-- Logs begin at Mon 2022-10-10 22:30:12 UTC, end at Tue 2022-10-11 01:13:18 UTC. -- Oct 10 23:05:52.224730 n-d-860864-2 systemd[1]: Starting Devstack devstack@n-api.service... Oct 10 23:05:52.232662 n-d-860864-2 devstack@n-api.service[104743]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 10 23:05:52.238893 n-d-860864-2 devstack@n-api.service[104743]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 10 23:05:52 2022] *** Oct 10 23:05:52.238893 n-d-860864-2 devstack@n-api.service[104743]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 10 23:05:52.238893 n-d-860864-2 devstack@n-api.service[104743]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 10 23:05:52.238893 n-d-860864-2 devstack@n-api.service[104743]: nodename: n-d-860864-2 Oct 10 23:05:52.238893 n-d-860864-2 devstack@n-api.service[104743]: machine: x86_64 Oct 10 23:05:52.238893 n-d-860864-2 devstack@n-api.service[104743]: clock source: unix Oct 10 23:05:52.238893 n-d-860864-2 devstack@n-api.service[104743]: pcre jit disabled Oct 10 23:05:52.238893 n-d-860864-2 devstack@n-api.service[104743]: detected number of CPU cores: 4 Oct 10 23:05:52.238893 n-d-860864-2 devstack@n-api.service[104743]: current working directory: / Oct 10 23:05:52.238893 n-d-860864-2 devstack@n-api.service[104743]: detected binary path: /usr/bin/uwsgi-core Oct 10 23:05:52.238893 n-d-860864-2 devstack@n-api.service[104743]: your processes number limit is 47680 Oct 10 23:05:52.238893 n-d-860864-2 devstack@n-api.service[104743]: your memory page size is 4096 bytes Oct 10 23:05:52.238893 n-d-860864-2 devstack@n-api.service[104743]: detected max file descriptor number: 2048 Oct 10 23:05:52.238893 n-d-860864-2 devstack@n-api.service[104743]: lock engine: pthread robust mutexes Oct 10 23:05:52.238893 n-d-860864-2 devstack@n-api.service[104743]: thunder lock: enabled Oct 10 23:05:52.238893 n-d-860864-2 devstack@n-api.service[104743]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 10 23:05:52.238893 n-d-860864-2 devstack@n-api.service[104743]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 10 23:05:52.276413 n-d-860864-2 devstack@n-api.service[104743]: Python main interpreter initialized at 0x56393202e9c0 Oct 10 23:05:52.276413 n-d-860864-2 devstack@n-api.service[104743]: python threads support enabled Oct 10 23:05:52.276413 n-d-860864-2 devstack@n-api.service[104743]: your server socket listen backlog is limited to 100 connections Oct 10 23:05:52.276413 n-d-860864-2 devstack@n-api.service[104743]: your mercy for graceful operations on workers is 90 seconds Oct 10 23:05:52.276826 n-d-860864-2 devstack@n-api.service[104743]: mapped 403077 bytes (393 KB) for 2 cores Oct 10 23:05:52.276826 n-d-860864-2 devstack@n-api.service[104743]: *** Operational MODE: preforking *** Oct 10 23:05:52.277143 n-d-860864-2 devstack@n-api.service[104743]: *** uWSGI is running in multiple interpreter mode *** Oct 10 23:05:52.277143 n-d-860864-2 devstack@n-api.service[104743]: spawned uWSGI master process (pid: 104743) Oct 10 23:05:52.277359 n-d-860864-2 systemd[1]: Started Devstack devstack@n-api.service. Oct 10 23:05:52.278104 n-d-860864-2 devstack@n-api.service[104743]: spawned uWSGI worker 1 (pid: 104745, cores: 1) Oct 10 23:05:52.278410 n-d-860864-2 devstack@n-api.service[104743]: spawned uWSGI worker 2 (pid: 104746, cores: 1) Oct 10 23:05:52.278579 n-d-860864-2 devstack@n-api.service[104743]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 10 23:05:52.959955 n-d-860864-2 devstack@n-api.service[104745]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 23:05:52.992324 n-d-860864-2 devstack@n-api.service[104746]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 23:05:54.067948 n-d-860864-2 devstack@n-api.service[104745]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 23:05:54.067948 n-d-860864-2 devstack@n-api.service[104745]: from cryptography.utils import int_from_bytes Oct 10 23:05:54.068563 n-d-860864-2 devstack@n-api.service[104745]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 23:05:54.068563 n-d-860864-2 devstack@n-api.service[104745]: from cryptography.utils import int_from_bytes Oct 10 23:05:54.095800 n-d-860864-2 devstack@n-api.service[104746]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 23:05:54.095800 n-d-860864-2 devstack@n-api.service[104746]: from cryptography.utils import int_from_bytes Oct 10 23:05:54.096374 n-d-860864-2 devstack@n-api.service[104746]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 23:05:54.096374 n-d-860864-2 devstack@n-api.service[104746]: from cryptography.utils import int_from_bytes Oct 10 23:05:56.613827 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 23:05:56.614503 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 23:05:56.614608 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 23:05:56.614964 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 23:05:56.615218 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 23:05:56.615606 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.615932 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.616252 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.616569 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.616896 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.617208 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.617301 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 23:05:56.617693 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.617779 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 23:05:56.617866 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.618104 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 23:05:56.618206 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.618428 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.618521 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 23:05:56.618699 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 23:05:56.618791 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.619051 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860864-2 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.619203 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.619372 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.619471 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.619681 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.619778 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.619993 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.620099 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.620309 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.620403 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.621652 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.621788 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.621866 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.621940 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.621940 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.622073 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.622435 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.622547 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.622547 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.622685 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.622753 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.622819 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.623003 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860864-2 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.623083 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.623325 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.623411 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.623632 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.623708 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.623939 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.624032 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.624258 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.624354 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.624562 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.624661 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.624878 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.624961 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.625180 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.625256 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.625602 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860864-2 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.625757 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.625922 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.626053 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.626233 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.626377 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.626546 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.626682 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.626920 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.627046 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.627227 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.627373 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.627534 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.627664 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.627849 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.627976 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.628193 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.628340 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.628466 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.628589 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.628742 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.628884 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.629086 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.629269 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860864-2 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.629438 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.629573 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.629735 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.629857 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.630021 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.630153 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.630439 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.630587 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.630714 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.630850 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.630975 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.631099 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.631235 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.631367 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.631503 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.631639 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.631771 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.631909 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.632034 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.632219 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.632354 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.632533 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.632668 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.632836 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.632979 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.633148 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.633285 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.633463 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.633603 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.633766 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.633900 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.634074 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.634202 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.634378 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.634613 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.634742 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.634865 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.634990 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.635121 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.635252 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.635412 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.635545 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.635676 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.635807 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.635931 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.636062 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.636195 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.636381 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.636549 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.636810 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.636947 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.637126 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.637263 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.637527 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.637682 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.637816 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.637979 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.638117 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.638250 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.638454 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.638582 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.638713 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.638846 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.638999 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.639143 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.639585 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.639726 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.639899 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.640039 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.640203 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.640343 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.640495 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.640701 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.640830 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.640964 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.641090 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.641213 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.641428 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.641575 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.641736 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.641872 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.642052 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.642187 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.642386 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.642515 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.642676 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.642811 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.642936 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.643070 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.643194 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.643318 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.643500 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.643629 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.643817 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.643945 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.644123 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.644251 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.644428 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.644556 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.644731 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.644859 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.645029 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.645164 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.645333 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.645522 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.645648 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.645771 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.645951 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.646079 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.646256 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.646392 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.646523 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.646749 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.646887 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.647026 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.647152 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.647276 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.647407 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.647540 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.647673 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.647814 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.647939 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.648069 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.648240 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.648368 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.648536 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.648677 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.648839 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.648968 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.649140 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.649267 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.649474 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.649613 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.649774 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.649909 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.650073 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.650209 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.650373 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.650513 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.650752 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.650907 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.651035 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.651159 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.651283 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.651424 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.651557 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.651682 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.651838 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.651974 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.652732 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.652935 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.653100 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.653429 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.653561 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.653721 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.653862 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.654026 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.654167 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.654342 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.654478 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.654649 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.654791 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.654955 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.655090 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.655257 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.655386 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.655562 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.655699 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.655865 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.655994 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.656168 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.656284 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.656470 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.656593 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.656774 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.656888 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.657074 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.657188 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.657405 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.657557 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.657719 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.657846 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.658025 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.658160 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.658330 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.658465 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.658631 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.658764 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.658933 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.659062 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.659232 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.659361 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.659522 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.659647 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.659818 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.659953 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.660117 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.660253 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.660416 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.660549 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.660715 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.660856 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.661067 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.661198 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.661322 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.661494 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.661623 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.661831 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.661959 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.662123 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.662258 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.662438 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.662566 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.662751 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.662887 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:05:56.663061 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.663189 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.663381 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.663515 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.663699 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.663833 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.664028 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.664155 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.664348 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.664471 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.664664 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.664784 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.664976 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.665087 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.665286 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.665451 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.665618 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.665752 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.665943 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.666072 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.666255 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.666389 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.666563 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.666684 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.666873 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.666986 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.667188 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.667325 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.667501 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.667620 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.668627 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.668927 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.669176 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.669624 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.669893 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.670084 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.670276 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.670465 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.670660 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.670660 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.671009 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.671313 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.671494 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.671494 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.671829 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.672029 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.672217 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.672411 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.672598 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.672785 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.672977 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.673149 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.673333 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.673540 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.673741 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.673942 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.674149 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.674344 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.674527 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.674705 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.674892 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.675091 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.675285 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.675454 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.675565 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.675673 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.675780 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.675906 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.676053 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.676179 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.676302 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.676426 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.676551 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.676689 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.676814 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.676940 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.677074 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.677199 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.677323 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.677483 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.677601 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.677734 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.677860 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.677985 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.678109 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.678244 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.678377 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.678509 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.678633 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.678757 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.678880 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.679014 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.679139 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.679262 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.679395 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.679520 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.679701 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.679842 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.679968 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.680093 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.680223 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.680347 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.680478 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.680603 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.680727 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.680850 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.680983 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.681127 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.681276 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.681493 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.681622 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.681759 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.681885 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.682015 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.682150 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.682281 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.682405 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.682534 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.682658 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.682781 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.682924 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.683050 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.683172 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.683303 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.683428 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.683544 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.683675 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.683799 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.683799 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.684053 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.684186 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.684370 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.684499 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.684682 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.684811 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.684994 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.685120 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.685324 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.685542 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.685676 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.685800 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.685930 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.686063 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.686229 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.686364 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.686537 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.686665 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.686859 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.686995 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.687166 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.687294 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.687471 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.687598 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.687779 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.687906 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.688086 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.688213 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.688395 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.688531 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.688702 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.688841 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.689005 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.689139 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.689306 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.689463 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.689642 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.689815 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.689942 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.690064 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.690239 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.690366 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.690544 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.690673 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.690862 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.690988 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.691172 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.691299 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.691556 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.691698 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.691834 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.691960 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.692091 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.692216 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.692370 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.692498 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.692674 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.692810 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.692977 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.693114 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.693278 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.693424 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.693616 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.693757 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.693919 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.694055 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.694222 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.694357 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.694524 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.694653 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.694826 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.694969 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.695131 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.695259 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.695452 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.695588 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.695758 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.695899 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.696059 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.696188 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.696360 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.696488 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.696661 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.696802 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.696973 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.697100 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.697293 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.697498 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.697649 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.697775 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.697932 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.698060 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.698241 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.698369 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.698559 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.698688 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.698884 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.699060 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.699256 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.699434 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.699602 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.699867 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.700106 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.700205 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.700423 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.700512 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.700739 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.700874 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.701084 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.701324 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.701478 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.701710 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.701848 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.701973 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.702107 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.702292 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.702422 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.702603 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.702733 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.702917 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.703045 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.703226 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.703354 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.703537 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.703652 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.703839 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.703952 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.704146 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.704260 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.704462 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.704577 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.704797 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.704909 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.705115 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.705229 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.705459 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.705591 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.705766 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.705880 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.706081 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.706203 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.706390 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.706503 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.706698 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.706837 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.707008 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.707145 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.707312 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.707439 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.707617 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.707744 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.707921 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.708064 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.708236 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.708364 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.708547 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.708673 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.708855 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.708990 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.709160 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.709285 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.709496 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.709624 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.709799 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.709970 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.710099 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.710230 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.710396 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.710526 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.710714 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.710827 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.711033 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.711144 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.711342 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.711455 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.711658 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.711806 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.712012 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.712144 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.712269 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.712393 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.712554 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.712691 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.712857 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.712985 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.713161 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.713299 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.713488 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.713617 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.713797 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.713926 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.714101 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.714318 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.714447 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.715101 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.715276 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.715406 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.715582 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.715894 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.716165 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.716302 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.716480 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.716614 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.716848 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.717000 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.717191 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.717477 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.717655 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.717839 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.718061 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.718242 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.718430 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.718620 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.718807 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.718996 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.719195 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.719384 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.719561 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.719740 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.719912 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.720153 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.720350 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.720525 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.720698 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.720871 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.721040 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.721202 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.721396 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.721575 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.721751 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.721932 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.722248 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.722453 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.722640 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.722826 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.723005 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.723192 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.723380 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.723578 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.723765 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.723765 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.724125 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.724302 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.724473 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.724661 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.724840 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.725024 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.725222 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.725516 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.725721 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.725909 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.726110 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.726304 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.726484 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.726662 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.726842 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.727026 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.727198 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.727330 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.727467 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.727593 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.727717 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.727841 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.727982 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.728109 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.728233 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.728349 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.728455 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.728588 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.728713 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.728844 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.728969 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.729093 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.729216 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.729354 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.729501 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.729501 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.729734 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.729858 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.729981 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.730162 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.730968 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.731110 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.731236 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.731360 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.731485 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.731630 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.731777 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.731904 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.732029 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.732153 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.732153 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.732506 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.732646 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.732646 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.732919 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.733044 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.733168 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.733292 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.733449 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.733577 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.733708 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.733833 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.733959 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.734092 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.734216 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.734340 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.734465 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.734589 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.734713 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.734845 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.734970 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.735095 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.735219 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.735343 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.735467 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.735645 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.735775 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.735900 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.736016 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.736126 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.736242 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.736350 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.736465 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.736580 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.736688 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.736794 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.736909 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.737029 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.737136 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.737242 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.737356 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.737501 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.737621 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.737731 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.737838 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.738001 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.738122 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.738277 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.738405 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.738595 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.738717 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.738908 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.739022 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.739214 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.739325 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.739504 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.739618 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.739818 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.739932 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.740128 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.740284 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.740432 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.740546 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.740749 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.740864 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.741131 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.741307 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.741461 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.741602 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.741713 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.741839 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.741974 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.742100 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.742271 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.742490 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.742625 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.742765 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.742896 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.743029 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.743154 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.743277 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.743466 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.743600 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.743774 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.743900 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.744076 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.744201 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.744379 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.744513 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.744682 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.744809 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.744983 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.745109 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.745287 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.745474 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.745609 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.745731 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.745922 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.746122 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.746267 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.746557 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.746788 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.746913 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.747069 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.747196 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.747378 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.747505 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.747716 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.747849 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.747974 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.748098 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.748286 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.748416 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.748591 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.748718 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.748895 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.749023 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.749197 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.749329 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.749527 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.749656 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.749856 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.750002 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.750161 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.750262 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.750465 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.750565 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.750776 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.750887 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.751091 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.751227 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.751377 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.751487 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.751712 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.751930 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.752071 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.752237 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.752379 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.752543 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.752698 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.752855 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.753022 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.753176 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.753335 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.753527 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.753748 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.753850 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.753984 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.754131 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.754288 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.754434 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.754605 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.754739 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.754917 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.755042 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.755231 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.755348 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.755535 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.755651 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.755838 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.755955 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.756228 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.756330 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.756467 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.756572 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.756776 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.756864 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.757098 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.757195 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.757443 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.757534 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.757750 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.757836 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.758055 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.758153 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.758358 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.758445 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.758663 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.758749 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.758970 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.759067 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.759281 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.759375 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.759590 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.759679 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.759900 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.760001 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.760212 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.760301 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.760522 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.760608 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.760828 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.760924 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.761136 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.761222 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.761983 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.762178 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.762342 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.762666 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.762830 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.762982 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.763123 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.763261 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.763409 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.763546 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.763699 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.763779 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.764004 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.764082 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.764333 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.764673 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.764893 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.764992 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.765206 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.765300 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.765565 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.765651 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.765889 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.765968 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.766214 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.766306 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.766518 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.766596 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.766827 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.766904 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.767135 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.767223 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.767440 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.767524 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.767750 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.767842 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.768053 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.768201 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.768359 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.768451 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.768669 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.768768 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.768977 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.769144 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.769279 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.769362 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.769613 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.769702 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.769927 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.770022 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.770237 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.770327 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.770544 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.770641 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.770849 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.770938 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.771149 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.771236 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.771472 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.771624 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.771763 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.771890 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.772046 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.772175 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.772347 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.772478 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.772655 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.772870 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.773000 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.773126 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.773358 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.773535 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.773698 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.773825 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.774008 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.774136 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.774309 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.774448 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.774616 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.774744 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.774926 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.775063 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.775239 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.775376 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.775551 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.775681 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.775850 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.775984 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.776188 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.776325 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.776511 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.776641 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.776835 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.776965 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.777723 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.777860 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.778236 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.778549 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.778816 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.778957 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.779244 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.779447 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.779599 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.779736 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.779864 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.779991 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.780119 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.780246 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.780453 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.780623 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.780755 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.780886 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.781021 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.781149 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.781290 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.781473 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.781596 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.781755 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.781988 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.782119 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.782301 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.782418 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.782607 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.782738 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.782946 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.783083 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.783271 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.783377 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.783577 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.783678 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.783891 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.784007 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.784201 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.784300 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.784510 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.784608 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.784816 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.784928 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.785121 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.785219 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.785452 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.785551 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.785773 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.785946 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.786096 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.786253 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.786403 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.786548 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.786713 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.786858 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.787020 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.787172 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.787320 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.787470 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.787632 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.787780 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.787929 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.788078 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.788225 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.788370 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.788531 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.788691 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.788840 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.788988 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.789135 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.789263 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.789447 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.789612 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.789767 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.789885 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.790028 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.790129 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.790357 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.790446 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.790670 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.790758 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.790983 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.791079 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.791289 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.791377 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.791614 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.791762 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.791917 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.792059 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.792225 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.792356 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.792533 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.792664 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.793139 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.793924 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.794109 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.794243 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.794372 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.794551 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.794693 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.794880 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.795010 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.795190 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.795320 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.795515 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.795653 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.795833 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.795963 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.796158 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.796288 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.796465 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.796603 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.796774 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.796901 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.797087 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.797215 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.797421 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.797568 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.797718 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.797847 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.798023 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.798161 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.798327 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.798472 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.798632 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.798761 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.798962 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.799090 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.799273 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.799403 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.799600 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.799729 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.799910 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.800039 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.800224 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.800353 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.800543 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.800721 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.800856 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.800993 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.801168 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.801297 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.801497 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.801627 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.801816 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.801951 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.802132 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.802261 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.802431 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.802559 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.802734 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.802872 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.803041 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.803192 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.803391 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.803520 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.803645 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.803779 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.803905 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.804207 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.804333 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.804508 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.804635 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.804809 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.804938 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.805109 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.805244 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.805451 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.805619 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.805750 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.805877 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.806066 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.806196 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.806373 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.806511 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.806675 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.806805 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.806977 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.807108 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.807277 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.807416 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.807604 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.807733 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.807904 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.808033 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.808228 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.808359 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.808943 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.809072 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.809320 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.809473 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.809677 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.809796 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.810002 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.810122 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.810322 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.810446 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.810638 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.810748 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.810950 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.811066 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.811269 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.811394 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.811585 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.811709 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.811930 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.812065 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.812208 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.812337 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.812520 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.812636 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.812832 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.812955 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.813146 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.813462 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.813605 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.813764 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.813890 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.814084 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.814212 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.814395 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.814517 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.814709 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.814824 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.815025 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.815149 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.815340 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.815457 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.815653 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.815778 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.815965 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.816094 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.816276 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.816418 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.817075 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.817208 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.817346 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.817513 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.817655 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.817784 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.817920 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.818056 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.818184 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.818311 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.818445 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.818573 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.818706 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.818841 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.818968 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.819095 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.819221 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.819347 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.819473 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.819625 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.819755 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.822414 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.822582 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.822732 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.822874 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.823002 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.823128 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.823260 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.823387 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.823530 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.823753 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.823886 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.824493 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.824620 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.824765 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.824892 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.825027 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.825154 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.825280 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.825280 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.825537 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.825678 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.825808 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.825934 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.826059 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.826184 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.826317 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.826453 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.826580 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.826713 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.826856 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.826856 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.827095 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.827229 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.827355 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.827481 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.827606 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.827738 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.827738 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.828004 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.828138 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.828264 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.828389 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.828515 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.828649 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.828784 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.828911 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.829037 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.829162 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.829162 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.829498 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.829628 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.829754 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.829879 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.830007 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.830134 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.830270 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.830396 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.830522 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.830655 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.830782 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.830916 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.831045 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.831170 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.831301 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.831427 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.831560 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.831695 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.831821 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.831946 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.832079 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.832205 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.832330 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.832523 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.832662 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.832801 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.832960 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.833111 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.833111 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.833400 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.833542 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.833674 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.833905 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.834048 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.834204 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.834335 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.834473 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.834611 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.834759 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.834889 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.835036 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.835174 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.835317 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.835446 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.835583 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.835718 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.835860 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.835999 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.836135 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.836284 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.836414 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.836552 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.836697 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.836837 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.836966 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.837099 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.837225 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.837361 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.837544 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.837791 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.837928 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.838091 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.838219 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.838399 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.838538 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.838704 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.838834 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.839007 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.839137 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.839309 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.839448 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.840196 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.840411 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.840548 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.840819 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.841056 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.841189 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.841390 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.841527 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.841717 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.841862 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.842025 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.842164 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.842339 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.842470 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.842637 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.842774 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.842942 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.843073 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.843247 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.843386 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.843554 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.844237 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.844376 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.844504 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.844630 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.844766 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.844903 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.845031 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.845157 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.845284 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.845441 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.845572 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.845713 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.845840 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.845966 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.846099 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.846099 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.846337 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.846471 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.846597 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.846723 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.846849 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.846982 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.847115 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.847250 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.847403 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.847532 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.847658 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.847807 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.848071 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.848202 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.848402 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.848532 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.848724 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.848857 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.849034 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.849164 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.849341 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.849507 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.849676 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.849982 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.850121 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.850286 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.850416 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.850607 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.850737 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.850917 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.851049 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.851229 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.851360 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.851543 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.851687 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.851850 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.851989 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.852158 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.852296 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.852465 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.852596 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.852771 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.852900 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.853066 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.853197 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.853459 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.853608 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.853736 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.853862 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.853987 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.854141 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.854286 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.854500 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.854631 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.854758 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.854892 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.855019 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.855193 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.855455 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.855783 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.856099 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.856241 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.856404 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.856548 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.856713 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.856851 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.857027 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.857156 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.857335 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.857504 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.857668 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.857799 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.857976 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.858106 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.858284 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.858422 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.858593 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.858722 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.858898 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.859036 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.859204 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.859344 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.859510 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.859649 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.859810 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.859940 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.860112 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.860419 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.860548 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.860730 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.860860 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.861038 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.861177 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.861346 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.861546 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.861677 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.861865 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.861996 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.862192 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.862322 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.862519 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.862650 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.862836 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.862978 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.863158 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.863287 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.863469 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.863604 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.863798 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.863982 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.864141 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.864270 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.864547 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.864689 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.864835 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.864970 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.865097 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.865223 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.865360 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.865579 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.865716 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.865851 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.865986 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.866113 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.866289 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.866419 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.867082 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.867323 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.867503 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.867503 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.867760 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.868520 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.868891 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.869081 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.870259 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.870963 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.870963 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.871470 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.871741 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.872015 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.872179 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.872179 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.872523 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.872952 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.873197 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.874194 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.874194 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.874549 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.874929 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.875315 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.875543 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.875543 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.875543 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.875543 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.876543 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.876787 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.876933 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.877715 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.877715 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.878531 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.879184 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.879633 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.880002 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.880002 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.880404 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.880653 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.880803 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.881021 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.881021 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.881422 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.881591 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.881721 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.881869 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.881869 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.882109 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.882274 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.882405 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.882541 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.882541 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.882791 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.882956 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.882956 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.883206 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.883372 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.883518 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.883645 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 23:05:56.883773 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.883773 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.883773 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.883773 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.883773 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.883773 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.883773 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.883773 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.884712 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.884712 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.884712 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.884712 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.884712 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.884712 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.884712 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.884712 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.885799 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.885799 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.885799 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.886180 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.886180 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.887023 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.887921 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.888245 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.888584 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.888903 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.889220 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.889825 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.890143 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.890458 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.890781 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.891095 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.891408 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.891727 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.892047 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.892377 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.892706 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.893019 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.893345 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.893732 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.894088 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.894404 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.894752 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.895106 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.895394 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.895705 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.896012 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:05:56.896257 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 23:05:57.034233 n-d-860864-2 devstack@n-api.service[104746]: INFO dbcounter [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] Registered counter for database nova_api Oct 10 23:05:57.056090 n-d-860864-2 devstack@n-api.service[104746]: DEBUG oslo_db.sqlalchemy.engines [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104746) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 23:05:57.057521 n-d-860864-2 devstack@n-api.service[104745]: INFO dbcounter [None req-9144a45c-5fce-45ad-86cb-31531c5d1ed6 None None] Registered counter for database nova_api Oct 10 23:05:57.063018 n-d-860864-2 devstack@n-api.service[104746]: DEBUG dbcounter [-] [104746] Writer thread running {{(pid=104746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 23:05:57.079347 n-d-860864-2 devstack@n-api.service[104745]: DEBUG oslo_db.sqlalchemy.engines [None req-9144a45c-5fce-45ad-86cb-31531c5d1ed6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 23:05:57.086240 n-d-860864-2 devstack@n-api.service[104745]: DEBUG dbcounter [-] [104745] Writer thread running {{(pid=104745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 23:05:57.121995 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.context [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c35e3cac-0e4f-44cc-a53a-8910e1eecc88(cell1) {{(pid=104746) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 23:05:57.125984 n-d-860864-2 devstack@n-api.service[104746]: DEBUG oslo_concurrency.lockutils [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:05:57.126462 n-d-860864-2 devstack@n-api.service[104746]: DEBUG oslo_concurrency.lockutils [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:05:57.128030 n-d-860864-2 devstack@n-api.service[104746]: DEBUG oslo_concurrency.lockutils [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:05:57.128782 n-d-860864-2 devstack@n-api.service[104746]: DEBUG oslo_concurrency.lockutils [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:05:57.129226 n-d-860864-2 devstack@n-api.service[104746]: DEBUG oslo_concurrency.lockutils [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:05:57.131244 n-d-860864-2 devstack@n-api.service[104746]: DEBUG oslo_concurrency.lockutils [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:05:57.133260 n-d-860864-2 devstack@n-api.service[104746]: INFO dbcounter [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] Registered counter for database nova_cell0 Oct 10 23:05:57.137859 n-d-860864-2 devstack@n-api.service[104746]: INFO dbcounter [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] Registered counter for database nova_cell1 Oct 10 23:05:57.145469 n-d-860864-2 devstack@n-api.service[104746]: DEBUG oslo_db.sqlalchemy.engines [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104746) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 23:05:57.147033 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.context [None req-9144a45c-5fce-45ad-86cb-31531c5d1ed6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c35e3cac-0e4f-44cc-a53a-8910e1eecc88(cell1) {{(pid=104745) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 23:05:57.147182 n-d-860864-2 devstack@n-api.service[104746]: DEBUG oslo_db.sqlalchemy.engines [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104746) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 23:05:57.150988 n-d-860864-2 devstack@n-api.service[104745]: DEBUG oslo_concurrency.lockutils [None req-9144a45c-5fce-45ad-86cb-31531c5d1ed6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:05:57.151465 n-d-860864-2 devstack@n-api.service[104745]: DEBUG oslo_concurrency.lockutils [None req-9144a45c-5fce-45ad-86cb-31531c5d1ed6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:05:57.153235 n-d-860864-2 devstack@n-api.service[104746]: DEBUG dbcounter [-] [104746] Writer thread running {{(pid=104746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 23:05:57.154218 n-d-860864-2 devstack@n-api.service[104745]: DEBUG oslo_concurrency.lockutils [None req-9144a45c-5fce-45ad-86cb-31531c5d1ed6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=104745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:05:57.154958 n-d-860864-2 devstack@n-api.service[104745]: DEBUG oslo_concurrency.lockutils [None req-9144a45c-5fce-45ad-86cb-31531c5d1ed6 None None] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:05:57.155401 n-d-860864-2 devstack@n-api.service[104745]: DEBUG oslo_concurrency.lockutils [None req-9144a45c-5fce-45ad-86cb-31531c5d1ed6 None None] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:05:57.157423 n-d-860864-2 devstack@n-api.service[104745]: DEBUG oslo_concurrency.lockutils [None req-9144a45c-5fce-45ad-86cb-31531c5d1ed6 None None] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:05:57.158488 n-d-860864-2 devstack@n-api.service[104746]: DEBUG dbcounter [-] [104746] Writer thread running {{(pid=104746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 23:05:57.159438 n-d-860864-2 devstack@n-api.service[104745]: INFO dbcounter [None req-9144a45c-5fce-45ad-86cb-31531c5d1ed6 None None] Registered counter for database nova_cell0 Oct 10 23:05:57.163575 n-d-860864-2 devstack@n-api.service[104745]: INFO dbcounter [None req-9144a45c-5fce-45ad-86cb-31531c5d1ed6 None None] Registered counter for database nova_cell1 Oct 10 23:05:57.171576 n-d-860864-2 devstack@n-api.service[104745]: DEBUG oslo_db.sqlalchemy.engines [None req-9144a45c-5fce-45ad-86cb-31531c5d1ed6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 23:05:57.174835 n-d-860864-2 devstack@n-api.service[104745]: DEBUG oslo_db.sqlalchemy.engines [None req-9144a45c-5fce-45ad-86cb-31531c5d1ed6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 23:05:57.178509 n-d-860864-2 devstack@n-api.service[104745]: DEBUG dbcounter [-] [104745] Writer thread running {{(pid=104745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 23:05:57.184804 n-d-860864-2 devstack@n-api.service[104745]: DEBUG dbcounter [-] [104745] Writer thread running {{(pid=104745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 23:05:57.303555 n-d-860864-2 devstack@n-api.service[104746]: INFO dbcounter [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] Registered counter for database nova_cell0 Oct 10 23:05:57.312582 n-d-860864-2 devstack@n-api.service[104746]: DEBUG oslo_db.sqlalchemy.engines [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104746) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 23:05:57.317922 n-d-860864-2 devstack@n-api.service[104746]: DEBUG dbcounter [-] [104746] Writer thread running {{(pid=104746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 23:05:57.333405 n-d-860864-2 devstack@n-api.service[104745]: INFO dbcounter [None req-9144a45c-5fce-45ad-86cb-31531c5d1ed6 None None] Registered counter for database nova_cell0 Oct 10 23:05:57.344047 n-d-860864-2 devstack@n-api.service[104745]: DEBUG oslo_db.sqlalchemy.engines [None req-9144a45c-5fce-45ad-86cb-31531c5d1ed6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 23:05:57.349710 n-d-860864-2 devstack@n-api.service[104745]: DEBUG dbcounter [-] [104745] Writer thread running {{(pid=104745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 23:05:57.665664 n-d-860864-2 devstack@n-api.service[104746]: WARNING keystonemiddleware.auth_token [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 23:05:57.673127 n-d-860864-2 devstack@n-api.service[104746]: WARNING keystonemiddleware.auth_token [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 23:05:57.673783 n-d-860864-2 devstack@n-api.service[104745]: WARNING keystonemiddleware.auth_token [None req-9144a45c-5fce-45ad-86cb-31531c5d1ed6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 23:05:57.681224 n-d-860864-2 devstack@n-api.service[104745]: WARNING keystonemiddleware.auth_token [None req-9144a45c-5fce-45ad-86cb-31531c5d1ed6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 23:05:58.021802 n-d-860864-2 devstack@n-api.service[104746]: WARNING keystonemiddleware.auth_token [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 23:05:58.027249 n-d-860864-2 devstack@n-api.service[104745]: WARNING keystonemiddleware.auth_token [None req-9144a45c-5fce-45ad-86cb-31531c5d1ed6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 23:05:58.027896 n-d-860864-2 devstack@n-api.service[104746]: WARNING keystonemiddleware.auth_token [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 23:05:58.033629 n-d-860864-2 devstack@n-api.service[104745]: WARNING keystonemiddleware.auth_token [None req-9144a45c-5fce-45ad-86cb-31531c5d1ed6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 23:05:58.034070 n-d-860864-2 devstack@n-api.service[104746]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56393202e9c0 pid: 104746 (default app) Oct 10 23:05:58.036203 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] Calling method '>' {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:05:58.037411 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001781 Oct 10 23:05:58.038247 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Mon Oct 10 23:05:58 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:05:58.039030 n-d-860864-2 devstack@n-api.service[104745]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56393202e9c0 pid: 104745 (default app) Oct 10 23:07:23.155110 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] Calling method '>' {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:07:23.157036 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002639 Oct 10 23:07:23.157899 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 931 bytes} [Mon Oct 10 23:07:23 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:07:23.179361 n-d-860864-2 devstack@n-api.service[104745]: DEBUG dbcounter [-] [104745] Writing DB stats nova_api:SELECT=3 {{(pid=104745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:07:23.180833 n-d-860864-2 devstack@n-api.service[104745]: DEBUG dbcounter [-] [104745] Writing DB stats nova_cell0:SELECT=3 {{(pid=104745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:07:23.181989 n-d-860864-2 devstack@n-api.service[104745]: DEBUG dbcounter [-] [104745] Writing DB stats nova_cell1:SELECT=3 {{(pid=104745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:07:23.183178 n-d-860864-2 devstack@n-api.service[104745]: DEBUG dbcounter [-] [104745] Writing DB stats nova_cell0:SELECT=3 {{(pid=104745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:07:24.087744 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-3b0da40f-48a1-4c24-86ef-bbf964dbf636 admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:07:24.122340 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-3b0da40f-48a1-4c24-86ef-bbf964dbf636 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.952956 Oct 10 23:07:24.123084 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1292 bytes} [Mon Oct 10 23:07:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:07:26.816969 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] Calling method '>' {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:07:26.818599 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-5992892e-2718-401e-a5aa-fc5b063c7d78 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002033 Oct 10 23:07:26.819883 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 931 bytes} [Mon Oct 10 23:07:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:07:27.263172 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-0e586754-3a17-4c1c-afb6-ecf379e76946 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "name": "cirros256", "swap": 0, "id": "c1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:07:27.313504 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-0e586754-3a17-4c1c-afb6-ecf379e76946 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.486529 Oct 10 23:07:27.313949 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1283 bytes} [Mon Oct 10 23:07:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:07:27.327655 n-d-860864-2 devstack@n-api.service[104746]: DEBUG dbcounter [-] [104746] Writing DB stats nova_api:SELECT=3 {{(pid=104746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:07:27.328688 n-d-860864-2 devstack@n-api.service[104746]: DEBUG dbcounter [-] [104746] Writing DB stats nova_cell1:SELECT=3 {{(pid=104746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:07:27.330086 n-d-860864-2 devstack@n-api.service[104746]: DEBUG dbcounter [-] [104746] Writing DB stats nova_cell0:SELECT=3 {{(pid=104746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:07:27.330954 n-d-860864-2 devstack@n-api.service[104746]: DEBUG dbcounter [-] [104746] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:07:27.549277 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-e4ff3c1f-f2cd-46f1-93a5-bd6a08b8ffd6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:07:27.629283 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-e4ff3c1f-f2cd-46f1-93a5-bd6a08b8ffd6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.306925 Oct 10 23:07:27.629916 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1336 bytes} [Mon Oct 10 23:07:27 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:07:30.453426 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-0e586754-3a17-4c1c-afb6-ecf379e76946 admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:07:30.455047 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-0e586754-3a17-4c1c-afb6-ecf379e76946 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002185 Oct 10 23:07:30.455614 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 931 bytes} [Mon Oct 10 23:07:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:07:31.436074 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-02ce3d44-8df5-4344-83c4-72e8afa3e733 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "rxtx_factor": 1.0, "swap": 0, "name": "ds512M", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d1"}} {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:07:31.480128 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-02ce3d44-8df5-4344-83c4-72e8afa3e733 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.017413 Oct 10 23:07:31.481499 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1283 bytes} [Mon Oct 10 23:07:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:07:31.501013 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-67db2a0d-5796-48c7-ab88-aa02c0069a14 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:07:31.558436 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-67db2a0d-5796-48c7-ab88-aa02c0069a14 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063759 Oct 10 23:07:31.560950 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1336 bytes} [Mon Oct 10 23:07:31 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:07:35.112740 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-02ce3d44-8df5-4344-83c4-72e8afa3e733 admin admin] Calling method '>' {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:07:35.115719 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-02ce3d44-8df5-4344-83c4-72e8afa3e733 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003726 Oct 10 23:07:35.117937 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 931 bytes} [Mon Oct 10 23:07:35 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:07:35.629391 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-a90886de-a8f8-42e7-bfa7-7cf9699dcc4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "swap": 0, "id": "d2", "vcpus": 1, "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G"}} {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:07:35.649994 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-a90886de-a8f8-42e7-bfa7-7cf9699dcc4c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.522416 Oct 10 23:07:35.650460 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1283 bytes} [Mon Oct 10 23:07:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:07:35.664756 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-a3460f5f-ac64-4ddf-8e23-8fc3221e0182 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:07:35.700524 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-a3460f5f-ac64-4ddf-8e23-8fc3221e0182 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040492 Oct 10 23:07:35.702062 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1336 bytes} [Mon Oct 10 23:07:35 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:07:38.509754 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-a90886de-a8f8-42e7-bfa7-7cf9699dcc4c admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:07:38.510706 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-a90886de-a8f8-42e7-bfa7-7cf9699dcc4c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Oct 10 23:07:38.511592 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 931 bytes} [Mon Oct 10 23:07:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:07:39.033364 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-0b8e5fac-ba74-4486-b65f-cb68f9502c1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "disk": 10, "id": "d3", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G"}} {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:07:39.064084 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-0b8e5fac-ba74-4486-b65f-cb68f9502c1b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.544486 Oct 10 23:07:39.065126 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1283 bytes} [Mon Oct 10 23:07:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:07:39.078378 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-cec7f333-1c5b-4ea9-a7db-f8df9bbb22c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:07:39.165313 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-cec7f333-1c5b-4ea9-a7db-f8df9bbb22c4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091298 Oct 10 23:07:39.166138 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1336 bytes} [Mon Oct 10 23:07:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:07:41.943758 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-0b8e5fac-ba74-4486-b65f-cb68f9502c1b admin admin] Calling method '>' {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:07:41.945425 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-0b8e5fac-ba74-4486-b65f-cb68f9502c1b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Oct 10 23:07:41.946727 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 931 bytes} [Mon Oct 10 23:07:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:07:42.541337 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-716a8ffd-f97f-4f7b-8a83-066fefb9e1eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "disk": 20, "name": "ds4G"}} {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:07:42.568854 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-716a8ffd-f97f-4f7b-8a83-066fefb9e1eb admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.615461 Oct 10 23:07:42.570198 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1283 bytes} [Mon Oct 10 23:07:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:07:42.582206 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-c23ced90-8b08-4c5f-a93f-03017bc373de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:07:42.611601 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-c23ced90-8b08-4c5f-a93f-03017bc373de admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032947 Oct 10 23:07:42.626390 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1336 bytes} [Mon Oct 10 23:07:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:07:45.385406 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-716a8ffd-f97f-4f7b-8a83-066fefb9e1eb admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:07:45.386837 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-716a8ffd-f97f-4f7b-8a83-066fefb9e1eb admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001995 Oct 10 23:07:45.387319 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 931 bytes} [Mon Oct 10 23:07:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:07:45.930990 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-17eb95a7-6499-4c5d-898f-671828e2e4eb admin admin] Calling method '>' {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:07:45.960106 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-17eb95a7-6499-4c5d-898f-671828e2e4eb admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.565570 Oct 10 23:07:45.960660 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1292 bytes} [Mon Oct 10 23:07:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:07:48.905368 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-716a8ffd-f97f-4f7b-8a83-066fefb9e1eb admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:07:48.906424 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-716a8ffd-f97f-4f7b-8a83-066fefb9e1eb admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Oct 10 23:07:48.906836 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 931 bytes} [Mon Oct 10 23:07:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:07:49.412075 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-661d0511-a776-496d-8be9-2e08135ce1ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "vcpus": 1, "name": "m1.tiny", "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0}} {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:07:49.433556 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-661d0511-a776-496d-8be9-2e08135ce1ff admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.519578 Oct 10 23:07:49.434180 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1283 bytes} [Mon Oct 10 23:07:48 2022] POST /compute/v2.1/flavors => generated 402 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 23:07:49.447420 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-224b18c0-a64f-4863-a9ef-0edd01e463f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:07:49.477358 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-224b18c0-a64f-4863-a9ef-0edd01e463f6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033629 Oct 10 23:07:49.478141 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1333 bytes} [Mon Oct 10 23:07:49 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:07:52.164677 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-661d0511-a776-496d-8be9-2e08135ce1ff admin admin] Calling method '>' {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:07:52.165743 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-661d0511-a776-496d-8be9-2e08135ce1ff admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 10 23:07:52.166143 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 931 bytes} [Mon Oct 10 23:07:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:07:52.609667 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-daba739c-c3ea-402f-b1b4-229d7aa3b193 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.small", "disk": 20}} {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:07:52.631948 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-daba739c-c3ea-402f-b1b4-229d7aa3b193 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.458564 Oct 10 23:07:52.632606 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1283 bytes} [Mon Oct 10 23:07:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:07:52.647788 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-321dc224-1e54-48c0-820a-dedb8cb1c0bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:07:52.674286 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-321dc224-1e54-48c0-820a-dedb8cb1c0bf admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030376 Oct 10 23:07:52.674988 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1333 bytes} [Mon Oct 10 23:07:52 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:07:55.476577 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-daba739c-c3ea-402f-b1b4-229d7aa3b193 admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:07:55.477547 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-daba739c-c3ea-402f-b1b4-229d7aa3b193 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001674 Oct 10 23:07:55.477982 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 931 bytes} [Mon Oct 10 23:07:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:07:55.994636 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-2ccbc62c-546f-488e-aa8b-dac2992b8617 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "m1.medium", "id": "3"}} {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:07:56.016504 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-2ccbc62c-546f-488e-aa8b-dac2992b8617 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.530067 Oct 10 23:07:56.019989 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1283 bytes} [Mon Oct 10 23:07:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:07:56.029202 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-7f83f864-3e9c-4a7a-b854-d37816fe4d14 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:07:56.033989 n-d-860864-2 devstack@n-api.service[104745]: DEBUG dbcounter [-] [104745] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:07:56.061710 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-7f83f864-3e9c-4a7a-b854-d37816fe4d14 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036185 Oct 10 23:07:56.062877 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1333 bytes} [Mon Oct 10 23:07:56 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:07:58.764581 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-2ccbc62c-546f-488e-aa8b-dac2992b8617 admin admin] Calling method '>' {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:07:58.765639 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-2ccbc62c-546f-488e-aa8b-dac2992b8617 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 10 23:07:58.766082 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 931 bytes} [Mon Oct 10 23:07:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:07:59.262697 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-b7dcd8b9-bf89-430c-9ac1-dc72397c9c7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "disk": 80, "swap": 0, "ram": 8192, "name": "m1.large", "id": "4", "os-flavor-access:is_public": true}} {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:07:59.285801 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-b7dcd8b9-bf89-430c-9ac1-dc72397c9c7c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.512629 Oct 10 23:07:59.295948 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1283 bytes} [Mon Oct 10 23:07:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:07:59.302433 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-bcc9eacf-4017-4dbd-a1eb-53193a37faca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:07:59.307397 n-d-860864-2 devstack@n-api.service[104746]: DEBUG dbcounter [-] [104746] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=104746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:07:59.332939 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-bcc9eacf-4017-4dbd-a1eb-53193a37faca admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034392 Oct 10 23:07:59.334099 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1333 bytes} [Mon Oct 10 23:07:59 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:08:02.098580 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-b7dcd8b9-bf89-430c-9ac1-dc72397c9c7c admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:02.100767 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-b7dcd8b9-bf89-430c-9ac1-dc72397c9c7c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002734 Oct 10 23:08:02.101389 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 931 bytes} [Mon Oct 10 23:08:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:08:02.624886 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-f28873ad-74d2-402d-bd9c-7144f85e457c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "id": "5", "rxtx_factor": 1.0, "disk": 160, "os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8}} {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:08:02.651897 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-f28873ad-74d2-402d-bd9c-7144f85e457c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.542959 Oct 10 23:08:02.652459 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1283 bytes} [Mon Oct 10 23:08:02 2022] POST /compute/v2.1/flavors => generated 408 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:08:02.666205 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-8b7fc127-3c21-4dd1-b416-e4019f9ce181 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:08:02.699189 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-8b7fc127-3c21-4dd1-b416-e4019f9ce181 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036925 Oct 10 23:08:02.699898 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1333 bytes} [Mon Oct 10 23:08:02 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:08:22.494485 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-f28873ad-74d2-402d-bd9c-7144f85e457c admin admin] Calling method '>' {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:22.495428 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-f28873ad-74d2-402d-bd9c-7144f85e457c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 10 23:08:22.495847 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 931 bytes} [Mon Oct 10 23:08:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:08:22.507341 n-d-860864-2 devstack@n-api.service[104745]: DEBUG dbcounter [-] [104745] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:08:22.916863 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-51e94984-7c0d-41ae-84ef-10ff9c36e865 admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:22.935921 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-51e94984-7c0d-41ae-84ef-10ff9c36e865 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.432986 Oct 10 23:08:22.936469 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1292 bytes} [Mon Oct 10 23:08:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:08:24.295418 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-f28873ad-74d2-402d-bd9c-7144f85e457c admin admin] Calling method '>' {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:24.296425 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-f28873ad-74d2-402d-bd9c-7144f85e457c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002034 Oct 10 23:08:24.296834 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Oct 10 23:08:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:08:24.862867 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-f911edbc-c7ca-4e5b-83c2-f8c8fe7faeee admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:24.868240 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.wsgi [None req-f911edbc-c7ca-4e5b-83c2-f8c8fe7faeee admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 10 23:08:24.871668 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-f911edbc-c7ca-4e5b-83c2-f8c8fe7faeee admin admin] Request method failure captured: Oct 10 23:08:24.871668 n-d-860864-2 devstack@n-api.service[104745]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 10 23:08:24.871668 n-d-860864-2 devstack@n-api.service[104745]: Accept: application/json Oct 10 23:08:24.871668 n-d-860864-2 devstack@n-api.service[104745]: Accept-Encoding: gzip, deflate Oct 10 23:08:24.871668 n-d-860864-2 devstack@n-api.service[104745]: Connection: keep-alive Oct 10 23:08:24.871668 n-d-860864-2 devstack@n-api.service[104745]: Content-Length: 0 Oct 10 23:08:24.871668 n-d-860864-2 devstack@n-api.service[104745]: Host: 10.222.0.23 Oct 10 23:08:24.871668 n-d-860864-2 devstack@n-api.service[104745]: Openstack-Api-Version: compute 2.92 Oct 10 23:08:24.871668 n-d-860864-2 devstack@n-api.service[104745]: Openstack-System-Scope: None Oct 10 23:08:24.871668 n-d-860864-2 devstack@n-api.service[104745]: User-Agent: python-novaclient Oct 10 23:08:24.871668 n-d-860864-2 devstack@n-api.service[104745]: X-Auth-Token: gAAAAABjRKXoLTKS9U6h1Y3RhsYNxEetPhE9aVhaEc9xAJ5036LMxE5_HTJHW2OT9PnpjUwdavacBvDh6AsSbEuEuQ_4jisbTcvEE8LWn8Ih2AqQ0IyM0Mu4lR2IvkDEo-7YeKOz1BXt7F4seWoh_XUKbH_vXYKhMg96c9JsMFPog3Y8f-ZEQoI Oct 10 23:08:24.871668 n-d-860864-2 devstack@n-api.service[104745]: X-Domain-Id: None Oct 10 23:08:24.871668 n-d-860864-2 devstack@n-api.service[104745]: X-Domain-Name: None Oct 10 23:08:24.871668 n-d-860864-2 devstack@n-api.service[104745]: X-Identity-Status: Confirmed Oct 10 23:08:24.871668 n-d-860864-2 devstack@n-api.service[104745]: X-Is-Admin-Project: True Oct 10 23:08:24.871668 n-d-860864-2 devstack@n-api.service[104745]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 23:08:24.871668 n-d-860864-2 devstack@n-api.service[104745]: X-Project-Domain-Id: default Oct 10 23:08:24.871668 n-d-860864-2 devstack@n-api.service[104745]: X-Project-Domain-Name: Default Oct 10 23:08:24.871668 n-d-860864-2 devstack@n-api.service[104745]: X-Project-Id: d769f65de8ef46e696d436b16a64ed44 Oct 10 23:08:24.871668 n-d-860864-2 devstack@n-api.service[104745]: X-Project-Name: admin Oct 10 23:08:24.871668 n-d-860864-2 devstack@n-api.service[104745]: X-Role: admin,member,reader Oct 10 23:08:24.871668 n-d-860864-2 devstack@n-api.service[104745]: X-Roles: admin,member,reader Oct 10 23:08:24.874163 n-d-860864-2 devstack@n-api.service[104745]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d769f65de8ef46e696d436b16a64ed44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d769f65de8ef46e696d436b16a64ed44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d769f65de8ef46e696d436b16a64ed44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d769f65de8ef46e696d436b16a64ed44", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:08:24.874163 n-d-860864-2 devstack@n-api.service[104745]: X-Tenant: admin Oct 10 23:08:24.874163 n-d-860864-2 devstack@n-api.service[104745]: X-Tenant-Id: d769f65de8ef46e696d436b16a64ed44 Oct 10 23:08:24.874163 n-d-860864-2 devstack@n-api.service[104745]: X-Tenant-Name: admin Oct 10 23:08:24.874163 n-d-860864-2 devstack@n-api.service[104745]: X-User: admin Oct 10 23:08:24.874163 n-d-860864-2 devstack@n-api.service[104745]: X-User-Domain-Id: default Oct 10 23:08:24.874163 n-d-860864-2 devstack@n-api.service[104745]: X-User-Domain-Name: Default Oct 10 23:08:24.874163 n-d-860864-2 devstack@n-api.service[104745]: X-User-Id: d697fe98a7474e58a1000b428f92c240 Oct 10 23:08:24.874163 n-d-860864-2 devstack@n-api.service[104745]: X-User-Name: admin Oct 10 23:08:24.874163 n-d-860864-2 devstack@n-api.service[104745]: method: > Oct 10 23:08:24.874163 n-d-860864-2 devstack@n-api.service[104745]: exception: Flavor 42 could not be found. Oct 10 23:08:24.874163 n-d-860864-2 devstack@n-api.service[104745]: action_args: {'id': '42'} Oct 10 23:08:24.874163 n-d-860864-2 devstack@n-api.service[104745]: {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:08:24.874163 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:08:24.875159 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 23:08:24.875159 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 23:08:24.875159 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 23:08:24.875159 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 23:08:24.875159 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:08:24.875159 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:08:24.875159 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 23:08:24.875159 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 23:08:24.875159 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 23:08:24.875159 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:08:24.875159 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 23:08:24.875159 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 23:08:24.875159 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 10 23:08:24.875159 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Oct 10 23:08:24.875159 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:08:24.875159 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Oct 10 23:08:24.875159 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:08:24.875159 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:08:24.875159 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:08:24.876885 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:08:24.876885 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:08:24.876885 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:08:24.876885 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:08:24.876885 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 23:08:24.876885 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:08:24.876885 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 10 23:08:24.876885 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Oct 10 23:08:24.876885 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:08:24.876885 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Oct 10 23:08:24.876885 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:08:24.876885 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:08:24.876885 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:08:24.876885 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:08:24.876885 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:08:24.876885 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 10 23:08:24.876885 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Oct 10 23:08:24.876885 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-f911edbc-c7ca-4e5b-83c2-f8c8fe7faeee admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:08:24.878370 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-f911edbc-c7ca-4e5b-83c2-f8c8fe7faeee admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.416291 Oct 10 23:08:24.878370 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1190 bytes} [Mon Oct 10 23:08:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 23:08:24.886760 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-6ee55ea3-a872-46fa-b995-4dda76dfcf94 admin admin] Calling method '>' {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:24.892071 n-d-860864-2 devstack@n-api.service[104746]: DEBUG dbcounter [-] [104746] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=104746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:08:24.912567 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-6ee55ea3-a872-46fa-b995-4dda76dfcf94 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.030122 Oct 10 23:08:24.913154 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Oct 10 23:08:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:08:24.924430 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-03cbed93-100f-4ec2-a35e-1b972e2493cd admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:24.947485 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-03cbed93-100f-4ec2-a35e-1b972e2493cd admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027565 Oct 10 23:08:24.948061 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Oct 10 23:08:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:08:24.959120 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-7a951a77-dfdb-4b99-bddd-77fa708c4c24 admin admin] Calling method '>' {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:24.965110 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.wsgi [None req-7a951a77-dfdb-4b99-bddd-77fa708c4c24 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 10 23:08:24.969191 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-7a951a77-dfdb-4b99-bddd-77fa708c4c24 admin admin] Request method failure captured: Oct 10 23:08:24.969191 n-d-860864-2 devstack@n-api.service[104746]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 10 23:08:24.969191 n-d-860864-2 devstack@n-api.service[104746]: Accept: application/json Oct 10 23:08:24.969191 n-d-860864-2 devstack@n-api.service[104746]: Accept-Encoding: gzip, deflate Oct 10 23:08:24.969191 n-d-860864-2 devstack@n-api.service[104746]: Connection: keep-alive Oct 10 23:08:24.969191 n-d-860864-2 devstack@n-api.service[104746]: Content-Length: 0 Oct 10 23:08:24.969191 n-d-860864-2 devstack@n-api.service[104746]: Host: 10.222.0.23 Oct 10 23:08:24.969191 n-d-860864-2 devstack@n-api.service[104746]: Openstack-Api-Version: compute 2.92 Oct 10 23:08:24.969191 n-d-860864-2 devstack@n-api.service[104746]: Openstack-System-Scope: None Oct 10 23:08:24.969191 n-d-860864-2 devstack@n-api.service[104746]: User-Agent: python-novaclient Oct 10 23:08:24.969191 n-d-860864-2 devstack@n-api.service[104746]: X-Auth-Token: gAAAAABjRKXoLTKS9U6h1Y3RhsYNxEetPhE9aVhaEc9xAJ5036LMxE5_HTJHW2OT9PnpjUwdavacBvDh6AsSbEuEuQ_4jisbTcvEE8LWn8Ih2AqQ0IyM0Mu4lR2IvkDEo-7YeKOz1BXt7F4seWoh_XUKbH_vXYKhMg96c9JsMFPog3Y8f-ZEQoI Oct 10 23:08:24.969191 n-d-860864-2 devstack@n-api.service[104746]: X-Domain-Id: None Oct 10 23:08:24.969191 n-d-860864-2 devstack@n-api.service[104746]: X-Domain-Name: None Oct 10 23:08:24.969191 n-d-860864-2 devstack@n-api.service[104746]: X-Identity-Status: Confirmed Oct 10 23:08:24.969191 n-d-860864-2 devstack@n-api.service[104746]: X-Is-Admin-Project: True Oct 10 23:08:24.969191 n-d-860864-2 devstack@n-api.service[104746]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 23:08:24.969191 n-d-860864-2 devstack@n-api.service[104746]: X-Project-Domain-Id: default Oct 10 23:08:24.969191 n-d-860864-2 devstack@n-api.service[104746]: X-Project-Domain-Name: Default Oct 10 23:08:24.969191 n-d-860864-2 devstack@n-api.service[104746]: X-Project-Id: d769f65de8ef46e696d436b16a64ed44 Oct 10 23:08:24.969191 n-d-860864-2 devstack@n-api.service[104746]: X-Project-Name: admin Oct 10 23:08:24.969191 n-d-860864-2 devstack@n-api.service[104746]: X-Role: admin,member,reader Oct 10 23:08:24.969191 n-d-860864-2 devstack@n-api.service[104746]: X-Roles: admin,member,reader Oct 10 23:08:24.970808 n-d-860864-2 devstack@n-api.service[104746]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d769f65de8ef46e696d436b16a64ed44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d769f65de8ef46e696d436b16a64ed44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d769f65de8ef46e696d436b16a64ed44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d769f65de8ef46e696d436b16a64ed44", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:08:24.970808 n-d-860864-2 devstack@n-api.service[104746]: X-Tenant: admin Oct 10 23:08:24.970808 n-d-860864-2 devstack@n-api.service[104746]: X-Tenant-Id: d769f65de8ef46e696d436b16a64ed44 Oct 10 23:08:24.970808 n-d-860864-2 devstack@n-api.service[104746]: X-Tenant-Name: admin Oct 10 23:08:24.970808 n-d-860864-2 devstack@n-api.service[104746]: X-User: admin Oct 10 23:08:24.970808 n-d-860864-2 devstack@n-api.service[104746]: X-User-Domain-Id: default Oct 10 23:08:24.970808 n-d-860864-2 devstack@n-api.service[104746]: X-User-Domain-Name: Default Oct 10 23:08:24.970808 n-d-860864-2 devstack@n-api.service[104746]: X-User-Id: d697fe98a7474e58a1000b428f92c240 Oct 10 23:08:24.970808 n-d-860864-2 devstack@n-api.service[104746]: X-User-Name: admin Oct 10 23:08:24.970808 n-d-860864-2 devstack@n-api.service[104746]: method: > Oct 10 23:08:24.970808 n-d-860864-2 devstack@n-api.service[104746]: exception: Flavor 42 could not be found. Oct 10 23:08:24.970808 n-d-860864-2 devstack@n-api.service[104746]: action_args: {'id': '42'} Oct 10 23:08:24.970808 n-d-860864-2 devstack@n-api.service[104746]: {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:08:24.970808 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:08:24.972716 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 23:08:24.972716 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 23:08:24.972716 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 23:08:24.972716 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 23:08:24.972716 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:08:24.972716 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:08:24.972716 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 23:08:24.972716 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 23:08:24.972716 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 23:08:24.972716 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:08:24.972716 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 23:08:24.972716 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 23:08:24.972716 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 10 23:08:24.972716 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Oct 10 23:08:24.972716 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:08:24.972716 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Oct 10 23:08:24.972716 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:08:24.972716 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:08:24.972716 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:08:24.974095 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:08:24.974095 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:08:24.974095 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:08:24.974095 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:08:24.974095 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 23:08:24.974095 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:08:24.974095 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 10 23:08:24.974095 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Oct 10 23:08:24.974095 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:08:24.974095 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Oct 10 23:08:24.974095 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:08:24.974095 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:08:24.974095 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:08:24.974095 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:08:24.974095 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:08:24.974095 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 10 23:08:24.974095 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Oct 10 23:08:24.974095 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-7a951a77-dfdb-4b99-bddd-77fa708c4c24 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:08:24.975345 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-7a951a77-dfdb-4b99-bddd-77fa708c4c24 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015305 Oct 10 23:08:24.975345 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1190 bytes} [Mon Oct 10 23:08:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 23:08:26.229540 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-03cbed93-100f-4ec2-a35e-1b972e2493cd admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:26.230560 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-03cbed93-100f-4ec2-a35e-1b972e2493cd admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Oct 10 23:08:26.230968 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Oct 10 23:08:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:08:26.780868 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-5301bbcf-5cc5-4736-8548-bc31bcbd4d1c admin admin] Calling method '>' {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:26.786023 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.wsgi [None req-5301bbcf-5cc5-4736-8548-bc31bcbd4d1c admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 10 23:08:26.787547 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-5301bbcf-5cc5-4736-8548-bc31bcbd4d1c admin admin] Request method failure captured: Oct 10 23:08:26.787547 n-d-860864-2 devstack@n-api.service[104746]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 10 23:08:26.787547 n-d-860864-2 devstack@n-api.service[104746]: Accept: application/json Oct 10 23:08:26.787547 n-d-860864-2 devstack@n-api.service[104746]: Accept-Encoding: gzip, deflate Oct 10 23:08:26.787547 n-d-860864-2 devstack@n-api.service[104746]: Connection: keep-alive Oct 10 23:08:26.787547 n-d-860864-2 devstack@n-api.service[104746]: Content-Length: 0 Oct 10 23:08:26.787547 n-d-860864-2 devstack@n-api.service[104746]: Host: 10.222.0.23 Oct 10 23:08:26.787547 n-d-860864-2 devstack@n-api.service[104746]: Openstack-Api-Version: compute 2.92 Oct 10 23:08:26.787547 n-d-860864-2 devstack@n-api.service[104746]: Openstack-System-Scope: None Oct 10 23:08:26.787547 n-d-860864-2 devstack@n-api.service[104746]: User-Agent: python-novaclient Oct 10 23:08:26.787547 n-d-860864-2 devstack@n-api.service[104746]: X-Auth-Token: gAAAAABjRKXqOVFv1EfjCiZJn88GXsDepDoSBXA1esZhGA4UDm-L1FQ68ak85RzpMwTXeJVfkqsyd5yg4bO-e146wI4aMNUxNekP8F_LwS9ZvUhXbd7eD69wwf4XC0AjHIYIv1jrJpz447fZyEf2TYgb9MN7Bv-w0CfZ_VXQyJzghUdbLaQj2iQ Oct 10 23:08:26.787547 n-d-860864-2 devstack@n-api.service[104746]: X-Domain-Id: None Oct 10 23:08:26.787547 n-d-860864-2 devstack@n-api.service[104746]: X-Domain-Name: None Oct 10 23:08:26.787547 n-d-860864-2 devstack@n-api.service[104746]: X-Identity-Status: Confirmed Oct 10 23:08:26.787547 n-d-860864-2 devstack@n-api.service[104746]: X-Is-Admin-Project: True Oct 10 23:08:26.787547 n-d-860864-2 devstack@n-api.service[104746]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 23:08:26.787547 n-d-860864-2 devstack@n-api.service[104746]: X-Project-Domain-Id: default Oct 10 23:08:26.787547 n-d-860864-2 devstack@n-api.service[104746]: X-Project-Domain-Name: Default Oct 10 23:08:26.787547 n-d-860864-2 devstack@n-api.service[104746]: X-Project-Id: d769f65de8ef46e696d436b16a64ed44 Oct 10 23:08:26.787547 n-d-860864-2 devstack@n-api.service[104746]: X-Project-Name: admin Oct 10 23:08:26.787547 n-d-860864-2 devstack@n-api.service[104746]: X-Role: admin,member,reader Oct 10 23:08:26.787547 n-d-860864-2 devstack@n-api.service[104746]: X-Roles: admin,member,reader Oct 10 23:08:26.789007 n-d-860864-2 devstack@n-api.service[104746]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d769f65de8ef46e696d436b16a64ed44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d769f65de8ef46e696d436b16a64ed44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d769f65de8ef46e696d436b16a64ed44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d769f65de8ef46e696d436b16a64ed44", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:08:26.789007 n-d-860864-2 devstack@n-api.service[104746]: X-Tenant: admin Oct 10 23:08:26.789007 n-d-860864-2 devstack@n-api.service[104746]: X-Tenant-Id: d769f65de8ef46e696d436b16a64ed44 Oct 10 23:08:26.789007 n-d-860864-2 devstack@n-api.service[104746]: X-Tenant-Name: admin Oct 10 23:08:26.789007 n-d-860864-2 devstack@n-api.service[104746]: X-User: admin Oct 10 23:08:26.789007 n-d-860864-2 devstack@n-api.service[104746]: X-User-Domain-Id: default Oct 10 23:08:26.789007 n-d-860864-2 devstack@n-api.service[104746]: X-User-Domain-Name: Default Oct 10 23:08:26.789007 n-d-860864-2 devstack@n-api.service[104746]: X-User-Id: d697fe98a7474e58a1000b428f92c240 Oct 10 23:08:26.789007 n-d-860864-2 devstack@n-api.service[104746]: X-User-Name: admin Oct 10 23:08:26.789007 n-d-860864-2 devstack@n-api.service[104746]: method: > Oct 10 23:08:26.789007 n-d-860864-2 devstack@n-api.service[104746]: exception: Flavor 84 could not be found. Oct 10 23:08:26.789007 n-d-860864-2 devstack@n-api.service[104746]: action_args: {'id': '84'} Oct 10 23:08:26.789007 n-d-860864-2 devstack@n-api.service[104746]: {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:08:26.789007 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:08:26.789989 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 23:08:26.789989 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 23:08:26.789989 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 23:08:26.789989 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 23:08:26.789989 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:08:26.789989 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:08:26.789989 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 23:08:26.789989 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 23:08:26.789989 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 23:08:26.789989 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:08:26.789989 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 23:08:26.789989 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 23:08:26.789989 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 10 23:08:26.789989 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Oct 10 23:08:26.789989 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:08:26.789989 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Oct 10 23:08:26.789989 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:08:26.789989 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:08:26.789989 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:08:26.791493 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:08:26.791493 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:08:26.791493 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:08:26.791493 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:08:26.791493 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 23:08:26.791493 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:08:26.791493 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 10 23:08:26.791493 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Oct 10 23:08:26.791493 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:08:26.791493 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Oct 10 23:08:26.791493 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:08:26.791493 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:08:26.791493 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:08:26.791493 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:08:26.791493 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:08:26.791493 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 10 23:08:26.791493 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Oct 10 23:08:26.791493 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-5301bbcf-5cc5-4736-8548-bc31bcbd4d1c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:08:26.792714 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-5301bbcf-5cc5-4736-8548-bc31bcbd4d1c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.418992 Oct 10 23:08:26.792714 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1190 bytes} [Mon Oct 10 23:08:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 420 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 23:08:26.799412 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-7ec5c359-fad2-4a35-872d-9f4a9783fbff admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:26.814759 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-7ec5c359-fad2-4a35-872d-9f4a9783fbff admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018864 Oct 10 23:08:26.815333 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Oct 10 23:08:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:08:26.825037 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-5286668c-59de-4b81-ac01-93456a9675d6 admin admin] Calling method '>' {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:26.841050 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-5286668c-59de-4b81-ac01-93456a9675d6 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019556 Oct 10 23:08:26.842163 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Oct 10 23:08:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:08:26.852190 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-e8451aa0-0c1c-4ef4-9cbf-8c349e9fea4a admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:26.858058 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.wsgi [None req-e8451aa0-0c1c-4ef4-9cbf-8c349e9fea4a admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 10 23:08:26.860072 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-e8451aa0-0c1c-4ef4-9cbf-8c349e9fea4a admin admin] Request method failure captured: Oct 10 23:08:26.860072 n-d-860864-2 devstack@n-api.service[104745]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 10 23:08:26.860072 n-d-860864-2 devstack@n-api.service[104745]: Accept: application/json Oct 10 23:08:26.860072 n-d-860864-2 devstack@n-api.service[104745]: Accept-Encoding: gzip, deflate Oct 10 23:08:26.860072 n-d-860864-2 devstack@n-api.service[104745]: Connection: keep-alive Oct 10 23:08:26.860072 n-d-860864-2 devstack@n-api.service[104745]: Content-Length: 0 Oct 10 23:08:26.860072 n-d-860864-2 devstack@n-api.service[104745]: Host: 10.222.0.23 Oct 10 23:08:26.860072 n-d-860864-2 devstack@n-api.service[104745]: Openstack-Api-Version: compute 2.92 Oct 10 23:08:26.860072 n-d-860864-2 devstack@n-api.service[104745]: Openstack-System-Scope: None Oct 10 23:08:26.860072 n-d-860864-2 devstack@n-api.service[104745]: User-Agent: python-novaclient Oct 10 23:08:26.860072 n-d-860864-2 devstack@n-api.service[104745]: X-Auth-Token: gAAAAABjRKXqOVFv1EfjCiZJn88GXsDepDoSBXA1esZhGA4UDm-L1FQ68ak85RzpMwTXeJVfkqsyd5yg4bO-e146wI4aMNUxNekP8F_LwS9ZvUhXbd7eD69wwf4XC0AjHIYIv1jrJpz447fZyEf2TYgb9MN7Bv-w0CfZ_VXQyJzghUdbLaQj2iQ Oct 10 23:08:26.860072 n-d-860864-2 devstack@n-api.service[104745]: X-Domain-Id: None Oct 10 23:08:26.860072 n-d-860864-2 devstack@n-api.service[104745]: X-Domain-Name: None Oct 10 23:08:26.860072 n-d-860864-2 devstack@n-api.service[104745]: X-Identity-Status: Confirmed Oct 10 23:08:26.860072 n-d-860864-2 devstack@n-api.service[104745]: X-Is-Admin-Project: True Oct 10 23:08:26.860072 n-d-860864-2 devstack@n-api.service[104745]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 23:08:26.860072 n-d-860864-2 devstack@n-api.service[104745]: X-Project-Domain-Id: default Oct 10 23:08:26.860072 n-d-860864-2 devstack@n-api.service[104745]: X-Project-Domain-Name: Default Oct 10 23:08:26.860072 n-d-860864-2 devstack@n-api.service[104745]: X-Project-Id: d769f65de8ef46e696d436b16a64ed44 Oct 10 23:08:26.860072 n-d-860864-2 devstack@n-api.service[104745]: X-Project-Name: admin Oct 10 23:08:26.860072 n-d-860864-2 devstack@n-api.service[104745]: X-Role: admin,member,reader Oct 10 23:08:26.860072 n-d-860864-2 devstack@n-api.service[104745]: X-Roles: admin,member,reader Oct 10 23:08:26.861336 n-d-860864-2 devstack@n-api.service[104745]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d769f65de8ef46e696d436b16a64ed44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d769f65de8ef46e696d436b16a64ed44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d769f65de8ef46e696d436b16a64ed44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d769f65de8ef46e696d436b16a64ed44", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:08:26.861336 n-d-860864-2 devstack@n-api.service[104745]: X-Tenant: admin Oct 10 23:08:26.861336 n-d-860864-2 devstack@n-api.service[104745]: X-Tenant-Id: d769f65de8ef46e696d436b16a64ed44 Oct 10 23:08:26.861336 n-d-860864-2 devstack@n-api.service[104745]: X-Tenant-Name: admin Oct 10 23:08:26.861336 n-d-860864-2 devstack@n-api.service[104745]: X-User: admin Oct 10 23:08:26.861336 n-d-860864-2 devstack@n-api.service[104745]: X-User-Domain-Id: default Oct 10 23:08:26.861336 n-d-860864-2 devstack@n-api.service[104745]: X-User-Domain-Name: Default Oct 10 23:08:26.861336 n-d-860864-2 devstack@n-api.service[104745]: X-User-Id: d697fe98a7474e58a1000b428f92c240 Oct 10 23:08:26.861336 n-d-860864-2 devstack@n-api.service[104745]: X-User-Name: admin Oct 10 23:08:26.861336 n-d-860864-2 devstack@n-api.service[104745]: method: > Oct 10 23:08:26.861336 n-d-860864-2 devstack@n-api.service[104745]: exception: Flavor 84 could not be found. Oct 10 23:08:26.861336 n-d-860864-2 devstack@n-api.service[104745]: action_args: {'id': '84'} Oct 10 23:08:26.861336 n-d-860864-2 devstack@n-api.service[104745]: {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:08:26.861336 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:08:26.862152 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 23:08:26.862152 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 23:08:26.862152 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 23:08:26.862152 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 23:08:26.862152 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:08:26.862152 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:08:26.862152 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 23:08:26.862152 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 23:08:26.862152 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 23:08:26.862152 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:08:26.862152 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 23:08:26.862152 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 23:08:26.862152 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 10 23:08:26.862152 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Oct 10 23:08:26.862152 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:08:26.862152 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Oct 10 23:08:26.862152 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:08:26.862152 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:08:26.862152 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:08:26.863675 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:08:26.863675 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:08:26.863675 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:08:26.863675 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:08:26.863675 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 23:08:26.863675 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:08:26.863675 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 10 23:08:26.863675 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Oct 10 23:08:26.863675 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:08:26.863675 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Oct 10 23:08:26.863675 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:08:26.863675 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:08:26.863675 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:08:26.863675 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:08:26.863675 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:08:26.863675 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 10 23:08:26.863675 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Oct 10 23:08:26.863675 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-e8451aa0-0c1c-4ef4-9cbf-8c349e9fea4a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:08:26.864735 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-e8451aa0-0c1c-4ef4-9cbf-8c349e9fea4a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012886 Oct 10 23:08:26.864735 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1190 bytes} [Mon Oct 10 23:08:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 10 23:08:28.145037 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-5286668c-59de-4b81-ac01-93456a9675d6 admin admin] Calling method '>' {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:28.146684 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-5286668c-59de-4b81-ac01-93456a9675d6 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002143 Oct 10 23:08:28.147195 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Oct 10 23:08:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:08:28.703288 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-acb710a4-c13b-4b63-8079-3a6cf17f3abb admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:28.709493 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.wsgi [None req-acb710a4-c13b-4b63-8079-3a6cf17f3abb admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 10 23:08:28.711040 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-acb710a4-c13b-4b63-8079-3a6cf17f3abb admin admin] Request method failure captured: Oct 10 23:08:28.711040 n-d-860864-2 devstack@n-api.service[104745]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 10 23:08:28.711040 n-d-860864-2 devstack@n-api.service[104745]: Accept: application/json Oct 10 23:08:28.711040 n-d-860864-2 devstack@n-api.service[104745]: Accept-Encoding: gzip, deflate Oct 10 23:08:28.711040 n-d-860864-2 devstack@n-api.service[104745]: Connection: keep-alive Oct 10 23:08:28.711040 n-d-860864-2 devstack@n-api.service[104745]: Content-Length: 0 Oct 10 23:08:28.711040 n-d-860864-2 devstack@n-api.service[104745]: Host: 10.222.0.23 Oct 10 23:08:28.711040 n-d-860864-2 devstack@n-api.service[104745]: Openstack-Api-Version: compute 2.92 Oct 10 23:08:28.711040 n-d-860864-2 devstack@n-api.service[104745]: Openstack-System-Scope: None Oct 10 23:08:28.711040 n-d-860864-2 devstack@n-api.service[104745]: User-Agent: python-novaclient Oct 10 23:08:28.711040 n-d-860864-2 devstack@n-api.service[104745]: X-Auth-Token: gAAAAABjRKXsIl7qsenDPRgA-EGJ4fr91kCJCF4oLX3HbAvY8N6uGdItUWCo-Xiy89PAcTBiN1yZkBq_WPzd1W-wLPxvT2sA3ccOsVgoRaqV1Aind6UAnGDReW7Lb6HkA-BMtWllyaHqVpr2-fmydZe6aySe4KZjDyxtHnBqip2A-D-X30XoRso Oct 10 23:08:28.711040 n-d-860864-2 devstack@n-api.service[104745]: X-Domain-Id: None Oct 10 23:08:28.711040 n-d-860864-2 devstack@n-api.service[104745]: X-Domain-Name: None Oct 10 23:08:28.711040 n-d-860864-2 devstack@n-api.service[104745]: X-Identity-Status: Confirmed Oct 10 23:08:28.711040 n-d-860864-2 devstack@n-api.service[104745]: X-Is-Admin-Project: True Oct 10 23:08:28.711040 n-d-860864-2 devstack@n-api.service[104745]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 23:08:28.711040 n-d-860864-2 devstack@n-api.service[104745]: X-Project-Domain-Id: default Oct 10 23:08:28.711040 n-d-860864-2 devstack@n-api.service[104745]: X-Project-Domain-Name: Default Oct 10 23:08:28.711040 n-d-860864-2 devstack@n-api.service[104745]: X-Project-Id: d769f65de8ef46e696d436b16a64ed44 Oct 10 23:08:28.711040 n-d-860864-2 devstack@n-api.service[104745]: X-Project-Name: admin Oct 10 23:08:28.711040 n-d-860864-2 devstack@n-api.service[104745]: X-Role: admin,member,reader Oct 10 23:08:28.711040 n-d-860864-2 devstack@n-api.service[104745]: X-Roles: admin,member,reader Oct 10 23:08:28.712314 n-d-860864-2 devstack@n-api.service[104745]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d769f65de8ef46e696d436b16a64ed44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d769f65de8ef46e696d436b16a64ed44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d769f65de8ef46e696d436b16a64ed44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d769f65de8ef46e696d436b16a64ed44", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:08:28.712314 n-d-860864-2 devstack@n-api.service[104745]: X-Tenant: admin Oct 10 23:08:28.712314 n-d-860864-2 devstack@n-api.service[104745]: X-Tenant-Id: d769f65de8ef46e696d436b16a64ed44 Oct 10 23:08:28.712314 n-d-860864-2 devstack@n-api.service[104745]: X-Tenant-Name: admin Oct 10 23:08:28.712314 n-d-860864-2 devstack@n-api.service[104745]: X-User: admin Oct 10 23:08:28.712314 n-d-860864-2 devstack@n-api.service[104745]: X-User-Domain-Id: default Oct 10 23:08:28.712314 n-d-860864-2 devstack@n-api.service[104745]: X-User-Domain-Name: Default Oct 10 23:08:28.712314 n-d-860864-2 devstack@n-api.service[104745]: X-User-Id: d697fe98a7474e58a1000b428f92c240 Oct 10 23:08:28.712314 n-d-860864-2 devstack@n-api.service[104745]: X-User-Name: admin Oct 10 23:08:28.712314 n-d-860864-2 devstack@n-api.service[104745]: method: > Oct 10 23:08:28.712314 n-d-860864-2 devstack@n-api.service[104745]: exception: Flavor 451 could not be found. Oct 10 23:08:28.712314 n-d-860864-2 devstack@n-api.service[104745]: action_args: {'id': '451'} Oct 10 23:08:28.712314 n-d-860864-2 devstack@n-api.service[104745]: {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:08:28.712314 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:08:28.713106 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 23:08:28.713106 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 23:08:28.713106 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 23:08:28.713106 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 23:08:28.713106 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:08:28.713106 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:08:28.713106 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 23:08:28.713106 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 23:08:28.713106 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 23:08:28.713106 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:08:28.713106 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 23:08:28.713106 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 23:08:28.713106 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 10 23:08:28.713106 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Oct 10 23:08:28.713106 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:08:28.713106 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Oct 10 23:08:28.713106 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:08:28.713106 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:08:28.713106 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:08:28.714364 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:08:28.714364 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:08:28.714364 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:08:28.714364 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:08:28.714364 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 23:08:28.714364 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:08:28.714364 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 10 23:08:28.714364 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Oct 10 23:08:28.714364 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:08:28.714364 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Oct 10 23:08:28.714364 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:08:28.714364 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:08:28.714364 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:08:28.714364 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:08:28.714364 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:08:28.714364 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 10 23:08:28.714364 n-d-860864-2 devstack@n-api.service[104745]: ERROR nova.api.openstack.wsgi Oct 10 23:08:28.714364 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-acb710a4-c13b-4b63-8079-3a6cf17f3abb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:08:28.715782 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-acb710a4-c13b-4b63-8079-3a6cf17f3abb admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.426256 Oct 10 23:08:28.715782 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Oct 10 23:08:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 427 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 23:08:28.722745 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-4b4af8c1-0a9f-49b8-88e4-e92643505e3b admin admin] Calling method '>' {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:28.740882 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-4b4af8c1-0a9f-49b8-88e4-e92643505e3b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021699 Oct 10 23:08:28.741556 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Oct 10 23:08:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:08:28.751957 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-cb4bef39-838d-453a-870b-55ef49aab079 admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:28.767354 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-cb4bef39-838d-453a-870b-55ef49aab079 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019523 Oct 10 23:08:28.767917 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1210 bytes} [Mon Oct 10 23:08:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:08:28.778066 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-1924ce79-41e1-449d-88e4-8052216dd3ce admin admin] Calling method '>' {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:28.783834 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.wsgi [None req-1924ce79-41e1-449d-88e4-8052216dd3ce admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 10 23:08:28.785365 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-1924ce79-41e1-449d-88e4-8052216dd3ce admin admin] Request method failure captured: Oct 10 23:08:28.785365 n-d-860864-2 devstack@n-api.service[104746]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 10 23:08:28.785365 n-d-860864-2 devstack@n-api.service[104746]: Accept: application/json Oct 10 23:08:28.785365 n-d-860864-2 devstack@n-api.service[104746]: Accept-Encoding: gzip, deflate Oct 10 23:08:28.785365 n-d-860864-2 devstack@n-api.service[104746]: Connection: keep-alive Oct 10 23:08:28.785365 n-d-860864-2 devstack@n-api.service[104746]: Content-Length: 0 Oct 10 23:08:28.785365 n-d-860864-2 devstack@n-api.service[104746]: Host: 10.222.0.23 Oct 10 23:08:28.785365 n-d-860864-2 devstack@n-api.service[104746]: Openstack-Api-Version: compute 2.92 Oct 10 23:08:28.785365 n-d-860864-2 devstack@n-api.service[104746]: Openstack-System-Scope: None Oct 10 23:08:28.785365 n-d-860864-2 devstack@n-api.service[104746]: User-Agent: python-novaclient Oct 10 23:08:28.785365 n-d-860864-2 devstack@n-api.service[104746]: X-Auth-Token: gAAAAABjRKXsIl7qsenDPRgA-EGJ4fr91kCJCF4oLX3HbAvY8N6uGdItUWCo-Xiy89PAcTBiN1yZkBq_WPzd1W-wLPxvT2sA3ccOsVgoRaqV1Aind6UAnGDReW7Lb6HkA-BMtWllyaHqVpr2-fmydZe6aySe4KZjDyxtHnBqip2A-D-X30XoRso Oct 10 23:08:28.785365 n-d-860864-2 devstack@n-api.service[104746]: X-Domain-Id: None Oct 10 23:08:28.785365 n-d-860864-2 devstack@n-api.service[104746]: X-Domain-Name: None Oct 10 23:08:28.785365 n-d-860864-2 devstack@n-api.service[104746]: X-Identity-Status: Confirmed Oct 10 23:08:28.785365 n-d-860864-2 devstack@n-api.service[104746]: X-Is-Admin-Project: True Oct 10 23:08:28.785365 n-d-860864-2 devstack@n-api.service[104746]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 23:08:28.785365 n-d-860864-2 devstack@n-api.service[104746]: X-Project-Domain-Id: default Oct 10 23:08:28.785365 n-d-860864-2 devstack@n-api.service[104746]: X-Project-Domain-Name: Default Oct 10 23:08:28.785365 n-d-860864-2 devstack@n-api.service[104746]: X-Project-Id: d769f65de8ef46e696d436b16a64ed44 Oct 10 23:08:28.785365 n-d-860864-2 devstack@n-api.service[104746]: X-Project-Name: admin Oct 10 23:08:28.785365 n-d-860864-2 devstack@n-api.service[104746]: X-Role: admin,member,reader Oct 10 23:08:28.785365 n-d-860864-2 devstack@n-api.service[104746]: X-Roles: admin,member,reader Oct 10 23:08:28.786984 n-d-860864-2 devstack@n-api.service[104746]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d769f65de8ef46e696d436b16a64ed44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d769f65de8ef46e696d436b16a64ed44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d769f65de8ef46e696d436b16a64ed44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d769f65de8ef46e696d436b16a64ed44", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:08:28.786984 n-d-860864-2 devstack@n-api.service[104746]: X-Tenant: admin Oct 10 23:08:28.786984 n-d-860864-2 devstack@n-api.service[104746]: X-Tenant-Id: d769f65de8ef46e696d436b16a64ed44 Oct 10 23:08:28.786984 n-d-860864-2 devstack@n-api.service[104746]: X-Tenant-Name: admin Oct 10 23:08:28.786984 n-d-860864-2 devstack@n-api.service[104746]: X-User: admin Oct 10 23:08:28.786984 n-d-860864-2 devstack@n-api.service[104746]: X-User-Domain-Id: default Oct 10 23:08:28.786984 n-d-860864-2 devstack@n-api.service[104746]: X-User-Domain-Name: Default Oct 10 23:08:28.786984 n-d-860864-2 devstack@n-api.service[104746]: X-User-Id: d697fe98a7474e58a1000b428f92c240 Oct 10 23:08:28.786984 n-d-860864-2 devstack@n-api.service[104746]: X-User-Name: admin Oct 10 23:08:28.786984 n-d-860864-2 devstack@n-api.service[104746]: method: > Oct 10 23:08:28.786984 n-d-860864-2 devstack@n-api.service[104746]: exception: Flavor 451 could not be found. Oct 10 23:08:28.786984 n-d-860864-2 devstack@n-api.service[104746]: action_args: {'id': '451'} Oct 10 23:08:28.786984 n-d-860864-2 devstack@n-api.service[104746]: {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:08:28.786984 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:08:28.788203 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 23:08:28.788203 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 23:08:28.788203 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 23:08:28.788203 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 23:08:28.788203 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:08:28.788203 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:08:28.788203 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 23:08:28.788203 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 23:08:28.788203 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 23:08:28.788203 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:08:28.788203 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 23:08:28.788203 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 23:08:28.788203 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 10 23:08:28.788203 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Oct 10 23:08:28.788203 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:08:28.788203 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Oct 10 23:08:28.788203 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:08:28.788203 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:08:28.788203 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:08:28.789253 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:08:28.789253 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:08:28.789253 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:08:28.789253 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:08:28.789253 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 23:08:28.789253 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:08:28.789253 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 10 23:08:28.789253 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Oct 10 23:08:28.789253 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:08:28.789253 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Oct 10 23:08:28.789253 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:08:28.789253 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:08:28.789253 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:08:28.789253 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:08:28.789253 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:08:28.789253 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 10 23:08:28.789253 n-d-860864-2 devstack@n-api.service[104746]: ERROR nova.api.openstack.wsgi Oct 10 23:08:28.789253 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-1924ce79-41e1-449d-88e4-8052216dd3ce admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:08:28.790601 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-1924ce79-41e1-449d-88e4-8052216dd3ce admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012393 Oct 10 23:08:28.790601 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Oct 10 23:08:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 23:08:30.073113 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-cb4bef39-838d-453a-870b-55ef49aab079 admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:30.074155 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-cb4bef39-838d-453a-870b-55ef49aab079 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 10 23:08:30.074549 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Oct 10 23:08:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:08:30.648351 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-e94ec02f-fe27-4cb4-a132-c47969470941 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:08:30.672006 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-e94ec02f-fe27-4cb4-a132-c47969470941 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.459052 Oct 10 23:08:30.672571 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1235 bytes} [Mon Oct 10 23:08:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:08:31.932353 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-cb4bef39-838d-453a-870b-55ef49aab079 admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:31.933395 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-cb4bef39-838d-453a-870b-55ef49aab079 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 10 23:08:31.933874 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Oct 10 23:08:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:08:32.492126 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-efe4089a-d147-40b2-a4b2-f12da6248dfd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:08:32.511865 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-efe4089a-d147-40b2-a4b2-f12da6248dfd admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.438706 Oct 10 23:08:32.511865 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1235 bytes} [Mon Oct 10 23:08:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:08:33.793848 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-cb4bef39-838d-453a-870b-55ef49aab079 admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:33.795429 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-cb4bef39-838d-453a-870b-55ef49aab079 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 10 23:08:33.795842 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Oct 10 23:08:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:08:34.367981 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-8dc9db5c-6b3d-463b-aad4-04a864920908 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:08:34.391240 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-8dc9db5c-6b3d-463b-aad4-04a864920908 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.456627 Oct 10 23:08:34.391799 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1235 bytes} [Mon Oct 10 23:08:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 23:08:35.674184 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-cb4bef39-838d-453a-870b-55ef49aab079 admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:35.675205 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-cb4bef39-838d-453a-870b-55ef49aab079 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 10 23:08:35.675609 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Oct 10 23:08:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:08:36.241491 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-c83ec310-3a35-4593-8cf5-66ad4fc773af admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:08:36.268854 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-c83ec310-3a35-4593-8cf5-66ad4fc773af admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.452767 Oct 10 23:08:36.269441 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1235 bytes} [Mon Oct 10 23:08:35 2022] POST /compute/v2.1/flavors => generated 409 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:08:37.533803 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-cb4bef39-838d-453a-870b-55ef49aab079 admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:37.534849 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-cb4bef39-838d-453a-870b-55ef49aab079 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Oct 10 23:08:37.535251 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Oct 10 23:08:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:08:38.100706 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-dc3c318b-8fd0-4bdb-8d41-066f5352ad2a admin admin] Calling method '>' {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:08:38.122256 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-dc3c318b-8fd0-4bdb-8d41-066f5352ad2a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.433649 Oct 10 23:08:38.122816 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1202 bytes} [Mon Oct 10 23:08:37 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:09:36.277514 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-cb4bef39-838d-453a-870b-55ef49aab079 admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:09:36.278544 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-cb4bef39-838d-453a-870b-55ef49aab079 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Oct 10 23:09:36.278950 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 931 bytes} [Mon Oct 10 23:09:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:09:36.291647 n-d-860864-2 devstack@n-api.service[104746]: DEBUG dbcounter [-] [104746] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:09:36.733226 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-09a9098d-4c4b-4fea-a5f0-e9d79c60ffa3 admin admin] Calling method '>' {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:09:36.754706 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-09a9098d-4c4b-4fea-a5f0-e9d79c60ffa3 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.467490 Oct 10 23:09:36.755251 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1292 bytes} [Mon Oct 10 23:09:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:09:36.776992 n-d-860864-2 devstack@n-api.service[104745]: DEBUG dbcounter [-] [104745] Writing DB stats nova_api:SELECT=14 {{(pid=104745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:09:36.781807 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-4d7baa00-dff2-4324-b5df-58172a517765 admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:09:36.789341 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-4d7baa00-dff2-4324-b5df-58172a517765 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013923 Oct 10 23:09:36.789919 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1283 bytes} [Mon Oct 10 23:09:36 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:09:36.801687 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-a8ad1211-4380-4c5e-9ce7-f795774afa0d admin admin] Calling method '>' {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:09:36.808916 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-a8ad1211-4380-4c5e-9ce7-f795774afa0d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010831 Oct 10 23:09:36.809460 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1286 bytes} [Mon Oct 10 23:09:36 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:09:36.821680 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-b12eab95-afcd-4035-ab84-e08de0c5693e admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:09:36.829793 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-b12eab95-afcd-4035-ab84-e08de0c5693e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011742 Oct 10 23:09:36.830341 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1286 bytes} [Mon Oct 10 23:09:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:09:36.842055 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-b72c7be5-0d6e-4807-b9c8-446ca304497f admin admin] Calling method '>' {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:09:36.850579 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-b72c7be5-0d6e-4807-b9c8-446ca304497f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012053 Oct 10 23:09:36.851110 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1283 bytes} [Mon Oct 10 23:09:36 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:14:54.238730 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-b12eab95-afcd-4035-ab84-e08de0c5693e admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:14:54.239743 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-b12eab95-afcd-4035-ab84-e08de0c5693e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 10 23:14:54.240144 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 34/69] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Oct 10 23:14:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:14:54.381289 n-d-860864-2 devstack@n-api.service[104746]: DEBUG dbcounter [-] [104746] Writing DB stats nova_api:SELECT=6 {{(pid=104746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:14:54.530558 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-74c7d350-085f-4337-a74a-9913b2f44bfc admin admin] Calling method '>' {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:14:54.535127 n-d-860864-2 devstack@n-api.service[104746]: DEBUG oslo_concurrency.lockutils [None req-74c7d350-085f-4337-a74a-9913b2f44bfc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:14:54.535602 n-d-860864-2 devstack@n-api.service[104746]: DEBUG oslo_concurrency.lockutils [None req-74c7d350-085f-4337-a74a-9913b2f44bfc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:14:54.536030 n-d-860864-2 devstack@n-api.service[104746]: DEBUG oslo_concurrency.lockutils [None req-74c7d350-085f-4337-a74a-9913b2f44bfc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:14:54.536737 n-d-860864-2 devstack@n-api.service[104746]: DEBUG oslo_concurrency.lockutils [None req-74c7d350-085f-4337-a74a-9913b2f44bfc admin admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:14:54.537186 n-d-860864-2 devstack@n-api.service[104746]: DEBUG oslo_concurrency.lockutils [None req-74c7d350-085f-4337-a74a-9913b2f44bfc admin admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:14:54.537630 n-d-860864-2 devstack@n-api.service[104746]: DEBUG oslo_concurrency.lockutils [None req-74c7d350-085f-4337-a74a-9913b2f44bfc admin admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:14:54.575295 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-74c7d350-085f-4337-a74a-9913b2f44bfc admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.195144 Oct 10 23:14:54.576021 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 36/70] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Oct 10 23:14:54 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:14:55.665809 n-d-860864-2 devstack@n-api.service[104745]: DEBUG nova.api.openstack.wsgi [None req-b12eab95-afcd-4035-ab84-e08de0c5693e admin admin] Calling method '>' {{(pid=104745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:14:55.666847 n-d-860864-2 devstack@n-api.service[104745]: INFO nova.api.openstack.requestlog [None req-b12eab95-afcd-4035-ab84-e08de0c5693e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Oct 10 23:14:55.667244 n-d-860864-2 devstack@n-api.service[104745]: [pid: 104745|app: 0|req: 35/71] 10.222.0.23 () {56 vars in 1074 bytes} [Mon Oct 10 23:14:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:14:55.870971 n-d-860864-2 devstack@n-api.service[104746]: DEBUG nova.api.openstack.wsgi [None req-bfa25163-e352-43ad-a0a0-225053cac49a admin admin] Calling method '>' {{(pid=104746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:14:55.874319 n-d-860864-2 devstack@n-api.service[104746]: DEBUG oslo_concurrency.lockutils [None req-bfa25163-e352-43ad-a0a0-225053cac49a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:14:55.874791 n-d-860864-2 devstack@n-api.service[104746]: DEBUG oslo_concurrency.lockutils [None req-bfa25163-e352-43ad-a0a0-225053cac49a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:14:55.875212 n-d-860864-2 devstack@n-api.service[104746]: DEBUG oslo_concurrency.lockutils [None req-bfa25163-e352-43ad-a0a0-225053cac49a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:14:55.875917 n-d-860864-2 devstack@n-api.service[104746]: DEBUG oslo_concurrency.lockutils [None req-bfa25163-e352-43ad-a0a0-225053cac49a admin admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:14:55.876358 n-d-860864-2 devstack@n-api.service[104746]: DEBUG oslo_concurrency.lockutils [None req-bfa25163-e352-43ad-a0a0-225053cac49a admin admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:14:55.876773 n-d-860864-2 devstack@n-api.service[104746]: DEBUG oslo_concurrency.lockutils [None req-bfa25163-e352-43ad-a0a0-225053cac49a admin admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:14:55.901773 n-d-860864-2 devstack@n-api.service[104746]: INFO nova.api.openstack.requestlog [None req-bfa25163-e352-43ad-a0a0-225053cac49a admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.087004 Oct 10 23:14:55.902325 n-d-860864-2 devstack@n-api.service[104746]: [pid: 104746|app: 0|req: 37/72] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Oct 10 23:14:55 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:15:42.301652 n-d-860864-2 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 10 23:15:42.302527 n-d-860864-2 devstack@n-api.service[104743]: Mon Oct 10 23:15:42 2022 - graceful shutdown triggered... Oct 10 23:15:42.303031 n-d-860864-2 devstack@n-api.service[104745]: Gracefully killing worker 1 (pid: 104745)... Oct 10 23:15:42.303403 n-d-860864-2 devstack@n-api.service[104746]: Gracefully killing worker 2 (pid: 104746)... Oct 10 23:15:42.428283 n-d-860864-2 devstack@n-api.service[104745]: DEBUG dbcounter [-] [104745] Writing DB stats nova_api:SELECT=4 {{(pid=104745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:15:43.303662 n-d-860864-2 devstack@n-api.service[104743]: worker 1 buried after 1 seconds Oct 10 23:15:43.304188 n-d-860864-2 devstack@n-api.service[104743]: worker 2 buried after 1 seconds Oct 10 23:15:43.304188 n-d-860864-2 devstack@n-api.service[104743]: goodbye to uWSGI. Oct 10 23:15:43.305191 n-d-860864-2 systemd[1]: devstack@n-api.service: Succeeded. Oct 10 23:15:43.305806 n-d-860864-2 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 10 23:15:43.308622 n-d-860864-2 systemd[1]: Starting Devstack devstack@n-api.service... Oct 10 23:15:43.325775 n-d-860864-2 devstack@n-api.service[120605]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 10 23:15:43.344456 n-d-860864-2 devstack@n-api.service[120605]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 10 23:15:43 2022] *** Oct 10 23:15:43.344456 n-d-860864-2 devstack@n-api.service[120605]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 10 23:15:43.344456 n-d-860864-2 devstack@n-api.service[120605]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 10 23:15:43.344456 n-d-860864-2 devstack@n-api.service[120605]: nodename: n-d-860864-2 Oct 10 23:15:43.344456 n-d-860864-2 devstack@n-api.service[120605]: machine: x86_64 Oct 10 23:15:43.344456 n-d-860864-2 devstack@n-api.service[120605]: clock source: unix Oct 10 23:15:43.344456 n-d-860864-2 devstack@n-api.service[120605]: pcre jit disabled Oct 10 23:15:43.344456 n-d-860864-2 devstack@n-api.service[120605]: detected number of CPU cores: 4 Oct 10 23:15:43.344456 n-d-860864-2 devstack@n-api.service[120605]: current working directory: / Oct 10 23:15:43.344456 n-d-860864-2 devstack@n-api.service[120605]: detected binary path: /usr/bin/uwsgi-core Oct 10 23:15:43.344456 n-d-860864-2 devstack@n-api.service[120605]: your processes number limit is 47680 Oct 10 23:15:43.344456 n-d-860864-2 devstack@n-api.service[120605]: your memory page size is 4096 bytes Oct 10 23:15:43.345517 n-d-860864-2 devstack@n-api.service[120605]: detected max file descriptor number: 2048 Oct 10 23:15:43.345517 n-d-860864-2 devstack@n-api.service[120605]: lock engine: pthread robust mutexes Oct 10 23:15:43.345517 n-d-860864-2 devstack@n-api.service[120605]: thunder lock: enabled Oct 10 23:15:43.345517 n-d-860864-2 devstack@n-api.service[120605]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 10 23:15:43.345517 n-d-860864-2 devstack@n-api.service[120605]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 10 23:15:43.385281 n-d-860864-2 devstack@n-api.service[120605]: Python main interpreter initialized at 0x5596255bd9c0 Oct 10 23:15:43.385281 n-d-860864-2 devstack@n-api.service[120605]: python threads support enabled Oct 10 23:15:43.385281 n-d-860864-2 devstack@n-api.service[120605]: your server socket listen backlog is limited to 100 connections Oct 10 23:15:43.385281 n-d-860864-2 devstack@n-api.service[120605]: your mercy for graceful operations on workers is 90 seconds Oct 10 23:15:43.385751 n-d-860864-2 devstack@n-api.service[120605]: mapped 403077 bytes (393 KB) for 2 cores Oct 10 23:15:43.385751 n-d-860864-2 devstack@n-api.service[120605]: *** Operational MODE: preforking *** Oct 10 23:15:43.386031 n-d-860864-2 devstack@n-api.service[120605]: *** uWSGI is running in multiple interpreter mode *** Oct 10 23:15:43.386031 n-d-860864-2 devstack@n-api.service[120605]: spawned uWSGI master process (pid: 120605) Oct 10 23:15:43.386248 n-d-860864-2 systemd[1]: Started Devstack devstack@n-api.service. Oct 10 23:15:43.386873 n-d-860864-2 devstack@n-api.service[120605]: spawned uWSGI worker 1 (pid: 120613, cores: 1) Oct 10 23:15:43.387793 n-d-860864-2 devstack@n-api.service[120605]: spawned uWSGI worker 2 (pid: 120614, cores: 1) Oct 10 23:15:43.387793 n-d-860864-2 devstack@n-api.service[120605]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 10 23:15:44.067091 n-d-860864-2 devstack@n-api.service[120613]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 23:15:44.083425 n-d-860864-2 devstack@n-api.service[120614]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 23:15:45.246246 n-d-860864-2 devstack@n-api.service[120613]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 23:15:45.246246 n-d-860864-2 devstack@n-api.service[120613]: from cryptography.utils import int_from_bytes Oct 10 23:15:45.246879 n-d-860864-2 devstack@n-api.service[120613]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 23:15:45.246879 n-d-860864-2 devstack@n-api.service[120613]: from cryptography.utils import int_from_bytes Oct 10 23:15:45.279129 n-d-860864-2 devstack@n-api.service[120614]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 23:15:45.279129 n-d-860864-2 devstack@n-api.service[120614]: from cryptography.utils import int_from_bytes Oct 10 23:15:45.279747 n-d-860864-2 devstack@n-api.service[120614]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 23:15:45.279747 n-d-860864-2 devstack@n-api.service[120614]: from cryptography.utils import int_from_bytes Oct 10 23:15:47.714500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 23:15:47.715129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 23:15:47.715245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 23:15:47.715550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 23:15:47.715815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 23:15:47.716212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.716554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.716893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.717223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.718253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.718460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.718794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.719123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.719462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.719732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.720058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.720575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860864-2 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.720913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.721235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.721586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.721923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.722243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.722580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.722902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.723416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.723886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.724208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.724535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.724886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.725213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.725561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.725905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.726220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.726566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.726888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.727310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860864-2 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.727641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.727965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.728289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.728742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.729052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.729405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.729735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.730081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.730405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.730739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.731071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.731399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.731729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.732045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.732367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.732686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.733177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.733589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.733910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.734173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.734496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.734831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.735163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.735498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.735784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.736059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.736389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.736732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.737047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.737364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.737702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.738018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.738341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.738657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.738972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.739294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.739622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.739952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.740284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.740600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.740928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.741351 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.741719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.742039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.742393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.742721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.743061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.743370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.743703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.744021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.744341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.744660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.744990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.745337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.745685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.745946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.746258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.746577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.746907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.747228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.747545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.747861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.748172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.748495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.748842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.749163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.749524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.749925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.750242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.750575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.750894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.751208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.751526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.751858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.752190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.752512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.752828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.753145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.753495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.753827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.754143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.754460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.754791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.755108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.755423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.755749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.756067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.756384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.756711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.757019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.757334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.757687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.758003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.758318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.758633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.758950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.759264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.759577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.759887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.760204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.760511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.760843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.761170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.761514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.761834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.762148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.762477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.762830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.763170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.763523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.763845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.764778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.765341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.765701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.766028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.766357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.766694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.767025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.767345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.767678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.768002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.768330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.768670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.769000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.769328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.769684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.770007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.770340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.770677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.771017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.771339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.771696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.772057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.772381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.772715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.773296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.773652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.773976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.774298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.774652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.774978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.775302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.775629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.775951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.776282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.776606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.776929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.777256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.777676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.778004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.778349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.778675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.779012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.779338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.779436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 23:15:47.780571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.780672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 23:15:47.780777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.781077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.781293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 23:15:47.781420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.781691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 23:15:47.781787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.781951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 23:15:47.782053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.782343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.782454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.782656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.782748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.782978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.783083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.783296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.783388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.783624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.783726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.783936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.784029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.784253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.784361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.784570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.784673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.784897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.784990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.785157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.785288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.785495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.785639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.785949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.786098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860864-2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.786269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.786363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.786579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.786688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.786895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.786989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.787212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.787344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.787515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.787637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.787840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.787965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.788150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.788270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.788478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.788657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.788841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.789162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.789273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.789410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.789516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.789734 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.789838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.790077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.790240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.790394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.790548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.790693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.790841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.790993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.791235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.791389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.791537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.791684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.791833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.791973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.792128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.792279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860864-2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.792429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.792577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.792727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.792884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.793036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.793209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.793347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.793600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.793692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.793915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.794017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.794224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.794365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.794534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.794635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.794845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.794941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.795174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.795265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.795650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.796009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.796111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.796327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.796431 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.796642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.796742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.796959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.797061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.797333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.797475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.797630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.797793 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.797954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.798050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.798273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.798378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.798585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.798686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.798891 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.798992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.799150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.799283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.799463 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.799574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.799789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.799891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.800115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.800220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.800443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.800555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.800696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.800853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.801008 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.801170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.801460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.801569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.801748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.801839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.801932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.802139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.802244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.802466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.802568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.802774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.802868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.803085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.803178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.803393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.803487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.803702 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.803795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.804012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.804107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.804331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.804477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.804653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.804755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.804977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.805113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.805288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.805513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.805640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.805742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.805992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.806103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.806328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.806471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.806640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.806783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.806970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.807075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.807287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.807395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.807601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.807758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.808406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.808570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.808677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.808765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.808765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.808931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.809016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.809116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.809222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.809366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.809543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.809682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.809819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.809959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.810090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.810205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.810319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.810443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.810604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.810733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.810917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.811407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.811407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.811736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.811866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.811989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.812103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.812317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.812445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.812641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.812776 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.813026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.813196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.813355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.813545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.813712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.813875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.814008 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.814147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.814278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.814409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.814587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.814721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.814864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.815002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.815143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.815343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.815486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.815619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.815749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.815890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.816027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.816173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.816314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.816446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.817096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.817197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.817285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.817402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.817504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.817612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.817758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.817851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.817945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.818081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.818212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.818310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.818430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.818538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.818742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.818851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.819064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.819164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.819375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.819469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.819687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.819822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.820007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.820129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.820320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.820421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.820629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.820729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.820948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.821070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.821249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.821349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.821598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.821708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.821925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.822048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.822236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.822343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.822546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.822655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.822850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.822959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.823156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.823263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.823463 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.823664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.823768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.823846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.824063 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.824164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.824453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.824664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.824757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.824839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.825007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.825156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.825339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.825562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.825730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.825877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.826031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.826129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.826228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.826318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.826528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 23:15:47.827126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.827414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.827740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.827835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.828057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.828179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.828374 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.828501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.828696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.828808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.829028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.829132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.829574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.829732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.829881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.830027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.830191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.830349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.830503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.830657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.830805 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.831053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.831231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.831395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.831550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.831711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.831858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.832003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.832148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.832312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.832483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.832595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.832714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.833039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.833359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.833708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.833847 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.834024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.834153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.834345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.834490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.834744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.834855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.834985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.835170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.835306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.835590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.835697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.835921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.836024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.836259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.836360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.836602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.836725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.836928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.837038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.837243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.837350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.837584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.837705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.837898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.838045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.838242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.838558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.838875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.839130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.839280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.839495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.839630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.839819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.839956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.840136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.840300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.840434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.840566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.840751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.840893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.841064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.841200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.841394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.841534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.841734 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.841881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.842050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.842186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.843121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.843273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.843495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.843856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.844110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.844258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.844436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.844578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.844765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.844898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.845089 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.845214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.845436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.845541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.845756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.845866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.846066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.846168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.846381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.846477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.846690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.846790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.847006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.847113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.847313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.847408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.847640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.847739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.847971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.848082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.848281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.848461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.848621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.848793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.848960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.849108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.849255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.849452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.849620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.849776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.849923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.850077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.850230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.850377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.850539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.850698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.850843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.851007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.851153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.851313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.851467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.851621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.851774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.851927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.852073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.852227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.852374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.852520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.852674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.852821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.852984 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.853166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.853321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.853498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.853658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.853812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.853958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.854118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.854271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.854425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.854570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.854717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.854926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.855077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.855221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.855374 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.855520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.855800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.855962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.856109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.856255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.856400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.856562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.856723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.857722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.858030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.858194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.858350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.858505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.858659 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.858818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.858818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.859112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.859112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.859112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.859112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.859678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.859823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.859980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.860125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.860277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.860432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.860578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.860722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.860867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.861013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.861157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.861316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.861493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.861600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.861600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.861781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.861881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.862038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.862130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.862229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.862317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.862401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.862552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.862709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.862855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.863071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.863223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.863396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.863565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.863720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.863866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.864011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.864165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.864345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.864508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.864968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.865152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.865152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.865541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.865704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.865873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.866021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.866177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.866342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.866494 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.866655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.866855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.867004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.867158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.867315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.867462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.868459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.868629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.868823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.868972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.868972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.869265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.869431 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.869584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.869741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.869741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.869741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.869741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.870316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.870479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.870634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.870787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.870942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.871108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.871254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.871415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.871569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.871569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.871868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.872022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.872168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.872320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.872491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.872639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.872794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.872941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.873086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.873231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.873402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.873598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.873598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.873898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.874044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.874343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.874495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.874735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.874962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.875165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.875328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.875475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.875621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.875767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.875927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.876082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.876262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.876424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.876593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.876755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.876920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.877065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.877221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.877367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.877606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.877764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.877911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.878056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.878388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.878548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.878696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.878858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.879200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.879375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.879531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.879679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.879837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.880415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.880590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.880748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.880897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.881051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.881208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.881355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.881536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.881536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.881826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.882261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.882540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.882709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.882709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.883001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.883148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.883148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.883435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.883582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.883735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.883882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.884050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.884197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.884358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.884513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.884668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.884823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.884969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.885172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.885328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.885499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.885499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.885777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.885923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.886092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.886239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.886391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.886537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.886690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.886837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.886992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.887147 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.887448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.887611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.887767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.887914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.888069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.890970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.891167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.891327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.891488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.891694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.891694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.891989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.892137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.892355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.892539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.892700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.892700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.892700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.893184 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.893331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.893503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.893666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.893821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.893821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.894104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.894261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.894408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.894563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.894563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.894879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.895082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.895082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.895082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.895571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.895716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.895870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.896024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.896170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.896329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.896483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.896666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.896666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.896945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.897102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.897261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.897500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.897662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.897809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.897955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.898777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.898935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.899084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.899248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.899406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.899561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.899720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.899720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.900005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.900150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.900324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.900483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.900637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.900785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.900977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.901146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.901303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.901593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.901755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.901929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.902077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.902237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.902423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.902575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.902730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.902885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.903039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.903195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.903350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.903497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.903497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.903806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.903971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.904133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.904280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.904433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.904579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.904899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.905942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.906125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.906316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.906472 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.906619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.906772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.906943 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.907151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.907350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.907541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.907703 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.907866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.908025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.908194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.908194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.908485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.908631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.908791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.908947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.909107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.909269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.909437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.909590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.909749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.909904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.910095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.910249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.910407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.910615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.910776 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.910776 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.911055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.911211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.911366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.911525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.911716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.911879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.912028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.912216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.912376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.912860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.913149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.913149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.913508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.913670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.913871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.914070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.914231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.914231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.914518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.914664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.914830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.914990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.914990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.915324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.915479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.915674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.915864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.916024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.916197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.916351 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.916553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.916710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.916866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.917014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.917168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.917321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.917492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.917492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.917784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.917951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.918105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.918252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.918405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.918552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.918714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.918860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.919006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.919163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.919328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.919490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.919490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.919769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.919924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.920070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.920223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.920690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.920896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.921046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.921192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.921338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.921538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.921697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.921853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.922014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.922168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.922326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.922480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.922641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.922788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.922934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.923080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.923232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.923232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.923232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.923665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.923813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.923973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.923973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.924281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.924428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.924585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.924731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.924731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.925019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.925165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.925311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.925311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.925613 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.925813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.925966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.926122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.926268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.926421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.926567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.926722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.926877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.927025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.927178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.927178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.927463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.927618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.927773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.927920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.928076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.928229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.928384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.928538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.928685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.928837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.928983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.929130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.929285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.929490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.929655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.930448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.930637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.930796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.930959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.931107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.931255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.931403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.931556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.931718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.932264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.932435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.932594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.932750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.932909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.933070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.933070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.933361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.934026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.934210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.934362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.934523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.934680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.934836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.934982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.935136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.935350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.935520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.935668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.936799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.936964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.937113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.937276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.937484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.937639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.937786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.937946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.938102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.938264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.938433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.938603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.938759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.938906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.938906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.939202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.939349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.939508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.939667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.939823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.939823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.940116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.940116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.940465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.940465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.940465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.940465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.941026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.941172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.941326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.941508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.941658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.941819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.941967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.942113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.942266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.942430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.942598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.942747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.942893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.942893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.943169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.943323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.943484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.943638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.943638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.943638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.944055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.944802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.945051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.945203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.945203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.945529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.945686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.945842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.946004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.946151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.946305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.946460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.946620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.946620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.946996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.947159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.947321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.947475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.948129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.948316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.948496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.948666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.948892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.949055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.949209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.949407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.949570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.950224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.950405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.950562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.950562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.950878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.951032 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.951187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.951339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.951492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.953022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.953199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.953364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.953559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.953559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.953873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.954041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.954195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.954356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.956661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.956888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.957068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.957242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.957464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.957643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.957802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.957977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.958133 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.958297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.958453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.958616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.958616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.958926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.959093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.959255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.959410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.959571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.959733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.959887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.960076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.960244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.960399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.960561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.960760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.960926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.961096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.961251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.961423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.961584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.961739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.961892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.962061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.962234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.962398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.962560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.962715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.962882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.963044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.963205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.963360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.963513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.963675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.963842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.963997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.964151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.964313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.964466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.964661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.964840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.964995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.965148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.965300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.965488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.965644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.965808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.965962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.966115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.966285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.966446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.966446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.966803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.966999 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.967156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.968255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.968411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.968763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.968974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.969137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.969287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.969452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.969452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.969774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.969931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.970120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.970278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.970426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.970572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.970727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.970874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.971040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.971188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.971335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.971490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.971648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.971802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.971949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.972096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.972249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.972410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.972568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.972716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.972862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.973017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.973173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.973329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.973562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.973837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.974002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.974151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.974461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.974631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.974791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.974791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.975086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.975243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.975403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.975552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.975552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.975854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.975854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.975854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.975854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.975854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.975854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.975854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.976880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.977091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.977322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.977538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.977538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.977538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.977538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.977538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.977538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.977538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.977538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.978705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.978705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.978705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.978705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.978705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.978705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.978705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.978705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.979869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.979869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.979869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.979869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.980442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.980442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.980814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.981163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.981517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.982384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.982384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.983016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.983016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.983372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.984247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.984578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.985163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.989493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.989493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.989734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.989826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.989903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.989984 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.990074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.990156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.990238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.990312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.990312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.990312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.990312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.990589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.990664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.990664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.990802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.990891 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.990967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.991040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.991040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.991040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.991238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.991321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.991402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.991476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.991548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.991626 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.991710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.991783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.991783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.991923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.991998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.992079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.992278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.992598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.992920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.993238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.993604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.993737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.993924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.994255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.994377 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.994691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.994889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.995011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.995316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.995516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.995628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.995952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.996293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.996618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.996941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.997053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.997260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.997625 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.997749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.998164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.998276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.998984 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.999583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:47.999899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.000144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.000257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.000567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.000772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.000893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.001309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.001456 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.001728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.002049 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.002169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.002369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.002655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.002788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.002994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.003309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.003642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.003965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.004070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.004425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.004542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.004762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.004875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.005082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.005304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.005663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.005784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.006024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.006138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.006352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.006511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.006693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.007020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.007123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.007345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.007560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.007674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.007988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.008092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.008287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.008391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.008599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.008816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.008928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.009222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.009326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.009569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.009686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.009881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.010124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.010235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.010508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.010620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.010815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.010925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.011135 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.011369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.011559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.011914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.012217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.012527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.012631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.012843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.013164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.013275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.013517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.013746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.013864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.014165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.014326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.015205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.015670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.015801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.016120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.016244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.016434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.016601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.016873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.017194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.017314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.017558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.017808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.017931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.018250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.018375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.018566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.018900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.019017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.019213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.019490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.019601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.019838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.020160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.020490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.020594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.020806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.021068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.021181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.021544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.021667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.021921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.022068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.022488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.022594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.022833 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.022954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.023415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.023649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.023753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.024087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.024200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.024419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.024575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.024713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.025114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.025220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.025508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.025626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.025834 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.025945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.026163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.026394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.026508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.026789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.026919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.027109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.027381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.027496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.027724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.027861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.028044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.028363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.028476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.028680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.028783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.028996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.029234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.029338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.029655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.029809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.030339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.030573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.030920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.031272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.031378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.031750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.031866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.032064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.032366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.032480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.032704 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.032814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.033022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.033262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.033407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.033676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.033794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.033991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.034102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.034317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.034582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.034695 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.034962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.035067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.035397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.035502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.035814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.035935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.036155 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.036257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.036483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.036703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.036814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.037116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.037243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.037470 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.037792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.037909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.038125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.038235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.038431 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.038668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.038778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.039067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.039181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.039411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.039516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.039746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.039902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.040076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.040381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.040493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.040685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.040794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120613) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 23:15:48.040998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.041317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.041781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.042104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.042415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.042725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.043042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.043355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.043664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.043972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.044282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.044599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.044906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.045218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.046326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.046653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.046970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.047284 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.047602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.047914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.048226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.048537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.048847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.049155 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.049523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.049864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.050189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.050516 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.050845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.051166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.051485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.051951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.052288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.052614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.052931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.053273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.053621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.053944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.054267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.054587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.054907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.055225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.055708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.056057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.056372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.056702 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.057034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.057361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.057707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.058025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.058362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.058685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.058998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.059314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.059632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.059950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.060268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.060586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.060903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.061758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.063341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.063341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.063532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.063858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.064197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.064536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.065014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.065223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.065626 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.066125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.066456 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.066779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.067106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 23:15:48.067352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 23:15:48.118816 n-d-860864-2 devstack@n-api.service[120613]: INFO dbcounter [None req-7125c5c4-0304-4e00-abd7-362458007c22 None None] Registered counter for database nova_api Oct 10 23:15:48.133256 n-d-860864-2 devstack@n-api.service[120614]: INFO dbcounter [None req-3b28dc91-f61a-4360-8436-03d9f3d84221 None None] Registered counter for database nova_api Oct 10 23:15:48.142672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_db.sqlalchemy.engines [None req-7125c5c4-0304-4e00-abd7-362458007c22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120613) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 23:15:48.150318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writer thread running {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 23:15:48.155771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_db.sqlalchemy.engines [None req-3b28dc91-f61a-4360-8436-03d9f3d84221 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 23:15:48.162673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writer thread running {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 23:15:48.208963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.context [None req-7125c5c4-0304-4e00-abd7-362458007c22 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c35e3cac-0e4f-44cc-a53a-8910e1eecc88(cell1) {{(pid=120613) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 23:15:48.213062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7125c5c4-0304-4e00-abd7-362458007c22 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:15:48.213630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7125c5c4-0304-4e00-abd7-362458007c22 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:15:48.215390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7125c5c4-0304-4e00-abd7-362458007c22 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:15:48.216152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7125c5c4-0304-4e00-abd7-362458007c22 None None] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:15:48.216657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7125c5c4-0304-4e00-abd7-362458007c22 None None] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:15:48.219601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7125c5c4-0304-4e00-abd7-362458007c22 None None] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:15:48.221655 n-d-860864-2 devstack@n-api.service[120613]: INFO dbcounter [None req-7125c5c4-0304-4e00-abd7-362458007c22 None None] Registered counter for database nova_cell0 Oct 10 23:15:48.222026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.context [None req-3b28dc91-f61a-4360-8436-03d9f3d84221 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c35e3cac-0e4f-44cc-a53a-8910e1eecc88(cell1) {{(pid=120614) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 23:15:48.225817 n-d-860864-2 devstack@n-api.service[120613]: INFO dbcounter [None req-7125c5c4-0304-4e00-abd7-362458007c22 None None] Registered counter for database nova_cell1 Oct 10 23:15:48.226079 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b28dc91-f61a-4360-8436-03d9f3d84221 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:15:48.226547 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b28dc91-f61a-4360-8436-03d9f3d84221 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:15:48.228119 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b28dc91-f61a-4360-8436-03d9f3d84221 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:15:48.228852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b28dc91-f61a-4360-8436-03d9f3d84221 None None] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:15:48.229299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b28dc91-f61a-4360-8436-03d9f3d84221 None None] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:15:48.231353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b28dc91-f61a-4360-8436-03d9f3d84221 None None] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:15:48.234697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_db.sqlalchemy.engines [None req-7125c5c4-0304-4e00-abd7-362458007c22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120613) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 23:15:48.234847 n-d-860864-2 devstack@n-api.service[120614]: INFO dbcounter [None req-3b28dc91-f61a-4360-8436-03d9f3d84221 None None] Registered counter for database nova_cell0 Oct 10 23:15:48.236136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_db.sqlalchemy.engines [None req-7125c5c4-0304-4e00-abd7-362458007c22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120613) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 23:15:48.238892 n-d-860864-2 devstack@n-api.service[120614]: INFO dbcounter [None req-3b28dc91-f61a-4360-8436-03d9f3d84221 None None] Registered counter for database nova_cell1 Oct 10 23:15:48.241084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writer thread running {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 23:15:48.247814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_db.sqlalchemy.engines [None req-3b28dc91-f61a-4360-8436-03d9f3d84221 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 23:15:48.250334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_db.sqlalchemy.engines [None req-3b28dc91-f61a-4360-8436-03d9f3d84221 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 23:15:48.255894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writer thread running {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 23:15:48.258522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writer thread running {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 23:15:48.384840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writer thread running {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 23:15:48.396279 n-d-860864-2 devstack@n-api.service[120613]: INFO dbcounter [None req-7125c5c4-0304-4e00-abd7-362458007c22 None None] Registered counter for database nova_cell0 Oct 10 23:15:48.403490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_db.sqlalchemy.engines [None req-7125c5c4-0304-4e00-abd7-362458007c22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120613) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 23:15:48.410299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writer thread running {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 23:15:48.411310 n-d-860864-2 devstack@n-api.service[120614]: INFO dbcounter [None req-3b28dc91-f61a-4360-8436-03d9f3d84221 None None] Registered counter for database nova_cell0 Oct 10 23:15:48.420185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_db.sqlalchemy.engines [None req-3b28dc91-f61a-4360-8436-03d9f3d84221 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 23:15:48.426040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writer thread running {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 23:15:48.743305 n-d-860864-2 devstack@n-api.service[120613]: WARNING keystonemiddleware.auth_token [None req-7125c5c4-0304-4e00-abd7-362458007c22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 23:15:48.751318 n-d-860864-2 devstack@n-api.service[120613]: WARNING keystonemiddleware.auth_token [None req-7125c5c4-0304-4e00-abd7-362458007c22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 23:15:48.773505 n-d-860864-2 devstack@n-api.service[120614]: WARNING keystonemiddleware.auth_token [None req-3b28dc91-f61a-4360-8436-03d9f3d84221 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 23:15:48.781104 n-d-860864-2 devstack@n-api.service[120614]: WARNING keystonemiddleware.auth_token [None req-3b28dc91-f61a-4360-8436-03d9f3d84221 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 23:15:49.101930 n-d-860864-2 devstack@n-api.service[120613]: WARNING keystonemiddleware.auth_token [None req-7125c5c4-0304-4e00-abd7-362458007c22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 23:15:49.108369 n-d-860864-2 devstack@n-api.service[120613]: WARNING keystonemiddleware.auth_token [None req-7125c5c4-0304-4e00-abd7-362458007c22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 23:15:49.113801 n-d-860864-2 devstack@n-api.service[120613]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5596255bd9c0 pid: 120613 (default app) Oct 10 23:15:49.129576 n-d-860864-2 devstack@n-api.service[120614]: WARNING keystonemiddleware.auth_token [None req-3b28dc91-f61a-4360-8436-03d9f3d84221 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 23:15:49.135563 n-d-860864-2 devstack@n-api.service[120614]: WARNING keystonemiddleware.auth_token [None req-3b28dc91-f61a-4360-8436-03d9f3d84221 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 23:15:49.141237 n-d-860864-2 devstack@n-api.service[120614]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5596255bd9c0 pid: 120614 (default app) Oct 10 23:16:28.832854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:16:28.833810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:16:28.834851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:16:28.835753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:16:29.943756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:16:29.945225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:16:29.946371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:16:29.947135 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:16:30.018771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e443bf53-3f7b-42de-92a2-40d7daec8cc3 tempest-AZAdminV2TestJSON-599914442 tempest-AZAdminV2TestJSON-599914442-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:30.023212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e443bf53-3f7b-42de-92a2-40d7daec8cc3 tempest-AZAdminV2TestJSON-599914442 tempest-AZAdminV2TestJSON-599914442-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:30.023212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e443bf53-3f7b-42de-92a2-40d7daec8cc3 tempest-AZAdminV2TestJSON-599914442 tempest-AZAdminV2TestJSON-599914442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:30.023212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e443bf53-3f7b-42de-92a2-40d7daec8cc3 tempest-AZAdminV2TestJSON-599914442 tempest-AZAdminV2TestJSON-599914442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:30.023212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e443bf53-3f7b-42de-92a2-40d7daec8cc3 tempest-AZAdminV2TestJSON-599914442 tempest-AZAdminV2TestJSON-599914442-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:30.023574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e443bf53-3f7b-42de-92a2-40d7daec8cc3 tempest-AZAdminV2TestJSON-599914442 tempest-AZAdminV2TestJSON-599914442-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:30.023574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e443bf53-3f7b-42de-92a2-40d7daec8cc3 tempest-AZAdminV2TestJSON-599914442 tempest-AZAdminV2TestJSON-599914442-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:30.068279 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e443bf53-3f7b-42de-92a2-40d7daec8cc3 tempest-AZAdminV2TestJSON-599914442 tempest-AZAdminV2TestJSON-599914442-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.250364 Oct 10 23:16:30.069322 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1/1] 10.222.0.23 () {58 vars in 1164 bytes} [Mon Oct 10 23:16:28 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:16:30.083946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3c4e8513-83d8-4990-bdc4-c291730e3b03 tempest-AZAdminV2TestJSON-599914442 tempest-AZAdminV2TestJSON-599914442-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:30.086214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c4e8513-83d8-4990-bdc4-c291730e3b03 tempest-AZAdminV2TestJSON-599914442 tempest-AZAdminV2TestJSON-599914442-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:30.086701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c4e8513-83d8-4990-bdc4-c291730e3b03 tempest-AZAdminV2TestJSON-599914442 tempest-AZAdminV2TestJSON-599914442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:30.087142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c4e8513-83d8-4990-bdc4-c291730e3b03 tempest-AZAdminV2TestJSON-599914442 tempest-AZAdminV2TestJSON-599914442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:30.087869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c4e8513-83d8-4990-bdc4-c291730e3b03 tempest-AZAdminV2TestJSON-599914442 tempest-AZAdminV2TestJSON-599914442-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:30.088322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c4e8513-83d8-4990-bdc4-c291730e3b03 tempest-AZAdminV2TestJSON-599914442 tempest-AZAdminV2TestJSON-599914442-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:30.089065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c4e8513-83d8-4990-bdc4-c291730e3b03 tempest-AZAdminV2TestJSON-599914442 tempest-AZAdminV2TestJSON-599914442-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:30.113885 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3c4e8513-83d8-4990-bdc4-c291730e3b03 tempest-AZAdminV2TestJSON-599914442 tempest-AZAdminV2TestJSON-599914442-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.034476 Oct 10 23:16:30.114810 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2/2] 10.222.0.23 () {58 vars in 1185 bytes} [Mon Oct 10 23:16:30 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:16:30.855615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c6c80585-d605-4d67-9823-6e0a1d1064d6 tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Calling method '.version_select at 0x7f6631153430>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:30.865422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c6c80585-d605-4d67-9823-6e0a1d1064d6 tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c35e3cac-0e4f-44cc-a53a-8910e1eecc88(cell1) {{(pid=120613) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 10 23:16:30.866281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6c80585-d605-4d67-9823-6e0a1d1064d6 tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:30.866970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6c80585-d605-4d67-9823-6e0a1d1064d6 tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:30.867480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6c80585-d605-4d67-9823-6e0a1d1064d6 tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:30.895152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6c80585-d605-4d67-9823-6e0a1d1064d6 tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:30.895640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6c80585-d605-4d67-9823-6e0a1d1064d6 tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:30.896082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6c80585-d605-4d67-9823-6e0a1d1064d6 tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:30.909839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6c80585-d605-4d67-9823-6e0a1d1064d6 tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:30.910326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6c80585-d605-4d67-9823-6e0a1d1064d6 tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:30.910796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6c80585-d605-4d67-9823-6e0a1d1064d6 tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:30.917619 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c6c80585-d605-4d67-9823-6e0a1d1064d6 tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.618099 Oct 10 23:16:30.918206 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3/3] 10.222.0.23 () {60 vars in 1208 bytes} [Mon Oct 10 23:16:30 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:16:31.120754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-72bcaa27-dd9b-4e97-bf17-c1c1683fab37 tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-684806869", "ram": 512, "vcpus": 1, "disk": 10, "id": 1841684746, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:31.173604 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-72bcaa27-dd9b-4e97-bf17-c1c1683fab37 tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.254123 Oct 10 23:16:31.174283 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4/4] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:16:30 2022] POST /compute/v2.1/flavors => generated 415 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:31.194558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e50c71ad-7870-4f1f-854c-92cfd3cf0ea7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1691207652", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:31.233742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-90cf9f20-de0c-4bb2-8320-ccfa9f7c3285 tempest-FlavorsV261TestJSON-1550052028 tempest-FlavorsV261TestJSON-1550052028-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-914685257", "id": 709041003, "os-flavor-access:is_public": "True"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:31.269154 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-90cf9f20-de0c-4bb2-8320-ccfa9f7c3285 tempest-FlavorsV261TestJSON-1550052028 tempest-FlavorsV261TestJSON-1550052028-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.093467 Oct 10 23:16:31.269773 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 5/5] 10.222.0.23 () {62 vars in 1188 bytes} [Mon Oct 10 23:16:31 2022] POST /compute/v2.1/flavors => generated 464 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:16:31.390532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7a4d4fc5-c575-445b-a93a-be4e41c2c517 tempest-AZAdminNegativeTestJSON-2015466889 tempest-AZAdminNegativeTestJSON-2015466889-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:31.392813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7a4d4fc5-c575-445b-a93a-be4e41c2c517 tempest-AZAdminNegativeTestJSON-2015466889 tempest-AZAdminNegativeTestJSON-2015466889-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '33f160af9c4c432db3abb951ead2a66a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14c62e7d1e3a4d45b88b7517fc34cfe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:31.397336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7a4d4fc5-c575-445b-a93a-be4e41c2c517 tempest-AZAdminNegativeTestJSON-2015466889 tempest-AZAdminNegativeTestJSON-2015466889-project] Request method failure captured: Oct 10 23:16:31.397336 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 10 23:16:31.397336 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:16:31.397336 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:16:31.397336 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:16:31.397336 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:16:31.397336 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:16:31.397336 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:16:31.397336 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:16:31.397336 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:31.397336 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfMkcNZzp0Pzc_Q09nYn9FeLPKgaEFVqmf1s4rXQe5Oce28sFNU8YOIgDEQ3WnjPXgi0lc_vY2iBJGbNzQ3brjSw5Ly0K_iN5iMgsoUcweqjH4WGQJ-FtCgZnG3lrNLWdiJ9OjRdOn7R1gT8bVemzA8Qr0O98L20JCU5LL2BmOvVV8 Oct 10 23:16:31.397336 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:16:31.397336 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:16:31.397336 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:16:31.397336 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:16:31.397336 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:16:31.397336 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:16:31.397336 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 14c62e7d1e3a4d45b88b7517fc34cfe9 Oct 10 23:16:31.397336 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AZAdminNegativeTestJSON-2015466889 Oct 10 23:16:31.397336 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:16:31.397336 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:16:31.399039 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/14c62e7d1e3a4d45b88b7517fc34cfe9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/14c62e7d1e3a4d45b88b7517fc34cfe9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/14c62e7d1e3a4d45b88b7517fc34cfe9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_14c62e7d1e3a4d45b88b7517fc34cfe9", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:31.399039 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AZAdminNegativeTestJSON-2015466889 Oct 10 23:16:31.399039 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 14c62e7d1e3a4d45b88b7517fc34cfe9 Oct 10 23:16:31.399039 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-2015466889 Oct 10 23:16:31.399039 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AZAdminNegativeTestJSON-2015466889-project Oct 10 23:16:31.399039 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:16:31.399039 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:16:31.399039 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 33f160af9c4c432db3abb951ead2a66a Oct 10 23:16:31.399039 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AZAdminNegativeTestJSON-2015466889-project Oct 10 23:16:31.399039 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:16:31.399039 n-d-860864-2 devstack@n-api.service[120613]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 10 23:16:31.399039 n-d-860864-2 devstack@n-api.service[120613]: action_args: {} Oct 10 23:16:31.399838 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:31.399838 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:31.399838 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:31.399838 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:31.399838 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:31.399838 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:31.399838 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:31.399838 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:31.399838 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 10 23:16:31.399838 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 10 23:16:31.399838 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:16:31.399838 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:16:31.399838 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:16:31.399838 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:16:31.399838 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:16:31.399838 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:16:31.399838 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:16:31.399838 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:16:31.399838 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:16:31.401097 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:16:31.401097 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:16:31.401097 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:16:31.401097 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:16:31.401097 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:16:31.401097 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 10 23:16:31.401097 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:31.401097 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:31.401097 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:31.401097 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:31.401097 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:31.401097 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:31.401097 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:16:31.401097 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:16:31.401097 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 10 23:16:31.401097 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:31.403904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7a4d4fc5-c575-445b-a93a-be4e41c2c517 tempest-AZAdminNegativeTestJSON-2015466889 tempest-AZAdminNegativeTestJSON-2015466889-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:31.405103 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7a4d4fc5-c575-445b-a93a-be4e41c2c517 tempest-AZAdminNegativeTestJSON-2015466889 tempest-AZAdminNegativeTestJSON-2015466889-project] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.133877 Oct 10 23:16:31.406231 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 6/6] 10.222.0.23 () {58 vars in 1185 bytes} [Mon Oct 10 23:16:31 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 135 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:16:31.534518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-e50c71ad-7870-4f1f-854c-92cfd3cf0ea7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] validate_networks() for None {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:16:31.746336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ab8fbb8e-9b91-4785-86f7-3df4f6945ace tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1365312757", "id": 1673240297, "os-flavor-access:is_public": "True"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:31.771533 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ab8fbb8e-9b91-4785-86f7-3df4f6945ace tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.363542 Oct 10 23:16:31.772151 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 7/7] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:16:31 2022] POST /compute/v2.1/flavors => generated 430 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:31.781216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ae96d779-9bda-41e7-a4f1-9be65f90d2e6 tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1018694162"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:31.789065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.aggregate [None req-ae96d779-9bda-41e7-a4f1-9be65f90d2e6 tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Generated uuid 888d9e54-ecdf-437c-abfd-06a6f91bead1 for aggregate {{(pid=120613) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 23:16:31.867983 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ae96d779-9bda-41e7-a4f1-9be65f90d2e6 tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.094438 Oct 10 23:16:31.869108 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 8/8] 10.222.0.23 () {62 vars in 1205 bytes} [Mon Oct 10 23:16:31 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:16:31.870227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e50c71ad-7870-4f1f-854c-92cfd3cf0ea7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:16:31.870862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e50c71ad-7870-4f1f-854c-92cfd3cf0ea7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:16:31.871496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e50c71ad-7870-4f1f-854c-92cfd3cf0ea7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:16:31.872066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e50c71ad-7870-4f1f-854c-92cfd3cf0ea7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:16:31.872620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e50c71ad-7870-4f1f-854c-92cfd3cf0ea7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:16:31.890326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e50c71ad-7870-4f1f-854c-92cfd3cf0ea7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:31.890987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e50c71ad-7870-4f1f-854c-92cfd3cf0ea7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:31.891749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e50c71ad-7870-4f1f-854c-92cfd3cf0ea7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:31.892609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e50c71ad-7870-4f1f-854c-92cfd3cf0ea7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:31.893216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e50c71ad-7870-4f1f-854c-92cfd3cf0ea7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:31.893660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e50c71ad-7870-4f1f-854c-92cfd3cf0ea7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:31.946099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-e50c71ad-7870-4f1f-854c-92cfd3cf0ea7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Getting quotas for project 8815288ae4a64e85a32b96bad674513a. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:16:31.955377 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-e50c71ad-7870-4f1f-854c-92cfd3cf0ea7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Getting quotas for user e433528b28f546e4b93bf170af8f6049 and project 8815288ae4a64e85a32b96bad674513a. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:16:31.967989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e50c71ad-7870-4f1f-854c-92cfd3cf0ea7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:16:31.971350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e50c71ad-7870-4f1f-854c-92cfd3cf0ea7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:16:32.058654 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e50c71ad-7870-4f1f-854c-92cfd3cf0ea7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.124432 Oct 10 23:16:32.060034 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1/9] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:16:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:16:32.066908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cef00430-7cad-4173-bdd2-ba01a7a947fa tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:32.117084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c140c426-06e8-482f-b214-499dd3218c52 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Calling method '.version_select at 0x7f663107c700>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:32.118927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c140c426-06e8-482f-b214-499dd3218c52 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:32.119405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c140c426-06e8-482f-b214-499dd3218c52 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:32.120335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c140c426-06e8-482f-b214-499dd3218c52 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:32.169718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c140c426-06e8-482f-b214-499dd3218c52 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:32.172678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c140c426-06e8-482f-b214-499dd3218c52 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:32.173224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c140c426-06e8-482f-b214-499dd3218c52 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:32.184938 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cef00430-7cad-4173-bdd2-ba01a7a947fa tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1841684746/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.122200 Oct 10 23:16:32.186592 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2/10] 10.222.0.23 () {60 vars in 1224 bytes} [Mon Oct 10 23:16:32 2022] POST /compute/v2.1/flavors/1841684746/os-extra_specs => generated 66 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:16:32.198782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c140c426-06e8-482f-b214-499dd3218c52 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:32.199277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c140c426-06e8-482f-b214-499dd3218c52 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:32.199708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c140c426-06e8-482f-b214-499dd3218c52 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:32.210887 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c140c426-06e8-482f-b214-499dd3218c52 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.340182 Oct 10 23:16:32.212929 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 9/11] 10.222.0.23 () {58 vars in 1167 bytes} [Mon Oct 10 23:16:31 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:32.218254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bf64d33d-7b53-4e47-9c85-09dca187e536 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:32.253798 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bf64d33d-7b53-4e47-9c85-09dca187e536 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1673240297" status: 202 len: 0 microversion: 2.1 time: 0.039005 Oct 10 23:16:32.254770 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 10/12] 10.222.0.23 () {58 vars in 1161 bytes} [Mon Oct 10 23:16:32 2022] DELETE /compute/v2.1/flavors/1673240297 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:16:32.259549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e36a6297-b710-4869-ac33-bda60b1d84f4 tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-665676219"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:32.362914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8039aa49-bf39-4f9c-91c3-b76223e34bd2 tempest-FlavorsV261TestJSON-315921058 tempest-FlavorsV261TestJSON-315921058-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:32.376154 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8039aa49-bf39-4f9c-91c3-b76223e34bd2 tempest-FlavorsV261TestJSON-315921058 tempest-FlavorsV261TestJSON-315921058-project] 10.222.0.23 "GET /compute/v2.1/flavors/709041003" status: 200 len: 464 microversion: 2.61 time: 0.188511 Oct 10 23:16:32.382479 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3/13] 10.222.0.23 () {60 vars in 1196 bytes} [Mon Oct 10 23:16:32 2022] GET /compute/v2.1/flavors/709041003 => generated 464 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:16:32.398577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7a8e08cf-2e05-46d3-8d9a-4c2874709863 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:32.405296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7a8e08cf-2e05-46d3-8d9a-4c2874709863 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:32.456341 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e36a6297-b710-4869-ac33-bda60b1d84f4 tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.200482 Oct 10 23:16:32.458145 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 11/14] 10.222.0.23 () {62 vars in 1210 bytes} [Mon Oct 10 23:16:32 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:16:32.552766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7a8e08cf-2e05-46d3-8d9a-4c2874709863 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:32.575817 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7a8e08cf-2e05-46d3-8d9a-4c2874709863 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 200 len: 1220 microversion: 2.1 time: 0.182950 Oct 10 23:16:32.577106 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 4/15] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:32 2022] GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 1220 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:32.585688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a9082fdb-a386-4cc6-b26e-dbdf3b5aa63e tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:32.639857 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a9082fdb-a386-4cc6-b26e-dbdf3b5aa63e tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5810 microversion: 2.1 time: 0.060641 Oct 10 23:16:32.640623 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 5/16] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:16:32 2022] GET /compute/v2.1/flavors/detail => generated 5810 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:32.646439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-19cb4ebc-51fc-4e7e-b7d7-ea66dc8efe4b tempest-FlavorsV261TestJSON-1550052028 tempest-FlavorsV261TestJSON-1550052028-project-admin] Action: 'update', calling method: .version_select at 0x7f6631664b80>, body: {"flavor": {"description": "new"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:32.699513 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-19cb4ebc-51fc-4e7e-b7d7-ea66dc8efe4b tempest-FlavorsV261TestJSON-1550052028 tempest-FlavorsV261TestJSON-1550052028-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/709041003" status: 200 len: 465 microversion: 2.61 time: 0.057173 Oct 10 23:16:32.700127 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 6/17] 10.222.0.23 () {62 vars in 1216 bytes} [Mon Oct 10 23:16:32 2022] PUT /compute/v2.1/flavors/709041003 => generated 465 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:16:32.705156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aaf0d3f7-758b-408a-a90d-1bbe2959ecdb tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:32.727978 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aaf0d3f7-758b-408a-a90d-1bbe2959ecdb tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.026789 Oct 10 23:16:32.728797 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 7/18] 10.222.0.23 () {60 vars in 1190 bytes} [Mon Oct 10 23:16:32 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:16:32.731516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a2ee816e-7fc3-4a01-b906-a14ce4489a9e tempest-FlavorsExtraSpecsTestJSON-52845036 tempest-FlavorsExtraSpecsTestJSON-52845036-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:32.734607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bb4298a5-9f6c-4a82-9ee0-e6fe30d85905 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-409443533", "id": 1581290915, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:32.759768 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bb4298a5-9f6c-4a82-9ee0-e6fe30d85905 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.029710 Oct 10 23:16:32.768196 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 8/19] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:16:32 2022] POST /compute/v2.1/flavors => generated 416 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:32.768196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2e74ffb4-fad0-4c06-af7c-b9da31fc3f2c tempest-FlavorsV261TestJSON-315921058 tempest-FlavorsV261TestJSON-315921058-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:32.768416 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a2ee816e-7fc3-4a01-b906-a14ce4489a9e tempest-FlavorsExtraSpecsTestJSON-52845036 tempest-FlavorsExtraSpecsTestJSON-52845036-project] 10.222.0.23 "GET /compute/v2.1/flavors/1841684746/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.306701 Oct 10 23:16:32.770354 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 12/20] 10.222.0.23 () {58 vars in 1203 bytes} [Mon Oct 10 23:16:32 2022] GET /compute/v2.1/flavors/1841684746/os-extra_specs => generated 66 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:16:32.783219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-58fc00e8-2d1a-4a5d-a33a-c4d60c7e699d tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-2"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:32.808214 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2e74ffb4-fad0-4c06-af7c-b9da31fc3f2c tempest-FlavorsV261TestJSON-315921058 tempest-FlavorsV261TestJSON-315921058-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 7184 microversion: 2.61 time: 0.045987 Oct 10 23:16:32.809139 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 9/21] 10.222.0.23 () {60 vars in 1187 bytes} [Mon Oct 10 23:16:32 2022] GET /compute/v2.1/flavors/detail => generated 7184 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:16:32.814726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fbdf8406-393a-4c14-8a0c-bac36d210e80 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:32.835771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58fc00e8-2d1a-4a5d-a33a-c4d60c7e699d tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:32.836274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58fc00e8-2d1a-4a5d-a33a-c4d60c7e699d tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:32.836712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58fc00e8-2d1a-4a5d-a33a-c4d60c7e699d tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:32.853583 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fbdf8406-393a-4c14-8a0c-bac36d210e80 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6216 microversion: 2.1 time: 0.043019 Oct 10 23:16:32.854858 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 10/22] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:16:32 2022] GET /compute/v2.1/flavors/detail => generated 6216 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:32.861532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3852823f-ea77-4a39-8e98-d07ba0ed9fb8 tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:32.892685 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3852823f-ea77-4a39-8e98-d07ba0ed9fb8 tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1841684746/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036607 Oct 10 23:16:32.893910 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 11/23] 10.222.0.23 () {60 vars in 1224 bytes} [Mon Oct 10 23:16:32 2022] POST /compute/v2.1/flavors/1841684746/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:16:32.899352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b0fcb5bc-6c5b-45d3-8b32-1d05080332d6 tempest-FlavorsV261TestJSON-315921058 tempest-FlavorsV261TestJSON-315921058-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:32.931618 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b0fcb5bc-6c5b-45d3-8b32-1d05080332d6 tempest-FlavorsV261TestJSON-315921058 tempest-FlavorsV261TestJSON-315921058-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 3658 microversion: 2.61 time: 0.036314 Oct 10 23:16:32.932744 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 12/24] 10.222.0.23 () {60 vars in 1166 bytes} [Mon Oct 10 23:16:32 2022] GET /compute/v2.1/flavors => generated 3658 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:16:32.938483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-71f0daa7-4f8a-4596-b9c9-d414fd65db83 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:32.971496 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-71f0daa7-4f8a-4596-b9c9-d414fd65db83 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1581290915" status: 202 len: 0 microversion: 2.1 time: 0.037138 Oct 10 23:16:32.972760 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 13/25] 10.222.0.23 () {58 vars in 1161 bytes} [Mon Oct 10 23:16:32 2022] DELETE /compute/v2.1/flavors/1581290915 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:16:32.978007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-038fe50b-10d4-443b-8c53-541012148196 tempest-FlavorsExtraSpecsTestJSON-52845036 tempest-FlavorsExtraSpecsTestJSON-52845036-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:32.988534 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-038fe50b-10d4-443b-8c53-541012148196 tempest-FlavorsExtraSpecsTestJSON-52845036 tempest-FlavorsExtraSpecsTestJSON-52845036-project] 10.222.0.23 "GET /compute/v2.1/flavors/1841684746/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.014481 Oct 10 23:16:32.989932 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 14/26] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:16:32 2022] GET /compute/v2.1/flavors/1841684746/os-extra_specs/hw:numa_nodes => generated 22 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:16:32.995033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8c5742c4-c966-435c-9606-3acfbb7473cc tempest-FlavorsV261TestJSON-1550052028 tempest-FlavorsV261TestJSON-1550052028-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:33.017691 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8c5742c4-c966-435c-9606-3acfbb7473cc tempest-FlavorsV261TestJSON-1550052028 tempest-FlavorsV261TestJSON-1550052028-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/709041003" status: 202 len: 0 microversion: 2.61 time: 0.026474 Oct 10 23:16:33.018795 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 15/27] 10.222.0.23 () {60 vars in 1199 bytes} [Mon Oct 10 23:16:32 2022] DELETE /compute/v2.1/flavors/709041003 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:16:33.029293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-505b6ba6-638c-423c-8ee7-433ee26ec231 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:33.064537 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-505b6ba6-638c-423c-8ee7-433ee26ec231 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.044106 Oct 10 23:16:33.065186 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 16/28] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:16:33 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:33.079986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ac0dbbf1-af4c-4402-92d9-7715cc7957a4 tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:33.124027 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ac0dbbf1-af4c-4402-92d9-7715cc7957a4 tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1841684746/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.056992 Oct 10 23:16:33.124634 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 17/29] 10.222.0.23 () {60 vars in 1224 bytes} [Mon Oct 10 23:16:33 2022] POST /compute/v2.1/flavors/1841684746/os-extra_specs => generated 66 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:16:33.131573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6ecc3e87-529f-42fd-b023-ea3ed9ad016c tempest-FlavorsV261TestJSON-1550052028 tempest-FlavorsV261TestJSON-1550052028-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:33.155867 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6ecc3e87-529f-42fd-b023-ea3ed9ad016c tempest-FlavorsV261TestJSON-1550052028 tempest-FlavorsV261TestJSON-1550052028-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6283 microversion: 2.61 time: 0.027746 Oct 10 23:16:33.156746 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 18/30] 10.222.0.23 () {60 vars in 1187 bytes} [Mon Oct 10 23:16:33 2022] GET /compute/v2.1/flavors/detail => generated 6283 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:16:33.172392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-48cba03b-5e07-448c-bf52-83861d69d907 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-856468594", "id": 1729437685, "os-flavor-access:is_public": "True"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:33.208821 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-48cba03b-5e07-448c-bf52-83861d69d907 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.042076 Oct 10 23:16:33.218650 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 19/31] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:16:33 2022] POST /compute/v2.1/flavors => generated 428 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:33.223168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-377af000-ceb1-4f27-8894-3ed6e392d039 tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:33.228566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7,nova_api:SAVEPOINT=6,nova_api:RELEASE=6,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:16:33.239696 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-377af000-ceb1-4f27-8894-3ed6e392d039 tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1841684746/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.024408 Oct 10 23:16:33.245953 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 20/32] 10.222.0.23 () {58 vars in 1203 bytes} [Mon Oct 10 23:16:33 2022] GET /compute/v2.1/flavors/1841684746/os-extra_specs => generated 66 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:16:33.251953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-943b8027-c8f2-47b5-8b81-aa1ac5233458 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:33.283971 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-943b8027-c8f2-47b5-8b81-aa1ac5233458 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1729437685" status: 202 len: 0 microversion: 2.1 time: 0.035069 Oct 10 23:16:33.285179 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 21/33] 10.222.0.23 () {58 vars in 1161 bytes} [Mon Oct 10 23:16:33 2022] DELETE /compute/v2.1/flavors/1729437685 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:16:33.291562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-036de343-0bb2-4a51-9b13-5bbef33459d7 tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:33.335703 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-036de343-0bb2-4a51-9b13-5bbef33459d7 tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/1841684746/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.048717 Oct 10 23:16:33.336482 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 22/34] 10.222.0.23 () {60 vars in 1265 bytes} [Mon Oct 10 23:16:33 2022] PUT /compute/v2.1/flavors/1841684746/os-extra_specs/hw:numa_nodes => generated 22 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:16:33.349056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c3597500-bfb6-4ab7-84db-f6da8646fbd4 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:33.376983 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c3597500-bfb6-4ab7-84db-f6da8646fbd4 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.035188 Oct 10 23:16:33.381650 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 23/35] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:16:33 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:33.389269 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cbe9f6b7-94d2-4470-a923-d62b2a7fabdc tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:33.406520 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cbe9f6b7-94d2-4470-a923-d62b2a7fabdc tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1841684746/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.023527 Oct 10 23:16:33.407857 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 24/36] 10.222.0.23 () {58 vars in 1203 bytes} [Mon Oct 10 23:16:33 2022] GET /compute/v2.1/flavors/1841684746/os-extra_specs => generated 66 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:16:33.415906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6774f2ff-a3aa-495e-bcbc-6ca8ebac45e6 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-348964544", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:33.446637 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6774f2ff-a3aa-495e-bcbc-6ca8ebac45e6 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.037194 Oct 10 23:16:33.448244 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 25/37] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:16:33 2022] POST /compute/v2.1/flavors => generated 506 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:33.455325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-45223614-1022-4d1b-bb16-0cb797dcfbc5 tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:33.495406 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-45223614-1022-4d1b-bb16-0cb797dcfbc5 tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1841684746/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.045363 Oct 10 23:16:33.496092 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 26/38] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 10 23:16:33 2022] DELETE /compute/v2.1/flavors/1841684746/os-extra_specs/hw:numa_nodes => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 23:16:33.507223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0e4fcb52-b3f2-4cd8-91f0-105ad94068d7 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:33.534609 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0e4fcb52-b3f2-4cd8-91f0-105ad94068d7 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/f60af3cd-3df6-4a28-b561-2af9795c8307" status: 202 len: 0 microversion: 2.1 time: 0.036361 Oct 10 23:16:33.538783 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 27/39] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:16:33 2022] DELETE /compute/v2.1/flavors/f60af3cd-3df6-4a28-b561-2af9795c8307 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:16:33.546352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-70f2020d-6d97-42cc-b896-8a6b829ec5f2 tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:33.578347 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-70f2020d-6d97-42cc-b896-8a6b829ec5f2 tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1841684746/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.037750 Oct 10 23:16:33.582843 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 28/40] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 10 23:16:33 2022] DELETE /compute/v2.1/flavors/1841684746/os-extra_specs/hw:cpu_policy => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 23:16:33.587338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a7b27c92-25ee-46d9-a169-df8fd6712d27 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:33.612429 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a7b27c92-25ee-46d9-a169-df8fd6712d27 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.032000 Oct 10 23:16:33.625018 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 29/41] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:16:33 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:33.629678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-570cf05b-a7c5-4366-85bc-4db2b7beb095 tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:33.638446 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-570cf05b-a7c5-4366-85bc-4db2b7beb095 tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1841684746/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.023252 Oct 10 23:16:33.640221 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 30/42] 10.222.0.23 () {58 vars in 1203 bytes} [Mon Oct 10 23:16:33 2022] GET /compute/v2.1/flavors/1841684746/os-extra_specs => generated 19 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:16:33.646736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9544428e-9845-47ba-82e6-1da1a0af241c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:33.647365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9544428e-9845-47ba-82e6-1da1a0af241c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:33.656317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9544428e-9845-47ba-82e6-1da1a0af241c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:33.656808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9544428e-9845-47ba-82e6-1da1a0af241c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:33.657254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9544428e-9845-47ba-82e6-1da1a0af241c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:33.658216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9544428e-9845-47ba-82e6-1da1a0af241c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:33.658670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9544428e-9845-47ba-82e6-1da1a0af241c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:33.659089 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9544428e-9845-47ba-82e6-1da1a0af241c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:33.816010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9544428e-9845-47ba-82e6-1da1a0af241c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:33.836159 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9544428e-9845-47ba-82e6-1da1a0af241c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 200 len: 1224 microversion: 2.1 time: 0.194658 Oct 10 23:16:33.844554 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 31/43] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:33 2022] GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 1224 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:33.852679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f9076271-c9ba-4f3a-ac03-ff39676f651a tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-427665331", "id": "1275d044-b167-48b2-8858-b60da863a9e1", "os-flavor-access:is_public": "True"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:33.854665 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-58fc00e8-2d1a-4a5d-a33a-c4d60c7e699d tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 1.082671 Oct 10 23:16:33.855856 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 13/44] 10.222.0.23 () {62 vars in 1232 bytes} [Mon Oct 10 23:16:32 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:16:33.866353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-84f0dc9c-c173-4a8d-8653-aea24af11c25 tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:33.880216 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f9076271-c9ba-4f3a-ac03-ff39676f651a tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.034527 Oct 10 23:16:33.882589 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 32/45] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:16:33 2022] POST /compute/v2.1/flavors => generated 506 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:33.890886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9fb36a47-2a0a-4cf2-92c0-7644a6bc52d3 tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-2"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:33.894055 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-84f0dc9c-c173-4a8d-8653-aea24af11c25 tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1841684746" status: 202 len: 0 microversion: 2.1 time: 0.036781 Oct 10 23:16:33.897527 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 14/46] 10.222.0.23 () {58 vars in 1161 bytes} [Mon Oct 10 23:16:33 2022] DELETE /compute/v2.1/flavors/1841684746 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:16:33.906795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fd928a60-8ad3-4fc6-a226-cf3b400db490 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:33.939273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9fb36a47-2a0a-4cf2-92c0-7644a6bc52d3 tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:33.940250 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fd928a60-8ad3-4fc6-a226-cf3b400db490 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1275d044-b167-48b2-8858-b60da863a9e1" status: 202 len: 0 microversion: 2.1 time: 0.044023 Oct 10 23:16:33.940495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9fb36a47-2a0a-4cf2-92c0-7644a6bc52d3 tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:33.941764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9fb36a47-2a0a-4cf2-92c0-7644a6bc52d3 tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:33.945085 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 15/47] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:16:33 2022] DELETE /compute/v2.1/flavors/1275d044-b167-48b2-8858-b60da863a9e1 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:16:33.955977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2d5326c3-7396-4a76-9d5a-cf2101fbf55b tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:33.992641 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2d5326c3-7396-4a76-9d5a-cf2101fbf55b tempest-FlavorsExtraSpecsTestJSON-630767120 tempest-FlavorsExtraSpecsTestJSON-630767120-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046016 Oct 10 23:16:33.993404 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 16/48] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:16:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:33.998446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1906787b-6a44-4d89-bccf-2b1fe0956095 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:34.022950 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1906787b-6a44-4d89-bccf-2b1fe0956095 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028098 Oct 10 23:16:34.023530 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 17/49] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:16:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:34.043224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-69ad64ae-c60e-4788-b1b6-7aef41e55076 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1970356218", "id": 2123529423, "os-flavor-access:is_public": "True"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:34.064316 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-69ad64ae-c60e-4788-b1b6-7aef41e55076 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.024770 Oct 10 23:16:34.072366 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 18/50] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:16:34 2022] POST /compute/v2.1/flavors => generated 414 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:16:34.078303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8ce3a1cb-680a-4e22-bd8c-a646831203e9 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:34.094560 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8ce3a1cb-680a-4e22-bd8c-a646831203e9 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/2123529423" status: 200 len: 414 microversion: 2.1 time: 0.020690 Oct 10 23:16:34.095270 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 19/51] 10.222.0.23 () {58 vars in 1158 bytes} [Mon Oct 10 23:16:34 2022] GET /compute/v2.1/flavors/2123529423 => generated 414 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:34.401822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-536b88a8-a8cf-42c8-87f0-5c9a12daa513 tempest-FlavorsAdminTestJSON-1849697476 tempest-FlavorsAdminTestJSON-1849697476-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:34.442795 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-536b88a8-a8cf-42c8-87f0-5c9a12daa513 tempest-FlavorsAdminTestJSON-1849697476 tempest-FlavorsAdminTestJSON-1849697476-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.338584 Oct 10 23:16:34.443553 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 20/52] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:16:34 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:34.466212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-62824ec9-2848-4c32-b808-ab52745d689c tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:34.487049 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-62824ec9-2848-4c32-b808-ab52745d689c tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/2123529423" status: 202 len: 0 microversion: 2.1 time: 0.024427 Oct 10 23:16:34.492216 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 21/53] 10.222.0.23 () {58 vars in 1161 bytes} [Mon Oct 10 23:16:34 2022] DELETE /compute/v2.1/flavors/2123529423 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:16:34.497014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-52514063-aaff-4193-9725-2295ac1d08aa tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:34.518528 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-52514063-aaff-4193-9725-2295ac1d08aa tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025126 Oct 10 23:16:34.521523 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 22/54] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:16:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:34.540243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b9fcae88-efa1-4d4e-a01e-11d38dc3dc9c tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-231426049", "id": 1916922209, "os-flavor-access:is_public": "False"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:34.565860 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b9fcae88-efa1-4d4e-a01e-11d38dc3dc9c tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.031205 Oct 10 23:16:34.567060 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 23/55] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:16:34 2022] POST /compute/v2.1/flavors => generated 429 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:16:34.581035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1609f8e8-0b5c-468b-a79d-ebc99810fa39 tempest-FlavorsAdminTestJSON-1849697476 tempest-FlavorsAdminTestJSON-1849697476-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "1916922209"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:34.600298 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-1609f8e8-0b5c-468b-a79d-ebc99810fa39 tempest-FlavorsAdminTestJSON-1849697476 tempest-FlavorsAdminTestJSON-1849697476-project] HTTP exception thrown: Flavor 1916922209 could not be found. Oct 10 23:16:34.604590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1609f8e8-0b5c-468b-a79d-ebc99810fa39 tempest-FlavorsAdminTestJSON-1849697476 tempest-FlavorsAdminTestJSON-1849697476-project] Request method failure captured: Oct 10 23:16:34.604590 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:16:34.604590 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:16:34.604590 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:16:34.604590 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:16:34.604590 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 107 Oct 10 23:16:34.604590 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:16:34.604590 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:16:34.604590 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:16:34.604590 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:34.604590 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfMp86EOlNqblTGn9TfJqp1SO15LgtkOnOWDKny9zdwWXNu7pS4Oe-7JXBvmNSbOtieVEmLFfzz28ItYjuXExsiHTsqg70HrBisJ2KQzXN04O8GOZUUxUx1Z31ASBTJiNH2P34lvUJ7IhC71GmfPAicV2Sj35ZtjNAFbOI5snjShCQ Oct 10 23:16:34.604590 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:16:34.604590 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:16:34.604590 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:16:34.604590 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:16:34.604590 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:16:34.604590 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:16:34.604590 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: b64ccd76af3a4f179455528e66d5c63c Oct 10 23:16:34.604590 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-FlavorsAdminTestJSON-1849697476 Oct 10 23:16:34.604590 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:16:34.604590 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:16:34.605885 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b64ccd76af3a4f179455528e66d5c63c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b64ccd76af3a4f179455528e66d5c63c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b64ccd76af3a4f179455528e66d5c63c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b64ccd76af3a4f179455528e66d5c63c", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:34.605885 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-FlavorsAdminTestJSON-1849697476 Oct 10 23:16:34.605885 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: b64ccd76af3a4f179455528e66d5c63c Oct 10 23:16:34.605885 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1849697476 Oct 10 23:16:34.605885 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-FlavorsAdminTestJSON-1849697476-project Oct 10 23:16:34.605885 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:16:34.605885 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:16:34.605885 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a9c1a7034ef74a83b63ad8bf7ba4dcd1 Oct 10 23:16:34.605885 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-FlavorsAdminTestJSON-1849697476-project Oct 10 23:16:34.605885 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:16:34.605885 n-d-860864-2 devstack@n-api.service[120613]: {"server": {"name": "test", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "1916922209"}} Oct 10 23:16:34.605885 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:16:34.605885 n-d-860864-2 devstack@n-api.service[120613]: exception: Flavor 1916922209 could not be found. Oct 10 23:16:34.606648 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '1916922209'}}} Oct 10 23:16:34.606648 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:34.606648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:34.606648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 10 23:16:34.606648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 10 23:16:34.606648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 23:16:34.606648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 23:16:34.606648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:16:34.606648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:16:34.606648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 23:16:34.606648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 23:16:34.606648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 23:16:34.606648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:34.606648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 23:16:34.606648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 23:16:34.606648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1916922209 could not be found. Oct 10 23:16:34.606648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:34.606648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:34.606648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:34.606648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:34.607834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:34.607834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:34.607834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:34.607834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:34.607834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:34.607834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:34.607834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:16:34.607834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:16:34.607834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:16:34.607834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:16:34.607834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:16:34.607834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:16:34.607834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 23:16:34.607834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 10 23:16:34.607834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 10 23:16:34.607834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1916922209 could not be found. Oct 10 23:16:34.607834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:34.607834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:34.607834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:34.607834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:34.607834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:34.609053 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:34.609053 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:16:34.609053 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:16:34.609053 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1916922209 could not be found. Oct 10 23:16:34.609053 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:34.610065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1609f8e8-0b5c-468b-a79d-ebc99810fa39 tempest-FlavorsAdminTestJSON-1849697476 tempest-FlavorsAdminTestJSON-1849697476-project] Returning 400 to user: Flavor 1916922209 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:34.611059 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1609f8e8-0b5c-468b-a79d-ebc99810fa39 tempest-FlavorsAdminTestJSON-1849697476 tempest-FlavorsAdminTestJSON-1849697476-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.035429 Oct 10 23:16:34.611781 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 24/56] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:16:34 2022] POST /compute/v2.1/servers => generated 81 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 10 23:16:34.620355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c54b3f56-f6d2-408a-89a6-3a3a15dc7a64 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:34.628249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7,nova_api:DELETE=12,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:16:34.653965 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c54b3f56-f6d2-408a-89a6-3a3a15dc7a64 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1916922209" status: 202 len: 0 microversion: 2.1 time: 0.037246 Oct 10 23:16:34.657258 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 25/57] 10.222.0.23 () {58 vars in 1161 bytes} [Mon Oct 10 23:16:34 2022] DELETE /compute/v2.1/flavors/1916922209 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:16:34.665209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8f9f21f2-8ca8-4315-8be9-eb4850206924 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:34.692602 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8f9f21f2-8ca8-4315-8be9-eb4850206924 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031760 Oct 10 23:16:34.697520 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 26/58] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:16:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:34.716295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3167c763-5ee3-4e1d-a19c-7df7e52a5fcf tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-590804028", "id": 884357013, "os-flavor-access:is_public": "False"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:34.748975 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3167c763-5ee3-4e1d-a19c-7df7e52a5fcf tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.035027 Oct 10 23:16:34.750965 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 27/59] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:16:34 2022] POST /compute/v2.1/flavors => generated 411 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:16:34.768592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1b1a3a3a-4bcc-4e13-9d15-683412c951c3 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1691604152", "id": 399451993, "os-flavor-access:is_public": "True"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:34.795245 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1b1a3a3a-4bcc-4e13-9d15-683412c951c3 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.035538 Oct 10 23:16:34.803429 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 28/60] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:16:34 2022] POST /compute/v2.1/flavors => generated 411 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:34.814384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b4f2dfb3-4b7b-400f-8843-eea991d2d964 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:34.845665 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b4f2dfb3-4b7b-400f-8843-eea991d2d964 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.039789 Oct 10 23:16:34.854111 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 29/61] 10.222.0.23 () {58 vars in 1169 bytes} [Mon Oct 10 23:16:34 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:34.870344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9878d383-ae3c-446e-aa13-86907a2e6334 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:34.881530 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9878d383-ae3c-446e-aa13-86907a2e6334 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.022558 Oct 10 23:16:34.882293 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 30/62] 10.222.0.23 () {58 vars in 1177 bytes} [Mon Oct 10 23:16:34 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:34.887610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5f74e1b6-4a17-4fb1-b0a3-6cac448f0d5b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:34.888286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5f74e1b6-4a17-4fb1-b0a3-6cac448f0d5b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:34.904049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f74e1b6-4a17-4fb1-b0a3-6cac448f0d5b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:34.905300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f74e1b6-4a17-4fb1-b0a3-6cac448f0d5b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:34.906118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f74e1b6-4a17-4fb1-b0a3-6cac448f0d5b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:34.906995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f74e1b6-4a17-4fb1-b0a3-6cac448f0d5b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:34.908135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f74e1b6-4a17-4fb1-b0a3-6cac448f0d5b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:34.913859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f74e1b6-4a17-4fb1-b0a3-6cac448f0d5b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:34.990443 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9fb36a47-2a0a-4cf2-92c0-7644a6bc52d3 tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 1.097310 Oct 10 23:16:34.991769 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 33/63] 10.222.0.23 () {62 vars in 1232 bytes} [Mon Oct 10 23:16:33 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:16:35.003811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a5572eae-91a2-44d3-bd4f-261a6402edbd tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:35.041215 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a5572eae-91a2-44d3-bd4f-261a6402edbd tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.047879 Oct 10 23:16:35.041905 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 34/64] 10.222.0.23 () {58 vars in 1171 bytes} [Mon Oct 10 23:16:34 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:35.063656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aef8cb83-8771-49ee-b85f-781ed0ddfd3e tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:35.117923 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aef8cb83-8771-49ee-b85f-781ed0ddfd3e tempest-AggregatesAdminTestV241-1896553409 tempest-AggregatesAdminTestV241-1896553409-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.074711 Oct 10 23:16:35.118583 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 35/65] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Oct 10 23:16:35 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:35.128600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e24d9c67-12f8-492d-bd66-f78d108437e2 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:35.143934 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e24d9c67-12f8-492d-bd66-f78d108437e2 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.021708 Oct 10 23:16:35.144877 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 36/66] 10.222.0.23 () {58 vars in 1169 bytes} [Mon Oct 10 23:16:35 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:35.160931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-02bec6d2-25f2-4c91-a24d-5d470fd7af73 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:35.200556 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-02bec6d2-25f2-4c91-a24d-5d470fd7af73 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.045373 Oct 10 23:16:35.202169 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 37/67] 10.222.0.23 () {58 vars in 1169 bytes} [Mon Oct 10 23:16:35 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:16:35.211020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dc87d0c8-fb3b-422b-a3b4-3adc1c2d253b tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-358925930", "name": "tempest-test_aggregate-439332839"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:35.243413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.aggregate [None req-dc87d0c8-fb3b-422b-a3b4-3adc1c2d253b tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Generated uuid 4886641e-53a8-49de-9aaa-b98aaa08bb3c for aggregate {{(pid=120614) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 23:16:35.324890 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dc87d0c8-fb3b-422b-a3b4-3adc1c2d253b tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.120151 Oct 10 23:16:35.325978 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 38/68] 10.222.0.23 () {60 vars in 1165 bytes} [Mon Oct 10 23:16:35 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:35.333891 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d002b4f2-dcfc-4f1a-b18f-dcfc8b5393d6 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:35.359815 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d002b4f2-dcfc-4f1a-b18f-dcfc8b5393d6 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.031471 Oct 10 23:16:35.367781 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 39/69] 10.222.0.23 () {58 vars in 1175 bytes} [Mon Oct 10 23:16:35 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:35.382709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f5c80799-1b76-40a7-b644-996373d7659c tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:35.402558 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f5c80799-1b76-40a7-b644-996373d7659c tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 300 microversion: 2.1 time: 0.032176 Oct 10 23:16:35.409931 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 40/70] 10.222.0.23 () {58 vars in 1143 bytes} [Mon Oct 10 23:16:35 2022] GET /compute/v2.1/os-aggregates => generated 300 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:35.409931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fcd7199f-c51c-4ac1-9177-d4629f24aa8c tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:35.430237 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fcd7199f-c51c-4ac1-9177-d4629f24aa8c tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.025653 Oct 10 23:16:35.431153 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 41/71] 10.222.0.23 () {58 vars in 1173 bytes} [Mon Oct 10 23:16:35 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:35.436041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4de123e1-bf58-496a-b0b5-0e4af3b2a775 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-2"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:35.454200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4de123e1-bf58-496a-b0b5-0e4af3b2a775 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:35.455009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4de123e1-bf58-496a-b0b5-0e4af3b2a775 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:35.455753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4de123e1-bf58-496a-b0b5-0e4af3b2a775 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:35.484281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=11,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:16:35.691365 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4de123e1-bf58-496a-b0b5-0e4af3b2a775 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 312 microversion: 2.1 time: 0.257982 Oct 10 23:16:35.692257 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 42/72] 10.222.0.23 () {60 vars in 1191 bytes} [Mon Oct 10 23:16:35 2022] POST /compute/v2.1/os-aggregates/2/action => generated 312 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:35.700246 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2d8d5b9e-e858-4f5b-b879-00ee1f46e708 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:35.729887 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2d8d5b9e-e858-4f5b-b879-00ee1f46e708 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.035278 Oct 10 23:16:35.730502 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 43/73] 10.222.0.23 () {58 vars in 1169 bytes} [Mon Oct 10 23:16:35 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:35.762753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5753f3bc-7bf4-4611-b453-e2569aaf7881 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:35.819912 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5753f3bc-7bf4-4611-b453-e2569aaf7881 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/399451993" status: 202 len: 0 microversion: 2.1 time: 0.074698 Oct 10 23:16:35.827505 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 44/74] 10.222.0.23 () {58 vars in 1158 bytes} [Mon Oct 10 23:16:35 2022] DELETE /compute/v2.1/flavors/399451993 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:16:35.836365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-156762c4-bee0-45ce-9255-8342fbde4f4c tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:35.883982 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-156762c4-bee0-45ce-9255-8342fbde4f4c tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052402 Oct 10 23:16:35.887220 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 45/75] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:16:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:16:35.904986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-06385f6f-7c8e-454c-9a2f-5ab8053b4890 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:35.931486 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-06385f6f-7c8e-454c-9a2f-5ab8053b4890 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/884357013" status: 202 len: 0 microversion: 2.1 time: 0.030862 Oct 10 23:16:35.932097 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 46/76] 10.222.0.23 () {58 vars in 1158 bytes} [Mon Oct 10 23:16:35 2022] DELETE /compute/v2.1/flavors/884357013 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 23:16:35.941703 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-36b1b0f9-8620-46a5-9a95-c992efe5c168 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:35.976022 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-36b1b0f9-8620-46a5-9a95-c992efe5c168 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038514 Oct 10 23:16:35.982048 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 47/77] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:16:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:36.006276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9574e426-9c45-41ca-81b2-4c1c52090dfc tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-531622375", "id": 1495586844, "os-flavor-access:is_public": "False"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:36.039693 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9574e426-9c45-41ca-81b2-4c1c52090dfc tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.043746 Oct 10 23:16:36.045424 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 48/78] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:16:35 2022] POST /compute/v2.1/flavors => generated 414 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:36.061677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1e96c83e-250a-4112-b437-fbdaa57ab211 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:36.093489 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1e96c83e-250a-4112-b437-fbdaa57ab211 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042960 Oct 10 23:16:36.095308 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 49/79] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:16:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:16:36.112583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-353a395c-14ae-4b63-9051-91aa6a68dc05 tempest-FlavorsAdminTestJSON-1849697476 tempest-FlavorsAdminTestJSON-1849697476-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:36.135833 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-353a395c-14ae-4b63-9051-91aa6a68dc05 tempest-FlavorsAdminTestJSON-1849697476 tempest-FlavorsAdminTestJSON-1849697476-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026435 Oct 10 23:16:36.137903 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 50/80] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:16:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:36.155432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d62a6b75-bee9-47aa-997e-51c4624406ee tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:36.180041 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d62a6b75-bee9-47aa-997e-51c4624406ee tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1495586844" status: 202 len: 0 microversion: 2.1 time: 0.028149 Oct 10 23:16:36.180747 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 51/81] 10.222.0.23 () {58 vars in 1161 bytes} [Mon Oct 10 23:16:36 2022] DELETE /compute/v2.1/flavors/1495586844 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 23:16:37.112785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-997419061", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "availability_zone": "tempest-test_az-358925930"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:37.152457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:37.153122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:37.155095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:37.156186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:37.158494 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:37.159881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:37.352404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] validate_networks() for None {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:16:37.394222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5f74e1b6-4a17-4fb1-b0a3-6cac448f0d5b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:37.433835 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5f74e1b6-4a17-4fb1-b0a3-6cac448f0d5b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 200 len: 1320 microversion: 2.1 time: 2.546955 Oct 10 23:16:37.434986 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 31/82] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:34 2022] GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 1320 bytes in 2552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:37.448575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5c26018c-7c64-4edd-9900-c1d6a2a1341c tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:37.499515 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5c26018c-7c64-4edd-9900-c1d6a2a1341c tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060970 Oct 10 23:16:37.505556 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 32/83] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:16:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:37.530491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-17029de5-961e-407c-89c6-358868ca2a52 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1397091676", "id": 240144283, "os-flavor-access:is_public": "True"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:37.570413 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-17029de5-961e-407c-89c6-358868ca2a52 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.046717 Oct 10 23:16:37.571966 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 33/84] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:16:37 2022] POST /compute/v2.1/flavors => generated 411 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:16:37.594346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8807db8b-89c5-4fc2-bdfe-be7ffbed0e36 tempest-FlavorsAdminTestJSON-1849697476 tempest-FlavorsAdminTestJSON-1849697476-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:37.672434 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8807db8b-89c5-4fc2-bdfe-be7ffbed0e36 tempest-FlavorsAdminTestJSON-1849697476 tempest-FlavorsAdminTestJSON-1849697476-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.091416 Oct 10 23:16:37.675689 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 34/85] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:16:37 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:37.695863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2dd0be15-6a56-4daa-bf38-2be69e4384cb tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:37.737857 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2dd0be15-6a56-4daa-bf38-2be69e4384cb tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/240144283" status: 202 len: 0 microversion: 2.1 time: 0.045684 Oct 10 23:16:37.739900 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 35/86] 10.222.0.23 () {58 vars in 1158 bytes} [Mon Oct 10 23:16:37 2022] DELETE /compute/v2.1/flavors/240144283 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 23:16:37.756805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8b9c5f3e-cbaa-4871-9b8c-d870f6bb94a8 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:37.758672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:16:37.759294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:16:37.760155 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:16:37.760728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:16:37.761733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:16:37.775960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:37.776841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:37.777504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:37.778645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:37.779696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:37.780567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:37.813079 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8b9c5f3e-cbaa-4871-9b8c-d870f6bb94a8 tempest-FlavorsAdminTestJSON-6880494 tempest-FlavorsAdminTestJSON-6880494-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067190 Oct 10 23:16:37.815490 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 36/87] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:16:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:37.852489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Getting quotas for project 44bbffb85d0c4d51b038cf010f9ffa84. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:16:37.870957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Getting quotas for user 67c7c0c5c6a34d429fcc76135bdae5e7 and project 44bbffb85d0c4d51b038cf010f9ffa84. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:16:37.884618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:16:37.888476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:16:38.008351 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8f869e4a-a402-4818-88d9-55db480c9d3c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.825258 Oct 10 23:16:38.017699 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 52/88] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:16:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:16:38.029431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f2743f1d-5c0d-45d1-9679-91ab3a6eacc6 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:38.030975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f2743f1d-5c0d-45d1-9679-91ab3a6eacc6 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:38.332606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f2743f1d-5c0d-45d1-9679-91ab3a6eacc6 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:38.392952 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f2743f1d-5c0d-45d1-9679-91ab3a6eacc6 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1241 microversion: 2.1 time: 0.370627 Oct 10 23:16:38.396189 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 37/89] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:38 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1241 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:38.464675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-74c7e6a5-9399-448d-8b8f-efc11189f213 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:38.465389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-74c7e6a5-9399-448d-8b8f-efc11189f213 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:38.476232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74c7e6a5-9399-448d-8b8f-efc11189f213 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:38.476835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74c7e6a5-9399-448d-8b8f-efc11189f213 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:38.478536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74c7e6a5-9399-448d-8b8f-efc11189f213 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:38.490271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74c7e6a5-9399-448d-8b8f-efc11189f213 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:38.490778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74c7e6a5-9399-448d-8b8f-efc11189f213 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:38.495631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74c7e6a5-9399-448d-8b8f-efc11189f213 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:39.068230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-74c7e6a5-9399-448d-8b8f-efc11189f213 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:39.081563 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-74c7e6a5-9399-448d-8b8f-efc11189f213 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 200 len: 1320 microversion: 2.1 time: 0.621185 Oct 10 23:16:39.082469 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 53/90] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:38 2022] GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 1320 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:39.422524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-43667464-a960-438e-8cac-21e41549514a tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:39.423303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-43667464-a960-438e-8cac-21e41549514a tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:39.519277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-43667464-a960-438e-8cac-21e41549514a tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:39.531257 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-43667464-a960-438e-8cac-21e41549514a tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1241 microversion: 2.1 time: 0.115199 Oct 10 23:16:39.532347 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 38/91] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:39 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1241 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:40.025804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-74c7e6a5-9399-448d-8b8f-efc11189f213 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:40.027312 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-74c7e6a5-9399-448d-8b8f-efc11189f213 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001744 Oct 10 23:16:40.027958 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 54/92] 10.222.0.23 () {56 vars in 886 bytes} [Mon Oct 10 23:16:40 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 10 23:16:40.110543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2936ed5e-d1e7-4dca-8774-5f19ae10c79c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:40.112779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2936ed5e-d1e7-4dca-8774-5f19ae10c79c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:40.117679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:16:40.126581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2936ed5e-d1e7-4dca-8774-5f19ae10c79c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:40.130900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2936ed5e-d1e7-4dca-8774-5f19ae10c79c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:40.132590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2936ed5e-d1e7-4dca-8774-5f19ae10c79c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:40.133942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2936ed5e-d1e7-4dca-8774-5f19ae10c79c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:40.135375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2936ed5e-d1e7-4dca-8774-5f19ae10c79c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:40.136532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2936ed5e-d1e7-4dca-8774-5f19ae10c79c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:40.463209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2936ed5e-d1e7-4dca-8774-5f19ae10c79c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:40.475650 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2936ed5e-d1e7-4dca-8774-5f19ae10c79c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 200 len: 1320 microversion: 2.1 time: 0.370758 Oct 10 23:16:40.476277 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 39/93] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:40 2022] GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 1320 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:40.568340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2887c868-1b22-4314-8310-0b8cefb6d909 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:40.570055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2887c868-1b22-4314-8310-0b8cefb6d909 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:40.583797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2887c868-1b22-4314-8310-0b8cefb6d909 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:40.584721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2887c868-1b22-4314-8310-0b8cefb6d909 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:40.585995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2887c868-1b22-4314-8310-0b8cefb6d909 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:40.587846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2887c868-1b22-4314-8310-0b8cefb6d909 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:40.589234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2887c868-1b22-4314-8310-0b8cefb6d909 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:40.590990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2887c868-1b22-4314-8310-0b8cefb6d909 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:40.882296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2887c868-1b22-4314-8310-0b8cefb6d909 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:40.906497 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2887c868-1b22-4314-8310-0b8cefb6d909 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1289 microversion: 2.1 time: 0.351869 Oct 10 23:16:40.907998 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 55/94] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:40 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1289 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:41.506232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a3724829-e247-4e34-8b67-f612f8ff5d28 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:41.507331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a3724829-e247-4e34-8b67-f612f8ff5d28 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:41.536332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3724829-e247-4e34-8b67-f612f8ff5d28 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:41.541078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3724829-e247-4e34-8b67-f612f8ff5d28 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:41.546133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3724829-e247-4e34-8b67-f612f8ff5d28 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:41.546993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3724829-e247-4e34-8b67-f612f8ff5d28 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:41.547482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3724829-e247-4e34-8b67-f612f8ff5d28 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:41.550476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3724829-e247-4e34-8b67-f612f8ff5d28 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:42.248823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a3724829-e247-4e34-8b67-f612f8ff5d28 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:42.265995 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a3724829-e247-4e34-8b67-f612f8ff5d28 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 200 len: 1320 microversion: 2.1 time: 0.765270 Oct 10 23:16:42.291036 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 40/95] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:41 2022] GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 1320 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:42.302868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1516ab34-4f0a-4973-8d1e-e86bd7224333 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:42.303879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1516ab34-4f0a-4973-8d1e-e86bd7224333 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:42.324308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1516ab34-4f0a-4973-8d1e-e86bd7224333 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:42.325162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1516ab34-4f0a-4973-8d1e-e86bd7224333 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:42.326976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1516ab34-4f0a-4973-8d1e-e86bd7224333 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:42.330275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1516ab34-4f0a-4973-8d1e-e86bd7224333 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:42.330919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1516ab34-4f0a-4973-8d1e-e86bd7224333 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:42.334117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1516ab34-4f0a-4973-8d1e-e86bd7224333 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:42.472811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-4cdca66f-2a6d-47cd-a6c1-d5912afacb81 req-0cea8318-6bb4-4365-9499-5f4b503b7b33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc4c250-e3ff-4840-bea2-b40c07049ae4", "tag": "9ca0dc09-a781-4608-9e31-5f63eec06e8f"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:42.502426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4cdca66f-2a6d-47cd-a6c1-d5912afacb81 req-0cea8318-6bb4-4365-9499-5f4b503b7b33 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:42.502963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4cdca66f-2a6d-47cd-a6c1-d5912afacb81 req-0cea8318-6bb4-4365-9499-5f4b503b7b33 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:42.503405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4cdca66f-2a6d-47cd-a6c1-d5912afacb81 req-0cea8318-6bb4-4365-9499-5f4b503b7b33 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:42.561525 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-4cdca66f-2a6d-47cd-a6c1-d5912afacb81 req-0cea8318-6bb4-4365-9499-5f4b503b7b33 service nova] Creating event network-changed:9ca0dc09-a781-4608-9e31-5f63eec06e8f for instance 3cc4c250-e3ff-4840-bea2-b40c07049ae4 on n-h1-860864-2 Oct 10 23:16:42.563057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4cdca66f-2a6d-47cd-a6c1-d5912afacb81 req-0cea8318-6bb4-4365-9499-5f4b503b7b33 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 23:16:42.563604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4cdca66f-2a6d-47cd-a6c1-d5912afacb81 req-0cea8318-6bb4-4365-9499-5f4b503b7b33 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 23:16:42.566253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8642fa4-e982-406c-a6ef-b337c512a5b0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:42.569207 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8642fa4-e982-406c-a6ef-b337c512a5b0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:42.581904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8642fa4-e982-406c-a6ef-b337c512a5b0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:42.582868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8642fa4-e982-406c-a6ef-b337c512a5b0 None None] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:42.583477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8642fa4-e982-406c-a6ef-b337c512a5b0 None None] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:42.584040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8642fa4-e982-406c-a6ef-b337c512a5b0 None None] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:42.606672 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.compute.rpcapi [None req-a8642fa4-e982-406c-a6ef-b337c512a5b0 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 10 23:16:42.614623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8642fa4-e982-406c-a6ef-b337c512a5b0 None None] Releasing lock "compute-rpcapi-router" {{(pid=120614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 23:16:42.653169 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a8642fa4-e982-406c-a6ef-b337c512a5b0 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.954215 Oct 10 23:16:42.655051 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 56/96] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:16:42.998606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1516ab34-4f0a-4973-8d1e-e86bd7224333 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:43.020496 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1516ab34-4f0a-4973-8d1e-e86bd7224333 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1295 microversion: 2.1 time: 0.714279 Oct 10 23:16:43.022372 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 41/97] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:42 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1295 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:43.290807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-62b79fde-cd32-4fa9-b221-ebb84445519d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:43.293880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-62b79fde-cd32-4fa9-b221-ebb84445519d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:43.317763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62b79fde-cd32-4fa9-b221-ebb84445519d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:43.319874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62b79fde-cd32-4fa9-b221-ebb84445519d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:43.320533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62b79fde-cd32-4fa9-b221-ebb84445519d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:43.322250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62b79fde-cd32-4fa9-b221-ebb84445519d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:43.325185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62b79fde-cd32-4fa9-b221-ebb84445519d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:43.325910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62b79fde-cd32-4fa9-b221-ebb84445519d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:44.051774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5866e0bf-4350-46f9-a0b3-160b768adf27 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:44.052584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5866e0bf-4350-46f9-a0b3-160b768adf27 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:44.060110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5866e0bf-4350-46f9-a0b3-160b768adf27 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:44.070361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5866e0bf-4350-46f9-a0b3-160b768adf27 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:44.078122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5866e0bf-4350-46f9-a0b3-160b768adf27 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:44.080425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5866e0bf-4350-46f9-a0b3-160b768adf27 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:44.083727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5866e0bf-4350-46f9-a0b3-160b768adf27 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:44.085138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5866e0bf-4350-46f9-a0b3-160b768adf27 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:44.531704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5866e0bf-4350-46f9-a0b3-160b768adf27 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:44.542340 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5866e0bf-4350-46f9-a0b3-160b768adf27 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1295 microversion: 2.1 time: 0.494619 Oct 10 23:16:44.550474 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 42/98] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:44 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1295 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:45.577366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e9da9123-9d79-46af-99d0-ac501230043e tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:45.579739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e9da9123-9d79-46af-99d0-ac501230043e tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:45.606427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9da9123-9d79-46af-99d0-ac501230043e tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:45.608683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9da9123-9d79-46af-99d0-ac501230043e tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:45.613275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9da9123-9d79-46af-99d0-ac501230043e tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:45.620889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9da9123-9d79-46af-99d0-ac501230043e tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:45.625909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9da9123-9d79-46af-99d0-ac501230043e tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:45.628581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9da9123-9d79-46af-99d0-ac501230043e tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:45.721697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-62b79fde-cd32-4fa9-b221-ebb84445519d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:45.739315 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-62b79fde-cd32-4fa9-b221-ebb84445519d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 200 len: 1320 microversion: 2.1 time: 2.450310 Oct 10 23:16:45.741519 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 57/99] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:43 2022] GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 1320 bytes in 2456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:47.108418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ecb19d8f-8f1b-4574-9914-39b6a8d30d08 tempest-QuotaClassesAdminTestJSON-1013965428 tempest-QuotaClassesAdminTestJSON-1013965428-project-admin] Calling method '.version_select at 0x7f66306b4ca0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:47.173981 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ecb19d8f-8f1b-4574-9914-39b6a8d30d08 tempest-QuotaClassesAdminTestJSON-1013965428 tempest-QuotaClassesAdminTestJSON-1013965428-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 1.146567 Oct 10 23:16:47.179145 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 58/100] 10.222.0.23 () {58 vars in 1185 bytes} [Mon Oct 10 23:16:46 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:47.193071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-79dc67c5-2cf4-43a4-a4a6-1aa19e52baec tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:47.194758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-79dc67c5-2cf4-43a4-a4a6-1aa19e52baec tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:47.236496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79dc67c5-2cf4-43a4-a4a6-1aa19e52baec tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:47.239505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79dc67c5-2cf4-43a4-a4a6-1aa19e52baec tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:47.240221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79dc67c5-2cf4-43a4-a4a6-1aa19e52baec tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:47.241748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79dc67c5-2cf4-43a4-a4a6-1aa19e52baec tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:47.243771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79dc67c5-2cf4-43a4-a4a6-1aa19e52baec tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:47.244569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79dc67c5-2cf4-43a4-a4a6-1aa19e52baec tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:47.247406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e9da9123-9d79-46af-99d0-ac501230043e tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:47.269236 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e9da9123-9d79-46af-99d0-ac501230043e tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1337 microversion: 2.1 time: 1.695418 Oct 10 23:16:47.299164 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 43/101] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:45 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1337 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:47.317841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-09b4e2a9-da66-43ce-8af3-665697670e6f tempest-QuotaClassesAdminTestJSON-1013965428 tempest-QuotaClassesAdminTestJSON-1013965428-project-admin] Action: 'update', calling method: .version_select at 0x7f663063ed30>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:48.130241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:DELETE=6,nova_api:SELECT=74,nova_api:INSERT=11,nova_api:UPDATE=9 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:16:48.352057 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-09b4e2a9-da66-43ce-8af3-665697670e6f tempest-QuotaClassesAdminTestJSON-1013965428 tempest-QuotaClassesAdminTestJSON-1013965428-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.051335 Oct 10 23:16:48.361274 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 44/102] 10.222.0.23 () {60 vars in 1206 bytes} [Mon Oct 10 23:16:47 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:48.372517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e3d161b6-f948-420b-9c7e-eb7fc7d3bdb8 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:48.382158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e3d161b6-f948-420b-9c7e-eb7fc7d3bdb8 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:48.391312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3d161b6-f948-420b-9c7e-eb7fc7d3bdb8 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:48.394327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3d161b6-f948-420b-9c7e-eb7fc7d3bdb8 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:48.394746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3d161b6-f948-420b-9c7e-eb7fc7d3bdb8 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:48.397486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3d161b6-f948-420b-9c7e-eb7fc7d3bdb8 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:48.399266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3d161b6-f948-420b-9c7e-eb7fc7d3bdb8 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:48.401705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3d161b6-f948-420b-9c7e-eb7fc7d3bdb8 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:48.705633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-79dc67c5-2cf4-43a4-a4a6-1aa19e52baec tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:48.731180 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-79dc67c5-2cf4-43a4-a4a6-1aa19e52baec tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 200 len: 1320 microversion: 2.1 time: 1.544843 Oct 10 23:16:48.734878 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 59/103] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:47 2022] GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 1320 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:48.965927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e3d161b6-f948-420b-9c7e-eb7fc7d3bdb8 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:48.975703 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e3d161b6-f948-420b-9c7e-eb7fc7d3bdb8 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1337 microversion: 2.1 time: 0.612513 Oct 10 23:16:48.983221 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 45/104] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:48 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1337 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:49.003391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c400754e-598e-4e63-8b50-872494bc24c5 tempest-QuotaClassesAdminTestJSON-1013965428 tempest-QuotaClassesAdminTestJSON-1013965428-project-admin] Calling method '.version_select at 0x7f66305f68b0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:49.027014 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c400754e-598e-4e63-8b50-872494bc24c5 tempest-QuotaClassesAdminTestJSON-1013965428 tempest-QuotaClassesAdminTestJSON-1013965428-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.037893 Oct 10 23:16:49.028353 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 46/105] 10.222.0.23 () {58 vars in 1185 bytes} [Mon Oct 10 23:16:48 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:49.041736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-55fb6f4f-abc2-4437-b686-b94b2de7605b tempest-QuotaClassesAdminTestJSON-1013965428 tempest-QuotaClassesAdminTestJSON-1013965428-project-admin] Action: 'update', calling method: .version_select at 0x7f6630662160>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:49.281521 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-55fb6f4f-abc2-4437-b686-b94b2de7605b tempest-QuotaClassesAdminTestJSON-1013965428 tempest-QuotaClassesAdminTestJSON-1013965428-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.241902 Oct 10 23:16:49.284774 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 47/106] 10.222.0.23 () {60 vars in 1206 bytes} [Mon Oct 10 23:16:49 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:16:49.666555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b61375f7-8998-433b-823b-41beeec6dcb9 tempest-FlavorsV255TestJSON-688475299 tempest-FlavorsV255TestJSON-688475299-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1217376813", "id": 825291502, "os-flavor-access:is_public": "True"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:49.698343 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b61375f7-8998-433b-823b-41beeec6dcb9 tempest-FlavorsV255TestJSON-688475299 tempest-FlavorsV255TestJSON-688475299-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.960305 Oct 10 23:16:49.711042 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 60/107] 10.222.0.23 () {62 vars in 1188 bytes} [Mon Oct 10 23:16:48 2022] POST /compute/v2.1/flavors => generated 446 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:16:49.759010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-40417f27-99e0-4963-ab3a-4696c11525c2 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:49.760615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-40417f27-99e0-4963-ab3a-4696c11525c2 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:49.797696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40417f27-99e0-4963-ab3a-4696c11525c2 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:49.801676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40417f27-99e0-4963-ab3a-4696c11525c2 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:49.803717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40417f27-99e0-4963-ab3a-4696c11525c2 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:49.806053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40417f27-99e0-4963-ab3a-4696c11525c2 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:49.809659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40417f27-99e0-4963-ab3a-4696c11525c2 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:49.818276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40417f27-99e0-4963-ab3a-4696c11525c2 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:50.151297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-40417f27-99e0-4963-ab3a-4696c11525c2 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:50.164302 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-40417f27-99e0-4963-ab3a-4696c11525c2 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 200 len: 1320 microversion: 2.1 time: 0.409270 Oct 10 23:16:50.178300 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 61/108] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:49 2022] GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 1320 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:50.192151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2a6ea3f1-b7ea-4ae5-8405-b4033e297855 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:50.193493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2a6ea3f1-b7ea-4ae5-8405-b4033e297855 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:50.207042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a6ea3f1-b7ea-4ae5-8405-b4033e297855 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:50.210298 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a6ea3f1-b7ea-4ae5-8405-b4033e297855 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:50.211125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a6ea3f1-b7ea-4ae5-8405-b4033e297855 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:50.214893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a6ea3f1-b7ea-4ae5-8405-b4033e297855 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:50.215374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a6ea3f1-b7ea-4ae5-8405-b4033e297855 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:50.221168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a6ea3f1-b7ea-4ae5-8405-b4033e297855 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:50.390744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-acd2aea1-c7a4-4a4d-a24f-14d4a0834873 tempest-FlavorsV255TestJSON-818951704 tempest-FlavorsV255TestJSON-818951704-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:50.410393 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-acd2aea1-c7a4-4a4d-a24f-14d4a0834873 tempest-FlavorsV255TestJSON-818951704 tempest-FlavorsV255TestJSON-818951704-project] 10.222.0.23 "GET /compute/v2.1/flavors/825291502" status: 200 len: 446 microversion: 2.55 time: 0.701320 Oct 10 23:16:50.424101 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 48/109] 10.222.0.23 () {60 vars in 1196 bytes} [Mon Oct 10 23:16:49 2022] GET /compute/v2.1/flavors/825291502 => generated 446 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 23:16:50.439306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-da268e43-dd2d-4020-8f10-de93b286ae09 tempest-FlavorsV255TestJSON-688475299 tempest-FlavorsV255TestJSON-688475299-project-admin] Action: 'update', calling method: .version_select at 0x7f6631664b80>, body: {"flavor": {"description": "new"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:50.527787 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-da268e43-dd2d-4020-8f10-de93b286ae09 tempest-FlavorsV255TestJSON-688475299 tempest-FlavorsV255TestJSON-688475299-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/825291502" status: 200 len: 447 microversion: 2.55 time: 0.093323 Oct 10 23:16:50.529450 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 49/110] 10.222.0.23 () {62 vars in 1216 bytes} [Mon Oct 10 23:16:50 2022] PUT /compute/v2.1/flavors/825291502 => generated 447 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 23:16:50.551318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-39a26928-950f-446c-8c75-1d96e12d21bf tempest-FlavorsV255TestJSON-818951704 tempest-FlavorsV255TestJSON-818951704-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:50.587215 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-39a26928-950f-446c-8c75-1d96e12d21bf tempest-FlavorsV255TestJSON-818951704 tempest-FlavorsV255TestJSON-818951704-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.048167 Oct 10 23:16:50.588748 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 50/111] 10.222.0.23 () {60 vars in 1187 bytes} [Mon Oct 10 23:16:50 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:16:50.610840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5cbd8461-1e48-4dcf-a338-59c0bed55e85 tempest-FlavorsV255TestJSON-818951704 tempest-FlavorsV255TestJSON-818951704-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:50.641351 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5cbd8461-1e48-4dcf-a338-59c0bed55e85 tempest-FlavorsV255TestJSON-818951704 tempest-FlavorsV255TestJSON-818951704-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.035816 Oct 10 23:16:50.655924 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 51/112] 10.222.0.23 () {60 vars in 1166 bytes} [Mon Oct 10 23:16:50 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:16:50.661248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a7234e5a-851d-4362-b5f7-21afbe7e19f8 tempest-FlavorsV255TestJSON-688475299 tempest-FlavorsV255TestJSON-688475299-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:50.688638 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a7234e5a-851d-4362-b5f7-21afbe7e19f8 tempest-FlavorsV255TestJSON-688475299 tempest-FlavorsV255TestJSON-688475299-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/825291502" status: 202 len: 0 microversion: 2.55 time: 0.031508 Oct 10 23:16:50.689443 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 52/113] 10.222.0.23 () {60 vars in 1199 bytes} [Mon Oct 10 23:16:50 2022] DELETE /compute/v2.1/flavors/825291502 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:16:50.708178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f2e8371d-bde9-486a-afe0-aa24a82751af tempest-FlavorsV255TestJSON-688475299 tempest-FlavorsV255TestJSON-688475299-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:50.753477 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f2e8371d-bde9-486a-afe0-aa24a82751af tempest-FlavorsV255TestJSON-688475299 tempest-FlavorsV255TestJSON-688475299-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.054451 Oct 10 23:16:50.777746 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 53/114] 10.222.0.23 () {60 vars in 1187 bytes} [Mon Oct 10 23:16:50 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:16:50.780067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2a6ea3f1-b7ea-4ae5-8405-b4033e297855 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:50.801842 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2a6ea3f1-b7ea-4ae5-8405-b4033e297855 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1337 microversion: 2.1 time: 0.622024 Oct 10 23:16:50.802436 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 62/115] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:50 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1337 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:51.192592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-20363a39-c4b6-4690-a026-ef242beb3d23 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:51.193711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-20363a39-c4b6-4690-a026-ef242beb3d23 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:51.206646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20363a39-c4b6-4690-a026-ef242beb3d23 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:51.210241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20363a39-c4b6-4690-a026-ef242beb3d23 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:51.210851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20363a39-c4b6-4690-a026-ef242beb3d23 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:51.212611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20363a39-c4b6-4690-a026-ef242beb3d23 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:51.215689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20363a39-c4b6-4690-a026-ef242beb3d23 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:51.217850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20363a39-c4b6-4690-a026-ef242beb3d23 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:51.806417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-20363a39-c4b6-4690-a026-ef242beb3d23 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:51.816969 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-20363a39-c4b6-4690-a026-ef242beb3d23 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 200 len: 1320 microversion: 2.1 time: 0.628783 Oct 10 23:16:51.846473 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 63/116] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:51 2022] GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 1320 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:52.090991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7cce5f77-711f-4736-b391-8a36356e22c4 tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Calling method '.version_select at 0x7f66305ad4c0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:52.096422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cce5f77-711f-4736-b391-8a36356e22c4 tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:52.097947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cce5f77-711f-4736-b391-8a36356e22c4 tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:52.098615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cce5f77-711f-4736-b391-8a36356e22c4 tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:52.101093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cce5f77-711f-4736-b391-8a36356e22c4 tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:52.102149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cce5f77-711f-4736-b391-8a36356e22c4 tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:52.103404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cce5f77-711f-4736-b391-8a36356e22c4 tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:52.202744 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7cce5f77-711f-4736-b391-8a36356e22c4 tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 1.161344 Oct 10 23:16:52.209547 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-159b5192-3167-4519-b7e5-02fed6c6a3cd req-eabb108b-cd01-42eb-8bec-d339db25599c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41c23198-c951-4c85-b87c-6f10d6835eaf", "tag": "470aa439-6a67-49f6-bdd4-ca7adc5d67b5"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:52.210295 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 54/117] 10.222.0.23 () {58 vars in 1128 bytes} [Mon Oct 10 23:16:51 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:52.226989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-68121013-2549-4803-a453-b9d7c4db9c86 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:52.231383 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-159b5192-3167-4519-b7e5-02fed6c6a3cd req-eabb108b-cd01-42eb-8bec-d339db25599c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:52.232994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-68121013-2549-4803-a453-b9d7c4db9c86 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:52.235039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-159b5192-3167-4519-b7e5-02fed6c6a3cd req-eabb108b-cd01-42eb-8bec-d339db25599c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:52.235770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-159b5192-3167-4519-b7e5-02fed6c6a3cd req-eabb108b-cd01-42eb-8bec-d339db25599c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:52.255566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68121013-2549-4803-a453-b9d7c4db9c86 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:52.268593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68121013-2549-4803-a453-b9d7c4db9c86 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:52.269116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68121013-2549-4803-a453-b9d7c4db9c86 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:52.270178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68121013-2549-4803-a453-b9d7c4db9c86 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:52.270790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68121013-2549-4803-a453-b9d7c4db9c86 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:52.271289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68121013-2549-4803-a453-b9d7c4db9c86 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:52.271887 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-159b5192-3167-4519-b7e5-02fed6c6a3cd req-eabb108b-cd01-42eb-8bec-d339db25599c service nova] Creating event network-changed:470aa439-6a67-49f6-bdd4-ca7adc5d67b5 for instance 41c23198-c951-4c85-b87c-6f10d6835eaf on n-h2-860864-2 Oct 10 23:16:52.292896 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-159b5192-3167-4519-b7e5-02fed6c6a3cd req-eabb108b-cd01-42eb-8bec-d339db25599c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.441872 Oct 10 23:16:52.298730 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 64/118] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:52.606733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=8 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:16:53.023561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-47169102-3788-4d69-aef0-98eb97cc6387 tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Calling method '.version_select at 0x7f66306b4f70>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:53.028939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-47169102-3788-4d69-aef0-98eb97cc6387 tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'd38db04beb854d5bb7a9cb8668b8415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2d0cb94344485aa0235b7fe8cd14bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:53.041283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-47169102-3788-4d69-aef0-98eb97cc6387 tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Request method failure captured: Oct 10 23:16:53.041283 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 10 23:16:53.041283 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:16:53.041283 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:16:53.041283 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:16:53.041283 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:16:53.041283 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:16:53.041283 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:16:53.041283 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:16:53.041283 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:53.041283 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKfetnhIj6wx290ByuOhKE5uXJwouTaPE5EGg5H_gGr1D-_FVjxnj97Lf0eZbCDEl0L3VcwQVJEexUMnPkeaqwNl-k__SQymUV4UA1NWrsVKEDyhe-934_GHuj6lCfJsB6GaBz5GN8i4hzYz5wJLspOB7Yh8m0dlYsiLc4rHcK4HorE Oct 10 23:16:53.041283 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:16:53.041283 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:16:53.041283 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:16:53.041283 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:16:53.041283 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:16:53.041283 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:16:53.041283 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 1d2d0cb94344485aa0235b7fe8cd14bf Oct 10 23:16:53.041283 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-798174562 Oct 10 23:16:53.041283 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:16:53.041283 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:16:53.042797 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d2d0cb94344485aa0235b7fe8cd14bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2d0cb94344485aa0235b7fe8cd14bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2d0cb94344485aa0235b7fe8cd14bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d2d0cb94344485aa0235b7fe8cd14bf", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:53.042797 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-HostsAdminNegativeTestJSON-798174562 Oct 10 23:16:53.042797 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 1d2d0cb94344485aa0235b7fe8cd14bf Oct 10 23:16:53.042797 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-798174562 Oct 10 23:16:53.042797 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-HostsAdminNegativeTestJSON-798174562-project Oct 10 23:16:53.042797 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:16:53.042797 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:16:53.042797 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: d38db04beb854d5bb7a9cb8668b8415f Oct 10 23:16:53.042797 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-HostsAdminNegativeTestJSON-798174562-project Oct 10 23:16:53.042797 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:16:53.042797 n-d-860864-2 devstack@n-api.service[120614]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 10 23:16:53.042797 n-d-860864-2 devstack@n-api.service[120614]: action_args: {} Oct 10 23:16:53.042797 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:53.043633 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.043633 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.043633 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.043633 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:53.043633 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:53.043633 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:16:53.043633 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:16:53.043633 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 23:16:53.043633 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:16:53.043633 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:53.043633 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:53.043633 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 10 23:16:53.043633 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 10 23:16:53.043633 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:16:53.043633 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:16:53.043633 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:16:53.043633 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:16:53.043633 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:16:53.043633 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:16:53.045064 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:16:53.045064 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:16:53.045064 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:16:53.045064 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:16:53.045064 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:16:53.045064 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:16:53.045064 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:16:53.045064 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:16:53.045064 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 10 23:16:53.045064 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.045064 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:53.045064 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.045064 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.045064 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.045064 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.045064 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:16:53.045064 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:16:53.045064 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 10 23:16:53.045064 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.046423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-47169102-3788-4d69-aef0-98eb97cc6387 tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:53.046423 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-47169102-3788-4d69-aef0-98eb97cc6387 tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.742357 Oct 10 23:16:53.059383 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 65/119] 10.222.0.23 () {58 vars in 1128 bytes} [Mon Oct 10 23:16:52 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 755 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:16:53.071723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-68121013-2549-4803-a453-b9d7c4db9c86 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:53.075493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d65f53e4-b1aa-4f54-a2e5-8fc1d480086d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:53.080709 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-68121013-2549-4803-a453-b9d7c4db9c86 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1337 microversion: 2.1 time: 0.869190 Oct 10 23:16:53.082042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d65f53e4-b1aa-4f54-a2e5-8fc1d480086d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:53.089043 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 55/120] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:52 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1337 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:53.105310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fe8b8d86-e780-44d0-a1d7-8c8e2430ba7f tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Calling method '.version_select at 0x7f6630568310>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:53.110726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fe8b8d86-e780-44d0-a1d7-8c8e2430ba7f tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'd38db04beb854d5bb7a9cb8668b8415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2d0cb94344485aa0235b7fe8cd14bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:53.125209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d65f53e4-b1aa-4f54-a2e5-8fc1d480086d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:53.125722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d65f53e4-b1aa-4f54-a2e5-8fc1d480086d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:53.127237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fe8b8d86-e780-44d0-a1d7-8c8e2430ba7f tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Request method failure captured: Oct 10 23:16:53.127237 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-hosts/n-d-860864-2/reboot HTTP/1.1 Oct 10 23:16:53.127237 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:16:53.127237 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:16:53.127237 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:16:53.127237 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:16:53.127237 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:16:53.127237 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:16:53.127237 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:16:53.127237 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:53.127237 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfetnhIj6wx290ByuOhKE5uXJwouTaPE5EGg5H_gGr1D-_FVjxnj97Lf0eZbCDEl0L3VcwQVJEexUMnPkeaqwNl-k__SQymUV4UA1NWrsVKEDyhe-934_GHuj6lCfJsB6GaBz5GN8i4hzYz5wJLspOB7Yh8m0dlYsiLc4rHcK4HorE Oct 10 23:16:53.127237 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:16:53.127237 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:16:53.127237 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:16:53.127237 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:16:53.127237 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:16:53.127237 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:16:53.127237 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 1d2d0cb94344485aa0235b7fe8cd14bf Oct 10 23:16:53.127237 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-798174562 Oct 10 23:16:53.127237 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:16:53.127237 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:16:53.128486 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d2d0cb94344485aa0235b7fe8cd14bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2d0cb94344485aa0235b7fe8cd14bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2d0cb94344485aa0235b7fe8cd14bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d2d0cb94344485aa0235b7fe8cd14bf", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:53.128486 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-HostsAdminNegativeTestJSON-798174562 Oct 10 23:16:53.128486 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 1d2d0cb94344485aa0235b7fe8cd14bf Oct 10 23:16:53.128486 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-798174562 Oct 10 23:16:53.128486 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-HostsAdminNegativeTestJSON-798174562-project Oct 10 23:16:53.128486 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:16:53.128486 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:16:53.128486 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: d38db04beb854d5bb7a9cb8668b8415f Oct 10 23:16:53.128486 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-HostsAdminNegativeTestJSON-798174562-project Oct 10 23:16:53.128486 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:16:53.128486 n-d-860864-2 devstack@n-api.service[120613]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 10 23:16:53.128486 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'n-d-860864-2'} Oct 10 23:16:53.128486 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:53.129283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.129283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.129283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.129283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:53.129283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:53.129283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:16:53.129283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:16:53.129283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:53.129283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:53.129283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 10 23:16:53.129283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 10 23:16:53.129283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:16:53.129283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:16:53.129283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:16:53.129283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:16:53.129283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:16:53.129283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:16:53.129283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:16:53.129283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:16:53.130328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:16:53.130328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:16:53.130328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:16:53.130328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:16:53.130328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:16:53.130328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:16:53.130328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 10 23:16:53.130328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.130328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:53.130328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.130328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.130328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.130328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.130328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:16:53.130328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:16:53.130328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 10 23:16:53.130328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.131175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fe8b8d86-e780-44d0-a1d7-8c8e2430ba7f tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:53.131175 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fe8b8d86-e780-44d0-a1d7-8c8e2430ba7f tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-860864-2/reboot" status: 403 len: 111 microversion: 2.1 time: 0.038413 Oct 10 23:16:53.140384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d65f53e4-b1aa-4f54-a2e5-8fc1d480086d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:53.141436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d65f53e4-b1aa-4f54-a2e5-8fc1d480086d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:53.142395 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 56/121] 10.222.0.23 () {58 vars in 1188 bytes} [Mon Oct 10 23:16:53 2022] GET /compute/v2.1/os-hosts/n-d-860864-2/reboot => generated 111 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:16:53.143892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d65f53e4-b1aa-4f54-a2e5-8fc1d480086d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:53.148455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d4fb52e2-9dca-4ce5-bf3d-b43dc9564a0c tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Calling method '.version_select at 0x7f6630683790>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:53.149499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d65f53e4-b1aa-4f54-a2e5-8fc1d480086d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:53.209870 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-d4fb52e2-9dca-4ce5-bf3d-b43dc9564a0c tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.217351 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d4fb52e2-9dca-4ce5-bf3d-b43dc9564a0c tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Request method failure captured: Oct 10 23:16:53.217351 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 10 23:16:53.217351 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:16:53.217351 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:16:53.217351 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:16:53.217351 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:16:53.217351 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:16:53.217351 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:16:53.217351 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:16:53.217351 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:53.217351 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfiTNZHN1aGtJXGdOrmMlHmd5us-unZFfHqn18ROel3RVl2vugD3elZ242ez-Tw-nUCx1ynb9xoMq1uiBWlSUy0jEUZy-hQJk140u7B82ShNHljjxjZ9w3XVFbyOVAxkOMzveHIo1s087o1o1KjDIORgHSOOsSuFa04wKbflritPas Oct 10 23:16:53.217351 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:16:53.217351 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:16:53.217351 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:16:53.217351 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:16:53.217351 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:16:53.217351 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:16:53.217351 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 19ee7304d15f4f8c82f8baa49bb5e86a Oct 10 23:16:53.217351 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.217351 n-d-860864-2 devstack@n-api.service[120613]: X-Role: admin,member,reader Oct 10 23:16:53.217351 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: admin,member,reader Oct 10 23:16:53.218945 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_19ee7304d15f4f8c82f8baa49bb5e86a", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:53.218945 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.218945 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 19ee7304d15f4f8c82f8baa49bb5e86a Oct 10 23:16:53.218945 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.218945 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-HostsAdminNegativeTestJSON-575246147-project-admin Oct 10 23:16:53.218945 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:16:53.218945 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:16:53.218945 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 24dc315257b64dcd9379b2e1e653f879 Oct 10 23:16:53.218945 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-HostsAdminNegativeTestJSON-575246147-project-admin Oct 10 23:16:53.218945 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:16:53.218945 n-d-860864-2 devstack@n-api.service[120613]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.218945 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'nonexistent_hostname'} Oct 10 23:16:53.218945 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:53.221389 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.221389 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 10 23:16:53.221389 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 10 23:16:53.221389 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 23:16:53.221389 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 23:16:53.221389 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:16:53.221389 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:16:53.221389 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:16:53.221389 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:16:53.221389 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 23:16:53.221389 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 23:16:53.221389 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 10 23:16:53.221389 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 10 23:16:53.221389 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:16:53.221389 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:16:53.221389 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 10 23:16:53.221389 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 10 23:16:53.221389 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:16:53.221389 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:16:53.223406 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 10 23:16:53.223406 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 10 23:16:53.223406 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.223406 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.223406 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:53.223406 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.223406 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.223406 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.223406 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.223406 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:53.223406 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:53.223406 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:16:53.223406 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:16:53.223406 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:53.223406 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:53.223406 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 10 23:16:53.223406 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 10 23:16:53.223406 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 10 23:16:53.223406 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:16:53.224471 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.224471 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.224471 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:53.224471 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.224471 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.224471 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.224471 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.224471 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:16:53.224471 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:16:53.224471 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.224471 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.228209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d4fb52e2-9dca-4ce5-bf3d-b43dc9564a0c tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:53.229494 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d4fb52e2-9dca-4ce5-bf3d-b43dc9564a0c tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.084632 Oct 10 23:16:53.238079 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 57/122] 10.222.0.23 () {58 vars in 1212 bytes} [Mon Oct 10 23:16:53 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:16:53.244982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-254710e6-7564-45ee-bd86-bc4b05ef07a4 tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Calling method '.version_select at 0x7f6630504f70>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:53.248969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-254710e6-7564-45ee-bd86-bc4b05ef07a4 tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'd38db04beb854d5bb7a9cb8668b8415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2d0cb94344485aa0235b7fe8cd14bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:53.251995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-254710e6-7564-45ee-bd86-bc4b05ef07a4 tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Request method failure captured: Oct 10 23:16:53.251995 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-hosts/n-d-860864-2 HTTP/1.1 Oct 10 23:16:53.251995 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:16:53.251995 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:16:53.251995 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:16:53.251995 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:16:53.251995 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:16:53.251995 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:16:53.251995 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:16:53.251995 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:53.251995 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfetnhIj6wx290ByuOhKE5uXJwouTaPE5EGg5H_gGr1D-_FVjxnj97Lf0eZbCDEl0L3VcwQVJEexUMnPkeaqwNl-k__SQymUV4UA1NWrsVKEDyhe-934_GHuj6lCfJsB6GaBz5GN8i4hzYz5wJLspOB7Yh8m0dlYsiLc4rHcK4HorE Oct 10 23:16:53.251995 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:16:53.251995 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:16:53.251995 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:16:53.251995 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:16:53.251995 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:16:53.251995 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:16:53.251995 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 1d2d0cb94344485aa0235b7fe8cd14bf Oct 10 23:16:53.251995 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-798174562 Oct 10 23:16:53.251995 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:16:53.251995 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:16:53.253187 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d2d0cb94344485aa0235b7fe8cd14bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2d0cb94344485aa0235b7fe8cd14bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2d0cb94344485aa0235b7fe8cd14bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d2d0cb94344485aa0235b7fe8cd14bf", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:53.253187 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-HostsAdminNegativeTestJSON-798174562 Oct 10 23:16:53.253187 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 1d2d0cb94344485aa0235b7fe8cd14bf Oct 10 23:16:53.253187 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-798174562 Oct 10 23:16:53.253187 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-HostsAdminNegativeTestJSON-798174562-project Oct 10 23:16:53.253187 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:16:53.253187 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:16:53.253187 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: d38db04beb854d5bb7a9cb8668b8415f Oct 10 23:16:53.253187 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-HostsAdminNegativeTestJSON-798174562-project Oct 10 23:16:53.253187 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:16:53.253187 n-d-860864-2 devstack@n-api.service[120613]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 10 23:16:53.253187 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'n-d-860864-2'} Oct 10 23:16:53.253187 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:53.253986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.253986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.253986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.253986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:53.253986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:53.253986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:16:53.253986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:16:53.253986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:53.253986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:53.253986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 10 23:16:53.253986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 10 23:16:53.253986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:16:53.253986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:16:53.253986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:16:53.253986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:16:53.253986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:16:53.253986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:16:53.253986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:16:53.253986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:16:53.257082 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:16:53.257082 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:16:53.257082 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:16:53.257082 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:16:53.257082 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:16:53.257082 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:16:53.257082 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 10 23:16:53.257082 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.257082 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:53.257082 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.257082 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.257082 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.257082 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.257082 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:16:53.257082 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:16:53.257082 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 10 23:16:53.257082 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.260139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-254710e6-7564-45ee-bd86-bc4b05ef07a4 tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:53.261511 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-254710e6-7564-45ee-bd86-bc4b05ef07a4 tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-860864-2" status: 403 len: 109 microversion: 2.1 time: 0.021818 Oct 10 23:16:53.262345 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 58/123] 10.222.0.23 () {58 vars in 1167 bytes} [Mon Oct 10 23:16:53 2022] GET /compute/v2.1/os-hosts/n-d-860864-2 => generated 109 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:16:53.306712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-425ec823-6499-448a-8529-52163a2e5714 tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Calling method '.version_select at 0x7f6630576af0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:53.345963 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-425ec823-6499-448a-8529-52163a2e5714 tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.363955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-425ec823-6499-448a-8529-52163a2e5714 tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Request method failure captured: Oct 10 23:16:53.363955 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 10 23:16:53.363955 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:16:53.363955 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:16:53.363955 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:16:53.363955 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:16:53.363955 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:16:53.363955 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:16:53.363955 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:16:53.363955 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:53.363955 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfiTNZHN1aGtJXGdOrmMlHmd5us-unZFfHqn18ROel3RVl2vugD3elZ242ez-Tw-nUCx1ynb9xoMq1uiBWlSUy0jEUZy-hQJk140u7B82ShNHljjxjZ9w3XVFbyOVAxkOMzveHIo1s087o1o1KjDIORgHSOOsSuFa04wKbflritPas Oct 10 23:16:53.363955 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:16:53.363955 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:16:53.363955 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:16:53.363955 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:16:53.363955 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:16:53.363955 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:16:53.363955 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 19ee7304d15f4f8c82f8baa49bb5e86a Oct 10 23:16:53.363955 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.363955 n-d-860864-2 devstack@n-api.service[120613]: X-Role: admin,member,reader Oct 10 23:16:53.363955 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: admin,member,reader Oct 10 23:16:53.365127 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_19ee7304d15f4f8c82f8baa49bb5e86a", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:53.365127 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.365127 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 19ee7304d15f4f8c82f8baa49bb5e86a Oct 10 23:16:53.365127 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.365127 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-HostsAdminNegativeTestJSON-575246147-project-admin Oct 10 23:16:53.365127 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:16:53.365127 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:16:53.365127 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 24dc315257b64dcd9379b2e1e653f879 Oct 10 23:16:53.365127 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-HostsAdminNegativeTestJSON-575246147-project-admin Oct 10 23:16:53.365127 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:16:53.365127 n-d-860864-2 devstack@n-api.service[120613]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.365127 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'nonexistent_hostname'} Oct 10 23:16:53.365127 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:53.367952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.367952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 10 23:16:53.367952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 10 23:16:53.367952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:16:53.367952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:16:53.367952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 10 23:16:53.367952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 10 23:16:53.367952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:16:53.367952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:16:53.367952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 10 23:16:53.367952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 10 23:16:53.367952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.367952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.367952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:53.367952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.367952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.367952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.367952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.367952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:53.368949 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:53.368949 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:16:53.368949 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:16:53.368949 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:53.368949 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:53.368949 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 10 23:16:53.368949 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:16:53.368949 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.368949 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.368949 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:53.368949 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.368949 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.368949 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.368949 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.368949 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:16:53.368949 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:16:53.368949 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.368949 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.376760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-425ec823-6499-448a-8529-52163a2e5714 tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:53.385098 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-425ec823-6499-448a-8529-52163a2e5714 tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.100636 Oct 10 23:16:53.389167 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 59/124] 10.222.0.23 () {58 vars in 1191 bytes} [Mon Oct 10 23:16:53 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:16:53.419550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f8c98f42-dde3-4193-b547-2e6edd4de1b9 tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Calling method '.version_select at 0x7f6630568af0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:53.441858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f8c98f42-dde3-4193-b547-2e6edd4de1b9 tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'd38db04beb854d5bb7a9cb8668b8415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2d0cb94344485aa0235b7fe8cd14bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:53.447439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f8c98f42-dde3-4193-b547-2e6edd4de1b9 tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Request method failure captured: Oct 10 23:16:53.447439 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-hosts/n-d-860864-2/shutdown HTTP/1.1 Oct 10 23:16:53.447439 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:16:53.447439 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:16:53.447439 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:16:53.447439 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:16:53.447439 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:16:53.447439 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:16:53.447439 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:16:53.447439 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:53.447439 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfetnhIj6wx290ByuOhKE5uXJwouTaPE5EGg5H_gGr1D-_FVjxnj97Lf0eZbCDEl0L3VcwQVJEexUMnPkeaqwNl-k__SQymUV4UA1NWrsVKEDyhe-934_GHuj6lCfJsB6GaBz5GN8i4hzYz5wJLspOB7Yh8m0dlYsiLc4rHcK4HorE Oct 10 23:16:53.447439 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:16:53.447439 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:16:53.447439 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:16:53.447439 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:16:53.447439 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:16:53.447439 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:16:53.447439 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 1d2d0cb94344485aa0235b7fe8cd14bf Oct 10 23:16:53.447439 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-798174562 Oct 10 23:16:53.447439 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:16:53.447439 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:16:53.449582 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d2d0cb94344485aa0235b7fe8cd14bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2d0cb94344485aa0235b7fe8cd14bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2d0cb94344485aa0235b7fe8cd14bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d2d0cb94344485aa0235b7fe8cd14bf", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:53.449582 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-HostsAdminNegativeTestJSON-798174562 Oct 10 23:16:53.449582 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 1d2d0cb94344485aa0235b7fe8cd14bf Oct 10 23:16:53.449582 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-798174562 Oct 10 23:16:53.449582 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-HostsAdminNegativeTestJSON-798174562-project Oct 10 23:16:53.449582 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:16:53.449582 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:16:53.449582 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: d38db04beb854d5bb7a9cb8668b8415f Oct 10 23:16:53.449582 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-HostsAdminNegativeTestJSON-798174562-project Oct 10 23:16:53.449582 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:16:53.449582 n-d-860864-2 devstack@n-api.service[120613]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 10 23:16:53.449582 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'n-d-860864-2'} Oct 10 23:16:53.449582 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:53.450644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.450644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.450644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.450644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:53.450644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:53.450644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:16:53.450644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:16:53.450644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:53.450644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:53.450644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 10 23:16:53.450644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 10 23:16:53.450644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:16:53.450644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:16:53.450644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:16:53.450644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:16:53.450644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:16:53.450644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:16:53.450644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:16:53.450644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:16:53.452501 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:16:53.452501 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:16:53.452501 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:16:53.452501 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:16:53.452501 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:16:53.452501 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:16:53.452501 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 10 23:16:53.452501 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.452501 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:53.452501 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.452501 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.452501 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.452501 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.452501 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:16:53.452501 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:16:53.452501 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 10 23:16:53.452501 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.461292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f8c98f42-dde3-4193-b547-2e6edd4de1b9 tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:53.463480 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f8c98f42-dde3-4193-b547-2e6edd4de1b9 tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-860864-2/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.070534 Oct 10 23:16:53.468885 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 60/125] 10.222.0.23 () {58 vars in 1194 bytes} [Mon Oct 10 23:16:53 2022] GET /compute/v2.1/os-hosts/n-d-860864-2/shutdown => generated 113 bytes in 76 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:16:53.490073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-efac0add-3a91-43d6-b91b-8636c3a48aac tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Calling method '.version_select at 0x7f6630576310>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:53.532705 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-efac0add-3a91-43d6-b91b-8636c3a48aac tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.541460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-efac0add-3a91-43d6-b91b-8636c3a48aac tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Request method failure captured: Oct 10 23:16:53.541460 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 10 23:16:53.541460 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:16:53.541460 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:16:53.541460 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:16:53.541460 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:16:53.541460 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:16:53.541460 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:16:53.541460 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:16:53.541460 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:53.541460 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfiTNZHN1aGtJXGdOrmMlHmd5us-unZFfHqn18ROel3RVl2vugD3elZ242ez-Tw-nUCx1ynb9xoMq1uiBWlSUy0jEUZy-hQJk140u7B82ShNHljjxjZ9w3XVFbyOVAxkOMzveHIo1s087o1o1KjDIORgHSOOsSuFa04wKbflritPas Oct 10 23:16:53.541460 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:16:53.541460 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:16:53.541460 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:16:53.541460 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:16:53.541460 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:16:53.541460 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:16:53.541460 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 19ee7304d15f4f8c82f8baa49bb5e86a Oct 10 23:16:53.541460 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.541460 n-d-860864-2 devstack@n-api.service[120613]: X-Role: admin,member,reader Oct 10 23:16:53.541460 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: admin,member,reader Oct 10 23:16:53.543064 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_19ee7304d15f4f8c82f8baa49bb5e86a", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:53.543064 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.543064 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 19ee7304d15f4f8c82f8baa49bb5e86a Oct 10 23:16:53.543064 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.543064 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-HostsAdminNegativeTestJSON-575246147-project-admin Oct 10 23:16:53.543064 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:16:53.543064 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:16:53.543064 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 24dc315257b64dcd9379b2e1e653f879 Oct 10 23:16:53.543064 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-HostsAdminNegativeTestJSON-575246147-project-admin Oct 10 23:16:53.543064 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:16:53.543064 n-d-860864-2 devstack@n-api.service[120613]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.543064 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'nonexistent_hostname'} Oct 10 23:16:53.543064 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:53.544045 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.544045 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 10 23:16:53.544045 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 10 23:16:53.544045 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 23:16:53.544045 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 23:16:53.544045 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:16:53.544045 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:16:53.544045 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:16:53.544045 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:16:53.544045 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 23:16:53.544045 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 23:16:53.544045 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 10 23:16:53.544045 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 10 23:16:53.544045 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:16:53.544045 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:16:53.544045 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 10 23:16:53.544045 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 10 23:16:53.544045 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:16:53.544045 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:16:53.546497 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 10 23:16:53.546497 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 10 23:16:53.546497 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.546497 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.546497 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:53.546497 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.546497 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.546497 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.546497 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.546497 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:53.546497 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:53.546497 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:16:53.546497 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:16:53.546497 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:53.546497 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:53.546497 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 10 23:16:53.546497 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 10 23:16:53.546497 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 10 23:16:53.546497 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:16:53.549286 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.549286 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.549286 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:53.549286 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.549286 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.549286 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.549286 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.549286 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:16:53.549286 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:16:53.549286 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.549286 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.552183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-efac0add-3a91-43d6-b91b-8636c3a48aac tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:53.554391 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-efac0add-3a91-43d6-b91b-8636c3a48aac tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.081841 Oct 10 23:16:53.555564 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 61/126] 10.222.0.23 () {58 vars in 1218 bytes} [Mon Oct 10 23:16:53 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:16:53.572151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-220a72c8-aec0-4fc9-95e0-0c66d1324b8e tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Calling method '.version_select at 0x7f6630576e50>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:53.580773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-220a72c8-aec0-4fc9-95e0-0c66d1324b8e tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'd38db04beb854d5bb7a9cb8668b8415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2d0cb94344485aa0235b7fe8cd14bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:53.586302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-220a72c8-aec0-4fc9-95e0-0c66d1324b8e tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Request method failure captured: Oct 10 23:16:53.586302 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-hosts/n-d-860864-2/startup HTTP/1.1 Oct 10 23:16:53.586302 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:16:53.586302 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:16:53.586302 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:16:53.586302 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:16:53.586302 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:16:53.586302 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:16:53.586302 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:16:53.586302 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:53.586302 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfetnhIj6wx290ByuOhKE5uXJwouTaPE5EGg5H_gGr1D-_FVjxnj97Lf0eZbCDEl0L3VcwQVJEexUMnPkeaqwNl-k__SQymUV4UA1NWrsVKEDyhe-934_GHuj6lCfJsB6GaBz5GN8i4hzYz5wJLspOB7Yh8m0dlYsiLc4rHcK4HorE Oct 10 23:16:53.586302 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:16:53.586302 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:16:53.586302 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:16:53.586302 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:16:53.586302 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:16:53.586302 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:16:53.586302 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 1d2d0cb94344485aa0235b7fe8cd14bf Oct 10 23:16:53.586302 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-798174562 Oct 10 23:16:53.586302 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:16:53.586302 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:16:53.587539 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d2d0cb94344485aa0235b7fe8cd14bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2d0cb94344485aa0235b7fe8cd14bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2d0cb94344485aa0235b7fe8cd14bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d2d0cb94344485aa0235b7fe8cd14bf", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:53.587539 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-HostsAdminNegativeTestJSON-798174562 Oct 10 23:16:53.587539 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 1d2d0cb94344485aa0235b7fe8cd14bf Oct 10 23:16:53.587539 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-798174562 Oct 10 23:16:53.587539 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-HostsAdminNegativeTestJSON-798174562-project Oct 10 23:16:53.587539 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:16:53.587539 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:16:53.587539 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: d38db04beb854d5bb7a9cb8668b8415f Oct 10 23:16:53.587539 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-HostsAdminNegativeTestJSON-798174562-project Oct 10 23:16:53.587539 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:16:53.587539 n-d-860864-2 devstack@n-api.service[120613]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 10 23:16:53.587539 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'n-d-860864-2'} Oct 10 23:16:53.587539 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:53.588579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.588579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.588579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.588579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:53.588579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:53.588579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:16:53.588579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:16:53.588579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:53.588579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:53.588579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 10 23:16:53.588579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 10 23:16:53.588579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:16:53.588579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:16:53.588579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:16:53.588579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:16:53.588579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:16:53.588579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:16:53.588579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:16:53.588579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:16:53.589896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:16:53.589896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:16:53.589896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:16:53.589896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:16:53.589896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:16:53.589896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:16:53.589896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 10 23:16:53.589896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.589896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:53.589896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.589896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.589896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.589896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.589896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:16:53.589896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:16:53.589896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 10 23:16:53.589896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.595102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-220a72c8-aec0-4fc9-95e0-0c66d1324b8e tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:53.597991 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-220a72c8-aec0-4fc9-95e0-0c66d1324b8e tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-860864-2/startup" status: 403 len: 110 microversion: 2.1 time: 0.034772 Oct 10 23:16:53.599908 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 62/127] 10.222.0.23 () {58 vars in 1191 bytes} [Mon Oct 10 23:16:53 2022] GET /compute/v2.1/os-hosts/n-d-860864-2/startup => generated 110 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:16:53.614346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b438d072-1b03-4e90-9eca-aad4003c6f60 tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Calling method '.version_select at 0x7f6630504dc0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:53.634688 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-b438d072-1b03-4e90-9eca-aad4003c6f60 tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.637466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b438d072-1b03-4e90-9eca-aad4003c6f60 tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Request method failure captured: Oct 10 23:16:53.637466 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 10 23:16:53.637466 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:16:53.637466 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:16:53.637466 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:16:53.637466 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:16:53.637466 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:16:53.637466 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:16:53.637466 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:16:53.637466 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:53.637466 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfiTNZHN1aGtJXGdOrmMlHmd5us-unZFfHqn18ROel3RVl2vugD3elZ242ez-Tw-nUCx1ynb9xoMq1uiBWlSUy0jEUZy-hQJk140u7B82ShNHljjxjZ9w3XVFbyOVAxkOMzveHIo1s087o1o1KjDIORgHSOOsSuFa04wKbflritPas Oct 10 23:16:53.637466 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:16:53.637466 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:16:53.637466 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:16:53.637466 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:16:53.637466 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:16:53.637466 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:16:53.637466 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 19ee7304d15f4f8c82f8baa49bb5e86a Oct 10 23:16:53.637466 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.637466 n-d-860864-2 devstack@n-api.service[120613]: X-Role: admin,member,reader Oct 10 23:16:53.637466 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: admin,member,reader Oct 10 23:16:53.639368 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_19ee7304d15f4f8c82f8baa49bb5e86a", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:53.639368 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.639368 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 19ee7304d15f4f8c82f8baa49bb5e86a Oct 10 23:16:53.639368 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.639368 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-HostsAdminNegativeTestJSON-575246147-project-admin Oct 10 23:16:53.639368 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:16:53.639368 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:16:53.639368 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 24dc315257b64dcd9379b2e1e653f879 Oct 10 23:16:53.639368 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-HostsAdminNegativeTestJSON-575246147-project-admin Oct 10 23:16:53.639368 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:16:53.639368 n-d-860864-2 devstack@n-api.service[120613]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.639368 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'nonexistent_hostname'} Oct 10 23:16:53.639368 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:53.640579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.640579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 10 23:16:53.640579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 10 23:16:53.640579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 23:16:53.640579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 23:16:53.640579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:16:53.640579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:16:53.640579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:16:53.640579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:16:53.640579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 23:16:53.640579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 23:16:53.640579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 10 23:16:53.640579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 10 23:16:53.640579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:16:53.640579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:16:53.640579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 10 23:16:53.640579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 10 23:16:53.640579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:16:53.640579 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:16:53.641627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 10 23:16:53.641627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 10 23:16:53.641627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.641627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.641627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:53.641627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.641627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.641627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.641627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.641627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:53.641627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:53.641627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:16:53.641627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:16:53.641627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:53.641627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:53.641627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 10 23:16:53.641627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 10 23:16:53.641627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 10 23:16:53.641627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:16:53.643334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.643334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.643334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:53.643334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.643334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.643334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.643334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.643334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:16:53.643334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:16:53.643334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.643334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.648266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b438d072-1b03-4e90-9eca-aad4003c6f60 tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:53.653223 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b438d072-1b03-4e90-9eca-aad4003c6f60 tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.048620 Oct 10 23:16:53.659684 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 63/128] 10.222.0.23 () {58 vars in 1215 bytes} [Mon Oct 10 23:16:53 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:16:53.669788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b5f6855c-de1b-4eb8-ad30-94f57b92b72b tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Action: 'update', calling method: .version_select at 0x7f6630576e50>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:53.693771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b5f6855c-de1b-4eb8-ad30-94f57b92b72b tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Request method failure captured: Oct 10 23:16:53.693771 n-d-860864-2 devstack@n-api.service[120613]: request: PUT /compute/v2.1/os-hosts/n-d-860864-2 HTTP/1.1 Oct 10 23:16:53.693771 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:16:53.693771 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:16:53.693771 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:16:53.693771 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 51 Oct 10 23:16:53.693771 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:16:53.693771 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:16:53.693771 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:16:53.693771 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:53.693771 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfiTNZHN1aGtJXGdOrmMlHmd5us-unZFfHqn18ROel3RVl2vugD3elZ242ez-Tw-nUCx1ynb9xoMq1uiBWlSUy0jEUZy-hQJk140u7B82ShNHljjxjZ9w3XVFbyOVAxkOMzveHIo1s087o1o1KjDIORgHSOOsSuFa04wKbflritPas Oct 10 23:16:53.693771 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:16:53.693771 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:16:53.693771 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:16:53.693771 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:16:53.693771 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:16:53.693771 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:16:53.693771 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 19ee7304d15f4f8c82f8baa49bb5e86a Oct 10 23:16:53.693771 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.693771 n-d-860864-2 devstack@n-api.service[120613]: X-Role: admin,member,reader Oct 10 23:16:53.693771 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: admin,member,reader Oct 10 23:16:53.694908 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_19ee7304d15f4f8c82f8baa49bb5e86a", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:53.694908 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.694908 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 19ee7304d15f4f8c82f8baa49bb5e86a Oct 10 23:16:53.694908 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.694908 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-HostsAdminNegativeTestJSON-575246147-project-admin Oct 10 23:16:53.694908 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:16:53.694908 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:16:53.694908 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 24dc315257b64dcd9379b2e1e653f879 Oct 10 23:16:53.694908 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-HostsAdminNegativeTestJSON-575246147-project-admin Oct 10 23:16:53.694908 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:16:53.694908 n-d-860864-2 devstack@n-api.service[120613]: {"status": "enable", "maintenance_mode": "invalid"} Oct 10 23:16:53.694908 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:16:53.694908 n-d-860864-2 devstack@n-api.service[120613]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'n-d-860864-2', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'disable', Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'Enable', Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'Disable', Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi On instance: Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'invalid' Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.695585 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.696875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.696875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:53.696875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:53.696875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:16:53.696875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:16:53.696875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:53.696875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:53.696875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:16:53.696875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:16:53.696875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:16:53.696875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:16:53.696875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:16:53.696875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:16:53.696875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 23:16:53.696875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.696875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:53.696875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.696875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.696875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.697896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.697896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:16:53.697896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:16:53.697896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 23:16:53.697896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.697896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b5f6855c-de1b-4eb8-ad30-94f57b92b72b tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:53.697896 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b5f6855c-de1b-4eb8-ad30-94f57b92b72b tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-860864-2" status: 400 len: 199 microversion: 2.1 time: 0.034434 Oct 10 23:16:53.704672 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 64/129] 10.222.0.23 () {60 vars in 1187 bytes} [Mon Oct 10 23:16:53 2022] PUT /compute/v2.1/os-hosts/n-d-860864-2 => generated 199 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:16:53.738517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e9bd6181-b1b7-43ca-8736-96d2934a9d39 tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Action: 'update', calling method: .version_select at 0x7f66304cb5e0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:53.778650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e9bd6181-b1b7-43ca-8736-96d2934a9d39 tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Request method failure captured: Oct 10 23:16:53.778650 n-d-860864-2 devstack@n-api.service[120613]: request: PUT /compute/v2.1/os-hosts/n-d-860864-2 HTTP/1.1 Oct 10 23:16:53.778650 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:16:53.778650 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:16:53.778650 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:16:53.778650 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 51 Oct 10 23:16:53.778650 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:16:53.778650 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:16:53.778650 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:16:53.778650 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:53.778650 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfiTNZHN1aGtJXGdOrmMlHmd5us-unZFfHqn18ROel3RVl2vugD3elZ242ez-Tw-nUCx1ynb9xoMq1uiBWlSUy0jEUZy-hQJk140u7B82ShNHljjxjZ9w3XVFbyOVAxkOMzveHIo1s087o1o1KjDIORgHSOOsSuFa04wKbflritPas Oct 10 23:16:53.778650 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:16:53.778650 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:16:53.778650 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:16:53.778650 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:16:53.778650 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:16:53.778650 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:16:53.778650 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 19ee7304d15f4f8c82f8baa49bb5e86a Oct 10 23:16:53.778650 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.778650 n-d-860864-2 devstack@n-api.service[120613]: X-Role: admin,member,reader Oct 10 23:16:53.778650 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: admin,member,reader Oct 10 23:16:53.779908 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_19ee7304d15f4f8c82f8baa49bb5e86a", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:53.779908 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.779908 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 19ee7304d15f4f8c82f8baa49bb5e86a Oct 10 23:16:53.779908 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.779908 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-HostsAdminNegativeTestJSON-575246147-project-admin Oct 10 23:16:53.779908 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:16:53.779908 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:16:53.779908 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 24dc315257b64dcd9379b2e1e653f879 Oct 10 23:16:53.779908 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-HostsAdminNegativeTestJSON-575246147-project-admin Oct 10 23:16:53.779908 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:16:53.779908 n-d-860864-2 devstack@n-api.service[120613]: {"status": "invalid", "maintenance_mode": "enable"} Oct 10 23:16:53.779908 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:16:53.779908 n-d-860864-2 devstack@n-api.service[120613]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'n-d-860864-2', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'disable', Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'Enable', Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'Disable', Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi On instance: Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'invalid' Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.780615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.781946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.781946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:53.781946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:53.781946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:16:53.781946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:16:53.781946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:53.781946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:53.781946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:16:53.781946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:16:53.781946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:16:53.781946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:16:53.781946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:16:53.781946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:16:53.781946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 23:16:53.781946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.781946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:53.781946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.781946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.781946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.782978 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.782978 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:16:53.782978 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:16:53.782978 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 23:16:53.782978 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.782978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e9bd6181-b1b7-43ca-8736-96d2934a9d39 tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:53.790001 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e9bd6181-b1b7-43ca-8736-96d2934a9d39 tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-860864-2" status: 400 len: 189 microversion: 2.1 time: 0.083940 Oct 10 23:16:53.799746 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 65/130] 10.222.0.23 () {60 vars in 1187 bytes} [Mon Oct 10 23:16:53 2022] PUT /compute/v2.1/os-hosts/n-d-860864-2 => generated 189 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:16:53.815871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a3337758-4d3c-4fb6-9fd5-e3b9cd395f5b tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Action: 'update', calling method: .version_select at 0x7f6630576a60>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:53.825067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a3337758-4d3c-4fb6-9fd5-e3b9cd395f5b tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'd38db04beb854d5bb7a9cb8668b8415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2d0cb94344485aa0235b7fe8cd14bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:53.827626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a3337758-4d3c-4fb6-9fd5-e3b9cd395f5b tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Request method failure captured: Oct 10 23:16:53.827626 n-d-860864-2 devstack@n-api.service[120613]: request: PUT /compute/v2.1/os-hosts/n-d-860864-2 HTTP/1.1 Oct 10 23:16:53.827626 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:16:53.827626 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:16:53.827626 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:16:53.827626 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 50 Oct 10 23:16:53.827626 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:16:53.827626 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:16:53.827626 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:16:53.827626 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:53.827626 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfetnhIj6wx290ByuOhKE5uXJwouTaPE5EGg5H_gGr1D-_FVjxnj97Lf0eZbCDEl0L3VcwQVJEexUMnPkeaqwNl-k__SQymUV4UA1NWrsVKEDyhe-934_GHuj6lCfJsB6GaBz5GN8i4hzYz5wJLspOB7Yh8m0dlYsiLc4rHcK4HorE Oct 10 23:16:53.827626 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:16:53.827626 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:16:53.827626 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:16:53.827626 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:16:53.827626 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:16:53.827626 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:16:53.827626 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 1d2d0cb94344485aa0235b7fe8cd14bf Oct 10 23:16:53.827626 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-798174562 Oct 10 23:16:53.827626 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:16:53.827626 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:16:53.828761 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d2d0cb94344485aa0235b7fe8cd14bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2d0cb94344485aa0235b7fe8cd14bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d2d0cb94344485aa0235b7fe8cd14bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d2d0cb94344485aa0235b7fe8cd14bf", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:53.828761 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-HostsAdminNegativeTestJSON-798174562 Oct 10 23:16:53.828761 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 1d2d0cb94344485aa0235b7fe8cd14bf Oct 10 23:16:53.828761 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-798174562 Oct 10 23:16:53.828761 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-HostsAdminNegativeTestJSON-798174562-project Oct 10 23:16:53.828761 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:16:53.828761 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:16:53.828761 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: d38db04beb854d5bb7a9cb8668b8415f Oct 10 23:16:53.828761 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-HostsAdminNegativeTestJSON-798174562-project Oct 10 23:16:53.828761 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:16:53.828761 n-d-860864-2 devstack@n-api.service[120613]: {"status": "enable", "maintenance_mode": "enable"} Oct 10 23:16:53.828761 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:16:53.828761 n-d-860864-2 devstack@n-api.service[120613]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 10 23:16:53.828761 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'n-d-860864-2', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 10 23:16:53.829551 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:53.829551 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.829551 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.829551 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.829551 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:53.829551 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:53.829551 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:16:53.829551 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:16:53.829551 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:53.829551 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:53.829551 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:16:53.829551 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:16:53.829551 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 10 23:16:53.829551 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 10 23:16:53.829551 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:16:53.829551 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:16:53.829551 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:16:53.829551 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:16:53.829551 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:16:53.829551 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:16:53.830559 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:16:53.830559 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:16:53.830559 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:16:53.830559 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:16:53.830559 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:16:53.830559 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:16:53.830559 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:16:53.830559 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:16:53.830559 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 10 23:16:53.830559 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.830559 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:53.830559 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.830559 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.830559 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.830559 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.830559 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:16:53.830559 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:16:53.830559 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 10 23:16:53.830559 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.836721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a3337758-4d3c-4fb6-9fd5-e3b9cd395f5b tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:53.840540 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a3337758-4d3c-4fb6-9fd5-e3b9cd395f5b tempest-HostsAdminNegativeTestJSON-798174562 tempest-HostsAdminNegativeTestJSON-798174562-project] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-860864-2" status: 403 len: 111 microversion: 2.1 time: 0.036897 Oct 10 23:16:53.844170 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 66/131] 10.222.0.23 () {60 vars in 1187 bytes} [Mon Oct 10 23:16:53 2022] PUT /compute/v2.1/os-hosts/n-d-860864-2 => generated 111 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:16:53.855326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-97ef35d5-04f8-4c05-acc4-01e7eb15a6ea tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Action: 'update', calling method: .version_select at 0x7f663045e5e0>, body: {"status": null, "maintenance_mode": null} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:53.861122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-97ef35d5-04f8-4c05-acc4-01e7eb15a6ea tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Request method failure captured: Oct 10 23:16:53.861122 n-d-860864-2 devstack@n-api.service[120613]: request: PUT /compute/v2.1/os-hosts/n-d-860864-2 HTTP/1.1 Oct 10 23:16:53.861122 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:16:53.861122 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:16:53.861122 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:16:53.861122 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 42 Oct 10 23:16:53.861122 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:16:53.861122 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:16:53.861122 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:16:53.861122 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:53.861122 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfiTNZHN1aGtJXGdOrmMlHmd5us-unZFfHqn18ROel3RVl2vugD3elZ242ez-Tw-nUCx1ynb9xoMq1uiBWlSUy0jEUZy-hQJk140u7B82ShNHljjxjZ9w3XVFbyOVAxkOMzveHIo1s087o1o1KjDIORgHSOOsSuFa04wKbflritPas Oct 10 23:16:53.861122 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:16:53.861122 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:16:53.861122 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:16:53.861122 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:16:53.861122 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:16:53.861122 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:16:53.861122 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 19ee7304d15f4f8c82f8baa49bb5e86a Oct 10 23:16:53.861122 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.861122 n-d-860864-2 devstack@n-api.service[120613]: X-Role: admin,member,reader Oct 10 23:16:53.861122 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: admin,member,reader Oct 10 23:16:53.862481 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_19ee7304d15f4f8c82f8baa49bb5e86a", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:53.862481 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.862481 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 19ee7304d15f4f8c82f8baa49bb5e86a Oct 10 23:16:53.862481 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.862481 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-HostsAdminNegativeTestJSON-575246147-project-admin Oct 10 23:16:53.862481 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:16:53.862481 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:16:53.862481 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 24dc315257b64dcd9379b2e1e653f879 Oct 10 23:16:53.862481 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-HostsAdminNegativeTestJSON-575246147-project-admin Oct 10 23:16:53.862481 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:16:53.862481 n-d-860864-2 devstack@n-api.service[120613]: {"status": null, "maintenance_mode": null} Oct 10 23:16:53.862481 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:16:53.862481 n-d-860864-2 devstack@n-api.service[120613]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 10 23:16:53.862481 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'n-d-860864-2', 'body': {'status': None, 'maintenance_mode': None}} Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'disable', Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'Enable', Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'Disable', Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi On instance: Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi None Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.863206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.864462 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:53.864462 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:53.864462 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:16:53.864462 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:16:53.864462 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:53.864462 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:53.864462 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:16:53.864462 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:16:53.864462 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:16:53.864462 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:16:53.864462 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:16:53.864462 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:16:53.864462 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 10 23:16:53.864462 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.864462 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:53.864462 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.864462 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.864462 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.864462 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.865456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:16:53.865456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:16:53.865456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 10 23:16:53.865456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.873427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-97ef35d5-04f8-4c05-acc4-01e7eb15a6ea tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:53.874902 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-97ef35d5-04f8-4c05-acc4-01e7eb15a6ea tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-860864-2" status: 400 len: 127 microversion: 2.1 time: 0.025239 Oct 10 23:16:53.885391 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 67/132] 10.222.0.23 () {60 vars in 1187 bytes} [Mon Oct 10 23:16:53 2022] PUT /compute/v2.1/os-hosts/n-d-860864-2 => generated 127 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:16:53.910733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dd913e23-e343-474b-923f-552b788e1c0c tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Action: 'update', calling method: .version_select at 0x7f663045e310>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:53.918804 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.hosts [None req-dd913e23-e343-474b-923f-552b788e1c0c tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Enabling host nonexistent_hostname. Oct 10 23:16:53.945315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d65f53e4-b1aa-4f54-a2e5-8fc1d480086d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:53.959781 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-dd913e23-e343-474b-923f-552b788e1c0c tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.961805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dd913e23-e343-474b-923f-552b788e1c0c tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Request method failure captured: Oct 10 23:16:53.961805 n-d-860864-2 devstack@n-api.service[120613]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 10 23:16:53.961805 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:16:53.961805 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:16:53.961805 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:16:53.961805 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 50 Oct 10 23:16:53.961805 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:16:53.961805 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:16:53.961805 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:16:53.961805 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:53.961805 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfiTNZHN1aGtJXGdOrmMlHmd5us-unZFfHqn18ROel3RVl2vugD3elZ242ez-Tw-nUCx1ynb9xoMq1uiBWlSUy0jEUZy-hQJk140u7B82ShNHljjxjZ9w3XVFbyOVAxkOMzveHIo1s087o1o1KjDIORgHSOOsSuFa04wKbflritPas Oct 10 23:16:53.961805 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:16:53.961805 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:16:53.961805 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:16:53.961805 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:16:53.961805 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:16:53.961805 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:16:53.961805 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 19ee7304d15f4f8c82f8baa49bb5e86a Oct 10 23:16:53.961805 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.961805 n-d-860864-2 devstack@n-api.service[120613]: X-Role: admin,member,reader Oct 10 23:16:53.961805 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: admin,member,reader Oct 10 23:16:53.963182 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19ee7304d15f4f8c82f8baa49bb5e86a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_19ee7304d15f4f8c82f8baa49bb5e86a", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:53.963182 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.963182 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 19ee7304d15f4f8c82f8baa49bb5e86a Oct 10 23:16:53.963182 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-575246147 Oct 10 23:16:53.963182 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-HostsAdminNegativeTestJSON-575246147-project-admin Oct 10 23:16:53.963182 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:16:53.963182 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:16:53.963182 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 24dc315257b64dcd9379b2e1e653f879 Oct 10 23:16:53.963182 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-HostsAdminNegativeTestJSON-575246147-project-admin Oct 10 23:16:53.963182 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:16:53.963182 n-d-860864-2 devstack@n-api.service[120613]: {"status": "enable", "maintenance_mode": "enable"} Oct 10 23:16:53.963182 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:16:53.963182 n-d-860864-2 devstack@n-api.service[120613]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.963182 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 10 23:16:53.964804 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:53.964804 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.964804 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 10 23:16:53.964804 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 10 23:16:53.964804 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 23:16:53.964804 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 23:16:53.964804 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:16:53.964804 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:16:53.964804 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:16:53.964804 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:16:53.964804 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 23:16:53.964804 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 23:16:53.964804 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 10 23:16:53.964804 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 10 23:16:53.964804 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:16:53.964804 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:16:53.964804 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 10 23:16:53.964804 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 10 23:16:53.968671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:16:53.968671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:16:53.968671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 10 23:16:53.968671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 10 23:16:53.968671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.968671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.968671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:53.968671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.968671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.968671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.968671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.968671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:53.968671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:53.968671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:16:53.968671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:16:53.968671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:53.968671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:53.968671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:16:53.968671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:16:53.968671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 10 23:16:53.971413 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 10 23:16:53.971413 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 10 23:16:53.971413 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:16:53.971413 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.971413 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.971413 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:53.971413 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.971413 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:53.971413 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:53.971413 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:53.971413 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:16:53.971413 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:16:53.971413 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 23:16:53.971413 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:53.978652 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d65f53e4-b1aa-4f54-a2e5-8fc1d480086d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 200 len: 1320 microversion: 2.1 time: 0.917421 Oct 10 23:16:53.979863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dd913e23-e343-474b-923f-552b788e1c0c tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:53.989837 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dd913e23-e343-474b-923f-552b788e1c0c tempest-HostsAdminNegativeTestJSON-575246147 tempest-HostsAdminNegativeTestJSON-575246147-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.096499 Oct 10 23:16:53.991529 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 66/133] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:53 2022] GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 1320 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:53.992013 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 68/134] 10.222.0.23 () {60 vars in 1211 bytes} [Mon Oct 10 23:16:53 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:16:54.118425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-aab83000-6f03-4a32-a1cf-a2b84d22bb32 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:54.119368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-aab83000-6f03-4a32-a1cf-a2b84d22bb32 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:54.136817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aab83000-6f03-4a32-a1cf-a2b84d22bb32 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:54.143063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aab83000-6f03-4a32-a1cf-a2b84d22bb32 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:54.143977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aab83000-6f03-4a32-a1cf-a2b84d22bb32 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:54.147130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aab83000-6f03-4a32-a1cf-a2b84d22bb32 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:54.147845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aab83000-6f03-4a32-a1cf-a2b84d22bb32 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:54.148347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aab83000-6f03-4a32-a1cf-a2b84d22bb32 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:54.841044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-aab83000-6f03-4a32-a1cf-a2b84d22bb32 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:54.851012 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-aab83000-6f03-4a32-a1cf-a2b84d22bb32 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1337 microversion: 2.1 time: 0.737492 Oct 10 23:16:54.856923 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 69/135] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:54 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1337 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:55.021203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7fba6baf-15e7-400f-ae8f-dcd070d73996 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:55.022602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7fba6baf-15e7-400f-ae8f-dcd070d73996 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:55.037514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fba6baf-15e7-400f-ae8f-dcd070d73996 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:55.038020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fba6baf-15e7-400f-ae8f-dcd070d73996 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:55.038459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fba6baf-15e7-400f-ae8f-dcd070d73996 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:55.039156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fba6baf-15e7-400f-ae8f-dcd070d73996 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:55.039706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fba6baf-15e7-400f-ae8f-dcd070d73996 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:55.040007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fba6baf-15e7-400f-ae8f-dcd070d73996 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:55.891316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-471595b7-16bd-4d5e-9900-e194b43f67fc tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:55.892178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-471595b7-16bd-4d5e-9900-e194b43f67fc tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:55.929669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-471595b7-16bd-4d5e-9900-e194b43f67fc tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:55.930233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-471595b7-16bd-4d5e-9900-e194b43f67fc tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:55.934058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-471595b7-16bd-4d5e-9900-e194b43f67fc tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:55.939361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-471595b7-16bd-4d5e-9900-e194b43f67fc tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:55.941199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-471595b7-16bd-4d5e-9900-e194b43f67fc tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:55.945266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-471595b7-16bd-4d5e-9900-e194b43f67fc tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:56.135017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7fba6baf-15e7-400f-ae8f-dcd070d73996 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:56.148722 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7fba6baf-15e7-400f-ae8f-dcd070d73996 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 200 len: 1320 microversion: 2.1 time: 1.131668 Oct 10 23:16:56.172091 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 67/136] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:55 2022] GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 1320 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:56.308183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-471595b7-16bd-4d5e-9900-e194b43f67fc tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:56.321958 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-471595b7-16bd-4d5e-9900-e194b43f67fc tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1337 microversion: 2.1 time: 0.439880 Oct 10 23:16:56.322552 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 70/137] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:55 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1337 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:56.853636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-19ec592c-9bfc-40cf-a0e9-d1c9d19ffb2f tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-271229129", "ram": 512, "vcpus": 1, "disk": 10, "id": 972734081, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:56.883183 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-19ec592c-9bfc-40cf-a0e9-d1c9d19ffb2f tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.641952 Oct 10 23:16:56.892123 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 68/138] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:16:56 2022] POST /compute/v2.1/flavors => generated 412 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:56.928369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4c74c82d-e45f-48db-add1-7adfbb8e8779 tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] Calling method '.version_select at 0x7f663045ee50>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:56.930872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4c74c82d-e45f-48db-add1-7adfbb8e8779 tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'd4304df2baf149518a62eac60e352452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21161c192ed4e728d6676cf118becb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:56.934828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4c74c82d-e45f-48db-add1-7adfbb8e8779 tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] Request method failure captured: Oct 10 23:16:56.934828 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 10 23:16:56.934828 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:16:56.934828 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:16:56.934828 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:16:56.934828 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:16:56.934828 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:16:56.934828 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:16:56.934828 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:16:56.934828 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:56.934828 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKflEDMrlDs_ZgGJ88qjMb0Cy1j6iZhsIQdthFM-2k-LjVz_SZfbXKny-vGZB23oMvrMxjpuq0ecEYrUozLlh4D2h6R5H7TNbCrCFKBynUgXnDngr8e7D8VlcIIyXTF0Fux2ZwifBI9D3mstDJiC-BOnLokkt9QmrXvU2v-2XjoSVgk Oct 10 23:16:56.934828 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:16:56.934828 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:16:56.934828 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:16:56.934828 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:16:56.934828 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:16:56.934828 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:16:56.934828 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e21161c192ed4e728d6676cf118becb1 Oct 10 23:16:56.934828 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1204539675 Oct 10 23:16:56.934828 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:16:56.934828 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:16:56.936572 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e21161c192ed4e728d6676cf118becb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e21161c192ed4e728d6676cf118becb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e21161c192ed4e728d6676cf118becb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e21161c192ed4e728d6676cf118becb1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:56.936572 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1204539675 Oct 10 23:16:56.936572 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e21161c192ed4e728d6676cf118becb1 Oct 10 23:16:56.936572 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1204539675 Oct 10 23:16:56.936572 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-HypervisorAdminNegativeTestJSON-1204539675-project Oct 10 23:16:56.936572 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:16:56.936572 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:16:56.936572 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: d4304df2baf149518a62eac60e352452 Oct 10 23:16:56.936572 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1204539675-project Oct 10 23:16:56.936572 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:16:56.936572 n-d-860864-2 devstack@n-api.service[120613]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 10 23:16:56.936572 n-d-860864-2 devstack@n-api.service[120613]: action_args: {} Oct 10 23:16:56.936572 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:56.937316 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:56.937316 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:56.937316 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:56.937316 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:56.937316 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:56.937316 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:16:56.937316 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:16:56.937316 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:56.937316 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:56.937316 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 10 23:16:56.937316 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 10 23:16:56.937316 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 10 23:16:56.937316 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 10 23:16:56.937316 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:16:56.937316 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:16:56.937316 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:16:56.937316 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:16:56.937316 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:16:56.937316 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:16:56.938580 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:16:56.938580 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:16:56.938580 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:16:56.938580 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:16:56.938580 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:16:56.938580 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:16:56.938580 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:16:56.938580 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:16:56.938580 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 10 23:16:56.938580 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:56.938580 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:56.938580 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:56.938580 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:56.938580 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:56.938580 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:56.938580 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:16:56.938580 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:16:56.938580 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 10 23:16:56.938580 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:56.939882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4c74c82d-e45f-48db-add1-7adfbb8e8779 tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:56.940953 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4c74c82d-e45f-48db-add1-7adfbb8e8779 tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.574543 Oct 10 23:16:56.946567 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 71/139] 10.222.0.23 () {58 vars in 1167 bytes} [Mon Oct 10 23:16:56 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 581 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:16:56.953203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ff1ac3ba-cf48-405a-8df9-49a2e749c387 tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] Calling method '.version_select at 0x7f6630576160>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:56.955992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ff1ac3ba-cf48-405a-8df9-49a2e749c387 tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'd4304df2baf149518a62eac60e352452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21161c192ed4e728d6676cf118becb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:56.959137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ff1ac3ba-cf48-405a-8df9-49a2e749c387 tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] Request method failure captured: Oct 10 23:16:56.959137 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 10 23:16:56.959137 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:16:56.959137 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:16:56.959137 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:16:56.959137 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:16:56.959137 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:16:56.959137 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:16:56.959137 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:16:56.959137 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:56.959137 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKflEDMrlDs_ZgGJ88qjMb0Cy1j6iZhsIQdthFM-2k-LjVz_SZfbXKny-vGZB23oMvrMxjpuq0ecEYrUozLlh4D2h6R5H7TNbCrCFKBynUgXnDngr8e7D8VlcIIyXTF0Fux2ZwifBI9D3mstDJiC-BOnLokkt9QmrXvU2v-2XjoSVgk Oct 10 23:16:56.959137 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:16:56.959137 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:16:56.959137 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:16:56.959137 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:16:56.959137 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:16:56.959137 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:16:56.959137 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e21161c192ed4e728d6676cf118becb1 Oct 10 23:16:56.959137 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1204539675 Oct 10 23:16:56.959137 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:16:56.959137 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:16:56.960254 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e21161c192ed4e728d6676cf118becb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e21161c192ed4e728d6676cf118becb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e21161c192ed4e728d6676cf118becb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e21161c192ed4e728d6676cf118becb1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:56.960254 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1204539675 Oct 10 23:16:56.960254 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e21161c192ed4e728d6676cf118becb1 Oct 10 23:16:56.960254 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1204539675 Oct 10 23:16:56.960254 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-HypervisorAdminNegativeTestJSON-1204539675-project Oct 10 23:16:56.960254 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:16:56.960254 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:16:56.960254 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: d4304df2baf149518a62eac60e352452 Oct 10 23:16:56.960254 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1204539675-project Oct 10 23:16:56.960254 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:16:56.960254 n-d-860864-2 devstack@n-api.service[120613]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 10 23:16:56.960254 n-d-860864-2 devstack@n-api.service[120613]: action_args: {} Oct 10 23:16:56.960254 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:56.960946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:56.960946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:56.960946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:56.960946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:56.960946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:56.960946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:16:56.960946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:16:56.960946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:56.960946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:56.960946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 10 23:16:56.960946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 10 23:16:56.960946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 10 23:16:56.960946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 10 23:16:56.960946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:16:56.960946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:16:56.960946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:16:56.960946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:16:56.960946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:16:56.960946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:16:56.961933 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:16:56.961933 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:16:56.961933 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:16:56.961933 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:16:56.961933 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:16:56.961933 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:16:56.961933 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:16:56.961933 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:16:56.961933 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 10 23:16:56.961933 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:56.961933 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:56.961933 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:56.961933 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:56.961933 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:56.961933 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:56.961933 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:16:56.961933 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:16:56.961933 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 10 23:16:56.961933 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:56.962903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ff1ac3ba-cf48-405a-8df9-49a2e749c387 tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:56.962903 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ff1ac3ba-cf48-405a-8df9-49a2e749c387 tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.012968 Oct 10 23:16:56.962903 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 72/140] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:16:56 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:16:56.971670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d6b21bae-0a3d-4f1d-a475-62276beb4ed6 tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] Calling method '.version_select at 0x7f66305049d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:56.973662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d6b21bae-0a3d-4f1d-a475-62276beb4ed6 tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'd4304df2baf149518a62eac60e352452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21161c192ed4e728d6676cf118becb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:56.975311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d6b21bae-0a3d-4f1d-a475-62276beb4ed6 tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] Request method failure captured: Oct 10 23:16:56.975311 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 10 23:16:56.975311 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:16:56.975311 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:16:56.975311 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:16:56.975311 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:16:56.975311 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:16:56.975311 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:16:56.975311 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:16:56.975311 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:56.975311 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKflEDMrlDs_ZgGJ88qjMb0Cy1j6iZhsIQdthFM-2k-LjVz_SZfbXKny-vGZB23oMvrMxjpuq0ecEYrUozLlh4D2h6R5H7TNbCrCFKBynUgXnDngr8e7D8VlcIIyXTF0Fux2ZwifBI9D3mstDJiC-BOnLokkt9QmrXvU2v-2XjoSVgk Oct 10 23:16:56.975311 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:16:56.975311 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:16:56.975311 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:16:56.975311 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:16:56.975311 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:16:56.975311 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:16:56.975311 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e21161c192ed4e728d6676cf118becb1 Oct 10 23:16:56.975311 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1204539675 Oct 10 23:16:56.975311 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:16:56.975311 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:16:56.976466 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e21161c192ed4e728d6676cf118becb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e21161c192ed4e728d6676cf118becb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e21161c192ed4e728d6676cf118becb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e21161c192ed4e728d6676cf118becb1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:56.976466 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1204539675 Oct 10 23:16:56.976466 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e21161c192ed4e728d6676cf118becb1 Oct 10 23:16:56.976466 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1204539675 Oct 10 23:16:56.976466 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-HypervisorAdminNegativeTestJSON-1204539675-project Oct 10 23:16:56.976466 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:16:56.976466 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:16:56.976466 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: d4304df2baf149518a62eac60e352452 Oct 10 23:16:56.976466 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1204539675-project Oct 10 23:16:56.976466 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:16:56.976466 n-d-860864-2 devstack@n-api.service[120613]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 10 23:16:56.976466 n-d-860864-2 devstack@n-api.service[120613]: action_args: {} Oct 10 23:16:56.976466 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:56.977222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:56.977222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:56.977222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:56.977222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:56.977222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:56.977222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:16:56.977222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:16:56.977222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:56.977222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:56.977222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 10 23:16:56.977222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 10 23:16:56.977222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:16:56.977222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:16:56.977222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:16:56.977222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:16:56.977222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:16:56.977222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:16:56.977222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:16:56.977222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:16:56.978227 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:16:56.978227 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:16:56.978227 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:16:56.978227 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:16:56.978227 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:16:56.978227 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:16:56.978227 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 10 23:16:56.978227 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:56.978227 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:56.978227 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:56.978227 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:56.978227 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:56.978227 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:56.978227 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:16:56.978227 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:16:56.978227 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 10 23:16:56.978227 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:56.979154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d6b21bae-0a3d-4f1d-a475-62276beb4ed6 tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:56.979154 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d6b21bae-0a3d-4f1d-a475-62276beb4ed6 tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.010688 Oct 10 23:16:56.979154 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 73/141] 10.222.0.23 () {58 vars in 1179 bytes} [Mon Oct 10 23:16:56 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:16:57.172966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=16 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:16:57.324610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-18158ef3-5e06-4c9f-bd93-3dd4659c53ba tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:57.335281 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-18158ef3-5e06-4c9f-bd93-3dd4659c53ba tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project] HTTP exception thrown: Flavor 972734081 has no extra specs with key hw:cpu_thread_policy. Oct 10 23:16:57.336984 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-18158ef3-5e06-4c9f-bd93-3dd4659c53ba tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project] Request method failure captured: Oct 10 23:16:57.336984 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/flavors/972734081/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 10 23:16:57.336984 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:16:57.336984 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:16:57.336984 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:16:57.336984 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:16:57.336984 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:16:57.336984 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:16:57.336984 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:16:57.336984 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:57.336984 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKfl-0Obdc-THIA_IOtDi2Y69oEGt1ENy3tzmyhGTqOp02VLRSGyRBCY5KXvb7ay1BDfKd6-oIEyRL7V-pfRnPrkO6CkVI3prxpz1Ibc7XpDexGQaZLuuMCmT6V7Q4jkR4GFyJJ6aAGX_Ksfq5TW1VZIJckCajFz35mOuCvfMESimF4 Oct 10 23:16:57.336984 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:16:57.336984 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:16:57.336984 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:16:57.336984 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:16:57.336984 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:16:57.336984 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:16:57.336984 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: afbf3ebebee4410b8a78f924b3622c2a Oct 10 23:16:57.336984 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 Oct 10 23:16:57.336984 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:16:57.336984 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:16:57.338157 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/afbf3ebebee4410b8a78f924b3622c2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afbf3ebebee4410b8a78f924b3622c2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afbf3ebebee4410b8a78f924b3622c2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_afbf3ebebee4410b8a78f924b3622c2a", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:57.338157 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 Oct 10 23:16:57.338157 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: afbf3ebebee4410b8a78f924b3622c2a Oct 10 23:16:57.338157 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 Oct 10 23:16:57.338157 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project Oct 10 23:16:57.338157 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:16:57.338157 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:16:57.338157 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 19a3c88230ba4d718a114eba7433a6eb Oct 10 23:16:57.338157 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project Oct 10 23:16:57.338157 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:16:57.338157 n-d-860864-2 devstack@n-api.service[120614]: exception: Flavor 972734081 has no extra specs with key hw:cpu_thread_policy. Oct 10 23:16:57.338832 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'flavor_id': '972734081', 'id': 'hw:cpu_thread_policy'} Oct 10 23:16:57.338832 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:57.338832 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.338832 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 10 23:16:57.338832 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 10 23:16:57.338832 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 10 23:16:57.338832 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.338832 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:57.338832 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.338832 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.338832 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:57.338832 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:57.338832 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:57.338832 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:57.338832 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:57.338832 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:57.338832 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 10 23:16:57.338832 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 23:16:57.338832 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 972734081 has no extra specs with key hw:cpu_thread_policy. Oct 10 23:16:57.338832 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.338832 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:57.338832 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.339932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.339932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:57.339932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:57.339932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:16:57.339932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:16:57.339932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 972734081 has no extra specs with key hw:cpu_thread_policy. Oct 10 23:16:57.339932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.340875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-18158ef3-5e06-4c9f-bd93-3dd4659c53ba tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project] Returning 404 to user: Flavor 972734081 has no extra specs with key hw:cpu_thread_policy. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:57.342268 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-18158ef3-5e06-4c9f-bd93-3dd4659c53ba tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project] 10.222.0.23 "GET /compute/v2.1/flavors/972734081/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.448187 Oct 10 23:16:57.349331 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 69/142] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 10 23:16:56 2022] GET /compute/v2.1/flavors/972734081/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 456 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:16:57.360358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5fb6d46e-82ed-450d-9b89-949a79b31a58 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:57.360979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5fb6d46e-82ed-450d-9b89-949a79b31a58 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:57.367072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5fb6d46e-82ed-450d-9b89-949a79b31a58 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:57.367559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5fb6d46e-82ed-450d-9b89-949a79b31a58 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:57.367998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5fb6d46e-82ed-450d-9b89-949a79b31a58 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:57.380444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5fb6d46e-82ed-450d-9b89-949a79b31a58 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:57.380444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5fb6d46e-82ed-450d-9b89-949a79b31a58 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:57.380444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5fb6d46e-82ed-450d-9b89-949a79b31a58 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:57.476310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e320e4e6-e39b-42f1-9cde-e076319a90bc tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Calling method '.version_select at 0x7f663045ef70>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:57.478454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e320e4e6-e39b-42f1-9cde-e076319a90bc tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:57.479125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e320e4e6-e39b-42f1-9cde-e076319a90bc tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:57.479560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e320e4e6-e39b-42f1-9cde-e076319a90bc tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:57.512039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e320e4e6-e39b-42f1-9cde-e076319a90bc tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:57.512645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e320e4e6-e39b-42f1-9cde-e076319a90bc tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:57.514110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e320e4e6-e39b-42f1-9cde-e076319a90bc tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:57.538338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e320e4e6-e39b-42f1-9cde-e076319a90bc tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:57.538781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e320e4e6-e39b-42f1-9cde-e076319a90bc tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:57.539701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e320e4e6-e39b-42f1-9cde-e076319a90bc tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:57.542680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5fb6d46e-82ed-450d-9b89-949a79b31a58 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:57.549122 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e320e4e6-e39b-42f1-9cde-e076319a90bc tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.566677 Oct 10 23:16:57.553791 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 74/143] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:16:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:57.554784 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5fb6d46e-82ed-450d-9b89-949a79b31a58 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 200 len: 1320 microversion: 2.1 time: 0.202618 Oct 10 23:16:57.555995 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 70/144] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:57 2022] GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 1320 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:57.563280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1187d5a4-4e9a-4154-8ea2-62b3d4a1fbd3 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:57.566841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1187d5a4-4e9a-4154-8ea2-62b3d4a1fbd3 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '19a3c88230ba4d718a114eba7433a6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afbf3ebebee4410b8a78f924b3622c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:57.568010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-90611f25-a325-4d30-a925-acfedda2a52c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:57.568984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-90611f25-a325-4d30-a925-acfedda2a52c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:57.569714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1187d5a4-4e9a-4154-8ea2-62b3d4a1fbd3 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project] Request method failure captured: Oct 10 23:16:57.569714 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/flavors/972734081/os-extra_specs HTTP/1.1 Oct 10 23:16:57.569714 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:16:57.569714 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:16:57.569714 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:16:57.569714 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 66 Oct 10 23:16:57.569714 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:16:57.569714 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:16:57.569714 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:16:57.569714 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:57.569714 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKfl-0Obdc-THIA_IOtDi2Y69oEGt1ENy3tzmyhGTqOp02VLRSGyRBCY5KXvb7ay1BDfKd6-oIEyRL7V-pfRnPrkO6CkVI3prxpz1Ibc7XpDexGQaZLuuMCmT6V7Q4jkR4GFyJJ6aAGX_Ksfq5TW1VZIJckCajFz35mOuCvfMESimF4 Oct 10 23:16:57.569714 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:16:57.569714 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:16:57.569714 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:16:57.569714 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:16:57.569714 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:16:57.569714 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:16:57.569714 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: afbf3ebebee4410b8a78f924b3622c2a Oct 10 23:16:57.569714 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 Oct 10 23:16:57.569714 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:16:57.569714 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:16:57.571706 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/afbf3ebebee4410b8a78f924b3622c2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afbf3ebebee4410b8a78f924b3622c2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afbf3ebebee4410b8a78f924b3622c2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_afbf3ebebee4410b8a78f924b3622c2a", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:57.571706 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 Oct 10 23:16:57.571706 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: afbf3ebebee4410b8a78f924b3622c2a Oct 10 23:16:57.571706 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 Oct 10 23:16:57.571706 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project Oct 10 23:16:57.571706 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:16:57.571706 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:16:57.571706 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 19a3c88230ba4d718a114eba7433a6eb Oct 10 23:16:57.571706 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project Oct 10 23:16:57.571706 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:16:57.571706 n-d-860864-2 devstack@n-api.service[120614]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 10 23:16:57.571706 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:16:57.572410 n-d-860864-2 devstack@n-api.service[120614]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 10 23:16:57.572410 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'flavor_id': '972734081', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 10 23:16:57.572410 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:57.572410 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.572410 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:57.572410 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:57.572410 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:57.572410 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:57.572410 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:57.572410 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:57.572410 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:16:57.572410 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:16:57.572410 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 10 23:16:57.572410 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 10 23:16:57.572410 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:16:57.572410 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:16:57.572410 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:16:57.572410 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:16:57.572410 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:16:57.573475 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:16:57.573475 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:16:57.573475 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:16:57.573475 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:16:57.573475 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:16:57.573475 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:16:57.573475 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:16:57.573475 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:16:57.573475 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:16:57.573475 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 10 23:16:57.573475 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.573475 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:57.573475 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.573475 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.573475 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:57.573475 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:57.573475 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:16:57.573475 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:16:57.573475 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 10 23:16:57.573475 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.574581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1187d5a4-4e9a-4154-8ea2-62b3d4a1fbd3 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:57.577302 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1187d5a4-4e9a-4154-8ea2-62b3d4a1fbd3 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project] 10.222.0.23 "POST /compute/v2.1/flavors/972734081/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.019908 Oct 10 23:16:57.578128 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 71/145] 10.222.0.23 () {60 vars in 1221 bytes} [Mon Oct 10 23:16:57 2022] POST /compute/v2.1/flavors/972734081/os-extra_specs => generated 124 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:16:57.583649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-97eb7cf8-4be7-4735-82cb-07cca9dcfa38 tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] Calling method '.version_select at 0x7f66306b4f70>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:57.585808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-97eb7cf8-4be7-4735-82cb-07cca9dcfa38 tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'd4304df2baf149518a62eac60e352452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21161c192ed4e728d6676cf118becb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:57.587938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-97eb7cf8-4be7-4735-82cb-07cca9dcfa38 tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] Request method failure captured: Oct 10 23:16:57.587938 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 10 23:16:57.587938 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:16:57.587938 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:16:57.587938 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:16:57.587938 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:16:57.587938 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:16:57.587938 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:16:57.587938 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:16:57.587938 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:57.587938 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKflEDMrlDs_ZgGJ88qjMb0Cy1j6iZhsIQdthFM-2k-LjVz_SZfbXKny-vGZB23oMvrMxjpuq0ecEYrUozLlh4D2h6R5H7TNbCrCFKBynUgXnDngr8e7D8VlcIIyXTF0Fux2ZwifBI9D3mstDJiC-BOnLokkt9QmrXvU2v-2XjoSVgk Oct 10 23:16:57.587938 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:16:57.587938 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:16:57.587938 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:16:57.587938 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:16:57.587938 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:16:57.587938 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:16:57.587938 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: e21161c192ed4e728d6676cf118becb1 Oct 10 23:16:57.587938 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1204539675 Oct 10 23:16:57.587938 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:16:57.587938 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:16:57.589169 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e21161c192ed4e728d6676cf118becb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e21161c192ed4e728d6676cf118becb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e21161c192ed4e728d6676cf118becb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e21161c192ed4e728d6676cf118becb1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:57.589169 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1204539675 Oct 10 23:16:57.589169 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: e21161c192ed4e728d6676cf118becb1 Oct 10 23:16:57.589169 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1204539675 Oct 10 23:16:57.589169 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-HypervisorAdminNegativeTestJSON-1204539675-project Oct 10 23:16:57.589169 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:16:57.589169 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:16:57.589169 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: d4304df2baf149518a62eac60e352452 Oct 10 23:16:57.589169 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1204539675-project Oct 10 23:16:57.589169 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:16:57.589169 n-d-860864-2 devstack@n-api.service[120614]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 10 23:16:57.589169 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '1'} Oct 10 23:16:57.589169 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:57.590038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.590038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:57.590038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:57.590038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:57.590038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:57.590038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:16:57.590038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:16:57.590038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:57.590038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:57.590038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 10 23:16:57.590038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 10 23:16:57.590038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:16:57.590038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:16:57.590038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:16:57.590038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:16:57.590038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:16:57.590038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:16:57.590038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:16:57.590038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:16:57.591015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:16:57.591015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:16:57.591015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:16:57.591015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:16:57.591015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:16:57.591015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:16:57.591015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 10 23:16:57.591015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.591015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:57.591015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.591015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.591015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:57.591015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:57.591015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:16:57.591015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:16:57.591015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 10 23:16:57.591015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.594072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-97eb7cf8-4be7-4735-82cb-07cca9dcfa38 tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:57.594956 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-97eb7cf8-4be7-4735-82cb-07cca9dcfa38 tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.015708 Oct 10 23:16:57.595492 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 72/146] 10.222.0.23 () {58 vars in 1173 bytes} [Mon Oct 10 23:16:57 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:16:57.599844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90611f25-a325-4d30-a925-acfedda2a52c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:57.599962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90611f25-a325-4d30-a925-acfedda2a52c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:57.600414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90611f25-a325-4d30-a925-acfedda2a52c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:57.602721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90611f25-a325-4d30-a925-acfedda2a52c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:57.603411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90611f25-a325-4d30-a925-acfedda2a52c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:57.603844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90611f25-a325-4d30-a925-acfedda2a52c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:57.606410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-59623189-5dba-4ff3-826e-3c5462834a3d tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:57.624349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=82,nova_api:DELETE=9,nova_api:SAVEPOINT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:16:57.656065 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-59623189-5dba-4ff3-826e-3c5462834a3d tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/972734081/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.054407 Oct 10 23:16:57.657333 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 73/147] 10.222.0.23 () {60 vars in 1221 bytes} [Mon Oct 10 23:16:57 2022] POST /compute/v2.1/flavors/972734081/os-extra_specs => generated 66 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:16:57.667115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-45969f2d-6775-4cf3-8ee7-b77bd4836f51 tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Calling method '.version_select at 0x7f663052a670>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:57.669426 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-45969f2d-6775-4cf3-8ee7-b77bd4836f51 tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] HTTP exception thrown: Hypervisor with ID '7480cd99-22a7-4787-88d5-6f1b7a504da9' could not be found. Oct 10 23:16:57.679151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-45969f2d-6775-4cf3-8ee7-b77bd4836f51 tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Request method failure captured: Oct 10 23:16:57.679151 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/os-hypervisors/7480cd99-22a7-4787-88d5-6f1b7a504da9/uptime HTTP/1.1 Oct 10 23:16:57.679151 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:16:57.679151 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:16:57.679151 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:16:57.679151 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:16:57.679151 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:16:57.679151 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:16:57.679151 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:16:57.679151 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:57.679151 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKfoOiz7TFmikCU1XPpPH9AjSReM3ZE2NlTdmzX4P9ADmcM7BtIlA41p1M9pE8uQr06exslB8pLAiaSuvpFeWAHWuh8Bz2oxwCOrvsjNNGzDFaWJCIwtlG4kk26GASMuiQGxLHCDgDkLaOgDZkMPiIJUW4rl1_ToSz0056S4YZt8xhw Oct 10 23:16:57.679151 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:16:57.679151 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:16:57.679151 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:16:57.679151 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:16:57.679151 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:16:57.679151 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:16:57.679151 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 9f8f55257df44dfca14112e353caa9dc Oct 10 23:16:57.679151 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-814347718 Oct 10 23:16:57.679151 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:16:57.679151 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:16:57.680357 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9f8f55257df44dfca14112e353caa9dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9f8f55257df44dfca14112e353caa9dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9f8f55257df44dfca14112e353caa9dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9f8f55257df44dfca14112e353caa9dc", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:57.680357 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-814347718 Oct 10 23:16:57.680357 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 9f8f55257df44dfca14112e353caa9dc Oct 10 23:16:57.680357 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-814347718 Oct 10 23:16:57.680357 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin Oct 10 23:16:57.680357 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:16:57.680357 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:16:57.680357 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 2d7f348990e548e58656d0951543676e Oct 10 23:16:57.680357 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin Oct 10 23:16:57.680357 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:16:57.680357 n-d-860864-2 devstack@n-api.service[120614]: exception: Hypervisor with ID '7480cd99-22a7-4787-88d5-6f1b7a504da9' could not be found. Oct 10 23:16:57.680357 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '7480cd99-22a7-4787-88d5-6f1b7a504da9'} Oct 10 23:16:57.680997 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:57.680997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.680997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 10 23:16:57.680997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 10 23:16:57.680997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '7480cd99-22a7-4787-88d5-6f1b7a504da9' Oct 10 23:16:57.680997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.680997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:57.680997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.680997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.680997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 10 23:16:57.680997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 10 23:16:57.680997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 10 23:16:57.680997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 10 23:16:57.680997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 10 23:16:57.680997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.680997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:57.680997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.680997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.680997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 10 23:16:57.680997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 10 23:16:57.680997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 10 23:16:57.680997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 10 23:16:57.682147 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 10 23:16:57.682147 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.682147 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:57.682147 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.682147 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.682147 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:57.682147 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:57.682147 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:57.682147 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:57.682147 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:16:57.682147 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:16:57.682147 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:57.682147 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:57.682147 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 10 23:16:57.682147 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 10 23:16:57.682147 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 10 23:16:57.682147 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 23:16:57.682147 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '7480cd99-22a7-4787-88d5-6f1b7a504da9' could not be found. Oct 10 23:16:57.682147 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.682147 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:57.682147 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.683183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.683183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:57.683183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:57.683183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:16:57.683183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:16:57.683183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '7480cd99-22a7-4787-88d5-6f1b7a504da9' could not be found. Oct 10 23:16:57.683183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.683183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-45969f2d-6775-4cf3-8ee7-b77bd4836f51 tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Returning 404 to user: Hypervisor with ID '7480cd99-22a7-4787-88d5-6f1b7a504da9' could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:57.683183 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-45969f2d-6775-4cf3-8ee7-b77bd4836f51 tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/7480cd99-22a7-4787-88d5-6f1b7a504da9/uptime" status: 404 len: 123 microversion: 2.1 time: 0.022240 Oct 10 23:16:57.686767 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 74/148] 10.222.0.23 () {58 vars in 1278 bytes} [Mon Oct 10 23:16:57 2022] GET /compute/v2.1/os-hypervisors/7480cd99-22a7-4787-88d5-6f1b7a504da9/uptime => generated 123 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:16:57.696346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1729cd05-469f-445e-bc6f-914d11288dd4 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:57.700663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1729cd05-469f-445e-bc6f-914d11288dd4 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '19a3c88230ba4d718a114eba7433a6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afbf3ebebee4410b8a78f924b3622c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:57.705729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1729cd05-469f-445e-bc6f-914d11288dd4 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project] Request method failure captured: Oct 10 23:16:57.705729 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/flavors/972734081/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 10 23:16:57.705729 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:16:57.705729 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:16:57.705729 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:16:57.705729 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:16:57.705729 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:16:57.705729 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:16:57.705729 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:16:57.705729 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:57.705729 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKfl-0Obdc-THIA_IOtDi2Y69oEGt1ENy3tzmyhGTqOp02VLRSGyRBCY5KXvb7ay1BDfKd6-oIEyRL7V-pfRnPrkO6CkVI3prxpz1Ibc7XpDexGQaZLuuMCmT6V7Q4jkR4GFyJJ6aAGX_Ksfq5TW1VZIJckCajFz35mOuCvfMESimF4 Oct 10 23:16:57.705729 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:16:57.705729 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:16:57.705729 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:16:57.705729 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:16:57.705729 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:16:57.705729 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:16:57.705729 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: afbf3ebebee4410b8a78f924b3622c2a Oct 10 23:16:57.705729 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 Oct 10 23:16:57.705729 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:16:57.705729 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:16:57.706862 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/afbf3ebebee4410b8a78f924b3622c2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afbf3ebebee4410b8a78f924b3622c2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afbf3ebebee4410b8a78f924b3622c2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_afbf3ebebee4410b8a78f924b3622c2a", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:57.706862 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 Oct 10 23:16:57.706862 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: afbf3ebebee4410b8a78f924b3622c2a Oct 10 23:16:57.706862 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 Oct 10 23:16:57.706862 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project Oct 10 23:16:57.706862 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:16:57.706862 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:16:57.706862 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 19a3c88230ba4d718a114eba7433a6eb Oct 10 23:16:57.706862 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project Oct 10 23:16:57.706862 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:16:57.706862 n-d-860864-2 devstack@n-api.service[120614]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 10 23:16:57.707538 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'flavor_id': '972734081', 'id': 'hw:numa_nodes'} Oct 10 23:16:57.707538 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:57.707538 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.707538 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:57.707538 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:57.707538 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:57.707538 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:57.707538 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:57.707538 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:57.707538 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 10 23:16:57.707538 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 10 23:16:57.707538 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:16:57.707538 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:16:57.707538 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:16:57.707538 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:16:57.707538 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:16:57.707538 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:16:57.707538 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:16:57.707538 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:16:57.707538 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:16:57.708601 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:16:57.708601 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:16:57.708601 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:16:57.708601 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:16:57.708601 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:16:57.708601 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 10 23:16:57.708601 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.708601 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:57.708601 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.708601 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.708601 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:57.708601 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:57.708601 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:16:57.708601 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:16:57.708601 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 10 23:16:57.708601 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.708601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1729cd05-469f-445e-bc6f-914d11288dd4 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:57.709997 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1729cd05-469f-445e-bc6f-914d11288dd4 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project] 10.222.0.23 "DELETE /compute/v2.1/flavors/972734081/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.022107 Oct 10 23:16:57.710623 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 75/149] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:16:57 2022] DELETE /compute/v2.1/flavors/972734081/os-extra_specs/hw:numa_nodes => generated 124 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:16:57.722988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-405559e2-1b56-49a4-8876-12b7f9e24a49 tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Calling method '.version_select at 0x7f6630643af0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:57.743934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-405559e2-1b56-49a4-8876-12b7f9e24a49 tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c35e3cac-0e4f-44cc-a53a-8910e1eecc88(cell1) {{(pid=120614) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 10 23:16:57.744780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-405559e2-1b56-49a4-8876-12b7f9e24a49 tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:57.745432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-405559e2-1b56-49a4-8876-12b7f9e24a49 tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:57.745861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-405559e2-1b56-49a4-8876-12b7f9e24a49 tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:57.785226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-405559e2-1b56-49a4-8876-12b7f9e24a49 tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:57.786010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-405559e2-1b56-49a4-8876-12b7f9e24a49 tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:57.786649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-405559e2-1b56-49a4-8876-12b7f9e24a49 tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:57.804797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-90611f25-a325-4d30-a925-acfedda2a52c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:57.815804 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-90611f25-a325-4d30-a925-acfedda2a52c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1337 microversion: 2.1 time: 0.257737 Oct 10 23:16:57.818733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-405559e2-1b56-49a4-8876-12b7f9e24a49 tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:57.819076 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 75/150] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:57 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1337 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:57.823787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-de19d5d9-7264-4ab8-a893-0d7b43047946 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:57.830923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-405559e2-1b56-49a4-8876-12b7f9e24a49 tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:57.831677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-405559e2-1b56-49a4-8876-12b7f9e24a49 tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:57.844008 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-405559e2-1b56-49a4-8876-12b7f9e24a49 tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.129597 Oct 10 23:16:57.844727 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 76/151] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:16:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:16:57.847526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=77,nova_api:UPDATE=16,nova_api:DELETE=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:16:57.856410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c2fd6c96-39ed-4449-b38a-31091345f84c tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] Calling method '.version_select at 0x7f66305c7790>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:57.858460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c2fd6c96-39ed-4449-b38a-31091345f84c tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'd4304df2baf149518a62eac60e352452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e21161c192ed4e728d6676cf118becb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:57.865027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c2fd6c96-39ed-4449-b38a-31091345f84c tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] Request method failure captured: Oct 10 23:16:57.865027 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 10 23:16:57.865027 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:16:57.865027 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:16:57.865027 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:16:57.865027 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:16:57.865027 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:16:57.865027 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:16:57.865027 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:16:57.865027 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:57.865027 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKflEDMrlDs_ZgGJ88qjMb0Cy1j6iZhsIQdthFM-2k-LjVz_SZfbXKny-vGZB23oMvrMxjpuq0ecEYrUozLlh4D2h6R5H7TNbCrCFKBynUgXnDngr8e7D8VlcIIyXTF0Fux2ZwifBI9D3mstDJiC-BOnLokkt9QmrXvU2v-2XjoSVgk Oct 10 23:16:57.865027 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:16:57.865027 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:16:57.865027 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:16:57.865027 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:16:57.865027 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:16:57.865027 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:16:57.865027 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: e21161c192ed4e728d6676cf118becb1 Oct 10 23:16:57.865027 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1204539675 Oct 10 23:16:57.865027 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:16:57.865027 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:16:57.866219 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e21161c192ed4e728d6676cf118becb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e21161c192ed4e728d6676cf118becb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e21161c192ed4e728d6676cf118becb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e21161c192ed4e728d6676cf118becb1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:57.866219 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1204539675 Oct 10 23:16:57.866219 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: e21161c192ed4e728d6676cf118becb1 Oct 10 23:16:57.866219 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1204539675 Oct 10 23:16:57.866219 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-HypervisorAdminNegativeTestJSON-1204539675-project Oct 10 23:16:57.866219 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:16:57.866219 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:16:57.866219 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: d4304df2baf149518a62eac60e352452 Oct 10 23:16:57.866219 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1204539675-project Oct 10 23:16:57.866219 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:16:57.866219 n-d-860864-2 devstack@n-api.service[120614]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 10 23:16:57.866219 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '1'} Oct 10 23:16:57.866219 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:57.866883 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.866883 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:57.866883 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:57.866883 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:57.866883 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:57.866883 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:16:57.866883 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:16:57.866883 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:57.866883 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:57.866883 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 10 23:16:57.866883 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 10 23:16:57.866883 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 10 23:16:57.866883 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 10 23:16:57.866883 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:16:57.866883 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:16:57.866883 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:16:57.866883 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:16:57.866883 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:16:57.866883 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:16:57.867829 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:16:57.867829 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:16:57.867829 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:16:57.867829 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:16:57.867829 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:16:57.867829 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:16:57.867829 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:16:57.867829 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:16:57.867829 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 10 23:16:57.867829 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.867829 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:57.867829 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.867829 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.867829 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:57.867829 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:57.867829 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:16:57.867829 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:16:57.867829 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 10 23:16:57.867829 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.870240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c2fd6c96-39ed-4449-b38a-31091345f84c tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:57.871338 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c2fd6c96-39ed-4449-b38a-31091345f84c tempest-HypervisorAdminNegativeTestJSON-1204539675 tempest-HypervisorAdminNegativeTestJSON-1204539675-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.019324 Oct 10 23:16:57.872460 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 77/152] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:16:57 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:16:57.885539 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-de19d5d9-7264-4ab8-a893-0d7b43047946 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/972734081/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.065246 Oct 10 23:16:57.892350 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 76/153] 10.222.0.23 () {60 vars in 1221 bytes} [Mon Oct 10 23:16:57 2022] POST /compute/v2.1/flavors/972734081/os-extra_specs => generated 66 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:16:57.899745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-395667ba-3481-4a1e-8bcb-e545898bff6b tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:57.901462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-592da256-4917-4574-b53a-5b8429387e07 tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Calling method '.version_select at 0x7f66305b9ee0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:57.904823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-395667ba-3481-4a1e-8bcb-e545898bff6b tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '19a3c88230ba4d718a114eba7433a6eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afbf3ebebee4410b8a78f924b3622c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:57.907366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-395667ba-3481-4a1e-8bcb-e545898bff6b tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project] Request method failure captured: Oct 10 23:16:57.907366 n-d-860864-2 devstack@n-api.service[120613]: request: PUT /compute/v2.1/flavors/972734081/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 10 23:16:57.907366 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:16:57.907366 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:16:57.907366 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:16:57.907366 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 22 Oct 10 23:16:57.907366 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:16:57.907366 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:16:57.907366 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:16:57.907366 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:57.907366 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfl-0Obdc-THIA_IOtDi2Y69oEGt1ENy3tzmyhGTqOp02VLRSGyRBCY5KXvb7ay1BDfKd6-oIEyRL7V-pfRnPrkO6CkVI3prxpz1Ibc7XpDexGQaZLuuMCmT6V7Q4jkR4GFyJJ6aAGX_Ksfq5TW1VZIJckCajFz35mOuCvfMESimF4 Oct 10 23:16:57.907366 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:16:57.907366 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:16:57.907366 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:16:57.907366 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:16:57.907366 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:16:57.907366 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:16:57.907366 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: afbf3ebebee4410b8a78f924b3622c2a Oct 10 23:16:57.907366 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 Oct 10 23:16:57.907366 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:16:57.907366 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:16:57.908487 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/afbf3ebebee4410b8a78f924b3622c2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afbf3ebebee4410b8a78f924b3622c2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/afbf3ebebee4410b8a78f924b3622c2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_afbf3ebebee4410b8a78f924b3622c2a", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:57.908487 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 Oct 10 23:16:57.908487 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: afbf3ebebee4410b8a78f924b3622c2a Oct 10 23:16:57.908487 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 Oct 10 23:16:57.908487 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project Oct 10 23:16:57.908487 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:16:57.908487 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:16:57.908487 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 19a3c88230ba4d718a114eba7433a6eb Oct 10 23:16:57.908487 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project Oct 10 23:16:57.908487 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:16:57.908487 n-d-860864-2 devstack@n-api.service[120613]: {"hw:numa_nodes": "1"} Oct 10 23:16:57.908487 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:16:57.908487 n-d-860864-2 devstack@n-api.service[120613]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 10 23:16:57.909235 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'flavor_id': '972734081', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 10 23:16:57.909235 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:57.909235 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.909235 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:57.909235 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:57.909235 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:57.909235 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:57.909235 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:57.909235 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:57.909235 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:16:57.909235 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:16:57.909235 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 10 23:16:57.909235 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 10 23:16:57.909235 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:16:57.909235 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:16:57.909235 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:16:57.909235 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:16:57.909235 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:16:57.909235 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:16:57.910238 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:16:57.910238 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:16:57.910238 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:16:57.910238 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:16:57.910238 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:16:57.910238 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:16:57.910238 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:16:57.910238 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:16:57.910238 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 10 23:16:57.910238 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.910238 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:57.910238 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.910238 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.910238 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:57.910238 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:57.910238 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:16:57.910238 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:16:57.910238 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 10 23:16:57.910238 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.911198 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-592da256-4917-4574-b53a-5b8429387e07 tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] HTTP exception thrown: Hypervisor with ID '51c253cf-4733-499b-8842-24f51f7a7176' could not be found. Oct 10 23:16:57.912954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-395667ba-3481-4a1e-8bcb-e545898bff6b tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:57.914045 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-395667ba-3481-4a1e-8bcb-e545898bff6b tempest-FlavorsExtraSpecsNegativeTestJSON-250002499 tempest-FlavorsExtraSpecsNegativeTestJSON-250002499-project] 10.222.0.23 "PUT /compute/v2.1/flavors/972734081/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.020106 Oct 10 23:16:57.914151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-592da256-4917-4574-b53a-5b8429387e07 tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Request method failure captured: Oct 10 23:16:57.914151 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/os-hypervisors/51c253cf-4733-499b-8842-24f51f7a7176 HTTP/1.1 Oct 10 23:16:57.914151 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:16:57.914151 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:16:57.914151 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:16:57.914151 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:16:57.914151 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:16:57.914151 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:16:57.914151 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:16:57.914151 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:57.914151 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKfoOiz7TFmikCU1XPpPH9AjSReM3ZE2NlTdmzX4P9ADmcM7BtIlA41p1M9pE8uQr06exslB8pLAiaSuvpFeWAHWuh8Bz2oxwCOrvsjNNGzDFaWJCIwtlG4kk26GASMuiQGxLHCDgDkLaOgDZkMPiIJUW4rl1_ToSz0056S4YZt8xhw Oct 10 23:16:57.914151 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:16:57.914151 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:16:57.914151 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:16:57.914151 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:16:57.914151 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:16:57.914151 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:16:57.914151 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 9f8f55257df44dfca14112e353caa9dc Oct 10 23:16:57.914151 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-814347718 Oct 10 23:16:57.914151 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:16:57.914151 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:16:57.915318 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9f8f55257df44dfca14112e353caa9dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9f8f55257df44dfca14112e353caa9dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9f8f55257df44dfca14112e353caa9dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9f8f55257df44dfca14112e353caa9dc", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:57.915318 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-814347718 Oct 10 23:16:57.915318 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 9f8f55257df44dfca14112e353caa9dc Oct 10 23:16:57.915318 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-814347718 Oct 10 23:16:57.915318 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin Oct 10 23:16:57.915318 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:16:57.915318 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:16:57.915318 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 2d7f348990e548e58656d0951543676e Oct 10 23:16:57.915318 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin Oct 10 23:16:57.915318 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:16:57.915318 n-d-860864-2 devstack@n-api.service[120614]: exception: Hypervisor with ID '51c253cf-4733-499b-8842-24f51f7a7176' could not be found. Oct 10 23:16:57.915318 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '51c253cf-4733-499b-8842-24f51f7a7176'} Oct 10 23:16:57.915939 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:57.915939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.915939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 10 23:16:57.915939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 10 23:16:57.915939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '51c253cf-4733-499b-8842-24f51f7a7176' Oct 10 23:16:57.915939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.915939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:57.915939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.915939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.915939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 10 23:16:57.915939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 10 23:16:57.915939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 10 23:16:57.915939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 10 23:16:57.915939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 10 23:16:57.915939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.915939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:57.915939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.915939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.915939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 10 23:16:57.915939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 10 23:16:57.915939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 10 23:16:57.915939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 10 23:16:57.917038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 10 23:16:57.917038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.917038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:57.917038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.917038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.917038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:57.917038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:57.917038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:57.917038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:57.917038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:16:57.917038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:16:57.917038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:57.917038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:57.917038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 10 23:16:57.917038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 10 23:16:57.917038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 10 23:16:57.917038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 10 23:16:57.917038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 10 23:16:57.917038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 23:16:57.917038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '51c253cf-4733-499b-8842-24f51f7a7176' could not be found. Oct 10 23:16:57.918750 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.918750 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:57.918750 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.918750 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.918750 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:57.918750 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:57.918750 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:16:57.918750 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:16:57.918750 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '51c253cf-4733-499b-8842-24f51f7a7176' could not be found. Oct 10 23:16:57.918750 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.918750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-592da256-4917-4574-b53a-5b8429387e07 tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] Returning 404 to user: Hypervisor with ID '51c253cf-4733-499b-8842-24f51f7a7176' could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:57.918750 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-592da256-4917-4574-b53a-5b8429387e07 tempest-HypervisorAdminNegativeTestJSON-814347718 tempest-HypervisorAdminNegativeTestJSON-814347718-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/51c253cf-4733-499b-8842-24f51f7a7176" status: 404 len: 123 microversion: 2.1 time: 0.036821 Oct 10 23:16:57.918750 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 78/154] 10.222.0.23 () {58 vars in 1257 bytes} [Mon Oct 10 23:16:57 2022] GET /compute/v2.1/os-hypervisors/51c253cf-4733-499b-8842-24f51f7a7176 => generated 123 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:16:57.924495 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 77/155] 10.222.0.23 () {60 vars in 1262 bytes} [Mon Oct 10 23:16:57 2022] PUT /compute/v2.1/flavors/972734081/os-extra_specs/hw:numa_nodes => generated 124 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:16:57.935994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-02c33c41-b2d7-4383-a77b-1a80e491d061 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:57.947536 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-02c33c41-b2d7-4383-a77b-1a80e491d061 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] HTTP exception thrown: Flavor 972734081 has no extra specs with key hw:cpu_thread_policy. Oct 10 23:16:57.948961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-02c33c41-b2d7-4383-a77b-1a80e491d061 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] Request method failure captured: Oct 10 23:16:57.948961 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/flavors/972734081/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 10 23:16:57.948961 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:16:57.948961 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:16:57.948961 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:16:57.948961 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:16:57.948961 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:16:57.948961 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:16:57.948961 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:16:57.948961 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:57.948961 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKfnRDXXqGmYt-h9EwCoWPN4sOsmXfd9bI3rStbSTo4R-iLI7n7AwDcNbJlMICDhhSxsJa-JyoWJXydWGrYFiFyEyBz-g--owFw3o2xuJmkCQef6pUGD6E3zX7dXsv542rioLbtOjP4zVAT9TgFv-XpFgb1EcM2VqzDsCrImoGtQjU4 Oct 10 23:16:57.948961 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:16:57.948961 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:16:57.948961 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:16:57.948961 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:16:57.948961 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:16:57.948961 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:16:57.948961 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: bd9f66d987cd4a9ca87f6b1de570618e Oct 10 23:16:57.948961 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 Oct 10 23:16:57.948961 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:16:57.948961 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:16:57.950340 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd9f66d987cd4a9ca87f6b1de570618e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd9f66d987cd4a9ca87f6b1de570618e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd9f66d987cd4a9ca87f6b1de570618e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd9f66d987cd4a9ca87f6b1de570618e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:57.950340 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 Oct 10 23:16:57.950340 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: bd9f66d987cd4a9ca87f6b1de570618e Oct 10 23:16:57.950340 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 Oct 10 23:16:57.950340 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin Oct 10 23:16:57.950340 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:16:57.950340 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:16:57.950340 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 0bafbf3e855e41bf8cc27ac8bba50ac7 Oct 10 23:16:57.950340 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin Oct 10 23:16:57.950340 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:16:57.950340 n-d-860864-2 devstack@n-api.service[120614]: exception: Flavor 972734081 has no extra specs with key hw:cpu_thread_policy. Oct 10 23:16:57.951792 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'flavor_id': '972734081', 'id': 'hw:cpu_thread_policy'} Oct 10 23:16:57.951792 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:57.951792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.951792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 10 23:16:57.951792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 10 23:16:57.951792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 10 23:16:57.951792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.951792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:57.951792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.951792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.951792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:57.951792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:57.951792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:57.951792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:57.951792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:57.951792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:57.951792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 10 23:16:57.951792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 23:16:57.951792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 972734081 has no extra specs with key hw:cpu_thread_policy. Oct 10 23:16:57.951792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.951792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:57.951792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.953927 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.953927 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:57.953927 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:57.953927 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:16:57.953927 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:16:57.953927 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 972734081 has no extra specs with key hw:cpu_thread_policy. Oct 10 23:16:57.953927 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.953927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-02c33c41-b2d7-4383-a77b-1a80e491d061 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] Returning 404 to user: Flavor 972734081 has no extra specs with key hw:cpu_thread_policy. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:57.958288 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-02c33c41-b2d7-4383-a77b-1a80e491d061 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/972734081/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.026041 Oct 10 23:16:57.959189 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 79/156] 10.222.0.23 () {58 vars in 1266 bytes} [Mon Oct 10 23:16:57 2022] DELETE /compute/v2.1/flavors/972734081/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:16:57.971823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-08984eec-7149-4c90-99e2-9d13197c28ba tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:57.975712 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-08984eec-7149-4c90-99e2-9d13197c28ba tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 10 23:16:57.977086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-08984eec-7149-4c90-99e2-9d13197c28ba tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] Request method failure captured: Oct 10 23:16:57.977086 n-d-860864-2 devstack@n-api.service[120613]: request: PUT /compute/v2.1/flavors/972734081/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 10 23:16:57.977086 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:16:57.977086 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:16:57.977086 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:16:57.977086 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 27 Oct 10 23:16:57.977086 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:16:57.977086 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:16:57.977086 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:16:57.977086 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:57.977086 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfnRDXXqGmYt-h9EwCoWPN4sOsmXfd9bI3rStbSTo4R-iLI7n7AwDcNbJlMICDhhSxsJa-JyoWJXydWGrYFiFyEyBz-g--owFw3o2xuJmkCQef6pUGD6E3zX7dXsv542rioLbtOjP4zVAT9TgFv-XpFgb1EcM2VqzDsCrImoGtQjU4 Oct 10 23:16:57.977086 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:16:57.977086 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:16:57.977086 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:16:57.977086 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:16:57.977086 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:16:57.977086 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:16:57.977086 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: bd9f66d987cd4a9ca87f6b1de570618e Oct 10 23:16:57.977086 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 Oct 10 23:16:57.977086 n-d-860864-2 devstack@n-api.service[120613]: X-Role: admin,member,reader Oct 10 23:16:57.977086 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: admin,member,reader Oct 10 23:16:57.978259 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd9f66d987cd4a9ca87f6b1de570618e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd9f66d987cd4a9ca87f6b1de570618e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd9f66d987cd4a9ca87f6b1de570618e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd9f66d987cd4a9ca87f6b1de570618e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:57.978259 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 Oct 10 23:16:57.978259 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: bd9f66d987cd4a9ca87f6b1de570618e Oct 10 23:16:57.978259 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 Oct 10 23:16:57.978259 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin Oct 10 23:16:57.978259 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:16:57.978259 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:16:57.978259 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 0bafbf3e855e41bf8cc27ac8bba50ac7 Oct 10 23:16:57.978259 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin Oct 10 23:16:57.978259 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:16:57.978259 n-d-860864-2 devstack@n-api.service[120613]: {"hw:cpu_policy": "shared"} Oct 10 23:16:57.978259 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:16:57.978259 n-d-860864-2 devstack@n-api.service[120613]: exception: Request body and URI mismatch Oct 10 23:16:57.978925 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'flavor_id': '972734081', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 10 23:16:57.978925 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:57.978925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.978925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:57.978925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:57.978925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:57.978925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:57.978925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:57.978925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:57.978925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:16:57.978925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:16:57.978925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 10 23:16:57.978925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 10 23:16:57.978925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 10 23:16:57.978925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.978925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:57.978925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.978925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.978925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:57.978925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:57.979957 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:16:57.979957 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:16:57.979957 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 10 23:16:57.979957 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.979957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-08984eec-7149-4c90-99e2-9d13197c28ba tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:57.979957 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-08984eec-7149-4c90-99e2-9d13197c28ba tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/972734081/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.010246 Oct 10 23:16:57.979957 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 78/157] 10.222.0.23 () {60 vars in 1262 bytes} [Mon Oct 10 23:16:57 2022] PUT /compute/v2.1/flavors/972734081/os-extra_specs/hw:numa_nodes => generated 73 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 23:16:57.990464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8f9a2c2a-c945-4cd2-9241-b31d1e899a23 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:16:57.995620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8f9a2c2a-c945-4cd2-9241-b31d1e899a23 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] Request method failure captured: Oct 10 23:16:57.995620 n-d-860864-2 devstack@n-api.service[120614]: request: PUT /compute/v2.1/flavors/972734081/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 10 23:16:57.995620 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:16:57.995620 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:16:57.995620 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:16:57.995620 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 49 Oct 10 23:16:57.995620 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:16:57.995620 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:16:57.995620 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:16:57.995620 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:16:57.995620 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKfnRDXXqGmYt-h9EwCoWPN4sOsmXfd9bI3rStbSTo4R-iLI7n7AwDcNbJlMICDhhSxsJa-JyoWJXydWGrYFiFyEyBz-g--owFw3o2xuJmkCQef6pUGD6E3zX7dXsv542rioLbtOjP4zVAT9TgFv-XpFgb1EcM2VqzDsCrImoGtQjU4 Oct 10 23:16:57.995620 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:16:57.995620 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:16:57.995620 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:16:57.995620 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:16:57.995620 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:16:57.995620 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:16:57.995620 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: bd9f66d987cd4a9ca87f6b1de570618e Oct 10 23:16:57.995620 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 Oct 10 23:16:57.995620 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:16:57.995620 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:16:57.997074 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bd9f66d987cd4a9ca87f6b1de570618e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd9f66d987cd4a9ca87f6b1de570618e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bd9f66d987cd4a9ca87f6b1de570618e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bd9f66d987cd4a9ca87f6b1de570618e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:16:57.997074 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 Oct 10 23:16:57.997074 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: bd9f66d987cd4a9ca87f6b1de570618e Oct 10 23:16:57.997074 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 Oct 10 23:16:57.997074 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin Oct 10 23:16:57.997074 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:16:57.997074 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:16:57.997074 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 0bafbf3e855e41bf8cc27ac8bba50ac7 Oct 10 23:16:57.997074 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin Oct 10 23:16:57.997074 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:16:57.997074 n-d-860864-2 devstack@n-api.service[120614]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 10 23:16:57.997074 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:16:57.998199 n-d-860864-2 devstack@n-api.service[120614]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 10 23:16:57.998199 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'flavor_id': '972734081', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 10 23:16:57.998199 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:16:57.998199 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.998199 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:16:57.998199 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:16:57.998199 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:16:57.998199 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:16:57.998199 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 10 23:16:57.998199 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.998199 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 10 23:16:57.998199 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 10 23:16:57.998199 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 10 23:16:57.998199 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 10 23:16:57.998199 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 10 23:16:57.998199 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 10 23:16:57.998199 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 10 23:16:57.998199 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 10 23:16:57.998199 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.998199 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance: Oct 10 23:16:57.998199 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 10 23:16:57.998199 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.999960 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:57.999960 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.999960 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:57.999960 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:57.999960 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:57.999960 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:16:57.999960 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:16:57.999960 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:16:57.999960 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:16:57.999960 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:16:57.999960 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:16:57.999960 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:16:57.999960 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:16:57.999960 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:16:57.999960 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:16:57.999960 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 10 23:16:57.999960 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.999960 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:16:57.999960 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:57.999960 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:16:58.000948 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:16:58.000948 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:16:58.000948 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:16:58.000948 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:16:58.000948 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 10 23:16:58.000948 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:16:58.000948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8f9a2c2a-c945-4cd2-9241-b31d1e899a23 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:16:58.000948 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8f9a2c2a-c945-4cd2-9241-b31d1e899a23 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/972734081/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.013989 Oct 10 23:16:58.000948 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 80/158] 10.222.0.23 () {60 vars in 1262 bytes} [Mon Oct 10 23:16:57 2022] PUT /compute/v2.1/flavors/972734081/os-extra_specs/hw:numa_nodes => generated 117 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:16:58.011430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-42a63f15-bf62-480f-b83b-827350580bfd tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:58.048023 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-42a63f15-bf62-480f-b83b-827350580bfd tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/972734081" status: 202 len: 0 microversion: 2.1 time: 0.041130 Oct 10 23:16:58.048631 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 79/159] 10.222.0.23 () {58 vars in 1158 bytes} [Mon Oct 10 23:16:58 2022] DELETE /compute/v2.1/flavors/972734081 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:16:58.058073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1b0c9ab2-d62a-4cbf-b016-8a26f9c25201 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:58.086242 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1b0c9ab2-d62a-4cbf-b016-8a26f9c25201 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967 tempest-FlavorsExtraSpecsNegativeTestJSON-86655967-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032434 Oct 10 23:16:58.101175 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 81/160] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:16:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:58.586678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c12c703d-ad86-415e-9a58-37c7b25b6d28 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:58.587584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c12c703d-ad86-415e-9a58-37c7b25b6d28 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:58.600262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c12c703d-ad86-415e-9a58-37c7b25b6d28 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:58.601671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c12c703d-ad86-415e-9a58-37c7b25b6d28 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:58.602275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c12c703d-ad86-415e-9a58-37c7b25b6d28 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:58.603438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c12c703d-ad86-415e-9a58-37c7b25b6d28 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:58.604050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c12c703d-ad86-415e-9a58-37c7b25b6d28 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:58.604616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c12c703d-ad86-415e-9a58-37c7b25b6d28 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:58.770251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c12c703d-ad86-415e-9a58-37c7b25b6d28 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:58.774500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:16:58.782479 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c12c703d-ad86-415e-9a58-37c7b25b6d28 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 200 len: 1320 microversion: 2.1 time: 0.203558 Oct 10 23:16:58.783423 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 80/161] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:58 2022] GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 1320 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:58.837656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-399e5699-d81d-419d-8e97-ed819e327506 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:58.838268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-399e5699-d81d-419d-8e97-ed819e327506 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:58.847242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-399e5699-d81d-419d-8e97-ed819e327506 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:58.847894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-399e5699-d81d-419d-8e97-ed819e327506 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:58.848486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-399e5699-d81d-419d-8e97-ed819e327506 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:58.849406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-399e5699-d81d-419d-8e97-ed819e327506 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:58.850567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-399e5699-d81d-419d-8e97-ed819e327506 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:58.851550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-399e5699-d81d-419d-8e97-ed819e327506 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:59.243182 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-399e5699-d81d-419d-8e97-ed819e327506 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:16:59.252803 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-399e5699-d81d-419d-8e97-ed819e327506 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1337 microversion: 2.1 time: 0.418977 Oct 10 23:16:59.256891 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 82/162] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:58 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1337 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:16:59.808173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e4298700-21bd-4223-b70d-d847a2debaca tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:16:59.809676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e4298700-21bd-4223-b70d-d847a2debaca tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:16:59.815110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=46,nova_cell0:UPDATE=12 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:16:59.835726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4298700-21bd-4223-b70d-d847a2debaca tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:59.839849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4298700-21bd-4223-b70d-d847a2debaca tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:59.841471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4298700-21bd-4223-b70d-d847a2debaca tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:16:59.844802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4298700-21bd-4223-b70d-d847a2debaca tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:16:59.845564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4298700-21bd-4223-b70d-d847a2debaca tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:16:59.846227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4298700-21bd-4223-b70d-d847a2debaca tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:00.166393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e4298700-21bd-4223-b70d-d847a2debaca tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:00.175405 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e4298700-21bd-4223-b70d-d847a2debaca tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 200 len: 1320 microversion: 2.1 time: 0.372596 Oct 10 23:17:00.180237 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 81/163] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:16:59 2022] GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 1320 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:00.282701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-65024da7-9105-4cb8-9802-6f330108891e tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:00.283361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-65024da7-9105-4cb8-9802-6f330108891e tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:00.296300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65024da7-9105-4cb8-9802-6f330108891e tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:00.297134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65024da7-9105-4cb8-9802-6f330108891e tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:00.297635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65024da7-9105-4cb8-9802-6f330108891e tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:00.298399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65024da7-9105-4cb8-9802-6f330108891e tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:00.299393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65024da7-9105-4cb8-9802-6f330108891e tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:00.302263 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65024da7-9105-4cb8-9802-6f330108891e tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:00.371869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=99 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:00.736298 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-65024da7-9105-4cb8-9802-6f330108891e tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:00.744613 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-65024da7-9105-4cb8-9802-6f330108891e tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1337 microversion: 2.1 time: 0.470020 Oct 10 23:17:00.750630 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 83/164] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:00 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1337 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:01.209920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-12c27c14-6530-42c0-9a10-e8a54a1eb050 req-be80cb8d-f09d-4510-8b1f-f66e47f748f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc4c250-e3ff-4840-bea2-b40c07049ae4", "name": "network-vif-plugged", "status": "completed", "tag": "9ca0dc09-a781-4608-9e31-5f63eec06e8f"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:01.212268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8182f42d-0dad-4f48-9e47-4809a3ee4d76 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:01.213324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8182f42d-0dad-4f48-9e47-4809a3ee4d76 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:01.226201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8182f42d-0dad-4f48-9e47-4809a3ee4d76 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:01.229911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8182f42d-0dad-4f48-9e47-4809a3ee4d76 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:01.230515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8182f42d-0dad-4f48-9e47-4809a3ee4d76 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:01.235250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8182f42d-0dad-4f48-9e47-4809a3ee4d76 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:01.235992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8182f42d-0dad-4f48-9e47-4809a3ee4d76 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:01.238064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8182f42d-0dad-4f48-9e47-4809a3ee4d76 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:01.250992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-12c27c14-6530-42c0-9a10-e8a54a1eb050 req-be80cb8d-f09d-4510-8b1f-f66e47f748f8 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:01.254587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-12c27c14-6530-42c0-9a10-e8a54a1eb050 req-be80cb8d-f09d-4510-8b1f-f66e47f748f8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:01.256287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-12c27c14-6530-42c0-9a10-e8a54a1eb050 req-be80cb8d-f09d-4510-8b1f-f66e47f748f8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:01.336428 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-12c27c14-6530-42c0-9a10-e8a54a1eb050 req-be80cb8d-f09d-4510-8b1f-f66e47f748f8 service nova] Creating event network-vif-plugged:9ca0dc09-a781-4608-9e31-5f63eec06e8f for instance 3cc4c250-e3ff-4840-bea2-b40c07049ae4 on n-h1-860864-2 Oct 10 23:17:01.338826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-12c27c14-6530-42c0-9a10-e8a54a1eb050 req-be80cb8d-f09d-4510-8b1f-f66e47f748f8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120613) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 23:17:01.339567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-12c27c14-6530-42c0-9a10-e8a54a1eb050 req-be80cb8d-f09d-4510-8b1f-f66e47f748f8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120613) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 23:17:01.343787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a0b7228-ef15-4e06-a3b2-ecb32a60e8d1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:01.347989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a0b7228-ef15-4e06-a3b2-ecb32a60e8d1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:01.348929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a0b7228-ef15-4e06-a3b2-ecb32a60e8d1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:01.353979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a0b7228-ef15-4e06-a3b2-ecb32a60e8d1 None None] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:01.355175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a0b7228-ef15-4e06-a3b2-ecb32a60e8d1 None None] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:01.355621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a0b7228-ef15-4e06-a3b2-ecb32a60e8d1 None None] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:01.388840 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.compute.rpcapi [None req-5a0b7228-ef15-4e06-a3b2-ecb32a60e8d1 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 10 23:17:01.400685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a0b7228-ef15-4e06-a3b2-ecb32a60e8d1 None None] Releasing lock "compute-rpcapi-router" {{(pid=120613) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 23:17:01.441290 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5a0b7228-ef15-4e06-a3b2-ecb32a60e8d1 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.066925 Oct 10 23:17:01.441984 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 82/165] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:17:01.774589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6c2ae646-802e-4849-a62f-f902649cea86 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:01.775499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6c2ae646-802e-4849-a62f-f902649cea86 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:01.791630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c2ae646-802e-4849-a62f-f902649cea86 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:01.792492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c2ae646-802e-4849-a62f-f902649cea86 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:01.793105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c2ae646-802e-4849-a62f-f902649cea86 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:01.794806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c2ae646-802e-4849-a62f-f902649cea86 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:01.796635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c2ae646-802e-4849-a62f-f902649cea86 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:01.799966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c2ae646-802e-4849-a62f-f902649cea86 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:02.176342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6c2ae646-802e-4849-a62f-f902649cea86 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:02.188098 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6c2ae646-802e-4849-a62f-f902649cea86 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1337 microversion: 2.1 time: 0.416040 Oct 10 23:17:02.188872 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 83/166] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:01 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1337 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:02.460971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8182f42d-0dad-4f48-9e47-4809a3ee4d76 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:02.477834 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8182f42d-0dad-4f48-9e47-4809a3ee4d76 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 200 len: 1320 microversion: 2.1 time: 1.279052 Oct 10 23:17:02.478595 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 84/167] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:01 2022] GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 1320 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:17:03.219397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a2cdeee3-eab7-4594-b183-c1a4121a7679 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:03.220783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a2cdeee3-eab7-4594-b183-c1a4121a7679 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:03.233188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2cdeee3-eab7-4594-b183-c1a4121a7679 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:03.234322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2cdeee3-eab7-4594-b183-c1a4121a7679 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:03.236546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2cdeee3-eab7-4594-b183-c1a4121a7679 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:03.237576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2cdeee3-eab7-4594-b183-c1a4121a7679 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:03.239642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2cdeee3-eab7-4594-b183-c1a4121a7679 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:03.246476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2cdeee3-eab7-4594-b183-c1a4121a7679 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:03.506222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6bba69c3-b141-4dd5-8905-c578c7bb9b6a tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:03.506839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6bba69c3-b141-4dd5-8905-c578c7bb9b6a tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:03.515917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6bba69c3-b141-4dd5-8905-c578c7bb9b6a tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:03.516425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6bba69c3-b141-4dd5-8905-c578c7bb9b6a tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:03.516873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6bba69c3-b141-4dd5-8905-c578c7bb9b6a tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:03.531880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6bba69c3-b141-4dd5-8905-c578c7bb9b6a tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:03.532482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6bba69c3-b141-4dd5-8905-c578c7bb9b6a tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:03.532937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6bba69c3-b141-4dd5-8905-c578c7bb9b6a tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:03.666245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a2cdeee3-eab7-4594-b183-c1a4121a7679 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:03.686095 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a2cdeee3-eab7-4594-b183-c1a4121a7679 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1337 microversion: 2.1 time: 0.478000 Oct 10 23:17:03.688358 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 84/168] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:03 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1337 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:04.344698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6bba69c3-b141-4dd5-8905-c578c7bb9b6a tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:04.355605 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e7cce1c2-17c6-41c0-a8e7-f0df1a03331d tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Calling method '.version_select at 0x7f6630427940>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:04.368825 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6bba69c3-b141-4dd5-8905-c578c7bb9b6a tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 200 len: 1320 microversion: 2.1 time: 0.866338 Oct 10 23:17:04.369408 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 85/169] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:03 2022] GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 1320 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:04.572426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7ca05f64-0612-439a-988f-6a6452cd72b5 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Calling method '.version_select at 0x7f6630499700>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:04.575117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ca05f64-0612-439a-988f-6a6452cd72b5 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:04.576592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ca05f64-0612-439a-988f-6a6452cd72b5 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:04.577236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ca05f64-0612-439a-988f-6a6452cd72b5 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:04.610593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ca05f64-0612-439a-988f-6a6452cd72b5 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:04.613221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ca05f64-0612-439a-988f-6a6452cd72b5 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:04.614041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ca05f64-0612-439a-988f-6a6452cd72b5 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:04.657580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ca05f64-0612-439a-988f-6a6452cd72b5 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:04.662032 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ca05f64-0612-439a-988f-6a6452cd72b5 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:04.662703 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ca05f64-0612-439a-988f-6a6452cd72b5 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:04.680284 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7ca05f64-0612-439a-988f-6a6452cd72b5 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.309839 Oct 10 23:17:04.686238 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e7cce1c2-17c6-41c0-a8e7-f0df1a03331d tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/94ea24f8308240318390c0d43d48ae5f" status: 200 len: 371 microversion: 2.1 time: 0.926838 Oct 10 23:17:04.694163 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 86/170] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:17:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:04.711496 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 85/171] 10.222.0.23 () {58 vars in 1242 bytes} [Mon Oct 10 23:17:03 2022] GET /compute/v2.1/os-quota-sets/94ea24f8308240318390c0d43d48ae5f => generated 371 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:04.716782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-07420650-264d-440d-985d-93ed22216ced tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Calling method '.version_select at 0x7f6630499b80>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:04.719072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07420650-264d-440d-985d-93ed22216ced tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:04.721604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07420650-264d-440d-985d-93ed22216ced tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:04.725210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e951e05f-90f9-4e49-89c9-93becbff3cf2 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Action: 'update', calling method: .version_select at 0x7f66304279d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:04.725815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07420650-264d-440d-985d-93ed22216ced tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:04.764010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07420650-264d-440d-985d-93ed22216ced tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:04.765306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07420650-264d-440d-985d-93ed22216ced tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:04.769975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07420650-264d-440d-985d-93ed22216ced tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:04.790067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07420650-264d-440d-985d-93ed22216ced tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:04.791294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07420650-264d-440d-985d-93ed22216ced tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:04.791733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07420650-264d-440d-985d-93ed22216ced tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:04.815128 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-07420650-264d-440d-985d-93ed22216ced tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.110798 Oct 10 23:17:04.816875 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 87/172] 10.222.0.23 () {58 vars in 1167 bytes} [Mon Oct 10 23:17:04 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:04.823104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8d260e89-c3ee-4e25-a8e4-272c651c9a05 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:04.826139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8d260e89-c3ee-4e25-a8e4-272c651c9a05 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:04.839284 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d260e89-c3ee-4e25-a8e4-272c651c9a05 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:04.840592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d260e89-c3ee-4e25-a8e4-272c651c9a05 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:04.843451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d260e89-c3ee-4e25-a8e4-272c651c9a05 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:04.844276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d260e89-c3ee-4e25-a8e4-272c651c9a05 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:04.844750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d260e89-c3ee-4e25-a8e4-272c651c9a05 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:04.845181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d260e89-c3ee-4e25-a8e4-272c651c9a05 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:05.269523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8d260e89-c3ee-4e25-a8e4-272c651c9a05 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:05.284530 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8d260e89-c3ee-4e25-a8e4-272c651c9a05 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1337 microversion: 2.1 time: 0.466121 Oct 10 23:17:05.302824 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 88/173] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:04 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1337 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:05.311991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-88218889-f1ef-4287-b0a7-637fcf3e2805 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Calling method '.version_select at 0x7f663053f940>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:05.328953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-88218889-f1ef-4287-b0a7-637fcf3e2805 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:05.334221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-88218889-f1ef-4287-b0a7-637fcf3e2805 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:05.334767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-88218889-f1ef-4287-b0a7-637fcf3e2805 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:05.395886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-88218889-f1ef-4287-b0a7-637fcf3e2805 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:05.396328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-88218889-f1ef-4287-b0a7-637fcf3e2805 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:05.396811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-88218889-f1ef-4287-b0a7-637fcf3e2805 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:05.429837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-88218889-f1ef-4287-b0a7-637fcf3e2805 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:05.431360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-88218889-f1ef-4287-b0a7-637fcf3e2805 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:05.432031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-88218889-f1ef-4287-b0a7-637fcf3e2805 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:05.441593 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-88218889-f1ef-4287-b0a7-637fcf3e2805 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.146762 Oct 10 23:17:05.449698 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 89/174] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:17:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:05.455409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3f61acef-fa3a-47ba-b5bd-f641e0c15e34 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:05.456205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3f61acef-fa3a-47ba-b5bd-f641e0c15e34 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:05.462492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f61acef-fa3a-47ba-b5bd-f641e0c15e34 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:05.463117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f61acef-fa3a-47ba-b5bd-f641e0c15e34 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:05.463773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f61acef-fa3a-47ba-b5bd-f641e0c15e34 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:05.464766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f61acef-fa3a-47ba-b5bd-f641e0c15e34 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:05.465455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f61acef-fa3a-47ba-b5bd-f641e0c15e34 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:05.466126 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f61acef-fa3a-47ba-b5bd-f641e0c15e34 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:05.606652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e951e05f-90f9-4e49-89c9-93becbff3cf2 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:05.610198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e951e05f-90f9-4e49-89c9-93becbff3cf2 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:05.610822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e951e05f-90f9-4e49-89c9-93becbff3cf2 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:05.614317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e951e05f-90f9-4e49-89c9-93becbff3cf2 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:05.617060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e951e05f-90f9-4e49-89c9-93becbff3cf2 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:05.617945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e951e05f-90f9-4e49-89c9-93becbff3cf2 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:05.933040 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e951e05f-90f9-4e49-89c9-93becbff3cf2 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/94ea24f8308240318390c0d43d48ae5f" status: 200 len: 328 microversion: 2.1 time: 1.220212 Oct 10 23:17:05.948225 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 86/175] 10.222.0.23 () {60 vars in 1262 bytes} [Mon Oct 10 23:17:04 2022] PUT /compute/v2.1/os-quota-sets/94ea24f8308240318390c0d43d48ae5f => generated 328 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:05.968235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8ca258e8-07f6-466d-9a02-b46d0001d131 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Calling method '.version_select at 0x7f6630427820>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:05.974667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ca258e8-07f6-466d-9a02-b46d0001d131 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:05.975191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ca258e8-07f6-466d-9a02-b46d0001d131 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:05.979444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ca258e8-07f6-466d-9a02-b46d0001d131 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:06.053800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ca258e8-07f6-466d-9a02-b46d0001d131 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:06.054306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ca258e8-07f6-466d-9a02-b46d0001d131 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:06.054749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ca258e8-07f6-466d-9a02-b46d0001d131 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:06.074606 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8ca258e8-07f6-466d-9a02-b46d0001d131 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.124383 Oct 10 23:17:06.082335 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 87/176] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:17:05 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:06.090033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6e99c5fa-17ed-4d70-9037-bb020b75ff84 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:06.120675 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6e99c5fa-17ed-4d70-9037-bb020b75ff84 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-quota-sets/94ea24f8308240318390c0d43d48ae5f" status: 202 len: 0 microversion: 2.1 time: 0.036819 Oct 10 23:17:06.121933 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 88/177] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:17:06 2022] DELETE /compute/v2.1/os-quota-sets/94ea24f8308240318390c0d43d48ae5f => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:17:06.134751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-348a85fb-84fc-4b2b-9d81-7ae821b7fe11 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Calling method '.version_select at 0x7f663041a280>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:06.140395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-348a85fb-84fc-4b2b-9d81-7ae821b7fe11 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:06.142550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-348a85fb-84fc-4b2b-9d81-7ae821b7fe11 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:06.143255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-348a85fb-84fc-4b2b-9d81-7ae821b7fe11 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:06.227614 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-348a85fb-84fc-4b2b-9d81-7ae821b7fe11 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.100018 Oct 10 23:17:06.230823 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 89/178] 10.222.0.23 () {58 vars in 1179 bytes} [Mon Oct 10 23:17:06 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:06.234230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3f61acef-fa3a-47ba-b5bd-f641e0c15e34 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:06.248309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1bcf413b-eae9-4843-92ce-da1ad021f9ac tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Calling method '.version_select at 0x7f6630447940>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:06.253099 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3f61acef-fa3a-47ba-b5bd-f641e0c15e34 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 200 len: 1469 microversion: 2.1 time: 0.802056 Oct 10 23:17:06.256294 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 90/179] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:05 2022] GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 1469 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:06.266924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-84cddb48-2a4f-4f60-b6f5-f2ee679bbd64 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Calling method '.version_select at 0x7f66306b4c10>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:06.269368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-84cddb48-2a4f-4f60-b6f5-f2ee679bbd64 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:06.282400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-84cddb48-2a4f-4f60-b6f5-f2ee679bbd64 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:06.283443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-84cddb48-2a4f-4f60-b6f5-f2ee679bbd64 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:06.327186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-84cddb48-2a4f-4f60-b6f5-f2ee679bbd64 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:06.329061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-84cddb48-2a4f-4f60-b6f5-f2ee679bbd64 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:06.331211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-84cddb48-2a4f-4f60-b6f5-f2ee679bbd64 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:06.359692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-84cddb48-2a4f-4f60-b6f5-f2ee679bbd64 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:06.360191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-84cddb48-2a4f-4f60-b6f5-f2ee679bbd64 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:06.360624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-84cddb48-2a4f-4f60-b6f5-f2ee679bbd64 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:06.383173 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-84cddb48-2a4f-4f60-b6f5-f2ee679bbd64 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.123419 Oct 10 23:17:06.384304 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 91/180] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:17:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:06.858361 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1bcf413b-eae9-4843-92ce-da1ad021f9ac tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/94ea24f8308240318390c0d43d48ae5f" status: 200 len: 371 microversion: 2.1 time: 0.624907 Oct 10 23:17:06.861479 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 90/181] 10.222.0.23 () {58 vars in 1242 bytes} [Mon Oct 10 23:17:06 2022] GET /compute/v2.1/os-quota-sets/94ea24f8308240318390c0d43d48ae5f => generated 371 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:06.880444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7e53a939-bc59-4828-97d8-074373df4bfc tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:06.883297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7e53a939-bc59-4828-97d8-074373df4bfc tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:06.905187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e53a939-bc59-4828-97d8-074373df4bfc tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:06.909326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e53a939-bc59-4828-97d8-074373df4bfc tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:06.910529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e53a939-bc59-4828-97d8-074373df4bfc tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:06.913441 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e53a939-bc59-4828-97d8-074373df4bfc tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:06.915933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e53a939-bc59-4828-97d8-074373df4bfc tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:06.916677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e53a939-bc59-4828-97d8-074373df4bfc tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:07.005354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-33594e3d-4766-47f1-8c4b-abb1fb0bfa24 tempest-DeleteServersAdminTestJSON-2036703229 tempest-DeleteServersAdminTestJSON-2036703229-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:07.005875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-33594e3d-4766-47f1-8c4b-abb1fb0bfa24 tempest-DeleteServersAdminTestJSON-2036703229 tempest-DeleteServersAdminTestJSON-2036703229-project-admin] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:07.020850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33594e3d-4766-47f1-8c4b-abb1fb0bfa24 tempest-DeleteServersAdminTestJSON-2036703229 tempest-DeleteServersAdminTestJSON-2036703229-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:07.021406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33594e3d-4766-47f1-8c4b-abb1fb0bfa24 tempest-DeleteServersAdminTestJSON-2036703229 tempest-DeleteServersAdminTestJSON-2036703229-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:07.021847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33594e3d-4766-47f1-8c4b-abb1fb0bfa24 tempest-DeleteServersAdminTestJSON-2036703229 tempest-DeleteServersAdminTestJSON-2036703229-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:07.030375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33594e3d-4766-47f1-8c4b-abb1fb0bfa24 tempest-DeleteServersAdminTestJSON-2036703229 tempest-DeleteServersAdminTestJSON-2036703229-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:07.030872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33594e3d-4766-47f1-8c4b-abb1fb0bfa24 tempest-DeleteServersAdminTestJSON-2036703229 tempest-DeleteServersAdminTestJSON-2036703229-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:07.031315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33594e3d-4766-47f1-8c4b-abb1fb0bfa24 tempest-DeleteServersAdminTestJSON-2036703229 tempest-DeleteServersAdminTestJSON-2036703229-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:07.280944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-33594e3d-4766-47f1-8c4b-abb1fb0bfa24 tempest-DeleteServersAdminTestJSON-2036703229 tempest-DeleteServersAdminTestJSON-2036703229-project-admin] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:17:07.660947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7e53a939-bc59-4828-97d8-074373df4bfc tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:07.671082 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7e53a939-bc59-4828-97d8-074373df4bfc tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1337 microversion: 2.1 time: 0.807233 Oct 10 23:17:07.671511 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-33594e3d-4766-47f1-8c4b-abb1fb0bfa24 tempest-DeleteServersAdminTestJSON-2036703229 tempest-DeleteServersAdminTestJSON-2036703229-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 204 len: 0 microversion: 2.1 time: 1.283947 Oct 10 23:17:07.673985 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 91/182] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:06 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1337 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:07.682576 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 92/183] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:17:06 2022] DELETE /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 0 bytes in 1297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:17:07.706891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-17a9a4c8-ddbf-43f2-9de0-6f36482eba13 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Calling method '.version_select at 0x7f663041a310>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:07.708572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-a6b316f0-2de9-48ba-a32a-fc23983d3242 req-9ac6255a-b95b-4619-ab74-f08ca725b67a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41c23198-c951-4c85-b87c-6f10d6835eaf", "name": "network-vif-plugged", "status": "completed", "tag": "470aa439-6a67-49f6-bdd4-ca7adc5d67b5"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:07.711204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17a9a4c8-ddbf-43f2-9de0-6f36482eba13 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:07.714175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17a9a4c8-ddbf-43f2-9de0-6f36482eba13 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:07.717175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17a9a4c8-ddbf-43f2-9de0-6f36482eba13 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:07.727373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a6b316f0-2de9-48ba-a32a-fc23983d3242 req-9ac6255a-b95b-4619-ab74-f08ca725b67a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:07.729059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a6b316f0-2de9-48ba-a32a-fc23983d3242 req-9ac6255a-b95b-4619-ab74-f08ca725b67a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:07.729928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a6b316f0-2de9-48ba-a32a-fc23983d3242 req-9ac6255a-b95b-4619-ab74-f08ca725b67a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:07.751792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17a9a4c8-ddbf-43f2-9de0-6f36482eba13 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:07.752295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17a9a4c8-ddbf-43f2-9de0-6f36482eba13 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:07.752739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17a9a4c8-ddbf-43f2-9de0-6f36482eba13 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:07.773260 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-17a9a4c8-ddbf-43f2-9de0-6f36482eba13 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.097984 Oct 10 23:17:07.777792 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 92/184] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:17:07 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:07.787767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6e202d63-d226-4051-9162-3d6f17fb86c6 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Calling method '.version_select at 0x7f6630427700>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:07.789362 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-a6b316f0-2de9-48ba-a32a-fc23983d3242 req-9ac6255a-b95b-4619-ab74-f08ca725b67a service nova] Creating event network-vif-plugged:470aa439-6a67-49f6-bdd4-ca7adc5d67b5 for instance 41c23198-c951-4c85-b87c-6f10d6835eaf on n-h2-860864-2 Oct 10 23:17:07.811532 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-a6b316f0-2de9-48ba-a32a-fc23983d3242 req-9ac6255a-b95b-4619-ab74-f08ca725b67a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121692 Oct 10 23:17:07.812192 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 93/185] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:07.847424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b74fcb29-0312-4743-93ba-a71c80145fb8 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:07.848373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b74fcb29-0312-4743-93ba-a71c80145fb8 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:07.880258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b74fcb29-0312-4743-93ba-a71c80145fb8 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:07.881079 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b74fcb29-0312-4743-93ba-a71c80145fb8 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:07.881789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b74fcb29-0312-4743-93ba-a71c80145fb8 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:07.884788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b74fcb29-0312-4743-93ba-a71c80145fb8 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:07.885596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b74fcb29-0312-4743-93ba-a71c80145fb8 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:07.886175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b74fcb29-0312-4743-93ba-a71c80145fb8 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:08.461759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b74fcb29-0312-4743-93ba-a71c80145fb8 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:08.478209 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b74fcb29-0312-4743-93ba-a71c80145fb8 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 200 len: 1475 microversion: 2.1 time: 0.649286 Oct 10 23:17:08.479314 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 94/186] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:07 2022] GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 1475 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:08.499270 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6e202d63-d226-4051-9162-3d6f17fb86c6 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/f8c6041207d24dee830c7e38255250b6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.720149 Oct 10 23:17:08.502047 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 93/187] 10.222.0.23 () {58 vars in 1269 bytes} [Mon Oct 10 23:17:07 2022] GET /compute/v2.1/os-quota-sets/f8c6041207d24dee830c7e38255250b6/defaults => generated 371 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:08.505976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0f11e5ef-adcb-4127-a53c-937b7a35573b tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Calling method '.version_select at 0x7f66305c7af0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:08.508243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f11e5ef-adcb-4127-a53c-937b7a35573b tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:08.510269 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f11e5ef-adcb-4127-a53c-937b7a35573b tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:08.511864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f11e5ef-adcb-4127-a53c-937b7a35573b tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:08.561915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f11e5ef-adcb-4127-a53c-937b7a35573b tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:08.567813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f11e5ef-adcb-4127-a53c-937b7a35573b tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:08.568548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f11e5ef-adcb-4127-a53c-937b7a35573b tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:08.585715 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0f11e5ef-adcb-4127-a53c-937b7a35573b tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.101110 Oct 10 23:17:08.588415 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 95/188] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:17:08 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:08.739791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fcc80581-269a-4f44-a011-11fbe771a5d1 tempest-QuotaClassesAdmin257Test-1738902457 tempest-QuotaClassesAdmin257Test-1738902457-project-admin] Calling method '.version_select at 0x7f66308714c0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:08.765661 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fcc80581-269a-4f44-a011-11fbe771a5d1 tempest-QuotaClassesAdmin257Test-1738902457 tempest-QuotaClassesAdmin257Test-1738902457-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.175943 Oct 10 23:17:08.772404 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 96/189] 10.222.0.23 () {60 vars in 1226 bytes} [Mon Oct 10 23:17:08 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:17:08.780701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2579472f-6d70-4f94-b245-6c467be9d871 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Calling method '.version_select at 0x7f66305c7670>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:08.782731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2579472f-6d70-4f94-b245-6c467be9d871 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:08.785269 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2579472f-6d70-4f94-b245-6c467be9d871 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:08.793966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2579472f-6d70-4f94-b245-6c467be9d871 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:08.820192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2579472f-6d70-4f94-b245-6c467be9d871 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:08.820938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2579472f-6d70-4f94-b245-6c467be9d871 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:08.821619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2579472f-6d70-4f94-b245-6c467be9d871 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:08.848887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2579472f-6d70-4f94-b245-6c467be9d871 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:08.849816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2579472f-6d70-4f94-b245-6c467be9d871 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:08.852016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2579472f-6d70-4f94-b245-6c467be9d871 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:08.878542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-858021f3-f682-491d-b53a-03d567930380 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Calling method '.version_select at 0x7f6630427550>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:08.880989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-858021f3-f682-491d-b53a-03d567930380 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:08.882234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-858021f3-f682-491d-b53a-03d567930380 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:08.882680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-858021f3-f682-491d-b53a-03d567930380 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:08.915261 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2579472f-6d70-4f94-b245-6c467be9d871 tempest-HypervisorAdminTestJSON-310205760 tempest-HypervisorAdminTestJSON-310205760-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.145836 Oct 10 23:17:08.916583 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 97/190] 10.222.0.23 () {58 vars in 1173 bytes} [Mon Oct 10 23:17:08 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:08.929790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7f1a0e54-f060-4faa-9a4a-5bf9cc484eef tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:08.933957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-858021f3-f682-491d-b53a-03d567930380 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:08.934460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-858021f3-f682-491d-b53a-03d567930380 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:08.934904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-858021f3-f682-491d-b53a-03d567930380 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:08.942468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7f1a0e54-f060-4faa-9a4a-5bf9cc484eef tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:08.959396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-858021f3-f682-491d-b53a-03d567930380 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:08.959894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-858021f3-f682-491d-b53a-03d567930380 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:08.960328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-858021f3-f682-491d-b53a-03d567930380 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:08.963535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f1a0e54-f060-4faa-9a4a-5bf9cc484eef tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:08.968922 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f1a0e54-f060-4faa-9a4a-5bf9cc484eef tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:08.974143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f1a0e54-f060-4faa-9a4a-5bf9cc484eef tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:08.975364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f1a0e54-f060-4faa-9a4a-5bf9cc484eef tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:08.976060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f1a0e54-f060-4faa-9a4a-5bf9cc484eef tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:08.977144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f1a0e54-f060-4faa-9a4a-5bf9cc484eef tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:08.983765 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-858021f3-f682-491d-b53a-03d567930380 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.479375 Oct 10 23:17:08.993470 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 94/191] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:17:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:09.006271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-459ea652-3993-4aeb-9629-db4a4a962324 tempest-QuotaClassesAdmin257Test-1738902457 tempest-QuotaClassesAdmin257Test-1738902457-project-admin] Action: 'update', calling method: .version_select at 0x7f6630447ee0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:09.223665 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-459ea652-3993-4aeb-9629-db4a4a962324 tempest-QuotaClassesAdmin257Test-1738902457 tempest-QuotaClassesAdmin257Test-1738902457-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.228485 Oct 10 23:17:09.234584 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 95/192] 10.222.0.23 () {62 vars in 1247 bytes} [Mon Oct 10 23:17:08 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:17:09.527518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-443bc4dd-eb7d-4e7e-ba01-0f8afca31dee tempest-HypervisorAdminNegativeUnderV252Test-497134694 tempest-HypervisorAdminNegativeUnderV252Test-497134694-project] Calling method '.version_select at 0x7f66303e7af0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:09.530826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-443bc4dd-eb7d-4e7e-ba01-0f8afca31dee tempest-HypervisorAdminNegativeUnderV252Test-497134694 tempest-HypervisorAdminNegativeUnderV252Test-497134694-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'cf725e7c4f9b43669b60f25545e0e0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fb13e49845480a90f5e721f92f176e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:09.535242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-443bc4dd-eb7d-4e7e-ba01-0f8afca31dee tempest-HypervisorAdminNegativeUnderV252Test-497134694 tempest-HypervisorAdminNegativeUnderV252Test-497134694-project] Request method failure captured: Oct 10 23:17:09.535242 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-hypervisors/n-h2-860864-2/search HTTP/1.1 Oct 10 23:17:09.535242 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:17:09.535242 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:17:09.535242 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:17:09.535242 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:17:09.535242 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:17:09.535242 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:17:09.535242 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:17:09.535242 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:09.535242 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfx1NaT3kDxdgrGCdp20jcOPRpiCTGPIiJefZDdxHv4IDJB8izd8AgCgmHiNqX-CBM0uzOp1iNbWw_4LcR6Eh8l9qscwNxg_5LQ06DW1jjytutbwWc99eqSOPxIRc6gE1SHOqMpO1-Cea8YxkcS5QeLJzPNOU7swKl9zNeFEy4Zr4M Oct 10 23:17:09.535242 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:17:09.535242 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:17:09.535242 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:17:09.535242 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:17:09.535242 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:17:09.535242 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:17:09.535242 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 98fb13e49845480a90f5e721f92f176e Oct 10 23:17:09.535242 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-497134694 Oct 10 23:17:09.535242 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:17:09.535242 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:17:09.536724 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/98fb13e49845480a90f5e721f92f176e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/98fb13e49845480a90f5e721f92f176e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/98fb13e49845480a90f5e721f92f176e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_98fb13e49845480a90f5e721f92f176e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:09.536724 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-497134694 Oct 10 23:17:09.536724 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 98fb13e49845480a90f5e721f92f176e Oct 10 23:17:09.536724 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-497134694 Oct 10 23:17:09.536724 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-497134694-project Oct 10 23:17:09.536724 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:17:09.536724 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:17:09.536724 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: cf725e7c4f9b43669b60f25545e0e0dc Oct 10 23:17:09.536724 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-497134694-project Oct 10 23:17:09.536724 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:17:09.536724 n-d-860864-2 devstack@n-api.service[120613]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 10 23:17:09.536724 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'n-h2-860864-2'} Oct 10 23:17:09.537583 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:09.537583 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:09.537583 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:09.537583 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:09.537583 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:09.537583 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:09.537583 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:17:09.537583 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:17:09.537583 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:09.537583 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:09.537583 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 10 23:17:09.537583 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 10 23:17:09.537583 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:17:09.537583 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:17:09.537583 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:17:09.537583 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:17:09.537583 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:17:09.537583 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:17:09.537583 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:17:09.538941 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:17:09.538941 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:17:09.538941 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:17:09.538941 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:17:09.538941 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:17:09.538941 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:17:09.538941 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:17:09.538941 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 10 23:17:09.538941 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:09.538941 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:09.538941 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:09.538941 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:09.538941 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:09.538941 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:09.538941 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:17:09.538941 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:17:09.538941 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 10 23:17:09.538941 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:09.540116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-443bc4dd-eb7d-4e7e-ba01-0f8afca31dee tempest-HypervisorAdminNegativeUnderV252Test-497134694 tempest-HypervisorAdminNegativeUnderV252Test-497134694-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:09.540116 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-443bc4dd-eb7d-4e7e-ba01-0f8afca31dee tempest-HypervisorAdminNegativeUnderV252Test-497134694 tempest-HypervisorAdminNegativeUnderV252Test-497134694-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h2-860864-2/search" status: 403 len: 117 microversion: 2.1 time: 0.302182 Oct 10 23:17:09.541699 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 96/193] 10.222.0.23 () {58 vars in 1209 bytes} [Mon Oct 10 23:17:09 2022] GET /compute/v2.1/os-hypervisors/n-h2-860864-2/search => generated 117 bytes in 306 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:17:09.548189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-71cb7907-8459-4528-996e-14b35c0b4290 tempest-QuotaClassesAdmin257Test-1738902457 tempest-QuotaClassesAdmin257Test-1738902457-project-admin] Calling method '.version_select at 0x7f6630427e50>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:09.574974 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-71cb7907-8459-4528-996e-14b35c0b4290 tempest-QuotaClassesAdmin257Test-1738902457 tempest-QuotaClassesAdmin257Test-1738902457-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.032098 Oct 10 23:17:09.576948 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 97/194] 10.222.0.23 () {60 vars in 1226 bytes} [Mon Oct 10 23:17:09 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:17:09.901996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7f1a0e54-f060-4faa-9a4a-5bf9cc484eef tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:09.917406 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7f1a0e54-f060-4faa-9a4a-5bf9cc484eef tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1337 microversion: 2.1 time: 0.997635 Oct 10 23:17:09.918232 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 98/195] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:08 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1337 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:09.927141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d2b9b451-e36b-4fa8-9abd-1e0548a9c272 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:09.938017 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d2b9b451-e36b-4fa8-9abd-1e0548a9c272 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.359419 Oct 10 23:17:09.942666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7cf24617-520a-4031-8df5-187cf7dbed3e tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:09.943512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7cf24617-520a-4031-8df5-187cf7dbed3e tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:09.948976 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 98/196] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:17:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:09.951760 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7cf24617-520a-4031-8df5-187cf7dbed3e tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:09.952457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7cf24617-520a-4031-8df5-187cf7dbed3e tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:09.953451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7cf24617-520a-4031-8df5-187cf7dbed3e tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:09.955913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4fd56a1b-9e5b-4473-ae72-142312256a7b tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Calling method '.version_select at 0x7f66303e70d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:09.956433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7cf24617-520a-4031-8df5-187cf7dbed3e tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:09.956908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7cf24617-520a-4031-8df5-187cf7dbed3e tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:09.957342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7cf24617-520a-4031-8df5-187cf7dbed3e tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:09.958907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fd56a1b-9e5b-4473-ae72-142312256a7b tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:09.959687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fd56a1b-9e5b-4473-ae72-142312256a7b tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:09.960462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fd56a1b-9e5b-4473-ae72-142312256a7b tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:09.982379 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-4fd56a1b-9e5b-4473-ae72-142312256a7b tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 10 23:17:09.990923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4fd56a1b-9e5b-4473-ae72-142312256a7b tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Request method failure captured: Oct 10 23:17:09.990923 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 10 23:17:09.990923 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:17:09.990923 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:17:09.990923 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:17:09.990923 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:17:09.990923 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:17:09.990923 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:17:09.990923 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:17:09.990923 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:09.990923 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfzU8SprZUuNbkqJf0bxHXpovcZcj8Ae6_q219elftUlsJRIcGWG-rY5DhUJauoNm2FrpjwHHlp2SP3twxW2KIYWeO2Nyp7JpYC1hfqPL_Mox_pp3_F_eV-3F61Y_azH7tGmq8_Eoil3IdP4cSnxhSRTg0RIlf45qLaDKXGb_2RYJ8 Oct 10 23:17:09.990923 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:17:09.990923 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:17:09.990923 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:17:09.990923 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:17:09.990923 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:17:09.990923 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:17:09.990923 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 590b05f6d29246d2a30b7ca37e7fe99b Oct 10 23:17:09.990923 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1910720206 Oct 10 23:17:09.990923 n-d-860864-2 devstack@n-api.service[120613]: X-Role: admin,member,reader Oct 10 23:17:09.990923 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: admin,member,reader Oct 10 23:17:09.992240 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/590b05f6d29246d2a30b7ca37e7fe99b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/590b05f6d29246d2a30b7ca37e7fe99b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/590b05f6d29246d2a30b7ca37e7fe99b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_590b05f6d29246d2a30b7ca37e7fe99b", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:09.992240 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1910720206 Oct 10 23:17:09.992240 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 590b05f6d29246d2a30b7ca37e7fe99b Oct 10 23:17:09.992240 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1910720206 Oct 10 23:17:09.992240 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin Oct 10 23:17:09.992240 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:17:09.992240 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:17:09.992240 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 59f50b5d85864dcf80c1680305424d23 Oct 10 23:17:09.992240 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin Oct 10 23:17:09.992240 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:17:09.992240 n-d-860864-2 devstack@n-api.service[120613]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 10 23:17:09.992240 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 10 23:17:09.992991 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:09.992991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:09.992991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:09.992991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:09.992991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:09.992991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:09.992991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:17:09.992991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:17:09.992991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:09.992991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:09.992991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 10 23:17:09.992991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 10 23:17:09.992991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 10 23:17:09.992991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 23:17:09.992991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 10 23:17:09.992991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:09.992991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:09.992991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:09.992991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:09.992991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:09.994137 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:09.994137 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:09.994137 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:09.994137 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 10 23:17:09.994137 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:09.997041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4fd56a1b-9e5b-4473-ae72-142312256a7b tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:09.999794 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4fd56a1b-9e5b-4473-ae72-142312256a7b tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.048476 Oct 10 23:17:10.013937 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 99/197] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 10 23:17:09 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:17:10.024888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8c508df0-86be-45f1-8583-3f3bd2f3bd20 tempest-QuotaClassesAdmin257Test-1738902457 tempest-QuotaClassesAdmin257Test-1738902457-project-admin] Action: 'update', calling method: .version_select at 0x7f6630410af0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:10.123404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:SELECT=74,nova_api:DELETE=5,nova_api:INSERT=3,nova_api:UPDATE=14 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:10.156369 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8c508df0-86be-45f1-8583-3f3bd2f3bd20 tempest-QuotaClassesAdmin257Test-1738902457 tempest-QuotaClassesAdmin257Test-1738902457-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.138176 Oct 10 23:17:10.159238 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 100/198] 10.222.0.23 () {62 vars in 1247 bytes} [Mon Oct 10 23:17:10 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:17:10.289116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7cf24617-520a-4031-8df5-187cf7dbed3e tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:10.306487 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7cf24617-520a-4031-8df5-187cf7dbed3e tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 200 len: 1475 microversion: 2.1 time: 0.380154 Oct 10 23:17:10.308752 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 99/199] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:09 2022] GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 1475 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:10.336635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6f913114-6b8c-4525-9663-e029919cfec2 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Calling method '.version_select at 0x7f66303da310>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:10.347665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f913114-6b8c-4525-9663-e029919cfec2 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:10.350845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f913114-6b8c-4525-9663-e029919cfec2 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:10.353720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f913114-6b8c-4525-9663-e029919cfec2 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:10.373568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:10.433471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f913114-6b8c-4525-9663-e029919cfec2 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:10.434790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f913114-6b8c-4525-9663-e029919cfec2 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:10.435342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f913114-6b8c-4525-9663-e029919cfec2 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:10.446581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f913114-6b8c-4525-9663-e029919cfec2 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:10.447068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f913114-6b8c-4525-9663-e029919cfec2 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:10.448658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f913114-6b8c-4525-9663-e029919cfec2 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:10.475723 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6f913114-6b8c-4525-9663-e029919cfec2 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.164460 Oct 10 23:17:10.478224 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 100/200] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:17:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:10.489792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e54b95c3-367c-4191-a1c9-e53dc698f8c3 tempest-HypervisorAdminNegativeUnderV252Test-497134694 tempest-HypervisorAdminNegativeUnderV252Test-497134694-project] Calling method '.version_select at 0x7f663175dca0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:10.492042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e54b95c3-367c-4191-a1c9-e53dc698f8c3 tempest-HypervisorAdminNegativeUnderV252Test-497134694 tempest-HypervisorAdminNegativeUnderV252Test-497134694-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'cf725e7c4f9b43669b60f25545e0e0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98fb13e49845480a90f5e721f92f176e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:10.496190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e54b95c3-367c-4191-a1c9-e53dc698f8c3 tempest-HypervisorAdminNegativeUnderV252Test-497134694 tempest-HypervisorAdminNegativeUnderV252Test-497134694-project] Request method failure captured: Oct 10 23:17:10.496190 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 10 23:17:10.496190 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:17:10.496190 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:17:10.496190 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:17:10.496190 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:17:10.496190 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:17:10.496190 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:17:10.496190 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:17:10.496190 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:10.496190 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKfx1NaT3kDxdgrGCdp20jcOPRpiCTGPIiJefZDdxHv4IDJB8izd8AgCgmHiNqX-CBM0uzOp1iNbWw_4LcR6Eh8l9qscwNxg_5LQ06DW1jjytutbwWc99eqSOPxIRc6gE1SHOqMpO1-Cea8YxkcS5QeLJzPNOU7swKl9zNeFEy4Zr4M Oct 10 23:17:10.496190 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:17:10.496190 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:17:10.496190 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:17:10.496190 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:17:10.496190 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:17:10.496190 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:17:10.496190 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 98fb13e49845480a90f5e721f92f176e Oct 10 23:17:10.496190 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-497134694 Oct 10 23:17:10.496190 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:17:10.496190 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:17:10.498250 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/98fb13e49845480a90f5e721f92f176e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/98fb13e49845480a90f5e721f92f176e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/98fb13e49845480a90f5e721f92f176e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_98fb13e49845480a90f5e721f92f176e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:10.498250 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-497134694 Oct 10 23:17:10.498250 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 98fb13e49845480a90f5e721f92f176e Oct 10 23:17:10.498250 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-497134694 Oct 10 23:17:10.498250 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-497134694-project Oct 10 23:17:10.498250 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:17:10.498250 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:17:10.498250 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: cf725e7c4f9b43669b60f25545e0e0dc Oct 10 23:17:10.498250 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-497134694-project Oct 10 23:17:10.498250 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:17:10.498250 n-d-860864-2 devstack@n-api.service[120614]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 10 23:17:10.498250 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '1'} Oct 10 23:17:10.499130 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:10.499130 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:10.499130 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:10.499130 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:10.499130 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:10.499130 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:10.499130 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:17:10.499130 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:17:10.499130 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:10.499130 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:10.499130 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 10 23:17:10.499130 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 10 23:17:10.499130 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:17:10.499130 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:17:10.499130 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:17:10.499130 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:17:10.499130 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:17:10.499130 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:17:10.499130 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:17:10.500363 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:17:10.500363 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:17:10.500363 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:17:10.500363 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:17:10.500363 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:17:10.500363 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:17:10.500363 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:17:10.500363 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 10 23:17:10.500363 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:10.500363 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:10.500363 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:10.500363 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:10.500363 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:10.500363 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:10.500363 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:17:10.500363 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:17:10.500363 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 10 23:17:10.500363 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:10.506371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e54b95c3-367c-4191-a1c9-e53dc698f8c3 tempest-HypervisorAdminNegativeUnderV252Test-497134694 tempest-HypervisorAdminNegativeUnderV252Test-497134694-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:10.508012 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e54b95c3-367c-4191-a1c9-e53dc698f8c3 tempest-HypervisorAdminNegativeUnderV252Test-497134694 tempest-HypervisorAdminNegativeUnderV252Test-497134694-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.022818 Oct 10 23:17:10.509029 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 101/201] 10.222.0.23 () {58 vars in 1176 bytes} [Mon Oct 10 23:17:10 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:17:10.522807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3cde276a-4cb0-42ef-bca2-672f8f8c0274 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Calling method '.version_select at 0x7f66303ed550>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:10.530196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3cde276a-4cb0-42ef-bca2-672f8f8c0274 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:10.532069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3cde276a-4cb0-42ef-bca2-672f8f8c0274 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:10.535080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3cde276a-4cb0-42ef-bca2-672f8f8c0274 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:10.565450 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-3cde276a-4cb0-42ef-bca2-672f8f8c0274 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] HTTP exception thrown: No hypervisor matching 'b8638795-157c-4ef2-91e8-92f5b5797aa9' could be found. Oct 10 23:17:10.568585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3cde276a-4cb0-42ef-bca2-672f8f8c0274 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Request method failure captured: Oct 10 23:17:10.568585 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/os-hypervisors/b8638795-157c-4ef2-91e8-92f5b5797aa9/servers HTTP/1.1 Oct 10 23:17:10.568585 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:17:10.568585 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:17:10.568585 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:17:10.568585 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:17:10.568585 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:17:10.568585 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:17:10.568585 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:17:10.568585 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:10.568585 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKfzU8SprZUuNbkqJf0bxHXpovcZcj8Ae6_q219elftUlsJRIcGWG-rY5DhUJauoNm2FrpjwHHlp2SP3twxW2KIYWeO2Nyp7JpYC1hfqPL_Mox_pp3_F_eV-3F61Y_azH7tGmq8_Eoil3IdP4cSnxhSRTg0RIlf45qLaDKXGb_2RYJ8 Oct 10 23:17:10.568585 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:17:10.568585 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:17:10.568585 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:17:10.568585 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:17:10.568585 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:17:10.568585 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:17:10.568585 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 590b05f6d29246d2a30b7ca37e7fe99b Oct 10 23:17:10.568585 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1910720206 Oct 10 23:17:10.568585 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:17:10.568585 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:17:10.569896 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/590b05f6d29246d2a30b7ca37e7fe99b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/590b05f6d29246d2a30b7ca37e7fe99b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/590b05f6d29246d2a30b7ca37e7fe99b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_590b05f6d29246d2a30b7ca37e7fe99b", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:10.569896 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1910720206 Oct 10 23:17:10.569896 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 590b05f6d29246d2a30b7ca37e7fe99b Oct 10 23:17:10.569896 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1910720206 Oct 10 23:17:10.569896 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin Oct 10 23:17:10.569896 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:17:10.569896 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:17:10.569896 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 59f50b5d85864dcf80c1680305424d23 Oct 10 23:17:10.569896 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin Oct 10 23:17:10.569896 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:17:10.569896 n-d-860864-2 devstack@n-api.service[120614]: exception: No hypervisor matching 'b8638795-157c-4ef2-91e8-92f5b5797aa9' could be found. Oct 10 23:17:10.569896 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'b8638795-157c-4ef2-91e8-92f5b5797aa9'} Oct 10 23:17:10.570594 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:10.570594 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:10.570594 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:10.570594 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:10.570594 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:10.570594 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:10.570594 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:17:10.570594 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:17:10.570594 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:10.570594 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:10.570594 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 10 23:17:10.570594 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 10 23:17:10.570594 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 10 23:17:10.570594 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 23:17:10.570594 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'b8638795-157c-4ef2-91e8-92f5b5797aa9' could be found. Oct 10 23:17:10.570594 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:10.570594 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:10.570594 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:10.570594 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:10.571614 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:10.571614 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:10.571614 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:10.571614 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:10.571614 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'b8638795-157c-4ef2-91e8-92f5b5797aa9' could be found. Oct 10 23:17:10.571614 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:10.575510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3cde276a-4cb0-42ef-bca2-672f8f8c0274 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] Returning 404 to user: No hypervisor matching 'b8638795-157c-4ef2-91e8-92f5b5797aa9' could be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:10.577645 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3cde276a-4cb0-42ef-bca2-672f8f8c0274 tempest-HypervisorAdminNegativeUnderV252Test-1910720206 tempest-HypervisorAdminNegativeUnderV252Test-1910720206-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/b8638795-157c-4ef2-91e8-92f5b5797aa9/servers" status: 404 len: 123 microversion: 2.1 time: 0.060642 Oct 10 23:17:10.579226 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 102/202] 10.222.0.23 () {58 vars in 1281 bytes} [Mon Oct 10 23:17:10 2022] GET /compute/v2.1/os-hypervisors/b8638795-157c-4ef2-91e8-92f5b5797aa9/servers => generated 123 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:17:10.863583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-a19b3875-3edc-43fd-941c-b456d3c9da29 req-a5ea50e6-fad1-46d9-b326-c6674e437fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc4c250-e3ff-4840-bea2-b40c07049ae4", "name": "network-vif-deleted", "tag": "9ca0dc09-a781-4608-9e31-5f63eec06e8f"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:10.899985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a19b3875-3edc-43fd-941c-b456d3c9da29 req-a5ea50e6-fad1-46d9-b326-c6674e437fc2 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:10.899985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a19b3875-3edc-43fd-941c-b456d3c9da29 req-a5ea50e6-fad1-46d9-b326-c6674e437fc2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:10.899985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a19b3875-3edc-43fd-941c-b456d3c9da29 req-a5ea50e6-fad1-46d9-b326-c6674e437fc2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:10.922618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5fbdbb96-1030-4049-ba33-6e8eb2797b02 tempest-ServersWithSpecificFlavorTestJSON-991659152 tempest-ServersWithSpecificFlavorTestJSON-991659152-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1262011703", "id": 2002068468, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:10.945119 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-a19b3875-3edc-43fd-941c-b456d3c9da29 req-a5ea50e6-fad1-46d9-b326-c6674e437fc2 service nova] Creating event network-vif-deleted:9ca0dc09-a781-4608-9e31-5f63eec06e8f for instance 3cc4c250-e3ff-4840-bea2-b40c07049ae4 on n-h1-860864-2 Oct 10 23:17:10.952517 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5fbdbb96-1030-4049-ba33-6e8eb2797b02 tempest-ServersWithSpecificFlavorTestJSON-991659152 tempest-ServersWithSpecificFlavorTestJSON-991659152-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.791828 Oct 10 23:17:10.957410 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 101/203] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:17:10 2022] POST /compute/v2.1/flavors => generated 425 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:10.973221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9b7a2da2-06d2-4f1b-ba69-ed5ddd611191 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:10.974275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9b7a2da2-06d2-4f1b-ba69-ed5ddd611191 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:10.975121 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-a19b3875-3edc-43fd-941c-b456d3c9da29 req-a5ea50e6-fad1-46d9-b326-c6674e437fc2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127593 Oct 10 23:17:10.979195 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 103/204] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:11.002040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-51e35a1f-91fc-45e4-81a0-9932344f7bce tempest-ServersWithSpecificFlavorTestJSON-991659152 tempest-ServersWithSpecificFlavorTestJSON-991659152-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:11.004857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b7a2da2-06d2-4f1b-ba69-ed5ddd611191 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:11.005760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b7a2da2-06d2-4f1b-ba69-ed5ddd611191 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:11.008605 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b7a2da2-06d2-4f1b-ba69-ed5ddd611191 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:11.010263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b7a2da2-06d2-4f1b-ba69-ed5ddd611191 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:11.011581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b7a2da2-06d2-4f1b-ba69-ed5ddd611191 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:11.013898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b7a2da2-06d2-4f1b-ba69-ed5ddd611191 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:11.035620 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-51e35a1f-91fc-45e4-81a0-9932344f7bce tempest-ServersWithSpecificFlavorTestJSON-991659152 tempest-ServersWithSpecificFlavorTestJSON-991659152-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.055023 Oct 10 23:17:11.036220 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 104/205] 10.222.0.23 () {58 vars in 1182 bytes} [Mon Oct 10 23:17:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:17:11.055590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-abfa4b60-6f53-4e3e-87ba-c03e080fd120 tempest-ServersWithSpecificFlavorTestJSON-991659152 tempest-ServersWithSpecificFlavorTestJSON-991659152-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1483065197", "id": 664831953, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:11.114485 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-abfa4b60-6f53-4e3e-87ba-c03e080fd120 tempest-ServersWithSpecificFlavorTestJSON-991659152 tempest-ServersWithSpecificFlavorTestJSON-991659152-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.071856 Oct 10 23:17:11.118557 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 105/206] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:17:11 2022] POST /compute/v2.1/flavors => generated 422 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:17:11.137134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-38d08b4d-95e1-4a7a-bb64-3dae0e58dd04 tempest-ServersWithSpecificFlavorTestJSON-991659152 tempest-ServersWithSpecificFlavorTestJSON-991659152-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:11.157532 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-38d08b4d-95e1-4a7a-bb64-3dae0e58dd04 tempest-ServersWithSpecificFlavorTestJSON-991659152 tempest-ServersWithSpecificFlavorTestJSON-991659152-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028172 Oct 10 23:17:11.167375 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 106/207] 10.222.0.23 () {58 vars in 1182 bytes} [Mon Oct 10 23:17:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:17:11.182658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c4016ab5-c4e4-4ee9-a099-04a69432fd45 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Action: 'create', calling method: .version_select at 0x7f6630499a60>, body: {"keypair": {"name": "tempest-keypair-589213585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKeII60emA7lNpjQLbgkKwtWfODAsjrVmN9w4ANnR+2LIUEIPD/OREoKAdQav5PpFHMoua8SV+f4UK7d5NOgFvH7wRiGEw6HmoeGseorQvF6A9/XI+F8bh9Od92we/Z6w=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:11.275188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-c4016ab5-c4e4-4ee9-a099-04a69432fd45 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Getting quotas for project 25f3787ea28344e78082ff74d7540f43. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:17:11.288000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-c4016ab5-c4e4-4ee9-a099-04a69432fd45 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Getting quotas for user e6cd6d7dfaeb4ac79fabf16698c60f96 and project 25f3787ea28344e78082ff74d7540f43. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:17:11.362771 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c4016ab5-c4e4-4ee9-a099-04a69432fd45 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.183286 Oct 10 23:17:11.364373 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 107/208] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:17:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:11.377578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6ed84978-a771-49f9-bf17-e390ecbedd14 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Action: 'update', calling method: .version_select at 0x7f6630677ee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:11.440390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9b7a2da2-06d2-4f1b-ba69-ed5ddd611191 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:11.459757 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9b7a2da2-06d2-4f1b-ba69-ed5ddd611191 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1337 microversion: 2.1 time: 0.504542 Oct 10 23:17:11.474314 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 102/209] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:10 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1337 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:11.482873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-95d6699c-77db-4bae-9376-6cdb9bd2f016 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:11.483523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-95d6699c-77db-4bae-9376-6cdb9bd2f016 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:11.500334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95d6699c-77db-4bae-9376-6cdb9bd2f016 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:11.501120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95d6699c-77db-4bae-9376-6cdb9bd2f016 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:11.501821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95d6699c-77db-4bae-9376-6cdb9bd2f016 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:11.502686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95d6699c-77db-4bae-9376-6cdb9bd2f016 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:11.503287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95d6699c-77db-4bae-9376-6cdb9bd2f016 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:11.503860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95d6699c-77db-4bae-9376-6cdb9bd2f016 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:11.562064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95d6699c-77db-4bae-9376-6cdb9bd2f016 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:11.565304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95d6699c-77db-4bae-9376-6cdb9bd2f016 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:11.566474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95d6699c-77db-4bae-9376-6cdb9bd2f016 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:11.567767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-95d6699c-77db-4bae-9376-6cdb9bd2f016 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lazy-loading 'fault' on Instance uuid 3cc4c250-e3ff-4840-bea2-b40c07049ae4 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:17:11.742557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-95d6699c-77db-4bae-9376-6cdb9bd2f016 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:11.750226 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-95d6699c-77db-4bae-9376-6cdb9bd2f016 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 200 len: 1310 microversion: 2.1 time: 0.279849 Oct 10 23:17:11.750792 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 103/210] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:11 2022] GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 1310 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:12.486392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b1959e98-fdf9-4238-999b-0e021d39832c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:12.487073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b1959e98-fdf9-4238-999b-0e021d39832c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:12.501363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1959e98-fdf9-4238-999b-0e021d39832c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:12.503337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1959e98-fdf9-4238-999b-0e021d39832c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:12.504522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1959e98-fdf9-4238-999b-0e021d39832c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:12.506050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1959e98-fdf9-4238-999b-0e021d39832c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:12.508861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1959e98-fdf9-4238-999b-0e021d39832c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:12.511801 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1959e98-fdf9-4238-999b-0e021d39832c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:12.699146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ed84978-a771-49f9-bf17-e390ecbedd14 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:12.700200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ed84978-a771-49f9-bf17-e390ecbedd14 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:12.701824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ed84978-a771-49f9-bf17-e390ecbedd14 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:12.702732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ed84978-a771-49f9-bf17-e390ecbedd14 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:12.704166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ed84978-a771-49f9-bf17-e390ecbedd14 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:12.704779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ed84978-a771-49f9-bf17-e390ecbedd14 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:12.731070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:RELEASE=2,nova_api:SAVEPOINT=1,nova_api:INSERT=3,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:12.806913 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6ed84978-a771-49f9-bf17-e390ecbedd14 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/30611af907f44349a3c0c277fad3dcc2" status: 200 len: 328 microversion: 2.1 time: 1.440212 Oct 10 23:17:12.808359 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 108/211] 10.222.0.23 () {60 vars in 1262 bytes} [Mon Oct 10 23:17:11 2022] PUT /compute/v2.1/os-quota-sets/30611af907f44349a3c0c277fad3dcc2 => generated 328 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:12.814641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7628d860-14c6-4f15-9aa4-0cae162d6f58 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:12.815758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7628d860-14c6-4f15-9aa4-0cae162d6f58 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:12.822863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7628d860-14c6-4f15-9aa4-0cae162d6f58 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:12.823567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7628d860-14c6-4f15-9aa4-0cae162d6f58 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:12.824149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7628d860-14c6-4f15-9aa4-0cae162d6f58 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:12.825058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7628d860-14c6-4f15-9aa4-0cae162d6f58 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:12.826589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7628d860-14c6-4f15-9aa4-0cae162d6f58 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:12.827469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7628d860-14c6-4f15-9aa4-0cae162d6f58 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:12.851818 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-7628d860-14c6-4f15-9aa4-0cae162d6f58 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] HTTP exception thrown: Instance 3cc4c250-e3ff-4840-bea2-b40c07049ae4 could not be found. Oct 10 23:17:12.860272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7628d860-14c6-4f15-9aa4-0cae162d6f58 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Request method failure captured: Oct 10 23:17:12.860272 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 HTTP/1.1 Oct 10 23:17:12.860272 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:17:12.860272 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:17:12.860272 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:17:12.860272 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:17:12.860272 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:17:12.860272 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:17:12.860272 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:17:12.860272 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:12.860272 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKfLvIPfZ_BMiq0h5Pucpt1Y_WPh4mLjby1G972cKbuOkuTqVF0srooqAhXvbFcjhPumBeWxEHnQqJ5xRpRxiIXo9bQF44Y2xIOXG2I-5ccFE9hBd7oufmu4xOFbR3vDejpCUNOrn9f3efj1ap8NMb9iL94gakN-VbhdlKsKVGlYWyQ Oct 10 23:17:12.860272 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:17:12.860272 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:17:12.860272 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:17:12.860272 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:17:12.860272 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:17:12.860272 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:17:12.860272 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 8815288ae4a64e85a32b96bad674513a Oct 10 23:17:12.860272 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-DeleteServersAdminTestJSON-147901847 Oct 10 23:17:12.860272 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:17:12.860272 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:17:12.861954 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8815288ae4a64e85a32b96bad674513a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8815288ae4a64e85a32b96bad674513a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8815288ae4a64e85a32b96bad674513a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8815288ae4a64e85a32b96bad674513a", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:12.861954 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-DeleteServersAdminTestJSON-147901847 Oct 10 23:17:12.861954 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 8815288ae4a64e85a32b96bad674513a Oct 10 23:17:12.861954 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-147901847 Oct 10 23:17:12.861954 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-DeleteServersAdminTestJSON-147901847-project Oct 10 23:17:12.861954 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:17:12.861954 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:17:12.861954 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: e433528b28f546e4b93bf170af8f6049 Oct 10 23:17:12.861954 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-DeleteServersAdminTestJSON-147901847-project Oct 10 23:17:12.861954 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:17:12.861954 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 3cc4c250-e3ff-4840-bea2-b40c07049ae4 could not be found. Oct 10 23:17:12.861954 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '3cc4c250-e3ff-4840-bea2-b40c07049ae4'} Oct 10 23:17:12.862916 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:12.862916 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:12.862916 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:17:12.862916 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:17:12.862916 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:17:12.862916 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:17:12.862916 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:17:12.862916 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:17:12.862916 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:17:12.862916 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:17:12.862916 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cc4c250-e3ff-4840-bea2-b40c07049ae4 could not be found. Oct 10 23:17:12.862916 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:12.862916 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:12.862916 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:12.862916 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:12.862916 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:12.862916 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:12.862916 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:12.862916 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:12.862916 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:12.864232 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:12.864232 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:17:12.864232 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:17:12.864232 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:17:12.864232 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:17:12.864232 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:17:12.864232 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:17:12.864232 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cc4c250-e3ff-4840-bea2-b40c07049ae4 could not be found. Oct 10 23:17:12.864232 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:12.864232 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:12.864232 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:12.864232 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:12.864232 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:12.864232 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:12.864232 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:12.864232 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:12.864232 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cc4c250-e3ff-4840-bea2-b40c07049ae4 could not be found. Oct 10 23:17:12.864232 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:12.870291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7628d860-14c6-4f15-9aa4-0cae162d6f58 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Returning 404 to user: Instance 3cc4c250-e3ff-4840-bea2-b40c07049ae4 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:12.871329 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7628d860-14c6-4f15-9aa4-0cae162d6f58 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 404 len: 111 microversion: 2.1 time: 0.061641 Oct 10 23:17:12.875989 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 109/212] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:12 2022] GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:17:12.913736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b410cbcb-6d8f-48dc-bdac-17d679de56a8 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Calling method '.version_select at 0x7f6630304790>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:13.437072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b410cbcb-6d8f-48dc-bdac-17d679de56a8 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:13.437886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b1959e98-fdf9-4238-999b-0e021d39832c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:13.438274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b410cbcb-6d8f-48dc-bdac-17d679de56a8 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:13.438726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b410cbcb-6d8f-48dc-bdac-17d679de56a8 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:13.445490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b410cbcb-6d8f-48dc-bdac-17d679de56a8 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:13.446089 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b410cbcb-6d8f-48dc-bdac-17d679de56a8 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:13.446544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b410cbcb-6d8f-48dc-bdac-17d679de56a8 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:13.449610 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b1959e98-fdf9-4238-999b-0e021d39832c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1487 microversion: 2.1 time: 0.967018 Oct 10 23:17:13.473073 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 104/213] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:12 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1487 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:13.483244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4c9f25ce-c206-4e54-8f62-018bd303566b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-3436419", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:13.532205 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b410cbcb-6d8f-48dc-bdac-17d679de56a8 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/30611af907f44349a3c0c277fad3dcc2/detail" status: 200 len: 916 microversion: 2.1 time: 0.654694 Oct 10 23:17:13.532838 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 110/214] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 10 23:17:12 2022] GET /compute/v2.1/os-quota-sets/30611af907f44349a3c0c277fad3dcc2/detail => generated 916 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:13.546326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c19d2e42-9f36-4a06-b37c-7a77a20aa759 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:13.547620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c19d2e42-9f36-4a06-b37c-7a77a20aa759 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:13.569424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c19d2e42-9f36-4a06-b37c-7a77a20aa759 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:13.569917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c19d2e42-9f36-4a06-b37c-7a77a20aa759 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:13.572856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c19d2e42-9f36-4a06-b37c-7a77a20aa759 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:13.573628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c19d2e42-9f36-4a06-b37c-7a77a20aa759 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:13.574103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c19d2e42-9f36-4a06-b37c-7a77a20aa759 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:13.587162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c19d2e42-9f36-4a06-b37c-7a77a20aa759 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:13.619391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-4c9f25ce-c206-4e54-8f62-018bd303566b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] validate_networks() for None {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:17:14.606129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-4c9f25ce-c206-4e54-8f62-018bd303566b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:17:14.606739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-4c9f25ce-c206-4e54-8f62-018bd303566b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:17:14.607785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-4c9f25ce-c206-4e54-8f62-018bd303566b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:17:14.608274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-4c9f25ce-c206-4e54-8f62-018bd303566b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:17:14.608777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-4c9f25ce-c206-4e54-8f62-018bd303566b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:17:14.640703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c9f25ce-c206-4e54-8f62-018bd303566b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:14.641211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c9f25ce-c206-4e54-8f62-018bd303566b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:14.641641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c9f25ce-c206-4e54-8f62-018bd303566b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:14.641830 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c19d2e42-9f36-4a06-b37c-7a77a20aa759 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1638 microversion: 2.1 time: 1.097387 Oct 10 23:17:14.645266 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 111/215] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:13 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1638 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:14.647758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c9f25ce-c206-4e54-8f62-018bd303566b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:14.648251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c9f25ce-c206-4e54-8f62-018bd303566b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:14.648700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c9f25ce-c206-4e54-8f62-018bd303566b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:14.662290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-da2389cf-cc00-4a2c-98de-1c77e4ccfbc7 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Action: 'update', calling method: .version_select at 0x7f6630292040>, body: {"quota_set": {"ram": "2048"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:14.724446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-4c9f25ce-c206-4e54-8f62-018bd303566b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Getting quotas for project 8815288ae4a64e85a32b96bad674513a. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:17:14.736892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-4c9f25ce-c206-4e54-8f62-018bd303566b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Getting quotas for user e433528b28f546e4b93bf170af8f6049 and project 8815288ae4a64e85a32b96bad674513a. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:17:14.772183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4c9f25ce-c206-4e54-8f62-018bd303566b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:17:14.782948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4c9f25ce-c206-4e54-8f62-018bd303566b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3b9a7c40-1a80-4be4-ba69-71487800d1f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:17:14.909502 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4c9f25ce-c206-4e54-8f62-018bd303566b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.434419 Oct 10 23:17:14.915809 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 105/216] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:17:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:17:14.918309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c318c4db-ad02-4a81-9a72-4d23c04e904a tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:14.920549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c318c4db-ad02-4a81-9a72-4d23c04e904a tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:14.930279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c318c4db-ad02-4a81-9a72-4d23c04e904a tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:14.930783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c318c4db-ad02-4a81-9a72-4d23c04e904a tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:14.932216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c318c4db-ad02-4a81-9a72-4d23c04e904a tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:14.933430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c318c4db-ad02-4a81-9a72-4d23c04e904a tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:14.934496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c318c4db-ad02-4a81-9a72-4d23c04e904a tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:14.935699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c318c4db-ad02-4a81-9a72-4d23c04e904a tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:15.065249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c318c4db-ad02-4a81-9a72-4d23c04e904a tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:17:15.337196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da2389cf-cc00-4a2c-98de-1c77e4ccfbc7 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:15.338163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da2389cf-cc00-4a2c-98de-1c77e4ccfbc7 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:15.339105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da2389cf-cc00-4a2c-98de-1c77e4ccfbc7 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:15.340081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da2389cf-cc00-4a2c-98de-1c77e4ccfbc7 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:15.340745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da2389cf-cc00-4a2c-98de-1c77e4ccfbc7 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:15.341936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da2389cf-cc00-4a2c-98de-1c77e4ccfbc7 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:15.390425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da2389cf-cc00-4a2c-98de-1c77e4ccfbc7 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:15.391580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da2389cf-cc00-4a2c-98de-1c77e4ccfbc7 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:15.392235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da2389cf-cc00-4a2c-98de-1c77e4ccfbc7 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:15.394363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da2389cf-cc00-4a2c-98de-1c77e4ccfbc7 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:15.395046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da2389cf-cc00-4a2c-98de-1c77e4ccfbc7 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:15.395681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da2389cf-cc00-4a2c-98de-1c77e4ccfbc7 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:15.500356 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-da2389cf-cc00-4a2c-98de-1c77e4ccfbc7 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/30611af907f44349a3c0c277fad3dcc2?user_id=d264eaa16c2441ed858e0c88d8fc5e45" status: 200 len: 328 microversion: 2.1 time: 0.853526 Oct 10 23:17:15.509723 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 112/217] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Oct 10 23:17:14 2022] PUT /compute/v2.1/os-quota-sets/30611af907f44349a3c0c277fad3dcc2?user_id=d264eaa16c2441ed858e0c88d8fc5e45 => generated 328 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:15.519450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-87b9e497-4686-4ddb-91b3-d76069ec8c63 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:15.520372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-87b9e497-4686-4ddb-91b3-d76069ec8c63 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3b9a7c40-1a80-4be4-ba69-71487800d1f5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:15.611572 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c318c4db-ad02-4a81-9a72-4d23c04e904a tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "DELETE /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 204 len: 0 microversion: 2.1 time: 0.698991 Oct 10 23:17:15.612649 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 106/218] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:17:14 2022] DELETE /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 0 bytes in 702 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:17:15.624564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9752975e-de0e-44ce-a810-7f7c2786ab74 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Calling method '.version_select at 0x7f66303c6ca0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:15.729938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-87b9e497-4686-4ddb-91b3-d76069ec8c63 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:15.745620 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-87b9e497-4686-4ddb-91b3-d76069ec8c63 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5" status: 200 len: 1217 microversion: 2.1 time: 0.231105 Oct 10 23:17:15.746221 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 113/219] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:15 2022] GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5 => generated 1217 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:15.755683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d2ed52ed-e80b-43e2-abc7-fc8dc5c810c8 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:15.756572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d2ed52ed-e80b-43e2-abc7-fc8dc5c810c8 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:15.785939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2ed52ed-e80b-43e2-abc7-fc8dc5c810c8 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:15.786864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2ed52ed-e80b-43e2-abc7-fc8dc5c810c8 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:15.787944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2ed52ed-e80b-43e2-abc7-fc8dc5c810c8 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:15.790263 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2ed52ed-e80b-43e2-abc7-fc8dc5c810c8 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:15.793064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2ed52ed-e80b-43e2-abc7-fc8dc5c810c8 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:15.795328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2ed52ed-e80b-43e2-abc7-fc8dc5c810c8 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:16.264754 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d2ed52ed-e80b-43e2-abc7-fc8dc5c810c8 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:16.298532 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d2ed52ed-e80b-43e2-abc7-fc8dc5c810c8 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1493 microversion: 2.1 time: 0.551107 Oct 10 23:17:16.301231 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 114/220] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:15 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1493 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:16.317732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-89779413-6e1d-4fbc-b571-42fbaed5cb3b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-464229767", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "664831953", "adminPass": "***", "networks": [{"uuid": "bd3fa17b-fc0e-4718-b288-41305d8c3332"}], "security_groups": [{"name": "tempest-securitygroup--872600194"}], "key_name": "tempest-keypair-589213585", "user_data": "}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:16.555226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-89779413-6e1d-4fbc-b571-42fbaed5cb3b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] validate_networks() for [('bd3fa17b-fc0e-4718-b288-41305d8c3332', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:17:16.667620 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9752975e-de0e-44ce-a810-7f7c2786ab74 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/30611af907f44349a3c0c277fad3dcc2?user_id=d264eaa16c2441ed858e0c88d8fc5e45" status: 200 len: 370 microversion: 2.1 time: 1.049421 Oct 10 23:17:16.680138 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 107/221] 10.222.0.23 () {58 vars in 1323 bytes} [Mon Oct 10 23:17:15 2022] GET /compute/v2.1/os-quota-sets/30611af907f44349a3c0c277fad3dcc2?user_id=d264eaa16c2441ed858e0c88d8fc5e45 => generated 370 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:16.768789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9688238d-3da7-4b83-8eb5-a0899a93a2bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:16.769764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9688238d-3da7-4b83-8eb5-a0899a93a2bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3b9a7c40-1a80-4be4-ba69-71487800d1f5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:16.782813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9688238d-3da7-4b83-8eb5-a0899a93a2bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:16.783317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9688238d-3da7-4b83-8eb5-a0899a93a2bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:16.783761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9688238d-3da7-4b83-8eb5-a0899a93a2bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:16.784474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9688238d-3da7-4b83-8eb5-a0899a93a2bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:16.784930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9688238d-3da7-4b83-8eb5-a0899a93a2bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:16.785361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9688238d-3da7-4b83-8eb5-a0899a93a2bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:16.934251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9688238d-3da7-4b83-8eb5-a0899a93a2bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:16.957841 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9688238d-3da7-4b83-8eb5-a0899a93a2bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5" status: 200 len: 1269 microversion: 2.1 time: 0.187006 Oct 10 23:17:16.959071 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 108/222] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:16 2022] GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5 => generated 1269 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:17:17.329414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8584841b-33cb-4730-b11b-443eb58634bb tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:17.330039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8584841b-33cb-4730-b11b-443eb58634bb tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:17.348048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8584841b-33cb-4730-b11b-443eb58634bb tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:17.348717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8584841b-33cb-4730-b11b-443eb58634bb tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:17.349238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8584841b-33cb-4730-b11b-443eb58634bb tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:17.350130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8584841b-33cb-4730-b11b-443eb58634bb tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:17.354171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8584841b-33cb-4730-b11b-443eb58634bb tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:17.359826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8584841b-33cb-4730-b11b-443eb58634bb tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:18.039400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8584841b-33cb-4730-b11b-443eb58634bb tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:18.053177 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8584841b-33cb-4730-b11b-443eb58634bb tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1493 microversion: 2.1 time: 0.725079 Oct 10 23:17:18.054918 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 109/223] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:17 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1493 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:18.067907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3d26d3e7-d48a-487d-95b0-91a1b6745c67 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Calling method '.version_select at 0x7f66303e7a60>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:18.803347 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3d26d3e7-d48a-487d-95b0-91a1b6745c67 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/f8c6041207d24dee830c7e38255250b6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.745382 Oct 10 23:17:18.808476 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 110/224] 10.222.0.23 () {58 vars in 1269 bytes} [Mon Oct 10 23:17:18 2022] GET /compute/v2.1/os-quota-sets/f8c6041207d24dee830c7e38255250b6/defaults => generated 371 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:18.828896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4ebe40b5-f7d2-4406-8b73-40ee0f5bff27 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:18.831977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4ebe40b5-f7d2-4406-8b73-40ee0f5bff27 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3b9a7c40-1a80-4be4-ba69-71487800d1f5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:18.848112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ebe40b5-f7d2-4406-8b73-40ee0f5bff27 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:18.850573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ebe40b5-f7d2-4406-8b73-40ee0f5bff27 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:18.852845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ebe40b5-f7d2-4406-8b73-40ee0f5bff27 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:18.855792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ebe40b5-f7d2-4406-8b73-40ee0f5bff27 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:18.864023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ebe40b5-f7d2-4406-8b73-40ee0f5bff27 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:18.865125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ebe40b5-f7d2-4406-8b73-40ee0f5bff27 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:18.895152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:19.167375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-89779413-6e1d-4fbc-b571-42fbaed5cb3b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:17:19.168794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-89779413-6e1d-4fbc-b571-42fbaed5cb3b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:17:19.169725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-89779413-6e1d-4fbc-b571-42fbaed5cb3b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:17:19.171076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-89779413-6e1d-4fbc-b571-42fbaed5cb3b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:17:19.171664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-89779413-6e1d-4fbc-b571-42fbaed5cb3b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:17:19.198177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89779413-6e1d-4fbc-b571-42fbaed5cb3b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:19.199610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89779413-6e1d-4fbc-b571-42fbaed5cb3b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:19.200053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89779413-6e1d-4fbc-b571-42fbaed5cb3b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:19.203527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89779413-6e1d-4fbc-b571-42fbaed5cb3b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:19.204244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89779413-6e1d-4fbc-b571-42fbaed5cb3b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:19.204683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89779413-6e1d-4fbc-b571-42fbaed5cb3b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:19.275433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-89779413-6e1d-4fbc-b571-42fbaed5cb3b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Getting quotas for project 25f3787ea28344e78082ff74d7540f43. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:17:19.305644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-89779413-6e1d-4fbc-b571-42fbaed5cb3b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Getting quotas for user e6cd6d7dfaeb4ac79fabf16698c60f96 and project 25f3787ea28344e78082ff74d7540f43. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:17:19.337016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-89779413-6e1d-4fbc-b571-42fbaed5cb3b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:17:19.340633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-89779413-6e1d-4fbc-b571-42fbaed5cb3b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: 12574d37-08bd-4e05-8953-e2e680ebee8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:17:19.438990 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-89779413-6e1d-4fbc-b571-42fbaed5cb3b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.134008 Oct 10 23:17:19.440266 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 115/225] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:17:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 3138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:17:19.448719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4cf73578-1a7a-4a15-9c44-9636972d8935 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Action: 'update', calling method: .version_select at 0x7f66302bd310>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:19.643848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4ebe40b5-f7d2-4406-8b73-40ee0f5bff27 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:19.660697 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4ebe40b5-f7d2-4406-8b73-40ee0f5bff27 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5" status: 200 len: 1317 microversion: 2.1 time: 0.849342 Oct 10 23:17:19.663234 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 111/226] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:18 2022] GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5 => generated 1317 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:19.678430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c77ae899-eec0-4f57-bc22-dd247b9d067c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:19.683884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c77ae899-eec0-4f57-bc22-dd247b9d067c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:19.709568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c77ae899-eec0-4f57-bc22-dd247b9d067c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:19.710092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c77ae899-eec0-4f57-bc22-dd247b9d067c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:19.710505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c77ae899-eec0-4f57-bc22-dd247b9d067c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:19.711249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c77ae899-eec0-4f57-bc22-dd247b9d067c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:19.711712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c77ae899-eec0-4f57-bc22-dd247b9d067c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:19.712141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c77ae899-eec0-4f57-bc22-dd247b9d067c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:20.160606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c77ae899-eec0-4f57-bc22-dd247b9d067c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c7c0c5c6a34d429fcc76135bdae5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bbffb85d0c4d51b038cf010f9ffa84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:20.174707 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c77ae899-eec0-4f57-bc22-dd247b9d067c tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 200 len: 1451 microversion: 2.1 time: 0.509251 Oct 10 23:17:20.175477 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 112/227] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:19 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 1451 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:20.213486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6fb7d946-c8c8-493c-befe-1d1c4dd780f5 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:20.224395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6fb7d946-c8c8-493c-befe-1d1c4dd780f5 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: 12574d37-08bd-4e05-8953-e2e680ebee8c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:20.442810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cf73578-1a7a-4a15-9c44-9636972d8935 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:20.444479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cf73578-1a7a-4a15-9c44-9636972d8935 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:20.446398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cf73578-1a7a-4a15-9c44-9636972d8935 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:20.449955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6fb7d946-c8c8-493c-befe-1d1c4dd780f5 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:20.452646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cf73578-1a7a-4a15-9c44-9636972d8935 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:20.454600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cf73578-1a7a-4a15-9c44-9636972d8935 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:20.460953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cf73578-1a7a-4a15-9c44-9636972d8935 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:20.464845 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6fb7d946-c8c8-493c-befe-1d1c4dd780f5 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c" status: 200 len: 1261 microversion: 2.1 time: 0.286648 Oct 10 23:17:20.477482 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 113/228] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:20 2022] GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c => generated 1261 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:20.484308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-913dd597-c32b-44bb-98a9-5a6557a3b2be req-9c85c0db-37e8-42bc-9ded-cc180cf4e89e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41c23198-c951-4c85-b87c-6f10d6835eaf", "name": "network-vif-deleted", "tag": "470aa439-6a67-49f6-bdd4-ca7adc5d67b5"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:20.544630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-913dd597-c32b-44bb-98a9-5a6557a3b2be req-9c85c0db-37e8-42bc-9ded-cc180cf4e89e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:20.545311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-913dd597-c32b-44bb-98a9-5a6557a3b2be req-9c85c0db-37e8-42bc-9ded-cc180cf4e89e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:20.548578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-913dd597-c32b-44bb-98a9-5a6557a3b2be req-9c85c0db-37e8-42bc-9ded-cc180cf4e89e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:20.613914 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-913dd597-c32b-44bb-98a9-5a6557a3b2be req-9c85c0db-37e8-42bc-9ded-cc180cf4e89e service nova] Creating event network-vif-deleted:470aa439-6a67-49f6-bdd4-ca7adc5d67b5 for instance 41c23198-c951-4c85-b87c-6f10d6835eaf on n-h2-860864-2 Oct 10 23:17:20.641731 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-913dd597-c32b-44bb-98a9-5a6557a3b2be req-9c85c0db-37e8-42bc-9ded-cc180cf4e89e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168258 Oct 10 23:17:20.645064 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 114/229] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:20.688830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b9e982e7-5d62-4333-98b6-7730d8e4db69 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:20.694818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b9e982e7-5d62-4333-98b6-7730d8e4db69 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3b9a7c40-1a80-4be4-ba69-71487800d1f5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:20.720157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9e982e7-5d62-4333-98b6-7730d8e4db69 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:20.723425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9e982e7-5d62-4333-98b6-7730d8e4db69 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:20.724625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9e982e7-5d62-4333-98b6-7730d8e4db69 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:20.732552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9e982e7-5d62-4333-98b6-7730d8e4db69 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:20.737239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9e982e7-5d62-4333-98b6-7730d8e4db69 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:20.739111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9e982e7-5d62-4333-98b6-7730d8e4db69 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:20.972088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=18 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:21.019490 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4cf73578-1a7a-4a15-9c44-9636972d8935 tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/f8c6041207d24dee830c7e38255250b6" status: 200 len: 329 microversion: 2.1 time: 1.576895 Oct 10 23:17:21.022565 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 116/230] 10.222.0.23 () {60 vars in 1263 bytes} [Mon Oct 10 23:17:19 2022] PUT /compute/v2.1/os-quota-sets/f8c6041207d24dee830c7e38255250b6 => generated 329 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:21.029019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-90578cdd-702c-4540-b363-69f40851752b req-f358b89e-679b-4c15-bc8a-6001bdc5e0d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b9a7c40-1a80-4be4-ba69-71487800d1f5", "tag": "1ceac712-6e6b-44a9-908f-d81d757aa539"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:21.055104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-90578cdd-702c-4540-b363-69f40851752b req-f358b89e-679b-4c15-bc8a-6001bdc5e0d9 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:21.056552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-90578cdd-702c-4540-b363-69f40851752b req-f358b89e-679b-4c15-bc8a-6001bdc5e0d9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:21.058505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-90578cdd-702c-4540-b363-69f40851752b req-f358b89e-679b-4c15-bc8a-6001bdc5e0d9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:21.083522 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-90578cdd-702c-4540-b363-69f40851752b req-f358b89e-679b-4c15-bc8a-6001bdc5e0d9 service nova] Creating event network-changed:1ceac712-6e6b-44a9-908f-d81d757aa539 for instance 3b9a7c40-1a80-4be4-ba69-71487800d1f5 on n-h1-860864-2 Oct 10 23:17:21.092041 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-90578cdd-702c-4540-b363-69f40851752b req-f358b89e-679b-4c15-bc8a-6001bdc5e0d9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067934 Oct 10 23:17:21.098811 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 117/231] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:21.105342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5c7bd989-2aef-4ba9-a3d0-d909c7f03c3c tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Action: 'update', calling method: .version_select at 0x7f6630292940>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:21.432539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b9e982e7-5d62-4333-98b6-7730d8e4db69 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:21.452931 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b9e982e7-5d62-4333-98b6-7730d8e4db69 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5" status: 200 len: 1317 microversion: 2.1 time: 0.768068 Oct 10 23:17:21.454203 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 115/232] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:20 2022] GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5 => generated 1317 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:17:21.567979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c7bd989-2aef-4ba9-a3d0-d909c7f03c3c tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:21.569307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c7bd989-2aef-4ba9-a3d0-d909c7f03c3c tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:21.570158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c7bd989-2aef-4ba9-a3d0-d909c7f03c3c tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:21.571225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c7bd989-2aef-4ba9-a3d0-d909c7f03c3c tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:21.571878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c7bd989-2aef-4ba9-a3d0-d909c7f03c3c tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:21.572456 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c7bd989-2aef-4ba9-a3d0-d909c7f03c3c tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:21.606967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9090a2d7-fbf9-4b84-b31a-16e7977176ab tempest-HypervisorAdminV228Test-437697870 tempest-HypervisorAdminV228Test-437697870-project-admin] Calling method '.version_select at 0x7f66303bdca0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:21.609662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9090a2d7-fbf9-4b84-b31a-16e7977176ab tempest-HypervisorAdminV228Test-437697870 tempest-HypervisorAdminV228Test-437697870-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:21.610571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9090a2d7-fbf9-4b84-b31a-16e7977176ab tempest-HypervisorAdminV228Test-437697870 tempest-HypervisorAdminV228Test-437697870-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:21.611239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9090a2d7-fbf9-4b84-b31a-16e7977176ab tempest-HypervisorAdminV228Test-437697870 tempest-HypervisorAdminV228Test-437697870-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:21.656128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9090a2d7-fbf9-4b84-b31a-16e7977176ab tempest-HypervisorAdminV228Test-437697870 tempest-HypervisorAdminV228Test-437697870-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:21.658109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9090a2d7-fbf9-4b84-b31a-16e7977176ab tempest-HypervisorAdminV228Test-437697870 tempest-HypervisorAdminV228Test-437697870-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:21.659352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9090a2d7-fbf9-4b84-b31a-16e7977176ab tempest-HypervisorAdminV228Test-437697870 tempest-HypervisorAdminV228Test-437697870-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:21.690303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9090a2d7-fbf9-4b84-b31a-16e7977176ab tempest-HypervisorAdminV228Test-437697870 tempest-HypervisorAdminV228Test-437697870-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:21.692412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9090a2d7-fbf9-4b84-b31a-16e7977176ab tempest-HypervisorAdminV228Test-437697870 tempest-HypervisorAdminV228Test-437697870-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:21.693550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9090a2d7-fbf9-4b84-b31a-16e7977176ab tempest-HypervisorAdminV228Test-437697870 tempest-HypervisorAdminV228Test-437697870-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:21.720388 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9090a2d7-fbf9-4b84-b31a-16e7977176ab tempest-HypervisorAdminV228Test-437697870 tempest-HypervisorAdminV228Test-437697870-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.255790 Oct 10 23:17:21.724429 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 116/233] 10.222.0.23 () {60 vars in 1187 bytes} [Mon Oct 10 23:17:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:17:21.740601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7d6e568f-53e6-4624-a9ec-c9403428bfc4 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:21.743692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7d6e568f-53e6-4624-a9ec-c9403428bfc4 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:21.801820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d6e568f-53e6-4624-a9ec-c9403428bfc4 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:21.802425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d6e568f-53e6-4624-a9ec-c9403428bfc4 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:21.802882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d6e568f-53e6-4624-a9ec-c9403428bfc4 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:21.818956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d6e568f-53e6-4624-a9ec-c9403428bfc4 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:21.819456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d6e568f-53e6-4624-a9ec-c9403428bfc4 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:21.830102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d6e568f-53e6-4624-a9ec-c9403428bfc4 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:21.879605 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-7d6e568f-53e6-4624-a9ec-c9403428bfc4 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] HTTP exception thrown: Instance 41c23198-c951-4c85-b87c-6f10d6835eaf could not be found. Oct 10 23:17:21.889746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7d6e568f-53e6-4624-a9ec-c9403428bfc4 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Request method failure captured: Oct 10 23:17:21.889746 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf HTTP/1.1 Oct 10 23:17:21.889746 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:17:21.889746 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:17:21.889746 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:17:21.889746 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:17:21.889746 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:17:21.889746 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:17:21.889746 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:17:21.889746 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:21.889746 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfMtlbv81fvlKtYKW6wOajkWrTu0IC2zEnoCWGsV-CzpWY6oxUF6K9REpwcqTICtW3eoXo_qzeuAkzN8b3tNhcuGfOz_b7MAUUWLTZ5moYE7TxMSQ3XGMSqczTVAgvbYeR_L7NnQlFeVI_JdtR1eir51R7xAQ-vp522-dDfSusDvjs Oct 10 23:17:21.889746 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:17:21.889746 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:17:21.889746 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:17:21.889746 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:17:21.889746 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:17:21.889746 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:17:21.889746 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 44bbffb85d0c4d51b038cf010f9ffa84 Oct 10 23:17:21.889746 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AggregatesAdminTestJSON-156151763 Oct 10 23:17:21.889746 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:17:21.889746 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:17:21.891469 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/44bbffb85d0c4d51b038cf010f9ffa84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44bbffb85d0c4d51b038cf010f9ffa84"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44bbffb85d0c4d51b038cf010f9ffa84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_44bbffb85d0c4d51b038cf010f9ffa84", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:21.891469 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AggregatesAdminTestJSON-156151763 Oct 10 23:17:21.891469 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 44bbffb85d0c4d51b038cf010f9ffa84 Oct 10 23:17:21.891469 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-156151763 Oct 10 23:17:21.891469 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AggregatesAdminTestJSON-156151763-project Oct 10 23:17:21.891469 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:17:21.891469 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:17:21.891469 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 67c7c0c5c6a34d429fcc76135bdae5e7 Oct 10 23:17:21.891469 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AggregatesAdminTestJSON-156151763-project Oct 10 23:17:21.891469 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:17:21.891469 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 41c23198-c951-4c85-b87c-6f10d6835eaf could not be found. Oct 10 23:17:21.891469 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '41c23198-c951-4c85-b87c-6f10d6835eaf'} Oct 10 23:17:21.892270 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:21.892270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:21.892270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:17:21.892270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:17:21.892270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:17:21.892270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:17:21.892270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:17:21.892270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:17:21.892270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:17:21.892270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:17:21.892270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41c23198-c951-4c85-b87c-6f10d6835eaf could not be found. Oct 10 23:17:21.892270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:21.892270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:21.892270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:21.892270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:21.892270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:21.892270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:21.892270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:21.892270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:21.892270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:21.893395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:21.893395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:17:21.893395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:17:21.893395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:17:21.893395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:17:21.893395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:17:21.893395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:17:21.893395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41c23198-c951-4c85-b87c-6f10d6835eaf could not be found. Oct 10 23:17:21.893395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:21.893395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:21.893395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:21.893395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:21.893395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:21.893395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:21.893395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:21.893395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:21.893395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41c23198-c951-4c85-b87c-6f10d6835eaf could not be found. Oct 10 23:17:21.893395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:21.894511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7d6e568f-53e6-4624-a9ec-c9403428bfc4 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Returning 404 to user: Instance 41c23198-c951-4c85-b87c-6f10d6835eaf could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:21.894511 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7d6e568f-53e6-4624-a9ec-c9403428bfc4 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 404 len: 111 microversion: 2.1 time: 0.164445 Oct 10 23:17:21.899585 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 117/234] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:21 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:17:22.130298 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:22.228979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6306a2c4-ca64-4075-88da-6fc750886739 tempest-SecurityGroupsTestAdminJSON-510928655 tempest-SecurityGroupsTestAdminJSON-510928655-project] Action: 'create', calling method: .version_select at 0x7f663175dca0>, body: {"security_group": {"name": "tempest-securitygroup-1367824419", "description": "tempest-description-1533116084"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:22.272695 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5c7bd989-2aef-4ba9-a3d0-d909c7f03c3c tempest-QuotasAdminTestJSON-918967556 tempest-QuotasAdminTestJSON-918967556-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/f8c6041207d24dee830c7e38255250b6" status: 200 len: 329 microversion: 2.1 time: 1.172215 Oct 10 23:17:22.283972 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 118/235] 10.222.0.23 () {60 vars in 1263 bytes} [Mon Oct 10 23:17:21 2022] PUT /compute/v2.1/os-quota-sets/f8c6041207d24dee830c7e38255250b6 => generated 329 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:22.292672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f88099dc-ed38-46e3-8837-a838fe6d5d22 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:22.301541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f88099dc-ed38-46e3-8837-a838fe6d5d22 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: 12574d37-08bd-4e05-8953-e2e680ebee8c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:22.323914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f88099dc-ed38-46e3-8837-a838fe6d5d22 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:22.330359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f88099dc-ed38-46e3-8837-a838fe6d5d22 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:22.330862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f88099dc-ed38-46e3-8837-a838fe6d5d22 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:22.331621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f88099dc-ed38-46e3-8837-a838fe6d5d22 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:22.332083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f88099dc-ed38-46e3-8837-a838fe6d5d22 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:22.332534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f88099dc-ed38-46e3-8837-a838fe6d5d22 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:22.572998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f88099dc-ed38-46e3-8837-a838fe6d5d22 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:22.585818 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f88099dc-ed38-46e3-8837-a838fe6d5d22 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c" status: 200 len: 1319 microversion: 2.1 time: 0.299452 Oct 10 23:17:22.595148 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 119/236] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:22 2022] GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:22.617414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-047709b8-9109-4db8-b779-2bff9fd1c9f2 tempest-HypervisorAdminV228Test-437697870 tempest-HypervisorAdminV228Test-437697870-project-admin] Calling method '.version_select at 0x7f66302bd160>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:22.620294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-047709b8-9109-4db8-b779-2bff9fd1c9f2 tempest-HypervisorAdminV228Test-437697870 tempest-HypervisorAdminV228Test-437697870-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:22.621060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-047709b8-9109-4db8-b779-2bff9fd1c9f2 tempest-HypervisorAdminV228Test-437697870 tempest-HypervisorAdminV228Test-437697870-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:22.621753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-047709b8-9109-4db8-b779-2bff9fd1c9f2 tempest-HypervisorAdminV228Test-437697870 tempest-HypervisorAdminV228Test-437697870-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:22.653879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-047709b8-9109-4db8-b779-2bff9fd1c9f2 tempest-HypervisorAdminV228Test-437697870 tempest-HypervisorAdminV228Test-437697870-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:22.660665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-047709b8-9109-4db8-b779-2bff9fd1c9f2 tempest-HypervisorAdminV228Test-437697870 tempest-HypervisorAdminV228Test-437697870-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:22.662224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-047709b8-9109-4db8-b779-2bff9fd1c9f2 tempest-HypervisorAdminV228Test-437697870 tempest-HypervisorAdminV228Test-437697870-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:22.686362 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-047709b8-9109-4db8-b779-2bff9fd1c9f2 tempest-HypervisorAdminV228Test-437697870 tempest-HypervisorAdminV228Test-437697870-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 717 microversion: 2.28 time: 0.089628 Oct 10 23:17:22.696487 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 120/237] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Oct 10 23:17:22 2022] GET /compute/v2.1/os-hypervisors/1 => generated 717 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:17:22.729989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0a3fead5-3aea-4e99-85fc-83ce3c9dfa93 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-2"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:22.767394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a3fead5-3aea-4e99-85fc-83ce3c9dfa93 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:22.773880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a3fead5-3aea-4e99-85fc-83ce3c9dfa93 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:22.774666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a3fead5-3aea-4e99-85fc-83ce3c9dfa93 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:23.139916 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0a3fead5-3aea-4e99-85fc-83ce3c9dfa93 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 297 microversion: 2.1 time: 0.428678 Oct 10 23:17:23.148003 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 121/238] 10.222.0.23 () {60 vars in 1191 bytes} [Mon Oct 10 23:17:22 2022] POST /compute/v2.1/os-aggregates/2/action => generated 297 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:23.153331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a47a7cd1-dd27-4c23-9252-60fbd805e933 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:23.158454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a47a7cd1-dd27-4c23-9252-60fbd805e933 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3b9a7c40-1a80-4be4-ba69-71487800d1f5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:23.176597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a47a7cd1-dd27-4c23-9252-60fbd805e933 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:23.177438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a47a7cd1-dd27-4c23-9252-60fbd805e933 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:23.178105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a47a7cd1-dd27-4c23-9252-60fbd805e933 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:23.179031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a47a7cd1-dd27-4c23-9252-60fbd805e933 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:23.179688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a47a7cd1-dd27-4c23-9252-60fbd805e933 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:23.180310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a47a7cd1-dd27-4c23-9252-60fbd805e933 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:23.686803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a47a7cd1-dd27-4c23-9252-60fbd805e933 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:23.702416 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a47a7cd1-dd27-4c23-9252-60fbd805e933 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5" status: 200 len: 1317 microversion: 2.1 time: 0.553005 Oct 10 23:17:23.703007 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 122/239] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:23 2022] GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5 => generated 1317 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:23.719089 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8eee2035-99ad-4067-af62-847ee4b46d86 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:23.781959 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8eee2035-99ad-4067-af62-847ee4b46d86 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.077521 Oct 10 23:17:23.785461 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 123/240] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:17:23 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 23:17:23.791033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a20048e8-8b79-4930-9cf7-62384fc76df7 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:23.791153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a20048e8-8b79-4930-9cf7-62384fc76df7 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: 12574d37-08bd-4e05-8953-e2e680ebee8c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:23.805179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a20048e8-8b79-4930-9cf7-62384fc76df7 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:23.805818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a20048e8-8b79-4930-9cf7-62384fc76df7 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:23.806421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a20048e8-8b79-4930-9cf7-62384fc76df7 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:23.807155 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a20048e8-8b79-4930-9cf7-62384fc76df7 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:23.807882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a20048e8-8b79-4930-9cf7-62384fc76df7 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:23.809539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a20048e8-8b79-4930-9cf7-62384fc76df7 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:23.970171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a20048e8-8b79-4930-9cf7-62384fc76df7 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:23.990467 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a20048e8-8b79-4930-9cf7-62384fc76df7 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c" status: 200 len: 1319 microversion: 2.1 time: 0.206400 Oct 10 23:17:23.991666 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 124/241] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:23 2022] GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:24.005927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7a301344-90e5-41f9-ae54-cc22920b61dc tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1906090056"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:24.009360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.aggregate [None req-7a301344-90e5-41f9-ae54-cc22920b61dc tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Generated uuid 3ce8fdcc-8623-4565-ada7-18ebeccb64d7 for aggregate {{(pid=120614) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 23:17:24.027485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:INSERT=16,nova_api:SELECT=67,nova_api:UPDATE=14,nova_api:DELETE=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:24.050935 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7a301344-90e5-41f9-ae54-cc22920b61dc tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057845 Oct 10 23:17:24.051549 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 125/242] 10.222.0.23 () {60 vars in 1164 bytes} [Mon Oct 10 23:17:23 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:24.063822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ed6d1e68-8f27-4860-8748-2643281b980f tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-2"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:24.082321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed6d1e68-8f27-4860-8748-2643281b980f tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:24.083128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed6d1e68-8f27-4860-8748-2643281b980f tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:24.083725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed6d1e68-8f27-4860-8748-2643281b980f tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:24.226416 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6306a2c4-ca64-4075-88da-6fc750886739 tempest-SecurityGroupsTestAdminJSON-510928655 tempest-SecurityGroupsTestAdminJSON-510928655-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 2.325417 Oct 10 23:17:24.228152 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 118/243] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:17:21 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 2328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:24.242215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-562ba1cf-eace-4ac5-9c2b-6821a1c4a7f4 tempest-SecurityGroupsTestAdminJSON-510928655 tempest-SecurityGroupsTestAdminJSON-510928655-project] Action: 'create', calling method: .version_select at 0x7f6630610670>, body: {"security_group": {"name": "tempest-securitygroup-471173160", "description": "tempest-description-1462697536"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:24.313090 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ed6d1e68-8f27-4860-8748-2643281b980f tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.253380 Oct 10 23:17:24.313996 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 126/244] 10.222.0.23 () {60 vars in 1191 bytes} [Mon Oct 10 23:17:24 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:24.338280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-db5a51ed-c491-4e79-8d77-9c0688509f54 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:24.365812 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-db5a51ed-c491-4e79-8d77-9c0688509f54 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 242 microversion: 2.1 time: 0.042156 Oct 10 23:17:24.366677 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 127/245] 10.222.0.23 () {58 vars in 1149 bytes} [Mon Oct 10 23:17:24 2022] GET /compute/v2.1/os-aggregates/3 => generated 242 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:24.381310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-df623e91-4009-4a2c-93c1-24d63bfc223b tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-2"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:24.400451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df623e91-4009-4a2c-93c1-24d63bfc223b tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:24.401195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df623e91-4009-4a2c-93c1-24d63bfc223b tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:24.401907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df623e91-4009-4a2c-93c1-24d63bfc223b tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:24.604986 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-df623e91-4009-4a2c-93c1-24d63bfc223b tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.228067 Oct 10 23:17:24.615945 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 128/246] 10.222.0.23 () {60 vars in 1191 bytes} [Mon Oct 10 23:17:24 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:24.627129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7f9149a6-0563-4427-bd6e-8543a1d18435 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:24.684030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:24.720466 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7f9149a6-0563-4427-bd6e-8543a1d18435 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.103317 Oct 10 23:17:24.735903 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 129/247] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:17:24 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 23:17:24.745628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f4e23c64-4b3e-4577-b484-3b65a7b982d7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:24.746260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f4e23c64-4b3e-4577-b484-3b65a7b982d7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3b9a7c40-1a80-4be4-ba69-71487800d1f5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:24.756126 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4e23c64-4b3e-4577-b484-3b65a7b982d7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:24.756620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4e23c64-4b3e-4577-b484-3b65a7b982d7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:24.757055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4e23c64-4b3e-4577-b484-3b65a7b982d7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:24.757818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4e23c64-4b3e-4577-b484-3b65a7b982d7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:24.758693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4e23c64-4b3e-4577-b484-3b65a7b982d7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:24.758693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4e23c64-4b3e-4577-b484-3b65a7b982d7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:24.918952 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-562ba1cf-eace-4ac5-9c2b-6821a1c4a7f4 tempest-SecurityGroupsTestAdminJSON-510928655 tempest-SecurityGroupsTestAdminJSON-510928655-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.680676 Oct 10 23:17:24.921127 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 119/248] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:17:24 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:17:24.931003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2b9ed4bf-24ad-4dd3-b4ba-61a3cad7baae tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1474563412"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:24.940119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.aggregate [None req-2b9ed4bf-24ad-4dd3-b4ba-61a3cad7baae tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Generated uuid ecedc34f-e7ea-4401-82d0-a0143b91f0fd for aggregate {{(pid=120613) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 23:17:25.077419 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2b9ed4bf-24ad-4dd3-b4ba-61a3cad7baae tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.154686 Oct 10 23:17:25.086667 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 120/249] 10.222.0.23 () {60 vars in 1164 bytes} [Mon Oct 10 23:17:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:25.502723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6a841938-9a87-4d76-b0cd-7782532a72b9 tempest-SecurityGroupsTestAdminJSON-604164133 tempest-SecurityGroupsTestAdminJSON-604164133-project-admin] Action: 'create', calling method: .version_select at 0x7f66312a9670>, body: {"security_group": {"name": "tempest-securitygroup-718779666", "description": "tempest-description-1111785185"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:25.545981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f4e23c64-4b3e-4577-b484-3b65a7b982d7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:25.559051 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f4e23c64-4b3e-4577-b484-3b65a7b982d7 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5" status: 200 len: 1317 microversion: 2.1 time: 0.817542 Oct 10 23:17:25.562277 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 130/250] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:24 2022] GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5 => generated 1317 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:25.574114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3d35c17b-0205-4082-bffb-2a3702b35f80 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:25.577405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3d35c17b-0205-4082-bffb-2a3702b35f80 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: 12574d37-08bd-4e05-8953-e2e680ebee8c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:25.592907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d35c17b-0205-4082-bffb-2a3702b35f80 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:25.593844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d35c17b-0205-4082-bffb-2a3702b35f80 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:25.596050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d35c17b-0205-4082-bffb-2a3702b35f80 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:25.599604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d35c17b-0205-4082-bffb-2a3702b35f80 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:25.600988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d35c17b-0205-4082-bffb-2a3702b35f80 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:25.603921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d35c17b-0205-4082-bffb-2a3702b35f80 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:26.356508 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6a841938-9a87-4d76-b0cd-7782532a72b9 tempest-SecurityGroupsTestAdminJSON-604164133 tempest-SecurityGroupsTestAdminJSON-604164133-project-admin] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.268172 Oct 10 23:17:26.357369 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 121/251] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:17:25 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:26.361400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3d35c17b-0205-4082-bffb-2a3702b35f80 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:26.370222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-51a0212d-8e8f-4dfb-8c8f-f85ca24364c7 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-2"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:26.371196 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3d35c17b-0205-4082-bffb-2a3702b35f80 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c" status: 200 len: 1386 microversion: 2.1 time: 0.807546 Oct 10 23:17:26.375288 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 131/252] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:25 2022] GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c => generated 1386 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:26.395315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-10e8472e-b72c-425c-868a-abaae55f5f71 tempest-SecurityGroupsTestAdminJSON-604164133 tempest-SecurityGroupsTestAdminJSON-604164133-project-admin] Action: 'create', calling method: .version_select at 0x7f66302bd8b0>, body: {"security_group": {"name": "tempest-securitygroup-2101183103", "description": "tempest-description-267247956"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:26.397047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51a0212d-8e8f-4dfb-8c8f-f85ca24364c7 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:26.398695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51a0212d-8e8f-4dfb-8c8f-f85ca24364c7 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:26.399138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51a0212d-8e8f-4dfb-8c8f-f85ca24364c7 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:26.644560 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-51a0212d-8e8f-4dfb-8c8f-f85ca24364c7 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.278272 Oct 10 23:17:26.645196 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 122/253] 10.222.0.23 () {60 vars in 1191 bytes} [Mon Oct 10 23:17:26 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:26.658838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d11ca8e9-0ea1-493b-a232-c3788b13d1ab tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:26.659550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d11ca8e9-0ea1-493b-a232-c3788b13d1ab tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3b9a7c40-1a80-4be4-ba69-71487800d1f5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:26.673254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d11ca8e9-0ea1-493b-a232-c3788b13d1ab tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:26.673803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d11ca8e9-0ea1-493b-a232-c3788b13d1ab tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:26.674243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d11ca8e9-0ea1-493b-a232-c3788b13d1ab tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:26.674945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d11ca8e9-0ea1-493b-a232-c3788b13d1ab tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:26.675397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d11ca8e9-0ea1-493b-a232-c3788b13d1ab tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:26.675824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d11ca8e9-0ea1-493b-a232-c3788b13d1ab tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:27.116251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d11ca8e9-0ea1-493b-a232-c3788b13d1ab tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:27.126273 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d11ca8e9-0ea1-493b-a232-c3788b13d1ab tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5" status: 200 len: 1317 microversion: 2.1 time: 0.472307 Oct 10 23:17:27.128101 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 123/254] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:26 2022] GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5 => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:27.134594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5bd3bdf6-fcc1-465c-9322-cef6c1d7b770 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:27.153563 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5bd3bdf6-fcc1-465c-9322-cef6c1d7b770 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.023327 Oct 10 23:17:27.155015 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 124/255] 10.222.0.23 () {58 vars in 1143 bytes} [Mon Oct 10 23:17:27 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:27.166719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-88af422a-0855-4276-9c4f-abfb354cac25 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-2"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:27.178924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88af422a-0855-4276-9c4f-abfb354cac25 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:27.179397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88af422a-0855-4276-9c4f-abfb354cac25 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:27.180006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88af422a-0855-4276-9c4f-abfb354cac25 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:27.282855 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-10e8472e-b72c-425c-868a-abaae55f5f71 tempest-SecurityGroupsTestAdminJSON-604164133 tempest-SecurityGroupsTestAdminJSON-604164133-project-admin] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.904324 Oct 10 23:17:27.283463 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 132/256] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:17:26 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:27.296830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bfb9ed5c-52b6-4d5f-9c0e-bed145900f80 tempest-SecurityGroupsTestAdminJSON-604164133 tempest-SecurityGroupsTestAdminJSON-604164133-project-admin] Calling method '.version_select at 0x7f663026d790>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:27.356761 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-88af422a-0855-4276-9c4f-abfb354cac25 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.193539 Oct 10 23:17:27.357822 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 125/257] 10.222.0.23 () {60 vars in 1191 bytes} [Mon Oct 10 23:17:27 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:27.369307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-890815fd-6c9f-4574-afd1-2bcfdc3ff6cf tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:27.406126 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-890815fd-6c9f-4574-afd1-2bcfdc3ff6cf tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.040951 Oct 10 23:17:27.407818 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 126/258] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:17:27 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 10 23:17:27.418183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-66813040-2c96-4d8d-b167-083ad1f3ddaa tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:27.419073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-66813040-2c96-4d8d-b167-083ad1f3ddaa tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: 12574d37-08bd-4e05-8953-e2e680ebee8c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:27.429485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66813040-2c96-4d8d-b167-083ad1f3ddaa tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:27.430277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66813040-2c96-4d8d-b167-083ad1f3ddaa tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:27.431338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66813040-2c96-4d8d-b167-083ad1f3ddaa tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:27.432447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66813040-2c96-4d8d-b167-083ad1f3ddaa tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:27.433646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66813040-2c96-4d8d-b167-083ad1f3ddaa tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:27.435801 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66813040-2c96-4d8d-b167-083ad1f3ddaa tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:28.195963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-66813040-2c96-4d8d-b167-083ad1f3ddaa tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:28.210632 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-66813040-2c96-4d8d-b167-083ad1f3ddaa tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c" status: 200 len: 1386 microversion: 2.1 time: 0.801154 Oct 10 23:17:28.211006 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 127/259] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:27 2022] GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c => generated 1386 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:28.219399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-893569c4-d4e3-40ce-b381-479939b05e6b tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1439512111"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:28.234813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.aggregate [None req-893569c4-d4e3-40ce-b381-479939b05e6b tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Generated uuid c743a48e-2c3c-4226-aa41-c8b9d3b2fb2b for aggregate {{(pid=120613) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 23:17:28.264936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:28.292530 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-893569c4-d4e3-40ce-b381-479939b05e6b tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.079601 Oct 10 23:17:28.293549 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 128/260] 10.222.0.23 () {60 vars in 1164 bytes} [Mon Oct 10 23:17:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:28.306069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-759ec6c6-0bef-4395-ab28-92d14a72b840 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:28.314109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-759ec6c6-0bef-4395-ab28-92d14a72b840 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3b9a7c40-1a80-4be4-ba69-71487800d1f5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:28.328431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-759ec6c6-0bef-4395-ab28-92d14a72b840 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:28.329166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-759ec6c6-0bef-4395-ab28-92d14a72b840 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:28.330654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-759ec6c6-0bef-4395-ab28-92d14a72b840 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:28.331552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-759ec6c6-0bef-4395-ab28-92d14a72b840 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:28.334380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-759ec6c6-0bef-4395-ab28-92d14a72b840 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:28.335050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-759ec6c6-0bef-4395-ab28-92d14a72b840 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:28.680629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-759ec6c6-0bef-4395-ab28-92d14a72b840 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:28.689448 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-759ec6c6-0bef-4395-ab28-92d14a72b840 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5" status: 200 len: 1317 microversion: 2.1 time: 0.387117 Oct 10 23:17:28.700296 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 129/261] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:28 2022] GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5 => generated 1317 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:28.705933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7bdef844-c77c-4838-9efa-86040fc622f2 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-2"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:28.724061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bdef844-c77c-4838-9efa-86040fc622f2 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:28.724560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bdef844-c77c-4838-9efa-86040fc622f2 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:28.724992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bdef844-c77c-4838-9efa-86040fc622f2 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:28.890911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG neutronclient.v2_0.client [None req-bfb9ed5c-52b6-4d5f-9c0e-bed145900f80 tempest-SecurityGroupsTestAdminJSON-604164133 tempest-SecurityGroupsTestAdminJSON-604164133-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0f5b0fc2-faa5-4000-9d6e-58c6d8c31488 does not exist", "detail": ""}} {{(pid=120614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:17:28.896812 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.security_group_api [None req-bfb9ed5c-52b6-4d5f-9c0e-bed145900f80 tempest-SecurityGroupsTestAdminJSON-604164133 tempest-SecurityGroupsTestAdminJSON-604164133-project-admin] Neutron security group 0f5b0fc2-faa5-4000-9d6e-58c6d8c31488 not found {{(pid=120614) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 23:17:28.897363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.compute.security_groups [None req-bfb9ed5c-52b6-4d5f-9c0e-bed145900f80 tempest-SecurityGroupsTestAdminJSON-604164133 tempest-SecurityGroupsTestAdminJSON-604164133-project-admin] Security Group ID 0f5b0fc2-faa5-4000-9d6e-58c6d8c31488 does not exist {{(pid=120614) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Oct 10 23:17:28.962936 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7bdef844-c77c-4838-9efa-86040fc622f2 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 0.260794 Oct 10 23:17:28.971492 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 130/262] 10.222.0.23 () {60 vars in 1191 bytes} [Mon Oct 10 23:17:28 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:28.979176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9b928e88-b5a9-4625-b45c-fa4cded1bc11 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-2"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:29.004094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b928e88-b5a9-4625-b45c-fa4cded1bc11 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:29.006085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b928e88-b5a9-4625-b45c-fa4cded1bc11 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:29.007100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b928e88-b5a9-4625-b45c-fa4cded1bc11 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:29.244517 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9b928e88-b5a9-4625-b45c-fa4cded1bc11 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.271162 Oct 10 23:17:29.245194 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 131/263] 10.222.0.23 () {60 vars in 1191 bytes} [Mon Oct 10 23:17:28 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:29.258822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3adeade3-069f-4926-8fc7-e47346aa9634 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:29.262437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3adeade3-069f-4926-8fc7-e47346aa9634 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: 12574d37-08bd-4e05-8953-e2e680ebee8c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:29.309323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3adeade3-069f-4926-8fc7-e47346aa9634 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:29.310648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3adeade3-069f-4926-8fc7-e47346aa9634 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:29.311268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3adeade3-069f-4926-8fc7-e47346aa9634 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:29.312444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3adeade3-069f-4926-8fc7-e47346aa9634 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:29.313281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3adeade3-069f-4926-8fc7-e47346aa9634 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:29.313923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3adeade3-069f-4926-8fc7-e47346aa9634 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:29.408651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG neutronclient.v2_0.client [None req-bfb9ed5c-52b6-4d5f-9c0e-bed145900f80 tempest-SecurityGroupsTestAdminJSON-604164133 tempest-SecurityGroupsTestAdminJSON-604164133-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0f5b0fc2-faa5-4000-9d6e-58c6d8c31488 does not exist", "detail": ""}} {{(pid=120614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:17:29.410530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.security_group_api [None req-bfb9ed5c-52b6-4d5f-9c0e-bed145900f80 tempest-SecurityGroupsTestAdminJSON-604164133 tempest-SecurityGroupsTestAdminJSON-604164133-project-admin] Neutron security group 0f5b0fc2-faa5-4000-9d6e-58c6d8c31488 not found {{(pid=120614) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 23:17:29.411581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.compute.security_groups [None req-bfb9ed5c-52b6-4d5f-9c0e-bed145900f80 tempest-SecurityGroupsTestAdminJSON-604164133 tempest-SecurityGroupsTestAdminJSON-604164133-project-admin] Security Group ID 0f5b0fc2-faa5-4000-9d6e-58c6d8c31488 does not exist {{(pid=120614) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Oct 10 23:17:30.013225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3adeade3-069f-4926-8fc7-e47346aa9634 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:30.031874 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3adeade3-069f-4926-8fc7-e47346aa9634 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c" status: 200 len: 1386 microversion: 2.1 time: 0.784344 Oct 10 23:17:30.051535 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 132/264] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:29 2022] GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c => generated 1386 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:30.067392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5c6cb97c-6438-45ae-9f9e-0e277a6119ac tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:30.111538 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5c6cb97c-6438-45ae-9f9e-0e277a6119ac tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.058300 Oct 10 23:17:30.119664 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 133/265] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:17:30 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 23:17:30.128941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-6c7e135b-7891-4c99-afaf-1ed383720a28 req-43af22d4-4914-4fa1-855a-5eb42b97fd59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12574d37-08bd-4e05-8953-e2e680ebee8c", "tag": "30719613-9b48-4dc7-8ef2-88f2ccd9e780"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:30.146477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6c7e135b-7891-4c99-afaf-1ed383720a28 req-43af22d4-4914-4fa1-855a-5eb42b97fd59 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:30.147333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6c7e135b-7891-4c99-afaf-1ed383720a28 req-43af22d4-4914-4fa1-855a-5eb42b97fd59 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:30.148044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6c7e135b-7891-4c99-afaf-1ed383720a28 req-43af22d4-4914-4fa1-855a-5eb42b97fd59 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:30.166987 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-6c7e135b-7891-4c99-afaf-1ed383720a28 req-43af22d4-4914-4fa1-855a-5eb42b97fd59 service nova] Creating event network-changed:30719613-9b48-4dc7-8ef2-88f2ccd9e780 for instance 12574d37-08bd-4e05-8953-e2e680ebee8c on n-h1-860864-2 Oct 10 23:17:30.175464 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-6c7e135b-7891-4c99-afaf-1ed383720a28 req-43af22d4-4914-4fa1-855a-5eb42b97fd59 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053925 Oct 10 23:17:30.176653 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 134/266] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:30.183347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0a2b348c-fd85-4a63-9aff-ec3c50af0563 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:30.185641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0a2b348c-fd85-4a63-9aff-ec3c50af0563 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3b9a7c40-1a80-4be4-ba69-71487800d1f5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:30.197992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a2b348c-fd85-4a63-9aff-ec3c50af0563 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:30.198773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a2b348c-fd85-4a63-9aff-ec3c50af0563 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:30.199488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a2b348c-fd85-4a63-9aff-ec3c50af0563 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:30.200626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a2b348c-fd85-4a63-9aff-ec3c50af0563 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:30.204405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a2b348c-fd85-4a63-9aff-ec3c50af0563 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:30.205199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a2b348c-fd85-4a63-9aff-ec3c50af0563 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:30.455849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=36,nova_cell0:UPDATE=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:30.794276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0a2b348c-fd85-4a63-9aff-ec3c50af0563 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:30.807623 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0a2b348c-fd85-4a63-9aff-ec3c50af0563 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5" status: 200 len: 1317 microversion: 2.1 time: 0.628183 Oct 10 23:17:30.821399 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 135/267] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:30 2022] GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5 => generated 1317 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:30.823034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4b5e52fc-06c3-4902-ba4e-5c6f96d1659c tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-755871732"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:30.827881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.aggregate [None req-4b5e52fc-06c3-4902-ba4e-5c6f96d1659c tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Generated uuid dcce1bc5-5737-4325-b80c-4d950f63e538 for aggregate {{(pid=120613) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 23:17:30.881790 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4b5e52fc-06c3-4902-ba4e-5c6f96d1659c tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.062162 Oct 10 23:17:30.882660 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 136/268] 10.222.0.23 () {60 vars in 1164 bytes} [Mon Oct 10 23:17:30 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:31.309401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-36179e05-b6e9-4c13-8504-ea20d4b87940 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Calling method '.version_select at 0x7f66303e70d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:31.425244 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-36179e05-b6e9-4c13-8504-ea20d4b87940 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/7bf9c1068cc5492dadf524865d23c501" status: 200 len: 371 microversion: 2.1 time: 0.541255 Oct 10 23:17:31.434231 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 137/269] 10.222.0.23 () {58 vars in 1242 bytes} [Mon Oct 10 23:17:30 2022] GET /compute/v2.1/os-quota-sets/7bf9c1068cc5492dadf524865d23c501 => generated 371 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:31.447003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-31894143-ae08-48b8-99e7-1a45a5dc25bd tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:31.505650 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-31894143-ae08-48b8-99e7-1a45a5dc25bd tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.063831 Oct 10 23:17:31.510035 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 138/270] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:17:31 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 23:17:31.516540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dad17e27-3f6b-4505-a1ed-5466bd89c0ed tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:31.517471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dad17e27-3f6b-4505-a1ed-5466bd89c0ed tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: 12574d37-08bd-4e05-8953-e2e680ebee8c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:31.523944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dad17e27-3f6b-4505-a1ed-5466bd89c0ed tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:31.524759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dad17e27-3f6b-4505-a1ed-5466bd89c0ed tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:31.526015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dad17e27-3f6b-4505-a1ed-5466bd89c0ed tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:31.526937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dad17e27-3f6b-4505-a1ed-5466bd89c0ed tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:31.527593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dad17e27-3f6b-4505-a1ed-5466bd89c0ed tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:31.528394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dad17e27-3f6b-4505-a1ed-5466bd89c0ed tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:31.592254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=15 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:31.835747 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bfb9ed5c-52b6-4d5f-9c0e-bed145900f80 tempest-SecurityGroupsTestAdminJSON-604164133 tempest-SecurityGroupsTestAdminJSON-604164133-project-admin] 10.222.0.23 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10538 microversion: 2.1 time: 4.542920 Oct 10 23:17:31.850922 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 133/271] 10.222.0.23 () {58 vars in 1191 bytes} [Mon Oct 10 23:17:27 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10538 bytes in 4559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 23:17:31.933976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dad17e27-3f6b-4505-a1ed-5466bd89c0ed tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:31.949282 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dad17e27-3f6b-4505-a1ed-5466bd89c0ed tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c" status: 200 len: 1386 microversion: 2.1 time: 0.437858 Oct 10 23:17:31.949915 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 139/272] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:31 2022] GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c => generated 1386 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:31.979890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0ddb1828-3931-43c9-ba77-e9c21866d680 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Action: 'update', calling method: .version_select at 0x7f66303c6700>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:31.991044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5a382901-7dd0-4fe9-8bc6-bb0a93cc9974 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1416472121", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:32.080741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-5a382901-7dd0-4fe9-8bc6-bb0a93cc9974 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] validate_networks() for None {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:17:32.086160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ddb1828-3931-43c9-ba77-e9c21866d680 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:32.086650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ddb1828-3931-43c9-ba77-e9c21866d680 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:32.087085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ddb1828-3931-43c9-ba77-e9c21866d680 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:32.087813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ddb1828-3931-43c9-ba77-e9c21866d680 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:32.088267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ddb1828-3931-43c9-ba77-e9c21866d680 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:32.088692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ddb1828-3931-43c9-ba77-e9c21866d680 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:32.192176 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0ddb1828-3931-43c9-ba77-e9c21866d680 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/7bf9c1068cc5492dadf524865d23c501" status: 200 len: 328 microversion: 2.1 time: 0.217051 Oct 10 23:17:32.197411 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 140/273] 10.222.0.23 () {60 vars in 1262 bytes} [Mon Oct 10 23:17:31 2022] PUT /compute/v2.1/os-quota-sets/7bf9c1068cc5492dadf524865d23c501 => generated 328 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:32.197672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b1c0931e-ba08-430a-8664-90707d7385da tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:32.205173 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-b1c0931e-ba08-430a-8664-90707d7385da tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 10 23:17:32.208037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b1c0931e-ba08-430a-8664-90707d7385da tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Request method failure captured: Oct 10 23:17:32.208037 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 10 23:17:32.208037 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:17:32.208037 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:17:32.208037 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:17:32.208037 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:17:32.208037 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:17:32.208037 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:17:32.208037 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:17:32.208037 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:32.208037 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfOMO23WeNNJ0dXS233_-4YnFE1E_5tkBanNXxjxm7t1INwl_mzLk7tuurD-oWYuOlNNrSJGoloN3bOjboS-Zqzf2YRXmWoIEAW3ddFu4Hkyu0thN1Wx31-zFnIXWCFmGxysbzmK3rbM3XjUZvDZmGedJA88pG9Y1Aur5qDbfNZOWE Oct 10 23:17:32.208037 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:17:32.208037 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:17:32.208037 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:17:32.208037 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:17:32.208037 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:17:32.208037 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:17:32.208037 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 47006f6e639740d09f2b62fea9d33758 Oct 10 23:17:32.208037 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AggregatesAdminTestJSON-1378333410 Oct 10 23:17:32.208037 n-d-860864-2 devstack@n-api.service[120613]: X-Role: admin,member,reader Oct 10 23:17:32.208037 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: admin,member,reader Oct 10 23:17:32.209515 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47006f6e639740d09f2b62fea9d33758"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47006f6e639740d09f2b62fea9d33758"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47006f6e639740d09f2b62fea9d33758"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47006f6e639740d09f2b62fea9d33758", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:32.209515 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AggregatesAdminTestJSON-1378333410 Oct 10 23:17:32.209515 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 47006f6e639740d09f2b62fea9d33758 Oct 10 23:17:32.209515 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1378333410 Oct 10 23:17:32.209515 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AggregatesAdminTestJSON-1378333410-project-admin Oct 10 23:17:32.209515 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:17:32.209515 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:17:32.209515 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: c7dce2b8789a419a86bc3847f2ecb3db Oct 10 23:17:32.209515 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AggregatesAdminTestJSON-1378333410-project-admin Oct 10 23:17:32.209515 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:17:32.209515 n-d-860864-2 devstack@n-api.service[120613]: exception: Aggregate 6 could not be found. Oct 10 23:17:32.209515 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '6'} Oct 10 23:17:32.209515 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:32.210337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:32.210337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 10 23:17:32.210337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 10 23:17:32.210337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 10 23:17:32.210337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 10 23:17:32.210337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:17:32.210337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:17:32.210337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 10 23:17:32.210337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 10 23:17:32.210337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:17:32.210337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:17:32.210337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 10 23:17:32.210337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 10 23:17:32.210337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 10 23:17:32.210337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:32.210337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:32.210337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:32.210337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:32.210337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:32.211683 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:32.211683 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:32.211683 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:32.211683 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:32.211683 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:32.211683 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 10 23:17:32.211683 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:17:32.211683 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 10 23:17:32.211683 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:32.211683 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:32.211683 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:32.211683 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:32.211683 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:32.211683 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:32.211683 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:32.211683 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:32.211683 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 10 23:17:32.211683 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:32.213564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b1c0931e-ba08-430a-8664-90707d7385da tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:32.213564 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b1c0931e-ba08-430a-8664-90707d7385da tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.015157 Oct 10 23:17:32.213564 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 141/274] 10.222.0.23 () {58 vars in 1149 bytes} [Mon Oct 10 23:17:32 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:17:32.218707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5c81a530-0f6c-4810-9630-aae6943ac5cd tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:32.219319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5c81a530-0f6c-4810-9630-aae6943ac5cd tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3b9a7c40-1a80-4be4-ba69-71487800d1f5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:32.226005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c81a530-0f6c-4810-9630-aae6943ac5cd tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:32.226481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c81a530-0f6c-4810-9630-aae6943ac5cd tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:32.226921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c81a530-0f6c-4810-9630-aae6943ac5cd tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:32.227624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c81a530-0f6c-4810-9630-aae6943ac5cd tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:32.228081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c81a530-0f6c-4810-9630-aae6943ac5cd tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:32.228509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c81a530-0f6c-4810-9630-aae6943ac5cd tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:32.244902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:32.437646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-5a382901-7dd0-4fe9-8bc6-bb0a93cc9974 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:17:32.438818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-5a382901-7dd0-4fe9-8bc6-bb0a93cc9974 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:17:32.439413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-5a382901-7dd0-4fe9-8bc6-bb0a93cc9974 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:17:32.439898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-5a382901-7dd0-4fe9-8bc6-bb0a93cc9974 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:17:32.444852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-5a382901-7dd0-4fe9-8bc6-bb0a93cc9974 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:17:32.458925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a382901-7dd0-4fe9-8bc6-bb0a93cc9974 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:32.459648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a382901-7dd0-4fe9-8bc6-bb0a93cc9974 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:32.460411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a382901-7dd0-4fe9-8bc6-bb0a93cc9974 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:32.461512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a382901-7dd0-4fe9-8bc6-bb0a93cc9974 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:32.462258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a382901-7dd0-4fe9-8bc6-bb0a93cc9974 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:32.462936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a382901-7dd0-4fe9-8bc6-bb0a93cc9974 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:32.492213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-5a382901-7dd0-4fe9-8bc6-bb0a93cc9974 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:17:32.507203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-5a382901-7dd0-4fe9-8bc6-bb0a93cc9974 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for user 310196e1663a4f7ca12e1fc53b0278ba and project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:17:32.531394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5a382901-7dd0-4fe9-8bc6-bb0a93cc9974 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:17:32.534051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5a382901-7dd0-4fe9-8bc6-bb0a93cc9974 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 90aa3419-44a6-4b0d-9af1-5f6df3554b71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:17:32.623138 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5a382901-7dd0-4fe9-8bc6-bb0a93cc9974 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.770740 Oct 10 23:17:32.624612 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 134/275] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:17:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:17:32.629614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dfed59b4-2e11-43e0-92e4-a80e16c6e7cb tempest-SecurityGroupsTestAdminJSON-510928655 tempest-SecurityGroupsTestAdminJSON-510928655-project] Calling method '.version_select at 0x7f6630304670>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:32.738982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5c81a530-0f6c-4810-9630-aae6943ac5cd tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:32.784565 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5c81a530-0f6c-4810-9630-aae6943ac5cd tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5" status: 200 len: 1317 microversion: 2.1 time: 0.570071 Oct 10 23:17:32.785169 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 142/276] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:32 2022] GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5 => generated 1317 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:32.803574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9d55737c-7a9b-4c05-94f1-b22ea13ce060 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:32.845975 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-9d55737c-7a9b-4c05-94f1-b22ea13ce060 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 10 23:17:32.847646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9d55737c-7a9b-4c05-94f1-b22ea13ce060 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Request method failure captured: Oct 10 23:17:32.847646 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 10 23:17:32.847646 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:17:32.847646 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:17:32.847646 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:17:32.847646 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:17:32.847646 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:17:32.847646 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:17:32.847646 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:17:32.847646 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:32.847646 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfOMO23WeNNJ0dXS233_-4YnFE1E_5tkBanNXxjxm7t1INwl_mzLk7tuurD-oWYuOlNNrSJGoloN3bOjboS-Zqzf2YRXmWoIEAW3ddFu4Hkyu0thN1Wx31-zFnIXWCFmGxysbzmK3rbM3XjUZvDZmGedJA88pG9Y1Aur5qDbfNZOWE Oct 10 23:17:32.847646 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:17:32.847646 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:17:32.847646 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:17:32.847646 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:17:32.847646 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:17:32.847646 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:17:32.847646 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 47006f6e639740d09f2b62fea9d33758 Oct 10 23:17:32.847646 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AggregatesAdminTestJSON-1378333410 Oct 10 23:17:32.847646 n-d-860864-2 devstack@n-api.service[120613]: X-Role: admin,member,reader Oct 10 23:17:32.847646 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: admin,member,reader Oct 10 23:17:32.849035 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47006f6e639740d09f2b62fea9d33758"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47006f6e639740d09f2b62fea9d33758"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47006f6e639740d09f2b62fea9d33758"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47006f6e639740d09f2b62fea9d33758", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:32.849035 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AggregatesAdminTestJSON-1378333410 Oct 10 23:17:32.849035 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 47006f6e639740d09f2b62fea9d33758 Oct 10 23:17:32.849035 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1378333410 Oct 10 23:17:32.849035 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AggregatesAdminTestJSON-1378333410-project-admin Oct 10 23:17:32.849035 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:17:32.849035 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:17:32.849035 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: c7dce2b8789a419a86bc3847f2ecb3db Oct 10 23:17:32.849035 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AggregatesAdminTestJSON-1378333410-project-admin Oct 10 23:17:32.849035 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:17:32.849035 n-d-860864-2 devstack@n-api.service[120613]: exception: Aggregate 6 could not be found. Oct 10 23:17:32.849035 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '6'} Oct 10 23:17:32.849035 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:32.850087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:32.850087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 10 23:17:32.850087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 10 23:17:32.850087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 23:17:32.850087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 23:17:32.850087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:17:32.850087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:17:32.850087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:17:32.850087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:17:32.850087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 23:17:32.850087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 23:17:32.850087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 10 23:17:32.850087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 10 23:17:32.850087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:17:32.850087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:17:32.850087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 10 23:17:32.850087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 10 23:17:32.850087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:17:32.850087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:17:32.851381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 10 23:17:32.851381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 10 23:17:32.851381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 10 23:17:32.851381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:32.851381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:32.851381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:32.851381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:32.851381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:32.851381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:32.851381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:32.851381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:32.851381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:32.851381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:32.851381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 10 23:17:32.851381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:17:32.851381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 10 23:17:32.851381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:32.851381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:32.851381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:32.851381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:32.851381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:32.852495 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:32.852495 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:32.852495 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:32.852495 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 10 23:17:32.852495 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:32.852495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9d55737c-7a9b-4c05-94f1-b22ea13ce060 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:32.852495 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9d55737c-7a9b-4c05-94f1-b22ea13ce060 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.062459 Oct 10 23:17:32.858337 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 143/277] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:17:32 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:17:33.008757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6fc8c939-9b2c-46c2-b193-ab952c098eb0 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-541529540", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:33.119234 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dfed59b4-2e11-43e0-92e4-a80e16c6e7cb tempest-SecurityGroupsTestAdminJSON-510928655 tempest-SecurityGroupsTestAdminJSON-510928655-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.493349 Oct 10 23:17:33.119826 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 135/278] 10.222.0.23 () {58 vars in 1191 bytes} [Mon Oct 10 23:17:32 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:33.129592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-6fc8c939-9b2c-46c2-b193-ab952c098eb0 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] validate_networks() for None {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:17:33.147085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5ac27ab7-dae6-4c28-9abd-c8a6e99b291e tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:33.147623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5ac27ab7-dae6-4c28-9abd-c8a6e99b291e tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 90aa3419-44a6-4b0d-9af1-5f6df3554b71] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:33.313360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5ac27ab7-dae6-4c28-9abd-c8a6e99b291e tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:33.337308 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5ac27ab7-dae6-4c28-9abd-c8a6e99b291e tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71" status: 200 len: 1217 microversion: 2.1 time: 0.199838 Oct 10 23:17:33.338136 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 136/279] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:33 2022] GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71 => generated 1217 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:33.343949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2a047355-ae0d-44d5-8da3-b62955878d6f tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-763063984", "name": "tempest-test_aggregate-1026569528"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:33.347954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.aggregate [None req-2a047355-ae0d-44d5-8da3-b62955878d6f tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Generated uuid 29e8c460-6a5b-48d5-90f9-12725c498ad8 for aggregate {{(pid=120614) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 23:17:33.399102 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2a047355-ae0d-44d5-8da3-b62955878d6f tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.053935 Oct 10 23:17:33.401245 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 137/280] 10.222.0.23 () {60 vars in 1165 bytes} [Mon Oct 10 23:17:33 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:33.413336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-228a5f18-00df-4184-8569-e766f637e8b6 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:33.414027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-228a5f18-00df-4184-8569-e766f637e8b6 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: 12574d37-08bd-4e05-8953-e2e680ebee8c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:33.429260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-228a5f18-00df-4184-8569-e766f637e8b6 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:33.429795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-228a5f18-00df-4184-8569-e766f637e8b6 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:33.430223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-228a5f18-00df-4184-8569-e766f637e8b6 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:33.447434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-228a5f18-00df-4184-8569-e766f637e8b6 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:33.447951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-228a5f18-00df-4184-8569-e766f637e8b6 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:33.448427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-228a5f18-00df-4184-8569-e766f637e8b6 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:33.756140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-228a5f18-00df-4184-8569-e766f637e8b6 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:33.766630 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-228a5f18-00df-4184-8569-e766f637e8b6 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c" status: 200 len: 1386 microversion: 2.1 time: 0.358681 Oct 10 23:17:33.767243 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 138/281] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:33 2022] GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c => generated 1386 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:33.788590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-43570b66-7c8a-4035-bb9f-c9c6126b6fc8 tempest-SecurityGroupsTestAdminJSON-604164133 tempest-SecurityGroupsTestAdminJSON-604164133-project-admin] Calling method '.version_select at 0x7f663026de50>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:34.009700 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-43570b66-7c8a-4035-bb9f-c9c6126b6fc8 tempest-SecurityGroupsTestAdminJSON-604164133 tempest-SecurityGroupsTestAdminJSON-604164133-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/b7566b7a-f2fc-481c-a4a6-f7c989cb5449" status: 202 len: 0 microversion: 2.1 time: 0.224776 Oct 10 23:17:34.010559 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 139/282] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:17:33 2022] DELETE /compute/v2.1/os-security-groups/b7566b7a-f2fc-481c-a4a6-f7c989cb5449 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:17:34.017832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-add22050-29b9-4ead-9824-6f2b444ce271 req-f2ec0773-a2ca-411a-9cf6-84469ed4e0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9a7c40-1a80-4be4-ba69-71487800d1f5", "name": "network-vif-plugged", "status": "completed", "tag": "1ceac712-6e6b-44a9-908f-d81d757aa539"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:34.039396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-add22050-29b9-4ead-9824-6f2b444ce271 req-f2ec0773-a2ca-411a-9cf6-84469ed4e0e4 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:34.040262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-add22050-29b9-4ead-9824-6f2b444ce271 req-f2ec0773-a2ca-411a-9cf6-84469ed4e0e4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:34.041619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-add22050-29b9-4ead-9824-6f2b444ce271 req-f2ec0773-a2ca-411a-9cf6-84469ed4e0e4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:34.062013 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-add22050-29b9-4ead-9824-6f2b444ce271 req-f2ec0773-a2ca-411a-9cf6-84469ed4e0e4 service nova] Creating event network-vif-plugged:1ceac712-6e6b-44a9-908f-d81d757aa539 for instance 3b9a7c40-1a80-4be4-ba69-71487800d1f5 on n-h1-860864-2 Oct 10 23:17:34.069130 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-add22050-29b9-4ead-9824-6f2b444ce271 req-f2ec0773-a2ca-411a-9cf6-84469ed4e0e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056656 Oct 10 23:17:34.070166 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 140/283] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:34.078638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4682f605-bc68-4ec7-a27d-f082cf5b59d9 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:34.117311 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4682f605-bc68-4ec7-a27d-f082cf5b59d9 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.045725 Oct 10 23:17:34.118532 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 141/284] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:17:34 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 23:17:34.125044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9ecef506-f55d-4a5e-90de-496d65e5460b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:34.125814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9ecef506-f55d-4a5e-90de-496d65e5460b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3b9a7c40-1a80-4be4-ba69-71487800d1f5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:34.136217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ecef506-f55d-4a5e-90de-496d65e5460b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:34.136715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ecef506-f55d-4a5e-90de-496d65e5460b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:34.137153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ecef506-f55d-4a5e-90de-496d65e5460b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:34.139629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ecef506-f55d-4a5e-90de-496d65e5460b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:34.140393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ecef506-f55d-4a5e-90de-496d65e5460b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:34.141001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ecef506-f55d-4a5e-90de-496d65e5460b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:34.178004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:34.476670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9ecef506-f55d-4a5e-90de-496d65e5460b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:34.485651 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9ecef506-f55d-4a5e-90de-496d65e5460b tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5" status: 200 len: 1317 microversion: 2.1 time: 0.364941 Oct 10 23:17:34.486235 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 142/285] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:34 2022] GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:34.490999 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-95c5e7a5-9984-42ed-b7eb-f9adda95bbcd tempest-SecurityGroupsTestAdminJSON-604164133 tempest-SecurityGroupsTestAdminJSON-604164133-project-admin] Calling method '.version_select at 0x7f663026d310>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:34.534727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6fc8c939-9b2c-46c2-b193-ab952c098eb0 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:17:34.535245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6fc8c939-9b2c-46c2-b193-ab952c098eb0 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:17:34.535705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6fc8c939-9b2c-46c2-b193-ab952c098eb0 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:17:34.536222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6fc8c939-9b2c-46c2-b193-ab952c098eb0 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:17:34.536735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6fc8c939-9b2c-46c2-b193-ab952c098eb0 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:17:34.549742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fc8c939-9b2c-46c2-b193-ab952c098eb0 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:34.551061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fc8c939-9b2c-46c2-b193-ab952c098eb0 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:34.551720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fc8c939-9b2c-46c2-b193-ab952c098eb0 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:34.552694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fc8c939-9b2c-46c2-b193-ab952c098eb0 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:34.553582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fc8c939-9b2c-46c2-b193-ab952c098eb0 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:34.554243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fc8c939-9b2c-46c2-b193-ab952c098eb0 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:34.581342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-6fc8c939-9b2c-46c2-b193-ab952c098eb0 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Getting quotas for project 7bf9c1068cc5492dadf524865d23c501. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:17:34.588291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-6fc8c939-9b2c-46c2-b193-ab952c098eb0 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Getting quotas for user 00d2a9f89dba43508243a4d0cae76c40 and project 7bf9c1068cc5492dadf524865d23c501. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:17:34.603551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.utils [None req-6fc8c939-9b2c-46c2-b193-ab952c098eb0 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] cores quota exceeded for 7bf9c1068cc5492dadf524865d23c501, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120613) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 10 23:17:34.604731 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-6fc8c939-9b2c-46c2-b193-ab952c098eb0 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 10 23:17:34.610512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6fc8c939-9b2c-46c2-b193-ab952c098eb0 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Request method failure captured: Oct 10 23:17:34.610512 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:17:34.610512 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:17:34.610512 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:17:34.610512 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:17:34.610512 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 144 Oct 10 23:17:34.610512 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:17:34.610512 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:17:34.610512 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:17:34.610512 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:34.610512 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKgJ55cgDZN3sOh5coqUGCjGbc8VkeOpRpucTdFkLbGW1HN1pzwx4HV3QZWTst8SHc7cRSpk6gzomkf17zAHsY3xZdM-0W_Y6RxvRGiCCSfmU3VLGLrdYMkQphGzsgKQDvOMu2yxNYPq2RmI7vu6ldI8ou4oy0zB_V3o-3zrRYj9SMM Oct 10 23:17:34.610512 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:17:34.610512 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:17:34.610512 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:17:34.610512 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:17:34.610512 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:17:34.610512 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:17:34.610512 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 7bf9c1068cc5492dadf524865d23c501 Oct 10 23:17:34.610512 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-QuotasAdminNegativeTest-1230081964 Oct 10 23:17:34.610512 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:17:34.610512 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:17:34.611831 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7bf9c1068cc5492dadf524865d23c501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7bf9c1068cc5492dadf524865d23c501"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7bf9c1068cc5492dadf524865d23c501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7bf9c1068cc5492dadf524865d23c501", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:34.611831 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-QuotasAdminNegativeTest-1230081964 Oct 10 23:17:34.611831 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 7bf9c1068cc5492dadf524865d23c501 Oct 10 23:17:34.611831 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1230081964 Oct 10 23:17:34.611831 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-QuotasAdminNegativeTest-1230081964-project Oct 10 23:17:34.611831 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:17:34.611831 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:17:34.611831 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 00d2a9f89dba43508243a4d0cae76c40 Oct 10 23:17:34.611831 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-QuotasAdminNegativeTest-1230081964-project Oct 10 23:17:34.611831 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:17:34.611831 n-d-860864-2 devstack@n-api.service[120613]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-541529540", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} Oct 10 23:17:34.611831 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:17:34.612600 n-d-860864-2 devstack@n-api.service[120613]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 10 23:17:34.612600 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-541529540', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452'}}} Oct 10 23:17:34.612600 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:34.612600 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:34.612600 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 10 23:17:34.612600 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 10 23:17:34.612600 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:17:34.612600 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:17:34.612600 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 10 23:17:34.612600 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc Oct 10 23:17:34.612600 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 10 23:17:34.612600 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 10 23:17:34.612600 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:17:34.612600 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:17:34.612600 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 10 23:17:34.612600 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 10 23:17:34.612600 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 10 23:17:34.612600 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 10 23:17:34.613634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 10 23:17:34.613634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 10 23:17:34.613634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 10 23:17:34.613634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:34.613634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:34.613634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:34.613634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:34.613634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 10 23:17:34.613634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 10 23:17:34.613634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 10 23:17:34.613634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 10 23:17:34.613634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 10 23:17:34.613634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 10 23:17:34.613634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 10 23:17:34.613634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 10 23:17:34.613634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 10 23:17:34.613634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 10 23:17:34.613634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 10 23:17:34.613634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:34.613634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:34.613634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:34.614780 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:34.614780 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:34.614780 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:34.614780 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:34.614780 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:34.614780 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:34.614780 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:34.614780 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:34.614780 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:34.614780 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:34.614780 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:34.614780 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:34.614780 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:34.614780 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 23:17:34.614780 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 10 23:17:34.614780 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 10 23:17:34.614780 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 10 23:17:34.614780 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:34.614780 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:34.614780 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:34.614780 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:34.615924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:34.615924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:34.615924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:34.615924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:34.615924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 10 23:17:34.615924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:34.618199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6fc8c939-9b2c-46c2-b193-ab952c098eb0 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:34.623357 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6fc8c939-9b2c-46c2-b193-ab952c098eb0 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.763292 Oct 10 23:17:34.627789 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 144/286] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:17:32 2022] POST /compute/v2.1/servers => generated 111 bytes in 1765 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:17:34.632381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c98e3a6b-b149-4779-8341-aefd4cb65c75 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:34.643242 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-c98e3a6b-b149-4779-8341-aefd4cb65c75 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 10 23:17:34.645098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c98e3a6b-b149-4779-8341-aefd4cb65c75 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Request method failure captured: Oct 10 23:17:34.645098 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 10 23:17:34.645098 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:17:34.645098 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:17:34.645098 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:17:34.645098 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:17:34.645098 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:17:34.645098 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:17:34.645098 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:17:34.645098 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:34.645098 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfOMO23WeNNJ0dXS233_-4YnFE1E_5tkBanNXxjxm7t1INwl_mzLk7tuurD-oWYuOlNNrSJGoloN3bOjboS-Zqzf2YRXmWoIEAW3ddFu4Hkyu0thN1Wx31-zFnIXWCFmGxysbzmK3rbM3XjUZvDZmGedJA88pG9Y1Aur5qDbfNZOWE Oct 10 23:17:34.645098 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:17:34.645098 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:17:34.645098 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:17:34.645098 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:17:34.645098 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:17:34.645098 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:17:34.645098 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 47006f6e639740d09f2b62fea9d33758 Oct 10 23:17:34.645098 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AggregatesAdminTestJSON-1378333410 Oct 10 23:17:34.645098 n-d-860864-2 devstack@n-api.service[120613]: X-Role: admin,member,reader Oct 10 23:17:34.645098 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: admin,member,reader Oct 10 23:17:34.646311 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47006f6e639740d09f2b62fea9d33758"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47006f6e639740d09f2b62fea9d33758"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47006f6e639740d09f2b62fea9d33758"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47006f6e639740d09f2b62fea9d33758", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:34.646311 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AggregatesAdminTestJSON-1378333410 Oct 10 23:17:34.646311 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 47006f6e639740d09f2b62fea9d33758 Oct 10 23:17:34.646311 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1378333410 Oct 10 23:17:34.646311 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AggregatesAdminTestJSON-1378333410-project-admin Oct 10 23:17:34.646311 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:17:34.646311 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:17:34.646311 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: c7dce2b8789a419a86bc3847f2ecb3db Oct 10 23:17:34.646311 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AggregatesAdminTestJSON-1378333410-project-admin Oct 10 23:17:34.646311 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:17:34.646311 n-d-860864-2 devstack@n-api.service[120613]: exception: Aggregate 7 could not be found. Oct 10 23:17:34.646311 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '7'} Oct 10 23:17:34.646311 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:34.647030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:34.647030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 10 23:17:34.647030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 10 23:17:34.647030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 10 23:17:34.647030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 10 23:17:34.647030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:17:34.647030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:17:34.647030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 10 23:17:34.647030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 10 23:17:34.647030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:17:34.647030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:17:34.647030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 10 23:17:34.647030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 10 23:17:34.647030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 10 23:17:34.647030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:34.647030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:34.647030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:34.647030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:34.647030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:34.648041 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:34.648041 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:34.648041 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:34.648041 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:34.648041 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:34.648041 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 10 23:17:34.648041 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:17:34.648041 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 10 23:17:34.648041 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:34.648041 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:34.648041 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:34.648041 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:34.648041 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:34.648041 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:34.648041 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:34.648041 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:34.648041 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 10 23:17:34.648041 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:34.651291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c98e3a6b-b149-4779-8341-aefd4cb65c75 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:34.654228 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c98e3a6b-b149-4779-8341-aefd4cb65c75 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.027733 Oct 10 23:17:34.666770 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 145/287] 10.222.0.23 () {58 vars in 1149 bytes} [Mon Oct 10 23:17:34 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:17:34.676665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b7aa3638-8f2d-407e-8c2e-01812e6e2a78 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:34.677772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b7aa3638-8f2d-407e-8c2e-01812e6e2a78 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 90aa3419-44a6-4b0d-9af1-5f6df3554b71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:34.688768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7aa3638-8f2d-407e-8c2e-01812e6e2a78 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:34.689431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7aa3638-8f2d-407e-8c2e-01812e6e2a78 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:34.690030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7aa3638-8f2d-407e-8c2e-01812e6e2a78 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:34.690912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7aa3638-8f2d-407e-8c2e-01812e6e2a78 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:34.691476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7aa3638-8f2d-407e-8c2e-01812e6e2a78 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:34.692059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7aa3638-8f2d-407e-8c2e-01812e6e2a78 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:34.733914 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-95c5e7a5-9984-42ed-b7eb-f9adda95bbcd tempest-SecurityGroupsTestAdminJSON-604164133 tempest-SecurityGroupsTestAdminJSON-604164133-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/1968415c-3364-440c-bf1a-7873a4bfe161" status: 202 len: 0 microversion: 2.1 time: 0.246589 Oct 10 23:17:34.734507 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 143/288] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:17:34 2022] DELETE /compute/v2.1/os-security-groups/1968415c-3364-440c-bf1a-7873a4bfe161 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:17:34.743998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-94916fdb-d39e-43cf-9cea-7579920c75cd tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Action: 'update', calling method: .version_select at 0x7f6630292040>, body: {"quota_set": {"cores": 20}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:34.831362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94916fdb-d39e-43cf-9cea-7579920c75cd tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:34.831993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94916fdb-d39e-43cf-9cea-7579920c75cd tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:34.832697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94916fdb-d39e-43cf-9cea-7579920c75cd tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:34.833488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94916fdb-d39e-43cf-9cea-7579920c75cd tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:34.833938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94916fdb-d39e-43cf-9cea-7579920c75cd tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:34.834843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94916fdb-d39e-43cf-9cea-7579920c75cd tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:34.875380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b7aa3638-8f2d-407e-8c2e-01812e6e2a78 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:34.883796 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b7aa3638-8f2d-407e-8c2e-01812e6e2a78 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71" status: 200 len: 1269 microversion: 2.1 time: 0.215495 Oct 10 23:17:34.884493 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 146/289] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:34 2022] GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71 => generated 1269 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:34.898712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f32f0312-338c-4e8f-8614-1c9dd272f178 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:34.913891 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-f32f0312-338c-4e8f-8614-1c9dd272f178 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 10 23:17:34.916584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f32f0312-338c-4e8f-8614-1c9dd272f178 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Request method failure captured: Oct 10 23:17:34.916584 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 10 23:17:34.916584 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:17:34.916584 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:17:34.916584 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:17:34.916584 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:17:34.916584 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:17:34.916584 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:17:34.916584 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:17:34.916584 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:34.916584 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfOMO23WeNNJ0dXS233_-4YnFE1E_5tkBanNXxjxm7t1INwl_mzLk7tuurD-oWYuOlNNrSJGoloN3bOjboS-Zqzf2YRXmWoIEAW3ddFu4Hkyu0thN1Wx31-zFnIXWCFmGxysbzmK3rbM3XjUZvDZmGedJA88pG9Y1Aur5qDbfNZOWE Oct 10 23:17:34.916584 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:17:34.916584 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:17:34.916584 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:17:34.916584 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:17:34.916584 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:17:34.916584 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:17:34.916584 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 47006f6e639740d09f2b62fea9d33758 Oct 10 23:17:34.916584 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AggregatesAdminTestJSON-1378333410 Oct 10 23:17:34.916584 n-d-860864-2 devstack@n-api.service[120613]: X-Role: admin,member,reader Oct 10 23:17:34.916584 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: admin,member,reader Oct 10 23:17:34.918139 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/47006f6e639740d09f2b62fea9d33758"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47006f6e639740d09f2b62fea9d33758"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/47006f6e639740d09f2b62fea9d33758"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_47006f6e639740d09f2b62fea9d33758", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:34.918139 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AggregatesAdminTestJSON-1378333410 Oct 10 23:17:34.918139 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 47006f6e639740d09f2b62fea9d33758 Oct 10 23:17:34.918139 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1378333410 Oct 10 23:17:34.918139 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AggregatesAdminTestJSON-1378333410-project-admin Oct 10 23:17:34.918139 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:17:34.918139 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:17:34.918139 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: c7dce2b8789a419a86bc3847f2ecb3db Oct 10 23:17:34.918139 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AggregatesAdminTestJSON-1378333410-project-admin Oct 10 23:17:34.918139 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:17:34.918139 n-d-860864-2 devstack@n-api.service[120613]: exception: Aggregate 7 could not be found. Oct 10 23:17:34.918139 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '7'} Oct 10 23:17:34.918139 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:34.919433 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:34.919433 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 10 23:17:34.919433 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 10 23:17:34.919433 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 23:17:34.919433 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 23:17:34.919433 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:17:34.919433 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:17:34.919433 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:17:34.919433 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:17:34.919433 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 23:17:34.919433 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 23:17:34.919433 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 10 23:17:34.919433 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 10 23:17:34.919433 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:17:34.919433 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:17:34.919433 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 10 23:17:34.919433 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 10 23:17:34.919433 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:17:34.919433 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:17:34.920571 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 10 23:17:34.920571 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 10 23:17:34.920571 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 10 23:17:34.920571 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:34.920571 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:34.920571 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:34.920571 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:34.920571 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:34.920571 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:34.920571 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:34.920571 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:34.920571 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:34.920571 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:34.920571 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 10 23:17:34.920571 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:17:34.920571 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 10 23:17:34.920571 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:34.920571 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:34.920571 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:34.920571 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:34.920571 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:34.922627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:34.922627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:34.922627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:34.922627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 10 23:17:34.922627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:34.923784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f32f0312-338c-4e8f-8614-1c9dd272f178 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:34.924709 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f32f0312-338c-4e8f-8614-1c9dd272f178 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.039020 Oct 10 23:17:34.929852 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 147/290] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:17:34 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:17:34.931256 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-94916fdb-d39e-43cf-9cea-7579920c75cd tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/7bf9c1068cc5492dadf524865d23c501" status: 200 len: 329 microversion: 2.1 time: 0.195353 Oct 10 23:17:34.932268 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 144/291] 10.222.0.23 () {60 vars in 1262 bytes} [Mon Oct 10 23:17:34 2022] PUT /compute/v2.1/os-quota-sets/7bf9c1068cc5492dadf524865d23c501 => generated 329 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:34.935079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-05a2656a-0532-4cd7-9a27-2719cba5d5c6 tempest-SecurityGroupsTestAdminJSON-510928655 tempest-SecurityGroupsTestAdminJSON-510928655-project] Calling method '.version_select at 0x7f663024d430>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:34.938262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c00fd083-67f5-4d83-8dab-1e4f0bb7317a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:34.939016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c00fd083-67f5-4d83-8dab-1e4f0bb7317a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: 12574d37-08bd-4e05-8953-e2e680ebee8c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:34.947718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c00fd083-67f5-4d83-8dab-1e4f0bb7317a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:34.948204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c00fd083-67f5-4d83-8dab-1e4f0bb7317a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:34.948632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c00fd083-67f5-4d83-8dab-1e4f0bb7317a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:34.949321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c00fd083-67f5-4d83-8dab-1e4f0bb7317a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:34.949799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c00fd083-67f5-4d83-8dab-1e4f0bb7317a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:34.950223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c00fd083-67f5-4d83-8dab-1e4f0bb7317a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:35.188399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c00fd083-67f5-4d83-8dab-1e4f0bb7317a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:35.208016 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c00fd083-67f5-4d83-8dab-1e4f0bb7317a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c" status: 200 len: 1386 microversion: 2.1 time: 0.273790 Oct 10 23:17:35.231044 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 145/292] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:34 2022] GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c => generated 1386 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:35.236987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0bbbe228-d241-4eee-a5f6-1bec55ea640f tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-554644403"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:35.242093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.aggregate [None req-0bbbe228-d241-4eee-a5f6-1bec55ea640f tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Generated uuid 5e2aa268-f8fd-4595-ba0d-bc55cabfd2a9 for aggregate {{(pid=120614) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 23:17:35.272582 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0bbbe228-d241-4eee-a5f6-1bec55ea640f tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.039960 Oct 10 23:17:35.283586 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 146/293] 10.222.0.23 () {60 vars in 1164 bytes} [Mon Oct 10 23:17:35 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:35.289320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-84320d63-c2a3-4870-8533-d852d3e532f9 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Calling method '.version_select at 0x7f66302bd670>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:35.409932 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-84320d63-c2a3-4870-8533-d852d3e532f9 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/7bf9c1068cc5492dadf524865d23c501" status: 200 len: 371 microversion: 2.1 time: 0.124616 Oct 10 23:17:35.411789 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 147/294] 10.222.0.23 () {58 vars in 1242 bytes} [Mon Oct 10 23:17:35 2022] GET /compute/v2.1/os-quota-sets/7bf9c1068cc5492dadf524865d23c501 => generated 371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:35.424220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6a247610-4b46-4587-9a42-6d3edf2ee949 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:35.437955 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6a247610-4b46-4587-9a42-6d3edf2ee949 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 226 microversion: 2.1 time: 0.024792 Oct 10 23:17:35.439374 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 148/295] 10.222.0.23 () {58 vars in 1149 bytes} [Mon Oct 10 23:17:35 2022] GET /compute/v2.1/os-aggregates/8 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:35.449337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ed3bc708-cca8-4b42-b952-e17de86a623b tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Action: 'update', calling method: .version_select at 0x7f663027e820>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:35.565492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed3bc708-cca8-4b42-b952-e17de86a623b tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:35.566211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed3bc708-cca8-4b42-b952-e17de86a623b tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:35.569288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed3bc708-cca8-4b42-b952-e17de86a623b tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:35.570268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed3bc708-cca8-4b42-b952-e17de86a623b tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:35.570541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed3bc708-cca8-4b42-b952-e17de86a623b tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:35.570952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed3bc708-cca8-4b42-b952-e17de86a623b tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:35.614904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=8,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:35.708627 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ed3bc708-cca8-4b42-b952-e17de86a623b tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/7bf9c1068cc5492dadf524865d23c501" status: 200 len: 328 microversion: 2.1 time: 0.267887 Oct 10 23:17:35.709967 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 149/296] 10.222.0.23 () {60 vars in 1262 bytes} [Mon Oct 10 23:17:35 2022] PUT /compute/v2.1/os-quota-sets/7bf9c1068cc5492dadf524865d23c501 => generated 328 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:35.714636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0e86bb7a-cd43-4a16-84cf-d376b4554a83 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:35.827978 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0e86bb7a-cd43-4a16-84cf-d376b4554a83 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 264 microversion: 2.1 time: 0.116700 Oct 10 23:17:35.829593 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 150/297] 10.222.0.23 () {60 vars in 1191 bytes} [Mon Oct 10 23:17:35 2022] POST /compute/v2.1/os-aggregates/8/action => generated 264 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:35.835804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-306ee44c-eb3f-4302-9d8d-c0662e44de1d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:35.844887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-306ee44c-eb3f-4302-9d8d-c0662e44de1d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3b9a7c40-1a80-4be4-ba69-71487800d1f5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:35.857153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-306ee44c-eb3f-4302-9d8d-c0662e44de1d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:35.857153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-306ee44c-eb3f-4302-9d8d-c0662e44de1d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:35.858034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-306ee44c-eb3f-4302-9d8d-c0662e44de1d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:35.858734 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-306ee44c-eb3f-4302-9d8d-c0662e44de1d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:35.864596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-306ee44c-eb3f-4302-9d8d-c0662e44de1d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:35.865094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-306ee44c-eb3f-4302-9d8d-c0662e44de1d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:35.905347 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-05a2656a-0532-4cd7-9a27-2719cba5d5c6 tempest-SecurityGroupsTestAdminJSON-510928655 tempest-SecurityGroupsTestAdminJSON-510928655-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/240c991b-d399-4bd8-9c68-7cceac4f9e7a" status: 202 len: 0 microversion: 2.1 time: 0.974140 Oct 10 23:17:35.906877 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 148/298] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:17:34 2022] DELETE /compute/v2.1/os-security-groups/240c991b-d399-4bd8-9c68-7cceac4f9e7a => generated 0 bytes in 976 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:17:35.914643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-33dd8dd1-42f8-4ce6-acfe-f48320c27d95 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1857694345", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:36.040420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-33dd8dd1-42f8-4ce6-acfe-f48320c27d95 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] validate_networks() for None {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:17:36.209523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-306ee44c-eb3f-4302-9d8d-c0662e44de1d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:36.220847 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-306ee44c-eb3f-4302-9d8d-c0662e44de1d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5" status: 200 len: 1467 microversion: 2.1 time: 0.389629 Oct 10 23:17:36.221765 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 151/299] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:35 2022] GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5 => generated 1467 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:36.229707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1b7927dd-d164-4933-9518-f1090a1b6e02 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:36.247335 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1b7927dd-d164-4933-9518-f1090a1b6e02 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 240 microversion: 2.1 time: 0.024801 Oct 10 23:17:36.248845 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 152/300] 10.222.0.23 () {58 vars in 1149 bytes} [Mon Oct 10 23:17:36 2022] GET /compute/v2.1/os-aggregates/8 => generated 240 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:36.255270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-844844e6-2dd1-4fbb-beb5-357082292276 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:36.256254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-844844e6-2dd1-4fbb-beb5-357082292276 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 90aa3419-44a6-4b0d-9af1-5f6df3554b71] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:36.264131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-844844e6-2dd1-4fbb-beb5-357082292276 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:36.264633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-844844e6-2dd1-4fbb-beb5-357082292276 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:36.265100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-844844e6-2dd1-4fbb-beb5-357082292276 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:36.266524 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-844844e6-2dd1-4fbb-beb5-357082292276 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:36.266976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-844844e6-2dd1-4fbb-beb5-357082292276 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:36.267448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-844844e6-2dd1-4fbb-beb5-357082292276 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:36.436701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-844844e6-2dd1-4fbb-beb5-357082292276 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:36.451421 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-844844e6-2dd1-4fbb-beb5-357082292276 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71" status: 200 len: 1275 microversion: 2.1 time: 0.198122 Oct 10 23:17:36.452508 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 153/301] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:36 2022] GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71 => generated 1275 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:36.460718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a478533b-db3c-4fb5-80f0-4ba0f790c6a0 tempest-SecurityGroupsTestAdminJSON-510928655 tempest-SecurityGroupsTestAdminJSON-510928655-project] Calling method '.version_select at 0x7f663027ee50>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:36.932830 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a478533b-db3c-4fb5-80f0-4ba0f790c6a0 tempest-SecurityGroupsTestAdminJSON-510928655 tempest-SecurityGroupsTestAdminJSON-510928655-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/4c47fc59-2357-47af-b4bc-56fdc2fa145e" status: 202 len: 0 microversion: 2.1 time: 0.475871 Oct 10 23:17:36.935313 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 154/302] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:17:36 2022] DELETE /compute/v2.1/os-security-groups/4c47fc59-2357-47af-b4bc-56fdc2fa145e => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:17:36.944806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7189b707-cfdf-4d28-8929-a62f0085f2fd tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:36.945693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7189b707-cfdf-4d28-8929-a62f0085f2fd tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: 12574d37-08bd-4e05-8953-e2e680ebee8c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:36.957913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7189b707-cfdf-4d28-8929-a62f0085f2fd tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:36.958903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7189b707-cfdf-4d28-8929-a62f0085f2fd tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:36.959570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7189b707-cfdf-4d28-8929-a62f0085f2fd tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:36.960915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7189b707-cfdf-4d28-8929-a62f0085f2fd tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:36.961614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7189b707-cfdf-4d28-8929-a62f0085f2fd tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:36.962278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7189b707-cfdf-4d28-8929-a62f0085f2fd tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:36.980705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-33dd8dd1-42f8-4ce6-acfe-f48320c27d95 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:17:36.980705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-33dd8dd1-42f8-4ce6-acfe-f48320c27d95 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:17:36.980705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-33dd8dd1-42f8-4ce6-acfe-f48320c27d95 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:17:36.981301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-33dd8dd1-42f8-4ce6-acfe-f48320c27d95 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:17:36.981436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-33dd8dd1-42f8-4ce6-acfe-f48320c27d95 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:17:37.014228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33dd8dd1-42f8-4ce6-acfe-f48320c27d95 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:37.021137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33dd8dd1-42f8-4ce6-acfe-f48320c27d95 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:37.021629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33dd8dd1-42f8-4ce6-acfe-f48320c27d95 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:37.025563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33dd8dd1-42f8-4ce6-acfe-f48320c27d95 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:37.026045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33dd8dd1-42f8-4ce6-acfe-f48320c27d95 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:37.026486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33dd8dd1-42f8-4ce6-acfe-f48320c27d95 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:37.071333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-33dd8dd1-42f8-4ce6-acfe-f48320c27d95 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Getting quotas for project 7bf9c1068cc5492dadf524865d23c501. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:17:37.086379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-33dd8dd1-42f8-4ce6-acfe-f48320c27d95 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Getting quotas for user 00d2a9f89dba43508243a4d0cae76c40 and project 7bf9c1068cc5492dadf524865d23c501. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:17:37.120885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.utils [None req-33dd8dd1-42f8-4ce6-acfe-f48320c27d95 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] instances quota exceeded for 7bf9c1068cc5492dadf524865d23c501, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120613) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 10 23:17:37.121453 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-33dd8dd1-42f8-4ce6-acfe-f48320c27d95 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 10 23:17:37.123990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-33dd8dd1-42f8-4ce6-acfe-f48320c27d95 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Request method failure captured: Oct 10 23:17:37.123990 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:17:37.123990 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:17:37.123990 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:17:37.123990 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:17:37.123990 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 145 Oct 10 23:17:37.123990 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:17:37.123990 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:17:37.123990 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:17:37.123990 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:37.123990 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKgJ55cgDZN3sOh5coqUGCjGbc8VkeOpRpucTdFkLbGW1HN1pzwx4HV3QZWTst8SHc7cRSpk6gzomkf17zAHsY3xZdM-0W_Y6RxvRGiCCSfmU3VLGLrdYMkQphGzsgKQDvOMu2yxNYPq2RmI7vu6ldI8ou4oy0zB_V3o-3zrRYj9SMM Oct 10 23:17:37.123990 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:17:37.123990 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:17:37.123990 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:17:37.123990 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:17:37.123990 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:17:37.123990 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:17:37.123990 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 7bf9c1068cc5492dadf524865d23c501 Oct 10 23:17:37.123990 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-QuotasAdminNegativeTest-1230081964 Oct 10 23:17:37.123990 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:17:37.123990 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:17:37.125217 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7bf9c1068cc5492dadf524865d23c501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7bf9c1068cc5492dadf524865d23c501"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7bf9c1068cc5492dadf524865d23c501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7bf9c1068cc5492dadf524865d23c501", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:37.125217 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-QuotasAdminNegativeTest-1230081964 Oct 10 23:17:37.125217 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 7bf9c1068cc5492dadf524865d23c501 Oct 10 23:17:37.125217 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1230081964 Oct 10 23:17:37.125217 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-QuotasAdminNegativeTest-1230081964-project Oct 10 23:17:37.125217 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:17:37.125217 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:17:37.125217 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 00d2a9f89dba43508243a4d0cae76c40 Oct 10 23:17:37.125217 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-QuotasAdminNegativeTest-1230081964-project Oct 10 23:17:37.125217 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:17:37.125217 n-d-860864-2 devstack@n-api.service[120613]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1857694345", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} Oct 10 23:17:37.125217 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:17:37.125917 n-d-860864-2 devstack@n-api.service[120613]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 10 23:17:37.125917 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1857694345', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452'}}} Oct 10 23:17:37.125917 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:37.125917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:37.125917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 10 23:17:37.125917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 10 23:17:37.125917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:17:37.125917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:17:37.125917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 10 23:17:37.125917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc Oct 10 23:17:37.125917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 10 23:17:37.125917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 10 23:17:37.125917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:17:37.125917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:17:37.125917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 10 23:17:37.125917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 10 23:17:37.125917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 10 23:17:37.125917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 10 23:17:37.126926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 10 23:17:37.126926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 10 23:17:37.126926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 10 23:17:37.126926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:37.126926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:37.126926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:37.126926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:37.126926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 10 23:17:37.126926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 10 23:17:37.126926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 10 23:17:37.126926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 10 23:17:37.126926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 10 23:17:37.126926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 10 23:17:37.126926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 10 23:17:37.126926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 10 23:17:37.126926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 10 23:17:37.126926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 10 23:17:37.126926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 10 23:17:37.126926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:37.126926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:37.126926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:37.128088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:37.128088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:37.128088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:37.128088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:37.128088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:37.128088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:37.128088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:37.128088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:37.128088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:37.128088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:37.128088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:37.128088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:37.128088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:37.128088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 23:17:37.128088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 10 23:17:37.128088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 10 23:17:37.128088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 10 23:17:37.128088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:37.128088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:37.128088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:37.128088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:37.129223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:37.129223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:37.129223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:37.129223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:37.129223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 10 23:17:37.129223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:37.129223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-33dd8dd1-42f8-4ce6-acfe-f48320c27d95 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:37.129223 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-33dd8dd1-42f8-4ce6-acfe-f48320c27d95 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.217257 Oct 10 23:17:37.132940 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 149/303] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:17:35 2022] POST /compute/v2.1/servers => generated 119 bytes in 1224 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:17:37.148515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7c9e0d2e-2735-4de7-a48d-a00356bf304d tempest-DeleteServersAdminTestJSON-2036703229 tempest-DeleteServersAdminTestJSON-2036703229-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:37.156840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7c9e0d2e-2735-4de7-a48d-a00356bf304d tempest-DeleteServersAdminTestJSON-2036703229 tempest-DeleteServersAdminTestJSON-2036703229-project-admin] [instance: 3b9a7c40-1a80-4be4-ba69-71487800d1f5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:37.169697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c9e0d2e-2735-4de7-a48d-a00356bf304d tempest-DeleteServersAdminTestJSON-2036703229 tempest-DeleteServersAdminTestJSON-2036703229-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:37.170201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c9e0d2e-2735-4de7-a48d-a00356bf304d tempest-DeleteServersAdminTestJSON-2036703229 tempest-DeleteServersAdminTestJSON-2036703229-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:37.170755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c9e0d2e-2735-4de7-a48d-a00356bf304d tempest-DeleteServersAdminTestJSON-2036703229 tempest-DeleteServersAdminTestJSON-2036703229-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:37.171329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c9e0d2e-2735-4de7-a48d-a00356bf304d tempest-DeleteServersAdminTestJSON-2036703229 tempest-DeleteServersAdminTestJSON-2036703229-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:37.171790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c9e0d2e-2735-4de7-a48d-a00356bf304d tempest-DeleteServersAdminTestJSON-2036703229 tempest-DeleteServersAdminTestJSON-2036703229-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:37.173896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c9e0d2e-2735-4de7-a48d-a00356bf304d tempest-DeleteServersAdminTestJSON-2036703229 tempest-DeleteServersAdminTestJSON-2036703229-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:37.369254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:37.529024 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7c9e0d2e-2735-4de7-a48d-a00356bf304d tempest-DeleteServersAdminTestJSON-2036703229 tempest-DeleteServersAdminTestJSON-2036703229-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5/action" status: 202 len: 0 microversion: 2.1 time: 0.390846 Oct 10 23:17:37.533564 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 150/304] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:17:37 2022] POST /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:17:37.538733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e8c18a17-359b-410d-a576-9e00453a32ba tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:37.565095 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=91,nova_api:DELETE=5 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:37.598644 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e8c18a17-359b-410d-a576-9e00453a32ba tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.063637 Oct 10 23:17:37.605173 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 151/305] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:17:37 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 23:17:37.617396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b1361a5b-0051-462a-8f53-56fe693ac745 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Action: 'update', calling method: .version_select at 0x7f663024d700>, body: {"quota_set": {"instances": 10}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:37.835572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7189b707-cfdf-4d28-8929-a62f0085f2fd tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:37.847882 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7189b707-cfdf-4d28-8929-a62f0085f2fd tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c" status: 200 len: 1386 microversion: 2.1 time: 0.910942 Oct 10 23:17:37.848421 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 155/306] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:36 2022] GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c => generated 1386 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:37.865536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a2413ecd-4fcd-4c7c-b921-1db9ad9c25e4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:37.866449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a2413ecd-4fcd-4c7c-b921-1db9ad9c25e4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 90aa3419-44a6-4b0d-9af1-5f6df3554b71] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:37.885967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2413ecd-4fcd-4c7c-b921-1db9ad9c25e4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:37.888291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2413ecd-4fcd-4c7c-b921-1db9ad9c25e4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:37.890264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2413ecd-4fcd-4c7c-b921-1db9ad9c25e4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:37.891168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2413ecd-4fcd-4c7c-b921-1db9ad9c25e4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:37.893776 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2413ecd-4fcd-4c7c-b921-1db9ad9c25e4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:37.896283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2413ecd-4fcd-4c7c-b921-1db9ad9c25e4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:38.169715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1361a5b-0051-462a-8f53-56fe693ac745 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:38.170960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1361a5b-0051-462a-8f53-56fe693ac745 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:38.170960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1361a5b-0051-462a-8f53-56fe693ac745 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:38.171619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1361a5b-0051-462a-8f53-56fe693ac745 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:38.172069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1361a5b-0051-462a-8f53-56fe693ac745 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:38.184622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1361a5b-0051-462a-8f53-56fe693ac745 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:38.309545 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b1361a5b-0051-462a-8f53-56fe693ac745 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/7bf9c1068cc5492dadf524865d23c501" status: 200 len: 329 microversion: 2.1 time: 0.701111 Oct 10 23:17:38.314259 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 152/307] 10.222.0.23 () {60 vars in 1262 bytes} [Mon Oct 10 23:17:37 2022] PUT /compute/v2.1/os-quota-sets/7bf9c1068cc5492dadf524865d23c501 => generated 329 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:38.319091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-96520b92-1ef6-44a8-9589-bd2176b7d5c1 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:38.330364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-96520b92-1ef6-44a8-9589-bd2176b7d5c1 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3b9a7c40-1a80-4be4-ba69-71487800d1f5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:38.346089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96520b92-1ef6-44a8-9589-bd2176b7d5c1 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:38.346597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96520b92-1ef6-44a8-9589-bd2176b7d5c1 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:38.347036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96520b92-1ef6-44a8-9589-bd2176b7d5c1 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:38.347760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96520b92-1ef6-44a8-9589-bd2176b7d5c1 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:38.348214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96520b92-1ef6-44a8-9589-bd2176b7d5c1 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:38.348837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96520b92-1ef6-44a8-9589-bd2176b7d5c1 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:38.398443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a2413ecd-4fcd-4c7c-b921-1db9ad9c25e4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:38.421626 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a2413ecd-4fcd-4c7c-b921-1db9ad9c25e4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71" status: 200 len: 1317 microversion: 2.1 time: 0.565659 Oct 10 23:17:38.424102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96520b92-1ef6-44a8-9589-bd2176b7d5c1 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:38.424768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96520b92-1ef6-44a8-9589-bd2176b7d5c1 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:38.425883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96520b92-1ef6-44a8-9589-bd2176b7d5c1 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:38.430543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-96520b92-1ef6-44a8-9589-bd2176b7d5c1 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lazy-loading 'fault' on Instance uuid 3b9a7c40-1a80-4be4-ba69-71487800d1f5 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:17:38.449057 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 156/308] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:37 2022] GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71 => generated 1317 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:38.474330 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-020d6c4d-4e4e-4b39-849f-8dcfd93bba4b tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1713292506", "availability_zone": "tempest-test_az-639825524"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:38.486389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.aggregate [None req-020d6c4d-4e4e-4b39-849f-8dcfd93bba4b tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Generated uuid 3b53dfd7-a299-40c1-8d62-2b3fa80b5d97 for aggregate {{(pid=120614) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 23:17:38.563972 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-020d6c4d-4e4e-4b39-849f-8dcfd93bba4b tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.113609 Oct 10 23:17:38.565187 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 157/309] 10.222.0.23 () {60 vars in 1165 bytes} [Mon Oct 10 23:17:38 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:38.572555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0015fc43-bf95-44d4-8b94-d25f6ea08816 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Calling method '.version_select at 0x7f66302923a0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:39.104802 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0015fc43-bf95-44d4-8b94-d25f6ea08816 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/7bf9c1068cc5492dadf524865d23c501" status: 200 len: 371 microversion: 2.1 time: 0.538217 Oct 10 23:17:39.106099 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 158/310] 10.222.0.23 () {58 vars in 1242 bytes} [Mon Oct 10 23:17:38 2022] GET /compute/v2.1/os-quota-sets/7bf9c1068cc5492dadf524865d23c501 => generated 371 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:39.111477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d4da6ef4-6748-4fdd-ae6d-82c61033d020 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1713292506_new", "availability_zone": "tempest-test_az-639825524_new"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:39.155557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-96520b92-1ef6-44a8-9589-bd2176b7d5c1 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:39.169093 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-96520b92-1ef6-44a8-9589-bd2176b7d5c1 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5" status: 200 len: 1450 microversion: 2.1 time: 0.849152 Oct 10 23:17:39.181399 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 153/311] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:38 2022] GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5 => generated 1450 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:39.187198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dc7b6749-dc82-4ea0-b841-06fa279aeee4 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:39.189134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dc7b6749-dc82-4ea0-b841-06fa279aeee4 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: 12574d37-08bd-4e05-8953-e2e680ebee8c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:39.198559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc7b6749-dc82-4ea0-b841-06fa279aeee4 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:39.201429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc7b6749-dc82-4ea0-b841-06fa279aeee4 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:39.202155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc7b6749-dc82-4ea0-b841-06fa279aeee4 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:39.205556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc7b6749-dc82-4ea0-b841-06fa279aeee4 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:39.206318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc7b6749-dc82-4ea0-b841-06fa279aeee4 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:39.207007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc7b6749-dc82-4ea0-b841-06fa279aeee4 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:39.373811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4da6ef4-6748-4fdd-ae6d-82c61033d020 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:39.376340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4da6ef4-6748-4fdd-ae6d-82c61033d020 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:39.378288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4da6ef4-6748-4fdd-ae6d-82c61033d020 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:39.470531 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d4da6ef4-6748-4fdd-ae6d-82c61033d020 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 334 microversion: 2.1 time: 0.363139 Oct 10 23:17:39.473415 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 159/312] 10.222.0.23 () {60 vars in 1170 bytes} [Mon Oct 10 23:17:39 2022] PUT /compute/v2.1/os-aggregates/9 => generated 334 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:39.488732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5083e01e-39cd-47d3-a682-c0df468f86b3 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Action: 'update', calling method: .version_select at 0x7f663026d310>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:39.563689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dc7b6749-dc82-4ea0-b841-06fa279aeee4 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:39.574010 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dc7b6749-dc82-4ea0-b841-06fa279aeee4 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c" status: 200 len: 1386 microversion: 2.1 time: 0.402476 Oct 10 23:17:39.579137 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 154/313] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:39 2022] GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c => generated 1386 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:39.597817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ae3df617-7388-4ad8-a4d7-1a5e20494cbe tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:39.598619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ae3df617-7388-4ad8-a4d7-1a5e20494cbe tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3b9a7c40-1a80-4be4-ba69-71487800d1f5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:39.611922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae3df617-7388-4ad8-a4d7-1a5e20494cbe tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:39.612780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae3df617-7388-4ad8-a4d7-1a5e20494cbe tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:39.613823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae3df617-7388-4ad8-a4d7-1a5e20494cbe tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:39.614759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae3df617-7388-4ad8-a4d7-1a5e20494cbe tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:39.615434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae3df617-7388-4ad8-a4d7-1a5e20494cbe tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:39.616458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae3df617-7388-4ad8-a4d7-1a5e20494cbe tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:39.664046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ae3df617-7388-4ad8-a4d7-1a5e20494cbe tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3b9a7c40-1a80-4be4-ba69-71487800d1f5] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:17:39.928356 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ae3df617-7388-4ad8-a4d7-1a5e20494cbe tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5" status: 204 len: 0 microversion: 2.1 time: 0.347747 Oct 10 23:17:39.932120 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 155/314] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:17:39 2022] DELETE /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:17:39.946601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-01bdea06-17ca-494b-ba1d-8242253a7101 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:39.947318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-01bdea06-17ca-494b-ba1d-8242253a7101 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 90aa3419-44a6-4b0d-9af1-5f6df3554b71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:39.962877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01bdea06-17ca-494b-ba1d-8242253a7101 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:39.963555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01bdea06-17ca-494b-ba1d-8242253a7101 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:39.963980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01bdea06-17ca-494b-ba1d-8242253a7101 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:39.964683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01bdea06-17ca-494b-ba1d-8242253a7101 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:39.965132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01bdea06-17ca-494b-ba1d-8242253a7101 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:39.965581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01bdea06-17ca-494b-ba1d-8242253a7101 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:40.081943 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5083e01e-39cd-47d3-a682-c0df468f86b3 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:40.082716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5083e01e-39cd-47d3-a682-c0df468f86b3 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:40.083166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5083e01e-39cd-47d3-a682-c0df468f86b3 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:40.083910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5083e01e-39cd-47d3-a682-c0df468f86b3 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:40.084369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5083e01e-39cd-47d3-a682-c0df468f86b3 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:40.085074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5083e01e-39cd-47d3-a682-c0df468f86b3 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:40.156598 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5083e01e-39cd-47d3-a682-c0df468f86b3 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/7bf9c1068cc5492dadf524865d23c501" status: 200 len: 325 microversion: 2.1 time: 0.681836 Oct 10 23:17:40.168558 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 160/315] 10.222.0.23 () {60 vars in 1262 bytes} [Mon Oct 10 23:17:39 2022] PUT /compute/v2.1/os-quota-sets/7bf9c1068cc5492dadf524865d23c501 => generated 325 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:40.168558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-76cd2876-48bb-42fc-9451-428b0bfde3cc tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:40.171882 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-76cd2876-48bb-42fc-9451-428b0bfde3cc tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.013099 Oct 10 23:17:40.180299 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 161/316] 10.222.0.23 () {58 vars in 1143 bytes} [Mon Oct 10 23:17:40 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:40.180299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-6cdf4d33-9d26-45ea-829c-d68f42d57a92 req-84fe8bf6-cc1a-4750-8f3e-6e7ad747072d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90aa3419-44a6-4b0d-9af1-5f6df3554b71", "tag": "e7e827df-c293-4503-a382-723a56a14034"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:40.193129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6cdf4d33-9d26-45ea-829c-d68f42d57a92 req-84fe8bf6-cc1a-4750-8f3e-6e7ad747072d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:40.193255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6cdf4d33-9d26-45ea-829c-d68f42d57a92 req-84fe8bf6-cc1a-4750-8f3e-6e7ad747072d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:40.193857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6cdf4d33-9d26-45ea-829c-d68f42d57a92 req-84fe8bf6-cc1a-4750-8f3e-6e7ad747072d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:40.210619 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-6cdf4d33-9d26-45ea-829c-d68f42d57a92 req-84fe8bf6-cc1a-4750-8f3e-6e7ad747072d service nova] Creating event network-changed:e7e827df-c293-4503-a382-723a56a14034 for instance 90aa3419-44a6-4b0d-9af1-5f6df3554b71 on n-h2-860864-2 Oct 10 23:17:40.220716 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-6cdf4d33-9d26-45ea-829c-d68f42d57a92 req-84fe8bf6-cc1a-4750-8f3e-6e7ad747072d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044639 Oct 10 23:17:40.220716 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 162/317] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:40.239174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9667a1b2-a1f4-45ad-af7d-53c82fa859bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:40.239942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9667a1b2-a1f4-45ad-af7d-53c82fa859bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3b9a7c40-1a80-4be4-ba69-71487800d1f5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:40.250230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9667a1b2-a1f4-45ad-af7d-53c82fa859bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:40.251982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9667a1b2-a1f4-45ad-af7d-53c82fa859bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:40.252730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9667a1b2-a1f4-45ad-af7d-53c82fa859bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:40.255795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9667a1b2-a1f4-45ad-af7d-53c82fa859bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:40.257989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9667a1b2-a1f4-45ad-af7d-53c82fa859bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:40.259304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9667a1b2-a1f4-45ad-af7d-53c82fa859bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:40.307205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9667a1b2-a1f4-45ad-af7d-53c82fa859bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:40.307703 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9667a1b2-a1f4-45ad-af7d-53c82fa859bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:40.308214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9667a1b2-a1f4-45ad-af7d-53c82fa859bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:40.308601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-9667a1b2-a1f4-45ad-af7d-53c82fa859bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lazy-loading 'fault' on Instance uuid 3b9a7c40-1a80-4be4-ba69-71487800d1f5 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:17:40.645002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-01bdea06-17ca-494b-ba1d-8242253a7101 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:40.653343 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-01bdea06-17ca-494b-ba1d-8242253a7101 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71" status: 200 len: 1317 microversion: 2.1 time: 0.719639 Oct 10 23:17:40.657014 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 156/318] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:39 2022] GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71 => generated 1317 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:40.676808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-e8c79753-49ae-488d-9b8b-25ccb603cfc4 req-cfa47683-4def-443d-89ff-1714535a7817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12574d37-08bd-4e05-8953-e2e680ebee8c", "name": "network-vif-plugged", "status": "completed", "tag": "30719613-9b48-4dc7-8ef2-88f2ccd9e780"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:40.699484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e8c79753-49ae-488d-9b8b-25ccb603cfc4 req-cfa47683-4def-443d-89ff-1714535a7817 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:40.704092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e8c79753-49ae-488d-9b8b-25ccb603cfc4 req-cfa47683-4def-443d-89ff-1714535a7817 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:40.704573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e8c79753-49ae-488d-9b8b-25ccb603cfc4 req-cfa47683-4def-443d-89ff-1714535a7817 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:40.741836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9667a1b2-a1f4-45ad-af7d-53c82fa859bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:40.742585 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-e8c79753-49ae-488d-9b8b-25ccb603cfc4 req-cfa47683-4def-443d-89ff-1714535a7817 service nova] Creating event network-vif-plugged:30719613-9b48-4dc7-8ef2-88f2ccd9e780 for instance 12574d37-08bd-4e05-8953-e2e680ebee8c on n-h1-860864-2 Oct 10 23:17:40.748943 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-e8c79753-49ae-488d-9b8b-25ccb603cfc4 req-cfa47683-4def-443d-89ff-1714535a7817 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090228 Oct 10 23:17:40.752260 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 157/319] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:40.761108 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9667a1b2-a1f4-45ad-af7d-53c82fa859bb tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5" status: 200 len: 1456 microversion: 2.1 time: 0.539188 Oct 10 23:17:40.775354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e3f97e94-12a2-4ee1-a23e-2686c5763439 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:40.777808 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 163/320] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:40 2022] GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5 => generated 1456 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:40.804028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a8057dbb-6c45-4621-a7aa-30c4ac238e2f tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1972566699", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:40.825224 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e3f97e94-12a2-4ee1-a23e-2686c5763439 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.065257 Oct 10 23:17:40.830115 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 158/321] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:17:40 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 23:17:40.838756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-86041583-48c0-44c1-8100-2a163691801f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:40.839806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-86041583-48c0-44c1-8100-2a163691801f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: 12574d37-08bd-4e05-8953-e2e680ebee8c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:40.853252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86041583-48c0-44c1-8100-2a163691801f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:40.857740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86041583-48c0-44c1-8100-2a163691801f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:40.871496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86041583-48c0-44c1-8100-2a163691801f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:40.875468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86041583-48c0-44c1-8100-2a163691801f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:40.877367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86041583-48c0-44c1-8100-2a163691801f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:40.879238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86041583-48c0-44c1-8100-2a163691801f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:40.922304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-a8057dbb-6c45-4621-a7aa-30c4ac238e2f tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] validate_networks() for None {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:17:41.381661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-a8057dbb-6c45-4621-a7aa-30c4ac238e2f tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:17:41.382189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-a8057dbb-6c45-4621-a7aa-30c4ac238e2f tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:17:41.383379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-a8057dbb-6c45-4621-a7aa-30c4ac238e2f tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:17:41.383889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-a8057dbb-6c45-4621-a7aa-30c4ac238e2f tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:17:41.384390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-a8057dbb-6c45-4621-a7aa-30c4ac238e2f tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:17:41.408777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8057dbb-6c45-4621-a7aa-30c4ac238e2f tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:41.409286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8057dbb-6c45-4621-a7aa-30c4ac238e2f tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:41.409820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8057dbb-6c45-4621-a7aa-30c4ac238e2f tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:41.411392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8057dbb-6c45-4621-a7aa-30c4ac238e2f tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:41.411934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8057dbb-6c45-4621-a7aa-30c4ac238e2f tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:41.412437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8057dbb-6c45-4621-a7aa-30c4ac238e2f tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:41.458633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-a8057dbb-6c45-4621-a7aa-30c4ac238e2f tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Getting quotas for project 7bf9c1068cc5492dadf524865d23c501. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:17:41.471883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-a8057dbb-6c45-4621-a7aa-30c4ac238e2f tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Getting quotas for user 00d2a9f89dba43508243a4d0cae76c40 and project 7bf9c1068cc5492dadf524865d23c501. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:17:41.503986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.utils [None req-a8057dbb-6c45-4621-a7aa-30c4ac238e2f tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] ram quota exceeded for 7bf9c1068cc5492dadf524865d23c501, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120614) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 10 23:17:41.506870 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-a8057dbb-6c45-4621-a7aa-30c4ac238e2f tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 10 23:17:41.518164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a8057dbb-6c45-4621-a7aa-30c4ac238e2f tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Request method failure captured: Oct 10 23:17:41.518164 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:17:41.518164 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:17:41.518164 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:17:41.518164 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:17:41.518164 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 145 Oct 10 23:17:41.518164 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:17:41.518164 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:17:41.518164 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:17:41.518164 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:41.518164 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgJ55cgDZN3sOh5coqUGCjGbc8VkeOpRpucTdFkLbGW1HN1pzwx4HV3QZWTst8SHc7cRSpk6gzomkf17zAHsY3xZdM-0W_Y6RxvRGiCCSfmU3VLGLrdYMkQphGzsgKQDvOMu2yxNYPq2RmI7vu6ldI8ou4oy0zB_V3o-3zrRYj9SMM Oct 10 23:17:41.518164 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:17:41.518164 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:17:41.518164 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:17:41.518164 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:17:41.518164 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:17:41.518164 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:17:41.518164 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 7bf9c1068cc5492dadf524865d23c501 Oct 10 23:17:41.518164 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-QuotasAdminNegativeTest-1230081964 Oct 10 23:17:41.518164 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:17:41.518164 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:17:41.519614 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7bf9c1068cc5492dadf524865d23c501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7bf9c1068cc5492dadf524865d23c501"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7bf9c1068cc5492dadf524865d23c501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7bf9c1068cc5492dadf524865d23c501", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:41.519614 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-QuotasAdminNegativeTest-1230081964 Oct 10 23:17:41.519614 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 7bf9c1068cc5492dadf524865d23c501 Oct 10 23:17:41.519614 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1230081964 Oct 10 23:17:41.519614 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-QuotasAdminNegativeTest-1230081964-project Oct 10 23:17:41.519614 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:17:41.519614 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:17:41.519614 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 00d2a9f89dba43508243a4d0cae76c40 Oct 10 23:17:41.519614 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-QuotasAdminNegativeTest-1230081964-project Oct 10 23:17:41.519614 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:17:41.519614 n-d-860864-2 devstack@n-api.service[120614]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1972566699", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} Oct 10 23:17:41.519614 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:17:41.520428 n-d-860864-2 devstack@n-api.service[120614]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 10 23:17:41.520428 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1972566699', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452'}}} Oct 10 23:17:41.520428 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:41.520428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:41.520428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 10 23:17:41.520428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 10 23:17:41.520428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:17:41.520428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:17:41.520428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 10 23:17:41.520428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc Oct 10 23:17:41.520428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 10 23:17:41.520428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 10 23:17:41.520428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:17:41.520428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:17:41.520428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 10 23:17:41.520428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 10 23:17:41.520428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 10 23:17:41.520428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 10 23:17:41.522112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 10 23:17:41.522112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 10 23:17:41.522112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 10 23:17:41.522112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:41.522112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:41.522112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:41.522112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:41.522112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 10 23:17:41.522112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 10 23:17:41.522112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 10 23:17:41.522112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 10 23:17:41.522112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 10 23:17:41.522112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 10 23:17:41.522112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 10 23:17:41.522112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 10 23:17:41.522112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 10 23:17:41.522112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 10 23:17:41.522112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 10 23:17:41.522112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:41.522112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:41.522112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:41.524635 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:41.524635 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:41.524635 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:41.524635 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:41.524635 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:41.524635 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:41.524635 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:41.524635 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:41.524635 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:41.524635 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:41.524635 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:41.524635 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:41.524635 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:41.524635 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 23:17:41.524635 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 10 23:17:41.524635 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 10 23:17:41.524635 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 10 23:17:41.524635 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:41.524635 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:41.524635 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:41.524635 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:41.526726 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:41.526726 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:41.526726 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:41.526726 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:41.526726 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 10 23:17:41.526726 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:41.526726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a8057dbb-6c45-4621-a7aa-30c4ac238e2f tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:41.529112 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a8057dbb-6c45-4621-a7aa-30c4ac238e2f tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.743526 Oct 10 23:17:41.530566 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 164/322] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:17:40 2022] POST /compute/v2.1/servers => generated 110 bytes in 752 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:17:41.543255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-62015c19-86f7-40bc-afd4-fb86776cc84a tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1944973230"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:41.553604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.aggregate [None req-62015c19-86f7-40bc-afd4-fb86776cc84a tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Generated uuid 7e2ece3c-546c-4d8f-93bb-0199e4a37ba7 for aggregate {{(pid=120614) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 23:17:41.598443 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-62015c19-86f7-40bc-afd4-fb86776cc84a tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.064668 Oct 10 23:17:41.604643 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 165/323] 10.222.0.23 () {60 vars in 1164 bytes} [Mon Oct 10 23:17:41 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:41.610687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-79c304f1-d4da-455b-8ec8-6fa6cffbb426 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Action: 'update', calling method: .version_select at 0x7f663017cca0>, body: {"quota_set": {"ram": 51200}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:41.985583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-86041583-48c0-44c1-8100-2a163691801f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:42.000280 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-86041583-48c0-44c1-8100-2a163691801f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c" status: 200 len: 1386 microversion: 2.1 time: 1.168679 Oct 10 23:17:42.001191 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 159/324] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:40 2022] GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c => generated 1386 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:42.013879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6992d502-cba1-44b0-a158-c7d9d6fb09b8 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:42.032405 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6992d502-cba1-44b0-a158-c7d9d6fb09b8 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.027999 Oct 10 23:17:42.034932 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 160/325] 10.222.0.23 () {58 vars in 1143 bytes} [Mon Oct 10 23:17:42 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:42.043650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1dedf856-8af4-4d09-992b-6aa81eb7e0e5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:42.048631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1dedf856-8af4-4d09-992b-6aa81eb7e0e5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 90aa3419-44a6-4b0d-9af1-5f6df3554b71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:42.059669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1dedf856-8af4-4d09-992b-6aa81eb7e0e5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:42.062675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1dedf856-8af4-4d09-992b-6aa81eb7e0e5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:42.064641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1dedf856-8af4-4d09-992b-6aa81eb7e0e5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:42.066090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1dedf856-8af4-4d09-992b-6aa81eb7e0e5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:42.069176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1dedf856-8af4-4d09-992b-6aa81eb7e0e5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:42.070436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1dedf856-8af4-4d09-992b-6aa81eb7e0e5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:42.216967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79c304f1-d4da-455b-8ec8-6fa6cffbb426 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:42.219351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79c304f1-d4da-455b-8ec8-6fa6cffbb426 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:42.219958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79c304f1-d4da-455b-8ec8-6fa6cffbb426 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:42.220961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79c304f1-d4da-455b-8ec8-6fa6cffbb426 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:42.221611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79c304f1-d4da-455b-8ec8-6fa6cffbb426 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:42.222202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79c304f1-d4da-455b-8ec8-6fa6cffbb426 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:42.297195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:UPDATE=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:42.312050 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-79c304f1-d4da-455b-8ec8-6fa6cffbb426 tempest-QuotasAdminNegativeTest-1784491858 tempest-QuotasAdminNegativeTest-1784491858-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/7bf9c1068cc5492dadf524865d23c501" status: 200 len: 329 microversion: 2.1 time: 0.705972 Oct 10 23:17:42.313543 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 166/326] 10.222.0.23 () {60 vars in 1262 bytes} [Mon Oct 10 23:17:41 2022] PUT /compute/v2.1/os-quota-sets/7bf9c1068cc5492dadf524865d23c501 => generated 329 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:42.331106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6b54b824-0574-4512-93ff-347cc565ba51 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:42.331961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6b54b824-0574-4512-93ff-347cc565ba51 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3b9a7c40-1a80-4be4-ba69-71487800d1f5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:42.339272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b54b824-0574-4512-93ff-347cc565ba51 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:42.339974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b54b824-0574-4512-93ff-347cc565ba51 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:42.340611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b54b824-0574-4512-93ff-347cc565ba51 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:42.341818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b54b824-0574-4512-93ff-347cc565ba51 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:42.342526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b54b824-0574-4512-93ff-347cc565ba51 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:42.343132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b54b824-0574-4512-93ff-347cc565ba51 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:42.384337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1dedf856-8af4-4d09-992b-6aa81eb7e0e5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:42.395356 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1dedf856-8af4-4d09-992b-6aa81eb7e0e5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71" status: 200 len: 1317 microversion: 2.1 time: 0.359023 Oct 10 23:17:42.396173 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 161/327] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:42 2022] GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71 => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:42.404560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a7b71729-2607-4c45-9f0b-0e2c69db7fd7 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:42.422610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b54b824-0574-4512-93ff-347cc565ba51 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:42.424524 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b54b824-0574-4512-93ff-347cc565ba51 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:42.425277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b54b824-0574-4512-93ff-347cc565ba51 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:42.426150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-6b54b824-0574-4512-93ff-347cc565ba51 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lazy-loading 'fault' on Instance uuid 3b9a7c40-1a80-4be4-ba69-71487800d1f5 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:17:42.473312 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a7b71729-2607-4c45-9f0b-0e2c69db7fd7 tempest-AggregatesAdminTestJSON-1378333410 tempest-AggregatesAdminTestJSON-1378333410-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.073063 Oct 10 23:17:42.473979 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 162/328] 10.222.0.23 () {58 vars in 1155 bytes} [Mon Oct 10 23:17:42 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 23:17:42.564271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6b54b824-0574-4512-93ff-347cc565ba51 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:42.573430 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6b54b824-0574-4512-93ff-347cc565ba51 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5" status: 200 len: 1414 microversion: 2.1 time: 0.249933 Oct 10 23:17:42.585663 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 167/329] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:42 2022] GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5 => generated 1414 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:42.586403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6118c59b-adec-41c8-8eaa-006d8381a279 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Action: 'update', calling method: .version_select at 0x7f663017cf70>, body: {"quota_set": {"ram": 0}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:42.606277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6118c59b-adec-41c8-8eaa-006d8381a279 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '00d2a9f89dba43508243a4d0cae76c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bf9c1068cc5492dadf524865d23c501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:42.609540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6118c59b-adec-41c8-8eaa-006d8381a279 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Request method failure captured: Oct 10 23:17:42.609540 n-d-860864-2 devstack@n-api.service[120614]: request: PUT /compute/v2.1/os-quota-sets/7bf9c1068cc5492dadf524865d23c501 HTTP/1.1 Oct 10 23:17:42.609540 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:17:42.609540 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:17:42.609540 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:17:42.609540 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 25 Oct 10 23:17:42.609540 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:17:42.609540 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:17:42.609540 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:17:42.609540 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:42.609540 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgJ55cgDZN3sOh5coqUGCjGbc8VkeOpRpucTdFkLbGW1HN1pzwx4HV3QZWTst8SHc7cRSpk6gzomkf17zAHsY3xZdM-0W_Y6RxvRGiCCSfmU3VLGLrdYMkQphGzsgKQDvOMu2yxNYPq2RmI7vu6ldI8ou4oy0zB_V3o-3zrRYj9SMM Oct 10 23:17:42.609540 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:17:42.609540 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:17:42.609540 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:17:42.609540 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:17:42.609540 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:17:42.609540 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:17:42.609540 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 7bf9c1068cc5492dadf524865d23c501 Oct 10 23:17:42.609540 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-QuotasAdminNegativeTest-1230081964 Oct 10 23:17:42.609540 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:17:42.609540 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:17:42.611008 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7bf9c1068cc5492dadf524865d23c501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7bf9c1068cc5492dadf524865d23c501"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7bf9c1068cc5492dadf524865d23c501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7bf9c1068cc5492dadf524865d23c501", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:42.611008 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-QuotasAdminNegativeTest-1230081964 Oct 10 23:17:42.611008 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 7bf9c1068cc5492dadf524865d23c501 Oct 10 23:17:42.611008 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1230081964 Oct 10 23:17:42.611008 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-QuotasAdminNegativeTest-1230081964-project Oct 10 23:17:42.611008 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:17:42.611008 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:17:42.611008 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 00d2a9f89dba43508243a4d0cae76c40 Oct 10 23:17:42.611008 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-QuotasAdminNegativeTest-1230081964-project Oct 10 23:17:42.611008 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:17:42.611008 n-d-860864-2 devstack@n-api.service[120614]: {"quota_set": {"ram": 0}} Oct 10 23:17:42.611008 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:17:42.611008 n-d-860864-2 devstack@n-api.service[120614]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 10 23:17:42.611008 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '7bf9c1068cc5492dadf524865d23c501', 'body': {'quota_set': {'ram': 0}}} Oct 10 23:17:42.611982 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:42.611982 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:42.611982 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:42.611982 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:42.611982 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:42.611982 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:42.611982 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:17:42.611982 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:17:42.611982 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:42.611982 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:42.611982 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:42.611982 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:42.611982 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 10 23:17:42.611982 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 10 23:17:42.611982 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 23:17:42.611982 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:42.611982 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 23:17:42.611982 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:42.611982 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 10 23:17:42.613340 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 10 23:17:42.613340 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:17:42.613340 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:17:42.613340 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:17:42.613340 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:17:42.613340 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:17:42.613340 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:17:42.613340 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:17:42.613340 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:17:42.613340 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:17:42.613340 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:17:42.613340 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:17:42.613340 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:17:42.613340 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:17:42.613340 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:17:42.613340 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 10 23:17:42.613340 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:42.613340 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:42.613340 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:42.613340 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:42.614855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:42.614855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:42.614855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:17:42.614855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:17:42.614855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 10 23:17:42.614855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:42.614855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6118c59b-adec-41c8-8eaa-006d8381a279 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:42.614855 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6118c59b-adec-41c8-8eaa-006d8381a279 tempest-QuotasAdminNegativeTest-1230081964 tempest-QuotasAdminNegativeTest-1230081964-project] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/7bf9c1068cc5492dadf524865d23c501" status: 403 len: 116 microversion: 2.1 time: 0.028429 Oct 10 23:17:42.614855 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 168/330] 10.222.0.23 () {60 vars in 1262 bytes} [Mon Oct 10 23:17:42 2022] PUT /compute/v2.1/os-quota-sets/7bf9c1068cc5492dadf524865d23c501 => generated 116 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:17:42.635208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e34696bc-a049-4e50-a0e7-f6669a74fffb tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:42.635719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e34696bc-a049-4e50-a0e7-f6669a74fffb tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:42.672090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e34696bc-a049-4e50-a0e7-f6669a74fffb tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:42.672932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e34696bc-a049-4e50-a0e7-f6669a74fffb tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:42.673534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e34696bc-a049-4e50-a0e7-f6669a74fffb tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:42.674386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e34696bc-a049-4e50-a0e7-f6669a74fffb tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:42.683634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e34696bc-a049-4e50-a0e7-f6669a74fffb tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:42.684366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e34696bc-a049-4e50-a0e7-f6669a74fffb tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:42.696249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7c951787-95f7-4c0b-b768-660d8d63f802 tempest-FlavorsV2NegativeTest-933950243 tempest-FlavorsV2NegativeTest-933950243-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:42.716862 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-e34696bc-a049-4e50-a0e7-f6669a74fffb tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] HTTP exception thrown: Instance 41c23198-c951-4c85-b87c-6f10d6835eaf could not be found. Oct 10 23:17:42.718847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e34696bc-a049-4e50-a0e7-f6669a74fffb tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Request method failure captured: Oct 10 23:17:42.718847 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf HTTP/1.1 Oct 10 23:17:42.718847 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:17:42.718847 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:17:42.718847 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:17:42.718847 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:17:42.718847 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:17:42.718847 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:17:42.718847 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:17:42.718847 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:42.718847 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKfMtlbv81fvlKtYKW6wOajkWrTu0IC2zEnoCWGsV-CzpWY6oxUF6K9REpwcqTICtW3eoXo_qzeuAkzN8b3tNhcuGfOz_b7MAUUWLTZ5moYE7TxMSQ3XGMSqczTVAgvbYeR_L7NnQlFeVI_JdtR1eir51R7xAQ-vp522-dDfSusDvjs Oct 10 23:17:42.718847 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:17:42.718847 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:17:42.718847 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:17:42.718847 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:17:42.718847 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:17:42.718847 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:17:42.718847 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 44bbffb85d0c4d51b038cf010f9ffa84 Oct 10 23:17:42.718847 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AggregatesAdminTestJSON-156151763 Oct 10 23:17:42.718847 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:17:42.718847 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:17:42.720186 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/44bbffb85d0c4d51b038cf010f9ffa84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44bbffb85d0c4d51b038cf010f9ffa84"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44bbffb85d0c4d51b038cf010f9ffa84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_44bbffb85d0c4d51b038cf010f9ffa84", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:42.720186 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AggregatesAdminTestJSON-156151763 Oct 10 23:17:42.720186 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 44bbffb85d0c4d51b038cf010f9ffa84 Oct 10 23:17:42.720186 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-156151763 Oct 10 23:17:42.720186 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AggregatesAdminTestJSON-156151763-project Oct 10 23:17:42.720186 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:17:42.720186 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:17:42.720186 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 67c7c0c5c6a34d429fcc76135bdae5e7 Oct 10 23:17:42.720186 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AggregatesAdminTestJSON-156151763-project Oct 10 23:17:42.720186 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:17:42.720186 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 41c23198-c951-4c85-b87c-6f10d6835eaf could not be found. Oct 10 23:17:42.720186 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '41c23198-c951-4c85-b87c-6f10d6835eaf'} Oct 10 23:17:42.720929 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:42.720929 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:42.720929 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:17:42.720929 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:17:42.720929 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:17:42.720929 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:17:42.720929 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:17:42.720929 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:17:42.720929 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:17:42.720929 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:17:42.720929 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41c23198-c951-4c85-b87c-6f10d6835eaf could not be found. Oct 10 23:17:42.720929 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:42.720929 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:42.720929 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:42.720929 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:42.720929 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:42.720929 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:42.720929 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:42.720929 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:42.720929 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:42.722113 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:42.722113 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:17:42.722113 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:17:42.722113 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:17:42.722113 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:17:42.722113 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:17:42.722113 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:17:42.722113 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:17:42.722113 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:17:42.722113 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41c23198-c951-4c85-b87c-6f10d6835eaf could not be found. Oct 10 23:17:42.722113 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:42.722113 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:42.722113 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:42.722113 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:42.722113 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:42.722113 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:42.722113 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:42.722113 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:42.722113 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41c23198-c951-4c85-b87c-6f10d6835eaf could not be found. Oct 10 23:17:42.722113 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:42.725714 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7c951787-95f7-4c0b-b768-660d8d63f802 tempest-FlavorsV2NegativeTest-933950243 tempest-FlavorsV2NegativeTest-933950243-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.250356 Oct 10 23:17:42.726804 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 163/331] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:17:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:42.727696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e34696bc-a049-4e50-a0e7-f6669a74fffb tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Returning 404 to user: Instance 41c23198-c951-4c85-b87c-6f10d6835eaf could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:42.729214 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e34696bc-a049-4e50-a0e7-f6669a74fffb tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "DELETE /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 404 len: 111 microversion: 2.1 time: 0.114961 Oct 10 23:17:42.730165 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 169/332] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:17:42 2022] DELETE /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:17:42.732846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-2911a32d-21a0-4f6e-ae9d-2759ad72cc66 req-7a6945a8-7129-409d-b1e7-e4192c5336ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9a7c40-1a80-4be4-ba69-71487800d1f5", "name": "network-vif-deleted", "tag": "1ceac712-6e6b-44a9-908f-d81d757aa539"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:42.742845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-128a80c6-d7ec-4cee-a803-95db0df84499 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:42.743756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-128a80c6-d7ec-4cee-a803-95db0df84499 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] [instance: 41c23198-c951-4c85-b87c-6f10d6835eaf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:42.746304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2911a32d-21a0-4f6e-ae9d-2759ad72cc66 req-7a6945a8-7129-409d-b1e7-e4192c5336ab service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:42.746986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2911a32d-21a0-4f6e-ae9d-2759ad72cc66 req-7a6945a8-7129-409d-b1e7-e4192c5336ab service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:42.748440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2911a32d-21a0-4f6e-ae9d-2759ad72cc66 req-7a6945a8-7129-409d-b1e7-e4192c5336ab service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:42.754327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-128a80c6-d7ec-4cee-a803-95db0df84499 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:42.755510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-128a80c6-d7ec-4cee-a803-95db0df84499 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:42.756937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-128a80c6-d7ec-4cee-a803-95db0df84499 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:42.758000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-128a80c6-d7ec-4cee-a803-95db0df84499 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:42.758606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-128a80c6-d7ec-4cee-a803-95db0df84499 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:42.759314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-128a80c6-d7ec-4cee-a803-95db0df84499 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:42.776276 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-128a80c6-d7ec-4cee-a803-95db0df84499 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] HTTP exception thrown: Instance 41c23198-c951-4c85-b87c-6f10d6835eaf could not be found. Oct 10 23:17:42.779475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-128a80c6-d7ec-4cee-a803-95db0df84499 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Request method failure captured: Oct 10 23:17:42.779475 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf HTTP/1.1 Oct 10 23:17:42.779475 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:17:42.779475 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:17:42.779475 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:17:42.779475 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:17:42.779475 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:17:42.779475 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:17:42.779475 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:17:42.779475 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:42.779475 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKfMtlbv81fvlKtYKW6wOajkWrTu0IC2zEnoCWGsV-CzpWY6oxUF6K9REpwcqTICtW3eoXo_qzeuAkzN8b3tNhcuGfOz_b7MAUUWLTZ5moYE7TxMSQ3XGMSqczTVAgvbYeR_L7NnQlFeVI_JdtR1eir51R7xAQ-vp522-dDfSusDvjs Oct 10 23:17:42.779475 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:17:42.779475 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:17:42.779475 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:17:42.779475 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:17:42.779475 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:17:42.779475 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:17:42.779475 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 44bbffb85d0c4d51b038cf010f9ffa84 Oct 10 23:17:42.779475 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AggregatesAdminTestJSON-156151763 Oct 10 23:17:42.779475 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:17:42.779475 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:17:42.780790 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/44bbffb85d0c4d51b038cf010f9ffa84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44bbffb85d0c4d51b038cf010f9ffa84"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44bbffb85d0c4d51b038cf010f9ffa84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_44bbffb85d0c4d51b038cf010f9ffa84", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:42.780790 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AggregatesAdminTestJSON-156151763 Oct 10 23:17:42.780790 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 44bbffb85d0c4d51b038cf010f9ffa84 Oct 10 23:17:42.780790 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-156151763 Oct 10 23:17:42.780790 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AggregatesAdminTestJSON-156151763-project Oct 10 23:17:42.780790 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:17:42.780790 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:17:42.780790 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 67c7c0c5c6a34d429fcc76135bdae5e7 Oct 10 23:17:42.780790 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AggregatesAdminTestJSON-156151763-project Oct 10 23:17:42.780790 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:17:42.780790 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 41c23198-c951-4c85-b87c-6f10d6835eaf could not be found. Oct 10 23:17:42.780790 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '41c23198-c951-4c85-b87c-6f10d6835eaf'} Oct 10 23:17:42.781725 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:42.781725 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:42.781725 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:17:42.781725 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:17:42.781725 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:17:42.781725 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:17:42.781725 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:17:42.781725 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:17:42.781725 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:17:42.781725 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:17:42.781725 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41c23198-c951-4c85-b87c-6f10d6835eaf could not be found. Oct 10 23:17:42.781725 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:42.781725 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:42.781725 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:42.781725 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:42.781725 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:42.781725 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:42.781725 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:42.781725 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:42.781725 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:42.783151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:42.783151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:17:42.783151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:17:42.783151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:17:42.783151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:17:42.783151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:17:42.783151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:17:42.783151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41c23198-c951-4c85-b87c-6f10d6835eaf could not be found. Oct 10 23:17:42.783151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:42.783151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:42.783151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:42.783151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:42.783151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:42.783151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:42.783151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:42.783151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:42.783151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41c23198-c951-4c85-b87c-6f10d6835eaf could not be found. Oct 10 23:17:42.783151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:42.785314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-128a80c6-d7ec-4cee-a803-95db0df84499 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] Returning 404 to user: Instance 41c23198-c951-4c85-b87c-6f10d6835eaf could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:42.785617 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-2911a32d-21a0-4f6e-ae9d-2759ad72cc66 req-7a6945a8-7129-409d-b1e7-e4192c5336ab service nova] Creating event network-vif-deleted:1ceac712-6e6b-44a9-908f-d81d757aa539 for instance 3b9a7c40-1a80-4be4-ba69-71487800d1f5 on n-h1-860864-2 Oct 10 23:17:42.787018 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-128a80c6-d7ec-4cee-a803-95db0df84499 tempest-AggregatesAdminTestJSON-156151763 tempest-AggregatesAdminTestJSON-156151763-project] 10.222.0.23 "GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf" status: 404 len: 111 microversion: 2.1 time: 0.052570 Oct 10 23:17:42.788655 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 170/333] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:42 2022] GET /compute/v2.1/servers/41c23198-c951-4c85-b87c-6f10d6835eaf => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:17:42.798753 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-2911a32d-21a0-4f6e-ae9d-2759ad72cc66 req-7a6945a8-7129-409d-b1e7-e4192c5336ab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067538 Oct 10 23:17:42.806045 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 164/334] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:43.026894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-485a9e65-7309-430a-baba-80a928848e0f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:43.027511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-485a9e65-7309-430a-baba-80a928848e0f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: 12574d37-08bd-4e05-8953-e2e680ebee8c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:43.068534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-485a9e65-7309-430a-baba-80a928848e0f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:43.069138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-485a9e65-7309-430a-baba-80a928848e0f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:43.069639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-485a9e65-7309-430a-baba-80a928848e0f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:43.078036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-485a9e65-7309-430a-baba-80a928848e0f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:43.080497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-485a9e65-7309-430a-baba-80a928848e0f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:43.081166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-485a9e65-7309-430a-baba-80a928848e0f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:43.426910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-869a19e9-1ae4-4f40-8443-de498bf058af tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:43.428352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-869a19e9-1ae4-4f40-8443-de498bf058af tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 90aa3419-44a6-4b0d-9af1-5f6df3554b71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:43.447192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-869a19e9-1ae4-4f40-8443-de498bf058af tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:43.448019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-869a19e9-1ae4-4f40-8443-de498bf058af tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:43.449664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-869a19e9-1ae4-4f40-8443-de498bf058af tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:43.451317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-869a19e9-1ae4-4f40-8443-de498bf058af tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:43.453039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-869a19e9-1ae4-4f40-8443-de498bf058af tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:43.455372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-869a19e9-1ae4-4f40-8443-de498bf058af tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:43.467043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-485a9e65-7309-430a-baba-80a928848e0f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:43.477197 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-485a9e65-7309-430a-baba-80a928848e0f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c" status: 200 len: 1386 microversion: 2.1 time: 0.455055 Oct 10 23:17:43.480806 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 171/335] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:43 2022] GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c => generated 1386 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:43.598371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-297b72c2-f8c0-4f57-bd22-41864e36c90c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:43.599426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-297b72c2-f8c0-4f57-bd22-41864e36c90c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3b9a7c40-1a80-4be4-ba69-71487800d1f5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:43.608217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-297b72c2-f8c0-4f57-bd22-41864e36c90c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:43.608874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-297b72c2-f8c0-4f57-bd22-41864e36c90c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:43.609706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-297b72c2-f8c0-4f57-bd22-41864e36c90c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:43.610561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-297b72c2-f8c0-4f57-bd22-41864e36c90c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:43.611605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-297b72c2-f8c0-4f57-bd22-41864e36c90c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:43.612148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-297b72c2-f8c0-4f57-bd22-41864e36c90c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:43.657484 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-297b72c2-f8c0-4f57-bd22-41864e36c90c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:43.658320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-297b72c2-f8c0-4f57-bd22-41864e36c90c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:43.658778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-297b72c2-f8c0-4f57-bd22-41864e36c90c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:43.659484 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-297b72c2-f8c0-4f57-bd22-41864e36c90c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lazy-loading 'fault' on Instance uuid 3b9a7c40-1a80-4be4-ba69-71487800d1f5 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:17:43.786529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-297b72c2-f8c0-4f57-bd22-41864e36c90c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e433528b28f546e4b93bf170af8f6049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8815288ae4a64e85a32b96bad674513a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:43.800585 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-297b72c2-f8c0-4f57-bd22-41864e36c90c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5" status: 200 len: 1307 microversion: 2.1 time: 0.207610 Oct 10 23:17:43.801686 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 172/336] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:43 2022] GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5 => generated 1307 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:43.889071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-869a19e9-1ae4-4f40-8443-de498bf058af tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:43.901112 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-869a19e9-1ae4-4f40-8443-de498bf058af tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71" status: 200 len: 1317 microversion: 2.1 time: 0.485458 Oct 10 23:17:43.902647 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 165/337] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:43 2022] GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71 => generated 1317 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:44.213254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5139a796-75f2-40d6-9e8c-322f7f4c9f3d tempest-FlavorsV2NegativeTest-933950243 tempest-FlavorsV2NegativeTest-933950243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-377664257", "imageRef": "288b4194-2577-47ba-88c0-823b46a8dd10", "flavorRef": "452"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:44.302711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-5139a796-75f2-40d6-9e8c-322f7f4c9f3d tempest-FlavorsV2NegativeTest-933950243 tempest-FlavorsV2NegativeTest-933950243-project] validate_networks() for None {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:17:44.509656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7f016f91-c1f3-4f11-a5da-4056bfb053b3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:44.511134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7f016f91-c1f3-4f11-a5da-4056bfb053b3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: 12574d37-08bd-4e05-8953-e2e680ebee8c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:44.526700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f016f91-c1f3-4f11-a5da-4056bfb053b3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:44.529142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f016f91-c1f3-4f11-a5da-4056bfb053b3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:44.530119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f016f91-c1f3-4f11-a5da-4056bfb053b3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:44.530866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f016f91-c1f3-4f11-a5da-4056bfb053b3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:44.531327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f016f91-c1f3-4f11-a5da-4056bfb053b3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:44.531754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f016f91-c1f3-4f11-a5da-4056bfb053b3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:44.610631 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-5139a796-75f2-40d6-9e8c-322f7f4c9f3d tempest-FlavorsV2NegativeTest-933950243 tempest-FlavorsV2NegativeTest-933950243-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 10 23:17:44.613733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5139a796-75f2-40d6-9e8c-322f7f4c9f3d tempest-FlavorsV2NegativeTest-933950243 tempest-FlavorsV2NegativeTest-933950243-project] Request method failure captured: Oct 10 23:17:44.613733 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:17:44.613733 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:17:44.613733 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:17:44.613733 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:17:44.613733 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 142 Oct 10 23:17:44.613733 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:17:44.613733 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:17:44.613733 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:17:44.613733 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:44.613733 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgVhnFB9RGnIjs5sGcRWcW0RE7tTS-mebtzhROO8Np2o9REeJ-EcQgzvWUn8S0SWhmvBS2idgKdE_Wnr6Bpu2SHip4QPtknMJhzRM2zinZN4LDcuOPj8O0k_H17-CwvlLyUikLZgqHfBpz5cwMn8B78KNCaIRzaJQjKwE5RNoJQii4 Oct 10 23:17:44.613733 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:17:44.613733 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:17:44.613733 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:17:44.613733 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:17:44.613733 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:17:44.613733 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:17:44.613733 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 1f6d6e05a35e450bbf955998a5be3e96 Oct 10 23:17:44.613733 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-FlavorsV2NegativeTest-933950243 Oct 10 23:17:44.613733 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:17:44.613733 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:17:44.615344 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1f6d6e05a35e450bbf955998a5be3e96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f6d6e05a35e450bbf955998a5be3e96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f6d6e05a35e450bbf955998a5be3e96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1f6d6e05a35e450bbf955998a5be3e96", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:44.615344 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-FlavorsV2NegativeTest-933950243 Oct 10 23:17:44.615344 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 1f6d6e05a35e450bbf955998a5be3e96 Oct 10 23:17:44.615344 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-933950243 Oct 10 23:17:44.615344 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-FlavorsV2NegativeTest-933950243-project Oct 10 23:17:44.615344 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:17:44.615344 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:17:44.615344 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: d58101467bc94e7eafe4624ebb96d325 Oct 10 23:17:44.615344 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-FlavorsV2NegativeTest-933950243-project Oct 10 23:17:44.615344 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:17:44.615344 n-d-860864-2 devstack@n-api.service[120614]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-377664257", "imageRef": "288b4194-2577-47ba-88c0-823b46a8dd10", "flavorRef": "452"}} Oct 10 23:17:44.615344 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:17:44.616175 n-d-860864-2 devstack@n-api.service[120614]: exception: Flavor's memory is too small for requested image. Oct 10 23:17:44.616175 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-377664257', 'imageRef': '288b4194-2577-47ba-88c0-823b46a8dd10', 'flavorRef': '452'}}} Oct 10 23:17:44.616175 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:44.616175 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:44.616175 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 10 23:17:44.616175 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 10 23:17:44.616175 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 10 23:17:44.616175 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 10 23:17:44.616175 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 10 23:17:44.616175 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 10 23:17:44.616175 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 10 23:17:44.616175 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 10 23:17:44.616175 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 10 23:17:44.616175 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 10 23:17:44.616175 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 10 23:17:44.616175 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 10 23:17:44.616175 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 10 23:17:44.616175 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:44.616175 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:44.616175 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:44.617470 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:44.617470 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:44.617470 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:44.617470 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:44.617470 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:44.617470 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:44.617470 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:44.617470 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:44.617470 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:44.617470 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:44.617470 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:44.617470 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:44.617470 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:44.617470 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 23:17:44.617470 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 10 23:17:44.617470 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 10 23:17:44.617470 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 10 23:17:44.617470 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:44.617470 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:44.617470 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:44.617470 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:44.618809 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:44.618809 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:44.618809 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:44.618809 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:44.618809 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 10 23:17:44.618809 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:44.619897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5139a796-75f2-40d6-9e8c-322f7f4c9f3d tempest-FlavorsV2NegativeTest-933950243 tempest-FlavorsV2NegativeTest-933950243-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:44.621084 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5139a796-75f2-40d6-9e8c-322f7f4c9f3d tempest-FlavorsV2NegativeTest-933950243 tempest-FlavorsV2NegativeTest-933950243-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.411863 Oct 10 23:17:44.623093 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 173/338] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:17:44 2022] POST /compute/v2.1/servers => generated 93 bytes in 414 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 23:17:44.830896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9f5d443f-8bcf-48fe-82a4-d2704bf92ba3 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:44.831686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9f5d443f-8bcf-48fe-82a4-d2704bf92ba3 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3b9a7c40-1a80-4be4-ba69-71487800d1f5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:44.847253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f5d443f-8bcf-48fe-82a4-d2704bf92ba3 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:44.848636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f5d443f-8bcf-48fe-82a4-d2704bf92ba3 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:44.851627 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f5d443f-8bcf-48fe-82a4-d2704bf92ba3 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:44.852979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f5d443f-8bcf-48fe-82a4-d2704bf92ba3 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:44.854686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f5d443f-8bcf-48fe-82a4-d2704bf92ba3 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:44.856375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f5d443f-8bcf-48fe-82a4-d2704bf92ba3 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:44.923659 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-9f5d443f-8bcf-48fe-82a4-d2704bf92ba3 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] HTTP exception thrown: Instance 3b9a7c40-1a80-4be4-ba69-71487800d1f5 could not be found. Oct 10 23:17:44.927383 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9f5d443f-8bcf-48fe-82a4-d2704bf92ba3 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Request method failure captured: Oct 10 23:17:44.927383 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5 HTTP/1.1 Oct 10 23:17:44.927383 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:17:44.927383 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:17:44.927383 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:17:44.927383 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:17:44.927383 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:17:44.927383 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:17:44.927383 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:17:44.927383 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:44.927383 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKfLvIPfZ_BMiq0h5Pucpt1Y_WPh4mLjby1G972cKbuOkuTqVF0srooqAhXvbFcjhPumBeWxEHnQqJ5xRpRxiIXo9bQF44Y2xIOXG2I-5ccFE9hBd7oufmu4xOFbR3vDejpCUNOrn9f3efj1ap8NMb9iL94gakN-VbhdlKsKVGlYWyQ Oct 10 23:17:44.927383 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:17:44.927383 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:17:44.927383 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:17:44.927383 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:17:44.927383 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:17:44.927383 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:17:44.927383 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 8815288ae4a64e85a32b96bad674513a Oct 10 23:17:44.927383 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-DeleteServersAdminTestJSON-147901847 Oct 10 23:17:44.927383 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:17:44.927383 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:17:44.928647 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8815288ae4a64e85a32b96bad674513a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8815288ae4a64e85a32b96bad674513a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8815288ae4a64e85a32b96bad674513a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8815288ae4a64e85a32b96bad674513a", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:44.928647 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-DeleteServersAdminTestJSON-147901847 Oct 10 23:17:44.928647 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 8815288ae4a64e85a32b96bad674513a Oct 10 23:17:44.928647 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-147901847 Oct 10 23:17:44.928647 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-DeleteServersAdminTestJSON-147901847-project Oct 10 23:17:44.928647 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:17:44.928647 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:17:44.928647 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: e433528b28f546e4b93bf170af8f6049 Oct 10 23:17:44.928647 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-DeleteServersAdminTestJSON-147901847-project Oct 10 23:17:44.928647 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:17:44.928647 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 3b9a7c40-1a80-4be4-ba69-71487800d1f5 could not be found. Oct 10 23:17:44.928647 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '3b9a7c40-1a80-4be4-ba69-71487800d1f5'} Oct 10 23:17:44.929294 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:44.929294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:44.929294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:17:44.929294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:17:44.929294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:17:44.929294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:17:44.929294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:17:44.929294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:17:44.929294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:17:44.929294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:17:44.929294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b9a7c40-1a80-4be4-ba69-71487800d1f5 could not be found. Oct 10 23:17:44.929294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:44.929294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:44.929294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:44.929294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:44.929294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:44.929294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:44.929294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:44.929294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:44.929294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:44.930424 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:44.930424 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:17:44.930424 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:17:44.930424 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:17:44.930424 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:17:44.930424 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:17:44.930424 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:17:44.930424 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b9a7c40-1a80-4be4-ba69-71487800d1f5 could not be found. Oct 10 23:17:44.930424 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:44.930424 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:44.930424 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:44.930424 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:44.930424 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:44.930424 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:44.930424 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:44.930424 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:44.930424 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b9a7c40-1a80-4be4-ba69-71487800d1f5 could not be found. Oct 10 23:17:44.930424 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:44.936903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9f5d443f-8bcf-48fe-82a4-d2704bf92ba3 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Returning 404 to user: Instance 3b9a7c40-1a80-4be4-ba69-71487800d1f5 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:44.938109 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9f5d443f-8bcf-48fe-82a4-d2704bf92ba3 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5" status: 404 len: 111 microversion: 2.1 time: 0.117520 Oct 10 23:17:44.945495 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 174/339] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:44 2022] GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:17:44.958577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dedd3437-2f5d-44f0-bb1f-6596f5c11c49 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:44.962159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dedd3437-2f5d-44f0-bb1f-6596f5c11c49 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 90aa3419-44a6-4b0d-9af1-5f6df3554b71] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:44.980939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dedd3437-2f5d-44f0-bb1f-6596f5c11c49 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:44.982627 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dedd3437-2f5d-44f0-bb1f-6596f5c11c49 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:44.984507 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dedd3437-2f5d-44f0-bb1f-6596f5c11c49 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:44.986433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dedd3437-2f5d-44f0-bb1f-6596f5c11c49 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:44.987241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dedd3437-2f5d-44f0-bb1f-6596f5c11c49 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:44.991475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dedd3437-2f5d-44f0-bb1f-6596f5c11c49 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:45.297063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7f016f91-c1f3-4f11-a5da-4056bfb053b3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:45.311309 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7f016f91-c1f3-4f11-a5da-4056bfb053b3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c" status: 200 len: 1584 microversion: 2.1 time: 0.808045 Oct 10 23:17:45.312528 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 166/340] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:44 2022] GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c => generated 1584 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:17:45.329883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-64766317-272a-4c90-8ca8-e65897365ca6 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:45.330546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-64766317-272a-4c90-8ca8-e65897365ca6 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3b9a7c40-1a80-4be4-ba69-71487800d1f5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:45.344689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64766317-272a-4c90-8ca8-e65897365ca6 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:45.345661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64766317-272a-4c90-8ca8-e65897365ca6 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:45.346251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64766317-272a-4c90-8ca8-e65897365ca6 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:45.347242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64766317-272a-4c90-8ca8-e65897365ca6 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:45.349723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64766317-272a-4c90-8ca8-e65897365ca6 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:45.350486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64766317-272a-4c90-8ca8-e65897365ca6 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:45.361734 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dedd3437-2f5d-44f0-bb1f-6596f5c11c49 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:45.377631 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dedd3437-2f5d-44f0-bb1f-6596f5c11c49 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71" status: 200 len: 1317 microversion: 2.1 time: 0.430568 Oct 10 23:17:45.382495 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 175/341] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:44 2022] GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71 => generated 1317 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:45.395776 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-64766317-272a-4c90-8ca8-e65897365ca6 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] HTTP exception thrown: Instance 3b9a7c40-1a80-4be4-ba69-71487800d1f5 could not be found. Oct 10 23:17:45.397696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-64766317-272a-4c90-8ca8-e65897365ca6 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Request method failure captured: Oct 10 23:17:45.397696 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5 HTTP/1.1 Oct 10 23:17:45.397696 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:17:45.397696 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:17:45.397696 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:17:45.397696 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:17:45.397696 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:17:45.397696 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:17:45.397696 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:17:45.397696 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:45.397696 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfLvIPfZ_BMiq0h5Pucpt1Y_WPh4mLjby1G972cKbuOkuTqVF0srooqAhXvbFcjhPumBeWxEHnQqJ5xRpRxiIXo9bQF44Y2xIOXG2I-5ccFE9hBd7oufmu4xOFbR3vDejpCUNOrn9f3efj1ap8NMb9iL94gakN-VbhdlKsKVGlYWyQ Oct 10 23:17:45.397696 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:17:45.397696 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:17:45.397696 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:17:45.397696 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:17:45.397696 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:17:45.397696 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:17:45.397696 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 8815288ae4a64e85a32b96bad674513a Oct 10 23:17:45.397696 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-DeleteServersAdminTestJSON-147901847 Oct 10 23:17:45.397696 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:17:45.397696 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:17:45.399170 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8815288ae4a64e85a32b96bad674513a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8815288ae4a64e85a32b96bad674513a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8815288ae4a64e85a32b96bad674513a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8815288ae4a64e85a32b96bad674513a", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:45.399170 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-DeleteServersAdminTestJSON-147901847 Oct 10 23:17:45.399170 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 8815288ae4a64e85a32b96bad674513a Oct 10 23:17:45.399170 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-147901847 Oct 10 23:17:45.399170 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-DeleteServersAdminTestJSON-147901847-project Oct 10 23:17:45.399170 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:17:45.399170 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:17:45.399170 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: e433528b28f546e4b93bf170af8f6049 Oct 10 23:17:45.399170 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-DeleteServersAdminTestJSON-147901847-project Oct 10 23:17:45.399170 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:17:45.399170 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 3b9a7c40-1a80-4be4-ba69-71487800d1f5 could not be found. Oct 10 23:17:45.399170 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '3b9a7c40-1a80-4be4-ba69-71487800d1f5'} Oct 10 23:17:45.399950 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:45.399950 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:45.399950 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:17:45.399950 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:17:45.399950 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:17:45.399950 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:17:45.399950 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:17:45.399950 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:17:45.399950 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:17:45.399950 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:17:45.399950 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b9a7c40-1a80-4be4-ba69-71487800d1f5 could not be found. Oct 10 23:17:45.399950 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:45.399950 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:45.399950 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:45.399950 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:45.399950 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:45.399950 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:45.399950 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:45.399950 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:45.399950 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:45.401535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:45.401535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:17:45.401535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:17:45.401535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:17:45.401535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:17:45.401535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:17:45.401535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:17:45.401535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:17:45.401535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:17:45.401535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b9a7c40-1a80-4be4-ba69-71487800d1f5 could not be found. Oct 10 23:17:45.401535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:45.401535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:45.401535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:45.401535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:45.401535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:45.401535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:45.401535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:45.401535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:45.401535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b9a7c40-1a80-4be4-ba69-71487800d1f5 could not be found. Oct 10 23:17:45.401535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:45.403661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-64766317-272a-4c90-8ca8-e65897365ca6 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Returning 404 to user: Instance 3b9a7c40-1a80-4be4-ba69-71487800d1f5 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:45.404043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-80c484dd-aca3-4224-93ce-86fa9aa7ac7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:45.404914 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-64766317-272a-4c90-8ca8-e65897365ca6 tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5" status: 404 len: 111 microversion: 2.1 time: 0.090996 Oct 10 23:17:45.406031 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 167/342] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:17:45 2022] DELETE /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:17:45.406404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-80c484dd-aca3-4224-93ce-86fa9aa7ac7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: 12574d37-08bd-4e05-8953-e2e680ebee8c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:45.428006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80c484dd-aca3-4224-93ce-86fa9aa7ac7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:45.428006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80c484dd-aca3-4224-93ce-86fa9aa7ac7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:45.428006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80c484dd-aca3-4224-93ce-86fa9aa7ac7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:45.428284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-96d87870-26a9-4ceb-8f0e-88b463157e3a tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:45.428284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-96d87870-26a9-4ceb-8f0e-88b463157e3a tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3b9a7c40-1a80-4be4-ba69-71487800d1f5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:45.429326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80c484dd-aca3-4224-93ce-86fa9aa7ac7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:45.431519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80c484dd-aca3-4224-93ce-86fa9aa7ac7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:45.432030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80c484dd-aca3-4224-93ce-86fa9aa7ac7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:45.449031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96d87870-26a9-4ceb-8f0e-88b463157e3a tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:45.449792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96d87870-26a9-4ceb-8f0e-88b463157e3a tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:45.450430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96d87870-26a9-4ceb-8f0e-88b463157e3a tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:45.451702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96d87870-26a9-4ceb-8f0e-88b463157e3a tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:45.452749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96d87870-26a9-4ceb-8f0e-88b463157e3a tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:45.453427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96d87870-26a9-4ceb-8f0e-88b463157e3a tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:45.470816 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-96d87870-26a9-4ceb-8f0e-88b463157e3a tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] HTTP exception thrown: Instance 3b9a7c40-1a80-4be4-ba69-71487800d1f5 could not be found. Oct 10 23:17:45.473586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-96d87870-26a9-4ceb-8f0e-88b463157e3a tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Request method failure captured: Oct 10 23:17:45.473586 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5 HTTP/1.1 Oct 10 23:17:45.473586 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:17:45.473586 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:17:45.473586 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:17:45.473586 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:17:45.473586 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:17:45.473586 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:17:45.473586 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:17:45.473586 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:45.473586 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfLvIPfZ_BMiq0h5Pucpt1Y_WPh4mLjby1G972cKbuOkuTqVF0srooqAhXvbFcjhPumBeWxEHnQqJ5xRpRxiIXo9bQF44Y2xIOXG2I-5ccFE9hBd7oufmu4xOFbR3vDejpCUNOrn9f3efj1ap8NMb9iL94gakN-VbhdlKsKVGlYWyQ Oct 10 23:17:45.473586 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:17:45.473586 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:17:45.473586 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:17:45.473586 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:17:45.473586 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:17:45.473586 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:17:45.473586 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 8815288ae4a64e85a32b96bad674513a Oct 10 23:17:45.473586 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-DeleteServersAdminTestJSON-147901847 Oct 10 23:17:45.473586 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:17:45.473586 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:17:45.474972 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8815288ae4a64e85a32b96bad674513a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8815288ae4a64e85a32b96bad674513a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8815288ae4a64e85a32b96bad674513a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8815288ae4a64e85a32b96bad674513a", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:45.474972 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-DeleteServersAdminTestJSON-147901847 Oct 10 23:17:45.474972 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 8815288ae4a64e85a32b96bad674513a Oct 10 23:17:45.474972 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-147901847 Oct 10 23:17:45.474972 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-DeleteServersAdminTestJSON-147901847-project Oct 10 23:17:45.474972 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:17:45.474972 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:17:45.474972 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: e433528b28f546e4b93bf170af8f6049 Oct 10 23:17:45.474972 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-DeleteServersAdminTestJSON-147901847-project Oct 10 23:17:45.474972 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:17:45.474972 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 3b9a7c40-1a80-4be4-ba69-71487800d1f5 could not be found. Oct 10 23:17:45.474972 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '3b9a7c40-1a80-4be4-ba69-71487800d1f5'} Oct 10 23:17:45.475632 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:45.475632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:45.475632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:17:45.475632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:17:45.475632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:17:45.475632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:17:45.475632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:17:45.475632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:17:45.475632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:17:45.475632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:17:45.475632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b9a7c40-1a80-4be4-ba69-71487800d1f5 could not be found. Oct 10 23:17:45.475632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:45.475632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:45.475632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:45.475632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:45.475632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:45.475632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:45.475632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:45.475632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:45.475632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:45.476686 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:45.476686 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:17:45.476686 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:17:45.476686 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:17:45.476686 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:17:45.476686 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:17:45.476686 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:17:45.476686 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b9a7c40-1a80-4be4-ba69-71487800d1f5 could not be found. Oct 10 23:17:45.476686 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:45.476686 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:45.476686 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:45.476686 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:45.476686 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:45.476686 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:45.476686 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:45.476686 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:45.476686 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b9a7c40-1a80-4be4-ba69-71487800d1f5 could not be found. Oct 10 23:17:45.476686 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:45.480361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-96d87870-26a9-4ceb-8f0e-88b463157e3a tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Returning 404 to user: Instance 3b9a7c40-1a80-4be4-ba69-71487800d1f5 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:45.481523 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-96d87870-26a9-4ceb-8f0e-88b463157e3a tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5" status: 404 len: 111 microversion: 2.1 time: 0.070997 Oct 10 23:17:45.486204 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 168/343] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:45 2022] GET /compute/v2.1/servers/3b9a7c40-1a80-4be4-ba69-71487800d1f5 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:17:45.491593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ed3d6c5c-fe00-42b2-857a-19dd9fdb765c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:45.492858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ed3d6c5c-fe00-42b2-857a-19dd9fdb765c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:45.503515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed3d6c5c-fe00-42b2-857a-19dd9fdb765c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:45.504313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed3d6c5c-fe00-42b2-857a-19dd9fdb765c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:45.504927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed3d6c5c-fe00-42b2-857a-19dd9fdb765c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:45.505878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed3d6c5c-fe00-42b2-857a-19dd9fdb765c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:45.506514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed3d6c5c-fe00-42b2-857a-19dd9fdb765c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:45.507397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed3d6c5c-fe00-42b2-857a-19dd9fdb765c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:45.526216 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-ed3d6c5c-fe00-42b2-857a-19dd9fdb765c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] HTTP exception thrown: Instance 3cc4c250-e3ff-4840-bea2-b40c07049ae4 could not be found. Oct 10 23:17:45.528040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ed3d6c5c-fe00-42b2-857a-19dd9fdb765c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Request method failure captured: Oct 10 23:17:45.528040 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 HTTP/1.1 Oct 10 23:17:45.528040 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:17:45.528040 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:17:45.528040 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:17:45.528040 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:17:45.528040 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:17:45.528040 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:17:45.528040 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:17:45.528040 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:45.528040 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfLvIPfZ_BMiq0h5Pucpt1Y_WPh4mLjby1G972cKbuOkuTqVF0srooqAhXvbFcjhPumBeWxEHnQqJ5xRpRxiIXo9bQF44Y2xIOXG2I-5ccFE9hBd7oufmu4xOFbR3vDejpCUNOrn9f3efj1ap8NMb9iL94gakN-VbhdlKsKVGlYWyQ Oct 10 23:17:45.528040 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:17:45.528040 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:17:45.528040 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:17:45.528040 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:17:45.528040 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:17:45.528040 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:17:45.528040 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 8815288ae4a64e85a32b96bad674513a Oct 10 23:17:45.528040 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-DeleteServersAdminTestJSON-147901847 Oct 10 23:17:45.528040 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:17:45.528040 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:17:45.529567 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8815288ae4a64e85a32b96bad674513a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8815288ae4a64e85a32b96bad674513a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8815288ae4a64e85a32b96bad674513a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8815288ae4a64e85a32b96bad674513a", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:45.529567 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-DeleteServersAdminTestJSON-147901847 Oct 10 23:17:45.529567 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 8815288ae4a64e85a32b96bad674513a Oct 10 23:17:45.529567 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-147901847 Oct 10 23:17:45.529567 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-DeleteServersAdminTestJSON-147901847-project Oct 10 23:17:45.529567 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:17:45.529567 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:17:45.529567 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: e433528b28f546e4b93bf170af8f6049 Oct 10 23:17:45.529567 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-DeleteServersAdminTestJSON-147901847-project Oct 10 23:17:45.529567 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:17:45.529567 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 3cc4c250-e3ff-4840-bea2-b40c07049ae4 could not be found. Oct 10 23:17:45.529567 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '3cc4c250-e3ff-4840-bea2-b40c07049ae4'} Oct 10 23:17:45.530222 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:45.530222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:45.530222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:17:45.530222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:17:45.530222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:17:45.530222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:17:45.530222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:17:45.530222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:17:45.530222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:17:45.530222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:17:45.530222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cc4c250-e3ff-4840-bea2-b40c07049ae4 could not be found. Oct 10 23:17:45.530222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:45.530222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:45.530222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:45.530222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:45.530222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:45.530222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:45.530222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:45.530222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:45.530222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:45.531377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:45.531377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:17:45.531377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:17:45.531377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:17:45.531377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:17:45.531377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:17:45.531377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:17:45.531377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:17:45.531377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:17:45.531377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cc4c250-e3ff-4840-bea2-b40c07049ae4 could not be found. Oct 10 23:17:45.531377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:45.531377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:45.531377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:45.531377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:45.531377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:45.531377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:45.531377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:45.531377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:45.531377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cc4c250-e3ff-4840-bea2-b40c07049ae4 could not be found. Oct 10 23:17:45.531377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:45.532456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ed3d6c5c-fe00-42b2-857a-19dd9fdb765c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Returning 404 to user: Instance 3cc4c250-e3ff-4840-bea2-b40c07049ae4 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:45.532456 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ed3d6c5c-fe00-42b2-857a-19dd9fdb765c tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 404 len: 111 microversion: 2.1 time: 0.042742 Oct 10 23:17:45.535772 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 169/344] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:17:45 2022] DELETE /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:17:45.546951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6e11ff4d-a332-4331-891c-913ecd7a049d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:45.558899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6e11ff4d-a332-4331-891c-913ecd7a049d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] [instance: 3cc4c250-e3ff-4840-bea2-b40c07049ae4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:45.573766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e11ff4d-a332-4331-891c-913ecd7a049d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:45.574262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e11ff4d-a332-4331-891c-913ecd7a049d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:45.575183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e11ff4d-a332-4331-891c-913ecd7a049d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:45.576176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e11ff4d-a332-4331-891c-913ecd7a049d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:45.577353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e11ff4d-a332-4331-891c-913ecd7a049d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:45.580329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e11ff4d-a332-4331-891c-913ecd7a049d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:45.615292 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-6e11ff4d-a332-4331-891c-913ecd7a049d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] HTTP exception thrown: Instance 3cc4c250-e3ff-4840-bea2-b40c07049ae4 could not be found. Oct 10 23:17:45.618868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6e11ff4d-a332-4331-891c-913ecd7a049d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Request method failure captured: Oct 10 23:17:45.618868 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 HTTP/1.1 Oct 10 23:17:45.618868 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:17:45.618868 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:17:45.618868 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:17:45.618868 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:17:45.618868 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:17:45.618868 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:17:45.618868 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:17:45.618868 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:45.618868 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfLvIPfZ_BMiq0h5Pucpt1Y_WPh4mLjby1G972cKbuOkuTqVF0srooqAhXvbFcjhPumBeWxEHnQqJ5xRpRxiIXo9bQF44Y2xIOXG2I-5ccFE9hBd7oufmu4xOFbR3vDejpCUNOrn9f3efj1ap8NMb9iL94gakN-VbhdlKsKVGlYWyQ Oct 10 23:17:45.618868 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:17:45.618868 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:17:45.618868 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:17:45.618868 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:17:45.618868 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:17:45.618868 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:17:45.618868 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 8815288ae4a64e85a32b96bad674513a Oct 10 23:17:45.618868 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-DeleteServersAdminTestJSON-147901847 Oct 10 23:17:45.618868 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:17:45.618868 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:17:45.620178 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8815288ae4a64e85a32b96bad674513a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8815288ae4a64e85a32b96bad674513a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8815288ae4a64e85a32b96bad674513a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8815288ae4a64e85a32b96bad674513a", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:45.620178 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-DeleteServersAdminTestJSON-147901847 Oct 10 23:17:45.620178 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 8815288ae4a64e85a32b96bad674513a Oct 10 23:17:45.620178 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-147901847 Oct 10 23:17:45.620178 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-DeleteServersAdminTestJSON-147901847-project Oct 10 23:17:45.620178 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:17:45.620178 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:17:45.620178 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: e433528b28f546e4b93bf170af8f6049 Oct 10 23:17:45.620178 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-DeleteServersAdminTestJSON-147901847-project Oct 10 23:17:45.620178 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:17:45.620178 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 3cc4c250-e3ff-4840-bea2-b40c07049ae4 could not be found. Oct 10 23:17:45.620178 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '3cc4c250-e3ff-4840-bea2-b40c07049ae4'} Oct 10 23:17:45.620861 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:45.620861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:45.620861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:17:45.620861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:17:45.620861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:17:45.620861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:17:45.620861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:17:45.620861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:17:45.620861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:17:45.620861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:17:45.620861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cc4c250-e3ff-4840-bea2-b40c07049ae4 could not be found. Oct 10 23:17:45.620861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:45.620861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:45.620861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:45.620861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:45.620861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:45.620861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:45.620861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:45.620861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:45.620861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:45.621973 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:45.621973 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:17:45.621973 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:17:45.621973 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:17:45.621973 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:17:45.621973 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:17:45.621973 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:17:45.621973 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cc4c250-e3ff-4840-bea2-b40c07049ae4 could not be found. Oct 10 23:17:45.621973 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:45.621973 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:45.621973 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:45.621973 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:45.621973 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:45.621973 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:45.621973 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:45.621973 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:45.621973 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cc4c250-e3ff-4840-bea2-b40c07049ae4 could not be found. Oct 10 23:17:45.621973 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:45.627246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6e11ff4d-a332-4331-891c-913ecd7a049d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] Returning 404 to user: Instance 3cc4c250-e3ff-4840-bea2-b40c07049ae4 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:45.635825 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6e11ff4d-a332-4331-891c-913ecd7a049d tempest-DeleteServersAdminTestJSON-147901847 tempest-DeleteServersAdminTestJSON-147901847-project] 10.222.0.23 "GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4" status: 404 len: 111 microversion: 2.1 time: 0.093794 Oct 10 23:17:45.642254 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 170/345] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:45 2022] GET /compute/v2.1/servers/3cc4c250-e3ff-4840-bea2-b40c07049ae4 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:17:45.757852 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-80c484dd-aca3-4224-93ce-86fa9aa7ac7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.372848 Oct 10 23:17:45.770191 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 176/346] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Oct 10 23:17:45 2022] GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c/os-interface => generated 284 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:46.411436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e6a66f4d-5ff3-4f17-a682-b81a33290ca0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:46.412386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e6a66f4d-5ff3-4f17-a682-b81a33290ca0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 90aa3419-44a6-4b0d-9af1-5f6df3554b71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:46.426977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6a66f4d-5ff3-4f17-a682-b81a33290ca0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:46.428598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6a66f4d-5ff3-4f17-a682-b81a33290ca0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:46.429145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6a66f4d-5ff3-4f17-a682-b81a33290ca0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:46.432072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6a66f4d-5ff3-4f17-a682-b81a33290ca0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:46.432683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6a66f4d-5ff3-4f17-a682-b81a33290ca0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:46.433224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6a66f4d-5ff3-4f17-a682-b81a33290ca0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:46.818111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e6a66f4d-5ff3-4f17-a682-b81a33290ca0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:46.830951 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e6a66f4d-5ff3-4f17-a682-b81a33290ca0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71" status: 200 len: 1317 microversion: 2.1 time: 0.428453 Oct 10 23:17:46.839186 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 171/347] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:46 2022] GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71 => generated 1317 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:47.053883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-368778f9-8c7b-4415-b8b4-6134a92a64a7 req-041f61dd-1d93-4ea0-87db-00a958db077d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90aa3419-44a6-4b0d-9af1-5f6df3554b71", "name": "network-vif-plugged", "status": "completed", "tag": "e7e827df-c293-4503-a382-723a56a14034"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:47.079410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-368778f9-8c7b-4415-b8b4-6134a92a64a7 req-041f61dd-1d93-4ea0-87db-00a958db077d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:47.080299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-368778f9-8c7b-4415-b8b4-6134a92a64a7 req-041f61dd-1d93-4ea0-87db-00a958db077d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:47.080957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-368778f9-8c7b-4415-b8b4-6134a92a64a7 req-041f61dd-1d93-4ea0-87db-00a958db077d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:47.109093 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-368778f9-8c7b-4415-b8b4-6134a92a64a7 req-041f61dd-1d93-4ea0-87db-00a958db077d service nova] Creating event network-vif-plugged:e7e827df-c293-4503-a382-723a56a14034 for instance 90aa3419-44a6-4b0d-9af1-5f6df3554b71 on n-h2-860864-2 Oct 10 23:17:47.124259 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-368778f9-8c7b-4415-b8b4-6134a92a64a7 req-041f61dd-1d93-4ea0-87db-00a958db077d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075026 Oct 10 23:17:47.125441 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 177/348] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:47.867379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9355c8af-a097-4ec5-aad8-001287346f28 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:47.868081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9355c8af-a097-4ec5-aad8-001287346f28 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 90aa3419-44a6-4b0d-9af1-5f6df3554b71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:47.906871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9355c8af-a097-4ec5-aad8-001287346f28 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:47.910909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9355c8af-a097-4ec5-aad8-001287346f28 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:47.911423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9355c8af-a097-4ec5-aad8-001287346f28 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:47.914838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9355c8af-a097-4ec5-aad8-001287346f28 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:47.915460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9355c8af-a097-4ec5-aad8-001287346f28 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:47.915907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9355c8af-a097-4ec5-aad8-001287346f28 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:48.214990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:48.290317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9355c8af-a097-4ec5-aad8-001287346f28 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:48.300239 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9355c8af-a097-4ec5-aad8-001287346f28 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71" status: 200 len: 1317 microversion: 2.1 time: 0.437053 Oct 10 23:17:48.304010 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 172/349] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:47 2022] GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71 => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:48.660039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6629ff87-9b3b-401f-8917-2fbeba2950d9 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:48.661892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6629ff87-9b3b-401f-8917-2fbeba2950d9 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: 12574d37-08bd-4e05-8953-e2e680ebee8c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:48.667626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-4a8e8945-7ce8-479d-9fe4-cbc6748e11db req-1e942e25-7183-485a-a98f-ca381832c502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12574d37-08bd-4e05-8953-e2e680ebee8c", "tag": "30719613-9b48-4dc7-8ef2-88f2ccd9e780"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:48.687218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=30 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:48.693446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4a8e8945-7ce8-479d-9fe4-cbc6748e11db req-1e942e25-7183-485a-a98f-ca381832c502 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:48.693998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4a8e8945-7ce8-479d-9fe4-cbc6748e11db req-1e942e25-7183-485a-a98f-ca381832c502 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:48.694445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4a8e8945-7ce8-479d-9fe4-cbc6748e11db req-1e942e25-7183-485a-a98f-ca381832c502 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:48.708487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6629ff87-9b3b-401f-8917-2fbeba2950d9 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:48.708983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6629ff87-9b3b-401f-8917-2fbeba2950d9 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:48.709454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:48.727129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6629ff87-9b3b-401f-8917-2fbeba2950d9 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:48.727888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6629ff87-9b3b-401f-8917-2fbeba2950d9 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:48.728359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6629ff87-9b3b-401f-8917-2fbeba2950d9 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:48.731042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6629ff87-9b3b-401f-8917-2fbeba2950d9 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:48.734783 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-4a8e8945-7ce8-479d-9fe4-cbc6748e11db req-1e942e25-7183-485a-a98f-ca381832c502 service nova] Creating event network-changed:30719613-9b48-4dc7-8ef2-88f2ccd9e780 for instance 12574d37-08bd-4e05-8953-e2e680ebee8c on n-h1-860864-2 Oct 10 23:17:48.756398 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-4a8e8945-7ce8-479d-9fe4-cbc6748e11db req-1e942e25-7183-485a-a98f-ca381832c502 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092416 Oct 10 23:17:48.760138 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 173/350] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:17:49.601519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a8a9358e-3e40-405e-9a53-c6b1dc7dcea1 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:49.607904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8a9358e-3e40-405e-9a53-c6b1dc7dcea1 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:49.608565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8a9358e-3e40-405e-9a53-c6b1dc7dcea1 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:49.611591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8a9358e-3e40-405e-9a53-c6b1dc7dcea1 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:49.614496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8a9358e-3e40-405e-9a53-c6b1dc7dcea1 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:49.616672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8a9358e-3e40-405e-9a53-c6b1dc7dcea1 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:49.618038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8a9358e-3e40-405e-9a53-c6b1dc7dcea1 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:49.682348 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a8a9358e-3e40-405e-9a53-c6b1dc7dcea1 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.688092 Oct 10 23:17:49.688156 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 174/351] 10.222.0.23 () {58 vars in 1176 bytes} [Mon Oct 10 23:17:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:49.694451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-22f5adb3-363b-480e-a967-27b10ecdb080 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:49.695500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-22f5adb3-363b-480e-a967-27b10ecdb080 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 90aa3419-44a6-4b0d-9af1-5f6df3554b71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:49.716436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22f5adb3-363b-480e-a967-27b10ecdb080 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:49.717704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22f5adb3-363b-480e-a967-27b10ecdb080 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:49.719329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22f5adb3-363b-480e-a967-27b10ecdb080 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:49.720476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22f5adb3-363b-480e-a967-27b10ecdb080 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:49.722490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22f5adb3-363b-480e-a967-27b10ecdb080 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:49.724837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22f5adb3-363b-480e-a967-27b10ecdb080 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:49.968581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6629ff87-9b3b-401f-8917-2fbeba2950d9 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:49.977068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:49.984798 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6629ff87-9b3b-401f-8917-2fbeba2950d9 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c" status: 200 len: 1584 microversion: 2.1 time: 1.332473 Oct 10 23:17:50.000979 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 178/352] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:48 2022] GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c => generated 1584 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:50.011230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-425fe908-da7a-47ef-8223-78fad38c3eca tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1630552628"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:50.015168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.aggregate [None req-425fe908-da7a-47ef-8223-78fad38c3eca tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Generated uuid e49fb666-6b3d-488b-a9ab-1b3460aab482 for aggregate {{(pid=120614) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 23:17:50.072584 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-425fe908-da7a-47ef-8223-78fad38c3eca tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.068960 Oct 10 23:17:50.082328 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 179/353] 10.222.0.23 () {60 vars in 1164 bytes} [Mon Oct 10 23:17:50 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:50.088740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ade31046-afca-4e91-b45d-cb133e1cb23a tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-2"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:50.106191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ade31046-afca-4e91-b45d-cb133e1cb23a tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:50.107554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ade31046-afca-4e91-b45d-cb133e1cb23a tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:50.109056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ade31046-afca-4e91-b45d-cb133e1cb23a tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:50.133952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-22f5adb3-363b-480e-a967-27b10ecdb080 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:50.150883 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-22f5adb3-363b-480e-a967-27b10ecdb080 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71" status: 200 len: 1467 microversion: 2.1 time: 0.460146 Oct 10 23:17:50.179294 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 175/354] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:49 2022] GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71 => generated 1467 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:50.356235 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ade31046-afca-4e91-b45d-cb133e1cb23a tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.272075 Oct 10 23:17:50.363683 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 180/355] 10.222.0.23 () {60 vars in 1194 bytes} [Mon Oct 10 23:17:50 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:50.378990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-23bd0d6d-c3a1-47d4-834f-34cecde35da9 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-2"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:50.405002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23bd0d6d-c3a1-47d4-834f-34cecde35da9 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:50.409938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23bd0d6d-c3a1-47d4-834f-34cecde35da9 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:50.417306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23bd0d6d-c3a1-47d4-834f-34cecde35da9 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:50.466277 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-23bd0d6d-c3a1-47d4-834f-34cecde35da9 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h2-860864-2. Oct 10 23:17:50.506423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-23bd0d6d-c3a1-47d4-834f-34cecde35da9 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Request method failure captured: Oct 10 23:17:50.506423 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Oct 10 23:17:50.506423 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:17:50.506423 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:17:50.506423 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:17:50.506423 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 39 Oct 10 23:17:50.506423 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:17:50.506423 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:17:50.506423 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:17:50.506423 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:50.506423 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgckPGRPmUcWekeGWEAVdulBvhKaDIQuQ5LnDF5MNT5Yxu8s1rpxRuk8t0X_rKnwBr01ocwkWbLJf7nwODsuakwQD3_T0Lja9V6Gj6s53u9LEHXrykwpBgxb2r7hnZNA0qciiItkh6QDtMb7q2rY7TSZCTsbKJPY-LV9gCmKmNcOVg Oct 10 23:17:50.506423 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:17:50.506423 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:17:50.506423 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:17:50.506423 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:17:50.506423 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:17:50.506423 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:17:50.506423 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 613e206f3825462c8489bc7e625cec5e Oct 10 23:17:50.506423 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:50.506423 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:17:50.506423 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:17:50.507927 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_613e206f3825462c8489bc7e625cec5e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:50.507927 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:50.507927 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 613e206f3825462c8489bc7e625cec5e Oct 10 23:17:50.507927 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:50.507927 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin Oct 10 23:17:50.507927 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:17:50.507927 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:17:50.507927 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: ceabea8ef0414bbb8ccbccd5a5476b30 Oct 10 23:17:50.507927 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin Oct 10 23:17:50.507927 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:17:50.507927 n-d-860864-2 devstack@n-api.service[120614]: {"add_host": {"host": "n-h2-860864-2"}} Oct 10 23:17:50.507927 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:17:50.507927 n-d-860864-2 devstack@n-api.service[120614]: exception: Aggregate 11 already has host n-h2-860864-2. Oct 10 23:17:50.508992 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h2-860864-2'}}} Oct 10 23:17:50.508992 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:50.508992 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:50.508992 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 23:17:50.508992 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 10 23:17:50.508992 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 23:17:50.508992 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 10 23:17:50.508992 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 23:17:50.508992 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 10 23:17:50.508992 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 23:17:50.508992 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 10 23:17:50.508992 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 23:17:50.508992 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 23:17:50.508992 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 23:17:50.508992 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result.read() Oct 10 23:17:50.508992 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 23:17:50.508992 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 10 23:17:50.508992 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 23:17:50.508992 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 10 23:17:50.510110 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 23:17:50.510110 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 10 23:17:50.510110 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 23:17:50.510110 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 10 23:17:50.510110 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-860864-2-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 10 23:17:50.510110 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:50.510110 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 10 23:17:50.510110 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:50.510110 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:50.510110 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 10 23:17:50.510110 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 10 23:17:50.510110 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 10 23:17:50.510110 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi session.flush() Oct 10 23:17:50.510110 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 10 23:17:50.510110 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 10 23:17:50.510110 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 10 23:17:50.510110 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 10 23:17:50.510110 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 10 23:17:50.510110 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 10 23:17:50.511194 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 23:17:50.511194 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception Oct 10 23:17:50.511194 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 10 23:17:50.511194 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 10 23:17:50.511194 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 10 23:17:50.511194 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 10 23:17:50.511194 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 10 23:17:50.511194 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 10 23:17:50.511194 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 10 23:17:50.511194 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 10 23:17:50.511194 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 10 23:17:50.511194 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 10 23:17:50.511194 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 10 23:17:50.511194 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 10 23:17:50.511194 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 10 23:17:50.511194 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 10 23:17:50.511194 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 10 23:17:50.511194 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 10 23:17:50.512555 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 10 23:17:50.512555 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 10 23:17:50.512555 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 10 23:17:50.512555 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 10 23:17:50.512555 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 23:17:50.512555 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception Oct 10 23:17:50.512555 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 23:17:50.512555 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 10 23:17:50.512555 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 23:17:50.512555 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 10 23:17:50.512555 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 23:17:50.512555 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 10 23:17:50.512555 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 23:17:50.512555 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 10 23:17:50.512555 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 23:17:50.512555 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 23:17:50.512555 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 23:17:50.512555 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result.read() Oct 10 23:17:50.515219 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 23:17:50.515219 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 10 23:17:50.515219 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 23:17:50.515219 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 10 23:17:50.515219 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 23:17:50.515219 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 10 23:17:50.515219 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 23:17:50.515219 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 10 23:17:50.515219 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-860864-2-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 10 23:17:50.515219 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 10 23:17:50.515219 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 10, 23, 17, 50, 455108), 'updated_at': None, 'host': 'n-h2-860864-2', 'aggregate_id': 11}] Oct 10 23:17:50.515219 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 10 23:17:50.515219 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:50.515219 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:50.515219 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:50.515219 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:50.515219 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 10 23:17:50.517038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 10 23:17:50.517038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 23:17:50.517038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 23:17:50.517038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:17:50.517038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:17:50.517038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:17:50.517038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:17:50.517038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 23:17:50.517038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 23:17:50.517038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 10 23:17:50.517038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 10 23:17:50.517038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 10 23:17:50.517038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 10 23:17:50.517038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 10 23:17:50.517038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 10 23:17:50.517038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 10 23:17:50.517038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 10 23:17:50.517038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h2-860864-2. Oct 10 23:17:50.517038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:50.517038 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:50.519869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:50.519869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:50.519869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:50.519869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:50.519869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:50.519869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:50.519869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:50.519869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:50.519869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:50.519869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:50.519869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 10 23:17:50.519869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 10 23:17:50.519869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h2-860864-2. Oct 10 23:17:50.519869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:50.519869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:50.519869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:50.519869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:50.519869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:50.519869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:50.519869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:50.519869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:50.521858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h2-860864-2. Oct 10 23:17:50.521858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:50.521858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-23bd0d6d-c3a1-47d4-834f-34cecde35da9 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Returning 409 to user: Aggregate 11 already has host n-h2-860864-2. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:50.521858 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-23bd0d6d-c3a1-47d4-834f-34cecde35da9 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.140210 Oct 10 23:17:50.521858 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 181/356] 10.222.0.23 () {60 vars in 1194 bytes} [Mon Oct 10 23:17:50 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 377 bytes (2 switches on core 0) Oct 10 23:17:50.532755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d36579a7-556f-4cf4-be2c-4539539adf56 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-2"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:50.564387 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d36579a7-556f-4cf4-be2c-4539539adf56 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:50.564943 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d36579a7-556f-4cf4-be2c-4539539adf56 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:50.565425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d36579a7-556f-4cf4-be2c-4539539adf56 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:50.806871 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d36579a7-556f-4cf4-be2c-4539539adf56 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.287267 Oct 10 23:17:50.832722 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 182/357] 10.222.0.23 () {60 vars in 1194 bytes} [Mon Oct 10 23:17:50 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:50.844372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0119304e-7683-4cdd-8c10-0eb9ef3c9859 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:50.914675 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0119304e-7683-4cdd-8c10-0eb9ef3c9859 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.080608 Oct 10 23:17:50.928286 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 183/358] 10.222.0.23 () {58 vars in 1155 bytes} [Mon Oct 10 23:17:50 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 23:17:50.953088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-80273fdb-2235-4612-87fc-2eb5f2c41460 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1808113714"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:50.965534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.aggregate [None req-80273fdb-2235-4612-87fc-2eb5f2c41460 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Generated uuid c0ea5fe6-db2e-4289-b072-8f9939c3570b for aggregate {{(pid=120614) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 23:17:51.035497 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-80273fdb-2235-4612-87fc-2eb5f2c41460 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.103199 Oct 10 23:17:51.036250 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 184/359] 10.222.0.23 () {60 vars in 1164 bytes} [Mon Oct 10 23:17:50 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:51.113360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f500ae11-2366-4aad-adc8-10844db34082 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:51.118172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f500ae11-2366-4aad-adc8-10844db34082 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] [instance: 90aa3419-44a6-4b0d-9af1-5f6df3554b71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:51.137730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f500ae11-2366-4aad-adc8-10844db34082 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:51.139364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f500ae11-2366-4aad-adc8-10844db34082 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:51.144257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f500ae11-2366-4aad-adc8-10844db34082 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:51.145303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f500ae11-2366-4aad-adc8-10844db34082 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:51.145999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f500ae11-2366-4aad-adc8-10844db34082 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:51.146833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f500ae11-2366-4aad-adc8-10844db34082 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:51.744684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ac3ec3f2-9550-45ef-b744-df8b5391eb90 tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-2"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:51.762276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ac3ec3f2-9550-45ef-b744-df8b5391eb90 tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '1f49e20be0594454980eab231570f868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fabba3b47b34906b3f3af08ef327fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:51.765093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ac3ec3f2-9550-45ef-b744-df8b5391eb90 tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Request method failure captured: Oct 10 23:17:51.765093 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 10 23:17:51.765093 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:17:51.765093 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:17:51.765093 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:17:51.765093 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 39 Oct 10 23:17:51.765093 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:17:51.765093 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:17:51.765093 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:17:51.765093 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:51.765093 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgbXCdcABT-O9kgMT4w66qExkcix7GdTMy3kXQlUcFTfQ-oNq67M7SwGRdW9ZA3pPbL0Bsldz0jzGnecUSjxoGqJLFXrVQJ7C8aWAFSfcooBZQBWvOxKz8D6EMgm7TX4CbSs21P37XHwCpV81xETYMmpAC9E19t-LLTnIqEpK66Wjc Oct 10 23:17:51.765093 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:17:51.765093 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:17:51.765093 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:17:51.765093 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:17:51.765093 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:17:51.765093 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:17:51.765093 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 1fabba3b47b34906b3f3af08ef327fc0 Oct 10 23:17:51.765093 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1227963068 Oct 10 23:17:51.765093 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:17:51.765093 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:17:51.766530 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1fabba3b47b34906b3f3af08ef327fc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fabba3b47b34906b3f3af08ef327fc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fabba3b47b34906b3f3af08ef327fc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1fabba3b47b34906b3f3af08ef327fc0", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:51.766530 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1227963068 Oct 10 23:17:51.766530 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 1fabba3b47b34906b3f3af08ef327fc0 Oct 10 23:17:51.766530 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1227963068 Oct 10 23:17:51.766530 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AggregatesAdminNegativeTestJSON-1227963068-project Oct 10 23:17:51.766530 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:17:51.766530 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:17:51.766530 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 1f49e20be0594454980eab231570f868 Oct 10 23:17:51.766530 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1227963068-project Oct 10 23:17:51.766530 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:17:51.766530 n-d-860864-2 devstack@n-api.service[120614]: {"add_host": {"host": "n-h2-860864-2"}} Oct 10 23:17:51.766530 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:17:51.766530 n-d-860864-2 devstack@n-api.service[120614]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 10 23:17:51.767383 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h2-860864-2'}}} Oct 10 23:17:51.767383 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:51.767383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:51.767383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:51.767383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:51.767383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:51.767383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:51.767383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:51.767383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:51.767383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:51.767383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:51.767383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 10 23:17:51.767383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 10 23:17:51.767383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:17:51.767383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:17:51.767383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:17:51.767383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:17:51.767383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:17:51.767383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:17:51.768692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:17:51.768692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:17:51.768692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:17:51.768692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:17:51.768692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:17:51.768692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:17:51.768692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:17:51.768692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:17:51.768692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 10 23:17:51.768692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:51.768692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:51.768692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:51.768692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:51.768692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:51.768692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:51.768692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:17:51.768692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:17:51.768692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 10 23:17:51.768692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:51.770067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ac3ec3f2-9550-45ef-b744-df8b5391eb90 tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:51.770067 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ac3ec3f2-9550-45ef-b744-df8b5391eb90 tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.721719 Oct 10 23:17:51.771439 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 185/360] 10.222.0.23 () {60 vars in 1194 bytes} [Mon Oct 10 23:17:51 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 727 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:17:51.786690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-89bc3de3-2191-47a5-a95d-9cb2217532e3 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:51.861007 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-89bc3de3-2191-47a5-a95d-9cb2217532e3 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.088348 Oct 10 23:17:51.861654 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 186/361] 10.222.0.23 () {58 vars in 1155 bytes} [Mon Oct 10 23:17:51 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 23:17:51.882971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a5a232b6-038d-4ed6-9a7a-c8e161fa1fc2 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1407915399"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:51.888127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.aggregate [None req-a5a232b6-038d-4ed6-9a7a-c8e161fa1fc2 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Generated uuid 24cad9e1-6ba0-4c80-aade-be51ba47dc26 for aggregate {{(pid=120614) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 23:17:51.931401 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a5a232b6-038d-4ed6-9a7a-c8e161fa1fc2 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.052922 Oct 10 23:17:51.947290 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 187/362] 10.222.0.23 () {60 vars in 1164 bytes} [Mon Oct 10 23:17:51 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:51.965154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d962fb03-fb2f-4ce9-9305-2b0dcd27993f tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1191508601"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:51.996640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d962fb03-fb2f-4ce9-9305-2b0dcd27993f tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:51.998492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d962fb03-fb2f-4ce9-9305-2b0dcd27993f tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:52.000011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d962fb03-fb2f-4ce9-9305-2b0dcd27993f tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:52.022636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d962fb03-fb2f-4ce9-9305-2b0dcd27993f tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:52.023266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d962fb03-fb2f-4ce9-9305-2b0dcd27993f tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:52.024072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d962fb03-fb2f-4ce9-9305-2b0dcd27993f tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:52.045882 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-d962fb03-fb2f-4ce9-9305-2b0dcd27993f tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1191508601 could not be found. Oct 10 23:17:52.051208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d962fb03-fb2f-4ce9-9305-2b0dcd27993f tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Request method failure captured: Oct 10 23:17:52.051208 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 10 23:17:52.051208 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:17:52.051208 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:17:52.051208 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:17:52.051208 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 58 Oct 10 23:17:52.051208 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:17:52.051208 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:17:52.051208 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:17:52.051208 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:52.051208 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgckPGRPmUcWekeGWEAVdulBvhKaDIQuQ5LnDF5MNT5Yxu8s1rpxRuk8t0X_rKnwBr01ocwkWbLJf7nwODsuakwQD3_T0Lja9V6Gj6s53u9LEHXrykwpBgxb2r7hnZNA0qciiItkh6QDtMb7q2rY7TSZCTsbKJPY-LV9gCmKmNcOVg Oct 10 23:17:52.051208 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:17:52.051208 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:17:52.051208 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:17:52.051208 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:17:52.051208 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:17:52.051208 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:17:52.051208 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 613e206f3825462c8489bc7e625cec5e Oct 10 23:17:52.051208 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:52.051208 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:17:52.051208 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:17:52.052510 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_613e206f3825462c8489bc7e625cec5e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:52.052510 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:52.052510 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 613e206f3825462c8489bc7e625cec5e Oct 10 23:17:52.052510 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:52.052510 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin Oct 10 23:17:52.052510 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:17:52.052510 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:17:52.052510 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: ceabea8ef0414bbb8ccbccd5a5476b30 Oct 10 23:17:52.052510 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin Oct 10 23:17:52.052510 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:17:52.052510 n-d-860864-2 devstack@n-api.service[120614]: {"add_host": {"host": "tempest-nonexist_host-1191508601"}} Oct 10 23:17:52.052510 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:17:52.053181 n-d-860864-2 devstack@n-api.service[120614]: exception: Compute host tempest-nonexist_host-1191508601 could not be found. Oct 10 23:17:52.053181 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-1191508601'}}} Oct 10 23:17:52.053181 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:52.053181 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.053181 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 10 23:17:52.053181 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 10 23:17:52.053181 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:17:52.053181 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:17:52.053181 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 10 23:17:52.053181 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 10 23:17:52.053181 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:17:52.053181 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:17:52.053181 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 10 23:17:52.053181 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 10 23:17:52.053181 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1191508601' is not mapped to any cell Oct 10 23:17:52.053181 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.053181 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:52.053181 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.053181 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.053181 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 10 23:17:52.054373 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 10 23:17:52.054373 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 10 23:17:52.054373 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 10 23:17:52.054373 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 10 23:17:52.054373 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.054373 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:52.054373 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.054373 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.054373 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 10 23:17:52.054373 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 10 23:17:52.054373 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 23:17:52.054373 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 23:17:52.054373 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:17:52.054373 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:17:52.054373 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:17:52.054373 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:17:52.054373 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 23:17:52.054373 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 23:17:52.054373 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 10 23:17:52.054373 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 10 23:17:52.055484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 10 23:17:52.055484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 10 23:17:52.055484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1191508601 could not be found. Oct 10 23:17:52.055484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.055484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:52.055484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.055484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.055484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:52.055484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:52.055484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:52.055484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:52.055484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:52.055484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:52.055484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:52.055484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:52.055484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 10 23:17:52.055484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:17:52.055484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1191508601 could not be found. Oct 10 23:17:52.055484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.055484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:52.055484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.058162 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.058162 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:52.058162 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:52.058162 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:52.058162 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:52.058162 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1191508601 could not be found. Oct 10 23:17:52.058162 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.058162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d962fb03-fb2f-4ce9-9305-2b0dcd27993f tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1191508601 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:52.058162 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d962fb03-fb2f-4ce9-9305-2b0dcd27993f tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.105264 Oct 10 23:17:52.058162 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 188/363] 10.222.0.23 () {60 vars in 1194 bytes} [Mon Oct 10 23:17:51 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:17:52.075797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b128950f-8f3b-4ba8-959d-e0b8c049e48a tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:52.123016 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b128950f-8f3b-4ba8-959d-e0b8c049e48a tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.059585 Oct 10 23:17:52.124377 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 189/364] 10.222.0.23 () {58 vars in 1155 bytes} [Mon Oct 10 23:17:52 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 23:17:52.144388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-44e077f8-326a-443c-8be7-c48a88fae72e tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:52.148519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-44e077f8-326a-443c-8be7-c48a88fae72e tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Request method failure captured: Oct 10 23:17:52.148519 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 10 23:17:52.148519 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:17:52.148519 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:17:52.148519 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:17:52.148519 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 283 Oct 10 23:17:52.148519 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:17:52.148519 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:17:52.148519 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:17:52.148519 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:52.148519 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgckPGRPmUcWekeGWEAVdulBvhKaDIQuQ5LnDF5MNT5Yxu8s1rpxRuk8t0X_rKnwBr01ocwkWbLJf7nwODsuakwQD3_T0Lja9V6Gj6s53u9LEHXrykwpBgxb2r7hnZNA0qciiItkh6QDtMb7q2rY7TSZCTsbKJPY-LV9gCmKmNcOVg Oct 10 23:17:52.148519 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:17:52.148519 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:17:52.148519 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:17:52.148519 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:17:52.148519 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:17:52.148519 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:17:52.148519 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 613e206f3825462c8489bc7e625cec5e Oct 10 23:17:52.148519 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:52.148519 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:17:52.148519 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:17:52.149760 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_613e206f3825462c8489bc7e625cec5e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:52.149760 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:52.149760 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 613e206f3825462c8489bc7e625cec5e Oct 10 23:17:52.149760 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:52.149760 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin Oct 10 23:17:52.149760 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:17:52.149760 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:17:52.149760 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: ceabea8ef0414bbb8ccbccd5a5476b30 Oct 10 23:17:52.149760 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin Oct 10 23:17:52.149760 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:17:52.150314 n-d-860864-2 devstack@n-api.service[120614]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 10 23:17:52.150314 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:17:52.150314 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 23:17:52.150314 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 10 23:17:52.150314 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:52.150314 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.150314 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:17:52.150314 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:17:52.150314 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:17:52.150314 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:17:52.151408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 23:17:52.151408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.151408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 10 23:17:52.151408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 23:17:52.151408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.151408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 10 23:17:52.151408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 10 23:17:52.151408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.151408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:52.151408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.151408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.151408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:52.151408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:52.151408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:52.151408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:52.151408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:52.151408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:52.152335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:52.152335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:52.152335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:17:52.152335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:17:52.152335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:17:52.152335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:17:52.152335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:17:52.152335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:17:52.152335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 23:17:52.152335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.152335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:52.152335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.152335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.152335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:52.152335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:52.153150 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:17:52.153150 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:17:52.153150 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 23:17:52.153150 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.155816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-44e077f8-326a-443c-8be7-c48a88fae72e tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:52.156900 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-44e077f8-326a-443c-8be7-c48a88fae72e tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.016650 Oct 10 23:17:52.157677 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 190/365] 10.222.0.23 () {60 vars in 1165 bytes} [Mon Oct 10 23:17:52 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:17:52.167036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d31687cb-8c9d-4212-9e38-092bee947f1d tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:52.175942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d31687cb-8c9d-4212-9e38-092bee947f1d tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Request method failure captured: Oct 10 23:17:52.175942 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 10 23:17:52.175942 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:17:52.175942 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:17:52.175942 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:17:52.175942 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 27 Oct 10 23:17:52.175942 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:17:52.175942 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:17:52.175942 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:17:52.175942 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:52.175942 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgckPGRPmUcWekeGWEAVdulBvhKaDIQuQ5LnDF5MNT5Yxu8s1rpxRuk8t0X_rKnwBr01ocwkWbLJf7nwODsuakwQD3_T0Lja9V6Gj6s53u9LEHXrykwpBgxb2r7hnZNA0qciiItkh6QDtMb7q2rY7TSZCTsbKJPY-LV9gCmKmNcOVg Oct 10 23:17:52.175942 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:17:52.175942 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:17:52.175942 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:17:52.175942 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:17:52.175942 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:17:52.175942 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:17:52.175942 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 613e206f3825462c8489bc7e625cec5e Oct 10 23:17:52.175942 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:52.175942 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:17:52.175942 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:17:52.177254 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_613e206f3825462c8489bc7e625cec5e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:52.177254 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:52.177254 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 613e206f3825462c8489bc7e625cec5e Oct 10 23:17:52.177254 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:52.177254 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin Oct 10 23:17:52.177254 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:17:52.177254 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:17:52.177254 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: ceabea8ef0414bbb8ccbccd5a5476b30 Oct 10 23:17:52.177254 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin Oct 10 23:17:52.177254 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:17:52.177254 n-d-860864-2 devstack@n-api.service[120614]: {"aggregate": {"name": ""}} Oct 10 23:17:52.177254 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:17:52.177254 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 10 23:17:52.178867 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 10 23:17:52.178867 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:52.178867 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.178867 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:17:52.178867 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:17:52.178867 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:17:52.178867 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:17:52.178867 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 10 23:17:52.178867 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.178867 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 10 23:17:52.178867 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 23:17:52.178867 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.178867 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 10 23:17:52.178867 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi '' Oct 10 23:17:52.178867 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.178867 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:52.178867 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.178867 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.178867 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:52.178867 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:52.178867 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:52.178867 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:52.178867 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:52.180204 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:52.180204 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:52.180204 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:52.180204 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:17:52.180204 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:17:52.180204 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:17:52.180204 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:17:52.180204 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:17:52.180204 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:17:52.180204 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 10 23:17:52.180204 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.180204 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:52.180204 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.180204 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.180204 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:52.180204 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:52.180204 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:17:52.180204 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:17:52.180204 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 10 23:17:52.180204 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.183687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d31687cb-8c9d-4212-9e38-092bee947f1d tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:52.186719 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d31687cb-8c9d-4212-9e38-092bee947f1d tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.022577 Oct 10 23:17:52.189172 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 191/366] 10.222.0.23 () {60 vars in 1164 bytes} [Mon Oct 10 23:17:52 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:17:52.208836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2e206538-d96f-4180-ae8a-21c3df2164d8 tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-483511299"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:52.236390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2e206538-d96f-4180-ae8a-21c3df2164d8 tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '1f49e20be0594454980eab231570f868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fabba3b47b34906b3f3af08ef327fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:52.238485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2e206538-d96f-4180-ae8a-21c3df2164d8 tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Request method failure captured: Oct 10 23:17:52.238485 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 10 23:17:52.238485 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:17:52.238485 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:17:52.238485 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:17:52.238485 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 59 Oct 10 23:17:52.238485 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:17:52.238485 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:17:52.238485 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:17:52.238485 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:52.238485 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgbXCdcABT-O9kgMT4w66qExkcix7GdTMy3kXQlUcFTfQ-oNq67M7SwGRdW9ZA3pPbL0Bsldz0jzGnecUSjxoGqJLFXrVQJ7C8aWAFSfcooBZQBWvOxKz8D6EMgm7TX4CbSs21P37XHwCpV81xETYMmpAC9E19t-LLTnIqEpK66Wjc Oct 10 23:17:52.238485 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:17:52.238485 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:17:52.238485 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:17:52.238485 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:17:52.238485 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:17:52.238485 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:17:52.238485 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 1fabba3b47b34906b3f3af08ef327fc0 Oct 10 23:17:52.238485 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1227963068 Oct 10 23:17:52.238485 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:17:52.238485 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:17:52.239759 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1fabba3b47b34906b3f3af08ef327fc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fabba3b47b34906b3f3af08ef327fc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fabba3b47b34906b3f3af08ef327fc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1fabba3b47b34906b3f3af08ef327fc0", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:52.239759 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1227963068 Oct 10 23:17:52.239759 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 1fabba3b47b34906b3f3af08ef327fc0 Oct 10 23:17:52.239759 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1227963068 Oct 10 23:17:52.239759 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AggregatesAdminNegativeTestJSON-1227963068-project Oct 10 23:17:52.239759 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:17:52.239759 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:17:52.239759 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 1f49e20be0594454980eab231570f868 Oct 10 23:17:52.239759 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1227963068-project Oct 10 23:17:52.239759 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:17:52.239759 n-d-860864-2 devstack@n-api.service[120614]: {"aggregate": {"name": "tempest-test_aggregate-483511299"}} Oct 10 23:17:52.239759 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:17:52.239759 n-d-860864-2 devstack@n-api.service[120614]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 10 23:17:52.240503 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-483511299'}}} Oct 10 23:17:52.240503 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:52.240503 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.240503 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:52.240503 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:52.240503 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:52.240503 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:52.240503 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:52.240503 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:52.240503 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:52.240503 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:52.240503 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:52.240503 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:52.240503 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 10 23:17:52.240503 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 10 23:17:52.240503 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:17:52.240503 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:17:52.240503 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:17:52.240503 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:17:52.241592 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:17:52.241592 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:17:52.241592 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:17:52.241592 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:17:52.241592 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:17:52.241592 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:17:52.241592 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:17:52.241592 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:17:52.241592 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:17:52.241592 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:17:52.241592 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 10 23:17:52.241592 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.241592 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:52.241592 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.241592 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.241592 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:52.241592 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:52.241592 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:17:52.241592 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:17:52.241592 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 10 23:17:52.242695 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.244276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2e206538-d96f-4180-ae8a-21c3df2164d8 tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:52.245414 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2e206538-d96f-4180-ae8a-21c3df2164d8 tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.051111 Oct 10 23:17:52.247410 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 192/367] 10.222.0.23 () {60 vars in 1164 bytes} [Mon Oct 10 23:17:52 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:17:52.273716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eaa6624d-f2a8-40c4-b575-8db710a2bb2b tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-284829885"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:52.282751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.aggregate [None req-eaa6624d-f2a8-40c4-b575-8db710a2bb2b tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Generated uuid 3156a457-7ed5-4fdc-8bff-060d64bee6be for aggregate {{(pid=120614) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 23:17:52.304386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=50 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:52.329510 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eaa6624d-f2a8-40c4-b575-8db710a2bb2b tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.074223 Oct 10 23:17:52.337314 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 193/368] 10.222.0.23 () {60 vars in 1164 bytes} [Mon Oct 10 23:17:52 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:52.349267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9e5b4570-f79e-4f08-8a5c-a2abebcef611 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-284829885"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:52.359712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.aggregate [None req-9e5b4570-f79e-4f08-8a5c-a2abebcef611 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Generated uuid 46bcde0b-f222-4db6-b588-a956940b3a98 for aggregate {{(pid=120614) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 23:17:52.383466 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-9e5b4570-f79e-4f08-8a5c-a2abebcef611 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-284829885 already exists. Oct 10 23:17:52.387680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9e5b4570-f79e-4f08-8a5c-a2abebcef611 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Request method failure captured: Oct 10 23:17:52.387680 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 10 23:17:52.387680 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:17:52.387680 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:17:52.387680 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:17:52.387680 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 59 Oct 10 23:17:52.387680 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:17:52.387680 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:17:52.387680 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:17:52.387680 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:52.387680 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgckPGRPmUcWekeGWEAVdulBvhKaDIQuQ5LnDF5MNT5Yxu8s1rpxRuk8t0X_rKnwBr01ocwkWbLJf7nwODsuakwQD3_T0Lja9V6Gj6s53u9LEHXrykwpBgxb2r7hnZNA0qciiItkh6QDtMb7q2rY7TSZCTsbKJPY-LV9gCmKmNcOVg Oct 10 23:17:52.387680 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:17:52.387680 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:17:52.387680 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:17:52.387680 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:17:52.387680 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:17:52.387680 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:17:52.387680 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 613e206f3825462c8489bc7e625cec5e Oct 10 23:17:52.387680 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:52.387680 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:17:52.387680 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:17:52.390225 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_613e206f3825462c8489bc7e625cec5e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:52.390225 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:52.390225 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 613e206f3825462c8489bc7e625cec5e Oct 10 23:17:52.390225 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:52.390225 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin Oct 10 23:17:52.390225 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:17:52.390225 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:17:52.390225 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: ceabea8ef0414bbb8ccbccd5a5476b30 Oct 10 23:17:52.390225 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin Oct 10 23:17:52.390225 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:17:52.390225 n-d-860864-2 devstack@n-api.service[120614]: {"aggregate": {"name": "tempest-test_aggregate-284829885"}} Oct 10 23:17:52.390225 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:17:52.390225 n-d-860864-2 devstack@n-api.service[120614]: exception: Aggregate tempest-test_aggregate-284829885 already exists. Oct 10 23:17:52.390937 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-284829885'}}} Oct 10 23:17:52.390937 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:52.390937 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.390937 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 10 23:17:52.390937 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 10 23:17:52.390937 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 23:17:52.390937 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 23:17:52.390937 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:17:52.390937 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:17:52.390937 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:17:52.390937 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:17:52.390937 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 23:17:52.390937 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 23:17:52.390937 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 10 23:17:52.390937 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 10 23:17:52.390937 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 10 23:17:52.390937 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 10 23:17:52.390937 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 10 23:17:52.390937 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 10 23:17:52.391964 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:17:52.391964 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:17:52.391964 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 10 23:17:52.391964 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 10 23:17:52.391964 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-284829885 already exists. Oct 10 23:17:52.391964 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.391964 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:52.391964 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.391964 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.391964 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:52.391964 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:52.391964 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:52.391964 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:52.391964 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:52.391964 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:52.391964 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:52.391964 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:52.391964 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:52.391964 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:52.391964 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 10 23:17:52.395122 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 10 23:17:52.395122 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-284829885 already exists. Oct 10 23:17:52.395122 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.395122 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:52.395122 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.395122 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.395122 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:52.395122 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:52.395122 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:52.395122 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:52.395122 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-284829885 already exists. Oct 10 23:17:52.395122 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.395122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9e5b4570-f79e-4f08-8a5c-a2abebcef611 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-284829885 already exists. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:52.395122 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9e5b4570-f79e-4f08-8a5c-a2abebcef611 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.053311 Oct 10 23:17:52.401303 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 194/369] 10.222.0.23 () {60 vars in 1164 bytes} [Mon Oct 10 23:17:52 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 10 23:17:52.409139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b1ae5a7d-cc19-4883-b17c-693a4d097911 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:52.460081 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b1ae5a7d-cc19-4883-b17c-693a4d097911 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.060220 Oct 10 23:17:52.463782 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 195/370] 10.222.0.23 () {58 vars in 1155 bytes} [Mon Oct 10 23:17:52 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 23:17:52.479481 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f500ae11-2366-4aad-adc8-10844db34082 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71" status: 200 len: 1618 microversion: 2.1 time: 2.289659 Oct 10 23:17:52.489701 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 176/371] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:50 2022] GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71 => generated 1618 bytes in 2304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:17:52.507247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5b618fe1-d0a5-4def-849e-76854f3b98ad tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-66985136"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:52.512763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b1f6ef23-6c5b-4ee0-9803-a46447450a78 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Action: 'create', calling method: .version_select at 0x7f663029f5e0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1057408258", "policies": ["affinity"]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:52.522074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.aggregate [None req-5b618fe1-d0a5-4def-849e-76854f3b98ad tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Generated uuid 135dbc72-0eb9-4063-9966-83161f187dd7 for aggregate {{(pid=120614) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 23:17:52.567235 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5b618fe1-d0a5-4def-849e-76854f3b98ad tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.082747 Oct 10 23:17:52.568338 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 196/372] 10.222.0.23 () {60 vars in 1164 bytes} [Mon Oct 10 23:17:52 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:52.582625 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0705bd4b-7527-48a6-b948-568f180eda1e tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:52.585997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0705bd4b-7527-48a6-b948-568f180eda1e tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '1f49e20be0594454980eab231570f868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fabba3b47b34906b3f3af08ef327fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:52.588611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-b1f6ef23-6c5b-4ee0-9803-a46447450a78 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_groups'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:17:52.590709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0705bd4b-7527-48a6-b948-568f180eda1e tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Request method failure captured: Oct 10 23:17:52.590709 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 10 23:17:52.590709 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:17:52.590709 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:17:52.590709 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:17:52.590709 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:17:52.590709 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:17:52.590709 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:17:52.590709 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:17:52.590709 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:52.590709 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgbXCdcABT-O9kgMT4w66qExkcix7GdTMy3kXQlUcFTfQ-oNq67M7SwGRdW9ZA3pPbL0Bsldz0jzGnecUSjxoGqJLFXrVQJ7C8aWAFSfcooBZQBWvOxKz8D6EMgm7TX4CbSs21P37XHwCpV81xETYMmpAC9E19t-LLTnIqEpK66Wjc Oct 10 23:17:52.590709 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:17:52.590709 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:17:52.590709 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:17:52.590709 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:17:52.590709 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:17:52.590709 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:17:52.590709 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 1fabba3b47b34906b3f3af08ef327fc0 Oct 10 23:17:52.590709 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1227963068 Oct 10 23:17:52.590709 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:17:52.590709 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:17:52.592380 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1fabba3b47b34906b3f3af08ef327fc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fabba3b47b34906b3f3af08ef327fc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fabba3b47b34906b3f3af08ef327fc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1fabba3b47b34906b3f3af08ef327fc0", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:52.592380 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1227963068 Oct 10 23:17:52.592380 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 1fabba3b47b34906b3f3af08ef327fc0 Oct 10 23:17:52.592380 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1227963068 Oct 10 23:17:52.592380 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AggregatesAdminNegativeTestJSON-1227963068-project Oct 10 23:17:52.592380 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:17:52.592380 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:17:52.592380 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 1f49e20be0594454980eab231570f868 Oct 10 23:17:52.592380 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1227963068-project Oct 10 23:17:52.592380 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:17:52.592380 n-d-860864-2 devstack@n-api.service[120614]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 10 23:17:52.592380 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '15'} Oct 10 23:17:52.593201 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:52.593201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.593201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:52.593201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:52.593201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:52.593201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:52.593201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:52.593201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:52.593201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 10 23:17:52.593201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 10 23:17:52.593201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:17:52.593201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:17:52.593201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:17:52.593201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:17:52.593201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:17:52.593201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:17:52.593201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:17:52.593201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:17:52.593201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:17:52.594714 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:17:52.594714 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:17:52.594714 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:17:52.594714 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:17:52.594714 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:17:52.594714 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 10 23:17:52.594714 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.594714 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:52.594714 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.594714 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.594714 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:52.594714 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:52.594714 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:17:52.594714 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:17:52.594714 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 10 23:17:52.594714 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.599596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0705bd4b-7527-48a6-b948-568f180eda1e tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:52.602818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-b1f6ef23-6c5b-4ee0-9803-a46447450a78 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for user 310196e1663a4f7ca12e1fc53b0278ba and project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_groups'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:17:52.603320 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0705bd4b-7527-48a6-b948-568f180eda1e tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.026254 Oct 10 23:17:52.604400 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 197/373] 10.222.0.23 () {58 vars in 1155 bytes} [Mon Oct 10 23:17:52 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:17:52.623942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1cd72c3a-8714-4a76-808a-165c027ebd8e tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:52.636913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=9 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:52.705944 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1cd72c3a-8714-4a76-808a-165c027ebd8e tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.096056 Oct 10 23:17:52.707540 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 198/374] 10.222.0.23 () {58 vars in 1155 bytes} [Mon Oct 10 23:17:52 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 23:17:52.717124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ae8c20dd-97a6-495e-9027-03d72e7293ab tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:52.755267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:52.755466 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-ae8c20dd-97a6-495e-9027-03d72e7293ab tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 10 23:17:52.759334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ae8c20dd-97a6-495e-9027-03d72e7293ab tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Request method failure captured: Oct 10 23:17:52.759334 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 10 23:17:52.759334 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:17:52.759334 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:17:52.759334 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:17:52.759334 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:17:52.759334 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:17:52.759334 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:17:52.759334 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:17:52.759334 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:52.759334 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgckPGRPmUcWekeGWEAVdulBvhKaDIQuQ5LnDF5MNT5Yxu8s1rpxRuk8t0X_rKnwBr01ocwkWbLJf7nwODsuakwQD3_T0Lja9V6Gj6s53u9LEHXrykwpBgxb2r7hnZNA0qciiItkh6QDtMb7q2rY7TSZCTsbKJPY-LV9gCmKmNcOVg Oct 10 23:17:52.759334 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:17:52.759334 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:17:52.759334 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:17:52.759334 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:17:52.759334 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:17:52.759334 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:17:52.759334 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 613e206f3825462c8489bc7e625cec5e Oct 10 23:17:52.759334 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:52.759334 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:17:52.759334 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:17:52.760840 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_613e206f3825462c8489bc7e625cec5e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:52.760840 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:52.760840 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 613e206f3825462c8489bc7e625cec5e Oct 10 23:17:52.760840 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:52.760840 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin Oct 10 23:17:52.760840 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:17:52.760840 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:17:52.760840 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: ceabea8ef0414bbb8ccbccd5a5476b30 Oct 10 23:17:52.760840 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin Oct 10 23:17:52.760840 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:17:52.760840 n-d-860864-2 devstack@n-api.service[120614]: exception: Aggregate -1 could not be found. Oct 10 23:17:52.760840 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '-1'} Oct 10 23:17:52.761717 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:52.761717 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.761717 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 10 23:17:52.761717 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 10 23:17:52.761717 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 23:17:52.761717 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 23:17:52.761717 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:17:52.761717 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:17:52.761717 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:17:52.761717 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:17:52.761717 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 23:17:52.761717 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 23:17:52.761717 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 10 23:17:52.761717 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 10 23:17:52.761717 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:17:52.761717 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:17:52.761717 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 10 23:17:52.761717 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 10 23:17:52.761717 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:17:52.763295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:17:52.763295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 10 23:17:52.763295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 10 23:17:52.763295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 10 23:17:52.763295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.763295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:52.763295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.763295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.763295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:52.763295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:52.763295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:52.763295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:52.763295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:52.763295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:52.763295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 10 23:17:52.763295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:17:52.763295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 10 23:17:52.763295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.763295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:52.763295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.763295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.764671 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:52.764671 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:52.764671 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:52.764671 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:52.764671 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 10 23:17:52.764671 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.764671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ae8c20dd-97a6-495e-9027-03d72e7293ab tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:52.764671 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ae8c20dd-97a6-495e-9027-03d72e7293ab tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.051317 Oct 10 23:17:52.766174 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 199/375] 10.222.0.23 () {58 vars in 1155 bytes} [Mon Oct 10 23:17:52 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 10 23:17:52.777969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e3576c98-98cd-4d52-a155-8540dd3368e2 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1387201869"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:52.790442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.aggregate [None req-e3576c98-98cd-4d52-a155-8540dd3368e2 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Generated uuid de58bbea-28c2-433d-b45c-24c545cbcace for aggregate {{(pid=120614) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 23:17:52.791987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-b1f6ef23-6c5b-4ee0-9803-a46447450a78 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_groups'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:17:52.818670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-b1f6ef23-6c5b-4ee0-9803-a46447450a78 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for user 310196e1663a4f7ca12e1fc53b0278ba and project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_groups'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:17:52.852498 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e3576c98-98cd-4d52-a155-8540dd3368e2 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.081552 Oct 10 23:17:52.853017 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 200/376] 10.222.0.23 () {60 vars in 1164 bytes} [Mon Oct 10 23:17:52 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:52.859133 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b1f6ef23-6c5b-4ee0-9803-a46447450a78 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.355846 Oct 10 23:17:52.871303 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 177/377] 10.222.0.23 () {60 vars in 1174 bytes} [Mon Oct 10 23:17:52 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:52.880886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2de207aa-2400-412c-ba05-48ea34a562fb tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:52.882845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2de207aa-2400-412c-ba05-48ea34a562fb tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '1f49e20be0594454980eab231570f868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fabba3b47b34906b3f3af08ef327fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:52.884853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2de207aa-2400-412c-ba05-48ea34a562fb tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Request method failure captured: Oct 10 23:17:52.884853 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 10 23:17:52.884853 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:17:52.884853 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:17:52.884853 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:17:52.884853 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:17:52.884853 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:17:52.884853 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:17:52.884853 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:17:52.884853 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:52.884853 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgbXCdcABT-O9kgMT4w66qExkcix7GdTMy3kXQlUcFTfQ-oNq67M7SwGRdW9ZA3pPbL0Bsldz0jzGnecUSjxoGqJLFXrVQJ7C8aWAFSfcooBZQBWvOxKz8D6EMgm7TX4CbSs21P37XHwCpV81xETYMmpAC9E19t-LLTnIqEpK66Wjc Oct 10 23:17:52.884853 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:17:52.884853 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:17:52.884853 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:17:52.884853 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:17:52.884853 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:17:52.884853 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:17:52.884853 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 1fabba3b47b34906b3f3af08ef327fc0 Oct 10 23:17:52.884853 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1227963068 Oct 10 23:17:52.884853 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:17:52.884853 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:17:52.886272 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1fabba3b47b34906b3f3af08ef327fc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fabba3b47b34906b3f3af08ef327fc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fabba3b47b34906b3f3af08ef327fc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1fabba3b47b34906b3f3af08ef327fc0", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:52.886272 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1227963068 Oct 10 23:17:52.886272 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 1fabba3b47b34906b3f3af08ef327fc0 Oct 10 23:17:52.886272 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1227963068 Oct 10 23:17:52.886272 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AggregatesAdminNegativeTestJSON-1227963068-project Oct 10 23:17:52.886272 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:17:52.886272 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:17:52.886272 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 1f49e20be0594454980eab231570f868 Oct 10 23:17:52.886272 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1227963068-project Oct 10 23:17:52.886272 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:17:52.886272 n-d-860864-2 devstack@n-api.service[120614]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 10 23:17:52.886272 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '16'} Oct 10 23:17:52.887120 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:52.887120 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.887120 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:52.887120 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:52.887120 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:52.887120 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:52.887120 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:52.887120 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:52.887120 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 10 23:17:52.887120 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 10 23:17:52.887120 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:17:52.887120 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:17:52.887120 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:17:52.887120 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:17:52.887120 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:17:52.887120 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:17:52.887120 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:17:52.887120 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:17:52.887120 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:17:52.889323 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:17:52.889323 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:17:52.889323 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:17:52.889323 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:17:52.889323 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:17:52.889323 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 10 23:17:52.889323 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.889323 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:52.889323 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.889323 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.889323 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:52.889323 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:52.889323 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:17:52.889323 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:17:52.889323 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 10 23:17:52.889323 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.893733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2de207aa-2400-412c-ba05-48ea34a562fb tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:52.894805 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2de207aa-2400-412c-ba05-48ea34a562fb tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] 10.222.0.23 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.017788 Oct 10 23:17:52.897080 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 201/378] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:17:52 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:17:52.909580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f5a81819-08a2-4ed2-8402-cb64f6fa6626 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:52.955468 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f5a81819-08a2-4ed2-8402-cb64f6fa6626 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.053670 Oct 10 23:17:52.958497 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 178/379] 10.222.0.23 () {58 vars in 1155 bytes} [Mon Oct 10 23:17:52 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 23:17:52.969681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c14ac101-7e3a-4bcd-8a8a-fac8ce920cb0 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:52.983059 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-c14ac101-7e3a-4bcd-8a8a-fac8ce920cb0 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 10 23:17:52.989121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c14ac101-7e3a-4bcd-8a8a-fac8ce920cb0 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Request method failure captured: Oct 10 23:17:52.989121 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 10 23:17:52.989121 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:17:52.989121 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:17:52.989121 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:17:52.989121 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:17:52.989121 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:17:52.989121 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:17:52.989121 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:17:52.989121 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:52.989121 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgckPGRPmUcWekeGWEAVdulBvhKaDIQuQ5LnDF5MNT5Yxu8s1rpxRuk8t0X_rKnwBr01ocwkWbLJf7nwODsuakwQD3_T0Lja9V6Gj6s53u9LEHXrykwpBgxb2r7hnZNA0qciiItkh6QDtMb7q2rY7TSZCTsbKJPY-LV9gCmKmNcOVg Oct 10 23:17:52.989121 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:17:52.989121 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:17:52.989121 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:17:52.989121 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:17:52.989121 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:17:52.989121 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:17:52.989121 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 613e206f3825462c8489bc7e625cec5e Oct 10 23:17:52.989121 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:52.989121 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:17:52.989121 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:17:52.990571 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_613e206f3825462c8489bc7e625cec5e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:52.990571 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:52.990571 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 613e206f3825462c8489bc7e625cec5e Oct 10 23:17:52.990571 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:52.990571 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin Oct 10 23:17:52.990571 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:17:52.990571 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:17:52.990571 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: ceabea8ef0414bbb8ccbccd5a5476b30 Oct 10 23:17:52.990571 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin Oct 10 23:17:52.990571 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:17:52.990571 n-d-860864-2 devstack@n-api.service[120614]: exception: Aggregate -1 could not be found. Oct 10 23:17:52.990571 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '-1'} Oct 10 23:17:52.991236 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:52.991236 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.991236 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 10 23:17:52.991236 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 10 23:17:52.991236 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 10 23:17:52.991236 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 10 23:17:52.991236 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:17:52.991236 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:17:52.991236 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 10 23:17:52.991236 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 10 23:17:52.991236 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:17:52.991236 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:17:52.991236 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 10 23:17:52.991236 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 10 23:17:52.991236 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 10 23:17:52.991236 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.991236 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:52.991236 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.991236 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.991236 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:52.992420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:52.992420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:52.992420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:52.992420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:52.992420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:52.992420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 10 23:17:52.992420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:17:52.992420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 10 23:17:52.992420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.992420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:52.992420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.992420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:52.992420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:52.992420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:52.992420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:52.992420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:52.992420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 10 23:17:52.992420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:52.996413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c14ac101-7e3a-4bcd-8a8a-fac8ce920cb0 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:52.996413 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c14ac101-7e3a-4bcd-8a8a-fac8ce920cb0 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.029130 Oct 10 23:17:52.996413 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 202/380] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:17:52 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:17:53.009583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cc7e4463-cc9b-4284-b7da-6c79c997c5fc tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:53.011755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cc7e4463-cc9b-4284-b7da-6c79c997c5fc tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '1f49e20be0594454980eab231570f868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fabba3b47b34906b3f3af08ef327fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:53.014591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cc7e4463-cc9b-4284-b7da-6c79c997c5fc tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Request method failure captured: Oct 10 23:17:53.014591 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 10 23:17:53.014591 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:17:53.014591 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:17:53.014591 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:17:53.014591 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:17:53.014591 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:17:53.014591 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:17:53.014591 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:17:53.014591 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:53.014591 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKgbXCdcABT-O9kgMT4w66qExkcix7GdTMy3kXQlUcFTfQ-oNq67M7SwGRdW9ZA3pPbL0Bsldz0jzGnecUSjxoGqJLFXrVQJ7C8aWAFSfcooBZQBWvOxKz8D6EMgm7TX4CbSs21P37XHwCpV81xETYMmpAC9E19t-LLTnIqEpK66Wjc Oct 10 23:17:53.014591 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:17:53.014591 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:17:53.014591 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:17:53.014591 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:17:53.014591 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:17:53.014591 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:17:53.014591 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 1fabba3b47b34906b3f3af08ef327fc0 Oct 10 23:17:53.014591 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1227963068 Oct 10 23:17:53.014591 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:17:53.014591 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:17:53.015912 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1fabba3b47b34906b3f3af08ef327fc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fabba3b47b34906b3f3af08ef327fc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fabba3b47b34906b3f3af08ef327fc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1fabba3b47b34906b3f3af08ef327fc0", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:53.015912 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1227963068 Oct 10 23:17:53.015912 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 1fabba3b47b34906b3f3af08ef327fc0 Oct 10 23:17:53.015912 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1227963068 Oct 10 23:17:53.015912 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AggregatesAdminNegativeTestJSON-1227963068-project Oct 10 23:17:53.015912 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:17:53.015912 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:17:53.015912 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 1f49e20be0594454980eab231570f868 Oct 10 23:17:53.015912 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1227963068-project Oct 10 23:17:53.015912 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:17:53.015912 n-d-860864-2 devstack@n-api.service[120613]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 10 23:17:53.015912 n-d-860864-2 devstack@n-api.service[120613]: action_args: {} Oct 10 23:17:53.016743 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:53.016743 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:53.016743 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:53.016743 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:53.016743 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:53.016743 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:53.016743 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:53.016743 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:53.016743 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 10 23:17:53.016743 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 10 23:17:53.016743 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:17:53.016743 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:17:53.016743 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:17:53.016743 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:17:53.016743 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:17:53.016743 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:17:53.016743 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:17:53.016743 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:17:53.016743 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:17:53.018080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:17:53.018080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:17:53.018080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:17:53.018080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:17:53.018080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:17:53.018080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 10 23:17:53.018080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:53.018080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:53.018080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:53.018080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:53.018080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:53.018080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:53.018080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:17:53.018080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:17:53.018080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 10 23:17:53.018080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:53.022463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cc7e4463-cc9b-4284-b7da-6c79c997c5fc tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:53.024421 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cc7e4463-cc9b-4284-b7da-6c79c997c5fc tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.020640 Oct 10 23:17:53.027515 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 179/381] 10.222.0.23 () {58 vars in 1143 bytes} [Mon Oct 10 23:17:53 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:17:53.049398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f7fa0a65-55ae-4c2d-9b4e-fe7f49114d90 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1413639144"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:53.057066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.aggregate [None req-f7fa0a65-55ae-4c2d-9b4e-fe7f49114d90 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Generated uuid 5addccc3-6301-4a9d-84bf-ce2ca53d232e for aggregate {{(pid=120614) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 23:17:53.126463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2133333226", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "a3002422-b16d-498d-8c8b-e67d1ef376e7"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:53.175640 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f7fa0a65-55ae-4c2d-9b4e-fe7f49114d90 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.122035 Oct 10 23:17:53.176369 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 203/382] 10.222.0.23 () {60 vars in 1164 bytes} [Mon Oct 10 23:17:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:53.188778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e2664915-3d2b-4f53-9520-08f7d0d20dfa tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-2"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:53.203581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e2664915-3d2b-4f53-9520-08f7d0d20dfa tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:53.204425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e2664915-3d2b-4f53-9520-08f7d0d20dfa tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:53.206029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e2664915-3d2b-4f53-9520-08f7d0d20dfa tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:53.302804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] validate_networks() for None {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:17:53.495215 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e2664915-3d2b-4f53-9520-08f7d0d20dfa tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.310730 Oct 10 23:17:53.495796 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 204/383] 10.222.0.23 () {60 vars in 1194 bytes} [Mon Oct 10 23:17:53 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:53.509356 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-74b0a671-7a00-47b9-90c9-476d2a25679a tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-2"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:53.514042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-74b0a671-7a00-47b9-90c9-476d2a25679a tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '1f49e20be0594454980eab231570f868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fabba3b47b34906b3f3af08ef327fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:53.515865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-74b0a671-7a00-47b9-90c9-476d2a25679a tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Request method failure captured: Oct 10 23:17:53.515865 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 10 23:17:53.515865 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:17:53.515865 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:17:53.515865 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:17:53.515865 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 42 Oct 10 23:17:53.515865 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:17:53.515865 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:17:53.515865 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:17:53.515865 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:53.515865 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgbXCdcABT-O9kgMT4w66qExkcix7GdTMy3kXQlUcFTfQ-oNq67M7SwGRdW9ZA3pPbL0Bsldz0jzGnecUSjxoGqJLFXrVQJ7C8aWAFSfcooBZQBWvOxKz8D6EMgm7TX4CbSs21P37XHwCpV81xETYMmpAC9E19t-LLTnIqEpK66Wjc Oct 10 23:17:53.515865 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:17:53.515865 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:17:53.515865 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:17:53.515865 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:17:53.515865 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:17:53.515865 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:17:53.515865 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 1fabba3b47b34906b3f3af08ef327fc0 Oct 10 23:17:53.515865 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1227963068 Oct 10 23:17:53.515865 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:17:53.515865 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:17:53.517077 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1fabba3b47b34906b3f3af08ef327fc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fabba3b47b34906b3f3af08ef327fc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1fabba3b47b34906b3f3af08ef327fc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1fabba3b47b34906b3f3af08ef327fc0", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:53.517077 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1227963068 Oct 10 23:17:53.517077 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 1fabba3b47b34906b3f3af08ef327fc0 Oct 10 23:17:53.517077 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1227963068 Oct 10 23:17:53.517077 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AggregatesAdminNegativeTestJSON-1227963068-project Oct 10 23:17:53.517077 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:17:53.517077 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:17:53.517077 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 1f49e20be0594454980eab231570f868 Oct 10 23:17:53.517077 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1227963068-project Oct 10 23:17:53.517077 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:17:53.517077 n-d-860864-2 devstack@n-api.service[120614]: {"remove_host": {"host": "n-h2-860864-2"}} Oct 10 23:17:53.517077 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:17:53.517077 n-d-860864-2 devstack@n-api.service[120614]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 10 23:17:53.517852 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-860864-2'}}} Oct 10 23:17:53.517852 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:53.517852 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:53.517852 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:53.517852 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:53.517852 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:53.517852 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:53.517852 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:53.517852 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:53.517852 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:53.517852 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:53.517852 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 10 23:17:53.517852 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 10 23:17:53.517852 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:17:53.517852 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:17:53.517852 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:17:53.517852 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:17:53.517852 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:17:53.517852 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:17:53.518880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:17:53.518880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:17:53.518880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:17:53.518880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:17:53.518880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:17:53.518880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:17:53.518880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:17:53.518880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:17:53.518880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 10 23:17:53.518880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:53.518880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:53.518880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:53.518880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:53.518880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:53.518880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:53.518880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:17:53.518880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:17:53.518880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 10 23:17:53.518880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:53.521228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-74b0a671-7a00-47b9-90c9-476d2a25679a tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:53.521228 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-74b0a671-7a00-47b9-90c9-476d2a25679a tempest-AggregatesAdminNegativeTestJSON-1227963068 tempest-AggregatesAdminNegativeTestJSON-1227963068-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.011965 Oct 10 23:17:53.521652 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 205/384] 10.222.0.23 () {60 vars in 1194 bytes} [Mon Oct 10 23:17:53 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:17:53.529656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-27583a7e-efa8-4e86-a48f-89f156a209e7 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-2"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:53.543844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27583a7e-efa8-4e86-a48f-89f156a209e7 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:53.545463 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27583a7e-efa8-4e86-a48f-89f156a209e7 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:53.546107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27583a7e-efa8-4e86-a48f-89f156a209e7 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:53.719231 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-27583a7e-efa8-4e86-a48f-89f156a209e7 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.195561 Oct 10 23:17:53.719844 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 206/385] 10.222.0.23 () {60 vars in 1194 bytes} [Mon Oct 10 23:17:53 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:53.750484 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e254c5e9-f7d2-4aa9-91d4-f949ae62f904 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:53.791409 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e254c5e9-f7d2-4aa9-91d4-f949ae62f904 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.047256 Oct 10 23:17:53.797058 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 207/386] 10.222.0.23 () {58 vars in 1155 bytes} [Mon Oct 10 23:17:53 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 23:17:53.802971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2c1fb401-93de-46dd-95b4-5b2a87e3133e tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2059190143"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:53.806778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.aggregate [None req-2c1fb401-93de-46dd-95b4-5b2a87e3133e tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Generated uuid 9f4040ea-118d-4d1a-a93c-e5aa18366dc0 for aggregate {{(pid=120614) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 23:17:53.853142 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2c1fb401-93de-46dd-95b4-5b2a87e3133e tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.054865 Oct 10 23:17:53.854268 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 208/387] 10.222.0.23 () {60 vars in 1164 bytes} [Mon Oct 10 23:17:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:53.877001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0ac04889-b5e2-432e-98ed-a3f0495b4dd5 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:53.893826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ac04889-b5e2-432e-98ed-a3f0495b4dd5 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:53.894785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ac04889-b5e2-432e-98ed-a3f0495b4dd5 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:53.894898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ac04889-b5e2-432e-98ed-a3f0495b4dd5 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:53.902640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ac04889-b5e2-432e-98ed-a3f0495b4dd5 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:53.903239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ac04889-b5e2-432e-98ed-a3f0495b4dd5 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:53.904444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ac04889-b5e2-432e-98ed-a3f0495b4dd5 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:53.914953 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.compute.aggregates [None req-0ac04889-b5e2-432e-98ed-a3f0495b4dd5 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 10 23:17:53.915517 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-0ac04889-b5e2-432e-98ed-a3f0495b4dd5 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 10 23:17:53.918677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0ac04889-b5e2-432e-98ed-a3f0495b4dd5 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Request method failure captured: Oct 10 23:17:53.918677 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 10 23:17:53.918677 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:17:53.918677 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:17:53.918677 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:17:53.918677 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 42 Oct 10 23:17:53.918677 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:17:53.918677 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:17:53.918677 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:17:53.918677 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:53.918677 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgckPGRPmUcWekeGWEAVdulBvhKaDIQuQ5LnDF5MNT5Yxu8s1rpxRuk8t0X_rKnwBr01ocwkWbLJf7nwODsuakwQD3_T0Lja9V6Gj6s53u9LEHXrykwpBgxb2r7hnZNA0qciiItkh6QDtMb7q2rY7TSZCTsbKJPY-LV9gCmKmNcOVg Oct 10 23:17:53.918677 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:17:53.918677 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:17:53.918677 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:17:53.918677 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:17:53.918677 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:17:53.918677 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:17:53.918677 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 613e206f3825462c8489bc7e625cec5e Oct 10 23:17:53.918677 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:53.918677 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:17:53.918677 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:17:53.920727 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/613e206f3825462c8489bc7e625cec5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_613e206f3825462c8489bc7e625cec5e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:53.920727 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:53.920727 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 613e206f3825462c8489bc7e625cec5e Oct 10 23:17:53.920727 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169 Oct 10 23:17:53.920727 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin Oct 10 23:17:53.920727 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:17:53.920727 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:17:53.920727 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: ceabea8ef0414bbb8ccbccd5a5476b30 Oct 10 23:17:53.920727 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin Oct 10 23:17:53.920727 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:17:53.920727 n-d-860864-2 devstack@n-api.service[120614]: {"remove_host": {"host": "nonexist_host"}} Oct 10 23:17:53.920727 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:17:53.920727 n-d-860864-2 devstack@n-api.service[120614]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 10 23:17:53.928077 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 10 23:17:53.928077 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:53.928077 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:53.928077 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 10 23:17:53.928077 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 10 23:17:53.928077 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:17:53.928077 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:17:53.928077 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 10 23:17:53.928077 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 10 23:17:53.928077 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:17:53.928077 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:17:53.928077 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 10 23:17:53.928077 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 10 23:17:53.928077 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 10 23:17:53.928077 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:53.928077 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:53.928077 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:53.928077 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:53.928077 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 10 23:17:53.928077 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 10 23:17:53.929258 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 10 23:17:53.929258 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 10 23:17:53.929258 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 10 23:17:53.929258 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:53.929258 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:53.929258 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:53.929258 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:53.929258 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 10 23:17:53.929258 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 10 23:17:53.929258 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 23:17:53.929258 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 23:17:53.929258 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:17:53.929258 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:17:53.929258 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:17:53.929258 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:17:53.929258 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 23:17:53.929258 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 23:17:53.929258 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 10 23:17:53.929258 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 10 23:17:53.929258 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 10 23:17:53.930362 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 10 23:17:53.930362 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 10 23:17:53.930362 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:53.930362 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:53.930362 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:53.930362 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:53.930362 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:53.930362 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:53.930362 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:53.930362 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:53.930362 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:53.930362 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:53.930362 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:53.930362 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:53.930362 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 10 23:17:53.930362 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 23:17:53.930362 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 10 23:17:53.930362 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:53.930362 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:53.930362 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:53.930362 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:53.931581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:53.931581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:53.931581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:53.931581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:53.931581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 10 23:17:53.931581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:17:53.931581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0ac04889-b5e2-432e-98ed-a3f0495b4dd5 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:53.931581 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0ac04889-b5e2-432e-98ed-a3f0495b4dd5 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.052802 Oct 10 23:17:53.931581 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 209/388] 10.222.0.23 () {60 vars in 1194 bytes} [Mon Oct 10 23:17:53 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:17:53.932710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8e72940b-1968-444b-9956-2a1c4d34e9f5 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:53.980470 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8e72940b-1968-444b-9956-2a1c4d34e9f5 tempest-AggregatesAdminNegativeTestJSON-1083677169 tempest-AggregatesAdminNegativeTestJSON-1083677169-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.053136 Oct 10 23:17:53.981638 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 210/389] 10.222.0.23 () {58 vars in 1155 bytes} [Mon Oct 10 23:17:53 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 23:17:54.515712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:17:54.516311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:17:54.516678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:17:54.517111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:17:54.517593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:17:54.579738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:54.588065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:54.589317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:54.590402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:54.591646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:54.592236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:54.644836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:17:54.656493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for user 310196e1663a4f7ca12e1fc53b0278ba and project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:17:54.707415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Going to run 2 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:17:54.714806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 7907c918-8df3-44bc-94f5-4fde965de66f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:17:54.850933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120613) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 10 23:17:54.884244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_group_members'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:17:54.902899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for user 310196e1663a4f7ca12e1fc53b0278ba and project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_group_members'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:17:54.993584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_group_members'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:17:55.009606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for user 310196e1663a4f7ca12e1fc53b0278ba and project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_group_members'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:17:55.056586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: c783f55d-ea82-4d94-a4f6-77591d412a02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=7907c918-8df3-44bc-94f5-4fde965de66f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:17:55.184616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_group_members'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:17:55.197319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for user 310196e1663a4f7ca12e1fc53b0278ba and project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_group_members'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:17:55.278237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_group_members'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:17:55.283936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for user 310196e1663a4f7ca12e1fc53b0278ba and project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_group_members'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:17:55.328317 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a687b739-ab71-4cd7-9754-d429d57174f5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.208291 Oct 10 23:17:55.332476 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 180/390] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:17:53 2022] POST /compute/v2.1/servers => generated 32 bytes in 2214 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 10 23:17:55.338815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cb641091-69ae-4ed4-baa7-5bdb84cc8226 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:55.345696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cb641091-69ae-4ed4-baa7-5bdb84cc8226 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:55.346762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cb641091-69ae-4ed4-baa7-5bdb84cc8226 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Searching by: {'deleted': False, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed'} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:17:55.368850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb641091-69ae-4ed4-baa7-5bdb84cc8226 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:55.369809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb641091-69ae-4ed4-baa7-5bdb84cc8226 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:55.370550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb641091-69ae-4ed4-baa7-5bdb84cc8226 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:55.371463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb641091-69ae-4ed4-baa7-5bdb84cc8226 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:55.372074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb641091-69ae-4ed4-baa7-5bdb84cc8226 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:55.372807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb641091-69ae-4ed4-baa7-5bdb84cc8226 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:55.566984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.multi_cell_list [None req-cb641091-69ae-4ed4-baa7-5bdb84cc8226 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120613) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:17:55.592065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-928d4fe6-dca4-43b7-91a9-479d8f0b60ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-426406900", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "6efb9146-bb54-41e6-9e93-c4bb8a061be1"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:55.679940 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-928d4fe6-dca4-43b7-91a9-479d8f0b60ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] validate_networks() for [('6efb9146-bb54-41e6-9e93-c4bb8a061be1', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:17:55.753678 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cb641091-69ae-4ed4-baa7-5bdb84cc8226 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.419754 Oct 10 23:17:55.757462 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 181/391] 10.222.0.23 () {58 vars in 1125 bytes} [Mon Oct 10 23:17:55 2022] GET /compute/v2.1/servers => generated 1004 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:55.773499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d0aa1ccf-abd5-47e4-af0d-900968420648 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:55.774215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d0aa1ccf-abd5-47e4-af0d-900968420648 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: c783f55d-ea82-4d94-a4f6-77591d412a02] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:56.105300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d0aa1ccf-abd5-47e4-af0d-900968420648 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:56.120926 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d0aa1ccf-abd5-47e4-af0d-900968420648 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02" status: 200 len: 1219 microversion: 2.1 time: 0.353257 Oct 10 23:17:56.136045 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 182/392] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:55 2022] GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02 => generated 1219 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:56.667744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5743961c-f10c-4985-9b3c-0243d3f1a855 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-828370356", "id": 1989670978, "os-flavor-access:is_public": "False"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:56.713712 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5743961c-f10c-4985-9b3c-0243d3f1a855 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.576341 Oct 10 23:17:56.714634 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 183/393] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:17:56 2022] POST /compute/v2.1/flavors => generated 438 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:56.730935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f435bfab-b164-4433-b5ca-39af598ba0e5 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "02da9cd789434c169240b104915d0607"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:56.920003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=2,nova_api:INSERT=9 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:17:56.956758 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f435bfab-b164-4433-b5ca-39af598ba0e5 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1989670978/action" status: 200 len: 97 microversion: 2.1 time: 0.231295 Oct 10 23:17:56.957915 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 184/394] 10.222.0.23 () {60 vars in 1200 bytes} [Mon Oct 10 23:17:56 2022] POST /compute/v2.1/flavors/1989670978/action => generated 97 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:17:56.980183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4c523bfd-bca7-4af4-902d-0f32d0b1ea6f tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "02da9cd789434c169240b104915d0607"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:57.236759 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-4c523bfd-bca7-4af4-902d-0f32d0b1ea6f tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] HTTP exception thrown: Flavor access already exists for flavor 32 and project 02da9cd789434c169240b104915d0607 combination. Oct 10 23:17:57.269285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4c523bfd-bca7-4af4-902d-0f32d0b1ea6f tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Request method failure captured: Oct 10 23:17:57.269285 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/flavors/1989670978/action HTTP/1.1 Oct 10 23:17:57.269285 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:17:57.269285 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:17:57.269285 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:17:57.269285 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 67 Oct 10 23:17:57.269285 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:17:57.269285 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:17:57.269285 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:17:57.269285 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:57.269285 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKgi3q6HD_0D4wWcDiAetsXqUWsCx8ZabdtZwW_LAxM1jQB-ONFQWypFG9bTroKZuR7Gs1vEyL2pvVqsglizFsS8LxymRB5mUkeSeDssd1riW5lbH97oWwjX_p0jTkqhXeAqzibX-dHUBd_VABlovVOYy16JMhKh1A8fN2hfxo1n57w Oct 10 23:17:57.269285 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:17:57.269285 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:17:57.269285 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:17:57.269285 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:17:57.269285 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:17:57.269285 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:17:57.269285 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 4265dc96309c4d3bb9038a4b8327ca8e Oct 10 23:17:57.269285 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-88973449 Oct 10 23:17:57.269285 n-d-860864-2 devstack@n-api.service[120613]: X-Role: admin,member,reader Oct 10 23:17:57.269285 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: admin,member,reader Oct 10 23:17:57.270711 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4265dc96309c4d3bb9038a4b8327ca8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4265dc96309c4d3bb9038a4b8327ca8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4265dc96309c4d3bb9038a4b8327ca8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4265dc96309c4d3bb9038a4b8327ca8e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:57.270711 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-88973449 Oct 10 23:17:57.270711 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 4265dc96309c4d3bb9038a4b8327ca8e Oct 10 23:17:57.270711 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-88973449 Oct 10 23:17:57.270711 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin Oct 10 23:17:57.270711 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:17:57.270711 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:17:57.270711 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: ecb928e9b8ad404286a1d9f81dad6925 Oct 10 23:17:57.270711 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin Oct 10 23:17:57.270711 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:17:57.270711 n-d-860864-2 devstack@n-api.service[120613]: {"addTenantAccess": {"tenant": "02da9cd789434c169240b104915d0607"}} Oct 10 23:17:57.270711 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:17:57.271430 n-d-860864-2 devstack@n-api.service[120613]: exception: Flavor access already exists for flavor 32 and project 02da9cd789434c169240b104915d0607 combination. Oct 10 23:17:57.271430 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '1989670978', 'body': {'addTenantAccess': {'tenant': '02da9cd789434c169240b104915d0607'}}} Oct 10 23:17:57.271430 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:57.271430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:57.271430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 23:17:57.271430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 10 23:17:57.271430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 23:17:57.271430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 10 23:17:57.271430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 23:17:57.271430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 10 23:17:57.271430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 23:17:57.271430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 10 23:17:57.271430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 23:17:57.271430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 23:17:57.271430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 23:17:57.271430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result.read() Oct 10 23:17:57.271430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 23:17:57.271430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 10 23:17:57.272439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 23:17:57.272439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 10 23:17:57.272439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 23:17:57.272439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 10 23:17:57.272439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 23:17:57.272439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 10 23:17:57.272439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '32-02da9cd789434c169240b104915d0607' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 10 23:17:57.272439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:57.272439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 10 23:17:57.272439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:57.272439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:57.272439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 10 23:17:57.272439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 10 23:17:57.272439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 10 23:17:57.272439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi session.flush() Oct 10 23:17:57.272439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 10 23:17:57.272439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 10 23:17:57.272439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 10 23:17:57.272439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 10 23:17:57.273635 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 10 23:17:57.273635 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 10 23:17:57.273635 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 23:17:57.273635 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception Oct 10 23:17:57.273635 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 10 23:17:57.273635 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 10 23:17:57.273635 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 10 23:17:57.273635 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 10 23:17:57.273635 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 10 23:17:57.273635 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 10 23:17:57.273635 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 10 23:17:57.273635 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 10 23:17:57.273635 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 10 23:17:57.273635 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 10 23:17:57.273635 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 10 23:17:57.273635 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 10 23:17:57.273635 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 10 23:17:57.273635 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 10 23:17:57.274637 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 10 23:17:57.274637 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 10 23:17:57.274637 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 10 23:17:57.274637 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 10 23:17:57.274637 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 10 23:17:57.274637 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 10 23:17:57.274637 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 23:17:57.274637 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception Oct 10 23:17:57.274637 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 23:17:57.274637 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 10 23:17:57.274637 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 23:17:57.274637 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 10 23:17:57.274637 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 23:17:57.274637 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 10 23:17:57.274637 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 23:17:57.274637 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 10 23:17:57.274637 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 23:17:57.274637 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 23:17:57.275885 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 23:17:57.275885 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result.read() Oct 10 23:17:57.275885 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 23:17:57.275885 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 10 23:17:57.275885 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 23:17:57.275885 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 10 23:17:57.275885 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 23:17:57.275885 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 10 23:17:57.275885 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 23:17:57.275885 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 10 23:17:57.275885 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '32-02da9cd789434c169240b104915d0607' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 10 23:17:57.275885 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 10 23:17:57.275885 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 10, 23, 17, 57, 229864), 'updated_at': None, 'flavor_id': 32, 'project_id': '02da9cd789434c169240b104915d0607'}] Oct 10 23:17:57.275885 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 10 23:17:57.275885 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:57.275885 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:57.275885 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:57.276831 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:57.276831 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 10 23:17:57.276831 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 10 23:17:57.276831 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 10 23:17:57.276831 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 10 23:17:57.276831 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 10 23:17:57.276831 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 10 23:17:57.276831 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 10 23:17:57.276831 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 10 23:17:57.276831 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 10 23:17:57.276831 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 10 23:17:57.276831 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:17:57.276831 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:17:57.276831 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 10 23:17:57.276831 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 10 23:17:57.276831 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 32 and project 02da9cd789434c169240b104915d0607 combination. Oct 10 23:17:57.276831 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:57.276831 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:57.276831 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:57.282355 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:57.282355 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:57.282355 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:57.282355 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:57.282355 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:57.282355 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:57.282355 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:57.282355 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:17:57.282355 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:17:57.282355 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 10 23:17:57.282355 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 10 23:17:57.282355 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 32 and project 02da9cd789434c169240b104915d0607 combination. Oct 10 23:17:57.282355 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:57.282355 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:57.282355 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:57.282355 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:57.282355 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:57.282355 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:57.282355 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:57.282355 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:57.284973 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 32 and project 02da9cd789434c169240b104915d0607 combination. Oct 10 23:17:57.284973 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:57.284973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4c523bfd-bca7-4af4-902d-0f32d0b1ea6f tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Returning 409 to user: Flavor access already exists for flavor 32 and project 02da9cd789434c169240b104915d0607 combination. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:57.284973 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4c523bfd-bca7-4af4-902d-0f32d0b1ea6f tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1989670978/action" status: 409 len: 152 microversion: 2.1 time: 0.295854 Oct 10 23:17:57.284973 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 185/395] 10.222.0.23 () {60 vars in 1200 bytes} [Mon Oct 10 23:17:56 2022] POST /compute/v2.1/flavors/1989670978/action => generated 152 bytes in 307 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:17:57.292611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0b820f1e-bca5-4745-81bd-6c2bed4e16f7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:57.294115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0b820f1e-bca5-4745-81bd-6c2bed4e16f7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: c783f55d-ea82-4d94-a4f6-77591d412a02] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:57.308944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b820f1e-bca5-4745-81bd-6c2bed4e16f7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:57.312745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b820f1e-bca5-4745-81bd-6c2bed4e16f7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:57.315424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b820f1e-bca5-4745-81bd-6c2bed4e16f7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:57.316401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b820f1e-bca5-4745-81bd-6c2bed4e16f7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:57.320646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b820f1e-bca5-4745-81bd-6c2bed4e16f7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:57.321328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b820f1e-bca5-4745-81bd-6c2bed4e16f7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:57.534804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0b820f1e-bca5-4745-81bd-6c2bed4e16f7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:57.548385 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0b820f1e-bca5-4745-81bd-6c2bed4e16f7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02" status: 200 len: 1215 microversion: 2.1 time: 0.265301 Oct 10 23:17:57.562027 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 186/396] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:57 2022] GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02 => generated 1215 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:57.562027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-aada51d1-9e6f-4cb3-9df6-f633d96359a2 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "02da9cd789434c169240b104915d0607"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:57.898225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-928d4fe6-dca4-43b7-91a9-479d8f0b60ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:17:57.899310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-928d4fe6-dca4-43b7-91a9-479d8f0b60ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:17:57.900331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-928d4fe6-dca4-43b7-91a9-479d8f0b60ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:17:57.901204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-928d4fe6-dca4-43b7-91a9-479d8f0b60ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:17:57.902240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-928d4fe6-dca4-43b7-91a9-479d8f0b60ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:17:57.919908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-928d4fe6-dca4-43b7-91a9-479d8f0b60ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:57.923443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-928d4fe6-dca4-43b7-91a9-479d8f0b60ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:57.924404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-928d4fe6-dca4-43b7-91a9-479d8f0b60ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:57.925609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-928d4fe6-dca4-43b7-91a9-479d8f0b60ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:57.927453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-928d4fe6-dca4-43b7-91a9-479d8f0b60ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:57.928040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-928d4fe6-dca4-43b7-91a9-479d8f0b60ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:57.978613 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-928d4fe6-dca4-43b7-91a9-479d8f0b60ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Getting quotas for project 1b5a9d1de27b407e91ff0ae66242ec81. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:17:57.989588 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-928d4fe6-dca4-43b7-91a9-479d8f0b60ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Getting quotas for user 9bd83ab05cb34853bbab0f86a630aa1e and project 1b5a9d1de27b407e91ff0ae66242ec81. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:17:58.030871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-928d4fe6-dca4-43b7-91a9-479d8f0b60ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:17:58.033199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-928d4fe6-dca4-43b7-91a9-479d8f0b60ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:17:58.128102 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-928d4fe6-dca4-43b7-91a9-479d8f0b60ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.428187 Oct 10 23:17:58.133763 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 211/397] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:17:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:17:58.147319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-018eb455-f215-4c9d-9361-477ceecdcb50 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:58.148207 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-018eb455-f215-4c9d-9361-477ceecdcb50 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:58.609999 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-aada51d1-9e6f-4cb3-9df6-f633d96359a2 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1989670978/action" status: 200 len: 21 microversion: 2.1 time: 1.054085 Oct 10 23:17:58.613766 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 187/398] 10.222.0.23 () {60 vars in 1200 bytes} [Mon Oct 10 23:17:57 2022] POST /compute/v2.1/flavors/1989670978/action => generated 21 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:17:58.632543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-af29360c-61c9-42e2-a378-f5f5b6e2c7ab tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:58.641549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-af29360c-61c9-42e2-a378-f5f5b6e2c7ab tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: c783f55d-ea82-4d94-a4f6-77591d412a02] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:17:58.663125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af29360c-61c9-42e2-a378-f5f5b6e2c7ab tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:58.675605 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af29360c-61c9-42e2-a378-f5f5b6e2c7ab tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:58.680161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af29360c-61c9-42e2-a378-f5f5b6e2c7ab tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:58.683217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af29360c-61c9-42e2-a378-f5f5b6e2c7ab tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:17:58.686494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af29360c-61c9-42e2-a378-f5f5b6e2c7ab tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:17:58.688536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af29360c-61c9-42e2-a378-f5f5b6e2c7ab tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:17:59.265177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-af29360c-61c9-42e2-a378-f5f5b6e2c7ab tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:59.287583 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-af29360c-61c9-42e2-a378-f5f5b6e2c7ab tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02" status: 200 len: 1289 microversion: 2.1 time: 0.670971 Oct 10 23:17:59.314597 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 188/399] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:58 2022] GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02 => generated 1289 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:59.334891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-749fc199-2f30-4439-b571-aa4b39fd9953 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:59.373206 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-749fc199-2f30-4439-b571-aa4b39fd9953 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1989670978" status: 202 len: 0 microversion: 2.1 time: 0.058270 Oct 10 23:17:59.383072 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 189/400] 10.222.0.23 () {58 vars in 1161 bytes} [Mon Oct 10 23:17:59 2022] DELETE /compute/v2.1/flavors/1989670978 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:17:59.400261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6f699705-fcf5-48c9-aad7-ce8f6570d759 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:59.458540 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6f699705-fcf5-48c9-aad7-ce8f6570d759 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.068263 Oct 10 23:17:59.479693 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 190/401] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:17:59 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:59.492980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e1b70e83-b561-4263-93e5-f60ac7416a2c tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-581509029", "id": 122867956, "os-flavor-access:is_public": "True"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:59.559030 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e1b70e83-b561-4263-93e5-f60ac7416a2c tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.073639 Oct 10 23:17:59.560409 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 191/402] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:17:59 2022] POST /compute/v2.1/flavors => generated 434 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:17:59.577361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e3013f45-ee3f-4742-8102-6b7b31da1aae tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:59.608753 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-e3013f45-ee3f-4742-8102-6b7b31da1aae tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 10 23:17:59.617047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e3013f45-ee3f-4742-8102-6b7b31da1aae tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Request method failure captured: Oct 10 23:17:59.617047 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/flavors/122867956/os-flavor-access HTTP/1.1 Oct 10 23:17:59.617047 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:17:59.617047 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:17:59.617047 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:17:59.617047 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:17:59.617047 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:17:59.617047 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:17:59.617047 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:17:59.617047 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:17:59.617047 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKgi3q6HD_0D4wWcDiAetsXqUWsCx8ZabdtZwW_LAxM1jQB-ONFQWypFG9bTroKZuR7Gs1vEyL2pvVqsglizFsS8LxymRB5mUkeSeDssd1riW5lbH97oWwjX_p0jTkqhXeAqzibX-dHUBd_VABlovVOYy16JMhKh1A8fN2hfxo1n57w Oct 10 23:17:59.617047 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:17:59.617047 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:17:59.617047 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:17:59.617047 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:17:59.617047 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:17:59.617047 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:17:59.617047 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 4265dc96309c4d3bb9038a4b8327ca8e Oct 10 23:17:59.617047 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-88973449 Oct 10 23:17:59.617047 n-d-860864-2 devstack@n-api.service[120613]: X-Role: admin,member,reader Oct 10 23:17:59.617047 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: admin,member,reader Oct 10 23:17:59.619056 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4265dc96309c4d3bb9038a4b8327ca8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4265dc96309c4d3bb9038a4b8327ca8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4265dc96309c4d3bb9038a4b8327ca8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4265dc96309c4d3bb9038a4b8327ca8e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:17:59.619056 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-88973449 Oct 10 23:17:59.619056 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 4265dc96309c4d3bb9038a4b8327ca8e Oct 10 23:17:59.619056 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-88973449 Oct 10 23:17:59.619056 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin Oct 10 23:17:59.619056 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:17:59.619056 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:17:59.619056 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: ecb928e9b8ad404286a1d9f81dad6925 Oct 10 23:17:59.619056 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin Oct 10 23:17:59.619056 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:17:59.619056 n-d-860864-2 devstack@n-api.service[120613]: exception: Access list not available for public flavors. Oct 10 23:17:59.619056 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'flavor_id': '122867956'} Oct 10 23:17:59.620022 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:17:59.620022 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:59.620022 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:59.620022 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:59.620022 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:17:59.620022 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:17:59.620022 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:17:59.620022 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:17:59.620022 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 10 23:17:59.620022 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 23:17:59.620022 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 10 23:17:59.620022 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:59.620022 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:17:59.620022 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:59.620022 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:17:59.620022 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:17:59.620022 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:17:59.620022 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:17:59.620022 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:17:59.620022 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 10 23:17:59.620022 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:17:59.624015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e3013f45-ee3f-4742-8102-6b7b31da1aae tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:17:59.625208 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e3013f45-ee3f-4742-8102-6b7b31da1aae tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/122867956/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.056133 Oct 10 23:17:59.629429 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 192/403] 10.222.0.23 () {58 vars in 1206 bytes} [Mon Oct 10 23:17:59 2022] GET /compute/v2.1/flavors/122867956/os-flavor-access => generated 91 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:17:59.646646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-da0cf77f-eb1d-4494-988f-173a191913b5 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:59.682172 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-da0cf77f-eb1d-4494-988f-173a191913b5 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/122867956" status: 202 len: 0 microversion: 2.1 time: 0.049954 Oct 10 23:17:59.683838 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 193/404] 10.222.0.23 () {58 vars in 1158 bytes} [Mon Oct 10 23:17:59 2022] DELETE /compute/v2.1/flavors/122867956 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:17:59.704989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2e2d03c4-ebda-4143-80d8-4d2e82897930 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:17:59.736921 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2e2d03c4-ebda-4143-80d8-4d2e82897930 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.047405 Oct 10 23:17:59.749883 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 194/405] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:17:59 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:17:59.759231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fe30d5b4-d54b-4aaf-a95c-5d39cb2ff851 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-512694078", "id": 2105538432, "os-flavor-access:is_public": "False"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:17:59.769042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-018eb455-f215-4c9d-9361-477ceecdcb50 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:17:59.781487 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-018eb455-f215-4c9d-9361-477ceecdcb50 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1210 microversion: 2.1 time: 1.641838 Oct 10 23:17:59.782701 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 212/406] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:17:58 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1210 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:17:59.794896 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fe30d5b4-d54b-4aaf-a95c-5d39cb2ff851 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.039304 Oct 10 23:17:59.838282 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 195/407] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:17:59 2022] POST /compute/v2.1/flavors => generated 438 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:18:00.342454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-326c4c98-32df-48bf-b859-b2af573600bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:00.343123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-326c4c98-32df-48bf-b859-b2af573600bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: c783f55d-ea82-4d94-a4f6-77591d412a02] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:00.358661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-326c4c98-32df-48bf-b859-b2af573600bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:00.359221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-326c4c98-32df-48bf-b859-b2af573600bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:00.371255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-326c4c98-32df-48bf-b859-b2af573600bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:00.372070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-326c4c98-32df-48bf-b859-b2af573600bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:00.372586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-326c4c98-32df-48bf-b859-b2af573600bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:00.373802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-326c4c98-32df-48bf-b859-b2af573600bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:00.476642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2c0fe5ac-aa19-4c6d-a354-51712949ab82 tempest-FlavorsAccessNegativeTestJSON-1449347356 tempest-FlavorsAccessNegativeTestJSON-1449347356-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "02da9cd789434c169240b104915d0607"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:00.481116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2c0fe5ac-aa19-4c6d-a354-51712949ab82 tempest-FlavorsAccessNegativeTestJSON-1449347356 tempest-FlavorsAccessNegativeTestJSON-1449347356-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '19e09dd8b7eb46869ac6f534114828a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02da9cd789434c169240b104915d0607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:00.487920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2c0fe5ac-aa19-4c6d-a354-51712949ab82 tempest-FlavorsAccessNegativeTestJSON-1449347356 tempest-FlavorsAccessNegativeTestJSON-1449347356-project] Request method failure captured: Oct 10 23:18:00.487920 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/flavors/2105538432/action HTTP/1.1 Oct 10 23:18:00.487920 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:18:00.487920 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:18:00.487920 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:18:00.487920 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 67 Oct 10 23:18:00.487920 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:18:00.487920 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:18:00.487920 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:18:00.487920 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:18:00.487920 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgg8JlkwCac3pj-CDdEZn606aHOuDJeHZPvyvUwn3QqHHbMlV7riTLxnuZU5DSiUHt3mbS8AdjSizcjen34hocijnNAc3XXgU__nXvnZTHpCUBZB3ADxYfSgT1wu95JvIyCEny8SFi_LuzLUDXA-aFaoZ0kizncLwNnTdIRf7_r4N0 Oct 10 23:18:00.487920 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:18:00.487920 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:18:00.487920 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:18:00.487920 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:18:00.487920 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:18:00.487920 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:18:00.487920 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 02da9cd789434c169240b104915d0607 Oct 10 23:18:00.487920 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1449347356 Oct 10 23:18:00.487920 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:18:00.487920 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:18:00.489236 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/02da9cd789434c169240b104915d0607"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02da9cd789434c169240b104915d0607"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02da9cd789434c169240b104915d0607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_02da9cd789434c169240b104915d0607", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:18:00.489236 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1449347356 Oct 10 23:18:00.489236 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 02da9cd789434c169240b104915d0607 Oct 10 23:18:00.489236 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1449347356 Oct 10 23:18:00.489236 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-FlavorsAccessNegativeTestJSON-1449347356-project Oct 10 23:18:00.489236 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:18:00.489236 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:18:00.489236 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 19e09dd8b7eb46869ac6f534114828a4 Oct 10 23:18:00.489236 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1449347356-project Oct 10 23:18:00.489236 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:18:00.489236 n-d-860864-2 devstack@n-api.service[120614]: {"addTenantAccess": {"tenant": "02da9cd789434c169240b104915d0607"}} Oct 10 23:18:00.489236 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:18:00.489997 n-d-860864-2 devstack@n-api.service[120614]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 10 23:18:00.489997 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '2105538432', 'body': {'addTenantAccess': {'tenant': '02da9cd789434c169240b104915d0607'}}} Oct 10 23:18:00.489997 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:18:00.489997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:18:00.489997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:18:00.489997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:18:00.489997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:18:00.489997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:18:00.489997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:18:00.489997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:18:00.489997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:18:00.489997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:18:00.489997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 10 23:18:00.489997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 10 23:18:00.489997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:18:00.489997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:18:00.489997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:18:00.489997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:18:00.489997 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:18:00.491778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:18:00.491778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:18:00.491778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:18:00.491778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:18:00.491778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:18:00.491778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:18:00.491778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:18:00.491778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:18:00.491778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:18:00.491778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 10 23:18:00.491778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:18:00.491778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:18:00.491778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:18:00.491778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:18:00.491778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:18:00.491778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:18:00.491778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:18:00.491778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:18:00.491778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 10 23:18:00.491778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:18:00.493818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2c0fe5ac-aa19-4c6d-a354-51712949ab82 tempest-FlavorsAccessNegativeTestJSON-1449347356 tempest-FlavorsAccessNegativeTestJSON-1449347356-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:18:00.493818 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2c0fe5ac-aa19-4c6d-a354-51712949ab82 tempest-FlavorsAccessNegativeTestJSON-1449347356 tempest-FlavorsAccessNegativeTestJSON-1449347356-project] 10.222.0.23 "POST /compute/v2.1/flavors/2105538432/action" status: 403 len: 130 microversion: 2.1 time: 0.684234 Oct 10 23:18:00.506612 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 213/408] 10.222.0.23 () {60 vars in 1200 bytes} [Mon Oct 10 23:17:59 2022] POST /compute/v2.1/flavors/2105538432/action => generated 130 bytes in 702 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:18:00.536006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cc4f7e99-8ac7-4b0b-8001-7a7af130b168 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:00.592062 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cc4f7e99-8ac7-4b0b-8001-7a7af130b168 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/2105538432" status: 202 len: 0 microversion: 2.1 time: 0.083257 Oct 10 23:18:00.595918 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 214/409] 10.222.0.23 () {58 vars in 1161 bytes} [Mon Oct 10 23:18:00 2022] DELETE /compute/v2.1/flavors/2105538432 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:18:00.605520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-20b088c5-536b-4f75-a4bc-613a3b693f47 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:00.681621 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-20b088c5-536b-4f75-a4bc-613a3b693f47 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.084327 Oct 10 23:18:00.709745 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 215/410] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:18:00 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:00.714408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2260bc66-c667-4cfd-b306-25691e927685 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1567062615", "id": 2136545108, "os-flavor-access:is_public": "False"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:00.758472 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2260bc66-c667-4cfd-b306-25691e927685 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.047679 Oct 10 23:18:00.760646 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 216/411] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:18:00 2022] POST /compute/v2.1/flavors => generated 439 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:00.773861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-68139822-11fa-41a1-bd36-a618b867774d tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "02da9cd789434c169240b104915d0607"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:01.523891 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-68139822-11fa-41a1-bd36-a618b867774d tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/2136545108/action" status: 200 len: 97 microversion: 2.1 time: 0.753716 Oct 10 23:18:01.547237 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 217/412] 10.222.0.23 () {60 vars in 1200 bytes} [Mon Oct 10 23:18:00 2022] POST /compute/v2.1/flavors/2136545108/action => generated 97 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:18:01.577121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-723fb36b-0153-4f76-87a7-442414054311 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:01.582929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-723fb36b-0153-4f76-87a7-442414054311 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:01.598787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-723fb36b-0153-4f76-87a7-442414054311 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:01.603581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-723fb36b-0153-4f76-87a7-442414054311 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:01.604604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-723fb36b-0153-4f76-87a7-442414054311 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:01.605806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-723fb36b-0153-4f76-87a7-442414054311 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:01.606492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-723fb36b-0153-4f76-87a7-442414054311 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:01.608151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-723fb36b-0153-4f76-87a7-442414054311 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:01.762622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-723fb36b-0153-4f76-87a7-442414054311 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:01.777708 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-723fb36b-0153-4f76-87a7-442414054311 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1268 microversion: 2.1 time: 0.226183 Oct 10 23:18:01.784300 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 218/413] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:01 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1268 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:01.796151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cf45509a-06fa-44f4-8088-d8fe38960543 tempest-FlavorsAccessNegativeTestJSON-1449347356 tempest-FlavorsAccessNegativeTestJSON-1449347356-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "02da9cd789434c169240b104915d0607"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:01.835216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cf45509a-06fa-44f4-8088-d8fe38960543 tempest-FlavorsAccessNegativeTestJSON-1449347356 tempest-FlavorsAccessNegativeTestJSON-1449347356-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '19e09dd8b7eb46869ac6f534114828a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02da9cd789434c169240b104915d0607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:01.837826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cf45509a-06fa-44f4-8088-d8fe38960543 tempest-FlavorsAccessNegativeTestJSON-1449347356 tempest-FlavorsAccessNegativeTestJSON-1449347356-project] Request method failure captured: Oct 10 23:18:01.837826 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/flavors/2136545108/action HTTP/1.1 Oct 10 23:18:01.837826 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:18:01.837826 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:18:01.837826 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:18:01.837826 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 70 Oct 10 23:18:01.837826 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:18:01.837826 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:18:01.837826 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:18:01.837826 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:18:01.837826 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgg8JlkwCac3pj-CDdEZn606aHOuDJeHZPvyvUwn3QqHHbMlV7riTLxnuZU5DSiUHt3mbS8AdjSizcjen34hocijnNAc3XXgU__nXvnZTHpCUBZB3ADxYfSgT1wu95JvIyCEny8SFi_LuzLUDXA-aFaoZ0kizncLwNnTdIRf7_r4N0 Oct 10 23:18:01.837826 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:18:01.837826 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:18:01.837826 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:18:01.837826 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:18:01.837826 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:18:01.837826 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:18:01.837826 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 02da9cd789434c169240b104915d0607 Oct 10 23:18:01.837826 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1449347356 Oct 10 23:18:01.837826 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:18:01.837826 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:18:01.839355 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/02da9cd789434c169240b104915d0607"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02da9cd789434c169240b104915d0607"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/02da9cd789434c169240b104915d0607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_02da9cd789434c169240b104915d0607", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:18:01.839355 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1449347356 Oct 10 23:18:01.839355 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 02da9cd789434c169240b104915d0607 Oct 10 23:18:01.839355 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1449347356 Oct 10 23:18:01.839355 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-FlavorsAccessNegativeTestJSON-1449347356-project Oct 10 23:18:01.839355 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:18:01.839355 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:18:01.839355 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 19e09dd8b7eb46869ac6f534114828a4 Oct 10 23:18:01.839355 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1449347356-project Oct 10 23:18:01.839355 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:18:01.839355 n-d-860864-2 devstack@n-api.service[120614]: {"removeTenantAccess": {"tenant": "02da9cd789434c169240b104915d0607"}} Oct 10 23:18:01.839355 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:18:01.840167 n-d-860864-2 devstack@n-api.service[120614]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 10 23:18:01.840167 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '2136545108', 'body': {'removeTenantAccess': {'tenant': '02da9cd789434c169240b104915d0607'}}} Oct 10 23:18:01.840167 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:18:01.840167 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:18:01.840167 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:18:01.840167 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:18:01.840167 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:18:01.840167 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:18:01.840167 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:18:01.840167 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:18:01.840167 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:18:01.840167 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:18:01.840167 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 10 23:18:01.840167 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi context.can( Oct 10 23:18:01.840167 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:18:01.840167 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:18:01.840167 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:18:01.840167 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:18:01.840167 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:18:01.840167 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:18:01.842070 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:18:01.842070 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:18:01.842070 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:18:01.842070 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:18:01.842070 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:18:01.842070 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:18:01.842070 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:18:01.842070 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:18:01.842070 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 10 23:18:01.842070 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:18:01.842070 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:18:01.842070 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:18:01.842070 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:18:01.842070 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:18:01.842070 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:18:01.842070 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:18:01.842070 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:18:01.842070 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 10 23:18:01.842070 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:18:01.846832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cf45509a-06fa-44f4-8088-d8fe38960543 tempest-FlavorsAccessNegativeTestJSON-1449347356 tempest-FlavorsAccessNegativeTestJSON-1449347356-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:18:01.849098 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cf45509a-06fa-44f4-8088-d8fe38960543 tempest-FlavorsAccessNegativeTestJSON-1449347356 tempest-FlavorsAccessNegativeTestJSON-1449347356-project] 10.222.0.23 "POST /compute/v2.1/flavors/2136545108/action" status: 403 len: 133 microversion: 2.1 time: 0.060930 Oct 10 23:18:01.850439 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 219/414] 10.222.0.23 () {60 vars in 1200 bytes} [Mon Oct 10 23:18:01 2022] POST /compute/v2.1/flavors/2136545108/action => generated 133 bytes in 66 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:18:01.867702 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-58b5d981-35d4-4258-8b05-5345dfa25da6 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "02da9cd789434c169240b104915d0607"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:01.957111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-326c4c98-32df-48bf-b859-b2af573600bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:01.969203 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-326c4c98-32df-48bf-b859-b2af573600bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02" status: 200 len: 1277 microversion: 2.1 time: 1.632415 Oct 10 23:18:01.972886 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 196/415] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:00 2022] GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02 => generated 1277 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:02.310358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0e07cc62-172c-4cbc-88bf-6954c107e936 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-665083028", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:02.344128 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-58b5d981-35d4-4258-8b05-5345dfa25da6 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/2136545108/action" status: 200 len: 21 microversion: 2.1 time: 0.485400 Oct 10 23:18:02.345667 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 220/416] 10.222.0.23 () {60 vars in 1200 bytes} [Mon Oct 10 23:18:01 2022] POST /compute/v2.1/flavors/2136545108/action => generated 21 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:18:02.367388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-63253c9c-c699-42d5-8e40-305d96f44d66 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:02.387394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=13,nova_api:INSERT=9 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:02.404848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-0e07cc62-172c-4cbc-88bf-6954c107e936 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] validate_networks() for None {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:18:02.410904 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-63253c9c-c699-42d5-8e40-305d96f44d66 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/2136545108" status: 202 len: 0 microversion: 2.1 time: 0.048034 Oct 10 23:18:02.413917 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 221/417] 10.222.0.23 () {58 vars in 1161 bytes} [Mon Oct 10 23:18:02 2022] DELETE /compute/v2.1/flavors/2136545108 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:18:02.424199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2ed1c3c7-90ff-405b-95fc-ce7500d0fd13 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:02.475869 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2ed1c3c7-90ff-405b-95fc-ce7500d0fd13 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.057943 Oct 10 23:18:02.476763 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 222/418] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:18:02 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:02.515636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-be7982b6-83e8-4be6-a81b-83b736b45a93 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1539579687", "id": 493736313, "os-flavor-access:is_public": "False"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:02.545256 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-be7982b6-83e8-4be6-a81b-83b736b45a93 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.048086 Oct 10 23:18:02.546624 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 223/419] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:18:02 2022] POST /compute/v2.1/flavors => generated 436 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:02.559642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a84ce3e4-8a4d-474d-8d08-541dc774537b tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c57806c8619345edad2f5838e7960bdf"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:02.690623 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-a84ce3e4-8a4d-474d-8d08-541dc774537b tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] HTTP exception thrown: Flavor access not found for 36 / c57806c8619345edad2f5838e7960bdf combination. Oct 10 23:18:02.693331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a84ce3e4-8a4d-474d-8d08-541dc774537b tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Request method failure captured: Oct 10 23:18:02.693331 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/flavors/493736313/action HTTP/1.1 Oct 10 23:18:02.693331 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:18:02.693331 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:18:02.693331 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:18:02.693331 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 70 Oct 10 23:18:02.693331 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:18:02.693331 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:18:02.693331 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:18:02.693331 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:18:02.693331 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgi3q6HD_0D4wWcDiAetsXqUWsCx8ZabdtZwW_LAxM1jQB-ONFQWypFG9bTroKZuR7Gs1vEyL2pvVqsglizFsS8LxymRB5mUkeSeDssd1riW5lbH97oWwjX_p0jTkqhXeAqzibX-dHUBd_VABlovVOYy16JMhKh1A8fN2hfxo1n57w Oct 10 23:18:02.693331 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:18:02.693331 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:18:02.693331 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:18:02.693331 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:18:02.693331 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:18:02.693331 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:18:02.693331 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 4265dc96309c4d3bb9038a4b8327ca8e Oct 10 23:18:02.693331 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-88973449 Oct 10 23:18:02.693331 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:18:02.693331 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:18:02.694938 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4265dc96309c4d3bb9038a4b8327ca8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4265dc96309c4d3bb9038a4b8327ca8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4265dc96309c4d3bb9038a4b8327ca8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4265dc96309c4d3bb9038a4b8327ca8e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:18:02.694938 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-88973449 Oct 10 23:18:02.694938 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 4265dc96309c4d3bb9038a4b8327ca8e Oct 10 23:18:02.694938 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-88973449 Oct 10 23:18:02.694938 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin Oct 10 23:18:02.694938 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:18:02.694938 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:18:02.694938 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: ecb928e9b8ad404286a1d9f81dad6925 Oct 10 23:18:02.694938 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin Oct 10 23:18:02.694938 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:18:02.694938 n-d-860864-2 devstack@n-api.service[120614]: {"removeTenantAccess": {"tenant": "c57806c8619345edad2f5838e7960bdf"}} Oct 10 23:18:02.694938 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:18:02.695747 n-d-860864-2 devstack@n-api.service[120614]: exception: Flavor access not found for 36 / c57806c8619345edad2f5838e7960bdf combination. Oct 10 23:18:02.695747 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '493736313', 'body': {'removeTenantAccess': {'tenant': 'c57806c8619345edad2f5838e7960bdf'}}} Oct 10 23:18:02.695747 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:18:02.695747 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:18:02.695747 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 10 23:18:02.695747 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 10 23:18:02.695747 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 10 23:18:02.695747 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 10 23:18:02.695747 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 10 23:18:02.695747 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 10 23:18:02.695747 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 10 23:18:02.695747 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 10 23:18:02.695747 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 10 23:18:02.695747 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 10 23:18:02.695747 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:18:02.695747 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:18:02.695747 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 10 23:18:02.695747 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 10 23:18:02.696977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 36 / c57806c8619345edad2f5838e7960bdf combination. Oct 10 23:18:02.696977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:18:02.696977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:18:02.696977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:18:02.696977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:18:02.696977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:18:02.696977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:18:02.696977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:18:02.696977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:18:02.696977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:18:02.696977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:18:02.696977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:18:02.696977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:18:02.696977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 10 23:18:02.696977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:18:02.696977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 36 / c57806c8619345edad2f5838e7960bdf combination. Oct 10 23:18:02.696977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:18:02.696977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:18:02.696977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:18:02.696977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:18:02.698348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:18:02.698348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:18:02.698348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:18:02.698348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:18:02.698348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 36 / c57806c8619345edad2f5838e7960bdf combination. Oct 10 23:18:02.698348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:18:02.701341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a84ce3e4-8a4d-474d-8d08-541dc774537b tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Returning 404 to user: Flavor access not found for 36 / c57806c8619345edad2f5838e7960bdf combination. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:18:02.702881 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a84ce3e4-8a4d-474d-8d08-541dc774537b tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/493736313/action" status: 404 len: 124 microversion: 2.1 time: 0.147137 Oct 10 23:18:02.707513 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 224/420] 10.222.0.23 () {60 vars in 1197 bytes} [Mon Oct 10 23:18:02 2022] POST /compute/v2.1/flavors/493736313/action => generated 124 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:18:02.718537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cc2631e7-b413-480b-9a28-b59934792bdd tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:02.747744 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cc2631e7-b413-480b-9a28-b59934792bdd tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/493736313" status: 202 len: 0 microversion: 2.1 time: 0.038429 Oct 10 23:18:02.748469 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 225/421] 10.222.0.23 () {58 vars in 1158 bytes} [Mon Oct 10 23:18:02 2022] DELETE /compute/v2.1/flavors/493736313 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:18:02.780613 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3a1aae32-fe81-4c5b-a8f0-cd25bb7e1e75 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:02.840716 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3a1aae32-fe81-4c5b-a8f0-cd25bb7e1e75 tempest-FlavorsAccessNegativeTestJSON-88973449 tempest-FlavorsAccessNegativeTestJSON-88973449-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.070080 Oct 10 23:18:02.841326 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 226/422] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:18:02 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:02.874468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2e421b1c-9317-4778-912d-e415a1decd83 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:02.874468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2e421b1c-9317-4778-912d-e415a1decd83 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:02.896736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e421b1c-9317-4778-912d-e415a1decd83 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:02.899600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e421b1c-9317-4778-912d-e415a1decd83 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:02.902663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e421b1c-9317-4778-912d-e415a1decd83 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:02.909769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e421b1c-9317-4778-912d-e415a1decd83 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:02.913577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e421b1c-9317-4778-912d-e415a1decd83 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:02.914083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e421b1c-9317-4778-912d-e415a1decd83 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:03.019086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2e421b1c-9317-4778-912d-e415a1decd83 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:03.033327 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2e421b1c-9317-4778-912d-e415a1decd83 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1268 microversion: 2.1 time: 0.167741 Oct 10 23:18:03.039904 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 227/423] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:02 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1268 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:03.049798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b8f1d5bd-ef22-4411-9326-78dba271201b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:03.050536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b8f1d5bd-ef22-4411-9326-78dba271201b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: c783f55d-ea82-4d94-a4f6-77591d412a02] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:03.073128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8f1d5bd-ef22-4411-9326-78dba271201b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:03.073685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8f1d5bd-ef22-4411-9326-78dba271201b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:03.074210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8f1d5bd-ef22-4411-9326-78dba271201b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:03.077887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8f1d5bd-ef22-4411-9326-78dba271201b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:03.078379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8f1d5bd-ef22-4411-9326-78dba271201b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:03.078819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8f1d5bd-ef22-4411-9326-78dba271201b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:03.652894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b8f1d5bd-ef22-4411-9326-78dba271201b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:03.666026 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b8f1d5bd-ef22-4411-9326-78dba271201b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02" status: 200 len: 1319 microversion: 2.1 time: 0.624883 Oct 10 23:18:03.666943 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 228/424] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:03 2022] GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02 => generated 1319 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:03.979285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-0e07cc62-172c-4cbc-88bf-6954c107e936 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:18:03.980356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-0e07cc62-172c-4cbc-88bf-6954c107e936 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:18:03.981079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-0e07cc62-172c-4cbc-88bf-6954c107e936 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:18:03.982452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-0e07cc62-172c-4cbc-88bf-6954c107e936 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:18:03.983090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-0e07cc62-172c-4cbc-88bf-6954c107e936 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:18:04.004159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e07cc62-172c-4cbc-88bf-6954c107e936 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:04.010663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e07cc62-172c-4cbc-88bf-6954c107e936 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:04.012145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e07cc62-172c-4cbc-88bf-6954c107e936 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:04.013598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e07cc62-172c-4cbc-88bf-6954c107e936 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:04.014318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e07cc62-172c-4cbc-88bf-6954c107e936 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:04.014999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e07cc62-172c-4cbc-88bf-6954c107e936 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:04.068442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-0e07cc62-172c-4cbc-88bf-6954c107e936 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Getting quotas for project 8fad4e7ad7ba4e8284360ccf30d71228. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:18:04.069545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1fdf8d01-9039-4c6d-b67f-3ccebd7120bc tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:04.070903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1fdf8d01-9039-4c6d-b67f-3ccebd7120bc tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:04.081923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fdf8d01-9039-4c6d-b67f-3ccebd7120bc tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:04.084948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fdf8d01-9039-4c6d-b67f-3ccebd7120bc tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:04.085649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fdf8d01-9039-4c6d-b67f-3ccebd7120bc tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:04.086762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fdf8d01-9039-4c6d-b67f-3ccebd7120bc tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:04.087931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fdf8d01-9039-4c6d-b67f-3ccebd7120bc tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:04.088705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-0e07cc62-172c-4cbc-88bf-6954c107e936 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Getting quotas for user cbc0deea66094fac8d5f985e133ceaaa and project 8fad4e7ad7ba4e8284360ccf30d71228. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:18:04.089561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fdf8d01-9039-4c6d-b67f-3ccebd7120bc tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:04.130035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0e07cc62-172c-4cbc-88bf-6954c107e936 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:18:04.132402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0e07cc62-172c-4cbc-88bf-6954c107e936 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:18:04.239115 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0e07cc62-172c-4cbc-88bf-6954c107e936 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.264691 Oct 10 23:18:04.244672 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 197/425] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:18:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:18:04.256224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-92e6ebbf-d79f-4a20-aa79-9873217f548a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:04.257221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-92e6ebbf-d79f-4a20-aa79-9873217f548a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:04.296764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1fdf8d01-9039-4c6d-b67f-3ccebd7120bc tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:04.305877 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1fdf8d01-9039-4c6d-b67f-3ccebd7120bc tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1268 microversion: 2.1 time: 0.242334 Oct 10 23:18:04.324421 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 229/426] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:04 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1268 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:04.695966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1776bd4a-6692-40bc-bd30-945b5f64434a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:04.696593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1776bd4a-6692-40bc-bd30-945b5f64434a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: c783f55d-ea82-4d94-a4f6-77591d412a02] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:04.717105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1776bd4a-6692-40bc-bd30-945b5f64434a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:04.722058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1776bd4a-6692-40bc-bd30-945b5f64434a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:04.725460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-92e6ebbf-d79f-4a20-aa79-9873217f548a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:04.735230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1776bd4a-6692-40bc-bd30-945b5f64434a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:04.736103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1776bd4a-6692-40bc-bd30-945b5f64434a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:04.746136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1776bd4a-6692-40bc-bd30-945b5f64434a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:04.750435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1776bd4a-6692-40bc-bd30-945b5f64434a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:04.755402 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-92e6ebbf-d79f-4a20-aa79-9873217f548a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1212 microversion: 2.1 time: 0.487578 Oct 10 23:18:04.756070 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 198/427] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:04 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1212 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:18:05.332961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a6df7105-1f0e-4ddc-8623-190d5f63ad63 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:05.334427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a6df7105-1f0e-4ddc-8623-190d5f63ad63 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:05.342005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6df7105-1f0e-4ddc-8623-190d5f63ad63 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:05.343903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6df7105-1f0e-4ddc-8623-190d5f63ad63 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:05.344674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6df7105-1f0e-4ddc-8623-190d5f63ad63 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:05.345710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6df7105-1f0e-4ddc-8623-190d5f63ad63 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:05.346630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6df7105-1f0e-4ddc-8623-190d5f63ad63 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:05.347532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6df7105-1f0e-4ddc-8623-190d5f63ad63 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:05.385742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1776bd4a-6692-40bc-bd30-945b5f64434a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:05.396488 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1776bd4a-6692-40bc-bd30-945b5f64434a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02" status: 200 len: 1319 microversion: 2.1 time: 0.705198 Oct 10 23:18:05.414159 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 230/428] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:04 2022] GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02 => generated 1319 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:18:05.606023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a6df7105-1f0e-4ddc-8623-190d5f63ad63 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:05.635035 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a6df7105-1f0e-4ddc-8623-190d5f63ad63 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1268 microversion: 2.1 time: 0.305947 Oct 10 23:18:05.662511 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 199/429] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:05 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1268 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:18:05.784046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-78a3e50c-c3da-4ee0-accf-0cab3c896292 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:05.784668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-78a3e50c-c3da-4ee0-accf-0cab3c896292 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:05.794987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78a3e50c-c3da-4ee0-accf-0cab3c896292 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:05.794987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78a3e50c-c3da-4ee0-accf-0cab3c896292 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:05.795914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78a3e50c-c3da-4ee0-accf-0cab3c896292 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:05.796636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78a3e50c-c3da-4ee0-accf-0cab3c896292 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:05.797095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78a3e50c-c3da-4ee0-accf-0cab3c896292 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:05.797568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78a3e50c-c3da-4ee0-accf-0cab3c896292 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:05.940212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-78a3e50c-c3da-4ee0-accf-0cab3c896292 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:05.956365 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-78a3e50c-c3da-4ee0-accf-0cab3c896292 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1264 microversion: 2.1 time: 0.175818 Oct 10 23:18:05.959545 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 231/430] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:05 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:06.180299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-161640f5-3bc9-42a6-a6af-ada1619a4752 req-50bc558d-4c46-4d73-819a-29777fbaabf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7907c918-8df3-44bc-94f5-4fde965de66f", "tag": "e3a0a0e5-3b6c-47c0-975a-49b336f25e2a"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:06.195552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-161640f5-3bc9-42a6-a6af-ada1619a4752 req-50bc558d-4c46-4d73-819a-29777fbaabf1 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:06.196036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-161640f5-3bc9-42a6-a6af-ada1619a4752 req-50bc558d-4c46-4d73-819a-29777fbaabf1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:06.196486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-161640f5-3bc9-42a6-a6af-ada1619a4752 req-50bc558d-4c46-4d73-819a-29777fbaabf1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:06.230428 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-161640f5-3bc9-42a6-a6af-ada1619a4752 req-50bc558d-4c46-4d73-819a-29777fbaabf1 service nova] Creating event network-changed:e3a0a0e5-3b6c-47c0-975a-49b336f25e2a for instance 7907c918-8df3-44bc-94f5-4fde965de66f on n-h1-860864-2 Oct 10 23:18:06.236218 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-161640f5-3bc9-42a6-a6af-ada1619a4752 req-50bc558d-4c46-4d73-819a-29777fbaabf1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059432 Oct 10 23:18:06.237177 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 200/431] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:06.422822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-80f8892b-a9cc-4ea8-974c-0c1a6b23da4c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:06.423750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-80f8892b-a9cc-4ea8-974c-0c1a6b23da4c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: c783f55d-ea82-4d94-a4f6-77591d412a02] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:06.432839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80f8892b-a9cc-4ea8-974c-0c1a6b23da4c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:06.439299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80f8892b-a9cc-4ea8-974c-0c1a6b23da4c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:06.439945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80f8892b-a9cc-4ea8-974c-0c1a6b23da4c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:06.442528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80f8892b-a9cc-4ea8-974c-0c1a6b23da4c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:06.443480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80f8892b-a9cc-4ea8-974c-0c1a6b23da4c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:06.445674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80f8892b-a9cc-4ea8-974c-0c1a6b23da4c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:06.691562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-da9ed9e6-fda4-4785-a863-7ff7c90b062f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:06.693127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-da9ed9e6-fda4-4785-a863-7ff7c90b062f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:06.704935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da9ed9e6-fda4-4785-a863-7ff7c90b062f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:06.706313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da9ed9e6-fda4-4785-a863-7ff7c90b062f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:06.706920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da9ed9e6-fda4-4785-a863-7ff7c90b062f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:06.708112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da9ed9e6-fda4-4785-a863-7ff7c90b062f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:06.708900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da9ed9e6-fda4-4785-a863-7ff7c90b062f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:06.709892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da9ed9e6-fda4-4785-a863-7ff7c90b062f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:06.893103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-80f8892b-a9cc-4ea8-974c-0c1a6b23da4c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:06.907311 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-80f8892b-a9cc-4ea8-974c-0c1a6b23da4c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02" status: 200 len: 1319 microversion: 2.1 time: 0.490375 Oct 10 23:18:06.908527 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 232/432] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:06 2022] GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02 => generated 1319 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:06.989225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-de3edde5-056e-4832-9d19-74bee39f2686 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:06.990049 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-de3edde5-056e-4832-9d19-74bee39f2686 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:06.996807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de3edde5-056e-4832-9d19-74bee39f2686 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:06.997778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de3edde5-056e-4832-9d19-74bee39f2686 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:06.998369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de3edde5-056e-4832-9d19-74bee39f2686 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:06.999240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de3edde5-056e-4832-9d19-74bee39f2686 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:06.999847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de3edde5-056e-4832-9d19-74bee39f2686 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:07.000447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de3edde5-056e-4832-9d19-74bee39f2686 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:07.458623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-de3edde5-056e-4832-9d19-74bee39f2686 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:07.474726 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-de3edde5-056e-4832-9d19-74bee39f2686 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1270 microversion: 2.1 time: 0.489748 Oct 10 23:18:07.477369 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 233/433] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:06 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1270 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:18:07.826214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-da9ed9e6-fda4-4785-a863-7ff7c90b062f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:07.837909 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-da9ed9e6-fda4-4785-a863-7ff7c90b062f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1310 microversion: 2.1 time: 1.154728 Oct 10 23:18:07.854714 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 201/434] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:06 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1310 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:07.936932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-306e7a8f-590d-4e1c-9382-bb5fb363eae8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:07.937756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-306e7a8f-590d-4e1c-9382-bb5fb363eae8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: c783f55d-ea82-4d94-a4f6-77591d412a02] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:07.948019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-306e7a8f-590d-4e1c-9382-bb5fb363eae8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:07.948758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-306e7a8f-590d-4e1c-9382-bb5fb363eae8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:07.949308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-306e7a8f-590d-4e1c-9382-bb5fb363eae8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:07.950446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-306e7a8f-590d-4e1c-9382-bb5fb363eae8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:07.951500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-306e7a8f-590d-4e1c-9382-bb5fb363eae8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:07.951942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-306e7a8f-590d-4e1c-9382-bb5fb363eae8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:07.960090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=18 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:08.238205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-306e7a8f-590d-4e1c-9382-bb5fb363eae8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:08.249368 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-306e7a8f-590d-4e1c-9382-bb5fb363eae8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02" status: 200 len: 1319 microversion: 2.1 time: 0.319272 Oct 10 23:18:08.252834 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 234/435] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:07 2022] GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02 => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:08.511426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ddf2b2c0-ddd7-4ca4-a488-551a4f3062b9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:08.515051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ddf2b2c0-ddd7-4ca4-a488-551a4f3062b9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:08.526894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddf2b2c0-ddd7-4ca4-a488-551a4f3062b9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:08.531413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddf2b2c0-ddd7-4ca4-a488-551a4f3062b9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:08.534470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddf2b2c0-ddd7-4ca4-a488-551a4f3062b9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:08.537021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddf2b2c0-ddd7-4ca4-a488-551a4f3062b9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:08.537726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddf2b2c0-ddd7-4ca4-a488-551a4f3062b9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:08.540347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddf2b2c0-ddd7-4ca4-a488-551a4f3062b9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:08.860191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ddf2b2c0-ddd7-4ca4-a488-551a4f3062b9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:08.870157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-914ab6b9-d59a-49d6-a9b3-099eb25cbc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:08.870820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-914ab6b9-d59a-49d6-a9b3-099eb25cbc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:08.882951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-914ab6b9-d59a-49d6-a9b3-099eb25cbc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:08.884394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-914ab6b9-d59a-49d6-a9b3-099eb25cbc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:08.885788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-914ab6b9-d59a-49d6-a9b3-099eb25cbc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:08.886581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-914ab6b9-d59a-49d6-a9b3-099eb25cbc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:08.887188 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ddf2b2c0-ddd7-4ca4-a488-551a4f3062b9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1270 microversion: 2.1 time: 0.390500 Oct 10 23:18:08.901408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-914ab6b9-d59a-49d6-a9b3-099eb25cbc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:08.901408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-914ab6b9-d59a-49d6-a9b3-099eb25cbc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:08.901661 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 202/436] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:08 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1270 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:09.177006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-914ab6b9-d59a-49d6-a9b3-099eb25cbc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:09.184803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-ddfeecb9-369b-49bc-a3d3-eeca5857687f req-5b7d64fb-a614-4d2d-b2d0-c4dfe9b2b622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c783f55d-ea82-4d94-a4f6-77591d412a02", "tag": "2b5f53ee-a28d-48f4-8fb1-613acb644289"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:09.188739 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-914ab6b9-d59a-49d6-a9b3-099eb25cbc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1310 microversion: 2.1 time: 0.323564 Oct 10 23:18:09.193531 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 235/437] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:08 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1310 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:09.227016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ddfeecb9-369b-49bc-a3d3-eeca5857687f req-5b7d64fb-a614-4d2d-b2d0-c4dfe9b2b622 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:09.228606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ddfeecb9-369b-49bc-a3d3-eeca5857687f req-5b7d64fb-a614-4d2d-b2d0-c4dfe9b2b622 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:09.229425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ddfeecb9-369b-49bc-a3d3-eeca5857687f req-5b7d64fb-a614-4d2d-b2d0-c4dfe9b2b622 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:09.268138 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-ddfeecb9-369b-49bc-a3d3-eeca5857687f req-5b7d64fb-a614-4d2d-b2d0-c4dfe9b2b622 service nova] Creating event network-changed:2b5f53ee-a28d-48f4-8fb1-613acb644289 for instance c783f55d-ea82-4d94-a4f6-77591d412a02 on n-h1-860864-2 Oct 10 23:18:09.280674 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-ddfeecb9-369b-49bc-a3d3-eeca5857687f req-5b7d64fb-a614-4d2d-b2d0-c4dfe9b2b622 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100473 Oct 10 23:18:09.281640 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 203/438] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:09.283308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1c3cf793-9574-43d0-976a-b502355102f2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:09.284232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1c3cf793-9574-43d0-976a-b502355102f2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: c783f55d-ea82-4d94-a4f6-77591d412a02] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:09.296906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c3cf793-9574-43d0-976a-b502355102f2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:09.301366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c3cf793-9574-43d0-976a-b502355102f2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:09.301905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c3cf793-9574-43d0-976a-b502355102f2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:09.303162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c3cf793-9574-43d0-976a-b502355102f2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:09.303644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c3cf793-9574-43d0-976a-b502355102f2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:09.304078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c3cf793-9574-43d0-976a-b502355102f2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:09.533952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1c3cf793-9574-43d0-976a-b502355102f2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:09.545152 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1c3cf793-9574-43d0-976a-b502355102f2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02" status: 200 len: 1319 microversion: 2.1 time: 0.268252 Oct 10 23:18:09.546636 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 236/439] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:09 2022] GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:18:09.803081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-59687abf-fdb7-4fd7-a6e3-97941b4b4315 tempest-FlavorMetadataValidation-319500726 tempest-FlavorMetadataValidation-319500726-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-204550979", "id": 1165718303, "os-flavor-access:is_public": "True"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:09.846320 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-59687abf-fdb7-4fd7-a6e3-97941b4b4315 tempest-FlavorMetadataValidation-319500726 tempest-FlavorMetadataValidation-319500726-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.460300 Oct 10 23:18:09.847592 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 204/440] 10.222.0.23 () {62 vars in 1188 bytes} [Mon Oct 10 23:18:09 2022] POST /compute/v2.1/flavors => generated 470 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:18:09.861364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b956fe71-5901-4063-b522-e6f6bbd77101 tempest-FlavorMetadataValidation-319500726 tempest-FlavorMetadataValidation-319500726-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:09.916816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-13113f54-465c-4df6-a80f-4d4ef5c9a947 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:09.919543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-13113f54-465c-4df6-a80f-4d4ef5c9a947 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:09.930288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13113f54-465c-4df6-a80f-4d4ef5c9a947 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:09.930788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13113f54-465c-4df6-a80f-4d4ef5c9a947 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:09.931224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13113f54-465c-4df6-a80f-4d4ef5c9a947 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:09.931973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13113f54-465c-4df6-a80f-4d4ef5c9a947 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:09.932387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13113f54-465c-4df6-a80f-4d4ef5c9a947 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:09.932813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13113f54-465c-4df6-a80f-4d4ef5c9a947 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:10.063086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=8 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:10.090329 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b956fe71-5901-4063-b522-e6f6bbd77101 tempest-FlavorMetadataValidation-319500726 tempest-FlavorMetadataValidation-319500726-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1165718303/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.232742 Oct 10 23:18:10.091224 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 237/441] 10.222.0.23 () {62 vars in 1265 bytes} [Mon Oct 10 23:18:09 2022] POST /compute/v2.1/flavors/1165718303/os-extra_specs => generated 62 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:10.104197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-03e653d9-918d-489c-b04f-728d3064f719 tempest-FlavorMetadataValidation-319500726 tempest-FlavorMetadataValidation-319500726-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:10.130982 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-03e653d9-918d-489c-b04f-728d3064f719 tempest-FlavorMetadataValidation-319500726 tempest-FlavorMetadataValidation-319500726-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1165718303" status: 202 len: 0 microversion: 2.86 time: 0.031255 Oct 10 23:18:10.132069 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 238/442] 10.222.0.23 () {60 vars in 1202 bytes} [Mon Oct 10 23:18:10 2022] DELETE /compute/v2.1/flavors/1165718303 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:18:10.142242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e05be86e-7a25-4e40-a613-1b32997e7e77 tempest-FlavorMetadataValidation-319500726 tempest-FlavorMetadataValidation-319500726-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:10.178258 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e05be86e-7a25-4e40-a613-1b32997e7e77 tempest-FlavorMetadataValidation-319500726 tempest-FlavorMetadataValidation-319500726-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6682 microversion: 2.86 time: 0.041201 Oct 10 23:18:10.192128 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 239/443] 10.222.0.23 () {60 vars in 1187 bytes} [Mon Oct 10 23:18:10 2022] GET /compute/v2.1/flavors/detail => generated 6682 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:18:10.217417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-490a1421-f966-4758-af8c-a3296fafbcdd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:10.221270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-490a1421-f966-4758-af8c-a3296fafbcdd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:10.232567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-490a1421-f966-4758-af8c-a3296fafbcdd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:10.233983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-490a1421-f966-4758-af8c-a3296fafbcdd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:10.235540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-490a1421-f966-4758-af8c-a3296fafbcdd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:10.236436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-490a1421-f966-4758-af8c-a3296fafbcdd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:10.237099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-490a1421-f966-4758-af8c-a3296fafbcdd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:10.238423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-490a1421-f966-4758-af8c-a3296fafbcdd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:10.288286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-13113f54-465c-4df6-a80f-4d4ef5c9a947 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:10.300539 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-13113f54-465c-4df6-a80f-4d4ef5c9a947 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1270 microversion: 2.1 time: 0.387903 Oct 10 23:18:10.301636 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 205/444] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:09 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1270 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:10.576481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-42f8c5d1-3ae5-4922-9ce9-f4d7a6d38cf3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:10.577248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-42f8c5d1-3ae5-4922-9ce9-f4d7a6d38cf3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: c783f55d-ea82-4d94-a4f6-77591d412a02] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:10.584532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-490a1421-f966-4758-af8c-a3296fafbcdd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:10.590705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42f8c5d1-3ae5-4922-9ce9-f4d7a6d38cf3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:10.592926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42f8c5d1-3ae5-4922-9ce9-f4d7a6d38cf3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:10.593693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42f8c5d1-3ae5-4922-9ce9-f4d7a6d38cf3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:10.594608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42f8c5d1-3ae5-4922-9ce9-f4d7a6d38cf3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:10.594720 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-490a1421-f966-4758-af8c-a3296fafbcdd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1310 microversion: 2.1 time: 0.385451 Oct 10 23:18:10.595700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42f8c5d1-3ae5-4922-9ce9-f4d7a6d38cf3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:10.596342 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 240/445] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:10 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1310 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:10.597870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42f8c5d1-3ae5-4922-9ce9-f4d7a6d38cf3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:11.133762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-40dd3749-d442-4ab9-9693-c43e83e88c7e tempest-FloatingIPDetailsTestJSON-383567993 tempest-FloatingIPDetailsTestJSON-383567993-project] Action: 'create', calling method: .version_select at 0x7f662bea00d0>, body: {"pool": null} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:11.660489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-42f8c5d1-3ae5-4922-9ce9-f4d7a6d38cf3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:11.671949 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-42f8c5d1-3ae5-4922-9ce9-f4d7a6d38cf3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02" status: 200 len: 1319 microversion: 2.1 time: 1.097266 Oct 10 23:18:11.672606 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 206/446] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:10 2022] GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02 => generated 1319 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:11.777200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-68e6a89a-4e93-4bf3-9625-abc5c2a9aaa1 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Calling method '.version_select at 0x7f66301a35e0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:11.780070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68e6a89a-4e93-4bf3-9625-abc5c2a9aaa1 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:11.781239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68e6a89a-4e93-4bf3-9625-abc5c2a9aaa1 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:11.781745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68e6a89a-4e93-4bf3-9625-abc5c2a9aaa1 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:11.838993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68e6a89a-4e93-4bf3-9625-abc5c2a9aaa1 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:11.844976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68e6a89a-4e93-4bf3-9625-abc5c2a9aaa1 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:11.847442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68e6a89a-4e93-4bf3-9625-abc5c2a9aaa1 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:11.872810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68e6a89a-4e93-4bf3-9625-abc5c2a9aaa1 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:11.873709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68e6a89a-4e93-4bf3-9625-abc5c2a9aaa1 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:11.874309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68e6a89a-4e93-4bf3-9625-abc5c2a9aaa1 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:11.893356 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-68e6a89a-4e93-4bf3-9625-abc5c2a9aaa1 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.219646 Oct 10 23:18:11.894233 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 207/447] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:18:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:11.899668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ecc88ef7-b7b9-40a7-bff0-343a7c75b685 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:11.900508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ecc88ef7-b7b9-40a7-bff0-343a7c75b685 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:11.912601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecc88ef7-b7b9-40a7-bff0-343a7c75b685 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:11.913850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecc88ef7-b7b9-40a7-bff0-343a7c75b685 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:11.915557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecc88ef7-b7b9-40a7-bff0-343a7c75b685 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:11.917942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecc88ef7-b7b9-40a7-bff0-343a7c75b685 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:11.918677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecc88ef7-b7b9-40a7-bff0-343a7c75b685 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:11.920415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecc88ef7-b7b9-40a7-bff0-343a7c75b685 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:12.506942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ecc88ef7-b7b9-40a7-bff0-343a7c75b685 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:12.520459 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ecc88ef7-b7b9-40a7-bff0-343a7c75b685 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1312 microversion: 2.1 time: 0.624986 Oct 10 23:18:12.525743 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 208/448] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:11 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1312 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:12.534695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5e174147-5ecb-43aa-8c47-0f9dfe217a23 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:12.535307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5e174147-5ecb-43aa-8c47-0f9dfe217a23 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:12.548086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e174147-5ecb-43aa-8c47-0f9dfe217a23 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:12.550308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e174147-5ecb-43aa-8c47-0f9dfe217a23 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:12.550768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e174147-5ecb-43aa-8c47-0f9dfe217a23 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:12.551486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e174147-5ecb-43aa-8c47-0f9dfe217a23 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:12.551939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e174147-5ecb-43aa-8c47-0f9dfe217a23 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:12.558707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e174147-5ecb-43aa-8c47-0f9dfe217a23 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:13.069621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5e174147-5ecb-43aa-8c47-0f9dfe217a23 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:13.085588 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5e174147-5ecb-43aa-8c47-0f9dfe217a23 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1310 microversion: 2.1 time: 0.557169 Oct 10 23:18:13.086885 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 209/449] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:12 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1310 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:13.098840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-cd2d4b9d-cd13-4914-acc9-b387efb2c4dd req-eaadcbb6-6356-45b4-9e47-46405fff3ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a793bab-7cf8-422b-8158-6c1cd268eaac", "tag": "69ca134e-b82a-4bc3-b55d-ed4eed16ae51"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:13.121015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cd2d4b9d-cd13-4914-acc9-b387efb2c4dd req-eaadcbb6-6356-45b4-9e47-46405fff3ef5 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:13.121678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cd2d4b9d-cd13-4914-acc9-b387efb2c4dd req-eaadcbb6-6356-45b4-9e47-46405fff3ef5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:13.122256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cd2d4b9d-cd13-4914-acc9-b387efb2c4dd req-eaadcbb6-6356-45b4-9e47-46405fff3ef5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:13.154903 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-cd2d4b9d-cd13-4914-acc9-b387efb2c4dd req-eaadcbb6-6356-45b4-9e47-46405fff3ef5 service nova] Creating event network-changed:69ca134e-b82a-4bc3-b55d-ed4eed16ae51 for instance 7a793bab-7cf8-422b-8158-6c1cd268eaac on n-h2-860864-2 Oct 10 23:18:13.163633 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-cd2d4b9d-cd13-4914-acc9-b387efb2c4dd req-eaadcbb6-6356-45b4-9e47-46405fff3ef5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074502 Oct 10 23:18:13.164625 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 210/450] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:13.169915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d300f98f-94b5-4636-be22-ffbba2c1e0ca tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Calling method '.version_select at 0x7f662bd930d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:13.171981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d300f98f-94b5-4636-be22-ffbba2c1e0ca tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:13.172683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d300f98f-94b5-4636-be22-ffbba2c1e0ca tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:13.173366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d300f98f-94b5-4636-be22-ffbba2c1e0ca tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:13.176718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:13.189590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d300f98f-94b5-4636-be22-ffbba2c1e0ca tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:13.190429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d300f98f-94b5-4636-be22-ffbba2c1e0ca tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:13.191326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d300f98f-94b5-4636-be22-ffbba2c1e0ca tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:13.266863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d300f98f-94b5-4636-be22-ffbba2c1e0ca tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:13.267798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d300f98f-94b5-4636-be22-ffbba2c1e0ca tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:13.268502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d300f98f-94b5-4636-be22-ffbba2c1e0ca tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:13.277252 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d300f98f-94b5-4636-be22-ffbba2c1e0ca tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h2-860864-2/servers" status: 200 len: 354 microversion: 2.1 time: 0.111071 Oct 10 23:18:13.278259 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 211/451] 10.222.0.23 () {58 vars in 1212 bytes} [Mon Oct 10 23:18:13 2022] GET /compute/v2.1/os-hypervisors/n-h2-860864-2/servers => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:13.528353 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-40dd3749-d442-4ab9-9693-c43e83e88c7e tempest-FloatingIPDetailsTestJSON-383567993 tempest-FloatingIPDetailsTestJSON-383567993-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.606854 Oct 10 23:18:13.543399 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 241/452] 10.222.0.23 () {60 vars in 1170 bytes} [Mon Oct 10 23:18:10 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:18:13.553128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9a41387d-e093-4536-92b8-847c73015146 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:13.554075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9a41387d-e093-4536-92b8-847c73015146 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: c783f55d-ea82-4d94-a4f6-77591d412a02] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:13.564122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a41387d-e093-4536-92b8-847c73015146 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:13.565487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a41387d-e093-4536-92b8-847c73015146 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:13.566136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a41387d-e093-4536-92b8-847c73015146 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:13.567208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a41387d-e093-4536-92b8-847c73015146 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:13.568307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a41387d-e093-4536-92b8-847c73015146 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:13.569005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a41387d-e093-4536-92b8-847c73015146 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:13.612309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:13.685769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c3331cb1-4cd1-403f-a53b-427bf00c51a6 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1952428463", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "d3362ac6-6706-413b-9654-0263e4510ad8"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:13.695893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=85,nova_api:DELETE=7 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:13.764050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-c3331cb1-4cd1-403f-a53b-427bf00c51a6 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] validate_networks() for [('d3362ac6-6706-413b-9654-0263e4510ad8', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:18:13.798880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9a41387d-e093-4536-92b8-847c73015146 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:13.811324 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9a41387d-e093-4536-92b8-847c73015146 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02" status: 200 len: 1319 microversion: 2.1 time: 0.265090 Oct 10 23:18:13.822786 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 242/453] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:13 2022] GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:13.834449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cae73fb8-91af-462b-ad9e-22231ae2d021 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Calling method '.version_select at 0x7f662bef60d0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:13.836211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cae73fb8-91af-462b-ad9e-22231ae2d021 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:13.836684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cae73fb8-91af-462b-ad9e-22231ae2d021 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:13.839669 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cae73fb8-91af-462b-ad9e-22231ae2d021 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:13.863315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cae73fb8-91af-462b-ad9e-22231ae2d021 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:13.864066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cae73fb8-91af-462b-ad9e-22231ae2d021 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:13.864495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cae73fb8-91af-462b-ad9e-22231ae2d021 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:13.876684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cae73fb8-91af-462b-ad9e-22231ae2d021 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:13.877355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cae73fb8-91af-462b-ad9e-22231ae2d021 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:13.877957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cae73fb8-91af-462b-ad9e-22231ae2d021 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:13.887592 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cae73fb8-91af-462b-ad9e-22231ae2d021 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.057112 Oct 10 23:18:13.890576 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 243/454] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:18:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:13.900825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bdd688ce-fb37-4821-8eca-7d3a909b981d tempest-FloatingIPDetailsTestJSON-383567993 tempest-FloatingIPDetailsTestJSON-383567993-project] Action: 'create', calling method: .version_select at 0x7f663027e670>, body: {"pool": null} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:14.046572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:14.731670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=40 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:15.944563 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bdd688ce-fb37-4821-8eca-7d3a909b981d tempest-FloatingIPDetailsTestJSON-383567993 tempest-FloatingIPDetailsTestJSON-383567993-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.052646 Oct 10 23:18:15.945906 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 244/455] 10.222.0.23 () {60 vars in 1170 bytes} [Mon Oct 10 23:18:13 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:15.951892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fa832848-5377-4bd1-817d-6f326badcb00 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:15.952728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fa832848-5377-4bd1-817d-6f326badcb00 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:15.979617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa832848-5377-4bd1-817d-6f326badcb00 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:15.980117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa832848-5377-4bd1-817d-6f326badcb00 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:15.981870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa832848-5377-4bd1-817d-6f326badcb00 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:15.982956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa832848-5377-4bd1-817d-6f326badcb00 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:15.983546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa832848-5377-4bd1-817d-6f326badcb00 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:15.984045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa832848-5377-4bd1-817d-6f326badcb00 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:16.157918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c3331cb1-4cd1-403f-a53b-427bf00c51a6 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:18:16.159247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c3331cb1-4cd1-403f-a53b-427bf00c51a6 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:18:16.160496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c3331cb1-4cd1-403f-a53b-427bf00c51a6 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:18:16.161074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c3331cb1-4cd1-403f-a53b-427bf00c51a6 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:18:16.161548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c3331cb1-4cd1-403f-a53b-427bf00c51a6 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:18:16.167422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fa832848-5377-4bd1-817d-6f326badcb00 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:16.173143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3331cb1-4cd1-403f-a53b-427bf00c51a6 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:16.173677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3331cb1-4cd1-403f-a53b-427bf00c51a6 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:16.174141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3331cb1-4cd1-403f-a53b-427bf00c51a6 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:16.175119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3331cb1-4cd1-403f-a53b-427bf00c51a6 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:16.175748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3331cb1-4cd1-403f-a53b-427bf00c51a6 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:16.176179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3331cb1-4cd1-403f-a53b-427bf00c51a6 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:16.177510 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fa832848-5377-4bd1-817d-6f326badcb00 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1312 microversion: 2.1 time: 0.230162 Oct 10 23:18:16.178099 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 245/456] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:15 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1312 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:16.183721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6be2cfdb-53ce-44e1-9781-8846e9a63073 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Calling method '.version_select at 0x7f662bea0040>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:16.186792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6be2cfdb-53ce-44e1-9781-8846e9a63073 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:16.187898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6be2cfdb-53ce-44e1-9781-8846e9a63073 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:16.188679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6be2cfdb-53ce-44e1-9781-8846e9a63073 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:16.197647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-c3331cb1-4cd1-403f-a53b-427bf00c51a6 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Getting quotas for project c7443a53a70743a09144270de0904832. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:18:16.203865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6be2cfdb-53ce-44e1-9781-8846e9a63073 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:16.204350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6be2cfdb-53ce-44e1-9781-8846e9a63073 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:16.204556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-c3331cb1-4cd1-403f-a53b-427bf00c51a6 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Getting quotas for user 12f4b43c646c4aba88160ffeb98c6aa8 and project c7443a53a70743a09144270de0904832. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:18:16.204787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6be2cfdb-53ce-44e1-9781-8846e9a63073 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:16.216576 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6be2cfdb-53ce-44e1-9781-8846e9a63073 tempest-HypervisorAdminUnderV252Test-504003976 tempest-HypervisorAdminUnderV252Test-504003976-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h2-860864-2/search" status: 200 len: 104 microversion: 2.1 time: 0.031918 Oct 10 23:18:16.216576 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 246/457] 10.222.0.23 () {58 vars in 1209 bytes} [Mon Oct 10 23:18:16 2022] GET /compute/v2.1/os-hypervisors/n-h2-860864-2/search => generated 104 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:16.216576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9b118f3d-6887-4397-a775-839f28971088 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:16.217033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9b118f3d-6887-4397-a775-839f28971088 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:16.225030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c3331cb1-4cd1-403f-a53b-427bf00c51a6 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:18:16.227249 n-d-860864-2 devstack@n-api.service[120613]: WARNING nova.utils [None req-c3331cb1-4cd1-403f-a53b-427bf00c51a6 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1952428463 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-195242846 Oct 10 23:18:16.227528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b118f3d-6887-4397-a775-839f28971088 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:16.228099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b118f3d-6887-4397-a775-839f28971088 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:16.228233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c3331cb1-4cd1-403f-a53b-427bf00c51a6 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:18:16.228995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b118f3d-6887-4397-a775-839f28971088 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:16.229669 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b118f3d-6887-4397-a775-839f28971088 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:16.230186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b118f3d-6887-4397-a775-839f28971088 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:16.231004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b118f3d-6887-4397-a775-839f28971088 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:16.285352 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c3331cb1-4cd1-403f-a53b-427bf00c51a6 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.005574 Oct 10 23:18:16.286392 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 212/458] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:18:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:18:16.296320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-b18992f6-e472-4ab7-968c-c23b70415621 req-43341cf9-e5b7-4cfa-b1f9-785f60e9294f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7907c918-8df3-44bc-94f5-4fde965de66f", "name": "network-vif-plugged", "status": "completed", "tag": "e3a0a0e5-3b6c-47c0-975a-49b336f25e2a"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:16.309997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b18992f6-e472-4ab7-968c-c23b70415621 req-43341cf9-e5b7-4cfa-b1f9-785f60e9294f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:16.310748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b18992f6-e472-4ab7-968c-c23b70415621 req-43341cf9-e5b7-4cfa-b1f9-785f60e9294f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:16.328675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b18992f6-e472-4ab7-968c-c23b70415621 req-43341cf9-e5b7-4cfa-b1f9-785f60e9294f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:16.374062 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-b18992f6-e472-4ab7-968c-c23b70415621 req-43341cf9-e5b7-4cfa-b1f9-785f60e9294f service nova] Creating event network-vif-plugged:e3a0a0e5-3b6c-47c0-975a-49b336f25e2a for instance 7907c918-8df3-44bc-94f5-4fde965de66f on n-h1-860864-2 Oct 10 23:18:16.385824 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-b18992f6-e472-4ab7-968c-c23b70415621 req-43341cf9-e5b7-4cfa-b1f9-785f60e9294f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097924 Oct 10 23:18:16.389855 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 213/459] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:16.406295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-06a9ee13-ff26-4b25-926c-53e36ac442bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:16.407797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-06a9ee13-ff26-4b25-926c-53e36ac442bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: c783f55d-ea82-4d94-a4f6-77591d412a02] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:16.424583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06a9ee13-ff26-4b25-926c-53e36ac442bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:16.425328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9b118f3d-6887-4397-a775-839f28971088 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:16.425707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06a9ee13-ff26-4b25-926c-53e36ac442bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:16.426759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06a9ee13-ff26-4b25-926c-53e36ac442bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:16.427684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06a9ee13-ff26-4b25-926c-53e36ac442bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:16.428592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06a9ee13-ff26-4b25-926c-53e36ac442bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:16.429171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06a9ee13-ff26-4b25-926c-53e36ac442bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:16.445455 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9b118f3d-6887-4397-a775-839f28971088 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1310 microversion: 2.1 time: 0.232644 Oct 10 23:18:16.446158 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 247/460] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:16 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1310 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:16.452085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-e5fa490c-8c5b-46b4-9dfc-d29f6e8cb71b req-1c327238-2211-49db-afb9-68526bd15570 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a45a7de2-2607-4f13-87e3-2c7e74785470", "tag": "fdbc7ece-ba7d-48ea-9d4a-166ef6293a46"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:16.476860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e5fa490c-8c5b-46b4-9dfc-d29f6e8cb71b req-1c327238-2211-49db-afb9-68526bd15570 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:16.478532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e5fa490c-8c5b-46b4-9dfc-d29f6e8cb71b req-1c327238-2211-49db-afb9-68526bd15570 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:16.480076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e5fa490c-8c5b-46b4-9dfc-d29f6e8cb71b req-1c327238-2211-49db-afb9-68526bd15570 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:16.506042 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-e5fa490c-8c5b-46b4-9dfc-d29f6e8cb71b req-1c327238-2211-49db-afb9-68526bd15570 service nova] Creating event network-changed:fdbc7ece-ba7d-48ea-9d4a-166ef6293a46 for instance a45a7de2-2607-4f13-87e3-2c7e74785470 on n-h2-860864-2 Oct 10 23:18:16.515804 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-e5fa490c-8c5b-46b4-9dfc-d29f6e8cb71b req-1c327238-2211-49db-afb9-68526bd15570 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067356 Oct 10 23:18:16.516751 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 248/461] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:16.532972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ea2ef68c-8e55-4143-a5ca-1bbee3846254 tempest-FloatingIPDetailsTestJSON-383567993 tempest-FloatingIPDetailsTestJSON-383567993-project] Action: 'create', calling method: .version_select at 0x7f662bf3c1f0>, body: {"pool": null} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:16.789912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-06a9ee13-ff26-4b25-926c-53e36ac442bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:16.798789 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-06a9ee13-ff26-4b25-926c-53e36ac442bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02" status: 200 len: 1319 microversion: 2.1 time: 0.407450 Oct 10 23:18:16.800000 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 214/462] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:16 2022] GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02 => generated 1319 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:16.804949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-899c9ca2-4483-46bc-96e5-75206d445819 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:16.805780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-899c9ca2-4483-46bc-96e5-75206d445819 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:16.894723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-899c9ca2-4483-46bc-96e5-75206d445819 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f4b43c646c4aba88160ffeb98c6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7443a53a70743a09144270de0904832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:16.914089 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-899c9ca2-4483-46bc-96e5-75206d445819 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" status: 200 len: 1232 microversion: 2.1 time: 0.111898 Oct 10 23:18:16.915129 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 215/463] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:16 2022] GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 => generated 1232 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:17.209671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-85d5f2d3-147e-4ca8-b643-6b0d43426743 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Calling method '.version_select at 0x7f662bde8280>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:17.213426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85d5f2d3-147e-4ca8-b643-6b0d43426743 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:17.215499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85d5f2d3-147e-4ca8-b643-6b0d43426743 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:17.216189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85d5f2d3-147e-4ca8-b643-6b0d43426743 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:17.218120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85d5f2d3-147e-4ca8-b643-6b0d43426743 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:17.218793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85d5f2d3-147e-4ca8-b643-6b0d43426743 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:17.221586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85d5f2d3-147e-4ca8-b643-6b0d43426743 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:17.260347 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-85d5f2d3-147e-4ca8-b643-6b0d43426743 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.343682 Oct 10 23:18:17.261699 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 216/464] 10.222.0.23 () {58 vars in 1128 bytes} [Mon Oct 10 23:18:16 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:17.268998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-28d5e680-e065-45e7-a0cb-94488085bde1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:17.269957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-28d5e680-e065-45e7-a0cb-94488085bde1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:17.277210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28d5e680-e065-45e7-a0cb-94488085bde1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:17.279240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28d5e680-e065-45e7-a0cb-94488085bde1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:17.280084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28d5e680-e065-45e7-a0cb-94488085bde1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:17.281743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28d5e680-e065-45e7-a0cb-94488085bde1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:17.283481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28d5e680-e065-45e7-a0cb-94488085bde1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:17.284298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28d5e680-e065-45e7-a0cb-94488085bde1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:17.590085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-28d5e680-e065-45e7-a0cb-94488085bde1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:17.599222 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-28d5e680-e065-45e7-a0cb-94488085bde1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1312 microversion: 2.1 time: 0.336074 Oct 10 23:18:17.599875 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 217/465] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:17 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1312 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:17.625688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-28b5f945-ce89-4766-8823-5a8398ef5a54 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Calling method '.version_select at 0x7f662bdf6700>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:17.632788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28b5f945-ce89-4766-8823-5a8398ef5a54 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:17.633283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28b5f945-ce89-4766-8823-5a8398ef5a54 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:17.633750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28b5f945-ce89-4766-8823-5a8398ef5a54 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:17.634495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28b5f945-ce89-4766-8823-5a8398ef5a54 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:17.634955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28b5f945-ce89-4766-8823-5a8398ef5a54 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:17.635387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28b5f945-ce89-4766-8823-5a8398ef5a54 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:17.661166 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-28b5f945-ce89-4766-8823-5a8398ef5a54 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.043363 Oct 10 23:18:17.662507 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 218/466] 10.222.0.23 () {58 vars in 1139 bytes} [Mon Oct 10 23:18:17 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:17.667505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-393f080d-248a-4019-a601-3cc52c71b7a8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:17.668650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-393f080d-248a-4019-a601-3cc52c71b7a8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:17.675509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-393f080d-248a-4019-a601-3cc52c71b7a8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:17.676013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-393f080d-248a-4019-a601-3cc52c71b7a8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:17.676445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-393f080d-248a-4019-a601-3cc52c71b7a8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:17.677361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-393f080d-248a-4019-a601-3cc52c71b7a8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:17.677977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-393f080d-248a-4019-a601-3cc52c71b7a8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:17.678431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-393f080d-248a-4019-a601-3cc52c71b7a8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:17.894566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-393f080d-248a-4019-a601-3cc52c71b7a8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:17.905197 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-393f080d-248a-4019-a601-3cc52c71b7a8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1310 microversion: 2.1 time: 0.240582 Oct 10 23:18:17.906798 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 219/467] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:17 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1310 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:17.922685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7c0ef174-bad1-4814-b093-ca1c11effde2 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Calling method '.version_select at 0x7f662bde8e50>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:17.927055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c0ef174-bad1-4814-b093-ca1c11effde2 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:17.927590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c0ef174-bad1-4814-b093-ca1c11effde2 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:17.928324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c0ef174-bad1-4814-b093-ca1c11effde2 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:17.929240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c0ef174-bad1-4814-b093-ca1c11effde2 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:17.929781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c0ef174-bad1-4814-b093-ca1c11effde2 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:17.930380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c0ef174-bad1-4814-b093-ca1c11effde2 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:17.960156 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7c0ef174-bad1-4814-b093-ca1c11effde2 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.051854 Oct 10 23:18:17.960826 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 220/468] 10.222.0.23 () {58 vars in 1145 bytes} [Mon Oct 10 23:18:17 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:18:17.967530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2cb6133b-70b3-42b8-a2bb-2a76f5e8c1c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:17.968351 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2cb6133b-70b3-42b8-a2bb-2a76f5e8c1c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: c783f55d-ea82-4d94-a4f6-77591d412a02] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:17.976758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cb6133b-70b3-42b8-a2bb-2a76f5e8c1c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:17.978437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cb6133b-70b3-42b8-a2bb-2a76f5e8c1c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:17.979204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cb6133b-70b3-42b8-a2bb-2a76f5e8c1c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:17.980045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cb6133b-70b3-42b8-a2bb-2a76f5e8c1c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:17.981279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cb6133b-70b3-42b8-a2bb-2a76f5e8c1c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:17.982315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cb6133b-70b3-42b8-a2bb-2a76f5e8c1c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:18.220639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2cb6133b-70b3-42b8-a2bb-2a76f5e8c1c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:18.228933 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2cb6133b-70b3-42b8-a2bb-2a76f5e8c1c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02" status: 200 len: 1319 microversion: 2.1 time: 0.267046 Oct 10 23:18:18.230068 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 221/469] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:17 2022] GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:18.239586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e3a3c5e0-a35f-4649-8043-8768946c8eea tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:18.240414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e3a3c5e0-a35f-4649-8043-8768946c8eea tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:18.248222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3a3c5e0-a35f-4649-8043-8768946c8eea tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:18.248820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3a3c5e0-a35f-4649-8043-8768946c8eea tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:18.249329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3a3c5e0-a35f-4649-8043-8768946c8eea tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:18.250266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3a3c5e0-a35f-4649-8043-8768946c8eea tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:18.250794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3a3c5e0-a35f-4649-8043-8768946c8eea tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:18.251336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3a3c5e0-a35f-4649-8043-8768946c8eea tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:18.332396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e3a3c5e0-a35f-4649-8043-8768946c8eea tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f4b43c646c4aba88160ffeb98c6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7443a53a70743a09144270de0904832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:18.343742 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e3a3c5e0-a35f-4649-8043-8768946c8eea tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" status: 200 len: 1284 microversion: 2.1 time: 0.112235 Oct 10 23:18:18.344365 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 222/470] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:18 2022] GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 => generated 1284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:18.348706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9fe11a88-3d27-41ee-a945-62b899636a58 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Calling method '.version_select at 0x7f662bd00f70>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:18.352401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fe11a88-3d27-41ee-a945-62b899636a58 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:18.352925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fe11a88-3d27-41ee-a945-62b899636a58 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:18.353456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fe11a88-3d27-41ee-a945-62b899636a58 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:18.354651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fe11a88-3d27-41ee-a945-62b899636a58 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:18.355575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fe11a88-3d27-41ee-a945-62b899636a58 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:18.356294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fe11a88-3d27-41ee-a945-62b899636a58 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:18.382176 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9fe11a88-3d27-41ee-a945-62b899636a58 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.036702 Oct 10 23:18:18.389353 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 223/471] 10.222.0.23 () {58 vars in 1128 bytes} [Mon Oct 10 23:18:18 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:18.394888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6761a8f7-8871-4e77-911c-6c892080c696 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Calling method '.version_select at 0x7f662bd86f70>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:18.397467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6761a8f7-8871-4e77-911c-6c892080c696 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:18.397968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6761a8f7-8871-4e77-911c-6c892080c696 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:18.398335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6761a8f7-8871-4e77-911c-6c892080c696 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:18.398979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6761a8f7-8871-4e77-911c-6c892080c696 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:18.399548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6761a8f7-8871-4e77-911c-6c892080c696 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:18.399968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6761a8f7-8871-4e77-911c-6c892080c696 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:18.426032 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6761a8f7-8871-4e77-911c-6c892080c696 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.035486 Oct 10 23:18:18.429574 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 224/472] 10.222.0.23 () {58 vars in 1155 bytes} [Mon Oct 10 23:18:18 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:18.435570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-b02589a0-34d2-477a-9280-176bcd332733 req-8340fc5c-a27b-4167-9db4-ccf198464577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c783f55d-ea82-4d94-a4f6-77591d412a02", "name": "network-vif-plugged", "status": "completed", "tag": "2b5f53ee-a28d-48f4-8fb1-613acb644289"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:18.445979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b02589a0-34d2-477a-9280-176bcd332733 req-8340fc5c-a27b-4167-9db4-ccf198464577 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:18.446466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b02589a0-34d2-477a-9280-176bcd332733 req-8340fc5c-a27b-4167-9db4-ccf198464577 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:18.447094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b02589a0-34d2-477a-9280-176bcd332733 req-8340fc5c-a27b-4167-9db4-ccf198464577 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:18.460390 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-b02589a0-34d2-477a-9280-176bcd332733 req-8340fc5c-a27b-4167-9db4-ccf198464577 service nova] Creating event network-vif-plugged:2b5f53ee-a28d-48f4-8fb1-613acb644289 for instance c783f55d-ea82-4d94-a4f6-77591d412a02 on n-h1-860864-2 Oct 10 23:18:18.465333 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-b02589a0-34d2-477a-9280-176bcd332733 req-8340fc5c-a27b-4167-9db4-ccf198464577 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034399 Oct 10 23:18:18.466902 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 225/473] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:18.472660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ac6969f4-53ea-4123-8e03-aa93621e19c0 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Calling method '.version_select at 0x7f662bdb74c0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:18.476780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac6969f4-53ea-4123-8e03-aa93621e19c0 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:18.478482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac6969f4-53ea-4123-8e03-aa93621e19c0 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:18.479170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac6969f4-53ea-4123-8e03-aa93621e19c0 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:18.480221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac6969f4-53ea-4123-8e03-aa93621e19c0 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:18.481083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac6969f4-53ea-4123-8e03-aa93621e19c0 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:18.481981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac6969f4-53ea-4123-8e03-aa93621e19c0 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:18.521283 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ac6969f4-53ea-4123-8e03-aa93621e19c0 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.052797 Oct 10 23:18:18.522519 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 226/474] 10.222.0.23 () {58 vars in 1128 bytes} [Mon Oct 10 23:18:18 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:18.535413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-950db2fe-4f38-491b-a4ba-b13e18fd6268 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Calling method '.version_select at 0x7f663010cc10>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:18.562881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-950db2fe-4f38-491b-a4ba-b13e18fd6268 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:18.564695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-950db2fe-4f38-491b-a4ba-b13e18fd6268 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:18.565413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-950db2fe-4f38-491b-a4ba-b13e18fd6268 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:18.594071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-950db2fe-4f38-491b-a4ba-b13e18fd6268 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:18.594584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-950db2fe-4f38-491b-a4ba-b13e18fd6268 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:18.595162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-950db2fe-4f38-491b-a4ba-b13e18fd6268 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:18.619356 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-950db2fe-4f38-491b-a4ba-b13e18fd6268 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-h2-860864-2" status: 200 len: 729 microversion: 2.1 time: 0.088578 Oct 10 23:18:18.620608 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 227/475] 10.222.0.23 () {58 vars in 1170 bytes} [Mon Oct 10 23:18:18 2022] GET /compute/v2.1/os-hosts/n-h2-860864-2 => generated 729 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:18.626864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fe880c88-f9b1-4e69-a603-49e173c3bdf1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:18.627905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fe880c88-f9b1-4e69-a603-49e173c3bdf1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:18.634551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe880c88-f9b1-4e69-a603-49e173c3bdf1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:18.635176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe880c88-f9b1-4e69-a603-49e173c3bdf1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:18.635746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe880c88-f9b1-4e69-a603-49e173c3bdf1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:18.637125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe880c88-f9b1-4e69-a603-49e173c3bdf1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:18.638426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe880c88-f9b1-4e69-a603-49e173c3bdf1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:18.639621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe880c88-f9b1-4e69-a603-49e173c3bdf1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:18.972307 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ea2ef68c-8e55-4143-a5ca-1bbee3846254 tempest-FloatingIPDetailsTestJSON-383567993 tempest-FloatingIPDetailsTestJSON-383567993-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.454129 Oct 10 23:18:18.974320 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 249/476] 10.222.0.23 () {60 vars in 1170 bytes} [Mon Oct 10 23:18:16 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:18.985960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-94bb256b-9d6d-4ff8-9390-2aaab5eb0cf0 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Calling method '.version_select at 0x7f662bf3c550>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:18.993737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94bb256b-9d6d-4ff8-9390-2aaab5eb0cf0 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:18.994391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94bb256b-9d6d-4ff8-9390-2aaab5eb0cf0 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:18.994971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94bb256b-9d6d-4ff8-9390-2aaab5eb0cf0 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:19.010518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94bb256b-9d6d-4ff8-9390-2aaab5eb0cf0 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:19.011254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94bb256b-9d6d-4ff8-9390-2aaab5eb0cf0 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:19.011982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94bb256b-9d6d-4ff8-9390-2aaab5eb0cf0 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:19.046126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fe880c88-f9b1-4e69-a603-49e173c3bdf1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:19.051420 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-94bb256b-9d6d-4ff8-9390-2aaab5eb0cf0 tempest-HostsAdminTestJSON-1271132078 tempest-HostsAdminTestJSON-1271132078-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-h1-860864-2" status: 200 len: 729 microversion: 2.1 time: 0.075858 Oct 10 23:18:19.052009 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 250/477] 10.222.0.23 () {58 vars in 1170 bytes} [Mon Oct 10 23:18:18 2022] GET /compute/v2.1/os-hosts/n-h1-860864-2 => generated 729 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:19.058826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-93794623-96ba-4d28-b40a-cc54f976c8e3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:19.060099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-93794623-96ba-4d28-b40a-cc54f976c8e3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:19.062927 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fe880c88-f9b1-4e69-a603-49e173c3bdf1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1312 microversion: 2.1 time: 0.440408 Oct 10 23:18:19.064033 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 228/478] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:18 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1312 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:19.066802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93794623-96ba-4d28-b40a-cc54f976c8e3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:19.067469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93794623-96ba-4d28-b40a-cc54f976c8e3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:19.068047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93794623-96ba-4d28-b40a-cc54f976c8e3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:19.068908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93794623-96ba-4d28-b40a-cc54f976c8e3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:19.069532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93794623-96ba-4d28-b40a-cc54f976c8e3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:19.070144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93794623-96ba-4d28-b40a-cc54f976c8e3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:19.071406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-acf67034-70b2-4546-a80e-b4bd5fe55012 tempest-FloatingIPDetailsTestJSON-383567993 tempest-FloatingIPDetailsTestJSON-383567993-project] Action: 'create', calling method: .version_select at 0x7f662bdf64c0>, body: {"pool": null} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:19.385888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-93794623-96ba-4d28-b40a-cc54f976c8e3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:19.400716 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-93794623-96ba-4d28-b40a-cc54f976c8e3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1310 microversion: 2.1 time: 0.347580 Oct 10 23:18:19.406227 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 251/479] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:19 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1310 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:19.426291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6c08039c-3211-455e-86ee-0dc8df7f4fda tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:19.427181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6c08039c-3211-455e-86ee-0dc8df7f4fda tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: c783f55d-ea82-4d94-a4f6-77591d412a02] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:19.442071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c08039c-3211-455e-86ee-0dc8df7f4fda tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:19.442983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c08039c-3211-455e-86ee-0dc8df7f4fda tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:19.446725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c08039c-3211-455e-86ee-0dc8df7f4fda tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:19.451979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c08039c-3211-455e-86ee-0dc8df7f4fda tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:19.452926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c08039c-3211-455e-86ee-0dc8df7f4fda tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:19.453767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c08039c-3211-455e-86ee-0dc8df7f4fda tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:19.728107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6c08039c-3211-455e-86ee-0dc8df7f4fda tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:19.736778 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6c08039c-3211-455e-86ee-0dc8df7f4fda tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02" status: 200 len: 1319 microversion: 2.1 time: 0.325268 Oct 10 23:18:19.738113 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 252/480] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:19 2022] GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02 => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:19.742987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e5b658cc-10c7-4ec6-a434-616dce37bbc8 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:19.743938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e5b658cc-10c7-4ec6-a434-616dce37bbc8 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:19.751807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5b658cc-10c7-4ec6-a434-616dce37bbc8 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:19.752811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5b658cc-10c7-4ec6-a434-616dce37bbc8 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:19.753800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5b658cc-10c7-4ec6-a434-616dce37bbc8 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:19.755018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5b658cc-10c7-4ec6-a434-616dce37bbc8 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:19.755834 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5b658cc-10c7-4ec6-a434-616dce37bbc8 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:19.756528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5b658cc-10c7-4ec6-a434-616dce37bbc8 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:20.101299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e5b658cc-10c7-4ec6-a434-616dce37bbc8 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f4b43c646c4aba88160ffeb98c6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7443a53a70743a09144270de0904832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:20.113967 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e5b658cc-10c7-4ec6-a434-616dce37bbc8 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" status: 200 len: 1332 microversion: 2.1 time: 0.374285 Oct 10 23:18:20.114623 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 253/481] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:19 2022] GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 => generated 1332 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:20.127240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-54a9f835-88b6-47d2-a153-8033f6fc2be5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:20.127381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-54a9f835-88b6-47d2-a153-8033f6fc2be5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:20.138115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54a9f835-88b6-47d2-a153-8033f6fc2be5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:20.138615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54a9f835-88b6-47d2-a153-8033f6fc2be5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:20.139055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54a9f835-88b6-47d2-a153-8033f6fc2be5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:20.139767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54a9f835-88b6-47d2-a153-8033f6fc2be5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:20.140224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54a9f835-88b6-47d2-a153-8033f6fc2be5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:20.140658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54a9f835-88b6-47d2-a153-8033f6fc2be5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:20.418462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-54a9f835-88b6-47d2-a153-8033f6fc2be5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:20.433040 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-54a9f835-88b6-47d2-a153-8033f6fc2be5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1312 microversion: 2.1 time: 0.313384 Oct 10 23:18:20.454271 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 254/482] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:20 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1312 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:20.468071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eb2f1701-e358-424e-95d5-1bc164db1214 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:20.470296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eb2f1701-e358-424e-95d5-1bc164db1214 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:20.486419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb2f1701-e358-424e-95d5-1bc164db1214 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:20.487069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb2f1701-e358-424e-95d5-1bc164db1214 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:20.487611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb2f1701-e358-424e-95d5-1bc164db1214 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:20.488415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb2f1701-e358-424e-95d5-1bc164db1214 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:20.490904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb2f1701-e358-424e-95d5-1bc164db1214 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:20.494178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb2f1701-e358-424e-95d5-1bc164db1214 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:20.835906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-eb2f1701-e358-424e-95d5-1bc164db1214 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:20.847573 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eb2f1701-e358-424e-95d5-1bc164db1214 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1310 microversion: 2.1 time: 0.391459 Oct 10 23:18:20.848468 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 255/483] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:20 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1310 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:20.853852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-12ac2134-099c-4798-8893-69da8c0c95c8 req-91f3e548-abd1-46d8-bc48-b20c01c33bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a793bab-7cf8-422b-8158-6c1cd268eaac", "name": "network-vif-plugged", "status": "completed", "tag": "69ca134e-b82a-4bc3-b55d-ed4eed16ae51"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:20.865863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-12ac2134-099c-4798-8893-69da8c0c95c8 req-91f3e548-abd1-46d8-bc48-b20c01c33bdf service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:20.867234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-12ac2134-099c-4798-8893-69da8c0c95c8 req-91f3e548-abd1-46d8-bc48-b20c01c33bdf service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:20.868090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-12ac2134-099c-4798-8893-69da8c0c95c8 req-91f3e548-abd1-46d8-bc48-b20c01c33bdf service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:20.894895 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-12ac2134-099c-4798-8893-69da8c0c95c8 req-91f3e548-abd1-46d8-bc48-b20c01c33bdf service nova] Creating event network-vif-plugged:69ca134e-b82a-4bc3-b55d-ed4eed16ae51 for instance 7a793bab-7cf8-422b-8158-6c1cd268eaac on n-h2-860864-2 Oct 10 23:18:20.908459 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-12ac2134-099c-4798-8893-69da8c0c95c8 req-91f3e548-abd1-46d8-bc48-b20c01c33bdf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057986 Oct 10 23:18:20.909690 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 256/484] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:20.916974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9e47bdc1-6ec1-4414-a398-21291851afc9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:20.917899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9e47bdc1-6ec1-4414-a398-21291851afc9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: c783f55d-ea82-4d94-a4f6-77591d412a02] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:20.926951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e47bdc1-6ec1-4414-a398-21291851afc9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:20.927712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e47bdc1-6ec1-4414-a398-21291851afc9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:20.928314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e47bdc1-6ec1-4414-a398-21291851afc9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:20.929311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e47bdc1-6ec1-4414-a398-21291851afc9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:20.930241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e47bdc1-6ec1-4414-a398-21291851afc9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:20.930821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e47bdc1-6ec1-4414-a398-21291851afc9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:21.414513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9e47bdc1-6ec1-4414-a398-21291851afc9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:21.433746 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9e47bdc1-6ec1-4414-a398-21291851afc9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02" status: 200 len: 1468 microversion: 2.1 time: 0.522388 Oct 10 23:18:21.434518 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 257/485] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:20 2022] GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02 => generated 1468 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:21.454195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-55bfcc1d-ee38-4f2c-ac19-037a6c925281 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:21.455034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-55bfcc1d-ee38-4f2c-ac19-037a6c925281 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:21.462557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55bfcc1d-ee38-4f2c-ac19-037a6c925281 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:21.463312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55bfcc1d-ee38-4f2c-ac19-037a6c925281 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:21.463909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55bfcc1d-ee38-4f2c-ac19-037a6c925281 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:21.464785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55bfcc1d-ee38-4f2c-ac19-037a6c925281 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:21.465238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55bfcc1d-ee38-4f2c-ac19-037a6c925281 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:21.465926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55bfcc1d-ee38-4f2c-ac19-037a6c925281 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:21.650175 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-acf67034-70b2-4546-a80e-b4bd5fe55012 tempest-FloatingIPDetailsTestJSON-383567993 tempest-FloatingIPDetailsTestJSON-383567993-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.583902 Oct 10 23:18:21.650175 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 229/486] 10.222.0.23 () {60 vars in 1170 bytes} [Mon Oct 10 23:18:19 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:21.655793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a828e03a-0152-45cc-a98d-f52f977f5732 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:21.656410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a828e03a-0152-45cc-a98d-f52f977f5732 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 7907c918-8df3-44bc-94f5-4fde965de66f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:21.668609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a828e03a-0152-45cc-a98d-f52f977f5732 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:21.669558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a828e03a-0152-45cc-a98d-f52f977f5732 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:21.670191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a828e03a-0152-45cc-a98d-f52f977f5732 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:21.671072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a828e03a-0152-45cc-a98d-f52f977f5732 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:21.671681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a828e03a-0152-45cc-a98d-f52f977f5732 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:21.672260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a828e03a-0152-45cc-a98d-f52f977f5732 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:21.742816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-55bfcc1d-ee38-4f2c-ac19-037a6c925281 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f4b43c646c4aba88160ffeb98c6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7443a53a70743a09144270de0904832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:21.757068 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-55bfcc1d-ee38-4f2c-ac19-037a6c925281 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" status: 200 len: 1332 microversion: 2.1 time: 0.320284 Oct 10 23:18:21.773488 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 258/487] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:21 2022] GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 => generated 1332 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:21.783528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-77db7070-ebaf-4956-b7ae-61a20f5b4b02 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:21.785153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-77db7070-ebaf-4956-b7ae-61a20f5b4b02 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:21.792868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=8,nova_api:INSERT=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:21.794998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77db7070-ebaf-4956-b7ae-61a20f5b4b02 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:21.795928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77db7070-ebaf-4956-b7ae-61a20f5b4b02 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:21.796639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77db7070-ebaf-4956-b7ae-61a20f5b4b02 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:21.798030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77db7070-ebaf-4956-b7ae-61a20f5b4b02 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:21.798911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77db7070-ebaf-4956-b7ae-61a20f5b4b02 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:21.799497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77db7070-ebaf-4956-b7ae-61a20f5b4b02 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:21.916377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a828e03a-0152-45cc-a98d-f52f977f5732 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:21.924858 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a828e03a-0152-45cc-a98d-f52f977f5732 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/7907c918-8df3-44bc-94f5-4fde965de66f" status: 200 len: 1469 microversion: 2.1 time: 0.273628 Oct 10 23:18:21.925773 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 230/488] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:21 2022] GET /compute/v2.1/servers/7907c918-8df3-44bc-94f5-4fde965de66f => generated 1469 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:22.101800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-77db7070-ebaf-4956-b7ae-61a20f5b4b02 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:22.116675 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-77db7070-ebaf-4956-b7ae-61a20f5b4b02 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1312 microversion: 2.1 time: 0.346660 Oct 10 23:18:22.117525 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 259/489] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:21 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1312 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:22.128802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a6066054-d4d8-4ac0-8b8e-b7446fec9e5a tempest-FloatingIPDetailsTestJSON-383567993 tempest-FloatingIPDetailsTestJSON-383567993-project] Calling method '.version_select at 0x7f663027e9d0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:22.215467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f8ff8d34-6f8f-4c41-a2fb-f6afedb5f04a tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Calling method '.version_select at 0x7f663010cdc0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:22.219773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8ff8d34-6f8f-4c41-a2fb-f6afedb5f04a tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:22.220110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8ff8d34-6f8f-4c41-a2fb-f6afedb5f04a tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:22.220558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8ff8d34-6f8f-4c41-a2fb-f6afedb5f04a tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:22.236098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8ff8d34-6f8f-4c41-a2fb-f6afedb5f04a tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:22.236593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8ff8d34-6f8f-4c41-a2fb-f6afedb5f04a tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:22.237028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8ff8d34-6f8f-4c41-a2fb-f6afedb5f04a tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:22.276903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8ff8d34-6f8f-4c41-a2fb-f6afedb5f04a tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:22.277516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8ff8d34-6f8f-4c41-a2fb-f6afedb5f04a tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:22.277964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8ff8d34-6f8f-4c41-a2fb-f6afedb5f04a tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:22.291149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8ff8d34-6f8f-4c41-a2fb-f6afedb5f04a tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:22.291612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8ff8d34-6f8f-4c41-a2fb-f6afedb5f04a tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:22.292059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8ff8d34-6f8f-4c41-a2fb-f6afedb5f04a tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:22.324004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8ff8d34-6f8f-4c41-a2fb-f6afedb5f04a tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:22.324643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8ff8d34-6f8f-4c41-a2fb-f6afedb5f04a tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:22.325158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8ff8d34-6f8f-4c41-a2fb-f6afedb5f04a tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:22.359034 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f8ff8d34-6f8f-4c41-a2fb-f6afedb5f04a tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2152 microversion: 2.53 time: 0.430901 Oct 10 23:18:22.374542 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 231/490] 10.222.0.23 () {60 vars in 1243 bytes} [Mon Oct 10 23:18:21 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2152 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:18:22.383978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-062373d8-37a6-4004-b9ec-f72bd3741fb4 req-79acfbfb-d17a-4215-9a1a-52b89fe04ccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7", "tag": "9d1017db-e093-43c6-b9a1-81a16928b5cf"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:22.402491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-062373d8-37a6-4004-b9ec-f72bd3741fb4 req-79acfbfb-d17a-4215-9a1a-52b89fe04ccd service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:22.403299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-062373d8-37a6-4004-b9ec-f72bd3741fb4 req-79acfbfb-d17a-4215-9a1a-52b89fe04ccd service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:22.403804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-062373d8-37a6-4004-b9ec-f72bd3741fb4 req-79acfbfb-d17a-4215-9a1a-52b89fe04ccd service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:22.418296 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-062373d8-37a6-4004-b9ec-f72bd3741fb4 req-79acfbfb-d17a-4215-9a1a-52b89fe04ccd service nova] Creating event network-changed:9d1017db-e093-43c6-b9a1-81a16928b5cf for instance f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 on n-h1-860864-2 Oct 10 23:18:22.425273 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-062373d8-37a6-4004-b9ec-f72bd3741fb4 req-79acfbfb-d17a-4215-9a1a-52b89fe04ccd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048446 Oct 10 23:18:22.426451 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 232/491] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:22.433599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2e2b279e-cda8-4fc2-b8ba-1ce768b5e621 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:22.435509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2e2b279e-cda8-4fc2-b8ba-1ce768b5e621 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:22.443983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e2b279e-cda8-4fc2-b8ba-1ce768b5e621 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:22.444483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e2b279e-cda8-4fc2-b8ba-1ce768b5e621 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:22.444929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e2b279e-cda8-4fc2-b8ba-1ce768b5e621 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:22.449705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e2b279e-cda8-4fc2-b8ba-1ce768b5e621 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:22.450388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e2b279e-cda8-4fc2-b8ba-1ce768b5e621 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:22.450917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e2b279e-cda8-4fc2-b8ba-1ce768b5e621 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:22.457269 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a6066054-d4d8-4ac0-8b8e-b7446fec9e5a tempest-FloatingIPDetailsTestJSON-383567993 tempest-FloatingIPDetailsTestJSON-383567993-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/6bfe7194-14e3-481b-a0d0-1294ceb372ba" status: 200 len: 141 microversion: 2.1 time: 0.338004 Oct 10 23:18:22.457893 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 260/492] 10.222.0.23 () {58 vars in 1260 bytes} [Mon Oct 10 23:18:22 2022] GET /compute/v2.1/os-floating-ips/6bfe7194-14e3-481b-a0d0-1294ceb372ba => generated 141 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:22.463698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e17b74d3-fcd9-4ccd-b942-dac8b463c303 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:22.473879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e17b74d3-fcd9-4ccd-b942-dac8b463c303 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:22.475955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e17b74d3-fcd9-4ccd-b942-dac8b463c303 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Searching by: {'reservation_id': 'r-8h1z42za', 'deleted': False, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:18:22.493738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e17b74d3-fcd9-4ccd-b942-dac8b463c303 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:22.494512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e17b74d3-fcd9-4ccd-b942-dac8b463c303 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:22.495218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e17b74d3-fcd9-4ccd-b942-dac8b463c303 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:22.507583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e17b74d3-fcd9-4ccd-b942-dac8b463c303 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:22.508321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e17b74d3-fcd9-4ccd-b942-dac8b463c303 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:22.508782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e17b74d3-fcd9-4ccd-b942-dac8b463c303 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:22.647846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2e2b279e-cda8-4fc2-b8ba-1ce768b5e621 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:22.656582 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2e2b279e-cda8-4fc2-b8ba-1ce768b5e621 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1492 microversion: 2.1 time: 0.228803 Oct 10 23:18:22.657173 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 233/493] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:22 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1492 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:22.674928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-302dcc79-3586-4e5d-b6e1-6cf1603958fd tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Calling method '.version_select at 0x7f662bd861f0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:22.674928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-302dcc79-3586-4e5d-b6e1-6cf1603958fd tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:22.674928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-302dcc79-3586-4e5d-b6e1-6cf1603958fd tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:22.674928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-302dcc79-3586-4e5d-b6e1-6cf1603958fd tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:22.683613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-302dcc79-3586-4e5d-b6e1-6cf1603958fd tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:22.684134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-302dcc79-3586-4e5d-b6e1-6cf1603958fd tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:22.685086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-302dcc79-3586-4e5d-b6e1-6cf1603958fd tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:22.695380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:22.703391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.multi_cell_list [None req-e17b74d3-fcd9-4ccd-b942-dac8b463c303 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:18:22.712073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-302dcc79-3586-4e5d-b6e1-6cf1603958fd tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:22.712561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-302dcc79-3586-4e5d-b6e1-6cf1603958fd tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:22.713106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-302dcc79-3586-4e5d-b6e1-6cf1603958fd tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:22.723678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-302dcc79-3586-4e5d-b6e1-6cf1603958fd tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:22.724160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-302dcc79-3586-4e5d-b6e1-6cf1603958fd tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:22.724802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-302dcc79-3586-4e5d-b6e1-6cf1603958fd tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:22.752677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-302dcc79-3586-4e5d-b6e1-6cf1603958fd tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:22.752956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-302dcc79-3586-4e5d-b6e1-6cf1603958fd tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:22.753617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-302dcc79-3586-4e5d-b6e1-6cf1603958fd tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:22.760081 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-302dcc79-3586-4e5d-b6e1-6cf1603958fd tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 844 microversion: 2.53 time: 0.101843 Oct 10 23:18:22.760837 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 234/494] 10.222.0.23 () {60 vars in 1222 bytes} [Mon Oct 10 23:18:22 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 844 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:18:22.766415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-07fc38af-f797-4862-afe2-29d841b01e07 tempest-FloatingIPDetailsTestJSON-383567993 tempest-FloatingIPDetailsTestJSON-383567993-project] Calling method '.version_select at 0x7f662bd86b80>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:22.838347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e17b74d3-fcd9-4ccd-b942-dac8b463c303 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:22.846673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e17b74d3-fcd9-4ccd-b942-dac8b463c303 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:22.847160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e17b74d3-fcd9-4ccd-b942-dac8b463c303 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:22.847596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e17b74d3-fcd9-4ccd-b942-dac8b463c303 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:22.985049 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e17b74d3-fcd9-4ccd-b942-dac8b463c303 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?reservation_id=r-8h1z42za" status: 200 len: 2930 microversion: 2.1 time: 0.525844 Oct 10 23:18:22.985693 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 261/495] 10.222.0.23 () {58 vars in 1197 bytes} [Mon Oct 10 23:18:22 2022] GET /compute/v2.1/servers/detail?reservation_id=r-8h1z42za => generated 2930 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:23.219499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2d1a5188-dc2c-4771-bfef-de8ced1f7fdf tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:23.220147 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2d1a5188-dc2c-4771-bfef-de8ced1f7fdf tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:23.227958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d1a5188-dc2c-4771-bfef-de8ced1f7fdf tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:23.228554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d1a5188-dc2c-4771-bfef-de8ced1f7fdf tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:23.229092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d1a5188-dc2c-4771-bfef-de8ced1f7fdf tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:23.229927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d1a5188-dc2c-4771-bfef-de8ced1f7fdf tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:23.230378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d1a5188-dc2c-4771-bfef-de8ced1f7fdf tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:23.230799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d1a5188-dc2c-4771-bfef-de8ced1f7fdf tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:23.367746 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2d1a5188-dc2c-4771-bfef-de8ced1f7fdf tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1643 microversion: 2.1 time: 0.380680 Oct 10 23:18:23.369077 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 262/496] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:22 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1643 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:23.377277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-709cee39-bd90-406c-bde1-53d059d2e9ce tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Calling method '.version_select at 0x7f663018e430>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:23.381659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-709cee39-bd90-406c-bde1-53d059d2e9ce tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:23.382278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-709cee39-bd90-406c-bde1-53d059d2e9ce tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:23.382578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-709cee39-bd90-406c-bde1-53d059d2e9ce tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:23.390066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:23.402395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-709cee39-bd90-406c-bde1-53d059d2e9ce tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:23.402882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-709cee39-bd90-406c-bde1-53d059d2e9ce tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:23.403329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-709cee39-bd90-406c-bde1-53d059d2e9ce tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:23.411141 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-709cee39-bd90-406c-bde1-53d059d2e9ce tempest-HypervisorAdminV253TestBase-1804271492 tempest-HypervisorAdminV253TestBase-1804271492-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/388338f8-3845-41f9-af72-daf3ec297c2f" status: 200 len: 792 microversion: 2.53 time: 0.040934 Oct 10 23:18:23.411759 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 263/497] 10.222.0.23 () {60 vars in 1298 bytes} [Mon Oct 10 23:18:23 2022] GET /compute/v2.1/os-hypervisors/388338f8-3845-41f9-af72-daf3ec297c2f => generated 792 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:18:23.423364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-319f3fd3-70d0-4e3b-91e6-9c7c81d9d55e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:23.424258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-319f3fd3-70d0-4e3b-91e6-9c7c81d9d55e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:23.434090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-319f3fd3-70d0-4e3b-91e6-9c7c81d9d55e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:23.435370 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-319f3fd3-70d0-4e3b-91e6-9c7c81d9d55e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:23.436045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-319f3fd3-70d0-4e3b-91e6-9c7c81d9d55e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:23.436965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-319f3fd3-70d0-4e3b-91e6-9c7c81d9d55e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:23.437662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-319f3fd3-70d0-4e3b-91e6-9c7c81d9d55e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:23.438374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-319f3fd3-70d0-4e3b-91e6-9c7c81d9d55e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:23.612725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-319f3fd3-70d0-4e3b-91e6-9c7c81d9d55e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f4b43c646c4aba88160ffeb98c6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7443a53a70743a09144270de0904832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:23.620798 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-319f3fd3-70d0-4e3b-91e6-9c7c81d9d55e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" status: 200 len: 1332 microversion: 2.1 time: 0.207770 Oct 10 23:18:23.622264 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 264/498] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:23 2022] GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 => generated 1332 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:23.628376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-0fb1cb7c-de98-4659-9ecb-cf1a9d6307d9 req-74b3e04e-b6c0-4cf9-98d8-126fa6c33f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a45a7de2-2607-4f13-87e3-2c7e74785470", "name": "network-vif-plugged", "status": "completed", "tag": "fdbc7ece-ba7d-48ea-9d4a-166ef6293a46"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:23.640971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0fb1cb7c-de98-4659-9ecb-cf1a9d6307d9 req-74b3e04e-b6c0-4cf9-98d8-126fa6c33f9f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:23.641461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0fb1cb7c-de98-4659-9ecb-cf1a9d6307d9 req-74b3e04e-b6c0-4cf9-98d8-126fa6c33f9f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:23.642129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0fb1cb7c-de98-4659-9ecb-cf1a9d6307d9 req-74b3e04e-b6c0-4cf9-98d8-126fa6c33f9f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:23.655303 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-0fb1cb7c-de98-4659-9ecb-cf1a9d6307d9 req-74b3e04e-b6c0-4cf9-98d8-126fa6c33f9f service nova] Creating event network-vif-plugged:fdbc7ece-ba7d-48ea-9d4a-166ef6293a46 for instance a45a7de2-2607-4f13-87e3-2c7e74785470 on n-h2-860864-2 Oct 10 23:18:23.661873 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-0fb1cb7c-de98-4659-9ecb-cf1a9d6307d9 req-74b3e04e-b6c0-4cf9-98d8-126fa6c33f9f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038113 Oct 10 23:18:23.663019 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 265/499] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:23.670704 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a85db395-2679-4752-8f1e-e673796391a6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:23.712242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.compute.server_groups [None req-a85db395-2679-4752-8f1e-e673796391a6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Querying cell c35e3cac-0e4f-44cc-a53a-8910e1eecc88(cell1) for 2 instances {{(pid=120614) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 10 23:18:23.713128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a85db395-2679-4752-8f1e-e673796391a6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:23.713927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a85db395-2679-4752-8f1e-e673796391a6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:23.714369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a85db395-2679-4752-8f1e-e673796391a6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:23.750500 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a85db395-2679-4752-8f1e-e673796391a6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/a3002422-b16d-498d-8c8b-e67d1ef376e7" status: 200 len: 266 microversion: 2.1 time: 0.085941 Oct 10 23:18:23.751416 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 266/500] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 10 23:18:23 2022] GET /compute/v2.1/os-server-groups/a3002422-b16d-498d-8c8b-e67d1ef376e7 => generated 266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:23.757262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-63aaf99a-af52-4b9e-8a17-9ae3cebbbed7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:23.758308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-63aaf99a-af52-4b9e-8a17-9ae3cebbbed7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:23.766070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63aaf99a-af52-4b9e-8a17-9ae3cebbbed7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:23.766609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63aaf99a-af52-4b9e-8a17-9ae3cebbbed7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:23.767079 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63aaf99a-af52-4b9e-8a17-9ae3cebbbed7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:23.767962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63aaf99a-af52-4b9e-8a17-9ae3cebbbed7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:23.768412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63aaf99a-af52-4b9e-8a17-9ae3cebbbed7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:23.768998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63aaf99a-af52-4b9e-8a17-9ae3cebbbed7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:23.941259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-63aaf99a-af52-4b9e-8a17-9ae3cebbbed7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:23.951492 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-63aaf99a-af52-4b9e-8a17-9ae3cebbbed7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1312 microversion: 2.1 time: 0.198864 Oct 10 23:18:23.952083 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 267/501] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:23 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1312 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:23.958435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7c719e67-49b9-467a-b526-7136c64ca12e tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:23.959044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7c719e67-49b9-467a-b526-7136c64ca12e tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:23.965067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c719e67-49b9-467a-b526-7136c64ca12e tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:23.965957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c719e67-49b9-467a-b526-7136c64ca12e tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:23.967069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c719e67-49b9-467a-b526-7136c64ca12e tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:23.967931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c719e67-49b9-467a-b526-7136c64ca12e tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:23.968381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c719e67-49b9-467a-b526-7136c64ca12e tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:23.968961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c719e67-49b9-467a-b526-7136c64ca12e tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:24.093015 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-07fc38af-f797-4862-afe2-29d841b01e07 tempest-FloatingIPDetailsTestJSON-383567993 tempest-FloatingIPDetailsTestJSON-383567993-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/6bfe7194-14e3-481b-a0d0-1294ceb372ba" status: 202 len: 0 microversion: 2.1 time: 1.329968 Oct 10 23:18:24.097999 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 235/502] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 10 23:18:22 2022] DELETE /compute/v2.1/os-floating-ips/6bfe7194-14e3-481b-a0d0-1294ceb372ba => generated 0 bytes in 1332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:18:24.101556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-75d95fe2-6bd7-4e28-9df9-15906be4bccc tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:24.102277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-75d95fe2-6bd7-4e28-9df9-15906be4bccc tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] [instance: c783f55d-ea82-4d94-a4f6-77591d412a02] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:24.104280 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7c719e67-49b9-467a-b526-7136c64ca12e tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1643 microversion: 2.1 time: 0.151158 Oct 10 23:18:24.105913 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 268/503] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:23 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1643 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:24.111951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75d95fe2-6bd7-4e28-9df9-15906be4bccc tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:24.114555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75d95fe2-6bd7-4e28-9df9-15906be4bccc tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:24.115172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75d95fe2-6bd7-4e28-9df9-15906be4bccc tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:24.116803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75d95fe2-6bd7-4e28-9df9-15906be4bccc tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:24.117857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75d95fe2-6bd7-4e28-9df9-15906be4bccc tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:24.118504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75d95fe2-6bd7-4e28-9df9-15906be4bccc tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:24.304142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-66d288d9-5265-4211-b93a-a121995fd9fc tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:24.307632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66d288d9-5265-4211-b93a-a121995fd9fc tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:24.308113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66d288d9-5265-4211-b93a-a121995fd9fc tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:24.308548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66d288d9-5265-4211-b93a-a121995fd9fc tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:24.309265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66d288d9-5265-4211-b93a-a121995fd9fc tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:24.309811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66d288d9-5265-4211-b93a-a121995fd9fc tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:24.310240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66d288d9-5265-4211-b93a-a121995fd9fc tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:24.336933 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-66d288d9-5265-4211-b93a-a121995fd9fc tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.230850 Oct 10 23:18:24.337463 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 269/504] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:18:24 2022] GET /compute/v2.1/os-services => generated 944 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:24.342736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6bdf06a7-84f4-47d5-a3cf-1c89399bd921 tempest-FloatingIPDetailsTestJSON-383567993 tempest-FloatingIPDetailsTestJSON-383567993-project] Calling method '.version_select at 0x7f662bce0f70>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:24.555412 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6bdf06a7-84f4-47d5-a3cf-1c89399bd921 tempest-FloatingIPDetailsTestJSON-383567993 tempest-FloatingIPDetailsTestJSON-383567993-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.216874 Oct 10 23:18:24.556003 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 270/505] 10.222.0.23 () {58 vars in 1164 bytes} [Mon Oct 10 23:18:24 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:18:24.560521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7d0ab7f1-e2a7-4ed3-9a6e-bdfae211243b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:24.564572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d0ab7f1-e2a7-4ed3-9a6e-bdfae211243b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:24.565068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d0ab7f1-e2a7-4ed3-9a6e-bdfae211243b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:24.565533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d0ab7f1-e2a7-4ed3-9a6e-bdfae211243b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:24.566268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d0ab7f1-e2a7-4ed3-9a6e-bdfae211243b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:24.566719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d0ab7f1-e2a7-4ed3-9a6e-bdfae211243b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:24.567141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d0ab7f1-e2a7-4ed3-9a6e-bdfae211243b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:24.591028 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7d0ab7f1-e2a7-4ed3-9a6e-bdfae211243b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.033864 Oct 10 23:18:24.592447 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 271/506] 10.222.0.23 () {58 vars in 1176 bytes} [Mon Oct 10 23:18:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:24.596848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fb52fabc-eaae-4c22-8ad5-b2d14adb13a0 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:24.599034 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-75d95fe2-6bd7-4e28-9df9-15906be4bccc tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02" status: 200 len: 1619 microversion: 2.1 time: 0.502012 Oct 10 23:18:24.601142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb52fabc-eaae-4c22-8ad5-b2d14adb13a0 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:24.601649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb52fabc-eaae-4c22-8ad5-b2d14adb13a0 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:24.602242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb52fabc-eaae-4c22-8ad5-b2d14adb13a0 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:24.603129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb52fabc-eaae-4c22-8ad5-b2d14adb13a0 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:24.603755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb52fabc-eaae-4c22-8ad5-b2d14adb13a0 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:24.604348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb52fabc-eaae-4c22-8ad5-b2d14adb13a0 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:24.610956 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 236/507] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:24 2022] GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02 => generated 1619 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:24.628098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d9a13c89-99d5-4780-8986-630158a4b48a tempest-FloatingIPDetailsTestJSON-383567993 tempest-FloatingIPDetailsTestJSON-383567993-project] Calling method '.version_select at 0x7f662bd00c10>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:24.630894 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fb52fabc-eaae-4c22-8ad5-b2d14adb13a0 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-860864-2" status: 200 len: 578 microversion: 2.1 time: 0.037261 Oct 10 23:18:24.639661 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 272/508] 10.222.0.23 () {58 vars in 1172 bytes} [Mon Oct 10 23:18:24 2022] GET /compute/v2.1/os-services?host=n-d-860864-2 => generated 578 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:24.639661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c07c6ad0-f863-4cab-aa01-6aac5213fe30 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860864-2", "block_migration": true, "disk_over_commit": false}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:24.641071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c07c6ad0-f863-4cab-aa01-6aac5213fe30 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:24.647247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c07c6ad0-f863-4cab-aa01-6aac5213fe30 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:24.647762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c07c6ad0-f863-4cab-aa01-6aac5213fe30 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:24.648197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c07c6ad0-f863-4cab-aa01-6aac5213fe30 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:24.649117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c07c6ad0-f863-4cab-aa01-6aac5213fe30 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:24.649340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c07c6ad0-f863-4cab-aa01-6aac5213fe30 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:24.649788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c07c6ad0-f863-4cab-aa01-6aac5213fe30 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:24.735495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-c07c6ad0-f863-4cab-aa01-6aac5213fe30 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lazy-loading 'flavor' on Instance uuid 7a793bab-7cf8-422b-8158-6c1cd268eaac {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:18:24.833986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c07c6ad0-f863-4cab-aa01-6aac5213fe30 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Going to try to live migrate instance to n-h1-860864-2 {{(pid=120614) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 23:18:24.992969 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d9a13c89-99d5-4780-8986-630158a4b48a tempest-FloatingIPDetailsTestJSON-383567993 tempest-FloatingIPDetailsTestJSON-383567993-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.371367 Oct 10 23:18:24.998015 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 237/509] 10.222.0.23 () {58 vars in 1149 bytes} [Mon Oct 10 23:18:24 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:25.003200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-46471c12-623c-4c3f-8fbb-2b3089fbd84d tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:25.003980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-46471c12-623c-4c3f-8fbb-2b3089fbd84d tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] [instance: 7907c918-8df3-44bc-94f5-4fde965de66f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:25.010808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46471c12-623c-4c3f-8fbb-2b3089fbd84d tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:25.011463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46471c12-623c-4c3f-8fbb-2b3089fbd84d tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:25.011914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46471c12-623c-4c3f-8fbb-2b3089fbd84d tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:25.012747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46471c12-623c-4c3f-8fbb-2b3089fbd84d tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:25.013399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46471c12-623c-4c3f-8fbb-2b3089fbd84d tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:25.013999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46471c12-623c-4c3f-8fbb-2b3089fbd84d tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:25.304630 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-46471c12-623c-4c3f-8fbb-2b3089fbd84d tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/7907c918-8df3-44bc-94f5-4fde965de66f" status: 200 len: 1620 microversion: 2.1 time: 0.305524 Oct 10 23:18:25.307608 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 238/510] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:24 2022] GET /compute/v2.1/servers/7907c918-8df3-44bc-94f5-4fde965de66f => generated 1620 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:25.318350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ccd9e556-00ab-41d6-a0eb-17a80fe710c9 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:25.338434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccd9e556-00ab-41d6-a0eb-17a80fe710c9 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:25.340143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccd9e556-00ab-41d6-a0eb-17a80fe710c9 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:25.342145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccd9e556-00ab-41d6-a0eb-17a80fe710c9 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:25.345484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccd9e556-00ab-41d6-a0eb-17a80fe710c9 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:25.350666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccd9e556-00ab-41d6-a0eb-17a80fe710c9 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:25.355476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccd9e556-00ab-41d6-a0eb-17a80fe710c9 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:25.404353 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ccd9e556-00ab-41d6-a0eb-17a80fe710c9 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.094428 Oct 10 23:18:25.406300 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 239/511] 10.222.0.23 () {58 vars in 1176 bytes} [Mon Oct 10 23:18:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:25.412080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e3828e34-3f5a-4173-ae5a-f2a2c29eb823 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:25.413022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e3828e34-3f5a-4173-ae5a-f2a2c29eb823 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:25.421079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3828e34-3f5a-4173-ae5a-f2a2c29eb823 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:25.421612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3828e34-3f5a-4173-ae5a-f2a2c29eb823 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:25.422051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3828e34-3f5a-4173-ae5a-f2a2c29eb823 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:25.423057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3828e34-3f5a-4173-ae5a-f2a2c29eb823 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:25.423516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3828e34-3f5a-4173-ae5a-f2a2c29eb823 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:25.424031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3828e34-3f5a-4173-ae5a-f2a2c29eb823 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:25.660861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e3828e34-3f5a-4173-ae5a-f2a2c29eb823 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f4b43c646c4aba88160ffeb98c6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7443a53a70743a09144270de0904832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:25.670002 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e3828e34-3f5a-4173-ae5a-f2a2c29eb823 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" status: 200 len: 1332 microversion: 2.1 time: 0.261393 Oct 10 23:18:25.675135 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 240/512] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:25 2022] GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 => generated 1332 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:25.681499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-52925b0d-5192-4e15-bd22-4c5ad4147ac2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:25.682318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-52925b0d-5192-4e15-bd22-4c5ad4147ac2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:25.688541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52925b0d-5192-4e15-bd22-4c5ad4147ac2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:25.689062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52925b0d-5192-4e15-bd22-4c5ad4147ac2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:25.689621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52925b0d-5192-4e15-bd22-4c5ad4147ac2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:25.690341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52925b0d-5192-4e15-bd22-4c5ad4147ac2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:25.690955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52925b0d-5192-4e15-bd22-4c5ad4147ac2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:25.691376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52925b0d-5192-4e15-bd22-4c5ad4147ac2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:25.994944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-52925b0d-5192-4e15-bd22-4c5ad4147ac2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:26.003840 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-52925b0d-5192-4e15-bd22-4c5ad4147ac2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1460 microversion: 2.1 time: 0.327463 Oct 10 23:18:26.004717 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 241/513] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:25 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1460 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:26.028868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3e6865af-4f1a-460e-8a97-2d1ac38519ad tempest-FloatingIPDetailsTestJSON-383567993 tempest-FloatingIPDetailsTestJSON-383567993-project] Calling method '.version_select at 0x7f662bd93160>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:26.860866 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3e6865af-4f1a-460e-8a97-2d1ac38519ad tempest-FloatingIPDetailsTestJSON-383567993 tempest-FloatingIPDetailsTestJSON-383567993-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/ad241c5e-2ff1-4437-861a-4abe3c7e6584" status: 202 len: 0 microversion: 2.1 time: 0.841513 Oct 10 23:18:26.861441 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 242/514] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 10 23:18:26 2022] DELETE /compute/v2.1/os-floating-ips/ad241c5e-2ff1-4437-861a-4abe3c7e6584 => generated 0 bytes in 843 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:18:26.868932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-420fec38-3b4a-4138-92f4-4485ba59fbd2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Action: 'create', calling method: .version_select at 0x7f662bdf6670>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2041019517", "policies": ["anti-affinity"]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:26.878047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:26.889598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-420fec38-3b4a-4138-92f4-4485ba59fbd2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_groups'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:18:26.894946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-420fec38-3b4a-4138-92f4-4485ba59fbd2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for user 310196e1663a4f7ca12e1fc53b0278ba and project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_groups'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:18:26.942940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-420fec38-3b4a-4138-92f4-4485ba59fbd2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_groups'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:18:26.949908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-420fec38-3b4a-4138-92f4-4485ba59fbd2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for user 310196e1663a4f7ca12e1fc53b0278ba and project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_groups'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:18:26.964938 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-420fec38-3b4a-4138-92f4-4485ba59fbd2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.099553 Oct 10 23:18:26.965681 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 243/515] 10.222.0.23 () {60 vars in 1174 bytes} [Mon Oct 10 23:18:26 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:26.974799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5bc18eb8-1fa4-454d-ba8a-300db27905a2 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:26.978614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bc18eb8-1fa4-454d-ba8a-300db27905a2 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:26.979097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bc18eb8-1fa4-454d-ba8a-300db27905a2 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:26.979606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bc18eb8-1fa4-454d-ba8a-300db27905a2 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:26.980339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bc18eb8-1fa4-454d-ba8a-300db27905a2 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:26.980790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bc18eb8-1fa4-454d-ba8a-300db27905a2 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:26.981528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bc18eb8-1fa4-454d-ba8a-300db27905a2 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:27.007831 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5bc18eb8-1fa4-454d-ba8a-300db27905a2 tempest-ServicesAdminTestJSON-1799510601 tempest-ServicesAdminTestJSON-1799510601-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.037070 Oct 10 23:18:27.008933 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 244/516] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:18:26 2022] GET /compute/v2.1/os-services => generated 944 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:27.366371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-569f00f1-4144-4ff6-82bb-e38e143c4756 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:27.366995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-569f00f1-4144-4ff6-82bb-e38e143c4756 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:27.374834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-569f00f1-4144-4ff6-82bb-e38e143c4756 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:27.375595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-569f00f1-4144-4ff6-82bb-e38e143c4756 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:27.376201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-569f00f1-4144-4ff6-82bb-e38e143c4756 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:27.377087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-569f00f1-4144-4ff6-82bb-e38e143c4756 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:27.377948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-569f00f1-4144-4ff6-82bb-e38e143c4756 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:27.378537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-569f00f1-4144-4ff6-82bb-e38e143c4756 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:27.504714 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c07c6ad0-f863-4cab-aa01-6aac5213fe30 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac/action" status: 202 len: 0 microversion: 2.1 time: 2.871728 Oct 10 23:18:27.506573 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 273/517] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:18:24 2022] POST /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac/action => generated 0 bytes in 2874 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:18:27.512424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-beac92fd-6c16-4b05-9b95-977faa28ce7e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:27.514389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-beac92fd-6c16-4b05-9b95-977faa28ce7e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:27.527695 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-beac92fd-6c16-4b05-9b95-977faa28ce7e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:27.528882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-beac92fd-6c16-4b05-9b95-977faa28ce7e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:27.529794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-beac92fd-6c16-4b05-9b95-977faa28ce7e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:27.530730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-beac92fd-6c16-4b05-9b95-977faa28ce7e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:27.532102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-beac92fd-6c16-4b05-9b95-977faa28ce7e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:27.532920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-beac92fd-6c16-4b05-9b95-977faa28ce7e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:27.657294 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-569f00f1-4144-4ff6-82bb-e38e143c4756 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1611 microversion: 2.1 time: 0.647131 Oct 10 23:18:27.661265 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 245/518] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:27 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1611 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:27.666010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e0423070-4a1f-4cef-acdf-1dc8d2d85b76 tempest-FloatingIPDetailsTestJSON-383567993 tempest-FloatingIPDetailsTestJSON-383567993-project] Calling method '.version_select at 0x7f662bde85e0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:27.811863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-beac92fd-6c16-4b05-9b95-977faa28ce7e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f4b43c646c4aba88160ffeb98c6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7443a53a70743a09144270de0904832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:27.827306 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-beac92fd-6c16-4b05-9b95-977faa28ce7e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" status: 200 len: 1332 microversion: 2.1 time: 0.319529 Oct 10 23:18:27.828481 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 274/519] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:27 2022] GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 => generated 1332 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:27.834962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-952890507", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "e5c534fa-95d5-4180-8bf7-c27512418476"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:27.930292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] validate_networks() for None {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:18:28.163614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:18:28.164036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:18:28.164515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:18:28.164931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:18:28.165332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:18:28.180821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:28.181302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:28.181846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:28.182525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:28.182991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:28.183413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:28.202304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:18:28.207635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for user 310196e1663a4f7ca12e1fc53b0278ba and project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:18:28.220307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Going to run 2 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:18:28.223167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: db1b49d1-08d6-4cb1-a27d-63944f113ea7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:18:28.265187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120614) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 10 23:18:28.285596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_group_members'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:18:28.291315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for user 310196e1663a4f7ca12e1fc53b0278ba and project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_group_members'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:18:28.351484 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_group_members'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:18:28.361361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for user 310196e1663a4f7ca12e1fc53b0278ba and project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_group_members'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:18:28.392389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: bd8c16ec-655a-451f-959f-62685aedc8af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=db1b49d1-08d6-4cb1-a27d-63944f113ea7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:18:28.464145 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_group_members'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:18:28.473693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for user 310196e1663a4f7ca12e1fc53b0278ba and project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_group_members'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:18:28.494651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:28.525449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_group_members'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:18:28.536461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for user 310196e1663a4f7ca12e1fc53b0278ba and project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'server_group_members'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:18:28.579439 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-47887e58-b697-4eb6-8732-d7ffd66a71a2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.749663 Oct 10 23:18:28.581473 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 275/520] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:18:27 2022] POST /compute/v2.1/servers => generated 32 bytes in 752 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 10 23:18:28.587472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c2fd48e9-1446-4da0-839e-ab37ea44ef5a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:28.588503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c2fd48e9-1446-4da0-839e-ab37ea44ef5a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:28.597551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2fd48e9-1446-4da0-839e-ab37ea44ef5a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:28.598683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2fd48e9-1446-4da0-839e-ab37ea44ef5a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:28.600362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2fd48e9-1446-4da0-839e-ab37ea44ef5a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:28.601468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2fd48e9-1446-4da0-839e-ab37ea44ef5a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:28.603026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2fd48e9-1446-4da0-839e-ab37ea44ef5a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:28.603787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2fd48e9-1446-4da0-839e-ab37ea44ef5a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:28.773035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c2fd48e9-1446-4da0-839e-ab37ea44ef5a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:28.785283 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c2fd48e9-1446-4da0-839e-ab37ea44ef5a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1502 microversion: 2.1 time: 0.202139 Oct 10 23:18:28.788352 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 276/521] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:28 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1502 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:28.796287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-161d5175-c9f9-4eda-8f91-2561def49a92 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:28.797217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-161d5175-c9f9-4eda-8f91-2561def49a92 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:28.805945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-161d5175-c9f9-4eda-8f91-2561def49a92 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:28.806796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-161d5175-c9f9-4eda-8f91-2561def49a92 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:28.807418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-161d5175-c9f9-4eda-8f91-2561def49a92 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:28.808323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-161d5175-c9f9-4eda-8f91-2561def49a92 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:28.808992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-161d5175-c9f9-4eda-8f91-2561def49a92 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:28.812396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-161d5175-c9f9-4eda-8f91-2561def49a92 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:28.917464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-161d5175-c9f9-4eda-8f91-2561def49a92 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ddd1b00fecb941ae8a0c5d0e3fc1ac51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338d6a067e5c4165bdc5f7ea021833ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:28.917889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-161d5175-c9f9-4eda-8f91-2561def49a92 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] flavor_id is None. Assuming migration. {{(pid=120614) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 10 23:18:28.918420 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-161d5175-c9f9-4eda-8f91-2561def49a92 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120614) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 10 23:18:29.115988 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-161d5175-c9f9-4eda-8f91-2561def49a92 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470/action" status: 202 len: 0 microversion: 2.1 time: 0.326300 Oct 10 23:18:29.116635 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 277/522] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:18:28 2022] POST /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:18:29.517917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-94129e46-8f5e-4186-aa15-2b2c167f2a43 tempest-InstanceUsageAuditLogTestJSON-1098073472 tempest-InstanceUsageAuditLogTestJSON-1098073472-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:29.570509 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e0423070-4a1f-4cef-acdf-1dc8d2d85b76 tempest-FloatingIPDetailsTestJSON-383567993 tempest-FloatingIPDetailsTestJSON-383567993-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/7926c275-a573-4f2d-be72-57df958286a9" status: 202 len: 0 microversion: 2.1 time: 1.908108 Oct 10 23:18:29.574950 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 246/523] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 10 23:18:27 2022] DELETE /compute/v2.1/os-floating-ips/7926c275-a573-4f2d-be72-57df958286a9 => generated 0 bytes in 1913 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:18:29.581630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f3aba581-2a7f-4bd9-ae07-2fef0bc7d424 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:29.586898 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-94129e46-8f5e-4186-aa15-2b2c167f2a43 tempest-InstanceUsageAuditLogTestJSON-1098073472 tempest-InstanceUsageAuditLogTestJSON-1098073472-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-10 23:18:27" status: 200 len: 318 microversion: 2.1 time: 0.468832 Oct 10 23:18:29.588491 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 278/524] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 10 23:18:29 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-10%2023%3A18%3A27 => generated 318 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:29.592502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f3aba581-2a7f-4bd9-ae07-2fef0bc7d424 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:29.593481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f3aba581-2a7f-4bd9-ae07-2fef0bc7d424 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Searching by: {'deleted': False, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed'} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:18:29.603495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c53ac574-dfb9-40e3-8007-969e51b40dbd tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:29.604697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c53ac574-dfb9-40e3-8007-969e51b40dbd tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:29.615441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c53ac574-dfb9-40e3-8007-969e51b40dbd tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:29.618353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c53ac574-dfb9-40e3-8007-969e51b40dbd tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:29.619097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c53ac574-dfb9-40e3-8007-969e51b40dbd tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:29.620925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c53ac574-dfb9-40e3-8007-969e51b40dbd tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:29.622690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c53ac574-dfb9-40e3-8007-969e51b40dbd tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:29.623406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c53ac574-dfb9-40e3-8007-969e51b40dbd tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:29.646996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3aba581-2a7f-4bd9-ae07-2fef0bc7d424 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:29.647825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3aba581-2a7f-4bd9-ae07-2fef0bc7d424 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:29.649182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3aba581-2a7f-4bd9-ae07-2fef0bc7d424 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:29.650467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3aba581-2a7f-4bd9-ae07-2fef0bc7d424 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:29.651271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3aba581-2a7f-4bd9-ae07-2fef0bc7d424 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:29.654287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3aba581-2a7f-4bd9-ae07-2fef0bc7d424 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:29.703010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.multi_cell_list [None req-f3aba581-2a7f-4bd9-ae07-2fef0bc7d424 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Listed batch of 5 results from cell out of 998 limit. Returned 5 total so far. {{(pid=120613) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:18:29.739779 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f3aba581-2a7f-4bd9-ae07-2fef0bc7d424 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.162804 Oct 10 23:18:29.740879 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 247/525] 10.222.0.23 () {58 vars in 1125 bytes} [Mon Oct 10 23:18:29 2022] GET /compute/v2.1/servers => generated 1664 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:29.748152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b25dc3f8-57f8-4f28-ad39-3405cc2e3ee9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:29.749123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b25dc3f8-57f8-4f28-ad39-3405cc2e3ee9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:29.756464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b25dc3f8-57f8-4f28-ad39-3405cc2e3ee9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:29.756952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b25dc3f8-57f8-4f28-ad39-3405cc2e3ee9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:29.757583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b25dc3f8-57f8-4f28-ad39-3405cc2e3ee9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:29.758457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b25dc3f8-57f8-4f28-ad39-3405cc2e3ee9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:29.759237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b25dc3f8-57f8-4f28-ad39-3405cc2e3ee9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:29.759816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b25dc3f8-57f8-4f28-ad39-3405cc2e3ee9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:29.993779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c53ac574-dfb9-40e3-8007-969e51b40dbd tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f4b43c646c4aba88160ffeb98c6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7443a53a70743a09144270de0904832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:30.007762 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c53ac574-dfb9-40e3-8007-969e51b40dbd tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" status: 200 len: 1332 microversion: 2.1 time: 0.416303 Oct 10 23:18:30.008503 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 279/526] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:29 2022] GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 => generated 1332 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:30.035381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b5d12333-07cf-4fc4-9d9f-b3da3fec1f89 tempest-FloatingIPDetailsTestJSON-383567993 tempest-FloatingIPDetailsTestJSON-383567993-project] Calling method '.version_select at 0x7f662bc74ca0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:30.038418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b25dc3f8-57f8-4f28-ad39-3405cc2e3ee9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:30.055799 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b25dc3f8-57f8-4f28-ad39-3405cc2e3ee9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1469 microversion: 2.1 time: 0.306661 Oct 10 23:18:30.073825 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 248/527] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:29 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1469 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:30.090218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c289771c-374c-4ed4-b6df-17b83f9f0997 tempest-InstanceUsageAuditLogTestJSON-1098073472 tempest-InstanceUsageAuditLogTestJSON-1098073472-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:30.155364 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c289771c-374c-4ed4-b6df-17b83f9f0997 tempest-InstanceUsageAuditLogTestJSON-1098073472 tempest-InstanceUsageAuditLogTestJSON-1098073472-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.088431 Oct 10 23:18:30.155856 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 249/528] 10.222.0.23 () {58 vars in 1185 bytes} [Mon Oct 10 23:18:30 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:30.176195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cba9b8e6-eccc-475b-bd97-6ddcef1feef7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:30.178944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cba9b8e6-eccc-475b-bd97-6ddcef1feef7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: bd8c16ec-655a-451f-959f-62685aedc8af] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:30.195863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cba9b8e6-eccc-475b-bd97-6ddcef1feef7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:30.197152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cba9b8e6-eccc-475b-bd97-6ddcef1feef7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:30.197911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cba9b8e6-eccc-475b-bd97-6ddcef1feef7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:30.199351 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cba9b8e6-eccc-475b-bd97-6ddcef1feef7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:30.200211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cba9b8e6-eccc-475b-bd97-6ddcef1feef7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:30.203207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cba9b8e6-eccc-475b-bd97-6ddcef1feef7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:30.431593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cba9b8e6-eccc-475b-bd97-6ddcef1feef7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:30.443844 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cba9b8e6-eccc-475b-bd97-6ddcef1feef7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af" status: 200 len: 1214 microversion: 2.1 time: 0.282747 Oct 10 23:18:30.445311 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 250/529] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:30 2022] GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af => generated 1214 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:30.450973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1e63bb65-93fb-46a5-9021-608cb43a8dbd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:30.451998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1e63bb65-93fb-46a5-9021-608cb43a8dbd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:30.460730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e63bb65-93fb-46a5-9021-608cb43a8dbd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:30.461588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e63bb65-93fb-46a5-9021-608cb43a8dbd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:30.463351 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e63bb65-93fb-46a5-9021-608cb43a8dbd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:30.464688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e63bb65-93fb-46a5-9021-608cb43a8dbd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:30.465836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e63bb65-93fb-46a5-9021-608cb43a8dbd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:30.467495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e63bb65-93fb-46a5-9021-608cb43a8dbd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:30.914565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1e63bb65-93fb-46a5-9021-608cb43a8dbd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:30.940534 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1e63bb65-93fb-46a5-9021-608cb43a8dbd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1502 microversion: 2.1 time: 0.493918 Oct 10 23:18:30.945220 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 251/530] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:30 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1502 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:30.957144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-b40295d0-714b-4412-a4eb-f572e7e156f6 req-59716e3f-5f84-4242-844f-3532131af363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a793bab-7cf8-422b-8158-6c1cd268eaac", "name": "network-vif-unplugged", "status": "completed", "tag": "69ca134e-b82a-4bc3-b55d-ed4eed16ae51"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:30.982131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b40295d0-714b-4412-a4eb-f572e7e156f6 req-59716e3f-5f84-4242-844f-3532131af363 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:30.982131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b40295d0-714b-4412-a4eb-f572e7e156f6 req-59716e3f-5f84-4242-844f-3532131af363 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:30.986136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b40295d0-714b-4412-a4eb-f572e7e156f6 req-59716e3f-5f84-4242-844f-3532131af363 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:31.016182 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-b40295d0-714b-4412-a4eb-f572e7e156f6 req-59716e3f-5f84-4242-844f-3532131af363 service nova] Creating event network-vif-unplugged:69ca134e-b82a-4bc3-b55d-ed4eed16ae51 for instance 7a793bab-7cf8-422b-8158-6c1cd268eaac on n-h2-860864-2 Oct 10 23:18:31.031063 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-b40295d0-714b-4412-a4eb-f572e7e156f6 req-59716e3f-5f84-4242-844f-3532131af363 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082198 Oct 10 23:18:31.033025 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 252/531] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:31.046379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-e698b433-0666-4641-9b5b-396f1833ac5a req-689c25d4-4908-4764-9990-cbb7dd5f0b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7", "name": "network-vif-plugged", "status": "completed", "tag": "9d1017db-e093-43c6-b9a1-81a16928b5cf"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:31.078787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e698b433-0666-4641-9b5b-396f1833ac5a req-689c25d4-4908-4764-9990-cbb7dd5f0b19 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:31.085507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e698b433-0666-4641-9b5b-396f1833ac5a req-689c25d4-4908-4764-9990-cbb7dd5f0b19 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:31.087124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e698b433-0666-4641-9b5b-396f1833ac5a req-689c25d4-4908-4764-9990-cbb7dd5f0b19 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:31.132192 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-e698b433-0666-4641-9b5b-396f1833ac5a req-689c25d4-4908-4764-9990-cbb7dd5f0b19 service nova] Creating event network-vif-plugged:9d1017db-e093-43c6-b9a1-81a16928b5cf for instance f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 on n-h1-860864-2 Oct 10 23:18:31.146187 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-e698b433-0666-4641-9b5b-396f1833ac5a req-689c25d4-4908-4764-9990-cbb7dd5f0b19 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107506 Oct 10 23:18:31.182173 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 253/532] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:31.210121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5d4b2a04-4698-4102-9272-606e0432028e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:31.211577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5d4b2a04-4698-4102-9272-606e0432028e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:31.249481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d4b2a04-4698-4102-9272-606e0432028e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:31.253769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d4b2a04-4698-4102-9272-606e0432028e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:31.254769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d4b2a04-4698-4102-9272-606e0432028e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:31.256414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d4b2a04-4698-4102-9272-606e0432028e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:31.260997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d4b2a04-4698-4102-9272-606e0432028e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:31.261913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d4b2a04-4698-4102-9272-606e0432028e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:31.634630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5d4b2a04-4698-4102-9272-606e0432028e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f4b43c646c4aba88160ffeb98c6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7443a53a70743a09144270de0904832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:31.648101 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5d4b2a04-4698-4102-9272-606e0432028e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" status: 200 len: 1332 microversion: 2.1 time: 0.460584 Oct 10 23:18:31.652632 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 254/533] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:31 2022] GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 => generated 1332 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:31.657558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3ccc76ce-dcf9-4474-b245-681bdd08d19f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:31.674311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3ccc76ce-dcf9-4474-b245-681bdd08d19f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:31.690824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ccc76ce-dcf9-4474-b245-681bdd08d19f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:31.696919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ccc76ce-dcf9-4474-b245-681bdd08d19f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:31.697574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ccc76ce-dcf9-4474-b245-681bdd08d19f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:31.702903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ccc76ce-dcf9-4474-b245-681bdd08d19f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:31.703607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ccc76ce-dcf9-4474-b245-681bdd08d19f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:31.704277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ccc76ce-dcf9-4474-b245-681bdd08d19f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:31.921295 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b5d12333-07cf-4fc4-9d9f-b3da3fec1f89 tempest-FloatingIPDetailsTestJSON-383567993 tempest-FloatingIPDetailsTestJSON-383567993-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/02f0103b-d27d-49dd-a750-8c043ab88e19" status: 202 len: 0 microversion: 2.1 time: 1.893233 Oct 10 23:18:31.921906 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 280/534] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 10 23:18:30 2022] DELETE /compute/v2.1/os-floating-ips/02f0103b-d27d-49dd-a750-8c043ab88e19 => generated 0 bytes in 1894 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:18:31.929080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-95cf58e4-20c1-4582-bee5-bee982b7a895 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:31.929734 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-95cf58e4-20c1-4582-bee5-bee982b7a895 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: bd8c16ec-655a-451f-959f-62685aedc8af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:31.938140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95cf58e4-20c1-4582-bee5-bee982b7a895 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:31.938857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95cf58e4-20c1-4582-bee5-bee982b7a895 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:31.939284 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95cf58e4-20c1-4582-bee5-bee982b7a895 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:31.940149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95cf58e4-20c1-4582-bee5-bee982b7a895 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:31.940750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95cf58e4-20c1-4582-bee5-bee982b7a895 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:31.941405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95cf58e4-20c1-4582-bee5-bee982b7a895 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:32.033606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-95cf58e4-20c1-4582-bee5-bee982b7a895 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:32.045641 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-95cf58e4-20c1-4582-bee5-bee982b7a895 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af" status: 200 len: 1276 microversion: 2.1 time: 0.121015 Oct 10 23:18:32.046943 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 281/535] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:31 2022] GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af => generated 1276 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:32.052591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7bb8a8cb-5f87-4b25-a5be-a1af58012c90 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:32.053482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7bb8a8cb-5f87-4b25-a5be-a1af58012c90 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:32.061694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bb8a8cb-5f87-4b25-a5be-a1af58012c90 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:32.062534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bb8a8cb-5f87-4b25-a5be-a1af58012c90 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:32.063124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bb8a8cb-5f87-4b25-a5be-a1af58012c90 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:32.063259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3ccc76ce-dcf9-4474-b245-681bdd08d19f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:32.064053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bb8a8cb-5f87-4b25-a5be-a1af58012c90 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:32.064669 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bb8a8cb-5f87-4b25-a5be-a1af58012c90 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:32.065100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bb8a8cb-5f87-4b25-a5be-a1af58012c90 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:32.071748 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3ccc76ce-dcf9-4474-b245-681bdd08d19f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1469 microversion: 2.1 time: 0.417822 Oct 10 23:18:32.086099 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 255/536] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:31 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1469 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:32.414693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7bb8a8cb-5f87-4b25-a5be-a1af58012c90 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:32.423785 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7bb8a8cb-5f87-4b25-a5be-a1af58012c90 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1502 microversion: 2.1 time: 0.375530 Oct 10 23:18:32.431153 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 282/537] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:32 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1502 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:32.570966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e12cc29e-ced1-4707-aede-a68b78e15488 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1721705522", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:32.653843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-e12cc29e-ced1-4707-aede-a68b78e15488 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] validate_networks() for None {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:18:32.682474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-14e6e300-2e4f-4283-a37d-db57571ffd9d tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:32.686419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-14e6e300-2e4f-4283-a37d-db57571ffd9d tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:32.698450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14e6e300-2e4f-4283-a37d-db57571ffd9d tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:32.699565 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14e6e300-2e4f-4283-a37d-db57571ffd9d tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:32.701710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14e6e300-2e4f-4283-a37d-db57571ffd9d tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:32.707455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14e6e300-2e4f-4283-a37d-db57571ffd9d tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:32.708462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14e6e300-2e4f-4283-a37d-db57571ffd9d tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:32.709326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14e6e300-2e4f-4283-a37d-db57571ffd9d tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:32.743236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:33.051002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-14e6e300-2e4f-4283-a37d-db57571ffd9d tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f4b43c646c4aba88160ffeb98c6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7443a53a70743a09144270de0904832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:33.065689 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-14e6e300-2e4f-4283-a37d-db57571ffd9d tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" status: 200 len: 1332 microversion: 2.1 time: 0.389640 Oct 10 23:18:33.066304 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 283/538] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:32 2022] GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 => generated 1332 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:33.087415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1eeff132-a440-4b42-8051-52eea447c75c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:33.088300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1eeff132-a440-4b42-8051-52eea447c75c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: bd8c16ec-655a-451f-959f-62685aedc8af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:33.097079 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1eeff132-a440-4b42-8051-52eea447c75c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:33.098023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1eeff132-a440-4b42-8051-52eea447c75c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:33.098609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1eeff132-a440-4b42-8051-52eea447c75c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:33.099464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1eeff132-a440-4b42-8051-52eea447c75c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:33.100070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1eeff132-a440-4b42-8051-52eea447c75c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:33.100640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1eeff132-a440-4b42-8051-52eea447c75c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:33.461243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1eeff132-a440-4b42-8051-52eea447c75c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:33.471688 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1eeff132-a440-4b42-8051-52eea447c75c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af" status: 200 len: 1318 microversion: 2.1 time: 0.388953 Oct 10 23:18:33.472519 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 284/539] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:33 2022] GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:33.477644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3fb171a5-a110-4e7a-a30c-530b5c29aec2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:33.478263 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3fb171a5-a110-4e7a-a30c-530b5c29aec2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:33.485359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fb171a5-a110-4e7a-a30c-530b5c29aec2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:33.485850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fb171a5-a110-4e7a-a30c-530b5c29aec2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:33.486285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fb171a5-a110-4e7a-a30c-530b5c29aec2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:33.486984 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fb171a5-a110-4e7a-a30c-530b5c29aec2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:33.487435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fb171a5-a110-4e7a-a30c-530b5c29aec2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:33.487854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fb171a5-a110-4e7a-a30c-530b5c29aec2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:33.637672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e12cc29e-ced1-4707-aede-a68b78e15488 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:18:33.638950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e12cc29e-ced1-4707-aede-a68b78e15488 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:18:33.640476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e12cc29e-ced1-4707-aede-a68b78e15488 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:18:33.641138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e12cc29e-ced1-4707-aede-a68b78e15488 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:18:33.641736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e12cc29e-ced1-4707-aede-a68b78e15488 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:18:33.656730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e12cc29e-ced1-4707-aede-a68b78e15488 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:33.657550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e12cc29e-ced1-4707-aede-a68b78e15488 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:33.657990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e12cc29e-ced1-4707-aede-a68b78e15488 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:33.659010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e12cc29e-ced1-4707-aede-a68b78e15488 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:33.659821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e12cc29e-ced1-4707-aede-a68b78e15488 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:33.660413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e12cc29e-ced1-4707-aede-a68b78e15488 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:33.684252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-e12cc29e-ced1-4707-aede-a68b78e15488 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Getting quotas for project b7c0dc0392fb4b438c2cae7dda5bb12b. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:18:33.693972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-e12cc29e-ced1-4707-aede-a68b78e15488 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Getting quotas for user 908cc3a0520f4898a016e0a7425698da and project b7c0dc0392fb4b438c2cae7dda5bb12b. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:18:33.711548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e12cc29e-ced1-4707-aede-a68b78e15488 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:18:33.715707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3fb171a5-a110-4e7a-a30c-530b5c29aec2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:33.720155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e12cc29e-ced1-4707-aede-a68b78e15488 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] [instance: c10a472b-a85b-41c5-9c6c-116d7c364af7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:18:33.724817 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3fb171a5-a110-4e7a-a30c-530b5c29aec2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1469 microversion: 2.1 time: 0.251424 Oct 10 23:18:33.737403 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 285/540] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:33 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1469 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:33.748407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-9bae8dee-56a2-4999-b74a-701d6b0d6e8b req-645019f7-a387-4db3-9e5f-963c4a7d38d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a793bab-7cf8-422b-8158-6c1cd268eaac", "tag": "69ca134e-b82a-4bc3-b55d-ed4eed16ae51"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:33.761448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9bae8dee-56a2-4999-b74a-701d6b0d6e8b req-645019f7-a387-4db3-9e5f-963c4a7d38d9 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:33.762137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9bae8dee-56a2-4999-b74a-701d6b0d6e8b req-645019f7-a387-4db3-9e5f-963c4a7d38d9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:33.764350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9bae8dee-56a2-4999-b74a-701d6b0d6e8b req-645019f7-a387-4db3-9e5f-963c4a7d38d9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:33.777746 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-9bae8dee-56a2-4999-b74a-701d6b0d6e8b req-645019f7-a387-4db3-9e5f-963c4a7d38d9 service nova] Creating event network-changed:69ca134e-b82a-4bc3-b55d-ed4eed16ae51 for instance 7a793bab-7cf8-422b-8158-6c1cd268eaac on n-h2-860864-2 Oct 10 23:18:33.786875 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e12cc29e-ced1-4707-aede-a68b78e15488 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.395013 Oct 10 23:18:33.795971 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 256/541] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:18:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 23:18:33.800988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c62baf8a-5649-4343-90b3-6cb91aee8068 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:33.801365 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-9bae8dee-56a2-4999-b74a-701d6b0d6e8b req-645019f7-a387-4db3-9e5f-963c4a7d38d9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044411 Oct 10 23:18:33.801684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c62baf8a-5649-4343-90b3-6cb91aee8068 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:33.804478 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 286/542] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:33.808302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c62baf8a-5649-4343-90b3-6cb91aee8068 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:33.808890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c62baf8a-5649-4343-90b3-6cb91aee8068 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:33.809327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c62baf8a-5649-4343-90b3-6cb91aee8068 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:33.811098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c62baf8a-5649-4343-90b3-6cb91aee8068 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:33.811215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c62baf8a-5649-4343-90b3-6cb91aee8068 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:33.811646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c62baf8a-5649-4343-90b3-6cb91aee8068 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:33.817029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-82d3f49d-0e17-45a4-8f4c-6fd13dd7fb6e tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:33.823222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-82d3f49d-0e17-45a4-8f4c-6fd13dd7fb6e tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] [instance: c10a472b-a85b-41c5-9c6c-116d7c364af7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:33.960259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-82d3f49d-0e17-45a4-8f4c-6fd13dd7fb6e tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908cc3a0520f4898a016e0a7425698da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0dc0392fb4b438c2cae7dda5bb12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:33.971015 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-82d3f49d-0e17-45a4-8f4c-6fd13dd7fb6e tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] 10.222.0.23 "GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7" status: 200 len: 1214 microversion: 2.1 time: 0.165106 Oct 10 23:18:33.971675 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 287/543] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:33 2022] GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7 => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:34.089638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a43d66df-626e-425d-878d-ef3a30eac94a tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:34.099217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a43d66df-626e-425d-878d-ef3a30eac94a tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:34.116340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43d66df-626e-425d-878d-ef3a30eac94a tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:34.117190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43d66df-626e-425d-878d-ef3a30eac94a tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:34.118842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43d66df-626e-425d-878d-ef3a30eac94a tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:34.122337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43d66df-626e-425d-878d-ef3a30eac94a tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:34.123285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43d66df-626e-425d-878d-ef3a30eac94a tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:34.123932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43d66df-626e-425d-878d-ef3a30eac94a tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:34.544252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c62baf8a-5649-4343-90b3-6cb91aee8068 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:34.552792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a43d66df-626e-425d-878d-ef3a30eac94a tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f4b43c646c4aba88160ffeb98c6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7443a53a70743a09144270de0904832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:34.563070 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c62baf8a-5649-4343-90b3-6cb91aee8068 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1502 microversion: 2.1 time: 0.766790 Oct 10 23:18:34.564717 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 257/544] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:33 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1502 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:34.566331 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a43d66df-626e-425d-878d-ef3a30eac94a tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" status: 200 len: 1536 microversion: 2.1 time: 0.476046 Oct 10 23:18:34.566964 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 288/545] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:34 2022] GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 => generated 1536 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:18:34.581562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bc5a0e62-acb5-4886-93e7-82f55f446f01 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:34.582330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bc5a0e62-acb5-4886-93e7-82f55f446f01 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: bd8c16ec-655a-451f-959f-62685aedc8af] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:34.597661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc5a0e62-acb5-4886-93e7-82f55f446f01 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:34.598354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc5a0e62-acb5-4886-93e7-82f55f446f01 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:34.599781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc5a0e62-acb5-4886-93e7-82f55f446f01 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:34.600625 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2858c09a-ae71-42e2-8913-b3d3d9240555 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Action: 'create', calling method: .version_select at 0x7f662ba721f0>, body: {"pool": "c02b141d-e215-451f-8c75-8cc086d43089"} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:34.603331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc5a0e62-acb5-4886-93e7-82f55f446f01 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:34.604519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc5a0e62-acb5-4886-93e7-82f55f446f01 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:34.607641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc5a0e62-acb5-4886-93e7-82f55f446f01 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:35.196526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bc5a0e62-acb5-4886-93e7-82f55f446f01 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:35.209079 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bc5a0e62-acb5-4886-93e7-82f55f446f01 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af" status: 200 len: 1318 microversion: 2.1 time: 0.642973 Oct 10 23:18:35.211301 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 258/546] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:34 2022] GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af => generated 1318 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:35.218044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4140ac0a-78de-478f-898a-3eb6bd67f9c3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:35.218957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4140ac0a-78de-478f-898a-3eb6bd67f9c3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:35.227091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4140ac0a-78de-478f-898a-3eb6bd67f9c3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:35.227939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4140ac0a-78de-478f-898a-3eb6bd67f9c3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:35.228623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4140ac0a-78de-478f-898a-3eb6bd67f9c3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:35.229342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4140ac0a-78de-478f-898a-3eb6bd67f9c3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:35.230039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4140ac0a-78de-478f-898a-3eb6bd67f9c3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:35.231209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4140ac0a-78de-478f-898a-3eb6bd67f9c3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:35.240219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:35.720464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4140ac0a-78de-478f-898a-3eb6bd67f9c3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:35.730948 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4140ac0a-78de-478f-898a-3eb6bd67f9c3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1469 microversion: 2.1 time: 0.518384 Oct 10 23:18:35.737766 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 259/547] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:35 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1469 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:35.746558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-81bf3ae3-8389-42bf-9257-7476d9a0aa9b tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:35.747465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-81bf3ae3-8389-42bf-9257-7476d9a0aa9b tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] [instance: c10a472b-a85b-41c5-9c6c-116d7c364af7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:35.763846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81bf3ae3-8389-42bf-9257-7476d9a0aa9b tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:35.764371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81bf3ae3-8389-42bf-9257-7476d9a0aa9b tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:35.764799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81bf3ae3-8389-42bf-9257-7476d9a0aa9b tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:35.765888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81bf3ae3-8389-42bf-9257-7476d9a0aa9b tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:35.766360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81bf3ae3-8389-42bf-9257-7476d9a0aa9b tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:35.766964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81bf3ae3-8389-42bf-9257-7476d9a0aa9b tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:36.126759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-81bf3ae3-8389-42bf-9257-7476d9a0aa9b tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908cc3a0520f4898a016e0a7425698da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0dc0392fb4b438c2cae7dda5bb12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:36.135688 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-81bf3ae3-8389-42bf-9257-7476d9a0aa9b tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] 10.222.0.23 "GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7" status: 200 len: 1274 microversion: 2.1 time: 0.396571 Oct 10 23:18:36.136413 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 260/548] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:35 2022] GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7 => generated 1274 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:36.159317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5fe38d38-ebda-480a-a7a9-a0a6c2e1f100 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:36.160697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5fe38d38-ebda-480a-a7a9-a0a6c2e1f100 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:36.168696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fe38d38-ebda-480a-a7a9-a0a6c2e1f100 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:36.169340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fe38d38-ebda-480a-a7a9-a0a6c2e1f100 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:36.169902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fe38d38-ebda-480a-a7a9-a0a6c2e1f100 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:36.170900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fe38d38-ebda-480a-a7a9-a0a6c2e1f100 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:36.171429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fe38d38-ebda-480a-a7a9-a0a6c2e1f100 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:36.171931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fe38d38-ebda-480a-a7a9-a0a6c2e1f100 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:36.658668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5fe38d38-ebda-480a-a7a9-a0a6c2e1f100 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:36.672545 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5fe38d38-ebda-480a-a7a9-a0a6c2e1f100 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1502 microversion: 2.1 time: 0.521281 Oct 10 23:18:36.673613 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 261/549] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:36 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1502 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:36.678781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9ec1cff7-7ee5-4c2a-9a95-63d271258425 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:36.679667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9ec1cff7-7ee5-4c2a-9a95-63d271258425 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: bd8c16ec-655a-451f-959f-62685aedc8af] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:36.687220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ec1cff7-7ee5-4c2a-9a95-63d271258425 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:36.687980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ec1cff7-7ee5-4c2a-9a95-63d271258425 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:36.688626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ec1cff7-7ee5-4c2a-9a95-63d271258425 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:36.689869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ec1cff7-7ee5-4c2a-9a95-63d271258425 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:36.690636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ec1cff7-7ee5-4c2a-9a95-63d271258425 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:36.691159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ec1cff7-7ee5-4c2a-9a95-63d271258425 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:37.083917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9ec1cff7-7ee5-4c2a-9a95-63d271258425 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:37.092793 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9ec1cff7-7ee5-4c2a-9a95-63d271258425 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af" status: 200 len: 1318 microversion: 2.1 time: 0.417812 Oct 10 23:18:37.093406 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 262/550] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:36 2022] GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:37.109703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-a95df67c-1899-4a86-a142-534eeb73ca51 req-148becad-77aa-405a-9c42-debfb7620def service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd8c16ec-655a-451f-959f-62685aedc8af", "tag": "082006d4-7c9f-4c16-a8bc-d014162b5e63"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:37.120442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a95df67c-1899-4a86-a142-534eeb73ca51 req-148becad-77aa-405a-9c42-debfb7620def service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:37.121333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a95df67c-1899-4a86-a142-534eeb73ca51 req-148becad-77aa-405a-9c42-debfb7620def service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:37.121630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a95df67c-1899-4a86-a142-534eeb73ca51 req-148becad-77aa-405a-9c42-debfb7620def service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:37.134776 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a95df67c-1899-4a86-a142-534eeb73ca51 req-148becad-77aa-405a-9c42-debfb7620def service nova] Creating event network-changed:082006d4-7c9f-4c16-a8bc-d014162b5e63 for instance bd8c16ec-655a-451f-959f-62685aedc8af on n-h1-860864-2 Oct 10 23:18:37.141795 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-a95df67c-1899-4a86-a142-534eeb73ca51 req-148becad-77aa-405a-9c42-debfb7620def service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038612 Oct 10 23:18:37.143080 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 263/551] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:37.148499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-55ab1e81-20d9-42b3-8664-33c39c155cba tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:37.149506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-55ab1e81-20d9-42b3-8664-33c39c155cba tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:37.156585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55ab1e81-20d9-42b3-8664-33c39c155cba tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:37.159559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55ab1e81-20d9-42b3-8664-33c39c155cba tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:37.159559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55ab1e81-20d9-42b3-8664-33c39c155cba tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:37.159559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55ab1e81-20d9-42b3-8664-33c39c155cba tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:37.159559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55ab1e81-20d9-42b3-8664-33c39c155cba tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:37.159917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55ab1e81-20d9-42b3-8664-33c39c155cba tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:37.507941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-55ab1e81-20d9-42b3-8664-33c39c155cba tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:37.522552 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-55ab1e81-20d9-42b3-8664-33c39c155cba tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1474 microversion: 2.1 time: 0.377399 Oct 10 23:18:37.525046 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 264/552] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:37 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1474 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:37.551663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-55077a44-7796-4d48-9467-6477d05d6bda tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:37.552654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-55077a44-7796-4d48-9467-6477d05d6bda tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] [instance: c10a472b-a85b-41c5-9c6c-116d7c364af7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:37.583272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55077a44-7796-4d48-9467-6477d05d6bda tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:37.584146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55077a44-7796-4d48-9467-6477d05d6bda tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:37.584738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55077a44-7796-4d48-9467-6477d05d6bda tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:37.585816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55077a44-7796-4d48-9467-6477d05d6bda tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:37.586488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55077a44-7796-4d48-9467-6477d05d6bda tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:37.587068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55077a44-7796-4d48-9467-6477d05d6bda tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:37.751000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-55077a44-7796-4d48-9467-6477d05d6bda tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908cc3a0520f4898a016e0a7425698da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0dc0392fb4b438c2cae7dda5bb12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:37.769409 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-55077a44-7796-4d48-9467-6477d05d6bda tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] 10.222.0.23 "GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7" status: 200 len: 1272 microversion: 2.1 time: 0.241383 Oct 10 23:18:37.791530 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 265/553] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:37 2022] GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7 => generated 1272 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:37.798354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-bf6c3439-b151-43b2-bcec-a0972845d0e7 req-3a9997ad-484f-4d7c-9ad1-e965a2271ede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db1b49d1-08d6-4cb1-a27d-63944f113ea7", "tag": "53c39c27-8c25-458d-9dc7-1288b1c8ad16"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:37.825616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-bf6c3439-b151-43b2-bcec-a0972845d0e7 req-3a9997ad-484f-4d7c-9ad1-e965a2271ede service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:37.825616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-bf6c3439-b151-43b2-bcec-a0972845d0e7 req-3a9997ad-484f-4d7c-9ad1-e965a2271ede service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:37.825616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-bf6c3439-b151-43b2-bcec-a0972845d0e7 req-3a9997ad-484f-4d7c-9ad1-e965a2271ede service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:37.843696 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-bf6c3439-b151-43b2-bcec-a0972845d0e7 req-3a9997ad-484f-4d7c-9ad1-e965a2271ede service nova] Creating event network-changed:53c39c27-8c25-458d-9dc7-1288b1c8ad16 for instance db1b49d1-08d6-4cb1-a27d-63944f113ea7 on n-h2-860864-2 Oct 10 23:18:37.849020 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-bf6c3439-b151-43b2-bcec-a0972845d0e7 req-3a9997ad-484f-4d7c-9ad1-e965a2271ede service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055135 Oct 10 23:18:37.849976 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 266/554] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:37.855803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bc8b989b-c11a-4b5d-9c3c-5cefbcfe21e4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:37.856735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bc8b989b-c11a-4b5d-9c3c-5cefbcfe21e4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:37.863548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc8b989b-c11a-4b5d-9c3c-5cefbcfe21e4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:37.864349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc8b989b-c11a-4b5d-9c3c-5cefbcfe21e4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:37.864349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc8b989b-c11a-4b5d-9c3c-5cefbcfe21e4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:37.865062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc8b989b-c11a-4b5d-9c3c-5cefbcfe21e4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:37.865567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc8b989b-c11a-4b5d-9c3c-5cefbcfe21e4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:37.865992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc8b989b-c11a-4b5d-9c3c-5cefbcfe21e4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:38.191918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=10 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:38.274003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bc8b989b-c11a-4b5d-9c3c-5cefbcfe21e4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:38.282522 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bc8b989b-c11a-4b5d-9c3c-5cefbcfe21e4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1502 microversion: 2.1 time: 0.431123 Oct 10 23:18:38.283264 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 267/555] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:37 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1502 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:38.287886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9d3b2bcf-a304-4687-bea9-74fa6e23ce0c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:38.288625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9d3b2bcf-a304-4687-bea9-74fa6e23ce0c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: bd8c16ec-655a-451f-959f-62685aedc8af] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:38.295222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d3b2bcf-a304-4687-bea9-74fa6e23ce0c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:38.296056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d3b2bcf-a304-4687-bea9-74fa6e23ce0c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:38.296758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d3b2bcf-a304-4687-bea9-74fa6e23ce0c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:38.297776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d3b2bcf-a304-4687-bea9-74fa6e23ce0c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:38.298459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d3b2bcf-a304-4687-bea9-74fa6e23ce0c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:38.299105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d3b2bcf-a304-4687-bea9-74fa6e23ce0c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:38.647909 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2858c09a-ae71-42e2-8913-b3d3d9240555 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.051754 Oct 10 23:18:38.649356 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 289/556] 10.222.0.23 () {60 vars in 1170 bytes} [Mon Oct 10 23:18:34 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:38.656597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7572e6a2-d8ae-44ff-b40c-af59f9f2b551 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:38.658856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7572e6a2-d8ae-44ff-b40c-af59f9f2b551 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:38.682560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7572e6a2-d8ae-44ff-b40c-af59f9f2b551 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:38.683682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7572e6a2-d8ae-44ff-b40c-af59f9f2b551 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:38.687232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7572e6a2-d8ae-44ff-b40c-af59f9f2b551 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:38.689072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7572e6a2-d8ae-44ff-b40c-af59f9f2b551 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:38.691198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7572e6a2-d8ae-44ff-b40c-af59f9f2b551 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:38.691811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7572e6a2-d8ae-44ff-b40c-af59f9f2b551 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:38.999389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7572e6a2-d8ae-44ff-b40c-af59f9f2b551 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:39.024335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9d3b2bcf-a304-4687-bea9-74fa6e23ce0c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:39.033798 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9d3b2bcf-a304-4687-bea9-74fa6e23ce0c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af" status: 200 len: 1318 microversion: 2.1 time: 0.749365 Oct 10 23:18:39.036637 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7572e6a2-d8ae-44ff-b40c-af59f9f2b551 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1474 microversion: 2.1 time: 0.385978 Oct 10 23:18:39.037762 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 268/557] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:38 2022] GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af => generated 1318 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:39.042741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-93492375-66e1-4b38-8351-62fee2b68714 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Action: 'action', calling method: .version_select at 0x7f6631ee08b0>, body: {"addFloatingIp": {"address": "172.25.5.40"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:39.046884 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 290/558] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:38 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1474 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:39.057629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-93492375-66e1-4b38-8351-62fee2b68714 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:39.061050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7670c27c-423e-453e-bc0b-212ac65adbba tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:39.071740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7670c27c-423e-453e-bc0b-212ac65adbba tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] [instance: c10a472b-a85b-41c5-9c6c-116d7c364af7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:39.078938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93492375-66e1-4b38-8351-62fee2b68714 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:39.079545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93492375-66e1-4b38-8351-62fee2b68714 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:39.080869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93492375-66e1-4b38-8351-62fee2b68714 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:39.085157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7670c27c-423e-453e-bc0b-212ac65adbba tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:39.086160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93492375-66e1-4b38-8351-62fee2b68714 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:39.086643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93492375-66e1-4b38-8351-62fee2b68714 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:39.087079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93492375-66e1-4b38-8351-62fee2b68714 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:39.095321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7670c27c-423e-453e-bc0b-212ac65adbba tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:39.095774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7670c27c-423e-453e-bc0b-212ac65adbba tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:39.096511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7670c27c-423e-453e-bc0b-212ac65adbba tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:39.096969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7670c27c-423e-453e-bc0b-212ac65adbba tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:39.097423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7670c27c-423e-453e-bc0b-212ac65adbba tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:39.198466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93492375-66e1-4b38-8351-62fee2b68714 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "refresh_cache-f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" {{(pid=120613) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 23:18:39.200043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93492375-66e1-4b38-8351-62fee2b68714 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquired lock "refresh_cache-f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" {{(pid=120613) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 23:18:39.672110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7670c27c-423e-453e-bc0b-212ac65adbba tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908cc3a0520f4898a016e0a7425698da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0dc0392fb4b438c2cae7dda5bb12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:39.683902 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7670c27c-423e-453e-bc0b-212ac65adbba tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] 10.222.0.23 "GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7" status: 200 len: 1314 microversion: 2.1 time: 0.634441 Oct 10 23:18:39.685275 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 291/559] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:39 2022] GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7 => generated 1314 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:39.690579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aa39948a-66ba-4f22-885e-d2a9123073ac tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:39.691421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aa39948a-66ba-4f22-885e-d2a9123073ac tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:39.719447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa39948a-66ba-4f22-885e-d2a9123073ac tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:39.720183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa39948a-66ba-4f22-885e-d2a9123073ac tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:39.720759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa39948a-66ba-4f22-885e-d2a9123073ac tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:39.739894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa39948a-66ba-4f22-885e-d2a9123073ac tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:39.740483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa39948a-66ba-4f22-885e-d2a9123073ac tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:39.740926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa39948a-66ba-4f22-885e-d2a9123073ac tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:40.113751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aa39948a-66ba-4f22-885e-d2a9123073ac tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:40.132489 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aa39948a-66ba-4f22-885e-d2a9123073ac tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1502 microversion: 2.1 time: 0.445336 Oct 10 23:18:40.136849 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 292/560] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:39 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1502 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:40.146245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9e86792e-557e-4878-a213-8064257cc646 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:40.147054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9e86792e-557e-4878-a213-8064257cc646 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: bd8c16ec-655a-451f-959f-62685aedc8af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:40.155082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e86792e-557e-4878-a213-8064257cc646 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:40.155680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e86792e-557e-4878-a213-8064257cc646 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:40.156342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e86792e-557e-4878-a213-8064257cc646 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:40.157165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e86792e-557e-4878-a213-8064257cc646 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:40.157848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e86792e-557e-4878-a213-8064257cc646 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:40.158368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e86792e-557e-4878-a213-8064257cc646 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:40.503437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9e86792e-557e-4878-a213-8064257cc646 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:40.518435 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9e86792e-557e-4878-a213-8064257cc646 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af" status: 200 len: 1318 microversion: 2.1 time: 0.381696 Oct 10 23:18:40.529440 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 293/561] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:40 2022] GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:40.529694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5606f002-ce32-40ed-99e8-e7e9a8f3da64 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:40.530641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5606f002-ce32-40ed-99e8-e7e9a8f3da64 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:40.538204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5606f002-ce32-40ed-99e8-e7e9a8f3da64 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:40.546653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5606f002-ce32-40ed-99e8-e7e9a8f3da64 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:40.547328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5606f002-ce32-40ed-99e8-e7e9a8f3da64 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:40.557122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5606f002-ce32-40ed-99e8-e7e9a8f3da64 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:40.558698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5606f002-ce32-40ed-99e8-e7e9a8f3da64 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:40.562855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5606f002-ce32-40ed-99e8-e7e9a8f3da64 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:40.988717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5606f002-ce32-40ed-99e8-e7e9a8f3da64 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:41.005127 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5606f002-ce32-40ed-99e8-e7e9a8f3da64 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1474 microversion: 2.1 time: 0.484223 Oct 10 23:18:41.020056 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 294/562] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:40 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1474 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:41.029692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-9c163ffa-5101-45af-971f-1afca65377fa req-69c52bd4-830b-4666-88c8-b879225c9e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c10a472b-a85b-41c5-9c6c-116d7c364af7", "tag": "f73264cc-f1da-4a5c-b6f9-4701cd3675dc"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:41.039621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9c163ffa-5101-45af-971f-1afca65377fa req-69c52bd4-830b-4666-88c8-b879225c9e16 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:41.040388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9c163ffa-5101-45af-971f-1afca65377fa req-69c52bd4-830b-4666-88c8-b879225c9e16 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:41.040984 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9c163ffa-5101-45af-971f-1afca65377fa req-69c52bd4-830b-4666-88c8-b879225c9e16 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:41.058650 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-9c163ffa-5101-45af-971f-1afca65377fa req-69c52bd4-830b-4666-88c8-b879225c9e16 service nova] Creating event network-changed:f73264cc-f1da-4a5c-b6f9-4701cd3675dc for instance c10a472b-a85b-41c5-9c6c-116d7c364af7 on n-h2-860864-2 Oct 10 23:18:41.065079 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-9c163ffa-5101-45af-971f-1afca65377fa req-69c52bd4-830b-4666-88c8-b879225c9e16 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043446 Oct 10 23:18:41.066273 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 295/563] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:41.074068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d0ea22b3-c1a7-49ba-8bed-fb650a376003 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:41.076288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d0ea22b3-c1a7-49ba-8bed-fb650a376003 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] [instance: c10a472b-a85b-41c5-9c6c-116d7c364af7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:41.085939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0ea22b3-c1a7-49ba-8bed-fb650a376003 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:41.087544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0ea22b3-c1a7-49ba-8bed-fb650a376003 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:41.088192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0ea22b3-c1a7-49ba-8bed-fb650a376003 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:41.089161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0ea22b3-c1a7-49ba-8bed-fb650a376003 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:41.089825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0ea22b3-c1a7-49ba-8bed-fb650a376003 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:41.091072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0ea22b3-c1a7-49ba-8bed-fb650a376003 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:42.116901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d0ea22b3-c1a7-49ba-8bed-fb650a376003 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908cc3a0520f4898a016e0a7425698da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0dc0392fb4b438c2cae7dda5bb12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:42.128733 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d0ea22b3-c1a7-49ba-8bed-fb650a376003 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] 10.222.0.23 "GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7" status: 200 len: 1314 microversion: 2.1 time: 1.061008 Oct 10 23:18:42.129789 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 296/564] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:41 2022] GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7 => generated 1314 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:42.136346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f1a2eee4-53f2-499b-83ba-1a5e39c04ef7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:42.137232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f1a2eee4-53f2-499b-83ba-1a5e39c04ef7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:42.148661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f1a2eee4-53f2-499b-83ba-1a5e39c04ef7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:42.149528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f1a2eee4-53f2-499b-83ba-1a5e39c04ef7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:42.150368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f1a2eee4-53f2-499b-83ba-1a5e39c04ef7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:42.152435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f1a2eee4-53f2-499b-83ba-1a5e39c04ef7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:42.155007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f1a2eee4-53f2-499b-83ba-1a5e39c04ef7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:42.155803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f1a2eee4-53f2-499b-83ba-1a5e39c04ef7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:42.649107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f1a2eee4-53f2-499b-83ba-1a5e39c04ef7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:42.660894 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f1a2eee4-53f2-499b-83ba-1a5e39c04ef7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1502 microversion: 2.1 time: 0.529667 Oct 10 23:18:42.662743 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 297/565] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:42 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1502 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:42.670934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-93492375-66e1-4b38-8351-62fee2b68714 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Building network info cache for instance {{(pid=120613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 23:18:42.673077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-524afafa-bf78-4be5-8483-43f9cb87a6c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:42.674405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-524afafa-bf78-4be5-8483-43f9cb87a6c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: bd8c16ec-655a-451f-959f-62685aedc8af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:42.687391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-524afafa-bf78-4be5-8483-43f9cb87a6c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:42.688565 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-524afafa-bf78-4be5-8483-43f9cb87a6c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:42.689886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-524afafa-bf78-4be5-8483-43f9cb87a6c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:42.692637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-524afafa-bf78-4be5-8483-43f9cb87a6c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:42.693514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-524afafa-bf78-4be5-8483-43f9cb87a6c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:42.696393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-524afafa-bf78-4be5-8483-43f9cb87a6c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:43.102250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-524afafa-bf78-4be5-8483-43f9cb87a6c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:43.116537 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-524afafa-bf78-4be5-8483-43f9cb87a6c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af" status: 200 len: 1318 microversion: 2.1 time: 0.451834 Oct 10 23:18:43.117144 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 298/566] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:42 2022] GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:43.123795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5dfd41be-d2c1-4239-9607-b7822b47c137 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:43.125617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5dfd41be-d2c1-4239-9607-b7822b47c137 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:43.140239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5dfd41be-d2c1-4239-9607-b7822b47c137 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:43.143133 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5dfd41be-d2c1-4239-9607-b7822b47c137 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:43.143773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5dfd41be-d2c1-4239-9607-b7822b47c137 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:43.144719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5dfd41be-d2c1-4239-9607-b7822b47c137 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:43.145331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5dfd41be-d2c1-4239-9607-b7822b47c137 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:43.147099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5dfd41be-d2c1-4239-9607-b7822b47c137 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:43.570376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5dfd41be-d2c1-4239-9607-b7822b47c137 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:43.579732 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5dfd41be-d2c1-4239-9607-b7822b47c137 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1474 microversion: 2.1 time: 0.461523 Oct 10 23:18:43.580864 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 299/567] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:43 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1474 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:43.585832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-c5f04465-46a1-4cd7-81e0-9d58b734d95b req-23a71e2e-fd13-4c85-b1ea-ab0089939677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7", "tag": "9d1017db-e093-43c6-b9a1-81a16928b5cf"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:43.595880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c5f04465-46a1-4cd7-81e0-9d58b734d95b req-23a71e2e-fd13-4c85-b1ea-ab0089939677 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:43.596583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c5f04465-46a1-4cd7-81e0-9d58b734d95b req-23a71e2e-fd13-4c85-b1ea-ab0089939677 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:43.597196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c5f04465-46a1-4cd7-81e0-9d58b734d95b req-23a71e2e-fd13-4c85-b1ea-ab0089939677 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:43.618183 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-c5f04465-46a1-4cd7-81e0-9d58b734d95b req-23a71e2e-fd13-4c85-b1ea-ab0089939677 service nova] Creating event network-changed:9d1017db-e093-43c6-b9a1-81a16928b5cf for instance f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 on n-h1-860864-2 Oct 10 23:18:43.635955 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-c5f04465-46a1-4cd7-81e0-9d58b734d95b req-23a71e2e-fd13-4c85-b1ea-ab0089939677 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042537 Oct 10 23:18:43.649867 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 300/568] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:43.665773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fd6e339c-45c5-4e44-b7f5-7a9b2c16038c tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:43.666800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fd6e339c-45c5-4e44-b7f5-7a9b2c16038c tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] [instance: c10a472b-a85b-41c5-9c6c-116d7c364af7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:43.671746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=22 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:43.687514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd6e339c-45c5-4e44-b7f5-7a9b2c16038c tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:43.688331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd6e339c-45c5-4e44-b7f5-7a9b2c16038c tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:43.689883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd6e339c-45c5-4e44-b7f5-7a9b2c16038c tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:43.691282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd6e339c-45c5-4e44-b7f5-7a9b2c16038c tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:43.691981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd6e339c-45c5-4e44-b7f5-7a9b2c16038c tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:43.692619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd6e339c-45c5-4e44-b7f5-7a9b2c16038c tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:43.705187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=26 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:43.892244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-93492375-66e1-4b38-8351-62fee2b68714 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Updating instance_info_cache with network_info: [{"id": "9d1017db-e093-43c6-b9a1-81a16928b5cf", "address": "fa:16:3e:cf:4a:3e", "network": {"id": "d3362ac6-6706-413b-9654-0263e4510ad8", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-146927878-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c7443a53a70743a09144270de0904832", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9d1017db-e0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 23:18:43.909892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93492375-66e1-4b38-8351-62fee2b68714 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Releasing lock "refresh_cache-f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" {{(pid=120613) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 23:18:43.910909 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-93492375-66e1-4b38-8351-62fee2b68714 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "POST /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7/action" status: 202 len: 0 microversion: 2.1 time: 4.872104 Oct 10 23:18:43.914845 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 269/569] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:18:39 2022] POST /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7/action => generated 0 bytes in 4874 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 23:18:43.922296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e79262ac-5b2c-4d4f-b1fa-fdccc08a2a0c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:43.923790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e79262ac-5b2c-4d4f-b1fa-fdccc08a2a0c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:43.938349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e79262ac-5b2c-4d4f-b1fa-fdccc08a2a0c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:43.939960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e79262ac-5b2c-4d4f-b1fa-fdccc08a2a0c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:43.940516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e79262ac-5b2c-4d4f-b1fa-fdccc08a2a0c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:43.942212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e79262ac-5b2c-4d4f-b1fa-fdccc08a2a0c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:43.943970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e79262ac-5b2c-4d4f-b1fa-fdccc08a2a0c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:43.947113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e79262ac-5b2c-4d4f-b1fa-fdccc08a2a0c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:43.965458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=30 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:44.184452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e79262ac-5b2c-4d4f-b1fa-fdccc08a2a0c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:44.195964 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e79262ac-5b2c-4d4f-b1fa-fdccc08a2a0c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1502 microversion: 2.1 time: 0.282815 Oct 10 23:18:44.198452 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 270/570] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:43 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1502 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:44.204167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-61955c86-105c-4a13-a082-913fb640f64b tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Action: 'create', calling method: .version_select at 0x7f662bcddaf0>, body: {"pool": "c02b141d-e215-451f-8c75-8cc086d43089"} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:44.912695 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fd6e339c-45c5-4e44-b7f5-7a9b2c16038c tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908cc3a0520f4898a016e0a7425698da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0dc0392fb4b438c2cae7dda5bb12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:44.924273 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fd6e339c-45c5-4e44-b7f5-7a9b2c16038c tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] 10.222.0.23 "GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7" status: 200 len: 1314 microversion: 2.1 time: 1.269233 Oct 10 23:18:44.945831 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 301/571] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:43 2022] GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7 => generated 1314 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:44.958171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7d770da4-928c-44c1-ae2c-8c0db18b27f6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:44.958836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7d770da4-928c-44c1-ae2c-8c0db18b27f6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: bd8c16ec-655a-451f-959f-62685aedc8af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:44.974491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d770da4-928c-44c1-ae2c-8c0db18b27f6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:44.976911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d770da4-928c-44c1-ae2c-8c0db18b27f6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:44.977470 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d770da4-928c-44c1-ae2c-8c0db18b27f6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:44.978239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d770da4-928c-44c1-ae2c-8c0db18b27f6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:44.978712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d770da4-928c-44c1-ae2c-8c0db18b27f6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:44.985604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d770da4-928c-44c1-ae2c-8c0db18b27f6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:45.808073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7d770da4-928c-44c1-ae2c-8c0db18b27f6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:45.828011 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7d770da4-928c-44c1-ae2c-8c0db18b27f6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af" status: 200 len: 1318 microversion: 2.1 time: 0.880554 Oct 10 23:18:45.828937 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 302/572] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:44 2022] GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af => generated 1318 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:45.834764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-96f3a3f3-b1d7-42cd-8630-1587b343236d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:45.835611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-96f3a3f3-b1d7-42cd-8630-1587b343236d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:45.848378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96f3a3f3-b1d7-42cd-8630-1587b343236d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:45.848975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96f3a3f3-b1d7-42cd-8630-1587b343236d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:45.849304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96f3a3f3-b1d7-42cd-8630-1587b343236d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:45.854403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96f3a3f3-b1d7-42cd-8630-1587b343236d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:45.855157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96f3a3f3-b1d7-42cd-8630-1587b343236d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:45.856140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96f3a3f3-b1d7-42cd-8630-1587b343236d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:46.182822 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-61955c86-105c-4a13-a082-913fb640f64b tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.983178 Oct 10 23:18:46.183491 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 271/573] 10.222.0.23 () {60 vars in 1170 bytes} [Mon Oct 10 23:18:44 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:46.202689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-3348b49d-df57-44d8-b025-b45f65094ce9 req-f27c8d3a-5f76-4e7f-9165-86cb7c620821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd8c16ec-655a-451f-959f-62685aedc8af", "name": "network-vif-plugged", "status": "completed", "tag": "082006d4-7c9f-4c16-a8bc-d014162b5e63"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:46.237663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3348b49d-df57-44d8-b025-b45f65094ce9 req-f27c8d3a-5f76-4e7f-9165-86cb7c620821 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:46.238156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3348b49d-df57-44d8-b025-b45f65094ce9 req-f27c8d3a-5f76-4e7f-9165-86cb7c620821 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:46.238575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3348b49d-df57-44d8-b025-b45f65094ce9 req-f27c8d3a-5f76-4e7f-9165-86cb7c620821 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:46.264335 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-3348b49d-df57-44d8-b025-b45f65094ce9 req-f27c8d3a-5f76-4e7f-9165-86cb7c620821 service nova] Creating event network-vif-plugged:082006d4-7c9f-4c16-a8bc-d014162b5e63 for instance bd8c16ec-655a-451f-959f-62685aedc8af on n-h1-860864-2 Oct 10 23:18:46.269944 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-3348b49d-df57-44d8-b025-b45f65094ce9 req-f27c8d3a-5f76-4e7f-9165-86cb7c620821 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084790 Oct 10 23:18:46.270647 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 272/574] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:46.343698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-96f3a3f3-b1d7-42cd-8630-1587b343236d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:46.357716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:46.373412 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-96f3a3f3-b1d7-42cd-8630-1587b343236d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1474 microversion: 2.1 time: 0.538141 Oct 10 23:18:46.376624 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 303/575] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:45 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1474 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:46.392575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-623a3c10-58a1-46e8-9d88-6c894e4a03d6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:46.392575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-623a3c10-58a1-46e8-9d88-6c894e4a03d6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:46.398736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-623a3c10-58a1-46e8-9d88-6c894e4a03d6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:46.399237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-623a3c10-58a1-46e8-9d88-6c894e4a03d6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:46.399682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-623a3c10-58a1-46e8-9d88-6c894e4a03d6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:46.400391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-623a3c10-58a1-46e8-9d88-6c894e4a03d6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:46.401548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-623a3c10-58a1-46e8-9d88-6c894e4a03d6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:46.402242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-623a3c10-58a1-46e8-9d88-6c894e4a03d6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:46.479862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-22b5139f-5bf9-4232-aa71-a78abf871ffa tempest-AbsoluteLimitsTestJSON-1794829829 tempest-AbsoluteLimitsTestJSON-1794829829-project] Calling method '.version_select at 0x7f662bde8280>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:46.492216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22b5139f-5bf9-4232-aa71-a78abf871ffa tempest-AbsoluteLimitsTestJSON-1794829829 tempest-AbsoluteLimitsTestJSON-1794829829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:46.492835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22b5139f-5bf9-4232-aa71-a78abf871ffa tempest-AbsoluteLimitsTestJSON-1794829829 tempest-AbsoluteLimitsTestJSON-1794829829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:46.493400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22b5139f-5bf9-4232-aa71-a78abf871ffa tempest-AbsoluteLimitsTestJSON-1794829829 tempest-AbsoluteLimitsTestJSON-1794829829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:46.494203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22b5139f-5bf9-4232-aa71-a78abf871ffa tempest-AbsoluteLimitsTestJSON-1794829829 tempest-AbsoluteLimitsTestJSON-1794829829-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:46.494814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22b5139f-5bf9-4232-aa71-a78abf871ffa tempest-AbsoluteLimitsTestJSON-1794829829 tempest-AbsoluteLimitsTestJSON-1794829829-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:46.495398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22b5139f-5bf9-4232-aa71-a78abf871ffa tempest-AbsoluteLimitsTestJSON-1794829829 tempest-AbsoluteLimitsTestJSON-1794829829-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:46.517926 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-22b5139f-5bf9-4232-aa71-a78abf871ffa tempest-AbsoluteLimitsTestJSON-1794829829 tempest-AbsoluteLimitsTestJSON-1794829829-project] 10.222.0.23 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.245867 Oct 10 23:18:46.518981 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 273/576] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 10 23:18:46 2022] GET /compute/v2.1/limits => generated 511 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:46.529458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2f72cc40-a8e9-4484-bc20-992abf12a761 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:46.530429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2f72cc40-a8e9-4484-bc20-992abf12a761 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] [instance: c10a472b-a85b-41c5-9c6c-116d7c364af7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:46.538120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:46.540079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f72cc40-a8e9-4484-bc20-992abf12a761 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:46.540851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f72cc40-a8e9-4484-bc20-992abf12a761 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:46.541582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f72cc40-a8e9-4484-bc20-992abf12a761 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:46.543180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f72cc40-a8e9-4484-bc20-992abf12a761 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:46.544032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f72cc40-a8e9-4484-bc20-992abf12a761 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:46.544688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f72cc40-a8e9-4484-bc20-992abf12a761 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:46.731868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2f72cc40-a8e9-4484-bc20-992abf12a761 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908cc3a0520f4898a016e0a7425698da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0dc0392fb4b438c2cae7dda5bb12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:46.742939 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2f72cc40-a8e9-4484-bc20-992abf12a761 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] 10.222.0.23 "GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7" status: 200 len: 1314 microversion: 2.1 time: 0.222113 Oct 10 23:18:46.745659 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 274/577] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:46 2022] GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:46.752873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bf329fd7-c0c7-44d9-9cdd-bc62ef17c76e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.104"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:46.756035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bf329fd7-c0c7-44d9-9cdd-bc62ef17c76e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:46.784190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf329fd7-c0c7-44d9-9cdd-bc62ef17c76e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:46.784805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf329fd7-c0c7-44d9-9cdd-bc62ef17c76e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:46.786573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf329fd7-c0c7-44d9-9cdd-bc62ef17c76e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:46.787415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf329fd7-c0c7-44d9-9cdd-bc62ef17c76e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:46.788318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf329fd7-c0c7-44d9-9cdd-bc62ef17c76e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:46.792683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf329fd7-c0c7-44d9-9cdd-bc62ef17c76e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:46.804367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-623a3c10-58a1-46e8-9d88-6c894e4a03d6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:46.843828 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-623a3c10-58a1-46e8-9d88-6c894e4a03d6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1492 microversion: 2.1 time: 0.461457 Oct 10 23:18:46.848168 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 304/578] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:46 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1492 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:46.871114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0905c5de-e2fd-42e7-98d6-510dd1a2df0f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:46.874130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0905c5de-e2fd-42e7-98d6-510dd1a2df0f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: bd8c16ec-655a-451f-959f-62685aedc8af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:46.896423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0905c5de-e2fd-42e7-98d6-510dd1a2df0f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:46.918376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0905c5de-e2fd-42e7-98d6-510dd1a2df0f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:46.919458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0905c5de-e2fd-42e7-98d6-510dd1a2df0f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:46.920520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0905c5de-e2fd-42e7-98d6-510dd1a2df0f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:46.920998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0905c5de-e2fd-42e7-98d6-510dd1a2df0f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:46.921494 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0905c5de-e2fd-42e7-98d6-510dd1a2df0f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:46.936823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf329fd7-c0c7-44d9-9cdd-bc62ef17c76e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "refresh_cache-f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" {{(pid=120613) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 23:18:46.937504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf329fd7-c0c7-44d9-9cdd-bc62ef17c76e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquired lock "refresh_cache-f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" {{(pid=120613) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 23:18:47.349427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0905c5de-e2fd-42e7-98d6-510dd1a2df0f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:47.358212 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0905c5de-e2fd-42e7-98d6-510dd1a2df0f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af" status: 200 len: 1318 microversion: 2.1 time: 0.495687 Oct 10 23:18:47.373951 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 305/579] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:46 2022] GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af => generated 1318 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:18:47.379334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dfca61bb-3d77-4be7-ba16-63aebefd5164 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Calling method '.version_select at 0x7f662ba1c040>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:47.383050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dfca61bb-3d77-4be7-ba16-63aebefd5164 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:47.383975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dfca61bb-3d77-4be7-ba16-63aebefd5164 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:47.384643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dfca61bb-3d77-4be7-ba16-63aebefd5164 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:47.408315 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dfca61bb-3d77-4be7-ba16-63aebefd5164 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.033234 Oct 10 23:18:47.409582 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 306/580] 10.222.0.23 () {58 vars in 1143 bytes} [Mon Oct 10 23:18:47 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:47.414922 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fa6dbbb7-16ba-426e-90a0-d75313d17f54 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:47.415531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fa6dbbb7-16ba-426e-90a0-d75313d17f54 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:47.422200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa6dbbb7-16ba-426e-90a0-d75313d17f54 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:47.422958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa6dbbb7-16ba-426e-90a0-d75313d17f54 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:47.423398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa6dbbb7-16ba-426e-90a0-d75313d17f54 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:47.424100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa6dbbb7-16ba-426e-90a0-d75313d17f54 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:47.424545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa6dbbb7-16ba-426e-90a0-d75313d17f54 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:47.425185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa6dbbb7-16ba-426e-90a0-d75313d17f54 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:47.558806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG neutronclient.v2_0.client [None req-bf329fd7-c0c7-44d9-9cdd-bc62ef17c76e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.5.104 (f54f144b-ead5-44f9-900b-666bb217a755) with port 9d1017db-e093-43c6-b9a1-81a16928b5cf using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network c02b141d-e215-451f-8c75-8cc086d43089.", "detail": ""}} {{(pid=120613) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:18:47.562524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf329fd7-c0c7-44d9-9cdd-bc62ef17c76e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Releasing lock "refresh_cache-f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" {{(pid=120613) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 23:18:47.563375 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-bf329fd7-c0c7-44d9-9cdd-bc62ef17c76e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] HTTP exception thrown: Cannot associate floating IP 172.25.5.104 (f54f144b-ead5-44f9-900b-666bb217a755) with port 9d1017db-e093-43c6-b9a1-81a16928b5cf using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network c02b141d-e215-451f-8c75-8cc086d43089. Oct 10 23:18:47.563375 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-7ce42b63-2493-47dd-a881-e201f570662f'] Oct 10 23:18:47.582485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bf329fd7-c0c7-44d9-9cdd-bc62ef17c76e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Request method failure captured: Oct 10 23:18:47.582485 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7/action HTTP/1.1 Oct 10 23:18:47.582485 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:18:47.582485 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:18:47.582485 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:18:47.582485 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 46 Oct 10 23:18:47.582485 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:18:47.582485 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:18:47.582485 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:18:47.582485 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:18:47.582485 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKg0cwut1HB5YgrFXzkSoyTQeSNf6qxj0xNy0WuCa7qczJ5YOryQpfrH6W3_OXKI0wSEFQ7dkHey15_8SU63XZ1M5zNoYA5xJKEUqbiOMJD1gjTG32yJeFhm5TI4ij7gW9yADfvCHHnzt25MECSs7hWoeJNb8LWbHa2evy2T-Sx_2Fc Oct 10 23:18:47.582485 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:18:47.582485 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:18:47.582485 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:18:47.582485 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:18:47.582485 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:18:47.582485 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:18:47.582485 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: c7443a53a70743a09144270de0904832 Oct 10 23:18:47.582485 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-521344888 Oct 10 23:18:47.582485 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:18:47.582485 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:18:47.584249 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c7443a53a70743a09144270de0904832"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7443a53a70743a09144270de0904832"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7443a53a70743a09144270de0904832"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c7443a53a70743a09144270de0904832", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:18:47.584249 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-521344888 Oct 10 23:18:47.584249 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: c7443a53a70743a09144270de0904832 Oct 10 23:18:47.584249 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-521344888 Oct 10 23:18:47.584249 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project Oct 10 23:18:47.584249 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:18:47.584249 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:18:47.584249 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 12f4b43c646c4aba88160ffeb98c6aa8 Oct 10 23:18:47.584249 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project Oct 10 23:18:47.584249 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:18:47.584249 n-d-860864-2 devstack@n-api.service[120613]: {"addFloatingIp": {"address": "172.25.5.104"}} Oct 10 23:18:47.584249 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:18:47.585222 n-d-860864-2 devstack@n-api.service[120613]: exception: Cannot associate floating IP 172.25.5.104 (f54f144b-ead5-44f9-900b-666bb217a755) with port 9d1017db-e093-43c6-b9a1-81a16928b5cf using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network c02b141d-e215-451f-8c75-8cc086d43089. Oct 10 23:18:47.585222 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-7ce42b63-2493-47dd-a881-e201f570662f'] Oct 10 23:18:47.585222 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7', 'body': {'addFloatingIp': {'address': '172.25.5.104'}}} Oct 10 23:18:47.585222 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:18:47.585222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:18:47.585222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 10 23:18:47.585222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 10 23:18:47.585222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:18:47.585222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:18:47.585222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 10 23:18:47.585222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 10 23:18:47.585222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:18:47.585222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:18:47.585222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 10 23:18:47.585222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 10 23:18:47.585222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:18:47.585222 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:18:47.586518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 10 23:18:47.586518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 10 23:18:47.586518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:18:47.586518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:18:47.586518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:18:47.586518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:18:47.586518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:18:47.586518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:18:47.586518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:18:47.586518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:18:47.586518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:18:47.586518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:18:47.586518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:18:47.586518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:18:47.586518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:18:47.586518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:18:47.588220 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.5.104 (f54f144b-ead5-44f9-900b-666bb217a755) with port 9d1017db-e093-43c6-b9a1-81a16928b5cf using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network c02b141d-e215-451f-8c75-8cc086d43089. Oct 10 23:18:47.588220 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ce42b63-2493-47dd-a881-e201f570662f'] Oct 10 23:18:47.588220 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:18:47.588220 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:18:47.588220 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:18:47.588220 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:18:47.588220 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 10 23:18:47.588220 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 10 23:18:47.588220 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 10 23:18:47.588220 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 10 23:18:47.588220 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 10 23:18:47.588220 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 10 23:18:47.588220 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.5.104 (f54f144b-ead5-44f9-900b-666bb217a755) with port 9d1017db-e093-43c6-b9a1-81a16928b5cf using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network c02b141d-e215-451f-8c75-8cc086d43089. Oct 10 23:18:47.588220 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ce42b63-2493-47dd-a881-e201f570662f'] Oct 10 23:18:47.588220 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:18:47.588220 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:18:47.589553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:18:47.589553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:18:47.589553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:18:47.589553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:18:47.589553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:18:47.589553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:18:47.589553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:18:47.589553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:18:47.589553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:18:47.589553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:18:47.589553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:18:47.589553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:18:47.589553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 10 23:18:47.589553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 10 23:18:47.589553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.5.104 (f54f144b-ead5-44f9-900b-666bb217a755) with port 9d1017db-e093-43c6-b9a1-81a16928b5cf using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network c02b141d-e215-451f-8c75-8cc086d43089. Oct 10 23:18:47.589553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ce42b63-2493-47dd-a881-e201f570662f'] Oct 10 23:18:47.589553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:18:47.589553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:18:47.592044 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:18:47.592044 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:18:47.592044 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:18:47.592044 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:18:47.592044 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:18:47.592044 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:18:47.592044 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.5.104 (f54f144b-ead5-44f9-900b-666bb217a755) with port 9d1017db-e093-43c6-b9a1-81a16928b5cf using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network c02b141d-e215-451f-8c75-8cc086d43089. Oct 10 23:18:47.592044 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ce42b63-2493-47dd-a881-e201f570662f'] Oct 10 23:18:47.592044 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:18:47.592044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bf329fd7-c0c7-44d9-9cdd-bc62ef17c76e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Returning 400 to user: Cannot associate floating IP 172.25.5.104 (f54f144b-ead5-44f9-900b-666bb217a755) with port 9d1017db-e093-43c6-b9a1-81a16928b5cf using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network c02b141d-e215-451f-8c75-8cc086d43089. Oct 10 23:18:47.592044 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-7ce42b63-2493-47dd-a881-e201f570662f'] {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:18:47.593971 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bf329fd7-c0c7-44d9-9cdd-bc62ef17c76e tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "POST /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7/action" status: 400 len: 382 microversion: 2.1 time: 0.842387 Oct 10 23:18:47.593971 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 275/581] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:18:46 2022] POST /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7/action => generated 382 bytes in 846 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:18:47.600049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-978064c5-e468-4804-88c9-f5c02535966c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:47.600772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-978064c5-e468-4804-88c9-f5c02535966c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:47.609070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-978064c5-e468-4804-88c9-f5c02535966c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:47.610555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-978064c5-e468-4804-88c9-f5c02535966c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:47.611084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-978064c5-e468-4804-88c9-f5c02535966c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:47.611884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-978064c5-e468-4804-88c9-f5c02535966c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:47.612346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-978064c5-e468-4804-88c9-f5c02535966c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:47.614012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-978064c5-e468-4804-88c9-f5c02535966c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:47.736668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fa6dbbb7-16ba-426e-90a0-d75313d17f54 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:47.746298 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fa6dbbb7-16ba-426e-90a0-d75313d17f54 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1474 microversion: 2.1 time: 0.335392 Oct 10 23:18:47.748660 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 307/582] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:47 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1474 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:47.772072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9e33b479-1386-40bb-9935-c30320530163 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Calling method '.version_select at 0x7f662ba65550>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:47.884672 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-978064c5-e468-4804-88c9-f5c02535966c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1643 microversion: 2.1 time: 0.290260 Oct 10 23:18:47.885533 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 276/583] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:47 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1643 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:47.892265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b13f1e6c-1cd7-48f3-a969-f588b2b34293 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:47.892981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b13f1e6c-1cd7-48f3-a969-f588b2b34293 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] [instance: c10a472b-a85b-41c5-9c6c-116d7c364af7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:47.900274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b13f1e6c-1cd7-48f3-a969-f588b2b34293 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:47.900812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b13f1e6c-1cd7-48f3-a969-f588b2b34293 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:47.901322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b13f1e6c-1cd7-48f3-a969-f588b2b34293 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:47.902554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b13f1e6c-1cd7-48f3-a969-f588b2b34293 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:47.903079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b13f1e6c-1cd7-48f3-a969-f588b2b34293 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:47.904410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b13f1e6c-1cd7-48f3-a969-f588b2b34293 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:48.102014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b13f1e6c-1cd7-48f3-a969-f588b2b34293 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908cc3a0520f4898a016e0a7425698da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0dc0392fb4b438c2cae7dda5bb12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:48.110899 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b13f1e6c-1cd7-48f3-a969-f588b2b34293 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] 10.222.0.23 "GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7" status: 200 len: 1314 microversion: 2.1 time: 0.223890 Oct 10 23:18:48.111486 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 277/584] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:47 2022] GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:48.116255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7efba39c-bd77-48fd-aeab-8f0c3cea6e1b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1548962283", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "6efb9146-bb54-41e6-9e93-c4bb8a061be1"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:48.199385 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-7efba39c-bd77-48fd-aeab-8f0c3cea6e1b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] validate_networks() for [('6efb9146-bb54-41e6-9e93-c4bb8a061be1', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:18:48.664553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7efba39c-bd77-48fd-aeab-8f0c3cea6e1b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:18:48.665138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7efba39c-bd77-48fd-aeab-8f0c3cea6e1b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:18:48.665488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7efba39c-bd77-48fd-aeab-8f0c3cea6e1b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:18:48.666094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7efba39c-bd77-48fd-aeab-8f0c3cea6e1b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:18:48.666670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7efba39c-bd77-48fd-aeab-8f0c3cea6e1b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:18:48.678652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7efba39c-bd77-48fd-aeab-8f0c3cea6e1b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:48.679150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7efba39c-bd77-48fd-aeab-8f0c3cea6e1b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:48.679592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7efba39c-bd77-48fd-aeab-8f0c3cea6e1b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:48.680327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7efba39c-bd77-48fd-aeab-8f0c3cea6e1b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:48.680939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7efba39c-bd77-48fd-aeab-8f0c3cea6e1b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:48.681421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7efba39c-bd77-48fd-aeab-8f0c3cea6e1b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:48.701568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-7efba39c-bd77-48fd-aeab-8f0c3cea6e1b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Getting quotas for project 1b5a9d1de27b407e91ff0ae66242ec81. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:18:48.707779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-7efba39c-bd77-48fd-aeab-8f0c3cea6e1b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Getting quotas for user 9bd83ab05cb34853bbab0f86a630aa1e and project 1b5a9d1de27b407e91ff0ae66242ec81. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:18:48.723510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7efba39c-bd77-48fd-aeab-8f0c3cea6e1b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:18:48.726031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7efba39c-bd77-48fd-aeab-8f0c3cea6e1b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:18:48.777590 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7efba39c-bd77-48fd-aeab-8f0c3cea6e1b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664423 Oct 10 23:18:48.778251 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 278/585] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:18:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:18:48.783269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-982a038a-672b-4e36-bd73-a0a25c5b5d25 req-cf0b35d9-b580-45f1-932b-c1da81361243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db1b49d1-08d6-4cb1-a27d-63944f113ea7", "name": "network-vif-plugged", "status": "completed", "tag": "53c39c27-8c25-458d-9dc7-1288b1c8ad16"}, {"server_uuid": "c10a472b-a85b-41c5-9c6c-116d7c364af7", "name": "network-vif-plugged", "status": "completed", "tag": "f73264cc-f1da-4a5c-b6f9-4701cd3675dc"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:48.796020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-982a038a-672b-4e36-bd73-a0a25c5b5d25 req-cf0b35d9-b580-45f1-932b-c1da81361243 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:48.796803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-982a038a-672b-4e36-bd73-a0a25c5b5d25 req-cf0b35d9-b580-45f1-932b-c1da81361243 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:48.797490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-982a038a-672b-4e36-bd73-a0a25c5b5d25 req-cf0b35d9-b580-45f1-932b-c1da81361243 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:48.822162 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-982a038a-672b-4e36-bd73-a0a25c5b5d25 req-cf0b35d9-b580-45f1-932b-c1da81361243 service nova] Creating event network-vif-plugged:53c39c27-8c25-458d-9dc7-1288b1c8ad16 for instance db1b49d1-08d6-4cb1-a27d-63944f113ea7 on n-h2-860864-2 Oct 10 23:18:48.823645 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-982a038a-672b-4e36-bd73-a0a25c5b5d25 req-cf0b35d9-b580-45f1-932b-c1da81361243 service nova] Creating event network-vif-plugged:f73264cc-f1da-4a5c-b6f9-4701cd3675dc for instance c10a472b-a85b-41c5-9c6c-116d7c364af7 on n-h2-860864-2 Oct 10 23:18:48.834240 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-982a038a-672b-4e36-bd73-a0a25c5b5d25 req-cf0b35d9-b580-45f1-932b-c1da81361243 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054194 Oct 10 23:18:48.834846 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 279/586] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:48.847704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c9916d7e-a307-45b3-8607-fdeb32f2b1a9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:48.849408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c9916d7e-a307-45b3-8607-fdeb32f2b1a9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: bd8c16ec-655a-451f-959f-62685aedc8af] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:48.885735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9916d7e-a307-45b3-8607-fdeb32f2b1a9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:48.893614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9916d7e-a307-45b3-8607-fdeb32f2b1a9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:48.896816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9916d7e-a307-45b3-8607-fdeb32f2b1a9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:48.898782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9916d7e-a307-45b3-8607-fdeb32f2b1a9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:48.900539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9916d7e-a307-45b3-8607-fdeb32f2b1a9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:48.902777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9916d7e-a307-45b3-8607-fdeb32f2b1a9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:48.951220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:49.218068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c9916d7e-a307-45b3-8607-fdeb32f2b1a9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:49.238056 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c9916d7e-a307-45b3-8607-fdeb32f2b1a9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af" status: 200 len: 1467 microversion: 2.1 time: 0.400297 Oct 10 23:18:49.253402 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 280/587] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:48 2022] GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af => generated 1467 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:49.253402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1e969c8f-a0d8-45ed-954f-fff9c4f567c2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:49.253402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1e969c8f-a0d8-45ed-954f-fff9c4f567c2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:49.276782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e969c8f-a0d8-45ed-954f-fff9c4f567c2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:49.278439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e969c8f-a0d8-45ed-954f-fff9c4f567c2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:49.279964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e969c8f-a0d8-45ed-954f-fff9c4f567c2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:49.281578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e969c8f-a0d8-45ed-954f-fff9c4f567c2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:49.282992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e969c8f-a0d8-45ed-954f-fff9c4f567c2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:49.283701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e969c8f-a0d8-45ed-954f-fff9c4f567c2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:49.480567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1e969c8f-a0d8-45ed-954f-fff9c4f567c2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:49.492631 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1e969c8f-a0d8-45ed-954f-fff9c4f567c2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1474 microversion: 2.1 time: 0.251575 Oct 10 23:18:49.494416 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 281/588] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:49 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1474 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:49.524469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c9da5255-e3c3-4f88-81de-1de741f3ccab tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:49.525087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c9da5255-e3c3-4f88-81de-1de741f3ccab tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:49.534641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9da5255-e3c3-4f88-81de-1de741f3ccab tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:49.540750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9da5255-e3c3-4f88-81de-1de741f3ccab tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:49.541514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9da5255-e3c3-4f88-81de-1de741f3ccab tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:49.551393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9da5255-e3c3-4f88-81de-1de741f3ccab tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:49.551906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9da5255-e3c3-4f88-81de-1de741f3ccab tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:49.552531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9da5255-e3c3-4f88-81de-1de741f3ccab tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:49.690596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c9da5255-e3c3-4f88-81de-1de741f3ccab tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:49.714286 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c9da5255-e3c3-4f88-81de-1de741f3ccab tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1215 microversion: 2.1 time: 0.202385 Oct 10 23:18:49.717010 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 282/589] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:49 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1215 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:49.723445 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9e33b479-1386-40bb-9935-c30320530163 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/f54f144b-ead5-44f9-900b-666bb217a755" status: 202 len: 0 microversion: 2.1 time: 1.956796 Oct 10 23:18:49.724105 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 308/590] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 10 23:18:47 2022] DELETE /compute/v2.1/os-floating-ips/f54f144b-ead5-44f9-900b-666bb217a755 => generated 0 bytes in 1958 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:18:49.735983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2521b9bf-86b1-477d-8f42-1988d7b51a70 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:49.738346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dcee28cb-0bbf-4aa2-91d0-2899d0dbf0c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:49.740523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dcee28cb-0bbf-4aa2-91d0-2899d0dbf0c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: db1b49d1-08d6-4cb1-a27d-63944f113ea7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:49.753899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2521b9bf-86b1-477d-8f42-1988d7b51a70 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] [instance: c10a472b-a85b-41c5-9c6c-116d7c364af7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:49.762023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcee28cb-0bbf-4aa2-91d0-2899d0dbf0c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:49.763665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcee28cb-0bbf-4aa2-91d0-2899d0dbf0c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:49.764435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcee28cb-0bbf-4aa2-91d0-2899d0dbf0c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:49.765637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcee28cb-0bbf-4aa2-91d0-2899d0dbf0c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:49.768374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcee28cb-0bbf-4aa2-91d0-2899d0dbf0c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:49.769769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcee28cb-0bbf-4aa2-91d0-2899d0dbf0c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:49.775535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2521b9bf-86b1-477d-8f42-1988d7b51a70 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:49.779800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2521b9bf-86b1-477d-8f42-1988d7b51a70 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:49.780542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2521b9bf-86b1-477d-8f42-1988d7b51a70 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:49.781549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2521b9bf-86b1-477d-8f42-1988d7b51a70 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:49.783429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2521b9bf-86b1-477d-8f42-1988d7b51a70 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:49.784139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2521b9bf-86b1-477d-8f42-1988d7b51a70 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:50.043124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dcee28cb-0bbf-4aa2-91d0-2899d0dbf0c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:50.053205 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dcee28cb-0bbf-4aa2-91d0-2899d0dbf0c0 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/db1b49d1-08d6-4cb1-a27d-63944f113ea7" status: 200 len: 1318 microversion: 2.1 time: 0.321994 Oct 10 23:18:50.054539 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 309/591] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:49 2022] GET /compute/v2.1/servers/db1b49d1-08d6-4cb1-a27d-63944f113ea7 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:50.066491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-82a2dc94-b598-486b-9da3-03c1a0a05f41 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Action: 'action', calling method: .version_select at 0x7f6631ee09d0>, body: {"removeFloatingIp": {"address": "172.25.5.40"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:50.109592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2521b9bf-86b1-477d-8f42-1988d7b51a70 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908cc3a0520f4898a016e0a7425698da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0dc0392fb4b438c2cae7dda5bb12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:50.126012 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2521b9bf-86b1-477d-8f42-1988d7b51a70 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] 10.222.0.23 "GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7" status: 200 len: 1314 microversion: 2.1 time: 0.405552 Oct 10 23:18:50.126910 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 283/592] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:49 2022] GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:50.264631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-82a2dc94-b598-486b-9da3-03c1a0a05f41 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:50.272181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82a2dc94-b598-486b-9da3-03c1a0a05f41 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:50.272735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82a2dc94-b598-486b-9da3-03c1a0a05f41 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:50.273175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82a2dc94-b598-486b-9da3-03c1a0a05f41 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:50.274415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82a2dc94-b598-486b-9da3-03c1a0a05f41 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:50.275068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82a2dc94-b598-486b-9da3-03c1a0a05f41 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:50.275731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82a2dc94-b598-486b-9da3-03c1a0a05f41 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:50.519254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3c81465d-1bbd-44ac-aabf-d07771407b83 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:50.520371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3c81465d-1bbd-44ac-aabf-d07771407b83 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:50.534184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c81465d-1bbd-44ac-aabf-d07771407b83 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:50.534695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c81465d-1bbd-44ac-aabf-d07771407b83 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:50.539974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c81465d-1bbd-44ac-aabf-d07771407b83 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:50.542310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c81465d-1bbd-44ac-aabf-d07771407b83 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:50.543370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c81465d-1bbd-44ac-aabf-d07771407b83 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:50.546670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c81465d-1bbd-44ac-aabf-d07771407b83 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:51.042286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3c81465d-1bbd-44ac-aabf-d07771407b83 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:51.058929 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3c81465d-1bbd-44ac-aabf-d07771407b83 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1474 microversion: 2.1 time: 0.543439 Oct 10 23:18:51.060451 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 284/593] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:50 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1474 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:18:51.065477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3a921043-6ee7-4b42-82ff-5599ca472e7c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:51.066094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3a921043-6ee7-4b42-82ff-5599ca472e7c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:51.080910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a921043-6ee7-4b42-82ff-5599ca472e7c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:51.081436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a921043-6ee7-4b42-82ff-5599ca472e7c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:51.081879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a921043-6ee7-4b42-82ff-5599ca472e7c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:51.082601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a921043-6ee7-4b42-82ff-5599ca472e7c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:51.083057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a921043-6ee7-4b42-82ff-5599ca472e7c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:51.083487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a921043-6ee7-4b42-82ff-5599ca472e7c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:51.182855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82a2dc94-b598-486b-9da3-03c1a0a05f41 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "refresh_cache-f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" {{(pid=120614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 23:18:51.183372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82a2dc94-b598-486b-9da3-03c1a0a05f41 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquired lock "refresh_cache-f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" {{(pid=120614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 23:18:51.528765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3a921043-6ee7-4b42-82ff-5599ca472e7c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:51.541263 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3a921043-6ee7-4b42-82ff-5599ca472e7c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1269 microversion: 2.1 time: 0.478531 Oct 10 23:18:51.561092 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 285/594] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:51 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1269 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:51.569903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f045570c-0e33-438f-9c5e-d2a35da42489 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:51.571964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f045570c-0e33-438f-9c5e-d2a35da42489 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: db1b49d1-08d6-4cb1-a27d-63944f113ea7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:51.582117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f045570c-0e33-438f-9c5e-d2a35da42489 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:51.583513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f045570c-0e33-438f-9c5e-d2a35da42489 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:51.584152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f045570c-0e33-438f-9c5e-d2a35da42489 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:51.585096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f045570c-0e33-438f-9c5e-d2a35da42489 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:51.585768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f045570c-0e33-438f-9c5e-d2a35da42489 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:51.586430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f045570c-0e33-438f-9c5e-d2a35da42489 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:52.139529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f045570c-0e33-438f-9c5e-d2a35da42489 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:52.155568 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f045570c-0e33-438f-9c5e-d2a35da42489 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/db1b49d1-08d6-4cb1-a27d-63944f113ea7" status: 200 len: 1468 microversion: 2.1 time: 0.590353 Oct 10 23:18:52.156770 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 286/595] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:51 2022] GET /compute/v2.1/servers/db1b49d1-08d6-4cb1-a27d-63944f113ea7 => generated 1468 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:52.162918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8d497dfa-7ab0-4c45-8d7d-1678e277040b tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:52.163819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8d497dfa-7ab0-4c45-8d7d-1678e277040b tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] [instance: c10a472b-a85b-41c5-9c6c-116d7c364af7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:52.176495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d497dfa-7ab0-4c45-8d7d-1678e277040b tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:52.177152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d497dfa-7ab0-4c45-8d7d-1678e277040b tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:52.177753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d497dfa-7ab0-4c45-8d7d-1678e277040b tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:52.179156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d497dfa-7ab0-4c45-8d7d-1678e277040b tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:52.179777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d497dfa-7ab0-4c45-8d7d-1678e277040b tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:52.180612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d497dfa-7ab0-4c45-8d7d-1678e277040b tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:52.512393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-82a2dc94-b598-486b-9da3-03c1a0a05f41 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Building network info cache for instance {{(pid=120614) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 23:18:52.927749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8d497dfa-7ab0-4c45-8d7d-1678e277040b tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908cc3a0520f4898a016e0a7425698da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0dc0392fb4b438c2cae7dda5bb12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:52.938122 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8d497dfa-7ab0-4c45-8d7d-1678e277040b tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] 10.222.0.23 "GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7" status: 200 len: 1464 microversion: 2.1 time: 0.779791 Oct 10 23:18:52.971782 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 287/596] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:52 2022] GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7 => generated 1464 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:52.986188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4b220889-302f-44dd-a551-d7000f0f6545 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:52.987212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4b220889-302f-44dd-a551-d7000f0f6545 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:53.004300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b220889-302f-44dd-a551-d7000f0f6545 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:53.005602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b220889-302f-44dd-a551-d7000f0f6545 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:53.006310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b220889-302f-44dd-a551-d7000f0f6545 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:53.007269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b220889-302f-44dd-a551-d7000f0f6545 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:53.010580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b220889-302f-44dd-a551-d7000f0f6545 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:53.011337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b220889-302f-44dd-a551-d7000f0f6545 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:53.537300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4b220889-302f-44dd-a551-d7000f0f6545 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:53.549040 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4b220889-302f-44dd-a551-d7000f0f6545 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1474 microversion: 2.1 time: 0.575174 Oct 10 23:18:53.568569 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 288/597] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:52 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1474 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:53.577998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-19ebb51f-d3d3-4349-9733-da25c375239f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:53.583854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-19ebb51f-d3d3-4349-9733-da25c375239f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:53.584757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-19ebb51f-d3d3-4349-9733-da25c375239f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Searching by: {'reservation_id': 'r-zpigf040', 'deleted': False, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed'} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:18:53.591548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19ebb51f-d3d3-4349-9733-da25c375239f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:53.592578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19ebb51f-d3d3-4349-9733-da25c375239f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:53.593175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19ebb51f-d3d3-4349-9733-da25c375239f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:53.594203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19ebb51f-d3d3-4349-9733-da25c375239f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:53.596262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19ebb51f-d3d3-4349-9733-da25c375239f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:53.596868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19ebb51f-d3d3-4349-9733-da25c375239f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:53.780546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.multi_cell_list [None req-19ebb51f-d3d3-4349-9733-da25c375239f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120613) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:18:53.913883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-19ebb51f-d3d3-4349-9733-da25c375239f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:53.924953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19ebb51f-d3d3-4349-9733-da25c375239f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:53.925752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19ebb51f-d3d3-4349-9733-da25c375239f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:53.926839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19ebb51f-d3d3-4349-9733-da25c375239f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:53.962143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-82a2dc94-b598-486b-9da3-03c1a0a05f41 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Updating instance_info_cache with network_info: [{"id": "9d1017db-e093-43c6-b9a1-81a16928b5cf", "address": "fa:16:3e:cf:4a:3e", "network": {"id": "d3362ac6-6706-413b-9654-0263e4510ad8", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-146927878-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c7443a53a70743a09144270de0904832", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9d1017db-e0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120614) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 23:18:53.980167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82a2dc94-b598-486b-9da3-03c1a0a05f41 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Releasing lock "refresh_cache-f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" {{(pid=120614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 23:18:53.981824 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-82a2dc94-b598-486b-9da3-03c1a0a05f41 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "POST /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7/action" status: 202 len: 0 microversion: 2.1 time: 3.925566 Oct 10 23:18:53.986456 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 310/598] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:18:50 2022] POST /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7/action => generated 0 bytes in 3931 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 23:18:53.992035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-1f131f04-72a9-4ab7-9625-10c59de12214 req-0cc3ec77-53e8-478d-bbb4-d89b095ff9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7", "tag": "9d1017db-e093-43c6-b9a1-81a16928b5cf"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:54.006727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1f131f04-72a9-4ab7-9625-10c59de12214 req-0cc3ec77-53e8-478d-bbb4-d89b095ff9a7 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:54.007612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1f131f04-72a9-4ab7-9625-10c59de12214 req-0cc3ec77-53e8-478d-bbb4-d89b095ff9a7 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:54.008350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1f131f04-72a9-4ab7-9625-10c59de12214 req-0cc3ec77-53e8-478d-bbb4-d89b095ff9a7 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:54.025693 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-1f131f04-72a9-4ab7-9625-10c59de12214 req-0cc3ec77-53e8-478d-bbb4-d89b095ff9a7 service nova] Creating event network-changed:9d1017db-e093-43c6-b9a1-81a16928b5cf for instance f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 on n-h1-860864-2 Oct 10 23:18:54.038774 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-1f131f04-72a9-4ab7-9625-10c59de12214 req-0cc3ec77-53e8-478d-bbb4-d89b095ff9a7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048703 Oct 10 23:18:54.040818 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 311/599] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:54.052100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3a92c3a7-1ee3-4294-901c-e1f40f0b3483 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:54.053173 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3a92c3a7-1ee3-4294-901c-e1f40f0b3483 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:54.067259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a92c3a7-1ee3-4294-901c-e1f40f0b3483 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:54.068639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a92c3a7-1ee3-4294-901c-e1f40f0b3483 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:54.070314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a92c3a7-1ee3-4294-901c-e1f40f0b3483 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:54.071814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a92c3a7-1ee3-4294-901c-e1f40f0b3483 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:54.072882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a92c3a7-1ee3-4294-901c-e1f40f0b3483 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:54.073938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a92c3a7-1ee3-4294-901c-e1f40f0b3483 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:54.459573 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-19ebb51f-d3d3-4349-9733-da25c375239f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?reservation_id=r-zpigf040" status: 200 len: 2928 microversion: 2.1 time: 0.888353 Oct 10 23:18:54.460576 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 289/600] 10.222.0.23 () {58 vars in 1197 bytes} [Mon Oct 10 23:18:53 2022] GET /compute/v2.1/servers/detail?reservation_id=r-zpigf040 => generated 2928 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:54.474214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3a92c3a7-1ee3-4294-901c-e1f40f0b3483 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:54.489984 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3a92c3a7-1ee3-4294-901c-e1f40f0b3483 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1311 microversion: 2.1 time: 0.446927 Oct 10 23:18:54.490663 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 312/601] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:54 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1311 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:54.501665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fd7bcd58-8866-40f7-8b16-07be118b5cc0 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Calling method '.version_select at 0x7f662b9d99d0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:55.010737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-69db70bc-3f26-4329-93a3-c9c2cf2aefb7 tempest-TenantUsagesTestJSON-105927137 tempest-TenantUsagesTestJSON-105927137-project-admin] Calling method '.version_select at 0x7f662bc68790>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:55.034146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69db70bc-3f26-4329-93a3-c9c2cf2aefb7 tempest-TenantUsagesTestJSON-105927137 tempest-TenantUsagesTestJSON-105927137-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:55.035180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69db70bc-3f26-4329-93a3-c9c2cf2aefb7 tempest-TenantUsagesTestJSON-105927137 tempest-TenantUsagesTestJSON-105927137-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:55.035820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69db70bc-3f26-4329-93a3-c9c2cf2aefb7 tempest-TenantUsagesTestJSON-105927137 tempest-TenantUsagesTestJSON-105927137-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:55.057883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69db70bc-3f26-4329-93a3-c9c2cf2aefb7 tempest-TenantUsagesTestJSON-105927137 tempest-TenantUsagesTestJSON-105927137-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:55.060460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69db70bc-3f26-4329-93a3-c9c2cf2aefb7 tempest-TenantUsagesTestJSON-105927137 tempest-TenantUsagesTestJSON-105927137-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:55.063545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69db70bc-3f26-4329-93a3-c9c2cf2aefb7 tempest-TenantUsagesTestJSON-105927137 tempest-TenantUsagesTestJSON-105927137-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:55.103458 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-69db70bc-3f26-4329-93a3-c9c2cf2aefb7 tempest-TenantUsagesTestJSON-105927137 tempest-TenantUsagesTestJSON-105927137-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/b7c0dc0392fb4b438c2cae7dda5bb12b?start=2022-10-09T23%3A18%3A52.963692&end=2022-10-11T23%3A18%3A52.963692" status: 200 len: 695 microversion: 2.1 time: 0.641740 Oct 10 23:18:55.104285 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 290/602] 10.222.0.23 () {58 vars in 1412 bytes} [Mon Oct 10 23:18:54 2022] GET /compute/v2.1/os-simple-tenant-usage/b7c0dc0392fb4b438c2cae7dda5bb12b?start=2022-10-09T23%3A18%3A52.963692&end=2022-10-11T23%3A18%3A52.963692 => generated 695 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:55.114350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b8046ae1-bd4e-427d-b5da-bdf9033ab2c6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:55.132728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.compute.server_groups [None req-b8046ae1-bd4e-427d-b5da-bdf9033ab2c6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Querying cell c35e3cac-0e4f-44cc-a53a-8910e1eecc88(cell1) for 2 instances {{(pid=120613) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 10 23:18:55.133976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8046ae1-bd4e-427d-b5da-bdf9033ab2c6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:55.134652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8046ae1-bd4e-427d-b5da-bdf9033ab2c6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:55.135246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8046ae1-bd4e-427d-b5da-bdf9033ab2c6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:55.172156 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b8046ae1-bd4e-427d-b5da-bdf9033ab2c6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/e5c534fa-95d5-4180-8bf7-c27512418476" status: 200 len: 271 microversion: 2.1 time: 0.066386 Oct 10 23:18:55.173040 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 291/603] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 10 23:18:55 2022] GET /compute/v2.1/os-server-groups/e5c534fa-95d5-4180-8bf7-c27512418476 => generated 271 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:55.183995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-85039ee6-c071-4b9c-b5f7-bb57e21e9fa5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:55.184846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-85039ee6-c071-4b9c-b5f7-bb57e21e9fa5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:55.191596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85039ee6-c071-4b9c-b5f7-bb57e21e9fa5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:55.192382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85039ee6-c071-4b9c-b5f7-bb57e21e9fa5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:55.193010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85039ee6-c071-4b9c-b5f7-bb57e21e9fa5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:55.193929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85039ee6-c071-4b9c-b5f7-bb57e21e9fa5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:55.195217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85039ee6-c071-4b9c-b5f7-bb57e21e9fa5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:55.196076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85039ee6-c071-4b9c-b5f7-bb57e21e9fa5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:55.758681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-85039ee6-c071-4b9c-b5f7-bb57e21e9fa5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:55.781842 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-85039ee6-c071-4b9c-b5f7-bb57e21e9fa5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1474 microversion: 2.1 time: 0.601432 Oct 10 23:18:55.783353 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 292/604] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:55 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1474 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:55.797101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-726fb631-edd7-4a3c-ba70-a9c5729019a3 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Calling method '.version_select at 0x7f662bb9c700>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:55.825195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-726fb631-edd7-4a3c-ba70-a9c5729019a3 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:55.827130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-726fb631-edd7-4a3c-ba70-a9c5729019a3 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:55.828166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-726fb631-edd7-4a3c-ba70-a9c5729019a3 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:55.878633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-726fb631-edd7-4a3c-ba70-a9c5729019a3 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:55.880869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-726fb631-edd7-4a3c-ba70-a9c5729019a3 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:55.882955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-726fb631-edd7-4a3c-ba70-a9c5729019a3 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:55.919901 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-726fb631-edd7-4a3c-ba70-a9c5729019a3 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/b7c0dc0392fb4b438c2cae7dda5bb12b?start=2022-10-09T23%3A18%3A52.963692&end=2022-10-11T23%3A18%3A52.963692" status: 200 len: 695 microversion: 2.1 time: 0.129358 Oct 10 23:18:55.934531 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 293/605] 10.222.0.23 () {58 vars in 1412 bytes} [Mon Oct 10 23:18:55 2022] GET /compute/v2.1/os-simple-tenant-usage/b7c0dc0392fb4b438c2cae7dda5bb12b?start=2022-10-09T23%3A18%3A52.963692&end=2022-10-11T23%3A18%3A52.963692 => generated 695 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:55.949192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a5867442-4541-4fc8-97d7-53948d75ea7b tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:55.950583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a5867442-4541-4fc8-97d7-53948d75ea7b tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] [instance: bd8c16ec-655a-451f-959f-62685aedc8af] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:55.957846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5867442-4541-4fc8-97d7-53948d75ea7b tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:55.958965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5867442-4541-4fc8-97d7-53948d75ea7b tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:55.959600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5867442-4541-4fc8-97d7-53948d75ea7b tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:55.960429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5867442-4541-4fc8-97d7-53948d75ea7b tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:55.961005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5867442-4541-4fc8-97d7-53948d75ea7b tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:55.961685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5867442-4541-4fc8-97d7-53948d75ea7b tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:56.270116 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a5867442-4541-4fc8-97d7-53948d75ea7b tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af" status: 200 len: 1618 microversion: 2.1 time: 0.334105 Oct 10 23:18:56.288356 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 294/606] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:55 2022] GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af => generated 1618 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:56.294516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d2393d01-4529-4535-adcd-23f5e9be9b6d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:56.295123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d2393d01-4529-4535-adcd-23f5e9be9b6d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:56.304430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2393d01-4529-4535-adcd-23f5e9be9b6d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:56.304947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2393d01-4529-4535-adcd-23f5e9be9b6d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:56.305718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2393d01-4529-4535-adcd-23f5e9be9b6d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:56.306804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2393d01-4529-4535-adcd-23f5e9be9b6d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:56.308491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2393d01-4529-4535-adcd-23f5e9be9b6d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:56.309200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2393d01-4529-4535-adcd-23f5e9be9b6d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:56.597330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d2393d01-4529-4535-adcd-23f5e9be9b6d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:56.611070 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d2393d01-4529-4535-adcd-23f5e9be9b6d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1311 microversion: 2.1 time: 0.321274 Oct 10 23:18:56.611670 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 295/607] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:56 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1311 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:56.618990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-74521d7c-fa04-4a66-9671-3c374eb18c06 tempest-TenantUsagesTestJSON-105927137 tempest-TenantUsagesTestJSON-105927137-project-admin] Calling method '.version_select at 0x7f662ba9c4c0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:56.639260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74521d7c-fa04-4a66-9671-3c374eb18c06 tempest-TenantUsagesTestJSON-105927137 tempest-TenantUsagesTestJSON-105927137-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:56.641456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74521d7c-fa04-4a66-9671-3c374eb18c06 tempest-TenantUsagesTestJSON-105927137 tempest-TenantUsagesTestJSON-105927137-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:56.642839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74521d7c-fa04-4a66-9671-3c374eb18c06 tempest-TenantUsagesTestJSON-105927137 tempest-TenantUsagesTestJSON-105927137-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:56.671019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74521d7c-fa04-4a66-9671-3c374eb18c06 tempest-TenantUsagesTestJSON-105927137 tempest-TenantUsagesTestJSON-105927137-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:56.672629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74521d7c-fa04-4a66-9671-3c374eb18c06 tempest-TenantUsagesTestJSON-105927137 tempest-TenantUsagesTestJSON-105927137-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:56.673667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74521d7c-fa04-4a66-9671-3c374eb18c06 tempest-TenantUsagesTestJSON-105927137 tempest-TenantUsagesTestJSON-105927137-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:56.742620 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-74521d7c-fa04-4a66-9671-3c374eb18c06 tempest-TenantUsagesTestJSON-105927137 tempest-TenantUsagesTestJSON-105927137-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-09T23%3A18%3A52.963692&end=2022-10-11T23%3A18%3A52.963692&detailed=1" status: 200 len: 7273 microversion: 2.1 time: 0.128462 Oct 10 23:18:56.756447 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 296/608] 10.222.0.23 () {58 vars in 1335 bytes} [Mon Oct 10 23:18:56 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-09T23%3A18%3A52.963692&end=2022-10-11T23%3A18%3A52.963692&detailed=1 => generated 7273 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:56.767229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-585c8535-cad3-4f40-bd0e-0fdda4861e8a req-af15057a-3971-43bb-821a-3a82177bd363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87be6fab-2ad1-4a49-8b54-8eb2e50c3e29", "tag": "0e2b501e-2b2d-414d-9297-d0c72224e923"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:56.791365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-585c8535-cad3-4f40-bd0e-0fdda4861e8a req-af15057a-3971-43bb-821a-3a82177bd363 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:56.791984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-585c8535-cad3-4f40-bd0e-0fdda4861e8a req-af15057a-3971-43bb-821a-3a82177bd363 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:56.792433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-585c8535-cad3-4f40-bd0e-0fdda4861e8a req-af15057a-3971-43bb-821a-3a82177bd363 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:56.843712 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-585c8535-cad3-4f40-bd0e-0fdda4861e8a req-af15057a-3971-43bb-821a-3a82177bd363 service nova] Creating event network-changed:0e2b501e-2b2d-414d-9297-d0c72224e923 for instance 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 on n-h1-860864-2 Oct 10 23:18:56.855863 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-585c8535-cad3-4f40-bd0e-0fdda4861e8a req-af15057a-3971-43bb-821a-3a82177bd363 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097830 Oct 10 23:18:56.857538 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 297/609] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:18:56.862204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4deb675e-b8cb-49b8-9e36-47a15f4c40d7 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:56.869939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4deb675e-b8cb-49b8-9e36-47a15f4c40d7 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] [instance: db1b49d1-08d6-4cb1-a27d-63944f113ea7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:56.884354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4deb675e-b8cb-49b8-9e36-47a15f4c40d7 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:56.885040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4deb675e-b8cb-49b8-9e36-47a15f4c40d7 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:56.885778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4deb675e-b8cb-49b8-9e36-47a15f4c40d7 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:56.886917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4deb675e-b8cb-49b8-9e36-47a15f4c40d7 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:56.889229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4deb675e-b8cb-49b8-9e36-47a15f4c40d7 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:56.890411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4deb675e-b8cb-49b8-9e36-47a15f4c40d7 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:56.961491 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fd7bcd58-8866-40f7-8b16-07be118b5cc0 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/c1afd9c0-eb3a-4260-a8d9-6e66b73f25c9" status: 202 len: 0 microversion: 2.1 time: 2.469670 Oct 10 23:18:56.962407 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 313/610] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 10 23:18:54 2022] DELETE /compute/v2.1/os-floating-ips/c1afd9c0-eb3a-4260-a8d9-6e66b73f25c9 => generated 0 bytes in 2471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:18:56.970774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ac8ec445-e5b6-4fa2-9b36-292c08528d8a tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:56.971549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ac8ec445-e5b6-4fa2-9b36-292c08528d8a tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] [instance: c10a472b-a85b-41c5-9c6c-116d7c364af7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:56.983689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac8ec445-e5b6-4fa2-9b36-292c08528d8a tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:56.985994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac8ec445-e5b6-4fa2-9b36-292c08528d8a tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:56.988337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac8ec445-e5b6-4fa2-9b36-292c08528d8a tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:56.989204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac8ec445-e5b6-4fa2-9b36-292c08528d8a tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:56.991624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac8ec445-e5b6-4fa2-9b36-292c08528d8a tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:56.992161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac8ec445-e5b6-4fa2-9b36-292c08528d8a tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:57.030115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ac8ec445-e5b6-4fa2-9b36-292c08528d8a tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] [instance: c10a472b-a85b-41c5-9c6c-116d7c364af7] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:18:57.139674 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4deb675e-b8cb-49b8-9e36-47a15f4c40d7 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/db1b49d1-08d6-4cb1-a27d-63944f113ea7" status: 200 len: 1619 microversion: 2.1 time: 0.280184 Oct 10 23:18:57.142263 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 298/611] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:56 2022] GET /compute/v2.1/servers/db1b49d1-08d6-4cb1-a27d-63944f113ea7 => generated 1619 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:57.151793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4474d54b-6ef2-477c-80ac-0faed92174c0 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:57.154464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4474d54b-6ef2-477c-80ac-0faed92174c0 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:57.165210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4474d54b-6ef2-477c-80ac-0faed92174c0 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:57.166222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4474d54b-6ef2-477c-80ac-0faed92174c0 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:57.166873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4474d54b-6ef2-477c-80ac-0faed92174c0 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:57.167922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4474d54b-6ef2-477c-80ac-0faed92174c0 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:57.168529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4474d54b-6ef2-477c-80ac-0faed92174c0 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:57.169364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4474d54b-6ef2-477c-80ac-0faed92174c0 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:57.177146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:57.207800 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ac8ec445-e5b6-4fa2-9b36-292c08528d8a tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7" status: 204 len: 0 microversion: 2.1 time: 0.243324 Oct 10 23:18:57.210312 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 314/612] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:18:56 2022] DELETE /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:18:57.220742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0b0f6509-0ca0-4a5b-b1f4-0826b4bf19e5 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Action: 'action', calling method: .version_select at 0x7f6631ee08b0>, body: {"addFloatingIp": {"address": ""}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:57.236181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0b0f6509-0ca0-4a5b-b1f4-0826b4bf19e5 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Request method failure captured: Oct 10 23:18:57.236181 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7/action HTTP/1.1 Oct 10 23:18:57.236181 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:18:57.236181 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:18:57.236181 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:18:57.236181 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 34 Oct 10 23:18:57.236181 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:18:57.236181 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:18:57.236181 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:18:57.236181 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:18:57.236181 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKg0cwut1HB5YgrFXzkSoyTQeSNf6qxj0xNy0WuCa7qczJ5YOryQpfrH6W3_OXKI0wSEFQ7dkHey15_8SU63XZ1M5zNoYA5xJKEUqbiOMJD1gjTG32yJeFhm5TI4ij7gW9yADfvCHHnzt25MECSs7hWoeJNb8LWbHa2evy2T-Sx_2Fc Oct 10 23:18:57.236181 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:18:57.236181 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:18:57.236181 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:18:57.236181 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:18:57.236181 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:18:57.236181 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:18:57.236181 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: c7443a53a70743a09144270de0904832 Oct 10 23:18:57.236181 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-521344888 Oct 10 23:18:57.236181 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:18:57.236181 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:18:57.238120 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c7443a53a70743a09144270de0904832"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7443a53a70743a09144270de0904832"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7443a53a70743a09144270de0904832"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c7443a53a70743a09144270de0904832", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:18:57.238120 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-521344888 Oct 10 23:18:57.238120 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: c7443a53a70743a09144270de0904832 Oct 10 23:18:57.238120 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-521344888 Oct 10 23:18:57.238120 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project Oct 10 23:18:57.238120 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:18:57.238120 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:18:57.238120 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 12f4b43c646c4aba88160ffeb98c6aa8 Oct 10 23:18:57.238120 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project Oct 10 23:18:57.238120 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:18:57.238120 n-d-860864-2 devstack@n-api.service[120614]: {"addFloatingIp": {"address": ""}} Oct 10 23:18:57.238120 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:18:57.238120 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 10 23:18:57.239249 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7', 'body': {'addFloatingIp': {'address': ''}}} Oct 10 23:18:57.239249 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:18:57.239249 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:18:57.239249 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:18:57.239249 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:18:57.239249 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:18:57.239249 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:18:57.239249 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 10 23:18:57.239249 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:18:57.239249 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 10 23:18:57.239249 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 10 23:18:57.239249 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:18:57.239249 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 10 23:18:57.239249 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi '' Oct 10 23:18:57.239249 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:18:57.239249 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:18:57.239249 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:18:57.239249 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:18:57.239249 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:18:57.239249 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:18:57.239249 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:18:57.239249 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:18:57.240914 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:18:57.240914 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:18:57.240914 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:18:57.240914 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:18:57.240914 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:18:57.240914 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:18:57.240914 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:18:57.240914 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:18:57.240914 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:18:57.240914 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:18:57.240914 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 10 23:18:57.240914 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:18:57.240914 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:18:57.240914 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:18:57.240914 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:18:57.240914 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:18:57.240914 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:18:57.240914 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:18:57.240914 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:18:57.242338 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 10 23:18:57.242338 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:18:57.243902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0b0f6509-0ca0-4a5b-b1f4-0826b4bf19e5 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:18:57.245259 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0b0f6509-0ca0-4a5b-b1f4-0826b4bf19e5 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "POST /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7/action" status: 400 len: 142 microversion: 2.1 time: 0.032624 Oct 10 23:18:57.246251 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 315/613] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:18:57 2022] POST /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7/action => generated 142 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:18:57.255963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3c0128a5-90ac-4453-9500-006055dc313d tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:57.258799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3c0128a5-90ac-4453-9500-006055dc313d tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] [instance: c10a472b-a85b-41c5-9c6c-116d7c364af7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:57.266862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c0128a5-90ac-4453-9500-006055dc313d tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:57.267700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c0128a5-90ac-4453-9500-006055dc313d tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:57.268411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c0128a5-90ac-4453-9500-006055dc313d tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:57.269549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c0128a5-90ac-4453-9500-006055dc313d tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:57.270171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c0128a5-90ac-4453-9500-006055dc313d tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:57.270755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c0128a5-90ac-4453-9500-006055dc313d tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:57.511842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4474d54b-6ef2-477c-80ac-0faed92174c0 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:57.529656 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4474d54b-6ef2-477c-80ac-0faed92174c0 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1474 microversion: 2.1 time: 0.384872 Oct 10 23:18:57.545553 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 299/614] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:57 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1474 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:57.552574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e473bf19-b6d8-4791-b79b-ffb366d94a42 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:57.558359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e473bf19-b6d8-4791-b79b-ffb366d94a42 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:57.565794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e473bf19-b6d8-4791-b79b-ffb366d94a42 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:57.566937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e473bf19-b6d8-4791-b79b-ffb366d94a42 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:57.567716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e473bf19-b6d8-4791-b79b-ffb366d94a42 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:57.568812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e473bf19-b6d8-4791-b79b-ffb366d94a42 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:57.569751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e473bf19-b6d8-4791-b79b-ffb366d94a42 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:57.570347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e473bf19-b6d8-4791-b79b-ffb366d94a42 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:57.598648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3c0128a5-90ac-4453-9500-006055dc313d tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908cc3a0520f4898a016e0a7425698da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0dc0392fb4b438c2cae7dda5bb12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:57.608570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e473bf19-b6d8-4791-b79b-ffb366d94a42 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "refresh_cache-f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" {{(pid=120613) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 23:18:57.610483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e473bf19-b6d8-4791-b79b-ffb366d94a42 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquired lock "refresh_cache-f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" {{(pid=120613) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 23:18:57.627609 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3c0128a5-90ac-4453-9500-006055dc313d tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] 10.222.0.23 "GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7" status: 200 len: 1470 microversion: 2.1 time: 0.360287 Oct 10 23:18:57.643450 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 316/615] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:57 2022] GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7 => generated 1470 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:57.655938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-72945224-c803-43e5-aa2f-276b38b16052 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-664899007", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "90aa3419-44a6-4b0d-9af1-5f6df3554b71"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:57.724461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-72945224-c803-43e5-aa2f-276b38b16052 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] validate_networks() for None {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:18:57.891477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e473bf19-b6d8-4791-b79b-ffb366d94a42 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Releasing lock "refresh_cache-f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" {{(pid=120613) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 23:18:57.892071 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-e473bf19-b6d8-4791-b79b-ffb366d94a42 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] HTTP exception thrown: floating IP not found Oct 10 23:18:57.893933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e473bf19-b6d8-4791-b79b-ffb366d94a42 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Request method failure captured: Oct 10 23:18:57.893933 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7/action HTTP/1.1 Oct 10 23:18:57.893933 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:18:57.893933 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:18:57.893933 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:18:57.893933 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 41 Oct 10 23:18:57.893933 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:18:57.893933 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:18:57.893933 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:18:57.893933 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:18:57.893933 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKg0cwut1HB5YgrFXzkSoyTQeSNf6qxj0xNy0WuCa7qczJ5YOryQpfrH6W3_OXKI0wSEFQ7dkHey15_8SU63XZ1M5zNoYA5xJKEUqbiOMJD1gjTG32yJeFhm5TI4ij7gW9yADfvCHHnzt25MECSs7hWoeJNb8LWbHa2evy2T-Sx_2Fc Oct 10 23:18:57.893933 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:18:57.893933 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:18:57.893933 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:18:57.893933 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:18:57.893933 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:18:57.893933 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:18:57.893933 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: c7443a53a70743a09144270de0904832 Oct 10 23:18:57.893933 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-521344888 Oct 10 23:18:57.893933 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:18:57.893933 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:18:57.895475 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c7443a53a70743a09144270de0904832"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7443a53a70743a09144270de0904832"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7443a53a70743a09144270de0904832"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c7443a53a70743a09144270de0904832", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:18:57.895475 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-521344888 Oct 10 23:18:57.895475 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: c7443a53a70743a09144270de0904832 Oct 10 23:18:57.895475 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-521344888 Oct 10 23:18:57.895475 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project Oct 10 23:18:57.895475 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:18:57.895475 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:18:57.895475 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 12f4b43c646c4aba88160ffeb98c6aa8 Oct 10 23:18:57.895475 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project Oct 10 23:18:57.895475 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:18:57.895475 n-d-860864-2 devstack@n-api.service[120613]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 10 23:18:57.895475 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:18:57.895475 n-d-860864-2 devstack@n-api.service[120613]: exception: floating IP not found Oct 10 23:18:57.896474 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 10 23:18:57.896474 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:18:57.896474 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:18:57.896474 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 10 23:18:57.896474 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 10 23:18:57.896474 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 10 23:18:57.896474 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 10 23:18:57.896474 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 10 23:18:57.896474 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 10 23:18:57.896474 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 10 23:18:57.896474 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 10 23:18:57.896474 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 10 23:18:57.896474 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:18:57.896474 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:18:57.896474 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:18:57.896474 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:18:57.896474 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:18:57.896474 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:18:57.896474 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:18:57.898002 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:18:57.898002 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:18:57.898002 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:18:57.898002 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:18:57.898002 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:18:57.898002 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:18:57.898002 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:18:57.898002 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 10 23:18:57.898002 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 23:18:57.898002 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 10 23:18:57.898002 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:18:57.898002 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:18:57.898002 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:18:57.898002 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:18:57.898002 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:18:57.898002 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:18:57.898002 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:18:57.898002 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:18:57.898002 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 10 23:18:57.898002 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:18:57.899235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e473bf19-b6d8-4791-b79b-ffb366d94a42 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Returning 404 to user: floating IP not found {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:18:57.899235 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e473bf19-b6d8-4791-b79b-ffb366d94a42 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "POST /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7/action" status: 404 len: 67 microversion: 2.1 time: 0.348711 Oct 10 23:18:57.900527 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 300/616] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:18:57 2022] POST /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7/action => generated 67 bytes in 354 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:18:57.910987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-07534025-ce19-4f3c-ae2e-03d990413762 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:57.911626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-07534025-ce19-4f3c-ae2e-03d990413762 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:57.925682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07534025-ce19-4f3c-ae2e-03d990413762 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:57.926194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07534025-ce19-4f3c-ae2e-03d990413762 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:57.926670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07534025-ce19-4f3c-ae2e-03d990413762 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:57.927439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07534025-ce19-4f3c-ae2e-03d990413762 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:57.927935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07534025-ce19-4f3c-ae2e-03d990413762 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:57.928365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07534025-ce19-4f3c-ae2e-03d990413762 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:58.565899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-07534025-ce19-4f3c-ae2e-03d990413762 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:58.579910 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-07534025-ce19-4f3c-ae2e-03d990413762 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1311 microversion: 2.1 time: 0.678182 Oct 10 23:18:58.609006 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 301/617] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:57 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1311 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:58.618269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0b2ae49b-5f71-4521-be10-42766b2ac1f0 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Action: 'action', calling method: .version_select at 0x7f6631ee09d0>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:18:58.747662 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-0b2ae49b-5f71-4521-be10-42766b2ac1f0 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 10 23:18:58.753036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0b2ae49b-5f71-4521-be10-42766b2ac1f0 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Request method failure captured: Oct 10 23:18:58.753036 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7/action HTTP/1.1 Oct 10 23:18:58.753036 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:18:58.753036 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:18:58.753036 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:18:58.753036 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 44 Oct 10 23:18:58.753036 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:18:58.753036 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:18:58.753036 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:18:58.753036 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:18:58.753036 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKg0cwut1HB5YgrFXzkSoyTQeSNf6qxj0xNy0WuCa7qczJ5YOryQpfrH6W3_OXKI0wSEFQ7dkHey15_8SU63XZ1M5zNoYA5xJKEUqbiOMJD1gjTG32yJeFhm5TI4ij7gW9yADfvCHHnzt25MECSs7hWoeJNb8LWbHa2evy2T-Sx_2Fc Oct 10 23:18:58.753036 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:18:58.753036 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:18:58.753036 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:18:58.753036 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:18:58.753036 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:18:58.753036 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:18:58.753036 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: c7443a53a70743a09144270de0904832 Oct 10 23:18:58.753036 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-521344888 Oct 10 23:18:58.753036 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:18:58.753036 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:18:58.754417 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c7443a53a70743a09144270de0904832"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7443a53a70743a09144270de0904832"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7443a53a70743a09144270de0904832"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c7443a53a70743a09144270de0904832", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:18:58.754417 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-521344888 Oct 10 23:18:58.754417 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: c7443a53a70743a09144270de0904832 Oct 10 23:18:58.754417 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-521344888 Oct 10 23:18:58.754417 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project Oct 10 23:18:58.754417 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:18:58.754417 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:18:58.754417 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 12f4b43c646c4aba88160ffeb98c6aa8 Oct 10 23:18:58.754417 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project Oct 10 23:18:58.754417 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:18:58.754417 n-d-860864-2 devstack@n-api.service[120613]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 10 23:18:58.754417 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:18:58.754417 n-d-860864-2 devstack@n-api.service[120613]: exception: Floating IP not found for address 0.0.0.0. Oct 10 23:18:58.755221 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 10 23:18:58.755221 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:18:58.755221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:18:58.755221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 10 23:18:58.755221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 10 23:18:58.755221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 10 23:18:58.755221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 10 23:18:58.755221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 10 23:18:58.755221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 10 23:18:58.755221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 10 23:18:58.755221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:18:58.755221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:18:58.755221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:18:58.755221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:18:58.755221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:18:58.755221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:18:58.755221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:18:58.755221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:18:58.755221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:18:58.756379 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:18:58.756379 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:18:58.756379 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:18:58.756379 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:18:58.756379 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:18:58.756379 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 10 23:18:58.756379 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 10 23:18:58.756379 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 10 23:18:58.756379 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 10 23:18:58.756379 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 10 23:18:58.756379 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:18:58.756379 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:18:58.756379 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:18:58.756379 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:18:58.756379 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:18:58.756379 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:18:58.756379 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:18:58.756379 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:18:58.756379 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 10 23:18:58.756379 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:18:58.760244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0b2ae49b-5f71-4521-be10-42766b2ac1f0 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:18:58.762131 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0b2ae49b-5f71-4521-be10-42766b2ac1f0 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "POST /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7/action" status: 404 len: 88 microversion: 2.1 time: 0.150723 Oct 10 23:18:58.764528 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 302/618] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:18:58 2022] POST /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7/action => generated 88 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:18:58.771222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8784f217-c64b-46f0-9fd3-63145b0182ba tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:58.776538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8784f217-c64b-46f0-9fd3-63145b0182ba tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:58.800709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8784f217-c64b-46f0-9fd3-63145b0182ba tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:58.801648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8784f217-c64b-46f0-9fd3-63145b0182ba tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:58.803493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8784f217-c64b-46f0-9fd3-63145b0182ba tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:58.804629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8784f217-c64b-46f0-9fd3-63145b0182ba tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:58.805800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8784f217-c64b-46f0-9fd3-63145b0182ba tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:58.806534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8784f217-c64b-46f0-9fd3-63145b0182ba tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:58.961991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-72945224-c803-43e5-aa2f-276b38b16052 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:18:58.962611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-72945224-c803-43e5-aa2f-276b38b16052 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:18:58.962880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-72945224-c803-43e5-aa2f-276b38b16052 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:18:58.963605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-72945224-c803-43e5-aa2f-276b38b16052 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:18:58.964179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-72945224-c803-43e5-aa2f-276b38b16052 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:18:58.967738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:18:58.995858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72945224-c803-43e5-aa2f-276b38b16052 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:58.996348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72945224-c803-43e5-aa2f-276b38b16052 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:58.996779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72945224-c803-43e5-aa2f-276b38b16052 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:59.006339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72945224-c803-43e5-aa2f-276b38b16052 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:59.015052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72945224-c803-43e5-aa2f-276b38b16052 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:59.015726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72945224-c803-43e5-aa2f-276b38b16052 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:59.065482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-72945224-c803-43e5-aa2f-276b38b16052 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:18:59.071956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-72945224-c803-43e5-aa2f-276b38b16052 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for user 310196e1663a4f7ca12e1fc53b0278ba and project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:18:59.099139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-72945224-c803-43e5-aa2f-276b38b16052 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:18:59.102174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-72945224-c803-43e5-aa2f-276b38b16052 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:18:59.194023 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-72945224-c803-43e5-aa2f-276b38b16052 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.549083 Oct 10 23:18:59.199684 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 317/619] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:18:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:18:59.210559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-45c20b1f-414a-4784-b1eb-a5ed2b3c8b47 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:59.211811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-45c20b1f-414a-4784-b1eb-a5ed2b3c8b47 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] [instance: c10a472b-a85b-41c5-9c6c-116d7c364af7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:59.221458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45c20b1f-414a-4784-b1eb-a5ed2b3c8b47 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:59.223796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45c20b1f-414a-4784-b1eb-a5ed2b3c8b47 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:59.224433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45c20b1f-414a-4784-b1eb-a5ed2b3c8b47 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:59.225311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45c20b1f-414a-4784-b1eb-a5ed2b3c8b47 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:59.225958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45c20b1f-414a-4784-b1eb-a5ed2b3c8b47 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:59.226558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45c20b1f-414a-4784-b1eb-a5ed2b3c8b47 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:59.265792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8784f217-c64b-46f0-9fd3-63145b0182ba tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:59.276396 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8784f217-c64b-46f0-9fd3-63145b0182ba tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1474 microversion: 2.1 time: 0.510385 Oct 10 23:18:59.281765 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 303/620] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:58 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1474 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:59.298619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0ade6486-fe7d-498c-8e08-fc779654bd50 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:59.299158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0ade6486-fe7d-498c-8e08-fc779654bd50 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:59.324334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ade6486-fe7d-498c-8e08-fc779654bd50 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:59.329753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ade6486-fe7d-498c-8e08-fc779654bd50 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:59.330275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ade6486-fe7d-498c-8e08-fc779654bd50 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:59.331100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ade6486-fe7d-498c-8e08-fc779654bd50 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:59.331495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ade6486-fe7d-498c-8e08-fc779654bd50 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:59.331926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ade6486-fe7d-498c-8e08-fc779654bd50 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:59.420344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0ade6486-fe7d-498c-8e08-fc779654bd50 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:18:59.611897 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0ade6486-fe7d-498c-8e08-fc779654bd50 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" status: 204 len: 0 microversion: 2.1 time: 0.325701 Oct 10 23:18:59.613711 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 304/621] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:18:59 2022] DELETE /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:18:59.627404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-603233ae-9065-4ca9-a62a-6a2cc080005e tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:59.629706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-603233ae-9065-4ca9-a62a-6a2cc080005e tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:59.865081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-603233ae-9065-4ca9-a62a-6a2cc080005e tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:18:59.875821 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-603233ae-9065-4ca9-a62a-6a2cc080005e tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8" status: 200 len: 1216 microversion: 2.1 time: 0.259518 Oct 10 23:18:59.899489 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 305/622] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:59 2022] GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8 => generated 1216 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:18:59.909624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-aefa3461-2dd8-40b7-a8f9-53d9064485aa tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:18:59.910463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-aefa3461-2dd8-40b7-a8f9-53d9064485aa tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:18:59.918831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aefa3461-2dd8-40b7-a8f9-53d9064485aa tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:59.920169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aefa3461-2dd8-40b7-a8f9-53d9064485aa tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:59.921887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aefa3461-2dd8-40b7-a8f9-53d9064485aa tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:18:59.923122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aefa3461-2dd8-40b7-a8f9-53d9064485aa tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:18:59.923751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aefa3461-2dd8-40b7-a8f9-53d9064485aa tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:18:59.924515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aefa3461-2dd8-40b7-a8f9-53d9064485aa tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:00.251282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-45c20b1f-414a-4784-b1eb-a5ed2b3c8b47 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908cc3a0520f4898a016e0a7425698da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0dc0392fb4b438c2cae7dda5bb12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:00.264994 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-45c20b1f-414a-4784-b1eb-a5ed2b3c8b47 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] 10.222.0.23 "GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7" status: 200 len: 1470 microversion: 2.1 time: 1.061502 Oct 10 23:19:00.269632 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 318/623] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:59 2022] GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7 => generated 1470 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:00.282884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f38ee249-067f-48c5-9036-79a27cecb4df tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:00.285521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f38ee249-067f-48c5-9036-79a27cecb4df tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:00.299871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f38ee249-067f-48c5-9036-79a27cecb4df tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:00.300379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f38ee249-067f-48c5-9036-79a27cecb4df tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:00.300820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f38ee249-067f-48c5-9036-79a27cecb4df tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:00.305903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f38ee249-067f-48c5-9036-79a27cecb4df tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:00.306390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f38ee249-067f-48c5-9036-79a27cecb4df tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:00.306829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f38ee249-067f-48c5-9036-79a27cecb4df tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:00.437485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-aefa3461-2dd8-40b7-a8f9-53d9064485aa tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:00.455431 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-aefa3461-2dd8-40b7-a8f9-53d9064485aa tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1311 microversion: 2.1 time: 0.545556 Oct 10 23:19:00.457597 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 306/624] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:18:59 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1311 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:00.465172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-912237ab-aff1-4eef-a63b-861521c23384 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:00.466532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-912237ab-aff1-4eef-a63b-861521c23384 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:00.486305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-912237ab-aff1-4eef-a63b-861521c23384 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:00.488433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-912237ab-aff1-4eef-a63b-861521c23384 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:00.490711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-912237ab-aff1-4eef-a63b-861521c23384 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:00.491700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-912237ab-aff1-4eef-a63b-861521c23384 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:00.492516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-912237ab-aff1-4eef-a63b-861521c23384 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:00.494627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-912237ab-aff1-4eef-a63b-861521c23384 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:00.659627 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f38ee249-067f-48c5-9036-79a27cecb4df tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f4b43c646c4aba88160ffeb98c6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7443a53a70743a09144270de0904832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:00.685365 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f38ee249-067f-48c5-9036-79a27cecb4df tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" status: 200 len: 1542 microversion: 2.1 time: 0.414347 Oct 10 23:19:00.686311 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 319/625] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:00 2022] GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 => generated 1542 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:01.018450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-feb723e6-2cef-4645-8000-711e2a6d673f tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] Calling method '.version_select at 0x7f662bbf8dc0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:01.041124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-912237ab-aff1-4eef-a63b-861521c23384 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:01.056413 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-912237ab-aff1-4eef-a63b-861521c23384 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1473 microversion: 2.1 time: 0.595845 Oct 10 23:19:01.063032 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 307/626] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:00 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1473 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:01.104307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-12ee910f-de1a-40df-abe6-37cfa3e5a411 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:01.105901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-12ee910f-de1a-40df-abe6-37cfa3e5a411 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:01.119467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12ee910f-de1a-40df-abe6-37cfa3e5a411 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:01.132187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12ee910f-de1a-40df-abe6-37cfa3e5a411 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:01.133004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12ee910f-de1a-40df-abe6-37cfa3e5a411 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:01.134014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12ee910f-de1a-40df-abe6-37cfa3e5a411 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:01.134748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12ee910f-de1a-40df-abe6-37cfa3e5a411 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:01.135920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12ee910f-de1a-40df-abe6-37cfa3e5a411 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:01.253078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG neutronclient.v2_0.client [None req-feb723e6-2cef-4645-8000-711e2a6d673f tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bdf59318-d338-46f8-be54-65504623b99e does not exist", "detail": ""}} {{(pid=120614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:19:01.254372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.security_group_api [None req-feb723e6-2cef-4645-8000-711e2a6d673f tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] Neutron security group bdf59318-d338-46f8-be54-65504623b99e not found {{(pid=120614) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 23:19:01.255093 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-feb723e6-2cef-4645-8000-711e2a6d673f tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] HTTP exception thrown: Security group bdf59318-d338-46f8-be54-65504623b99e does not exist Oct 10 23:19:01.255093 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-729d594c-28eb-405d-80f5-b03f3581afd7'] Oct 10 23:19:01.262476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-feb723e6-2cef-4645-8000-711e2a6d673f tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] Request method failure captured: Oct 10 23:19:01.262476 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/os-security-groups/bdf59318-d338-46f8-be54-65504623b99e HTTP/1.1 Oct 10 23:19:01.262476 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:19:01.262476 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:19:01.262476 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:19:01.262476 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:19:01.262476 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:19:01.262476 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:19:01.262476 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:19:01.262476 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:19:01.262476 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKhkWJtDQ6QgxKkC1uXncLxkBd45u58IbFaIMuYQp7b9p2bDbc-AnQAzOYDMwFAEcKO-m2536i9FkcybNiDQJ47RN6ydvCwRKqM4g5g8-kyaJobFMO17gqZT5Ty96VYfCnzIaZ3HgNIQ9HPIzorT5QpkKO61zhZz7OlMLhAF-5njMu4 Oct 10 23:19:01.262476 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:19:01.262476 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:19:01.262476 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:19:01.262476 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:19:01.262476 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:19:01.262476 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:19:01.262476 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 4cb201ef7bfb4f8281f7f0ae3cbd8d93 Oct 10 23:19:01.262476 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-486456462 Oct 10 23:19:01.262476 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:19:01.262476 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:19:01.264421 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4cb201ef7bfb4f8281f7f0ae3cbd8d93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4cb201ef7bfb4f8281f7f0ae3cbd8d93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4cb201ef7bfb4f8281f7f0ae3cbd8d93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4cb201ef7bfb4f8281f7f0ae3cbd8d93", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:19:01.264421 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-486456462 Oct 10 23:19:01.264421 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 4cb201ef7bfb4f8281f7f0ae3cbd8d93 Oct 10 23:19:01.264421 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-486456462 Oct 10 23:19:01.264421 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-SecurityGroupsNegativeTestJSON-486456462-project Oct 10 23:19:01.264421 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:19:01.264421 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:19:01.264421 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: cf60ebc6605d4bf2b7f4260b7f008e1c Oct 10 23:19:01.264421 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-486456462-project Oct 10 23:19:01.264421 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:19:01.264421 n-d-860864-2 devstack@n-api.service[120614]: exception: Security group bdf59318-d338-46f8-be54-65504623b99e does not exist Oct 10 23:19:01.264421 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-729d594c-28eb-405d-80f5-b03f3581afd7'] Oct 10 23:19:01.264421 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'bdf59318-d338-46f8-be54-65504623b99e'} Oct 10 23:19:01.265298 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:19:01.265298 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:01.265298 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 23:19:01.265298 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 23:19:01.265298 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:01.265298 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:01.265298 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 23:19:01.265298 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 23:19:01.265298 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:01.265298 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:01.265298 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 23:19:01.265298 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 23:19:01.265298 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:01.265298 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:01.265298 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:19:01.265298 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:19:01.265298 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:01.265298 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:01.265298 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:19:01.266931 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:19:01.266931 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:01.266931 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:01.266931 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:19:01.266931 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:19:01.266931 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:19:01.266931 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:19:01.266931 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bdf59318-d338-46f8-be54-65504623b99e does not exist Oct 10 23:19:01.266931 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-729d594c-28eb-405d-80f5-b03f3581afd7'] Oct 10 23:19:01.266931 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:01.266931 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:01.266931 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:01.266931 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:01.266931 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 23:19:01.266931 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 23:19:01.266931 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 23:19:01.266931 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 23:19:01.266931 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bdf59318-d338-46f8-be54-65504623b99e does not exist Oct 10 23:19:01.272769 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-729d594c-28eb-405d-80f5-b03f3581afd7'] Oct 10 23:19:01.272769 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:01.272769 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:01.272769 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:01.272769 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:01.272769 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:01.272769 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:01.272769 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:19:01.272769 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:19:01.272769 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:19:01.272769 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:19:01.272769 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:19:01.272769 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:19:01.272769 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 23:19:01.272769 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 23:19:01.272769 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bdf59318-d338-46f8-be54-65504623b99e does not exist Oct 10 23:19:01.272769 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-729d594c-28eb-405d-80f5-b03f3581afd7'] Oct 10 23:19:01.272769 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:01.272769 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:01.272769 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:01.272769 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:01.274332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:01.274332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:01.274332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:19:01.274332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:19:01.274332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bdf59318-d338-46f8-be54-65504623b99e does not exist Oct 10 23:19:01.274332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-729d594c-28eb-405d-80f5-b03f3581afd7'] Oct 10 23:19:01.274332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:01.277493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-feb723e6-2cef-4645-8000-711e2a6d673f tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] Returning 404 to user: Security group bdf59318-d338-46f8-be54-65504623b99e does not exist Oct 10 23:19:01.277493 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-729d594c-28eb-405d-80f5-b03f3581afd7'] {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:19:01.277493 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-feb723e6-2cef-4645-8000-711e2a6d673f tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/bdf59318-d338-46f8-be54-65504623b99e" status: 404 len: 194 microversion: 2.1 time: 0.414889 Oct 10 23:19:01.285412 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 320/627] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:19:00 2022] DELETE /compute/v2.1/os-security-groups/bdf59318-d338-46f8-be54-65504623b99e => generated 194 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:19:01.299089 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-ce00305d-c0c6-4c97-99b9-ee8573c45230 req-f9990551-990c-44d8-9850-498e99c089cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10a472b-a85b-41c5-9c6c-116d7c364af7", "name": "network-vif-deleted", "tag": "f73264cc-f1da-4a5c-b6f9-4701cd3675dc"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:01.324234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ce00305d-c0c6-4c97-99b9-ee8573c45230 req-f9990551-990c-44d8-9850-498e99c089cd service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:01.324839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ce00305d-c0c6-4c97-99b9-ee8573c45230 req-f9990551-990c-44d8-9850-498e99c089cd service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:01.326232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ce00305d-c0c6-4c97-99b9-ee8573c45230 req-f9990551-990c-44d8-9850-498e99c089cd service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:01.358529 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-ce00305d-c0c6-4c97-99b9-ee8573c45230 req-f9990551-990c-44d8-9850-498e99c089cd service nova] Creating event network-vif-deleted:f73264cc-f1da-4a5c-b6f9-4701cd3675dc for instance c10a472b-a85b-41c5-9c6c-116d7c364af7 on n-h2-860864-2 Oct 10 23:19:01.394155 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-ce00305d-c0c6-4c97-99b9-ee8573c45230 req-f9990551-990c-44d8-9850-498e99c089cd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106164 Oct 10 23:19:01.395191 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 321/628] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:01.414044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-12ee910f-de1a-40df-abe6-37cfa3e5a411 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:01.426119 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7b9adf10-676b-4bf0-acf6-bd102538410e tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.028712 Oct 10 23:19:01.427228 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-12ee910f-de1a-40df-abe6-37cfa3e5a411 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8" status: 200 len: 1220 microversion: 2.1 time: 0.344673 Oct 10 23:19:01.429495 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 308/629] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:01 2022] GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8 => generated 1220 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:01.431606 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 322/630] 10.222.0.23 () {58 vars in 1164 bytes} [Mon Oct 10 23:19:01 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 10 23:19:01.437891 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d2b70ee2-1af4-4fc9-b588-9afd4b7232b6 tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] Calling method '.version_select at 0x7f662bbfc8b0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:01.441598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-480a3b71-1d00-46f4-83b0-1f4c72fb9fc1 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:01.444376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-480a3b71-1d00-46f4-83b0-1f4c72fb9fc1 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] [instance: c10a472b-a85b-41c5-9c6c-116d7c364af7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:01.460122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-480a3b71-1d00-46f4-83b0-1f4c72fb9fc1 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:01.460612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-480a3b71-1d00-46f4-83b0-1f4c72fb9fc1 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:01.461039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-480a3b71-1d00-46f4-83b0-1f4c72fb9fc1 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:01.461775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-480a3b71-1d00-46f4-83b0-1f4c72fb9fc1 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:01.462224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-480a3b71-1d00-46f4-83b0-1f4c72fb9fc1 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:01.462643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-480a3b71-1d00-46f4-83b0-1f4c72fb9fc1 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:01.525488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-480a3b71-1d00-46f4-83b0-1f4c72fb9fc1 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:01.525991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-480a3b71-1d00-46f4-83b0-1f4c72fb9fc1 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:01.526691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-480a3b71-1d00-46f4-83b0-1f4c72fb9fc1 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:01.527676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-480a3b71-1d00-46f4-83b0-1f4c72fb9fc1 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lazy-loading 'fault' on Instance uuid c10a472b-a85b-41c5-9c6c-116d7c364af7 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:19:01.998986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-480a3b71-1d00-46f4-83b0-1f4c72fb9fc1 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908cc3a0520f4898a016e0a7425698da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c0dc0392fb4b438c2cae7dda5bb12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:02.009352 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-480a3b71-1d00-46f4-83b0-1f4c72fb9fc1 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] 10.222.0.23 "GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7" status: 200 len: 1304 microversion: 2.1 time: 0.577306 Oct 10 23:19:02.014583 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 309/631] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:01 2022] GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7 => generated 1304 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:02.019328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b2fa44fb-c463-4bd6-9dc3-d999848e5056 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:02.022965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b2fa44fb-c463-4bd6-9dc3-d999848e5056 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:02.041602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2fa44fb-c463-4bd6-9dc3-d999848e5056 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:02.042904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2fa44fb-c463-4bd6-9dc3-d999848e5056 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:02.043564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2fa44fb-c463-4bd6-9dc3-d999848e5056 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:02.045546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2fa44fb-c463-4bd6-9dc3-d999848e5056 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:02.047564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2fa44fb-c463-4bd6-9dc3-d999848e5056 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:02.050490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2fa44fb-c463-4bd6-9dc3-d999848e5056 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:02.269580 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d2b70ee2-1af4-4fc9-b588-9afd4b7232b6 tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.835106 Oct 10 23:19:02.271130 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 323/632] 10.222.0.23 () {58 vars in 1158 bytes} [Mon Oct 10 23:19:01 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:02.276065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-219c507b-3cc8-4e32-8c2e-86f575274728 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:02.277488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-219c507b-3cc8-4e32-8c2e-86f575274728 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:02.295949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-219c507b-3cc8-4e32-8c2e-86f575274728 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:02.296651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-219c507b-3cc8-4e32-8c2e-86f575274728 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:02.297445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-219c507b-3cc8-4e32-8c2e-86f575274728 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:02.298336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-219c507b-3cc8-4e32-8c2e-86f575274728 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:02.301874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-219c507b-3cc8-4e32-8c2e-86f575274728 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:02.302326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-219c507b-3cc8-4e32-8c2e-86f575274728 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:02.429148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b2fa44fb-c463-4bd6-9dc3-d999848e5056 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:02.442166 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b2fa44fb-c463-4bd6-9dc3-d999848e5056 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1311 microversion: 2.1 time: 0.426193 Oct 10 23:19:02.444216 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 310/633] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:02 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1311 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:02.455193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-46a1ab49-3d42-4b5b-92e5-4d0ffaa51a89 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:02.456977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-46a1ab49-3d42-4b5b-92e5-4d0ffaa51a89 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:02.464325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:02.503005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46a1ab49-3d42-4b5b-92e5-4d0ffaa51a89 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:02.507962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46a1ab49-3d42-4b5b-92e5-4d0ffaa51a89 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:02.508736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46a1ab49-3d42-4b5b-92e5-4d0ffaa51a89 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:02.515245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46a1ab49-3d42-4b5b-92e5-4d0ffaa51a89 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:02.516186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46a1ab49-3d42-4b5b-92e5-4d0ffaa51a89 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:02.518507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46a1ab49-3d42-4b5b-92e5-4d0ffaa51a89 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:02.725590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-219c507b-3cc8-4e32-8c2e-86f575274728 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f4b43c646c4aba88160ffeb98c6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7443a53a70743a09144270de0904832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:02.735606 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-219c507b-3cc8-4e32-8c2e-86f575274728 tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" status: 200 len: 1542 microversion: 2.1 time: 0.463177 Oct 10 23:19:02.736431 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 324/634] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:02 2022] GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 => generated 1542 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:02.745536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2abf8194-7350-4845-b7f1-e4fc04334622 tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] Calling method '.version_select at 0x7f662bdc8c10>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:03.115777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-46a1ab49-3d42-4b5b-92e5-4d0ffaa51a89 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:03.124601 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-46a1ab49-3d42-4b5b-92e5-4d0ffaa51a89 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1473 microversion: 2.1 time: 0.679171 Oct 10 23:19:03.125189 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 311/635] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:02 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1473 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:03.139760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-29c2f222-68ed-491b-a50d-e96cb31d59b7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:03.140393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-29c2f222-68ed-491b-a50d-e96cb31d59b7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:03.155791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29c2f222-68ed-491b-a50d-e96cb31d59b7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:03.156296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29c2f222-68ed-491b-a50d-e96cb31d59b7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:03.156737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29c2f222-68ed-491b-a50d-e96cb31d59b7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:03.157474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29c2f222-68ed-491b-a50d-e96cb31d59b7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:03.157933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29c2f222-68ed-491b-a50d-e96cb31d59b7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:03.158360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29c2f222-68ed-491b-a50d-e96cb31d59b7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:03.225359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG neutronclient.v2_0.client [None req-2abf8194-7350-4845-b7f1-e4fc04334622 tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:19:03.226212 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-2abf8194-7350-4845-b7f1-e4fc04334622 tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 10 23:19:03.226212 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-658ba6e8-4f19-4451-abb0-36f6fde499ac'] Oct 10 23:19:03.228614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2abf8194-7350-4845-b7f1-e4fc04334622 tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] Request method failure captured: Oct 10 23:19:03.228614 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/os-security-groups/d1784a7e-f174-4159-a23b-9429273ac409 HTTP/1.1 Oct 10 23:19:03.228614 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:19:03.228614 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:19:03.228614 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:19:03.228614 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:19:03.228614 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:19:03.228614 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:19:03.228614 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:19:03.228614 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:19:03.228614 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKhkWJtDQ6QgxKkC1uXncLxkBd45u58IbFaIMuYQp7b9p2bDbc-AnQAzOYDMwFAEcKO-m2536i9FkcybNiDQJ47RN6ydvCwRKqM4g5g8-kyaJobFMO17gqZT5Ty96VYfCnzIaZ3HgNIQ9HPIzorT5QpkKO61zhZz7OlMLhAF-5njMu4 Oct 10 23:19:03.228614 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:19:03.228614 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:19:03.228614 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:19:03.228614 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:19:03.228614 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:19:03.228614 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:19:03.228614 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 4cb201ef7bfb4f8281f7f0ae3cbd8d93 Oct 10 23:19:03.228614 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-486456462 Oct 10 23:19:03.228614 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:19:03.228614 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:19:03.230253 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4cb201ef7bfb4f8281f7f0ae3cbd8d93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4cb201ef7bfb4f8281f7f0ae3cbd8d93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4cb201ef7bfb4f8281f7f0ae3cbd8d93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4cb201ef7bfb4f8281f7f0ae3cbd8d93", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:19:03.230253 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-486456462 Oct 10 23:19:03.230253 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 4cb201ef7bfb4f8281f7f0ae3cbd8d93 Oct 10 23:19:03.230253 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-486456462 Oct 10 23:19:03.230253 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-SecurityGroupsNegativeTestJSON-486456462-project Oct 10 23:19:03.230253 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:19:03.230253 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:19:03.230253 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: cf60ebc6605d4bf2b7f4260b7f008e1c Oct 10 23:19:03.230253 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-486456462-project Oct 10 23:19:03.230253 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:19:03.230253 n-d-860864-2 devstack@n-api.service[120614]: exception: Insufficient rights for removing default security group. Oct 10 23:19:03.230253 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-658ba6e8-4f19-4451-abb0-36f6fde499ac'] Oct 10 23:19:03.230253 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'd1784a7e-f174-4159-a23b-9429273ac409'} Oct 10 23:19:03.231273 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:19:03.231273 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:03.231273 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 10 23:19:03.231273 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 10 23:19:03.231273 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:03.231273 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:03.231273 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 10 23:19:03.231273 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 10 23:19:03.231273 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:03.231273 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:03.231273 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 10 23:19:03.231273 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 10 23:19:03.231273 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:03.231273 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:03.231273 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:19:03.231273 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:19:03.231273 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:03.231273 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:03.231273 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:19:03.233420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:19:03.233420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:03.233420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:03.233420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:19:03.233420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:19:03.233420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:19:03.233420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:19:03.233420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 10 23:19:03.233420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-658ba6e8-4f19-4451-abb0-36f6fde499ac'] Oct 10 23:19:03.233420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.233420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:03.233420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.233420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:03.233420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 10 23:19:03.233420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 10 23:19:03.233420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 10 23:19:03.233420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 10 23:19:03.233420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 10 23:19:03.233420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-658ba6e8-4f19-4451-abb0-36f6fde499ac'] Oct 10 23:19:03.234808 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.234808 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:03.234808 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.234808 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:03.234808 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:03.234808 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:03.234808 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:19:03.234808 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:19:03.234808 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:19:03.234808 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:19:03.234808 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:19:03.234808 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:19:03.234808 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 10 23:19:03.234808 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 23:19:03.234808 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 10 23:19:03.234808 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-658ba6e8-4f19-4451-abb0-36f6fde499ac'] Oct 10 23:19:03.234808 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.234808 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:03.234808 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.234808 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:03.234808 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:03.236375 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:03.236375 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:19:03.236375 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:19:03.236375 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 10 23:19:03.236375 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-658ba6e8-4f19-4451-abb0-36f6fde499ac'] Oct 10 23:19:03.236375 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.236375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2abf8194-7350-4845-b7f1-e4fc04334622 tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 10 23:19:03.236375 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-658ba6e8-4f19-4451-abb0-36f6fde499ac'] {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:19:03.237895 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2abf8194-7350-4845-b7f1-e4fc04334622 tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/d1784a7e-f174-4159-a23b-9429273ac409" status: 400 len: 182 microversion: 2.1 time: 0.499838 Oct 10 23:19:03.238524 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 325/636] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:19:02 2022] DELETE /compute/v2.1/os-security-groups/d1784a7e-f174-4159-a23b-9429273ac409 => generated 182 bytes in 501 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:19:03.254280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c9458863-2c15-4ee8-8f30-f97bf12e7a13 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:03.260708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c9458863-2c15-4ee8-8f30-f97bf12e7a13 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] [instance: c10a472b-a85b-41c5-9c6c-116d7c364af7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:03.280823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9458863-2c15-4ee8-8f30-f97bf12e7a13 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:03.283880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9458863-2c15-4ee8-8f30-f97bf12e7a13 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:03.285678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-29c2f222-68ed-491b-a50d-e96cb31d59b7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:03.287169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9458863-2c15-4ee8-8f30-f97bf12e7a13 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:03.290367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9458863-2c15-4ee8-8f30-f97bf12e7a13 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:03.292832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9458863-2c15-4ee8-8f30-f97bf12e7a13 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:03.294633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9458863-2c15-4ee8-8f30-f97bf12e7a13 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:03.298308 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-29c2f222-68ed-491b-a50d-e96cb31d59b7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8" status: 200 len: 1274 microversion: 2.1 time: 0.168701 Oct 10 23:19:03.299421 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 312/637] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:03 2022] GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8 => generated 1274 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:03.317067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-84a01676-c3ac-4633-944f-25fdee92ac5f tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] Calling method '.version_select at 0x7f662bab5700>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:03.330458 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-c9458863-2c15-4ee8-8f30-f97bf12e7a13 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] HTTP exception thrown: Instance c10a472b-a85b-41c5-9c6c-116d7c364af7 could not be found. Oct 10 23:19:03.332290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c9458863-2c15-4ee8-8f30-f97bf12e7a13 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Request method failure captured: Oct 10 23:19:03.332290 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7 HTTP/1.1 Oct 10 23:19:03.332290 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:19:03.332290 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:19:03.332290 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:19:03.332290 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:19:03.332290 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:19:03.332290 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:19:03.332290 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:19:03.332290 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:19:03.332290 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKhHCgDFHtWTSPt980H8NvSRtmzTD7jhNc5zSf0RtxSGZ8KdVhg480iGrFZHR_K35sDir5JDXh2ObcCPjy562RdwfMpM0VlbZ51enq666O6_sOzuXDzQ2b-geq4HYRlCvHwgYgtcvCQHcOYsbekT8EXkCF6nH8znY_zMZ5j_oO6k6V0 Oct 10 23:19:03.332290 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:19:03.332290 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:19:03.332290 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:19:03.332290 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:19:03.332290 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:19:03.332290 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:19:03.332290 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: b7c0dc0392fb4b438c2cae7dda5bb12b Oct 10 23:19:03.332290 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TenantUsagesTestJSON-735596292 Oct 10 23:19:03.332290 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:19:03.332290 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:19:03.333851 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b7c0dc0392fb4b438c2cae7dda5bb12b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7c0dc0392fb4b438c2cae7dda5bb12b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7c0dc0392fb4b438c2cae7dda5bb12b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b7c0dc0392fb4b438c2cae7dda5bb12b", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:19:03.333851 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TenantUsagesTestJSON-735596292 Oct 10 23:19:03.333851 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: b7c0dc0392fb4b438c2cae7dda5bb12b Oct 10 23:19:03.333851 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TenantUsagesTestJSON-735596292 Oct 10 23:19:03.333851 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TenantUsagesTestJSON-735596292-project Oct 10 23:19:03.333851 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:19:03.333851 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:19:03.333851 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 908cc3a0520f4898a016e0a7425698da Oct 10 23:19:03.333851 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TenantUsagesTestJSON-735596292-project Oct 10 23:19:03.333851 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:19:03.333851 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance c10a472b-a85b-41c5-9c6c-116d7c364af7 could not be found. Oct 10 23:19:03.333851 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'c10a472b-a85b-41c5-9c6c-116d7c364af7'} Oct 10 23:19:03.334842 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:19:03.334842 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:03.334842 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:19:03.334842 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:19:03.334842 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:19:03.334842 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:19:03.334842 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:19:03.334842 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:19:03.334842 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:19:03.334842 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:19:03.334842 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c10a472b-a85b-41c5-9c6c-116d7c364af7 could not be found. Oct 10 23:19:03.334842 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.334842 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:03.334842 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.334842 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:03.334842 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:03.334842 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:03.334842 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:19:03.334842 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:19:03.334842 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:19:03.336420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:19:03.336420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:19:03.336420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:19:03.336420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:19:03.336420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:19:03.336420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:19:03.336420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:19:03.336420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c10a472b-a85b-41c5-9c6c-116d7c364af7 could not be found. Oct 10 23:19:03.336420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.336420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:03.336420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.336420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:03.336420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:03.336420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:03.336420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:19:03.336420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:19:03.336420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c10a472b-a85b-41c5-9c6c-116d7c364af7 could not be found. Oct 10 23:19:03.336420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.340081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c9458863-2c15-4ee8-8f30-f97bf12e7a13 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] Returning 404 to user: Instance c10a472b-a85b-41c5-9c6c-116d7c364af7 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:19:03.342108 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c9458863-2c15-4ee8-8f30-f97bf12e7a13 tempest-TenantUsagesTestJSON-735596292 tempest-TenantUsagesTestJSON-735596292-project] 10.222.0.23 "GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7" status: 404 len: 111 microversion: 2.1 time: 0.102331 Oct 10 23:19:03.346245 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 326/638] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:03 2022] GET /compute/v2.1/servers/c10a472b-a85b-41c5-9c6c-116d7c364af7 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:19:03.372935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG neutronclient.v2_0.client [None req-84a01676-c3ac-4633-944f-25fdee92ac5f tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 43066ab8-37b5-4d3b-b322-23cb4ca4d7c4 does not exist", "detail": ""}} {{(pid=120613) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:19:03.372935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.security_group_api [None req-84a01676-c3ac-4633-944f-25fdee92ac5f tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] Neutron security group 43066ab8-37b5-4d3b-b322-23cb4ca4d7c4 not found {{(pid=120613) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 23:19:03.372935 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-84a01676-c3ac-4633-944f-25fdee92ac5f tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] HTTP exception thrown: Security group 43066ab8-37b5-4d3b-b322-23cb4ca4d7c4 does not exist Oct 10 23:19:03.372935 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-28e839af-9f7a-445a-95ce-24d06c1177cb'] Oct 10 23:19:03.372935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-84a01676-c3ac-4633-944f-25fdee92ac5f tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] Request method failure captured: Oct 10 23:19:03.372935 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-security-groups/43066ab8-37b5-4d3b-b322-23cb4ca4d7c4 HTTP/1.1 Oct 10 23:19:03.372935 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:19:03.372935 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:19:03.372935 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:19:03.372935 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:19:03.372935 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:19:03.372935 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:19:03.372935 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:19:03.372935 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:19:03.374423 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKhkWJtDQ6QgxKkC1uXncLxkBd45u58IbFaIMuYQp7b9p2bDbc-AnQAzOYDMwFAEcKO-m2536i9FkcybNiDQJ47RN6ydvCwRKqM4g5g8-kyaJobFMO17gqZT5Ty96VYfCnzIaZ3HgNIQ9HPIzorT5QpkKO61zhZz7OlMLhAF-5njMu4 Oct 10 23:19:03.374423 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:19:03.374423 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:19:03.374423 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:19:03.374423 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:19:03.374423 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:19:03.374423 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:19:03.374423 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 4cb201ef7bfb4f8281f7f0ae3cbd8d93 Oct 10 23:19:03.374423 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-486456462 Oct 10 23:19:03.374423 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:19:03.374423 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:19:03.374423 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4cb201ef7bfb4f8281f7f0ae3cbd8d93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4cb201ef7bfb4f8281f7f0ae3cbd8d93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4cb201ef7bfb4f8281f7f0ae3cbd8d93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4cb201ef7bfb4f8281f7f0ae3cbd8d93", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:19:03.374423 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-486456462 Oct 10 23:19:03.374423 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 4cb201ef7bfb4f8281f7f0ae3cbd8d93 Oct 10 23:19:03.374423 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-486456462 Oct 10 23:19:03.375632 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-SecurityGroupsNegativeTestJSON-486456462-project Oct 10 23:19:03.375632 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:19:03.375632 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:19:03.375632 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: cf60ebc6605d4bf2b7f4260b7f008e1c Oct 10 23:19:03.375632 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-486456462-project Oct 10 23:19:03.375632 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:19:03.375632 n-d-860864-2 devstack@n-api.service[120613]: exception: Security group 43066ab8-37b5-4d3b-b322-23cb4ca4d7c4 does not exist Oct 10 23:19:03.375632 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-28e839af-9f7a-445a-95ce-24d06c1177cb'] Oct 10 23:19:03.375632 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '43066ab8-37b5-4d3b-b322-23cb4ca4d7c4'} Oct 10 23:19:03.375632 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:19:03.375632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:03.375632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 23:19:03.375632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 23:19:03.375632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:03.375632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:03.375632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 23:19:03.375632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 23:19:03.375632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:03.375632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:03.375632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 23:19:03.375632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 23:19:03.375632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:03.375632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:03.377247 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:19:03.377247 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:19:03.377247 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:03.377247 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:03.377247 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:19:03.377247 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:19:03.377247 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:03.377247 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:03.377247 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:19:03.377247 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:19:03.377247 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:19:03.377247 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:19:03.377247 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 43066ab8-37b5-4d3b-b322-23cb4ca4d7c4 does not exist Oct 10 23:19:03.377247 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28e839af-9f7a-445a-95ce-24d06c1177cb'] Oct 10 23:19:03.377247 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.377247 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:03.377247 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.377247 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:03.377247 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 10 23:19:03.378809 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 23:19:03.378809 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 23:19:03.378809 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 23:19:03.378809 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 43066ab8-37b5-4d3b-b322-23cb4ca4d7c4 does not exist Oct 10 23:19:03.378809 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28e839af-9f7a-445a-95ce-24d06c1177cb'] Oct 10 23:19:03.378809 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.378809 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:03.378809 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.378809 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:03.378809 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:03.378809 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:03.378809 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:19:03.378809 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:19:03.378809 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:19:03.378809 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:19:03.378809 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:19:03.378809 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:19:03.378809 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 10 23:19:03.378809 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 23:19:03.380069 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 43066ab8-37b5-4d3b-b322-23cb4ca4d7c4 does not exist Oct 10 23:19:03.380069 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28e839af-9f7a-445a-95ce-24d06c1177cb'] Oct 10 23:19:03.380069 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.380069 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:03.380069 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.380069 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:03.380069 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:03.380069 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:03.380069 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:19:03.380069 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:19:03.380069 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 43066ab8-37b5-4d3b-b322-23cb4ca4d7c4 does not exist Oct 10 23:19:03.380069 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28e839af-9f7a-445a-95ce-24d06c1177cb'] Oct 10 23:19:03.380069 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.380069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-84a01676-c3ac-4633-944f-25fdee92ac5f tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] Returning 404 to user: Security group 43066ab8-37b5-4d3b-b322-23cb4ca4d7c4 does not exist Oct 10 23:19:03.380069 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-28e839af-9f7a-445a-95ce-24d06c1177cb'] {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:19:03.381145 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-84a01676-c3ac-4633-944f-25fdee92ac5f tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/43066ab8-37b5-4d3b-b322-23cb4ca4d7c4" status: 404 len: 194 microversion: 2.1 time: 0.068477 Oct 10 23:19:03.381145 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 313/639] 10.222.0.23 () {58 vars in 1269 bytes} [Mon Oct 10 23:19:03 2022] GET /compute/v2.1/os-security-groups/43066ab8-37b5-4d3b-b322-23cb4ca4d7c4 => generated 194 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:19:03.381324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-57ccfa65-40bf-461c-a12e-b062612d8c9c tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] Action: 'update', calling method: .version_select at 0x7f662bbf80d0>, body: {"security_group": {"name": "tempest-sg-880455715", "description": "tempest-description-1560657073"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:03.472571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-43449741-662f-461a-97f4-f15fe2e50727 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:03.473189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-43449741-662f-461a-97f4-f15fe2e50727 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:03.484795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43449741-662f-461a-97f4-f15fe2e50727 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:03.485304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43449741-662f-461a-97f4-f15fe2e50727 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:03.487204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43449741-662f-461a-97f4-f15fe2e50727 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:03.487945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43449741-662f-461a-97f4-f15fe2e50727 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:03.488411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43449741-662f-461a-97f4-f15fe2e50727 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:03.496662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43449741-662f-461a-97f4-f15fe2e50727 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:03.510822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG neutronclient.v2_0.client [None req-57ccfa65-40bf-461c-a12e-b062612d8c9c tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3c4a652f-42c4-4041-9993-713d60fc8fe7 does not exist", "detail": ""}} {{(pid=120614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:19:03.511427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.security_group_api [None req-57ccfa65-40bf-461c-a12e-b062612d8c9c tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] Neutron security group 3c4a652f-42c4-4041-9993-713d60fc8fe7 not found {{(pid=120614) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 23:19:03.511950 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-57ccfa65-40bf-461c-a12e-b062612d8c9c tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] HTTP exception thrown: Security group 3c4a652f-42c4-4041-9993-713d60fc8fe7 does not exist Oct 10 23:19:03.511950 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-42f3d884-125b-4d08-b686-3808b12c3917'] Oct 10 23:19:03.514401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-57ccfa65-40bf-461c-a12e-b062612d8c9c tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] Request method failure captured: Oct 10 23:19:03.514401 n-d-860864-2 devstack@n-api.service[120614]: request: PUT /compute/v2.1/os-security-groups/3c4a652f-42c4-4041-9993-713d60fc8fe7 HTTP/1.1 Oct 10 23:19:03.514401 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:19:03.514401 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:19:03.514401 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:19:03.514401 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 101 Oct 10 23:19:03.514401 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:19:03.514401 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:19:03.514401 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:19:03.514401 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:19:03.514401 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKhkWJtDQ6QgxKkC1uXncLxkBd45u58IbFaIMuYQp7b9p2bDbc-AnQAzOYDMwFAEcKO-m2536i9FkcybNiDQJ47RN6ydvCwRKqM4g5g8-kyaJobFMO17gqZT5Ty96VYfCnzIaZ3HgNIQ9HPIzorT5QpkKO61zhZz7OlMLhAF-5njMu4 Oct 10 23:19:03.514401 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:19:03.514401 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:19:03.514401 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:19:03.514401 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:19:03.514401 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:19:03.514401 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:19:03.514401 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 4cb201ef7bfb4f8281f7f0ae3cbd8d93 Oct 10 23:19:03.514401 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-486456462 Oct 10 23:19:03.514401 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:19:03.514401 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:19:03.515735 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4cb201ef7bfb4f8281f7f0ae3cbd8d93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4cb201ef7bfb4f8281f7f0ae3cbd8d93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4cb201ef7bfb4f8281f7f0ae3cbd8d93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4cb201ef7bfb4f8281f7f0ae3cbd8d93", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:19:03.515735 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-486456462 Oct 10 23:19:03.515735 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 4cb201ef7bfb4f8281f7f0ae3cbd8d93 Oct 10 23:19:03.515735 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-486456462 Oct 10 23:19:03.515735 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-SecurityGroupsNegativeTestJSON-486456462-project Oct 10 23:19:03.515735 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:19:03.515735 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:19:03.515735 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: cf60ebc6605d4bf2b7f4260b7f008e1c Oct 10 23:19:03.515735 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-486456462-project Oct 10 23:19:03.515735 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:19:03.515735 n-d-860864-2 devstack@n-api.service[120614]: {"security_group": {"name": "tempest-sg-880455715", "description": "tempest-description-1560657073"}} Oct 10 23:19:03.515735 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:19:03.515735 n-d-860864-2 devstack@n-api.service[120614]: exception: Security group 3c4a652f-42c4-4041-9993-713d60fc8fe7 does not exist Oct 10 23:19:03.516521 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-42f3d884-125b-4d08-b686-3808b12c3917'] Oct 10 23:19:03.516521 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '3c4a652f-42c4-4041-9993-713d60fc8fe7', 'body': {'security_group': {'name': 'tempest-sg-880455715', 'description': 'tempest-description-1560657073'}}} Oct 10 23:19:03.516521 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:19:03.516521 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:03.516521 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 23:19:03.516521 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 23:19:03.516521 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:03.516521 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:03.516521 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 23:19:03.516521 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 23:19:03.516521 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:03.516521 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:03.516521 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 23:19:03.516521 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 23:19:03.516521 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:03.516521 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:03.516521 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:19:03.516521 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:19:03.518002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:03.518002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:03.518002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:19:03.518002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:19:03.518002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:03.518002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:03.518002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:19:03.518002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:19:03.518002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:19:03.518002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:19:03.518002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3c4a652f-42c4-4041-9993-713d60fc8fe7 does not exist Oct 10 23:19:03.518002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42f3d884-125b-4d08-b686-3808b12c3917'] Oct 10 23:19:03.518002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.518002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:03.518002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.518002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:03.518002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 10 23:19:03.518002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 23:19:03.518002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 23:19:03.519192 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 23:19:03.519192 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3c4a652f-42c4-4041-9993-713d60fc8fe7 does not exist Oct 10 23:19:03.519192 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42f3d884-125b-4d08-b686-3808b12c3917'] Oct 10 23:19:03.519192 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.519192 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:03.519192 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.519192 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:03.519192 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:03.519192 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:03.519192 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:19:03.519192 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:19:03.519192 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:19:03.519192 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:19:03.519192 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:19:03.519192 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:19:03.519192 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 10 23:19:03.519192 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 23:19:03.519192 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3c4a652f-42c4-4041-9993-713d60fc8fe7 does not exist Oct 10 23:19:03.519192 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42f3d884-125b-4d08-b686-3808b12c3917'] Oct 10 23:19:03.519192 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.520389 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:03.520389 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.520389 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:03.520389 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:03.520389 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:03.520389 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:19:03.520389 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:19:03.520389 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3c4a652f-42c4-4041-9993-713d60fc8fe7 does not exist Oct 10 23:19:03.520389 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-42f3d884-125b-4d08-b686-3808b12c3917'] Oct 10 23:19:03.520389 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:03.520389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-57ccfa65-40bf-461c-a12e-b062612d8c9c tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] Returning 404 to user: Security group 3c4a652f-42c4-4041-9993-713d60fc8fe7 does not exist Oct 10 23:19:03.520389 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-42f3d884-125b-4d08-b686-3808b12c3917'] {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:19:03.520389 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-57ccfa65-40bf-461c-a12e-b062612d8c9c tempest-SecurityGroupsNegativeTestJSON-486456462 tempest-SecurityGroupsNegativeTestJSON-486456462-project] 10.222.0.23 "PUT /compute/v2.1/os-security-groups/3c4a652f-42c4-4041-9993-713d60fc8fe7" status: 404 len: 194 microversion: 2.1 time: 0.140624 Oct 10 23:19:03.522157 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 327/640] 10.222.0.23 () {60 vars in 1290 bytes} [Mon Oct 10 23:19:03 2022] PUT /compute/v2.1/os-security-groups/3c4a652f-42c4-4041-9993-713d60fc8fe7 => generated 194 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:19:03.535671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-74956061-ef2f-4dd0-99e5-962e616408ca req-94f4f48d-413f-45ac-a65b-2a50409a584d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a45a7de2-2607-4f13-87e3-2c7e74785470", "name": "network-vif-unplugged", "status": "completed", "tag": "fdbc7ece-ba7d-48ea-9d4a-166ef6293a46"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:03.566467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-74956061-ef2f-4dd0-99e5-962e616408ca req-94f4f48d-413f-45ac-a65b-2a50409a584d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:03.577553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-74956061-ef2f-4dd0-99e5-962e616408ca req-94f4f48d-413f-45ac-a65b-2a50409a584d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:03.578197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-74956061-ef2f-4dd0-99e5-962e616408ca req-94f4f48d-413f-45ac-a65b-2a50409a584d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:03.598912 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-74956061-ef2f-4dd0-99e5-962e616408ca req-94f4f48d-413f-45ac-a65b-2a50409a584d service nova] Creating event network-vif-unplugged:fdbc7ece-ba7d-48ea-9d4a-166ef6293a46 for instance a45a7de2-2607-4f13-87e3-2c7e74785470 on n-h1-860864-2 Oct 10 23:19:03.624439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [req-74956061-ef2f-4dd0-99e5-962e616408ca req-94f4f48d-413f-45ac-a65b-2a50409a584d service nova] Instance a45a7de2-2607-4f13-87e3-2c7e74785470 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 23:19:03.644720 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-74956061-ef2f-4dd0-99e5-962e616408ca req-94f4f48d-413f-45ac-a65b-2a50409a584d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111835 Oct 10 23:19:03.651035 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 328/641] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:03.768549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b3a4f820-1ec3-4310-9c0e-0d9d40b4f9b9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1991098198", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "de46cdec-ec5d-4348-b04f-dbf364a4ee52"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:03.858356 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-b3a4f820-1ec3-4310-9c0e-0d9d40b4f9b9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] validate_networks() for [('de46cdec-ec5d-4348-b04f-dbf364a4ee52', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:19:04.195181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-43449741-662f-461a-97f4-f15fe2e50727 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:04.209542 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-43449741-662f-461a-97f4-f15fe2e50727 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1311 microversion: 2.1 time: 0.736554 Oct 10 23:19:04.211749 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 314/642] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:03 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1311 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:04.225272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c5500fc3-49a7-4e9f-a1f2-7d457578ffef tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:04.225931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c5500fc3-49a7-4e9f-a1f2-7d457578ffef tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:04.264134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5500fc3-49a7-4e9f-a1f2-7d457578ffef tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:04.267795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5500fc3-49a7-4e9f-a1f2-7d457578ffef tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:04.268324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5500fc3-49a7-4e9f-a1f2-7d457578ffef tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:04.269142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5500fc3-49a7-4e9f-a1f2-7d457578ffef tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:04.269803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5500fc3-49a7-4e9f-a1f2-7d457578ffef tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:04.272480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5500fc3-49a7-4e9f-a1f2-7d457578ffef tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:04.423191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5500fc3-49a7-4e9f-a1f2-7d457578ffef tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:04.423688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5500fc3-49a7-4e9f-a1f2-7d457578ffef tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:04.424126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5500fc3-49a7-4e9f-a1f2-7d457578ffef tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:04.424580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-c5500fc3-49a7-4e9f-a1f2-7d457578ffef tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lazy-loading 'fault' on Instance uuid f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:19:04.782928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c5500fc3-49a7-4e9f-a1f2-7d457578ffef tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12f4b43c646c4aba88160ffeb98c6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7443a53a70743a09144270de0904832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:04.804203 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c5500fc3-49a7-4e9f-a1f2-7d457578ffef tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" status: 200 len: 1322 microversion: 2.1 time: 0.583192 Oct 10 23:19:04.806313 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 315/643] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:04 2022] GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 => generated 1322 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:04.819885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f23e2b03-05e8-4ba0-8c35-98e859ae66a2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:04.820938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f23e2b03-05e8-4ba0-8c35-98e859ae66a2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:04.831155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f23e2b03-05e8-4ba0-8c35-98e859ae66a2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:04.832249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f23e2b03-05e8-4ba0-8c35-98e859ae66a2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:04.832867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f23e2b03-05e8-4ba0-8c35-98e859ae66a2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:04.834101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f23e2b03-05e8-4ba0-8c35-98e859ae66a2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:04.834813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f23e2b03-05e8-4ba0-8c35-98e859ae66a2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:04.835456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f23e2b03-05e8-4ba0-8c35-98e859ae66a2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:05.769348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f23e2b03-05e8-4ba0-8c35-98e859ae66a2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:05.776164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:05.787116 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f23e2b03-05e8-4ba0-8c35-98e859ae66a2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1473 microversion: 2.1 time: 0.978908 Oct 10 23:19:05.795606 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 316/644] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:04 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1473 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:05.801625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-b6bcbc9b-cda5-453c-abee-f34e8383a83b req-ec49cb26-454f-42e2-918e-9de3cdf06ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7", "name": "network-vif-deleted", "tag": "9d1017db-e093-43c6-b9a1-81a16928b5cf"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:05.816021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b6bcbc9b-cda5-453c-abee-f34e8383a83b req-ec49cb26-454f-42e2-918e-9de3cdf06ebb service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:05.817933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b6bcbc9b-cda5-453c-abee-f34e8383a83b req-ec49cb26-454f-42e2-918e-9de3cdf06ebb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:05.818578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b6bcbc9b-cda5-453c-abee-f34e8383a83b req-ec49cb26-454f-42e2-918e-9de3cdf06ebb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:05.847479 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-b6bcbc9b-cda5-453c-abee-f34e8383a83b req-ec49cb26-454f-42e2-918e-9de3cdf06ebb service nova] Creating event network-vif-deleted:9d1017db-e093-43c6-b9a1-81a16928b5cf for instance f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 on n-h1-860864-2 Oct 10 23:19:05.855164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-b3a4f820-1ec3-4310-9c0e-0d9d40b4f9b9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:19:05.856355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-b3a4f820-1ec3-4310-9c0e-0d9d40b4f9b9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:19:05.857667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-b3a4f820-1ec3-4310-9c0e-0d9d40b4f9b9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:19:05.858652 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-b3a4f820-1ec3-4310-9c0e-0d9d40b4f9b9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:19:05.859548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-b3a4f820-1ec3-4310-9c0e-0d9d40b4f9b9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:19:05.866392 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-b6bcbc9b-cda5-453c-abee-f34e8383a83b req-ec49cb26-454f-42e2-918e-9de3cdf06ebb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068242 Oct 10 23:19:05.867373 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 317/645] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:05.878511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dd8df5f9-3693-40c6-b26d-e937006963e6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:05.879562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dd8df5f9-3693-40c6-b26d-e937006963e6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:05.892193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3a4f820-1ec3-4310-9c0e-0d9d40b4f9b9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:05.893276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3a4f820-1ec3-4310-9c0e-0d9d40b4f9b9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:05.894600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3a4f820-1ec3-4310-9c0e-0d9d40b4f9b9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:05.895957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3a4f820-1ec3-4310-9c0e-0d9d40b4f9b9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:05.898127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3a4f820-1ec3-4310-9c0e-0d9d40b4f9b9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:05.900179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3a4f820-1ec3-4310-9c0e-0d9d40b4f9b9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:05.920707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd8df5f9-3693-40c6-b26d-e937006963e6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:05.921209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd8df5f9-3693-40c6-b26d-e937006963e6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:05.921679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd8df5f9-3693-40c6-b26d-e937006963e6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:05.922439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd8df5f9-3693-40c6-b26d-e937006963e6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:05.938235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd8df5f9-3693-40c6-b26d-e937006963e6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:05.939103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd8df5f9-3693-40c6-b26d-e937006963e6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:05.948113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-b3a4f820-1ec3-4310-9c0e-0d9d40b4f9b9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Getting quotas for project 01ebbb0c057c44be8b51615d59209d90. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:19:05.961602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-b3a4f820-1ec3-4310-9c0e-0d9d40b4f9b9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Getting quotas for user fabfd9ac67b645bf9234590b623c27b0 and project 01ebbb0c057c44be8b51615d59209d90. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:19:05.990993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b3a4f820-1ec3-4310-9c0e-0d9d40b4f9b9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:19:06.001979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b3a4f820-1ec3-4310-9c0e-0d9d40b4f9b9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:19:06.118015 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b3a4f820-1ec3-4310-9c0e-0d9d40b4f9b9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.465649 Oct 10 23:19:06.135729 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 329/646] 10.222.0.23 () {62 vars in 1188 bytes} [Mon Oct 10 23:19:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2484 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 23:19:06.148297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e01d8413-d953-4672-a2bf-e0feca7a865c tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:06.148815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e01d8413-d953-4672-a2bf-e0feca7a865c tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: 12574d37-08bd-4e05-8953-e2e680ebee8c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:06.202393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e01d8413-d953-4672-a2bf-e0feca7a865c tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:06.205893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e01d8413-d953-4672-a2bf-e0feca7a865c tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:06.206709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e01d8413-d953-4672-a2bf-e0feca7a865c tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:06.210514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e01d8413-d953-4672-a2bf-e0feca7a865c tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:06.212344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e01d8413-d953-4672-a2bf-e0feca7a865c tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:06.213016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e01d8413-d953-4672-a2bf-e0feca7a865c tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:06.261646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:06.293066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e01d8413-d953-4672-a2bf-e0feca7a865c tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: 12574d37-08bd-4e05-8953-e2e680ebee8c] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:19:06.524130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dd8df5f9-3693-40c6-b26d-e937006963e6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:06.538906 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e01d8413-d953-4672-a2bf-e0feca7a865c tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "DELETE /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c" status: 204 len: 0 microversion: 2.1 time: 0.392164 Oct 10 23:19:06.540728 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dd8df5f9-3693-40c6-b26d-e937006963e6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8" status: 200 len: 1316 microversion: 2.1 time: 0.665354 Oct 10 23:19:06.541591 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 318/648] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:05 2022] GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8 => generated 1316 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:06.542068 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 330/648] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:19:06 2022] DELETE /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:19:06.561877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-b42b465f-6513-4d60-8725-99ddfcca3986 req-5a208473-8b94-4fc3-92e6-e6c46571a9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87be6fab-2ad1-4a49-8b54-8eb2e50c3e29", "name": "network-vif-plugged", "status": "completed", "tag": "0e2b501e-2b2d-414d-9297-d0c72224e923"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:06.570049 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4528d5f0-c3f3-4131-b172-5607faafc9ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:06.572216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4528d5f0-c3f3-4131-b172-5607faafc9ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:06.599949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4528d5f0-c3f3-4131-b172-5607faafc9ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:06.601346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b42b465f-6513-4d60-8725-99ddfcca3986 req-5a208473-8b94-4fc3-92e6-e6c46571a9d8 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:06.601868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b42b465f-6513-4d60-8725-99ddfcca3986 req-5a208473-8b94-4fc3-92e6-e6c46571a9d8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:06.602305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b42b465f-6513-4d60-8725-99ddfcca3986 req-5a208473-8b94-4fc3-92e6-e6c46571a9d8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:06.604678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4528d5f0-c3f3-4131-b172-5607faafc9ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:06.616394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4528d5f0-c3f3-4131-b172-5607faafc9ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:06.621015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4528d5f0-c3f3-4131-b172-5607faafc9ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:06.621652 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4528d5f0-c3f3-4131-b172-5607faafc9ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:06.624317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4528d5f0-c3f3-4131-b172-5607faafc9ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:06.652793 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-b42b465f-6513-4d60-8725-99ddfcca3986 req-5a208473-8b94-4fc3-92e6-e6c46571a9d8 service nova] Creating event network-vif-plugged:0e2b501e-2b2d-414d-9297-d0c72224e923 for instance 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 on n-h1-860864-2 Oct 10 23:19:06.674556 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-b42b465f-6513-4d60-8725-99ddfcca3986 req-5a208473-8b94-4fc3-92e6-e6c46571a9d8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131531 Oct 10 23:19:06.677741 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 319/649] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:06.699795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-a7685e6e-d683-45a2-9352-54136241295b req-a96a99ad-93ab-4728-9580-b5f8cff0993a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a45a7de2-2607-4f13-87e3-2c7e74785470", "tag": "fdbc7ece-ba7d-48ea-9d4a-166ef6293a46"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:06.722466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=12 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:06.737557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a7685e6e-d683-45a2-9352-54136241295b req-a96a99ad-93ab-4728-9580-b5f8cff0993a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:06.738047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a7685e6e-d683-45a2-9352-54136241295b req-a96a99ad-93ab-4728-9580-b5f8cff0993a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:06.738480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a7685e6e-d683-45a2-9352-54136241295b req-a96a99ad-93ab-4728-9580-b5f8cff0993a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:06.782161 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a7685e6e-d683-45a2-9352-54136241295b req-a96a99ad-93ab-4728-9580-b5f8cff0993a service nova] Creating event network-changed:fdbc7ece-ba7d-48ea-9d4a-166ef6293a46 for instance a45a7de2-2607-4f13-87e3-2c7e74785470 on n-h1-860864-2 Oct 10 23:19:06.837004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-a7685e6e-d683-45a2-9352-54136241295b req-a96a99ad-93ab-4728-9580-b5f8cff0993a service nova] Instance a45a7de2-2607-4f13-87e3-2c7e74785470 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 23:19:06.870502 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-a7685e6e-d683-45a2-9352-54136241295b req-a96a99ad-93ab-4728-9580-b5f8cff0993a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191024 Oct 10 23:19:06.871582 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 320/650] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:06.892637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-61a626d4-e9e4-4886-afac-f12948c4e45f tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:06.893737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-61a626d4-e9e4-4886-afac-f12948c4e45f tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] [instance: f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:06.907448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61a626d4-e9e4-4886-afac-f12948c4e45f tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:06.909716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61a626d4-e9e4-4886-afac-f12948c4e45f tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:06.910341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61a626d4-e9e4-4886-afac-f12948c4e45f tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:06.911238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61a626d4-e9e4-4886-afac-f12948c4e45f tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:06.916853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61a626d4-e9e4-4886-afac-f12948c4e45f tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:06.917705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61a626d4-e9e4-4886-afac-f12948c4e45f tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:06.948894 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-61a626d4-e9e4-4886-afac-f12948c4e45f tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] HTTP exception thrown: Instance f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 could not be found. Oct 10 23:19:06.954657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-61a626d4-e9e4-4886-afac-f12948c4e45f tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Request method failure captured: Oct 10 23:19:06.954657 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 HTTP/1.1 Oct 10 23:19:06.954657 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:19:06.954657 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:19:06.954657 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:19:06.954657 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:19:06.954657 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:19:06.954657 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:19:06.954657 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:19:06.954657 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:19:06.954657 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKg0cwut1HB5YgrFXzkSoyTQeSNf6qxj0xNy0WuCa7qczJ5YOryQpfrH6W3_OXKI0wSEFQ7dkHey15_8SU63XZ1M5zNoYA5xJKEUqbiOMJD1gjTG32yJeFhm5TI4ij7gW9yADfvCHHnzt25MECSs7hWoeJNb8LWbHa2evy2T-Sx_2Fc Oct 10 23:19:06.954657 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:19:06.954657 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:19:06.954657 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:19:06.954657 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:19:06.954657 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:19:06.954657 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:19:06.954657 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: c7443a53a70743a09144270de0904832 Oct 10 23:19:06.954657 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-521344888 Oct 10 23:19:06.954657 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:19:06.954657 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:19:06.956413 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c7443a53a70743a09144270de0904832"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7443a53a70743a09144270de0904832"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7443a53a70743a09144270de0904832"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c7443a53a70743a09144270de0904832", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:19:06.956413 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-521344888 Oct 10 23:19:06.956413 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: c7443a53a70743a09144270de0904832 Oct 10 23:19:06.956413 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-521344888 Oct 10 23:19:06.956413 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project Oct 10 23:19:06.956413 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:19:06.956413 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:19:06.956413 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 12f4b43c646c4aba88160ffeb98c6aa8 Oct 10 23:19:06.956413 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project Oct 10 23:19:06.956413 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:19:06.956413 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 could not be found. Oct 10 23:19:06.957349 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7'} Oct 10 23:19:06.957349 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:19:06.957349 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:06.957349 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:19:06.957349 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:19:06.957349 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:19:06.957349 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:19:06.957349 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:19:06.957349 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:19:06.957349 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:19:06.957349 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:19:06.957349 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 could not be found. Oct 10 23:19:06.957349 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:06.957349 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:06.957349 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:06.957349 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:06.957349 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:06.957349 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:06.957349 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:19:06.957349 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:19:06.958965 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:19:06.958965 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:19:06.958965 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:19:06.958965 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:19:06.958965 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:19:06.958965 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:19:06.958965 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:19:06.958965 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:19:06.958965 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 could not be found. Oct 10 23:19:06.958965 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:06.958965 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:06.958965 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:06.958965 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:06.958965 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:06.958965 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:06.958965 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:19:06.958965 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:19:06.958965 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 could not be found. Oct 10 23:19:06.958965 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:06.961873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-61a626d4-e9e4-4886-afac-f12948c4e45f tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] Returning 404 to user: Instance f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:19:06.965468 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-61a626d4-e9e4-4886-afac-f12948c4e45f tempest-FloatingIPsAssociationNegativeTestJSON-521344888 tempest-FloatingIPsAssociationNegativeTestJSON-521344888-project] 10.222.0.23 "GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7" status: 404 len: 111 microversion: 2.1 time: 0.077742 Oct 10 23:19:06.968009 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 321/651] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:06 2022] GET /compute/v2.1/servers/f4a0d9e3-8f2c-4ce1-a192-89286cc7b0e7 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:19:06.978501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bd587aee-8e8e-4e3a-8099-54ea46e6c2f1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:06.982684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bd587aee-8e8e-4e3a-8099-54ea46e6c2f1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:06.999993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4528d5f0-c3f3-4131-b172-5607faafc9ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:07.010934 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4528d5f0-c3f3-4131-b172-5607faafc9ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1311 microversion: 2.1 time: 0.467356 Oct 10 23:19:07.025418 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 331/652] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:06 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1311 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:07.026761 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-90a5e237-a4b0-4be7-9386-0b038036cb7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-128848871", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "2002068468", "adminPass": "***", "networks": [{"uuid": "bd3fa17b-fc0e-4718-b288-41305d8c3332"}], "security_groups": [{"name": "tempest-securitygroup--872600194"}], "key_name": "tempest-keypair-589213585", "user_data": "}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:07.171344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bd587aee-8e8e-4e3a-8099-54ea46e6c2f1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:07.188045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bd587aee-8e8e-4e3a-8099-54ea46e6c2f1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:07.189977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bd587aee-8e8e-4e3a-8099-54ea46e6c2f1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:07.198984 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bd587aee-8e8e-4e3a-8099-54ea46e6c2f1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1262 microversion: 2.25 time: 0.229698 Oct 10 23:19:07.215079 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 322/653] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:06 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1262 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:07.225596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f3d3cca8-032a-4128-a92c-3ae18b226797 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:07.226220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f3d3cca8-032a-4128-a92c-3ae18b226797 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:07.246811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3d3cca8-032a-4128-a92c-3ae18b226797 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:07.247422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3d3cca8-032a-4128-a92c-3ae18b226797 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:07.248085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3d3cca8-032a-4128-a92c-3ae18b226797 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:07.248814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3d3cca8-032a-4128-a92c-3ae18b226797 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:07.249276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3d3cca8-032a-4128-a92c-3ae18b226797 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:07.252158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3d3cca8-032a-4128-a92c-3ae18b226797 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:07.478043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-90a5e237-a4b0-4be7-9386-0b038036cb7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] validate_networks() for [('bd3fa17b-fc0e-4718-b288-41305d8c3332', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:19:07.832448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f3d3cca8-032a-4128-a92c-3ae18b226797 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:07.842815 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f3d3cca8-032a-4128-a92c-3ae18b226797 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1471 microversion: 2.1 time: 0.626240 Oct 10 23:19:07.843402 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 323/654] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:07 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1471 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:07.849328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-58d3c9dc-0f66-4031-a0af-cff6af87589b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:07.850213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-58d3c9dc-0f66-4031-a0af-cff6af87589b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:07.856624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58d3c9dc-0f66-4031-a0af-cff6af87589b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:07.857634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58d3c9dc-0f66-4031-a0af-cff6af87589b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:07.858260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58d3c9dc-0f66-4031-a0af-cff6af87589b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:07.859313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58d3c9dc-0f66-4031-a0af-cff6af87589b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:07.859953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58d3c9dc-0f66-4031-a0af-cff6af87589b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:07.860577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58d3c9dc-0f66-4031-a0af-cff6af87589b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:08.444443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-58d3c9dc-0f66-4031-a0af-cff6af87589b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:08.455581 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-58d3c9dc-0f66-4031-a0af-cff6af87589b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8" status: 200 len: 1316 microversion: 2.1 time: 0.609890 Oct 10 23:19:08.479602 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 324/655] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:07 2022] GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8 => generated 1316 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:08.501811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-eb07cfaa-e1e5-4172-bf8a-04d60e7f8b23 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:08.506759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-eb07cfaa-e1e5-4172-bf8a-04d60e7f8b23 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:08.521230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb07cfaa-e1e5-4172-bf8a-04d60e7f8b23 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:08.523284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb07cfaa-e1e5-4172-bf8a-04d60e7f8b23 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:08.523896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb07cfaa-e1e5-4172-bf8a-04d60e7f8b23 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:08.526260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb07cfaa-e1e5-4172-bf8a-04d60e7f8b23 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:08.529910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb07cfaa-e1e5-4172-bf8a-04d60e7f8b23 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:08.530588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb07cfaa-e1e5-4172-bf8a-04d60e7f8b23 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:09.013880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-90a5e237-a4b0-4be7-9386-0b038036cb7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:19:09.014460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-90a5e237-a4b0-4be7-9386-0b038036cb7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:19:09.015265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-90a5e237-a4b0-4be7-9386-0b038036cb7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:19:09.015935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-90a5e237-a4b0-4be7-9386-0b038036cb7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:19:09.016654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-90a5e237-a4b0-4be7-9386-0b038036cb7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:19:09.036838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90a5e237-a4b0-4be7-9386-0b038036cb7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:09.043767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90a5e237-a4b0-4be7-9386-0b038036cb7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:09.044388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90a5e237-a4b0-4be7-9386-0b038036cb7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:09.045222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90a5e237-a4b0-4be7-9386-0b038036cb7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:09.045731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90a5e237-a4b0-4be7-9386-0b038036cb7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:09.046166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90a5e237-a4b0-4be7-9386-0b038036cb7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:09.091901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-90a5e237-a4b0-4be7-9386-0b038036cb7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Getting quotas for project 25f3787ea28344e78082ff74d7540f43. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:19:09.111794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-90a5e237-a4b0-4be7-9386-0b038036cb7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Getting quotas for user e6cd6d7dfaeb4ac79fabf16698c60f96 and project 25f3787ea28344e78082ff74d7540f43. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:19:09.136004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-90a5e237-a4b0-4be7-9386-0b038036cb7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:19:09.141409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-90a5e237-a4b0-4be7-9386-0b038036cb7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:19:09.256565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-eb07cfaa-e1e5-4172-bf8a-04d60e7f8b23 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:09.269944 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-eb07cfaa-e1e5-4172-bf8a-04d60e7f8b23 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1311 microversion: 2.1 time: 0.788427 Oct 10 23:19:09.273050 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 325/656] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:08 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1311 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:09.280596 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-90a5e237-a4b0-4be7-9386-0b038036cb7b tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.259493 Oct 10 23:19:09.282925 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 332/657] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:19:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 2269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:19:09.299564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-10d637e8-3a6e-42fd-b25a-9a117077d981 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:09.300202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-10d637e8-3a6e-42fd-b25a-9a117077d981 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:09.304299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-78bde443-e76d-4aae-ad84-8f2e8143c177 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:09.305435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-78bde443-e76d-4aae-ad84-8f2e8143c177 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:09.307343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10d637e8-3a6e-42fd-b25a-9a117077d981 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:09.307838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10d637e8-3a6e-42fd-b25a-9a117077d981 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:09.308335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10d637e8-3a6e-42fd-b25a-9a117077d981 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:09.309093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10d637e8-3a6e-42fd-b25a-9a117077d981 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:09.309609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10d637e8-3a6e-42fd-b25a-9a117077d981 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:09.310812 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10d637e8-3a6e-42fd-b25a-9a117077d981 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:09.344873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-78bde443-e76d-4aae-ad84-8f2e8143c177 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:09.348236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-78bde443-e76d-4aae-ad84-8f2e8143c177 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:09.348706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-78bde443-e76d-4aae-ad84-8f2e8143c177 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:09.349488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-78bde443-e76d-4aae-ad84-8f2e8143c177 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:09.355352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-78bde443-e76d-4aae-ad84-8f2e8143c177 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:09.360166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-78bde443-e76d-4aae-ad84-8f2e8143c177 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:09.558447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-78bde443-e76d-4aae-ad84-8f2e8143c177 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:09.567946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-78bde443-e76d-4aae-ad84-8f2e8143c177 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:09.573117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-78bde443-e76d-4aae-ad84-8f2e8143c177 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:09.574523 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-78bde443-e76d-4aae-ad84-8f2e8143c177 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1320 microversion: 2.25 time: 0.300063 Oct 10 23:19:09.591752 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 326/658] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:09 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1320 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:09.603321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8fb3d970-1b93-4201-b017-4b8bbfc06829 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:09.604010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8fb3d970-1b93-4201-b017-4b8bbfc06829 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:09.872544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8fb3d970-1b93-4201-b017-4b8bbfc06829 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:09.881603 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8fb3d970-1b93-4201-b017-4b8bbfc06829 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 200 len: 1263 microversion: 2.1 time: 0.287255 Oct 10 23:19:09.883012 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 327/659] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:09 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 1263 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:09.890115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d407ada4-f92e-444d-a42a-7702300af947 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:09.891008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d407ada4-f92e-444d-a42a-7702300af947 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:09.901511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d407ada4-f92e-444d-a42a-7702300af947 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:09.902705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d407ada4-f92e-444d-a42a-7702300af947 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:09.904302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d407ada4-f92e-444d-a42a-7702300af947 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:09.905425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d407ada4-f92e-444d-a42a-7702300af947 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:09.906498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d407ada4-f92e-444d-a42a-7702300af947 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:09.907954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d407ada4-f92e-444d-a42a-7702300af947 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:10.109717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-10d637e8-3a6e-42fd-b25a-9a117077d981 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:10.121727 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-10d637e8-3a6e-42fd-b25a-9a117077d981 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1471 microversion: 2.1 time: 0.837686 Oct 10 23:19:10.123142 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 333/660] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:09 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1471 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:10.297506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9212efb3-92ef-456a-90b6-ead5491b3dcd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:10.298148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9212efb3-92ef-456a-90b6-ead5491b3dcd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:10.307986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9212efb3-92ef-456a-90b6-ead5491b3dcd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:10.308462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9212efb3-92ef-456a-90b6-ead5491b3dcd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:10.309153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9212efb3-92ef-456a-90b6-ead5491b3dcd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:10.310056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9212efb3-92ef-456a-90b6-ead5491b3dcd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:10.317884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9212efb3-92ef-456a-90b6-ead5491b3dcd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:10.318649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9212efb3-92ef-456a-90b6-ead5491b3dcd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:10.676199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9212efb3-92ef-456a-90b6-ead5491b3dcd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:10.684905 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9212efb3-92ef-456a-90b6-ead5491b3dcd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1311 microversion: 2.1 time: 0.392360 Oct 10 23:19:10.702076 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 334/661] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:10 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1311 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:19:10.709649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1041aad8-abfd-48b0-8a8d-d463f661c1eb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:10.710362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1041aad8-abfd-48b0-8a8d-d463f661c1eb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:10.717408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1041aad8-abfd-48b0-8a8d-d463f661c1eb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:10.717981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1041aad8-abfd-48b0-8a8d-d463f661c1eb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:10.718494 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1041aad8-abfd-48b0-8a8d-d463f661c1eb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:10.719339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1041aad8-abfd-48b0-8a8d-d463f661c1eb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:10.720033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1041aad8-abfd-48b0-8a8d-d463f661c1eb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:10.720557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1041aad8-abfd-48b0-8a8d-d463f661c1eb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:10.747965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d407ada4-f92e-444d-a42a-7702300af947 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:10.767567 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d407ada4-f92e-444d-a42a-7702300af947 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8" status: 200 len: 1316 microversion: 2.1 time: 0.879649 Oct 10 23:19:10.768352 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 328/662] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:09 2022] GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8 => generated 1316 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:10.904813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0250ad1f-8840-4994-a20c-84922bf5c6ab tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:10.905571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0250ad1f-8840-4994-a20c-84922bf5c6ab tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:10.916091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0250ad1f-8840-4994-a20c-84922bf5c6ab tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:10.916760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0250ad1f-8840-4994-a20c-84922bf5c6ab tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:10.917276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0250ad1f-8840-4994-a20c-84922bf5c6ab tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:10.919857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0250ad1f-8840-4994-a20c-84922bf5c6ab tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:10.929486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0250ad1f-8840-4994-a20c-84922bf5c6ab tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:10.930348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0250ad1f-8840-4994-a20c-84922bf5c6ab tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:10.977230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1041aad8-abfd-48b0-8a8d-d463f661c1eb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:10.992967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1041aad8-abfd-48b0-8a8d-d463f661c1eb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:10.995261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1041aad8-abfd-48b0-8a8d-d463f661c1eb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:11.002121 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1041aad8-abfd-48b0-8a8d-d463f661c1eb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1320 microversion: 2.25 time: 0.296562 Oct 10 23:19:11.005188 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 335/663] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:10 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1320 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:11.143630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0250ad1f-8840-4994-a20c-84922bf5c6ab tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:11.154421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c788a5b2-6906-4376-bf23-42dcc548be11 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:11.155440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c788a5b2-6906-4376-bf23-42dcc548be11 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:11.157784 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0250ad1f-8840-4994-a20c-84922bf5c6ab tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 200 len: 1315 microversion: 2.1 time: 0.255285 Oct 10 23:19:11.158771 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 329/664] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:10 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:19:11.171096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c788a5b2-6906-4376-bf23-42dcc548be11 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:11.171597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c788a5b2-6906-4376-bf23-42dcc548be11 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:11.172029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c788a5b2-6906-4376-bf23-42dcc548be11 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:11.172739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c788a5b2-6906-4376-bf23-42dcc548be11 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:11.173190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c788a5b2-6906-4376-bf23-42dcc548be11 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:11.173645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c788a5b2-6906-4376-bf23-42dcc548be11 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:11.666612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c788a5b2-6906-4376-bf23-42dcc548be11 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:11.708684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dc374cc2-eca9-4d31-8e04-902d23c66aee tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:11.709307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dc374cc2-eca9-4d31-8e04-902d23c66aee tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:11.716374 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc374cc2-eca9-4d31-8e04-902d23c66aee tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:11.717076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc374cc2-eca9-4d31-8e04-902d23c66aee tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:11.721858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc374cc2-eca9-4d31-8e04-902d23c66aee tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:11.722697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc374cc2-eca9-4d31-8e04-902d23c66aee tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:11.725585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc374cc2-eca9-4d31-8e04-902d23c66aee tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:11.726082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc374cc2-eca9-4d31-8e04-902d23c66aee tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:11.737544 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c788a5b2-6906-4376-bf23-42dcc548be11 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1468 microversion: 2.1 time: 0.586731 Oct 10 23:19:11.739623 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 336/665] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:11 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1468 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:19:11.770895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4f072377-32d1-4021-96b0-4de809f8c249 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:11.771447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4f072377-32d1-4021-96b0-4de809f8c249 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:11.782396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f072377-32d1-4021-96b0-4de809f8c249 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:11.784437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f072377-32d1-4021-96b0-4de809f8c249 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:11.786972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f072377-32d1-4021-96b0-4de809f8c249 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:11.787814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f072377-32d1-4021-96b0-4de809f8c249 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:11.791468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f072377-32d1-4021-96b0-4de809f8c249 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:11.791931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f072377-32d1-4021-96b0-4de809f8c249 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:11.979669 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4f072377-32d1-4021-96b0-4de809f8c249 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "POST /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470/action" status: 204 len: 0 microversion: 2.1 time: 0.213737 Oct 10 23:19:11.980984 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 337/666] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:19:11 2022] POST /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470/action => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:19:11.987055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e7df52d7-5670-440f-96a5-0dfe2e913b4f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:11.988077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e7df52d7-5670-440f-96a5-0dfe2e913b4f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:12.003911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7df52d7-5670-440f-96a5-0dfe2e913b4f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:12.004762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7df52d7-5670-440f-96a5-0dfe2e913b4f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:12.005422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7df52d7-5670-440f-96a5-0dfe2e913b4f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:12.007544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7df52d7-5670-440f-96a5-0dfe2e913b4f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:12.008447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7df52d7-5670-440f-96a5-0dfe2e913b4f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:12.008880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7df52d7-5670-440f-96a5-0dfe2e913b4f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:12.423781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dc374cc2-eca9-4d31-8e04-902d23c66aee tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:12.435675 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dc374cc2-eca9-4d31-8e04-902d23c66aee tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1311 microversion: 2.1 time: 0.730313 Oct 10 23:19:12.437412 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 330/667] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:11 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1311 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:19:12.443009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-abfcdb2e-67c7-454e-b98a-1e68735d468a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:12.443908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-abfcdb2e-67c7-454e-b98a-1e68735d468a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:12.453103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abfcdb2e-67c7-454e-b98a-1e68735d468a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:12.453879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abfcdb2e-67c7-454e-b98a-1e68735d468a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:12.455158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abfcdb2e-67c7-454e-b98a-1e68735d468a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:12.456916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abfcdb2e-67c7-454e-b98a-1e68735d468a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:12.458297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abfcdb2e-67c7-454e-b98a-1e68735d468a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:12.458929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abfcdb2e-67c7-454e-b98a-1e68735d468a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:12.503785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e7df52d7-5670-440f-96a5-0dfe2e913b4f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:12.513127 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e7df52d7-5670-440f-96a5-0dfe2e913b4f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8" status: 200 len: 1316 microversion: 2.1 time: 0.530414 Oct 10 23:19:12.517191 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 338/668] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:11 2022] GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8 => generated 1316 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:12.522690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b7a5cc49-014f-4ff3-9039-0d5ac9e4249a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:12.536919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b7a5cc49-014f-4ff3-9039-0d5ac9e4249a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:12.547944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7a5cc49-014f-4ff3-9039-0d5ac9e4249a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:12.548708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7a5cc49-014f-4ff3-9039-0d5ac9e4249a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:12.549947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7a5cc49-014f-4ff3-9039-0d5ac9e4249a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:12.550820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7a5cc49-014f-4ff3-9039-0d5ac9e4249a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:12.551429 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7a5cc49-014f-4ff3-9039-0d5ac9e4249a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:12.551998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7a5cc49-014f-4ff3-9039-0d5ac9e4249a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:13.138442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-abfcdb2e-67c7-454e-b98a-1e68735d468a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:13.173237 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-abfcdb2e-67c7-454e-b98a-1e68735d468a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1468 microversion: 2.1 time: 0.722278 Oct 10 23:19:13.174589 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 331/669] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:12 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1468 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:13.196737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-170ffda7-4a09-4a15-9e71-e917ee36ee96 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:13.197369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-170ffda7-4a09-4a15-9e71-e917ee36ee96 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:13.220036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-170ffda7-4a09-4a15-9e71-e917ee36ee96 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:13.220538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-170ffda7-4a09-4a15-9e71-e917ee36ee96 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:13.221566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-170ffda7-4a09-4a15-9e71-e917ee36ee96 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:13.223048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-170ffda7-4a09-4a15-9e71-e917ee36ee96 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:13.224236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-170ffda7-4a09-4a15-9e71-e917ee36ee96 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:13.224688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-170ffda7-4a09-4a15-9e71-e917ee36ee96 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:13.401576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-170ffda7-4a09-4a15-9e71-e917ee36ee96 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:13.445541 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-170ffda7-4a09-4a15-9e71-e917ee36ee96 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 200 len: 1321 microversion: 2.1 time: 0.266715 Oct 10 23:19:13.461648 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 332/670] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:13 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:13.461648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-ab5f7b30-3693-4d38-9b9a-4b3a91e5c80d req-967eac9e-81e4-4a09-a2a3-fec77e949bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a45a7de2-2607-4f13-87e3-2c7e74785470", "name": "network-vif-plugged", "status": "completed", "tag": "fdbc7ece-ba7d-48ea-9d4a-166ef6293a46"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:13.485607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ab5f7b30-3693-4d38-9b9a-4b3a91e5c80d req-967eac9e-81e4-4a09-a2a3-fec77e949bb8 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:13.486706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ab5f7b30-3693-4d38-9b9a-4b3a91e5c80d req-967eac9e-81e4-4a09-a2a3-fec77e949bb8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:13.487908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ab5f7b30-3693-4d38-9b9a-4b3a91e5c80d req-967eac9e-81e4-4a09-a2a3-fec77e949bb8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:13.519240 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-ab5f7b30-3693-4d38-9b9a-4b3a91e5c80d req-967eac9e-81e4-4a09-a2a3-fec77e949bb8 service nova] Creating event network-vif-plugged:fdbc7ece-ba7d-48ea-9d4a-166ef6293a46 for instance a45a7de2-2607-4f13-87e3-2c7e74785470 on n-h1-860864-2 Oct 10 23:19:13.556343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-ab5f7b30-3693-4d38-9b9a-4b3a91e5c80d req-967eac9e-81e4-4a09-a2a3-fec77e949bb8 service nova] Instance a45a7de2-2607-4f13-87e3-2c7e74785470 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 23:19:13.576539 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-ab5f7b30-3693-4d38-9b9a-4b3a91e5c80d req-967eac9e-81e4-4a09-a2a3-fec77e949bb8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124151 Oct 10 23:19:13.577369 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 333/671] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:13.583729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a21f665d-fed4-46e8-9a8c-629c92f0b2ff tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:13.584437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a21f665d-fed4-46e8-9a8c-629c92f0b2ff tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:13.595975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a21f665d-fed4-46e8-9a8c-629c92f0b2ff tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:13.597283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a21f665d-fed4-46e8-9a8c-629c92f0b2ff tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:13.598126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a21f665d-fed4-46e8-9a8c-629c92f0b2ff tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:13.599253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a21f665d-fed4-46e8-9a8c-629c92f0b2ff tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:13.599536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a21f665d-fed4-46e8-9a8c-629c92f0b2ff tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:13.600025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a21f665d-fed4-46e8-9a8c-629c92f0b2ff tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:13.616894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b7a5cc49-014f-4ff3-9039-0d5ac9e4249a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:13.634171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b7a5cc49-014f-4ff3-9039-0d5ac9e4249a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:13.635872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b7a5cc49-014f-4ff3-9039-0d5ac9e4249a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:13.637139 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b7a5cc49-014f-4ff3-9039-0d5ac9e4249a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1362 microversion: 2.25 time: 1.118204 Oct 10 23:19:13.640037 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 339/672] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:12 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1362 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:13.646094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f80bbab5-552a-4fc5-a198-ab27d7fe1b84 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:13.647008 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f80bbab5-552a-4fc5-a198-ab27d7fe1b84 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:13.655501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f80bbab5-552a-4fc5-a198-ab27d7fe1b84 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:13.656433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f80bbab5-552a-4fc5-a198-ab27d7fe1b84 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:13.657344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f80bbab5-552a-4fc5-a198-ab27d7fe1b84 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:13.658663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f80bbab5-552a-4fc5-a198-ab27d7fe1b84 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:13.659588 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f80bbab5-552a-4fc5-a198-ab27d7fe1b84 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:13.660231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f80bbab5-552a-4fc5-a198-ab27d7fe1b84 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:14.346397 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f80bbab5-552a-4fc5-a198-ab27d7fe1b84 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:14.362286 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f80bbab5-552a-4fc5-a198-ab27d7fe1b84 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8" status: 200 len: 1316 microversion: 2.1 time: 0.719999 Oct 10 23:19:14.364049 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 340/673] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:13 2022] GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8 => generated 1316 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:14.371389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-f3c9452c-4b45-408c-b223-228e0dee6080 req-a34a793b-fac2-4175-acbe-0ae8729547b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d61c758-b733-4d1e-8dbb-99cda309c9c8", "tag": "62320ef9-2ee0-496d-ba83-d8d6fb707554"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:14.418215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f3c9452c-4b45-408c-b223-228e0dee6080 req-a34a793b-fac2-4175-acbe-0ae8729547b0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:14.420797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f3c9452c-4b45-408c-b223-228e0dee6080 req-a34a793b-fac2-4175-acbe-0ae8729547b0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:14.421861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f3c9452c-4b45-408c-b223-228e0dee6080 req-a34a793b-fac2-4175-acbe-0ae8729547b0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:14.422790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a21f665d-fed4-46e8-9a8c-629c92f0b2ff tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:14.434103 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a21f665d-fed4-46e8-9a8c-629c92f0b2ff tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1494 microversion: 2.1 time: 0.855442 Oct 10 23:19:14.435311 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 334/674] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:13 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1494 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:14.459722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-91c55123-12cb-424a-85a5-0162ec221e25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:14.460453 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-f3c9452c-4b45-408c-b223-228e0dee6080 req-a34a793b-fac2-4175-acbe-0ae8729547b0 service nova] Creating event network-changed:62320ef9-2ee0-496d-ba83-d8d6fb707554 for instance 5d61c758-b733-4d1e-8dbb-99cda309c9c8 on n-h1-860864-2 Oct 10 23:19:14.464590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-91c55123-12cb-424a-85a5-0162ec221e25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:14.469405 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-f3c9452c-4b45-408c-b223-228e0dee6080 req-a34a793b-fac2-4175-acbe-0ae8729547b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103776 Oct 10 23:19:14.470430 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 341/675] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:14.475882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-466a373c-3911-4925-8394-141c920b49fd tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:14.476987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-466a373c-3911-4925-8394-141c920b49fd tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:14.484236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-466a373c-3911-4925-8394-141c920b49fd tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:14.485105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-466a373c-3911-4925-8394-141c920b49fd tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:14.486008 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-466a373c-3911-4925-8394-141c920b49fd tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:14.486969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-466a373c-3911-4925-8394-141c920b49fd tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:14.487757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-466a373c-3911-4925-8394-141c920b49fd tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:14.488446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-466a373c-3911-4925-8394-141c920b49fd tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:14.490934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91c55123-12cb-424a-85a5-0162ec221e25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:14.492059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91c55123-12cb-424a-85a5-0162ec221e25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:14.493729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91c55123-12cb-424a-85a5-0162ec221e25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:14.494558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91c55123-12cb-424a-85a5-0162ec221e25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:14.496116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91c55123-12cb-424a-85a5-0162ec221e25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:14.496663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91c55123-12cb-424a-85a5-0162ec221e25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:14.965492 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-466a373c-3911-4925-8394-141c920b49fd tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1645 microversion: 2.1 time: 0.493455 Oct 10 23:19:14.972010 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 342/676] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:14 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1645 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:14.976972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-340d66da-926c-4cd1-8226-9f726953b900 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:14.981289 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-340d66da-926c-4cd1-8226-9f726953b900 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:15.003379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-340d66da-926c-4cd1-8226-9f726953b900 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:15.003886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-340d66da-926c-4cd1-8226-9f726953b900 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:15.004328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-340d66da-926c-4cd1-8226-9f726953b900 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:15.005536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-340d66da-926c-4cd1-8226-9f726953b900 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:15.005536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-340d66da-926c-4cd1-8226-9f726953b900 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:15.008291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-340d66da-926c-4cd1-8226-9f726953b900 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:15.087866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-91c55123-12cb-424a-85a5-0162ec221e25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:15.102559 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-91c55123-12cb-424a-85a5-0162ec221e25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1468 microversion: 2.1 time: 0.665065 Oct 10 23:19:15.107739 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 335/677] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:14 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1468 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:15.120630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-03cf0487-7e58-4672-91dc-df90f198f7b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:15.122166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-03cf0487-7e58-4672-91dc-df90f198f7b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:15.135389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03cf0487-7e58-4672-91dc-df90f198f7b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:15.135895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03cf0487-7e58-4672-91dc-df90f198f7b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:15.141282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03cf0487-7e58-4672-91dc-df90f198f7b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:15.143232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03cf0487-7e58-4672-91dc-df90f198f7b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:15.143362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03cf0487-7e58-4672-91dc-df90f198f7b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:15.143807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03cf0487-7e58-4672-91dc-df90f198f7b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:15.864993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-03cf0487-7e58-4672-91dc-df90f198f7b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:15.888047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-03cf0487-7e58-4672-91dc-df90f198f7b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:15.898825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-03cf0487-7e58-4672-91dc-df90f198f7b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:15.900802 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-03cf0487-7e58-4672-91dc-df90f198f7b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1362 microversion: 2.25 time: 0.790479 Oct 10 23:19:15.924096 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 336/678] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:15 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1362 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:15.944187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-961a35f4-71ec-4dd1-a8e4-06393f40c3ac tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:15.954803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-961a35f4-71ec-4dd1-a8e4-06393f40c3ac tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:15.976884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-961a35f4-71ec-4dd1-a8e4-06393f40c3ac tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:15.978949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-961a35f4-71ec-4dd1-a8e4-06393f40c3ac tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:15.979653 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-961a35f4-71ec-4dd1-a8e4-06393f40c3ac tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:15.980605 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-961a35f4-71ec-4dd1-a8e4-06393f40c3ac tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:15.981296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-961a35f4-71ec-4dd1-a8e4-06393f40c3ac tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:15.982399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-961a35f4-71ec-4dd1-a8e4-06393f40c3ac tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:16.260661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-340d66da-926c-4cd1-8226-9f726953b900 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:16.283194 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-340d66da-926c-4cd1-8226-9f726953b900 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 200 len: 1388 microversion: 2.1 time: 1.306752 Oct 10 23:19:16.286784 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 343/679] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:14 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 1388 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:16.299078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-25d347c7-6893-4abf-81d8-f018dcebebe5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:16.300136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-25d347c7-6893-4abf-81d8-f018dcebebe5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:16.317546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25d347c7-6893-4abf-81d8-f018dcebebe5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:16.318141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25d347c7-6893-4abf-81d8-f018dcebebe5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:16.318531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25d347c7-6893-4abf-81d8-f018dcebebe5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:16.321332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25d347c7-6893-4abf-81d8-f018dcebebe5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:16.322208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25d347c7-6893-4abf-81d8-f018dcebebe5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:16.324791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25d347c7-6893-4abf-81d8-f018dcebebe5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:16.514919 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-961a35f4-71ec-4dd1-a8e4-06393f40c3ac tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1645 microversion: 2.1 time: 0.589391 Oct 10 23:19:16.516108 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 337/680] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:15 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1645 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:16.532152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-34b99aaa-f9cf-4a19-bc11-6c93d176f18f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:16.533221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-34b99aaa-f9cf-4a19-bc11-6c93d176f18f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:16.547117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34b99aaa-f9cf-4a19-bc11-6c93d176f18f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:16.551946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34b99aaa-f9cf-4a19-bc11-6c93d176f18f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:16.552648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34b99aaa-f9cf-4a19-bc11-6c93d176f18f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:16.553771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34b99aaa-f9cf-4a19-bc11-6c93d176f18f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:16.554619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34b99aaa-f9cf-4a19-bc11-6c93d176f18f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:16.555240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34b99aaa-f9cf-4a19-bc11-6c93d176f18f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:16.569297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:16.996000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-34b99aaa-f9cf-4a19-bc11-6c93d176f18f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:17.006764 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-34b99aaa-f9cf-4a19-bc11-6c93d176f18f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1460 microversion: 2.1 time: 0.489370 Oct 10 23:19:17.011371 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 338/681] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:16 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1460 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:17.020785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e8b1cc5c-e435-41c5-8021-2dd2012ad500 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:17.024781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8b1cc5c-e435-41c5-8021-2dd2012ad500 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:17.039023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8b1cc5c-e435-41c5-8021-2dd2012ad500 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:17.039791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8b1cc5c-e435-41c5-8021-2dd2012ad500 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:17.044536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8b1cc5c-e435-41c5-8021-2dd2012ad500 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:17.045225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8b1cc5c-e435-41c5-8021-2dd2012ad500 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:17.053736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8b1cc5c-e435-41c5-8021-2dd2012ad500 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:17.107757 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e8b1cc5c-e435-41c5-8021-2dd2012ad500 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.095008 Oct 10 23:19:17.112027 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 339/682] 10.222.0.23 () {58 vars in 1176 bytes} [Mon Oct 10 23:19:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:17.119274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-23e6d690-3929-4626-89ac-1c173e12bf58 req-b3c4fb4b-1cc3-4d5c-a457-37d7af0d1c7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1847e3cf-10bd-40d5-b668-d5a1c73fc189", "tag": "336fa68a-b02a-496e-bd84-6e77cd69df0f"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:17.147133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-23e6d690-3929-4626-89ac-1c173e12bf58 req-b3c4fb4b-1cc3-4d5c-a457-37d7af0d1c7c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:17.147681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-23e6d690-3929-4626-89ac-1c173e12bf58 req-b3c4fb4b-1cc3-4d5c-a457-37d7af0d1c7c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:17.148186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-23e6d690-3929-4626-89ac-1c173e12bf58 req-b3c4fb4b-1cc3-4d5c-a457-37d7af0d1c7c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:17.174642 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-23e6d690-3929-4626-89ac-1c173e12bf58 req-b3c4fb4b-1cc3-4d5c-a457-37d7af0d1c7c service nova] Creating event network-changed:336fa68a-b02a-496e-bd84-6e77cd69df0f for instance 1847e3cf-10bd-40d5-b668-d5a1c73fc189 on n-h2-860864-2 Oct 10 23:19:17.187994 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-23e6d690-3929-4626-89ac-1c173e12bf58 req-b3c4fb4b-1cc3-4d5c-a457-37d7af0d1c7c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074432 Oct 10 23:19:17.188734 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 340/683] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:17.197112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2aa8b468-6f91-4429-94d7-af47c65cc59b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:17.199520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2aa8b468-6f91-4429-94d7-af47c65cc59b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:17.215308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2aa8b468-6f91-4429-94d7-af47c65cc59b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:17.216136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2aa8b468-6f91-4429-94d7-af47c65cc59b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:17.216524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2aa8b468-6f91-4429-94d7-af47c65cc59b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:17.218167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2aa8b468-6f91-4429-94d7-af47c65cc59b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:17.219145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2aa8b468-6f91-4429-94d7-af47c65cc59b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:17.220572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2aa8b468-6f91-4429-94d7-af47c65cc59b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:17.781675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-25d347c7-6893-4abf-81d8-f018dcebebe5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:17.791326 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-25d347c7-6893-4abf-81d8-f018dcebebe5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8" status: 200 len: 1316 microversion: 2.1 time: 1.503079 Oct 10 23:19:17.810204 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 344/684] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:16 2022] GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8 => generated 1316 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:17.816186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0fe4e957-7504-4bbd-aea2-ee0ee3439a17 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:17.817071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0fe4e957-7504-4bbd-aea2-ee0ee3439a17 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:17.824979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0fe4e957-7504-4bbd-aea2-ee0ee3439a17 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:17.826243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0fe4e957-7504-4bbd-aea2-ee0ee3439a17 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:17.826989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0fe4e957-7504-4bbd-aea2-ee0ee3439a17 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:17.827859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0fe4e957-7504-4bbd-aea2-ee0ee3439a17 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:17.828531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0fe4e957-7504-4bbd-aea2-ee0ee3439a17 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:17.829110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0fe4e957-7504-4bbd-aea2-ee0ee3439a17 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:17.842461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2aa8b468-6f91-4429-94d7-af47c65cc59b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:17.852212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2aa8b468-6f91-4429-94d7-af47c65cc59b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:17.854012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2aa8b468-6f91-4429-94d7-af47c65cc59b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:17.855420 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2aa8b468-6f91-4429-94d7-af47c65cc59b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1362 microversion: 2.25 time: 0.665225 Oct 10 23:19:17.856149 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 341/685] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:17 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1362 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:17.863557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ee512ad7-0eb0-4724-8871-293d3f030863 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:17.864877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ee512ad7-0eb0-4724-8871-293d3f030863 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:17.879886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee512ad7-0eb0-4724-8871-293d3f030863 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:17.882146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee512ad7-0eb0-4724-8871-293d3f030863 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:17.882789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee512ad7-0eb0-4724-8871-293d3f030863 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:17.884090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:17.885728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee512ad7-0eb0-4724-8871-293d3f030863 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:17.888520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee512ad7-0eb0-4724-8871-293d3f030863 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:17.889419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee512ad7-0eb0-4724-8871-293d3f030863 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:18.371977 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0fe4e957-7504-4bbd-aea2-ee0ee3439a17 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1611 microversion: 2.1 time: 0.559010 Oct 10 23:19:18.374056 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 345/686] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:17 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1611 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:18.381178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-01ff2714-bcb1-4394-9ba4-7b324a29e3f0 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:18.381821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-01ff2714-bcb1-4394-9ba4-7b324a29e3f0 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:18.401539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01ff2714-bcb1-4394-9ba4-7b324a29e3f0 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:18.402466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01ff2714-bcb1-4394-9ba4-7b324a29e3f0 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:18.403604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01ff2714-bcb1-4394-9ba4-7b324a29e3f0 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:18.405753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01ff2714-bcb1-4394-9ba4-7b324a29e3f0 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:18.406570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01ff2714-bcb1-4394-9ba4-7b324a29e3f0 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:18.407243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01ff2714-bcb1-4394-9ba4-7b324a29e3f0 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:18.444969 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ee512ad7-0eb0-4724-8871-293d3f030863 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29/action" status: 202 len: 0 microversion: 2.1 time: 0.586842 Oct 10 23:19:18.449419 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 342/687] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:19:17 2022] POST /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:19:18.463133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-9453b086-3860-4e19-b5e8-acdf1f757b10 req-17968265-5fa0-4a83-8716-d7059cc61cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12574d37-08bd-4e05-8953-e2e680ebee8c", "name": "network-vif-deleted", "tag": "30719613-9b48-4dc7-8ef2-88f2ccd9e780"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:18.474768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9453b086-3860-4e19-b5e8-acdf1f757b10 req-17968265-5fa0-4a83-8716-d7059cc61cda service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:18.475535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9453b086-3860-4e19-b5e8-acdf1f757b10 req-17968265-5fa0-4a83-8716-d7059cc61cda service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:18.476139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9453b086-3860-4e19-b5e8-acdf1f757b10 req-17968265-5fa0-4a83-8716-d7059cc61cda service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:18.495130 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-9453b086-3860-4e19-b5e8-acdf1f757b10 req-17968265-5fa0-4a83-8716-d7059cc61cda service nova] Creating event network-vif-deleted:30719613-9b48-4dc7-8ef2-88f2ccd9e780 for instance 12574d37-08bd-4e05-8953-e2e680ebee8c on n-h1-860864-2 Oct 10 23:19:18.503925 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-9453b086-3860-4e19-b5e8-acdf1f757b10 req-17968265-5fa0-4a83-8716-d7059cc61cda service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052881 Oct 10 23:19:18.505248 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 343/688] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:18.516105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ca791286-65da-4bc9-bdc1-f9f39d4e3401 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Calling method '.version_select at 0x7f662bab5790>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:18.520578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ca791286-65da-4bc9-bdc1-f9f39d4e3401 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:18.521476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ca791286-65da-4bc9-bdc1-f9f39d4e3401 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:18.522133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ca791286-65da-4bc9-bdc1-f9f39d4e3401 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:18.534025 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ca791286-65da-4bc9-bdc1-f9f39d4e3401 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.027397 Oct 10 23:19:18.535218 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 344/689] 10.222.0.23 () {58 vars in 1143 bytes} [Mon Oct 10 23:19:18 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:18.540355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0afbc662-71b1-49aa-b559-879c97fb1177 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:18.541275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0afbc662-71b1-49aa-b559-879c97fb1177 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:18.553038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0afbc662-71b1-49aa-b559-879c97fb1177 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:18.555962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0afbc662-71b1-49aa-b559-879c97fb1177 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:18.558551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0afbc662-71b1-49aa-b559-879c97fb1177 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:18.559674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0afbc662-71b1-49aa-b559-879c97fb1177 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:18.561125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0afbc662-71b1-49aa-b559-879c97fb1177 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:18.565426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0afbc662-71b1-49aa-b559-879c97fb1177 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:18.929343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-01ff2714-bcb1-4394-9ba4-7b324a29e3f0 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:18.945782 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-01ff2714-bcb1-4394-9ba4-7b324a29e3f0 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 200 len: 1388 microversion: 2.1 time: 0.569407 Oct 10 23:19:18.948430 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 346/690] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:18 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 1388 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:18.958606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fab981d6-5b51-4b9e-a717-aa3dd646dd0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1534414624", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:19.066687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:19.092965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-fab981d6-5b51-4b9e-a717-aa3dd646dd0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] validate_networks() for None {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:19:19.129559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=18 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:19.300709 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0afbc662-71b1-49aa-b559-879c97fb1177 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1650 microversion: 2.1 time: 0.764130 Oct 10 23:19:19.301346 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 345/691] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:18 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1650 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:19.314912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ff0d3287-98c2-416d-8574-99dbb62f8db6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:19.315960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ff0d3287-98c2-416d-8574-99dbb62f8db6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:19.330803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff0d3287-98c2-416d-8574-99dbb62f8db6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:19.332063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff0d3287-98c2-416d-8574-99dbb62f8db6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:19.332650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff0d3287-98c2-416d-8574-99dbb62f8db6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:19.334103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff0d3287-98c2-416d-8574-99dbb62f8db6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:19.334718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff0d3287-98c2-416d-8574-99dbb62f8db6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:19.335289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff0d3287-98c2-416d-8574-99dbb62f8db6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:19.860582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ff0d3287-98c2-416d-8574-99dbb62f8db6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:19.871111 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ff0d3287-98c2-416d-8574-99dbb62f8db6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8" status: 200 len: 1316 microversion: 2.1 time: 0.563964 Oct 10 23:19:19.875202 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 346/692] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:19 2022] GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8 => generated 1316 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:19.888588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3f25cce1-efa6-46ef-9a62-8b3446cd5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:19.889478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3f25cce1-efa6-46ef-9a62-8b3446cd5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:19.900115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=16 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:19.902431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f25cce1-efa6-46ef-9a62-8b3446cd5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:19.906052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f25cce1-efa6-46ef-9a62-8b3446cd5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:19.906511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f25cce1-efa6-46ef-9a62-8b3446cd5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:19.907249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f25cce1-efa6-46ef-9a62-8b3446cd5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:19.907710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f25cce1-efa6-46ef-9a62-8b3446cd5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:19.914030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f25cce1-efa6-46ef-9a62-8b3446cd5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:20.062814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-fab981d6-5b51-4b9e-a717-aa3dd646dd0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:19:20.065279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-fab981d6-5b51-4b9e-a717-aa3dd646dd0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:19:20.066094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-fab981d6-5b51-4b9e-a717-aa3dd646dd0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:19:20.066876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-fab981d6-5b51-4b9e-a717-aa3dd646dd0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:19:20.067464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-fab981d6-5b51-4b9e-a717-aa3dd646dd0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:19:20.074095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:20.089948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fab981d6-5b51-4b9e-a717-aa3dd646dd0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:20.091535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fab981d6-5b51-4b9e-a717-aa3dd646dd0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:20.092579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fab981d6-5b51-4b9e-a717-aa3dd646dd0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:20.093963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fab981d6-5b51-4b9e-a717-aa3dd646dd0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:20.094653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fab981d6-5b51-4b9e-a717-aa3dd646dd0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:20.095250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fab981d6-5b51-4b9e-a717-aa3dd646dd0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:20.120808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-fab981d6-5b51-4b9e-a717-aa3dd646dd0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Getting quotas for project 8fad4e7ad7ba4e8284360ccf30d71228. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:19:20.147151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-fab981d6-5b51-4b9e-a717-aa3dd646dd0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Getting quotas for user cbc0deea66094fac8d5f985e133ceaaa and project 8fad4e7ad7ba4e8284360ccf30d71228. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:19:20.191543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fab981d6-5b51-4b9e-a717-aa3dd646dd0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:19:20.194268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fab981d6-5b51-4b9e-a717-aa3dd646dd0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:19:20.293741 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fab981d6-5b51-4b9e-a717-aa3dd646dd0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.343663 Oct 10 23:19:20.299427 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 347/693] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:19:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:19:20.315874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dafb3c18-ccb8-4aea-8e49-ace9f4114da0 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:20.316509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dafb3c18-ccb8-4aea-8e49-ace9f4114da0 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:20.357355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dafb3c18-ccb8-4aea-8e49-ace9f4114da0 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:20.357892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dafb3c18-ccb8-4aea-8e49-ace9f4114da0 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:20.358342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dafb3c18-ccb8-4aea-8e49-ace9f4114da0 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:20.359071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dafb3c18-ccb8-4aea-8e49-ace9f4114da0 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:20.359533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dafb3c18-ccb8-4aea-8e49-ace9f4114da0 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:20.360033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dafb3c18-ccb8-4aea-8e49-ace9f4114da0 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:20.431164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3f25cce1-efa6-46ef-9a62-8b3446cd5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:20.448205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3f25cce1-efa6-46ef-9a62-8b3446cd5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:20.453616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3f25cce1-efa6-46ef-9a62-8b3446cd5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:20.458282 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3f25cce1-efa6-46ef-9a62-8b3446cd5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1362 microversion: 2.25 time: 0.577060 Oct 10 23:19:20.475915 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 347/694] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:19 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1362 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:20.489318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6fa26df8-f691-4b6d-b64a-a80e57400f8d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:20.490631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6fa26df8-f691-4b6d-b64a-a80e57400f8d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:20.734362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6fa26df8-f691-4b6d-b64a-a80e57400f8d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:20.744166 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6fa26df8-f691-4b6d-b64a-a80e57400f8d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1213 microversion: 2.1 time: 0.265030 Oct 10 23:19:20.744780 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 348/695] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:20 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1213 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:20.772451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f22c72ad-76ea-41de-b616-bd9e6ff8786c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:20.775494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f22c72ad-76ea-41de-b616-bd9e6ff8786c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:20.800640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f22c72ad-76ea-41de-b616-bd9e6ff8786c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:20.803646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f22c72ad-76ea-41de-b616-bd9e6ff8786c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:20.806012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f22c72ad-76ea-41de-b616-bd9e6ff8786c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:20.806912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f22c72ad-76ea-41de-b616-bd9e6ff8786c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:20.809717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f22c72ad-76ea-41de-b616-bd9e6ff8786c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:20.818571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f22c72ad-76ea-41de-b616-bd9e6ff8786c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:21.291366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dafb3c18-ccb8-4aea-8e49-ace9f4114da0 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:21.300731 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dafb3c18-ccb8-4aea-8e49-ace9f4114da0 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 200 len: 1388 microversion: 2.1 time: 0.999844 Oct 10 23:19:21.318195 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 348/696] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:20 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 1388 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:21.452197 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f22c72ad-76ea-41de-b616-bd9e6ff8786c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1630 microversion: 2.1 time: 0.684340 Oct 10 23:19:21.470102 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 349/697] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:20 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1630 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:21.487527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-89f90f94-1caf-4543-b1c1-8c8610a821b1 req-7cb244f0-9c59-41c6-bb93-87827e403621 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbe32f87-f44c-40f1-a4be-8c6dd98c20b5", "tag": "250f123d-5ada-4744-bccc-c92a75d38e1f"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:21.503263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-89f90f94-1caf-4543-b1c1-8c8610a821b1 req-7cb244f0-9c59-41c6-bb93-87827e403621 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:21.505761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-89f90f94-1caf-4543-b1c1-8c8610a821b1 req-7cb244f0-9c59-41c6-bb93-87827e403621 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:21.508850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-89f90f94-1caf-4543-b1c1-8c8610a821b1 req-7cb244f0-9c59-41c6-bb93-87827e403621 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:21.535271 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-89f90f94-1caf-4543-b1c1-8c8610a821b1 req-7cb244f0-9c59-41c6-bb93-87827e403621 service nova] Creating event network-changed:250f123d-5ada-4744-bccc-c92a75d38e1f for instance bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 on n-h2-860864-2 Oct 10 23:19:21.543337 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-89f90f94-1caf-4543-b1c1-8c8610a821b1 req-7cb244f0-9c59-41c6-bb93-87827e403621 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071900 Oct 10 23:19:21.548192 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 350/698] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:21.557316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b7961625-5c3d-4a5d-bc5e-44466ed16bcb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:21.558049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b7961625-5c3d-4a5d-bc5e-44466ed16bcb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:21.576221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7961625-5c3d-4a5d-bc5e-44466ed16bcb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:21.576782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7961625-5c3d-4a5d-bc5e-44466ed16bcb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:21.577349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7961625-5c3d-4a5d-bc5e-44466ed16bcb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:21.578079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7961625-5c3d-4a5d-bc5e-44466ed16bcb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:21.578559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7961625-5c3d-4a5d-bc5e-44466ed16bcb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:21.578949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7961625-5c3d-4a5d-bc5e-44466ed16bcb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:21.594066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-65ea4cd5-7089-48df-bb40-a0c60e6e4c5d tempest-AZV2TestJSON-215665170 tempest-AZV2TestJSON-215665170-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:21.596086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65ea4cd5-7089-48df-bb40-a0c60e6e4c5d tempest-AZV2TestJSON-215665170 tempest-AZV2TestJSON-215665170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:21.596724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65ea4cd5-7089-48df-bb40-a0c60e6e4c5d tempest-AZV2TestJSON-215665170 tempest-AZV2TestJSON-215665170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:21.597788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65ea4cd5-7089-48df-bb40-a0c60e6e4c5d tempest-AZV2TestJSON-215665170 tempest-AZV2TestJSON-215665170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:21.600189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65ea4cd5-7089-48df-bb40-a0c60e6e4c5d tempest-AZV2TestJSON-215665170 tempest-AZV2TestJSON-215665170-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:21.601540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65ea4cd5-7089-48df-bb40-a0c60e6e4c5d tempest-AZV2TestJSON-215665170 tempest-AZV2TestJSON-215665170-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:21.602143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65ea4cd5-7089-48df-bb40-a0c60e6e4c5d tempest-AZV2TestJSON-215665170 tempest-AZV2TestJSON-215665170-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:21.645560 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-65ea4cd5-7089-48df-bb40-a0c60e6e4c5d tempest-AZV2TestJSON-215665170 tempest-AZV2TestJSON-215665170-project] 10.222.0.23 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.336609 Oct 10 23:19:21.646455 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 349/699] 10.222.0.23 () {58 vars in 1164 bytes} [Mon Oct 10 23:19:21 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:19:21.660599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b0e48086-e109-4594-9f3d-bea6c021363e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:21.662938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b0e48086-e109-4594-9f3d-bea6c021363e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:21.681957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0e48086-e109-4594-9f3d-bea6c021363e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:21.685075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0e48086-e109-4594-9f3d-bea6c021363e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:21.686491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0e48086-e109-4594-9f3d-bea6c021363e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:21.687262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0e48086-e109-4594-9f3d-bea6c021363e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:21.691169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0e48086-e109-4594-9f3d-bea6c021363e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:21.692154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0e48086-e109-4594-9f3d-bea6c021363e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:21.807253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b7961625-5c3d-4a5d-bc5e-44466ed16bcb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:21.838843 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b7961625-5c3d-4a5d-bc5e-44466ed16bcb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8" status: 200 len: 1316 microversion: 2.1 time: 0.289364 Oct 10 23:19:21.850997 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 351/700] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:21 2022] GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8 => generated 1316 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:21.858927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1b32646d-f43b-4fcb-817c-c8d2ebd38582 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860864-2", "block_migration": true, "disk_over_commit": false}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:21.862633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1b32646d-f43b-4fcb-817c-c8d2ebd38582 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:21.870929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b32646d-f43b-4fcb-817c-c8d2ebd38582 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:21.871466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b32646d-f43b-4fcb-817c-c8d2ebd38582 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:21.872893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b32646d-f43b-4fcb-817c-c8d2ebd38582 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:21.873969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b32646d-f43b-4fcb-817c-c8d2ebd38582 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:21.874444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b32646d-f43b-4fcb-817c-c8d2ebd38582 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:21.874895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b32646d-f43b-4fcb-817c-c8d2ebd38582 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:21.972215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-1b32646d-f43b-4fcb-817c-c8d2ebd38582 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lazy-loading 'flavor' on Instance uuid 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:19:22.159296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1b32646d-f43b-4fcb-817c-c8d2ebd38582 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Going to try to live migrate instance to n-h2-860864-2 {{(pid=120613) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 23:19:22.270270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b0e48086-e109-4594-9f3d-bea6c021363e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:22.282828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b0e48086-e109-4594-9f3d-bea6c021363e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:22.286889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b0e48086-e109-4594-9f3d-bea6c021363e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:22.292043 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b0e48086-e109-4594-9f3d-bea6c021363e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1362 microversion: 2.25 time: 0.644391 Oct 10 23:19:22.294971 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 350/701] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:21 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1362 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:22.310941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e6b2d161-774f-4dee-aefe-b6705ba1d0f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:22.314263 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e6b2d161-774f-4dee-aefe-b6705ba1d0f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:22.324921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6b2d161-774f-4dee-aefe-b6705ba1d0f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:22.330978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6b2d161-774f-4dee-aefe-b6705ba1d0f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:22.332656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6b2d161-774f-4dee-aefe-b6705ba1d0f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:22.337797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6b2d161-774f-4dee-aefe-b6705ba1d0f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:22.338446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6b2d161-774f-4dee-aefe-b6705ba1d0f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:22.340618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6b2d161-774f-4dee-aefe-b6705ba1d0f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:22.456937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e6b2d161-774f-4dee-aefe-b6705ba1d0f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:22.468764 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e6b2d161-774f-4dee-aefe-b6705ba1d0f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1273 microversion: 2.1 time: 0.172453 Oct 10 23:19:22.487271 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 351/702] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:22 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1273 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:22.493550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9511783e-0d73-4e31-bf51-7fc8f1c732cc tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:22.497844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9511783e-0d73-4e31-bf51-7fc8f1c732cc tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:22.514229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9511783e-0d73-4e31-bf51-7fc8f1c732cc tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:22.514735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9511783e-0d73-4e31-bf51-7fc8f1c732cc tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:22.515168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9511783e-0d73-4e31-bf51-7fc8f1c732cc tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:22.515882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9511783e-0d73-4e31-bf51-7fc8f1c732cc tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:22.516338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9511783e-0d73-4e31-bf51-7fc8f1c732cc tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:22.525711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9511783e-0d73-4e31-bf51-7fc8f1c732cc tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:22.759404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9511783e-0d73-4e31-bf51-7fc8f1c732cc tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:22.770077 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9511783e-0d73-4e31-bf51-7fc8f1c732cc tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 200 len: 1388 microversion: 2.1 time: 0.281471 Oct 10 23:19:22.775816 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 352/703] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:22 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 1388 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:22.866883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cebcbda1-c5ff-4dc1-a575-134852af30dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:22.872449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cebcbda1-c5ff-4dc1-a575-134852af30dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:22.882435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cebcbda1-c5ff-4dc1-a575-134852af30dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:22.887278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cebcbda1-c5ff-4dc1-a575-134852af30dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:22.889265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cebcbda1-c5ff-4dc1-a575-134852af30dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:22.891072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cebcbda1-c5ff-4dc1-a575-134852af30dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:22.891950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cebcbda1-c5ff-4dc1-a575-134852af30dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:22.892638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cebcbda1-c5ff-4dc1-a575-134852af30dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:23.145900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cebcbda1-c5ff-4dc1-a575-134852af30dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:23.158354 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cebcbda1-c5ff-4dc1-a575-134852af30dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8" status: 200 len: 1316 microversion: 2.1 time: 0.294941 Oct 10 23:19:23.159937 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 353/704] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:22 2022] GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8 => generated 1316 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:23.324066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a573fa68-44c0-4ec4-8a93-f19b0c7671e7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:23.325540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a573fa68-44c0-4ec4-8a93-f19b0c7671e7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:23.333003 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a573fa68-44c0-4ec4-8a93-f19b0c7671e7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:23.333940 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a573fa68-44c0-4ec4-8a93-f19b0c7671e7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:23.334332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a573fa68-44c0-4ec4-8a93-f19b0c7671e7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:23.335379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a573fa68-44c0-4ec4-8a93-f19b0c7671e7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:23.336110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a573fa68-44c0-4ec4-8a93-f19b0c7671e7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:23.336620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a573fa68-44c0-4ec4-8a93-f19b0c7671e7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:23.723306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a573fa68-44c0-4ec4-8a93-f19b0c7671e7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:23.735526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a573fa68-44c0-4ec4-8a93-f19b0c7671e7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:23.736985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a573fa68-44c0-4ec4-8a93-f19b0c7671e7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:23.738456 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a573fa68-44c0-4ec4-8a93-f19b0c7671e7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1362 microversion: 2.25 time: 0.418928 Oct 10 23:19:23.754087 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 354/705] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:23 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1362 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:19:23.764436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b78a7eed-668e-4a14-9d49-436da89a0cf8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:23.765066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b78a7eed-668e-4a14-9d49-436da89a0cf8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:23.771264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b78a7eed-668e-4a14-9d49-436da89a0cf8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:23.771980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b78a7eed-668e-4a14-9d49-436da89a0cf8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:23.772568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b78a7eed-668e-4a14-9d49-436da89a0cf8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:23.773464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b78a7eed-668e-4a14-9d49-436da89a0cf8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:23.774280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b78a7eed-668e-4a14-9d49-436da89a0cf8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:23.774856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b78a7eed-668e-4a14-9d49-436da89a0cf8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:23.901880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b78a7eed-668e-4a14-9d49-436da89a0cf8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:23.912834 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b78a7eed-668e-4a14-9d49-436da89a0cf8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1271 microversion: 2.1 time: 0.157428 Oct 10 23:19:23.914632 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 355/706] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:23 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:23.920642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dcdeef5f-b69f-47c4-ab28-e305c6210b9a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:23.921616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dcdeef5f-b69f-47c4-ab28-e305c6210b9a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:23.928941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcdeef5f-b69f-47c4-ab28-e305c6210b9a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:23.929804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcdeef5f-b69f-47c4-ab28-e305c6210b9a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:23.930480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcdeef5f-b69f-47c4-ab28-e305c6210b9a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:23.950161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcdeef5f-b69f-47c4-ab28-e305c6210b9a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:23.951936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcdeef5f-b69f-47c4-ab28-e305c6210b9a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:23.953082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcdeef5f-b69f-47c4-ab28-e305c6210b9a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:25.040192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dcdeef5f-b69f-47c4-ab28-e305c6210b9a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:25.062982 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dcdeef5f-b69f-47c4-ab28-e305c6210b9a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 200 len: 1388 microversion: 2.1 time: 1.145362 Oct 10 23:19:25.064454 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 356/707] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:23 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 1388 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:25.086123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-2fc95fcb-da6b-498d-b52b-88d0f1f312f2 req-d9c88e6b-3f68-414c-9128-468c11437bee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d61c758-b733-4d1e-8dbb-99cda309c9c8", "name": "network-vif-plugged", "status": "completed", "tag": "62320ef9-2ee0-496d-ba83-d8d6fb707554"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:25.103590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2fc95fcb-da6b-498d-b52b-88d0f1f312f2 req-d9c88e6b-3f68-414c-9128-468c11437bee service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:25.104850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2fc95fcb-da6b-498d-b52b-88d0f1f312f2 req-d9c88e6b-3f68-414c-9128-468c11437bee service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:25.105599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2fc95fcb-da6b-498d-b52b-88d0f1f312f2 req-d9c88e6b-3f68-414c-9128-468c11437bee service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:25.125668 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-2fc95fcb-da6b-498d-b52b-88d0f1f312f2 req-d9c88e6b-3f68-414c-9128-468c11437bee service nova] Creating event network-vif-plugged:62320ef9-2ee0-496d-ba83-d8d6fb707554 for instance 5d61c758-b733-4d1e-8dbb-99cda309c9c8 on n-h1-860864-2 Oct 10 23:19:25.134765 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-2fc95fcb-da6b-498d-b52b-88d0f1f312f2 req-d9c88e6b-3f68-414c-9128-468c11437bee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062857 Oct 10 23:19:25.135700 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 357/708] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:25.144894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-52394149-6cf4-4682-8c6f-63345a588617 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:25.146212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-52394149-6cf4-4682-8c6f-63345a588617 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:25.155708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52394149-6cf4-4682-8c6f-63345a588617 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:25.156729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52394149-6cf4-4682-8c6f-63345a588617 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:25.157558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52394149-6cf4-4682-8c6f-63345a588617 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:25.158571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52394149-6cf4-4682-8c6f-63345a588617 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:25.159547 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52394149-6cf4-4682-8c6f-63345a588617 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:25.160194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52394149-6cf4-4682-8c6f-63345a588617 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:25.936843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-52394149-6cf4-4682-8c6f-63345a588617 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:25.949106 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-52394149-6cf4-4682-8c6f-63345a588617 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8" status: 200 len: 1316 microversion: 2.1 time: 0.810703 Oct 10 23:19:25.953226 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 358/709] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:25 2022] GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8 => generated 1316 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:26.174221 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a7958e57-de07-4710-a5f8-46ea3fba11b3 tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] 10.222.0.23 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.219823 Oct 10 23:19:26.179487 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 359/710] 10.222.0.23 () {58 vars in 1128 bytes} [Mon Oct 10 23:19:25 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 10 23:19:26.186272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-791619b6-745e-4953-8a55-331a8d476c5f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:26.186890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-791619b6-745e-4953-8a55-331a8d476c5f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:26.198229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-791619b6-745e-4953-8a55-331a8d476c5f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:26.199065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-791619b6-745e-4953-8a55-331a8d476c5f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:26.201707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-791619b6-745e-4953-8a55-331a8d476c5f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:26.203694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-791619b6-745e-4953-8a55-331a8d476c5f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:26.206156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-791619b6-745e-4953-8a55-331a8d476c5f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:26.206942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-791619b6-745e-4953-8a55-331a8d476c5f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:26.743751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-791619b6-745e-4953-8a55-331a8d476c5f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:26.766513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-791619b6-745e-4953-8a55-331a8d476c5f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:26.772104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-791619b6-745e-4953-8a55-331a8d476c5f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:26.773909 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-791619b6-745e-4953-8a55-331a8d476c5f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1362 microversion: 2.25 time: 0.592914 Oct 10 23:19:26.789400 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 360/711] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:26 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1362 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:26.789400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-443e6319-222b-4f58-b3f9-536c0106bc1e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:26.789400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-443e6319-222b-4f58-b3f9-536c0106bc1e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:26.794825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-443e6319-222b-4f58-b3f9-536c0106bc1e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:26.795682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-443e6319-222b-4f58-b3f9-536c0106bc1e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:26.796335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-443e6319-222b-4f58-b3f9-536c0106bc1e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:26.797985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-443e6319-222b-4f58-b3f9-536c0106bc1e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:26.798958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-443e6319-222b-4f58-b3f9-536c0106bc1e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:26.799698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-443e6319-222b-4f58-b3f9-536c0106bc1e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:27.062632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:27.157448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-443e6319-222b-4f58-b3f9-536c0106bc1e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:27.171856 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-443e6319-222b-4f58-b3f9-536c0106bc1e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1313 microversion: 2.1 time: 0.394994 Oct 10 23:19:27.172838 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 361/712] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:26 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:27.189407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1af9e3bf-bfa4-4bcd-b1dc-05181c2e192e tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:27.190053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1af9e3bf-bfa4-4bcd-b1dc-05181c2e192e tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:27.196118 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1af9e3bf-bfa4-4bcd-b1dc-05181c2e192e tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:27.196720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1af9e3bf-bfa4-4bcd-b1dc-05181c2e192e tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:27.197119 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1af9e3bf-bfa4-4bcd-b1dc-05181c2e192e tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:27.197898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1af9e3bf-bfa4-4bcd-b1dc-05181c2e192e tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:27.198364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1af9e3bf-bfa4-4bcd-b1dc-05181c2e192e tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:27.198838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1af9e3bf-bfa4-4bcd-b1dc-05181c2e192e tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:27.355206 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1b32646d-f43b-4fcb-817c-c8d2ebd38582 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29/action" status: 202 len: 0 microversion: 2.1 time: 5.511513 Oct 10 23:19:27.356049 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 352/713] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:19:21 2022] POST /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29/action => generated 0 bytes in 5513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:19:27.362191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9e32e9d7-7767-49c6-9b4a-c2c04a4969c6 tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] Calling method '.version_select at 0x7f662b98f280>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:27.408901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1af9e3bf-bfa4-4bcd-b1dc-05181c2e192e tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:27.421071 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1af9e3bf-bfa4-4bcd-b1dc-05181c2e192e tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 200 len: 1388 microversion: 2.1 time: 0.246866 Oct 10 23:19:27.426375 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-9e32e9d7-7767-49c6-9b4a-c2c04a4969c6 tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] HTTP exception thrown: Image not found. Oct 10 23:19:27.436192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9e32e9d7-7767-49c6-9b4a-c2c04a4969c6 tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] Request method failure captured: Oct 10 23:19:27.436192 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 10 23:19:27.436192 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:19:27.436192 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:19:27.436192 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:19:27.436192 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:19:27.436192 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:19:27.436192 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:19:27.436192 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:19:27.436192 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:19:27.436192 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKh84IbuBSwdO-itIIKqtXLpqXOm1EnebYjk8-FlU7BDVHP6mGV1aVVB5tF6LfOkCOl4TWI_TCKPj_G6OE89zp1URVletIDE102XLgaHqlJxdOcm9Mqk56HtMtPcyGNs5cdN8ZMmKh-fSp7YoCvQ3kVOowdIGxeXfB2NpGuLkLzjeuQ Oct 10 23:19:27.436192 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:19:27.436192 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:19:27.436192 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:19:27.436192 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:19:27.436192 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:19:27.436192 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:19:27.436192 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e627bd70eeee4916a718d53f42f2b09d Oct 10 23:19:27.436192 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1004107469 Oct 10 23:19:27.436192 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:19:27.436192 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:19:27.437936 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e627bd70eeee4916a718d53f42f2b09d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e627bd70eeee4916a718d53f42f2b09d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e627bd70eeee4916a718d53f42f2b09d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e627bd70eeee4916a718d53f42f2b09d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:19:27.437936 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1004107469 Oct 10 23:19:27.437936 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e627bd70eeee4916a718d53f42f2b09d Oct 10 23:19:27.437936 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1004107469 Oct 10 23:19:27.437936 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesDeleteNegativeTestJSON-1004107469-project Oct 10 23:19:27.437936 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:19:27.437936 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:19:27.437936 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 23f31b2506b849cd8322c9d334ea97a6 Oct 10 23:19:27.437936 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1004107469-project Oct 10 23:19:27.437936 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:19:27.437936 n-d-860864-2 devstack@n-api.service[120613]: exception: Image not found. Oct 10 23:19:27.437936 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '-1'} Oct 10 23:19:27.437936 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:19:27.437936 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:27.439080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 23:19:27.439080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 23:19:27.439080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:19:27.439080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:19:27.439080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:19:27.439080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:19:27.439080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 23:19:27.439080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 23:19:27.439080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 23:19:27.439080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 23:19:27.439080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:19:27.439080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:19:27.439080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:19:27.439080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:19:27.439080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 10 23:19:27.439080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:27.439080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:27.439080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:27.439080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:27.440611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 23:19:27.440611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 23:19:27.440611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 23:19:27.440611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 23:19:27.440611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 23:19:27.440611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 23:19:27.440611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 10 23:19:27.440611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:27.440611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:27.440611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:27.440611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:27.440611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:27.440611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:27.440611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:19:27.440611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:19:27.440611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:19:27.440611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:19:27.440611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:19:27.440611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:19:27.440611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 23:19:27.442064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 23:19:27.442064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 23:19:27.442064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:27.442064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:27.442064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:27.442064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:27.442064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:27.442064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:27.442064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:19:27.442064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:19:27.442064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 23:19:27.442064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:27.442945 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 362/714] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:27 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 1388 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:27.443804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9e32e9d7-7767-49c6-9b4a-c2c04a4969c6 tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] Returning 404 to user: Image not found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:19:27.444900 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9e32e9d7-7767-49c6-9b4a-c2c04a4969c6 tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] 10.222.0.23 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.086984 Oct 10 23:19:27.445695 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 353/715] 10.222.0.23 () {58 vars in 1134 bytes} [Mon Oct 10 23:19:27 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:19:27.463162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9db30124-0a12-4cf0-8346-787df1c6fa62 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:27.463796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9db30124-0a12-4cf0-8346-787df1c6fa62 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:27.470797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9db30124-0a12-4cf0-8346-787df1c6fa62 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:27.471296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9db30124-0a12-4cf0-8346-787df1c6fa62 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:27.471753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9db30124-0a12-4cf0-8346-787df1c6fa62 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:27.472436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9db30124-0a12-4cf0-8346-787df1c6fa62 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:27.472974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9db30124-0a12-4cf0-8346-787df1c6fa62 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:27.473282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9db30124-0a12-4cf0-8346-787df1c6fa62 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:27.510315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-091161a8-20c9-4a76-a3b9-dba1f029e8d5 tempest-FloatingIPDetailsNegativeTestJSON-643098941 tempest-FloatingIPDetailsNegativeTestJSON-643098941-project] Calling method '.version_select at 0x7f662bbf8a60>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:27.572240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG neutronclient.v2_0.client [None req-091161a8-20c9-4a76-a3b9-dba1f029e8d5 tempest-FloatingIPDetailsNegativeTestJSON-643098941 tempest-FloatingIPDetailsNegativeTestJSON-643098941-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 68542fbd-0600-47a3-ad84-8839e08b44ea could not be found", "detail": ""}} {{(pid=120614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:19:27.573439 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-091161a8-20c9-4a76-a3b9-dba1f029e8d5 tempest-FloatingIPDetailsNegativeTestJSON-643098941 tempest-FloatingIPDetailsNegativeTestJSON-643098941-project] HTTP exception thrown: Floating IP not found for ID 68542fbd-0600-47a3-ad84-8839e08b44ea Oct 10 23:19:27.577744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-091161a8-20c9-4a76-a3b9-dba1f029e8d5 tempest-FloatingIPDetailsNegativeTestJSON-643098941 tempest-FloatingIPDetailsNegativeTestJSON-643098941-project] Request method failure captured: Oct 10 23:19:27.577744 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/os-floating-ips/68542fbd-0600-47a3-ad84-8839e08b44ea HTTP/1.1 Oct 10 23:19:27.577744 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:19:27.577744 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:19:27.577744 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:19:27.577744 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:19:27.577744 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:19:27.577744 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:19:27.577744 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:19:27.577744 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:19:27.577744 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKh-TSHG5R22IDhMsYeJaMhhK67zS-N8nPTpZ8PlREH2baXAY4LznDoBf3NiBh8VV-tdEU6pdHeaDKyaQIuKp5d18aAbsqJHBLsQIgby20fzUNLrxENBvLP8ByC85NhpjztoUp8_Vubf5MvaOPuH7VxKmoAoKWoeJ-eGd2KCZLIo0uM Oct 10 23:19:27.577744 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:19:27.577744 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:19:27.577744 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:19:27.577744 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:19:27.577744 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:19:27.577744 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:19:27.577744 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 95f3ec24f3dd4306abd6010ab4b53d54 Oct 10 23:19:27.577744 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-643098941 Oct 10 23:19:27.577744 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:19:27.577744 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:19:27.579185 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/95f3ec24f3dd4306abd6010ab4b53d54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/95f3ec24f3dd4306abd6010ab4b53d54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/95f3ec24f3dd4306abd6010ab4b53d54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_95f3ec24f3dd4306abd6010ab4b53d54", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:19:27.579185 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-643098941 Oct 10 23:19:27.579185 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 95f3ec24f3dd4306abd6010ab4b53d54 Oct 10 23:19:27.579185 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-643098941 Oct 10 23:19:27.579185 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-643098941-project Oct 10 23:19:27.579185 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:19:27.579185 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:19:27.579185 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 403f829dfda2495b85d1879675e7bfe1 Oct 10 23:19:27.579185 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-643098941-project Oct 10 23:19:27.579185 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:19:27.579185 n-d-860864-2 devstack@n-api.service[120614]: exception: Floating IP not found for ID 68542fbd-0600-47a3-ad84-8839e08b44ea Oct 10 23:19:27.579185 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '68542fbd-0600-47a3-ad84-8839e08b44ea'} Oct 10 23:19:27.580251 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:19:27.580251 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:27.580251 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 10 23:19:27.580251 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 10 23:19:27.580251 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:27.580251 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:27.580251 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 10 23:19:27.580251 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 10 23:19:27.580251 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:27.580251 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:27.580251 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 23:19:27.580251 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 23:19:27.580251 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:27.580251 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:27.580251 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:19:27.580251 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:19:27.580251 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:27.580251 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:27.580251 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:19:27.583431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:19:27.583431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:19:27.583431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:19:27.583431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:19:27.583431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:19:27.583431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:19:27.583431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:19:27.583431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 68542fbd-0600-47a3-ad84-8839e08b44ea could not be found Oct 10 23:19:27.583431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c43e30f5-2b33-4ef8-b383-0d153ce57f29'] Oct 10 23:19:27.583431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:27.583431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:27.583431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:27.583431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:27.583431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 10 23:19:27.583431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 10 23:19:27.583431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 10 23:19:27.583431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 10 23:19:27.583431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 68542fbd-0600-47a3-ad84-8839e08b44ea. Oct 10 23:19:27.583431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:27.584665 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:27.584665 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:27.584665 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:27.584665 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:27.584665 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:27.584665 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:19:27.584665 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:19:27.584665 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:19:27.584665 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:19:27.584665 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:19:27.584665 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:19:27.584665 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 10 23:19:27.584665 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 23:19:27.584665 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 68542fbd-0600-47a3-ad84-8839e08b44ea Oct 10 23:19:27.584665 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:27.584665 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:27.584665 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:27.584665 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:27.584665 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:27.584665 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:27.584665 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:19:27.585962 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:19:27.585962 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 68542fbd-0600-47a3-ad84-8839e08b44ea Oct 10 23:19:27.585962 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:19:27.588160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-091161a8-20c9-4a76-a3b9-dba1f029e8d5 tempest-FloatingIPDetailsNegativeTestJSON-643098941 tempest-FloatingIPDetailsNegativeTestJSON-643098941-project] Returning 404 to user: Floating IP not found for ID 68542fbd-0600-47a3-ad84-8839e08b44ea {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:19:27.589234 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-091161a8-20c9-4a76-a3b9-dba1f029e8d5 tempest-FloatingIPDetailsNegativeTestJSON-643098941 tempest-FloatingIPDetailsNegativeTestJSON-643098941-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/68542fbd-0600-47a3-ad84-8839e08b44ea" status: 404 len: 111 microversion: 2.1 time: 0.149410 Oct 10 23:19:27.594814 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 363/716] 10.222.0.23 () {58 vars in 1260 bytes} [Mon Oct 10 23:19:27 2022] GET /compute/v2.1/os-floating-ips/68542fbd-0600-47a3-ad84-8839e08b44ea => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:19:27.604323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c7b1fd3a-8ea2-4f90-b8be-aa25956cb05c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:27.608768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c7b1fd3a-8ea2-4f90-b8be-aa25956cb05c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:27.628974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7b1fd3a-8ea2-4f90-b8be-aa25956cb05c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:27.630004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7b1fd3a-8ea2-4f90-b8be-aa25956cb05c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:27.631491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7b1fd3a-8ea2-4f90-b8be-aa25956cb05c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:27.636172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7b1fd3a-8ea2-4f90-b8be-aa25956cb05c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:27.636969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7b1fd3a-8ea2-4f90-b8be-aa25956cb05c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:27.638766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7b1fd3a-8ea2-4f90-b8be-aa25956cb05c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:28.020914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c7b1fd3a-8ea2-4f90-b8be-aa25956cb05c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:28.033241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9db30124-0a12-4cf0-8346-787df1c6fa62 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:28.064457 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c7b1fd3a-8ea2-4f90-b8be-aa25956cb05c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1504 microversion: 2.1 time: 0.467991 Oct 10 23:19:28.065176 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 364/717] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:27 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1504 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:28.069040 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9db30124-0a12-4cf0-8346-787df1c6fa62 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8" status: 200 len: 1316 microversion: 2.1 time: 0.622138 Oct 10 23:19:28.073095 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 354/718] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:27 2022] GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8 => generated 1316 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:28.086333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-fdd9b388-3766-4566-bde0-5a738c35ce01 req-a3b2fb68-c899-4c0f-adfd-246632358718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1847e3cf-10bd-40d5-b668-d5a1c73fc189", "name": "network-vif-plugged", "status": "completed", "tag": "336fa68a-b02a-496e-bd84-6e77cd69df0f"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:28.094013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-129a4453-96d1-4915-aca7-4c6c78f227e0 tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] Calling method '.version_select at 0x7f662b991670>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:28.111707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fdd9b388-3766-4566-bde0-5a738c35ce01 req-a3b2fb68-c899-4c0f-adfd-246632358718 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:28.117432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fdd9b388-3766-4566-bde0-5a738c35ce01 req-a3b2fb68-c899-4c0f-adfd-246632358718 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:28.118103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fdd9b388-3766-4566-bde0-5a738c35ce01 req-a3b2fb68-c899-4c0f-adfd-246632358718 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:28.152048 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-fdd9b388-3766-4566-bde0-5a738c35ce01 req-a3b2fb68-c899-4c0f-adfd-246632358718 service nova] Creating event network-vif-plugged:336fa68a-b02a-496e-bd84-6e77cd69df0f for instance 1847e3cf-10bd-40d5-b668-d5a1c73fc189 on n-h2-860864-2 Oct 10 23:19:28.159396 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-fdd9b388-3766-4566-bde0-5a738c35ce01 req-a3b2fb68-c899-4c0f-adfd-246632358718 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088318 Oct 10 23:19:28.160367 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 365/719] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:28.165568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b0f2c0de-36dd-453f-8d26-6f631e2147cb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:28.166270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b0f2c0de-36dd-453f-8d26-6f631e2147cb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:28.201926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0f2c0de-36dd-453f-8d26-6f631e2147cb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:28.204419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0f2c0de-36dd-453f-8d26-6f631e2147cb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:28.205877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0f2c0de-36dd-453f-8d26-6f631e2147cb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:28.207665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0f2c0de-36dd-453f-8d26-6f631e2147cb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:28.210017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0f2c0de-36dd-453f-8d26-6f631e2147cb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:28.210882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0f2c0de-36dd-453f-8d26-6f631e2147cb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:28.213806 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-129a4453-96d1-4915-aca7-4c6c78f227e0 tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] HTTP exception thrown: Image not found. Oct 10 23:19:28.217368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-129a4453-96d1-4915-aca7-4c6c78f227e0 tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] Request method failure captured: Oct 10 23:19:28.217368 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/images/84015bbd-1f74-4b4b-ae07-1ff248d1f6ej HTTP/1.1 Oct 10 23:19:28.217368 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:19:28.217368 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:19:28.217368 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:19:28.217368 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:19:28.217368 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:19:28.217368 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:19:28.217368 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:19:28.217368 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:19:28.217368 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKh84IbuBSwdO-itIIKqtXLpqXOm1EnebYjk8-FlU7BDVHP6mGV1aVVB5tF6LfOkCOl4TWI_TCKPj_G6OE89zp1URVletIDE102XLgaHqlJxdOcm9Mqk56HtMtPcyGNs5cdN8ZMmKh-fSp7YoCvQ3kVOowdIGxeXfB2NpGuLkLzjeuQ Oct 10 23:19:28.217368 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:19:28.217368 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:19:28.217368 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:19:28.217368 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:19:28.217368 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:19:28.217368 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:19:28.217368 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e627bd70eeee4916a718d53f42f2b09d Oct 10 23:19:28.217368 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1004107469 Oct 10 23:19:28.217368 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:19:28.217368 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:19:28.218837 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e627bd70eeee4916a718d53f42f2b09d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e627bd70eeee4916a718d53f42f2b09d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e627bd70eeee4916a718d53f42f2b09d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e627bd70eeee4916a718d53f42f2b09d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:19:28.218837 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1004107469 Oct 10 23:19:28.218837 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e627bd70eeee4916a718d53f42f2b09d Oct 10 23:19:28.218837 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1004107469 Oct 10 23:19:28.218837 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesDeleteNegativeTestJSON-1004107469-project Oct 10 23:19:28.218837 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:19:28.218837 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:19:28.218837 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 23f31b2506b849cd8322c9d334ea97a6 Oct 10 23:19:28.218837 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1004107469-project Oct 10 23:19:28.218837 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:19:28.218837 n-d-860864-2 devstack@n-api.service[120613]: exception: Image not found. Oct 10 23:19:28.218837 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '84015bbd-1f74-4b4b-ae07-1ff248d1f6ej'} Oct 10 23:19:28.218837 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:19:28.219619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:28.219619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 23:19:28.219619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 23:19:28.219619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:19:28.219619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:19:28.219619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:19:28.219619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:19:28.219619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 23:19:28.219619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 23:19:28.219619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 23:19:28.219619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 23:19:28.219619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:19:28.219619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:19:28.219619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:19:28.219619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:19:28.219619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 84015bbd-1f74-4b4b-ae07-1ff248d1f6ej to delete Oct 10 23:19:28.219619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:28.219619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:28.219619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:28.220747 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:28.220747 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 23:19:28.220747 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 23:19:28.220747 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 23:19:28.220747 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 23:19:28.220747 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 23:19:28.220747 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 23:19:28.220747 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 84015bbd-1f74-4b4b-ae07-1ff248d1f6ej could not be found. Oct 10 23:19:28.220747 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:28.220747 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:28.220747 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:28.220747 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:28.220747 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:28.220747 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:28.220747 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:19:28.220747 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:19:28.220747 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:19:28.220747 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:19:28.220747 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:19:28.220747 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:19:28.222009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 23:19:28.222009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 23:19:28.222009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 23:19:28.222009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:28.222009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:28.222009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:28.222009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:28.222009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:28.222009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:28.222009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:19:28.222009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:19:28.222009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 23:19:28.222009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:28.225590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-129a4453-96d1-4915-aca7-4c6c78f227e0 tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] Returning 404 to user: Image not found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:19:28.226804 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-129a4453-96d1-4915-aca7-4c6c78f227e0 tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] 10.222.0.23 "DELETE /compute/v2.1/images/84015bbd-1f74-4b4b-ae07-1ff248d1f6ej" status: 404 len: 62 microversion: 2.1 time: 0.149868 Oct 10 23:19:28.228241 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 355/720] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:28 2022] DELETE /compute/v2.1/images/84015bbd-1f74-4b4b-ae07-1ff248d1f6ej => generated 62 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:19:28.244510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-a74174d5-1b8a-4be6-b39c-46528ef6bb8d req-6dd4a756-1d0d-4f40-a9d9-a6a9dcc1e6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76f81164-31f2-4f4b-9ec5-1e2ee8416c7b", "tag": "1a0d0d6b-022c-4c38-bd51-d8b961af213c"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:28.275633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a74174d5-1b8a-4be6-b39c-46528ef6bb8d req-6dd4a756-1d0d-4f40-a9d9-a6a9dcc1e6c4 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:28.276527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a74174d5-1b8a-4be6-b39c-46528ef6bb8d req-6dd4a756-1d0d-4f40-a9d9-a6a9dcc1e6c4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:28.277077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a74174d5-1b8a-4be6-b39c-46528ef6bb8d req-6dd4a756-1d0d-4f40-a9d9-a6a9dcc1e6c4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:28.320056 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a74174d5-1b8a-4be6-b39c-46528ef6bb8d req-6dd4a756-1d0d-4f40-a9d9-a6a9dcc1e6c4 service nova] Creating event network-changed:1a0d0d6b-022c-4c38-bd51-d8b961af213c for instance 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b on n-h2-860864-2 Oct 10 23:19:28.334442 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-a74174d5-1b8a-4be6-b39c-46528ef6bb8d req-6dd4a756-1d0d-4f40-a9d9-a6a9dcc1e6c4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100969 Oct 10 23:19:28.335361 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 356/721] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:28.360281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a035cf54-2613-498c-b5d2-b9f22da3af7c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:28.361009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a035cf54-2613-498c-b5d2-b9f22da3af7c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:28.400072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a035cf54-2613-498c-b5d2-b9f22da3af7c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:28.400595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a035cf54-2613-498c-b5d2-b9f22da3af7c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:28.401033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a035cf54-2613-498c-b5d2-b9f22da3af7c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:28.406949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a035cf54-2613-498c-b5d2-b9f22da3af7c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:28.407437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a035cf54-2613-498c-b5d2-b9f22da3af7c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:28.407886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a035cf54-2613-498c-b5d2-b9f22da3af7c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:28.732995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a035cf54-2613-498c-b5d2-b9f22da3af7c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:28.746309 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a035cf54-2613-498c-b5d2-b9f22da3af7c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1313 microversion: 2.1 time: 0.402016 Oct 10 23:19:28.749665 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 357/722] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:28 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:28.765530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9f3d4d11-a766-444b-8071-9940b2a897ee tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] Calling method '.version_select at 0x7f662b94bee0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:28.791392 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-9f3d4d11-a766-444b-8071-9940b2a897ee tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] HTTP exception thrown: Image not found. Oct 10 23:19:28.793364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9f3d4d11-a766-444b-8071-9940b2a897ee tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] Request method failure captured: Oct 10 23:19:28.793364 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/images/09e5f462-793f-4105-b96c-5071d2532b121 HTTP/1.1 Oct 10 23:19:28.793364 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:19:28.793364 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:19:28.793364 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:19:28.793364 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:19:28.793364 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:19:28.793364 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:19:28.793364 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:19:28.793364 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:19:28.793364 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKh84IbuBSwdO-itIIKqtXLpqXOm1EnebYjk8-FlU7BDVHP6mGV1aVVB5tF6LfOkCOl4TWI_TCKPj_G6OE89zp1URVletIDE102XLgaHqlJxdOcm9Mqk56HtMtPcyGNs5cdN8ZMmKh-fSp7YoCvQ3kVOowdIGxeXfB2NpGuLkLzjeuQ Oct 10 23:19:28.793364 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:19:28.793364 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:19:28.793364 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:19:28.793364 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:19:28.793364 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:19:28.793364 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:19:28.793364 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e627bd70eeee4916a718d53f42f2b09d Oct 10 23:19:28.793364 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1004107469 Oct 10 23:19:28.793364 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:19:28.793364 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:19:28.795123 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e627bd70eeee4916a718d53f42f2b09d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e627bd70eeee4916a718d53f42f2b09d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e627bd70eeee4916a718d53f42f2b09d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e627bd70eeee4916a718d53f42f2b09d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:19:28.795123 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1004107469 Oct 10 23:19:28.795123 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e627bd70eeee4916a718d53f42f2b09d Oct 10 23:19:28.795123 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1004107469 Oct 10 23:19:28.795123 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesDeleteNegativeTestJSON-1004107469-project Oct 10 23:19:28.795123 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:19:28.795123 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:19:28.795123 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 23f31b2506b849cd8322c9d334ea97a6 Oct 10 23:19:28.795123 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1004107469-project Oct 10 23:19:28.795123 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:19:28.795123 n-d-860864-2 devstack@n-api.service[120613]: exception: Image not found. Oct 10 23:19:28.795123 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '09e5f462-793f-4105-b96c-5071d2532b121'} Oct 10 23:19:28.795123 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:19:28.796127 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:28.796127 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 23:19:28.796127 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 23:19:28.796127 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:19:28.796127 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:19:28.796127 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:19:28.796127 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:19:28.796127 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 23:19:28.796127 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 23:19:28.796127 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 23:19:28.796127 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 23:19:28.796127 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:19:28.796127 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:19:28.796127 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:19:28.796127 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:19:28.796127 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 09e5f462-793f-4105-b96c-5071d2532b121 to delete Oct 10 23:19:28.796127 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:28.796127 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:28.796127 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:28.797430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:28.797430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 23:19:28.797430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 23:19:28.797430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 23:19:28.797430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 23:19:28.797430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 23:19:28.797430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 23:19:28.797430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 09e5f462-793f-4105-b96c-5071d2532b121 could not be found. Oct 10 23:19:28.797430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:28.797430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:28.797430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:28.797430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:28.797430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:28.797430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:28.797430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:19:28.797430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:19:28.797430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:19:28.797430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:19:28.797430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:19:28.797430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:19:28.798630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 23:19:28.798630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 23:19:28.798630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 23:19:28.798630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:28.798630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:28.798630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:28.798630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:28.798630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:28.798630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:28.798630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:19:28.798630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:19:28.798630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 23:19:28.798630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:28.817070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9f3d4d11-a766-444b-8071-9940b2a897ee tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] Returning 404 to user: Image not found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:19:28.818496 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9f3d4d11-a766-444b-8071-9940b2a897ee tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] 10.222.0.23 "DELETE /compute/v2.1/images/09e5f462-793f-4105-b96c-5071d2532b121" status: 404 len: 62 microversion: 2.1 time: 0.067532 Oct 10 23:19:28.833234 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 358/723] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:19:28 2022] DELETE /compute/v2.1/images/09e5f462-793f-4105-b96c-5071d2532b121 => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:19:28.838967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-82da8f65-331c-4b14-82bb-81f1808a44a3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:28.839797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-82da8f65-331c-4b14-82bb-81f1808a44a3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:28.849626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82da8f65-331c-4b14-82bb-81f1808a44a3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:28.850443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82da8f65-331c-4b14-82bb-81f1808a44a3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:28.851143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82da8f65-331c-4b14-82bb-81f1808a44a3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:28.852167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82da8f65-331c-4b14-82bb-81f1808a44a3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:28.852785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82da8f65-331c-4b14-82bb-81f1808a44a3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:28.853425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82da8f65-331c-4b14-82bb-81f1808a44a3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:28.993828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b0f2c0de-36dd-453f-8d26-6f631e2147cb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:28.999171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:29.010483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b0f2c0de-36dd-453f-8d26-6f631e2147cb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:29.011998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b0f2c0de-36dd-453f-8d26-6f631e2147cb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:29.020205 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b0f2c0de-36dd-453f-8d26-6f631e2147cb tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1362 microversion: 2.25 time: 0.858586 Oct 10 23:19:29.025904 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 366/724] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:28 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1362 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:29.114227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b3693eea-0b8d-458e-b8d4-ad340ab33633 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1834350388", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "7c424f24-ceb9-4eef-92d5-e365af6624aa"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:29.118977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-82da8f65-331c-4b14-82bb-81f1808a44a3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:29.124924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:29.133057 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-82da8f65-331c-4b14-82bb-81f1808a44a3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 200 len: 1388 microversion: 2.1 time: 0.298096 Oct 10 23:19:29.134458 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 359/725] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:28 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 1388 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:29.140685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-39600f36-c9d5-4457-a506-e25ca126acc3 tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] Calling method '.version_select at 0x7f6630304af0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:29.183697 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-39600f36-c9d5-4457-a506-e25ca126acc3 tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] HTTP exception thrown: Image not found. Oct 10 23:19:29.186785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-39600f36-c9d5-4457-a506-e25ca126acc3 tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] Request method failure captured: Oct 10 23:19:29.186785 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/images/tempest-invalid-919614917 HTTP/1.1 Oct 10 23:19:29.186785 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:19:29.186785 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:19:29.186785 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:19:29.186785 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:19:29.186785 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:19:29.186785 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:19:29.186785 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:19:29.186785 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:19:29.186785 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKh84IbuBSwdO-itIIKqtXLpqXOm1EnebYjk8-FlU7BDVHP6mGV1aVVB5tF6LfOkCOl4TWI_TCKPj_G6OE89zp1URVletIDE102XLgaHqlJxdOcm9Mqk56HtMtPcyGNs5cdN8ZMmKh-fSp7YoCvQ3kVOowdIGxeXfB2NpGuLkLzjeuQ Oct 10 23:19:29.186785 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:19:29.186785 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:19:29.186785 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:19:29.186785 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:19:29.186785 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:19:29.186785 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:19:29.186785 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e627bd70eeee4916a718d53f42f2b09d Oct 10 23:19:29.186785 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1004107469 Oct 10 23:19:29.186785 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:19:29.186785 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:19:29.188150 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e627bd70eeee4916a718d53f42f2b09d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e627bd70eeee4916a718d53f42f2b09d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e627bd70eeee4916a718d53f42f2b09d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e627bd70eeee4916a718d53f42f2b09d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:19:29.188150 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1004107469 Oct 10 23:19:29.188150 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e627bd70eeee4916a718d53f42f2b09d Oct 10 23:19:29.188150 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1004107469 Oct 10 23:19:29.188150 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesDeleteNegativeTestJSON-1004107469-project Oct 10 23:19:29.188150 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:19:29.188150 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:19:29.188150 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 23f31b2506b849cd8322c9d334ea97a6 Oct 10 23:19:29.188150 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1004107469-project Oct 10 23:19:29.188150 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:19:29.188150 n-d-860864-2 devstack@n-api.service[120613]: exception: Image not found. Oct 10 23:19:29.188150 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'tempest-invalid-919614917'} Oct 10 23:19:29.188150 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:19:29.188946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:29.188946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 23:19:29.188946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 23:19:29.188946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:19:29.188946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:19:29.188946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:19:29.188946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:19:29.188946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 23:19:29.188946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 23:19:29.188946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 23:19:29.188946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 23:19:29.188946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:19:29.188946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:19:29.188946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:19:29.188946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:19:29.188946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-919614917 to delete Oct 10 23:19:29.188946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:29.188946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:29.188946 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:29.190156 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:29.190156 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 23:19:29.190156 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 23:19:29.190156 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 23:19:29.190156 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 23:19:29.190156 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 23:19:29.190156 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 23:19:29.190156 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-919614917 could not be found. Oct 10 23:19:29.190156 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:29.190156 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:29.190156 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:29.190156 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:29.190156 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:29.190156 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:29.190156 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:19:29.190156 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:19:29.190156 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:19:29.190156 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:19:29.190156 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:19:29.190156 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:19:29.191330 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 23:19:29.191330 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 23:19:29.191330 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 23:19:29.191330 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:29.191330 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:29.191330 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:29.191330 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:29.191330 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:29.191330 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:29.191330 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:19:29.191330 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:19:29.191330 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 23:19:29.191330 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:29.194133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-39600f36-c9d5-4457-a506-e25ca126acc3 tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] Returning 404 to user: Image not found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:19:29.195923 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-39600f36-c9d5-4457-a506-e25ca126acc3 tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] 10.222.0.23 "DELETE /compute/v2.1/images/tempest-invalid-919614917" status: 404 len: 62 microversion: 2.1 time: 0.059540 Oct 10 23:19:29.201604 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 360/726] 10.222.0.23 () {58 vars in 1203 bytes} [Mon Oct 10 23:19:29 2022] DELETE /compute/v2.1/images/tempest-invalid-919614917 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:19:29.215277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4718b835-8872-4053-b614-eeab5db92c46 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:29.216508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4718b835-8872-4053-b614-eeab5db92c46 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:29.223118 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-b3693eea-0b8d-458e-b8d4-ad340ab33633 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] validate_networks() for [('7c424f24-ceb9-4eef-92d5-e365af6624aa', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:19:29.225589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:29.227447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4718b835-8872-4053-b614-eeab5db92c46 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:29.238053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4718b835-8872-4053-b614-eeab5db92c46 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:29.241649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4718b835-8872-4053-b614-eeab5db92c46 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:29.242651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4718b835-8872-4053-b614-eeab5db92c46 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:29.243301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4718b835-8872-4053-b614-eeab5db92c46 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:29.244094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4718b835-8872-4053-b614-eeab5db92c46 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:29.505691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4718b835-8872-4053-b614-eeab5db92c46 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:29.515996 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4718b835-8872-4053-b614-eeab5db92c46 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1504 microversion: 2.1 time: 0.313072 Oct 10 23:19:29.535682 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 361/727] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:29 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1504 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:29.540760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0f5d6c1d-7247-4e42-9a83-2022b276d9f2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:29.541631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0f5d6c1d-7247-4e42-9a83-2022b276d9f2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:29.552243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f5d6c1d-7247-4e42-9a83-2022b276d9f2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:29.553823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f5d6c1d-7247-4e42-9a83-2022b276d9f2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:29.554486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f5d6c1d-7247-4e42-9a83-2022b276d9f2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:29.555397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f5d6c1d-7247-4e42-9a83-2022b276d9f2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:29.556031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f5d6c1d-7247-4e42-9a83-2022b276d9f2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:29.556629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f5d6c1d-7247-4e42-9a83-2022b276d9f2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:29.754083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0f5d6c1d-7247-4e42-9a83-2022b276d9f2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:29.815593 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0f5d6c1d-7247-4e42-9a83-2022b276d9f2 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8" status: 200 len: 1466 microversion: 2.1 time: 0.278448 Oct 10 23:19:29.816535 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 362/728] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:29 2022] GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8 => generated 1466 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:29.835302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b26d5d21-2143-4b74-9f30-bcf790ca7367 tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] Calling method '.version_select at 0x7f662b98f940>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:29.865960 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-b26d5d21-2143-4b74-9f30-bcf790ca7367 tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] HTTP exception thrown: Image not found. Oct 10 23:19:29.868073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b26d5d21-2143-4b74-9f30-bcf790ca7367 tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] Request method failure captured: Oct 10 23:19:29.868073 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/images/5af041b4-fc3a-43c6-bf83-04738f193164 HTTP/1.1 Oct 10 23:19:29.868073 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:19:29.868073 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:19:29.868073 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:19:29.868073 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:19:29.868073 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:19:29.868073 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:19:29.868073 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:19:29.868073 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:19:29.868073 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKh84IbuBSwdO-itIIKqtXLpqXOm1EnebYjk8-FlU7BDVHP6mGV1aVVB5tF6LfOkCOl4TWI_TCKPj_G6OE89zp1URVletIDE102XLgaHqlJxdOcm9Mqk56HtMtPcyGNs5cdN8ZMmKh-fSp7YoCvQ3kVOowdIGxeXfB2NpGuLkLzjeuQ Oct 10 23:19:29.868073 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:19:29.868073 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:19:29.868073 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:19:29.868073 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:19:29.868073 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:19:29.868073 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:19:29.868073 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e627bd70eeee4916a718d53f42f2b09d Oct 10 23:19:29.868073 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1004107469 Oct 10 23:19:29.868073 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:19:29.868073 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:19:29.869365 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e627bd70eeee4916a718d53f42f2b09d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e627bd70eeee4916a718d53f42f2b09d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e627bd70eeee4916a718d53f42f2b09d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e627bd70eeee4916a718d53f42f2b09d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:19:29.869365 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1004107469 Oct 10 23:19:29.869365 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e627bd70eeee4916a718d53f42f2b09d Oct 10 23:19:29.869365 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1004107469 Oct 10 23:19:29.869365 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesDeleteNegativeTestJSON-1004107469-project Oct 10 23:19:29.869365 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:19:29.869365 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:19:29.869365 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 23f31b2506b849cd8322c9d334ea97a6 Oct 10 23:19:29.869365 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1004107469-project Oct 10 23:19:29.869365 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:19:29.869365 n-d-860864-2 devstack@n-api.service[120613]: exception: Image not found. Oct 10 23:19:29.869365 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '5af041b4-fc3a-43c6-bf83-04738f193164'} Oct 10 23:19:29.869365 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:19:29.870230 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:29.870230 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 23:19:29.870230 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 23:19:29.870230 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:19:29.870230 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:19:29.870230 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:19:29.870230 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:19:29.870230 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 23:19:29.870230 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 23:19:29.870230 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 23:19:29.870230 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 23:19:29.870230 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:19:29.870230 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:19:29.870230 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:19:29.870230 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:19:29.870230 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5af041b4-fc3a-43c6-bf83-04738f193164 to delete Oct 10 23:19:29.870230 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:29.870230 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:29.870230 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:29.871354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:29.871354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 23:19:29.871354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 23:19:29.871354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 23:19:29.871354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 23:19:29.871354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 23:19:29.871354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 23:19:29.871354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5af041b4-fc3a-43c6-bf83-04738f193164 could not be found. Oct 10 23:19:29.871354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:29.871354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:29.871354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:29.871354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:29.871354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:29.871354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:29.871354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:19:29.871354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:19:29.871354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:19:29.871354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:19:29.871354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:19:29.871354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:19:29.873206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 23:19:29.873206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 23:19:29.873206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 23:19:29.873206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:29.873206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:19:29.873206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:29.873206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:19:29.873206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:19:29.873206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:19:29.873206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:19:29.873206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:19:29.873206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 23:19:29.873206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:19:29.875881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b26d5d21-2143-4b74-9f30-bcf790ca7367 tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] Returning 404 to user: Image not found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:19:29.876799 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b26d5d21-2143-4b74-9f30-bcf790ca7367 tempest-ImagesDeleteNegativeTestJSON-1004107469 tempest-ImagesDeleteNegativeTestJSON-1004107469-project] 10.222.0.23 "DELETE /compute/v2.1/images/5af041b4-fc3a-43c6-bf83-04738f193164" status: 404 len: 62 microversion: 2.1 time: 0.058541 Oct 10 23:19:29.877683 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 363/729] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:29 2022] DELETE /compute/v2.1/images/5af041b4-fc3a-43c6-bf83-04738f193164 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:19:29.887543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-070ebe50-d9fd-4064-969d-0db922fb8ac4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:29.889153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-070ebe50-d9fd-4064-969d-0db922fb8ac4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:29.896842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-070ebe50-d9fd-4064-969d-0db922fb8ac4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:29.897350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-070ebe50-d9fd-4064-969d-0db922fb8ac4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:29.897824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-070ebe50-d9fd-4064-969d-0db922fb8ac4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:29.898537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-070ebe50-d9fd-4064-969d-0db922fb8ac4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:29.899000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-070ebe50-d9fd-4064-969d-0db922fb8ac4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:29.899430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-070ebe50-d9fd-4064-969d-0db922fb8ac4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:30.101642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-070ebe50-d9fd-4064-969d-0db922fb8ac4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:30.113046 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-070ebe50-d9fd-4064-969d-0db922fb8ac4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1313 microversion: 2.1 time: 0.227975 Oct 10 23:19:30.119651 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 364/730] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:29 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:30.131573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-92c765f4-16a3-4c1a-9948-4d838144c1b4 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:30.132127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-92c765f4-16a3-4c1a-9948-4d838144c1b4 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:30.141358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92c765f4-16a3-4c1a-9948-4d838144c1b4 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:30.142310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92c765f4-16a3-4c1a-9948-4d838144c1b4 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:30.143001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92c765f4-16a3-4c1a-9948-4d838144c1b4 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:30.144174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92c765f4-16a3-4c1a-9948-4d838144c1b4 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:30.144852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92c765f4-16a3-4c1a-9948-4d838144c1b4 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:30.145508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92c765f4-16a3-4c1a-9948-4d838144c1b4 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:30.166041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:30.353437 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-92c765f4-16a3-4c1a-9948-4d838144c1b4 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8" status: 200 len: 1617 microversion: 2.1 time: 0.232406 Oct 10 23:19:30.354032 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 365/731] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:30 2022] GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8 => generated 1617 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:30.358926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-81469148-1384-4991-82a9-680e5fbc1406 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:30.360179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-81469148-1384-4991-82a9-680e5fbc1406 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:30.367753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81469148-1384-4991-82a9-680e5fbc1406 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:30.368199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81469148-1384-4991-82a9-680e5fbc1406 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:30.368640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81469148-1384-4991-82a9-680e5fbc1406 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:30.369527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81469148-1384-4991-82a9-680e5fbc1406 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:30.370150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81469148-1384-4991-82a9-680e5fbc1406 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:30.370736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81469148-1384-4991-82a9-680e5fbc1406 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:30.604242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-81469148-1384-4991-82a9-680e5fbc1406 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:30.624585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-81469148-1384-4991-82a9-680e5fbc1406 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:30.626941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-81469148-1384-4991-82a9-680e5fbc1406 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:30.628414 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-81469148-1384-4991-82a9-680e5fbc1406 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1558 microversion: 2.25 time: 0.273398 Oct 10 23:19:30.629164 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 366/732] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:30 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1558 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:30.634111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9e1198f3-785f-40b4-82bc-e2ddd734674d tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:30.634984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9e1198f3-785f-40b4-82bc-e2ddd734674d tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:30.645182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e1198f3-785f-40b4-82bc-e2ddd734674d tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:30.646033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e1198f3-785f-40b4-82bc-e2ddd734674d tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:30.647272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e1198f3-785f-40b4-82bc-e2ddd734674d tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:30.648204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e1198f3-785f-40b4-82bc-e2ddd734674d tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:30.648874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e1198f3-785f-40b4-82bc-e2ddd734674d tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:30.649570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e1198f3-785f-40b4-82bc-e2ddd734674d tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:30.739206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:31.056578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9e1198f3-785f-40b4-82bc-e2ddd734674d tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:31.080028 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9e1198f3-785f-40b4-82bc-e2ddd734674d tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 200 len: 1388 microversion: 2.1 time: 0.441054 Oct 10 23:19:31.093435 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 367/733] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:30 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 1388 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:31.104426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-b851ee69-1df1-47c9-9f98-b854c79c84e8 req-b4b60ea5-dc08-4902-bde7-2ee92d48b972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbe32f87-f44c-40f1-a4be-8c6dd98c20b5", "name": "network-vif-plugged", "status": "completed", "tag": "250f123d-5ada-4744-bccc-c92a75d38e1f"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:31.135450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b851ee69-1df1-47c9-9f98-b854c79c84e8 req-b4b60ea5-dc08-4902-bde7-2ee92d48b972 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:31.136074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b851ee69-1df1-47c9-9f98-b854c79c84e8 req-b4b60ea5-dc08-4902-bde7-2ee92d48b972 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:31.136596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b851ee69-1df1-47c9-9f98-b854c79c84e8 req-b4b60ea5-dc08-4902-bde7-2ee92d48b972 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:31.175696 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-b851ee69-1df1-47c9-9f98-b854c79c84e8 req-b4b60ea5-dc08-4902-bde7-2ee92d48b972 service nova] Creating event network-vif-plugged:250f123d-5ada-4744-bccc-c92a75d38e1f for instance bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 on n-h2-860864-2 Oct 10 23:19:31.181221 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-b851ee69-1df1-47c9-9f98-b854c79c84e8 req-b4b60ea5-dc08-4902-bde7-2ee92d48b972 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098574 Oct 10 23:19:31.184641 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 368/734] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:31.207676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f885dad8-959b-4881-b076-efb2917dcb9e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:31.229890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f885dad8-959b-4881-b076-efb2917dcb9e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:31.268118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f885dad8-959b-4881-b076-efb2917dcb9e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:31.268927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f885dad8-959b-4881-b076-efb2917dcb9e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:31.269690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f885dad8-959b-4881-b076-efb2917dcb9e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:31.270907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f885dad8-959b-4881-b076-efb2917dcb9e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:31.271463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f885dad8-959b-4881-b076-efb2917dcb9e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:31.271986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f885dad8-959b-4881-b076-efb2917dcb9e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:31.601784 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-b3693eea-0b8d-458e-b8d4-ad340ab33633 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:19:31.602351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-b3693eea-0b8d-458e-b8d4-ad340ab33633 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:19:31.602675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-b3693eea-0b8d-458e-b8d4-ad340ab33633 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:19:31.603087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-b3693eea-0b8d-458e-b8d4-ad340ab33633 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:19:31.603497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-b3693eea-0b8d-458e-b8d4-ad340ab33633 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:19:31.619485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:31.625571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3693eea-0b8d-458e-b8d4-ad340ab33633 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:31.626458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3693eea-0b8d-458e-b8d4-ad340ab33633 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:31.627101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3693eea-0b8d-458e-b8d4-ad340ab33633 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:31.634429 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3693eea-0b8d-458e-b8d4-ad340ab33633 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:31.635686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3693eea-0b8d-458e-b8d4-ad340ab33633 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:31.636326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3693eea-0b8d-458e-b8d4-ad340ab33633 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:31.658737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-b3693eea-0b8d-458e-b8d4-ad340ab33633 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Getting quotas for project b891937a0ec146f88efac2b3d43f3e00. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:19:31.671301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-b3693eea-0b8d-458e-b8d4-ad340ab33633 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Getting quotas for user cc50e8356193429f9e70f4c4be6d5fff and project b891937a0ec146f88efac2b3d43f3e00. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:19:31.677926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f885dad8-959b-4881-b076-efb2917dcb9e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:31.688004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b3693eea-0b8d-458e-b8d4-ad340ab33633 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:19:31.688334 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f885dad8-959b-4881-b076-efb2917dcb9e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1504 microversion: 2.1 time: 0.501609 Oct 10 23:19:31.689130 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 369/735] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:31 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1504 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:31.690920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b3693eea-0b8d-458e-b8d4-ad340ab33633 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:19:31.695636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3f0b39b4-3743-46d9-a4db-d0731a713879 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-628713137", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["90aa3419-44a6-4b0d-9af1-5f6df3554b71"]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:31.787722 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b3693eea-0b8d-458e-b8d4-ad340ab33633 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.765254 Oct 10 23:19:31.794132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-3f0b39b4-3743-46d9-a4db-d0731a713879 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] validate_networks() for None {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:19:31.798871 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 367/736] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:19:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:19:32.128185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-47eaa09f-1cb4-4588-a542-3be14fa5cdd2 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:32.135586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-47eaa09f-1cb4-4588-a542-3be14fa5cdd2 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:32.160689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47eaa09f-1cb4-4588-a542-3be14fa5cdd2 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:32.163400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47eaa09f-1cb4-4588-a542-3be14fa5cdd2 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:32.164142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47eaa09f-1cb4-4588-a542-3be14fa5cdd2 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:32.166065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47eaa09f-1cb4-4588-a542-3be14fa5cdd2 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:32.170030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47eaa09f-1cb4-4588-a542-3be14fa5cdd2 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:32.171559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47eaa09f-1cb4-4588-a542-3be14fa5cdd2 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:32.400150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-3f0b39b4-3743-46d9-a4db-d0731a713879 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:19:32.400638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-3f0b39b4-3743-46d9-a4db-d0731a713879 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:19:32.401045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-3f0b39b4-3743-46d9-a4db-d0731a713879 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:19:32.401983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-3f0b39b4-3743-46d9-a4db-d0731a713879 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:19:32.402397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-3f0b39b4-3743-46d9-a4db-d0731a713879 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:19:32.420529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f0b39b4-3743-46d9-a4db-d0731a713879 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:32.423564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f0b39b4-3743-46d9-a4db-d0731a713879 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:32.427137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f0b39b4-3743-46d9-a4db-d0731a713879 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:32.431260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f0b39b4-3743-46d9-a4db-d0731a713879 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:32.435126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f0b39b4-3743-46d9-a4db-d0731a713879 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:32.436215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f0b39b4-3743-46d9-a4db-d0731a713879 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:32.460738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-47eaa09f-1cb4-4588-a542-3be14fa5cdd2 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lazy-loading 'services' on Instance uuid 1847e3cf-10bd-40d5-b668-d5a1c73fc189 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:19:32.481440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-3f0b39b4-3743-46d9-a4db-d0731a713879 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:19:32.496635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-3f0b39b4-3743-46d9-a4db-d0731a713879 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for user 310196e1663a4f7ca12e1fc53b0278ba and project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:19:32.537080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3f0b39b4-3743-46d9-a4db-d0731a713879 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:19:32.540809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3f0b39b4-3743-46d9-a4db-d0731a713879 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: d4bce34b-efcf-4b32-9c0c-882ebe101017] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:19:32.558020 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-47eaa09f-1cb4-4588-a542-3be14fa5cdd2 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 2051 microversion: 2.25 time: 0.756712 Oct 10 23:19:32.558951 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 368/737] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:31 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 2051 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:32.564679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6a2c927b-365d-412a-b7b9-9be25b61fbcf tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:32.566143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6a2c927b-365d-412a-b7b9-9be25b61fbcf tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:32.574433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a2c927b-365d-412a-b7b9-9be25b61fbcf tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:32.575502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a2c927b-365d-412a-b7b9-9be25b61fbcf tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:32.576392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a2c927b-365d-412a-b7b9-9be25b61fbcf tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:32.578168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a2c927b-365d-412a-b7b9-9be25b61fbcf tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:32.579692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a2c927b-365d-412a-b7b9-9be25b61fbcf tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:32.580356 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a2c927b-365d-412a-b7b9-9be25b61fbcf tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:32.671096 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3f0b39b4-3743-46d9-a4db-d0731a713879 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.979907 Oct 10 23:19:32.673260 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 370/738] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:19:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:19:32.687957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-38924a65-19c6-43cc-895c-a172dc3d990e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1469224533", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "7c424f24-ceb9-4eef-92d5-e365af6624aa"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:32.842970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-38924a65-19c6-43cc-895c-a172dc3d990e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] validate_networks() for [('7c424f24-ceb9-4eef-92d5-e365af6624aa', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:19:32.914736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6a2c927b-365d-412a-b7b9-9be25b61fbcf tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:32.924791 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6a2c927b-365d-412a-b7b9-9be25b61fbcf tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1313 microversion: 2.1 time: 0.363797 Oct 10 23:19:32.932908 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 369/739] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:32 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:32.947494 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c583124f-015d-4b25-ae80-e7d4390d6cb3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:32.949754 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c583124f-015d-4b25-ae80-e7d4390d6cb3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:32.965880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c583124f-015d-4b25-ae80-e7d4390d6cb3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:32.966305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c583124f-015d-4b25-ae80-e7d4390d6cb3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:32.966763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c583124f-015d-4b25-ae80-e7d4390d6cb3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:32.967960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c583124f-015d-4b25-ae80-e7d4390d6cb3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:32.970646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c583124f-015d-4b25-ae80-e7d4390d6cb3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:32.972332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c583124f-015d-4b25-ae80-e7d4390d6cb3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:33.198772 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c583124f-015d-4b25-ae80-e7d4390d6cb3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:33.215412 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c583124f-015d-4b25-ae80-e7d4390d6cb3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 200 len: 1587 microversion: 2.1 time: 0.278516 Oct 10 23:19:33.241708 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 370/740] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:32 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 1587 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:33.256383 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-132dad94-1eeb-4f51-82c3-c90cba4e285e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:33.259006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-132dad94-1eeb-4f51-82c3-c90cba4e285e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:33.273034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-132dad94-1eeb-4f51-82c3-c90cba4e285e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:33.275101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-132dad94-1eeb-4f51-82c3-c90cba4e285e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:33.277112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-132dad94-1eeb-4f51-82c3-c90cba4e285e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:33.279602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-132dad94-1eeb-4f51-82c3-c90cba4e285e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:33.280697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-132dad94-1eeb-4f51-82c3-c90cba4e285e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:33.281841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-132dad94-1eeb-4f51-82c3-c90cba4e285e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:33.475212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-132dad94-1eeb-4f51-82c3-c90cba4e285e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lazy-loading 'services' on Instance uuid 1847e3cf-10bd-40d5-b668-d5a1c73fc189 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:19:33.490663 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-132dad94-1eeb-4f51-82c3-c90cba4e285e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 2051 microversion: 2.25 time: 0.247516 Oct 10 23:19:33.491522 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 371/741] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:33 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 2051 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:33.504153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bd0efea0-034c-479a-82f6-80108815aa35 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:33.511443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bd0efea0-034c-479a-82f6-80108815aa35 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: d4bce34b-efcf-4b32-9c0c-882ebe101017] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:33.599706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bd0efea0-034c-479a-82f6-80108815aa35 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:33.615411 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bd0efea0-034c-479a-82f6-80108815aa35 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017" status: 200 len: 1216 microversion: 2.1 time: 0.122642 Oct 10 23:19:33.633789 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 372/742] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:33 2022] GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017 => generated 1216 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:33.642540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-febe7d17-e700-46ba-8fe1-9b21ded69230 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:33.644508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-febe7d17-e700-46ba-8fe1-9b21ded69230 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:33.652723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-febe7d17-e700-46ba-8fe1-9b21ded69230 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:33.655428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-febe7d17-e700-46ba-8fe1-9b21ded69230 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:33.656164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-febe7d17-e700-46ba-8fe1-9b21ded69230 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:33.657261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-febe7d17-e700-46ba-8fe1-9b21ded69230 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:33.657933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-febe7d17-e700-46ba-8fe1-9b21ded69230 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:33.658573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-febe7d17-e700-46ba-8fe1-9b21ded69230 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:33.887320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-febe7d17-e700-46ba-8fe1-9b21ded69230 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:33.899233 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-febe7d17-e700-46ba-8fe1-9b21ded69230 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1504 microversion: 2.1 time: 0.261498 Oct 10 23:19:33.918587 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 373/743] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:33 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1504 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:33.926412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e1e88486-33ad-412b-adb0-22d533797eba tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:33.926863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e1e88486-33ad-412b-adb0-22d533797eba tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:33.943390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1e88486-33ad-412b-adb0-22d533797eba tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:33.943911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1e88486-33ad-412b-adb0-22d533797eba tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:33.944512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1e88486-33ad-412b-adb0-22d533797eba tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:33.945293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1e88486-33ad-412b-adb0-22d533797eba tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:33.945788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1e88486-33ad-412b-adb0-22d533797eba tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:33.946229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1e88486-33ad-412b-adb0-22d533797eba tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:34.104989 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e1e88486-33ad-412b-adb0-22d533797eba tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.184649 Oct 10 23:19:34.110099 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 374/744] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Oct 10 23:19:33 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5/os-interface => generated 285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:34.116575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-45be3b67-0ddd-42f9-92fc-b08e13e2618c tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:34.120242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45be3b67-0ddd-42f9-92fc-b08e13e2618c tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:34.120726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45be3b67-0ddd-42f9-92fc-b08e13e2618c tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:34.121157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45be3b67-0ddd-42f9-92fc-b08e13e2618c tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:34.121917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45be3b67-0ddd-42f9-92fc-b08e13e2618c tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:34.122556 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45be3b67-0ddd-42f9-92fc-b08e13e2618c tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:34.123014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45be3b67-0ddd-42f9-92fc-b08e13e2618c tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:34.240312 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-45be3b67-0ddd-42f9-92fc-b08e13e2618c tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.129014 Oct 10 23:19:34.241116 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 375/745] 10.222.0.23 () {60 vars in 1217 bytes} [Mon Oct 10 23:19:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:19:34.278460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a2879695-ac89-42cd-9cd2-701d027a6962 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:34.282022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a2879695-ac89-42cd-9cd2-701d027a6962 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:34.298215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2879695-ac89-42cd-9cd2-701d027a6962 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:34.299051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2879695-ac89-42cd-9cd2-701d027a6962 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:34.299141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2879695-ac89-42cd-9cd2-701d027a6962 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:34.302105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2879695-ac89-42cd-9cd2-701d027a6962 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:34.302575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2879695-ac89-42cd-9cd2-701d027a6962 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:34.303003 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2879695-ac89-42cd-9cd2-701d027a6962 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:34.427120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-38924a65-19c6-43cc-895c-a172dc3d990e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:19:34.427659 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-38924a65-19c6-43cc-895c-a172dc3d990e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:19:34.428271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-38924a65-19c6-43cc-895c-a172dc3d990e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:19:34.428836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-38924a65-19c6-43cc-895c-a172dc3d990e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:19:34.429252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-38924a65-19c6-43cc-895c-a172dc3d990e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:19:34.444039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38924a65-19c6-43cc-895c-a172dc3d990e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:34.448154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38924a65-19c6-43cc-895c-a172dc3d990e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:34.449000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38924a65-19c6-43cc-895c-a172dc3d990e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:34.451580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38924a65-19c6-43cc-895c-a172dc3d990e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:34.452155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38924a65-19c6-43cc-895c-a172dc3d990e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:34.452591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38924a65-19c6-43cc-895c-a172dc3d990e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:34.479708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-38924a65-19c6-43cc-895c-a172dc3d990e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Getting quotas for project b891937a0ec146f88efac2b3d43f3e00. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:19:34.520810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-38924a65-19c6-43cc-895c-a172dc3d990e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Getting quotas for user cc50e8356193429f9e70f4c4be6d5fff and project b891937a0ec146f88efac2b3d43f3e00. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:19:34.548386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-38924a65-19c6-43cc-895c-a172dc3d990e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:19:34.551506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-38924a65-19c6-43cc-895c-a172dc3d990e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:19:34.662349 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-38924a65-19c6-43cc-895c-a172dc3d990e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.987494 Oct 10 23:19:34.675102 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 371/746] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:19:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:19:34.699494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-db9b6342-9b65-4ec0-bac2-d3e60f72e8aa tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860864-2", "block_migration": "auto"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:34.704891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-db9b6342-9b65-4ec0-bac2-d3e60f72e8aa tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:34.724893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db9b6342-9b65-4ec0-bac2-d3e60f72e8aa tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:34.726777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db9b6342-9b65-4ec0-bac2-d3e60f72e8aa tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:34.727383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db9b6342-9b65-4ec0-bac2-d3e60f72e8aa tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:34.728179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db9b6342-9b65-4ec0-bac2-d3e60f72e8aa tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:34.728709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db9b6342-9b65-4ec0-bac2-d3e60f72e8aa tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:34.729142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db9b6342-9b65-4ec0-bac2-d3e60f72e8aa tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:34.760695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-db9b6342-9b65-4ec0-bac2-d3e60f72e8aa tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lazy-loading 'flavor' on Instance uuid 1847e3cf-10bd-40d5-b668-d5a1c73fc189 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:19:34.775130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-db9b6342-9b65-4ec0-bac2-d3e60f72e8aa tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Going to try to live migrate instance to n-h1-860864-2 {{(pid=120613) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 23:19:35.006341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a2879695-ac89-42cd-9cd2-701d027a6962 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:35.016834 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a2879695-ac89-42cd-9cd2-701d027a6962 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1313 microversion: 2.1 time: 0.751842 Oct 10 23:19:35.022747 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 376/747] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:34 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1313 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:35.032550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-9bf2b446-f864-40e5-b513-9cf5f8ccbc88 req-7853f3b5-8457-432b-b8d6-06497333a653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87be6fab-2ad1-4a49-8b54-8eb2e50c3e29", "name": "network-vif-unplugged", "status": "completed", "tag": "0e2b501e-2b2d-414d-9297-d0c72224e923"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:35.053401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9bf2b446-f864-40e5-b513-9cf5f8ccbc88 req-7853f3b5-8457-432b-b8d6-06497333a653 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:35.053895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9bf2b446-f864-40e5-b513-9cf5f8ccbc88 req-7853f3b5-8457-432b-b8d6-06497333a653 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:35.058090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9bf2b446-f864-40e5-b513-9cf5f8ccbc88 req-7853f3b5-8457-432b-b8d6-06497333a653 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:35.086153 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-9bf2b446-f864-40e5-b513-9cf5f8ccbc88 req-7853f3b5-8457-432b-b8d6-06497333a653 service nova] Creating event network-vif-unplugged:0e2b501e-2b2d-414d-9297-d0c72224e923 for instance 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 on n-h1-860864-2 Oct 10 23:19:35.096148 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-9bf2b446-f864-40e5-b513-9cf5f8ccbc88 req-7853f3b5-8457-432b-b8d6-06497333a653 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071831 Oct 10 23:19:35.101280 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 377/748] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:35.108097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-26a60069-8d0f-456d-bffd-3bf79f5481ed tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:35.108402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-26a60069-8d0f-456d-bffd-3bf79f5481ed tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: d4bce34b-efcf-4b32-9c0c-882ebe101017] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:35.131639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26a60069-8d0f-456d-bffd-3bf79f5481ed tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:35.132142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26a60069-8d0f-456d-bffd-3bf79f5481ed tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:35.132683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26a60069-8d0f-456d-bffd-3bf79f5481ed tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:35.133416 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26a60069-8d0f-456d-bffd-3bf79f5481ed tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:35.134032 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26a60069-8d0f-456d-bffd-3bf79f5481ed tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:35.134787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26a60069-8d0f-456d-bffd-3bf79f5481ed tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:35.859211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-26a60069-8d0f-456d-bffd-3bf79f5481ed tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:35.872092 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-26a60069-8d0f-456d-bffd-3bf79f5481ed tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017" status: 200 len: 1276 microversion: 2.1 time: 0.769172 Oct 10 23:19:35.874452 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 378/749] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:35 2022] GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017 => generated 1276 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:35.895963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ea43739c-8deb-44ef-8c05-62617f1c9ec8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1782909723", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "451", "networks": [{"uuid": "7c424f24-ceb9-4eef-92d5-e365af6624aa"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:35.990858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-ea43739c-8deb-44ef-8c05-62617f1c9ec8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] validate_networks() for [('7c424f24-ceb9-4eef-92d5-e365af6624aa', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:19:37.959298 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ea43739c-8deb-44ef-8c05-62617f1c9ec8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:19:37.959890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ea43739c-8deb-44ef-8c05-62617f1c9ec8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:19:37.960181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ea43739c-8deb-44ef-8c05-62617f1c9ec8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:19:37.960589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ea43739c-8deb-44ef-8c05-62617f1c9ec8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:19:37.961002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ea43739c-8deb-44ef-8c05-62617f1c9ec8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:19:37.984546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea43739c-8deb-44ef-8c05-62617f1c9ec8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:37.985294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea43739c-8deb-44ef-8c05-62617f1c9ec8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:37.985908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea43739c-8deb-44ef-8c05-62617f1c9ec8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:37.987513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea43739c-8deb-44ef-8c05-62617f1c9ec8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:37.988195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea43739c-8deb-44ef-8c05-62617f1c9ec8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:37.988617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea43739c-8deb-44ef-8c05-62617f1c9ec8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:38.047175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ea43739c-8deb-44ef-8c05-62617f1c9ec8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Getting quotas for project b891937a0ec146f88efac2b3d43f3e00. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:19:38.061867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ea43739c-8deb-44ef-8c05-62617f1c9ec8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Getting quotas for user cc50e8356193429f9e70f4c4be6d5fff and project b891937a0ec146f88efac2b3d43f3e00. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:19:38.069260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:38.090521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ea43739c-8deb-44ef-8c05-62617f1c9ec8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:19:38.093903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ea43739c-8deb-44ef-8c05-62617f1c9ec8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 4521fa13-07d6-4f81-9a92-64b6862a3bd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:19:38.201341 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ea43739c-8deb-44ef-8c05-62617f1c9ec8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.325482 Oct 10 23:19:38.206489 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 379/750] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:19:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:19:38.211375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d4760816-1f68-4599-ae8b-13456966a8b4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:38.212427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d4760816-1f68-4599-ae8b-13456966a8b4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:38.221159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4760816-1f68-4599-ae8b-13456966a8b4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:38.221978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4760816-1f68-4599-ae8b-13456966a8b4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:38.222593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4760816-1f68-4599-ae8b-13456966a8b4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:38.223485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4760816-1f68-4599-ae8b-13456966a8b4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:38.224399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4760816-1f68-4599-ae8b-13456966a8b4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:38.225227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4760816-1f68-4599-ae8b-13456966a8b4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:39.047485 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-db9b6342-9b65-4ec0-bac2-d3e60f72e8aa tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189/action" status: 202 len: 0 microversion: 2.25 time: 4.358628 Oct 10 23:19:39.048910 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 372/751] 10.222.0.23 () {62 vars in 1319 bytes} [Mon Oct 10 23:19:34 2022] POST /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189/action => generated 0 bytes in 4368 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:19:39.054483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-c82a5c76-a84e-441c-a7d1-c7e6847e3ddb req-6d537da2-febd-4591-a497-64a5d4de6a7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f81164-31f2-4f4b-9ec5-1e2ee8416c7b", "name": "network-vif-plugged", "status": "completed", "tag": "1a0d0d6b-022c-4c38-bd51-d8b961af213c"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:39.078169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c82a5c76-a84e-441c-a7d1-c7e6847e3ddb req-6d537da2-febd-4591-a497-64a5d4de6a7a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:39.079188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c82a5c76-a84e-441c-a7d1-c7e6847e3ddb req-6d537da2-febd-4591-a497-64a5d4de6a7a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:39.095662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c82a5c76-a84e-441c-a7d1-c7e6847e3ddb req-6d537da2-febd-4591-a497-64a5d4de6a7a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:39.140880 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-c82a5c76-a84e-441c-a7d1-c7e6847e3ddb req-6d537da2-febd-4591-a497-64a5d4de6a7a service nova] Creating event network-vif-plugged:1a0d0d6b-022c-4c38-bd51-d8b961af213c for instance 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b on n-h2-860864-2 Oct 10 23:19:39.146455 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-c82a5c76-a84e-441c-a7d1-c7e6847e3ddb req-6d537da2-febd-4591-a497-64a5d4de6a7a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096087 Oct 10 23:19:39.147184 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 373/752] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:39.152728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f213c913-b260-4090-990b-f14f4a46fa90 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:39.153854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f213c913-b260-4090-990b-f14f4a46fa90 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:39.163585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f213c913-b260-4090-990b-f14f4a46fa90 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:39.164361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f213c913-b260-4090-990b-f14f4a46fa90 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:39.165043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f213c913-b260-4090-990b-f14f4a46fa90 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:39.166550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f213c913-b260-4090-990b-f14f4a46fa90 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:39.167281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f213c913-b260-4090-990b-f14f4a46fa90 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:39.167908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f213c913-b260-4090-990b-f14f4a46fa90 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:39.390572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d4760816-1f68-4599-ae8b-13456966a8b4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:39.424354 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d4760816-1f68-4599-ae8b-13456966a8b4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1504 microversion: 2.1 time: 1.215347 Oct 10 23:19:39.426200 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 380/753] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:38 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1504 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:39.444185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9b666a59-6fa6-43c0-9f0b-459f6ec86df8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:39.446009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9b666a59-6fa6-43c0-9f0b-459f6ec86df8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: d4bce34b-efcf-4b32-9c0c-882ebe101017] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:39.455789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b666a59-6fa6-43c0-9f0b-459f6ec86df8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:39.456448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b666a59-6fa6-43c0-9f0b-459f6ec86df8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:39.457031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b666a59-6fa6-43c0-9f0b-459f6ec86df8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:39.457948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b666a59-6fa6-43c0-9f0b-459f6ec86df8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:39.458552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b666a59-6fa6-43c0-9f0b-459f6ec86df8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:39.459130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b666a59-6fa6-43c0-9f0b-459f6ec86df8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:40.205128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f213c913-b260-4090-990b-f14f4a46fa90 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:40.215703 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f213c913-b260-4090-990b-f14f4a46fa90 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1313 microversion: 2.1 time: 1.066861 Oct 10 23:19:40.216144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9b666a59-6fa6-43c0-9f0b-459f6ec86df8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:40.217324 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 374/754] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:39 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1313 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:40.222406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-632f6a4f-0036-46a5-ad41-b18e623fc999 req-04e1d98c-9fe5-4a3e-9bf5-c6a95fc7b867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87be6fab-2ad1-4a49-8b54-8eb2e50c3e29", "tag": "0e2b501e-2b2d-414d-9297-d0c72224e923"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:40.236294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-632f6a4f-0036-46a5-ad41-b18e623fc999 req-04e1d98c-9fe5-4a3e-9bf5-c6a95fc7b867 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:40.237240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-632f6a4f-0036-46a5-ad41-b18e623fc999 req-04e1d98c-9fe5-4a3e-9bf5-c6a95fc7b867 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:40.237885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-632f6a4f-0036-46a5-ad41-b18e623fc999 req-04e1d98c-9fe5-4a3e-9bf5-c6a95fc7b867 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:40.238727 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9b666a59-6fa6-43c0-9f0b-459f6ec86df8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017" status: 200 len: 1316 microversion: 2.1 time: 0.811099 Oct 10 23:19:40.239508 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 381/755] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:39 2022] GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017 => generated 1316 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:40.253918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-419fde90-83db-41a9-b5c8-dd24192a50cb tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:40.254887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-419fde90-83db-41a9-b5c8-dd24192a50cb tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 4521fa13-07d6-4f81-9a92-64b6862a3bd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:40.272714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-419fde90-83db-41a9-b5c8-dd24192a50cb tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:40.273545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-419fde90-83db-41a9-b5c8-dd24192a50cb tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:40.274216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-419fde90-83db-41a9-b5c8-dd24192a50cb tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:40.275084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-419fde90-83db-41a9-b5c8-dd24192a50cb tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:40.275837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-419fde90-83db-41a9-b5c8-dd24192a50cb tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:40.276448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-419fde90-83db-41a9-b5c8-dd24192a50cb tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:40.315804 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-632f6a4f-0036-46a5-ad41-b18e623fc999 req-04e1d98c-9fe5-4a3e-9bf5-c6a95fc7b867 service nova] Creating event network-changed:0e2b501e-2b2d-414d-9297-d0c72224e923 for instance 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 on n-h1-860864-2 Oct 10 23:19:40.321891 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-632f6a4f-0036-46a5-ad41-b18e623fc999 req-04e1d98c-9fe5-4a3e-9bf5-c6a95fc7b867 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103141 Oct 10 23:19:40.322818 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 375/756] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:40.328749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-717dfcfd-a398-467f-8a97-fd1e0a6b2610 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:40.329903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-717dfcfd-a398-467f-8a97-fd1e0a6b2610 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:40.348542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-717dfcfd-a398-467f-8a97-fd1e0a6b2610 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:40.350503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-717dfcfd-a398-467f-8a97-fd1e0a6b2610 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:40.351204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-717dfcfd-a398-467f-8a97-fd1e0a6b2610 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:40.353706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-717dfcfd-a398-467f-8a97-fd1e0a6b2610 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:40.354609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-717dfcfd-a398-467f-8a97-fd1e0a6b2610 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:40.355266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-717dfcfd-a398-467f-8a97-fd1e0a6b2610 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:40.525068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-419fde90-83db-41a9-b5c8-dd24192a50cb tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:40.533681 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-419fde90-83db-41a9-b5c8-dd24192a50cb tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3" status: 200 len: 1279 microversion: 2.1 time: 0.292539 Oct 10 23:19:40.534276 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 382/757] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:40 2022] GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3 => generated 1279 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:40.545131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3f5c3149-2374-4cbe-b39e-0ab57732e9c8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:40.554857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3f5c3149-2374-4cbe-b39e-0ab57732e9c8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:40.573446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f5c3149-2374-4cbe-b39e-0ab57732e9c8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:40.574288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f5c3149-2374-4cbe-b39e-0ab57732e9c8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:40.574913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f5c3149-2374-4cbe-b39e-0ab57732e9c8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:40.575804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f5c3149-2374-4cbe-b39e-0ab57732e9c8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:40.576405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f5c3149-2374-4cbe-b39e-0ab57732e9c8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:40.576981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f5c3149-2374-4cbe-b39e-0ab57732e9c8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:41.132690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-717dfcfd-a398-467f-8a97-fd1e0a6b2610 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:41.149252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-717dfcfd-a398-467f-8a97-fd1e0a6b2610 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:41.155298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-717dfcfd-a398-467f-8a97-fd1e0a6b2610 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:41.157295 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-717dfcfd-a398-467f-8a97-fd1e0a6b2610 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1568 microversion: 2.25 time: 0.832820 Oct 10 23:19:41.165025 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 376/758] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:40 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1568 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:41.177514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1d908e66-d093-4d5f-a85f-07a155f1c07a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:41.178364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1d908e66-d093-4d5f-a85f-07a155f1c07a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:41.185265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d908e66-d093-4d5f-a85f-07a155f1c07a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:41.186330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d908e66-d093-4d5f-a85f-07a155f1c07a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:41.186919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d908e66-d093-4d5f-a85f-07a155f1c07a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:41.187845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d908e66-d093-4d5f-a85f-07a155f1c07a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:41.188591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d908e66-d093-4d5f-a85f-07a155f1c07a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:41.189183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d908e66-d093-4d5f-a85f-07a155f1c07a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:41.245922 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3f5c3149-2374-4cbe-b39e-0ab57732e9c8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:41.260367 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3f5c3149-2374-4cbe-b39e-0ab57732e9c8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1504 microversion: 2.1 time: 0.722305 Oct 10 23:19:41.260976 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 383/759] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:40 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1504 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:41.270202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-cbd61966-3d27-404b-898c-382f743b6587 req-35ad8472-317a-4470-b4f5-ec3964743291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbe32f87-f44c-40f1-a4be-8c6dd98c20b5", "tag": "250f123d-5ada-4744-bccc-c92a75d38e1f"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:41.298283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-cbd61966-3d27-404b-898c-382f743b6587 req-35ad8472-317a-4470-b4f5-ec3964743291 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:41.299125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-cbd61966-3d27-404b-898c-382f743b6587 req-35ad8472-317a-4470-b4f5-ec3964743291 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:41.299637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-cbd61966-3d27-404b-898c-382f743b6587 req-35ad8472-317a-4470-b4f5-ec3964743291 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:41.331320 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-cbd61966-3d27-404b-898c-382f743b6587 req-35ad8472-317a-4470-b4f5-ec3964743291 service nova] Creating event network-changed:250f123d-5ada-4744-bccc-c92a75d38e1f for instance bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 on n-h2-860864-2 Oct 10 23:19:41.337105 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-cbd61966-3d27-404b-898c-382f743b6587 req-35ad8472-317a-4470-b4f5-ec3964743291 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070680 Oct 10 23:19:41.338695 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 384/760] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:41.346122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c391c3b0-2c29-4bc4-9c0f-e79fab1a869f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:41.347486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c391c3b0-2c29-4bc4-9c0f-e79fab1a869f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:41.359866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c391c3b0-2c29-4bc4-9c0f-e79fab1a869f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:41.360851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c391c3b0-2c29-4bc4-9c0f-e79fab1a869f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:41.361701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c391c3b0-2c29-4bc4-9c0f-e79fab1a869f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:41.364229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c391c3b0-2c29-4bc4-9c0f-e79fab1a869f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:41.364963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c391c3b0-2c29-4bc4-9c0f-e79fab1a869f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:41.365851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c391c3b0-2c29-4bc4-9c0f-e79fab1a869f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:41.899724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1d908e66-d093-4d5f-a85f-07a155f1c07a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:41.914989 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1d908e66-d093-4d5f-a85f-07a155f1c07a tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 200 len: 1587 microversion: 2.1 time: 0.743470 Oct 10 23:19:41.916617 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 377/761] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:41 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 1587 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:41.922749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9ad868f9-4646-47fc-83a6-6df050839237 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:41.923790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9ad868f9-4646-47fc-83a6-6df050839237 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: d4bce34b-efcf-4b32-9c0c-882ebe101017] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:41.932380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ad868f9-4646-47fc-83a6-6df050839237 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:41.933322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ad868f9-4646-47fc-83a6-6df050839237 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:41.934028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ad868f9-4646-47fc-83a6-6df050839237 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:41.935965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ad868f9-4646-47fc-83a6-6df050839237 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:41.936685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ad868f9-4646-47fc-83a6-6df050839237 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:41.937826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ad868f9-4646-47fc-83a6-6df050839237 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:42.231059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c391c3b0-2c29-4bc4-9c0f-e79fab1a869f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:42.242208 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c391c3b0-2c29-4bc4-9c0f-e79fab1a869f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1313 microversion: 2.1 time: 0.901886 Oct 10 23:19:42.242949 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 385/762] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:41 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1313 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:42.248628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b15a57d5-53ff-47ed-986b-0e7e27ead2ee tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:42.250464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b15a57d5-53ff-47ed-986b-0e7e27ead2ee tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 4521fa13-07d6-4f81-9a92-64b6862a3bd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:42.257898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b15a57d5-53ff-47ed-986b-0e7e27ead2ee tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:42.258604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b15a57d5-53ff-47ed-986b-0e7e27ead2ee tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:42.259229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b15a57d5-53ff-47ed-986b-0e7e27ead2ee tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:42.260132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b15a57d5-53ff-47ed-986b-0e7e27ead2ee tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:42.261146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b15a57d5-53ff-47ed-986b-0e7e27ead2ee tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:42.261785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b15a57d5-53ff-47ed-986b-0e7e27ead2ee tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:42.394154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b15a57d5-53ff-47ed-986b-0e7e27ead2ee tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:42.402797 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b15a57d5-53ff-47ed-986b-0e7e27ead2ee tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3" status: 200 len: 1279 microversion: 2.1 time: 0.158426 Oct 10 23:19:42.416240 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 386/763] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:42 2022] GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3 => generated 1279 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:42.416240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4157cec1-80ab-4d35-87b4-eda81c3e8db3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:42.416240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4157cec1-80ab-4d35-87b4-eda81c3e8db3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:42.418465 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4157cec1-80ab-4d35-87b4-eda81c3e8db3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:42.419859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4157cec1-80ab-4d35-87b4-eda81c3e8db3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:42.420675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4157cec1-80ab-4d35-87b4-eda81c3e8db3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:42.422316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4157cec1-80ab-4d35-87b4-eda81c3e8db3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:42.423048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4157cec1-80ab-4d35-87b4-eda81c3e8db3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:42.423699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4157cec1-80ab-4d35-87b4-eda81c3e8db3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:42.448488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:42.650022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9ad868f9-4646-47fc-83a6-6df050839237 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:42.662665 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9ad868f9-4646-47fc-83a6-6df050839237 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017" status: 200 len: 1316 microversion: 2.1 time: 0.744745 Oct 10 23:19:42.678526 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 378/764] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:41 2022] GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017 => generated 1316 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:42.683489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-798e5a1f-f63d-4857-b014-3d3bd3d43ece tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:42.685086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-798e5a1f-f63d-4857-b014-3d3bd3d43ece tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:42.691710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-798e5a1f-f63d-4857-b014-3d3bd3d43ece tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:42.692470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-798e5a1f-f63d-4857-b014-3d3bd3d43ece tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:42.693073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-798e5a1f-f63d-4857-b014-3d3bd3d43ece tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:42.693956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-798e5a1f-f63d-4857-b014-3d3bd3d43ece tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:42.694564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-798e5a1f-f63d-4857-b014-3d3bd3d43ece tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:42.695144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-798e5a1f-f63d-4857-b014-3d3bd3d43ece tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:43.023391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4157cec1-80ab-4d35-87b4-eda81c3e8db3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:43.035271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4157cec1-80ab-4d35-87b4-eda81c3e8db3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:43.036857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4157cec1-80ab-4d35-87b4-eda81c3e8db3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:43.038436 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4157cec1-80ab-4d35-87b4-eda81c3e8db3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1568 microversion: 2.25 time: 0.632449 Oct 10 23:19:43.039206 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 387/765] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:42 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1568 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:43.044868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-5bf57d84-8c97-4054-aa4a-3d92b6054317 req-a8b861f1-5503-4191-a1da-837fd38fb141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4bce34b-efcf-4b32-9c0c-882ebe101017", "tag": "eecc4a02-e3b1-42d5-8ca7-35ef517e597e"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:43.058759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5bf57d84-8c97-4054-aa4a-3d92b6054317 req-a8b861f1-5503-4191-a1da-837fd38fb141 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:43.060240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5bf57d84-8c97-4054-aa4a-3d92b6054317 req-a8b861f1-5503-4191-a1da-837fd38fb141 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:43.061058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5bf57d84-8c97-4054-aa4a-3d92b6054317 req-a8b861f1-5503-4191-a1da-837fd38fb141 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:43.076656 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-5bf57d84-8c97-4054-aa4a-3d92b6054317 req-a8b861f1-5503-4191-a1da-837fd38fb141 service nova] Creating event network-changed:eecc4a02-e3b1-42d5-8ca7-35ef517e597e for instance d4bce34b-efcf-4b32-9c0c-882ebe101017 on n-h1-860864-2 Oct 10 23:19:43.082966 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-5bf57d84-8c97-4054-aa4a-3d92b6054317 req-a8b861f1-5503-4191-a1da-837fd38fb141 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042274 Oct 10 23:19:43.084372 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 388/766] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:43.271208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-616c4a99-96e8-4228-87a0-475564cf8220 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:43.272723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-616c4a99-96e8-4228-87a0-475564cf8220 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:43.286579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-616c4a99-96e8-4228-87a0-475564cf8220 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:43.287487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-616c4a99-96e8-4228-87a0-475564cf8220 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:43.288369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-616c4a99-96e8-4228-87a0-475564cf8220 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:43.289341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-616c4a99-96e8-4228-87a0-475564cf8220 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:43.290042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-616c4a99-96e8-4228-87a0-475564cf8220 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:43.290699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-616c4a99-96e8-4228-87a0-475564cf8220 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:43.437902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-798e5a1f-f63d-4857-b014-3d3bd3d43ece tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:43.444898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:43.448542 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-798e5a1f-f63d-4857-b014-3d3bd3d43ece tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1504 microversion: 2.1 time: 0.767956 Oct 10 23:19:43.449402 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 379/767] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:42 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1504 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:43.476274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2302cc6f-238c-411a-9315-de61e3119cf4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:43.478706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2302cc6f-238c-411a-9315-de61e3119cf4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 4521fa13-07d6-4f81-9a92-64b6862a3bd3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:43.490182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2302cc6f-238c-411a-9315-de61e3119cf4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:43.490996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2302cc6f-238c-411a-9315-de61e3119cf4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:43.491787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2302cc6f-238c-411a-9315-de61e3119cf4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:43.493187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2302cc6f-238c-411a-9315-de61e3119cf4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:43.494839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2302cc6f-238c-411a-9315-de61e3119cf4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:43.498703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2302cc6f-238c-411a-9315-de61e3119cf4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:43.655230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2302cc6f-238c-411a-9315-de61e3119cf4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:43.667992 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2302cc6f-238c-411a-9315-de61e3119cf4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3" status: 200 len: 1279 microversion: 2.1 time: 0.208504 Oct 10 23:19:43.675980 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 380/768] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:43 2022] GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3 => generated 1279 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:43.693553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6c43692e-6f54-4375-b4b2-bdfd79141de3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:43.694423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6c43692e-6f54-4375-b4b2-bdfd79141de3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: d4bce34b-efcf-4b32-9c0c-882ebe101017] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:43.707378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c43692e-6f54-4375-b4b2-bdfd79141de3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:43.708215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c43692e-6f54-4375-b4b2-bdfd79141de3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:43.708944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c43692e-6f54-4375-b4b2-bdfd79141de3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:43.711803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c43692e-6f54-4375-b4b2-bdfd79141de3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:43.712864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c43692e-6f54-4375-b4b2-bdfd79141de3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:43.714584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c43692e-6f54-4375-b4b2-bdfd79141de3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:43.771687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-616c4a99-96e8-4228-87a0-475564cf8220 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:43.788068 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-616c4a99-96e8-4228-87a0-475564cf8220 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1462 microversion: 2.1 time: 0.521036 Oct 10 23:19:43.801763 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 389/769] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:43 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1462 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:19:43.815452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7c0bea82-ca7b-40d5-b67f-25c24018f4d6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:43.818413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7c0bea82-ca7b-40d5-b67f-25c24018f4d6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:43.830835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c0bea82-ca7b-40d5-b67f-25c24018f4d6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:43.838181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c0bea82-ca7b-40d5-b67f-25c24018f4d6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:43.838639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c0bea82-ca7b-40d5-b67f-25c24018f4d6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:43.839972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c0bea82-ca7b-40d5-b67f-25c24018f4d6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:43.840444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c0bea82-ca7b-40d5-b67f-25c24018f4d6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:43.842559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c0bea82-ca7b-40d5-b67f-25c24018f4d6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:43.996409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7c0bea82-ca7b-40d5-b67f-25c24018f4d6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:44.010689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7c0bea82-ca7b-40d5-b67f-25c24018f4d6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Old instance type m1.heat2, new instance type m1.heat {{(pid=120614) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 10 23:19:44.026345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-7c0bea82-ca7b-40d5-b67f-25c24018f4d6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:19:44.026765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-7c0bea82-ca7b-40d5-b67f-25c24018f4d6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:19:44.032520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-7c0bea82-ca7b-40d5-b67f-25c24018f4d6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:19:44.032995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-7c0bea82-ca7b-40d5-b67f-25c24018f4d6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:19:44.033440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-7c0bea82-ca7b-40d5-b67f-25c24018f4d6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:19:44.272797 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7c0bea82-ca7b-40d5-b67f-25c24018f4d6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "POST /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b/action" status: 202 len: 0 microversion: 2.1 time: 0.461121 Oct 10 23:19:44.273808 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 390/770] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:19:43 2022] POST /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:19:44.290171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-704a020c-693b-4bcd-b372-43f97253f4ed tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:44.290847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-704a020c-693b-4bcd-b372-43f97253f4ed tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:44.306321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-704a020c-693b-4bcd-b372-43f97253f4ed tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:44.307823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-704a020c-693b-4bcd-b372-43f97253f4ed tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:44.308860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-704a020c-693b-4bcd-b372-43f97253f4ed tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:44.310837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-704a020c-693b-4bcd-b372-43f97253f4ed tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:44.315761 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-704a020c-693b-4bcd-b372-43f97253f4ed tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:44.316426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-704a020c-693b-4bcd-b372-43f97253f4ed tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:44.466933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:44.542607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=12 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:44.547516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6c43692e-6f54-4375-b4b2-bdfd79141de3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:44.564913 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6c43692e-6f54-4375-b4b2-bdfd79141de3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017" status: 200 len: 1316 microversion: 2.1 time: 0.875204 Oct 10 23:19:44.565829 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 381/771] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:43 2022] GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017 => generated 1316 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:19:44.581191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-db444281-e9d4-425e-92fc-a5163c797b84 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:44.581883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-db444281-e9d4-425e-92fc-a5163c797b84 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:44.599340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db444281-e9d4-425e-92fc-a5163c797b84 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:44.599834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db444281-e9d4-425e-92fc-a5163c797b84 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:44.600407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db444281-e9d4-425e-92fc-a5163c797b84 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:44.601706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db444281-e9d4-425e-92fc-a5163c797b84 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:44.602168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db444281-e9d4-425e-92fc-a5163c797b84 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:44.602593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db444281-e9d4-425e-92fc-a5163c797b84 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:44.896475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-db444281-e9d4-425e-92fc-a5163c797b84 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:44.903836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-704a020c-693b-4bcd-b372-43f97253f4ed tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:44.908898 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-db444281-e9d4-425e-92fc-a5163c797b84 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1471 microversion: 2.1 time: 0.341127 Oct 10 23:19:44.910890 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 382/772] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:44 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1471 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:44.915791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-704a020c-693b-4bcd-b372-43f97253f4ed tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:44.918480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-fe0cdd85-4f95-407e-a8d2-850cfa5a718c req-ceead739-4a89-40ce-9256-a7abbf3226ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8400778e-6c2d-4055-9799-5ec4e9ae0f1b", "tag": "1b892abb-8814-4a04-bc5f-0a3e26cdf3a3"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:44.923210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-704a020c-693b-4bcd-b372-43f97253f4ed tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:44.924904 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-704a020c-693b-4bcd-b372-43f97253f4ed tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1568 microversion: 2.25 time: 0.649202 Oct 10 23:19:44.925986 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 391/773] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:44 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1568 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:44.933332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6e329e6a-b0e0-4962-816f-52bcf6fee601 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:44.941363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-fe0cdd85-4f95-407e-a8d2-850cfa5a718c req-ceead739-4a89-40ce-9256-a7abbf3226ef service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:44.948422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-fe0cdd85-4f95-407e-a8d2-850cfa5a718c req-ceead739-4a89-40ce-9256-a7abbf3226ef service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:44.955055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-fe0cdd85-4f95-407e-a8d2-850cfa5a718c req-ceead739-4a89-40ce-9256-a7abbf3226ef service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:44.956010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6e329e6a-b0e0-4962-816f-52bcf6fee601 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:44.974840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e329e6a-b0e0-4962-816f-52bcf6fee601 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:44.980421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e329e6a-b0e0-4962-816f-52bcf6fee601 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:44.980968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e329e6a-b0e0-4962-816f-52bcf6fee601 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:44.983661 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-fe0cdd85-4f95-407e-a8d2-850cfa5a718c req-ceead739-4a89-40ce-9256-a7abbf3226ef service nova] Creating event network-changed:1b892abb-8814-4a04-bc5f-0a3e26cdf3a3 for instance 8400778e-6c2d-4055-9799-5ec4e9ae0f1b on n-h1-860864-2 Oct 10 23:19:44.983954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e329e6a-b0e0-4962-816f-52bcf6fee601 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:44.984520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e329e6a-b0e0-4962-816f-52bcf6fee601 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:44.985038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e329e6a-b0e0-4962-816f-52bcf6fee601 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:44.990807 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-fe0cdd85-4f95-407e-a8d2-850cfa5a718c req-ceead739-4a89-40ce-9256-a7abbf3226ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078101 Oct 10 23:19:44.996427 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 383/774] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:45.027575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7b1bf80e-dc66-4704-b24b-b600aeb68401 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:45.033910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7b1bf80e-dc66-4704-b24b-b600aeb68401 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 4521fa13-07d6-4f81-9a92-64b6862a3bd3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:45.042735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b1bf80e-dc66-4704-b24b-b600aeb68401 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:45.044053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b1bf80e-dc66-4704-b24b-b600aeb68401 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:45.046014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b1bf80e-dc66-4704-b24b-b600aeb68401 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:45.051446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b1bf80e-dc66-4704-b24b-b600aeb68401 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:45.052406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b1bf80e-dc66-4704-b24b-b600aeb68401 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:45.053416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b1bf80e-dc66-4704-b24b-b600aeb68401 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:45.664156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7b1bf80e-dc66-4704-b24b-b600aeb68401 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:45.674724 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7b1bf80e-dc66-4704-b24b-b600aeb68401 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3" status: 200 len: 1321 microversion: 2.1 time: 0.662236 Oct 10 23:19:45.676194 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 384/775] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:44 2022] GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3 => generated 1321 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:45.687042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-482d76e5-a8b1-4254-ae57-1b9a4a54696a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:45.692807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-482d76e5-a8b1-4254-ae57-1b9a4a54696a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: d4bce34b-efcf-4b32-9c0c-882ebe101017] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:45.697539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-482d76e5-a8b1-4254-ae57-1b9a4a54696a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:45.698401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-482d76e5-a8b1-4254-ae57-1b9a4a54696a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:45.698917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-482d76e5-a8b1-4254-ae57-1b9a4a54696a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:45.699937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-482d76e5-a8b1-4254-ae57-1b9a4a54696a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:45.703187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-482d76e5-a8b1-4254-ae57-1b9a4a54696a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:45.704150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-482d76e5-a8b1-4254-ae57-1b9a4a54696a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:45.989636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6e329e6a-b0e0-4962-816f-52bcf6fee601 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:46.000872 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6e329e6a-b0e0-4962-816f-52bcf6fee601 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1504 microversion: 2.1 time: 1.073503 Oct 10 23:19:46.002414 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 392/776] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:44 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1504 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:46.007680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ba4e0f98-56bc-4bd1-8ecd-0aece89f3531 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Calling method '.version_select at 0x7f6630687b80>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:46.072495 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ba4e0f98-56bc-4bd1-8ecd-0aece89f3531 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] 10.222.0.23 "GET /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e" status: 200 len: 637 microversion: 2.1 time: 0.068776 Oct 10 23:19:46.083508 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 393/777] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:19:46 2022] GET /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e => generated 637 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:46.092632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-432b8090-d03f-44e9-9a7f-55bd1f7a27e4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:46.093267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-432b8090-d03f-44e9-9a7f-55bd1f7a27e4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:46.106375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-432b8090-d03f-44e9-9a7f-55bd1f7a27e4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:46.107619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-432b8090-d03f-44e9-9a7f-55bd1f7a27e4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:46.108223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-432b8090-d03f-44e9-9a7f-55bd1f7a27e4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:46.109307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-432b8090-d03f-44e9-9a7f-55bd1f7a27e4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:46.110308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-432b8090-d03f-44e9-9a7f-55bd1f7a27e4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:46.110935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-432b8090-d03f-44e9-9a7f-55bd1f7a27e4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:46.379010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-482d76e5-a8b1-4254-ae57-1b9a4a54696a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:46.392110 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-482d76e5-a8b1-4254-ae57-1b9a4a54696a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017" status: 200 len: 1316 microversion: 2.1 time: 0.714161 Oct 10 23:19:46.394850 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 385/778] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:45 2022] GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017 => generated 1316 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:46.404138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b95c26dc-887e-4a54-9dd8-94576e152ede tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:46.410649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b95c26dc-887e-4a54-9dd8-94576e152ede tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:46.430961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b95c26dc-887e-4a54-9dd8-94576e152ede tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:46.432201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b95c26dc-887e-4a54-9dd8-94576e152ede tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:46.432651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b95c26dc-887e-4a54-9dd8-94576e152ede tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:46.433398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b95c26dc-887e-4a54-9dd8-94576e152ede tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:46.433931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b95c26dc-887e-4a54-9dd8-94576e152ede tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:46.434361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b95c26dc-887e-4a54-9dd8-94576e152ede tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:46.483510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-432b8090-d03f-44e9-9a7f-55bd1f7a27e4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:46.501916 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-432b8090-d03f-44e9-9a7f-55bd1f7a27e4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1471 microversion: 2.1 time: 0.417433 Oct 10 23:19:46.504974 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 394/779] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:46 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1471 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:46.525294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-aacdc852-e863-44fc-949f-4763930829bb req-a5775d02-a593-49f0-a853-0d7d6edd6ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d", "tag": "9aeedf20-d5e5-4fe0-87b9-2bdfe5ba2dbc"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:46.564558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-aacdc852-e863-44fc-949f-4763930829bb req-a5775d02-a593-49f0-a853-0d7d6edd6ee8 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:46.565237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-aacdc852-e863-44fc-949f-4763930829bb req-a5775d02-a593-49f0-a853-0d7d6edd6ee8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:46.566168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-aacdc852-e863-44fc-949f-4763930829bb req-a5775d02-a593-49f0-a853-0d7d6edd6ee8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:46.583249 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-aacdc852-e863-44fc-949f-4763930829bb req-a5775d02-a593-49f0-a853-0d7d6edd6ee8 service nova] Creating event network-changed:9aeedf20-d5e5-4fe0-87b9-2bdfe5ba2dbc for instance 9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d on n-h2-860864-2 Oct 10 23:19:46.600431 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-aacdc852-e863-44fc-949f-4763930829bb req-a5775d02-a593-49f0-a853-0d7d6edd6ee8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093807 Oct 10 23:19:46.605754 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 395/780] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:46.613745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f275011d-0b3e-4f1a-8545-52f8f5e2e104 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Action: 'update_all', calling method: .version_select at 0x7f662b9c19d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:46.710133 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-f275011d-0b3e-4f1a-8545-52f8f5e2e104 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Getting quotas for project 057537f4ff5244659f0bdd05cbb32aac. Resources: dict_keys(['metadata_items']) {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:19:46.729826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-f275011d-0b3e-4f1a-8545-52f8f5e2e104 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Getting quotas for user d70b59e0e3b84c2e98502f6a8cb96c1c and project 057537f4ff5244659f0bdd05cbb32aac. Resources: dict_keys(['metadata_items']) {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:19:47.297011 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f275011d-0b3e-4f1a-8545-52f8f5e2e104 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] 10.222.0.23 "PUT /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.684858 Oct 10 23:19:47.298821 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 396/781] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:19:46 2022] PUT /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata => generated 61 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:19:47.307905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0f9ac6ec-6a2c-4304-af1b-26e5c1aacbb8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:47.309486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0f9ac6ec-6a2c-4304-af1b-26e5c1aacbb8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 4521fa13-07d6-4f81-9a92-64b6862a3bd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:47.339639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f9ac6ec-6a2c-4304-af1b-26e5c1aacbb8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:47.340151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f9ac6ec-6a2c-4304-af1b-26e5c1aacbb8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:47.340589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f9ac6ec-6a2c-4304-af1b-26e5c1aacbb8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:47.342352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f9ac6ec-6a2c-4304-af1b-26e5c1aacbb8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:47.343035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f9ac6ec-6a2c-4304-af1b-26e5c1aacbb8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:47.344080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f9ac6ec-6a2c-4304-af1b-26e5c1aacbb8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:47.703899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b95c26dc-887e-4a54-9dd8-94576e152ede tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:47.713395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b95c26dc-887e-4a54-9dd8-94576e152ede tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:47.715102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b95c26dc-887e-4a54-9dd8-94576e152ede tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:47.716648 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b95c26dc-887e-4a54-9dd8-94576e152ede tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1568 microversion: 2.25 time: 1.320613 Oct 10 23:19:47.717775 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 386/782] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:46 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1568 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:47.724631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0f9ac6ec-6a2c-4304-af1b-26e5c1aacbb8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:47.733839 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0f9ac6ec-6a2c-4304-af1b-26e5c1aacbb8 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3" status: 200 len: 1321 microversion: 2.1 time: 0.433695 Oct 10 23:19:47.756186 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 397/783] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:47 2022] GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3 => generated 1321 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:47.761472 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e810d635-c9f3-4af4-a194-9730b7121451 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:47.762311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e810d635-c9f3-4af4-a194-9730b7121451 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:47.767696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-414f17ec-569c-41f5-a90b-34ea49faa811 req-3ae87cca-b326-4e32-b26a-ad5964135297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1847e3cf-10bd-40d5-b668-d5a1c73fc189", "name": "network-vif-unplugged", "status": "completed", "tag": "336fa68a-b02a-496e-bd84-6e77cd69df0f"}, {"name": "network-changed", "server_uuid": "1847e3cf-10bd-40d5-b668-d5a1c73fc189", "tag": "336fa68a-b02a-496e-bd84-6e77cd69df0f"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:47.784925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e810d635-c9f3-4af4-a194-9730b7121451 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:47.785496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e810d635-c9f3-4af4-a194-9730b7121451 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:47.789903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e810d635-c9f3-4af4-a194-9730b7121451 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:47.791001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e810d635-c9f3-4af4-a194-9730b7121451 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:47.795104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e810d635-c9f3-4af4-a194-9730b7121451 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:47.795756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e810d635-c9f3-4af4-a194-9730b7121451 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:47.801015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-414f17ec-569c-41f5-a90b-34ea49faa811 req-3ae87cca-b326-4e32-b26a-ad5964135297 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:47.804965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-414f17ec-569c-41f5-a90b-34ea49faa811 req-3ae87cca-b326-4e32-b26a-ad5964135297 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:47.805790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-414f17ec-569c-41f5-a90b-34ea49faa811 req-3ae87cca-b326-4e32-b26a-ad5964135297 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:47.833573 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-414f17ec-569c-41f5-a90b-34ea49faa811 req-3ae87cca-b326-4e32-b26a-ad5964135297 service nova] Creating event network-vif-unplugged:336fa68a-b02a-496e-bd84-6e77cd69df0f for instance 1847e3cf-10bd-40d5-b668-d5a1c73fc189 on n-h2-860864-2 Oct 10 23:19:47.834365 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-414f17ec-569c-41f5-a90b-34ea49faa811 req-3ae87cca-b326-4e32-b26a-ad5964135297 service nova] Creating event network-changed:336fa68a-b02a-496e-bd84-6e77cd69df0f for instance 1847e3cf-10bd-40d5-b668-d5a1c73fc189 on n-h2-860864-2 Oct 10 23:19:47.847195 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-414f17ec-569c-41f5-a90b-34ea49faa811 req-3ae87cca-b326-4e32-b26a-ad5964135297 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.089616 Oct 10 23:19:47.848405 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 398/784] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:47.865738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6d8b3f4a-65f7-4d19-9f8d-871f798d7a75 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Calling method '.version_select at 0x7f6630673940>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:48.014806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:48.241022 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6d8b3f4a-65f7-4d19-9f8d-871f798d7a75 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] 10.222.0.23 "DELETE /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.384747 Oct 10 23:19:48.246104 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 399/785] 10.222.0.23 () {58 vars in 1296 bytes} [Mon Oct 10 23:19:47 2022] DELETE /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata/os_version => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:19:48.252969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4f1dbff6-9c2c-4eda-9ae8-53944829abfd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:48.254804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4f1dbff6-9c2c-4eda-9ae8-53944829abfd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: d4bce34b-efcf-4b32-9c0c-882ebe101017] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:48.263602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f1dbff6-9c2c-4eda-9ae8-53944829abfd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:48.264542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f1dbff6-9c2c-4eda-9ae8-53944829abfd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:48.265227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f1dbff6-9c2c-4eda-9ae8-53944829abfd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:48.266179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f1dbff6-9c2c-4eda-9ae8-53944829abfd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:48.267059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f1dbff6-9c2c-4eda-9ae8-53944829abfd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:48.267685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f1dbff6-9c2c-4eda-9ae8-53944829abfd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:48.666360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4f1dbff6-9c2c-4eda-9ae8-53944829abfd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:48.677910 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4f1dbff6-9c2c-4eda-9ae8-53944829abfd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017" status: 200 len: 1316 microversion: 2.1 time: 0.429381 Oct 10 23:19:48.679210 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 400/786] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:48 2022] GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017 => generated 1316 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:48.687102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-89756cb0-6ebd-42f0-aa39-78f508670f87 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:48.687849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-89756cb0-6ebd-42f0-aa39-78f508670f87 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:48.695255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89756cb0-6ebd-42f0-aa39-78f508670f87 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:48.695441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89756cb0-6ebd-42f0-aa39-78f508670f87 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:48.696342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89756cb0-6ebd-42f0-aa39-78f508670f87 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:48.697307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89756cb0-6ebd-42f0-aa39-78f508670f87 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:48.698602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89756cb0-6ebd-42f0-aa39-78f508670f87 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:48.699242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89756cb0-6ebd-42f0-aa39-78f508670f87 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:48.738771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e810d635-c9f3-4af4-a194-9730b7121451 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:48.749155 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e810d635-c9f3-4af4-a194-9730b7121451 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1479 microversion: 2.1 time: 1.030069 Oct 10 23:19:48.766059 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 387/787] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:47 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1479 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:48.772359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f8de2b83-84e3-4d3a-8e7b-c60467a2094a tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Calling method '.version_select at 0x7f6630304c10>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:48.821585 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f8de2b83-84e3-4d3a-8e7b-c60467a2094a tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] 10.222.0.23 "GET /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata" status: 200 len: 37 microversion: 2.1 time: 0.054065 Oct 10 23:19:48.822329 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 388/788] 10.222.0.23 () {58 vars in 1260 bytes} [Mon Oct 10 23:19:48 2022] GET /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata => generated 37 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:19:48.836585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e31de763-42d1-4412-9243-78e9936c82dd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:48.837737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e31de763-42d1-4412-9243-78e9936c82dd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:48.845235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e31de763-42d1-4412-9243-78e9936c82dd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:48.845989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e31de763-42d1-4412-9243-78e9936c82dd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:48.846634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e31de763-42d1-4412-9243-78e9936c82dd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:48.847511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e31de763-42d1-4412-9243-78e9936c82dd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:48.848133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e31de763-42d1-4412-9243-78e9936c82dd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:48.848715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e31de763-42d1-4412-9243-78e9936c82dd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:49.060221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-89756cb0-6ebd-42f0-aa39-78f508670f87 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:49.078042 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-89756cb0-6ebd-42f0-aa39-78f508670f87 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1471 microversion: 2.1 time: 0.387789 Oct 10 23:19:49.080471 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 401/789] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:48 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1471 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:49.095098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5bb5b45e-9d76-4bb3-adaf-3cfad8fb8045 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:49.095719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5bb5b45e-9d76-4bb3-adaf-3cfad8fb8045 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 4521fa13-07d6-4f81-9a92-64b6862a3bd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:49.103228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5bb5b45e-9d76-4bb3-adaf-3cfad8fb8045 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:49.104045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5bb5b45e-9d76-4bb3-adaf-3cfad8fb8045 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:49.104758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5bb5b45e-9d76-4bb3-adaf-3cfad8fb8045 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:49.106327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5bb5b45e-9d76-4bb3-adaf-3cfad8fb8045 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:49.107418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5bb5b45e-9d76-4bb3-adaf-3cfad8fb8045 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:49.108771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5bb5b45e-9d76-4bb3-adaf-3cfad8fb8045 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:49.204242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e31de763-42d1-4412-9243-78e9936c82dd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:49.213345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e31de763-42d1-4412-9243-78e9936c82dd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:49.215210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e31de763-42d1-4412-9243-78e9936c82dd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:49.217141 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e31de763-42d1-4412-9243-78e9936c82dd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1568 microversion: 2.25 time: 0.393384 Oct 10 23:19:49.229646 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 389/790] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:48 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1568 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:49.241061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bfe2d77d-9a91-4939-b2bf-ae086e0fdfca tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Calling method '.version_select at 0x7f662b9588b0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:49.245994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfe2d77d-9a91-4939-b2bf-ae086e0fdfca tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:49.246742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfe2d77d-9a91-4939-b2bf-ae086e0fdfca tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:49.248720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfe2d77d-9a91-4939-b2bf-ae086e0fdfca tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:49.252388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5bb5b45e-9d76-4bb3-adaf-3cfad8fb8045 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:49.259344 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bfe2d77d-9a91-4939-b2bf-ae086e0fdfca tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1954 microversion: 2.1 time: 0.028378 Oct 10 23:19:49.260063 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 390/791] 10.222.0.23 () {58 vars in 1143 bytes} [Mon Oct 10 23:19:49 2022] GET /compute/v2.1/os-migrations => generated 1954 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:49.260289 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5bb5b45e-9d76-4bb3-adaf-3cfad8fb8045 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3" status: 200 len: 1321 microversion: 2.1 time: 0.169757 Oct 10 23:19:49.260872 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 402/792] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:49 2022] GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:49.267939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0cf98425-785a-41d5-baef-31a8370eabff tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Action: 'update_all', calling method: .version_select at 0x7f662b991b80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:49.280297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6aa612cf-6ba8-416b-bedb-9fc0840a0454 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:49.281138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6aa612cf-6ba8-416b-bedb-9fc0840a0454 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:49.288025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6aa612cf-6ba8-416b-bedb-9fc0840a0454 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:49.288616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6aa612cf-6ba8-416b-bedb-9fc0840a0454 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:49.289059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6aa612cf-6ba8-416b-bedb-9fc0840a0454 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:49.289806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6aa612cf-6ba8-416b-bedb-9fc0840a0454 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:49.290416 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6aa612cf-6ba8-416b-bedb-9fc0840a0454 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:49.291023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6aa612cf-6ba8-416b-bedb-9fc0840a0454 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:49.320951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-0cf98425-785a-41d5-baef-31a8370eabff tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Getting quotas for project 057537f4ff5244659f0bdd05cbb32aac. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:19:49.326817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-0cf98425-785a-41d5-baef-31a8370eabff tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Getting quotas for user d70b59e0e3b84c2e98502f6a8cb96c1c and project 057537f4ff5244659f0bdd05cbb32aac. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:19:49.454143 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6aa612cf-6ba8-416b-bedb-9fc0840a0454 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1630 microversion: 2.1 time: 0.179537 Oct 10 23:19:49.456013 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 403/793] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:49 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1630 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:49.484198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bb8f7fc6-64b3-4b54-9c06-21f914eac7e7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Action: 'create', calling method: .version_select at 0x7f6630246700>, body: {"keypair": {"name": "tempest-keypair-242336254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFg16rHcur1CpuZpv2G/ZAGKlz2/wxTi6JxogoBk9tWNC1uUc7eJT1NAYhHsyOpBJobF2DC71RIQoyJhCtrR+akzdqJf23Hm5eUXzHuoKXK6ZqaDWwAbZ4rSBxpPXupMrA=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:49.504175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-bb8f7fc6-64b3-4b54-9c06-21f914eac7e7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Getting quotas for project 1b5a9d1de27b407e91ff0ae66242ec81. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:19:49.516083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-bb8f7fc6-64b3-4b54-9c06-21f914eac7e7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Getting quotas for user 9bd83ab05cb34853bbab0f86a630aa1e and project 1b5a9d1de27b407e91ff0ae66242ec81. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:19:49.551333 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bb8f7fc6-64b3-4b54-9c06-21f914eac7e7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.071045 Oct 10 23:19:49.552445 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 404/794] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:19:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:19:49.707212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-53bbb995-51d8-4809-9f0c-2ced4471ed43 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:49.708999 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-53bbb995-51d8-4809-9f0c-2ced4471ed43 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: d4bce34b-efcf-4b32-9c0c-882ebe101017] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:49.717296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53bbb995-51d8-4809-9f0c-2ced4471ed43 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:49.718043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53bbb995-51d8-4809-9f0c-2ced4471ed43 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:49.718728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53bbb995-51d8-4809-9f0c-2ced4471ed43 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:49.719748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53bbb995-51d8-4809-9f0c-2ced4471ed43 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:49.720388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53bbb995-51d8-4809-9f0c-2ced4471ed43 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:49.721203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53bbb995-51d8-4809-9f0c-2ced4471ed43 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:49.723834 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0cf98425-785a-41d5-baef-31a8370eabff tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] 10.222.0.23 "PUT /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.462073 Oct 10 23:19:49.724534 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 391/795] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:19:49 2022] PUT /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata => generated 61 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:19:49.734041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-96fb1714-ca14-450f-89d6-3a783d42d933 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Calling method '.version_select at 0x7f662b9588b0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:49.788008 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-96fb1714-ca14-450f-89d6-3a783d42d933 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] 10.222.0.23 "GET /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.057961 Oct 10 23:19:49.789451 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 392/796] 10.222.0.23 () {58 vars in 1290 bytes} [Mon Oct 10 23:19:49 2022] GET /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata/os_distro => generated 33 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 23:19:49.802076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0dd00abb-50ea-4b4a-b5c8-7ed43b61656b tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Action: 'update_all', calling method: .version_select at 0x7f662b909310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:49.887055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-0dd00abb-50ea-4b4a-b5c8-7ed43b61656b tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Getting quotas for project 057537f4ff5244659f0bdd05cbb32aac. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:19:49.898885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-0dd00abb-50ea-4b4a-b5c8-7ed43b61656b tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Getting quotas for user d70b59e0e3b84c2e98502f6a8cb96c1c and project 057537f4ff5244659f0bdd05cbb32aac. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:19:50.064773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-53bbb995-51d8-4809-9f0c-2ced4471ed43 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:50.074102 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-53bbb995-51d8-4809-9f0c-2ced4471ed43 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017" status: 200 len: 1316 microversion: 2.1 time: 0.373679 Oct 10 23:19:50.077778 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 405/797] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:49 2022] GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017 => generated 1316 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:50.090468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-1d42e2f6-16e7-4006-80b2-ef788343ab83 req-7c5d8eb4-47cd-4c5c-ac35-42eebe4e5865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4521fa13-07d6-4f81-9a92-64b6862a3bd3", "tag": "5d0fd092-c1ac-4d0a-8a4b-2851cc1ab0fe"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:50.111490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1d42e2f6-16e7-4006-80b2-ef788343ab83 req-7c5d8eb4-47cd-4c5c-ac35-42eebe4e5865 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:50.112361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1d42e2f6-16e7-4006-80b2-ef788343ab83 req-7c5d8eb4-47cd-4c5c-ac35-42eebe4e5865 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:50.116268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1d42e2f6-16e7-4006-80b2-ef788343ab83 req-7c5d8eb4-47cd-4c5c-ac35-42eebe4e5865 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:50.158360 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0dd00abb-50ea-4b4a-b5c8-7ed43b61656b tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] 10.222.0.23 "PUT /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.359378 Oct 10 23:19:50.163139 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 393/798] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:19:49 2022] PUT /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata => generated 61 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:19:50.163413 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-1d42e2f6-16e7-4006-80b2-ef788343ab83 req-7c5d8eb4-47cd-4c5c-ac35-42eebe4e5865 service nova] Creating event network-changed:5d0fd092-c1ac-4d0a-8a4b-2851cc1ab0fe for instance 4521fa13-07d6-4f81-9a92-64b6862a3bd3 on n-h2-860864-2 Oct 10 23:19:50.168256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-95e738e3-d754-4fc2-b661-a98f8c74167f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:50.171811 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-1d42e2f6-16e7-4006-80b2-ef788343ab83 req-7c5d8eb4-47cd-4c5c-ac35-42eebe4e5865 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092793 Oct 10 23:19:50.171964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-95e738e3-d754-4fc2-b661-a98f8c74167f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:50.174775 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 406/799] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:50.180985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-193ad129-1b13-4df3-b9f2-04355003fb64 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Calling method '.version_select at 0x7f662b968550>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:50.186270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:50.189425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95e738e3-d754-4fc2-b661-a98f8c74167f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:50.189802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95e738e3-d754-4fc2-b661-a98f8c74167f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:50.191724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95e738e3-d754-4fc2-b661-a98f8c74167f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:50.192499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95e738e3-d754-4fc2-b661-a98f8c74167f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:50.193133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95e738e3-d754-4fc2-b661-a98f8c74167f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:50.193872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95e738e3-d754-4fc2-b661-a98f8c74167f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:50.227246 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-193ad129-1b13-4df3-b9f2-04355003fb64 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] 10.222.0.23 "GET /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.051055 Oct 10 23:19:50.235622 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 407/800] 10.222.0.23 () {58 vars in 1260 bytes} [Mon Oct 10 23:19:50 2022] GET /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata => generated 61 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:19:50.361468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-04fb8146-4d33-4ffd-964b-7ee63564c553 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Action: 'create', calling method: .version_select at 0x7f6630687b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1505247545", "description": "tempest-description-1966626449"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:50.605205 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-04fb8146-4d33-4ffd-964b-7ee63564c553 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.367890 Oct 10 23:19:50.607787 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 408/801] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:19:50 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:50.615483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-84bd92e4-7ae9-4ad2-9ae4-0c1ce32837d1 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Action: 'update_all', calling method: .version_select at 0x7f662b9cd3a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:50.665657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-95e738e3-d754-4fc2-b661-a98f8c74167f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:50.673976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-84bd92e4-7ae9-4ad2-9ae4-0c1ce32837d1 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Getting quotas for project 057537f4ff5244659f0bdd05cbb32aac. Resources: dict_keys(['metadata_items']) {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:19:50.676257 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-95e738e3-d754-4fc2-b661-a98f8c74167f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1471 microversion: 2.1 time: 0.514600 Oct 10 23:19:50.677563 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 394/802] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:50 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1471 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:50.683805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cafcd476-5edb-486a-b517-8f6739a4a7b7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:50.685071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cafcd476-5edb-486a-b517-8f6739a4a7b7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:50.693760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cafcd476-5edb-486a-b517-8f6739a4a7b7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:50.694624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cafcd476-5edb-486a-b517-8f6739a4a7b7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:50.695120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-84bd92e4-7ae9-4ad2-9ae4-0c1ce32837d1 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Getting quotas for user d70b59e0e3b84c2e98502f6a8cb96c1c and project 057537f4ff5244659f0bdd05cbb32aac. Resources: dict_keys(['metadata_items']) {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:19:50.695760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cafcd476-5edb-486a-b517-8f6739a4a7b7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:50.696945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cafcd476-5edb-486a-b517-8f6739a4a7b7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:50.697682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cafcd476-5edb-486a-b517-8f6739a4a7b7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:50.698625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cafcd476-5edb-486a-b517-8f6739a4a7b7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:50.895523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cafcd476-5edb-486a-b517-8f6739a4a7b7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:50.905012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cafcd476-5edb-486a-b517-8f6739a4a7b7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:50.906850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cafcd476-5edb-486a-b517-8f6739a4a7b7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:50.908271 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cafcd476-5edb-486a-b517-8f6739a4a7b7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1568 microversion: 2.25 time: 0.229369 Oct 10 23:19:50.909649 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 395/803] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:50 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:50.915057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0d4b02b5-de03-4ba2-b4ec-9cbd1f004fac tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:50.915987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0d4b02b5-de03-4ba2-b4ec-9cbd1f004fac tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 4521fa13-07d6-4f81-9a92-64b6862a3bd3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:50.923471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d4b02b5-de03-4ba2-b4ec-9cbd1f004fac tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:50.924304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d4b02b5-de03-4ba2-b4ec-9cbd1f004fac tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:50.925122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d4b02b5-de03-4ba2-b4ec-9cbd1f004fac tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:50.926105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d4b02b5-de03-4ba2-b4ec-9cbd1f004fac tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:50.926823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d4b02b5-de03-4ba2-b4ec-9cbd1f004fac tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:50.927326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d4b02b5-de03-4ba2-b4ec-9cbd1f004fac tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:50.938586 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-84bd92e4-7ae9-4ad2-9ae4-0c1ce32837d1 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] 10.222.0.23 "PUT /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.328997 Oct 10 23:19:50.939520 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 409/804] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:19:50 2022] PUT /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata => generated 61 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:19:50.945771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a8d79b1c-b9fd-496f-9856-ab7516fa0aca tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Action: 'create', calling method: .version_select at 0x7f66301bfb80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-691929023", "description": "tempest-description-512274964"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:51.101960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0d4b02b5-de03-4ba2-b4ec-9cbd1f004fac tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:51.110948 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0d4b02b5-de03-4ba2-b4ec-9cbd1f004fac tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3" status: 200 len: 1321 microversion: 2.1 time: 0.200020 Oct 10 23:19:51.111827 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 396/805] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:50 2022] GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:51.116644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e84ad4b8-3f42-4024-9bb6-1ea1558bccd4 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Action: 'update_all', calling method: .version_select at 0x7f662b98f0d0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:51.171445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-e84ad4b8-3f42-4024-9bb6-1ea1558bccd4 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Getting quotas for project 057537f4ff5244659f0bdd05cbb32aac. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:19:51.176805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-e84ad4b8-3f42-4024-9bb6-1ea1558bccd4 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Getting quotas for user d70b59e0e3b84c2e98502f6a8cb96c1c and project 057537f4ff5244659f0bdd05cbb32aac. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:19:51.273204 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a8d79b1c-b9fd-496f-9856-ab7516fa0aca tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.332290 Oct 10 23:19:51.273783 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 410/806] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:19:50 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:51.279591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-91fd1d75-ed37-4ff0-83c5-2a66279a0415 req-0b0a3df8-7f8e-47b5-afc1-aa27191c1fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4bce34b-efcf-4b32-9c0c-882ebe101017", "name": "network-vif-plugged", "status": "completed", "tag": "eecc4a02-e3b1-42d5-8ca7-35ef517e597e"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:51.291112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-91fd1d75-ed37-4ff0-83c5-2a66279a0415 req-0b0a3df8-7f8e-47b5-afc1-aa27191c1fc5 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:51.292209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-91fd1d75-ed37-4ff0-83c5-2a66279a0415 req-0b0a3df8-7f8e-47b5-afc1-aa27191c1fc5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:51.292394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-91fd1d75-ed37-4ff0-83c5-2a66279a0415 req-0b0a3df8-7f8e-47b5-afc1-aa27191c1fc5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:51.305596 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-91fd1d75-ed37-4ff0-83c5-2a66279a0415 req-0b0a3df8-7f8e-47b5-afc1-aa27191c1fc5 service nova] Creating event network-vif-plugged:eecc4a02-e3b1-42d5-8ca7-35ef517e597e for instance d4bce34b-efcf-4b32-9c0c-882ebe101017 on n-h1-860864-2 Oct 10 23:19:51.314152 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-91fd1d75-ed37-4ff0-83c5-2a66279a0415 req-0b0a3df8-7f8e-47b5-afc1-aa27191c1fc5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038670 Oct 10 23:19:51.315448 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 411/807] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:51.324144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-09b94fe6-0938-472e-96e7-552f7d5f516d tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:51.325222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-09b94fe6-0938-472e-96e7-552f7d5f516d tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: d4bce34b-efcf-4b32-9c0c-882ebe101017] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:51.333460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09b94fe6-0938-472e-96e7-552f7d5f516d tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:51.335046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09b94fe6-0938-472e-96e7-552f7d5f516d tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:51.335807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09b94fe6-0938-472e-96e7-552f7d5f516d tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:51.336733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09b94fe6-0938-472e-96e7-552f7d5f516d tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:51.337473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09b94fe6-0938-472e-96e7-552f7d5f516d tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:51.338405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09b94fe6-0938-472e-96e7-552f7d5f516d tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:51.547172 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e84ad4b8-3f42-4024-9bb6-1ea1558bccd4 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] 10.222.0.23 "PUT /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata" status: 200 len: 64 microversion: 2.1 time: 0.434196 Oct 10 23:19:51.548044 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 397/808] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:19:51 2022] PUT /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata => generated 64 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:19:51.553298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-694610bf-31ad-4793-8400-abdcf517f07a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1274283708", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "6f6758f8-cea0-4c07-90bd-fe7352ffe3a0"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:51.609217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-09b94fe6-0938-472e-96e7-552f7d5f516d tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:51.612709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-694610bf-31ad-4793-8400-abdcf517f07a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] validate_networks() for [('6f6758f8-cea0-4c07-90bd-fe7352ffe3a0', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:19:51.620555 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-09b94fe6-0938-472e-96e7-552f7d5f516d tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017" status: 200 len: 1316 microversion: 2.1 time: 0.303468 Oct 10 23:19:51.621071 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 412/809] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:51 2022] GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017 => generated 1316 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:51.642701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a8ef57c0-45d1-4b4f-8880-84960b9f5f2d tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Calling method '.version_select at 0x7f662b9cd0d0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:51.694764 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a8ef57c0-45d1-4b4f-8880-84960b9f5f2d tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] 10.222.0.23 "GET /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata" status: 200 len: 64 microversion: 2.1 time: 0.059641 Oct 10 23:19:51.697500 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 413/810] 10.222.0.23 () {58 vars in 1260 bytes} [Mon Oct 10 23:19:51 2022] GET /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata => generated 64 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:19:51.705397 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-96241e6e-8bfa-427d-8394-6c6a3b229df3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:51.706010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-96241e6e-8bfa-427d-8394-6c6a3b229df3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:51.717928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96241e6e-8bfa-427d-8394-6c6a3b229df3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:51.718644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96241e6e-8bfa-427d-8394-6c6a3b229df3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:51.718855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96241e6e-8bfa-427d-8394-6c6a3b229df3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:51.719842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96241e6e-8bfa-427d-8394-6c6a3b229df3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:51.720464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96241e6e-8bfa-427d-8394-6c6a3b229df3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:51.721072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96241e6e-8bfa-427d-8394-6c6a3b229df3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:52.183007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-694610bf-31ad-4793-8400-abdcf517f07a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:19:52.183546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-694610bf-31ad-4793-8400-abdcf517f07a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:19:52.184474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-694610bf-31ad-4793-8400-abdcf517f07a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:19:52.185218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-694610bf-31ad-4793-8400-abdcf517f07a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:19:52.186060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-694610bf-31ad-4793-8400-abdcf517f07a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:19:52.224413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-694610bf-31ad-4793-8400-abdcf517f07a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:52.224908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-694610bf-31ad-4793-8400-abdcf517f07a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:52.225347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-694610bf-31ad-4793-8400-abdcf517f07a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:52.226401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-694610bf-31ad-4793-8400-abdcf517f07a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:52.226872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-694610bf-31ad-4793-8400-abdcf517f07a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:52.227297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-694610bf-31ad-4793-8400-abdcf517f07a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:52.246182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-694610bf-31ad-4793-8400-abdcf517f07a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Getting quotas for project 56fc65084a2a46689aa3b221e6d7aeb8. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:19:52.256889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-694610bf-31ad-4793-8400-abdcf517f07a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Getting quotas for user 9dfa7f1be9884bb1aabc9df8702fa630 and project 56fc65084a2a46689aa3b221e6d7aeb8. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:19:52.274277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-694610bf-31ad-4793-8400-abdcf517f07a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:19:52.282670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-694610bf-31ad-4793-8400-abdcf517f07a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:19:52.350275 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-694610bf-31ad-4793-8400-abdcf517f07a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.800998 Oct 10 23:19:52.351833 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 398/811] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:19:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:19:52.357871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-47412f29-7ec5-44d3-ad9c-e5ac979e5bfe tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Action: 'update_all', calling method: .version_select at 0x7f662bab5820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:52.430894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-47412f29-7ec5-44d3-ad9c-e5ac979e5bfe tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Getting quotas for project 057537f4ff5244659f0bdd05cbb32aac. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:19:52.440882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-47412f29-7ec5-44d3-ad9c-e5ac979e5bfe tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Getting quotas for user d70b59e0e3b84c2e98502f6a8cb96c1c and project 057537f4ff5244659f0bdd05cbb32aac. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:19:52.642847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-96241e6e-8bfa-427d-8394-6c6a3b229df3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:52.657884 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-96241e6e-8bfa-427d-8394-6c6a3b229df3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1471 microversion: 2.1 time: 0.958171 Oct 10 23:19:52.658511 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 414/812] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:51 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1471 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:52.674915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-374f3e8d-98ed-474b-bea5-66c234d08691 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:52.675947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-374f3e8d-98ed-474b-bea5-66c234d08691 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:52.696425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-374f3e8d-98ed-474b-bea5-66c234d08691 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:52.697258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-374f3e8d-98ed-474b-bea5-66c234d08691 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:52.697741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-374f3e8d-98ed-474b-bea5-66c234d08691 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:52.698490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-374f3e8d-98ed-474b-bea5-66c234d08691 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:52.698971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-374f3e8d-98ed-474b-bea5-66c234d08691 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:52.699397 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-374f3e8d-98ed-474b-bea5-66c234d08691 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:52.712746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:52.943876 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-47412f29-7ec5-44d3-ad9c-e5ac979e5bfe tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] 10.222.0.23 "PUT /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.586845 Oct 10 23:19:52.950891 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 399/813] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:19:52 2022] PUT /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata => generated 61 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:19:52.957176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-80eb16f0-7c8b-4b4f-adde-a931334fdefc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:52.958113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-80eb16f0-7c8b-4b4f-adde-a931334fdefc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 4521fa13-07d6-4f81-9a92-64b6862a3bd3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:52.969817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80eb16f0-7c8b-4b4f-adde-a931334fdefc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:52.970326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80eb16f0-7c8b-4b4f-adde-a931334fdefc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:52.970777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80eb16f0-7c8b-4b4f-adde-a931334fdefc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:52.972151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80eb16f0-7c8b-4b4f-adde-a931334fdefc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:52.972617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80eb16f0-7c8b-4b4f-adde-a931334fdefc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:52.973051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80eb16f0-7c8b-4b4f-adde-a931334fdefc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:53.152424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-80eb16f0-7c8b-4b4f-adde-a931334fdefc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:53.156406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-374f3e8d-98ed-474b-bea5-66c234d08691 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:53.170492 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-80eb16f0-7c8b-4b4f-adde-a931334fdefc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3" status: 200 len: 1321 microversion: 2.1 time: 0.218006 Oct 10 23:19:53.171162 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 400/814] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:52 2022] GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:53.172175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-374f3e8d-98ed-474b-bea5-66c234d08691 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:53.173895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-374f3e8d-98ed-474b-bea5-66c234d08691 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:53.175168 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-374f3e8d-98ed-474b-bea5-66c234d08691 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1568 microversion: 2.25 time: 0.515718 Oct 10 23:19:53.177058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-25659e50-13be-4f79-9395-9e1af0212a5a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:53.177948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-25659e50-13be-4f79-9395-9e1af0212a5a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:53.192252 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 415/815] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:52 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1568 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:53.197174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-44c1b00b-76b2-41d0-a638-2d6847752e62 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:53.197884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-44c1b00b-76b2-41d0-a638-2d6847752e62 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: d4bce34b-efcf-4b32-9c0c-882ebe101017] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:53.199172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25659e50-13be-4f79-9395-9e1af0212a5a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:53.201934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25659e50-13be-4f79-9395-9e1af0212a5a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:53.203264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25659e50-13be-4f79-9395-9e1af0212a5a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:53.204234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25659e50-13be-4f79-9395-9e1af0212a5a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:53.205603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25659e50-13be-4f79-9395-9e1af0212a5a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:53.206441 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25659e50-13be-4f79-9395-9e1af0212a5a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:53.207732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44c1b00b-76b2-41d0-a638-2d6847752e62 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:53.208232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44c1b00b-76b2-41d0-a638-2d6847752e62 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:53.208872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44c1b00b-76b2-41d0-a638-2d6847752e62 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:53.209618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44c1b00b-76b2-41d0-a638-2d6847752e62 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:53.210233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44c1b00b-76b2-41d0-a638-2d6847752e62 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:53.210687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44c1b00b-76b2-41d0-a638-2d6847752e62 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:53.300295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-25659e50-13be-4f79-9395-9e1af0212a5a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:53.321745 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-25659e50-13be-4f79-9395-9e1af0212a5a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71" status: 200 len: 1220 microversion: 2.1 time: 0.149200 Oct 10 23:19:53.322718 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 401/816] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:53 2022] GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71 => generated 1220 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:53.330393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-88faad3f-3bba-49a2-96dd-65df9c6c3437 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Action: 'update', calling method: .version_select at 0x7f66303bdaf0>, body: {"meta": {"os_version": "alt"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:53.414228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-88faad3f-3bba-49a2-96dd-65df9c6c3437 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Getting quotas for project 057537f4ff5244659f0bdd05cbb32aac. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:19:53.426248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-88faad3f-3bba-49a2-96dd-65df9c6c3437 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Getting quotas for user d70b59e0e3b84c2e98502f6a8cb96c1c and project 057537f4ff5244659f0bdd05cbb32aac. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:19:53.646052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-44c1b00b-76b2-41d0-a638-2d6847752e62 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:53.654500 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-44c1b00b-76b2-41d0-a638-2d6847752e62 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017" status: 200 len: 1316 microversion: 2.1 time: 0.460584 Oct 10 23:19:53.655080 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 416/817] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:53 2022] GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017 => generated 1316 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:53.666943 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ec3ec097-909f-4703-a568-693c47d1a135 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2076867047", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "6efb9146-bb54-41e6-9e93-c4bb8a061be1"}], "security_groups": [{"name": "tempest-securitygroup--770617793"}], "key_name": "tempest-keypair-242336254", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:53.797204 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-88faad3f-3bba-49a2-96dd-65df9c6c3437 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] 10.222.0.23 "PUT /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.470658 Oct 10 23:19:53.802311 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 402/818] 10.222.0.23 () {60 vars in 1313 bytes} [Mon Oct 10 23:19:53 2022] PUT /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata/os_version => generated 31 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:19:53.805907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-11d723ad-3a1b-46e1-a5e8-ca2df78f5991 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:53.806838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-11d723ad-3a1b-46e1-a5e8-ca2df78f5991 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:53.814262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11d723ad-3a1b-46e1-a5e8-ca2df78f5991 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:53.814771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11d723ad-3a1b-46e1-a5e8-ca2df78f5991 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:53.815590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11d723ad-3a1b-46e1-a5e8-ca2df78f5991 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:53.816416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11d723ad-3a1b-46e1-a5e8-ca2df78f5991 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:53.822396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11d723ad-3a1b-46e1-a5e8-ca2df78f5991 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:53.824064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11d723ad-3a1b-46e1-a5e8-ca2df78f5991 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:53.905803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-ec3ec097-909f-4703-a568-693c47d1a135 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] validate_networks() for [('6efb9146-bb54-41e6-9e93-c4bb8a061be1', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:19:54.037497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-11d723ad-3a1b-46e1-a5e8-ca2df78f5991 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:54.047314 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-11d723ad-3a1b-46e1-a5e8-ca2df78f5991 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1476 microversion: 2.1 time: 0.247004 Oct 10 23:19:54.047908 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 403/819] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:53 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1476 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:54.062161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-099f96e9-a10a-47e1-b77c-85f54846487e tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Calling method '.version_select at 0x7f662bdf6550>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:54.111154 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-099f96e9-a10a-47e1-b77c-85f54846487e tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] 10.222.0.23 "GET /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata" status: 200 len: 58 microversion: 2.1 time: 0.060110 Oct 10 23:19:54.111747 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 404/820] 10.222.0.23 () {58 vars in 1260 bytes} [Mon Oct 10 23:19:54 2022] GET /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata => generated 58 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:19:54.118079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-a473320f-bd52-4ca3-8fe0-e1bba21443cf req-7f520199-e0be-4222-ace1-edc8d87eb87f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d", "name": "network-vif-plugged", "status": "completed", "tag": "9aeedf20-d5e5-4fe0-87b9-2bdfe5ba2dbc"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:54.130599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a473320f-bd52-4ca3-8fe0-e1bba21443cf req-7f520199-e0be-4222-ace1-edc8d87eb87f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:54.131078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a473320f-bd52-4ca3-8fe0-e1bba21443cf req-7f520199-e0be-4222-ace1-edc8d87eb87f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:54.131718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a473320f-bd52-4ca3-8fe0-e1bba21443cf req-7f520199-e0be-4222-ace1-edc8d87eb87f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:54.145891 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a473320f-bd52-4ca3-8fe0-e1bba21443cf req-7f520199-e0be-4222-ace1-edc8d87eb87f service nova] Creating event network-vif-plugged:9aeedf20-d5e5-4fe0-87b9-2bdfe5ba2dbc for instance 9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d on n-h2-860864-2 Oct 10 23:19:54.150840 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-a473320f-bd52-4ca3-8fe0-e1bba21443cf req-7f520199-e0be-4222-ace1-edc8d87eb87f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037966 Oct 10 23:19:54.151453 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 405/821] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:54.157705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-650b6cf3-8b9b-486c-a9da-63bcc7032fed tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Action: 'update_all', calling method: .version_select at 0x7f662bb9cee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:54.215249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-650b6cf3-8b9b-486c-a9da-63bcc7032fed tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Getting quotas for project 057537f4ff5244659f0bdd05cbb32aac. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:19:54.222567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-650b6cf3-8b9b-486c-a9da-63bcc7032fed tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Getting quotas for user d70b59e0e3b84c2e98502f6a8cb96c1c and project 057537f4ff5244659f0bdd05cbb32aac. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:19:54.524988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ec3ec097-909f-4703-a568-693c47d1a135 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:19:54.525450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ec3ec097-909f-4703-a568-693c47d1a135 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:19:54.525932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ec3ec097-909f-4703-a568-693c47d1a135 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:19:54.526345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ec3ec097-909f-4703-a568-693c47d1a135 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:19:54.526935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ec3ec097-909f-4703-a568-693c47d1a135 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:19:54.527420 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-650b6cf3-8b9b-486c-a9da-63bcc7032fed tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] 10.222.0.23 "PUT /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.374662 Oct 10 23:19:54.528027 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 406/822] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:19:54 2022] PUT /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata => generated 61 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:19:54.532140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:54.537786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f365a5b9-a535-499c-8170-fdc3f08e4852 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:54.538128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec3ec097-909f-4703-a568-693c47d1a135 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:54.538778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec3ec097-909f-4703-a568-693c47d1a135 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:54.539386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec3ec097-909f-4703-a568-693c47d1a135 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:54.540096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f365a5b9-a535-499c-8170-fdc3f08e4852 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 4521fa13-07d6-4f81-9a92-64b6862a3bd3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:54.540585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec3ec097-909f-4703-a568-693c47d1a135 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:54.541412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec3ec097-909f-4703-a568-693c47d1a135 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:54.541847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec3ec097-909f-4703-a568-693c47d1a135 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:54.551254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f365a5b9-a535-499c-8170-fdc3f08e4852 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:54.551859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f365a5b9-a535-499c-8170-fdc3f08e4852 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:54.552419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f365a5b9-a535-499c-8170-fdc3f08e4852 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:54.553329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f365a5b9-a535-499c-8170-fdc3f08e4852 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:54.553885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f365a5b9-a535-499c-8170-fdc3f08e4852 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:54.554855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f365a5b9-a535-499c-8170-fdc3f08e4852 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:54.563870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ec3ec097-909f-4703-a568-693c47d1a135 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Getting quotas for project 1b5a9d1de27b407e91ff0ae66242ec81. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:19:54.569645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ec3ec097-909f-4703-a568-693c47d1a135 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Getting quotas for user 9bd83ab05cb34853bbab0f86a630aa1e and project 1b5a9d1de27b407e91ff0ae66242ec81. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:19:54.584342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ec3ec097-909f-4703-a568-693c47d1a135 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:19:54.586865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ec3ec097-909f-4703-a568-693c47d1a135 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:19:54.646266 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ec3ec097-909f-4703-a568-693c47d1a135 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.983122 Oct 10 23:19:54.648080 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 417/823] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:19:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:19:54.655601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ab81075b-4205-48ab-8128-5c393d7aabac tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:54.656384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ab81075b-4205-48ab-8128-5c393d7aabac tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:54.667510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab81075b-4205-48ab-8128-5c393d7aabac tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:54.670552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab81075b-4205-48ab-8128-5c393d7aabac tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:54.671218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab81075b-4205-48ab-8128-5c393d7aabac tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:54.672149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab81075b-4205-48ab-8128-5c393d7aabac tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:54.672951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab81075b-4205-48ab-8128-5c393d7aabac tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:54.673580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab81075b-4205-48ab-8128-5c393d7aabac tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:54.723546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f365a5b9-a535-499c-8170-fdc3f08e4852 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:54.733811 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f365a5b9-a535-499c-8170-fdc3f08e4852 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3" status: 200 len: 1321 microversion: 2.1 time: 0.202100 Oct 10 23:19:54.735970 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 407/824] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:54 2022] GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:54.741063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-98721089-47f3-41c2-8232-92ff374c24c2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:54.743100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-98721089-47f3-41c2-8232-92ff374c24c2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:54.757125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98721089-47f3-41c2-8232-92ff374c24c2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:54.757891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98721089-47f3-41c2-8232-92ff374c24c2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:54.758726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98721089-47f3-41c2-8232-92ff374c24c2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:54.759739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98721089-47f3-41c2-8232-92ff374c24c2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:54.760407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98721089-47f3-41c2-8232-92ff374c24c2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:54.761023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98721089-47f3-41c2-8232-92ff374c24c2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:54.766415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:54.849989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-98721089-47f3-41c2-8232-92ff374c24c2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:54.860865 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-98721089-47f3-41c2-8232-92ff374c24c2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71" status: 200 len: 1268 microversion: 2.1 time: 0.122204 Oct 10 23:19:54.861522 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 408/825] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:54 2022] GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71 => generated 1268 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:54.867020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9635e243-6dd9-40b3-8b51-00f9f67cefaf tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Action: 'create', calling method: .version_select at 0x7f6630304790>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:54.929919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-9635e243-6dd9-40b3-8b51-00f9f67cefaf tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Getting quotas for project 057537f4ff5244659f0bdd05cbb32aac. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:19:54.937503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-9635e243-6dd9-40b3-8b51-00f9f67cefaf tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Getting quotas for user d70b59e0e3b84c2e98502f6a8cb96c1c and project 057537f4ff5244659f0bdd05cbb32aac. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:19:54.941344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ab81075b-4205-48ab-8128-5c393d7aabac tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:54.952057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ab81075b-4205-48ab-8128-5c393d7aabac tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:54.953887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ab81075b-4205-48ab-8128-5c393d7aabac tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:54.956764 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ab81075b-4205-48ab-8128-5c393d7aabac tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1568 microversion: 2.25 time: 0.307287 Oct 10 23:19:54.957346 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 418/826] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:54 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1568 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:54.962461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-02cbea95-24da-4ac5-9046-079f2dd0cf07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:54.964038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-02cbea95-24da-4ac5-9046-079f2dd0cf07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:55.046259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-02cbea95-24da-4ac5-9046-079f2dd0cf07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:55.055439 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-02cbea95-24da-4ac5-9046-079f2dd0cf07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1234 microversion: 2.1 time: 0.096988 Oct 10 23:19:55.056471 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 419/827] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:54 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1234 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:55.075311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-767682c2-b79a-4065-9c18-9f7858fc5c72 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:55.076676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-767682c2-b79a-4065-9c18-9f7858fc5c72 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: d4bce34b-efcf-4b32-9c0c-882ebe101017] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:55.096382 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-767682c2-b79a-4065-9c18-9f7858fc5c72 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:55.097326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-767682c2-b79a-4065-9c18-9f7858fc5c72 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:55.098016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-767682c2-b79a-4065-9c18-9f7858fc5c72 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:55.099025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-767682c2-b79a-4065-9c18-9f7858fc5c72 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:55.099752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-767682c2-b79a-4065-9c18-9f7858fc5c72 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:55.100526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-767682c2-b79a-4065-9c18-9f7858fc5c72 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:55.339573 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9635e243-6dd9-40b3-8b51-00f9f67cefaf tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] 10.222.0.23 "POST /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata" status: 200 len: 85 microversion: 2.1 time: 0.476547 Oct 10 23:19:55.340172 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 409/828] 10.222.0.23 () {60 vars in 1281 bytes} [Mon Oct 10 23:19:54 2022] POST /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata => generated 85 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:19:55.345705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c3ea120e-0633-470b-961e-68ddbcb9394d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:55.346517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c3ea120e-0633-470b-961e-68ddbcb9394d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:55.353203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3ea120e-0633-470b-961e-68ddbcb9394d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:55.353821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3ea120e-0633-470b-961e-68ddbcb9394d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:55.354429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3ea120e-0633-470b-961e-68ddbcb9394d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:55.355454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3ea120e-0633-470b-961e-68ddbcb9394d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:55.356066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3ea120e-0633-470b-961e-68ddbcb9394d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:55.357099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3ea120e-0633-470b-961e-68ddbcb9394d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:55.364693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-767682c2-b79a-4065-9c18-9f7858fc5c72 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:55.372856 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-767682c2-b79a-4065-9c18-9f7858fc5c72 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017" status: 200 len: 1316 microversion: 2.1 time: 0.315092 Oct 10 23:19:55.374028 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 420/829] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:55 2022] GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017 => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:55.378745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-07c3eafb-a1aa-4019-8f9e-9ca60a5e0e41 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] Calling method '.version_select at 0x7f66301bfb80>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:55.433737 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-07c3eafb-a1aa-4019-8f9e-9ca60a5e0e41 tempest-ImagesMetadataTestJSON-530281560 tempest-ImagesMetadataTestJSON-530281560-project] 10.222.0.23 "GET /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata" status: 200 len: 85 microversion: 2.1 time: 0.058242 Oct 10 23:19:55.439771 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 421/830] 10.222.0.23 () {58 vars in 1260 bytes} [Mon Oct 10 23:19:55 2022] GET /compute/v2.1/images/2a32e854-f8a1-451f-bda2-1b58f5ea675e/metadata => generated 85 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:19:55.600135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c3ea120e-0633-470b-961e-68ddbcb9394d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:55.612324 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c3ea120e-0633-470b-961e-68ddbcb9394d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1476 microversion: 2.1 time: 0.270402 Oct 10 23:19:55.613280 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 410/831] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:55 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1476 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:55.759365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-09011b9c-e697-40fa-9539-99dd9b865487 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:55.760007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-09011b9c-e697-40fa-9539-99dd9b865487 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 4521fa13-07d6-4f81-9a92-64b6862a3bd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:55.767375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09011b9c-e697-40fa-9539-99dd9b865487 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:55.767875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09011b9c-e697-40fa-9539-99dd9b865487 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:55.768312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09011b9c-e697-40fa-9539-99dd9b865487 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:55.769038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09011b9c-e697-40fa-9539-99dd9b865487 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:55.769522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09011b9c-e697-40fa-9539-99dd9b865487 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:55.769959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09011b9c-e697-40fa-9539-99dd9b865487 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:55.888749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ed6fcea4-c336-4444-9e94-e4be8923f855 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:55.889528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ed6fcea4-c336-4444-9e94-e4be8923f855 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:55.902697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed6fcea4-c336-4444-9e94-e4be8923f855 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:55.903251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed6fcea4-c336-4444-9e94-e4be8923f855 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:55.905242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed6fcea4-c336-4444-9e94-e4be8923f855 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:55.907099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed6fcea4-c336-4444-9e94-e4be8923f855 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:55.907579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed6fcea4-c336-4444-9e94-e4be8923f855 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:55.908017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed6fcea4-c336-4444-9e94-e4be8923f855 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:56.024675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ed6fcea4-c336-4444-9e94-e4be8923f855 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:56.033984 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-09011b9c-e697-40fa-9539-99dd9b865487 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:56.036849 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ed6fcea4-c336-4444-9e94-e4be8923f855 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71" status: 200 len: 1268 microversion: 2.1 time: 0.154670 Oct 10 23:19:56.038543 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 411/832] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:55 2022] GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71 => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:56.045804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8c2c8e3e-df5a-4ada-b434-0d6941de6466 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:56.047248 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-09011b9c-e697-40fa-9539-99dd9b865487 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3" status: 200 len: 1321 microversion: 2.1 time: 0.292220 Oct 10 23:19:56.047512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8c2c8e3e-df5a-4ada-b434-0d6941de6466 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:56.048153 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 422/833] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:55 2022] GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3 => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:56.059046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c2c8e3e-df5a-4ada-b434-0d6941de6466 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:56.060922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c2c8e3e-df5a-4ada-b434-0d6941de6466 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:56.062156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c2c8e3e-df5a-4ada-b434-0d6941de6466 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:56.063671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c2c8e3e-df5a-4ada-b434-0d6941de6466 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:56.064493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c2c8e3e-df5a-4ada-b434-0d6941de6466 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:56.065517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c2c8e3e-df5a-4ada-b434-0d6941de6466 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:56.088011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-45649300-e3e0-424e-87aa-2aeb34050d07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:56.088743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-45649300-e3e0-424e-87aa-2aeb34050d07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:56.103096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45649300-e3e0-424e-87aa-2aeb34050d07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:56.107873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45649300-e3e0-424e-87aa-2aeb34050d07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:56.108412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45649300-e3e0-424e-87aa-2aeb34050d07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:56.109113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45649300-e3e0-424e-87aa-2aeb34050d07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:56.109610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45649300-e3e0-424e-87aa-2aeb34050d07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:56.110084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45649300-e3e0-424e-87aa-2aeb34050d07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:56.227832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-45649300-e3e0-424e-87aa-2aeb34050d07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:56.238216 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-45649300-e3e0-424e-87aa-2aeb34050d07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1286 microversion: 2.1 time: 0.158486 Oct 10 23:19:56.250483 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 423/834] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:56 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1286 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:56.261792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-87cc92ab-3d0c-40af-b21f-a1a6eb051be8 req-540d5e43-c493-4622-b52b-7f8b4588acd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4521fa13-07d6-4f81-9a92-64b6862a3bd3", "name": "network-vif-plugged", "status": "completed", "tag": "5d0fd092-c1ac-4d0a-8a4b-2851cc1ab0fe"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:56.283978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-87cc92ab-3d0c-40af-b21f-a1a6eb051be8 req-540d5e43-c493-4622-b52b-7f8b4588acd3 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:56.285936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-87cc92ab-3d0c-40af-b21f-a1a6eb051be8 req-540d5e43-c493-4622-b52b-7f8b4588acd3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:56.286378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-87cc92ab-3d0c-40af-b21f-a1a6eb051be8 req-540d5e43-c493-4622-b52b-7f8b4588acd3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:56.307504 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-87cc92ab-3d0c-40af-b21f-a1a6eb051be8 req-540d5e43-c493-4622-b52b-7f8b4588acd3 service nova] Creating event network-vif-plugged:5d0fd092-c1ac-4d0a-8a4b-2851cc1ab0fe for instance 4521fa13-07d6-4f81-9a92-64b6862a3bd3 on n-h2-860864-2 Oct 10 23:19:56.317780 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-87cc92ab-3d0c-40af-b21f-a1a6eb051be8 req-540d5e43-c493-4622-b52b-7f8b4588acd3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064807 Oct 10 23:19:56.318395 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 424/835] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:56.365636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8c2c8e3e-df5a-4ada-b434-0d6941de6466 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:56.385104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8c2c8e3e-df5a-4ada-b434-0d6941de6466 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:56.386765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8c2c8e3e-df5a-4ada-b434-0d6941de6466 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:56.388500 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8c2c8e3e-df5a-4ada-b434-0d6941de6466 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1568 microversion: 2.25 time: 0.348078 Oct 10 23:19:56.389243 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 412/836] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:56 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1568 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:56.414350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2f8a8674-2031-45bf-8f38-b43328271a83 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:56.415114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2f8a8674-2031-45bf-8f38-b43328271a83 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: d4bce34b-efcf-4b32-9c0c-882ebe101017] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:56.421842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f8a8674-2031-45bf-8f38-b43328271a83 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:56.422342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f8a8674-2031-45bf-8f38-b43328271a83 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:56.422782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f8a8674-2031-45bf-8f38-b43328271a83 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:56.423496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f8a8674-2031-45bf-8f38-b43328271a83 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:56.423951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f8a8674-2031-45bf-8f38-b43328271a83 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:56.424380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f8a8674-2031-45bf-8f38-b43328271a83 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:56.613769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2f8a8674-2031-45bf-8f38-b43328271a83 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:56.625417 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2f8a8674-2031-45bf-8f38-b43328271a83 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017" status: 200 len: 1466 microversion: 2.1 time: 0.221861 Oct 10 23:19:56.645322 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 425/837] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:56 2022] GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017 => generated 1466 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:19:56.648915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bc0a6f46-da62-4ce0-851c-a583829aa990 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:56.649679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bc0a6f46-da62-4ce0-851c-a583829aa990 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] [instance: d4bce34b-efcf-4b32-9c0c-882ebe101017] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:56.651582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c4d40d06-bc6a-4ff7-8f51-eee878fa1018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:56.652443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c4d40d06-bc6a-4ff7-8f51-eee878fa1018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:56.662166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c4d40d06-bc6a-4ff7-8f51-eee878fa1018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:56.662708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c4d40d06-bc6a-4ff7-8f51-eee878fa1018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:56.663364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c4d40d06-bc6a-4ff7-8f51-eee878fa1018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:56.663778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc0a6f46-da62-4ce0-851c-a583829aa990 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:56.664289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc0a6f46-da62-4ce0-851c-a583829aa990 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:56.664734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc0a6f46-da62-4ce0-851c-a583829aa990 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:56.665065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c4d40d06-bc6a-4ff7-8f51-eee878fa1018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:56.665545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc0a6f46-da62-4ce0-851c-a583829aa990 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:56.666197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c4d40d06-bc6a-4ff7-8f51-eee878fa1018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:56.666333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc0a6f46-da62-4ce0-851c-a583829aa990 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:56.666629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc0a6f46-da62-4ce0-851c-a583829aa990 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:56.667266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c4d40d06-bc6a-4ff7-8f51-eee878fa1018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:56.932056 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bc0a6f46-da62-4ce0-851c-a583829aa990 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017" status: 200 len: 1617 microversion: 2.1 time: 0.286522 Oct 10 23:19:56.933718 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 413/838] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:56 2022] GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017 => generated 1617 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:57.071256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9dcdba60-c6f6-4f95-9c50-2d10762e683b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:57.072074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9dcdba60-c6f6-4f95-9c50-2d10762e683b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:57.086684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9dcdba60-c6f6-4f95-9c50-2d10762e683b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:57.088253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9dcdba60-c6f6-4f95-9c50-2d10762e683b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:57.089321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9dcdba60-c6f6-4f95-9c50-2d10762e683b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:57.090554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9dcdba60-c6f6-4f95-9c50-2d10762e683b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:57.091921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9dcdba60-c6f6-4f95-9c50-2d10762e683b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:57.092724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9dcdba60-c6f6-4f95-9c50-2d10762e683b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:57.124064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c4d40d06-bc6a-4ff7-8f51-eee878fa1018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:57.135424 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c4d40d06-bc6a-4ff7-8f51-eee878fa1018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1476 microversion: 2.1 time: 0.488572 Oct 10 23:19:57.136625 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 426/839] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:56 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1476 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:57.162210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-86b40c88-cb1d-4212-98ce-693b0916168d tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:57.162838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-86b40c88-cb1d-4212-98ce-693b0916168d tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 4521fa13-07d6-4f81-9a92-64b6862a3bd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:57.170905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86b40c88-cb1d-4212-98ce-693b0916168d tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:57.171416 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86b40c88-cb1d-4212-98ce-693b0916168d tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:57.171855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86b40c88-cb1d-4212-98ce-693b0916168d tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:57.172564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86b40c88-cb1d-4212-98ce-693b0916168d tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:57.173014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86b40c88-cb1d-4212-98ce-693b0916168d tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:57.173492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86b40c88-cb1d-4212-98ce-693b0916168d tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:57.200604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9dcdba60-c6f6-4f95-9c50-2d10762e683b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:57.215087 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9dcdba60-c6f6-4f95-9c50-2d10762e683b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71" status: 200 len: 1274 microversion: 2.1 time: 0.153387 Oct 10 23:19:57.215855 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 414/840] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:57 2022] GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71 => generated 1274 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:19:57.221763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-caf8e000-51ef-488b-b372-4468730fd219 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2036794575", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "90aa3419-44a6-4b0d-9af1-5f6df3554b71"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:57.295809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-caf8e000-51ef-488b-b372-4468730fd219 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] validate_networks() for None {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:19:57.534599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-86b40c88-cb1d-4212-98ce-693b0916168d tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:57.549969 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-86b40c88-cb1d-4212-98ce-693b0916168d tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3" status: 200 len: 1321 microversion: 2.1 time: 0.398066 Oct 10 23:19:57.550732 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 427/841] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:57 2022] GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3 => generated 1321 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:57.556801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3557a9f2-e8ee-4724-8c0c-28647ef86880 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:57.557853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3557a9f2-e8ee-4724-8c0c-28647ef86880 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:57.565067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3557a9f2-e8ee-4724-8c0c-28647ef86880 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:57.565598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3557a9f2-e8ee-4724-8c0c-28647ef86880 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:57.566219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3557a9f2-e8ee-4724-8c0c-28647ef86880 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:57.567219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3557a9f2-e8ee-4724-8c0c-28647ef86880 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:57.569041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3557a9f2-e8ee-4724-8c0c-28647ef86880 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:57.569720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3557a9f2-e8ee-4724-8c0c-28647ef86880 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:57.706864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3557a9f2-e8ee-4724-8c0c-28647ef86880 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:57.735063 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3557a9f2-e8ee-4724-8c0c-28647ef86880 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1292 microversion: 2.1 time: 0.183177 Oct 10 23:19:57.736096 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 428/842] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:57 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1292 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:57.750740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a5e66509-aaca-459e-a199-735ac38da968 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:57.751716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a5e66509-aaca-459e-a199-735ac38da968 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:57.759197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5e66509-aaca-459e-a199-735ac38da968 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:57.760151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5e66509-aaca-459e-a199-735ac38da968 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:57.760823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5e66509-aaca-459e-a199-735ac38da968 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:57.761778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5e66509-aaca-459e-a199-735ac38da968 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:57.762740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5e66509-aaca-459e-a199-735ac38da968 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:57.764070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5e66509-aaca-459e-a199-735ac38da968 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:58.123533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-caf8e000-51ef-488b-b372-4468730fd219 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:19:58.124139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-caf8e000-51ef-488b-b372-4468730fd219 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:19:58.124490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-caf8e000-51ef-488b-b372-4468730fd219 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:19:58.125102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-caf8e000-51ef-488b-b372-4468730fd219 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:19:58.125549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-caf8e000-51ef-488b-b372-4468730fd219 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:19:58.140468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-caf8e000-51ef-488b-b372-4468730fd219 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:58.141079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-caf8e000-51ef-488b-b372-4468730fd219 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:58.141910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-caf8e000-51ef-488b-b372-4468730fd219 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:58.142841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-caf8e000-51ef-488b-b372-4468730fd219 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:58.145340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-caf8e000-51ef-488b-b372-4468730fd219 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:58.146128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-caf8e000-51ef-488b-b372-4468730fd219 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:58.169990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-caf8e000-51ef-488b-b372-4468730fd219 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:19:58.180636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-caf8e000-51ef-488b-b372-4468730fd219 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Getting quotas for user 310196e1663a4f7ca12e1fc53b0278ba and project d98b12fc1bbf42d4b7376222c55733ed. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:19:58.190186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a5e66509-aaca-459e-a199-735ac38da968 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:58.196480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-caf8e000-51ef-488b-b372-4468730fd219 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:19:58.199616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-caf8e000-51ef-488b-b372-4468730fd219 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:19:58.208220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a5e66509-aaca-459e-a199-735ac38da968 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:58.209783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a5e66509-aaca-459e-a199-735ac38da968 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:58.211075 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a5e66509-aaca-459e-a199-735ac38da968 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1568 microversion: 2.25 time: 0.473649 Oct 10 23:19:58.225509 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 429/843] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:57 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1568 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:58.225509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7d5b1f78-12bd-47b6-b368-db0a99a3b5e6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:58.225509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7d5b1f78-12bd-47b6-b368-db0a99a3b5e6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:58.237214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d5b1f78-12bd-47b6-b368-db0a99a3b5e6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:58.237905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d5b1f78-12bd-47b6-b368-db0a99a3b5e6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:58.238364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d5b1f78-12bd-47b6-b368-db0a99a3b5e6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:58.239230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d5b1f78-12bd-47b6-b368-db0a99a3b5e6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:58.239683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d5b1f78-12bd-47b6-b368-db0a99a3b5e6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:58.241807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d5b1f78-12bd-47b6-b368-db0a99a3b5e6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:58.281317 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-caf8e000-51ef-488b-b372-4468730fd219 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.063641 Oct 10 23:19:58.282077 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 415/844] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:19:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:19:58.293728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d41c8d95-3f82-44d9-93cb-27cdbf9fdf72 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:58.295174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d41c8d95-3f82-44d9-93cb-27cdbf9fdf72 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:58.303998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:19:58.306283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d41c8d95-3f82-44d9-93cb-27cdbf9fdf72 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:58.306901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d41c8d95-3f82-44d9-93cb-27cdbf9fdf72 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:58.307546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d41c8d95-3f82-44d9-93cb-27cdbf9fdf72 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:58.308525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d41c8d95-3f82-44d9-93cb-27cdbf9fdf72 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:58.309248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d41c8d95-3f82-44d9-93cb-27cdbf9fdf72 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:58.310030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d41c8d95-3f82-44d9-93cb-27cdbf9fdf72 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:58.616723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7d5b1f78-12bd-47b6-b368-db0a99a3b5e6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:58.629062 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7d5b1f78-12bd-47b6-b368-db0a99a3b5e6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1476 microversion: 2.1 time: 0.415761 Oct 10 23:19:58.631133 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 430/845] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:58 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1476 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:58.636078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0f0b88d8-e62a-4ff7-8bb9-a99be82621a4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:58.636884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0f0b88d8-e62a-4ff7-8bb9-a99be82621a4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:58.699108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d41c8d95-3f82-44d9-93cb-27cdbf9fdf72 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:58.708301 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d41c8d95-3f82-44d9-93cb-27cdbf9fdf72 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71" status: 200 len: 1316 microversion: 2.1 time: 0.418590 Oct 10 23:19:58.712552 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 416/846] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:58 2022] GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71 => generated 1316 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:58.730031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-2903adce-3e2a-42c9-adf6-6571833c376b req-bd015803-c4ca-4991-b51a-7ac554aed4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8400778e-6c2d-4055-9799-5ec4e9ae0f1b", "name": "network-vif-plugged", "status": "completed", "tag": "1b892abb-8814-4a04-bc5f-0a3e26cdf3a3"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:58.755104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2903adce-3e2a-42c9-adf6-6571833c376b req-bd015803-c4ca-4991-b51a-7ac554aed4c0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:58.755919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2903adce-3e2a-42c9-adf6-6571833c376b req-bd015803-c4ca-4991-b51a-7ac554aed4c0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:58.756535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2903adce-3e2a-42c9-adf6-6571833c376b req-bd015803-c4ca-4991-b51a-7ac554aed4c0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:58.776360 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-2903adce-3e2a-42c9-adf6-6571833c376b req-bd015803-c4ca-4991-b51a-7ac554aed4c0 service nova] Creating event network-vif-plugged:1b892abb-8814-4a04-bc5f-0a3e26cdf3a3 for instance 8400778e-6c2d-4055-9799-5ec4e9ae0f1b on n-h1-860864-2 Oct 10 23:19:58.787833 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-2903adce-3e2a-42c9-adf6-6571833c376b req-bd015803-c4ca-4991-b51a-7ac554aed4c0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073593 Oct 10 23:19:58.788390 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 417/847] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:58.793521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d9bbb8b8-9fe5-400e-b5b1-65dbc11d003e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:58.794478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d9bbb8b8-9fe5-400e-b5b1-65dbc11d003e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 4521fa13-07d6-4f81-9a92-64b6862a3bd3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:58.815969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9bbb8b8-9fe5-400e-b5b1-65dbc11d003e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:58.816539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9bbb8b8-9fe5-400e-b5b1-65dbc11d003e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:58.821593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9bbb8b8-9fe5-400e-b5b1-65dbc11d003e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:58.822782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9bbb8b8-9fe5-400e-b5b1-65dbc11d003e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:58.823417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9bbb8b8-9fe5-400e-b5b1-65dbc11d003e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:58.824020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9bbb8b8-9fe5-400e-b5b1-65dbc11d003e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:59.113361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d9bbb8b8-9fe5-400e-b5b1-65dbc11d003e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:59.117047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0f0b88d8-e62a-4ff7-8bb9-a99be82621a4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:59.124226 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d9bbb8b8-9fe5-400e-b5b1-65dbc11d003e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3" status: 200 len: 1513 microversion: 2.1 time: 0.334534 Oct 10 23:19:59.125865 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 418/848] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:58 2022] GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3 => generated 1513 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:59.129866 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0f0b88d8-e62a-4ff7-8bb9-a99be82621a4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d" status: 200 len: 1217 microversion: 2.1 time: 0.497421 Oct 10 23:19:59.130444 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 431/849] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:58 2022] GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d => generated 1217 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:59.132303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-929b9518-da78-4f1a-983c-af579dd7f14e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:59.133131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-929b9518-da78-4f1a-983c-af579dd7f14e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:59.140505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-929b9518-da78-4f1a-983c-af579dd7f14e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:59.141725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-929b9518-da78-4f1a-983c-af579dd7f14e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:59.142379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-929b9518-da78-4f1a-983c-af579dd7f14e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:59.143324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-929b9518-da78-4f1a-983c-af579dd7f14e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:59.143977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-929b9518-da78-4f1a-983c-af579dd7f14e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:59.145852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-929b9518-da78-4f1a-983c-af579dd7f14e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:59.149263 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b4c2e7d1-32f6-419d-946b-2c34923d2173 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:59.149909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b4c2e7d1-32f6-419d-946b-2c34923d2173 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:59.159281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4c2e7d1-32f6-419d-946b-2c34923d2173 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:59.160296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4c2e7d1-32f6-419d-946b-2c34923d2173 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:59.160923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4c2e7d1-32f6-419d-946b-2c34923d2173 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:59.162800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4c2e7d1-32f6-419d-946b-2c34923d2173 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:59.163465 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4c2e7d1-32f6-419d-946b-2c34923d2173 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:59.163969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4c2e7d1-32f6-419d-946b-2c34923d2173 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:59.236644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-929b9518-da78-4f1a-983c-af579dd7f14e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:59.246714 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-929b9518-da78-4f1a-983c-af579dd7f14e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1292 microversion: 2.1 time: 0.118493 Oct 10 23:19:59.247940 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 419/850] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:59 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1292 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:19:59.253913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-990adf2a-462c-4003-8fd7-dd0173832036 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:59.254891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-990adf2a-462c-4003-8fd7-dd0173832036 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:59.261880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-990adf2a-462c-4003-8fd7-dd0173832036 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:59.263766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-990adf2a-462c-4003-8fd7-dd0173832036 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:59.273198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-990adf2a-462c-4003-8fd7-dd0173832036 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:59.274126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-990adf2a-462c-4003-8fd7-dd0173832036 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:59.274612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-990adf2a-462c-4003-8fd7-dd0173832036 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:59.275058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-990adf2a-462c-4003-8fd7-dd0173832036 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:59.529556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-990adf2a-462c-4003-8fd7-dd0173832036 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:59.546122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-990adf2a-462c-4003-8fd7-dd0173832036 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:59.547831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-990adf2a-462c-4003-8fd7-dd0173832036 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:59.549338 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-990adf2a-462c-4003-8fd7-dd0173832036 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1558 microversion: 2.25 time: 0.299713 Oct 10 23:19:59.558729 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 420/851] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:59 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1558 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:59.573341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-2ad2032b-cc1a-4c15-879f-7122ec35139d req-4ba58b09-7ea8-4325-b409-852056a2b979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26119603-9e9d-40bc-8b27-03e36c3c9f71", "tag": "06f29faa-7ff9-4ce5-8ccf-43416e2a4bf9"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:19:59.591562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2ad2032b-cc1a-4c15-879f-7122ec35139d req-4ba58b09-7ea8-4325-b409-852056a2b979 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:59.592157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2ad2032b-cc1a-4c15-879f-7122ec35139d req-4ba58b09-7ea8-4325-b409-852056a2b979 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:59.592967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2ad2032b-cc1a-4c15-879f-7122ec35139d req-4ba58b09-7ea8-4325-b409-852056a2b979 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:59.606081 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-2ad2032b-cc1a-4c15-879f-7122ec35139d req-4ba58b09-7ea8-4325-b409-852056a2b979 service nova] Creating event network-changed:06f29faa-7ff9-4ce5-8ccf-43416e2a4bf9 for instance 26119603-9e9d-40bc-8b27-03e36c3c9f71 on n-h1-860864-2 Oct 10 23:19:59.611849 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-2ad2032b-cc1a-4c15-879f-7122ec35139d req-4ba58b09-7ea8-4325-b409-852056a2b979 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052921 Oct 10 23:19:59.612555 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 421/852] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:19:59.617575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7d76cccb-9ae2-4634-996d-8b3da3a0939d tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Calling method '.version_select at 0x7f663029f160>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:59.621033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d76cccb-9ae2-4634-996d-8b3da3a0939d tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:59.621557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d76cccb-9ae2-4634-996d-8b3da3a0939d tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:59.621999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d76cccb-9ae2-4634-996d-8b3da3a0939d tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:59.631931 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7d76cccb-9ae2-4634-996d-8b3da3a0939d tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 2365 microversion: 2.25 time: 0.018141 Oct 10 23:19:59.632685 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 422/853] 10.222.0.23 () {60 vars in 1184 bytes} [Mon Oct 10 23:19:59 2022] GET /compute/v2.1/os-migrations => generated 2365 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:59.646568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b4c2e7d1-32f6-419d-946b-2c34923d2173 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:19:59.649603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-442075ed-3543-4634-b6f8-f0a31ce1ec9e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:59.650818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-442075ed-3543-4634-b6f8-f0a31ce1ec9e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:59.658195 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b4c2e7d1-32f6-419d-946b-2c34923d2173 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1321 microversion: 2.1 time: 0.512550 Oct 10 23:19:59.659396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-442075ed-3543-4634-b6f8-f0a31ce1ec9e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:59.659698 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 432/854] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:59 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1321 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:19:59.659806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-442075ed-3543-4634-b6f8-f0a31ce1ec9e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:59.660326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-442075ed-3543-4634-b6f8-f0a31ce1ec9e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:59.661181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-442075ed-3543-4634-b6f8-f0a31ce1ec9e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:59.661699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-442075ed-3543-4634-b6f8-f0a31ce1ec9e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:59.662260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-442075ed-3543-4634-b6f8-f0a31ce1ec9e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:59.666513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fe96f1cd-abaf-43d9-a979-44c79612acb0 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:59.667458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fe96f1cd-abaf-43d9-a979-44c79612acb0 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:59.674229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe96f1cd-abaf-43d9-a979-44c79612acb0 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:59.674973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe96f1cd-abaf-43d9-a979-44c79612acb0 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:59.675477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe96f1cd-abaf-43d9-a979-44c79612acb0 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:59.676238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe96f1cd-abaf-43d9-a979-44c79612acb0 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:59.676759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe96f1cd-abaf-43d9-a979-44c79612acb0 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:59.677245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe96f1cd-abaf-43d9-a979-44c79612acb0 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:59.820481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-442075ed-3543-4634-b6f8-f0a31ce1ec9e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lazy-loading 'services' on Instance uuid 1847e3cf-10bd-40d5-b668-d5a1c73fc189 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:19:59.886578 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-442075ed-3543-4634-b6f8-f0a31ce1ec9e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 2051 microversion: 2.25 time: 0.241922 Oct 10 23:19:59.887535 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 423/855] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:19:59 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 2051 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:19:59.918925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5e1f42f5-94f1-4726-b9b4-f85270a0f113 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:19:59.922888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5e1f42f5-94f1-4726-b9b4-f85270a0f113 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:19:59.936890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e1f42f5-94f1-4726-b9b4-f85270a0f113 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:59.937932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e1f42f5-94f1-4726-b9b4-f85270a0f113 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:59.939029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e1f42f5-94f1-4726-b9b4-f85270a0f113 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:19:59.941368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e1f42f5-94f1-4726-b9b4-f85270a0f113 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:19:59.943453 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e1f42f5-94f1-4726-b9b4-f85270a0f113 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:19:59.944140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e1f42f5-94f1-4726-b9b4-f85270a0f113 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:00.096317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fe96f1cd-abaf-43d9-a979-44c79612acb0 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:00.105675 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fe96f1cd-abaf-43d9-a979-44c79612acb0 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1476 microversion: 2.1 time: 0.442915 Oct 10 23:20:00.126407 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 433/856] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:59 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1476 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:00.136747 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4d54380f-c9f2-4ff2-b4a7-11bb2c937c61 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1636913477", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "de46cdec-ec5d-4348-b04f-dbf364a4ee52"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:00.165494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5e1f42f5-94f1-4726-b9b4-f85270a0f113 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:00.174349 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5e1f42f5-94f1-4726-b9b4-f85270a0f113 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71" status: 200 len: 1316 microversion: 2.1 time: 0.266506 Oct 10 23:20:00.174931 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 424/857] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:19:59 2022] GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71 => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:00.179679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-885dbec2-2592-4a90-8c4b-ff396ca2cb0e tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:00.180658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-885dbec2-2592-4a90-8c4b-ff396ca2cb0e tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:00.188473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-885dbec2-2592-4a90-8c4b-ff396ca2cb0e tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:00.189228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-885dbec2-2592-4a90-8c4b-ff396ca2cb0e tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:00.189911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-885dbec2-2592-4a90-8c4b-ff396ca2cb0e tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:00.190835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-885dbec2-2592-4a90-8c4b-ff396ca2cb0e tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:00.191507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-885dbec2-2592-4a90-8c4b-ff396ca2cb0e tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:00.192157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-885dbec2-2592-4a90-8c4b-ff396ca2cb0e tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:00.219645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-4d54380f-c9f2-4ff2-b4a7-11bb2c937c61 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] validate_networks() for [('de46cdec-ec5d-4348-b04f-dbf364a4ee52', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:20:00.306927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-885dbec2-2592-4a90-8c4b-ff396ca2cb0e tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:00.328243 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-885dbec2-2592-4a90-8c4b-ff396ca2cb0e tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d" status: 200 len: 1277 microversion: 2.1 time: 0.151365 Oct 10 23:20:00.329177 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 425/858] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:00 2022] GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d => generated 1277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:00.334669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d1d65de6-8919-4536-8899-a7248a8393d2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:00.335359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d1d65de6-8919-4536-8899-a7248a8393d2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:00.343271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1d65de6-8919-4536-8899-a7248a8393d2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:00.343994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1d65de6-8919-4536-8899-a7248a8393d2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:00.344615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1d65de6-8919-4536-8899-a7248a8393d2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:00.345729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1d65de6-8919-4536-8899-a7248a8393d2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:00.346365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1d65de6-8919-4536-8899-a7248a8393d2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:00.347013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1d65de6-8919-4536-8899-a7248a8393d2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:00.562407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d1d65de6-8919-4536-8899-a7248a8393d2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:00.571790 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d1d65de6-8919-4536-8899-a7248a8393d2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1359 microversion: 2.1 time: 0.241465 Oct 10 23:20:00.572479 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 426/859] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:00 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:00.685061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e010edc2-88b2-4ecf-9bca-62328366a032 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:00.686300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e010edc2-88b2-4ecf-9bca-62328366a032 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:00.696087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e010edc2-88b2-4ecf-9bca-62328366a032 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:00.696592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e010edc2-88b2-4ecf-9bca-62328366a032 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:00.697957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e010edc2-88b2-4ecf-9bca-62328366a032 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:00.699059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e010edc2-88b2-4ecf-9bca-62328366a032 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:00.699728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e010edc2-88b2-4ecf-9bca-62328366a032 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:00.700956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e010edc2-88b2-4ecf-9bca-62328366a032 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:00.939764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e010edc2-88b2-4ecf-9bca-62328366a032 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:00.951560 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e010edc2-88b2-4ecf-9bca-62328366a032 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1321 microversion: 2.1 time: 0.272453 Oct 10 23:20:00.967341 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 427/860] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:00 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:01.140237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b332d5dd-c49f-43df-8e38-24e9c6931252 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:01.141904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b332d5dd-c49f-43df-8e38-24e9c6931252 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:01.147862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b332d5dd-c49f-43df-8e38-24e9c6931252 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:01.148553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b332d5dd-c49f-43df-8e38-24e9c6931252 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:01.148989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b332d5dd-c49f-43df-8e38-24e9c6931252 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:01.149758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b332d5dd-c49f-43df-8e38-24e9c6931252 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:01.150217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b332d5dd-c49f-43df-8e38-24e9c6931252 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:01.150644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b332d5dd-c49f-43df-8e38-24e9c6931252 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:01.157045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:01.301408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b332d5dd-c49f-43df-8e38-24e9c6931252 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:01.311438 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b332d5dd-c49f-43df-8e38-24e9c6931252 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1476 microversion: 2.1 time: 0.175791 Oct 10 23:20:01.312255 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 428/861] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:01 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1476 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:01.334010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-baed11f4-0ef1-4c9e-ad65-8d985dfd4f77 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:01.334628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-baed11f4-0ef1-4c9e-ad65-8d985dfd4f77 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:01.341023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-baed11f4-0ef1-4c9e-ad65-8d985dfd4f77 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:01.342480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-baed11f4-0ef1-4c9e-ad65-8d985dfd4f77 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:01.343085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-baed11f4-0ef1-4c9e-ad65-8d985dfd4f77 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:01.344027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-baed11f4-0ef1-4c9e-ad65-8d985dfd4f77 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:01.344648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-baed11f4-0ef1-4c9e-ad65-8d985dfd4f77 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:01.346921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-baed11f4-0ef1-4c9e-ad65-8d985dfd4f77 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:01.492591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-baed11f4-0ef1-4c9e-ad65-8d985dfd4f77 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:01.500833 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-baed11f4-0ef1-4c9e-ad65-8d985dfd4f77 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71" status: 200 len: 1316 microversion: 2.1 time: 0.170600 Oct 10 23:20:01.501810 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 429/862] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:01 2022] GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71 => generated 1316 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:01.506125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2f21fa37-a9e6-4281-ab2a-77fea01d165d tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:01.507043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2f21fa37-a9e6-4281-ab2a-77fea01d165d tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:01.514691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f21fa37-a9e6-4281-ab2a-77fea01d165d tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:01.515385 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f21fa37-a9e6-4281-ab2a-77fea01d165d tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:01.515681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f21fa37-a9e6-4281-ab2a-77fea01d165d tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:01.516535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f21fa37-a9e6-4281-ab2a-77fea01d165d tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:01.517056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f21fa37-a9e6-4281-ab2a-77fea01d165d tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:01.517611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f21fa37-a9e6-4281-ab2a-77fea01d165d tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:01.581183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2f21fa37-a9e6-4281-ab2a-77fea01d165d tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:01.589163 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2f21fa37-a9e6-4281-ab2a-77fea01d165d tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d" status: 200 len: 1275 microversion: 2.1 time: 0.086731 Oct 10 23:20:01.589897 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 430/863] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:01 2022] GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d => generated 1275 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:01.595853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b51ddf88-3307-48dc-97d5-8b0ca23a5c07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:01.596596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b51ddf88-3307-48dc-97d5-8b0ca23a5c07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:01.602761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b51ddf88-3307-48dc-97d5-8b0ca23a5c07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:01.603284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b51ddf88-3307-48dc-97d5-8b0ca23a5c07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:01.604073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b51ddf88-3307-48dc-97d5-8b0ca23a5c07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:01.604613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b51ddf88-3307-48dc-97d5-8b0ca23a5c07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:01.605171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b51ddf88-3307-48dc-97d5-8b0ca23a5c07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:01.605714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b51ddf88-3307-48dc-97d5-8b0ca23a5c07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:01.617030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4d54380f-c9f2-4ff2-b4a7-11bb2c937c61 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:20:01.617549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4d54380f-c9f2-4ff2-b4a7-11bb2c937c61 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:20:01.618044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4d54380f-c9f2-4ff2-b4a7-11bb2c937c61 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:20:01.618453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4d54380f-c9f2-4ff2-b4a7-11bb2c937c61 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:20:01.618866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4d54380f-c9f2-4ff2-b4a7-11bb2c937c61 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:20:01.628700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=37 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:01.632164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d54380f-c9f2-4ff2-b4a7-11bb2c937c61 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:01.632688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d54380f-c9f2-4ff2-b4a7-11bb2c937c61 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:01.633530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d54380f-c9f2-4ff2-b4a7-11bb2c937c61 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:01.634525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d54380f-c9f2-4ff2-b4a7-11bb2c937c61 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:01.635159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d54380f-c9f2-4ff2-b4a7-11bb2c937c61 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:01.635788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d54380f-c9f2-4ff2-b4a7-11bb2c937c61 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:01.657409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-4d54380f-c9f2-4ff2-b4a7-11bb2c937c61 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Getting quotas for project 01ebbb0c057c44be8b51615d59209d90. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:20:01.662758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-4d54380f-c9f2-4ff2-b4a7-11bb2c937c61 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Getting quotas for user fabfd9ac67b645bf9234590b623c27b0 and project 01ebbb0c057c44be8b51615d59209d90. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:20:01.677430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4d54380f-c9f2-4ff2-b4a7-11bb2c937c61 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:20:01.680059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4d54380f-c9f2-4ff2-b4a7-11bb2c937c61 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:20:01.734210 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4d54380f-c9f2-4ff2-b4a7-11bb2c937c61 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.605877 Oct 10 23:20:01.735186 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 434/864] 10.222.0.23 () {62 vars in 1188 bytes} [Mon Oct 10 23:20:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1608 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 23:20:01.745919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c0a4c797-6da1-4979-ad71-442227ebd011 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:01.746929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c0a4c797-6da1-4979-ad71-442227ebd011 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:01.787596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b51ddf88-3307-48dc-97d5-8b0ca23a5c07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:01.797650 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b51ddf88-3307-48dc-97d5-8b0ca23a5c07 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1359 microversion: 2.1 time: 0.206532 Oct 10 23:20:01.843688 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 431/865] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:01 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1359 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:01.874515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c0a4c797-6da1-4979-ad71-442227ebd011 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:01.895514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c0a4c797-6da1-4979-ad71-442227ebd011 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:01.897681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c0a4c797-6da1-4979-ad71-442227ebd011 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:01.900321 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c0a4c797-6da1-4979-ad71-442227ebd011 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1262 microversion: 2.25 time: 0.157814 Oct 10 23:20:01.901329 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 435/866] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:01 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1262 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:20:01.976450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4a5e198d-d21e-4603-ad88-f73392ffd070 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:01.977095 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4a5e198d-d21e-4603-ad88-f73392ffd070 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:01.989629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a5e198d-d21e-4603-ad88-f73392ffd070 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:01.990140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a5e198d-d21e-4603-ad88-f73392ffd070 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:01.990900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a5e198d-d21e-4603-ad88-f73392ffd070 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:01.991500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a5e198d-d21e-4603-ad88-f73392ffd070 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:01.991965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a5e198d-d21e-4603-ad88-f73392ffd070 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:01.992418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a5e198d-d21e-4603-ad88-f73392ffd070 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:02.292225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4a5e198d-d21e-4603-ad88-f73392ffd070 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:02.303193 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4a5e198d-d21e-4603-ad88-f73392ffd070 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1321 microversion: 2.1 time: 0.330985 Oct 10 23:20:02.319581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-7de680ae-9845-400b-a4fa-cdb1859acec6 req-9b8f5a89-14dc-4fa3-8531-b6f0bcb1ab03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90cc20e4-bd05-44fc-931c-ddffba1494e6", "tag": "9cd0c0df-842e-4355-8798-be1d34e79325"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:02.321769 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 432/867] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:01 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:02.334452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7de680ae-9845-400b-a4fa-cdb1859acec6 req-9b8f5a89-14dc-4fa3-8531-b6f0bcb1ab03 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:02.335215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7de680ae-9845-400b-a4fa-cdb1859acec6 req-9b8f5a89-14dc-4fa3-8531-b6f0bcb1ab03 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:02.335918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7de680ae-9845-400b-a4fa-cdb1859acec6 req-9b8f5a89-14dc-4fa3-8531-b6f0bcb1ab03 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:02.336355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-196e58f2-5643-427e-b27e-4f1361c500f3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:02.337022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-196e58f2-5643-427e-b27e-4f1361c500f3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:02.348376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-196e58f2-5643-427e-b27e-4f1361c500f3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:02.351112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-196e58f2-5643-427e-b27e-4f1361c500f3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:02.351600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-196e58f2-5643-427e-b27e-4f1361c500f3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:02.352388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-196e58f2-5643-427e-b27e-4f1361c500f3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:02.352875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-196e58f2-5643-427e-b27e-4f1361c500f3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:02.353562 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-7de680ae-9845-400b-a4fa-cdb1859acec6 req-9b8f5a89-14dc-4fa3-8531-b6f0bcb1ab03 service nova] Creating event network-changed:9cd0c0df-842e-4355-8798-be1d34e79325 for instance 90cc20e4-bd05-44fc-931c-ddffba1494e6 on n-h2-860864-2 Oct 10 23:20:02.356993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-196e58f2-5643-427e-b27e-4f1361c500f3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:02.359571 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-7de680ae-9845-400b-a4fa-cdb1859acec6 req-9b8f5a89-14dc-4fa3-8531-b6f0bcb1ab03 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043286 Oct 10 23:20:02.360929 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 436/868] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:02.527478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fc911c82-d442-45dc-be1e-5975514f7f7a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:02.530052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fc911c82-d442-45dc-be1e-5975514f7f7a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:02.556752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc911c82-d442-45dc-be1e-5975514f7f7a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:02.557734 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc911c82-d442-45dc-be1e-5975514f7f7a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:02.561896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc911c82-d442-45dc-be1e-5975514f7f7a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:02.563687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc911c82-d442-45dc-be1e-5975514f7f7a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:02.568423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc911c82-d442-45dc-be1e-5975514f7f7a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:02.570715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc911c82-d442-45dc-be1e-5975514f7f7a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:02.766234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-196e58f2-5643-427e-b27e-4f1361c500f3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:02.783281 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-196e58f2-5643-427e-b27e-4f1361c500f3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1476 microversion: 2.1 time: 0.449885 Oct 10 23:20:02.798297 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 433/869] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:02 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1476 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:02.807409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2c89527b-4597-417e-94a6-bd14c952b9ef tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:02.809014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2c89527b-4597-417e-94a6-bd14c952b9ef tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:02.823994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c89527b-4597-417e-94a6-bd14c952b9ef tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:02.824721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c89527b-4597-417e-94a6-bd14c952b9ef tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:02.825948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c89527b-4597-417e-94a6-bd14c952b9ef tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:02.826840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c89527b-4597-417e-94a6-bd14c952b9ef tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:02.827463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c89527b-4597-417e-94a6-bd14c952b9ef tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:02.828070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c89527b-4597-417e-94a6-bd14c952b9ef tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:03.093540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fc911c82-d442-45dc-be1e-5975514f7f7a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:03.097973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2c89527b-4597-417e-94a6-bd14c952b9ef tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:03.113584 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2c89527b-4597-417e-94a6-bd14c952b9ef tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d" status: 200 len: 1317 microversion: 2.1 time: 0.313373 Oct 10 23:20:03.123961 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 434/870] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:02 2022] GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:03.126900 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fc911c82-d442-45dc-be1e-5975514f7f7a tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71" status: 200 len: 1316 microversion: 2.1 time: 0.604848 Oct 10 23:20:03.127912 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 437/871] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:02 2022] GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71 => generated 1316 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:03.137251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-afef0092-14fb-4479-aeb4-fedfbde2c8c2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:03.141083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-afef0092-14fb-4479-aeb4-fedfbde2c8c2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:03.141234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c881cbbc-5913-4297-b16f-ec54429f2411 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:03.141687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c881cbbc-5913-4297-b16f-ec54429f2411 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:03.151845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afef0092-14fb-4479-aeb4-fedfbde2c8c2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:03.154928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afef0092-14fb-4479-aeb4-fedfbde2c8c2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:03.156993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afef0092-14fb-4479-aeb4-fedfbde2c8c2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:03.157461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c881cbbc-5913-4297-b16f-ec54429f2411 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:03.157962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c881cbbc-5913-4297-b16f-ec54429f2411 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:03.158122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afef0092-14fb-4479-aeb4-fedfbde2c8c2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:03.158714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afef0092-14fb-4479-aeb4-fedfbde2c8c2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:03.159950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afef0092-14fb-4479-aeb4-fedfbde2c8c2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:03.160637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c881cbbc-5913-4297-b16f-ec54429f2411 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:03.163229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c881cbbc-5913-4297-b16f-ec54429f2411 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:03.163897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c881cbbc-5913-4297-b16f-ec54429f2411 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:03.165337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c881cbbc-5913-4297-b16f-ec54429f2411 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:03.207768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:03.543485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c881cbbc-5913-4297-b16f-ec54429f2411 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:03.554727 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c881cbbc-5913-4297-b16f-ec54429f2411 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1359 microversion: 2.1 time: 0.419290 Oct 10 23:20:03.570552 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 435/872] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:03 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1359 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:03.579007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-32fd6e79-6bc1-4e8c-838d-5c793978b52b tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:03.579750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-32fd6e79-6bc1-4e8c-838d-5c793978b52b tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:03.585893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32fd6e79-6bc1-4e8c-838d-5c793978b52b tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:03.586625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32fd6e79-6bc1-4e8c-838d-5c793978b52b tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:03.587065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32fd6e79-6bc1-4e8c-838d-5c793978b52b tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:03.587766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32fd6e79-6bc1-4e8c-838d-5c793978b52b tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:03.588411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32fd6e79-6bc1-4e8c-838d-5c793978b52b tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:03.588838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32fd6e79-6bc1-4e8c-838d-5c793978b52b tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:03.687642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-afef0092-14fb-4479-aeb4-fedfbde2c8c2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:03.706781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-afef0092-14fb-4479-aeb4-fedfbde2c8c2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:03.708084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-afef0092-14fb-4479-aeb4-fedfbde2c8c2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:03.709217 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-afef0092-14fb-4479-aeb4-fedfbde2c8c2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1314 microversion: 2.25 time: 0.579926 Oct 10 23:20:03.709816 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 438/873] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:03 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:03.812493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-471c3b65-2417-4b12-a1a0-3ef0f579726a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:03.813462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-471c3b65-2417-4b12-a1a0-3ef0f579726a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:03.820324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-471c3b65-2417-4b12-a1a0-3ef0f579726a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:03.820988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-471c3b65-2417-4b12-a1a0-3ef0f579726a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:03.821641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-471c3b65-2417-4b12-a1a0-3ef0f579726a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:03.822528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-471c3b65-2417-4b12-a1a0-3ef0f579726a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:03.823146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-471c3b65-2417-4b12-a1a0-3ef0f579726a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:03.823727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-471c3b65-2417-4b12-a1a0-3ef0f579726a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:03.994273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-32fd6e79-6bc1-4e8c-838d-5c793978b52b tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:04.016863 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-32fd6e79-6bc1-4e8c-838d-5c793978b52b tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1321 microversion: 2.1 time: 0.444701 Oct 10 23:20:04.018337 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 436/874] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:03 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1321 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:04.141473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-66be0f30-ab5a-4d15-80f0-507615fa6014 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:04.142387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-66be0f30-ab5a-4d15-80f0-507615fa6014 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:04.153515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66be0f30-ab5a-4d15-80f0-507615fa6014 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:04.156394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66be0f30-ab5a-4d15-80f0-507615fa6014 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:04.157342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66be0f30-ab5a-4d15-80f0-507615fa6014 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:04.158397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66be0f30-ab5a-4d15-80f0-507615fa6014 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:04.159035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66be0f30-ab5a-4d15-80f0-507615fa6014 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:04.159674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66be0f30-ab5a-4d15-80f0-507615fa6014 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:04.164439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-471c3b65-2417-4b12-a1a0-3ef0f579726a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:04.176479 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-471c3b65-2417-4b12-a1a0-3ef0f579726a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1476 microversion: 2.1 time: 0.368024 Oct 10 23:20:04.177593 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 439/875] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:03 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1476 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:04.199346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9e9c1126-0881-407e-8aab-ce16333abb57 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:04.201589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9e9c1126-0881-407e-8aab-ce16333abb57 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:04.213947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e9c1126-0881-407e-8aab-ce16333abb57 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:04.217302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e9c1126-0881-407e-8aab-ce16333abb57 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:04.218023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e9c1126-0881-407e-8aab-ce16333abb57 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:04.220096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e9c1126-0881-407e-8aab-ce16333abb57 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:04.220759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e9c1126-0881-407e-8aab-ce16333abb57 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:04.221366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e9c1126-0881-407e-8aab-ce16333abb57 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:04.463935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9e9c1126-0881-407e-8aab-ce16333abb57 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:04.477072 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9e9c1126-0881-407e-8aab-ce16333abb57 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71" status: 200 len: 1316 microversion: 2.1 time: 0.298211 Oct 10 23:20:04.477749 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 440/876] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:04 2022] GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71 => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:04.584107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ef38a21f-53da-4ce8-8103-8af0ea9e43e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:04.584809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ef38a21f-53da-4ce8-8103-8af0ea9e43e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:04.589838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-66be0f30-ab5a-4d15-80f0-507615fa6014 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:04.609551 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-66be0f30-ab5a-4d15-80f0-507615fa6014 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d" status: 200 len: 1317 microversion: 2.1 time: 0.475792 Oct 10 23:20:04.618071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef38a21f-53da-4ce8-8103-8af0ea9e43e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:04.618600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef38a21f-53da-4ce8-8103-8af0ea9e43e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:04.619050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef38a21f-53da-4ce8-8103-8af0ea9e43e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:04.619775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef38a21f-53da-4ce8-8103-8af0ea9e43e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:04.620232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef38a21f-53da-4ce8-8103-8af0ea9e43e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:04.620682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef38a21f-53da-4ce8-8103-8af0ea9e43e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:04.627200 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 437/877] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:04 2022] GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d => generated 1317 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:04.739126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6375ccec-f0e3-4412-be45-53b5cc8a04e6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:04.740120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6375ccec-f0e3-4412-be45-53b5cc8a04e6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:04.753001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6375ccec-f0e3-4412-be45-53b5cc8a04e6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:04.753651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6375ccec-f0e3-4412-be45-53b5cc8a04e6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:04.754451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6375ccec-f0e3-4412-be45-53b5cc8a04e6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:04.755283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6375ccec-f0e3-4412-be45-53b5cc8a04e6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:04.765200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6375ccec-f0e3-4412-be45-53b5cc8a04e6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:04.766054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6375ccec-f0e3-4412-be45-53b5cc8a04e6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:04.883451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ef38a21f-53da-4ce8-8103-8af0ea9e43e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:04.894138 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ef38a21f-53da-4ce8-8103-8af0ea9e43e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1359 microversion: 2.1 time: 0.314396 Oct 10 23:20:04.894946 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 441/878] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:04 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1359 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:04.920816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-9864d710-d818-4be9-a921-e3d7be1fa205 req-23f00fff-a78a-47f9-a66a-564f79da20ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8cb5a23-7b52-472b-b06e-1b830053c92d", "tag": "fab54877-ae0b-4495-b318-ffee867fcc69"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:04.932047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9864d710-d818-4be9-a921-e3d7be1fa205 req-23f00fff-a78a-47f9-a66a-564f79da20ee service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:04.932716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9864d710-d818-4be9-a921-e3d7be1fa205 req-23f00fff-a78a-47f9-a66a-564f79da20ee service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:04.933243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9864d710-d818-4be9-a921-e3d7be1fa205 req-23f00fff-a78a-47f9-a66a-564f79da20ee service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:04.947323 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-9864d710-d818-4be9-a921-e3d7be1fa205 req-23f00fff-a78a-47f9-a66a-564f79da20ee service nova] Creating event network-changed:fab54877-ae0b-4495-b318-ffee867fcc69 for instance e8cb5a23-7b52-472b-b06e-1b830053c92d on n-h2-860864-2 Oct 10 23:20:04.953830 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-9864d710-d818-4be9-a921-e3d7be1fa205 req-23f00fff-a78a-47f9-a66a-564f79da20ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046237 Oct 10 23:20:04.955326 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 442/879] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:05.047162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b7146a26-3eff-46f2-8036-ff5c18549fb4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:05.047963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b7146a26-3eff-46f2-8036-ff5c18549fb4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:05.054745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7146a26-3eff-46f2-8036-ff5c18549fb4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:05.055564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7146a26-3eff-46f2-8036-ff5c18549fb4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:05.056102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7146a26-3eff-46f2-8036-ff5c18549fb4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:05.056904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7146a26-3eff-46f2-8036-ff5c18549fb4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:05.057506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7146a26-3eff-46f2-8036-ff5c18549fb4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:05.058007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7146a26-3eff-46f2-8036-ff5c18549fb4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:05.117421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6375ccec-f0e3-4412-be45-53b5cc8a04e6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:05.127073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6375ccec-f0e3-4412-be45-53b5cc8a04e6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:05.128517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6375ccec-f0e3-4412-be45-53b5cc8a04e6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:05.129665 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6375ccec-f0e3-4412-be45-53b5cc8a04e6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1320 microversion: 2.25 time: 0.395272 Oct 10 23:20:05.130234 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 438/880] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:04 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1320 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:20:05.203594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-515a1cff-bb06-4c8c-a3dd-fc8452b1aee8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:05.205223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-515a1cff-bb06-4c8c-a3dd-fc8452b1aee8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:05.214400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b7146a26-3eff-46f2-8036-ff5c18549fb4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:05.222274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-515a1cff-bb06-4c8c-a3dd-fc8452b1aee8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:05.222771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-515a1cff-bb06-4c8c-a3dd-fc8452b1aee8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:05.225474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-515a1cff-bb06-4c8c-a3dd-fc8452b1aee8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:05.226205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-515a1cff-bb06-4c8c-a3dd-fc8452b1aee8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:05.226664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-515a1cff-bb06-4c8c-a3dd-fc8452b1aee8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:05.227083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-515a1cff-bb06-4c8c-a3dd-fc8452b1aee8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:05.230196 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b7146a26-3eff-46f2-8036-ff5c18549fb4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1512 microversion: 2.1 time: 0.189697 Oct 10 23:20:05.233675 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 443/881] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:05 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1512 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:05.254289 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-235706bf-8d43-42da-815c-5e59399c4807 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:05.254903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-235706bf-8d43-42da-815c-5e59399c4807 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:05.261471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-235706bf-8d43-42da-815c-5e59399c4807 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:05.261959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-235706bf-8d43-42da-815c-5e59399c4807 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:05.262593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-235706bf-8d43-42da-815c-5e59399c4807 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:05.263832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-235706bf-8d43-42da-815c-5e59399c4807 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:05.264562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-235706bf-8d43-42da-815c-5e59399c4807 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:05.264995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-235706bf-8d43-42da-815c-5e59399c4807 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:05.602296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-235706bf-8d43-42da-815c-5e59399c4807 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:05.611602 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-235706bf-8d43-42da-815c-5e59399c4807 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d" status: 200 len: 1513 microversion: 2.1 time: 0.361604 Oct 10 23:20:05.612504 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 444/882] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:05 2022] GET /compute/v2.1/servers/9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d => generated 1513 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:05.617873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0b7f69a4-9a70-4a6d-85e8-f9aae0d44b72 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:05.618753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0b7f69a4-9a70-4a6d-85e8-f9aae0d44b72 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:05.627318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b7f69a4-9a70-4a6d-85e8-f9aae0d44b72 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:05.627832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b7f69a4-9a70-4a6d-85e8-f9aae0d44b72 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:05.628267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b7f69a4-9a70-4a6d-85e8-f9aae0d44b72 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:05.629361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b7f69a4-9a70-4a6d-85e8-f9aae0d44b72 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:05.630091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b7f69a4-9a70-4a6d-85e8-f9aae0d44b72 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:05.630668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b7f69a4-9a70-4a6d-85e8-f9aae0d44b72 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:05.698169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-515a1cff-bb06-4c8c-a3dd-fc8452b1aee8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:05.709933 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-515a1cff-bb06-4c8c-a3dd-fc8452b1aee8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1476 microversion: 2.1 time: 0.513635 Oct 10 23:20:05.711407 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 439/883] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:05 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1476 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:05.727549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8cfd8e2c-ef07-4863-89b3-4b06971b1d2b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:05.728351 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8cfd8e2c-ef07-4863-89b3-4b06971b1d2b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:05.735577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8cfd8e2c-ef07-4863-89b3-4b06971b1d2b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:05.736138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8cfd8e2c-ef07-4863-89b3-4b06971b1d2b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:05.736648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8cfd8e2c-ef07-4863-89b3-4b06971b1d2b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:05.737463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8cfd8e2c-ef07-4863-89b3-4b06971b1d2b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:05.737986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8cfd8e2c-ef07-4863-89b3-4b06971b1d2b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:05.738498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8cfd8e2c-ef07-4863-89b3-4b06971b1d2b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:05.923686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0b7f69a4-9a70-4a6d-85e8-f9aae0d44b72 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:05.932896 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0b7f69a4-9a70-4a6d-85e8-f9aae0d44b72 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71" status: 200 len: 1316 microversion: 2.1 time: 0.318641 Oct 10 23:20:05.933734 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 445/884] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:05 2022] GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71 => generated 1316 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:05.953019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4d9d174c-ee30-4602-bcdf-4fb43089ec24 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:05.958377 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4d9d174c-ee30-4602-bcdf-4fb43089ec24 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:05.959701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4d9d174c-ee30-4602-bcdf-4fb43089ec24 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:20:05.972701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d9d174c-ee30-4602-bcdf-4fb43089ec24 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:05.973185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d9d174c-ee30-4602-bcdf-4fb43089ec24 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:05.973665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d9d174c-ee30-4602-bcdf-4fb43089ec24 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:05.974390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d9d174c-ee30-4602-bcdf-4fb43089ec24 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:05.974839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d9d174c-ee30-4602-bcdf-4fb43089ec24 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:05.975257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d9d174c-ee30-4602-bcdf-4fb43089ec24 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:06.082625 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.multi_cell_list [None req-4d9d174c-ee30-4602-bcdf-4fb43089ec24 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:20:06.185366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8cfd8e2c-ef07-4863-89b3-4b06971b1d2b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:06.194523 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8cfd8e2c-ef07-4863-89b3-4b06971b1d2b tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d" status: 200 len: 1317 microversion: 2.1 time: 0.481517 Oct 10 23:20:06.200483 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 440/885] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:05 2022] GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d => generated 1317 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:06.205177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4d9d174c-ee30-4602-bcdf-4fb43089ec24 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:06.209194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5ba5574f-bf49-49b1-a814-ebefb9cf039c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:06.218767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d9d174c-ee30-4602-bcdf-4fb43089ec24 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:06.220006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d9d174c-ee30-4602-bcdf-4fb43089ec24 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:06.220697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d9d174c-ee30-4602-bcdf-4fb43089ec24 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:06.220823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5ba5574f-bf49-49b1-a814-ebefb9cf039c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:06.227366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ba5574f-bf49-49b1-a814-ebefb9cf039c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:06.227875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ba5574f-bf49-49b1-a814-ebefb9cf039c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:06.228319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ba5574f-bf49-49b1-a814-ebefb9cf039c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:06.229039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ba5574f-bf49-49b1-a814-ebefb9cf039c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:06.229525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ba5574f-bf49-49b1-a814-ebefb9cf039c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:06.229962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ba5574f-bf49-49b1-a814-ebefb9cf039c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:06.488779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5ba5574f-bf49-49b1-a814-ebefb9cf039c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:06.504165 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5ba5574f-bf49-49b1-a814-ebefb9cf039c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1359 microversion: 2.1 time: 0.295939 Oct 10 23:20:06.505577 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 441/886] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:06 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1359 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:06.510808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b088a787-dc87-427d-8749-e421ba142ed3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:06.514335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b088a787-dc87-427d-8749-e421ba142ed3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:06.536656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b088a787-dc87-427d-8749-e421ba142ed3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:06.537155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b088a787-dc87-427d-8749-e421ba142ed3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:06.537628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b088a787-dc87-427d-8749-e421ba142ed3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:06.538602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b088a787-dc87-427d-8749-e421ba142ed3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:06.539266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b088a787-dc87-427d-8749-e421ba142ed3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:06.539872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b088a787-dc87-427d-8749-e421ba142ed3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:06.877644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b088a787-dc87-427d-8749-e421ba142ed3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:06.887625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b088a787-dc87-427d-8749-e421ba142ed3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:06.889862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b088a787-dc87-427d-8749-e421ba142ed3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:06.891314 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b088a787-dc87-427d-8749-e421ba142ed3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1362 microversion: 2.25 time: 0.384252 Oct 10 23:20:06.891996 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 442/887] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:06 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1362 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:06.898913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9179eaa0-6c41-42a4-87f7-72f67537c996 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:06.899948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9179eaa0-6c41-42a4-87f7-72f67537c996 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:06.908906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9179eaa0-6c41-42a4-87f7-72f67537c996 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:06.909792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9179eaa0-6c41-42a4-87f7-72f67537c996 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:06.910496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9179eaa0-6c41-42a4-87f7-72f67537c996 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:06.911510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9179eaa0-6c41-42a4-87f7-72f67537c996 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:06.912355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9179eaa0-6c41-42a4-87f7-72f67537c996 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:06.913134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9179eaa0-6c41-42a4-87f7-72f67537c996 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:06.920550 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4d9d174c-ee30-4602-bcdf-4fb43089ec24 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 0.985562 Oct 10 23:20:06.921158 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 446/888] 10.222.0.23 () {58 vars in 1167 bytes} [Mon Oct 10 23:20:05 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:06.950527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5eafbf5e-7628-44b0-ad8b-88e650a4ece1 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:06.956257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5eafbf5e-7628-44b0-ad8b-88e650a4ece1 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:06.958766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5eafbf5e-7628-44b0-ad8b-88e650a4ece1 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1834350388', 'deleted': False, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:20:06.966845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5eafbf5e-7628-44b0-ad8b-88e650a4ece1 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:06.968110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5eafbf5e-7628-44b0-ad8b-88e650a4ece1 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:06.968694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5eafbf5e-7628-44b0-ad8b-88e650a4ece1 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:06.969608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5eafbf5e-7628-44b0-ad8b-88e650a4ece1 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:06.970228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5eafbf5e-7628-44b0-ad8b-88e650a4ece1 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:06.971324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5eafbf5e-7628-44b0-ad8b-88e650a4ece1 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:07.076060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.multi_cell_list [None req-5eafbf5e-7628-44b0-ad8b-88e650a4ece1 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:20:07.106034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9179eaa0-6c41-42a4-87f7-72f67537c996 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:07.117880 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9179eaa0-6c41-42a4-87f7-72f67537c996 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1476 microversion: 2.1 time: 0.224706 Oct 10 23:20:07.118794 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 443/889] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:06 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1476 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:07.123413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-85102d93-3c67-4410-a40b-d95da7f32df6 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:07.134376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-85102d93-3c67-4410-a40b-d95da7f32df6 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:07.143284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85102d93-3c67-4410-a40b-d95da7f32df6 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:07.143771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85102d93-3c67-4410-a40b-d95da7f32df6 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:07.147397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85102d93-3c67-4410-a40b-d95da7f32df6 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:07.148316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85102d93-3c67-4410-a40b-d95da7f32df6 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:07.149363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85102d93-3c67-4410-a40b-d95da7f32df6 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:07.153353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85102d93-3c67-4410-a40b-d95da7f32df6 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:07.180821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5eafbf5e-7628-44b0-ad8b-88e650a4ece1 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:07.187913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5eafbf5e-7628-44b0-ad8b-88e650a4ece1 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:07.188806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5eafbf5e-7628-44b0-ad8b-88e650a4ece1 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:07.190203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5eafbf5e-7628-44b0-ad8b-88e650a4ece1 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:07.402907 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5eafbf5e-7628-44b0-ad8b-88e650a4ece1 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1834350388" status: 200 len: 1515 microversion: 2.1 time: 0.457869 Oct 10 23:20:07.405809 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 447/890] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 10 23:20:06 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1834350388 => generated 1515 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:07.411995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fa4577d1-068a-4ee3-9e14-75d2a24efff7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:07.412908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fa4577d1-068a-4ee3-9e14-75d2a24efff7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:07.425183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa4577d1-068a-4ee3-9e14-75d2a24efff7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:07.426061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa4577d1-068a-4ee3-9e14-75d2a24efff7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:07.428272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa4577d1-068a-4ee3-9e14-75d2a24efff7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:07.430811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa4577d1-068a-4ee3-9e14-75d2a24efff7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:07.432172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa4577d1-068a-4ee3-9e14-75d2a24efff7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:07.432833 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa4577d1-068a-4ee3-9e14-75d2a24efff7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:07.442044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-85102d93-3c67-4410-a40b-d95da7f32df6 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:07.445220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:07.461342 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-85102d93-3c67-4410-a40b-d95da7f32df6 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71" status: 200 len: 1316 microversion: 2.1 time: 0.341459 Oct 10 23:20:07.461959 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 444/891] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:07 2022] GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71 => generated 1316 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:07.468327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d380e384-676b-46c4-879a-a23965060c59 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:07.473479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d380e384-676b-46c4-879a-a23965060c59 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:07.485882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d380e384-676b-46c4-879a-a23965060c59 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00'} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:20:07.499053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d380e384-676b-46c4-879a-a23965060c59 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:07.499546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d380e384-676b-46c4-879a-a23965060c59 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:07.500274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d380e384-676b-46c4-879a-a23965060c59 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:07.503489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d380e384-676b-46c4-879a-a23965060c59 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:07.506977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d380e384-676b-46c4-879a-a23965060c59 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:07.510229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d380e384-676b-46c4-879a-a23965060c59 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:07.666783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.multi_cell_list [None req-d380e384-676b-46c4-879a-a23965060c59 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120613) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:20:07.700471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fa4577d1-068a-4ee3-9e14-75d2a24efff7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:07.712703 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fa4577d1-068a-4ee3-9e14-75d2a24efff7 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d" status: 200 len: 1317 microversion: 2.1 time: 0.303240 Oct 10 23:20:07.721593 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 448/892] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:07 2022] GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:07.729311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bb002194-bf41-4a80-94d3-a9bf6aa6522a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:07.730011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bb002194-bf41-4a80-94d3-a9bf6aa6522a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:07.732578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:07.743763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb002194-bf41-4a80-94d3-a9bf6aa6522a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:07.744407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb002194-bf41-4a80-94d3-a9bf6aa6522a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:07.745352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb002194-bf41-4a80-94d3-a9bf6aa6522a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:07.746111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb002194-bf41-4a80-94d3-a9bf6aa6522a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:07.746623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb002194-bf41-4a80-94d3-a9bf6aa6522a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:07.747055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb002194-bf41-4a80-94d3-a9bf6aa6522a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:07.783023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d380e384-676b-46c4-879a-a23965060c59 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:07.798430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d380e384-676b-46c4-879a-a23965060c59 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:07.799211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d380e384-676b-46c4-879a-a23965060c59 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:07.799984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d380e384-676b-46c4-879a-a23965060c59 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:08.019838 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d380e384-676b-46c4-879a-a23965060c59 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4521 microversion: 2.1 time: 0.556576 Oct 10 23:20:08.021022 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 445/893] 10.222.0.23 () {58 vars in 1173 bytes} [Mon Oct 10 23:20:07 2022] GET /compute/v2.1/servers/detail?status=active => generated 4521 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:08.025915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-6eb45ff7-0909-47ca-9d6d-4a8482ab5ade req-ee7a61ae-d6fe-460f-a075-8efbf99a8e01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3bb20a8-8b13-470d-ac2b-50b7a7bea206", "tag": "cf309634-58e1-4dda-a8ad-e94e39638eb7"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:08.038449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6eb45ff7-0909-47ca-9d6d-4a8482ab5ade req-ee7a61ae-d6fe-460f-a075-8efbf99a8e01 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:08.039481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6eb45ff7-0909-47ca-9d6d-4a8482ab5ade req-ee7a61ae-d6fe-460f-a075-8efbf99a8e01 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:08.040072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6eb45ff7-0909-47ca-9d6d-4a8482ab5ade req-ee7a61ae-d6fe-460f-a075-8efbf99a8e01 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:08.056420 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-6eb45ff7-0909-47ca-9d6d-4a8482ab5ade req-ee7a61ae-d6fe-460f-a075-8efbf99a8e01 service nova] Creating event network-changed:cf309634-58e1-4dda-a8ad-e94e39638eb7 for instance c3bb20a8-8b13-470d-ac2b-50b7a7bea206 on n-h2-860864-2 Oct 10 23:20:08.062549 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-6eb45ff7-0909-47ca-9d6d-4a8482ab5ade req-ee7a61ae-d6fe-460f-a075-8efbf99a8e01 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039649 Oct 10 23:20:08.063419 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 446/894] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:08.070662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3e98b824-f279-4ac4-ae9c-11f1165ca50a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:08.072415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3e98b824-f279-4ac4-ae9c-11f1165ca50a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:08.079658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb002194-bf41-4a80-94d3-a9bf6aa6522a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:08.080726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e98b824-f279-4ac4-ae9c-11f1165ca50a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:08.083209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e98b824-f279-4ac4-ae9c-11f1165ca50a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:08.083855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e98b824-f279-4ac4-ae9c-11f1165ca50a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:08.085151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e98b824-f279-4ac4-ae9c-11f1165ca50a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:08.094147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e98b824-f279-4ac4-ae9c-11f1165ca50a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:08.094833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e98b824-f279-4ac4-ae9c-11f1165ca50a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:08.099247 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bb002194-bf41-4a80-94d3-a9bf6aa6522a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1359 microversion: 2.1 time: 0.376098 Oct 10 23:20:08.100487 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 449/895] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:07 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1359 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:08.108152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-582c3d5e-8c41-44bb-a818-277760d35430 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:08.119360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-582c3d5e-8c41-44bb-a818-277760d35430 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:08.120464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.compute.servers [None req-582c3d5e-8c41-44bb-a818-277760d35430 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Removing options 'limit' from query {{(pid=120614) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 10 23:20:08.121463 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-582c3d5e-8c41-44bb-a818-277760d35430 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Searching by: {'deleted': False, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:20:08.127582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-582c3d5e-8c41-44bb-a818-277760d35430 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:08.128341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-582c3d5e-8c41-44bb-a818-277760d35430 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:08.129236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-582c3d5e-8c41-44bb-a818-277760d35430 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:08.130685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-582c3d5e-8c41-44bb-a818-277760d35430 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:08.131887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-582c3d5e-8c41-44bb-a818-277760d35430 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:08.133214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-582c3d5e-8c41-44bb-a818-277760d35430 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:08.362613 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-582c3d5e-8c41-44bb-a818-277760d35430 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:08.388289 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-582c3d5e-8c41-44bb-a818-277760d35430 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:08.389010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-582c3d5e-8c41-44bb-a818-277760d35430 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:08.389644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-582c3d5e-8c41-44bb-a818-277760d35430 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:08.417969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3e98b824-f279-4ac4-ae9c-11f1165ca50a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:08.427630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3e98b824-f279-4ac4-ae9c-11f1165ca50a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:08.429087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3e98b824-f279-4ac4-ae9c-11f1165ca50a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:08.441935 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3e98b824-f279-4ac4-ae9c-11f1165ca50a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1362 microversion: 2.25 time: 0.369951 Oct 10 23:20:08.455749 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 447/896] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:08 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1362 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:08.455749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d688c760-0cc9-48e6-a693-0fb4ae9e53dc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:08.455749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d688c760-0cc9-48e6-a693-0fb4ae9e53dc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:08.466705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d688c760-0cc9-48e6-a693-0fb4ae9e53dc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:08.467227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d688c760-0cc9-48e6-a693-0fb4ae9e53dc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:08.467670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d688c760-0cc9-48e6-a693-0fb4ae9e53dc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:08.468394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d688c760-0cc9-48e6-a693-0fb4ae9e53dc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:08.468850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d688c760-0cc9-48e6-a693-0fb4ae9e53dc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:08.469279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d688c760-0cc9-48e6-a693-0fb4ae9e53dc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:08.770369 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-582c3d5e-8c41-44bb-a818-277760d35430 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 0.665514 Oct 10 23:20:08.778365 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 450/897] 10.222.0.23 () {58 vars in 1161 bytes} [Mon Oct 10 23:20:08 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:08.783424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-86e67c88-3d90-4a1b-bd83-1f57f624e8fa tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:08.784324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-86e67c88-3d90-4a1b-bd83-1f57f624e8fa tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:08.797128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86e67c88-3d90-4a1b-bd83-1f57f624e8fa tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:08.797648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86e67c88-3d90-4a1b-bd83-1f57f624e8fa tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:08.800001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86e67c88-3d90-4a1b-bd83-1f57f624e8fa tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:08.800679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86e67c88-3d90-4a1b-bd83-1f57f624e8fa tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:08.802386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86e67c88-3d90-4a1b-bd83-1f57f624e8fa tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:08.803731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86e67c88-3d90-4a1b-bd83-1f57f624e8fa tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:08.807220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d688c760-0cc9-48e6-a693-0fb4ae9e53dc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:08.823591 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d688c760-0cc9-48e6-a693-0fb4ae9e53dc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1476 microversion: 2.1 time: 0.378256 Oct 10 23:20:08.824245 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 448/898] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:08 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1476 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:08.866823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9ea54a7f-4686-4313-ab84-c9f44f5d43aa tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:08.870149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9ea54a7f-4686-4313-ab84-c9f44f5d43aa tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:08.885163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ea54a7f-4686-4313-ab84-c9f44f5d43aa tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:08.886498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ea54a7f-4686-4313-ab84-c9f44f5d43aa tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:08.889735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ea54a7f-4686-4313-ab84-c9f44f5d43aa tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:08.890826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ea54a7f-4686-4313-ab84-c9f44f5d43aa tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:08.891462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ea54a7f-4686-4313-ab84-c9f44f5d43aa tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:08.892054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ea54a7f-4686-4313-ab84-c9f44f5d43aa tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:09.264296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9ea54a7f-4686-4313-ab84-c9f44f5d43aa tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:09.277522 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9ea54a7f-4686-4313-ab84-c9f44f5d43aa tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d" status: 200 len: 1317 microversion: 2.1 time: 0.420606 Oct 10 23:20:09.279586 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 449/899] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:08 2022] GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d => generated 1317 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:09.284969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cc5f3f5d-b25b-4e8e-9c72-d900c56c886c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:09.290596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cc5f3f5d-b25b-4e8e-9c72-d900c56c886c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:09.291667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cc5f3f5d-b25b-4e8e-9c72-d900c56c886c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00'} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:20:09.298160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc5f3f5d-b25b-4e8e-9c72-d900c56c886c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:09.298914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc5f3f5d-b25b-4e8e-9c72-d900c56c886c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:09.299526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc5f3f5d-b25b-4e8e-9c72-d900c56c886c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:09.300848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc5f3f5d-b25b-4e8e-9c72-d900c56c886c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:09.301537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc5f3f5d-b25b-4e8e-9c72-d900c56c886c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:09.302155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc5f3f5d-b25b-4e8e-9c72-d900c56c886c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:09.414253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.multi_cell_list [None req-cc5f3f5d-b25b-4e8e-9c72-d900c56c886c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120613) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:20:09.484801 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cc5f3f5d-b25b-4e8e-9c72-d900c56c886c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.203775 Oct 10 23:20:09.485652 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 450/900] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:20:09 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:09.499181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a36be65e-f881-4e3c-ad0e-9f026c851c32 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:09.499804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a36be65e-f881-4e3c-ad0e-9f026c851c32 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:09.508933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a36be65e-f881-4e3c-ad0e-9f026c851c32 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:09.508933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a36be65e-f881-4e3c-ad0e-9f026c851c32 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:09.508933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a36be65e-f881-4e3c-ad0e-9f026c851c32 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:09.509349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a36be65e-f881-4e3c-ad0e-9f026c851c32 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:09.509659 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a36be65e-f881-4e3c-ad0e-9f026c851c32 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:09.510094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a36be65e-f881-4e3c-ad0e-9f026c851c32 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:09.585014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-86e67c88-3d90-4a1b-bd83-1f57f624e8fa tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:09.593282 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-86e67c88-3d90-4a1b-bd83-1f57f624e8fa tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71" status: 200 len: 1316 microversion: 2.1 time: 0.813984 Oct 10 23:20:09.594138 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 451/901] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:08 2022] GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71 => generated 1316 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:09.598809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a2b2795f-df67-4b96-8c6b-3fc0b0a7e100 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:09.599418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a2b2795f-df67-4b96-8c6b-3fc0b0a7e100 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:09.611261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2b2795f-df67-4b96-8c6b-3fc0b0a7e100 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:09.611864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2b2795f-df67-4b96-8c6b-3fc0b0a7e100 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:09.612307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2b2795f-df67-4b96-8c6b-3fc0b0a7e100 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:09.613015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2b2795f-df67-4b96-8c6b-3fc0b0a7e100 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:09.613516 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2b2795f-df67-4b96-8c6b-3fc0b0a7e100 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:09.613941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2b2795f-df67-4b96-8c6b-3fc0b0a7e100 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:09.683564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a36be65e-f881-4e3c-ad0e-9f026c851c32 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:09.692617 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a36be65e-f881-4e3c-ad0e-9f026c851c32 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1359 microversion: 2.1 time: 0.201270 Oct 10 23:20:09.699742 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 451/902] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:09 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:09.699742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d05cbe78-f144-49a7-8b49-7bfde4a21ec2 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:09.705427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d05cbe78-f144-49a7-8b49-7bfde4a21ec2 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:09.705427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.compute.servers [None req-d05cbe78-f144-49a7-8b49-7bfde4a21ec2 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Removing options 'limit' from query {{(pid=120613) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 10 23:20:09.705427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d05cbe78-f144-49a7-8b49-7bfde4a21ec2 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Searching by: {'deleted': False, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00'} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:20:09.713974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d05cbe78-f144-49a7-8b49-7bfde4a21ec2 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:09.714462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d05cbe78-f144-49a7-8b49-7bfde4a21ec2 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:09.714922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d05cbe78-f144-49a7-8b49-7bfde4a21ec2 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:09.715681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d05cbe78-f144-49a7-8b49-7bfde4a21ec2 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:09.717236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d05cbe78-f144-49a7-8b49-7bfde4a21ec2 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:09.717236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d05cbe78-f144-49a7-8b49-7bfde4a21ec2 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:09.745179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.multi_cell_list [None req-d05cbe78-f144-49a7-8b49-7bfde4a21ec2 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120613) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:20:09.782357 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d05cbe78-f144-49a7-8b49-7bfde4a21ec2 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.087628 Oct 10 23:20:09.782956 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 452/903] 10.222.0.23 () {58 vars in 1150 bytes} [Mon Oct 10 23:20:09 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:09.795092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8616902c-8b3f-4ce6-b941-77c9143e2ce7 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:09.799782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8616902c-8b3f-4ce6-b941-77c9143e2ce7 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:09.800449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8616902c-8b3f-4ce6-b941-77c9143e2ce7 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Searching by: {'deleted': False, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00'} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:20:09.805753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8616902c-8b3f-4ce6-b941-77c9143e2ce7 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:09.806241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8616902c-8b3f-4ce6-b941-77c9143e2ce7 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:09.806682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8616902c-8b3f-4ce6-b941-77c9143e2ce7 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:09.807414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8616902c-8b3f-4ce6-b941-77c9143e2ce7 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:09.807868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8616902c-8b3f-4ce6-b941-77c9143e2ce7 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:09.808295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8616902c-8b3f-4ce6-b941-77c9143e2ce7 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:09.837133 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a2b2795f-df67-4b96-8c6b-3fc0b0a7e100 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:09.842859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.multi_cell_list [None req-8616902c-8b3f-4ce6-b941-77c9143e2ce7 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120613) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:20:09.847547 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a2b2795f-df67-4b96-8c6b-3fc0b0a7e100 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:09.849532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a2b2795f-df67-4b96-8c6b-3fc0b0a7e100 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:09.850986 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a2b2795f-df67-4b96-8c6b-3fc0b0a7e100 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1362 microversion: 2.25 time: 0.255682 Oct 10 23:20:09.851761 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 452/904] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:09 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:09.856353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-246a416a-30e5-4128-96fb-89a815b3d8ea tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:09.857096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-246a416a-30e5-4128-96fb-89a815b3d8ea tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:09.863900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-246a416a-30e5-4128-96fb-89a815b3d8ea tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:09.864410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-246a416a-30e5-4128-96fb-89a815b3d8ea tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:09.864848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-246a416a-30e5-4128-96fb-89a815b3d8ea tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:09.865760 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-246a416a-30e5-4128-96fb-89a815b3d8ea tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:09.866221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-246a416a-30e5-4128-96fb-89a815b3d8ea tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:09.866647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-246a416a-30e5-4128-96fb-89a815b3d8ea tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:09.890819 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8616902c-8b3f-4ce6-b941-77c9143e2ce7 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.099938 Oct 10 23:20:09.892243 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 453/905] 10.222.0.23 () {58 vars in 1125 bytes} [Mon Oct 10 23:20:09 2022] GET /compute/v2.1/servers => generated 1012 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:09.913770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-edee7f90-e2b7-4af2-905b-a5617bf41158 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:09.919387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-edee7f90-e2b7-4af2-905b-a5617bf41158 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:09.920383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-edee7f90-e2b7-4af2-905b-a5617bf41158 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00'} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:20:09.933890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-edee7f90-e2b7-4af2-905b-a5617bf41158 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:09.936235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-edee7f90-e2b7-4af2-905b-a5617bf41158 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:09.936235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-edee7f90-e2b7-4af2-905b-a5617bf41158 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:09.936704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-edee7f90-e2b7-4af2-905b-a5617bf41158 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:09.937297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-edee7f90-e2b7-4af2-905b-a5617bf41158 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:09.937818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-edee7f90-e2b7-4af2-905b-a5617bf41158 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:10.008295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-246a416a-30e5-4128-96fb-89a815b3d8ea tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:10.018112 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-246a416a-30e5-4128-96fb-89a815b3d8ea tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1476 microversion: 2.1 time: 0.165446 Oct 10 23:20:10.018894 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 453/906] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:09 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1476 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:10.026981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.multi_cell_list [None req-edee7f90-e2b7-4af2-905b-a5617bf41158 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120613) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:20:10.088537 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-edee7f90-e2b7-4af2-905b-a5617bf41158 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.184729 Oct 10 23:20:10.089136 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 454/907] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:20:09 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:10.102318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cc3453c1-95b8-4d23-8ddf-b79eeeaf0707 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:10.107589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cc3453c1-95b8-4d23-8ddf-b79eeeaf0707 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:10.108330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.compute.servers [None req-cc3453c1-95b8-4d23-8ddf-b79eeeaf0707 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Removing options 'limit' from query {{(pid=120613) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 10 23:20:10.108953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cc3453c1-95b8-4d23-8ddf-b79eeeaf0707 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Searching by: {'deleted': False, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00'} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:20:10.114315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc3453c1-95b8-4d23-8ddf-b79eeeaf0707 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:10.114795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc3453c1-95b8-4d23-8ddf-b79eeeaf0707 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:10.115361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc3453c1-95b8-4d23-8ddf-b79eeeaf0707 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:10.115942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc3453c1-95b8-4d23-8ddf-b79eeeaf0707 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:10.117644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc3453c1-95b8-4d23-8ddf-b79eeeaf0707 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:10.117644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc3453c1-95b8-4d23-8ddf-b79eeeaf0707 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:10.142104 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cc3453c1-95b8-4d23-8ddf-b79eeeaf0707 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.043636 Oct 10 23:20:10.142925 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 455/908] 10.222.0.23 () {58 vars in 1140 bytes} [Mon Oct 10 23:20:10 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:10.155804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c045b4a3-8b5e-4215-ac72-05f0ec262d72 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:10.161066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c045b4a3-8b5e-4215-ac72-05f0ec262d72 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:10.161601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c045b4a3-8b5e-4215-ac72-05f0ec262d72 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1834350388', 'deleted': False, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00'} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:20:10.166738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c045b4a3-8b5e-4215-ac72-05f0ec262d72 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:10.167705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c045b4a3-8b5e-4215-ac72-05f0ec262d72 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:10.167705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c045b4a3-8b5e-4215-ac72-05f0ec262d72 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:10.167914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ba29796e-b6ec-4c4f-a8c4-e9e692f53ff0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1298564236", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "977b51bf-61b3-40d4-8e03-83e6ca7ae239"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:10.168346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c045b4a3-8b5e-4215-ac72-05f0ec262d72 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:10.168794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c045b4a3-8b5e-4215-ac72-05f0ec262d72 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:10.169888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c045b4a3-8b5e-4215-ac72-05f0ec262d72 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:10.228537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-ba29796e-b6ec-4c4f-a8c4-e9e692f53ff0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] validate_networks() for [('977b51bf-61b3-40d4-8e03-83e6ca7ae239', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:20:10.258496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.multi_cell_list [None req-c045b4a3-8b5e-4215-ac72-05f0ec262d72 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120613) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:20:10.337595 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c045b4a3-8b5e-4215-ac72-05f0ec262d72 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1834350388" status: 200 len: 346 microversion: 2.1 time: 0.185812 Oct 10 23:20:10.341613 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 456/909] 10.222.0.23 () {58 vars in 1242 bytes} [Mon Oct 10 23:20:10 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1834350388 => generated 346 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:20:10.349172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-99ec9eb6-cf02-4ffe-a1ec-e0e621f0c49c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:10.350473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-99ec9eb6-cf02-4ffe-a1ec-e0e621f0c49c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:10.359247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99ec9eb6-cf02-4ffe-a1ec-e0e621f0c49c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:10.359930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99ec9eb6-cf02-4ffe-a1ec-e0e621f0c49c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:10.360376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99ec9eb6-cf02-4ffe-a1ec-e0e621f0c49c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:10.361086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99ec9eb6-cf02-4ffe-a1ec-e0e621f0c49c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:10.361610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99ec9eb6-cf02-4ffe-a1ec-e0e621f0c49c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:10.362041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99ec9eb6-cf02-4ffe-a1ec-e0e621f0c49c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:10.521853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-99ec9eb6-cf02-4ffe-a1ec-e0e621f0c49c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:10.534254 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-99ec9eb6-cf02-4ffe-a1ec-e0e621f0c49c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d" status: 200 len: 1317 microversion: 2.1 time: 0.191233 Oct 10 23:20:10.548697 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 457/910] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:10 2022] GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:10.548697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6217fdf1-31e6-4af8-a93f-794271de03c0 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:10.550873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6217fdf1-31e6-4af8-a93f-794271de03c0 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:10.553075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6217fdf1-31e6-4af8-a93f-794271de03c0 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:10.553075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6217fdf1-31e6-4af8-a93f-794271de03c0 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:10.629107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6217fdf1-31e6-4af8-a93f-794271de03c0 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Going to try to stop instance {{(pid=120613) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 23:20:10.675545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ba29796e-b6ec-4c4f-a8c4-e9e692f53ff0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:20:10.676401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ba29796e-b6ec-4c4f-a8c4-e9e692f53ff0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:20:10.676882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ba29796e-b6ec-4c4f-a8c4-e9e692f53ff0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:20:10.677647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ba29796e-b6ec-4c4f-a8c4-e9e692f53ff0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:20:10.678063 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ba29796e-b6ec-4c4f-a8c4-e9e692f53ff0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:20:10.689054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba29796e-b6ec-4c4f-a8c4-e9e692f53ff0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:10.689686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba29796e-b6ec-4c4f-a8c4-e9e692f53ff0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:10.690120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba29796e-b6ec-4c4f-a8c4-e9e692f53ff0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:10.690231 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6217fdf1-31e6-4af8-a93f-794271de03c0 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "POST /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b/action" status: 202 len: 0 microversion: 2.1 time: 0.153834 Oct 10 23:20:10.691174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba29796e-b6ec-4c4f-a8c4-e9e692f53ff0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:10.691305 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 458/911] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:20:10 2022] POST /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:20:10.694352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba29796e-b6ec-4c4f-a8c4-e9e692f53ff0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:10.694798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba29796e-b6ec-4c4f-a8c4-e9e692f53ff0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:10.697734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7998f8bb-390f-47d1-8477-0fda5770d605 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:10.698553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7998f8bb-390f-47d1-8477-0fda5770d605 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:10.710856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7998f8bb-390f-47d1-8477-0fda5770d605 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:10.713552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7998f8bb-390f-47d1-8477-0fda5770d605 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:10.713699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7998f8bb-390f-47d1-8477-0fda5770d605 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:10.715742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7998f8bb-390f-47d1-8477-0fda5770d605 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:10.717219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7998f8bb-390f-47d1-8477-0fda5770d605 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:10.717781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7998f8bb-390f-47d1-8477-0fda5770d605 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:10.723403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ba29796e-b6ec-4c4f-a8c4-e9e692f53ff0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Getting quotas for project 2054001d7ed142698beaf51dcb6bd496. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:20:10.728956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ba29796e-b6ec-4c4f-a8c4-e9e692f53ff0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Getting quotas for user 504f553ef2324ac19370a181cf4c3629 and project 2054001d7ed142698beaf51dcb6bd496. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:20:10.736995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:10.743243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ba29796e-b6ec-4c4f-a8c4-e9e692f53ff0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:20:10.745574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ba29796e-b6ec-4c4f-a8c4-e9e692f53ff0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:20:10.808848 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ba29796e-b6ec-4c4f-a8c4-e9e692f53ff0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.779556 Oct 10 23:20:10.816928 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 454/912] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:20:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:20:10.830527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-671f2db3-11c1-4960-b5d0-fdbe10dcaacc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:10.831147 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-671f2db3-11c1-4960-b5d0-fdbe10dcaacc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:10.843849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-671f2db3-11c1-4960-b5d0-fdbe10dcaacc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:10.844465 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-671f2db3-11c1-4960-b5d0-fdbe10dcaacc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:10.844783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-671f2db3-11c1-4960-b5d0-fdbe10dcaacc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:10.845530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-671f2db3-11c1-4960-b5d0-fdbe10dcaacc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:10.846022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-671f2db3-11c1-4960-b5d0-fdbe10dcaacc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:10.846451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-671f2db3-11c1-4960-b5d0-fdbe10dcaacc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:10.873596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:10.907284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7998f8bb-390f-47d1-8477-0fda5770d605 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:10.916142 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7998f8bb-390f-47d1-8477-0fda5770d605 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71" status: 200 len: 1316 microversion: 2.1 time: 0.223730 Oct 10 23:20:10.922279 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 459/913] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:10 2022] GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71 => generated 1316 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:10.933774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4aed3da8-30f1-42e7-b3d1-6ccfca9e6e41 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:10.934751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4aed3da8-30f1-42e7-b3d1-6ccfca9e6e41 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:10.942214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4aed3da8-30f1-42e7-b3d1-6ccfca9e6e41 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:10.942839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4aed3da8-30f1-42e7-b3d1-6ccfca9e6e41 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:10.943381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4aed3da8-30f1-42e7-b3d1-6ccfca9e6e41 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:10.944194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4aed3da8-30f1-42e7-b3d1-6ccfca9e6e41 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:10.944752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4aed3da8-30f1-42e7-b3d1-6ccfca9e6e41 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:10.945449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4aed3da8-30f1-42e7-b3d1-6ccfca9e6e41 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:11.033365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-671f2db3-11c1-4960-b5d0-fdbe10dcaacc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:11.043375 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-671f2db3-11c1-4960-b5d0-fdbe10dcaacc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1522 microversion: 2.1 time: 0.224554 Oct 10 23:20:11.057583 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 455/914] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:10 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:11.057583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a515d67d-eb8f-452b-9214-84ec41ce81f8 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:11.057583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a515d67d-eb8f-452b-9214-84ec41ce81f8 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:11.121762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a515d67d-eb8f-452b-9214-84ec41ce81f8 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f553ef2324ac19370a181cf4c3629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2054001d7ed142698beaf51dcb6bd496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:11.130824 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a515d67d-eb8f-452b-9214-84ec41ce81f8 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 200 len: 1216 microversion: 2.1 time: 0.085527 Oct 10 23:20:11.142468 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 456/915] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:11 2022] GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 1216 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:11.152152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4aed3da8-30f1-42e7-b3d1-6ccfca9e6e41 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:11.157153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0358b139-3c30-4df3-8728-ff5f199a8467 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:11.157859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0358b139-3c30-4df3-8728-ff5f199a8467 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:11.161453 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4aed3da8-30f1-42e7-b3d1-6ccfca9e6e41 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1359 microversion: 2.1 time: 0.235044 Oct 10 23:20:11.165112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0358b139-3c30-4df3-8728-ff5f199a8467 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:11.166013 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0358b139-3c30-4df3-8728-ff5f199a8467 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:11.166918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0358b139-3c30-4df3-8728-ff5f199a8467 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:11.168229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0358b139-3c30-4df3-8728-ff5f199a8467 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:11.169887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0358b139-3c30-4df3-8728-ff5f199a8467 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:11.170948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0358b139-3c30-4df3-8728-ff5f199a8467 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:11.177444 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 460/916] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:10 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1359 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:11.182486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-f0a0b9b6-0a1c-4bed-939e-27a6d31641d4 req-3060f241-7d36-415a-b647-5ce4bb492058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cc20e4-bd05-44fc-931c-ddffba1494e6", "name": "network-vif-plugged", "status": "completed", "tag": "9cd0c0df-842e-4355-8798-be1d34e79325"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:11.192808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f0a0b9b6-0a1c-4bed-939e-27a6d31641d4 req-3060f241-7d36-415a-b647-5ce4bb492058 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:11.193297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f0a0b9b6-0a1c-4bed-939e-27a6d31641d4 req-3060f241-7d36-415a-b647-5ce4bb492058 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:11.193822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f0a0b9b6-0a1c-4bed-939e-27a6d31641d4 req-3060f241-7d36-415a-b647-5ce4bb492058 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:11.207467 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-f0a0b9b6-0a1c-4bed-939e-27a6d31641d4 req-3060f241-7d36-415a-b647-5ce4bb492058 service nova] Creating event network-vif-plugged:9cd0c0df-842e-4355-8798-be1d34e79325 for instance 90cc20e4-bd05-44fc-931c-ddffba1494e6 on n-h2-860864-2 Oct 10 23:20:11.216713 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-f0a0b9b6-0a1c-4bed-939e-27a6d31641d4 req-3060f241-7d36-415a-b647-5ce4bb492058 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037745 Oct 10 23:20:11.217935 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 461/917] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:11.225474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a53556a1-cbdc-4140-b3ba-fa38d24c284a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:11.227115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a53556a1-cbdc-4140-b3ba-fa38d24c284a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:11.245538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a53556a1-cbdc-4140-b3ba-fa38d24c284a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:11.246340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a53556a1-cbdc-4140-b3ba-fa38d24c284a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:11.246951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a53556a1-cbdc-4140-b3ba-fa38d24c284a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:11.248370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a53556a1-cbdc-4140-b3ba-fa38d24c284a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:11.249064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a53556a1-cbdc-4140-b3ba-fa38d24c284a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:11.249852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a53556a1-cbdc-4140-b3ba-fa38d24c284a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:11.374222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0358b139-3c30-4df3-8728-ff5f199a8467 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:11.384924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0358b139-3c30-4df3-8728-ff5f199a8467 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:11.387032 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0358b139-3c30-4df3-8728-ff5f199a8467 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:11.388261 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0358b139-3c30-4df3-8728-ff5f199a8467 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1362 microversion: 2.25 time: 0.237508 Oct 10 23:20:11.390162 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 457/918] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:11 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:11.490235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a53556a1-cbdc-4140-b3ba-fa38d24c284a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:11.498949 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a53556a1-cbdc-4140-b3ba-fa38d24c284a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1476 microversion: 2.1 time: 0.279732 Oct 10 23:20:11.499788 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 462/919] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:11 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1476 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:11.561244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2425bb8e-bd21-4ed4-9b72-552412616d10 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:11.562053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2425bb8e-bd21-4ed4-9b72-552412616d10 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:11.568442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2425bb8e-bd21-4ed4-9b72-552412616d10 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:11.568936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2425bb8e-bd21-4ed4-9b72-552412616d10 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:11.569394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2425bb8e-bd21-4ed4-9b72-552412616d10 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:11.570097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2425bb8e-bd21-4ed4-9b72-552412616d10 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:11.570698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2425bb8e-bd21-4ed4-9b72-552412616d10 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:11.571160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2425bb8e-bd21-4ed4-9b72-552412616d10 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:11.717724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2425bb8e-bd21-4ed4-9b72-552412616d10 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:11.725523 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2425bb8e-bd21-4ed4-9b72-552412616d10 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d" status: 200 len: 1317 microversion: 2.1 time: 0.168950 Oct 10 23:20:11.726109 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 458/920] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:11 2022] GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:11.940862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-36b5c164-c58f-43c6-9fca-eea9fbd5afa0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:11.941403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-36b5c164-c58f-43c6-9fca-eea9fbd5afa0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:11.948572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36b5c164-c58f-43c6-9fca-eea9fbd5afa0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:11.949458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36b5c164-c58f-43c6-9fca-eea9fbd5afa0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:11.949903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36b5c164-c58f-43c6-9fca-eea9fbd5afa0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:11.951746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36b5c164-c58f-43c6-9fca-eea9fbd5afa0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:11.951885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36b5c164-c58f-43c6-9fca-eea9fbd5afa0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:11.952275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36b5c164-c58f-43c6-9fca-eea9fbd5afa0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:12.071006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d911c9eb-80bc-42b9-9043-a19e654b3cfc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:12.073016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d911c9eb-80bc-42b9-9043-a19e654b3cfc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:12.080630 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d911c9eb-80bc-42b9-9043-a19e654b3cfc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:12.081212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d911c9eb-80bc-42b9-9043-a19e654b3cfc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:12.081768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d911c9eb-80bc-42b9-9043-a19e654b3cfc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:12.082534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d911c9eb-80bc-42b9-9043-a19e654b3cfc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:12.083327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d911c9eb-80bc-42b9-9043-a19e654b3cfc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:12.084285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d911c9eb-80bc-42b9-9043-a19e654b3cfc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:12.099929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-36b5c164-c58f-43c6-9fca-eea9fbd5afa0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:12.111196 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-36b5c164-c58f-43c6-9fca-eea9fbd5afa0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71" status: 200 len: 1316 microversion: 2.1 time: 0.174672 Oct 10 23:20:12.112147 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 463/921] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:11 2022] GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71 => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:12.157162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-855a5d48-1101-4ab5-a630-351c2a27777c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:12.157907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-855a5d48-1101-4ab5-a630-351c2a27777c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:12.164150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-855a5d48-1101-4ab5-a630-351c2a27777c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:12.165516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-855a5d48-1101-4ab5-a630-351c2a27777c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:12.166032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-855a5d48-1101-4ab5-a630-351c2a27777c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:12.167003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-855a5d48-1101-4ab5-a630-351c2a27777c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:12.167541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-855a5d48-1101-4ab5-a630-351c2a27777c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:12.168042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-855a5d48-1101-4ab5-a630-351c2a27777c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:12.237476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-855a5d48-1101-4ab5-a630-351c2a27777c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f553ef2324ac19370a181cf4c3629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2054001d7ed142698beaf51dcb6bd496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:12.244081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d911c9eb-80bc-42b9-9043-a19e654b3cfc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:12.245269 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-855a5d48-1101-4ab5-a630-351c2a27777c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 200 len: 1268 microversion: 2.1 time: 0.092985 Oct 10 23:20:12.257399 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 464/922] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:12 2022] GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 1268 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:12.257399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-59a617b7-c22c-4e02-af92-2cbf0d6e892e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:12.257399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-59a617b7-c22c-4e02-af92-2cbf0d6e892e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:12.257757 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d911c9eb-80bc-42b9-9043-a19e654b3cfc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1522 microversion: 2.1 time: 0.188874 Oct 10 23:20:12.259922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:12.261847 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59a617b7-c22c-4e02-af92-2cbf0d6e892e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:12.262322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59a617b7-c22c-4e02-af92-2cbf0d6e892e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:12.262852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59a617b7-c22c-4e02-af92-2cbf0d6e892e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:12.264063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59a617b7-c22c-4e02-af92-2cbf0d6e892e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:12.265328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59a617b7-c22c-4e02-af92-2cbf0d6e892e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:12.265811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59a617b7-c22c-4e02-af92-2cbf0d6e892e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:12.267115 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 459/923] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:12 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:12.400145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-59a617b7-c22c-4e02-af92-2cbf0d6e892e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:12.416175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c206adee-6d0a-4b66-85fb-cc0175f965b4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:12.416990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c206adee-6d0a-4b66-85fb-cc0175f965b4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:12.427497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c206adee-6d0a-4b66-85fb-cc0175f965b4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:12.428321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c206adee-6d0a-4b66-85fb-cc0175f965b4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:12.429624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c206adee-6d0a-4b66-85fb-cc0175f965b4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:12.430517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c206adee-6d0a-4b66-85fb-cc0175f965b4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:12.430645 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-59a617b7-c22c-4e02-af92-2cbf0d6e892e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1359 microversion: 2.1 time: 0.181962 Oct 10 23:20:12.431417 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 465/924] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:12 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:12.432186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c206adee-6d0a-4b66-85fb-cc0175f965b4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:12.432665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c206adee-6d0a-4b66-85fb-cc0175f965b4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:12.527824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bf0e22a0-d750-4149-8621-d25f49c06eab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:12.530081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bf0e22a0-d750-4149-8621-d25f49c06eab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:12.541601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf0e22a0-d750-4149-8621-d25f49c06eab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:12.542197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf0e22a0-d750-4149-8621-d25f49c06eab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:12.542630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf0e22a0-d750-4149-8621-d25f49c06eab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:12.543489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf0e22a0-d750-4149-8621-d25f49c06eab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:12.544502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf0e22a0-d750-4149-8621-d25f49c06eab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:12.545759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf0e22a0-d750-4149-8621-d25f49c06eab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:12.603763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c206adee-6d0a-4b66-85fb-cc0175f965b4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:12.626254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c206adee-6d0a-4b66-85fb-cc0175f965b4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:12.628352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c206adee-6d0a-4b66-85fb-cc0175f965b4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:12.629756 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c206adee-6d0a-4b66-85fb-cc0175f965b4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1362 microversion: 2.25 time: 0.219836 Oct 10 23:20:12.633421 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 460/925] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:12 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:12.751022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b751ea21-2a04-4a99-b059-c028368941ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:12.751993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b751ea21-2a04-4a99-b059-c028368941ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:12.758450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b751ea21-2a04-4a99-b059-c028368941ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:12.759250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b751ea21-2a04-4a99-b059-c028368941ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:12.759777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b751ea21-2a04-4a99-b059-c028368941ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:12.760559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b751ea21-2a04-4a99-b059-c028368941ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:12.761255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b751ea21-2a04-4a99-b059-c028368941ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:12.761789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b751ea21-2a04-4a99-b059-c028368941ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:12.814080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bf0e22a0-d750-4149-8621-d25f49c06eab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:12.835742 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bf0e22a0-d750-4149-8621-d25f49c06eab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1476 microversion: 2.1 time: 0.311780 Oct 10 23:20:12.836683 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 466/926] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:12 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1476 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:12.962281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b751ea21-2a04-4a99-b059-c028368941ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:12.973208 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b751ea21-2a04-4a99-b059-c028368941ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d" status: 200 len: 1317 microversion: 2.1 time: 0.226709 Oct 10 23:20:12.973940 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 461/927] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:12 2022] GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:13.136225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-56846272-89ac-49c9-9dcd-8e6929bbf160 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:13.136844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-56846272-89ac-49c9-9dcd-8e6929bbf160 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:13.145607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56846272-89ac-49c9-9dcd-8e6929bbf160 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:13.146102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56846272-89ac-49c9-9dcd-8e6929bbf160 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:13.146541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56846272-89ac-49c9-9dcd-8e6929bbf160 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:13.147245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56846272-89ac-49c9-9dcd-8e6929bbf160 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:13.147710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56846272-89ac-49c9-9dcd-8e6929bbf160 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:13.148125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56846272-89ac-49c9-9dcd-8e6929bbf160 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:13.272325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f24f3a7e-6472-4508-a7e1-4c2bb2a8f806 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:13.273621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f24f3a7e-6472-4508-a7e1-4c2bb2a8f806 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:13.282139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f24f3a7e-6472-4508-a7e1-4c2bb2a8f806 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:13.282908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f24f3a7e-6472-4508-a7e1-4c2bb2a8f806 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:13.283553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f24f3a7e-6472-4508-a7e1-4c2bb2a8f806 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:13.284517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f24f3a7e-6472-4508-a7e1-4c2bb2a8f806 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:13.285192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f24f3a7e-6472-4508-a7e1-4c2bb2a8f806 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:13.285844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f24f3a7e-6472-4508-a7e1-4c2bb2a8f806 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:13.361699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f24f3a7e-6472-4508-a7e1-4c2bb2a8f806 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f553ef2324ac19370a181cf4c3629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2054001d7ed142698beaf51dcb6bd496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:13.370721 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f24f3a7e-6472-4508-a7e1-4c2bb2a8f806 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 200 len: 1274 microversion: 2.1 time: 0.102163 Oct 10 23:20:13.381659 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 462/928] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:13 2022] GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 1274 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:13.381659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d7a79c7f-9cca-4136-8295-d05760a4c78a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:13.381659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d7a79c7f-9cca-4136-8295-d05760a4c78a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:13.391342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7a79c7f-9cca-4136-8295-d05760a4c78a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:13.391836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7a79c7f-9cca-4136-8295-d05760a4c78a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:13.392269 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7a79c7f-9cca-4136-8295-d05760a4c78a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:13.392982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7a79c7f-9cca-4136-8295-d05760a4c78a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:13.393463 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7a79c7f-9cca-4136-8295-d05760a4c78a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:13.393890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7a79c7f-9cca-4136-8295-d05760a4c78a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:13.544444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d7a79c7f-9cca-4136-8295-d05760a4c78a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:13.554083 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d7a79c7f-9cca-4136-8295-d05760a4c78a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1522 microversion: 2.1 time: 0.181125 Oct 10 23:20:13.554903 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 463/929] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:13 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:13.563828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-3fbb4eb6-84d7-4671-bf6d-452b811cfe5b req-21c963d5-a793-44b5-bc2d-000dc6d36393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26119603-9e9d-40bc-8b27-03e36c3c9f71", "name": "network-vif-plugged", "status": "completed", "tag": "06f29faa-7ff9-4ce5-8ccf-43416e2a4bf9"}, {"server_uuid": "e8cb5a23-7b52-472b-b06e-1b830053c92d", "name": "network-vif-plugged", "status": "completed", "tag": "fab54877-ae0b-4495-b318-ffee867fcc69"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:13.574955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3fbb4eb6-84d7-4671-bf6d-452b811cfe5b req-21c963d5-a793-44b5-bc2d-000dc6d36393 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:13.575902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3fbb4eb6-84d7-4671-bf6d-452b811cfe5b req-21c963d5-a793-44b5-bc2d-000dc6d36393 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:13.576614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3fbb4eb6-84d7-4671-bf6d-452b811cfe5b req-21c963d5-a793-44b5-bc2d-000dc6d36393 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:13.590000 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-3fbb4eb6-84d7-4671-bf6d-452b811cfe5b req-21c963d5-a793-44b5-bc2d-000dc6d36393 service nova] Creating event network-vif-plugged:06f29faa-7ff9-4ce5-8ccf-43416e2a4bf9 for instance 26119603-9e9d-40bc-8b27-03e36c3c9f71 on n-h1-860864-2 Oct 10 23:20:13.592662 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-3fbb4eb6-84d7-4671-bf6d-452b811cfe5b req-21c963d5-a793-44b5-bc2d-000dc6d36393 service nova] Creating event network-vif-plugged:fab54877-ae0b-4495-b318-ffee867fcc69 for instance e8cb5a23-7b52-472b-b06e-1b830053c92d on n-h2-860864-2 Oct 10 23:20:13.601892 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-3fbb4eb6-84d7-4671-bf6d-452b811cfe5b req-21c963d5-a793-44b5-bc2d-000dc6d36393 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045696 Oct 10 23:20:13.605817 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 464/930] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:13.611820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-43678aa0-fff5-4113-92da-b6dcde9fadd6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:13.612636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-43678aa0-fff5-4113-92da-b6dcde9fadd6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:13.619881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43678aa0-fff5-4113-92da-b6dcde9fadd6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:13.620508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43678aa0-fff5-4113-92da-b6dcde9fadd6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:13.620953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43678aa0-fff5-4113-92da-b6dcde9fadd6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:13.621687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43678aa0-fff5-4113-92da-b6dcde9fadd6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:13.622145 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43678aa0-fff5-4113-92da-b6dcde9fadd6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:13.623098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43678aa0-fff5-4113-92da-b6dcde9fadd6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:13.668302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-56846272-89ac-49c9-9dcd-8e6929bbf160 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:13.679366 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-56846272-89ac-49c9-9dcd-8e6929bbf160 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71" status: 200 len: 1316 microversion: 2.1 time: 0.546876 Oct 10 23:20:13.680136 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 467/931] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:13 2022] GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71 => generated 1316 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:13.693399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-72b9541f-0843-4d40-9842-f01093f12d04 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:13.693399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-72b9541f-0843-4d40-9842-f01093f12d04 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:13.693897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72b9541f-0843-4d40-9842-f01093f12d04 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:13.694610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72b9541f-0843-4d40-9842-f01093f12d04 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:13.695258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72b9541f-0843-4d40-9842-f01093f12d04 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:13.696178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72b9541f-0843-4d40-9842-f01093f12d04 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:13.696829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72b9541f-0843-4d40-9842-f01093f12d04 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:13.697490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72b9541f-0843-4d40-9842-f01093f12d04 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:13.832043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-43678aa0-fff5-4113-92da-b6dcde9fadd6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:13.839942 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-43678aa0-fff5-4113-92da-b6dcde9fadd6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1542 microversion: 2.1 time: 0.231818 Oct 10 23:20:13.840746 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 465/932] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:13 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1542 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:13.864485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8ee71f15-0dd3-4d93-85ba-a4d691571d24 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:13.865143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8ee71f15-0dd3-4d93-85ba-a4d691571d24 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:13.871601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8ee71f15-0dd3-4d93-85ba-a4d691571d24 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:13.872405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8ee71f15-0dd3-4d93-85ba-a4d691571d24 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:13.873008 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8ee71f15-0dd3-4d93-85ba-a4d691571d24 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:13.874172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8ee71f15-0dd3-4d93-85ba-a4d691571d24 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:13.874740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8ee71f15-0dd3-4d93-85ba-a4d691571d24 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:13.875275 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8ee71f15-0dd3-4d93-85ba-a4d691571d24 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:13.954761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-72b9541f-0843-4d40-9842-f01093f12d04 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:13.969111 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8ee71f15-0dd3-4d93-85ba-a4d691571d24 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108823 Oct 10 23:20:13.969309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-72b9541f-0843-4d40-9842-f01093f12d04 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:13.969814 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 466/933] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Oct 10 23:20:13 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:13.971345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-72b9541f-0843-4d40-9842-f01093f12d04 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:13.972733 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-72b9541f-0843-4d40-9842-f01093f12d04 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1362 microversion: 2.25 time: 0.291681 Oct 10 23:20:13.973830 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 468/934] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:13 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1362 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:13.975046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4b8e19e5-e882-4731-88cc-753086164434 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:13.975969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4b8e19e5-e882-4731-88cc-753086164434 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:13.986809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b8e19e5-e882-4731-88cc-753086164434 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:13.987320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b8e19e5-e882-4731-88cc-753086164434 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:13.987818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b8e19e5-e882-4731-88cc-753086164434 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:13.989538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b8e19e5-e882-4731-88cc-753086164434 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:13.990293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b8e19e5-e882-4731-88cc-753086164434 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:13.990739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b8e19e5-e882-4731-88cc-753086164434 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:13.998496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a116fbe2-caf6-484a-bae6-dad9b9dd5d83 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:13.999135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a116fbe2-caf6-484a-bae6-dad9b9dd5d83 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:14.006224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a116fbe2-caf6-484a-bae6-dad9b9dd5d83 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:14.006709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a116fbe2-caf6-484a-bae6-dad9b9dd5d83 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:14.007140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a116fbe2-caf6-484a-bae6-dad9b9dd5d83 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:14.007909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a116fbe2-caf6-484a-bae6-dad9b9dd5d83 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:14.008689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a116fbe2-caf6-484a-bae6-dad9b9dd5d83 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:14.017812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a116fbe2-caf6-484a-bae6-dad9b9dd5d83 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:14.139828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4b8e19e5-e882-4731-88cc-753086164434 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:14.148153 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4b8e19e5-e882-4731-88cc-753086164434 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1476 microversion: 2.1 time: 0.177260 Oct 10 23:20:14.148731 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 467/935] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:13 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1476 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:14.397252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a116fbe2-caf6-484a-bae6-dad9b9dd5d83 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:14.401223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-df7030d1-4318-4e8f-bb33-e8b5f18c004c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:14.401754 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-df7030d1-4318-4e8f-bb33-e8b5f18c004c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:14.408564 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a116fbe2-caf6-484a-bae6-dad9b9dd5d83 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d" status: 200 len: 1317 microversion: 2.1 time: 0.414891 Oct 10 23:20:14.410282 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 469/936] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:13 2022] GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:14.427627 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df7030d1-4318-4e8f-bb33-e8b5f18c004c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:14.428291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df7030d1-4318-4e8f-bb33-e8b5f18c004c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:14.428927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df7030d1-4318-4e8f-bb33-e8b5f18c004c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:14.429261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df7030d1-4318-4e8f-bb33-e8b5f18c004c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:14.430092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df7030d1-4318-4e8f-bb33-e8b5f18c004c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:14.430565 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df7030d1-4318-4e8f-bb33-e8b5f18c004c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:14.577693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-362727dd-1b42-4d2b-9f6e-f748bab08f5a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:14.578488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-362727dd-1b42-4d2b-9f6e-f748bab08f5a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:14.596220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-362727dd-1b42-4d2b-9f6e-f748bab08f5a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:14.596889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-362727dd-1b42-4d2b-9f6e-f748bab08f5a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:14.598750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-362727dd-1b42-4d2b-9f6e-f748bab08f5a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:14.599589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-362727dd-1b42-4d2b-9f6e-f748bab08f5a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:14.600311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-362727dd-1b42-4d2b-9f6e-f748bab08f5a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:14.600904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-362727dd-1b42-4d2b-9f6e-f748bab08f5a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:14.681966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-df7030d1-4318-4e8f-bb33-e8b5f18c004c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f553ef2324ac19370a181cf4c3629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2054001d7ed142698beaf51dcb6bd496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:14.691553 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-df7030d1-4318-4e8f-bb33-e8b5f18c004c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 200 len: 1316 microversion: 2.1 time: 0.298193 Oct 10 23:20:14.692366 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 468/937] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:14 2022] GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:14.710028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3e6b9021-6679-4673-8ea7-517b9aa693b0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:14.710568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3e6b9021-6679-4673-8ea7-517b9aa693b0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:14.717236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e6b9021-6679-4673-8ea7-517b9aa693b0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:14.717915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e6b9021-6679-4673-8ea7-517b9aa693b0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:14.718495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e6b9021-6679-4673-8ea7-517b9aa693b0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:14.719197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e6b9021-6679-4673-8ea7-517b9aa693b0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:14.719730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e6b9021-6679-4673-8ea7-517b9aa693b0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:14.720730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e6b9021-6679-4673-8ea7-517b9aa693b0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:14.889496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3e6b9021-6679-4673-8ea7-517b9aa693b0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:14.897608 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3e6b9021-6679-4673-8ea7-517b9aa693b0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71" status: 200 len: 1316 microversion: 2.1 time: 0.194902 Oct 10 23:20:14.914949 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 469/938] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:14 2022] GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71 => generated 1316 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:14.991753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-362727dd-1b42-4d2b-9f6e-f748bab08f5a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:14.998529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c0687688-215c-4abc-ada4-9b0796fdd88d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:14.999519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c0687688-215c-4abc-ada4-9b0796fdd88d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:15.005699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c0687688-215c-4abc-ada4-9b0796fdd88d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:15.006412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c0687688-215c-4abc-ada4-9b0796fdd88d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:15.007016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c0687688-215c-4abc-ada4-9b0796fdd88d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:15.007878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c0687688-215c-4abc-ada4-9b0796fdd88d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:15.008251 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-362727dd-1b42-4d2b-9f6e-f748bab08f5a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1522 microversion: 2.1 time: 0.433527 Oct 10 23:20:15.008665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c0687688-215c-4abc-ada4-9b0796fdd88d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:15.021415 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 470/939] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:14 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:15.022805 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c0687688-215c-4abc-ada4-9b0796fdd88d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:15.172889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5401fd59-1dea-4a12-8e9d-3d3a42c2604f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:15.173649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5401fd59-1dea-4a12-8e9d-3d3a42c2604f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:15.180638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5401fd59-1dea-4a12-8e9d-3d3a42c2604f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:15.181299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5401fd59-1dea-4a12-8e9d-3d3a42c2604f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:15.181923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5401fd59-1dea-4a12-8e9d-3d3a42c2604f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:15.182790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5401fd59-1dea-4a12-8e9d-3d3a42c2604f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:15.183400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5401fd59-1dea-4a12-8e9d-3d3a42c2604f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:15.184067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5401fd59-1dea-4a12-8e9d-3d3a42c2604f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:15.198487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c0687688-215c-4abc-ada4-9b0796fdd88d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:15.209257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c0687688-215c-4abc-ada4-9b0796fdd88d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:15.211217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c0687688-215c-4abc-ada4-9b0796fdd88d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:15.212450 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c0687688-215c-4abc-ada4-9b0796fdd88d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1362 microversion: 2.25 time: 0.218750 Oct 10 23:20:15.213489 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 470/940] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:14 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:15.433888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ffc786f9-5558-463a-9663-6d80ba817bba tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:15.434656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ffc786f9-5558-463a-9663-6d80ba817bba tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:15.442746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffc786f9-5558-463a-9663-6d80ba817bba tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:15.443267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffc786f9-5558-463a-9663-6d80ba817bba tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:15.443717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffc786f9-5558-463a-9663-6d80ba817bba tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:15.444519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffc786f9-5558-463a-9663-6d80ba817bba tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:15.445042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffc786f9-5558-463a-9663-6d80ba817bba tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:15.445539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffc786f9-5558-463a-9663-6d80ba817bba tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:15.552452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5401fd59-1dea-4a12-8e9d-3d3a42c2604f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:15.574767 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5401fd59-1dea-4a12-8e9d-3d3a42c2604f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1475 microversion: 2.1 time: 0.406407 Oct 10 23:20:15.576228 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 471/941] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:15 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1475 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:15.609135 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ffc786f9-5558-463a-9663-6d80ba817bba tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:15.617550 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ffc786f9-5558-463a-9663-6d80ba817bba tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d" status: 200 len: 1317 microversion: 2.1 time: 0.187364 Oct 10 23:20:15.618265 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 471/942] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:15 2022] GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:15.716542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d0e8005b-3cde-4aca-9ef5-38c497f35ed8 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:15.717835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d0e8005b-3cde-4aca-9ef5-38c497f35ed8 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:15.723907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0e8005b-3cde-4aca-9ef5-38c497f35ed8 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:15.724403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0e8005b-3cde-4aca-9ef5-38c497f35ed8 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:15.725015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0e8005b-3cde-4aca-9ef5-38c497f35ed8 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:15.725925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0e8005b-3cde-4aca-9ef5-38c497f35ed8 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:15.726541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0e8005b-3cde-4aca-9ef5-38c497f35ed8 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:15.727127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0e8005b-3cde-4aca-9ef5-38c497f35ed8 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:15.922721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5417bad5-88d6-4e79-9b70-ba5619d757fb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:15.923342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5417bad5-88d6-4e79-9b70-ba5619d757fb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:15.929309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5417bad5-88d6-4e79-9b70-ba5619d757fb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:15.929853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5417bad5-88d6-4e79-9b70-ba5619d757fb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:15.930290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5417bad5-88d6-4e79-9b70-ba5619d757fb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:15.930990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5417bad5-88d6-4e79-9b70-ba5619d757fb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:15.931450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5417bad5-88d6-4e79-9b70-ba5619d757fb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:15.931878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5417bad5-88d6-4e79-9b70-ba5619d757fb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:16.065049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d0e8005b-3cde-4aca-9ef5-38c497f35ed8 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f553ef2324ac19370a181cf4c3629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2054001d7ed142698beaf51dcb6bd496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:16.070127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5417bad5-88d6-4e79-9b70-ba5619d757fb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:16.073608 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d0e8005b-3cde-4aca-9ef5-38c497f35ed8 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 200 len: 1316 microversion: 2.1 time: 0.361380 Oct 10 23:20:16.074419 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 472/943] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:15 2022] GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:16.079756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dfab80a6-1a66-4721-ae7b-2895d87477a6 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:16.080445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dfab80a6-1a66-4721-ae7b-2895d87477a6 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:16.086830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfab80a6-1a66-4721-ae7b-2895d87477a6 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:16.087615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfab80a6-1a66-4721-ae7b-2895d87477a6 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:16.088291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfab80a6-1a66-4721-ae7b-2895d87477a6 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:16.089235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfab80a6-1a66-4721-ae7b-2895d87477a6 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:16.089981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfab80a6-1a66-4721-ae7b-2895d87477a6 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:16.090643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfab80a6-1a66-4721-ae7b-2895d87477a6 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:16.091778 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5417bad5-88d6-4e79-9b70-ba5619d757fb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71" status: 200 len: 1502 microversion: 2.1 time: 0.172272 Oct 10 23:20:16.093977 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 472/944] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:15 2022] GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71 => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:16.126485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-abf9c94b-2fbf-4680-ba0e-10ea128c24e3 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1505247545"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:16.127292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-abf9c94b-2fbf-4680-ba0e-10ea128c24e3 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:16.133831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-abf9c94b-2fbf-4680-ba0e-10ea128c24e3 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:16.134372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-abf9c94b-2fbf-4680-ba0e-10ea128c24e3 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:16.134789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-abf9c94b-2fbf-4680-ba0e-10ea128c24e3 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:16.135492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-abf9c94b-2fbf-4680-ba0e-10ea128c24e3 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:16.136003 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-abf9c94b-2fbf-4680-ba0e-10ea128c24e3 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:16.136602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-abf9c94b-2fbf-4680-ba0e-10ea128c24e3 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:16.282292 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.network.security_group_api [None req-abf9c94b-2fbf-4680-ba0e-10ea128c24e3 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Adding security group 1d1d621a-389e-4f53-ae2d-05bc629e2d19 to port 06f29faa-7ff9-4ce5-8ccf-43416e2a4bf9 Oct 10 23:20:16.652325 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-abf9c94b-2fbf-4680-ba0e-10ea128c24e3 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "POST /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71/action" status: 202 len: 0 microversion: 2.1 time: 0.538262 Oct 10 23:20:16.655346 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 473/945] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:20:16 2022] POST /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:20:16.660663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2fa42221-7e5e-4af8-8517-4b8e2a3de11c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:16.661583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2fa42221-7e5e-4af8-8517-4b8e2a3de11c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:16.677561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fa42221-7e5e-4af8-8517-4b8e2a3de11c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:16.678281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fa42221-7e5e-4af8-8517-4b8e2a3de11c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:16.680407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fa42221-7e5e-4af8-8517-4b8e2a3de11c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:16.681317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fa42221-7e5e-4af8-8517-4b8e2a3de11c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:16.682626 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fa42221-7e5e-4af8-8517-4b8e2a3de11c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:16.684337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fa42221-7e5e-4af8-8517-4b8e2a3de11c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:16.699607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dfab80a6-1a66-4721-ae7b-2895d87477a6 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:16.710717 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dfab80a6-1a66-4721-ae7b-2895d87477a6 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1522 microversion: 2.1 time: 0.634990 Oct 10 23:20:16.718410 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 473/946] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:16 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1522 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:16.724382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-c2183f6c-e42b-49a3-922f-67e4ee4570db req-a44fceda-8438-4c8e-b460-d593670b9cdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc60f0b-c592-4047-97cf-7c81649085d3", "tag": "fef8ff70-fee3-4957-aa01-50f6a48fab07"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:16.748508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:16.761500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c2183f6c-e42b-49a3-922f-67e4ee4570db req-a44fceda-8438-4c8e-b460-d593670b9cdf service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:16.763817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c2183f6c-e42b-49a3-922f-67e4ee4570db req-a44fceda-8438-4c8e-b460-d593670b9cdf service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:16.764530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c2183f6c-e42b-49a3-922f-67e4ee4570db req-a44fceda-8438-4c8e-b460-d593670b9cdf service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:16.797366 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-c2183f6c-e42b-49a3-922f-67e4ee4570db req-a44fceda-8438-4c8e-b460-d593670b9cdf service nova] Creating event network-changed:fef8ff70-fee3-4957-aa01-50f6a48fab07 for instance 9dc60f0b-c592-4047-97cf-7c81649085d3 on n-h1-860864-2 Oct 10 23:20:16.811535 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-c2183f6c-e42b-49a3-922f-67e4ee4570db req-a44fceda-8438-4c8e-b460-d593670b9cdf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091415 Oct 10 23:20:16.812786 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 474/947] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:16.822533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-613bcf77-a6cd-4028-ad36-eb20c8bdf2d7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:16.827194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-613bcf77-a6cd-4028-ad36-eb20c8bdf2d7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:16.844140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-613bcf77-a6cd-4028-ad36-eb20c8bdf2d7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:16.846778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-613bcf77-a6cd-4028-ad36-eb20c8bdf2d7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:16.847781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-613bcf77-a6cd-4028-ad36-eb20c8bdf2d7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:16.849848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-613bcf77-a6cd-4028-ad36-eb20c8bdf2d7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:16.852002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-613bcf77-a6cd-4028-ad36-eb20c8bdf2d7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:16.854649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-613bcf77-a6cd-4028-ad36-eb20c8bdf2d7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:16.929030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2fa42221-7e5e-4af8-8517-4b8e2a3de11c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:16.939692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2fa42221-7e5e-4af8-8517-4b8e2a3de11c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:16.941599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2fa42221-7e5e-4af8-8517-4b8e2a3de11c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:16.942927 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2fa42221-7e5e-4af8-8517-4b8e2a3de11c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1362 microversion: 2.25 time: 0.286160 Oct 10 23:20:16.943829 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 474/948] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:16 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:16.948828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-70f0aa54-971d-4fbb-a587-986981ea17d5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:16.949472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-70f0aa54-971d-4fbb-a587-986981ea17d5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:16.956683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70f0aa54-971d-4fbb-a587-986981ea17d5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:16.957176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70f0aa54-971d-4fbb-a587-986981ea17d5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:16.957842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70f0aa54-971d-4fbb-a587-986981ea17d5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:16.958732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70f0aa54-971d-4fbb-a587-986981ea17d5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:16.959339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70f0aa54-971d-4fbb-a587-986981ea17d5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:16.959980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70f0aa54-971d-4fbb-a587-986981ea17d5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:17.138968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-70f0aa54-971d-4fbb-a587-986981ea17d5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:17.151678 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-70f0aa54-971d-4fbb-a587-986981ea17d5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d" status: 200 len: 1467 microversion: 2.1 time: 0.206508 Oct 10 23:20:17.152829 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 475/949] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:16 2022] GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d => generated 1467 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:17.161101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-863101c0-b990-4f13-87d0-b16f0ef5f766 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-691929023"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:17.162232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-863101c0-b990-4f13-87d0-b16f0ef5f766 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:17.170773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-863101c0-b990-4f13-87d0-b16f0ef5f766 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:17.171316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-863101c0-b990-4f13-87d0-b16f0ef5f766 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:17.171818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-863101c0-b990-4f13-87d0-b16f0ef5f766 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:17.172664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-863101c0-b990-4f13-87d0-b16f0ef5f766 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:17.173119 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-863101c0-b990-4f13-87d0-b16f0ef5f766 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:17.174145 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-863101c0-b990-4f13-87d0-b16f0ef5f766 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:17.347991 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.network.security_group_api [None req-863101c0-b990-4f13-87d0-b16f0ef5f766 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Adding security group e91508f8-8d36-4924-8e71-d6780ec143f2 to port 06f29faa-7ff9-4ce5-8ccf-43416e2a4bf9 Oct 10 23:20:17.425740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-613bcf77-a6cd-4028-ad36-eb20c8bdf2d7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:17.437669 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-613bcf77-a6cd-4028-ad36-eb20c8bdf2d7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1475 microversion: 2.1 time: 0.623398 Oct 10 23:20:17.465246 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 475/950] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:16 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1475 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:17.473744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-fda9df78-2da0-4daf-a35d-14e49ee7f2d3 req-c4527391-8800-4468-963d-bbea589b25b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26119603-9e9d-40bc-8b27-03e36c3c9f71", "tag": "06f29faa-7ff9-4ce5-8ccf-43416e2a4bf9"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:17.486062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-fda9df78-2da0-4daf-a35d-14e49ee7f2d3 req-c4527391-8800-4468-963d-bbea589b25b0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:17.486848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-fda9df78-2da0-4daf-a35d-14e49ee7f2d3 req-c4527391-8800-4468-963d-bbea589b25b0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:17.487424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-fda9df78-2da0-4daf-a35d-14e49ee7f2d3 req-c4527391-8800-4468-963d-bbea589b25b0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:17.506410 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-fda9df78-2da0-4daf-a35d-14e49ee7f2d3 req-c4527391-8800-4468-963d-bbea589b25b0 service nova] Creating event network-changed:06f29faa-7ff9-4ce5-8ccf-43416e2a4bf9 for instance 26119603-9e9d-40bc-8b27-03e36c3c9f71 on n-h1-860864-2 Oct 10 23:20:17.514633 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-fda9df78-2da0-4daf-a35d-14e49ee7f2d3 req-c4527391-8800-4468-963d-bbea589b25b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044486 Oct 10 23:20:17.516481 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 476/951] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:17.523606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7d702233-009a-4205-939b-f1b699ebfed2 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:17.526222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7d702233-009a-4205-939b-f1b699ebfed2 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:17.536130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d702233-009a-4205-939b-f1b699ebfed2 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:17.536987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d702233-009a-4205-939b-f1b699ebfed2 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:17.537898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d702233-009a-4205-939b-f1b699ebfed2 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:17.539454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d702233-009a-4205-939b-f1b699ebfed2 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:17.540398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d702233-009a-4205-939b-f1b699ebfed2 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:17.541096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d702233-009a-4205-939b-f1b699ebfed2 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:17.778216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=42 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:17.804550 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-863101c0-b990-4f13-87d0-b16f0ef5f766 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "POST /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71/action" status: 202 len: 0 microversion: 2.1 time: 0.649605 Oct 10 23:20:17.805502 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 476/952] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:20:17 2022] POST /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71/action => generated 0 bytes in 652 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:20:17.810447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-36f48d77-75ce-4d9e-9693-90994417d051 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:17.811240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-36f48d77-75ce-4d9e-9693-90994417d051 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:17.816714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7d702233-009a-4205-939b-f1b699ebfed2 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f553ef2324ac19370a181cf4c3629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2054001d7ed142698beaf51dcb6bd496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:17.817862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36f48d77-75ce-4d9e-9693-90994417d051 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:17.818360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36f48d77-75ce-4d9e-9693-90994417d051 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:17.818788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36f48d77-75ce-4d9e-9693-90994417d051 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:17.819488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36f48d77-75ce-4d9e-9693-90994417d051 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:17.820435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36f48d77-75ce-4d9e-9693-90994417d051 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:17.821023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36f48d77-75ce-4d9e-9693-90994417d051 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:17.834303 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7d702233-009a-4205-939b-f1b699ebfed2 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 200 len: 1316 microversion: 2.1 time: 0.313090 Oct 10 23:20:17.835132 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 477/953] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:17 2022] GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:17.840372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9cf17e3f-f0fa-4a5d-9d86-fd7ba76bf617 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:17.841000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9cf17e3f-f0fa-4a5d-9d86-fd7ba76bf617 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:17.847397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cf17e3f-f0fa-4a5d-9d86-fd7ba76bf617 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:17.847898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cf17e3f-f0fa-4a5d-9d86-fd7ba76bf617 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:17.848339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cf17e3f-f0fa-4a5d-9d86-fd7ba76bf617 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:17.849051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cf17e3f-f0fa-4a5d-9d86-fd7ba76bf617 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:17.849540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cf17e3f-f0fa-4a5d-9d86-fd7ba76bf617 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:17.849987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cf17e3f-f0fa-4a5d-9d86-fd7ba76bf617 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:17.852952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:17.880861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9cf17e3f-f0fa-4a5d-9d86-fd7ba76bf617 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:20:17.994662 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9cf17e3f-f0fa-4a5d-9d86-fd7ba76bf617 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 204 len: 0 microversion: 2.1 time: 0.157637 Oct 10 23:20:17.996750 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 478/954] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:20:17 2022] DELETE /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:20:18.004216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-8e40c5fe-3236-4106-acec-5719362ad520 req-8b301741-a967-4a65-b81b-5135970eae99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3bb20a8-8b13-470d-ac2b-50b7a7bea206", "name": "network-vif-plugged", "status": "completed", "tag": "cf309634-58e1-4dda-a8ad-e94e39638eb7"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:18.020475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8e40c5fe-3236-4106-acec-5719362ad520 req-8b301741-a967-4a65-b81b-5135970eae99 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:18.021022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8e40c5fe-3236-4106-acec-5719362ad520 req-8b301741-a967-4a65-b81b-5135970eae99 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:18.021668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8e40c5fe-3236-4106-acec-5719362ad520 req-8b301741-a967-4a65-b81b-5135970eae99 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:18.035382 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-8e40c5fe-3236-4106-acec-5719362ad520 req-8b301741-a967-4a65-b81b-5135970eae99 service nova] Creating event network-vif-plugged:cf309634-58e1-4dda-a8ad-e94e39638eb7 for instance c3bb20a8-8b13-470d-ac2b-50b7a7bea206 on n-h2-860864-2 Oct 10 23:20:18.036826 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-36f48d77-75ce-4d9e-9693-90994417d051 tempest-ServersOnMultiNodesTest-1025769007 tempest-ServersOnMultiNodesTest-1025769007-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d" status: 200 len: 1618 microversion: 2.1 time: 0.229830 Oct 10 23:20:18.038298 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 477/955] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:17 2022] GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d => generated 1618 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:18.053597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-08ff6429-0b72-4a7c-8059-5cfc53ad9201 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:18.059511 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-8e40c5fe-3236-4106-acec-5719362ad520 req-8b301741-a967-4a65-b81b-5135970eae99 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057119 Oct 10 23:20:18.059511 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 479/956] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:18.061061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-08ff6429-0b72-4a7c-8059-5cfc53ad9201 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:18.063801 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-896d1b7d-d21c-42cf-ba8e-2c1ff8fdb720 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:18.064383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-896d1b7d-d21c-42cf-ba8e-2c1ff8fdb720 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:18.068453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ff6429-0b72-4a7c-8059-5cfc53ad9201 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:18.069005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ff6429-0b72-4a7c-8059-5cfc53ad9201 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:18.069491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ff6429-0b72-4a7c-8059-5cfc53ad9201 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:18.070192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ff6429-0b72-4a7c-8059-5cfc53ad9201 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:18.070645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ff6429-0b72-4a7c-8059-5cfc53ad9201 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:18.070998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-896d1b7d-d21c-42cf-ba8e-2c1ff8fdb720 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:18.071321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ff6429-0b72-4a7c-8059-5cfc53ad9201 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:18.071493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-896d1b7d-d21c-42cf-ba8e-2c1ff8fdb720 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:18.071914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-896d1b7d-d21c-42cf-ba8e-2c1ff8fdb720 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:18.072671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-896d1b7d-d21c-42cf-ba8e-2c1ff8fdb720 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:18.073138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-896d1b7d-d21c-42cf-ba8e-2c1ff8fdb720 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:18.073595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-896d1b7d-d21c-42cf-ba8e-2c1ff8fdb720 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:18.237115 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-896d1b7d-d21c-42cf-ba8e-2c1ff8fdb720 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.178691 Oct 10 23:20:18.238258 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 480/957] 10.222.0.23 () {58 vars in 1293 bytes} [Mon Oct 10 23:20:18 2022] GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71/os-security-groups => generated 1157 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:18.242817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d7ae4ee9-f5e9-4251-a9c8-d57f703d3618 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:18.243445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d7ae4ee9-f5e9-4251-a9c8-d57f703d3618 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:18.254985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-08ff6429-0b72-4a7c-8059-5cfc53ad9201 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:18.261624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7ae4ee9-f5e9-4251-a9c8-d57f703d3618 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:18.262203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7ae4ee9-f5e9-4251-a9c8-d57f703d3618 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:18.262777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7ae4ee9-f5e9-4251-a9c8-d57f703d3618 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:18.264068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7ae4ee9-f5e9-4251-a9c8-d57f703d3618 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:18.264642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7ae4ee9-f5e9-4251-a9c8-d57f703d3618 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:18.265131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7ae4ee9-f5e9-4251-a9c8-d57f703d3618 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:18.265683 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-08ff6429-0b72-4a7c-8059-5cfc53ad9201 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1522 microversion: 2.1 time: 0.226012 Oct 10 23:20:18.266739 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 478/958] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:18 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:18.273239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d0343950-0c76-41d4-a973-e44626e23728 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:18.274181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d0343950-0c76-41d4-a973-e44626e23728 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:18.281986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0343950-0c76-41d4-a973-e44626e23728 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:18.282881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0343950-0c76-41d4-a973-e44626e23728 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:18.283572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0343950-0c76-41d4-a973-e44626e23728 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:18.284563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0343950-0c76-41d4-a973-e44626e23728 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:18.285249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0343950-0c76-41d4-a973-e44626e23728 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:18.285912 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0343950-0c76-41d4-a973-e44626e23728 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:18.415741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d7ae4ee9-f5e9-4251-a9c8-d57f703d3618 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:18.428328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d7ae4ee9-f5e9-4251-a9c8-d57f703d3618 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:18.430433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d7ae4ee9-f5e9-4251-a9c8-d57f703d3618 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:18.431613 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d7ae4ee9-f5e9-4251-a9c8-d57f703d3618 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1362 microversion: 2.25 time: 0.192436 Oct 10 23:20:18.432413 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 481/959] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:18 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:18.437426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1caac7c3-e618-4351-8fe1-bf774633749a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:18.437933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1caac7c3-e618-4351-8fe1-bf774633749a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:18.443989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1caac7c3-e618-4351-8fe1-bf774633749a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:18.444487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1caac7c3-e618-4351-8fe1-bf774633749a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:18.444928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1caac7c3-e618-4351-8fe1-bf774633749a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:18.445664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1caac7c3-e618-4351-8fe1-bf774633749a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:18.446127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1caac7c3-e618-4351-8fe1-bf774633749a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:18.446567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1caac7c3-e618-4351-8fe1-bf774633749a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:18.449420 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d0343950-0c76-41d4-a973-e44626e23728 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:18.459315 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d0343950-0c76-41d4-a973-e44626e23728 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 200 len: 1712 microversion: 2.1 time: 0.191029 Oct 10 23:20:18.459913 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 479/960] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:18 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 1712 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:18.465189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f55dac6f-47eb-4968-a6f5-5ff744739494 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Action: 'create', calling method: .version_select at 0x7f662b5c4a60>, body: {"security_group": {"name": " tempest-securitygroup -839580722 ", "description": "tempest-description-1321015162"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:18.487779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1caac7c3-e618-4351-8fe1-bf774633749a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:20:18.573705 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1caac7c3-e618-4351-8fe1-bf774633749a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d" status: 204 len: 0 microversion: 2.1 time: 0.140061 Oct 10 23:20:18.574367 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 482/961] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:20:18 2022] DELETE /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:20:18.583153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bafb43d9-d2ef-40c5-860d-0a3c6abe14f9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:18.583853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bafb43d9-d2ef-40c5-860d-0a3c6abe14f9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:18.590405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bafb43d9-d2ef-40c5-860d-0a3c6abe14f9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:18.590562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bafb43d9-d2ef-40c5-860d-0a3c6abe14f9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:18.591546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bafb43d9-d2ef-40c5-860d-0a3c6abe14f9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:18.592358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bafb43d9-d2ef-40c5-860d-0a3c6abe14f9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:18.592740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bafb43d9-d2ef-40c5-860d-0a3c6abe14f9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:18.593162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bafb43d9-d2ef-40c5-860d-0a3c6abe14f9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:18.626324 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f55dac6f-47eb-4968-a6f5-5ff744739494 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.164899 Oct 10 23:20:18.626967 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 480/962] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:20:18 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:18.632320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e251f50d-0e2c-422b-a214-404dbcef4405 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:18.633071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e251f50d-0e2c-422b-a214-404dbcef4405 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:18.642749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e251f50d-0e2c-422b-a214-404dbcef4405 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:18.643258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e251f50d-0e2c-422b-a214-404dbcef4405 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:18.646354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e251f50d-0e2c-422b-a214-404dbcef4405 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:18.646354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e251f50d-0e2c-422b-a214-404dbcef4405 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:18.646354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e251f50d-0e2c-422b-a214-404dbcef4405 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:18.646354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e251f50d-0e2c-422b-a214-404dbcef4405 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:18.736659 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bafb43d9-d2ef-40c5-860d-0a3c6abe14f9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:18.744652 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bafb43d9-d2ef-40c5-860d-0a3c6abe14f9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1473 microversion: 2.1 time: 0.165484 Oct 10 23:20:18.745235 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 483/963] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:18 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1473 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:18.750091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8bcd45bb-9d45-422d-9d37-a3aa65e5ff63 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662b5055e0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:18.790240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e251f50d-0e2c-422b-a214-404dbcef4405 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:18.798641 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e251f50d-0e2c-422b-a214-404dbcef4405 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d" status: 200 len: 1473 microversion: 2.1 time: 0.170661 Oct 10 23:20:18.799218 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 481/964] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:18 2022] GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d => generated 1473 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:18.799345 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8bcd45bb-9d45-422d-9d37-a3aa65e5ff63 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/dadc641d-0288-4d88-99a8-b8641da8e24f" status: 200 len: 223 microversion: 2.1 time: 0.052919 Oct 10 23:20:18.799963 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 484/965] 10.222.0.23 () {58 vars in 1269 bytes} [Mon Oct 10 23:20:18 2022] GET /compute/v2.1/os-security-groups/dadc641d-0288-4d88-99a8-b8641da8e24f => generated 223 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:18.812043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e8a1da1f-ebe0-4ea2-a34a-6ec4465c2af0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662b5181f0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:18.860707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a14ee875-f085-4453-9981-29a721db6897 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:18.861327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a14ee875-f085-4453-9981-29a721db6897 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:18.867408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a14ee875-f085-4453-9981-29a721db6897 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:18.867894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a14ee875-f085-4453-9981-29a721db6897 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:18.868328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a14ee875-f085-4453-9981-29a721db6897 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:18.869010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a14ee875-f085-4453-9981-29a721db6897 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:18.869486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a14ee875-f085-4453-9981-29a721db6897 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:18.869904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a14ee875-f085-4453-9981-29a721db6897 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:18.992323 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e8a1da1f-ebe0-4ea2-a34a-6ec4465c2af0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/dadc641d-0288-4d88-99a8-b8641da8e24f" status: 202 len: 0 microversion: 2.1 time: 0.183937 Oct 10 23:20:18.996285 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 482/966] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:20:18 2022] DELETE /compute/v2.1/os-security-groups/dadc641d-0288-4d88-99a8-b8641da8e24f => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:20:19.001510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-16a58cf6-4866-4d29-8372-e029d559f296 req-abea09f0-53fb-4d07-b2ee-342d0a2dfa68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90cc20e4-bd05-44fc-931c-ddffba1494e6", "tag": "9cd0c0df-842e-4355-8798-be1d34e79325"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:19.014782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-16a58cf6-4866-4d29-8372-e029d559f296 req-abea09f0-53fb-4d07-b2ee-342d0a2dfa68 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:19.015225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a14ee875-f085-4453-9981-29a721db6897 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f553ef2324ac19370a181cf4c3629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2054001d7ed142698beaf51dcb6bd496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:19.015358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-16a58cf6-4866-4d29-8372-e029d559f296 req-abea09f0-53fb-4d07-b2ee-342d0a2dfa68 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:19.015690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-16a58cf6-4866-4d29-8372-e029d559f296 req-abea09f0-53fb-4d07-b2ee-342d0a2dfa68 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:19.023541 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a14ee875-f085-4453-9981-29a721db6897 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 200 len: 1316 microversion: 2.1 time: 0.167434 Oct 10 23:20:19.026867 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-16a58cf6-4866-4d29-8372-e029d559f296 req-abea09f0-53fb-4d07-b2ee-342d0a2dfa68 service nova] Creating event network-changed:9cd0c0df-842e-4355-8798-be1d34e79325 for instance 90cc20e4-bd05-44fc-931c-ddffba1494e6 on n-h2-860864-2 Oct 10 23:20:19.032666 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-16a58cf6-4866-4d29-8372-e029d559f296 req-abea09f0-53fb-4d07-b2ee-342d0a2dfa68 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035145 Oct 10 23:20:19.033352 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 483/967] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:19.037945 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 485/968] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:18 2022] GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:19.038296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ce11f636-4866-4d44-97fd-648fe419f895 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662b557700>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:19.061609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG neutronclient.v2_0.client [None req-ce11f636-4866-4d44-97fd-648fe419f895 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dadc641d-0288-4d88-99a8-b8641da8e24f does not exist", "detail": ""}} {{(pid=120614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:20:19.062204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.security_group_api [None req-ce11f636-4866-4d44-97fd-648fe419f895 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Neutron security group dadc641d-0288-4d88-99a8-b8641da8e24f not found {{(pid=120614) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 23:20:19.062757 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-ce11f636-4866-4d44-97fd-648fe419f895 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] HTTP exception thrown: Security group dadc641d-0288-4d88-99a8-b8641da8e24f does not exist Oct 10 23:20:19.062757 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-27eff69b-e6be-4409-b151-25446c4542fb'] Oct 10 23:20:19.064754 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ce11f636-4866-4d44-97fd-648fe419f895 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Request method failure captured: Oct 10 23:20:19.064754 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/os-security-groups/dadc641d-0288-4d88-99a8-b8641da8e24f HTTP/1.1 Oct 10 23:20:19.064754 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:20:19.064754 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:20:19.064754 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:20:19.064754 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:20:19.064754 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:20:19.064754 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:20:19.064754 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:20:19.064754 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:19.064754 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKiWDPhHeP1ao6Y5tHRbKvX9ZemW6vlLJ_C_MrPyGjEC179XpXPzYIbuoXBVNF4FDH7pzl8bOhuSRj1e7-5DcugU6k1KiwPFd9Qs6t3kjUe9RfKY0BXqex3wdvC4HjG24zVF2_841auDxOTWHziJVDjurPxpFpMsEGjqqP8S2TuKi34 Oct 10 23:20:19.064754 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:20:19.064754 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:20:19.064754 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:20:19.064754 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:20:19.064754 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:20:19.064754 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:20:19.064754 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:20:19.064754 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:20:19.064754 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:20:19.064754 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:20:19.066389 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_56fc65084a2a46689aa3b221e6d7aeb8", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:19.066389 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:20:19.066389 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:20:19.066389 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:20:19.066389 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:20:19.066389 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:20:19.066389 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:20:19.066389 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 9dfa7f1be9884bb1aabc9df8702fa630 Oct 10 23:20:19.066389 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:20:19.066389 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:20:19.066389 n-d-860864-2 devstack@n-api.service[120614]: exception: Security group dadc641d-0288-4d88-99a8-b8641da8e24f does not exist Oct 10 23:20:19.066389 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-27eff69b-e6be-4409-b151-25446c4542fb'] Oct 10 23:20:19.066389 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'dadc641d-0288-4d88-99a8-b8641da8e24f'} Oct 10 23:20:19.067306 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:19.067306 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:19.067306 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 23:20:19.067306 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 23:20:19.067306 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:19.067306 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:19.067306 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 23:20:19.067306 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 23:20:19.067306 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:19.067306 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:19.067306 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 23:20:19.067306 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 23:20:19.067306 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:19.067306 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:19.067306 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:20:19.067306 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:20:19.067306 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:19.067306 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:19.067306 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:20:19.068489 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:20:19.068489 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:19.068489 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:19.068489 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:20:19.068489 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:20:19.068489 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:20:19.068489 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:20:19.068489 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dadc641d-0288-4d88-99a8-b8641da8e24f does not exist Oct 10 23:20:19.068489 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27eff69b-e6be-4409-b151-25446c4542fb'] Oct 10 23:20:19.068489 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:19.068489 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:19.068489 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:19.068489 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:19.068489 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 10 23:20:19.068489 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 23:20:19.068489 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 23:20:19.068489 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 23:20:19.068489 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dadc641d-0288-4d88-99a8-b8641da8e24f does not exist Oct 10 23:20:19.070183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27eff69b-e6be-4409-b151-25446c4542fb'] Oct 10 23:20:19.070183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:19.070183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:19.070183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:19.070183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:19.070183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:19.070183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:19.070183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:19.070183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:19.070183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:20:19.070183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:20:19.070183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:19.070183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:19.070183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 10 23:20:19.070183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 23:20:19.070183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dadc641d-0288-4d88-99a8-b8641da8e24f does not exist Oct 10 23:20:19.070183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27eff69b-e6be-4409-b151-25446c4542fb'] Oct 10 23:20:19.070183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:19.070183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:19.070183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:19.070183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:19.072257 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:19.072257 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:19.072257 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:19.072257 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:19.072257 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dadc641d-0288-4d88-99a8-b8641da8e24f does not exist Oct 10 23:20:19.072257 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27eff69b-e6be-4409-b151-25446c4542fb'] Oct 10 23:20:19.072257 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:19.072257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ce11f636-4866-4d44-97fd-648fe419f895 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Returning 404 to user: Security group dadc641d-0288-4d88-99a8-b8641da8e24f does not exist Oct 10 23:20:19.072257 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-27eff69b-e6be-4409-b151-25446c4542fb'] {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:19.072257 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ce11f636-4866-4d44-97fd-648fe419f895 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/dadc641d-0288-4d88-99a8-b8641da8e24f" status: 404 len: 194 microversion: 2.1 time: 0.031717 Oct 10 23:20:19.072257 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 484/969] 10.222.0.23 () {58 vars in 1269 bytes} [Mon Oct 10 23:20:19 2022] GET /compute/v2.1/os-security-groups/dadc641d-0288-4d88-99a8-b8641da8e24f => generated 194 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:19.076702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4fcf0d48-61fb-4caa-836c-3f5a68153af6 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Action: 'create', calling method: .version_select at 0x7f662b7e80d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1569327838", "description": "tempest-description-484499652"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:19.214978 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4fcf0d48-61fb-4caa-836c-3f5a68153af6 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.142661 Oct 10 23:20:19.215587 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 486/970] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:20:19 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:19.229046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-96c333a7-3401-412b-863f-24f686b13ca2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Action: 'create', calling method: .version_select at 0x7f662b518c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-412282098", "description": "tempest-description-1339010415"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:19.290422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fa871756-2c0d-44e5-8329-8b5db818a1ae tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:19.291077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fa871756-2c0d-44e5-8329-8b5db818a1ae tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:19.298654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa871756-2c0d-44e5-8329-8b5db818a1ae tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:19.299153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa871756-2c0d-44e5-8329-8b5db818a1ae tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:19.299625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa871756-2c0d-44e5-8329-8b5db818a1ae tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:19.300338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa871756-2c0d-44e5-8329-8b5db818a1ae tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:19.300816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa871756-2c0d-44e5-8329-8b5db818a1ae tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:19.301236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa871756-2c0d-44e5-8329-8b5db818a1ae tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:19.375312 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-96c333a7-3401-412b-863f-24f686b13ca2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.149569 Oct 10 23:20:19.377068 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 485/971] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:20:19 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:19.398017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8a9172de-fa71-43d4-abaa-e080cdfc2b0f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Action: 'create', calling method: .version_select at 0x7f66305d6ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2137665283", "description": "tempest-description-921119169"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:19.458801 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fa871756-2c0d-44e5-8329-8b5db818a1ae tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:19.467484 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fa871756-2c0d-44e5-8329-8b5db818a1ae tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1522 microversion: 2.1 time: 0.180802 Oct 10 23:20:19.467915 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 487/972] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:19 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:19.472378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cf4203b7-69dd-4f72-b658-eabf4f46ff45 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:19.472983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cf4203b7-69dd-4f72-b658-eabf4f46ff45 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:19.478968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf4203b7-69dd-4f72-b658-eabf4f46ff45 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:19.479450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf4203b7-69dd-4f72-b658-eabf4f46ff45 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:19.479919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf4203b7-69dd-4f72-b658-eabf4f46ff45 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:19.480711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf4203b7-69dd-4f72-b658-eabf4f46ff45 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:19.481183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf4203b7-69dd-4f72-b658-eabf4f46ff45 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:19.481843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf4203b7-69dd-4f72-b658-eabf4f46ff45 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:19.560584 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8a9172de-fa71-43d4-abaa-e080cdfc2b0f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.166879 Oct 10 23:20:19.561498 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 486/973] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:20:19 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:19.567462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1f9f3149-f20d-44c6-9f07-7d8155484a93 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:19.568722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1f9f3149-f20d-44c6-9f07-7d8155484a93 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:19.576976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f9f3149-f20d-44c6-9f07-7d8155484a93 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:19.577693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f9f3149-f20d-44c6-9f07-7d8155484a93 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:19.578129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f9f3149-f20d-44c6-9f07-7d8155484a93 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:19.579015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f9f3149-f20d-44c6-9f07-7d8155484a93 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:19.579469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f9f3149-f20d-44c6-9f07-7d8155484a93 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:19.579887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f9f3149-f20d-44c6-9f07-7d8155484a93 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:19.635193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cf4203b7-69dd-4f72-b658-eabf4f46ff45 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:19.645621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cf4203b7-69dd-4f72-b658-eabf4f46ff45 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:19.648243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cf4203b7-69dd-4f72-b658-eabf4f46ff45 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:19.650478 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cf4203b7-69dd-4f72-b658-eabf4f46ff45 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1362 microversion: 2.25 time: 0.181622 Oct 10 23:20:19.651043 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 488/974] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:19 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:19.657848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c3eb8699-56b3-4c6b-bcd3-a51b195b7088 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662b5c7280>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:19.732774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1f9f3149-f20d-44c6-9f07-7d8155484a93 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:19.741586 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1f9f3149-f20d-44c6-9f07-7d8155484a93 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 200 len: 1712 microversion: 2.1 time: 0.178780 Oct 10 23:20:19.742243 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 487/975] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:19 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 1712 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:19.746672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-3fe31a01-e992-4ea2-8971-4c4f1fee012f req-4951637d-9352-4d9a-a0da-d5863829f162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26119603-9e9d-40bc-8b27-03e36c3c9f71", "tag": "06f29faa-7ff9-4ce5-8ccf-43416e2a4bf9"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:19.756320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3fe31a01-e992-4ea2-8971-4c4f1fee012f req-4951637d-9352-4d9a-a0da-d5863829f162 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:19.756792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3fe31a01-e992-4ea2-8971-4c4f1fee012f req-4951637d-9352-4d9a-a0da-d5863829f162 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:19.757214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3fe31a01-e992-4ea2-8971-4c4f1fee012f req-4951637d-9352-4d9a-a0da-d5863829f162 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:19.769623 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-3fe31a01-e992-4ea2-8971-4c4f1fee012f req-4951637d-9352-4d9a-a0da-d5863829f162 service nova] Creating event network-changed:06f29faa-7ff9-4ce5-8ccf-43416e2a4bf9 for instance 26119603-9e9d-40bc-8b27-03e36c3c9f71 on n-h1-860864-2 Oct 10 23:20:19.774583 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-3fe31a01-e992-4ea2-8971-4c4f1fee012f req-4951637d-9352-4d9a-a0da-d5863829f162 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031186 Oct 10 23:20:19.775164 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 488/976] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:19.781096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0e71bbf2-09f7-4122-864f-87ae167ca8de tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:19.781811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0e71bbf2-09f7-4122-864f-87ae167ca8de tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:19.787733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e71bbf2-09f7-4122-864f-87ae167ca8de tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:19.788211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e71bbf2-09f7-4122-864f-87ae167ca8de tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:19.788667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e71bbf2-09f7-4122-864f-87ae167ca8de tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:19.790366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e71bbf2-09f7-4122-864f-87ae167ca8de tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:19.790820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e71bbf2-09f7-4122-864f-87ae167ca8de tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:19.791240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e71bbf2-09f7-4122-864f-87ae167ca8de tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:19.865878 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c3eb8699-56b3-4c6b-bcd3-a51b195b7088 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.212714 Oct 10 23:20:19.866475 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 489/977] 10.222.0.23 () {58 vars in 1158 bytes} [Mon Oct 10 23:20:19 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:19.871562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-812368f5-0c91-4a7c-9f28-f011d5fc2ac3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:19.872397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-812368f5-0c91-4a7c-9f28-f011d5fc2ac3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:19.878872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-812368f5-0c91-4a7c-9f28-f011d5fc2ac3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:19.879361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-812368f5-0c91-4a7c-9f28-f011d5fc2ac3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:19.879792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-812368f5-0c91-4a7c-9f28-f011d5fc2ac3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:19.880525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-812368f5-0c91-4a7c-9f28-f011d5fc2ac3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:19.880978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-812368f5-0c91-4a7c-9f28-f011d5fc2ac3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:19.881429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-812368f5-0c91-4a7c-9f28-f011d5fc2ac3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:19.933818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0e71bbf2-09f7-4122-864f-87ae167ca8de tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:19.941993 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0e71bbf2-09f7-4122-864f-87ae167ca8de tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1473 microversion: 2.1 time: 0.165675 Oct 10 23:20:19.942822 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 489/978] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:19 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1473 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:19.947042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e230148e-ab50-47c6-9dbd-9a5758fd734e tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662b52cdc0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:20.021771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-812368f5-0c91-4a7c-9f28-f011d5fc2ac3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:20.030714 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-812368f5-0c91-4a7c-9f28-f011d5fc2ac3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d" status: 200 len: 1473 microversion: 2.1 time: 0.163038 Oct 10 23:20:20.031290 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 490/979] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:19 2022] GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d => generated 1473 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:20.047210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d2fd467c-c4ba-4d2f-aa7a-80d0e1440cd0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:20.047818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d2fd467c-c4ba-4d2f-aa7a-80d0e1440cd0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:20.053881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2fd467c-c4ba-4d2f-aa7a-80d0e1440cd0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:20.054366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2fd467c-c4ba-4d2f-aa7a-80d0e1440cd0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:20.054799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2fd467c-c4ba-4d2f-aa7a-80d0e1440cd0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:20.055482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2fd467c-c4ba-4d2f-aa7a-80d0e1440cd0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:20.055918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2fd467c-c4ba-4d2f-aa7a-80d0e1440cd0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:20.056337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2fd467c-c4ba-4d2f-aa7a-80d0e1440cd0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:20.133023 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e230148e-ab50-47c6-9dbd-9a5758fd734e tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/d4039f9a-cc27-4839-b812-036178c7697b" status: 202 len: 0 microversion: 2.1 time: 0.189368 Oct 10 23:20:20.134634 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 490/980] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:20:19 2022] DELETE /compute/v2.1/os-security-groups/d4039f9a-cc27-4839-b812-036178c7697b => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:20:20.140232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-500ca240-c1ff-4a13-aab7-34e83013e1e0 req-70d67910-417c-4f6a-9034-0209875e7672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f81164-31f2-4f4b-9ec5-1e2ee8416c7b", "name": "network-vif-unplugged", "status": "completed", "tag": "1a0d0d6b-022c-4c38-bd51-d8b961af213c"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:20.153795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-500ca240-c1ff-4a13-aab7-34e83013e1e0 req-70d67910-417c-4f6a-9034-0209875e7672 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:20.154911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-500ca240-c1ff-4a13-aab7-34e83013e1e0 req-70d67910-417c-4f6a-9034-0209875e7672 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:20.155834 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-500ca240-c1ff-4a13-aab7-34e83013e1e0 req-70d67910-417c-4f6a-9034-0209875e7672 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:20.186177 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-500ca240-c1ff-4a13-aab7-34e83013e1e0 req-70d67910-417c-4f6a-9034-0209875e7672 service nova] Creating event network-vif-unplugged:1a0d0d6b-022c-4c38-bd51-d8b961af213c for instance 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b on n-h2-860864-2 Oct 10 23:20:20.193105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [req-500ca240-c1ff-4a13-aab7-34e83013e1e0 req-70d67910-417c-4f6a-9034-0209875e7672 service nova] Instance 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2'} {{(pid=120614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 23:20:20.199933 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-500ca240-c1ff-4a13-aab7-34e83013e1e0 req-70d67910-417c-4f6a-9034-0209875e7672 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064118 Oct 10 23:20:20.201823 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 491/981] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:20.208623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c03c3551-9401-4991-b416-e18c232401a3 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662b518790>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:20.214543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d2fd467c-c4ba-4d2f-aa7a-80d0e1440cd0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f553ef2324ac19370a181cf4c3629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2054001d7ed142698beaf51dcb6bd496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:20.217340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=18 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:20.224988 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d2fd467c-c4ba-4d2f-aa7a-80d0e1440cd0 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 200 len: 1316 microversion: 2.1 time: 0.181634 Oct 10 23:20:20.225601 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 491/982] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:20 2022] GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 1316 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:20.234685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG neutronclient.v2_0.client [None req-c03c3551-9401-4991-b416-e18c232401a3 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d4039f9a-cc27-4839-b812-036178c7697b does not exist", "detail": ""}} {{(pid=120614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:20:20.235837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.security_group_api [None req-c03c3551-9401-4991-b416-e18c232401a3 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Neutron security group d4039f9a-cc27-4839-b812-036178c7697b not found {{(pid=120614) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 23:20:20.236541 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-c03c3551-9401-4991-b416-e18c232401a3 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] HTTP exception thrown: Security group d4039f9a-cc27-4839-b812-036178c7697b does not exist Oct 10 23:20:20.236541 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-e9635f15-e178-487b-a85a-a78a700f272b'] Oct 10 23:20:20.239288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c03c3551-9401-4991-b416-e18c232401a3 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Request method failure captured: Oct 10 23:20:20.239288 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/os-security-groups/d4039f9a-cc27-4839-b812-036178c7697b HTTP/1.1 Oct 10 23:20:20.239288 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:20:20.239288 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:20:20.239288 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:20:20.239288 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:20:20.239288 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:20:20.239288 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:20:20.239288 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:20:20.239288 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:20.239288 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKiWDPhHeP1ao6Y5tHRbKvX9ZemW6vlLJ_C_MrPyGjEC179XpXPzYIbuoXBVNF4FDH7pzl8bOhuSRj1e7-5DcugU6k1KiwPFd9Qs6t3kjUe9RfKY0BXqex3wdvC4HjG24zVF2_841auDxOTWHziJVDjurPxpFpMsEGjqqP8S2TuKi34 Oct 10 23:20:20.239288 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:20:20.239288 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:20:20.239288 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:20:20.239288 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:20:20.239288 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:20:20.239288 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:20:20.239288 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:20:20.239288 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:20:20.239288 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:20:20.239288 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:20:20.240757 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_56fc65084a2a46689aa3b221e6d7aeb8", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:20.240757 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:20:20.240757 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:20:20.240757 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:20:20.240757 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:20:20.240757 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:20:20.240757 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:20:20.240757 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 9dfa7f1be9884bb1aabc9df8702fa630 Oct 10 23:20:20.240757 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:20:20.240757 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:20:20.240757 n-d-860864-2 devstack@n-api.service[120614]: exception: Security group d4039f9a-cc27-4839-b812-036178c7697b does not exist Oct 10 23:20:20.240757 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-e9635f15-e178-487b-a85a-a78a700f272b'] Oct 10 23:20:20.240757 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'd4039f9a-cc27-4839-b812-036178c7697b'} Oct 10 23:20:20.241623 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:20.241623 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:20.241623 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 23:20:20.241623 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 23:20:20.241623 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:20.241623 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:20.241623 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 23:20:20.241623 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 23:20:20.241623 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:20.241623 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:20.241623 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 23:20:20.241623 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 23:20:20.241623 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:20.241623 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:20.241623 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:20:20.241623 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:20:20.241623 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:20.241623 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:20.241623 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:20:20.242818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:20:20.242818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:20.242818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:20.242818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:20:20.242818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:20:20.242818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:20:20.242818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:20:20.242818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d4039f9a-cc27-4839-b812-036178c7697b does not exist Oct 10 23:20:20.242818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9635f15-e178-487b-a85a-a78a700f272b'] Oct 10 23:20:20.242818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:20.242818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:20.242818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:20.242818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:20.242818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 10 23:20:20.242818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 23:20:20.242818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 23:20:20.242818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 23:20:20.242818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d4039f9a-cc27-4839-b812-036178c7697b does not exist Oct 10 23:20:20.244105 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9635f15-e178-487b-a85a-a78a700f272b'] Oct 10 23:20:20.244105 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:20.244105 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:20.244105 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:20.244105 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:20.244105 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:20.244105 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:20.244105 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:20.244105 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:20.244105 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:20:20.244105 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:20:20.244105 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:20.244105 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:20.244105 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 10 23:20:20.244105 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 23:20:20.244105 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d4039f9a-cc27-4839-b812-036178c7697b does not exist Oct 10 23:20:20.244105 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9635f15-e178-487b-a85a-a78a700f272b'] Oct 10 23:20:20.244105 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:20.244105 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:20.244105 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:20.244105 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:20.245473 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:20.245473 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:20.245473 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:20.245473 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:20.245473 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d4039f9a-cc27-4839-b812-036178c7697b does not exist Oct 10 23:20:20.245473 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9635f15-e178-487b-a85a-a78a700f272b'] Oct 10 23:20:20.245473 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:20.245473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c03c3551-9401-4991-b416-e18c232401a3 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Returning 404 to user: Security group d4039f9a-cc27-4839-b812-036178c7697b does not exist Oct 10 23:20:20.245473 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-e9635f15-e178-487b-a85a-a78a700f272b'] {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:20.245473 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c03c3551-9401-4991-b416-e18c232401a3 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/d4039f9a-cc27-4839-b812-036178c7697b" status: 404 len: 194 microversion: 2.1 time: 0.037505 Oct 10 23:20:20.245473 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 492/983] 10.222.0.23 () {58 vars in 1269 bytes} [Mon Oct 10 23:20:20 2022] GET /compute/v2.1/os-security-groups/d4039f9a-cc27-4839-b812-036178c7697b => generated 194 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:20.250664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-66cd90cd-b129-473a-9178-1d298c80f9e2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f66301a38b0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:20.486871 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-66cd90cd-b129-473a-9178-1d298c80f9e2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/1feac7cf-97a1-4526-bd43-41317c1ba275" status: 202 len: 0 microversion: 2.1 time: 0.241158 Oct 10 23:20:20.492210 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 492/984] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:20:20 2022] DELETE /compute/v2.1/os-security-groups/1feac7cf-97a1-4526-bd43-41317c1ba275 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:20:20.492562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5f1cb06d-7a34-49b9-b615-c15dceb5fa58 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:20.494878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5f1cb06d-7a34-49b9-b615-c15dceb5fa58 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:20.501552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9f98014e-4446-42f2-969f-c8b1a07957eb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662b4e7430>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:20.507610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f1cb06d-7a34-49b9-b615-c15dceb5fa58 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:20.509657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f1cb06d-7a34-49b9-b615-c15dceb5fa58 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:20.510299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f1cb06d-7a34-49b9-b615-c15dceb5fa58 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:20.514712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f1cb06d-7a34-49b9-b615-c15dceb5fa58 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:20.515221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f1cb06d-7a34-49b9-b615-c15dceb5fa58 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:20.515666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f1cb06d-7a34-49b9-b615-c15dceb5fa58 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:20.553568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG neutronclient.v2_0.client [None req-9f98014e-4446-42f2-969f-c8b1a07957eb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1feac7cf-97a1-4526-bd43-41317c1ba275 does not exist", "detail": ""}} {{(pid=120613) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:20:20.554650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.security_group_api [None req-9f98014e-4446-42f2-969f-c8b1a07957eb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Neutron security group 1feac7cf-97a1-4526-bd43-41317c1ba275 not found {{(pid=120613) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 23:20:20.555371 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-9f98014e-4446-42f2-969f-c8b1a07957eb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] HTTP exception thrown: Security group 1feac7cf-97a1-4526-bd43-41317c1ba275 does not exist Oct 10 23:20:20.555371 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-dc10bb97-9601-44e6-b6a9-7553b96fe1e4'] Oct 10 23:20:20.557795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9f98014e-4446-42f2-969f-c8b1a07957eb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Request method failure captured: Oct 10 23:20:20.557795 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-security-groups/1feac7cf-97a1-4526-bd43-41317c1ba275 HTTP/1.1 Oct 10 23:20:20.557795 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:20:20.557795 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:20:20.557795 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:20:20.557795 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:20:20.557795 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:20:20.557795 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:20:20.557795 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:20:20.557795 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:20.557795 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKiWDPhHeP1ao6Y5tHRbKvX9ZemW6vlLJ_C_MrPyGjEC179XpXPzYIbuoXBVNF4FDH7pzl8bOhuSRj1e7-5DcugU6k1KiwPFd9Qs6t3kjUe9RfKY0BXqex3wdvC4HjG24zVF2_841auDxOTWHziJVDjurPxpFpMsEGjqqP8S2TuKi34 Oct 10 23:20:20.557795 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:20:20.557795 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:20:20.557795 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:20:20.557795 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:20:20.557795 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:20:20.557795 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:20:20.557795 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:20:20.557795 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:20:20.557795 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:20:20.557795 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:20:20.559140 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_56fc65084a2a46689aa3b221e6d7aeb8", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:20.559140 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:20:20.559140 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:20:20.559140 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:20:20.559140 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:20:20.559140 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:20:20.559140 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:20:20.559140 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 9dfa7f1be9884bb1aabc9df8702fa630 Oct 10 23:20:20.559140 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:20:20.559140 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:20:20.559140 n-d-860864-2 devstack@n-api.service[120613]: exception: Security group 1feac7cf-97a1-4526-bd43-41317c1ba275 does not exist Oct 10 23:20:20.559140 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-dc10bb97-9601-44e6-b6a9-7553b96fe1e4'] Oct 10 23:20:20.559140 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '1feac7cf-97a1-4526-bd43-41317c1ba275'} Oct 10 23:20:20.560488 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:20.560488 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:20.560488 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 23:20:20.560488 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 23:20:20.560488 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:20.560488 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:20.560488 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 23:20:20.560488 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 23:20:20.560488 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:20.560488 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:20.560488 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 23:20:20.560488 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 23:20:20.560488 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:20.560488 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:20.560488 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:20:20.560488 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:20:20.560488 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:20.560488 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:20.560488 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:20:20.561694 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:20:20.561694 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:20.561694 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:20.561694 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:20:20.561694 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:20:20.561694 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:20:20.561694 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:20:20.561694 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1feac7cf-97a1-4526-bd43-41317c1ba275 does not exist Oct 10 23:20:20.561694 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc10bb97-9601-44e6-b6a9-7553b96fe1e4'] Oct 10 23:20:20.561694 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:20.561694 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:20.561694 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:20.561694 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:20.561694 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 10 23:20:20.561694 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 23:20:20.561694 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 23:20:20.561694 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 23:20:20.561694 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1feac7cf-97a1-4526-bd43-41317c1ba275 does not exist Oct 10 23:20:20.562817 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc10bb97-9601-44e6-b6a9-7553b96fe1e4'] Oct 10 23:20:20.562817 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:20.562817 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:20.562817 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:20.562817 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:20.562817 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:20.562817 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:20.562817 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:20.562817 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:20.562817 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:20:20.562817 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:20:20.562817 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:20.562817 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:20.562817 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 10 23:20:20.562817 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 23:20:20.562817 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1feac7cf-97a1-4526-bd43-41317c1ba275 does not exist Oct 10 23:20:20.562817 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc10bb97-9601-44e6-b6a9-7553b96fe1e4'] Oct 10 23:20:20.562817 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:20.562817 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:20.562817 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:20.562817 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:20.564083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:20.564083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:20.564083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:20.564083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:20.564083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1feac7cf-97a1-4526-bd43-41317c1ba275 does not exist Oct 10 23:20:20.564083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc10bb97-9601-44e6-b6a9-7553b96fe1e4'] Oct 10 23:20:20.564083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:20.566351 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9f98014e-4446-42f2-969f-c8b1a07957eb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Returning 404 to user: Security group 1feac7cf-97a1-4526-bd43-41317c1ba275 does not exist Oct 10 23:20:20.566351 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-dc10bb97-9601-44e6-b6a9-7553b96fe1e4'] {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:20.567705 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9f98014e-4446-42f2-969f-c8b1a07957eb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/1feac7cf-97a1-4526-bd43-41317c1ba275" status: 404 len: 194 microversion: 2.1 time: 0.073799 Oct 10 23:20:20.568778 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 493/985] 10.222.0.23 () {58 vars in 1269 bytes} [Mon Oct 10 23:20:20 2022] GET /compute/v2.1/os-security-groups/1feac7cf-97a1-4526-bd43-41317c1ba275 => generated 194 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:20.577032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-90ceb58a-3b62-4985-b265-b36a602672c5 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662b56daf0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:20.713241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=12 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:20.771062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5f1cb06d-7a34-49b9-b615-c15dceb5fa58 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:20.780024 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5f1cb06d-7a34-49b9-b615-c15dceb5fa58 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1522 microversion: 2.1 time: 0.291981 Oct 10 23:20:20.780741 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 493/986] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:20 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:20.785657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-92015f80-f430-409c-b4f8-546460ad9397 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:20.786277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-92015f80-f430-409c-b4f8-546460ad9397 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:20.792215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92015f80-f430-409c-b4f8-546460ad9397 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:20.792947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92015f80-f430-409c-b4f8-546460ad9397 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:20.793400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92015f80-f430-409c-b4f8-546460ad9397 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:20.794711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92015f80-f430-409c-b4f8-546460ad9397 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:20.795168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92015f80-f430-409c-b4f8-546460ad9397 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:20.795592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92015f80-f430-409c-b4f8-546460ad9397 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:20.981229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-92015f80-f430-409c-b4f8-546460ad9397 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:20.990434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-92015f80-f430-409c-b4f8-546460ad9397 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:20.991779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-92015f80-f430-409c-b4f8-546460ad9397 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:20.993216 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-92015f80-f430-409c-b4f8-546460ad9397 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1362 microversion: 2.25 time: 0.211430 Oct 10 23:20:20.994285 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 494/987] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:20 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:21.000281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4803fe70-e0d1-42a0-9fd6-df04c3d96828 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:21.001069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4803fe70-e0d1-42a0-9fd6-df04c3d96828 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:21.007291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4803fe70-e0d1-42a0-9fd6-df04c3d96828 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:21.007958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4803fe70-e0d1-42a0-9fd6-df04c3d96828 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:21.008830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4803fe70-e0d1-42a0-9fd6-df04c3d96828 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:21.009721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4803fe70-e0d1-42a0-9fd6-df04c3d96828 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:21.010342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4803fe70-e0d1-42a0-9fd6-df04c3d96828 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:21.010914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4803fe70-e0d1-42a0-9fd6-df04c3d96828 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:21.023541 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-90ceb58a-3b62-4985-b265-b36a602672c5 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/3648d6c5-3f7a-469e-8d0e-0eaffc5de75c" status: 202 len: 0 microversion: 2.1 time: 0.450680 Oct 10 23:20:21.024547 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 494/988] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:20:20 2022] DELETE /compute/v2.1/os-security-groups/3648d6c5-3f7a-469e-8d0e-0eaffc5de75c => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 23:20:21.032334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-abd334f6-9863-4c95-87eb-745af14bb090 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:21.033438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-abd334f6-9863-4c95-87eb-745af14bb090 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:21.061669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abd334f6-9863-4c95-87eb-745af14bb090 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:21.062618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abd334f6-9863-4c95-87eb-745af14bb090 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:21.063294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abd334f6-9863-4c95-87eb-745af14bb090 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:21.064218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abd334f6-9863-4c95-87eb-745af14bb090 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:21.065504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abd334f6-9863-4c95-87eb-745af14bb090 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:21.066094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abd334f6-9863-4c95-87eb-745af14bb090 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:21.135576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=21 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:21.269091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4803fe70-e0d1-42a0-9fd6-df04c3d96828 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:21.286873 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4803fe70-e0d1-42a0-9fd6-df04c3d96828 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 200 len: 1712 microversion: 2.1 time: 0.291303 Oct 10 23:20:21.290263 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 495/989] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:20 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 1712 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:21.295964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a6a66ab2-64e1-4636-8a3a-5ddb9157a649 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662b52cc10>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:21.305903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-abd334f6-9863-4c95-87eb-745af14bb090 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:21.315254 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-abd334f6-9863-4c95-87eb-745af14bb090 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1473 microversion: 2.1 time: 0.288016 Oct 10 23:20:21.319037 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 495/990] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:21 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1473 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:21.324423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e467d2f4-8731-4aa4-9443-1de2f59167f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:21.325115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e467d2f4-8731-4aa4-9443-1de2f59167f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:21.332993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e467d2f4-8731-4aa4-9443-1de2f59167f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:21.333792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e467d2f4-8731-4aa4-9443-1de2f59167f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:21.334220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e467d2f4-8731-4aa4-9443-1de2f59167f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:21.335154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e467d2f4-8731-4aa4-9443-1de2f59167f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:21.335761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e467d2f4-8731-4aa4-9443-1de2f59167f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:21.336511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e467d2f4-8731-4aa4-9443-1de2f59167f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:21.361607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG neutronclient.v2_0.client [None req-a6a66ab2-64e1-4636-8a3a-5ddb9157a649 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3648d6c5-3f7a-469e-8d0e-0eaffc5de75c does not exist", "detail": ""}} {{(pid=120614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:20:21.362949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.security_group_api [None req-a6a66ab2-64e1-4636-8a3a-5ddb9157a649 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Neutron security group 3648d6c5-3f7a-469e-8d0e-0eaffc5de75c not found {{(pid=120614) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 23:20:21.363715 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-a6a66ab2-64e1-4636-8a3a-5ddb9157a649 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] HTTP exception thrown: Security group 3648d6c5-3f7a-469e-8d0e-0eaffc5de75c does not exist Oct 10 23:20:21.363715 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-c54569e0-24b4-4799-b211-49525e8adfd2'] Oct 10 23:20:21.366882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a6a66ab2-64e1-4636-8a3a-5ddb9157a649 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Request method failure captured: Oct 10 23:20:21.366882 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/os-security-groups/3648d6c5-3f7a-469e-8d0e-0eaffc5de75c HTTP/1.1 Oct 10 23:20:21.366882 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:20:21.366882 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:20:21.366882 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:20:21.366882 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:20:21.366882 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:20:21.366882 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:20:21.366882 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:20:21.366882 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:21.366882 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKiWDPhHeP1ao6Y5tHRbKvX9ZemW6vlLJ_C_MrPyGjEC179XpXPzYIbuoXBVNF4FDH7pzl8bOhuSRj1e7-5DcugU6k1KiwPFd9Qs6t3kjUe9RfKY0BXqex3wdvC4HjG24zVF2_841auDxOTWHziJVDjurPxpFpMsEGjqqP8S2TuKi34 Oct 10 23:20:21.366882 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:20:21.366882 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:20:21.366882 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:20:21.366882 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:20:21.366882 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:20:21.366882 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:20:21.366882 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:20:21.366882 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:20:21.366882 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:20:21.366882 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:20:21.368533 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_56fc65084a2a46689aa3b221e6d7aeb8", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:21.368533 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:20:21.368533 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:20:21.368533 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:20:21.368533 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:20:21.368533 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:20:21.368533 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:20:21.368533 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 9dfa7f1be9884bb1aabc9df8702fa630 Oct 10 23:20:21.368533 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:20:21.368533 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:20:21.368533 n-d-860864-2 devstack@n-api.service[120614]: exception: Security group 3648d6c5-3f7a-469e-8d0e-0eaffc5de75c does not exist Oct 10 23:20:21.368533 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-c54569e0-24b4-4799-b211-49525e8adfd2'] Oct 10 23:20:21.368533 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '3648d6c5-3f7a-469e-8d0e-0eaffc5de75c'} Oct 10 23:20:21.369766 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:21.369766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:21.369766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 23:20:21.369766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 23:20:21.369766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:21.369766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:21.369766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 23:20:21.369766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 23:20:21.369766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:21.369766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:21.369766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 23:20:21.369766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 23:20:21.369766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:21.369766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:21.369766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:20:21.369766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:20:21.369766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:21.369766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:21.369766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:20:21.370918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:20:21.370918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:21.370918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:21.370918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:20:21.370918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:20:21.370918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:20:21.370918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:20:21.370918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3648d6c5-3f7a-469e-8d0e-0eaffc5de75c does not exist Oct 10 23:20:21.370918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c54569e0-24b4-4799-b211-49525e8adfd2'] Oct 10 23:20:21.370918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:21.370918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:21.370918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:21.370918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:21.370918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 10 23:20:21.370918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 23:20:21.370918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 23:20:21.370918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 23:20:21.370918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3648d6c5-3f7a-469e-8d0e-0eaffc5de75c does not exist Oct 10 23:20:21.371996 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c54569e0-24b4-4799-b211-49525e8adfd2'] Oct 10 23:20:21.371996 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:21.371996 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:21.371996 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:21.371996 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:21.371996 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:21.371996 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:21.371996 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:21.371996 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:21.371996 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:20:21.371996 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:20:21.371996 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:21.371996 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:21.371996 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 10 23:20:21.371996 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 23:20:21.371996 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3648d6c5-3f7a-469e-8d0e-0eaffc5de75c does not exist Oct 10 23:20:21.371996 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c54569e0-24b4-4799-b211-49525e8adfd2'] Oct 10 23:20:21.371996 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:21.371996 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:21.371996 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:21.371996 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:21.373894 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:21.373894 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:21.373894 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:21.373894 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:21.373894 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3648d6c5-3f7a-469e-8d0e-0eaffc5de75c does not exist Oct 10 23:20:21.373894 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c54569e0-24b4-4799-b211-49525e8adfd2'] Oct 10 23:20:21.373894 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:21.377208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a6a66ab2-64e1-4636-8a3a-5ddb9157a649 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Returning 404 to user: Security group 3648d6c5-3f7a-469e-8d0e-0eaffc5de75c does not exist Oct 10 23:20:21.377208 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-c54569e0-24b4-4799-b211-49525e8adfd2'] {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:21.378466 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a6a66ab2-64e1-4636-8a3a-5ddb9157a649 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/3648d6c5-3f7a-469e-8d0e-0eaffc5de75c" status: 404 len: 194 microversion: 2.1 time: 0.086989 Oct 10 23:20:21.379576 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 496/991] 10.222.0.23 () {58 vars in 1269 bytes} [Mon Oct 10 23:20:21 2022] GET /compute/v2.1/os-security-groups/3648d6c5-3f7a-469e-8d0e-0eaffc5de75c => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:21.384878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-81746d5f-1856-4547-9863-23ea08e79241 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:21.385949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-81746d5f-1856-4547-9863-23ea08e79241 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:21.394709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81746d5f-1856-4547-9863-23ea08e79241 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:21.395582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81746d5f-1856-4547-9863-23ea08e79241 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:21.396229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81746d5f-1856-4547-9863-23ea08e79241 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:21.397152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81746d5f-1856-4547-9863-23ea08e79241 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:21.397826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81746d5f-1856-4547-9863-23ea08e79241 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:21.398448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81746d5f-1856-4547-9863-23ea08e79241 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:21.524734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e467d2f4-8731-4aa4-9443-1de2f59167f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:21.534399 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e467d2f4-8731-4aa4-9443-1de2f59167f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d" status: 200 len: 1473 microversion: 2.1 time: 0.214206 Oct 10 23:20:21.535310 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 496/992] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:21 2022] GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d => generated 1473 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:21.540000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4af668bd-0fc7-4b77-8324-211403ba26ba tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662b5c7790>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:21.622485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-81746d5f-1856-4547-9863-23ea08e79241 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f553ef2324ac19370a181cf4c3629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2054001d7ed142698beaf51dcb6bd496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:21.630878 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-81746d5f-1856-4547-9863-23ea08e79241 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 200 len: 1316 microversion: 2.1 time: 0.249997 Oct 10 23:20:21.631740 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 497/993] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:21 2022] GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 1316 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:21.713612 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4af668bd-0fc7-4b77-8324-211403ba26ba tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.176905 Oct 10 23:20:21.714125 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 497/994] 10.222.0.23 () {58 vars in 1158 bytes} [Mon Oct 10 23:20:21 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:21.730714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9f1da0d8-9b6e-452f-8624-86fb0212a145 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Action: 'create', calling method: .version_select at 0x7f662b56f040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1684888195", "description": "tempest-description-638894716"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:21.804264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-23f99b52-6186-448f-b04b-d76a7df56c77 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:21.805268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-23f99b52-6186-448f-b04b-d76a7df56c77 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:21.818467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23f99b52-6186-448f-b04b-d76a7df56c77 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:21.819143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23f99b52-6186-448f-b04b-d76a7df56c77 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:21.819720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23f99b52-6186-448f-b04b-d76a7df56c77 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:21.821600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23f99b52-6186-448f-b04b-d76a7df56c77 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:21.822244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23f99b52-6186-448f-b04b-d76a7df56c77 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:21.823944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23f99b52-6186-448f-b04b-d76a7df56c77 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:21.961658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-23f99b52-6186-448f-b04b-d76a7df56c77 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:21.970447 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-23f99b52-6186-448f-b04b-d76a7df56c77 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1522 microversion: 2.1 time: 0.170020 Oct 10 23:20:21.971245 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 498/995] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:21 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:22.023008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-39f8e8a8-3fae-4bb7-8940-22ded9ba29b2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:22.023655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-39f8e8a8-3fae-4bb7-8940-22ded9ba29b2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:22.030396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39f8e8a8-3fae-4bb7-8940-22ded9ba29b2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:22.030882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39f8e8a8-3fae-4bb7-8940-22ded9ba29b2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:22.031319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39f8e8a8-3fae-4bb7-8940-22ded9ba29b2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:22.032019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39f8e8a8-3fae-4bb7-8940-22ded9ba29b2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:22.032469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39f8e8a8-3fae-4bb7-8940-22ded9ba29b2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:22.032894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39f8e8a8-3fae-4bb7-8940-22ded9ba29b2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:22.048564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:22.054454 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9f1da0d8-9b6e-452f-8624-86fb0212a145 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.327613 Oct 10 23:20:22.055231 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 498/996] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:20:21 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:22.069056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-218cce45-abf1-4e7c-b04b-2d63e6f6de3d tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Action: 'create', calling method: .version_select at 0x7f662b5c43a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1422107415", "description": "tempest-description-288457378"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:22.182170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-39f8e8a8-3fae-4bb7-8940-22ded9ba29b2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:22.191987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-39f8e8a8-3fae-4bb7-8940-22ded9ba29b2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:22.193504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-39f8e8a8-3fae-4bb7-8940-22ded9ba29b2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:22.194642 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-39f8e8a8-3fae-4bb7-8940-22ded9ba29b2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1362 microversion: 2.25 time: 0.175586 Oct 10 23:20:22.195203 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 499/997] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:22 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:20:22.315791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bdf95fbd-5aea-477b-9825-4a8fc4c7144f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:22.316438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bdf95fbd-5aea-477b-9825-4a8fc4c7144f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:22.321761 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-218cce45-abf1-4e7c-b04b-2d63e6f6de3d tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.252323 Oct 10 23:20:22.322412 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 499/998] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:20:22 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:20:22.322832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdf95fbd-5aea-477b-9825-4a8fc4c7144f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:22.323402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdf95fbd-5aea-477b-9825-4a8fc4c7144f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:22.324016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdf95fbd-5aea-477b-9825-4a8fc4c7144f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:22.326506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdf95fbd-5aea-477b-9825-4a8fc4c7144f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:22.327157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdf95fbd-5aea-477b-9825-4a8fc4c7144f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:22.327774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdf95fbd-5aea-477b-9825-4a8fc4c7144f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:22.347099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9b59a4a7-2690-418b-841a-bc6d08722937 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:22.348338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9b59a4a7-2690-418b-841a-bc6d08722937 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:22.356236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:22.359632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b59a4a7-2690-418b-841a-bc6d08722937 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:22.360401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b59a4a7-2690-418b-841a-bc6d08722937 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:22.361908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b59a4a7-2690-418b-841a-bc6d08722937 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:22.362928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b59a4a7-2690-418b-841a-bc6d08722937 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:22.364301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b59a4a7-2690-418b-841a-bc6d08722937 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:22.364978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b59a4a7-2690-418b-841a-bc6d08722937 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:22.510590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bdf95fbd-5aea-477b-9825-4a8fc4c7144f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:22.521226 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bdf95fbd-5aea-477b-9825-4a8fc4c7144f tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 200 len: 1712 microversion: 2.1 time: 0.209956 Oct 10 23:20:22.521961 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 500/999] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:22 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 1712 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:22.526791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-73cce290-88df-4fa5-8489-f97889b48503 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1769794864", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "6f6758f8-cea0-4c07-90bd-fe7352ffe3a0"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:22.564200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9b59a4a7-2690-418b-841a-bc6d08722937 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:22.573087 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9b59a4a7-2690-418b-841a-bc6d08722937 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1473 microversion: 2.1 time: 0.232370 Oct 10 23:20:22.574204 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 500/1000] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:22 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1473 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:22.579429 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-10f7c295-fb32-4b3d-b984-0e4049ccb8f9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:22.580344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-10f7c295-fb32-4b3d-b984-0e4049ccb8f9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:22.587514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10f7c295-fb32-4b3d-b984-0e4049ccb8f9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:22.587766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10f7c295-fb32-4b3d-b984-0e4049ccb8f9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:22.588363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10f7c295-fb32-4b3d-b984-0e4049ccb8f9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:22.588967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10f7c295-fb32-4b3d-b984-0e4049ccb8f9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:22.589453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10f7c295-fb32-4b3d-b984-0e4049ccb8f9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:22.589895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10f7c295-fb32-4b3d-b984-0e4049ccb8f9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:22.604979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-73cce290-88df-4fa5-8489-f97889b48503 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] validate_networks() for [('6f6758f8-cea0-4c07-90bd-fe7352ffe3a0', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:20:22.742517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-10f7c295-fb32-4b3d-b984-0e4049ccb8f9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:22.753436 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-10f7c295-fb32-4b3d-b984-0e4049ccb8f9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d" status: 200 len: 1473 microversion: 2.1 time: 0.177742 Oct 10 23:20:22.754158 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 501/1001] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:22 2022] GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d => generated 1473 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:22.758709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-46815ba2-6f36-4324-8025-973881fef526 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:22.759472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-46815ba2-6f36-4324-8025-973881fef526 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:22.765490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46815ba2-6f36-4324-8025-973881fef526 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:22.766077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46815ba2-6f36-4324-8025-973881fef526 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:22.766805 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46815ba2-6f36-4324-8025-973881fef526 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:22.767375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46815ba2-6f36-4324-8025-973881fef526 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:22.767928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46815ba2-6f36-4324-8025-973881fef526 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:22.768434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46815ba2-6f36-4324-8025-973881fef526 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:22.921140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-46815ba2-6f36-4324-8025-973881fef526 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f553ef2324ac19370a181cf4c3629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2054001d7ed142698beaf51dcb6bd496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:22.929663 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-46815ba2-6f36-4324-8025-973881fef526 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 200 len: 1316 microversion: 2.1 time: 0.174400 Oct 10 23:20:22.931976 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 502/1002] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:22 2022] GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:22.995658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f8031b12-43e5-4060-b288-09d133c25e2f tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:22.996214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f8031b12-43e5-4060-b288-09d133c25e2f tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:23.002572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f8031b12-43e5-4060-b288-09d133c25e2f tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:23.003059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f8031b12-43e5-4060-b288-09d133c25e2f tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:23.003488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f8031b12-43e5-4060-b288-09d133c25e2f tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:23.004191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f8031b12-43e5-4060-b288-09d133c25e2f tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:23.004642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f8031b12-43e5-4060-b288-09d133c25e2f tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:23.005065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f8031b12-43e5-4060-b288-09d133c25e2f tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:23.007851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:23.363898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f8031b12-43e5-4060-b288-09d133c25e2f tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:23.371909 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f8031b12-43e5-4060-b288-09d133c25e2f tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1522 microversion: 2.1 time: 0.380188 Oct 10 23:20:23.373010 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 503/1003] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:22 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:23.375319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-73cce290-88df-4fa5-8489-f97889b48503 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:20:23.375851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-73cce290-88df-4fa5-8489-f97889b48503 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:20:23.376431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-73cce290-88df-4fa5-8489-f97889b48503 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:20:23.376942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-73cce290-88df-4fa5-8489-f97889b48503 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:20:23.377522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-73cce290-88df-4fa5-8489-f97889b48503 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:20:23.377890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-adfa9521-b17b-4641-88f5-1a0e22261437 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:23.378696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-adfa9521-b17b-4641-88f5-1a0e22261437 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:23.384820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adfa9521-b17b-4641-88f5-1a0e22261437 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:23.385541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adfa9521-b17b-4641-88f5-1a0e22261437 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:23.385981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adfa9521-b17b-4641-88f5-1a0e22261437 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:23.386849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adfa9521-b17b-4641-88f5-1a0e22261437 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:23.387470 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adfa9521-b17b-4641-88f5-1a0e22261437 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:23.388091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adfa9521-b17b-4641-88f5-1a0e22261437 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:23.390620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73cce290-88df-4fa5-8489-f97889b48503 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:23.391619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73cce290-88df-4fa5-8489-f97889b48503 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:23.392134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73cce290-88df-4fa5-8489-f97889b48503 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:23.395850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73cce290-88df-4fa5-8489-f97889b48503 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:23.399442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73cce290-88df-4fa5-8489-f97889b48503 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:23.400084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73cce290-88df-4fa5-8489-f97889b48503 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:23.431870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-73cce290-88df-4fa5-8489-f97889b48503 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Getting quotas for project 56fc65084a2a46689aa3b221e6d7aeb8. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:20:23.441421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-73cce290-88df-4fa5-8489-f97889b48503 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Getting quotas for user 9dfa7f1be9884bb1aabc9df8702fa630 and project 56fc65084a2a46689aa3b221e6d7aeb8. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:20:23.455488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-73cce290-88df-4fa5-8489-f97889b48503 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:20:23.457920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-73cce290-88df-4fa5-8489-f97889b48503 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:20:23.514286 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-73cce290-88df-4fa5-8489-f97889b48503 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.990629 Oct 10 23:20:23.527545 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 501/1004] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:20:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:20:23.548832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-f33b7e20-384e-428a-91c1-60398cf45305 req-1016166c-46fb-4aa1-b114-86ba80a1826b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f81164-31f2-4f4b-9ec5-1e2ee8416c7b", "name": "network-vif-plugged", "status": "completed", "tag": "1a0d0d6b-022c-4c38-bd51-d8b961af213c"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:23.562232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f33b7e20-384e-428a-91c1-60398cf45305 req-1016166c-46fb-4aa1-b114-86ba80a1826b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:23.563188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f33b7e20-384e-428a-91c1-60398cf45305 req-1016166c-46fb-4aa1-b114-86ba80a1826b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:23.564408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f33b7e20-384e-428a-91c1-60398cf45305 req-1016166c-46fb-4aa1-b114-86ba80a1826b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:23.578793 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-f33b7e20-384e-428a-91c1-60398cf45305 req-1016166c-46fb-4aa1-b114-86ba80a1826b service nova] Creating event network-vif-plugged:1a0d0d6b-022c-4c38-bd51-d8b961af213c for instance 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b on n-h2-860864-2 Oct 10 23:20:23.587408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-f33b7e20-384e-428a-91c1-60398cf45305 req-1016166c-46fb-4aa1-b114-86ba80a1826b service nova] Instance 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 23:20:23.597552 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-f33b7e20-384e-428a-91c1-60398cf45305 req-1016166c-46fb-4aa1-b114-86ba80a1826b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066212 Oct 10 23:20:23.603822 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 502/1005] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:23.611685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-68b8a929-cec1-4eb9-b440-ba521c91b60f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:23.612901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-68b8a929-cec1-4eb9-b440-ba521c91b60f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:23.695411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-68b8a929-cec1-4eb9-b440-ba521c91b60f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:23.711421 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-68b8a929-cec1-4eb9-b440-ba521c91b60f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 200 len: 1216 microversion: 2.1 time: 0.106026 Oct 10 23:20:23.712529 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 503/1006] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:23 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 1216 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:23.718910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3e2a465e-040b-460e-ba17-1b9423e609af tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:23.719553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3e2a465e-040b-460e-ba17-1b9423e609af tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:23.733674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e2a465e-040b-460e-ba17-1b9423e609af tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:23.734181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e2a465e-040b-460e-ba17-1b9423e609af tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:23.734621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e2a465e-040b-460e-ba17-1b9423e609af tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:23.735334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e2a465e-040b-460e-ba17-1b9423e609af tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:23.735788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e2a465e-040b-460e-ba17-1b9423e609af tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:23.736213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e2a465e-040b-460e-ba17-1b9423e609af tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:23.836109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-adfa9521-b17b-4641-88f5-1a0e22261437 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:23.850318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-adfa9521-b17b-4641-88f5-1a0e22261437 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:23.851759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-adfa9521-b17b-4641-88f5-1a0e22261437 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:23.854309 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-adfa9521-b17b-4641-88f5-1a0e22261437 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1362 microversion: 2.25 time: 0.480103 Oct 10 23:20:23.855950 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 504/1007] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:23 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1362 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:23.869518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-995ae71d-3245-4a9d-98e3-89bf433d54bc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:23.870607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-995ae71d-3245-4a9d-98e3-89bf433d54bc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:23.888893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-995ae71d-3245-4a9d-98e3-89bf433d54bc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:23.889543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-995ae71d-3245-4a9d-98e3-89bf433d54bc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:23.890294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-995ae71d-3245-4a9d-98e3-89bf433d54bc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:23.891320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-995ae71d-3245-4a9d-98e3-89bf433d54bc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:23.891772 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-995ae71d-3245-4a9d-98e3-89bf433d54bc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:23.892198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-995ae71d-3245-4a9d-98e3-89bf433d54bc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:24.026096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3e2a465e-040b-460e-ba17-1b9423e609af tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:24.038804 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3e2a465e-040b-460e-ba17-1b9423e609af tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 200 len: 1712 microversion: 2.1 time: 0.324685 Oct 10 23:20:24.039407 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 504/1008] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:23 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 1712 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:24.061730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-45becb1d-714b-4bc5-a2d3-7217ecc7b378 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:24.063033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-45becb1d-714b-4bc5-a2d3-7217ecc7b378 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:24.075959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45becb1d-714b-4bc5-a2d3-7217ecc7b378 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:24.076456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45becb1d-714b-4bc5-a2d3-7217ecc7b378 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:24.076902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45becb1d-714b-4bc5-a2d3-7217ecc7b378 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:24.077850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45becb1d-714b-4bc5-a2d3-7217ecc7b378 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:24.079275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45becb1d-714b-4bc5-a2d3-7217ecc7b378 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:24.080145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45becb1d-714b-4bc5-a2d3-7217ecc7b378 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:24.243532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-45becb1d-714b-4bc5-a2d3-7217ecc7b378 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:24.252108 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-45becb1d-714b-4bc5-a2d3-7217ecc7b378 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d" status: 200 len: 1431 microversion: 2.1 time: 0.205870 Oct 10 23:20:24.252705 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 505/1009] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:24 2022] GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d => generated 1431 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:24.262165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a48b6c63-3ef4-4260-acc6-38b3f6857977 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:24.271099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a48b6c63-3ef4-4260-acc6-38b3f6857977 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:24.279186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a48b6c63-3ef4-4260-acc6-38b3f6857977 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:24.280786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a48b6c63-3ef4-4260-acc6-38b3f6857977 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:24.281291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a48b6c63-3ef4-4260-acc6-38b3f6857977 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:24.282135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a48b6c63-3ef4-4260-acc6-38b3f6857977 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:24.282655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a48b6c63-3ef4-4260-acc6-38b3f6857977 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:24.283149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a48b6c63-3ef4-4260-acc6-38b3f6857977 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:24.305074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-995ae71d-3245-4a9d-98e3-89bf433d54bc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:24.323495 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-995ae71d-3245-4a9d-98e3-89bf433d54bc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1470 microversion: 2.1 time: 0.465036 Oct 10 23:20:24.335151 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 505/1010] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:23 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1470 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:24.347077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-94c28fa6-50f6-4402-bb83-47e9c55c867f req-5cc0f3a9-76b8-4e2a-b4af-db3f83cb0386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cb5a23-7b52-472b-b06e-1b830053c92d", "name": "network-vif-deleted", "tag": "fab54877-ae0b-4495-b318-ffee867fcc69"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:24.360737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-94c28fa6-50f6-4402-bb83-47e9c55c867f req-5cc0f3a9-76b8-4e2a-b4af-db3f83cb0386 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:24.361468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-94c28fa6-50f6-4402-bb83-47e9c55c867f req-5cc0f3a9-76b8-4e2a-b4af-db3f83cb0386 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:24.362146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-94c28fa6-50f6-4402-bb83-47e9c55c867f req-5cc0f3a9-76b8-4e2a-b4af-db3f83cb0386 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:24.376274 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-94c28fa6-50f6-4402-bb83-47e9c55c867f req-5cc0f3a9-76b8-4e2a-b4af-db3f83cb0386 service nova] Creating event network-vif-deleted:fab54877-ae0b-4495-b318-ffee867fcc69 for instance e8cb5a23-7b52-472b-b06e-1b830053c92d on n-h2-860864-2 Oct 10 23:20:24.384836 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-94c28fa6-50f6-4402-bb83-47e9c55c867f req-5cc0f3a9-76b8-4e2a-b4af-db3f83cb0386 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044370 Oct 10 23:20:24.386398 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 506/1011] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:24.395843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7158b8a8-c5ff-4f05-bb40-86ac334d3990 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:24.396945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7158b8a8-c5ff-4f05-bb40-86ac334d3990 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:24.420171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7158b8a8-c5ff-4f05-bb40-86ac334d3990 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:24.420970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7158b8a8-c5ff-4f05-bb40-86ac334d3990 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:24.422039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7158b8a8-c5ff-4f05-bb40-86ac334d3990 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:24.423721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7158b8a8-c5ff-4f05-bb40-86ac334d3990 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:24.424420 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7158b8a8-c5ff-4f05-bb40-86ac334d3990 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:24.425206 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7158b8a8-c5ff-4f05-bb40-86ac334d3990 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:24.532887 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7158b8a8-c5ff-4f05-bb40-86ac334d3990 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "POST /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b/action" status: 204 len: 0 microversion: 2.1 time: 0.144281 Oct 10 23:20:24.533648 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 507/1012] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:20:24 2022] POST /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b/action => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:20:24.539932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-28102227-7301-447b-b572-689c66c61d3e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:24.540662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-28102227-7301-447b-b572-689c66c61d3e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:24.548894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28102227-7301-447b-b572-689c66c61d3e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:24.549439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28102227-7301-447b-b572-689c66c61d3e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:24.549887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28102227-7301-447b-b572-689c66c61d3e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:24.550585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28102227-7301-447b-b572-689c66c61d3e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:24.551037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28102227-7301-447b-b572-689c66c61d3e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:24.551476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28102227-7301-447b-b572-689c66c61d3e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:24.770285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a48b6c63-3ef4-4260-acc6-38b3f6857977 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f553ef2324ac19370a181cf4c3629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2054001d7ed142698beaf51dcb6bd496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:24.780302 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a48b6c63-3ef4-4260-acc6-38b3f6857977 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 200 len: 1316 microversion: 2.1 time: 0.521442 Oct 10 23:20:24.781240 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 506/1013] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:24 2022] GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 1316 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:24.786144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-360599a7-75b2-4a74-b396-9ec48dadc89b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:24.786770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-360599a7-75b2-4a74-b396-9ec48dadc89b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:24.792802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-360599a7-75b2-4a74-b396-9ec48dadc89b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:24.793509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-360599a7-75b2-4a74-b396-9ec48dadc89b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:24.794089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-360599a7-75b2-4a74-b396-9ec48dadc89b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:24.794717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-360599a7-75b2-4a74-b396-9ec48dadc89b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:24.795198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-360599a7-75b2-4a74-b396-9ec48dadc89b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:24.795610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-360599a7-75b2-4a74-b396-9ec48dadc89b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:25.075869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-360599a7-75b2-4a74-b396-9ec48dadc89b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:25.089025 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-360599a7-75b2-4a74-b396-9ec48dadc89b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1470 microversion: 2.1 time: 0.306688 Oct 10 23:20:25.102192 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 507/1014] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:24 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1470 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:25.111097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f03891ee-a7c0-4de7-9f9d-411a6898977f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:25.112197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f03891ee-a7c0-4de7-9f9d-411a6898977f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:25.115243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:25.140146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f03891ee-a7c0-4de7-9f9d-411a6898977f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:25.140840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f03891ee-a7c0-4de7-9f9d-411a6898977f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:25.141299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f03891ee-a7c0-4de7-9f9d-411a6898977f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:25.145837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f03891ee-a7c0-4de7-9f9d-411a6898977f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:25.146501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f03891ee-a7c0-4de7-9f9d-411a6898977f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:25.147150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f03891ee-a7c0-4de7-9f9d-411a6898977f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:25.270721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f03891ee-a7c0-4de7-9f9d-411a6898977f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:25.284575 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f03891ee-a7c0-4de7-9f9d-411a6898977f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 200 len: 1212 microversion: 2.1 time: 0.178826 Oct 10 23:20:25.285509 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 508/1015] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:25 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 1212 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:25.291299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b0ffaae4-df5e-418a-a382-86339e1d88da tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:25.292317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b0ffaae4-df5e-418a-a382-86339e1d88da tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:25.306986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0ffaae4-df5e-418a-a382-86339e1d88da tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:25.307709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0ffaae4-df5e-418a-a382-86339e1d88da tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:25.308302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0ffaae4-df5e-418a-a382-86339e1d88da tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:25.309182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0ffaae4-df5e-418a-a382-86339e1d88da tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:25.309929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0ffaae4-df5e-418a-a382-86339e1d88da tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:25.310918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0ffaae4-df5e-418a-a382-86339e1d88da tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:25.347022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-28102227-7301-447b-b572-689c66c61d3e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:25.355952 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-28102227-7301-447b-b572-689c66c61d3e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1522 microversion: 2.1 time: 0.820558 Oct 10 23:20:25.357346 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 508/1016] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:24 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1522 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:25.363201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0b4251af-c41b-4a86-98c1-906ab415a2a3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:25.364111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0b4251af-c41b-4a86-98c1-906ab415a2a3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:25.370442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b4251af-c41b-4a86-98c1-906ab415a2a3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:25.371103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b4251af-c41b-4a86-98c1-906ab415a2a3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:25.371697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b4251af-c41b-4a86-98c1-906ab415a2a3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:25.372708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b4251af-c41b-4a86-98c1-906ab415a2a3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:25.373731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b4251af-c41b-4a86-98c1-906ab415a2a3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:25.374447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b4251af-c41b-4a86-98c1-906ab415a2a3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:25.484140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0b4251af-c41b-4a86-98c1-906ab415a2a3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:25.495118 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0b4251af-c41b-4a86-98c1-906ab415a2a3 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 200 len: 1645 microversion: 2.1 time: 0.136147 Oct 10 23:20:25.496845 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 509/1017] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:25 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 1645 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:25.502568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-46f4f16f-31e9-44fa-b197-5c49e75929c9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:25.503524 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-46f4f16f-31e9-44fa-b197-5c49e75929c9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:25.512682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46f4f16f-31e9-44fa-b197-5c49e75929c9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:25.513621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46f4f16f-31e9-44fa-b197-5c49e75929c9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:25.514215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46f4f16f-31e9-44fa-b197-5c49e75929c9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:25.515160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46f4f16f-31e9-44fa-b197-5c49e75929c9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:25.515701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46f4f16f-31e9-44fa-b197-5c49e75929c9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:25.516155 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46f4f16f-31e9-44fa-b197-5c49e75929c9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:25.546445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b0ffaae4-df5e-418a-a382-86339e1d88da tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:25.568301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b0ffaae4-df5e-418a-a382-86339e1d88da tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:25.569805 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46f4f16f-31e9-44fa-b197-5c49e75929c9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:25.570645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b0ffaae4-df5e-418a-a382-86339e1d88da tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:25.572421 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b0ffaae4-df5e-418a-a382-86339e1d88da tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1557 microversion: 2.25 time: 0.285095 Oct 10 23:20:25.573186 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 509/1018] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:25 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1557 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:25.580380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-0cb5c7c2-224f-4802-9e80-42ae8f06dcdd req-c7884c56-8a9e-4ec5-beef-45dc040d5d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbe32f87-f44c-40f1-a4be-8c6dd98c20b5", "name": "network-vif-deleted", "tag": "250f123d-5ada-4744-bccc-c92a75d38e1f"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:25.604063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0cb5c7c2-224f-4802-9e80-42ae8f06dcdd req-c7884c56-8a9e-4ec5-beef-45dc040d5d9c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:25.609951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0cb5c7c2-224f-4802-9e80-42ae8f06dcdd req-c7884c56-8a9e-4ec5-beef-45dc040d5d9c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:25.610947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46f4f16f-31e9-44fa-b197-5c49e75929c9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:25.611547 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46f4f16f-31e9-44fa-b197-5c49e75929c9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:25.611901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-46f4f16f-31e9-44fa-b197-5c49e75929c9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lazy-loading 'fault' on Instance uuid e8cb5a23-7b52-472b-b06e-1b830053c92d {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:20:25.612150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0cb5c7c2-224f-4802-9e80-42ae8f06dcdd req-c7884c56-8a9e-4ec5-beef-45dc040d5d9c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:25.629591 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-0cb5c7c2-224f-4802-9e80-42ae8f06dcdd req-c7884c56-8a9e-4ec5-beef-45dc040d5d9c service nova] Creating event network-vif-deleted:250f123d-5ada-4744-bccc-c92a75d38e1f for instance bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 on n-h2-860864-2 Oct 10 23:20:25.637493 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-0cb5c7c2-224f-4802-9e80-42ae8f06dcdd req-c7884c56-8a9e-4ec5-beef-45dc040d5d9c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060452 Oct 10 23:20:25.639917 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 510/1019] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:25.657864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-02c16fb6-9fa8-4893-a3e2-a64b274989d4 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:25.659212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-02c16fb6-9fa8-4893-a3e2-a64b274989d4 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:25.671192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02c16fb6-9fa8-4893-a3e2-a64b274989d4 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:25.673475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02c16fb6-9fa8-4893-a3e2-a64b274989d4 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:25.673923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02c16fb6-9fa8-4893-a3e2-a64b274989d4 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:25.674638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02c16fb6-9fa8-4893-a3e2-a64b274989d4 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:25.675093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02c16fb6-9fa8-4893-a3e2-a64b274989d4 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:25.675512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02c16fb6-9fa8-4893-a3e2-a64b274989d4 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:25.774934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-46f4f16f-31e9-44fa-b197-5c49e75929c9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:25.793902 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-46f4f16f-31e9-44fa-b197-5c49e75929c9 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d" status: 200 len: 1307 microversion: 2.1 time: 0.295238 Oct 10 23:20:25.805399 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 510/1020] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:25 2022] GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d => generated 1307 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:25.805399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-d54bf3a5-04d2-40e2-bed5-0c50c3c54642 req-563a1ec7-396f-42b6-9992-96ba3ae80ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc60f0b-c592-4047-97cf-7c81649085d3", "name": "network-vif-plugged", "status": "completed", "tag": "fef8ff70-fee3-4957-aa01-50f6a48fab07"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:25.833245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d54bf3a5-04d2-40e2-bed5-0c50c3c54642 req-563a1ec7-396f-42b6-9992-96ba3ae80ab6 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:25.833765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d54bf3a5-04d2-40e2-bed5-0c50c3c54642 req-563a1ec7-396f-42b6-9992-96ba3ae80ab6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:25.834206 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d54bf3a5-04d2-40e2-bed5-0c50c3c54642 req-563a1ec7-396f-42b6-9992-96ba3ae80ab6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:25.847281 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-d54bf3a5-04d2-40e2-bed5-0c50c3c54642 req-563a1ec7-396f-42b6-9992-96ba3ae80ab6 service nova] Creating event network-vif-plugged:fef8ff70-fee3-4957-aa01-50f6a48fab07 for instance 9dc60f0b-c592-4047-97cf-7c81649085d3 on n-h1-860864-2 Oct 10 23:20:25.856179 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-d54bf3a5-04d2-40e2-bed5-0c50c3c54642 req-563a1ec7-396f-42b6-9992-96ba3ae80ab6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059475 Oct 10 23:20:25.858474 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 511/1021] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:25.866003 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-34aa522a-7160-4f2a-90c0-5cc39f45718e tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:25.866988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-34aa522a-7160-4f2a-90c0-5cc39f45718e tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:25.874476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34aa522a-7160-4f2a-90c0-5cc39f45718e tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:25.875216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34aa522a-7160-4f2a-90c0-5cc39f45718e tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:25.875654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34aa522a-7160-4f2a-90c0-5cc39f45718e tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:25.876360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34aa522a-7160-4f2a-90c0-5cc39f45718e tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:25.876878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34aa522a-7160-4f2a-90c0-5cc39f45718e tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:25.877309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34aa522a-7160-4f2a-90c0-5cc39f45718e tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:26.050206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-02c16fb6-9fa8-4893-a3e2-a64b274989d4 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lazy-loading 'services' on Instance uuid c3bb20a8-8b13-470d-ac2b-50b7a7bea206 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:20:26.068513 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-02c16fb6-9fa8-4893-a3e2-a64b274989d4 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 2050 microversion: 2.25 time: 0.427057 Oct 10 23:20:26.081828 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 511/1022] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:25 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 2050 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:26.095815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-25de69fe-ee27-4a7c-bde7-01afb8159dc3 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:26.096603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-25de69fe-ee27-4a7c-bde7-01afb8159dc3 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:26.097745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-34aa522a-7160-4f2a-90c0-5cc39f45718e tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f553ef2324ac19370a181cf4c3629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2054001d7ed142698beaf51dcb6bd496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:26.104281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25de69fe-ee27-4a7c-bde7-01afb8159dc3 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:26.105657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25de69fe-ee27-4a7c-bde7-01afb8159dc3 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:26.106272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25de69fe-ee27-4a7c-bde7-01afb8159dc3 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:26.107657 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-34aa522a-7160-4f2a-90c0-5cc39f45718e tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 200 len: 1316 microversion: 2.1 time: 0.246705 Oct 10 23:20:26.108652 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 512/1023] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:25 2022] GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:26.109613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25de69fe-ee27-4a7c-bde7-01afb8159dc3 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:26.110324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25de69fe-ee27-4a7c-bde7-01afb8159dc3 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:26.111048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25de69fe-ee27-4a7c-bde7-01afb8159dc3 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:26.140236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ee59fa4d-a2e2-4133-85d7-24d3e2879bc3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:26.143516 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ee59fa4d-a2e2-4133-85d7-24d3e2879bc3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:26.152788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee59fa4d-a2e2-4133-85d7-24d3e2879bc3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:26.153641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee59fa4d-a2e2-4133-85d7-24d3e2879bc3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:26.154337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee59fa4d-a2e2-4133-85d7-24d3e2879bc3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:26.155523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee59fa4d-a2e2-4133-85d7-24d3e2879bc3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:26.156059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee59fa4d-a2e2-4133-85d7-24d3e2879bc3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:26.156568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee59fa4d-a2e2-4133-85d7-24d3e2879bc3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:26.313864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ee59fa4d-a2e2-4133-85d7-24d3e2879bc3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:26.322445 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ee59fa4d-a2e2-4133-85d7-24d3e2879bc3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1470 microversion: 2.1 time: 0.190418 Oct 10 23:20:26.323324 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 513/1024] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:26 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1470 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:26.328500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-148cab47-7441-412c-aad5-932c537663e9 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:26.329571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-148cab47-7441-412c-aad5-932c537663e9 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:26.336554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-148cab47-7441-412c-aad5-932c537663e9 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:26.337127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-148cab47-7441-412c-aad5-932c537663e9 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:26.337535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-148cab47-7441-412c-aad5-932c537663e9 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:26.338247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-148cab47-7441-412c-aad5-932c537663e9 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:26.338707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-148cab47-7441-412c-aad5-932c537663e9 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:26.339138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-148cab47-7441-412c-aad5-932c537663e9 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:26.343936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-25de69fe-ee27-4a7c-bde7-01afb8159dc3 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lazy-loading 'services' on Instance uuid c3bb20a8-8b13-470d-ac2b-50b7a7bea206 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:20:26.358620 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-25de69fe-ee27-4a7c-bde7-01afb8159dc3 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 2050 microversion: 2.25 time: 0.268273 Oct 10 23:20:26.359899 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 512/1025] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:26 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 2050 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:20:26.380139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-82ded938-8c76-4dda-a913-e1dff34a99f2 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:26.382259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-82ded938-8c76-4dda-a913-e1dff34a99f2 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:26.391367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82ded938-8c76-4dda-a913-e1dff34a99f2 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:26.391793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82ded938-8c76-4dda-a913-e1dff34a99f2 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:26.392400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82ded938-8c76-4dda-a913-e1dff34a99f2 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:26.393122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82ded938-8c76-4dda-a913-e1dff34a99f2 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:26.393622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82ded938-8c76-4dda-a913-e1dff34a99f2 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:26.394054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82ded938-8c76-4dda-a913-e1dff34a99f2 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:26.424453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-148cab47-7441-412c-aad5-932c537663e9 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:26.433715 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-148cab47-7441-412c-aad5-932c537663e9 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 200 len: 1268 microversion: 2.1 time: 0.109331 Oct 10 23:20:26.434297 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 514/1026] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:26 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 1268 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:26.443956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-88b49364-3c4f-492a-ba95-0e6776273028 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:26.447677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-88b49364-3c4f-492a-ba95-0e6776273028 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:26.448172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-88b49364-3c4f-492a-ba95-0e6776273028 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:26.448610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-88b49364-3c4f-492a-ba95-0e6776273028 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:26.449349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-88b49364-3c4f-492a-ba95-0e6776273028 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:26.450128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-88b49364-3c4f-492a-ba95-0e6776273028 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:26.450713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-88b49364-3c4f-492a-ba95-0e6776273028 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:26.481796 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-88b49364-3c4f-492a-ba95-0e6776273028 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.041856 Oct 10 23:20:26.482974 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 515/1027] 10.222.0.23 () {60 vars in 1217 bytes} [Mon Oct 10 23:20:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:20:26.496043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bca71ff5-5d3c-48c3-8e48-efabda4e22fe tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:26.497855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bca71ff5-5d3c-48c3-8e48-efabda4e22fe tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:26.505070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bca71ff5-5d3c-48c3-8e48-efabda4e22fe tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:26.505617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bca71ff5-5d3c-48c3-8e48-efabda4e22fe tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:26.506057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bca71ff5-5d3c-48c3-8e48-efabda4e22fe tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:26.507667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bca71ff5-5d3c-48c3-8e48-efabda4e22fe tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:26.508147 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bca71ff5-5d3c-48c3-8e48-efabda4e22fe tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:26.508750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bca71ff5-5d3c-48c3-8e48-efabda4e22fe tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:26.582972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-82ded938-8c76-4dda-a913-e1dff34a99f2 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:26.593137 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-82ded938-8c76-4dda-a913-e1dff34a99f2 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1522 microversion: 2.1 time: 0.217073 Oct 10 23:20:26.597071 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bca71ff5-5d3c-48c3-8e48-efabda4e22fe tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206/action" status: 202 len: 0 microversion: 2.25 time: 0.105491 Oct 10 23:20:26.597880 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 516/1028] 10.222.0.23 () {62 vars in 1319 bytes} [Mon Oct 10 23:20:26 2022] POST /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:20:26.598834 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 513/1029] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:26 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:26.604073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ab2c90f9-3838-4976-b3eb-d5a834de0dc1 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:26.604883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ab2c90f9-3838-4976-b3eb-d5a834de0dc1 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:26.617027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab2c90f9-3838-4976-b3eb-d5a834de0dc1 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:26.617182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c51ea809-1962-467d-b683-432bfac512ba tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:26.617756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab2c90f9-3838-4976-b3eb-d5a834de0dc1 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:26.617883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c51ea809-1962-467d-b683-432bfac512ba tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:26.618369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab2c90f9-3838-4976-b3eb-d5a834de0dc1 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:26.619332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab2c90f9-3838-4976-b3eb-d5a834de0dc1 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:26.619995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab2c90f9-3838-4976-b3eb-d5a834de0dc1 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:26.620509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab2c90f9-3838-4976-b3eb-d5a834de0dc1 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:26.624086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c51ea809-1962-467d-b683-432bfac512ba tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:26.624692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c51ea809-1962-467d-b683-432bfac512ba tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:26.625200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c51ea809-1962-467d-b683-432bfac512ba tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:26.626022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c51ea809-1962-467d-b683-432bfac512ba tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:26.626539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c51ea809-1962-467d-b683-432bfac512ba tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:26.627052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c51ea809-1962-467d-b683-432bfac512ba tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:26.658005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab2c90f9-3838-4976-b3eb-d5a834de0dc1 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:26.658391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab2c90f9-3838-4976-b3eb-d5a834de0dc1 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:26.658819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab2c90f9-3838-4976-b3eb-d5a834de0dc1 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:26.659258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-ab2c90f9-3838-4976-b3eb-d5a834de0dc1 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lazy-loading 'fault' on Instance uuid bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:20:26.703916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ab2c90f9-3838-4976-b3eb-d5a834de0dc1 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:26.712257 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ab2c90f9-3838-4976-b3eb-d5a834de0dc1 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 200 len: 1353 microversion: 2.1 time: 0.112482 Oct 10 23:20:26.712831 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 517/1030] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:26 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 1353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:26.761675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-c51ea809-1962-467d-b683-432bfac512ba tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lazy-loading 'services' on Instance uuid c3bb20a8-8b13-470d-ac2b-50b7a7bea206 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:20:26.776596 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c51ea809-1962-467d-b683-432bfac512ba tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 2055 microversion: 2.25 time: 0.162624 Oct 10 23:20:26.789793 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 514/1031] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:26 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 2055 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:20:26.832226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-29bdb77e-1858-4a88-b332-ba09b266e3b5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:26.833017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-29bdb77e-1858-4a88-b332-ba09b266e3b5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: e8cb5a23-7b52-472b-b06e-1b830053c92d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:26.839127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29bdb77e-1858-4a88-b332-ba09b266e3b5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:26.839893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29bdb77e-1858-4a88-b332-ba09b266e3b5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:26.840505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29bdb77e-1858-4a88-b332-ba09b266e3b5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:26.841780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29bdb77e-1858-4a88-b332-ba09b266e3b5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:26.842429 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29bdb77e-1858-4a88-b332-ba09b266e3b5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:26.842960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29bdb77e-1858-4a88-b332-ba09b266e3b5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:26.860851 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-29bdb77e-1858-4a88-b332-ba09b266e3b5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] HTTP exception thrown: Instance e8cb5a23-7b52-472b-b06e-1b830053c92d could not be found. Oct 10 23:20:26.863751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-29bdb77e-1858-4a88-b332-ba09b266e3b5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Request method failure captured: Oct 10 23:20:26.863751 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d HTTP/1.1 Oct 10 23:20:26.863751 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:20:26.863751 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:20:26.863751 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:20:26.863751 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:20:26.863751 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:20:26.863751 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:20:26.863751 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:20:26.863751 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:26.863751 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgJCGPRazsPZv_KJRTPkW4yfXkftWI99r6NM1NcPzbV6ezzFy8Kk0KC2fs-Oq1mdxcQ8vpiKa4rTjWrgHH8KDGbQArWJeSLbZnpz5njlegxl252rFp2J2t_YkO8EBZX2N9DD656V96Tu1xc3xvEKd_hjW4bndDcX9tluGi3sznnXco Oct 10 23:20:26.863751 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:20:26.863751 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:20:26.863751 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:20:26.863751 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:20:26.863751 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:20:26.863751 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:20:26.863751 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: d98b12fc1bbf42d4b7376222c55733ed Oct 10 23:20:26.863751 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:20:26.863751 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:20:26.863751 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:20:26.865488 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d98b12fc1bbf42d4b7376222c55733ed", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:26.865488 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:20:26.865488 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: d98b12fc1bbf42d4b7376222c55733ed Oct 10 23:20:26.865488 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:20:26.865488 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersOnMultiNodesTest-1123459593-project Oct 10 23:20:26.865488 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:20:26.865488 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:20:26.865488 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 310196e1663a4f7ca12e1fc53b0278ba Oct 10 23:20:26.865488 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersOnMultiNodesTest-1123459593-project Oct 10 23:20:26.865488 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:20:26.865488 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance e8cb5a23-7b52-472b-b06e-1b830053c92d could not be found. Oct 10 23:20:26.865488 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'e8cb5a23-7b52-472b-b06e-1b830053c92d'} Oct 10 23:20:26.866399 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:26.866399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:26.866399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:26.866399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:26.866399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:20:26.866399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:20:26.866399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:20:26.866399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:20:26.866399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:20:26.866399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:20:26.866399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8cb5a23-7b52-472b-b06e-1b830053c92d could not be found. Oct 10 23:20:26.866399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:26.866399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:26.866399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:26.866399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:26.866399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:26.866399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:26.866399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:26.866399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:26.866399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:26.867959 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:26.867959 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:20:26.867959 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:20:26.867959 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:26.867959 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:26.867959 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:26.867959 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:26.867959 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8cb5a23-7b52-472b-b06e-1b830053c92d could not be found. Oct 10 23:20:26.867959 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:26.867959 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:26.867959 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:26.867959 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:26.867959 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:26.867959 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:26.867959 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:26.867959 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:26.867959 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8cb5a23-7b52-472b-b06e-1b830053c92d could not be found. Oct 10 23:20:26.867959 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:26.869398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-29bdb77e-1858-4a88-b332-ba09b266e3b5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Returning 404 to user: Instance e8cb5a23-7b52-472b-b06e-1b830053c92d could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:26.870228 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-29bdb77e-1858-4a88-b332-ba09b266e3b5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d" status: 404 len: 111 microversion: 2.1 time: 0.042610 Oct 10 23:20:26.871355 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 518/1032] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:26 2022] GET /compute/v2.1/servers/e8cb5a23-7b52-472b-b06e-1b830053c92d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:26.881269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-44ba1f34-2e9f-4c26-8744-db82ee43c37a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:26.881826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-44ba1f34-2e9f-4c26-8744-db82ee43c37a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: d4bce34b-efcf-4b32-9c0c-882ebe101017] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:26.888498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44ba1f34-2e9f-4c26-8744-db82ee43c37a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:26.888984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44ba1f34-2e9f-4c26-8744-db82ee43c37a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:26.889494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44ba1f34-2e9f-4c26-8744-db82ee43c37a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:26.890240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44ba1f34-2e9f-4c26-8744-db82ee43c37a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:26.890975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44ba1f34-2e9f-4c26-8744-db82ee43c37a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:26.891441 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44ba1f34-2e9f-4c26-8744-db82ee43c37a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:26.920559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-44ba1f34-2e9f-4c26-8744-db82ee43c37a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: d4bce34b-efcf-4b32-9c0c-882ebe101017] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:20:27.016019 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-44ba1f34-2e9f-4c26-8744-db82ee43c37a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017" status: 204 len: 0 microversion: 2.1 time: 0.139224 Oct 10 23:20:27.019674 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 515/1033] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:20:26 2022] DELETE /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:20:27.026355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-157ba748-2b8b-47d3-8d91-e8b391d7a7bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:27.027370 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-157ba748-2b8b-47d3-8d91-e8b391d7a7bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: d4bce34b-efcf-4b32-9c0c-882ebe101017] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:27.036829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-157ba748-2b8b-47d3-8d91-e8b391d7a7bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:27.038761 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-157ba748-2b8b-47d3-8d91-e8b391d7a7bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:27.039397 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-157ba748-2b8b-47d3-8d91-e8b391d7a7bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:27.040293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-157ba748-2b8b-47d3-8d91-e8b391d7a7bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:27.040914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-157ba748-2b8b-47d3-8d91-e8b391d7a7bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:27.041532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-157ba748-2b8b-47d3-8d91-e8b391d7a7bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:27.068906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:27.134893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-89dd0391-dfc1-4f61-9196-f4fe17cd5598 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:27.135922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-89dd0391-dfc1-4f61-9196-f4fe17cd5598 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:27.165043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89dd0391-dfc1-4f61-9196-f4fe17cd5598 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:27.165633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89dd0391-dfc1-4f61-9196-f4fe17cd5598 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:27.169214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89dd0391-dfc1-4f61-9196-f4fe17cd5598 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:27.170834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89dd0391-dfc1-4f61-9196-f4fe17cd5598 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:27.173668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89dd0391-dfc1-4f61-9196-f4fe17cd5598 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:27.174113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89dd0391-dfc1-4f61-9196-f4fe17cd5598 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:27.214939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:27.236069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-157ba748-2b8b-47d3-8d91-e8b391d7a7bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:27.244255 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-157ba748-2b8b-47d3-8d91-e8b391d7a7bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017" status: 200 len: 1472 microversion: 2.1 time: 0.222255 Oct 10 23:20:27.244931 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 519/1034] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:27 2022] GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017 => generated 1472 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:27.348727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b2f2a699-0f54-4174-84c7-a11e7d3d920e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:27.349339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b2f2a699-0f54-4174-84c7-a11e7d3d920e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:27.355644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2f2a699-0f54-4174-84c7-a11e7d3d920e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:27.356202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2f2a699-0f54-4174-84c7-a11e7d3d920e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:27.357314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2f2a699-0f54-4174-84c7-a11e7d3d920e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:27.358962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2f2a699-0f54-4174-84c7-a11e7d3d920e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:27.359419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2f2a699-0f54-4174-84c7-a11e7d3d920e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:27.359827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2f2a699-0f54-4174-84c7-a11e7d3d920e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:27.426296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-89dd0391-dfc1-4f61-9196-f4fe17cd5598 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f553ef2324ac19370a181cf4c3629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2054001d7ed142698beaf51dcb6bd496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:27.435961 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-89dd0391-dfc1-4f61-9196-f4fe17cd5598 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 200 len: 1316 microversion: 2.1 time: 0.306758 Oct 10 23:20:27.438275 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 516/1035] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:27 2022] GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 1316 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:27.459332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1f590643-16cd-43b6-968c-38ade41269a8 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:27.460171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1f590643-16cd-43b6-968c-38ade41269a8 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:27.467585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f590643-16cd-43b6-968c-38ade41269a8 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:27.468350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f590643-16cd-43b6-968c-38ade41269a8 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:27.468862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f590643-16cd-43b6-968c-38ade41269a8 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:27.469759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f590643-16cd-43b6-968c-38ade41269a8 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:27.470353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f590643-16cd-43b6-968c-38ade41269a8 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:27.470861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f590643-16cd-43b6-968c-38ade41269a8 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:27.538453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b2f2a699-0f54-4174-84c7-a11e7d3d920e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:27.547803 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b2f2a699-0f54-4174-84c7-a11e7d3d920e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1470 microversion: 2.1 time: 0.203059 Oct 10 23:20:27.548389 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 520/1036] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:27 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1470 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:27.578398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1f590643-16cd-43b6-968c-38ade41269a8 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:27.585945 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1f590643-16cd-43b6-968c-38ade41269a8 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 200 len: 1274 microversion: 2.1 time: 0.131416 Oct 10 23:20:27.586505 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 517/1037] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:27 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 1274 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:27.616046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-273c6601-1e56-42b2-83ac-e2d230347635 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:27.616633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-273c6601-1e56-42b2-83ac-e2d230347635 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:27.622460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-273c6601-1e56-42b2-83ac-e2d230347635 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:27.623650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-273c6601-1e56-42b2-83ac-e2d230347635 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:27.624085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-273c6601-1e56-42b2-83ac-e2d230347635 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:27.624777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-273c6601-1e56-42b2-83ac-e2d230347635 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:27.625225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-273c6601-1e56-42b2-83ac-e2d230347635 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:27.625676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-273c6601-1e56-42b2-83ac-e2d230347635 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:27.736525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c7db6993-448a-4006-baba-48dacb50b1de tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:27.737327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c7db6993-448a-4006-baba-48dacb50b1de tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:27.743606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7db6993-448a-4006-baba-48dacb50b1de tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:27.744374 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7db6993-448a-4006-baba-48dacb50b1de tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:27.744883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7db6993-448a-4006-baba-48dacb50b1de tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:27.745695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7db6993-448a-4006-baba-48dacb50b1de tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:27.746223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7db6993-448a-4006-baba-48dacb50b1de tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:27.746719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7db6993-448a-4006-baba-48dacb50b1de tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:27.764551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-273c6601-1e56-42b2-83ac-e2d230347635 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:27.773310 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-273c6601-1e56-42b2-83ac-e2d230347635 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1499 microversion: 2.1 time: 0.161117 Oct 10 23:20:27.773985 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 521/1038] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:27 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1499 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:27.783408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7db6993-448a-4006-baba-48dacb50b1de tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:27.783894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7db6993-448a-4006-baba-48dacb50b1de tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:27.784327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7db6993-448a-4006-baba-48dacb50b1de tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:27.785267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-c7db6993-448a-4006-baba-48dacb50b1de tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lazy-loading 'fault' on Instance uuid bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:20:27.800007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-51b4164e-ae8c-4e25-8e8a-345426640bbc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:27.804790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-51b4164e-ae8c-4e25-8e8a-345426640bbc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:27.805870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-51b4164e-ae8c-4e25-8e8a-345426640bbc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:20:27.812693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51b4164e-ae8c-4e25-8e8a-345426640bbc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:27.812693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51b4164e-ae8c-4e25-8e8a-345426640bbc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:27.813003 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51b4164e-ae8c-4e25-8e8a-345426640bbc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:27.813506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51b4164e-ae8c-4e25-8e8a-345426640bbc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:27.813995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51b4164e-ae8c-4e25-8e8a-345426640bbc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:27.814363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51b4164e-ae8c-4e25-8e8a-345426640bbc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:27.848260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c7db6993-448a-4006-baba-48dacb50b1de tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cd6d7dfaeb4ac79fabf16698c60f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3787ea28344e78082ff74d7540f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:27.862910 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c7db6993-448a-4006-baba-48dacb50b1de tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 200 len: 1353 microversion: 2.1 time: 0.128141 Oct 10 23:20:27.863552 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 518/1039] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:27 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 1353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:27.869970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-01a92723-df67-41e4-bcf4-96d8dea7c218 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:27.870887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-01a92723-df67-41e4-bcf4-96d8dea7c218 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:27.878987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01a92723-df67-41e4-bcf4-96d8dea7c218 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:27.880172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01a92723-df67-41e4-bcf4-96d8dea7c218 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:27.880653 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01a92723-df67-41e4-bcf4-96d8dea7c218 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:27.882717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01a92723-df67-41e4-bcf4-96d8dea7c218 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:27.883310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01a92723-df67-41e4-bcf4-96d8dea7c218 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:27.883783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01a92723-df67-41e4-bcf4-96d8dea7c218 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:27.920047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.multi_cell_list [None req-51b4164e-ae8c-4e25-8e8a-345426640bbc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:20:27.988336 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-51b4164e-ae8c-4e25-8e8a-345426640bbc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.193497 Oct 10 23:20:27.988941 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 522/1040] 10.222.0.23 () {58 vars in 1154 bytes} [Mon Oct 10 23:20:27 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:20:28.004222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ab8d9603-2ca1-4d80-8453-59f7fd4e9574 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:28.013236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab8d9603-2ca1-4d80-8453-59f7fd4e9574 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:28.014321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab8d9603-2ca1-4d80-8453-59f7fd4e9574 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:28.014947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab8d9603-2ca1-4d80-8453-59f7fd4e9574 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:28.135598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ab8d9603-2ca1-4d80-8453-59f7fd4e9574 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Going to try to start instance {{(pid=120614) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 10 23:20:28.144549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-01a92723-df67-41e4-bcf4-96d8dea7c218 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lazy-loading 'services' on Instance uuid c3bb20a8-8b13-470d-ac2b-50b7a7bea206 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:20:28.200222 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-01a92723-df67-41e4-bcf4-96d8dea7c218 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 2035 microversion: 2.25 time: 0.335215 Oct 10 23:20:28.204552 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 519/1041] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:27 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 2035 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:28.231287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7a937e47-44e3-4144-a169-0f1371f2c732 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860864-2", "block_migration": "auto"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:28.241979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7a937e47-44e3-4144-a169-0f1371f2c732 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:28.250536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a937e47-44e3-4144-a169-0f1371f2c732 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:28.251316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a937e47-44e3-4144-a169-0f1371f2c732 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:28.251934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a937e47-44e3-4144-a169-0f1371f2c732 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:28.252994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a937e47-44e3-4144-a169-0f1371f2c732 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:28.253784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a937e47-44e3-4144-a169-0f1371f2c732 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:28.254375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a937e47-44e3-4144-a169-0f1371f2c732 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:28.268358 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ab8d9603-2ca1-4d80-8453-59f7fd4e9574 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "POST /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b/action" status: 202 len: 0 microversion: 2.1 time: 0.271080 Oct 10 23:20:28.272450 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 523/1042] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:20:27 2022] POST /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 23:20:28.283896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e09ea6f6-2887-437e-8a78-931da8f6dfdd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:28.284966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e09ea6f6-2887-437e-8a78-931da8f6dfdd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: d4bce34b-efcf-4b32-9c0c-882ebe101017] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:28.295566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e09ea6f6-2887-437e-8a78-931da8f6dfdd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:28.296212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e09ea6f6-2887-437e-8a78-931da8f6dfdd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:28.296417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-7a937e47-44e3-4144-a169-0f1371f2c732 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lazy-loading 'flavor' on Instance uuid c3bb20a8-8b13-470d-ac2b-50b7a7bea206 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:20:28.296853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e09ea6f6-2887-437e-8a78-931da8f6dfdd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:28.297715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e09ea6f6-2887-437e-8a78-931da8f6dfdd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:28.298302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e09ea6f6-2887-437e-8a78-931da8f6dfdd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:28.298843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e09ea6f6-2887-437e-8a78-931da8f6dfdd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:28.310820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7a937e47-44e3-4144-a169-0f1371f2c732 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Going to try to live migrate instance to n-h1-860864-2 {{(pid=120613) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 23:20:28.490098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e09ea6f6-2887-437e-8a78-931da8f6dfdd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:28.501363 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e09ea6f6-2887-437e-8a78-931da8f6dfdd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017" status: 200 len: 1472 microversion: 2.1 time: 0.228901 Oct 10 23:20:28.502171 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 524/1043] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:28 2022] GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017 => generated 1472 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:28.508062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-313e2812-fc9e-4e88-bd8e-e242de546ede tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:28.508869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-313e2812-fc9e-4e88-bd8e-e242de546ede tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:28.523370 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-313e2812-fc9e-4e88-bd8e-e242de546ede tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:28.524125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-313e2812-fc9e-4e88-bd8e-e242de546ede tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:28.524797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-313e2812-fc9e-4e88-bd8e-e242de546ede tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:28.525876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-313e2812-fc9e-4e88-bd8e-e242de546ede tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:28.526572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-313e2812-fc9e-4e88-bd8e-e242de546ede tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:28.527226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-313e2812-fc9e-4e88-bd8e-e242de546ede tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:28.710917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-313e2812-fc9e-4e88-bd8e-e242de546ede tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:28.721488 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-313e2812-fc9e-4e88-bd8e-e242de546ede tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1508 microversion: 2.1 time: 0.218079 Oct 10 23:20:28.722935 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 525/1044] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:28 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1508 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:28.727654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aaf9ee60-5e76-4822-8dc4-2cc63c1476c6 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:28.728641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aaf9ee60-5e76-4822-8dc4-2cc63c1476c6 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:28.735480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aaf9ee60-5e76-4822-8dc4-2cc63c1476c6 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:28.736211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aaf9ee60-5e76-4822-8dc4-2cc63c1476c6 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:28.736865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aaf9ee60-5e76-4822-8dc4-2cc63c1476c6 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:28.737846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aaf9ee60-5e76-4822-8dc4-2cc63c1476c6 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:28.738458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aaf9ee60-5e76-4822-8dc4-2cc63c1476c6 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:28.739040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aaf9ee60-5e76-4822-8dc4-2cc63c1476c6 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:28.908246 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aaf9ee60-5e76-4822-8dc4-2cc63c1476c6 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f553ef2324ac19370a181cf4c3629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2054001d7ed142698beaf51dcb6bd496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:28.918184 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aaf9ee60-5e76-4822-8dc4-2cc63c1476c6 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 200 len: 1316 microversion: 2.1 time: 0.193937 Oct 10 23:20:28.918897 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 526/1045] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:28 2022] GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 1316 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:28.933973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8147ef5d-73ec-4050-9770-42000a7c13f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:28.935246 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8147ef5d-73ec-4050-9770-42000a7c13f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:28.942001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8147ef5d-73ec-4050-9770-42000a7c13f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:28.942493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8147ef5d-73ec-4050-9770-42000a7c13f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:28.942918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8147ef5d-73ec-4050-9770-42000a7c13f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:28.943612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8147ef5d-73ec-4050-9770-42000a7c13f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:28.944057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8147ef5d-73ec-4050-9770-42000a7c13f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:28.944472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8147ef5d-73ec-4050-9770-42000a7c13f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:29.177667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8147ef5d-73ec-4050-9770-42000a7c13f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:29.189710 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8147ef5d-73ec-4050-9770-42000a7c13f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1470 microversion: 2.1 time: 0.268905 Oct 10 23:20:29.201411 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 527/1046] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:28 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1470 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:29.201411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-01fcbde0-bff6-46f9-819a-fec3edca9fdf tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:29.201411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-01fcbde0-bff6-46f9-819a-fec3edca9fdf tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:29.216216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01fcbde0-bff6-46f9-819a-fec3edca9fdf tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:29.216763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01fcbde0-bff6-46f9-819a-fec3edca9fdf tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:29.217939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01fcbde0-bff6-46f9-819a-fec3edca9fdf tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:29.218318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01fcbde0-bff6-46f9-819a-fec3edca9fdf tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:29.218866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01fcbde0-bff6-46f9-819a-fec3edca9fdf tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:29.219311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01fcbde0-bff6-46f9-819a-fec3edca9fdf tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:29.648842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-01fcbde0-bff6-46f9-819a-fec3edca9fdf tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:29.661675 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-01fcbde0-bff6-46f9-819a-fec3edca9fdf tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 200 len: 1316 microversion: 2.1 time: 0.468123 Oct 10 23:20:29.676765 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 528/1047] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:29 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:29.676765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-162b94c6-fc36-445c-86b0-52be3b2f0aeb tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:29.676765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-162b94c6-fc36-445c-86b0-52be3b2f0aeb tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:29.682105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-162b94c6-fc36-445c-86b0-52be3b2f0aeb tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:29.683848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-162b94c6-fc36-445c-86b0-52be3b2f0aeb tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:29.684307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-162b94c6-fc36-445c-86b0-52be3b2f0aeb tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:29.686657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-162b94c6-fc36-445c-86b0-52be3b2f0aeb tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:29.687296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-162b94c6-fc36-445c-86b0-52be3b2f0aeb tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:29.687917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-162b94c6-fc36-445c-86b0-52be3b2f0aeb tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:29.704268 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-162b94c6-fc36-445c-86b0-52be3b2f0aeb tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] HTTP exception thrown: Instance bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 could not be found. Oct 10 23:20:29.706053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-162b94c6-fc36-445c-86b0-52be3b2f0aeb tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Request method failure captured: Oct 10 23:20:29.706053 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 HTTP/1.1 Oct 10 23:20:29.706053 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:20:29.706053 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:20:29.706053 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:20:29.706053 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:20:29.706053 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:20:29.706053 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:20:29.706053 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:20:29.706053 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:29.706053 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKfpr_H3bE9_ipcFLFmtBtnkNxz58JpvfetvgMu0HVnPVmXWaJC--SxOr-Fwx0WhAx68NBbDOSHsjtngykYs644Y1OWq2MGebxpna629uqll8TU-2YYEHAxCSnKADg86UL2PhT4A6ss7j6r6a5voQU2Kl7pKirpjaPsmAsAV05fBbjc Oct 10 23:20:29.706053 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:20:29.706053 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:20:29.706053 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:20:29.706053 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:20:29.706053 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:20:29.706053 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:20:29.706053 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 25f3787ea28344e78082ff74d7540f43 Oct 10 23:20:29.706053 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-256611622 Oct 10 23:20:29.706053 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:20:29.706053 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:20:29.707511 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/25f3787ea28344e78082ff74d7540f43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25f3787ea28344e78082ff74d7540f43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25f3787ea28344e78082ff74d7540f43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_25f3787ea28344e78082ff74d7540f43", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:29.707511 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-256611622 Oct 10 23:20:29.707511 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 25f3787ea28344e78082ff74d7540f43 Oct 10 23:20:29.707511 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-256611622 Oct 10 23:20:29.707511 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersWithSpecificFlavorTestJSON-256611622-project Oct 10 23:20:29.707511 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:20:29.707511 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:20:29.707511 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: e6cd6d7dfaeb4ac79fabf16698c60f96 Oct 10 23:20:29.707511 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-256611622-project Oct 10 23:20:29.707511 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:20:29.707511 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 could not be found. Oct 10 23:20:29.707511 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'bbe32f87-f44c-40f1-a4be-8c6dd98c20b5'} Oct 10 23:20:29.708564 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:29.708564 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:29.708564 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:29.708564 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:29.708564 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:20:29.708564 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:20:29.708564 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:20:29.708564 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:20:29.708564 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:20:29.708564 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:20:29.708564 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 could not be found. Oct 10 23:20:29.708564 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:29.708564 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:29.708564 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:29.708564 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:29.708564 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:29.708564 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:29.708564 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:29.708564 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:29.708564 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:29.712851 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:29.712851 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:20:29.712851 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:20:29.712851 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:29.712851 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:29.712851 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:29.712851 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:29.712851 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 could not be found. Oct 10 23:20:29.712851 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:29.712851 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:29.712851 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:29.712851 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:29.712851 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:29.712851 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:29.712851 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:29.712851 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:29.712851 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 could not be found. Oct 10 23:20:29.712851 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:29.714309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-162b94c6-fc36-445c-86b0-52be3b2f0aeb tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Returning 404 to user: Instance bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:29.714309 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-162b94c6-fc36-445c-86b0-52be3b2f0aeb tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 404 len: 111 microversion: 2.1 time: 0.042077 Oct 10 23:20:29.714309 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 529/1048] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:29 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:29.714309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-519088c6-dfc8-42e5-8ce6-f85b3e49ba03 req-99d763ce-6f70-4605-84c5-2706a8bfa85f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dea3f22-ee85-4a3f-a4cd-a0634c6e451b", "tag": "f65ed136-fdf8-4735-a0b9-6e6d462b75e1"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:29.723871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-519088c6-dfc8-42e5-8ce6-f85b3e49ba03 req-99d763ce-6f70-4605-84c5-2706a8bfa85f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:29.724345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-519088c6-dfc8-42e5-8ce6-f85b3e49ba03 req-99d763ce-6f70-4605-84c5-2706a8bfa85f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:29.724796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-519088c6-dfc8-42e5-8ce6-f85b3e49ba03 req-99d763ce-6f70-4605-84c5-2706a8bfa85f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:29.736649 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-519088c6-dfc8-42e5-8ce6-f85b3e49ba03 req-99d763ce-6f70-4605-84c5-2706a8bfa85f service nova] Creating event network-changed:f65ed136-fdf8-4735-a0b9-6e6d462b75e1 for instance 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b on n-h2-860864-2 Oct 10 23:20:29.741724 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-519088c6-dfc8-42e5-8ce6-f85b3e49ba03 req-99d763ce-6f70-4605-84c5-2706a8bfa85f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032022 Oct 10 23:20:29.742884 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 530/1049] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:29.748923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c746ce8b-c1d2-4e74-a5b4-abd2ffe70d81 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:29.749656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c746ce8b-c1d2-4e74-a5b4-abd2ffe70d81 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: d4bce34b-efcf-4b32-9c0c-882ebe101017] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:29.755716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c746ce8b-c1d2-4e74-a5b4-abd2ffe70d81 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:29.756196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c746ce8b-c1d2-4e74-a5b4-abd2ffe70d81 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:29.756826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c746ce8b-c1d2-4e74-a5b4-abd2ffe70d81 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:29.757615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c746ce8b-c1d2-4e74-a5b4-abd2ffe70d81 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:29.758079 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c746ce8b-c1d2-4e74-a5b4-abd2ffe70d81 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:29.758491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c746ce8b-c1d2-4e74-a5b4-abd2ffe70d81 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:30.166949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c746ce8b-c1d2-4e74-a5b4-abd2ffe70d81 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:30.175652 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c746ce8b-c1d2-4e74-a5b4-abd2ffe70d81 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017" status: 200 len: 1472 microversion: 2.1 time: 0.431462 Oct 10 23:20:30.176295 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 531/1050] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:29 2022] GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017 => generated 1472 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:30.189513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d3561386-5012-44f5-8704-8e2bec971a06 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:30.189513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d3561386-5012-44f5-8704-8e2bec971a06 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: 12574d37-08bd-4e05-8953-e2e680ebee8c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:30.189513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3561386-5012-44f5-8704-8e2bec971a06 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:30.189513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3561386-5012-44f5-8704-8e2bec971a06 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:30.189945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3561386-5012-44f5-8704-8e2bec971a06 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:30.189945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3561386-5012-44f5-8704-8e2bec971a06 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:30.190134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3561386-5012-44f5-8704-8e2bec971a06 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:30.190588 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3561386-5012-44f5-8704-8e2bec971a06 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:30.205831 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-d3561386-5012-44f5-8704-8e2bec971a06 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] HTTP exception thrown: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. Oct 10 23:20:30.209063 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d3561386-5012-44f5-8704-8e2bec971a06 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Request method failure captured: Oct 10 23:20:30.209063 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c HTTP/1.1 Oct 10 23:20:30.209063 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:20:30.209063 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:20:30.209063 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:20:30.209063 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:20:30.209063 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:20:30.209063 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:20:30.209063 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:20:30.209063 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:30.209063 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKfpr_H3bE9_ipcFLFmtBtnkNxz58JpvfetvgMu0HVnPVmXWaJC--SxOr-Fwx0WhAx68NBbDOSHsjtngykYs644Y1OWq2MGebxpna629uqll8TU-2YYEHAxCSnKADg86UL2PhT4A6ss7j6r6a5voQU2Kl7pKirpjaPsmAsAV05fBbjc Oct 10 23:20:30.209063 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:20:30.209063 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:20:30.209063 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:20:30.209063 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:20:30.209063 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:20:30.209063 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:20:30.209063 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 25f3787ea28344e78082ff74d7540f43 Oct 10 23:20:30.209063 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-256611622 Oct 10 23:20:30.209063 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:20:30.209063 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:20:30.210718 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/25f3787ea28344e78082ff74d7540f43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25f3787ea28344e78082ff74d7540f43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25f3787ea28344e78082ff74d7540f43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_25f3787ea28344e78082ff74d7540f43", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:30.210718 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-256611622 Oct 10 23:20:30.210718 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 25f3787ea28344e78082ff74d7540f43 Oct 10 23:20:30.210718 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-256611622 Oct 10 23:20:30.210718 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersWithSpecificFlavorTestJSON-256611622-project Oct 10 23:20:30.210718 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:20:30.210718 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:20:30.210718 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: e6cd6d7dfaeb4ac79fabf16698c60f96 Oct 10 23:20:30.210718 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-256611622-project Oct 10 23:20:30.210718 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:20:30.210718 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. Oct 10 23:20:30.210718 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '12574d37-08bd-4e05-8953-e2e680ebee8c'} Oct 10 23:20:30.211557 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:30.211557 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:30.211557 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:30.211557 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:30.211557 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:20:30.211557 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:20:30.211557 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:20:30.211557 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:20:30.211557 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:20:30.211557 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:20:30.211557 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. Oct 10 23:20:30.211557 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:30.211557 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:30.211557 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:30.211557 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:30.211557 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:30.211557 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:30.211557 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:30.211557 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:30.211557 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:30.212868 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:30.212868 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:20:30.212868 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:20:30.212868 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:20:30.212868 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:20:30.212868 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:30.212868 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:30.212868 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:30.212868 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:30.212868 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. Oct 10 23:20:30.212868 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:30.212868 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:30.212868 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:30.212868 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:30.212868 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:30.212868 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:30.212868 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:30.212868 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:30.212868 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. Oct 10 23:20:30.212868 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:30.214145 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d3561386-5012-44f5-8704-8e2bec971a06 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Returning 404 to user: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:30.214145 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d3561386-5012-44f5-8704-8e2bec971a06 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "DELETE /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c" status: 404 len: 111 microversion: 2.1 time: 0.031599 Oct 10 23:20:30.214145 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 532/1051] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:20:30 2022] DELETE /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:30.219903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3e920336-f0af-42ef-9804-50827ed0b42e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:30.220680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3e920336-f0af-42ef-9804-50827ed0b42e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:30.227115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e920336-f0af-42ef-9804-50827ed0b42e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:30.227770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e920336-f0af-42ef-9804-50827ed0b42e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:30.228302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e920336-f0af-42ef-9804-50827ed0b42e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:30.229106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e920336-f0af-42ef-9804-50827ed0b42e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:30.229687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e920336-f0af-42ef-9804-50827ed0b42e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:30.230206 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e920336-f0af-42ef-9804-50827ed0b42e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:30.621169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3e920336-f0af-42ef-9804-50827ed0b42e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:30.633825 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3e920336-f0af-42ef-9804-50827ed0b42e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1508 microversion: 2.1 time: 0.419227 Oct 10 23:20:30.657236 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 533/1052] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:30 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1508 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:30.657236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5755db08-a85b-43bd-a341-54aefcfb4c43 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:30.657790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5755db08-a85b-43bd-a341-54aefcfb4c43 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:30.681127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5755db08-a85b-43bd-a341-54aefcfb4c43 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:30.681647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5755db08-a85b-43bd-a341-54aefcfb4c43 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:30.682084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5755db08-a85b-43bd-a341-54aefcfb4c43 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:30.682795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5755db08-a85b-43bd-a341-54aefcfb4c43 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:30.683247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5755db08-a85b-43bd-a341-54aefcfb4c43 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:30.683675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5755db08-a85b-43bd-a341-54aefcfb4c43 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:30.797960 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7a937e47-44e3-4144-a169-0f1371f2c732 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206/action" status: 202 len: 0 microversion: 2.25 time: 2.570037 Oct 10 23:20:30.798980 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 520/1053] 10.222.0.23 () {62 vars in 1319 bytes} [Mon Oct 10 23:20:28 2022] POST /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206/action => generated 0 bytes in 2572 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:20:30.806211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2caec7f9-2604-4f5d-aa52-5d2b72da68d9 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:30.806972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2caec7f9-2604-4f5d-aa52-5d2b72da68d9 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: 12574d37-08bd-4e05-8953-e2e680ebee8c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:30.816958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2caec7f9-2604-4f5d-aa52-5d2b72da68d9 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:30.818260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2caec7f9-2604-4f5d-aa52-5d2b72da68d9 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:30.818907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2caec7f9-2604-4f5d-aa52-5d2b72da68d9 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:30.820442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2caec7f9-2604-4f5d-aa52-5d2b72da68d9 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:30.821057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2caec7f9-2604-4f5d-aa52-5d2b72da68d9 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:30.821823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2caec7f9-2604-4f5d-aa52-5d2b72da68d9 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:30.840508 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-2caec7f9-2604-4f5d-aa52-5d2b72da68d9 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] HTTP exception thrown: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. Oct 10 23:20:30.844412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2caec7f9-2604-4f5d-aa52-5d2b72da68d9 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Request method failure captured: Oct 10 23:20:30.844412 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c HTTP/1.1 Oct 10 23:20:30.844412 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:20:30.844412 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:20:30.844412 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:20:30.844412 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:20:30.844412 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:20:30.844412 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:20:30.844412 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:20:30.844412 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:30.844412 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfpr_H3bE9_ipcFLFmtBtnkNxz58JpvfetvgMu0HVnPVmXWaJC--SxOr-Fwx0WhAx68NBbDOSHsjtngykYs644Y1OWq2MGebxpna629uqll8TU-2YYEHAxCSnKADg86UL2PhT4A6ss7j6r6a5voQU2Kl7pKirpjaPsmAsAV05fBbjc Oct 10 23:20:30.844412 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:20:30.844412 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:20:30.844412 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:20:30.844412 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:20:30.844412 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:20:30.844412 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:20:30.844412 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 25f3787ea28344e78082ff74d7540f43 Oct 10 23:20:30.844412 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-256611622 Oct 10 23:20:30.844412 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:20:30.844412 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:20:30.846101 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/25f3787ea28344e78082ff74d7540f43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25f3787ea28344e78082ff74d7540f43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25f3787ea28344e78082ff74d7540f43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_25f3787ea28344e78082ff74d7540f43", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:30.846101 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-256611622 Oct 10 23:20:30.846101 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 25f3787ea28344e78082ff74d7540f43 Oct 10 23:20:30.846101 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-256611622 Oct 10 23:20:30.846101 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersWithSpecificFlavorTestJSON-256611622-project Oct 10 23:20:30.846101 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:20:30.846101 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:20:30.846101 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: e6cd6d7dfaeb4ac79fabf16698c60f96 Oct 10 23:20:30.846101 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-256611622-project Oct 10 23:20:30.846101 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:20:30.846101 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. Oct 10 23:20:30.846101 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '12574d37-08bd-4e05-8953-e2e680ebee8c'} Oct 10 23:20:30.846886 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:30.846886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:30.846886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:30.846886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:30.846886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:20:30.846886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:20:30.846886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:20:30.846886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:20:30.846886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:20:30.846886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:20:30.846886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. Oct 10 23:20:30.846886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:30.846886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:30.846886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:30.846886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:30.846886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:30.846886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:30.846886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:30.846886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:30.846886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:30.848104 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:30.848104 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:20:30.848104 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:20:30.848104 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:30.848104 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:30.848104 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:30.848104 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:30.848104 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. Oct 10 23:20:30.848104 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:30.848104 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:30.848104 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:30.848104 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:30.848104 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:30.848104 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:30.848104 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:30.848104 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:30.848104 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. Oct 10 23:20:30.848104 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:30.851435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2caec7f9-2604-4f5d-aa52-5d2b72da68d9 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Returning 404 to user: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:30.852360 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2caec7f9-2604-4f5d-aa52-5d2b72da68d9 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c" status: 404 len: 111 microversion: 2.1 time: 0.052129 Oct 10 23:20:30.852922 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 521/1054] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:30 2022] GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:30.858489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8d71354d-e21b-4f38-9e0a-0cdda1a56581 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:30.859057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8d71354d-e21b-4f38-9e0a-0cdda1a56581 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:30.867392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d71354d-e21b-4f38-9e0a-0cdda1a56581 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:30.867877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d71354d-e21b-4f38-9e0a-0cdda1a56581 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:30.868771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d71354d-e21b-4f38-9e0a-0cdda1a56581 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:30.869869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d71354d-e21b-4f38-9e0a-0cdda1a56581 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:30.870518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d71354d-e21b-4f38-9e0a-0cdda1a56581 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:30.871157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d71354d-e21b-4f38-9e0a-0cdda1a56581 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:30.948620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5755db08-a85b-43bd-a341-54aefcfb4c43 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f553ef2324ac19370a181cf4c3629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2054001d7ed142698beaf51dcb6bd496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:30.962402 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5755db08-a85b-43bd-a341-54aefcfb4c43 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 200 len: 1504 microversion: 2.1 time: 0.309651 Oct 10 23:20:30.977400 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 534/1055] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:30 2022] GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 1504 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:30.977400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-a80e8fb7-aa50-4bf1-8fc8-995d690b164a req-e8895a5b-43d8-4088-9ba0-506824b9a4ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4bce34b-efcf-4b32-9c0c-882ebe101017", "name": "network-vif-deleted", "tag": "eecc4a02-e3b1-42d5-8ca7-35ef517e597e"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:30.991509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a80e8fb7-aa50-4bf1-8fc8-995d690b164a req-e8895a5b-43d8-4088-9ba0-506824b9a4ea service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:30.992185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a80e8fb7-aa50-4bf1-8fc8-995d690b164a req-e8895a5b-43d8-4088-9ba0-506824b9a4ea service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:30.992399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a80e8fb7-aa50-4bf1-8fc8-995d690b164a req-e8895a5b-43d8-4088-9ba0-506824b9a4ea service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:31.007077 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-a80e8fb7-aa50-4bf1-8fc8-995d690b164a req-e8895a5b-43d8-4088-9ba0-506824b9a4ea service nova] Creating event network-vif-deleted:eecc4a02-e3b1-42d5-8ca7-35ef517e597e for instance d4bce34b-efcf-4b32-9c0c-882ebe101017 on n-h1-860864-2 Oct 10 23:20:31.012944 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-a80e8fb7-aa50-4bf1-8fc8-995d690b164a req-e8895a5b-43d8-4088-9ba0-506824b9a4ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047616 Oct 10 23:20:31.014518 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 535/1056] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:31.020488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4fb55276-efef-4f1c-aa54-cdcd7e330b98 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:31.021367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4fb55276-efef-4f1c-aa54-cdcd7e330b98 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:31.031047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fb55276-efef-4f1c-aa54-cdcd7e330b98 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:31.031810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fb55276-efef-4f1c-aa54-cdcd7e330b98 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:31.032726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fb55276-efef-4f1c-aa54-cdcd7e330b98 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:31.033674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fb55276-efef-4f1c-aa54-cdcd7e330b98 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:31.034581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fb55276-efef-4f1c-aa54-cdcd7e330b98 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:31.036558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fb55276-efef-4f1c-aa54-cdcd7e330b98 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:31.059129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8d71354d-e21b-4f38-9e0a-0cdda1a56581 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:31.068077 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8d71354d-e21b-4f38-9e0a-0cdda1a56581 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1462 microversion: 2.1 time: 0.214083 Oct 10 23:20:31.068646 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 522/1057] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:30 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1462 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:31.073444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-be81ffec-09df-47c8-b0fd-d8a8f177d632 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:31.074286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-be81ffec-09df-47c8-b0fd-d8a8f177d632 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:31.081582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be81ffec-09df-47c8-b0fd-d8a8f177d632 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:31.082333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be81ffec-09df-47c8-b0fd-d8a8f177d632 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:31.083486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be81ffec-09df-47c8-b0fd-d8a8f177d632 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:31.084397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be81ffec-09df-47c8-b0fd-d8a8f177d632 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:31.085037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be81ffec-09df-47c8-b0fd-d8a8f177d632 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:31.085676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be81ffec-09df-47c8-b0fd-d8a8f177d632 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:31.190339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4fb55276-efef-4f1c-aa54-cdcd7e330b98 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:31.198624 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4fb55276-efef-4f1c-aa54-cdcd7e330b98 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 200 len: 1316 microversion: 2.1 time: 0.182767 Oct 10 23:20:31.199189 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 536/1058] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:31 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 1316 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:31.205934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9ec266df-4291-4f4b-a9ce-749554bd28ba tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '.version_select at 0x7f662b4ec8b0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:31.227392 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9ec266df-4291-4f4b-a9ce-749554bd28ba tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-589213585" status: 202 len: 0 microversion: 2.1 time: 0.026918 Oct 10 23:20:31.227987 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 537/1059] 10.222.0.23 () {58 vars in 1218 bytes} [Mon Oct 10 23:20:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-589213585 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:20:31.235492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7e1b0ea9-c041-4b44-9600-6e5b67a10c71 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:31.235988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7e1b0ea9-c041-4b44-9600-6e5b67a10c71 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:31.242361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e1b0ea9-c041-4b44-9600-6e5b67a10c71 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:31.242859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e1b0ea9-c041-4b44-9600-6e5b67a10c71 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:31.243297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e1b0ea9-c041-4b44-9600-6e5b67a10c71 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:31.244151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e1b0ea9-c041-4b44-9600-6e5b67a10c71 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:31.244620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e1b0ea9-c041-4b44-9600-6e5b67a10c71 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:31.245054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e1b0ea9-c041-4b44-9600-6e5b67a10c71 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:31.253873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-be81ffec-09df-47c8-b0fd-d8a8f177d632 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:31.264607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-be81ffec-09df-47c8-b0fd-d8a8f177d632 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:31.266126 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:31.266889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-be81ffec-09df-47c8-b0fd-d8a8f177d632 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:31.268638 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-be81ffec-09df-47c8-b0fd-d8a8f177d632 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1567 microversion: 2.25 time: 0.198845 Oct 10 23:20:31.270154 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 523/1060] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:31 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1567 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:31.275740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5fd34944-05c0-470e-9226-6a5ac9b0df76 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:31.276347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5fd34944-05c0-470e-9226-6a5ac9b0df76 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:31.282939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fd34944-05c0-470e-9226-6a5ac9b0df76 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:31.283619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fd34944-05c0-470e-9226-6a5ac9b0df76 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:31.284218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fd34944-05c0-470e-9226-6a5ac9b0df76 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:31.285078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fd34944-05c0-470e-9226-6a5ac9b0df76 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:31.285899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fd34944-05c0-470e-9226-6a5ac9b0df76 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:31.286476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fd34944-05c0-470e-9226-6a5ac9b0df76 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:31.287804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7e1b0ea9-c041-4b44-9600-6e5b67a10c71 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:20:31.386725 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7e1b0ea9-c041-4b44-9600-6e5b67a10c71 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 204 len: 0 microversion: 2.1 time: 0.157414 Oct 10 23:20:31.388524 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 538/1061] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:20:31 2022] DELETE /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:20:31.395799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-50ad7e39-a994-498d-accf-3f2df34a83ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:31.398100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-50ad7e39-a994-498d-accf-3f2df34a83ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: d4bce34b-efcf-4b32-9c0c-882ebe101017] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:31.406676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50ad7e39-a994-498d-accf-3f2df34a83ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:31.407165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50ad7e39-a994-498d-accf-3f2df34a83ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:31.407597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50ad7e39-a994-498d-accf-3f2df34a83ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:31.408341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50ad7e39-a994-498d-accf-3f2df34a83ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:31.408781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50ad7e39-a994-498d-accf-3f2df34a83ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:31.409196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50ad7e39-a994-498d-accf-3f2df34a83ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:31.450863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50ad7e39-a994-498d-accf-3f2df34a83ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:31.453257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50ad7e39-a994-498d-accf-3f2df34a83ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:31.454619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50ad7e39-a994-498d-accf-3f2df34a83ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:31.455100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-50ad7e39-a994-498d-accf-3f2df34a83ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lazy-loading 'fault' on Instance uuid d4bce34b-efcf-4b32-9c0c-882ebe101017 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:20:31.508183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-50ad7e39-a994-498d-accf-3f2df34a83ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:31.517629 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-50ad7e39-a994-498d-accf-3f2df34a83ca tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017" status: 200 len: 1306 microversion: 2.1 time: 0.126715 Oct 10 23:20:31.531000 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 539/1062] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:31 2022] GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017 => generated 1306 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:31.531000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d7785528-ab6f-4b78-870f-f5572c5b03a5 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:31.531000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d7785528-ab6f-4b78-870f-f5572c5b03a5 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:31.531619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7785528-ab6f-4b78-870f-f5572c5b03a5 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:31.531882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7785528-ab6f-4b78-870f-f5572c5b03a5 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:31.534736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7785528-ab6f-4b78-870f-f5572c5b03a5 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:31.534736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7785528-ab6f-4b78-870f-f5572c5b03a5 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:31.534736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7785528-ab6f-4b78-870f-f5572c5b03a5 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:31.534736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7785528-ab6f-4b78-870f-f5572c5b03a5 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:31.575069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5fd34944-05c0-470e-9226-6a5ac9b0df76 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:31.585001 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5fd34944-05c0-470e-9226-6a5ac9b0df76 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1462 microversion: 2.1 time: 0.313456 Oct 10 23:20:31.597333 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 524/1063] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:31 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1462 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:31.625973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8c2833e0-595b-4bbc-8f27-1401fafa5455 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Action: 'create', calling method: .version_select at 0x7f662b505820>, body: {"keypair": {"name": "tempest-keypair-750709035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSQRkjOxUSyOSFR8RYTwn32HxlxlWessfgthzbpzHFQU1gPM8YmdtjEAgvqTWNgiquiABsZiobHlIJbu9YA7ZGkX4ScMqs8QCREe1IWZ2sfQh7PXrHWDEvLc69WwvLR5A=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:31.660317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-8c2833e0-595b-4bbc-8f27-1401fafa5455 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Getting quotas for project 8fad4e7ad7ba4e8284360ccf30d71228. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:20:31.666293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-8c2833e0-595b-4bbc-8f27-1401fafa5455 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Getting quotas for user cbc0deea66094fac8d5f985e133ceaaa and project 8fad4e7ad7ba4e8284360ccf30d71228. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:20:31.710156 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8c2833e0-595b-4bbc-8f27-1401fafa5455 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.102282 Oct 10 23:20:31.711336 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 525/1064] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:20:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:20:31.723044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-af657109-73f4-4cb6-b913-5556657dac47 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:31.723586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-af657109-73f4-4cb6-b913-5556657dac47 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:31.730614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af657109-73f4-4cb6-b913-5556657dac47 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:31.731141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af657109-73f4-4cb6-b913-5556657dac47 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:31.733003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af657109-73f4-4cb6-b913-5556657dac47 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:31.733719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af657109-73f4-4cb6-b913-5556657dac47 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:31.734379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af657109-73f4-4cb6-b913-5556657dac47 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:31.734838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af657109-73f4-4cb6-b913-5556657dac47 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:31.854822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d7785528-ab6f-4b78-870f-f5572c5b03a5 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f553ef2324ac19370a181cf4c3629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2054001d7ed142698beaf51dcb6bd496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:31.864323 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d7785528-ab6f-4b78-870f-f5572c5b03a5 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 200 len: 1510 microversion: 2.1 time: 0.344881 Oct 10 23:20:31.865543 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 540/1065] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:31 2022] GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 1510 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:32.012564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-af657109-73f4-4cb6-b913-5556657dac47 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:32.023156 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-af657109-73f4-4cb6-b913-5556657dac47 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1512 microversion: 2.1 time: 0.303933 Oct 10 23:20:32.038213 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 526/1066] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:31 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1512 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:32.052769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0b10c436-6b59-4df8-b3aa-b77bb47c63ca tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:32.057712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0b10c436-6b59-4df8-b3aa-b77bb47c63ca tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:32.058479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.compute.servers [None req-0b10c436-6b59-4df8-b3aa-b77bb47c63ca tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Removing options 'limit' from query {{(pid=120614) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 10 23:20:32.059464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0b10c436-6b59-4df8-b3aa-b77bb47c63ca tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Searching by: {'deleted': False, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:20:32.061414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b10c436-6b59-4df8-b3aa-b77bb47c63ca tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.061946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b10c436-6b59-4df8-b3aa-b77bb47c63ca tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.063058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b10c436-6b59-4df8-b3aa-b77bb47c63ca tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.063408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b10c436-6b59-4df8-b3aa-b77bb47c63ca tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.063935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b10c436-6b59-4df8-b3aa-b77bb47c63ca tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.064437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b10c436-6b59-4df8-b3aa-b77bb47c63ca tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.065982 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0b10c436-6b59-4df8-b3aa-b77bb47c63ca tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.018476 Oct 10 23:20:32.073811 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 541/1067] 10.222.0.23 () {58 vars in 1140 bytes} [Mon Oct 10 23:20:32 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:20:32.083378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3ccaf813-623d-406f-9d12-72a153b38283 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:32.086836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3ccaf813-623d-406f-9d12-72a153b38283 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:32.094634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ccaf813-623d-406f-9d12-72a153b38283 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.095131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ccaf813-623d-406f-9d12-72a153b38283 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.095571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ccaf813-623d-406f-9d12-72a153b38283 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.096464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ccaf813-623d-406f-9d12-72a153b38283 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.097115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ccaf813-623d-406f-9d12-72a153b38283 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.097759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ccaf813-623d-406f-9d12-72a153b38283 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.161574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b52a0a10-a18c-4e81-8439-aedb87b2fb4d tempest-ServersWithSpecificFlavorTestJSON-991659152 tempest-ServersWithSpecificFlavorTestJSON-991659152-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:32.171555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:32.183515 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b52a0a10-a18c-4e81-8439-aedb87b2fb4d tempest-ServersWithSpecificFlavorTestJSON-991659152 tempest-ServersWithSpecificFlavorTestJSON-991659152-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/664831953" status: 202 len: 0 microversion: 2.1 time: 0.025464 Oct 10 23:20:32.184338 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 542/1068] 10.222.0.23 () {58 vars in 1158 bytes} [Mon Oct 10 23:20:32 2022] DELETE /compute/v2.1/flavors/664831953 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 23:20:32.192701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-570ee5f1-2a49-42d1-85b9-68d2db34a256 tempest-ServersWithSpecificFlavorTestJSON-991659152 tempest-ServersWithSpecificFlavorTestJSON-991659152-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:32.216801 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-570ee5f1-2a49-42d1-85b9-68d2db34a256 tempest-ServersWithSpecificFlavorTestJSON-991659152 tempest-ServersWithSpecificFlavorTestJSON-991659152-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.026762 Oct 10 23:20:32.217524 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 543/1069] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:20:32 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:32.231344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0f50c393-a3ef-48b8-a618-8e2677f85e81 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:32.232205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0f50c393-a3ef-48b8-a618-8e2677f85e81 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:32.238488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f50c393-a3ef-48b8-a618-8e2677f85e81 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.238987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f50c393-a3ef-48b8-a618-8e2677f85e81 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.239429 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f50c393-a3ef-48b8-a618-8e2677f85e81 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.240139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f50c393-a3ef-48b8-a618-8e2677f85e81 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.240595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f50c393-a3ef-48b8-a618-8e2677f85e81 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.241023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f50c393-a3ef-48b8-a618-8e2677f85e81 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.380350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0f50c393-a3ef-48b8-a618-8e2677f85e81 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:32.388500 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0f50c393-a3ef-48b8-a618-8e2677f85e81 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 200 len: 1316 microversion: 2.1 time: 0.161223 Oct 10 23:20:32.389075 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 544/1070] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:32 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:32.401532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-39297a02-7e4b-454a-8378-ccfbc391f2f1 tempest-ServersWithSpecificFlavorTestJSON-991659152 tempest-ServersWithSpecificFlavorTestJSON-991659152-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:32.413724 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-39297a02-7e4b-454a-8378-ccfbc391f2f1 tempest-ServersWithSpecificFlavorTestJSON-991659152 tempest-ServersWithSpecificFlavorTestJSON-991659152-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/2002068468" status: 202 len: 0 microversion: 2.1 time: 0.023338 Oct 10 23:20:32.414241 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 545/1071] 10.222.0.23 () {58 vars in 1161 bytes} [Mon Oct 10 23:20:32 2022] DELETE /compute/v2.1/flavors/2002068468 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:20:32.423124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-250a05e4-8c8d-47e7-bc5b-80a7346b8902 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:32.423752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-250a05e4-8c8d-47e7-bc5b-80a7346b8902 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:32.430301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-250a05e4-8c8d-47e7-bc5b-80a7346b8902 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.430801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-250a05e4-8c8d-47e7-bc5b-80a7346b8902 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.431254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-250a05e4-8c8d-47e7-bc5b-80a7346b8902 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.431991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-250a05e4-8c8d-47e7-bc5b-80a7346b8902 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.432451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-250a05e4-8c8d-47e7-bc5b-80a7346b8902 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.432824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-250a05e4-8c8d-47e7-bc5b-80a7346b8902 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.581348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-250a05e4-8c8d-47e7-bc5b-80a7346b8902 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:32.590494 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-250a05e4-8c8d-47e7-bc5b-80a7346b8902 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:32.592776 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-250a05e4-8c8d-47e7-bc5b-80a7346b8902 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:32.594026 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-250a05e4-8c8d-47e7-bc5b-80a7346b8902 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1567 microversion: 2.25 time: 0.175723 Oct 10 23:20:32.594782 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 546/1072] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:32 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:32.603651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2610bf48-3c42-4a86-b046-134d798cbdd5 tempest-ServersWithSpecificFlavorTestJSON-991659152 tempest-ServersWithSpecificFlavorTestJSON-991659152-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:32.620968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3ccaf813-623d-406f-9d12-72a153b38283 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:32.626206 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2610bf48-3c42-4a86-b046-134d798cbdd5 tempest-ServersWithSpecificFlavorTestJSON-991659152 tempest-ServersWithSpecificFlavorTestJSON-991659152-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030545 Oct 10 23:20:32.627170 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 547/1073] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:20:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:32.631803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bb6f31f7-ce11-45d7-a12b-43cd704a61bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:32.632414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bb6f31f7-ce11-45d7-a12b-43cd704a61bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: d4bce34b-efcf-4b32-9c0c-882ebe101017] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:32.639771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb6f31f7-ce11-45d7-a12b-43cd704a61bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.643308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb6f31f7-ce11-45d7-a12b-43cd704a61bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.643308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb6f31f7-ce11-45d7-a12b-43cd704a61bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.643308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb6f31f7-ce11-45d7-a12b-43cd704a61bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.643308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb6f31f7-ce11-45d7-a12b-43cd704a61bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.643808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb6f31f7-ce11-45d7-a12b-43cd704a61bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.644948 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3ccaf813-623d-406f-9d12-72a153b38283 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1512 microversion: 2.1 time: 0.568208 Oct 10 23:20:32.650653 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 527/1074] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:32 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1512 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:32.657320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8b2b9a5a-3d03-40ec-9a42-fdb1f6dc1c85 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:32.657972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8b2b9a5a-3d03-40ec-9a42-fdb1f6dc1c85 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:32.673499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b2b9a5a-3d03-40ec-9a42-fdb1f6dc1c85 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.674218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b2b9a5a-3d03-40ec-9a42-fdb1f6dc1c85 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.675080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b2b9a5a-3d03-40ec-9a42-fdb1f6dc1c85 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.676212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b2b9a5a-3d03-40ec-9a42-fdb1f6dc1c85 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.677812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b2b9a5a-3d03-40ec-9a42-fdb1f6dc1c85 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.678334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b2b9a5a-3d03-40ec-9a42-fdb1f6dc1c85 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.695315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb6f31f7-ce11-45d7-a12b-43cd704a61bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.696095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb6f31f7-ce11-45d7-a12b-43cd704a61bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.696817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb6f31f7-ce11-45d7-a12b-43cd704a61bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.697246 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-8b2b9a5a-3d03-40ec-9a42-fdb1f6dc1c85 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] HTTP exception thrown: Instance bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 could not be found. Oct 10 23:20:32.697409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-bb6f31f7-ce11-45d7-a12b-43cd704a61bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lazy-loading 'fault' on Instance uuid d4bce34b-efcf-4b32-9c0c-882ebe101017 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:20:32.698941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8b2b9a5a-3d03-40ec-9a42-fdb1f6dc1c85 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Request method failure captured: Oct 10 23:20:32.698941 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 HTTP/1.1 Oct 10 23:20:32.698941 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:20:32.698941 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:20:32.698941 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:20:32.698941 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:20:32.698941 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:20:32.698941 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:20:32.698941 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:20:32.698941 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:32.698941 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKfpr_H3bE9_ipcFLFmtBtnkNxz58JpvfetvgMu0HVnPVmXWaJC--SxOr-Fwx0WhAx68NBbDOSHsjtngykYs644Y1OWq2MGebxpna629uqll8TU-2YYEHAxCSnKADg86UL2PhT4A6ss7j6r6a5voQU2Kl7pKirpjaPsmAsAV05fBbjc Oct 10 23:20:32.698941 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:20:32.698941 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:20:32.698941 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:20:32.698941 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:20:32.698941 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:20:32.698941 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:20:32.698941 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 25f3787ea28344e78082ff74d7540f43 Oct 10 23:20:32.698941 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-256611622 Oct 10 23:20:32.698941 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:20:32.698941 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:20:32.701026 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/25f3787ea28344e78082ff74d7540f43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25f3787ea28344e78082ff74d7540f43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25f3787ea28344e78082ff74d7540f43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_25f3787ea28344e78082ff74d7540f43", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:32.701026 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-256611622 Oct 10 23:20:32.701026 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 25f3787ea28344e78082ff74d7540f43 Oct 10 23:20:32.701026 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-256611622 Oct 10 23:20:32.701026 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersWithSpecificFlavorTestJSON-256611622-project Oct 10 23:20:32.701026 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:20:32.701026 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:20:32.701026 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: e6cd6d7dfaeb4ac79fabf16698c60f96 Oct 10 23:20:32.701026 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-256611622-project Oct 10 23:20:32.701026 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:20:32.701026 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 could not be found. Oct 10 23:20:32.701026 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'bbe32f87-f44c-40f1-a4be-8c6dd98c20b5'} Oct 10 23:20:32.701842 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:32.701842 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:32.701842 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:32.701842 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:32.701842 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:20:32.701842 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:20:32.701842 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:20:32.701842 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:20:32.701842 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:20:32.701842 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:20:32.701842 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 could not be found. Oct 10 23:20:32.701842 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:32.701842 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:32.701842 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:32.701842 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:32.701842 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:32.701842 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:32.701842 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:32.701842 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:32.701842 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:32.703081 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:32.703081 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:20:32.703081 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:20:32.703081 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:20:32.703081 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:20:32.703081 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:32.703081 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:32.703081 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:32.703081 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:32.703081 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 could not be found. Oct 10 23:20:32.703081 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:32.703081 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:32.703081 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:32.703081 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:32.703081 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:32.703081 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:32.703081 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:32.703081 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:32.703081 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 could not be found. Oct 10 23:20:32.703081 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:32.704284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8b2b9a5a-3d03-40ec-9a42-fdb1f6dc1c85 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Returning 404 to user: Instance bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:32.704284 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8b2b9a5a-3d03-40ec-9a42-fdb1f6dc1c85 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 404 len: 111 microversion: 2.1 time: 0.048379 Oct 10 23:20:32.704284 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 528/1075] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:20:32 2022] DELETE /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:32.707565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-06c0ff37-7deb-4edc-a80d-f773284f11b3 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:32.708257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-06c0ff37-7deb-4edc-a80d-f773284f11b3 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:32.714275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06c0ff37-7deb-4edc-a80d-f773284f11b3 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.714757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06c0ff37-7deb-4edc-a80d-f773284f11b3 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.715218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06c0ff37-7deb-4edc-a80d-f773284f11b3 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.716069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06c0ff37-7deb-4edc-a80d-f773284f11b3 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.716704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06c0ff37-7deb-4edc-a80d-f773284f11b3 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.717354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06c0ff37-7deb-4edc-a80d-f773284f11b3 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.751752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb6f31f7-ce11-45d7-a12b-43cd704a61bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:32.760056 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bb6f31f7-ce11-45d7-a12b-43cd704a61bd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017" status: 200 len: 1306 microversion: 2.1 time: 0.131830 Oct 10 23:20:32.760635 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 548/1076] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:32 2022] GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017 => generated 1306 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:32.766011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-15327184-df24-4285-8010-81ff8c713c71 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:32.766859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-15327184-df24-4285-8010-81ff8c713c71 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: bbe32f87-f44c-40f1-a4be-8c6dd98c20b5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:32.773657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15327184-df24-4285-8010-81ff8c713c71 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.774333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15327184-df24-4285-8010-81ff8c713c71 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.774952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15327184-df24-4285-8010-81ff8c713c71 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.775826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15327184-df24-4285-8010-81ff8c713c71 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.776281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15327184-df24-4285-8010-81ff8c713c71 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.776707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15327184-df24-4285-8010-81ff8c713c71 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.790619 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-15327184-df24-4285-8010-81ff8c713c71 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] HTTP exception thrown: Instance bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 could not be found. Oct 10 23:20:32.792312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-15327184-df24-4285-8010-81ff8c713c71 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Request method failure captured: Oct 10 23:20:32.792312 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 HTTP/1.1 Oct 10 23:20:32.792312 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:20:32.792312 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:20:32.792312 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:20:32.792312 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:20:32.792312 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:20:32.792312 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:20:32.792312 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:20:32.792312 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:32.792312 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKfpr_H3bE9_ipcFLFmtBtnkNxz58JpvfetvgMu0HVnPVmXWaJC--SxOr-Fwx0WhAx68NBbDOSHsjtngykYs644Y1OWq2MGebxpna629uqll8TU-2YYEHAxCSnKADg86UL2PhT4A6ss7j6r6a5voQU2Kl7pKirpjaPsmAsAV05fBbjc Oct 10 23:20:32.792312 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:20:32.792312 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:20:32.792312 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:20:32.792312 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:20:32.792312 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:20:32.792312 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:20:32.792312 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 25f3787ea28344e78082ff74d7540f43 Oct 10 23:20:32.792312 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-256611622 Oct 10 23:20:32.792312 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:20:32.792312 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:20:32.793914 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/25f3787ea28344e78082ff74d7540f43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25f3787ea28344e78082ff74d7540f43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25f3787ea28344e78082ff74d7540f43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_25f3787ea28344e78082ff74d7540f43", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:32.793914 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-256611622 Oct 10 23:20:32.793914 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 25f3787ea28344e78082ff74d7540f43 Oct 10 23:20:32.793914 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-256611622 Oct 10 23:20:32.793914 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersWithSpecificFlavorTestJSON-256611622-project Oct 10 23:20:32.793914 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:20:32.793914 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:20:32.793914 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: e6cd6d7dfaeb4ac79fabf16698c60f96 Oct 10 23:20:32.793914 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-256611622-project Oct 10 23:20:32.793914 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:20:32.793914 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 could not be found. Oct 10 23:20:32.793914 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'bbe32f87-f44c-40f1-a4be-8c6dd98c20b5'} Oct 10 23:20:32.795639 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:32.795639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:32.795639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:32.795639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:32.795639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:20:32.795639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:20:32.795639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:20:32.795639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:20:32.795639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:20:32.795639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:20:32.795639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 could not be found. Oct 10 23:20:32.795639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:32.795639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:32.795639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:32.795639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:32.795639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:32.795639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:32.795639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:32.795639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:32.795639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:32.797091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:32.797091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:20:32.797091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:20:32.797091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:32.797091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:32.797091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:32.797091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:32.797091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 could not be found. Oct 10 23:20:32.797091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:32.797091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:32.797091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:32.797091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:32.797091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:32.797091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:32.797091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:32.797091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:32.797091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 could not be found. Oct 10 23:20:32.797091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:32.798609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-15327184-df24-4285-8010-81ff8c713c71 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Returning 404 to user: Instance bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:32.798609 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-15327184-df24-4285-8010-81ff8c713c71 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5" status: 404 len: 111 microversion: 2.1 time: 0.032125 Oct 10 23:20:32.798609 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 549/1077] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:32 2022] GET /compute/v2.1/servers/bbe32f87-f44c-40f1-a4be-8c6dd98c20b5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:32.803277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-06caac5e-72b6-4df9-9941-f6e937907824 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:32.803773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-06caac5e-72b6-4df9-9941-f6e937907824 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: 12574d37-08bd-4e05-8953-e2e680ebee8c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:32.811042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06caac5e-72b6-4df9-9941-f6e937907824 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.811532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06caac5e-72b6-4df9-9941-f6e937907824 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.811966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06caac5e-72b6-4df9-9941-f6e937907824 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.812673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06caac5e-72b6-4df9-9941-f6e937907824 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.813184 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06caac5e-72b6-4df9-9941-f6e937907824 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.813649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06caac5e-72b6-4df9-9941-f6e937907824 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.832717 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-06caac5e-72b6-4df9-9941-f6e937907824 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] HTTP exception thrown: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. Oct 10 23:20:32.834517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-06caac5e-72b6-4df9-9941-f6e937907824 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Request method failure captured: Oct 10 23:20:32.834517 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c HTTP/1.1 Oct 10 23:20:32.834517 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:20:32.834517 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:20:32.834517 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:20:32.834517 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:20:32.834517 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:20:32.834517 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:20:32.834517 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:20:32.834517 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:32.834517 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKfpr_H3bE9_ipcFLFmtBtnkNxz58JpvfetvgMu0HVnPVmXWaJC--SxOr-Fwx0WhAx68NBbDOSHsjtngykYs644Y1OWq2MGebxpna629uqll8TU-2YYEHAxCSnKADg86UL2PhT4A6ss7j6r6a5voQU2Kl7pKirpjaPsmAsAV05fBbjc Oct 10 23:20:32.834517 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:20:32.834517 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:20:32.834517 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:20:32.834517 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:20:32.834517 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:20:32.834517 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:20:32.834517 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 25f3787ea28344e78082ff74d7540f43 Oct 10 23:20:32.834517 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-256611622 Oct 10 23:20:32.834517 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:20:32.834517 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:20:32.836198 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/25f3787ea28344e78082ff74d7540f43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25f3787ea28344e78082ff74d7540f43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25f3787ea28344e78082ff74d7540f43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_25f3787ea28344e78082ff74d7540f43", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:32.836198 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-256611622 Oct 10 23:20:32.836198 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 25f3787ea28344e78082ff74d7540f43 Oct 10 23:20:32.836198 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-256611622 Oct 10 23:20:32.836198 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersWithSpecificFlavorTestJSON-256611622-project Oct 10 23:20:32.836198 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:20:32.836198 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:20:32.836198 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: e6cd6d7dfaeb4ac79fabf16698c60f96 Oct 10 23:20:32.836198 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-256611622-project Oct 10 23:20:32.836198 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:20:32.836198 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. Oct 10 23:20:32.836198 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '12574d37-08bd-4e05-8953-e2e680ebee8c'} Oct 10 23:20:32.837072 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:32.837072 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:32.837072 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:32.837072 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:32.837072 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:20:32.837072 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:20:32.837072 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:20:32.837072 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:20:32.837072 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:20:32.837072 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:20:32.837072 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. Oct 10 23:20:32.837072 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:32.837072 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:32.837072 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:32.837072 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:32.837072 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:32.837072 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:32.837072 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:32.837072 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:32.837072 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:32.838789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:32.838789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:20:32.838789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:20:32.838789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:20:32.838789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:20:32.838789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:32.838789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:32.838789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:32.838789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:32.838789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. Oct 10 23:20:32.838789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:32.838789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:32.838789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:32.838789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:32.838789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:32.838789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:32.838789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:32.838789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:32.838789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. Oct 10 23:20:32.838789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:32.840751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-06caac5e-72b6-4df9-9941-f6e937907824 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Returning 404 to user: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:32.840751 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-06caac5e-72b6-4df9-9941-f6e937907824 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "DELETE /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c" status: 404 len: 111 microversion: 2.1 time: 0.037783 Oct 10 23:20:32.840751 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 550/1078] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:20:32 2022] DELETE /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:32.845788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9a6797a8-3af1-44bd-bbec-5933fbd06bd6 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:32.846483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9a6797a8-3af1-44bd-bbec-5933fbd06bd6 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] [instance: 12574d37-08bd-4e05-8953-e2e680ebee8c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:32.853557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a6797a8-3af1-44bd-bbec-5933fbd06bd6 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.854134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a6797a8-3af1-44bd-bbec-5933fbd06bd6 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.854639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a6797a8-3af1-44bd-bbec-5933fbd06bd6 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.855403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a6797a8-3af1-44bd-bbec-5933fbd06bd6 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.855925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a6797a8-3af1-44bd-bbec-5933fbd06bd6 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.856422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a6797a8-3af1-44bd-bbec-5933fbd06bd6 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.871171 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-9a6797a8-3af1-44bd-bbec-5933fbd06bd6 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] HTTP exception thrown: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. Oct 10 23:20:32.872927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9a6797a8-3af1-44bd-bbec-5933fbd06bd6 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Request method failure captured: Oct 10 23:20:32.872927 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c HTTP/1.1 Oct 10 23:20:32.872927 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:20:32.872927 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:20:32.872927 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:20:32.872927 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:20:32.872927 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:20:32.872927 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:20:32.872927 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:20:32.872927 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:32.872927 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKfpr_H3bE9_ipcFLFmtBtnkNxz58JpvfetvgMu0HVnPVmXWaJC--SxOr-Fwx0WhAx68NBbDOSHsjtngykYs644Y1OWq2MGebxpna629uqll8TU-2YYEHAxCSnKADg86UL2PhT4A6ss7j6r6a5voQU2Kl7pKirpjaPsmAsAV05fBbjc Oct 10 23:20:32.872927 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:20:32.872927 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:20:32.872927 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:20:32.872927 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:20:32.872927 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:20:32.872927 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:20:32.872927 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 25f3787ea28344e78082ff74d7540f43 Oct 10 23:20:32.872927 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-256611622 Oct 10 23:20:32.872927 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:20:32.872927 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:20:32.874377 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/25f3787ea28344e78082ff74d7540f43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25f3787ea28344e78082ff74d7540f43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25f3787ea28344e78082ff74d7540f43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_25f3787ea28344e78082ff74d7540f43", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:32.874377 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-256611622 Oct 10 23:20:32.874377 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 25f3787ea28344e78082ff74d7540f43 Oct 10 23:20:32.874377 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-256611622 Oct 10 23:20:32.874377 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersWithSpecificFlavorTestJSON-256611622-project Oct 10 23:20:32.874377 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:20:32.874377 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:20:32.874377 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: e6cd6d7dfaeb4ac79fabf16698c60f96 Oct 10 23:20:32.874377 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-256611622-project Oct 10 23:20:32.874377 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:20:32.874377 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. Oct 10 23:20:32.874377 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '12574d37-08bd-4e05-8953-e2e680ebee8c'} Oct 10 23:20:32.875305 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:32.875305 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:32.875305 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:32.875305 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:32.875305 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:20:32.875305 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:20:32.875305 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:20:32.875305 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:20:32.875305 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:20:32.875305 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:20:32.875305 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. Oct 10 23:20:32.875305 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:32.875305 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:32.875305 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:32.875305 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:32.875305 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:32.875305 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:32.875305 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:32.875305 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:32.875305 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:32.876823 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:32.876823 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:20:32.876823 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:20:32.876823 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:32.876823 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:32.876823 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:32.876823 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:32.876823 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. Oct 10 23:20:32.876823 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:32.876823 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:32.876823 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:32.876823 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:32.876823 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:32.876823 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:32.876823 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:32.876823 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:32.876823 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. Oct 10 23:20:32.876823 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:32.878300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9a6797a8-3af1-44bd-bbec-5933fbd06bd6 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] Returning 404 to user: Instance 12574d37-08bd-4e05-8953-e2e680ebee8c could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:32.878300 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9a6797a8-3af1-44bd-bbec-5933fbd06bd6 tempest-ServersWithSpecificFlavorTestJSON-256611622 tempest-ServersWithSpecificFlavorTestJSON-256611622-project] 10.222.0.23 "GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c" status: 404 len: 111 microversion: 2.1 time: 0.032281 Oct 10 23:20:32.878300 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 551/1079] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:32 2022] GET /compute/v2.1/servers/12574d37-08bd-4e05-8953-e2e680ebee8c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:20:32.896403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c1d5452b-e03e-425b-ab16-2aaf8232801c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:32.897492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c1d5452b-e03e-425b-ab16-2aaf8232801c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:32.904962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1d5452b-e03e-425b-ab16-2aaf8232801c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.905793 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1d5452b-e03e-425b-ab16-2aaf8232801c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.906379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1d5452b-e03e-425b-ab16-2aaf8232801c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.909415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1d5452b-e03e-425b-ab16-2aaf8232801c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.909415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1d5452b-e03e-425b-ab16-2aaf8232801c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.909415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1d5452b-e03e-425b-ab16-2aaf8232801c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.911019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-06c0ff37-7deb-4edc-a80d-f773284f11b3 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:32.929827 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-06c0ff37-7deb-4edc-a80d-f773284f11b3 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d" status: 200 len: 1513 microversion: 2.1 time: 0.224208 Oct 10 23:20:32.931831 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 529/1080] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:32 2022] GET /compute/v2.1/servers/9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:32.955257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-65f6de47-471a-4492-9b71-14bf8ac459f5 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:32.955880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-65f6de47-471a-4492-9b71-14bf8ac459f5 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 4521fa13-07d6-4f81-9a92-64b6862a3bd3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:32.962295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65f6de47-471a-4492-9b71-14bf8ac459f5 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.962831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65f6de47-471a-4492-9b71-14bf8ac459f5 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.963356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65f6de47-471a-4492-9b71-14bf8ac459f5 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:32.964060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65f6de47-471a-4492-9b71-14bf8ac459f5 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:32.965466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65f6de47-471a-4492-9b71-14bf8ac459f5 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:32.965466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65f6de47-471a-4492-9b71-14bf8ac459f5 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:33.160135 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c1d5452b-e03e-425b-ab16-2aaf8232801c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f553ef2324ac19370a181cf4c3629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2054001d7ed142698beaf51dcb6bd496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:33.164239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-65f6de47-471a-4492-9b71-14bf8ac459f5 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:33.170684 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c1d5452b-e03e-425b-ab16-2aaf8232801c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 200 len: 1510 microversion: 2.1 time: 0.280058 Oct 10 23:20:33.190253 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 552/1081] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:32 2022] GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 1510 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:33.192950 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-65f6de47-471a-4492-9b71-14bf8ac459f5 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3" status: 200 len: 1513 microversion: 2.1 time: 0.242224 Oct 10 23:20:33.210059 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 530/1082] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:32 2022] GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3 => generated 1513 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:33.215369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cdb3637f-f46c-4208-956c-94a762cd2543 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:33.221733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cdb3637f-f46c-4208-956c-94a762cd2543 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:33.222450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cdb3637f-f46c-4208-956c-94a762cd2543 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:20:33.415297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8a2a5994-dffb-45ea-abeb-3f3d8c0d3047 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:33.416432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8a2a5994-dffb-45ea-abeb-3f3d8c0d3047 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:33.423068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:33.425636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a2a5994-dffb-45ea-abeb-3f3d8c0d3047 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:33.426516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a2a5994-dffb-45ea-abeb-3f3d8c0d3047 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:33.427325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a2a5994-dffb-45ea-abeb-3f3d8c0d3047 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:33.428284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a2a5994-dffb-45ea-abeb-3f3d8c0d3047 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:33.429407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a2a5994-dffb-45ea-abeb-3f3d8c0d3047 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:33.430562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a2a5994-dffb-45ea-abeb-3f3d8c0d3047 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:33.694390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cdb3637f-f46c-4208-956c-94a762cd2543 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:33.695678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cdb3637f-f46c-4208-956c-94a762cd2543 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:33.696289 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cdb3637f-f46c-4208-956c-94a762cd2543 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:33.697209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cdb3637f-f46c-4208-956c-94a762cd2543 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:33.697688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cdb3637f-f46c-4208-956c-94a762cd2543 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:33.698268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cdb3637f-f46c-4208-956c-94a762cd2543 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:33.710860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8a2a5994-dffb-45ea-abeb-3f3d8c0d3047 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:33.728724 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8a2a5994-dffb-45ea-abeb-3f3d8c0d3047 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 200 len: 1316 microversion: 2.1 time: 0.318514 Oct 10 23:20:33.731347 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 531/1083] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:33 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 1316 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:33.741245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-18a00f6f-b6d5-4c11-830b-7238834a5998 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:33.742347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-18a00f6f-b6d5-4c11-830b-7238834a5998 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:33.751877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18a00f6f-b6d5-4c11-830b-7238834a5998 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:33.752879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18a00f6f-b6d5-4c11-830b-7238834a5998 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:33.753524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18a00f6f-b6d5-4c11-830b-7238834a5998 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:33.754539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18a00f6f-b6d5-4c11-830b-7238834a5998 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:33.755196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18a00f6f-b6d5-4c11-830b-7238834a5998 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:33.756210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18a00f6f-b6d5-4c11-830b-7238834a5998 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:33.780410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:33.844229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.multi_cell_list [None req-cdb3637f-f46c-4208-956c-94a762cd2543 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:20:33.964051 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cdb3637f-f46c-4208-956c-94a762cd2543 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.752362 Oct 10 23:20:33.965294 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 553/1084] 10.222.0.23 () {58 vars in 1154 bytes} [Mon Oct 10 23:20:33 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:20:33.983681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-907f9914-7b48-4f39-8177-2365e9533881 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:33.984585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-907f9914-7b48-4f39-8177-2365e9533881 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: d4bce34b-efcf-4b32-9c0c-882ebe101017] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:33.992871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-907f9914-7b48-4f39-8177-2365e9533881 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:33.993478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-907f9914-7b48-4f39-8177-2365e9533881 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:33.994814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-907f9914-7b48-4f39-8177-2365e9533881 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:33.994814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-907f9914-7b48-4f39-8177-2365e9533881 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:33.995343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-907f9914-7b48-4f39-8177-2365e9533881 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:34.008449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-907f9914-7b48-4f39-8177-2365e9533881 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:34.034704 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-907f9914-7b48-4f39-8177-2365e9533881 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] HTTP exception thrown: Instance d4bce34b-efcf-4b32-9c0c-882ebe101017 could not be found. Oct 10 23:20:34.036244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-907f9914-7b48-4f39-8177-2365e9533881 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Request method failure captured: Oct 10 23:20:34.036244 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017 HTTP/1.1 Oct 10 23:20:34.036244 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:20:34.036244 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:20:34.036244 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:20:34.036244 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:20:34.036244 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:20:34.036244 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:20:34.036244 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:20:34.036244 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:34.036244 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgJCGPRazsPZv_KJRTPkW4yfXkftWI99r6NM1NcPzbV6ezzFy8Kk0KC2fs-Oq1mdxcQ8vpiKa4rTjWrgHH8KDGbQArWJeSLbZnpz5njlegxl252rFp2J2t_YkO8EBZX2N9DD656V96Tu1xc3xvEKd_hjW4bndDcX9tluGi3sznnXco Oct 10 23:20:34.036244 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:20:34.036244 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:20:34.036244 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:20:34.036244 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:20:34.036244 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:20:34.036244 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:20:34.036244 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: d98b12fc1bbf42d4b7376222c55733ed Oct 10 23:20:34.036244 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:20:34.036244 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:20:34.036244 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:20:34.037863 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d98b12fc1bbf42d4b7376222c55733ed", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:34.037863 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:20:34.037863 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: d98b12fc1bbf42d4b7376222c55733ed Oct 10 23:20:34.037863 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:20:34.037863 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersOnMultiNodesTest-1123459593-project Oct 10 23:20:34.037863 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:20:34.037863 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:20:34.037863 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 310196e1663a4f7ca12e1fc53b0278ba Oct 10 23:20:34.037863 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersOnMultiNodesTest-1123459593-project Oct 10 23:20:34.037863 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:20:34.037863 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance d4bce34b-efcf-4b32-9c0c-882ebe101017 could not be found. Oct 10 23:20:34.037863 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'd4bce34b-efcf-4b32-9c0c-882ebe101017'} Oct 10 23:20:34.038770 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:34.038770 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:34.038770 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:34.038770 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:34.038770 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:20:34.038770 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:20:34.038770 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:20:34.038770 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:20:34.038770 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:20:34.038770 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:20:34.038770 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4bce34b-efcf-4b32-9c0c-882ebe101017 could not be found. Oct 10 23:20:34.038770 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:34.038770 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:34.038770 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:34.038770 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:34.038770 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:34.038770 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:34.038770 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:34.038770 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:34.038770 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:34.040140 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:34.040140 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:20:34.040140 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:20:34.040140 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:34.040140 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:34.040140 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:34.040140 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:34.040140 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4bce34b-efcf-4b32-9c0c-882ebe101017 could not be found. Oct 10 23:20:34.040140 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:34.040140 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:34.040140 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:34.040140 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:34.040140 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:34.040140 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:34.040140 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:34.040140 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:34.040140 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4bce34b-efcf-4b32-9c0c-882ebe101017 could not be found. Oct 10 23:20:34.040140 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:34.041509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-907f9914-7b48-4f39-8177-2365e9533881 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Returning 404 to user: Instance d4bce34b-efcf-4b32-9c0c-882ebe101017 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:34.041509 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-907f9914-7b48-4f39-8177-2365e9533881 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017" status: 404 len: 111 microversion: 2.1 time: 0.070330 Oct 10 23:20:34.041675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-18a00f6f-b6d5-4c11-830b-7238834a5998 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:34.042972 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 554/1085] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:33 2022] GET /compute/v2.1/servers/d4bce34b-efcf-4b32-9c0c-882ebe101017 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:34.050199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-68c4d4c4-9bc6-4b0b-b36a-954b4c68e5bf tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:34.050830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-68c4d4c4-9bc6-4b0b-b36a-954b4c68e5bf tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:34.051446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-18a00f6f-b6d5-4c11-830b-7238834a5998 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:34.054173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-18a00f6f-b6d5-4c11-830b-7238834a5998 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:34.056545 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-18a00f6f-b6d5-4c11-830b-7238834a5998 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1567 microversion: 2.25 time: 0.322303 Oct 10 23:20:34.065433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68c4d4c4-9bc6-4b0b-b36a-954b4c68e5bf tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:34.065433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68c4d4c4-9bc6-4b0b-b36a-954b4c68e5bf tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:34.065433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68c4d4c4-9bc6-4b0b-b36a-954b4c68e5bf tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:34.065433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68c4d4c4-9bc6-4b0b-b36a-954b4c68e5bf tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:34.065934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68c4d4c4-9bc6-4b0b-b36a-954b4c68e5bf tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:34.065934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68c4d4c4-9bc6-4b0b-b36a-954b4c68e5bf tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:34.066577 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 532/1086] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:33 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1567 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:34.075860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fa7b45bb-c881-485a-a763-1987251676d4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:34.076503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fa7b45bb-c881-485a-a763-1987251676d4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:34.085191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa7b45bb-c881-485a-a763-1987251676d4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:34.086258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa7b45bb-c881-485a-a763-1987251676d4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:34.087009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa7b45bb-c881-485a-a763-1987251676d4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:34.087936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa7b45bb-c881-485a-a763-1987251676d4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:34.088610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa7b45bb-c881-485a-a763-1987251676d4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:34.089269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa7b45bb-c881-485a-a763-1987251676d4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:34.119450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fa7b45bb-c881-485a-a763-1987251676d4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:20:34.234116 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fa7b45bb-c881-485a-a763-1987251676d4 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8" status: 204 len: 0 microversion: 2.1 time: 0.165877 Oct 10 23:20:34.234855 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 533/1087] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:20:34 2022] DELETE /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:20:34.244294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4e19f094-970f-4a88-8da6-130f4f95db17 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:34.244578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4e19f094-970f-4a88-8da6-130f4f95db17 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:34.251756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e19f094-970f-4a88-8da6-130f4f95db17 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:34.252042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e19f094-970f-4a88-8da6-130f4f95db17 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:34.252462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e19f094-970f-4a88-8da6-130f4f95db17 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:34.253137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e19f094-970f-4a88-8da6-130f4f95db17 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:34.253621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e19f094-970f-4a88-8da6-130f4f95db17 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:34.254048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e19f094-970f-4a88-8da6-130f4f95db17 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:34.406628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4e19f094-970f-4a88-8da6-130f4f95db17 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f553ef2324ac19370a181cf4c3629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2054001d7ed142698beaf51dcb6bd496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:34.415133 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4e19f094-970f-4a88-8da6-130f4f95db17 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 200 len: 1510 microversion: 2.1 time: 0.175787 Oct 10 23:20:34.415754 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 534/1088] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:34 2022] GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:34.439788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-77ecf900-e4d0-4959-bc7d-b8a0b520e5e6 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Calling method '.version_select at 0x7f662b4821f0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:34.443231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77ecf900-e4d0-4959-bc7d-b8a0b520e5e6 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:34.443806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77ecf900-e4d0-4959-bc7d-b8a0b520e5e6 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:34.444147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77ecf900-e4d0-4959-bc7d-b8a0b520e5e6 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:34.455633 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-77ecf900-e4d0-4959-bc7d-b8a0b520e5e6 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.028638 Oct 10 23:20:34.456249 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 535/1089] 10.222.0.23 () {58 vars in 1143 bytes} [Mon Oct 10 23:20:34 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:34.460887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-89b37aa4-8f87-4574-bee8-3dc384d8f617 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:34.461441 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-89b37aa4-8f87-4574-bee8-3dc384d8f617 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:34.470670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89b37aa4-8f87-4574-bee8-3dc384d8f617 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:34.471068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89b37aa4-8f87-4574-bee8-3dc384d8f617 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:34.471498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89b37aa4-8f87-4574-bee8-3dc384d8f617 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:34.472188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89b37aa4-8f87-4574-bee8-3dc384d8f617 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:34.472633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89b37aa4-8f87-4574-bee8-3dc384d8f617 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:34.473048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89b37aa4-8f87-4574-bee8-3dc384d8f617 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:34.520306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-68c4d4c4-9bc6-4b0b-b36a-954b4c68e5bf tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:34.532280 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-68c4d4c4-9bc6-4b0b-b36a-954b4c68e5bf tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1512 microversion: 2.1 time: 0.488097 Oct 10 23:20:34.533238 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 555/1090] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:34 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1512 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:34.537866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-38774b0f-e327-4c00-9637-bff2e9813f3b tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:34.544925 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-38774b0f-e327-4c00-9637-bff2e9813f3b tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.010419 Oct 10 23:20:34.546111 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 556/1091] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:20:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:34.558105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-95b52049-591a-44f2-847a-4e84b25ffa4e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:34.559029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-95b52049-591a-44f2-847a-4e84b25ffa4e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:34.566966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95b52049-591a-44f2-847a-4e84b25ffa4e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:34.567531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95b52049-591a-44f2-847a-4e84b25ffa4e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:34.568063 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95b52049-591a-44f2-847a-4e84b25ffa4e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:34.568830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95b52049-591a-44f2-847a-4e84b25ffa4e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:34.569534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95b52049-591a-44f2-847a-4e84b25ffa4e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:34.570170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95b52049-591a-44f2-847a-4e84b25ffa4e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:34.621178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-89b37aa4-8f87-4574-bee8-3dc384d8f617 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:34.630542 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-89b37aa4-8f87-4574-bee8-3dc384d8f617 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8" status: 200 len: 1472 microversion: 2.1 time: 0.173082 Oct 10 23:20:34.631324 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 536/1092] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:34 2022] GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8 => generated 1472 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:34.635395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d34dc2f8-e9a3-4038-91f0-a86d63aaaf8e tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-116381320", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:34.658630 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d34dc2f8-e9a3-4038-91f0-a86d63aaaf8e tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.026467 Oct 10 23:20:34.659237 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 537/1093] 10.222.0.23 () {60 vars in 1146 bytes} [Mon Oct 10 23:20:34 2022] POST /compute/v2.1/flavors => generated 498 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:34.671518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b84259ea-d1ca-40c7-8786-b66cc4b8caf5 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:34.678866 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b84259ea-d1ca-40c7-8786-b66cc4b8caf5 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011621 Oct 10 23:20:34.679417 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 538/1094] 10.222.0.23 () {58 vars in 1182 bytes} [Mon Oct 10 23:20:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 23:20:34.753786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-89a3f905-d295-4f24-bdb7-790f5fe762cd tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:34.754297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-89a3f905-d295-4f24-bdb7-790f5fe762cd tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:34.761333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89a3f905-d295-4f24-bdb7-790f5fe762cd tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:34.761882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89a3f905-d295-4f24-bdb7-790f5fe762cd tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:34.762316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89a3f905-d295-4f24-bdb7-790f5fe762cd tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:34.763997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89a3f905-d295-4f24-bdb7-790f5fe762cd tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:34.764464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89a3f905-d295-4f24-bdb7-790f5fe762cd tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:34.764897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89a3f905-d295-4f24-bdb7-790f5fe762cd tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:34.862684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-95b52049-591a-44f2-847a-4e84b25ffa4e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:34.873812 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-95b52049-591a-44f2-847a-4e84b25ffa4e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d" status: 200 len: 1513 microversion: 2.1 time: 0.318322 Oct 10 23:20:34.874489 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 557/1095] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:34 2022] GET /compute/v2.1/servers/9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d => generated 1513 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:34.879983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3901bbd5-d8af-43d3-bd4b-d08f1afd8654 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-325091839", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "f218c400-5b4f-4041-afcd-140d0f0aff91"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:34.949166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-89a3f905-d295-4f24-bdb7-790f5fe762cd tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:34.960488 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-89a3f905-d295-4f24-bdb7-790f5fe762cd tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 200 len: 1316 microversion: 2.1 time: 0.210985 Oct 10 23:20:34.961455 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 539/1096] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:34 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 1316 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:34.966260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bdddb501-d2fd-439b-88d6-610aee3d0189 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:34.967218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bdddb501-d2fd-439b-88d6-610aee3d0189 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 4521fa13-07d6-4f81-9a92-64b6862a3bd3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:34.976371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdddb501-d2fd-439b-88d6-610aee3d0189 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:34.976870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdddb501-d2fd-439b-88d6-610aee3d0189 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:34.977307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdddb501-d2fd-439b-88d6-610aee3d0189 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:34.978122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdddb501-d2fd-439b-88d6-610aee3d0189 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:34.978644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdddb501-d2fd-439b-88d6-610aee3d0189 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:34.979187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdddb501-d2fd-439b-88d6-610aee3d0189 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:35.162140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-3901bbd5-d8af-43d3-bd4b-d08f1afd8654 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] validate_networks() for None {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:20:35.186636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bdddb501-d2fd-439b-88d6-610aee3d0189 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:35.196089 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bdddb501-d2fd-439b-88d6-610aee3d0189 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3" status: 200 len: 1513 microversion: 2.1 time: 0.233570 Oct 10 23:20:35.196899 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 540/1097] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:34 2022] GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3 => generated 1513 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:35.213860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4448e187-dfeb-441c-b4aa-fa6341da6926 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:35.213860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4448e187-dfeb-441c-b4aa-fa6341da6926 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:35.220069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4448e187-dfeb-441c-b4aa-fa6341da6926 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:35.220582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4448e187-dfeb-441c-b4aa-fa6341da6926 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:35.221174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4448e187-dfeb-441c-b4aa-fa6341da6926 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:35.221950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4448e187-dfeb-441c-b4aa-fa6341da6926 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:35.222479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4448e187-dfeb-441c-b4aa-fa6341da6926 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:35.222971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4448e187-dfeb-441c-b4aa-fa6341da6926 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:35.411721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4448e187-dfeb-441c-b4aa-fa6341da6926 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:35.420825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4448e187-dfeb-441c-b4aa-fa6341da6926 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:35.422320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4448e187-dfeb-441c-b4aa-fa6341da6926 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:35.423612 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4448e187-dfeb-441c-b4aa-fa6341da6926 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1567 microversion: 2.25 time: 0.220721 Oct 10 23:20:35.424187 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 541/1098] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:35 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:35.428709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-0ea09927-2ec1-4855-b3ab-44196647ed73 req-cec243f3-9c4d-4591-980b-f57ffa997af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc60f0b-c592-4047-97cf-7c81649085d3", "name": "network-vif-deleted", "tag": "fef8ff70-fee3-4957-aa01-50f6a48fab07"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:35.441435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0ea09927-2ec1-4855-b3ab-44196647ed73 req-cec243f3-9c4d-4591-980b-f57ffa997af9 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:35.441924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0ea09927-2ec1-4855-b3ab-44196647ed73 req-cec243f3-9c4d-4591-980b-f57ffa997af9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:35.442358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0ea09927-2ec1-4855-b3ab-44196647ed73 req-cec243f3-9c4d-4591-980b-f57ffa997af9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:35.455999 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-0ea09927-2ec1-4855-b3ab-44196647ed73 req-cec243f3-9c4d-4591-980b-f57ffa997af9 service nova] Creating event network-vif-deleted:fef8ff70-fee3-4957-aa01-50f6a48fab07 for instance 9dc60f0b-c592-4047-97cf-7c81649085d3 on n-h1-860864-2 Oct 10 23:20:35.461012 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-0ea09927-2ec1-4855-b3ab-44196647ed73 req-cec243f3-9c4d-4591-980b-f57ffa997af9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035636 Oct 10 23:20:35.461829 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 542/1099] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:35.467191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9b6b2102-c8c1-43eb-9a97-0751bd43b0de tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:35.472085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9b6b2102-c8c1-43eb-9a97-0751bd43b0de tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:35.472929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9b6b2102-c8c1-43eb-9a97-0751bd43b0de tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Searching by: {'deleted': False, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00'} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:20:35.478491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b6b2102-c8c1-43eb-9a97-0751bd43b0de tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:35.479018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b6b2102-c8c1-43eb-9a97-0751bd43b0de tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:35.479447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b6b2102-c8c1-43eb-9a97-0751bd43b0de tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:35.480177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b6b2102-c8c1-43eb-9a97-0751bd43b0de tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:35.480916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b6b2102-c8c1-43eb-9a97-0751bd43b0de tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:35.481340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b6b2102-c8c1-43eb-9a97-0751bd43b0de tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:35.580978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.multi_cell_list [None req-9b6b2102-c8c1-43eb-9a97-0751bd43b0de tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120613) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:20:35.603374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3901bbd5-d8af-43d3-bd4b-d08f1afd8654 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:20:35.604552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3901bbd5-d8af-43d3-bd4b-d08f1afd8654 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:20:35.605476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3901bbd5-d8af-43d3-bd4b-d08f1afd8654 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:20:35.606103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3901bbd5-d8af-43d3-bd4b-d08f1afd8654 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:20:35.609336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3901bbd5-d8af-43d3-bd4b-d08f1afd8654 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:20:35.620153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3901bbd5-d8af-43d3-bd4b-d08f1afd8654 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:35.620934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3901bbd5-d8af-43d3-bd4b-d08f1afd8654 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:35.621620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3901bbd5-d8af-43d3-bd4b-d08f1afd8654 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:35.623380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3901bbd5-d8af-43d3-bd4b-d08f1afd8654 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:35.624053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3901bbd5-d8af-43d3-bd4b-d08f1afd8654 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:35.624685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3901bbd5-d8af-43d3-bd4b-d08f1afd8654 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:35.648032 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-3901bbd5-d8af-43d3-bd4b-d08f1afd8654 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Getting quotas for project 8fad4e7ad7ba4e8284360ccf30d71228. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:20:35.650677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9b6b2102-c8c1-43eb-9a97-0751bd43b0de tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:35.657617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-3901bbd5-d8af-43d3-bd4b-d08f1afd8654 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Getting quotas for user cbc0deea66094fac8d5f985e133ceaaa and project 8fad4e7ad7ba4e8284360ccf30d71228. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:20:35.661478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b6b2102-c8c1-43eb-9a97-0751bd43b0de tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:35.661970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b6b2102-c8c1-43eb-9a97-0751bd43b0de tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:35.662440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b6b2102-c8c1-43eb-9a97-0751bd43b0de tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:35.675917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3901bbd5-d8af-43d3-bd4b-d08f1afd8654 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:20:35.678368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3901bbd5-d8af-43d3-bd4b-d08f1afd8654 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:20:35.747535 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3901bbd5-d8af-43d3-bd4b-d08f1afd8654 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.871320 Oct 10 23:20:35.748992 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 558/1100] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:20:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:20:35.754238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ac561de7-cf01-4464-a106-d02a9829b4fc tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:35.755264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ac561de7-cf01-4464-a106-d02a9829b4fc tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:35.766541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac561de7-cf01-4464-a106-d02a9829b4fc tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:35.767377 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac561de7-cf01-4464-a106-d02a9829b4fc tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:35.768114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac561de7-cf01-4464-a106-d02a9829b4fc tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:35.769182 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac561de7-cf01-4464-a106-d02a9829b4fc tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:35.769898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac561de7-cf01-4464-a106-d02a9829b4fc tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:35.770484 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac561de7-cf01-4464-a106-d02a9829b4fc tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:35.835745 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9b6b2102-c8c1-43eb-9a97-0751bd43b0de tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 4521 microversion: 2.1 time: 0.372845 Oct 10 23:20:35.837131 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 543/1101] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:20:35 2022] GET /compute/v2.1/servers/detail => generated 4521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:35.858094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-61673007-845f-4b9b-9a66-efa858c877f6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:35.859127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-61673007-845f-4b9b-9a66-efa858c877f6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:35.866665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:35.869335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61673007-845f-4b9b-9a66-efa858c877f6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:35.870300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61673007-845f-4b9b-9a66-efa858c877f6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:35.870925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61673007-845f-4b9b-9a66-efa858c877f6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:35.871818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61673007-845f-4b9b-9a66-efa858c877f6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:35.872647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61673007-845f-4b9b-9a66-efa858c877f6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:35.873237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61673007-845f-4b9b-9a66-efa858c877f6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:35.942793 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ac561de7-cf01-4464-a106-d02a9829b4fc tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f553ef2324ac19370a181cf4c3629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2054001d7ed142698beaf51dcb6bd496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:35.952007 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ac561de7-cf01-4464-a106-d02a9829b4fc tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 200 len: 1468 microversion: 2.1 time: 0.201690 Oct 10 23:20:35.955854 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 559/1102] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:35 2022] GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 1468 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:35.962584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b0423c10-84cb-4197-912d-3ceb48d421f6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:35.963507 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b0423c10-84cb-4197-912d-3ceb48d421f6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:36.056825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b0423c10-84cb-4197-912d-3ceb48d421f6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:36.071934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-61673007-845f-4b9b-9a66-efa858c877f6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:36.073071 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b0423c10-84cb-4197-912d-3ceb48d421f6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1278 microversion: 2.1 time: 0.114269 Oct 10 23:20:36.074275 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 560/1103] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:35 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1278 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:36.080721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-835df089-4a4b-420e-a3a5-39650eef236f tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:36.080886 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-61673007-845f-4b9b-9a66-efa858c877f6 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8" status: 200 len: 1472 microversion: 2.1 time: 0.242391 Oct 10 23:20:36.089595 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 544/1104] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:35 2022] GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8 => generated 1472 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:36.089595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-42396093-69e5-4965-9026-374fd6e9a177 req-26146164-bcbd-4f79-a157-e64c5d9f36b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dea3f22-ee85-4a3f-a4cd-a0634c6e451b", "name": "network-vif-plugged", "status": "completed", "tag": "f65ed136-fdf8-4735-a0b9-6e6d462b75e1"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:36.100224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-835df089-4a4b-420e-a3a5-39650eef236f tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:36.101032 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-835df089-4a4b-420e-a3a5-39650eef236f tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:20:36.102054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-42396093-69e5-4965-9026-374fd6e9a177 req-26146164-bcbd-4f79-a157-e64c5d9f36b0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:36.102911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-42396093-69e5-4965-9026-374fd6e9a177 req-26146164-bcbd-4f79-a157-e64c5d9f36b0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:36.103455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-42396093-69e5-4965-9026-374fd6e9a177 req-26146164-bcbd-4f79-a157-e64c5d9f36b0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:36.116924 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-42396093-69e5-4965-9026-374fd6e9a177 req-26146164-bcbd-4f79-a157-e64c5d9f36b0 service nova] Creating event network-vif-plugged:f65ed136-fdf8-4735-a0b9-6e6d462b75e1 for instance 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b on n-h2-860864-2 Oct 10 23:20:36.122030 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-42396093-69e5-4965-9026-374fd6e9a177 req-26146164-bcbd-4f79-a157-e64c5d9f36b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038759 Oct 10 23:20:36.123713 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 545/1105] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:36.129221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9ac0eeff-cffe-4e3c-8baa-ba283569234e tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:36.130427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9ac0eeff-cffe-4e3c-8baa-ba283569234e tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:36.137908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ac0eeff-cffe-4e3c-8baa-ba283569234e tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:36.139054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ac0eeff-cffe-4e3c-8baa-ba283569234e tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:36.139812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ac0eeff-cffe-4e3c-8baa-ba283569234e tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:36.140784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ac0eeff-cffe-4e3c-8baa-ba283569234e tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:36.141617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ac0eeff-cffe-4e3c-8baa-ba283569234e tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:36.142187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ac0eeff-cffe-4e3c-8baa-ba283569234e tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:36.302374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-835df089-4a4b-420e-a3a5-39650eef236f tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:36.302869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-835df089-4a4b-420e-a3a5-39650eef236f tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:36.303320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-835df089-4a4b-420e-a3a5-39650eef236f tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:36.304894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-835df089-4a4b-420e-a3a5-39650eef236f tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:36.305368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-835df089-4a4b-420e-a3a5-39650eef236f tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:36.305828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-835df089-4a4b-420e-a3a5-39650eef236f tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:36.380901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.multi_cell_list [None req-835df089-4a4b-420e-a3a5-39650eef236f tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:20:36.406912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9ac0eeff-cffe-4e3c-8baa-ba283569234e tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:36.421118 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9ac0eeff-cffe-4e3c-8baa-ba283569234e tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 200 len: 1316 microversion: 2.1 time: 0.295805 Oct 10 23:20:36.423453 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 546/1106] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:36 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:36.452238 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-835df089-4a4b-420e-a3a5-39650eef236f tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.376519 Oct 10 23:20:36.453220 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 561/1107] 10.222.0.23 () {58 vars in 1150 bytes} [Mon Oct 10 23:20:36 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:36.475256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6d5abd73-fbed-47bd-8ee0-e33ac9235d6a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:36.476046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6d5abd73-fbed-47bd-8ee0-e33ac9235d6a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:36.477835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-73322f76-6e43-4eee-b742-b001ef09a8fc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:36.502565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d5abd73-fbed-47bd-8ee0-e33ac9235d6a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:36.503098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d5abd73-fbed-47bd-8ee0-e33ac9235d6a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:36.503538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d5abd73-fbed-47bd-8ee0-e33ac9235d6a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:36.505709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-73322f76-6e43-4eee-b742-b001ef09a8fc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:36.506519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-73322f76-6e43-4eee-b742-b001ef09a8fc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:20:36.508370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d5abd73-fbed-47bd-8ee0-e33ac9235d6a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:36.509606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d5abd73-fbed-47bd-8ee0-e33ac9235d6a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:36.510230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d5abd73-fbed-47bd-8ee0-e33ac9235d6a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:36.524967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73322f76-6e43-4eee-b742-b001ef09a8fc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:36.526560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73322f76-6e43-4eee-b742-b001ef09a8fc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:36.537687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73322f76-6e43-4eee-b742-b001ef09a8fc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:36.542071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73322f76-6e43-4eee-b742-b001ef09a8fc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:36.542650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73322f76-6e43-4eee-b742-b001ef09a8fc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:36.543101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73322f76-6e43-4eee-b742-b001ef09a8fc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:36.687584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.multi_cell_list [None req-73322f76-6e43-4eee-b742-b001ef09a8fc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:20:36.693656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:36.768137 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-73322f76-6e43-4eee-b742-b001ef09a8fc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.298458 Oct 10 23:20:36.776311 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 562/1108] 10.222.0.23 () {58 vars in 1212 bytes} [Mon Oct 10 23:20:36 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:36.782203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-83d9f333-a6ec-4b67-82db-77108e600f95 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:36.787735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-83d9f333-a6ec-4b67-82db-77108e600f95 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:36.788772 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-83d9f333-a6ec-4b67-82db-77108e600f95 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:20:36.794566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83d9f333-a6ec-4b67-82db-77108e600f95 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:36.795305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83d9f333-a6ec-4b67-82db-77108e600f95 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:36.795966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83d9f333-a6ec-4b67-82db-77108e600f95 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:36.797014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83d9f333-a6ec-4b67-82db-77108e600f95 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:36.797681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83d9f333-a6ec-4b67-82db-77108e600f95 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:36.798281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83d9f333-a6ec-4b67-82db-77108e600f95 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:36.926792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.multi_cell_list [None req-83d9f333-a6ec-4b67-82db-77108e600f95 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:20:36.980835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6d5abd73-fbed-47bd-8ee0-e33ac9235d6a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:36.992882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6d5abd73-fbed-47bd-8ee0-e33ac9235d6a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:36.996576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6d5abd73-fbed-47bd-8ee0-e33ac9235d6a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:37.003110 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6d5abd73-fbed-47bd-8ee0-e33ac9235d6a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1567 microversion: 2.25 time: 0.555230 Oct 10 23:20:37.003835 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 547/1109] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:36 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1567 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:20:37.009149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9d0c4977-96e8-40c9-9192-8f6dc7d7d7d7 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:37.010878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9d0c4977-96e8-40c9-9192-8f6dc7d7d7d7 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:37.017979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d0c4977-96e8-40c9-9192-8f6dc7d7d7d7 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:37.018744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d0c4977-96e8-40c9-9192-8f6dc7d7d7d7 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:37.019410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d0c4977-96e8-40c9-9192-8f6dc7d7d7d7 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:37.020370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d0c4977-96e8-40c9-9192-8f6dc7d7d7d7 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:37.024258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d0c4977-96e8-40c9-9192-8f6dc7d7d7d7 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:37.026322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d0c4977-96e8-40c9-9192-8f6dc7d7d7d7 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:37.026444 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-83d9f333-a6ec-4b67-82db-77108e600f95 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.248578 Oct 10 23:20:37.033833 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 563/1110] 10.222.0.23 () {58 vars in 1196 bytes} [Mon Oct 10 23:20:36 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:37.042734 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-595f87de-9502-4e25-8fd9-cad43b7d89ea tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:37.050395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-595f87de-9502-4e25-8fd9-cad43b7d89ea tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:37.051315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-595f87de-9502-4e25-8fd9-cad43b7d89ea tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Searching by: {'name': '1834350388', 'deleted': False, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:20:37.058280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-595f87de-9502-4e25-8fd9-cad43b7d89ea tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:37.058989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-595f87de-9502-4e25-8fd9-cad43b7d89ea tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:37.060370 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-595f87de-9502-4e25-8fd9-cad43b7d89ea tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:37.061689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-595f87de-9502-4e25-8fd9-cad43b7d89ea tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:37.062910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-595f87de-9502-4e25-8fd9-cad43b7d89ea tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:37.063534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-595f87de-9502-4e25-8fd9-cad43b7d89ea tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:37.103858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d0c4977-96e8-40c9-9192-8f6dc7d7d7d7 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:37.105258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d0c4977-96e8-40c9-9192-8f6dc7d7d7d7 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:37.106431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d0c4977-96e8-40c9-9192-8f6dc7d7d7d7 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:37.109691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-9d0c4977-96e8-40c9-9192-8f6dc7d7d7d7 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lazy-loading 'fault' on Instance uuid 9dc60f0b-c592-4047-97cf-7c81649085d3 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:20:37.178396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.multi_cell_list [None req-595f87de-9502-4e25-8fd9-cad43b7d89ea tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:20:37.212564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9d0c4977-96e8-40c9-9192-8f6dc7d7d7d7 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '504f553ef2324ac19370a181cf4c3629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2054001d7ed142698beaf51dcb6bd496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:37.225166 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9d0c4977-96e8-40c9-9192-8f6dc7d7d7d7 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 200 len: 1306 microversion: 2.1 time: 0.219525 Oct 10 23:20:37.228091 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 548/1111] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:37 2022] GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 1306 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:37.235507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-27696b6c-03d4-4d5f-b037-83355136c166 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:37.237987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-27696b6c-03d4-4d5f-b037-83355136c166 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:37.252475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27696b6c-03d4-4d5f-b037-83355136c166 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:37.255952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27696b6c-03d4-4d5f-b037-83355136c166 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:37.256601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27696b6c-03d4-4d5f-b037-83355136c166 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:37.258840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27696b6c-03d4-4d5f-b037-83355136c166 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:37.259460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27696b6c-03d4-4d5f-b037-83355136c166 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:37.261465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27696b6c-03d4-4d5f-b037-83355136c166 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:37.315176 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-595f87de-9502-4e25-8fd9-cad43b7d89ea tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers?name=1834350388" status: 200 len: 346 microversion: 2.1 time: 0.272524 Oct 10 23:20:37.325058 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 564/1112] 10.222.0.23 () {58 vars in 1156 bytes} [Mon Oct 10 23:20:37 2022] GET /compute/v2.1/servers?name=1834350388 => generated 346 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:37.349609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e6d00ebe-291d-49ff-9739-d20c0bebd147 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:37.350856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e6d00ebe-291d-49ff-9739-d20c0bebd147 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:37.366806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6d00ebe-291d-49ff-9739-d20c0bebd147 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:37.369476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6d00ebe-291d-49ff-9739-d20c0bebd147 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:37.370067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6d00ebe-291d-49ff-9739-d20c0bebd147 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:37.370894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6d00ebe-291d-49ff-9739-d20c0bebd147 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:37.374704 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6d00ebe-291d-49ff-9739-d20c0bebd147 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:37.376024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6d00ebe-291d-49ff-9739-d20c0bebd147 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:37.380270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-27696b6c-03d4-4d5f-b037-83355136c166 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:37.392704 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-27696b6c-03d4-4d5f-b037-83355136c166 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1330 microversion: 2.1 time: 0.160392 Oct 10 23:20:37.394701 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 549/1113] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:37 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1330 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:37.399583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ecac742c-8598-411e-847e-73c93c732b8c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:37.413896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ecac742c-8598-411e-847e-73c93c732b8c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:37.429711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ecac742c-8598-411e-847e-73c93c732b8c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00'} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:20:37.457322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecac742c-8598-411e-847e-73c93c732b8c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:37.462092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecac742c-8598-411e-847e-73c93c732b8c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:37.462892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecac742c-8598-411e-847e-73c93c732b8c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:37.464510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecac742c-8598-411e-847e-73c93c732b8c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:37.465894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecac742c-8598-411e-847e-73c93c732b8c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:37.483355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecac742c-8598-411e-847e-73c93c732b8c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:37.673060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e6d00ebe-291d-49ff-9739-d20c0bebd147 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:37.687771 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e6d00ebe-291d-49ff-9739-d20c0bebd147 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8" status: 200 len: 1430 microversion: 2.1 time: 0.356546 Oct 10 23:20:37.713200 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 565/1114] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:37 2022] GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8 => generated 1430 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:37.724520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eddf758c-7206-46f9-9ca6-4fc35b2194fe tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:37.728945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eddf758c-7206-46f9-9ca6-4fc35b2194fe tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:37.742597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eddf758c-7206-46f9-9ca6-4fc35b2194fe tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:37.743262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eddf758c-7206-46f9-9ca6-4fc35b2194fe tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:37.743835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eddf758c-7206-46f9-9ca6-4fc35b2194fe tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:37.749629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eddf758c-7206-46f9-9ca6-4fc35b2194fe tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:37.762423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eddf758c-7206-46f9-9ca6-4fc35b2194fe tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:37.764327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eddf758c-7206-46f9-9ca6-4fc35b2194fe tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:38.150875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:38.158566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.multi_cell_list [None req-ecac742c-8598-411e-847e-73c93c732b8c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120613) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:20:38.271057 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ecac742c-8598-411e-847e-73c93c732b8c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.874920 Oct 10 23:20:38.281520 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 550/1115] 10.222.0.23 () {58 vars in 1154 bytes} [Mon Oct 10 23:20:37 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:38.289079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-d893bf0b-a5fd-4ceb-a6eb-5413e4b87309 req-7d26801f-baa5-457e-abda-6c4de2ed1fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d61c758-b733-4d1e-8dbb-99cda309c9c8", "name": "network-vif-deleted", "tag": "62320ef9-2ee0-496d-ba83-d8d6fb707554"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:38.313673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d893bf0b-a5fd-4ceb-a6eb-5413e4b87309 req-7d26801f-baa5-457e-abda-6c4de2ed1fc1 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:38.315131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d893bf0b-a5fd-4ceb-a6eb-5413e4b87309 req-7d26801f-baa5-457e-abda-6c4de2ed1fc1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:38.315965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d893bf0b-a5fd-4ceb-a6eb-5413e4b87309 req-7d26801f-baa5-457e-abda-6c4de2ed1fc1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:38.335173 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-d893bf0b-a5fd-4ceb-a6eb-5413e4b87309 req-7d26801f-baa5-457e-abda-6c4de2ed1fc1 service nova] Creating event network-vif-deleted:62320ef9-2ee0-496d-ba83-d8d6fb707554 for instance 5d61c758-b733-4d1e-8dbb-99cda309c9c8 on n-h1-860864-2 Oct 10 23:20:38.345719 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-d893bf0b-a5fd-4ceb-a6eb-5413e4b87309 req-7d26801f-baa5-457e-abda-6c4de2ed1fc1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062243 Oct 10 23:20:38.346600 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 551/1116] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:38.352960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-088b74b8-92a0-46c9-bfc1-9c4f512ce56d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:38.354293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-088b74b8-92a0-46c9-bfc1-9c4f512ce56d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:38.363102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-088b74b8-92a0-46c9-bfc1-9c4f512ce56d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:38.363896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-088b74b8-92a0-46c9-bfc1-9c4f512ce56d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:38.364891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-088b74b8-92a0-46c9-bfc1-9c4f512ce56d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:38.365885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-088b74b8-92a0-46c9-bfc1-9c4f512ce56d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:38.366571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-088b74b8-92a0-46c9-bfc1-9c4f512ce56d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:38.367940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-088b74b8-92a0-46c9-bfc1-9c4f512ce56d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:38.687853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-088b74b8-92a0-46c9-bfc1-9c4f512ce56d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:38.702184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-088b74b8-92a0-46c9-bfc1-9c4f512ce56d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:38.704195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-088b74b8-92a0-46c9-bfc1-9c4f512ce56d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:38.704839 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-088b74b8-92a0-46c9-bfc1-9c4f512ce56d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1567 microversion: 2.25 time: 0.356993 Oct 10 23:20:38.706386 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 552/1117] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:38 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1567 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:38.711210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c2fb7071-a4fd-4ce0-bd26-d6a2e6720b4c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:38.712029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c2fb7071-a4fd-4ce0-bd26-d6a2e6720b4c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:38.720515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2fb7071-a4fd-4ce0-bd26-d6a2e6720b4c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:38.721222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2fb7071-a4fd-4ce0-bd26-d6a2e6720b4c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:38.721901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2fb7071-a4fd-4ce0-bd26-d6a2e6720b4c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:38.722856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2fb7071-a4fd-4ce0-bd26-d6a2e6720b4c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:38.723547 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2fb7071-a4fd-4ce0-bd26-d6a2e6720b4c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:38.725018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2fb7071-a4fd-4ce0-bd26-d6a2e6720b4c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:38.741739 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-c2fb7071-a4fd-4ce0-bd26-d6a2e6720b4c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] HTTP exception thrown: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. Oct 10 23:20:38.743652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c2fb7071-a4fd-4ce0-bd26-d6a2e6720b4c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Request method failure captured: Oct 10 23:20:38.743652 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 HTTP/1.1 Oct 10 23:20:38.743652 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:20:38.743652 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:20:38.743652 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:20:38.743652 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:20:38.743652 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:20:38.743652 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:20:38.743652 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:20:38.743652 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:38.743652 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKipnZhnIgvV9PWGRz4lmxzE1f4_1N3i60b9BWpm059BAcmJFaljQTaRWvk3ANuE6oxYDw1XGHvmoTuJ2whHMfATcbdM9iH6B5SDI3X8sDMMbCtp6IEVs80bYICnuWO-KtZ-SVclvjeBmi-nUyDfvzjkpPBnRxqG_w1DsERvGyDeSd0 Oct 10 23:20:38.743652 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:20:38.743652 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:20:38.743652 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:20:38.743652 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:20:38.743652 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:20:38.743652 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:20:38.743652 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 2054001d7ed142698beaf51dcb6bd496 Oct 10 23:20:38.743652 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesNegativeTestJSON-427333629 Oct 10 23:20:38.743652 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:20:38.743652 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:20:38.745120 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2054001d7ed142698beaf51dcb6bd496"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2054001d7ed142698beaf51dcb6bd496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2054001d7ed142698beaf51dcb6bd496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2054001d7ed142698beaf51dcb6bd496", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:38.745120 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesNegativeTestJSON-427333629 Oct 10 23:20:38.745120 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 2054001d7ed142698beaf51dcb6bd496 Oct 10 23:20:38.745120 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-427333629 Oct 10 23:20:38.745120 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesNegativeTestJSON-427333629-project Oct 10 23:20:38.745120 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:20:38.745120 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:20:38.745120 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 504f553ef2324ac19370a181cf4c3629 Oct 10 23:20:38.745120 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesNegativeTestJSON-427333629-project Oct 10 23:20:38.745120 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:20:38.745120 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. Oct 10 23:20:38.745120 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '9dc60f0b-c592-4047-97cf-7c81649085d3'} Oct 10 23:20:38.745917 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:38.745917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:38.745917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:38.745917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:38.745917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:20:38.745917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:20:38.745917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:20:38.745917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:20:38.745917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:20:38.745917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:20:38.745917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. Oct 10 23:20:38.745917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:38.745917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:38.745917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:38.745917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:38.745917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:38.745917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:38.745917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:38.745917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:38.745917 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:38.747120 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:38.747120 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:20:38.747120 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:20:38.747120 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:38.747120 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:38.747120 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:38.747120 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:38.747120 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. Oct 10 23:20:38.747120 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:38.747120 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:38.747120 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:38.747120 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:38.747120 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:38.747120 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:38.747120 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:38.747120 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:38.747120 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. Oct 10 23:20:38.747120 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:38.748872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c2fb7071-a4fd-4ce0-bd26-d6a2e6720b4c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Returning 404 to user: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:38.748872 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c2fb7071-a4fd-4ce0-bd26-d6a2e6720b4c tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 404 len: 111 microversion: 2.1 time: 0.037730 Oct 10 23:20:38.750470 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 553/1118] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:38 2022] GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:38.756475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ef923621-d814-4699-8e1c-6666d2583049 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:38.762631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ef923621-d814-4699-8e1c-6666d2583049 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:38.764041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ef923621-d814-4699-8e1c-6666d2583049 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-183435038', 'deleted': False, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00'} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:20:38.766769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-eddf758c-7206-46f9-9ca6-4fc35b2194fe tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:38.769361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef923621-d814-4699-8e1c-6666d2583049 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:38.769880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef923621-d814-4699-8e1c-6666d2583049 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:38.770552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef923621-d814-4699-8e1c-6666d2583049 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:38.771296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef923621-d814-4699-8e1c-6666d2583049 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:38.771904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef923621-d814-4699-8e1c-6666d2583049 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:38.772344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef923621-d814-4699-8e1c-6666d2583049 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:38.778004 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eddf758c-7206-46f9-9ca6-4fc35b2194fe tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 200 len: 1316 microversion: 2.1 time: 1.064202 Oct 10 23:20:38.794956 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 566/1119] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:37 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 1316 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:38.800163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bb36095a-420f-4793-b7ed-1ec87a786171 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:38.800992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bb36095a-420f-4793-b7ed-1ec87a786171 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:38.806961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb36095a-420f-4793-b7ed-1ec87a786171 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:38.807647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb36095a-420f-4793-b7ed-1ec87a786171 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:38.808706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb36095a-420f-4793-b7ed-1ec87a786171 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:38.809798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb36095a-420f-4793-b7ed-1ec87a786171 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:38.810782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb36095a-420f-4793-b7ed-1ec87a786171 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:38.811400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb36095a-420f-4793-b7ed-1ec87a786171 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:38.886244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.multi_cell_list [None req-ef923621-d814-4699-8e1c-6666d2583049 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120613) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:20:38.931077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb36095a-420f-4793-b7ed-1ec87a786171 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:38.944023 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bb36095a-420f-4793-b7ed-1ec87a786171 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1336 microversion: 2.1 time: 0.145128 Oct 10 23:20:38.944712 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 567/1120] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:38 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1336 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:38.958559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4fe58bc4-fa4f-4060-acb8-cdd0830e445a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:38.959193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4fe58bc4-fa4f-4060-acb8-cdd0830e445a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:38.970025 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ef923621-d814-4699-8e1c-6666d2583049 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-183435038" status: 200 len: 346 microversion: 2.1 time: 0.217992 Oct 10 23:20:38.977895 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 554/1121] 10.222.0.23 () {58 vars in 1228 bytes} [Mon Oct 10 23:20:38 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-183435038 => generated 346 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:38.977895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-59ed53a3-5b9a-4c1b-9c93-9fa7ec6c5eda tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1169266005", "metadata": {"image_type": "test"}}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:38.979058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-59ed53a3-5b9a-4c1b-9c93-9fa7ec6c5eda tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:38.985354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fe58bc4-fa4f-4060-acb8-cdd0830e445a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:38.985845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fe58bc4-fa4f-4060-acb8-cdd0830e445a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:38.986297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fe58bc4-fa4f-4060-acb8-cdd0830e445a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:38.987034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fe58bc4-fa4f-4060-acb8-cdd0830e445a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:38.988530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59ed53a3-5b9a-4c1b-9c93-9fa7ec6c5eda tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:38.989136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59ed53a3-5b9a-4c1b-9c93-9fa7ec6c5eda tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:38.989726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59ed53a3-5b9a-4c1b-9c93-9fa7ec6c5eda tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:38.990531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59ed53a3-5b9a-4c1b-9c93-9fa7ec6c5eda tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:38.991218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59ed53a3-5b9a-4c1b-9c93-9fa7ec6c5eda tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:38.991750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59ed53a3-5b9a-4c1b-9c93-9fa7ec6c5eda tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:38.993804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fe58bc4-fa4f-4060-acb8-cdd0830e445a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:38.996264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fe58bc4-fa4f-4060-acb8-cdd0830e445a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:39.007451 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-59ed53a3-5b9a-4c1b-9c93-9fa7ec6c5eda tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] HTTP exception thrown: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. Oct 10 23:20:39.009246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-59ed53a3-5b9a-4c1b-9c93-9fa7ec6c5eda tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Request method failure captured: Oct 10 23:20:39.009246 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3/action HTTP/1.1 Oct 10 23:20:39.009246 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:20:39.009246 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:20:39.009246 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:20:39.009246 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 112 Oct 10 23:20:39.009246 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:20:39.009246 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:20:39.009246 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:20:39.009246 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:39.009246 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKipnZhnIgvV9PWGRz4lmxzE1f4_1N3i60b9BWpm059BAcmJFaljQTaRWvk3ANuE6oxYDw1XGHvmoTuJ2whHMfATcbdM9iH6B5SDI3X8sDMMbCtp6IEVs80bYICnuWO-KtZ-SVclvjeBmi-nUyDfvzjkpPBnRxqG_w1DsERvGyDeSd0 Oct 10 23:20:39.009246 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:20:39.009246 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:20:39.009246 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:20:39.009246 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:20:39.009246 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:20:39.009246 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:20:39.009246 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 2054001d7ed142698beaf51dcb6bd496 Oct 10 23:20:39.009246 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesNegativeTestJSON-427333629 Oct 10 23:20:39.009246 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:20:39.009246 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:20:39.010892 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2054001d7ed142698beaf51dcb6bd496"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2054001d7ed142698beaf51dcb6bd496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2054001d7ed142698beaf51dcb6bd496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2054001d7ed142698beaf51dcb6bd496", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:39.010892 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesNegativeTestJSON-427333629 Oct 10 23:20:39.010892 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 2054001d7ed142698beaf51dcb6bd496 Oct 10 23:20:39.010892 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-427333629 Oct 10 23:20:39.010892 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesNegativeTestJSON-427333629-project Oct 10 23:20:39.010892 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:20:39.010892 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:20:39.010892 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 504f553ef2324ac19370a181cf4c3629 Oct 10 23:20:39.010892 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesNegativeTestJSON-427333629-project Oct 10 23:20:39.010892 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:20:39.010892 n-d-860864-2 devstack@n-api.service[120613]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1169266005", "metadata": {"image_type": "test"}}} Oct 10 23:20:39.010892 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:20:39.011821 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. Oct 10 23:20:39.011821 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '9dc60f0b-c592-4047-97cf-7c81649085d3', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1169266005', 'metadata': {'image_type': 'test'}}}} Oct 10 23:20:39.011821 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:39.011821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:39.011821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:39.011821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:39.011821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:20:39.011821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:20:39.011821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:20:39.011821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:20:39.011821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:20:39.011821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:20:39.011821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. Oct 10 23:20:39.011821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.011821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:39.011821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.011821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:39.011821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:39.011821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:39.013430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:39.013430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:39.013430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:39.013430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:39.013430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:20:39.013430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:20:39.013430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:20:39.013430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:20:39.013430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 10 23:20:39.013430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 10 23:20:39.013430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:39.013430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:39.013430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:39.013430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:39.013430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. Oct 10 23:20:39.013430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.013430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:39.013430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.013430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:39.013430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:39.014712 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:39.014712 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:39.014712 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:39.014712 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. Oct 10 23:20:39.014712 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.017511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-59ed53a3-5b9a-4c1b-9c93-9fa7ec6c5eda tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Returning 404 to user: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:39.018623 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-59ed53a3-5b9a-4c1b-9c93-9fa7ec6c5eda tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "POST /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3/action" status: 404 len: 111 microversion: 2.1 time: 0.046423 Oct 10 23:20:39.019697 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 555/1122] 10.222.0.23 () {60 vars in 1279 bytes} [Mon Oct 10 23:20:38 2022] POST /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:39.024740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d38f8268-84f3-48f3-9e07-350c31318899 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:39.025509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d38f8268-84f3-48f3-9e07-350c31318899 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 4521fa13-07d6-4f81-9a92-64b6862a3bd3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:39.035664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d38f8268-84f3-48f3-9e07-350c31318899 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:39.036531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d38f8268-84f3-48f3-9e07-350c31318899 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:39.037234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d38f8268-84f3-48f3-9e07-350c31318899 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:39.038252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d38f8268-84f3-48f3-9e07-350c31318899 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:39.039092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d38f8268-84f3-48f3-9e07-350c31318899 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:39.040422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d38f8268-84f3-48f3-9e07-350c31318899 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:39.072938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d38f8268-84f3-48f3-9e07-350c31318899 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 4521fa13-07d6-4f81-9a92-64b6862a3bd3] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:20:39.089229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fe58bc4-fa4f-4060-acb8-cdd0830e445a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:39.090041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fe58bc4-fa4f-4060-acb8-cdd0830e445a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:39.091467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fe58bc4-fa4f-4060-acb8-cdd0830e445a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:39.092323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-4fe58bc4-fa4f-4060-acb8-cdd0830e445a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lazy-loading 'fault' on Instance uuid 5d61c758-b733-4d1e-8dbb-99cda309c9c8 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:20:39.193100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4fe58bc4-fa4f-4060-acb8-cdd0830e445a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:39.223998 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4fe58bc4-fa4f-4060-acb8-cdd0830e445a tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8" status: 200 len: 1306 microversion: 2.1 time: 0.277511 Oct 10 23:20:39.225971 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 568/1123] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:38 2022] GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8 => generated 1306 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:39.229944 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d38f8268-84f3-48f3-9e07-350c31318899 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3" status: 204 len: 0 microversion: 2.1 time: 0.208480 Oct 10 23:20:39.232730 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 556/1124] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:20:39 2022] DELETE /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:20:39.237640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-71a303ab-55fc-4c26-a067-e255541fa79f tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-987973325", "metadata": {"image_type": "test"}}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:39.241158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-71a303ab-55fc-4c26-a067-e255541fa79f tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Failed to fetch instance by id tempest-invalid-2002458659 {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 10 23:20:39.242119 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-71a303ab-55fc-4c26-a067-e255541fa79f tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] HTTP exception thrown: Instance tempest-invalid-2002458659 could not be found. Oct 10 23:20:39.243796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5b1e042b-e520-4679-8608-35b583e28cb0 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:39.244414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-71a303ab-55fc-4c26-a067-e255541fa79f tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Request method failure captured: Oct 10 23:20:39.244414 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/tempest-invalid-2002458659/action HTTP/1.1 Oct 10 23:20:39.244414 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:20:39.244414 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:20:39.244414 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:20:39.244414 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 111 Oct 10 23:20:39.244414 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:20:39.244414 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:20:39.244414 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:20:39.244414 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:39.244414 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKipnZhnIgvV9PWGRz4lmxzE1f4_1N3i60b9BWpm059BAcmJFaljQTaRWvk3ANuE6oxYDw1XGHvmoTuJ2whHMfATcbdM9iH6B5SDI3X8sDMMbCtp6IEVs80bYICnuWO-KtZ-SVclvjeBmi-nUyDfvzjkpPBnRxqG_w1DsERvGyDeSd0 Oct 10 23:20:39.244414 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:20:39.244414 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:20:39.244414 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:20:39.244414 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:20:39.244414 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:20:39.244414 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:20:39.244414 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 2054001d7ed142698beaf51dcb6bd496 Oct 10 23:20:39.244414 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ImagesNegativeTestJSON-427333629 Oct 10 23:20:39.244414 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:20:39.244414 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:20:39.245783 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2054001d7ed142698beaf51dcb6bd496"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2054001d7ed142698beaf51dcb6bd496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2054001d7ed142698beaf51dcb6bd496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2054001d7ed142698beaf51dcb6bd496", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:39.245783 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ImagesNegativeTestJSON-427333629 Oct 10 23:20:39.245783 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 2054001d7ed142698beaf51dcb6bd496 Oct 10 23:20:39.245783 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-427333629 Oct 10 23:20:39.245783 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ImagesNegativeTestJSON-427333629-project Oct 10 23:20:39.245783 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:20:39.245783 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:20:39.245783 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 504f553ef2324ac19370a181cf4c3629 Oct 10 23:20:39.245783 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ImagesNegativeTestJSON-427333629-project Oct 10 23:20:39.245783 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:20:39.245783 n-d-860864-2 devstack@n-api.service[120614]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-987973325", "metadata": {"image_type": "test"}}} Oct 10 23:20:39.245783 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:20:39.245783 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance tempest-invalid-2002458659 could not be found. Oct 10 23:20:39.246626 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'tempest-invalid-2002458659', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-987973325', 'metadata': {'image_type': 'test'}}}} Oct 10 23:20:39.246626 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:39.246626 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:39.246626 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:39.246626 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:39.246626 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 10 23:20:39.246626 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 10 23:20:39.246626 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-2002458659 could not be found. Oct 10 23:20:39.246626 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.246626 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:39.246626 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.246626 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:39.246626 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:39.246626 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:39.246626 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:39.246626 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:39.246626 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:39.246626 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:39.246626 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:20:39.246626 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:20:39.248709 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:20:39.248709 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:20:39.248709 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 10 23:20:39.248709 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 10 23:20:39.248709 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:39.248709 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:39.248709 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:39.248709 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:39.248709 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-2002458659 could not be found. Oct 10 23:20:39.248709 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.248709 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:39.248709 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.248709 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:39.248709 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:39.248709 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:39.248709 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:39.248709 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:39.248709 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-2002458659 could not be found. Oct 10 23:20:39.248709 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.249927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5b1e042b-e520-4679-8608-35b583e28cb0 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 4521fa13-07d6-4f81-9a92-64b6862a3bd3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:39.252278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-71a303ab-55fc-4c26-a067-e255541fa79f tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Returning 404 to user: Instance tempest-invalid-2002458659 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:39.253879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b1e042b-e520-4679-8608-35b583e28cb0 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:39.254388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b1e042b-e520-4679-8608-35b583e28cb0 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:39.254626 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-71a303ab-55fc-4c26-a067-e255541fa79f tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "POST /compute/v2.1/servers/tempest-invalid-2002458659/action" status: 404 len: 101 microversion: 2.1 time: 0.026412 Oct 10 23:20:39.254854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b1e042b-e520-4679-8608-35b583e28cb0 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:39.255581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b1e042b-e520-4679-8608-35b583e28cb0 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:39.256096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b1e042b-e520-4679-8608-35b583e28cb0 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:39.256322 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 569/1125] 10.222.0.23 () {60 vars in 1249 bytes} [Mon Oct 10 23:20:39 2022] POST /compute/v2.1/servers/tempest-invalid-2002458659/action => generated 101 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:39.256962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b1e042b-e520-4679-8608-35b583e28cb0 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:39.273636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5d507e26-48e3-47a4-8e13-d02a816251ba tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1293028540"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:39.281071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5d507e26-48e3-47a4-8e13-d02a816251ba tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 10 23:20:39.281642 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-5d507e26-48e3-47a4-8e13-d02a816251ba tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 23:20:39.286670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5d507e26-48e3-47a4-8e13-d02a816251ba tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Request method failure captured: Oct 10 23:20:39.286670 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 10 23:20:39.286670 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:20:39.286670 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:20:39.286670 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:20:39.286670 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 57 Oct 10 23:20:39.286670 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:20:39.286670 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:20:39.286670 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:20:39.286670 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:39.286670 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKipnZhnIgvV9PWGRz4lmxzE1f4_1N3i60b9BWpm059BAcmJFaljQTaRWvk3ANuE6oxYDw1XGHvmoTuJ2whHMfATcbdM9iH6B5SDI3X8sDMMbCtp6IEVs80bYICnuWO-KtZ-SVclvjeBmi-nUyDfvzjkpPBnRxqG_w1DsERvGyDeSd0 Oct 10 23:20:39.286670 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:20:39.286670 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:20:39.286670 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:20:39.286670 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:20:39.286670 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:20:39.286670 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:20:39.286670 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 2054001d7ed142698beaf51dcb6bd496 Oct 10 23:20:39.286670 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ImagesNegativeTestJSON-427333629 Oct 10 23:20:39.286670 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:20:39.286670 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:20:39.288055 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2054001d7ed142698beaf51dcb6bd496"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2054001d7ed142698beaf51dcb6bd496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2054001d7ed142698beaf51dcb6bd496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2054001d7ed142698beaf51dcb6bd496", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:39.288055 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ImagesNegativeTestJSON-427333629 Oct 10 23:20:39.288055 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 2054001d7ed142698beaf51dcb6bd496 Oct 10 23:20:39.288055 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-427333629 Oct 10 23:20:39.288055 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ImagesNegativeTestJSON-427333629-project Oct 10 23:20:39.288055 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:20:39.288055 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:20:39.288055 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 504f553ef2324ac19370a181cf4c3629 Oct 10 23:20:39.288055 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ImagesNegativeTestJSON-427333629-project Oct 10 23:20:39.288055 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:20:39.288055 n-d-860864-2 devstack@n-api.service[120614]: {"createImage": {"name": "tempest-test-snap-1293028540"}} Oct 10 23:20:39.288055 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:20:39.288055 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 23:20:39.288886 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1293028540'}}} Oct 10 23:20:39.288886 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:39.288886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:39.288886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:39.288886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:39.288886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 10 23:20:39.288886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 10 23:20:39.288886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 23:20:39.288886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.288886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:39.288886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.288886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:39.288886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:39.288886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:39.288886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:39.288886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:39.288886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:39.288886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:39.288886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:20:39.288886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:20:39.290183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:20:39.290183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:20:39.290183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 10 23:20:39.290183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 10 23:20:39.290183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:39.290183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:39.290183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:39.290183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:39.290183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 23:20:39.290183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.290183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:39.290183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.290183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:39.290183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:39.290183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:39.290183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:39.290183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:39.290183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 23:20:39.290183 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.291368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5d507e26-48e3-47a4-8e13-d02a816251ba tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:39.291368 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5d507e26-48e3-47a4-8e13-d02a816251ba tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.028291 Oct 10 23:20:39.291368 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 570/1126] 10.222.0.23 () {60 vars in 1275 bytes} [Mon Oct 10 23:20:39 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:39.304403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c2e8f8d3-6587-4755-bada-d25e6ec2105f tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-446671550"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:39.309552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c2e8f8d3-6587-4755-bada-d25e6ec2105f tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 10 23:20:39.310602 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-c2e8f8d3-6587-4755-bada-d25e6ec2105f tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 23:20:39.314301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c2e8f8d3-6587-4755-bada-d25e6ec2105f tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Request method failure captured: Oct 10 23:20:39.314301 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 10 23:20:39.314301 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:20:39.314301 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:20:39.314301 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:20:39.314301 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 56 Oct 10 23:20:39.314301 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:20:39.314301 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:20:39.314301 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:20:39.314301 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:39.314301 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKipnZhnIgvV9PWGRz4lmxzE1f4_1N3i60b9BWpm059BAcmJFaljQTaRWvk3ANuE6oxYDw1XGHvmoTuJ2whHMfATcbdM9iH6B5SDI3X8sDMMbCtp6IEVs80bYICnuWO-KtZ-SVclvjeBmi-nUyDfvzjkpPBnRxqG_w1DsERvGyDeSd0 Oct 10 23:20:39.314301 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:20:39.314301 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:20:39.314301 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:20:39.314301 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:20:39.314301 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:20:39.314301 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:20:39.314301 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 2054001d7ed142698beaf51dcb6bd496 Oct 10 23:20:39.314301 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ImagesNegativeTestJSON-427333629 Oct 10 23:20:39.314301 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:20:39.314301 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:20:39.315925 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2054001d7ed142698beaf51dcb6bd496"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2054001d7ed142698beaf51dcb6bd496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2054001d7ed142698beaf51dcb6bd496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2054001d7ed142698beaf51dcb6bd496", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:39.315925 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ImagesNegativeTestJSON-427333629 Oct 10 23:20:39.315925 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 2054001d7ed142698beaf51dcb6bd496 Oct 10 23:20:39.315925 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-427333629 Oct 10 23:20:39.315925 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ImagesNegativeTestJSON-427333629-project Oct 10 23:20:39.315925 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:20:39.315925 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:20:39.315925 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 504f553ef2324ac19370a181cf4c3629 Oct 10 23:20:39.315925 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ImagesNegativeTestJSON-427333629-project Oct 10 23:20:39.315925 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:20:39.315925 n-d-860864-2 devstack@n-api.service[120614]: {"createImage": {"name": "tempest-test-snap-446671550"}} Oct 10 23:20:39.315925 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:20:39.315925 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 23:20:39.316872 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-446671550'}}} Oct 10 23:20:39.316872 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:39.316872 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:39.316872 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:39.316872 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:39.316872 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 10 23:20:39.316872 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 10 23:20:39.316872 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 23:20:39.316872 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.316872 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:39.316872 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.316872 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:39.316872 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:39.316872 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:39.316872 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:39.316872 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:39.316872 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:39.316872 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:39.316872 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:20:39.316872 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:20:39.319149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:20:39.319149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:20:39.319149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 10 23:20:39.319149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 10 23:20:39.319149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:39.319149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:39.319149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:39.319149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:39.319149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 23:20:39.319149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.319149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:39.319149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.319149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:39.319149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:39.319149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:39.319149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:39.319149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:39.319149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 23:20:39.319149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.321699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c2e8f8d3-6587-4755-bada-d25e6ec2105f tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:39.321699 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c2e8f8d3-6587-4755-bada-d25e6ec2105f tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.020170 Oct 10 23:20:39.325969 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 571/1127] 10.222.0.23 () {60 vars in 1281 bytes} [Mon Oct 10 23:20:39 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:20:39.332469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7f6fffc5-925f-4ad9-9535-cb4124133d49 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:39.332983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7f6fffc5-925f-4ad9-9535-cb4124133d49 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:39.342328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f6fffc5-925f-4ad9-9535-cb4124133d49 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:39.342948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f6fffc5-925f-4ad9-9535-cb4124133d49 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:39.343392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f6fffc5-925f-4ad9-9535-cb4124133d49 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:39.344112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f6fffc5-925f-4ad9-9535-cb4124133d49 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:39.344581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f6fffc5-925f-4ad9-9535-cb4124133d49 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:39.345012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f6fffc5-925f-4ad9-9535-cb4124133d49 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:39.363356 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-7f6fffc5-925f-4ad9-9535-cb4124133d49 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] HTTP exception thrown: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. Oct 10 23:20:39.373307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7f6fffc5-925f-4ad9-9535-cb4124133d49 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Request method failure captured: Oct 10 23:20:39.373307 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 HTTP/1.1 Oct 10 23:20:39.373307 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:20:39.373307 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:20:39.373307 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:20:39.373307 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:20:39.373307 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:20:39.373307 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:20:39.373307 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:20:39.373307 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:39.373307 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKipnZhnIgvV9PWGRz4lmxzE1f4_1N3i60b9BWpm059BAcmJFaljQTaRWvk3ANuE6oxYDw1XGHvmoTuJ2whHMfATcbdM9iH6B5SDI3X8sDMMbCtp6IEVs80bYICnuWO-KtZ-SVclvjeBmi-nUyDfvzjkpPBnRxqG_w1DsERvGyDeSd0 Oct 10 23:20:39.373307 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:20:39.373307 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:20:39.373307 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:20:39.373307 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:20:39.373307 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:20:39.373307 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:20:39.373307 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 2054001d7ed142698beaf51dcb6bd496 Oct 10 23:20:39.373307 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ImagesNegativeTestJSON-427333629 Oct 10 23:20:39.373307 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:20:39.373307 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:20:39.374762 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2054001d7ed142698beaf51dcb6bd496"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2054001d7ed142698beaf51dcb6bd496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2054001d7ed142698beaf51dcb6bd496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2054001d7ed142698beaf51dcb6bd496", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:39.374762 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ImagesNegativeTestJSON-427333629 Oct 10 23:20:39.374762 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 2054001d7ed142698beaf51dcb6bd496 Oct 10 23:20:39.374762 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-427333629 Oct 10 23:20:39.374762 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ImagesNegativeTestJSON-427333629-project Oct 10 23:20:39.374762 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:20:39.374762 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:20:39.374762 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 504f553ef2324ac19370a181cf4c3629 Oct 10 23:20:39.374762 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ImagesNegativeTestJSON-427333629-project Oct 10 23:20:39.374762 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:20:39.374762 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. Oct 10 23:20:39.374762 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '9dc60f0b-c592-4047-97cf-7c81649085d3'} Oct 10 23:20:39.375496 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:39.375496 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:39.375496 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:39.375496 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:39.375496 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:20:39.375496 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:20:39.375496 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:20:39.375496 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:20:39.375496 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:20:39.375496 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:20:39.375496 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. Oct 10 23:20:39.375496 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.375496 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:39.375496 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.375496 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:39.375496 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:39.375496 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:39.375496 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:39.375496 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:39.375496 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:39.376798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:39.376798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:20:39.376798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:20:39.376798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:20:39.376798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:20:39.376798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:39.376798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:39.376798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:39.376798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:39.376798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. Oct 10 23:20:39.376798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.376798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:39.376798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.376798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:39.376798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:39.376798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:39.376798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:39.376798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:39.376798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. Oct 10 23:20:39.376798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.379786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7f6fffc5-925f-4ad9-9535-cb4124133d49 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Returning 404 to user: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:39.379786 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7f6fffc5-925f-4ad9-9535-cb4124133d49 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 404 len: 111 microversion: 2.1 time: 0.047803 Oct 10 23:20:39.379786 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 572/1128] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:20:39 2022] DELETE /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:39.385123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9184f0c6-9a39-4b5a-9113-2ad93a40c693 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:39.385864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9184f0c6-9a39-4b5a-9113-2ad93a40c693 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] [instance: 9dc60f0b-c592-4047-97cf-7c81649085d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:39.394020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9184f0c6-9a39-4b5a-9113-2ad93a40c693 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:39.394523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9184f0c6-9a39-4b5a-9113-2ad93a40c693 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:39.395049 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9184f0c6-9a39-4b5a-9113-2ad93a40c693 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:39.395989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9184f0c6-9a39-4b5a-9113-2ad93a40c693 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:39.396640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9184f0c6-9a39-4b5a-9113-2ad93a40c693 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:39.397290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9184f0c6-9a39-4b5a-9113-2ad93a40c693 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:39.417093 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-9184f0c6-9a39-4b5a-9113-2ad93a40c693 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] HTTP exception thrown: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. Oct 10 23:20:39.419543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9184f0c6-9a39-4b5a-9113-2ad93a40c693 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Request method failure captured: Oct 10 23:20:39.419543 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 HTTP/1.1 Oct 10 23:20:39.419543 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:20:39.419543 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:20:39.419543 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:20:39.419543 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:20:39.419543 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:20:39.419543 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:20:39.419543 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:20:39.419543 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:39.419543 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKipnZhnIgvV9PWGRz4lmxzE1f4_1N3i60b9BWpm059BAcmJFaljQTaRWvk3ANuE6oxYDw1XGHvmoTuJ2whHMfATcbdM9iH6B5SDI3X8sDMMbCtp6IEVs80bYICnuWO-KtZ-SVclvjeBmi-nUyDfvzjkpPBnRxqG_w1DsERvGyDeSd0 Oct 10 23:20:39.419543 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:20:39.419543 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:20:39.419543 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:20:39.419543 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:20:39.419543 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:20:39.419543 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:20:39.419543 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 2054001d7ed142698beaf51dcb6bd496 Oct 10 23:20:39.419543 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ImagesNegativeTestJSON-427333629 Oct 10 23:20:39.419543 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:20:39.419543 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:20:39.421097 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2054001d7ed142698beaf51dcb6bd496"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2054001d7ed142698beaf51dcb6bd496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2054001d7ed142698beaf51dcb6bd496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2054001d7ed142698beaf51dcb6bd496", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:39.421097 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ImagesNegativeTestJSON-427333629 Oct 10 23:20:39.421097 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 2054001d7ed142698beaf51dcb6bd496 Oct 10 23:20:39.421097 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-427333629 Oct 10 23:20:39.421097 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ImagesNegativeTestJSON-427333629-project Oct 10 23:20:39.421097 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:20:39.421097 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:20:39.421097 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 504f553ef2324ac19370a181cf4c3629 Oct 10 23:20:39.421097 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ImagesNegativeTestJSON-427333629-project Oct 10 23:20:39.421097 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:20:39.421097 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. Oct 10 23:20:39.421097 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '9dc60f0b-c592-4047-97cf-7c81649085d3'} Oct 10 23:20:39.421873 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:39.421873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:39.421873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:39.421873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:39.421873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:20:39.421873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:20:39.421873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:20:39.421873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:20:39.421873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:20:39.421873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:20:39.421873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. Oct 10 23:20:39.421873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.421873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:39.421873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.421873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:39.421873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:39.421873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:39.421873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:39.421873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:39.421873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:39.423076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:39.423076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:20:39.423076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:20:39.423076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:39.423076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:39.423076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:39.423076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:39.423076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. Oct 10 23:20:39.423076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.423076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:39.423076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.423076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:39.423076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:39.423076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:39.423076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:39.423076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:39.423076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. Oct 10 23:20:39.423076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:39.424181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9184f0c6-9a39-4b5a-9113-2ad93a40c693 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] Returning 404 to user: Instance 9dc60f0b-c592-4047-97cf-7c81649085d3 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:39.424181 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9184f0c6-9a39-4b5a-9113-2ad93a40c693 tempest-ImagesNegativeTestJSON-427333629 tempest-ImagesNegativeTestJSON-427333629-project] 10.222.0.23 "GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3" status: 404 len: 111 microversion: 2.1 time: 0.041499 Oct 10 23:20:39.424181 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 573/1129] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:39 2022] GET /compute/v2.1/servers/9dc60f0b-c592-4047-97cf-7c81649085d3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:39.536913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5b1e042b-e520-4679-8608-35b583e28cb0 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:39.566317 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5b1e042b-e520-4679-8608-35b583e28cb0 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3" status: 200 len: 1519 microversion: 2.1 time: 0.330006 Oct 10 23:20:39.568301 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 557/1130] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:39 2022] GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3 => generated 1519 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:39.732642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4d633984-f295-4f26-af1f-1960a23f8aee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:39.733356 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4d633984-f295-4f26-af1f-1960a23f8aee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:39.739614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d633984-f295-4f26-af1f-1960a23f8aee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:39.740128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d633984-f295-4f26-af1f-1960a23f8aee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:39.740621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d633984-f295-4f26-af1f-1960a23f8aee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:39.741480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d633984-f295-4f26-af1f-1960a23f8aee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:39.742256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d633984-f295-4f26-af1f-1960a23f8aee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:39.742859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d633984-f295-4f26-af1f-1960a23f8aee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:39.801907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5b75e09b-1dfb-4827-b323-bde4c6a0c0fc tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:39.802918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5b75e09b-1dfb-4827-b323-bde4c6a0c0fc tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:39.809210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b75e09b-1dfb-4827-b323-bde4c6a0c0fc tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:39.810392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b75e09b-1dfb-4827-b323-bde4c6a0c0fc tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:39.810910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b75e09b-1dfb-4827-b323-bde4c6a0c0fc tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:39.811707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b75e09b-1dfb-4827-b323-bde4c6a0c0fc tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:39.812230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b75e09b-1dfb-4827-b323-bde4c6a0c0fc tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:39.812959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b75e09b-1dfb-4827-b323-bde4c6a0c0fc tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:40.055152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4d633984-f295-4f26-af1f-1960a23f8aee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:40.071963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4d633984-f295-4f26-af1f-1960a23f8aee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:40.073557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4d633984-f295-4f26-af1f-1960a23f8aee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:40.074901 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4d633984-f295-4f26-af1f-1960a23f8aee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1567 microversion: 2.25 time: 0.347723 Oct 10 23:20:40.092432 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 574/1131] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:39 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1567 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:40.098591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-38f2278f-1c63-4777-8e04-d8b26dc9a1db tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:40.099704 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-38f2278f-1c63-4777-8e04-d8b26dc9a1db tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:40.106209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38f2278f-1c63-4777-8e04-d8b26dc9a1db tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:40.107920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38f2278f-1c63-4777-8e04-d8b26dc9a1db tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:40.108508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38f2278f-1c63-4777-8e04-d8b26dc9a1db tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:40.109394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38f2278f-1c63-4777-8e04-d8b26dc9a1db tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:40.109950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38f2278f-1c63-4777-8e04-d8b26dc9a1db tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:40.110654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38f2278f-1c63-4777-8e04-d8b26dc9a1db tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:40.240562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-38f2278f-1c63-4777-8e04-d8b26dc9a1db tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:40.259512 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-38f2278f-1c63-4777-8e04-d8b26dc9a1db tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1336 microversion: 2.1 time: 0.165165 Oct 10 23:20:40.262088 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 575/1132] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:40 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1336 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:40.276179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-82bdcf9d-0e90-47e7-9105-6ff9f42f00dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:40.277083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-82bdcf9d-0e90-47e7-9105-6ff9f42f00dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 5d61c758-b733-4d1e-8dbb-99cda309c9c8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:40.284875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82bdcf9d-0e90-47e7-9105-6ff9f42f00dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:40.285366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82bdcf9d-0e90-47e7-9105-6ff9f42f00dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:40.285872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82bdcf9d-0e90-47e7-9105-6ff9f42f00dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:40.286582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82bdcf9d-0e90-47e7-9105-6ff9f42f00dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:40.287029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82bdcf9d-0e90-47e7-9105-6ff9f42f00dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:40.287483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82bdcf9d-0e90-47e7-9105-6ff9f42f00dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:40.315162 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-82bdcf9d-0e90-47e7-9105-6ff9f42f00dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] HTTP exception thrown: Instance 5d61c758-b733-4d1e-8dbb-99cda309c9c8 could not be found. Oct 10 23:20:40.319372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-82bdcf9d-0e90-47e7-9105-6ff9f42f00dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Request method failure captured: Oct 10 23:20:40.319372 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8 HTTP/1.1 Oct 10 23:20:40.319372 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:20:40.319372 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:20:40.319372 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:20:40.319372 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:20:40.319372 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:20:40.319372 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:20:40.319372 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:20:40.319372 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:40.319372 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgJCGPRazsPZv_KJRTPkW4yfXkftWI99r6NM1NcPzbV6ezzFy8Kk0KC2fs-Oq1mdxcQ8vpiKa4rTjWrgHH8KDGbQArWJeSLbZnpz5njlegxl252rFp2J2t_YkO8EBZX2N9DD656V96Tu1xc3xvEKd_hjW4bndDcX9tluGi3sznnXco Oct 10 23:20:40.319372 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:20:40.319372 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:20:40.319372 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:20:40.319372 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:20:40.319372 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:20:40.319372 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:20:40.319372 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: d98b12fc1bbf42d4b7376222c55733ed Oct 10 23:20:40.319372 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:20:40.319372 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:20:40.319372 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:20:40.320759 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d98b12fc1bbf42d4b7376222c55733ed", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:40.320759 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:20:40.320759 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: d98b12fc1bbf42d4b7376222c55733ed Oct 10 23:20:40.320759 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:20:40.320759 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersOnMultiNodesTest-1123459593-project Oct 10 23:20:40.320759 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:20:40.320759 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:20:40.320759 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 310196e1663a4f7ca12e1fc53b0278ba Oct 10 23:20:40.320759 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersOnMultiNodesTest-1123459593-project Oct 10 23:20:40.320759 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:20:40.320759 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 5d61c758-b733-4d1e-8dbb-99cda309c9c8 could not be found. Oct 10 23:20:40.320759 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '5d61c758-b733-4d1e-8dbb-99cda309c9c8'} Oct 10 23:20:40.321542 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:40.321542 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:40.321542 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:40.321542 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:40.321542 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:20:40.321542 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:20:40.321542 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:20:40.321542 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:20:40.321542 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:20:40.321542 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:20:40.321542 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d61c758-b733-4d1e-8dbb-99cda309c9c8 could not be found. Oct 10 23:20:40.321542 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:40.321542 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:40.321542 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:40.321542 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:40.321542 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:40.321542 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:40.321542 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:40.321542 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:40.321542 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:40.322880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:40.322880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:20:40.322880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:20:40.322880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:40.322880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:40.322880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:40.322880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:40.322880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d61c758-b733-4d1e-8dbb-99cda309c9c8 could not be found. Oct 10 23:20:40.322880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:40.322880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:40.322880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:40.322880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:40.322880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:40.322880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:40.322880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:40.322880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:40.322880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d61c758-b733-4d1e-8dbb-99cda309c9c8 could not be found. Oct 10 23:20:40.322880 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:40.324893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-82bdcf9d-0e90-47e7-9105-6ff9f42f00dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Returning 404 to user: Instance 5d61c758-b733-4d1e-8dbb-99cda309c9c8 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:40.326443 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-82bdcf9d-0e90-47e7-9105-6ff9f42f00dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8" status: 404 len: 111 microversion: 2.1 time: 0.061946 Oct 10 23:20:40.327270 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 576/1133] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:40 2022] GET /compute/v2.1/servers/5d61c758-b733-4d1e-8dbb-99cda309c9c8 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:40.337106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6a502e9d-762b-410c-a527-ef140a74c1ff tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:40.337725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6a502e9d-762b-410c-a527-ef140a74c1ff tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: db1b49d1-08d6-4cb1-a27d-63944f113ea7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:40.346265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a502e9d-762b-410c-a527-ef140a74c1ff tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:40.348008 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a502e9d-762b-410c-a527-ef140a74c1ff tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:40.349360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a502e9d-762b-410c-a527-ef140a74c1ff tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:40.350380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a502e9d-762b-410c-a527-ef140a74c1ff tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:40.351507 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a502e9d-762b-410c-a527-ef140a74c1ff tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:40.352364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a502e9d-762b-410c-a527-ef140a74c1ff tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:40.399975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6a502e9d-762b-410c-a527-ef140a74c1ff tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: db1b49d1-08d6-4cb1-a27d-63944f113ea7] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:20:40.453007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5b75e09b-1dfb-4827-b323-bde4c6a0c0fc tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:40.468974 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5b75e09b-1dfb-4827-b323-bde4c6a0c0fc tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 200 len: 1502 microversion: 2.1 time: 0.671043 Oct 10 23:20:40.470259 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 558/1134] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:39 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 1502 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:40.499333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3711840e-296f-4a2d-9d3a-e6ae55377547 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1684888195"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:40.499887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3711840e-296f-4a2d-9d3a-e6ae55377547 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:40.517503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3711840e-296f-4a2d-9d3a-e6ae55377547 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:40.518462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3711840e-296f-4a2d-9d3a-e6ae55377547 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:40.519445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3711840e-296f-4a2d-9d3a-e6ae55377547 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:40.520214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3711840e-296f-4a2d-9d3a-e6ae55377547 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:40.523061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3711840e-296f-4a2d-9d3a-e6ae55377547 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:40.523517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3711840e-296f-4a2d-9d3a-e6ae55377547 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:40.583785 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6a502e9d-762b-410c-a527-ef140a74c1ff tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "DELETE /compute/v2.1/servers/db1b49d1-08d6-4cb1-a27d-63944f113ea7" status: 204 len: 0 microversion: 2.1 time: 0.250771 Oct 10 23:20:40.586592 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 577/1135] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:20:40 2022] DELETE /compute/v2.1/servers/db1b49d1-08d6-4cb1-a27d-63944f113ea7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:20:40.603530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2f678b14-fd1e-4af7-8fde-ea66a4216c98 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:40.604244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2f678b14-fd1e-4af7-8fde-ea66a4216c98 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 4521fa13-07d6-4f81-9a92-64b6862a3bd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:40.626093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f678b14-fd1e-4af7-8fde-ea66a4216c98 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:40.632320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f678b14-fd1e-4af7-8fde-ea66a4216c98 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:40.633071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f678b14-fd1e-4af7-8fde-ea66a4216c98 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:40.634002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f678b14-fd1e-4af7-8fde-ea66a4216c98 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:40.634658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f678b14-fd1e-4af7-8fde-ea66a4216c98 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:40.635243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f678b14-fd1e-4af7-8fde-ea66a4216c98 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:40.823045 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.network.security_group_api [None req-3711840e-296f-4a2d-9d3a-e6ae55377547 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Adding security group 809fd1e8-f9ce-41a2-a9f2-48418ee34c3d to port f65ed136-fdf8-4735-a0b9-6e6d462b75e1 Oct 10 23:20:40.914880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2f678b14-fd1e-4af7-8fde-ea66a4216c98 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:40.929470 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2f678b14-fd1e-4af7-8fde-ea66a4216c98 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3" status: 200 len: 1519 microversion: 2.1 time: 0.336046 Oct 10 23:20:40.930436 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 578/1136] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:40 2022] GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3 => generated 1519 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:40.935200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4711ca58-6ebe-44e7-88b4-17d9d29b7d2c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:40.935833 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4711ca58-6ebe-44e7-88b4-17d9d29b7d2c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: bd8c16ec-655a-451f-959f-62685aedc8af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:40.943055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4711ca58-6ebe-44e7-88b4-17d9d29b7d2c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:40.943632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4711ca58-6ebe-44e7-88b4-17d9d29b7d2c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:40.944140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4711ca58-6ebe-44e7-88b4-17d9d29b7d2c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:40.944846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4711ca58-6ebe-44e7-88b4-17d9d29b7d2c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:40.945303 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4711ca58-6ebe-44e7-88b4-17d9d29b7d2c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:40.945864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4711ca58-6ebe-44e7-88b4-17d9d29b7d2c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:40.986911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4711ca58-6ebe-44e7-88b4-17d9d29b7d2c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: bd8c16ec-655a-451f-959f-62685aedc8af] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:20:41.060467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:41.119641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:41.150879 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4711ca58-6ebe-44e7-88b4-17d9d29b7d2c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af" status: 204 len: 0 microversion: 2.1 time: 0.219027 Oct 10 23:20:41.154952 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 579/1137] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:20:40 2022] DELETE /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:20:41.160742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-c5dea687-9443-4eea-b411-7c2d69a02316 req-266f3c34-1ca4-470b-9fa0-076b7320ea5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3bb20a8-8b13-470d-ac2b-50b7a7bea206", "name": "network-vif-unplugged", "status": "completed", "tag": "cf309634-58e1-4dda-a8ad-e94e39638eb7"}, {"name": "network-changed", "server_uuid": "c3bb20a8-8b13-470d-ac2b-50b7a7bea206", "tag": "cf309634-58e1-4dda-a8ad-e94e39638eb7"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:41.173262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c5dea687-9443-4eea-b411-7c2d69a02316 req-266f3c34-1ca4-470b-9fa0-076b7320ea5d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:41.173864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c5dea687-9443-4eea-b411-7c2d69a02316 req-266f3c34-1ca4-470b-9fa0-076b7320ea5d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:41.174305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c5dea687-9443-4eea-b411-7c2d69a02316 req-266f3c34-1ca4-470b-9fa0-076b7320ea5d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:41.189183 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-c5dea687-9443-4eea-b411-7c2d69a02316 req-266f3c34-1ca4-470b-9fa0-076b7320ea5d service nova] Creating event network-vif-unplugged:cf309634-58e1-4dda-a8ad-e94e39638eb7 for instance c3bb20a8-8b13-470d-ac2b-50b7a7bea206 on n-h2-860864-2 Oct 10 23:20:41.190065 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-c5dea687-9443-4eea-b411-7c2d69a02316 req-266f3c34-1ca4-470b-9fa0-076b7320ea5d service nova] Creating event network-changed:cf309634-58e1-4dda-a8ad-e94e39638eb7 for instance c3bb20a8-8b13-470d-ac2b-50b7a7bea206 on n-h2-860864-2 Oct 10 23:20:41.195658 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-c5dea687-9443-4eea-b411-7c2d69a02316 req-266f3c34-1ca4-470b-9fa0-076b7320ea5d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.038836 Oct 10 23:20:41.196480 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 580/1138] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:41.202494 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-21ad88e1-7db2-4307-989b-21f923ab0f92 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:41.203152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-21ad88e1-7db2-4307-989b-21f923ab0f92 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:41.210115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21ad88e1-7db2-4307-989b-21f923ab0f92 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:41.210647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21ad88e1-7db2-4307-989b-21f923ab0f92 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:41.211611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21ad88e1-7db2-4307-989b-21f923ab0f92 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:41.211848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21ad88e1-7db2-4307-989b-21f923ab0f92 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:41.212436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21ad88e1-7db2-4307-989b-21f923ab0f92 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:41.212872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21ad88e1-7db2-4307-989b-21f923ab0f92 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:41.458329 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3711840e-296f-4a2d-9d3a-e6ae55377547 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "POST /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b/action" status: 202 len: 0 microversion: 2.1 time: 0.964850 Oct 10 23:20:41.465207 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 559/1139] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:20:40 2022] POST /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b/action => generated 0 bytes in 972 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:20:41.473655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-701646f1-c093-4aff-ac50-33cf02e0c01f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:41.474285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-701646f1-c093-4aff-ac50-33cf02e0c01f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: db1b49d1-08d6-4cb1-a27d-63944f113ea7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:41.482136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-701646f1-c093-4aff-ac50-33cf02e0c01f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:41.482780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-701646f1-c093-4aff-ac50-33cf02e0c01f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:41.483118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-701646f1-c093-4aff-ac50-33cf02e0c01f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:41.483832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-701646f1-c093-4aff-ac50-33cf02e0c01f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:41.484348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-701646f1-c093-4aff-ac50-33cf02e0c01f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:41.484844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-701646f1-c093-4aff-ac50-33cf02e0c01f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:41.515507 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-21ad88e1-7db2-4307-989b-21f923ab0f92 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:41.533658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-21ad88e1-7db2-4307-989b-21f923ab0f92 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:41.536080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-21ad88e1-7db2-4307-989b-21f923ab0f92 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:41.538220 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-21ad88e1-7db2-4307-989b-21f923ab0f92 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1567 microversion: 2.25 time: 0.340694 Oct 10 23:20:41.560349 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 581/1140] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:41 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1567 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:41.585419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b5d382bb-e00c-46bd-b73a-3c7f7c2c0115 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:41.586491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b5d382bb-e00c-46bd-b73a-3c7f7c2c0115 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:41.604418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5d382bb-e00c-46bd-b73a-3c7f7c2c0115 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:41.605279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5d382bb-e00c-46bd-b73a-3c7f7c2c0115 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:41.607595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5d382bb-e00c-46bd-b73a-3c7f7c2c0115 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:41.611872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5d382bb-e00c-46bd-b73a-3c7f7c2c0115 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:41.614677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5d382bb-e00c-46bd-b73a-3c7f7c2c0115 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:41.615863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5d382bb-e00c-46bd-b73a-3c7f7c2c0115 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:41.751365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-701646f1-c093-4aff-ac50-33cf02e0c01f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:41.761354 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-701646f1-c093-4aff-ac50-33cf02e0c01f tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/db1b49d1-08d6-4cb1-a27d-63944f113ea7" status: 200 len: 1474 microversion: 2.1 time: 0.291724 Oct 10 23:20:41.762233 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 560/1141] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:41 2022] GET /compute/v2.1/servers/db1b49d1-08d6-4cb1-a27d-63944f113ea7 => generated 1474 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:41.768858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2e3a97e7-59a0-4c6b-9f8c-65b6a5d8bdc0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662b4c2550>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:41.956395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG neutronclient.v2_0.client [None req-2e3a97e7-59a0-4c6b-9f8c-65b6a5d8bdc0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 809fd1e8-f9ce-41a2-a9f2-48418ee34c3d in use.", "detail": ""}} {{(pid=120613) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:20:41.958479 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-2e3a97e7-59a0-4c6b-9f8c-65b6a5d8bdc0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] HTTP exception thrown: Security Group 809fd1e8-f9ce-41a2-a9f2-48418ee34c3d in use. Oct 10 23:20:41.958479 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-f3a6d146-37f6-4223-82a3-3894c43f182c'] Oct 10 23:20:41.962114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2e3a97e7-59a0-4c6b-9f8c-65b6a5d8bdc0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Request method failure captured: Oct 10 23:20:41.962114 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/os-security-groups/809fd1e8-f9ce-41a2-a9f2-48418ee34c3d HTTP/1.1 Oct 10 23:20:41.962114 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:20:41.962114 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:20:41.962114 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:20:41.962114 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:20:41.962114 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:20:41.962114 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:20:41.962114 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:20:41.962114 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:41.962114 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKiWDPhHeP1ao6Y5tHRbKvX9ZemW6vlLJ_C_MrPyGjEC179XpXPzYIbuoXBVNF4FDH7pzl8bOhuSRj1e7-5DcugU6k1KiwPFd9Qs6t3kjUe9RfKY0BXqex3wdvC4HjG24zVF2_841auDxOTWHziJVDjurPxpFpMsEGjqqP8S2TuKi34 Oct 10 23:20:41.962114 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:20:41.962114 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:20:41.962114 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:20:41.962114 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:20:41.962114 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:20:41.962114 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:20:41.962114 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:20:41.962114 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:20:41.962114 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:20:41.962114 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:20:41.963569 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_56fc65084a2a46689aa3b221e6d7aeb8", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:41.963569 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:20:41.963569 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:20:41.963569 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:20:41.963569 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:20:41.963569 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:20:41.963569 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:20:41.963569 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 9dfa7f1be9884bb1aabc9df8702fa630 Oct 10 23:20:41.963569 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:20:41.963569 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:20:41.963569 n-d-860864-2 devstack@n-api.service[120613]: exception: Security Group 809fd1e8-f9ce-41a2-a9f2-48418ee34c3d in use. Oct 10 23:20:41.963569 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-f3a6d146-37f6-4223-82a3-3894c43f182c'] Oct 10 23:20:41.963569 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '809fd1e8-f9ce-41a2-a9f2-48418ee34c3d'} Oct 10 23:20:41.964395 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:41.964395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:41.964395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 10 23:20:41.964395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 10 23:20:41.964395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:41.964395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:41.964395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 10 23:20:41.964395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 10 23:20:41.964395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:41.964395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:41.964395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 10 23:20:41.964395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 10 23:20:41.964395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:41.964395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:41.964395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:20:41.964395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:20:41.964395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:41.964395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:41.964395 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:20:41.965648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:20:41.965648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:41.965648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:41.965648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:20:41.965648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:20:41.965648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:20:41.965648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:20:41.965648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 809fd1e8-f9ce-41a2-a9f2-48418ee34c3d in use. Oct 10 23:20:41.965648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3a6d146-37f6-4223-82a3-3894c43f182c'] Oct 10 23:20:41.965648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:41.965648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:41.965648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:41.965648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:41.965648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 10 23:20:41.965648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 10 23:20:41.965648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 10 23:20:41.965648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 10 23:20:41.965648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 809fd1e8-f9ce-41a2-a9f2-48418ee34c3d in use. Oct 10 23:20:41.965648 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3a6d146-37f6-4223-82a3-3894c43f182c'] Oct 10 23:20:41.967429 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:41.967429 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:41.967429 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:41.967429 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:41.967429 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:41.967429 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:41.967429 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:41.967429 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:41.967429 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:20:41.967429 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:20:41.967429 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:41.967429 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:41.967429 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 10 23:20:41.967429 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 23:20:41.967429 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 809fd1e8-f9ce-41a2-a9f2-48418ee34c3d in use. Oct 10 23:20:41.967429 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3a6d146-37f6-4223-82a3-3894c43f182c'] Oct 10 23:20:41.967429 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:41.967429 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:41.967429 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:41.967429 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:41.967429 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:41.971386 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:41.971386 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:41.971386 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:41.971386 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 809fd1e8-f9ce-41a2-a9f2-48418ee34c3d in use. Oct 10 23:20:41.971386 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3a6d146-37f6-4223-82a3-3894c43f182c'] Oct 10 23:20:41.971386 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:41.973785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2e3a97e7-59a0-4c6b-9f8c-65b6a5d8bdc0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Returning 400 to user: Security Group 809fd1e8-f9ce-41a2-a9f2-48418ee34c3d in use. Oct 10 23:20:41.973785 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-f3a6d146-37f6-4223-82a3-3894c43f182c'] {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:41.975066 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2e3a97e7-59a0-4c6b-9f8c-65b6a5d8bdc0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/809fd1e8-f9ce-41a2-a9f2-48418ee34c3d" status: 400 len: 185 microversion: 2.1 time: 0.211137 Oct 10 23:20:41.976166 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 561/1142] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:20:41 2022] DELETE /compute/v2.1/os-security-groups/809fd1e8-f9ce-41a2-a9f2-48418ee34c3d => generated 185 bytes in 213 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:20:41.981870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-553da94f-6c6a-46b0-9e86-1a7681ef17e3 req-112a643f-01ff-4e91-8546-4e6734aa3e14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dea3f22-ee85-4a3f-a4cd-a0634c6e451b", "tag": "f65ed136-fdf8-4735-a0b9-6e6d462b75e1"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:41.997744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-553da94f-6c6a-46b0-9e86-1a7681ef17e3 req-112a643f-01ff-4e91-8546-4e6734aa3e14 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:41.998707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-553da94f-6c6a-46b0-9e86-1a7681ef17e3 req-112a643f-01ff-4e91-8546-4e6734aa3e14 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:42.000095 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-553da94f-6c6a-46b0-9e86-1a7681ef17e3 req-112a643f-01ff-4e91-8546-4e6734aa3e14 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:42.015845 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-553da94f-6c6a-46b0-9e86-1a7681ef17e3 req-112a643f-01ff-4e91-8546-4e6734aa3e14 service nova] Creating event network-changed:f65ed136-fdf8-4735-a0b9-6e6d462b75e1 for instance 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b on n-h2-860864-2 Oct 10 23:20:42.023162 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-553da94f-6c6a-46b0-9e86-1a7681ef17e3 req-112a643f-01ff-4e91-8546-4e6734aa3e14 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044833 Oct 10 23:20:42.024433 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 562/1143] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:42.030921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b5d382bb-e00c-46bd-b73a-3c7f7c2c0115 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:42.035549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a216d519-2514-4bfd-a076-f99c5b4449fd tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:42.036521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a216d519-2514-4bfd-a076-f99c5b4449fd tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 4521fa13-07d6-4f81-9a92-64b6862a3bd3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:42.041030 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b5d382bb-e00c-46bd-b73a-3c7f7c2c0115 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1378 microversion: 2.1 time: 0.479469 Oct 10 23:20:42.045207 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 582/1144] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:41 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1378 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:42.050414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-de085b01-bd78-4728-ae91-19208109e514 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:42.052712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-de085b01-bd78-4728-ae91-19208109e514 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:42.058714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de085b01-bd78-4728-ae91-19208109e514 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:42.059213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a216d519-2514-4bfd-a076-f99c5b4449fd tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:42.059336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de085b01-bd78-4728-ae91-19208109e514 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:42.060609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de085b01-bd78-4728-ae91-19208109e514 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:42.061195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a216d519-2514-4bfd-a076-f99c5b4449fd tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:42.061597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de085b01-bd78-4728-ae91-19208109e514 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:42.062051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de085b01-bd78-4728-ae91-19208109e514 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:42.062391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a216d519-2514-4bfd-a076-f99c5b4449fd tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:42.062634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de085b01-bd78-4728-ae91-19208109e514 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:42.063653 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a216d519-2514-4bfd-a076-f99c5b4449fd tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:42.064478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a216d519-2514-4bfd-a076-f99c5b4449fd tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:42.065333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a216d519-2514-4bfd-a076-f99c5b4449fd tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:42.179418 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-de085b01-bd78-4728-ae91-19208109e514 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "POST /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b/action" status: 202 len: 0 microversion: 2.1 time: 0.130805 Oct 10 23:20:42.180226 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 583/1145] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:20:42 2022] POST /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:20:42.195186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b4ad31a5-b772-44e3-993a-ce6bc3782706 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:42.195965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b4ad31a5-b772-44e3-993a-ce6bc3782706 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:42.204250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4ad31a5-b772-44e3-993a-ce6bc3782706 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:42.204783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4ad31a5-b772-44e3-993a-ce6bc3782706 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:42.205393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4ad31a5-b772-44e3-993a-ce6bc3782706 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:42.207043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4ad31a5-b772-44e3-993a-ce6bc3782706 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:42.207512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4ad31a5-b772-44e3-993a-ce6bc3782706 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:42.208522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4ad31a5-b772-44e3-993a-ce6bc3782706 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:42.339212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a216d519-2514-4bfd-a076-f99c5b4449fd tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:42.349055 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a216d519-2514-4bfd-a076-f99c5b4449fd tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3" status: 200 len: 1519 microversion: 2.1 time: 0.322812 Oct 10 23:20:42.362241 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 563/1146] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:42 2022] GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3 => generated 1519 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:42.551521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b4ad31a5-b772-44e3-993a-ce6bc3782706 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:42.570154 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b4ad31a5-b772-44e3-993a-ce6bc3782706 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 200 len: 1573 microversion: 2.1 time: 0.382835 Oct 10 23:20:42.588703 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 584/1147] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:42 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 1573 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:42.641968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c525516a-85c3-4e0f-8470-0e2cd8051e3b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:42.642950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c525516a-85c3-4e0f-8470-0e2cd8051e3b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:42.657981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c525516a-85c3-4e0f-8470-0e2cd8051e3b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:42.658781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c525516a-85c3-4e0f-8470-0e2cd8051e3b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:42.660811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c525516a-85c3-4e0f-8470-0e2cd8051e3b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:42.662579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c525516a-85c3-4e0f-8470-0e2cd8051e3b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:42.663517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c525516a-85c3-4e0f-8470-0e2cd8051e3b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:42.664833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c525516a-85c3-4e0f-8470-0e2cd8051e3b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:42.788174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-161b6707-a524-494e-83ec-e55c85a82af8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:42.788915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-161b6707-a524-494e-83ec-e55c85a82af8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: db1b49d1-08d6-4cb1-a27d-63944f113ea7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:42.803379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-161b6707-a524-494e-83ec-e55c85a82af8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:42.803989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-161b6707-a524-494e-83ec-e55c85a82af8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:42.804512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-161b6707-a524-494e-83ec-e55c85a82af8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:42.805311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-161b6707-a524-494e-83ec-e55c85a82af8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:42.805876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-161b6707-a524-494e-83ec-e55c85a82af8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:42.806378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-161b6707-a524-494e-83ec-e55c85a82af8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:43.188450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c525516a-85c3-4e0f-8470-0e2cd8051e3b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:43.209425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c525516a-85c3-4e0f-8470-0e2cd8051e3b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:43.211354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c525516a-85c3-4e0f-8470-0e2cd8051e3b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:43.218041 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c525516a-85c3-4e0f-8470-0e2cd8051e3b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1567 microversion: 2.25 time: 0.581684 Oct 10 23:20:43.220788 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 564/1148] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:42 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1567 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:43.228041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6b930d83-6865-417d-801f-1735b97520e5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:43.229519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6b930d83-6865-417d-801f-1735b97520e5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:43.243956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b930d83-6865-417d-801f-1735b97520e5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:43.245582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b930d83-6865-417d-801f-1735b97520e5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:43.246210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b930d83-6865-417d-801f-1735b97520e5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:43.248753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b930d83-6865-417d-801f-1735b97520e5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:43.250224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b930d83-6865-417d-801f-1735b97520e5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:43.250846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b930d83-6865-417d-801f-1735b97520e5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:43.687656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6b930d83-6865-417d-801f-1735b97520e5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:43.704695 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6b930d83-6865-417d-801f-1735b97520e5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1378 microversion: 2.1 time: 0.481983 Oct 10 23:20:43.727458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-161b6707-a524-494e-83ec-e55c85a82af8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:43.730839 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 565/1149] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:43 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1378 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:43.737257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-fbc6d068-5631-419e-91e0-2653546b88c3 req-bac2ffd7-fdb7-4373-8dbc-605ff35c2e40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c528ef78-5144-437a-83e3-38376725259a", "tag": "caf7c02f-0516-49b4-a4e1-4d9d62869316"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:43.747851 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-161b6707-a524-494e-83ec-e55c85a82af8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/db1b49d1-08d6-4cb1-a27d-63944f113ea7" status: 200 len: 1474 microversion: 2.1 time: 0.963101 Oct 10 23:20:43.748807 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 585/1150] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:42 2022] GET /compute/v2.1/servers/db1b49d1-08d6-4cb1-a27d-63944f113ea7 => generated 1474 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:43.750294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-fbc6d068-5631-419e-91e0-2653546b88c3 req-bac2ffd7-fdb7-4373-8dbc-605ff35c2e40 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:43.750968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-fbc6d068-5631-419e-91e0-2653546b88c3 req-bac2ffd7-fdb7-4373-8dbc-605ff35c2e40 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:43.751711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-fbc6d068-5631-419e-91e0-2653546b88c3 req-bac2ffd7-fdb7-4373-8dbc-605ff35c2e40 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:43.753558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9a79376d-9041-4ef9-840b-d4fabdef9743 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:43.754176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9a79376d-9041-4ef9-840b-d4fabdef9743 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 4521fa13-07d6-4f81-9a92-64b6862a3bd3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:43.767369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a79376d-9041-4ef9-840b-d4fabdef9743 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:43.767576 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-fbc6d068-5631-419e-91e0-2653546b88c3 req-bac2ffd7-fdb7-4373-8dbc-605ff35c2e40 service nova] Creating event network-changed:caf7c02f-0516-49b4-a4e1-4d9d62869316 for instance c528ef78-5144-437a-83e3-38376725259a on n-h1-860864-2 Oct 10 23:20:43.767878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a79376d-9041-4ef9-840b-d4fabdef9743 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:43.768319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a79376d-9041-4ef9-840b-d4fabdef9743 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:43.769033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a79376d-9041-4ef9-840b-d4fabdef9743 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:43.769524 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a79376d-9041-4ef9-840b-d4fabdef9743 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:43.769962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a79376d-9041-4ef9-840b-d4fabdef9743 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:43.774682 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-fbc6d068-5631-419e-91e0-2653546b88c3 req-bac2ffd7-fdb7-4373-8dbc-605ff35c2e40 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041643 Oct 10 23:20:43.775551 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 566/1151] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:43.782453 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-114d4b00-03ef-4113-a5a8-8c8aa3b5712b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:43.783419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-114d4b00-03ef-4113-a5a8-8c8aa3b5712b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:43.790384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-114d4b00-03ef-4113-a5a8-8c8aa3b5712b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:43.791139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-114d4b00-03ef-4113-a5a8-8c8aa3b5712b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:43.791772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-114d4b00-03ef-4113-a5a8-8c8aa3b5712b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:43.792840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-114d4b00-03ef-4113-a5a8-8c8aa3b5712b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:43.793494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-114d4b00-03ef-4113-a5a8-8c8aa3b5712b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:43.794147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-114d4b00-03ef-4113-a5a8-8c8aa3b5712b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:44.446127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-114d4b00-03ef-4113-a5a8-8c8aa3b5712b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:44.461712 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-114d4b00-03ef-4113-a5a8-8c8aa3b5712b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 200 len: 1573 microversion: 2.1 time: 0.684639 Oct 10 23:20:44.477446 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 567/1152] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:43 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 1573 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:44.477446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-026972a9-a01f-47fe-ad85-3ec1ab3629d8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:44.477446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-026972a9-a01f-47fe-ad85-3ec1ab3629d8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:44.478251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9a79376d-9041-4ef9-840b-d4fabdef9743 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:44.478465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-026972a9-a01f-47fe-ad85-3ec1ab3629d8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:44.478465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-026972a9-a01f-47fe-ad85-3ec1ab3629d8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:44.478465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-026972a9-a01f-47fe-ad85-3ec1ab3629d8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:44.478465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-026972a9-a01f-47fe-ad85-3ec1ab3629d8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:44.478769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-026972a9-a01f-47fe-ad85-3ec1ab3629d8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:44.478970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-026972a9-a01f-47fe-ad85-3ec1ab3629d8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:44.497620 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9a79376d-9041-4ef9-840b-d4fabdef9743 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3" status: 200 len: 1519 microversion: 2.1 time: 0.747302 Oct 10 23:20:44.509225 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 586/1153] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:43 2022] GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3 => generated 1519 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:44.738090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-72e4d732-6862-43ca-9878-af04ee17c47d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:44.739862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-72e4d732-6862-43ca-9878-af04ee17c47d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:44.758194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72e4d732-6862-43ca-9878-af04ee17c47d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:44.759027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72e4d732-6862-43ca-9878-af04ee17c47d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:44.759755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72e4d732-6862-43ca-9878-af04ee17c47d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:44.761283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72e4d732-6862-43ca-9878-af04ee17c47d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:44.762206 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72e4d732-6862-43ca-9878-af04ee17c47d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:44.763449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72e4d732-6862-43ca-9878-af04ee17c47d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:44.835377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-026972a9-a01f-47fe-ad85-3ec1ab3629d8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:44.848798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-026972a9-a01f-47fe-ad85-3ec1ab3629d8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:44.850893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-026972a9-a01f-47fe-ad85-3ec1ab3629d8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:44.852699 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-026972a9-a01f-47fe-ad85-3ec1ab3629d8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1567 microversion: 2.25 time: 0.389082 Oct 10 23:20:44.861193 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 568/1154] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:44 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1567 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:44.876971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-31b19982-1f89-493a-a735-02473712b2ff tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:44.877634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-31b19982-1f89-493a-a735-02473712b2ff tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: db1b49d1-08d6-4cb1-a27d-63944f113ea7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:44.893085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-31b19982-1f89-493a-a735-02473712b2ff tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:44.893617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-31b19982-1f89-493a-a735-02473712b2ff tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:44.894056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-31b19982-1f89-493a-a735-02473712b2ff tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:44.894761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-31b19982-1f89-493a-a735-02473712b2ff tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:44.895216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-31b19982-1f89-493a-a735-02473712b2ff tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:44.895647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-31b19982-1f89-493a-a735-02473712b2ff tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:44.919942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:45.006474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-31b19982-1f89-493a-a735-02473712b2ff tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:45.018511 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-31b19982-1f89-493a-a735-02473712b2ff tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/db1b49d1-08d6-4cb1-a27d-63944f113ea7" status: 200 len: 1432 microversion: 2.1 time: 0.159819 Oct 10 23:20:45.019718 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 569/1155] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:44 2022] GET /compute/v2.1/servers/db1b49d1-08d6-4cb1-a27d-63944f113ea7 => generated 1432 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:45.025531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-9ce0bee6-97e3-4503-9e2f-de3fd1c78e8c req-cee5f257-1cf0-4da0-8d07-92e586ce3e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4521fa13-07d6-4f81-9a92-64b6862a3bd3", "name": "network-vif-deleted", "tag": "5d0fd092-c1ac-4d0a-8a4b-2851cc1ab0fe"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:45.046582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9ce0bee6-97e3-4503-9e2f-de3fd1c78e8c req-cee5f257-1cf0-4da0-8d07-92e586ce3e7c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:45.048776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9ce0bee6-97e3-4503-9e2f-de3fd1c78e8c req-cee5f257-1cf0-4da0-8d07-92e586ce3e7c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:45.050021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9ce0bee6-97e3-4503-9e2f-de3fd1c78e8c req-cee5f257-1cf0-4da0-8d07-92e586ce3e7c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:45.070167 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-9ce0bee6-97e3-4503-9e2f-de3fd1c78e8c req-cee5f257-1cf0-4da0-8d07-92e586ce3e7c service nova] Creating event network-vif-deleted:5d0fd092-c1ac-4d0a-8a4b-2851cc1ab0fe for instance 4521fa13-07d6-4f81-9a92-64b6862a3bd3 on n-h2-860864-2 Oct 10 23:20:45.076095 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-9ce0bee6-97e3-4503-9e2f-de3fd1c78e8c req-cee5f257-1cf0-4da0-8d07-92e586ce3e7c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053764 Oct 10 23:20:45.077235 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 570/1156] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:45.490200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6dadc8dd-b4aa-4caf-923c-5d35540c60e2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:45.491323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6dadc8dd-b4aa-4caf-923c-5d35540c60e2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:45.504287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6dadc8dd-b4aa-4caf-923c-5d35540c60e2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:45.504783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6dadc8dd-b4aa-4caf-923c-5d35540c60e2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:45.505221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6dadc8dd-b4aa-4caf-923c-5d35540c60e2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:45.505968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6dadc8dd-b4aa-4caf-923c-5d35540c60e2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:45.506683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6dadc8dd-b4aa-4caf-923c-5d35540c60e2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:45.506835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6dadc8dd-b4aa-4caf-923c-5d35540c60e2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:45.647217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=14 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:45.852725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6dadc8dd-b4aa-4caf-923c-5d35540c60e2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:45.862995 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6dadc8dd-b4aa-4caf-923c-5d35540c60e2 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 200 len: 1573 microversion: 2.1 time: 0.377517 Oct 10 23:20:45.864212 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 571/1157] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:45 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 1573 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:45.869365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-32b5e2d8-e847-4565-abca-ccca4798f343 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:45.870215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-32b5e2d8-e847-4565-abca-ccca4798f343 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 4521fa13-07d6-4f81-9a92-64b6862a3bd3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:45.884871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32b5e2d8-e847-4565-abca-ccca4798f343 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:45.885657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32b5e2d8-e847-4565-abca-ccca4798f343 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:45.886244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32b5e2d8-e847-4565-abca-ccca4798f343 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:45.887174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32b5e2d8-e847-4565-abca-ccca4798f343 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:45.887784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32b5e2d8-e847-4565-abca-ccca4798f343 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:45.889096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32b5e2d8-e847-4565-abca-ccca4798f343 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:45.931754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32b5e2d8-e847-4565-abca-ccca4798f343 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:45.932195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32b5e2d8-e847-4565-abca-ccca4798f343 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:45.932641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32b5e2d8-e847-4565-abca-ccca4798f343 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:45.933182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-32b5e2d8-e847-4565-abca-ccca4798f343 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lazy-loading 'fault' on Instance uuid 4521fa13-07d6-4f81-9a92-64b6862a3bd3 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:20:46.019674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-32b5e2d8-e847-4565-abca-ccca4798f343 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:46.028132 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-32b5e2d8-e847-4565-abca-ccca4798f343 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3" status: 200 len: 1311 microversion: 2.1 time: 0.162711 Oct 10 23:20:46.036608 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 572/1158] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:45 2022] GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3 => generated 1311 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:46.046924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5046c5e1-e259-4a53-85e4-45dc1dfec7d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:46.050083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5046c5e1-e259-4a53-85e4-45dc1dfec7d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:46.058311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-72e4d732-6862-43ca-9878-af04ee17c47d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:46.067143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=8 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:46.079528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5046c5e1-e259-4a53-85e4-45dc1dfec7d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:46.082299 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-72e4d732-6862-43ca-9878-af04ee17c47d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1378 microversion: 2.1 time: 1.354509 Oct 10 23:20:46.082853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5046c5e1-e259-4a53-85e4-45dc1dfec7d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:46.083100 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 587/1159] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:44 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1378 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:46.094764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5046c5e1-e259-4a53-85e4-45dc1dfec7d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:46.095826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5046c5e1-e259-4a53-85e4-45dc1dfec7d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:46.102589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5046c5e1-e259-4a53-85e4-45dc1dfec7d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:46.103125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5046c5e1-e259-4a53-85e4-45dc1dfec7d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:46.104765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-50443c3f-9433-4879-9447-6ef0e7bdfed2 req-71cdcf55-e890-475a-963e-a8b0bdab238c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db1b49d1-08d6-4cb1-a27d-63944f113ea7", "name": "network-vif-deleted", "tag": "53c39c27-8c25-458d-9dc7-1288b1c8ad16"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:46.149874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-50443c3f-9433-4879-9447-6ef0e7bdfed2 req-71cdcf55-e890-475a-963e-a8b0bdab238c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:46.150448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-50443c3f-9433-4879-9447-6ef0e7bdfed2 req-71cdcf55-e890-475a-963e-a8b0bdab238c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:46.153368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-50443c3f-9433-4879-9447-6ef0e7bdfed2 req-71cdcf55-e890-475a-963e-a8b0bdab238c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:46.190161 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-50443c3f-9433-4879-9447-6ef0e7bdfed2 req-71cdcf55-e890-475a-963e-a8b0bdab238c service nova] Creating event network-vif-deleted:53c39c27-8c25-458d-9dc7-1288b1c8ad16 for instance db1b49d1-08d6-4cb1-a27d-63944f113ea7 on n-h2-860864-2 Oct 10 23:20:46.205099 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-50443c3f-9433-4879-9447-6ef0e7bdfed2 req-71cdcf55-e890-475a-963e-a8b0bdab238c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119199 Oct 10 23:20:46.206065 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 588/1160] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:46.215664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-33235baa-e22b-4a1a-b0f9-a66051cc0cdb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:46.217029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-33235baa-e22b-4a1a-b0f9-a66051cc0cdb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: db1b49d1-08d6-4cb1-a27d-63944f113ea7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:46.237426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33235baa-e22b-4a1a-b0f9-a66051cc0cdb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:46.238252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33235baa-e22b-4a1a-b0f9-a66051cc0cdb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:46.239017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33235baa-e22b-4a1a-b0f9-a66051cc0cdb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:46.239893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33235baa-e22b-4a1a-b0f9-a66051cc0cdb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:46.240641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33235baa-e22b-4a1a-b0f9-a66051cc0cdb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:46.241848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33235baa-e22b-4a1a-b0f9-a66051cc0cdb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:46.295258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33235baa-e22b-4a1a-b0f9-a66051cc0cdb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:46.295957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33235baa-e22b-4a1a-b0f9-a66051cc0cdb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:46.296541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33235baa-e22b-4a1a-b0f9-a66051cc0cdb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:46.297178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-33235baa-e22b-4a1a-b0f9-a66051cc0cdb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lazy-loading 'fault' on Instance uuid db1b49d1-08d6-4cb1-a27d-63944f113ea7 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:20:46.373322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-33235baa-e22b-4a1a-b0f9-a66051cc0cdb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:46.384286 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-33235baa-e22b-4a1a-b0f9-a66051cc0cdb tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/db1b49d1-08d6-4cb1-a27d-63944f113ea7" status: 200 len: 1308 microversion: 2.1 time: 0.175754 Oct 10 23:20:46.385050 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 589/1161] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:46 2022] GET /compute/v2.1/servers/db1b49d1-08d6-4cb1-a27d-63944f113ea7 => generated 1308 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:46.604478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5046c5e1-e259-4a53-85e4-45dc1dfec7d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:46.623663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5046c5e1-e259-4a53-85e4-45dc1dfec7d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:46.625531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5046c5e1-e259-4a53-85e4-45dc1dfec7d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:46.628585 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5046c5e1-e259-4a53-85e4-45dc1dfec7d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1567 microversion: 2.25 time: 0.590513 Oct 10 23:20:46.632957 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 573/1162] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:46 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1567 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:46.892297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4628c9ac-7e44-4218-a2b0-3652e97873b0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:46.892914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4628c9ac-7e44-4218-a2b0-3652e97873b0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:46.905123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4628c9ac-7e44-4218-a2b0-3652e97873b0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:46.905902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4628c9ac-7e44-4218-a2b0-3652e97873b0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:46.917505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4628c9ac-7e44-4218-a2b0-3652e97873b0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:46.918430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4628c9ac-7e44-4218-a2b0-3652e97873b0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:46.918739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4628c9ac-7e44-4218-a2b0-3652e97873b0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:46.919697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4628c9ac-7e44-4218-a2b0-3652e97873b0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:47.062968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d42b9bff-a3d0-4eca-8ab6-8bd698dd720a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:47.063920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d42b9bff-a3d0-4eca-8ab6-8bd698dd720a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 4521fa13-07d6-4f81-9a92-64b6862a3bd3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:47.072585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d42b9bff-a3d0-4eca-8ab6-8bd698dd720a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:47.073416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d42b9bff-a3d0-4eca-8ab6-8bd698dd720a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:47.074083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d42b9bff-a3d0-4eca-8ab6-8bd698dd720a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:47.076809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d42b9bff-a3d0-4eca-8ab6-8bd698dd720a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:47.077588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d42b9bff-a3d0-4eca-8ab6-8bd698dd720a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:47.078217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d42b9bff-a3d0-4eca-8ab6-8bd698dd720a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:47.097564 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-d42b9bff-a3d0-4eca-8ab6-8bd698dd720a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] HTTP exception thrown: Instance 4521fa13-07d6-4f81-9a92-64b6862a3bd3 could not be found. Oct 10 23:20:47.099552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d42b9bff-a3d0-4eca-8ab6-8bd698dd720a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Request method failure captured: Oct 10 23:20:47.099552 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3 HTTP/1.1 Oct 10 23:20:47.099552 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:20:47.099552 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:20:47.099552 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:20:47.099552 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:20:47.099552 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:20:47.099552 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:20:47.099552 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:20:47.099552 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:47.099552 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKiAlVLEDIUo4Z4vpkSnaW_Ec9-QFQhvTEPmeVPuO5tzvRe8IKXj6O9WPze3enINXPkDbYXSZC-UH_ZWsolabXfE40ZbU-ispXAQCJOEOeZkq49812HaEAX7yfvRRFarvzY_3VWiyeMjy8pLo8a2jNK0yjroXtDpKeZVkrSeTr42CS4 Oct 10 23:20:47.099552 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:20:47.099552 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:20:47.099552 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:20:47.099552 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:20:47.099552 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:20:47.099552 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:20:47.099552 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: b891937a0ec146f88efac2b3d43f3e00 Oct 10 23:20:47.099552 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ListServerFiltersTestJSON-1138482225 Oct 10 23:20:47.099552 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:20:47.099552 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:20:47.100865 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b891937a0ec146f88efac2b3d43f3e00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b891937a0ec146f88efac2b3d43f3e00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b891937a0ec146f88efac2b3d43f3e00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b891937a0ec146f88efac2b3d43f3e00", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:47.100865 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ListServerFiltersTestJSON-1138482225 Oct 10 23:20:47.100865 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: b891937a0ec146f88efac2b3d43f3e00 Oct 10 23:20:47.100865 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1138482225 Oct 10 23:20:47.100865 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ListServerFiltersTestJSON-1138482225-project Oct 10 23:20:47.100865 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:20:47.100865 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:20:47.100865 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: cc50e8356193429f9e70f4c4be6d5fff Oct 10 23:20:47.100865 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ListServerFiltersTestJSON-1138482225-project Oct 10 23:20:47.100865 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:20:47.100865 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 4521fa13-07d6-4f81-9a92-64b6862a3bd3 could not be found. Oct 10 23:20:47.100865 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '4521fa13-07d6-4f81-9a92-64b6862a3bd3'} Oct 10 23:20:47.102087 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:47.102087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:47.102087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:47.102087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:47.102087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:20:47.102087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:20:47.102087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:20:47.102087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:20:47.102087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:20:47.102087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:20:47.102087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4521fa13-07d6-4f81-9a92-64b6862a3bd3 could not be found. Oct 10 23:20:47.102087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:47.102087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:47.102087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:47.102087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:47.102087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:47.102087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:47.102087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:47.102087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:47.102087 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:47.103298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:47.103298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:20:47.103298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:20:47.103298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:47.103298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:47.103298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:47.103298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:47.103298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4521fa13-07d6-4f81-9a92-64b6862a3bd3 could not be found. Oct 10 23:20:47.103298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:47.103298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:47.103298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:47.103298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:47.103298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:47.103298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:47.103298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:47.103298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:47.103298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4521fa13-07d6-4f81-9a92-64b6862a3bd3 could not be found. Oct 10 23:20:47.103298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:47.107953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d42b9bff-a3d0-4eca-8ab6-8bd698dd720a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Returning 404 to user: Instance 4521fa13-07d6-4f81-9a92-64b6862a3bd3 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:47.109129 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d42b9bff-a3d0-4eca-8ab6-8bd698dd720a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3" status: 404 len: 111 microversion: 2.1 time: 0.052379 Oct 10 23:20:47.113057 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 574/1163] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:47 2022] GET /compute/v2.1/servers/4521fa13-07d6-4f81-9a92-64b6862a3bd3 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:20:47.117526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=16 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:47.120191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-de98c96c-1bac-4042-8322-74b2f4be25f5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:47.123249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-de98c96c-1bac-4042-8322-74b2f4be25f5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:47.130122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de98c96c-1bac-4042-8322-74b2f4be25f5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:47.130928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de98c96c-1bac-4042-8322-74b2f4be25f5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:47.132028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de98c96c-1bac-4042-8322-74b2f4be25f5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:47.140493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de98c96c-1bac-4042-8322-74b2f4be25f5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:47.142127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de98c96c-1bac-4042-8322-74b2f4be25f5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:47.142654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de98c96c-1bac-4042-8322-74b2f4be25f5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:47.237745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4628c9ac-7e44-4218-a2b0-3652e97873b0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:47.246702 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4628c9ac-7e44-4218-a2b0-3652e97873b0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 200 len: 1573 microversion: 2.1 time: 0.359219 Oct 10 23:20:47.254008 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 590/1164] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:46 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 1573 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:47.271226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-15d5c694-5192-4178-a61a-9f49df769938 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:47.271788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-15d5c694-5192-4178-a61a-9f49df769938 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:47.293247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15d5c694-5192-4178-a61a-9f49df769938 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:47.295567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15d5c694-5192-4178-a61a-9f49df769938 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:47.297864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15d5c694-5192-4178-a61a-9f49df769938 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:47.300582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15d5c694-5192-4178-a61a-9f49df769938 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:47.304161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15d5c694-5192-4178-a61a-9f49df769938 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:47.304908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15d5c694-5192-4178-a61a-9f49df769938 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:47.363354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-15d5c694-5192-4178-a61a-9f49df769938 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:20:47.375285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-de98c96c-1bac-4042-8322-74b2f4be25f5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:47.388935 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-de98c96c-1bac-4042-8322-74b2f4be25f5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1378 microversion: 2.1 time: 0.273378 Oct 10 23:20:47.389828 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 575/1165] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:47 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1378 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:47.411300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-924824e6-52ee-43d8-b34b-57c58ae56191 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:47.412240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-924824e6-52ee-43d8-b34b-57c58ae56191 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: db1b49d1-08d6-4cb1-a27d-63944f113ea7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:47.418725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-924824e6-52ee-43d8-b34b-57c58ae56191 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:47.420528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-924824e6-52ee-43d8-b34b-57c58ae56191 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:47.421263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-924824e6-52ee-43d8-b34b-57c58ae56191 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:47.422120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-924824e6-52ee-43d8-b34b-57c58ae56191 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:47.422798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-924824e6-52ee-43d8-b34b-57c58ae56191 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:47.423440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-924824e6-52ee-43d8-b34b-57c58ae56191 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:47.443656 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-924824e6-52ee-43d8-b34b-57c58ae56191 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] HTTP exception thrown: Instance db1b49d1-08d6-4cb1-a27d-63944f113ea7 could not be found. Oct 10 23:20:47.445949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-924824e6-52ee-43d8-b34b-57c58ae56191 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Request method failure captured: Oct 10 23:20:47.445949 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/db1b49d1-08d6-4cb1-a27d-63944f113ea7 HTTP/1.1 Oct 10 23:20:47.445949 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:20:47.445949 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:20:47.445949 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:20:47.445949 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:20:47.445949 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:20:47.445949 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:20:47.445949 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:20:47.445949 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:47.445949 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKgJCGPRazsPZv_KJRTPkW4yfXkftWI99r6NM1NcPzbV6ezzFy8Kk0KC2fs-Oq1mdxcQ8vpiKa4rTjWrgHH8KDGbQArWJeSLbZnpz5njlegxl252rFp2J2t_YkO8EBZX2N9DD656V96Tu1xc3xvEKd_hjW4bndDcX9tluGi3sznnXco Oct 10 23:20:47.445949 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:20:47.445949 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:20:47.445949 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:20:47.445949 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:20:47.445949 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:20:47.445949 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:20:47.445949 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: d98b12fc1bbf42d4b7376222c55733ed Oct 10 23:20:47.445949 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:20:47.445949 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:20:47.445949 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:20:47.447369 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d98b12fc1bbf42d4b7376222c55733ed", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:47.447369 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:20:47.447369 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: d98b12fc1bbf42d4b7376222c55733ed Oct 10 23:20:47.447369 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:20:47.447369 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersOnMultiNodesTest-1123459593-project Oct 10 23:20:47.447369 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:20:47.447369 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:20:47.447369 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 310196e1663a4f7ca12e1fc53b0278ba Oct 10 23:20:47.447369 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersOnMultiNodesTest-1123459593-project Oct 10 23:20:47.447369 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:20:47.447369 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance db1b49d1-08d6-4cb1-a27d-63944f113ea7 could not be found. Oct 10 23:20:47.447369 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'db1b49d1-08d6-4cb1-a27d-63944f113ea7'} Oct 10 23:20:47.448141 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:47.448141 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:47.448141 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:47.448141 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:47.448141 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:20:47.448141 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:20:47.448141 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:20:47.448141 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:20:47.448141 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:20:47.448141 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:20:47.448141 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db1b49d1-08d6-4cb1-a27d-63944f113ea7 could not be found. Oct 10 23:20:47.448141 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:47.448141 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:47.448141 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:47.448141 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:47.448141 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:47.448141 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:47.448141 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:47.448141 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:47.448141 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:47.449366 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:47.449366 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:20:47.449366 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:20:47.449366 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:47.449366 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:47.449366 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:47.449366 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:47.449366 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db1b49d1-08d6-4cb1-a27d-63944f113ea7 could not be found. Oct 10 23:20:47.449366 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:47.449366 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:47.449366 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:47.449366 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:47.449366 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:47.449366 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:47.449366 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:47.449366 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:47.449366 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db1b49d1-08d6-4cb1-a27d-63944f113ea7 could not be found. Oct 10 23:20:47.449366 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:47.452464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-924824e6-52ee-43d8-b34b-57c58ae56191 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Returning 404 to user: Instance db1b49d1-08d6-4cb1-a27d-63944f113ea7 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:47.453786 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-924824e6-52ee-43d8-b34b-57c58ae56191 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/db1b49d1-08d6-4cb1-a27d-63944f113ea7" status: 404 len: 111 microversion: 2.1 time: 0.046472 Oct 10 23:20:47.455562 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 576/1166] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:47 2022] GET /compute/v2.1/servers/db1b49d1-08d6-4cb1-a27d-63944f113ea7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:47.487333 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-15d5c694-5192-4178-a61a-9f49df769938 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d" status: 204 len: 0 microversion: 2.1 time: 0.231665 Oct 10 23:20:47.488699 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 591/1167] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:20:47 2022] DELETE /compute/v2.1/servers/9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:20:47.489690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-03cc5641-1d8c-4740-88cd-2192a6256c80 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:47.490789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-03cc5641-1d8c-4740-88cd-2192a6256c80 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: bd8c16ec-655a-451f-959f-62685aedc8af] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:47.501894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-da3a10a2-c0d6-4b42-b5a1-09d3b2b8b333 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:47.504797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-da3a10a2-c0d6-4b42-b5a1-09d3b2b8b333 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:47.510814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03cc5641-1d8c-4740-88cd-2192a6256c80 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:47.512040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03cc5641-1d8c-4740-88cd-2192a6256c80 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:47.514952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03cc5641-1d8c-4740-88cd-2192a6256c80 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:47.517899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03cc5641-1d8c-4740-88cd-2192a6256c80 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:47.518601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03cc5641-1d8c-4740-88cd-2192a6256c80 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:47.519594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da3a10a2-c0d6-4b42-b5a1-09d3b2b8b333 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:47.520794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03cc5641-1d8c-4740-88cd-2192a6256c80 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:47.523845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da3a10a2-c0d6-4b42-b5a1-09d3b2b8b333 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:47.525194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da3a10a2-c0d6-4b42-b5a1-09d3b2b8b333 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:47.526148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da3a10a2-c0d6-4b42-b5a1-09d3b2b8b333 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:47.527596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da3a10a2-c0d6-4b42-b5a1-09d3b2b8b333 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:47.528750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da3a10a2-c0d6-4b42-b5a1-09d3b2b8b333 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:47.615968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-03cc5641-1d8c-4740-88cd-2192a6256c80 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:47.626489 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-03cc5641-1d8c-4740-88cd-2192a6256c80 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af" status: 200 len: 1431 microversion: 2.1 time: 0.147524 Oct 10 23:20:47.643700 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 577/1168] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:47 2022] GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af => generated 1431 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:47.665167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-01dfaa13-b456-453a-8a31-6ad90bb67734 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:47.665913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-01dfaa13-b456-453a-8a31-6ad90bb67734 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:47.673516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01dfaa13-b456-453a-8a31-6ad90bb67734 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:47.674111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01dfaa13-b456-453a-8a31-6ad90bb67734 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:47.675191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01dfaa13-b456-453a-8a31-6ad90bb67734 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:47.676118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01dfaa13-b456-453a-8a31-6ad90bb67734 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:47.676933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01dfaa13-b456-453a-8a31-6ad90bb67734 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:47.677479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01dfaa13-b456-453a-8a31-6ad90bb67734 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:47.829607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-da3a10a2-c0d6-4b42-b5a1-09d3b2b8b333 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:47.839449 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-da3a10a2-c0d6-4b42-b5a1-09d3b2b8b333 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d" status: 200 len: 1519 microversion: 2.1 time: 0.346475 Oct 10 23:20:47.853485 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 592/1169] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:47 2022] GET /compute/v2.1/servers/9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d => generated 1519 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:47.865100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-01dfaa13-b456-453a-8a31-6ad90bb67734 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:47.874049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-01dfaa13-b456-453a-8a31-6ad90bb67734 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:47.875748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-01dfaa13-b456-453a-8a31-6ad90bb67734 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:47.876924 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-01dfaa13-b456-453a-8a31-6ad90bb67734 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1567 microversion: 2.25 time: 0.216670 Oct 10 23:20:47.894139 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 578/1170] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:47 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:48.269657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-7a4b27c7-a1ff-483c-96d0-f3680f32abce req-91eed21d-16c0-45d3-bd2b-ad5450c2ad50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd8c16ec-655a-451f-959f-62685aedc8af", "name": "network-vif-deleted", "tag": "082006d4-7c9f-4c16-a8bc-d014162b5e63"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:48.271286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4d8db581-191a-4e9e-bbb8-4ae16a8a6754 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:48.271977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4d8db581-191a-4e9e-bbb8-4ae16a8a6754 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:48.281767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d8db581-191a-4e9e-bbb8-4ae16a8a6754 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:48.285944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d8db581-191a-4e9e-bbb8-4ae16a8a6754 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:48.286517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d8db581-191a-4e9e-bbb8-4ae16a8a6754 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:48.287832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d8db581-191a-4e9e-bbb8-4ae16a8a6754 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:48.289414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d8db581-191a-4e9e-bbb8-4ae16a8a6754 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:48.289543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7a4b27c7-a1ff-483c-96d0-f3680f32abce req-91eed21d-16c0-45d3-bd2b-ad5450c2ad50 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:48.293477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7a4b27c7-a1ff-483c-96d0-f3680f32abce req-91eed21d-16c0-45d3-bd2b-ad5450c2ad50 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:48.294182 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7a4b27c7-a1ff-483c-96d0-f3680f32abce req-91eed21d-16c0-45d3-bd2b-ad5450c2ad50 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:48.294844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d8db581-191a-4e9e-bbb8-4ae16a8a6754 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:48.328143 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-7a4b27c7-a1ff-483c-96d0-f3680f32abce req-91eed21d-16c0-45d3-bd2b-ad5450c2ad50 service nova] Creating event network-vif-deleted:082006d4-7c9f-4c16-a8bc-d014162b5e63 for instance bd8c16ec-655a-451f-959f-62685aedc8af on n-h1-860864-2 Oct 10 23:20:48.339888 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-7a4b27c7-a1ff-483c-96d0-f3680f32abce req-91eed21d-16c0-45d3-bd2b-ad5450c2ad50 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076329 Oct 10 23:20:48.345216 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 593/1171] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:48.629800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4d8db581-191a-4e9e-bbb8-4ae16a8a6754 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:48.638728 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4d8db581-191a-4e9e-bbb8-4ae16a8a6754 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 200 len: 1573 microversion: 2.1 time: 0.370570 Oct 10 23:20:48.643477 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 579/1172] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:48 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 1573 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:48.650588 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2bd3117f-03b9-4dd7-b9c9-de9376a39544 tempest-ListImagesTestJSON-114416084 tempest-ListImagesTestJSON-114416084-project] Calling method '.version_select at 0x7f662b764280>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:48.690762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-679dc3e2-894b-42ce-9967-e6f424590f31 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:48.692460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-679dc3e2-894b-42ce-9967-e6f424590f31 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:48.705315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-679dc3e2-894b-42ce-9967-e6f424590f31 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:48.705839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-679dc3e2-894b-42ce-9967-e6f424590f31 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:48.706276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-679dc3e2-894b-42ce-9967-e6f424590f31 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:48.706984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-679dc3e2-894b-42ce-9967-e6f424590f31 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:48.707487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-679dc3e2-894b-42ce-9967-e6f424590f31 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:48.707932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-679dc3e2-894b-42ce-9967-e6f424590f31 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:48.709330 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2bd3117f-03b9-4dd7-b9c9-de9376a39544 tempest-ListImagesTestJSON-114416084 tempest-ListImagesTestJSON-114416084-project] 10.222.0.23 "GET /compute/v2.1/images/70c986fa-2f30-4b1e-8ea0-fb6ffa975889" status: 200 len: 784 microversion: 2.1 time: 0.362099 Oct 10 23:20:48.717562 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 594/1173] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:20:48 2022] GET /compute/v2.1/images/70c986fa-2f30-4b1e-8ea0-fb6ffa975889 => generated 784 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:48.729735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d0342506-dfb5-4f72-af53-0a869d6762f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:48.730636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d0342506-dfb5-4f72-af53-0a869d6762f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: bd8c16ec-655a-451f-959f-62685aedc8af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:48.737595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0342506-dfb5-4f72-af53-0a869d6762f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:48.738090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0342506-dfb5-4f72-af53-0a869d6762f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:48.738529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0342506-dfb5-4f72-af53-0a869d6762f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:48.739237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0342506-dfb5-4f72-af53-0a869d6762f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:48.739685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0342506-dfb5-4f72-af53-0a869d6762f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:48.740144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0342506-dfb5-4f72-af53-0a869d6762f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:48.800010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0342506-dfb5-4f72-af53-0a869d6762f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:48.800878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0342506-dfb5-4f72-af53-0a869d6762f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:48.801647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0342506-dfb5-4f72-af53-0a869d6762f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:48.802766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-d0342506-dfb5-4f72-af53-0a869d6762f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lazy-loading 'fault' on Instance uuid bd8c16ec-655a-451f-959f-62685aedc8af {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:20:48.815482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:48.948856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d0342506-dfb5-4f72-af53-0a869d6762f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:48.956123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:48.965870 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d0342506-dfb5-4f72-af53-0a869d6762f3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af" status: 200 len: 1308 microversion: 2.1 time: 0.251895 Oct 10 23:20:48.967317 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 595/1174] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:48 2022] GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af => generated 1308 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:48.981223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b513b4b7-21c8-4a70-aeb2-f88a88c03ee5 tempest-ListImagesTestJSON-114416084 tempest-ListImagesTestJSON-114416084-project] Calling method '.version_select at 0x7f662b764310>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:49.058238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-679dc3e2-894b-42ce-9967-e6f424590f31 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:49.075081 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-679dc3e2-894b-42ce-9967-e6f424590f31 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1378 microversion: 2.1 time: 0.430133 Oct 10 23:20:49.090449 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 580/1175] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:48 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1378 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:49.103145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c3facb5b-1b07-41f2-9f8d-b4d009f5e545 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:49.104263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c3facb5b-1b07-41f2-9f8d-b4d009f5e545 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:49.116594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3facb5b-1b07-41f2-9f8d-b4d009f5e545 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:49.117096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3facb5b-1b07-41f2-9f8d-b4d009f5e545 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:49.117758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3facb5b-1b07-41f2-9f8d-b4d009f5e545 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:49.118658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3facb5b-1b07-41f2-9f8d-b4d009f5e545 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:49.119293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3facb5b-1b07-41f2-9f8d-b4d009f5e545 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:49.120226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3facb5b-1b07-41f2-9f8d-b4d009f5e545 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:49.120764 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b513b4b7-21c8-4a70-aeb2-f88a88c03ee5 tempest-ListImagesTestJSON-114416084 tempest-ListImagesTestJSON-114416084-project] 10.222.0.23 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.149933 Oct 10 23:20:49.121486 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 596/1176] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 10 23:20:48 2022] GET /compute/v2.1/images => generated 445 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:49.137143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a4e5fc09-6135-40d9-b67b-33bf6dc5b270 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:49.138718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a4e5fc09-6135-40d9-b67b-33bf6dc5b270 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:49.145916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4e5fc09-6135-40d9-b67b-33bf6dc5b270 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:49.146537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4e5fc09-6135-40d9-b67b-33bf6dc5b270 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:49.147111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4e5fc09-6135-40d9-b67b-33bf6dc5b270 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:49.148441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4e5fc09-6135-40d9-b67b-33bf6dc5b270 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:49.149017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4e5fc09-6135-40d9-b67b-33bf6dc5b270 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:49.149610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4e5fc09-6135-40d9-b67b-33bf6dc5b270 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:49.520675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c3facb5b-1b07-41f2-9f8d-b4d009f5e545 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:49.535203 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c3facb5b-1b07-41f2-9f8d-b4d009f5e545 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d" status: 200 len: 1519 microversion: 2.1 time: 0.443410 Oct 10 23:20:49.537516 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 581/1177] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:49 2022] GET /compute/v2.1/servers/9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d => generated 1519 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:49.546733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a2198e1a-0885-4dd3-bd04-656b7af6df65 tempest-ListImagesTestJSON-114416084 tempest-ListImagesTestJSON-114416084-project] Calling method '.version_select at 0x7f662baa7af0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:49.596099 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a2198e1a-0885-4dd3-bd04-656b7af6df65 tempest-ListImagesTestJSON-114416084 tempest-ListImagesTestJSON-114416084-project] 10.222.0.23 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.053414 Oct 10 23:20:49.596693 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 582/1178] 10.222.0.23 () {58 vars in 1143 bytes} [Mon Oct 10 23:20:49 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:49.635754 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a4e5fc09-6135-40d9-b67b-33bf6dc5b270 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:49.646005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a4e5fc09-6135-40d9-b67b-33bf6dc5b270 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:49.647781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a4e5fc09-6135-40d9-b67b-33bf6dc5b270 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:49.649142 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a4e5fc09-6135-40d9-b67b-33bf6dc5b270 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1567 microversion: 2.25 time: 0.517167 Oct 10 23:20:49.650259 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 597/1179] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:49 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1567 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:49.675276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d4198265-12c0-4fc5-9f36-639283a2da94 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:49.676102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d4198265-12c0-4fc5-9f36-639283a2da94 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:49.684165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4198265-12c0-4fc5-9f36-639283a2da94 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:49.685586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4198265-12c0-4fc5-9f36-639283a2da94 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:49.686405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4198265-12c0-4fc5-9f36-639283a2da94 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:49.687278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4198265-12c0-4fc5-9f36-639283a2da94 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:49.688406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4198265-12c0-4fc5-9f36-639283a2da94 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:49.689014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4198265-12c0-4fc5-9f36-639283a2da94 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:49.933414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-990737ef-04df-4adb-b766-61d336e19af8 req-52d5d945-5484-4e73-a4d5-e04a7ab6ed84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d", "name": "network-vif-unplugged", "status": "completed", "tag": "9aeedf20-d5e5-4fe0-87b9-2bdfe5ba2dbc"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:49.944901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-990737ef-04df-4adb-b766-61d336e19af8 req-52d5d945-5484-4e73-a4d5-e04a7ab6ed84 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:49.945441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-990737ef-04df-4adb-b766-61d336e19af8 req-52d5d945-5484-4e73-a4d5-e04a7ab6ed84 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:49.946000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-990737ef-04df-4adb-b766-61d336e19af8 req-52d5d945-5484-4e73-a4d5-e04a7ab6ed84 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:49.970727 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-990737ef-04df-4adb-b766-61d336e19af8 req-52d5d945-5484-4e73-a4d5-e04a7ab6ed84 service nova] Creating event network-vif-unplugged:9aeedf20-d5e5-4fe0-87b9-2bdfe5ba2dbc for instance 9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d on n-h2-860864-2 Oct 10 23:20:49.985698 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-990737ef-04df-4adb-b766-61d336e19af8 req-52d5d945-5484-4e73-a4d5-e04a7ab6ed84 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053319 Oct 10 23:20:49.987504 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 598/1180] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:49.998667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-48897cbc-4078-4f84-b733-40ca9a0528a8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:49.999397 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-48897cbc-4078-4f84-b733-40ca9a0528a8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: bd8c16ec-655a-451f-959f-62685aedc8af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:50.015527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48897cbc-4078-4f84-b733-40ca9a0528a8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:50.018207 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48897cbc-4078-4f84-b733-40ca9a0528a8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:50.018678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48897cbc-4078-4f84-b733-40ca9a0528a8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:50.019415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48897cbc-4078-4f84-b733-40ca9a0528a8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:50.019881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48897cbc-4078-4f84-b733-40ca9a0528a8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:50.022415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48897cbc-4078-4f84-b733-40ca9a0528a8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:50.046086 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-48897cbc-4078-4f84-b733-40ca9a0528a8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] HTTP exception thrown: Instance bd8c16ec-655a-451f-959f-62685aedc8af could not be found. Oct 10 23:20:50.055741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-48897cbc-4078-4f84-b733-40ca9a0528a8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Request method failure captured: Oct 10 23:20:50.055741 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af HTTP/1.1 Oct 10 23:20:50.055741 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:20:50.055741 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:20:50.055741 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:20:50.055741 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:20:50.055741 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:20:50.055741 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:20:50.055741 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:20:50.055741 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:50.055741 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgJCGPRazsPZv_KJRTPkW4yfXkftWI99r6NM1NcPzbV6ezzFy8Kk0KC2fs-Oq1mdxcQ8vpiKa4rTjWrgHH8KDGbQArWJeSLbZnpz5njlegxl252rFp2J2t_YkO8EBZX2N9DD656V96Tu1xc3xvEKd_hjW4bndDcX9tluGi3sznnXco Oct 10 23:20:50.055741 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:20:50.055741 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:20:50.055741 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:20:50.055741 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:20:50.055741 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:20:50.055741 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:20:50.055741 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: d98b12fc1bbf42d4b7376222c55733ed Oct 10 23:20:50.055741 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:20:50.055741 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:20:50.055741 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:20:50.057184 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d98b12fc1bbf42d4b7376222c55733ed", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:50.057184 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:20:50.057184 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: d98b12fc1bbf42d4b7376222c55733ed Oct 10 23:20:50.057184 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:20:50.057184 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersOnMultiNodesTest-1123459593-project Oct 10 23:20:50.057184 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:20:50.057184 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:20:50.057184 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 310196e1663a4f7ca12e1fc53b0278ba Oct 10 23:20:50.057184 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersOnMultiNodesTest-1123459593-project Oct 10 23:20:50.057184 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:20:50.057184 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance bd8c16ec-655a-451f-959f-62685aedc8af could not be found. Oct 10 23:20:50.057184 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'bd8c16ec-655a-451f-959f-62685aedc8af'} Oct 10 23:20:50.057970 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:50.057970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:50.057970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:50.057970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:50.057970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:20:50.057970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:20:50.057970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:20:50.057970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:20:50.057970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:20:50.057970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:20:50.057970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd8c16ec-655a-451f-959f-62685aedc8af could not be found. Oct 10 23:20:50.057970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:50.057970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:50.057970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:50.057970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:50.057970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:50.057970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:50.057970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:50.057970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:50.057970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:50.059288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:50.059288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:20:50.059288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:20:50.059288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:50.059288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:50.059288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:50.059288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:50.059288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd8c16ec-655a-451f-959f-62685aedc8af could not be found. Oct 10 23:20:50.059288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:50.059288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:50.059288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:50.059288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:50.059288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:50.059288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:50.059288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:50.059288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:50.059288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd8c16ec-655a-451f-959f-62685aedc8af could not be found. Oct 10 23:20:50.059288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:50.060548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-48897cbc-4078-4f84-b733-40ca9a0528a8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Returning 404 to user: Instance bd8c16ec-655a-451f-959f-62685aedc8af could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:50.060548 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-48897cbc-4078-4f84-b733-40ca9a0528a8 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af" status: 404 len: 111 microversion: 2.1 time: 0.068397 Oct 10 23:20:50.060548 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 599/1181] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:49 2022] GET /compute/v2.1/servers/bd8c16ec-655a-451f-959f-62685aedc8af => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:20:50.073187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d18bb1b5-6fa9-4bbb-a982-bf2c450e8bf1 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:50.074300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d4198265-12c0-4fc5-9f36-639283a2da94 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:50.086552 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d4198265-12c0-4fc5-9f36-639283a2da94 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 200 len: 1571 microversion: 2.1 time: 0.416095 Oct 10 23:20:50.088005 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 583/1182] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:49 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 1571 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:50.111225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-facd7fbc-cb70-4180-b28e-fd336289b108 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:50.112211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-facd7fbc-cb70-4180-b28e-fd336289b108 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:50.114787 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d18bb1b5-6fa9-4bbb-a982-bf2c450e8bf1 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/e5c534fa-95d5-4180-8bf7-c27512418476" status: 204 len: 0 microversion: 2.1 time: 0.049030 Oct 10 23:20:50.116187 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 600/1183] 10.222.0.23 () {58 vars in 1266 bytes} [Mon Oct 10 23:20:50 2022] DELETE /compute/v2.1/os-server-groups/e5c534fa-95d5-4180-8bf7-c27512418476 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:20:50.126082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c1c4b3eb-99df-41bc-aff5-ef83e704efe7 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1422107415"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:50.126892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c1c4b3eb-99df-41bc-aff5-ef83e704efe7 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:50.134966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1c4b3eb-99df-41bc-aff5-ef83e704efe7 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:50.135999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-facd7fbc-cb70-4180-b28e-fd336289b108 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:50.136363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1c4b3eb-99df-41bc-aff5-ef83e704efe7 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:50.136526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-facd7fbc-cb70-4180-b28e-fd336289b108 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:50.136944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-facd7fbc-cb70-4180-b28e-fd336289b108 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:50.137301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1c4b3eb-99df-41bc-aff5-ef83e704efe7 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:50.140337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-facd7fbc-cb70-4180-b28e-fd336289b108 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:50.140689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1c4b3eb-99df-41bc-aff5-ef83e704efe7 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:50.140893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-facd7fbc-cb70-4180-b28e-fd336289b108 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:50.142593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1c4b3eb-99df-41bc-aff5-ef83e704efe7 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:50.143640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1c4b3eb-99df-41bc-aff5-ef83e704efe7 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:50.146201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-facd7fbc-cb70-4180-b28e-fd336289b108 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:50.408738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-facd7fbc-cb70-4180-b28e-fd336289b108 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:50.429351 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-facd7fbc-cb70-4180-b28e-fd336289b108 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1378 microversion: 2.1 time: 0.330831 Oct 10 23:20:50.430675 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 584/1184] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:50 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1378 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:50.438229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a39d58c1-b74a-4c3b-a44a-cfefda244fa3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:50.438772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a39d58c1-b74a-4c3b-a44a-cfefda244fa3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 7907c918-8df3-44bc-94f5-4fde965de66f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:50.445628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a39d58c1-b74a-4c3b-a44a-cfefda244fa3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:50.446405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a39d58c1-b74a-4c3b-a44a-cfefda244fa3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:50.447055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a39d58c1-b74a-4c3b-a44a-cfefda244fa3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:50.448001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a39d58c1-b74a-4c3b-a44a-cfefda244fa3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:50.448614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a39d58c1-b74a-4c3b-a44a-cfefda244fa3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:50.449209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a39d58c1-b74a-4c3b-a44a-cfefda244fa3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:50.490022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a39d58c1-b74a-4c3b-a44a-cfefda244fa3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 7907c918-8df3-44bc-94f5-4fde965de66f] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:20:50.668145 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a39d58c1-b74a-4c3b-a44a-cfefda244fa3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7907c918-8df3-44bc-94f5-4fde965de66f" status: 204 len: 0 microversion: 2.1 time: 0.235858 Oct 10 23:20:50.669802 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 585/1185] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:20:50 2022] DELETE /compute/v2.1/servers/7907c918-8df3-44bc-94f5-4fde965de66f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:20:50.677519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-60964c27-8578-4ab2-9fd4-18bc8bbd352d tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:50.678978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-60964c27-8578-4ab2-9fd4-18bc8bbd352d tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:50.687393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60964c27-8578-4ab2-9fd4-18bc8bbd352d tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:50.687982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60964c27-8578-4ab2-9fd4-18bc8bbd352d tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:50.688513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60964c27-8578-4ab2-9fd4-18bc8bbd352d tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:50.689454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60964c27-8578-4ab2-9fd4-18bc8bbd352d tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:50.690301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60964c27-8578-4ab2-9fd4-18bc8bbd352d tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:50.690928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60964c27-8578-4ab2-9fd4-18bc8bbd352d tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:50.941578 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.network.security_group_api [None req-c1c4b3eb-99df-41bc-aff5-ef83e704efe7 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Adding security group 25f1402f-1fb7-4e2d-a72f-da95199566c2 to port f65ed136-fdf8-4735-a0b9-6e6d462b75e1 Oct 10 23:20:50.972099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-60964c27-8578-4ab2-9fd4-18bc8bbd352d tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:50.982304 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-60964c27-8578-4ab2-9fd4-18bc8bbd352d tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d" status: 200 len: 1519 microversion: 2.1 time: 0.310989 Oct 10 23:20:50.982897 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 586/1186] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:50 2022] GET /compute/v2.1/servers/9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d => generated 1519 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:50.990984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f39c08bb-94a3-4108-b889-b4ea91818cf5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:50.991485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f39c08bb-94a3-4108-b889-b4ea91818cf5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: c783f55d-ea82-4d94-a4f6-77591d412a02] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:51.005341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f39c08bb-94a3-4108-b889-b4ea91818cf5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:51.008018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f39c08bb-94a3-4108-b889-b4ea91818cf5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:51.011399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f39c08bb-94a3-4108-b889-b4ea91818cf5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:51.012336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f39c08bb-94a3-4108-b889-b4ea91818cf5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:51.013178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f39c08bb-94a3-4108-b889-b4ea91818cf5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:51.013830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f39c08bb-94a3-4108-b889-b4ea91818cf5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:51.018702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:51.080483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f39c08bb-94a3-4108-b889-b4ea91818cf5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: c783f55d-ea82-4d94-a4f6-77591d412a02] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:20:51.252543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:51.276969 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f39c08bb-94a3-4108-b889-b4ea91818cf5 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02" status: 204 len: 0 microversion: 2.1 time: 0.289125 Oct 10 23:20:51.281613 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 587/1187] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:20:50 2022] DELETE /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:20:51.295904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9ed01ee1-e11d-4488-bcea-897ec9e24dec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:51.299073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9ed01ee1-e11d-4488-bcea-897ec9e24dec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:51.308101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ed01ee1-e11d-4488-bcea-897ec9e24dec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:51.308675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ed01ee1-e11d-4488-bcea-897ec9e24dec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:51.309122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ed01ee1-e11d-4488-bcea-897ec9e24dec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:51.310409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ed01ee1-e11d-4488-bcea-897ec9e24dec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:51.311532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ed01ee1-e11d-4488-bcea-897ec9e24dec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:51.311776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ed01ee1-e11d-4488-bcea-897ec9e24dec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:51.558880 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c1c4b3eb-99df-41bc-aff5-ef83e704efe7 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "POST /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b/action" status: 202 len: 0 microversion: 2.1 time: 1.440555 Oct 10 23:20:51.559500 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 601/1188] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:20:50 2022] POST /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b/action => generated 0 bytes in 1443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:20:51.567066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-8dc1a58a-2606-4396-bee5-aaff1cd3a32e req-dff9d240-456f-41eb-a880-01e164f121bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d", "name": "network-vif-deleted", "tag": "9aeedf20-d5e5-4fe0-87b9-2bdfe5ba2dbc"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:51.589698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8dc1a58a-2606-4396-bee5-aaff1cd3a32e req-dff9d240-456f-41eb-a880-01e164f121bb service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:51.590238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8dc1a58a-2606-4396-bee5-aaff1cd3a32e req-dff9d240-456f-41eb-a880-01e164f121bb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:51.590685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8dc1a58a-2606-4396-bee5-aaff1cd3a32e req-dff9d240-456f-41eb-a880-01e164f121bb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:51.621337 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-8dc1a58a-2606-4396-bee5-aaff1cd3a32e req-dff9d240-456f-41eb-a880-01e164f121bb service nova] Creating event network-vif-deleted:9aeedf20-d5e5-4fe0-87b9-2bdfe5ba2dbc for instance 9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d on n-h2-860864-2 Oct 10 23:20:51.634794 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-8dc1a58a-2606-4396-bee5-aaff1cd3a32e req-dff9d240-456f-41eb-a880-01e164f121bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073955 Oct 10 23:20:51.635756 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 602/1189] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:51.646094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f2add4b2-3670-46dc-b314-d7ef45b32a68 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:51.646811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f2add4b2-3670-46dc-b314-d7ef45b32a68 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 7907c918-8df3-44bc-94f5-4fde965de66f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:51.666694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2add4b2-3670-46dc-b314-d7ef45b32a68 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:51.670534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2add4b2-3670-46dc-b314-d7ef45b32a68 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:51.671457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2add4b2-3670-46dc-b314-d7ef45b32a68 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:51.672755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2add4b2-3670-46dc-b314-d7ef45b32a68 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:51.673505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2add4b2-3670-46dc-b314-d7ef45b32a68 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:51.674099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2add4b2-3670-46dc-b314-d7ef45b32a68 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:51.676035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9ed01ee1-e11d-4488-bcea-897ec9e24dec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:51.687059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9ed01ee1-e11d-4488-bcea-897ec9e24dec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:51.691692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9ed01ee1-e11d-4488-bcea-897ec9e24dec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:51.693326 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9ed01ee1-e11d-4488-bcea-897ec9e24dec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1567 microversion: 2.25 time: 0.411968 Oct 10 23:20:51.719272 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 588/1190] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:51 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1567 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:51.729067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3e639cdd-9732-45ed-b173-cea967922982 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:51.734254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3e639cdd-9732-45ed-b173-cea967922982 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:51.759779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e639cdd-9732-45ed-b173-cea967922982 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:51.760267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e639cdd-9732-45ed-b173-cea967922982 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:51.760726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e639cdd-9732-45ed-b173-cea967922982 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:51.762079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e639cdd-9732-45ed-b173-cea967922982 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:51.762537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e639cdd-9732-45ed-b173-cea967922982 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:51.768655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e639cdd-9732-45ed-b173-cea967922982 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:51.940925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f2add4b2-3670-46dc-b314-d7ef45b32a68 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:51.955114 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f2add4b2-3670-46dc-b314-d7ef45b32a68 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/7907c918-8df3-44bc-94f5-4fde965de66f" status: 200 len: 1475 microversion: 2.1 time: 0.316172 Oct 10 23:20:51.956934 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 603/1191] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:51 2022] GET /compute/v2.1/servers/7907c918-8df3-44bc-94f5-4fde965de66f => generated 1475 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:51.962013 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fc63495d-3086-4d0d-9d11-71684882a76f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662b39ea60>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:52.024570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3e639cdd-9732-45ed-b173-cea967922982 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:52.038851 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3e639cdd-9732-45ed-b173-cea967922982 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1378 microversion: 2.1 time: 0.318253 Oct 10 23:20:52.055325 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 589/1192] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:51 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1378 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:52.067201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ae0448eb-2a1b-43e4-b19c-c596988f34bc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:52.067840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ae0448eb-2a1b-43e4-b19c-c596988f34bc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:52.077454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae0448eb-2a1b-43e4-b19c-c596988f34bc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:52.078655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae0448eb-2a1b-43e4-b19c-c596988f34bc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:52.079194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae0448eb-2a1b-43e4-b19c-c596988f34bc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:52.080777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae0448eb-2a1b-43e4-b19c-c596988f34bc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:52.081415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae0448eb-2a1b-43e4-b19c-c596988f34bc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:52.081955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae0448eb-2a1b-43e4-b19c-c596988f34bc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:52.100266 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-ae0448eb-2a1b-43e4-b19c-c596988f34bc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] HTTP exception thrown: Instance 9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d could not be found. Oct 10 23:20:52.102571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ae0448eb-2a1b-43e4-b19c-c596988f34bc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Request method failure captured: Oct 10 23:20:52.102571 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d HTTP/1.1 Oct 10 23:20:52.102571 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:20:52.102571 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:20:52.102571 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:20:52.102571 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:20:52.102571 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:20:52.102571 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:20:52.102571 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:20:52.102571 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:52.102571 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKiAlVLEDIUo4Z4vpkSnaW_Ec9-QFQhvTEPmeVPuO5tzvRe8IKXj6O9WPze3enINXPkDbYXSZC-UH_ZWsolabXfE40ZbU-ispXAQCJOEOeZkq49812HaEAX7yfvRRFarvzY_3VWiyeMjy8pLo8a2jNK0yjroXtDpKeZVkrSeTr42CS4 Oct 10 23:20:52.102571 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:20:52.102571 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:20:52.102571 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:20:52.102571 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:20:52.102571 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:20:52.102571 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:20:52.102571 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: b891937a0ec146f88efac2b3d43f3e00 Oct 10 23:20:52.102571 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ListServerFiltersTestJSON-1138482225 Oct 10 23:20:52.102571 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:20:52.102571 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:20:52.104020 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b891937a0ec146f88efac2b3d43f3e00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b891937a0ec146f88efac2b3d43f3e00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b891937a0ec146f88efac2b3d43f3e00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b891937a0ec146f88efac2b3d43f3e00", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:52.104020 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ListServerFiltersTestJSON-1138482225 Oct 10 23:20:52.104020 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: b891937a0ec146f88efac2b3d43f3e00 Oct 10 23:20:52.104020 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1138482225 Oct 10 23:20:52.104020 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ListServerFiltersTestJSON-1138482225-project Oct 10 23:20:52.104020 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:20:52.104020 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:20:52.104020 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: cc50e8356193429f9e70f4c4be6d5fff Oct 10 23:20:52.104020 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ListServerFiltersTestJSON-1138482225-project Oct 10 23:20:52.104020 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:20:52.104020 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d could not be found. Oct 10 23:20:52.104020 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d'} Oct 10 23:20:52.104768 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:52.104768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:52.104768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:52.104768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:52.104768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:20:52.104768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:20:52.104768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:20:52.104768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:20:52.104768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:20:52.104768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:20:52.104768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d could not be found. Oct 10 23:20:52.104768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:52.104768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:52.104768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:52.104768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:52.104768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:52.104768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:52.104768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:52.104768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:52.104768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:52.106095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:52.106095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:20:52.106095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:20:52.106095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:52.106095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:52.106095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:52.106095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:52.106095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d could not be found. Oct 10 23:20:52.106095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:52.106095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:52.106095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:52.106095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:52.106095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:52.106095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:52.106095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:52.106095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:52.106095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d could not be found. Oct 10 23:20:52.106095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:52.110515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ae0448eb-2a1b-43e4-b19c-c596988f34bc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Returning 404 to user: Instance 9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:52.110515 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ae0448eb-2a1b-43e4-b19c-c596988f34bc tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d" status: 404 len: 111 microversion: 2.1 time: 0.046772 Oct 10 23:20:52.110515 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 590/1193] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:52 2022] GET /compute/v2.1/servers/9e9a2db7-796f-4ae7-ad9e-b8fde0b8b22d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:52.114430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2abd3079-be6c-42fd-8210-0ce66cd55191 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:52.114974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2abd3079-be6c-42fd-8210-0ce66cd55191 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:52.123243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2abd3079-be6c-42fd-8210-0ce66cd55191 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:52.123788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2abd3079-be6c-42fd-8210-0ce66cd55191 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:52.124401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2abd3079-be6c-42fd-8210-0ce66cd55191 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:52.125520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2abd3079-be6c-42fd-8210-0ce66cd55191 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:52.125990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2abd3079-be6c-42fd-8210-0ce66cd55191 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:52.126427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2abd3079-be6c-42fd-8210-0ce66cd55191 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:52.153267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG neutronclient.v2_0.client [None req-fc63495d-3086-4d0d-9d11-71684882a76f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 25f1402f-1fb7-4e2d-a72f-da95199566c2 in use.", "detail": ""}} {{(pid=120614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:20:52.154346 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-fc63495d-3086-4d0d-9d11-71684882a76f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] HTTP exception thrown: Security Group 25f1402f-1fb7-4e2d-a72f-da95199566c2 in use. Oct 10 23:20:52.154346 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-99c90a23-08ef-4cb1-a57c-5debf26091bd'] Oct 10 23:20:52.156918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fc63495d-3086-4d0d-9d11-71684882a76f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Request method failure captured: Oct 10 23:20:52.156918 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/os-security-groups/25f1402f-1fb7-4e2d-a72f-da95199566c2 HTTP/1.1 Oct 10 23:20:52.156918 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:20:52.156918 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:20:52.156918 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:20:52.156918 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:20:52.156918 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:20:52.156918 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:20:52.156918 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:20:52.156918 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:52.156918 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKiWDPhHeP1ao6Y5tHRbKvX9ZemW6vlLJ_C_MrPyGjEC179XpXPzYIbuoXBVNF4FDH7pzl8bOhuSRj1e7-5DcugU6k1KiwPFd9Qs6t3kjUe9RfKY0BXqex3wdvC4HjG24zVF2_841auDxOTWHziJVDjurPxpFpMsEGjqqP8S2TuKi34 Oct 10 23:20:52.156918 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:20:52.156918 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:20:52.156918 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:20:52.156918 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:20:52.156918 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:20:52.156918 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:20:52.156918 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:20:52.156918 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:20:52.156918 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:20:52.156918 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:20:52.158608 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_56fc65084a2a46689aa3b221e6d7aeb8", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:52.158608 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:20:52.158608 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:20:52.158608 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:20:52.158608 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:20:52.158608 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:20:52.158608 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:20:52.158608 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 9dfa7f1be9884bb1aabc9df8702fa630 Oct 10 23:20:52.158608 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:20:52.158608 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:20:52.158608 n-d-860864-2 devstack@n-api.service[120614]: exception: Security Group 25f1402f-1fb7-4e2d-a72f-da95199566c2 in use. Oct 10 23:20:52.158608 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-99c90a23-08ef-4cb1-a57c-5debf26091bd'] Oct 10 23:20:52.158608 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '25f1402f-1fb7-4e2d-a72f-da95199566c2'} Oct 10 23:20:52.159588 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:52.159588 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:52.159588 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 10 23:20:52.159588 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 10 23:20:52.159588 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:52.159588 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:52.159588 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 10 23:20:52.159588 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 10 23:20:52.159588 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:52.159588 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:52.159588 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 10 23:20:52.159588 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 10 23:20:52.159588 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:52.159588 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:52.159588 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:20:52.159588 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:20:52.159588 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:52.159588 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:52.159588 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:20:52.160987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:20:52.160987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:20:52.160987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:20:52.160987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:20:52.160987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:20:52.160987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:20:52.160987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:20:52.160987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 25f1402f-1fb7-4e2d-a72f-da95199566c2 in use. Oct 10 23:20:52.160987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99c90a23-08ef-4cb1-a57c-5debf26091bd'] Oct 10 23:20:52.160987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:52.160987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:52.160987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:52.160987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:52.160987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 10 23:20:52.160987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 10 23:20:52.160987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 10 23:20:52.160987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 10 23:20:52.160987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 25f1402f-1fb7-4e2d-a72f-da95199566c2 in use. Oct 10 23:20:52.160987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99c90a23-08ef-4cb1-a57c-5debf26091bd'] Oct 10 23:20:52.162415 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:52.162415 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:52.162415 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:52.162415 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:52.162415 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:52.162415 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:52.162415 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:52.162415 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:52.162415 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:20:52.162415 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:20:52.162415 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:52.162415 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:52.162415 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 10 23:20:52.162415 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 23:20:52.162415 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 25f1402f-1fb7-4e2d-a72f-da95199566c2 in use. Oct 10 23:20:52.162415 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99c90a23-08ef-4cb1-a57c-5debf26091bd'] Oct 10 23:20:52.162415 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:52.162415 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:52.162415 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:52.162415 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:52.162415 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:52.163961 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:52.163961 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:52.163961 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:52.163961 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 25f1402f-1fb7-4e2d-a72f-da95199566c2 in use. Oct 10 23:20:52.163961 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99c90a23-08ef-4cb1-a57c-5debf26091bd'] Oct 10 23:20:52.163961 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:52.170191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fc63495d-3086-4d0d-9d11-71684882a76f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Returning 400 to user: Security Group 25f1402f-1fb7-4e2d-a72f-da95199566c2 in use. Oct 10 23:20:52.170191 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-99c90a23-08ef-4cb1-a57c-5debf26091bd'] {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:52.170191 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fc63495d-3086-4d0d-9d11-71684882a76f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/25f1402f-1fb7-4e2d-a72f-da95199566c2" status: 400 len: 185 microversion: 2.1 time: 0.207756 Oct 10 23:20:52.170885 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 604/1194] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:20:51 2022] DELETE /compute/v2.1/os-security-groups/25f1402f-1fb7-4e2d-a72f-da95199566c2 => generated 185 bytes in 213 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:20:52.171536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2abd3079-be6c-42fd-8210-0ce66cd55191 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:20:52.176747 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4b7a77dd-3464-4ad3-8b3e-0edc9464a297 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:52.177717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4b7a77dd-3464-4ad3-8b3e-0edc9464a297 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:52.185672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b7a77dd-3464-4ad3-8b3e-0edc9464a297 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:52.186366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b7a77dd-3464-4ad3-8b3e-0edc9464a297 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:52.187149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b7a77dd-3464-4ad3-8b3e-0edc9464a297 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:52.188007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b7a77dd-3464-4ad3-8b3e-0edc9464a297 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:52.188763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b7a77dd-3464-4ad3-8b3e-0edc9464a297 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:52.189196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b7a77dd-3464-4ad3-8b3e-0edc9464a297 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:52.219906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4b7a77dd-3464-4ad3-8b3e-0edc9464a297 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:20:52.302400 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2abd3079-be6c-42fd-8210-0ce66cd55191 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 204 len: 0 microversion: 2.1 time: 0.189540 Oct 10 23:20:52.303334 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 591/1195] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:20:52 2022] DELETE /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 23:20:52.313789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a5647df8-f08e-4bee-a136-87ef66f40668 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:52.317237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a5647df8-f08e-4bee-a136-87ef66f40668 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:52.340944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5647df8-f08e-4bee-a136-87ef66f40668 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:52.342725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5647df8-f08e-4bee-a136-87ef66f40668 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:52.343774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5647df8-f08e-4bee-a136-87ef66f40668 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:52.344997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5647df8-f08e-4bee-a136-87ef66f40668 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:52.348041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5647df8-f08e-4bee-a136-87ef66f40668 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:52.348920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5647df8-f08e-4bee-a136-87ef66f40668 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:52.353570 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4b7a77dd-3464-4ad3-8b3e-0edc9464a297 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 204 len: 0 microversion: 2.1 time: 0.180378 Oct 10 23:20:52.358610 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 605/1196] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:20:52 2022] DELETE /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:20:52.366941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7a6415ac-756a-4988-b142-71ff9ddbced1 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:52.367931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7a6415ac-756a-4988-b142-71ff9ddbced1 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:52.376951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a6415ac-756a-4988-b142-71ff9ddbced1 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:52.381169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a6415ac-756a-4988-b142-71ff9ddbced1 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:52.382015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a6415ac-756a-4988-b142-71ff9ddbced1 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:52.383074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a6415ac-756a-4988-b142-71ff9ddbced1 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:52.383790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a6415ac-756a-4988-b142-71ff9ddbced1 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:52.384576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a6415ac-756a-4988-b142-71ff9ddbced1 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:52.570291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a5647df8-f08e-4bee-a136-87ef66f40668 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:52.581955 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a5647df8-f08e-4bee-a136-87ef66f40668 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1518 microversion: 2.1 time: 0.271588 Oct 10 23:20:52.582955 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 592/1197] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:52 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1518 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:52.672521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7a6415ac-756a-4988-b142-71ff9ddbced1 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:52.682215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-411b3a66-5e21-450f-b27d-251115ef879f req-41cfa36d-2d0f-4299-8712-16713261bee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c528ef78-5144-437a-83e3-38376725259a", "name": "network-vif-plugged", "status": "completed", "tag": "caf7c02f-0516-49b4-a4e1-4d9d62869316"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:52.682610 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7a6415ac-756a-4988-b142-71ff9ddbced1 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 200 len: 1646 microversion: 2.1 time: 0.321413 Oct 10 23:20:52.683667 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 606/1198] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:52 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 1646 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:52.701015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-411b3a66-5e21-450f-b27d-251115ef879f req-41cfa36d-2d0f-4299-8712-16713261bee7 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:52.703091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-411b3a66-5e21-450f-b27d-251115ef879f req-41cfa36d-2d0f-4299-8712-16713261bee7 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:52.707137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-411b3a66-5e21-450f-b27d-251115ef879f req-41cfa36d-2d0f-4299-8712-16713261bee7 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:52.725880 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-411b3a66-5e21-450f-b27d-251115ef879f req-41cfa36d-2d0f-4299-8712-16713261bee7 service nova] Creating event network-vif-plugged:caf7c02f-0516-49b4-a4e1-4d9d62869316 for instance c528ef78-5144-437a-83e3-38376725259a on n-h1-860864-2 Oct 10 23:20:52.735987 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-411b3a66-5e21-450f-b27d-251115ef879f req-41cfa36d-2d0f-4299-8712-16713261bee7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057567 Oct 10 23:20:52.736426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e62c989a-a667-46f6-a5d8-deb1b873a863 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:52.737357 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 593/1199] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:20:52.739344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e62c989a-a667-46f6-a5d8-deb1b873a863 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:52.747747 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e62c989a-a667-46f6-a5d8-deb1b873a863 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:52.748450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e62c989a-a667-46f6-a5d8-deb1b873a863 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:52.749578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e62c989a-a667-46f6-a5d8-deb1b873a863 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:52.750383 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e62c989a-a667-46f6-a5d8-deb1b873a863 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:52.751935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e62c989a-a667-46f6-a5d8-deb1b873a863 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:52.752028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e62c989a-a667-46f6-a5d8-deb1b873a863 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:52.917849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e62c989a-a667-46f6-a5d8-deb1b873a863 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:52.927640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e62c989a-a667-46f6-a5d8-deb1b873a863 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:52.929001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e62c989a-a667-46f6-a5d8-deb1b873a863 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:52.930206 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e62c989a-a667-46f6-a5d8-deb1b873a863 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1567 microversion: 2.25 time: 0.207932 Oct 10 23:20:52.930771 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 607/1200] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:52 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:20:52.984343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fea61499-3bfc-4d3d-8b85-5edd7c639f73 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:52.984947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fea61499-3bfc-4d3d-8b85-5edd7c639f73 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 7907c918-8df3-44bc-94f5-4fde965de66f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:52.992151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fea61499-3bfc-4d3d-8b85-5edd7c639f73 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:52.992838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fea61499-3bfc-4d3d-8b85-5edd7c639f73 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:52.993271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fea61499-3bfc-4d3d-8b85-5edd7c639f73 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:52.994152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fea61499-3bfc-4d3d-8b85-5edd7c639f73 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:52.994895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fea61499-3bfc-4d3d-8b85-5edd7c639f73 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:52.995322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fea61499-3bfc-4d3d-8b85-5edd7c639f73 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:53.066498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1401576d-e4f3-439c-afd4-3e3c529c233b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1232398495", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": "none"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:53.145007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-1401576d-e4f3-439c-afd4-3e3c529c233b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:20:53.145722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-1401576d-e4f3-439c-afd4-3e3c529c233b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:20:53.146591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-1401576d-e4f3-439c-afd4-3e3c529c233b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:20:53.147176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-1401576d-e4f3-439c-afd4-3e3c529c233b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:20:53.147750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-1401576d-e4f3-439c-afd4-3e3c529c233b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:20:53.159822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1401576d-e4f3-439c-afd4-3e3c529c233b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:53.160660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1401576d-e4f3-439c-afd4-3e3c529c233b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:53.161259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1401576d-e4f3-439c-afd4-3e3c529c233b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:53.162183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1401576d-e4f3-439c-afd4-3e3c529c233b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:53.163281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1401576d-e4f3-439c-afd4-3e3c529c233b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:53.163726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1401576d-e4f3-439c-afd4-3e3c529c233b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:53.183955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-1401576d-e4f3-439c-afd4-3e3c529c233b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Getting quotas for project b7856298ca7041b99dfcdb3e39c5f881. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:20:53.190156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fea61499-3bfc-4d3d-8b85-5edd7c639f73 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:53.193269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-1401576d-e4f3-439c-afd4-3e3c529c233b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Getting quotas for user 3c7236d800a747eba9437a3c68047f12 and project b7856298ca7041b99dfcdb3e39c5f881. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:20:53.204102 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fea61499-3bfc-4d3d-8b85-5edd7c639f73 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/7907c918-8df3-44bc-94f5-4fde965de66f" status: 200 len: 1475 microversion: 2.1 time: 0.223526 Oct 10 23:20:53.209367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1401576d-e4f3-439c-afd4-3e3c529c233b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:20:53.213945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1401576d-e4f3-439c-afd4-3e3c529c233b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] [instance: bdf5220b-cc6e-4457-b00c-b4e02cf8f982] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:20:53.215671 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 608/1201] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:52 2022] GET /compute/v2.1/servers/7907c918-8df3-44bc-94f5-4fde965de66f => generated 1475 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:53.227038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2f04221f-9a46-4d87-b3d8-9164d55aac85 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:53.227880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2f04221f-9a46-4d87-b3d8-9164d55aac85 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:53.234964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f04221f-9a46-4d87-b3d8-9164d55aac85 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:53.235492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f04221f-9a46-4d87-b3d8-9164d55aac85 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:53.236182 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f04221f-9a46-4d87-b3d8-9164d55aac85 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:53.237176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f04221f-9a46-4d87-b3d8-9164d55aac85 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:53.237814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f04221f-9a46-4d87-b3d8-9164d55aac85 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:53.238442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f04221f-9a46-4d87-b3d8-9164d55aac85 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:53.283347 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1401576d-e4f3-439c-afd4-3e3c529c233b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.510882 Oct 10 23:20:53.284232 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 594/1202] 10.222.0.23 () {62 vars in 1188 bytes} [Mon Oct 10 23:20:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 23:20:53.296349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-766d192c-99b5-4975-a7a9-c36c78f32348 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:53.297588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-766d192c-99b5-4975-a7a9-c36c78f32348 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] [instance: bdf5220b-cc6e-4457-b00c-b4e02cf8f982] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:53.383442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-766d192c-99b5-4975-a7a9-c36c78f32348 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:53.393365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-766d192c-99b5-4975-a7a9-c36c78f32348 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:53.395276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-766d192c-99b5-4975-a7a9-c36c78f32348 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:53.396443 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-766d192c-99b5-4975-a7a9-c36c78f32348 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] 10.222.0.23 "GET /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982" status: 200 len: 1281 microversion: 2.47 time: 0.104542 Oct 10 23:20:53.405481 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 595/1203] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:53 2022] GET /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982 => generated 1281 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:53.422943 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2f04221f-9a46-4d87-b3d8-9164d55aac85 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:53.433066 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2f04221f-9a46-4d87-b3d8-9164d55aac85 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1378 microversion: 2.1 time: 0.210045 Oct 10 23:20:53.433859 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 609/1204] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:53 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1378 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:53.609084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e02ff313-a2e1-48a3-ae7b-82050d4e59ce tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:53.609850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e02ff313-a2e1-48a3-ae7b-82050d4e59ce tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:53.616789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e02ff313-a2e1-48a3-ae7b-82050d4e59ce tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:53.617735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e02ff313-a2e1-48a3-ae7b-82050d4e59ce tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:53.618229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e02ff313-a2e1-48a3-ae7b-82050d4e59ce tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:53.619321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e02ff313-a2e1-48a3-ae7b-82050d4e59ce tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:53.620025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e02ff313-a2e1-48a3-ae7b-82050d4e59ce tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:53.620660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e02ff313-a2e1-48a3-ae7b-82050d4e59ce tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:53.655550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-015d5139-366b-4c95-ba17-1c72d6eca33a req-a7c78596-c2ad-450b-86ee-2cb551dc49d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dea3f22-ee85-4a3f-a4cd-a0634c6e451b", "tag": "f65ed136-fdf8-4735-a0b9-6e6d462b75e1"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:53.668740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-015d5139-366b-4c95-ba17-1c72d6eca33a req-a7c78596-c2ad-450b-86ee-2cb551dc49d0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:53.669313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-015d5139-366b-4c95-ba17-1c72d6eca33a req-a7c78596-c2ad-450b-86ee-2cb551dc49d0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:53.670166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-015d5139-366b-4c95-ba17-1c72d6eca33a req-a7c78596-c2ad-450b-86ee-2cb551dc49d0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:53.683555 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-015d5139-366b-4c95-ba17-1c72d6eca33a req-a7c78596-c2ad-450b-86ee-2cb551dc49d0 service nova] Creating event network-changed:f65ed136-fdf8-4735-a0b9-6e6d462b75e1 for instance 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b on n-h2-860864-2 Oct 10 23:20:53.689628 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-015d5139-366b-4c95-ba17-1c72d6eca33a req-a7c78596-c2ad-450b-86ee-2cb551dc49d0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040372 Oct 10 23:20:53.691533 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 610/1205] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:20:53.768310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e02ff313-a2e1-48a3-ae7b-82050d4e59ce tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:53.777866 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e02ff313-a2e1-48a3-ae7b-82050d4e59ce tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1518 microversion: 2.1 time: 0.173524 Oct 10 23:20:53.778830 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 596/1206] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:53 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:53.784874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-52316ff5-8144-47ed-908c-f40e220e1b74 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:53.785667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-52316ff5-8144-47ed-908c-f40e220e1b74 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:53.791707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52316ff5-8144-47ed-908c-f40e220e1b74 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:53.792533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52316ff5-8144-47ed-908c-f40e220e1b74 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:53.793595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52316ff5-8144-47ed-908c-f40e220e1b74 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:53.797226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52316ff5-8144-47ed-908c-f40e220e1b74 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:53.801093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52316ff5-8144-47ed-908c-f40e220e1b74 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:53.801577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52316ff5-8144-47ed-908c-f40e220e1b74 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:53.862466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3c36429d-54f7-4a6f-aa74-556ebf967ade tempest-FlavorsAccessTestJSON-232408945 tempest-FlavorsAccessTestJSON-232408945-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2097926918", "id": 866238045, "os-flavor-access:is_public": "False"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:53.884930 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3c36429d-54f7-4a6f-aa74-556ebf967ade tempest-FlavorsAccessTestJSON-232408945 tempest-FlavorsAccessTestJSON-232408945-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.191972 Oct 10 23:20:53.885565 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 611/1207] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:20:53 2022] POST /compute/v2.1/flavors => generated 428 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:53.907088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-67e554c9-50c6-49e7-a3e3-ee37983c7aaf tempest-FlavorsAccessTestJSON-232408945 tempest-FlavorsAccessTestJSON-232408945-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4407985fd8214974bfc55ce798858a40"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:53.997170 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-67e554c9-50c6-49e7-a3e3-ee37983c7aaf tempest-FlavorsAccessTestJSON-232408945 tempest-FlavorsAccessTestJSON-232408945-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/866238045/action" status: 200 len: 96 microversion: 2.1 time: 0.095207 Oct 10 23:20:53.998846 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 612/1208] 10.222.0.23 () {60 vars in 1197 bytes} [Mon Oct 10 23:20:53 2022] POST /compute/v2.1/flavors/866238045/action => generated 96 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:20:54.007864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-85779a93-728c-4ff3-af04-d84b625dcf52 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:54.008996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-85779a93-728c-4ff3-af04-d84b625dcf52 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:54.011637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-52316ff5-8144-47ed-908c-f40e220e1b74 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:54.015900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85779a93-728c-4ff3-af04-d84b625dcf52 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:54.016393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85779a93-728c-4ff3-af04-d84b625dcf52 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:54.017249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85779a93-728c-4ff3-af04-d84b625dcf52 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:54.018018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85779a93-728c-4ff3-af04-d84b625dcf52 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:54.018819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85779a93-728c-4ff3-af04-d84b625dcf52 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:54.019356 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85779a93-728c-4ff3-af04-d84b625dcf52 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:54.022332 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-52316ff5-8144-47ed-908c-f40e220e1b74 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 200 len: 1646 microversion: 2.1 time: 0.242160 Oct 10 23:20:54.022911 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 597/1209] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:53 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 1646 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:54.172803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-eef88483-b968-465a-bee0-30d801e88cb0 tempest-FlavorsAccessTestJSON-1164138157 tempest-FlavorsAccessTestJSON-1164138157-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:54.199414 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-eef88483-b968-465a-bee0-30d801e88cb0 tempest-FlavorsAccessTestJSON-1164138157 tempest-FlavorsAccessTestJSON-1164138157-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5897 microversion: 2.1 time: 0.175197 Oct 10 23:20:54.200030 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 598/1210] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:20:54 2022] GET /compute/v2.1/flavors/detail => generated 5897 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:54.219311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f455aeff-9727-4497-b20f-a575158e9912 tempest-FlavorsAccessTestJSON-232408945 tempest-FlavorsAccessTestJSON-232408945-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4407985fd8214974bfc55ce798858a40"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:54.303188 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f455aeff-9727-4497-b20f-a575158e9912 tempest-FlavorsAccessTestJSON-232408945 tempest-FlavorsAccessTestJSON-232408945-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/866238045/action" status: 200 len: 21 microversion: 2.1 time: 0.088537 Oct 10 23:20:54.304220 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 599/1211] 10.222.0.23 () {60 vars in 1197 bytes} [Mon Oct 10 23:20:54 2022] POST /compute/v2.1/flavors/866238045/action => generated 21 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 23:20:54.309085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a6e9ea9b-8464-4112-8e30-51740cdfe60c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:54.310336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a6e9ea9b-8464-4112-8e30-51740cdfe60c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 7907c918-8df3-44bc-94f5-4fde965de66f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:54.320099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6e9ea9b-8464-4112-8e30-51740cdfe60c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:54.320819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6e9ea9b-8464-4112-8e30-51740cdfe60c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:54.321293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6e9ea9b-8464-4112-8e30-51740cdfe60c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:54.322142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6e9ea9b-8464-4112-8e30-51740cdfe60c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:54.322607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6e9ea9b-8464-4112-8e30-51740cdfe60c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:54.323041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6e9ea9b-8464-4112-8e30-51740cdfe60c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:54.407531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-85779a93-728c-4ff3-af04-d84b625dcf52 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:54.423729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-85779a93-728c-4ff3-af04-d84b625dcf52 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:54.425196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-85779a93-728c-4ff3-af04-d84b625dcf52 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:54.426425 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-85779a93-728c-4ff3-af04-d84b625dcf52 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1567 microversion: 2.25 time: 0.426632 Oct 10 23:20:54.426987 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 613/1212] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:53 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1567 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:54.441010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-68b4faa9-1271-4e95-8525-dc1b80b39957 tempest-FlavorsAccessTestJSON-1164138157 tempest-FlavorsAccessTestJSON-1164138157-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:54.467527 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-68b4faa9-1271-4e95-8525-dc1b80b39957 tempest-FlavorsAccessTestJSON-1164138157 tempest-FlavorsAccessTestJSON-1164138157-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5479 microversion: 2.1 time: 0.034828 Oct 10 23:20:54.468701 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 614/1213] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:20:54 2022] GET /compute/v2.1/flavors/detail => generated 5479 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:54.473270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6d58c12f-8584-4005-b9b3-abb3fdf61a29 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:54.473907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6d58c12f-8584-4005-b9b3-abb3fdf61a29 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] [instance: bdf5220b-cc6e-4457-b00c-b4e02cf8f982] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:54.480134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d58c12f-8584-4005-b9b3-abb3fdf61a29 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:54.480815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d58c12f-8584-4005-b9b3-abb3fdf61a29 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:54.481464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d58c12f-8584-4005-b9b3-abb3fdf61a29 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:54.483276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d58c12f-8584-4005-b9b3-abb3fdf61a29 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:54.483741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d58c12f-8584-4005-b9b3-abb3fdf61a29 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:54.484215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d58c12f-8584-4005-b9b3-abb3fdf61a29 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:54.502530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a6e9ea9b-8464-4112-8e30-51740cdfe60c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:54.512683 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a6e9ea9b-8464-4112-8e30-51740cdfe60c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/7907c918-8df3-44bc-94f5-4fde965de66f" status: 200 len: 1475 microversion: 2.1 time: 0.207367 Oct 10 23:20:54.514474 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 600/1214] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:54 2022] GET /compute/v2.1/servers/7907c918-8df3-44bc-94f5-4fde965de66f => generated 1475 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:54.521083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1e17507d-a9d6-4649-a0d7-d6737e9c931f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:54.521774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1e17507d-a9d6-4649-a0d7-d6737e9c931f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:54.531974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e17507d-a9d6-4649-a0d7-d6737e9c931f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:54.532475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e17507d-a9d6-4649-a0d7-d6737e9c931f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:54.533021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e17507d-a9d6-4649-a0d7-d6737e9c931f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:54.533667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e17507d-a9d6-4649-a0d7-d6737e9c931f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:54.534289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e17507d-a9d6-4649-a0d7-d6737e9c931f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:54.534874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e17507d-a9d6-4649-a0d7-d6737e9c931f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:54.617329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6d58c12f-8584-4005-b9b3-abb3fdf61a29 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:54.627649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6d58c12f-8584-4005-b9b3-abb3fdf61a29 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:54.629288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6d58c12f-8584-4005-b9b3-abb3fdf61a29 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:54.630560 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6d58c12f-8584-4005-b9b3-abb3fdf61a29 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] 10.222.0.23 "GET /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982" status: 200 len: 1333 microversion: 2.47 time: 0.160923 Oct 10 23:20:54.631534 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 615/1215] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:54 2022] GET /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982 => generated 1333 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:54.636186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a2dd082c-099f-4b4d-b0e7-366d4d07745b tempest-FlavorsAccessTestJSON-232408945 tempest-FlavorsAccessTestJSON-232408945-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:54.639989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:54.663976 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a2dd082c-099f-4b4d-b0e7-366d4d07745b tempest-FlavorsAccessTestJSON-232408945 tempest-FlavorsAccessTestJSON-232408945-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/866238045" status: 202 len: 0 microversion: 2.1 time: 0.030317 Oct 10 23:20:54.664960 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 616/1216] 10.222.0.23 () {58 vars in 1158 bytes} [Mon Oct 10 23:20:54 2022] DELETE /compute/v2.1/flavors/866238045 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:20:54.673959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1e17507d-a9d6-4649-a0d7-d6737e9c931f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:54.679335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e16e5ffb-fa31-4105-b9f6-082a685d8530 tempest-FlavorsAccessTestJSON-232408945 tempest-FlavorsAccessTestJSON-232408945-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:54.682133 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1e17507d-a9d6-4649-a0d7-d6737e9c931f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1378 microversion: 2.1 time: 0.166071 Oct 10 23:20:54.682893 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 601/1217] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:54 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1378 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:54.700198 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e16e5ffb-fa31-4105-b9f6-082a685d8530 tempest-FlavorsAccessTestJSON-232408945 tempest-FlavorsAccessTestJSON-232408945-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5479 microversion: 2.1 time: 0.031088 Oct 10 23:20:54.701285 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 617/1218] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:20:54 2022] GET /compute/v2.1/flavors/detail => generated 5479 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:54.722748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-42ea6ccd-9973-4226-96b7-b9c5188b874b tempest-FlavorsAccessTestJSON-232408945 tempest-FlavorsAccessTestJSON-232408945-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-406547445", "id": 908391098, "os-flavor-access:is_public": "False"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:54.741662 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-42ea6ccd-9973-4226-96b7-b9c5188b874b tempest-FlavorsAccessTestJSON-232408945 tempest-FlavorsAccessTestJSON-232408945-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.023755 Oct 10 23:20:54.742479 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 602/1219] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:20:54 2022] POST /compute/v2.1/flavors => generated 427 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:54.758338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cd10a417-f5a7-4af5-9cd1-b261116402d5 tempest-FlavorsAccessTestJSON-232408945 tempest-FlavorsAccessTestJSON-232408945-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:54.774589 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cd10a417-f5a7-4af5-9cd1-b261116402d5 tempest-FlavorsAccessTestJSON-232408945 tempest-FlavorsAccessTestJSON-232408945-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/908391098/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.022518 Oct 10 23:20:54.775280 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 618/1220] 10.222.0.23 () {58 vars in 1206 bytes} [Mon Oct 10 23:20:54 2022] GET /compute/v2.1/flavors/908391098/os-flavor-access => generated 21 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:20:54.785593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-89a3b102-b51d-4373-8dbd-92b7336b3994 tempest-FlavorsAccessTestJSON-232408945 tempest-FlavorsAccessTestJSON-232408945-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:54.804078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7c5ad07f-b7f2-4d94-8ba4-62b4e4c43e8e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:54.805073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7c5ad07f-b7f2-4d94-8ba4-62b4e4c43e8e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:54.807465 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-89a3b102-b51d-4373-8dbd-92b7336b3994 tempest-FlavorsAccessTestJSON-232408945 tempest-FlavorsAccessTestJSON-232408945-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/908391098" status: 202 len: 0 microversion: 2.1 time: 0.025398 Oct 10 23:20:54.811670 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 603/1221] 10.222.0.23 () {58 vars in 1158 bytes} [Mon Oct 10 23:20:54 2022] DELETE /compute/v2.1/flavors/908391098 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:20:54.819468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e73d4274-6d51-443c-a696-db83f81f513b tempest-FlavorsAccessTestJSON-232408945 tempest-FlavorsAccessTestJSON-232408945-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:54.831899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c5ad07f-b7f2-4d94-8ba4-62b4e4c43e8e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:54.832478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c5ad07f-b7f2-4d94-8ba4-62b4e4c43e8e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:54.833210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c5ad07f-b7f2-4d94-8ba4-62b4e4c43e8e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:54.841696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c5ad07f-b7f2-4d94-8ba4-62b4e4c43e8e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:54.842576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c5ad07f-b7f2-4d94-8ba4-62b4e4c43e8e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:54.843116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c5ad07f-b7f2-4d94-8ba4-62b4e4c43e8e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:54.849398 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e73d4274-6d51-443c-a696-db83f81f513b tempest-FlavorsAccessTestJSON-232408945 tempest-FlavorsAccessTestJSON-232408945-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5479 microversion: 2.1 time: 0.034549 Oct 10 23:20:54.850291 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 604/1222] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:20:54 2022] GET /compute/v2.1/flavors/detail => generated 5479 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:55.048945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6a88bc96-9a99-4d0e-8e15-ef5d7f371ced tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:55.050179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6a88bc96-9a99-4d0e-8e15-ef5d7f371ced tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:55.061983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a88bc96-9a99-4d0e-8e15-ef5d7f371ced tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:55.062707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a88bc96-9a99-4d0e-8e15-ef5d7f371ced tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:55.063966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a88bc96-9a99-4d0e-8e15-ef5d7f371ced tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:55.065444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a88bc96-9a99-4d0e-8e15-ef5d7f371ced tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:55.066086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a88bc96-9a99-4d0e-8e15-ef5d7f371ced tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:55.066803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a88bc96-9a99-4d0e-8e15-ef5d7f371ced tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:55.181003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6a88bc96-9a99-4d0e-8e15-ef5d7f371ced tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:55.190603 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6a88bc96-9a99-4d0e-8e15-ef5d7f371ced tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 200 len: 1466 microversion: 2.1 time: 0.147641 Oct 10 23:20:55.205404 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 605/1223] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:55 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 1466 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:55.452739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8404cb55-d66a-42b0-8936-72089f9382a9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:55.453365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8404cb55-d66a-42b0-8936-72089f9382a9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:55.459461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8404cb55-d66a-42b0-8936-72089f9382a9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:55.459950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8404cb55-d66a-42b0-8936-72089f9382a9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:55.460390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8404cb55-d66a-42b0-8936-72089f9382a9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:55.461092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8404cb55-d66a-42b0-8936-72089f9382a9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:55.461581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8404cb55-d66a-42b0-8936-72089f9382a9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:55.462013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8404cb55-d66a-42b0-8936-72089f9382a9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:55.479551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7c5ad07f-b7f2-4d94-8ba4-62b4e4c43e8e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:55.489271 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7c5ad07f-b7f2-4d94-8ba4-62b4e4c43e8e tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1518 microversion: 2.1 time: 0.691240 Oct 10 23:20:55.509519 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 619/1224] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:54 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1518 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:55.538338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5c3cfb0a-d3d5-4dda-875e-d3f8f197a194 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:55.538872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5c3cfb0a-d3d5-4dda-875e-d3f8f197a194 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 7907c918-8df3-44bc-94f5-4fde965de66f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:55.547033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c3cfb0a-d3d5-4dda-875e-d3f8f197a194 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:55.547462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c3cfb0a-d3d5-4dda-875e-d3f8f197a194 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:55.547906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c3cfb0a-d3d5-4dda-875e-d3f8f197a194 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:55.549176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c3cfb0a-d3d5-4dda-875e-d3f8f197a194 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:55.549176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c3cfb0a-d3d5-4dda-875e-d3f8f197a194 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:55.550018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c3cfb0a-d3d5-4dda-875e-d3f8f197a194 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:55.788479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5c3cfb0a-d3d5-4dda-875e-d3f8f197a194 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:55.798242 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5c3cfb0a-d3d5-4dda-875e-d3f8f197a194 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/7907c918-8df3-44bc-94f5-4fde965de66f" status: 200 len: 1475 microversion: 2.1 time: 0.265018 Oct 10 23:20:55.807265 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 620/1225] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:55 2022] GET /compute/v2.1/servers/7907c918-8df3-44bc-94f5-4fde965de66f => generated 1475 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:55.807265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e0bcdc52-c987-4d59-83c9-84f6d0ff01aa tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:55.807265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e0bcdc52-c987-4d59-83c9-84f6d0ff01aa tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] [instance: bdf5220b-cc6e-4457-b00c-b4e02cf8f982] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:55.817873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0bcdc52-c987-4d59-83c9-84f6d0ff01aa tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:55.819025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0bcdc52-c987-4d59-83c9-84f6d0ff01aa tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:55.819735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0bcdc52-c987-4d59-83c9-84f6d0ff01aa tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:55.820697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0bcdc52-c987-4d59-83c9-84f6d0ff01aa tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:55.821546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0bcdc52-c987-4d59-83c9-84f6d0ff01aa tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:55.823098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0bcdc52-c987-4d59-83c9-84f6d0ff01aa tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:55.927755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e0bcdc52-c987-4d59-83c9-84f6d0ff01aa tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:55.938810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e0bcdc52-c987-4d59-83c9-84f6d0ff01aa tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:55.941237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e0bcdc52-c987-4d59-83c9-84f6d0ff01aa tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:55.942553 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e0bcdc52-c987-4d59-83c9-84f6d0ff01aa tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] 10.222.0.23 "GET /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982" status: 200 len: 1339 microversion: 2.47 time: 0.142191 Oct 10 23:20:55.945329 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 621/1226] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:55 2022] GET /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982 => generated 1339 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:55.949959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-33906eb0-ee5d-4e7d-a0cf-57f1b10f5c9f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:55.951689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-33906eb0-ee5d-4e7d-a0cf-57f1b10f5c9f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:55.961609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33906eb0-ee5d-4e7d-a0cf-57f1b10f5c9f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:55.962259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33906eb0-ee5d-4e7d-a0cf-57f1b10f5c9f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:55.962860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33906eb0-ee5d-4e7d-a0cf-57f1b10f5c9f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:55.964091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33906eb0-ee5d-4e7d-a0cf-57f1b10f5c9f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:55.964695 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33906eb0-ee5d-4e7d-a0cf-57f1b10f5c9f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:55.965120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33906eb0-ee5d-4e7d-a0cf-57f1b10f5c9f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:56.151880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8404cb55-d66a-42b0-8936-72089f9382a9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:56.161752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8404cb55-d66a-42b0-8936-72089f9382a9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:56.163235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8404cb55-d66a-42b0-8936-72089f9382a9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:56.164763 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8404cb55-d66a-42b0-8936-72089f9382a9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1567 microversion: 2.25 time: 0.716835 Oct 10 23:20:56.165294 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 606/1227] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:55 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1567 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:20:56.171099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-717bf351-9cfc-48ed-9c1e-cd6b6ee1b00e req-424e8298-802c-4b5c-a335-1e9c91c1ecb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dea3f22-ee85-4a3f-a4cd-a0634c6e451b", "name": "network-vif-deleted", "tag": "f65ed136-fdf8-4735-a0b9-6e6d462b75e1"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:56.181567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-717bf351-9cfc-48ed-9c1e-cd6b6ee1b00e req-424e8298-802c-4b5c-a335-1e9c91c1ecb9 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:56.182760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-717bf351-9cfc-48ed-9c1e-cd6b6ee1b00e req-424e8298-802c-4b5c-a335-1e9c91c1ecb9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:56.183354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-717bf351-9cfc-48ed-9c1e-cd6b6ee1b00e req-424e8298-802c-4b5c-a335-1e9c91c1ecb9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:56.196579 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-717bf351-9cfc-48ed-9c1e-cd6b6ee1b00e req-424e8298-802c-4b5c-a335-1e9c91c1ecb9 service nova] Creating event network-vif-deleted:f65ed136-fdf8-4735-a0b9-6e6d462b75e1 for instance 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b on n-h2-860864-2 Oct 10 23:20:56.204469 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-717bf351-9cfc-48ed-9c1e-cd6b6ee1b00e req-424e8298-802c-4b5c-a335-1e9c91c1ecb9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036978 Oct 10 23:20:56.205935 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 607/1228] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:56.218403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a98f8c4d-d626-479d-8129-4daf586d6dfe tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:56.220054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a98f8c4d-d626-479d-8129-4daf586d6dfe tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:56.228008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a98f8c4d-d626-479d-8129-4daf586d6dfe tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:56.229143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a98f8c4d-d626-479d-8129-4daf586d6dfe tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:56.230090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-33906eb0-ee5d-4e7d-a0cf-57f1b10f5c9f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:56.230782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a98f8c4d-d626-479d-8129-4daf586d6dfe tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:56.232294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a98f8c4d-d626-479d-8129-4daf586d6dfe tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:56.233209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a98f8c4d-d626-479d-8129-4daf586d6dfe tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:56.233891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a98f8c4d-d626-479d-8129-4daf586d6dfe tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:56.242057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:56.249715 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-33906eb0-ee5d-4e7d-a0cf-57f1b10f5c9f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1378 microversion: 2.1 time: 0.304598 Oct 10 23:20:56.253992 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 622/1229] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:55 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1378 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:56.399978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a98f8c4d-d626-479d-8129-4daf586d6dfe tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:56.411239 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a98f8c4d-d626-479d-8129-4daf586d6dfe tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 200 len: 1466 microversion: 2.1 time: 0.198765 Oct 10 23:20:56.425432 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 608/1230] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:56 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 1466 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:56.519254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9be634f7-f826-4cb9-b15d-b067e4c004d4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:56.520220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9be634f7-f826-4cb9-b15d-b067e4c004d4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:56.534658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9be634f7-f826-4cb9-b15d-b067e4c004d4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:56.535545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9be634f7-f826-4cb9-b15d-b067e4c004d4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:56.536187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9be634f7-f826-4cb9-b15d-b067e4c004d4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:56.539255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9be634f7-f826-4cb9-b15d-b067e4c004d4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:56.540730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9be634f7-f826-4cb9-b15d-b067e4c004d4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:56.558065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9be634f7-f826-4cb9-b15d-b067e4c004d4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:56.640545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-0dd2f574-7f80-4f2a-b48a-ba484bdc3b22 req-296c74ad-891e-4309-aaa3-1f230e327748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c783f55d-ea82-4d94-a4f6-77591d412a02", "name": "network-vif-deleted", "tag": "2b5f53ee-a28d-48f4-8fb1-613acb644289"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:56.669768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0dd2f574-7f80-4f2a-b48a-ba484bdc3b22 req-296c74ad-891e-4309-aaa3-1f230e327748 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:56.670898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0dd2f574-7f80-4f2a-b48a-ba484bdc3b22 req-296c74ad-891e-4309-aaa3-1f230e327748 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:56.672872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0dd2f574-7f80-4f2a-b48a-ba484bdc3b22 req-296c74ad-891e-4309-aaa3-1f230e327748 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:56.677948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:56.715810 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-0dd2f574-7f80-4f2a-b48a-ba484bdc3b22 req-296c74ad-891e-4309-aaa3-1f230e327748 service nova] Creating event network-vif-deleted:2b5f53ee-a28d-48f4-8fb1-613acb644289 for instance c783f55d-ea82-4d94-a4f6-77591d412a02 on n-h1-860864-2 Oct 10 23:20:56.722816 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-0dd2f574-7f80-4f2a-b48a-ba484bdc3b22 req-296c74ad-891e-4309-aaa3-1f230e327748 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087237 Oct 10 23:20:56.742064 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 609/1231] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:20:56.823520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-086f22bb-7afd-46f1-b51e-f6173ef79666 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:56.824548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-086f22bb-7afd-46f1-b51e-f6173ef79666 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 7907c918-8df3-44bc-94f5-4fde965de66f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:56.842011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9be634f7-f826-4cb9-b15d-b067e4c004d4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:56.849196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-086f22bb-7afd-46f1-b51e-f6173ef79666 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:56.857244 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9be634f7-f826-4cb9-b15d-b067e4c004d4 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1476 microversion: 2.1 time: 0.343678 Oct 10 23:20:56.863092 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 623/1232] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:56 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1476 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:56.863376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-086f22bb-7afd-46f1-b51e-f6173ef79666 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:56.864130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-086f22bb-7afd-46f1-b51e-f6173ef79666 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:56.866843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-086f22bb-7afd-46f1-b51e-f6173ef79666 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:56.867448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-086f22bb-7afd-46f1-b51e-f6173ef79666 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:56.868020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-086f22bb-7afd-46f1-b51e-f6173ef79666 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:56.949369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-086f22bb-7afd-46f1-b51e-f6173ef79666 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:56.952452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-086f22bb-7afd-46f1-b51e-f6173ef79666 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:56.956990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-086f22bb-7afd-46f1-b51e-f6173ef79666 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:56.957629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-086f22bb-7afd-46f1-b51e-f6173ef79666 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lazy-loading 'fault' on Instance uuid 7907c918-8df3-44bc-94f5-4fde965de66f {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:20:56.973413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-85bfa2fa-ec2b-4c74-8fb8-c93f61290fd1 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:56.978265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-85bfa2fa-ec2b-4c74-8fb8-c93f61290fd1 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] [instance: bdf5220b-cc6e-4457-b00c-b4e02cf8f982] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:56.987993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85bfa2fa-ec2b-4c74-8fb8-c93f61290fd1 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:56.988770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85bfa2fa-ec2b-4c74-8fb8-c93f61290fd1 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:56.989363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85bfa2fa-ec2b-4c74-8fb8-c93f61290fd1 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:56.990674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85bfa2fa-ec2b-4c74-8fb8-c93f61290fd1 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:56.991877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85bfa2fa-ec2b-4c74-8fb8-c93f61290fd1 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:56.992571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85bfa2fa-ec2b-4c74-8fb8-c93f61290fd1 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:57.074830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-086f22bb-7afd-46f1-b51e-f6173ef79666 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:57.083369 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-086f22bb-7afd-46f1-b51e-f6173ef79666 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/7907c918-8df3-44bc-94f5-4fde965de66f" status: 200 len: 1309 microversion: 2.1 time: 0.264634 Oct 10 23:20:57.086265 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 610/1233] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:56 2022] GET /compute/v2.1/servers/7907c918-8df3-44bc-94f5-4fde965de66f => generated 1309 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:57.185542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-85bfa2fa-ec2b-4c74-8fb8-c93f61290fd1 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:57.191232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3278d4e5-6d2b-42b9-90c4-fe818a659e53 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:57.192024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3278d4e5-6d2b-42b9-90c4-fe818a659e53 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:57.199165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-85bfa2fa-ec2b-4c74-8fb8-c93f61290fd1 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:57.206036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-85bfa2fa-ec2b-4c74-8fb8-c93f61290fd1 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:57.207762 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-85bfa2fa-ec2b-4c74-8fb8-c93f61290fd1 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] 10.222.0.23 "GET /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982" status: 200 len: 1339 microversion: 2.47 time: 0.240801 Oct 10 23:20:57.208819 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 624/1234] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:56 2022] GET /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982 => generated 1339 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:57.209280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3278d4e5-6d2b-42b9-90c4-fe818a659e53 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:57.215076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3278d4e5-6d2b-42b9-90c4-fe818a659e53 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:57.215539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3278d4e5-6d2b-42b9-90c4-fe818a659e53 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:57.233475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3278d4e5-6d2b-42b9-90c4-fe818a659e53 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:57.233475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3278d4e5-6d2b-42b9-90c4-fe818a659e53 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:57.233475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3278d4e5-6d2b-42b9-90c4-fe818a659e53 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:57.281684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d043298e-eb0f-4de6-966e-b95b43a883ab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:57.282506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d043298e-eb0f-4de6-966e-b95b43a883ab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:57.291467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d043298e-eb0f-4de6-966e-b95b43a883ab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:57.291958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d043298e-eb0f-4de6-966e-b95b43a883ab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:57.292391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d043298e-eb0f-4de6-966e-b95b43a883ab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:57.293087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d043298e-eb0f-4de6-966e-b95b43a883ab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:57.298034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d043298e-eb0f-4de6-966e-b95b43a883ab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:57.299442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d043298e-eb0f-4de6-966e-b95b43a883ab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:57.484621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3278d4e5-6d2b-42b9-90c4-fe818a659e53 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:57.495005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3278d4e5-6d2b-42b9-90c4-fe818a659e53 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:57.496687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3278d4e5-6d2b-42b9-90c4-fe818a659e53 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:57.498773 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3278d4e5-6d2b-42b9-90c4-fe818a659e53 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1567 microversion: 2.25 time: 0.312020 Oct 10 23:20:57.499640 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 611/1235] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:57 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1567 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:20:57.505910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-01615303-9ce4-4b11-af7d-581d3e10fbae tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:57.506938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-01615303-9ce4-4b11-af7d-581d3e10fbae tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:57.520734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01615303-9ce4-4b11-af7d-581d3e10fbae tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:57.521944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01615303-9ce4-4b11-af7d-581d3e10fbae tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:57.522877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01615303-9ce4-4b11-af7d-581d3e10fbae tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:57.523849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01615303-9ce4-4b11-af7d-581d3e10fbae tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:57.524748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01615303-9ce4-4b11-af7d-581d3e10fbae tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:57.525542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01615303-9ce4-4b11-af7d-581d3e10fbae tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:57.554546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d043298e-eb0f-4de6-966e-b95b43a883ab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:57.566125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01615303-9ce4-4b11-af7d-581d3e10fbae tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:57.566727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01615303-9ce4-4b11-af7d-581d3e10fbae tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:57.567329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01615303-9ce4-4b11-af7d-581d3e10fbae tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:57.567863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-01615303-9ce4-4b11-af7d-581d3e10fbae tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lazy-loading 'fault' on Instance uuid 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:20:57.577568 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d043298e-eb0f-4de6-966e-b95b43a883ab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1528 microversion: 2.1 time: 0.301616 Oct 10 23:20:57.578687 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 625/1236] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:57 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1528 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:57.602209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b080c44d-b091-41dd-8128-f82b8ba3781f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:57.602825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b080c44d-b091-41dd-8128-f82b8ba3781f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:57.610468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b080c44d-b091-41dd-8128-f82b8ba3781f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:57.610963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b080c44d-b091-41dd-8128-f82b8ba3781f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:57.611403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b080c44d-b091-41dd-8128-f82b8ba3781f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:57.612086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b080c44d-b091-41dd-8128-f82b8ba3781f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:57.612539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b080c44d-b091-41dd-8128-f82b8ba3781f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:57.612951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b080c44d-b091-41dd-8128-f82b8ba3781f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:57.623024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-01615303-9ce4-4b11-af7d-581d3e10fbae tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:57.632681 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-01615303-9ce4-4b11-af7d-581d3e10fbae tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 200 len: 1306 microversion: 2.1 time: 0.131527 Oct 10 23:20:57.633212 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 612/1237] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:57 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 1306 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:57.880770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b080c44d-b091-41dd-8128-f82b8ba3781f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:57.885405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e8fe76d8-0dbf-4633-be7c-8e7dd5fd1e6c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:57.894368 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b080c44d-b091-41dd-8128-f82b8ba3781f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1528 microversion: 2.1 time: 0.296326 Oct 10 23:20:57.895650 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 626/1238] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:57 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1528 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:57.896737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e8fe76d8-0dbf-4633-be7c-8e7dd5fd1e6c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:57.910697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8fe76d8-0dbf-4633-be7c-8e7dd5fd1e6c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:57.914349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8fe76d8-0dbf-4633-be7c-8e7dd5fd1e6c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:57.915934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8fe76d8-0dbf-4633-be7c-8e7dd5fd1e6c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:57.917251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8fe76d8-0dbf-4633-be7c-8e7dd5fd1e6c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:57.918028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8fe76d8-0dbf-4633-be7c-8e7dd5fd1e6c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:57.918707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8fe76d8-0dbf-4633-be7c-8e7dd5fd1e6c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:57.919456 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-41f37f69-79ce-4871-bdce-9b85c72d14a4 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:57.944984 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-41f37f69-79ce-4871-bdce-9b85c72d14a4 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/f218c400-5b4f-4041-afcd-140d0f0aff91" status: 202 len: 0 microversion: 2.1 time: 0.029380 Oct 10 23:20:57.946556 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 627/1239] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:20:57 2022] DELETE /compute/v2.1/flavors/f218c400-5b4f-4041-afcd-140d0f0aff91 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 23:20:57.956424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-efccfdac-1e6a-416a-9fdb-e1cfb8b004cc tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:57.981217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8fe76d8-0dbf-4633-be7c-8e7dd5fd1e6c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:57.982218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8fe76d8-0dbf-4633-be7c-8e7dd5fd1e6c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:57.983113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8fe76d8-0dbf-4633-be7c-8e7dd5fd1e6c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:57.989101 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-efccfdac-1e6a-416a-9fdb-e1cfb8b004cc tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036856 Oct 10 23:20:57.989746 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 628/1240] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:20:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:57.996560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-e8fe76d8-0dbf-4633-be7c-8e7dd5fd1e6c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lazy-loading 'fault' on Instance uuid 8400778e-6c2d-4055-9799-5ec4e9ae0f1b {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:20:58.020848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-092fdc1c-67a2-4dc6-9371-9705d3665018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:58.026109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-092fdc1c-67a2-4dc6-9371-9705d3665018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:58.037498 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-092fdc1c-67a2-4dc6-9371-9705d3665018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:58.038223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-092fdc1c-67a2-4dc6-9371-9705d3665018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:58.039078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-092fdc1c-67a2-4dc6-9371-9705d3665018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:58.040033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-092fdc1c-67a2-4dc6-9371-9705d3665018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:58.040680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-092fdc1c-67a2-4dc6-9371-9705d3665018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:58.041470 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-092fdc1c-67a2-4dc6-9371-9705d3665018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:58.078673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-092fdc1c-67a2-4dc6-9371-9705d3665018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:58.084994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-092fdc1c-67a2-4dc6-9371-9705d3665018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Old instance type tempest-test_resize_flavor_-116381320, new instance type m1.heat {{(pid=120614) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 10 23:20:58.094181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-092fdc1c-67a2-4dc6-9371-9705d3665018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:20:58.094849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-092fdc1c-67a2-4dc6-9371-9705d3665018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:20:58.095702 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-092fdc1c-67a2-4dc6-9371-9705d3665018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:20:58.096266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-092fdc1c-67a2-4dc6-9371-9705d3665018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:20:58.096869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-092fdc1c-67a2-4dc6-9371-9705d3665018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:20:58.098473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e8fe76d8-0dbf-4633-be7c-8e7dd5fd1e6c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:58.109961 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e8fe76d8-0dbf-4633-be7c-8e7dd5fd1e6c tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1311 microversion: 2.1 time: 0.228609 Oct 10 23:20:58.119239 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 613/1241] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:57 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1311 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:58.129998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bd7c9273-6491-47c0-b6c4-e1e57552582c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:58.136711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bd7c9273-6491-47c0-b6c4-e1e57552582c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 7907c918-8df3-44bc-94f5-4fde965de66f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:58.145155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd7c9273-6491-47c0-b6c4-e1e57552582c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:58.146134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd7c9273-6491-47c0-b6c4-e1e57552582c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:58.146984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd7c9273-6491-47c0-b6c4-e1e57552582c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:58.147859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd7c9273-6491-47c0-b6c4-e1e57552582c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:58.148464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd7c9273-6491-47c0-b6c4-e1e57552582c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:58.149426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd7c9273-6491-47c0-b6c4-e1e57552582c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:58.170361 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-bd7c9273-6491-47c0-b6c4-e1e57552582c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] HTTP exception thrown: Instance 7907c918-8df3-44bc-94f5-4fde965de66f could not be found. Oct 10 23:20:58.172616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bd7c9273-6491-47c0-b6c4-e1e57552582c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Request method failure captured: Oct 10 23:20:58.172616 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/7907c918-8df3-44bc-94f5-4fde965de66f HTTP/1.1 Oct 10 23:20:58.172616 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:20:58.172616 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:20:58.172616 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:20:58.172616 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:20:58.172616 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:20:58.172616 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:20:58.172616 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:20:58.172616 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:58.172616 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKgJCGPRazsPZv_KJRTPkW4yfXkftWI99r6NM1NcPzbV6ezzFy8Kk0KC2fs-Oq1mdxcQ8vpiKa4rTjWrgHH8KDGbQArWJeSLbZnpz5njlegxl252rFp2J2t_YkO8EBZX2N9DD656V96Tu1xc3xvEKd_hjW4bndDcX9tluGi3sznnXco Oct 10 23:20:58.172616 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:20:58.172616 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:20:58.172616 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:20:58.172616 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:20:58.172616 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:20:58.172616 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:20:58.172616 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: d98b12fc1bbf42d4b7376222c55733ed Oct 10 23:20:58.172616 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:20:58.172616 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:20:58.172616 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:20:58.174460 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d98b12fc1bbf42d4b7376222c55733ed", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:58.174460 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:20:58.174460 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: d98b12fc1bbf42d4b7376222c55733ed Oct 10 23:20:58.174460 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:20:58.174460 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersOnMultiNodesTest-1123459593-project Oct 10 23:20:58.174460 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:20:58.174460 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:20:58.174460 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 310196e1663a4f7ca12e1fc53b0278ba Oct 10 23:20:58.174460 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersOnMultiNodesTest-1123459593-project Oct 10 23:20:58.174460 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:20:58.174460 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 7907c918-8df3-44bc-94f5-4fde965de66f could not be found. Oct 10 23:20:58.174460 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '7907c918-8df3-44bc-94f5-4fde965de66f'} Oct 10 23:20:58.175364 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:58.175364 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:58.175364 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:58.175364 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:58.175364 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:20:58.175364 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:20:58.175364 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:20:58.175364 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:20:58.175364 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:20:58.175364 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:20:58.175364 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7907c918-8df3-44bc-94f5-4fde965de66f could not be found. Oct 10 23:20:58.175364 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:58.175364 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:58.175364 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:58.175364 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:58.175364 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:58.175364 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:58.175364 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:58.175364 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:58.175364 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:58.176596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:58.176596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:20:58.176596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:20:58.176596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:58.176596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:58.176596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:58.176596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:58.176596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7907c918-8df3-44bc-94f5-4fde965de66f could not be found. Oct 10 23:20:58.176596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:58.176596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:58.176596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:58.176596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:58.176596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:58.176596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:58.176596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:58.176596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:58.176596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7907c918-8df3-44bc-94f5-4fde965de66f could not be found. Oct 10 23:20:58.176596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:58.179217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bd7c9273-6491-47c0-b6c4-e1e57552582c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Returning 404 to user: Instance 7907c918-8df3-44bc-94f5-4fde965de66f could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:58.181065 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bd7c9273-6491-47c0-b6c4-e1e57552582c tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/7907c918-8df3-44bc-94f5-4fde965de66f" status: 404 len: 111 microversion: 2.1 time: 0.060287 Oct 10 23:20:58.182135 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 614/1242] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:58 2022] GET /compute/v2.1/servers/7907c918-8df3-44bc-94f5-4fde965de66f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:58.192120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e48e00df-2d24-4fd2-ae9f-6a40f830a982 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:58.193692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e48e00df-2d24-4fd2-ae9f-6a40f830a982 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: c783f55d-ea82-4d94-a4f6-77591d412a02] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:58.200150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e48e00df-2d24-4fd2-ae9f-6a40f830a982 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:58.201842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e48e00df-2d24-4fd2-ae9f-6a40f830a982 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:58.202501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e48e00df-2d24-4fd2-ae9f-6a40f830a982 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:58.203464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e48e00df-2d24-4fd2-ae9f-6a40f830a982 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:58.204101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e48e00df-2d24-4fd2-ae9f-6a40f830a982 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:58.204733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e48e00df-2d24-4fd2-ae9f-6a40f830a982 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:58.216704 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-092fdc1c-67a2-4dc6-9371-9705d3665018 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "POST /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a/action" status: 202 len: 0 microversion: 2.1 time: 0.201387 Oct 10 23:20:58.220376 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 629/1243] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:20:58 2022] POST /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:20:58.229159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-081309d2-333d-4e25-b11c-fca87b9279cf tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:58.231352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-081309d2-333d-4e25-b11c-fca87b9279cf tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:58.241937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-081309d2-333d-4e25-b11c-fca87b9279cf tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:58.243098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-081309d2-333d-4e25-b11c-fca87b9279cf tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:58.244070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-081309d2-333d-4e25-b11c-fca87b9279cf tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:58.245060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-081309d2-333d-4e25-b11c-fca87b9279cf tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:58.245923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-081309d2-333d-4e25-b11c-fca87b9279cf tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:58.246047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:20:58.246161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-081309d2-333d-4e25-b11c-fca87b9279cf tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:58.250660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e48e00df-2d24-4fd2-ae9f-6a40f830a982 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:58.251136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e48e00df-2d24-4fd2-ae9f-6a40f830a982 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:58.251743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e48e00df-2d24-4fd2-ae9f-6a40f830a982 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:58.252370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-e48e00df-2d24-4fd2-ae9f-6a40f830a982 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lazy-loading 'fault' on Instance uuid c783f55d-ea82-4d94-a4f6-77591d412a02 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:20:58.320991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e48e00df-2d24-4fd2-ae9f-6a40f830a982 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:58.329776 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e48e00df-2d24-4fd2-ae9f-6a40f830a982 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02" status: 200 len: 1309 microversion: 2.1 time: 0.143001 Oct 10 23:20:58.330362 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 615/1244] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:58 2022] GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02 => generated 1309 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:58.339063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-696b261d-5b26-493f-b12e-d7f26373c4f6 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:58.339684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-696b261d-5b26-493f-b12e-d7f26373c4f6 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] [instance: bdf5220b-cc6e-4457-b00c-b4e02cf8f982] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:58.347512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-696b261d-5b26-493f-b12e-d7f26373c4f6 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:58.348420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-696b261d-5b26-493f-b12e-d7f26373c4f6 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:58.349084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-696b261d-5b26-493f-b12e-d7f26373c4f6 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:58.350137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-696b261d-5b26-493f-b12e-d7f26373c4f6 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:58.350775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-696b261d-5b26-493f-b12e-d7f26373c4f6 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:58.351364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-696b261d-5b26-493f-b12e-d7f26373c4f6 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:58.504710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-081309d2-333d-4e25-b11c-fca87b9279cf tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:58.528421 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-081309d2-333d-4e25-b11c-fca87b9279cf tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1537 microversion: 2.1 time: 0.303746 Oct 10 23:20:58.533652 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 630/1245] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:58 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1537 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:20:58.543485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-696b261d-5b26-493f-b12e-d7f26373c4f6 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:58.549498 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-97979270-dc94-4bcf-998c-ac1031377148 req-aa972f41-7220-444f-8f0b-7a72160ec206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7907c918-8df3-44bc-94f5-4fde965de66f", "name": "network-vif-deleted", "tag": "e3a0a0e5-3b6c-47c0-975a-49b336f25e2a"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:58.560591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-696b261d-5b26-493f-b12e-d7f26373c4f6 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:58.562200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-696b261d-5b26-493f-b12e-d7f26373c4f6 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:58.563888 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-696b261d-5b26-493f-b12e-d7f26373c4f6 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] 10.222.0.23 "GET /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982" status: 200 len: 1360 microversion: 2.47 time: 0.230916 Oct 10 23:20:58.564761 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 616/1246] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:58 2022] GET /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982 => generated 1360 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:58.569742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-37f17607-3b29-4555-8970-8c1b8957a77f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:58.570672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-37f17607-3b29-4555-8970-8c1b8957a77f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:58.578235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37f17607-3b29-4555-8970-8c1b8957a77f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:58.579070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37f17607-3b29-4555-8970-8c1b8957a77f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:58.579998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37f17607-3b29-4555-8970-8c1b8957a77f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:58.581101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37f17607-3b29-4555-8970-8c1b8957a77f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:58.581886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37f17607-3b29-4555-8970-8c1b8957a77f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:58.582539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37f17607-3b29-4555-8970-8c1b8957a77f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:58.582675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-97979270-dc94-4bcf-998c-ac1031377148 req-aa972f41-7220-444f-8f0b-7a72160ec206 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:58.583114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-97979270-dc94-4bcf-998c-ac1031377148 req-aa972f41-7220-444f-8f0b-7a72160ec206 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:58.584878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-97979270-dc94-4bcf-998c-ac1031377148 req-aa972f41-7220-444f-8f0b-7a72160ec206 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:58.612462 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-97979270-dc94-4bcf-998c-ac1031377148 req-aa972f41-7220-444f-8f0b-7a72160ec206 service nova] Creating event network-vif-deleted:e3a0a0e5-3b6c-47c0-975a-49b336f25e2a for instance 7907c918-8df3-44bc-94f5-4fde965de66f on n-h1-860864-2 Oct 10 23:20:58.644215 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-97979270-dc94-4bcf-998c-ac1031377148 req-aa972f41-7220-444f-8f0b-7a72160ec206 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106942 Oct 10 23:20:58.647541 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 631/1247] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:58.660734 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-10b8be83-3b3b-4fa4-bff6-e46ed493d92a tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-836722855"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:58.670182 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-10b8be83-3b3b-4fa4-bff6-e46ed493d92a tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] [instance: bdf5220b-cc6e-4457-b00c-b4e02cf8f982] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:58.687567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10b8be83-3b3b-4fa4-bff6-e46ed493d92a tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:58.688532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10b8be83-3b3b-4fa4-bff6-e46ed493d92a tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:58.689747 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10b8be83-3b3b-4fa4-bff6-e46ed493d92a tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:58.692042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10b8be83-3b3b-4fa4-bff6-e46ed493d92a tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:58.693004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10b8be83-3b3b-4fa4-bff6-e46ed493d92a tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:58.694967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10b8be83-3b3b-4fa4-bff6-e46ed493d92a tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:58.877514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-37f17607-3b29-4555-8970-8c1b8957a77f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:58.888712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-37f17607-3b29-4555-8970-8c1b8957a77f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:58.892160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-37f17607-3b29-4555-8970-8c1b8957a77f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:58.893652 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-37f17607-3b29-4555-8970-8c1b8957a77f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1567 microversion: 2.25 time: 0.327641 Oct 10 23:20:58.894535 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 617/1248] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:58 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1567 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:58.900443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a7650f25-8fd2-406a-a65c-43009c80ab04 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:58.901223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a7650f25-8fd2-406a-a65c-43009c80ab04 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:58.909501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7650f25-8fd2-406a-a65c-43009c80ab04 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:58.909857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7650f25-8fd2-406a-a65c-43009c80ab04 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:58.910303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7650f25-8fd2-406a-a65c-43009c80ab04 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:58.911006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7650f25-8fd2-406a-a65c-43009c80ab04 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:58.911461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7650f25-8fd2-406a-a65c-43009c80ab04 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:58.911887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7650f25-8fd2-406a-a65c-43009c80ab04 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:58.927590 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-a7650f25-8fd2-406a-a65c-43009c80ab04 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] HTTP exception thrown: Instance 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b could not be found. Oct 10 23:20:58.929142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a7650f25-8fd2-406a-a65c-43009c80ab04 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Request method failure captured: Oct 10 23:20:58.929142 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b HTTP/1.1 Oct 10 23:20:58.929142 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:20:58.929142 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:20:58.929142 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:20:58.929142 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:20:58.929142 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:20:58.929142 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:20:58.929142 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:20:58.929142 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:58.929142 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKiWDPhHeP1ao6Y5tHRbKvX9ZemW6vlLJ_C_MrPyGjEC179XpXPzYIbuoXBVNF4FDH7pzl8bOhuSRj1e7-5DcugU6k1KiwPFd9Qs6t3kjUe9RfKY0BXqex3wdvC4HjG24zVF2_841auDxOTWHziJVDjurPxpFpMsEGjqqP8S2TuKi34 Oct 10 23:20:58.929142 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:20:58.929142 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:20:58.929142 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:20:58.929142 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:20:58.929142 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:20:58.929142 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:20:58.929142 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:20:58.929142 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:20:58.929142 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:20:58.929142 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:20:58.930636 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_56fc65084a2a46689aa3b221e6d7aeb8", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:58.930636 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:20:58.930636 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:20:58.930636 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:20:58.930636 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:20:58.930636 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:20:58.930636 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:20:58.930636 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 9dfa7f1be9884bb1aabc9df8702fa630 Oct 10 23:20:58.930636 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:20:58.930636 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:20:58.930636 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b could not be found. Oct 10 23:20:58.930636 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '0dea3f22-ee85-4a3f-a4cd-a0634c6e451b'} Oct 10 23:20:58.931439 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:58.931439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:58.931439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:58.931439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:58.931439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:20:58.931439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:20:58.931439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:20:58.931439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:20:58.931439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:20:58.931439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:20:58.931439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b could not be found. Oct 10 23:20:58.931439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:58.931439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:58.931439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:58.931439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:58.931439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:58.931439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:58.931439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:58.931439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:58.931439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:58.933346 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:58.933346 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:20:58.933346 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:20:58.933346 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:58.933346 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:58.933346 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:58.933346 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:58.933346 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b could not be found. Oct 10 23:20:58.933346 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:58.933346 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:58.933346 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:58.933346 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:58.933346 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:58.933346 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:58.933346 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:58.933346 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:58.933346 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b could not be found. Oct 10 23:20:58.933346 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:20:58.935199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a7650f25-8fd2-406a-a65c-43009c80ab04 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Returning 404 to user: Instance 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:58.935199 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a7650f25-8fd2-406a-a65c-43009c80ab04 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 404 len: 111 microversion: 2.1 time: 0.034323 Oct 10 23:20:58.936266 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 618/1249] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:58 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:58.943083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-af02a570-35dd-4667-b153-814636e80044 req-d7ad1ad9-4e9c-45c7-bafb-93a324797db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8400778e-6c2d-4055-9799-5ec4e9ae0f1b", "name": "network-vif-deleted", "tag": "1b892abb-8814-4a04-bc5f-0a3e26cdf3a3"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:58.958307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-af02a570-35dd-4667-b153-814636e80044 req-d7ad1ad9-4e9c-45c7-bafb-93a324797db2 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:58.959277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-af02a570-35dd-4667-b153-814636e80044 req-d7ad1ad9-4e9c-45c7-bafb-93a324797db2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:58.959723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-af02a570-35dd-4667-b153-814636e80044 req-d7ad1ad9-4e9c-45c7-bafb-93a324797db2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:58.984013 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-af02a570-35dd-4667-b153-814636e80044 req-d7ad1ad9-4e9c-45c7-bafb-93a324797db2 service nova] Creating event network-vif-deleted:1b892abb-8814-4a04-bc5f-0a3e26cdf3a3 for instance 8400778e-6c2d-4055-9799-5ec4e9ae0f1b on n-h1-860864-2 Oct 10 23:20:58.998700 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-af02a570-35dd-4667-b153-814636e80044 req-d7ad1ad9-4e9c-45c7-bafb-93a324797db2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060697 Oct 10 23:20:58.999676 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 619/1250] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:20:59.005809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7effe8ba-aa9e-4ee7-a95b-1fd04df0f262 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662b596ca0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:59.017532 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-10b8be83-3b3b-4fa4-bff6-e46ed493d92a tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] 10.222.0.23 "POST /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982/action" status: 202 len: 52 microversion: 2.47 time: 0.365483 Oct 10 23:20:59.025253 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 632/1251] 10.222.0.23 () {62 vars in 1319 bytes} [Mon Oct 10 23:20:58 2022] POST /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982/action => generated 52 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 10 23:20:59.033464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6155c3de-bb76-45f1-b0d7-a6eed0c9cfd7 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:59.034478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6155c3de-bb76-45f1-b0d7-a6eed0c9cfd7 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] [instance: bdf5220b-cc6e-4457-b00c-b4e02cf8f982] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:59.052477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6155c3de-bb76-45f1-b0d7-a6eed0c9cfd7 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:59.052797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6155c3de-bb76-45f1-b0d7-a6eed0c9cfd7 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:59.054240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6155c3de-bb76-45f1-b0d7-a6eed0c9cfd7 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:59.055387 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6155c3de-bb76-45f1-b0d7-a6eed0c9cfd7 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:59.058752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6155c3de-bb76-45f1-b0d7-a6eed0c9cfd7 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:59.059517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6155c3de-bb76-45f1-b0d7-a6eed0c9cfd7 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:59.104063 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6155c3de-bb76-45f1-b0d7-a6eed0c9cfd7 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] [instance: bdf5220b-cc6e-4457-b00c-b4e02cf8f982] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:20:59.241676 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6155c3de-bb76-45f1-b0d7-a6eed0c9cfd7 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982" status: 204 len: 0 microversion: 2.47 time: 0.208113 Oct 10 23:20:59.242651 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 633/1252] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:20:59 2022] DELETE /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 10 23:20:59.256021 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e45be26a-5fb9-4397-92b7-eb061ff5e143 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:59.257790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e45be26a-5fb9-4397-92b7-eb061ff5e143 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:59.269948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e45be26a-5fb9-4397-92b7-eb061ff5e143 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:59.270478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e45be26a-5fb9-4397-92b7-eb061ff5e143 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:59.271051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e45be26a-5fb9-4397-92b7-eb061ff5e143 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:59.276777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e45be26a-5fb9-4397-92b7-eb061ff5e143 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:59.277328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e45be26a-5fb9-4397-92b7-eb061ff5e143 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:59.279915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e45be26a-5fb9-4397-92b7-eb061ff5e143 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:59.313183 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7effe8ba-aa9e-4ee7-a95b-1fd04df0f262 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/809fd1e8-f9ce-41a2-a9f2-48418ee34c3d" status: 202 len: 0 microversion: 2.1 time: 0.312223 Oct 10 23:20:59.314095 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 620/1253] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:20:58 2022] DELETE /compute/v2.1/os-security-groups/809fd1e8-f9ce-41a2-a9f2-48418ee34c3d => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:20:59.324123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6a5384d8-4c42-47b1-bdf3-6779c642ad84 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:59.325044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6a5384d8-4c42-47b1-bdf3-6779c642ad84 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] [instance: bdf5220b-cc6e-4457-b00c-b4e02cf8f982] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:59.332426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a5384d8-4c42-47b1-bdf3-6779c642ad84 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:59.332959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a5384d8-4c42-47b1-bdf3-6779c642ad84 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:59.333418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a5384d8-4c42-47b1-bdf3-6779c642ad84 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:59.334330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a5384d8-4c42-47b1-bdf3-6779c642ad84 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:59.334943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a5384d8-4c42-47b1-bdf3-6779c642ad84 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:59.335528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a5384d8-4c42-47b1-bdf3-6779c642ad84 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:59.355439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e45be26a-5fb9-4397-92b7-eb061ff5e143 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:59.355989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e45be26a-5fb9-4397-92b7-eb061ff5e143 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:59.356460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e45be26a-5fb9-4397-92b7-eb061ff5e143 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:59.357247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-e45be26a-5fb9-4397-92b7-eb061ff5e143 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lazy-loading 'fault' on Instance uuid 8400778e-6c2d-4055-9799-5ec4e9ae0f1b {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:20:59.447770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6a5384d8-4c42-47b1-bdf3-6779c642ad84 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:59.458349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6a5384d8-4c42-47b1-bdf3-6779c642ad84 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:59.460158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6a5384d8-4c42-47b1-bdf3-6779c642ad84 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:59.461998 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6a5384d8-4c42-47b1-bdf3-6779c642ad84 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] 10.222.0.23 "GET /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982" status: 200 len: 1366 microversion: 2.47 time: 0.146959 Oct 10 23:20:59.469900 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 621/1254] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:59 2022] GET /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:20:59.477324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e45be26a-5fb9-4397-92b7-eb061ff5e143 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc50e8356193429f9e70f4c4be6d5fff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b891937a0ec146f88efac2b3d43f3e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:59.479132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-54c3b681-d243-4ee6-99fc-0eaabe78fd82 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662b94bf70>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:59.496188 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e45be26a-5fb9-4397-92b7-eb061ff5e143 tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 200 len: 1311 microversion: 2.1 time: 0.247627 Oct 10 23:20:59.501479 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 634/1255] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:59 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 1311 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:59.508135 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6898d326-f4ca-4056-a1ec-713d860d32ee tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:59.508752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6898d326-f4ca-4056-a1ec-713d860d32ee tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: c783f55d-ea82-4d94-a4f6-77591d412a02] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:59.515905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6898d326-f4ca-4056-a1ec-713d860d32ee tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:59.516389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6898d326-f4ca-4056-a1ec-713d860d32ee tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:59.517079 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6898d326-f4ca-4056-a1ec-713d860d32ee tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:59.517544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6898d326-f4ca-4056-a1ec-713d860d32ee tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:59.517996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6898d326-f4ca-4056-a1ec-713d860d32ee tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:59.518411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6898d326-f4ca-4056-a1ec-713d860d32ee tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:59.537577 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-6898d326-f4ca-4056-a1ec-713d860d32ee tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] HTTP exception thrown: Instance c783f55d-ea82-4d94-a4f6-77591d412a02 could not be found. Oct 10 23:20:59.537577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6898d326-f4ca-4056-a1ec-713d860d32ee tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Request method failure captured: Oct 10 23:20:59.537577 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02 HTTP/1.1 Oct 10 23:20:59.537577 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:20:59.537577 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:20:59.537577 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:20:59.537577 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:20:59.537577 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:20:59.537577 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:20:59.537577 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:20:59.537577 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:20:59.537577 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgJCGPRazsPZv_KJRTPkW4yfXkftWI99r6NM1NcPzbV6ezzFy8Kk0KC2fs-Oq1mdxcQ8vpiKa4rTjWrgHH8KDGbQArWJeSLbZnpz5njlegxl252rFp2J2t_YkO8EBZX2N9DD656V96Tu1xc3xvEKd_hjW4bndDcX9tluGi3sznnXco Oct 10 23:20:59.537577 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:20:59.537577 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:20:59.537577 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:20:59.537577 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:20:59.537577 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:20:59.537577 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:20:59.537577 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: d98b12fc1bbf42d4b7376222c55733ed Oct 10 23:20:59.537577 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:20:59.537577 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:20:59.537577 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:20:59.539594 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d98b12fc1bbf42d4b7376222c55733ed", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:20:59.539594 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:20:59.539594 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: d98b12fc1bbf42d4b7376222c55733ed Oct 10 23:20:59.539594 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:20:59.539594 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersOnMultiNodesTest-1123459593-project Oct 10 23:20:59.539594 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:20:59.539594 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:20:59.539594 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 310196e1663a4f7ca12e1fc53b0278ba Oct 10 23:20:59.539594 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersOnMultiNodesTest-1123459593-project Oct 10 23:20:59.539594 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:20:59.539594 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance c783f55d-ea82-4d94-a4f6-77591d412a02 could not be found. Oct 10 23:20:59.539594 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'c783f55d-ea82-4d94-a4f6-77591d412a02'} Oct 10 23:20:59.540544 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:20:59.540544 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:59.540544 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:20:59.540544 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:20:59.540544 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:20:59.540544 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:20:59.540544 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:20:59.540544 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:20:59.540544 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:20:59.540544 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:20:59.540544 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c783f55d-ea82-4d94-a4f6-77591d412a02 could not be found. Oct 10 23:20:59.540544 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:59.540544 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:59.540544 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:59.540544 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:59.540544 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:59.540544 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:59.540544 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:20:59.540544 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:20:59.540544 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:20:59.542035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:20:59.542035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:20:59.542035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:20:59.542035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:20:59.542035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:20:59.542035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:20:59.542035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:20:59.542035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c783f55d-ea82-4d94-a4f6-77591d412a02 could not be found. Oct 10 23:20:59.542035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:59.542035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:20:59.542035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:59.542035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:20:59.542035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:20:59.542035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:20:59.542035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:20:59.542035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:20:59.542035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c783f55d-ea82-4d94-a4f6-77591d412a02 could not be found. Oct 10 23:20:59.542035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:20:59.543319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6898d326-f4ca-4056-a1ec-713d860d32ee tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Returning 404 to user: Instance c783f55d-ea82-4d94-a4f6-77591d412a02 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:20:59.543319 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6898d326-f4ca-4056-a1ec-713d860d32ee tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02" status: 404 len: 111 microversion: 2.1 time: 0.039668 Oct 10 23:20:59.543319 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 635/1256] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:59 2022] GET /compute/v2.1/servers/c783f55d-ea82-4d94-a4f6-77591d412a02 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:20:59.546950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-380337d2-9ccf-4932-8a49-b2abb106e394 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:59.579383 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-380337d2-9ccf-4932-8a49-b2abb106e394 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/a3002422-b16d-498d-8c8b-e67d1ef376e7" status: 204 len: 0 microversion: 2.1 time: 0.036489 Oct 10 23:20:59.579962 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 636/1257] 10.222.0.23 () {58 vars in 1266 bytes} [Mon Oct 10 23:20:59 2022] DELETE /compute/v2.1/os-server-groups/a3002422-b16d-498d-8c8b-e67d1ef376e7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:20:59.585570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7e8cfd95-5fe6-4db3-b7a2-b116cd058cf3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:59.586185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7e8cfd95-5fe6-4db3-b7a2-b116cd058cf3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:59.592971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e8cfd95-5fe6-4db3-b7a2-b116cd058cf3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:59.593490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e8cfd95-5fe6-4db3-b7a2-b116cd058cf3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:59.593925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e8cfd95-5fe6-4db3-b7a2-b116cd058cf3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:59.594623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e8cfd95-5fe6-4db3-b7a2-b116cd058cf3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:59.595056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e8cfd95-5fe6-4db3-b7a2-b116cd058cf3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:59.595498 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e8cfd95-5fe6-4db3-b7a2-b116cd058cf3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:59.712757 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-54c3b681-d243-4ee6-99fc-0eaabe78fd82 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/25f1402f-1fb7-4e2d-a72f-da95199566c2" status: 202 len: 0 microversion: 2.1 time: 0.241376 Oct 10 23:20:59.714168 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 622/1258] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:20:59 2022] DELETE /compute/v2.1/os-security-groups/25f1402f-1fb7-4e2d-a72f-da95199566c2 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:20:59.719458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8eed7ffd-8c2a-46b9-b327-5266215428cd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:59.720255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8eed7ffd-8c2a-46b9-b327-5266215428cd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 90aa3419-44a6-4b0d-9af1-5f6df3554b71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:59.739491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8eed7ffd-8c2a-46b9-b327-5266215428cd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:59.740270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8eed7ffd-8c2a-46b9-b327-5266215428cd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:59.742268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8eed7ffd-8c2a-46b9-b327-5266215428cd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:59.743535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8eed7ffd-8c2a-46b9-b327-5266215428cd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:59.747729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8eed7ffd-8c2a-46b9-b327-5266215428cd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:59.748454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8eed7ffd-8c2a-46b9-b327-5266215428cd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:59.800102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7e8cfd95-5fe6-4db3-b7a2-b116cd058cf3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:20:59.807297 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7e8cfd95-5fe6-4db3-b7a2-b116cd058cf3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1537 microversion: 2.1 time: 0.225911 Oct 10 23:20:59.807950 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 637/1259] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:20:59 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1537 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:20:59.810698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8eed7ffd-8c2a-46b9-b327-5266215428cd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 90aa3419-44a6-4b0d-9af1-5f6df3554b71] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:20:59.812470 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e12c8658-86c6-4fb7-9614-0297ea82667d tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Action: 'create', calling method: .version_select at 0x7f662b3404c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-74821743", "description": "tempest-description-579385751"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:20:59.943812 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8eed7ffd-8c2a-46b9-b327-5266215428cd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "DELETE /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71" status: 204 len: 0 microversion: 2.1 time: 0.227556 Oct 10 23:20:59.944635 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 623/1260] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:20:59 2022] DELETE /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:20:59.951458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f2da536f-7d41-4448-81b7-5ed95f9f5714 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:20:59.952439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f2da536f-7d41-4448-81b7-5ed95f9f5714 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:20:59.960469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2da536f-7d41-4448-81b7-5ed95f9f5714 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:59.961636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2da536f-7d41-4448-81b7-5ed95f9f5714 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:59.962081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2da536f-7d41-4448-81b7-5ed95f9f5714 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:20:59.963256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2da536f-7d41-4448-81b7-5ed95f9f5714 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:20:59.963882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2da536f-7d41-4448-81b7-5ed95f9f5714 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:20:59.964317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2da536f-7d41-4448-81b7-5ed95f9f5714 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:00.063125 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e12c8658-86c6-4fb7-9614-0297ea82667d tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.253998 Oct 10 23:21:00.063686 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 638/1261] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:20:59 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:00.069580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-546ecc48-af75-4309-956f-7afefa75eee3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:00.070744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-546ecc48-af75-4309-956f-7afefa75eee3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 90aa3419-44a6-4b0d-9af1-5f6df3554b71] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:00.081420 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-546ecc48-af75-4309-956f-7afefa75eee3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:00.082102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-546ecc48-af75-4309-956f-7afefa75eee3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:00.082602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-546ecc48-af75-4309-956f-7afefa75eee3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:00.083521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-546ecc48-af75-4309-956f-7afefa75eee3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:00.084216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-546ecc48-af75-4309-956f-7afefa75eee3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:00.084783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-546ecc48-af75-4309-956f-7afefa75eee3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:00.131078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f2da536f-7d41-4448-81b7-5ed95f9f5714 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:00.141327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f2da536f-7d41-4448-81b7-5ed95f9f5714 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:00.142846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f2da536f-7d41-4448-81b7-5ed95f9f5714 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:00.144256 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f2da536f-7d41-4448-81b7-5ed95f9f5714 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1542 microversion: 2.25 time: 0.198473 Oct 10 23:21:00.145334 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 624/1262] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:20:59 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1542 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:00.151744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-05100fc9-b71f-4bd5-bdb1-ac1471e017ee tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Action: 'update', calling method: .version_select at 0x7f662bb9c700>, body: {"security_group": {"name": "tempest-sg-hth-1977593947", "description": "tempest-description-hth-808545936"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:00.244073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-546ecc48-af75-4309-956f-7afefa75eee3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:00.253075 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-546ecc48-af75-4309-956f-7afefa75eee3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71" status: 200 len: 1473 microversion: 2.1 time: 0.188039 Oct 10 23:21:00.253688 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 639/1263] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:00 2022] GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71 => generated 1473 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:00.257979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b0ea6ade-3c11-4405-a8b4-9543b6a36324 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Calling method '.version_select at 0x7f662b5dd9d0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:00.261355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0ea6ade-3c11-4405-a8b4-9543b6a36324 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:00.261872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0ea6ade-3c11-4405-a8b4-9543b6a36324 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:00.262313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0ea6ade-3c11-4405-a8b4-9543b6a36324 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:00.265795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:00.274785 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b0ea6ade-3c11-4405-a8b4-9543b6a36324 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 3155 microversion: 2.25 time: 0.020108 Oct 10 23:21:00.275397 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 640/1264] 10.222.0.23 () {60 vars in 1184 bytes} [Mon Oct 10 23:21:00 2022] GET /compute/v2.1/os-migrations => generated 3155 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:00.311389 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-05100fc9-b71f-4bd5-bdb1-ac1471e017ee tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "PUT /compute/v2.1/os-security-groups/0c614002-ed3a-4e9e-a979-e2325601c3e0" status: 200 len: 217 microversion: 2.1 time: 0.164605 Oct 10 23:21:00.320691 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 625/1265] 10.222.0.23 () {60 vars in 1290 bytes} [Mon Oct 10 23:21:00 2022] PUT /compute/v2.1/os-security-groups/0c614002-ed3a-4e9e-a979-e2325601c3e0 => generated 217 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:00.325777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e6193405-9c6f-4a7b-b885-bcb5b8ff3a0f tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:00.326803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e6193405-9c6f-4a7b-b885-bcb5b8ff3a0f tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:00.333850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6193405-9c6f-4a7b-b885-bcb5b8ff3a0f tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:00.334667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6193405-9c6f-4a7b-b885-bcb5b8ff3a0f tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:00.335376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6193405-9c6f-4a7b-b885-bcb5b8ff3a0f tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:00.336276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6193405-9c6f-4a7b-b885-bcb5b8ff3a0f tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:00.336777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6193405-9c6f-4a7b-b885-bcb5b8ff3a0f tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:00.337207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6193405-9c6f-4a7b-b885-bcb5b8ff3a0f tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:00.409081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e8af7470-0f4a-4af9-9b07-66152bfcb469 tempest-InstanceUsageAuditLogNegativeTestJSON-142732698 tempest-InstanceUsageAuditLogNegativeTestJSON-142732698-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:00.410624 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-e8af7470-0f4a-4af9-9b07-66152bfcb469 tempest-InstanceUsageAuditLogNegativeTestJSON-142732698 tempest-InstanceUsageAuditLogNegativeTestJSON-142732698-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 10 23:21:00.415476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e8af7470-0f4a-4af9-9b07-66152bfcb469 tempest-InstanceUsageAuditLogNegativeTestJSON-142732698 tempest-InstanceUsageAuditLogNegativeTestJSON-142732698-project-admin] Request method failure captured: Oct 10 23:21:00.415476 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 10 23:21:00.415476 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:21:00.415476 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:21:00.415476 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:21:00.415476 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:21:00.415476 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:21:00.415476 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:21:00.415476 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:21:00.415476 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:00.415476 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKjcIUVasRL6UzHsES66MJrIyqGMW9PlyLVpGAe1DE0Z7x8lZmbSVbvujbZTy3KRqOPyv3wZLOWvxFrqEvEzC12Wk5Zv_s8EvfFLGjRVmEHSF7lb7iAerTOWM3dyP8tg8QR0Ul4_VxehO2DBs7zZc7ltHONNkqo1uqZg21LuzZkocSE Oct 10 23:21:00.415476 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:21:00.415476 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:21:00.415476 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:21:00.415476 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:21:00.415476 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:21:00.415476 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:21:00.415476 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 2458c84a1514473592369e3b89c8d4ef Oct 10 23:21:00.415476 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-142732698 Oct 10 23:21:00.415476 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:21:00.415476 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:21:00.416879 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2458c84a1514473592369e3b89c8d4ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2458c84a1514473592369e3b89c8d4ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2458c84a1514473592369e3b89c8d4ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2458c84a1514473592369e3b89c8d4ef", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:00.416879 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-142732698 Oct 10 23:21:00.416879 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 2458c84a1514473592369e3b89c8d4ef Oct 10 23:21:00.416879 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-142732698 Oct 10 23:21:00.416879 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-142732698-project-admin Oct 10 23:21:00.416879 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:21:00.416879 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:21:00.416879 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 50af4dca91fa49e1a7ae840c069eca8b Oct 10 23:21:00.416879 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-142732698-project-admin Oct 10 23:21:00.416879 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:21:00.416879 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid timestamp for date invalid_time Oct 10 23:21:00.417778 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'invalid_time'} Oct 10 23:21:00.417778 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:00.417778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.417778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 10 23:21:00.417778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 10 23:21:00.417778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 10 23:21:00.417778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 10 23:21:00.417778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 10 23:21:00.417778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 10 23:21:00.417778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 10 23:21:00.417778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.417778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:00.417778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.417778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.417778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:00.417778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:00.417778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:00.417778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:00.417778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:00.417778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:00.419795 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 10 23:21:00.419795 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 10 23:21:00.419795 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 10 23:21:00.419795 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.419795 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:00.419795 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.419795 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.419795 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:00.419795 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:00.419795 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:21:00.419795 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:21:00.419795 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 10 23:21:00.419795 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.419795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e8af7470-0f4a-4af9-9b07-66152bfcb469 tempest-InstanceUsageAuditLogNegativeTestJSON-142732698 tempest-InstanceUsageAuditLogNegativeTestJSON-142732698-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:00.419795 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e8af7470-0f4a-4af9-9b07-66152bfcb469 tempest-InstanceUsageAuditLogNegativeTestJSON-142732698 tempest-InstanceUsageAuditLogNegativeTestJSON-142732698-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.140587 Oct 10 23:21:00.420816 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 641/1266] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Oct 10 23:21:00 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 23:21:00.423752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-df20407e-0af2-4533-a7e7-b1c7424d33dd tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662b9cd160>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:00.471828 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-df20407e-0af2-4533-a7e7-b1c7424d33dd tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/0c614002-ed3a-4e9e-a979-e2325601c3e0" status: 200 len: 217 microversion: 2.1 time: 0.053226 Oct 10 23:21:00.472535 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 642/1267] 10.222.0.23 () {58 vars in 1269 bytes} [Mon Oct 10 23:21:00 2022] GET /compute/v2.1/os-security-groups/0c614002-ed3a-4e9e-a979-e2325601c3e0 => generated 217 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:00.476306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-e6193405-9c6f-4a7b-b885-bcb5b8ff3a0f tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lazy-loading 'services' on Instance uuid c3bb20a8-8b13-470d-ac2b-50b7a7bea206 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:21:00.491560 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e6193405-9c6f-4a7b-b885-bcb5b8ff3a0f tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 2035 microversion: 2.25 time: 0.169682 Oct 10 23:21:00.492171 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 626/1268] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:00 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 2035 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:00.496815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2eb0d13b-c863-4eee-96f9-63cda1e13457 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662b98f790>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:00.598691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-72a8898c-c9b8-410c-bb61-2d1d85b239c3 tempest-InstanceUsageAuditLogNegativeTestJSON-112350531 tempest-InstanceUsageAuditLogNegativeTestJSON-112350531-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:00.600411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-72a8898c-c9b8-410c-bb61-2d1d85b239c3 tempest-InstanceUsageAuditLogNegativeTestJSON-112350531 tempest-InstanceUsageAuditLogNegativeTestJSON-112350531-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '97a4200b21014b36851b799fc8c11950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e1bddc663b44f29acb0b9ee0d344b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:00.601994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-72a8898c-c9b8-410c-bb61-2d1d85b239c3 tempest-InstanceUsageAuditLogNegativeTestJSON-112350531 tempest-InstanceUsageAuditLogNegativeTestJSON-112350531-project] Request method failure captured: Oct 10 23:21:00.601994 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 10 23:21:00.601994 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:21:00.601994 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:21:00.601994 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:21:00.601994 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:21:00.601994 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:21:00.601994 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:21:00.601994 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:21:00.601994 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:00.601994 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKjbFul2XaL48timhXXIfbudZk9WBm6KwC-Es1gpS8yjJUqQotud8obg-tmY0GOV9t4sypGMctNQFil5LnBEGaVZ8MRbwi74xBDdYRyNnJdim55q5d7ximBNienYjyOl5R8x3OYA3ROm-e9pV5wnmOVtm9gCRW2a-wOt8n5l4Itkixo Oct 10 23:21:00.601994 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:21:00.601994 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:21:00.601994 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:21:00.601994 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:21:00.601994 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:21:00.601994 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:21:00.601994 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 80e1bddc663b44f29acb0b9ee0d344b0 Oct 10 23:21:00.601994 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-112350531 Oct 10 23:21:00.601994 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:21:00.601994 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:21:00.603418 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/80e1bddc663b44f29acb0b9ee0d344b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/80e1bddc663b44f29acb0b9ee0d344b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/80e1bddc663b44f29acb0b9ee0d344b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_80e1bddc663b44f29acb0b9ee0d344b0", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:00.603418 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-112350531 Oct 10 23:21:00.603418 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 80e1bddc663b44f29acb0b9ee0d344b0 Oct 10 23:21:00.603418 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-112350531 Oct 10 23:21:00.603418 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-112350531-project Oct 10 23:21:00.603418 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:21:00.603418 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:21:00.603418 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 97a4200b21014b36851b799fc8c11950 Oct 10 23:21:00.603418 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-112350531-project Oct 10 23:21:00.603418 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:21:00.604117 n-d-860864-2 devstack@n-api.service[120614]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 10 23:21:00.604117 n-d-860864-2 devstack@n-api.service[120614]: action_args: {} Oct 10 23:21:00.604117 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:00.604117 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.604117 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:00.604117 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:00.604117 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:00.604117 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:00.604117 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:00.604117 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:00.604117 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 10 23:21:00.604117 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 10 23:21:00.604117 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:21:00.604117 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:21:00.604117 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:21:00.604117 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:21:00.604117 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:21:00.604117 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:21:00.604117 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:21:00.604117 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:21:00.606208 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:21:00.606208 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:21:00.606208 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:21:00.606208 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:21:00.606208 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:21:00.606208 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:21:00.606208 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 10 23:21:00.606208 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.606208 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:00.606208 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.606208 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.606208 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:00.606208 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:00.606208 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:21:00.606208 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:21:00.606208 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 10 23:21:00.606208 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.607631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-72a8898c-c9b8-410c-bb61-2d1d85b239c3 tempest-InstanceUsageAuditLogNegativeTestJSON-112350531 tempest-InstanceUsageAuditLogNegativeTestJSON-112350531-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:00.607631 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-72a8898c-c9b8-410c-bb61-2d1d85b239c3 tempest-InstanceUsageAuditLogNegativeTestJSON-112350531 tempest-InstanceUsageAuditLogNegativeTestJSON-112350531-project] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.129793 Oct 10 23:21:00.607631 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 643/1269] 10.222.0.23 () {58 vars in 1185 bytes} [Mon Oct 10 23:21:00 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 131 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:21:00.608240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9c6b1f05-f4a9-43a4-8f07-84e13bd8500b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:00.608853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9c6b1f05-f4a9-43a4-8f07-84e13bd8500b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] [instance: bdf5220b-cc6e-4457-b00c-b4e02cf8f982] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:00.624737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c6b1f05-f4a9-43a4-8f07-84e13bd8500b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:00.625241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c6b1f05-f4a9-43a4-8f07-84e13bd8500b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:00.625722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c6b1f05-f4a9-43a4-8f07-84e13bd8500b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:00.626441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c6b1f05-f4a9-43a4-8f07-84e13bd8500b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:00.626906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c6b1f05-f4a9-43a4-8f07-84e13bd8500b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:00.627323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c6b1f05-f4a9-43a4-8f07-84e13bd8500b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:00.679404 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2eb0d13b-c863-4eee-96f9-63cda1e13457 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/0c614002-ed3a-4e9e-a979-e2325601c3e0" status: 202 len: 0 microversion: 2.1 time: 0.186002 Oct 10 23:21:00.683128 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 627/1270] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:21:00 2022] DELETE /compute/v2.1/os-security-groups/0c614002-ed3a-4e9e-a979-e2325601c3e0 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:21:00.687658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d457fb45-a93a-41b4-8eec-9e693b13ad5a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:00.688336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d457fb45-a93a-41b4-8eec-9e693b13ad5a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] [instance: 8400778e-6c2d-4055-9799-5ec4e9ae0f1b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:00.696502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9c6b1f05-f4a9-43a4-8f07-84e13bd8500b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:00.697054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d457fb45-a93a-41b4-8eec-9e693b13ad5a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:00.697580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d457fb45-a93a-41b4-8eec-9e693b13ad5a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:00.698234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d457fb45-a93a-41b4-8eec-9e693b13ad5a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:00.699901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d457fb45-a93a-41b4-8eec-9e693b13ad5a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:00.700357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d457fb45-a93a-41b4-8eec-9e693b13ad5a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:00.702183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d457fb45-a93a-41b4-8eec-9e693b13ad5a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:00.706475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9c6b1f05-f4a9-43a4-8f07-84e13bd8500b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:00.708248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9c6b1f05-f4a9-43a4-8f07-84e13bd8500b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:00.709446 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9c6b1f05-f4a9-43a4-8f07-84e13bd8500b tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] 10.222.0.23 "GET /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982" status: 200 len: 1366 microversion: 2.47 time: 0.104705 Oct 10 23:21:00.710521 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 644/1271] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:00 2022] GET /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982 => generated 1366 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:00.716096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4aa0cb5d-d8e5-4997-83fa-ffdaef3c5329 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Action: 'create', calling method: .version_select at 0x7f662b9c1940>, body: {"keypair": {"name": "tempest-keypair-1107002667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3557ot/J+c0LYO4W3aU+vpOnloNLizJzfEx20KbUbimMRrMRX2kMo6ugWPDfQU1X96Z9g2hKr3FAcCXhdxKqRZBALznbOZh4uJFiQu1WtDVRjzF0WQ02WDVpI2t9aRQA=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:00.723241 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-d457fb45-a93a-41b4-8eec-9e693b13ad5a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] HTTP exception thrown: Instance 8400778e-6c2d-4055-9799-5ec4e9ae0f1b could not be found. Oct 10 23:21:00.725689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d457fb45-a93a-41b4-8eec-9e693b13ad5a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Request method failure captured: Oct 10 23:21:00.725689 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b HTTP/1.1 Oct 10 23:21:00.725689 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:21:00.725689 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:21:00.725689 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:21:00.725689 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:21:00.725689 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:21:00.725689 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:21:00.725689 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:21:00.725689 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:00.725689 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKiAlVLEDIUo4Z4vpkSnaW_Ec9-QFQhvTEPmeVPuO5tzvRe8IKXj6O9WPze3enINXPkDbYXSZC-UH_ZWsolabXfE40ZbU-ispXAQCJOEOeZkq49812HaEAX7yfvRRFarvzY_3VWiyeMjy8pLo8a2jNK0yjroXtDpKeZVkrSeTr42CS4 Oct 10 23:21:00.725689 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:21:00.725689 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:21:00.725689 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:21:00.725689 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:21:00.725689 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:21:00.725689 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:21:00.725689 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: b891937a0ec146f88efac2b3d43f3e00 Oct 10 23:21:00.725689 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ListServerFiltersTestJSON-1138482225 Oct 10 23:21:00.725689 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:21:00.725689 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:21:00.727390 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b891937a0ec146f88efac2b3d43f3e00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b891937a0ec146f88efac2b3d43f3e00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b891937a0ec146f88efac2b3d43f3e00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b891937a0ec146f88efac2b3d43f3e00", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:00.727390 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ListServerFiltersTestJSON-1138482225 Oct 10 23:21:00.727390 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: b891937a0ec146f88efac2b3d43f3e00 Oct 10 23:21:00.727390 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1138482225 Oct 10 23:21:00.727390 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ListServerFiltersTestJSON-1138482225-project Oct 10 23:21:00.727390 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:21:00.727390 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:21:00.727390 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: cc50e8356193429f9e70f4c4be6d5fff Oct 10 23:21:00.727390 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ListServerFiltersTestJSON-1138482225-project Oct 10 23:21:00.727390 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:21:00.727390 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 8400778e-6c2d-4055-9799-5ec4e9ae0f1b could not be found. Oct 10 23:21:00.727390 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '8400778e-6c2d-4055-9799-5ec4e9ae0f1b'} Oct 10 23:21:00.728309 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:00.728309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.728309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:21:00.728309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:21:00.728309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:21:00.728309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:21:00.728309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:21:00.728309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:21:00.728309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:21:00.728309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:21:00.728309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8400778e-6c2d-4055-9799-5ec4e9ae0f1b could not be found. Oct 10 23:21:00.728309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.728309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:00.728309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.728309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.728309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:00.728309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:00.728309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:00.728309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:00.728309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:00.730009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:00.730009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:21:00.730009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:21:00.730009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:21:00.730009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:21:00.730009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:21:00.730009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:21:00.730009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8400778e-6c2d-4055-9799-5ec4e9ae0f1b could not be found. Oct 10 23:21:00.730009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.730009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:00.730009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.730009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.730009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:00.730009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:00.730009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:21:00.730009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:21:00.730009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8400778e-6c2d-4055-9799-5ec4e9ae0f1b could not be found. Oct 10 23:21:00.730009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.731422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d457fb45-a93a-41b4-8eec-9e693b13ad5a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] Returning 404 to user: Instance 8400778e-6c2d-4055-9799-5ec4e9ae0f1b could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:00.731422 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d457fb45-a93a-41b4-8eec-9e693b13ad5a tempest-ListServerFiltersTestJSON-1138482225 tempest-ListServerFiltersTestJSON-1138482225-project] 10.222.0.23 "GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b" status: 404 len: 111 microversion: 2.1 time: 0.049301 Oct 10 23:21:00.731799 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 628/1272] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:00 2022] GET /compute/v2.1/servers/8400778e-6c2d-4055-9799-5ec4e9ae0f1b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:21:00.736949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-41e8e589-a516-45a4-afd8-3723c9aaf682 tempest-InstanceUsageAuditLogNegativeTestJSON-112350531 tempest-InstanceUsageAuditLogNegativeTestJSON-112350531-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:00.738817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-41e8e589-a516-45a4-afd8-3723c9aaf682 tempest-InstanceUsageAuditLogNegativeTestJSON-112350531 tempest-InstanceUsageAuditLogNegativeTestJSON-112350531-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '97a4200b21014b36851b799fc8c11950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80e1bddc663b44f29acb0b9ee0d344b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:00.740856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-41e8e589-a516-45a4-afd8-3723c9aaf682 tempest-InstanceUsageAuditLogNegativeTestJSON-112350531 tempest-InstanceUsageAuditLogNegativeTestJSON-112350531-project] Request method failure captured: Oct 10 23:21:00.740856 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-10%2023:21:00 HTTP/1.1 Oct 10 23:21:00.740856 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:21:00.740856 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:21:00.740856 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:21:00.740856 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:21:00.740856 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:21:00.740856 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:21:00.740856 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:21:00.740856 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:00.740856 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKjbFul2XaL48timhXXIfbudZk9WBm6KwC-Es1gpS8yjJUqQotud8obg-tmY0GOV9t4sypGMctNQFil5LnBEGaVZ8MRbwi74xBDdYRyNnJdim55q5d7ximBNienYjyOl5R8x3OYA3ROm-e9pV5wnmOVtm9gCRW2a-wOt8n5l4Itkixo Oct 10 23:21:00.740856 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:21:00.740856 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:21:00.740856 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:21:00.740856 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:21:00.740856 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:21:00.740856 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:21:00.740856 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 80e1bddc663b44f29acb0b9ee0d344b0 Oct 10 23:21:00.740856 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-112350531 Oct 10 23:21:00.740856 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:21:00.740856 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:21:00.742273 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/80e1bddc663b44f29acb0b9ee0d344b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/80e1bddc663b44f29acb0b9ee0d344b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/80e1bddc663b44f29acb0b9ee0d344b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_80e1bddc663b44f29acb0b9ee0d344b0", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:00.742273 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-112350531 Oct 10 23:21:00.742273 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 80e1bddc663b44f29acb0b9ee0d344b0 Oct 10 23:21:00.742273 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-112350531 Oct 10 23:21:00.742273 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-112350531-project Oct 10 23:21:00.742273 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:21:00.742273 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:21:00.742273 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 97a4200b21014b36851b799fc8c11950 Oct 10 23:21:00.742273 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-112350531-project Oct 10 23:21:00.742273 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:21:00.742920 n-d-860864-2 devstack@n-api.service[120613]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 10 23:21:00.742920 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '2022-10-10 23:21:00'} Oct 10 23:21:00.742920 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:00.742920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.742920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:00.742920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:00.742920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:00.742920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:00.742920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:00.742920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:00.742920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 10 23:21:00.742920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 10 23:21:00.742920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:21:00.742920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:21:00.742920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:21:00.742920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:21:00.742920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:21:00.742920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:21:00.742920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:21:00.742920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:21:00.744143 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:21:00.744143 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:21:00.744143 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:21:00.744143 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:21:00.744143 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:21:00.744143 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:21:00.744143 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 10 23:21:00.744143 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.744143 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:00.744143 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.744143 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.744143 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:00.744143 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:00.744143 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:21:00.744143 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:21:00.744143 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 10 23:21:00.744143 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.748069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-41e8e589-a516-45a4-afd8-3723c9aaf682 tempest-InstanceUsageAuditLogNegativeTestJSON-112350531 tempest-InstanceUsageAuditLogNegativeTestJSON-112350531-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:00.748888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-4aa0cb5d-d8e5-4997-83fa-ffdaef3c5329 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Getting quotas for project 01ebbb0c057c44be8b51615d59209d90. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:21:00.749771 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-41e8e589-a516-45a4-afd8-3723c9aaf682 tempest-InstanceUsageAuditLogNegativeTestJSON-112350531 tempest-InstanceUsageAuditLogNegativeTestJSON-112350531-project] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-10 23:21:00" status: 403 len: 128 microversion: 2.1 time: 0.009443 Oct 10 23:21:00.749771 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 629/1273] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 10 23:21:00 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-10%2023%3A21%3A00 => generated 128 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:21:00.753122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-4aa0cb5d-d8e5-4997-83fa-ffdaef3c5329 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Getting quotas for user fabfd9ac67b645bf9234590b623c27b0 and project 01ebbb0c057c44be8b51615d59209d90. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:21:00.756659 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8361ad78-741d-4f27-84ea-23d33939e4ba tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:00.757113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8361ad78-741d-4f27-84ea-23d33939e4ba tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:00.769886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8361ad78-741d-4f27-84ea-23d33939e4ba tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:00.770372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8361ad78-741d-4f27-84ea-23d33939e4ba tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:00.770805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8361ad78-741d-4f27-84ea-23d33939e4ba tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:00.771516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8361ad78-741d-4f27-84ea-23d33939e4ba tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:00.771990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8361ad78-741d-4f27-84ea-23d33939e4ba tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:00.772416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8361ad78-741d-4f27-84ea-23d33939e4ba tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:00.787621 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-8361ad78-741d-4f27-84ea-23d33939e4ba tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] HTTP exception thrown: Instance 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b could not be found. Oct 10 23:21:00.788154 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4aa0cb5d-d8e5-4997-83fa-ffdaef3c5329 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.075706 Oct 10 23:21:00.789062 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 645/1274] 10.222.0.23 () {62 vars in 1200 bytes} [Mon Oct 10 23:21:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 78 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 23:21:00.789228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8361ad78-741d-4f27-84ea-23d33939e4ba tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Request method failure captured: Oct 10 23:21:00.789228 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b HTTP/1.1 Oct 10 23:21:00.789228 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:21:00.789228 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:21:00.789228 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:21:00.789228 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:21:00.789228 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:21:00.789228 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:21:00.789228 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:21:00.789228 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:00.789228 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKiWDPhHeP1ao6Y5tHRbKvX9ZemW6vlLJ_C_MrPyGjEC179XpXPzYIbuoXBVNF4FDH7pzl8bOhuSRj1e7-5DcugU6k1KiwPFd9Qs6t3kjUe9RfKY0BXqex3wdvC4HjG24zVF2_841auDxOTWHziJVDjurPxpFpMsEGjqqP8S2TuKi34 Oct 10 23:21:00.789228 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:21:00.789228 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:21:00.789228 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:21:00.789228 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:21:00.789228 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:21:00.789228 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:21:00.789228 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:21:00.789228 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:00.789228 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:21:00.789228 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:21:00.791040 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_56fc65084a2a46689aa3b221e6d7aeb8", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:00.791040 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:00.791040 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:21:00.791040 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:00.791040 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:21:00.791040 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:21:00.791040 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:21:00.791040 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 9dfa7f1be9884bb1aabc9df8702fa630 Oct 10 23:21:00.791040 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:21:00.791040 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:21:00.791040 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b could not be found. Oct 10 23:21:00.791040 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '0dea3f22-ee85-4a3f-a4cd-a0634c6e451b'} Oct 10 23:21:00.792144 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:00.792144 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.792144 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:21:00.792144 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:21:00.792144 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:21:00.792144 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:21:00.792144 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:21:00.792144 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:21:00.792144 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:21:00.792144 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:21:00.792144 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b could not be found. Oct 10 23:21:00.792144 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.792144 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:00.792144 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.792144 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.792144 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:00.792144 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:00.792144 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:00.792144 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:00.792144 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:00.793392 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:00.793392 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:21:00.793392 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:21:00.793392 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:21:00.793392 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:21:00.793392 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:21:00.793392 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:21:00.793392 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:21:00.793392 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:21:00.793392 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b could not be found. Oct 10 23:21:00.793392 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.793392 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:00.793392 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.793392 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.793392 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:00.793392 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:00.793392 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:21:00.793392 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:21:00.793392 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b could not be found. Oct 10 23:21:00.793392 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.796245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8361ad78-741d-4f27-84ea-23d33939e4ba tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Returning 404 to user: Instance 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:00.796245 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8361ad78-741d-4f27-84ea-23d33939e4ba tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 404 len: 111 microversion: 2.1 time: 0.046537 Oct 10 23:21:00.796245 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 630/1275] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:21:00 2022] DELETE /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:21:00.799219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-28591adf-2e5e-4823-8abe-2d9e6759b64b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:00.799838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-28591adf-2e5e-4823-8abe-2d9e6759b64b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:00.805813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28591adf-2e5e-4823-8abe-2d9e6759b64b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:00.806385 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28591adf-2e5e-4823-8abe-2d9e6759b64b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:00.806889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28591adf-2e5e-4823-8abe-2d9e6759b64b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:00.807664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28591adf-2e5e-4823-8abe-2d9e6759b64b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:00.808199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28591adf-2e5e-4823-8abe-2d9e6759b64b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:00.808701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28591adf-2e5e-4823-8abe-2d9e6759b64b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:00.825611 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-28591adf-2e5e-4823-8abe-2d9e6759b64b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] HTTP exception thrown: Instance 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b could not be found. Oct 10 23:21:00.827068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-28591adf-2e5e-4823-8abe-2d9e6759b64b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Request method failure captured: Oct 10 23:21:00.827068 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b HTTP/1.1 Oct 10 23:21:00.827068 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:21:00.827068 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:21:00.827068 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:21:00.827068 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:21:00.827068 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:21:00.827068 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:21:00.827068 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:21:00.827068 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:00.827068 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKiWDPhHeP1ao6Y5tHRbKvX9ZemW6vlLJ_C_MrPyGjEC179XpXPzYIbuoXBVNF4FDH7pzl8bOhuSRj1e7-5DcugU6k1KiwPFd9Qs6t3kjUe9RfKY0BXqex3wdvC4HjG24zVF2_841auDxOTWHziJVDjurPxpFpMsEGjqqP8S2TuKi34 Oct 10 23:21:00.827068 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:21:00.827068 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:21:00.827068 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:21:00.827068 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:21:00.827068 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:21:00.827068 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:21:00.827068 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:21:00.827068 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:00.827068 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:21:00.827068 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:21:00.828685 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_56fc65084a2a46689aa3b221e6d7aeb8", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:00.828685 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:00.828685 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:21:00.828685 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:00.828685 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:21:00.828685 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:21:00.828685 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:21:00.828685 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 9dfa7f1be9884bb1aabc9df8702fa630 Oct 10 23:21:00.828685 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:21:00.828685 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:21:00.828685 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b could not be found. Oct 10 23:21:00.828685 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '0dea3f22-ee85-4a3f-a4cd-a0634c6e451b'} Oct 10 23:21:00.829802 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:00.829802 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.829802 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:21:00.829802 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:21:00.829802 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:21:00.829802 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:21:00.829802 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:21:00.829802 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:21:00.829802 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:21:00.829802 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:21:00.829802 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b could not be found. Oct 10 23:21:00.829802 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.829802 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:00.829802 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.829802 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.829802 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:00.829802 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:00.829802 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:00.829802 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:00.829802 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:00.831313 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:00.831313 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:21:00.831313 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:21:00.831313 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:21:00.831313 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:21:00.831313 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:21:00.831313 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:21:00.831313 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b could not be found. Oct 10 23:21:00.831313 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.831313 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:00.831313 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.831313 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.831313 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:00.831313 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:00.831313 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:21:00.831313 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:21:00.831313 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b could not be found. Oct 10 23:21:00.831313 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.833087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-28591adf-2e5e-4823-8abe-2d9e6759b64b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Returning 404 to user: Instance 0dea3f22-ee85-4a3f-a4cd-a0634c6e451b could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:00.833087 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-28591adf-2e5e-4823-8abe-2d9e6759b64b tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b" status: 404 len: 111 microversion: 2.1 time: 0.034229 Oct 10 23:21:00.834459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ef241b65-88d1-481b-9afb-a39e30e5330d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:00.835008 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 631/1276] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:00 2022] GET /compute/v2.1/servers/0dea3f22-ee85-4a3f-a4cd-a0634c6e451b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:21:00.835145 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ef241b65-88d1-481b-9afb-a39e30e5330d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:00.839929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fb9d94e8-5754-45cf-8334-769995c1b7ab tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662bb9c280>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:00.851046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef241b65-88d1-481b-9afb-a39e30e5330d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:00.853231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef241b65-88d1-481b-9afb-a39e30e5330d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:00.853743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef241b65-88d1-481b-9afb-a39e30e5330d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:00.857825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef241b65-88d1-481b-9afb-a39e30e5330d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:00.858439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef241b65-88d1-481b-9afb-a39e30e5330d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:00.859056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef241b65-88d1-481b-9afb-a39e30e5330d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:00.896924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG neutronclient.v2_0.client [None req-fb9d94e8-5754-45cf-8334-769995c1b7ab tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 25f1402f-1fb7-4e2d-a72f-da95199566c2 does not exist", "detail": ""}} {{(pid=120613) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:21:00.898450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.security_group_api [None req-fb9d94e8-5754-45cf-8334-769995c1b7ab tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Neutron security group 25f1402f-1fb7-4e2d-a72f-da95199566c2 not found {{(pid=120613) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 23:21:00.900499 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-fb9d94e8-5754-45cf-8334-769995c1b7ab tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] HTTP exception thrown: Security group 25f1402f-1fb7-4e2d-a72f-da95199566c2 does not exist Oct 10 23:21:00.900499 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-5237cc57-720d-4026-adf0-89618be6ebcc'] Oct 10 23:21:00.904762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fb9d94e8-5754-45cf-8334-769995c1b7ab tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Request method failure captured: Oct 10 23:21:00.904762 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/os-security-groups/25f1402f-1fb7-4e2d-a72f-da95199566c2 HTTP/1.1 Oct 10 23:21:00.904762 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:21:00.904762 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:21:00.904762 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:21:00.904762 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:21:00.904762 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:21:00.904762 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:21:00.904762 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:21:00.904762 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:00.904762 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKiWDPhHeP1ao6Y5tHRbKvX9ZemW6vlLJ_C_MrPyGjEC179XpXPzYIbuoXBVNF4FDH7pzl8bOhuSRj1e7-5DcugU6k1KiwPFd9Qs6t3kjUe9RfKY0BXqex3wdvC4HjG24zVF2_841auDxOTWHziJVDjurPxpFpMsEGjqqP8S2TuKi34 Oct 10 23:21:00.904762 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:21:00.904762 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:21:00.904762 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:21:00.904762 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:21:00.904762 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:21:00.904762 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:21:00.904762 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:21:00.904762 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:00.904762 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:21:00.904762 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:21:00.907943 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_56fc65084a2a46689aa3b221e6d7aeb8", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:00.907943 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:00.907943 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:21:00.907943 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:00.907943 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:21:00.907943 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:21:00.907943 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:21:00.907943 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 9dfa7f1be9884bb1aabc9df8702fa630 Oct 10 23:21:00.907943 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:21:00.907943 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:21:00.907943 n-d-860864-2 devstack@n-api.service[120613]: exception: Security group 25f1402f-1fb7-4e2d-a72f-da95199566c2 does not exist Oct 10 23:21:00.907943 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-5237cc57-720d-4026-adf0-89618be6ebcc'] Oct 10 23:21:00.907943 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '25f1402f-1fb7-4e2d-a72f-da95199566c2'} Oct 10 23:21:00.909151 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:00.909151 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.909151 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 23:21:00.909151 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 23:21:00.909151 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:00.909151 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:00.909151 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 23:21:00.909151 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 23:21:00.909151 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:00.909151 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:00.909151 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 23:21:00.909151 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 23:21:00.909151 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:00.909151 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:00.909151 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:21:00.909151 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:21:00.909151 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:00.909151 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:00.909151 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:21:00.913520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:21:00.913520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:00.913520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:00.913520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:21:00.913520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:21:00.913520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:21:00.913520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:21:00.913520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 25f1402f-1fb7-4e2d-a72f-da95199566c2 does not exist Oct 10 23:21:00.913520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5237cc57-720d-4026-adf0-89618be6ebcc'] Oct 10 23:21:00.913520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.913520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:00.913520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.913520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.913520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 23:21:00.913520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 23:21:00.913520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 23:21:00.913520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 23:21:00.913520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 25f1402f-1fb7-4e2d-a72f-da95199566c2 does not exist Oct 10 23:21:00.916767 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5237cc57-720d-4026-adf0-89618be6ebcc'] Oct 10 23:21:00.916767 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.916767 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:00.916767 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.916767 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.916767 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:00.916767 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:00.916767 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:00.916767 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:00.916767 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:21:00.916767 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:21:00.916767 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:00.916767 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:00.916767 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 23:21:00.916767 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 23:21:00.916767 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 25f1402f-1fb7-4e2d-a72f-da95199566c2 does not exist Oct 10 23:21:00.916767 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5237cc57-720d-4026-adf0-89618be6ebcc'] Oct 10 23:21:00.916767 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.916767 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:00.916767 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.916767 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.922023 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:00.922023 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:00.922023 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:21:00.922023 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:21:00.922023 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 25f1402f-1fb7-4e2d-a72f-da95199566c2 does not exist Oct 10 23:21:00.922023 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5237cc57-720d-4026-adf0-89618be6ebcc'] Oct 10 23:21:00.922023 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.926796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fb9d94e8-5754-45cf-8334-769995c1b7ab tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Returning 404 to user: Security group 25f1402f-1fb7-4e2d-a72f-da95199566c2 does not exist Oct 10 23:21:00.926796 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-5237cc57-720d-4026-adf0-89618be6ebcc'] {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:00.926796 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fb9d94e8-5754-45cf-8334-769995c1b7ab tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/25f1402f-1fb7-4e2d-a72f-da95199566c2" status: 404 len: 194 microversion: 2.1 time: 0.090055 Oct 10 23:21:00.926796 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 632/1277] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:21:00 2022] DELETE /compute/v2.1/os-security-groups/25f1402f-1fb7-4e2d-a72f-da95199566c2 => generated 194 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:21:00.938265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-66a12240-363a-4830-a370-3c1dc3eed29c tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662b98f8b0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:00.975320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG neutronclient.v2_0.client [None req-66a12240-363a-4830-a370-3c1dc3eed29c tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 809fd1e8-f9ce-41a2-a9f2-48418ee34c3d does not exist", "detail": ""}} {{(pid=120613) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:21:00.977045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.security_group_api [None req-66a12240-363a-4830-a370-3c1dc3eed29c tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Neutron security group 809fd1e8-f9ce-41a2-a9f2-48418ee34c3d not found {{(pid=120613) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 23:21:00.977045 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-66a12240-363a-4830-a370-3c1dc3eed29c tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] HTTP exception thrown: Security group 809fd1e8-f9ce-41a2-a9f2-48418ee34c3d does not exist Oct 10 23:21:00.977045 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-7eb1d73a-4cba-4145-9dfa-2feea8dcbcce'] Oct 10 23:21:00.978638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-66a12240-363a-4830-a370-3c1dc3eed29c tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Request method failure captured: Oct 10 23:21:00.978638 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/os-security-groups/809fd1e8-f9ce-41a2-a9f2-48418ee34c3d HTTP/1.1 Oct 10 23:21:00.978638 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:21:00.978638 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:21:00.978638 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:21:00.978638 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:21:00.978638 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:21:00.978638 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:21:00.978638 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:21:00.978638 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:00.978638 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKiWDPhHeP1ao6Y5tHRbKvX9ZemW6vlLJ_C_MrPyGjEC179XpXPzYIbuoXBVNF4FDH7pzl8bOhuSRj1e7-5DcugU6k1KiwPFd9Qs6t3kjUe9RfKY0BXqex3wdvC4HjG24zVF2_841auDxOTWHziJVDjurPxpFpMsEGjqqP8S2TuKi34 Oct 10 23:21:00.978638 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:21:00.978638 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:21:00.978638 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:21:00.978638 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:21:00.978638 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:21:00.978638 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:21:00.978638 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:21:00.978638 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:00.978638 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:21:00.978638 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:21:00.979998 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_56fc65084a2a46689aa3b221e6d7aeb8", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:00.979998 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:00.979998 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:21:00.979998 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:00.979998 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:21:00.979998 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:21:00.979998 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:21:00.979998 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 9dfa7f1be9884bb1aabc9df8702fa630 Oct 10 23:21:00.979998 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:21:00.979998 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:21:00.979998 n-d-860864-2 devstack@n-api.service[120613]: exception: Security group 809fd1e8-f9ce-41a2-a9f2-48418ee34c3d does not exist Oct 10 23:21:00.979998 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-7eb1d73a-4cba-4145-9dfa-2feea8dcbcce'] Oct 10 23:21:00.979998 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '809fd1e8-f9ce-41a2-a9f2-48418ee34c3d'} Oct 10 23:21:00.980821 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:00.980821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.980821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 23:21:00.980821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 23:21:00.980821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:00.980821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:00.980821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 23:21:00.980821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 23:21:00.980821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:00.980821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:00.980821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 23:21:00.980821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 23:21:00.980821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:00.980821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:00.980821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:21:00.980821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:21:00.980821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:00.980821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:00.980821 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:21:00.982626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:21:00.982626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:00.982626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:00.982626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:21:00.982626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:21:00.982626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:21:00.982626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:21:00.982626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 809fd1e8-f9ce-41a2-a9f2-48418ee34c3d does not exist Oct 10 23:21:00.982626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7eb1d73a-4cba-4145-9dfa-2feea8dcbcce'] Oct 10 23:21:00.982626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.982626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:00.982626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.982626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.982626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 23:21:00.982626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 23:21:00.982626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 23:21:00.982626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 23:21:00.982626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 809fd1e8-f9ce-41a2-a9f2-48418ee34c3d does not exist Oct 10 23:21:00.983769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7eb1d73a-4cba-4145-9dfa-2feea8dcbcce'] Oct 10 23:21:00.983769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.983769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:00.983769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.983769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.983769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:00.983769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:00.983769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:00.983769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:00.983769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:21:00.983769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:21:00.983769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:00.983769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:00.983769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 23:21:00.983769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 23:21:00.983769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 809fd1e8-f9ce-41a2-a9f2-48418ee34c3d does not exist Oct 10 23:21:00.983769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7eb1d73a-4cba-4145-9dfa-2feea8dcbcce'] Oct 10 23:21:00.983769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.983769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:00.983769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.983769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:00.985119 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:00.985119 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:00.985119 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:21:00.985119 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:21:00.985119 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 809fd1e8-f9ce-41a2-a9f2-48418ee34c3d does not exist Oct 10 23:21:00.985119 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7eb1d73a-4cba-4145-9dfa-2feea8dcbcce'] Oct 10 23:21:00.985119 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:00.985119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-66a12240-363a-4830-a370-3c1dc3eed29c tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Returning 404 to user: Security group 809fd1e8-f9ce-41a2-a9f2-48418ee34c3d does not exist Oct 10 23:21:00.985119 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-7eb1d73a-4cba-4145-9dfa-2feea8dcbcce'] {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:00.985119 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-66a12240-363a-4830-a370-3c1dc3eed29c tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/809fd1e8-f9ce-41a2-a9f2-48418ee34c3d" status: 404 len: 194 microversion: 2.1 time: 0.049186 Oct 10 23:21:00.985119 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 633/1278] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:21:00 2022] DELETE /compute/v2.1/os-security-groups/809fd1e8-f9ce-41a2-a9f2-48418ee34c3d => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:21:00.990510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f2790fc7-1def-4baf-b348-37fee4819b0c tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662bd00ee0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:01.024522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG neutronclient.v2_0.client [None req-f2790fc7-1def-4baf-b348-37fee4819b0c tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3648d6c5-3f7a-469e-8d0e-0eaffc5de75c does not exist", "detail": ""}} {{(pid=120613) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:21:01.027158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.security_group_api [None req-f2790fc7-1def-4baf-b348-37fee4819b0c tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Neutron security group 3648d6c5-3f7a-469e-8d0e-0eaffc5de75c not found {{(pid=120613) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 23:21:01.028094 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-f2790fc7-1def-4baf-b348-37fee4819b0c tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] HTTP exception thrown: Security group 3648d6c5-3f7a-469e-8d0e-0eaffc5de75c does not exist Oct 10 23:21:01.028094 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-0be0d240-260f-4f10-ba90-65c0410abb38'] Oct 10 23:21:01.032803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f2790fc7-1def-4baf-b348-37fee4819b0c tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Request method failure captured: Oct 10 23:21:01.032803 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/os-security-groups/3648d6c5-3f7a-469e-8d0e-0eaffc5de75c HTTP/1.1 Oct 10 23:21:01.032803 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:21:01.032803 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:21:01.032803 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:21:01.032803 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:21:01.032803 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:21:01.032803 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:21:01.032803 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:21:01.032803 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:01.032803 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKiWDPhHeP1ao6Y5tHRbKvX9ZemW6vlLJ_C_MrPyGjEC179XpXPzYIbuoXBVNF4FDH7pzl8bOhuSRj1e7-5DcugU6k1KiwPFd9Qs6t3kjUe9RfKY0BXqex3wdvC4HjG24zVF2_841auDxOTWHziJVDjurPxpFpMsEGjqqP8S2TuKi34 Oct 10 23:21:01.032803 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:21:01.032803 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:21:01.032803 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:21:01.032803 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:21:01.032803 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:21:01.032803 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:21:01.032803 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:21:01.032803 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:01.032803 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:21:01.032803 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:21:01.034541 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_56fc65084a2a46689aa3b221e6d7aeb8", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:01.034541 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:01.034541 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:21:01.034541 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:01.034541 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:21:01.034541 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:21:01.034541 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:21:01.034541 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 9dfa7f1be9884bb1aabc9df8702fa630 Oct 10 23:21:01.034541 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:21:01.034541 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:21:01.034541 n-d-860864-2 devstack@n-api.service[120613]: exception: Security group 3648d6c5-3f7a-469e-8d0e-0eaffc5de75c does not exist Oct 10 23:21:01.034541 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-0be0d240-260f-4f10-ba90-65c0410abb38'] Oct 10 23:21:01.034541 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '3648d6c5-3f7a-469e-8d0e-0eaffc5de75c'} Oct 10 23:21:01.035553 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:01.035553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:01.035553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 23:21:01.035553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 23:21:01.035553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:01.035553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:01.035553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 23:21:01.035553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 23:21:01.035553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:01.035553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:01.035553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 23:21:01.035553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 23:21:01.035553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:01.035553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:01.035553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:21:01.035553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:21:01.035553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:01.035553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:01.035553 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:21:01.036989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:21:01.036989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:01.036989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:01.036989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:21:01.036989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:21:01.036989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:21:01.036989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:21:01.036989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3648d6c5-3f7a-469e-8d0e-0eaffc5de75c does not exist Oct 10 23:21:01.036989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0be0d240-260f-4f10-ba90-65c0410abb38'] Oct 10 23:21:01.036989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.036989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:01.036989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.036989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:01.036989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 23:21:01.036989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 23:21:01.036989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 23:21:01.036989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 23:21:01.036989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3648d6c5-3f7a-469e-8d0e-0eaffc5de75c does not exist Oct 10 23:21:01.038538 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0be0d240-260f-4f10-ba90-65c0410abb38'] Oct 10 23:21:01.038538 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.038538 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:01.038538 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.038538 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:01.038538 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:01.038538 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:01.038538 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:01.038538 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:01.038538 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:21:01.038538 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:21:01.038538 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:01.038538 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:01.038538 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 23:21:01.038538 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 23:21:01.038538 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3648d6c5-3f7a-469e-8d0e-0eaffc5de75c does not exist Oct 10 23:21:01.038538 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0be0d240-260f-4f10-ba90-65c0410abb38'] Oct 10 23:21:01.038538 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.038538 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:01.038538 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.038538 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:01.040442 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:01.040442 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:01.040442 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:21:01.040442 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:21:01.040442 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3648d6c5-3f7a-469e-8d0e-0eaffc5de75c does not exist Oct 10 23:21:01.040442 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0be0d240-260f-4f10-ba90-65c0410abb38'] Oct 10 23:21:01.040442 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.040442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f2790fc7-1def-4baf-b348-37fee4819b0c tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Returning 404 to user: Security group 3648d6c5-3f7a-469e-8d0e-0eaffc5de75c does not exist Oct 10 23:21:01.040442 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-0be0d240-260f-4f10-ba90-65c0410abb38'] {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:01.042491 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f2790fc7-1def-4baf-b348-37fee4819b0c tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/3648d6c5-3f7a-469e-8d0e-0eaffc5de75c" status: 404 len: 194 microversion: 2.1 time: 0.055670 Oct 10 23:21:01.042491 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 634/1279] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:21:00 2022] DELETE /compute/v2.1/os-security-groups/3648d6c5-3f7a-469e-8d0e-0eaffc5de75c => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:21:01.064450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-26c48fe1-2282-4910-95bd-7d7fdd99c025 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662bb9c0d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:01.108209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ef241b65-88d1-481b-9afb-a39e30e5330d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:01.117252 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ef241b65-88d1-481b-9afb-a39e30e5330d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1537 microversion: 2.1 time: 0.288369 Oct 10 23:21:01.118522 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 646/1280] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:00 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1537 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:01.152039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG neutronclient.v2_0.client [None req-26c48fe1-2282-4910-95bd-7d7fdd99c025 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1feac7cf-97a1-4526-bd43-41317c1ba275 does not exist", "detail": ""}} {{(pid=120613) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:21:01.152971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.security_group_api [None req-26c48fe1-2282-4910-95bd-7d7fdd99c025 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Neutron security group 1feac7cf-97a1-4526-bd43-41317c1ba275 not found {{(pid=120613) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 23:21:01.172290 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-26c48fe1-2282-4910-95bd-7d7fdd99c025 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] HTTP exception thrown: Security group 1feac7cf-97a1-4526-bd43-41317c1ba275 does not exist Oct 10 23:21:01.172290 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-305e840b-fe78-4ada-815f-d1a5152b7ea1'] Oct 10 23:21:01.178955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-26c48fe1-2282-4910-95bd-7d7fdd99c025 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Request method failure captured: Oct 10 23:21:01.178955 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/os-security-groups/1feac7cf-97a1-4526-bd43-41317c1ba275 HTTP/1.1 Oct 10 23:21:01.178955 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:21:01.178955 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:21:01.178955 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:21:01.178955 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:21:01.178955 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:21:01.178955 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:21:01.178955 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:21:01.178955 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:01.178955 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKiWDPhHeP1ao6Y5tHRbKvX9ZemW6vlLJ_C_MrPyGjEC179XpXPzYIbuoXBVNF4FDH7pzl8bOhuSRj1e7-5DcugU6k1KiwPFd9Qs6t3kjUe9RfKY0BXqex3wdvC4HjG24zVF2_841auDxOTWHziJVDjurPxpFpMsEGjqqP8S2TuKi34 Oct 10 23:21:01.178955 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:21:01.178955 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:21:01.178955 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:21:01.178955 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:21:01.178955 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:21:01.178955 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:21:01.178955 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:21:01.178955 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:01.178955 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:21:01.178955 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:21:01.180698 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_56fc65084a2a46689aa3b221e6d7aeb8", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:01.180698 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:01.180698 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:21:01.180698 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:01.180698 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:21:01.180698 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:21:01.180698 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:21:01.180698 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 9dfa7f1be9884bb1aabc9df8702fa630 Oct 10 23:21:01.180698 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:21:01.180698 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:21:01.180698 n-d-860864-2 devstack@n-api.service[120613]: exception: Security group 1feac7cf-97a1-4526-bd43-41317c1ba275 does not exist Oct 10 23:21:01.180698 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-305e840b-fe78-4ada-815f-d1a5152b7ea1'] Oct 10 23:21:01.180698 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '1feac7cf-97a1-4526-bd43-41317c1ba275'} Oct 10 23:21:01.181784 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:01.181784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:01.181784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 23:21:01.181784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 23:21:01.181784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:01.181784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:01.181784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 23:21:01.181784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 23:21:01.181784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:01.181784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:01.181784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 23:21:01.181784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 23:21:01.181784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:01.181784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:01.181784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:21:01.181784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:21:01.181784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:01.181784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:01.181784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:21:01.183425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:21:01.183425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:01.183425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:01.183425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:21:01.183425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:21:01.183425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:21:01.183425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:21:01.183425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1feac7cf-97a1-4526-bd43-41317c1ba275 does not exist Oct 10 23:21:01.183425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-305e840b-fe78-4ada-815f-d1a5152b7ea1'] Oct 10 23:21:01.183425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.183425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:01.183425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.183425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:01.183425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 23:21:01.183425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 23:21:01.183425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 23:21:01.183425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 23:21:01.183425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1feac7cf-97a1-4526-bd43-41317c1ba275 does not exist Oct 10 23:21:01.184845 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-305e840b-fe78-4ada-815f-d1a5152b7ea1'] Oct 10 23:21:01.184845 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.184845 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:01.184845 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.184845 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:01.184845 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:01.184845 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:01.184845 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:01.184845 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:01.184845 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:21:01.184845 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:21:01.184845 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:01.184845 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:01.184845 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 23:21:01.184845 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 23:21:01.184845 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1feac7cf-97a1-4526-bd43-41317c1ba275 does not exist Oct 10 23:21:01.184845 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-305e840b-fe78-4ada-815f-d1a5152b7ea1'] Oct 10 23:21:01.184845 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.184845 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:01.184845 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.184845 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:01.187909 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:01.187909 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:01.187909 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:21:01.187909 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:21:01.187909 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1feac7cf-97a1-4526-bd43-41317c1ba275 does not exist Oct 10 23:21:01.187909 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-305e840b-fe78-4ada-815f-d1a5152b7ea1'] Oct 10 23:21:01.187909 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.191754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-26c48fe1-2282-4910-95bd-7d7fdd99c025 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Returning 404 to user: Security group 1feac7cf-97a1-4526-bd43-41317c1ba275 does not exist Oct 10 23:21:01.191754 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-305e840b-fe78-4ada-815f-d1a5152b7ea1'] {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:01.195924 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-26c48fe1-2282-4910-95bd-7d7fdd99c025 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/1feac7cf-97a1-4526-bd43-41317c1ba275" status: 404 len: 194 microversion: 2.1 time: 0.136065 Oct 10 23:21:01.201928 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 635/1281] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:21:01 2022] DELETE /compute/v2.1/os-security-groups/1feac7cf-97a1-4526-bd43-41317c1ba275 => generated 194 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:21:01.207617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-41dfad04-4343-4d28-b9cb-e281e699ec31 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662b9c1790>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:01.284803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d3e9db25-d68e-492f-a77f-706affac12dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:01.285894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d3e9db25-d68e-492f-a77f-706affac12dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 90aa3419-44a6-4b0d-9af1-5f6df3554b71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:01.301279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG neutronclient.v2_0.client [None req-41dfad04-4343-4d28-b9cb-e281e699ec31 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d4039f9a-cc27-4839-b812-036178c7697b does not exist", "detail": ""}} {{(pid=120614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:21:01.302836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.security_group_api [None req-41dfad04-4343-4d28-b9cb-e281e699ec31 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Neutron security group d4039f9a-cc27-4839-b812-036178c7697b not found {{(pid=120614) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 23:21:01.303365 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-41dfad04-4343-4d28-b9cb-e281e699ec31 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] HTTP exception thrown: Security group d4039f9a-cc27-4839-b812-036178c7697b does not exist Oct 10 23:21:01.303365 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-0ad1ff43-4e98-41c6-8cc1-dcfa218050fa'] Oct 10 23:21:01.320847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-41dfad04-4343-4d28-b9cb-e281e699ec31 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Request method failure captured: Oct 10 23:21:01.320847 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/os-security-groups/d4039f9a-cc27-4839-b812-036178c7697b HTTP/1.1 Oct 10 23:21:01.320847 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:21:01.320847 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:21:01.320847 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:21:01.320847 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:21:01.320847 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:21:01.320847 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:21:01.320847 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:21:01.320847 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:01.320847 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKiWDPhHeP1ao6Y5tHRbKvX9ZemW6vlLJ_C_MrPyGjEC179XpXPzYIbuoXBVNF4FDH7pzl8bOhuSRj1e7-5DcugU6k1KiwPFd9Qs6t3kjUe9RfKY0BXqex3wdvC4HjG24zVF2_841auDxOTWHziJVDjurPxpFpMsEGjqqP8S2TuKi34 Oct 10 23:21:01.320847 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:21:01.320847 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:21:01.320847 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:21:01.320847 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:21:01.320847 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:21:01.320847 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:21:01.320847 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:21:01.320847 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:01.320847 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:21:01.320847 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:21:01.322368 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_56fc65084a2a46689aa3b221e6d7aeb8", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:01.322368 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:01.322368 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:21:01.322368 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:01.322368 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:21:01.322368 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:21:01.322368 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:21:01.322368 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 9dfa7f1be9884bb1aabc9df8702fa630 Oct 10 23:21:01.322368 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:21:01.322368 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:21:01.322368 n-d-860864-2 devstack@n-api.service[120614]: exception: Security group d4039f9a-cc27-4839-b812-036178c7697b does not exist Oct 10 23:21:01.322368 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-0ad1ff43-4e98-41c6-8cc1-dcfa218050fa'] Oct 10 23:21:01.322368 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'd4039f9a-cc27-4839-b812-036178c7697b'} Oct 10 23:21:01.323211 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:01.323211 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:01.323211 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 23:21:01.323211 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 23:21:01.323211 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:01.323211 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:01.323211 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 23:21:01.323211 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 23:21:01.323211 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:01.323211 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:01.323211 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 23:21:01.323211 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 23:21:01.323211 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:01.323211 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:01.323211 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:21:01.323211 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:21:01.323211 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:01.323211 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:01.323211 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:21:01.324388 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:21:01.324388 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:01.324388 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:01.324388 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:21:01.324388 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:21:01.324388 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:21:01.324388 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:21:01.324388 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d4039f9a-cc27-4839-b812-036178c7697b does not exist Oct 10 23:21:01.324388 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ad1ff43-4e98-41c6-8cc1-dcfa218050fa'] Oct 10 23:21:01.324388 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.324388 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:01.324388 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.324388 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:01.324388 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 23:21:01.324388 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 23:21:01.324388 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 23:21:01.324388 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 23:21:01.324388 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d4039f9a-cc27-4839-b812-036178c7697b does not exist Oct 10 23:21:01.327985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ad1ff43-4e98-41c6-8cc1-dcfa218050fa'] Oct 10 23:21:01.327985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.327985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:01.327985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.327985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:01.327985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:01.327985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:01.327985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:01.327985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:01.327985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:21:01.327985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:21:01.327985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:01.327985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:01.327985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 23:21:01.327985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 23:21:01.327985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d4039f9a-cc27-4839-b812-036178c7697b does not exist Oct 10 23:21:01.327985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ad1ff43-4e98-41c6-8cc1-dcfa218050fa'] Oct 10 23:21:01.327985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.327985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:01.327985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.327985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:01.330898 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:01.330898 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:01.330898 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:21:01.330898 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:21:01.330898 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d4039f9a-cc27-4839-b812-036178c7697b does not exist Oct 10 23:21:01.330898 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0ad1ff43-4e98-41c6-8cc1-dcfa218050fa'] Oct 10 23:21:01.330898 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.330898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-41dfad04-4343-4d28-b9cb-e281e699ec31 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Returning 404 to user: Security group d4039f9a-cc27-4839-b812-036178c7697b does not exist Oct 10 23:21:01.330898 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-0ad1ff43-4e98-41c6-8cc1-dcfa218050fa'] {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:01.330898 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-41dfad04-4343-4d28-b9cb-e281e699ec31 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/d4039f9a-cc27-4839-b812-036178c7697b" status: 404 len: 194 microversion: 2.1 time: 0.121073 Oct 10 23:21:01.330898 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 647/1282] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:21:01 2022] DELETE /compute/v2.1/os-security-groups/d4039f9a-cc27-4839-b812-036178c7697b => generated 194 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:21:01.333168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3e9db25-d68e-492f-a77f-706affac12dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:01.333168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3e9db25-d68e-492f-a77f-706affac12dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:01.333168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3e9db25-d68e-492f-a77f-706affac12dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:01.341471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3e9db25-d68e-492f-a77f-706affac12dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:01.342990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3e9db25-d68e-492f-a77f-706affac12dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:01.354332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ce947c99-1932-4330-9516-cfa7a880489f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662b5d7ee0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:01.355558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3e9db25-d68e-492f-a77f-706affac12dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:01.384030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:01.436322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG neutronclient.v2_0.client [None req-ce947c99-1932-4330-9516-cfa7a880489f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dadc641d-0288-4d88-99a8-b8641da8e24f does not exist", "detail": ""}} {{(pid=120614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:21:01.437155 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.security_group_api [None req-ce947c99-1932-4330-9516-cfa7a880489f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Neutron security group dadc641d-0288-4d88-99a8-b8641da8e24f not found {{(pid=120614) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 23:21:01.438367 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-ce947c99-1932-4330-9516-cfa7a880489f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] HTTP exception thrown: Security group dadc641d-0288-4d88-99a8-b8641da8e24f does not exist Oct 10 23:21:01.438367 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-84f2fe9d-4716-462a-b8d8-503ca5b7c44a'] Oct 10 23:21:01.443069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ce947c99-1932-4330-9516-cfa7a880489f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Request method failure captured: Oct 10 23:21:01.443069 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/os-security-groups/dadc641d-0288-4d88-99a8-b8641da8e24f HTTP/1.1 Oct 10 23:21:01.443069 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:21:01.443069 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:21:01.443069 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:21:01.443069 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:21:01.443069 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:21:01.443069 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:21:01.443069 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:21:01.443069 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:01.443069 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKiWDPhHeP1ao6Y5tHRbKvX9ZemW6vlLJ_C_MrPyGjEC179XpXPzYIbuoXBVNF4FDH7pzl8bOhuSRj1e7-5DcugU6k1KiwPFd9Qs6t3kjUe9RfKY0BXqex3wdvC4HjG24zVF2_841auDxOTWHziJVDjurPxpFpMsEGjqqP8S2TuKi34 Oct 10 23:21:01.443069 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:21:01.443069 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:21:01.443069 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:21:01.443069 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:21:01.443069 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:21:01.443069 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:21:01.443069 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:21:01.443069 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:01.443069 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:21:01.443069 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:21:01.444789 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_56fc65084a2a46689aa3b221e6d7aeb8", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:01.444789 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:01.444789 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:21:01.444789 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:01.444789 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:21:01.444789 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:21:01.444789 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:21:01.444789 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 9dfa7f1be9884bb1aabc9df8702fa630 Oct 10 23:21:01.444789 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:21:01.444789 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:21:01.444789 n-d-860864-2 devstack@n-api.service[120614]: exception: Security group dadc641d-0288-4d88-99a8-b8641da8e24f does not exist Oct 10 23:21:01.444789 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-84f2fe9d-4716-462a-b8d8-503ca5b7c44a'] Oct 10 23:21:01.444789 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'dadc641d-0288-4d88-99a8-b8641da8e24f'} Oct 10 23:21:01.445862 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:01.445862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:01.445862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 23:21:01.445862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 23:21:01.445862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:01.445862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:01.445862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 23:21:01.445862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 23:21:01.445862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:01.445862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:01.445862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 23:21:01.445862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 23:21:01.445862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:01.445862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:01.445862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:21:01.445862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:21:01.445862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:01.445862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:01.445862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:21:01.447080 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:21:01.447080 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:01.447080 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:01.447080 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:21:01.447080 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:21:01.447080 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:21:01.447080 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:21:01.447080 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dadc641d-0288-4d88-99a8-b8641da8e24f does not exist Oct 10 23:21:01.447080 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84f2fe9d-4716-462a-b8d8-503ca5b7c44a'] Oct 10 23:21:01.447080 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.447080 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:01.447080 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.447080 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:01.447080 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 23:21:01.447080 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 23:21:01.447080 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 23:21:01.447080 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 23:21:01.447080 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dadc641d-0288-4d88-99a8-b8641da8e24f does not exist Oct 10 23:21:01.448220 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84f2fe9d-4716-462a-b8d8-503ca5b7c44a'] Oct 10 23:21:01.448220 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.448220 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:01.448220 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.448220 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:01.448220 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:01.448220 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:01.448220 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:01.448220 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:01.448220 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:21:01.448220 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:21:01.448220 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:01.448220 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:01.448220 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 23:21:01.448220 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 23:21:01.448220 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dadc641d-0288-4d88-99a8-b8641da8e24f does not exist Oct 10 23:21:01.448220 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84f2fe9d-4716-462a-b8d8-503ca5b7c44a'] Oct 10 23:21:01.448220 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.448220 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:01.448220 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.448220 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:01.449528 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:01.449528 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:01.449528 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:21:01.449528 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:21:01.449528 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dadc641d-0288-4d88-99a8-b8641da8e24f does not exist Oct 10 23:21:01.449528 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84f2fe9d-4716-462a-b8d8-503ca5b7c44a'] Oct 10 23:21:01.449528 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:01.449528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ce947c99-1932-4330-9516-cfa7a880489f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Returning 404 to user: Security group dadc641d-0288-4d88-99a8-b8641da8e24f does not exist Oct 10 23:21:01.449528 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-84f2fe9d-4716-462a-b8d8-503ca5b7c44a'] {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:01.449528 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ce947c99-1932-4330-9516-cfa7a880489f tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/dadc641d-0288-4d88-99a8-b8641da8e24f" status: 404 len: 194 microversion: 2.1 time: 0.115375 Oct 10 23:21:01.449528 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 648/1283] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:21:01 2022] DELETE /compute/v2.1/os-security-groups/dadc641d-0288-4d88-99a8-b8641da8e24f => generated 194 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:21:01.457475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4a239e3d-a509-41ce-9ac2-05f58789bcbb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:01.458517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4a239e3d-a509-41ce-9ac2-05f58789bcbb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:01.469575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a239e3d-a509-41ce-9ac2-05f58789bcbb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:01.470091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a239e3d-a509-41ce-9ac2-05f58789bcbb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:01.471136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a239e3d-a509-41ce-9ac2-05f58789bcbb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:01.472043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a239e3d-a509-41ce-9ac2-05f58789bcbb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:01.472508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a239e3d-a509-41ce-9ac2-05f58789bcbb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:01.472943 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a239e3d-a509-41ce-9ac2-05f58789bcbb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:01.507298 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4a239e3d-a509-41ce-9ac2-05f58789bcbb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:21:01.641038 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4a239e3d-a509-41ce-9ac2-05f58789bcbb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "DELETE /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71" status: 204 len: 0 microversion: 2.1 time: 0.188221 Oct 10 23:21:01.641942 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 649/1284] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:21:01 2022] DELETE /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:21:01.648407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a2ae473d-0953-4d2b-a86a-5783d47eaecd tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:01.649446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a2ae473d-0953-4d2b-a86a-5783d47eaecd tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:01.652823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=9,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:01.659542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2ae473d-0953-4d2b-a86a-5783d47eaecd tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:01.660291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2ae473d-0953-4d2b-a86a-5783d47eaecd tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:01.660742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2ae473d-0953-4d2b-a86a-5783d47eaecd tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:01.662320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2ae473d-0953-4d2b-a86a-5783d47eaecd tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:01.662989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2ae473d-0953-4d2b-a86a-5783d47eaecd tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:01.663426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2ae473d-0953-4d2b-a86a-5783d47eaecd tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:01.741335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d3e9db25-d68e-492f-a77f-706affac12dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:01.750615 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d3e9db25-d68e-492f-a77f-706affac12dd tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71" status: 200 len: 1473 microversion: 2.1 time: 0.475870 Oct 10 23:21:01.751485 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 636/1285] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:01 2022] GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71 => generated 1473 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:01.757132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7bb26632-5e90-404f-8bf8-6ead58fb742d tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:01.763327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7bb26632-5e90-404f-8bf8-6ead58fb742d tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:01.777164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bb26632-5e90-404f-8bf8-6ead58fb742d tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:01.777801 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bb26632-5e90-404f-8bf8-6ead58fb742d tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:01.778314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bb26632-5e90-404f-8bf8-6ead58fb742d tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:01.779899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bb26632-5e90-404f-8bf8-6ead58fb742d tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:01.780540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bb26632-5e90-404f-8bf8-6ead58fb742d tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:01.781199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bb26632-5e90-404f-8bf8-6ead58fb742d tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:02.162414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7bb26632-5e90-404f-8bf8-6ead58fb742d tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:02.172835 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7bb26632-5e90-404f-8bf8-6ead58fb742d tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71" status: 200 len: 1645 microversion: 2.1 time: 0.420145 Oct 10 23:21:02.173689 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 637/1286] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:01 2022] GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71 => generated 1645 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:02.178785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-30242945-f5e7-4b78-9d42-a6e888adbca2 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:02.179562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-30242945-f5e7-4b78-9d42-a6e888adbca2 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] [instance: bdf5220b-cc6e-4457-b00c-b4e02cf8f982] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:02.188623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30242945-f5e7-4b78-9d42-a6e888adbca2 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:02.189456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30242945-f5e7-4b78-9d42-a6e888adbca2 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:02.190200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30242945-f5e7-4b78-9d42-a6e888adbca2 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:02.191201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30242945-f5e7-4b78-9d42-a6e888adbca2 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:02.191961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30242945-f5e7-4b78-9d42-a6e888adbca2 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:02.192598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30242945-f5e7-4b78-9d42-a6e888adbca2 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:02.259575 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a2ae473d-0953-4d2b-a86a-5783d47eaecd tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1812 microversion: 2.1 time: 0.615895 Oct 10 23:21:02.260169 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 650/1287] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:01 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1812 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:02.270113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0697cbbf-fd47-4107-8af1-4b37c791acd6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:02.270726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0697cbbf-fd47-4107-8af1-4b37c791acd6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:02.294945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0697cbbf-fd47-4107-8af1-4b37c791acd6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:02.297351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0697cbbf-fd47-4107-8af1-4b37c791acd6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:02.299313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0697cbbf-fd47-4107-8af1-4b37c791acd6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:02.300242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0697cbbf-fd47-4107-8af1-4b37c791acd6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:02.300924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0697cbbf-fd47-4107-8af1-4b37c791acd6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:02.301544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0697cbbf-fd47-4107-8af1-4b37c791acd6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:02.363908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-30242945-f5e7-4b78-9d42-a6e888adbca2 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:02.381992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-30242945-f5e7-4b78-9d42-a6e888adbca2 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:02.384302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-30242945-f5e7-4b78-9d42-a6e888adbca2 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:02.386269 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-30242945-f5e7-4b78-9d42-a6e888adbca2 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] 10.222.0.23 "GET /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982" status: 200 len: 1366 microversion: 2.47 time: 0.211333 Oct 10 23:21:02.407176 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 638/1288] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:02 2022] GET /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:02.421089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c0027fe4-71c9-41ae-b03c-9a08ee40570b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:02.426905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0027fe4-71c9-41ae-b03c-9a08ee40570b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:02.428789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0027fe4-71c9-41ae-b03c-9a08ee40570b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:02.429493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0027fe4-71c9-41ae-b03c-9a08ee40570b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:02.431843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0027fe4-71c9-41ae-b03c-9a08ee40570b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:02.432402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0027fe4-71c9-41ae-b03c-9a08ee40570b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:02.433117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0027fe4-71c9-41ae-b03c-9a08ee40570b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:02.516486 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c0027fe4-71c9-41ae-b03c-9a08ee40570b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.107918 Oct 10 23:21:02.525404 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 639/1289] 10.222.0.23 () {58 vars in 1176 bytes} [Mon Oct 10 23:21:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:02.580077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0697cbbf-fd47-4107-8af1-4b37c791acd6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:02.596198 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0697cbbf-fd47-4107-8af1-4b37c791acd6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1537 microversion: 2.1 time: 0.334985 Oct 10 23:21:02.610579 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 651/1290] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:02 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1537 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:02.775375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e1a58090-c9e1-4cf9-acb2-135a5e3f97a3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:02.777218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e1a58090-c9e1-4cf9-acb2-135a5e3f97a3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 90aa3419-44a6-4b0d-9af1-5f6df3554b71] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:02.788268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1a58090-c9e1-4cf9-acb2-135a5e3f97a3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:02.789027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1a58090-c9e1-4cf9-acb2-135a5e3f97a3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:02.789879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1a58090-c9e1-4cf9-acb2-135a5e3f97a3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:02.791030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1a58090-c9e1-4cf9-acb2-135a5e3f97a3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:02.792312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1a58090-c9e1-4cf9-acb2-135a5e3f97a3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:02.793181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1a58090-c9e1-4cf9-acb2-135a5e3f97a3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:03.170935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e1a58090-c9e1-4cf9-acb2-135a5e3f97a3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:03.183124 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e1a58090-c9e1-4cf9-acb2-135a5e3f97a3 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71" status: 200 len: 1473 microversion: 2.1 time: 0.410966 Oct 10 23:21:03.186136 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 640/1291] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:02 2022] GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71 => generated 1473 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:03.199998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-08f8fdb7-0fb6-4dcf-bb1d-0d713161e336 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:03.200778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-08f8fdb7-0fb6-4dcf-bb1d-0d713161e336 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:03.209061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08f8fdb7-0fb6-4dcf-bb1d-0d713161e336 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:03.209844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08f8fdb7-0fb6-4dcf-bb1d-0d713161e336 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:03.210551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08f8fdb7-0fb6-4dcf-bb1d-0d713161e336 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:03.211602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08f8fdb7-0fb6-4dcf-bb1d-0d713161e336 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:03.212265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08f8fdb7-0fb6-4dcf-bb1d-0d713161e336 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:03.213202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08f8fdb7-0fb6-4dcf-bb1d-0d713161e336 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:03.427661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-456cb28f-fa6d-4d60-bf6d-10c0a0204608 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:03.428172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-456cb28f-fa6d-4d60-bf6d-10c0a0204608 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] [instance: bdf5220b-cc6e-4457-b00c-b4e02cf8f982] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:03.441660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:03.448106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-456cb28f-fa6d-4d60-bf6d-10c0a0204608 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:03.453991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-456cb28f-fa6d-4d60-bf6d-10c0a0204608 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:03.456507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-456cb28f-fa6d-4d60-bf6d-10c0a0204608 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:03.459428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-456cb28f-fa6d-4d60-bf6d-10c0a0204608 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:03.460316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-456cb28f-fa6d-4d60-bf6d-10c0a0204608 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:03.464681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-456cb28f-fa6d-4d60-bf6d-10c0a0204608 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:03.684053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-456cb28f-fa6d-4d60-bf6d-10c0a0204608 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:03.695046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-456cb28f-fa6d-4d60-bf6d-10c0a0204608 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:03.700048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-456cb28f-fa6d-4d60-bf6d-10c0a0204608 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:03.703357 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-456cb28f-fa6d-4d60-bf6d-10c0a0204608 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] 10.222.0.23 "GET /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982" status: 200 len: 1366 microversion: 2.47 time: 0.280845 Oct 10 23:21:03.707934 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 641/1292] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:03 2022] GET /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:03.714409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a1dffe40-fe34-4374-94f9-ce990ad28154 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1493266528", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "de46cdec-ec5d-4348-b04f-dbf364a4ee52"}], "security_groups": [{"name": "tempest-securitygroup--1899487221"}], "key_name": "tempest-keypair-1107002667", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:03.890652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-a1dffe40-fe34-4374-94f9-ce990ad28154 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] validate_networks() for [('de46cdec-ec5d-4348-b04f-dbf364a4ee52', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:21:03.987849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-08f8fdb7-0fb6-4dcf-bb1d-0d713161e336 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:03.999456 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-08f8fdb7-0fb6-4dcf-bb1d-0d713161e336 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71" status: 200 len: 1645 microversion: 2.1 time: 0.803303 Oct 10 23:21:04.010385 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 652/1293] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:03 2022] GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71 => generated 1645 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:04.031504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-64f65b2f-81e1-480b-a76a-60b8b712e4e5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:04.032378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-64f65b2f-81e1-480b-a76a-60b8b712e4e5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:04.048834 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64f65b2f-81e1-480b-a76a-60b8b712e4e5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:04.055895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64f65b2f-81e1-480b-a76a-60b8b712e4e5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:04.056408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64f65b2f-81e1-480b-a76a-60b8b712e4e5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:04.057396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64f65b2f-81e1-480b-a76a-60b8b712e4e5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:04.059527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64f65b2f-81e1-480b-a76a-60b8b712e4e5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:04.068270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64f65b2f-81e1-480b-a76a-60b8b712e4e5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:04.630380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a1dffe40-fe34-4374-94f9-ce990ad28154 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:21:04.630925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a1dffe40-fe34-4374-94f9-ce990ad28154 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:21:04.631588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a1dffe40-fe34-4374-94f9-ce990ad28154 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:21:04.632124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a1dffe40-fe34-4374-94f9-ce990ad28154 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:21:04.632743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a1dffe40-fe34-4374-94f9-ce990ad28154 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:21:04.651676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1dffe40-fe34-4374-94f9-ce990ad28154 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:04.652281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1dffe40-fe34-4374-94f9-ce990ad28154 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:04.652816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1dffe40-fe34-4374-94f9-ce990ad28154 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:04.658189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1dffe40-fe34-4374-94f9-ce990ad28154 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:04.658920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1dffe40-fe34-4374-94f9-ce990ad28154 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:04.659603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1dffe40-fe34-4374-94f9-ce990ad28154 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:04.721154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-a1dffe40-fe34-4374-94f9-ce990ad28154 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Getting quotas for project 01ebbb0c057c44be8b51615d59209d90. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:21:04.730687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-a1dffe40-fe34-4374-94f9-ce990ad28154 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Getting quotas for user fabfd9ac67b645bf9234590b623c27b0 and project 01ebbb0c057c44be8b51615d59209d90. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:21:04.777694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a1dffe40-fe34-4374-94f9-ce990ad28154 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:21:04.782390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-64f65b2f-81e1-480b-a76a-60b8b712e4e5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:04.785949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a1dffe40-fe34-4374-94f9-ce990ad28154 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:21:04.792735 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-64f65b2f-81e1-480b-a76a-60b8b712e4e5 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1537 microversion: 2.1 time: 0.780832 Oct 10 23:21:04.793320 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 653/1294] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:04 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1537 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:04.814134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3ec40dfd-f945-4537-bfa8-4b7fb63cd351 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:04.814884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3ec40dfd-f945-4537-bfa8-4b7fb63cd351 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 90aa3419-44a6-4b0d-9af1-5f6df3554b71] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:04.836767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ec40dfd-f945-4537-bfa8-4b7fb63cd351 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:04.842285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ec40dfd-f945-4537-bfa8-4b7fb63cd351 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:04.843030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ec40dfd-f945-4537-bfa8-4b7fb63cd351 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:04.843939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ec40dfd-f945-4537-bfa8-4b7fb63cd351 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:04.848521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ec40dfd-f945-4537-bfa8-4b7fb63cd351 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:04.849915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ec40dfd-f945-4537-bfa8-4b7fb63cd351 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:04.937007 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a1dffe40-fe34-4374-94f9-ce990ad28154 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.226397 Oct 10 23:21:04.939883 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 642/1295] 10.222.0.23 () {62 vars in 1188 bytes} [Mon Oct 10 23:21:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 23:21:04.962910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-1ce91a29-eba1-457e-8c70-fce63b313c12 req-f97d652c-afa7-4398-9552-61ce03351793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90aa3419-44a6-4b0d-9af1-5f6df3554b71", "name": "network-vif-deleted", "tag": "e7e827df-c293-4503-a382-723a56a14034"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:05.002065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1ce91a29-eba1-457e-8c70-fce63b313c12 req-f97d652c-afa7-4398-9552-61ce03351793 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:05.002779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1ce91a29-eba1-457e-8c70-fce63b313c12 req-f97d652c-afa7-4398-9552-61ce03351793 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:05.004975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1ce91a29-eba1-457e-8c70-fce63b313c12 req-f97d652c-afa7-4398-9552-61ce03351793 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:05.035451 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-1ce91a29-eba1-457e-8c70-fce63b313c12 req-f97d652c-afa7-4398-9552-61ce03351793 service nova] Creating event network-vif-deleted:e7e827df-c293-4503-a382-723a56a14034 for instance 90aa3419-44a6-4b0d-9af1-5f6df3554b71 on n-h2-860864-2 Oct 10 23:21:05.046853 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-1ce91a29-eba1-457e-8c70-fce63b313c12 req-f97d652c-afa7-4398-9552-61ce03351793 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103832 Oct 10 23:21:05.052605 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 643/1296] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:05.063920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-859ffa0a-a954-4811-a2bd-3e636e59959f tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:05.067866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-859ffa0a-a954-4811-a2bd-3e636e59959f tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] [instance: bdf5220b-cc6e-4457-b00c-b4e02cf8f982] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:05.085284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-859ffa0a-a954-4811-a2bd-3e636e59959f tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:05.086020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-859ffa0a-a954-4811-a2bd-3e636e59959f tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:05.087477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-859ffa0a-a954-4811-a2bd-3e636e59959f tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:05.088866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-859ffa0a-a954-4811-a2bd-3e636e59959f tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:05.096219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-859ffa0a-a954-4811-a2bd-3e636e59959f tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:05.098115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-859ffa0a-a954-4811-a2bd-3e636e59959f tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:05.099876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3ec40dfd-f945-4537-bfa8-4b7fb63cd351 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '310196e1663a4f7ca12e1fc53b0278ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98b12fc1bbf42d4b7376222c55733ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:05.120503 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3ec40dfd-f945-4537-bfa8-4b7fb63cd351 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71" status: 200 len: 1302 microversion: 2.1 time: 0.318301 Oct 10 23:21:05.131272 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 654/1297] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:04 2022] GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71 => generated 1302 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:05.149749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4db6f5e5-99b6-4a83-b3e3-2d4e6c24637b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:05.152683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4db6f5e5-99b6-4a83-b3e3-2d4e6c24637b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:05.224740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-859ffa0a-a954-4811-a2bd-3e636e59959f tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:05.227599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-859ffa0a-a954-4811-a2bd-3e636e59959f tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:05.228602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-859ffa0a-a954-4811-a2bd-3e636e59959f tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:05.230639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-859ffa0a-a954-4811-a2bd-3e636e59959f tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lazy-loading 'fault' on Instance uuid bdf5220b-cc6e-4457-b00c-b4e02cf8f982 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:21:05.364963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4db6f5e5-99b6-4a83-b3e3-2d4e6c24637b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:05.376636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4db6f5e5-99b6-4a83-b3e3-2d4e6c24637b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:05.378806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4db6f5e5-99b6-4a83-b3e3-2d4e6c24637b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:05.384994 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4db6f5e5-99b6-4a83-b3e3-2d4e6c24637b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1286 microversion: 2.25 time: 0.247886 Oct 10 23:21:05.385989 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 655/1298] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:05 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1286 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:05.404899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4053e49a-6cad-4ad7-8f62-8e23636fa1eb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:05.405560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4053e49a-6cad-4ad7-8f62-8e23636fa1eb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:05.423880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4053e49a-6cad-4ad7-8f62-8e23636fa1eb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:05.424390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4053e49a-6cad-4ad7-8f62-8e23636fa1eb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:05.425233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4053e49a-6cad-4ad7-8f62-8e23636fa1eb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:05.431827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4053e49a-6cad-4ad7-8f62-8e23636fa1eb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:05.432488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4053e49a-6cad-4ad7-8f62-8e23636fa1eb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:05.433399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4053e49a-6cad-4ad7-8f62-8e23636fa1eb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:05.452314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-859ffa0a-a954-4811-a2bd-3e636e59959f tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:05.478652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-859ffa0a-a954-4811-a2bd-3e636e59959f tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:05.489075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-859ffa0a-a954-4811-a2bd-3e636e59959f tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c7236d800a747eba9437a3c68047f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7856298ca7041b99dfcdb3e39c5f881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:05.496214 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-859ffa0a-a954-4811-a2bd-3e636e59959f tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] 10.222.0.23 "GET /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982" status: 200 len: 1371 microversion: 2.47 time: 0.442111 Oct 10 23:21:05.503332 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 644/1299] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:05 2022] GET /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982 => generated 1371 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:05.589345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4053e49a-6cad-4ad7-8f62-8e23636fa1eb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dfa7f1be9884bb1aabc9df8702fa630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fc65084a2a46689aa3b221e6d7aeb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:05.600718 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4053e49a-6cad-4ad7-8f62-8e23636fa1eb tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71" status: 200 len: 1466 microversion: 2.1 time: 0.213187 Oct 10 23:21:05.601673 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 656/1300] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:05 2022] GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71 => generated 1466 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:05.822305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3c023209-a946-4449-a28b-d4dae0d2f3a7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:05.823483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3c023209-a946-4449-a28b-d4dae0d2f3a7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:05.867535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c023209-a946-4449-a28b-d4dae0d2f3a7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:05.869136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c023209-a946-4449-a28b-d4dae0d2f3a7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:05.872114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c023209-a946-4449-a28b-d4dae0d2f3a7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:05.875777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c023209-a946-4449-a28b-d4dae0d2f3a7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:05.882184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c023209-a946-4449-a28b-d4dae0d2f3a7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:05.882640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c023209-a946-4449-a28b-d4dae0d2f3a7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:06.163472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a19db4e1-36bd-42aa-a141-aa19810ef7f1 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:06.164107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a19db4e1-36bd-42aa-a141-aa19810ef7f1 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] [instance: 90aa3419-44a6-4b0d-9af1-5f6df3554b71] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:06.172562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a19db4e1-36bd-42aa-a141-aa19810ef7f1 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:06.196833 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a19db4e1-36bd-42aa-a141-aa19810ef7f1 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:06.199221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a19db4e1-36bd-42aa-a141-aa19810ef7f1 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:06.200524 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a19db4e1-36bd-42aa-a141-aa19810ef7f1 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:06.204519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a19db4e1-36bd-42aa-a141-aa19810ef7f1 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:06.205180 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a19db4e1-36bd-42aa-a141-aa19810ef7f1 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:06.221788 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-a19db4e1-36bd-42aa-a141-aa19810ef7f1 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] HTTP exception thrown: Instance 90aa3419-44a6-4b0d-9af1-5f6df3554b71 could not be found. Oct 10 23:21:06.224004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a19db4e1-36bd-42aa-a141-aa19810ef7f1 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Request method failure captured: Oct 10 23:21:06.224004 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71 HTTP/1.1 Oct 10 23:21:06.224004 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:21:06.224004 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:21:06.224004 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:21:06.224004 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:21:06.224004 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:21:06.224004 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:21:06.224004 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:21:06.224004 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:06.224004 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgJCGPRazsPZv_KJRTPkW4yfXkftWI99r6NM1NcPzbV6ezzFy8Kk0KC2fs-Oq1mdxcQ8vpiKa4rTjWrgHH8KDGbQArWJeSLbZnpz5njlegxl252rFp2J2t_YkO8EBZX2N9DD656V96Tu1xc3xvEKd_hjW4bndDcX9tluGi3sznnXco Oct 10 23:21:06.224004 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:21:06.224004 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:21:06.224004 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:21:06.224004 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:21:06.224004 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:21:06.224004 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:21:06.224004 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: d98b12fc1bbf42d4b7376222c55733ed Oct 10 23:21:06.224004 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:21:06.224004 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:21:06.224004 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:21:06.225768 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d98b12fc1bbf42d4b7376222c55733ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d98b12fc1bbf42d4b7376222c55733ed", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:06.225768 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:21:06.225768 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: d98b12fc1bbf42d4b7376222c55733ed Oct 10 23:21:06.225768 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1123459593 Oct 10 23:21:06.225768 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersOnMultiNodesTest-1123459593-project Oct 10 23:21:06.225768 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:21:06.225768 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:21:06.225768 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 310196e1663a4f7ca12e1fc53b0278ba Oct 10 23:21:06.225768 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersOnMultiNodesTest-1123459593-project Oct 10 23:21:06.225768 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:21:06.225768 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 90aa3419-44a6-4b0d-9af1-5f6df3554b71 could not be found. Oct 10 23:21:06.225768 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '90aa3419-44a6-4b0d-9af1-5f6df3554b71'} Oct 10 23:21:06.227397 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:06.227397 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:06.227397 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:21:06.227397 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:21:06.227397 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:21:06.227397 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:21:06.227397 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:21:06.227397 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:21:06.227397 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:21:06.227397 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:21:06.227397 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90aa3419-44a6-4b0d-9af1-5f6df3554b71 could not be found. Oct 10 23:21:06.227397 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:06.227397 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:06.227397 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:06.227397 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:06.227397 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:06.227397 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:06.227397 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:06.227397 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:06.227397 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:06.228712 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:06.228712 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:21:06.228712 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:21:06.228712 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:21:06.228712 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:21:06.228712 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:21:06.228712 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:21:06.228712 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90aa3419-44a6-4b0d-9af1-5f6df3554b71 could not be found. Oct 10 23:21:06.228712 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:06.228712 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:06.228712 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:06.228712 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:06.228712 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:06.228712 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:06.228712 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:21:06.228712 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:21:06.228712 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90aa3419-44a6-4b0d-9af1-5f6df3554b71 could not be found. Oct 10 23:21:06.228712 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:06.231042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a19db4e1-36bd-42aa-a141-aa19810ef7f1 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] Returning 404 to user: Instance 90aa3419-44a6-4b0d-9af1-5f6df3554b71 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:06.232309 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a19db4e1-36bd-42aa-a141-aa19810ef7f1 tempest-ServersOnMultiNodesTest-1123459593 tempest-ServersOnMultiNodesTest-1123459593-project] 10.222.0.23 "GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71" status: 404 len: 111 microversion: 2.1 time: 0.077106 Oct 10 23:21:06.233718 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 657/1301] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:06 2022] GET /compute/v2.1/servers/90aa3419-44a6-4b0d-9af1-5f6df3554b71 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:21:06.326579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3c023209-a946-4449-a28b-d4dae0d2f3a7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:06.334978 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3c023209-a946-4449-a28b-d4dae0d2f3a7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1537 microversion: 2.1 time: 0.518702 Oct 10 23:21:06.335566 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 645/1302] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:05 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1537 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:06.416484 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0db08b34-946d-450f-ad73-d65e6dc94ae5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:06.417351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0db08b34-946d-450f-ad73-d65e6dc94ae5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:06.429313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0db08b34-946d-450f-ad73-d65e6dc94ae5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:06.430390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0db08b34-946d-450f-ad73-d65e6dc94ae5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:06.430905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0db08b34-946d-450f-ad73-d65e6dc94ae5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:06.431902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0db08b34-946d-450f-ad73-d65e6dc94ae5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:06.433079 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0db08b34-946d-450f-ad73-d65e6dc94ae5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:06.433732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0db08b34-946d-450f-ad73-d65e6dc94ae5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:06.530060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-454b8629-0fb2-41c5-ae2f-d7fcb6df8e78 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:06.530642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-454b8629-0fb2-41c5-ae2f-d7fcb6df8e78 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] [instance: bdf5220b-cc6e-4457-b00c-b4e02cf8f982] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:06.538784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-454b8629-0fb2-41c5-ae2f-d7fcb6df8e78 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:06.539782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-454b8629-0fb2-41c5-ae2f-d7fcb6df8e78 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:06.541084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-454b8629-0fb2-41c5-ae2f-d7fcb6df8e78 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:06.542306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-454b8629-0fb2-41c5-ae2f-d7fcb6df8e78 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:06.543175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-454b8629-0fb2-41c5-ae2f-d7fcb6df8e78 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:06.549641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0db08b34-946d-450f-ad73-d65e6dc94ae5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:06.558400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-454b8629-0fb2-41c5-ae2f-d7fcb6df8e78 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:06.565485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0db08b34-946d-450f-ad73-d65e6dc94ae5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:06.570183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0db08b34-946d-450f-ad73-d65e6dc94ae5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:06.573717 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0db08b34-946d-450f-ad73-d65e6dc94ae5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1282 microversion: 2.25 time: 0.161466 Oct 10 23:21:06.574569 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 658/1303] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:06 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1282 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:06.591454 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-454b8629-0fb2-41c5-ae2f-d7fcb6df8e78 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] HTTP exception thrown: Instance bdf5220b-cc6e-4457-b00c-b4e02cf8f982 could not be found. Oct 10 23:21:06.593885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-454b8629-0fb2-41c5-ae2f-d7fcb6df8e78 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Request method failure captured: Oct 10 23:21:06.593885 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982 HTTP/1.1 Oct 10 23:21:06.593885 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:21:06.593885 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:21:06.593885 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:21:06.593885 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:21:06.593885 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:21:06.593885 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:21:06.593885 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:21:06.593885 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:06.593885 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKjUm_qDzJgCRBtG9JwwZLWzKmtgPnwL09xR4BGEv1vX2DGh6NH8AroUjNBvjAE3hSAyU9MlxvKwOJxZhXFtr_9xCxyd7WwP2N69j6wjcGUsldVz0-oCHqvFARtkq3GOqVf4nowaKEoKx9gw6oBF8vB3dluG-pVNJCkQcxS-WHoWB18 Oct 10 23:21:06.593885 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:21:06.593885 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:21:06.593885 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:21:06.593885 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:21:06.593885 n-d-860864-2 devstack@n-api.service[120613]: X-Openstack-Nova-Api-Version: 2.47 Oct 10 23:21:06.593885 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:21:06.593885 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:21:06.593885 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: b7856298ca7041b99dfcdb3e39c5f881 Oct 10 23:21:06.593885 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersAaction247Test-621491368 Oct 10 23:21:06.593885 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:21:06.593885 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:21:06.595653 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b7856298ca7041b99dfcdb3e39c5f881"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7856298ca7041b99dfcdb3e39c5f881"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7856298ca7041b99dfcdb3e39c5f881"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b7856298ca7041b99dfcdb3e39c5f881", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:06.595653 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersAaction247Test-621491368 Oct 10 23:21:06.595653 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: b7856298ca7041b99dfcdb3e39c5f881 Oct 10 23:21:06.595653 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersAaction247Test-621491368 Oct 10 23:21:06.595653 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersAaction247Test-621491368-project Oct 10 23:21:06.595653 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:21:06.595653 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:21:06.595653 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 3c7236d800a747eba9437a3c68047f12 Oct 10 23:21:06.595653 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersAaction247Test-621491368-project Oct 10 23:21:06.595653 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:21:06.595653 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance bdf5220b-cc6e-4457-b00c-b4e02cf8f982 could not be found. Oct 10 23:21:06.595653 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'bdf5220b-cc6e-4457-b00c-b4e02cf8f982'} Oct 10 23:21:06.596578 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:06.596578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:06.596578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:21:06.596578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:21:06.596578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:21:06.596578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:21:06.596578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:21:06.596578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:21:06.596578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:21:06.596578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:21:06.596578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdf5220b-cc6e-4457-b00c-b4e02cf8f982 could not be found. Oct 10 23:21:06.596578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:06.596578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:06.596578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:06.596578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:06.596578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:06.596578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:06.596578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:06.596578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:06.596578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:06.598048 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:06.598048 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:21:06.598048 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:21:06.598048 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:21:06.598048 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:21:06.598048 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:21:06.598048 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:21:06.598048 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdf5220b-cc6e-4457-b00c-b4e02cf8f982 could not be found. Oct 10 23:21:06.598048 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:06.598048 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:06.598048 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:06.598048 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:06.598048 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:06.598048 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:06.598048 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:21:06.598048 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:21:06.598048 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdf5220b-cc6e-4457-b00c-b4e02cf8f982 could not be found. Oct 10 23:21:06.598048 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:06.599401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-454b8629-0fb2-41c5-ae2f-d7fcb6df8e78 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] Returning 404 to user: Instance bdf5220b-cc6e-4457-b00c-b4e02cf8f982 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:06.599401 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-454b8629-0fb2-41c5-ae2f-d7fcb6df8e78 tempest-ServersAaction247Test-621491368 tempest-ServersAaction247Test-621491368-project] 10.222.0.23 "GET /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982" status: 404 len: 111 microversion: 2.47 time: 0.071589 Oct 10 23:21:06.599401 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 646/1304] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:06 2022] GET /compute/v2.1/servers/bdf5220b-cc6e-4457-b00c-b4e02cf8f982 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 10 23:21:06.631456 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fa43a7af-0162-428e-818c-61515ed132d0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:06.632864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fa43a7af-0162-428e-818c-61515ed132d0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] [instance: 26119603-9e9d-40bc-8b27-03e36c3c9f71] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:06.643152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa43a7af-0162-428e-818c-61515ed132d0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:06.644170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa43a7af-0162-428e-818c-61515ed132d0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:06.644884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa43a7af-0162-428e-818c-61515ed132d0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:06.645853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa43a7af-0162-428e-818c-61515ed132d0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:06.646536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa43a7af-0162-428e-818c-61515ed132d0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:06.652019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa43a7af-0162-428e-818c-61515ed132d0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:06.676643 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-fa43a7af-0162-428e-818c-61515ed132d0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] HTTP exception thrown: Instance 26119603-9e9d-40bc-8b27-03e36c3c9f71 could not be found. Oct 10 23:21:06.678312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fa43a7af-0162-428e-818c-61515ed132d0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Request method failure captured: Oct 10 23:21:06.678312 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71 HTTP/1.1 Oct 10 23:21:06.678312 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:21:06.678312 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:21:06.678312 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:21:06.678312 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:21:06.678312 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:21:06.678312 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:21:06.678312 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:21:06.678312 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:06.678312 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKiWDPhHeP1ao6Y5tHRbKvX9ZemW6vlLJ_C_MrPyGjEC179XpXPzYIbuoXBVNF4FDH7pzl8bOhuSRj1e7-5DcugU6k1KiwPFd9Qs6t3kjUe9RfKY0BXqex3wdvC4HjG24zVF2_841auDxOTWHziJVDjurPxpFpMsEGjqqP8S2TuKi34 Oct 10 23:21:06.678312 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:21:06.678312 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:21:06.678312 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:21:06.678312 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:21:06.678312 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:21:06.678312 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:21:06.678312 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:21:06.678312 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:06.678312 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:21:06.678312 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:21:06.680128 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/56fc65084a2a46689aa3b221e6d7aeb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_56fc65084a2a46689aa3b221e6d7aeb8", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:06.680128 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:06.680128 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 56fc65084a2a46689aa3b221e6d7aeb8 Oct 10 23:21:06.680128 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-241200561 Oct 10 23:21:06.680128 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:21:06.680128 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:21:06.680128 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:21:06.680128 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 9dfa7f1be9884bb1aabc9df8702fa630 Oct 10 23:21:06.680128 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-SecurityGroupsTestJSON-241200561-project Oct 10 23:21:06.680128 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:21:06.680128 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 26119603-9e9d-40bc-8b27-03e36c3c9f71 could not be found. Oct 10 23:21:06.680128 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '26119603-9e9d-40bc-8b27-03e36c3c9f71'} Oct 10 23:21:06.681274 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:06.681274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:06.681274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:21:06.681274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:21:06.681274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:21:06.681274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:21:06.681274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:21:06.681274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:21:06.681274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:21:06.681274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:21:06.681274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26119603-9e9d-40bc-8b27-03e36c3c9f71 could not be found. Oct 10 23:21:06.681274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:06.681274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:06.681274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:06.681274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:06.681274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:06.681274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:06.681274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:06.681274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:06.681274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:06.682657 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:06.682657 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:21:06.682657 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:21:06.682657 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:21:06.682657 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:21:06.682657 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:21:06.682657 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:21:06.682657 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26119603-9e9d-40bc-8b27-03e36c3c9f71 could not be found. Oct 10 23:21:06.682657 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:06.682657 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:06.682657 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:06.682657 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:06.682657 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:06.682657 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:06.682657 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:21:06.682657 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:21:06.682657 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26119603-9e9d-40bc-8b27-03e36c3c9f71 could not be found. Oct 10 23:21:06.682657 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:06.685752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fa43a7af-0162-428e-818c-61515ed132d0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Returning 404 to user: Instance 26119603-9e9d-40bc-8b27-03e36c3c9f71 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:06.685752 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fa43a7af-0162-428e-818c-61515ed132d0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71" status: 404 len: 111 microversion: 2.1 time: 0.054307 Oct 10 23:21:06.685752 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 659/1305] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:06 2022] GET /compute/v2.1/servers/26119603-9e9d-40bc-8b27-03e36c3c9f71 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:21:06.689652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-be425ab5-05ab-4865-8919-04ec0b7e3cfa tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662bb9cca0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:06.797577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f7968641-9270-4e0a-b37c-d5435dbcbfa7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfcce8af-548d-4f21-a4c4-4b268690e189", "device": "/dev/xvdb"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:06.801651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f7968641-9270-4e0a-b37c-d5435dbcbfa7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:06.808638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7968641-9270-4e0a-b37c-d5435dbcbfa7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:06.809321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7968641-9270-4e0a-b37c-d5435dbcbfa7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:06.810523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7968641-9270-4e0a-b37c-d5435dbcbfa7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:06.811265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7968641-9270-4e0a-b37c-d5435dbcbfa7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:06.811788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7968641-9270-4e0a-b37c-d5435dbcbfa7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:06.812219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7968641-9270-4e0a-b37c-d5435dbcbfa7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:07.019578 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-be425ab5-05ab-4865-8919-04ec0b7e3cfa tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/e91508f8-8d36-4924-8e71-d6780ec143f2" status: 202 len: 0 microversion: 2.1 time: 0.334430 Oct 10 23:21:07.020784 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 647/1306] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:21:06 2022] DELETE /compute/v2.1/os-security-groups/e91508f8-8d36-4924-8e71-d6780ec143f2 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:21:07.032845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f7fa43b0-8ae0-478c-9d5b-a70f2c7e3bb0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] Calling method '.version_select at 0x7f662b56d4c0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:07.425272 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f7968641-9270-4e0a-b37c-d5435dbcbfa7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "POST /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.631849 Oct 10 23:21:07.426301 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 660/1307] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Oct 10 23:21:06 2022] POST /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/os-volume_attachments => generated 194 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:21:07.445029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-5c0c89d1-1190-4537-af61-03938c6a48a2 req-192726eb-76c3-4bc5-adb5-16a9764010c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26119603-9e9d-40bc-8b27-03e36c3c9f71", "name": "network-vif-deleted", "tag": "06f29faa-7ff9-4ce5-8ccf-43416e2a4bf9"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:07.474839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5c0c89d1-1190-4537-af61-03938c6a48a2 req-192726eb-76c3-4bc5-adb5-16a9764010c1 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:07.475711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5c0c89d1-1190-4537-af61-03938c6a48a2 req-192726eb-76c3-4bc5-adb5-16a9764010c1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:07.479374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5c0c89d1-1190-4537-af61-03938c6a48a2 req-192726eb-76c3-4bc5-adb5-16a9764010c1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:07.495540 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-5c0c89d1-1190-4537-af61-03938c6a48a2 req-192726eb-76c3-4bc5-adb5-16a9764010c1 service nova] Creating event network-vif-deleted:06f29faa-7ff9-4ce5-8ccf-43416e2a4bf9 for instance 26119603-9e9d-40bc-8b27-03e36c3c9f71 on n-h1-860864-2 Oct 10 23:21:07.503633 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-5c0c89d1-1190-4537-af61-03938c6a48a2 req-192726eb-76c3-4bc5-adb5-16a9764010c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074290 Oct 10 23:21:07.505354 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 661/1308] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:07.577757 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f7fa43b0-8ae0-478c-9d5b-a70f2c7e3bb0 tempest-SecurityGroupsTestJSON-241200561 tempest-SecurityGroupsTestJSON-241200561-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/1d1d621a-389e-4f53-ae2d-05bc629e2d19" status: 202 len: 0 microversion: 2.1 time: 0.552953 Oct 10 23:21:07.578350 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 648/1309] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:21:07 2022] DELETE /compute/v2.1/os-security-groups/1d1d621a-389e-4f53-ae2d-05bc629e2d19 => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 23:21:07.584603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-698af3e5-4303-4f99-9f11-9b7fde4e1e77 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:07.585347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-698af3e5-4303-4f99-9f11-9b7fde4e1e77 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:07.598561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-698af3e5-4303-4f99-9f11-9b7fde4e1e77 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:07.601442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-698af3e5-4303-4f99-9f11-9b7fde4e1e77 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:07.601995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-698af3e5-4303-4f99-9f11-9b7fde4e1e77 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:07.612961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-698af3e5-4303-4f99-9f11-9b7fde4e1e77 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:07.613623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-698af3e5-4303-4f99-9f11-9b7fde4e1e77 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:07.614305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-698af3e5-4303-4f99-9f11-9b7fde4e1e77 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:08.048566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-698af3e5-4303-4f99-9f11-9b7fde4e1e77 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:08.058069 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-698af3e5-4303-4f99-9f11-9b7fde4e1e77 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1542 microversion: 2.1 time: 0.478469 Oct 10 23:21:08.067153 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 649/1310] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:07 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1542 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:08.085635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9856940a-3ae6-49a2-a91b-5f183f2c524b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:08.087188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9856940a-3ae6-49a2-a91b-5f183f2c524b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:08.100352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9856940a-3ae6-49a2-a91b-5f183f2c524b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:08.100852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9856940a-3ae6-49a2-a91b-5f183f2c524b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:08.101679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9856940a-3ae6-49a2-a91b-5f183f2c524b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:08.103813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9856940a-3ae6-49a2-a91b-5f183f2c524b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:08.104929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9856940a-3ae6-49a2-a91b-5f183f2c524b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:08.106561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9856940a-3ae6-49a2-a91b-5f183f2c524b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:08.110517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-debf8532-c820-4d79-b4f8-cc6335f56378 tempest-KeyPairsV210TestJSON-605514867 tempest-KeyPairsV210TestJSON-605514867-project-admin] Action: 'create', calling method: .version_select at 0x7f663026d040>, body: {"keypair": {"name": "tempest-keypair-1302704300", "type": "ssh", "user_id": "a14bd57c11264ea1a8138dc3540d6fcf", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNB732jJzBUUtusfX+epncyjcjKcddTyIqHJto9aMlTZu3Ztf20Cpj27amrtmlbWwVcvkFEypluVIp8C9YpmiSpEwNotd4iaW8IwMkW04FAnytBa9nOtyJSYF33mLR/Z5g=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:08.150128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-debf8532-c820-4d79-b4f8-cc6335f56378 tempest-KeyPairsV210TestJSON-605514867 tempest-KeyPairsV210TestJSON-605514867-project-admin] Getting quotas for project 6ef66189bb014b6780b40f8bceb0edca. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:21:08.165456 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-debf8532-c820-4d79-b4f8-cc6335f56378 tempest-KeyPairsV210TestJSON-605514867 tempest-KeyPairsV210TestJSON-605514867-project-admin] Getting quotas for user a655b5fa577e4669af63256ac2ed2a82 and project 6ef66189bb014b6780b40f8bceb0edca. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:21:08.219026 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-debf8532-c820-4d79-b4f8-cc6335f56378 tempest-KeyPairsV210TestJSON-605514867 tempest-KeyPairsV210TestJSON-605514867-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.711721 Oct 10 23:21:08.228845 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 662/1311] 10.222.0.23 () {62 vars in 1200 bytes} [Mon Oct 10 23:21:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 717 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 23:21:08.234872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4f434de0-6fc7-4d43-9cb5-d1ac4b17e1a4 tempest-KeyPairsV210TestJSON-605514867 tempest-KeyPairsV210TestJSON-605514867-project-admin] Action: 'create', calling method: .version_select at 0x7f6633ab1d30>, body: {"keypair": {"name": "tempest-keypair-1195185099", "type": "ssh", "user_id": "a14bd57c11264ea1a8138dc3540d6fcf", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE10Bd1kOxY9d7mMaH843KgraML+8Rn8wSer5JQi7dJkArhDsCCBskTWs/wzA5tSaas+l2dBwtUVmQsUGY29fkgEsARH02gU5Nk5dy/POxgU5HPGp4u5sUuVHtcmaoJzAQ=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:08.246954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9856940a-3ae6-49a2-a91b-5f183f2c524b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:08.255257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-4f434de0-6fc7-4d43-9cb5-d1ac4b17e1a4 tempest-KeyPairsV210TestJSON-605514867 tempest-KeyPairsV210TestJSON-605514867-project-admin] Getting quotas for project 6ef66189bb014b6780b40f8bceb0edca. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:21:08.264963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9856940a-3ae6-49a2-a91b-5f183f2c524b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:08.267175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9856940a-3ae6-49a2-a91b-5f183f2c524b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:08.268178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-4f434de0-6fc7-4d43-9cb5-d1ac4b17e1a4 tempest-KeyPairsV210TestJSON-605514867 tempest-KeyPairsV210TestJSON-605514867-project-admin] Getting quotas for user a655b5fa577e4669af63256ac2ed2a82 and project 6ef66189bb014b6780b40f8bceb0edca. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:21:08.270135 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9856940a-3ae6-49a2-a91b-5f183f2c524b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1344 microversion: 2.25 time: 0.200862 Oct 10 23:21:08.272202 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 650/1312] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:08 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1344 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:08.302697 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4f434de0-6fc7-4d43-9cb5-d1ac4b17e1a4 tempest-KeyPairsV210TestJSON-605514867 tempest-KeyPairsV210TestJSON-605514867-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.072913 Oct 10 23:21:08.312797 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 663/1313] 10.222.0.23 () {62 vars in 1200 bytes} [Mon Oct 10 23:21:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 23:21:08.315479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5f433625-fe1f-46a1-9085-d4376e53a8ad tempest-KeyPairsV210TestJSON-605514867 tempest-KeyPairsV210TestJSON-605514867-project-admin] Calling method '.version_select at 0x7f662b56d4c0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:08.328943 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5f433625-fe1f-46a1-9085-d4376e53a8ad tempest-KeyPairsV210TestJSON-605514867 tempest-KeyPairsV210TestJSON-605514867-project-admin] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1302704300?user_id=a14bd57c11264ea1a8138dc3540d6fcf" status: 200 len: 512 microversion: 2.10 time: 0.017539 Oct 10 23:21:08.329560 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 651/1314] 10.222.0.23 () {60 vars in 1340 bytes} [Mon Oct 10 23:21:08 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1302704300?user_id=a14bd57c11264ea1a8138dc3540d6fcf => generated 512 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:21:08.351174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-79414beb-bcd6-405f-a8a8-a2237498fe92 tempest-KeyPairsV210TestJSON-605514867 tempest-KeyPairsV210TestJSON-605514867-project-admin] Action: 'create', calling method: .version_select at 0x7f6633abeb80>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1390909122", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEntm9DWhU4VF/84cenatpKPMqQ4klP6s9cfb0AUlgsrG9TheakiJp9tiIZm5ugJkkVBU7JYTa48ni42Z/q/DEtxSXTTNhAYSf9Yf4brdqPtINUxRF0hKIAeIEAs0sBUDQ=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:08.378429 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-79414beb-bcd6-405f-a8a8-a2237498fe92 tempest-KeyPairsV210TestJSON-605514867 tempest-KeyPairsV210TestJSON-605514867-project-admin] Getting quotas for project 6ef66189bb014b6780b40f8bceb0edca. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:21:08.385034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-79414beb-bcd6-405f-a8a8-a2237498fe92 tempest-KeyPairsV210TestJSON-605514867 tempest-KeyPairsV210TestJSON-605514867-project-admin] Getting quotas for user a655b5fa577e4669af63256ac2ed2a82 and project 6ef66189bb014b6780b40f8bceb0edca. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:21:08.425424 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-79414beb-bcd6-405f-a8a8-a2237498fe92 tempest-KeyPairsV210TestJSON-605514867 tempest-KeyPairsV210TestJSON-605514867-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.082949 Oct 10 23:21:08.428074 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 664/1315] 10.222.0.23 () {62 vars in 1200 bytes} [Mon Oct 10 23:21:08 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 87 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 23:21:08.438884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a14b843f-bf7a-45bc-b8b8-3fd232b8e31a tempest-KeyPairsV210TestJSON-605514867 tempest-KeyPairsV210TestJSON-605514867-project-admin] Calling method '.version_select at 0x7f662b56d5e0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:08.450915 n-d-860864-2 devstack@n-api.service[120613]: WARNING oslo_db.sqlalchemy.utils [None req-a14b843f-bf7a-45bc-b8b8-3fd232b8e31a tempest-KeyPairsV210TestJSON-605514867 tempest-KeyPairsV210TestJSON-605514867-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 10 23:21:08.462356 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a14b843f-bf7a-45bc-b8b8-3fd232b8e31a tempest-KeyPairsV210TestJSON-605514867 tempest-KeyPairsV210TestJSON-605514867-project-admin] 10.222.0.23 "GET /compute/v2.1/os-keypairs?user_id=a14bd57c11264ea1a8138dc3540d6fcf" status: 200 len: 726 microversion: 2.10 time: 0.027510 Oct 10 23:21:08.476756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8885c546-93b2-4104-b371-46697fa5b6fa tempest-KeyPairsV210TestJSON-605514867 tempest-KeyPairsV210TestJSON-605514867-project-admin] Calling method '.version_select at 0x7f6633ab19d0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:08.483586 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 652/1316] 10.222.0.23 () {60 vars in 1259 bytes} [Mon Oct 10 23:21:08 2022] GET /compute/v2.1/os-keypairs?user_id=a14bd57c11264ea1a8138dc3540d6fcf => generated 726 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:21:08.504092 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8885c546-93b2-4104-b371-46697fa5b6fa tempest-KeyPairsV210TestJSON-605514867 tempest-KeyPairsV210TestJSON-605514867-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1390909122" status: 204 len: 0 microversion: 2.10 time: 0.032087 Oct 10 23:21:08.514219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5f6086c0-ec04-46a9-876a-ea5c82f99e0f tempest-KeyPairsV210TestJSON-605514867 tempest-KeyPairsV210TestJSON-605514867-project-admin] Calling method '.version_select at 0x7f662b505a60>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:08.520023 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 665/1317] 10.222.0.23 () {60 vars in 1325 bytes} [Mon Oct 10 23:21:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1390909122 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 10 23:21:08.562363 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5f6086c0-ec04-46a9-876a-ea5c82f99e0f tempest-KeyPairsV210TestJSON-605514867 tempest-KeyPairsV210TestJSON-605514867-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1195185099?user_id=a14bd57c11264ea1a8138dc3540d6fcf" status: 204 len: 0 microversion: 2.10 time: 0.052190 Oct 10 23:21:08.574792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d929bde1-5c42-4f16-ab6c-03cacff07aaf tempest-KeyPairsV210TestJSON-605514867 tempest-KeyPairsV210TestJSON-605514867-project-admin] Calling method '.version_select at 0x7f662b4cc670>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:08.579673 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 653/1318] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Oct 10 23:21:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1195185099?user_id=a14bd57c11264ea1a8138dc3540d6fcf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:21:08.609488 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d929bde1-5c42-4f16-ab6c-03cacff07aaf tempest-KeyPairsV210TestJSON-605514867 tempest-KeyPairsV210TestJSON-605514867-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1302704300?user_id=a14bd57c11264ea1a8138dc3540d6fcf" status: 204 len: 0 microversion: 2.10 time: 0.039603 Oct 10 23:21:08.614803 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 666/1319] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Oct 10 23:21:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1302704300?user_id=a14bd57c11264ea1a8138dc3540d6fcf => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:21:09.090856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c730db7e-05f6-480f-9f26-bd5d432df80c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:09.092155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c730db7e-05f6-480f-9f26-bd5d432df80c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:09.104139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c730db7e-05f6-480f-9f26-bd5d432df80c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:09.108202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c730db7e-05f6-480f-9f26-bd5d432df80c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:09.108693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c730db7e-05f6-480f-9f26-bd5d432df80c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:09.109489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c730db7e-05f6-480f-9f26-bd5d432df80c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:09.109976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c730db7e-05f6-480f-9f26-bd5d432df80c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:09.110413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c730db7e-05f6-480f-9f26-bd5d432df80c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:09.303427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c9e28896-f848-4dd1-a398-3bf79ceb9221 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:09.304195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c9e28896-f848-4dd1-a398-3bf79ceb9221 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:09.322528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9e28896-f848-4dd1-a398-3bf79ceb9221 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:09.323091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9e28896-f848-4dd1-a398-3bf79ceb9221 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:09.323765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9e28896-f848-4dd1-a398-3bf79ceb9221 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:09.324685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9e28896-f848-4dd1-a398-3bf79ceb9221 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:09.332947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9e28896-f848-4dd1-a398-3bf79ceb9221 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:09.333768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9e28896-f848-4dd1-a398-3bf79ceb9221 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:10.115842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c9e28896-f848-4dd1-a398-3bf79ceb9221 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:10.132426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c9e28896-f848-4dd1-a398-3bf79ceb9221 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:10.134222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c9e28896-f848-4dd1-a398-3bf79ceb9221 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:10.135734 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c9e28896-f848-4dd1-a398-3bf79ceb9221 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1412 microversion: 2.25 time: 0.837484 Oct 10 23:21:10.140565 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 667/1320] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:09 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1412 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:21:10.541972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c730db7e-05f6-480f-9f26-bd5d432df80c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:10.567974 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c730db7e-05f6-480f-9f26-bd5d432df80c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1542 microversion: 2.1 time: 1.478707 Oct 10 23:21:10.568671 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 654/1321] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:09 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1542 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:11.023625 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3751dfeb-903c-4ace-956e-d4102a7c7d5b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1137877929", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": "none"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:11.108595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3751dfeb-903c-4ace-956e-d4102a7c7d5b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:21:11.109613 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3751dfeb-903c-4ace-956e-d4102a7c7d5b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:21:11.110105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3751dfeb-903c-4ace-956e-d4102a7c7d5b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:21:11.110863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3751dfeb-903c-4ace-956e-d4102a7c7d5b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:21:11.111353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3751dfeb-903c-4ace-956e-d4102a7c7d5b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:21:11.126946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3751dfeb-903c-4ace-956e-d4102a7c7d5b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:11.127592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3751dfeb-903c-4ace-956e-d4102a7c7d5b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:11.127887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3751dfeb-903c-4ace-956e-d4102a7c7d5b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:11.130480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3751dfeb-903c-4ace-956e-d4102a7c7d5b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:11.131476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3751dfeb-903c-4ace-956e-d4102a7c7d5b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:11.132113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3751dfeb-903c-4ace-956e-d4102a7c7d5b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:11.170622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-3751dfeb-903c-4ace-956e-d4102a7c7d5b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Getting quotas for project 82691202f4ce41a3958dc8767955b71d. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:21:11.171099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cc178388-6c7c-43ba-9dc8-e23057019b35 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:11.171834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cc178388-6c7c-43ba-9dc8-e23057019b35 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:11.179775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-3751dfeb-903c-4ace-956e-d4102a7c7d5b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Getting quotas for user c695a35a2d4c40eeb86a4653a4c048ec and project 82691202f4ce41a3958dc8767955b71d. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:21:11.184915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc178388-6c7c-43ba-9dc8-e23057019b35 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:11.186788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc178388-6c7c-43ba-9dc8-e23057019b35 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:11.188568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc178388-6c7c-43ba-9dc8-e23057019b35 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:11.191341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc178388-6c7c-43ba-9dc8-e23057019b35 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:11.192066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc178388-6c7c-43ba-9dc8-e23057019b35 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:11.192844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc178388-6c7c-43ba-9dc8-e23057019b35 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:11.231744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3751dfeb-903c-4ace-956e-d4102a7c7d5b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:21:11.234608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3751dfeb-903c-4ace-956e-d4102a7c7d5b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:21:11.334444 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3751dfeb-903c-4ace-956e-d4102a7c7d5b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.536767 Oct 10 23:21:11.340229 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 668/1322] 10.222.0.23 () {62 vars in 1188 bytes} [Mon Oct 10 23:21:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 23:21:11.356415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-716cacf3-ea56-4f8a-90e8-e6724403ab74 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:11.359294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-716cacf3-ea56-4f8a-90e8-e6724403ab74 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:11.704963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-716cacf3-ea56-4f8a-90e8-e6724403ab74 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:11.715319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-716cacf3-ea56-4f8a-90e8-e6724403ab74 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:11.717779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-716cacf3-ea56-4f8a-90e8-e6724403ab74 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:11.720669 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-716cacf3-ea56-4f8a-90e8-e6724403ab74 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1278 microversion: 2.57 time: 0.373373 Oct 10 23:21:11.725415 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 669/1323] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:11 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1278 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:21:11.732817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ecfcea92-4305-46c2-ba6c-e46b5d4b9aab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:11.736867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ecfcea92-4305-46c2-ba6c-e46b5d4b9aab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:11.751934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ecfcea92-4305-46c2-ba6c-e46b5d4b9aab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:11.753261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ecfcea92-4305-46c2-ba6c-e46b5d4b9aab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:11.754371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ecfcea92-4305-46c2-ba6c-e46b5d4b9aab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:11.756791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ecfcea92-4305-46c2-ba6c-e46b5d4b9aab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:11.757868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ecfcea92-4305-46c2-ba6c-e46b5d4b9aab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:11.758313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ecfcea92-4305-46c2-ba6c-e46b5d4b9aab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:11.798421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:11.880402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cc178388-6c7c-43ba-9dc8-e23057019b35 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:11.894119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cc178388-6c7c-43ba-9dc8-e23057019b35 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:11.898634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cc178388-6c7c-43ba-9dc8-e23057019b35 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:11.903034 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cc178388-6c7c-43ba-9dc8-e23057019b35 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1412 microversion: 2.25 time: 0.738388 Oct 10 23:21:11.907709 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 655/1324] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:11 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1412 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:21:12.752112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3db3c7a7-20f8-44fa-afa0-f7571d18520e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:12.754060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3db3c7a7-20f8-44fa-afa0-f7571d18520e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:12.763750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3db3c7a7-20f8-44fa-afa0-f7571d18520e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:12.764404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3db3c7a7-20f8-44fa-afa0-f7571d18520e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:12.764756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3db3c7a7-20f8-44fa-afa0-f7571d18520e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:12.765540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3db3c7a7-20f8-44fa-afa0-f7571d18520e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:12.766038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3db3c7a7-20f8-44fa-afa0-f7571d18520e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:12.766496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3db3c7a7-20f8-44fa-afa0-f7571d18520e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:12.917350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3db3c7a7-20f8-44fa-afa0-f7571d18520e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:12.926979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3db3c7a7-20f8-44fa-afa0-f7571d18520e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:12.928438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3db3c7a7-20f8-44fa-afa0-f7571d18520e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:12.941456 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3db3c7a7-20f8-44fa-afa0-f7571d18520e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1330 microversion: 2.57 time: 0.191413 Oct 10 23:21:12.955682 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 656/1325] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:12 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1330 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:12.973879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1be2d342-1449-459e-9fb1-05e4465c95e5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:12.975781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1be2d342-1449-459e-9fb1-05e4465c95e5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:12.993612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1be2d342-1449-459e-9fb1-05e4465c95e5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:12.994346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1be2d342-1449-459e-9fb1-05e4465c95e5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:12.994873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1be2d342-1449-459e-9fb1-05e4465c95e5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:12.996457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1be2d342-1449-459e-9fb1-05e4465c95e5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:12.997058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1be2d342-1449-459e-9fb1-05e4465c95e5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:12.998203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1be2d342-1449-459e-9fb1-05e4465c95e5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:13.006926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ecfcea92-4305-46c2-ba6c-e46b5d4b9aab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:13.021024 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ecfcea92-4305-46c2-ba6c-e46b5d4b9aab tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1542 microversion: 2.1 time: 1.293465 Oct 10 23:21:13.022495 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 670/1326] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:11 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1542 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:13.404407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1be2d342-1449-459e-9fb1-05e4465c95e5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:13.427650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1be2d342-1449-459e-9fb1-05e4465c95e5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:13.429831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1be2d342-1449-459e-9fb1-05e4465c95e5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:13.435732 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1be2d342-1449-459e-9fb1-05e4465c95e5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1412 microversion: 2.25 time: 0.469194 Oct 10 23:21:13.438229 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 657/1327] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:12 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1412 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:13.669816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-76089c7e-083d-4031-9c34-8f70c95c3273 req-ebcd2ec4-e4fb-4101-b7ed-5c10d2d499ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58fcd7f0-d348-47b1-9b3d-f7514b940eb3", "tag": "4ddf9b37-7413-4cc7-829c-ce7603a65f55"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:13.702000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-76089c7e-083d-4031-9c34-8f70c95c3273 req-ebcd2ec4-e4fb-4101-b7ed-5c10d2d499ad service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:13.704013 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-76089c7e-083d-4031-9c34-8f70c95c3273 req-ebcd2ec4-e4fb-4101-b7ed-5c10d2d499ad service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:13.706935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-76089c7e-083d-4031-9c34-8f70c95c3273 req-ebcd2ec4-e4fb-4101-b7ed-5c10d2d499ad service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:13.749167 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-76089c7e-083d-4031-9c34-8f70c95c3273 req-ebcd2ec4-e4fb-4101-b7ed-5c10d2d499ad service nova] Creating event network-changed:4ddf9b37-7413-4cc7-829c-ce7603a65f55 for instance 58fcd7f0-d348-47b1-9b3d-f7514b940eb3 on n-h2-860864-2 Oct 10 23:21:13.755929 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-76089c7e-083d-4031-9c34-8f70c95c3273 req-ebcd2ec4-e4fb-4101-b7ed-5c10d2d499ad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090991 Oct 10 23:21:13.757691 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 671/1328] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:13.971856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-df988eb6-3792-4bf0-9874-39967e56b9c3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:13.973128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-df988eb6-3792-4bf0-9874-39967e56b9c3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:13.991918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df988eb6-3792-4bf0-9874-39967e56b9c3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:13.992721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df988eb6-3792-4bf0-9874-39967e56b9c3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:13.993322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df988eb6-3792-4bf0-9874-39967e56b9c3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:13.994235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df988eb6-3792-4bf0-9874-39967e56b9c3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:13.994855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df988eb6-3792-4bf0-9874-39967e56b9c3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:13.995444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df988eb6-3792-4bf0-9874-39967e56b9c3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:14.050094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bb104e11-cc98-48ff-8f37-9087945e8660 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:14.051048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bb104e11-cc98-48ff-8f37-9087945e8660 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:14.067752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb104e11-cc98-48ff-8f37-9087945e8660 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:14.068965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb104e11-cc98-48ff-8f37-9087945e8660 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:14.069700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb104e11-cc98-48ff-8f37-9087945e8660 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:14.071586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb104e11-cc98-48ff-8f37-9087945e8660 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:14.072293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb104e11-cc98-48ff-8f37-9087945e8660 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:14.073510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb104e11-cc98-48ff-8f37-9087945e8660 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:14.246788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-df988eb6-3792-4bf0-9874-39967e56b9c3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:14.271088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-df988eb6-3792-4bf0-9874-39967e56b9c3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:14.277161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-df988eb6-3792-4bf0-9874-39967e56b9c3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:14.283759 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-df988eb6-3792-4bf0-9874-39967e56b9c3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1336 microversion: 2.57 time: 0.316261 Oct 10 23:21:14.286668 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 658/1329] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:13 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1336 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:14.466701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6b21894b-6f2d-46af-a4fa-45f572483119 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:14.467623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6b21894b-6f2d-46af-a4fa-45f572483119 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:14.490261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b21894b-6f2d-46af-a4fa-45f572483119 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:14.493437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b21894b-6f2d-46af-a4fa-45f572483119 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:14.494240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b21894b-6f2d-46af-a4fa-45f572483119 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:14.496589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b21894b-6f2d-46af-a4fa-45f572483119 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:14.497310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b21894b-6f2d-46af-a4fa-45f572483119 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:14.500881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b21894b-6f2d-46af-a4fa-45f572483119 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:14.680136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:14.753677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:15.051577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb104e11-cc98-48ff-8f37-9087945e8660 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:15.064806 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bb104e11-cc98-48ff-8f37-9087945e8660 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1542 microversion: 2.1 time: 1.023667 Oct 10 23:21:15.065812 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 672/1330] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:14 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1542 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:15.314646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-73371abd-5d92-4718-87f6-57a0c19038bf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:15.315574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-73371abd-5d92-4718-87f6-57a0c19038bf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:15.325090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73371abd-5d92-4718-87f6-57a0c19038bf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:15.329753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73371abd-5d92-4718-87f6-57a0c19038bf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:15.330561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73371abd-5d92-4718-87f6-57a0c19038bf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:15.331484 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73371abd-5d92-4718-87f6-57a0c19038bf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:15.333938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73371abd-5d92-4718-87f6-57a0c19038bf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:15.335177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73371abd-5d92-4718-87f6-57a0c19038bf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:15.478164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-73371abd-5d92-4718-87f6-57a0c19038bf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:15.490071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-73371abd-5d92-4718-87f6-57a0c19038bf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:15.491536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-73371abd-5d92-4718-87f6-57a0c19038bf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:15.492697 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-73371abd-5d92-4718-87f6-57a0c19038bf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1336 microversion: 2.57 time: 0.182467 Oct 10 23:21:15.509344 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 673/1331] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:15 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1336 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:15.640599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6b21894b-6f2d-46af-a4fa-45f572483119 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:15.652728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6b21894b-6f2d-46af-a4fa-45f572483119 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:15.665974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6b21894b-6f2d-46af-a4fa-45f572483119 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:15.674407 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6b21894b-6f2d-46af-a4fa-45f572483119 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1412 microversion: 2.25 time: 1.213789 Oct 10 23:21:15.690117 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 659/1332] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:14 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1412 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:21:16.095160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f725e673-1cca-405d-9d96-08f75f579079 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:16.096373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f725e673-1cca-405d-9d96-08f75f579079 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:16.099525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:16.115675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f725e673-1cca-405d-9d96-08f75f579079 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:16.122095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f725e673-1cca-405d-9d96-08f75f579079 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:16.123334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f725e673-1cca-405d-9d96-08f75f579079 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:16.125148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f725e673-1cca-405d-9d96-08f75f579079 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:16.125879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f725e673-1cca-405d-9d96-08f75f579079 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:16.126619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f725e673-1cca-405d-9d96-08f75f579079 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:16.545128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-661520c2-dd0d-49d3-9c40-38cff4449af2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:16.545868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-661520c2-dd0d-49d3-9c40-38cff4449af2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:16.580054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-661520c2-dd0d-49d3-9c40-38cff4449af2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:16.580666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-661520c2-dd0d-49d3-9c40-38cff4449af2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:16.581127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-661520c2-dd0d-49d3-9c40-38cff4449af2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:16.586331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-661520c2-dd0d-49d3-9c40-38cff4449af2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:16.586796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-661520c2-dd0d-49d3-9c40-38cff4449af2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:16.587238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-661520c2-dd0d-49d3-9c40-38cff4449af2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:16.599811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:16.938216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-661520c2-dd0d-49d3-9c40-38cff4449af2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:16.953881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-661520c2-dd0d-49d3-9c40-38cff4449af2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:16.955613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-661520c2-dd0d-49d3-9c40-38cff4449af2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:16.956857 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-661520c2-dd0d-49d3-9c40-38cff4449af2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1357 microversion: 2.57 time: 0.417067 Oct 10 23:21:16.957444 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 660/1333] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:16 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1357 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:16.977500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d027d363-4794-4e73-bcde-d9d048e3f175 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:16.978136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d027d363-4794-4e73-bcde-d9d048e3f175 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:16.997128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d027d363-4794-4e73-bcde-d9d048e3f175 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:16.997720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d027d363-4794-4e73-bcde-d9d048e3f175 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:17.002169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d027d363-4794-4e73-bcde-d9d048e3f175 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:17.003232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d027d363-4794-4e73-bcde-d9d048e3f175 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:17.009775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d027d363-4794-4e73-bcde-d9d048e3f175 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:17.010339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d027d363-4794-4e73-bcde-d9d048e3f175 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:17.106261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f725e673-1cca-405d-9d96-08f75f579079 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:17.116415 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f725e673-1cca-405d-9d96-08f75f579079 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1542 microversion: 2.1 time: 1.025551 Oct 10 23:21:17.120840 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 674/1334] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:16 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1542 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:17.126187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3b080d57-3d76-41e0-b251-4ab097f9a7d7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:17.144965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3b080d57-3d76-41e0-b251-4ab097f9a7d7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:17.167146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b080d57-3d76-41e0-b251-4ab097f9a7d7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:17.180562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b080d57-3d76-41e0-b251-4ab097f9a7d7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:17.188440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b080d57-3d76-41e0-b251-4ab097f9a7d7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:17.189612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b080d57-3d76-41e0-b251-4ab097f9a7d7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:17.190262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b080d57-3d76-41e0-b251-4ab097f9a7d7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:17.192634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b080d57-3d76-41e0-b251-4ab097f9a7d7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:17.404159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3b080d57-3d76-41e0-b251-4ab097f9a7d7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:21:17.404874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3b080d57-3d76-41e0-b251-4ab097f9a7d7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:21:17.405950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3b080d57-3d76-41e0-b251-4ab097f9a7d7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:21:17.406770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3b080d57-3d76-41e0-b251-4ab097f9a7d7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:21:17.407364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3b080d57-3d76-41e0-b251-4ab097f9a7d7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:21:17.548011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3b080d57-3d76-41e0-b251-4ab097f9a7d7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:17.564918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b080d57-3d76-41e0-b251-4ab097f9a7d7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:17.565522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b080d57-3d76-41e0-b251-4ab097f9a7d7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:17.565967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b080d57-3d76-41e0-b251-4ab097f9a7d7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:17.566686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b080d57-3d76-41e0-b251-4ab097f9a7d7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:17.567143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b080d57-3d76-41e0-b251-4ab097f9a7d7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:17.567569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b080d57-3d76-41e0-b251-4ab097f9a7d7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:17.642398 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3b080d57-3d76-41e0-b251-4ab097f9a7d7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "POST /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd/action" status: 202 len: 1138 microversion: 2.57 time: 0.520208 Oct 10 23:21:17.650489 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 675/1335] 10.222.0.23 () {62 vars in 1320 bytes} [Mon Oct 10 23:21:17 2022] POST /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd/action => generated 1138 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 10 23:21:18.073952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d99f64d7-6102-4b31-af13-1bcc10f19edd tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-836455536", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:18.251114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-d99f64d7-6102-4b31-af13-1bcc10f19edd tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] validate_networks() for None {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:21:18.552238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d027d363-4794-4e73-bcde-d9d048e3f175 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:18.568072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d027d363-4794-4e73-bcde-d9d048e3f175 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:18.576004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d027d363-4794-4e73-bcde-d9d048e3f175 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:18.582725 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d027d363-4794-4e73-bcde-d9d048e3f175 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1412 microversion: 2.25 time: 1.614866 Oct 10 23:21:18.598022 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 661/1336] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:16 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1412 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:18.611232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3a6d8ee0-5c2c-41cf-81a2-737b887db7f7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:18.611862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3a6d8ee0-5c2c-41cf-81a2-737b887db7f7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:18.626133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:18.632154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a6d8ee0-5c2c-41cf-81a2-737b887db7f7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:18.632906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a6d8ee0-5c2c-41cf-81a2-737b887db7f7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:18.633740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a6d8ee0-5c2c-41cf-81a2-737b887db7f7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:18.635245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a6d8ee0-5c2c-41cf-81a2-737b887db7f7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:18.639383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a6d8ee0-5c2c-41cf-81a2-737b887db7f7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:18.639882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a6d8ee0-5c2c-41cf-81a2-737b887db7f7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:18.936018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3a6d8ee0-5c2c-41cf-81a2-737b887db7f7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:18.964538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3a6d8ee0-5c2c-41cf-81a2-737b887db7f7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:18.969218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3a6d8ee0-5c2c-41cf-81a2-737b887db7f7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:18.971473 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3a6d8ee0-5c2c-41cf-81a2-737b887db7f7 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1366 microversion: 2.57 time: 0.371613 Oct 10 23:21:18.972206 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 662/1337] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:18 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1366 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:19.005693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2d53973e-1bdb-4a39-97ae-c33bbb8f5fc1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:19.006406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2d53973e-1bdb-4a39-97ae-c33bbb8f5fc1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:19.022187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d53973e-1bdb-4a39-97ae-c33bbb8f5fc1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:19.022725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d53973e-1bdb-4a39-97ae-c33bbb8f5fc1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:19.024986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d53973e-1bdb-4a39-97ae-c33bbb8f5fc1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:19.026310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d53973e-1bdb-4a39-97ae-c33bbb8f5fc1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:19.027086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d53973e-1bdb-4a39-97ae-c33bbb8f5fc1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:19.027812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d53973e-1bdb-4a39-97ae-c33bbb8f5fc1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:19.286737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-d99f64d7-6102-4b31-af13-1bcc10f19edd tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:21:19.287173 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-d99f64d7-6102-4b31-af13-1bcc10f19edd tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:21:19.287443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-d99f64d7-6102-4b31-af13-1bcc10f19edd tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:21:19.288020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-d99f64d7-6102-4b31-af13-1bcc10f19edd tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:21:19.288575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-d99f64d7-6102-4b31-af13-1bcc10f19edd tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:21:19.307571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d99f64d7-6102-4b31-af13-1bcc10f19edd tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:19.308167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d99f64d7-6102-4b31-af13-1bcc10f19edd tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:19.308686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d99f64d7-6102-4b31-af13-1bcc10f19edd tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:19.311222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d99f64d7-6102-4b31-af13-1bcc10f19edd tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:19.311799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d99f64d7-6102-4b31-af13-1bcc10f19edd tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:19.313499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d99f64d7-6102-4b31-af13-1bcc10f19edd tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:19.377141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-d99f64d7-6102-4b31-af13-1bcc10f19edd tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Getting quotas for project e84c3cf61abe4eb4901114ac1167f466. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:21:19.384705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-d99f64d7-6102-4b31-af13-1bcc10f19edd tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Getting quotas for user 40517612a20f448d8812e505e14f105e and project e84c3cf61abe4eb4901114ac1167f466. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:21:19.406228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d99f64d7-6102-4b31-af13-1bcc10f19edd tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:21:19.410398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d99f64d7-6102-4b31-af13-1bcc10f19edd tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 6656fd97-0371-4915-a530-5741f3d335bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:21:19.478431 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d99f64d7-6102-4b31-af13-1bcc10f19edd tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.824737 Oct 10 23:21:19.479847 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 676/1338] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:21:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:21:19.495124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f6585032-ff24-4389-9ccd-28eb8e0efd89 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:19.500430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f6585032-ff24-4389-9ccd-28eb8e0efd89 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 6656fd97-0371-4915-a530-5741f3d335bd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:19.594279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f6585032-ff24-4389-9ccd-28eb8e0efd89 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:19.607565 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f6585032-ff24-4389-9ccd-28eb8e0efd89 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd" status: 200 len: 1218 microversion: 2.1 time: 0.119110 Oct 10 23:21:19.608907 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 677/1339] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:19 2022] GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:21:19.629209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a58dac70-bd72-4cc1-81de-bd50b15c47c9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:19.630115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a58dac70-bd72-4cc1-81de-bd50b15c47c9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:19.646490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a58dac70-bd72-4cc1-81de-bd50b15c47c9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:19.647111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a58dac70-bd72-4cc1-81de-bd50b15c47c9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:19.648169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a58dac70-bd72-4cc1-81de-bd50b15c47c9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:19.651510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a58dac70-bd72-4cc1-81de-bd50b15c47c9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:19.651979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a58dac70-bd72-4cc1-81de-bd50b15c47c9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:19.652491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a58dac70-bd72-4cc1-81de-bd50b15c47c9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:19.745930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2d53973e-1bdb-4a39-97ae-c33bbb8f5fc1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:19.760484 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2d53973e-1bdb-4a39-97ae-c33bbb8f5fc1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1542 microversion: 2.1 time: 0.760717 Oct 10 23:21:19.761902 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 663/1340] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:18 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1542 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:19.889572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a58dac70-bd72-4cc1-81de-bd50b15c47c9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:19.924901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a58dac70-bd72-4cc1-81de-bd50b15c47c9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:19.929076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a58dac70-bd72-4cc1-81de-bd50b15c47c9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:19.930886 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a58dac70-bd72-4cc1-81de-bd50b15c47c9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1412 microversion: 2.25 time: 0.306260 Oct 10 23:21:19.931952 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 678/1341] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:19 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1412 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:20.001139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-56d9cf3d-fadc-46f8-a63a-5a55323ff1aa tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:20.002044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-56d9cf3d-fadc-46f8-a63a-5a55323ff1aa tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:20.011147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56d9cf3d-fadc-46f8-a63a-5a55323ff1aa tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:20.011710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56d9cf3d-fadc-46f8-a63a-5a55323ff1aa tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:20.012157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56d9cf3d-fadc-46f8-a63a-5a55323ff1aa tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:20.012880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56d9cf3d-fadc-46f8-a63a-5a55323ff1aa tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:20.013884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56d9cf3d-fadc-46f8-a63a-5a55323ff1aa tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:20.014320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56d9cf3d-fadc-46f8-a63a-5a55323ff1aa tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:20.123116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-56d9cf3d-fadc-46f8-a63a-5a55323ff1aa tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:20.137480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-56d9cf3d-fadc-46f8-a63a-5a55323ff1aa tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:20.143379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-56d9cf3d-fadc-46f8-a63a-5a55323ff1aa tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:20.147137 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-56d9cf3d-fadc-46f8-a63a-5a55323ff1aa tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1366 microversion: 2.57 time: 0.149527 Oct 10 23:21:20.149233 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 664/1342] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:19 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:20.632482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-41d71180-3833-4a08-9e25-f4c89b5a91ce tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:20.634024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-41d71180-3833-4a08-9e25-f4c89b5a91ce tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 6656fd97-0371-4915-a530-5741f3d335bd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:20.653048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41d71180-3833-4a08-9e25-f4c89b5a91ce tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:20.653992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41d71180-3833-4a08-9e25-f4c89b5a91ce tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:20.654651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41d71180-3833-4a08-9e25-f4c89b5a91ce tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:20.658193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41d71180-3833-4a08-9e25-f4c89b5a91ce tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:20.658748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41d71180-3833-4a08-9e25-f4c89b5a91ce tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:20.659395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41d71180-3833-4a08-9e25-f4c89b5a91ce tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:20.793304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-41d71180-3833-4a08-9e25-f4c89b5a91ce tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:20.796950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b7d9f5c6-80a6-48ed-a9a0-1acd177bec6c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:20.799181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b7d9f5c6-80a6-48ed-a9a0-1acd177bec6c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:20.805100 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-41d71180-3833-4a08-9e25-f4c89b5a91ce tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd" status: 200 len: 1270 microversion: 2.1 time: 0.177539 Oct 10 23:21:20.806453 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 679/1343] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:20 2022] GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd => generated 1270 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:20.829263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7d9f5c6-80a6-48ed-a9a0-1acd177bec6c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:20.829811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7d9f5c6-80a6-48ed-a9a0-1acd177bec6c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:20.834593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7d9f5c6-80a6-48ed-a9a0-1acd177bec6c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:20.836154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7d9f5c6-80a6-48ed-a9a0-1acd177bec6c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:20.838492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7d9f5c6-80a6-48ed-a9a0-1acd177bec6c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:20.840568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7d9f5c6-80a6-48ed-a9a0-1acd177bec6c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:20.960534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dde34e52-9c1c-4510-9d24-4006e2c0106f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:20.963069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dde34e52-9c1c-4510-9d24-4006e2c0106f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:20.970336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dde34e52-9c1c-4510-9d24-4006e2c0106f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:20.971220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dde34e52-9c1c-4510-9d24-4006e2c0106f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:20.971999 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dde34e52-9c1c-4510-9d24-4006e2c0106f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:20.972875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dde34e52-9c1c-4510-9d24-4006e2c0106f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:20.973520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dde34e52-9c1c-4510-9d24-4006e2c0106f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:20.974109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dde34e52-9c1c-4510-9d24-4006e2c0106f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:21.162529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dde34e52-9c1c-4510-9d24-4006e2c0106f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:21.176692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dde34e52-9c1c-4510-9d24-4006e2c0106f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:21.181222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dde34e52-9c1c-4510-9d24-4006e2c0106f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:21.183324 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dde34e52-9c1c-4510-9d24-4006e2c0106f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1412 microversion: 2.25 time: 0.229510 Oct 10 23:21:21.194351 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 680/1344] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:20 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1412 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:21.199747 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1127d342-216b-432c-a70c-9a0a2cbb3b43 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:21.200631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1127d342-216b-432c-a70c-9a0a2cbb3b43 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:21.215709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1127d342-216b-432c-a70c-9a0a2cbb3b43 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:21.224557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1127d342-216b-432c-a70c-9a0a2cbb3b43 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:21.225270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1127d342-216b-432c-a70c-9a0a2cbb3b43 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:21.227840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1127d342-216b-432c-a70c-9a0a2cbb3b43 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:21.229452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1127d342-216b-432c-a70c-9a0a2cbb3b43 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:21.237505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1127d342-216b-432c-a70c-9a0a2cbb3b43 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:21.397855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1127d342-216b-432c-a70c-9a0a2cbb3b43 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:21.411350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1127d342-216b-432c-a70c-9a0a2cbb3b43 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:21.426445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1127d342-216b-432c-a70c-9a0a2cbb3b43 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:21.428017 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1127d342-216b-432c-a70c-9a0a2cbb3b43 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1366 microversion: 2.57 time: 0.232275 Oct 10 23:21:21.428797 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 681/1345] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:21 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:21.471608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b7d9f5c6-80a6-48ed-a9a0-1acd177bec6c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:21.533013 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b7d9f5c6-80a6-48ed-a9a0-1acd177bec6c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1542 microversion: 2.1 time: 0.735070 Oct 10 23:21:21.539826 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 665/1346] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:20 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1542 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:21.839571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bac852a7-45fb-4d9a-94ec-c7198784faea tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:21.840927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bac852a7-45fb-4d9a-94ec-c7198784faea tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 6656fd97-0371-4915-a530-5741f3d335bd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:21.863349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bac852a7-45fb-4d9a-94ec-c7198784faea tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:21.866555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bac852a7-45fb-4d9a-94ec-c7198784faea tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:21.868518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bac852a7-45fb-4d9a-94ec-c7198784faea tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:21.870837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bac852a7-45fb-4d9a-94ec-c7198784faea tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:21.873733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bac852a7-45fb-4d9a-94ec-c7198784faea tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:21.874598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bac852a7-45fb-4d9a-94ec-c7198784faea tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:22.044541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a8680282-15bc-46c2-a75f-d2cb051b091e tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-775525290", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "f49ff5af-c923-4cd0-8170-ddd20d31ef8e"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:22.066242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bac852a7-45fb-4d9a-94ec-c7198784faea tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:22.084237 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bac852a7-45fb-4d9a-94ec-c7198784faea tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd" status: 200 len: 1276 microversion: 2.1 time: 0.253556 Oct 10 23:21:22.086448 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 682/1347] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:21 2022] GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd => generated 1276 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:22.123964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-a8680282-15bc-46c2-a75f-d2cb051b091e tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] validate_networks() for [('f49ff5af-c923-4cd0-8170-ddd20d31ef8e', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:21:22.213470 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-08aa8489-d47b-47cd-a268-f713b5f26153 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:22.214616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-08aa8489-d47b-47cd-a268-f713b5f26153 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:22.223638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08aa8489-d47b-47cd-a268-f713b5f26153 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:22.225002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08aa8489-d47b-47cd-a268-f713b5f26153 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:22.226415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08aa8489-d47b-47cd-a268-f713b5f26153 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:22.227508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08aa8489-d47b-47cd-a268-f713b5f26153 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:22.228606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08aa8489-d47b-47cd-a268-f713b5f26153 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:22.229259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08aa8489-d47b-47cd-a268-f713b5f26153 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:22.661341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-08aa8489-d47b-47cd-a268-f713b5f26153 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:22.673838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-08aa8489-d47b-47cd-a268-f713b5f26153 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:22.681842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-08aa8489-d47b-47cd-a268-f713b5f26153 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:22.683024 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-08aa8489-d47b-47cd-a268-f713b5f26153 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1412 microversion: 2.25 time: 0.474964 Oct 10 23:21:22.683599 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 683/1348] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:22 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1412 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:22.705470 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ad1b96f8-a1fa-487d-a007-78c34f3a07c5 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:22.709265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ad1b96f8-a1fa-487d-a007-78c34f3a07c5 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:22.723825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad1b96f8-a1fa-487d-a007-78c34f3a07c5 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:22.724376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad1b96f8-a1fa-487d-a007-78c34f3a07c5 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:22.731756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad1b96f8-a1fa-487d-a007-78c34f3a07c5 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:22.732709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad1b96f8-a1fa-487d-a007-78c34f3a07c5 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:22.733173 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad1b96f8-a1fa-487d-a007-78c34f3a07c5 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:22.733632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad1b96f8-a1fa-487d-a007-78c34f3a07c5 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:22.872998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ad1b96f8-a1fa-487d-a007-78c34f3a07c5 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:22.886587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ad1b96f8-a1fa-487d-a007-78c34f3a07c5 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:22.888824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ad1b96f8-a1fa-487d-a007-78c34f3a07c5 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:22.894572 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ad1b96f8-a1fa-487d-a007-78c34f3a07c5 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1366 microversion: 2.57 time: 0.209669 Oct 10 23:21:22.909573 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 684/1349] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:22 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:22.909573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7ac5cc12-1aa2-48bc-99b4-e03e5c2ad3f2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:22.909573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7ac5cc12-1aa2-48bc-99b4-e03e5c2ad3f2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:22.919125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ac5cc12-1aa2-48bc-99b4-e03e5c2ad3f2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:22.923041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ac5cc12-1aa2-48bc-99b4-e03e5c2ad3f2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:22.924900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ac5cc12-1aa2-48bc-99b4-e03e5c2ad3f2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:22.927329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ac5cc12-1aa2-48bc-99b4-e03e5c2ad3f2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:22.928048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ac5cc12-1aa2-48bc-99b4-e03e5c2ad3f2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:22.929990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ac5cc12-1aa2-48bc-99b4-e03e5c2ad3f2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:23.262828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7ac5cc12-1aa2-48bc-99b4-e03e5c2ad3f2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:23.271904 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7ac5cc12-1aa2-48bc-99b4-e03e5c2ad3f2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1542 microversion: 2.1 time: 0.375001 Oct 10 23:21:23.275883 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 685/1350] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:22 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1542 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:23.284237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-5b44be18-d618-44be-afdc-4762fd0e97bb req-62dcb4fe-a60c-4604-9fcf-81ac520f0bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58fcd7f0-d348-47b1-9b3d-f7514b940eb3", "name": "network-vif-plugged", "status": "completed", "tag": "4ddf9b37-7413-4cc7-829c-ce7603a65f55"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:23.327856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5b44be18-d618-44be-afdc-4762fd0e97bb req-62dcb4fe-a60c-4604-9fcf-81ac520f0bb8 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:23.330943 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5b44be18-d618-44be-afdc-4762fd0e97bb req-62dcb4fe-a60c-4604-9fcf-81ac520f0bb8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:23.331663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5b44be18-d618-44be-afdc-4762fd0e97bb req-62dcb4fe-a60c-4604-9fcf-81ac520f0bb8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:23.356327 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-5b44be18-d618-44be-afdc-4762fd0e97bb req-62dcb4fe-a60c-4604-9fcf-81ac520f0bb8 service nova] Creating event network-vif-plugged:4ddf9b37-7413-4cc7-829c-ce7603a65f55 for instance 58fcd7f0-d348-47b1-9b3d-f7514b940eb3 on n-h2-860864-2 Oct 10 23:21:23.370035 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-5b44be18-d618-44be-afdc-4762fd0e97bb req-62dcb4fe-a60c-4604-9fcf-81ac520f0bb8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090793 Oct 10 23:21:23.375359 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 686/1351] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:23.381152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a5e65d47-8cd0-4aa6-a518-1766fdb7dc04 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:23.386907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a5e65d47-8cd0-4aa6-a518-1766fdb7dc04 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 6656fd97-0371-4915-a530-5741f3d335bd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:23.400957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5e65d47-8cd0-4aa6-a518-1766fdb7dc04 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:23.404127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5e65d47-8cd0-4aa6-a518-1766fdb7dc04 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:23.412427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5e65d47-8cd0-4aa6-a518-1766fdb7dc04 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:23.413506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5e65d47-8cd0-4aa6-a518-1766fdb7dc04 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:23.414193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5e65d47-8cd0-4aa6-a518-1766fdb7dc04 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:23.415315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5e65d47-8cd0-4aa6-a518-1766fdb7dc04 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:23.478188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a8680282-15bc-46c2-a75f-d2cb051b091e tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:21:23.478785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a8680282-15bc-46c2-a75f-d2cb051b091e tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:21:23.479114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a8680282-15bc-46c2-a75f-d2cb051b091e tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:21:23.479533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a8680282-15bc-46c2-a75f-d2cb051b091e tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:21:23.479974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a8680282-15bc-46c2-a75f-d2cb051b091e tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:21:23.494685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8680282-15bc-46c2-a75f-d2cb051b091e tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:23.497326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8680282-15bc-46c2-a75f-d2cb051b091e tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:23.510130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8680282-15bc-46c2-a75f-d2cb051b091e tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:23.511487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8680282-15bc-46c2-a75f-d2cb051b091e tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:23.512131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8680282-15bc-46c2-a75f-d2cb051b091e tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:23.512735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8680282-15bc-46c2-a75f-d2cb051b091e tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:23.548495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-a8680282-15bc-46c2-a75f-d2cb051b091e tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Getting quotas for project 17a9f7ea82a145a4bc4cf562a82a0a90. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:21:23.560618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-a8680282-15bc-46c2-a75f-d2cb051b091e tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Getting quotas for user 6c0345d40e024645a2c7bf9d1ae09b36 and project 17a9f7ea82a145a4bc4cf562a82a0a90. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:21:23.597946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a8680282-15bc-46c2-a75f-d2cb051b091e tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Going to run 3 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:21:23.600726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a8680282-15bc-46c2-a75f-d2cb051b091e tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: a6ae5edf-fc2a-431a-9360-201b079daf30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:21:23.642404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a8680282-15bc-46c2-a75f-d2cb051b091e tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: 2391b441-47e3-4bf3-b134-3aa316543f10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=a6ae5edf-fc2a-431a-9360-201b079daf30,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:21:23.688470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a8680282-15bc-46c2-a75f-d2cb051b091e tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: d9d0be5f-c878-4a44-8433-56d0d850ea56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=2391b441-47e3-4bf3-b134-3aa316543f10,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:21:23.886633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a5e65d47-8cd0-4aa6-a518-1766fdb7dc04 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:23.895262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:23.901813 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a5e65d47-8cd0-4aa6-a518-1766fdb7dc04 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd" status: 200 len: 1318 microversion: 2.1 time: 0.523266 Oct 10 23:21:23.912532 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 687/1352] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:23 2022] GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd => generated 1318 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:23.930031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-01777607-f187-49ef-84a7-0073f71ce641 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:23.930922 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-01777607-f187-49ef-84a7-0073f71ce641 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:23.946933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01777607-f187-49ef-84a7-0073f71ce641 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:23.947695 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01777607-f187-49ef-84a7-0073f71ce641 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:23.948204 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a8680282-15bc-46c2-a75f-d2cb051b091e tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.110964 Oct 10 23:21:23.948482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01777607-f187-49ef-84a7-0073f71ce641 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:23.949354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01777607-f187-49ef-84a7-0073f71ce641 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:23.949981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01777607-f187-49ef-84a7-0073f71ce641 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:23.952036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01777607-f187-49ef-84a7-0073f71ce641 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:23.952363 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 666/1353] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:21:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:21:23.964357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1afde7d5-f0f8-46e5-812b-f456be1dc8a2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:23.970273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1afde7d5-f0f8-46e5-812b-f456be1dc8a2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:24.018074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1afde7d5-f0f8-46e5-812b-f456be1dc8a2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:24.018881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1afde7d5-f0f8-46e5-812b-f456be1dc8a2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:24.022669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1afde7d5-f0f8-46e5-812b-f456be1dc8a2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:24.025780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1afde7d5-f0f8-46e5-812b-f456be1dc8a2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:24.027432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1afde7d5-f0f8-46e5-812b-f456be1dc8a2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:24.028080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1afde7d5-f0f8-46e5-812b-f456be1dc8a2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:24.180875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1afde7d5-f0f8-46e5-812b-f456be1dc8a2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:24.196618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1afde7d5-f0f8-46e5-812b-f456be1dc8a2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:24.198556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1afde7d5-f0f8-46e5-812b-f456be1dc8a2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:24.203662 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1afde7d5-f0f8-46e5-812b-f456be1dc8a2 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1366 microversion: 2.57 time: 0.249851 Oct 10 23:21:24.213264 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 667/1354] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:23 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:24.245795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2f73e208-3da1-4da7-80d3-382368b17caa tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:24.271306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2f73e208-3da1-4da7-80d3-382368b17caa tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:24.272145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2f73e208-3da1-4da7-80d3-382368b17caa tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Searching by: {'deleted': False, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90'} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:21:24.320166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-01777607-f187-49ef-84a7-0073f71ce641 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:24.328960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f73e208-3da1-4da7-80d3-382368b17caa tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:24.329872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f73e208-3da1-4da7-80d3-382368b17caa tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:24.331354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f73e208-3da1-4da7-80d3-382368b17caa tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:24.335036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f73e208-3da1-4da7-80d3-382368b17caa tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:24.335162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-01777607-f187-49ef-84a7-0073f71ce641 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:24.336437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f73e208-3da1-4da7-80d3-382368b17caa tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:24.336578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-01777607-f187-49ef-84a7-0073f71ce641 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:24.340129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f73e208-3da1-4da7-80d3-382368b17caa tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:24.340613 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-01777607-f187-49ef-84a7-0073f71ce641 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1412 microversion: 2.25 time: 0.426505 Oct 10 23:21:24.341959 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 688/1355] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:23 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1412 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:24.371551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-61b66fcc-5d7a-4d02-977b-8508e41113da tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:24.372570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-61b66fcc-5d7a-4d02-977b-8508e41113da tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:24.387014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61b66fcc-5d7a-4d02-977b-8508e41113da tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:24.390081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61b66fcc-5d7a-4d02-977b-8508e41113da tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:24.390708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61b66fcc-5d7a-4d02-977b-8508e41113da tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:24.391809 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2f73e208-3da1-4da7-80d3-382368b17caa tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.160079 Oct 10 23:21:24.392743 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 668/1356] 10.222.0.23 () {58 vars in 1125 bytes} [Mon Oct 10 23:21:24 2022] GET /compute/v2.1/servers => generated 1015 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:24.393449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61b66fcc-5d7a-4d02-977b-8508e41113da tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:24.394708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61b66fcc-5d7a-4d02-977b-8508e41113da tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:24.396138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61b66fcc-5d7a-4d02-977b-8508e41113da tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:24.406609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c910aa1b-729b-4f58-a6cf-0d502d21b934 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:24.407486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c910aa1b-729b-4f58-a6cf-0d502d21b934 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: d9d0be5f-c878-4a44-8433-56d0d850ea56] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:24.723980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c910aa1b-729b-4f58-a6cf-0d502d21b934 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:24.746744 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c910aa1b-729b-4f58-a6cf-0d502d21b934 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56" status: 200 len: 1222 microversion: 2.1 time: 0.346002 Oct 10 23:21:24.748374 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 669/1357] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:24 2022] GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56 => generated 1222 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:24.898233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-61b66fcc-5d7a-4d02-977b-8508e41113da tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:24.908981 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-61b66fcc-5d7a-4d02-977b-8508e41113da tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1542 microversion: 2.1 time: 0.550970 Oct 10 23:21:24.913848 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 689/1358] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:24 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1542 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:24.939765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ca33d79b-9d5e-41bc-915c-c9fdae6fc06c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:24.940919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ca33d79b-9d5e-41bc-915c-c9fdae6fc06c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 6656fd97-0371-4915-a530-5741f3d335bd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:24.958569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ca33d79b-9d5e-41bc-915c-c9fdae6fc06c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:24.961681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ca33d79b-9d5e-41bc-915c-c9fdae6fc06c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:24.962341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ca33d79b-9d5e-41bc-915c-c9fdae6fc06c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:24.963259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ca33d79b-9d5e-41bc-915c-c9fdae6fc06c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:24.963888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ca33d79b-9d5e-41bc-915c-c9fdae6fc06c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:24.964491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ca33d79b-9d5e-41bc-915c-c9fdae6fc06c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:25.249635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8d2f1bc1-e636-4160-b850-3fb714c80c46 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:25.250564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8d2f1bc1-e636-4160-b850-3fb714c80c46 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:25.268233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d2f1bc1-e636-4160-b850-3fb714c80c46 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:25.272764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d2f1bc1-e636-4160-b850-3fb714c80c46 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:25.275733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d2f1bc1-e636-4160-b850-3fb714c80c46 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:25.278088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d2f1bc1-e636-4160-b850-3fb714c80c46 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:25.279846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d2f1bc1-e636-4160-b850-3fb714c80c46 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:25.280482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d2f1bc1-e636-4160-b850-3fb714c80c46 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:25.447819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ca33d79b-9d5e-41bc-915c-c9fdae6fc06c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:25.457700 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ca33d79b-9d5e-41bc-915c-c9fdae6fc06c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd" status: 200 len: 1318 microversion: 2.1 time: 0.526126 Oct 10 23:21:25.478849 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 670/1359] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:24 2022] GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd => generated 1318 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:25.490638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-08aa0173-7645-47d9-8de3-d873b7607168 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:25.491486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-08aa0173-7645-47d9-8de3-d873b7607168 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:25.506123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08aa0173-7645-47d9-8de3-d873b7607168 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:25.509734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08aa0173-7645-47d9-8de3-d873b7607168 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:25.510577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08aa0173-7645-47d9-8de3-d873b7607168 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:25.513342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08aa0173-7645-47d9-8de3-d873b7607168 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:25.514158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08aa0173-7645-47d9-8de3-d873b7607168 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:25.515247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08aa0173-7645-47d9-8de3-d873b7607168 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:25.596645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8d2f1bc1-e636-4160-b850-3fb714c80c46 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:25.612889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8d2f1bc1-e636-4160-b850-3fb714c80c46 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:25.625946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8d2f1bc1-e636-4160-b850-3fb714c80c46 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:25.628075 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8d2f1bc1-e636-4160-b850-3fb714c80c46 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1366 microversion: 2.57 time: 0.383716 Oct 10 23:21:25.632529 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 690/1360] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:25 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1366 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:21:25.774817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3d9a8ce8-49b5-40a0-b852-3cd8531d8aec tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:25.775992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3d9a8ce8-49b5-40a0-b852-3cd8531d8aec tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: d9d0be5f-c878-4a44-8433-56d0d850ea56] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:26.135180 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3d9a8ce8-49b5-40a0-b852-3cd8531d8aec tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:26.141692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-08aa0173-7645-47d9-8de3-d873b7607168 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:26.153181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=35 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:26.157316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-08aa0173-7645-47d9-8de3-d873b7607168 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:26.159155 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3d9a8ce8-49b5-40a0-b852-3cd8531d8aec tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56" status: 200 len: 1222 microversion: 2.1 time: 0.388248 Oct 10 23:21:26.170863 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 691/1361] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:25 2022] GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56 => generated 1222 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:26.173437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-be5b2da8-51a1-426c-ab60-10e959c7cb04 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:26.176187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-be5b2da8-51a1-426c-ab60-10e959c7cb04 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:26.183092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-08aa0173-7645-47d9-8de3-d873b7607168 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:26.188937 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-08aa0173-7645-47d9-8de3-d873b7607168 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1412 microversion: 2.25 time: 0.708838 Oct 10 23:21:26.205447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be5b2da8-51a1-426c-ab60-10e959c7cb04 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:26.206786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be5b2da8-51a1-426c-ab60-10e959c7cb04 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:26.207539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be5b2da8-51a1-426c-ab60-10e959c7cb04 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:26.211651 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 671/1362] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:25 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1412 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:26.211896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be5b2da8-51a1-426c-ab60-10e959c7cb04 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:26.212542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be5b2da8-51a1-426c-ab60-10e959c7cb04 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:26.214371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be5b2da8-51a1-426c-ab60-10e959c7cb04 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:26.451020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-be5b2da8-51a1-426c-ab60-10e959c7cb04 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:26.467469 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-be5b2da8-51a1-426c-ab60-10e959c7cb04 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1542 microversion: 2.1 time: 0.304914 Oct 10 23:21:26.481713 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 692/1363] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:26 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1542 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:26.498087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eed15f68-221d-487b-8d13-61fea3dd9d9f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:26.499112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eed15f68-221d-487b-8d13-61fea3dd9d9f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 6656fd97-0371-4915-a530-5741f3d335bd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:26.508594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-630c30a8-9931-4765-b41a-6ae84ec27e8d tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] Action: 'create', calling method: .version_select at 0x7f662baa73a0>, body: {"pool": null} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:26.511401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eed15f68-221d-487b-8d13-61fea3dd9d9f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:26.514732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eed15f68-221d-487b-8d13-61fea3dd9d9f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:26.516641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eed15f68-221d-487b-8d13-61fea3dd9d9f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:26.517880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eed15f68-221d-487b-8d13-61fea3dd9d9f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:26.519543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eed15f68-221d-487b-8d13-61fea3dd9d9f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:26.522051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eed15f68-221d-487b-8d13-61fea3dd9d9f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:26.776198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-eed15f68-221d-487b-8d13-61fea3dd9d9f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:26.790406 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eed15f68-221d-487b-8d13-61fea3dd9d9f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd" status: 200 len: 1318 microversion: 2.1 time: 0.306138 Oct 10 23:21:26.791529 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 693/1364] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:26 2022] GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:26.796768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a496d5a1-3476-42c2-80bf-e24ef14ade40 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:26.798524 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a496d5a1-3476-42c2-80bf-e24ef14ade40 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:26.806002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a496d5a1-3476-42c2-80bf-e24ef14ade40 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:26.806708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a496d5a1-3476-42c2-80bf-e24ef14ade40 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:26.808189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a496d5a1-3476-42c2-80bf-e24ef14ade40 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:26.811298 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a496d5a1-3476-42c2-80bf-e24ef14ade40 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:26.811953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a496d5a1-3476-42c2-80bf-e24ef14ade40 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:26.820414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a496d5a1-3476-42c2-80bf-e24ef14ade40 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:27.042883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a496d5a1-3476-42c2-80bf-e24ef14ade40 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:27.065593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a496d5a1-3476-42c2-80bf-e24ef14ade40 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:27.067913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a496d5a1-3476-42c2-80bf-e24ef14ade40 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:27.070795 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a496d5a1-3476-42c2-80bf-e24ef14ade40 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1366 microversion: 2.57 time: 0.277987 Oct 10 23:21:27.085874 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 694/1365] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:26 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:27.085874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-84aa19e4-49fc-46a3-9248-101dce2eccdd req-9d3ba0da-6629-4607-9e80-be1ab9f4e0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6656fd97-0371-4915-a530-5741f3d335bd", "tag": "1f4476d0-aee9-4380-baee-92028b057cb4"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:27.109834 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-84aa19e4-49fc-46a3-9248-101dce2eccdd req-9d3ba0da-6629-4607-9e80-be1ab9f4e0d1 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:27.110443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-84aa19e4-49fc-46a3-9248-101dce2eccdd req-9d3ba0da-6629-4607-9e80-be1ab9f4e0d1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:27.110884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-84aa19e4-49fc-46a3-9248-101dce2eccdd req-9d3ba0da-6629-4607-9e80-be1ab9f4e0d1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:27.129114 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-84aa19e4-49fc-46a3-9248-101dce2eccdd req-9d3ba0da-6629-4607-9e80-be1ab9f4e0d1 service nova] Creating event network-changed:1f4476d0-aee9-4380-baee-92028b057cb4 for instance 6656fd97-0371-4915-a530-5741f3d335bd on n-h1-860864-2 Oct 10 23:21:27.134886 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-84aa19e4-49fc-46a3-9248-101dce2eccdd req-9d3ba0da-6629-4607-9e80-be1ab9f4e0d1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061579 Oct 10 23:21:27.141201 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 695/1366] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:27.146673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3c174f04-55be-4a5f-9a47-5c359248c2f1 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:27.147378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3c174f04-55be-4a5f-9a47-5c359248c2f1 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:27.158353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c174f04-55be-4a5f-9a47-5c359248c2f1 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:27.159075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c174f04-55be-4a5f-9a47-5c359248c2f1 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:27.161291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c174f04-55be-4a5f-9a47-5c359248c2f1 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:27.166128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c174f04-55be-4a5f-9a47-5c359248c2f1 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:27.166896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c174f04-55be-4a5f-9a47-5c359248c2f1 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:27.167340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c174f04-55be-4a5f-9a47-5c359248c2f1 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:27.441414 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3c174f04-55be-4a5f-9a47-5c359248c2f1 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1858 microversion: 2.1 time: 0.298275 Oct 10 23:21:27.442843 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 696/1367] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:27 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1858 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:27.449164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c30408ff-b002-4ba5-aff8-8d79937c7dde tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:27.450336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c30408ff-b002-4ba5-aff8-8d79937c7dde tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: d9d0be5f-c878-4a44-8433-56d0d850ea56] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:27.458926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c30408ff-b002-4ba5-aff8-8d79937c7dde tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:27.459664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c30408ff-b002-4ba5-aff8-8d79937c7dde tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:27.460177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c30408ff-b002-4ba5-aff8-8d79937c7dde tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:27.460901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c30408ff-b002-4ba5-aff8-8d79937c7dde tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:27.461351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c30408ff-b002-4ba5-aff8-8d79937c7dde tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:27.461801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c30408ff-b002-4ba5-aff8-8d79937c7dde tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:27.543183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c30408ff-b002-4ba5-aff8-8d79937c7dde tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:27.551595 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c30408ff-b002-4ba5-aff8-8d79937c7dde tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56" status: 200 len: 1274 microversion: 2.1 time: 0.106563 Oct 10 23:21:27.552180 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 697/1368] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:27 2022] GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56 => generated 1274 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:27.557095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-565b361c-217f-4b7a-8c66-b2490f96344b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:27.557820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-565b361c-217f-4b7a-8c66-b2490f96344b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:27.563997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-565b361c-217f-4b7a-8c66-b2490f96344b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:27.564487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-565b361c-217f-4b7a-8c66-b2490f96344b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:27.564919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-565b361c-217f-4b7a-8c66-b2490f96344b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:27.565647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-565b361c-217f-4b7a-8c66-b2490f96344b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:27.566096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-565b361c-217f-4b7a-8c66-b2490f96344b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:27.566515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-565b361c-217f-4b7a-8c66-b2490f96344b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:27.723374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-565b361c-217f-4b7a-8c66-b2490f96344b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:27.732512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-565b361c-217f-4b7a-8c66-b2490f96344b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:27.734478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-565b361c-217f-4b7a-8c66-b2490f96344b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:27.736675 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-565b361c-217f-4b7a-8c66-b2490f96344b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1608 microversion: 2.25 time: 0.183327 Oct 10 23:21:27.756345 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 698/1369] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:27 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1608 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:27.767640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7ec1d044-c3b0-4db2-8040-22958b71292c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860864-2", "block_migration": true, "disk_over_commit": false}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:27.775976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7ec1d044-c3b0-4db2-8040-22958b71292c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:27.788895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ec1d044-c3b0-4db2-8040-22958b71292c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:27.791071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ec1d044-c3b0-4db2-8040-22958b71292c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:27.791585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ec1d044-c3b0-4db2-8040-22958b71292c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:27.792533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ec1d044-c3b0-4db2-8040-22958b71292c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:27.797007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ec1d044-c3b0-4db2-8040-22958b71292c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:27.797885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ec1d044-c3b0-4db2-8040-22958b71292c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:27.866216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-7ec1d044-c3b0-4db2-8040-22958b71292c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lazy-loading 'flavor' on Instance uuid 90cc20e4-bd05-44fc-931c-ddffba1494e6 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:21:27.884607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7ec1d044-c3b0-4db2-8040-22958b71292c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Going to try to live migrate instance to n-h1-860864-2 {{(pid=120614) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 23:21:29.366121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:31.447131 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7ec1d044-c3b0-4db2-8040-22958b71292c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/action" status: 202 len: 0 microversion: 2.1 time: 3.688277 Oct 10 23:21:31.447811 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 699/1370] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:21:27 2022] POST /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/action => generated 0 bytes in 3690 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:21:31.455677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3e33db3f-9fb9-42c3-a40c-076b27929524 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:31.457962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3e33db3f-9fb9-42c3-a40c-076b27929524 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:31.483579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e33db3f-9fb9-42c3-a40c-076b27929524 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:31.489361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e33db3f-9fb9-42c3-a40c-076b27929524 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:31.490414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e33db3f-9fb9-42c3-a40c-076b27929524 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:31.491371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e33db3f-9fb9-42c3-a40c-076b27929524 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:31.492035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e33db3f-9fb9-42c3-a40c-076b27929524 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:31.514021 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e33db3f-9fb9-42c3-a40c-076b27929524 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:31.888711 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-630c30a8-9931-4765-b41a-6ae84ec27e8d tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.474263 Oct 10 23:21:31.890172 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 672/1371] 10.222.0.23 () {60 vars in 1170 bytes} [Mon Oct 10 23:21:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:31.894957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dbf705ae-f384-4efe-8dd7-a52a1cca4c13 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:31.895464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dbf705ae-f384-4efe-8dd7-a52a1cca4c13 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:31.912681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbf705ae-f384-4efe-8dd7-a52a1cca4c13 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:31.915307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbf705ae-f384-4efe-8dd7-a52a1cca4c13 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:31.916581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbf705ae-f384-4efe-8dd7-a52a1cca4c13 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:31.918516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbf705ae-f384-4efe-8dd7-a52a1cca4c13 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:31.920451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbf705ae-f384-4efe-8dd7-a52a1cca4c13 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:31.921148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbf705ae-f384-4efe-8dd7-a52a1cca4c13 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:32.272001 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dbf705ae-f384-4efe-8dd7-a52a1cca4c13 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.380722 Oct 10 23:21:32.272942 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 673/1372] 10.222.0.23 () {60 vars in 1316 bytes} [Mon Oct 10 23:21:31 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-interface => generated 285 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:21:32.278433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b49f157f-2a9e-45a7-8df1-d11fa0dd297e tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:32.279788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b49f157f-2a9e-45a7-8df1-d11fa0dd297e tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 6656fd97-0371-4915-a530-5741f3d335bd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:32.289869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b49f157f-2a9e-45a7-8df1-d11fa0dd297e tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:32.290633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b49f157f-2a9e-45a7-8df1-d11fa0dd297e tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:32.291236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b49f157f-2a9e-45a7-8df1-d11fa0dd297e tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:32.292147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b49f157f-2a9e-45a7-8df1-d11fa0dd297e tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:32.292829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b49f157f-2a9e-45a7-8df1-d11fa0dd297e tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:32.293455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b49f157f-2a9e-45a7-8df1-d11fa0dd297e tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:32.705894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3e33db3f-9fb9-42c3-a40c-076b27929524 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:32.722522 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3e33db3f-9fb9-42c3-a40c-076b27929524 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1541 microversion: 2.1 time: 1.273615 Oct 10 23:21:32.728123 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 700/1373] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:31 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1541 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:32.746419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a363ac21-fe19-4ba2-b44d-c022cf76476f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:32.747069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a363ac21-fe19-4ba2-b44d-c022cf76476f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:32.749133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b49f157f-2a9e-45a7-8df1-d11fa0dd297e tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:32.757634 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b49f157f-2a9e-45a7-8df1-d11fa0dd297e tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd" status: 200 len: 1318 microversion: 2.1 time: 0.483379 Oct 10 23:21:32.763045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a363ac21-fe19-4ba2-b44d-c022cf76476f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:32.764161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a363ac21-fe19-4ba2-b44d-c022cf76476f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:32.764712 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 674/1374] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:32 2022] GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:32.764807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a363ac21-fe19-4ba2-b44d-c022cf76476f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:32.769716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a363ac21-fe19-4ba2-b44d-c022cf76476f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:32.772505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a363ac21-fe19-4ba2-b44d-c022cf76476f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:32.773169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a363ac21-fe19-4ba2-b44d-c022cf76476f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:32.782804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8bf7fcb4-9685-4286-bd67-18d65d0ae612 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:32.784621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8bf7fcb4-9685-4286-bd67-18d65d0ae612 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: d9d0be5f-c878-4a44-8433-56d0d850ea56] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:32.799186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8bf7fcb4-9685-4286-bd67-18d65d0ae612 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:32.799929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8bf7fcb4-9685-4286-bd67-18d65d0ae612 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:32.803100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8bf7fcb4-9685-4286-bd67-18d65d0ae612 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:32.806401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8bf7fcb4-9685-4286-bd67-18d65d0ae612 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:32.808368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8bf7fcb4-9685-4286-bd67-18d65d0ae612 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:32.809034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8bf7fcb4-9685-4286-bd67-18d65d0ae612 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:33.441834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8bf7fcb4-9685-4286-bd67-18d65d0ae612 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:33.463724 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8bf7fcb4-9685-4286-bd67-18d65d0ae612 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56" status: 200 len: 1322 microversion: 2.1 time: 0.691468 Oct 10 23:21:33.464404 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 675/1375] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:32 2022] GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56 => generated 1322 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:33.469699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1ac2d7cc-0e8f-4674-8136-53a1ac805286 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:33.474252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1ac2d7cc-0e8f-4674-8136-53a1ac805286 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:33.485937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ac2d7cc-0e8f-4674-8136-53a1ac805286 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:33.487603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ac2d7cc-0e8f-4674-8136-53a1ac805286 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:33.488449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ac2d7cc-0e8f-4674-8136-53a1ac805286 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:33.489414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ac2d7cc-0e8f-4674-8136-53a1ac805286 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:33.490126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ac2d7cc-0e8f-4674-8136-53a1ac805286 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:33.490782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ac2d7cc-0e8f-4674-8136-53a1ac805286 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:33.524756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a363ac21-fe19-4ba2-b44d-c022cf76476f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:33.545420 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a363ac21-fe19-4ba2-b44d-c022cf76476f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:33.554959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a363ac21-fe19-4ba2-b44d-c022cf76476f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:33.559156 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a363ac21-fe19-4ba2-b44d-c022cf76476f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1366 microversion: 2.57 time: 0.827660 Oct 10 23:21:33.563852 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 701/1376] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:32 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1366 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:33.568758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-eefe9e5e-df80-4174-a120-de3084c9ade4 req-dc4469e8-f2a1-4489-b49a-d10b20bd49a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c528ef78-5144-437a-83e3-38376725259a", "name": "network-vif-unplugged", "status": "completed", "tag": "caf7c02f-0516-49b4-a4e1-4d9d62869316"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:33.580309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-eefe9e5e-df80-4174-a120-de3084c9ade4 req-dc4469e8-f2a1-4489-b49a-d10b20bd49a2 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:33.581739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-eefe9e5e-df80-4174-a120-de3084c9ade4 req-dc4469e8-f2a1-4489-b49a-d10b20bd49a2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:33.582406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-eefe9e5e-df80-4174-a120-de3084c9ade4 req-dc4469e8-f2a1-4489-b49a-d10b20bd49a2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:33.597864 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-eefe9e5e-df80-4174-a120-de3084c9ade4 req-dc4469e8-f2a1-4489-b49a-d10b20bd49a2 service nova] Creating event network-vif-unplugged:caf7c02f-0516-49b4-a4e1-4d9d62869316 for instance c528ef78-5144-437a-83e3-38376725259a on n-h2-860864-2 Oct 10 23:21:33.606174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [req-eefe9e5e-df80-4174-a120-de3084c9ade4 req-dc4469e8-f2a1-4489-b49a-d10b20bd49a2 service nova] Instance c528ef78-5144-437a-83e3-38376725259a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 23:21:33.635354 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-eefe9e5e-df80-4174-a120-de3084c9ade4 req-dc4469e8-f2a1-4489-b49a-d10b20bd49a2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069416 Oct 10 23:21:33.637072 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 702/1377] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:33.662390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-29b38de2-7bc3-4042-a299-c1caaa8116a1 tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] Calling method '.version_select at 0x7f6633aca160>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:34.373284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:34.424660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1ac2d7cc-0e8f-4674-8136-53a1ac805286 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:34.441296 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1ac2d7cc-0e8f-4674-8136-53a1ac805286 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.975355 Oct 10 23:21:34.444121 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 676/1378] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:33 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:34.451374 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c1014549-9aa9-4e42-84c0-e6309157b500 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:34.452281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c1014549-9aa9-4e42-84c0-e6309157b500 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:34.459920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1014549-9aa9-4e42-84c0-e6309157b500 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:34.460615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1014549-9aa9-4e42-84c0-e6309157b500 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:34.461253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1014549-9aa9-4e42-84c0-e6309157b500 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:34.462208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1014549-9aa9-4e42-84c0-e6309157b500 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:34.463668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1014549-9aa9-4e42-84c0-e6309157b500 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:34.464358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1014549-9aa9-4e42-84c0-e6309157b500 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:34.738150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:34.755438 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-29b38de2-7bc3-4042-a299-c1caaa8116a1 tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/69feed91-e964-4ec8-ae96-339ea5798a97" status: 200 len: 142 microversion: 2.1 time: 1.116122 Oct 10 23:21:34.757133 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 703/1379] 10.222.0.23 () {58 vars in 1260 bytes} [Mon Oct 10 23:21:33 2022] GET /compute/v2.1/os-floating-ips/69feed91-e964-4ec8-ae96-339ea5798a97 => generated 142 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:34.769035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-58f11b57-2a99-4cb4-98b1-84a639c6acb1 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:34.771116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-58f11b57-2a99-4cb4-98b1-84a639c6acb1 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 6656fd97-0371-4915-a530-5741f3d335bd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:34.781274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58f11b57-2a99-4cb4-98b1-84a639c6acb1 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:34.782502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58f11b57-2a99-4cb4-98b1-84a639c6acb1 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:34.782830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58f11b57-2a99-4cb4-98b1-84a639c6acb1 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:34.783766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58f11b57-2a99-4cb4-98b1-84a639c6acb1 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:34.784439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58f11b57-2a99-4cb4-98b1-84a639c6acb1 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:34.785067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58f11b57-2a99-4cb4-98b1-84a639c6acb1 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:34.949061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c1014549-9aa9-4e42-84c0-e6309157b500 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:34.957963 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c1014549-9aa9-4e42-84c0-e6309157b500 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1541 microversion: 2.1 time: 0.511326 Oct 10 23:21:34.959000 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 677/1380] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:34 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1541 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:34.973091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d28f5927-607d-4a4f-b134-58d5a255713b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:34.974709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d28f5927-607d-4a4f-b134-58d5a255713b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: d9d0be5f-c878-4a44-8433-56d0d850ea56] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:34.984156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d28f5927-607d-4a4f-b134-58d5a255713b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:34.984916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d28f5927-607d-4a4f-b134-58d5a255713b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:34.985576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d28f5927-607d-4a4f-b134-58d5a255713b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:34.987915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d28f5927-607d-4a4f-b134-58d5a255713b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:34.988554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d28f5927-607d-4a4f-b134-58d5a255713b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:34.989152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d28f5927-607d-4a4f-b134-58d5a255713b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:35.345410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d28f5927-607d-4a4f-b134-58d5a255713b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:35.363991 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d28f5927-607d-4a4f-b134-58d5a255713b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56" status: 200 len: 1322 microversion: 2.1 time: 0.403309 Oct 10 23:21:35.364953 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 678/1381] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:34 2022] GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56 => generated 1322 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:35.382475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d4aa5ed9-f3ae-4dbc-9aaa-807ff73db181 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:35.383408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d4aa5ed9-f3ae-4dbc-9aaa-807ff73db181 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:35.393211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4aa5ed9-f3ae-4dbc-9aaa-807ff73db181 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:35.394086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4aa5ed9-f3ae-4dbc-9aaa-807ff73db181 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:35.394728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4aa5ed9-f3ae-4dbc-9aaa-807ff73db181 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:35.398423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4aa5ed9-f3ae-4dbc-9aaa-807ff73db181 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:35.398917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4aa5ed9-f3ae-4dbc-9aaa-807ff73db181 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:35.399397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4aa5ed9-f3ae-4dbc-9aaa-807ff73db181 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:35.406970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-58f11b57-2a99-4cb4-98b1-84a639c6acb1 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:35.432331 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-58f11b57-2a99-4cb4-98b1-84a639c6acb1 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd" status: 200 len: 1318 microversion: 2.1 time: 0.659642 Oct 10 23:21:35.433021 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 704/1382] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:34 2022] GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd => generated 1318 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:35.458883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-4f5ab3af-2c02-4d52-a5d5-db6a762e1a56 req-328b34b5-5d60-4f37-8013-793763e90e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6656fd97-0371-4915-a530-5741f3d335bd", "name": "network-vif-plugged", "status": "completed", "tag": "1f4476d0-aee9-4380-baee-92028b057cb4"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:35.481482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4f5ab3af-2c02-4d52-a5d5-db6a762e1a56 req-328b34b5-5d60-4f37-8013-793763e90e10 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:35.482374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4f5ab3af-2c02-4d52-a5d5-db6a762e1a56 req-328b34b5-5d60-4f37-8013-793763e90e10 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:35.482979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4f5ab3af-2c02-4d52-a5d5-db6a762e1a56 req-328b34b5-5d60-4f37-8013-793763e90e10 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:35.495770 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-4f5ab3af-2c02-4d52-a5d5-db6a762e1a56 req-328b34b5-5d60-4f37-8013-793763e90e10 service nova] Creating event network-vif-plugged:1f4476d0-aee9-4380-baee-92028b057cb4 for instance 6656fd97-0371-4915-a530-5741f3d335bd on n-h1-860864-2 Oct 10 23:21:35.510279 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-4f5ab3af-2c02-4d52-a5d5-db6a762e1a56 req-328b34b5-5d60-4f37-8013-793763e90e10 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062845 Oct 10 23:21:35.511431 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 705/1383] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:35.522528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cafe1e1c-326f-445b-b4aa-81496ae7e5c4 tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] Calling method '.version_select at 0x7f6633a878b0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:35.648406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d4aa5ed9-f3ae-4dbc-9aaa-807ff73db181 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:35.664377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d4aa5ed9-f3ae-4dbc-9aaa-807ff73db181 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:35.666801 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d4aa5ed9-f3ae-4dbc-9aaa-807ff73db181 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:35.668385 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d4aa5ed9-f3ae-4dbc-9aaa-807ff73db181 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1366 microversion: 2.57 time: 0.302366 Oct 10 23:21:35.670251 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 679/1384] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:35 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:35.676620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-99b0e97f-728c-4b3c-917a-456fd783ec5a req-99986c1f-a600-470d-a470-3439feda8c01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d0be5f-c878-4a44-8433-56d0d850ea56", "tag": "6a5e2c60-162c-4fd1-8808-219a533492b2"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:35.710716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-99b0e97f-728c-4b3c-917a-456fd783ec5a req-99986c1f-a600-470d-a470-3439feda8c01 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:35.711300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-99b0e97f-728c-4b3c-917a-456fd783ec5a req-99986c1f-a600-470d-a470-3439feda8c01 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:35.712990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-99b0e97f-728c-4b3c-917a-456fd783ec5a req-99986c1f-a600-470d-a470-3439feda8c01 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:35.735266 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-99b0e97f-728c-4b3c-917a-456fd783ec5a req-99986c1f-a600-470d-a470-3439feda8c01 service nova] Creating event network-changed:6a5e2c60-162c-4fd1-8808-219a533492b2 for instance d9d0be5f-c878-4a44-8433-56d0d850ea56 on n-h2-860864-2 Oct 10 23:21:35.740917 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-99b0e97f-728c-4b3c-917a-456fd783ec5a req-99986c1f-a600-470d-a470-3439feda8c01 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068704 Oct 10 23:21:35.742117 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 680/1385] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:35.748370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3dbf4bf7-8811-4359-82d4-fdf69eec8fc7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:35.749218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3dbf4bf7-8811-4359-82d4-fdf69eec8fc7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:35.758870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3dbf4bf7-8811-4359-82d4-fdf69eec8fc7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:35.759494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3dbf4bf7-8811-4359-82d4-fdf69eec8fc7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:35.760037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3dbf4bf7-8811-4359-82d4-fdf69eec8fc7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:35.760850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3dbf4bf7-8811-4359-82d4-fdf69eec8fc7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:35.761432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3dbf4bf7-8811-4359-82d4-fdf69eec8fc7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:35.761979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3dbf4bf7-8811-4359-82d4-fdf69eec8fc7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:35.790405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:36.058439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3dbf4bf7-8811-4359-82d4-fdf69eec8fc7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:36.070082 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3dbf4bf7-8811-4359-82d4-fdf69eec8fc7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.326473 Oct 10 23:21:36.071112 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 681/1386] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:35 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:36.098213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-44315e46-47b2-4f7c-a652-2d5d53765e15 req-48551436-6185-407d-a328-800c90558293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c528ef78-5144-437a-83e3-38376725259a", "tag": "caf7c02f-0516-49b4-a4e1-4d9d62869316"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:36.113027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-44315e46-47b2-4f7c-a652-2d5d53765e15 req-48551436-6185-407d-a328-800c90558293 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:36.113851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-44315e46-47b2-4f7c-a652-2d5d53765e15 req-48551436-6185-407d-a328-800c90558293 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:36.114505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-44315e46-47b2-4f7c-a652-2d5d53765e15 req-48551436-6185-407d-a328-800c90558293 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:36.145624 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-44315e46-47b2-4f7c-a652-2d5d53765e15 req-48551436-6185-407d-a328-800c90558293 service nova] Creating event network-changed:caf7c02f-0516-49b4-a4e1-4d9d62869316 for instance c528ef78-5144-437a-83e3-38376725259a on n-h2-860864-2 Oct 10 23:21:36.160895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-44315e46-47b2-4f7c-a652-2d5d53765e15 req-48551436-6185-407d-a328-800c90558293 service nova] Instance c528ef78-5144-437a-83e3-38376725259a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 23:21:36.185655 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-44315e46-47b2-4f7c-a652-2d5d53765e15 req-48551436-6185-407d-a328-800c90558293 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111827 Oct 10 23:21:36.187988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:36.188559 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 682/1387] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:36.194746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7a5607b1-5f87-4a04-a8dc-90111221655a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:36.195573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7a5607b1-5f87-4a04-a8dc-90111221655a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:36.203060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a5607b1-5f87-4a04-a8dc-90111221655a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:36.203803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a5607b1-5f87-4a04-a8dc-90111221655a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:36.204517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a5607b1-5f87-4a04-a8dc-90111221655a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:36.205491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a5607b1-5f87-4a04-a8dc-90111221655a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:36.206108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a5607b1-5f87-4a04-a8dc-90111221655a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:36.206692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a5607b1-5f87-4a04-a8dc-90111221655a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:36.358440 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cafe1e1c-326f-445b-b4aa-81496ae7e5c4 tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.844484 Oct 10 23:21:36.359077 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 706/1388] 10.222.0.23 () {58 vars in 1149 bytes} [Mon Oct 10 23:21:35 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:36.374572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c40753f3-9e2f-4abc-9d98-7c4bd9f2f283 tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] Calling method '.version_select at 0x7f6633a3f790>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:36.643835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7a5607b1-5f87-4a04-a8dc-90111221655a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:36.673780 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7a5607b1-5f87-4a04-a8dc-90111221655a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1473 microversion: 2.1 time: 0.481763 Oct 10 23:21:36.691856 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 683/1389] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:36 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1473 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:36.691856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1c8b3e66-928f-42b4-9176-65b5d6eeb9de tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:36.691856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1c8b3e66-928f-42b4-9176-65b5d6eeb9de tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: d9d0be5f-c878-4a44-8433-56d0d850ea56] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:36.707432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c8b3e66-928f-42b4-9176-65b5d6eeb9de tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:36.708742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c8b3e66-928f-42b4-9176-65b5d6eeb9de tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:36.710160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c8b3e66-928f-42b4-9176-65b5d6eeb9de tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:36.713481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c8b3e66-928f-42b4-9176-65b5d6eeb9de tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:36.729005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c8b3e66-928f-42b4-9176-65b5d6eeb9de tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:36.729829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c8b3e66-928f-42b4-9176-65b5d6eeb9de tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:37.249789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1c8b3e66-928f-42b4-9176-65b5d6eeb9de tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:37.262387 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1c8b3e66-928f-42b4-9176-65b5d6eeb9de tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56" status: 200 len: 1322 microversion: 2.1 time: 0.581797 Oct 10 23:21:37.263796 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 684/1390] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:36 2022] GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56 => generated 1322 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:37.268797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-64ba0155-8f49-4c8f-8ec2-f77391137f08 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:37.284174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-64ba0155-8f49-4c8f-8ec2-f77391137f08 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 6656fd97-0371-4915-a530-5741f3d335bd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:37.308928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64ba0155-8f49-4c8f-8ec2-f77391137f08 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:37.318710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64ba0155-8f49-4c8f-8ec2-f77391137f08 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:37.319336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64ba0155-8f49-4c8f-8ec2-f77391137f08 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:37.320107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64ba0155-8f49-4c8f-8ec2-f77391137f08 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:37.320586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64ba0155-8f49-4c8f-8ec2-f77391137f08 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:37.321022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64ba0155-8f49-4c8f-8ec2-f77391137f08 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:37.707736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-64ba0155-8f49-4c8f-8ec2-f77391137f08 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:37.718630 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-64ba0155-8f49-4c8f-8ec2-f77391137f08 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd" status: 200 len: 1318 microversion: 2.1 time: 0.453980 Oct 10 23:21:37.736247 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 685/1391] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:37 2022] GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd => generated 1318 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:37.751212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4fc12a29-459a-439c-89bf-db54905b5a81 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:37.751834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4fc12a29-459a-439c-89bf-db54905b5a81 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:37.780356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fc12a29-459a-439c-89bf-db54905b5a81 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:37.781793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fc12a29-459a-439c-89bf-db54905b5a81 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:37.783394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fc12a29-459a-439c-89bf-db54905b5a81 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:37.786586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fc12a29-459a-439c-89bf-db54905b5a81 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:37.787477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fc12a29-459a-439c-89bf-db54905b5a81 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:37.788078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fc12a29-459a-439c-89bf-db54905b5a81 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:38.071991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4fc12a29-459a-439c-89bf-db54905b5a81 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:38.088863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4fc12a29-459a-439c-89bf-db54905b5a81 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:38.096206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4fc12a29-459a-439c-89bf-db54905b5a81 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:38.100266 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4fc12a29-459a-439c-89bf-db54905b5a81 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1366 microversion: 2.57 time: 0.362867 Oct 10 23:21:38.113744 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 686/1392] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:37 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1366 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:38.121043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c7cdce02-6cc3-402d-b879-36e5634d8412 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:38.130226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c7cdce02-6cc3-402d-b879-36e5634d8412 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:38.156530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7cdce02-6cc3-402d-b879-36e5634d8412 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:38.159324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7cdce02-6cc3-402d-b879-36e5634d8412 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:38.160948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7cdce02-6cc3-402d-b879-36e5634d8412 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:38.165308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7cdce02-6cc3-402d-b879-36e5634d8412 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:38.166082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7cdce02-6cc3-402d-b879-36e5634d8412 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:38.166792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7cdce02-6cc3-402d-b879-36e5634d8412 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:38.937340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c7cdce02-6cc3-402d-b879-36e5634d8412 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:38.948300 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c7cdce02-6cc3-402d-b879-36e5634d8412 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.833029 Oct 10 23:21:38.956605 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 687/1393] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:38 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:39.099534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ea833ff7-55f3-4f80-949a-1abd8e5a2420 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Action: 'create', calling method: .version_select at 0x7f662b98f8b0>, body: {"keypair": {"name": "tempest-keypair-1322257476", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2PIvSkXmZvuSnKyaXWYikjvAR16PrEX6n+MlhD/7aO55AgE7ykhOws08LgV8h1sN3NVWjNmEwXJgRtAhQVmMzaEr7Vjv+IxfcrrUJvHwulQC0D4ef6jVftpFF2SzwxCg=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:39.145393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-ea833ff7-55f3-4f80-949a-1abd8e5a2420 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Getting quotas for project c79b53335e364bee8df72339b5800957. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:21:39.161482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-ea833ff7-55f3-4f80-949a-1abd8e5a2420 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Getting quotas for user a679599a8ab140b39217ae582e124c21 and project c79b53335e364bee8df72339b5800957. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:21:39.224649 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ea833ff7-55f3-4f80-949a-1abd8e5a2420 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.266721 Oct 10 23:21:39.228370 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 688/1394] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:21:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:39.242735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-243098a8-e6ba-49a0-b56b-e88fb8a81566 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:39.253694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-243098a8-e6ba-49a0-b56b-e88fb8a81566 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:39.269837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-243098a8-e6ba-49a0-b56b-e88fb8a81566 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:39.270856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-243098a8-e6ba-49a0-b56b-e88fb8a81566 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:39.272094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-243098a8-e6ba-49a0-b56b-e88fb8a81566 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:39.273746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-243098a8-e6ba-49a0-b56b-e88fb8a81566 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:39.274996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-243098a8-e6ba-49a0-b56b-e88fb8a81566 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:39.275673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-243098a8-e6ba-49a0-b56b-e88fb8a81566 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:39.633157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-243098a8-e6ba-49a0-b56b-e88fb8a81566 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:39.647028 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-243098a8-e6ba-49a0-b56b-e88fb8a81566 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1470 microversion: 2.1 time: 0.416037 Oct 10 23:21:39.649359 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 689/1395] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:39 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1470 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:39.655058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-8aa00a8e-b901-42f2-99a9-664837d83586 req-7a986932-11de-49da-b6d7-a6bb5f342702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6ae5edf-fc2a-431a-9360-201b079daf30", "tag": "91c911a0-bbc5-43b9-8298-54c5443d9b3e"}, {"name": "network-changed", "server_uuid": "58fcd7f0-d348-47b1-9b3d-f7514b940eb3", "tag": "4ddf9b37-7413-4cc7-829c-ce7603a65f55"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:39.691579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8aa00a8e-b901-42f2-99a9-664837d83586 req-7a986932-11de-49da-b6d7-a6bb5f342702 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:39.692070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8aa00a8e-b901-42f2-99a9-664837d83586 req-7a986932-11de-49da-b6d7-a6bb5f342702 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:39.692556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8aa00a8e-b901-42f2-99a9-664837d83586 req-7a986932-11de-49da-b6d7-a6bb5f342702 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:39.715736 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-8aa00a8e-b901-42f2-99a9-664837d83586 req-7a986932-11de-49da-b6d7-a6bb5f342702 service nova] Creating event network-changed:91c911a0-bbc5-43b9-8298-54c5443d9b3e for instance a6ae5edf-fc2a-431a-9360-201b079daf30 on n-h2-860864-2 Oct 10 23:21:39.719256 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-8aa00a8e-b901-42f2-99a9-664837d83586 req-7a986932-11de-49da-b6d7-a6bb5f342702 service nova] Creating event network-changed:4ddf9b37-7413-4cc7-829c-ce7603a65f55 for instance 58fcd7f0-d348-47b1-9b3d-f7514b940eb3 on n-h2-860864-2 Oct 10 23:21:39.739812 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-8aa00a8e-b901-42f2-99a9-664837d83586 req-7a986932-11de-49da-b6d7-a6bb5f342702 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.088755 Oct 10 23:21:39.740745 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 690/1396] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:39.746161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-780ba0d2-a90a-4862-8dbd-b4475beb9dcf tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:39.746861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-780ba0d2-a90a-4862-8dbd-b4475beb9dcf tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: d9d0be5f-c878-4a44-8433-56d0d850ea56] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:39.760298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-780ba0d2-a90a-4862-8dbd-b4475beb9dcf tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:39.760794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-780ba0d2-a90a-4862-8dbd-b4475beb9dcf tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:39.761235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-780ba0d2-a90a-4862-8dbd-b4475beb9dcf tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:39.761982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-780ba0d2-a90a-4862-8dbd-b4475beb9dcf tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:39.762440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-780ba0d2-a90a-4862-8dbd-b4475beb9dcf tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:39.762870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-780ba0d2-a90a-4862-8dbd-b4475beb9dcf tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:40.100952 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c40753f3-9e2f-4abc-9d98-7c4bd9f2f283 tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/69feed91-e964-4ec8-ae96-339ea5798a97" status: 202 len: 0 microversion: 2.1 time: 3.730568 Oct 10 23:21:40.109482 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 707/1397] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 10 23:21:36 2022] DELETE /compute/v2.1/os-floating-ips/69feed91-e964-4ec8-ae96-339ea5798a97 => generated 0 bytes in 3739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:21:40.120280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-406943ae-b527-4427-88b0-e6360db41fc4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:40.121466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-406943ae-b527-4427-88b0-e6360db41fc4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 6656fd97-0371-4915-a530-5741f3d335bd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:40.129292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-406943ae-b527-4427-88b0-e6360db41fc4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:40.130191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-406943ae-b527-4427-88b0-e6360db41fc4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:40.130882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-406943ae-b527-4427-88b0-e6360db41fc4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:40.131846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-406943ae-b527-4427-88b0-e6360db41fc4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:40.132549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-406943ae-b527-4427-88b0-e6360db41fc4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:40.133230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-406943ae-b527-4427-88b0-e6360db41fc4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:40.176337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:40.569231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-780ba0d2-a90a-4862-8dbd-b4475beb9dcf tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:40.600128 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-780ba0d2-a90a-4862-8dbd-b4475beb9dcf tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56" status: 200 len: 1322 microversion: 2.1 time: 0.857432 Oct 10 23:21:40.601922 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 691/1398] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:39 2022] GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56 => generated 1322 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:40.603597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-406943ae-b527-4427-88b0-e6360db41fc4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:40.616218 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-406943ae-b527-4427-88b0-e6360db41fc4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd" status: 200 len: 1467 microversion: 2.1 time: 0.505227 Oct 10 23:21:40.617651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-90bf9294-9a93-4518-9dd9-2e5f0bca173d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:40.618304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-90bf9294-9a93-4518-9dd9-2e5f0bca173d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:40.621899 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 708/1399] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:40 2022] GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd => generated 1467 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:40.630546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90bf9294-9a93-4518-9dd9-2e5f0bca173d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:40.637346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-17a66391-47da-4084-ac10-971d25c20a15 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:40.639508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90bf9294-9a93-4518-9dd9-2e5f0bca173d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:40.641646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-17a66391-47da-4084-ac10-971d25c20a15 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:40.645284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90bf9294-9a93-4518-9dd9-2e5f0bca173d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:40.647598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90bf9294-9a93-4518-9dd9-2e5f0bca173d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:40.648613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90bf9294-9a93-4518-9dd9-2e5f0bca173d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:40.649962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90bf9294-9a93-4518-9dd9-2e5f0bca173d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:40.655886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17a66391-47da-4084-ac10-971d25c20a15 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:40.656383 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17a66391-47da-4084-ac10-971d25c20a15 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:40.656820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17a66391-47da-4084-ac10-971d25c20a15 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:40.663633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17a66391-47da-4084-ac10-971d25c20a15 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:40.664316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17a66391-47da-4084-ac10-971d25c20a15 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:40.664771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17a66391-47da-4084-ac10-971d25c20a15 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:40.746917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-90bf9294-9a93-4518-9dd9-2e5f0bca173d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:40.752573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17a66391-47da-4084-ac10-971d25c20a15 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:40.753485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17a66391-47da-4084-ac10-971d25c20a15 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:40.754162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17a66391-47da-4084-ac10-971d25c20a15 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:40.756093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17a66391-47da-4084-ac10-971d25c20a15 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:40.756708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17a66391-47da-4084-ac10-971d25c20a15 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:40.757278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17a66391-47da-4084-ac10-971d25c20a15 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:40.776074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-90bf9294-9a93-4518-9dd9-2e5f0bca173d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:40.778216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-90bf9294-9a93-4518-9dd9-2e5f0bca173d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:40.784261 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-90bf9294-9a93-4518-9dd9-2e5f0bca173d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1366 microversion: 2.57 time: 0.180198 Oct 10 23:21:40.785404 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 692/1400] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:40 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:40.794978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-17a66391-47da-4084-ac10-971d25c20a15 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Getting quotas for project 8fad4e7ad7ba4e8284360ccf30d71228. Resources: {'cores', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:21:40.811507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-01301ab0-8ba2-453c-a5f6-0580d9952b25 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:40.814073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-01301ab0-8ba2-453c-a5f6-0580d9952b25 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:40.823067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-17a66391-47da-4084-ac10-971d25c20a15 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Getting quotas for user cbc0deea66094fac8d5f985e133ceaaa and project 8fad4e7ad7ba4e8284360ccf30d71228. Resources: {'cores', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:21:40.839715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01301ab0-8ba2-453c-a5f6-0580d9952b25 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:40.842424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01301ab0-8ba2-453c-a5f6-0580d9952b25 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:40.843307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01301ab0-8ba2-453c-a5f6-0580d9952b25 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:40.844467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01301ab0-8ba2-453c-a5f6-0580d9952b25 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:40.845171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01301ab0-8ba2-453c-a5f6-0580d9952b25 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:40.845928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01301ab0-8ba2-453c-a5f6-0580d9952b25 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:40.860584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:41.088891 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-17a66391-47da-4084-ac10-971d25c20a15 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "POST /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a/action" status: 202 len: 0 microversion: 2.1 time: 0.460420 Oct 10 23:21:41.094843 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 709/1401] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:21:40 2022] POST /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:21:41.111591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3052ab26-6cd0-47c8-890f-3a2a037fdc1a tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] Action: 'create', calling method: .version_select at 0x7f662b3efa60>, body: {"pool": null} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:41.462077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-01301ab0-8ba2-453c-a5f6-0580d9952b25 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:41.475286 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-01301ab0-8ba2-453c-a5f6-0580d9952b25 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.688484 Oct 10 23:21:41.493137 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 693/1402] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:40 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:41.499200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-5edf4962-2f79-45f8-893b-1beae29f6375 req-eb0c27b9-9b57-42c3-822e-800e08761b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c528ef78-5144-437a-83e3-38376725259a", "name": "network-vif-plugged", "status": "completed", "tag": "caf7c02f-0516-49b4-a4e1-4d9d62869316"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:41.509409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5edf4962-2f79-45f8-893b-1beae29f6375 req-eb0c27b9-9b57-42c3-822e-800e08761b1a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:41.510169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5edf4962-2f79-45f8-893b-1beae29f6375 req-eb0c27b9-9b57-42c3-822e-800e08761b1a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:41.510630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5edf4962-2f79-45f8-893b-1beae29f6375 req-eb0c27b9-9b57-42c3-822e-800e08761b1a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:41.527231 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-5edf4962-2f79-45f8-893b-1beae29f6375 req-eb0c27b9-9b57-42c3-822e-800e08761b1a service nova] Creating event network-vif-plugged:caf7c02f-0516-49b4-a4e1-4d9d62869316 for instance c528ef78-5144-437a-83e3-38376725259a on n-h2-860864-2 Oct 10 23:21:41.535056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-5edf4962-2f79-45f8-893b-1beae29f6375 req-eb0c27b9-9b57-42c3-822e-800e08761b1a service nova] Instance c528ef78-5144-437a-83e3-38376725259a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 23:21:41.548595 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-5edf4962-2f79-45f8-893b-1beae29f6375 req-eb0c27b9-9b57-42c3-822e-800e08761b1a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053430 Oct 10 23:21:41.549590 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 694/1403] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:41.714226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-16d0fbee-9f9e-4e58-81c3-f45a33180964 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1669788924", "block_migration": true, "disk_over_commit": false}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:41.717955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-16d0fbee-9f9e-4e58-81c3-f45a33180964 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] [instance: 6656fd97-0371-4915-a530-5741f3d335bd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:41.729294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16d0fbee-9f9e-4e58-81c3-f45a33180964 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:41.730420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16d0fbee-9f9e-4e58-81c3-f45a33180964 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:41.731258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16d0fbee-9f9e-4e58-81c3-f45a33180964 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:41.733230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16d0fbee-9f9e-4e58-81c3-f45a33180964 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:41.734541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16d0fbee-9f9e-4e58-81c3-f45a33180964 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:41.735413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16d0fbee-9f9e-4e58-81c3-f45a33180964 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:41.770922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-16d0fbee-9f9e-4e58-81c3-f45a33180964 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Lazy-loading 'flavor' on Instance uuid 6656fd97-0371-4915-a530-5741f3d335bd {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:21:41.785721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-16d0fbee-9f9e-4e58-81c3-f45a33180964 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] [instance: 6656fd97-0371-4915-a530-5741f3d335bd] Going to try to live migrate instance to tempest-host-1669788924 {{(pid=120613) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 23:21:41.793831 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-16d0fbee-9f9e-4e58-81c3-f45a33180964 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] HTTP exception thrown: Compute host tempest-host-1669788924 could not be found. Oct 10 23:21:41.798473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-16d0fbee-9f9e-4e58-81c3-f45a33180964 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Request method failure captured: Oct 10 23:21:41.798473 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd/action HTTP/1.1 Oct 10 23:21:41.798473 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:21:41.798473 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:21:41.798473 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:21:41.798473 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 107 Oct 10 23:21:41.798473 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:21:41.798473 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:21:41.798473 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:21:41.798473 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:41.798473 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKjteycwnqBZzwd87z4meA46xRiktNBU4GtpBFGpY5h-RLr_wTG8hJj3e01k0S44wSi_LA6j8DbEt8glx8uXHVhSaqgt9lnLqg84c9OdvA9fsuXhdEtPcfrp9e5AMnQXQzwoIFmbXc4rmNyrYPT28yLMHw-wDYmZrlwrfm7hTcLSqAA Oct 10 23:21:41.798473 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:21:41.798473 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:21:41.798473 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:21:41.798473 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:21:41.798473 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:21:41.798473 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:21:41.798473 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: ef39aff5221c4540827d4d5ac7c77a0a Oct 10 23:21:41.798473 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-LiveMigrationNegativeTest-1468430736 Oct 10 23:21:41.798473 n-d-860864-2 devstack@n-api.service[120613]: X-Role: admin,member,reader Oct 10 23:21:41.798473 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: admin,member,reader Oct 10 23:21:41.800278 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ef39aff5221c4540827d4d5ac7c77a0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef39aff5221c4540827d4d5ac7c77a0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef39aff5221c4540827d4d5ac7c77a0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ef39aff5221c4540827d4d5ac7c77a0a", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:41.800278 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-LiveMigrationNegativeTest-1468430736 Oct 10 23:21:41.800278 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: ef39aff5221c4540827d4d5ac7c77a0a Oct 10 23:21:41.800278 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1468430736 Oct 10 23:21:41.800278 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-LiveMigrationNegativeTest-1468430736-project-admin Oct 10 23:21:41.800278 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:21:41.800278 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:21:41.800278 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 43fbe867e70542c0b83b1ba51c885ba2 Oct 10 23:21:41.800278 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-LiveMigrationNegativeTest-1468430736-project-admin Oct 10 23:21:41.800278 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:21:41.800278 n-d-860864-2 devstack@n-api.service[120613]: {"os-migrateLive": {"host": "tempest-host-1669788924", "block_migration": true, "disk_over_commit": false}} Oct 10 23:21:41.800278 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:21:41.801367 n-d-860864-2 devstack@n-api.service[120613]: exception: Compute host tempest-host-1669788924 could not be found. Oct 10 23:21:41.801367 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '6656fd97-0371-4915-a530-5741f3d335bd', 'body': {'os-migrateLive': {'host': 'tempest-host-1669788924', 'block_migration': True, 'disk_over_commit': False}}} Oct 10 23:21:41.801367 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:41.801367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:41.801367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 10 23:21:41.801367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 10 23:21:41.801367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 10 23:21:41.801367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 23:21:41.801367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 10 23:21:41.801367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 23:21:41.801367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 10 23:21:41.801367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 23:21:41.801367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 10 23:21:41.801367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 23:21:41.801367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 10 23:21:41.801367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 23:21:41.801367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 10 23:21:41.801367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 23:21:41.801367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 23:21:41.803056 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 23:21:41.803056 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 10 23:21:41.803056 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 23:21:41.803056 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 10 23:21:41.803056 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 10 23:21:41.803056 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:21:41.803056 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:21:41.803056 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 10 23:21:41.803056 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 10 23:21:41.803056 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 10 23:21:41.803056 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:41.803056 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 10 23:21:41.803056 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 10 23:21:41.803056 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 10 23:21:41.803056 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 10 23:21:41.803056 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 10 23:21:41.803056 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 10 23:21:41.803056 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1669788924 could not be found. Oct 10 23:21:41.803056 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:41.804590 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:41.804590 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:41.804590 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:41.804590 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:41.804590 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:41.804590 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:41.804590 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:41.804590 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:41.804590 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:41.804590 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:21:41.804590 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:21:41.804590 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:21:41.804590 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:21:41.804590 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:21:41.804590 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:21:41.804590 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 10 23:21:41.804590 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 10 23:21:41.804590 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 10 23:21:41.804590 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1669788924 could not be found. Oct 10 23:21:41.804590 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:41.806710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:41.806710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:41.806710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:41.806710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:41.806710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:41.806710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:21:41.806710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:21:41.806710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1669788924 could not be found. Oct 10 23:21:41.806710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:41.810696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-16d0fbee-9f9e-4e58-81c3-f45a33180964 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Returning 400 to user: Compute host tempest-host-1669788924 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:41.811760 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-16d0fbee-9f9e-4e58-81c3-f45a33180964 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd/action" status: 400 len: 100 microversion: 2.1 time: 0.254262 Oct 10 23:21:41.813249 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 695/1404] 10.222.0.23 () {60 vars in 1279 bytes} [Mon Oct 10 23:21:41 2022] POST /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd/action => generated 100 bytes in 263 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:21:41.819607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f590ccaf-6700-43e0-a498-a92bbb00c1ac tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:41.820991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f590ccaf-6700-43e0-a498-a92bbb00c1ac tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:41.828662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:41.831497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f590ccaf-6700-43e0-a498-a92bbb00c1ac tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:41.832550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f590ccaf-6700-43e0-a498-a92bbb00c1ac tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:41.833198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f590ccaf-6700-43e0-a498-a92bbb00c1ac tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:41.834003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f590ccaf-6700-43e0-a498-a92bbb00c1ac tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:41.834606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f590ccaf-6700-43e0-a498-a92bbb00c1ac tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:41.834998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f590ccaf-6700-43e0-a498-a92bbb00c1ac tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:42.403657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f590ccaf-6700-43e0-a498-a92bbb00c1ac tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:42.418414 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f590ccaf-6700-43e0-a498-a92bbb00c1ac tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1469 microversion: 2.1 time: 0.598314 Oct 10 23:21:42.419918 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 696/1405] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:41 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1469 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:42.425039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d1bfdbef-c5f9-4c10-9f21-6af606616889 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:42.431424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d1bfdbef-c5f9-4c10-9f21-6af606616889 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: d9d0be5f-c878-4a44-8433-56d0d850ea56] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:42.451022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1bfdbef-c5f9-4c10-9f21-6af606616889 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:42.451819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1bfdbef-c5f9-4c10-9f21-6af606616889 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:42.452622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1bfdbef-c5f9-4c10-9f21-6af606616889 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:42.453680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1bfdbef-c5f9-4c10-9f21-6af606616889 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:42.455327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1bfdbef-c5f9-4c10-9f21-6af606616889 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:42.457234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1bfdbef-c5f9-4c10-9f21-6af606616889 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:42.787304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d1bfdbef-c5f9-4c10-9f21-6af606616889 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:42.798287 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d1bfdbef-c5f9-4c10-9f21-6af606616889 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56" status: 200 len: 1322 microversion: 2.1 time: 0.376979 Oct 10 23:21:42.798893 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 697/1406] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:42 2022] GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56 => generated 1322 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:42.814655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bdedb4b4-4f40-4ca2-98ad-54cacced575d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:42.815528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bdedb4b4-4f40-4ca2-98ad-54cacced575d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:42.834402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdedb4b4-4f40-4ca2-98ad-54cacced575d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:42.835240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdedb4b4-4f40-4ca2-98ad-54cacced575d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:42.835867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdedb4b4-4f40-4ca2-98ad-54cacced575d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:42.836785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdedb4b4-4f40-4ca2-98ad-54cacced575d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:42.837480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdedb4b4-4f40-4ca2-98ad-54cacced575d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:42.838091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdedb4b4-4f40-4ca2-98ad-54cacced575d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:43.055278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bdedb4b4-4f40-4ca2-98ad-54cacced575d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:43.074957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bdedb4b4-4f40-4ca2-98ad-54cacced575d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:43.076488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bdedb4b4-4f40-4ca2-98ad-54cacced575d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:43.077744 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bdedb4b4-4f40-4ca2-98ad-54cacced575d tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1366 microversion: 2.57 time: 0.268219 Oct 10 23:21:43.078656 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 698/1407] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:42 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:43.084526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-05999bb6-bb27-40ab-b0ea-e52f0603f054 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:43.085145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-05999bb6-bb27-40ab-b0ea-e52f0603f054 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 6656fd97-0371-4915-a530-5741f3d335bd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:43.102466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05999bb6-bb27-40ab-b0ea-e52f0603f054 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:43.103189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05999bb6-bb27-40ab-b0ea-e52f0603f054 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:43.103806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05999bb6-bb27-40ab-b0ea-e52f0603f054 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:43.104770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05999bb6-bb27-40ab-b0ea-e52f0603f054 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:43.105449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05999bb6-bb27-40ab-b0ea-e52f0603f054 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:43.110494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05999bb6-bb27-40ab-b0ea-e52f0603f054 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:43.335100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-05999bb6-bb27-40ab-b0ea-e52f0603f054 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:43.337514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:43.346090 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-05999bb6-bb27-40ab-b0ea-e52f0603f054 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd" status: 200 len: 1467 microversion: 2.1 time: 0.265834 Oct 10 23:21:43.347137 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 699/1408] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:43 2022] GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd => generated 1467 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:43.429623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-9abf02fa-2c35-436e-bcdf-e22196cdee20 req-6d592de3-049a-4e21-8bd7-99243c7837a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2391b441-47e3-4bf3-b134-3aa316543f10", "tag": "d6030a75-0ba4-487f-9252-aede9ef4854e"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:43.447792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9abf02fa-2c35-436e-bcdf-e22196cdee20 req-6d592de3-049a-4e21-8bd7-99243c7837a9 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:43.448604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9abf02fa-2c35-436e-bcdf-e22196cdee20 req-6d592de3-049a-4e21-8bd7-99243c7837a9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:43.449231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9abf02fa-2c35-436e-bcdf-e22196cdee20 req-6d592de3-049a-4e21-8bd7-99243c7837a9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:43.483708 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-9abf02fa-2c35-436e-bcdf-e22196cdee20 req-6d592de3-049a-4e21-8bd7-99243c7837a9 service nova] Creating event network-changed:d6030a75-0ba4-487f-9252-aede9ef4854e for instance 2391b441-47e3-4bf3-b134-3aa316543f10 on n-h1-860864-2 Oct 10 23:21:43.494818 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-9abf02fa-2c35-436e-bcdf-e22196cdee20 req-6d592de3-049a-4e21-8bd7-99243c7837a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146285 Oct 10 23:21:43.495537 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 700/1409] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:43.501767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0744aa72-942d-49c4-ac25-ed0c053e1294 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:43.502463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0744aa72-942d-49c4-ac25-ed0c053e1294 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:43.510932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0744aa72-942d-49c4-ac25-ed0c053e1294 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:43.511424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0744aa72-942d-49c4-ac25-ed0c053e1294 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:43.511860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0744aa72-942d-49c4-ac25-ed0c053e1294 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:43.512558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0744aa72-942d-49c4-ac25-ed0c053e1294 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:43.513060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0744aa72-942d-49c4-ac25-ed0c053e1294 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:43.513715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0744aa72-942d-49c4-ac25-ed0c053e1294 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:43.783661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0744aa72-942d-49c4-ac25-ed0c053e1294 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:43.794448 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0744aa72-942d-49c4-ac25-ed0c053e1294 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.297077 Oct 10 23:21:43.795391 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 701/1410] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:43 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:43.801805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b423670d-6c8e-433b-8583-a8e7e609d32c tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-791403549", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "5631ef21-325b-4fec-b503-2d6a2de46474"}], "security_groups": [{"name": "tempest-securitygroup--690309739"}], "key_name": "tempest-keypair-1322257476", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:43.973567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-b423670d-6c8e-433b-8583-a8e7e609d32c tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] validate_networks() for [('5631ef21-325b-4fec-b503-2d6a2de46474', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:21:44.409069 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3052ab26-6cd0-47c8-890f-3a2a037fdc1a tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.312593 Oct 10 23:21:44.410576 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 710/1411] 10.222.0.23 () {60 vars in 1170 bytes} [Mon Oct 10 23:21:41 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:44.417997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-05ff7a45-4d3a-4b9a-8850-4d837b497353 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:44.419273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-05ff7a45-4d3a-4b9a-8850-4d837b497353 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:44.429993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05ff7a45-4d3a-4b9a-8850-4d837b497353 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:44.431078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05ff7a45-4d3a-4b9a-8850-4d837b497353 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:44.431818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05ff7a45-4d3a-4b9a-8850-4d837b497353 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:44.433082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05ff7a45-4d3a-4b9a-8850-4d837b497353 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:44.434150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05ff7a45-4d3a-4b9a-8850-4d837b497353 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:44.436192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05ff7a45-4d3a-4b9a-8850-4d837b497353 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:44.469339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-b423670d-6c8e-433b-8583-a8e7e609d32c tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Getting quotas for project c79b53335e364bee8df72339b5800957. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:21:44.475348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-b423670d-6c8e-433b-8583-a8e7e609d32c tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Getting quotas for user a679599a8ab140b39217ae582e124c21 and project c79b53335e364bee8df72339b5800957. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:21:44.489270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-b423670d-6c8e-433b-8583-a8e7e609d32c tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:21:44.489722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-b423670d-6c8e-433b-8583-a8e7e609d32c tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:21:44.490377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-b423670d-6c8e-433b-8583-a8e7e609d32c tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:21:44.490971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-b423670d-6c8e-433b-8583-a8e7e609d32c tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:21:44.491680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-b423670d-6c8e-433b-8583-a8e7e609d32c tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:21:44.501108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b423670d-6c8e-433b-8583-a8e7e609d32c tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:44.501745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b423670d-6c8e-433b-8583-a8e7e609d32c tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:44.502508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b423670d-6c8e-433b-8583-a8e7e609d32c tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:44.503428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b423670d-6c8e-433b-8583-a8e7e609d32c tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:44.503890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b423670d-6c8e-433b-8583-a8e7e609d32c tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:44.504313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b423670d-6c8e-433b-8583-a8e7e609d32c tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:44.522254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-b423670d-6c8e-433b-8583-a8e7e609d32c tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Getting quotas for project c79b53335e364bee8df72339b5800957. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:21:44.528454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-b423670d-6c8e-433b-8583-a8e7e609d32c tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Getting quotas for user a679599a8ab140b39217ae582e124c21 and project c79b53335e364bee8df72339b5800957. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:21:44.543517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b423670d-6c8e-433b-8583-a8e7e609d32c tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:21:44.546361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b423670d-6c8e-433b-8583-a8e7e609d32c tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:21:44.598113 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b423670d-6c8e-433b-8583-a8e7e609d32c tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.801423 Oct 10 23:21:44.604907 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 702/1412] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:21:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:21:44.604907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-805f82af-ce63-484e-bd96-ac7dd10ce205 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1718604154", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:44.667056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-805f82af-ce63-484e-bd96-ac7dd10ce205 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] validate_networks() for None {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:21:44.686980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-05ff7a45-4d3a-4b9a-8850-4d837b497353 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:44.697502 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-05ff7a45-4d3a-4b9a-8850-4d837b497353 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1469 microversion: 2.1 time: 0.284312 Oct 10 23:21:44.706144 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 711/1413] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:44 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1469 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:44.706144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-91bc2434-8d43-4fbd-ab9f-8f01d959604f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:44.706144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-91bc2434-8d43-4fbd-ab9f-8f01d959604f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: d9d0be5f-c878-4a44-8433-56d0d850ea56] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:44.712562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91bc2434-8d43-4fbd-ab9f-8f01d959604f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:44.717316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91bc2434-8d43-4fbd-ab9f-8f01d959604f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:44.718189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91bc2434-8d43-4fbd-ab9f-8f01d959604f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:44.719144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91bc2434-8d43-4fbd-ab9f-8f01d959604f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:44.719773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91bc2434-8d43-4fbd-ab9f-8f01d959604f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:44.720545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91bc2434-8d43-4fbd-ab9f-8f01d959604f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:44.887474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-91bc2434-8d43-4fbd-ab9f-8f01d959604f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:44.898982 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-91bc2434-8d43-4fbd-ab9f-8f01d959604f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56" status: 200 len: 1322 microversion: 2.1 time: 0.199579 Oct 10 23:21:44.900358 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 712/1414] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:44 2022] GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:44.915051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d9d346dd-b65b-4f80-8ac4-4da2163a5cda tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:44.917652 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d9d346dd-b65b-4f80-8ac4-4da2163a5cda tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:44.925758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d346dd-b65b-4f80-8ac4-4da2163a5cda tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:44.926475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d346dd-b65b-4f80-8ac4-4da2163a5cda tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:44.927252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d346dd-b65b-4f80-8ac4-4da2163a5cda tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:44.928116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d346dd-b65b-4f80-8ac4-4da2163a5cda tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:44.928725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d346dd-b65b-4f80-8ac4-4da2163a5cda tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:44.929304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d346dd-b65b-4f80-8ac4-4da2163a5cda tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:44.995664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-805f82af-ce63-484e-bd96-ac7dd10ce205 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:21:44.997322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-805f82af-ce63-484e-bd96-ac7dd10ce205 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:21:44.999304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-805f82af-ce63-484e-bd96-ac7dd10ce205 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:21:44.999962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-805f82af-ce63-484e-bd96-ac7dd10ce205 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:21:45.000593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-805f82af-ce63-484e-bd96-ac7dd10ce205 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:21:45.010819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d9d346dd-b65b-4f80-8ac4-4da2163a5cda tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:45.012184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-805f82af-ce63-484e-bd96-ac7dd10ce205 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:45.013020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-805f82af-ce63-484e-bd96-ac7dd10ce205 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:45.013876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-805f82af-ce63-484e-bd96-ac7dd10ce205 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:45.014865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-805f82af-ce63-484e-bd96-ac7dd10ce205 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:45.015535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-805f82af-ce63-484e-bd96-ac7dd10ce205 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:45.016184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-805f82af-ce63-484e-bd96-ac7dd10ce205 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:45.020185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d9d346dd-b65b-4f80-8ac4-4da2163a5cda tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:45.021554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d9d346dd-b65b-4f80-8ac4-4da2163a5cda tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:45.023565 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d9d346dd-b65b-4f80-8ac4-4da2163a5cda tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1366 microversion: 2.57 time: 0.121919 Oct 10 23:21:45.024797 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 713/1415] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:44 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1366 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:45.031794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-02efb7b7-13cb-4df0-82f2-ff71c7d7901f tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] Calling method '.version_select at 0x7f6633a039d0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:45.054977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-805f82af-ce63-484e-bd96-ac7dd10ce205 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Getting quotas for project e84c3cf61abe4eb4901114ac1167f466. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:21:45.061193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-805f82af-ce63-484e-bd96-ac7dd10ce205 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Getting quotas for user 40517612a20f448d8812e505e14f105e and project e84c3cf61abe4eb4901114ac1167f466. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:21:45.074899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-805f82af-ce63-484e-bd96-ac7dd10ce205 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:21:45.077781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-805f82af-ce63-484e-bd96-ac7dd10ce205 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:21:45.128829 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-805f82af-ce63-484e-bd96-ac7dd10ce205 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528537 Oct 10 23:21:45.135908 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 703/1416] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:21:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:21:45.141826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-975043d4-0d9f-4755-a940-31619e040c3e req-62edc709-b6f2-4f2b-bda5-2ce6de973d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d0be5f-c878-4a44-8433-56d0d850ea56", "name": "network-vif-plugged", "status": "completed", "tag": "6a5e2c60-162c-4fd1-8808-219a533492b2"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:45.152590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-975043d4-0d9f-4755-a940-31619e040c3e req-62edc709-b6f2-4f2b-bda5-2ce6de973d04 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:45.153357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-975043d4-0d9f-4755-a940-31619e040c3e req-62edc709-b6f2-4f2b-bda5-2ce6de973d04 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:45.153875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-975043d4-0d9f-4755-a940-31619e040c3e req-62edc709-b6f2-4f2b-bda5-2ce6de973d04 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:45.165588 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-975043d4-0d9f-4755-a940-31619e040c3e req-62edc709-b6f2-4f2b-bda5-2ce6de973d04 service nova] Creating event network-vif-plugged:6a5e2c60-162c-4fd1-8808-219a533492b2 for instance d9d0be5f-c878-4a44-8433-56d0d850ea56 on n-h2-860864-2 Oct 10 23:21:45.170811 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-975043d4-0d9f-4755-a940-31619e040c3e req-62edc709-b6f2-4f2b-bda5-2ce6de973d04 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033696 Oct 10 23:21:45.171437 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 704/1417] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:45.176749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b51c16b6-a156-44c4-a477-700e4d0f57b8 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:45.177347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b51c16b6-a156-44c4-a477-700e4d0f57b8 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:45.245017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b51c16b6-a156-44c4-a477-700e4d0f57b8 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:45.252998 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b51c16b6-a156-44c4-a477-700e4d0f57b8 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d" status: 200 len: 1269 microversion: 2.1 time: 0.080316 Oct 10 23:21:45.256618 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 705/1418] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:45 2022] GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d => generated 1269 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:45.275606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b1845108-9377-4a80-9daf-dea860098e94 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:45.276436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b1845108-9377-4a80-9daf-dea860098e94 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:45.284169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1845108-9377-4a80-9daf-dea860098e94 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:45.284985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1845108-9377-4a80-9daf-dea860098e94 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:45.285651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1845108-9377-4a80-9daf-dea860098e94 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:45.286558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1845108-9377-4a80-9daf-dea860098e94 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:45.287208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1845108-9377-4a80-9daf-dea860098e94 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:45.287825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1845108-9377-4a80-9daf-dea860098e94 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:45.476270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b1845108-9377-4a80-9daf-dea860098e94 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:45.488786 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b1845108-9377-4a80-9daf-dea860098e94 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.224429 Oct 10 23:21:45.489585 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 706/1419] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:45 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:45.494864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ee648576-f48d-45bd-962a-b154b02aeba8 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:45.495491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ee648576-f48d-45bd-962a-b154b02aeba8 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:45.576597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ee648576-f48d-45bd-962a-b154b02aeba8 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:45.590621 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ee648576-f48d-45bd-962a-b154b02aeba8 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1219 microversion: 2.1 time: 0.099880 Oct 10 23:21:45.593776 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 707/1420] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:45 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:45.724791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-28703a2f-85d0-488e-83ba-e1398a66149f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:45.725476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-28703a2f-85d0-488e-83ba-e1398a66149f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:45.741620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28703a2f-85d0-488e-83ba-e1398a66149f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:45.742387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28703a2f-85d0-488e-83ba-e1398a66149f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:45.743053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28703a2f-85d0-488e-83ba-e1398a66149f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:45.744024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28703a2f-85d0-488e-83ba-e1398a66149f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:45.744698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28703a2f-85d0-488e-83ba-e1398a66149f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:45.746013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28703a2f-85d0-488e-83ba-e1398a66149f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:45.960123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-28703a2f-85d0-488e-83ba-e1398a66149f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:45.970603 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-28703a2f-85d0-488e-83ba-e1398a66149f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1469 microversion: 2.1 time: 0.253076 Oct 10 23:21:45.985432 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-02efb7b7-13cb-4df0-82f2-ff71c7d7901f tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3" status: 202 len: 0 microversion: 2.1 time: 0.945219 Oct 10 23:21:45.985432 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 714/1421] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 10 23:21:45 2022] DELETE /compute/v2.1/os-floating-ips/7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3 => generated 0 bytes in 947 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:21:45.985432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8075cc08-4a0d-44f1-ad97-4545bb8304cf tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:45.985432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8075cc08-4a0d-44f1-ad97-4545bb8304cf tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: d9d0be5f-c878-4a44-8433-56d0d850ea56] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:45.987377 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 708/1422] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:45 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1469 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:21:45.989248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8075cc08-4a0d-44f1-ad97-4545bb8304cf tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:45.989718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8075cc08-4a0d-44f1-ad97-4545bb8304cf tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:45.990390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8075cc08-4a0d-44f1-ad97-4545bb8304cf tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:45.991334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8075cc08-4a0d-44f1-ad97-4545bb8304cf tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:45.992111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8075cc08-4a0d-44f1-ad97-4545bb8304cf tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:45.992541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8075cc08-4a0d-44f1-ad97-4545bb8304cf tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:45.995322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-723dd924-dd2a-48d3-ba3d-33afdbe2252e tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] Calling method '.version_select at 0x7f662b5c7b80>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:46.040460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG neutronclient.v2_0.client [None req-723dd924-dd2a-48d3-ba3d-33afdbe2252e tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3 could not be found", "detail": ""}} {{(pid=120613) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:21:46.041356 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-723dd924-dd2a-48d3-ba3d-33afdbe2252e tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] HTTP exception thrown: Floating IP not found for ID 7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3 Oct 10 23:21:46.047994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-723dd924-dd2a-48d3-ba3d-33afdbe2252e tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] Request method failure captured: Oct 10 23:21:46.047994 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-floating-ips/7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3 HTTP/1.1 Oct 10 23:21:46.047994 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:21:46.047994 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:21:46.047994 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:21:46.047994 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:21:46.047994 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:21:46.047994 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:21:46.047994 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:21:46.047994 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:46.047994 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKj2zyw8lbRAhPkDnWmx-9QiZ1adNKZz6rPDnjM16WnakPqlsJFC2RpB0Si26HFEGanya_SmP65YZgGdW1II8lgqFixX4GbrXgM1gBxgjKKpR-jQ332HsrnR9S7S_x_CDJMGOGxW9vfDxlH2SiDe-De8C9wWprzzX4No4nHGlD-Q33E Oct 10 23:21:46.047994 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:21:46.047994 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:21:46.047994 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:21:46.047994 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:21:46.047994 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:21:46.047994 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:21:46.047994 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 6e73a41f5ede43599dfd6cb40078bfb1 Oct 10 23:21:46.047994 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-FloatingIPsTestJSON-763317695 Oct 10 23:21:46.047994 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:21:46.047994 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:21:46.050014 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6e73a41f5ede43599dfd6cb40078bfb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6e73a41f5ede43599dfd6cb40078bfb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6e73a41f5ede43599dfd6cb40078bfb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6e73a41f5ede43599dfd6cb40078bfb1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:46.050014 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-FloatingIPsTestJSON-763317695 Oct 10 23:21:46.050014 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 6e73a41f5ede43599dfd6cb40078bfb1 Oct 10 23:21:46.050014 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-FloatingIPsTestJSON-763317695 Oct 10 23:21:46.050014 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-FloatingIPsTestJSON-763317695-project Oct 10 23:21:46.050014 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:21:46.050014 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:21:46.050014 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: e3e71b5ac469496e878ea37d5b82a983 Oct 10 23:21:46.050014 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-FloatingIPsTestJSON-763317695-project Oct 10 23:21:46.050014 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:21:46.050014 n-d-860864-2 devstack@n-api.service[120613]: exception: Floating IP not found for ID 7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3 Oct 10 23:21:46.050014 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3'} Oct 10 23:21:46.050014 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:46.051064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:46.051064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 10 23:21:46.051064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 10 23:21:46.051064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:46.051064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:46.051064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 10 23:21:46.051064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 10 23:21:46.051064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:46.051064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:46.051064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 23:21:46.051064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 23:21:46.051064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:46.051064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:46.051064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:21:46.051064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:21:46.051064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:46.051064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:46.051064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:21:46.051064 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:21:46.054435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:46.054435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:46.054435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:21:46.054435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:21:46.054435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:21:46.054435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:21:46.054435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3 could not be found Oct 10 23:21:46.054435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-02642a5b-ec48-404c-b726-c34817e5f53c'] Oct 10 23:21:46.054435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:46.054435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:46.054435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:46.054435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:46.054435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 10 23:21:46.054435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 10 23:21:46.054435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 10 23:21:46.054435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 10 23:21:46.054435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3. Oct 10 23:21:46.054435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:46.054435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:46.054435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:46.056025 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:46.056025 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:46.056025 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:46.056025 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:46.056025 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:46.056025 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:21:46.056025 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:21:46.056025 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:46.056025 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:46.056025 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 10 23:21:46.056025 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 23:21:46.056025 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3 Oct 10 23:21:46.056025 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:46.056025 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:46.056025 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:46.056025 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:46.056025 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:46.056025 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:46.056025 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:21:46.056025 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:21:46.057823 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3 Oct 10 23:21:46.057823 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:21:46.057823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-723dd924-dd2a-48d3-ba3d-33afdbe2252e tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] Returning 404 to user: Floating IP not found for ID 7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3 {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:46.057823 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-723dd924-dd2a-48d3-ba3d-33afdbe2252e tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3" status: 404 len: 111 microversion: 2.1 time: 0.058215 Oct 10 23:21:46.057823 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 709/1423] 10.222.0.23 () {58 vars in 1260 bytes} [Mon Oct 10 23:21:45 2022] GET /compute/v2.1/os-floating-ips/7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:21:46.072168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ffd8d45d-2bfe-4cea-9b85-08626fb15786 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:46.072792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ffd8d45d-2bfe-4cea-9b85-08626fb15786 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:46.080900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ffd8d45d-2bfe-4cea-9b85-08626fb15786 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:46.081437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ffd8d45d-2bfe-4cea-9b85-08626fb15786 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:46.081957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ffd8d45d-2bfe-4cea-9b85-08626fb15786 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:46.082985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ffd8d45d-2bfe-4cea-9b85-08626fb15786 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:46.083586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ffd8d45d-2bfe-4cea-9b85-08626fb15786 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:46.084011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ffd8d45d-2bfe-4cea-9b85-08626fb15786 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:46.154365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8075cc08-4a0d-44f1-ad97-4545bb8304cf tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:46.164579 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8075cc08-4a0d-44f1-ad97-4545bb8304cf tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56" status: 200 len: 1322 microversion: 2.1 time: 0.191032 Oct 10 23:21:46.165854 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 715/1424] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:45 2022] GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:46.171322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-018e6941-e587-4030-911d-f782a4f3ee92 tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] Calling method '.version_select at 0x7f6633a03c10>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:46.195922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ffd8d45d-2bfe-4cea-9b85-08626fb15786 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:46.211004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ffd8d45d-2bfe-4cea-9b85-08626fb15786 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:46.213369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ffd8d45d-2bfe-4cea-9b85-08626fb15786 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:46.215040 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ffd8d45d-2bfe-4cea-9b85-08626fb15786 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1366 microversion: 2.57 time: 0.156009 Oct 10 23:21:46.216370 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 710/1425] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:46 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:46.231014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG neutronclient.v2_0.client [None req-018e6941-e587-4030-911d-f782a4f3ee92 tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3 could not be found", "detail": ""}} {{(pid=120614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:21:46.231715 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-018e6941-e587-4030-911d-f782a4f3ee92 tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] HTTP exception thrown: Floating IP not found for ID 7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3 Oct 10 23:21:46.238371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-018e6941-e587-4030-911d-f782a4f3ee92 tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] Request method failure captured: Oct 10 23:21:46.238371 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/os-floating-ips/7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3 HTTP/1.1 Oct 10 23:21:46.238371 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:21:46.238371 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:21:46.238371 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:21:46.238371 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:21:46.238371 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:21:46.238371 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:21:46.238371 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:21:46.238371 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:46.238371 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKj2zyw8lbRAhPkDnWmx-9QiZ1adNKZz6rPDnjM16WnakPqlsJFC2RpB0Si26HFEGanya_SmP65YZgGdW1II8lgqFixX4GbrXgM1gBxgjKKpR-jQ332HsrnR9S7S_x_CDJMGOGxW9vfDxlH2SiDe-De8C9wWprzzX4No4nHGlD-Q33E Oct 10 23:21:46.238371 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:21:46.238371 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:21:46.238371 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:21:46.238371 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:21:46.238371 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:21:46.238371 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:21:46.238371 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 6e73a41f5ede43599dfd6cb40078bfb1 Oct 10 23:21:46.238371 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-FloatingIPsTestJSON-763317695 Oct 10 23:21:46.238371 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:21:46.238371 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:21:46.239778 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6e73a41f5ede43599dfd6cb40078bfb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6e73a41f5ede43599dfd6cb40078bfb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6e73a41f5ede43599dfd6cb40078bfb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6e73a41f5ede43599dfd6cb40078bfb1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:46.239778 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-FloatingIPsTestJSON-763317695 Oct 10 23:21:46.239778 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 6e73a41f5ede43599dfd6cb40078bfb1 Oct 10 23:21:46.239778 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-FloatingIPsTestJSON-763317695 Oct 10 23:21:46.239778 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-FloatingIPsTestJSON-763317695-project Oct 10 23:21:46.239778 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:21:46.239778 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:21:46.239778 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: e3e71b5ac469496e878ea37d5b82a983 Oct 10 23:21:46.239778 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-FloatingIPsTestJSON-763317695-project Oct 10 23:21:46.239778 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:21:46.239778 n-d-860864-2 devstack@n-api.service[120614]: exception: Floating IP not found for ID 7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3 Oct 10 23:21:46.239778 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3'} Oct 10 23:21:46.239778 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:46.240746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:46.240746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 10 23:21:46.240746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 10 23:21:46.240746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:46.240746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:46.240746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 10 23:21:46.240746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 10 23:21:46.240746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:46.240746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:46.240746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 23:21:46.240746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 23:21:46.240746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:46.240746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:46.240746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:21:46.240746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:21:46.240746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:46.240746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:46.240746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:21:46.240746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:21:46.242015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:21:46.242015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:21:46.242015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:21:46.242015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:21:46.242015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:21:46.242015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:21:46.242015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3 could not be found Oct 10 23:21:46.242015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-54d4a00a-cf64-4e9c-bcc8-59f4c9cbca55'] Oct 10 23:21:46.242015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:46.242015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:46.242015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:46.242015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:46.242015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 10 23:21:46.242015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 10 23:21:46.242015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 10 23:21:46.242015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 10 23:21:46.242015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3. Oct 10 23:21:46.242015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:46.242015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:46.242015 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:46.243264 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:46.243264 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:46.243264 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:46.243264 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:46.243264 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:46.243264 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:21:46.243264 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:21:46.243264 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:46.243264 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:46.243264 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 10 23:21:46.243264 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 23:21:46.243264 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3 Oct 10 23:21:46.243264 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:46.243264 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:46.243264 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:46.243264 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:46.243264 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:46.243264 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:46.243264 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:21:46.243264 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:21:46.244514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3 Oct 10 23:21:46.244514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:46.244514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-018e6941-e587-4030-911d-f782a4f3ee92 tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] Returning 404 to user: Floating IP not found for ID 7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3 {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:46.244514 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-018e6941-e587-4030-911d-f782a4f3ee92 tempest-FloatingIPsTestJSON-763317695 tempest-FloatingIPsTestJSON-763317695-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3" status: 404 len: 111 microversion: 2.1 time: 0.072838 Oct 10 23:21:46.244514 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 716/1426] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 10 23:21:46 2022] DELETE /compute/v2.1/os-floating-ips/7c016ba1-cdaa-4d6d-a6db-6df0131ecdc3 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:21:46.283602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c9df7a8b-2d2c-413e-ba26-a1c15d4a6dd7 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:46.284671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c9df7a8b-2d2c-413e-ba26-a1c15d4a6dd7 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:46.292338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9df7a8b-2d2c-413e-ba26-a1c15d4a6dd7 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:46.292837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9df7a8b-2d2c-413e-ba26-a1c15d4a6dd7 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:46.293492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9df7a8b-2d2c-413e-ba26-a1c15d4a6dd7 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:46.294201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9df7a8b-2d2c-413e-ba26-a1c15d4a6dd7 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:46.294888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9df7a8b-2d2c-413e-ba26-a1c15d4a6dd7 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:46.295507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9df7a8b-2d2c-413e-ba26-a1c15d4a6dd7 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:46.378425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c9df7a8b-2d2c-413e-ba26-a1c15d4a6dd7 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:46.386629 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c9df7a8b-2d2c-413e-ba26-a1c15d4a6dd7 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d" status: 200 len: 1321 microversion: 2.1 time: 0.111225 Oct 10 23:21:46.387204 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 711/1427] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:46 2022] GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d => generated 1321 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:46.512030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-73444921-86a5-4eae-a81d-baa5d35bccb4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:46.512642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-73444921-86a5-4eae-a81d-baa5d35bccb4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:46.519740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73444921-86a5-4eae-a81d-baa5d35bccb4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:46.520227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73444921-86a5-4eae-a81d-baa5d35bccb4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:46.520837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73444921-86a5-4eae-a81d-baa5d35bccb4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:46.521798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73444921-86a5-4eae-a81d-baa5d35bccb4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:46.522258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73444921-86a5-4eae-a81d-baa5d35bccb4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:46.522707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73444921-86a5-4eae-a81d-baa5d35bccb4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:46.615734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ee9d4937-d8a2-42fb-b9be-6fcd6ba72767 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:46.616453 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ee9d4937-d8a2-42fb-b9be-6fcd6ba72767 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:46.632044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee9d4937-d8a2-42fb-b9be-6fcd6ba72767 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:46.633186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee9d4937-d8a2-42fb-b9be-6fcd6ba72767 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:46.635052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee9d4937-d8a2-42fb-b9be-6fcd6ba72767 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:46.635811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee9d4937-d8a2-42fb-b9be-6fcd6ba72767 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:46.636275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee9d4937-d8a2-42fb-b9be-6fcd6ba72767 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:46.639545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee9d4937-d8a2-42fb-b9be-6fcd6ba72767 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:46.776058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ee9d4937-d8a2-42fb-b9be-6fcd6ba72767 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:46.791758 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ee9d4937-d8a2-42fb-b9be-6fcd6ba72767 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1215 microversion: 2.1 time: 0.180418 Oct 10 23:21:46.793857 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 712/1428] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:46 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1215 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:46.821898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-73444921-86a5-4eae-a81d-baa5d35bccb4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:46.830973 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-73444921-86a5-4eae-a81d-baa5d35bccb4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.322694 Oct 10 23:21:46.832485 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 717/1429] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:46 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:46.996553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3c6efeef-4ae0-4711-965e-563c073ed034 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:46.997182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3c6efeef-4ae0-4711-965e-563c073ed034 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:47.008484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c6efeef-4ae0-4711-965e-563c073ed034 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:47.008983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c6efeef-4ae0-4711-965e-563c073ed034 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:47.009443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c6efeef-4ae0-4711-965e-563c073ed034 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:47.010159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c6efeef-4ae0-4711-965e-563c073ed034 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:47.010939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c6efeef-4ae0-4711-965e-563c073ed034 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:47.012250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c6efeef-4ae0-4711-965e-563c073ed034 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:47.189675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2c488389-b87e-4cae-9236-bdddc54eb8ec tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:47.191418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2c488389-b87e-4cae-9236-bdddc54eb8ec tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: d9d0be5f-c878-4a44-8433-56d0d850ea56] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:47.199230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c488389-b87e-4cae-9236-bdddc54eb8ec tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:47.199988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c488389-b87e-4cae-9236-bdddc54eb8ec tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:47.200428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c488389-b87e-4cae-9236-bdddc54eb8ec tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:47.201878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c488389-b87e-4cae-9236-bdddc54eb8ec tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:47.203382 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c488389-b87e-4cae-9236-bdddc54eb8ec tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:47.204135 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c488389-b87e-4cae-9236-bdddc54eb8ec tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:47.415102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2c488389-b87e-4cae-9236-bdddc54eb8ec tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:47.435998 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2c488389-b87e-4cae-9236-bdddc54eb8ec tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56" status: 200 len: 1516 microversion: 2.1 time: 0.251413 Oct 10 23:21:47.436595 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 718/1430] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:47 2022] GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56 => generated 1516 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:47.453448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-09332b5d-cc35-4480-9a28-43101b133496 req-e32bda83-53da-44c7-813d-aa6cbc26b0b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6ae5edf-fc2a-431a-9360-201b079daf30", "name": "network-vif-plugged", "status": "completed", "tag": "91c911a0-bbc5-43b9-8298-54c5443d9b3e"}, {"server_uuid": "2391b441-47e3-4bf3-b134-3aa316543f10", "name": "network-vif-plugged", "status": "completed", "tag": "d6030a75-0ba4-487f-9252-aede9ef4854e"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:47.472184 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-09332b5d-cc35-4480-9a28-43101b133496 req-e32bda83-53da-44c7-813d-aa6cbc26b0b5 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:47.472664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-09332b5d-cc35-4480-9a28-43101b133496 req-e32bda83-53da-44c7-813d-aa6cbc26b0b5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:47.473470 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-09332b5d-cc35-4480-9a28-43101b133496 req-e32bda83-53da-44c7-813d-aa6cbc26b0b5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:47.496982 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-09332b5d-cc35-4480-9a28-43101b133496 req-e32bda83-53da-44c7-813d-aa6cbc26b0b5 service nova] Creating event network-vif-plugged:91c911a0-bbc5-43b9-8298-54c5443d9b3e for instance a6ae5edf-fc2a-431a-9360-201b079daf30 on n-h2-860864-2 Oct 10 23:21:47.497700 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-09332b5d-cc35-4480-9a28-43101b133496 req-e32bda83-53da-44c7-813d-aa6cbc26b0b5 service nova] Creating event network-vif-plugged:d6030a75-0ba4-487f-9252-aede9ef4854e for instance 2391b441-47e3-4bf3-b134-3aa316543f10 on n-h1-860864-2 Oct 10 23:21:47.510921 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-09332b5d-cc35-4480-9a28-43101b133496 req-e32bda83-53da-44c7-813d-aa6cbc26b0b5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.061525 Oct 10 23:21:47.512798 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 719/1431] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:47.534664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7af56dcf-f991-45e6-b967-eb96f96a42f0 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:47.535999 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7af56dcf-f991-45e6-b967-eb96f96a42f0 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:47.552216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7af56dcf-f991-45e6-b967-eb96f96a42f0 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:47.558904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7af56dcf-f991-45e6-b967-eb96f96a42f0 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:47.559677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7af56dcf-f991-45e6-b967-eb96f96a42f0 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:47.561104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7af56dcf-f991-45e6-b967-eb96f96a42f0 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:47.562184 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7af56dcf-f991-45e6-b967-eb96f96a42f0 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:47.562830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7af56dcf-f991-45e6-b967-eb96f96a42f0 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:47.641673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3c6efeef-4ae0-4711-965e-563c073ed034 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:47.671734 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3c6efeef-4ae0-4711-965e-563c073ed034 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1469 microversion: 2.1 time: 0.679213 Oct 10 23:21:47.681640 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 713/1432] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:46 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1469 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:47.682645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7af56dcf-f991-45e6-b967-eb96f96a42f0 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:47.690824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dcf1a5d6-7f28-495e-b195-d9388025cbba tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:47.692025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dcf1a5d6-7f28-495e-b195-d9388025cbba tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:47.708786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7af56dcf-f991-45e6-b967-eb96f96a42f0 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:47.710199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dcf1a5d6-7f28-495e-b195-d9388025cbba tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:47.710698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dcf1a5d6-7f28-495e-b195-d9388025cbba tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:47.711144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dcf1a5d6-7f28-495e-b195-d9388025cbba tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:47.711838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dcf1a5d6-7f28-495e-b195-d9388025cbba tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:47.712288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dcf1a5d6-7f28-495e-b195-d9388025cbba tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:47.712713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dcf1a5d6-7f28-495e-b195-d9388025cbba tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:47.717749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7af56dcf-f991-45e6-b967-eb96f96a42f0 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:47.719087 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7af56dcf-f991-45e6-b967-eb96f96a42f0 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1366 microversion: 2.57 time: 0.204018 Oct 10 23:21:47.725320 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 720/1433] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:47 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:47.755936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ab4129cc-abfa-4c60-b1a1-adf84f5ef830 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:47.756922 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ab4129cc-abfa-4c60-b1a1-adf84f5ef830 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: 2391b441-47e3-4bf3-b134-3aa316543f10] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:47.767135 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab4129cc-abfa-4c60-b1a1-adf84f5ef830 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:47.768071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab4129cc-abfa-4c60-b1a1-adf84f5ef830 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:47.768724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab4129cc-abfa-4c60-b1a1-adf84f5ef830 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:47.769715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab4129cc-abfa-4c60-b1a1-adf84f5ef830 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:47.770368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab4129cc-abfa-4c60-b1a1-adf84f5ef830 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:47.774016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab4129cc-abfa-4c60-b1a1-adf84f5ef830 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:48.232331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ab4129cc-abfa-4c60-b1a1-adf84f5ef830 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:48.243108 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ab4129cc-abfa-4c60-b1a1-adf84f5ef830 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10" status: 200 len: 1322 microversion: 2.1 time: 0.506090 Oct 10 23:21:48.244191 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 721/1434] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:47 2022] GET /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10 => generated 1322 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:48.249955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f02617bb-e2bf-431b-aba0-9056a76aab8a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:48.250767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f02617bb-e2bf-431b-aba0-9056a76aab8a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:48.257762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f02617bb-e2bf-431b-aba0-9056a76aab8a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:48.258631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f02617bb-e2bf-431b-aba0-9056a76aab8a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:48.259306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f02617bb-e2bf-431b-aba0-9056a76aab8a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:48.260175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f02617bb-e2bf-431b-aba0-9056a76aab8a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:48.260630 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f02617bb-e2bf-431b-aba0-9056a76aab8a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:48.261054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f02617bb-e2bf-431b-aba0-9056a76aab8a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:48.362358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f02617bb-e2bf-431b-aba0-9056a76aab8a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:48.370605 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f02617bb-e2bf-431b-aba0-9056a76aab8a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1277 microversion: 2.1 time: 0.125086 Oct 10 23:21:48.371783 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 722/1435] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:48 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1277 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:48.380320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1b9c4495-9a4f-4b40-8c55-0131b5ad9fdb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:48.381147 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1b9c4495-9a4f-4b40-8c55-0131b5ad9fdb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:48.387834 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b9c4495-9a4f-4b40-8c55-0131b5ad9fdb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:48.389599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b9c4495-9a4f-4b40-8c55-0131b5ad9fdb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:48.390472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b9c4495-9a4f-4b40-8c55-0131b5ad9fdb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:48.391352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b9c4495-9a4f-4b40-8c55-0131b5ad9fdb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:48.391958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b9c4495-9a4f-4b40-8c55-0131b5ad9fdb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:48.392571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b9c4495-9a4f-4b40-8c55-0131b5ad9fdb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:48.397360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dcf1a5d6-7f28-495e-b195-d9388025cbba tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:48.405681 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dcf1a5d6-7f28-495e-b195-d9388025cbba tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d" status: 200 len: 1394 microversion: 2.1 time: 0.722646 Oct 10 23:21:48.413671 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 714/1436] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:47 2022] GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d => generated 1394 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:48.698611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2fd1b3ac-3343-444b-8a79-4716192fc7f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:48.699251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2fd1b3ac-3343-444b-8a79-4716192fc7f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:48.707474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fd1b3ac-3343-444b-8a79-4716192fc7f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:48.708068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fd1b3ac-3343-444b-8a79-4716192fc7f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:48.708593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fd1b3ac-3343-444b-8a79-4716192fc7f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:48.709401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fd1b3ac-3343-444b-8a79-4716192fc7f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:48.710818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fd1b3ac-3343-444b-8a79-4716192fc7f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:48.711257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fd1b3ac-3343-444b-8a79-4716192fc7f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:49.030860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1b9c4495-9a4f-4b40-8c55-0131b5ad9fdb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:49.040191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2fd1b3ac-3343-444b-8a79-4716192fc7f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:49.040627 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1b9c4495-9a4f-4b40-8c55-0131b5ad9fdb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.667444 Oct 10 23:21:49.041768 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 723/1437] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:48 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:49.048920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-19f925f5-c51f-4aa0-93ae-c4dd4ad2c797 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:49.049955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-19f925f5-c51f-4aa0-93ae-c4dd4ad2c797 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:49.057598 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2fd1b3ac-3343-444b-8a79-4716192fc7f7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1535 microversion: 2.1 time: 0.362048 Oct 10 23:21:49.057858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19f925f5-c51f-4aa0-93ae-c4dd4ad2c797 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:49.058532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19f925f5-c51f-4aa0-93ae-c4dd4ad2c797 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:49.059238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19f925f5-c51f-4aa0-93ae-c4dd4ad2c797 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:49.059634 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 715/1438] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:48 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1535 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:21:49.060732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19f925f5-c51f-4aa0-93ae-c4dd4ad2c797 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:49.061266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19f925f5-c51f-4aa0-93ae-c4dd4ad2c797 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:49.061831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19f925f5-c51f-4aa0-93ae-c4dd4ad2c797 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:49.175011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-19f925f5-c51f-4aa0-93ae-c4dd4ad2c797 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:49.184627 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-19f925f5-c51f-4aa0-93ae-c4dd4ad2c797 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:49.186674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-19f925f5-c51f-4aa0-93ae-c4dd4ad2c797 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:49.187926 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-19f925f5-c51f-4aa0-93ae-c4dd4ad2c797 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1366 microversion: 2.57 time: 0.144834 Oct 10 23:21:49.190748 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 724/1439] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:49 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:49.270175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a74cc039-b777-4539-a905-fc5b8ef41253 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:49.272787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a74cc039-b777-4539-a905-fc5b8ef41253 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: 2391b441-47e3-4bf3-b134-3aa316543f10] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:49.281955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a74cc039-b777-4539-a905-fc5b8ef41253 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:49.283925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a74cc039-b777-4539-a905-fc5b8ef41253 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:49.284594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a74cc039-b777-4539-a905-fc5b8ef41253 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:49.286128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a74cc039-b777-4539-a905-fc5b8ef41253 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:49.286810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a74cc039-b777-4539-a905-fc5b8ef41253 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:49.287452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a74cc039-b777-4539-a905-fc5b8ef41253 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:49.397051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-30473800-ccb4-4af1-a8de-3e24785e7b40 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:49.397710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-30473800-ccb4-4af1-a8de-3e24785e7b40 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:49.409035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30473800-ccb4-4af1-a8de-3e24785e7b40 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:49.410204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30473800-ccb4-4af1-a8de-3e24785e7b40 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:49.410857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30473800-ccb4-4af1-a8de-3e24785e7b40 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:49.411852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30473800-ccb4-4af1-a8de-3e24785e7b40 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:49.415415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30473800-ccb4-4af1-a8de-3e24785e7b40 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:49.416657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30473800-ccb4-4af1-a8de-3e24785e7b40 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:49.474488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:49.594997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-30473800-ccb4-4af1-a8de-3e24785e7b40 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:49.612652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a74cc039-b777-4539-a905-fc5b8ef41253 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:49.648784 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a74cc039-b777-4539-a905-fc5b8ef41253 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10" status: 200 len: 1322 microversion: 2.1 time: 0.384157 Oct 10 23:21:49.662147 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 716/1440] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:49 2022] GET /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10 => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:49.665829 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-30473800-ccb4-4af1-a8de-3e24785e7b40 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1277 microversion: 2.1 time: 0.272419 Oct 10 23:21:49.667917 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 725/1441] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:49 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1277 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:21:49.678739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-74653e09-8120-4acf-be2d-625a5fc3c810 req-dc42bb2a-d537-427b-aec0-fecb06ff466a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c528ef78-5144-437a-83e3-38376725259a", "name": "network-vif-unplugged", "status": "completed", "tag": "caf7c02f-0516-49b4-a4e1-4d9d62869316"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:49.690282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7ff7d76c-3e40-4f13-80c0-98e9247469c3 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:49.690918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7ff7d76c-3e40-4f13-80c0-98e9247469c3 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:49.697884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ff7d76c-3e40-4f13-80c0-98e9247469c3 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:49.698375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ff7d76c-3e40-4f13-80c0-98e9247469c3 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:49.698811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ff7d76c-3e40-4f13-80c0-98e9247469c3 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:49.699519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ff7d76c-3e40-4f13-80c0-98e9247469c3 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:49.700001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ff7d76c-3e40-4f13-80c0-98e9247469c3 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:49.700423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ff7d76c-3e40-4f13-80c0-98e9247469c3 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:49.702799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-74653e09-8120-4acf-be2d-625a5fc3c810 req-dc42bb2a-d537-427b-aec0-fecb06ff466a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:49.703771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-74653e09-8120-4acf-be2d-625a5fc3c810 req-dc42bb2a-d537-427b-aec0-fecb06ff466a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:49.707292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-74653e09-8120-4acf-be2d-625a5fc3c810 req-dc42bb2a-d537-427b-aec0-fecb06ff466a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:49.736887 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-74653e09-8120-4acf-be2d-625a5fc3c810 req-dc42bb2a-d537-427b-aec0-fecb06ff466a service nova] Creating event network-vif-unplugged:caf7c02f-0516-49b4-a4e1-4d9d62869316 for instance c528ef78-5144-437a-83e3-38376725259a on n-h1-860864-2 Oct 10 23:21:49.746374 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-74653e09-8120-4acf-be2d-625a5fc3c810 req-dc42bb2a-d537-427b-aec0-fecb06ff466a service nova] Instance c528ef78-5144-437a-83e3-38376725259a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 23:21:49.772788 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-74653e09-8120-4acf-be2d-625a5fc3c810 req-dc42bb2a-d537-427b-aec0-fecb06ff466a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109264 Oct 10 23:21:49.773916 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 717/1442] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:50.034535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7ff7d76c-3e40-4f13-80c0-98e9247469c3 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:50.043686 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7ff7d76c-3e40-4f13-80c0-98e9247469c3 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d" status: 200 len: 1394 microversion: 2.1 time: 0.373815 Oct 10 23:21:50.045875 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 726/1443] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:49 2022] GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d => generated 1394 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:50.066994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4b369e36-83aa-481e-92bd-8f2733f8f0ef tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:50.068201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4b369e36-83aa-481e-92bd-8f2733f8f0ef tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:50.075128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b369e36-83aa-481e-92bd-8f2733f8f0ef tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:50.075667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b369e36-83aa-481e-92bd-8f2733f8f0ef tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:50.076068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b369e36-83aa-481e-92bd-8f2733f8f0ef tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:50.077065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b369e36-83aa-481e-92bd-8f2733f8f0ef tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:50.077587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b369e36-83aa-481e-92bd-8f2733f8f0ef tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:50.078015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b369e36-83aa-481e-92bd-8f2733f8f0ef tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:50.088214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e8c92d94-ba0b-43d8-bf82-5aaf713ea82c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:50.088876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e8c92d94-ba0b-43d8-bf82-5aaf713ea82c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:50.096393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8c92d94-ba0b-43d8-bf82-5aaf713ea82c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:50.096895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8c92d94-ba0b-43d8-bf82-5aaf713ea82c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:50.097331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8c92d94-ba0b-43d8-bf82-5aaf713ea82c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:50.098600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8c92d94-ba0b-43d8-bf82-5aaf713ea82c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:50.099066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8c92d94-ba0b-43d8-bf82-5aaf713ea82c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:50.099501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8c92d94-ba0b-43d8-bf82-5aaf713ea82c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:50.330111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e8c92d94-ba0b-43d8-bf82-5aaf713ea82c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:50.340327 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e8c92d94-ba0b-43d8-bf82-5aaf713ea82c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1535 microversion: 2.1 time: 0.256768 Oct 10 23:21:50.353007 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 727/1444] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:50 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1535 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:50.353007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a43baa1b-0572-41fb-b58c-aaadf2e36868 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:50.353007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a43baa1b-0572-41fb-b58c-aaadf2e36868 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:50.357770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43baa1b-0572-41fb-b58c-aaadf2e36868 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:50.358926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43baa1b-0572-41fb-b58c-aaadf2e36868 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:50.358926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43baa1b-0572-41fb-b58c-aaadf2e36868 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:50.359977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43baa1b-0572-41fb-b58c-aaadf2e36868 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:50.360580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43baa1b-0572-41fb-b58c-aaadf2e36868 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:50.361187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43baa1b-0572-41fb-b58c-aaadf2e36868 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:50.442645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a43baa1b-0572-41fb-b58c-aaadf2e36868 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:50.452913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a43baa1b-0572-41fb-b58c-aaadf2e36868 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:50.454769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a43baa1b-0572-41fb-b58c-aaadf2e36868 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:50.456613 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a43baa1b-0572-41fb-b58c-aaadf2e36868 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1384 microversion: 2.57 time: 0.113354 Oct 10 23:21:50.469711 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 728/1445] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:50 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1384 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:50.692199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e74ffd04-5867-41dd-b813-4472505a6277 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:50.692738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e74ffd04-5867-41dd-b813-4472505a6277 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: 2391b441-47e3-4bf3-b134-3aa316543f10] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:50.699526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e74ffd04-5867-41dd-b813-4472505a6277 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:50.700019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e74ffd04-5867-41dd-b813-4472505a6277 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:50.702770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e74ffd04-5867-41dd-b813-4472505a6277 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:50.703376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e74ffd04-5867-41dd-b813-4472505a6277 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:50.703841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e74ffd04-5867-41dd-b813-4472505a6277 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:50.704317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e74ffd04-5867-41dd-b813-4472505a6277 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:50.770388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:50.797680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4b369e36-83aa-481e-92bd-8f2733f8f0ef tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:50.811220 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4b369e36-83aa-481e-92bd-8f2733f8f0ef tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.750547 Oct 10 23:21:50.812795 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 718/1446] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:50 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:50.819172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-781a28ee-9075-4147-b281-2f3c685ff585 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:50.820253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-781a28ee-9075-4147-b281-2f3c685ff585 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:50.831086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-781a28ee-9075-4147-b281-2f3c685ff585 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:50.831784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-781a28ee-9075-4147-b281-2f3c685ff585 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:50.835851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-781a28ee-9075-4147-b281-2f3c685ff585 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:50.836046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-781a28ee-9075-4147-b281-2f3c685ff585 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:50.836615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-781a28ee-9075-4147-b281-2f3c685ff585 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:50.837147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-781a28ee-9075-4147-b281-2f3c685ff585 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:50.936789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e74ffd04-5867-41dd-b813-4472505a6277 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:50.945726 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e74ffd04-5867-41dd-b813-4472505a6277 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10" status: 200 len: 1515 microversion: 2.1 time: 0.257140 Oct 10 23:21:50.946314 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 729/1447] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:50 2022] GET /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10 => generated 1515 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:21:50.969163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8e52bc1c-db9b-4f62-b399-095976ea4995 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:50.970073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8e52bc1c-db9b-4f62-b399-095976ea4995 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: a6ae5edf-fc2a-431a-9360-201b079daf30] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:50.976498 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e52bc1c-db9b-4f62-b399-095976ea4995 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:50.976987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e52bc1c-db9b-4f62-b399-095976ea4995 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:50.977437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e52bc1c-db9b-4f62-b399-095976ea4995 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:50.978311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e52bc1c-db9b-4f62-b399-095976ea4995 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:50.978921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e52bc1c-db9b-4f62-b399-095976ea4995 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:50.979343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e52bc1c-db9b-4f62-b399-095976ea4995 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:51.130093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8e52bc1c-db9b-4f62-b399-095976ea4995 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:51.134735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-781a28ee-9075-4147-b281-2f3c685ff585 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:51.143546 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-781a28ee-9075-4147-b281-2f3c685ff585 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1319 microversion: 2.1 time: 0.328863 Oct 10 23:21:51.144276 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 719/1448] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:50 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:51.145052 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8e52bc1c-db9b-4f62-b399-095976ea4995 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/a6ae5edf-fc2a-431a-9360-201b079daf30" status: 200 len: 1515 microversion: 2.1 time: 0.180429 Oct 10 23:21:51.146365 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 730/1449] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:50 2022] GET /compute/v2.1/servers/a6ae5edf-fc2a-431a-9360-201b079daf30 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:21:51.166319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-40bedf3f-aa66-4567-a279-33ad8b4e31b4 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:51.175665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a6b8b59d-d579-4111-9937-6ad0897c4896 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:51.176777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-40bedf3f-aa66-4567-a279-33ad8b4e31b4 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:51.181620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a6b8b59d-d579-4111-9937-6ad0897c4896 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: a6ae5edf-fc2a-431a-9360-201b079daf30] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:51.189079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40bedf3f-aa66-4567-a279-33ad8b4e31b4 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:51.189719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40bedf3f-aa66-4567-a279-33ad8b4e31b4 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:51.190398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40bedf3f-aa66-4567-a279-33ad8b4e31b4 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:51.192255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6b8b59d-d579-4111-9937-6ad0897c4896 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:51.193150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40bedf3f-aa66-4567-a279-33ad8b4e31b4 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:51.193651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40bedf3f-aa66-4567-a279-33ad8b4e31b4 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:51.194144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40bedf3f-aa66-4567-a279-33ad8b4e31b4 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:51.194378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6b8b59d-d579-4111-9937-6ad0897c4896 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:51.194993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6b8b59d-d579-4111-9937-6ad0897c4896 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:51.195991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6b8b59d-d579-4111-9937-6ad0897c4896 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:51.196519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6b8b59d-d579-4111-9937-6ad0897c4896 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:51.196941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6b8b59d-d579-4111-9937-6ad0897c4896 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:51.263470 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a6b8b59d-d579-4111-9937-6ad0897c4896 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: a6ae5edf-fc2a-431a-9360-201b079daf30] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:21:51.376840 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a6b8b59d-d579-4111-9937-6ad0897c4896 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a6ae5edf-fc2a-431a-9360-201b079daf30" status: 204 len: 0 microversion: 2.1 time: 0.204738 Oct 10 23:21:51.377611 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 731/1450] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:21:51 2022] DELETE /compute/v2.1/servers/a6ae5edf-fc2a-431a-9360-201b079daf30 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:21:51.383969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-94d80890-1cc1-4e48-92a6-2d77ca98aa39 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:51.384664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-94d80890-1cc1-4e48-92a6-2d77ca98aa39 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:51.394711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94d80890-1cc1-4e48-92a6-2d77ca98aa39 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:51.395200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94d80890-1cc1-4e48-92a6-2d77ca98aa39 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:51.395679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94d80890-1cc1-4e48-92a6-2d77ca98aa39 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:51.396557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94d80890-1cc1-4e48-92a6-2d77ca98aa39 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:51.397168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94d80890-1cc1-4e48-92a6-2d77ca98aa39 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:51.397815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94d80890-1cc1-4e48-92a6-2d77ca98aa39 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:51.449476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-40bedf3f-aa66-4567-a279-33ad8b4e31b4 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:51.469016 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-40bedf3f-aa66-4567-a279-33ad8b4e31b4 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d" status: 200 len: 1394 microversion: 2.1 time: 0.323136 Oct 10 23:21:51.478846 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 720/1451] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:51 2022] GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d => generated 1394 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:51.478846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-434e8676-2867-4a25-90ac-3ffd24b3bc5f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:51.478846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-434e8676-2867-4a25-90ac-3ffd24b3bc5f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: a6ae5edf-fc2a-431a-9360-201b079daf30] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:51.491124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-434e8676-2867-4a25-90ac-3ffd24b3bc5f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:51.491629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-434e8676-2867-4a25-90ac-3ffd24b3bc5f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:51.492069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-434e8676-2867-4a25-90ac-3ffd24b3bc5f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:51.493557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-434e8676-2867-4a25-90ac-3ffd24b3bc5f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:51.494671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-434e8676-2867-4a25-90ac-3ffd24b3bc5f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:51.494671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-434e8676-2867-4a25-90ac-3ffd24b3bc5f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:51.721722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-434e8676-2867-4a25-90ac-3ffd24b3bc5f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:51.730655 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-434e8676-2867-4a25-90ac-3ffd24b3bc5f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/a6ae5edf-fc2a-431a-9360-201b079daf30" status: 200 len: 1521 microversion: 2.1 time: 0.259527 Oct 10 23:21:51.731640 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 721/1452] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:51 2022] GET /compute/v2.1/servers/a6ae5edf-fc2a-431a-9360-201b079daf30 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:51.738017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3ceeb9ee-6b8e-4154-9a38-cc6303b04e86 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:51.738838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3ceeb9ee-6b8e-4154-9a38-cc6303b04e86 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:51.745954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ceeb9ee-6b8e-4154-9a38-cc6303b04e86 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:51.746661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ceeb9ee-6b8e-4154-9a38-cc6303b04e86 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:51.747237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ceeb9ee-6b8e-4154-9a38-cc6303b04e86 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:51.748929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ceeb9ee-6b8e-4154-9a38-cc6303b04e86 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:51.749693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ceeb9ee-6b8e-4154-9a38-cc6303b04e86 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:51.750126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ceeb9ee-6b8e-4154-9a38-cc6303b04e86 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:51.767322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:51.773160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-94d80890-1cc1-4e48-92a6-2d77ca98aa39 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:51.783540 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-94d80890-1cc1-4e48-92a6-2d77ca98aa39 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1535 microversion: 2.1 time: 0.404494 Oct 10 23:21:51.784982 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 732/1453] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:51 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1535 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:51.808310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-aab5d949-43d0-48d2-ad98-87cdf09cacf6 req-33260eed-ed34-426e-b430-175dbb27e9ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3480d89d-6a7a-4814-bc55-63ab2350750d", "tag": "91530f58-3fc0-45aa-809a-4a02f3333d71"}, {"name": "network-changed", "server_uuid": "c528ef78-5144-437a-83e3-38376725259a", "tag": "caf7c02f-0516-49b4-a4e1-4d9d62869316"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:51.819261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-aab5d949-43d0-48d2-ad98-87cdf09cacf6 req-33260eed-ed34-426e-b430-175dbb27e9ee service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:51.820127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-aab5d949-43d0-48d2-ad98-87cdf09cacf6 req-33260eed-ed34-426e-b430-175dbb27e9ee service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:51.820721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-aab5d949-43d0-48d2-ad98-87cdf09cacf6 req-33260eed-ed34-426e-b430-175dbb27e9ee service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:51.833207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3ceeb9ee-6b8e-4154-9a38-cc6303b04e86 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:51.835366 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-aab5d949-43d0-48d2-ad98-87cdf09cacf6 req-33260eed-ed34-426e-b430-175dbb27e9ee service nova] Creating event network-changed:91530f58-3fc0-45aa-809a-4a02f3333d71 for instance 3480d89d-6a7a-4814-bc55-63ab2350750d on n-h1-860864-2 Oct 10 23:21:51.836219 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-aab5d949-43d0-48d2-ad98-87cdf09cacf6 req-33260eed-ed34-426e-b430-175dbb27e9ee service nova] Creating event network-changed:caf7c02f-0516-49b4-a4e1-4d9d62869316 for instance c528ef78-5144-437a-83e3-38376725259a on n-h1-860864-2 Oct 10 23:21:51.843137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [req-aab5d949-43d0-48d2-ad98-87cdf09cacf6 req-33260eed-ed34-426e-b430-175dbb27e9ee service nova] Instance c528ef78-5144-437a-83e3-38376725259a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 23:21:51.843666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3ceeb9ee-6b8e-4154-9a38-cc6303b04e86 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:51.855845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3ceeb9ee-6b8e-4154-9a38-cc6303b04e86 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:51.856120 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-aab5d949-43d0-48d2-ad98-87cdf09cacf6 req-33260eed-ed34-426e-b430-175dbb27e9ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.051474 Oct 10 23:21:51.857688 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 733/1454] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:21:51.858082 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3ceeb9ee-6b8e-4154-9a38-cc6303b04e86 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1372 microversion: 2.57 time: 0.123214 Oct 10 23:21:51.858924 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 722/1455] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:51 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1372 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:51.876674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bb120c5d-14ad-4404-97f7-6ad9b61de640 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:51.881454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bb120c5d-14ad-4404-97f7-6ad9b61de640 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:51.892020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb120c5d-14ad-4404-97f7-6ad9b61de640 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:51.894077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb120c5d-14ad-4404-97f7-6ad9b61de640 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:51.895081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb120c5d-14ad-4404-97f7-6ad9b61de640 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:51.896009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb120c5d-14ad-4404-97f7-6ad9b61de640 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:51.896468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb120c5d-14ad-4404-97f7-6ad9b61de640 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:51.897073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb120c5d-14ad-4404-97f7-6ad9b61de640 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:52.174433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-37adc46c-aa14-4a71-bd66-a04b986fc376 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:52.175059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-37adc46c-aa14-4a71-bd66-a04b986fc376 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:52.185984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37adc46c-aa14-4a71-bd66-a04b986fc376 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:52.186817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37adc46c-aa14-4a71-bd66-a04b986fc376 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:52.187439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37adc46c-aa14-4a71-bd66-a04b986fc376 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:52.188728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37adc46c-aa14-4a71-bd66-a04b986fc376 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:52.189588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37adc46c-aa14-4a71-bd66-a04b986fc376 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:52.190509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37adc46c-aa14-4a71-bd66-a04b986fc376 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:52.314334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb120c5d-14ad-4404-97f7-6ad9b61de640 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:52.331360 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bb120c5d-14ad-4404-97f7-6ad9b61de640 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.460813 Oct 10 23:21:52.333622 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 734/1456] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:51 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:52.495953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fdb3c881-acf6-45fb-a9b9-8cb5f4e42708 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:52.497132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fdb3c881-acf6-45fb-a9b9-8cb5f4e42708 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:52.506239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdb3c881-acf6-45fb-a9b9-8cb5f4e42708 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:52.507520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdb3c881-acf6-45fb-a9b9-8cb5f4e42708 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:52.507520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdb3c881-acf6-45fb-a9b9-8cb5f4e42708 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:52.508290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdb3c881-acf6-45fb-a9b9-8cb5f4e42708 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:52.509292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdb3c881-acf6-45fb-a9b9-8cb5f4e42708 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:52.509973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdb3c881-acf6-45fb-a9b9-8cb5f4e42708 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:52.621951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-37adc46c-aa14-4a71-bd66-a04b986fc376 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:52.629878 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-37adc46c-aa14-4a71-bd66-a04b986fc376 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1319 microversion: 2.1 time: 0.464379 Oct 10 23:21:52.630791 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 723/1457] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:52 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1319 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:52.673029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fdb3c881-acf6-45fb-a9b9-8cb5f4e42708 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:52.681001 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fdb3c881-acf6-45fb-a9b9-8cb5f4e42708 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d" status: 200 len: 1394 microversion: 2.1 time: 0.190397 Oct 10 23:21:52.681884 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 735/1458] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:52 2022] GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d => generated 1394 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:21:52.755367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6f56a4ff-f1c2-4c2a-ba87-b92803634573 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:52.756207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6f56a4ff-f1c2-4c2a-ba87-b92803634573 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: a6ae5edf-fc2a-431a-9360-201b079daf30] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:52.762535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f56a4ff-f1c2-4c2a-ba87-b92803634573 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:52.763029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f56a4ff-f1c2-4c2a-ba87-b92803634573 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:52.763667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f56a4ff-f1c2-4c2a-ba87-b92803634573 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:52.764396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f56a4ff-f1c2-4c2a-ba87-b92803634573 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:52.765354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f56a4ff-f1c2-4c2a-ba87-b92803634573 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:52.766009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f56a4ff-f1c2-4c2a-ba87-b92803634573 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:52.808093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-500eb656-d0bb-4414-8c51-a80a2e6e1da2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:52.808709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-500eb656-d0bb-4414-8c51-a80a2e6e1da2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:52.816971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-500eb656-d0bb-4414-8c51-a80a2e6e1da2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:52.817301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-500eb656-d0bb-4414-8c51-a80a2e6e1da2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:52.817714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-500eb656-d0bb-4414-8c51-a80a2e6e1da2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:52.820857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-500eb656-d0bb-4414-8c51-a80a2e6e1da2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:52.820857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-500eb656-d0bb-4414-8c51-a80a2e6e1da2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:52.821277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-500eb656-d0bb-4414-8c51-a80a2e6e1da2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:52.997229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-500eb656-d0bb-4414-8c51-a80a2e6e1da2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:53.008379 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-500eb656-d0bb-4414-8c51-a80a2e6e1da2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1535 microversion: 2.1 time: 0.204032 Oct 10 23:21:53.009595 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 736/1459] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:52 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1535 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:21:53.015498 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-885fe849-3bfe-429e-a2ac-86ecc0e2f769 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:53.016490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-885fe849-3bfe-429e-a2ac-86ecc0e2f769 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:53.027121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-885fe849-3bfe-429e-a2ac-86ecc0e2f769 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:53.027766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-885fe849-3bfe-429e-a2ac-86ecc0e2f769 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:53.028299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-885fe849-3bfe-429e-a2ac-86ecc0e2f769 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:53.029360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-885fe849-3bfe-429e-a2ac-86ecc0e2f769 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:53.030421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-885fe849-3bfe-429e-a2ac-86ecc0e2f769 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:53.030956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-885fe849-3bfe-429e-a2ac-86ecc0e2f769 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:53.107629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-885fe849-3bfe-429e-a2ac-86ecc0e2f769 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:53.116689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-885fe849-3bfe-429e-a2ac-86ecc0e2f769 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:53.118165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-885fe849-3bfe-429e-a2ac-86ecc0e2f769 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:53.119330 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-885fe849-3bfe-429e-a2ac-86ecc0e2f769 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1372 microversion: 2.57 time: 0.108482 Oct 10 23:21:53.119886 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 737/1460] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:53 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:53.194071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-b1e0f8d2-630f-4898-b771-980860f4c3e7 req-ef780a6e-581c-47d3-b6fd-175651905b8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cf22bf8-8f94-4915-ad99-2d9614352ea6", "tag": "2ca2c16e-0ce8-4fee-9beb-8fd4f1c2ead3"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:53.206160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b1e0f8d2-630f-4898-b771-980860f4c3e7 req-ef780a6e-581c-47d3-b6fd-175651905b8e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:53.206947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b1e0f8d2-630f-4898-b771-980860f4c3e7 req-ef780a6e-581c-47d3-b6fd-175651905b8e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:53.207542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b1e0f8d2-630f-4898-b771-980860f4c3e7 req-ef780a6e-581c-47d3-b6fd-175651905b8e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:53.208274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6f56a4ff-f1c2-4c2a-ba87-b92803634573 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:53.219032 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6f56a4ff-f1c2-4c2a-ba87-b92803634573 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/a6ae5edf-fc2a-431a-9360-201b079daf30" status: 200 len: 1521 microversion: 2.1 time: 0.467345 Oct 10 23:21:53.219620 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 724/1461] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:52 2022] GET /compute/v2.1/servers/a6ae5edf-fc2a-431a-9360-201b079daf30 => generated 1521 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:53.221137 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-b1e0f8d2-630f-4898-b771-980860f4c3e7 req-ef780a6e-581c-47d3-b6fd-175651905b8e service nova] Creating event network-changed:2ca2c16e-0ce8-4fee-9beb-8fd4f1c2ead3 for instance 9cf22bf8-8f94-4915-ad99-2d9614352ea6 on n-h1-860864-2 Oct 10 23:21:53.226268 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-b1e0f8d2-630f-4898-b771-980860f4c3e7 req-ef780a6e-581c-47d3-b6fd-175651905b8e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105257 Oct 10 23:21:53.227346 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 738/1462] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:53.360279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ec9a1c8e-a5e0-4770-90de-1e98af5dfa3a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:53.374239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ec9a1c8e-a5e0-4770-90de-1e98af5dfa3a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:53.381073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ec9a1c8e-a5e0-4770-90de-1e98af5dfa3a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:53.381245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ec9a1c8e-a5e0-4770-90de-1e98af5dfa3a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:53.381660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ec9a1c8e-a5e0-4770-90de-1e98af5dfa3a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:53.382373 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ec9a1c8e-a5e0-4770-90de-1e98af5dfa3a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:53.382861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ec9a1c8e-a5e0-4770-90de-1e98af5dfa3a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:53.383295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ec9a1c8e-a5e0-4770-90de-1e98af5dfa3a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:53.655357 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0eeb8c42-e708-41ec-9f1c-55dde5d2c97f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:53.657076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0eeb8c42-e708-41ec-9f1c-55dde5d2c97f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:53.671645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0eeb8c42-e708-41ec-9f1c-55dde5d2c97f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:53.672151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0eeb8c42-e708-41ec-9f1c-55dde5d2c97f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:53.672593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0eeb8c42-e708-41ec-9f1c-55dde5d2c97f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:53.673313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0eeb8c42-e708-41ec-9f1c-55dde5d2c97f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:53.674961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0eeb8c42-e708-41ec-9f1c-55dde5d2c97f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:53.675406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0eeb8c42-e708-41ec-9f1c-55dde5d2c97f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:53.830766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ec9a1c8e-a5e0-4770-90de-1e98af5dfa3a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:53.846790 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ec9a1c8e-a5e0-4770-90de-1e98af5dfa3a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.490559 Oct 10 23:21:53.847858 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 725/1463] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:53 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:53.867411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-833d27eb-51de-4798-9b20-0f51d0c06010 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:53.868166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-833d27eb-51de-4798-9b20-0f51d0c06010 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:53.870276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:53.879947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-833d27eb-51de-4798-9b20-0f51d0c06010 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:53.881068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-833d27eb-51de-4798-9b20-0f51d0c06010 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:53.881968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-833d27eb-51de-4798-9b20-0f51d0c06010 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:53.883161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-833d27eb-51de-4798-9b20-0f51d0c06010 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:53.883988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-833d27eb-51de-4798-9b20-0f51d0c06010 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:53.885025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-833d27eb-51de-4798-9b20-0f51d0c06010 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:53.956933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0eeb8c42-e708-41ec-9f1c-55dde5d2c97f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:53.965128 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0eeb8c42-e708-41ec-9f1c-55dde5d2c97f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1319 microversion: 2.1 time: 0.314955 Oct 10 23:21:53.966072 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 739/1464] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:53 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1319 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:54.038587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-490289ad-e577-42fe-b6b9-74f463ddcd6f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:54.039365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-490289ad-e577-42fe-b6b9-74f463ddcd6f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:54.047564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-490289ad-e577-42fe-b6b9-74f463ddcd6f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:54.048397 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-490289ad-e577-42fe-b6b9-74f463ddcd6f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:54.049179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-490289ad-e577-42fe-b6b9-74f463ddcd6f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:54.050021 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-490289ad-e577-42fe-b6b9-74f463ddcd6f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:54.050853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-490289ad-e577-42fe-b6b9-74f463ddcd6f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:54.051555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-490289ad-e577-42fe-b6b9-74f463ddcd6f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:54.310811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-490289ad-e577-42fe-b6b9-74f463ddcd6f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:54.324589 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-490289ad-e577-42fe-b6b9-74f463ddcd6f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1535 microversion: 2.1 time: 0.293052 Oct 10 23:21:54.334756 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 740/1465] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:54 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1535 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:54.345138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5efb365b-b90d-4422-8f1a-23def3306de3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:54.345929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5efb365b-b90d-4422-8f1a-23def3306de3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:54.360733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5efb365b-b90d-4422-8f1a-23def3306de3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:54.361406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5efb365b-b90d-4422-8f1a-23def3306de3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:54.361998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5efb365b-b90d-4422-8f1a-23def3306de3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:54.363322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5efb365b-b90d-4422-8f1a-23def3306de3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:54.363900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5efb365b-b90d-4422-8f1a-23def3306de3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:54.364607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5efb365b-b90d-4422-8f1a-23def3306de3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:54.400500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:54.506134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-833d27eb-51de-4798-9b20-0f51d0c06010 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:54.543283 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-833d27eb-51de-4798-9b20-0f51d0c06010 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d" status: 200 len: 1394 microversion: 2.1 time: 0.691447 Oct 10 23:21:54.547100 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 726/1466] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:53 2022] GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d => generated 1394 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:54.554066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5efb365b-b90d-4422-8f1a-23def3306de3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:54.568094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5efb365b-b90d-4422-8f1a-23def3306de3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:54.570292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2b7922af-b5a3-40b7-bed2-0e000b9627b7 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:54.573853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2b7922af-b5a3-40b7-bed2-0e000b9627b7 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: a6ae5edf-fc2a-431a-9360-201b079daf30] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:54.584261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b7922af-b5a3-40b7-bed2-0e000b9627b7 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:54.584833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b7922af-b5a3-40b7-bed2-0e000b9627b7 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:54.585329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b7922af-b5a3-40b7-bed2-0e000b9627b7 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:54.586350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b7922af-b5a3-40b7-bed2-0e000b9627b7 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:54.586904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5efb365b-b90d-4422-8f1a-23def3306de3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:54.587824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b7922af-b5a3-40b7-bed2-0e000b9627b7 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:54.589864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b7922af-b5a3-40b7-bed2-0e000b9627b7 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:54.591555 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5efb365b-b90d-4422-8f1a-23def3306de3 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1372 microversion: 2.57 time: 0.255507 Oct 10 23:21:54.594609 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 741/1467] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:54 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1372 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:54.658065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-9378c5da-91d4-4fc3-8363-726a93cd0f0c req-eb15f4d3-a264-4948-9e15-42d13d8cfd65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6ae5edf-fc2a-431a-9360-201b079daf30", "name": "network-vif-deleted", "tag": "91c911a0-bbc5-43b9-8298-54c5443d9b3e"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:54.677416 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9378c5da-91d4-4fc3-8363-726a93cd0f0c req-eb15f4d3-a264-4948-9e15-42d13d8cfd65 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:54.682292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9378c5da-91d4-4fc3-8363-726a93cd0f0c req-eb15f4d3-a264-4948-9e15-42d13d8cfd65 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:54.682880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9378c5da-91d4-4fc3-8363-726a93cd0f0c req-eb15f4d3-a264-4948-9e15-42d13d8cfd65 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:54.707874 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-9378c5da-91d4-4fc3-8363-726a93cd0f0c req-eb15f4d3-a264-4948-9e15-42d13d8cfd65 service nova] Creating event network-vif-deleted:91c911a0-bbc5-43b9-8298-54c5443d9b3e for instance a6ae5edf-fc2a-431a-9360-201b079daf30 on n-h2-860864-2 Oct 10 23:21:54.721296 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-9378c5da-91d4-4fc3-8363-726a93cd0f0c req-eb15f4d3-a264-4948-9e15-42d13d8cfd65 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067785 Oct 10 23:21:54.722159 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 742/1468] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:54.872397 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fb30b35c-4a74-4151-8d10-b31302653560 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:54.874068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fb30b35c-4a74-4151-8d10-b31302653560 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:54.884221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb30b35c-4a74-4151-8d10-b31302653560 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:54.894602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb30b35c-4a74-4151-8d10-b31302653560 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:54.895214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb30b35c-4a74-4151-8d10-b31302653560 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:54.896576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb30b35c-4a74-4151-8d10-b31302653560 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:54.897157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb30b35c-4a74-4151-8d10-b31302653560 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:54.898519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb30b35c-4a74-4151-8d10-b31302653560 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:54.898789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2b7922af-b5a3-40b7-bed2-0e000b9627b7 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:54.917526 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2b7922af-b5a3-40b7-bed2-0e000b9627b7 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/a6ae5edf-fc2a-431a-9360-201b079daf30" status: 200 len: 1479 microversion: 2.1 time: 0.367267 Oct 10 23:21:54.919024 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 727/1469] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:54 2022] GET /compute/v2.1/servers/a6ae5edf-fc2a-431a-9360-201b079daf30 => generated 1479 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:54.995689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3c56a024-b6f9-48b4-8c00-e78d9849bdc7 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:54.997162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3c56a024-b6f9-48b4-8c00-e78d9849bdc7 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:55.018773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c56a024-b6f9-48b4-8c00-e78d9849bdc7 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:55.019586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c56a024-b6f9-48b4-8c00-e78d9849bdc7 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:55.020795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c56a024-b6f9-48b4-8c00-e78d9849bdc7 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:55.021912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c56a024-b6f9-48b4-8c00-e78d9849bdc7 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:55.022593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c56a024-b6f9-48b4-8c00-e78d9849bdc7 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:55.023295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c56a024-b6f9-48b4-8c00-e78d9849bdc7 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:55.061921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:55.224099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fb30b35c-4a74-4151-8d10-b31302653560 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:55.235888 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fb30b35c-4a74-4151-8d10-b31302653560 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.368430 Oct 10 23:21:55.236974 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 743/1470] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:54 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:21:55.286001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3c56a024-b6f9-48b4-8c00-e78d9849bdc7 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:55.298811 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3c56a024-b6f9-48b4-8c00-e78d9849bdc7 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1319 microversion: 2.1 time: 0.314153 Oct 10 23:21:55.299847 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 728/1471] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:54 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:21:55.309259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-0f03ce5a-c1f7-4fd4-8d0f-08906da373ab req-bdde645c-efa2-4da2-ad94-7e3e5dab9dda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cc20e4-bd05-44fc-931c-ddffba1494e6", "name": "network-vif-unplugged", "status": "completed", "tag": "9cd0c0df-842e-4355-8798-be1d34e79325"}, {"name": "network-changed", "server_uuid": "90cc20e4-bd05-44fc-931c-ddffba1494e6", "tag": "9cd0c0df-842e-4355-8798-be1d34e79325"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:21:55.320450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0f03ce5a-c1f7-4fd4-8d0f-08906da373ab req-bdde645c-efa2-4da2-ad94-7e3e5dab9dda service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:55.321270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0f03ce5a-c1f7-4fd4-8d0f-08906da373ab req-bdde645c-efa2-4da2-ad94-7e3e5dab9dda service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:55.321751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0f03ce5a-c1f7-4fd4-8d0f-08906da373ab req-bdde645c-efa2-4da2-ad94-7e3e5dab9dda service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:55.333739 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-0f03ce5a-c1f7-4fd4-8d0f-08906da373ab req-bdde645c-efa2-4da2-ad94-7e3e5dab9dda service nova] Creating event network-vif-unplugged:9cd0c0df-842e-4355-8798-be1d34e79325 for instance 90cc20e4-bd05-44fc-931c-ddffba1494e6 on n-h2-860864-2 Oct 10 23:21:55.334247 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-0f03ce5a-c1f7-4fd4-8d0f-08906da373ab req-bdde645c-efa2-4da2-ad94-7e3e5dab9dda service nova] Creating event network-changed:9cd0c0df-842e-4355-8798-be1d34e79325 for instance 90cc20e4-bd05-44fc-931c-ddffba1494e6 on n-h2-860864-2 Oct 10 23:21:55.339913 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-0f03ce5a-c1f7-4fd4-8d0f-08906da373ab req-bdde645c-efa2-4da2-ad94-7e3e5dab9dda service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.036407 Oct 10 23:21:55.350198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6866858f-7c63-4866-abd0-f883ae29045a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:55.350982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6866858f-7c63-4866-abd0-f883ae29045a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:55.354040 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 744/1472] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:55.357825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6866858f-7c63-4866-abd0-f883ae29045a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:55.358682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6866858f-7c63-4866-abd0-f883ae29045a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:55.359279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6866858f-7c63-4866-abd0-f883ae29045a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:55.360176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6866858f-7c63-4866-abd0-f883ae29045a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:55.360804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6866858f-7c63-4866-abd0-f883ae29045a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:55.361427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6866858f-7c63-4866-abd0-f883ae29045a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:55.502753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6866858f-7c63-4866-abd0-f883ae29045a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:55.511143 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6866858f-7c63-4866-abd0-f883ae29045a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1535 microversion: 2.1 time: 0.165033 Oct 10 23:21:55.520350 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 729/1473] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:55 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1535 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:55.573258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8d55cafc-14ca-4fe0-8573-e0c156d8c568 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:55.574203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8d55cafc-14ca-4fe0-8573-e0c156d8c568 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:55.583086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d55cafc-14ca-4fe0-8573-e0c156d8c568 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:55.583730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d55cafc-14ca-4fe0-8573-e0c156d8c568 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:55.584275 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d55cafc-14ca-4fe0-8573-e0c156d8c568 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:55.585139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d55cafc-14ca-4fe0-8573-e0c156d8c568 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:55.585877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d55cafc-14ca-4fe0-8573-e0c156d8c568 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:55.586618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d55cafc-14ca-4fe0-8573-e0c156d8c568 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:55.625666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5f4b0655-4554-4c66-b16a-314b2e62de9e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:55.626384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5f4b0655-4554-4c66-b16a-314b2e62de9e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:55.629632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=24 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:55.648754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f4b0655-4554-4c66-b16a-314b2e62de9e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:55.649287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f4b0655-4554-4c66-b16a-314b2e62de9e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:55.654439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f4b0655-4554-4c66-b16a-314b2e62de9e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:55.655692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f4b0655-4554-4c66-b16a-314b2e62de9e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:55.656711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f4b0655-4554-4c66-b16a-314b2e62de9e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:55.656711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f4b0655-4554-4c66-b16a-314b2e62de9e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:55.799754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5f4b0655-4554-4c66-b16a-314b2e62de9e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:55.813958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5f4b0655-4554-4c66-b16a-314b2e62de9e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:55.815454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5f4b0655-4554-4c66-b16a-314b2e62de9e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:55.816684 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5f4b0655-4554-4c66-b16a-314b2e62de9e tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1357 microversion: 2.57 time: 0.197364 Oct 10 23:21:55.817520 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 730/1474] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:55 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:21:55.847820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c8b43b23-117c-40d3-b039-68f498e84b8b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:55.848330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c8b43b23-117c-40d3-b039-68f498e84b8b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:55.855490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8b43b23-117c-40d3-b039-68f498e84b8b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:55.856099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8b43b23-117c-40d3-b039-68f498e84b8b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:55.856554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8b43b23-117c-40d3-b039-68f498e84b8b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:55.858276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8b43b23-117c-40d3-b039-68f498e84b8b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:55.858744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8b43b23-117c-40d3-b039-68f498e84b8b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:55.859326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8b43b23-117c-40d3-b039-68f498e84b8b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:55.864455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8d55cafc-14ca-4fe0-8573-e0c156d8c568 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:55.874288 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8d55cafc-14ca-4fe0-8573-e0c156d8c568 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d" status: 200 len: 1394 microversion: 2.1 time: 0.305695 Oct 10 23:21:55.885714 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 745/1475] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:55 2022] GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d => generated 1394 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:55.894547 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c8b43b23-117c-40d3-b039-68f498e84b8b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:21:55.947617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-99102bc0-c8bb-4756-a339-7fc3eeb7f078 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:55.948479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-99102bc0-c8bb-4756-a339-7fc3eeb7f078 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: a6ae5edf-fc2a-431a-9360-201b079daf30] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:55.959143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99102bc0-c8bb-4756-a339-7fc3eeb7f078 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:55.959891 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99102bc0-c8bb-4756-a339-7fc3eeb7f078 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:55.960933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99102bc0-c8bb-4756-a339-7fc3eeb7f078 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:55.962712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99102bc0-c8bb-4756-a339-7fc3eeb7f078 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:55.964073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99102bc0-c8bb-4756-a339-7fc3eeb7f078 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:55.964685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99102bc0-c8bb-4756-a339-7fc3eeb7f078 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:55.981070 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-99102bc0-c8bb-4756-a339-7fc3eeb7f078 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] HTTP exception thrown: Instance a6ae5edf-fc2a-431a-9360-201b079daf30 could not be found. Oct 10 23:21:55.996494 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-99102bc0-c8bb-4756-a339-7fc3eeb7f078 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Request method failure captured: Oct 10 23:21:55.996494 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/a6ae5edf-fc2a-431a-9360-201b079daf30 HTTP/1.1 Oct 10 23:21:55.996494 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:21:55.996494 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:21:55.996494 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:21:55.996494 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:21:55.996494 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:21:55.996494 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:21:55.996494 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:21:55.996494 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:55.996494 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKjx3jMXRlRrSvJ4nRado7qCxEAEXtHBTD0nf8TkZrnPWf4ckLhofTCdip-rxjJzZ2jSyLCsgqwxIRzYmkZzYLqIpXnn8Wn6VX_JnDnprgNgDMAsUTcuzzvjyjt3VjOnLn8YfRsTMfPO-sekgn8IkCCfpBByfME3B3Ja43Jkmt2Ax4M Oct 10 23:21:55.996494 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:21:55.996494 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:21:55.996494 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:21:55.996494 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:21:55.996494 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:21:55.996494 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:21:55.996494 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 17a9f7ea82a145a4bc4cf562a82a0a90 Oct 10 23:21:55.996494 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:21:55.996494 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:21:55.996494 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:21:55.998818 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17a9f7ea82a145a4bc4cf562a82a0a90", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:55.998818 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:21:55.998818 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 17a9f7ea82a145a4bc4cf562a82a0a90 Oct 10 23:21:55.998818 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:21:55.998818 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ListServersNegativeTestJSON-1842684533-project Oct 10 23:21:55.998818 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:21:55.998818 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:21:55.998818 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 6c0345d40e024645a2c7bf9d1ae09b36 Oct 10 23:21:55.998818 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ListServersNegativeTestJSON-1842684533-project Oct 10 23:21:55.998818 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:21:55.998818 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance a6ae5edf-fc2a-431a-9360-201b079daf30 could not be found. Oct 10 23:21:55.998818 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'a6ae5edf-fc2a-431a-9360-201b079daf30'} Oct 10 23:21:55.999715 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:55.999715 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:55.999715 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:21:55.999715 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:21:55.999715 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:21:55.999715 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:21:55.999715 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:21:55.999715 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:21:55.999715 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:21:55.999715 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:21:55.999715 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6ae5edf-fc2a-431a-9360-201b079daf30 could not be found. Oct 10 23:21:55.999715 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:55.999715 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:55.999715 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:55.999715 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:55.999715 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:55.999715 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:55.999715 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:55.999715 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:55.999715 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:56.001445 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:56.001445 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:21:56.001445 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:21:56.001445 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:21:56.001445 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:21:56.001445 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:21:56.001445 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:21:56.001445 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6ae5edf-fc2a-431a-9360-201b079daf30 could not be found. Oct 10 23:21:56.001445 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.001445 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:56.001445 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.001445 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:56.001445 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:56.001445 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:56.001445 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:21:56.001445 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:21:56.001445 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6ae5edf-fc2a-431a-9360-201b079daf30 could not be found. Oct 10 23:21:56.001445 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.003795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-99102bc0-c8bb-4756-a339-7fc3eeb7f078 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Returning 404 to user: Instance a6ae5edf-fc2a-431a-9360-201b079daf30 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:56.003795 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-99102bc0-c8bb-4756-a339-7fc3eeb7f078 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/a6ae5edf-fc2a-431a-9360-201b079daf30" status: 404 len: 111 microversion: 2.1 time: 0.058625 Oct 10 23:21:56.003795 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 746/1476] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:55 2022] GET /compute/v2.1/servers/a6ae5edf-fc2a-431a-9360-201b079daf30 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:21:56.017017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3651d5a8-ca92-431d-be08-3a7011f987e8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:56.022844 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c8b43b23-117c-40d3-b039-68f498e84b8b tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 204 len: 0 microversion: 2.57 time: 0.178843 Oct 10 23:21:56.023245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3651d5a8-ca92-431d-be08-3a7011f987e8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:56.024353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3651d5a8-ca92-431d-be08-3a7011f987e8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:21:56.027852 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 731/1477] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:21:55 2022] DELETE /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:21:56.031393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3651d5a8-ca92-431d-be08-3a7011f987e8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:56.032100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3651d5a8-ca92-431d-be08-3a7011f987e8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:56.033758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3651d5a8-ca92-431d-be08-3a7011f987e8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:56.034717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3651d5a8-ca92-431d-be08-3a7011f987e8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:56.035253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3651d5a8-ca92-431d-be08-3a7011f987e8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:56.035759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3651d5a8-ca92-431d-be08-3a7011f987e8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:56.036247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bb44e9ed-ef7e-430d-a791-26cc15cbbd82 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:56.037385 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bb44e9ed-ef7e-430d-a791-26cc15cbbd82 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:56.046410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb44e9ed-ef7e-430d-a791-26cc15cbbd82 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:56.046911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb44e9ed-ef7e-430d-a791-26cc15cbbd82 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:56.047422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb44e9ed-ef7e-430d-a791-26cc15cbbd82 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:56.048183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb44e9ed-ef7e-430d-a791-26cc15cbbd82 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:56.048645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb44e9ed-ef7e-430d-a791-26cc15cbbd82 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:56.049117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb44e9ed-ef7e-430d-a791-26cc15cbbd82 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:56.131462 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3651d5a8-ca92-431d-be08-3a7011f987e8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.122299 Oct 10 23:21:56.132647 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 747/1478] 10.222.0.23 () {58 vars in 1230 bytes} [Mon Oct 10 23:21:56 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:21:56.138301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bb44e9ed-ef7e-430d-a791-26cc15cbbd82 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:56.147383 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fc23f9b7-c305-4d1f-a084-b75b10da017a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:56.151475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fc23f9b7-c305-4d1f-a084-b75b10da017a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Request method failure captured: Oct 10 23:21:56.151475 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 10 23:21:56.151475 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:21:56.151475 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:21:56.151475 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:21:56.151475 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:21:56.151475 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:21:56.151475 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:21:56.151475 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:21:56.151475 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:56.151475 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKjx3jMXRlRrSvJ4nRado7qCxEAEXtHBTD0nf8TkZrnPWf4ckLhofTCdip-rxjJzZ2jSyLCsgqwxIRzYmkZzYLqIpXnn8Wn6VX_JnDnprgNgDMAsUTcuzzvjyjt3VjOnLn8YfRsTMfPO-sekgn8IkCCfpBByfME3B3Ja43Jkmt2Ax4M Oct 10 23:21:56.151475 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:21:56.151475 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:21:56.151475 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:21:56.151475 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:21:56.151475 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:21:56.151475 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:21:56.151475 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 17a9f7ea82a145a4bc4cf562a82a0a90 Oct 10 23:21:56.151475 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:21:56.151475 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:21:56.151475 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:21:56.153183 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17a9f7ea82a145a4bc4cf562a82a0a90", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:56.153183 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:21:56.153183 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 17a9f7ea82a145a4bc4cf562a82a0a90 Oct 10 23:21:56.153183 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:21:56.153183 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ListServersNegativeTestJSON-1842684533-project Oct 10 23:21:56.153183 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:21:56.153183 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:21:56.153183 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 6c0345d40e024645a2c7bf9d1ae09b36 Oct 10 23:21:56.153183 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ListServersNegativeTestJSON-1842684533-project Oct 10 23:21:56.153183 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:21:56.153183 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 10 23:21:56.153183 n-d-860864-2 devstack@n-api.service[120614]: action_args: {} Oct 10 23:21:56.154180 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:56.154180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:56.154180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:21:56.154180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:21:56.154180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:21:56.154180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:21:56.154180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 10 23:21:56.154180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.154180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 10 23:21:56.154180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 10 23:21:56.154180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.154180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 10 23:21:56.154180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 10 23:21:56.154180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.154180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:56.154180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.154180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:56.154180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:56.154180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:56.154180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:56.154180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:56.154180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:56.154180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:56.155971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 23:21:56.155971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:21:56.155971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 23:21:56.155971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:21:56.155971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 23:21:56.155971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:21:56.155971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 10 23:21:56.155971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 10 23:21:56.155971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 10 23:21:56.155971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:21:56.155971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:21:56.155971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:21:56.155971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:21:56.155971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 10 23:21:56.155971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.155971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:56.155971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.155971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:56.155971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:56.155971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:56.157565 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:21:56.157565 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:21:56.157565 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 10 23:21:56.157565 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.158163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bb44e9ed-ef7e-430d-a791-26cc15cbbd82 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:56.159088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fc23f9b7-c305-4d1f-a084-b75b10da017a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:56.160083 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fc23f9b7-c305-4d1f-a084-b75b10da017a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.017666 Oct 10 23:21:56.160736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bb44e9ed-ef7e-430d-a791-26cc15cbbd82 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:56.160976 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 748/1479] 10.222.0.23 () {58 vars in 1182 bytes} [Mon Oct 10 23:21:56 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 23:21:56.162909 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bb44e9ed-ef7e-430d-a791-26cc15cbbd82 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1363 microversion: 2.57 time: 0.132923 Oct 10 23:21:56.169414 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 732/1480] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:56 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1363 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:56.182539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c89e3654-f13c-4d82-b35a-36c0ccd643e8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:56.188696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c89e3654-f13c-4d82-b35a-36c0ccd643e8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:56.190086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c89e3654-f13c-4d82-b35a-36c0ccd643e8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Searching by: {'deleted': False, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:21:56.195862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c89e3654-f13c-4d82-b35a-36c0ccd643e8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:56.196460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c89e3654-f13c-4d82-b35a-36c0ccd643e8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:56.196904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c89e3654-f13c-4d82-b35a-36c0ccd643e8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:56.197956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c89e3654-f13c-4d82-b35a-36c0ccd643e8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:56.198183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c89e3654-f13c-4d82-b35a-36c0ccd643e8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:56.198588 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c89e3654-f13c-4d82-b35a-36c0ccd643e8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:56.261789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7891a9c2-9de4-423b-9f59-0ba958b1defd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:56.262769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7891a9c2-9de4-423b-9f59-0ba958b1defd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:56.269866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7891a9c2-9de4-423b-9f59-0ba958b1defd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:56.271769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7891a9c2-9de4-423b-9f59-0ba958b1defd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:56.272426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7891a9c2-9de4-423b-9f59-0ba958b1defd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:56.273493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7891a9c2-9de4-423b-9f59-0ba958b1defd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:56.274178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7891a9c2-9de4-423b-9f59-0ba958b1defd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:56.274805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7891a9c2-9de4-423b-9f59-0ba958b1defd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:56.298795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.multi_cell_list [None req-c89e3654-f13c-4d82-b35a-36c0ccd643e8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:21:56.376412 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c89e3654-f13c-4d82-b35a-36c0ccd643e8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.197707 Oct 10 23:21:56.377188 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 749/1481] 10.222.0.23 () {58 vars in 1125 bytes} [Mon Oct 10 23:21:56 2022] GET /compute/v2.1/servers => generated 681 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:56.381952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f212672e-1b91-4e64-b6bf-1ea7502c7cb0 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:56.382564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f212672e-1b91-4e64-b6bf-1ea7502c7cb0 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:56.391275 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f212672e-1b91-4e64-b6bf-1ea7502c7cb0 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:56.391770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f212672e-1b91-4e64-b6bf-1ea7502c7cb0 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:56.392266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f212672e-1b91-4e64-b6bf-1ea7502c7cb0 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:56.393957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f212672e-1b91-4e64-b6bf-1ea7502c7cb0 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:56.394483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f212672e-1b91-4e64-b6bf-1ea7502c7cb0 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:56.396029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f212672e-1b91-4e64-b6bf-1ea7502c7cb0 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:56.535650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f212672e-1b91-4e64-b6bf-1ea7502c7cb0 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:56.544222 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f212672e-1b91-4e64-b6bf-1ea7502c7cb0 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1319 microversion: 2.1 time: 0.165772 Oct 10 23:21:56.545568 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 750/1482] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:56 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:56.550104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b102cce8-f768-4b6b-9a42-b9befa43ba7b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:56.555070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b102cce8-f768-4b6b-9a42-b9befa43ba7b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:56.555506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.compute.servers [None req-b102cce8-f768-4b6b-9a42-b9befa43ba7b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Removing options 'limit' from query {{(pid=120614) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 10 23:21:56.556324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b102cce8-f768-4b6b-9a42-b9befa43ba7b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Searching by: {'deleted': False, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:21:56.562714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b102cce8-f768-4b6b-9a42-b9befa43ba7b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:56.563190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b102cce8-f768-4b6b-9a42-b9befa43ba7b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:56.563622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b102cce8-f768-4b6b-9a42-b9befa43ba7b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:56.564364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b102cce8-f768-4b6b-9a42-b9befa43ba7b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:56.564813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b102cce8-f768-4b6b-9a42-b9befa43ba7b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:56.565231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b102cce8-f768-4b6b-9a42-b9befa43ba7b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:56.570872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7891a9c2-9de4-423b-9f59-0ba958b1defd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:56.580929 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7891a9c2-9de4-423b-9f59-0ba958b1defd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.324964 Oct 10 23:21:56.581891 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 733/1483] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:56 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:21:56.586629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-342e5a4d-5d94-4cc3-9a90-edce601cec7b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:56.587230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-342e5a4d-5d94-4cc3-9a90-edce601cec7b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:56.593838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-342e5a4d-5d94-4cc3-9a90-edce601cec7b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:56.594509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-342e5a4d-5d94-4cc3-9a90-edce601cec7b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:56.595120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-342e5a4d-5d94-4cc3-9a90-edce601cec7b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:56.596627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-342e5a4d-5d94-4cc3-9a90-edce601cec7b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:56.597237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-342e5a4d-5d94-4cc3-9a90-edce601cec7b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:56.597583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.multi_cell_list [None req-b102cce8-f768-4b6b-9a42-b9befa43ba7b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:21:56.597982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-342e5a4d-5d94-4cc3-9a90-edce601cec7b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:56.626523 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b102cce8-f768-4b6b-9a42-b9befa43ba7b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.079825 Oct 10 23:21:56.627109 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 751/1484] 10.222.0.23 () {58 vars in 1144 bytes} [Mon Oct 10 23:21:56 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:56.640489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bdd28cdc-fbf3-416d-b9fe-65c2091347c8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:56.644655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bdd28cdc-fbf3-416d-b9fe-65c2091347c8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Request method failure captured: Oct 10 23:21:56.644655 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 10 23:21:56.644655 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:21:56.644655 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:21:56.644655 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:21:56.644655 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:21:56.644655 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:21:56.644655 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:21:56.644655 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:21:56.644655 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:56.644655 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKjx3jMXRlRrSvJ4nRado7qCxEAEXtHBTD0nf8TkZrnPWf4ckLhofTCdip-rxjJzZ2jSyLCsgqwxIRzYmkZzYLqIpXnn8Wn6VX_JnDnprgNgDMAsUTcuzzvjyjt3VjOnLn8YfRsTMfPO-sekgn8IkCCfpBByfME3B3Ja43Jkmt2Ax4M Oct 10 23:21:56.644655 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:21:56.644655 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:21:56.644655 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:21:56.644655 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:21:56.644655 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:21:56.644655 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:21:56.644655 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 17a9f7ea82a145a4bc4cf562a82a0a90 Oct 10 23:21:56.644655 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:21:56.644655 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:21:56.644655 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:21:56.646449 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17a9f7ea82a145a4bc4cf562a82a0a90", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:56.646449 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:21:56.646449 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 17a9f7ea82a145a4bc4cf562a82a0a90 Oct 10 23:21:56.646449 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:21:56.646449 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ListServersNegativeTestJSON-1842684533-project Oct 10 23:21:56.646449 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:21:56.646449 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:21:56.646449 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 6c0345d40e024645a2c7bf9d1ae09b36 Oct 10 23:21:56.646449 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ListServersNegativeTestJSON-1842684533-project Oct 10 23:21:56.646449 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:21:56.646449 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 10 23:21:56.646449 n-d-860864-2 devstack@n-api.service[120614]: action_args: {} Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi '-1' Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:56.647513 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:56.649348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:56.649348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:56.649348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 23:21:56.649348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:21:56.649348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 23:21:56.649348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:21:56.649348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 23:21:56.649348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:21:56.649348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 10 23:21:56.649348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 10 23:21:56.649348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 10 23:21:56.649348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:21:56.649348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:21:56.649348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:21:56.649348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:21:56.649348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 10 23:21:56.649348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.649348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:56.649348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.649348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:56.650847 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:56.650847 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:56.650847 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:21:56.650847 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:21:56.650847 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 10 23:21:56.650847 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.650847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bdd28cdc-fbf3-416d-b9fe-65c2091347c8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:56.650847 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bdd28cdc-fbf3-416d-b9fe-65c2091347c8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.010145 Oct 10 23:21:56.650847 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 752/1485] 10.222.0.23 () {58 vars in 1142 bytes} [Mon Oct 10 23:21:56 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 23:21:56.660850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-00e9a7b0-8c5d-4f2b-8bd6-0c931b060b8b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:56.664815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-00e9a7b0-8c5d-4f2b-8bd6-0c931b060b8b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Request method failure captured: Oct 10 23:21:56.664815 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 10 23:21:56.664815 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:21:56.664815 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:21:56.664815 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:21:56.664815 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:21:56.664815 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:21:56.664815 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:21:56.664815 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:21:56.664815 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:56.664815 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKjx3jMXRlRrSvJ4nRado7qCxEAEXtHBTD0nf8TkZrnPWf4ckLhofTCdip-rxjJzZ2jSyLCsgqwxIRzYmkZzYLqIpXnn8Wn6VX_JnDnprgNgDMAsUTcuzzvjyjt3VjOnLn8YfRsTMfPO-sekgn8IkCCfpBByfME3B3Ja43Jkmt2Ax4M Oct 10 23:21:56.664815 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:21:56.664815 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:21:56.664815 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:21:56.664815 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:21:56.664815 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:21:56.664815 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:21:56.664815 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 17a9f7ea82a145a4bc4cf562a82a0a90 Oct 10 23:21:56.664815 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:21:56.664815 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:21:56.664815 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:21:56.666559 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17a9f7ea82a145a4bc4cf562a82a0a90", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:56.666559 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:21:56.666559 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 17a9f7ea82a145a4bc4cf562a82a0a90 Oct 10 23:21:56.666559 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:21:56.666559 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ListServersNegativeTestJSON-1842684533-project Oct 10 23:21:56.666559 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:21:56.666559 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:21:56.666559 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 6c0345d40e024645a2c7bf9d1ae09b36 Oct 10 23:21:56.666559 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ListServersNegativeTestJSON-1842684533-project Oct 10 23:21:56.666559 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:21:56.666559 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 10 23:21:56.666559 n-d-860864-2 devstack@n-api.service[120614]: action_args: {} Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'testing' Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:56.668037 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:56.669958 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:56.669958 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:56.669958 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 23:21:56.669958 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:21:56.669958 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 23:21:56.669958 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:21:56.669958 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 23:21:56.669958 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:21:56.669958 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 10 23:21:56.669958 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 10 23:21:56.669958 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 10 23:21:56.669958 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:21:56.669958 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:21:56.669958 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:21:56.669958 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:21:56.669958 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 10 23:21:56.669958 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.669958 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:56.669958 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.669958 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:56.671503 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:56.671503 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:56.671503 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:21:56.671503 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:21:56.671503 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 10 23:21:56.671503 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:56.671503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-00e9a7b0-8c5d-4f2b-8bd6-0c931b060b8b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:56.671503 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-00e9a7b0-8c5d-4f2b-8bd6-0c931b060b8b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.013018 Oct 10 23:21:56.672932 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 753/1486] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:21:56 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 23:21:56.678641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dafd4d82-ded8-41d0-b3d6-6fb92cea0ce7 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:56.684492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dafd4d82-ded8-41d0-b3d6-6fb92cea0ce7 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:56.685192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dafd4d82-ded8-41d0-b3d6-6fb92cea0ce7 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:21:56.693688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.compute.servers [None req-dafd4d82-ded8-41d0-b3d6-6fb92cea0ce7 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Flavor 'non_existing_flavor' could not be found {{(pid=120614) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 10 23:21:56.695400 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dafd4d82-ded8-41d0-b3d6-6fb92cea0ce7 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.021197 Oct 10 23:21:56.696359 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 754/1487] 10.222.0.23 () {58 vars in 1178 bytes} [Mon Oct 10 23:21:56 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:21:56.710681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7045f632-54ea-4be0-8b3a-c76d1bab3535 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:56.715382 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7045f632-54ea-4be0-8b3a-c76d1bab3535 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:56.716041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7045f632-54ea-4be0-8b3a-c76d1bab3535 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:21:56.722113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7045f632-54ea-4be0-8b3a-c76d1bab3535 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:56.722589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7045f632-54ea-4be0-8b3a-c76d1bab3535 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:56.723019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7045f632-54ea-4be0-8b3a-c76d1bab3535 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:56.723806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7045f632-54ea-4be0-8b3a-c76d1bab3535 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:56.724259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7045f632-54ea-4be0-8b3a-c76d1bab3535 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:56.724691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7045f632-54ea-4be0-8b3a-c76d1bab3535 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:56.808740 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7045f632-54ea-4be0-8b3a-c76d1bab3535 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.101606 Oct 10 23:21:56.809854 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 755/1488] 10.222.0.23 () {58 vars in 1174 bytes} [Mon Oct 10 23:21:56 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 23:21:56.827794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d85c77dd-f338-466b-b793-1bb5d71188df tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:56.833152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d85c77dd-f338-466b-b793-1bb5d71188df tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:56.833879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d85c77dd-f338-466b-b793-1bb5d71188df tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:21:56.838127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-342e5a4d-5d94-4cc3-9a90-edce601cec7b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:56.842174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d85c77dd-f338-466b-b793-1bb5d71188df tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:56.842860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d85c77dd-f338-466b-b793-1bb5d71188df tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:56.843467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d85c77dd-f338-466b-b793-1bb5d71188df tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:56.844384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d85c77dd-f338-466b-b793-1bb5d71188df tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:56.845673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d85c77dd-f338-466b-b793-1bb5d71188df tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:56.846508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d85c77dd-f338-466b-b793-1bb5d71188df tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:56.851411 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-342e5a4d-5d94-4cc3-9a90-edce601cec7b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1535 microversion: 2.1 time: 0.268064 Oct 10 23:21:56.865403 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 734/1489] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:56 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1535 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:56.901263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0144d369-188b-49d3-b3fc-ce69de06f9f0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:56.902388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0144d369-188b-49d3-b3fc-ce69de06f9f0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:56.912800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0144d369-188b-49d3-b3fc-ce69de06f9f0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:56.913420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0144d369-188b-49d3-b3fc-ce69de06f9f0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:56.913991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0144d369-188b-49d3-b3fc-ce69de06f9f0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:56.914802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0144d369-188b-49d3-b3fc-ce69de06f9f0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:56.915602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0144d369-188b-49d3-b3fc-ce69de06f9f0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:56.916154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0144d369-188b-49d3-b3fc-ce69de06f9f0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:56.945947 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d85c77dd-f338-466b-b793-1bb5d71188df tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.127561 Oct 10 23:21:56.946846 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 756/1490] 10.222.0.23 () {58 vars in 1184 bytes} [Mon Oct 10 23:21:56 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:21:56.960796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0ae42fd7-985d-4a22-a872-1ac68403350d tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:56.967248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0ae42fd7-985d-4a22-a872-1ac68403350d tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:56.968544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0ae42fd7-985d-4a22-a872-1ac68403350d tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Searching by: {'deleted': False, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:21:56.976369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ae42fd7-985d-4a22-a872-1ac68403350d tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:56.976853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ae42fd7-985d-4a22-a872-1ac68403350d tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:56.977281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ae42fd7-985d-4a22-a872-1ac68403350d tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:56.978053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ae42fd7-985d-4a22-a872-1ac68403350d tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:56.978657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ae42fd7-985d-4a22-a872-1ac68403350d tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:56.979084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ae42fd7-985d-4a22-a872-1ac68403350d tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:57.009475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.multi_cell_list [None req-0ae42fd7-985d-4a22-a872-1ac68403350d tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:21:57.103633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0ae42fd7-985d-4a22-a872-1ac68403350d tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:57.111326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ae42fd7-985d-4a22-a872-1ac68403350d tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:57.111820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ae42fd7-985d-4a22-a872-1ac68403350d tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:57.112257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ae42fd7-985d-4a22-a872-1ac68403350d tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:57.249425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0144d369-188b-49d3-b3fc-ce69de06f9f0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:57.254358 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0ae42fd7-985d-4a22-a872-1ac68403350d tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.298792 Oct 10 23:21:57.255355 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 757/1491] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:21:56 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:57.258573 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0144d369-188b-49d3-b3fc-ce69de06f9f0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d" status: 200 len: 1394 microversion: 2.1 time: 0.362051 Oct 10 23:21:57.259151 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 735/1492] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:56 2022] GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d => generated 1394 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:21:57.269936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-45676a51-f3cd-4935-bcce-6098ec8e66d9 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:57.270562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-45676a51-f3cd-4935-bcce-6098ec8e66d9 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:57.278484 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45676a51-f3cd-4935-bcce-6098ec8e66d9 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:57.279950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45676a51-f3cd-4935-bcce-6098ec8e66d9 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:57.280535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45676a51-f3cd-4935-bcce-6098ec8e66d9 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:57.281249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45676a51-f3cd-4935-bcce-6098ec8e66d9 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:57.281739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45676a51-f3cd-4935-bcce-6098ec8e66d9 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:57.282172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45676a51-f3cd-4935-bcce-6098ec8e66d9 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:57.283616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-800d31c2-d89c-4e93-8bab-6afc4c0c0f35 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:57.289328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-800d31c2-d89c-4e93-8bab-6afc4c0c0f35 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:57.290657 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-800d31c2-d89c-4e93-8bab-6afc4c0c0f35 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.012273 Oct 10 23:21:57.291422 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 736/1493] 10.222.0.23 () {58 vars in 1178 bytes} [Mon Oct 10 23:21:57 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 23:21:57.305925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b65d3e62-c759-47d9-8091-cd006a905d95 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:57.313574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b65d3e62-c759-47d9-8091-cd006a905d95 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:57.315087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b65d3e62-c759-47d9-8091-cd006a905d95 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Searching by: {'deleted': False, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90'} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:21:57.322565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b65d3e62-c759-47d9-8091-cd006a905d95 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:57.323394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b65d3e62-c759-47d9-8091-cd006a905d95 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:57.324075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b65d3e62-c759-47d9-8091-cd006a905d95 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:57.325875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b65d3e62-c759-47d9-8091-cd006a905d95 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:57.326910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b65d3e62-c759-47d9-8091-cd006a905d95 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:57.327689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b65d3e62-c759-47d9-8091-cd006a905d95 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:57.363373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-45676a51-f3cd-4935-bcce-6098ec8e66d9 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:57.364561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.multi_cell_list [None req-b65d3e62-c759-47d9-8091-cd006a905d95 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120613) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:21:57.373252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-45676a51-f3cd-4935-bcce-6098ec8e66d9 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:57.376514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-45676a51-f3cd-4935-bcce-6098ec8e66d9 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:57.377943 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-45676a51-f3cd-4935-bcce-6098ec8e66d9 tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1363 microversion: 2.57 time: 0.121773 Oct 10 23:21:57.394115 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 758/1494] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:57 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1363 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:57.404358 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b65d3e62-c759-47d9-8091-cd006a905d95 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.102349 Oct 10 23:21:57.405012 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 737/1495] 10.222.0.23 () {58 vars in 1125 bytes} [Mon Oct 10 23:21:57 2022] GET /compute/v2.1/servers => generated 681 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:21:57.419996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-15b28c65-2bb1-4526-9031-1f9f03209eeb tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:57.420452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-15b28c65-2bb1-4526-9031-1f9f03209eeb tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: a6ae5edf-fc2a-431a-9360-201b079daf30] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:57.427344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:57.429129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15b28c65-2bb1-4526-9031-1f9f03209eeb tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:57.430558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15b28c65-2bb1-4526-9031-1f9f03209eeb tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:57.430709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15b28c65-2bb1-4526-9031-1f9f03209eeb tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:57.431631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15b28c65-2bb1-4526-9031-1f9f03209eeb tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:57.432170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15b28c65-2bb1-4526-9031-1f9f03209eeb tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:57.433200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15b28c65-2bb1-4526-9031-1f9f03209eeb tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:57.449939 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-15b28c65-2bb1-4526-9031-1f9f03209eeb tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] HTTP exception thrown: Instance a6ae5edf-fc2a-431a-9360-201b079daf30 could not be found. Oct 10 23:21:57.452311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-15b28c65-2bb1-4526-9031-1f9f03209eeb tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Request method failure captured: Oct 10 23:21:57.452311 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/a6ae5edf-fc2a-431a-9360-201b079daf30 HTTP/1.1 Oct 10 23:21:57.452311 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:21:57.452311 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:21:57.452311 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:21:57.452311 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:21:57.452311 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:21:57.452311 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:21:57.452311 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:21:57.452311 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:57.452311 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKjx3jMXRlRrSvJ4nRado7qCxEAEXtHBTD0nf8TkZrnPWf4ckLhofTCdip-rxjJzZ2jSyLCsgqwxIRzYmkZzYLqIpXnn8Wn6VX_JnDnprgNgDMAsUTcuzzvjyjt3VjOnLn8YfRsTMfPO-sekgn8IkCCfpBByfME3B3Ja43Jkmt2Ax4M Oct 10 23:21:57.452311 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:21:57.452311 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:21:57.452311 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:21:57.452311 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:21:57.452311 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:21:57.452311 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:21:57.452311 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 17a9f7ea82a145a4bc4cf562a82a0a90 Oct 10 23:21:57.452311 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:21:57.452311 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:21:57.452311 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:21:57.454314 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17a9f7ea82a145a4bc4cf562a82a0a90", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:57.454314 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:21:57.454314 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 17a9f7ea82a145a4bc4cf562a82a0a90 Oct 10 23:21:57.454314 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:21:57.454314 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ListServersNegativeTestJSON-1842684533-project Oct 10 23:21:57.454314 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:21:57.454314 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:21:57.454314 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 6c0345d40e024645a2c7bf9d1ae09b36 Oct 10 23:21:57.454314 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ListServersNegativeTestJSON-1842684533-project Oct 10 23:21:57.454314 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:21:57.454314 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance a6ae5edf-fc2a-431a-9360-201b079daf30 could not be found. Oct 10 23:21:57.454314 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'a6ae5edf-fc2a-431a-9360-201b079daf30'} Oct 10 23:21:57.455332 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:57.455332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:57.455332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:21:57.455332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:21:57.455332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:21:57.455332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:21:57.455332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:21:57.455332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:21:57.455332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:21:57.455332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:21:57.455332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6ae5edf-fc2a-431a-9360-201b079daf30 could not be found. Oct 10 23:21:57.455332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:57.455332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:57.455332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:57.455332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:57.455332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:57.455332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:57.455332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:57.455332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:57.455332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:57.456976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:57.456976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:21:57.456976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:21:57.456976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:21:57.456976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:21:57.456976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:21:57.456976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:21:57.456976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:21:57.456976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:21:57.456976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6ae5edf-fc2a-431a-9360-201b079daf30 could not be found. Oct 10 23:21:57.456976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:57.456976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:57.456976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:57.456976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:57.456976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:57.456976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:57.456976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:21:57.456976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:21:57.456976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6ae5edf-fc2a-431a-9360-201b079daf30 could not be found. Oct 10 23:21:57.456976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:57.461938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-15b28c65-2bb1-4526-9031-1f9f03209eeb tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Returning 404 to user: Instance a6ae5edf-fc2a-431a-9360-201b079daf30 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:57.461938 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-15b28c65-2bb1-4526-9031-1f9f03209eeb tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a6ae5edf-fc2a-431a-9360-201b079daf30" status: 404 len: 111 microversion: 2.1 time: 0.040196 Oct 10 23:21:57.461938 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 759/1496] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:21:57 2022] DELETE /compute/v2.1/servers/a6ae5edf-fc2a-431a-9360-201b079daf30 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:21:57.465580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ac220303-ee85-4498-9e19-f10dd7375ace tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:57.466287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ac220303-ee85-4498-9e19-f10dd7375ace tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: 2391b441-47e3-4bf3-b134-3aa316543f10] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:57.474401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac220303-ee85-4498-9e19-f10dd7375ace tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:57.474888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac220303-ee85-4498-9e19-f10dd7375ace tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:57.475324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac220303-ee85-4498-9e19-f10dd7375ace tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:57.476027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac220303-ee85-4498-9e19-f10dd7375ace tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:57.476667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac220303-ee85-4498-9e19-f10dd7375ace tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:57.477093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac220303-ee85-4498-9e19-f10dd7375ace tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:57.481788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:57.510052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ac220303-ee85-4498-9e19-f10dd7375ace tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: 2391b441-47e3-4bf3-b134-3aa316543f10] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:21:57.570332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d68e5b8a-f1ac-481e-878b-8d741c95c4f0 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:57.571383 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d68e5b8a-f1ac-481e-878b-8d741c95c4f0 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:57.580757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d68e5b8a-f1ac-481e-878b-8d741c95c4f0 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:57.581608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d68e5b8a-f1ac-481e-878b-8d741c95c4f0 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:57.582497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d68e5b8a-f1ac-481e-878b-8d741c95c4f0 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:57.583468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d68e5b8a-f1ac-481e-878b-8d741c95c4f0 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:57.584122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d68e5b8a-f1ac-481e-878b-8d741c95c4f0 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:57.584702 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d68e5b8a-f1ac-481e-878b-8d741c95c4f0 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:57.606177 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ac220303-ee85-4498-9e19-f10dd7375ace tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10" status: 204 len: 0 microversion: 2.1 time: 0.144064 Oct 10 23:21:57.606872 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 738/1497] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:21:57 2022] DELETE /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:21:57.613660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7424255a-3503-4c9d-869f-8c315dcd6b62 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:57.614405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7424255a-3503-4c9d-869f-8c315dcd6b62 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:57.620579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7424255a-3503-4c9d-869f-8c315dcd6b62 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:57.621257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7424255a-3503-4c9d-869f-8c315dcd6b62 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:57.622018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7424255a-3503-4c9d-869f-8c315dcd6b62 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:57.623064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7424255a-3503-4c9d-869f-8c315dcd6b62 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:57.623821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7424255a-3503-4c9d-869f-8c315dcd6b62 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:57.624438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7424255a-3503-4c9d-869f-8c315dcd6b62 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:57.790479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d68e5b8a-f1ac-481e-878b-8d741c95c4f0 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:57.807426 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d68e5b8a-f1ac-481e-878b-8d741c95c4f0 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1319 microversion: 2.1 time: 0.244227 Oct 10 23:21:57.808403 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 760/1498] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:57 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:57.823430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4a4a51f8-9265-4b8f-948d-d9c89601debe tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:57.823871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4a4a51f8-9265-4b8f-948d-d9c89601debe tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: d9d0be5f-c878-4a44-8433-56d0d850ea56] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:57.834810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a4a51f8-9265-4b8f-948d-d9c89601debe tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:57.835674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a4a51f8-9265-4b8f-948d-d9c89601debe tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:57.836482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a4a51f8-9265-4b8f-948d-d9c89601debe tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:57.843387 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a4a51f8-9265-4b8f-948d-d9c89601debe tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:57.843878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a4a51f8-9265-4b8f-948d-d9c89601debe tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:57.844367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a4a51f8-9265-4b8f-948d-d9c89601debe tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:57.907189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7424255a-3503-4c9d-869f-8c315dcd6b62 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:57.914785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4a4a51f8-9265-4b8f-948d-d9c89601debe tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: d9d0be5f-c878-4a44-8433-56d0d850ea56] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:21:57.922814 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7424255a-3503-4c9d-869f-8c315dcd6b62 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.313562 Oct 10 23:21:57.923213 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 739/1499] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:57 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:57.945077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-84e8eb36-3557-43a9-bff1-73583b0865a2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:57.945827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-84e8eb36-3557-43a9-bff1-73583b0865a2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:57.964481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84e8eb36-3557-43a9-bff1-73583b0865a2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:57.965724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84e8eb36-3557-43a9-bff1-73583b0865a2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:57.966646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84e8eb36-3557-43a9-bff1-73583b0865a2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:57.968045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84e8eb36-3557-43a9-bff1-73583b0865a2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:57.969303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84e8eb36-3557-43a9-bff1-73583b0865a2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:57.970795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84e8eb36-3557-43a9-bff1-73583b0865a2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:58.059526 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4a4a51f8-9265-4b8f-948d-d9c89601debe tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56" status: 204 len: 0 microversion: 2.1 time: 0.249799 Oct 10 23:21:58.061742 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 761/1500] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:21:57 2022] DELETE /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:21:58.074172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-51753791-6e48-4a1e-80fb-2ec2738e152f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:58.075202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-51753791-6e48-4a1e-80fb-2ec2738e152f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: a6ae5edf-fc2a-431a-9360-201b079daf30] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:58.090417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51753791-6e48-4a1e-80fb-2ec2738e152f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:58.090906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51753791-6e48-4a1e-80fb-2ec2738e152f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:58.091365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51753791-6e48-4a1e-80fb-2ec2738e152f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:58.092818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51753791-6e48-4a1e-80fb-2ec2738e152f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:58.093317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51753791-6e48-4a1e-80fb-2ec2738e152f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:58.093767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51753791-6e48-4a1e-80fb-2ec2738e152f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:58.112827 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-51753791-6e48-4a1e-80fb-2ec2738e152f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] HTTP exception thrown: Instance a6ae5edf-fc2a-431a-9360-201b079daf30 could not be found. Oct 10 23:21:58.115244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-51753791-6e48-4a1e-80fb-2ec2738e152f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Request method failure captured: Oct 10 23:21:58.115244 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/a6ae5edf-fc2a-431a-9360-201b079daf30 HTTP/1.1 Oct 10 23:21:58.115244 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:21:58.115244 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:21:58.115244 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:21:58.115244 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:21:58.115244 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:21:58.115244 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:21:58.115244 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:21:58.115244 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:21:58.115244 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKjx3jMXRlRrSvJ4nRado7qCxEAEXtHBTD0nf8TkZrnPWf4ckLhofTCdip-rxjJzZ2jSyLCsgqwxIRzYmkZzYLqIpXnn8Wn6VX_JnDnprgNgDMAsUTcuzzvjyjt3VjOnLn8YfRsTMfPO-sekgn8IkCCfpBByfME3B3Ja43Jkmt2Ax4M Oct 10 23:21:58.115244 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:21:58.115244 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:21:58.115244 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:21:58.115244 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:21:58.115244 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:21:58.115244 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:21:58.115244 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 17a9f7ea82a145a4bc4cf562a82a0a90 Oct 10 23:21:58.115244 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:21:58.115244 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:21:58.115244 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:21:58.116869 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17a9f7ea82a145a4bc4cf562a82a0a90", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:21:58.116869 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:21:58.116869 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 17a9f7ea82a145a4bc4cf562a82a0a90 Oct 10 23:21:58.116869 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:21:58.116869 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ListServersNegativeTestJSON-1842684533-project Oct 10 23:21:58.116869 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:21:58.116869 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:21:58.116869 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 6c0345d40e024645a2c7bf9d1ae09b36 Oct 10 23:21:58.116869 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ListServersNegativeTestJSON-1842684533-project Oct 10 23:21:58.116869 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:21:58.116869 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance a6ae5edf-fc2a-431a-9360-201b079daf30 could not be found. Oct 10 23:21:58.116869 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'a6ae5edf-fc2a-431a-9360-201b079daf30'} Oct 10 23:21:58.117995 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:21:58.117995 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:58.117995 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:21:58.117995 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:21:58.117995 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:21:58.117995 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:21:58.117995 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:21:58.117995 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:21:58.117995 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:21:58.117995 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:21:58.117995 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6ae5edf-fc2a-431a-9360-201b079daf30 could not be found. Oct 10 23:21:58.117995 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:58.117995 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:58.117995 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:58.117995 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:58.117995 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:58.117995 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:58.117995 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:21:58.117995 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:21:58.117995 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:21:58.119479 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:21:58.119479 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:21:58.119479 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:21:58.119479 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:21:58.119479 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:21:58.119479 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:21:58.119479 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:21:58.119479 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6ae5edf-fc2a-431a-9360-201b079daf30 could not be found. Oct 10 23:21:58.119479 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:58.119479 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:21:58.119479 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:58.119479 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:21:58.119479 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:21:58.119479 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:21:58.119479 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:21:58.119479 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:21:58.119479 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6ae5edf-fc2a-431a-9360-201b079daf30 could not be found. Oct 10 23:21:58.119479 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:21:58.120733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-51753791-6e48-4a1e-80fb-2ec2738e152f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Returning 404 to user: Instance a6ae5edf-fc2a-431a-9360-201b079daf30 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:21:58.120733 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-51753791-6e48-4a1e-80fb-2ec2738e152f tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/a6ae5edf-fc2a-431a-9360-201b079daf30" status: 404 len: 111 microversion: 2.1 time: 0.050248 Oct 10 23:21:58.120733 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 762/1501] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:58 2022] GET /compute/v2.1/servers/a6ae5edf-fc2a-431a-9360-201b079daf30 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:21:58.128409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5284416d-2d4d-484f-91cd-0550603f933a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:58.129094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5284416d-2d4d-484f-91cd-0550603f933a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: 2391b441-47e3-4bf3-b134-3aa316543f10] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:58.137443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5284416d-2d4d-484f-91cd-0550603f933a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:58.137912 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5284416d-2d4d-484f-91cd-0550603f933a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:58.139265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5284416d-2d4d-484f-91cd-0550603f933a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:58.140955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5284416d-2d4d-484f-91cd-0550603f933a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:58.141425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5284416d-2d4d-484f-91cd-0550603f933a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:58.141852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5284416d-2d4d-484f-91cd-0550603f933a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:58.360407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-84e8eb36-3557-43a9-bff1-73583b0865a2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:58.367637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5284416d-2d4d-484f-91cd-0550603f933a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:58.370861 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-84e8eb36-3557-43a9-bff1-73583b0865a2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1535 microversion: 2.1 time: 0.445991 Oct 10 23:21:58.371459 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 740/1502] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:57 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1535 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:58.377741 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5284416d-2d4d-484f-91cd-0550603f933a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10" status: 200 len: 1521 microversion: 2.1 time: 0.255601 Oct 10 23:21:58.381931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-29884a91-dd32-4122-87e1-68eba4b7f935 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:58.383013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-29884a91-dd32-4122-87e1-68eba4b7f935 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:58.389842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29884a91-dd32-4122-87e1-68eba4b7f935 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:58.390274 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 763/1503] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:58 2022] GET /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:58.390401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29884a91-dd32-4122-87e1-68eba4b7f935 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:58.390824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29884a91-dd32-4122-87e1-68eba4b7f935 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:58.391628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29884a91-dd32-4122-87e1-68eba4b7f935 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:58.392219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29884a91-dd32-4122-87e1-68eba4b7f935 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:58.392716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29884a91-dd32-4122-87e1-68eba4b7f935 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:58.405850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b9e6c3b2-11c9-4aca-9264-be8a21f99a2c tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:58.406389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b9e6c3b2-11c9-4aca-9264-be8a21f99a2c tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:58.413391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9e6c3b2-11c9-4aca-9264-be8a21f99a2c tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:58.413892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9e6c3b2-11c9-4aca-9264-be8a21f99a2c tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:58.414325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9e6c3b2-11c9-4aca-9264-be8a21f99a2c tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:58.415016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9e6c3b2-11c9-4aca-9264-be8a21f99a2c tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:58.415459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9e6c3b2-11c9-4aca-9264-be8a21f99a2c tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:58.415873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9e6c3b2-11c9-4aca-9264-be8a21f99a2c tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:58.440551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:21:58.459487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9e6c3b2-11c9-4aca-9264-be8a21f99a2c tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:58.460125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9e6c3b2-11c9-4aca-9264-be8a21f99a2c tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:58.460900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9e6c3b2-11c9-4aca-9264-be8a21f99a2c tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:58.461552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-b9e6c3b2-11c9-4aca-9264-be8a21f99a2c tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lazy-loading 'fault' on Instance uuid cb45a427-0de8-46e7-bcd5-bd96b85e3bcd {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:21:58.510741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b9e6c3b2-11c9-4aca-9264-be8a21f99a2c tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:58.519436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b9e6c3b2-11c9-4aca-9264-be8a21f99a2c tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:58.520896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b9e6c3b2-11c9-4aca-9264-be8a21f99a2c tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:58.522140 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b9e6c3b2-11c9-4aca-9264-be8a21f99a2c tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1368 microversion: 2.57 time: 0.121159 Oct 10 23:21:58.522714 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 764/1504] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:58 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1368 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:21:58.643913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-29884a91-dd32-4122-87e1-68eba4b7f935 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:58.652256 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-29884a91-dd32-4122-87e1-68eba4b7f935 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d" status: 200 len: 1394 microversion: 2.1 time: 0.279194 Oct 10 23:21:58.652857 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 741/1505] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:58 2022] GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d => generated 1394 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:58.835883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-349b070e-b2e2-4bff-b157-a113fbf104c7 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:58.836756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-349b070e-b2e2-4bff-b157-a113fbf104c7 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:58.851249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-349b070e-b2e2-4bff-b157-a113fbf104c7 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:58.852203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-349b070e-b2e2-4bff-b157-a113fbf104c7 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:58.852203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-349b070e-b2e2-4bff-b157-a113fbf104c7 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:58.852843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-349b070e-b2e2-4bff-b157-a113fbf104c7 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:58.853325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-349b070e-b2e2-4bff-b157-a113fbf104c7 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:58.853795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-349b070e-b2e2-4bff-b157-a113fbf104c7 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:58.952927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-df9921ee-4046-47f5-af65-88c2550fe7b7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:58.953631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-df9921ee-4046-47f5-af65-88c2550fe7b7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:58.978957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df9921ee-4046-47f5-af65-88c2550fe7b7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:58.983610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df9921ee-4046-47f5-af65-88c2550fe7b7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:58.984505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df9921ee-4046-47f5-af65-88c2550fe7b7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:58.985354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df9921ee-4046-47f5-af65-88c2550fe7b7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:58.985903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df9921ee-4046-47f5-af65-88c2550fe7b7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:58.997736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df9921ee-4046-47f5-af65-88c2550fe7b7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:59.259665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-df9921ee-4046-47f5-af65-88c2550fe7b7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:59.272304 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-df9921ee-4046-47f5-af65-88c2550fe7b7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.323815 Oct 10 23:21:59.292513 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 742/1506] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:58 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:59.397861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c9882ee5-c12c-457c-ab84-8c248981ce20 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:59.398855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c9882ee5-c12c-457c-ab84-8c248981ce20 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:59.417866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9882ee5-c12c-457c-ab84-8c248981ce20 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:59.418582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9882ee5-c12c-457c-ab84-8c248981ce20 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:59.419182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9882ee5-c12c-457c-ab84-8c248981ce20 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:59.420830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9882ee5-c12c-457c-ab84-8c248981ce20 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:59.421565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9882ee5-c12c-457c-ab84-8c248981ce20 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:59.422213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9882ee5-c12c-457c-ab84-8c248981ce20 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:59.466260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-349b070e-b2e2-4bff-b157-a113fbf104c7 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:59.489303 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-349b070e-b2e2-4bff-b157-a113fbf104c7 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1319 microversion: 2.1 time: 0.661490 Oct 10 23:21:59.489938 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 765/1507] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:58 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1319 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:59.502308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2292bf46-ccb4-4a9c-a033-0240c3fbcbcd tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:59.503002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2292bf46-ccb4-4a9c-a033-0240c3fbcbcd tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: 2391b441-47e3-4bf3-b134-3aa316543f10] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:59.511159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2292bf46-ccb4-4a9c-a033-0240c3fbcbcd tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:59.511656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2292bf46-ccb4-4a9c-a033-0240c3fbcbcd tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:59.512327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2292bf46-ccb4-4a9c-a033-0240c3fbcbcd tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:59.514046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2292bf46-ccb4-4a9c-a033-0240c3fbcbcd tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:59.514767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2292bf46-ccb4-4a9c-a033-0240c3fbcbcd tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:59.517784 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2292bf46-ccb4-4a9c-a033-0240c3fbcbcd tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:59.688014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2292bf46-ccb4-4a9c-a033-0240c3fbcbcd tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:59.698021 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2292bf46-ccb4-4a9c-a033-0240c3fbcbcd tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10" status: 200 len: 1521 microversion: 2.1 time: 0.205985 Oct 10 23:21:59.699617 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 766/1508] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:59 2022] GET /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:21:59.705640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d3784d29-7bb3-4c96-9b3e-3928c2354c3f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:59.706611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d3784d29-7bb3-4c96-9b3e-3928c2354c3f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:59.722513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3784d29-7bb3-4c96-9b3e-3928c2354c3f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:59.723641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3784d29-7bb3-4c96-9b3e-3928c2354c3f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:59.724450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3784d29-7bb3-4c96-9b3e-3928c2354c3f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:59.725460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3784d29-7bb3-4c96-9b3e-3928c2354c3f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:59.726336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3784d29-7bb3-4c96-9b3e-3928c2354c3f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:59.727012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3784d29-7bb3-4c96-9b3e-3928c2354c3f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:59.775402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3784d29-7bb3-4c96-9b3e-3928c2354c3f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:59.776589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3784d29-7bb3-4c96-9b3e-3928c2354c3f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:59.777250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3784d29-7bb3-4c96-9b3e-3928c2354c3f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:59.777983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-d3784d29-7bb3-4c96-9b3e-3928c2354c3f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lazy-loading 'fault' on Instance uuid cb45a427-0de8-46e7-bcd5-bd96b85e3bcd {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:21:59.845816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d3784d29-7bb3-4c96-9b3e-3928c2354c3f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:59.855261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d3784d29-7bb3-4c96-9b3e-3928c2354c3f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:59.856939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d3784d29-7bb3-4c96-9b3e-3928c2354c3f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c695a35a2d4c40eeb86a4653a4c048ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82691202f4ce41a3958dc8767955b71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:21:59.859421 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d3784d29-7bb3-4c96-9b3e-3928c2354c3f tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 200 len: 1368 microversion: 2.57 time: 0.158607 Oct 10 23:21:59.860161 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 767/1509] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:21:59 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:21:59.885331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-28097e96-40d2-4f73-b302-3e84472fd9ea tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:21:59.886104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-28097e96-40d2-4f73-b302-3e84472fd9ea tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:21:59.892876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28097e96-40d2-4f73-b302-3e84472fd9ea tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:59.893707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28097e96-40d2-4f73-b302-3e84472fd9ea tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:59.894417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28097e96-40d2-4f73-b302-3e84472fd9ea tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:21:59.895491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28097e96-40d2-4f73-b302-3e84472fd9ea tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:21:59.896051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28097e96-40d2-4f73-b302-3e84472fd9ea tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:21:59.896713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28097e96-40d2-4f73-b302-3e84472fd9ea tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:00.037409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-28097e96-40d2-4f73-b302-3e84472fd9ea tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:00.047228 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-28097e96-40d2-4f73-b302-3e84472fd9ea tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d" status: 200 len: 1394 microversion: 2.1 time: 0.166189 Oct 10 23:22:00.048073 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 768/1510] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:59 2022] GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d => generated 1394 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:00.052646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-f9d94b14-e0ad-4cd0-b612-475a320cf389 req-855b6c0e-5039-470f-9961-7baecb7bfb2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3480d89d-6a7a-4814-bc55-63ab2350750d", "name": "network-vif-plugged", "status": "completed", "tag": "91530f58-3fc0-45aa-809a-4a02f3333d71"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:00.063325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f9d94b14-e0ad-4cd0-b612-475a320cf389 req-855b6c0e-5039-470f-9961-7baecb7bfb2e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:00.064119 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f9d94b14-e0ad-4cd0-b612-475a320cf389 req-855b6c0e-5039-470f-9961-7baecb7bfb2e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:00.064749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f9d94b14-e0ad-4cd0-b612-475a320cf389 req-855b6c0e-5039-470f-9961-7baecb7bfb2e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:00.079046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c9882ee5-c12c-457c-ab84-8c248981ce20 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:00.093073 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c9882ee5-c12c-457c-ab84-8c248981ce20 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1535 microversion: 2.1 time: 0.699440 Oct 10 23:22:00.095605 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 743/1511] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:21:59 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1535 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:00.097246 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-f9d94b14-e0ad-4cd0-b612-475a320cf389 req-855b6c0e-5039-470f-9961-7baecb7bfb2e service nova] Creating event network-vif-plugged:91530f58-3fc0-45aa-809a-4a02f3333d71 for instance 3480d89d-6a7a-4814-bc55-63ab2350750d on n-h1-860864-2 Oct 10 23:22:00.108429 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-f9d94b14-e0ad-4cd0-b612-475a320cf389 req-855b6c0e-5039-470f-9961-7baecb7bfb2e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058385 Oct 10 23:22:00.109494 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 769/1512] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:00.301251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-03fe58bc-f107-4dc0-a94c-94ed28e7919f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:00.301904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-03fe58bc-f107-4dc0-a94c-94ed28e7919f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:00.310733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03fe58bc-f107-4dc0-a94c-94ed28e7919f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:00.311516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03fe58bc-f107-4dc0-a94c-94ed28e7919f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:00.312173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03fe58bc-f107-4dc0-a94c-94ed28e7919f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:00.313073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03fe58bc-f107-4dc0-a94c-94ed28e7919f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:00.313935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03fe58bc-f107-4dc0-a94c-94ed28e7919f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:00.314521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03fe58bc-f107-4dc0-a94c-94ed28e7919f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:00.513481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1995b747-9e8e-4d2d-8441-ef4212c5b92a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:00.514357 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1995b747-9e8e-4d2d-8441-ef4212c5b92a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:00.521409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1995b747-9e8e-4d2d-8441-ef4212c5b92a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:00.521908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1995b747-9e8e-4d2d-8441-ef4212c5b92a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:00.522347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1995b747-9e8e-4d2d-8441-ef4212c5b92a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:00.523260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1995b747-9e8e-4d2d-8441-ef4212c5b92a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:00.523729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1995b747-9e8e-4d2d-8441-ef4212c5b92a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:00.524160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1995b747-9e8e-4d2d-8441-ef4212c5b92a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:00.627501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-03fe58bc-f107-4dc0-a94c-94ed28e7919f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:00.636857 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-03fe58bc-f107-4dc0-a94c-94ed28e7919f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.339368 Oct 10 23:22:00.638149 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 744/1513] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:00 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:00.722877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1995b747-9e8e-4d2d-8441-ef4212c5b92a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:00.735958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0056eabd-c9f8-42ca-ad6f-5ff4bac9ed4a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:00.737128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0056eabd-c9f8-42ca-ad6f-5ff4bac9ed4a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: 2391b441-47e3-4bf3-b134-3aa316543f10] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:00.748625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0056eabd-c9f8-42ca-ad6f-5ff4bac9ed4a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:00.751110 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1995b747-9e8e-4d2d-8441-ef4212c5b92a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1319 microversion: 2.1 time: 0.241767 Oct 10 23:22:00.751708 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 770/1514] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:00 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:00.752458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0056eabd-c9f8-42ca-ad6f-5ff4bac9ed4a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:00.753193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0056eabd-c9f8-42ca-ad6f-5ff4bac9ed4a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:00.754133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0056eabd-c9f8-42ca-ad6f-5ff4bac9ed4a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:00.754770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0056eabd-c9f8-42ca-ad6f-5ff4bac9ed4a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:00.755375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0056eabd-c9f8-42ca-ad6f-5ff4bac9ed4a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:00.890797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4e74f281-dcd4-4798-92df-7f5adbe2cfcf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:00.891476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4e74f281-dcd4-4798-92df-7f5adbe2cfcf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] [instance: cb45a427-0de8-46e7-bcd5-bd96b85e3bcd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:00.907671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e74f281-dcd4-4798-92df-7f5adbe2cfcf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:00.908775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e74f281-dcd4-4798-92df-7f5adbe2cfcf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:00.909355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e74f281-dcd4-4798-92df-7f5adbe2cfcf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:00.910165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e74f281-dcd4-4798-92df-7f5adbe2cfcf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:00.910715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e74f281-dcd4-4798-92df-7f5adbe2cfcf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:00.911197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e74f281-dcd4-4798-92df-7f5adbe2cfcf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:00.951256 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-4e74f281-dcd4-4798-92df-7f5adbe2cfcf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] HTTP exception thrown: Instance cb45a427-0de8-46e7-bcd5-bd96b85e3bcd could not be found. Oct 10 23:22:00.953262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4e74f281-dcd4-4798-92df-7f5adbe2cfcf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Request method failure captured: Oct 10 23:22:00.953262 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd HTTP/1.1 Oct 10 23:22:00.953262 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:22:00.953262 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:22:00.953262 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:22:00.953262 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:22:00.953262 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:22:00.953262 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:22:00.953262 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:22:00.953262 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:22:00.953262 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKjmfKt7kpEVPJLBNTgfGDfgVFX8j3g-VxwdyLrSPliCXL6rc1hAJ8svwJKLXUg1crit8t-GIdZqQrBnalKMVVHFBxdYaVYPdyLNGBpNjS6PsIHpBYmGy5sRAYya00Ho9XjzcAhoTT2cOAGvneEjj_MJB8PfIf9zXv2DUItbroAV0s4 Oct 10 23:22:00.953262 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:22:00.953262 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:22:00.953262 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:22:00.953262 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:22:00.953262 n-d-860864-2 devstack@n-api.service[120614]: X-Openstack-Nova-Api-Version: 2.57 Oct 10 23:22:00.953262 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:22:00.953262 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:22:00.953262 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 82691202f4ce41a3958dc8767955b71d Oct 10 23:22:00.953262 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerShowV257Test-1888587379 Oct 10 23:22:00.953262 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:22:00.953262 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:22:00.954989 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/82691202f4ce41a3958dc8767955b71d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82691202f4ce41a3958dc8767955b71d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/82691202f4ce41a3958dc8767955b71d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_82691202f4ce41a3958dc8767955b71d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:22:00.954989 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerShowV257Test-1888587379 Oct 10 23:22:00.954989 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 82691202f4ce41a3958dc8767955b71d Oct 10 23:22:00.954989 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerShowV257Test-1888587379 Oct 10 23:22:00.954989 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerShowV257Test-1888587379-project Oct 10 23:22:00.954989 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:22:00.954989 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:22:00.954989 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: c695a35a2d4c40eeb86a4653a4c048ec Oct 10 23:22:00.954989 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerShowV257Test-1888587379-project Oct 10 23:22:00.954989 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:22:00.954989 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance cb45a427-0de8-46e7-bcd5-bd96b85e3bcd could not be found. Oct 10 23:22:00.954989 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'cb45a427-0de8-46e7-bcd5-bd96b85e3bcd'} Oct 10 23:22:00.956001 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:22:00.956001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:00.956001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:22:00.956001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:22:00.956001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:22:00.956001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:22:00.956001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:22:00.956001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:22:00.956001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:22:00.956001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:22:00.956001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb45a427-0de8-46e7-bcd5-bd96b85e3bcd could not be found. Oct 10 23:22:00.956001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:00.956001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:22:00.956001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:00.956001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:00.956001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:22:00.956001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:22:00.956001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:22:00.956001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:22:00.956001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:22:00.957674 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:22:00.957674 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:22:00.957674 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:22:00.957674 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:22:00.957674 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:22:00.957674 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:22:00.957674 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:22:00.957674 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb45a427-0de8-46e7-bcd5-bd96b85e3bcd could not be found. Oct 10 23:22:00.957674 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:00.957674 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:22:00.957674 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:00.957674 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:00.957674 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:22:00.957674 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:22:00.957674 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:22:00.957674 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:22:00.957674 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb45a427-0de8-46e7-bcd5-bd96b85e3bcd could not be found. Oct 10 23:22:00.957674 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:00.960023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4e74f281-dcd4-4798-92df-7f5adbe2cfcf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] Returning 404 to user: Instance cb45a427-0de8-46e7-bcd5-bd96b85e3bcd could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:22:00.961148 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4e74f281-dcd4-4798-92df-7f5adbe2cfcf tempest-ServerShowV257Test-1888587379 tempest-ServerShowV257Test-1888587379-project] 10.222.0.23 "GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd" status: 404 len: 111 microversion: 2.57 time: 0.074908 Oct 10 23:22:00.965097 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 771/1515] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:00 2022] GET /compute/v2.1/servers/cb45a427-0de8-46e7-bcd5-bd96b85e3bcd => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 10 23:22:01.071211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-790eb897-e3ae-45dc-ba79-8ad6ca373451 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:01.071826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-790eb897-e3ae-45dc-ba79-8ad6ca373451 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:01.083282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-790eb897-e3ae-45dc-ba79-8ad6ca373451 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:01.083792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-790eb897-e3ae-45dc-ba79-8ad6ca373451 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:01.084287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-790eb897-e3ae-45dc-ba79-8ad6ca373451 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:01.085889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-790eb897-e3ae-45dc-ba79-8ad6ca373451 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:01.087222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-790eb897-e3ae-45dc-ba79-8ad6ca373451 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:01.088554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-790eb897-e3ae-45dc-ba79-8ad6ca373451 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:01.305002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0056eabd-c9f8-42ca-ad6f-5ff4bac9ed4a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:01.315465 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0056eabd-c9f8-42ca-ad6f-5ff4bac9ed4a tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10" status: 200 len: 1521 microversion: 2.1 time: 0.584171 Oct 10 23:22:01.333804 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 745/1516] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:00 2022] GET /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10 => generated 1521 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:01.341424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d3525b81-8764-44c8-a7f6-ac833466b280 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:01.342457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d3525b81-8764-44c8-a7f6-ac833466b280 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:01.349203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3525b81-8764-44c8-a7f6-ac833466b280 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:01.350183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3525b81-8764-44c8-a7f6-ac833466b280 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:01.350884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3525b81-8764-44c8-a7f6-ac833466b280 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:01.351843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3525b81-8764-44c8-a7f6-ac833466b280 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:01.352535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3525b81-8764-44c8-a7f6-ac833466b280 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:01.353195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3525b81-8764-44c8-a7f6-ac833466b280 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:01.603584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-790eb897-e3ae-45dc-ba79-8ad6ca373451 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:01.612028 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-790eb897-e3ae-45dc-ba79-8ad6ca373451 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d" status: 200 len: 1394 microversion: 2.1 time: 0.544786 Oct 10 23:22:01.616850 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 772/1517] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:01 2022] GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d => generated 1394 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:22:01.662972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-100387d6-5aae-4ace-8ae1-52d5e4e3f68a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:01.664132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-100387d6-5aae-4ace-8ae1-52d5e4e3f68a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:01.670438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-100387d6-5aae-4ace-8ae1-52d5e4e3f68a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:01.671306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-100387d6-5aae-4ace-8ae1-52d5e4e3f68a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:01.671958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-100387d6-5aae-4ace-8ae1-52d5e4e3f68a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:01.672904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-100387d6-5aae-4ace-8ae1-52d5e4e3f68a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:01.673605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-100387d6-5aae-4ace-8ae1-52d5e4e3f68a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:01.674263 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-100387d6-5aae-4ace-8ae1-52d5e4e3f68a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:01.989290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-100387d6-5aae-4ace-8ae1-52d5e4e3f68a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:02.009520 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-100387d6-5aae-4ace-8ae1-52d5e4e3f68a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.350030 Oct 10 23:22:02.034694 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 773/1518] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:01 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:22:02.043004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-62048f0e-0e2f-4542-aa3f-370f717fd847 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:02.050773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-62048f0e-0e2f-4542-aa3f-370f717fd847 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:02.063552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62048f0e-0e2f-4542-aa3f-370f717fd847 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:02.064302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62048f0e-0e2f-4542-aa3f-370f717fd847 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:02.065053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62048f0e-0e2f-4542-aa3f-370f717fd847 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:02.066111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62048f0e-0e2f-4542-aa3f-370f717fd847 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:02.066783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62048f0e-0e2f-4542-aa3f-370f717fd847 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:02.067353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62048f0e-0e2f-4542-aa3f-370f717fd847 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:02.193807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d3525b81-8764-44c8-a7f6-ac833466b280 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:02.203828 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d3525b81-8764-44c8-a7f6-ac833466b280 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1528 microversion: 2.1 time: 0.868234 Oct 10 23:22:02.220163 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 746/1519] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:01 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1528 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:02.234974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-7e81282e-16b8-4eac-8d20-0471aa760a76 req-f59c4fd1-12c5-4c0a-98a2-814a18efe438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d0be5f-c878-4a44-8433-56d0d850ea56", "name": "network-vif-deleted", "tag": "6a5e2c60-162c-4fd1-8808-219a533492b2"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:02.260564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7e81282e-16b8-4eac-8d20-0471aa760a76 req-f59c4fd1-12c5-4c0a-98a2-814a18efe438 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:02.261567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7e81282e-16b8-4eac-8d20-0471aa760a76 req-f59c4fd1-12c5-4c0a-98a2-814a18efe438 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:02.262166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7e81282e-16b8-4eac-8d20-0471aa760a76 req-f59c4fd1-12c5-4c0a-98a2-814a18efe438 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:02.290169 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-7e81282e-16b8-4eac-8d20-0471aa760a76 req-f59c4fd1-12c5-4c0a-98a2-814a18efe438 service nova] Creating event network-vif-deleted:6a5e2c60-162c-4fd1-8808-219a533492b2 for instance d9d0be5f-c878-4a44-8433-56d0d850ea56 on n-h2-860864-2 Oct 10 23:22:02.296719 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-7e81282e-16b8-4eac-8d20-0471aa760a76 req-f59c4fd1-12c5-4c0a-98a2-814a18efe438 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066049 Oct 10 23:22:02.298012 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 747/1520] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:02.309297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8878544d-5e8b-425e-9d0c-5d8c56b3abfd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:02.311254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8878544d-5e8b-425e-9d0c-5d8c56b3abfd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:02.329646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8878544d-5e8b-425e-9d0c-5d8c56b3abfd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:02.330550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8878544d-5e8b-425e-9d0c-5d8c56b3abfd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:02.331174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8878544d-5e8b-425e-9d0c-5d8c56b3abfd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:02.332054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8878544d-5e8b-425e-9d0c-5d8c56b3abfd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:02.332850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8878544d-5e8b-425e-9d0c-5d8c56b3abfd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:02.333525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8878544d-5e8b-425e-9d0c-5d8c56b3abfd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:02.522636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-62048f0e-0e2f-4542-aa3f-370f717fd847 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:02.533498 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-62048f0e-0e2f-4542-aa3f-370f717fd847 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1319 microversion: 2.1 time: 0.497143 Oct 10 23:22:02.536117 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 774/1521] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:02 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1319 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:02.545537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d59e0655-74e5-45cf-8d84-2a0d3f8a95d0 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:02.546169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d59e0655-74e5-45cf-8d84-2a0d3f8a95d0 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: 2391b441-47e3-4bf3-b134-3aa316543f10] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:02.552977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d59e0655-74e5-45cf-8d84-2a0d3f8a95d0 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:02.554247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d59e0655-74e5-45cf-8d84-2a0d3f8a95d0 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:02.554767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d59e0655-74e5-45cf-8d84-2a0d3f8a95d0 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:02.555499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d59e0655-74e5-45cf-8d84-2a0d3f8a95d0 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:02.555967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d59e0655-74e5-45cf-8d84-2a0d3f8a95d0 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:02.556978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d59e0655-74e5-45cf-8d84-2a0d3f8a95d0 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:02.740733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8878544d-5e8b-425e-9d0c-5d8c56b3abfd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:02.765759 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8878544d-5e8b-425e-9d0c-5d8c56b3abfd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1528 microversion: 2.1 time: 0.466187 Oct 10 23:22:02.766777 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 748/1522] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:02 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1528 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:02.776970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-430dc3f0-03be-4a94-b3c0-68f6bfa80a09 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:02.778041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-430dc3f0-03be-4a94-b3c0-68f6bfa80a09 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:02.793890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-430dc3f0-03be-4a94-b3c0-68f6bfa80a09 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:02.795556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-430dc3f0-03be-4a94-b3c0-68f6bfa80a09 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:02.796186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-430dc3f0-03be-4a94-b3c0-68f6bfa80a09 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:02.797751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-430dc3f0-03be-4a94-b3c0-68f6bfa80a09 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:02.798233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-430dc3f0-03be-4a94-b3c0-68f6bfa80a09 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:02.798667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-430dc3f0-03be-4a94-b3c0-68f6bfa80a09 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:03.015889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d59e0655-74e5-45cf-8d84-2a0d3f8a95d0 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:03.027373 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d59e0655-74e5-45cf-8d84-2a0d3f8a95d0 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10" status: 200 len: 1521 microversion: 2.1 time: 0.489847 Oct 10 23:22:03.027992 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 775/1523] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:02 2022] GET /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10 => generated 1521 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:03.035936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-394d0785-b590-49ba-9e3f-4f80e0bdd5a2 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:03.049655 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-394d0785-b590-49ba-9e3f-4f80e0bdd5a2 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] HTTP exception thrown: Flavor f218c400-5b4f-4041-afcd-140d0f0aff91 could not be found. Oct 10 23:22:03.052902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-394d0785-b590-49ba-9e3f-4f80e0bdd5a2 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Request method failure captured: Oct 10 23:22:03.052902 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/flavors/f218c400-5b4f-4041-afcd-140d0f0aff91 HTTP/1.1 Oct 10 23:22:03.052902 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:22:03.052902 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:22:03.052902 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:22:03.052902 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:22:03.052902 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:22:03.052902 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:22:03.052902 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:22:03.052902 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:22:03.052902 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgptKfRhyNBj1_A9lwQ1qIgoOAIuG_nuTvEIUaYZviExy15s_qrEQFClELwQpuozL0EnY4dmwTGuJTsE0NKwDRDiBlCVwN5KebYwXQlfgAbzwMVP1uxXyqxcfWq9ex9EwhFPxb2lSVx1D4oXDuQJOgf_jwKJIiKK1JWIgxYbq_M6Wg Oct 10 23:22:03.052902 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:22:03.052902 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:22:03.052902 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:22:03.052902 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:22:03.052902 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:22:03.052902 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:22:03.052902 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 338d6a067e5c4165bdc5f7ea021833ee Oct 10 23:22:03.052902 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-MigrationsAdminTest-1558972064 Oct 10 23:22:03.052902 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:22:03.052902 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:22:03.054982 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/338d6a067e5c4165bdc5f7ea021833ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/338d6a067e5c4165bdc5f7ea021833ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/338d6a067e5c4165bdc5f7ea021833ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_338d6a067e5c4165bdc5f7ea021833ee", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:22:03.054982 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-MigrationsAdminTest-1558972064 Oct 10 23:22:03.054982 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 338d6a067e5c4165bdc5f7ea021833ee Oct 10 23:22:03.054982 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-MigrationsAdminTest-1558972064 Oct 10 23:22:03.054982 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-MigrationsAdminTest-1558972064-project-admin Oct 10 23:22:03.054982 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:22:03.054982 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:22:03.054982 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: ddd1b00fecb941ae8a0c5d0e3fc1ac51 Oct 10 23:22:03.054982 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-MigrationsAdminTest-1558972064-project-admin Oct 10 23:22:03.054982 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:22:03.054982 n-d-860864-2 devstack@n-api.service[120614]: exception: Flavor f218c400-5b4f-4041-afcd-140d0f0aff91 could not be found. Oct 10 23:22:03.054982 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'f218c400-5b4f-4041-afcd-140d0f0aff91'} Oct 10 23:22:03.055869 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:22:03.055869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:03.055869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 10 23:22:03.055869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 10 23:22:03.055869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 10 23:22:03.055869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 10 23:22:03.055869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 10 23:22:03.055869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 10 23:22:03.055869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 10 23:22:03.055869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 10 23:22:03.055869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:22:03.055869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:22:03.055869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 10 23:22:03.055869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 10 23:22:03.055869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor f218c400-5b4f-4041-afcd-140d0f0aff91 could not be found. Oct 10 23:22:03.055869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:03.055869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:22:03.055869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:03.055869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:03.055869 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:22:03.058658 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:22:03.058658 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:22:03.058658 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:22:03.058658 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:22:03.058658 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:22:03.058658 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 10 23:22:03.058658 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:22:03.058658 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor f218c400-5b4f-4041-afcd-140d0f0aff91 could not be found. Oct 10 23:22:03.058658 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:03.058658 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:22:03.058658 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:03.058658 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:03.058658 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:22:03.058658 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:22:03.058658 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:22:03.058658 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:22:03.058658 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor f218c400-5b4f-4041-afcd-140d0f0aff91 could not be found. Oct 10 23:22:03.058658 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:03.063909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-394d0785-b590-49ba-9e3f-4f80e0bdd5a2 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Returning 404 to user: Flavor f218c400-5b4f-4041-afcd-140d0f0aff91 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:22:03.065073 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-394d0785-b590-49ba-9e3f-4f80e0bdd5a2 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/f218c400-5b4f-4041-afcd-140d0f0aff91" status: 404 len: 109 microversion: 2.1 time: 0.036162 Oct 10 23:22:03.079508 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 776/1524] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:22:03 2022] DELETE /compute/v2.1/flavors/f218c400-5b4f-4041-afcd-140d0f0aff91 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:22:03.087148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-df741b66-afb8-41f8-ad61-b172cf319d66 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:03.097606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-df741b66-afb8-41f8-ad61-b172cf319d66 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:03.097606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df741b66-afb8-41f8-ad61-b172cf319d66 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:03.098128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df741b66-afb8-41f8-ad61-b172cf319d66 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:03.098462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df741b66-afb8-41f8-ad61-b172cf319d66 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:03.102426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df741b66-afb8-41f8-ad61-b172cf319d66 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:03.103815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df741b66-afb8-41f8-ad61-b172cf319d66 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:03.104445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df741b66-afb8-41f8-ad61-b172cf319d66 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:03.359482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-df741b66-afb8-41f8-ad61-b172cf319d66 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:03.371750 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-df741b66-afb8-41f8-ad61-b172cf319d66 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.290905 Oct 10 23:22:03.372978 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 777/1525] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:03 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:03.373401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-430dc3f0-03be-4a94-b3c0-68f6bfa80a09 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:03.379241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ef4b8e2b-38d0-4af1-9bb3-41244c299f24 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-15221244", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:03.381640 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-430dc3f0-03be-4a94-b3c0-68f6bfa80a09 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d" status: 200 len: 1394 microversion: 2.1 time: 0.613499 Oct 10 23:22:03.405646 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 749/1526] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:02 2022] GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d => generated 1394 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:03.476346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-ef4b8e2b-38d0-4af1-9bb3-41244c299f24 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] validate_networks() for None {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:22:03.558708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ad68c787-e9e9-4f6e-8894-86fa29253b53 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:03.559321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ad68c787-e9e9-4f6e-8894-86fa29253b53 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:03.572820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad68c787-e9e9-4f6e-8894-86fa29253b53 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:03.573613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad68c787-e9e9-4f6e-8894-86fa29253b53 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:03.574240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad68c787-e9e9-4f6e-8894-86fa29253b53 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:03.575134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad68c787-e9e9-4f6e-8894-86fa29253b53 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:03.575745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad68c787-e9e9-4f6e-8894-86fa29253b53 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:03.577032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad68c787-e9e9-4f6e-8894-86fa29253b53 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:03.825112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ef4b8e2b-38d0-4af1-9bb3-41244c299f24 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:22:03.827311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ef4b8e2b-38d0-4af1-9bb3-41244c299f24 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:22:03.828053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ef4b8e2b-38d0-4af1-9bb3-41244c299f24 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:22:03.828651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ef4b8e2b-38d0-4af1-9bb3-41244c299f24 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:22:03.829102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ef4b8e2b-38d0-4af1-9bb3-41244c299f24 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:22:03.847947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef4b8e2b-38d0-4af1-9bb3-41244c299f24 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:03.848820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef4b8e2b-38d0-4af1-9bb3-41244c299f24 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:03.848966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ad68c787-e9e9-4f6e-8894-86fa29253b53 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:03.850110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef4b8e2b-38d0-4af1-9bb3-41244c299f24 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:03.851088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef4b8e2b-38d0-4af1-9bb3-41244c299f24 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:03.852002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef4b8e2b-38d0-4af1-9bb3-41244c299f24 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:03.852647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef4b8e2b-38d0-4af1-9bb3-41244c299f24 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:03.859131 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ad68c787-e9e9-4f6e-8894-86fa29253b53 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1319 microversion: 2.1 time: 0.304483 Oct 10 23:22:03.871897 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 750/1527] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:03 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:03.878549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ef4b8e2b-38d0-4af1-9bb3-41244c299f24 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Getting quotas for project 8fad4e7ad7ba4e8284360ccf30d71228. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:22:03.887068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ef4b8e2b-38d0-4af1-9bb3-41244c299f24 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Getting quotas for user cbc0deea66094fac8d5f985e133ceaaa and project 8fad4e7ad7ba4e8284360ccf30d71228. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:22:03.906023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ef4b8e2b-38d0-4af1-9bb3-41244c299f24 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:22:03.909891 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ef4b8e2b-38d0-4af1-9bb3-41244c299f24 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:22:03.986022 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ef4b8e2b-38d0-4af1-9bb3-41244c299f24 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610988 Oct 10 23:22:03.987041 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 778/1528] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:22:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:22:04.000664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f1aa193b-2bbe-48c2-9aa3-f4496ccc89f2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:04.001288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f1aa193b-2bbe-48c2-9aa3-f4496ccc89f2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:04.054497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3d9e15b7-e138-4f90-aa9b-3c5340fa9ed8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:04.055846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3d9e15b7-e138-4f90-aa9b-3c5340fa9ed8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: 2391b441-47e3-4bf3-b134-3aa316543f10] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:04.065484 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d9e15b7-e138-4f90-aa9b-3c5340fa9ed8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:04.066177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d9e15b7-e138-4f90-aa9b-3c5340fa9ed8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:04.066824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d9e15b7-e138-4f90-aa9b-3c5340fa9ed8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:04.068524 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d9e15b7-e138-4f90-aa9b-3c5340fa9ed8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:04.068995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d9e15b7-e138-4f90-aa9b-3c5340fa9ed8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:04.069520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d9e15b7-e138-4f90-aa9b-3c5340fa9ed8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:04.104799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f1aa193b-2bbe-48c2-9aa3-f4496ccc89f2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:04.117095 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f1aa193b-2bbe-48c2-9aa3-f4496ccc89f2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1211 microversion: 2.1 time: 0.119882 Oct 10 23:22:04.125710 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 751/1529] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:03 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1211 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:04.179134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3d9e15b7-e138-4f90-aa9b-3c5340fa9ed8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:04.188212 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3d9e15b7-e138-4f90-aa9b-3c5340fa9ed8 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10" status: 200 len: 1479 microversion: 2.1 time: 0.138789 Oct 10 23:22:04.189602 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 779/1530] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:04 2022] GET /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10 => generated 1479 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:22:04.330200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-d2a19250-59c2-4890-a9e5-8e62e15f0af1 req-4a74f818-557c-4e3c-a4de-eddd5f296428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2391b441-47e3-4bf3-b134-3aa316543f10", "name": "network-vif-deleted", "tag": "d6030a75-0ba4-487f-9252-aede9ef4854e"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:04.344095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d2a19250-59c2-4890-a9e5-8e62e15f0af1 req-4a74f818-557c-4e3c-a4de-eddd5f296428 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:04.344559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d2a19250-59c2-4890-a9e5-8e62e15f0af1 req-4a74f818-557c-4e3c-a4de-eddd5f296428 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:04.344992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d2a19250-59c2-4890-a9e5-8e62e15f0af1 req-4a74f818-557c-4e3c-a4de-eddd5f296428 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:04.360490 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-d2a19250-59c2-4890-a9e5-8e62e15f0af1 req-4a74f818-557c-4e3c-a4de-eddd5f296428 service nova] Creating event network-vif-deleted:d6030a75-0ba4-487f-9252-aede9ef4854e for instance 2391b441-47e3-4bf3-b134-3aa316543f10 on n-h1-860864-2 Oct 10 23:22:04.371927 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-d2a19250-59c2-4890-a9e5-8e62e15f0af1 req-4a74f818-557c-4e3c-a4de-eddd5f296428 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045503 Oct 10 23:22:04.372950 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 780/1531] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:04.400753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1d6171b5-44a6-40ed-82a3-4e65fe0d3a72 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:04.401490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1d6171b5-44a6-40ed-82a3-4e65fe0d3a72 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:04.433939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d6171b5-44a6-40ed-82a3-4e65fe0d3a72 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:04.439316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d6171b5-44a6-40ed-82a3-4e65fe0d3a72 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:04.440070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d6171b5-44a6-40ed-82a3-4e65fe0d3a72 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:04.440887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d6171b5-44a6-40ed-82a3-4e65fe0d3a72 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:04.441519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d6171b5-44a6-40ed-82a3-4e65fe0d3a72 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:04.441956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d6171b5-44a6-40ed-82a3-4e65fe0d3a72 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:04.532253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7a381832-2d85-4fe3-b0c7-615c05610bb8 tempest-VolumesGetTestJSON-1673530663 tempest-VolumesGetTestJSON-1673530663-project] Action: 'create', calling method: .version_select at 0x7f662b1c3670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-800748218", "metadata": {"Type": "work"}}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:04.669243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1d6171b5-44a6-40ed-82a3-4e65fe0d3a72 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:04.679981 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1d6171b5-44a6-40ed-82a3-4e65fe0d3a72 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.283638 Oct 10 23:22:04.680748 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 781/1532] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:04 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:04.685942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7cd8e962-bff9-47da-b86a-c675e3f839d3 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:04.687046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7cd8e962-bff9-47da-b86a-c675e3f839d3 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:04.693697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7cd8e962-bff9-47da-b86a-c675e3f839d3 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:04.694224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7cd8e962-bff9-47da-b86a-c675e3f839d3 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:04.695327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7cd8e962-bff9-47da-b86a-c675e3f839d3 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:04.696102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7cd8e962-bff9-47da-b86a-c675e3f839d3 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:04.697738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7cd8e962-bff9-47da-b86a-c675e3f839d3 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:04.698385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7cd8e962-bff9-47da-b86a-c675e3f839d3 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:04.871026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7cd8e962-bff9-47da-b86a-c675e3f839d3 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:04.881190 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7cd8e962-bff9-47da-b86a-c675e3f839d3 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d" status: 200 len: 1394 microversion: 2.1 time: 0.199080 Oct 10 23:22:04.882144 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 782/1533] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:04 2022] GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d => generated 1394 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:04.989725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c65abf37-8679-4e05-9b81-c5d601f5fa33 tempest-FloatingIPsNegativeTestJSON-1852727178 tempest-FloatingIPsNegativeTestJSON-1852727178-project] Calling method '.version_select at 0x7f662aa80160>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:05.046660 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7a381832-2d85-4fe3-b0c7-615c05610bb8 tempest-VolumesGetTestJSON-1673530663 tempest-VolumesGetTestJSON-1673530663-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.768873 Oct 10 23:22:05.053555 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 752/1534] 10.222.0.23 () {60 vars in 1156 bytes} [Mon Oct 10 23:22:04 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 770 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 10 23:22:05.120714 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c65abf37-8679-4e05-9b81-c5d601f5fa33 tempest-FloatingIPsNegativeTestJSON-1852727178 tempest-FloatingIPsNegativeTestJSON-1852727178-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.237737 Oct 10 23:22:05.121300 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 783/1535] 10.222.0.23 () {58 vars in 1149 bytes} [Mon Oct 10 23:22:04 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:22:05.134796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e07b174d-2833-4842-a786-d138d1b62f5d tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:05.135433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e07b174d-2833-4842-a786-d138d1b62f5d tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:05.158034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e07b174d-2833-4842-a786-d138d1b62f5d tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:05.158903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e07b174d-2833-4842-a786-d138d1b62f5d tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:05.160064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e07b174d-2833-4842-a786-d138d1b62f5d tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:05.161402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e07b174d-2833-4842-a786-d138d1b62f5d tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:05.162506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e07b174d-2833-4842-a786-d138d1b62f5d tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:05.163319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e07b174d-2833-4842-a786-d138d1b62f5d tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:05.215378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-c2592eff-2f85-4cd0-9b4e-e5bded771a81 req-e282688a-cdb9-40fb-a361-eaa559314ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c528ef78-5144-437a-83e3-38376725259a", "name": "network-vif-plugged", "status": "completed", "tag": "caf7c02f-0516-49b4-a4e1-4d9d62869316"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:05.237747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c2592eff-2f85-4cd0-9b4e-e5bded771a81 req-e282688a-cdb9-40fb-a361-eaa559314ef8 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:05.242130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c2592eff-2f85-4cd0-9b4e-e5bded771a81 req-e282688a-cdb9-40fb-a361-eaa559314ef8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:05.242678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c2592eff-2f85-4cd0-9b4e-e5bded771a81 req-e282688a-cdb9-40fb-a361-eaa559314ef8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:05.265334 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-c2592eff-2f85-4cd0-9b4e-e5bded771a81 req-e282688a-cdb9-40fb-a361-eaa559314ef8 service nova] Creating event network-vif-plugged:caf7c02f-0516-49b4-a4e1-4d9d62869316 for instance c528ef78-5144-437a-83e3-38376725259a on n-h1-860864-2 Oct 10 23:22:05.274998 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-c2592eff-2f85-4cd0-9b4e-e5bded771a81 req-e282688a-cdb9-40fb-a361-eaa559314ef8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224442 Oct 10 23:22:05.277175 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 753/1536] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:05.287043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6adf2bcc-b25f-42a4-bc44-a3e791e86edb tempest-VolumesGetTestJSON-1673530663 tempest-VolumesGetTestJSON-1673530663-project] Calling method '.version_select at 0x7f662b1ed8b0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:05.369328 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6adf2bcc-b25f-42a4-bc44-a3e791e86edb tempest-VolumesGetTestJSON-1673530663 tempest-VolumesGetTestJSON-1673530663-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1d90d864-267b-4f77-b76b-197b2f059e36" status: 200 len: 352 microversion: 2.1 time: 0.089837 Oct 10 23:22:05.370423 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 754/1537] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:22:05 2022] GET /compute/v2.1/os-volumes/1d90d864-267b-4f77-b76b-197b2f059e36 => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:05.381685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-82a6558f-9e9b-4991-80ba-549b9129b659 tempest-FloatingIPsNegativeTestJSON-1852727178 tempest-FloatingIPsNegativeTestJSON-1852727178-project] Action: 'create', calling method: .version_select at 0x7f662b3f5b80>, body: {"pool": "non_exist_pool"} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:05.395249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e07b174d-2833-4842-a786-d138d1b62f5d tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:05.403360 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e07b174d-2833-4842-a786-d138d1b62f5d tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1319 microversion: 2.1 time: 0.281028 Oct 10 23:22:05.416871 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-82a6558f-9e9b-4991-80ba-549b9129b659 tempest-FloatingIPsNegativeTestJSON-1852727178 tempest-FloatingIPsNegativeTestJSON-1852727178-project] HTTP exception thrown: Floating IP pool not found. Oct 10 23:22:05.417995 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 784/1538] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:05 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:05.418933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-82a6558f-9e9b-4991-80ba-549b9129b659 tempest-FloatingIPsNegativeTestJSON-1852727178 tempest-FloatingIPsNegativeTestJSON-1852727178-project] Request method failure captured: Oct 10 23:22:05.418933 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 10 23:22:05.418933 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:22:05.418933 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:22:05.418933 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:22:05.418933 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 26 Oct 10 23:22:05.418933 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:22:05.418933 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:22:05.418933 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:22:05.418933 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:22:05.418933 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKkcv3ZGvEWtU_AGycwy74ZTuac8NaT_ZcrKjFGgwk081PMqtj5OZjKgfuGoKZ2EkRNPB0ZAnigwvFnKXaQHDfCxCamJuba_N3stjWxs0eXzkL36YEcODVzGAsrpBwCDNh7HjUmkWNXC-3_-6Ja1E41ZN8B3E92rzTkeJC8NWdf__Yc Oct 10 23:22:05.418933 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:22:05.418933 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:22:05.418933 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:22:05.418933 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:22:05.418933 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:22:05.418933 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:22:05.418933 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: c437261f019e4af5aa5d6a4c0a455612 Oct 10 23:22:05.418933 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1852727178 Oct 10 23:22:05.418933 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:22:05.418933 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:22:05.420961 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c437261f019e4af5aa5d6a4c0a455612"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c437261f019e4af5aa5d6a4c0a455612"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c437261f019e4af5aa5d6a4c0a455612"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c437261f019e4af5aa5d6a4c0a455612", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:22:05.420961 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1852727178 Oct 10 23:22:05.420961 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: c437261f019e4af5aa5d6a4c0a455612 Oct 10 23:22:05.420961 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1852727178 Oct 10 23:22:05.420961 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-FloatingIPsNegativeTestJSON-1852727178-project Oct 10 23:22:05.420961 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:22:05.420961 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:22:05.420961 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: b67d0623ee4642e5944db9c103538f7a Oct 10 23:22:05.420961 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1852727178-project Oct 10 23:22:05.420961 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:22:05.420961 n-d-860864-2 devstack@n-api.service[120613]: {"pool": "non_exist_pool"} Oct 10 23:22:05.420961 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:22:05.420961 n-d-860864-2 devstack@n-api.service[120613]: exception: Floating IP pool not found. Oct 10 23:22:05.420961 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 10 23:22:05.420961 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:22:05.422217 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:05.422217 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 10 23:22:05.422217 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 10 23:22:05.422217 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 10 23:22:05.422217 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 10 23:22:05.422217 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 10 23:22:05.422217 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 10 23:22:05.422217 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 10 23:22:05.422217 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:22:05.422217 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:22:05.422217 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:22:05.422217 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:05.422217 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:22:05.422217 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:22:05.422217 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:22:05.422217 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:22:05.422217 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:22:05.422217 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:22:05.422217 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:22:05.422217 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:22:05.423753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 10 23:22:05.423753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:22:05.423753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 10 23:22:05.423753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:22:05.423753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:22:05.423753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:22:05.423753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:05.423753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:22:05.423753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:22:05.423753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:22:05.423753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:22:05.423753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 10 23:22:05.423753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:22:05.423753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-82a6558f-9e9b-4991-80ba-549b9129b659 tempest-FloatingIPsNegativeTestJSON-1852727178 tempest-FloatingIPsNegativeTestJSON-1852727178-project] Returning 404 to user: Floating IP pool not found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:22:05.425815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ceefb89b-d4b6-4eea-8f36-33ba9129196c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:05.426440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ceefb89b-d4b6-4eea-8f36-33ba9129196c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:05.426574 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-82a6558f-9e9b-4991-80ba-549b9129b659 tempest-FloatingIPsNegativeTestJSON-1852727178 tempest-FloatingIPsNegativeTestJSON-1852727178-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.053795 Oct 10 23:22:05.427244 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 755/1539] 10.222.0.23 () {60 vars in 1170 bytes} [Mon Oct 10 23:22:05 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:22:05.434225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-02a2b36f-075b-49f6-953e-488fe236fa0b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:05.436411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-02a2b36f-075b-49f6-953e-488fe236fa0b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: 2391b441-47e3-4bf3-b134-3aa316543f10] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:05.437588 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ceefb89b-d4b6-4eea-8f36-33ba9129196c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:05.438262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ceefb89b-d4b6-4eea-8f36-33ba9129196c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:05.438855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ceefb89b-d4b6-4eea-8f36-33ba9129196c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:05.439721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ceefb89b-d4b6-4eea-8f36-33ba9129196c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:05.440331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ceefb89b-d4b6-4eea-8f36-33ba9129196c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:05.440937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ceefb89b-d4b6-4eea-8f36-33ba9129196c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:05.445983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:22:05.446337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02a2b36f-075b-49f6-953e-488fe236fa0b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:05.446944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02a2b36f-075b-49f6-953e-488fe236fa0b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:05.447556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02a2b36f-075b-49f6-953e-488fe236fa0b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:05.448907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02a2b36f-075b-49f6-953e-488fe236fa0b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:05.449690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02a2b36f-075b-49f6-953e-488fe236fa0b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:05.450250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02a2b36f-075b-49f6-953e-488fe236fa0b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:05.510342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ceefb89b-d4b6-4eea-8f36-33ba9129196c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:05.519379 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ceefb89b-d4b6-4eea-8f36-33ba9129196c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1263 microversion: 2.1 time: 0.099486 Oct 10 23:22:05.520385 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 785/1540] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:05 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1263 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:05.522447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-02a2b36f-075b-49f6-953e-488fe236fa0b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:05.528190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2de5401e-a5e3-42a7-b6dd-302c8d5d7a78 tempest-FloatingIPsNegativeTestJSON-1852727178 tempest-FloatingIPsNegativeTestJSON-1852727178-project] Calling method '.version_select at 0x7f662abede50>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:05.542488 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-02a2b36f-075b-49f6-953e-488fe236fa0b tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10" status: 200 len: 1479 microversion: 2.1 time: 0.113745 Oct 10 23:22:05.543859 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 756/1541] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:05 2022] GET /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10 => generated 1479 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:05.575947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG neutronclient.v2_0.client [None req-2de5401e-a5e3-42a7-b6dd-302c8d5d7a78 tempest-FloatingIPsNegativeTestJSON-1852727178 tempest-FloatingIPsNegativeTestJSON-1852727178-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 2d4f1c06-58df-44fb-ba35-35828bae4fb4 could not be found", "detail": ""}} {{(pid=120614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:22:05.576710 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-2de5401e-a5e3-42a7-b6dd-302c8d5d7a78 tempest-FloatingIPsNegativeTestJSON-1852727178 tempest-FloatingIPsNegativeTestJSON-1852727178-project] HTTP exception thrown: Floating IP not found for ID 2d4f1c06-58df-44fb-ba35-35828bae4fb4 Oct 10 23:22:05.578751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2de5401e-a5e3-42a7-b6dd-302c8d5d7a78 tempest-FloatingIPsNegativeTestJSON-1852727178 tempest-FloatingIPsNegativeTestJSON-1852727178-project] Request method failure captured: Oct 10 23:22:05.578751 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/os-floating-ips/2d4f1c06-58df-44fb-ba35-35828bae4fb4 HTTP/1.1 Oct 10 23:22:05.578751 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:22:05.578751 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:22:05.578751 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:22:05.578751 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:22:05.578751 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:22:05.578751 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:22:05.578751 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:22:05.578751 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:22:05.578751 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKkcv3ZGvEWtU_AGycwy74ZTuac8NaT_ZcrKjFGgwk081PMqtj5OZjKgfuGoKZ2EkRNPB0ZAnigwvFnKXaQHDfCxCamJuba_N3stjWxs0eXzkL36YEcODVzGAsrpBwCDNh7HjUmkWNXC-3_-6Ja1E41ZN8B3E92rzTkeJC8NWdf__Yc Oct 10 23:22:05.578751 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:22:05.578751 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:22:05.578751 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:22:05.578751 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:22:05.578751 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:22:05.578751 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:22:05.578751 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: c437261f019e4af5aa5d6a4c0a455612 Oct 10 23:22:05.578751 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1852727178 Oct 10 23:22:05.578751 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:22:05.578751 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:22:05.580124 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c437261f019e4af5aa5d6a4c0a455612"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c437261f019e4af5aa5d6a4c0a455612"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c437261f019e4af5aa5d6a4c0a455612"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c437261f019e4af5aa5d6a4c0a455612", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:22:05.580124 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1852727178 Oct 10 23:22:05.580124 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: c437261f019e4af5aa5d6a4c0a455612 Oct 10 23:22:05.580124 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1852727178 Oct 10 23:22:05.580124 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-FloatingIPsNegativeTestJSON-1852727178-project Oct 10 23:22:05.580124 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:22:05.580124 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:22:05.580124 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: b67d0623ee4642e5944db9c103538f7a Oct 10 23:22:05.580124 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1852727178-project Oct 10 23:22:05.580124 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:22:05.580124 n-d-860864-2 devstack@n-api.service[120614]: exception: Floating IP not found for ID 2d4f1c06-58df-44fb-ba35-35828bae4fb4 Oct 10 23:22:05.580124 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '2d4f1c06-58df-44fb-ba35-35828bae4fb4'} Oct 10 23:22:05.580124 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:22:05.580970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:05.580970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 10 23:22:05.580970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 10 23:22:05.580970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:22:05.580970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:22:05.580970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 10 23:22:05.580970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 10 23:22:05.580970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:22:05.580970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:22:05.580970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 23:22:05.580970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 23:22:05.580970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:22:05.580970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:22:05.580970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:22:05.580970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:22:05.580970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:22:05.580970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:22:05.580970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:22:05.580970 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:22:05.583286 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:22:05.583286 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:22:05.583286 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:22:05.583286 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:22:05.583286 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:22:05.583286 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:22:05.583286 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 2d4f1c06-58df-44fb-ba35-35828bae4fb4 could not be found Oct 10 23:22:05.583286 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-376e4105-6afc-4172-bf47-34885f1422cd'] Oct 10 23:22:05.583286 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:05.583286 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:22:05.583286 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:05.583286 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:05.583286 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 10 23:22:05.583286 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 10 23:22:05.583286 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 10 23:22:05.583286 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 10 23:22:05.583286 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 2d4f1c06-58df-44fb-ba35-35828bae4fb4. Oct 10 23:22:05.583286 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:05.583286 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:22:05.583286 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:05.584585 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:05.584585 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:22:05.584585 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:22:05.584585 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:22:05.584585 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:22:05.584585 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:22:05.584585 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:22:05.584585 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:22:05.584585 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:22:05.584585 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 10 23:22:05.584585 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 23:22:05.584585 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 2d4f1c06-58df-44fb-ba35-35828bae4fb4 Oct 10 23:22:05.584585 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:05.584585 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:22:05.584585 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:05.584585 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:05.584585 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:22:05.584585 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:22:05.584585 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:22:05.584585 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:22:05.586060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 2d4f1c06-58df-44fb-ba35-35828bae4fb4 Oct 10 23:22:05.586060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:05.586060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2de5401e-a5e3-42a7-b6dd-302c8d5d7a78 tempest-FloatingIPsNegativeTestJSON-1852727178 tempest-FloatingIPsNegativeTestJSON-1852727178-project] Returning 404 to user: Floating IP not found for ID 2d4f1c06-58df-44fb-ba35-35828bae4fb4 {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:22:05.586060 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2de5401e-a5e3-42a7-b6dd-302c8d5d7a78 tempest-FloatingIPsNegativeTestJSON-1852727178 tempest-FloatingIPsNegativeTestJSON-1852727178-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/2d4f1c06-58df-44fb-ba35-35828bae4fb4" status: 404 len: 111 microversion: 2.1 time: 0.057487 Oct 10 23:22:05.586060 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 786/1542] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 10 23:22:05 2022] DELETE /compute/v2.1/os-floating-ips/2d4f1c06-58df-44fb-ba35-35828bae4fb4 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:22:05.711383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5a9c75b1-df19-43ad-b62b-315ccc070c50 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:05.712778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5a9c75b1-df19-43ad-b62b-315ccc070c50 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:05.720974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a9c75b1-df19-43ad-b62b-315ccc070c50 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:05.722011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a9c75b1-df19-43ad-b62b-315ccc070c50 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:05.722711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a9c75b1-df19-43ad-b62b-315ccc070c50 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:05.723646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a9c75b1-df19-43ad-b62b-315ccc070c50 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:05.724436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a9c75b1-df19-43ad-b62b-315ccc070c50 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:05.725087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a9c75b1-df19-43ad-b62b-315ccc070c50 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:05.905256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e4c07856-4cd3-4782-a973-5a34fdd0e15f tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:05.906560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e4c07856-4cd3-4782-a973-5a34fdd0e15f tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:05.917291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4c07856-4cd3-4782-a973-5a34fdd0e15f tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:05.919061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4c07856-4cd3-4782-a973-5a34fdd0e15f tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:05.920690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4c07856-4cd3-4782-a973-5a34fdd0e15f tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:05.922720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4c07856-4cd3-4782-a973-5a34fdd0e15f tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:05.923483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4c07856-4cd3-4782-a973-5a34fdd0e15f tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:05.924178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4c07856-4cd3-4782-a973-5a34fdd0e15f tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:06.203091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e4c07856-4cd3-4782-a973-5a34fdd0e15f tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:06.218721 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e4c07856-4cd3-4782-a973-5a34fdd0e15f tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d" status: 200 len: 1394 microversion: 2.1 time: 0.317350 Oct 10 23:22:06.243973 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 787/1543] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:05 2022] GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d => generated 1394 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:06.385145 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ab554902-37d1-4de1-b14d-40158855d3d8 tempest-VolumesGetTestJSON-1673530663 tempest-VolumesGetTestJSON-1673530663-project] Calling method '.version_select at 0x7f662abed0d0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:06.474101 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ab554902-37d1-4de1-b14d-40158855d3d8 tempest-VolumesGetTestJSON-1673530663 tempest-VolumesGetTestJSON-1673530663-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1d90d864-267b-4f77-b76b-197b2f059e36" status: 200 len: 353 microversion: 2.1 time: 0.092689 Oct 10 23:22:06.475602 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 788/1544] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:22:06 2022] GET /compute/v2.1/os-volumes/1d90d864-267b-4f77-b76b-197b2f059e36 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:22:06.480783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fff9a672-260e-4b36-92a5-2e91fae093f4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:06.481415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fff9a672-260e-4b36-92a5-2e91fae093f4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:06.492336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fff9a672-260e-4b36-92a5-2e91fae093f4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:06.493187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fff9a672-260e-4b36-92a5-2e91fae093f4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:06.493999 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fff9a672-260e-4b36-92a5-2e91fae093f4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:06.494909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fff9a672-260e-4b36-92a5-2e91fae093f4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:06.495558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fff9a672-260e-4b36-92a5-2e91fae093f4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:06.496196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fff9a672-260e-4b36-92a5-2e91fae093f4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:06.530039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5a9c75b1-df19-43ad-b62b-315ccc070c50 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:06.545735 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5a9c75b1-df19-43ad-b62b-315ccc070c50 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.835460 Oct 10 23:22:06.559626 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 757/1545] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:05 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:06.572303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d0d41fe4-2188-4a55-a5f8-a8a2e0bc1b4c tempest-VolumesGetTestJSON-1673530663 tempest-VolumesGetTestJSON-1673530663-project] Calling method '.version_select at 0x7f662b1b9790>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:06.666878 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d0d41fe4-2188-4a55-a5f8-a8a2e0bc1b4c tempest-VolumesGetTestJSON-1673530663 tempest-VolumesGetTestJSON-1673530663-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1d90d864-267b-4f77-b76b-197b2f059e36" status: 200 len: 353 microversion: 2.1 time: 0.105335 Oct 10 23:22:06.667575 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 758/1546] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:22:06 2022] GET /compute/v2.1/os-volumes/1d90d864-267b-4f77-b76b-197b2f059e36 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:06.672104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-85c351b3-9033-4567-9121-5642b4cd2221 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:06.672718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-85c351b3-9033-4567-9121-5642b4cd2221 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:06.693634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85c351b3-9033-4567-9121-5642b4cd2221 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:06.694137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85c351b3-9033-4567-9121-5642b4cd2221 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:06.694576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85c351b3-9033-4567-9121-5642b4cd2221 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:06.695287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85c351b3-9033-4567-9121-5642b4cd2221 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:06.695749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85c351b3-9033-4567-9121-5642b4cd2221 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:06.696177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85c351b3-9033-4567-9121-5642b4cd2221 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:06.737089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:22:06.879903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-85c351b3-9033-4567-9121-5642b4cd2221 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:06.894474 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-85c351b3-9033-4567-9121-5642b4cd2221 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1269 microversion: 2.1 time: 0.224777 Oct 10 23:22:06.906383 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 759/1547] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:06 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1269 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:06.915756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3a6b4a33-f357-45d2-90c2-cd5cd2d8c8d2 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:06.916541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3a6b4a33-f357-45d2-90c2-cd5cd2d8c8d2 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: 2391b441-47e3-4bf3-b134-3aa316543f10] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:06.928938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a6b4a33-f357-45d2-90c2-cd5cd2d8c8d2 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:06.929443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a6b4a33-f357-45d2-90c2-cd5cd2d8c8d2 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:06.932264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a6b4a33-f357-45d2-90c2-cd5cd2d8c8d2 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:06.933234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a6b4a33-f357-45d2-90c2-cd5cd2d8c8d2 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:06.934088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a6b4a33-f357-45d2-90c2-cd5cd2d8c8d2 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:06.934944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a6b4a33-f357-45d2-90c2-cd5cd2d8c8d2 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:06.955557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fff9a672-260e-4b36-92a5-2e91fae093f4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:06.973813 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fff9a672-260e-4b36-92a5-2e91fae093f4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1319 microversion: 2.1 time: 0.496910 Oct 10 23:22:07.001772 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 789/1548] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:06 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1319 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:07.007194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6e00467b-1920-46bb-85dd-adbb0ef4da0e tempest-VolumesGetTestJSON-1673530663 tempest-VolumesGetTestJSON-1673530663-project] Calling method '.version_select at 0x7f662abed9d0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:07.023620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a6b4a33-f357-45d2-90c2-cd5cd2d8c8d2 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:07.024130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a6b4a33-f357-45d2-90c2-cd5cd2d8c8d2 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:07.024574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a6b4a33-f357-45d2-90c2-cd5cd2d8c8d2 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:07.025032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-3a6b4a33-f357-45d2-90c2-cd5cd2d8c8d2 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lazy-loading 'fault' on Instance uuid 2391b441-47e3-4bf3-b134-3aa316543f10 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:22:07.126788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3a6b4a33-f357-45d2-90c2-cd5cd2d8c8d2 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0345d40e024645a2c7bf9d1ae09b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a9f7ea82a145a4bc4cf562a82a0a90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:07.141809 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3a6b4a33-f357-45d2-90c2-cd5cd2d8c8d2 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10" status: 200 len: 1312 microversion: 2.1 time: 0.230794 Oct 10 23:22:07.158463 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 760/1549] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:06 2022] GET /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10 => generated 1312 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:07.196386 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6e00467b-1920-46bb-85dd-adbb0ef4da0e tempest-VolumesGetTestJSON-1673530663 tempest-VolumesGetTestJSON-1673530663-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/1d90d864-267b-4f77-b76b-197b2f059e36" status: 202 len: 0 microversion: 2.1 time: 0.193299 Oct 10 23:22:07.196978 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 790/1550] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 10 23:22:07 2022] DELETE /compute/v2.1/os-volumes/1d90d864-267b-4f77-b76b-197b2f059e36 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:22:07.206842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a0e18671-1c0f-4681-a8a8-d103800c8664 tempest-VolumesGetTestJSON-1673530663 tempest-VolumesGetTestJSON-1673530663-project] Calling method '.version_select at 0x7f662b14dca0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:07.248278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e382ce8c-8779-4cd7-b66b-baa7e8462ff9 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:07.250087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e382ce8c-8779-4cd7-b66b-baa7e8462ff9 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:07.290252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e382ce8c-8779-4cd7-b66b-baa7e8462ff9 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:07.300750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e382ce8c-8779-4cd7-b66b-baa7e8462ff9 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:07.301437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e382ce8c-8779-4cd7-b66b-baa7e8462ff9 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:07.302423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e382ce8c-8779-4cd7-b66b-baa7e8462ff9 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:07.303061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e382ce8c-8779-4cd7-b66b-baa7e8462ff9 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:07.303659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e382ce8c-8779-4cd7-b66b-baa7e8462ff9 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:07.308315 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a0e18671-1c0f-4681-a8a8-d103800c8664 tempest-VolumesGetTestJSON-1673530663 tempest-VolumesGetTestJSON-1673530663-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1d90d864-267b-4f77-b76b-197b2f059e36" status: 200 len: 352 microversion: 2.1 time: 0.105947 Oct 10 23:22:07.309003 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 761/1551] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:22:07 2022] GET /compute/v2.1/os-volumes/1d90d864-267b-4f77-b76b-197b2f059e36 => generated 352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:07.568189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:22:07.577925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-183480cc-ef81-477b-a6e8-03bf3cee3eeb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:07.579964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-183480cc-ef81-477b-a6e8-03bf3cee3eeb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:07.621327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-183480cc-ef81-477b-a6e8-03bf3cee3eeb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:07.622400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-183480cc-ef81-477b-a6e8-03bf3cee3eeb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:07.626088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-183480cc-ef81-477b-a6e8-03bf3cee3eeb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:07.627796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-183480cc-ef81-477b-a6e8-03bf3cee3eeb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:07.629756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-183480cc-ef81-477b-a6e8-03bf3cee3eeb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:07.630486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-183480cc-ef81-477b-a6e8-03bf3cee3eeb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:07.897005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e382ce8c-8779-4cd7-b66b-baa7e8462ff9 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:07.911379 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e382ce8c-8779-4cd7-b66b-baa7e8462ff9 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d" status: 200 len: 1575 microversion: 2.1 time: 0.668343 Oct 10 23:22:07.913802 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 791/1552] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:07 2022] GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d => generated 1575 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:22:07.940463 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cf83dc11-749c-47da-b6e2-c1f7b9a24ff2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:07.942126 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cf83dc11-749c-47da-b6e2-c1f7b9a24ff2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:07.969389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf83dc11-749c-47da-b6e2-c1f7b9a24ff2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:07.971007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf83dc11-749c-47da-b6e2-c1f7b9a24ff2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:07.971879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf83dc11-749c-47da-b6e2-c1f7b9a24ff2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:07.973516 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf83dc11-749c-47da-b6e2-c1f7b9a24ff2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:07.974313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf83dc11-749c-47da-b6e2-c1f7b9a24ff2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:07.979078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf83dc11-749c-47da-b6e2-c1f7b9a24ff2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:08.234533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-183480cc-ef81-477b-a6e8-03bf3cee3eeb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:08.243879 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-183480cc-ef81-477b-a6e8-03bf3cee3eeb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.676684 Oct 10 23:22:08.244474 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 762/1553] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:07 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:22:08.250200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c99cd59f-cc6a-4e81-bf05-7fcc0c8f7360 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:08.261749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c99cd59f-cc6a-4e81-bf05-7fcc0c8f7360 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:08.288592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c99cd59f-cc6a-4e81-bf05-7fcc0c8f7360 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:08.289113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c99cd59f-cc6a-4e81-bf05-7fcc0c8f7360 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:08.289616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c99cd59f-cc6a-4e81-bf05-7fcc0c8f7360 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:08.290356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c99cd59f-cc6a-4e81-bf05-7fcc0c8f7360 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:08.290818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c99cd59f-cc6a-4e81-bf05-7fcc0c8f7360 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:08.291263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c99cd59f-cc6a-4e81-bf05-7fcc0c8f7360 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:08.474995 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c99cd59f-cc6a-4e81-bf05-7fcc0c8f7360 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.229198 Oct 10 23:22:08.476620 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 763/1554] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Oct 10 23:22:08 2022] GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d/os-interface => generated 285 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:08.496045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-68141872-c248-445d-8423-18d1df5f240a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:08.496849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-68141872-c248-445d-8423-18d1df5f240a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:08.509136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68141872-c248-445d-8423-18d1df5f240a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:08.509662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68141872-c248-445d-8423-18d1df5f240a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:08.510322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68141872-c248-445d-8423-18d1df5f240a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:08.511201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68141872-c248-445d-8423-18d1df5f240a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:08.511818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68141872-c248-445d-8423-18d1df5f240a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:08.512522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68141872-c248-445d-8423-18d1df5f240a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:08.710015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cf83dc11-749c-47da-b6e2-c1f7b9a24ff2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:08.724001 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cf83dc11-749c-47da-b6e2-c1f7b9a24ff2 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1311 microversion: 2.1 time: 0.793938 Oct 10 23:22:08.726404 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 792/1555] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:07 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1311 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:22:08.738931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0d5b6822-89ca-4fe2-be93-1f9c02a85739 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:08.740477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0d5b6822-89ca-4fe2-be93-1f9c02a85739 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: 2391b441-47e3-4bf3-b134-3aa316543f10] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:08.756214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d5b6822-89ca-4fe2-be93-1f9c02a85739 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:08.757031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d5b6822-89ca-4fe2-be93-1f9c02a85739 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:08.757672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d5b6822-89ca-4fe2-be93-1f9c02a85739 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:08.759291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d5b6822-89ca-4fe2-be93-1f9c02a85739 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:08.762454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d5b6822-89ca-4fe2-be93-1f9c02a85739 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:08.763123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d5b6822-89ca-4fe2-be93-1f9c02a85739 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:08.797206 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-0d5b6822-89ca-4fe2-be93-1f9c02a85739 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] HTTP exception thrown: Instance 2391b441-47e3-4bf3-b134-3aa316543f10 could not be found. Oct 10 23:22:08.799405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0d5b6822-89ca-4fe2-be93-1f9c02a85739 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Request method failure captured: Oct 10 23:22:08.799405 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10 HTTP/1.1 Oct 10 23:22:08.799405 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:22:08.799405 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:22:08.799405 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:22:08.799405 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:22:08.799405 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:22:08.799405 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:22:08.799405 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:22:08.799405 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:22:08.799405 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKjx3jMXRlRrSvJ4nRado7qCxEAEXtHBTD0nf8TkZrnPWf4ckLhofTCdip-rxjJzZ2jSyLCsgqwxIRzYmkZzYLqIpXnn8Wn6VX_JnDnprgNgDMAsUTcuzzvjyjt3VjOnLn8YfRsTMfPO-sekgn8IkCCfpBByfME3B3Ja43Jkmt2Ax4M Oct 10 23:22:08.799405 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:22:08.799405 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:22:08.799405 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:22:08.799405 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:22:08.799405 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:22:08.799405 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:22:08.799405 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 17a9f7ea82a145a4bc4cf562a82a0a90 Oct 10 23:22:08.799405 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:22:08.799405 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:22:08.799405 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:22:08.801069 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17a9f7ea82a145a4bc4cf562a82a0a90", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:22:08.801069 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:22:08.801069 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 17a9f7ea82a145a4bc4cf562a82a0a90 Oct 10 23:22:08.801069 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:22:08.801069 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ListServersNegativeTestJSON-1842684533-project Oct 10 23:22:08.801069 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:22:08.801069 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:22:08.801069 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 6c0345d40e024645a2c7bf9d1ae09b36 Oct 10 23:22:08.801069 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ListServersNegativeTestJSON-1842684533-project Oct 10 23:22:08.801069 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:22:08.801069 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 2391b441-47e3-4bf3-b134-3aa316543f10 could not be found. Oct 10 23:22:08.801069 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '2391b441-47e3-4bf3-b134-3aa316543f10'} Oct 10 23:22:08.802076 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:22:08.802076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:08.802076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:22:08.802076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:22:08.802076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:22:08.802076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:22:08.802076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:22:08.802076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:22:08.802076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:22:08.802076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:22:08.802076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2391b441-47e3-4bf3-b134-3aa316543f10 could not be found. Oct 10 23:22:08.802076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:08.802076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:22:08.802076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:08.802076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:08.802076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:22:08.802076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:22:08.802076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:22:08.802076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:22:08.802076 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:22:08.803603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:22:08.803603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:22:08.803603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:22:08.803603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:22:08.803603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:22:08.803603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:22:08.803603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:22:08.803603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2391b441-47e3-4bf3-b134-3aa316543f10 could not be found. Oct 10 23:22:08.803603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:08.803603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:22:08.803603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:08.803603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:08.803603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:22:08.803603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:22:08.803603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:22:08.803603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:22:08.803603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2391b441-47e3-4bf3-b134-3aa316543f10 could not be found. Oct 10 23:22:08.803603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:08.805994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0d5b6822-89ca-4fe2-be93-1f9c02a85739 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Returning 404 to user: Instance 2391b441-47e3-4bf3-b134-3aa316543f10 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:22:08.807140 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0d5b6822-89ca-4fe2-be93-1f9c02a85739 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10" status: 404 len: 111 microversion: 2.1 time: 0.078046 Oct 10 23:22:08.808046 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 793/1556] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:08 2022] GET /compute/v2.1/servers/2391b441-47e3-4bf3-b134-3aa316543f10 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:22:08.819581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2aae0c49-ac47-4f60-a935-9068d00d7cf6 tempest-VolumesGetTestJSON-1673530663 tempest-VolumesGetTestJSON-1673530663-project] Calling method '.version_select at 0x7f6633a03af0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:08.915412 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2aae0c49-ac47-4f60-a935-9068d00d7cf6 tempest-VolumesGetTestJSON-1673530663 tempest-VolumesGetTestJSON-1673530663-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1d90d864-267b-4f77-b76b-197b2f059e36" status: 200 len: 352 microversion: 2.1 time: 0.106067 Oct 10 23:22:08.916000 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 794/1557] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:22:08 2022] GET /compute/v2.1/os-volumes/1d90d864-267b-4f77-b76b-197b2f059e36 => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:08.921615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-93bd1661-68bc-416a-bee8-6342d8c20da6 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:08.922231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-93bd1661-68bc-416a-bee8-6342d8c20da6 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] [instance: d9d0be5f-c878-4a44-8433-56d0d850ea56] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:08.930212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93bd1661-68bc-416a-bee8-6342d8c20da6 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:08.931227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93bd1661-68bc-416a-bee8-6342d8c20da6 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:08.931862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93bd1661-68bc-416a-bee8-6342d8c20da6 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:08.932862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93bd1661-68bc-416a-bee8-6342d8c20da6 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:08.933506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93bd1661-68bc-416a-bee8-6342d8c20da6 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:08.934092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93bd1661-68bc-416a-bee8-6342d8c20da6 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:08.956669 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-93bd1661-68bc-416a-bee8-6342d8c20da6 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] HTTP exception thrown: Instance d9d0be5f-c878-4a44-8433-56d0d850ea56 could not be found. Oct 10 23:22:08.959484 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-93bd1661-68bc-416a-bee8-6342d8c20da6 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Request method failure captured: Oct 10 23:22:08.959484 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56 HTTP/1.1 Oct 10 23:22:08.959484 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:22:08.959484 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:22:08.959484 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:22:08.959484 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:22:08.959484 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:22:08.959484 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:22:08.959484 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:22:08.959484 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:22:08.959484 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKjx3jMXRlRrSvJ4nRado7qCxEAEXtHBTD0nf8TkZrnPWf4ckLhofTCdip-rxjJzZ2jSyLCsgqwxIRzYmkZzYLqIpXnn8Wn6VX_JnDnprgNgDMAsUTcuzzvjyjt3VjOnLn8YfRsTMfPO-sekgn8IkCCfpBByfME3B3Ja43Jkmt2Ax4M Oct 10 23:22:08.959484 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:22:08.959484 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:22:08.959484 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:22:08.959484 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:22:08.959484 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:22:08.959484 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:22:08.959484 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 17a9f7ea82a145a4bc4cf562a82a0a90 Oct 10 23:22:08.959484 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:22:08.959484 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:22:08.959484 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:22:08.961148 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/17a9f7ea82a145a4bc4cf562a82a0a90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_17a9f7ea82a145a4bc4cf562a82a0a90", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:22:08.961148 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:22:08.961148 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 17a9f7ea82a145a4bc4cf562a82a0a90 Oct 10 23:22:08.961148 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1842684533 Oct 10 23:22:08.961148 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ListServersNegativeTestJSON-1842684533-project Oct 10 23:22:08.961148 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:22:08.961148 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:22:08.961148 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 6c0345d40e024645a2c7bf9d1ae09b36 Oct 10 23:22:08.961148 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ListServersNegativeTestJSON-1842684533-project Oct 10 23:22:08.961148 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:22:08.961148 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance d9d0be5f-c878-4a44-8433-56d0d850ea56 could not be found. Oct 10 23:22:08.961148 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'd9d0be5f-c878-4a44-8433-56d0d850ea56'} Oct 10 23:22:08.962089 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:22:08.962089 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:08.962089 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:22:08.962089 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:22:08.962089 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:22:08.962089 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:22:08.962089 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:22:08.962089 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:22:08.962089 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:22:08.962089 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:22:08.962089 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d0be5f-c878-4a44-8433-56d0d850ea56 could not be found. Oct 10 23:22:08.962089 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:08.962089 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:22:08.962089 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:08.962089 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:08.962089 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:22:08.962089 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:22:08.962089 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:22:08.962089 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:22:08.962089 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:22:08.963642 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:22:08.963642 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:22:08.963642 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:22:08.963642 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:22:08.963642 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:22:08.963642 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:22:08.963642 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:22:08.963642 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d0be5f-c878-4a44-8433-56d0d850ea56 could not be found. Oct 10 23:22:08.963642 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:08.963642 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:22:08.963642 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:08.963642 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:08.963642 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:22:08.963642 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:22:08.963642 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:22:08.963642 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:22:08.963642 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d0be5f-c878-4a44-8433-56d0d850ea56 could not be found. Oct 10 23:22:08.963642 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:08.965739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-93bd1661-68bc-416a-bee8-6342d8c20da6 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] Returning 404 to user: Instance d9d0be5f-c878-4a44-8433-56d0d850ea56 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:22:08.966910 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-93bd1661-68bc-416a-bee8-6342d8c20da6 tempest-ListServersNegativeTestJSON-1842684533 tempest-ListServersNegativeTestJSON-1842684533-project] 10.222.0.23 "GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56" status: 404 len: 111 microversion: 2.1 time: 0.049801 Oct 10 23:22:08.967940 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 795/1558] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:08 2022] GET /compute/v2.1/servers/d9d0be5f-c878-4a44-8433-56d0d850ea56 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:22:09.094776 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-afe543b1-668e-4356-a1c9-2b34f1f85ef0 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:09.095770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-afe543b1-668e-4356-a1c9-2b34f1f85ef0 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:09.105438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afe543b1-668e-4356-a1c9-2b34f1f85ef0 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:09.117812 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afe543b1-668e-4356-a1c9-2b34f1f85ef0 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:09.122103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afe543b1-668e-4356-a1c9-2b34f1f85ef0 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:09.124143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afe543b1-668e-4356-a1c9-2b34f1f85ef0 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:09.126586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afe543b1-668e-4356-a1c9-2b34f1f85ef0 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:09.127509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afe543b1-668e-4356-a1c9-2b34f1f85ef0 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:09.189369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-68141872-c248-445d-8423-18d1df5f240a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:09.199082 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-68141872-c248-445d-8423-18d1df5f240a tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1319 microversion: 2.1 time: 0.720226 Oct 10 23:22:09.205454 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 764/1559] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:08 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1319 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:09.272327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e434c715-7709-4c6a-a0e3-aca7c4717c44 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:09.273711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e434c715-7709-4c6a-a0e3-aca7c4717c44 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:09.282719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e434c715-7709-4c6a-a0e3-aca7c4717c44 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:09.284233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e434c715-7709-4c6a-a0e3-aca7c4717c44 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:09.284930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e434c715-7709-4c6a-a0e3-aca7c4717c44 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:09.285911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e434c715-7709-4c6a-a0e3-aca7c4717c44 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:09.286588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e434c715-7709-4c6a-a0e3-aca7c4717c44 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:09.287260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e434c715-7709-4c6a-a0e3-aca7c4717c44 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:09.444665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-afe543b1-668e-4356-a1c9-2b34f1f85ef0 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lazy-loading 'services' on Instance uuid 58fcd7f0-d348-47b1-9b3d-f7514b940eb3 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:22:09.462268 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-afe543b1-668e-4356-a1c9-2b34f1f85ef0 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 2346 microversion: 2.25 time: 0.374260 Oct 10 23:22:09.477819 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 796/1560] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:09 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 2346 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:22:09.488315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3acb5fd3-7cb7-434a-a8ed-ae29ce3774aa tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:09.493076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3acb5fd3-7cb7-434a-a8ed-ae29ce3774aa tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:09.494532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3acb5fd3-7cb7-434a-a8ed-ae29ce3774aa tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:09.495483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3acb5fd3-7cb7-434a-a8ed-ae29ce3774aa tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:09.496400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3acb5fd3-7cb7-434a-a8ed-ae29ce3774aa tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:09.497007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3acb5fd3-7cb7-434a-a8ed-ae29ce3774aa tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:09.497617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3acb5fd3-7cb7-434a-a8ed-ae29ce3774aa tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:09.526791 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3acb5fd3-7cb7-434a-a8ed-ae29ce3774aa tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.042043 Oct 10 23:22:09.537320 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 797/1561] 10.222.0.23 () {60 vars in 1217 bytes} [Mon Oct 10 23:22:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 23:22:09.644200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e434c715-7709-4c6a-a0e3-aca7c4717c44 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:09.666384 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e434c715-7709-4c6a-a0e3-aca7c4717c44 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.396887 Oct 10 23:22:09.673993 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 765/1562] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:09 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:09.750582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-451f4fac-1f73-4e6a-bd49-f334a30da069 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:09.753173 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-451f4fac-1f73-4e6a-bd49-f334a30da069 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:09.768065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-451f4fac-1f73-4e6a-bd49-f334a30da069 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:09.768932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-451f4fac-1f73-4e6a-bd49-f334a30da069 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:09.769635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-451f4fac-1f73-4e6a-bd49-f334a30da069 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:09.770579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-451f4fac-1f73-4e6a-bd49-f334a30da069 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:09.771727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-451f4fac-1f73-4e6a-bd49-f334a30da069 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:09.773822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-451f4fac-1f73-4e6a-bd49-f334a30da069 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:09.931266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-36b056a6-dd83-4da4-af62-f3601381fc6b tempest-VolumesGetTestJSON-1673530663 tempest-VolumesGetTestJSON-1673530663-project] Calling method '.version_select at 0x7f662b228310>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:10.145466 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-36b056a6-dd83-4da4-af62-f3601381fc6b tempest-VolumesGetTestJSON-1673530663 tempest-VolumesGetTestJSON-1673530663-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1d90d864-267b-4f77-b76b-197b2f059e36" status: 200 len: 352 microversion: 2.1 time: 0.218583 Oct 10 23:22:10.146074 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 766/1563] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:22:09 2022] GET /compute/v2.1/os-volumes/1d90d864-267b-4f77-b76b-197b2f059e36 => generated 352 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:22:10.229413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d8b599f8-c0cc-4f2d-8b9e-18a11f64e6ed tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:10.230883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d8b599f8-c0cc-4f2d-8b9e-18a11f64e6ed tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:10.243206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8b599f8-c0cc-4f2d-8b9e-18a11f64e6ed tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:10.247178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8b599f8-c0cc-4f2d-8b9e-18a11f64e6ed tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:10.249262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8b599f8-c0cc-4f2d-8b9e-18a11f64e6ed tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:10.251396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8b599f8-c0cc-4f2d-8b9e-18a11f64e6ed tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:10.253126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8b599f8-c0cc-4f2d-8b9e-18a11f64e6ed tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:10.255018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8b599f8-c0cc-4f2d-8b9e-18a11f64e6ed tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:10.394687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-451f4fac-1f73-4e6a-bd49-f334a30da069 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:10.411949 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-451f4fac-1f73-4e6a-bd49-f334a30da069 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1311 microversion: 2.1 time: 0.667249 Oct 10 23:22:10.423523 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 798/1564] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:09 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1311 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:10.693866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3d346415-c4f3-490a-a191-5efce2981dd2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:10.694705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3d346415-c4f3-490a-a191-5efce2981dd2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:10.709502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d346415-c4f3-490a-a191-5efce2981dd2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:10.711574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d346415-c4f3-490a-a191-5efce2981dd2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:10.713353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d346415-c4f3-490a-a191-5efce2981dd2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:10.716952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d346415-c4f3-490a-a191-5efce2981dd2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:10.717860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d346415-c4f3-490a-a191-5efce2981dd2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:10.719846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d346415-c4f3-490a-a191-5efce2981dd2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:10.769256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d8b599f8-c0cc-4f2d-8b9e-18a11f64e6ed tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:10.782432 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d8b599f8-c0cc-4f2d-8b9e-18a11f64e6ed tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1319 microversion: 2.1 time: 0.555949 Oct 10 23:22:10.783213 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 767/1565] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:10 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1319 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:22:11.122307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3d346415-c4f3-490a-a191-5efce2981dd2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:11.137020 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3d346415-c4f3-490a-a191-5efce2981dd2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.448128 Oct 10 23:22:11.140697 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 799/1566] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:10 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:11.162620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ab40ce03-2a7a-4c40-8167-a235e7b46be6 tempest-VolumesGetTestJSON-1673530663 tempest-VolumesGetTestJSON-1673530663-project] Calling method '.version_select at 0x7f662b3f5dc0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:11.287046 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-ab40ce03-2a7a-4c40-8167-a235e7b46be6 tempest-VolumesGetTestJSON-1673530663 tempest-VolumesGetTestJSON-1673530663-project] HTTP exception thrown: Volume 1d90d864-267b-4f77-b76b-197b2f059e36 could not be found. Oct 10 23:22:11.291837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ab40ce03-2a7a-4c40-8167-a235e7b46be6 tempest-VolumesGetTestJSON-1673530663 tempest-VolumesGetTestJSON-1673530663-project] Request method failure captured: Oct 10 23:22:11.291837 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-volumes/1d90d864-267b-4f77-b76b-197b2f059e36 HTTP/1.1 Oct 10 23:22:11.291837 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:22:11.291837 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:22:11.291837 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:22:11.291837 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:22:11.291837 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:22:11.291837 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:22:11.291837 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:22:11.291837 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:22:11.291837 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKkc_aVxWkmt3_86GWb6qwPLn1XDKoe3VYwlqHMazf2vre52RujJoAxxdDPZ2ksrtKJ3FdDDdrMPAWg7POoEMgsPwbRxADFxgmhZ5uSuTjQQEftM9V5OoLRzNaKk_jmUUyQel4xH2JigsA9udWxxZG-hMC6ad2u1kMRfMRp7hUwvRU8 Oct 10 23:22:11.291837 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:22:11.291837 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:22:11.291837 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:22:11.291837 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:22:11.291837 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:22:11.291837 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:22:11.291837 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: a4a97871f1eb4321b42f09cc520d54fa Oct 10 23:22:11.291837 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-VolumesGetTestJSON-1673530663 Oct 10 23:22:11.291837 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:22:11.291837 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:22:11.293558 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a4a97871f1eb4321b42f09cc520d54fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a4a97871f1eb4321b42f09cc520d54fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a4a97871f1eb4321b42f09cc520d54fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a4a97871f1eb4321b42f09cc520d54fa", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:22:11.293558 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-VolumesGetTestJSON-1673530663 Oct 10 23:22:11.293558 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: a4a97871f1eb4321b42f09cc520d54fa Oct 10 23:22:11.293558 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-VolumesGetTestJSON-1673530663 Oct 10 23:22:11.293558 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-VolumesGetTestJSON-1673530663-project Oct 10 23:22:11.293558 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:22:11.293558 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:22:11.293558 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: c35d28f8b07f41a1b082d79827f9ebdc Oct 10 23:22:11.293558 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-VolumesGetTestJSON-1673530663-project Oct 10 23:22:11.293558 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:22:11.293558 n-d-860864-2 devstack@n-api.service[120613]: exception: Volume 1d90d864-267b-4f77-b76b-197b2f059e36 could not be found. Oct 10 23:22:11.293558 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '1d90d864-267b-4f77-b76b-197b2f059e36'} Oct 10 23:22:11.293558 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:22:11.294830 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:11.294830 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 23:22:11.294830 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 23:22:11.294830 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 23:22:11.294830 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 23:22:11.294830 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 23:22:11.294830 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 23:22:11.294830 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 23:22:11.294830 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 23:22:11.294830 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 23:22:11.294830 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 23:22:11.294830 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 23:22:11.294830 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 23:22:11.294830 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 23:22:11.294830 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 23:22:11.294830 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1d90d864-267b-4f77-b76b-197b2f059e36 could not be found. (HTTP 404) (Request-ID: req-951d7e24-ed68-4f9d-913e-95482d83e20f) Oct 10 23:22:11.294830 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:22:11.294830 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:22:11.294830 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:22:11.296303 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:11.296303 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 10 23:22:11.296303 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 10 23:22:11.296303 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 23:22:11.296303 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 23:22:11.296303 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 23:22:11.296303 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 23:22:11.296303 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 23:22:11.296303 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 23:22:11.296303 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 23:22:11.296303 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 23:22:11.296303 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 23:22:11.296303 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 23:22:11.296303 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 23:22:11.296303 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 23:22:11.296303 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 23:22:11.296303 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 23:22:11.296303 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 23:22:11.296303 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 23:22:11.298090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 23:22:11.298090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 23:22:11.298090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 23:22:11.298090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 23:22:11.298090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1d90d864-267b-4f77-b76b-197b2f059e36 could not be found. Oct 10 23:22:11.298090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:22:11.298090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:22:11.298090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:22:11.298090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:11.298090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:22:11.298090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:22:11.298090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:22:11.298090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:22:11.298090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:22:11.298090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:22:11.298090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:22:11.298090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:22:11.298090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 10 23:22:11.298090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:22:11.299475 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1d90d864-267b-4f77-b76b-197b2f059e36 could not be found. Oct 10 23:22:11.299475 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:22:11.299475 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:22:11.299475 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:22:11.299475 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:11.299475 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:22:11.299475 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:22:11.299475 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:22:11.299475 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:22:11.299475 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1d90d864-267b-4f77-b76b-197b2f059e36 could not be found. Oct 10 23:22:11.299475 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:22:11.305421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ab40ce03-2a7a-4c40-8167-a235e7b46be6 tempest-VolumesGetTestJSON-1673530663 tempest-VolumesGetTestJSON-1673530663-project] Returning 404 to user: Volume 1d90d864-267b-4f77-b76b-197b2f059e36 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:22:11.305421 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ab40ce03-2a7a-4c40-8167-a235e7b46be6 tempest-VolumesGetTestJSON-1673530663 tempest-VolumesGetTestJSON-1673530663-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1d90d864-267b-4f77-b76b-197b2f059e36" status: 404 len: 109 microversion: 2.1 time: 0.147239 Oct 10 23:22:11.311158 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 768/1567] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:22:11 2022] GET /compute/v2.1/os-volumes/1d90d864-267b-4f77-b76b-197b2f059e36 => generated 109 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:22:11.439710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1fdae2c1-7876-455a-b6ad-48c2822dfcf4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:11.440504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1fdae2c1-7876-455a-b6ad-48c2822dfcf4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:11.458791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fdae2c1-7876-455a-b6ad-48c2822dfcf4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:11.459286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fdae2c1-7876-455a-b6ad-48c2822dfcf4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:11.459725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fdae2c1-7876-455a-b6ad-48c2822dfcf4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:11.460443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fdae2c1-7876-455a-b6ad-48c2822dfcf4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:11.471469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fdae2c1-7876-455a-b6ad-48c2822dfcf4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:11.471933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fdae2c1-7876-455a-b6ad-48c2822dfcf4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:11.773227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-001c04ff-d16a-43cb-ae4d-ed7bdd80ff28 req-5ecf54dc-8a3d-452e-bef3-3fd3a9d33f8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5142fea1-e8ea-4f3d-964a-bed317b8342a", "tag": "b6d015b9-418b-43be-8a73-5bb37417c784"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:11.826786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-001c04ff-d16a-43cb-ae4d-ed7bdd80ff28 req-5ecf54dc-8a3d-452e-bef3-3fd3a9d33f8a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:11.827352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-001c04ff-d16a-43cb-ae4d-ed7bdd80ff28 req-5ecf54dc-8a3d-452e-bef3-3fd3a9d33f8a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:11.829568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-001c04ff-d16a-43cb-ae4d-ed7bdd80ff28 req-5ecf54dc-8a3d-452e-bef3-3fd3a9d33f8a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:11.855897 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-001c04ff-d16a-43cb-ae4d-ed7bdd80ff28 req-5ecf54dc-8a3d-452e-bef3-3fd3a9d33f8a service nova] Creating event network-changed:b6d015b9-418b-43be-8a73-5bb37417c784 for instance 5142fea1-e8ea-4f3d-964a-bed317b8342a on n-h2-860864-2 Oct 10 23:22:11.867676 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-001c04ff-d16a-43cb-ae4d-ed7bdd80ff28 req-5ecf54dc-8a3d-452e-bef3-3fd3a9d33f8a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098752 Oct 10 23:22:11.872166 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 769/1568] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:22:11.883447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dce2cd8d-1746-4044-bd79-d90d8a5fa320 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:11.889074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dce2cd8d-1746-4044-bd79-d90d8a5fa320 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:11.909495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dce2cd8d-1746-4044-bd79-d90d8a5fa320 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:11.910261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dce2cd8d-1746-4044-bd79-d90d8a5fa320 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:11.911579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dce2cd8d-1746-4044-bd79-d90d8a5fa320 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:11.912473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dce2cd8d-1746-4044-bd79-d90d8a5fa320 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:11.913400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dce2cd8d-1746-4044-bd79-d90d8a5fa320 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:11.914248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dce2cd8d-1746-4044-bd79-d90d8a5fa320 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:12.095229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1fdae2c1-7876-455a-b6ad-48c2822dfcf4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:12.108416 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1fdae2c1-7876-455a-b6ad-48c2822dfcf4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1311 microversion: 2.1 time: 0.672592 Oct 10 23:22:12.122152 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 800/1569] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:11 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1311 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:12.164464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9ee44452-5a0b-4cd6-b93e-f88cbaec881e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:12.165086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9ee44452-5a0b-4cd6-b93e-f88cbaec881e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:12.168177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:22:12.186265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ee44452-5a0b-4cd6-b93e-f88cbaec881e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:12.186860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ee44452-5a0b-4cd6-b93e-f88cbaec881e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:12.187308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ee44452-5a0b-4cd6-b93e-f88cbaec881e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:12.188057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ee44452-5a0b-4cd6-b93e-f88cbaec881e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:12.188501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ee44452-5a0b-4cd6-b93e-f88cbaec881e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:12.188939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ee44452-5a0b-4cd6-b93e-f88cbaec881e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:12.436877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dce2cd8d-1746-4044-bd79-d90d8a5fa320 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:12.448329 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dce2cd8d-1746-4044-bd79-d90d8a5fa320 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1319 microversion: 2.1 time: 0.573516 Oct 10 23:22:12.449169 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 770/1570] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:11 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1319 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:12.456869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-f32680e9-51d4-49e4-9b72-e6d6e79f7a7f req-6a4dbc9d-2194-46d8-9acf-ed05a417e7e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cf22bf8-8f94-4915-ad99-2d9614352ea6", "name": "network-vif-plugged", "status": "completed", "tag": "2ca2c16e-0ce8-4fee-9beb-8fd4f1c2ead3"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:12.478958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f32680e9-51d4-49e4-9b72-e6d6e79f7a7f req-6a4dbc9d-2194-46d8-9acf-ed05a417e7e4 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:12.479451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f32680e9-51d4-49e4-9b72-e6d6e79f7a7f req-6a4dbc9d-2194-46d8-9acf-ed05a417e7e4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:12.479891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f32680e9-51d4-49e4-9b72-e6d6e79f7a7f req-6a4dbc9d-2194-46d8-9acf-ed05a417e7e4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:12.502864 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-f32680e9-51d4-49e4-9b72-e6d6e79f7a7f req-6a4dbc9d-2194-46d8-9acf-ed05a417e7e4 service nova] Creating event network-vif-plugged:2ca2c16e-0ce8-4fee-9beb-8fd4f1c2ead3 for instance 9cf22bf8-8f94-4915-ad99-2d9614352ea6 on n-h1-860864-2 Oct 10 23:22:12.520379 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-f32680e9-51d4-49e4-9b72-e6d6e79f7a7f req-6a4dbc9d-2194-46d8-9acf-ed05a417e7e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067689 Oct 10 23:22:12.521018 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 771/1571] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:12.595927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b45e3c16-2c9d-4e9a-ba68-8c60f1bfdaae tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1131f34-911c-4cd6-9b7c-52d566a442f2", "device": "/dev/xvdb"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:12.598999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b45e3c16-2c9d-4e9a-ba68-8c60f1bfdaae tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:12.614070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b45e3c16-2c9d-4e9a-ba68-8c60f1bfdaae tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:12.614603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b45e3c16-2c9d-4e9a-ba68-8c60f1bfdaae tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:12.615051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b45e3c16-2c9d-4e9a-ba68-8c60f1bfdaae tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:12.615776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b45e3c16-2c9d-4e9a-ba68-8c60f1bfdaae tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:12.616230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b45e3c16-2c9d-4e9a-ba68-8c60f1bfdaae tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:12.626383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b45e3c16-2c9d-4e9a-ba68-8c60f1bfdaae tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:12.792903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9ee44452-5a0b-4cd6-b93e-f88cbaec881e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:12.805053 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9ee44452-5a0b-4cd6-b93e-f88cbaec881e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.644339 Oct 10 23:22:12.806033 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 801/1572] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:12 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:22:13.118328 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b45e3c16-2c9d-4e9a-ba68-8c60f1bfdaae tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "POST /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.527190 Oct 10 23:22:13.123315 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 772/1573] 10.222.0.23 () {62 vars in 1364 bytes} [Mon Oct 10 23:22:12 2022] POST /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments => generated 194 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 23:22:13.136721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-556fb433-6ee9-4fc9-bf03-34b76fc6fe96 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:13.142871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-556fb433-6ee9-4fc9-bf03-34b76fc6fe96 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:13.158346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-556fb433-6ee9-4fc9-bf03-34b76fc6fe96 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:13.161430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-556fb433-6ee9-4fc9-bf03-34b76fc6fe96 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:13.162392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-556fb433-6ee9-4fc9-bf03-34b76fc6fe96 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:13.163856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-556fb433-6ee9-4fc9-bf03-34b76fc6fe96 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:13.165853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-556fb433-6ee9-4fc9-bf03-34b76fc6fe96 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:13.168566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-556fb433-6ee9-4fc9-bf03-34b76fc6fe96 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:13.484791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c68bd965-c3a6-41a0-901f-d0843313eac8 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:13.485548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c68bd965-c3a6-41a0-901f-d0843313eac8 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:13.503941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c68bd965-c3a6-41a0-901f-d0843313eac8 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:13.504448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c68bd965-c3a6-41a0-901f-d0843313eac8 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:13.504889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c68bd965-c3a6-41a0-901f-d0843313eac8 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:13.505639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c68bd965-c3a6-41a0-901f-d0843313eac8 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:13.506097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c68bd965-c3a6-41a0-901f-d0843313eac8 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:13.506532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c68bd965-c3a6-41a0-901f-d0843313eac8 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:13.896622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=8 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:22:14.113865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:22:14.125279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c68bd965-c3a6-41a0-901f-d0843313eac8 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:14.144461 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c68bd965-c3a6-41a0-901f-d0843313eac8 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1319 microversion: 2.1 time: 0.665489 Oct 10 23:22:14.145618 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 773/1574] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:13 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1319 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:14.157053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1e350cc9-20a6-42a5-b0a9-ffff05833e56 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:14.157992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1e350cc9-20a6-42a5-b0a9-ffff05833e56 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:14.172102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e350cc9-20a6-42a5-b0a9-ffff05833e56 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:14.173157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e350cc9-20a6-42a5-b0a9-ffff05833e56 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:14.175181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e350cc9-20a6-42a5-b0a9-ffff05833e56 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:14.176192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e350cc9-20a6-42a5-b0a9-ffff05833e56 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:14.178299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e350cc9-20a6-42a5-b0a9-ffff05833e56 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:14.178955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e350cc9-20a6-42a5-b0a9-ffff05833e56 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:14.203777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-556fb433-6ee9-4fc9-bf03-34b76fc6fe96 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:14.231900 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-556fb433-6ee9-4fc9-bf03-34b76fc6fe96 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1311 microversion: 2.1 time: 1.099635 Oct 10 23:22:14.234242 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 802/1575] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:13 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1311 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:14.248624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fd482490-3665-4ccb-892b-6aa35b24d889 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:14.249632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fd482490-3665-4ccb-892b-6aa35b24d889 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:14.262248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd482490-3665-4ccb-892b-6aa35b24d889 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:14.264727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd482490-3665-4ccb-892b-6aa35b24d889 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:14.267227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd482490-3665-4ccb-892b-6aa35b24d889 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:14.268177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd482490-3665-4ccb-892b-6aa35b24d889 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:14.268803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd482490-3665-4ccb-892b-6aa35b24d889 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:14.270792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd482490-3665-4ccb-892b-6aa35b24d889 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:14.434220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1e350cc9-20a6-42a5-b0a9-ffff05833e56 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:14.445225 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1e350cc9-20a6-42a5-b0a9-ffff05833e56 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d" status: 200 len: 1575 microversion: 2.1 time: 0.298203 Oct 10 23:22:14.445859 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 774/1576] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:14 2022] GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d => generated 1575 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:14.480278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-d140429a-2797-4cd5-ab23-39abb42897f1 req-7f3dd002-da84-4f86-8ce3-d4441ca26e6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3480d89d-6a7a-4814-bc55-63ab2350750d", "tag": "91530f58-3fc0-45aa-809a-4a02f3333d71"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:14.505003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d140429a-2797-4cd5-ab23-39abb42897f1 req-7f3dd002-da84-4f86-8ce3-d4441ca26e6a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:14.505643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d140429a-2797-4cd5-ab23-39abb42897f1 req-7f3dd002-da84-4f86-8ce3-d4441ca26e6a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:14.509124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d140429a-2797-4cd5-ab23-39abb42897f1 req-7f3dd002-da84-4f86-8ce3-d4441ca26e6a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:14.540137 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-d140429a-2797-4cd5-ab23-39abb42897f1 req-7f3dd002-da84-4f86-8ce3-d4441ca26e6a service nova] Creating event network-changed:91530f58-3fc0-45aa-809a-4a02f3333d71 for instance 3480d89d-6a7a-4814-bc55-63ab2350750d on n-h1-860864-2 Oct 10 23:22:14.557066 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-d140429a-2797-4cd5-ab23-39abb42897f1 req-7f3dd002-da84-4f86-8ce3-d4441ca26e6a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087710 Oct 10 23:22:14.558840 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 775/1577] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:15.131380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fd482490-3665-4ccb-892b-6aa35b24d889 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:15.142801 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fd482490-3665-4ccb-892b-6aa35b24d889 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.906493 Oct 10 23:22:15.152017 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 803/1578] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:14 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:15.178090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bec2c2f8-31f4-40d9-8c62-1b5164b5861c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:15.178992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bec2c2f8-31f4-40d9-8c62-1b5164b5861c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:15.181076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:22:15.205357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bec2c2f8-31f4-40d9-8c62-1b5164b5861c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:15.205893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bec2c2f8-31f4-40d9-8c62-1b5164b5861c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:15.213402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bec2c2f8-31f4-40d9-8c62-1b5164b5861c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:15.214269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bec2c2f8-31f4-40d9-8c62-1b5164b5861c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:15.214761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bec2c2f8-31f4-40d9-8c62-1b5164b5861c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:15.215209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bec2c2f8-31f4-40d9-8c62-1b5164b5861c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:15.261577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d0d02ac4-72ba-4499-a537-a60821cdfa72 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:15.262503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d0d02ac4-72ba-4499-a537-a60821cdfa72 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:15.270641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0d02ac4-72ba-4499-a537-a60821cdfa72 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:15.272684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0d02ac4-72ba-4499-a537-a60821cdfa72 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:15.280137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0d02ac4-72ba-4499-a537-a60821cdfa72 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:15.290688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0d02ac4-72ba-4499-a537-a60821cdfa72 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:15.290688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0d02ac4-72ba-4499-a537-a60821cdfa72 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:15.290688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0d02ac4-72ba-4499-a537-a60821cdfa72 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:16.002914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d0d02ac4-72ba-4499-a537-a60821cdfa72 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:16.024438 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d0d02ac4-72ba-4499-a537-a60821cdfa72 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1311 microversion: 2.1 time: 0.766603 Oct 10 23:22:16.027433 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 804/1579] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:15 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1311 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:22:16.181979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6e28f013-e28c-465d-8f0a-5ee67bbf9820 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:16.182891 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6e28f013-e28c-465d-8f0a-5ee67bbf9820 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:16.199254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e28f013-e28c-465d-8f0a-5ee67bbf9820 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:16.203579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e28f013-e28c-465d-8f0a-5ee67bbf9820 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:16.205834 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e28f013-e28c-465d-8f0a-5ee67bbf9820 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:16.210909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e28f013-e28c-465d-8f0a-5ee67bbf9820 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:16.217181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e28f013-e28c-465d-8f0a-5ee67bbf9820 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:16.218196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e28f013-e28c-465d-8f0a-5ee67bbf9820 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:16.355578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bec2c2f8-31f4-40d9-8c62-1b5164b5861c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:16.375848 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bec2c2f8-31f4-40d9-8c62-1b5164b5861c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1469 microversion: 2.1 time: 1.200590 Oct 10 23:22:16.376538 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 776/1580] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:15 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1469 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:16.404654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-88ec20d3-a257-460f-9ae3-261982403394 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:16.405255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-88ec20d3-a257-460f-9ae3-261982403394 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:16.424440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88ec20d3-a257-460f-9ae3-261982403394 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:16.424950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88ec20d3-a257-460f-9ae3-261982403394 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:16.425420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88ec20d3-a257-460f-9ae3-261982403394 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:16.426151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88ec20d3-a257-460f-9ae3-261982403394 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:16.426612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88ec20d3-a257-460f-9ae3-261982403394 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:16.427132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88ec20d3-a257-460f-9ae3-261982403394 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:16.492300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-88ec20d3-a257-460f-9ae3-261982403394 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Lazy-loading 'flavor' on Instance uuid 9cf22bf8-8f94-4915-ad99-2d9614352ea6 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:22:16.663781 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-88ec20d3-a257-460f-9ae3-261982403394 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6/action" status: 202 len: 0 microversion: 2.1 time: 0.261743 Oct 10 23:22:16.667330 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 777/1581] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:22:16 2022] POST /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 23:22:16.685126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-085ed56e-1206-4572-b6a0-58425115613e tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:16.688967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-085ed56e-1206-4572-b6a0-58425115613e tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:16.707123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-085ed56e-1206-4572-b6a0-58425115613e tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:16.707630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-085ed56e-1206-4572-b6a0-58425115613e tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:16.709277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-085ed56e-1206-4572-b6a0-58425115613e tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:16.710028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-085ed56e-1206-4572-b6a0-58425115613e tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:16.710482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-085ed56e-1206-4572-b6a0-58425115613e tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:16.713170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-085ed56e-1206-4572-b6a0-58425115613e tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:16.721521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:22:17.205782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-085ed56e-1206-4572-b6a0-58425115613e tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:17.219237 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-085ed56e-1206-4572-b6a0-58425115613e tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1477 microversion: 2.1 time: 0.550198 Oct 10 23:22:17.219854 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 778/1582] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:16 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1477 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:17.252615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-488ac70b-d279-4f40-82b8-557dfbbbe37d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:17.253240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-488ac70b-d279-4f40-82b8-557dfbbbe37d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:17.269192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-488ac70b-d279-4f40-82b8-557dfbbbe37d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:17.269726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-488ac70b-d279-4f40-82b8-557dfbbbe37d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:17.270187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-488ac70b-d279-4f40-82b8-557dfbbbe37d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:17.270888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-488ac70b-d279-4f40-82b8-557dfbbbe37d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:17.271345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-488ac70b-d279-4f40-82b8-557dfbbbe37d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:17.271775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-488ac70b-d279-4f40-82b8-557dfbbbe37d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:17.359047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6e28f013-e28c-465d-8f0a-5ee67bbf9820 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:17.388237 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6e28f013-e28c-465d-8f0a-5ee67bbf9820 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 1.210781 Oct 10 23:22:17.391361 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 805/1583] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:16 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:18.097172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-488ac70b-d279-4f40-82b8-557dfbbbe37d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:18.105521 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-488ac70b-d279-4f40-82b8-557dfbbbe37d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1311 microversion: 2.1 time: 0.882981 Oct 10 23:22:18.110106 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 779/1584] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:17 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1311 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:18.242977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bb3658f3-4e76-479c-a80d-0f54a7a80f00 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:18.243584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bb3658f3-4e76-479c-a80d-0f54a7a80f00 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:18.257454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb3658f3-4e76-479c-a80d-0f54a7a80f00 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:18.258125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb3658f3-4e76-479c-a80d-0f54a7a80f00 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:18.258573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb3658f3-4e76-479c-a80d-0f54a7a80f00 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:18.259293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb3658f3-4e76-479c-a80d-0f54a7a80f00 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:18.259746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb3658f3-4e76-479c-a80d-0f54a7a80f00 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:18.260169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb3658f3-4e76-479c-a80d-0f54a7a80f00 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:18.422728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b2ae7f39-147f-40af-9e5f-ee6fbc95e7ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:18.424345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b2ae7f39-147f-40af-9e5f-ee6fbc95e7ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:18.445122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2ae7f39-147f-40af-9e5f-ee6fbc95e7ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:18.446501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2ae7f39-147f-40af-9e5f-ee6fbc95e7ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:18.447564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2ae7f39-147f-40af-9e5f-ee6fbc95e7ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:18.448538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2ae7f39-147f-40af-9e5f-ee6fbc95e7ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:18.449166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2ae7f39-147f-40af-9e5f-ee6fbc95e7ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:18.449789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2ae7f39-147f-40af-9e5f-ee6fbc95e7ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:18.579432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb3658f3-4e76-479c-a80d-0f54a7a80f00 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:18.596566 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bb3658f3-4e76-479c-a80d-0f54a7a80f00 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1460 microversion: 2.1 time: 0.357716 Oct 10 23:22:18.598887 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 806/1585] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:18 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1460 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:18.629080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0d5ed15d-4596-47a4-b6af-a7d11f26f6fd tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:18.630131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0d5ed15d-4596-47a4-b6af-a7d11f26f6fd tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:18.649535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d5ed15d-4596-47a4-b6af-a7d11f26f6fd tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:18.650361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d5ed15d-4596-47a4-b6af-a7d11f26f6fd tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:18.651210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d5ed15d-4596-47a4-b6af-a7d11f26f6fd tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:18.652175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d5ed15d-4596-47a4-b6af-a7d11f26f6fd tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:18.653814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d5ed15d-4596-47a4-b6af-a7d11f26f6fd tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:18.654963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d5ed15d-4596-47a4-b6af-a7d11f26f6fd tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:18.681231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:22:19.047851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b2ae7f39-147f-40af-9e5f-ee6fbc95e7ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:19.057525 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b2ae7f39-147f-40af-9e5f-ee6fbc95e7ca tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1717 microversion: 2.1 time: 0.642801 Oct 10 23:22:19.062534 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 780/1586] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:18 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1717 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:22:19.081815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-644cfe40-9852-4cc2-a484-db2faa684030 req-4dca94d5-ea09-4aa5-8a8b-61ef93fb312c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5142fea1-e8ea-4f3d-964a-bed317b8342a", "name": "network-vif-plugged", "status": "completed", "tag": "b6d015b9-418b-43be-8a73-5bb37417c784"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:19.097313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-644cfe40-9852-4cc2-a484-db2faa684030 req-4dca94d5-ea09-4aa5-8a8b-61ef93fb312c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:19.098654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-644cfe40-9852-4cc2-a484-db2faa684030 req-4dca94d5-ea09-4aa5-8a8b-61ef93fb312c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:19.099280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-644cfe40-9852-4cc2-a484-db2faa684030 req-4dca94d5-ea09-4aa5-8a8b-61ef93fb312c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:19.132585 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-644cfe40-9852-4cc2-a484-db2faa684030 req-4dca94d5-ea09-4aa5-8a8b-61ef93fb312c service nova] Creating event network-vif-plugged:b6d015b9-418b-43be-8a73-5bb37417c784 for instance 5142fea1-e8ea-4f3d-964a-bed317b8342a on n-h2-860864-2 Oct 10 23:22:19.138532 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0d5ed15d-4596-47a4-b6af-a7d11f26f6fd tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1611 microversion: 2.1 time: 0.516497 Oct 10 23:22:19.139483 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 807/1587] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:18 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1611 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:19.151228 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-644cfe40-9852-4cc2-a484-db2faa684030 req-4dca94d5-ea09-4aa5-8a8b-61ef93fb312c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087191 Oct 10 23:22:19.151986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-28e0b67b-fff6-400e-9214-385d6d536fb4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:19.152617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-28e0b67b-fff6-400e-9214-385d6d536fb4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:19.152849 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 781/1588] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:19.169575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28e0b67b-fff6-400e-9214-385d6d536fb4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:19.170975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28e0b67b-fff6-400e-9214-385d6d536fb4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:19.173361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28e0b67b-fff6-400e-9214-385d6d536fb4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:19.174108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28e0b67b-fff6-400e-9214-385d6d536fb4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:19.174473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28e0b67b-fff6-400e-9214-385d6d536fb4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:19.174915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28e0b67b-fff6-400e-9214-385d6d536fb4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:19.177544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f5db9ada-251e-49bb-8792-bd953dad46d7 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:19.181633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5db9ada-251e-49bb-8792-bd953dad46d7 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:19.188359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5db9ada-251e-49bb-8792-bd953dad46d7 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:19.189277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5db9ada-251e-49bb-8792-bd953dad46d7 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:19.190390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5db9ada-251e-49bb-8792-bd953dad46d7 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:19.193227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5db9ada-251e-49bb-8792-bd953dad46d7 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:19.196174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5db9ada-251e-49bb-8792-bd953dad46d7 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:19.296997 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f5db9ada-251e-49bb-8792-bd953dad46d7 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.131583 Oct 10 23:22:19.305591 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 782/1589] 10.222.0.23 () {58 vars in 1176 bytes} [Mon Oct 10 23:22:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:19.319404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-49d4ff4f-278b-45f1-b373-9f000dcab860 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860864-2", "block_migration": true, "disk_over_commit": false}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:19.323301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-49d4ff4f-278b-45f1-b373-9f000dcab860 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:19.343428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49d4ff4f-278b-45f1-b373-9f000dcab860 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:19.350191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49d4ff4f-278b-45f1-b373-9f000dcab860 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:19.350801 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49d4ff4f-278b-45f1-b373-9f000dcab860 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:19.351880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49d4ff4f-278b-45f1-b373-9f000dcab860 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:19.352599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49d4ff4f-278b-45f1-b373-9f000dcab860 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:19.353269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49d4ff4f-278b-45f1-b373-9f000dcab860 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:19.393643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-49d4ff4f-278b-45f1-b373-9f000dcab860 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Lazy-loading 'flavor' on Instance uuid 9cf22bf8-8f94-4915-ad99-2d9614352ea6 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:22:19.409168 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-49d4ff4f-278b-45f1-b373-9f000dcab860 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 9cf22bf8-8f94-4915-ad99-2d9614352ea6 while it is in vm_state suspended Oct 10 23:22:19.411542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-49d4ff4f-278b-45f1-b373-9f000dcab860 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Request method failure captured: Oct 10 23:22:19.411542 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6/action HTTP/1.1 Oct 10 23:22:19.411542 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:22:19.411542 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:22:19.411542 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:22:19.411542 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 97 Oct 10 23:22:19.411542 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:22:19.411542 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:22:19.411542 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:22:19.411542 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:22:19.411542 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKjteycwnqBZzwd87z4meA46xRiktNBU4GtpBFGpY5h-RLr_wTG8hJj3e01k0S44wSi_LA6j8DbEt8glx8uXHVhSaqgt9lnLqg84c9OdvA9fsuXhdEtPcfrp9e5AMnQXQzwoIFmbXc4rmNyrYPT28yLMHw-wDYmZrlwrfm7hTcLSqAA Oct 10 23:22:19.411542 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:22:19.411542 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:22:19.411542 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:22:19.411542 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:22:19.411542 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:22:19.411542 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:22:19.411542 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: ef39aff5221c4540827d4d5ac7c77a0a Oct 10 23:22:19.411542 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-LiveMigrationNegativeTest-1468430736 Oct 10 23:22:19.411542 n-d-860864-2 devstack@n-api.service[120613]: X-Role: admin,member,reader Oct 10 23:22:19.411542 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: admin,member,reader Oct 10 23:22:19.413094 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ef39aff5221c4540827d4d5ac7c77a0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef39aff5221c4540827d4d5ac7c77a0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ef39aff5221c4540827d4d5ac7c77a0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ef39aff5221c4540827d4d5ac7c77a0a", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:22:19.413094 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-LiveMigrationNegativeTest-1468430736 Oct 10 23:22:19.413094 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: ef39aff5221c4540827d4d5ac7c77a0a Oct 10 23:22:19.413094 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1468430736 Oct 10 23:22:19.413094 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-LiveMigrationNegativeTest-1468430736-project-admin Oct 10 23:22:19.413094 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:22:19.413094 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:22:19.413094 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 43fbe867e70542c0b83b1ba51c885ba2 Oct 10 23:22:19.413094 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-LiveMigrationNegativeTest-1468430736-project-admin Oct 10 23:22:19.413094 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:22:19.413094 n-d-860864-2 devstack@n-api.service[120613]: {"os-migrateLive": {"host": "n-h2-860864-2", "block_migration": true, "disk_over_commit": false}} Oct 10 23:22:19.413094 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:22:19.415408 n-d-860864-2 devstack@n-api.service[120613]: exception: Cannot 'os-migrateLive' instance 9cf22bf8-8f94-4915-ad99-2d9614352ea6 while it is in vm_state suspended Oct 10 23:22:19.415408 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '9cf22bf8-8f94-4915-ad99-2d9614352ea6', 'body': {'os-migrateLive': {'host': 'n-h2-860864-2', 'block_migration': True, 'disk_over_commit': False}}} Oct 10 23:22:19.415408 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:22:19.415408 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:19.415408 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 10 23:22:19.415408 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 10 23:22:19.415408 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 10 23:22:19.415408 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 23:22:19.415408 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 10 23:22:19.415408 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 23:22:19.415408 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 10 23:22:19.415408 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 23:22:19.415408 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 10 23:22:19.415408 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 23:22:19.415408 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 10 23:22:19.415408 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 23:22:19.415408 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 10 23:22:19.415408 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 23:22:19.416655 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 23:22:19.416655 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 23:22:19.416655 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 23:22:19.416655 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 23:22:19.416655 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9cf22bf8-8f94-4915-ad99-2d9614352ea6 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 10 23:22:19.416655 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:22:19.416655 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:22:19.416655 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:22:19.416655 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:19.416655 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:22:19.416655 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:22:19.416655 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:22:19.416655 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:22:19.416655 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:22:19.416655 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:22:19.416655 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:22:19.416655 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:22:19.416655 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:22:19.416655 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:22:19.416655 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:22:19.420834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:22:19.420834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 10 23:22:19.420834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 10 23:22:19.420834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 23:22:19.420834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 23:22:19.420834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 23:22:19.420834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 9cf22bf8-8f94-4915-ad99-2d9614352ea6 while it is in vm_state suspended Oct 10 23:22:19.420834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:22:19.420834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:22:19.420834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:22:19.420834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:19.420834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:22:19.420834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:22:19.420834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:22:19.420834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:22:19.420834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 9cf22bf8-8f94-4915-ad99-2d9614352ea6 while it is in vm_state suspended Oct 10 23:22:19.420834 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:22:19.425143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-49d4ff4f-278b-45f1-b373-9f000dcab860 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 9cf22bf8-8f94-4915-ad99-2d9614352ea6 while it is in vm_state suspended {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:22:19.426224 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-49d4ff4f-278b-45f1-b373-9f000dcab860 tempest-LiveMigrationNegativeTest-1468430736 tempest-LiveMigrationNegativeTest-1468430736-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6/action" status: 409 len: 155 microversion: 2.1 time: 0.112565 Oct 10 23:22:19.426989 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 783/1590] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:22:19 2022] POST /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6/action => generated 155 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 10 23:22:19.443307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d65cdb36-f953-4b69-950d-d01e2e852f48 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:19.444063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d65cdb36-f953-4b69-950d-d01e2e852f48 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:19.454892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d65cdb36-f953-4b69-950d-d01e2e852f48 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:19.456496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d65cdb36-f953-4b69-950d-d01e2e852f48 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:19.457920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d65cdb36-f953-4b69-950d-d01e2e852f48 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:19.460098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d65cdb36-f953-4b69-950d-d01e2e852f48 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:19.462720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d65cdb36-f953-4b69-950d-d01e2e852f48 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:19.463663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d65cdb36-f953-4b69-950d-d01e2e852f48 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:19.496563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d65cdb36-f953-4b69-950d-d01e2e852f48 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:22:19.507585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=16 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:22:19.660446 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d65cdb36-f953-4b69-950d-d01e2e852f48 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 204 len: 0 microversion: 2.1 time: 0.220968 Oct 10 23:22:19.662285 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 784/1591] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:22:19 2022] DELETE /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 23:22:19.671233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d5f8c848-578a-45a0-80cb-4d5060939e7c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:19.671956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d5f8c848-578a-45a0-80cb-4d5060939e7c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:19.700335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-28e0b67b-fff6-400e-9214-385d6d536fb4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:19.702502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5f8c848-578a-45a0-80cb-4d5060939e7c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:19.706573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5f8c848-578a-45a0-80cb-4d5060939e7c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:19.707277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5f8c848-578a-45a0-80cb-4d5060939e7c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:19.708181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5f8c848-578a-45a0-80cb-4d5060939e7c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:19.712462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5f8c848-578a-45a0-80cb-4d5060939e7c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:19.715566 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-28e0b67b-fff6-400e-9214-385d6d536fb4 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1311 microversion: 2.1 time: 0.573504 Oct 10 23:22:19.718298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5f8c848-578a-45a0-80cb-4d5060939e7c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:19.726168 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 808/1592] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:19 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1311 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:20.094600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-42cf43a8-73bb-499e-becf-4701ee33f663 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:20.095567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-42cf43a8-73bb-499e-becf-4701ee33f663 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:20.115727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42cf43a8-73bb-499e-becf-4701ee33f663 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:20.116802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42cf43a8-73bb-499e-becf-4701ee33f663 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:20.116802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42cf43a8-73bb-499e-becf-4701ee33f663 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:20.117414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42cf43a8-73bb-499e-becf-4701ee33f663 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:20.120741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42cf43a8-73bb-499e-becf-4701ee33f663 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:20.121414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42cf43a8-73bb-499e-becf-4701ee33f663 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:20.464205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-42cf43a8-73bb-499e-becf-4701ee33f663 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:20.489970 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-42cf43a8-73bb-499e-becf-4701ee33f663 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1707 microversion: 2.1 time: 0.399696 Oct 10 23:22:20.494672 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 809/1593] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:20 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1707 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:20.526666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-55e68b5e-a9f7-421e-b912-8f17a81e91d1 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Calling method '.version_select at 0x7f662aa680d0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:20.548096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55e68b5e-a9f7-421e-b912-8f17a81e91d1 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:20.551177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55e68b5e-a9f7-421e-b912-8f17a81e91d1 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:20.558256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55e68b5e-a9f7-421e-b912-8f17a81e91d1 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:20.606152 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-55e68b5e-a9f7-421e-b912-8f17a81e91d1 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 3112 microversion: 2.1 time: 0.086253 Oct 10 23:22:20.609660 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 810/1594] 10.222.0.23 () {58 vars in 1143 bytes} [Mon Oct 10 23:22:20 2022] GET /compute/v2.1/os-migrations => generated 3112 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:22:20.625008 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b11d44fe-63cf-4b25-91d1-82fbb03e8a34 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:20.626093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b11d44fe-63cf-4b25-91d1-82fbb03e8a34 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:20.643865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b11d44fe-63cf-4b25-91d1-82fbb03e8a34 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:20.647380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b11d44fe-63cf-4b25-91d1-82fbb03e8a34 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:20.648024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b11d44fe-63cf-4b25-91d1-82fbb03e8a34 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:20.649636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b11d44fe-63cf-4b25-91d1-82fbb03e8a34 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:20.651578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b11d44fe-63cf-4b25-91d1-82fbb03e8a34 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:20.652281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b11d44fe-63cf-4b25-91d1-82fbb03e8a34 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:21.031555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d5f8c848-578a-45a0-80cb-4d5060939e7c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:21.047351 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b11d44fe-63cf-4b25-91d1-82fbb03e8a34 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1858 microversion: 2.1 time: 0.427618 Oct 10 23:22:21.050920 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d5f8c848-578a-45a0-80cb-4d5060939e7c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1466 microversion: 2.1 time: 1.384315 Oct 10 23:22:21.059945 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 811/1595] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:20 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1858 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:21.079014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a4d85030-87e2-47f7-8140-5f71ae2da8a6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:21.079463 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 785/1596] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:19 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1466 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:21.084139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a4d85030-87e2-47f7-8140-5f71ae2da8a6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:21.098086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-15fa05e2-e609-4e7c-9ce7-0cf78e47560b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:21.100633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-15fa05e2-e609-4e7c-9ce7-0cf78e47560b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:21.104774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4d85030-87e2-47f7-8140-5f71ae2da8a6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:21.106675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4d85030-87e2-47f7-8140-5f71ae2da8a6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:21.107554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4d85030-87e2-47f7-8140-5f71ae2da8a6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:21.109101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4d85030-87e2-47f7-8140-5f71ae2da8a6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:21.111794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4d85030-87e2-47f7-8140-5f71ae2da8a6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:21.121785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4d85030-87e2-47f7-8140-5f71ae2da8a6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:21.125360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15fa05e2-e609-4e7c-9ce7-0cf78e47560b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:21.127859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15fa05e2-e609-4e7c-9ce7-0cf78e47560b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:21.128845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15fa05e2-e609-4e7c-9ce7-0cf78e47560b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:21.129619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15fa05e2-e609-4e7c-9ce7-0cf78e47560b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:21.130081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15fa05e2-e609-4e7c-9ce7-0cf78e47560b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:21.130506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15fa05e2-e609-4e7c-9ce7-0cf78e47560b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:21.490458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a4d85030-87e2-47f7-8140-5f71ae2da8a6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:21.499662 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a4d85030-87e2-47f7-8140-5f71ae2da8a6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1460 microversion: 2.1 time: 0.437326 Oct 10 23:22:21.523996 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 812/1597] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:21 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1460 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:21.543815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-63ce3a5c-8d97-489c-a4ef-84cf436b12f5 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:21.544500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-63ce3a5c-8d97-489c-a4ef-84cf436b12f5 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:21.555148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63ce3a5c-8d97-489c-a4ef-84cf436b12f5 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:21.555646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63ce3a5c-8d97-489c-a4ef-84cf436b12f5 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:21.556315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63ce3a5c-8d97-489c-a4ef-84cf436b12f5 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:21.557238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63ce3a5c-8d97-489c-a4ef-84cf436b12f5 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:21.557953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63ce3a5c-8d97-489c-a4ef-84cf436b12f5 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:21.562719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63ce3a5c-8d97-489c-a4ef-84cf436b12f5 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:21.911395 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-15fa05e2-e609-4e7c-9ce7-0cf78e47560b tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1858 microversion: 2.1 time: 0.828648 Oct 10 23:22:21.912013 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 786/1598] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:21 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1858 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:22:21.946405 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-63ce3a5c-8d97-489c-a4ef-84cf436b12f5 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1611 microversion: 2.1 time: 0.420676 Oct 10 23:22:21.953715 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 813/1599] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:21 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1611 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:21.973684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-77d0ea48-3375-476c-b573-47fef2166e74 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:21.974267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-77d0ea48-3375-476c-b573-47fef2166e74 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:21.982882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77d0ea48-3375-476c-b573-47fef2166e74 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:21.984567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77d0ea48-3375-476c-b573-47fef2166e74 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:21.986011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77d0ea48-3375-476c-b573-47fef2166e74 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:21.986988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77d0ea48-3375-476c-b573-47fef2166e74 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:21.993029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77d0ea48-3375-476c-b573-47fef2166e74 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:21.993919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77d0ea48-3375-476c-b573-47fef2166e74 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:22.039928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6dd72935-c0a9-43ae-9f34-8326a5e94d9a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:22.040656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6dd72935-c0a9-43ae-9f34-8326a5e94d9a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:22.048344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6dd72935-c0a9-43ae-9f34-8326a5e94d9a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:22.049549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6dd72935-c0a9-43ae-9f34-8326a5e94d9a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:22.050155 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6dd72935-c0a9-43ae-9f34-8326a5e94d9a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:22.051050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6dd72935-c0a9-43ae-9f34-8326a5e94d9a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:22.051689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6dd72935-c0a9-43ae-9f34-8326a5e94d9a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:22.052342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6dd72935-c0a9-43ae-9f34-8326a5e94d9a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:22.130384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-77d0ea48-3375-476c-b573-47fef2166e74 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ddd1b00fecb941ae8a0c5d0e3fc1ac51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338d6a067e5c4165bdc5f7ea021833ee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:22.131160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-77d0ea48-3375-476c-b573-47fef2166e74 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] flavor_id is None. Assuming migration. {{(pid=120613) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 10 23:22:22.131798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-77d0ea48-3375-476c-b573-47fef2166e74 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120613) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 10 23:22:22.995537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-6dd72935-c0a9-43ae-9f34-8326a5e94d9a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lazy-loading 'services' on Instance uuid 90cc20e4-bd05-44fc-931c-ddffba1494e6 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:22:22.996347 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-77d0ea48-3375-476c-b573-47fef2166e74 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a/action" status: 202 len: 0 microversion: 2.1 time: 1.026330 Oct 10 23:22:22.997609 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 787/1600] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:22:21 2022] POST /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a/action => generated 0 bytes in 1028 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:22:23.009101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8b0cb6ce-1a87-4bd3-a7f8-39112258004d tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:23.010039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8b0cb6ce-1a87-4bd3-a7f8-39112258004d tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:23.023816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b0cb6ce-1a87-4bd3-a7f8-39112258004d tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:23.024673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b0cb6ce-1a87-4bd3-a7f8-39112258004d tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:23.025496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b0cb6ce-1a87-4bd3-a7f8-39112258004d tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:23.026968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b0cb6ce-1a87-4bd3-a7f8-39112258004d tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:23.035014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b0cb6ce-1a87-4bd3-a7f8-39112258004d tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:23.036310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b0cb6ce-1a87-4bd3-a7f8-39112258004d tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:23.234089 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6dd72935-c0a9-43ae-9f34-8326a5e94d9a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "DELETE /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/os-volume_attachments/cfcce8af-548d-4f21-a4c4-4b268690e189" status: 202 len: 0 microversion: 2.1 time: 1.197285 Oct 10 23:22:23.236319 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 814/1601] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Oct 10 23:22:22 2022] DELETE /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/os-volume_attachments/cfcce8af-548d-4f21-a4c4-4b268690e189 => generated 0 bytes in 1201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:22:23.258829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c3395d35-f837-4220-849f-23410f114e84 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:23.265083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c3395d35-f837-4220-849f-23410f114e84 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:23.291499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3395d35-f837-4220-849f-23410f114e84 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:23.293347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3395d35-f837-4220-849f-23410f114e84 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:23.293832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3395d35-f837-4220-849f-23410f114e84 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:23.297547 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3395d35-f837-4220-849f-23410f114e84 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:23.299846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3395d35-f837-4220-849f-23410f114e84 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:23.300938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3395d35-f837-4220-849f-23410f114e84 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:23.551830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8b0cb6ce-1a87-4bd3-a7f8-39112258004d tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:23.563964 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8b0cb6ce-1a87-4bd3-a7f8-39112258004d tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1466 microversion: 2.1 time: 0.564957 Oct 10 23:22:23.570438 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 788/1602] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:22 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1466 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:23.580202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-74f012bd-fc42-40e7-be2a-d712bcfce982 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:23.582939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-74f012bd-fc42-40e7-be2a-d712bcfce982 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:23.602280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74f012bd-fc42-40e7-be2a-d712bcfce982 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:23.603055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74f012bd-fc42-40e7-be2a-d712bcfce982 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:23.603855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74f012bd-fc42-40e7-be2a-d712bcfce982 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:23.610251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74f012bd-fc42-40e7-be2a-d712bcfce982 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:23.610933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74f012bd-fc42-40e7-be2a-d712bcfce982 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:23.611541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74f012bd-fc42-40e7-be2a-d712bcfce982 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:23.714219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c3395d35-f837-4220-849f-23410f114e84 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:23.716756 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-74f012bd-fc42-40e7-be2a-d712bcfce982 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144675 Oct 10 23:22:23.717389 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 789/1603] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:22:23 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:23.724205 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c3395d35-f837-4220-849f-23410f114e84 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1469 microversion: 2.1 time: 0.485739 Oct 10 23:22:23.746746 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 815/1604] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:23 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1469 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:23.772490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-ca134c69-186c-4679-909e-a29d07711f7c req-0d49185b-1458-4bef-89cc-c223b3575936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cf22bf8-8f94-4915-ad99-2d9614352ea6", "name": "network-vif-deleted", "tag": "2ca2c16e-0ce8-4fee-9beb-8fd4f1c2ead3"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:23.790572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ca134c69-186c-4679-909e-a29d07711f7c req-0d49185b-1458-4bef-89cc-c223b3575936 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:23.791062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ca134c69-186c-4679-909e-a29d07711f7c req-0d49185b-1458-4bef-89cc-c223b3575936 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:23.791510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ca134c69-186c-4679-909e-a29d07711f7c req-0d49185b-1458-4bef-89cc-c223b3575936 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:23.817590 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-ca134c69-186c-4679-909e-a29d07711f7c req-0d49185b-1458-4bef-89cc-c223b3575936 service nova] Creating event network-vif-deleted:2ca2c16e-0ce8-4fee-9beb-8fd4f1c2ead3 for instance 9cf22bf8-8f94-4915-ad99-2d9614352ea6 on n-h1-860864-2 Oct 10 23:22:23.825397 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-ca134c69-186c-4679-909e-a29d07711f7c req-0d49185b-1458-4bef-89cc-c223b3575936 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057560 Oct 10 23:22:23.827323 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 790/1605] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:24.600464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-75790dc2-68af-4e0c-9838-48f509134740 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:24.601742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-75790dc2-68af-4e0c-9838-48f509134740 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:24.614056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75790dc2-68af-4e0c-9838-48f509134740 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:24.614810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75790dc2-68af-4e0c-9838-48f509134740 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:24.615440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75790dc2-68af-4e0c-9838-48f509134740 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:24.616610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75790dc2-68af-4e0c-9838-48f509134740 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:24.617222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75790dc2-68af-4e0c-9838-48f509134740 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:24.618434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75790dc2-68af-4e0c-9838-48f509134740 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:24.727750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75790dc2-68af-4e0c-9838-48f509134740 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:24.730236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75790dc2-68af-4e0c-9838-48f509134740 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:24.730805 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75790dc2-68af-4e0c-9838-48f509134740 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:24.732315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-75790dc2-68af-4e0c-9838-48f509134740 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lazy-loading 'fault' on Instance uuid 9cf22bf8-8f94-4915-ad99-2d9614352ea6 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:22:24.733352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a0b63083-198f-42d2-932b-619844ace06d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:24.735984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a0b63083-198f-42d2-932b-619844ace06d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:24.769314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0b63083-198f-42d2-932b-619844ace06d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:24.772695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0b63083-198f-42d2-932b-619844ace06d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:24.775061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0b63083-198f-42d2-932b-619844ace06d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:24.776145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0b63083-198f-42d2-932b-619844ace06d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:24.777719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0b63083-198f-42d2-932b-619844ace06d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:24.780846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0b63083-198f-42d2-932b-619844ace06d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:24.876757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-75790dc2-68af-4e0c-9838-48f509134740 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:24.881622 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a0b63083-198f-42d2-932b-619844ace06d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155531 Oct 10 23:22:24.891188 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-75790dc2-68af-4e0c-9838-48f509134740 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 200 len: 1309 microversion: 2.1 time: 0.297331 Oct 10 23:22:24.891653 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 791/1606] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:22:24 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:24.898078 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 816/1607] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:24 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 1309 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:24.904574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0602f4c3-b6b0-4df9-aa3a-e9e46094e847 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:24.905458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0602f4c3-b6b0-4df9-aa3a-e9e46094e847 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:24.916359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0602f4c3-b6b0-4df9-aa3a-e9e46094e847 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:24.916861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0602f4c3-b6b0-4df9-aa3a-e9e46094e847 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:24.919948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0602f4c3-b6b0-4df9-aa3a-e9e46094e847 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:24.920711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0602f4c3-b6b0-4df9-aa3a-e9e46094e847 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:24.921190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0602f4c3-b6b0-4df9-aa3a-e9e46094e847 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:24.922071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0602f4c3-b6b0-4df9-aa3a-e9e46094e847 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:25.575753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0602f4c3-b6b0-4df9-aa3a-e9e46094e847 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:25.585819 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0602f4c3-b6b0-4df9-aa3a-e9e46094e847 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1469 microversion: 2.1 time: 0.690904 Oct 10 23:22:25.586561 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 792/1608] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:24 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1469 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:25.894862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-252e7f90-c9d8-4e25-b86b-89a401c9fe0a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:25.897838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-252e7f90-c9d8-4e25-b86b-89a401c9fe0a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:25.905990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-252e7f90-c9d8-4e25-b86b-89a401c9fe0a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:25.918362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-252e7f90-c9d8-4e25-b86b-89a401c9fe0a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:25.922030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-252e7f90-c9d8-4e25-b86b-89a401c9fe0a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:25.922785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-252e7f90-c9d8-4e25-b86b-89a401c9fe0a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:25.923252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-252e7f90-c9d8-4e25-b86b-89a401c9fe0a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:25.924722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-252e7f90-c9d8-4e25-b86b-89a401c9fe0a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:25.946586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:22:25.991441 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-252e7f90-c9d8-4e25-b86b-89a401c9fe0a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100369 Oct 10 23:22:25.992690 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 793/1609] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:22:25 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:25.998376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3d20aa03-f70f-4ab7-ae5d-14f5f0ba419c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:25.999243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3d20aa03-f70f-4ab7-ae5d-14f5f0ba419c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 9cf22bf8-8f94-4915-ad99-2d9614352ea6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:26.005885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d20aa03-f70f-4ab7-ae5d-14f5f0ba419c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:26.006642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d20aa03-f70f-4ab7-ae5d-14f5f0ba419c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:26.007244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d20aa03-f70f-4ab7-ae5d-14f5f0ba419c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:26.008206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d20aa03-f70f-4ab7-ae5d-14f5f0ba419c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:26.009035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d20aa03-f70f-4ab7-ae5d-14f5f0ba419c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:26.009994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d20aa03-f70f-4ab7-ae5d-14f5f0ba419c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:26.031833 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-3d20aa03-f70f-4ab7-ae5d-14f5f0ba419c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] HTTP exception thrown: Instance 9cf22bf8-8f94-4915-ad99-2d9614352ea6 could not be found. Oct 10 23:22:26.034409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3d20aa03-f70f-4ab7-ae5d-14f5f0ba419c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Request method failure captured: Oct 10 23:22:26.034409 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 HTTP/1.1 Oct 10 23:22:26.034409 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:22:26.034409 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:22:26.034409 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:22:26.034409 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:22:26.034409 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:22:26.034409 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:22:26.034409 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:22:26.034409 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:22:26.034409 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKjrivCmJSNrdOHg1otD4ykmOiWlz1wMSRThIO0qvL5RWNJnk1nBXopk75yCpHTPB7x3UZz3nZxpdWkFw0KPRwStqoqpxf29lWJP0UTMglB6neSYqzDMpxCcausmooyWvB1xNSTVRa-SmXTI9b-oAvKVE4QsqBZvw_RwiM4IWtGYfbg Oct 10 23:22:26.034409 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:22:26.034409 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:22:26.034409 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:22:26.034409 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:22:26.034409 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:22:26.034409 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:22:26.034409 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e84c3cf61abe4eb4901114ac1167f466 Oct 10 23:22:26.034409 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-LiveMigrationNegativeTest-1385943398 Oct 10 23:22:26.034409 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:22:26.034409 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:22:26.036182 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e84c3cf61abe4eb4901114ac1167f466"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e84c3cf61abe4eb4901114ac1167f466"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e84c3cf61abe4eb4901114ac1167f466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e84c3cf61abe4eb4901114ac1167f466", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:22:26.036182 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-LiveMigrationNegativeTest-1385943398 Oct 10 23:22:26.036182 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e84c3cf61abe4eb4901114ac1167f466 Oct 10 23:22:26.036182 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1385943398 Oct 10 23:22:26.036182 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-LiveMigrationNegativeTest-1385943398-project Oct 10 23:22:26.036182 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:22:26.036182 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:22:26.036182 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 40517612a20f448d8812e505e14f105e Oct 10 23:22:26.036182 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-LiveMigrationNegativeTest-1385943398-project Oct 10 23:22:26.036182 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:22:26.036182 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 9cf22bf8-8f94-4915-ad99-2d9614352ea6 could not be found. Oct 10 23:22:26.036182 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '9cf22bf8-8f94-4915-ad99-2d9614352ea6'} Oct 10 23:22:26.037215 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:22:26.037215 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:26.037215 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:22:26.037215 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:22:26.037215 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:22:26.037215 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:22:26.037215 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:22:26.037215 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:22:26.037215 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:22:26.037215 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:22:26.037215 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cf22bf8-8f94-4915-ad99-2d9614352ea6 could not be found. Oct 10 23:22:26.037215 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:22:26.037215 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:22:26.037215 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:22:26.037215 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:26.037215 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:22:26.037215 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:22:26.037215 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:22:26.037215 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:22:26.037215 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:22:26.039027 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:22:26.039027 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:22:26.039027 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:22:26.039027 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:22:26.039027 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:22:26.039027 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:22:26.039027 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:22:26.039027 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cf22bf8-8f94-4915-ad99-2d9614352ea6 could not be found. Oct 10 23:22:26.039027 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:22:26.039027 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:22:26.039027 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:22:26.039027 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:26.039027 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:22:26.039027 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:22:26.039027 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:22:26.039027 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:22:26.039027 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cf22bf8-8f94-4915-ad99-2d9614352ea6 could not be found. Oct 10 23:22:26.039027 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:22:26.041467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3d20aa03-f70f-4ab7-ae5d-14f5f0ba419c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Returning 404 to user: Instance 9cf22bf8-8f94-4915-ad99-2d9614352ea6 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:22:26.045643 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3d20aa03-f70f-4ab7-ae5d-14f5f0ba419c tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6" status: 404 len: 111 microversion: 2.1 time: 0.051519 Oct 10 23:22:26.046566 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 794/1610] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:25 2022] GET /compute/v2.1/servers/9cf22bf8-8f94-4915-ad99-2d9614352ea6 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:22:26.060157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cc43703e-df7b-4fc0-914d-86da9a1cee5f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:26.061263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cc43703e-df7b-4fc0-914d-86da9a1cee5f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 6656fd97-0371-4915-a530-5741f3d335bd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:26.075251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc43703e-df7b-4fc0-914d-86da9a1cee5f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:26.075749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc43703e-df7b-4fc0-914d-86da9a1cee5f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:26.076725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc43703e-df7b-4fc0-914d-86da9a1cee5f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:26.082069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc43703e-df7b-4fc0-914d-86da9a1cee5f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:26.082576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc43703e-df7b-4fc0-914d-86da9a1cee5f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:26.083017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc43703e-df7b-4fc0-914d-86da9a1cee5f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:26.137155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cc43703e-df7b-4fc0-914d-86da9a1cee5f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 6656fd97-0371-4915-a530-5741f3d335bd] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:22:26.312220 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cc43703e-df7b-4fc0-914d-86da9a1cee5f tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd" status: 204 len: 0 microversion: 2.1 time: 0.260416 Oct 10 23:22:26.314769 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 795/1611] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:22:26 2022] DELETE /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:22:26.338624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-29876e3e-aaeb-426c-9874-e84f050160ae tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:26.345493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-29876e3e-aaeb-426c-9874-e84f050160ae tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 6656fd97-0371-4915-a530-5741f3d335bd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:26.359960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29876e3e-aaeb-426c-9874-e84f050160ae tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:26.360471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29876e3e-aaeb-426c-9874-e84f050160ae tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:26.362314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29876e3e-aaeb-426c-9874-e84f050160ae tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:26.363136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29876e3e-aaeb-426c-9874-e84f050160ae tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:26.363608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29876e3e-aaeb-426c-9874-e84f050160ae tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:26.364045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29876e3e-aaeb-426c-9874-e84f050160ae tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:26.520033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5fa8c306-a78d-4962-8ce0-b0ac9bd8d441 tempest-ComputeTenantNetworksTest-469535837 tempest-ComputeTenantNetworksTest-469535837-project] Calling method '.version_select at 0x7f662aa80dc0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:27.008298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-29876e3e-aaeb-426c-9874-e84f050160ae tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:27.017259 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-29876e3e-aaeb-426c-9874-e84f050160ae tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd" status: 200 len: 1473 microversion: 2.1 time: 0.698273 Oct 10 23:22:27.019874 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 796/1612] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:26 2022] GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd => generated 1473 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:27.038016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4c296c2e-58b3-4226-9a78-74ffa77ef05a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:27.038957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4c296c2e-58b3-4226-9a78-74ffa77ef05a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:27.054553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c296c2e-58b3-4226-9a78-74ffa77ef05a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:27.055064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c296c2e-58b3-4226-9a78-74ffa77ef05a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:27.055515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c296c2e-58b3-4226-9a78-74ffa77ef05a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:27.058842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c296c2e-58b3-4226-9a78-74ffa77ef05a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:27.059328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c296c2e-58b3-4226-9a78-74ffa77ef05a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:27.059767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c296c2e-58b3-4226-9a78-74ffa77ef05a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:27.533457 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5fa8c306-a78d-4962-8ce0-b0ac9bd8d441 tempest-ComputeTenantNetworksTest-469535837 tempest-ComputeTenantNetworksTest-469535837-project] 10.222.0.23 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.654420 Oct 10 23:22:27.535285 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 817/1613] 10.222.0.23 () {58 vars in 1158 bytes} [Mon Oct 10 23:22:25 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:27.548431 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e42fccc4-3806-4c08-89eb-ec117921bfb7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:27.557460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e42fccc4-3806-4c08-89eb-ec117921bfb7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:27.596337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4c296c2e-58b3-4226-9a78-74ffa77ef05a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:27.599140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e42fccc4-3806-4c08-89eb-ec117921bfb7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:27.607073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e42fccc4-3806-4c08-89eb-ec117921bfb7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:27.608338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e42fccc4-3806-4c08-89eb-ec117921bfb7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:27.609504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e42fccc4-3806-4c08-89eb-ec117921bfb7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:27.610181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e42fccc4-3806-4c08-89eb-ec117921bfb7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:27.611218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e42fccc4-3806-4c08-89eb-ec117921bfb7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:27.614156 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4c296c2e-58b3-4226-9a78-74ffa77ef05a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1469 microversion: 2.1 time: 0.592828 Oct 10 23:22:27.627091 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 797/1614] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:27 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1469 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:27.634848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-82c98ca2-3088-41a4-9131-9bed9d272642 tempest-ComputeTenantNetworksTest-469535837 tempest-ComputeTenantNetworksTest-469535837-project] Calling method '.version_select at 0x7f662b17cb80>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:27.681526 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e42fccc4-3806-4c08-89eb-ec117921bfb7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143392 Oct 10 23:22:27.687821 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 818/1615] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:22:27 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:27.828383 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-82c98ca2-3088-41a4-9131-9bed9d272642 tempest-ComputeTenantNetworksTest-469535837 tempest-ComputeTenantNetworksTest-469535837-project] 10.222.0.23 "GET /compute/v2.1/os-tenant-networks/1d247efd-e8d7-4692-9f9c-67265139abf3" status: 200 len: 140 microversion: 2.1 time: 0.211984 Oct 10 23:22:27.828872 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 798/1616] 10.222.0.23 () {58 vars in 1269 bytes} [Mon Oct 10 23:22:27 2022] GET /compute/v2.1/os-tenant-networks/1d247efd-e8d7-4692-9f9c-67265139abf3 => generated 140 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:28.043851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2f3b97fb-66df-4138-ab19-46e8da809d0b tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:28.044562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2f3b97fb-66df-4138-ab19-46e8da809d0b tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 6656fd97-0371-4915-a530-5741f3d335bd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:28.058994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f3b97fb-66df-4138-ab19-46e8da809d0b tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:28.059883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f3b97fb-66df-4138-ab19-46e8da809d0b tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:28.060568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f3b97fb-66df-4138-ab19-46e8da809d0b tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:28.061836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f3b97fb-66df-4138-ab19-46e8da809d0b tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:28.062536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f3b97fb-66df-4138-ab19-46e8da809d0b tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:28.063200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f3b97fb-66df-4138-ab19-46e8da809d0b tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:28.648093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f9fc1cd8-64e4-4df8-817b-167a49f57b25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:28.649343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f9fc1cd8-64e4-4df8-817b-167a49f57b25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:28.686777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9fc1cd8-64e4-4df8-817b-167a49f57b25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:28.687586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9fc1cd8-64e4-4df8-817b-167a49f57b25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:28.691006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9fc1cd8-64e4-4df8-817b-167a49f57b25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:28.694074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9fc1cd8-64e4-4df8-817b-167a49f57b25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:28.695171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9fc1cd8-64e4-4df8-817b-167a49f57b25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:28.696601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9fc1cd8-64e4-4df8-817b-167a49f57b25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:28.706579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2f3b97fb-66df-4138-ab19-46e8da809d0b tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:28.730804 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2f3b97fb-66df-4138-ab19-46e8da809d0b tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd" status: 200 len: 1473 microversion: 2.1 time: 0.689800 Oct 10 23:22:28.731434 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 819/1617] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:28 2022] GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd => generated 1473 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:28.755387 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-893fa67e-82d5-4b2c-83e6-8e9f9b681fe4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:28.757932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-893fa67e-82d5-4b2c-83e6-8e9f9b681fe4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:28.769351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-893fa67e-82d5-4b2c-83e6-8e9f9b681fe4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:28.771209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-893fa67e-82d5-4b2c-83e6-8e9f9b681fe4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:28.772595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-893fa67e-82d5-4b2c-83e6-8e9f9b681fe4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:28.773788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-893fa67e-82d5-4b2c-83e6-8e9f9b681fe4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:28.774576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-893fa67e-82d5-4b2c-83e6-8e9f9b681fe4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:28.775516 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-893fa67e-82d5-4b2c-83e6-8e9f9b681fe4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:28.832624 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-893fa67e-82d5-4b2c-83e6-8e9f9b681fe4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099953 Oct 10 23:22:28.833459 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 820/1618] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:22:28 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:29.230647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:22:29.321178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4c22aa9d-90fa-48a7-a107-141b937afab9 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:29.322103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4c22aa9d-90fa-48a7-a107-141b937afab9 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:29.330763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c22aa9d-90fa-48a7-a107-141b937afab9 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:29.331505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c22aa9d-90fa-48a7-a107-141b937afab9 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:29.332200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c22aa9d-90fa-48a7-a107-141b937afab9 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:29.333095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c22aa9d-90fa-48a7-a107-141b937afab9 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:29.333748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c22aa9d-90fa-48a7-a107-141b937afab9 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:29.334329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c22aa9d-90fa-48a7-a107-141b937afab9 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:29.978917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-4c22aa9d-90fa-48a7-a107-141b937afab9 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lazy-loading 'services' on Instance uuid 58fcd7f0-d348-47b1-9b3d-f7514b940eb3 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:22:30.023533 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4c22aa9d-90fa-48a7-a107-141b937afab9 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 2424 microversion: 2.25 time: 0.705962 Oct 10 23:22:30.024139 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 821/1619] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:29 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 2424 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:22:30.044547 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f9fc1cd8-64e4-4df8-817b-167a49f57b25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:30.061598 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f9fc1cd8-64e4-4df8-817b-167a49f57b25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1474 microversion: 2.1 time: 1.417704 Oct 10 23:22:30.064204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f73127bc-9c3c-4ea8-98ed-b97467d6f3c4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:30.065037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f73127bc-9c3c-4ea8-98ed-b97467d6f3c4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 6656fd97-0371-4915-a530-5741f3d335bd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:30.073762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f73127bc-9c3c-4ea8-98ed-b97467d6f3c4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:30.074508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f73127bc-9c3c-4ea8-98ed-b97467d6f3c4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:30.077702 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f73127bc-9c3c-4ea8-98ed-b97467d6f3c4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:30.079038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f73127bc-9c3c-4ea8-98ed-b97467d6f3c4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:30.079866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f73127bc-9c3c-4ea8-98ed-b97467d6f3c4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:30.080470 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f73127bc-9c3c-4ea8-98ed-b97467d6f3c4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:30.082079 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 799/1620] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:28 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1474 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:30.087339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a27d7442-22e1-4036-b962-75850c385b3e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:30.089722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a27d7442-22e1-4036-b962-75850c385b3e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:30.096506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a27d7442-22e1-4036-b962-75850c385b3e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:30.097668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a27d7442-22e1-4036-b962-75850c385b3e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:30.098295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a27d7442-22e1-4036-b962-75850c385b3e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:30.099434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a27d7442-22e1-4036-b962-75850c385b3e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:30.104909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a27d7442-22e1-4036-b962-75850c385b3e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:30.105584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a27d7442-22e1-4036-b962-75850c385b3e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:30.150279 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a27d7442-22e1-4036-b962-75850c385b3e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066998 Oct 10 23:22:30.150866 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 800/1621] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:22:30 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:30.161895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8accdd31-930c-4417-a2f2-19b23712272e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860864-2", "block_migration": "auto"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:30.165935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8accdd31-930c-4417-a2f2-19b23712272e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:30.176982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8accdd31-930c-4417-a2f2-19b23712272e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:30.177907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8accdd31-930c-4417-a2f2-19b23712272e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:30.178345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8accdd31-930c-4417-a2f2-19b23712272e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:30.179479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8accdd31-930c-4417-a2f2-19b23712272e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:30.179932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8accdd31-930c-4417-a2f2-19b23712272e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:30.180357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8accdd31-930c-4417-a2f2-19b23712272e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:30.214851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-8accdd31-930c-4417-a2f2-19b23712272e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lazy-loading 'flavor' on Instance uuid 58fcd7f0-d348-47b1-9b3d-f7514b940eb3 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:22:30.231903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8accdd31-930c-4417-a2f2-19b23712272e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Going to try to live migrate instance to n-h1-860864-2 {{(pid=120613) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 23:22:30.416198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f73127bc-9c3c-4ea8-98ed-b97467d6f3c4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:30.448810 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f73127bc-9c3c-4ea8-98ed-b97467d6f3c4 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd" status: 200 len: 1431 microversion: 2.1 time: 0.394308 Oct 10 23:22:30.474272 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 822/1622] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:30 2022] GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd => generated 1431 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:30.519027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-a05b37b0-6e69-43d8-b8bd-75c6313670ce req-723f4eab-ad33-4490-8cd2-23a9b0f4c31d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6656fd97-0371-4915-a530-5741f3d335bd", "name": "network-vif-deleted", "tag": "1f4476d0-aee9-4380-baee-92028b057cb4"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:30.567734 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a05b37b0-6e69-43d8-b8bd-75c6313670ce req-723f4eab-ad33-4490-8cd2-23a9b0f4c31d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:30.581895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a05b37b0-6e69-43d8-b8bd-75c6313670ce req-723f4eab-ad33-4490-8cd2-23a9b0f4c31d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:30.585097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a05b37b0-6e69-43d8-b8bd-75c6313670ce req-723f4eab-ad33-4490-8cd2-23a9b0f4c31d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:30.633360 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-a05b37b0-6e69-43d8-b8bd-75c6313670ce req-723f4eab-ad33-4490-8cd2-23a9b0f4c31d service nova] Creating event network-vif-deleted:1f4476d0-aee9-4380-baee-92028b057cb4 for instance 6656fd97-0371-4915-a530-5741f3d335bd on n-h1-860864-2 Oct 10 23:22:30.652860 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-a05b37b0-6e69-43d8-b8bd-75c6313670ce req-723f4eab-ad33-4490-8cd2-23a9b0f4c31d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172297 Oct 10 23:22:30.658444 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 823/1623] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:31.082549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8916f34f-f16d-4989-980c-6665d9531648 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:31.083329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8916f34f-f16d-4989-980c-6665d9531648 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:31.106598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8916f34f-f16d-4989-980c-6665d9531648 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:31.112305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8916f34f-f16d-4989-980c-6665d9531648 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:31.112757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8916f34f-f16d-4989-980c-6665d9531648 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:31.118962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8916f34f-f16d-4989-980c-6665d9531648 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:31.119467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8916f34f-f16d-4989-980c-6665d9531648 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:31.123537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8916f34f-f16d-4989-980c-6665d9531648 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:31.370162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8916f34f-f16d-4989-980c-6665d9531648 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:31.382033 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8916f34f-f16d-4989-980c-6665d9531648 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1474 microversion: 2.1 time: 0.304660 Oct 10 23:22:31.396169 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 824/1624] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:31 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1474 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:31.412795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-96700c00-74b0-4bd0-b0bd-66432c5bc3ce tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:31.415482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-96700c00-74b0-4bd0-b0bd-66432c5bc3ce tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:31.431867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96700c00-74b0-4bd0-b0bd-66432c5bc3ce tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:31.432645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96700c00-74b0-4bd0-b0bd-66432c5bc3ce tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:31.434641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96700c00-74b0-4bd0-b0bd-66432c5bc3ce tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:31.436575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96700c00-74b0-4bd0-b0bd-66432c5bc3ce tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:31.439315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96700c00-74b0-4bd0-b0bd-66432c5bc3ce tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:31.440930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96700c00-74b0-4bd0-b0bd-66432c5bc3ce tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:31.453131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:22:31.560883 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-96700c00-74b0-4bd0-b0bd-66432c5bc3ce tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159852 Oct 10 23:22:31.563428 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 825/1625] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:22:31 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:31.586912 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dd2dbf3b-867f-4f9d-95fe-e38a72acbc25 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:31.593239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dd2dbf3b-867f-4f9d-95fe-e38a72acbc25 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 6656fd97-0371-4915-a530-5741f3d335bd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:31.612778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd2dbf3b-867f-4f9d-95fe-e38a72acbc25 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:31.616634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd2dbf3b-867f-4f9d-95fe-e38a72acbc25 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:31.617230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd2dbf3b-867f-4f9d-95fe-e38a72acbc25 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:31.619386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd2dbf3b-867f-4f9d-95fe-e38a72acbc25 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:31.620309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd2dbf3b-867f-4f9d-95fe-e38a72acbc25 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:31.624883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd2dbf3b-867f-4f9d-95fe-e38a72acbc25 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:31.684795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd2dbf3b-867f-4f9d-95fe-e38a72acbc25 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:31.686413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd2dbf3b-867f-4f9d-95fe-e38a72acbc25 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:31.686837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd2dbf3b-867f-4f9d-95fe-e38a72acbc25 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:31.687299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-dd2dbf3b-867f-4f9d-95fe-e38a72acbc25 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lazy-loading 'fault' on Instance uuid 6656fd97-0371-4915-a530-5741f3d335bd {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:22:31.738652 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dd2dbf3b-867f-4f9d-95fe-e38a72acbc25 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40517612a20f448d8812e505e14f105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84c3cf61abe4eb4901114ac1167f466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:31.749238 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dd2dbf3b-867f-4f9d-95fe-e38a72acbc25 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd" status: 200 len: 1308 microversion: 2.1 time: 0.180801 Oct 10 23:22:31.750268 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 826/1626] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:31 2022] GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd => generated 1308 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:31.945208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5c9c4cae-7f58-403b-939f-03d8cba97ebc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1272455190", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "2e70e5c7-da0e-4bbe-970c-c601496b5c6b"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:32.022854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-5c9c4cae-7f58-403b-939f-03d8cba97ebc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] validate_networks() for [('2e70e5c7-da0e-4bbe-970c-c601496b5c6b', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:22:32.822816 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8accdd31-930c-4417-a2f2-19b23712272e tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/action" status: 202 len: 0 microversion: 2.25 time: 2.668179 Oct 10 23:22:32.823764 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 801/1627] 10.222.0.23 () {62 vars in 1319 bytes} [Mon Oct 10 23:22:30 2022] POST /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/action => generated 0 bytes in 2670 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:22:32.831248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9f1b4617-e6da-495b-a592-9fe218c0f3ea tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:32.831869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9f1b4617-e6da-495b-a592-9fe218c0f3ea tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:32.847650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f1b4617-e6da-495b-a592-9fe218c0f3ea tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:32.848155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f1b4617-e6da-495b-a592-9fe218c0f3ea tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:32.848527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f1b4617-e6da-495b-a592-9fe218c0f3ea tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:32.849269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f1b4617-e6da-495b-a592-9fe218c0f3ea tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:32.849754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f1b4617-e6da-495b-a592-9fe218c0f3ea tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:32.852042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f1b4617-e6da-495b-a592-9fe218c0f3ea tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:33.132777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-5c9c4cae-7f58-403b-939f-03d8cba97ebc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:22:33.133294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-5c9c4cae-7f58-403b-939f-03d8cba97ebc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:22:33.133870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-5c9c4cae-7f58-403b-939f-03d8cba97ebc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:22:33.134505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-5c9c4cae-7f58-403b-939f-03d8cba97ebc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:22:33.135003 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-5c9c4cae-7f58-403b-939f-03d8cba97ebc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:22:33.146328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c9c4cae-7f58-403b-939f-03d8cba97ebc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:33.147219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c9c4cae-7f58-403b-939f-03d8cba97ebc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:33.147735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c9c4cae-7f58-403b-939f-03d8cba97ebc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:33.148620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c9c4cae-7f58-403b-939f-03d8cba97ebc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:33.149158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c9c4cae-7f58-403b-939f-03d8cba97ebc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:33.149670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c9c4cae-7f58-403b-939f-03d8cba97ebc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:33.172017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-5c9c4cae-7f58-403b-939f-03d8cba97ebc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Getting quotas for project 451d034bd7474164a08bd3374680c0d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:22:33.178049 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-5c9c4cae-7f58-403b-939f-03d8cba97ebc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Getting quotas for user 60c692636a4b4667a4eff5cde6e183bc and project 451d034bd7474164a08bd3374680c0d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:22:33.192804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5c9c4cae-7f58-403b-939f-03d8cba97ebc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:22:33.195654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5c9c4cae-7f58-403b-939f-03d8cba97ebc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: fe8a45b4-e6cb-434f-8e97-8caa78888257] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:22:33.272753 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5c9c4cae-7f58-403b-939f-03d8cba97ebc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.520642 Oct 10 23:22:33.274337 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 827/1628] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:22:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:22:33.285398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-64c1863b-d4f4-4913-919e-5acca1151b3f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:33.288093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-64c1863b-d4f4-4913-919e-5acca1151b3f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:33.295901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64c1863b-d4f4-4913-919e-5acca1151b3f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:33.296748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64c1863b-d4f4-4913-919e-5acca1151b3f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:33.297422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64c1863b-d4f4-4913-919e-5acca1151b3f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:33.298351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64c1863b-d4f4-4913-919e-5acca1151b3f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:33.299005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64c1863b-d4f4-4913-919e-5acca1151b3f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:33.299659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64c1863b-d4f4-4913-919e-5acca1151b3f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:33.351670 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-64c1863b-d4f4-4913-919e-5acca1151b3f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076005 Oct 10 23:22:33.352907 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 828/1629] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:22:33 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:22:33.358647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-181307bf-39e8-40d5-a837-a8e59e55fda5 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:33.359556 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-181307bf-39e8-40d5-a837-a8e59e55fda5 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] [instance: 6656fd97-0371-4915-a530-5741f3d335bd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:33.368162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-181307bf-39e8-40d5-a837-a8e59e55fda5 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:33.370241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-181307bf-39e8-40d5-a837-a8e59e55fda5 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:33.371919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-181307bf-39e8-40d5-a837-a8e59e55fda5 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:33.373553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-181307bf-39e8-40d5-a837-a8e59e55fda5 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:33.374303 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-181307bf-39e8-40d5-a837-a8e59e55fda5 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:33.374952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-181307bf-39e8-40d5-a837-a8e59e55fda5 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:33.388119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9f1b4617-e6da-495b-a592-9fe218c0f3ea tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:33.395991 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-181307bf-39e8-40d5-a837-a8e59e55fda5 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] HTTP exception thrown: Instance 6656fd97-0371-4915-a530-5741f3d335bd could not be found. Oct 10 23:22:33.397956 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9f1b4617-e6da-495b-a592-9fe218c0f3ea tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1474 microversion: 2.1 time: 0.573006 Oct 10 23:22:33.398766 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 802/1630] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:32 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1474 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:33.399237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-181307bf-39e8-40d5-a837-a8e59e55fda5 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Request method failure captured: Oct 10 23:22:33.399237 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd HTTP/1.1 Oct 10 23:22:33.399237 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:22:33.399237 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:22:33.399237 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:22:33.399237 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:22:33.399237 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:22:33.399237 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:22:33.399237 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:22:33.399237 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:22:33.399237 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKjrivCmJSNrdOHg1otD4ykmOiWlz1wMSRThIO0qvL5RWNJnk1nBXopk75yCpHTPB7x3UZz3nZxpdWkFw0KPRwStqoqpxf29lWJP0UTMglB6neSYqzDMpxCcausmooyWvB1xNSTVRa-SmXTI9b-oAvKVE4QsqBZvw_RwiM4IWtGYfbg Oct 10 23:22:33.399237 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:22:33.399237 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:22:33.399237 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:22:33.399237 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:22:33.399237 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:22:33.399237 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:22:33.399237 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: e84c3cf61abe4eb4901114ac1167f466 Oct 10 23:22:33.399237 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-LiveMigrationNegativeTest-1385943398 Oct 10 23:22:33.399237 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:22:33.399237 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:22:33.400843 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e84c3cf61abe4eb4901114ac1167f466"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e84c3cf61abe4eb4901114ac1167f466"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e84c3cf61abe4eb4901114ac1167f466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e84c3cf61abe4eb4901114ac1167f466", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:22:33.400843 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-LiveMigrationNegativeTest-1385943398 Oct 10 23:22:33.400843 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: e84c3cf61abe4eb4901114ac1167f466 Oct 10 23:22:33.400843 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1385943398 Oct 10 23:22:33.400843 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-LiveMigrationNegativeTest-1385943398-project Oct 10 23:22:33.400843 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:22:33.400843 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:22:33.400843 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 40517612a20f448d8812e505e14f105e Oct 10 23:22:33.400843 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-LiveMigrationNegativeTest-1385943398-project Oct 10 23:22:33.400843 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:22:33.400843 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 6656fd97-0371-4915-a530-5741f3d335bd could not be found. Oct 10 23:22:33.400843 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '6656fd97-0371-4915-a530-5741f3d335bd'} Oct 10 23:22:33.401744 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:22:33.401744 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:33.401744 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:22:33.401744 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:22:33.401744 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:22:33.401744 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:22:33.401744 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:22:33.401744 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:22:33.401744 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:22:33.401744 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:22:33.401744 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6656fd97-0371-4915-a530-5741f3d335bd could not be found. Oct 10 23:22:33.401744 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:33.401744 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:22:33.401744 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:33.401744 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:33.401744 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:22:33.401744 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:22:33.401744 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:22:33.401744 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:22:33.401744 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:22:33.404664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:22:33.404664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:22:33.404664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:22:33.404664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:22:33.404664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:22:33.404664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:22:33.404664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:22:33.404664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6656fd97-0371-4915-a530-5741f3d335bd could not be found. Oct 10 23:22:33.404664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:33.404664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:22:33.404664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:33.404664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:22:33.404664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:22:33.404664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:22:33.404664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:22:33.404664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:22:33.404664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6656fd97-0371-4915-a530-5741f3d335bd could not be found. Oct 10 23:22:33.404664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:22:33.408268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-181307bf-39e8-40d5-a837-a8e59e55fda5 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Returning 404 to user: Instance 6656fd97-0371-4915-a530-5741f3d335bd could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:22:33.409765 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-181307bf-39e8-40d5-a837-a8e59e55fda5 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd" status: 404 len: 111 microversion: 2.1 time: 0.055210 Oct 10 23:22:33.410567 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 829/1631] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:33 2022] GET /compute/v2.1/servers/6656fd97-0371-4915-a530-5741f3d335bd => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:22:33.411859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-181307bf-39e8-40d5-a837-a8e59e55fda5 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:33.413152 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-181307bf-39e8-40d5-a837-a8e59e55fda5 tempest-LiveMigrationNegativeTest-1385943398 tempest-LiveMigrationNegativeTest-1385943398-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001369 Oct 10 23:22:33.414233 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 830/1632] 10.222.0.23 () {56 vars in 886 bytes} [Mon Oct 10 23:22:33 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 10 23:22:33.420208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b0e5767c-3cb3-4867-bbdf-2668e5f64e02 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:33.421196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b0e5767c-3cb3-4867-bbdf-2668e5f64e02 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: fe8a45b4-e6cb-434f-8e97-8caa78888257] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:33.432790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-28f18c76-7155-4925-91f1-a60b62890367 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:33.433450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-28f18c76-7155-4925-91f1-a60b62890367 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:33.459747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28f18c76-7155-4925-91f1-a60b62890367 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:33.460250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28f18c76-7155-4925-91f1-a60b62890367 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:33.460806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28f18c76-7155-4925-91f1-a60b62890367 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:33.461437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28f18c76-7155-4925-91f1-a60b62890367 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:33.461875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28f18c76-7155-4925-91f1-a60b62890367 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:33.463503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28f18c76-7155-4925-91f1-a60b62890367 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:33.502542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b0e5767c-3cb3-4867-bbdf-2668e5f64e02 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:33.512364 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b0e5767c-3cb3-4867-bbdf-2668e5f64e02 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257" status: 200 len: 1208 microversion: 2.1 time: 0.095456 Oct 10 23:22:33.517422 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 831/1633] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:33 2022] GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257 => generated 1208 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:33.517422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b0e5767c-3cb3-4867-bbdf-2668e5f64e02 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:33.517422 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b0e5767c-3cb3-4867-bbdf-2668e5f64e02 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001425 Oct 10 23:22:33.517422 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 832/1634] 10.222.0.23 () {54 vars in 1035 bytes} [Mon Oct 10 23:22:33 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 10 23:22:33.524672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b0e5767c-3cb3-4867-bbdf-2668e5f64e02 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:33.525766 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b0e5767c-3cb3-4867-bbdf-2668e5f64e02 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001411 Oct 10 23:22:33.526508 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 833/1635] 10.222.0.23 () {54 vars in 1041 bytes} [Mon Oct 10 23:22:33 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:22:33.536141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b0e5767c-3cb3-4867-bbdf-2668e5f64e02 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:33.537879 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b0e5767c-3cb3-4867-bbdf-2668e5f64e02 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002160 Oct 10 23:22:33.540592 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 834/1636] 10.222.0.23 () {56 vars in 886 bytes} [Mon Oct 10 23:22:33 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 10 23:22:33.787696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-28f18c76-7155-4925-91f1-a60b62890367 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:33.802948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-28f18c76-7155-4925-91f1-a60b62890367 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:33.805040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-28f18c76-7155-4925-91f1-a60b62890367 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:33.806992 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-28f18c76-7155-4925-91f1-a60b62890367 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.383029 Oct 10 23:22:33.822825 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 803/1637] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:33 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:22:34.426137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9df986ff-1b39-475a-aa96-87ebd0e30cdc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:34.426912 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9df986ff-1b39-475a-aa96-87ebd0e30cdc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:34.449125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9df986ff-1b39-475a-aa96-87ebd0e30cdc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:34.449817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9df986ff-1b39-475a-aa96-87ebd0e30cdc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:34.451588 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9df986ff-1b39-475a-aa96-87ebd0e30cdc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:34.452482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9df986ff-1b39-475a-aa96-87ebd0e30cdc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:34.453102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9df986ff-1b39-475a-aa96-87ebd0e30cdc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:34.454350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9df986ff-1b39-475a-aa96-87ebd0e30cdc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:34.540596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d03c9d6d-9257-4e16-8e3a-85c5e105d451 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:34.541482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d03c9d6d-9257-4e16-8e3a-85c5e105d451 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: fe8a45b4-e6cb-434f-8e97-8caa78888257] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:34.553618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d03c9d6d-9257-4e16-8e3a-85c5e105d451 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:34.556402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d03c9d6d-9257-4e16-8e3a-85c5e105d451 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:34.557146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d03c9d6d-9257-4e16-8e3a-85c5e105d451 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:34.559594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d03c9d6d-9257-4e16-8e3a-85c5e105d451 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:34.560301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d03c9d6d-9257-4e16-8e3a-85c5e105d451 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:34.567460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d03c9d6d-9257-4e16-8e3a-85c5e105d451 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:34.880489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9df986ff-1b39-475a-aa96-87ebd0e30cdc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:34.895114 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9df986ff-1b39-475a-aa96-87ebd0e30cdc tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1474 microversion: 2.1 time: 0.472984 Oct 10 23:22:34.897141 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 835/1638] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:34 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1474 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:34.923964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a9373752-c3f3-4322-a4ce-a320b9fbdb7f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:34.930078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a9373752-c3f3-4322-a4ce-a320b9fbdb7f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:34.959631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9373752-c3f3-4322-a4ce-a320b9fbdb7f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:34.962347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9373752-c3f3-4322-a4ce-a320b9fbdb7f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:34.962774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9373752-c3f3-4322-a4ce-a320b9fbdb7f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:34.963544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9373752-c3f3-4322-a4ce-a320b9fbdb7f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:34.964015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9373752-c3f3-4322-a4ce-a320b9fbdb7f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:34.970608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9373752-c3f3-4322-a4ce-a320b9fbdb7f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:35.049792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d03c9d6d-9257-4e16-8e3a-85c5e105d451 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:35.068292 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d03c9d6d-9257-4e16-8e3a-85c5e105d451 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257" status: 200 len: 1204 microversion: 2.1 time: 0.531588 Oct 10 23:22:35.070046 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 804/1639] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:34 2022] GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257 => generated 1204 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:35.684611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a9373752-c3f3-4322-a4ce-a320b9fbdb7f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:35.706244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a9373752-c3f3-4322-a4ce-a320b9fbdb7f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:35.710273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a9373752-c3f3-4322-a4ce-a320b9fbdb7f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:35.722569 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a9373752-c3f3-4322-a4ce-a320b9fbdb7f tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.814198 Oct 10 23:22:35.726076 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 836/1640] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:34 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:22:35.924881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e492858a-7c02-405e-a392-9fadde807822 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:35.925757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e492858a-7c02-405e-a392-9fadde807822 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:35.943929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e492858a-7c02-405e-a392-9fadde807822 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:35.954524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e492858a-7c02-405e-a392-9fadde807822 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:35.956106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e492858a-7c02-405e-a392-9fadde807822 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:35.957628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e492858a-7c02-405e-a392-9fadde807822 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:35.964571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e492858a-7c02-405e-a392-9fadde807822 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:35.965250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e492858a-7c02-405e-a392-9fadde807822 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:36.101936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dacdfa62-a159-4289-ae8d-f1b6548b79d2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:36.102603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dacdfa62-a159-4289-ae8d-f1b6548b79d2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: fe8a45b4-e6cb-434f-8e97-8caa78888257] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:36.143296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dacdfa62-a159-4289-ae8d-f1b6548b79d2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:36.143788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dacdfa62-a159-4289-ae8d-f1b6548b79d2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:36.152662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dacdfa62-a159-4289-ae8d-f1b6548b79d2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:36.153570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dacdfa62-a159-4289-ae8d-f1b6548b79d2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:36.154055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dacdfa62-a159-4289-ae8d-f1b6548b79d2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:36.156645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dacdfa62-a159-4289-ae8d-f1b6548b79d2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:36.328237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dacdfa62-a159-4289-ae8d-f1b6548b79d2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:36.337537 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dacdfa62-a159-4289-ae8d-f1b6548b79d2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257" status: 200 len: 1278 microversion: 2.1 time: 0.245030 Oct 10 23:22:36.338129 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 837/1641] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:36 2022] GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257 => generated 1278 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:22:36.449022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e492858a-7c02-405e-a392-9fadde807822 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:36.463376 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e492858a-7c02-405e-a392-9fadde807822 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1474 microversion: 2.1 time: 0.541162 Oct 10 23:22:36.464987 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 805/1642] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:35 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1474 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:36.753116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2038ea08-3ec2-42e9-b092-583ff38b5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:36.753768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2038ea08-3ec2-42e9-b092-583ff38b5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:36.775018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2038ea08-3ec2-42e9-b092-583ff38b5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:36.776962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2038ea08-3ec2-42e9-b092-583ff38b5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:36.777434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2038ea08-3ec2-42e9-b092-583ff38b5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:36.778167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2038ea08-3ec2-42e9-b092-583ff38b5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:36.778629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2038ea08-3ec2-42e9-b092-583ff38b5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:36.779051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2038ea08-3ec2-42e9-b092-583ff38b5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:37.282695 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2038ea08-3ec2-42e9-b092-583ff38b5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:37.298279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2038ea08-3ec2-42e9-b092-583ff38b5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:37.304972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2038ea08-3ec2-42e9-b092-583ff38b5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:37.308528 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2038ea08-3ec2-42e9-b092-583ff38b5cc7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.560214 Oct 10 23:22:37.327281 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 838/1643] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:36 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:22:37.364291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3eb06b81-696c-4d4d-be6c-d4964445fe97 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:37.365541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3eb06b81-696c-4d4d-be6c-d4964445fe97 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: fe8a45b4-e6cb-434f-8e97-8caa78888257] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:37.386371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3eb06b81-696c-4d4d-be6c-d4964445fe97 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:37.387150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3eb06b81-696c-4d4d-be6c-d4964445fe97 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:37.387777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3eb06b81-696c-4d4d-be6c-d4964445fe97 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:37.390212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3eb06b81-696c-4d4d-be6c-d4964445fe97 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:37.392811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3eb06b81-696c-4d4d-be6c-d4964445fe97 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:37.393493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3eb06b81-696c-4d4d-be6c-d4964445fe97 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:37.490297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2ac02217-da20-48b4-a550-0aff225ecf25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:37.491128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2ac02217-da20-48b4-a550-0aff225ecf25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:37.502250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ac02217-da20-48b4-a550-0aff225ecf25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:37.503106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ac02217-da20-48b4-a550-0aff225ecf25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:37.503880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ac02217-da20-48b4-a550-0aff225ecf25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:37.505148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ac02217-da20-48b4-a550-0aff225ecf25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:37.505960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ac02217-da20-48b4-a550-0aff225ecf25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:37.506583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ac02217-da20-48b4-a550-0aff225ecf25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:37.540732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3eb06b81-696c-4d4d-be6c-d4964445fe97 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:37.564550 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3eb06b81-696c-4d4d-be6c-d4964445fe97 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257" status: 200 len: 1266 microversion: 2.1 time: 0.203421 Oct 10 23:22:37.565924 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 806/1644] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:37 2022] GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:38.317340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2ac02217-da20-48b4-a550-0aff225ecf25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:38.327263 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2ac02217-da20-48b4-a550-0aff225ecf25 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1474 microversion: 2.1 time: 0.841592 Oct 10 23:22:38.341897 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 839/1645] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:37 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1474 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:38.342683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2c783c71-8b88-4e1e-a4fe-0babddac7910 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:38.342939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2c783c71-8b88-4e1e-a4fe-0babddac7910 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:38.354951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c783c71-8b88-4e1e-a4fe-0babddac7910 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:38.355450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c783c71-8b88-4e1e-a4fe-0babddac7910 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:38.366092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c783c71-8b88-4e1e-a4fe-0babddac7910 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:38.366874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c783c71-8b88-4e1e-a4fe-0babddac7910 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:38.367358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c783c71-8b88-4e1e-a4fe-0babddac7910 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:38.367796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c783c71-8b88-4e1e-a4fe-0babddac7910 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:38.606912 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-24f3e53d-bbcb-452e-9dc5-13f984633d40 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:38.608347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-24f3e53d-bbcb-452e-9dc5-13f984633d40 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: fe8a45b4-e6cb-434f-8e97-8caa78888257] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:38.628944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24f3e53d-bbcb-452e-9dc5-13f984633d40 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:38.638329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24f3e53d-bbcb-452e-9dc5-13f984633d40 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:38.639311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24f3e53d-bbcb-452e-9dc5-13f984633d40 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:38.640286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24f3e53d-bbcb-452e-9dc5-13f984633d40 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:38.640968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24f3e53d-bbcb-452e-9dc5-13f984633d40 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:38.641672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24f3e53d-bbcb-452e-9dc5-13f984633d40 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:39.035705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2c783c71-8b88-4e1e-a4fe-0babddac7910 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:39.050215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2c783c71-8b88-4e1e-a4fe-0babddac7910 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:39.054554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2c783c71-8b88-4e1e-a4fe-0babddac7910 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:39.059657 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2c783c71-8b88-4e1e-a4fe-0babddac7910 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.723222 Oct 10 23:22:39.060743 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 807/1646] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:38 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:22:39.100768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-24f3e53d-bbcb-452e-9dc5-13f984633d40 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:39.117349 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-24f3e53d-bbcb-452e-9dc5-13f984633d40 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257" status: 200 len: 1308 microversion: 2.1 time: 0.516278 Oct 10 23:22:39.121403 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 840/1647] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:38 2022] GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257 => generated 1308 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:39.352296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-983737f7-5424-408d-b37a-7a9ccbcef1bd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:39.353096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-983737f7-5424-408d-b37a-7a9ccbcef1bd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:39.375762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-983737f7-5424-408d-b37a-7a9ccbcef1bd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:39.377154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-983737f7-5424-408d-b37a-7a9ccbcef1bd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:39.377868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-983737f7-5424-408d-b37a-7a9ccbcef1bd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:39.379125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-983737f7-5424-408d-b37a-7a9ccbcef1bd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:39.379986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-983737f7-5424-408d-b37a-7a9ccbcef1bd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:39.380675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-983737f7-5424-408d-b37a-7a9ccbcef1bd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:39.407875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:22:39.810502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-983737f7-5424-408d-b37a-7a9ccbcef1bd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:39.824529 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-983737f7-5424-408d-b37a-7a9ccbcef1bd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1474 microversion: 2.1 time: 0.473556 Oct 10 23:22:39.832662 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 808/1648] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:39 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1474 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:40.087033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7ca17e59-265c-4008-9fe2-e2ed5ab422c3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:40.087649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7ca17e59-265c-4008-9fe2-e2ed5ab422c3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:40.103439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ca17e59-265c-4008-9fe2-e2ed5ab422c3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:40.104699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ca17e59-265c-4008-9fe2-e2ed5ab422c3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:40.110732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ca17e59-265c-4008-9fe2-e2ed5ab422c3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:40.113629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ca17e59-265c-4008-9fe2-e2ed5ab422c3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:40.119866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ca17e59-265c-4008-9fe2-e2ed5ab422c3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:40.120597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ca17e59-265c-4008-9fe2-e2ed5ab422c3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:40.145644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-25523133-67c8-4b25-aead-0e29570c5890 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:40.147776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-25523133-67c8-4b25-aead-0e29570c5890 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: fe8a45b4-e6cb-434f-8e97-8caa78888257] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:40.165966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25523133-67c8-4b25-aead-0e29570c5890 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:40.167654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25523133-67c8-4b25-aead-0e29570c5890 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:40.168282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25523133-67c8-4b25-aead-0e29570c5890 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:40.171693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25523133-67c8-4b25-aead-0e29570c5890 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:40.173143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25523133-67c8-4b25-aead-0e29570c5890 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:40.175416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25523133-67c8-4b25-aead-0e29570c5890 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:40.488951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7ca17e59-265c-4008-9fe2-e2ed5ab422c3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:40.504766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7ca17e59-265c-4008-9fe2-e2ed5ab422c3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:40.510190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7ca17e59-265c-4008-9fe2-e2ed5ab422c3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:40.513342 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7ca17e59-265c-4008-9fe2-e2ed5ab422c3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.428757 Oct 10 23:22:40.516020 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 841/1649] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:40 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:22:40.529536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-667e6307-8771-4983-a601-7181c60b519e req-4973d4ab-74e6-4dda-96a1-4c55a9e15a25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe8a45b4-e6cb-434f-8e97-8caa78888257", "tag": "825c46b6-1861-46dc-990c-5e0e0232f588"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:40.561107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-667e6307-8771-4983-a601-7181c60b519e req-4973d4ab-74e6-4dda-96a1-4c55a9e15a25 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:40.564514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-667e6307-8771-4983-a601-7181c60b519e req-4973d4ab-74e6-4dda-96a1-4c55a9e15a25 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:40.566908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-667e6307-8771-4983-a601-7181c60b519e req-4973d4ab-74e6-4dda-96a1-4c55a9e15a25 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:40.591481 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-667e6307-8771-4983-a601-7181c60b519e req-4973d4ab-74e6-4dda-96a1-4c55a9e15a25 service nova] Creating event network-changed:825c46b6-1861-46dc-990c-5e0e0232f588 for instance fe8a45b4-e6cb-434f-8e97-8caa78888257 on n-h1-860864-2 Oct 10 23:22:40.604809 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-667e6307-8771-4983-a601-7181c60b519e req-4973d4ab-74e6-4dda-96a1-4c55a9e15a25 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082159 Oct 10 23:22:40.606199 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 842/1650] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:40.616195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-25523133-67c8-4b25-aead-0e29570c5890 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:40.630534 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-25523133-67c8-4b25-aead-0e29570c5890 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257" status: 200 len: 1308 microversion: 2.1 time: 0.489595 Oct 10 23:22:40.632810 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 809/1651] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:40 2022] GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257 => generated 1308 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:40.858903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6095d31b-09f4-48e8-913e-12f373c94467 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:40.859941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6095d31b-09f4-48e8-913e-12f373c94467 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:40.870149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6095d31b-09f4-48e8-913e-12f373c94467 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:40.871716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6095d31b-09f4-48e8-913e-12f373c94467 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:40.872199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6095d31b-09f4-48e8-913e-12f373c94467 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:40.872963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6095d31b-09f4-48e8-913e-12f373c94467 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:40.874298 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6095d31b-09f4-48e8-913e-12f373c94467 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:40.874743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6095d31b-09f4-48e8-913e-12f373c94467 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:41.555094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0bc06038-94e3-41b8-a0d3-d82a10210f59 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:41.556484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0bc06038-94e3-41b8-a0d3-d82a10210f59 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:41.574351 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0bc06038-94e3-41b8-a0d3-d82a10210f59 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:41.575381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0bc06038-94e3-41b8-a0d3-d82a10210f59 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:41.577502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0bc06038-94e3-41b8-a0d3-d82a10210f59 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:41.580666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0bc06038-94e3-41b8-a0d3-d82a10210f59 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:41.582755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0bc06038-94e3-41b8-a0d3-d82a10210f59 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:41.583909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0bc06038-94e3-41b8-a0d3-d82a10210f59 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:41.593856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6095d31b-09f4-48e8-913e-12f373c94467 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:41.616985 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6095d31b-09f4-48e8-913e-12f373c94467 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1474 microversion: 2.1 time: 0.762716 Oct 10 23:22:41.621773 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 843/1652] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:40 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1474 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:41.667301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f30a3a58-cbe3-4eb9-98ff-2790196bc073 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:41.668235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f30a3a58-cbe3-4eb9-98ff-2790196bc073 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: fe8a45b4-e6cb-434f-8e97-8caa78888257] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:41.687958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f30a3a58-cbe3-4eb9-98ff-2790196bc073 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:41.688689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f30a3a58-cbe3-4eb9-98ff-2790196bc073 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:41.689252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f30a3a58-cbe3-4eb9-98ff-2790196bc073 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:41.691449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f30a3a58-cbe3-4eb9-98ff-2790196bc073 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:41.694253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f30a3a58-cbe3-4eb9-98ff-2790196bc073 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:41.694820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f30a3a58-cbe3-4eb9-98ff-2790196bc073 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:41.924154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0bc06038-94e3-41b8-a0d3-d82a10210f59 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:41.939872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0bc06038-94e3-41b8-a0d3-d82a10210f59 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:41.941791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0bc06038-94e3-41b8-a0d3-d82a10210f59 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:41.943140 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0bc06038-94e3-41b8-a0d3-d82a10210f59 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.398794 Oct 10 23:22:41.943752 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 810/1653] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:41 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:22:42.257828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f30a3a58-cbe3-4eb9-98ff-2790196bc073 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:42.266824 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f30a3a58-cbe3-4eb9-98ff-2790196bc073 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257" status: 200 len: 1308 microversion: 2.1 time: 0.604508 Oct 10 23:22:42.271781 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 844/1654] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:41 2022] GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257 => generated 1308 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:42.653766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0f647f5b-80fb-4d56-8eaa-d54fe1ea0fc1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:42.656549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0f647f5b-80fb-4d56-8eaa-d54fe1ea0fc1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:42.672199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f647f5b-80fb-4d56-8eaa-d54fe1ea0fc1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:42.674253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f647f5b-80fb-4d56-8eaa-d54fe1ea0fc1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:42.675169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f647f5b-80fb-4d56-8eaa-d54fe1ea0fc1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:42.677334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f647f5b-80fb-4d56-8eaa-d54fe1ea0fc1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:42.679476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f647f5b-80fb-4d56-8eaa-d54fe1ea0fc1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:42.680886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f647f5b-80fb-4d56-8eaa-d54fe1ea0fc1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:42.972893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d9d82c6f-776e-425b-91b6-6e812768e851 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:42.973578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d9d82c6f-776e-425b-91b6-6e812768e851 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:42.975545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:22:42.984165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d82c6f-776e-425b-91b6-6e812768e851 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:42.984675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d82c6f-776e-425b-91b6-6e812768e851 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:42.985113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d82c6f-776e-425b-91b6-6e812768e851 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:42.985904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d82c6f-776e-425b-91b6-6e812768e851 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:42.986465 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d82c6f-776e-425b-91b6-6e812768e851 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:42.986905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d82c6f-776e-425b-91b6-6e812768e851 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:43.163882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:22:43.204496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0f647f5b-80fb-4d56-8eaa-d54fe1ea0fc1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:43.233021 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0f647f5b-80fb-4d56-8eaa-d54fe1ea0fc1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1474 microversion: 2.1 time: 0.585714 Oct 10 23:22:43.234712 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 811/1655] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:42 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1474 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:43.297687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-124d3d43-acdf-45e4-99a9-2d12094db2db tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:43.298519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-124d3d43-acdf-45e4-99a9-2d12094db2db tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: fe8a45b4-e6cb-434f-8e97-8caa78888257] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:43.313892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-124d3d43-acdf-45e4-99a9-2d12094db2db tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:43.314712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-124d3d43-acdf-45e4-99a9-2d12094db2db tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:43.316104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-124d3d43-acdf-45e4-99a9-2d12094db2db tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:43.317015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-124d3d43-acdf-45e4-99a9-2d12094db2db tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:43.318417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-124d3d43-acdf-45e4-99a9-2d12094db2db tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:43.318868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-124d3d43-acdf-45e4-99a9-2d12094db2db tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:43.507055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=8 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:22:43.526895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d9d82c6f-776e-425b-91b6-6e812768e851 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:43.557520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d9d82c6f-776e-425b-91b6-6e812768e851 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:43.564562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d9d82c6f-776e-425b-91b6-6e812768e851 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:43.569008 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d9d82c6f-776e-425b-91b6-6e812768e851 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.597170 Oct 10 23:22:43.569809 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 845/1656] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:42 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:22:43.670488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-124d3d43-acdf-45e4-99a9-2d12094db2db tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:43.682902 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-124d3d43-acdf-45e4-99a9-2d12094db2db tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257" status: 200 len: 1308 microversion: 2.1 time: 0.389104 Oct 10 23:22:43.687858 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 812/1657] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:43 2022] GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257 => generated 1308 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:44.268344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c667efcb-e167-4eb8-a7c1-d7ffb8f55904 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:44.271215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c667efcb-e167-4eb8-a7c1-d7ffb8f55904 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:44.316905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c667efcb-e167-4eb8-a7c1-d7ffb8f55904 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:44.317662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c667efcb-e167-4eb8-a7c1-d7ffb8f55904 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:44.318122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c667efcb-e167-4eb8-a7c1-d7ffb8f55904 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:44.318897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c667efcb-e167-4eb8-a7c1-d7ffb8f55904 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:44.319368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c667efcb-e167-4eb8-a7c1-d7ffb8f55904 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:44.320448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c667efcb-e167-4eb8-a7c1-d7ffb8f55904 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:44.597815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4d5b2953-c532-4008-93cb-a4e5a7ce66d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:44.598677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4d5b2953-c532-4008-93cb-a4e5a7ce66d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:44.613265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d5b2953-c532-4008-93cb-a4e5a7ce66d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:44.614070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d5b2953-c532-4008-93cb-a4e5a7ce66d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:44.614732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d5b2953-c532-4008-93cb-a4e5a7ce66d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:44.615660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d5b2953-c532-4008-93cb-a4e5a7ce66d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:44.622402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d5b2953-c532-4008-93cb-a4e5a7ce66d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:44.623709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d5b2953-c532-4008-93cb-a4e5a7ce66d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:44.647530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c667efcb-e167-4eb8-a7c1-d7ffb8f55904 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:44.661813 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c667efcb-e167-4eb8-a7c1-d7ffb8f55904 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1474 microversion: 2.1 time: 0.403034 Oct 10 23:22:44.668142 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 846/1658] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:44 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1474 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:44.711567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1613e594-a32d-47a7-b8d2-a469830bd25a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:44.712198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1613e594-a32d-47a7-b8d2-a469830bd25a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: fe8a45b4-e6cb-434f-8e97-8caa78888257] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:44.724787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1613e594-a32d-47a7-b8d2-a469830bd25a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:44.725296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1613e594-a32d-47a7-b8d2-a469830bd25a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:44.725775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1613e594-a32d-47a7-b8d2-a469830bd25a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:44.726485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1613e594-a32d-47a7-b8d2-a469830bd25a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:44.727177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1613e594-a32d-47a7-b8d2-a469830bd25a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:44.727808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1613e594-a32d-47a7-b8d2-a469830bd25a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:45.075684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1613e594-a32d-47a7-b8d2-a469830bd25a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:45.090111 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1613e594-a32d-47a7-b8d2-a469830bd25a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257" status: 200 len: 1308 microversion: 2.1 time: 0.382376 Oct 10 23:22:45.090710 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 847/1659] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:44 2022] GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257 => generated 1308 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:22:45.602320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4d5b2953-c532-4008-93cb-a4e5a7ce66d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:45.618467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4d5b2953-c532-4008-93cb-a4e5a7ce66d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:45.622182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4d5b2953-c532-4008-93cb-a4e5a7ce66d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:45.645256 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4d5b2953-c532-4008-93cb-a4e5a7ce66d7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 1.044944 Oct 10 23:22:45.645950 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 813/1660] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:44 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:22:45.697508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ac2857dd-9c53-4b9e-a613-1a764a133a6f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:45.699358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ac2857dd-9c53-4b9e-a613-1a764a133a6f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:45.718143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac2857dd-9c53-4b9e-a613-1a764a133a6f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:45.719395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac2857dd-9c53-4b9e-a613-1a764a133a6f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:45.721928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac2857dd-9c53-4b9e-a613-1a764a133a6f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:45.722955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac2857dd-9c53-4b9e-a613-1a764a133a6f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:45.725724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac2857dd-9c53-4b9e-a613-1a764a133a6f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:45.726437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac2857dd-9c53-4b9e-a613-1a764a133a6f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:45.791961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:22:46.062343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ac2857dd-9c53-4b9e-a613-1a764a133a6f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:46.076889 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ac2857dd-9c53-4b9e-a613-1a764a133a6f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1474 microversion: 2.1 time: 0.384414 Oct 10 23:22:46.093548 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 848/1661] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:45 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1474 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:46.114002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f6aa253a-9261-436b-9f12-7cdec6fcbae7 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:46.114831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f6aa253a-9261-436b-9f12-7cdec6fcbae7 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: fe8a45b4-e6cb-434f-8e97-8caa78888257] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:46.125662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:22:46.130696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6aa253a-9261-436b-9f12-7cdec6fcbae7 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:46.131210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6aa253a-9261-436b-9f12-7cdec6fcbae7 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:46.133564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6aa253a-9261-436b-9f12-7cdec6fcbae7 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:46.134977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6aa253a-9261-436b-9f12-7cdec6fcbae7 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:46.138728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6aa253a-9261-436b-9f12-7cdec6fcbae7 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:46.139296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6aa253a-9261-436b-9f12-7cdec6fcbae7 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:46.499942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f6aa253a-9261-436b-9f12-7cdec6fcbae7 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:46.511160 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f6aa253a-9261-436b-9f12-7cdec6fcbae7 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257" status: 200 len: 1308 microversion: 2.1 time: 0.401446 Oct 10 23:22:46.525944 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 814/1662] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:46 2022] GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257 => generated 1308 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:46.672396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5962cb26-3dbf-4a8b-97da-7fb904025aa5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:46.673020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5962cb26-3dbf-4a8b-97da-7fb904025aa5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:46.687843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5962cb26-3dbf-4a8b-97da-7fb904025aa5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:46.688368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5962cb26-3dbf-4a8b-97da-7fb904025aa5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:46.688783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5962cb26-3dbf-4a8b-97da-7fb904025aa5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:46.694348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5962cb26-3dbf-4a8b-97da-7fb904025aa5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:46.697052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5962cb26-3dbf-4a8b-97da-7fb904025aa5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:46.699126 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5962cb26-3dbf-4a8b-97da-7fb904025aa5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:47.048511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5962cb26-3dbf-4a8b-97da-7fb904025aa5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:47.079212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5962cb26-3dbf-4a8b-97da-7fb904025aa5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:47.096634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5962cb26-3dbf-4a8b-97da-7fb904025aa5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:47.098810 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5962cb26-3dbf-4a8b-97da-7fb904025aa5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.431334 Oct 10 23:22:47.100106 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 849/1663] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:46 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:22:47.108207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8ac5a19f-1ca3-4c27-b488-d4a95ee328d1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:47.110453 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8ac5a19f-1ca3-4c27-b488-d4a95ee328d1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:47.129835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ac5a19f-1ca3-4c27-b488-d4a95ee328d1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:47.131472 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ac5a19f-1ca3-4c27-b488-d4a95ee328d1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:47.133285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ac5a19f-1ca3-4c27-b488-d4a95ee328d1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:47.135024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ac5a19f-1ca3-4c27-b488-d4a95ee328d1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:47.135756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ac5a19f-1ca3-4c27-b488-d4a95ee328d1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:47.136624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ac5a19f-1ca3-4c27-b488-d4a95ee328d1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:47.413920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8ac5a19f-1ca3-4c27-b488-d4a95ee328d1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:47.427453 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8ac5a19f-1ca3-4c27-b488-d4a95ee328d1 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1474 microversion: 2.1 time: 0.327270 Oct 10 23:22:47.428088 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 815/1664] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:47 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1474 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:47.558169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-da7c9072-7aba-422b-b455-5f59fc315c81 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:47.559579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-da7c9072-7aba-422b-b455-5f59fc315c81 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: fe8a45b4-e6cb-434f-8e97-8caa78888257] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:47.570079 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da7c9072-7aba-422b-b455-5f59fc315c81 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:47.572720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da7c9072-7aba-422b-b455-5f59fc315c81 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:47.578800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da7c9072-7aba-422b-b455-5f59fc315c81 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:47.581235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da7c9072-7aba-422b-b455-5f59fc315c81 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:47.582760 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da7c9072-7aba-422b-b455-5f59fc315c81 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:47.585920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da7c9072-7aba-422b-b455-5f59fc315c81 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:48.021782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-da7c9072-7aba-422b-b455-5f59fc315c81 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:48.048063 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-da7c9072-7aba-422b-b455-5f59fc315c81 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257" status: 200 len: 1308 microversion: 2.1 time: 0.496917 Oct 10 23:22:48.052789 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 850/1665] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:47 2022] GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257 => generated 1308 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:48.128486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-29fb5cb5-9db3-4761-baf0-c77034d230b8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:48.129146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-29fb5cb5-9db3-4761-baf0-c77034d230b8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:48.149223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29fb5cb5-9db3-4761-baf0-c77034d230b8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:48.149744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29fb5cb5-9db3-4761-baf0-c77034d230b8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:48.151359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29fb5cb5-9db3-4761-baf0-c77034d230b8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:48.158506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29fb5cb5-9db3-4761-baf0-c77034d230b8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:48.158982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29fb5cb5-9db3-4761-baf0-c77034d230b8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:48.159431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29fb5cb5-9db3-4761-baf0-c77034d230b8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:48.453511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b3206b0f-f19e-435a-8ed3-57c2be4cc6cd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:48.454381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b3206b0f-f19e-435a-8ed3-57c2be4cc6cd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:48.464986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3206b0f-f19e-435a-8ed3-57c2be4cc6cd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:48.465622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3206b0f-f19e-435a-8ed3-57c2be4cc6cd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:48.466163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3206b0f-f19e-435a-8ed3-57c2be4cc6cd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:48.470920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3206b0f-f19e-435a-8ed3-57c2be4cc6cd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:48.474330 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3206b0f-f19e-435a-8ed3-57c2be4cc6cd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:48.475472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3206b0f-f19e-435a-8ed3-57c2be4cc6cd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:48.526954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-29fb5cb5-9db3-4761-baf0-c77034d230b8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:48.541339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-29fb5cb5-9db3-4761-baf0-c77034d230b8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:48.549676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-29fb5cb5-9db3-4761-baf0-c77034d230b8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:48.551396 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-29fb5cb5-9db3-4761-baf0-c77034d230b8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.427923 Oct 10 23:22:48.552004 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 816/1666] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:48 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:22:48.767518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b3206b0f-f19e-435a-8ed3-57c2be4cc6cd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:48.779990 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b3206b0f-f19e-435a-8ed3-57c2be4cc6cd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1474 microversion: 2.1 time: 0.331256 Oct 10 23:22:48.794521 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 851/1667] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:48 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1474 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:49.206090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3087fc34-42b1-40e2-a316-06045913f476 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Action: 'create', calling method: .version_select at 0x7f662b027e50>, body: {"keypair": {"name": "tempest-keypair-1642851461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCdM06jpHubHqDoZl7m6u9tst+OvSJdyZAVNTJzq4zKOmqCZ6fGUfNE3G/TLDWuEK/49to5+otxlbQ0jk6QuSXzoAWfVb1BT+CbpRTo70gAn9tPo1naAVdWkT2hwucDgw=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:49.235110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-3087fc34-42b1-40e2-a316-06045913f476 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Getting quotas for project 6e7609ed88094dd083202e42b058ffd5. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:22:49.254808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-3087fc34-42b1-40e2-a316-06045913f476 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Getting quotas for user f9e8299b29f044b0ab99b74346bf4870 and project 6e7609ed88094dd083202e42b058ffd5. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:22:49.326152 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3087fc34-42b1-40e2-a316-06045913f476 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.638791 Oct 10 23:22:49.328931 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 817/1668] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:22:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:49.344288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1bae87f7-bdc4-4e42-b0e9-a33093230d2a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:49.345039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1bae87f7-bdc4-4e42-b0e9-a33093230d2a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: fe8a45b4-e6cb-434f-8e97-8caa78888257] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:49.362213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bae87f7-bdc4-4e42-b0e9-a33093230d2a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:49.363914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bae87f7-bdc4-4e42-b0e9-a33093230d2a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:49.364536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bae87f7-bdc4-4e42-b0e9-a33093230d2a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:49.365596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bae87f7-bdc4-4e42-b0e9-a33093230d2a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:49.368508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bae87f7-bdc4-4e42-b0e9-a33093230d2a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:49.369255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bae87f7-bdc4-4e42-b0e9-a33093230d2a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:49.508963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-febaf34e-e0cb-47ea-af79-84919912ce80 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-840465896", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": "none"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:49.600423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-febaf34e-e0cb-47ea-af79-84919912ce80 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:22:49.600922 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-febaf34e-e0cb-47ea-af79-84919912ce80 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:22:49.601705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-febaf34e-e0cb-47ea-af79-84919912ce80 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:22:49.602366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-febaf34e-e0cb-47ea-af79-84919912ce80 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:22:49.603000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-febaf34e-e0cb-47ea-af79-84919912ce80 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:22:49.616705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-febaf34e-e0cb-47ea-af79-84919912ce80 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:49.617582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-febaf34e-e0cb-47ea-af79-84919912ce80 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:49.618309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-febaf34e-e0cb-47ea-af79-84919912ce80 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:49.619271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-febaf34e-e0cb-47ea-af79-84919912ce80 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:49.620472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-febaf34e-e0cb-47ea-af79-84919912ce80 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:49.621232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-febaf34e-e0cb-47ea-af79-84919912ce80 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:49.645117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1bae87f7-bdc4-4e42-b0e9-a33093230d2a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:49.661456 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1bae87f7-bdc4-4e42-b0e9-a33093230d2a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257" status: 200 len: 1308 microversion: 2.1 time: 0.329928 Oct 10 23:22:49.662732 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 818/1669] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:49 2022] GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257 => generated 1308 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:49.675588 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-febaf34e-e0cb-47ea-af79-84919912ce80 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Getting quotas for project 9a26f0bfba01462387501d3d6e5a6453. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:22:49.675915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ce110162-961f-4a5f-8829-79e9036c1544 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:49.676554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ce110162-961f-4a5f-8829-79e9036c1544 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:49.685033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-febaf34e-e0cb-47ea-af79-84919912ce80 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Getting quotas for user c201f1cbb5ba4f1ebf3211c937a4964b and project 9a26f0bfba01462387501d3d6e5a6453. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:22:49.692146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce110162-961f-4a5f-8829-79e9036c1544 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:49.692668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce110162-961f-4a5f-8829-79e9036c1544 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:49.693116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce110162-961f-4a5f-8829-79e9036c1544 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:49.695526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce110162-961f-4a5f-8829-79e9036c1544 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:49.695988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce110162-961f-4a5f-8829-79e9036c1544 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:49.697403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce110162-961f-4a5f-8829-79e9036c1544 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:49.711188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-febaf34e-e0cb-47ea-af79-84919912ce80 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:22:49.713858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-febaf34e-e0cb-47ea-af79-84919912ce80 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:22:49.805794 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-febaf34e-e0cb-47ea-af79-84919912ce80 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.842397 Oct 10 23:22:49.823157 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 852/1670] 10.222.0.23 () {62 vars in 1188 bytes} [Mon Oct 10 23:22:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 10 23:22:49.837519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1a4e00bb-7a0b-4a54-ad8d-8492ea146457 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:49.852352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1a4e00bb-7a0b-4a54-ad8d-8492ea146457 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:49.888527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a4e00bb-7a0b-4a54-ad8d-8492ea146457 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:49.891858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a4e00bb-7a0b-4a54-ad8d-8492ea146457 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:49.893453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a4e00bb-7a0b-4a54-ad8d-8492ea146457 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:49.895841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a4e00bb-7a0b-4a54-ad8d-8492ea146457 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:49.898833 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a4e00bb-7a0b-4a54-ad8d-8492ea146457 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:49.901546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a4e00bb-7a0b-4a54-ad8d-8492ea146457 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:49.911578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ce110162-961f-4a5f-8829-79e9036c1544 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:49.951983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ce110162-961f-4a5f-8829-79e9036c1544 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:49.954853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ce110162-961f-4a5f-8829-79e9036c1544 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:49.960463 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ce110162-961f-4a5f-8829-79e9036c1544 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.294364 Oct 10 23:22:49.964477 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 819/1671] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:49 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:22:49.982280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b6516cca-00fb-4b89-b8a3-a72963a73916 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:49.989264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b6516cca-00fb-4b89-b8a3-a72963a73916 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:50.186096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b6516cca-00fb-4b89-b8a3-a72963a73916 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:50.195313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b6516cca-00fb-4b89-b8a3-a72963a73916 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:50.196954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b6516cca-00fb-4b89-b8a3-a72963a73916 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:50.207382 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b6516cca-00fb-4b89-b8a3-a72963a73916 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "PUT /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1358 microversion: 2.75 time: 0.241032 Oct 10 23:22:50.210803 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 820/1672] 10.222.0.23 () {62 vars in 1297 bytes} [Mon Oct 10 23:22:49 2022] PUT /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:22:50.240904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-82041cdc-399d-4298-976c-c14e6c727d19 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:50.242014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-82041cdc-399d-4298-976c-c14e6c727d19 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:50.361235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-82041cdc-399d-4298-976c-c14e6c727d19 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:50.375719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-82041cdc-399d-4298-976c-c14e6c727d19 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:50.377060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-82041cdc-399d-4298-976c-c14e6c727d19 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:50.403217 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-82041cdc-399d-4298-976c-c14e6c727d19 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1358 microversion: 2.75 time: 0.164961 Oct 10 23:22:50.406313 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 821/1673] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:50 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:22:50.632920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1a4e00bb-7a0b-4a54-ad8d-8492ea146457 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:50.648585 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1a4e00bb-7a0b-4a54-ad8d-8492ea146457 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1474 microversion: 2.1 time: 0.824167 Oct 10 23:22:50.679029 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 853/1674] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:49 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1474 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:50.700947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-0dda1b63-952f-4c31-8200-523d48a01bd6 req-b63fda24-610b-4ba6-bdcd-e577241bf234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe8a45b4-e6cb-434f-8e97-8caa78888257", "name": "network-vif-plugged", "status": "completed", "tag": "825c46b6-1861-46dc-990c-5e0e0232f588"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:50.720910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3e966b3d-fbdc-4685-a84f-d7e50a308e3c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:50.721917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3e966b3d-fbdc-4685-a84f-d7e50a308e3c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: fe8a45b4-e6cb-434f-8e97-8caa78888257] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:50.732081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0dda1b63-952f-4c31-8200-523d48a01bd6 req-b63fda24-610b-4ba6-bdcd-e577241bf234 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:50.739886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0dda1b63-952f-4c31-8200-523d48a01bd6 req-b63fda24-610b-4ba6-bdcd-e577241bf234 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:50.740523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0dda1b63-952f-4c31-8200-523d48a01bd6 req-b63fda24-610b-4ba6-bdcd-e577241bf234 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:50.753604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e966b3d-fbdc-4685-a84f-d7e50a308e3c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:50.754242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e966b3d-fbdc-4685-a84f-d7e50a308e3c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:50.755465 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e966b3d-fbdc-4685-a84f-d7e50a308e3c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:50.758113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e966b3d-fbdc-4685-a84f-d7e50a308e3c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:50.760463 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e966b3d-fbdc-4685-a84f-d7e50a308e3c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:50.762208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e966b3d-fbdc-4685-a84f-d7e50a308e3c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:50.780531 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-0dda1b63-952f-4c31-8200-523d48a01bd6 req-b63fda24-610b-4ba6-bdcd-e577241bf234 service nova] Creating event network-vif-plugged:825c46b6-1861-46dc-990c-5e0e0232f588 for instance fe8a45b4-e6cb-434f-8e97-8caa78888257 on n-h1-860864-2 Oct 10 23:22:50.830652 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-0dda1b63-952f-4c31-8200-523d48a01bd6 req-b63fda24-610b-4ba6-bdcd-e577241bf234 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129071 Oct 10 23:22:50.845467 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 822/1675] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:50.995078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4e1a5a6e-fc0f-4f19-8f25-9c36741093e9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:50.995783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4e1a5a6e-fc0f-4f19-8f25-9c36741093e9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:51.013148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e1a5a6e-fc0f-4f19-8f25-9c36741093e9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:51.013872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e1a5a6e-fc0f-4f19-8f25-9c36741093e9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:51.014539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e1a5a6e-fc0f-4f19-8f25-9c36741093e9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:51.026790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e1a5a6e-fc0f-4f19-8f25-9c36741093e9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:51.027397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e1a5a6e-fc0f-4f19-8f25-9c36741093e9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:51.027730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e1a5a6e-fc0f-4f19-8f25-9c36741093e9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:51.402949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3e966b3d-fbdc-4685-a84f-d7e50a308e3c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:51.427640 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3e966b3d-fbdc-4685-a84f-d7e50a308e3c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257" status: 200 len: 1308 microversion: 2.1 time: 0.717695 Oct 10 23:22:51.428422 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 854/1676] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:50 2022] GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257 => generated 1308 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:51.452360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ff1b136f-44dd-4f76-96ef-fe60861c68d5 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:51.452982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ff1b136f-44dd-4f76-96ef-fe60861c68d5 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:51.478617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff1b136f-44dd-4f76-96ef-fe60861c68d5 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:51.484439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff1b136f-44dd-4f76-96ef-fe60861c68d5 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:51.485156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff1b136f-44dd-4f76-96ef-fe60861c68d5 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:51.486128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff1b136f-44dd-4f76-96ef-fe60861c68d5 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:51.503937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff1b136f-44dd-4f76-96ef-fe60861c68d5 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:51.505753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff1b136f-44dd-4f76-96ef-fe60861c68d5 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:51.684310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4e1a5a6e-fc0f-4f19-8f25-9c36741093e9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:51.692468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ff1b136f-44dd-4f76-96ef-fe60861c68d5 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:51.693571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4e1a5a6e-fc0f-4f19-8f25-9c36741093e9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:51.700398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4e1a5a6e-fc0f-4f19-8f25-9c36741093e9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:51.702236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ff1b136f-44dd-4f76-96ef-fe60861c68d5 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:51.703707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ff1b136f-44dd-4f76-96ef-fe60861c68d5 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:51.704763 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4e1a5a6e-fc0f-4f19-8f25-9c36741093e9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.714115 Oct 10 23:22:51.706141 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 823/1677] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:50 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:22:51.711977 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ff1b136f-44dd-4f76-96ef-fe60861c68d5 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1410 microversion: 2.75 time: 0.276519 Oct 10 23:22:51.712884 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 855/1678] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:51 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1410 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:22:51.722419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-53b160b7-9f2a-4541-bddb-08b84de34a65 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:51.723277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-53b160b7-9f2a-4541-bddb-08b84de34a65 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:51.735406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53b160b7-9f2a-4541-bddb-08b84de34a65 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:51.739881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53b160b7-9f2a-4541-bddb-08b84de34a65 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:51.740522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53b160b7-9f2a-4541-bddb-08b84de34a65 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:51.746053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53b160b7-9f2a-4541-bddb-08b84de34a65 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:51.746573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53b160b7-9f2a-4541-bddb-08b84de34a65 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:51.747023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53b160b7-9f2a-4541-bddb-08b84de34a65 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:52.127838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-53b160b7-9f2a-4541-bddb-08b84de34a65 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:52.139406 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-53b160b7-9f2a-4541-bddb-08b84de34a65 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1474 microversion: 2.1 time: 0.431666 Oct 10 23:22:52.140679 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 824/1679] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:51 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1474 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:52.263554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-db2498fc-f61e-4536-9f28-1b446d53d085 req-293e428d-d3d0-4d99-988e-4157b4ee2aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58fcd7f0-d348-47b1-9b3d-f7514b940eb3", "name": "network-vif-unplugged", "status": "completed", "tag": "4ddf9b37-7413-4cc7-829c-ce7603a65f55"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:52.280859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-db2498fc-f61e-4536-9f28-1b446d53d085 req-293e428d-d3d0-4d99-988e-4157b4ee2aed service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:52.281420 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-db2498fc-f61e-4536-9f28-1b446d53d085 req-293e428d-d3d0-4d99-988e-4157b4ee2aed service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:52.281871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-db2498fc-f61e-4536-9f28-1b446d53d085 req-293e428d-d3d0-4d99-988e-4157b4ee2aed service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:52.307772 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-db2498fc-f61e-4536-9f28-1b446d53d085 req-293e428d-d3d0-4d99-988e-4157b4ee2aed service nova] Creating event network-vif-unplugged:4ddf9b37-7413-4cc7-829c-ce7603a65f55 for instance 58fcd7f0-d348-47b1-9b3d-f7514b940eb3 on n-h2-860864-2 Oct 10 23:22:52.313866 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-db2498fc-f61e-4536-9f28-1b446d53d085 req-293e428d-d3d0-4d99-988e-4157b4ee2aed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057112 Oct 10 23:22:52.315208 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 856/1680] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:52.457961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f2ff23f7-92d4-4693-8c04-972d5ee5c3f4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:52.459763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f2ff23f7-92d4-4693-8c04-972d5ee5c3f4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: fe8a45b4-e6cb-434f-8e97-8caa78888257] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:52.468899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2ff23f7-92d4-4693-8c04-972d5ee5c3f4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:52.470355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2ff23f7-92d4-4693-8c04-972d5ee5c3f4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:52.470961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2ff23f7-92d4-4693-8c04-972d5ee5c3f4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:52.471871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2ff23f7-92d4-4693-8c04-972d5ee5c3f4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:52.472487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2ff23f7-92d4-4693-8c04-972d5ee5c3f4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:52.473412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2ff23f7-92d4-4693-8c04-972d5ee5c3f4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:52.734561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b5f0207d-4fbe-4f8a-945a-1df68f8262d3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:52.736023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b5f0207d-4fbe-4f8a-945a-1df68f8262d3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:52.749981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5f0207d-4fbe-4f8a-945a-1df68f8262d3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:52.750688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5f0207d-4fbe-4f8a-945a-1df68f8262d3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:52.751728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5f0207d-4fbe-4f8a-945a-1df68f8262d3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:52.753927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5f0207d-4fbe-4f8a-945a-1df68f8262d3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:52.755783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5f0207d-4fbe-4f8a-945a-1df68f8262d3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:52.759592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5f0207d-4fbe-4f8a-945a-1df68f8262d3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:52.997646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f2ff23f7-92d4-4693-8c04-972d5ee5c3f4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:53.012196 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f2ff23f7-92d4-4693-8c04-972d5ee5c3f4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257" status: 200 len: 1308 microversion: 2.1 time: 0.556597 Oct 10 23:22:53.033188 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 825/1681] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:52 2022] GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257 => generated 1308 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:53.048097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-76a8378e-e0b9-4776-b0bb-7c815fae2611 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:53.048097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-76a8378e-e0b9-4776-b0bb-7c815fae2611 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:53.062791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76a8378e-e0b9-4776-b0bb-7c815fae2611 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:53.063321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76a8378e-e0b9-4776-b0bb-7c815fae2611 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:53.063805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76a8378e-e0b9-4776-b0bb-7c815fae2611 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:53.065504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76a8378e-e0b9-4776-b0bb-7c815fae2611 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:53.066887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76a8378e-e0b9-4776-b0bb-7c815fae2611 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:53.068204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76a8378e-e0b9-4776-b0bb-7c815fae2611 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:53.138631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b5f0207d-4fbe-4f8a-945a-1df68f8262d3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:53.151529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b5f0207d-4fbe-4f8a-945a-1df68f8262d3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:53.157798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b5f0207d-4fbe-4f8a-945a-1df68f8262d3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:53.161951 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b5f0207d-4fbe-4f8a-945a-1df68f8262d3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.432184 Oct 10 23:22:53.165240 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 857/1682] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:52 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:22:53.183218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4b73ab53-8263-4431-a452-9611375f46a8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:53.184330 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4b73ab53-8263-4431-a452-9611375f46a8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:53.198619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b73ab53-8263-4431-a452-9611375f46a8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:53.200202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b73ab53-8263-4431-a452-9611375f46a8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:53.202537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b73ab53-8263-4431-a452-9611375f46a8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:53.206651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b73ab53-8263-4431-a452-9611375f46a8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:53.207356 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b73ab53-8263-4431-a452-9611375f46a8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:53.208039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b73ab53-8263-4431-a452-9611375f46a8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:53.484925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-76a8378e-e0b9-4776-b0bb-7c815fae2611 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:53.497041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-76a8378e-e0b9-4776-b0bb-7c815fae2611 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:53.506484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-76a8378e-e0b9-4776-b0bb-7c815fae2611 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:53.516849 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-76a8378e-e0b9-4776-b0bb-7c815fae2611 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1416 microversion: 2.75 time: 0.482375 Oct 10 23:22:53.521292 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 826/1683] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:53 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1416 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:22:53.548635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4b73ab53-8263-4431-a452-9611375f46a8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:53.563778 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4b73ab53-8263-4431-a452-9611375f46a8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1474 microversion: 2.1 time: 0.395967 Oct 10 23:22:53.566985 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 858/1684] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:53 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1474 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:54.040626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-24d16832-d1f9-4441-8009-00f28125e1a8 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:54.042026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-24d16832-d1f9-4441-8009-00f28125e1a8 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: fe8a45b4-e6cb-434f-8e97-8caa78888257] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:54.054547 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24d16832-d1f9-4441-8009-00f28125e1a8 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:54.056671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24d16832-d1f9-4441-8009-00f28125e1a8 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:54.058455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24d16832-d1f9-4441-8009-00f28125e1a8 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:54.059974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24d16832-d1f9-4441-8009-00f28125e1a8 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:54.061406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24d16832-d1f9-4441-8009-00f28125e1a8 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:54.070042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24d16832-d1f9-4441-8009-00f28125e1a8 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:54.198993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1b41cc0d-4b1a-4012-ad3c-e9ee376977a0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:54.199968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1b41cc0d-4b1a-4012-ad3c-e9ee376977a0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:54.213575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b41cc0d-4b1a-4012-ad3c-e9ee376977a0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:54.214340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b41cc0d-4b1a-4012-ad3c-e9ee376977a0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:54.217480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b41cc0d-4b1a-4012-ad3c-e9ee376977a0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:54.218643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b41cc0d-4b1a-4012-ad3c-e9ee376977a0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:54.219505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b41cc0d-4b1a-4012-ad3c-e9ee376977a0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:54.220732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b41cc0d-4b1a-4012-ad3c-e9ee376977a0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:54.516584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1b41cc0d-4b1a-4012-ad3c-e9ee376977a0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:54.538859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1b41cc0d-4b1a-4012-ad3c-e9ee376977a0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:54.544000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1b41cc0d-4b1a-4012-ad3c-e9ee376977a0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:54.552128 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1b41cc0d-4b1a-4012-ad3c-e9ee376977a0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.353869 Oct 10 23:22:54.553298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-24d16832-d1f9-4441-8009-00f28125e1a8 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:54.557580 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 859/1685] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:54 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:22:54.563829 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-24d16832-d1f9-4441-8009-00f28125e1a8 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257" status: 200 len: 1487 microversion: 2.1 time: 0.527596 Oct 10 23:22:54.564826 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 827/1686] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:54 2022] GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257 => generated 1487 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:54.570853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1501e232-3759-4b61-b2a5-920231de8c51 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:54.572130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1501e232-3759-4b61-b2a5-920231de8c51 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:54.577625 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-24abfd8f-f808-4146-ae47-9643b9bd296e req-e4c14755-744d-4658-b7a3-587b4936a3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58fcd7f0-d348-47b1-9b3d-f7514b940eb3", "tag": "4ddf9b37-7413-4cc7-829c-ce7603a65f55"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:54.581791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1501e232-3759-4b61-b2a5-920231de8c51 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:54.582567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1501e232-3759-4b61-b2a5-920231de8c51 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:54.583461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1501e232-3759-4b61-b2a5-920231de8c51 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:54.584495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1501e232-3759-4b61-b2a5-920231de8c51 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:54.585275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1501e232-3759-4b61-b2a5-920231de8c51 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:54.586225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1501e232-3759-4b61-b2a5-920231de8c51 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:54.625449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-24abfd8f-f808-4146-ae47-9643b9bd296e req-e4c14755-744d-4658-b7a3-587b4936a3e0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:54.625944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-24abfd8f-f808-4146-ae47-9643b9bd296e req-e4c14755-744d-4658-b7a3-587b4936a3e0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:54.626381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-24abfd8f-f808-4146-ae47-9643b9bd296e req-e4c14755-744d-4658-b7a3-587b4936a3e0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:54.629072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:22:54.662277 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-24abfd8f-f808-4146-ae47-9643b9bd296e req-e4c14755-744d-4658-b7a3-587b4936a3e0 service nova] Creating event network-changed:4ddf9b37-7413-4cc7-829c-ce7603a65f55 for instance 58fcd7f0-d348-47b1-9b3d-f7514b940eb3 on n-h2-860864-2 Oct 10 23:22:54.676294 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-24abfd8f-f808-4146-ae47-9643b9bd296e req-e4c14755-744d-4658-b7a3-587b4936a3e0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113993 Oct 10 23:22:54.676989 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 860/1687] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:22:54.709128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0d0d93f6-8b43-43a1-8117-2dcf74302faf tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:54.710638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0d0d93f6-8b43-43a1-8117-2dcf74302faf tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: fe8a45b4-e6cb-434f-8e97-8caa78888257] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:54.718959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d0d93f6-8b43-43a1-8117-2dcf74302faf tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:54.725344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d0d93f6-8b43-43a1-8117-2dcf74302faf tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:54.726262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d0d93f6-8b43-43a1-8117-2dcf74302faf tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:54.727203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d0d93f6-8b43-43a1-8117-2dcf74302faf tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:54.729662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d0d93f6-8b43-43a1-8117-2dcf74302faf tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:54.730657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d0d93f6-8b43-43a1-8117-2dcf74302faf tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:54.844759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1501e232-3759-4b61-b2a5-920231de8c51 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:54.860974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1501e232-3759-4b61-b2a5-920231de8c51 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:54.865140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1501e232-3759-4b61-b2a5-920231de8c51 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:54.883073 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1501e232-3759-4b61-b2a5-920231de8c51 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1416 microversion: 2.75 time: 0.311001 Oct 10 23:22:54.883783 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 828/1688] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:54 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1416 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:22:54.917812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9e3b8155-0b6d-4417-a73a-717bda97aa07 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:54.918683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9e3b8155-0b6d-4417-a73a-717bda97aa07 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:54.928025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e3b8155-0b6d-4417-a73a-717bda97aa07 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:54.929089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e3b8155-0b6d-4417-a73a-717bda97aa07 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:54.930028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e3b8155-0b6d-4417-a73a-717bda97aa07 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:54.930960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e3b8155-0b6d-4417-a73a-717bda97aa07 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:54.931762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e3b8155-0b6d-4417-a73a-717bda97aa07 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:54.932292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e3b8155-0b6d-4417-a73a-717bda97aa07 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:54.958524 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0d0d93f6-8b43-43a1-8117-2dcf74302faf tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "POST /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257/action" status: 202 len: 0 microversion: 2.1 time: 0.278442 Oct 10 23:22:54.961610 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 861/1689] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:22:54 2022] POST /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:22:54.988905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8a388a97-2111-41ee-b112-f7055139266c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1360912570", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e315d2cb-5853-42b6-8fd0-af46b9966171"}], "security_groups": [{"name": "tempest-securitygroup--2018688791"}], "key_name": "tempest-keypair-1642851461", "user_data": "}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:55.222641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-8a388a97-2111-41ee-b112-f7055139266c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] validate_networks() for [('e315d2cb-5853-42b6-8fd0-af46b9966171', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:22:55.258323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9e3b8155-0b6d-4417-a73a-717bda97aa07 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:55.270592 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9e3b8155-0b6d-4417-a73a-717bda97aa07 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1474 microversion: 2.1 time: 0.385048 Oct 10 23:22:55.279602 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 829/1690] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:54 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1474 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:55.287758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-403ed836-0098-473b-9486-62a9d8a3fef4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:55.288416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-403ed836-0098-473b-9486-62a9d8a3fef4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: fe8a45b4-e6cb-434f-8e97-8caa78888257] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:55.301620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-403ed836-0098-473b-9486-62a9d8a3fef4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:55.304896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-403ed836-0098-473b-9486-62a9d8a3fef4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:55.308725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-403ed836-0098-473b-9486-62a9d8a3fef4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:55.309737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-403ed836-0098-473b-9486-62a9d8a3fef4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:55.312802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-403ed836-0098-473b-9486-62a9d8a3fef4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:55.313728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-403ed836-0098-473b-9486-62a9d8a3fef4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:55.577197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-403ed836-0098-473b-9486-62a9d8a3fef4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:55.588217 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-403ed836-0098-473b-9486-62a9d8a3fef4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257" status: 200 len: 1472 microversion: 2.1 time: 0.307536 Oct 10 23:22:55.589251 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 830/1691] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:55 2022] GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257 => generated 1472 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:55.595951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a55c20bf-7e82-47f6-b3bf-aa3d623f86a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:55.596811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a55c20bf-7e82-47f6-b3bf-aa3d623f86a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:55.604169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a55c20bf-7e82-47f6-b3bf-aa3d623f86a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:55.604999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a55c20bf-7e82-47f6-b3bf-aa3d623f86a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:55.605631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a55c20bf-7e82-47f6-b3bf-aa3d623f86a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:55.606773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a55c20bf-7e82-47f6-b3bf-aa3d623f86a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:55.607472 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a55c20bf-7e82-47f6-b3bf-aa3d623f86a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:55.608189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a55c20bf-7e82-47f6-b3bf-aa3d623f86a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:55.896439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-8a388a97-2111-41ee-b112-f7055139266c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:22:55.897195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-8a388a97-2111-41ee-b112-f7055139266c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:22:55.897997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-8a388a97-2111-41ee-b112-f7055139266c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:22:55.898417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-8a388a97-2111-41ee-b112-f7055139266c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:22:55.899050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-8a388a97-2111-41ee-b112-f7055139266c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:22:55.911439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a388a97-2111-41ee-b112-f7055139266c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:55.911931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a388a97-2111-41ee-b112-f7055139266c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:55.912369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a388a97-2111-41ee-b112-f7055139266c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:55.913093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a388a97-2111-41ee-b112-f7055139266c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:55.913583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a388a97-2111-41ee-b112-f7055139266c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:55.914002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a388a97-2111-41ee-b112-f7055139266c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:55.921636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a55c20bf-7e82-47f6-b3bf-aa3d623f86a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:55.933660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a55c20bf-7e82-47f6-b3bf-aa3d623f86a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:55.933960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-8a388a97-2111-41ee-b112-f7055139266c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Getting quotas for project 6e7609ed88094dd083202e42b058ffd5. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:22:55.935539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a55c20bf-7e82-47f6-b3bf-aa3d623f86a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:55.937051 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a55c20bf-7e82-47f6-b3bf-aa3d623f86a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.346676 Oct 10 23:22:55.941047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-8a388a97-2111-41ee-b112-f7055139266c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Getting quotas for user f9e8299b29f044b0ab99b74346bf4870 and project 6e7609ed88094dd083202e42b058ffd5. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:22:55.950230 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 831/1692] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:55 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:22:55.956405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8a388a97-2111-41ee-b112-f7055139266c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:22:55.959241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8a388a97-2111-41ee-b112-f7055139266c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:22:55.962230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7df58c9d-a018-47e9-b484-9b02db8ff025 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1335798083"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:55.965086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7df58c9d-a018-47e9-b484-9b02db8ff025 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: fe8a45b4-e6cb-434f-8e97-8caa78888257] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:55.972506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7df58c9d-a018-47e9-b484-9b02db8ff025 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:55.973255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7df58c9d-a018-47e9-b484-9b02db8ff025 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:55.974226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7df58c9d-a018-47e9-b484-9b02db8ff025 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:55.975136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7df58c9d-a018-47e9-b484-9b02db8ff025 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:55.975791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7df58c9d-a018-47e9-b484-9b02db8ff025 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:55.976522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7df58c9d-a018-47e9-b484-9b02db8ff025 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:56.017261 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8a388a97-2111-41ee-b112-f7055139266c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.054042 Oct 10 23:22:56.023656 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 862/1693] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:22:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:22:56.023656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-85a600bd-332a-463a-b387-3b3edbbcfaf7 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:56.024085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-85a600bd-332a-463a-b387-3b3edbbcfaf7 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:56.032358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85a600bd-332a-463a-b387-3b3edbbcfaf7 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:56.033122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85a600bd-332a-463a-b387-3b3edbbcfaf7 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:56.035338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85a600bd-332a-463a-b387-3b3edbbcfaf7 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:56.036300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85a600bd-332a-463a-b387-3b3edbbcfaf7 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:56.036951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85a600bd-332a-463a-b387-3b3edbbcfaf7 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:56.037975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85a600bd-332a-463a-b387-3b3edbbcfaf7 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:56.155706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-85a600bd-332a-463a-b387-3b3edbbcfaf7 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:56.168115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-85a600bd-332a-463a-b387-3b3edbbcfaf7 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:56.170861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-85a600bd-332a-463a-b387-3b3edbbcfaf7 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:56.202931 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-85a600bd-332a-463a-b387-3b3edbbcfaf7 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1437 microversion: 2.75 time: 0.159379 Oct 10 23:22:56.202931 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 863/1694] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:56 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1437 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:22:56.202931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-94ee046c-84c8-4fe4-aeb2-a800b040c5f9 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:56.202931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-94ee046c-84c8-4fe4-aeb2-a800b040c5f9 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:56.335816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-94ee046c-84c8-4fe4-aeb2-a800b040c5f9 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:56.346354 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-94ee046c-84c8-4fe4-aeb2-a800b040c5f9 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1238 microversion: 2.1 time: 0.164911 Oct 10 23:22:56.347556 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 864/1695] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:56 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1238 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:56.355096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:22:56.359831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:56.372474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:56.373815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:56.374528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:56.375542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:56.376186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:56.377052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:56.415002 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7df58c9d-a018-47e9-b484-9b02db8ff025 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "POST /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257/action" status: 202 len: 0 microversion: 2.1 time: 0.463368 Oct 10 23:22:56.415763 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 832/1696] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:22:55 2022] POST /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 23:22:56.437792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-40d41013-75ad-4bc0-b22e-76c8ac39d445 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:56.441188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-40d41013-75ad-4bc0-b22e-76c8ac39d445 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:56.482449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40d41013-75ad-4bc0-b22e-76c8ac39d445 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:56.484109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40d41013-75ad-4bc0-b22e-76c8ac39d445 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:56.484754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40d41013-75ad-4bc0-b22e-76c8ac39d445 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:56.485675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40d41013-75ad-4bc0-b22e-76c8ac39d445 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:56.491614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40d41013-75ad-4bc0-b22e-76c8ac39d445 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:56.492090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40d41013-75ad-4bc0-b22e-76c8ac39d445 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:56.558927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:22:56.562172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:22:56.563263 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:22:56.564056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:22:56.564783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:22:56.710586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:56.730864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:56.739479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:56.740070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:56.744102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:56.747351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:56.748638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:56.802518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:22:56.844807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-40d41013-75ad-4bc0-b22e-76c8ac39d445 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:56.862956 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-40d41013-75ad-4bc0-b22e-76c8ac39d445 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1474 microversion: 2.1 time: 0.436517 Oct 10 23:22:56.869633 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 833/1697] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:56 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1474 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:56.891879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e59aab6c-5bb2-4a0f-a3f4-76898c92b79f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662af76f70>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:56.948389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:56.963428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:56.967256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:56.970679 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e59aab6c-5bb2-4a0f-a3f4-76898c92b79f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.103460 Oct 10 23:22:56.971994 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 834/1698] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:22:56 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:56.980004 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-029564c5-ca22-4cd8-8ab2-9039ff41d5e9 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "POST /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1/action" status: 202 len: 1494 microversion: 2.75 time: 0.630356 Oct 10 23:22:56.986327 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 865/1699] 10.222.0.23 () {62 vars in 1319 bytes} [Mon Oct 10 23:22:56 2022] POST /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1/action => generated 1494 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 10 23:22:56.986757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5891e828-d04e-4ae3-a6d1-08db355cac65 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:56.988949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5891e828-d04e-4ae3-a6d1-08db355cac65 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:57.000409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5891e828-d04e-4ae3-a6d1-08db355cac65 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:57.002627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5891e828-d04e-4ae3-a6d1-08db355cac65 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:57.003095 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5891e828-d04e-4ae3-a6d1-08db355cac65 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:57.004029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5891e828-d04e-4ae3-a6d1-08db355cac65 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:57.004500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5891e828-d04e-4ae3-a6d1-08db355cac65 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:57.005017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5891e828-d04e-4ae3-a6d1-08db355cac65 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:57.022738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4d8984fc-6266-4e14-8dc4-2559a0954033 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:57.024332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4d8984fc-6266-4e14-8dc4-2559a0954033 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:57.040524 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d8984fc-6266-4e14-8dc4-2559a0954033 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:57.041019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d8984fc-6266-4e14-8dc4-2559a0954033 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:57.041492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d8984fc-6266-4e14-8dc4-2559a0954033 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:57.042316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d8984fc-6266-4e14-8dc4-2559a0954033 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:57.043778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d8984fc-6266-4e14-8dc4-2559a0954033 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:57.044231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d8984fc-6266-4e14-8dc4-2559a0954033 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:57.131535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4d8984fc-6266-4e14-8dc4-2559a0954033 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:57.145245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4d8984fc-6266-4e14-8dc4-2559a0954033 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:57.147811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4d8984fc-6266-4e14-8dc4-2559a0954033 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:57.163775 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4d8984fc-6266-4e14-8dc4-2559a0954033 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.146021 Oct 10 23:22:57.165683 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 866/1700] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:57 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:22:57.240700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5891e828-d04e-4ae3-a6d1-08db355cac65 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:57.251948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5891e828-d04e-4ae3-a6d1-08db355cac65 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:57.253969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5891e828-d04e-4ae3-a6d1-08db355cac65 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:57.255191 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5891e828-d04e-4ae3-a6d1-08db355cac65 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.273329 Oct 10 23:22:57.257444 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 835/1701] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:56 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:22:57.375150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c70a9ecc-0288-470e-a57f-8df76e6c10b4 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:57.375796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c70a9ecc-0288-470e-a57f-8df76e6c10b4 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:57.383711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c70a9ecc-0288-470e-a57f-8df76e6c10b4 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:57.384214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c70a9ecc-0288-470e-a57f-8df76e6c10b4 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:57.384658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c70a9ecc-0288-470e-a57f-8df76e6c10b4 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:57.385395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c70a9ecc-0288-470e-a57f-8df76e6c10b4 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:57.385901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c70a9ecc-0288-470e-a57f-8df76e6c10b4 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:57.386327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c70a9ecc-0288-470e-a57f-8df76e6c10b4 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:57.473204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c70a9ecc-0288-470e-a57f-8df76e6c10b4 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:57.482115 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c70a9ecc-0288-470e-a57f-8df76e6c10b4 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1290 microversion: 2.1 time: 0.113852 Oct 10 23:22:57.490852 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 867/1702] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:57 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1290 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:57.889932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6f9fd510-6155-42ee-b714-a4df90e159b9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:57.891278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6f9fd510-6155-42ee-b714-a4df90e159b9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:57.905822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f9fd510-6155-42ee-b714-a4df90e159b9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:57.906325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f9fd510-6155-42ee-b714-a4df90e159b9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:57.906773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f9fd510-6155-42ee-b714-a4df90e159b9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:57.907814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f9fd510-6155-42ee-b714-a4df90e159b9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:57.908380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f9fd510-6155-42ee-b714-a4df90e159b9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:57.924020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f9fd510-6155-42ee-b714-a4df90e159b9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:57.990413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-31f236ba-1310-4302-b807-9e8bf6324720 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b753e50>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:58.057904 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-31f236ba-1310-4302-b807-9e8bf6324720 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.073140 Oct 10 23:22:58.069852 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 868/1703] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:22:57 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:58.195671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8869a11a-db3c-45fc-9676-ab4aa151a72b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:58.205888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8869a11a-db3c-45fc-9676-ab4aa151a72b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:58.215608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8869a11a-db3c-45fc-9676-ab4aa151a72b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:58.216367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8869a11a-db3c-45fc-9676-ab4aa151a72b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:58.218131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8869a11a-db3c-45fc-9676-ab4aa151a72b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:58.219411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8869a11a-db3c-45fc-9676-ab4aa151a72b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:58.220159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8869a11a-db3c-45fc-9676-ab4aa151a72b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:58.221068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8869a11a-db3c-45fc-9676-ab4aa151a72b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:58.239828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6f9fd510-6155-42ee-b714-a4df90e159b9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:58.258652 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6f9fd510-6155-42ee-b714-a4df90e159b9 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1474 microversion: 2.1 time: 0.374289 Oct 10 23:22:58.266277 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 836/1704] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:57 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1474 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:58.285344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1eeddbb3-eca6-4e1d-be63-d43c649c9c62 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:58.286359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1eeddbb3-eca6-4e1d-be63-d43c649c9c62 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:58.295346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1eeddbb3-eca6-4e1d-be63-d43c649c9c62 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:58.296070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1eeddbb3-eca6-4e1d-be63-d43c649c9c62 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:58.296618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1eeddbb3-eca6-4e1d-be63-d43c649c9c62 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:58.297813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1eeddbb3-eca6-4e1d-be63-d43c649c9c62 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:58.298393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1eeddbb3-eca6-4e1d-be63-d43c649c9c62 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:58.298934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1eeddbb3-eca6-4e1d-be63-d43c649c9c62 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:58.347404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8869a11a-db3c-45fc-9676-ab4aa151a72b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:58.358271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8869a11a-db3c-45fc-9676-ab4aa151a72b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:58.361203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8869a11a-db3c-45fc-9676-ab4aa151a72b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:58.367153 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8869a11a-db3c-45fc-9676-ab4aa151a72b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.176106 Oct 10 23:22:58.367873 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 869/1705] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:58 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:22:58.506352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-015b5261-71c2-4dfb-97d1-a3d72cfa42aa tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:58.507843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-015b5261-71c2-4dfb-97d1-a3d72cfa42aa tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:58.516210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-015b5261-71c2-4dfb-97d1-a3d72cfa42aa tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:58.517005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-015b5261-71c2-4dfb-97d1-a3d72cfa42aa tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:58.517633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-015b5261-71c2-4dfb-97d1-a3d72cfa42aa tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:58.518535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-015b5261-71c2-4dfb-97d1-a3d72cfa42aa tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:58.519162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-015b5261-71c2-4dfb-97d1-a3d72cfa42aa tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:58.519759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-015b5261-71c2-4dfb-97d1-a3d72cfa42aa tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:58.551196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1eeddbb3-eca6-4e1d-be63-d43c649c9c62 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:58.561737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1eeddbb3-eca6-4e1d-be63-d43c649c9c62 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:58.566623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1eeddbb3-eca6-4e1d-be63-d43c649c9c62 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:58.569573 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1eeddbb3-eca6-4e1d-be63-d43c649c9c62 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.290204 Oct 10 23:22:58.570814 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 837/1706] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:58 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:22:58.639098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-015b5261-71c2-4dfb-97d1-a3d72cfa42aa tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:58.649340 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-015b5261-71c2-4dfb-97d1-a3d72cfa42aa tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1296 microversion: 2.1 time: 0.146145 Oct 10 23:22:58.650256 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 870/1707] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:58 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1296 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:59.081964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c85e30bb-4f77-43b8-8d7e-4853489bd2aa tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b035ee0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:59.188971 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c85e30bb-4f77-43b8-8d7e-4853489bd2aa tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.115834 Oct 10 23:22:59.189842 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 838/1708] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:22:59 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:59.290605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-efd20075-33b4-4612-be90-1025b330260d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:59.291883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-efd20075-33b4-4612-be90-1025b330260d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:59.305727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efd20075-33b4-4612-be90-1025b330260d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:59.306345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efd20075-33b4-4612-be90-1025b330260d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:59.306904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efd20075-33b4-4612-be90-1025b330260d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:59.307971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efd20075-33b4-4612-be90-1025b330260d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:59.308666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efd20075-33b4-4612-be90-1025b330260d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:59.309392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efd20075-33b4-4612-be90-1025b330260d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:59.403817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2868f492-a8cd-4b34-babd-873f276bdf5e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:59.405567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2868f492-a8cd-4b34-babd-873f276bdf5e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:59.415798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2868f492-a8cd-4b34-babd-873f276bdf5e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:59.430471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2868f492-a8cd-4b34-babd-873f276bdf5e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:59.431397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2868f492-a8cd-4b34-babd-873f276bdf5e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:59.432428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2868f492-a8cd-4b34-babd-873f276bdf5e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:59.433485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2868f492-a8cd-4b34-babd-873f276bdf5e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:59.433623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2868f492-a8cd-4b34-babd-873f276bdf5e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:59.526437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-efd20075-33b4-4612-be90-1025b330260d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:59.527033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2868f492-a8cd-4b34-babd-873f276bdf5e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:59.535936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2868f492-a8cd-4b34-babd-873f276bdf5e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:59.537834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2868f492-a8cd-4b34-babd-873f276bdf5e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:59.544234 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2868f492-a8cd-4b34-babd-873f276bdf5e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.144512 Oct 10 23:22:59.545201 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 839/1709] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:59 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:22:59.551198 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-efd20075-33b4-4612-be90-1025b330260d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1474 microversion: 2.1 time: 0.264688 Oct 10 23:22:59.552122 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 871/1710] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:59 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1474 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:22:59.598442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fd61d736-b339-4bfc-bf6d-2fbc0ac3420d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:59.599429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fd61d736-b339-4bfc-bf6d-2fbc0ac3420d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:59.606043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd61d736-b339-4bfc-bf6d-2fbc0ac3420d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:59.607037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd61d736-b339-4bfc-bf6d-2fbc0ac3420d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:59.608558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd61d736-b339-4bfc-bf6d-2fbc0ac3420d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:59.609849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd61d736-b339-4bfc-bf6d-2fbc0ac3420d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:59.610602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd61d736-b339-4bfc-bf6d-2fbc0ac3420d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:59.611140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd61d736-b339-4bfc-bf6d-2fbc0ac3420d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:59.677716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c8dfec83-635c-4a35-af4d-b600f7fda03f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:22:59.678577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c8dfec83-635c-4a35-af4d-b600f7fda03f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:22:59.687479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8dfec83-635c-4a35-af4d-b600f7fda03f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:59.689098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8dfec83-635c-4a35-af4d-b600f7fda03f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:59.689847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8dfec83-635c-4a35-af4d-b600f7fda03f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:59.691332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8dfec83-635c-4a35-af4d-b600f7fda03f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:22:59.692117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8dfec83-635c-4a35-af4d-b600f7fda03f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:22:59.693226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8dfec83-635c-4a35-af4d-b600f7fda03f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:22:59.897411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fd61d736-b339-4bfc-bf6d-2fbc0ac3420d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:59.921854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fd61d736-b339-4bfc-bf6d-2fbc0ac3420d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:59.924157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fd61d736-b339-4bfc-bf6d-2fbc0ac3420d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:59.926530 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fd61d736-b339-4bfc-bf6d-2fbc0ac3420d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.333300 Oct 10 23:22:59.927845 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 840/1711] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:22:59 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:22:59.965699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c8dfec83-635c-4a35-af4d-b600f7fda03f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:22:59.989360 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c8dfec83-635c-4a35-af4d-b600f7fda03f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1364 microversion: 2.1 time: 0.316771 Oct 10 23:22:59.994371 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 872/1712] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:22:59 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1364 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:00.204416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-85c7e3c7-85b8-4374-8624-67779150d348 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b035af0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:00.256491 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-85c7e3c7-85b8-4374-8624-67779150d348 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.056245 Oct 10 23:23:00.257069 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 841/1713] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:00 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:00.574533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c62b0aa1-baef-4e6c-bb2f-06383b6847d1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:00.575247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:00.578451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c62b0aa1-baef-4e6c-bb2f-06383b6847d1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:00.581083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9389f1d9-7b68-4e2d-a319-75cec7ce5874 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:00.582544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9389f1d9-7b68-4e2d-a319-75cec7ce5874 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:00.585309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:00.590395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9389f1d9-7b68-4e2d-a319-75cec7ce5874 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:00.591697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c62b0aa1-baef-4e6c-bb2f-06383b6847d1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:00.592762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c62b0aa1-baef-4e6c-bb2f-06383b6847d1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:00.593425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9389f1d9-7b68-4e2d-a319-75cec7ce5874 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:00.593891 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c62b0aa1-baef-4e6c-bb2f-06383b6847d1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:00.594932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c62b0aa1-baef-4e6c-bb2f-06383b6847d1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:00.595792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c62b0aa1-baef-4e6c-bb2f-06383b6847d1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:00.596953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c62b0aa1-baef-4e6c-bb2f-06383b6847d1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:00.597890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9389f1d9-7b68-4e2d-a319-75cec7ce5874 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:00.598938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9389f1d9-7b68-4e2d-a319-75cec7ce5874 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:00.600135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9389f1d9-7b68-4e2d-a319-75cec7ce5874 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:00.602079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9389f1d9-7b68-4e2d-a319-75cec7ce5874 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:00.706860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c62b0aa1-baef-4e6c-bb2f-06383b6847d1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:00.723298 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c62b0aa1-baef-4e6c-bb2f-06383b6847d1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:00.729733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c62b0aa1-baef-4e6c-bb2f-06383b6847d1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:00.737011 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c62b0aa1-baef-4e6c-bb2f-06383b6847d1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.167076 Oct 10 23:23:00.739081 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 873/1714] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:00 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:00.939146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9389f1d9-7b68-4e2d-a319-75cec7ce5874 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:00.958092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a6e85d8c-332f-4a9f-ade8-acf72f151bd3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:00.958882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a6e85d8c-332f-4a9f-ade8-acf72f151bd3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:00.979749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6e85d8c-332f-4a9f-ade8-acf72f151bd3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:00.980509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6e85d8c-332f-4a9f-ade8-acf72f151bd3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:00.981230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6e85d8c-332f-4a9f-ade8-acf72f151bd3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:00.982237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6e85d8c-332f-4a9f-ade8-acf72f151bd3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:00.983733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6e85d8c-332f-4a9f-ade8-acf72f151bd3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:00.984405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6e85d8c-332f-4a9f-ade8-acf72f151bd3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:00.992737 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9389f1d9-7b68-4e2d-a319-75cec7ce5874 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1473 microversion: 2.1 time: 0.418177 Oct 10 23:23:00.999946 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 842/1715] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:00 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1473 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:01.020432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-75184260-0a35-47e3-bb98-6f4b6868ce48 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:01.021397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-75184260-0a35-47e3-bb98-6f4b6868ce48 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:01.035646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75184260-0a35-47e3-bb98-6f4b6868ce48 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:01.036544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75184260-0a35-47e3-bb98-6f4b6868ce48 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:01.037532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75184260-0a35-47e3-bb98-6f4b6868ce48 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:01.038781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75184260-0a35-47e3-bb98-6f4b6868ce48 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:01.039510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75184260-0a35-47e3-bb98-6f4b6868ce48 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:01.040181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75184260-0a35-47e3-bb98-6f4b6868ce48 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:01.185283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a6e85d8c-332f-4a9f-ade8-acf72f151bd3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:01.197674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a6e85d8c-332f-4a9f-ade8-acf72f151bd3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:01.199427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a6e85d8c-332f-4a9f-ade8-acf72f151bd3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:01.200845 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a6e85d8c-332f-4a9f-ade8-acf72f151bd3 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.252682 Oct 10 23:23:01.220639 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 874/1716] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:00 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:23:01.226155 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-50e36c2f-6170-4e79-b010-bb3bfea96a9d req-8af9650a-dc47-4200-93f8-8669101a7462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5142fea1-e8ea-4f3d-964a-bed317b8342a", "name": "network-vif-unplugged", "status": "completed", "tag": "b6d015b9-418b-43be-8a73-5bb37417c784"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:01.238104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-50e36c2f-6170-4e79-b010-bb3bfea96a9d req-8af9650a-dc47-4200-93f8-8669101a7462 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:01.238819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-50e36c2f-6170-4e79-b010-bb3bfea96a9d req-8af9650a-dc47-4200-93f8-8669101a7462 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:01.239566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-50e36c2f-6170-4e79-b010-bb3bfea96a9d req-8af9650a-dc47-4200-93f8-8669101a7462 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:01.254104 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-50e36c2f-6170-4e79-b010-bb3bfea96a9d req-8af9650a-dc47-4200-93f8-8669101a7462 service nova] Creating event network-vif-unplugged:b6d015b9-418b-43be-8a73-5bb37417c784 for instance 5142fea1-e8ea-4f3d-964a-bed317b8342a on n-h1-860864-2 Oct 10 23:23:01.261245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [req-50e36c2f-6170-4e79-b010-bb3bfea96a9d req-8af9650a-dc47-4200-93f8-8669101a7462 service nova] Instance 5142fea1-e8ea-4f3d-964a-bed317b8342a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 23:23:01.275865 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-50e36c2f-6170-4e79-b010-bb3bfea96a9d req-8af9650a-dc47-4200-93f8-8669101a7462 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053594 Oct 10 23:23:01.276927 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 875/1717] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:23:01.283005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-182673af-4de1-40b6-b592-a8112de8931e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f6633a3f790>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:01.339670 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-182673af-4de1-40b6-b592-a8112de8931e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.061187 Oct 10 23:23:01.340566 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 876/1718] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:01 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:01.583217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-75184260-0a35-47e3-bb98-6f4b6868ce48 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:01.598555 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-75184260-0a35-47e3-bb98-6f4b6868ce48 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1364 microversion: 2.1 time: 0.581455 Oct 10 23:23:01.609409 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 843/1719] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:01 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1364 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:01.767181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b6ab1e32-a27b-4142-a32a-37d22f2a741c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:01.767976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b6ab1e32-a27b-4142-a32a-37d22f2a741c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:01.775732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6ab1e32-a27b-4142-a32a-37d22f2a741c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:01.776698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6ab1e32-a27b-4142-a32a-37d22f2a741c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:01.777582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6ab1e32-a27b-4142-a32a-37d22f2a741c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:01.780312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6ab1e32-a27b-4142-a32a-37d22f2a741c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:01.781038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6ab1e32-a27b-4142-a32a-37d22f2a741c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:01.781731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6ab1e32-a27b-4142-a32a-37d22f2a741c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:01.879132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b6ab1e32-a27b-4142-a32a-37d22f2a741c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:01.890835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b6ab1e32-a27b-4142-a32a-37d22f2a741c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:01.892710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b6ab1e32-a27b-4142-a32a-37d22f2a741c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:01.899222 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b6ab1e32-a27b-4142-a32a-37d22f2a741c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.137664 Oct 10 23:23:01.900197 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 877/1720] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:01 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:23:02.229426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cda715e3-8fbe-4184-ab2d-f660db007004 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:02.230064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cda715e3-8fbe-4184-ab2d-f660db007004 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:02.245895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cda715e3-8fbe-4184-ab2d-f660db007004 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:02.248973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cda715e3-8fbe-4184-ab2d-f660db007004 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:02.250454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cda715e3-8fbe-4184-ab2d-f660db007004 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:02.252443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cda715e3-8fbe-4184-ab2d-f660db007004 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:02.254527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cda715e3-8fbe-4184-ab2d-f660db007004 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:02.256084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cda715e3-8fbe-4184-ab2d-f660db007004 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:02.311175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-70419f53-31a0-422a-9b69-0d7a78351676 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:02.312085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-70419f53-31a0-422a-9b69-0d7a78351676 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:02.322846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70419f53-31a0-422a-9b69-0d7a78351676 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:02.324026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70419f53-31a0-422a-9b69-0d7a78351676 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:02.324493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70419f53-31a0-422a-9b69-0d7a78351676 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:02.325655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70419f53-31a0-422a-9b69-0d7a78351676 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:02.327050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70419f53-31a0-422a-9b69-0d7a78351676 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:02.327511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70419f53-31a0-422a-9b69-0d7a78351676 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:02.559486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cda715e3-8fbe-4184-ab2d-f660db007004 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:02.576082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cda715e3-8fbe-4184-ab2d-f660db007004 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:02.579946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cda715e3-8fbe-4184-ab2d-f660db007004 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:02.581936 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cda715e3-8fbe-4184-ab2d-f660db007004 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.356624 Oct 10 23:23:02.583127 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 878/1721] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:02 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:02.592537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-99e4cb45-0c4c-4ce5-b058-da7448792127 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b753670>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:02.677331 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-99e4cb45-0c4c-4ce5-b058-da7448792127 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.092451 Oct 10 23:23:02.678606 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 879/1722] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:02 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:02.687045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9ae6a698-08fc-43c6-a1f8-9c98d2c094fd tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:02.688108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9ae6a698-08fc-43c6-a1f8-9c98d2c094fd tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:02.696432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ae6a698-08fc-43c6-a1f8-9c98d2c094fd tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:02.697490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ae6a698-08fc-43c6-a1f8-9c98d2c094fd tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:02.699166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ae6a698-08fc-43c6-a1f8-9c98d2c094fd tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:02.700408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ae6a698-08fc-43c6-a1f8-9c98d2c094fd tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:02.701742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ae6a698-08fc-43c6-a1f8-9c98d2c094fd tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:02.702439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ae6a698-08fc-43c6-a1f8-9c98d2c094fd tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:02.813282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-70419f53-31a0-422a-9b69-0d7a78351676 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:02.834525 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-70419f53-31a0-422a-9b69-0d7a78351676 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1473 microversion: 2.1 time: 0.815007 Oct 10 23:23:02.837431 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 844/1723] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:02 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1473 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:02.931698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4ab83e9e-a5f3-4e7b-b35d-c40210463f1e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:02.932560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4ab83e9e-a5f3-4e7b-b35d-c40210463f1e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:02.955948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ab83e9e-a5f3-4e7b-b35d-c40210463f1e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:02.956855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ab83e9e-a5f3-4e7b-b35d-c40210463f1e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:02.957463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ab83e9e-a5f3-4e7b-b35d-c40210463f1e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:02.958507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ab83e9e-a5f3-4e7b-b35d-c40210463f1e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:02.959106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ab83e9e-a5f3-4e7b-b35d-c40210463f1e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:02.962242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ab83e9e-a5f3-4e7b-b35d-c40210463f1e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:02.993763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9ae6a698-08fc-43c6-a1f8-9c98d2c094fd tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:03.007267 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9ae6a698-08fc-43c6-a1f8-9c98d2c094fd tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1364 microversion: 2.1 time: 0.327393 Oct 10 23:23:03.019305 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 880/1724] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:02 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1364 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:03.073655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4ab83e9e-a5f3-4e7b-b35d-c40210463f1e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:03.085346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4ab83e9e-a5f3-4e7b-b35d-c40210463f1e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:03.086169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4ab83e9e-a5f3-4e7b-b35d-c40210463f1e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:03.095184 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4ab83e9e-a5f3-4e7b-b35d-c40210463f1e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.168808 Oct 10 23:23:03.096022 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 845/1725] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:02 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:23:03.413197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-3e9032ed-6e96-4c64-abfa-c80f0034bded req-33425b2c-0742-43b8-9132-c4de1ff83935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10d4252b-2561-4a94-adf8-018fdec5c2cc", "tag": "9fd315b0-8b11-4a9f-b09c-b6b5287bc293"}, {"name": "network-changed", "server_uuid": "5142fea1-e8ea-4f3d-964a-bed317b8342a", "tag": "b6d015b9-418b-43be-8a73-5bb37417c784"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:03.428374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3e9032ed-6e96-4c64-abfa-c80f0034bded req-33425b2c-0742-43b8-9132-c4de1ff83935 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:03.429282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3e9032ed-6e96-4c64-abfa-c80f0034bded req-33425b2c-0742-43b8-9132-c4de1ff83935 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:03.429965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3e9032ed-6e96-4c64-abfa-c80f0034bded req-33425b2c-0742-43b8-9132-c4de1ff83935 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:03.446711 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-3e9032ed-6e96-4c64-abfa-c80f0034bded req-33425b2c-0742-43b8-9132-c4de1ff83935 service nova] Creating event network-changed:9fd315b0-8b11-4a9f-b09c-b6b5287bc293 for instance 10d4252b-2561-4a94-adf8-018fdec5c2cc on n-h2-860864-2 Oct 10 23:23:03.447483 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-3e9032ed-6e96-4c64-abfa-c80f0034bded req-33425b2c-0742-43b8-9132-c4de1ff83935 service nova] Creating event network-changed:b6d015b9-418b-43be-8a73-5bb37417c784 for instance 5142fea1-e8ea-4f3d-964a-bed317b8342a on n-h1-860864-2 Oct 10 23:23:03.458755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [req-3e9032ed-6e96-4c64-abfa-c80f0034bded req-33425b2c-0742-43b8-9132-c4de1ff83935 service nova] Instance 5142fea1-e8ea-4f3d-964a-bed317b8342a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 23:23:03.476168 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-3e9032ed-6e96-4c64-abfa-c80f0034bded req-33425b2c-0742-43b8-9132-c4de1ff83935 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.067233 Oct 10 23:23:03.477546 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 881/1726] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:23:03.612390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-68acd5c1-b5a4-48fc-bd41-c110f338aaf2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:03.613122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-68acd5c1-b5a4-48fc-bd41-c110f338aaf2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:03.620620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68acd5c1-b5a4-48fc-bd41-c110f338aaf2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:03.621389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68acd5c1-b5a4-48fc-bd41-c110f338aaf2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:03.622028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68acd5c1-b5a4-48fc-bd41-c110f338aaf2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:03.622927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68acd5c1-b5a4-48fc-bd41-c110f338aaf2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:03.624248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68acd5c1-b5a4-48fc-bd41-c110f338aaf2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:03.624946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68acd5c1-b5a4-48fc-bd41-c110f338aaf2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:03.696244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-46d9e04d-9add-40ae-b0d1-3fe1989825de tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b968670>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:03.747081 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-46d9e04d-9add-40ae-b0d1-3fe1989825de tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.055887 Oct 10 23:23:03.756302 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 882/1727] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:03 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:03.770155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-68acd5c1-b5a4-48fc-bd41-c110f338aaf2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:03.772862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:03.782955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-68acd5c1-b5a4-48fc-bd41-c110f338aaf2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:03.784495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-68acd5c1-b5a4-48fc-bd41-c110f338aaf2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:03.786283 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-68acd5c1-b5a4-48fc-bd41-c110f338aaf2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.178423 Oct 10 23:23:03.786929 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 846/1728] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:03 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:03.860937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3adb7bf6-e6a2-43f8-8440-9db1b94a22c8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:03.861811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3adb7bf6-e6a2-43f8-8440-9db1b94a22c8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:03.869104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3adb7bf6-e6a2-43f8-8440-9db1b94a22c8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:03.869867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3adb7bf6-e6a2-43f8-8440-9db1b94a22c8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:03.870466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3adb7bf6-e6a2-43f8-8440-9db1b94a22c8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:03.871182 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3adb7bf6-e6a2-43f8-8440-9db1b94a22c8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:03.871806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3adb7bf6-e6a2-43f8-8440-9db1b94a22c8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:03.872435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3adb7bf6-e6a2-43f8-8440-9db1b94a22c8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:04.036404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9907a41c-10bb-47f7-bc2f-78ec70545d36 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:04.037036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9907a41c-10bb-47f7-bc2f-78ec70545d36 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:04.044522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9907a41c-10bb-47f7-bc2f-78ec70545d36 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:04.045511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9907a41c-10bb-47f7-bc2f-78ec70545d36 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:04.046012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9907a41c-10bb-47f7-bc2f-78ec70545d36 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:04.046725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9907a41c-10bb-47f7-bc2f-78ec70545d36 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:04.047366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9907a41c-10bb-47f7-bc2f-78ec70545d36 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:04.047842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9907a41c-10bb-47f7-bc2f-78ec70545d36 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:04.093780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3adb7bf6-e6a2-43f8-8440-9db1b94a22c8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:04.101526 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3adb7bf6-e6a2-43f8-8440-9db1b94a22c8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1471 microversion: 2.1 time: 0.246384 Oct 10 23:23:04.102104 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 883/1729] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:03 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1471 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:04.124503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c7582406-e6dc-48f3-a7a6-6954802a1f8c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:04.125122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c7582406-e6dc-48f3-a7a6-6954802a1f8c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:04.131297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7582406-e6dc-48f3-a7a6-6954802a1f8c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:04.131784 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7582406-e6dc-48f3-a7a6-6954802a1f8c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:04.132229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7582406-e6dc-48f3-a7a6-6954802a1f8c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:04.133037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7582406-e6dc-48f3-a7a6-6954802a1f8c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:04.133594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7582406-e6dc-48f3-a7a6-6954802a1f8c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:04.134385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7582406-e6dc-48f3-a7a6-6954802a1f8c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:04.200546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c7582406-e6dc-48f3-a7a6-6954802a1f8c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:04.209486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c7582406-e6dc-48f3-a7a6-6954802a1f8c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:04.210950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c7582406-e6dc-48f3-a7a6-6954802a1f8c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:04.215764 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c7582406-e6dc-48f3-a7a6-6954802a1f8c tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.095312 Oct 10 23:23:04.216353 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 884/1730] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:04 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:23:04.332603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9907a41c-10bb-47f7-bc2f-78ec70545d36 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:04.340357 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9907a41c-10bb-47f7-bc2f-78ec70545d36 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1364 microversion: 2.1 time: 0.308012 Oct 10 23:23:04.340870 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 847/1731] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:04 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1364 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:04.644480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-68271fe5-45c4-4bab-8f66-8632b2951723 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1360025140", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "6efb9146-bb54-41e6-9e93-c4bb8a061be1"}], "block_device_mapping_v2": [{"uuid": "b58a1984-42e0-46d0-9654-dacaf773d017", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:04.726575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-68271fe5-45c4-4bab-8f66-8632b2951723 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] validate_networks() for [('6efb9146-bb54-41e6-9e93-c4bb8a061be1', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:23:04.768368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-55f9139f-b8ce-4416-8a93-de8d8b5df189 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662af205e0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:04.831133 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-55f9139f-b8ce-4416-8a93-de8d8b5df189 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.067412 Oct 10 23:23:04.832186 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 848/1732] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:04 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:04.839636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8ef9afe2-16e8-459a-b071-f372462eab75 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:04.840857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8ef9afe2-16e8-459a-b071-f372462eab75 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:04.851059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ef9afe2-16e8-459a-b071-f372462eab75 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:04.851859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ef9afe2-16e8-459a-b071-f372462eab75 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:04.852744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ef9afe2-16e8-459a-b071-f372462eab75 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:04.853530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ef9afe2-16e8-459a-b071-f372462eab75 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:04.854022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ef9afe2-16e8-459a-b071-f372462eab75 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:04.854530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ef9afe2-16e8-459a-b071-f372462eab75 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:05.110664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8ef9afe2-16e8-459a-b071-f372462eab75 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:05.125543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8ef9afe2-16e8-459a-b071-f372462eab75 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:05.127276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8ef9afe2-16e8-459a-b071-f372462eab75 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:05.128745 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8ef9afe2-16e8-459a-b071-f372462eab75 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.293269 Oct 10 23:23:05.128745 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 849/1733] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:04 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:05.144525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9eadeda0-e0ef-4980-a16a-7e4db9bf8c4e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:05.145291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9eadeda0-e0ef-4980-a16a-7e4db9bf8c4e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:05.159056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9eadeda0-e0ef-4980-a16a-7e4db9bf8c4e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:05.159559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9eadeda0-e0ef-4980-a16a-7e4db9bf8c4e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:05.159999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9eadeda0-e0ef-4980-a16a-7e4db9bf8c4e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:05.160966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9eadeda0-e0ef-4980-a16a-7e4db9bf8c4e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:05.161460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9eadeda0-e0ef-4980-a16a-7e4db9bf8c4e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:05.161897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9eadeda0-e0ef-4980-a16a-7e4db9bf8c4e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:05.257888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-68271fe5-45c4-4bab-8f66-8632b2951723 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:23:05.258398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-68271fe5-45c4-4bab-8f66-8632b2951723 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:23:05.258780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-68271fe5-45c4-4bab-8f66-8632b2951723 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:23:05.259294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-68271fe5-45c4-4bab-8f66-8632b2951723 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:23:05.259706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-68271fe5-45c4-4bab-8f66-8632b2951723 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:23:05.269041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68271fe5-45c4-4bab-8f66-8632b2951723 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:05.269553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68271fe5-45c4-4bab-8f66-8632b2951723 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:05.269992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68271fe5-45c4-4bab-8f66-8632b2951723 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:05.270716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68271fe5-45c4-4bab-8f66-8632b2951723 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:05.271165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68271fe5-45c4-4bab-8f66-8632b2951723 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:05.271588 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68271fe5-45c4-4bab-8f66-8632b2951723 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:05.291104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-68271fe5-45c4-4bab-8f66-8632b2951723 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Getting quotas for project 1b5a9d1de27b407e91ff0ae66242ec81. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:23:05.296815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-68271fe5-45c4-4bab-8f66-8632b2951723 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Getting quotas for user 9bd83ab05cb34853bbab0f86a630aa1e and project 1b5a9d1de27b407e91ff0ae66242ec81. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:23:05.379143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-68271fe5-45c4-4bab-8f66-8632b2951723 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:23:05.381255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-68271fe5-45c4-4bab-8f66-8632b2951723 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b58a1984-42e0-46d0-9654-dacaf773d017',volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:23:05.463935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9eadeda0-e0ef-4980-a16a-7e4db9bf8c4e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:05.476461 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9eadeda0-e0ef-4980-a16a-7e4db9bf8c4e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1471 microversion: 2.1 time: 0.344494 Oct 10 23:23:05.479134 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 850/1734] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:05 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1471 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:05.490625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-05c32126-bcab-4f73-9832-5a521b446b5f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:05.492730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-05c32126-bcab-4f73-9832-5a521b446b5f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:05.512105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05c32126-bcab-4f73-9832-5a521b446b5f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:05.513225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05c32126-bcab-4f73-9832-5a521b446b5f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:05.514373 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05c32126-bcab-4f73-9832-5a521b446b5f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:05.516486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05c32126-bcab-4f73-9832-5a521b446b5f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:05.517361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05c32126-bcab-4f73-9832-5a521b446b5f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:05.517572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05c32126-bcab-4f73-9832-5a521b446b5f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:05.616951 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-68271fe5-45c4-4bab-8f66-8632b2951723 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.978172 Oct 10 23:23:05.624739 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 885/1735] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:23:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 23:23:05.630441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e30d07d6-59ca-4ea9-9b59-193d3962944c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:05.631467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e30d07d6-59ca-4ea9-9b59-193d3962944c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:05.638619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e30d07d6-59ca-4ea9-9b59-193d3962944c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:05.640238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e30d07d6-59ca-4ea9-9b59-193d3962944c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:05.640885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e30d07d6-59ca-4ea9-9b59-193d3962944c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:05.642082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e30d07d6-59ca-4ea9-9b59-193d3962944c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:05.642751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e30d07d6-59ca-4ea9-9b59-193d3962944c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:05.643426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e30d07d6-59ca-4ea9-9b59-193d3962944c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:05.680086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-05c32126-bcab-4f73-9832-5a521b446b5f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:05.691502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-05c32126-bcab-4f73-9832-5a521b446b5f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:05.693908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-05c32126-bcab-4f73-9832-5a521b446b5f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:05.700646 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-05c32126-bcab-4f73-9832-5a521b446b5f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.219645 Oct 10 23:23:05.701852 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 851/1736] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:05 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:05.728940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4d64a2b5-7ccd-46b6-b51e-10e1b6c13522 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:05.729816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4d64a2b5-7ccd-46b6-b51e-10e1b6c13522 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:05.736172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:05.799551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4d64a2b5-7ccd-46b6-b51e-10e1b6c13522 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:05.807851 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4d64a2b5-7ccd-46b6-b51e-10e1b6c13522 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1053 microversion: 2.1 time: 0.090727 Oct 10 23:23:05.810130 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 852/1737] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:05 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1053 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:05.850133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d71eda9e-c0cc-49ca-9d53-d638e37af403 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662aff5040>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:05.906879 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d71eda9e-c0cc-49ca-9d53-d638e37af403 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.063274 Oct 10 23:23:05.916039 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 853/1738] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:05 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:05.918745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e30d07d6-59ca-4ea9-9b59-193d3962944c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:05.929250 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e30d07d6-59ca-4ea9-9b59-193d3962944c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1364 microversion: 2.1 time: 0.303076 Oct 10 23:23:05.930142 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 886/1739] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:05 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1364 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:06.160896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-da9d6c88-35f2-455c-a3b5-9db632cc7a80 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:06.161835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-da9d6c88-35f2-455c-a3b5-9db632cc7a80 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:06.172186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da9d6c88-35f2-455c-a3b5-9db632cc7a80 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:06.173303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da9d6c88-35f2-455c-a3b5-9db632cc7a80 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:06.174084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da9d6c88-35f2-455c-a3b5-9db632cc7a80 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:06.179495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da9d6c88-35f2-455c-a3b5-9db632cc7a80 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:06.180049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da9d6c88-35f2-455c-a3b5-9db632cc7a80 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:06.182654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da9d6c88-35f2-455c-a3b5-9db632cc7a80 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:06.345552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-da9d6c88-35f2-455c-a3b5-9db632cc7a80 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:06.355649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-da9d6c88-35f2-455c-a3b5-9db632cc7a80 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:06.357626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-da9d6c88-35f2-455c-a3b5-9db632cc7a80 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:06.358925 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-da9d6c88-35f2-455c-a3b5-9db632cc7a80 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.202150 Oct 10 23:23:06.369490 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 854/1740] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:06 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:06.501409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bf99cb11-b540-4eca-8f05-98d4e08734ff tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:06.503237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bf99cb11-b540-4eca-8f05-98d4e08734ff tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:06.511655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf99cb11-b540-4eca-8f05-98d4e08734ff tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:06.512557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf99cb11-b540-4eca-8f05-98d4e08734ff tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:06.513329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf99cb11-b540-4eca-8f05-98d4e08734ff tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:06.515068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf99cb11-b540-4eca-8f05-98d4e08734ff tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:06.515729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf99cb11-b540-4eca-8f05-98d4e08734ff tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:06.516166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf99cb11-b540-4eca-8f05-98d4e08734ff tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:06.550877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:06.686638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bf99cb11-b540-4eca-8f05-98d4e08734ff tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:06.696675 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bf99cb11-b540-4eca-8f05-98d4e08734ff tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1471 microversion: 2.1 time: 0.199961 Oct 10 23:23:06.698313 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 887/1741] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:06 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1471 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:06.720642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-baa85900-7caf-4d9b-a6cd-cd7e24e1abe9 req-07c2fd45-58b8-4720-82ad-4abefda28ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d4252b-2561-4a94-adf8-018fdec5c2cc", "name": "network-vif-plugged", "status": "completed", "tag": "9fd315b0-8b11-4a9f-b09c-b6b5287bc293"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:06.731455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-baa85900-7caf-4d9b-a6cd-cd7e24e1abe9 req-07c2fd45-58b8-4720-82ad-4abefda28ca8 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:06.732330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-baa85900-7caf-4d9b-a6cd-cd7e24e1abe9 req-07c2fd45-58b8-4720-82ad-4abefda28ca8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:06.733581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-baa85900-7caf-4d9b-a6cd-cd7e24e1abe9 req-07c2fd45-58b8-4720-82ad-4abefda28ca8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:06.735975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-90e8a2a9-378b-4e0f-917f-0e078db469ed tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:06.736598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-90e8a2a9-378b-4e0f-917f-0e078db469ed tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:06.745279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90e8a2a9-378b-4e0f-917f-0e078db469ed tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:06.745823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90e8a2a9-378b-4e0f-917f-0e078db469ed tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:06.746256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90e8a2a9-378b-4e0f-917f-0e078db469ed tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:06.748982 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-baa85900-7caf-4d9b-a6cd-cd7e24e1abe9 req-07c2fd45-58b8-4720-82ad-4abefda28ca8 service nova] Creating event network-vif-plugged:9fd315b0-8b11-4a9f-b09c-b6b5287bc293 for instance 10d4252b-2561-4a94-adf8-018fdec5c2cc on n-h2-860864-2 Oct 10 23:23:06.752532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90e8a2a9-378b-4e0f-917f-0e078db469ed tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:06.753316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90e8a2a9-378b-4e0f-917f-0e078db469ed tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:06.757914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90e8a2a9-378b-4e0f-917f-0e078db469ed tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:06.758361 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-baa85900-7caf-4d9b-a6cd-cd7e24e1abe9 req-07c2fd45-58b8-4720-82ad-4abefda28ca8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039640 Oct 10 23:23:06.759208 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 855/1742] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:23:06.838907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f8610818-590a-4ce2-8146-b9950cce0541 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:06.839885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f8610818-590a-4ce2-8146-b9950cce0541 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:06.851981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8610818-590a-4ce2-8146-b9950cce0541 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:06.855556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8610818-590a-4ce2-8146-b9950cce0541 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:06.856247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8610818-590a-4ce2-8146-b9950cce0541 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:06.860505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8610818-590a-4ce2-8146-b9950cce0541 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:06.860962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-90e8a2a9-378b-4e0f-917f-0e078db469ed tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:06.861480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8610818-590a-4ce2-8146-b9950cce0541 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:06.862853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8610818-590a-4ce2-8146-b9950cce0541 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:06.880497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-90e8a2a9-378b-4e0f-917f-0e078db469ed tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:06.882198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-90e8a2a9-378b-4e0f-917f-0e078db469ed tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:06.888910 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-90e8a2a9-378b-4e0f-917f-0e078db469ed tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.157464 Oct 10 23:23:06.890267 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 888/1743] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:06 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:23:06.924857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1d9906fe-83f5-4de9-9197-8a2b5a1c4a49 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f6633ab1dc0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:06.986736 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1d9906fe-83f5-4de9-9197-8a2b5a1c4a49 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.067549 Oct 10 23:23:06.988350 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 889/1744] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:06 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:06.994043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a044b3de-fdbc-4540-b9df-e9393c103273 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:06.994955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a044b3de-fdbc-4540-b9df-e9393c103273 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:07.008060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a044b3de-fdbc-4540-b9df-e9393c103273 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:07.008740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a044b3de-fdbc-4540-b9df-e9393c103273 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:07.009508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f8610818-590a-4ce2-8146-b9950cce0541 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:07.009879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a044b3de-fdbc-4540-b9df-e9393c103273 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:07.010948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a044b3de-fdbc-4540-b9df-e9393c103273 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:07.011583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a044b3de-fdbc-4540-b9df-e9393c103273 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:07.012247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a044b3de-fdbc-4540-b9df-e9393c103273 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:07.018211 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f8610818-590a-4ce2-8146-b9950cce0541 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1103 microversion: 2.1 time: 0.184497 Oct 10 23:23:07.018802 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 856/1745] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:06 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1103 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:07.189474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a044b3de-fdbc-4540-b9df-e9393c103273 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:07.198397 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a044b3de-fdbc-4540-b9df-e9393c103273 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1364 microversion: 2.1 time: 0.208551 Oct 10 23:23:07.199233 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 890/1746] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:06 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:07.385493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-334789d0-b883-45fa-b2d0-0226173c4d6c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:07.388272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-334789d0-b883-45fa-b2d0-0226173c4d6c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:07.396105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-334789d0-b883-45fa-b2d0-0226173c4d6c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:07.396813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-334789d0-b883-45fa-b2d0-0226173c4d6c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:07.398724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-334789d0-b883-45fa-b2d0-0226173c4d6c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:07.399627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-334789d0-b883-45fa-b2d0-0226173c4d6c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:07.400250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-334789d0-b883-45fa-b2d0-0226173c4d6c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:07.400842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-334789d0-b883-45fa-b2d0-0226173c4d6c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:07.658178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-334789d0-b883-45fa-b2d0-0226173c4d6c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:07.671415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-334789d0-b883-45fa-b2d0-0226173c4d6c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:07.672922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-334789d0-b883-45fa-b2d0-0226173c4d6c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:07.674222 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-334789d0-b883-45fa-b2d0-0226173c4d6c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.293048 Oct 10 23:23:07.674780 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 857/1747] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:07 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:07.723323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f2953d54-5139-468a-84bd-d2c6ef95888c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:07.724101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f2953d54-5139-468a-84bd-d2c6ef95888c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:07.730608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2953d54-5139-468a-84bd-d2c6ef95888c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:07.731333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2953d54-5139-468a-84bd-d2c6ef95888c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:07.731737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2953d54-5139-468a-84bd-d2c6ef95888c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:07.732728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2953d54-5139-468a-84bd-d2c6ef95888c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:07.733170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2953d54-5139-468a-84bd-d2c6ef95888c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:07.733795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2953d54-5139-468a-84bd-d2c6ef95888c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:07.921848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-72ae1f18-6dd0-4066-9367-c93ae432173a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:07.925325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-72ae1f18-6dd0-4066-9367-c93ae432173a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:07.939697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72ae1f18-6dd0-4066-9367-c93ae432173a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:07.940777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72ae1f18-6dd0-4066-9367-c93ae432173a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:07.940936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72ae1f18-6dd0-4066-9367-c93ae432173a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:07.941650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72ae1f18-6dd0-4066-9367-c93ae432173a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:07.942116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72ae1f18-6dd0-4066-9367-c93ae432173a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:07.942544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72ae1f18-6dd0-4066-9367-c93ae432173a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:07.972482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f2953d54-5139-468a-84bd-d2c6ef95888c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:07.990214 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f2953d54-5139-468a-84bd-d2c6ef95888c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1471 microversion: 2.1 time: 0.270323 Oct 10 23:23:07.990710 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 891/1748] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:07 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1471 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:08.013143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b1ebbc22-0452-4687-8192-c2d8c43f635b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f6633ab0820>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:08.081049 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b1ebbc22-0452-4687-8192-c2d8c43f635b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.080451 Oct 10 23:23:08.089386 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 892/1749] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:07 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:08.089386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4a5d698d-7f15-4a59-8995-869d079db3e2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:08.089386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4a5d698d-7f15-4a59-8995-869d079db3e2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:08.098511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a5d698d-7f15-4a59-8995-869d079db3e2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:08.099799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a5d698d-7f15-4a59-8995-869d079db3e2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:08.100485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a5d698d-7f15-4a59-8995-869d079db3e2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:08.101276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a5d698d-7f15-4a59-8995-869d079db3e2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:08.101835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a5d698d-7f15-4a59-8995-869d079db3e2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:08.102487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a5d698d-7f15-4a59-8995-869d079db3e2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:08.194584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4a5d698d-7f15-4a59-8995-869d079db3e2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:08.204689 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4a5d698d-7f15-4a59-8995-869d079db3e2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1151 microversion: 2.1 time: 0.120961 Oct 10 23:23:08.206043 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 893/1750] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:08 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1151 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:08.231135 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-22c3ba8e-bb6f-4646-9d4a-0546dd132016 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:08.231947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-22c3ba8e-bb6f-4646-9d4a-0546dd132016 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:08.234130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-72ae1f18-6dd0-4066-9367-c93ae432173a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:08.239776 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22c3ba8e-bb6f-4646-9d4a-0546dd132016 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:08.240455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22c3ba8e-bb6f-4646-9d4a-0546dd132016 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:08.241081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22c3ba8e-bb6f-4646-9d4a-0546dd132016 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:08.242023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22c3ba8e-bb6f-4646-9d4a-0546dd132016 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:08.242645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22c3ba8e-bb6f-4646-9d4a-0546dd132016 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:08.243233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22c3ba8e-bb6f-4646-9d4a-0546dd132016 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:08.249076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-72ae1f18-6dd0-4066-9367-c93ae432173a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:08.251103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-72ae1f18-6dd0-4066-9367-c93ae432173a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:08.261883 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-72ae1f18-6dd0-4066-9367-c93ae432173a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.344903 Oct 10 23:23:08.262475 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 858/1751] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:07 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:23:08.423893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-22c3ba8e-bb6f-4646-9d4a-0546dd132016 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:08.434627 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-22c3ba8e-bb6f-4646-9d4a-0546dd132016 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1364 microversion: 2.1 time: 0.209131 Oct 10 23:23:08.436708 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 894/1752] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:08 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:08.700191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b7046e22-e660-417b-be38-2573f91266d6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:08.700810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b7046e22-e660-417b-be38-2573f91266d6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:08.709146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7046e22-e660-417b-be38-2573f91266d6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:08.709759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7046e22-e660-417b-be38-2573f91266d6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:08.710188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7046e22-e660-417b-be38-2573f91266d6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:08.711643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7046e22-e660-417b-be38-2573f91266d6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:08.712395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7046e22-e660-417b-be38-2573f91266d6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:08.713232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7046e22-e660-417b-be38-2573f91266d6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:08.852169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-d459082e-4a3a-4f61-a75b-38b7fcfec6ba req-68826b13-97e7-47ce-9864-9f6f9942a081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe8a45b4-e6cb-434f-8e97-8caa78888257", "name": "network-vif-plugged", "status": "completed", "tag": "825c46b6-1861-46dc-990c-5e0e0232f588"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:08.901156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d459082e-4a3a-4f61-a75b-38b7fcfec6ba req-68826b13-97e7-47ce-9864-9f6f9942a081 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:08.902442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d459082e-4a3a-4f61-a75b-38b7fcfec6ba req-68826b13-97e7-47ce-9864-9f6f9942a081 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:08.903132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d459082e-4a3a-4f61-a75b-38b7fcfec6ba req-68826b13-97e7-47ce-9864-9f6f9942a081 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:08.942296 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-d459082e-4a3a-4f61-a75b-38b7fcfec6ba req-68826b13-97e7-47ce-9864-9f6f9942a081 service nova] Creating event network-vif-plugged:825c46b6-1861-46dc-990c-5e0e0232f588 for instance fe8a45b4-e6cb-434f-8e97-8caa78888257 on n-h1-860864-2 Oct 10 23:23:08.949844 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-d459082e-4a3a-4f61-a75b-38b7fcfec6ba req-68826b13-97e7-47ce-9864-9f6f9942a081 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118070 Oct 10 23:23:08.951091 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 895/1753] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:23:09.017188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4ecdc168-3fe6-40ec-b059-6aaa0b20e30b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:09.018445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4ecdc168-3fe6-40ec-b059-6aaa0b20e30b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:09.036889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b7046e22-e660-417b-be38-2573f91266d6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:09.044359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ecdc168-3fe6-40ec-b059-6aaa0b20e30b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:09.045790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ecdc168-3fe6-40ec-b059-6aaa0b20e30b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:09.050012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ecdc168-3fe6-40ec-b059-6aaa0b20e30b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:09.051520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ecdc168-3fe6-40ec-b059-6aaa0b20e30b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:09.052217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ecdc168-3fe6-40ec-b059-6aaa0b20e30b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:09.053491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ecdc168-3fe6-40ec-b059-6aaa0b20e30b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:09.063379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b7046e22-e660-417b-be38-2573f91266d6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:09.067836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b7046e22-e660-417b-be38-2573f91266d6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:09.072115 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b7046e22-e660-417b-be38-2573f91266d6 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.374610 Oct 10 23:23:09.074388 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 859/1754] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:08 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:09.107014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c0d6db81-992e-4633-87f4-f1f1373a7e32 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662af4ba60>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:09.175244 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c0d6db81-992e-4633-87f4-f1f1373a7e32 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.077220 Oct 10 23:23:09.179008 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 860/1755] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:09 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:09.239638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bec24feb-c315-4610-811d-9d79f0d66a82 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:09.241452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bec24feb-c315-4610-811d-9d79f0d66a82 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:09.251733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bec24feb-c315-4610-811d-9d79f0d66a82 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:09.252452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bec24feb-c315-4610-811d-9d79f0d66a82 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:09.253085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bec24feb-c315-4610-811d-9d79f0d66a82 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:09.254627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bec24feb-c315-4610-811d-9d79f0d66a82 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:09.255313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bec24feb-c315-4610-811d-9d79f0d66a82 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:09.255998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bec24feb-c315-4610-811d-9d79f0d66a82 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:09.405285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bec24feb-c315-4610-811d-9d79f0d66a82 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:09.415290 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bec24feb-c315-4610-811d-9d79f0d66a82 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1169 microversion: 2.1 time: 0.188326 Oct 10 23:23:09.438569 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 861/1756] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:09 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1169 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:09.448872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c04345a5-758c-4738-93c9-835d76aa00ca tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:09.450595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c04345a5-758c-4738-93c9-835d76aa00ca tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:09.464724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c04345a5-758c-4738-93c9-835d76aa00ca tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:09.466333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c04345a5-758c-4738-93c9-835d76aa00ca tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:09.468365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c04345a5-758c-4738-93c9-835d76aa00ca tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:09.484480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c04345a5-758c-4738-93c9-835d76aa00ca tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:09.484985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c04345a5-758c-4738-93c9-835d76aa00ca tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:09.486329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c04345a5-758c-4738-93c9-835d76aa00ca tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:09.542042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4ecdc168-3fe6-40ec-b059-6aaa0b20e30b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:09.558600 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4ecdc168-3fe6-40ec-b059-6aaa0b20e30b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1468 microversion: 2.1 time: 0.548442 Oct 10 23:23:09.563626 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 896/1757] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:09 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1468 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:09.578684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7713147d-0f24-4600-9713-efa1cd9e2a00 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:09.582990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7713147d-0f24-4600-9713-efa1cd9e2a00 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:09.600933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7713147d-0f24-4600-9713-efa1cd9e2a00 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:09.616418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7713147d-0f24-4600-9713-efa1cd9e2a00 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:09.619695 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7713147d-0f24-4600-9713-efa1cd9e2a00 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:09.622286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7713147d-0f24-4600-9713-efa1cd9e2a00 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:09.627675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7713147d-0f24-4600-9713-efa1cd9e2a00 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:09.634707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7713147d-0f24-4600-9713-efa1cd9e2a00 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:09.841483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c04345a5-758c-4738-93c9-835d76aa00ca tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:09.854651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c04345a5-758c-4738-93c9-835d76aa00ca tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:09.856098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c04345a5-758c-4738-93c9-835d76aa00ca tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:09.877103 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c04345a5-758c-4738-93c9-835d76aa00ca tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.437080 Oct 10 23:23:09.890656 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 862/1758] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:09 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:09.913046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-335b4d77-1a55-4113-ac32-6069a32d2c0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:09.913470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-335b4d77-1a55-4113-ac32-6069a32d2c0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:09.927794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-335b4d77-1a55-4113-ac32-6069a32d2c0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:09.928296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-335b4d77-1a55-4113-ac32-6069a32d2c0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:09.928730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-335b4d77-1a55-4113-ac32-6069a32d2c0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:09.937965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-335b4d77-1a55-4113-ac32-6069a32d2c0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:09.938991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-335b4d77-1a55-4113-ac32-6069a32d2c0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:09.942039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-335b4d77-1a55-4113-ac32-6069a32d2c0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:10.235889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7713147d-0f24-4600-9713-efa1cd9e2a00 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:10.254365 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7713147d-0f24-4600-9713-efa1cd9e2a00 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1551 microversion: 2.1 time: 0.684726 Oct 10 23:23:10.258197 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 897/1759] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:09 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1551 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:10.270735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a5ffedd4-51a7-41c7-bcfb-1084f59b9fb8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:10.271628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a5ffedd4-51a7-41c7-bcfb-1084f59b9fb8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:10.278408 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-335b4d77-1a55-4113-ac32-6069a32d2c0e tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "POST /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a/action" status: 202 len: 0 microversion: 2.1 time: 0.384311 Oct 10 23:23:10.281880 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 863/1760] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:23:09 2022] POST /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:23:10.288262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5ffedd4-51a7-41c7-bcfb-1084f59b9fb8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:10.290662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5ffedd4-51a7-41c7-bcfb-1084f59b9fb8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:10.291862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5ffedd4-51a7-41c7-bcfb-1084f59b9fb8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:10.294329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5ffedd4-51a7-41c7-bcfb-1084f59b9fb8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:10.294748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5369dce7-b13d-4f66-9abd-5d200fb4ddfa tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b024550>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:10.298122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5ffedd4-51a7-41c7-bcfb-1084f59b9fb8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:10.298773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5ffedd4-51a7-41c7-bcfb-1084f59b9fb8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:10.395981 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5369dce7-b13d-4f66-9abd-5d200fb4ddfa tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.109318 Oct 10 23:23:10.398394 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 864/1761] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:10 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:10.424048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d96e99a9-f6b1-4c57-a8eb-8a04a0f2b849 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:10.424958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d96e99a9-f6b1-4c57-a8eb-8a04a0f2b849 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:10.432320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d96e99a9-f6b1-4c57-a8eb-8a04a0f2b849 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:10.433130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d96e99a9-f6b1-4c57-a8eb-8a04a0f2b849 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:10.433803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d96e99a9-f6b1-4c57-a8eb-8a04a0f2b849 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:10.434720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d96e99a9-f6b1-4c57-a8eb-8a04a0f2b849 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:10.435349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d96e99a9-f6b1-4c57-a8eb-8a04a0f2b849 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:10.436065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d96e99a9-f6b1-4c57-a8eb-8a04a0f2b849 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:10.902100 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d96e99a9-f6b1-4c57-a8eb-8a04a0f2b849 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.499956 Oct 10 23:23:10.906316 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 865/1762] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Oct 10 23:23:10 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc/os-interface => generated 285 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:23:10.918853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e336e354-03b0-41fb-8ae7-d401cb27db19 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:10.919722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e336e354-03b0-41fb-8ae7-d401cb27db19 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:10.931328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e336e354-03b0-41fb-8ae7-d401cb27db19 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:10.931660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e336e354-03b0-41fb-8ae7-d401cb27db19 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:10.932447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e336e354-03b0-41fb-8ae7-d401cb27db19 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:10.934244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e336e354-03b0-41fb-8ae7-d401cb27db19 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:10.938637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e336e354-03b0-41fb-8ae7-d401cb27db19 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:10.939317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e336e354-03b0-41fb-8ae7-d401cb27db19 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:11.175780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a5ffedd4-51a7-41c7-bcfb-1084f59b9fb8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:11.194954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a5ffedd4-51a7-41c7-bcfb-1084f59b9fb8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:11.197629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a5ffedd4-51a7-41c7-bcfb-1084f59b9fb8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:11.200882 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a5ffedd4-51a7-41c7-bcfb-1084f59b9fb8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1815 microversion: 2.25 time: 0.940194 Oct 10 23:23:11.204568 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 898/1763] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:10 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1815 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:11.218709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-02789310-ea22-4bcf-b740-a50fe73160b5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:11.219728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-02789310-ea22-4bcf-b740-a50fe73160b5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:11.229583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02789310-ea22-4bcf-b740-a50fe73160b5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:11.230863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02789310-ea22-4bcf-b740-a50fe73160b5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:11.232172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02789310-ea22-4bcf-b740-a50fe73160b5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:11.234683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02789310-ea22-4bcf-b740-a50fe73160b5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:11.235487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02789310-ea22-4bcf-b740-a50fe73160b5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:11.236135 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02789310-ea22-4bcf-b740-a50fe73160b5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:11.743688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e336e354-03b0-41fb-8ae7-d401cb27db19 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:11.757164 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e336e354-03b0-41fb-8ae7-d401cb27db19 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1467 microversion: 2.1 time: 0.849444 Oct 10 23:23:11.757950 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 866/1764] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:10 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1467 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:11.768274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3512cc48-248a-41f0-b5f4-ace3e4306269 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:11.770092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3512cc48-248a-41f0-b5f4-ace3e4306269 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:11.783481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3512cc48-248a-41f0-b5f4-ace3e4306269 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:11.789535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3512cc48-248a-41f0-b5f4-ace3e4306269 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:11.790866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3512cc48-248a-41f0-b5f4-ace3e4306269 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:11.795975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3512cc48-248a-41f0-b5f4-ace3e4306269 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:11.797160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3512cc48-248a-41f0-b5f4-ace3e4306269 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:11.797829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3512cc48-248a-41f0-b5f4-ace3e4306269 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:11.852860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:11.925467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-02789310-ea22-4bcf-b740-a50fe73160b5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:11.943261 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-02789310-ea22-4bcf-b740-a50fe73160b5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1211 microversion: 2.1 time: 0.737324 Oct 10 23:23:11.950292 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 899/1765] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:11 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1211 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:11.973059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-d0ca27e9-c754-4b8d-9ed4-c93b2b2c42c8 req-3ee37a9a-6bb2-41f8-bc1d-4faf80f9b1df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5142fea1-e8ea-4f3d-964a-bed317b8342a", "name": "network-vif-plugged", "status": "completed", "tag": "b6d015b9-418b-43be-8a73-5bb37417c784"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:12.002436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d0ca27e9-c754-4b8d-9ed4-c93b2b2c42c8 req-3ee37a9a-6bb2-41f8-bc1d-4faf80f9b1df service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:12.003325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d0ca27e9-c754-4b8d-9ed4-c93b2b2c42c8 req-3ee37a9a-6bb2-41f8-bc1d-4faf80f9b1df service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:12.004068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d0ca27e9-c754-4b8d-9ed4-c93b2b2c42c8 req-3ee37a9a-6bb2-41f8-bc1d-4faf80f9b1df service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:12.033108 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-d0ca27e9-c754-4b8d-9ed4-c93b2b2c42c8 req-3ee37a9a-6bb2-41f8-bc1d-4faf80f9b1df service nova] Creating event network-vif-plugged:b6d015b9-418b-43be-8a73-5bb37417c784 for instance 5142fea1-e8ea-4f3d-964a-bed317b8342a on n-h1-860864-2 Oct 10 23:23:12.051024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [req-d0ca27e9-c754-4b8d-9ed4-c93b2b2c42c8 req-3ee37a9a-6bb2-41f8-bc1d-4faf80f9b1df service nova] Instance 5142fea1-e8ea-4f3d-964a-bed317b8342a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 23:23:12.071343 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-d0ca27e9-c754-4b8d-9ed4-c93b2b2c42c8 req-3ee37a9a-6bb2-41f8-bc1d-4faf80f9b1df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115382 Oct 10 23:23:12.077281 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 900/1766] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:23:12.086251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-48225f3f-6cd4-41eb-82f9-dbde1e2eea1c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f6633ab0b80>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:12.102465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3512cc48-248a-41f0-b5f4-ace3e4306269 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:12.118999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3512cc48-248a-41f0-b5f4-ace3e4306269 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:12.128132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3512cc48-248a-41f0-b5f4-ace3e4306269 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:12.147933 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3512cc48-248a-41f0-b5f4-ace3e4306269 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.388255 Oct 10 23:23:12.148542 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 867/1767] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:11 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:12.197463 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-48225f3f-6cd4-41eb-82f9-dbde1e2eea1c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.118381 Oct 10 23:23:12.198182 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 901/1768] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:12 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:12.230604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-29a69785-92b9-4610-9eda-3cf1d655ec2e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:12.231347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-29a69785-92b9-4610-9eda-3cf1d655ec2e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:12.238621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29a69785-92b9-4610-9eda-3cf1d655ec2e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:12.239569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29a69785-92b9-4610-9eda-3cf1d655ec2e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:12.240249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29a69785-92b9-4610-9eda-3cf1d655ec2e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:12.241186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29a69785-92b9-4610-9eda-3cf1d655ec2e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:12.241888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29a69785-92b9-4610-9eda-3cf1d655ec2e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:12.242731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29a69785-92b9-4610-9eda-3cf1d655ec2e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:12.681319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-29a69785-92b9-4610-9eda-3cf1d655ec2e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:12.692029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-29a69785-92b9-4610-9eda-3cf1d655ec2e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:12.703056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-29a69785-92b9-4610-9eda-3cf1d655ec2e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:12.704964 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-29a69785-92b9-4610-9eda-3cf1d655ec2e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1805 microversion: 2.25 time: 0.479607 Oct 10 23:23:12.717455 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 868/1769] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:12 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1805 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:12.739880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5aeb7341-b675-43c0-86a9-cd5bda6d9efd tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Calling method '.version_select at 0x7f662b794160>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:12.744727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5aeb7341-b675-43c0-86a9-cd5bda6d9efd tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:12.745239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5aeb7341-b675-43c0-86a9-cd5bda6d9efd tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:12.746296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5aeb7341-b675-43c0-86a9-cd5bda6d9efd tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:12.785286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6f5f90e7-42b0-4f88-8770-06dfc39d1e0a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:12.786214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6f5f90e7-42b0-4f88-8770-06dfc39d1e0a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:12.788355 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5aeb7341-b675-43c0-86a9-cd5bda6d9efd tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 4472 microversion: 2.25 time: 0.052444 Oct 10 23:23:12.805030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f5f90e7-42b0-4f88-8770-06dfc39d1e0a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:12.805030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f5f90e7-42b0-4f88-8770-06dfc39d1e0a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:12.805030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f5f90e7-42b0-4f88-8770-06dfc39d1e0a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:12.805030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f5f90e7-42b0-4f88-8770-06dfc39d1e0a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:12.805560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f5f90e7-42b0-4f88-8770-06dfc39d1e0a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:12.805560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f5f90e7-42b0-4f88-8770-06dfc39d1e0a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:12.807627 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 902/1770] 10.222.0.23 () {60 vars in 1184 bytes} [Mon Oct 10 23:23:12 2022] GET /compute/v2.1/os-migrations => generated 4472 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:12.831036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-54c0da45-36a0-47ea-923f-465ea0da4184 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:12.831943 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-54c0da45-36a0-47ea-923f-465ea0da4184 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:12.840305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54c0da45-36a0-47ea-923f-465ea0da4184 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:12.840948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54c0da45-36a0-47ea-923f-465ea0da4184 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:12.841534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54c0da45-36a0-47ea-923f-465ea0da4184 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:12.842685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54c0da45-36a0-47ea-923f-465ea0da4184 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:12.843542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54c0da45-36a0-47ea-923f-465ea0da4184 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:12.844297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54c0da45-36a0-47ea-923f-465ea0da4184 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:13.162725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-54c0da45-36a0-47ea-923f-465ea0da4184 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lazy-loading 'services' on Instance uuid 58fcd7f0-d348-47b1-9b3d-f7514b940eb3 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:13.180236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6f5f90e7-42b0-4f88-8770-06dfc39d1e0a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:13.189448 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6f5f90e7-42b0-4f88-8770-06dfc39d1e0a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1467 microversion: 2.1 time: 0.408189 Oct 10 23:23:13.193102 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-54c0da45-36a0-47ea-923f-465ea0da4184 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 2424 microversion: 2.25 time: 0.384071 Oct 10 23:23:13.194656 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 869/1771] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:12 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1467 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:13.207856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5527d111-4301-438a-b8b7-00e881070f78 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:13.211775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5527d111-4301-438a-b8b7-00e881070f78 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:13.213825 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 903/1772] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:12 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 2424 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:13.231196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5527d111-4301-438a-b8b7-00e881070f78 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:13.234055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5527d111-4301-438a-b8b7-00e881070f78 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:13.235443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5527d111-4301-438a-b8b7-00e881070f78 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:13.236199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5527d111-4301-438a-b8b7-00e881070f78 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:13.236666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5527d111-4301-438a-b8b7-00e881070f78 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:13.237094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5527d111-4301-438a-b8b7-00e881070f78 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:13.248153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-151179e9-38bb-412a-aa15-51187d273d92 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:13.250161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-151179e9-38bb-412a-aa15-51187d273d92 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:13.269502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-151179e9-38bb-412a-aa15-51187d273d92 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:13.270081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-151179e9-38bb-412a-aa15-51187d273d92 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:13.270542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-151179e9-38bb-412a-aa15-51187d273d92 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:13.272334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-151179e9-38bb-412a-aa15-51187d273d92 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:13.272476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-151179e9-38bb-412a-aa15-51187d273d92 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:13.272861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-151179e9-38bb-412a-aa15-51187d273d92 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:13.375571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-151179e9-38bb-412a-aa15-51187d273d92 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:13.388073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-151179e9-38bb-412a-aa15-51187d273d92 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:13.389735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-151179e9-38bb-412a-aa15-51187d273d92 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:13.395903 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-151179e9-38bb-412a-aa15-51187d273d92 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.180856 Oct 10 23:23:13.396713 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 904/1773] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:13 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:13.414069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9a075a34-b34a-41fa-90dd-ab31ca76a495 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f66339cbc10>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:13.495146 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9a075a34-b34a-41fa-90dd-ab31ca76a495 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.093540 Oct 10 23:23:13.497429 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 905/1774] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:13 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:13.506809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f7c898de-4acc-49ce-82a3-e96de9360757 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:13.507421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f7c898de-4acc-49ce-82a3-e96de9360757 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:13.519742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7c898de-4acc-49ce-82a3-e96de9360757 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:13.520234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7c898de-4acc-49ce-82a3-e96de9360757 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:13.520705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7c898de-4acc-49ce-82a3-e96de9360757 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:13.521352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7c898de-4acc-49ce-82a3-e96de9360757 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:13.521827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7c898de-4acc-49ce-82a3-e96de9360757 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:13.522256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7c898de-4acc-49ce-82a3-e96de9360757 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:13.687375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-f7c898de-4acc-49ce-82a3-e96de9360757 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lazy-loading 'services' on Instance uuid 58fcd7f0-d348-47b1-9b3d-f7514b940eb3 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:13.708608 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f7c898de-4acc-49ce-82a3-e96de9360757 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 2424 microversion: 2.25 time: 0.211695 Oct 10 23:23:13.718940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5527d111-4301-438a-b8b7-00e881070f78 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:13.724089 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 906/1775] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:13 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 2424 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:13.733911 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5527d111-4301-438a-b8b7-00e881070f78 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1211 microversion: 2.1 time: 0.537533 Oct 10 23:23:13.743733 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 870/1776] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:13 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1211 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:13.821843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-398ac7fe-1b31-40d3-a856-34fbc8f0b09b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:13.822362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-398ac7fe-1b31-40d3-a856-34fbc8f0b09b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:13.829818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-398ac7fe-1b31-40d3-a856-34fbc8f0b09b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:13.830344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-398ac7fe-1b31-40d3-a856-34fbc8f0b09b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:13.830844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-398ac7fe-1b31-40d3-a856-34fbc8f0b09b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:13.831494 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-398ac7fe-1b31-40d3-a856-34fbc8f0b09b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:13.832033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-398ac7fe-1b31-40d3-a856-34fbc8f0b09b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:13.832458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-398ac7fe-1b31-40d3-a856-34fbc8f0b09b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:13.941009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-398ac7fe-1b31-40d3-a856-34fbc8f0b09b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lazy-loading 'services' on Instance uuid 58fcd7f0-d348-47b1-9b3d-f7514b940eb3 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:14.070793 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-398ac7fe-1b31-40d3-a856-34fbc8f0b09b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "DELETE /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments/f1131f34-911c-4cd6-9b7c-52d566a442f2" status: 202 len: 0 microversion: 2.25 time: 0.253127 Oct 10 23:23:14.075834 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 907/1777] 10.222.0.23 () {60 vars in 1457 bytes} [Mon Oct 10 23:23:13 2022] DELETE /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments/f1131f34-911c-4cd6-9b7c-52d566a442f2 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:23:14.084696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a1f767bd-0c4a-46e6-83f1-11cfb7e3ec1e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:14.087138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a1f767bd-0c4a-46e6-83f1-11cfb7e3ec1e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:14.102368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1f767bd-0c4a-46e6-83f1-11cfb7e3ec1e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:14.102862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1f767bd-0c4a-46e6-83f1-11cfb7e3ec1e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:14.103300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1f767bd-0c4a-46e6-83f1-11cfb7e3ec1e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:14.104021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1f767bd-0c4a-46e6-83f1-11cfb7e3ec1e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:14.104483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1f767bd-0c4a-46e6-83f1-11cfb7e3ec1e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:14.106616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1f767bd-0c4a-46e6-83f1-11cfb7e3ec1e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:14.148941 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a1f767bd-0c4a-46e6-83f1-11cfb7e3ec1e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.068221 Oct 10 23:23:14.150166 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 871/1778] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Oct 10 23:23:14 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:23:14.172329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-c91c7c31-bdb9-4df4-ae72-89f54e1aaf28 req-5854b1dc-abd4-4b79-9cd2-53a6294cb118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9431e2e-3fb9-4834-8827-88c1e3762543", "tag": "10aa8c22-3c3a-4a97-83bc-82a7afa75cd5"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:14.184732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c91c7c31-bdb9-4df4-ae72-89f54e1aaf28 req-5854b1dc-abd4-4b79-9cd2-53a6294cb118 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:14.185554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c91c7c31-bdb9-4df4-ae72-89f54e1aaf28 req-5854b1dc-abd4-4b79-9cd2-53a6294cb118 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:14.187152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c91c7c31-bdb9-4df4-ae72-89f54e1aaf28 req-5854b1dc-abd4-4b79-9cd2-53a6294cb118 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:14.211940 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-c91c7c31-bdb9-4df4-ae72-89f54e1aaf28 req-5854b1dc-abd4-4b79-9cd2-53a6294cb118 service nova] Creating event network-changed:10aa8c22-3c3a-4a97-83bc-82a7afa75cd5 for instance e9431e2e-3fb9-4834-8827-88c1e3762543 on n-h1-860864-2 Oct 10 23:23:14.219362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-64f15363-cb66-484a-8f64-54d3c9270411 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:14.220953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-64f15363-cb66-484a-8f64-54d3c9270411 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:14.228979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64f15363-cb66-484a-8f64-54d3c9270411 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:14.229824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64f15363-cb66-484a-8f64-54d3c9270411 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:14.230589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64f15363-cb66-484a-8f64-54d3c9270411 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:14.232140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64f15363-cb66-484a-8f64-54d3c9270411 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:14.233212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64f15363-cb66-484a-8f64-54d3c9270411 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:14.233674 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-c91c7c31-bdb9-4df4-ae72-89f54e1aaf28 req-5854b1dc-abd4-4b79-9cd2-53a6294cb118 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065874 Oct 10 23:23:14.234188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64f15363-cb66-484a-8f64-54d3c9270411 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:14.243102 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 908/1779] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:23:14.424798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-44c17d5e-7008-4bfa-bf01-7626160fdf75 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:14.425835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-44c17d5e-7008-4bfa-bf01-7626160fdf75 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:14.439268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44c17d5e-7008-4bfa-bf01-7626160fdf75 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:14.439959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44c17d5e-7008-4bfa-bf01-7626160fdf75 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:14.440590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44c17d5e-7008-4bfa-bf01-7626160fdf75 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:14.441502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44c17d5e-7008-4bfa-bf01-7626160fdf75 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:14.442126 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44c17d5e-7008-4bfa-bf01-7626160fdf75 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:14.442740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44c17d5e-7008-4bfa-bf01-7626160fdf75 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:14.466576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:14.635270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-44c17d5e-7008-4bfa-bf01-7626160fdf75 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:14.645546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-64f15363-cb66-484a-8f64-54d3c9270411 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:14.652664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-44c17d5e-7008-4bfa-bf01-7626160fdf75 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:14.654167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-44c17d5e-7008-4bfa-bf01-7626160fdf75 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:14.655501 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-64f15363-cb66-484a-8f64-54d3c9270411 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1467 microversion: 2.1 time: 0.439802 Oct 10 23:23:14.656282 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 872/1780] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:14 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1467 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:14.674078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0d3825f1-c1fd-442b-9b3e-3b4d5fc0fee7 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662aed8e50>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:14.687596 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-44c17d5e-7008-4bfa-bf01-7626160fdf75 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.267049 Oct 10 23:23:14.702399 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 909/1781] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:14 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:14.764747 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b478ef3c-12f2-4678-a75d-7eeb8af08cc5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:14.765416 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b478ef3c-12f2-4678-a75d-7eeb8af08cc5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:14.775615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b478ef3c-12f2-4678-a75d-7eeb8af08cc5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:14.776195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b478ef3c-12f2-4678-a75d-7eeb8af08cc5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:14.776632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b478ef3c-12f2-4678-a75d-7eeb8af08cc5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:14.777351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b478ef3c-12f2-4678-a75d-7eeb8af08cc5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:14.778386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b478ef3c-12f2-4678-a75d-7eeb8af08cc5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:14.778827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b478ef3c-12f2-4678-a75d-7eeb8af08cc5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:14.813202 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0d3825f1-c1fd-442b-9b3e-3b4d5fc0fee7 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.144176 Oct 10 23:23:14.814216 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 873/1782] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:14 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:15.071924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b478ef3c-12f2-4678-a75d-7eeb8af08cc5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:15.087996 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b478ef3c-12f2-4678-a75d-7eeb8af08cc5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1211 microversion: 2.1 time: 0.327425 Oct 10 23:23:15.094852 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 910/1783] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:14 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1211 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:15.164454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b450a2b1-77aa-4f07-a21f-2673f35417b8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:15.172239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b450a2b1-77aa-4f07-a21f-2673f35417b8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:15.192140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b450a2b1-77aa-4f07-a21f-2673f35417b8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:15.194179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b450a2b1-77aa-4f07-a21f-2673f35417b8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:15.195499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b450a2b1-77aa-4f07-a21f-2673f35417b8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:15.196496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b450a2b1-77aa-4f07-a21f-2673f35417b8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:15.197115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b450a2b1-77aa-4f07-a21f-2673f35417b8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:15.197809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b450a2b1-77aa-4f07-a21f-2673f35417b8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:15.289678 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b450a2b1-77aa-4f07-a21f-2673f35417b8 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.128831 Oct 10 23:23:15.294234 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 874/1784] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Oct 10 23:23:15 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:23:15.683982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-de6ad4e1-d4ec-418e-8a31-90d9c349d3b6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:15.684609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-de6ad4e1-d4ec-418e-8a31-90d9c349d3b6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:15.700112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:15.700905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=20 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:15.703333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de6ad4e1-d4ec-418e-8a31-90d9c349d3b6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:15.704043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de6ad4e1-d4ec-418e-8a31-90d9c349d3b6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:15.704699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de6ad4e1-d4ec-418e-8a31-90d9c349d3b6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:15.705650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de6ad4e1-d4ec-418e-8a31-90d9c349d3b6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:15.706279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de6ad4e1-d4ec-418e-8a31-90d9c349d3b6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:15.707970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de6ad4e1-d4ec-418e-8a31-90d9c349d3b6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:15.721685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ea9669c6-cda9-4d70-8248-7fc466f0d3b0 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:15.722322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ea9669c6-cda9-4d70-8248-7fc466f0d3b0 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:15.737997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea9669c6-cda9-4d70-8248-7fc466f0d3b0 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:15.738131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea9669c6-cda9-4d70-8248-7fc466f0d3b0 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:15.739028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea9669c6-cda9-4d70-8248-7fc466f0d3b0 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:15.740652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea9669c6-cda9-4d70-8248-7fc466f0d3b0 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:15.745349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea9669c6-cda9-4d70-8248-7fc466f0d3b0 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:15.745898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea9669c6-cda9-4d70-8248-7fc466f0d3b0 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:15.807242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:15.971029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ea9669c6-cda9-4d70-8248-7fc466f0d3b0 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:15.984137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ea9669c6-cda9-4d70-8248-7fc466f0d3b0 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:15.988809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ea9669c6-cda9-4d70-8248-7fc466f0d3b0 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:15.995474 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ea9669c6-cda9-4d70-8248-7fc466f0d3b0 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.280760 Oct 10 23:23:15.996656 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 875/1785] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:15 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:16.014393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a5006b6a-196b-4536-bc26-f478e70a2f90 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662aed9700>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:16.097911 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a5006b6a-196b-4536-bc26-f478e70a2f90 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.099649 Oct 10 23:23:16.098827 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 876/1786] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:15 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:16.108852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-de6ad4e1-d4ec-418e-8a31-90d9c349d3b6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:16.116460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bfbd2f55-5a41-4c5c-afef-f5c6a4b229c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:16.117175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bfbd2f55-5a41-4c5c-afef-f5c6a4b229c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:16.122951 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-de6ad4e1-d4ec-418e-8a31-90d9c349d3b6 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1467 microversion: 2.1 time: 0.443092 Oct 10 23:23:16.126500 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 911/1787] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:15 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1467 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:16.137763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfbd2f55-5a41-4c5c-afef-f5c6a4b229c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:16.137763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfbd2f55-5a41-4c5c-afef-f5c6a4b229c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:16.137763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfbd2f55-5a41-4c5c-afef-f5c6a4b229c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:16.137763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfbd2f55-5a41-4c5c-afef-f5c6a4b229c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:16.138202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfbd2f55-5a41-4c5c-afef-f5c6a4b229c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:16.138202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfbd2f55-5a41-4c5c-afef-f5c6a4b229c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:16.274949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-21206e47-fd92-41d0-a6c1-20c28c480c4f req-2a437742-f4fa-427b-b6ff-1d064577ab80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10d4252b-2561-4a94-adf8-018fdec5c2cc", "tag": "9fd315b0-8b11-4a9f-b09c-b6b5287bc293"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:16.297324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-21206e47-fd92-41d0-a6c1-20c28c480c4f req-2a437742-f4fa-427b-b6ff-1d064577ab80 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:16.299682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-21206e47-fd92-41d0-a6c1-20c28c480c4f req-2a437742-f4fa-427b-b6ff-1d064577ab80 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:16.300310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-21206e47-fd92-41d0-a6c1-20c28c480c4f req-2a437742-f4fa-427b-b6ff-1d064577ab80 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:16.333634 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-21206e47-fd92-41d0-a6c1-20c28c480c4f req-2a437742-f4fa-427b-b6ff-1d064577ab80 service nova] Creating event network-changed:9fd315b0-8b11-4a9f-b09c-b6b5287bc293 for instance 10d4252b-2561-4a94-adf8-018fdec5c2cc on n-h2-860864-2 Oct 10 23:23:16.347423 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-21206e47-fd92-41d0-a6c1-20c28c480c4f req-2a437742-f4fa-427b-b6ff-1d064577ab80 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076905 Oct 10 23:23:16.348986 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 912/1788] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:23:16.363013 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4007c0fe-dc7f-4d0c-899a-29740967b344 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:16.379920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4007c0fe-dc7f-4d0c-899a-29740967b344 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:16.398577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4007c0fe-dc7f-4d0c-899a-29740967b344 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:16.399224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4007c0fe-dc7f-4d0c-899a-29740967b344 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:16.400803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4007c0fe-dc7f-4d0c-899a-29740967b344 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:16.402437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4007c0fe-dc7f-4d0c-899a-29740967b344 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:16.403091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4007c0fe-dc7f-4d0c-899a-29740967b344 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:16.403728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4007c0fe-dc7f-4d0c-899a-29740967b344 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:16.456630 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4007c0fe-dc7f-4d0c-899a-29740967b344 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.105939 Oct 10 23:23:16.457509 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 913/1789] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Oct 10 23:23:16 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:23:16.509550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bfbd2f55-5a41-4c5c-afef-f5c6a4b229c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:16.522611 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bfbd2f55-5a41-4c5c-afef-f5c6a4b229c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1211 microversion: 2.1 time: 0.410080 Oct 10 23:23:16.538688 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 877/1790] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:16 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1211 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:17.033319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ebed09d9-d48f-4861-b9ea-e8344db25070 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:17.034701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ebed09d9-d48f-4861-b9ea-e8344db25070 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:17.051085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebed09d9-d48f-4861-b9ea-e8344db25070 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:17.052515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebed09d9-d48f-4861-b9ea-e8344db25070 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:17.054656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebed09d9-d48f-4861-b9ea-e8344db25070 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:17.055575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebed09d9-d48f-4861-b9ea-e8344db25070 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:17.058390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebed09d9-d48f-4861-b9ea-e8344db25070 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:17.060508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebed09d9-d48f-4861-b9ea-e8344db25070 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:17.114763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ee9b439d-6c71-4b0a-a851-314a45610c55 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662aed90d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:17.237747 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ee9b439d-6c71-4b0a-a851-314a45610c55 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.127036 Oct 10 23:23:17.238969 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 878/1791] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:17 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:17.264135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d5d6765d-4f7e-4471-9f18-9a9bcda17457 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:17.267967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d5d6765d-4f7e-4471-9f18-9a9bcda17457 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:17.302535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5d6765d-4f7e-4471-9f18-9a9bcda17457 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:17.306407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5d6765d-4f7e-4471-9f18-9a9bcda17457 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:17.311646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5d6765d-4f7e-4471-9f18-9a9bcda17457 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:17.316698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5d6765d-4f7e-4471-9f18-9a9bcda17457 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:17.318233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5d6765d-4f7e-4471-9f18-9a9bcda17457 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:17.319308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5d6765d-4f7e-4471-9f18-9a9bcda17457 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:17.321616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ebed09d9-d48f-4861-b9ea-e8344db25070 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:17.335744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ebed09d9-d48f-4861-b9ea-e8344db25070 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:17.339437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ebed09d9-d48f-4861-b9ea-e8344db25070 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:17.362537 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ebed09d9-d48f-4861-b9ea-e8344db25070 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.334285 Oct 10 23:23:17.363141 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 914/1792] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:17 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:17.389944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-3efc1a8e-9fe3-4a17-bee3-e8036c11d0b3 req-e9d737b2-2732-4ace-a987-2b6875737d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5142fea1-e8ea-4f3d-964a-bed317b8342a", "name": "network-vif-unplugged", "status": "completed", "tag": "b6d015b9-418b-43be-8a73-5bb37417c784"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:17.418080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3efc1a8e-9fe3-4a17-bee3-e8036c11d0b3 req-e9d737b2-2732-4ace-a987-2b6875737d9c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:17.420365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3efc1a8e-9fe3-4a17-bee3-e8036c11d0b3 req-e9d737b2-2732-4ace-a987-2b6875737d9c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:17.421702 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3efc1a8e-9fe3-4a17-bee3-e8036c11d0b3 req-e9d737b2-2732-4ace-a987-2b6875737d9c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:17.445026 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-3efc1a8e-9fe3-4a17-bee3-e8036c11d0b3 req-e9d737b2-2732-4ace-a987-2b6875737d9c service nova] Creating event network-vif-unplugged:b6d015b9-418b-43be-8a73-5bb37417c784 for instance 5142fea1-e8ea-4f3d-964a-bed317b8342a on n-h2-860864-2 Oct 10 23:23:17.452398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [req-3efc1a8e-9fe3-4a17-bee3-e8036c11d0b3 req-e9d737b2-2732-4ace-a987-2b6875737d9c service nova] Instance 5142fea1-e8ea-4f3d-964a-bed317b8342a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 23:23:17.473277 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-3efc1a8e-9fe3-4a17-bee3-e8036c11d0b3 req-e9d737b2-2732-4ace-a987-2b6875737d9c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090559 Oct 10 23:23:17.474231 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 915/1793] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:23:17.483696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7d05c2dc-2338-4b45-9f8c-22bde6acb135 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:17.486121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7d05c2dc-2338-4b45-9f8c-22bde6acb135 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:17.493455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d05c2dc-2338-4b45-9f8c-22bde6acb135 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:17.494076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d05c2dc-2338-4b45-9f8c-22bde6acb135 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:17.494587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d05c2dc-2338-4b45-9f8c-22bde6acb135 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:17.495380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d05c2dc-2338-4b45-9f8c-22bde6acb135 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:17.496006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d05c2dc-2338-4b45-9f8c-22bde6acb135 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:17.496506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d05c2dc-2338-4b45-9f8c-22bde6acb135 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:17.567552 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7d05c2dc-2338-4b45-9f8c-22bde6acb135 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.088408 Oct 10 23:23:17.568549 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 916/1794] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Oct 10 23:23:17 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:23:17.574518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7e7c97be-9010-4703-ba3d-5f0244e30181 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:17.575371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7e7c97be-9010-4703-ba3d-5f0244e30181 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:17.582779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:17.584715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e7c97be-9010-4703-ba3d-5f0244e30181 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:17.585472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e7c97be-9010-4703-ba3d-5f0244e30181 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:17.602529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e7c97be-9010-4703-ba3d-5f0244e30181 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:17.606864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e7c97be-9010-4703-ba3d-5f0244e30181 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:17.607728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e7c97be-9010-4703-ba3d-5f0244e30181 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:17.609026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e7c97be-9010-4703-ba3d-5f0244e30181 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:17.710589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d5d6765d-4f7e-4471-9f18-9a9bcda17457 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:17.726221 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d5d6765d-4f7e-4471-9f18-9a9bcda17457 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1467 microversion: 2.1 time: 0.483840 Oct 10 23:23:17.744007 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 879/1795] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:17 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1467 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:17.827204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7e7c97be-9010-4703-ba3d-5f0244e30181 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:17.836228 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7e7c97be-9010-4703-ba3d-5f0244e30181 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1211 microversion: 2.1 time: 0.265627 Oct 10 23:23:17.836948 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 917/1796] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:17 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1211 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:18.258983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8b65be58-b336-4ec9-9258-e5e9dcc4d7b5 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662aed9d30>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:18.343420 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8b65be58-b336-4ec9-9258-e5e9dcc4d7b5 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.093160 Oct 10 23:23:18.344756 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 880/1797] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:18 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:18.396574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0b43ceac-1109-40c4-b0d6-115a990aa191 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:18.397561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0b43ceac-1109-40c4-b0d6-115a990aa191 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:18.411117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b43ceac-1109-40c4-b0d6-115a990aa191 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:18.413761 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b43ceac-1109-40c4-b0d6-115a990aa191 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:18.414400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b43ceac-1109-40c4-b0d6-115a990aa191 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:18.415483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b43ceac-1109-40c4-b0d6-115a990aa191 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:18.417639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b43ceac-1109-40c4-b0d6-115a990aa191 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:18.418526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b43ceac-1109-40c4-b0d6-115a990aa191 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:18.575316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0b43ceac-1109-40c4-b0d6-115a990aa191 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:18.588318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b16c65e1-45b2-4a01-b0c8-c29cd8359556 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:18.588672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0b43ceac-1109-40c4-b0d6-115a990aa191 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:18.593536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b16c65e1-45b2-4a01-b0c8-c29cd8359556 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:18.602191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0b43ceac-1109-40c4-b0d6-115a990aa191 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:18.605171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b16c65e1-45b2-4a01-b0c8-c29cd8359556 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:18.606135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b16c65e1-45b2-4a01-b0c8-c29cd8359556 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:18.606747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b16c65e1-45b2-4a01-b0c8-c29cd8359556 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:18.608498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b16c65e1-45b2-4a01-b0c8-c29cd8359556 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:18.609415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b16c65e1-45b2-4a01-b0c8-c29cd8359556 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:18.610607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b16c65e1-45b2-4a01-b0c8-c29cd8359556 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:18.613084 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0b43ceac-1109-40c4-b0d6-115a990aa191 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.220631 Oct 10 23:23:18.621631 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 918/1798] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:18 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:18.663232 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b16c65e1-45b2-4a01-b0c8-c29cd8359556 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.084730 Oct 10 23:23:18.666213 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 881/1799] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Oct 10 23:23:18 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 23:23:18.756536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a1e978fd-55b7-43d5-a44b-a9afa4abe21d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:18.758075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a1e978fd-55b7-43d5-a44b-a9afa4abe21d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:18.774685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1e978fd-55b7-43d5-a44b-a9afa4abe21d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:18.775564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1e978fd-55b7-43d5-a44b-a9afa4abe21d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:18.777059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1e978fd-55b7-43d5-a44b-a9afa4abe21d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:18.778473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1e978fd-55b7-43d5-a44b-a9afa4abe21d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:18.782478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1e978fd-55b7-43d5-a44b-a9afa4abe21d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:18.783398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1e978fd-55b7-43d5-a44b-a9afa4abe21d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:18.860328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a58aa729-041b-469e-94ee-a77f42607ceb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:18.862016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a58aa729-041b-469e-94ee-a77f42607ceb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:18.877301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a58aa729-041b-469e-94ee-a77f42607ceb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:18.878379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a58aa729-041b-469e-94ee-a77f42607ceb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:18.879221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a58aa729-041b-469e-94ee-a77f42607ceb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:18.880206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a58aa729-041b-469e-94ee-a77f42607ceb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:18.880891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a58aa729-041b-469e-94ee-a77f42607ceb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:18.881889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a58aa729-041b-469e-94ee-a77f42607ceb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:18.973790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a1e978fd-55b7-43d5-a44b-a9afa4abe21d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:18.984644 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a1e978fd-55b7-43d5-a44b-a9afa4abe21d tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1467 microversion: 2.1 time: 0.233956 Oct 10 23:23:18.990701 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 919/1800] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:18 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1467 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:19.080698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-7c4ea295-fb06-4ec7-a03e-55fc51f537fe req-750c75bc-f7a3-4967-b9bd-8984f895b2fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5142fea1-e8ea-4f3d-964a-bed317b8342a", "tag": "b6d015b9-418b-43be-8a73-5bb37417c784"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:19.104330 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7c4ea295-fb06-4ec7-a03e-55fc51f537fe req-750c75bc-f7a3-4967-b9bd-8984f895b2fb service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:19.104917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7c4ea295-fb06-4ec7-a03e-55fc51f537fe req-750c75bc-f7a3-4967-b9bd-8984f895b2fb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:19.105360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7c4ea295-fb06-4ec7-a03e-55fc51f537fe req-750c75bc-f7a3-4967-b9bd-8984f895b2fb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:19.134677 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-7c4ea295-fb06-4ec7-a03e-55fc51f537fe req-750c75bc-f7a3-4967-b9bd-8984f895b2fb service nova] Creating event network-changed:b6d015b9-418b-43be-8a73-5bb37417c784 for instance 5142fea1-e8ea-4f3d-964a-bed317b8342a on n-h2-860864-2 Oct 10 23:23:19.146151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [req-7c4ea295-fb06-4ec7-a03e-55fc51f537fe req-750c75bc-f7a3-4967-b9bd-8984f895b2fb service nova] Instance 5142fea1-e8ea-4f3d-964a-bed317b8342a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 23:23:19.156002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a58aa729-041b-469e-94ee-a77f42607ceb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:19.165839 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a58aa729-041b-469e-94ee-a77f42607ceb tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1199 microversion: 2.1 time: 0.309809 Oct 10 23:23:19.167355 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 882/1801] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:18 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1199 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:19.182843 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-7c4ea295-fb06-4ec7-a03e-55fc51f537fe req-750c75bc-f7a3-4967-b9bd-8984f895b2fb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106436 Oct 10 23:23:19.183487 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 920/1802] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:23:19.359861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e18ad00e-1577-4e40-b0a4-899cee2474cb tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662aeefe50>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:19.412254 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e18ad00e-1577-4e40-b0a4-899cee2474cb tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.056626 Oct 10 23:23:19.421519 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 883/1803] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:19 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:19.651679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bb0cf0fa-00f0-4b4f-9feb-a740ed0cfb6a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:19.653109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bb0cf0fa-00f0-4b4f-9feb-a740ed0cfb6a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:19.676632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-66d77f28-a3dc-402e-bd86-668f3dcee68a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:19.679599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-66d77f28-a3dc-402e-bd86-668f3dcee68a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:19.691727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb0cf0fa-00f0-4b4f-9feb-a740ed0cfb6a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:19.692684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb0cf0fa-00f0-4b4f-9feb-a740ed0cfb6a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:19.693364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb0cf0fa-00f0-4b4f-9feb-a740ed0cfb6a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:19.700823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb0cf0fa-00f0-4b4f-9feb-a740ed0cfb6a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:19.703178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66d77f28-a3dc-402e-bd86-668f3dcee68a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:19.705914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb0cf0fa-00f0-4b4f-9feb-a740ed0cfb6a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:19.707987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb0cf0fa-00f0-4b4f-9feb-a740ed0cfb6a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:19.715787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66d77f28-a3dc-402e-bd86-668f3dcee68a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:19.717843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66d77f28-a3dc-402e-bd86-668f3dcee68a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:19.720683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66d77f28-a3dc-402e-bd86-668f3dcee68a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:19.721355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66d77f28-a3dc-402e-bd86-668f3dcee68a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:19.723878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66d77f28-a3dc-402e-bd86-668f3dcee68a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:19.790683 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-66d77f28-a3dc-402e-bd86-668f3dcee68a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.117858 Oct 10 23:23:19.792300 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 884/1804] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Oct 10 23:23:19 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 23:23:19.886898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb0cf0fa-00f0-4b4f-9feb-a740ed0cfb6a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:19.897456 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb0cf0fa-00f0-4b4f-9feb-a740ed0cfb6a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:19.898926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb0cf0fa-00f0-4b4f-9feb-a740ed0cfb6a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:19.905765 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bb0cf0fa-00f0-4b4f-9feb-a740ed0cfb6a tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.258189 Oct 10 23:23:19.930687 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 921/1805] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:19 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:20.012089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9256111b-e9af-4e4e-85cd-742e7fe5328c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:20.012862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9256111b-e9af-4e4e-85cd-742e7fe5328c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:20.023905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9256111b-e9af-4e4e-85cd-742e7fe5328c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:20.024319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9256111b-e9af-4e4e-85cd-742e7fe5328c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:20.024766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9256111b-e9af-4e4e-85cd-742e7fe5328c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:20.025607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9256111b-e9af-4e4e-85cd-742e7fe5328c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:20.026001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9256111b-e9af-4e4e-85cd-742e7fe5328c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:20.026475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9256111b-e9af-4e4e-85cd-742e7fe5328c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:20.191458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bda57820-c0d8-4dba-a491-b9e22613331b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:20.192346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bda57820-c0d8-4dba-a491-b9e22613331b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:20.202128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bda57820-c0d8-4dba-a491-b9e22613331b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:20.213226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bda57820-c0d8-4dba-a491-b9e22613331b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:20.214003 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bda57820-c0d8-4dba-a491-b9e22613331b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:20.214932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bda57820-c0d8-4dba-a491-b9e22613331b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:20.215563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bda57820-c0d8-4dba-a491-b9e22613331b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:20.216164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bda57820-c0d8-4dba-a491-b9e22613331b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:20.368980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bda57820-c0d8-4dba-a491-b9e22613331b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:20.378439 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bda57820-c0d8-4dba-a491-b9e22613331b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1199 microversion: 2.1 time: 0.190975 Oct 10 23:23:20.397739 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 922/1806] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:20 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1199 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:20.427181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9256111b-e9af-4e4e-85cd-742e7fe5328c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:20.428701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1a7f8694-9bb1-4671-a365-b52a736304f8 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b764c10>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:20.441357 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9256111b-e9af-4e4e-85cd-742e7fe5328c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1467 microversion: 2.1 time: 0.433092 Oct 10 23:23:20.444768 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 885/1807] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:20 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1467 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:20.495517 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1a7f8694-9bb1-4671-a365-b52a736304f8 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.071250 Oct 10 23:23:20.504639 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 923/1808] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:20 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:20.804298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ed20f3fc-bbd2-4bcd-9a83-44398b85ea65 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:20.806934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ed20f3fc-bbd2-4bcd-9a83-44398b85ea65 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:20.823304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed20f3fc-bbd2-4bcd-9a83-44398b85ea65 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:20.824407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed20f3fc-bbd2-4bcd-9a83-44398b85ea65 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:20.829410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed20f3fc-bbd2-4bcd-9a83-44398b85ea65 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:20.830332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed20f3fc-bbd2-4bcd-9a83-44398b85ea65 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:20.830714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed20f3fc-bbd2-4bcd-9a83-44398b85ea65 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:20.831148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed20f3fc-bbd2-4bcd-9a83-44398b85ea65 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:20.873796 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ed20f3fc-bbd2-4bcd-9a83-44398b85ea65 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.073253 Oct 10 23:23:20.879313 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 886/1809] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Oct 10 23:23:20 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:23:20.945919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1709127d-ac64-490e-9ca8-5028af28e422 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:20.947170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1709127d-ac64-490e-9ca8-5028af28e422 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:20.973204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1709127d-ac64-490e-9ca8-5028af28e422 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:20.973758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1709127d-ac64-490e-9ca8-5028af28e422 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:20.974201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1709127d-ac64-490e-9ca8-5028af28e422 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:20.974929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1709127d-ac64-490e-9ca8-5028af28e422 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:20.975613 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1709127d-ac64-490e-9ca8-5028af28e422 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:20.976044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1709127d-ac64-490e-9ca8-5028af28e422 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:21.112427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1709127d-ac64-490e-9ca8-5028af28e422 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:21.120938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1709127d-ac64-490e-9ca8-5028af28e422 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:21.122751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1709127d-ac64-490e-9ca8-5028af28e422 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:21.129528 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1709127d-ac64-490e-9ca8-5028af28e422 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.196233 Oct 10 23:23:21.147209 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 924/1810] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:20 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:21.406179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8d305af1-6d30-49e3-b6a6-6e4e3cd314a8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:21.407012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8d305af1-6d30-49e3-b6a6-6e4e3cd314a8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:21.421065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d305af1-6d30-49e3-b6a6-6e4e3cd314a8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:21.422548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d305af1-6d30-49e3-b6a6-6e4e3cd314a8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:21.423193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d305af1-6d30-49e3-b6a6-6e4e3cd314a8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:21.424110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d305af1-6d30-49e3-b6a6-6e4e3cd314a8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:21.424736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d305af1-6d30-49e3-b6a6-6e4e3cd314a8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:21.427030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d305af1-6d30-49e3-b6a6-6e4e3cd314a8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:21.477612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-777beb86-0374-4827-ae65-ffe69385c5ae tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:21.478605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-777beb86-0374-4827-ae65-ffe69385c5ae tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:21.506469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-777beb86-0374-4827-ae65-ffe69385c5ae tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:21.507435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-777beb86-0374-4827-ae65-ffe69385c5ae tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:21.508142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-777beb86-0374-4827-ae65-ffe69385c5ae tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:21.509142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-777beb86-0374-4827-ae65-ffe69385c5ae tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:21.509877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-777beb86-0374-4827-ae65-ffe69385c5ae tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:21.511774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-777beb86-0374-4827-ae65-ffe69385c5ae tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:21.650771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8d305af1-6d30-49e3-b6a6-6e4e3cd314a8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:21.662021 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8d305af1-6d30-49e3-b6a6-6e4e3cd314a8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1199 microversion: 2.1 time: 0.260733 Oct 10 23:23:21.678843 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 887/1811] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:21 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1199 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:21.686155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b2c67781-2317-48e1-8849-8a6238685aa3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662aed91f0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:21.766243 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b2c67781-2317-48e1-8849-8a6238685aa3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.085618 Oct 10 23:23:21.778955 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 888/1812] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:21 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:21.900569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a4a7160a-42e4-43b3-a7ec-ef683b9c7db4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:21.903728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a4a7160a-42e4-43b3-a7ec-ef683b9c7db4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:21.920286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4a7160a-42e4-43b3-a7ec-ef683b9c7db4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:21.923594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4a7160a-42e4-43b3-a7ec-ef683b9c7db4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:21.924055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4a7160a-42e4-43b3-a7ec-ef683b9c7db4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:21.924912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4a7160a-42e4-43b3-a7ec-ef683b9c7db4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:21.925452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4a7160a-42e4-43b3-a7ec-ef683b9c7db4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:21.928042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4a7160a-42e4-43b3-a7ec-ef683b9c7db4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:21.981818 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a4a7160a-42e4-43b3-a7ec-ef683b9c7db4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.098473 Oct 10 23:23:21.987585 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 889/1813] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Oct 10 23:23:21 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 23:23:22.037456 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-777beb86-0374-4827-ae65-ffe69385c5ae tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:22.050642 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-777beb86-0374-4827-ae65-ffe69385c5ae tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1467 microversion: 2.1 time: 0.583761 Oct 10 23:23:22.065324 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 925/1814] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:21 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1467 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:22.163424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8d7e2518-16e5-4391-8cd9-14df76c49221 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:22.164281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8d7e2518-16e5-4391-8cd9-14df76c49221 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:22.189143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d7e2518-16e5-4391-8cd9-14df76c49221 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:22.191589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d7e2518-16e5-4391-8cd9-14df76c49221 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:22.193731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d7e2518-16e5-4391-8cd9-14df76c49221 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:22.194671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d7e2518-16e5-4391-8cd9-14df76c49221 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:22.196522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d7e2518-16e5-4391-8cd9-14df76c49221 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:22.200662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d7e2518-16e5-4391-8cd9-14df76c49221 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:22.238009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:22.349928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8d7e2518-16e5-4391-8cd9-14df76c49221 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:22.362146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8d7e2518-16e5-4391-8cd9-14df76c49221 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:22.363865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8d7e2518-16e5-4391-8cd9-14df76c49221 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:22.370130 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8d7e2518-16e5-4391-8cd9-14df76c49221 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.212299 Oct 10 23:23:22.377447 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 890/1815] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:22 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:22.691711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7a36601c-97c6-4742-bae7-72327edcf99b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:22.692557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7a36601c-97c6-4742-bae7-72327edcf99b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:22.708862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a36601c-97c6-4742-bae7-72327edcf99b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:22.709536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a36601c-97c6-4742-bae7-72327edcf99b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:22.709826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a36601c-97c6-4742-bae7-72327edcf99b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:22.710543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a36601c-97c6-4742-bae7-72327edcf99b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:22.710994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a36601c-97c6-4742-bae7-72327edcf99b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:22.711628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a36601c-97c6-4742-bae7-72327edcf99b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:22.795805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0eba27aa-2969-4f17-be22-09e5d7ea1bf3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662aeff430>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:22.879367 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0eba27aa-2969-4f17-be22-09e5d7ea1bf3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.098558 Oct 10 23:23:22.880146 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 891/1816] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:22 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:22.939664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7a36601c-97c6-4742-bae7-72327edcf99b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:22.950263 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7a36601c-97c6-4742-bae7-72327edcf99b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1199 microversion: 2.1 time: 0.262314 Oct 10 23:23:22.951225 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 926/1817] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:22 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1199 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:22.994806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-64c13351-39d3-460d-85cf-0c80ff5f0ef9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:22.997188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-64c13351-39d3-460d-85cf-0c80ff5f0ef9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:23.007857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64c13351-39d3-460d-85cf-0c80ff5f0ef9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:23.008667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64c13351-39d3-460d-85cf-0c80ff5f0ef9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:23.010070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64c13351-39d3-460d-85cf-0c80ff5f0ef9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:23.011003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64c13351-39d3-460d-85cf-0c80ff5f0ef9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:23.011800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64c13351-39d3-460d-85cf-0c80ff5f0ef9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:23.012434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64c13351-39d3-460d-85cf-0c80ff5f0ef9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:23.054778 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-64c13351-39d3-460d-85cf-0c80ff5f0ef9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.064145 Oct 10 23:23:23.055384 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 892/1818] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Oct 10 23:23:22 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:23:23.080442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f3d5d26e-13d5-47c8-99da-b78d0365f54c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:23.083035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f3d5d26e-13d5-47c8-99da-b78d0365f54c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:23.094016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3d5d26e-13d5-47c8-99da-b78d0365f54c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:23.095015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3d5d26e-13d5-47c8-99da-b78d0365f54c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:23.095771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3d5d26e-13d5-47c8-99da-b78d0365f54c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:23.096713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3d5d26e-13d5-47c8-99da-b78d0365f54c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:23.097563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3d5d26e-13d5-47c8-99da-b78d0365f54c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:23.098244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3d5d26e-13d5-47c8-99da-b78d0365f54c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:23.278067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f3d5d26e-13d5-47c8-99da-b78d0365f54c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:23.289071 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f3d5d26e-13d5-47c8-99da-b78d0365f54c tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1460 microversion: 2.1 time: 0.213359 Oct 10 23:23:23.289810 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 927/1819] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:23 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1460 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:23.314339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b4e4e89c-8e78-470d-b91c-7303a160c121 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:23.315091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b4e4e89c-8e78-470d-b91c-7303a160c121 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:23.322013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4e4e89c-8e78-470d-b91c-7303a160c121 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:23.322663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4e4e89c-8e78-470d-b91c-7303a160c121 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:23.323892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4e4e89c-8e78-470d-b91c-7303a160c121 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:23.324119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4e4e89c-8e78-470d-b91c-7303a160c121 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:23.324673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4e4e89c-8e78-470d-b91c-7303a160c121 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:23.325192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4e4e89c-8e78-470d-b91c-7303a160c121 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:23.405417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3d01155a-713c-4dc1-9e4f-fb714ddd7eb4 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:23.406261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3d01155a-713c-4dc1-9e4f-fb714ddd7eb4 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:23.417651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d01155a-713c-4dc1-9e4f-fb714ddd7eb4 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:23.418167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d01155a-713c-4dc1-9e4f-fb714ddd7eb4 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:23.418935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d01155a-713c-4dc1-9e4f-fb714ddd7eb4 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:23.419749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d01155a-713c-4dc1-9e4f-fb714ddd7eb4 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:23.420392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d01155a-713c-4dc1-9e4f-fb714ddd7eb4 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:23.421451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d01155a-713c-4dc1-9e4f-fb714ddd7eb4 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:23.426754 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:23.497968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3d01155a-713c-4dc1-9e4f-fb714ddd7eb4 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:23.511876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3d01155a-713c-4dc1-9e4f-fb714ddd7eb4 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:23.514766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3d01155a-713c-4dc1-9e4f-fb714ddd7eb4 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:23.522191 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3d01155a-713c-4dc1-9e4f-fb714ddd7eb4 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.121286 Oct 10 23:23:23.523484 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 928/1820] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:23 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:23:23.559304 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b4e4e89c-8e78-470d-b91c-7303a160c121 tempest-MigrationsAdminTest-1558972064 tempest-MigrationsAdminTest-1558972064-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1611 microversion: 2.1 time: 0.249838 Oct 10 23:23:23.573981 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 893/1821] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:23 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1611 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:23.591886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6587bf8d-dcc8-43a0-bbe4-5546a7bacbc8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:23.592903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6587bf8d-dcc8-43a0-bbe4-5546a7bacbc8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:23.599430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6587bf8d-dcc8-43a0-bbe4-5546a7bacbc8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:23.599862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6587bf8d-dcc8-43a0-bbe4-5546a7bacbc8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:23.600320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6587bf8d-dcc8-43a0-bbe4-5546a7bacbc8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:23.601116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6587bf8d-dcc8-43a0-bbe4-5546a7bacbc8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:23.601650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6587bf8d-dcc8-43a0-bbe4-5546a7bacbc8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:23.602088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6587bf8d-dcc8-43a0-bbe4-5546a7bacbc8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:23.633487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6587bf8d-dcc8-43a0-bbe4-5546a7bacbc8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:23:23.768297 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6587bf8d-dcc8-43a0-bbe4-5546a7bacbc8 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 204 len: 0 microversion: 2.1 time: 0.180160 Oct 10 23:23:23.771940 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 929/1822] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:23:23 2022] DELETE /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:23:23.779169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b4e3362e-ccb0-47c3-ab61-fb4d4ab94d4f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:23.780429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b4e3362e-ccb0-47c3-ab61-fb4d4ab94d4f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:23.792081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4e3362e-ccb0-47c3-ab61-fb4d4ab94d4f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:23.792889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4e3362e-ccb0-47c3-ab61-fb4d4ab94d4f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:23.793707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4e3362e-ccb0-47c3-ab61-fb4d4ab94d4f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:23.794724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4e3362e-ccb0-47c3-ab61-fb4d4ab94d4f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:23.795502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4e3362e-ccb0-47c3-ab61-fb4d4ab94d4f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:23.795868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4e3362e-ccb0-47c3-ab61-fb4d4ab94d4f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:23.896135 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a6957432-e403-4052-9787-28659910eca4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b764b80>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:23.955282 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a6957432-e403-4052-9787-28659910eca4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.063073 Oct 10 23:23:23.956585 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 930/1823] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:23 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:23.980396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-67c764d9-0a08-4415-950d-66cd10574c83 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:23.981282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-67c764d9-0a08-4415-950d-66cd10574c83 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:23.990448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67c764d9-0a08-4415-950d-66cd10574c83 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:23.990448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67c764d9-0a08-4415-950d-66cd10574c83 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:23.990448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67c764d9-0a08-4415-950d-66cd10574c83 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:23.990907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67c764d9-0a08-4415-950d-66cd10574c83 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:23.991255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67c764d9-0a08-4415-950d-66cd10574c83 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:23.991838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67c764d9-0a08-4415-950d-66cd10574c83 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:23.994749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b4e3362e-ccb0-47c3-ab61-fb4d4ab94d4f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:24.005894 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b4e3362e-ccb0-47c3-ab61-fb4d4ab94d4f tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1466 microversion: 2.1 time: 0.231934 Oct 10 23:23:24.010215 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 894/1824] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:23 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1466 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:24.068308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7759551e-6843-4d9e-ba4a-14c7fe37ccda tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:24.070921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7759551e-6843-4d9e-ba4a-14c7fe37ccda tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:24.077345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7759551e-6843-4d9e-ba4a-14c7fe37ccda tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:24.078339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7759551e-6843-4d9e-ba4a-14c7fe37ccda tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:24.078476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7759551e-6843-4d9e-ba4a-14c7fe37ccda tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:24.079206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7759551e-6843-4d9e-ba4a-14c7fe37ccda tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:24.079634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7759551e-6843-4d9e-ba4a-14c7fe37ccda tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:24.080071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7759551e-6843-4d9e-ba4a-14c7fe37ccda tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:24.116059 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7759551e-6843-4d9e-ba4a-14c7fe37ccda tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.051094 Oct 10 23:23:24.121421 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 895/1825] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Oct 10 23:23:24 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:24.177597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-67c764d9-0a08-4415-950d-66cd10574c83 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:24.178307 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-67c764d9-0a08-4415-950d-66cd10574c83 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1199 microversion: 2.1 time: 0.202068 Oct 10 23:23:24.182765 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 931/1826] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:23 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1199 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:24.553743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4a335fd8-70cb-488d-90ed-e80fef565f29 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:24.554246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4a335fd8-70cb-488d-90ed-e80fef565f29 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:24.563753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a335fd8-70cb-488d-90ed-e80fef565f29 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:24.564239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a335fd8-70cb-488d-90ed-e80fef565f29 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:24.564678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a335fd8-70cb-488d-90ed-e80fef565f29 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:24.565730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a335fd8-70cb-488d-90ed-e80fef565f29 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:24.566767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a335fd8-70cb-488d-90ed-e80fef565f29 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:24.566767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a335fd8-70cb-488d-90ed-e80fef565f29 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:24.673830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4a335fd8-70cb-488d-90ed-e80fef565f29 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:24.685884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4a335fd8-70cb-488d-90ed-e80fef565f29 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:24.690881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4a335fd8-70cb-488d-90ed-e80fef565f29 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:24.697836 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4a335fd8-70cb-488d-90ed-e80fef565f29 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.148229 Oct 10 23:23:24.703856 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 896/1827] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:24 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:24.949309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-61f73422-1ecd-4ce3-ba6c-a0c1eeee8bc6 req-c4d54fa0-8f50-4ac8-90e7-580fcddd8181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5142fea1-e8ea-4f3d-964a-bed317b8342a", "name": "network-vif-plugged", "status": "completed", "tag": "b6d015b9-418b-43be-8a73-5bb37417c784"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:24.972241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-61f73422-1ecd-4ce3-ba6c-a0c1eeee8bc6 req-c4d54fa0-8f50-4ac8-90e7-580fcddd8181 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:24.972758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-61f73422-1ecd-4ce3-ba6c-a0c1eeee8bc6 req-c4d54fa0-8f50-4ac8-90e7-580fcddd8181 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:24.973135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3d9b327e-408d-4590-9ee8-9fc9e726abf2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662aed89d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:24.973664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-61f73422-1ecd-4ce3-ba6c-a0c1eeee8bc6 req-c4d54fa0-8f50-4ac8-90e7-580fcddd8181 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:25.008338 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-61f73422-1ecd-4ce3-ba6c-a0c1eeee8bc6 req-c4d54fa0-8f50-4ac8-90e7-580fcddd8181 service nova] Creating event network-vif-plugged:b6d015b9-418b-43be-8a73-5bb37417c784 for instance 5142fea1-e8ea-4f3d-964a-bed317b8342a on n-h2-860864-2 Oct 10 23:23:25.019848 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-61f73422-1ecd-4ce3-ba6c-a0c1eeee8bc6 req-c4d54fa0-8f50-4ac8-90e7-580fcddd8181 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073467 Oct 10 23:23:25.020947 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 932/1828] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:23:25.035413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1f195a64-c570-480a-bfbc-c5461da78985 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:25.036496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1f195a64-c570-480a-bfbc-c5461da78985 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:25.044358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f195a64-c570-480a-bfbc-c5461da78985 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:25.044899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f195a64-c570-480a-bfbc-c5461da78985 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:25.045639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f195a64-c570-480a-bfbc-c5461da78985 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:25.046654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f195a64-c570-480a-bfbc-c5461da78985 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:25.047188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f195a64-c570-480a-bfbc-c5461da78985 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:25.047617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f195a64-c570-480a-bfbc-c5461da78985 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:25.052568 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3d9b327e-408d-4590-9ee8-9fc9e726abf2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1414 microversion: 2.1 time: 0.084487 Oct 10 23:23:25.053859 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 897/1829] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:24 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:25.207668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-72f6a9ae-a676-48a2-8722-8f939712a455 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:25.208719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-72f6a9ae-a676-48a2-8722-8f939712a455 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:25.227057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72f6a9ae-a676-48a2-8722-8f939712a455 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:25.227668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72f6a9ae-a676-48a2-8722-8f939712a455 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:25.230855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72f6a9ae-a676-48a2-8722-8f939712a455 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:25.231625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72f6a9ae-a676-48a2-8722-8f939712a455 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:25.232094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72f6a9ae-a676-48a2-8722-8f939712a455 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:25.232529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72f6a9ae-a676-48a2-8722-8f939712a455 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:25.233724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1f195a64-c570-480a-bfbc-c5461da78985 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:25.242458 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1f195a64-c570-480a-bfbc-c5461da78985 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1466 microversion: 2.1 time: 0.211605 Oct 10 23:23:25.258736 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 933/1830] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:25 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1466 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:25.472036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-72f6a9ae-a676-48a2-8722-8f939712a455 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:25.480217 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-72f6a9ae-a676-48a2-8722-8f939712a455 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1199 microversion: 2.1 time: 0.277305 Oct 10 23:23:25.481447 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 898/1831] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:25 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1199 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:25.754382 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b0bdede3-5859-425b-b593-860419e27a9f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:25.755291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b0bdede3-5859-425b-b593-860419e27a9f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:25.761977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0bdede3-5859-425b-b593-860419e27a9f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:25.762756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0bdede3-5859-425b-b593-860419e27a9f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:25.763363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0bdede3-5859-425b-b593-860419e27a9f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:25.764378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0bdede3-5859-425b-b593-860419e27a9f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:25.764909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0bdede3-5859-425b-b593-860419e27a9f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:25.765322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0bdede3-5859-425b-b593-860419e27a9f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:26.078595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1128612a-6b9b-4714-a3d6-6e1f42727463 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662aed8ee0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:26.115075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b0bdede3-5859-425b-b593-860419e27a9f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:26.130181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b0bdede3-5859-425b-b593-860419e27a9f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:26.142082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b0bdede3-5859-425b-b593-860419e27a9f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:26.155133 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b0bdede3-5859-425b-b593-860419e27a9f tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.404626 Oct 10 23:23:26.165707 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 934/1832] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:25 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:26.178752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-e7ed660b-a206-4383-88af-bc1a594f2bc3 req-be035055-d0d7-40a9-ab97-83926a9d5637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5142fea1-e8ea-4f3d-964a-bed317b8342a", "name": "network-vif-deleted", "tag": "b6d015b9-418b-43be-8a73-5bb37417c784"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:26.186795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e7ed660b-a206-4383-88af-bc1a594f2bc3 req-be035055-d0d7-40a9-ab97-83926a9d5637 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:26.186795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e7ed660b-a206-4383-88af-bc1a594f2bc3 req-be035055-d0d7-40a9-ab97-83926a9d5637 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:26.187153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e7ed660b-a206-4383-88af-bc1a594f2bc3 req-be035055-d0d7-40a9-ab97-83926a9d5637 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:26.220445 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-e7ed660b-a206-4383-88af-bc1a594f2bc3 req-be035055-d0d7-40a9-ab97-83926a9d5637 service nova] Creating event network-vif-deleted:b6d015b9-418b-43be-8a73-5bb37417c784 for instance 5142fea1-e8ea-4f3d-964a-bed317b8342a on n-h2-860864-2 Oct 10 23:23:26.233062 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-e7ed660b-a206-4383-88af-bc1a594f2bc3 req-be035055-d0d7-40a9-ab97-83926a9d5637 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067050 Oct 10 23:23:26.237222 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 935/1833] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:23:26.269428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-74cbb4e4-6866-4840-830f-ea9395da436b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:26.270129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-74cbb4e4-6866-4840-830f-ea9395da436b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:26.278193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74cbb4e4-6866-4840-830f-ea9395da436b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:26.278689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74cbb4e4-6866-4840-830f-ea9395da436b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:26.279128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74cbb4e4-6866-4840-830f-ea9395da436b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:26.280818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74cbb4e4-6866-4840-830f-ea9395da436b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:26.281279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74cbb4e4-6866-4840-830f-ea9395da436b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:26.281738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74cbb4e4-6866-4840-830f-ea9395da436b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:26.425283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-74cbb4e4-6866-4840-830f-ea9395da436b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:26.441653 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-74cbb4e4-6866-4840-830f-ea9395da436b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 200 len: 1296 microversion: 2.1 time: 0.176735 Oct 10 23:23:26.449021 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 936/1834] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:26 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 1296 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:26.508175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-44045d02-a8ab-49a1-a1e9-f38bf64b8fc4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:26.508786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-44045d02-a8ab-49a1-a1e9-f38bf64b8fc4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:26.524963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44045d02-a8ab-49a1-a1e9-f38bf64b8fc4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:26.525746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44045d02-a8ab-49a1-a1e9-f38bf64b8fc4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:26.526623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44045d02-a8ab-49a1-a1e9-f38bf64b8fc4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:26.527514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44045d02-a8ab-49a1-a1e9-f38bf64b8fc4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:26.528130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44045d02-a8ab-49a1-a1e9-f38bf64b8fc4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:26.528724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44045d02-a8ab-49a1-a1e9-f38bf64b8fc4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:26.701009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-44045d02-a8ab-49a1-a1e9-f38bf64b8fc4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:26.710436 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-44045d02-a8ab-49a1-a1e9-f38bf64b8fc4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1199 microversion: 2.1 time: 0.208200 Oct 10 23:23:26.725935 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 937/1835] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:26 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1199 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:26.988524 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1128612a-6b9b-4714-a3d6-6e1f42727463 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1423 microversion: 2.1 time: 0.922466 Oct 10 23:23:26.994397 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 899/1836] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:26 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1423 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:27.005891 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-77101ab0-11f7-4f9c-b7da-ba510bb7f698 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b764ee0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:27.058721 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-77101ab0-11f7-4f9c-b7da-ba510bb7f698 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 200 len: 1423 microversion: 2.1 time: 0.058901 Oct 10 23:23:27.059493 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 938/1837] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:23:26 2022] GET /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 1423 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:27.073234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8bcf65c5-69a6-4ae0-bac6-e74b1e1fb629 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662aeff430>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:27.185605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-41d2e293-b5e5-41eb-8ad2-081f7f69f4db tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:27.187299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-41d2e293-b5e5-41eb-8ad2-081f7f69f4db tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:27.194989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41d2e293-b5e5-41eb-8ad2-081f7f69f4db tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:27.195580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41d2e293-b5e5-41eb-8ad2-081f7f69f4db tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:27.196098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41d2e293-b5e5-41eb-8ad2-081f7f69f4db tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:27.197193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41d2e293-b5e5-41eb-8ad2-081f7f69f4db tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:27.197748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41d2e293-b5e5-41eb-8ad2-081f7f69f4db tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:27.198262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41d2e293-b5e5-41eb-8ad2-081f7f69f4db tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:27.267813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-41d2e293-b5e5-41eb-8ad2-081f7f69f4db tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:27.281156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-41d2e293-b5e5-41eb-8ad2-081f7f69f4db tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:27.282634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-41d2e293-b5e5-41eb-8ad2-081f7f69f4db tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:27.287874 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-41d2e293-b5e5-41eb-8ad2-081f7f69f4db tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.106253 Oct 10 23:23:27.288447 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 939/1838] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:27 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:23:27.465697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8c031550-45de-4148-b8ba-b12515795924 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:27.466346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8c031550-45de-4148-b8ba-b12515795924 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 5142fea1-e8ea-4f3d-964a-bed317b8342a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:27.472870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c031550-45de-4148-b8ba-b12515795924 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:27.473361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c031550-45de-4148-b8ba-b12515795924 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:27.473831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c031550-45de-4148-b8ba-b12515795924 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:27.474534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c031550-45de-4148-b8ba-b12515795924 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:27.475220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c031550-45de-4148-b8ba-b12515795924 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:27.475872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c031550-45de-4148-b8ba-b12515795924 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:27.492864 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-8c031550-45de-4148-b8ba-b12515795924 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] HTTP exception thrown: Instance 5142fea1-e8ea-4f3d-964a-bed317b8342a could not be found. Oct 10 23:23:27.494566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8c031550-45de-4148-b8ba-b12515795924 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Request method failure captured: Oct 10 23:23:27.494566 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a HTTP/1.1 Oct 10 23:23:27.494566 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:23:27.494566 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:23:27.494566 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:23:27.494566 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:23:27.494566 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:23:27.494566 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:23:27.494566 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:23:27.494566 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:23:27.494566 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgnbrtWotA5vmkMo4hAdL8zla9ltVJq-vphOMSGbrqzaupm4dOUwfwyPpRyCiSMe1ZEHR5Rz6ca9pvzk6spT16CJ3_AnSaqjs3ef9DkCCEHXnz-vKjdA5h1eyrWc9CCRHx4DSLeiktr5YussnAysO_dJn6OE8X75o9Na45EF6imrn0 Oct 10 23:23:27.494566 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:23:27.494566 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:23:27.494566 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:23:27.494566 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:23:27.494566 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:23:27.494566 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:23:27.494566 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 8fad4e7ad7ba4e8284360ccf30d71228 Oct 10 23:23:27.494566 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-MigrationsAdminTest-315073527 Oct 10 23:23:27.494566 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:23:27.494566 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:23:27.496502 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8fad4e7ad7ba4e8284360ccf30d71228"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fad4e7ad7ba4e8284360ccf30d71228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fad4e7ad7ba4e8284360ccf30d71228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8fad4e7ad7ba4e8284360ccf30d71228", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:23:27.496502 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-MigrationsAdminTest-315073527 Oct 10 23:23:27.496502 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 8fad4e7ad7ba4e8284360ccf30d71228 Oct 10 23:23:27.496502 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-MigrationsAdminTest-315073527 Oct 10 23:23:27.496502 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-MigrationsAdminTest-315073527-project Oct 10 23:23:27.496502 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:23:27.496502 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:23:27.496502 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: cbc0deea66094fac8d5f985e133ceaaa Oct 10 23:23:27.496502 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-MigrationsAdminTest-315073527-project Oct 10 23:23:27.496502 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:23:27.496502 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 5142fea1-e8ea-4f3d-964a-bed317b8342a could not be found. Oct 10 23:23:27.496502 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '5142fea1-e8ea-4f3d-964a-bed317b8342a'} Oct 10 23:23:27.497495 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:23:27.497495 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:23:27.497495 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:23:27.497495 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:23:27.497495 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:23:27.497495 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:23:27.497495 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:23:27.497495 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:23:27.497495 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:23:27.497495 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:23:27.497495 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5142fea1-e8ea-4f3d-964a-bed317b8342a could not be found. Oct 10 23:23:27.497495 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:23:27.497495 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:23:27.497495 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:23:27.497495 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:23:27.497495 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:23:27.497495 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:23:27.497495 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:23:27.497495 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:23:27.497495 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:23:27.499380 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:23:27.499380 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:23:27.499380 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:23:27.499380 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:23:27.499380 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:23:27.499380 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:23:27.499380 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:23:27.499380 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5142fea1-e8ea-4f3d-964a-bed317b8342a could not be found. Oct 10 23:23:27.499380 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:23:27.499380 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:23:27.499380 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:23:27.499380 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:23:27.499380 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:23:27.499380 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:23:27.499380 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:23:27.499380 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:23:27.499380 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5142fea1-e8ea-4f3d-964a-bed317b8342a could not be found. Oct 10 23:23:27.499380 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:23:27.500954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8c031550-45de-4148-b8ba-b12515795924 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Returning 404 to user: Instance 5142fea1-e8ea-4f3d-964a-bed317b8342a could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:23:27.500954 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8c031550-45de-4148-b8ba-b12515795924 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a" status: 404 len: 111 microversion: 2.1 time: 0.034231 Oct 10 23:23:27.500954 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 940/1839] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:27 2022] GET /compute/v2.1/servers/5142fea1-e8ea-4f3d-964a-bed317b8342a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:23:27.506579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2f5a3420-c1d0-46c5-b5d1-51c7b8795467 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:27.506579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2f5a3420-c1d0-46c5-b5d1-51c7b8795467 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:27.512586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f5a3420-c1d0-46c5-b5d1-51c7b8795467 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:27.513198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f5a3420-c1d0-46c5-b5d1-51c7b8795467 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:27.513670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f5a3420-c1d0-46c5-b5d1-51c7b8795467 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:27.515074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f5a3420-c1d0-46c5-b5d1-51c7b8795467 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:27.515639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f5a3420-c1d0-46c5-b5d1-51c7b8795467 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:27.516075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f5a3420-c1d0-46c5-b5d1-51c7b8795467 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:27.560586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2f5a3420-c1d0-46c5-b5d1-51c7b8795467 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:23:27.702716 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8bcf65c5-69a6-4ae0-bac6-e74b1e1fb629 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "DELETE /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 204 len: 0 microversion: 2.1 time: 0.633116 Oct 10 23:23:27.703527 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2f5a3420-c1d0-46c5-b5d1-51c7b8795467 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 204 len: 0 microversion: 2.1 time: 0.201503 Oct 10 23:23:27.703936 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 900/1840] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:27 2022] DELETE /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:23:27.708316 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 941/1841] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:23:27 2022] DELETE /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:23:27.712231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f0eab6c2-c140-4c34-bea8-8cbd96b22ae3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:27.712830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f0eab6c2-c140-4c34-bea8-8cbd96b22ae3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: fe8a45b4-e6cb-434f-8e97-8caa78888257] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:27.713814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a91279db-aa8f-4ea4-ba57-bcc561cb4250 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:27.714529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a91279db-aa8f-4ea4-ba57-bcc561cb4250 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:27.720802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0eab6c2-c140-4c34-bea8-8cbd96b22ae3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:27.721138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a91279db-aa8f-4ea4-ba57-bcc561cb4250 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:27.721663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a91279db-aa8f-4ea4-ba57-bcc561cb4250 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:27.721914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0eab6c2-c140-4c34-bea8-8cbd96b22ae3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:27.722105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a91279db-aa8f-4ea4-ba57-bcc561cb4250 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:27.722542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0eab6c2-c140-4c34-bea8-8cbd96b22ae3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:27.722808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a91279db-aa8f-4ea4-ba57-bcc561cb4250 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:27.723240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0eab6c2-c140-4c34-bea8-8cbd96b22ae3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:27.723434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a91279db-aa8f-4ea4-ba57-bcc561cb4250 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:27.723675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0eab6c2-c140-4c34-bea8-8cbd96b22ae3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:27.723850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a91279db-aa8f-4ea4-ba57-bcc561cb4250 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:27.724364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0eab6c2-c140-4c34-bea8-8cbd96b22ae3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:27.753562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f0eab6c2-c140-4c34-bea8-8cbd96b22ae3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: fe8a45b4-e6cb-434f-8e97-8caa78888257] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:23:27.852212 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f0eab6c2-c140-4c34-bea8-8cbd96b22ae3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257" status: 204 len: 0 microversion: 2.1 time: 0.143872 Oct 10 23:23:27.853137 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 901/1842] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:23:27 2022] DELETE /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:23:27.866540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d60dacce-49c5-4a60-9559-97de3d3f59ce tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:27.867576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d60dacce-49c5-4a60-9559-97de3d3f59ce tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:27.875683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d60dacce-49c5-4a60-9559-97de3d3f59ce tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:27.876469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d60dacce-49c5-4a60-9559-97de3d3f59ce tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:27.876980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d60dacce-49c5-4a60-9559-97de3d3f59ce tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:27.877820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d60dacce-49c5-4a60-9559-97de3d3f59ce tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:27.878406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d60dacce-49c5-4a60-9559-97de3d3f59ce tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:27.878893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d60dacce-49c5-4a60-9559-97de3d3f59ce tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:27.887126 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a91279db-aa8f-4ea4-ba57-bcc561cb4250 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:27.898898 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a91279db-aa8f-4ea4-ba57-bcc561cb4250 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1534 microversion: 2.1 time: 0.189424 Oct 10 23:23:27.900480 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 942/1843] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:27 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1534 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:27.978062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-751954d5-bc92-48b5-94b4-e51c8d12227d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1081947838", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "2e70e5c7-da0e-4bbe-970c-c601496b5c6b"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:28.037543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d60dacce-49c5-4a60-9559-97de3d3f59ce tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:28.038918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-751954d5-bc92-48b5-94b4-e51c8d12227d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] validate_networks() for [('2e70e5c7-da0e-4bbe-970c-c601496b5c6b', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:23:28.046249 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d60dacce-49c5-4a60-9559-97de3d3f59ce tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1199 microversion: 2.1 time: 0.191708 Oct 10 23:23:28.048998 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 902/1844] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:27 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1199 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:28.316695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ed73dc9c-927b-4407-b169-6e406518933e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:28.317747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ed73dc9c-927b-4407-b169-6e406518933e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:28.321794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:28.327214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed73dc9c-927b-4407-b169-6e406518933e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:28.327960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed73dc9c-927b-4407-b169-6e406518933e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:28.328657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed73dc9c-927b-4407-b169-6e406518933e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:28.329458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed73dc9c-927b-4407-b169-6e406518933e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:28.330108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed73dc9c-927b-4407-b169-6e406518933e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:28.330744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed73dc9c-927b-4407-b169-6e406518933e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:28.412931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ed73dc9c-927b-4407-b169-6e406518933e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:28.422643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ed73dc9c-927b-4407-b169-6e406518933e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:28.424366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ed73dc9c-927b-4407-b169-6e406518933e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:28.429429 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ed73dc9c-927b-4407-b169-6e406518933e tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1446 microversion: 2.75 time: 0.118008 Oct 10 23:23:28.430149 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 903/1845] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:28 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1446 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:23:28.459664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-751954d5-bc92-48b5-94b4-e51c8d12227d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:23:28.460200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-751954d5-bc92-48b5-94b4-e51c8d12227d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:23:28.460695 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-751954d5-bc92-48b5-94b4-e51c8d12227d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:23:28.461114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-751954d5-bc92-48b5-94b4-e51c8d12227d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:23:28.461557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-751954d5-bc92-48b5-94b4-e51c8d12227d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:23:28.471388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-751954d5-bc92-48b5-94b4-e51c8d12227d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:28.471873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-751954d5-bc92-48b5-94b4-e51c8d12227d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:28.472311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-751954d5-bc92-48b5-94b4-e51c8d12227d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:28.473036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-751954d5-bc92-48b5-94b4-e51c8d12227d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:28.473514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-751954d5-bc92-48b5-94b4-e51c8d12227d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:28.473945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-751954d5-bc92-48b5-94b4-e51c8d12227d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:28.491119 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-751954d5-bc92-48b5-94b4-e51c8d12227d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Getting quotas for project 451d034bd7474164a08bd3374680c0d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:23:28.496615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-751954d5-bc92-48b5-94b4-e51c8d12227d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Getting quotas for user 60c692636a4b4667a4eff5cde6e183bc and project 451d034bd7474164a08bd3374680c0d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:23:28.509657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-751954d5-bc92-48b5-94b4-e51c8d12227d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:23:28.512365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-751954d5-bc92-48b5-94b4-e51c8d12227d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:23:28.567619 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-751954d5-bc92-48b5-94b4-e51c8d12227d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593593 Oct 10 23:23:28.568498 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 943/1846] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:23:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 23:23:28.580791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c12984c1-b0c5-4bbd-a383-67a19c7b18de tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:28.581599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c12984c1-b0c5-4bbd-a383-67a19c7b18de tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:28.663933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c12984c1-b0c5-4bbd-a383-67a19c7b18de tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:28.675318 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c12984c1-b0c5-4bbd-a383-67a19c7b18de tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1208 microversion: 2.1 time: 0.097305 Oct 10 23:23:28.676692 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 904/1847] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:28 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1208 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:28.925052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1e95a05c-45fd-40e6-8127-6bcbd5232630 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:28.925823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1e95a05c-45fd-40e6-8127-6bcbd5232630 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:28.949888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e95a05c-45fd-40e6-8127-6bcbd5232630 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:28.950398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e95a05c-45fd-40e6-8127-6bcbd5232630 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:28.953040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e95a05c-45fd-40e6-8127-6bcbd5232630 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:28.955859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e95a05c-45fd-40e6-8127-6bcbd5232630 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:28.956879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e95a05c-45fd-40e6-8127-6bcbd5232630 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:28.957934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e95a05c-45fd-40e6-8127-6bcbd5232630 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:29.072353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9d170d36-2310-4c4a-84f4-baeb884a1911 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:29.073133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9d170d36-2310-4c4a-84f4-baeb884a1911 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:29.082204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d170d36-2310-4c4a-84f4-baeb884a1911 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:29.083335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d170d36-2310-4c4a-84f4-baeb884a1911 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:29.083972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d170d36-2310-4c4a-84f4-baeb884a1911 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:29.085487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d170d36-2310-4c4a-84f4-baeb884a1911 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:29.086019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d170d36-2310-4c4a-84f4-baeb884a1911 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:29.086543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d170d36-2310-4c4a-84f4-baeb884a1911 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:29.183324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1e95a05c-45fd-40e6-8127-6bcbd5232630 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:29.200273 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1e95a05c-45fd-40e6-8127-6bcbd5232630 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1534 microversion: 2.1 time: 0.279593 Oct 10 23:23:29.200440 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 944/1848] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:28 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1534 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:29.272474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9d170d36-2310-4c4a-84f4-baeb884a1911 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:29.282097 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9d170d36-2310-4c4a-84f4-baeb884a1911 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1199 microversion: 2.1 time: 0.213661 Oct 10 23:23:29.282954 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 905/1849] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:29 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1199 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:29.457602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2b31c061-9203-4261-bc96-ab3427a3c0a1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:29.458244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2b31c061-9203-4261-bc96-ab3427a3c0a1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:29.464476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b31c061-9203-4261-bc96-ab3427a3c0a1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:29.465030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b31c061-9203-4261-bc96-ab3427a3c0a1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:29.465408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b31c061-9203-4261-bc96-ab3427a3c0a1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:29.468129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b31c061-9203-4261-bc96-ab3427a3c0a1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:29.468129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b31c061-9203-4261-bc96-ab3427a3c0a1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:29.468129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b31c061-9203-4261-bc96-ab3427a3c0a1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:29.538863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2b31c061-9203-4261-bc96-ab3427a3c0a1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:29.549851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2b31c061-9203-4261-bc96-ab3427a3c0a1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:29.551365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2b31c061-9203-4261-bc96-ab3427a3c0a1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:29.556814 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2b31c061-9203-4261-bc96-ab3427a3c0a1 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1452 microversion: 2.75 time: 0.103145 Oct 10 23:23:29.557715 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 945/1850] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:29 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1452 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:29.699518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-49772750-5437-43f5-a621-a7837301e6e0 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:29.700377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-49772750-5437-43f5-a621-a7837301e6e0 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:29.708663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49772750-5437-43f5-a621-a7837301e6e0 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:29.709160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49772750-5437-43f5-a621-a7837301e6e0 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:29.709671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49772750-5437-43f5-a621-a7837301e6e0 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:29.710381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49772750-5437-43f5-a621-a7837301e6e0 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:29.710836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49772750-5437-43f5-a621-a7837301e6e0 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:29.711267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49772750-5437-43f5-a621-a7837301e6e0 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:29.776946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-49772750-5437-43f5-a621-a7837301e6e0 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:29.784821 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-49772750-5437-43f5-a621-a7837301e6e0 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1212 microversion: 2.1 time: 0.089393 Oct 10 23:23:29.785418 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 906/1851] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:29 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:30.225563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c7dc3e6b-6f46-4515-a23c-b349493414bd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:30.226666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c7dc3e6b-6f46-4515-a23c-b349493414bd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:30.238014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7dc3e6b-6f46-4515-a23c-b349493414bd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:30.238621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7dc3e6b-6f46-4515-a23c-b349493414bd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:30.239235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7dc3e6b-6f46-4515-a23c-b349493414bd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:30.240136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7dc3e6b-6f46-4515-a23c-b349493414bd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:30.240794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7dc3e6b-6f46-4515-a23c-b349493414bd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:30.242530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7dc3e6b-6f46-4515-a23c-b349493414bd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:30.253411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:30.306320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c5e17ce1-30fe-4e0b-aec8-04a984cc315d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:30.306934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c5e17ce1-30fe-4e0b-aec8-04a984cc315d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:30.314048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5e17ce1-30fe-4e0b-aec8-04a984cc315d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:30.314868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5e17ce1-30fe-4e0b-aec8-04a984cc315d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:30.315363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5e17ce1-30fe-4e0b-aec8-04a984cc315d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:30.316271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5e17ce1-30fe-4e0b-aec8-04a984cc315d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:30.316901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5e17ce1-30fe-4e0b-aec8-04a984cc315d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:30.317532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5e17ce1-30fe-4e0b-aec8-04a984cc315d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:30.417682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c7dc3e6b-6f46-4515-a23c-b349493414bd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:30.427863 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c7dc3e6b-6f46-4515-a23c-b349493414bd tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1534 microversion: 2.1 time: 0.206953 Oct 10 23:23:30.428463 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 946/1852] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:30 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1534 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:30.463832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c5e17ce1-30fe-4e0b-aec8-04a984cc315d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:30.473095 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c5e17ce1-30fe-4e0b-aec8-04a984cc315d tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1199 microversion: 2.1 time: 0.170557 Oct 10 23:23:30.473728 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 907/1853] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:30 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1199 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:30.590884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-616a23c4-e816-4ad0-aef1-1d23de88772d tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:30.591567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-616a23c4-e816-4ad0-aef1-1d23de88772d tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:30.599897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-616a23c4-e816-4ad0-aef1-1d23de88772d tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:30.600393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-616a23c4-e816-4ad0-aef1-1d23de88772d tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:30.600835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-616a23c4-e816-4ad0-aef1-1d23de88772d tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:30.601622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-616a23c4-e816-4ad0-aef1-1d23de88772d tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:30.602257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-616a23c4-e816-4ad0-aef1-1d23de88772d tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:30.602690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-616a23c4-e816-4ad0-aef1-1d23de88772d tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:30.675700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-616a23c4-e816-4ad0-aef1-1d23de88772d tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:30.690335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-616a23c4-e816-4ad0-aef1-1d23de88772d tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:30.693384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-616a23c4-e816-4ad0-aef1-1d23de88772d tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:30.699390 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-616a23c4-e816-4ad0-aef1-1d23de88772d tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1452 microversion: 2.75 time: 0.112519 Oct 10 23:23:30.699980 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 947/1854] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:30 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:30.810458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b6451663-0680-45a0-a9a2-9662ff3862fd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:30.811954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b6451663-0680-45a0-a9a2-9662ff3862fd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:30.824377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6451663-0680-45a0-a9a2-9662ff3862fd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:30.831686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6451663-0680-45a0-a9a2-9662ff3862fd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:30.831686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6451663-0680-45a0-a9a2-9662ff3862fd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:30.831686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6451663-0680-45a0-a9a2-9662ff3862fd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:30.832140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6451663-0680-45a0-a9a2-9662ff3862fd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:30.832581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6451663-0680-45a0-a9a2-9662ff3862fd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:30.912823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b6451663-0680-45a0-a9a2-9662ff3862fd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:30.921144 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b6451663-0680-45a0-a9a2-9662ff3862fd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1260 microversion: 2.1 time: 0.116189 Oct 10 23:23:30.921745 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 908/1855] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:30 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1260 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:31.454201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-151a21d1-bb85-4ae7-b5fd-ea85a9eb9774 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:31.455011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-151a21d1-bb85-4ae7-b5fd-ea85a9eb9774 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:31.468226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-d0e7cdfb-e29a-4bae-bc35-86acd6fdf9ad req-5698143f-5a96-4c21-81c5-527e026ffcdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9431e2e-3fb9-4834-8827-88c1e3762543", "name": "network-vif-plugged", "status": "completed", "tag": "10aa8c22-3c3a-4a97-83bc-82a7afa75cd5"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:31.484093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-151a21d1-bb85-4ae7-b5fd-ea85a9eb9774 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:31.486728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-151a21d1-bb85-4ae7-b5fd-ea85a9eb9774 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:31.489438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-151a21d1-bb85-4ae7-b5fd-ea85a9eb9774 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:31.493052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d0e7cdfb-e29a-4bae-bc35-86acd6fdf9ad req-5698143f-5a96-4c21-81c5-527e026ffcdf service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:31.493873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d0e7cdfb-e29a-4bae-bc35-86acd6fdf9ad req-5698143f-5a96-4c21-81c5-527e026ffcdf service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:31.494500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d0e7cdfb-e29a-4bae-bc35-86acd6fdf9ad req-5698143f-5a96-4c21-81c5-527e026ffcdf service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:31.494871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-151a21d1-bb85-4ae7-b5fd-ea85a9eb9774 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:31.495876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-151a21d1-bb85-4ae7-b5fd-ea85a9eb9774 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:31.497600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-151a21d1-bb85-4ae7-b5fd-ea85a9eb9774 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:31.511545 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-d0e7cdfb-e29a-4bae-bc35-86acd6fdf9ad req-5698143f-5a96-4c21-81c5-527e026ffcdf service nova] Creating event network-vif-plugged:10aa8c22-3c3a-4a97-83bc-82a7afa75cd5 for instance e9431e2e-3fb9-4834-8827-88c1e3762543 on n-h1-860864-2 Oct 10 23:23:31.518832 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-d0e7cdfb-e29a-4bae-bc35-86acd6fdf9ad req-5698143f-5a96-4c21-81c5-527e026ffcdf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055692 Oct 10 23:23:31.519783 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 909/1856] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:23:31.526374 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2976ed4e-ae11-4330-bdf1-7a952613c4fa tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:31.527334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2976ed4e-ae11-4330-bdf1-7a952613c4fa tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:31.536631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2976ed4e-ae11-4330-bdf1-7a952613c4fa tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:31.537989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2976ed4e-ae11-4330-bdf1-7a952613c4fa tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:31.538619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2976ed4e-ae11-4330-bdf1-7a952613c4fa tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:31.539752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2976ed4e-ae11-4330-bdf1-7a952613c4fa tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:31.540655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2976ed4e-ae11-4330-bdf1-7a952613c4fa tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:31.541313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2976ed4e-ae11-4330-bdf1-7a952613c4fa tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:31.697868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-151a21d1-bb85-4ae7-b5fd-ea85a9eb9774 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:31.712694 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-151a21d1-bb85-4ae7-b5fd-ea85a9eb9774 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1492 microversion: 2.1 time: 0.265129 Oct 10 23:23:31.714234 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 948/1857] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:31 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1492 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:31.731121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c691d08d-cd52-4b89-9f04-b2f1040869c2 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:31.738981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c691d08d-cd52-4b89-9f04-b2f1040869c2 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:31.746769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:31.771216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c691d08d-cd52-4b89-9f04-b2f1040869c2 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:31.777642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c691d08d-cd52-4b89-9f04-b2f1040869c2 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:31.778295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c691d08d-cd52-4b89-9f04-b2f1040869c2 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:31.779209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c691d08d-cd52-4b89-9f04-b2f1040869c2 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:31.780520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c691d08d-cd52-4b89-9f04-b2f1040869c2 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:31.781156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c691d08d-cd52-4b89-9f04-b2f1040869c2 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:31.953312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2976ed4e-ae11-4330-bdf1-7a952613c4fa tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:31.960546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:31.966829 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2976ed4e-ae11-4330-bdf1-7a952613c4fa tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1199 microversion: 2.1 time: 0.445213 Oct 10 23:23:31.968142 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 910/1858] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:31 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1199 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:31.974733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-980a7af1-7e78-4466-90af-72b1b53e0c85 req-b01c8f3a-79d7-44ec-a590-a199a4657c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c528ef78-5144-437a-83e3-38376725259a", "name": "network-vif-deleted", "tag": "caf7c02f-0516-49b4-a4e1-4d9d62869316"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:31.996536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-980a7af1-7e78-4466-90af-72b1b53e0c85 req-b01c8f3a-79d7-44ec-a590-a199a4657c68 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:31.997299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-980a7af1-7e78-4466-90af-72b1b53e0c85 req-b01c8f3a-79d7-44ec-a590-a199a4657c68 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:31.997937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-980a7af1-7e78-4466-90af-72b1b53e0c85 req-b01c8f3a-79d7-44ec-a590-a199a4657c68 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:32.011519 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-980a7af1-7e78-4466-90af-72b1b53e0c85 req-b01c8f3a-79d7-44ec-a590-a199a4657c68 service nova] Creating event network-vif-deleted:caf7c02f-0516-49b4-a4e1-4d9d62869316 for instance c528ef78-5144-437a-83e3-38376725259a on n-h1-860864-2 Oct 10 23:23:32.017958 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-980a7af1-7e78-4466-90af-72b1b53e0c85 req-b01c8f3a-79d7-44ec-a590-a199a4657c68 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046870 Oct 10 23:23:32.023740 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 911/1859] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:23:32.030021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-00824889-65b0-4abb-911f-d60337729623 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:32.031373 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-00824889-65b0-4abb-911f-d60337729623 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:32.044121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00824889-65b0-4abb-911f-d60337729623 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:32.044681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00824889-65b0-4abb-911f-d60337729623 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:32.045859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00824889-65b0-4abb-911f-d60337729623 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:32.047915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00824889-65b0-4abb-911f-d60337729623 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:32.048397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00824889-65b0-4abb-911f-d60337729623 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:32.048982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00824889-65b0-4abb-911f-d60337729623 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:32.058540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c691d08d-cd52-4b89-9f04-b2f1040869c2 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:32.075214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c691d08d-cd52-4b89-9f04-b2f1040869c2 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:32.080438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c691d08d-cd52-4b89-9f04-b2f1040869c2 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:32.099728 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c691d08d-cd52-4b89-9f04-b2f1040869c2 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1452 microversion: 2.75 time: 0.375255 Oct 10 23:23:32.115032 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 949/1860] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:31 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1452 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:32.164334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-00824889-65b0-4abb-911f-d60337729623 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:32.180959 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-00824889-65b0-4abb-911f-d60337729623 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1268 microversion: 2.1 time: 0.152039 Oct 10 23:23:32.181916 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 912/1861] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:32 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:32.742471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-452e3530-83e8-41a3-b38d-74bdaf0e5717 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:32.743458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-452e3530-83e8-41a3-b38d-74bdaf0e5717 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:32.752950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-8eae2763-3d7b-43a8-aa2e-91145293a00b req-37d5850f-3286-42e5-99fa-0c2e64ffdb24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe8a45b4-e6cb-434f-8e97-8caa78888257", "name": "network-vif-deleted", "tag": "825c46b6-1861-46dc-990c-5e0e0232f588"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:32.764601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-452e3530-83e8-41a3-b38d-74bdaf0e5717 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:32.765103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-452e3530-83e8-41a3-b38d-74bdaf0e5717 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:32.769300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8eae2763-3d7b-43a8-aa2e-91145293a00b req-37d5850f-3286-42e5-99fa-0c2e64ffdb24 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:32.769806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8eae2763-3d7b-43a8-aa2e-91145293a00b req-37d5850f-3286-42e5-99fa-0c2e64ffdb24 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:32.770237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8eae2763-3d7b-43a8-aa2e-91145293a00b req-37d5850f-3286-42e5-99fa-0c2e64ffdb24 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:32.774459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-452e3530-83e8-41a3-b38d-74bdaf0e5717 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:32.774990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-452e3530-83e8-41a3-b38d-74bdaf0e5717 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:32.775462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-452e3530-83e8-41a3-b38d-74bdaf0e5717 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:32.775897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-452e3530-83e8-41a3-b38d-74bdaf0e5717 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:32.796891 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-8eae2763-3d7b-43a8-aa2e-91145293a00b req-37d5850f-3286-42e5-99fa-0c2e64ffdb24 service nova] Creating event network-vif-deleted:825c46b6-1861-46dc-990c-5e0e0232f588 for instance fe8a45b4-e6cb-434f-8e97-8caa78888257 on n-h1-860864-2 Oct 10 23:23:32.804920 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-8eae2763-3d7b-43a8-aa2e-91145293a00b req-37d5850f-3286-42e5-99fa-0c2e64ffdb24 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055273 Oct 10 23:23:32.805671 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 913/1862] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:23:32.811852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-452e3530-83e8-41a3-b38d-74bdaf0e5717 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:32.814994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-452e3530-83e8-41a3-b38d-74bdaf0e5717 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:32.815549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-452e3530-83e8-41a3-b38d-74bdaf0e5717 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:32.815973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-452e3530-83e8-41a3-b38d-74bdaf0e5717 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lazy-loading 'fault' on Instance uuid c528ef78-5144-437a-83e3-38376725259a {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:32.901347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-452e3530-83e8-41a3-b38d-74bdaf0e5717 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:32.913733 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-452e3530-83e8-41a3-b38d-74bdaf0e5717 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1368 microversion: 2.1 time: 0.175907 Oct 10 23:23:32.914628 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 950/1863] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:32 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:32.994937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4693ade4-c2ee-499f-89ab-5294bdab7033 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:32.995924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4693ade4-c2ee-499f-89ab-5294bdab7033 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:33.004016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4693ade4-c2ee-499f-89ab-5294bdab7033 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:33.005036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4693ade4-c2ee-499f-89ab-5294bdab7033 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:33.005692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4693ade4-c2ee-499f-89ab-5294bdab7033 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:33.006590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4693ade4-c2ee-499f-89ab-5294bdab7033 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:33.007216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4693ade4-c2ee-499f-89ab-5294bdab7033 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:33.007814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4693ade4-c2ee-499f-89ab-5294bdab7033 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:33.134740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eaeaa3ff-d966-4add-b5ec-8940988496cb tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:33.135356 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eaeaa3ff-d966-4add-b5ec-8940988496cb tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:33.142412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaeaa3ff-d966-4add-b5ec-8940988496cb tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:33.143178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaeaa3ff-d966-4add-b5ec-8940988496cb tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:33.143782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaeaa3ff-d966-4add-b5ec-8940988496cb tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:33.144767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaeaa3ff-d966-4add-b5ec-8940988496cb tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:33.145406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaeaa3ff-d966-4add-b5ec-8940988496cb tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:33.145997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaeaa3ff-d966-4add-b5ec-8940988496cb tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:33.196517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4693ade4-c2ee-499f-89ab-5294bdab7033 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:33.228370 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4693ade4-c2ee-499f-89ab-5294bdab7033 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1199 microversion: 2.1 time: 0.237204 Oct 10 23:23:33.241861 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 914/1864] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:32 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1199 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:33.250859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-da767263-0e8b-4898-8e57-f30c158ae0f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:33.251486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-da767263-0e8b-4898-8e57-f30c158ae0f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:33.257828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da767263-0e8b-4898-8e57-f30c158ae0f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:33.258321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da767263-0e8b-4898-8e57-f30c158ae0f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:33.258963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da767263-0e8b-4898-8e57-f30c158ae0f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:33.259869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da767263-0e8b-4898-8e57-f30c158ae0f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:33.260493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da767263-0e8b-4898-8e57-f30c158ae0f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:33.261096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da767263-0e8b-4898-8e57-f30c158ae0f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:33.272374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-eaeaa3ff-d966-4add-b5ec-8940988496cb tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:33.282566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-eaeaa3ff-d966-4add-b5ec-8940988496cb tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:33.284044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-eaeaa3ff-d966-4add-b5ec-8940988496cb tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:33.295089 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eaeaa3ff-d966-4add-b5ec-8940988496cb tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1437 microversion: 2.75 time: 0.163975 Oct 10 23:23:33.295942 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 951/1865] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:33 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1437 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:23:33.344884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-da767263-0e8b-4898-8e57-f30c158ae0f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:33.354152 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-da767263-0e8b-4898-8e57-f30c158ae0f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1266 microversion: 2.1 time: 0.111083 Oct 10 23:23:33.355690 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 915/1866] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:33 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:33.568095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c5b11786-3712-4987-abe2-db5949378b41 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:33.571252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c5b11786-3712-4987-abe2-db5949378b41 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:33.578873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5b11786-3712-4987-abe2-db5949378b41 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:33.579468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5b11786-3712-4987-abe2-db5949378b41 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:33.580011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5b11786-3712-4987-abe2-db5949378b41 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:33.581227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5b11786-3712-4987-abe2-db5949378b41 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:33.582243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5b11786-3712-4987-abe2-db5949378b41 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:33.583138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5b11786-3712-4987-abe2-db5949378b41 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:33.691033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c5b11786-3712-4987-abe2-db5949378b41 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:23:33.691581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c5b11786-3712-4987-abe2-db5949378b41 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:23:33.692198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c5b11786-3712-4987-abe2-db5949378b41 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:23:33.692732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c5b11786-3712-4987-abe2-db5949378b41 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:23:33.693253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c5b11786-3712-4987-abe2-db5949378b41 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:23:33.845105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c5b11786-3712-4987-abe2-db5949378b41 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:33.859392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5b11786-3712-4987-abe2-db5949378b41 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:33.860121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5b11786-3712-4987-abe2-db5949378b41 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:33.861015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5b11786-3712-4987-abe2-db5949378b41 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:33.866546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5b11786-3712-4987-abe2-db5949378b41 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:33.867277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5b11786-3712-4987-abe2-db5949378b41 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:33.867925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5b11786-3712-4987-abe2-db5949378b41 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:33.941084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-38b83a08-42f2-4b4d-b118-23a8836e2e71 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:33.941738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-38b83a08-42f2-4b4d-b118-23a8836e2e71 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:33.957652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38b83a08-42f2-4b4d-b118-23a8836e2e71 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:33.958164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38b83a08-42f2-4b4d-b118-23a8836e2e71 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:33.958658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38b83a08-42f2-4b4d-b118-23a8836e2e71 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:33.959332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38b83a08-42f2-4b4d-b118-23a8836e2e71 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:33.968138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38b83a08-42f2-4b4d-b118-23a8836e2e71 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:33.968697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38b83a08-42f2-4b4d-b118-23a8836e2e71 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:34.110802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38b83a08-42f2-4b4d-b118-23a8836e2e71 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:34.111303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38b83a08-42f2-4b4d-b118-23a8836e2e71 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:34.112465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38b83a08-42f2-4b4d-b118-23a8836e2e71 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:34.116204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-38b83a08-42f2-4b4d-b118-23a8836e2e71 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lazy-loading 'fault' on Instance uuid c528ef78-5144-437a-83e3-38376725259a {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:34.163976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-38b83a08-42f2-4b4d-b118-23a8836e2e71 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:34.173291 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-38b83a08-42f2-4b4d-b118-23a8836e2e71 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 200 len: 1368 microversion: 2.1 time: 0.236966 Oct 10 23:23:34.174085 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 916/1867] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:33 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:34.246640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-c5b11786-3712-4987-abe2-db5949378b41 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:34.255427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-129dcd02-830f-4feb-b745-8f497222cb4f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:34.256076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-129dcd02-830f-4feb-b745-8f497222cb4f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:34.272097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-129dcd02-830f-4feb-b745-8f497222cb4f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:34.274042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-129dcd02-830f-4feb-b745-8f497222cb4f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:34.274511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-129dcd02-830f-4feb-b745-8f497222cb4f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:34.278378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-129dcd02-830f-4feb-b745-8f497222cb4f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:34.279700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-129dcd02-830f-4feb-b745-8f497222cb4f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:34.281169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-129dcd02-830f-4feb-b745-8f497222cb4f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:34.291280 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c5b11786-3712-4987-abe2-db5949378b41 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1/action" status: 202 len: 1940 microversion: 2.75 time: 0.968400 Oct 10 23:23:34.292484 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 952/1868] 10.222.0.23 () {62 vars in 1319 bytes} [Mon Oct 10 23:23:33 2022] POST /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1/action => generated 1940 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 10 23:23:34.324233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f4425394-1abf-4df9-8db5-13a3aef69a51 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:34.324820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f4425394-1abf-4df9-8db5-13a3aef69a51 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:34.332272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4425394-1abf-4df9-8db5-13a3aef69a51 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:34.332765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4425394-1abf-4df9-8db5-13a3aef69a51 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:34.333196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4425394-1abf-4df9-8db5-13a3aef69a51 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:34.334532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4425394-1abf-4df9-8db5-13a3aef69a51 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:34.334992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4425394-1abf-4df9-8db5-13a3aef69a51 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:34.336642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4425394-1abf-4df9-8db5-13a3aef69a51 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:34.449682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-f4425394-1abf-4df9-8db5-13a3aef69a51 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:34.476861 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f4425394-1abf-4df9-8db5-13a3aef69a51 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1927 microversion: 2.75 time: 0.156826 Oct 10 23:23:34.478113 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 953/1869] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:34 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1927 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:23:34.484744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2ba4309b-4d7e-4475-b888-5ed05c9832ad tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:34.485081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2ba4309b-4d7e-4475-b888-5ed05c9832ad tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:34.492713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ba4309b-4d7e-4475-b888-5ed05c9832ad tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:34.493215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ba4309b-4d7e-4475-b888-5ed05c9832ad tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:34.495726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ba4309b-4d7e-4475-b888-5ed05c9832ad tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:34.495726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ba4309b-4d7e-4475-b888-5ed05c9832ad tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:34.495726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ba4309b-4d7e-4475-b888-5ed05c9832ad tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:34.495726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ba4309b-4d7e-4475-b888-5ed05c9832ad tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:34.510941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-129dcd02-830f-4feb-b745-8f497222cb4f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:34.520107 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-129dcd02-830f-4feb-b745-8f497222cb4f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1382 microversion: 2.1 time: 0.268116 Oct 10 23:23:34.521498 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 917/1870] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:34 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1382 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:34.714053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-eebf4fd4-0333-4eeb-9988-a7230c26c465 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:34.715720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-eebf4fd4-0333-4eeb-9988-a7230c26c465 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:34.726904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eebf4fd4-0333-4eeb-9988-a7230c26c465 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:34.727704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eebf4fd4-0333-4eeb-9988-a7230c26c465 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:34.728191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eebf4fd4-0333-4eeb-9988-a7230c26c465 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:34.728912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eebf4fd4-0333-4eeb-9988-a7230c26c465 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:34.729369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eebf4fd4-0333-4eeb-9988-a7230c26c465 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:34.729823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eebf4fd4-0333-4eeb-9988-a7230c26c465 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:34.791601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2ba4309b-4d7e-4475-b888-5ed05c9832ad tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:34.802726 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2ba4309b-4d7e-4475-b888-5ed05c9832ad tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1308 microversion: 2.1 time: 0.323469 Oct 10 23:23:34.803879 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 954/1871] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:34 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1308 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:34.883377 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-eebf4fd4-0333-4eeb-9988-a7230c26c465 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1533 microversion: 2.1 time: 0.342548 Oct 10 23:23:34.884063 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 918/1872] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:34 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1533 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:34.906915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eaa540d4-cf2c-41e0-b1b8-830697d0cb9c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:34.907529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eaa540d4-cf2c-41e0-b1b8-830697d0cb9c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:34.923043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaa540d4-cf2c-41e0-b1b8-830697d0cb9c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:34.925512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaa540d4-cf2c-41e0-b1b8-830697d0cb9c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:34.926011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaa540d4-cf2c-41e0-b1b8-830697d0cb9c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:34.926737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaa540d4-cf2c-41e0-b1b8-830697d0cb9c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:34.927234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaa540d4-cf2c-41e0-b1b8-830697d0cb9c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:34.927714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaa540d4-cf2c-41e0-b1b8-830697d0cb9c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:35.121567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-653167a0-f03d-4dbf-bf9a-be73da0bffd6 req-4131531a-edc8-4750-8fdb-c3282781b20b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abe142b1-562e-4ca2-a300-84a0bf7353ac", "tag": "183fcafc-50f1-4a82-bda7-809f6f81821e"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:35.134593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-653167a0-f03d-4dbf-bf9a-be73da0bffd6 req-4131531a-edc8-4750-8fdb-c3282781b20b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:35.135270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-653167a0-f03d-4dbf-bf9a-be73da0bffd6 req-4131531a-edc8-4750-8fdb-c3282781b20b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:35.135775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-653167a0-f03d-4dbf-bf9a-be73da0bffd6 req-4131531a-edc8-4750-8fdb-c3282781b20b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:35.150398 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-653167a0-f03d-4dbf-bf9a-be73da0bffd6 req-4131531a-edc8-4750-8fdb-c3282781b20b service nova] Creating event network-changed:183fcafc-50f1-4a82-bda7-809f6f81821e for instance abe142b1-562e-4ca2-a300-84a0bf7353ac on n-h2-860864-2 Oct 10 23:23:35.156562 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-653167a0-f03d-4dbf-bf9a-be73da0bffd6 req-4131531a-edc8-4750-8fdb-c3282781b20b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040973 Oct 10 23:23:35.157178 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 919/1873] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:23:35.207186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-beea0f61-92ab-4946-bdab-d85219654f82 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:35.208234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-beea0f61-92ab-4946-bdab-d85219654f82 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: c528ef78-5144-437a-83e3-38376725259a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:35.229079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-beea0f61-92ab-4946-bdab-d85219654f82 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:35.229805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-beea0f61-92ab-4946-bdab-d85219654f82 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:35.230342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-beea0f61-92ab-4946-bdab-d85219654f82 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:35.231162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-beea0f61-92ab-4946-bdab-d85219654f82 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:35.231720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-beea0f61-92ab-4946-bdab-d85219654f82 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:35.232235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-beea0f61-92ab-4946-bdab-d85219654f82 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:35.255718 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-beea0f61-92ab-4946-bdab-d85219654f82 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] HTTP exception thrown: Instance c528ef78-5144-437a-83e3-38376725259a could not be found. Oct 10 23:23:35.266861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-beea0f61-92ab-4946-bdab-d85219654f82 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Request method failure captured: Oct 10 23:23:35.266861 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a HTTP/1.1 Oct 10 23:23:35.266861 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:23:35.266861 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:23:35.266861 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:23:35.266861 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:23:35.266861 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:23:35.266861 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:23:35.266861 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:23:35.266861 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:23:35.266861 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKgnbrtWotA5vmkMo4hAdL8zla9ltVJq-vphOMSGbrqzaupm4dOUwfwyPpRyCiSMe1ZEHR5Rz6ca9pvzk6spT16CJ3_AnSaqjs3ef9DkCCEHXnz-vKjdA5h1eyrWc9CCRHx4DSLeiktr5YussnAysO_dJn6OE8X75o9Na45EF6imrn0 Oct 10 23:23:35.266861 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:23:35.266861 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:23:35.266861 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:23:35.266861 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:23:35.266861 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:23:35.266861 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:23:35.266861 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 8fad4e7ad7ba4e8284360ccf30d71228 Oct 10 23:23:35.266861 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-MigrationsAdminTest-315073527 Oct 10 23:23:35.266861 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:23:35.266861 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:23:35.268797 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8fad4e7ad7ba4e8284360ccf30d71228"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fad4e7ad7ba4e8284360ccf30d71228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fad4e7ad7ba4e8284360ccf30d71228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8fad4e7ad7ba4e8284360ccf30d71228", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:23:35.268797 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-MigrationsAdminTest-315073527 Oct 10 23:23:35.268797 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 8fad4e7ad7ba4e8284360ccf30d71228 Oct 10 23:23:35.268797 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-MigrationsAdminTest-315073527 Oct 10 23:23:35.268797 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-MigrationsAdminTest-315073527-project Oct 10 23:23:35.268797 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:23:35.268797 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:23:35.268797 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: cbc0deea66094fac8d5f985e133ceaaa Oct 10 23:23:35.268797 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-MigrationsAdminTest-315073527-project Oct 10 23:23:35.268797 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:23:35.268797 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance c528ef78-5144-437a-83e3-38376725259a could not be found. Oct 10 23:23:35.268797 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'c528ef78-5144-437a-83e3-38376725259a'} Oct 10 23:23:35.269883 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:23:35.269883 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:23:35.269883 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:23:35.269883 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:23:35.269883 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:23:35.269883 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:23:35.269883 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:23:35.269883 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:23:35.269883 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:23:35.269883 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:23:35.269883 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c528ef78-5144-437a-83e3-38376725259a could not be found. Oct 10 23:23:35.269883 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:23:35.269883 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:23:35.269883 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:23:35.269883 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:23:35.269883 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:23:35.269883 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:23:35.269883 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:23:35.269883 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:23:35.269883 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:23:35.272113 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:23:35.272113 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:23:35.272113 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:23:35.272113 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:23:35.272113 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:23:35.272113 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:23:35.272113 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:23:35.272113 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c528ef78-5144-437a-83e3-38376725259a could not be found. Oct 10 23:23:35.272113 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:23:35.272113 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:23:35.272113 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:23:35.272113 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:23:35.272113 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:23:35.272113 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:23:35.272113 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:23:35.272113 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:23:35.272113 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c528ef78-5144-437a-83e3-38376725259a could not be found. Oct 10 23:23:35.272113 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:23:35.273838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-beea0f61-92ab-4946-bdab-d85219654f82 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Returning 404 to user: Instance c528ef78-5144-437a-83e3-38376725259a could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:23:35.273838 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-beea0f61-92ab-4946-bdab-d85219654f82 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a" status: 404 len: 111 microversion: 2.1 time: 0.073848 Oct 10 23:23:35.278340 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 920/1874] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:35 2022] GET /compute/v2.1/servers/c528ef78-5144-437a-83e3-38376725259a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:23:35.285146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-37f62579-c59a-4a77-8b61-012a3e124a26 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '.version_select at 0x7f662aed80d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:35.288040 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eaa540d4-cf2c-41e0-b1b8-830697d0cb9c tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1533 microversion: 2.1 time: 0.382495 Oct 10 23:23:35.290270 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 955/1875] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:34 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1533 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:35.315319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0c082d21-4f3b-40be-84a4-6d9453cab4a5 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:35.320919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c082d21-4f3b-40be-84a4-6d9453cab4a5 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:35.322755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c082d21-4f3b-40be-84a4-6d9453cab4a5 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:35.323388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c082d21-4f3b-40be-84a4-6d9453cab4a5 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:35.325825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c082d21-4f3b-40be-84a4-6d9453cab4a5 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:35.325981 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-37f62579-c59a-4a77-8b61-012a3e124a26 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-750709035" status: 202 len: 0 microversion: 2.1 time: 0.046453 Oct 10 23:23:35.328329 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 921/1876] 10.222.0.23 () {58 vars in 1218 bytes} [Mon Oct 10 23:23:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-750709035 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:23:35.328648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c082d21-4f3b-40be-84a4-6d9453cab4a5 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:35.329327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c082d21-4f3b-40be-84a4-6d9453cab4a5 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:35.358592 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0c082d21-4f3b-40be-84a4-6d9453cab4a5 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.048217 Oct 10 23:23:35.359737 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 956/1877] 10.222.0.23 () {58 vars in 1176 bytes} [Mon Oct 10 23:23:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:23:35.371925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5b973553-d764-401f-9f20-1821f6c593ec tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860864-2", "block_migration": false, "disk_over_commit": false}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:35.375034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5b973553-d764-401f-9f20-1821f6c593ec tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:35.382588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b973553-d764-401f-9f20-1821f6c593ec tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:35.383327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b973553-d764-401f-9f20-1821f6c593ec tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:35.383957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b973553-d764-401f-9f20-1821f6c593ec tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:35.384955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b973553-d764-401f-9f20-1821f6c593ec tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:35.385627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b973553-d764-401f-9f20-1821f6c593ec tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:35.386214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b973553-d764-401f-9f20-1821f6c593ec tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:35.415557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-5b973553-d764-401f-9f20-1821f6c593ec tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lazy-loading 'flavor' on Instance uuid e9431e2e-3fb9-4834-8827-88c1e3762543 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:35.430856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5b973553-d764-401f-9f20-1821f6c593ec tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Going to try to live migrate instance to n-h2-860864-2 {{(pid=120613) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 23:23:35.512675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4e59d4c4-2d60-41a6-8838-33e3d9721fbb tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:35.513280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4e59d4c4-2d60-41a6-8838-33e3d9721fbb tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:35.530975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e59d4c4-2d60-41a6-8838-33e3d9721fbb tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:35.533236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e59d4c4-2d60-41a6-8838-33e3d9721fbb tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:35.535112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e59d4c4-2d60-41a6-8838-33e3d9721fbb tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:35.535902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e59d4c4-2d60-41a6-8838-33e3d9721fbb tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:35.540458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e59d4c4-2d60-41a6-8838-33e3d9721fbb tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:35.540962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e59d4c4-2d60-41a6-8838-33e3d9721fbb tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:35.680042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-4e59d4c4-2d60-41a6-8838-33e3d9721fbb tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:35.747855 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4e59d4c4-2d60-41a6-8838-33e3d9721fbb tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1927 microversion: 2.75 time: 0.239592 Oct 10 23:23:35.748538 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 957/1878] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:35 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1927 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:35.831603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f6fb509a-7943-4598-bf1b-194eade7c6bb tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:35.832751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f6fb509a-7943-4598-bf1b-194eade7c6bb tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:35.841213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6fb509a-7943-4598-bf1b-194eade7c6bb tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:35.842001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6fb509a-7943-4598-bf1b-194eade7c6bb tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:35.842831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6fb509a-7943-4598-bf1b-194eade7c6bb tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:35.844028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6fb509a-7943-4598-bf1b-194eade7c6bb tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:35.844660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6fb509a-7943-4598-bf1b-194eade7c6bb tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:35.845406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6fb509a-7943-4598-bf1b-194eade7c6bb tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:36.009343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f6fb509a-7943-4598-bf1b-194eade7c6bb tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:36.028319 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f6fb509a-7943-4598-bf1b-194eade7c6bb tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1308 microversion: 2.1 time: 0.202015 Oct 10 23:23:36.030392 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 958/1879] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:35 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1308 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:36.231584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d9105965-ed64-4762-b41d-3d39f26b8e56 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:36.232084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d9105965-ed64-4762-b41d-3d39f26b8e56 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:36.238690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9105965-ed64-4762-b41d-3d39f26b8e56 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:36.239175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9105965-ed64-4762-b41d-3d39f26b8e56 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:36.239605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9105965-ed64-4762-b41d-3d39f26b8e56 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:36.240300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9105965-ed64-4762-b41d-3d39f26b8e56 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:36.240841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9105965-ed64-4762-b41d-3d39f26b8e56 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:36.241181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9105965-ed64-4762-b41d-3d39f26b8e56 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:36.270885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d9105965-ed64-4762-b41d-3d39f26b8e56 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:23:36.273881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:36.352790 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d9105965-ed64-4762-b41d-3d39f26b8e56 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "DELETE /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 204 len: 0 microversion: 2.1 time: 0.124408 Oct 10 23:23:36.353284 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 959/1880] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:23:36 2022] DELETE /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 23:23:36.362418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c9ee1a44-473f-4000-ade9-1e92d723d612 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:36.363130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c9ee1a44-473f-4000-ade9-1e92d723d612 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:36.370248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9ee1a44-473f-4000-ade9-1e92d723d612 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:36.370880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9ee1a44-473f-4000-ade9-1e92d723d612 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:36.371326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9ee1a44-473f-4000-ade9-1e92d723d612 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:36.372209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9ee1a44-473f-4000-ade9-1e92d723d612 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:36.372677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9ee1a44-473f-4000-ade9-1e92d723d612 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:36.373105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9ee1a44-473f-4000-ade9-1e92d723d612 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:36.515626 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c9ee1a44-473f-4000-ade9-1e92d723d612 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:36.523613 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c9ee1a44-473f-4000-ade9-1e92d723d612 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1468 microversion: 2.1 time: 0.165910 Oct 10 23:23:36.524196 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 960/1881] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:36 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1468 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:36.778735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c4aad4a9-7886-499e-b592-46248176e429 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:36.779385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c4aad4a9-7886-499e-b592-46248176e429 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:36.786487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c4aad4a9-7886-499e-b592-46248176e429 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:36.787232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c4aad4a9-7886-499e-b592-46248176e429 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:36.787696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c4aad4a9-7886-499e-b592-46248176e429 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:36.788399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c4aad4a9-7886-499e-b592-46248176e429 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:36.788850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c4aad4a9-7886-499e-b592-46248176e429 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:36.789273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c4aad4a9-7886-499e-b592-46248176e429 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:36.918250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-c4aad4a9-7886-499e-b592-46248176e429 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:36.936768 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c4aad4a9-7886-499e-b592-46248176e429 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1927 microversion: 2.75 time: 0.160979 Oct 10 23:23:36.937728 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 961/1882] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:36 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1927 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:23:37.053883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5ba5fca1-2736-41c8-894d-1d87de9f3066 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:37.057219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5ba5fca1-2736-41c8-894d-1d87de9f3066 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:37.064143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ba5fca1-2736-41c8-894d-1d87de9f3066 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:37.064623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ba5fca1-2736-41c8-894d-1d87de9f3066 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:37.065052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ba5fca1-2736-41c8-894d-1d87de9f3066 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:37.065775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ba5fca1-2736-41c8-894d-1d87de9f3066 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:37.066224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ba5fca1-2736-41c8-894d-1d87de9f3066 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:37.066643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ba5fca1-2736-41c8-894d-1d87de9f3066 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:37.229785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5ba5fca1-2736-41c8-894d-1d87de9f3066 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:37.239137 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5ba5fca1-2736-41c8-894d-1d87de9f3066 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1308 microversion: 2.1 time: 0.189193 Oct 10 23:23:37.239715 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 962/1883] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:37 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1308 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:37.548269 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b9620892-1b5c-4433-95be-a265d0f96356 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:37.548896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b9620892-1b5c-4433-95be-a265d0f96356 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:37.555424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9620892-1b5c-4433-95be-a265d0f96356 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:37.555949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9620892-1b5c-4433-95be-a265d0f96356 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:37.556445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9620892-1b5c-4433-95be-a265d0f96356 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:37.557653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9620892-1b5c-4433-95be-a265d0f96356 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:37.558384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9620892-1b5c-4433-95be-a265d0f96356 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:37.559182 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9620892-1b5c-4433-95be-a265d0f96356 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:37.768781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b9620892-1b5c-4433-95be-a265d0f96356 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:37.780217 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b9620892-1b5c-4433-95be-a265d0f96356 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1468 microversion: 2.1 time: 0.232832 Oct 10 23:23:37.780949 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 963/1884] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:37 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1468 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:37.966600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-384fbb81-6229-4385-9009-aff69d949b49 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:37.967320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-384fbb81-6229-4385-9009-aff69d949b49 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:37.974917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-384fbb81-6229-4385-9009-aff69d949b49 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:37.975395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-384fbb81-6229-4385-9009-aff69d949b49 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:37.975866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-384fbb81-6229-4385-9009-aff69d949b49 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:37.976555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-384fbb81-6229-4385-9009-aff69d949b49 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:37.977003 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-384fbb81-6229-4385-9009-aff69d949b49 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:37.977434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-384fbb81-6229-4385-9009-aff69d949b49 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:38.082778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-384fbb81-6229-4385-9009-aff69d949b49 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:38.103978 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-384fbb81-6229-4385-9009-aff69d949b49 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1927 microversion: 2.75 time: 0.140504 Oct 10 23:23:38.106236 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 964/1885] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:37 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1927 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:38.276118 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c52cd790-9c16-4d09-b574-4ab67e8a7fca tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:38.276740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c52cd790-9c16-4d09-b574-4ab67e8a7fca tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:38.285411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c52cd790-9c16-4d09-b574-4ab67e8a7fca tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:38.286107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c52cd790-9c16-4d09-b574-4ab67e8a7fca tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:38.286513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c52cd790-9c16-4d09-b574-4ab67e8a7fca tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:38.288206 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c52cd790-9c16-4d09-b574-4ab67e8a7fca tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:38.288206 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c52cd790-9c16-4d09-b574-4ab67e8a7fca tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:38.288512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c52cd790-9c16-4d09-b574-4ab67e8a7fca tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:38.504375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:38.525724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c52cd790-9c16-4d09-b574-4ab67e8a7fca tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:38.536484 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c52cd790-9c16-4d09-b574-4ab67e8a7fca tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1308 microversion: 2.1 time: 0.272005 Oct 10 23:23:38.554752 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 965/1886] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:38 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1308 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:38.669988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:38.805697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1ad3e5f7-c5e0-4ca6-89ee-79f6ae7ac262 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:38.806322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1ad3e5f7-c5e0-4ca6-89ee-79f6ae7ac262 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:38.833260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ad3e5f7-c5e0-4ca6-89ee-79f6ae7ac262 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:38.833792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ad3e5f7-c5e0-4ca6-89ee-79f6ae7ac262 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:38.834241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ad3e5f7-c5e0-4ca6-89ee-79f6ae7ac262 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:38.834951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ad3e5f7-c5e0-4ca6-89ee-79f6ae7ac262 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:38.835408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ad3e5f7-c5e0-4ca6-89ee-79f6ae7ac262 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:38.835837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ad3e5f7-c5e0-4ca6-89ee-79f6ae7ac262 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:39.133112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1ad3e5f7-c5e0-4ca6-89ee-79f6ae7ac262 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:39.145137 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1ad3e5f7-c5e0-4ca6-89ee-79f6ae7ac262 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1468 microversion: 2.1 time: 0.344011 Oct 10 23:23:39.145847 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 966/1887] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:38 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1468 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:39.152332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4605c41c-49a7-44f3-8b1d-59dd8fb8dd7c tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:39.156595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4605c41c-49a7-44f3-8b1d-59dd8fb8dd7c tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:39.168719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4605c41c-49a7-44f3-8b1d-59dd8fb8dd7c tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:39.169216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4605c41c-49a7-44f3-8b1d-59dd8fb8dd7c tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:39.170343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4605c41c-49a7-44f3-8b1d-59dd8fb8dd7c tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:39.171255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4605c41c-49a7-44f3-8b1d-59dd8fb8dd7c tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:39.171996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4605c41c-49a7-44f3-8b1d-59dd8fb8dd7c tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:39.172702 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4605c41c-49a7-44f3-8b1d-59dd8fb8dd7c tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:39.326949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-4605c41c-49a7-44f3-8b1d-59dd8fb8dd7c tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:39.359542 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4605c41c-49a7-44f3-8b1d-59dd8fb8dd7c tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1927 microversion: 2.75 time: 0.212544 Oct 10 23:23:39.360237 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 967/1888] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:39 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1927 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:39.370101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-6cdc0514-1796-4561-a8d7-625ac1beb828 req-9e406337-a45c-4f16-89f9-afb62a883422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f81164-31f2-4f4b-9ec5-1e2ee8416c7b", "name": "network-vif-deleted", "tag": "1a0d0d6b-022c-4c38-bd51-d8b961af213c"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:39.388590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6cdc0514-1796-4561-a8d7-625ac1beb828 req-9e406337-a45c-4f16-89f9-afb62a883422 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:39.389963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6cdc0514-1796-4561-a8d7-625ac1beb828 req-9e406337-a45c-4f16-89f9-afb62a883422 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:39.392156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6cdc0514-1796-4561-a8d7-625ac1beb828 req-9e406337-a45c-4f16-89f9-afb62a883422 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:39.442895 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-6cdc0514-1796-4561-a8d7-625ac1beb828 req-9e406337-a45c-4f16-89f9-afb62a883422 service nova] Creating event network-vif-deleted:1a0d0d6b-022c-4c38-bd51-d8b961af213c for instance 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b on n-h2-860864-2 Oct 10 23:23:39.454156 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-6cdc0514-1796-4561-a8d7-625ac1beb828 req-9e406337-a45c-4f16-89f9-afb62a883422 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088511 Oct 10 23:23:39.456928 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 968/1889] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:23:39.589441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1eb80081-28f8-4a36-ad2f-5113f385b3b2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:39.590524 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1eb80081-28f8-4a36-ad2f-5113f385b3b2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:39.608651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1eb80081-28f8-4a36-ad2f-5113f385b3b2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:39.609621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1eb80081-28f8-4a36-ad2f-5113f385b3b2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:39.610349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1eb80081-28f8-4a36-ad2f-5113f385b3b2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:39.614575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1eb80081-28f8-4a36-ad2f-5113f385b3b2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:39.615914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1eb80081-28f8-4a36-ad2f-5113f385b3b2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:39.617581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1eb80081-28f8-4a36-ad2f-5113f385b3b2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:39.771522 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5b973553-d764-401f-9f20-1821f6c593ec tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543/action" status: 202 len: 0 microversion: 2.1 time: 4.403735 Oct 10 23:23:39.772763 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 922/1890] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:23:35 2022] POST /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543/action => generated 0 bytes in 4406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:23:39.782617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d5f89f41-1f3e-420a-9179-993142bb000c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:39.783568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d5f89f41-1f3e-420a-9179-993142bb000c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:39.799563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5f89f41-1f3e-420a-9179-993142bb000c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:39.800055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5f89f41-1f3e-420a-9179-993142bb000c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:39.800439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5f89f41-1f3e-420a-9179-993142bb000c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:39.801185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5f89f41-1f3e-420a-9179-993142bb000c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:39.801653 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5f89f41-1f3e-420a-9179-993142bb000c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:39.806688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5f89f41-1f3e-420a-9179-993142bb000c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:39.916211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1eb80081-28f8-4a36-ad2f-5113f385b3b2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:39.942698 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1eb80081-28f8-4a36-ad2f-5113f385b3b2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1308 microversion: 2.1 time: 0.378932 Oct 10 23:23:39.943835 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 969/1891] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:39 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1308 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:40.056736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d5f89f41-1f3e-420a-9179-993142bb000c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:40.069514 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d5f89f41-1f3e-420a-9179-993142bb000c tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1392 microversion: 2.1 time: 0.292444 Oct 10 23:23:40.070555 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 923/1892] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:39 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1392 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:40.172653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bf1b18f1-732d-4b42-b404-35d986357fc7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:40.173699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bf1b18f1-732d-4b42-b404-35d986357fc7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:40.183615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf1b18f1-732d-4b42-b404-35d986357fc7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:40.186750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf1b18f1-732d-4b42-b404-35d986357fc7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:40.191336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf1b18f1-732d-4b42-b404-35d986357fc7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:40.192665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf1b18f1-732d-4b42-b404-35d986357fc7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:40.194313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf1b18f1-732d-4b42-b404-35d986357fc7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:40.195285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf1b18f1-732d-4b42-b404-35d986357fc7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:40.245527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf1b18f1-732d-4b42-b404-35d986357fc7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:40.246904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf1b18f1-732d-4b42-b404-35d986357fc7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:40.248215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf1b18f1-732d-4b42-b404-35d986357fc7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:40.248916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-bf1b18f1-732d-4b42-b404-35d986357fc7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lazy-loading 'fault' on Instance uuid 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:40.314386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bf1b18f1-732d-4b42-b404-35d986357fc7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:40.329545 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bf1b18f1-732d-4b42-b404-35d986357fc7 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 200 len: 1303 microversion: 2.1 time: 0.161999 Oct 10 23:23:40.330622 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 970/1893] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:40 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 1303 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:40.390935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d5a328d8-315e-42b0-a160-29380672ddef tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:40.392070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d5a328d8-315e-42b0-a160-29380672ddef tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:40.407991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5a328d8-315e-42b0-a160-29380672ddef tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:40.409810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5a328d8-315e-42b0-a160-29380672ddef tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:40.410393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5a328d8-315e-42b0-a160-29380672ddef tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:40.411168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5a328d8-315e-42b0-a160-29380672ddef tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:40.411965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5a328d8-315e-42b0-a160-29380672ddef tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:40.412780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5a328d8-315e-42b0-a160-29380672ddef tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:40.569910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-d5a328d8-315e-42b0-a160-29380672ddef tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:40.590084 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d5a328d8-315e-42b0-a160-29380672ddef tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1927 microversion: 2.75 time: 0.204076 Oct 10 23:23:40.618113 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 924/1894] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:40 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1927 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:40.968558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a01bbaad-7596-48d2-bd7a-2ec220166ec3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:40.969464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a01bbaad-7596-48d2-bd7a-2ec220166ec3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:40.976704 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a01bbaad-7596-48d2-bd7a-2ec220166ec3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:40.977645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a01bbaad-7596-48d2-bd7a-2ec220166ec3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:40.978262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a01bbaad-7596-48d2-bd7a-2ec220166ec3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:40.979322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a01bbaad-7596-48d2-bd7a-2ec220166ec3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:40.980035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a01bbaad-7596-48d2-bd7a-2ec220166ec3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:40.980863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a01bbaad-7596-48d2-bd7a-2ec220166ec3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:40.985340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-ac06d55f-5a1d-4435-8226-198d9f1b74eb req-405f1dac-b5b4-4e6b-8b7d-4504933f1ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe142b1-562e-4ca2-a300-84a0bf7353ac", "name": "network-vif-plugged", "status": "completed", "tag": "183fcafc-50f1-4a82-bda7-809f6f81821e"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:40.996333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ac06d55f-5a1d-4435-8226-198d9f1b74eb req-405f1dac-b5b4-4e6b-8b7d-4504933f1ca2 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:40.996820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ac06d55f-5a1d-4435-8226-198d9f1b74eb req-405f1dac-b5b4-4e6b-8b7d-4504933f1ca2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:40.997992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ac06d55f-5a1d-4435-8226-198d9f1b74eb req-405f1dac-b5b4-4e6b-8b7d-4504933f1ca2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:41.013342 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-ac06d55f-5a1d-4435-8226-198d9f1b74eb req-405f1dac-b5b4-4e6b-8b7d-4504933f1ca2 service nova] Creating event network-vif-plugged:183fcafc-50f1-4a82-bda7-809f6f81821e for instance abe142b1-562e-4ca2-a300-84a0bf7353ac on n-h2-860864-2 Oct 10 23:23:41.025715 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-ac06d55f-5a1d-4435-8226-198d9f1b74eb req-405f1dac-b5b4-4e6b-8b7d-4504933f1ca2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043902 Oct 10 23:23:41.027208 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 925/1895] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:23:41.094331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fb394b75-6e89-48da-997a-1c7095fd63e8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:41.095290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fb394b75-6e89-48da-997a-1c7095fd63e8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:41.106569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb394b75-6e89-48da-997a-1c7095fd63e8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:41.110236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb394b75-6e89-48da-997a-1c7095fd63e8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:41.111024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb394b75-6e89-48da-997a-1c7095fd63e8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:41.111986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb394b75-6e89-48da-997a-1c7095fd63e8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:41.112611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb394b75-6e89-48da-997a-1c7095fd63e8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:41.115231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb394b75-6e89-48da-997a-1c7095fd63e8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:41.350670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a01bbaad-7596-48d2-bd7a-2ec220166ec3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:41.367872 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a01bbaad-7596-48d2-bd7a-2ec220166ec3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1308 microversion: 2.1 time: 0.403275 Oct 10 23:23:41.370222 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 971/1896] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:40 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1308 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:41.376745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e15d7a8a-2060-49eb-9bf7-822c4e340804 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:41.377600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e15d7a8a-2060-49eb-9bf7-822c4e340804 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:41.384520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e15d7a8a-2060-49eb-9bf7-822c4e340804 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:41.385449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e15d7a8a-2060-49eb-9bf7-822c4e340804 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:41.386065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e15d7a8a-2060-49eb-9bf7-822c4e340804 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:41.386934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e15d7a8a-2060-49eb-9bf7-822c4e340804 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:41.387599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e15d7a8a-2060-49eb-9bf7-822c4e340804 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:41.388182 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e15d7a8a-2060-49eb-9bf7-822c4e340804 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:41.421507 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-e15d7a8a-2060-49eb-9bf7-822c4e340804 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] HTTP exception thrown: Instance 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b could not be found. Oct 10 23:23:41.424664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e15d7a8a-2060-49eb-9bf7-822c4e340804 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Request method failure captured: Oct 10 23:23:41.424664 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b HTTP/1.1 Oct 10 23:23:41.424664 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:23:41.424664 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:23:41.424664 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:23:41.424664 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:23:41.424664 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:23:41.424664 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:23:41.424664 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:23:41.424664 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:23:41.424664 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgnbrtWotA5vmkMo4hAdL8zla9ltVJq-vphOMSGbrqzaupm4dOUwfwyPpRyCiSMe1ZEHR5Rz6ca9pvzk6spT16CJ3_AnSaqjs3ef9DkCCEHXnz-vKjdA5h1eyrWc9CCRHx4DSLeiktr5YussnAysO_dJn6OE8X75o9Na45EF6imrn0 Oct 10 23:23:41.424664 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:23:41.424664 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:23:41.424664 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:23:41.424664 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:23:41.424664 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:23:41.424664 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:23:41.424664 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 8fad4e7ad7ba4e8284360ccf30d71228 Oct 10 23:23:41.424664 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-MigrationsAdminTest-315073527 Oct 10 23:23:41.424664 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:23:41.424664 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:23:41.426499 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8fad4e7ad7ba4e8284360ccf30d71228"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fad4e7ad7ba4e8284360ccf30d71228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fad4e7ad7ba4e8284360ccf30d71228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8fad4e7ad7ba4e8284360ccf30d71228", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:23:41.426499 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-MigrationsAdminTest-315073527 Oct 10 23:23:41.426499 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 8fad4e7ad7ba4e8284360ccf30d71228 Oct 10 23:23:41.426499 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-MigrationsAdminTest-315073527 Oct 10 23:23:41.426499 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-MigrationsAdminTest-315073527-project Oct 10 23:23:41.426499 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:23:41.426499 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:23:41.426499 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: cbc0deea66094fac8d5f985e133ceaaa Oct 10 23:23:41.426499 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-MigrationsAdminTest-315073527-project Oct 10 23:23:41.426499 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:23:41.426499 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b could not be found. Oct 10 23:23:41.426499 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '76f81164-31f2-4f4b-9ec5-1e2ee8416c7b'} Oct 10 23:23:41.427504 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:23:41.427504 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:23:41.427504 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:23:41.427504 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:23:41.427504 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:23:41.427504 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:23:41.427504 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:23:41.427504 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:23:41.427504 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:23:41.427504 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:23:41.427504 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b could not be found. Oct 10 23:23:41.427504 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:23:41.427504 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:23:41.427504 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:23:41.427504 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:23:41.427504 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:23:41.427504 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:23:41.427504 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:23:41.427504 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:23:41.427504 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:23:41.429123 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:23:41.429123 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:23:41.429123 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:23:41.429123 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:23:41.429123 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:23:41.429123 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:23:41.429123 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:23:41.429123 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b could not be found. Oct 10 23:23:41.429123 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:23:41.429123 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:23:41.429123 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:23:41.429123 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:23:41.429123 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:23:41.429123 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:23:41.429123 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:23:41.429123 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:23:41.429123 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b could not be found. Oct 10 23:23:41.429123 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:23:41.431540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e15d7a8a-2060-49eb-9bf7-822c4e340804 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Returning 404 to user: Instance 76f81164-31f2-4f4b-9ec5-1e2ee8416c7b could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:23:41.432728 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e15d7a8a-2060-49eb-9bf7-822c4e340804 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b" status: 404 len: 111 microversion: 2.1 time: 0.060997 Oct 10 23:23:41.433878 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 972/1897] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:41 2022] GET /compute/v2.1/servers/76f81164-31f2-4f4b-9ec5-1e2ee8416c7b => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:23:41.441157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fb394b75-6e89-48da-997a-1c7095fd63e8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:41.443395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-37d21ff0-66f9-44ea-9199-dcf16060911a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:41.444098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-37d21ff0-66f9-44ea-9199-dcf16060911a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:41.455460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37d21ff0-66f9-44ea-9199-dcf16060911a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:41.455908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37d21ff0-66f9-44ea-9199-dcf16060911a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:41.456340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37d21ff0-66f9-44ea-9199-dcf16060911a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:41.457238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37d21ff0-66f9-44ea-9199-dcf16060911a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:41.458023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37d21ff0-66f9-44ea-9199-dcf16060911a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:41.458454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37d21ff0-66f9-44ea-9199-dcf16060911a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:41.458966 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fb394b75-6e89-48da-997a-1c7095fd63e8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1392 microversion: 2.1 time: 0.370065 Oct 10 23:23:41.459733 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 926/1898] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:41 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1392 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:41.499189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-37d21ff0-66f9-44ea-9199-dcf16060911a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:23:41.543544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:41.600508 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-37d21ff0-66f9-44ea-9199-dcf16060911a tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 204 len: 0 microversion: 2.1 time: 0.161335 Oct 10 23:23:41.601619 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 973/1899] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:23:41 2022] DELETE /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:23:41.611480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-398c957e-8108-4001-8107-f370e7585ca3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:41.612359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-398c957e-8108-4001-8107-f370e7585ca3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:41.625172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-398c957e-8108-4001-8107-f370e7585ca3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:41.626173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-398c957e-8108-4001-8107-f370e7585ca3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:41.626909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-398c957e-8108-4001-8107-f370e7585ca3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:41.627439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-57e8eeea-7792-40da-bec1-823ea2e5f2ab tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:41.628158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-57e8eeea-7792-40da-bec1-823ea2e5f2ab tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:41.628821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-398c957e-8108-4001-8107-f370e7585ca3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:41.629628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-398c957e-8108-4001-8107-f370e7585ca3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:41.630286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-398c957e-8108-4001-8107-f370e7585ca3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:41.634908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57e8eeea-7792-40da-bec1-823ea2e5f2ab tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:41.635339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57e8eeea-7792-40da-bec1-823ea2e5f2ab tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:41.635778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57e8eeea-7792-40da-bec1-823ea2e5f2ab tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:41.636480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57e8eeea-7792-40da-bec1-823ea2e5f2ab tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:41.636927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57e8eeea-7792-40da-bec1-823ea2e5f2ab tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:41.637360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57e8eeea-7792-40da-bec1-823ea2e5f2ab tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:41.718422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-57e8eeea-7792-40da-bec1-823ea2e5f2ab tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:41.745408 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-57e8eeea-7792-40da-bec1-823ea2e5f2ab tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1927 microversion: 2.75 time: 0.124931 Oct 10 23:23:41.746361 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 974/1900] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:41 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1927 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:41.815178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-398c957e-8108-4001-8107-f370e7585ca3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:41.829269 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-398c957e-8108-4001-8107-f370e7585ca3 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1466 microversion: 2.1 time: 0.223674 Oct 10 23:23:41.830174 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 927/1901] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:41 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1466 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:42.401606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0a5f65bc-5f1e-45d6-af6a-31c8f530c31a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:42.402455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0a5f65bc-5f1e-45d6-af6a-31c8f530c31a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:42.413275 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a5f65bc-5f1e-45d6-af6a-31c8f530c31a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:42.414445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a5f65bc-5f1e-45d6-af6a-31c8f530c31a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:42.415116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a5f65bc-5f1e-45d6-af6a-31c8f530c31a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:42.416196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a5f65bc-5f1e-45d6-af6a-31c8f530c31a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:42.416980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a5f65bc-5f1e-45d6-af6a-31c8f530c31a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:42.418389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a5f65bc-5f1e-45d6-af6a-31c8f530c31a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:42.488601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-44c90ddc-3762-403e-b65b-6275b8019f08 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:42.489444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-44c90ddc-3762-403e-b65b-6275b8019f08 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:42.504096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44c90ddc-3762-403e-b65b-6275b8019f08 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:42.506964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44c90ddc-3762-403e-b65b-6275b8019f08 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:42.507654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44c90ddc-3762-403e-b65b-6275b8019f08 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:42.510842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44c90ddc-3762-403e-b65b-6275b8019f08 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:42.511791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44c90ddc-3762-403e-b65b-6275b8019f08 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:42.513580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44c90ddc-3762-403e-b65b-6275b8019f08 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:42.587894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0a5f65bc-5f1e-45d6-af6a-31c8f530c31a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:42.597100 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0a5f65bc-5f1e-45d6-af6a-31c8f530c31a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1308 microversion: 2.1 time: 0.202202 Oct 10 23:23:42.613082 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 975/1902] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:42 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1308 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:42.777733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bf81da59-aa68-4131-aa52-98f7b989b925 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:42.778361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bf81da59-aa68-4131-aa52-98f7b989b925 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:42.787980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf81da59-aa68-4131-aa52-98f7b989b925 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:42.788526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf81da59-aa68-4131-aa52-98f7b989b925 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:42.788969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf81da59-aa68-4131-aa52-98f7b989b925 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:42.798598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf81da59-aa68-4131-aa52-98f7b989b925 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:42.799187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf81da59-aa68-4131-aa52-98f7b989b925 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:42.799643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf81da59-aa68-4131-aa52-98f7b989b925 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:42.809644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-44c90ddc-3762-403e-b65b-6275b8019f08 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:42.822976 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-44c90ddc-3762-403e-b65b-6275b8019f08 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1392 microversion: 2.1 time: 0.338983 Oct 10 23:23:42.823584 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 928/1903] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:42 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1392 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:42.842062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b7d84e5e-40a4-4d75-b8f6-8ba2f81413d1 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:42.850105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b7d84e5e-40a4-4d75-b8f6-8ba2f81413d1 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:42.850881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b7d84e5e-40a4-4d75-b8f6-8ba2f81413d1 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Searching by: {'deleted': False, 'project_id': 'c79b53335e364bee8df72339b5800957'} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:23:42.859924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7d84e5e-40a4-4d75-b8f6-8ba2f81413d1 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:42.860418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7d84e5e-40a4-4d75-b8f6-8ba2f81413d1 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:42.860856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7d84e5e-40a4-4d75-b8f6-8ba2f81413d1 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:42.863418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7d84e5e-40a4-4d75-b8f6-8ba2f81413d1 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:42.863418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7d84e5e-40a4-4d75-b8f6-8ba2f81413d1 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:42.863418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7d84e5e-40a4-4d75-b8f6-8ba2f81413d1 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:42.894258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:42.908014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.multi_cell_list [None req-b7d84e5e-40a4-4d75-b8f6-8ba2f81413d1 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120613) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:23:42.955840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-bf81da59-aa68-4131-aa52-98f7b989b925 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:42.968886 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b7d84e5e-40a4-4d75-b8f6-8ba2f81413d1 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.143703 Oct 10 23:23:42.969768 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 929/1904] 10.222.0.23 () {58 vars in 1125 bytes} [Mon Oct 10 23:23:42 2022] GET /compute/v2.1/servers => generated 333 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:23:42.982470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ba079e64-c611-4a49-a53f-e03b5bed040b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:42.984193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ba079e64-c611-4a49-a53f-e03b5bed040b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:42.986426 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bf81da59-aa68-4131-aa52-98f7b989b925 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1927 microversion: 2.75 time: 0.214799 Oct 10 23:23:42.991663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba079e64-c611-4a49-a53f-e03b5bed040b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:42.992675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba079e64-c611-4a49-a53f-e03b5bed040b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:42.993612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba079e64-c611-4a49-a53f-e03b5bed040b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:42.995150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba079e64-c611-4a49-a53f-e03b5bed040b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:42.995793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba079e64-c611-4a49-a53f-e03b5bed040b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:42.996380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba079e64-c611-4a49-a53f-e03b5bed040b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:42.997875 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 976/1905] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:42 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1927 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:43.012419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e6c9f9a0-01aa-4d0f-9755-0283a6ea28de tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:43.017329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e6c9f9a0-01aa-4d0f-9755-0283a6ea28de tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:43.018230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e6c9f9a0-01aa-4d0f-9755-0283a6ea28de tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Searching by: {'deleted': False, 'project_id': 'c79b53335e364bee8df72339b5800957'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:23:43.023751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6c9f9a0-01aa-4d0f-9755-0283a6ea28de tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:43.024513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6c9f9a0-01aa-4d0f-9755-0283a6ea28de tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:43.025136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6c9f9a0-01aa-4d0f-9755-0283a6ea28de tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:43.026080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6c9f9a0-01aa-4d0f-9755-0283a6ea28de tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:43.026710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6c9f9a0-01aa-4d0f-9755-0283a6ea28de tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:43.027313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6c9f9a0-01aa-4d0f-9755-0283a6ea28de tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:43.062104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.multi_cell_list [None req-e6c9f9a0-01aa-4d0f-9755-0283a6ea28de tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:23:43.110777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e6c9f9a0-01aa-4d0f-9755-0283a6ea28de tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:43.116148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:43.118421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6c9f9a0-01aa-4d0f-9755-0283a6ea28de tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:43.119038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6c9f9a0-01aa-4d0f-9755-0283a6ea28de tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:43.119485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6c9f9a0-01aa-4d0f-9755-0283a6ea28de tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:43.198799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ba079e64-c611-4a49-a53f-e03b5bed040b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:43.208599 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ba079e64-c611-4a49-a53f-e03b5bed040b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1466 microversion: 2.1 time: 0.237275 Oct 10 23:23:43.210365 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 930/1906] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:42 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1466 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:43.365412 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e6c9f9a0-01aa-4d0f-9755-0283a6ea28de tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.365735 Oct 10 23:23:43.379287 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 977/1907] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:23:42 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:43.399646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d5608113-86ea-4b84-9182-b9821b695091 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:43.434165 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d5608113-86ea-4b84-9182-b9821b695091 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039925 Oct 10 23:23:43.435241 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 931/1908] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:23:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:23:43.623905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-59cddfa0-49b7-44d1-bb09-6a185c201b20 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:43.624643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-59cddfa0-49b7-44d1-bb09-6a185c201b20 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:43.644873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59cddfa0-49b7-44d1-bb09-6a185c201b20 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:43.645366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59cddfa0-49b7-44d1-bb09-6a185c201b20 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:43.645822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59cddfa0-49b7-44d1-bb09-6a185c201b20 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:43.646636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59cddfa0-49b7-44d1-bb09-6a185c201b20 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:43.647088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59cddfa0-49b7-44d1-bb09-6a185c201b20 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:43.647509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59cddfa0-49b7-44d1-bb09-6a185c201b20 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:43.838625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bf242cfd-c677-4fb8-9102-c82ce75d85d0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:43.839778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bf242cfd-c677-4fb8-9102-c82ce75d85d0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:43.861575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf242cfd-c677-4fb8-9102-c82ce75d85d0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:43.862063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf242cfd-c677-4fb8-9102-c82ce75d85d0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:43.862680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf242cfd-c677-4fb8-9102-c82ce75d85d0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:43.863837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf242cfd-c677-4fb8-9102-c82ce75d85d0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:43.864523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf242cfd-c677-4fb8-9102-c82ce75d85d0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:43.865109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf242cfd-c677-4fb8-9102-c82ce75d85d0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:43.886616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-59cddfa0-49b7-44d1-bb09-6a185c201b20 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:43.903320 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-59cddfa0-49b7-44d1-bb09-6a185c201b20 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1487 microversion: 2.1 time: 0.281154 Oct 10 23:23:43.905396 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 978/1909] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:43 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1487 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:43.923951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d1e8447b-12ad-4bfc-a744-f6abd907877b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:43.924599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d1e8447b-12ad-4bfc-a744-f6abd907877b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:43.932067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bf242cfd-c677-4fb8-9102-c82ce75d85d0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:23:43.935193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1e8447b-12ad-4bfc-a744-f6abd907877b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:43.936764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1e8447b-12ad-4bfc-a744-f6abd907877b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:43.942080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1e8447b-12ad-4bfc-a744-f6abd907877b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:43.949302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1e8447b-12ad-4bfc-a744-f6abd907877b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:43.951804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1e8447b-12ad-4bfc-a744-f6abd907877b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:43.953210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1e8447b-12ad-4bfc-a744-f6abd907877b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:44.092441 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bf242cfd-c677-4fb8-9102-c82ce75d85d0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d" status: 204 len: 0 microversion: 2.1 time: 0.258369 Oct 10 23:23:44.093956 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 932/1910] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:23:43 2022] DELETE /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:23:44.107095 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-76c4d5c8-5c96-4862-a58f-ac00d2f31571 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:44.119475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76c4d5c8-5c96-4862-a58f-ac00d2f31571 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:44.120342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76c4d5c8-5c96-4862-a58f-ac00d2f31571 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:44.121036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76c4d5c8-5c96-4862-a58f-ac00d2f31571 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:44.162892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-76c4d5c8-5c96-4862-a58f-ac00d2f31571 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Going to try to stop instance {{(pid=120613) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 23:23:44.240510 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-76c4d5c8-5c96-4862-a58f-ac00d2f31571 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "POST /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac/action" status: 202 len: 0 microversion: 2.1 time: 0.144041 Oct 10 23:23:44.250040 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 933/1911] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:23:44 2022] POST /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:23:44.258640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d1e8447b-12ad-4bfc-a744-f6abd907877b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:44.266271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-07645ee3-11cc-43f7-a3d0-aa15b770ad5f tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:44.267122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-07645ee3-11cc-43f7-a3d0-aa15b770ad5f tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:44.298862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07645ee3-11cc-43f7-a3d0-aa15b770ad5f tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:44.299362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07645ee3-11cc-43f7-a3d0-aa15b770ad5f tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:44.300023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07645ee3-11cc-43f7-a3d0-aa15b770ad5f tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:44.301134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07645ee3-11cc-43f7-a3d0-aa15b770ad5f tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:44.301848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07645ee3-11cc-43f7-a3d0-aa15b770ad5f tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:44.306125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07645ee3-11cc-43f7-a3d0-aa15b770ad5f tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:44.314334 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d1e8447b-12ad-4bfc-a744-f6abd907877b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1392 microversion: 2.1 time: 0.407332 Oct 10 23:23:44.318433 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 979/1912] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:43 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1392 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:44.323464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-03ba3321-cc5d-4bb0-b10b-b5ee141b0eee req-e392f86e-72b4-40c3-87e9-b375dadcd031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a45a7de2-2607-4f13-87e3-2c7e74785470", "name": "network-vif-deleted", "tag": "fdbc7ece-ba7d-48ea-9d4a-166ef6293a46"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:44.355802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-03ba3321-cc5d-4bb0-b10b-b5ee141b0eee req-e392f86e-72b4-40c3-87e9-b375dadcd031 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:44.360882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-03ba3321-cc5d-4bb0-b10b-b5ee141b0eee req-e392f86e-72b4-40c3-87e9-b375dadcd031 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:44.362409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-03ba3321-cc5d-4bb0-b10b-b5ee141b0eee req-e392f86e-72b4-40c3-87e9-b375dadcd031 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:44.380398 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-03ba3321-cc5d-4bb0-b10b-b5ee141b0eee req-e392f86e-72b4-40c3-87e9-b375dadcd031 service nova] Creating event network-vif-deleted:fdbc7ece-ba7d-48ea-9d4a-166ef6293a46 for instance a45a7de2-2607-4f13-87e3-2c7e74785470 on n-h1-860864-2 Oct 10 23:23:44.389937 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-03ba3321-cc5d-4bb0-b10b-b5ee141b0eee req-e392f86e-72b4-40c3-87e9-b375dadcd031 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069945 Oct 10 23:23:44.401293 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 980/1913] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:23:44.428336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bb99fc93-7a29-4fdc-b2b9-84eef1574ebb tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:44.431712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bb99fc93-7a29-4fdc-b2b9-84eef1574ebb tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:44.441204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb99fc93-7a29-4fdc-b2b9-84eef1574ebb tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:44.441959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb99fc93-7a29-4fdc-b2b9-84eef1574ebb tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:44.442428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb99fc93-7a29-4fdc-b2b9-84eef1574ebb tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:44.443361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb99fc93-7a29-4fdc-b2b9-84eef1574ebb tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:44.443977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb99fc93-7a29-4fdc-b2b9-84eef1574ebb tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:44.444590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb99fc93-7a29-4fdc-b2b9-84eef1574ebb tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:44.490001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-07645ee3-11cc-43f7-a3d0-aa15b770ad5f tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:44.534155 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-07645ee3-11cc-43f7-a3d0-aa15b770ad5f tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1927 microversion: 2.75 time: 0.282078 Oct 10 23:23:44.535142 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 934/1914] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:44 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1927 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:44.541012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bfd028ab-fe61-46f4-8b6b-a0014ea20242 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:44.555306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bfd028ab-fe61-46f4-8b6b-a0014ea20242 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:44.573488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfd028ab-fe61-46f4-8b6b-a0014ea20242 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:44.578876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfd028ab-fe61-46f4-8b6b-a0014ea20242 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:44.579688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfd028ab-fe61-46f4-8b6b-a0014ea20242 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:44.580088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfd028ab-fe61-46f4-8b6b-a0014ea20242 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:44.588842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfd028ab-fe61-46f4-8b6b-a0014ea20242 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:44.589291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfd028ab-fe61-46f4-8b6b-a0014ea20242 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:44.656249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfd028ab-fe61-46f4-8b6b-a0014ea20242 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:44.656737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfd028ab-fe61-46f4-8b6b-a0014ea20242 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:44.657397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfd028ab-fe61-46f4-8b6b-a0014ea20242 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:44.657943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-bfd028ab-fe61-46f4-8b6b-a0014ea20242 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lazy-loading 'fault' on Instance uuid a45a7de2-2607-4f13-87e3-2c7e74785470 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:44.729048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb99fc93-7a29-4fdc-b2b9-84eef1574ebb tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:44.749545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bfd028ab-fe61-46f4-8b6b-a0014ea20242 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:44.755090 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bb99fc93-7a29-4fdc-b2b9-84eef1574ebb tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d" status: 200 len: 1699 microversion: 2.1 time: 0.349220 Oct 10 23:23:44.756505 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 981/1915] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:44 2022] GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d => generated 1699 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:44.763816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d60f9142-25c6-48b3-acf4-7e777cbc5698 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:44.767020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d60f9142-25c6-48b3-acf4-7e777cbc5698 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:44.778711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d60f9142-25c6-48b3-acf4-7e777cbc5698 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:44.781759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d60f9142-25c6-48b3-acf4-7e777cbc5698 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:44.783424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d60f9142-25c6-48b3-acf4-7e777cbc5698 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:44.785515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d60f9142-25c6-48b3-acf4-7e777cbc5698 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:44.787902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d60f9142-25c6-48b3-acf4-7e777cbc5698 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:44.788653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d60f9142-25c6-48b3-acf4-7e777cbc5698 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:44.792225 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bfd028ab-fe61-46f4-8b6b-a0014ea20242 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1302 microversion: 2.1 time: 0.255426 Oct 10 23:23:44.794129 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 935/1916] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:44 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1302 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:45.027289 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d60f9142-25c6-48b3-acf4-7e777cbc5698 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:45.037600 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d60f9142-25c6-48b3-acf4-7e777cbc5698 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1497 microversion: 2.1 time: 0.278873 Oct 10 23:23:45.046792 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 982/1917] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:44 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1497 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:45.344562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d576db12-3b5f-4b3a-8c53-75824caf59c4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:45.345423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d576db12-3b5f-4b3a-8c53-75824caf59c4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:45.357147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d576db12-3b5f-4b3a-8c53-75824caf59c4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:45.358306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d576db12-3b5f-4b3a-8c53-75824caf59c4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:45.358822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d576db12-3b5f-4b3a-8c53-75824caf59c4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:45.359783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d576db12-3b5f-4b3a-8c53-75824caf59c4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:45.360502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d576db12-3b5f-4b3a-8c53-75824caf59c4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:45.361039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d576db12-3b5f-4b3a-8c53-75824caf59c4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:45.552701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d576db12-3b5f-4b3a-8c53-75824caf59c4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:45.565172 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d576db12-3b5f-4b3a-8c53-75824caf59c4 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1392 microversion: 2.1 time: 0.225528 Oct 10 23:23:45.571167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7d59abc5-d1bd-4787-93e6-6632caff9725 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:45.573598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7d59abc5-d1bd-4787-93e6-6632caff9725 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:45.577460 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 936/1918] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:45 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1392 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:45.586519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d59abc5-d1bd-4787-93e6-6632caff9725 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:45.587918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d59abc5-d1bd-4787-93e6-6632caff9725 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:45.591681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d59abc5-d1bd-4787-93e6-6632caff9725 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:45.594379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d59abc5-d1bd-4787-93e6-6632caff9725 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:45.596652 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d59abc5-d1bd-4787-93e6-6632caff9725 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:45.597134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d59abc5-d1bd-4787-93e6-6632caff9725 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:45.729333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-7d59abc5-d1bd-4787-93e6-6632caff9725 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:45.751704 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7d59abc5-d1bd-4787-93e6-6632caff9725 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1927 microversion: 2.75 time: 0.185013 Oct 10 23:23:45.752721 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 983/1919] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:45 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1927 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:23:45.790629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-418f3067-7fa7-40cc-a36e-1ddff49db7e7 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:45.791448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-418f3067-7fa7-40cc-a36e-1ddff49db7e7 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:45.798812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-418f3067-7fa7-40cc-a36e-1ddff49db7e7 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:45.799641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-418f3067-7fa7-40cc-a36e-1ddff49db7e7 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:45.800378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-418f3067-7fa7-40cc-a36e-1ddff49db7e7 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:45.801296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-418f3067-7fa7-40cc-a36e-1ddff49db7e7 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:45.802068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-418f3067-7fa7-40cc-a36e-1ddff49db7e7 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:45.803094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-418f3067-7fa7-40cc-a36e-1ddff49db7e7 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:45.827803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ebf0a910-82f5-4ec8-8cde-a3acf407d163 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:45.828869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ebf0a910-82f5-4ec8-8cde-a3acf407d163 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:45.837534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebf0a910-82f5-4ec8-8cde-a3acf407d163 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:45.841233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebf0a910-82f5-4ec8-8cde-a3acf407d163 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:45.845181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebf0a910-82f5-4ec8-8cde-a3acf407d163 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:45.848778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebf0a910-82f5-4ec8-8cde-a3acf407d163 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:45.849541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebf0a910-82f5-4ec8-8cde-a3acf407d163 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:45.850435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebf0a910-82f5-4ec8-8cde-a3acf407d163 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:45.932943 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebf0a910-82f5-4ec8-8cde-a3acf407d163 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:45.933814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebf0a910-82f5-4ec8-8cde-a3acf407d163 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:45.934650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebf0a910-82f5-4ec8-8cde-a3acf407d163 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:45.935351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-ebf0a910-82f5-4ec8-8cde-a3acf407d163 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lazy-loading 'fault' on Instance uuid a45a7de2-2607-4f13-87e3-2c7e74785470 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:45.983966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ebf0a910-82f5-4ec8-8cde-a3acf407d163 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbc0deea66094fac8d5f985e133ceaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fad4e7ad7ba4e8284360ccf30d71228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:45.993949 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ebf0a910-82f5-4ec8-8cde-a3acf407d163 tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 200 len: 1302 microversion: 2.1 time: 0.173141 Oct 10 23:23:45.995124 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 984/1920] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:45 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 1302 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:46.062973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9447a094-5188-4a3f-99b8-6bf00a2825e9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:46.063597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9447a094-5188-4a3f-99b8-6bf00a2825e9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:46.078965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9447a094-5188-4a3f-99b8-6bf00a2825e9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:46.079732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9447a094-5188-4a3f-99b8-6bf00a2825e9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:46.080395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9447a094-5188-4a3f-99b8-6bf00a2825e9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:46.081325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9447a094-5188-4a3f-99b8-6bf00a2825e9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:46.081974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9447a094-5188-4a3f-99b8-6bf00a2825e9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:46.083087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-418f3067-7fa7-40cc-a36e-1ddff49db7e7 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:46.083817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9447a094-5188-4a3f-99b8-6bf00a2825e9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:46.098785 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-418f3067-7fa7-40cc-a36e-1ddff49db7e7 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d" status: 200 len: 1699 microversion: 2.1 time: 0.313896 Oct 10 23:23:46.100865 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 937/1921] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:45 2022] GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d => generated 1699 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:46.508267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9447a094-5188-4a3f-99b8-6bf00a2825e9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:46.518912 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9447a094-5188-4a3f-99b8-6bf00a2825e9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1497 microversion: 2.1 time: 0.460833 Oct 10 23:23:46.519991 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 985/1922] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:46 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1497 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:46.601713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0ed3a38f-7e0d-42ac-930e-fbe2f95b8634 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:46.603055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0ed3a38f-7e0d-42ac-930e-fbe2f95b8634 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:46.611775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ed3a38f-7e0d-42ac-930e-fbe2f95b8634 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:46.612321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ed3a38f-7e0d-42ac-930e-fbe2f95b8634 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:46.612760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ed3a38f-7e0d-42ac-930e-fbe2f95b8634 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:46.613517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ed3a38f-7e0d-42ac-930e-fbe2f95b8634 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:46.614237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ed3a38f-7e0d-42ac-930e-fbe2f95b8634 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:46.614670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ed3a38f-7e0d-42ac-930e-fbe2f95b8634 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:46.785829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9dd7a6f6-575c-41ab-adcd-abfb8bc67e30 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:46.787373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9dd7a6f6-575c-41ab-adcd-abfb8bc67e30 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:46.800816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9dd7a6f6-575c-41ab-adcd-abfb8bc67e30 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:46.801669 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9dd7a6f6-575c-41ab-adcd-abfb8bc67e30 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:46.802296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9dd7a6f6-575c-41ab-adcd-abfb8bc67e30 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:46.803098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9dd7a6f6-575c-41ab-adcd-abfb8bc67e30 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:46.803617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9dd7a6f6-575c-41ab-adcd-abfb8bc67e30 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:46.804347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9dd7a6f6-575c-41ab-adcd-abfb8bc67e30 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:46.923958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-9dd7a6f6-575c-41ab-adcd-abfb8bc67e30 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:46.962639 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9dd7a6f6-575c-41ab-adcd-abfb8bc67e30 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1927 microversion: 2.75 time: 0.182195 Oct 10 23:23:46.963959 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 986/1923] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:46 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1927 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:23:46.977156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-271c3729-c06c-4738-a59c-208c5bff7bee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1477249175", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "de46cdec-ec5d-4348-b04f-dbf364a4ee52"}], "block_device_mapping_v2": [{"uuid": "3f5030bd-6213-49b5-88bd-e8f8eb4b86b8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:47.104001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-271c3729-c06c-4738-a59c-208c5bff7bee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] validate_networks() for [('de46cdec-ec5d-4348-b04f-dbf364a4ee52', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:23:47.149322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0ed3a38f-7e0d-42ac-930e-fbe2f95b8634 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:47.161465 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0ed3a38f-7e0d-42ac-930e-fbe2f95b8634 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1392 microversion: 2.1 time: 0.564801 Oct 10 23:23:47.163041 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 938/1924] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:46 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1392 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:47.168771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-19dc614b-1977-4483-b92e-5b2152c6322b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:47.169819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-19dc614b-1977-4483-b92e-5b2152c6322b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] [instance: a45a7de2-2607-4f13-87e3-2c7e74785470] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:47.178466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19dc614b-1977-4483-b92e-5b2152c6322b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:47.179312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19dc614b-1977-4483-b92e-5b2152c6322b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:47.179974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19dc614b-1977-4483-b92e-5b2152c6322b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:47.180905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19dc614b-1977-4483-b92e-5b2152c6322b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:47.181935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19dc614b-1977-4483-b92e-5b2152c6322b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:47.182656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19dc614b-1977-4483-b92e-5b2152c6322b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:47.200772 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-19dc614b-1977-4483-b92e-5b2152c6322b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] HTTP exception thrown: Instance a45a7de2-2607-4f13-87e3-2c7e74785470 could not be found. Oct 10 23:23:47.203334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-19dc614b-1977-4483-b92e-5b2152c6322b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Request method failure captured: Oct 10 23:23:47.203334 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 HTTP/1.1 Oct 10 23:23:47.203334 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:23:47.203334 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:23:47.203334 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:23:47.203334 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:23:47.203334 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:23:47.203334 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:23:47.203334 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:23:47.203334 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:23:47.203334 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKgnbrtWotA5vmkMo4hAdL8zla9ltVJq-vphOMSGbrqzaupm4dOUwfwyPpRyCiSMe1ZEHR5Rz6ca9pvzk6spT16CJ3_AnSaqjs3ef9DkCCEHXnz-vKjdA5h1eyrWc9CCRHx4DSLeiktr5YussnAysO_dJn6OE8X75o9Na45EF6imrn0 Oct 10 23:23:47.203334 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:23:47.203334 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:23:47.203334 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:23:47.203334 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:23:47.203334 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:23:47.203334 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:23:47.203334 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 8fad4e7ad7ba4e8284360ccf30d71228 Oct 10 23:23:47.203334 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-MigrationsAdminTest-315073527 Oct 10 23:23:47.203334 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:23:47.203334 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:23:47.205326 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8fad4e7ad7ba4e8284360ccf30d71228"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fad4e7ad7ba4e8284360ccf30d71228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fad4e7ad7ba4e8284360ccf30d71228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8fad4e7ad7ba4e8284360ccf30d71228", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:23:47.205326 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-MigrationsAdminTest-315073527 Oct 10 23:23:47.205326 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 8fad4e7ad7ba4e8284360ccf30d71228 Oct 10 23:23:47.205326 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-MigrationsAdminTest-315073527 Oct 10 23:23:47.205326 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-MigrationsAdminTest-315073527-project Oct 10 23:23:47.205326 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:23:47.205326 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:23:47.205326 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: cbc0deea66094fac8d5f985e133ceaaa Oct 10 23:23:47.205326 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-MigrationsAdminTest-315073527-project Oct 10 23:23:47.205326 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:23:47.205326 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance a45a7de2-2607-4f13-87e3-2c7e74785470 could not be found. Oct 10 23:23:47.205326 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'a45a7de2-2607-4f13-87e3-2c7e74785470'} Oct 10 23:23:47.206240 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:23:47.206240 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:23:47.206240 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:23:47.206240 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:23:47.206240 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:23:47.206240 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:23:47.206240 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:23:47.206240 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:23:47.206240 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:23:47.206240 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:23:47.206240 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a45a7de2-2607-4f13-87e3-2c7e74785470 could not be found. Oct 10 23:23:47.206240 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:23:47.206240 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:23:47.206240 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:23:47.206240 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:23:47.206240 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:23:47.206240 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:23:47.206240 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:23:47.206240 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:23:47.206240 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:23:47.207673 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:23:47.207673 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:23:47.207673 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:23:47.207673 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:23:47.207673 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:23:47.207673 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:23:47.207673 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:23:47.207673 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a45a7de2-2607-4f13-87e3-2c7e74785470 could not be found. Oct 10 23:23:47.207673 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:23:47.207673 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:23:47.207673 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:23:47.207673 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:23:47.207673 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:23:47.207673 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:23:47.207673 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:23:47.207673 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:23:47.207673 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a45a7de2-2607-4f13-87e3-2c7e74785470 could not be found. Oct 10 23:23:47.207673 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:23:47.210852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-19dc614b-1977-4483-b92e-5b2152c6322b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] Returning 404 to user: Instance a45a7de2-2607-4f13-87e3-2c7e74785470 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:23:47.212013 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-19dc614b-1977-4483-b92e-5b2152c6322b tempest-MigrationsAdminTest-315073527 tempest-MigrationsAdminTest-315073527-project] 10.222.0.23 "GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470" status: 404 len: 111 microversion: 2.1 time: 0.047665 Oct 10 23:23:47.212793 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 939/1925] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:47 2022] GET /compute/v2.1/servers/a45a7de2-2607-4f13-87e3-2c7e74785470 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:23:47.230970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-176dd857-b102-4858-8eab-9afc9d39d6a0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:47.233422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-176dd857-b102-4858-8eab-9afc9d39d6a0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:47.262931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-176dd857-b102-4858-8eab-9afc9d39d6a0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:47.264655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-176dd857-b102-4858-8eab-9afc9d39d6a0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:47.269165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-176dd857-b102-4858-8eab-9afc9d39d6a0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:47.270861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-176dd857-b102-4858-8eab-9afc9d39d6a0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:47.280910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-176dd857-b102-4858-8eab-9afc9d39d6a0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:47.284525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-176dd857-b102-4858-8eab-9afc9d39d6a0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:47.587147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-176dd857-b102-4858-8eab-9afc9d39d6a0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:47.598097 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-176dd857-b102-4858-8eab-9afc9d39d6a0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d" status: 200 len: 1699 microversion: 2.1 time: 0.383982 Oct 10 23:23:47.598676 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 940/1926] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:47 2022] GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d => generated 1699 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:47.609669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e9731d93-9a15-425e-9992-7773bc92bf81 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:47.613500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e9731d93-9a15-425e-9992-7773bc92bf81 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:47.620509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9731d93-9a15-425e-9992-7773bc92bf81 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:47.631130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9731d93-9a15-425e-9992-7773bc92bf81 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:47.633244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9731d93-9a15-425e-9992-7773bc92bf81 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:47.634702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9731d93-9a15-425e-9992-7773bc92bf81 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:47.639620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9731d93-9a15-425e-9992-7773bc92bf81 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:47.640251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9731d93-9a15-425e-9992-7773bc92bf81 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:47.702283 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e9731d93-9a15-425e-9992-7773bc92bf81 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc/ips" status: 200 len: 147 microversion: 2.1 time: 0.097136 Oct 10 23:23:47.718348 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 941/1927] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 10 23:23:47 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc/ips => generated 147 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:23:47.726965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8594b6bb-ec72-4123-a76b-e4904441f37a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:47.727596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8594b6bb-ec72-4123-a76b-e4904441f37a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:47.732342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:47.742633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8594b6bb-ec72-4123-a76b-e4904441f37a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:47.744024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8594b6bb-ec72-4123-a76b-e4904441f37a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:47.745232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8594b6bb-ec72-4123-a76b-e4904441f37a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:47.746192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8594b6bb-ec72-4123-a76b-e4904441f37a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:47.746814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8594b6bb-ec72-4123-a76b-e4904441f37a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:47.747418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8594b6bb-ec72-4123-a76b-e4904441f37a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:48.091898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8594b6bb-ec72-4123-a76b-e4904441f37a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:48.102750 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8594b6bb-ec72-4123-a76b-e4904441f37a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1497 microversion: 2.1 time: 0.379867 Oct 10 23:23:48.117798 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 942/1928] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:47 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1497 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:48.117798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f0e1c68d-b2a4-4b4c-9ca3-dfada044c6de tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:48.117798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f0e1c68d-b2a4-4b4c-9ca3-dfada044c6de tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:48.120343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0e1c68d-b2a4-4b4c-9ca3-dfada044c6de tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:48.121190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0e1c68d-b2a4-4b4c-9ca3-dfada044c6de tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:48.121731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0e1c68d-b2a4-4b4c-9ca3-dfada044c6de tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:48.122553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0e1c68d-b2a4-4b4c-9ca3-dfada044c6de tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:48.123089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0e1c68d-b2a4-4b4c-9ca3-dfada044c6de tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:48.123639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0e1c68d-b2a4-4b4c-9ca3-dfada044c6de tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:48.262536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-f0e1c68d-b2a4-4b4c-9ca3-dfada044c6de tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:48.268689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:48.286018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-271c3729-c06c-4738-a59c-208c5bff7bee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:23:48.287548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-271c3729-c06c-4738-a59c-208c5bff7bee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:23:48.288449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-271c3729-c06c-4738-a59c-208c5bff7bee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:23:48.289552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-271c3729-c06c-4738-a59c-208c5bff7bee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:23:48.290107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-271c3729-c06c-4738-a59c-208c5bff7bee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:23:48.322477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-271c3729-c06c-4738-a59c-208c5bff7bee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:48.324325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-271c3729-c06c-4738-a59c-208c5bff7bee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:48.327804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-271c3729-c06c-4738-a59c-208c5bff7bee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:48.334168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-271c3729-c06c-4738-a59c-208c5bff7bee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:48.336897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-271c3729-c06c-4738-a59c-208c5bff7bee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:48.340109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-271c3729-c06c-4738-a59c-208c5bff7bee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:48.343986 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f0e1c68d-b2a4-4b4c-9ca3-dfada044c6de tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1927 microversion: 2.75 time: 0.236399 Oct 10 23:23:48.348162 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 943/1929] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:48 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1927 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:48.369408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8a9d0d3d-59ba-4641-85b5-d08aa2fcf9d2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:48.370168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8a9d0d3d-59ba-4641-85b5-d08aa2fcf9d2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:48.407864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a9d0d3d-59ba-4641-85b5-d08aa2fcf9d2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:48.408389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a9d0d3d-59ba-4641-85b5-d08aa2fcf9d2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:48.408931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a9d0d3d-59ba-4641-85b5-d08aa2fcf9d2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:48.409923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a9d0d3d-59ba-4641-85b5-d08aa2fcf9d2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:48.411340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a9d0d3d-59ba-4641-85b5-d08aa2fcf9d2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:48.412279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a9d0d3d-59ba-4641-85b5-d08aa2fcf9d2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:48.413523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-271c3729-c06c-4738-a59c-208c5bff7bee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Getting quotas for project 01ebbb0c057c44be8b51615d59209d90. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:23:48.427699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-271c3729-c06c-4738-a59c-208c5bff7bee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Getting quotas for user fabfd9ac67b645bf9234590b623c27b0 and project 01ebbb0c057c44be8b51615d59209d90. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:23:48.589897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-271c3729-c06c-4738-a59c-208c5bff7bee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:23:48.591752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-271c3729-c06c-4738-a59c-208c5bff7bee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f5030bd-6213-49b5-88bd-e8f8eb4b86b8',volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:23:48.879643 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-271c3729-c06c-4738-a59c-208c5bff7bee tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.913522 Oct 10 23:23:48.880357 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 987/1930] 10.222.0.23 () {62 vars in 1188 bytes} [Mon Oct 10 23:23:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1916 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 23:23:48.894583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-798ab7a2-1169-4aa9-88dd-d395c2db1360 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:48.896311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-798ab7a2-1169-4aa9-88dd-d395c2db1360 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:48.909746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-798ab7a2-1169-4aa9-88dd-d395c2db1360 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:48.911408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-798ab7a2-1169-4aa9-88dd-d395c2db1360 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:48.911855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-798ab7a2-1169-4aa9-88dd-d395c2db1360 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:48.913255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-798ab7a2-1169-4aa9-88dd-d395c2db1360 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:48.913767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-798ab7a2-1169-4aa9-88dd-d395c2db1360 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:48.914202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-798ab7a2-1169-4aa9-88dd-d395c2db1360 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:48.951139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-798ab7a2-1169-4aa9-88dd-d395c2db1360 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:48.951885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-798ab7a2-1169-4aa9-88dd-d395c2db1360 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:48.952705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-798ab7a2-1169-4aa9-88dd-d395c2db1360 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:48.953345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-798ab7a2-1169-4aa9-88dd-d395c2db1360 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lazy-loading 'fault' on Instance uuid 3480d89d-6a7a-4814-bc55-63ab2350750d {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:48.982935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:49.093208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-798ab7a2-1169-4aa9-88dd-d395c2db1360 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a679599a8ab140b39217ae582e124c21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79b53335e364bee8df72339b5800957', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:49.114456 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-798ab7a2-1169-4aa9-88dd-d395c2db1360 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d" status: 200 len: 1359 microversion: 2.1 time: 0.232397 Oct 10 23:23:49.115799 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 988/1931] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:48 2022] GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:49.130103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-278016d5-b019-444f-a545-3a656aa6a394 req-e4a135dd-d5d8-4fc4-9a73-cc461d3aa3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3480d89d-6a7a-4814-bc55-63ab2350750d", "name": "network-vif-deleted", "tag": "91530f58-3fc0-45aa-809a-4a02f3333d71"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:49.152021 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-278016d5-b019-444f-a545-3a656aa6a394 req-e4a135dd-d5d8-4fc4-9a73-cc461d3aa3c2 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:49.154822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-278016d5-b019-444f-a545-3a656aa6a394 req-e4a135dd-d5d8-4fc4-9a73-cc461d3aa3c2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:49.155291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-278016d5-b019-444f-a545-3a656aa6a394 req-e4a135dd-d5d8-4fc4-9a73-cc461d3aa3c2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:49.169419 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-278016d5-b019-444f-a545-3a656aa6a394 req-e4a135dd-d5d8-4fc4-9a73-cc461d3aa3c2 service nova] Creating event network-vif-deleted:91530f58-3fc0-45aa-809a-4a02f3333d71 for instance 3480d89d-6a7a-4814-bc55-63ab2350750d on n-h1-860864-2 Oct 10 23:23:49.178662 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-278016d5-b019-444f-a545-3a656aa6a394 req-e4a135dd-d5d8-4fc4-9a73-cc461d3aa3c2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059603 Oct 10 23:23:49.179978 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 989/1932] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:23:49.204436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-67ede75f-0c4d-4ce1-b380-9d04105c8f9d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:49.206595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-67ede75f-0c4d-4ce1-b380-9d04105c8f9d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:49.358592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8a9d0d3d-59ba-4641-85b5-d08aa2fcf9d2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:49.361909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-67ede75f-0c4d-4ce1-b380-9d04105c8f9d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:49.375509 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8a9d0d3d-59ba-4641-85b5-d08aa2fcf9d2 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1392 microversion: 2.1 time: 1.025900 Oct 10 23:23:49.377236 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 944/1933] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:48 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1392 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:49.384937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dd1e9ad9-2393-4777-8cd4-03d05ec12475 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:49.386975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dd1e9ad9-2393-4777-8cd4-03d05ec12475 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:49.399227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd1e9ad9-2393-4777-8cd4-03d05ec12475 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:49.399938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd1e9ad9-2393-4777-8cd4-03d05ec12475 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:49.400716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd1e9ad9-2393-4777-8cd4-03d05ec12475 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:49.401670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd1e9ad9-2393-4777-8cd4-03d05ec12475 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:49.402775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd1e9ad9-2393-4777-8cd4-03d05ec12475 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:49.403445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd1e9ad9-2393-4777-8cd4-03d05ec12475 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:49.415237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-67ede75f-0c4d-4ce1-b380-9d04105c8f9d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:49.430331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-67ede75f-0c4d-4ce1-b380-9d04105c8f9d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:49.431575 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-67ede75f-0c4d-4ce1-b380-9d04105c8f9d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1104 microversion: 2.25 time: 0.242799 Oct 10 23:23:49.432196 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 990/1934] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:49 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1104 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:49.462142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-97582ab2-acdc-4593-ba38-fc3674d14a66 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:49.462789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-97582ab2-acdc-4593-ba38-fc3674d14a66 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:49.480100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97582ab2-acdc-4593-ba38-fc3674d14a66 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:49.480679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97582ab2-acdc-4593-ba38-fc3674d14a66 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:49.481078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97582ab2-acdc-4593-ba38-fc3674d14a66 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:49.481817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97582ab2-acdc-4593-ba38-fc3674d14a66 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:49.486792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97582ab2-acdc-4593-ba38-fc3674d14a66 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:49.487893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97582ab2-acdc-4593-ba38-fc3674d14a66 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:49.712302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-97582ab2-acdc-4593-ba38-fc3674d14a66 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:49.737059 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-97582ab2-acdc-4593-ba38-fc3674d14a66 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1927 microversion: 2.75 time: 0.303716 Oct 10 23:23:49.751363 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 991/1935] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:49 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1927 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:49.757735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dd1e9ad9-2393-4777-8cd4-03d05ec12475 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:49.773949 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dd1e9ad9-2393-4777-8cd4-03d05ec12475 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1497 microversion: 2.1 time: 0.394814 Oct 10 23:23:49.774675 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 945/1936] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:49 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1497 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:50.146226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5c81562a-d45f-4a3d-a526-e2ad80c8c473 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:50.147355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5c81562a-d45f-4a3d-a526-e2ad80c8c473 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] [instance: 3480d89d-6a7a-4814-bc55-63ab2350750d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:50.162385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c81562a-d45f-4a3d-a526-e2ad80c8c473 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:50.166057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c81562a-d45f-4a3d-a526-e2ad80c8c473 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:50.166725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c81562a-d45f-4a3d-a526-e2ad80c8c473 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:50.167974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c81562a-d45f-4a3d-a526-e2ad80c8c473 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:50.168817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c81562a-d45f-4a3d-a526-e2ad80c8c473 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:50.170189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c81562a-d45f-4a3d-a526-e2ad80c8c473 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:50.209653 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-5c81562a-d45f-4a3d-a526-e2ad80c8c473 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] HTTP exception thrown: Instance 3480d89d-6a7a-4814-bc55-63ab2350750d could not be found. Oct 10 23:23:50.211499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5c81562a-d45f-4a3d-a526-e2ad80c8c473 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Request method failure captured: Oct 10 23:23:50.211499 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d HTTP/1.1 Oct 10 23:23:50.211499 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:23:50.211499 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:23:50.211499 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:23:50.211499 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:23:50.211499 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:23:50.211499 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:23:50.211499 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:23:50.211499 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:23:50.211499 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKkBV3oTTau7OB1q1GOj5eH73Bz4r4i9QkTERHHTryxZtDtiwhz46OB1nse4WFh6njA-oiVxChTDrHBMpHi0b0-wGbv061AoC8O0Te-E8HH6GlRL_yl5W7r8fV8fLQnMvOsylepXzTdLKMKiAsMnijfJ4j84ueyjH3L8-wV2NGpJgkM Oct 10 23:23:50.211499 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:23:50.211499 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:23:50.211499 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:23:50.211499 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:23:50.211499 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:23:50.211499 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:23:50.211499 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: c79b53335e364bee8df72339b5800957 Oct 10 23:23:50.211499 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersTestJSON-1275556853 Oct 10 23:23:50.211499 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:23:50.211499 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:23:50.213131 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c79b53335e364bee8df72339b5800957"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c79b53335e364bee8df72339b5800957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c79b53335e364bee8df72339b5800957"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c79b53335e364bee8df72339b5800957", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:23:50.213131 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersTestJSON-1275556853 Oct 10 23:23:50.213131 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: c79b53335e364bee8df72339b5800957 Oct 10 23:23:50.213131 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersTestJSON-1275556853 Oct 10 23:23:50.213131 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersTestJSON-1275556853-project Oct 10 23:23:50.213131 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:23:50.213131 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:23:50.213131 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: a679599a8ab140b39217ae582e124c21 Oct 10 23:23:50.213131 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersTestJSON-1275556853-project Oct 10 23:23:50.213131 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:23:50.213131 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 3480d89d-6a7a-4814-bc55-63ab2350750d could not be found. Oct 10 23:23:50.213131 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '3480d89d-6a7a-4814-bc55-63ab2350750d'} Oct 10 23:23:50.214085 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:23:50.214085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:23:50.214085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:23:50.214085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:23:50.214085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:23:50.214085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:23:50.214085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:23:50.214085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:23:50.214085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:23:50.214085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:23:50.214085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3480d89d-6a7a-4814-bc55-63ab2350750d could not be found. Oct 10 23:23:50.214085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:23:50.214085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:23:50.214085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:23:50.214085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:23:50.214085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:23:50.214085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:23:50.214085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:23:50.214085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:23:50.214085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:23:50.215705 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:23:50.215705 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:23:50.215705 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:23:50.215705 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:23:50.215705 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:23:50.215705 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:23:50.215705 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:23:50.215705 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3480d89d-6a7a-4814-bc55-63ab2350750d could not be found. Oct 10 23:23:50.215705 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:23:50.215705 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:23:50.215705 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:23:50.215705 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:23:50.215705 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:23:50.215705 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:23:50.215705 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:23:50.215705 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:23:50.215705 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3480d89d-6a7a-4814-bc55-63ab2350750d could not be found. Oct 10 23:23:50.215705 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:23:50.217002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5c81562a-d45f-4a3d-a526-e2ad80c8c473 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Returning 404 to user: Instance 3480d89d-6a7a-4814-bc55-63ab2350750d could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:23:50.217002 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5c81562a-d45f-4a3d-a526-e2ad80c8c473 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d" status: 404 len: 111 microversion: 2.1 time: 0.071129 Oct 10 23:23:50.218618 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 992/1937] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:50 2022] GET /compute/v2.1/servers/3480d89d-6a7a-4814-bc55-63ab2350750d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:23:50.227219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-df1fbc52-8583-4b95-9f8e-33595d4296a0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] Calling method '.version_select at 0x7f662af7e790>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:50.267300 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-df1fbc52-8583-4b95-9f8e-33595d4296a0 tempest-ServersTestJSON-1275556853 tempest-ServersTestJSON-1275556853-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1322257476" status: 202 len: 0 microversion: 2.1 time: 0.043943 Oct 10 23:23:50.268052 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 946/1938] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 10 23:23:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1322257476 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:23:50.409088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7957153b-c24a-4d0d-8bce-949dc53b97f9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:50.410407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7957153b-c24a-4d0d-8bce-949dc53b97f9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:50.424257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7957153b-c24a-4d0d-8bce-949dc53b97f9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:50.425050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7957153b-c24a-4d0d-8bce-949dc53b97f9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:50.425635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7957153b-c24a-4d0d-8bce-949dc53b97f9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:50.426390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7957153b-c24a-4d0d-8bce-949dc53b97f9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:50.426865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7957153b-c24a-4d0d-8bce-949dc53b97f9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:50.427285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7957153b-c24a-4d0d-8bce-949dc53b97f9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:50.459631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ea9390d6-c621-4ccd-bda2-58c61f59c4c5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:50.460948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ea9390d6-c621-4ccd-bda2-58c61f59c4c5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:50.480743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea9390d6-c621-4ccd-bda2-58c61f59c4c5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:50.483183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea9390d6-c621-4ccd-bda2-58c61f59c4c5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:50.485499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea9390d6-c621-4ccd-bda2-58c61f59c4c5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:50.491904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea9390d6-c621-4ccd-bda2-58c61f59c4c5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:50.493145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea9390d6-c621-4ccd-bda2-58c61f59c4c5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:50.493917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea9390d6-c621-4ccd-bda2-58c61f59c4c5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:50.766793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ea9390d6-c621-4ccd-bda2-58c61f59c4c5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:50.779624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ea9390d6-c621-4ccd-bda2-58c61f59c4c5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:50.784960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ea9390d6-c621-4ccd-bda2-58c61f59c4c5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:50.789843 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ea9390d6-c621-4ccd-bda2-58c61f59c4c5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1233 microversion: 2.25 time: 0.334347 Oct 10 23:23:50.793122 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 947/1939] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:50 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1233 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:23:50.807805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dbd6f847-f4a2-4108-868b-6cbd3a35c4f6 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:50.810304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dbd6f847-f4a2-4108-868b-6cbd3a35c4f6 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:50.827543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbd6f847-f4a2-4108-868b-6cbd3a35c4f6 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:50.829094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbd6f847-f4a2-4108-868b-6cbd3a35c4f6 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:50.830350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbd6f847-f4a2-4108-868b-6cbd3a35c4f6 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:50.835994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbd6f847-f4a2-4108-868b-6cbd3a35c4f6 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:50.836480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbd6f847-f4a2-4108-868b-6cbd3a35c4f6 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:50.837348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbd6f847-f4a2-4108-868b-6cbd3a35c4f6 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:50.901271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7957153b-c24a-4d0d-8bce-949dc53b97f9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:50.927687 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7957153b-c24a-4d0d-8bce-949dc53b97f9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1392 microversion: 2.1 time: 0.523096 Oct 10 23:23:50.929203 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 993/1940] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:50 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1392 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:50.934994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4cf26d6a-b6a8-40e5-a1f4-91711c1cb21e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:50.935774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4cf26d6a-b6a8-40e5-a1f4-91711c1cb21e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:50.946604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cf26d6a-b6a8-40e5-a1f4-91711c1cb21e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:50.947101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cf26d6a-b6a8-40e5-a1f4-91711c1cb21e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:50.947543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cf26d6a-b6a8-40e5-a1f4-91711c1cb21e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:50.950211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cf26d6a-b6a8-40e5-a1f4-91711c1cb21e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:50.952612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cf26d6a-b6a8-40e5-a1f4-91711c1cb21e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:50.953115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cf26d6a-b6a8-40e5-a1f4-91711c1cb21e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:51.032214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-dbd6f847-f4a2-4108-868b-6cbd3a35c4f6 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:51.077844 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dbd6f847-f4a2-4108-868b-6cbd3a35c4f6 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1927 microversion: 2.75 time: 0.280305 Oct 10 23:23:51.081302 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 948/1941] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:50 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1927 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:51.302605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4cf26d6a-b6a8-40e5-a1f4-91711c1cb21e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:51.317904 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4cf26d6a-b6a8-40e5-a1f4-91711c1cb21e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1497 microversion: 2.1 time: 0.386986 Oct 10 23:23:51.318643 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 994/1942] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:50 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1497 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:51.806219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0f410f7a-d369-485a-98af-7481d423f613 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba3f642b-0a4d-4a5d-933c-e3ca0075aea9"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:51.812601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0f410f7a-d369-485a-98af-7481d423f613 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:51.828023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-609e6ab5-7ab4-4dc7-80a9-276fc5e0eb24 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:51.832583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-609e6ab5-7ab4-4dc7-80a9-276fc5e0eb24 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:51.840298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f410f7a-d369-485a-98af-7481d423f613 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:51.843692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f410f7a-d369-485a-98af-7481d423f613 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:51.845992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f410f7a-d369-485a-98af-7481d423f613 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:51.846794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-609e6ab5-7ab4-4dc7-80a9-276fc5e0eb24 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:51.847969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-609e6ab5-7ab4-4dc7-80a9-276fc5e0eb24 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:51.850062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-609e6ab5-7ab4-4dc7-80a9-276fc5e0eb24 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:51.850725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f410f7a-d369-485a-98af-7481d423f613 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:51.852480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f410f7a-d369-485a-98af-7481d423f613 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:51.853083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f410f7a-d369-485a-98af-7481d423f613 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:51.855364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-609e6ab5-7ab4-4dc7-80a9-276fc5e0eb24 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:51.857454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-609e6ab5-7ab4-4dc7-80a9-276fc5e0eb24 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:51.859009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-609e6ab5-7ab4-4dc7-80a9-276fc5e0eb24 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:52.041925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-609e6ab5-7ab4-4dc7-80a9-276fc5e0eb24 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:52.059620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-609e6ab5-7ab4-4dc7-80a9-276fc5e0eb24 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:52.065001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-609e6ab5-7ab4-4dc7-80a9-276fc5e0eb24 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:52.069163 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-609e6ab5-7ab4-4dc7-80a9-276fc5e0eb24 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1251 microversion: 2.25 time: 0.242573 Oct 10 23:23:52.073496 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 995/1943] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:51 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1251 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:52.082304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-189d986a-e098-4583-a904-e4503bfb34e8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:52.085769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-189d986a-e098-4583-a904-e4503bfb34e8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:52.102112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-189d986a-e098-4583-a904-e4503bfb34e8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:52.102623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-189d986a-e098-4583-a904-e4503bfb34e8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:52.105085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-189d986a-e098-4583-a904-e4503bfb34e8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:52.107505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-189d986a-e098-4583-a904-e4503bfb34e8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:52.110243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-189d986a-e098-4583-a904-e4503bfb34e8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:52.110493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-189d986a-e098-4583-a904-e4503bfb34e8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:52.308241 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0f410f7a-d369-485a-98af-7481d423f613 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "POST /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.513942 Oct 10 23:23:52.309452 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 949/1944] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Oct 10 23:23:51 2022] POST /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc/os-volume_attachments => generated 194 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:23:52.374037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4b2fb3bd-8532-4a0a-b594-31f9f00760cb tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:52.375440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4b2fb3bd-8532-4a0a-b594-31f9f00760cb tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:52.392064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b2fb3bd-8532-4a0a-b594-31f9f00760cb tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:52.397776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b2fb3bd-8532-4a0a-b594-31f9f00760cb tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:52.398614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b2fb3bd-8532-4a0a-b594-31f9f00760cb tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:52.400710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b2fb3bd-8532-4a0a-b594-31f9f00760cb tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:52.401682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b2fb3bd-8532-4a0a-b594-31f9f00760cb tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:52.402404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b2fb3bd-8532-4a0a-b594-31f9f00760cb tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:52.563833 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-189d986a-e098-4583-a904-e4503bfb34e8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:52.592012 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-189d986a-e098-4583-a904-e4503bfb34e8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1392 microversion: 2.1 time: 0.518209 Oct 10 23:23:52.607328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-4b2fb3bd-8532-4a0a-b594-31f9f00760cb tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:52.612353 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 996/1945] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:52 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1392 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:52.620392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-53b10d78-5935-4711-84f8-2c1485c89058 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:52.621042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-53b10d78-5935-4711-84f8-2c1485c89058 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:52.638475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53b10d78-5935-4711-84f8-2c1485c89058 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:52.638971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53b10d78-5935-4711-84f8-2c1485c89058 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:52.640151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53b10d78-5935-4711-84f8-2c1485c89058 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:52.640843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53b10d78-5935-4711-84f8-2c1485c89058 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:52.641292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53b10d78-5935-4711-84f8-2c1485c89058 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:52.643267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53b10d78-5935-4711-84f8-2c1485c89058 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:52.647330 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4b2fb3bd-8532-4a0a-b594-31f9f00760cb tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1927 microversion: 2.75 time: 0.336248 Oct 10 23:23:52.647954 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 950/1946] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:52 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1927 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:53.097081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a69d5aee-3658-4b04-98d1-4311173aa024 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:53.097768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a69d5aee-3658-4b04-98d1-4311173aa024 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:53.101404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:53.120542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a69d5aee-3658-4b04-98d1-4311173aa024 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:53.121051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a69d5aee-3658-4b04-98d1-4311173aa024 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:53.121525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a69d5aee-3658-4b04-98d1-4311173aa024 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:53.122258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a69d5aee-3658-4b04-98d1-4311173aa024 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:53.122726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a69d5aee-3658-4b04-98d1-4311173aa024 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:53.123186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a69d5aee-3658-4b04-98d1-4311173aa024 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:53.365884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-53b10d78-5935-4711-84f8-2c1485c89058 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:53.385209 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-53b10d78-5935-4711-84f8-2c1485c89058 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1497 microversion: 2.1 time: 0.771437 Oct 10 23:23:53.386269 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 997/1947] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:52 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1497 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:53.585208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a69d5aee-3658-4b04-98d1-4311173aa024 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:53.610467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a69d5aee-3658-4b04-98d1-4311173aa024 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:53.620863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e3c1780e-ba82-49b3-a1fd-f3f1ee7b9b13 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:53.622068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e3c1780e-ba82-49b3-a1fd-f3f1ee7b9b13 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:53.631173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a69d5aee-3658-4b04-98d1-4311173aa024 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:53.636159 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a69d5aee-3658-4b04-98d1-4311173aa024 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1293 microversion: 2.25 time: 0.544401 Oct 10 23:23:53.637968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3c1780e-ba82-49b3-a1fd-f3f1ee7b9b13 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:53.655214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3c1780e-ba82-49b3-a1fd-f3f1ee7b9b13 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:53.655879 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 951/1948] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:53 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1293 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:53.656618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3c1780e-ba82-49b3-a1fd-f3f1ee7b9b13 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:53.662774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3c1780e-ba82-49b3-a1fd-f3f1ee7b9b13 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:53.664728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3c1780e-ba82-49b3-a1fd-f3f1ee7b9b13 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:53.665418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3c1780e-ba82-49b3-a1fd-f3f1ee7b9b13 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:53.691153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1bb2f8f9-3a0c-4108-947c-8ecfcdbc009b tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:53.692763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1bb2f8f9-3a0c-4108-947c-8ecfcdbc009b tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:53.736849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bb2f8f9-3a0c-4108-947c-8ecfcdbc009b tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:53.737637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bb2f8f9-3a0c-4108-947c-8ecfcdbc009b tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:53.738309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bb2f8f9-3a0c-4108-947c-8ecfcdbc009b tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:53.740180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bb2f8f9-3a0c-4108-947c-8ecfcdbc009b tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:53.757753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bb2f8f9-3a0c-4108-947c-8ecfcdbc009b tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:53.761334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bb2f8f9-3a0c-4108-947c-8ecfcdbc009b tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:53.928880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-1bb2f8f9-3a0c-4108-947c-8ecfcdbc009b tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:53.968243 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1bb2f8f9-3a0c-4108-947c-8ecfcdbc009b tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1927 microversion: 2.75 time: 0.290062 Oct 10 23:23:53.970591 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 952/1949] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:53 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1927 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:23:54.297093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5cd03205-112a-468f-b2bd-26a12ede212f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1452635777", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:54.386214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-5cd03205-112a-468f-b2bd-26a12ede212f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] validate_networks() for None {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:23:54.534054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e3c1780e-ba82-49b3-a1fd-f3f1ee7b9b13 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:54.551366 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e3c1780e-ba82-49b3-a1fd-f3f1ee7b9b13 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1392 microversion: 2.1 time: 0.934168 Oct 10 23:23:54.553569 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 998/1950] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:53 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1392 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:54.559945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fcf1165f-5043-44ef-a579-2d6cad2e5393 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:54.561725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fcf1165f-5043-44ef-a579-2d6cad2e5393 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:54.580310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fcf1165f-5043-44ef-a579-2d6cad2e5393 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:54.581225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fcf1165f-5043-44ef-a579-2d6cad2e5393 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:54.582134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fcf1165f-5043-44ef-a579-2d6cad2e5393 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:54.583932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fcf1165f-5043-44ef-a579-2d6cad2e5393 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:54.584731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fcf1165f-5043-44ef-a579-2d6cad2e5393 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:54.585763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fcf1165f-5043-44ef-a579-2d6cad2e5393 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:54.988982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-5cd03205-112a-468f-b2bd-26a12ede212f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:23:54.989651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-5cd03205-112a-468f-b2bd-26a12ede212f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:23:54.990318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-5cd03205-112a-468f-b2bd-26a12ede212f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:23:54.993425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-5cd03205-112a-468f-b2bd-26a12ede212f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:23:54.994077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-5cd03205-112a-468f-b2bd-26a12ede212f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:23:55.025646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cd03205-112a-468f-b2bd-26a12ede212f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:55.026544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cd03205-112a-468f-b2bd-26a12ede212f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:55.030770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cd03205-112a-468f-b2bd-26a12ede212f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:55.032359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cd03205-112a-468f-b2bd-26a12ede212f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:55.033211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cd03205-112a-468f-b2bd-26a12ede212f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:55.033943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cd03205-112a-468f-b2bd-26a12ede212f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:55.086648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-5cd03205-112a-468f-b2bd-26a12ede212f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Getting quotas for project 1795ae26f5294bbaa444099b9c261f23. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:23:55.111876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-5cd03205-112a-468f-b2bd-26a12ede212f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Getting quotas for user bd9a7943bb264da19ee753ea3ce7ffce and project 1795ae26f5294bbaa444099b9c261f23. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:23:55.147316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5cd03205-112a-468f-b2bd-26a12ede212f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:23:55.152188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5cd03205-112a-468f-b2bd-26a12ede212f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] [instance: 5e6f2901-8ce0-455d-b905-6e3c34afee0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:23:55.220142 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5cd03205-112a-468f-b2bd-26a12ede212f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.117591 Oct 10 23:23:55.221478 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 953/1951] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:23:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 23:23:55.226586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c80a23f0-68fb-46c5-9e6d-9abdda84de08 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:55.227677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c80a23f0-68fb-46c5-9e6d-9abdda84de08 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:55.236472 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c80a23f0-68fb-46c5-9e6d-9abdda84de08 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:55.237332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c80a23f0-68fb-46c5-9e6d-9abdda84de08 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:55.237998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c80a23f0-68fb-46c5-9e6d-9abdda84de08 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:55.239088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c80a23f0-68fb-46c5-9e6d-9abdda84de08 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:55.239912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c80a23f0-68fb-46c5-9e6d-9abdda84de08 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:55.240554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c80a23f0-68fb-46c5-9e6d-9abdda84de08 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:55.402801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fcf1165f-5043-44ef-a579-2d6cad2e5393 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:55.430329 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fcf1165f-5043-44ef-a579-2d6cad2e5393 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1497 microversion: 2.1 time: 0.872195 Oct 10 23:23:55.430974 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 999/1952] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:54 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1497 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:55.462241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-44798ff0-d75a-42a9-9695-b54235aa959e tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:55.466762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-44798ff0-d75a-42a9-9695-b54235aa959e tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:55.485230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44798ff0-d75a-42a9-9695-b54235aa959e tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:55.486046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44798ff0-d75a-42a9-9695-b54235aa959e tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:55.487375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44798ff0-d75a-42a9-9695-b54235aa959e tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:55.491213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44798ff0-d75a-42a9-9695-b54235aa959e tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:55.491883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44798ff0-d75a-42a9-9695-b54235aa959e tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:55.493975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44798ff0-d75a-42a9-9695-b54235aa959e tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:55.673096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-44798ff0-d75a-42a9-9695-b54235aa959e tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:55.699993 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-44798ff0-d75a-42a9-9695-b54235aa959e tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1927 microversion: 2.75 time: 0.250380 Oct 10 23:23:55.719972 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1000/1953] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:55 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1927 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:55.732610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e79de9e4-713c-466d-92e9-d4c0239337fa tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:55.734036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e79de9e4-713c-466d-92e9-d4c0239337fa tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] [instance: 5e6f2901-8ce0-455d-b905-6e3c34afee0e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:55.886833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c80a23f0-68fb-46c5-9e6d-9abdda84de08 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:55.899026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c80a23f0-68fb-46c5-9e6d-9abdda84de08 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:55.911526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c80a23f0-68fb-46c5-9e6d-9abdda84de08 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:55.913304 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c80a23f0-68fb-46c5-9e6d-9abdda84de08 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1293 microversion: 2.25 time: 0.690651 Oct 10 23:23:55.914085 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 954/1954] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:55 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1293 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:55.919541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c2ef4212-8137-465b-b017-5861cf030b2f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:55.922291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c2ef4212-8137-465b-b017-5861cf030b2f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:55.939629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2ef4212-8137-465b-b017-5861cf030b2f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:55.940424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2ef4212-8137-465b-b017-5861cf030b2f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:55.941024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2ef4212-8137-465b-b017-5861cf030b2f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:55.941919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2ef4212-8137-465b-b017-5861cf030b2f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:55.942554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2ef4212-8137-465b-b017-5861cf030b2f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:55.943138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2ef4212-8137-465b-b017-5861cf030b2f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:56.057517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e79de9e4-713c-466d-92e9-d4c0239337fa tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9a7943bb264da19ee753ea3ce7ffce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1795ae26f5294bbaa444099b9c261f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:56.065329 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e79de9e4-713c-466d-92e9-d4c0239337fa tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] 10.222.0.23 "GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e" status: 200 len: 1223 microversion: 2.1 time: 0.343293 Oct 10 23:23:56.065953 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1001/1955] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:55 2022] GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e => generated 1223 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:56.081808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-2611f808-ce26-4a5c-a912-7ae34305e359 req-6529196e-426e-4a18-a10f-af9e0e4b1964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9431e2e-3fb9-4834-8827-88c1e3762543", "name": "network-vif-unplugged", "status": "completed", "tag": "10aa8c22-3c3a-4a97-83bc-82a7afa75cd5"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:56.107691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2611f808-ce26-4a5c-a912-7ae34305e359 req-6529196e-426e-4a18-a10f-af9e0e4b1964 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:56.110013 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2611f808-ce26-4a5c-a912-7ae34305e359 req-6529196e-426e-4a18-a10f-af9e0e4b1964 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:56.110666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2611f808-ce26-4a5c-a912-7ae34305e359 req-6529196e-426e-4a18-a10f-af9e0e4b1964 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:56.138138 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-2611f808-ce26-4a5c-a912-7ae34305e359 req-6529196e-426e-4a18-a10f-af9e0e4b1964 service nova] Creating event network-vif-unplugged:10aa8c22-3c3a-4a97-83bc-82a7afa75cd5 for instance e9431e2e-3fb9-4834-8827-88c1e3762543 on n-h1-860864-2 Oct 10 23:23:56.151873 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-2611f808-ce26-4a5c-a912-7ae34305e359 req-6529196e-426e-4a18-a10f-af9e0e4b1964 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080882 Oct 10 23:23:56.153083 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1002/1956] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:23:56.402383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c2ef4212-8137-465b-b017-5861cf030b2f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:56.416712 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c2ef4212-8137-465b-b017-5861cf030b2f tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1392 microversion: 2.1 time: 0.501156 Oct 10 23:23:56.423328 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 955/1957] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:55 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1392 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:56.456503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e5427708-99d6-4560-aa0c-b1b4225fe3cc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:56.457267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e5427708-99d6-4560-aa0c-b1b4225fe3cc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:56.471317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5427708-99d6-4560-aa0c-b1b4225fe3cc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:56.471842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5427708-99d6-4560-aa0c-b1b4225fe3cc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:56.472283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5427708-99d6-4560-aa0c-b1b4225fe3cc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:56.473002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5427708-99d6-4560-aa0c-b1b4225fe3cc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:56.473497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5427708-99d6-4560-aa0c-b1b4225fe3cc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:56.473924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5427708-99d6-4560-aa0c-b1b4225fe3cc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:56.736055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-eed86127-d6ba-4e7a-a27c-ae04c6fea1b6 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:56.736678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-eed86127-d6ba-4e7a-a27c-ae04c6fea1b6 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:56.751184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eed86127-d6ba-4e7a-a27c-ae04c6fea1b6 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:56.751777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eed86127-d6ba-4e7a-a27c-ae04c6fea1b6 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:56.752448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eed86127-d6ba-4e7a-a27c-ae04c6fea1b6 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:56.753553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eed86127-d6ba-4e7a-a27c-ae04c6fea1b6 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:56.754188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eed86127-d6ba-4e7a-a27c-ae04c6fea1b6 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:56.756344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eed86127-d6ba-4e7a-a27c-ae04c6fea1b6 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:56.962328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e5427708-99d6-4560-aa0c-b1b4225fe3cc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:56.973064 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e5427708-99d6-4560-aa0c-b1b4225fe3cc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1497 microversion: 2.1 time: 0.521945 Oct 10 23:23:56.974945 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1003/1958] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:56 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1497 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:56.979226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-eed86127-d6ba-4e7a-a27c-ae04c6fea1b6 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:56.995914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-16eea0dc-736b-4082-9437-0e89e4488650 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:56.996871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-16eea0dc-736b-4082-9437-0e89e4488650 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:57.007934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16eea0dc-736b-4082-9437-0e89e4488650 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:57.008674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16eea0dc-736b-4082-9437-0e89e4488650 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:57.010185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16eea0dc-736b-4082-9437-0e89e4488650 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:57.010935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16eea0dc-736b-4082-9437-0e89e4488650 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:57.012251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16eea0dc-736b-4082-9437-0e89e4488650 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:57.013568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16eea0dc-736b-4082-9437-0e89e4488650 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:57.034986 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-eed86127-d6ba-4e7a-a27c-ae04c6fea1b6 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1927 microversion: 2.75 time: 0.301736 Oct 10 23:23:57.049939 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 956/1959] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:56 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1927 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:57.073744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-4cc95273-95a1-44a4-85df-02315617cb4d req-88806aea-48da-44ba-9608-7a9cd9c18c7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a472045-8c28-4437-9e0f-9223369022ae", "tag": "7eabf4d8-5373-4658-bf95-07c701376608"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:57.105907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4cc95273-95a1-44a4-85df-02315617cb4d req-88806aea-48da-44ba-9608-7a9cd9c18c7f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:57.106858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4cc95273-95a1-44a4-85df-02315617cb4d req-88806aea-48da-44ba-9608-7a9cd9c18c7f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:57.107466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4cc95273-95a1-44a4-85df-02315617cb4d req-88806aea-48da-44ba-9608-7a9cd9c18c7f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:57.124871 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-4cc95273-95a1-44a4-85df-02315617cb4d req-88806aea-48da-44ba-9608-7a9cd9c18c7f service nova] Creating event network-changed:7eabf4d8-5373-4658-bf95-07c701376608 for instance 3a472045-8c28-4437-9e0f-9223369022ae on n-h1-860864-2 Oct 10 23:23:57.134191 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-4cc95273-95a1-44a4-85df-02315617cb4d req-88806aea-48da-44ba-9608-7a9cd9c18c7f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072115 Oct 10 23:23:57.143343 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 957/1960] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:23:57.149055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-430b859b-a49c-420c-88ea-ee6d5e5f9cc2 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:57.149908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-430b859b-a49c-420c-88ea-ee6d5e5f9cc2 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] [instance: 5e6f2901-8ce0-455d-b905-6e3c34afee0e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:57.163162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-430b859b-a49c-420c-88ea-ee6d5e5f9cc2 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:57.169593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-430b859b-a49c-420c-88ea-ee6d5e5f9cc2 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:57.170108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-430b859b-a49c-420c-88ea-ee6d5e5f9cc2 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:57.170944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-430b859b-a49c-420c-88ea-ee6d5e5f9cc2 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:57.171569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-430b859b-a49c-420c-88ea-ee6d5e5f9cc2 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:57.171954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-430b859b-a49c-420c-88ea-ee6d5e5f9cc2 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:57.377573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-430b859b-a49c-420c-88ea-ee6d5e5f9cc2 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9a7943bb264da19ee753ea3ce7ffce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1795ae26f5294bbaa444099b9c261f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:57.392019 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-430b859b-a49c-420c-88ea-ee6d5e5f9cc2 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] 10.222.0.23 "GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e" status: 200 len: 1275 microversion: 2.1 time: 0.247276 Oct 10 23:23:57.397490 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 958/1961] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:57 2022] GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e => generated 1275 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:57.450309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c62b1d3d-7655-4d07-a697-cd22e6119b21 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:57.451104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c62b1d3d-7655-4d07-a697-cd22e6119b21 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:57.472611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c62b1d3d-7655-4d07-a697-cd22e6119b21 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:57.474350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c62b1d3d-7655-4d07-a697-cd22e6119b21 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:57.476275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c62b1d3d-7655-4d07-a697-cd22e6119b21 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:57.479815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c62b1d3d-7655-4d07-a697-cd22e6119b21 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:57.480396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c62b1d3d-7655-4d07-a697-cd22e6119b21 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:57.481988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c62b1d3d-7655-4d07-a697-cd22e6119b21 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:57.678305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-16eea0dc-736b-4082-9437-0e89e4488650 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:57.687236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-16eea0dc-736b-4082-9437-0e89e4488650 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:57.689270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-16eea0dc-736b-4082-9437-0e89e4488650 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:57.690701 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-16eea0dc-736b-4082-9437-0e89e4488650 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1293 microversion: 2.25 time: 0.714689 Oct 10 23:23:57.691473 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1004/1962] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:56 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1293 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:57.999375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-024a55cd-6bc1-4fcc-8bad-4059ea055e93 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:58.000154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-024a55cd-6bc1-4fcc-8bad-4059ea055e93 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:58.007600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-024a55cd-6bc1-4fcc-8bad-4059ea055e93 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:58.008355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-024a55cd-6bc1-4fcc-8bad-4059ea055e93 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:58.008977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-024a55cd-6bc1-4fcc-8bad-4059ea055e93 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:58.009864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-024a55cd-6bc1-4fcc-8bad-4059ea055e93 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:58.010473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-024a55cd-6bc1-4fcc-8bad-4059ea055e93 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:58.011108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-024a55cd-6bc1-4fcc-8bad-4059ea055e93 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:58.288027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c62b1d3d-7655-4d07-a697-cd22e6119b21 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:58.300038 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c62b1d3d-7655-4d07-a697-cd22e6119b21 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1392 microversion: 2.1 time: 0.855409 Oct 10 23:23:58.301596 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 959/1963] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:57 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1392 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:58.321551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bc77b158-83cd-4d8f-b9b0-3de5b55af28e tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:58.322991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bc77b158-83cd-4d8f-b9b0-3de5b55af28e tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:58.340228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc77b158-83cd-4d8f-b9b0-3de5b55af28e tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:58.342818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc77b158-83cd-4d8f-b9b0-3de5b55af28e tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:58.344366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc77b158-83cd-4d8f-b9b0-3de5b55af28e tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:58.346834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc77b158-83cd-4d8f-b9b0-3de5b55af28e tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:58.347980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc77b158-83cd-4d8f-b9b0-3de5b55af28e tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:58.349865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc77b158-83cd-4d8f-b9b0-3de5b55af28e tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:58.357024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:58.379511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=8 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:23:58.492508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-024a55cd-6bc1-4fcc-8bad-4059ea055e93 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:58.505216 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-024a55cd-6bc1-4fcc-8bad-4059ea055e93 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1497 microversion: 2.1 time: 0.509883 Oct 10 23:23:58.524856 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1005/1964] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:57 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1497 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:58.539011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-12db0e35-38aa-4bd8-b225-a04ec45f70c6 req-0488a87c-c563-4975-b43c-e06ef0f79df5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9431e2e-3fb9-4834-8827-88c1e3762543", "tag": "10aa8c22-3c3a-4a97-83bc-82a7afa75cd5"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:23:58.553141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-bc77b158-83cd-4d8f-b9b0-3de5b55af28e tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:23:58.567380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-12db0e35-38aa-4bd8-b225-a04ec45f70c6 req-0488a87c-c563-4975-b43c-e06ef0f79df5 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:58.568526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-12db0e35-38aa-4bd8-b225-a04ec45f70c6 req-0488a87c-c563-4975-b43c-e06ef0f79df5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:58.569151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-12db0e35-38aa-4bd8-b225-a04ec45f70c6 req-0488a87c-c563-4975-b43c-e06ef0f79df5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:58.586728 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-12db0e35-38aa-4bd8-b225-a04ec45f70c6 req-0488a87c-c563-4975-b43c-e06ef0f79df5 service nova] Creating event network-changed:10aa8c22-3c3a-4a97-83bc-82a7afa75cd5 for instance e9431e2e-3fb9-4834-8827-88c1e3762543 on n-h1-860864-2 Oct 10 23:23:58.595780 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-12db0e35-38aa-4bd8-b225-a04ec45f70c6 req-0488a87c-c563-4975-b43c-e06ef0f79df5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068488 Oct 10 23:23:58.598091 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bc77b158-83cd-4d8f-b9b0-3de5b55af28e tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1927 microversion: 2.75 time: 0.293235 Oct 10 23:23:58.598642 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 960/1965] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:58 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1927 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:23:58.599549 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1006/1966] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:23:58.626316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5c35588c-a86b-4f67-8822-b129f6b3d8cc tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:58.626942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5c35588c-a86b-4f67-8822-b129f6b3d8cc tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] [instance: 5e6f2901-8ce0-455d-b905-6e3c34afee0e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:58.635490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c35588c-a86b-4f67-8822-b129f6b3d8cc tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:58.636716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c35588c-a86b-4f67-8822-b129f6b3d8cc tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:58.637785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c35588c-a86b-4f67-8822-b129f6b3d8cc tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:58.639338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c35588c-a86b-4f67-8822-b129f6b3d8cc tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:58.640384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c35588c-a86b-4f67-8822-b129f6b3d8cc tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:58.641510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c35588c-a86b-4f67-8822-b129f6b3d8cc tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:58.719039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-acf3f5b6-dfeb-43dd-8f96-0a4df06b7904 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:58.720093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-acf3f5b6-dfeb-43dd-8f96-0a4df06b7904 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:58.726846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf3f5b6-dfeb-43dd-8f96-0a4df06b7904 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:58.727524 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf3f5b6-dfeb-43dd-8f96-0a4df06b7904 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:58.728270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf3f5b6-dfeb-43dd-8f96-0a4df06b7904 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:58.729860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf3f5b6-dfeb-43dd-8f96-0a4df06b7904 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:58.730679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf3f5b6-dfeb-43dd-8f96-0a4df06b7904 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:58.731390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf3f5b6-dfeb-43dd-8f96-0a4df06b7904 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:58.795010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5c35588c-a86b-4f67-8822-b129f6b3d8cc tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9a7943bb264da19ee753ea3ce7ffce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1795ae26f5294bbaa444099b9c261f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:58.813141 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5c35588c-a86b-4f67-8822-b129f6b3d8cc tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] 10.222.0.23 "GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e" status: 200 len: 1281 microversion: 2.1 time: 0.197575 Oct 10 23:23:58.817331 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 961/1967] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:58 2022] GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e => generated 1281 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:23:59.328289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a8fc9729-ee36-4fb1-9c4e-64db2c29bb08 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:59.329169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a8fc9729-ee36-4fb1-9c4e-64db2c29bb08 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:59.340149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8fc9729-ee36-4fb1-9c4e-64db2c29bb08 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:59.343640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8fc9729-ee36-4fb1-9c4e-64db2c29bb08 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:59.348946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8fc9729-ee36-4fb1-9c4e-64db2c29bb08 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:59.351938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8fc9729-ee36-4fb1-9c4e-64db2c29bb08 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:59.352700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8fc9729-ee36-4fb1-9c4e-64db2c29bb08 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:59.353484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8fc9729-ee36-4fb1-9c4e-64db2c29bb08 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:59.546358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-acf3f5b6-dfeb-43dd-8f96-0a4df06b7904 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:59.559175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-acf3f5b6-dfeb-43dd-8f96-0a4df06b7904 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:59.567796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-acf3f5b6-dfeb-43dd-8f96-0a4df06b7904 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:59.569460 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-acf3f5b6-dfeb-43dd-8f96-0a4df06b7904 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1293 microversion: 2.25 time: 0.855624 Oct 10 23:23:59.573706 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1007/1968] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:58 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1293 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:23:59.579100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7bd751f8-6adc-4055-9cac-6fe44287de04 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:59.584567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7bd751f8-6adc-4055-9cac-6fe44287de04 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:59.606980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bd751f8-6adc-4055-9cac-6fe44287de04 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:59.607519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bd751f8-6adc-4055-9cac-6fe44287de04 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:59.608021 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bd751f8-6adc-4055-9cac-6fe44287de04 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:59.609551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bd751f8-6adc-4055-9cac-6fe44287de04 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:59.609918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bd751f8-6adc-4055-9cac-6fe44287de04 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:59.610401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bd751f8-6adc-4055-9cac-6fe44287de04 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:59.759624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a8fc9729-ee36-4fb1-9c4e-64db2c29bb08 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:23:59.787349 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a8fc9729-ee36-4fb1-9c4e-64db2c29bb08 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1392 microversion: 2.1 time: 0.464731 Oct 10 23:23:59.795800 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 962/1969] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:59 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1392 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:23:59.806778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e3ca89b7-cba4-483d-a262-85d79ee15814 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:23:59.807827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e3ca89b7-cba4-483d-a262-85d79ee15814 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:23:59.825297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3ca89b7-cba4-483d-a262-85d79ee15814 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:59.825962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3ca89b7-cba4-483d-a262-85d79ee15814 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:59.826489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3ca89b7-cba4-483d-a262-85d79ee15814 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:23:59.828575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3ca89b7-cba4-483d-a262-85d79ee15814 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:23:59.829106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3ca89b7-cba4-483d-a262-85d79ee15814 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:23:59.829602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3ca89b7-cba4-483d-a262-85d79ee15814 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:00.058854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-e3ca89b7-cba4-483d-a262-85d79ee15814 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:24:00.094650 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e3ca89b7-cba4-483d-a262-85d79ee15814 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1927 microversion: 2.75 time: 0.297571 Oct 10 23:24:00.109941 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 963/1970] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:23:59 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1927 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:00.122743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9cc0aecd-81ba-439e-99e0-a3bf5eab18bf tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:00.124766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9cc0aecd-81ba-439e-99e0-a3bf5eab18bf tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] [instance: 5e6f2901-8ce0-455d-b905-6e3c34afee0e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:00.132034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cc0aecd-81ba-439e-99e0-a3bf5eab18bf tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:00.133043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cc0aecd-81ba-439e-99e0-a3bf5eab18bf tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:00.133921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cc0aecd-81ba-439e-99e0-a3bf5eab18bf tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:00.134946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cc0aecd-81ba-439e-99e0-a3bf5eab18bf tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:00.135899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cc0aecd-81ba-439e-99e0-a3bf5eab18bf tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:00.136766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cc0aecd-81ba-439e-99e0-a3bf5eab18bf tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:00.190516 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7bd751f8-6adc-4055-9cac-6fe44287de04 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:00.201153 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7bd751f8-6adc-4055-9cac-6fe44287de04 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1497 microversion: 2.1 time: 0.626073 Oct 10 23:24:00.202352 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1008/1971] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:23:59 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1497 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:00.249055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9cc0aecd-81ba-439e-99e0-a3bf5eab18bf tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9a7943bb264da19ee753ea3ce7ffce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1795ae26f5294bbaa444099b9c261f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:00.281137 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9cc0aecd-81ba-439e-99e0-a3bf5eab18bf tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] 10.222.0.23 "GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e" status: 200 len: 1281 microversion: 2.1 time: 0.168655 Oct 10 23:24:00.286090 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 964/1972] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:00 2022] GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e => generated 1281 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:00.603675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-606d4196-99e1-4ff4-8759-92d3bf7a4a70 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:00.604501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-606d4196-99e1-4ff4-8759-92d3bf7a4a70 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:00.633155 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-606d4196-99e1-4ff4-8759-92d3bf7a4a70 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:00.634200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-606d4196-99e1-4ff4-8759-92d3bf7a4a70 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:00.635372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-606d4196-99e1-4ff4-8759-92d3bf7a4a70 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:00.637974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-606d4196-99e1-4ff4-8759-92d3bf7a4a70 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:00.644038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-606d4196-99e1-4ff4-8759-92d3bf7a4a70 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:00.647756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-606d4196-99e1-4ff4-8759-92d3bf7a4a70 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:00.735969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:00.817782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d6724174-95cc-4783-bf64-c78688d5e343 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:00.818410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d6724174-95cc-4783-bf64-c78688d5e343 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:00.826584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6724174-95cc-4783-bf64-c78688d5e343 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:00.827960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6724174-95cc-4783-bf64-c78688d5e343 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:00.828589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6724174-95cc-4783-bf64-c78688d5e343 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:00.829536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6724174-95cc-4783-bf64-c78688d5e343 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:00.830232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6724174-95cc-4783-bf64-c78688d5e343 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:00.830832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6724174-95cc-4783-bf64-c78688d5e343 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:00.979376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-606d4196-99e1-4ff4-8759-92d3bf7a4a70 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:00.994369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-606d4196-99e1-4ff4-8759-92d3bf7a4a70 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:01.003066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-606d4196-99e1-4ff4-8759-92d3bf7a4a70 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:01.004234 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-606d4196-99e1-4ff4-8759-92d3bf7a4a70 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1293 microversion: 2.25 time: 0.405260 Oct 10 23:24:01.005229 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1009/1973] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:00 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1293 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:24:01.129496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3490f3c8-34e7-437b-ae94-580147dd61be tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:01.130303 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3490f3c8-34e7-437b-ae94-580147dd61be tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:01.146413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3490f3c8-34e7-437b-ae94-580147dd61be tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:01.147185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3490f3c8-34e7-437b-ae94-580147dd61be tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:01.149546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3490f3c8-34e7-437b-ae94-580147dd61be tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:01.150610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3490f3c8-34e7-437b-ae94-580147dd61be tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:01.157809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3490f3c8-34e7-437b-ae94-580147dd61be tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:01.158758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3490f3c8-34e7-437b-ae94-580147dd61be tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:01.309279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-3490f3c8-34e7-437b-ae94-580147dd61be tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:24:01.335449 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3490f3c8-34e7-437b-ae94-580147dd61be tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1945 microversion: 2.75 time: 0.210464 Oct 10 23:24:01.336398 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1010/1974] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:01 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1945 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:24:01.342399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6df35b01-1fea-4b2e-9c22-7eb94fbbc50a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:01.343461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6df35b01-1fea-4b2e-9c22-7eb94fbbc50a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:01.345478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:01.355926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6df35b01-1fea-4b2e-9c22-7eb94fbbc50a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:01.357629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6df35b01-1fea-4b2e-9c22-7eb94fbbc50a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:01.358888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6df35b01-1fea-4b2e-9c22-7eb94fbbc50a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:01.360613 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6df35b01-1fea-4b2e-9c22-7eb94fbbc50a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:01.361312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6df35b01-1fea-4b2e-9c22-7eb94fbbc50a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:01.361996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6df35b01-1fea-4b2e-9c22-7eb94fbbc50a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:01.390156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d6724174-95cc-4783-bf64-c78688d5e343 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:01.405283 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d6724174-95cc-4783-bf64-c78688d5e343 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1392 microversion: 2.1 time: 0.593580 Oct 10 23:24:01.406139 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 965/1975] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:00 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1392 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:01.424156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c9bdc81c-d97b-4803-94c5-e98484542d9b tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:01.424915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c9bdc81c-d97b-4803-94c5-e98484542d9b tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] [instance: 5e6f2901-8ce0-455d-b905-6e3c34afee0e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:01.436155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9bdc81c-d97b-4803-94c5-e98484542d9b tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:01.438519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9bdc81c-d97b-4803-94c5-e98484542d9b tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:01.439034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9bdc81c-d97b-4803-94c5-e98484542d9b tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:01.441705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9bdc81c-d97b-4803-94c5-e98484542d9b tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:01.442639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9bdc81c-d97b-4803-94c5-e98484542d9b tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:01.443354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9bdc81c-d97b-4803-94c5-e98484542d9b tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:01.582002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6df35b01-1fea-4b2e-9c22-7eb94fbbc50a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:01.592140 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6df35b01-1fea-4b2e-9c22-7eb94fbbc50a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1497 microversion: 2.1 time: 0.253704 Oct 10 23:24:01.593422 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1011/1976] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:01 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1497 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:01.760277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c9bdc81c-d97b-4803-94c5-e98484542d9b tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9a7943bb264da19ee753ea3ce7ffce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1795ae26f5294bbaa444099b9c261f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:01.772608 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c9bdc81c-d97b-4803-94c5-e98484542d9b tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] 10.222.0.23 "GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e" status: 200 len: 1323 microversion: 2.1 time: 0.365345 Oct 10 23:24:01.786540 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 966/1977] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:01 2022] GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e => generated 1323 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:02.037119 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f19e45c6-e998-481e-b819-69e3f9028c34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:02.038293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f19e45c6-e998-481e-b819-69e3f9028c34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:02.060045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f19e45c6-e998-481e-b819-69e3f9028c34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:02.060728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f19e45c6-e998-481e-b819-69e3f9028c34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:02.063049 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f19e45c6-e998-481e-b819-69e3f9028c34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:02.064956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f19e45c6-e998-481e-b819-69e3f9028c34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:02.066811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f19e45c6-e998-481e-b819-69e3f9028c34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:02.067472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f19e45c6-e998-481e-b819-69e3f9028c34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:02.263491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-6bd83a66-7e71-46bb-acf4-80bdf4c6694e req-86909e9a-445d-4c67-877e-d5ca27e8e65b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e6f2901-8ce0-455d-b905-6e3c34afee0e", "tag": "5263ca2b-f1fc-41b2-ac18-ab1425e63332"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:02.276583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6bd83a66-7e71-46bb-acf4-80bdf4c6694e req-86909e9a-445d-4c67-877e-d5ca27e8e65b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:02.277736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6bd83a66-7e71-46bb-acf4-80bdf4c6694e req-86909e9a-445d-4c67-877e-d5ca27e8e65b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:02.278377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6bd83a66-7e71-46bb-acf4-80bdf4c6694e req-86909e9a-445d-4c67-877e-d5ca27e8e65b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:02.293721 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-6bd83a66-7e71-46bb-acf4-80bdf4c6694e req-86909e9a-445d-4c67-877e-d5ca27e8e65b service nova] Creating event network-changed:5263ca2b-f1fc-41b2-ac18-ab1425e63332 for instance 5e6f2901-8ce0-455d-b905-6e3c34afee0e on n-h2-860864-2 Oct 10 23:24:02.302140 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-6bd83a66-7e71-46bb-acf4-80bdf4c6694e req-86909e9a-445d-4c67-877e-d5ca27e8e65b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044657 Oct 10 23:24:02.303554 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 967/1978] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:24:02.373231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-83dd542b-076d-4435-9356-1dcd1709b48d tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:02.374756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-83dd542b-076d-4435-9356-1dcd1709b48d tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:02.383197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83dd542b-076d-4435-9356-1dcd1709b48d tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:02.384401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83dd542b-076d-4435-9356-1dcd1709b48d tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:02.385082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83dd542b-076d-4435-9356-1dcd1709b48d tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:02.386042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83dd542b-076d-4435-9356-1dcd1709b48d tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:02.386719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83dd542b-076d-4435-9356-1dcd1709b48d tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:02.387858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83dd542b-076d-4435-9356-1dcd1709b48d tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:02.460767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f19e45c6-e998-481e-b819-69e3f9028c34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:02.470430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f19e45c6-e998-481e-b819-69e3f9028c34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:02.474446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f19e45c6-e998-481e-b819-69e3f9028c34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:02.483265 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f19e45c6-e998-481e-b819-69e3f9028c34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1293 microversion: 2.25 time: 0.453078 Oct 10 23:24:02.492439 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1012/1979] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:02 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1293 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:02.500046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a80ad0d7-a443-4d72-9928-4e5c78a1feb1 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:02.500678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a80ad0d7-a443-4d72-9928-4e5c78a1feb1 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:02.515948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a80ad0d7-a443-4d72-9928-4e5c78a1feb1 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:02.516451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a80ad0d7-a443-4d72-9928-4e5c78a1feb1 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:02.516889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a80ad0d7-a443-4d72-9928-4e5c78a1feb1 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:02.517641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a80ad0d7-a443-4d72-9928-4e5c78a1feb1 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:02.518095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a80ad0d7-a443-4d72-9928-4e5c78a1feb1 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:02.518517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a80ad0d7-a443-4d72-9928-4e5c78a1feb1 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:02.617319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-83dd542b-076d-4435-9356-1dcd1709b48d tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:24:02.653176 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-83dd542b-076d-4435-9356-1dcd1709b48d tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1933 microversion: 2.75 time: 0.285459 Oct 10 23:24:02.698342 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 968/1980] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:02 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1933 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:24:02.709571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f1b02904-8322-488a-b909-80e9c7ace365 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:02.720054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f1b02904-8322-488a-b909-80e9c7ace365 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:02.727743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1b02904-8322-488a-b909-80e9c7ace365 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:02.728726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1b02904-8322-488a-b909-80e9c7ace365 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:02.729569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1b02904-8322-488a-b909-80e9c7ace365 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:02.730706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1b02904-8322-488a-b909-80e9c7ace365 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:02.732110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1b02904-8322-488a-b909-80e9c7ace365 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:02.732938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1b02904-8322-488a-b909-80e9c7ace365 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:02.826258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a80ad0d7-a443-4d72-9928-4e5c78a1feb1 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:02.839435 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a80ad0d7-a443-4d72-9928-4e5c78a1feb1 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1392 microversion: 2.1 time: 0.343692 Oct 10 23:24:02.840516 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1013/1981] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:02 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1392 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:02.848439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1bd657ac-144b-4a66-bed8-ffdd872af24f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:02.849365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1bd657ac-144b-4a66-bed8-ffdd872af24f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] [instance: 5e6f2901-8ce0-455d-b905-6e3c34afee0e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:02.857535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bd657ac-144b-4a66-bed8-ffdd872af24f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:02.859119 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bd657ac-144b-4a66-bed8-ffdd872af24f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:02.859832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bd657ac-144b-4a66-bed8-ffdd872af24f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:02.860747 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bd657ac-144b-4a66-bed8-ffdd872af24f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:02.861449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bd657ac-144b-4a66-bed8-ffdd872af24f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:02.862054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bd657ac-144b-4a66-bed8-ffdd872af24f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:03.120774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1bd657ac-144b-4a66-bed8-ffdd872af24f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9a7943bb264da19ee753ea3ce7ffce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1795ae26f5294bbaa444099b9c261f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:03.130602 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1bd657ac-144b-4a66-bed8-ffdd872af24f tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] 10.222.0.23 "GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e" status: 200 len: 1323 microversion: 2.1 time: 0.288884 Oct 10 23:24:03.142601 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1014/1982] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:02 2022] GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e => generated 1323 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:03.179607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f1b02904-8322-488a-b909-80e9c7ace365 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:03.194034 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f1b02904-8322-488a-b909-80e9c7ace365 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1497 microversion: 2.1 time: 0.493091 Oct 10 23:24:03.213344 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 969/1983] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:02 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1497 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:03.518799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6fcf3efd-87e8-4a66-8eee-4ee09b888c48 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:03.519412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6fcf3efd-87e8-4a66-8eee-4ee09b888c48 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:03.535635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6fcf3efd-87e8-4a66-8eee-4ee09b888c48 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:03.536971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6fcf3efd-87e8-4a66-8eee-4ee09b888c48 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:03.538048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6fcf3efd-87e8-4a66-8eee-4ee09b888c48 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:03.539480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6fcf3efd-87e8-4a66-8eee-4ee09b888c48 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:03.540278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6fcf3efd-87e8-4a66-8eee-4ee09b888c48 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:03.540917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6fcf3efd-87e8-4a66-8eee-4ee09b888c48 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:03.685650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4a5336c5-d309-453c-bfd2-49048c339a34 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:03.686490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4a5336c5-d309-453c-bfd2-49048c339a34 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:03.695502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a5336c5-d309-453c-bfd2-49048c339a34 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:03.696394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a5336c5-d309-453c-bfd2-49048c339a34 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:03.697076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a5336c5-d309-453c-bfd2-49048c339a34 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:03.698067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a5336c5-d309-453c-bfd2-49048c339a34 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:03.698754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a5336c5-d309-453c-bfd2-49048c339a34 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:03.699414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a5336c5-d309-453c-bfd2-49048c339a34 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:03.820352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-4a5336c5-d309-453c-bfd2-49048c339a34 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:24:03.862852 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4a5336c5-d309-453c-bfd2-49048c339a34 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1933 microversion: 2.75 time: 0.181930 Oct 10 23:24:03.865890 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 970/1984] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:03 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1933 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:24:03.877919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5ce76a62-5b2e-4123-91fa-6d99919dbcb8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:03.883455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5ce76a62-5b2e-4123-91fa-6d99919dbcb8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:03.894474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ce76a62-5b2e-4123-91fa-6d99919dbcb8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:03.901334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ce76a62-5b2e-4123-91fa-6d99919dbcb8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:03.902108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ce76a62-5b2e-4123-91fa-6d99919dbcb8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:03.903018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ce76a62-5b2e-4123-91fa-6d99919dbcb8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:03.903667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ce76a62-5b2e-4123-91fa-6d99919dbcb8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:03.904284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ce76a62-5b2e-4123-91fa-6d99919dbcb8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:04.141684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5ce76a62-5b2e-4123-91fa-6d99919dbcb8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:04.159482 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5ce76a62-5b2e-4123-91fa-6d99919dbcb8 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1392 microversion: 2.1 time: 0.292122 Oct 10 23:24:04.160092 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 971/1985] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:03 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1392 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:04.165234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b9ab1695-8e95-4006-94df-90de3a72efd9 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:04.165900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b9ab1695-8e95-4006-94df-90de3a72efd9 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] [instance: 5e6f2901-8ce0-455d-b905-6e3c34afee0e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:04.178795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9ab1695-8e95-4006-94df-90de3a72efd9 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:04.178795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9ab1695-8e95-4006-94df-90de3a72efd9 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:04.179091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9ab1695-8e95-4006-94df-90de3a72efd9 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:04.179710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9ab1695-8e95-4006-94df-90de3a72efd9 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:04.180170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9ab1695-8e95-4006-94df-90de3a72efd9 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:04.180602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9ab1695-8e95-4006-94df-90de3a72efd9 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:04.196337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6fcf3efd-87e8-4a66-8eee-4ee09b888c48 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:04.217970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6fcf3efd-87e8-4a66-8eee-4ee09b888c48 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:04.220100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6fcf3efd-87e8-4a66-8eee-4ee09b888c48 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:04.221629 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6fcf3efd-87e8-4a66-8eee-4ee09b888c48 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1293 microversion: 2.25 time: 0.707564 Oct 10 23:24:04.223964 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1015/1986] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:03 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1293 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:04.229852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-87d0d4f6-ede0-46dd-8552-9671b4961c97 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:04.230671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-87d0d4f6-ede0-46dd-8552-9671b4961c97 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:04.237674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87d0d4f6-ede0-46dd-8552-9671b4961c97 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:04.239186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87d0d4f6-ede0-46dd-8552-9671b4961c97 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:04.239864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87d0d4f6-ede0-46dd-8552-9671b4961c97 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:04.241115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87d0d4f6-ede0-46dd-8552-9671b4961c97 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:04.241812 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87d0d4f6-ede0-46dd-8552-9671b4961c97 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:04.242408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87d0d4f6-ede0-46dd-8552-9671b4961c97 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:04.406031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b9ab1695-8e95-4006-94df-90de3a72efd9 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9a7943bb264da19ee753ea3ce7ffce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1795ae26f5294bbaa444099b9c261f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:04.416943 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b9ab1695-8e95-4006-94df-90de3a72efd9 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] 10.222.0.23 "GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e" status: 200 len: 1323 microversion: 2.1 time: 0.255458 Oct 10 23:24:04.418327 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 972/1987] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:04 2022] GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e => generated 1323 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:04.542986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-87d0d4f6-ede0-46dd-8552-9671b4961c97 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:04.556053 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-87d0d4f6-ede0-46dd-8552-9671b4961c97 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1497 microversion: 2.1 time: 0.330680 Oct 10 23:24:04.558232 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1016/1988] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:04 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1497 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:04.898128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ddc44c63-d696-4b53-b2e2-c65a96291fe2 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:04.899408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ddc44c63-d696-4b53-b2e2-c65a96291fe2 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:04.912837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddc44c63-d696-4b53-b2e2-c65a96291fe2 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:04.913718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddc44c63-d696-4b53-b2e2-c65a96291fe2 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:04.914503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddc44c63-d696-4b53-b2e2-c65a96291fe2 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:04.915588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddc44c63-d696-4b53-b2e2-c65a96291fe2 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:04.916276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddc44c63-d696-4b53-b2e2-c65a96291fe2 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:04.917145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddc44c63-d696-4b53-b2e2-c65a96291fe2 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:05.055516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:05.058990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-ddc44c63-d696-4b53-b2e2-c65a96291fe2 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] Lazy-loading 'services' on Instance uuid 37e535e7-b049-463e-8f53-7fa3f05457a1 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:24:05.102889 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ddc44c63-d696-4b53-b2e2-c65a96291fe2 tempest-ServersAdmin275Test-1518994900 tempest-ServersAdmin275Test-1518994900-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1918 microversion: 2.75 time: 0.211342 Oct 10 23:24:05.121556 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 973/1989] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:04 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1918 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:05.147722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-68d73fc7-39aa-4be0-b020-87bdd4e79c83 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:05.148553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-68d73fc7-39aa-4be0-b020-87bdd4e79c83 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:05.159178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68d73fc7-39aa-4be0-b020-87bdd4e79c83 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:05.160408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68d73fc7-39aa-4be0-b020-87bdd4e79c83 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:05.161020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68d73fc7-39aa-4be0-b020-87bdd4e79c83 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:05.162031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68d73fc7-39aa-4be0-b020-87bdd4e79c83 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:05.162998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68d73fc7-39aa-4be0-b020-87bdd4e79c83 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:05.166106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68d73fc7-39aa-4be0-b020-87bdd4e79c83 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:05.189478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9298241a-d25f-4ccb-b71a-ddfdcfa2cc01 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:05.190115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9298241a-d25f-4ccb-b71a-ddfdcfa2cc01 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:05.201836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:05.206510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:05.207856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-68d73fc7-39aa-4be0-b020-87bdd4e79c83 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:24:05.210909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9298241a-d25f-4ccb-b71a-ddfdcfa2cc01 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:05.211437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9298241a-d25f-4ccb-b71a-ddfdcfa2cc01 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:05.213405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9298241a-d25f-4ccb-b71a-ddfdcfa2cc01 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:05.216386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9298241a-d25f-4ccb-b71a-ddfdcfa2cc01 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:05.219681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9298241a-d25f-4ccb-b71a-ddfdcfa2cc01 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:05.221239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9298241a-d25f-4ccb-b71a-ddfdcfa2cc01 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:05.379458 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-68d73fc7-39aa-4be0-b020-87bdd4e79c83 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "DELETE /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 204 len: 0 microversion: 2.75 time: 0.234569 Oct 10 23:24:05.381422 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1017/1990] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:24:05 2022] DELETE /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:24:05.394292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-87fbd8d0-db23-45c9-ab9f-a16d081ea4ae tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:05.395795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-87fbd8d0-db23-45c9-ab9f-a16d081ea4ae tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:05.402868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87fbd8d0-db23-45c9-ab9f-a16d081ea4ae tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:05.406395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87fbd8d0-db23-45c9-ab9f-a16d081ea4ae tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:05.408517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87fbd8d0-db23-45c9-ab9f-a16d081ea4ae tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:05.409710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87fbd8d0-db23-45c9-ab9f-a16d081ea4ae tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:05.410425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87fbd8d0-db23-45c9-ab9f-a16d081ea4ae tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:05.411185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87fbd8d0-db23-45c9-ab9f-a16d081ea4ae tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:05.968102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-87fbd8d0-db23-45c9-ab9f-a16d081ea4ae tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:05.978490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-87fbd8d0-db23-45c9-ab9f-a16d081ea4ae tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:05.980358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-87fbd8d0-db23-45c9-ab9f-a16d081ea4ae tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:05.982519 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-87fbd8d0-db23-45c9-ab9f-a16d081ea4ae tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1281 microversion: 2.25 time: 0.599653 Oct 10 23:24:06.004235 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1018/1991] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:05 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1281 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:06.011758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ba3bf349-93b1-4c50-a86a-cb56f1ffee06 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:06.012687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ba3bf349-93b1-4c50-a86a-cb56f1ffee06 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:06.053629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba3bf349-93b1-4c50-a86a-cb56f1ffee06 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:06.054517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba3bf349-93b1-4c50-a86a-cb56f1ffee06 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:06.055270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba3bf349-93b1-4c50-a86a-cb56f1ffee06 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:06.056462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba3bf349-93b1-4c50-a86a-cb56f1ffee06 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:06.057198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba3bf349-93b1-4c50-a86a-cb56f1ffee06 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:06.058114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba3bf349-93b1-4c50-a86a-cb56f1ffee06 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:06.058886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9298241a-d25f-4ccb-b71a-ddfdcfa2cc01 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:06.065281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=12 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:06.070403 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9298241a-d25f-4ccb-b71a-ddfdcfa2cc01 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1392 microversion: 2.1 time: 0.890123 Oct 10 23:24:06.070996 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 974/1992] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:05 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1392 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:24:06.080886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d8554c12-8f80-4e29-98be-1b5d704dcb93 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:06.081635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d8554c12-8f80-4e29-98be-1b5d704dcb93 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] [instance: 5e6f2901-8ce0-455d-b905-6e3c34afee0e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:06.089156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8554c12-8f80-4e29-98be-1b5d704dcb93 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:06.090016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8554c12-8f80-4e29-98be-1b5d704dcb93 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:06.090715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8554c12-8f80-4e29-98be-1b5d704dcb93 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:06.091864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8554c12-8f80-4e29-98be-1b5d704dcb93 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:06.093155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8554c12-8f80-4e29-98be-1b5d704dcb93 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:06.094273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8554c12-8f80-4e29-98be-1b5d704dcb93 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:06.175940 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ba3bf349-93b1-4c50-a86a-cb56f1ffee06 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:06.188057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ba3bf349-93b1-4c50-a86a-cb56f1ffee06 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:06.189820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ba3bf349-93b1-4c50-a86a-cb56f1ffee06 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:06.195737 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ba3bf349-93b1-4c50-a86a-cb56f1ffee06 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1443 microversion: 2.75 time: 0.189905 Oct 10 23:24:06.215630 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1019/1993] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:06 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1443 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:06.221477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-28b50f41-6379-401e-b339-c657d55a9c69 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:06.222339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-28b50f41-6379-401e-b339-c657d55a9c69 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:06.233528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28b50f41-6379-401e-b339-c657d55a9c69 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:06.234549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28b50f41-6379-401e-b339-c657d55a9c69 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:06.234999 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28b50f41-6379-401e-b339-c657d55a9c69 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:06.235720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28b50f41-6379-401e-b339-c657d55a9c69 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:06.236167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28b50f41-6379-401e-b339-c657d55a9c69 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:06.240267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28b50f41-6379-401e-b339-c657d55a9c69 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:06.340082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d8554c12-8f80-4e29-98be-1b5d704dcb93 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9a7943bb264da19ee753ea3ce7ffce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1795ae26f5294bbaa444099b9c261f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:06.344812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:06.349931 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d8554c12-8f80-4e29-98be-1b5d704dcb93 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] 10.222.0.23 "GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e" status: 200 len: 1323 microversion: 2.1 time: 0.273267 Oct 10 23:24:06.350897 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 975/1994] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:06 2022] GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e => generated 1323 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:06.486015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-28b50f41-6379-401e-b339-c657d55a9c69 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:06.495831 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-28b50f41-6379-401e-b339-c657d55a9c69 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1497 microversion: 2.1 time: 0.278368 Oct 10 23:24:06.497304 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1020/1995] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:06 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1497 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:07.014638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-04896e4a-7b23-4a32-bb88-5b3bf1f321f9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:07.016064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-04896e4a-7b23-4a32-bb88-5b3bf1f321f9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:07.036506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04896e4a-7b23-4a32-bb88-5b3bf1f321f9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:07.037266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04896e4a-7b23-4a32-bb88-5b3bf1f321f9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:07.052406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04896e4a-7b23-4a32-bb88-5b3bf1f321f9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:07.053781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04896e4a-7b23-4a32-bb88-5b3bf1f321f9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:07.056996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04896e4a-7b23-4a32-bb88-5b3bf1f321f9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:07.058398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04896e4a-7b23-4a32-bb88-5b3bf1f321f9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:07.095720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-938621b8-a258-4e34-9bdf-256609ab631e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:07.096340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-938621b8-a258-4e34-9bdf-256609ab631e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:07.118140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-938621b8-a258-4e34-9bdf-256609ab631e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:07.118680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-938621b8-a258-4e34-9bdf-256609ab631e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:07.142102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-938621b8-a258-4e34-9bdf-256609ab631e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:07.143149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-938621b8-a258-4e34-9bdf-256609ab631e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:07.150877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-938621b8-a258-4e34-9bdf-256609ab631e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:07.158748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-938621b8-a258-4e34-9bdf-256609ab631e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:07.379646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-04896e4a-7b23-4a32-bb88-5b3bf1f321f9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:07.392961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-04896e4a-7b23-4a32-bb88-5b3bf1f321f9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:07.394946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-04896e4a-7b23-4a32-bb88-5b3bf1f321f9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:07.401942 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-04896e4a-7b23-4a32-bb88-5b3bf1f321f9 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1281 microversion: 2.25 time: 0.393293 Oct 10 23:24:07.403337 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 976/1996] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:07 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1281 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:07.417642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-223a831f-a5ab-49e0-b6a3-14efe39b82f6 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:07.418348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-223a831f-a5ab-49e0-b6a3-14efe39b82f6 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:07.430945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-223a831f-a5ab-49e0-b6a3-14efe39b82f6 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:07.431451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-223a831f-a5ab-49e0-b6a3-14efe39b82f6 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:07.431900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-223a831f-a5ab-49e0-b6a3-14efe39b82f6 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:07.432647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-223a831f-a5ab-49e0-b6a3-14efe39b82f6 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:07.438382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-223a831f-a5ab-49e0-b6a3-14efe39b82f6 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:07.438866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-223a831f-a5ab-49e0-b6a3-14efe39b82f6 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:07.586804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-223a831f-a5ab-49e0-b6a3-14efe39b82f6 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:07.596590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-938621b8-a258-4e34-9bdf-256609ab631e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:07.606250 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-938621b8-a258-4e34-9bdf-256609ab631e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1392 microversion: 2.1 time: 0.515430 Oct 10 23:24:07.618647 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1021/1997] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:07 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1392 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:07.628638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-04b7a05a-5722-4cfc-aa91-a1393e3dc767 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:07.629263 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-04b7a05a-5722-4cfc-aa91-a1393e3dc767 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] [instance: 5e6f2901-8ce0-455d-b905-6e3c34afee0e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:07.629423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-223a831f-a5ab-49e0-b6a3-14efe39b82f6 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:07.633554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-223a831f-a5ab-49e0-b6a3-14efe39b82f6 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c201f1cbb5ba4f1ebf3211c937a4964b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a26f0bfba01462387501d3d6e5a6453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:07.658421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04b7a05a-5722-4cfc-aa91-a1393e3dc767 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:07.664017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04b7a05a-5722-4cfc-aa91-a1393e3dc767 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:07.666303 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-223a831f-a5ab-49e0-b6a3-14efe39b82f6 tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 200 len: 1443 microversion: 2.75 time: 0.251586 Oct 10 23:24:07.668887 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 977/1998] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:07 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 1443 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:07.669223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04b7a05a-5722-4cfc-aa91-a1393e3dc767 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:07.674054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04b7a05a-5722-4cfc-aa91-a1393e3dc767 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:07.674546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04b7a05a-5722-4cfc-aa91-a1393e3dc767 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:07.674984 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04b7a05a-5722-4cfc-aa91-a1393e3dc767 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:07.691460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5de3f885-0630-4e21-88da-d989c9f4ebf2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:07.696619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5de3f885-0630-4e21-88da-d989c9f4ebf2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:07.719274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5de3f885-0630-4e21-88da-d989c9f4ebf2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:07.727697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5de3f885-0630-4e21-88da-d989c9f4ebf2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:07.734513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5de3f885-0630-4e21-88da-d989c9f4ebf2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:07.735826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5de3f885-0630-4e21-88da-d989c9f4ebf2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:07.740151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5de3f885-0630-4e21-88da-d989c9f4ebf2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:07.744885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5de3f885-0630-4e21-88da-d989c9f4ebf2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:08.269841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5de3f885-0630-4e21-88da-d989c9f4ebf2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:08.308979 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5de3f885-0630-4e21-88da-d989c9f4ebf2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1497 microversion: 2.1 time: 0.638221 Oct 10 23:24:08.317557 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 978/1999] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:07 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1497 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:08.442379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-48275c5f-6885-4f15-a0f6-b78682f0204c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:08.444400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-48275c5f-6885-4f15-a0f6-b78682f0204c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:08.457118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-48275c5f-6885-4f15-a0f6-b78682f0204c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:08.458025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-48275c5f-6885-4f15-a0f6-b78682f0204c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:08.458736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-48275c5f-6885-4f15-a0f6-b78682f0204c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:08.460023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-48275c5f-6885-4f15-a0f6-b78682f0204c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:08.464319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-48275c5f-6885-4f15-a0f6-b78682f0204c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:08.465151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-48275c5f-6885-4f15-a0f6-b78682f0204c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:08.558921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-04b7a05a-5722-4cfc-aa91-a1393e3dc767 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9a7943bb264da19ee753ea3ce7ffce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1795ae26f5294bbaa444099b9c261f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:08.578446 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-04b7a05a-5722-4cfc-aa91-a1393e3dc767 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] 10.222.0.23 "GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e" status: 200 len: 1323 microversion: 2.1 time: 0.956104 Oct 10 23:24:08.597885 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1022/2000] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:07 2022] GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e => generated 1323 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:08.632560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3beba47a-a38d-4f0e-a317-ac73a77192a0 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:08.633534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3beba47a-a38d-4f0e-a317-ac73a77192a0 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:08.651968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3beba47a-a38d-4f0e-a317-ac73a77192a0 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:08.657670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3beba47a-a38d-4f0e-a317-ac73a77192a0 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:08.659727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3beba47a-a38d-4f0e-a317-ac73a77192a0 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:08.662227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3beba47a-a38d-4f0e-a317-ac73a77192a0 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:08.664105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3beba47a-a38d-4f0e-a317-ac73a77192a0 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:08.664951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3beba47a-a38d-4f0e-a317-ac73a77192a0 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:08.923040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-48275c5f-6885-4f15-a0f6-b78682f0204c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:08.937884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-48275c5f-6885-4f15-a0f6-b78682f0204c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:08.942807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-48275c5f-6885-4f15-a0f6-b78682f0204c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:08.945649 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-48275c5f-6885-4f15-a0f6-b78682f0204c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1281 microversion: 2.25 time: 0.511867 Oct 10 23:24:08.946612 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 979/2001] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:08 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1281 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:08.974384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7b3fee90-a3b8-4de4-8988-d1e7c586fd3b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:08.975125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7b3fee90-a3b8-4de4-8988-d1e7c586fd3b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] [instance: 37e535e7-b049-463e-8f53-7fa3f05457a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:08.991848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b3fee90-a3b8-4de4-8988-d1e7c586fd3b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:08.992352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b3fee90-a3b8-4de4-8988-d1e7c586fd3b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:08.992790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b3fee90-a3b8-4de4-8988-d1e7c586fd3b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:09.001662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b3fee90-a3b8-4de4-8988-d1e7c586fd3b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:09.002174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b3fee90-a3b8-4de4-8988-d1e7c586fd3b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:09.003711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b3fee90-a3b8-4de4-8988-d1e7c586fd3b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:09.037286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3beba47a-a38d-4f0e-a317-ac73a77192a0 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:09.041526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:09.050290 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-7b3fee90-a3b8-4de4-8988-d1e7c586fd3b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] HTTP exception thrown: Instance 37e535e7-b049-463e-8f53-7fa3f05457a1 could not be found. Oct 10 23:24:09.053028 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3beba47a-a38d-4f0e-a317-ac73a77192a0 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1392 microversion: 2.1 time: 0.424562 Oct 10 23:24:09.055078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7b3fee90-a3b8-4de4-8988-d1e7c586fd3b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Request method failure captured: Oct 10 23:24:09.055078 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 HTTP/1.1 Oct 10 23:24:09.055078 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:24:09.055078 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:24:09.055078 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:24:09.055078 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:24:09.055078 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:24:09.055078 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:24:09.055078 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:24:09.055078 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:24:09.055078 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKlGxw--TDWVYASC71qfi8Bw3TPKEuq9raZJKVQZBB8bY8uXr10Hq1f6QQusP33bTzGfwzqpz-flUusHAs4utu-f-EVcNI5XHA5Gz0nWMp89tA3AXexoDfApAtnsG5-5mgApxyPg7LanvtwxoZeargewb8Jkud2IaI4A-AyKi6vwpy4 Oct 10 23:24:09.055078 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:24:09.055078 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:24:09.055078 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:24:09.055078 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:24:09.055078 n-d-860864-2 devstack@n-api.service[120613]: X-Openstack-Nova-Api-Version: 2.75 Oct 10 23:24:09.055078 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:24:09.055078 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:24:09.055078 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 9a26f0bfba01462387501d3d6e5a6453 Oct 10 23:24:09.055078 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersAdmin275Test-342623217 Oct 10 23:24:09.055078 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:24:09.055078 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:24:09.057123 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9a26f0bfba01462387501d3d6e5a6453"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9a26f0bfba01462387501d3d6e5a6453"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9a26f0bfba01462387501d3d6e5a6453"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9a26f0bfba01462387501d3d6e5a6453", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:24:09.057123 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersAdmin275Test-342623217 Oct 10 23:24:09.057123 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 9a26f0bfba01462387501d3d6e5a6453 Oct 10 23:24:09.057123 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersAdmin275Test-342623217 Oct 10 23:24:09.057123 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersAdmin275Test-342623217-project Oct 10 23:24:09.057123 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:24:09.057123 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:24:09.057123 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: c201f1cbb5ba4f1ebf3211c937a4964b Oct 10 23:24:09.057123 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersAdmin275Test-342623217-project Oct 10 23:24:09.057123 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:24:09.057123 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 37e535e7-b049-463e-8f53-7fa3f05457a1 could not be found. Oct 10 23:24:09.057123 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '37e535e7-b049-463e-8f53-7fa3f05457a1'} Oct 10 23:24:09.058444 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:24:09.058444 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:24:09.058444 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:24:09.058444 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:24:09.058444 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:24:09.058444 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:24:09.058444 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:24:09.058444 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:24:09.058444 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:24:09.058444 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:24:09.058444 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37e535e7-b049-463e-8f53-7fa3f05457a1 could not be found. Oct 10 23:24:09.058444 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:24:09.058444 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:24:09.058444 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:24:09.058444 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:24:09.058444 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:24:09.058444 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:24:09.058444 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:24:09.058444 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:24:09.058444 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:24:09.060299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:24:09.060299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:24:09.060299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:24:09.060299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:24:09.060299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:24:09.060299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:24:09.060299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:24:09.060299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37e535e7-b049-463e-8f53-7fa3f05457a1 could not be found. Oct 10 23:24:09.060299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:24:09.060299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:24:09.060299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:24:09.060299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:24:09.060299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:24:09.060299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:24:09.060299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:24:09.060299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:24:09.060299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37e535e7-b049-463e-8f53-7fa3f05457a1 could not be found. Oct 10 23:24:09.060299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:24:09.061998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7b3fee90-a3b8-4de4-8988-d1e7c586fd3b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] Returning 404 to user: Instance 37e535e7-b049-463e-8f53-7fa3f05457a1 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:24:09.061998 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7b3fee90-a3b8-4de4-8988-d1e7c586fd3b tempest-ServersAdmin275Test-342623217 tempest-ServersAdmin275Test-342623217-project] 10.222.0.23 "GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1" status: 404 len: 111 microversion: 2.75 time: 0.093972 Oct 10 23:24:09.061998 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 980/2002] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:08 2022] GET /compute/v2.1/servers/37e535e7-b049-463e-8f53-7fa3f05457a1 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:24:09.078332 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1023/2003] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:08 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1392 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:09.347521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-40c19c9b-3fdd-4cd2-835c-04c106fdd0a5 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:09.348143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-40c19c9b-3fdd-4cd2-835c-04c106fdd0a5 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:09.360827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40c19c9b-3fdd-4cd2-835c-04c106fdd0a5 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:09.361472 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40c19c9b-3fdd-4cd2-835c-04c106fdd0a5 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:09.361923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40c19c9b-3fdd-4cd2-835c-04c106fdd0a5 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:09.362657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40c19c9b-3fdd-4cd2-835c-04c106fdd0a5 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:09.363111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40c19c9b-3fdd-4cd2-835c-04c106fdd0a5 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:09.363542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40c19c9b-3fdd-4cd2-835c-04c106fdd0a5 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:09.616416 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-10a4728a-4974-4968-b7e2-8d1a37f2d133 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:09.617345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-10a4728a-4974-4968-b7e2-8d1a37f2d133 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] [instance: 5e6f2901-8ce0-455d-b905-6e3c34afee0e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:09.636162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10a4728a-4974-4968-b7e2-8d1a37f2d133 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:09.638001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10a4728a-4974-4968-b7e2-8d1a37f2d133 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:09.639979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10a4728a-4974-4968-b7e2-8d1a37f2d133 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:09.641724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10a4728a-4974-4968-b7e2-8d1a37f2d133 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:09.642788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10a4728a-4974-4968-b7e2-8d1a37f2d133 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:09.645293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10a4728a-4974-4968-b7e2-8d1a37f2d133 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:09.875055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-40c19c9b-3fdd-4cd2-835c-04c106fdd0a5 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:09.889454 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-40c19c9b-3fdd-4cd2-835c-04c106fdd0a5 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1497 microversion: 2.1 time: 0.546053 Oct 10 23:24:09.893779 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 981/2004] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:09 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1497 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:09.920196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-0f53ea0f-d7a5-48ac-9a49-3ce19c681fb7 req-5397efcc-f254-4707-871d-3b7c101bf44d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6f2901-8ce0-455d-b905-6e3c34afee0e", "name": "network-vif-plugged", "status": "completed", "tag": "5263ca2b-f1fc-41b2-ac18-ab1425e63332"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:09.965427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0f53ea0f-d7a5-48ac-9a49-3ce19c681fb7 req-5397efcc-f254-4707-871d-3b7c101bf44d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:09.965929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0f53ea0f-d7a5-48ac-9a49-3ce19c681fb7 req-5397efcc-f254-4707-871d-3b7c101bf44d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:09.968729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0f53ea0f-d7a5-48ac-9a49-3ce19c681fb7 req-5397efcc-f254-4707-871d-3b7c101bf44d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:09.998458 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-0f53ea0f-d7a5-48ac-9a49-3ce19c681fb7 req-5397efcc-f254-4707-871d-3b7c101bf44d service nova] Creating event network-vif-plugged:5263ca2b-f1fc-41b2-ac18-ab1425e63332 for instance 5e6f2901-8ce0-455d-b905-6e3c34afee0e on n-h2-860864-2 Oct 10 23:24:10.010757 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-0f53ea0f-d7a5-48ac-9a49-3ce19c681fb7 req-5397efcc-f254-4707-871d-3b7c101bf44d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103592 Oct 10 23:24:10.012704 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 982/2005] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:24:10.039818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-337b9c0e-5824-4128-8f4f-c662b58dcffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:10.041283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-337b9c0e-5824-4128-8f4f-c662b58dcffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:10.076696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-337b9c0e-5824-4128-8f4f-c662b58dcffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:10.080385 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-337b9c0e-5824-4128-8f4f-c662b58dcffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:10.081070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-337b9c0e-5824-4128-8f4f-c662b58dcffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:10.083809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-337b9c0e-5824-4128-8f4f-c662b58dcffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:10.085618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-337b9c0e-5824-4128-8f4f-c662b58dcffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:10.086645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-337b9c0e-5824-4128-8f4f-c662b58dcffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:10.138748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-10a4728a-4974-4968-b7e2-8d1a37f2d133 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9a7943bb264da19ee753ea3ce7ffce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1795ae26f5294bbaa444099b9c261f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:10.150646 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-10a4728a-4974-4968-b7e2-8d1a37f2d133 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] 10.222.0.23 "GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e" status: 200 len: 1323 microversion: 2.1 time: 0.539162 Oct 10 23:24:10.158153 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1024/2006] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:09 2022] GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e => generated 1323 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:10.172151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3eefddeb-fc21-4096-89e4-5530c3cfdacd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:10.172151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3eefddeb-fc21-4096-89e4-5530c3cfdacd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:10.189056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3eefddeb-fc21-4096-89e4-5530c3cfdacd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:10.189601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3eefddeb-fc21-4096-89e4-5530c3cfdacd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:10.190062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3eefddeb-fc21-4096-89e4-5530c3cfdacd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:10.195934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3eefddeb-fc21-4096-89e4-5530c3cfdacd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:10.196424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3eefddeb-fc21-4096-89e4-5530c3cfdacd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:10.196871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3eefddeb-fc21-4096-89e4-5530c3cfdacd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:10.546857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3eefddeb-fc21-4096-89e4-5530c3cfdacd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:10.560256 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3eefddeb-fc21-4096-89e4-5530c3cfdacd tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1392 microversion: 2.1 time: 0.400474 Oct 10 23:24:10.575606 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1025/2007] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:10 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1392 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:10.600687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-337b9c0e-5824-4128-8f4f-c662b58dcffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:10.620812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-337b9c0e-5824-4128-8f4f-c662b58dcffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:10.622905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-337b9c0e-5824-4128-8f4f-c662b58dcffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:10.627162 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-337b9c0e-5824-4128-8f4f-c662b58dcffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1281 microversion: 2.25 time: 0.610565 Oct 10 23:24:10.629265 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 983/2008] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:10 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1281 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:10.918385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-da391d73-5c35-422e-9d95-6d67fc233180 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:10.919010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-da391d73-5c35-422e-9d95-6d67fc233180 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:10.929212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da391d73-5c35-422e-9d95-6d67fc233180 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:10.929739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da391d73-5c35-422e-9d95-6d67fc233180 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:10.930183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da391d73-5c35-422e-9d95-6d67fc233180 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:10.930915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da391d73-5c35-422e-9d95-6d67fc233180 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:10.931363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da391d73-5c35-422e-9d95-6d67fc233180 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:10.931790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da391d73-5c35-422e-9d95-6d67fc233180 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:11.182365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7416b6f8-52f8-4d18-91ae-55ace9866886 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:11.183152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7416b6f8-52f8-4d18-91ae-55ace9866886 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] [instance: 5e6f2901-8ce0-455d-b905-6e3c34afee0e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:11.199548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7416b6f8-52f8-4d18-91ae-55ace9866886 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:11.200071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7416b6f8-52f8-4d18-91ae-55ace9866886 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:11.200521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7416b6f8-52f8-4d18-91ae-55ace9866886 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:11.201261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7416b6f8-52f8-4d18-91ae-55ace9866886 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:11.201776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7416b6f8-52f8-4d18-91ae-55ace9866886 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:11.206495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7416b6f8-52f8-4d18-91ae-55ace9866886 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:11.476993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-da391d73-5c35-422e-9d95-6d67fc233180 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:11.486233 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-da391d73-5c35-422e-9d95-6d67fc233180 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1497 microversion: 2.1 time: 0.571685 Oct 10 23:24:11.486826 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1026/2009] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:10 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1497 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:11.587415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-97c4cba2-0e1f-46ed-a593-72caa8b0cd2b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:11.588202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-97c4cba2-0e1f-46ed-a593-72caa8b0cd2b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:11.600827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97c4cba2-0e1f-46ed-a593-72caa8b0cd2b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:11.605540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97c4cba2-0e1f-46ed-a593-72caa8b0cd2b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:11.606198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97c4cba2-0e1f-46ed-a593-72caa8b0cd2b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:11.607221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97c4cba2-0e1f-46ed-a593-72caa8b0cd2b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:11.607954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97c4cba2-0e1f-46ed-a593-72caa8b0cd2b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:11.610533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97c4cba2-0e1f-46ed-a593-72caa8b0cd2b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:12.147471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-97c4cba2-0e1f-46ed-a593-72caa8b0cd2b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:12.156679 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-97c4cba2-0e1f-46ed-a593-72caa8b0cd2b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1392 microversion: 2.1 time: 0.573323 Oct 10 23:24:12.157310 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1027/2010] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:11 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1392 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:12.169623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7416b6f8-52f8-4d18-91ae-55ace9866886 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9a7943bb264da19ee753ea3ce7ffce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1795ae26f5294bbaa444099b9c261f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:12.172256 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7416b6f8-52f8-4d18-91ae-55ace9866886 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] 10.222.0.23 "GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e" status: 200 len: 1323 microversion: 2.1 time: 0.993877 Oct 10 23:24:12.179588 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e63c63ef-abaf-418f-9743-0ecb0171e4dc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:12.180104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e63c63ef-abaf-418f-9743-0ecb0171e4dc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:12.185751 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 984/2011] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:11 2022] GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e => generated 1323 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:24:12.187328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e63c63ef-abaf-418f-9743-0ecb0171e4dc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:12.187816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e63c63ef-abaf-418f-9743-0ecb0171e4dc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:12.188254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e63c63ef-abaf-418f-9743-0ecb0171e4dc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:12.188962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e63c63ef-abaf-418f-9743-0ecb0171e4dc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:12.189638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e63c63ef-abaf-418f-9743-0ecb0171e4dc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:12.190245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e63c63ef-abaf-418f-9743-0ecb0171e4dc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:12.377101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e75517f4-d90d-4c96-a0b7-41eff76220a0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:12.385067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e75517f4-d90d-4c96-a0b7-41eff76220a0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:12.385591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e75517f4-d90d-4c96-a0b7-41eff76220a0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:12.386035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e75517f4-d90d-4c96-a0b7-41eff76220a0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:12.425769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e75517f4-d90d-4c96-a0b7-41eff76220a0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Going to try to stop instance {{(pid=120613) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 23:24:12.478085 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e75517f4-d90d-4c96-a0b7-41eff76220a0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "POST /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc/action" status: 202 len: 0 microversion: 2.1 time: 0.106230 Oct 10 23:24:12.479573 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 985/2012] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:24:12 2022] POST /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:24:12.498796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-87f84364-238c-4f29-8932-b03cc565c53d tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:12.501959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-87f84364-238c-4f29-8932-b03cc565c53d tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:12.510023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87f84364-238c-4f29-8932-b03cc565c53d tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:12.510655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87f84364-238c-4f29-8932-b03cc565c53d tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:12.511190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87f84364-238c-4f29-8932-b03cc565c53d tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:12.514185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87f84364-238c-4f29-8932-b03cc565c53d tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:12.515468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87f84364-238c-4f29-8932-b03cc565c53d tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:12.516183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87f84364-238c-4f29-8932-b03cc565c53d tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:12.579483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e63c63ef-abaf-418f-9743-0ecb0171e4dc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:12.593435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e63c63ef-abaf-418f-9743-0ecb0171e4dc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:12.594926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e63c63ef-abaf-418f-9743-0ecb0171e4dc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:12.596084 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e63c63ef-abaf-418f-9743-0ecb0171e4dc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1281 microversion: 2.25 time: 0.423435 Oct 10 23:24:12.596681 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1028/2013] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:12 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1281 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:12.601137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e5e477bd-30ea-452b-a089-893dfb48c8ae tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:12.612785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e5e477bd-30ea-452b-a089-893dfb48c8ae tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:12.630653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5e477bd-30ea-452b-a089-893dfb48c8ae tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:12.631201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5e477bd-30ea-452b-a089-893dfb48c8ae tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:12.631595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5e477bd-30ea-452b-a089-893dfb48c8ae tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:12.632347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5e477bd-30ea-452b-a089-893dfb48c8ae tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:12.632805 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5e477bd-30ea-452b-a089-893dfb48c8ae tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:12.633235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5e477bd-30ea-452b-a089-893dfb48c8ae tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:12.805633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-87f84364-238c-4f29-8932-b03cc565c53d tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:12.816126 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-87f84364-238c-4f29-8932-b03cc565c53d tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1726 microversion: 2.1 time: 0.325736 Oct 10 23:24:12.817471 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 986/2014] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:12 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1726 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:12.951160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e5e477bd-30ea-452b-a089-893dfb48c8ae tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:12.968097 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e5e477bd-30ea-452b-a089-893dfb48c8ae tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1497 microversion: 2.1 time: 0.369766 Oct 10 23:24:12.968699 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1029/2015] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:12 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1497 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:13.183433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f498879a-2c97-490b-8036-d0e66869f10b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:13.184738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f498879a-2c97-490b-8036-d0e66869f10b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:13.197971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f498879a-2c97-490b-8036-d0e66869f10b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:13.198745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f498879a-2c97-490b-8036-d0e66869f10b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:13.199337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f498879a-2c97-490b-8036-d0e66869f10b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:13.200395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f498879a-2c97-490b-8036-d0e66869f10b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:13.201679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f498879a-2c97-490b-8036-d0e66869f10b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:13.203007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f498879a-2c97-490b-8036-d0e66869f10b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:13.248821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ee9cdd8d-aba1-461f-bb46-129cbe3addc3 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1056092483", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "01a5e7e6-e4b5-4bc2-b318-782699102893"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:13.328338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-ee9cdd8d-aba1-461f-bb46-129cbe3addc3 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] validate_networks() for [('01a5e7e6-e4b5-4bc2-b318-782699102893', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:24:13.465337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f498879a-2c97-490b-8036-d0e66869f10b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:13.478188 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f498879a-2c97-490b-8036-d0e66869f10b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1392 microversion: 2.1 time: 0.298568 Oct 10 23:24:13.479323 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1030/2016] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:13 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1392 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:24:13.484836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dba74d6c-6142-4294-a931-00d66a0c1dd2 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:13.485739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dba74d6c-6142-4294-a931-00d66a0c1dd2 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] [instance: 5e6f2901-8ce0-455d-b905-6e3c34afee0e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:13.494213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dba74d6c-6142-4294-a931-00d66a0c1dd2 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:13.498068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dba74d6c-6142-4294-a931-00d66a0c1dd2 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:13.500123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dba74d6c-6142-4294-a931-00d66a0c1dd2 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:13.501336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dba74d6c-6142-4294-a931-00d66a0c1dd2 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:13.501994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dba74d6c-6142-4294-a931-00d66a0c1dd2 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:13.502587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dba74d6c-6142-4294-a931-00d66a0c1dd2 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:13.680261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dba74d6c-6142-4294-a931-00d66a0c1dd2 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9a7943bb264da19ee753ea3ce7ffce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1795ae26f5294bbaa444099b9c261f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:13.693175 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dba74d6c-6142-4294-a931-00d66a0c1dd2 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] 10.222.0.23 "GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e" status: 200 len: 1473 microversion: 2.1 time: 0.212583 Oct 10 23:24:13.712905 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1031/2017] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:13 2022] GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e => generated 1473 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:13.720444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0d18c2e5-c7d6-4e05-b9c2-f33d54372e36 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:13.721416 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0d18c2e5-c7d6-4e05-b9c2-f33d54372e36 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:13.730089 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d18c2e5-c7d6-4e05-b9c2-f33d54372e36 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:13.730835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d18c2e5-c7d6-4e05-b9c2-f33d54372e36 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:13.731774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d18c2e5-c7d6-4e05-b9c2-f33d54372e36 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:13.733443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d18c2e5-c7d6-4e05-b9c2-f33d54372e36 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:13.734405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d18c2e5-c7d6-4e05-b9c2-f33d54372e36 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:13.735491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d18c2e5-c7d6-4e05-b9c2-f33d54372e36 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:13.967106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0d18c2e5-c7d6-4e05-b9c2-f33d54372e36 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:13.981338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0d18c2e5-c7d6-4e05-b9c2-f33d54372e36 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:13.983765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0d18c2e5-c7d6-4e05-b9c2-f33d54372e36 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:13.986898 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0d18c2e5-c7d6-4e05-b9c2-f33d54372e36 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1281 microversion: 2.25 time: 0.272689 Oct 10 23:24:13.988558 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1032/2018] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:13 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1281 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:13.993757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-00e1774e-2748-4884-b3cc-2592bfc38dc8 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:13.994549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-00e1774e-2748-4884-b3cc-2592bfc38dc8 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] [instance: 5e6f2901-8ce0-455d-b905-6e3c34afee0e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:14.014041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-00e1774e-2748-4884-b3cc-2592bfc38dc8 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:14.015257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-00e1774e-2748-4884-b3cc-2592bfc38dc8 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:14.015831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-00e1774e-2748-4884-b3cc-2592bfc38dc8 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:14.016554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-00e1774e-2748-4884-b3cc-2592bfc38dc8 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:14.017048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-00e1774e-2748-4884-b3cc-2592bfc38dc8 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:14.025997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-00e1774e-2748-4884-b3cc-2592bfc38dc8 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:14.072751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-00e1774e-2748-4884-b3cc-2592bfc38dc8 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'bd9a7943bb264da19ee753ea3ce7ffce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1795ae26f5294bbaa444099b9c261f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:14.081972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-00e1774e-2748-4884-b3cc-2592bfc38dc8 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Request method failure captured: Oct 10 23:24:14.081972 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e/diagnostics HTTP/1.1 Oct 10 23:24:14.081972 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:24:14.081972 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:24:14.081972 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:24:14.081972 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:24:14.081972 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:24:14.081972 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:24:14.081972 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:24:14.081972 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:24:14.081972 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKmIjdkbn9LqfvHxWWnuvaq5VsMKFYp10nhjF5cUJxaOstBngNmx7Ww4_CHbfZLHlTe2TUHEjT3VL3iN-Q5kWjR2tgT-8T2hobewxf9GV-ej63AlCjJcD2-X8k8Jnl2cA1jGYycDIPIXaSKeCJmrJGQk9mIeqVDgsQcdrOO4Lqp2Szk Oct 10 23:24:14.081972 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:24:14.081972 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:24:14.081972 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:24:14.081972 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:24:14.081972 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:24:14.081972 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:24:14.081972 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 1795ae26f5294bbaa444099b9c261f23 Oct 10 23:24:14.081972 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1022960313 Oct 10 23:24:14.081972 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:24:14.081972 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:24:14.083888 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1795ae26f5294bbaa444099b9c261f23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1795ae26f5294bbaa444099b9c261f23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1795ae26f5294bbaa444099b9c261f23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1795ae26f5294bbaa444099b9c261f23", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:24:14.083888 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1022960313 Oct 10 23:24:14.083888 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 1795ae26f5294bbaa444099b9c261f23 Oct 10 23:24:14.083888 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1022960313 Oct 10 23:24:14.083888 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerDiagnosticsNegativeTest-1022960313-project Oct 10 23:24:14.083888 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:24:14.083888 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:24:14.083888 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: bd9a7943bb264da19ee753ea3ce7ffce Oct 10 23:24:14.083888 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1022960313-project Oct 10 23:24:14.083888 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:24:14.083888 n-d-860864-2 devstack@n-api.service[120614]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 10 23:24:14.085892 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'server_id': '5e6f2901-8ce0-455d-b905-6e3c34afee0e'} Oct 10 23:24:14.085892 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:24:14.085892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:24:14.085892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:24:14.085892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:24:14.085892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:24:14.085892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:24:14.085892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:24:14.085892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:24:14.085892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 10 23:24:14.085892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 10 23:24:14.085892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:24:14.085892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:24:14.085892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:24:14.085892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:24:14.085892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:24:14.085892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:24:14.085892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:24:14.085892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:24:14.085892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:24:14.087827 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:24:14.087827 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:24:14.087827 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:24:14.087827 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:24:14.087827 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:24:14.087827 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 10 23:24:14.087827 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:24:14.087827 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:24:14.087827 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:24:14.087827 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:24:14.087827 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:24:14.087827 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:24:14.087827 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:24:14.087827 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:24:14.087827 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 10 23:24:14.087827 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:24:14.090187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-00e1774e-2748-4884-b3cc-2592bfc38dc8 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:24:14.091245 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-00e1774e-2748-4884-b3cc-2592bfc38dc8 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] 10.222.0.23 "GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.101509 Oct 10 23:24:14.097457 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1033/2019] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:24:13 2022] GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e/diagnostics => generated 117 bytes in 108 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:24:14.103042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-28b9d671-db3a-44f8-830d-850fd0622e33 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:14.103662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-28b9d671-db3a-44f8-830d-850fd0622e33 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:14.110539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28b9d671-db3a-44f8-830d-850fd0622e33 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:14.111267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28b9d671-db3a-44f8-830d-850fd0622e33 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:14.112559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28b9d671-db3a-44f8-830d-850fd0622e33 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:14.113614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28b9d671-db3a-44f8-830d-850fd0622e33 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:14.114235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28b9d671-db3a-44f8-830d-850fd0622e33 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:14.114824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28b9d671-db3a-44f8-830d-850fd0622e33 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:14.345409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-28b9d671-db3a-44f8-830d-850fd0622e33 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:14.359224 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-28b9d671-db3a-44f8-830d-850fd0622e33 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1726 microversion: 2.1 time: 0.259840 Oct 10 23:24:14.373409 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1034/2020] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:14 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1726 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:14.373409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-55d23355-8c0c-4fb9-957f-eeea11779f73 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:14.373409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-55d23355-8c0c-4fb9-957f-eeea11779f73 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:14.378926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55d23355-8c0c-4fb9-957f-eeea11779f73 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:14.379424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55d23355-8c0c-4fb9-957f-eeea11779f73 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:14.379930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55d23355-8c0c-4fb9-957f-eeea11779f73 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:14.380767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55d23355-8c0c-4fb9-957f-eeea11779f73 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:14.381461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55d23355-8c0c-4fb9-957f-eeea11779f73 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:14.382638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55d23355-8c0c-4fb9-957f-eeea11779f73 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:14.428216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-ee9cdd8d-aba1-461f-bb46-129cbe3addc3 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:24:14.428764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-ee9cdd8d-aba1-461f-bb46-129cbe3addc3 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:24:14.429275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-ee9cdd8d-aba1-461f-bb46-129cbe3addc3 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:24:14.429793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-ee9cdd8d-aba1-461f-bb46-129cbe3addc3 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:24:14.430378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-ee9cdd8d-aba1-461f-bb46-129cbe3addc3 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:24:14.452040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee9cdd8d-aba1-461f-bb46-129cbe3addc3 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:14.452784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee9cdd8d-aba1-461f-bb46-129cbe3addc3 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:14.453451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee9cdd8d-aba1-461f-bb46-129cbe3addc3 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:14.454197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee9cdd8d-aba1-461f-bb46-129cbe3addc3 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:14.454655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee9cdd8d-aba1-461f-bb46-129cbe3addc3 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:14.455603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee9cdd8d-aba1-461f-bb46-129cbe3addc3 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:14.490921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-ee9cdd8d-aba1-461f-bb46-129cbe3addc3 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Getting quotas for project 7340f5ad1bea4967850a88c986602b9d. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:24:14.517798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-ee9cdd8d-aba1-461f-bb46-129cbe3addc3 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Getting quotas for user df36ffee3e4544a8baf6265d915716bd and project 7340f5ad1bea4967850a88c986602b9d. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:24:14.542055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ee9cdd8d-aba1-461f-bb46-129cbe3addc3 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:24:14.547521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ee9cdd8d-aba1-461f-bb46-129cbe3addc3 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:24:14.631182 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ee9cdd8d-aba1-461f-bb46-129cbe3addc3 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.807779 Oct 10 23:24:14.632264 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 987/2021] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:24:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:24:14.645733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-52b7ada2-a05c-4af3-8690-9d64ff0813ce tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:14.647696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-52b7ada2-a05c-4af3-8690-9d64ff0813ce tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] [instance: 5e6f2901-8ce0-455d-b905-6e3c34afee0e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:14.660067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52b7ada2-a05c-4af3-8690-9d64ff0813ce tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:14.661338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52b7ada2-a05c-4af3-8690-9d64ff0813ce tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:14.672358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52b7ada2-a05c-4af3-8690-9d64ff0813ce tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:14.673426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52b7ada2-a05c-4af3-8690-9d64ff0813ce tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:14.674108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52b7ada2-a05c-4af3-8690-9d64ff0813ce tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:14.674772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52b7ada2-a05c-4af3-8690-9d64ff0813ce tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:14.691754 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-55d23355-8c0c-4fb9-957f-eeea11779f73 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:14.699577 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-55d23355-8c0c-4fb9-957f-eeea11779f73 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1497 microversion: 2.1 time: 0.336233 Oct 10 23:24:14.700157 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1035/2022] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:14 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1497 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:14.706751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-05d2a219-297d-4b96-98c4-2447baca91a6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:14.707360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-05d2a219-297d-4b96-98c4-2447baca91a6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:14.713507 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05d2a219-297d-4b96-98c4-2447baca91a6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:14.713998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05d2a219-297d-4b96-98c4-2447baca91a6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:14.720707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-52b7ada2-a05c-4af3-8690-9d64ff0813ce tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] [instance: 5e6f2901-8ce0-455d-b905-6e3c34afee0e] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:24:14.721857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05d2a219-297d-4b96-98c4-2447baca91a6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:14.722638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05d2a219-297d-4b96-98c4-2447baca91a6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:14.723321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05d2a219-297d-4b96-98c4-2447baca91a6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:14.723663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05d2a219-297d-4b96-98c4-2447baca91a6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:14.912712 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-52b7ada2-a05c-4af3-8690-9d64ff0813ce tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e" status: 204 len: 0 microversion: 2.1 time: 0.270823 Oct 10 23:24:14.914169 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 988/2023] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:24:14 2022] DELETE /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:24:14.928633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-81cfd889-e4ff-4c06-836d-4bc5be0eea2d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:14.932426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-81cfd889-e4ff-4c06-836d-4bc5be0eea2d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:15.034836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-05d2a219-297d-4b96-98c4-2447baca91a6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:15.049098 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-05d2a219-297d-4b96-98c4-2447baca91a6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1382 microversion: 2.1 time: 0.347875 Oct 10 23:24:15.058281 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1036/2024] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:14 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1382 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:15.062695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-81cfd889-e4ff-4c06-836d-4bc5be0eea2d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df36ffee3e4544a8baf6265d915716bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7340f5ad1bea4967850a88c986602b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:15.072799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-87466d40-a522-4087-9f95-957ffd65f9d4 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:15.074520 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-81cfd889-e4ff-4c06-836d-4bc5be0eea2d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20" status: 200 len: 1217 microversion: 2.1 time: 0.154191 Oct 10 23:24:15.075269 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 989/2025] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:14 2022] GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:15.077899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-87466d40-a522-4087-9f95-957ffd65f9d4 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] [instance: 5e6f2901-8ce0-455d-b905-6e3c34afee0e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:15.081813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a0b119b9-b36f-486e-94f0-2555d7d49d21 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:15.084128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a0b119b9-b36f-486e-94f0-2555d7d49d21 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:15.088802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87466d40-a522-4087-9f95-957ffd65f9d4 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:15.090094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87466d40-a522-4087-9f95-957ffd65f9d4 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:15.090747 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87466d40-a522-4087-9f95-957ffd65f9d4 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:15.091687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87466d40-a522-4087-9f95-957ffd65f9d4 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:15.092373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87466d40-a522-4087-9f95-957ffd65f9d4 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:15.093591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87466d40-a522-4087-9f95-957ffd65f9d4 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:15.100443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0b119b9-b36f-486e-94f0-2555d7d49d21 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:15.101035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0b119b9-b36f-486e-94f0-2555d7d49d21 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:15.107200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0b119b9-b36f-486e-94f0-2555d7d49d21 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:15.113070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0b119b9-b36f-486e-94f0-2555d7d49d21 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:15.114058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0b119b9-b36f-486e-94f0-2555d7d49d21 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:15.114661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0b119b9-b36f-486e-94f0-2555d7d49d21 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:15.328833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a0b119b9-b36f-486e-94f0-2555d7d49d21 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:15.339020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a0b119b9-b36f-486e-94f0-2555d7d49d21 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:15.340606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a0b119b9-b36f-486e-94f0-2555d7d49d21 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:15.341814 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a0b119b9-b36f-486e-94f0-2555d7d49d21 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1281 microversion: 2.25 time: 0.265129 Oct 10 23:24:15.343444 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 990/2026] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:15 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1281 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:15.349225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e36b42dd-a76d-4902-9044-4a32d4ccbd40 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Calling method '.version_select at 0x7f662ae4a940>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:15.354169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e36b42dd-a76d-4902-9044-4a32d4ccbd40 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:15.355110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e36b42dd-a76d-4902-9044-4a32d4ccbd40 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:15.355880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e36b42dd-a76d-4902-9044-4a32d4ccbd40 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:15.369115 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e36b42dd-a76d-4902-9044-4a32d4ccbd40 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 2704 microversion: 2.1 time: 0.024632 Oct 10 23:24:15.370463 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 991/2027] 10.222.0.23 () {58 vars in 1143 bytes} [Mon Oct 10 23:24:15 2022] GET /compute/v2.1/os-migrations => generated 2704 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:15.388353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ce5d43e8-2140-4af0-b4b9-160a17f77023 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:15.390412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ce5d43e8-2140-4af0-b4b9-160a17f77023 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:15.412566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce5d43e8-2140-4af0-b4b9-160a17f77023 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:15.414444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce5d43e8-2140-4af0-b4b9-160a17f77023 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:15.415255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce5d43e8-2140-4af0-b4b9-160a17f77023 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:15.416888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce5d43e8-2140-4af0-b4b9-160a17f77023 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:15.417596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce5d43e8-2140-4af0-b4b9-160a17f77023 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:15.418926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce5d43e8-2140-4af0-b4b9-160a17f77023 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:15.474845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-87466d40-a522-4087-9f95-957ffd65f9d4 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9a7943bb264da19ee753ea3ce7ffce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1795ae26f5294bbaa444099b9c261f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:15.488055 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-87466d40-a522-4087-9f95-957ffd65f9d4 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] 10.222.0.23 "GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e" status: 200 len: 1479 microversion: 2.1 time: 0.425558 Oct 10 23:24:15.489808 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1037/2028] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:15 2022] GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e => generated 1479 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:15.502183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-490ca3bf-68f7-49d7-ac77-90f4fbdda6f6 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:15.508531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-490ca3bf-68f7-49d7-ac77-90f4fbdda6f6 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:15.519742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-490ca3bf-68f7-49d7-ac77-90f4fbdda6f6 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:15.520254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-490ca3bf-68f7-49d7-ac77-90f4fbdda6f6 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:15.520676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-490ca3bf-68f7-49d7-ac77-90f4fbdda6f6 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:15.521425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-490ca3bf-68f7-49d7-ac77-90f4fbdda6f6 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:15.524877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-490ca3bf-68f7-49d7-ac77-90f4fbdda6f6 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:15.525133 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-490ca3bf-68f7-49d7-ac77-90f4fbdda6f6 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:15.596532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ce5d43e8-2140-4af0-b4b9-160a17f77023 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:15.606716 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ce5d43e8-2140-4af0-b4b9-160a17f77023 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1726 microversion: 2.1 time: 0.224435 Oct 10 23:24:15.612892 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 992/2029] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:15 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1726 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:24:15.774954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7feb4898-8463-4be0-8697-aa3efbbe8d25 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-870815241", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": "none"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:15.846510 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-490ca3bf-68f7-49d7-ac77-90f4fbdda6f6 tempest-LiveMigrationTest-1048495008 tempest-LiveMigrationTest-1048495008-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1533 microversion: 2.1 time: 0.354255 Oct 10 23:24:15.861051 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1038/2030] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:15 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1533 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:15.861051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0409b3c0-7fd3-4458-9705-1a4d84771857 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:15.861051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0409b3c0-7fd3-4458-9705-1a4d84771857 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:15.864486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0409b3c0-7fd3-4458-9705-1a4d84771857 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:15.865338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0409b3c0-7fd3-4458-9705-1a4d84771857 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:15.866179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0409b3c0-7fd3-4458-9705-1a4d84771857 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:15.867213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0409b3c0-7fd3-4458-9705-1a4d84771857 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:15.867896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0409b3c0-7fd3-4458-9705-1a4d84771857 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:15.868546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0409b3c0-7fd3-4458-9705-1a4d84771857 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:15.881999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7feb4898-8463-4be0-8697-aa3efbbe8d25 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:24:15.882626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7feb4898-8463-4be0-8697-aa3efbbe8d25 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:24:15.883146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7feb4898-8463-4be0-8697-aa3efbbe8d25 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:24:15.887094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7feb4898-8463-4be0-8697-aa3efbbe8d25 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:24:15.887801 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7feb4898-8463-4be0-8697-aa3efbbe8d25 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:24:15.899182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7feb4898-8463-4be0-8697-aa3efbbe8d25 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:15.899671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7feb4898-8463-4be0-8697-aa3efbbe8d25 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:15.900115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7feb4898-8463-4be0-8697-aa3efbbe8d25 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:15.901935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7feb4898-8463-4be0-8697-aa3efbbe8d25 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:15.902688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7feb4898-8463-4be0-8697-aa3efbbe8d25 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:15.903129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7feb4898-8463-4be0-8697-aa3efbbe8d25 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:15.947702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-7feb4898-8463-4be0-8697-aa3efbbe8d25 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Getting quotas for project 9492b98195e046748b5c136552563152. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:24:15.961291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-7feb4898-8463-4be0-8697-aa3efbbe8d25 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Getting quotas for user f3fb6dfdf3264af282e44d68d84153f1 and project 9492b98195e046748b5c136552563152. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:24:16.027505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7feb4898-8463-4be0-8697-aa3efbbe8d25 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:24:16.031175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7feb4898-8463-4be0-8697-aa3efbbe8d25 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:24:16.118114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0409b3c0-7fd3-4458-9705-1a4d84771857 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:16.118555 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7feb4898-8463-4be0-8697-aa3efbbe8d25 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.503931 Oct 10 23:24:16.119821 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 993/2031] 10.222.0.23 () {62 vars in 1188 bytes} [Mon Oct 10 23:24:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 23:24:16.125790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6a24b224-a572-4a2b-b2e1-e0f9409db221 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:16.126664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6a24b224-a572-4a2b-b2e1-e0f9409db221 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:16.134449 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0409b3c0-7fd3-4458-9705-1a4d84771857 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1497 microversion: 2.1 time: 0.284857 Oct 10 23:24:16.135280 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1039/2032] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:15 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1497 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:16.149735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a24b224-a572-4a2b-b2e1-e0f9409db221 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:16.149735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a24b224-a572-4a2b-b2e1-e0f9409db221 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:16.149735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a24b224-a572-4a2b-b2e1-e0f9409db221 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:16.149735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a24b224-a572-4a2b-b2e1-e0f9409db221 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:16.150262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a24b224-a572-4a2b-b2e1-e0f9409db221 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:16.150262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a24b224-a572-4a2b-b2e1-e0f9409db221 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:16.154812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:16.164708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-c73f1dad-9f6e-4521-a1fe-da9353ee68a8 req-a3419e7b-561c-45e8-a2b6-6ea3c78bbd29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a472045-8c28-4437-9e0f-9223369022ae", "name": "network-vif-plugged", "status": "completed", "tag": "7eabf4d8-5373-4658-bf95-07c701376608"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:16.180207 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c73f1dad-9f6e-4521-a1fe-da9353ee68a8 req-a3419e7b-561c-45e8-a2b6-6ea3c78bbd29 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:16.181190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c73f1dad-9f6e-4521-a1fe-da9353ee68a8 req-a3419e7b-561c-45e8-a2b6-6ea3c78bbd29 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:16.181972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c73f1dad-9f6e-4521-a1fe-da9353ee68a8 req-a3419e7b-561c-45e8-a2b6-6ea3c78bbd29 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:16.195611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6a24b224-a572-4a2b-b2e1-e0f9409db221 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:24:16.209669 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-c73f1dad-9f6e-4521-a1fe-da9353ee68a8 req-a3419e7b-561c-45e8-a2b6-6ea3c78bbd29 service nova] Creating event network-vif-plugged:7eabf4d8-5373-4658-bf95-07c701376608 for instance 3a472045-8c28-4437-9e0f-9223369022ae on n-h1-860864-2 Oct 10 23:24:16.217358 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-c73f1dad-9f6e-4521-a1fe-da9353ee68a8 req-a3419e7b-561c-45e8-a2b6-6ea3c78bbd29 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063242 Oct 10 23:24:16.219580 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1040/2033] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:24:16.230948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-241bb29c-7859-464e-920a-929e9703edb6 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:16.236025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-241bb29c-7859-464e-920a-929e9703edb6 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:16.248682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-241bb29c-7859-464e-920a-929e9703edb6 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:16.251968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-241bb29c-7859-464e-920a-929e9703edb6 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:16.252654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-241bb29c-7859-464e-920a-929e9703edb6 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:16.253717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-241bb29c-7859-464e-920a-929e9703edb6 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:16.254374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-241bb29c-7859-464e-920a-929e9703edb6 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:16.255900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-241bb29c-7859-464e-920a-929e9703edb6 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:16.309321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:16.354093 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6a24b224-a572-4a2b-b2e1-e0f9409db221 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 204 len: 0 microversion: 2.1 time: 0.230078 Oct 10 23:24:16.360252 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 994/2034] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:24:16 2022] DELETE /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:24:16.407956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-86e30c77-f67f-4950-9763-b844422d1494 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:16.409985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-86e30c77-f67f-4950-9763-b844422d1494 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:16.465462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-241bb29c-7859-464e-920a-929e9703edb6 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df36ffee3e4544a8baf6265d915716bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7340f5ad1bea4967850a88c986602b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:16.476567 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-241bb29c-7859-464e-920a-929e9703edb6 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20" status: 200 len: 1221 microversion: 2.1 time: 0.255542 Oct 10 23:24:16.480524 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1041/2035] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:16 2022] GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 => generated 1221 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:16.497715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ee053181-6e8a-467b-98ca-d41082c1e295 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:16.499840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ee053181-6e8a-467b-98ca-d41082c1e295 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:16.512650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee053181-6e8a-467b-98ca-d41082c1e295 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:16.514387 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee053181-6e8a-467b-98ca-d41082c1e295 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:16.515001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee053181-6e8a-467b-98ca-d41082c1e295 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:16.515979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee053181-6e8a-467b-98ca-d41082c1e295 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:16.517274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee053181-6e8a-467b-98ca-d41082c1e295 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:16.518523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee053181-6e8a-467b-98ca-d41082c1e295 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:16.565435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-86e30c77-f67f-4950-9763-b844422d1494 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:16.580339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-86e30c77-f67f-4950-9763-b844422d1494 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:16.583724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-86e30c77-f67f-4950-9763-b844422d1494 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:16.589983 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-86e30c77-f67f-4950-9763-b844422d1494 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1452 microversion: 2.91 time: 0.204906 Oct 10 23:24:16.598667 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 995/2036] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:16 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1452 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:16.604681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-366ed806-a135-4961-b2d3-287f48562ab7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:16.605300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-366ed806-a135-4961-b2d3-287f48562ab7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:16.613824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-366ed806-a135-4961-b2d3-287f48562ab7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:16.614438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-366ed806-a135-4961-b2d3-287f48562ab7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:16.614953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-366ed806-a135-4961-b2d3-287f48562ab7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:16.615745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-366ed806-a135-4961-b2d3-287f48562ab7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:16.616501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-366ed806-a135-4961-b2d3-287f48562ab7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:16.617160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-366ed806-a135-4961-b2d3-287f48562ab7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:16.814773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ee053181-6e8a-467b-98ca-d41082c1e295 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:16.825710 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ee053181-6e8a-467b-98ca-d41082c1e295 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1388 microversion: 2.1 time: 0.336378 Oct 10 23:24:16.830645 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1042/2037] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:16 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1388 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:16.836873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d6030d06-8085-4b2f-9fba-d56f0eaaec13 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:16.838258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d6030d06-8085-4b2f-9fba-d56f0eaaec13 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] [instance: 5e6f2901-8ce0-455d-b905-6e3c34afee0e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:16.846483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6030d06-8085-4b2f-9fba-d56f0eaaec13 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:16.847459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6030d06-8085-4b2f-9fba-d56f0eaaec13 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:16.848286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6030d06-8085-4b2f-9fba-d56f0eaaec13 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:16.849279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6030d06-8085-4b2f-9fba-d56f0eaaec13 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:16.849945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6030d06-8085-4b2f-9fba-d56f0eaaec13 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:16.850732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6030d06-8085-4b2f-9fba-d56f0eaaec13 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:17.003541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-366ed806-a135-4961-b2d3-287f48562ab7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:17.030963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-366ed806-a135-4961-b2d3-287f48562ab7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:17.036624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-366ed806-a135-4961-b2d3-287f48562ab7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:17.039382 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-366ed806-a135-4961-b2d3-287f48562ab7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1281 microversion: 2.25 time: 0.438990 Oct 10 23:24:17.042574 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 996/2038] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:16 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1281 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:17.072405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-eec85734-92b3-4ac5-8fe4-f9d6797a7155 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:17.073679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-eec85734-92b3-4ac5-8fe4-f9d6797a7155 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:17.090743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eec85734-92b3-4ac5-8fe4-f9d6797a7155 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:17.091642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eec85734-92b3-4ac5-8fe4-f9d6797a7155 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:17.091927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d6030d06-8085-4b2f-9fba-d56f0eaaec13 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9a7943bb264da19ee753ea3ce7ffce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1795ae26f5294bbaa444099b9c261f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:17.093073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eec85734-92b3-4ac5-8fe4-f9d6797a7155 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:17.094651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eec85734-92b3-4ac5-8fe4-f9d6797a7155 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:17.095987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eec85734-92b3-4ac5-8fe4-f9d6797a7155 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:17.096680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eec85734-92b3-4ac5-8fe4-f9d6797a7155 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:17.106809 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d6030d06-8085-4b2f-9fba-d56f0eaaec13 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] 10.222.0.23 "GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e" status: 200 len: 1479 microversion: 2.1 time: 0.273082 Oct 10 23:24:17.109364 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1043/2039] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:16 2022] GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e => generated 1479 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:17.161986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-93c1b213-5606-402f-9bff-91c8dbbb5859 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:17.162627 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-93c1b213-5606-402f-9bff-91c8dbbb5859 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:17.188569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93c1b213-5606-402f-9bff-91c8dbbb5859 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:17.189413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93c1b213-5606-402f-9bff-91c8dbbb5859 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:17.195991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93c1b213-5606-402f-9bff-91c8dbbb5859 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:17.197798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93c1b213-5606-402f-9bff-91c8dbbb5859 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:17.198295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93c1b213-5606-402f-9bff-91c8dbbb5859 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:17.203375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93c1b213-5606-402f-9bff-91c8dbbb5859 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:17.540365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-93c1b213-5606-402f-9bff-91c8dbbb5859 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:17.552398 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-93c1b213-5606-402f-9bff-91c8dbbb5859 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 200 len: 1474 microversion: 2.1 time: 0.395111 Oct 10 23:24:17.556093 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1044/2040] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:17 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 1474 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:17.569642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-afc30801-80af-45e8-a323-d34b7c990953 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:17.571564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-afc30801-80af-45e8-a323-d34b7c990953 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:17.586691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afc30801-80af-45e8-a323-d34b7c990953 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:17.589506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afc30801-80af-45e8-a323-d34b7c990953 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:17.591372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afc30801-80af-45e8-a323-d34b7c990953 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:17.593070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afc30801-80af-45e8-a323-d34b7c990953 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:17.594973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afc30801-80af-45e8-a323-d34b7c990953 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:17.597943 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afc30801-80af-45e8-a323-d34b7c990953 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:17.724057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-afc30801-80af-45e8-a323-d34b7c990953 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df36ffee3e4544a8baf6265d915716bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7340f5ad1bea4967850a88c986602b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:17.737006 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-afc30801-80af-45e8-a323-d34b7c990953 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20" status: 200 len: 1269 microversion: 2.1 time: 0.178608 Oct 10 23:24:17.739113 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1045/2041] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:17 2022] GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 => generated 1269 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:17.749903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-68b679fc-55b5-4939-80d0-377140815e4e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-120658734"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:17.761993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-68b679fc-55b5-4939-80d0-377140815e4e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:17.777767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68b679fc-55b5-4939-80d0-377140815e4e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:17.778347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68b679fc-55b5-4939-80d0-377140815e4e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:17.778795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68b679fc-55b5-4939-80d0-377140815e4e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:17.781856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68b679fc-55b5-4939-80d0-377140815e4e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:17.782603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68b679fc-55b5-4939-80d0-377140815e4e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:17.784178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68b679fc-55b5-4939-80d0-377140815e4e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:18.082418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-eec85734-92b3-4ac5-8fe4-f9d6797a7155 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:18.091583 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-eec85734-92b3-4ac5-8fe4-f9d6797a7155 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1726 microversion: 2.1 time: 1.039651 Oct 10 23:24:18.111789 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 997/2042] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:17 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1726 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:18.121044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c57c0250-408c-4f07-9001-e07c094ef7e0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:18.124850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c57c0250-408c-4f07-9001-e07c094ef7e0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:18.142142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c57c0250-408c-4f07-9001-e07c094ef7e0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:18.144273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c57c0250-408c-4f07-9001-e07c094ef7e0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:18.144740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c57c0250-408c-4f07-9001-e07c094ef7e0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:18.145519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c57c0250-408c-4f07-9001-e07c094ef7e0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:18.149733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c57c0250-408c-4f07-9001-e07c094ef7e0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:18.150272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c57c0250-408c-4f07-9001-e07c094ef7e0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:18.297145 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-68b679fc-55b5-4939-80d0-377140815e4e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "POST /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac/action" status: 202 len: 0 microversion: 2.1 time: 0.555230 Oct 10 23:24:18.298629 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1046/2043] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:24:17 2022] POST /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 23:24:18.307551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5d5bdfb8-4763-4dfd-92a4-a31d65a20e11 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:18.308679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5d5bdfb8-4763-4dfd-92a4-a31d65a20e11 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:18.332279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d5bdfb8-4763-4dfd-92a4-a31d65a20e11 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:18.333057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d5bdfb8-4763-4dfd-92a4-a31d65a20e11 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:18.334011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d5bdfb8-4763-4dfd-92a4-a31d65a20e11 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:18.343618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c57c0250-408c-4f07-9001-e07c094ef7e0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:18.344980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d5bdfb8-4763-4dfd-92a4-a31d65a20e11 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:18.345698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d5bdfb8-4763-4dfd-92a4-a31d65a20e11 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:18.346301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d5bdfb8-4763-4dfd-92a4-a31d65a20e11 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:18.355660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c57c0250-408c-4f07-9001-e07c094ef7e0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:18.357302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c57c0250-408c-4f07-9001-e07c094ef7e0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:18.378583 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c57c0250-408c-4f07-9001-e07c094ef7e0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1504 microversion: 2.91 time: 0.271364 Oct 10 23:24:18.397863 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 998/2044] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:18 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1504 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:18.408733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3153d1f4-3336-48d1-a8a7-0786f63d1dcd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:18.410051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3153d1f4-3336-48d1-a8a7-0786f63d1dcd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:18.418161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3153d1f4-3336-48d1-a8a7-0786f63d1dcd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:18.419116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3153d1f4-3336-48d1-a8a7-0786f63d1dcd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:18.419793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3153d1f4-3336-48d1-a8a7-0786f63d1dcd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:18.421262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3153d1f4-3336-48d1-a8a7-0786f63d1dcd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:18.422050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3153d1f4-3336-48d1-a8a7-0786f63d1dcd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:18.422648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3153d1f4-3336-48d1-a8a7-0786f63d1dcd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:18.878160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3153d1f4-3336-48d1-a8a7-0786f63d1dcd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:18.895394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3153d1f4-3336-48d1-a8a7-0786f63d1dcd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:18.918747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3153d1f4-3336-48d1-a8a7-0786f63d1dcd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:18.941078 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3153d1f4-3336-48d1-a8a7-0786f63d1dcd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1281 microversion: 2.25 time: 0.537240 Oct 10 23:24:18.957679 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 999/2045] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:18 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1281 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:18.962987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e36872b1-73e0-47f7-9400-420683ddf48b tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:18.964359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e36872b1-73e0-47f7-9400-420683ddf48b tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] [instance: 5e6f2901-8ce0-455d-b905-6e3c34afee0e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:18.980402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:18.983814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e36872b1-73e0-47f7-9400-420683ddf48b tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:18.984596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e36872b1-73e0-47f7-9400-420683ddf48b tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:18.985296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e36872b1-73e0-47f7-9400-420683ddf48b tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:18.986321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e36872b1-73e0-47f7-9400-420683ddf48b tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:18.987035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e36872b1-73e0-47f7-9400-420683ddf48b tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:18.987712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e36872b1-73e0-47f7-9400-420683ddf48b tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:19.186987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e36872b1-73e0-47f7-9400-420683ddf48b tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9a7943bb264da19ee753ea3ce7ffce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1795ae26f5294bbaa444099b9c261f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:19.225239 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e36872b1-73e0-47f7-9400-420683ddf48b tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] 10.222.0.23 "GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e" status: 200 len: 1308 microversion: 2.1 time: 0.278108 Oct 10 23:24:19.246745 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1000/2046] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:18 2022] GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e => generated 1308 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:19.271947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c245a30d-4861-4bbc-b69a-27b8ac6d1e7f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b13e670>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:19.355023 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c245a30d-4861-4bbc-b69a-27b8ac6d1e7f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3" status: 200 len: 1413 microversion: 2.1 time: 0.106706 Oct 10 23:24:19.356149 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1001/2047] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:24:19 2022] GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3 => generated 1413 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:19.366631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d14e864e-f7fc-4338-8663-5cfce7bf0b83 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:19.372604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d14e864e-f7fc-4338-8663-5cfce7bf0b83 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:19.395123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d14e864e-f7fc-4338-8663-5cfce7bf0b83 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:19.396435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d14e864e-f7fc-4338-8663-5cfce7bf0b83 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:19.397229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d14e864e-f7fc-4338-8663-5cfce7bf0b83 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:19.398941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d14e864e-f7fc-4338-8663-5cfce7bf0b83 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:19.400076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d14e864e-f7fc-4338-8663-5cfce7bf0b83 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:19.400794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d14e864e-f7fc-4338-8663-5cfce7bf0b83 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:19.582276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5d5bdfb8-4763-4dfd-92a4-a31d65a20e11 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:19.597571 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5d5bdfb8-4763-4dfd-92a4-a31d65a20e11 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1388 microversion: 2.1 time: 1.297450 Oct 10 23:24:19.609245 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1047/2048] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:18 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1388 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:19.622374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-ec279f45-1950-4dfb-a2ae-f2dd4ffadcfd req-824fc366-cc41-4e0f-b156-6d644db9548e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6f2901-8ce0-455d-b905-6e3c34afee0e", "name": "network-vif-deleted", "tag": "5263ca2b-f1fc-41b2-ac18-ab1425e63332"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:19.652019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ec279f45-1950-4dfb-a2ae-f2dd4ffadcfd req-824fc366-cc41-4e0f-b156-6d644db9548e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:19.654324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ec279f45-1950-4dfb-a2ae-f2dd4ffadcfd req-824fc366-cc41-4e0f-b156-6d644db9548e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:19.656851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ec279f45-1950-4dfb-a2ae-f2dd4ffadcfd req-824fc366-cc41-4e0f-b156-6d644db9548e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:19.661218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d14e864e-f7fc-4338-8663-5cfce7bf0b83 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df36ffee3e4544a8baf6265d915716bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7340f5ad1bea4967850a88c986602b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:19.678766 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-ec279f45-1950-4dfb-a2ae-f2dd4ffadcfd req-824fc366-cc41-4e0f-b156-6d644db9548e service nova] Creating event network-vif-deleted:5263ca2b-f1fc-41b2-ac18-ab1425e63332 for instance 5e6f2901-8ce0-455d-b905-6e3c34afee0e on n-h2-860864-2 Oct 10 23:24:19.687205 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-ec279f45-1950-4dfb-a2ae-f2dd4ffadcfd req-824fc366-cc41-4e0f-b156-6d644db9548e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075123 Oct 10 23:24:19.692085 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d14e864e-f7fc-4338-8663-5cfce7bf0b83 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20" status: 200 len: 1275 microversion: 2.1 time: 0.332692 Oct 10 23:24:19.692572 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1048/2049] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:24:19.696705 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1002/2050] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:19 2022] GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 => generated 1275 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:19.701512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d51e63f2-b553-4a2c-aa3d-dff681c4f762 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:19.707086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d51e63f2-b553-4a2c-aa3d-dff681c4f762 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:19.710755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fb9bfc1b-a9c7-4218-a052-bdeb95594ed7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:19.711741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fb9bfc1b-a9c7-4218-a052-bdeb95594ed7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:19.721459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d51e63f2-b553-4a2c-aa3d-dff681c4f762 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:19.722783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d51e63f2-b553-4a2c-aa3d-dff681c4f762 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:19.726415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d51e63f2-b553-4a2c-aa3d-dff681c4f762 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:19.727542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d51e63f2-b553-4a2c-aa3d-dff681c4f762 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:19.728237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d51e63f2-b553-4a2c-aa3d-dff681c4f762 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:19.730001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d51e63f2-b553-4a2c-aa3d-dff681c4f762 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:19.733743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb9bfc1b-a9c7-4218-a052-bdeb95594ed7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:19.734552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb9bfc1b-a9c7-4218-a052-bdeb95594ed7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:19.735245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb9bfc1b-a9c7-4218-a052-bdeb95594ed7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:19.737317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb9bfc1b-a9c7-4218-a052-bdeb95594ed7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:19.738081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb9bfc1b-a9c7-4218-a052-bdeb95594ed7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:19.740328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb9bfc1b-a9c7-4218-a052-bdeb95594ed7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:19.907240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fb9bfc1b-a9c7-4218-a052-bdeb95594ed7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:19.949486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fb9bfc1b-a9c7-4218-a052-bdeb95594ed7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:19.955853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fb9bfc1b-a9c7-4218-a052-bdeb95594ed7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:19.971793 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fb9bfc1b-a9c7-4218-a052-bdeb95594ed7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1510 microversion: 2.91 time: 0.272491 Oct 10 23:24:19.972745 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1003/2051] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:19 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1510 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:19.979152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-482a35a2-dafb-438a-abcb-51fff894b273 req-49eb761e-2a99-4ecd-ab33-24eb4275a0e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9431e2e-3fb9-4834-8827-88c1e3762543", "name": "network-vif-deleted", "tag": "10aa8c22-3c3a-4a97-83bc-82a7afa75cd5"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:19.997292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-482a35a2-dafb-438a-abcb-51fff894b273 req-49eb761e-2a99-4ecd-ab33-24eb4275a0e5 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:19.998085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-482a35a2-dafb-438a-abcb-51fff894b273 req-49eb761e-2a99-4ecd-ab33-24eb4275a0e5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:19.999589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-482a35a2-dafb-438a-abcb-51fff894b273 req-49eb761e-2a99-4ecd-ab33-24eb4275a0e5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:20.017964 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-482a35a2-dafb-438a-abcb-51fff894b273 req-49eb761e-2a99-4ecd-ab33-24eb4275a0e5 service nova] Creating event network-vif-deleted:10aa8c22-3c3a-4a97-83bc-82a7afa75cd5 for instance e9431e2e-3fb9-4834-8827-88c1e3762543 on n-h2-860864-2 Oct 10 23:24:20.024117 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-482a35a2-dafb-438a-abcb-51fff894b273 req-49eb761e-2a99-4ecd-ab33-24eb4275a0e5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049678 Oct 10 23:24:20.025323 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1004/2052] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:24:20.032191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-01b9b59e-922a-4dbc-9754-3cce3a5e870e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:20.033185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-01b9b59e-922a-4dbc-9754-3cce3a5e870e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:20.041914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01b9b59e-922a-4dbc-9754-3cce3a5e870e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:20.042714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01b9b59e-922a-4dbc-9754-3cce3a5e870e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:20.043315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01b9b59e-922a-4dbc-9754-3cce3a5e870e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:20.044291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01b9b59e-922a-4dbc-9754-3cce3a5e870e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:20.044920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01b9b59e-922a-4dbc-9754-3cce3a5e870e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:20.046279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01b9b59e-922a-4dbc-9754-3cce3a5e870e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:20.364780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d51e63f2-b553-4a2c-aa3d-dff681c4f762 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:20.377928 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d51e63f2-b553-4a2c-aa3d-dff681c4f762 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1726 microversion: 2.1 time: 0.683261 Oct 10 23:24:20.393665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-01b9b59e-922a-4dbc-9754-3cce3a5e870e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:20.399922 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1049/2053] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:19 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1726 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:20.410769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8855e588-e319-45b9-9a99-e68916337d28 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:20.414892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8855e588-e319-45b9-9a99-e68916337d28 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] [instance: 5e6f2901-8ce0-455d-b905-6e3c34afee0e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:20.420329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-01b9b59e-922a-4dbc-9754-3cce3a5e870e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:20.423185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-01b9b59e-922a-4dbc-9754-3cce3a5e870e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:20.426520 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-01b9b59e-922a-4dbc-9754-3cce3a5e870e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1476 microversion: 2.25 time: 0.398330 Oct 10 23:24:20.429994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8855e588-e319-45b9-9a99-e68916337d28 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:20.430204 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1005/2054] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:20 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1476 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:20.433723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8855e588-e319-45b9-9a99-e68916337d28 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:20.437436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8855e588-e319-45b9-9a99-e68916337d28 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:20.438503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8855e588-e319-45b9-9a99-e68916337d28 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:20.439148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8855e588-e319-45b9-9a99-e68916337d28 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:20.439762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8855e588-e319-45b9-9a99-e68916337d28 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:20.449315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-254254e8-10e3-4abc-960b-db17cc60432e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b13eca0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:20.520820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8855e588-e319-45b9-9a99-e68916337d28 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:20.531425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8855e588-e319-45b9-9a99-e68916337d28 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:20.535217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8855e588-e319-45b9-9a99-e68916337d28 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:20.535891 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-8855e588-e319-45b9-9a99-e68916337d28 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lazy-loading 'fault' on Instance uuid 5e6f2901-8ce0-455d-b905-6e3c34afee0e {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:24:20.540505 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-254254e8-10e3-4abc-960b-db17cc60432e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3" status: 200 len: 1413 microversion: 2.1 time: 0.109166 Oct 10 23:24:20.553583 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1006/2055] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:24:20 2022] GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3 => generated 1413 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:20.590071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-642d69bf-c325-464b-bc0d-16815a23db60 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:20.590704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-642d69bf-c325-464b-bc0d-16815a23db60 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:20.618955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8855e588-e319-45b9-9a99-e68916337d28 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd9a7943bb264da19ee753ea3ce7ffce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1795ae26f5294bbaa444099b9c261f23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:20.626073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-642d69bf-c325-464b-bc0d-16815a23db60 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:20.628400 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8855e588-e319-45b9-9a99-e68916337d28 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] 10.222.0.23 "GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e" status: 200 len: 1313 microversion: 2.1 time: 0.227028 Oct 10 23:24:20.630560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-642d69bf-c325-464b-bc0d-16815a23db60 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:20.631102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-642d69bf-c325-464b-bc0d-16815a23db60 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:20.631793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-642d69bf-c325-464b-bc0d-16815a23db60 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:20.632257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-642d69bf-c325-464b-bc0d-16815a23db60 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:20.632691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-642d69bf-c325-464b-bc0d-16815a23db60 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:20.635751 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1050/2056] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:20 2022] GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:20.647281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5fdcc8d6-ad05-458c-80ed-c52388e5ed32 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:20.647835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5fdcc8d6-ad05-458c-80ed-c52388e5ed32 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:20.663044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5fdcc8d6-ad05-458c-80ed-c52388e5ed32 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:20.664093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5fdcc8d6-ad05-458c-80ed-c52388e5ed32 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:20.664748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5fdcc8d6-ad05-458c-80ed-c52388e5ed32 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:20.667206 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5fdcc8d6-ad05-458c-80ed-c52388e5ed32 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:20.667670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5fdcc8d6-ad05-458c-80ed-c52388e5ed32 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:20.668102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5fdcc8d6-ad05-458c-80ed-c52388e5ed32 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:20.826494 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5fdcc8d6-ad05-458c-80ed-c52388e5ed32 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:20.843904 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5fdcc8d6-ad05-458c-80ed-c52388e5ed32 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1184 microversion: 2.1 time: 0.204713 Oct 10 23:24:20.846048 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1051/2057] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:20 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1184 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:20.866121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4f2b59d4-2827-42da-aba6-05513aa2bc22 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:20.875864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4f2b59d4-2827-42da-aba6-05513aa2bc22 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:20.911486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f2b59d4-2827-42da-aba6-05513aa2bc22 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:20.912135 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f2b59d4-2827-42da-aba6-05513aa2bc22 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:20.916711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f2b59d4-2827-42da-aba6-05513aa2bc22 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:20.919713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f2b59d4-2827-42da-aba6-05513aa2bc22 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:20.923931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f2b59d4-2827-42da-aba6-05513aa2bc22 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:20.926100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f2b59d4-2827-42da-aba6-05513aa2bc22 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:21.123063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-642d69bf-c325-464b-bc0d-16815a23db60 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lazy-loading 'services' on Instance uuid 3a472045-8c28-4437-9e0f-9223369022ae {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:24:21.222695 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-642d69bf-c325-464b-bc0d-16815a23db60 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1969 microversion: 2.25 time: 0.666371 Oct 10 23:24:21.223308 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1007/2058] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:20 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1969 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:21.304823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3e5ba467-4d2a-4f3d-a0e6-c3d4ad38d326 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:21.305679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3e5ba467-4d2a-4f3d-a0e6-c3d4ad38d326 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:21.322436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e5ba467-4d2a-4f3d-a0e6-c3d4ad38d326 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:21.323017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e5ba467-4d2a-4f3d-a0e6-c3d4ad38d326 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:21.323577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e5ba467-4d2a-4f3d-a0e6-c3d4ad38d326 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:21.326409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e5ba467-4d2a-4f3d-a0e6-c3d4ad38d326 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:21.327925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e5ba467-4d2a-4f3d-a0e6-c3d4ad38d326 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:21.330008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e5ba467-4d2a-4f3d-a0e6-c3d4ad38d326 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:21.509723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4f2b59d4-2827-42da-aba6-05513aa2bc22 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df36ffee3e4544a8baf6265d915716bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7340f5ad1bea4967850a88c986602b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:21.521938 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4f2b59d4-2827-42da-aba6-05513aa2bc22 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20" status: 200 len: 1317 microversion: 2.1 time: 0.670243 Oct 10 23:24:21.523361 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1052/2059] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:20 2022] GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 => generated 1317 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:21.529870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2a1bdcf2-3dd8-4a6f-9e73-6002c3ceaab3 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:21.531081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2a1bdcf2-3dd8-4a6f-9e73-6002c3ceaab3 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:21.538779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a1bdcf2-3dd8-4a6f-9e73-6002c3ceaab3 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:21.539870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a1bdcf2-3dd8-4a6f-9e73-6002c3ceaab3 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:21.540532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a1bdcf2-3dd8-4a6f-9e73-6002c3ceaab3 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:21.542147 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a1bdcf2-3dd8-4a6f-9e73-6002c3ceaab3 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:21.542937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a1bdcf2-3dd8-4a6f-9e73-6002c3ceaab3 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:21.543535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a1bdcf2-3dd8-4a6f-9e73-6002c3ceaab3 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:21.635099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3e5ba467-4d2a-4f3d-a0e6-c3d4ad38d326 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:21.657007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3e5ba467-4d2a-4f3d-a0e6-c3d4ad38d326 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:21.660812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3e5ba467-4d2a-4f3d-a0e6-c3d4ad38d326 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:21.705668 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3e5ba467-4d2a-4f3d-a0e6-c3d4ad38d326 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1510 microversion: 2.91 time: 0.448533 Oct 10 23:24:21.707624 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1008/2060] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:21 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1510 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:21.737267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5ab5f359-81ab-4aae-919c-370afe3b49fb tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:21.738072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5ab5f359-81ab-4aae-919c-370afe3b49fb tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:21.750710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ab5f359-81ab-4aae-919c-370afe3b49fb tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:21.751411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ab5f359-81ab-4aae-919c-370afe3b49fb tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:21.751879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ab5f359-81ab-4aae-919c-370afe3b49fb tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:21.752647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ab5f359-81ab-4aae-919c-370afe3b49fb tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:21.757341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ab5f359-81ab-4aae-919c-370afe3b49fb tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:21.759093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ab5f359-81ab-4aae-919c-370afe3b49fb tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:22.434812 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-2a1bdcf2-3dd8-4a6f-9e73-6002c3ceaab3 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lazy-loading 'services' on Instance uuid 3a472045-8c28-4437-9e0f-9223369022ae {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:24:22.497792 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2a1bdcf2-3dd8-4a6f-9e73-6002c3ceaab3 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1969 microversion: 2.25 time: 0.972642 Oct 10 23:24:22.504143 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1053/2061] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:21 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1969 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:22.525480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c019d680-7235-4ab4-8352-36734cae1fca tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662a8c9550>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:22.658201 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c019d680-7235-4ab4-8352-36734cae1fca tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3" status: 200 len: 1413 microversion: 2.1 time: 0.148664 Oct 10 23:24:22.658837 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1054/2062] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:24:22 2022] GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3 => generated 1413 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:22.682496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3b47022c-79a6-4271-a4c5-edce920ce742 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:22.684444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3b47022c-79a6-4271-a4c5-edce920ce742 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] [instance: 5e6f2901-8ce0-455d-b905-6e3c34afee0e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:22.710888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b47022c-79a6-4271-a4c5-edce920ce742 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:22.711965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b47022c-79a6-4271-a4c5-edce920ce742 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:22.717060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b47022c-79a6-4271-a4c5-edce920ce742 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:22.721816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b47022c-79a6-4271-a4c5-edce920ce742 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:22.724906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b47022c-79a6-4271-a4c5-edce920ce742 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:22.726052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b47022c-79a6-4271-a4c5-edce920ce742 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:22.833157 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-3b47022c-79a6-4271-a4c5-edce920ce742 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] HTTP exception thrown: Instance 5e6f2901-8ce0-455d-b905-6e3c34afee0e could not be found. Oct 10 23:24:22.841671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3b47022c-79a6-4271-a4c5-edce920ce742 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Request method failure captured: Oct 10 23:24:22.841671 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e HTTP/1.1 Oct 10 23:24:22.841671 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:24:22.841671 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:24:22.841671 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:24:22.841671 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:24:22.841671 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:24:22.841671 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:24:22.841671 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:24:22.841671 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:24:22.841671 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKmIjdkbn9LqfvHxWWnuvaq5VsMKFYp10nhjF5cUJxaOstBngNmx7Ww4_CHbfZLHlTe2TUHEjT3VL3iN-Q5kWjR2tgT-8T2hobewxf9GV-ej63AlCjJcD2-X8k8Jnl2cA1jGYycDIPIXaSKeCJmrJGQk9mIeqVDgsQcdrOO4Lqp2Szk Oct 10 23:24:22.841671 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:24:22.841671 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:24:22.841671 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:24:22.841671 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:24:22.841671 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:24:22.841671 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:24:22.841671 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 1795ae26f5294bbaa444099b9c261f23 Oct 10 23:24:22.841671 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1022960313 Oct 10 23:24:22.841671 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:24:22.841671 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:24:22.844180 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1795ae26f5294bbaa444099b9c261f23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1795ae26f5294bbaa444099b9c261f23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1795ae26f5294bbaa444099b9c261f23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1795ae26f5294bbaa444099b9c261f23", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:24:22.844180 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1022960313 Oct 10 23:24:22.844180 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 1795ae26f5294bbaa444099b9c261f23 Oct 10 23:24:22.844180 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1022960313 Oct 10 23:24:22.844180 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerDiagnosticsNegativeTest-1022960313-project Oct 10 23:24:22.844180 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:24:22.844180 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:24:22.844180 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: bd9a7943bb264da19ee753ea3ce7ffce Oct 10 23:24:22.844180 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1022960313-project Oct 10 23:24:22.844180 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:24:22.844180 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 5e6f2901-8ce0-455d-b905-6e3c34afee0e could not be found. Oct 10 23:24:22.844180 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '5e6f2901-8ce0-455d-b905-6e3c34afee0e'} Oct 10 23:24:22.845702 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:24:22.845702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:24:22.845702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:24:22.845702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:24:22.845702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:24:22.845702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:24:22.845702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:24:22.845702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:24:22.845702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:24:22.845702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:24:22.845702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e6f2901-8ce0-455d-b905-6e3c34afee0e could not be found. Oct 10 23:24:22.845702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:24:22.845702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:24:22.845702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:24:22.845702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:24:22.845702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:24:22.845702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:24:22.845702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:24:22.845702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:24:22.845702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:24:22.849073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:24:22.849073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:24:22.849073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:24:22.849073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:24:22.849073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:24:22.849073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:24:22.849073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:24:22.849073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e6f2901-8ce0-455d-b905-6e3c34afee0e could not be found. Oct 10 23:24:22.849073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:24:22.849073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:24:22.849073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:24:22.849073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:24:22.849073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:24:22.849073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:24:22.849073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:24:22.849073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:24:22.849073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e6f2901-8ce0-455d-b905-6e3c34afee0e could not be found. Oct 10 23:24:22.849073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:24:22.851927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3b47022c-79a6-4271-a4c5-edce920ce742 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] Returning 404 to user: Instance 5e6f2901-8ce0-455d-b905-6e3c34afee0e could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:24:22.854002 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3b47022c-79a6-4271-a4c5-edce920ce742 tempest-ServerDiagnosticsNegativeTest-1022960313 tempest-ServerDiagnosticsNegativeTest-1022960313-project] 10.222.0.23 "GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e" status: 404 len: 111 microversion: 2.1 time: 0.189047 Oct 10 23:24:22.866758 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1055/2063] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:22 2022] GET /compute/v2.1/servers/5e6f2901-8ce0-455d-b905-6e3c34afee0e => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:24:22.919893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f4baa237-e05b-443a-9b91-a1b4233cb08a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:22.924910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f4baa237-e05b-443a-9b91-a1b4233cb08a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:22.946963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4baa237-e05b-443a-9b91-a1b4233cb08a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:22.947490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4baa237-e05b-443a-9b91-a1b4233cb08a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:22.948244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4baa237-e05b-443a-9b91-a1b4233cb08a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:22.951045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4baa237-e05b-443a-9b91-a1b4233cb08a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:22.951537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4baa237-e05b-443a-9b91-a1b4233cb08a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:22.954462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4baa237-e05b-443a-9b91-a1b4233cb08a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:22.971348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5ab5f359-81ab-4aae-919c-370afe3b49fb tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:23.007766 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5ab5f359-81ab-4aae-919c-370afe3b49fb tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1726 microversion: 2.1 time: 1.298562 Oct 10 23:24:23.008408 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1009/2064] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:21 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1726 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:23.041445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-debd5ce1-8c92-4266-8b7f-b621b298b770 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:23.068025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-debd5ce1-8c92-4266-8b7f-b621b298b770 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:23.075544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-debd5ce1-8c92-4266-8b7f-b621b298b770 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:23.077963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-debd5ce1-8c92-4266-8b7f-b621b298b770 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:23.091761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-debd5ce1-8c92-4266-8b7f-b621b298b770 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:23.092907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-debd5ce1-8c92-4266-8b7f-b621b298b770 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:23.098505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-debd5ce1-8c92-4266-8b7f-b621b298b770 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:23.173667 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-debd5ce1-8c92-4266-8b7f-b621b298b770 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.157439 Oct 10 23:24:23.174902 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1010/2065] 10.222.0.23 () {60 vars in 1217 bytes} [Mon Oct 10 23:24:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:24:23.180588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-77b300ba-8ba2-4b4b-82b0-13fbbe8c7f40 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:23.181521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-77b300ba-8ba2-4b4b-82b0-13fbbe8c7f40 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:23.190400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77b300ba-8ba2-4b4b-82b0-13fbbe8c7f40 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:23.191964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77b300ba-8ba2-4b4b-82b0-13fbbe8c7f40 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:23.192788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77b300ba-8ba2-4b4b-82b0-13fbbe8c7f40 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:23.214880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77b300ba-8ba2-4b4b-82b0-13fbbe8c7f40 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:23.227195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77b300ba-8ba2-4b4b-82b0-13fbbe8c7f40 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:23.228488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77b300ba-8ba2-4b4b-82b0-13fbbe8c7f40 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:23.452123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f4baa237-e05b-443a-9b91-a1b4233cb08a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:23.464655 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f4baa237-e05b-443a-9b91-a1b4233cb08a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1184 microversion: 2.1 time: 0.589174 Oct 10 23:24:23.486248 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1056/2066] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:22 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1184 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:23.500538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-48a4b4f1-c8e2-48f6-a374-858bbb574bf3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:23.501154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-48a4b4f1-c8e2-48f6-a374-858bbb574bf3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:23.504220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:23.525961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48a4b4f1-c8e2-48f6-a374-858bbb574bf3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:23.538153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48a4b4f1-c8e2-48f6-a374-858bbb574bf3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:23.539124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48a4b4f1-c8e2-48f6-a374-858bbb574bf3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:23.540053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48a4b4f1-c8e2-48f6-a374-858bbb574bf3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:23.540688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48a4b4f1-c8e2-48f6-a374-858bbb574bf3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:23.541287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48a4b4f1-c8e2-48f6-a374-858bbb574bf3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:23.643027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-48a4b4f1-c8e2-48f6-a374-858bbb574bf3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:23.667978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-48a4b4f1-c8e2-48f6-a374-858bbb574bf3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:23.669931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-48a4b4f1-c8e2-48f6-a374-858bbb574bf3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:23.676440 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-48a4b4f1-c8e2-48f6-a374-858bbb574bf3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1531 microversion: 2.91 time: 0.189008 Oct 10 23:24:23.678435 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1057/2067] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:23 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1531 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:23.691109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d6b8511e-8e0d-4b62-92a2-de2ece547c3d tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860864-2", "block_migration": "auto"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:23.694236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d6b8511e-8e0d-4b62-92a2-de2ece547c3d tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:23.711529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6b8511e-8e0d-4b62-92a2-de2ece547c3d tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:23.713720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6b8511e-8e0d-4b62-92a2-de2ece547c3d tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:23.715351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6b8511e-8e0d-4b62-92a2-de2ece547c3d tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:23.718408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6b8511e-8e0d-4b62-92a2-de2ece547c3d tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:23.719286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6b8511e-8e0d-4b62-92a2-de2ece547c3d tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:23.719901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6b8511e-8e0d-4b62-92a2-de2ece547c3d tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:23.758802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:23.775619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-d6b8511e-8e0d-4b62-92a2-de2ece547c3d tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lazy-loading 'flavor' on Instance uuid 3a472045-8c28-4437-9e0f-9223369022ae {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:24:23.835914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d6b8511e-8e0d-4b62-92a2-de2ece547c3d tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Going to try to live migrate instance to n-h2-860864-2 {{(pid=120614) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 23:24:23.844177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-77b300ba-8ba2-4b4b-82b0-13fbbe8c7f40 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df36ffee3e4544a8baf6265d915716bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7340f5ad1bea4967850a88c986602b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:23.854576 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-77b300ba-8ba2-4b4b-82b0-13fbbe8c7f40 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20" status: 200 len: 1317 microversion: 2.1 time: 0.678195 Oct 10 23:24:23.855110 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1011/2068] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:23 2022] GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 => generated 1317 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:23.879025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ed64cd18-3887-437b-92a1-fce64dcc5eba tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b143040>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:23.988777 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ed64cd18-3887-437b-92a1-fce64dcc5eba tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3" status: 200 len: 1413 microversion: 2.1 time: 0.119305 Oct 10 23:24:23.992702 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1012/2069] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:24:23 2022] GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3 => generated 1413 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:24.627600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0fe3d9b2-5a8c-496c-8306-fdd266181eda tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:24.628593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0fe3d9b2-5a8c-496c-8306-fdd266181eda tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:24.642746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fe3d9b2-5a8c-496c-8306-fdd266181eda tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:24.646507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fe3d9b2-5a8c-496c-8306-fdd266181eda tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:24.647701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fe3d9b2-5a8c-496c-8306-fdd266181eda tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:24.649267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fe3d9b2-5a8c-496c-8306-fdd266181eda tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:24.650447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fe3d9b2-5a8c-496c-8306-fdd266181eda tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:24.654564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fe3d9b2-5a8c-496c-8306-fdd266181eda tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:24.906013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-0fe3d9b2-5a8c-496c-8306-fdd266181eda tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lazy-loading 'services' on Instance uuid 2031b270-ebc4-4583-8a2c-086ad7842cba {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:24:24.910197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:24.953147 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0fe3d9b2-5a8c-496c-8306-fdd266181eda tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1936 microversion: 2.91 time: 0.957621 Oct 10 23:24:24.981519 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1013/2070] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:23 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1936 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:25.012421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8f45c39d-c30d-47fe-b5b4-6d3af1b53e06 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:25.013949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8f45c39d-c30d-47fe-b5b4-6d3af1b53e06 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:25.040658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f45c39d-c30d-47fe-b5b4-6d3af1b53e06 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:25.043138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f45c39d-c30d-47fe-b5b4-6d3af1b53e06 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:25.046225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f45c39d-c30d-47fe-b5b4-6d3af1b53e06 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:25.052993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f45c39d-c30d-47fe-b5b4-6d3af1b53e06 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:25.053840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f45c39d-c30d-47fe-b5b4-6d3af1b53e06 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:25.055754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f45c39d-c30d-47fe-b5b4-6d3af1b53e06 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:25.389346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8f45c39d-c30d-47fe-b5b4-6d3af1b53e06 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:25.403367 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8f45c39d-c30d-47fe-b5b4-6d3af1b53e06 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1726 microversion: 2.1 time: 0.420457 Oct 10 23:24:25.404564 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1014/2071] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:24 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1726 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:25.416997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-cc8607e8-7b3e-4f7a-9ab5-9f9d170f5dea req-64ce3c78-9f06-4ec0-bfd7-01352b3f8dcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bc10526-4ed2-4d25-bbf1-62b5b5b38b20", "tag": "a4608dac-974c-4e7f-a564-49f4a5dd0c04"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:25.443916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cc8607e8-7b3e-4f7a-9ab5-9f9d170f5dea req-64ce3c78-9f06-4ec0-bfd7-01352b3f8dcb service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:25.445917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cc8607e8-7b3e-4f7a-9ab5-9f9d170f5dea req-64ce3c78-9f06-4ec0-bfd7-01352b3f8dcb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:25.447913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cc8607e8-7b3e-4f7a-9ab5-9f9d170f5dea req-64ce3c78-9f06-4ec0-bfd7-01352b3f8dcb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:25.518013 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-cc8607e8-7b3e-4f7a-9ab5-9f9d170f5dea req-64ce3c78-9f06-4ec0-bfd7-01352b3f8dcb service nova] Creating event network-changed:a4608dac-974c-4e7f-a564-49f4a5dd0c04 for instance 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 on n-h2-860864-2 Oct 10 23:24:25.534937 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-cc8607e8-7b3e-4f7a-9ab5-9f9d170f5dea req-64ce3c78-9f06-4ec0-bfd7-01352b3f8dcb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124869 Oct 10 23:24:25.540493 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1015/2072] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:24:25.562482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-54c818bf-3a83-4fe8-9104-1691ad4d1f60 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:25.564690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-54c818bf-3a83-4fe8-9104-1691ad4d1f60 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:25.593709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54c818bf-3a83-4fe8-9104-1691ad4d1f60 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:25.594601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54c818bf-3a83-4fe8-9104-1691ad4d1f60 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:25.602155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54c818bf-3a83-4fe8-9104-1691ad4d1f60 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:25.603229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54c818bf-3a83-4fe8-9104-1691ad4d1f60 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:25.604057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54c818bf-3a83-4fe8-9104-1691ad4d1f60 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:25.604675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54c818bf-3a83-4fe8-9104-1691ad4d1f60 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:25.755246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-54c818bf-3a83-4fe8-9104-1691ad4d1f60 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:25.778277 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-54c818bf-3a83-4fe8-9104-1691ad4d1f60 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1184 microversion: 2.1 time: 0.236378 Oct 10 23:24:25.797128 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1016/2073] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:25 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1184 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:25.821880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c63e1a5a-6737-4a5c-b848-37d2a69c7c8e tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:25.825589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c63e1a5a-6737-4a5c-b848-37d2a69c7c8e tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:25.851052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c63e1a5a-6737-4a5c-b848-37d2a69c7c8e tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:25.855250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c63e1a5a-6737-4a5c-b848-37d2a69c7c8e tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:25.861111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c63e1a5a-6737-4a5c-b848-37d2a69c7c8e tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:25.862759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c63e1a5a-6737-4a5c-b848-37d2a69c7c8e tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:25.868253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c63e1a5a-6737-4a5c-b848-37d2a69c7c8e tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:25.869133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c63e1a5a-6737-4a5c-b848-37d2a69c7c8e tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:26.304514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c63e1a5a-6737-4a5c-b848-37d2a69c7c8e tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df36ffee3e4544a8baf6265d915716bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7340f5ad1bea4967850a88c986602b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:26.322787 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c63e1a5a-6737-4a5c-b848-37d2a69c7c8e tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20" status: 200 len: 1317 microversion: 2.1 time: 0.523939 Oct 10 23:24:26.341317 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1017/2074] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:25 2022] GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 => generated 1317 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:26.351974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-eea7d3cb-8f92-4ad2-b808-6f14a39e2881 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:26.353805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-eea7d3cb-8f92-4ad2-b808-6f14a39e2881 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:26.370083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eea7d3cb-8f92-4ad2-b808-6f14a39e2881 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:26.371959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eea7d3cb-8f92-4ad2-b808-6f14a39e2881 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:26.374499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eea7d3cb-8f92-4ad2-b808-6f14a39e2881 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:26.378307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eea7d3cb-8f92-4ad2-b808-6f14a39e2881 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:26.379028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eea7d3cb-8f92-4ad2-b808-6f14a39e2881 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:26.381247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eea7d3cb-8f92-4ad2-b808-6f14a39e2881 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:26.577607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=16 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:26.587755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-eea7d3cb-8f92-4ad2-b808-6f14a39e2881 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lazy-loading 'services' on Instance uuid 2031b270-ebc4-4583-8a2c-086ad7842cba {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:24:26.635119 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-eea7d3cb-8f92-4ad2-b808-6f14a39e2881 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1936 microversion: 2.91 time: 0.290240 Oct 10 23:24:26.635760 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1018/2075] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:26 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1936 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:26.649398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0b696f04-0685-48ee-95af-76ed67341474 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b0148b0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:26.724855 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0b696f04-0685-48ee-95af-76ed67341474 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3" status: 200 len: 1413 microversion: 2.1 time: 0.087947 Oct 10 23:24:26.734285 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1019/2076] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:24:26 2022] GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3 => generated 1413 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:26.743476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-da10b567-5b80-4277-8daa-2fe4aa84a0f7 req-a28ac2da-9fd8-401b-b193-5a696d56557f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe142b1-562e-4ca2-a300-84a0bf7353ac", "name": "network-vif-plugged", "status": "completed", "tag": "183fcafc-50f1-4a82-bda7-809f6f81821e"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:26.760946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-da10b567-5b80-4277-8daa-2fe4aa84a0f7 req-a28ac2da-9fd8-401b-b193-5a696d56557f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:26.761448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-da10b567-5b80-4277-8daa-2fe4aa84a0f7 req-a28ac2da-9fd8-401b-b193-5a696d56557f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:26.761875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-da10b567-5b80-4277-8daa-2fe4aa84a0f7 req-a28ac2da-9fd8-401b-b193-5a696d56557f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:26.785965 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-da10b567-5b80-4277-8daa-2fe4aa84a0f7 req-a28ac2da-9fd8-401b-b193-5a696d56557f service nova] Creating event network-vif-plugged:183fcafc-50f1-4a82-bda7-809f6f81821e for instance abe142b1-562e-4ca2-a300-84a0bf7353ac on n-h2-860864-2 Oct 10 23:24:26.807350 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-da10b567-5b80-4277-8daa-2fe4aa84a0f7 req-a28ac2da-9fd8-401b-b193-5a696d56557f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071701 Oct 10 23:24:26.809250 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1020/2077] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:24:26.831459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9181cc7f-908d-49c6-9513-16cd5830f884 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:26.832167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9181cc7f-908d-49c6-9513-16cd5830f884 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:26.849085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9181cc7f-908d-49c6-9513-16cd5830f884 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:26.858644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9181cc7f-908d-49c6-9513-16cd5830f884 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:26.859498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9181cc7f-908d-49c6-9513-16cd5830f884 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:26.860543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9181cc7f-908d-49c6-9513-16cd5830f884 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:26.861169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9181cc7f-908d-49c6-9513-16cd5830f884 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:26.861789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9181cc7f-908d-49c6-9513-16cd5830f884 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:27.295492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9181cc7f-908d-49c6-9513-16cd5830f884 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:27.312344 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9181cc7f-908d-49c6-9513-16cd5830f884 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1726 microversion: 2.1 time: 0.494342 Oct 10 23:24:27.314000 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1021/2078] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:26 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1726 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:27.322817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8a801782-d65a-44f4-ab89-272914579692 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:27.331477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a801782-d65a-44f4-ab89-272914579692 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:27.335676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a801782-d65a-44f4-ab89-272914579692 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:27.337994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a801782-d65a-44f4-ab89-272914579692 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:27.340240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a801782-d65a-44f4-ab89-272914579692 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:27.344458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a801782-d65a-44f4-ab89-272914579692 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:27.345326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a801782-d65a-44f4-ab89-272914579692 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:27.404723 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8a801782-d65a-44f4-ab89-272914579692 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.089354 Oct 10 23:24:27.417670 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1022/2079] 10.222.0.23 () {60 vars in 1217 bytes} [Mon Oct 10 23:24:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:24:27.427938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1261608c-b0d5-49f9-a669-e26a897e7a21 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:27.428811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1261608c-b0d5-49f9-a669-e26a897e7a21 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:27.446897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1261608c-b0d5-49f9-a669-e26a897e7a21 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:27.448729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1261608c-b0d5-49f9-a669-e26a897e7a21 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:27.452426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1261608c-b0d5-49f9-a669-e26a897e7a21 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:27.453884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1261608c-b0d5-49f9-a669-e26a897e7a21 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:27.456543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1261608c-b0d5-49f9-a669-e26a897e7a21 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:27.457555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1261608c-b0d5-49f9-a669-e26a897e7a21 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:27.643802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1261608c-b0d5-49f9-a669-e26a897e7a21 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:27.658460 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1261608c-b0d5-49f9-a669-e26a897e7a21 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1184 microversion: 2.1 time: 0.234848 Oct 10 23:24:27.673408 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1023/2080] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:27 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1184 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:27.673408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-057d8abe-3be7-43c6-9b7f-4d9999dc802b tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:27.679342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-057d8abe-3be7-43c6-9b7f-4d9999dc802b tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:27.689160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-057d8abe-3be7-43c6-9b7f-4d9999dc802b tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:27.689703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-057d8abe-3be7-43c6-9b7f-4d9999dc802b tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:27.690145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-057d8abe-3be7-43c6-9b7f-4d9999dc802b tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:27.691710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-057d8abe-3be7-43c6-9b7f-4d9999dc802b tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:27.692187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-057d8abe-3be7-43c6-9b7f-4d9999dc802b tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:27.692628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-057d8abe-3be7-43c6-9b7f-4d9999dc802b tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:28.664312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-057d8abe-3be7-43c6-9b7f-4d9999dc802b tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df36ffee3e4544a8baf6265d915716bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7340f5ad1bea4967850a88c986602b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:28.706258 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-057d8abe-3be7-43c6-9b7f-4d9999dc802b tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20" status: 200 len: 1317 microversion: 2.1 time: 1.043599 Oct 10 23:24:28.710652 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1024/2081] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:27 2022] GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 => generated 1317 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:28.742784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2bbf88d8-3c92-4c20-9a5b-8c5c2f63ef00 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:28.744681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2bbf88d8-3c92-4c20-9a5b-8c5c2f63ef00 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:28.771445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bbf88d8-3c92-4c20-9a5b-8c5c2f63ef00 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:28.780870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bbf88d8-3c92-4c20-9a5b-8c5c2f63ef00 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:28.781692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bbf88d8-3c92-4c20-9a5b-8c5c2f63ef00 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:28.784423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bbf88d8-3c92-4c20-9a5b-8c5c2f63ef00 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:28.790527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bbf88d8-3c92-4c20-9a5b-8c5c2f63ef00 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:28.791455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bbf88d8-3c92-4c20-9a5b-8c5c2f63ef00 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:28.896755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-2bbf88d8-3c92-4c20-9a5b-8c5c2f63ef00 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lazy-loading 'flavor' on Instance uuid 2031b270-ebc4-4583-8a2c-086ad7842cba {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:24:29.712657 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2bbf88d8-3c92-4c20-9a5b-8c5c2f63ef00 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "POST /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba/action" status: 202 len: 0 microversion: 2.91 time: 0.991172 Oct 10 23:24:29.718799 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1025/2082] 10.222.0.23 () {62 vars in 1319 bytes} [Mon Oct 10 23:24:28 2022] POST /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba/action => generated 0 bytes in 1004 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:24:29.774996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3fdafa8d-96c7-4d58-8bbb-5bc718cbf635 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b143160>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:29.886840 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d6b8511e-8e0d-4b62-92a2-de2ece547c3d tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae/action" status: 202 len: 0 microversion: 2.25 time: 6.199805 Oct 10 23:24:29.887837 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1058/2083] 10.222.0.23 () {62 vars in 1319 bytes} [Mon Oct 10 23:24:23 2022] POST /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae/action => generated 0 bytes in 6201 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:24:29.895821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ba341fde-2b4e-4348-9f86-01fa8924c723 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:29.896489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ba341fde-2b4e-4348-9f86-01fa8924c723 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:29.914590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba341fde-2b4e-4348-9f86-01fa8924c723 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:29.915759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba341fde-2b4e-4348-9f86-01fa8924c723 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:29.918038 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3fdafa8d-96c7-4d58-8bbb-5bc718cbf635 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3" status: 200 len: 1413 microversion: 2.1 time: 0.194120 Oct 10 23:24:29.919331 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1026/2084] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:24:29 2022] GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3 => generated 1413 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:29.927650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1dd7585b-4a91-489e-8f9f-85e124bd1f1e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:29.928968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1dd7585b-4a91-489e-8f9f-85e124bd1f1e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:29.929489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba341fde-2b4e-4348-9f86-01fa8924c723 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:29.930342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba341fde-2b4e-4348-9f86-01fa8924c723 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:29.930841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba341fde-2b4e-4348-9f86-01fa8924c723 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:29.931282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba341fde-2b4e-4348-9f86-01fa8924c723 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:29.938795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1dd7585b-4a91-489e-8f9f-85e124bd1f1e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:29.940147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1dd7585b-4a91-489e-8f9f-85e124bd1f1e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:29.941013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1dd7585b-4a91-489e-8f9f-85e124bd1f1e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:29.942013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1dd7585b-4a91-489e-8f9f-85e124bd1f1e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:29.942996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1dd7585b-4a91-489e-8f9f-85e124bd1f1e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:29.943831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1dd7585b-4a91-489e-8f9f-85e124bd1f1e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:30.141920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1dd7585b-4a91-489e-8f9f-85e124bd1f1e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:30.175309 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1dd7585b-4a91-489e-8f9f-85e124bd1f1e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1184 microversion: 2.1 time: 0.251484 Oct 10 23:24:30.176027 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1027/2085] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:29 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1184 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:30.230949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fb21f114-ac38-468b-a5c8-f628447dd6d1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:30.233066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fb21f114-ac38-468b-a5c8-f628447dd6d1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:30.273330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb21f114-ac38-468b-a5c8-f628447dd6d1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:30.276327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb21f114-ac38-468b-a5c8-f628447dd6d1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:30.277971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb21f114-ac38-468b-a5c8-f628447dd6d1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:30.284862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb21f114-ac38-468b-a5c8-f628447dd6d1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:30.285788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb21f114-ac38-468b-a5c8-f628447dd6d1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:30.286498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb21f114-ac38-468b-a5c8-f628447dd6d1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:30.540347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ba341fde-2b4e-4348-9f86-01fa8924c723 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:30.550711 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ba341fde-2b4e-4348-9f86-01fa8924c723 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1726 microversion: 2.1 time: 0.661038 Oct 10 23:24:30.551702 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1059/2086] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:29 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1726 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:30.558663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-134240d1-8649-48d2-875d-cdb5dd075613 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:30.560028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-134240d1-8649-48d2-875d-cdb5dd075613 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:30.569597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-134240d1-8649-48d2-875d-cdb5dd075613 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:30.570700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-134240d1-8649-48d2-875d-cdb5dd075613 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:30.571605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-134240d1-8649-48d2-875d-cdb5dd075613 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:30.573292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-134240d1-8649-48d2-875d-cdb5dd075613 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:30.574087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-134240d1-8649-48d2-875d-cdb5dd075613 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:30.575361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-134240d1-8649-48d2-875d-cdb5dd075613 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:30.595734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fb21f114-ac38-468b-a5c8-f628447dd6d1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:30.618040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fb21f114-ac38-468b-a5c8-f628447dd6d1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:30.621588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fb21f114-ac38-468b-a5c8-f628447dd6d1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:30.641513 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fb21f114-ac38-468b-a5c8-f628447dd6d1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.441493 Oct 10 23:24:30.644210 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1028/2087] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:30 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:30.660047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-84e91561-0f3a-4a1d-97ce-9b369612248e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:30.661473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-84e91561-0f3a-4a1d-97ce-9b369612248e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:30.679015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84e91561-0f3a-4a1d-97ce-9b369612248e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:30.679548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84e91561-0f3a-4a1d-97ce-9b369612248e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:30.682225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84e91561-0f3a-4a1d-97ce-9b369612248e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:30.683062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84e91561-0f3a-4a1d-97ce-9b369612248e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:30.685587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84e91561-0f3a-4a1d-97ce-9b369612248e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:30.686064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84e91561-0f3a-4a1d-97ce-9b369612248e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:30.930994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-134240d1-8649-48d2-875d-cdb5dd075613 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df36ffee3e4544a8baf6265d915716bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7340f5ad1bea4967850a88c986602b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:30.945106 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-134240d1-8649-48d2-875d-cdb5dd075613 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20" status: 200 len: 1317 microversion: 2.1 time: 0.392045 Oct 10 23:24:30.946804 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1060/2088] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:30 2022] GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:30.977368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-fbd61760-cf13-45e1-9771-1b638dd2e3c5 req-c8cbd112-9c93-49d0-bf56-06768b43a6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bc10526-4ed2-4d25-bbf1-62b5b5b38b20", "name": "network-vif-plugged", "status": "completed", "tag": "a4608dac-974c-4e7f-a564-49f4a5dd0c04"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:31.020958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fbd61760-cf13-45e1-9771-1b638dd2e3c5 req-c8cbd112-9c93-49d0-bf56-06768b43a6d3 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:31.022952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fbd61760-cf13-45e1-9771-1b638dd2e3c5 req-c8cbd112-9c93-49d0-bf56-06768b43a6d3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:31.024053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fbd61760-cf13-45e1-9771-1b638dd2e3c5 req-c8cbd112-9c93-49d0-bf56-06768b43a6d3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:31.076892 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-fbd61760-cf13-45e1-9771-1b638dd2e3c5 req-c8cbd112-9c93-49d0-bf56-06768b43a6d3 service nova] Creating event network-vif-plugged:a4608dac-974c-4e7f-a564-49f4a5dd0c04 for instance 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 on n-h2-860864-2 Oct 10 23:24:31.099586 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-fbd61760-cf13-45e1-9771-1b638dd2e3c5 req-c8cbd112-9c93-49d0-bf56-06768b43a6d3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149328 Oct 10 23:24:31.108576 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1061/2089] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:24:31.128564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-795b5cc5-d217-4ce6-b36b-123af0244d8f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b41ca60>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:31.247386 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-795b5cc5-d217-4ce6-b36b-123af0244d8f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3" status: 200 len: 1413 microversion: 2.1 time: 0.135621 Oct 10 23:24:31.248307 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1062/2090] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:24:31 2022] GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3 => generated 1413 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:31.272753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-261eb6bc-008b-4ce0-8a97-a3f69ef2bc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:31.287699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-261eb6bc-008b-4ce0-8a97-a3f69ef2bc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:31.344048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-261eb6bc-008b-4ce0-8a97-a3f69ef2bc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:31.345347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-261eb6bc-008b-4ce0-8a97-a3f69ef2bc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:31.349250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-261eb6bc-008b-4ce0-8a97-a3f69ef2bc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:31.350363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-261eb6bc-008b-4ce0-8a97-a3f69ef2bc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:31.352268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-261eb6bc-008b-4ce0-8a97-a3f69ef2bc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:31.352880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-261eb6bc-008b-4ce0-8a97-a3f69ef2bc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:31.509614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-261eb6bc-008b-4ce0-8a97-a3f69ef2bc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:31.514981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-261eb6bc-008b-4ce0-8a97-a3f69ef2bc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:31.515909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-261eb6bc-008b-4ce0-8a97-a3f69ef2bc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:31.516402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-261eb6bc-008b-4ce0-8a97-a3f69ef2bc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lazy-loading 'fault' on Instance uuid e9431e2e-3fb9-4834-8827-88c1e3762543 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:24:31.636792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-84e91561-0f3a-4a1d-97ce-9b369612248e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:31.651668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-84e91561-0f3a-4a1d-97ce-9b369612248e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:31.657062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-84e91561-0f3a-4a1d-97ce-9b369612248e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:31.658744 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-84e91561-0f3a-4a1d-97ce-9b369612248e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 1.013457 Oct 10 23:24:31.660678 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1029/2091] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:30 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:31.666197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f153b3f0-968f-4c00-af2b-8684e0ffc406 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:31.667093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f153b3f0-968f-4c00-af2b-8684e0ffc406 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:31.675112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f153b3f0-968f-4c00-af2b-8684e0ffc406 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:31.676199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f153b3f0-968f-4c00-af2b-8684e0ffc406 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:31.676896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f153b3f0-968f-4c00-af2b-8684e0ffc406 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:31.677908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f153b3f0-968f-4c00-af2b-8684e0ffc406 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:31.678605 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f153b3f0-968f-4c00-af2b-8684e0ffc406 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:31.679383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f153b3f0-968f-4c00-af2b-8684e0ffc406 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:31.756407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-261eb6bc-008b-4ce0-8a97-a3f69ef2bc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:31.770695 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-261eb6bc-008b-4ce0-8a97-a3f69ef2bc52 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1189 microversion: 2.1 time: 0.521072 Oct 10 23:24:31.777933 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1063/2092] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:31 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1189 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:32.090014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f153b3f0-968f-4c00-af2b-8684e0ffc406 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:32.091285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e8075088-50eb-4fb4-b0fd-fea95c51839b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2004204980", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:32.100421 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f153b3f0-968f-4c00-af2b-8684e0ffc406 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1726 microversion: 2.1 time: 0.438183 Oct 10 23:24:32.105272 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1030/2093] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:31 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1726 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:32.112805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-94e2a516-1038-4990-8543-681df7cbecb2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:32.116863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-94e2a516-1038-4990-8543-681df7cbecb2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:32.133166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94e2a516-1038-4990-8543-681df7cbecb2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:32.135539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94e2a516-1038-4990-8543-681df7cbecb2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:32.136202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94e2a516-1038-4990-8543-681df7cbecb2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:32.137790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94e2a516-1038-4990-8543-681df7cbecb2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:32.138809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94e2a516-1038-4990-8543-681df7cbecb2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:32.141041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94e2a516-1038-4990-8543-681df7cbecb2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:32.263792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-94e2a516-1038-4990-8543-681df7cbecb2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:32.278248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-94e2a516-1038-4990-8543-681df7cbecb2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:32.284596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-94e2a516-1038-4990-8543-681df7cbecb2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:32.288579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-e8075088-50eb-4fb4-b0fd-fea95c51839b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] validate_networks() for None {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:24:32.298505 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-94e2a516-1038-4990-8543-681df7cbecb2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.191810 Oct 10 23:24:32.299832 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1031/2094] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:32 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:32.309898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-12f1dbd6-a1b1-4bc9-a31d-184b4be94c75 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:32.322511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-12f1dbd6-a1b1-4bc9-a31d-184b4be94c75 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:32.333068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12f1dbd6-a1b1-4bc9-a31d-184b4be94c75 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:32.333668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12f1dbd6-a1b1-4bc9-a31d-184b4be94c75 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:32.334067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12f1dbd6-a1b1-4bc9-a31d-184b4be94c75 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:32.334789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12f1dbd6-a1b1-4bc9-a31d-184b4be94c75 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:32.337898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12f1dbd6-a1b1-4bc9-a31d-184b4be94c75 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:32.338764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12f1dbd6-a1b1-4bc9-a31d-184b4be94c75 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:32.352746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:32.671541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-12f1dbd6-a1b1-4bc9-a31d-184b4be94c75 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df36ffee3e4544a8baf6265d915716bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7340f5ad1bea4967850a88c986602b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:32.683250 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-12f1dbd6-a1b1-4bc9-a31d-184b4be94c75 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20" status: 200 len: 1317 microversion: 2.1 time: 0.381989 Oct 10 23:24:32.689434 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1032/2095] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:32 2022] GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:32.697786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6b482dab-8b8e-4930-93df-2c3d8e903611 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b014b80>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:32.782109 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6b482dab-8b8e-4930-93df-2c3d8e903611 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3" status: 200 len: 1413 microversion: 2.1 time: 0.095230 Oct 10 23:24:32.782712 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1033/2096] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:24:32 2022] GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:32.795100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-359a558f-c746-4e9e-89d9-7878c0848af1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:32.796964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-359a558f-c746-4e9e-89d9-7878c0848af1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:32.812256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-359a558f-c746-4e9e-89d9-7878c0848af1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:32.812748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-359a558f-c746-4e9e-89d9-7878c0848af1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:32.816238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-359a558f-c746-4e9e-89d9-7878c0848af1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:32.817628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-359a558f-c746-4e9e-89d9-7878c0848af1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:32.818898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-359a558f-c746-4e9e-89d9-7878c0848af1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:32.819605 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-359a558f-c746-4e9e-89d9-7878c0848af1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:33.178793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-359a558f-c746-4e9e-89d9-7878c0848af1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:33.189285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-359a558f-c746-4e9e-89d9-7878c0848af1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:33.196471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-359a558f-c746-4e9e-89d9-7878c0848af1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:33.198157 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-359a558f-c746-4e9e-89d9-7878c0848af1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 0.413835 Oct 10 23:24:33.201896 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1034/2097] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:32 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:33.207135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d2d421fb-de47-43d8-9e9b-33d45804c6e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:33.212433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d2d421fb-de47-43d8-9e9b-33d45804c6e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:33.228562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2d421fb-de47-43d8-9e9b-33d45804c6e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:33.230158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2d421fb-de47-43d8-9e9b-33d45804c6e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:33.233539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2d421fb-de47-43d8-9e9b-33d45804c6e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:33.234666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2d421fb-de47-43d8-9e9b-33d45804c6e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:33.235320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2d421fb-de47-43d8-9e9b-33d45804c6e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:33.236876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2d421fb-de47-43d8-9e9b-33d45804c6e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:33.312022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e8075088-50eb-4fb4-b0fd-fea95c51839b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:24:33.312610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e8075088-50eb-4fb4-b0fd-fea95c51839b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:24:33.312899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e8075088-50eb-4fb4-b0fd-fea95c51839b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:24:33.313317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e8075088-50eb-4fb4-b0fd-fea95c51839b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:24:33.313789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e8075088-50eb-4fb4-b0fd-fea95c51839b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:24:33.331925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8075088-50eb-4fb4-b0fd-fea95c51839b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:33.332425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8075088-50eb-4fb4-b0fd-fea95c51839b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:33.332868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8075088-50eb-4fb4-b0fd-fea95c51839b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:33.337166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2d421fb-de47-43d8-9e9b-33d45804c6e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:33.339711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2d421fb-de47-43d8-9e9b-33d45804c6e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:33.341960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8075088-50eb-4fb4-b0fd-fea95c51839b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:33.342427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8075088-50eb-4fb4-b0fd-fea95c51839b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:33.343534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8075088-50eb-4fb4-b0fd-fea95c51839b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:33.344671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2d421fb-de47-43d8-9e9b-33d45804c6e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:33.346387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-d2d421fb-de47-43d8-9e9b-33d45804c6e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lazy-loading 'fault' on Instance uuid e9431e2e-3fb9-4834-8827-88c1e3762543 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:24:33.381740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-e8075088-50eb-4fb4-b0fd-fea95c51839b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Getting quotas for project b6f65dbe8455479391d42d0a97fa1305. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:24:33.392504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-e8075088-50eb-4fb4-b0fd-fea95c51839b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Getting quotas for user be8faa9362e94ceab173df40b3008af1 and project b6f65dbe8455479391d42d0a97fa1305. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:24:33.431399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e8075088-50eb-4fb4-b0fd-fea95c51839b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:24:33.434246 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e8075088-50eb-4fb4-b0fd-fea95c51839b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: e47ddcc1-9723-4e88-8c1d-ded295d4e989] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:24:33.464817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d2d421fb-de47-43d8-9e9b-33d45804c6e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:33.482778 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d2d421fb-de47-43d8-9e9b-33d45804c6e6 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1189 microversion: 2.1 time: 0.279431 Oct 10 23:24:33.503052 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1035/2098] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:33 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1189 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:33.517945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9a538b33-c7fa-4148-becd-16925c6b67b2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:33.518604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9a538b33-c7fa-4148-becd-16925c6b67b2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:33.538552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a538b33-c7fa-4148-becd-16925c6b67b2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:33.539415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a538b33-c7fa-4148-becd-16925c6b67b2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:33.539869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a538b33-c7fa-4148-becd-16925c6b67b2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:33.540621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a538b33-c7fa-4148-becd-16925c6b67b2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:33.544549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a538b33-c7fa-4148-becd-16925c6b67b2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:33.545075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a538b33-c7fa-4148-becd-16925c6b67b2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:33.571249 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e8075088-50eb-4fb4-b0fd-fea95c51839b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.791307 Oct 10 23:24:33.587024 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1064/2099] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:24:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:24:33.605970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3c081d7e-240e-49a8-bcd5-815ba66c398b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:33.615091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3c081d7e-240e-49a8-bcd5-815ba66c398b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:33.651131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c081d7e-240e-49a8-bcd5-815ba66c398b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:33.651936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c081d7e-240e-49a8-bcd5-815ba66c398b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:33.658043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c081d7e-240e-49a8-bcd5-815ba66c398b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:33.666421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c081d7e-240e-49a8-bcd5-815ba66c398b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:33.667168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c081d7e-240e-49a8-bcd5-815ba66c398b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:33.668538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c081d7e-240e-49a8-bcd5-815ba66c398b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:33.940241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3c081d7e-240e-49a8-bcd5-815ba66c398b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:33.956096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3c081d7e-240e-49a8-bcd5-815ba66c398b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:33.965976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3c081d7e-240e-49a8-bcd5-815ba66c398b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:33.991079 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3c081d7e-240e-49a8-bcd5-815ba66c398b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.395555 Oct 10 23:24:33.994391 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1065/2100] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:33 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:34.006602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d4b59d1a-bc00-4759-8af2-206c98d3e100 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:34.007563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d4b59d1a-bc00-4759-8af2-206c98d3e100 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: e47ddcc1-9723-4e88-8c1d-ded295d4e989] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:34.074025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9a538b33-c7fa-4148-becd-16925c6b67b2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:34.084048 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9a538b33-c7fa-4148-becd-16925c6b67b2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1726 microversion: 2.1 time: 0.579056 Oct 10 23:24:34.089517 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1036/2101] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:33 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1726 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:34.104843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7a3df390-9cde-45e4-aa68-88a9cb3ccc62 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:34.105196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7a3df390-9cde-45e4-aa68-88a9cb3ccc62 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:34.119715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a3df390-9cde-45e4-aa68-88a9cb3ccc62 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:34.122222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a3df390-9cde-45e4-aa68-88a9cb3ccc62 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:34.122493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a3df390-9cde-45e4-aa68-88a9cb3ccc62 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:34.123256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a3df390-9cde-45e4-aa68-88a9cb3ccc62 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:34.123765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a3df390-9cde-45e4-aa68-88a9cb3ccc62 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:34.124235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a3df390-9cde-45e4-aa68-88a9cb3ccc62 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:34.206520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d4b59d1a-bc00-4759-8af2-206c98d3e100 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:34.218387 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d4b59d1a-bc00-4759-8af2-206c98d3e100 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989" status: 200 len: 1222 microversion: 2.1 time: 0.221678 Oct 10 23:24:34.235215 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1066/2102] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:33 2022] GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989 => generated 1222 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:34.243404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-098b349d-4eaa-4d91-aee2-23c3930c1bec tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662aa31a60>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:34.308353 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-098b349d-4eaa-4d91-aee2-23c3930c1bec tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3" status: 200 len: 1413 microversion: 2.1 time: 0.071741 Oct 10 23:24:34.308963 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1067/2103] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:24:34 2022] GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3 => generated 1413 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:34.334701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1d51c7a8-c5f1-42ad-b7b6-0dde764684f4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:34.337577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1d51c7a8-c5f1-42ad-b7b6-0dde764684f4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:34.355888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d51c7a8-c5f1-42ad-b7b6-0dde764684f4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:34.356026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d51c7a8-c5f1-42ad-b7b6-0dde764684f4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:34.366431 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d51c7a8-c5f1-42ad-b7b6-0dde764684f4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:34.372875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d51c7a8-c5f1-42ad-b7b6-0dde764684f4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:34.375779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d51c7a8-c5f1-42ad-b7b6-0dde764684f4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:34.376352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d51c7a8-c5f1-42ad-b7b6-0dde764684f4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:34.557806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7a3df390-9cde-45e4-aa68-88a9cb3ccc62 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df36ffee3e4544a8baf6265d915716bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7340f5ad1bea4967850a88c986602b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:34.574329 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7a3df390-9cde-45e4-aa68-88a9cb3ccc62 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20" status: 200 len: 1505 microversion: 2.1 time: 0.483219 Oct 10 23:24:34.575825 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1037/2104] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:34 2022] GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 => generated 1505 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:34.585858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fc82a8dd-2676-4dac-8ef5-13bf1437ecf9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:34.587265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fc82a8dd-2676-4dac-8ef5-13bf1437ecf9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:34.601665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc82a8dd-2676-4dac-8ef5-13bf1437ecf9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:34.618843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc82a8dd-2676-4dac-8ef5-13bf1437ecf9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:34.619679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc82a8dd-2676-4dac-8ef5-13bf1437ecf9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:34.620708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc82a8dd-2676-4dac-8ef5-13bf1437ecf9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:34.626077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc82a8dd-2676-4dac-8ef5-13bf1437ecf9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:34.630344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc82a8dd-2676-4dac-8ef5-13bf1437ecf9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:34.738221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc82a8dd-2676-4dac-8ef5-13bf1437ecf9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:34.743366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc82a8dd-2676-4dac-8ef5-13bf1437ecf9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:34.744313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc82a8dd-2676-4dac-8ef5-13bf1437ecf9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:34.745000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-fc82a8dd-2676-4dac-8ef5-13bf1437ecf9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lazy-loading 'fault' on Instance uuid e9431e2e-3fb9-4834-8827-88c1e3762543 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:24:34.836412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fc82a8dd-2676-4dac-8ef5-13bf1437ecf9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:34.859882 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fc82a8dd-2676-4dac-8ef5-13bf1437ecf9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 200 len: 1143 microversion: 2.1 time: 0.281530 Oct 10 23:24:34.877430 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1038/2105] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:34 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 1143 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:34.891624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cbf4172f-755c-441a-a6d3-e7d036b8e306 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:34.892565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cbf4172f-755c-441a-a6d3-e7d036b8e306 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:34.907513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbf4172f-755c-441a-a6d3-e7d036b8e306 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:34.909947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbf4172f-755c-441a-a6d3-e7d036b8e306 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:34.910693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbf4172f-755c-441a-a6d3-e7d036b8e306 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:34.913627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbf4172f-755c-441a-a6d3-e7d036b8e306 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:34.914199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1d51c7a8-c5f1-42ad-b7b6-0dde764684f4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:34.914888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbf4172f-755c-441a-a6d3-e7d036b8e306 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:34.915539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbf4172f-755c-441a-a6d3-e7d036b8e306 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:34.932113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1d51c7a8-c5f1-42ad-b7b6-0dde764684f4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:34.933689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1d51c7a8-c5f1-42ad-b7b6-0dde764684f4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:34.935007 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1d51c7a8-c5f1-42ad-b7b6-0dde764684f4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 0.625067 Oct 10 23:24:34.935585 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1068/2106] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:34 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:35.006418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cbf4172f-755c-441a-a6d3-e7d036b8e306 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'df36ffee3e4544a8baf6265d915716bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7340f5ad1bea4967850a88c986602b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:35.013232 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cbf4172f-755c-441a-a6d3-e7d036b8e306 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20/os-instance-actions/req-ee9cdd8d-aba1-461f-bb46-129cbe3addc3" status: 200 len: 313 microversion: 2.1 time: 0.133313 Oct 10 23:24:35.013992 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1039/2107] 10.222.0.23 () {58 vars in 1419 bytes} [Mon Oct 10 23:24:34 2022] GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20/os-instance-actions/req-ee9cdd8d-aba1-461f-bb46-129cbe3addc3 => generated 313 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:24:35.030433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-53a59bc5-a8f2-4e13-af14-da068b36af13 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:35.031305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-53a59bc5-a8f2-4e13-af14-da068b36af13 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:35.041882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7aa9fafb-cbfb-48a5-897c-d001f5207a0c tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:35.046840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53a59bc5-a8f2-4e13-af14-da068b36af13 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:35.049926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53a59bc5-a8f2-4e13-af14-da068b36af13 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:35.050668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53a59bc5-a8f2-4e13-af14-da068b36af13 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:35.053121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53a59bc5-a8f2-4e13-af14-da068b36af13 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:35.053816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53a59bc5-a8f2-4e13-af14-da068b36af13 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:35.054669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7aa9fafb-cbfb-48a5-897c-d001f5207a0c tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:35.055814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53a59bc5-a8f2-4e13-af14-da068b36af13 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:35.068578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7aa9fafb-cbfb-48a5-897c-d001f5207a0c tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:35.076403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7aa9fafb-cbfb-48a5-897c-d001f5207a0c tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:35.080463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7aa9fafb-cbfb-48a5-897c-d001f5207a0c tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:35.081581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7aa9fafb-cbfb-48a5-897c-d001f5207a0c tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:35.082505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7aa9fafb-cbfb-48a5-897c-d001f5207a0c tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:35.084269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7aa9fafb-cbfb-48a5-897c-d001f5207a0c tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:35.270902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-53a59bc5-a8f2-4e13-af14-da068b36af13 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:35.290361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-53a59bc5-a8f2-4e13-af14-da068b36af13 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:35.293519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-53a59bc5-a8f2-4e13-af14-da068b36af13 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:35.308023 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-53a59bc5-a8f2-4e13-af14-da068b36af13 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.275456 Oct 10 23:24:35.330066 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1069/2108] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:35 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:35.332083 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7aa9fafb-cbfb-48a5-897c-d001f5207a0c tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "POST /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20/action" status: 202 len: 0 microversion: 2.1 time: 0.294050 Oct 10 23:24:35.334702 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1040/2109] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:24:35 2022] POST /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:24:35.339890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-04a43dbf-104f-4511-b86e-8bb32d144605 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:35.341870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-04a43dbf-104f-4511-b86e-8bb32d144605 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: e47ddcc1-9723-4e88-8c1d-ded295d4e989] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:35.345693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-52b6c8ff-cffe-4efd-b3ee-3f5c6a63809f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:35.347224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-52b6c8ff-cffe-4efd-b3ee-3f5c6a63809f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:35.352190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04a43dbf-104f-4511-b86e-8bb32d144605 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:35.352823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04a43dbf-104f-4511-b86e-8bb32d144605 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:35.353447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04a43dbf-104f-4511-b86e-8bb32d144605 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:35.354679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04a43dbf-104f-4511-b86e-8bb32d144605 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:35.355304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04a43dbf-104f-4511-b86e-8bb32d144605 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:35.356369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04a43dbf-104f-4511-b86e-8bb32d144605 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:35.365042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52b6c8ff-cffe-4efd-b3ee-3f5c6a63809f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:35.365940 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52b6c8ff-cffe-4efd-b3ee-3f5c6a63809f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:35.366602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52b6c8ff-cffe-4efd-b3ee-3f5c6a63809f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:35.367531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52b6c8ff-cffe-4efd-b3ee-3f5c6a63809f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:35.373175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52b6c8ff-cffe-4efd-b3ee-3f5c6a63809f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:35.374114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52b6c8ff-cffe-4efd-b3ee-3f5c6a63809f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:35.478234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-04a43dbf-104f-4511-b86e-8bb32d144605 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:35.493260 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-04a43dbf-104f-4511-b86e-8bb32d144605 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989" status: 200 len: 1226 microversion: 2.1 time: 0.158403 Oct 10 23:24:35.495498 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1041/2110] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:35 2022] GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989 => generated 1226 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:35.518209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b52a6be4-6e0d-48b8-9a64-6c5139e23506 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b14d280>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:35.610414 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b52a6be4-6e0d-48b8-9a64-6c5139e23506 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3" status: 200 len: 1413 microversion: 2.1 time: 0.096846 Oct 10 23:24:35.612077 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1042/2111] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:24:35 2022] GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3 => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:35.617352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7337169b-2f63-469a-bafc-330746f2bc45 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:35.618272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7337169b-2f63-469a-bafc-330746f2bc45 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:35.627584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7337169b-2f63-469a-bafc-330746f2bc45 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:35.628704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7337169b-2f63-469a-bafc-330746f2bc45 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:35.629462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7337169b-2f63-469a-bafc-330746f2bc45 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:35.630526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7337169b-2f63-469a-bafc-330746f2bc45 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:35.631246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7337169b-2f63-469a-bafc-330746f2bc45 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:35.631884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7337169b-2f63-469a-bafc-330746f2bc45 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:35.802169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-52b6c8ff-cffe-4efd-b3ee-3f5c6a63809f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:35.834789 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-52b6c8ff-cffe-4efd-b3ee-3f5c6a63809f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1726 microversion: 2.1 time: 0.491649 Oct 10 23:24:35.835484 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1070/2112] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:35 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1726 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:35.884537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-545fe401-3809-4298-9468-ea5d26df4327 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:35.887000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-545fe401-3809-4298-9468-ea5d26df4327 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: e9431e2e-3fb9-4834-8827-88c1e3762543] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:35.912812 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-545fe401-3809-4298-9468-ea5d26df4327 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:35.916223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-545fe401-3809-4298-9468-ea5d26df4327 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:35.918205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-545fe401-3809-4298-9468-ea5d26df4327 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:35.923216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-545fe401-3809-4298-9468-ea5d26df4327 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:35.923974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-545fe401-3809-4298-9468-ea5d26df4327 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:35.927675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-545fe401-3809-4298-9468-ea5d26df4327 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:36.007611 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-545fe401-3809-4298-9468-ea5d26df4327 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] HTTP exception thrown: Instance e9431e2e-3fb9-4834-8827-88c1e3762543 could not be found. Oct 10 23:24:36.019590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-545fe401-3809-4298-9468-ea5d26df4327 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Request method failure captured: Oct 10 23:24:36.019590 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 HTTP/1.1 Oct 10 23:24:36.019590 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:24:36.019590 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:24:36.019590 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:24:36.019590 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:24:36.019590 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:24:36.019590 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:24:36.019590 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:24:36.019590 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:24:36.019590 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgRPLcuZOQHwLU9RnicPEH510hzllvVdPlPCGOmNQBoxDHi79ZXGpYqFEY19dF7VzBhNqLTlXC_vyC8MW9a2tEUHUYnDXlBf-DOE9ZImuHN1BHcoafH9TPbkB373S2vzrdGE3t7fAFAdG2i4H3Rh-M7BKAz8ehKA0Q1u4tVUaE3hyQ Oct 10 23:24:36.019590 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:24:36.019590 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:24:36.019590 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:24:36.019590 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:24:36.019590 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:24:36.019590 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:24:36.019590 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 1b5a9d1de27b407e91ff0ae66242ec81 Oct 10 23:24:36.019590 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-LiveMigrationTest-1684235659 Oct 10 23:24:36.019590 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:24:36.019590 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:24:36.021813 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1b5a9d1de27b407e91ff0ae66242ec81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1b5a9d1de27b407e91ff0ae66242ec81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1b5a9d1de27b407e91ff0ae66242ec81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1b5a9d1de27b407e91ff0ae66242ec81", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:24:36.021813 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-LiveMigrationTest-1684235659 Oct 10 23:24:36.021813 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 1b5a9d1de27b407e91ff0ae66242ec81 Oct 10 23:24:36.021813 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-LiveMigrationTest-1684235659 Oct 10 23:24:36.021813 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-LiveMigrationTest-1684235659-project Oct 10 23:24:36.021813 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:24:36.021813 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:24:36.021813 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 9bd83ab05cb34853bbab0f86a630aa1e Oct 10 23:24:36.021813 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-LiveMigrationTest-1684235659-project Oct 10 23:24:36.021813 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:24:36.021813 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance e9431e2e-3fb9-4834-8827-88c1e3762543 could not be found. Oct 10 23:24:36.021813 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'e9431e2e-3fb9-4834-8827-88c1e3762543'} Oct 10 23:24:36.022817 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:24:36.022817 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:24:36.022817 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:24:36.022817 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:24:36.022817 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:24:36.022817 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:24:36.022817 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:24:36.022817 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:24:36.022817 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:24:36.022817 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:24:36.022817 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9431e2e-3fb9-4834-8827-88c1e3762543 could not be found. Oct 10 23:24:36.022817 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:24:36.022817 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:24:36.022817 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:24:36.022817 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:24:36.022817 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:24:36.022817 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:24:36.022817 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:24:36.022817 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:24:36.022817 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:24:36.024341 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:24:36.024341 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:24:36.024341 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:24:36.024341 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:24:36.024341 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:24:36.024341 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:24:36.024341 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:24:36.024341 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9431e2e-3fb9-4834-8827-88c1e3762543 could not be found. Oct 10 23:24:36.024341 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:24:36.024341 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:24:36.024341 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:24:36.024341 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:24:36.024341 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:24:36.024341 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:24:36.024341 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:24:36.024341 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:24:36.024341 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9431e2e-3fb9-4834-8827-88c1e3762543 could not be found. Oct 10 23:24:36.024341 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:24:36.034294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-545fe401-3809-4298-9468-ea5d26df4327 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Returning 404 to user: Instance e9431e2e-3fb9-4834-8827-88c1e3762543 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:24:36.039729 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-545fe401-3809-4298-9468-ea5d26df4327 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543" status: 404 len: 111 microversion: 2.1 time: 0.157935 Oct 10 23:24:36.046644 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1071/2113] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:35 2022] GET /compute/v2.1/servers/e9431e2e-3fb9-4834-8827-88c1e3762543 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:24:36.098536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-845d5a06-1582-41ee-a8a4-805ffc7f78b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:36.099756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-845d5a06-1582-41ee-a8a4-805ffc7f78b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:36.110536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-845d5a06-1582-41ee-a8a4-805ffc7f78b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:36.111335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-845d5a06-1582-41ee-a8a4-805ffc7f78b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:36.112100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-845d5a06-1582-41ee-a8a4-805ffc7f78b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:36.113465 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-845d5a06-1582-41ee-a8a4-805ffc7f78b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:36.114917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-845d5a06-1582-41ee-a8a4-805ffc7f78b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:36.115506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-845d5a06-1582-41ee-a8a4-805ffc7f78b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:36.126600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7337169b-2f63-469a-bafc-330746f2bc45 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df36ffee3e4544a8baf6265d915716bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7340f5ad1bea4967850a88c986602b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:36.146223 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7337169b-2f63-469a-bafc-330746f2bc45 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20" status: 200 len: 1507 microversion: 2.1 time: 0.532833 Oct 10 23:24:36.151685 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1043/2114] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:35 2022] GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 => generated 1507 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:36.342404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bc625a05-512e-4a03-b746-fe45ad3c0395 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:36.346866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bc625a05-512e-4a03-b746-fe45ad3c0395 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:36.357406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc625a05-512e-4a03-b746-fe45ad3c0395 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:36.387119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc625a05-512e-4a03-b746-fe45ad3c0395 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:36.392682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc625a05-512e-4a03-b746-fe45ad3c0395 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:36.395481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc625a05-512e-4a03-b746-fe45ad3c0395 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:36.396649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc625a05-512e-4a03-b746-fe45ad3c0395 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:36.398337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc625a05-512e-4a03-b746-fe45ad3c0395 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:36.522851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bc625a05-512e-4a03-b746-fe45ad3c0395 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:36.537762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bc625a05-512e-4a03-b746-fe45ad3c0395 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:36.539536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bc625a05-512e-4a03-b746-fe45ad3c0395 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:36.553549 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bc625a05-512e-4a03-b746-fe45ad3c0395 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.219665 Oct 10 23:24:36.554384 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1044/2115] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:36 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:36.569447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8a203c1d-2a1e-4714-aecc-d3b3c21b8da0 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:36.572234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8a203c1d-2a1e-4714-aecc-d3b3c21b8da0 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: e47ddcc1-9723-4e88-8c1d-ded295d4e989] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:36.593842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a203c1d-2a1e-4714-aecc-d3b3c21b8da0 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:36.594385 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a203c1d-2a1e-4714-aecc-d3b3c21b8da0 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:36.594844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a203c1d-2a1e-4714-aecc-d3b3c21b8da0 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:36.595748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a203c1d-2a1e-4714-aecc-d3b3c21b8da0 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:36.596220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a203c1d-2a1e-4714-aecc-d3b3c21b8da0 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:36.596658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a203c1d-2a1e-4714-aecc-d3b3c21b8da0 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:36.777091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8a203c1d-2a1e-4714-aecc-d3b3c21b8da0 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:36.801324 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8a203c1d-2a1e-4714-aecc-d3b3c21b8da0 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989" status: 200 len: 1282 microversion: 2.1 time: 0.246065 Oct 10 23:24:36.806542 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1045/2116] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:36 2022] GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989 => generated 1282 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:36.819310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4ab83c1e-703c-44b9-aa77-1c3d43778497 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b228c10>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:36.885148 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4ab83c1e-703c-44b9-aa77-1c3d43778497 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3" status: 200 len: 1413 microversion: 2.1 time: 0.077103 Oct 10 23:24:36.886467 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1046/2117] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:24:36 2022] GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3 => generated 1413 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:36.892631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1c807213-8bc4-4e4d-8518-ef4aefe10576 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:36.893814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1c807213-8bc4-4e4d-8518-ef4aefe10576 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:36.896193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:36.903802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c807213-8bc4-4e4d-8518-ef4aefe10576 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:36.904383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c807213-8bc4-4e4d-8518-ef4aefe10576 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:36.904898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c807213-8bc4-4e4d-8518-ef4aefe10576 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:36.906479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c807213-8bc4-4e4d-8518-ef4aefe10576 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:36.907029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c807213-8bc4-4e4d-8518-ef4aefe10576 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:36.907780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c807213-8bc4-4e4d-8518-ef4aefe10576 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:37.076611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1c807213-8bc4-4e4d-8518-ef4aefe10576 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:37.087635 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1c807213-8bc4-4e4d-8518-ef4aefe10576 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1726 microversion: 2.1 time: 0.199131 Oct 10 23:24:37.088998 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1047/2118] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:36 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1726 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:37.103894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-845d5a06-1582-41ee-a8a4-805ffc7f78b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:37.116057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-845d5a06-1582-41ee-a8a4-805ffc7f78b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:37.117972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-845d5a06-1582-41ee-a8a4-805ffc7f78b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:37.119429 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-845d5a06-1582-41ee-a8a4-805ffc7f78b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 1.068070 Oct 10 23:24:37.120522 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1072/2119] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:36 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:37.176897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2c60020a-cf6f-449a-b5f8-b2cfd029e54b tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:37.177509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2c60020a-cf6f-449a-b5f8-b2cfd029e54b tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:37.189953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c60020a-cf6f-449a-b5f8-b2cfd029e54b tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:37.190499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c60020a-cf6f-449a-b5f8-b2cfd029e54b tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:37.190956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c60020a-cf6f-449a-b5f8-b2cfd029e54b tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:37.191685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c60020a-cf6f-449a-b5f8-b2cfd029e54b tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:37.192146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c60020a-cf6f-449a-b5f8-b2cfd029e54b tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:37.192572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c60020a-cf6f-449a-b5f8-b2cfd029e54b tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:37.365323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:37.509521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2c60020a-cf6f-449a-b5f8-b2cfd029e54b tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df36ffee3e4544a8baf6265d915716bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7340f5ad1bea4967850a88c986602b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:37.531367 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2c60020a-cf6f-449a-b5f8-b2cfd029e54b tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20" status: 200 len: 1507 microversion: 2.1 time: 0.358451 Oct 10 23:24:37.532622 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1048/2120] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:37 2022] GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 => generated 1507 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:37.583550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-55228cd8-1f16-4cb7-8052-568e87a90a14 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:37.584698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-55228cd8-1f16-4cb7-8052-568e87a90a14 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:37.602147 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55228cd8-1f16-4cb7-8052-568e87a90a14 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:37.602984 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55228cd8-1f16-4cb7-8052-568e87a90a14 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:37.603630 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55228cd8-1f16-4cb7-8052-568e87a90a14 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:37.604753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55228cd8-1f16-4cb7-8052-568e87a90a14 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:37.605456 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55228cd8-1f16-4cb7-8052-568e87a90a14 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:37.606066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-55228cd8-1f16-4cb7-8052-568e87a90a14 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:37.833094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-495c6b77-1c0e-4dd0-a031-1d54a639bb81 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:37.833993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-495c6b77-1c0e-4dd0-a031-1d54a639bb81 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: e47ddcc1-9723-4e88-8c1d-ded295d4e989] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:37.845002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-55228cd8-1f16-4cb7-8052-568e87a90a14 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:37.853766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-495c6b77-1c0e-4dd0-a031-1d54a639bb81 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:37.854575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-495c6b77-1c0e-4dd0-a031-1d54a639bb81 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:37.855039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-495c6b77-1c0e-4dd0-a031-1d54a639bb81 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:37.858050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-495c6b77-1c0e-4dd0-a031-1d54a639bb81 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:37.858608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-495c6b77-1c0e-4dd0-a031-1d54a639bb81 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:37.859060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-495c6b77-1c0e-4dd0-a031-1d54a639bb81 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:37.861996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-55228cd8-1f16-4cb7-8052-568e87a90a14 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:37.863764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-55228cd8-1f16-4cb7-8052-568e87a90a14 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:37.879631 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-55228cd8-1f16-4cb7-8052-568e87a90a14 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.303389 Oct 10 23:24:37.881072 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1073/2121] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:37 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:24:37.901837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c17052ab-931b-416f-b1b2-219129afafcc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b770280>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:38.013527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-495c6b77-1c0e-4dd0-a031-1d54a639bb81 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:38.025127 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-495c6b77-1c0e-4dd0-a031-1d54a639bb81 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989" status: 200 len: 1280 microversion: 2.1 time: 0.198506 Oct 10 23:24:38.041486 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1049/2122] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:37 2022] GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989 => generated 1280 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:38.067268 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c17052ab-931b-416f-b1b2-219129afafcc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3" status: 200 len: 1413 microversion: 2.1 time: 0.165324 Oct 10 23:24:38.069508 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1074/2123] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:24:37 2022] GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3 => generated 1413 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:24:38.117270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-42e7b071-5279-4062-b8d1-364aed02bdff tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:38.118228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-42e7b071-5279-4062-b8d1-364aed02bdff tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:38.129272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42e7b071-5279-4062-b8d1-364aed02bdff tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:38.129811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42e7b071-5279-4062-b8d1-364aed02bdff tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:38.131180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42e7b071-5279-4062-b8d1-364aed02bdff tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:38.132193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42e7b071-5279-4062-b8d1-364aed02bdff tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:38.132890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42e7b071-5279-4062-b8d1-364aed02bdff tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:38.134489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42e7b071-5279-4062-b8d1-364aed02bdff tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:38.150566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-44268884-d801-4862-b761-14a802866ef1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:38.152053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-44268884-d801-4862-b761-14a802866ef1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:38.157682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:38.185975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44268884-d801-4862-b761-14a802866ef1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:38.189276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44268884-d801-4862-b761-14a802866ef1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:38.193742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44268884-d801-4862-b761-14a802866ef1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:38.196698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44268884-d801-4862-b761-14a802866ef1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:38.198770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44268884-d801-4862-b761-14a802866ef1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:38.200107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44268884-d801-4862-b761-14a802866ef1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:38.489443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-42e7b071-5279-4062-b8d1-364aed02bdff tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:38.508276 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-42e7b071-5279-4062-b8d1-364aed02bdff tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1703 microversion: 2.1 time: 0.397950 Oct 10 23:24:38.510133 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1050/2124] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:38 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1703 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:38.550604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8c9a7c6e-f31e-48e3-a0eb-f73133124249 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:38.589798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c9a7c6e-f31e-48e3-a0eb-f73133124249 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:38.596617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c9a7c6e-f31e-48e3-a0eb-f73133124249 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:38.598547 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c9a7c6e-f31e-48e3-a0eb-f73133124249 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:38.688613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8c9a7c6e-f31e-48e3-a0eb-f73133124249 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Going to try to start instance {{(pid=120613) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 10 23:24:38.813863 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8c9a7c6e-f31e-48e3-a0eb-f73133124249 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "POST /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc/action" status: 202 len: 0 microversion: 2.1 time: 0.271769 Oct 10 23:24:38.815326 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1051/2125] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:24:38 2022] POST /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:24:38.826555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cf718985-de08-4df3-8913-8eb93262530d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:38.833132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cf718985-de08-4df3-8913-8eb93262530d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:38.849100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf718985-de08-4df3-8913-8eb93262530d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:38.849402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf718985-de08-4df3-8913-8eb93262530d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:38.849844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf718985-de08-4df3-8913-8eb93262530d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:38.850551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf718985-de08-4df3-8913-8eb93262530d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:38.851036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf718985-de08-4df3-8913-8eb93262530d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:38.852920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf718985-de08-4df3-8913-8eb93262530d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:39.220569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-44268884-d801-4862-b761-14a802866ef1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:39.229514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-44268884-d801-4862-b761-14a802866ef1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:39.243478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-44268884-d801-4862-b761-14a802866ef1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:39.244911 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-44268884-d801-4862-b761-14a802866ef1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 1.101396 Oct 10 23:24:39.258165 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1075/2126] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:38 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:39.267118 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1301959b-e46c-4617-bce6-ffd1293824d5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:39.272999 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1301959b-e46c-4617-bce6-ffd1293824d5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:39.291383 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1301959b-e46c-4617-bce6-ffd1293824d5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:39.292282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1301959b-e46c-4617-bce6-ffd1293824d5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:39.292899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1301959b-e46c-4617-bce6-ffd1293824d5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:39.293923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1301959b-e46c-4617-bce6-ffd1293824d5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:39.296561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1301959b-e46c-4617-bce6-ffd1293824d5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:39.301813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1301959b-e46c-4617-bce6-ffd1293824d5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:39.419332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cf718985-de08-4df3-8913-8eb93262530d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df36ffee3e4544a8baf6265d915716bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7340f5ad1bea4967850a88c986602b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:39.434288 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cf718985-de08-4df3-8913-8eb93262530d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20" status: 200 len: 1505 microversion: 2.1 time: 0.617784 Oct 10 23:24:39.463632 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1052/2127] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:38 2022] GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 => generated 1505 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:39.469623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8ae4beb4-4fd7-40ff-a575-ff34fb45ee32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:39.470782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8ae4beb4-4fd7-40ff-a575-ff34fb45ee32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:39.478082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ae4beb4-4fd7-40ff-a575-ff34fb45ee32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:39.478969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ae4beb4-4fd7-40ff-a575-ff34fb45ee32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:39.479646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ae4beb4-4fd7-40ff-a575-ff34fb45ee32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:39.480779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ae4beb4-4fd7-40ff-a575-ff34fb45ee32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:39.481528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ae4beb4-4fd7-40ff-a575-ff34fb45ee32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:39.482214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ae4beb4-4fd7-40ff-a575-ff34fb45ee32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:39.952116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1301959b-e46c-4617-bce6-ffd1293824d5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:39.966531 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1301959b-e46c-4617-bce6-ffd1293824d5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1712 microversion: 2.1 time: 0.707191 Oct 10 23:24:39.973662 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1076/2128] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:39 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1712 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:39.986675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2614260c-9361-4834-be8d-d6fbe0dbb30d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:39.994280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2614260c-9361-4834-be8d-d6fbe0dbb30d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: e47ddcc1-9723-4e88-8c1d-ded295d4e989] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:40.005409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2614260c-9361-4834-be8d-d6fbe0dbb30d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:40.005920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2614260c-9361-4834-be8d-d6fbe0dbb30d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:40.006351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2614260c-9361-4834-be8d-d6fbe0dbb30d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:40.007267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2614260c-9361-4834-be8d-d6fbe0dbb30d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:40.007893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2614260c-9361-4834-be8d-d6fbe0dbb30d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:40.008485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2614260c-9361-4834-be8d-d6fbe0dbb30d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:40.127461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2614260c-9361-4834-be8d-d6fbe0dbb30d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:40.142748 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2614260c-9361-4834-be8d-d6fbe0dbb30d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989" status: 200 len: 1280 microversion: 2.1 time: 0.160466 Oct 10 23:24:40.160220 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1077/2129] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:39 2022] GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989 => generated 1280 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:40.172569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6ca664b5-8efa-4c4b-8d84-d8e176ae35fd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662a854280>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:40.364947 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6ca664b5-8efa-4c4b-8d84-d8e176ae35fd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3" status: 200 len: 1413 microversion: 2.1 time: 0.202868 Oct 10 23:24:40.376939 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1078/2130] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:24:40 2022] GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3 => generated 1413 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:40.376939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0def1fca-5a6f-45af-88d7-135ace97f934 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Calling method '.version_select at 0x7f662a854a60>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:40.376939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0def1fca-5a6f-45af-88d7-135ace97f934 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:40.387805 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0def1fca-5a6f-45af-88d7-135ace97f934 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:40.388337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0def1fca-5a6f-45af-88d7-135ace97f934 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:40.388821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0def1fca-5a6f-45af-88d7-135ace97f934 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:40.391788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0def1fca-5a6f-45af-88d7-135ace97f934 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:40.392320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0def1fca-5a6f-45af-88d7-135ace97f934 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:40.392781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0def1fca-5a6f-45af-88d7-135ace97f934 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:40.457822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8ae4beb4-4fd7-40ff-a575-ff34fb45ee32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:40.468981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:40.471734 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0def1fca-5a6f-45af-88d7-135ace97f934 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.103631 Oct 10 23:24:40.473226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8ae4beb4-4fd7-40ff-a575-ff34fb45ee32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:40.473528 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1079/2131] 10.222.0.23 () {58 vars in 1296 bytes} [Mon Oct 10 23:24:40 2022] GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20/os-instance-actions => generated 611 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:24:40.479031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9d08c0b6-654f-48b2-b31a-ec3dae8a9754 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:40.480065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9d08c0b6-654f-48b2-b31a-ec3dae8a9754 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:40.481365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8ae4beb4-4fd7-40ff-a575-ff34fb45ee32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:40.499458 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8ae4beb4-4fd7-40ff-a575-ff34fb45ee32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 1.033769 Oct 10 23:24:40.504435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d08c0b6-654f-48b2-b31a-ec3dae8a9754 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:40.505548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d08c0b6-654f-48b2-b31a-ec3dae8a9754 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:40.506237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d08c0b6-654f-48b2-b31a-ec3dae8a9754 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:40.507176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d08c0b6-654f-48b2-b31a-ec3dae8a9754 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:40.508293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d08c0b6-654f-48b2-b31a-ec3dae8a9754 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:40.508903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d08c0b6-654f-48b2-b31a-ec3dae8a9754 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:40.533784 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1053/2132] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:39 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:40.544133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bbf97b3d-64d0-4d37-980b-97d9c3e7ba0d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:40.544641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bbf97b3d-64d0-4d37-980b-97d9c3e7ba0d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:40.557768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbf97b3d-64d0-4d37-980b-97d9c3e7ba0d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:40.558306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbf97b3d-64d0-4d37-980b-97d9c3e7ba0d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:40.558747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbf97b3d-64d0-4d37-980b-97d9c3e7ba0d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:40.559460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbf97b3d-64d0-4d37-980b-97d9c3e7ba0d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:40.559912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbf97b3d-64d0-4d37-980b-97d9c3e7ba0d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:40.560388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbf97b3d-64d0-4d37-980b-97d9c3e7ba0d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:40.623547 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bbf97b3d-64d0-4d37-980b-97d9c3e7ba0d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:24:40.823137 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bbf97b3d-64d0-4d37-980b-97d9c3e7ba0d tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20" status: 204 len: 0 microversion: 2.1 time: 0.287591 Oct 10 23:24:40.827439 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1054/2133] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:24:40 2022] DELETE /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:24:40.841211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-688b5320-2d0d-4761-a0e4-c361a3d34a04 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:40.844325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-688b5320-2d0d-4761-a0e4-c361a3d34a04 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:40.855335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-688b5320-2d0d-4761-a0e4-c361a3d34a04 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:40.858659 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-688b5320-2d0d-4761-a0e4-c361a3d34a04 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:40.859833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-688b5320-2d0d-4761-a0e4-c361a3d34a04 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:40.862365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-688b5320-2d0d-4761-a0e4-c361a3d34a04 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:40.863036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-688b5320-2d0d-4761-a0e4-c361a3d34a04 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:40.864508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-688b5320-2d0d-4761-a0e4-c361a3d34a04 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:41.177655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-688b5320-2d0d-4761-a0e4-c361a3d34a04 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df36ffee3e4544a8baf6265d915716bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7340f5ad1bea4967850a88c986602b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:41.186043 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-688b5320-2d0d-4761-a0e4-c361a3d34a04 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20" status: 200 len: 1511 microversion: 2.1 time: 0.357237 Oct 10 23:24:41.186978 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1055/2134] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:40 2022] GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 => generated 1511 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:41.212612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bbc331c2-87c3-4410-9c1e-97e5c5672db7 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:41.213333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bbc331c2-87c3-4410-9c1e-97e5c5672db7 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:41.222331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbc331c2-87c3-4410-9c1e-97e5c5672db7 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:41.222892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbc331c2-87c3-4410-9c1e-97e5c5672db7 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:41.223331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbc331c2-87c3-4410-9c1e-97e5c5672db7 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:41.224161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbc331c2-87c3-4410-9c1e-97e5c5672db7 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:41.224618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbc331c2-87c3-4410-9c1e-97e5c5672db7 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:41.225043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbc331c2-87c3-4410-9c1e-97e5c5672db7 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:41.315372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9d08c0b6-654f-48b2-b31a-ec3dae8a9754 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:41.333208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9d08c0b6-654f-48b2-b31a-ec3dae8a9754 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:41.334688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9d08c0b6-654f-48b2-b31a-ec3dae8a9754 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:41.335962 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9d08c0b6-654f-48b2-b31a-ec3dae8a9754 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 0.861482 Oct 10 23:24:41.337585 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1080/2135] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:40 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:41.359667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c246a98f-cdf3-4d0e-aece-497fb9069998 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:41.361696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c246a98f-cdf3-4d0e-aece-497fb9069998 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: e47ddcc1-9723-4e88-8c1d-ded295d4e989] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:41.378395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c246a98f-cdf3-4d0e-aece-497fb9069998 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:41.379624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c246a98f-cdf3-4d0e-aece-497fb9069998 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:41.380298 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c246a98f-cdf3-4d0e-aece-497fb9069998 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:41.381315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c246a98f-cdf3-4d0e-aece-497fb9069998 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:41.381957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c246a98f-cdf3-4d0e-aece-497fb9069998 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:41.382598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c246a98f-cdf3-4d0e-aece-497fb9069998 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:41.600862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bbc331c2-87c3-4410-9c1e-97e5c5672db7 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:41.618065 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bbc331c2-87c3-4410-9c1e-97e5c5672db7 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1712 microversion: 2.1 time: 0.415886 Oct 10 23:24:41.618967 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1056/2136] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:41 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1712 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:41.636936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a52f531d-efc0-483e-9e8b-1f10d43da6c1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b13e430>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:41.676870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c246a98f-cdf3-4d0e-aece-497fb9069998 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:41.692218 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c246a98f-cdf3-4d0e-aece-497fb9069998 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989" status: 200 len: 1322 microversion: 2.1 time: 0.348535 Oct 10 23:24:41.703382 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1081/2137] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:41 2022] GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989 => generated 1322 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:41.717146 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a52f531d-efc0-483e-9e8b-1f10d43da6c1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3" status: 200 len: 1413 microversion: 2.1 time: 0.097033 Oct 10 23:24:41.718623 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1057/2138] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:24:41 2022] GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3 => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:41.728057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-05f26e74-26c4-4aa0-88f1-13988dbb0863 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:41.728674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-05f26e74-26c4-4aa0-88f1-13988dbb0863 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:41.748609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05f26e74-26c4-4aa0-88f1-13988dbb0863 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:41.750865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05f26e74-26c4-4aa0-88f1-13988dbb0863 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:41.753957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05f26e74-26c4-4aa0-88f1-13988dbb0863 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:41.754899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05f26e74-26c4-4aa0-88f1-13988dbb0863 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:41.755529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05f26e74-26c4-4aa0-88f1-13988dbb0863 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:41.763309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05f26e74-26c4-4aa0-88f1-13988dbb0863 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:41.951562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-05f26e74-26c4-4aa0-88f1-13988dbb0863 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:41.965426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-05f26e74-26c4-4aa0-88f1-13988dbb0863 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:41.966733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-05f26e74-26c4-4aa0-88f1-13988dbb0863 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:41.987292 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-05f26e74-26c4-4aa0-88f1-13988dbb0863 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.274994 Oct 10 23:24:42.013773 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1082/2139] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:41 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:42.211610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-93779486-dee9-4cf8-b50b-972c9fe36a98 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:42.212527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-93779486-dee9-4cf8-b50b-972c9fe36a98 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:42.228262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93779486-dee9-4cf8-b50b-972c9fe36a98 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:42.236214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93779486-dee9-4cf8-b50b-972c9fe36a98 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:42.236953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93779486-dee9-4cf8-b50b-972c9fe36a98 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:42.237954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93779486-dee9-4cf8-b50b-972c9fe36a98 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:42.238600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93779486-dee9-4cf8-b50b-972c9fe36a98 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:42.239217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93779486-dee9-4cf8-b50b-972c9fe36a98 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:42.363791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c22c1538-026f-497c-97df-22c88a9557f0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:42.364716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c22c1538-026f-497c-97df-22c88a9557f0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:42.381265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c22c1538-026f-497c-97df-22c88a9557f0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:42.382262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c22c1538-026f-497c-97df-22c88a9557f0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:42.382262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c22c1538-026f-497c-97df-22c88a9557f0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:42.382912 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c22c1538-026f-497c-97df-22c88a9557f0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:42.383388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c22c1538-026f-497c-97df-22c88a9557f0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:42.383811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c22c1538-026f-497c-97df-22c88a9557f0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:42.577678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-93779486-dee9-4cf8-b50b-972c9fe36a98 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df36ffee3e4544a8baf6265d915716bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7340f5ad1bea4967850a88c986602b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:42.589076 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-93779486-dee9-4cf8-b50b-972c9fe36a98 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20" status: 200 len: 1511 microversion: 2.1 time: 0.381401 Oct 10 23:24:42.590533 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1058/2140] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:42 2022] GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 => generated 1511 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:42.649616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b881c7a6-3bab-4ad4-9cff-e43d02deb76e tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:42.651047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b881c7a6-3bab-4ad4-9cff-e43d02deb76e tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:42.664010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b881c7a6-3bab-4ad4-9cff-e43d02deb76e tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:42.666160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b881c7a6-3bab-4ad4-9cff-e43d02deb76e tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:42.668661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b881c7a6-3bab-4ad4-9cff-e43d02deb76e tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:42.670211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b881c7a6-3bab-4ad4-9cff-e43d02deb76e tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:42.689759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b881c7a6-3bab-4ad4-9cff-e43d02deb76e tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:42.690350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b881c7a6-3bab-4ad4-9cff-e43d02deb76e tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:43.035361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b881c7a6-3bab-4ad4-9cff-e43d02deb76e tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:43.057641 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b881c7a6-3bab-4ad4-9cff-e43d02deb76e tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1712 microversion: 2.1 time: 0.413104 Oct 10 23:24:43.058961 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1059/2141] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:42 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1712 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:43.068965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-213ed594-d04d-4549-8a07-2f59a9aa27b3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:43.074367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-213ed594-d04d-4549-8a07-2f59a9aa27b3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: e47ddcc1-9723-4e88-8c1d-ded295d4e989] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:43.089538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-213ed594-d04d-4549-8a07-2f59a9aa27b3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:43.092599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-213ed594-d04d-4549-8a07-2f59a9aa27b3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:43.098155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-213ed594-d04d-4549-8a07-2f59a9aa27b3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:43.099139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-213ed594-d04d-4549-8a07-2f59a9aa27b3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:43.100448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-213ed594-d04d-4549-8a07-2f59a9aa27b3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:43.101280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-213ed594-d04d-4549-8a07-2f59a9aa27b3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:43.359042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:43.484820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c22c1538-026f-497c-97df-22c88a9557f0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:43.505577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c22c1538-026f-497c-97df-22c88a9557f0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:43.514200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c22c1538-026f-497c-97df-22c88a9557f0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:43.516087 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c22c1538-026f-497c-97df-22c88a9557f0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 1.156948 Oct 10 23:24:43.520928 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1083/2142] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:42 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:43.534916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9b6fb332-58b6-43b9-8ae4-e241e935178f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662a8a8940>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:43.624635 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9b6fb332-58b6-43b9-8ae4-e241e935178f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3" status: 200 len: 1413 microversion: 2.1 time: 0.101588 Oct 10 23:24:43.626468 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1084/2143] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:24:43 2022] GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3 => generated 1413 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:43.633244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a29d8561-8267-4b94-86b9-3110e59d26a4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:43.634299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a29d8561-8267-4b94-86b9-3110e59d26a4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:43.643869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a29d8561-8267-4b94-86b9-3110e59d26a4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:43.644705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a29d8561-8267-4b94-86b9-3110e59d26a4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:43.645400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a29d8561-8267-4b94-86b9-3110e59d26a4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:43.646328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a29d8561-8267-4b94-86b9-3110e59d26a4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:43.647028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a29d8561-8267-4b94-86b9-3110e59d26a4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:43.647930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a29d8561-8267-4b94-86b9-3110e59d26a4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:43.836193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a29d8561-8267-4b94-86b9-3110e59d26a4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:43.850712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a29d8561-8267-4b94-86b9-3110e59d26a4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:43.855933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a29d8561-8267-4b94-86b9-3110e59d26a4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:43.879118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-213ed594-d04d-4549-8a07-2f59a9aa27b3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:43.884579 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a29d8561-8267-4b94-86b9-3110e59d26a4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.256349 Oct 10 23:24:43.897649 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-213ed594-d04d-4549-8a07-2f59a9aa27b3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989" status: 200 len: 1322 microversion: 2.1 time: 0.834526 Oct 10 23:24:43.897786 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1085/2144] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:43 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:43.908510 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1060/2145] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:43 2022] GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989 => generated 1322 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:43.916400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2ada7b69-f797-4e32-9ab5-5f7de59f4ef1 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:43.917306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2ada7b69-f797-4e32-9ab5-5f7de59f4ef1 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:43.948483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ada7b69-f797-4e32-9ab5-5f7de59f4ef1 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:43.950560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ada7b69-f797-4e32-9ab5-5f7de59f4ef1 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:43.951309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ada7b69-f797-4e32-9ab5-5f7de59f4ef1 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:43.956605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ada7b69-f797-4e32-9ab5-5f7de59f4ef1 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:43.957406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ada7b69-f797-4e32-9ab5-5f7de59f4ef1 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:43.962607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ada7b69-f797-4e32-9ab5-5f7de59f4ef1 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:44.090889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7a6d28eb-e841-437e-9aa1-763d4c8b1aad tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:44.091891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7a6d28eb-e841-437e-9aa1-763d4c8b1aad tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:44.110573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a6d28eb-e841-437e-9aa1-763d4c8b1aad tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:44.114096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a6d28eb-e841-437e-9aa1-763d4c8b1aad tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:44.117034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a6d28eb-e841-437e-9aa1-763d4c8b1aad tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:44.118121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a6d28eb-e841-437e-9aa1-763d4c8b1aad tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:44.122516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a6d28eb-e841-437e-9aa1-763d4c8b1aad tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:44.123218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a6d28eb-e841-437e-9aa1-763d4c8b1aad tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:44.129710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2ada7b69-f797-4e32-9ab5-5f7de59f4ef1 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df36ffee3e4544a8baf6265d915716bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7340f5ad1bea4967850a88c986602b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:44.145297 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2ada7b69-f797-4e32-9ab5-5f7de59f4ef1 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20" status: 200 len: 1469 microversion: 2.1 time: 0.247325 Oct 10 23:24:44.178883 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1086/2146] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:43 2022] GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 => generated 1469 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:44.441698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-004de03b-2248-488c-871a-005f7febe25a req-ce1925be-ae92-424c-83f8-5d1100f08430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bc10526-4ed2-4d25-bbf1-62b5b5b38b20", "name": "network-vif-deleted", "tag": "a4608dac-974c-4e7f-a564-49f4a5dd0c04"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:44.464788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=8 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:44.473527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-004de03b-2248-488c-871a-005f7febe25a req-ce1925be-ae92-424c-83f8-5d1100f08430 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:44.475232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-004de03b-2248-488c-871a-005f7febe25a req-ce1925be-ae92-424c-83f8-5d1100f08430 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:44.475681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-004de03b-2248-488c-871a-005f7febe25a req-ce1925be-ae92-424c-83f8-5d1100f08430 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:44.526411 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-004de03b-2248-488c-871a-005f7febe25a req-ce1925be-ae92-424c-83f8-5d1100f08430 service nova] Creating event network-vif-deleted:a4608dac-974c-4e7f-a564-49f4a5dd0c04 for instance 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 on n-h2-860864-2 Oct 10 23:24:44.548673 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-004de03b-2248-488c-871a-005f7febe25a req-ce1925be-ae92-424c-83f8-5d1100f08430 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107956 Oct 10 23:24:44.551625 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1087/2147] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:24:44.563901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-78990b4b-b6a2-4869-8141-1dbf6503f396 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:44.566269 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-78990b4b-b6a2-4869-8141-1dbf6503f396 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:44.597472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78990b4b-b6a2-4869-8141-1dbf6503f396 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:44.598137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78990b4b-b6a2-4869-8141-1dbf6503f396 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:44.598982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78990b4b-b6a2-4869-8141-1dbf6503f396 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:44.606438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78990b4b-b6a2-4869-8141-1dbf6503f396 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:44.607225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78990b4b-b6a2-4869-8141-1dbf6503f396 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:44.607897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78990b4b-b6a2-4869-8141-1dbf6503f396 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:44.902740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7a6d28eb-e841-437e-9aa1-763d4c8b1aad tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:44.930076 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7a6d28eb-e841-437e-9aa1-763d4c8b1aad tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1716 microversion: 2.1 time: 0.841586 Oct 10 23:24:44.931477 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1061/2148] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:44 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1716 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:24:44.936606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f37ef972-7246-4f4b-8085-64ba2b6c0ab1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b94baf0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:45.024533 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f37ef972-7246-4f4b-8085-64ba2b6c0ab1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3" status: 200 len: 1413 microversion: 2.1 time: 0.091773 Oct 10 23:24:45.027156 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1062/2149] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:24:44 2022] GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3 => generated 1413 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:45.040823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-06d7e713-bc31-4171-be6c-37abdbd9d73d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:45.041790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-06d7e713-bc31-4171-be6c-37abdbd9d73d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:45.056663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06d7e713-bc31-4171-be6c-37abdbd9d73d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:45.057458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06d7e713-bc31-4171-be6c-37abdbd9d73d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:45.058115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06d7e713-bc31-4171-be6c-37abdbd9d73d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:45.059128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06d7e713-bc31-4171-be6c-37abdbd9d73d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:45.063491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06d7e713-bc31-4171-be6c-37abdbd9d73d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:45.064244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06d7e713-bc31-4171-be6c-37abdbd9d73d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:45.327185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-78990b4b-b6a2-4869-8141-1dbf6503f396 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:45.327531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-06d7e713-bc31-4171-be6c-37abdbd9d73d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:45.356340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-78990b4b-b6a2-4869-8141-1dbf6503f396 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:45.359654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-06d7e713-bc31-4171-be6c-37abdbd9d73d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:45.361113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-78990b4b-b6a2-4869-8141-1dbf6503f396 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:45.365173 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-78990b4b-b6a2-4869-8141-1dbf6503f396 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 0.812240 Oct 10 23:24:45.368576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-06d7e713-bc31-4171-be6c-37abdbd9d73d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:45.371519 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1088/2150] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:44 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:45.387870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-43a5e10e-93cb-47e2-8b8d-a8ee562b2035 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:45.388834 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-43a5e10e-93cb-47e2-8b8d-a8ee562b2035 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: e47ddcc1-9723-4e88-8c1d-ded295d4e989] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:45.389156 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-06d7e713-bc31-4171-be6c-37abdbd9d73d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.357187 Oct 10 23:24:45.395120 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1063/2151] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:45 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:45.423916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43a5e10e-93cb-47e2-8b8d-a8ee562b2035 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:45.431608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2ae8626a-54bf-4b07-8880-e1023b83d34f tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:45.432650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43a5e10e-93cb-47e2-8b8d-a8ee562b2035 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:45.435586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43a5e10e-93cb-47e2-8b8d-a8ee562b2035 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:45.440312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2ae8626a-54bf-4b07-8880-e1023b83d34f tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:45.443390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43a5e10e-93cb-47e2-8b8d-a8ee562b2035 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:45.451811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43a5e10e-93cb-47e2-8b8d-a8ee562b2035 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:45.454602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43a5e10e-93cb-47e2-8b8d-a8ee562b2035 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:45.488973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ae8626a-54bf-4b07-8880-e1023b83d34f tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:45.491207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ae8626a-54bf-4b07-8880-e1023b83d34f tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:45.492904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ae8626a-54bf-4b07-8880-e1023b83d34f tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:45.494312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ae8626a-54bf-4b07-8880-e1023b83d34f tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:45.494947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ae8626a-54bf-4b07-8880-e1023b83d34f tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:45.495701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ae8626a-54bf-4b07-8880-e1023b83d34f tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:45.706410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ae8626a-54bf-4b07-8880-e1023b83d34f tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:45.709461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ae8626a-54bf-4b07-8880-e1023b83d34f tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:45.712011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ae8626a-54bf-4b07-8880-e1023b83d34f tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:45.712552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-2ae8626a-54bf-4b07-8880-e1023b83d34f tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lazy-loading 'fault' on Instance uuid 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:24:45.832090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2ae8626a-54bf-4b07-8880-e1023b83d34f tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df36ffee3e4544a8baf6265d915716bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7340f5ad1bea4967850a88c986602b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:45.845095 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2ae8626a-54bf-4b07-8880-e1023b83d34f tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20" status: 200 len: 1307 microversion: 2.1 time: 0.445200 Oct 10 23:24:45.858087 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1064/2152] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:45 2022] GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 => generated 1307 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:46.043900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a3ce82db-b71c-48a9-b013-50d86d7499f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b909ca0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:46.120544 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a3ce82db-b71c-48a9-b013-50d86d7499f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3" status: 200 len: 1413 microversion: 2.1 time: 0.080526 Oct 10 23:24:46.121301 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1065/2153] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:24:46 2022] GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3 => generated 1413 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:24:46.248277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-43a5e10e-93cb-47e2-8b8d-a8ee562b2035 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:46.268278 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-43a5e10e-93cb-47e2-8b8d-a8ee562b2035 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989" status: 200 len: 1322 microversion: 2.1 time: 0.895346 Oct 10 23:24:46.271371 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1089/2154] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:45 2022] GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989 => generated 1322 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:46.402901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-596fa21a-b558-49fe-833b-14ab13d9589e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:46.403679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-596fa21a-b558-49fe-833b-14ab13d9589e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:46.441144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3367b49c-a037-4818-901b-04c72faf76b4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:46.441974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3367b49c-a037-4818-901b-04c72faf76b4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:46.444485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-596fa21a-b558-49fe-833b-14ab13d9589e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:46.445228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-596fa21a-b558-49fe-833b-14ab13d9589e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:46.451689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-596fa21a-b558-49fe-833b-14ab13d9589e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:46.462899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-596fa21a-b558-49fe-833b-14ab13d9589e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:46.467824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-596fa21a-b558-49fe-833b-14ab13d9589e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:46.469120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-596fa21a-b558-49fe-833b-14ab13d9589e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:46.473875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3367b49c-a037-4818-901b-04c72faf76b4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:46.474459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3367b49c-a037-4818-901b-04c72faf76b4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:46.474912 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3367b49c-a037-4818-901b-04c72faf76b4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:46.475670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3367b49c-a037-4818-901b-04c72faf76b4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:46.480099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3367b49c-a037-4818-901b-04c72faf76b4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:46.482703 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3367b49c-a037-4818-901b-04c72faf76b4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:46.733309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3367b49c-a037-4818-901b-04c72faf76b4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:46.745290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3367b49c-a037-4818-901b-04c72faf76b4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:46.747141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3367b49c-a037-4818-901b-04c72faf76b4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:46.762506 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3367b49c-a037-4818-901b-04c72faf76b4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1558 microversion: 2.91 time: 0.328209 Oct 10 23:24:46.763625 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1090/2155] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:46 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1558 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:46.769322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-42dea813-d92b-4f92-95eb-1586cdfc2a53 req-36c0e3d1-0bd2-4c67-b5cc-69f6a8601541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e47ddcc1-9723-4e88-8c1d-ded295d4e989", "tag": "84337f7d-20d9-455a-81b0-82cecccbe13d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:46.791823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-42dea813-d92b-4f92-95eb-1586cdfc2a53 req-36c0e3d1-0bd2-4c67-b5cc-69f6a8601541 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:46.793161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-42dea813-d92b-4f92-95eb-1586cdfc2a53 req-36c0e3d1-0bd2-4c67-b5cc-69f6a8601541 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:46.796626 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-42dea813-d92b-4f92-95eb-1586cdfc2a53 req-36c0e3d1-0bd2-4c67-b5cc-69f6a8601541 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:46.831092 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-42dea813-d92b-4f92-95eb-1586cdfc2a53 req-36c0e3d1-0bd2-4c67-b5cc-69f6a8601541 service nova] Creating event network-changed:84337f7d-20d9-455a-81b0-82cecccbe13d for instance e47ddcc1-9723-4e88-8c1d-ded295d4e989 on n-h1-860864-2 Oct 10 23:24:46.841390 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-42dea813-d92b-4f92-95eb-1586cdfc2a53 req-36c0e3d1-0bd2-4c67-b5cc-69f6a8601541 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076176 Oct 10 23:24:46.847613 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1091/2156] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:24:46.876496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e1211343-c340-4d91-8d30-ae0be83ec8b2 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:46.884119 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e1211343-c340-4d91-8d30-ae0be83ec8b2 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] [instance: 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:46.902108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1211343-c340-4d91-8d30-ae0be83ec8b2 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:46.903178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1211343-c340-4d91-8d30-ae0be83ec8b2 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:46.903966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1211343-c340-4d91-8d30-ae0be83ec8b2 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:46.904910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1211343-c340-4d91-8d30-ae0be83ec8b2 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:46.905708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1211343-c340-4d91-8d30-ae0be83ec8b2 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:46.906341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1211343-c340-4d91-8d30-ae0be83ec8b2 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:46.948638 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-e1211343-c340-4d91-8d30-ae0be83ec8b2 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] HTTP exception thrown: Instance 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 could not be found. Oct 10 23:24:46.954939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e1211343-c340-4d91-8d30-ae0be83ec8b2 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Request method failure captured: Oct 10 23:24:46.954939 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 HTTP/1.1 Oct 10 23:24:46.954939 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:24:46.954939 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:24:46.954939 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:24:46.954939 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:24:46.954939 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:24:46.954939 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:24:46.954939 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:24:46.954939 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:24:46.954939 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKmcUggC4_pWywov2bFAQSNJ8BsgIU7AJMH76kv_QlG0gs4ZFlHRzArXL8gvzg7MkoDOyMnSZl52ZPOHZMRQP6_ews6ShKN455trwzsUq9z0-WW9WIdHT3j_WsM7B0wQ0iFcsH8OI_2reyzKhKmHXSjjGmM2MATUqTVSPvWiZHgYqfY Oct 10 23:24:46.954939 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:24:46.954939 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:24:46.954939 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:24:46.954939 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:24:46.954939 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:24:46.954939 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:24:46.954939 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 7340f5ad1bea4967850a88c986602b9d Oct 10 23:24:46.954939 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-InstanceActionsTestJSON-1579680428 Oct 10 23:24:46.954939 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:24:46.954939 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:24:46.956151 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7340f5ad1bea4967850a88c986602b9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7340f5ad1bea4967850a88c986602b9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7340f5ad1bea4967850a88c986602b9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7340f5ad1bea4967850a88c986602b9d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:24:46.956151 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-InstanceActionsTestJSON-1579680428 Oct 10 23:24:46.956151 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 7340f5ad1bea4967850a88c986602b9d Oct 10 23:24:46.956151 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1579680428 Oct 10 23:24:46.956151 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-InstanceActionsTestJSON-1579680428-project Oct 10 23:24:46.956151 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:24:46.956151 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:24:46.956151 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: df36ffee3e4544a8baf6265d915716bd Oct 10 23:24:46.956151 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-InstanceActionsTestJSON-1579680428-project Oct 10 23:24:46.956151 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:24:46.956151 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 could not be found. Oct 10 23:24:46.956151 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '4bc10526-4ed2-4d25-bbf1-62b5b5b38b20'} Oct 10 23:24:46.956720 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:24:46.956720 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:24:46.956720 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:24:46.956720 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:24:46.956720 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:24:46.956720 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:24:46.956720 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:24:46.956720 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:24:46.956720 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:24:46.956720 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:24:46.956720 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 could not be found. Oct 10 23:24:46.956720 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:24:46.956720 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:24:46.956720 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:24:46.956720 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:24:46.956720 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:24:46.956720 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:24:46.956720 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:24:46.956720 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:24:46.956720 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:24:46.959620 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:24:46.959620 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:24:46.959620 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:24:46.959620 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:24:46.959620 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:24:46.959620 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:24:46.959620 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:24:46.959620 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 could not be found. Oct 10 23:24:46.959620 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:24:46.959620 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:24:46.959620 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:24:46.959620 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:24:46.959620 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:24:46.959620 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:24:46.959620 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:24:46.959620 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:24:46.959620 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 could not be found. Oct 10 23:24:46.959620 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:24:46.965115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e1211343-c340-4d91-8d30-ae0be83ec8b2 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] Returning 404 to user: Instance 4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:24:46.969696 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e1211343-c340-4d91-8d30-ae0be83ec8b2 tempest-InstanceActionsTestJSON-1579680428 tempest-InstanceActionsTestJSON-1579680428-project] 10.222.0.23 "GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20" status: 404 len: 111 microversion: 2.1 time: 0.099380 Oct 10 23:24:46.970543 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1092/2157] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:46 2022] GET /compute/v2.1/servers/4bc10526-4ed2-4d25-bbf1-62b5b5b38b20 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:24:47.114190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-596fa21a-b558-49fe-833b-14ab13d9589e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:47.120356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:47.138272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a3f35356-9b8f-48c4-818a-c631e55934eb tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662a8b8af0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:47.145909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-596fa21a-b558-49fe-833b-14ab13d9589e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:47.152311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-596fa21a-b558-49fe-833b-14ab13d9589e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:47.154873 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-596fa21a-b558-49fe-833b-14ab13d9589e tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 0.756269 Oct 10 23:24:47.157499 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1066/2158] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:46 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:47.300348 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a3f35356-9b8f-48c4-818a-c631e55934eb tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3" status: 200 len: 1413 microversion: 2.1 time: 0.166727 Oct 10 23:24:47.301303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c109f194-ab02-4462-b07a-ec8ee37dc8aa tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:47.310053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c109f194-ab02-4462-b07a-ec8ee37dc8aa tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: e47ddcc1-9723-4e88-8c1d-ded295d4e989] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:47.310221 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1093/2159] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:24:47 2022] GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3 => generated 1413 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:24:47.315957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c109f194-ab02-4462-b07a-ec8ee37dc8aa tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:47.316475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c109f194-ab02-4462-b07a-ec8ee37dc8aa tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:47.325406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c109f194-ab02-4462-b07a-ec8ee37dc8aa tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:47.332639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c109f194-ab02-4462-b07a-ec8ee37dc8aa tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:47.333325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c109f194-ab02-4462-b07a-ec8ee37dc8aa tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:47.333864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c109f194-ab02-4462-b07a-ec8ee37dc8aa tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:47.797993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-531a3396-5375-4c32-bf4f-9c2083aea5d2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:47.798728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-531a3396-5375-4c32-bf4f-9c2083aea5d2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:47.814423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-531a3396-5375-4c32-bf4f-9c2083aea5d2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:47.816703 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-531a3396-5375-4c32-bf4f-9c2083aea5d2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:47.817533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-531a3396-5375-4c32-bf4f-9c2083aea5d2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:47.818521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-531a3396-5375-4c32-bf4f-9c2083aea5d2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:47.819944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-531a3396-5375-4c32-bf4f-9c2083aea5d2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:47.820659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-531a3396-5375-4c32-bf4f-9c2083aea5d2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:48.073249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c109f194-ab02-4462-b07a-ec8ee37dc8aa tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:48.086611 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c109f194-ab02-4462-b07a-ec8ee37dc8aa tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989" status: 200 len: 1322 microversion: 2.1 time: 0.790112 Oct 10 23:24:48.090379 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1067/2160] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:47 2022] GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989 => generated 1322 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:24:48.091525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-531a3396-5375-4c32-bf4f-9c2083aea5d2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:48.096800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0e7a31ab-8827-4c29-acb4-affdf575d3a5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:48.097660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0e7a31ab-8827-4c29-acb4-affdf575d3a5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:48.104542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e7a31ab-8827-4c29-acb4-affdf575d3a5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:48.105565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e7a31ab-8827-4c29-acb4-affdf575d3a5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:48.106149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e7a31ab-8827-4c29-acb4-affdf575d3a5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:48.107032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e7a31ab-8827-4c29-acb4-affdf575d3a5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:48.107627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e7a31ab-8827-4c29-acb4-affdf575d3a5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:48.108195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e7a31ab-8827-4c29-acb4-affdf575d3a5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:48.112743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-531a3396-5375-4c32-bf4f-9c2083aea5d2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:48.123356 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-531a3396-5375-4c32-bf4f-9c2083aea5d2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:48.146338 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-531a3396-5375-4c32-bf4f-9c2083aea5d2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.351847 Oct 10 23:24:48.154178 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1094/2161] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:47 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:48.184292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e26e2162-f2c7-4bed-8158-6998523374a5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:48.185466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e26e2162-f2c7-4bed-8158-6998523374a5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:48.201018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0e7a31ab-8827-4c29-acb4-affdf575d3a5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:24:48.209285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:48.213193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e26e2162-f2c7-4bed-8158-6998523374a5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:48.215722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e26e2162-f2c7-4bed-8158-6998523374a5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:48.218398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e26e2162-f2c7-4bed-8158-6998523374a5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:48.219255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e26e2162-f2c7-4bed-8158-6998523374a5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:48.223869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e26e2162-f2c7-4bed-8158-6998523374a5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:48.226700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e26e2162-f2c7-4bed-8158-6998523374a5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:48.429655 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0e7a31ab-8827-4c29-acb4-affdf575d3a5 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "DELETE /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 204 len: 0 microversion: 2.1 time: 0.333545 Oct 10 23:24:48.434121 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1068/2162] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:24:48 2022] DELETE /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:24:48.447124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a0043d66-0f8f-406b-bb06-7a1bbe01eba7 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662ae708b0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:48.572068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e26e2162-f2c7-4bed-8158-6998523374a5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:48.590646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e26e2162-f2c7-4bed-8158-6998523374a5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:48.595973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e26e2162-f2c7-4bed-8158-6998523374a5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:48.599188 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e26e2162-f2c7-4bed-8158-6998523374a5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 0.417103 Oct 10 23:24:48.614658 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1095/2163] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:48 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:24:48.625003 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e4d7bb4f-28b1-4b87-89bf-fa14583de144 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:48.630150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e4d7bb4f-28b1-4b87-89bf-fa14583de144 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:48.637671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4d7bb4f-28b1-4b87-89bf-fa14583de144 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:48.638607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4d7bb4f-28b1-4b87-89bf-fa14583de144 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:48.639284 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4d7bb4f-28b1-4b87-89bf-fa14583de144 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:48.640942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4d7bb4f-28b1-4b87-89bf-fa14583de144 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:48.641668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4d7bb4f-28b1-4b87-89bf-fa14583de144 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:48.642315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4d7bb4f-28b1-4b87-89bf-fa14583de144 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:49.335609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e4d7bb4f-28b1-4b87-89bf-fa14583de144 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:49.352737 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e4d7bb4f-28b1-4b87-89bf-fa14583de144 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1667 microversion: 2.1 time: 0.736566 Oct 10 23:24:49.354818 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1096/2164] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:48 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1667 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:49.366441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d60f4112-0caa-4acc-bcd6-144aa81dbb5c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:49.367438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d60f4112-0caa-4acc-bcd6-144aa81dbb5c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: e47ddcc1-9723-4e88-8c1d-ded295d4e989] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:49.380161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d60f4112-0caa-4acc-bcd6-144aa81dbb5c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:49.380674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d60f4112-0caa-4acc-bcd6-144aa81dbb5c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:49.383490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d60f4112-0caa-4acc-bcd6-144aa81dbb5c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:49.384323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d60f4112-0caa-4acc-bcd6-144aa81dbb5c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:49.385991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d60f4112-0caa-4acc-bcd6-144aa81dbb5c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:49.386469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d60f4112-0caa-4acc-bcd6-144aa81dbb5c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:50.883771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d60f4112-0caa-4acc-bcd6-144aa81dbb5c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:50.897880 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d60f4112-0caa-4acc-bcd6-144aa81dbb5c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989" status: 200 len: 1322 microversion: 2.1 time: 1.538287 Oct 10 23:24:50.913851 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1097/2165] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:49 2022] GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989 => generated 1322 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:50.933745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5577a962-3fa2-4c5b-ac97-ffaf46dccd21 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:50.934699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5577a962-3fa2-4c5b-ac97-ffaf46dccd21 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:50.951150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5577a962-3fa2-4c5b-ac97-ffaf46dccd21 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:50.951930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5577a962-3fa2-4c5b-ac97-ffaf46dccd21 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:50.953228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5577a962-3fa2-4c5b-ac97-ffaf46dccd21 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:50.954232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5577a962-3fa2-4c5b-ac97-ffaf46dccd21 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:50.957479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5577a962-3fa2-4c5b-ac97-ffaf46dccd21 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:50.958124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5577a962-3fa2-4c5b-ac97-ffaf46dccd21 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:51.487665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5577a962-3fa2-4c5b-ac97-ffaf46dccd21 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:51.505090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5577a962-3fa2-4c5b-ac97-ffaf46dccd21 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:51.512108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5577a962-3fa2-4c5b-ac97-ffaf46dccd21 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:51.525737 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5577a962-3fa2-4c5b-ac97-ffaf46dccd21 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.609192 Oct 10 23:24:51.531309 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1098/2166] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:50 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:51.544319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-891baac7-2714-49a3-8eac-a1a518778705 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:51.545684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-891baac7-2714-49a3-8eac-a1a518778705 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:51.554946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-891baac7-2714-49a3-8eac-a1a518778705 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:51.564006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-891baac7-2714-49a3-8eac-a1a518778705 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:51.569004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-891baac7-2714-49a3-8eac-a1a518778705 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:51.573318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-891baac7-2714-49a3-8eac-a1a518778705 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:51.574690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-891baac7-2714-49a3-8eac-a1a518778705 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:51.577779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-891baac7-2714-49a3-8eac-a1a518778705 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:52.054646 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a0043d66-0f8f-406b-bb06-7a1bbe01eba7 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3" status: 200 len: 1422 microversion: 2.1 time: 3.619093 Oct 10 23:24:52.065176 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1069/2167] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:24:48 2022] GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3 => generated 1422 bytes in 3630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:52.070864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-88916043-4d0a-4ed5-bf85-3f07d0874c56 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:52.071798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-88916043-4d0a-4ed5-bf85-3f07d0874c56 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:52.079490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88916043-4d0a-4ed5-bf85-3f07d0874c56 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:52.080186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88916043-4d0a-4ed5-bf85-3f07d0874c56 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:52.080836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88916043-4d0a-4ed5-bf85-3f07d0874c56 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:52.081912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88916043-4d0a-4ed5-bf85-3f07d0874c56 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:52.082561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88916043-4d0a-4ed5-bf85-3f07d0874c56 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:52.083073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88916043-4d0a-4ed5-bf85-3f07d0874c56 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:52.386097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-891baac7-2714-49a3-8eac-a1a518778705 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:52.401982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-891baac7-2714-49a3-8eac-a1a518778705 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:52.403905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-891baac7-2714-49a3-8eac-a1a518778705 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:52.406236 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-891baac7-2714-49a3-8eac-a1a518778705 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 0.872465 Oct 10 23:24:52.428940 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1099/2168] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:51 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:52.435791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-88916043-4d0a-4ed5-bf85-3f07d0874c56 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:52.441481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6ce11f0e-2818-4d89-a32c-04b19ed30a87 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:52.443057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6ce11f0e-2818-4d89-a32c-04b19ed30a87 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: e47ddcc1-9723-4e88-8c1d-ded295d4e989] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:52.446863 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-88916043-4d0a-4ed5-bf85-3f07d0874c56 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1667 microversion: 2.1 time: 0.380180 Oct 10 23:24:52.447476 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1070/2169] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:52 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1667 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:52.453043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ce11f0e-2818-4d89-a32c-04b19ed30a87 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:52.453975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ce11f0e-2818-4d89-a32c-04b19ed30a87 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:52.454625 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ce11f0e-2818-4d89-a32c-04b19ed30a87 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:52.455547 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ce11f0e-2818-4d89-a32c-04b19ed30a87 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:52.456307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ce11f0e-2818-4d89-a32c-04b19ed30a87 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:52.457175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ce11f0e-2818-4d89-a32c-04b19ed30a87 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:52.470036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-818ecdda-8af3-47ff-a6b3-9cfb1c624100 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f6630304790>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:52.485485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:52.609039 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-818ecdda-8af3-47ff-a6b3-9cfb1c624100 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3" status: 200 len: 1422 microversion: 2.1 time: 0.154442 Oct 10 23:24:52.621103 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1071/2170] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:24:52 2022] GET /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3 => generated 1422 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:52.637013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6a4a737a-a64f-4a09-9a77-9bbedb2b1e62 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:52.642501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6a4a737a-a64f-4a09-9a77-9bbedb2b1e62 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:52.659698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a4a737a-a64f-4a09-9a77-9bbedb2b1e62 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:52.662313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a4a737a-a64f-4a09-9a77-9bbedb2b1e62 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:52.665466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a4a737a-a64f-4a09-9a77-9bbedb2b1e62 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:52.666702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a4a737a-a64f-4a09-9a77-9bbedb2b1e62 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:52.667384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a4a737a-a64f-4a09-9a77-9bbedb2b1e62 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:52.669691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a4a737a-a64f-4a09-9a77-9bbedb2b1e62 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:52.855694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6ce11f0e-2818-4d89-a32c-04b19ed30a87 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:52.868655 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6ce11f0e-2818-4d89-a32c-04b19ed30a87 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989" status: 200 len: 1322 microversion: 2.1 time: 0.438159 Oct 10 23:24:52.872590 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1100/2171] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:52 2022] GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989 => generated 1322 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:52.886212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d429ee01-a488-409d-a386-638877dec42c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662a8fbf70>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:52.933087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6a4a737a-a64f-4a09-9a77-9bbedb2b1e62 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:52.951070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6a4a737a-a64f-4a09-9a77-9bbedb2b1e62 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:52.955538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6a4a737a-a64f-4a09-9a77-9bbedb2b1e62 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:52.969665 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6a4a737a-a64f-4a09-9a77-9bbedb2b1e62 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.345066 Oct 10 23:24:52.971883 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1072/2172] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:52 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:52.982018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-d5ff9e19-7a35-4e1a-ac66-60e9bab1249f req-f8942180-dada-4008-9803-91b09cc63eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47ddcc1-9723-4e88-8c1d-ded295d4e989", "name": "network-vif-plugged", "status": "completed", "tag": "84337f7d-20d9-455a-81b0-82cecccbe13d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:53.011978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d5ff9e19-7a35-4e1a-ac66-60e9bab1249f req-f8942180-dada-4008-9803-91b09cc63eb0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:53.013022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d5ff9e19-7a35-4e1a-ac66-60e9bab1249f req-f8942180-dada-4008-9803-91b09cc63eb0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:53.015599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d5ff9e19-7a35-4e1a-ac66-60e9bab1249f req-f8942180-dada-4008-9803-91b09cc63eb0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:53.052875 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-d5ff9e19-7a35-4e1a-ac66-60e9bab1249f req-f8942180-dada-4008-9803-91b09cc63eb0 service nova] Creating event network-vif-plugged:84337f7d-20d9-455a-81b0-82cecccbe13d for instance e47ddcc1-9723-4e88-8c1d-ded295d4e989 on n-h1-860864-2 Oct 10 23:24:53.069212 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-d5ff9e19-7a35-4e1a-ac66-60e9bab1249f req-f8942180-dada-4008-9803-91b09cc63eb0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086312 Oct 10 23:24:53.078534 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1073/2173] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:24:53.443418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-53346e41-0391-4f3b-844e-f6f9a04db9e4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:53.444621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-53346e41-0391-4f3b-844e-f6f9a04db9e4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:53.483331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53346e41-0391-4f3b-844e-f6f9a04db9e4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:53.483953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53346e41-0391-4f3b-844e-f6f9a04db9e4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:53.484416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53346e41-0391-4f3b-844e-f6f9a04db9e4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:53.485173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53346e41-0391-4f3b-844e-f6f9a04db9e4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:53.485781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53346e41-0391-4f3b-844e-f6f9a04db9e4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:53.494767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53346e41-0391-4f3b-844e-f6f9a04db9e4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:53.738018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-53346e41-0391-4f3b-844e-f6f9a04db9e4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:53.758455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-53346e41-0391-4f3b-844e-f6f9a04db9e4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:53.770678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-53346e41-0391-4f3b-844e-f6f9a04db9e4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:53.777435 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-53346e41-0391-4f3b-844e-f6f9a04db9e4 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 0.341320 Oct 10 23:24:53.778434 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1074/2174] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:53 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:53.790388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-95f205a8-dc2f-4480-a35d-bef2026fc247 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:53.791148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-95f205a8-dc2f-4480-a35d-bef2026fc247 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:53.811631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95f205a8-dc2f-4480-a35d-bef2026fc247 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:53.816146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95f205a8-dc2f-4480-a35d-bef2026fc247 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:53.816811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95f205a8-dc2f-4480-a35d-bef2026fc247 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:53.822299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95f205a8-dc2f-4480-a35d-bef2026fc247 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:53.822782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95f205a8-dc2f-4480-a35d-bef2026fc247 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:53.823257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95f205a8-dc2f-4480-a35d-bef2026fc247 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:53.948691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-95f205a8-dc2f-4480-a35d-bef2026fc247 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:53.966113 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-95f205a8-dc2f-4480-a35d-bef2026fc247 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1600 microversion: 2.1 time: 0.185879 Oct 10 23:24:53.970120 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1075/2175] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:53 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1600 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:53.975254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6e454d34-9d02-4106-8f5e-85b13a800a0c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:53.981954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6e454d34-9d02-4106-8f5e-85b13a800a0c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: e47ddcc1-9723-4e88-8c1d-ded295d4e989] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:54.001165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e454d34-9d02-4106-8f5e-85b13a800a0c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:54.001820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e454d34-9d02-4106-8f5e-85b13a800a0c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:54.002354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e454d34-9d02-4106-8f5e-85b13a800a0c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:54.003171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e454d34-9d02-4106-8f5e-85b13a800a0c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:54.003723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e454d34-9d02-4106-8f5e-85b13a800a0c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:54.004227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e454d34-9d02-4106-8f5e-85b13a800a0c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:54.236734 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d429ee01-a488-409d-a386-638877dec42c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "DELETE /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3" status: 204 len: 0 microversion: 2.1 time: 1.361741 Oct 10 23:24:54.237502 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1101/2176] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:52 2022] DELETE /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3 => generated 0 bytes in 1364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:24:54.243081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b35dda1c-84bd-42f4-9711-3a4fb8ade796 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:54.245370 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b35dda1c-84bd-42f4-9711-3a4fb8ade796 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:54.260572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b35dda1c-84bd-42f4-9711-3a4fb8ade796 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:54.262670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b35dda1c-84bd-42f4-9711-3a4fb8ade796 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:54.265112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b35dda1c-84bd-42f4-9711-3a4fb8ade796 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:54.266179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b35dda1c-84bd-42f4-9711-3a4fb8ade796 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:54.267542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b35dda1c-84bd-42f4-9711-3a4fb8ade796 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:54.269194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b35dda1c-84bd-42f4-9711-3a4fb8ade796 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:54.271477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6e454d34-9d02-4106-8f5e-85b13a800a0c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:54.295701 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6e454d34-9d02-4106-8f5e-85b13a800a0c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989" status: 200 len: 1322 microversion: 2.1 time: 0.324071 Oct 10 23:24:54.317292 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1076/2177] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:53 2022] GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989 => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:54.333086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2a095baf-fc89-4e6e-8cc7-2e6d6730c7f1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:54.335901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2a095baf-fc89-4e6e-8cc7-2e6d6730c7f1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:54.356600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a095baf-fc89-4e6e-8cc7-2e6d6730c7f1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:54.357647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a095baf-fc89-4e6e-8cc7-2e6d6730c7f1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:54.359220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a095baf-fc89-4e6e-8cc7-2e6d6730c7f1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:54.360772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a095baf-fc89-4e6e-8cc7-2e6d6730c7f1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:54.363990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a095baf-fc89-4e6e-8cc7-2e6d6730c7f1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:54.364630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a095baf-fc89-4e6e-8cc7-2e6d6730c7f1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:54.426563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2a095baf-fc89-4e6e-8cc7-2e6d6730c7f1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:24:54.566910 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2a095baf-fc89-4e6e-8cc7-2e6d6730c7f1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 204 len: 0 microversion: 2.1 time: 0.240793 Oct 10 23:24:54.567977 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1077/2178] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:24:54 2022] DELETE /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:24:54.695145 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b35dda1c-84bd-42f4-9711-3a4fb8ade796 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:54.719409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b35dda1c-84bd-42f4-9711-3a4fb8ade796 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:54.724875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b35dda1c-84bd-42f4-9711-3a4fb8ade796 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:54.744742 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b35dda1c-84bd-42f4-9711-3a4fb8ade796 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.504924 Oct 10 23:24:54.762676 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1102/2179] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:54 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:54.811162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8788ac96-583e-4118-a68e-13c2af034ffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:54.813261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8788ac96-583e-4118-a68e-13c2af034ffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:54.849619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8788ac96-583e-4118-a68e-13c2af034ffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:54.850438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8788ac96-583e-4118-a68e-13c2af034ffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:54.851172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8788ac96-583e-4118-a68e-13c2af034ffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:54.852363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8788ac96-583e-4118-a68e-13c2af034ffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:54.853110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8788ac96-583e-4118-a68e-13c2af034ffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:54.853857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8788ac96-583e-4118-a68e-13c2af034ffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:54.931372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f5a89c8f-7232-4882-9306-4317f9c5d5a9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1208927509", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "2e70e5c7-da0e-4bbe-970c-c601496b5c6b"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:55.115480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-f5a89c8f-7232-4882-9306-4317f9c5d5a9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] validate_networks() for [('2e70e5c7-da0e-4bbe-970c-c601496b5c6b', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:24:55.257654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8788ac96-583e-4118-a68e-13c2af034ffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:55.272386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8788ac96-583e-4118-a68e-13c2af034ffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:55.277204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8788ac96-583e-4118-a68e-13c2af034ffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:55.285238 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8788ac96-583e-4118-a68e-13c2af034ffd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 0.481305 Oct 10 23:24:55.301512 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1078/2180] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:54 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:55.315044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f8b133ba-41b9-4fa1-9105-10beccb3c5d3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:55.321117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f8b133ba-41b9-4fa1-9105-10beccb3c5d3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:55.338678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8b133ba-41b9-4fa1-9105-10beccb3c5d3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:55.339084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8b133ba-41b9-4fa1-9105-10beccb3c5d3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:55.339514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8b133ba-41b9-4fa1-9105-10beccb3c5d3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:55.340437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8b133ba-41b9-4fa1-9105-10beccb3c5d3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:55.348449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8b133ba-41b9-4fa1-9105-10beccb3c5d3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:55.348914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8b133ba-41b9-4fa1-9105-10beccb3c5d3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:55.469617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f8b133ba-41b9-4fa1-9105-10beccb3c5d3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:55.484985 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f8b133ba-41b9-4fa1-9105-10beccb3c5d3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 200 len: 1600 microversion: 2.1 time: 0.181759 Oct 10 23:24:55.486434 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1079/2181] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:55 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 1600 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:55.494205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-78787f00-b019-4162-888b-02eb0ad1a5e5 req-fce840df-ec55-4d84-8a79-d97d87cd97e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a472045-8c28-4437-9e0f-9223369022ae", "name": "network-vif-unplugged", "status": "completed", "tag": "7eabf4d8-5373-4658-bf95-07c701376608"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:55.519680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-78787f00-b019-4162-888b-02eb0ad1a5e5 req-fce840df-ec55-4d84-8a79-d97d87cd97e6 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:55.520183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-78787f00-b019-4162-888b-02eb0ad1a5e5 req-fce840df-ec55-4d84-8a79-d97d87cd97e6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:55.522516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-78787f00-b019-4162-888b-02eb0ad1a5e5 req-fce840df-ec55-4d84-8a79-d97d87cd97e6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:55.552123 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-78787f00-b019-4162-888b-02eb0ad1a5e5 req-fce840df-ec55-4d84-8a79-d97d87cd97e6 service nova] Creating event network-vif-unplugged:7eabf4d8-5373-4658-bf95-07c701376608 for instance 3a472045-8c28-4437-9e0f-9223369022ae on n-h1-860864-2 Oct 10 23:24:55.561278 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-78787f00-b019-4162-888b-02eb0ad1a5e5 req-fce840df-ec55-4d84-8a79-d97d87cd97e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073404 Oct 10 23:24:55.563112 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1080/2182] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:24:55.573181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e7334b50-29b2-402b-b29c-1e3357273c47 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:55.576518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e7334b50-29b2-402b-b29c-1e3357273c47 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: e47ddcc1-9723-4e88-8c1d-ded295d4e989] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:55.595446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7334b50-29b2-402b-b29c-1e3357273c47 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:55.596378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7334b50-29b2-402b-b29c-1e3357273c47 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:55.596378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7334b50-29b2-402b-b29c-1e3357273c47 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:55.597061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7334b50-29b2-402b-b29c-1e3357273c47 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:55.597570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7334b50-29b2-402b-b29c-1e3357273c47 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:55.598020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7334b50-29b2-402b-b29c-1e3357273c47 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:55.884419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e7334b50-29b2-402b-b29c-1e3357273c47 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:55.894426 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e7334b50-29b2-402b-b29c-1e3357273c47 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989" status: 200 len: 1472 microversion: 2.1 time: 0.330179 Oct 10 23:24:55.917431 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1081/2183] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:55 2022] GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989 => generated 1472 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:55.917431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-377b8b23-5953-4696-836c-191e13c51d67 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:55.917431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-377b8b23-5953-4696-836c-191e13c51d67 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:55.917431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-377b8b23-5953-4696-836c-191e13c51d67 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:55.917942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-377b8b23-5953-4696-836c-191e13c51d67 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:55.917942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-377b8b23-5953-4696-836c-191e13c51d67 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:55.917942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-377b8b23-5953-4696-836c-191e13c51d67 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:55.918403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-377b8b23-5953-4696-836c-191e13c51d67 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:55.919251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-377b8b23-5953-4696-836c-191e13c51d67 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:56.047256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-377b8b23-5953-4696-836c-191e13c51d67 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:56.058179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-377b8b23-5953-4696-836c-191e13c51d67 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:56.060212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-377b8b23-5953-4696-836c-191e13c51d67 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:56.087842 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-377b8b23-5953-4696-836c-191e13c51d67 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.184880 Oct 10 23:24:56.097735 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1082/2184] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:55 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:56.714588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-16709ef4-6243-4b20-8ac5-6009c07f3eaa tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:56.721150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-16709ef4-6243-4b20-8ac5-6009c07f3eaa tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] [instance: c4569a9f-a5d9-4e8c-8236-4005a970cd97] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:56.745627 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-16709ef4-6243-4b20-8ac5-6009c07f3eaa tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] HTTP exception thrown: Instance c4569a9f-a5d9-4e8c-8236-4005a970cd97 could not be found. Oct 10 23:24:56.754006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-16709ef4-6243-4b20-8ac5-6009c07f3eaa tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Request method failure captured: Oct 10 23:24:56.754006 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/c4569a9f-a5d9-4e8c-8236-4005a970cd97/action HTTP/1.1 Oct 10 23:24:56.754006 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:24:56.754006 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:24:56.754006 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:24:56.754006 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 15 Oct 10 23:24:56.754006 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:24:56.754006 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:24:56.754006 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:24:56.754006 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:24:56.754006 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKmuZVE867-0n9QJjXfmVVavhIsQxkC6IV8mn1-VRQuxDMywRVVFwcEClOdOpSEI98-F1ZVRhxJys0flpTXUzRUXmoV9xjma-aQxaFMGJxv2EIyedFGTrmv8NPh9Qzwd3qHxchnmFKti6VSfFMq5R4YCYAIul7WLBBwwJR-zlvJIKBk Oct 10 23:24:56.754006 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:24:56.754006 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:24:56.754006 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:24:56.754006 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:24:56.754006 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:24:56.754006 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:24:56.754006 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: da6449b194674f3f937af77207f39b28 Oct 10 23:24:56.754006 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1244263607 Oct 10 23:24:56.754006 n-d-860864-2 devstack@n-api.service[120613]: X-Role: admin,member,reader Oct 10 23:24:56.754006 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: admin,member,reader Oct 10 23:24:56.756074 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da6449b194674f3f937af77207f39b28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da6449b194674f3f937af77207f39b28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da6449b194674f3f937af77207f39b28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da6449b194674f3f937af77207f39b28", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:24:56.756074 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1244263607 Oct 10 23:24:56.756074 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: da6449b194674f3f937af77207f39b28 Oct 10 23:24:56.756074 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1244263607 Oct 10 23:24:56.756074 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersAdminNegativeTestJSON-1244263607-project-admin Oct 10 23:24:56.756074 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:24:56.756074 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:24:56.756074 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 074e507895974ec8a4551b9b71fd70c5 Oct 10 23:24:56.756074 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1244263607-project-admin Oct 10 23:24:56.756074 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:24:56.756074 n-d-860864-2 devstack@n-api.service[120613]: {"migrate": {}} Oct 10 23:24:56.756074 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:24:56.756074 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance c4569a9f-a5d9-4e8c-8236-4005a970cd97 could not be found. Oct 10 23:24:56.757223 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'c4569a9f-a5d9-4e8c-8236-4005a970cd97', 'body': {'migrate': {}}} Oct 10 23:24:56.757223 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:24:56.757223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:24:56.757223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:24:56.757223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:24:56.757223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:24:56.757223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:24:56.757223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:24:56.757223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:24:56.757223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4569a9f-a5d9-4e8c-8236-4005a970cd97 could not be found. Oct 10 23:24:56.757223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:24:56.757223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:24:56.757223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:24:56.757223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:24:56.757223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:24:56.757223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:24:56.757223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:24:56.757223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:24:56.757223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:24:56.757223 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:24:56.758927 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:24:56.758927 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:24:56.758927 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 10 23:24:56.758927 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 10 23:24:56.758927 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:24:56.758927 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:24:56.758927 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4569a9f-a5d9-4e8c-8236-4005a970cd97 could not be found. Oct 10 23:24:56.758927 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:24:56.758927 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:24:56.758927 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:24:56.758927 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:24:56.758927 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:24:56.758927 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:24:56.758927 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:24:56.758927 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:24:56.758927 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4569a9f-a5d9-4e8c-8236-4005a970cd97 could not be found. Oct 10 23:24:56.758927 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:24:56.763598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-16709ef4-6243-4b20-8ac5-6009c07f3eaa tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Returning 404 to user: Instance c4569a9f-a5d9-4e8c-8236-4005a970cd97 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:24:56.766437 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-16709ef4-6243-4b20-8ac5-6009c07f3eaa tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/c4569a9f-a5d9-4e8c-8236-4005a970cd97/action" status: 404 len: 111 microversion: 2.1 time: 0.665895 Oct 10 23:24:56.772980 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1083/2185] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:24:56 2022] POST /compute/v2.1/servers/c4569a9f-a5d9-4e8c-8236-4005a970cd97/action => generated 111 bytes in 673 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:24:56.786939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-ff4a7552-9c0f-4178-9814-2e7c850cb268 req-4d3c5345-b8ba-4381-8d79-b2d6fb74f1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe142b1-562e-4ca2-a300-84a0bf7353ac", "name": "network-vif-unplugged", "status": "completed", "tag": "183fcafc-50f1-4a82-bda7-809f6f81821e"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:56.864187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ff4a7552-9c0f-4178-9814-2e7c850cb268 req-4d3c5345-b8ba-4381-8d79-b2d6fb74f1d5 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:56.864989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ff4a7552-9c0f-4178-9814-2e7c850cb268 req-4d3c5345-b8ba-4381-8d79-b2d6fb74f1d5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:56.865726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ff4a7552-9c0f-4178-9814-2e7c850cb268 req-4d3c5345-b8ba-4381-8d79-b2d6fb74f1d5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:56.936188 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-ff4a7552-9c0f-4178-9814-2e7c850cb268 req-4d3c5345-b8ba-4381-8d79-b2d6fb74f1d5 service nova] Creating event network-vif-unplugged:183fcafc-50f1-4a82-bda7-809f6f81821e for instance abe142b1-562e-4ca2-a300-84a0bf7353ac on n-h2-860864-2 Oct 10 23:24:56.959138 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-ff4a7552-9c0f-4178-9814-2e7c850cb268 req-4d3c5345-b8ba-4381-8d79-b2d6fb74f1d5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.183379 Oct 10 23:24:56.962507 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1084/2186] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:24:56.974150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b73ba030-e960-4be3-b485-3db85f581a67 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:56.975447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b73ba030-e960-4be3-b485-3db85f581a67 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:56.987691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b73ba030-e960-4be3-b485-3db85f581a67 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:56.989881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b73ba030-e960-4be3-b485-3db85f581a67 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:56.990993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b73ba030-e960-4be3-b485-3db85f581a67 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:56.992747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b73ba030-e960-4be3-b485-3db85f581a67 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:56.993857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b73ba030-e960-4be3-b485-3db85f581a67 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:56.994828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b73ba030-e960-4be3-b485-3db85f581a67 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:57.059874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:57.429171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b73ba030-e960-4be3-b485-3db85f581a67 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:57.454325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b73ba030-e960-4be3-b485-3db85f581a67 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:57.457963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b73ba030-e960-4be3-b485-3db85f581a67 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:57.461336 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b73ba030-e960-4be3-b485-3db85f581a67 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 0.496107 Oct 10 23:24:57.463102 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1085/2187] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:56 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:57.471784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b696a600-b2a0-46b3-9e26-7965a160933e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:57.480157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b696a600-b2a0-46b3-9e26-7965a160933e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 90cc20e4-bd05-44fc-931c-ddffba1494e6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:57.497040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b696a600-b2a0-46b3-9e26-7965a160933e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:57.499213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b696a600-b2a0-46b3-9e26-7965a160933e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:57.499728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b696a600-b2a0-46b3-9e26-7965a160933e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:57.500468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b696a600-b2a0-46b3-9e26-7965a160933e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:57.500938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b696a600-b2a0-46b3-9e26-7965a160933e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:57.501368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b696a600-b2a0-46b3-9e26-7965a160933e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:57.520256 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-b696a600-b2a0-46b3-9e26-7965a160933e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] HTTP exception thrown: Instance 90cc20e4-bd05-44fc-931c-ddffba1494e6 could not be found. Oct 10 23:24:57.522521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b696a600-b2a0-46b3-9e26-7965a160933e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Request method failure captured: Oct 10 23:24:57.522521 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 HTTP/1.1 Oct 10 23:24:57.522521 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:24:57.522521 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:24:57.522521 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:24:57.522521 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:24:57.522521 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:24:57.522521 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:24:57.522521 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:24:57.522521 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:24:57.522521 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKgRPLcuZOQHwLU9RnicPEH510hzllvVdPlPCGOmNQBoxDHi79ZXGpYqFEY19dF7VzBhNqLTlXC_vyC8MW9a2tEUHUYnDXlBf-DOE9ZImuHN1BHcoafH9TPbkB373S2vzrdGE3t7fAFAdG2i4H3Rh-M7BKAz8ehKA0Q1u4tVUaE3hyQ Oct 10 23:24:57.522521 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:24:57.522521 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:24:57.522521 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:24:57.522521 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:24:57.522521 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:24:57.522521 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:24:57.522521 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 1b5a9d1de27b407e91ff0ae66242ec81 Oct 10 23:24:57.522521 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-LiveMigrationTest-1684235659 Oct 10 23:24:57.522521 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:24:57.522521 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:24:57.524299 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1b5a9d1de27b407e91ff0ae66242ec81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1b5a9d1de27b407e91ff0ae66242ec81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1b5a9d1de27b407e91ff0ae66242ec81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1b5a9d1de27b407e91ff0ae66242ec81", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:24:57.524299 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-LiveMigrationTest-1684235659 Oct 10 23:24:57.524299 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 1b5a9d1de27b407e91ff0ae66242ec81 Oct 10 23:24:57.524299 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-LiveMigrationTest-1684235659 Oct 10 23:24:57.524299 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-LiveMigrationTest-1684235659-project Oct 10 23:24:57.524299 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:24:57.524299 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:24:57.524299 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 9bd83ab05cb34853bbab0f86a630aa1e Oct 10 23:24:57.524299 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-LiveMigrationTest-1684235659-project Oct 10 23:24:57.524299 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:24:57.524299 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 90cc20e4-bd05-44fc-931c-ddffba1494e6 could not be found. Oct 10 23:24:57.524299 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '90cc20e4-bd05-44fc-931c-ddffba1494e6'} Oct 10 23:24:57.525492 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:24:57.525492 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:24:57.525492 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:24:57.525492 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:24:57.525492 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:24:57.525492 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:24:57.525492 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:24:57.525492 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:24:57.525492 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:24:57.525492 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:24:57.525492 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90cc20e4-bd05-44fc-931c-ddffba1494e6 could not be found. Oct 10 23:24:57.525492 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:24:57.525492 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:24:57.525492 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:24:57.525492 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:24:57.525492 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:24:57.525492 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:24:57.525492 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:24:57.525492 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:24:57.525492 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:24:57.527877 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:24:57.527877 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:24:57.527877 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:24:57.527877 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:24:57.527877 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:24:57.527877 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:24:57.527877 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:24:57.527877 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90cc20e4-bd05-44fc-931c-ddffba1494e6 could not be found. Oct 10 23:24:57.527877 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:24:57.527877 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:24:57.527877 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:24:57.527877 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:24:57.527877 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:24:57.527877 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:24:57.527877 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:24:57.527877 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:24:57.527877 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90cc20e4-bd05-44fc-931c-ddffba1494e6 could not be found. Oct 10 23:24:57.527877 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:24:57.531413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b696a600-b2a0-46b3-9e26-7965a160933e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Returning 404 to user: Instance 90cc20e4-bd05-44fc-931c-ddffba1494e6 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:24:57.531413 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b696a600-b2a0-46b3-9e26-7965a160933e tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6" status: 404 len: 111 microversion: 2.1 time: 0.059712 Oct 10 23:24:57.531413 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1086/2188] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:57 2022] GET /compute/v2.1/servers/90cc20e4-bd05-44fc-931c-ddffba1494e6 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:24:57.534525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6ce2ea8d-0e5c-44cb-9340-ba9fbf919c4d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-735061630", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:57.650887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-6ce2ea8d-0e5c-44cb-9340-ba9fbf919c4d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] validate_networks() for None {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:24:58.097745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6ce2ea8d-0e5c-44cb-9340-ba9fbf919c4d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:24:58.098365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6ce2ea8d-0e5c-44cb-9340-ba9fbf919c4d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:24:58.099562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6ce2ea8d-0e5c-44cb-9340-ba9fbf919c4d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:24:58.100014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6ce2ea8d-0e5c-44cb-9340-ba9fbf919c4d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:24:58.100493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6ce2ea8d-0e5c-44cb-9340-ba9fbf919c4d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:24:58.106851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:24:58.125783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ce2ea8d-0e5c-44cb-9340-ba9fbf919c4d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:58.126281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ce2ea8d-0e5c-44cb-9340-ba9fbf919c4d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:58.126729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ce2ea8d-0e5c-44cb-9340-ba9fbf919c4d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:58.127713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ce2ea8d-0e5c-44cb-9340-ba9fbf919c4d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:58.128176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ce2ea8d-0e5c-44cb-9340-ba9fbf919c4d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:58.128759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ce2ea8d-0e5c-44cb-9340-ba9fbf919c4d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:58.154676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-6ce2ea8d-0e5c-44cb-9340-ba9fbf919c4d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Getting quotas for project b6f65dbe8455479391d42d0a97fa1305. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:24:58.160567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-6ce2ea8d-0e5c-44cb-9340-ba9fbf919c4d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Getting quotas for user be8faa9362e94ceab173df40b3008af1 and project b6f65dbe8455479391d42d0a97fa1305. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:24:58.182074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6ce2ea8d-0e5c-44cb-9340-ba9fbf919c4d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:24:58.184853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6ce2ea8d-0e5c-44cb-9340-ba9fbf919c4d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:24:58.253471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-f5a89c8f-7232-4882-9306-4317f9c5d5a9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:24:58.254037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-f5a89c8f-7232-4882-9306-4317f9c5d5a9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:24:58.255154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-f5a89c8f-7232-4882-9306-4317f9c5d5a9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:24:58.255561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-f5a89c8f-7232-4882-9306-4317f9c5d5a9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:24:58.256199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-f5a89c8f-7232-4882-9306-4317f9c5d5a9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:24:58.268801 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6ce2ea8d-0e5c-44cb-9340-ba9fbf919c4d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738579 Oct 10 23:24:58.273627 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5a89c8f-7232-4882-9306-4317f9c5d5a9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:58.275650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5a89c8f-7232-4882-9306-4317f9c5d5a9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:58.276465 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1087/2189] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:24:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:24:58.277359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5a89c8f-7232-4882-9306-4317f9c5d5a9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:58.278519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5a89c8f-7232-4882-9306-4317f9c5d5a9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:58.279115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5a89c8f-7232-4882-9306-4317f9c5d5a9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:58.279673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5a89c8f-7232-4882-9306-4317f9c5d5a9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:58.288440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4196c0f1-b62e-45eb-aa39-6af49ac040bb tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:58.289282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4196c0f1-b62e-45eb-aa39-6af49ac040bb tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:58.302132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4196c0f1-b62e-45eb-aa39-6af49ac040bb tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:58.303063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4196c0f1-b62e-45eb-aa39-6af49ac040bb tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:58.304116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4196c0f1-b62e-45eb-aa39-6af49ac040bb tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:58.306291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4196c0f1-b62e-45eb-aa39-6af49ac040bb tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:58.306971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4196c0f1-b62e-45eb-aa39-6af49ac040bb tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:58.307727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4196c0f1-b62e-45eb-aa39-6af49ac040bb tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:58.332520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-f5a89c8f-7232-4882-9306-4317f9c5d5a9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Getting quotas for project 451d034bd7474164a08bd3374680c0d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:24:58.340904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-f5a89c8f-7232-4882-9306-4317f9c5d5a9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Getting quotas for user 60c692636a4b4667a4eff5cde6e183bc and project 451d034bd7474164a08bd3374680c0d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:24:58.364076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f5a89c8f-7232-4882-9306-4317f9c5d5a9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:24:58.370510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f5a89c8f-7232-4882-9306-4317f9c5d5a9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 5242250f-5274-4992-adb3-e8fdd3b65ed7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:24:58.482379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4196c0f1-b62e-45eb-aa39-6af49ac040bb tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:58.489201 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f5a89c8f-7232-4882-9306-4317f9c5d5a9 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.573144 Oct 10 23:24:58.490384 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1103/2190] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:24:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:24:58.501322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2307cb28-f0ee-4f0e-8484-a9c850eece89 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '.version_select at 0x7f662a8a8040>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:58.516110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4196c0f1-b62e-45eb-aa39-6af49ac040bb tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:58.523243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4196c0f1-b62e-45eb-aa39-6af49ac040bb tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:58.540953 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2307cb28-f0ee-4f0e-8484-a9c850eece89 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-242336254" status: 202 len: 0 microversion: 2.1 time: 0.049602 Oct 10 23:24:58.544834 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1104/2191] 10.222.0.23 () {58 vars in 1218 bytes} [Mon Oct 10 23:24:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-242336254 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:24:58.544969 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4196c0f1-b62e-45eb-aa39-6af49ac040bb tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.259417 Oct 10 23:24:58.558836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-81c9dd79-5315-4775-b6ff-5262a485bacb req-cf086177-6f70-4078-a9fc-d51284b88ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cc20e4-bd05-44fc-931c-ddffba1494e6", "name": "network-vif-deleted", "tag": "9cd0c0df-842e-4355-8798-be1d34e79325"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:24:58.568882 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1088/2192] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:58 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:24:58.584483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-58a18832-9663-4ac9-b37e-db4497606ca4 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:58.588107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-58a18832-9663-4ac9-b37e-db4497606ca4 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:58.626027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-81c9dd79-5315-4775-b6ff-5262a485bacb req-cf086177-6f70-4078-a9fc-d51284b88ae6 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:58.626580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-81c9dd79-5315-4775-b6ff-5262a485bacb req-cf086177-6f70-4078-a9fc-d51284b88ae6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:58.627030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-81c9dd79-5315-4775-b6ff-5262a485bacb req-cf086177-6f70-4078-a9fc-d51284b88ae6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:58.684148 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-81c9dd79-5315-4775-b6ff-5262a485bacb req-cf086177-6f70-4078-a9fc-d51284b88ae6 service nova] Creating event network-vif-deleted:9cd0c0df-842e-4355-8798-be1d34e79325 for instance 90cc20e4-bd05-44fc-931c-ddffba1494e6 on n-h1-860864-2 Oct 10 23:24:58.693157 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-81c9dd79-5315-4775-b6ff-5262a485bacb req-cf086177-6f70-4078-a9fc-d51284b88ae6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149904 Oct 10 23:24:58.694916 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1105/2193] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:24:58.700631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fbe33bb4-8e7c-471d-b385-c877a3eb9600 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:58.701881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fbe33bb4-8e7c-471d-b385-c877a3eb9600 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:58.711297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbe33bb4-8e7c-471d-b385-c877a3eb9600 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:58.711787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbe33bb4-8e7c-471d-b385-c877a3eb9600 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:58.712221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbe33bb4-8e7c-471d-b385-c877a3eb9600 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:58.712927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbe33bb4-8e7c-471d-b385-c877a3eb9600 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:58.714769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbe33bb4-8e7c-471d-b385-c877a3eb9600 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:58.714769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbe33bb4-8e7c-471d-b385-c877a3eb9600 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:58.827126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-58a18832-9663-4ac9-b37e-db4497606ca4 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:58.841195 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-58a18832-9663-4ac9-b37e-db4497606ca4 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 200 len: 1221 microversion: 2.1 time: 0.269511 Oct 10 23:24:58.842066 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1089/2194] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:58 2022] GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 1221 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:58.868837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fb19c0db-3be5-4c6e-bcab-fe01ae42358f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:58.880632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fb19c0db-3be5-4c6e-bcab-fe01ae42358f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 5242250f-5274-4992-adb3-e8fdd3b65ed7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:59.076579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fb19c0db-3be5-4c6e-bcab-fe01ae42358f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:24:59.097090 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fb19c0db-3be5-4c6e-bcab-fe01ae42358f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7" status: 200 len: 1208 microversion: 2.1 time: 0.232290 Oct 10 23:24:59.119396 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1090/2195] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:24:58 2022] GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7 => generated 1208 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:24:59.601436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3fb3a2b2-dfd9-4192-ae94-1c31311198b2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:24:59.602081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3fb3a2b2-dfd9-4192-ae94-1c31311198b2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:24:59.693719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fb3a2b2-dfd9-4192-ae94-1c31311198b2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:59.699888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fb3a2b2-dfd9-4192-ae94-1c31311198b2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:59.703027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fb3a2b2-dfd9-4192-ae94-1c31311198b2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:24:59.721122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fb3a2b2-dfd9-4192-ae94-1c31311198b2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:24:59.727146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fb3a2b2-dfd9-4192-ae94-1c31311198b2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:24:59.736607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fb3a2b2-dfd9-4192-ae94-1c31311198b2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:00.118154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3fb3a2b2-dfd9-4192-ae94-1c31311198b2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:00.187713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3fb3a2b2-dfd9-4192-ae94-1c31311198b2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:00.197270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3fb3a2b2-dfd9-4192-ae94-1c31311198b2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:00.222447 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3fb3a2b2-dfd9-4192-ae94-1c31311198b2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.645619 Oct 10 23:25:00.226526 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1091/2196] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:59 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:00.246252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a7cb735e-0edd-4e9c-b349-37a38ef28882 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:00.247162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a7cb735e-0edd-4e9c-b349-37a38ef28882 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:00.266155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7cb735e-0edd-4e9c-b349-37a38ef28882 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:00.267232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7cb735e-0edd-4e9c-b349-37a38ef28882 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:00.268831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7cb735e-0edd-4e9c-b349-37a38ef28882 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:00.270106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7cb735e-0edd-4e9c-b349-37a38ef28882 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:00.274246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7cb735e-0edd-4e9c-b349-37a38ef28882 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:00.276483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7cb735e-0edd-4e9c-b349-37a38ef28882 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:00.492202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fbe33bb4-8e7c-471d-b385-c877a3eb9600 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:00.532028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fbe33bb4-8e7c-471d-b385-c877a3eb9600 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:00.533946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fbe33bb4-8e7c-471d-b385-c877a3eb9600 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:00.535499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a7cb735e-0edd-4e9c-b349-37a38ef28882 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:00.535998 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fbe33bb4-8e7c-471d-b385-c877a3eb9600 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 1.839792 Oct 10 23:25:00.537429 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1106/2197] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:24:58 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:00.543786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5bb7b1b3-2e42-4be4-8cda-bfde5c5bbc35 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:00.544595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5bb7b1b3-2e42-4be4-8cda-bfde5c5bbc35 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 5242250f-5274-4992-adb3-e8fdd3b65ed7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:00.556722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5bb7b1b3-2e42-4be4-8cda-bfde5c5bbc35 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:00.557355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5bb7b1b3-2e42-4be4-8cda-bfde5c5bbc35 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:00.560081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5bb7b1b3-2e42-4be4-8cda-bfde5c5bbc35 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:00.563149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5bb7b1b3-2e42-4be4-8cda-bfde5c5bbc35 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:00.565218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5bb7b1b3-2e42-4be4-8cda-bfde5c5bbc35 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:00.567791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5bb7b1b3-2e42-4be4-8cda-bfde5c5bbc35 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:00.574581 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a7cb735e-0edd-4e9c-b349-37a38ef28882 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 200 len: 1273 microversion: 2.1 time: 0.333239 Oct 10 23:25:00.581880 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1092/2198] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:00 2022] GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 1273 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:00.597263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bdeca077-3c09-4000-987a-2992d46f681a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:00.597803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bdeca077-3c09-4000-987a-2992d46f681a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:00.633092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdeca077-3c09-4000-987a-2992d46f681a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:00.638442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdeca077-3c09-4000-987a-2992d46f681a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:00.646892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdeca077-3c09-4000-987a-2992d46f681a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:00.651054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdeca077-3c09-4000-987a-2992d46f681a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:00.651054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdeca077-3c09-4000-987a-2992d46f681a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:00.654721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdeca077-3c09-4000-987a-2992d46f681a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:00.736751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bdeca077-3c09-4000-987a-2992d46f681a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:25:00.884515 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bdeca077-3c09-4000-987a-2992d46f681a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "DELETE /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 204 len: 0 microversion: 2.1 time: 0.298977 Oct 10 23:25:00.887295 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1093/2199] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:25:00 2022] DELETE /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:25:00.903764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a3708351-f834-4b7c-8bb9-88d8a4da454b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:00.904623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a3708351-f834-4b7c-8bb9-88d8a4da454b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:00.915697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3708351-f834-4b7c-8bb9-88d8a4da454b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:00.916296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3708351-f834-4b7c-8bb9-88d8a4da454b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:00.917138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3708351-f834-4b7c-8bb9-88d8a4da454b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:00.918086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3708351-f834-4b7c-8bb9-88d8a4da454b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:00.918872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3708351-f834-4b7c-8bb9-88d8a4da454b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:00.919928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3708351-f834-4b7c-8bb9-88d8a4da454b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:01.155696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5bb7b1b3-2e42-4be4-8cda-bfde5c5bbc35 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:01.178132 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5bb7b1b3-2e42-4be4-8cda-bfde5c5bbc35 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7" status: 200 len: 1204 microversion: 2.1 time: 0.632357 Oct 10 23:25:01.184694 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1107/2200] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:00 2022] GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7 => generated 1204 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:01.227668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-69f24b81-3873-4600-9299-3ef6ddcea1e3 req-d2a058e5-6b11-4fd7-ba63-ea05b3a7ac9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a472045-8c28-4437-9e0f-9223369022ae", "tag": "7eabf4d8-5373-4658-bf95-07c701376608"}, {"server_uuid": "abe142b1-562e-4ca2-a300-84a0bf7353ac", "name": "network-vif-deleted", "tag": "183fcafc-50f1-4a82-bda7-809f6f81821e"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:01.296850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-69f24b81-3873-4600-9299-3ef6ddcea1e3 req-d2a058e5-6b11-4fd7-ba63-ea05b3a7ac9c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:01.307067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-69f24b81-3873-4600-9299-3ef6ddcea1e3 req-d2a058e5-6b11-4fd7-ba63-ea05b3a7ac9c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:01.307770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-69f24b81-3873-4600-9299-3ef6ddcea1e3 req-d2a058e5-6b11-4fd7-ba63-ea05b3a7ac9c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:01.362449 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-69f24b81-3873-4600-9299-3ef6ddcea1e3 req-d2a058e5-6b11-4fd7-ba63-ea05b3a7ac9c service nova] Creating event network-changed:7eabf4d8-5373-4658-bf95-07c701376608 for instance 3a472045-8c28-4437-9e0f-9223369022ae on n-h1-860864-2 Oct 10 23:25:01.362965 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-69f24b81-3873-4600-9299-3ef6ddcea1e3 req-d2a058e5-6b11-4fd7-ba63-ea05b3a7ac9c service nova] Creating event network-vif-deleted:183fcafc-50f1-4a82-bda7-809f6f81821e for instance abe142b1-562e-4ca2-a300-84a0bf7353ac on n-h2-860864-2 Oct 10 23:25:01.378272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a3708351-f834-4b7c-8bb9-88d8a4da454b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:01.396821 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a3708351-f834-4b7c-8bb9-88d8a4da454b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1485 microversion: 2.1 time: 0.502399 Oct 10 23:25:01.397694 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1094/2201] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:00 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1485 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:01.402509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c57c116e-418d-4869-8297-a22730745c43 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:01.403355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c57c116e-418d-4869-8297-a22730745c43 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:01.417794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c57c116e-418d-4869-8297-a22730745c43 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:01.418592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c57c116e-418d-4869-8297-a22730745c43 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:01.419915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c57c116e-418d-4869-8297-a22730745c43 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:01.420865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c57c116e-418d-4869-8297-a22730745c43 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:01.421662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c57c116e-418d-4869-8297-a22730745c43 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:01.422315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c57c116e-418d-4869-8297-a22730745c43 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:01.477492 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-69f24b81-3873-4600-9299-3ef6ddcea1e3 req-d2a058e5-6b11-4fd7-ba63-ea05b3a7ac9c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.278625 Oct 10 23:25:01.478631 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1108/2202] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:25:01.562669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c57c116e-418d-4869-8297-a22730745c43 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:01.573837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ea686aa9-591d-48d5-82dd-a6238f2ccfb1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:01.575714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ea686aa9-591d-48d5-82dd-a6238f2ccfb1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:01.580299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c57c116e-418d-4869-8297-a22730745c43 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:01.582755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c57c116e-418d-4869-8297-a22730745c43 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:01.588859 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c57c116e-418d-4869-8297-a22730745c43 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.189780 Oct 10 23:25:01.589615 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1095/2203] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:01 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:01.591913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea686aa9-591d-48d5-82dd-a6238f2ccfb1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:01.592563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea686aa9-591d-48d5-82dd-a6238f2ccfb1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:01.593736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea686aa9-591d-48d5-82dd-a6238f2ccfb1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:01.594462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea686aa9-591d-48d5-82dd-a6238f2ccfb1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:01.594913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea686aa9-591d-48d5-82dd-a6238f2ccfb1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:01.595333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea686aa9-591d-48d5-82dd-a6238f2ccfb1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:01.610536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e3b390a4-fa82-4962-8d63-ec3e903dfc60 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:01.611163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e3b390a4-fa82-4962-8d63-ec3e903dfc60 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:01.620318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3b390a4-fa82-4962-8d63-ec3e903dfc60 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:01.620831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3b390a4-fa82-4962-8d63-ec3e903dfc60 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:01.621280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3b390a4-fa82-4962-8d63-ec3e903dfc60 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:01.622054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3b390a4-fa82-4962-8d63-ec3e903dfc60 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:01.622572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3b390a4-fa82-4962-8d63-ec3e903dfc60 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:01.623302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3b390a4-fa82-4962-8d63-ec3e903dfc60 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:02.318434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e3b390a4-fa82-4962-8d63-ec3e903dfc60 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:02.327850 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e3b390a4-fa82-4962-8d63-ec3e903dfc60 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 200 len: 1281 microversion: 2.1 time: 0.722005 Oct 10 23:25:02.332166 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1096/2204] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:01 2022] GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 1281 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:02.341474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-420b2725-e5a2-46ba-a2a4-f1eb92ee6b80 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:02.344840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-420b2725-e5a2-46ba-a2a4-f1eb92ee6b80 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 5242250f-5274-4992-adb3-e8fdd3b65ed7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:02.359938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-420b2725-e5a2-46ba-a2a4-f1eb92ee6b80 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:02.363429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-420b2725-e5a2-46ba-a2a4-f1eb92ee6b80 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:02.364076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-420b2725-e5a2-46ba-a2a4-f1eb92ee6b80 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:02.368034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-420b2725-e5a2-46ba-a2a4-f1eb92ee6b80 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:02.368733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-420b2725-e5a2-46ba-a2a4-f1eb92ee6b80 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:02.369344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-420b2725-e5a2-46ba-a2a4-f1eb92ee6b80 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:02.549699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-420b2725-e5a2-46ba-a2a4-f1eb92ee6b80 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:02.564650 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-420b2725-e5a2-46ba-a2a4-f1eb92ee6b80 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7" status: 200 len: 1260 microversion: 2.1 time: 0.231082 Oct 10 23:25:02.586780 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1097/2205] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:02 2022] GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7 => generated 1260 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:02.598432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d5e18711-390c-40ae-bc75-b5e9cb5bc579 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:02.600203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d5e18711-390c-40ae-bc75-b5e9cb5bc579 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:02.619970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5e18711-390c-40ae-bc75-b5e9cb5bc579 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:02.620876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5e18711-390c-40ae-bc75-b5e9cb5bc579 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:02.623900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5e18711-390c-40ae-bc75-b5e9cb5bc579 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:02.625217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5e18711-390c-40ae-bc75-b5e9cb5bc579 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:02.625943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5e18711-390c-40ae-bc75-b5e9cb5bc579 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:02.626608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5e18711-390c-40ae-bc75-b5e9cb5bc579 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:03.180864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ea686aa9-591d-48d5-82dd-a6238f2ccfb1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:03.194672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ea686aa9-591d-48d5-82dd-a6238f2ccfb1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:03.201090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ea686aa9-591d-48d5-82dd-a6238f2ccfb1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:03.208298 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ea686aa9-591d-48d5-82dd-a6238f2ccfb1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 1.643981 Oct 10 23:25:03.226706 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1109/2206] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:01 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:03.240499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-294e2b0f-3947-4cbd-9ec1-a5674ad011cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:03.242672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-294e2b0f-3947-4cbd-9ec1-a5674ad011cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:03.260009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-294e2b0f-3947-4cbd-9ec1-a5674ad011cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:03.260802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-294e2b0f-3947-4cbd-9ec1-a5674ad011cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:03.261643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-294e2b0f-3947-4cbd-9ec1-a5674ad011cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:03.263673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-294e2b0f-3947-4cbd-9ec1-a5674ad011cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:03.265089 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-294e2b0f-3947-4cbd-9ec1-a5674ad011cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:03.267301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-294e2b0f-3947-4cbd-9ec1-a5674ad011cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:03.360444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d5e18711-390c-40ae-bc75-b5e9cb5bc579 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:03.372074 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d5e18711-390c-40ae-bc75-b5e9cb5bc579 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1485 microversion: 2.1 time: 0.782921 Oct 10 23:25:03.373301 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1098/2207] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:02 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1485 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:03.380117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5d93ad72-e40a-4360-98d8-290d2652a333 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:03.381280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5d93ad72-e40a-4360-98d8-290d2652a333 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:03.406396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d93ad72-e40a-4360-98d8-290d2652a333 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:03.407853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d93ad72-e40a-4360-98d8-290d2652a333 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:03.408629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d93ad72-e40a-4360-98d8-290d2652a333 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:03.410431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d93ad72-e40a-4360-98d8-290d2652a333 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:03.412493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d93ad72-e40a-4360-98d8-290d2652a333 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:03.413344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d93ad72-e40a-4360-98d8-290d2652a333 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:03.731623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5d93ad72-e40a-4360-98d8-290d2652a333 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:03.749972 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5d93ad72-e40a-4360-98d8-290d2652a333 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 200 len: 1279 microversion: 2.1 time: 0.368291 Oct 10 23:25:03.751833 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1099/2208] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:03 2022] GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 1279 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:03.761331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1ffb06ea-a180-4fd0-9533-aba27f87122b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:03.768122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1ffb06ea-a180-4fd0-9533-aba27f87122b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 5242250f-5274-4992-adb3-e8fdd3b65ed7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:03.784456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ffb06ea-a180-4fd0-9533-aba27f87122b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:03.795134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ffb06ea-a180-4fd0-9533-aba27f87122b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:03.803493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ffb06ea-a180-4fd0-9533-aba27f87122b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:03.805763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ffb06ea-a180-4fd0-9533-aba27f87122b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:03.807313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-294e2b0f-3947-4cbd-9ec1-a5674ad011cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:03.810783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ffb06ea-a180-4fd0-9533-aba27f87122b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:03.816165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ffb06ea-a180-4fd0-9533-aba27f87122b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:03.838942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-294e2b0f-3947-4cbd-9ec1-a5674ad011cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:03.840395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-294e2b0f-3947-4cbd-9ec1-a5674ad011cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:03.858549 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-294e2b0f-3947-4cbd-9ec1-a5674ad011cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.628663 Oct 10 23:25:03.859537 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1110/2209] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:03 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:04.012624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1ffb06ea-a180-4fd0-9533-aba27f87122b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:04.024331 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1ffb06ea-a180-4fd0-9533-aba27f87122b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7" status: 200 len: 1266 microversion: 2.1 time: 0.270899 Oct 10 23:25:04.037407 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1100/2210] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:03 2022] GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7 => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:04.243369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5e52296a-b907-4ce4-84d3-d6381cee29b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:04.244672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5e52296a-b907-4ce4-84d3-d6381cee29b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:04.264881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e52296a-b907-4ce4-84d3-d6381cee29b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:04.267807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e52296a-b907-4ce4-84d3-d6381cee29b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:04.270085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e52296a-b907-4ce4-84d3-d6381cee29b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:04.271647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e52296a-b907-4ce4-84d3-d6381cee29b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:04.275540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e52296a-b907-4ce4-84d3-d6381cee29b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:04.279172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e52296a-b907-4ce4-84d3-d6381cee29b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:04.403882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0e6427db-f229-46e3-b2aa-e8d2436c5585 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:04.404864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0e6427db-f229-46e3-b2aa-e8d2436c5585 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:04.417911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e6427db-f229-46e3-b2aa-e8d2436c5585 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:04.419228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e6427db-f229-46e3-b2aa-e8d2436c5585 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:04.423051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e6427db-f229-46e3-b2aa-e8d2436c5585 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:04.424727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e6427db-f229-46e3-b2aa-e8d2436c5585 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:04.426842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e6427db-f229-46e3-b2aa-e8d2436c5585 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:04.429046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e6427db-f229-46e3-b2aa-e8d2436c5585 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:04.845209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5e52296a-b907-4ce4-84d3-d6381cee29b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:04.860580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5e52296a-b907-4ce4-84d3-d6381cee29b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:04.866505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5e52296a-b907-4ce4-84d3-d6381cee29b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:04.870370 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5e52296a-b907-4ce4-84d3-d6381cee29b0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 0.633023 Oct 10 23:25:04.873139 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1111/2211] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:04 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:04.887019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fdbad5bc-3df7-48b3-850d-664f99108349 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:04.888293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fdbad5bc-3df7-48b3-850d-664f99108349 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:04.893576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0e6427db-f229-46e3-b2aa-e8d2436c5585 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:04.916376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdbad5bc-3df7-48b3-850d-664f99108349 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:04.917097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdbad5bc-3df7-48b3-850d-664f99108349 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:04.918533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdbad5bc-3df7-48b3-850d-664f99108349 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:04.919122 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0e6427db-f229-46e3-b2aa-e8d2436c5585 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1485 microversion: 2.1 time: 0.519908 Oct 10 23:25:04.919974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdbad5bc-3df7-48b3-850d-664f99108349 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:04.920567 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1101/2212] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:04 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1485 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:25:04.922144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdbad5bc-3df7-48b3-850d-664f99108349 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:04.923260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdbad5bc-3df7-48b3-850d-664f99108349 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:04.939150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-320f38ff-713b-4065-92c4-ab53c1fbee4b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:04.941049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-320f38ff-713b-4065-92c4-ab53c1fbee4b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:04.964297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-320f38ff-713b-4065-92c4-ab53c1fbee4b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:04.970759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-320f38ff-713b-4065-92c4-ab53c1fbee4b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:04.971453 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-320f38ff-713b-4065-92c4-ab53c1fbee4b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:04.972338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-320f38ff-713b-4065-92c4-ab53c1fbee4b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:04.976570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-320f38ff-713b-4065-92c4-ab53c1fbee4b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:04.977259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-320f38ff-713b-4065-92c4-ab53c1fbee4b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:05.109564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fdbad5bc-3df7-48b3-850d-664f99108349 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:05.131415 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fdbad5bc-3df7-48b3-850d-664f99108349 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 200 len: 1279 microversion: 2.1 time: 0.254294 Oct 10 23:25:05.134742 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1112/2213] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:04 2022] GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 1279 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:05.148847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fcc29817-d892-42fd-b454-0ba9e41e16f1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:05.150675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fcc29817-d892-42fd-b454-0ba9e41e16f1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 5242250f-5274-4992-adb3-e8fdd3b65ed7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:05.168434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fcc29817-d892-42fd-b454-0ba9e41e16f1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:05.170270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fcc29817-d892-42fd-b454-0ba9e41e16f1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:05.172179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fcc29817-d892-42fd-b454-0ba9e41e16f1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:05.175394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fcc29817-d892-42fd-b454-0ba9e41e16f1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:05.176261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fcc29817-d892-42fd-b454-0ba9e41e16f1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:05.177998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fcc29817-d892-42fd-b454-0ba9e41e16f1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:05.504041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-320f38ff-713b-4065-92c4-ab53c1fbee4b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:05.520905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-320f38ff-713b-4065-92c4-ab53c1fbee4b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:05.535507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-320f38ff-713b-4065-92c4-ab53c1fbee4b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:05.554635 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-320f38ff-713b-4065-92c4-ab53c1fbee4b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.630170 Oct 10 23:25:05.555575 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1102/2214] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:04 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:05.620741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-a96e7613-6018-47cf-ab0b-71bbd8b0507e req-4d71138c-adc8-48ae-b8cb-2ac67da5c301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87be6fab-2ad1-4a49-8b54-8eb2e50c3e29", "name": "network-vif-deleted", "tag": "0e2b501e-2b2d-414d-9297-d0c72224e923"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:05.675327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a96e7613-6018-47cf-ab0b-71bbd8b0507e req-4d71138c-adc8-48ae-b8cb-2ac67da5c301 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:05.676932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a96e7613-6018-47cf-ab0b-71bbd8b0507e req-4d71138c-adc8-48ae-b8cb-2ac67da5c301 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:05.678184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a96e7613-6018-47cf-ab0b-71bbd8b0507e req-4d71138c-adc8-48ae-b8cb-2ac67da5c301 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:05.710147 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a96e7613-6018-47cf-ab0b-71bbd8b0507e req-4d71138c-adc8-48ae-b8cb-2ac67da5c301 service nova] Creating event network-vif-deleted:0e2b501e-2b2d-414d-9297-d0c72224e923 for instance 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 on n-h2-860864-2 Oct 10 23:25:05.722239 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-a96e7613-6018-47cf-ab0b-71bbd8b0507e req-4d71138c-adc8-48ae-b8cb-2ac67da5c301 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115936 Oct 10 23:25:05.723501 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1103/2215] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:25:05.905138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-97514a03-8010-4bf3-bc13-d05758dc4326 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:05.906451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-97514a03-8010-4bf3-bc13-d05758dc4326 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:05.922862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97514a03-8010-4bf3-bc13-d05758dc4326 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:05.941820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97514a03-8010-4bf3-bc13-d05758dc4326 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:05.941820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97514a03-8010-4bf3-bc13-d05758dc4326 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:05.942921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97514a03-8010-4bf3-bc13-d05758dc4326 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:05.948212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97514a03-8010-4bf3-bc13-d05758dc4326 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:05.949848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97514a03-8010-4bf3-bc13-d05758dc4326 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:05.971137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:25:06.374145 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fcc29817-d892-42fd-b454-0ba9e41e16f1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:06.396675 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fcc29817-d892-42fd-b454-0ba9e41e16f1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7" status: 200 len: 1308 microversion: 2.1 time: 1.260425 Oct 10 23:25:06.398083 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1113/2216] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:05 2022] GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7 => generated 1308 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:06.405308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7fafa254-3feb-4fdf-aa23-bf747273e4d7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:06.406306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7fafa254-3feb-4fdf-aa23-bf747273e4d7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:06.417069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fafa254-3feb-4fdf-aa23-bf747273e4d7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:06.420254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fafa254-3feb-4fdf-aa23-bf747273e4d7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:06.420845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-97514a03-8010-4bf3-bc13-d05758dc4326 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:06.424267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fafa254-3feb-4fdf-aa23-bf747273e4d7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:06.425353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fafa254-3feb-4fdf-aa23-bf747273e4d7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:06.426256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fafa254-3feb-4fdf-aa23-bf747273e4d7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:06.427160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fafa254-3feb-4fdf-aa23-bf747273e4d7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:06.439724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-97514a03-8010-4bf3-bc13-d05758dc4326 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:06.441186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-97514a03-8010-4bf3-bc13-d05758dc4326 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:06.442440 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-97514a03-8010-4bf3-bc13-d05758dc4326 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 0.543550 Oct 10 23:25:06.443359 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1104/2217] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:05 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:06.452869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f253ba0c-84bc-4be3-8a80-91a93ccffd37 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:06.453551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f253ba0c-84bc-4be3-8a80-91a93ccffd37 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:06.466109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f253ba0c-84bc-4be3-8a80-91a93ccffd37 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:06.466717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f253ba0c-84bc-4be3-8a80-91a93ccffd37 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:06.467335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f253ba0c-84bc-4be3-8a80-91a93ccffd37 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:06.482308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f253ba0c-84bc-4be3-8a80-91a93ccffd37 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:06.482830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f253ba0c-84bc-4be3-8a80-91a93ccffd37 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:06.483344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f253ba0c-84bc-4be3-8a80-91a93ccffd37 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:06.524662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fafa254-3feb-4fdf-aa23-bf747273e4d7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:06.526591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fafa254-3feb-4fdf-aa23-bf747273e4d7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:06.527187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fafa254-3feb-4fdf-aa23-bf747273e4d7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:06.527846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-7fafa254-3feb-4fdf-aa23-bf747273e4d7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lazy-loading 'fault' on Instance uuid 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:25:06.967049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f253ba0c-84bc-4be3-8a80-91a93ccffd37 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:06.989751 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f253ba0c-84bc-4be3-8a80-91a93ccffd37 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 200 len: 1321 microversion: 2.1 time: 0.538867 Oct 10 23:25:06.993708 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1105/2218] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:06 2022] GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 1321 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:07.010707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5b77841e-6e86-4e05-a121-912ac6cdf91d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:07.012058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5b77841e-6e86-4e05-a121-912ac6cdf91d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:07.036744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b77841e-6e86-4e05-a121-912ac6cdf91d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:07.037305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b77841e-6e86-4e05-a121-912ac6cdf91d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:07.037888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b77841e-6e86-4e05-a121-912ac6cdf91d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:07.038523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b77841e-6e86-4e05-a121-912ac6cdf91d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:07.039015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b77841e-6e86-4e05-a121-912ac6cdf91d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:07.039446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b77841e-6e86-4e05-a121-912ac6cdf91d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:07.067122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7fafa254-3feb-4fdf-aa23-bf747273e4d7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:07.079025 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7fafa254-3feb-4fdf-aa23-bf747273e4d7 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 200 len: 1301 microversion: 2.1 time: 0.679526 Oct 10 23:25:07.087849 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1114/2219] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:06 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 1301 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:07.253799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5b77841e-6e86-4e05-a121-912ac6cdf91d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:07.269203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5b77841e-6e86-4e05-a121-912ac6cdf91d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:07.279108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5b77841e-6e86-4e05-a121-912ac6cdf91d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:07.292386 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5b77841e-6e86-4e05-a121-912ac6cdf91d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.296888 Oct 10 23:25:07.294128 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1106/2220] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:06 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:07.420822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d545878f-b1c2-4a5a-85a3-19143844496e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:07.422410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d545878f-b1c2-4a5a-85a3-19143844496e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 5242250f-5274-4992-adb3-e8fdd3b65ed7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:07.433645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d545878f-b1c2-4a5a-85a3-19143844496e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:07.434137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d545878f-b1c2-4a5a-85a3-19143844496e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:07.457897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-2f9266a4-4c22-445b-bc20-0e93cb594238 req-106ff0a1-3013-4c51-8078-00dc17285b78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5242250f-5274-4992-adb3-e8fdd3b65ed7", "tag": "90f86f41-ee10-436d-af23-bca655e7f68b"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:07.470352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d545878f-b1c2-4a5a-85a3-19143844496e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:07.479612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d545878f-b1c2-4a5a-85a3-19143844496e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:07.483086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d545878f-b1c2-4a5a-85a3-19143844496e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:07.487561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d545878f-b1c2-4a5a-85a3-19143844496e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:07.503454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2f9266a4-4c22-445b-bc20-0e93cb594238 req-106ff0a1-3013-4c51-8078-00dc17285b78 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:07.504977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2f9266a4-4c22-445b-bc20-0e93cb594238 req-106ff0a1-3013-4c51-8078-00dc17285b78 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:07.508437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2f9266a4-4c22-445b-bc20-0e93cb594238 req-106ff0a1-3013-4c51-8078-00dc17285b78 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:07.544708 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-2f9266a4-4c22-445b-bc20-0e93cb594238 req-106ff0a1-3013-4c51-8078-00dc17285b78 service nova] Creating event network-changed:90f86f41-ee10-436d-af23-bca655e7f68b for instance 5242250f-5274-4992-adb3-e8fdd3b65ed7 on n-h2-860864-2 Oct 10 23:25:07.574787 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-2f9266a4-4c22-445b-bc20-0e93cb594238 req-106ff0a1-3013-4c51-8078-00dc17285b78 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120903 Oct 10 23:25:07.581597 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1107/2221] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:25:07.587317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2b0eb3d8-f872-4b65-96ac-543dd10f21a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:07.595979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2b0eb3d8-f872-4b65-96ac-543dd10f21a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:07.615072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b0eb3d8-f872-4b65-96ac-543dd10f21a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:07.626225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b0eb3d8-f872-4b65-96ac-543dd10f21a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:07.626992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b0eb3d8-f872-4b65-96ac-543dd10f21a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:07.627995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b0eb3d8-f872-4b65-96ac-543dd10f21a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:07.628635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b0eb3d8-f872-4b65-96ac-543dd10f21a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:07.629278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b0eb3d8-f872-4b65-96ac-543dd10f21a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:08.138803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:25:08.150772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2b0eb3d8-f872-4b65-96ac-543dd10f21a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:08.160806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d545878f-b1c2-4a5a-85a3-19143844496e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:08.178099 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d545878f-b1c2-4a5a-85a3-19143844496e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7" status: 200 len: 1308 microversion: 2.1 time: 0.761204 Oct 10 23:25:08.178933 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1115/2222] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:07 2022] GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7 => generated 1308 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:25:08.195735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2b0eb3d8-f872-4b65-96ac-543dd10f21a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:08.200384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2b0eb3d8-f872-4b65-96ac-543dd10f21a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:08.205163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e02490d9-9b7c-4572-8422-a291043ddbf6 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:08.205868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e02490d9-9b7c-4572-8422-a291043ddbf6 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:08.208529 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2b0eb3d8-f872-4b65-96ac-543dd10f21a7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 0.624127 Oct 10 23:25:08.225412 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1108/2223] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:07 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:08.225850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e02490d9-9b7c-4572-8422-a291043ddbf6 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:08.225850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e02490d9-9b7c-4572-8422-a291043ddbf6 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:08.225850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e02490d9-9b7c-4572-8422-a291043ddbf6 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:08.225850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e02490d9-9b7c-4572-8422-a291043ddbf6 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:08.226373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e02490d9-9b7c-4572-8422-a291043ddbf6 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:08.226373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e02490d9-9b7c-4572-8422-a291043ddbf6 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:08.242256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-46e0d020-ccfb-4b5c-ae71-cda8d5723a92 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:08.243028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-46e0d020-ccfb-4b5c-ae71-cda8d5723a92 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:08.274708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46e0d020-ccfb-4b5c-ae71-cda8d5723a92 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:08.275240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46e0d020-ccfb-4b5c-ae71-cda8d5723a92 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:08.275709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46e0d020-ccfb-4b5c-ae71-cda8d5723a92 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:08.276500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46e0d020-ccfb-4b5c-ae71-cda8d5723a92 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:08.277024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46e0d020-ccfb-4b5c-ae71-cda8d5723a92 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:08.277631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46e0d020-ccfb-4b5c-ae71-cda8d5723a92 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:08.294678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:25:08.329031 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-46e0d020-ccfb-4b5c-ae71-cda8d5723a92 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] HTTP exception thrown: Instance 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 could not be found. Oct 10 23:25:08.333638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-46e0d020-ccfb-4b5c-ae71-cda8d5723a92 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Request method failure captured: Oct 10 23:25:08.333638 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 HTTP/1.1 Oct 10 23:25:08.333638 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:25:08.333638 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:25:08.333638 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:25:08.333638 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:25:08.333638 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:25:08.333638 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:25:08.333638 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:25:08.333638 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:25:08.333638 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKgRPLcuZOQHwLU9RnicPEH510hzllvVdPlPCGOmNQBoxDHi79ZXGpYqFEY19dF7VzBhNqLTlXC_vyC8MW9a2tEUHUYnDXlBf-DOE9ZImuHN1BHcoafH9TPbkB373S2vzrdGE3t7fAFAdG2i4H3Rh-M7BKAz8ehKA0Q1u4tVUaE3hyQ Oct 10 23:25:08.333638 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:25:08.333638 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:25:08.333638 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:25:08.333638 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:25:08.333638 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:25:08.333638 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:25:08.333638 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 1b5a9d1de27b407e91ff0ae66242ec81 Oct 10 23:25:08.333638 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-LiveMigrationTest-1684235659 Oct 10 23:25:08.333638 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:25:08.333638 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:25:08.336169 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1b5a9d1de27b407e91ff0ae66242ec81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1b5a9d1de27b407e91ff0ae66242ec81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1b5a9d1de27b407e91ff0ae66242ec81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1b5a9d1de27b407e91ff0ae66242ec81", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:25:08.336169 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-LiveMigrationTest-1684235659 Oct 10 23:25:08.336169 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 1b5a9d1de27b407e91ff0ae66242ec81 Oct 10 23:25:08.336169 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-LiveMigrationTest-1684235659 Oct 10 23:25:08.336169 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-LiveMigrationTest-1684235659-project Oct 10 23:25:08.336169 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:25:08.336169 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:25:08.336169 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 9bd83ab05cb34853bbab0f86a630aa1e Oct 10 23:25:08.336169 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-LiveMigrationTest-1684235659-project Oct 10 23:25:08.336169 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:25:08.336169 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 could not be found. Oct 10 23:25:08.336169 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '87be6fab-2ad1-4a49-8b54-8eb2e50c3e29'} Oct 10 23:25:08.337588 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:25:08.337588 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:08.337588 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:25:08.337588 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:25:08.337588 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:25:08.337588 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:25:08.337588 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:25:08.337588 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:25:08.337588 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:25:08.337588 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:25:08.337588 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 could not be found. Oct 10 23:25:08.337588 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:08.337588 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:08.337588 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:08.337588 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:08.337588 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:08.337588 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:08.337588 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:25:08.337588 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:25:08.337588 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:25:08.340992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:25:08.340992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:25:08.340992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:25:08.340992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:25:08.340992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:25:08.340992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:25:08.340992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:25:08.340992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 could not be found. Oct 10 23:25:08.340992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:08.340992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:08.340992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:08.340992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:08.340992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:08.340992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:08.340992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:25:08.340992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:25:08.340992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 could not be found. Oct 10 23:25:08.340992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:08.343692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-46e0d020-ccfb-4b5c-ae71-cda8d5723a92 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Returning 404 to user: Instance 87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:25:08.343692 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-46e0d020-ccfb-4b5c-ae71-cda8d5723a92 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29" status: 404 len: 111 microversion: 2.1 time: 0.114587 Oct 10 23:25:08.343692 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1109/2224] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:08 2022] GET /compute/v2.1/servers/87be6fab-2ad1-4a49-8b54-8eb2e50c3e29 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:25:08.350636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cdcfc862-8a2f-4eaf-a9f6-4656ee55e013 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:08.351290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cdcfc862-8a2f-4eaf-a9f6-4656ee55e013 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:08.351988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:25:08.366539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdcfc862-8a2f-4eaf-a9f6-4656ee55e013 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:08.367100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdcfc862-8a2f-4eaf-a9f6-4656ee55e013 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:08.367835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdcfc862-8a2f-4eaf-a9f6-4656ee55e013 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:08.368456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdcfc862-8a2f-4eaf-a9f6-4656ee55e013 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:08.369931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdcfc862-8a2f-4eaf-a9f6-4656ee55e013 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:08.370605 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdcfc862-8a2f-4eaf-a9f6-4656ee55e013 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:08.504286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cdcfc862-8a2f-4eaf-a9f6-4656ee55e013 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:08.524538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cdcfc862-8a2f-4eaf-a9f6-4656ee55e013 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:08.530890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cdcfc862-8a2f-4eaf-a9f6-4656ee55e013 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:08.552893 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cdcfc862-8a2f-4eaf-a9f6-4656ee55e013 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.210555 Oct 10 23:25:08.557005 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1110/2225] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:08 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:08.574675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c1154113-dcb4-478d-8826-48827835ee6b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:08.575561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c1154113-dcb4-478d-8826-48827835ee6b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:08.594125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1154113-dcb4-478d-8826-48827835ee6b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:08.596705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1154113-dcb4-478d-8826-48827835ee6b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:08.597816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1154113-dcb4-478d-8826-48827835ee6b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:08.601188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1154113-dcb4-478d-8826-48827835ee6b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:08.611823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1154113-dcb4-478d-8826-48827835ee6b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:08.612831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1154113-dcb4-478d-8826-48827835ee6b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:08.700147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c1154113-dcb4-478d-8826-48827835ee6b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:25:08.847375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e02490d9-9b7c-4572-8422-a291043ddbf6 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:08.865735 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e02490d9-9b7c-4572-8422-a291043ddbf6 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 200 len: 1321 microversion: 2.1 time: 0.669280 Oct 10 23:25:08.869136 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1116/2226] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:08 2022] GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 1321 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:08.888057 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c1154113-dcb4-478d-8826-48827835ee6b tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 204 len: 0 microversion: 2.1 time: 0.328328 Oct 10 23:25:08.893691 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1111/2227] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:25:08 2022] DELETE /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:25:08.899007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6dc3e761-bb09-46a5-b446-215d8950697a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:08.899792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6dc3e761-bb09-46a5-b446-215d8950697a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:08.914932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6dc3e761-bb09-46a5-b446-215d8950697a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:08.915995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6dc3e761-bb09-46a5-b446-215d8950697a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:08.916650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6dc3e761-bb09-46a5-b446-215d8950697a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:08.917751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6dc3e761-bb09-46a5-b446-215d8950697a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:08.918511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6dc3e761-bb09-46a5-b446-215d8950697a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:08.919176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6dc3e761-bb09-46a5-b446-215d8950697a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:09.201433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=10 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:25:09.206513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-032109c0-bc07-4dd8-98c1-66525bef167e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:09.237436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-032109c0-bc07-4dd8-98c1-66525bef167e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 5242250f-5274-4992-adb3-e8fdd3b65ed7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:09.237436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-032109c0-bc07-4dd8-98c1-66525bef167e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:09.237436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-032109c0-bc07-4dd8-98c1-66525bef167e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:09.237436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-032109c0-bc07-4dd8-98c1-66525bef167e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:09.237894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-032109c0-bc07-4dd8-98c1-66525bef167e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:09.237894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-032109c0-bc07-4dd8-98c1-66525bef167e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:09.237894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-032109c0-bc07-4dd8-98c1-66525bef167e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:09.436261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6dc3e761-bb09-46a5-b446-215d8950697a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:09.493169 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6dc3e761-bb09-46a5-b446-215d8950697a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1498 microversion: 2.1 time: 0.574958 Oct 10 23:25:09.494883 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1117/2228] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:08 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1498 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:09.525909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-658edb11-af08-40e4-a8ed-d2ff4c546941 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:09.528880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-658edb11-af08-40e4-a8ed-d2ff4c546941 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:09.558559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-658edb11-af08-40e4-a8ed-d2ff4c546941 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:09.560050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-658edb11-af08-40e4-a8ed-d2ff4c546941 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:09.560526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-658edb11-af08-40e4-a8ed-d2ff4c546941 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:09.561280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-658edb11-af08-40e4-a8ed-d2ff4c546941 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:09.567518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-658edb11-af08-40e4-a8ed-d2ff4c546941 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:09.567968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-658edb11-af08-40e4-a8ed-d2ff4c546941 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:09.878420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-032109c0-bc07-4dd8-98c1-66525bef167e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:09.893553 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-032109c0-bc07-4dd8-98c1-66525bef167e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7" status: 200 len: 1308 microversion: 2.1 time: 0.693769 Oct 10 23:25:09.903990 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1112/2229] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:09 2022] GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7 => generated 1308 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:09.918494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2cb48f51-27a5-4a73-a550-5f55ea74fb32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:09.919237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2cb48f51-27a5-4a73-a550-5f55ea74fb32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:09.935463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cb48f51-27a5-4a73-a550-5f55ea74fb32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:09.936369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cb48f51-27a5-4a73-a550-5f55ea74fb32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:09.937225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cb48f51-27a5-4a73-a550-5f55ea74fb32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:09.942140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cb48f51-27a5-4a73-a550-5f55ea74fb32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:09.943112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cb48f51-27a5-4a73-a550-5f55ea74fb32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:09.943969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cb48f51-27a5-4a73-a550-5f55ea74fb32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:10.158553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2cb48f51-27a5-4a73-a550-5f55ea74fb32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:10.226101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2cb48f51-27a5-4a73-a550-5f55ea74fb32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:10.238210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2cb48f51-27a5-4a73-a550-5f55ea74fb32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:10.251626 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2cb48f51-27a5-4a73-a550-5f55ea74fb32 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.345724 Oct 10 23:25:10.254187 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1113/2230] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:09 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:10.266903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cf772490-0610-4a4a-beb8-87face8ae591 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:10.270375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cf772490-0610-4a4a-beb8-87face8ae591 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:10.297699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf772490-0610-4a4a-beb8-87face8ae591 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:10.299312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf772490-0610-4a4a-beb8-87face8ae591 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:10.300497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf772490-0610-4a4a-beb8-87face8ae591 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:10.302392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf772490-0610-4a4a-beb8-87face8ae591 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:10.304702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf772490-0610-4a4a-beb8-87face8ae591 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:10.305824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf772490-0610-4a4a-beb8-87face8ae591 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:10.486666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-658edb11-af08-40e4-a8ed-d2ff4c546941 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:10.496847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-658edb11-af08-40e4-a8ed-d2ff4c546941 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:10.498337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-658edb11-af08-40e4-a8ed-d2ff4c546941 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:10.500084 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-658edb11-af08-40e4-a8ed-d2ff4c546941 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 1.002882 Oct 10 23:25:10.516670 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1118/2231] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:09 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:10.521798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-35d34367-867d-4e90-aeb7-bdc3b357807a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:10.522649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-35d34367-867d-4e90-aeb7-bdc3b357807a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:10.538202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35d34367-867d-4e90-aeb7-bdc3b357807a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:10.541699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35d34367-867d-4e90-aeb7-bdc3b357807a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:10.542319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35d34367-867d-4e90-aeb7-bdc3b357807a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:10.544038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35d34367-867d-4e90-aeb7-bdc3b357807a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:10.549975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35d34367-867d-4e90-aeb7-bdc3b357807a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:10.550981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35d34367-867d-4e90-aeb7-bdc3b357807a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:10.676614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cf772490-0610-4a4a-beb8-87face8ae591 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:10.691510 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cf772490-0610-4a4a-beb8-87face8ae591 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 200 len: 1321 microversion: 2.1 time: 0.434662 Oct 10 23:25:10.711444 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1114/2232] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:10 2022] GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 1321 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:10.922893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5cd9c259-574e-459c-8013-0e61a23555b0 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:10.926058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5cd9c259-574e-459c-8013-0e61a23555b0 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 5242250f-5274-4992-adb3-e8fdd3b65ed7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:10.947499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cd9c259-574e-459c-8013-0e61a23555b0 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:10.948107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cd9c259-574e-459c-8013-0e61a23555b0 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:10.948757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cd9c259-574e-459c-8013-0e61a23555b0 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:10.949753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cd9c259-574e-459c-8013-0e61a23555b0 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:10.950419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cd9c259-574e-459c-8013-0e61a23555b0 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:10.951178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cd9c259-574e-459c-8013-0e61a23555b0 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:11.192964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-35d34367-867d-4e90-aeb7-bdc3b357807a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:11.230443 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-35d34367-867d-4e90-aeb7-bdc3b357807a tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1498 microversion: 2.1 time: 0.711653 Oct 10 23:25:11.232557 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1119/2233] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:10 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1498 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:11.333178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5cd9c259-574e-459c-8013-0e61a23555b0 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:11.347882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fdd186fb-d39f-46c3-a0f4-550481cb3b8b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:11.348846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fdd186fb-d39f-46c3-a0f4-550481cb3b8b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:11.361270 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5cd9c259-574e-459c-8013-0e61a23555b0 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7" status: 200 len: 1308 microversion: 2.1 time: 0.436361 Oct 10 23:25:11.364643 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1115/2234] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:10 2022] GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7 => generated 1308 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:25:11.364839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdd186fb-d39f-46c3-a0f4-550481cb3b8b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:11.365966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdd186fb-d39f-46c3-a0f4-550481cb3b8b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:11.366738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdd186fb-d39f-46c3-a0f4-550481cb3b8b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:11.368475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdd186fb-d39f-46c3-a0f4-550481cb3b8b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:11.369104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdd186fb-d39f-46c3-a0f4-550481cb3b8b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:11.369731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdd186fb-d39f-46c3-a0f4-550481cb3b8b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:11.377648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-a5a14107-4e01-4468-ad30-fd79303ebe8a req-b4bd4013-5831-4903-b022-cfbdaa90641f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c6f9198-4d2e-4064-9648-8136d5b0f14d", "tag": "61fd4e90-e896-45d8-8b8f-094125dac88f"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:11.402503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:25:11.416307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a5a14107-4e01-4468-ad30-fd79303ebe8a req-b4bd4013-5831-4903-b022-cfbdaa90641f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:11.420721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a5a14107-4e01-4468-ad30-fd79303ebe8a req-b4bd4013-5831-4903-b022-cfbdaa90641f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:11.427054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a5a14107-4e01-4468-ad30-fd79303ebe8a req-b4bd4013-5831-4903-b022-cfbdaa90641f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:11.474620 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a5a14107-4e01-4468-ad30-fd79303ebe8a req-b4bd4013-5831-4903-b022-cfbdaa90641f service nova] Creating event network-changed:61fd4e90-e896-45d8-8b8f-094125dac88f for instance 6c6f9198-4d2e-4064-9648-8136d5b0f14d on n-h2-860864-2 Oct 10 23:25:11.487190 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-a5a14107-4e01-4468-ad30-fd79303ebe8a req-b4bd4013-5831-4903-b022-cfbdaa90641f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118219 Oct 10 23:25:11.488442 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1116/2235] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:25:11.552999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6646fa4a-885c-42d4-bf77-1f9c106526db tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:11.554447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6646fa4a-885c-42d4-bf77-1f9c106526db tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:11.564935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6646fa4a-885c-42d4-bf77-1f9c106526db tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:11.566105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6646fa4a-885c-42d4-bf77-1f9c106526db tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:11.567344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6646fa4a-885c-42d4-bf77-1f9c106526db tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:11.568803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6646fa4a-885c-42d4-bf77-1f9c106526db tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:11.570114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6646fa4a-885c-42d4-bf77-1f9c106526db tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:11.571077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6646fa4a-885c-42d4-bf77-1f9c106526db tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:11.583524 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fdd186fb-d39f-46c3-a0f4-550481cb3b8b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:11.588088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:25:11.606641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fdd186fb-d39f-46c3-a0f4-550481cb3b8b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:11.613764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fdd186fb-d39f-46c3-a0f4-550481cb3b8b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:11.630637 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fdd186fb-d39f-46c3-a0f4-550481cb3b8b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.308408 Oct 10 23:25:11.631451 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1120/2236] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:11 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:11.718760 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a1cd4a7e-4b11-4d51-bdb9-e9b9d0bed08d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:11.719686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a1cd4a7e-4b11-4d51-bdb9-e9b9d0bed08d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:11.728711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1cd4a7e-4b11-4d51-bdb9-e9b9d0bed08d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:11.729941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1cd4a7e-4b11-4d51-bdb9-e9b9d0bed08d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:11.730784 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1cd4a7e-4b11-4d51-bdb9-e9b9d0bed08d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:11.731782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1cd4a7e-4b11-4d51-bdb9-e9b9d0bed08d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:11.732521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1cd4a7e-4b11-4d51-bdb9-e9b9d0bed08d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:11.733545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1cd4a7e-4b11-4d51-bdb9-e9b9d0bed08d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:12.163927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a1cd4a7e-4b11-4d51-bdb9-e9b9d0bed08d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:12.198348 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a1cd4a7e-4b11-4d51-bdb9-e9b9d0bed08d tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 200 len: 1321 microversion: 2.1 time: 0.484162 Oct 10 23:25:12.198978 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1121/2237] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:11 2022] GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 1321 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:12.257566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-25d6a9f7-bb02-401d-b16d-d949f59896c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:12.258197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-25d6a9f7-bb02-401d-b16d-d949f59896c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:12.267280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25d6a9f7-bb02-401d-b16d-d949f59896c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:12.268062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25d6a9f7-bb02-401d-b16d-d949f59896c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:12.268617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25d6a9f7-bb02-401d-b16d-d949f59896c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:12.269619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25d6a9f7-bb02-401d-b16d-d949f59896c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:12.270493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25d6a9f7-bb02-401d-b16d-d949f59896c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:12.271277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25d6a9f7-bb02-401d-b16d-d949f59896c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:12.412680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25d6a9f7-bb02-401d-b16d-d949f59896c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:12.413944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25d6a9f7-bb02-401d-b16d-d949f59896c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:12.415048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25d6a9f7-bb02-401d-b16d-d949f59896c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:12.416918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-25d6a9f7-bb02-401d-b16d-d949f59896c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lazy-loading 'fault' on Instance uuid 7a793bab-7cf8-422b-8158-6c1cd268eaac {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:25:12.490995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6646fa4a-885c-42d4-bf77-1f9c106526db tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:12.504101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6646fa4a-885c-42d4-bf77-1f9c106526db tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:12.506187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6646fa4a-885c-42d4-bf77-1f9c106526db tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:12.508171 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6646fa4a-885c-42d4-bf77-1f9c106526db tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 0.963901 Oct 10 23:25:12.509451 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1117/2238] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:11 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:12.516521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9df6188a-cc39-4a29-b080-90e4a5488416 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:12.517399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9df6188a-cc39-4a29-b080-90e4a5488416 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 5242250f-5274-4992-adb3-e8fdd3b65ed7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:12.526168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9df6188a-cc39-4a29-b080-90e4a5488416 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:12.526926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9df6188a-cc39-4a29-b080-90e4a5488416 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:12.527368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9df6188a-cc39-4a29-b080-90e4a5488416 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:12.528192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9df6188a-cc39-4a29-b080-90e4a5488416 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:12.528644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9df6188a-cc39-4a29-b080-90e4a5488416 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:12.529069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9df6188a-cc39-4a29-b080-90e4a5488416 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:12.730808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-25d6a9f7-bb02-401d-b16d-d949f59896c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bd83ab05cb34853bbab0f86a630aa1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5a9d1de27b407e91ff0ae66242ec81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:12.743006 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-25d6a9f7-bb02-401d-b16d-d949f59896c3 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 200 len: 1300 microversion: 2.1 time: 0.490707 Oct 10 23:25:12.764608 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1122/2239] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:12 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 1300 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:12.772747 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-504ded4a-438a-41a6-ae16-1511eac94a3f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:12.777367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-504ded4a-438a-41a6-ae16-1511eac94a3f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:12.792694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-504ded4a-438a-41a6-ae16-1511eac94a3f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:12.795390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-504ded4a-438a-41a6-ae16-1511eac94a3f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:12.795841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-504ded4a-438a-41a6-ae16-1511eac94a3f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:12.796692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-504ded4a-438a-41a6-ae16-1511eac94a3f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:12.801448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-504ded4a-438a-41a6-ae16-1511eac94a3f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:12.801971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-504ded4a-438a-41a6-ae16-1511eac94a3f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:12.963714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-504ded4a-438a-41a6-ae16-1511eac94a3f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:12.995475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-504ded4a-438a-41a6-ae16-1511eac94a3f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:13.000971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-504ded4a-438a-41a6-ae16-1511eac94a3f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:13.008543 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-504ded4a-438a-41a6-ae16-1511eac94a3f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1535 microversion: 2.91 time: 0.242112 Oct 10 23:25:13.009203 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1123/2240] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:12 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1535 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:13.053941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9df6188a-cc39-4a29-b080-90e4a5488416 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:13.065902 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9df6188a-cc39-4a29-b080-90e4a5488416 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7" status: 200 len: 1308 microversion: 2.1 time: 0.554926 Oct 10 23:25:13.067146 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1118/2241] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:12 2022] GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7 => generated 1308 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:13.223599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1e76f5e5-2a76-468c-935a-a72393e99752 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:13.225733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1e76f5e5-2a76-468c-935a-a72393e99752 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:13.240339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e76f5e5-2a76-468c-935a-a72393e99752 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:13.244082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e76f5e5-2a76-468c-935a-a72393e99752 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:13.246164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e76f5e5-2a76-468c-935a-a72393e99752 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:13.249450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e76f5e5-2a76-468c-935a-a72393e99752 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:13.251303 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e76f5e5-2a76-468c-935a-a72393e99752 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:13.251878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e76f5e5-2a76-468c-935a-a72393e99752 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:13.492343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1e76f5e5-2a76-468c-935a-a72393e99752 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:13.504359 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1e76f5e5-2a76-468c-935a-a72393e99752 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 200 len: 1321 microversion: 2.1 time: 0.284480 Oct 10 23:25:13.518472 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1124/2242] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:13 2022] GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:13.542361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-de4ff0a5-902d-4a95-af02-df67c750354d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:13.544807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-de4ff0a5-902d-4a95-af02-df67c750354d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:13.552841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de4ff0a5-902d-4a95-af02-df67c750354d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:13.553348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de4ff0a5-902d-4a95-af02-df67c750354d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:13.554008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de4ff0a5-902d-4a95-af02-df67c750354d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:13.554895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de4ff0a5-902d-4a95-af02-df67c750354d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:13.555498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de4ff0a5-902d-4a95-af02-df67c750354d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:13.556112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de4ff0a5-902d-4a95-af02-df67c750354d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:13.579346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-11d82b50-f277-4410-ae96-54787237005f req-a8dae8e3-6df9-4512-ac78-9e9d10aa51be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a793bab-7cf8-422b-8158-6c1cd268eaac", "name": "network-vif-deleted", "tag": "69ca134e-b82a-4bc3-b55d-ed4eed16ae51"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:13.612975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-11d82b50-f277-4410-ae96-54787237005f req-a8dae8e3-6df9-4512-ac78-9e9d10aa51be service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:13.613863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-11d82b50-f277-4410-ae96-54787237005f req-a8dae8e3-6df9-4512-ac78-9e9d10aa51be service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:13.614481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-11d82b50-f277-4410-ae96-54787237005f req-a8dae8e3-6df9-4512-ac78-9e9d10aa51be service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:13.637479 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-11d82b50-f277-4410-ae96-54787237005f req-a8dae8e3-6df9-4512-ac78-9e9d10aa51be service nova] Creating event network-vif-deleted:69ca134e-b82a-4bc3-b55d-ed4eed16ae51 for instance 7a793bab-7cf8-422b-8158-6c1cd268eaac on n-h1-860864-2 Oct 10 23:25:13.650161 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-11d82b50-f277-4410-ae96-54787237005f req-a8dae8e3-6df9-4512-ac78-9e9d10aa51be service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079001 Oct 10 23:25:13.652740 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1125/2243] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:25:13.790952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0a27b6cc-793f-4f88-a042-3f4e28a981a9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:13.792503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0a27b6cc-793f-4f88-a042-3f4e28a981a9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] [instance: 7a793bab-7cf8-422b-8158-6c1cd268eaac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:13.805948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a27b6cc-793f-4f88-a042-3f4e28a981a9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:13.806824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a27b6cc-793f-4f88-a042-3f4e28a981a9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:13.807460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a27b6cc-793f-4f88-a042-3f4e28a981a9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:13.808766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a27b6cc-793f-4f88-a042-3f4e28a981a9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:13.809632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a27b6cc-793f-4f88-a042-3f4e28a981a9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:13.810608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a27b6cc-793f-4f88-a042-3f4e28a981a9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:13.836018 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-0a27b6cc-793f-4f88-a042-3f4e28a981a9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] HTTP exception thrown: Instance 7a793bab-7cf8-422b-8158-6c1cd268eaac could not be found. Oct 10 23:25:13.839227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0a27b6cc-793f-4f88-a042-3f4e28a981a9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Request method failure captured: Oct 10 23:25:13.839227 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac HTTP/1.1 Oct 10 23:25:13.839227 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:25:13.839227 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:25:13.839227 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:25:13.839227 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:25:13.839227 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:25:13.839227 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:25:13.839227 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:25:13.839227 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:25:13.839227 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKgRPLcuZOQHwLU9RnicPEH510hzllvVdPlPCGOmNQBoxDHi79ZXGpYqFEY19dF7VzBhNqLTlXC_vyC8MW9a2tEUHUYnDXlBf-DOE9ZImuHN1BHcoafH9TPbkB373S2vzrdGE3t7fAFAdG2i4H3Rh-M7BKAz8ehKA0Q1u4tVUaE3hyQ Oct 10 23:25:13.839227 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:25:13.839227 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:25:13.839227 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:25:13.839227 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:25:13.839227 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:25:13.839227 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:25:13.839227 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 1b5a9d1de27b407e91ff0ae66242ec81 Oct 10 23:25:13.839227 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-LiveMigrationTest-1684235659 Oct 10 23:25:13.839227 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:25:13.839227 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:25:13.840723 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1b5a9d1de27b407e91ff0ae66242ec81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1b5a9d1de27b407e91ff0ae66242ec81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1b5a9d1de27b407e91ff0ae66242ec81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1b5a9d1de27b407e91ff0ae66242ec81", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:25:13.840723 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-LiveMigrationTest-1684235659 Oct 10 23:25:13.840723 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 1b5a9d1de27b407e91ff0ae66242ec81 Oct 10 23:25:13.840723 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-LiveMigrationTest-1684235659 Oct 10 23:25:13.840723 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-LiveMigrationTest-1684235659-project Oct 10 23:25:13.840723 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:25:13.840723 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:25:13.840723 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 9bd83ab05cb34853bbab0f86a630aa1e Oct 10 23:25:13.840723 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-LiveMigrationTest-1684235659-project Oct 10 23:25:13.840723 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:25:13.840723 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 7a793bab-7cf8-422b-8158-6c1cd268eaac could not be found. Oct 10 23:25:13.840723 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '7a793bab-7cf8-422b-8158-6c1cd268eaac'} Oct 10 23:25:13.841605 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:25:13.841605 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:13.841605 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:25:13.841605 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:25:13.841605 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:25:13.841605 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:25:13.841605 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:25:13.841605 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:25:13.841605 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:25:13.841605 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:25:13.841605 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a793bab-7cf8-422b-8158-6c1cd268eaac could not be found. Oct 10 23:25:13.841605 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:13.841605 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:13.841605 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:13.841605 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:13.841605 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:13.841605 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:13.841605 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:25:13.841605 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:25:13.841605 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:25:13.844536 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:25:13.844536 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:25:13.844536 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:25:13.844536 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:25:13.844536 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:25:13.844536 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:25:13.844536 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:25:13.844536 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a793bab-7cf8-422b-8158-6c1cd268eaac could not be found. Oct 10 23:25:13.844536 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:13.844536 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:13.844536 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:13.844536 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:13.844536 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:13.844536 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:13.844536 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:25:13.844536 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:25:13.844536 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a793bab-7cf8-422b-8158-6c1cd268eaac could not be found. Oct 10 23:25:13.844536 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:13.846475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0a27b6cc-793f-4f88-a042-3f4e28a981a9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] Returning 404 to user: Instance 7a793bab-7cf8-422b-8158-6c1cd268eaac could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:25:13.847737 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0a27b6cc-793f-4f88-a042-3f4e28a981a9 tempest-LiveMigrationTest-1684235659 tempest-LiveMigrationTest-1684235659-project] 10.222.0.23 "GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac" status: 404 len: 111 microversion: 2.1 time: 0.075344 Oct 10 23:25:13.848472 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1126/2244] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:13 2022] GET /compute/v2.1/servers/7a793bab-7cf8-422b-8158-6c1cd268eaac => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:25:13.905227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-de4ff0a5-902d-4a95-af02-df67c750354d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:13.919369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-de4ff0a5-902d-4a95-af02-df67c750354d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:13.926923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-de4ff0a5-902d-4a95-af02-df67c750354d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:13.928330 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-de4ff0a5-902d-4a95-af02-df67c750354d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 0.397995 Oct 10 23:25:13.929083 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1119/2245] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:13 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:14.045580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8d84cc06-fc54-438e-b8b0-337b6d524b7b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:14.047020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8d84cc06-fc54-438e-b8b0-337b6d524b7b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:14.067081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d84cc06-fc54-438e-b8b0-337b6d524b7b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:14.074373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d84cc06-fc54-438e-b8b0-337b6d524b7b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:14.076219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d84cc06-fc54-438e-b8b0-337b6d524b7b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:14.077980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d84cc06-fc54-438e-b8b0-337b6d524b7b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:14.078892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d84cc06-fc54-438e-b8b0-337b6d524b7b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:14.079501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d84cc06-fc54-438e-b8b0-337b6d524b7b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:14.106852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6f3d1512-78ce-4d9f-90df-2db88e1072bc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:14.107748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6f3d1512-78ce-4d9f-90df-2db88e1072bc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 5242250f-5274-4992-adb3-e8fdd3b65ed7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:14.127946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f3d1512-78ce-4d9f-90df-2db88e1072bc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:14.128719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f3d1512-78ce-4d9f-90df-2db88e1072bc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:14.131002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f3d1512-78ce-4d9f-90df-2db88e1072bc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:14.134936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f3d1512-78ce-4d9f-90df-2db88e1072bc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:14.135689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f3d1512-78ce-4d9f-90df-2db88e1072bc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:14.136507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f3d1512-78ce-4d9f-90df-2db88e1072bc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:14.200059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8d84cc06-fc54-438e-b8b0-337b6d524b7b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:14.212441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8d84cc06-fc54-438e-b8b0-337b6d524b7b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:14.214303 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8d84cc06-fc54-438e-b8b0-337b6d524b7b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:14.232074 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8d84cc06-fc54-438e-b8b0-337b6d524b7b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1535 microversion: 2.91 time: 0.195073 Oct 10 23:25:14.241404 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1127/2246] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:14 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1535 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:14.432187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-38828129-8548-458e-92c0-43dad4eb2022 req-8cac4460-6c4b-490a-80f3-88447724c438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5242250f-5274-4992-adb3-e8fdd3b65ed7", "name": "network-vif-plugged", "status": "completed", "tag": "90f86f41-ee10-436d-af23-bca655e7f68b"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:14.458765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-38828129-8548-458e-92c0-43dad4eb2022 req-8cac4460-6c4b-490a-80f3-88447724c438 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:14.459254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-38828129-8548-458e-92c0-43dad4eb2022 req-8cac4460-6c4b-490a-80f3-88447724c438 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:14.465516 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-38828129-8548-458e-92c0-43dad4eb2022 req-8cac4460-6c4b-490a-80f3-88447724c438 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:14.506115 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-38828129-8548-458e-92c0-43dad4eb2022 req-8cac4460-6c4b-490a-80f3-88447724c438 service nova] Creating event network-vif-plugged:90f86f41-ee10-436d-af23-bca655e7f68b for instance 5242250f-5274-4992-adb3-e8fdd3b65ed7 on n-h2-860864-2 Oct 10 23:25:14.519419 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-38828129-8548-458e-92c0-43dad4eb2022 req-8cac4460-6c4b-490a-80f3-88447724c438 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093804 Oct 10 23:25:14.520074 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1128/2247] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:25:14.530819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2f968d04-2643-4174-a70c-506f1f1aa44e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:14.536164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2f968d04-2643-4174-a70c-506f1f1aa44e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:14.552531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f968d04-2643-4174-a70c-506f1f1aa44e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:14.553254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f968d04-2643-4174-a70c-506f1f1aa44e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:14.553871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f968d04-2643-4174-a70c-506f1f1aa44e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:14.554754 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f968d04-2643-4174-a70c-506f1f1aa44e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:14.555348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f968d04-2643-4174-a70c-506f1f1aa44e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:14.558278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f968d04-2643-4174-a70c-506f1f1aa44e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:14.954129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2f968d04-2643-4174-a70c-506f1f1aa44e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:14.964381 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2f968d04-2643-4174-a70c-506f1f1aa44e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 200 len: 1321 microversion: 2.1 time: 0.438210 Oct 10 23:25:14.982383 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1129/2248] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:14 2022] GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 1321 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:15.014918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7798ceb8-f9fa-4815-98a5-8a98ec458e09 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:15.016498 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7798ceb8-f9fa-4815-98a5-8a98ec458e09 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:15.050216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:25:15.071789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7798ceb8-f9fa-4815-98a5-8a98ec458e09 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:15.083919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7798ceb8-f9fa-4815-98a5-8a98ec458e09 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:15.084889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7798ceb8-f9fa-4815-98a5-8a98ec458e09 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:15.096018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6f3d1512-78ce-4d9f-90df-2db88e1072bc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:15.104682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7798ceb8-f9fa-4815-98a5-8a98ec458e09 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:15.110803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7798ceb8-f9fa-4815-98a5-8a98ec458e09 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:15.113445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7798ceb8-f9fa-4815-98a5-8a98ec458e09 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:15.132014 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6f3d1512-78ce-4d9f-90df-2db88e1072bc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7" status: 200 len: 1308 microversion: 2.1 time: 1.030727 Oct 10 23:25:15.133852 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1120/2249] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:14 2022] GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7 => generated 1308 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:15.278281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5fff44ea-0f1b-4656-888d-ccecd067ad8d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:15.280266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5fff44ea-0f1b-4656-888d-ccecd067ad8d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:15.305916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fff44ea-0f1b-4656-888d-ccecd067ad8d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:15.306661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fff44ea-0f1b-4656-888d-ccecd067ad8d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:15.307294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fff44ea-0f1b-4656-888d-ccecd067ad8d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:15.308237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fff44ea-0f1b-4656-888d-ccecd067ad8d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:15.308886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fff44ea-0f1b-4656-888d-ccecd067ad8d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:15.317995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fff44ea-0f1b-4656-888d-ccecd067ad8d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:15.324397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:25:15.477039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7798ceb8-f9fa-4815-98a5-8a98ec458e09 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:15.483046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5fff44ea-0f1b-4656-888d-ccecd067ad8d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:15.498437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5fff44ea-0f1b-4656-888d-ccecd067ad8d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:15.507091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7798ceb8-f9fa-4815-98a5-8a98ec458e09 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:15.508586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7798ceb8-f9fa-4815-98a5-8a98ec458e09 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:15.511061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5fff44ea-0f1b-4656-888d-ccecd067ad8d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:15.513301 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7798ceb8-f9fa-4815-98a5-8a98ec458e09 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 0.526292 Oct 10 23:25:15.516638 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1130/2250] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:14 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:15.520739 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5fff44ea-0f1b-4656-888d-ccecd067ad8d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1538 microversion: 2.91 time: 0.248664 Oct 10 23:25:15.521819 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1121/2251] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:15 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1538 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:25:15.556717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-85e2c8a6-8b20-4912-90dd-d593fa200a7c tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-860864-2"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:15.560166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-85e2c8a6-8b20-4912-90dd-d593fa200a7c tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:15.566802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85e2c8a6-8b20-4912-90dd-d593fa200a7c tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:15.567529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85e2c8a6-8b20-4912-90dd-d593fa200a7c tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:15.568183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85e2c8a6-8b20-4912-90dd-d593fa200a7c tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:15.569053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85e2c8a6-8b20-4912-90dd-d593fa200a7c tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:15.569680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85e2c8a6-8b20-4912-90dd-d593fa200a7c tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:15.570377 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85e2c8a6-8b20-4912-90dd-d593fa200a7c tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:15.630936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-85e2c8a6-8b20-4912-90dd-d593fa200a7c tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-860864-2". {{(pid=120614) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 10 23:25:15.769795 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-85e2c8a6-8b20-4912-90dd-d593fa200a7c tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba/action" status: 202 len: 0 microversion: 2.91 time: 0.214687 Oct 10 23:25:15.772544 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1131/2252] 10.222.0.23 () {62 vars in 1319 bytes} [Mon Oct 10 23:25:15 2022] POST /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:25:15.781036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0d94d122-3a7a-4205-b317-eb0d4629120e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:15.781689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0d94d122-3a7a-4205-b317-eb0d4629120e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:15.792896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d94d122-3a7a-4205-b317-eb0d4629120e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:15.794349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d94d122-3a7a-4205-b317-eb0d4629120e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:15.796075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d94d122-3a7a-4205-b317-eb0d4629120e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:15.797962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d94d122-3a7a-4205-b317-eb0d4629120e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:15.799014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d94d122-3a7a-4205-b317-eb0d4629120e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:15.800767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d94d122-3a7a-4205-b317-eb0d4629120e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:15.987831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0d94d122-3a7a-4205-b317-eb0d4629120e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:16.002565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0d94d122-3a7a-4205-b317-eb0d4629120e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:16.004144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0d94d122-3a7a-4205-b317-eb0d4629120e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:16.007940 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-468c5436-b092-456e-91cc-65f9edd6be64 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:16.009060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-468c5436-b092-456e-91cc-65f9edd6be64 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:16.017849 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0d94d122-3a7a-4205-b317-eb0d4629120e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1486 microversion: 2.91 time: 0.240886 Oct 10 23:25:16.018348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-468c5436-b092-456e-91cc-65f9edd6be64 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:16.018807 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1122/2253] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:15 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1486 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:16.020196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-468c5436-b092-456e-91cc-65f9edd6be64 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:16.020859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-468c5436-b092-456e-91cc-65f9edd6be64 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:16.021766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-468c5436-b092-456e-91cc-65f9edd6be64 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:16.022374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-468c5436-b092-456e-91cc-65f9edd6be64 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:16.023113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-468c5436-b092-456e-91cc-65f9edd6be64 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:16.163600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1b8fa992-11cc-4ca1-94f0-2666c798829c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:16.164224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1b8fa992-11cc-4ca1-94f0-2666c798829c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 5242250f-5274-4992-adb3-e8fdd3b65ed7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:16.176436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b8fa992-11cc-4ca1-94f0-2666c798829c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:16.176945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b8fa992-11cc-4ca1-94f0-2666c798829c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:16.177409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b8fa992-11cc-4ca1-94f0-2666c798829c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:16.182577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b8fa992-11cc-4ca1-94f0-2666c798829c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:16.183067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b8fa992-11cc-4ca1-94f0-2666c798829c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:16.183511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b8fa992-11cc-4ca1-94f0-2666c798829c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:16.472762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-468c5436-b092-456e-91cc-65f9edd6be64 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:16.497357 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-468c5436-b092-456e-91cc-65f9edd6be64 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 200 len: 1321 microversion: 2.1 time: 0.493393 Oct 10 23:25:16.502623 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1132/2254] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:16 2022] GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 1321 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:16.546789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5dba3538-3994-4e6d-aad4-c49e10bf402a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:16.547869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5dba3538-3994-4e6d-aad4-c49e10bf402a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:16.589080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5dba3538-3994-4e6d-aad4-c49e10bf402a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:16.590170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5dba3538-3994-4e6d-aad4-c49e10bf402a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:16.590827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5dba3538-3994-4e6d-aad4-c49e10bf402a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:16.600411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5dba3538-3994-4e6d-aad4-c49e10bf402a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:16.601529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5dba3538-3994-4e6d-aad4-c49e10bf402a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:16.602151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5dba3538-3994-4e6d-aad4-c49e10bf402a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:17.083661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1b8fa992-11cc-4ca1-94f0-2666c798829c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:17.098277 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1b8fa992-11cc-4ca1-94f0-2666c798829c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7" status: 200 len: 1308 microversion: 2.1 time: 0.938469 Oct 10 23:25:17.101580 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1123/2255] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:16 2022] GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7 => generated 1308 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:25:17.118302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0b01580e-f357-4e25-9220-5a950830f50a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:17.122928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0b01580e-f357-4e25-9220-5a950830f50a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:17.146022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b01580e-f357-4e25-9220-5a950830f50a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:17.149956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b01580e-f357-4e25-9220-5a950830f50a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:17.150599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b01580e-f357-4e25-9220-5a950830f50a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:17.154377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b01580e-f357-4e25-9220-5a950830f50a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:17.156829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b01580e-f357-4e25-9220-5a950830f50a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:17.159333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b01580e-f357-4e25-9220-5a950830f50a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:17.400305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5dba3538-3994-4e6d-aad4-c49e10bf402a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:17.411185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5dba3538-3994-4e6d-aad4-c49e10bf402a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:17.413893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5dba3538-3994-4e6d-aad4-c49e10bf402a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:17.415710 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5dba3538-3994-4e6d-aad4-c49e10bf402a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1486 microversion: 2.25 time: 0.873525 Oct 10 23:25:17.416633 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1133/2256] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:16 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1486 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:17.433355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0b01580e-f357-4e25-9220-5a950830f50a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:17.450747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0b01580e-f357-4e25-9220-5a950830f50a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:17.453176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0b01580e-f357-4e25-9220-5a950830f50a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:17.461200 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0b01580e-f357-4e25-9220-5a950830f50a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1488 microversion: 2.91 time: 0.358172 Oct 10 23:25:17.473234 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1124/2257] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:17 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1488 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:17.532438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a9db1d99-38fb-41aa-b5c3-7bd48f35bc6e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:17.533060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a9db1d99-38fb-41aa-b5c3-7bd48f35bc6e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:17.545693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9db1d99-38fb-41aa-b5c3-7bd48f35bc6e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:17.547028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9db1d99-38fb-41aa-b5c3-7bd48f35bc6e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:17.548244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9db1d99-38fb-41aa-b5c3-7bd48f35bc6e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:17.549157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9db1d99-38fb-41aa-b5c3-7bd48f35bc6e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:17.550308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9db1d99-38fb-41aa-b5c3-7bd48f35bc6e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:17.550913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9db1d99-38fb-41aa-b5c3-7bd48f35bc6e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:18.131987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ace902a0-7f0a-4852-a208-bbd6377e9bc4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:18.134026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ace902a0-7f0a-4852-a208-bbd6377e9bc4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 5242250f-5274-4992-adb3-e8fdd3b65ed7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:18.135631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a9db1d99-38fb-41aa-b5c3-7bd48f35bc6e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:18.149701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ace902a0-7f0a-4852-a208-bbd6377e9bc4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:18.150705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ace902a0-7f0a-4852-a208-bbd6377e9bc4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:18.151368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ace902a0-7f0a-4852-a208-bbd6377e9bc4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:18.153927 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a9db1d99-38fb-41aa-b5c3-7bd48f35bc6e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 200 len: 1321 microversion: 2.1 time: 0.623499 Oct 10 23:25:18.154506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ace902a0-7f0a-4852-a208-bbd6377e9bc4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:18.156970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ace902a0-7f0a-4852-a208-bbd6377e9bc4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:18.157970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ace902a0-7f0a-4852-a208-bbd6377e9bc4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:18.178346 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1134/2258] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:17 2022] GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 1321 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:18.450892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0c5db56d-eb23-41ce-a966-facc756a7cdd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:18.453718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0c5db56d-eb23-41ce-a966-facc756a7cdd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:18.462962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c5db56d-eb23-41ce-a966-facc756a7cdd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:18.463931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c5db56d-eb23-41ce-a966-facc756a7cdd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:18.464630 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c5db56d-eb23-41ce-a966-facc756a7cdd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:18.465616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c5db56d-eb23-41ce-a966-facc756a7cdd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:18.466321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c5db56d-eb23-41ce-a966-facc756a7cdd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:18.466984 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c5db56d-eb23-41ce-a966-facc756a7cdd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:18.651812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ace902a0-7f0a-4852-a208-bbd6377e9bc4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:18.662485 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ace902a0-7f0a-4852-a208-bbd6377e9bc4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7" status: 200 len: 1488 microversion: 2.1 time: 0.537458 Oct 10 23:25:18.663727 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1125/2259] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:18 2022] GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7 => generated 1488 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:18.669629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-449f0706-01d8-4154-a937-2395160a97a0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:18.670833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-449f0706-01d8-4154-a937-2395160a97a0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:18.678775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-449f0706-01d8-4154-a937-2395160a97a0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:18.679553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-449f0706-01d8-4154-a937-2395160a97a0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:18.680220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-449f0706-01d8-4154-a937-2395160a97a0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:18.681276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-449f0706-01d8-4154-a937-2395160a97a0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:18.682017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-449f0706-01d8-4154-a937-2395160a97a0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:18.682666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-449f0706-01d8-4154-a937-2395160a97a0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:18.875536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-449f0706-01d8-4154-a937-2395160a97a0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:18.886101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-449f0706-01d8-4154-a937-2395160a97a0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:18.888198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-449f0706-01d8-4154-a937-2395160a97a0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:18.903817 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-449f0706-01d8-4154-a937-2395160a97a0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.238787 Oct 10 23:25:18.904420 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1126/2260] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:18 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:18.923622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-44a3ecce-df7f-4262-869b-b437f7012d55 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:18.934019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-44a3ecce-df7f-4262-869b-b437f7012d55 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 5242250f-5274-4992-adb3-e8fdd3b65ed7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:18.945972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44a3ecce-df7f-4262-869b-b437f7012d55 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:18.946473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44a3ecce-df7f-4262-869b-b437f7012d55 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:18.946914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44a3ecce-df7f-4262-869b-b437f7012d55 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:18.951894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44a3ecce-df7f-4262-869b-b437f7012d55 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:18.953906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44a3ecce-df7f-4262-869b-b437f7012d55 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:18.954469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44a3ecce-df7f-4262-869b-b437f7012d55 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:19.014859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-44a3ecce-df7f-4262-869b-b437f7012d55 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lazy-loading 'flavor' on Instance uuid 5242250f-5274-4992-adb3-e8fdd3b65ed7 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:25:19.163331 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-44a3ecce-df7f-4262-869b-b437f7012d55 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "POST /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7/action" status: 202 len: 0 microversion: 2.1 time: 0.254338 Oct 10 23:25:19.164505 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1127/2261] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:25:18 2022] POST /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:25:19.177679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-df841ff3-5f39-459d-9082-20df603160c1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:19.180328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-df841ff3-5f39-459d-9082-20df603160c1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 5242250f-5274-4992-adb3-e8fdd3b65ed7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:19.201164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df841ff3-5f39-459d-9082-20df603160c1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:19.207879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df841ff3-5f39-459d-9082-20df603160c1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:19.210011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df841ff3-5f39-459d-9082-20df603160c1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:19.215880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df841ff3-5f39-459d-9082-20df603160c1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:19.222670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df841ff3-5f39-459d-9082-20df603160c1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:19.227714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df841ff3-5f39-459d-9082-20df603160c1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:19.507543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0c5db56d-eb23-41ce-a966-facc756a7cdd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:19.535053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0c5db56d-eb23-41ce-a966-facc756a7cdd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:19.543925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0c5db56d-eb23-41ce-a966-facc756a7cdd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:19.545422 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0c5db56d-eb23-41ce-a966-facc756a7cdd tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1476 microversion: 2.25 time: 1.098719 Oct 10 23:25:19.546299 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1135/2262] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:18 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1476 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:25:19.559651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-31f68722-8729-45ef-a44e-a91d4592ef0b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:19.560533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-31f68722-8729-45ef-a44e-a91d4592ef0b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:19.592610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31f68722-8729-45ef-a44e-a91d4592ef0b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:19.595143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31f68722-8729-45ef-a44e-a91d4592ef0b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:19.598716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31f68722-8729-45ef-a44e-a91d4592ef0b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:19.605409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31f68722-8729-45ef-a44e-a91d4592ef0b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:19.606473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31f68722-8729-45ef-a44e-a91d4592ef0b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:19.607101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31f68722-8729-45ef-a44e-a91d4592ef0b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:19.673135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-df841ff3-5f39-459d-9082-20df603160c1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:19.685087 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-df841ff3-5f39-459d-9082-20df603160c1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7" status: 200 len: 1496 microversion: 2.1 time: 0.516090 Oct 10 23:25:19.686412 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1128/2263] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:19 2022] GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7 => generated 1496 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:19.692729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1f19f5e4-83e8-43a6-a97e-121619f5cac2 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Calling method '.version_select at 0x7f662ae87b80>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:19.696633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f19f5e4-83e8-43a6-a97e-121619f5cac2 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:19.697330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f19f5e4-83e8-43a6-a97e-121619f5cac2 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:19.697936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f19f5e4-83e8-43a6-a97e-121619f5cac2 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:19.714034 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1f19f5e4-83e8-43a6-a97e-121619f5cac2 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1698 microversion: 2.25 time: 0.025655 Oct 10 23:25:19.714718 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1129/2264] 10.222.0.23 () {60 vars in 1184 bytes} [Mon Oct 10 23:25:19 2022] GET /compute/v2.1/os-migrations => generated 1698 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:19.731690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fa6d3fb7-5915-4024-8372-c453544dabd8 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:19.732581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fa6d3fb7-5915-4024-8372-c453544dabd8 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:19.741689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa6d3fb7-5915-4024-8372-c453544dabd8 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:19.742523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa6d3fb7-5915-4024-8372-c453544dabd8 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:19.743681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa6d3fb7-5915-4024-8372-c453544dabd8 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:19.744611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa6d3fb7-5915-4024-8372-c453544dabd8 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:19.745519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa6d3fb7-5915-4024-8372-c453544dabd8 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:19.746120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa6d3fb7-5915-4024-8372-c453544dabd8 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:20.194302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-fa6d3fb7-5915-4024-8372-c453544dabd8 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] Lazy-loading 'services' on Instance uuid 3a472045-8c28-4437-9e0f-9223369022ae {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:25:20.240523 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fa6d3fb7-5915-4024-8372-c453544dabd8 tempest-LiveAutoBlockMigrationV225Test-558836673 tempest-LiveAutoBlockMigrationV225Test-558836673-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1969 microversion: 2.25 time: 0.513158 Oct 10 23:25:20.270361 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1130/2265] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:19 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1969 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:20.304210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c75a5622-ed0a-4708-8f94-80047fe78cf2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:20.305233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c75a5622-ed0a-4708-8f94-80047fe78cf2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:20.314162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c75a5622-ed0a-4708-8f94-80047fe78cf2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:20.316343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c75a5622-ed0a-4708-8f94-80047fe78cf2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:20.316995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c75a5622-ed0a-4708-8f94-80047fe78cf2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:20.318955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c75a5622-ed0a-4708-8f94-80047fe78cf2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:20.320487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c75a5622-ed0a-4708-8f94-80047fe78cf2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:20.322480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c75a5622-ed0a-4708-8f94-80047fe78cf2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:20.490498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c75a5622-ed0a-4708-8f94-80047fe78cf2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:20.520321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c75a5622-ed0a-4708-8f94-80047fe78cf2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:20.529571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c75a5622-ed0a-4708-8f94-80047fe78cf2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:20.553696 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c75a5622-ed0a-4708-8f94-80047fe78cf2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.281797 Oct 10 23:25:20.554791 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1131/2266] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:20 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:20.568459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-602adaac-be49-4dad-b109-26ea4504984c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:20.573967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-602adaac-be49-4dad-b109-26ea4504984c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:20.606198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-602adaac-be49-4dad-b109-26ea4504984c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:20.607989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-602adaac-be49-4dad-b109-26ea4504984c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:20.608461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-602adaac-be49-4dad-b109-26ea4504984c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:20.612684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-602adaac-be49-4dad-b109-26ea4504984c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:20.613235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-602adaac-be49-4dad-b109-26ea4504984c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:20.613789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-602adaac-be49-4dad-b109-26ea4504984c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:20.666067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-31f68722-8729-45ef-a44e-a91d4592ef0b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:20.693042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-602adaac-be49-4dad-b109-26ea4504984c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:25:20.694627 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-31f68722-8729-45ef-a44e-a91d4592ef0b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 200 len: 1321 microversion: 2.1 time: 1.140752 Oct 10 23:25:20.696528 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1136/2267] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:19 2022] GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 1321 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:20.739558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-15f19a86-73e6-4e99-a2f8-c1fde001e00b req-e4431d41-dff5-4367-83f9-69b813b90650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c6f9198-4d2e-4064-9648-8136d5b0f14d", "name": "network-vif-plugged", "status": "completed", "tag": "61fd4e90-e896-45d8-8b8f-094125dac88f"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:20.789327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-15f19a86-73e6-4e99-a2f8-c1fde001e00b req-e4431d41-dff5-4367-83f9-69b813b90650 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:20.791716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-15f19a86-73e6-4e99-a2f8-c1fde001e00b req-e4431d41-dff5-4367-83f9-69b813b90650 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:20.793754 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-15f19a86-73e6-4e99-a2f8-c1fde001e00b req-e4431d41-dff5-4367-83f9-69b813b90650 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:20.833251 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-15f19a86-73e6-4e99-a2f8-c1fde001e00b req-e4431d41-dff5-4367-83f9-69b813b90650 service nova] Creating event network-vif-plugged:61fd4e90-e896-45d8-8b8f-094125dac88f for instance 6c6f9198-4d2e-4064-9648-8136d5b0f14d on n-h2-860864-2 Oct 10 23:25:20.850734 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-15f19a86-73e6-4e99-a2f8-c1fde001e00b req-e4431d41-dff5-4367-83f9-69b813b90650 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148733 Oct 10 23:25:20.852103 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1137/2268] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:25:20.871104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0f6e247e-d69c-4db2-87fc-7e140a795e24 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:20.885883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0f6e247e-d69c-4db2-87fc-7e140a795e24 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 5242250f-5274-4992-adb3-e8fdd3b65ed7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:20.910658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f6e247e-d69c-4db2-87fc-7e140a795e24 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:20.914507 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f6e247e-d69c-4db2-87fc-7e140a795e24 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:20.915773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f6e247e-d69c-4db2-87fc-7e140a795e24 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:20.918652 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f6e247e-d69c-4db2-87fc-7e140a795e24 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:20.920512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f6e247e-d69c-4db2-87fc-7e140a795e24 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:20.922150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f6e247e-d69c-4db2-87fc-7e140a795e24 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:21.017103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:25:21.100817 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-602adaac-be49-4dad-b109-26ea4504984c tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 204 len: 0 microversion: 2.25 time: 0.542214 Oct 10 23:25:21.106454 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1132/2269] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:25:20 2022] DELETE /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:25:21.125747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-aa243e39-6e85-48d2-99d6-103cf6253469 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:21.129816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-aa243e39-6e85-48d2-99d6-103cf6253469 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:21.161401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa243e39-6e85-48d2-99d6-103cf6253469 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:21.164773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa243e39-6e85-48d2-99d6-103cf6253469 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:21.166730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa243e39-6e85-48d2-99d6-103cf6253469 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:21.169129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa243e39-6e85-48d2-99d6-103cf6253469 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:21.172573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa243e39-6e85-48d2-99d6-103cf6253469 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:21.175224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa243e39-6e85-48d2-99d6-103cf6253469 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:21.803636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-aa243e39-6e85-48d2-99d6-103cf6253469 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:21.808909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0f6e247e-d69c-4db2-87fc-7e140a795e24 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:21.833480 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0f6e247e-d69c-4db2-87fc-7e140a795e24 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7" status: 200 len: 1479 microversion: 2.1 time: 0.970343 Oct 10 23:25:21.836319 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1138/2270] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:20 2022] GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7 => generated 1479 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:21.846268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-aa243e39-6e85-48d2-99d6-103cf6253469 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:21.854723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-aa243e39-6e85-48d2-99d6-103cf6253469 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:21.858073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-953b8e63-5a2e-4e01-83eb-208af0d543e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:21.860787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-953b8e63-5a2e-4e01-83eb-208af0d543e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:21.870508 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-aa243e39-6e85-48d2-99d6-103cf6253469 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1482 microversion: 2.25 time: 0.750246 Oct 10 23:25:21.871241 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1133/2271] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:21 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1482 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:21.878341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2d577b21-9b17-4f6c-b341-fd5d7d00b0f2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:21.883701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-953b8e63-5a2e-4e01-83eb-208af0d543e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:21.887014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2d577b21-9b17-4f6c-b341-fd5d7d00b0f2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:21.889480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-953b8e63-5a2e-4e01-83eb-208af0d543e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:21.890762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-953b8e63-5a2e-4e01-83eb-208af0d543e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:21.894044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-953b8e63-5a2e-4e01-83eb-208af0d543e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:21.901225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-953b8e63-5a2e-4e01-83eb-208af0d543e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:21.902561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-953b8e63-5a2e-4e01-83eb-208af0d543e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:21.904438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d577b21-9b17-4f6c-b341-fd5d7d00b0f2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:21.914250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d577b21-9b17-4f6c-b341-fd5d7d00b0f2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:21.917786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d577b21-9b17-4f6c-b341-fd5d7d00b0f2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:21.918775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d577b21-9b17-4f6c-b341-fd5d7d00b0f2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:21.919362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d577b21-9b17-4f6c-b341-fd5d7d00b0f2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:21.919906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d577b21-9b17-4f6c-b341-fd5d7d00b0f2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:22.146846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-953b8e63-5a2e-4e01-83eb-208af0d543e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:22.163901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-953b8e63-5a2e-4e01-83eb-208af0d543e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:22.165367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-953b8e63-5a2e-4e01-83eb-208af0d543e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:22.206359 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-953b8e63-5a2e-4e01-83eb-208af0d543e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.368813 Oct 10 23:25:22.217478 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1139/2272] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:21 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:22.230216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c6a6b127-e7b9-427b-98db-eeb1c965d7a5 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-933837647"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:22.237365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c6a6b127-e7b9-427b-98db-eeb1c965d7a5 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 5242250f-5274-4992-adb3-e8fdd3b65ed7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:22.252225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6a6b127-e7b9-427b-98db-eeb1c965d7a5 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:22.255828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6a6b127-e7b9-427b-98db-eeb1c965d7a5 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:22.256434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6a6b127-e7b9-427b-98db-eeb1c965d7a5 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:22.265938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6a6b127-e7b9-427b-98db-eeb1c965d7a5 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:22.266794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6a6b127-e7b9-427b-98db-eeb1c965d7a5 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:22.270355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6a6b127-e7b9-427b-98db-eeb1c965d7a5 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:22.795289 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c6a6b127-e7b9-427b-98db-eeb1c965d7a5 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "POST /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7/action" status: 202 len: 0 microversion: 2.1 time: 0.574889 Oct 10 23:25:22.799848 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1140/2273] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:25:22 2022] POST /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 23:25:22.824726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2d577b21-9b17-4f6c-b341-fd5d7d00b0f2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:22.830111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:25:22.848671 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2d577b21-9b17-4f6c-b341-fd5d7d00b0f2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 200 len: 1321 microversion: 2.1 time: 0.973046 Oct 10 23:25:22.850197 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1134/2274] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:21 2022] GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 1321 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:22.871354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-11b010e0-f888-4ebc-8ba9-1eb001d66a32 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f66301d5280>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:23.004470 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-11b010e0-f888-4ebc-8ba9-1eb001d66a32 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510" status: 200 len: 1439 microversion: 2.1 time: 0.150395 Oct 10 23:25:23.013747 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1135/2275] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:25:22 2022] GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510 => generated 1439 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:23.026118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-88bd2101-b0a8-4c5b-809f-910e036596f7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:23.026751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-88bd2101-b0a8-4c5b-809f-910e036596f7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:23.045592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88bd2101-b0a8-4c5b-809f-910e036596f7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:23.046135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88bd2101-b0a8-4c5b-809f-910e036596f7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:23.054870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88bd2101-b0a8-4c5b-809f-910e036596f7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:23.055696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88bd2101-b0a8-4c5b-809f-910e036596f7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:23.061023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88bd2101-b0a8-4c5b-809f-910e036596f7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:23.061023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88bd2101-b0a8-4c5b-809f-910e036596f7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:23.277782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-51ec8801-3ac9-44ad-ae08-cf8085f82d8b tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1608162318", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "cfef5dea-a2ab-4bd7-b65f-57afe6002c89"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:23.412828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-51ec8801-3ac9-44ad-ae08-cf8085f82d8b tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] validate_networks() for [('cfef5dea-a2ab-4bd7-b65f-57afe6002c89', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:25:23.691709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-88bd2101-b0a8-4c5b-809f-910e036596f7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:23.732156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-88bd2101-b0a8-4c5b-809f-910e036596f7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:23.736637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-88bd2101-b0a8-4c5b-809f-910e036596f7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:23.738326 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-88bd2101-b0a8-4c5b-809f-910e036596f7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1482 microversion: 2.25 time: 0.723418 Oct 10 23:25:23.760163 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1136/2276] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:23 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1482 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:23.776036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-29b7ec6c-f42c-4ff3-bca3-ad11be327f06 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:23.787315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-29b7ec6c-f42c-4ff3-bca3-ad11be327f06 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:23.800686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29b7ec6c-f42c-4ff3-bca3-ad11be327f06 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:23.801488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29b7ec6c-f42c-4ff3-bca3-ad11be327f06 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:23.803111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29b7ec6c-f42c-4ff3-bca3-ad11be327f06 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:23.804290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29b7ec6c-f42c-4ff3-bca3-ad11be327f06 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:23.804926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29b7ec6c-f42c-4ff3-bca3-ad11be327f06 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:23.805579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29b7ec6c-f42c-4ff3-bca3-ad11be327f06 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:23.986845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-29b7ec6c-f42c-4ff3-bca3-ad11be327f06 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:24.012914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-29b7ec6c-f42c-4ff3-bca3-ad11be327f06 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:24.023116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-29b7ec6c-f42c-4ff3-bca3-ad11be327f06 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:24.045837 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-29b7ec6c-f42c-4ff3-bca3-ad11be327f06 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.279656 Oct 10 23:25:24.046795 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1137/2277] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:23 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:24.072339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8c15d1a3-ea09-4685-8d17-f3761b893140 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:24.073291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8c15d1a3-ea09-4685-8d17-f3761b893140 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:24.101285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c15d1a3-ea09-4685-8d17-f3761b893140 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:24.104775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c15d1a3-ea09-4685-8d17-f3761b893140 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:24.105723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c15d1a3-ea09-4685-8d17-f3761b893140 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:24.107483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c15d1a3-ea09-4685-8d17-f3761b893140 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:24.111271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c15d1a3-ea09-4685-8d17-f3761b893140 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:24.115851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c15d1a3-ea09-4685-8d17-f3761b893140 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:25.257278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8c15d1a3-ea09-4685-8d17-f3761b893140 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:25.279316 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8c15d1a3-ea09-4685-8d17-f3761b893140 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 200 len: 1470 microversion: 2.1 time: 1.229487 Oct 10 23:25:25.283697 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1138/2278] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:24 2022] GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 1470 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:25.298450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-48c7a13a-0f19-4b48-8d18-34d6335efca1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662baa7550>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:25.471777 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-48c7a13a-0f19-4b48-8d18-34d6335efca1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510" status: 200 len: 1439 microversion: 2.1 time: 0.186571 Oct 10 23:25:25.473964 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1139/2279] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:25:25 2022] GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510 => generated 1439 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:25.482671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-73a1ca02-8533-4fc0-b492-28d35a4d21b5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:25.486702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-73a1ca02-8533-4fc0-b492-28d35a4d21b5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:25.507249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73a1ca02-8533-4fc0-b492-28d35a4d21b5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:25.509054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73a1ca02-8533-4fc0-b492-28d35a4d21b5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:25.510254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73a1ca02-8533-4fc0-b492-28d35a4d21b5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:25.511782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73a1ca02-8533-4fc0-b492-28d35a4d21b5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:25.512934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73a1ca02-8533-4fc0-b492-28d35a4d21b5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:25.514610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73a1ca02-8533-4fc0-b492-28d35a4d21b5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:25.801752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-51ec8801-3ac9-44ad-ae08-cf8085f82d8b tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:25:25.803688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-51ec8801-3ac9-44ad-ae08-cf8085f82d8b tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:25:25.804660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-51ec8801-3ac9-44ad-ae08-cf8085f82d8b tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:25:25.805354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-51ec8801-3ac9-44ad-ae08-cf8085f82d8b tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:25:25.806344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-51ec8801-3ac9-44ad-ae08-cf8085f82d8b tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:25:25.846743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51ec8801-3ac9-44ad-ae08-cf8085f82d8b tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:25.849885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51ec8801-3ac9-44ad-ae08-cf8085f82d8b tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:25.854746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51ec8801-3ac9-44ad-ae08-cf8085f82d8b tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:25.856110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51ec8801-3ac9-44ad-ae08-cf8085f82d8b tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:25.860690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51ec8801-3ac9-44ad-ae08-cf8085f82d8b tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:25.864946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51ec8801-3ac9-44ad-ae08-cf8085f82d8b tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:25.955454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-51ec8801-3ac9-44ad-ae08-cf8085f82d8b tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Getting quotas for project 2481a2904215494d8bdf9876a8be0822. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:25:25.998055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-51ec8801-3ac9-44ad-ae08-cf8085f82d8b tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Getting quotas for user 5508f1f7e16d4b98ad363f9647609ca8 and project 2481a2904215494d8bdf9876a8be0822. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:25:26.066496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-51ec8801-3ac9-44ad-ae08-cf8085f82d8b tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:25:26.081208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-51ec8801-3ac9-44ad-ae08-cf8085f82d8b tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] [instance: d3873d3f-2b48-4d60-b076-6b2bf69591b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:25:26.210051 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-51ec8801-3ac9-44ad-ae08-cf8085f82d8b tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.401066 Oct 10 23:25:26.215792 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1141/2280] 10.222.0.23 () {62 vars in 1188 bytes} [Mon Oct 10 23:25:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3413 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 23:25:26.231163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cda3e2f9-7913-42f7-a63a-63ccadd215a6 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:26.235708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cda3e2f9-7913-42f7-a63a-63ccadd215a6 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:26.254083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-73a1ca02-8533-4fc0-b492-28d35a4d21b5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:26.273412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-73a1ca02-8533-4fc0-b492-28d35a4d21b5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:26.276293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cda3e2f9-7913-42f7-a63a-63ccadd215a6 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:26.277995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cda3e2f9-7913-42f7-a63a-63ccadd215a6 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:26.279963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-73a1ca02-8533-4fc0-b492-28d35a4d21b5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:26.282480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cda3e2f9-7913-42f7-a63a-63ccadd215a6 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:26.285669 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cda3e2f9-7913-42f7-a63a-63ccadd215a6 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:26.285964 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-73a1ca02-8533-4fc0-b492-28d35a4d21b5 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1266 microversion: 2.25 time: 0.810078 Oct 10 23:25:26.289356 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1140/2281] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:25 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1266 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:26.292997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cda3e2f9-7913-42f7-a63a-63ccadd215a6 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:26.294047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cda3e2f9-7913-42f7-a63a-63ccadd215a6 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:26.299173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-27902272-8242-4976-a1b7-6a7a6a76a521 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:26.302059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-27902272-8242-4976-a1b7-6a7a6a76a521 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:26.340191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27902272-8242-4976-a1b7-6a7a6a76a521 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:26.340955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27902272-8242-4976-a1b7-6a7a6a76a521 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:26.347533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27902272-8242-4976-a1b7-6a7a6a76a521 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:26.348673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27902272-8242-4976-a1b7-6a7a6a76a521 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:26.349290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27902272-8242-4976-a1b7-6a7a6a76a521 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:26.350269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27902272-8242-4976-a1b7-6a7a6a76a521 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:26.455344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-27902272-8242-4976-a1b7-6a7a6a76a521 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Lazy-loading 'flavor' on Instance uuid 6c6f9198-4d2e-4064-9648-8136d5b0f14d {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:25:26.675293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cda3e2f9-7913-42f7-a63a-63ccadd215a6 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:26.691022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cda3e2f9-7913-42f7-a63a-63ccadd215a6 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:26.717678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cda3e2f9-7913-42f7-a63a-63ccadd215a6 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:26.748119 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cda3e2f9-7913-42f7-a63a-63ccadd215a6 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.516905 Oct 10 23:25:26.752281 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1142/2282] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:26 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:26.762377 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-27902272-8242-4976-a1b7-6a7a6a76a521 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d/action" status: 202 len: 0 microversion: 2.1 time: 0.470169 Oct 10 23:25:26.766172 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1141/2283] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:25:26 2022] POST /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:25:26.777653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-99b16a3c-e5e0-42ec-bddd-08327666b663 req-232d88ed-c133-4111-92e6-7994474a2fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a472045-8c28-4437-9e0f-9223369022ae", "name": "network-vif-deleted", "tag": "7eabf4d8-5373-4658-bf95-07c701376608"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:26.785780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b0a3d27b-f7a7-4341-b873-e6f50b15a0af tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:26.792303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b0a3d27b-f7a7-4341-b873-e6f50b15a0af tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:26.848390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0a3d27b-f7a7-4341-b873-e6f50b15a0af tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:26.856906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-99b16a3c-e5e0-42ec-bddd-08327666b663 req-232d88ed-c133-4111-92e6-7994474a2fc0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:26.860932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0a3d27b-f7a7-4341-b873-e6f50b15a0af tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:26.873232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0a3d27b-f7a7-4341-b873-e6f50b15a0af tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:26.873957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-99b16a3c-e5e0-42ec-bddd-08327666b663 req-232d88ed-c133-4111-92e6-7994474a2fc0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:26.876347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0a3d27b-f7a7-4341-b873-e6f50b15a0af tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:26.877897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0a3d27b-f7a7-4341-b873-e6f50b15a0af tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:26.879828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-99b16a3c-e5e0-42ec-bddd-08327666b663 req-232d88ed-c133-4111-92e6-7994474a2fc0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:26.880107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0a3d27b-f7a7-4341-b873-e6f50b15a0af tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:26.935517 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-99b16a3c-e5e0-42ec-bddd-08327666b663 req-232d88ed-c133-4111-92e6-7994474a2fc0 service nova] Creating event network-vif-deleted:7eabf4d8-5373-4658-bf95-07c701376608 for instance 3a472045-8c28-4437-9e0f-9223369022ae on n-h2-860864-2 Oct 10 23:25:26.953523 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-99b16a3c-e5e0-42ec-bddd-08327666b663 req-232d88ed-c133-4111-92e6-7994474a2fc0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199376 Oct 10 23:25:26.955107 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1143/2284] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:25:26.972117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c564fa2b-7c85-45bd-b1eb-90194bc5f199 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:26.974774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c564fa2b-7c85-45bd-b1eb-90194bc5f199 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] [instance: d3873d3f-2b48-4d60-b076-6b2bf69591b2] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:27.274277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-b0a3d27b-f7a7-4341-b873-e6f50b15a0af tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lazy-loading 'services' on Instance uuid 10d4252b-2561-4a94-adf8-018fdec5c2cc {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:25:27.279864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c564fa2b-7c85-45bd-b1eb-90194bc5f199 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:27.306221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c564fa2b-7c85-45bd-b1eb-90194bc5f199 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:27.316376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c564fa2b-7c85-45bd-b1eb-90194bc5f199 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:27.320620 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c564fa2b-7c85-45bd-b1eb-90194bc5f199 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] 10.222.0.23 "GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2" status: 200 len: 1259 microversion: 2.21 time: 0.363721 Oct 10 23:25:27.326310 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1144/2285] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:26 2022] GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2 => generated 1259 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:27.352848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e3417333-6755-41cf-a3fe-7ec726cb086b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662a863f70>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:27.504354 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e3417333-6755-41cf-a3fe-7ec726cb086b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510" status: 200 len: 1439 microversion: 2.1 time: 0.176345 Oct 10 23:25:27.505655 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1145/2286] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:25:27 2022] GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510 => generated 1439 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:27.527779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ee395d56-60da-4c58-b011-9eaa79dcb35e tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:27.531804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ee395d56-60da-4c58-b011-9eaa79dcb35e tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:27.565476 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b0a3d27b-f7a7-4341-b873-e6f50b15a0af tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "DELETE /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc/os-volume_attachments/ba3f642b-0a4d-4a5d-933c-e3ca0075aea9" status: 202 len: 0 microversion: 2.1 time: 0.796562 Oct 10 23:25:27.567195 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1142/2287] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Oct 10 23:25:26 2022] DELETE /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc/os-volume_attachments/ba3f642b-0a4d-4a5d-933c-e3ca0075aea9 => generated 0 bytes in 800 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:25:27.579199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee395d56-60da-4c58-b011-9eaa79dcb35e tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:27.579898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee395d56-60da-4c58-b011-9eaa79dcb35e tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:27.580262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee395d56-60da-4c58-b011-9eaa79dcb35e tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:27.588370 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee395d56-60da-4c58-b011-9eaa79dcb35e tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:27.589725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee395d56-60da-4c58-b011-9eaa79dcb35e tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:27.590207 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee395d56-60da-4c58-b011-9eaa79dcb35e tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:27.662892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f465661b-54be-41a6-8b78-0c4fb2765542 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:27.666605 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f465661b-54be-41a6-8b78-0c4fb2765542 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:27.698481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f465661b-54be-41a6-8b78-0c4fb2765542 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:27.706768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f465661b-54be-41a6-8b78-0c4fb2765542 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:27.707675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f465661b-54be-41a6-8b78-0c4fb2765542 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:27.709019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f465661b-54be-41a6-8b78-0c4fb2765542 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:27.710832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f465661b-54be-41a6-8b78-0c4fb2765542 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:27.715487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f465661b-54be-41a6-8b78-0c4fb2765542 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:27.966208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f465661b-54be-41a6-8b78-0c4fb2765542 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:27.990804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f465661b-54be-41a6-8b78-0c4fb2765542 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:27.999303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f465661b-54be-41a6-8b78-0c4fb2765542 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:28.001548 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f465661b-54be-41a6-8b78-0c4fb2765542 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1266 microversion: 2.25 time: 0.432884 Oct 10 23:25:28.002131 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1143/2288] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:27 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1266 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:28.031087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-83bfb230-7170-4d2f-a67b-aa0145d72b76 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:28.032057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-83bfb230-7170-4d2f-a67b-aa0145d72b76 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:28.058749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83bfb230-7170-4d2f-a67b-aa0145d72b76 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:28.059616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83bfb230-7170-4d2f-a67b-aa0145d72b76 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:28.060243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83bfb230-7170-4d2f-a67b-aa0145d72b76 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:28.062690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83bfb230-7170-4d2f-a67b-aa0145d72b76 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:28.064485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83bfb230-7170-4d2f-a67b-aa0145d72b76 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:28.065242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83bfb230-7170-4d2f-a67b-aa0145d72b76 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:28.350903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-83bfb230-7170-4d2f-a67b-aa0145d72b76 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:28.395844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-83bfb230-7170-4d2f-a67b-aa0145d72b76 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:28.408840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-83bfb230-7170-4d2f-a67b-aa0145d72b76 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:28.420942 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-83bfb230-7170-4d2f-a67b-aa0145d72b76 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.409228 Oct 10 23:25:28.447354 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1144/2289] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:28 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:28.454498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f3a2b677-941b-467d-8862-ec6bb993fd3a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:28.455129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f3a2b677-941b-467d-8862-ec6bb993fd3a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] [instance: d3873d3f-2b48-4d60-b076-6b2bf69591b2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:28.474998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3a2b677-941b-467d-8862-ec6bb993fd3a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:28.475522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3a2b677-941b-467d-8862-ec6bb993fd3a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:28.475945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3a2b677-941b-467d-8862-ec6bb993fd3a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:28.476670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3a2b677-941b-467d-8862-ec6bb993fd3a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:28.482100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3a2b677-941b-467d-8862-ec6bb993fd3a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:28.482100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3a2b677-941b-467d-8862-ec6bb993fd3a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:28.687835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f3a2b677-941b-467d-8862-ec6bb993fd3a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:28.741940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f3a2b677-941b-467d-8862-ec6bb993fd3a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:28.744239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f3a2b677-941b-467d-8862-ec6bb993fd3a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:28.746357 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f3a2b677-941b-467d-8862-ec6bb993fd3a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] 10.222.0.23 "GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2" status: 200 len: 1311 microversion: 2.21 time: 0.297639 Oct 10 23:25:28.753975 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1145/2290] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:28 2022] GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2 => generated 1311 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:28.762159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a7e1ca87-1dad-43c7-b255-b2f074226d24 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b4e7dc0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:30.712271 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ee395d56-60da-4c58-b011-9eaa79dcb35e tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 200 len: 1629 microversion: 2.1 time: 3.205471 Oct 10 23:25:30.736976 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1146/2291] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:27 2022] GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 1629 bytes in 3220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:30.748471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bce9acb9-2acd-4872-8579-c3196d01b993 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:30.749108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bce9acb9-2acd-4872-8579-c3196d01b993 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:30.768032 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bce9acb9-2acd-4872-8579-c3196d01b993 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:30.768520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bce9acb9-2acd-4872-8579-c3196d01b993 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:30.768959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bce9acb9-2acd-4872-8579-c3196d01b993 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:30.769706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bce9acb9-2acd-4872-8579-c3196d01b993 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:30.774031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bce9acb9-2acd-4872-8579-c3196d01b993 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:30.774683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bce9acb9-2acd-4872-8579-c3196d01b993 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:31.213839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bce9acb9-2acd-4872-8579-c3196d01b993 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:31.233331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bce9acb9-2acd-4872-8579-c3196d01b993 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:31.244545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bce9acb9-2acd-4872-8579-c3196d01b993 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:31.261596 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bce9acb9-2acd-4872-8579-c3196d01b993 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1266 microversion: 2.25 time: 0.517233 Oct 10 23:25:31.290468 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1147/2292] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:30 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1266 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:31.308817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a9b7c8d9-719d-436b-907e-f802546560a2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:31.326821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a9b7c8d9-719d-436b-907e-f802546560a2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:31.360351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9b7c8d9-719d-436b-907e-f802546560a2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:31.361034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9b7c8d9-719d-436b-907e-f802546560a2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:31.367055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9b7c8d9-719d-436b-907e-f802546560a2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:31.367849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9b7c8d9-719d-436b-907e-f802546560a2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:31.368501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9b7c8d9-719d-436b-907e-f802546560a2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:31.377538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9b7c8d9-719d-436b-907e-f802546560a2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:31.739928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a9b7c8d9-719d-436b-907e-f802546560a2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:31.761708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a9b7c8d9-719d-436b-907e-f802546560a2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:31.767959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a9b7c8d9-719d-436b-907e-f802546560a2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:31.795707 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a9b7c8d9-719d-436b-907e-f802546560a2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.502955 Oct 10 23:25:31.796244 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1148/2293] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:31 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:31.820766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-227c6c49-24db-4f6f-a00d-7f8f922b3762 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:31.820766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-227c6c49-24db-4f6f-a00d-7f8f922b3762 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] [instance: d3873d3f-2b48-4d60-b076-6b2bf69591b2] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:31.852231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-227c6c49-24db-4f6f-a00d-7f8f922b3762 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:31.852714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-227c6c49-24db-4f6f-a00d-7f8f922b3762 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:31.853157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-227c6c49-24db-4f6f-a00d-7f8f922b3762 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:31.853935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-227c6c49-24db-4f6f-a00d-7f8f922b3762 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:31.854385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-227c6c49-24db-4f6f-a00d-7f8f922b3762 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:31.855280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-227c6c49-24db-4f6f-a00d-7f8f922b3762 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:32.236674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-227c6c49-24db-4f6f-a00d-7f8f922b3762 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:32.251426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-227c6c49-24db-4f6f-a00d-7f8f922b3762 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:32.252891 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-227c6c49-24db-4f6f-a00d-7f8f922b3762 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:32.274735 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-227c6c49-24db-4f6f-a00d-7f8f922b3762 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] 10.222.0.23 "GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2" status: 200 len: 1317 microversion: 2.21 time: 0.467752 Oct 10 23:25:32.279832 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1149/2294] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:31 2022] GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2 => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:32.301590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f96feac2-8ce3-493f-b202-2933392eb5f8 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:32.304822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f96feac2-8ce3-493f-b202-2933392eb5f8 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:32.339291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f96feac2-8ce3-493f-b202-2933392eb5f8 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:32.339748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f96feac2-8ce3-493f-b202-2933392eb5f8 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:32.340188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f96feac2-8ce3-493f-b202-2933392eb5f8 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:32.342583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f96feac2-8ce3-493f-b202-2933392eb5f8 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:32.344786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f96feac2-8ce3-493f-b202-2933392eb5f8 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:32.345945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f96feac2-8ce3-493f-b202-2933392eb5f8 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:33.079444 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f96feac2-8ce3-493f-b202-2933392eb5f8 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 200 len: 1612 microversion: 2.1 time: 0.797555 Oct 10 23:25:33.090492 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1150/2295] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:32 2022] GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 1612 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:33.108748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-01b6f235-630e-4215-951c-c755d1989c87 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:33.119473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-01b6f235-630e-4215-951c-c755d1989c87 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:33.153167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01b6f235-630e-4215-951c-c755d1989c87 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:33.153713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01b6f235-630e-4215-951c-c755d1989c87 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:33.154159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01b6f235-630e-4215-951c-c755d1989c87 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:33.154884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01b6f235-630e-4215-951c-c755d1989c87 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:33.155338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01b6f235-630e-4215-951c-c755d1989c87 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:33.166580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01b6f235-630e-4215-951c-c755d1989c87 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:34.224427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-01b6f235-630e-4215-951c-c755d1989c87 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:34.247709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-01b6f235-630e-4215-951c-c755d1989c87 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:34.253504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-01b6f235-630e-4215-951c-c755d1989c87 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:34.257450 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-01b6f235-630e-4215-951c-c755d1989c87 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1266 microversion: 2.25 time: 1.165436 Oct 10 23:25:34.261687 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1151/2296] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:33 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1266 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:34.279668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-793553d7-20af-45f1-a628-aea022d56413 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:34.288849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-793553d7-20af-45f1-a628-aea022d56413 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:34.313920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-793553d7-20af-45f1-a628-aea022d56413 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:34.315722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-793553d7-20af-45f1-a628-aea022d56413 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:34.319243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-793553d7-20af-45f1-a628-aea022d56413 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:34.322074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-793553d7-20af-45f1-a628-aea022d56413 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:34.322699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-793553d7-20af-45f1-a628-aea022d56413 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:34.323160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-793553d7-20af-45f1-a628-aea022d56413 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:34.742507 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-793553d7-20af-45f1-a628-aea022d56413 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:34.761590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-793553d7-20af-45f1-a628-aea022d56413 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:34.763487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-793553d7-20af-45f1-a628-aea022d56413 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:34.790359 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-793553d7-20af-45f1-a628-aea022d56413 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.527127 Oct 10 23:25:34.790934 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1152/2297] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:34 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:34.815364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-37731659-4847-48d8-8d7c-047181155ffa tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:34.815996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-37731659-4847-48d8-8d7c-047181155ffa tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:34.835508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37731659-4847-48d8-8d7c-047181155ffa tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:34.836179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37731659-4847-48d8-8d7c-047181155ffa tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:34.838001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37731659-4847-48d8-8d7c-047181155ffa tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:34.838889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37731659-4847-48d8-8d7c-047181155ffa tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:34.847326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37731659-4847-48d8-8d7c-047181155ffa tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:34.848029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37731659-4847-48d8-8d7c-047181155ffa tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:34.935880 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-37731659-4847-48d8-8d7c-047181155ffa tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] HTTP exception thrown: Cannot 'migrate' instance 6c6f9198-4d2e-4064-9648-8136d5b0f14d while it is in vm_state suspended Oct 10 23:25:34.940356 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-37731659-4847-48d8-8d7c-047181155ffa tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Request method failure captured: Oct 10 23:25:34.940356 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d/action HTTP/1.1 Oct 10 23:25:34.940356 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:25:34.940356 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:25:34.940356 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:25:34.940356 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 15 Oct 10 23:25:34.940356 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:25:34.940356 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:25:34.940356 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:25:34.940356 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:25:34.940356 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKmuZVE867-0n9QJjXfmVVavhIsQxkC6IV8mn1-VRQuxDMywRVVFwcEClOdOpSEI98-F1ZVRhxJys0flpTXUzRUXmoV9xjma-aQxaFMGJxv2EIyedFGTrmv8NPh9Qzwd3qHxchnmFKti6VSfFMq5R4YCYAIul7WLBBwwJR-zlvJIKBk Oct 10 23:25:34.940356 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:25:34.940356 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:25:34.940356 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:25:34.940356 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:25:34.940356 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:25:34.940356 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:25:34.940356 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: da6449b194674f3f937af77207f39b28 Oct 10 23:25:34.940356 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1244263607 Oct 10 23:25:34.940356 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:25:34.940356 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:25:34.941675 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da6449b194674f3f937af77207f39b28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da6449b194674f3f937af77207f39b28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da6449b194674f3f937af77207f39b28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da6449b194674f3f937af77207f39b28", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:25:34.941675 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1244263607 Oct 10 23:25:34.941675 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: da6449b194674f3f937af77207f39b28 Oct 10 23:25:34.941675 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1244263607 Oct 10 23:25:34.941675 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersAdminNegativeTestJSON-1244263607-project-admin Oct 10 23:25:34.941675 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:25:34.941675 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:25:34.941675 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 074e507895974ec8a4551b9b71fd70c5 Oct 10 23:25:34.941675 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1244263607-project-admin Oct 10 23:25:34.941675 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:25:34.941675 n-d-860864-2 devstack@n-api.service[120614]: {"migrate": {}} Oct 10 23:25:34.941675 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:25:34.941675 n-d-860864-2 devstack@n-api.service[120614]: exception: Cannot 'migrate' instance 6c6f9198-4d2e-4064-9648-8136d5b0f14d while it is in vm_state suspended Oct 10 23:25:34.942354 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '6c6f9198-4d2e-4064-9648-8136d5b0f14d', 'body': {'migrate': {}}} Oct 10 23:25:34.942354 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:25:34.942354 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:34.942354 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 10 23:25:34.942354 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 10 23:25:34.942354 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 10 23:25:34.942354 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 23:25:34.942354 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 10 23:25:34.942354 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 23:25:34.942354 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 10 23:25:34.942354 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 23:25:34.942354 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 23:25:34.942354 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 23:25:34.942354 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 23:25:34.942354 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 23:25:34.942354 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6c6f9198-4d2e-4064-9648-8136d5b0f14d in vm_state suspended. Cannot resize while the instance is in this state. Oct 10 23:25:34.942354 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:34.942354 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:34.942354 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:34.942354 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:34.943408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:34.943408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:34.943408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:25:34.943408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:25:34.943408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:25:34.943408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:25:34.943408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:25:34.943408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:25:34.943408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 10 23:25:34.943408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 23:25:34.943408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 23:25:34.943408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 23:25:34.943408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 6c6f9198-4d2e-4064-9648-8136d5b0f14d while it is in vm_state suspended Oct 10 23:25:34.943408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:34.943408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:34.943408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:34.943408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:34.943408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:34.943408 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:34.944549 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:25:34.944549 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:25:34.944549 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 6c6f9198-4d2e-4064-9648-8136d5b0f14d while it is in vm_state suspended Oct 10 23:25:34.944549 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:34.946259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-37731659-4847-48d8-8d7c-047181155ffa tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Returning 409 to user: Cannot 'migrate' instance 6c6f9198-4d2e-4064-9648-8136d5b0f14d while it is in vm_state suspended {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:25:34.950451 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-37731659-4847-48d8-8d7c-047181155ffa tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d/action" status: 409 len: 148 microversion: 2.1 time: 0.158107 Oct 10 23:25:34.953131 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1153/2298] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:25:34 2022] POST /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d/action => generated 148 bytes in 161 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:25:34.964172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-6a6b8f9e-46c0-4d39-8939-f943817646e6 req-11f4ebb7-f6b2-47c7-a60e-79594ecb4c5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5242250f-5274-4992-adb3-e8fdd3b65ed7", "name": "network-vif-plugged", "status": "completed", "tag": "90f86f41-ee10-436d-af23-bca655e7f68b"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:34.991315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6a6b8f9e-46c0-4d39-8939-f943817646e6 req-11f4ebb7-f6b2-47c7-a60e-79594ecb4c5c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:34.992199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6a6b8f9e-46c0-4d39-8939-f943817646e6 req-11f4ebb7-f6b2-47c7-a60e-79594ecb4c5c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:34.992836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6a6b8f9e-46c0-4d39-8939-f943817646e6 req-11f4ebb7-f6b2-47c7-a60e-79594ecb4c5c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:35.014030 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-6a6b8f9e-46c0-4d39-8939-f943817646e6 req-11f4ebb7-f6b2-47c7-a60e-79594ecb4c5c service nova] Creating event network-vif-plugged:90f86f41-ee10-436d-af23-bca655e7f68b for instance 5242250f-5274-4992-adb3-e8fdd3b65ed7 on n-h2-860864-2 Oct 10 23:25:35.031894 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-6a6b8f9e-46c0-4d39-8939-f943817646e6 req-11f4ebb7-f6b2-47c7-a60e-79594ecb4c5c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076647 Oct 10 23:25:35.037828 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1154/2299] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:25:35.050005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a17a8828-793f-4546-a945-37a46938c7e7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:35.051104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a17a8828-793f-4546-a945-37a46938c7e7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] [instance: d3873d3f-2b48-4d60-b076-6b2bf69591b2] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:35.057832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a17a8828-793f-4546-a945-37a46938c7e7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:35.058610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a17a8828-793f-4546-a945-37a46938c7e7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:35.059289 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a17a8828-793f-4546-a945-37a46938c7e7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:35.060213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a17a8828-793f-4546-a945-37a46938c7e7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:35.060873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a17a8828-793f-4546-a945-37a46938c7e7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:35.061575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a17a8828-793f-4546-a945-37a46938c7e7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:35.924397 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:25:36.560961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a17a8828-793f-4546-a945-37a46938c7e7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:36.611169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a17a8828-793f-4546-a945-37a46938c7e7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:36.621738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a17a8828-793f-4546-a945-37a46938c7e7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:36.633889 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a17a8828-793f-4546-a945-37a46938c7e7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] 10.222.0.23 "GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2" status: 200 len: 1359 microversion: 2.21 time: 1.591311 Oct 10 23:25:36.652547 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1155/2300] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:35 2022] GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2 => generated 1359 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:36.671896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-61c55481-ef67-457e-9d55-08a19d6cdcf7 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:36.680716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-61c55481-ef67-457e-9d55-08a19d6cdcf7 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Request method failure captured: Oct 10 23:25:36.680716 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989/action HTTP/1.1 Oct 10 23:25:36.680716 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:25:36.680716 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:25:36.680716 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:25:36.680716 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 39 Oct 10 23:25:36.680716 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:25:36.680716 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:25:36.680716 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:25:36.680716 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:25:36.680716 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKmuZVE867-0n9QJjXfmVVavhIsQxkC6IV8mn1-VRQuxDMywRVVFwcEClOdOpSEI98-F1ZVRhxJys0flpTXUzRUXmoV9xjma-aQxaFMGJxv2EIyedFGTrmv8NPh9Qzwd3qHxchnmFKti6VSfFMq5R4YCYAIul7WLBBwwJR-zlvJIKBk Oct 10 23:25:36.680716 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:25:36.680716 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:25:36.680716 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:25:36.680716 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:25:36.680716 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:25:36.680716 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:25:36.680716 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: da6449b194674f3f937af77207f39b28 Oct 10 23:25:36.680716 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1244263607 Oct 10 23:25:36.680716 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:25:36.680716 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:25:36.682221 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da6449b194674f3f937af77207f39b28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da6449b194674f3f937af77207f39b28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da6449b194674f3f937af77207f39b28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da6449b194674f3f937af77207f39b28", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:25:36.682221 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1244263607 Oct 10 23:25:36.682221 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: da6449b194674f3f937af77207f39b28 Oct 10 23:25:36.682221 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1244263607 Oct 10 23:25:36.682221 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersAdminNegativeTestJSON-1244263607-project-admin Oct 10 23:25:36.682221 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:25:36.682221 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:25:36.682221 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 074e507895974ec8a4551b9b71fd70c5 Oct 10 23:25:36.682221 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1244263607-project-admin Oct 10 23:25:36.682221 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:25:36.682221 n-d-860864-2 devstack@n-api.service[120614]: {"os-resetState": {"state": "invalid"}} Oct 10 23:25:36.682221 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:25:36.682979 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 10 23:25:36.682979 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'e47ddcc1-9723-4e88-8c1d-ded295d4e989', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 10 23:25:36.682979 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:25:36.682979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:36.682979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:25:36.682979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:25:36.682979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:25:36.682979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:25:36.682979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 10 23:25:36.682979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:36.682979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 10 23:25:36.682979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 10 23:25:36.682979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:36.682979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 10 23:25:36.682979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'invalid' Oct 10 23:25:36.682979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:36.682979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:36.682979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:36.682979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:36.682979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:36.682979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:36.682979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:25:36.684372 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:25:36.684372 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:25:36.684372 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:25:36.684372 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:25:36.684372 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:25:36.684372 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:25:36.684372 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:25:36.684372 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:25:36.684372 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:25:36.684372 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 10 23:25:36.684372 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:36.684372 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:36.684372 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:36.684372 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:36.684372 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:36.684372 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:36.684372 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:25:36.684372 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:25:36.684372 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 10 23:25:36.685783 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:36.689256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-61c55481-ef67-457e-9d55-08a19d6cdcf7 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:25:36.691442 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-61c55481-ef67-457e-9d55-08a19d6cdcf7 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989/action" status: 400 len: 144 microversion: 2.1 time: 0.029196 Oct 10 23:25:36.699867 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1156/2301] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:25:36 2022] POST /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989/action => generated 144 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:25:36.708966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-be636344-1a0f-43f3-ad96-7f84ee768e29 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:36.712988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-be636344-1a0f-43f3-ad96-7f84ee768e29 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:36.734935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be636344-1a0f-43f3-ad96-7f84ee768e29 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:36.736933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be636344-1a0f-43f3-ad96-7f84ee768e29 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:36.738034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be636344-1a0f-43f3-ad96-7f84ee768e29 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:36.742074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be636344-1a0f-43f3-ad96-7f84ee768e29 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:36.744324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be636344-1a0f-43f3-ad96-7f84ee768e29 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:36.747686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be636344-1a0f-43f3-ad96-7f84ee768e29 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:37.083855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-be636344-1a0f-43f3-ad96-7f84ee768e29 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:37.099565 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-be636344-1a0f-43f3-ad96-7f84ee768e29 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:37.107390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-be636344-1a0f-43f3-ad96-7f84ee768e29 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:37.110611 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-be636344-1a0f-43f3-ad96-7f84ee768e29 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1266 microversion: 2.25 time: 0.408924 Oct 10 23:25:37.133575 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1157/2302] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:36 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1266 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:37.147616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b09cc1b6-6f73-4ebf-8966-9252282a215b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:37.148550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b09cc1b6-6f73-4ebf-8966-9252282a215b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:37.177797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b09cc1b6-6f73-4ebf-8966-9252282a215b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:37.184251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b09cc1b6-6f73-4ebf-8966-9252282a215b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:37.185050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b09cc1b6-6f73-4ebf-8966-9252282a215b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:37.185868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b09cc1b6-6f73-4ebf-8966-9252282a215b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:37.186347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b09cc1b6-6f73-4ebf-8966-9252282a215b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:37.188785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b09cc1b6-6f73-4ebf-8966-9252282a215b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:37.304151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=8 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:25:37.403100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b09cc1b6-6f73-4ebf-8966-9252282a215b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:37.426852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b09cc1b6-6f73-4ebf-8966-9252282a215b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:37.428384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b09cc1b6-6f73-4ebf-8966-9252282a215b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:37.481924 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b09cc1b6-6f73-4ebf-8966-9252282a215b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.321927 Oct 10 23:25:37.482597 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1158/2303] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:37 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:37.523804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d242c98d-2e4e-4be7-9775-6d1bb354b995 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:37.547746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d242c98d-2e4e-4be7-9775-6d1bb354b995 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Request method failure captured: Oct 10 23:25:37.547746 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989/action HTTP/1.1 Oct 10 23:25:37.547746 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:25:37.547746 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:25:37.547746 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:25:37.547746 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 31 Oct 10 23:25:37.547746 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:25:37.547746 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:25:37.547746 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:25:37.547746 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:25:37.547746 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKmuZVE867-0n9QJjXfmVVavhIsQxkC6IV8mn1-VRQuxDMywRVVFwcEClOdOpSEI98-F1ZVRhxJys0flpTXUzRUXmoV9xjma-aQxaFMGJxv2EIyedFGTrmv8NPh9Qzwd3qHxchnmFKti6VSfFMq5R4YCYAIul7WLBBwwJR-zlvJIKBk Oct 10 23:25:37.547746 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:25:37.547746 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:25:37.547746 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:25:37.547746 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:25:37.547746 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:25:37.547746 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:25:37.547746 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: da6449b194674f3f937af77207f39b28 Oct 10 23:25:37.547746 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1244263607 Oct 10 23:25:37.547746 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:25:37.547746 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:25:37.556099 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da6449b194674f3f937af77207f39b28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da6449b194674f3f937af77207f39b28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da6449b194674f3f937af77207f39b28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da6449b194674f3f937af77207f39b28", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:25:37.556099 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1244263607 Oct 10 23:25:37.556099 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: da6449b194674f3f937af77207f39b28 Oct 10 23:25:37.556099 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1244263607 Oct 10 23:25:37.556099 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersAdminNegativeTestJSON-1244263607-project-admin Oct 10 23:25:37.556099 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:25:37.556099 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:25:37.556099 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 074e507895974ec8a4551b9b71fd70c5 Oct 10 23:25:37.556099 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1244263607-project-admin Oct 10 23:25:37.556099 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:25:37.556099 n-d-860864-2 devstack@n-api.service[120614]: {"os-resetState": {"state": 1}} Oct 10 23:25:37.556099 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:25:37.556099 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 10 23:25:37.558085 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'e47ddcc1-9723-4e88-8c1d-ded295d4e989', 'body': {'os-resetState': {'state': 1}}} Oct 10 23:25:37.558085 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:25:37.558085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:37.558085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:25:37.558085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:25:37.558085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:25:37.558085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:25:37.558085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 10 23:25:37.558085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:37.558085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 10 23:25:37.558085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 10 23:25:37.558085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:37.558085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 10 23:25:37.558085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 1 Oct 10 23:25:37.558085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:37.558085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:37.558085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:37.558085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:37.558085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:37.558085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:37.558085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:25:37.558085 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:25:37.560382 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:25:37.560382 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:25:37.560382 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:25:37.560382 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:25:37.560382 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:25:37.560382 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:25:37.560382 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:25:37.560382 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:25:37.560382 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 10 23:25:37.560382 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:37.560382 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:37.560382 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:37.560382 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:37.560382 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:37.560382 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:37.560382 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:25:37.560382 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:25:37.560382 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 10 23:25:37.560382 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:37.561346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d242c98d-2e4e-4be7-9775-6d1bb354b995 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:25:37.561346 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d242c98d-2e4e-4be7-9775-6d1bb354b995 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989/action" status: 400 len: 120 microversion: 2.1 time: 0.071766 Oct 10 23:25:37.568232 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1159/2304] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:25:37 2022] POST /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989/action => generated 120 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:25:37.579081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7f43c988-9a9a-48b5-9b2a-09d3d3a202f8 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:37.605598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7f43c988-9a9a-48b5-9b2a-09d3d3a202f8 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Failed to fetch instance by id 999 {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 10 23:25:37.606182 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-7f43c988-9a9a-48b5-9b2a-09d3d3a202f8 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 10 23:25:37.613920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7f43c988-9a9a-48b5-9b2a-09d3d3a202f8 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Request method failure captured: Oct 10 23:25:37.613920 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 10 23:25:37.613920 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:25:37.613920 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:25:37.613920 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:25:37.613920 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 37 Oct 10 23:25:37.613920 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:25:37.613920 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:25:37.613920 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:25:37.613920 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:25:37.613920 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKmuZVE867-0n9QJjXfmVVavhIsQxkC6IV8mn1-VRQuxDMywRVVFwcEClOdOpSEI98-F1ZVRhxJys0flpTXUzRUXmoV9xjma-aQxaFMGJxv2EIyedFGTrmv8NPh9Qzwd3qHxchnmFKti6VSfFMq5R4YCYAIul7WLBBwwJR-zlvJIKBk Oct 10 23:25:37.613920 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:25:37.613920 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:25:37.613920 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:25:37.613920 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:25:37.613920 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:25:37.613920 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:25:37.613920 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: da6449b194674f3f937af77207f39b28 Oct 10 23:25:37.613920 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1244263607 Oct 10 23:25:37.613920 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:25:37.613920 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:25:37.615188 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/da6449b194674f3f937af77207f39b28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da6449b194674f3f937af77207f39b28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/da6449b194674f3f937af77207f39b28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_da6449b194674f3f937af77207f39b28", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:25:37.615188 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1244263607 Oct 10 23:25:37.615188 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: da6449b194674f3f937af77207f39b28 Oct 10 23:25:37.615188 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1244263607 Oct 10 23:25:37.615188 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersAdminNegativeTestJSON-1244263607-project-admin Oct 10 23:25:37.615188 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:25:37.615188 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:25:37.615188 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 074e507895974ec8a4551b9b71fd70c5 Oct 10 23:25:37.615188 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1244263607-project-admin Oct 10 23:25:37.615188 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:25:37.615188 n-d-860864-2 devstack@n-api.service[120614]: {"os-resetState": {"state": "error"}} Oct 10 23:25:37.615188 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:25:37.615188 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 999 could not be found. Oct 10 23:25:37.615907 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 10 23:25:37.615907 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:25:37.615907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:37.615907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:25:37.615907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:25:37.615907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 10 23:25:37.615907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 10 23:25:37.615907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 10 23:25:37.615907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:37.615907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:37.615907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:37.615907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:37.615907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:37.615907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:37.615907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:25:37.615907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:25:37.615907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:25:37.615907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:25:37.615907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:25:37.615907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:25:37.615907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 10 23:25:37.617127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 10 23:25:37.617127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:25:37.617127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:25:37.617127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 10 23:25:37.617127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:37.617127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:37.617127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:37.617127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:37.617127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:37.617127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:37.617127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:25:37.617127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:25:37.617127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 10 23:25:37.617127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:37.617127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7f43c988-9a9a-48b5-9b2a-09d3d3a202f8 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:25:37.617127 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7f43c988-9a9a-48b5-9b2a-09d3d3a202f8 tempest-ServersAdminNegativeTestJSON-1244263607 tempest-ServersAdminNegativeTestJSON-1244263607-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.046769 Oct 10 23:25:37.618030 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1160/2305] 10.222.0.23 () {60 vars in 1179 bytes} [Mon Oct 10 23:25:37 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:25:37.644368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f82f76ed-b43a-48c6-b672-13c618969356 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:37.653637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f82f76ed-b43a-48c6-b672-13c618969356 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:37.672450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f82f76ed-b43a-48c6-b672-13c618969356 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:37.672450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f82f76ed-b43a-48c6-b672-13c618969356 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:37.672450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f82f76ed-b43a-48c6-b672-13c618969356 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:37.672450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f82f76ed-b43a-48c6-b672-13c618969356 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:37.678691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f82f76ed-b43a-48c6-b672-13c618969356 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:37.678691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f82f76ed-b43a-48c6-b672-13c618969356 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:37.697739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:25:37.702450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f82f76ed-b43a-48c6-b672-13c618969356 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:25:37.819995 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f82f76ed-b43a-48c6-b672-13c618969356 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 204 len: 0 microversion: 2.1 time: 0.190486 Oct 10 23:25:37.823601 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1161/2306] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:25:37 2022] DELETE /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:25:37.839555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cee47c89-dc33-49cd-a5ed-24bffc5319b7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:37.847391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cee47c89-dc33-49cd-a5ed-24bffc5319b7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] [instance: d3873d3f-2b48-4d60-b076-6b2bf69591b2] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:37.861202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cee47c89-dc33-49cd-a5ed-24bffc5319b7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:37.862027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cee47c89-dc33-49cd-a5ed-24bffc5319b7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:37.863317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cee47c89-dc33-49cd-a5ed-24bffc5319b7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:37.864276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cee47c89-dc33-49cd-a5ed-24bffc5319b7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:37.865025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cee47c89-dc33-49cd-a5ed-24bffc5319b7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:37.865656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cee47c89-dc33-49cd-a5ed-24bffc5319b7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:38.479548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:25:38.508517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cee47c89-dc33-49cd-a5ed-24bffc5319b7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:38.523754 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cee47c89-dc33-49cd-a5ed-24bffc5319b7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:38.528092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cee47c89-dc33-49cd-a5ed-24bffc5319b7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:38.529540 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cee47c89-dc33-49cd-a5ed-24bffc5319b7 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] 10.222.0.23 "GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2" status: 200 len: 1359 microversion: 2.21 time: 0.704464 Oct 10 23:25:38.530998 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1162/2307] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:37 2022] GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2 => generated 1359 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:38.539551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-8ae18881-0c1d-48f1-a904-f51576e6fb4d req-9cd04b02-fb5b-40a9-bfe7-65c9af288387 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3873d3f-2b48-4d60-b076-6b2bf69591b2", "tag": "94befed5-51d0-4492-b73a-e591196ece3a"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:38.551888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8ae18881-0c1d-48f1-a904-f51576e6fb4d req-9cd04b02-fb5b-40a9-bfe7-65c9af288387 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:38.552615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8ae18881-0c1d-48f1-a904-f51576e6fb4d req-9cd04b02-fb5b-40a9-bfe7-65c9af288387 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:38.553345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8ae18881-0c1d-48f1-a904-f51576e6fb4d req-9cd04b02-fb5b-40a9-bfe7-65c9af288387 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:38.581651 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-8ae18881-0c1d-48f1-a904-f51576e6fb4d req-9cd04b02-fb5b-40a9-bfe7-65c9af288387 service nova] Creating event network-changed:94befed5-51d0-4492-b73a-e591196ece3a for instance d3873d3f-2b48-4d60-b076-6b2bf69591b2 on n-h1-860864-2 Oct 10 23:25:38.599915 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-8ae18881-0c1d-48f1-a904-f51576e6fb4d req-9cd04b02-fb5b-40a9-bfe7-65c9af288387 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065619 Oct 10 23:25:38.609767 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1163/2308] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:25:38.622350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-02d0f258-b0a0-4caa-b3e5-9e958b23a56c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:38.623292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-02d0f258-b0a0-4caa-b3e5-9e958b23a56c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:38.637448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02d0f258-b0a0-4caa-b3e5-9e958b23a56c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:38.643541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02d0f258-b0a0-4caa-b3e5-9e958b23a56c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:38.643541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02d0f258-b0a0-4caa-b3e5-9e958b23a56c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:38.643541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02d0f258-b0a0-4caa-b3e5-9e958b23a56c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:38.649668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02d0f258-b0a0-4caa-b3e5-9e958b23a56c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:38.650249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02d0f258-b0a0-4caa-b3e5-9e958b23a56c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:38.704460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:25:39.261072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-02d0f258-b0a0-4caa-b3e5-9e958b23a56c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:39.277572 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-02d0f258-b0a0-4caa-b3e5-9e958b23a56c tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 200 len: 1467 microversion: 2.1 time: 0.666065 Oct 10 23:25:39.287740 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1164/2309] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:38 2022] GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 1467 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:39.297167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f558865c-607f-4e09-b03b-99ce403319fc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:39.297938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f558865c-607f-4e09-b03b-99ce403319fc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:39.325061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:25:39.334313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f558865c-607f-4e09-b03b-99ce403319fc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:39.334821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f558865c-607f-4e09-b03b-99ce403319fc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:39.335268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f558865c-607f-4e09-b03b-99ce403319fc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:39.335986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f558865c-607f-4e09-b03b-99ce403319fc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:39.336447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f558865c-607f-4e09-b03b-99ce403319fc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:39.336870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f558865c-607f-4e09-b03b-99ce403319fc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:39.341627 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a7e1ca87-1dad-43c7-b255-b2f074226d24 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510" status: 200 len: 1439 microversion: 2.1 time: 10.584664 Oct 10 23:25:39.342253 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1146/2310] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:25:28 2022] GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510 => generated 1439 bytes in 10586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:39.366950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f5d4972b-ce61-433c-9a48-a1428c3175b0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:39.368128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f5d4972b-ce61-433c-9a48-a1428c3175b0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:39.394136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5d4972b-ce61-433c-9a48-a1428c3175b0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:39.396854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5d4972b-ce61-433c-9a48-a1428c3175b0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:39.397332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5d4972b-ce61-433c-9a48-a1428c3175b0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:39.398125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5d4972b-ce61-433c-9a48-a1428c3175b0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:39.403732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5d4972b-ce61-433c-9a48-a1428c3175b0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:39.407537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5d4972b-ce61-433c-9a48-a1428c3175b0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:39.504346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f558865c-607f-4e09-b03b-99ce403319fc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:39.517769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f558865c-607f-4e09-b03b-99ce403319fc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:39.522972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f558865c-607f-4e09-b03b-99ce403319fc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:39.531870 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f558865c-607f-4e09-b03b-99ce403319fc tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1266 microversion: 2.25 time: 0.240105 Oct 10 23:25:39.533254 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1165/2311] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:39 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:39.558083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b15c86f9-a776-498e-bd96-fa94cbd9ea77 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:39.558799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b15c86f9-a776-498e-bd96-fa94cbd9ea77 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] [instance: d3873d3f-2b48-4d60-b076-6b2bf69591b2] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:39.559366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f5d4972b-ce61-433c-9a48-a1428c3175b0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:39.572736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b15c86f9-a776-498e-bd96-fa94cbd9ea77 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:39.575894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f5d4972b-ce61-433c-9a48-a1428c3175b0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:39.579937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f5d4972b-ce61-433c-9a48-a1428c3175b0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:39.583215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b15c86f9-a776-498e-bd96-fa94cbd9ea77 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:39.583726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b15c86f9-a776-498e-bd96-fa94cbd9ea77 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:39.584490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b15c86f9-a776-498e-bd96-fa94cbd9ea77 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:39.584968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b15c86f9-a776-498e-bd96-fa94cbd9ea77 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:39.585422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b15c86f9-a776-498e-bd96-fa94cbd9ea77 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:39.597322 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f5d4972b-ce61-433c-9a48-a1428c3175b0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.253991 Oct 10 23:25:39.602944 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1147/2312] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:39 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:39.955645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b15c86f9-a776-498e-bd96-fa94cbd9ea77 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:39.970644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b15c86f9-a776-498e-bd96-fa94cbd9ea77 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:39.974240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b15c86f9-a776-498e-bd96-fa94cbd9ea77 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:39.977863 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b15c86f9-a776-498e-bd96-fa94cbd9ea77 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] 10.222.0.23 "GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2" status: 200 len: 1359 microversion: 2.21 time: 0.423976 Oct 10 23:25:39.979098 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1166/2313] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:39 2022] GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2 => generated 1359 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:40.317192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-466fb3c5-017c-4bca-ae39-bbbe0f93dfd2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:40.326114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-466fb3c5-017c-4bca-ae39-bbbe0f93dfd2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:40.356238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-466fb3c5-017c-4bca-ae39-bbbe0f93dfd2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:40.356733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-466fb3c5-017c-4bca-ae39-bbbe0f93dfd2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:40.357179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-466fb3c5-017c-4bca-ae39-bbbe0f93dfd2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:40.359868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b18ffb07-40aa-4302-94de-75ef60950f91 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662a818160>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:40.368968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-466fb3c5-017c-4bca-ae39-bbbe0f93dfd2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:40.378171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-466fb3c5-017c-4bca-ae39-bbbe0f93dfd2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:40.379236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-466fb3c5-017c-4bca-ae39-bbbe0f93dfd2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:40.483940 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b18ffb07-40aa-4302-94de-75ef60950f91 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510" status: 200 len: 1439 microversion: 2.1 time: 0.129275 Oct 10 23:25:40.486938 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1167/2314] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:25:40 2022] GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510 => generated 1439 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:40.567358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-18d089a0-506f-4db0-ad88-b34b4ebe1617 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:40.570346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-18d089a0-506f-4db0-ad88-b34b4ebe1617 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:40.603960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-18d089a0-506f-4db0-ad88-b34b4ebe1617 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:40.610316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-18d089a0-506f-4db0-ad88-b34b4ebe1617 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:40.611043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-18d089a0-506f-4db0-ad88-b34b4ebe1617 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:40.611982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-18d089a0-506f-4db0-ad88-b34b4ebe1617 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:40.620786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-18d089a0-506f-4db0-ad88-b34b4ebe1617 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:40.621639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-18d089a0-506f-4db0-ad88-b34b4ebe1617 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:40.733816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-18d089a0-506f-4db0-ad88-b34b4ebe1617 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:40.735115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-18d089a0-506f-4db0-ad88-b34b4ebe1617 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:40.735779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-18d089a0-506f-4db0-ad88-b34b4ebe1617 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:40.736469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-18d089a0-506f-4db0-ad88-b34b4ebe1617 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lazy-loading 'fault' on Instance uuid 3a472045-8c28-4437-9e0f-9223369022ae {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:25:40.793936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-466fb3c5-017c-4bca-ae39-bbbe0f93dfd2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:40.808319 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-466fb3c5-017c-4bca-ae39-bbbe0f93dfd2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 200 len: 1467 microversion: 2.1 time: 0.501477 Oct 10 23:25:40.809734 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1148/2315] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:40 2022] GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 1467 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:40.822932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6c290b8e-757a-4bec-8c80-d046352df1e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:40.826127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6c290b8e-757a-4bec-8c80-d046352df1e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:40.838761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c290b8e-757a-4bec-8c80-d046352df1e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:40.839282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c290b8e-757a-4bec-8c80-d046352df1e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:40.839723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c290b8e-757a-4bec-8c80-d046352df1e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:40.840459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c290b8e-757a-4bec-8c80-d046352df1e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:40.840915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c290b8e-757a-4bec-8c80-d046352df1e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:40.841341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c290b8e-757a-4bec-8c80-d046352df1e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:40.937169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-18d089a0-506f-4db0-ad88-b34b4ebe1617 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:40.949257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-18d089a0-506f-4db0-ad88-b34b4ebe1617 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:40.955926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-18d089a0-506f-4db0-ad88-b34b4ebe1617 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:40.959714 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-18d089a0-506f-4db0-ad88-b34b4ebe1617 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1271 microversion: 2.25 time: 0.403642 Oct 10 23:25:40.963047 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1168/2316] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:40 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1271 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:40.971772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6c290b8e-757a-4bec-8c80-d046352df1e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:40.993625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6c290b8e-757a-4bec-8c80-d046352df1e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:40.997800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6c290b8e-757a-4bec-8c80-d046352df1e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:41.008193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9e92de22-bc64-4ba7-b31f-75f5655e88dd tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:41.009587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9e92de22-bc64-4ba7-b31f-75f5655e88dd tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] [instance: d3873d3f-2b48-4d60-b076-6b2bf69591b2] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:41.018396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e92de22-bc64-4ba7-b31f-75f5655e88dd tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:41.020585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e92de22-bc64-4ba7-b31f-75f5655e88dd tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:41.022824 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6c290b8e-757a-4bec-8c80-d046352df1e3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.211560 Oct 10 23:25:41.023593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e92de22-bc64-4ba7-b31f-75f5655e88dd tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:41.024864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e92de22-bc64-4ba7-b31f-75f5655e88dd tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:41.038735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e92de22-bc64-4ba7-b31f-75f5655e88dd tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:41.039249 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1149/2317] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:40 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:41.040107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e92de22-bc64-4ba7-b31f-75f5655e88dd tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:41.324079 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9e92de22-bc64-4ba7-b31f-75f5655e88dd tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:41.333495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9e92de22-bc64-4ba7-b31f-75f5655e88dd tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:41.334961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9e92de22-bc64-4ba7-b31f-75f5655e88dd tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:41.336153 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9e92de22-bc64-4ba7-b31f-75f5655e88dd tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] 10.222.0.23 "GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2" status: 200 len: 1359 microversion: 2.21 time: 0.331926 Oct 10 23:25:41.336676 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1169/2318] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:41 2022] GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2 => generated 1359 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:41.501281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-56c4d0f3-e2f1-4cb9-a673-1125b9611933 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662ad331f0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:41.587104 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-56c4d0f3-e2f1-4cb9-a673-1125b9611933 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510" status: 200 len: 1439 microversion: 2.1 time: 0.089750 Oct 10 23:25:41.588116 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1150/2319] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:25:41 2022] GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510 => generated 1439 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:41.840724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aeec3497-f407-42aa-90fd-00c6706f83a2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:41.842059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aeec3497-f407-42aa-90fd-00c6706f83a2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:41.866655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeec3497-f407-42aa-90fd-00c6706f83a2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:41.870184 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeec3497-f407-42aa-90fd-00c6706f83a2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:41.870924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeec3497-f407-42aa-90fd-00c6706f83a2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:41.872112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeec3497-f407-42aa-90fd-00c6706f83a2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:41.872775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeec3497-f407-42aa-90fd-00c6706f83a2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:41.876127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeec3497-f407-42aa-90fd-00c6706f83a2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:41.992108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-557d9096-197b-4f6a-95db-911e5836f22b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:41.992932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-557d9096-197b-4f6a-95db-911e5836f22b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:42.030881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-557d9096-197b-4f6a-95db-911e5836f22b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:42.033886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-557d9096-197b-4f6a-95db-911e5836f22b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:42.040769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-557d9096-197b-4f6a-95db-911e5836f22b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:42.049784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-557d9096-197b-4f6a-95db-911e5836f22b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:42.051073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-557d9096-197b-4f6a-95db-911e5836f22b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:42.069469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-557d9096-197b-4f6a-95db-911e5836f22b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:42.321562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aeec3497-f407-42aa-90fd-00c6706f83a2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:42.331847 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-557d9096-197b-4f6a-95db-911e5836f22b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:42.332757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-557d9096-197b-4f6a-95db-911e5836f22b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:42.333559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-557d9096-197b-4f6a-95db-911e5836f22b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:42.334397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-557d9096-197b-4f6a-95db-911e5836f22b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lazy-loading 'fault' on Instance uuid 3a472045-8c28-4437-9e0f-9223369022ae {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:25:42.374571 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aeec3497-f407-42aa-90fd-00c6706f83a2 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 200 len: 1425 microversion: 2.1 time: 0.543679 Oct 10 23:25:42.390000 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1170/2320] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:41 2022] GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 1425 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:42.418010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9daee3c7-5b0d-4f80-9b4b-8f23bcafa0a8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:42.419557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9daee3c7-5b0d-4f80-9b4b-8f23bcafa0a8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:42.441955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9daee3c7-5b0d-4f80-9b4b-8f23bcafa0a8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:42.446562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9daee3c7-5b0d-4f80-9b4b-8f23bcafa0a8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:42.447286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9daee3c7-5b0d-4f80-9b4b-8f23bcafa0a8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:42.448888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9daee3c7-5b0d-4f80-9b4b-8f23bcafa0a8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:42.449367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9daee3c7-5b0d-4f80-9b4b-8f23bcafa0a8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:42.449820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9daee3c7-5b0d-4f80-9b4b-8f23bcafa0a8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:42.472882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-557d9096-197b-4f6a-95db-911e5836f22b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:42.497180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-557d9096-197b-4f6a-95db-911e5836f22b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:42.506209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-557d9096-197b-4f6a-95db-911e5836f22b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:42.509227 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-557d9096-197b-4f6a-95db-911e5836f22b tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 200 len: 1271 microversion: 2.25 time: 0.521237 Oct 10 23:25:42.517752 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1151/2321] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:41 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 1271 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:42.531343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-62479ff0-e06e-458d-ac30-eacf86c78248 req-783c797c-d4fe-4283-9e75-04c25044d79d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c6f9198-4d2e-4064-9648-8136d5b0f14d", "name": "network-vif-deleted", "tag": "61fd4e90-e896-45d8-8b8f-094125dac88f"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:42.570067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-62479ff0-e06e-458d-ac30-eacf86c78248 req-783c797c-d4fe-4283-9e75-04c25044d79d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:42.570505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-62479ff0-e06e-458d-ac30-eacf86c78248 req-783c797c-d4fe-4283-9e75-04c25044d79d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:42.570948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-62479ff0-e06e-458d-ac30-eacf86c78248 req-783c797c-d4fe-4283-9e75-04c25044d79d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:42.607925 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-62479ff0-e06e-458d-ac30-eacf86c78248 req-783c797c-d4fe-4283-9e75-04c25044d79d service nova] Creating event network-vif-deleted:61fd4e90-e896-45d8-8b8f-094125dac88f for instance 6c6f9198-4d2e-4064-9648-8136d5b0f14d on n-h2-860864-2 Oct 10 23:25:42.617403 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-62479ff0-e06e-458d-ac30-eacf86c78248 req-783c797c-d4fe-4283-9e75-04c25044d79d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098221 Oct 10 23:25:42.623147 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1152/2322] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:25:42.635294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0ce72d98-22e4-4f0d-b307-1dbce4744050 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:42.636429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0ce72d98-22e4-4f0d-b307-1dbce4744050 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] [instance: d3873d3f-2b48-4d60-b076-6b2bf69591b2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:42.659652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ce72d98-22e4-4f0d-b307-1dbce4744050 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:42.661335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ce72d98-22e4-4f0d-b307-1dbce4744050 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:42.663152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ce72d98-22e4-4f0d-b307-1dbce4744050 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:42.664290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ce72d98-22e4-4f0d-b307-1dbce4744050 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:42.665990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ce72d98-22e4-4f0d-b307-1dbce4744050 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:42.667272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ce72d98-22e4-4f0d-b307-1dbce4744050 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:42.998726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9daee3c7-5b0d-4f80-9b4b-8f23bcafa0a8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:43.016610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9daee3c7-5b0d-4f80-9b4b-8f23bcafa0a8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:43.023279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9daee3c7-5b0d-4f80-9b4b-8f23bcafa0a8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:43.050522 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9daee3c7-5b0d-4f80-9b4b-8f23bcafa0a8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.650333 Oct 10 23:25:43.067127 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1171/2323] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:42 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:43.090898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-10c02914-bdfe-4080-a8ca-50b9c9924be1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662a7db9d0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:43.098081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0ce72d98-22e4-4f0d-b307-1dbce4744050 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:43.130328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0ce72d98-22e4-4f0d-b307-1dbce4744050 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:43.132090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0ce72d98-22e4-4f0d-b307-1dbce4744050 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:43.135675 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0ce72d98-22e4-4f0d-b307-1dbce4744050 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] 10.222.0.23 "GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2" status: 200 len: 1359 microversion: 2.21 time: 0.511000 Oct 10 23:25:43.136277 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1153/2324] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:42 2022] GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2 => generated 1359 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:43.418296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-905823a4-10bb-4ca9-b654-fb803f2cab4e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:43.418914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-905823a4-10bb-4ca9-b654-fb803f2cab4e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:43.435738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-905823a4-10bb-4ca9-b654-fb803f2cab4e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:43.436476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-905823a4-10bb-4ca9-b654-fb803f2cab4e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:43.436914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-905823a4-10bb-4ca9-b654-fb803f2cab4e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:43.438324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-905823a4-10bb-4ca9-b654-fb803f2cab4e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:43.438918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-905823a4-10bb-4ca9-b654-fb803f2cab4e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:43.473203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-905823a4-10bb-4ca9-b654-fb803f2cab4e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:43.571509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-905823a4-10bb-4ca9-b654-fb803f2cab4e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:43.572579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-905823a4-10bb-4ca9-b654-fb803f2cab4e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:43.573758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-905823a4-10bb-4ca9-b654-fb803f2cab4e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:43.574765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-905823a4-10bb-4ca9-b654-fb803f2cab4e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lazy-loading 'fault' on Instance uuid 6c6f9198-4d2e-4064-9648-8136d5b0f14d {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:25:43.701039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-905823a4-10bb-4ca9-b654-fb803f2cab4e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:43.717530 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-905823a4-10bb-4ca9-b654-fb803f2cab4e tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 200 len: 1311 microversion: 2.1 time: 0.301541 Oct 10 23:25:43.719295 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1154/2325] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:43 2022] GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 1311 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:43.737285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4cb3976a-f66a-4392-a819-94b12b3ea7f1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:43.739166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4cb3976a-f66a-4392-a819-94b12b3ea7f1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 3a472045-8c28-4437-9e0f-9223369022ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:43.756766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cb3976a-f66a-4392-a819-94b12b3ea7f1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:43.757615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cb3976a-f66a-4392-a819-94b12b3ea7f1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:43.758257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cb3976a-f66a-4392-a819-94b12b3ea7f1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:43.759469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cb3976a-f66a-4392-a819-94b12b3ea7f1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:43.760265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cb3976a-f66a-4392-a819-94b12b3ea7f1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:43.760888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cb3976a-f66a-4392-a819-94b12b3ea7f1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:43.797953 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-4cb3976a-f66a-4392-a819-94b12b3ea7f1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] HTTP exception thrown: Instance 3a472045-8c28-4437-9e0f-9223369022ae could not be found. Oct 10 23:25:43.802636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4cb3976a-f66a-4392-a819-94b12b3ea7f1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Request method failure captured: Oct 10 23:25:43.802636 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae HTTP/1.1 Oct 10 23:25:43.802636 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:25:43.802636 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:25:43.802636 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:25:43.802636 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:25:43.802636 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:25:43.802636 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:25:43.802636 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:25:43.802636 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:25:43.802636 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKhZqIZA1oxOMX1OC1eOcdSguIJ_DulQxWj0Ue5q2p6UJYynRs89rlsdOHCTgWuGarrq4XPbdbJi1lOyN-sFKr9LDc3gLipfATB9fn3ccS9-q8j95xGd72XVQGzBCOv5WgjoJZH2hsshWwYRnCabpt4eWaX-xLDLlHvOK7BYGfK1cjo Oct 10 23:25:43.802636 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:25:43.802636 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:25:43.802636 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:25:43.802636 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:25:43.802636 n-d-860864-2 devstack@n-api.service[120613]: X-Openstack-Nova-Api-Version: 2.25 Oct 10 23:25:43.802636 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:25:43.802636 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:25:43.802636 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 01ebbb0c057c44be8b51615d59209d90 Oct 10 23:25:43.802636 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1185304471 Oct 10 23:25:43.802636 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:25:43.802636 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:25:43.804377 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/01ebbb0c057c44be8b51615d59209d90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/01ebbb0c057c44be8b51615d59209d90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/01ebbb0c057c44be8b51615d59209d90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_01ebbb0c057c44be8b51615d59209d90", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:25:43.804377 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1185304471 Oct 10 23:25:43.804377 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 01ebbb0c057c44be8b51615d59209d90 Oct 10 23:25:43.804377 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1185304471 Oct 10 23:25:43.804377 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-LiveAutoBlockMigrationV225Test-1185304471-project Oct 10 23:25:43.804377 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:25:43.804377 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:25:43.804377 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: fabfd9ac67b645bf9234590b623c27b0 Oct 10 23:25:43.804377 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1185304471-project Oct 10 23:25:43.804377 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:25:43.804377 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 3a472045-8c28-4437-9e0f-9223369022ae could not be found. Oct 10 23:25:43.804377 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '3a472045-8c28-4437-9e0f-9223369022ae'} Oct 10 23:25:43.805231 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:25:43.805231 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:43.805231 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:25:43.805231 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:25:43.805231 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:25:43.805231 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:25:43.805231 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:25:43.805231 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:25:43.805231 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:25:43.805231 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:25:43.805231 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a472045-8c28-4437-9e0f-9223369022ae could not be found. Oct 10 23:25:43.805231 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:43.805231 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:43.805231 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:43.805231 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:43.805231 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:43.805231 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:43.805231 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:25:43.805231 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:25:43.805231 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:25:43.806728 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:25:43.806728 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:25:43.806728 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:25:43.806728 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:25:43.806728 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:25:43.806728 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:25:43.806728 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:25:43.806728 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a472045-8c28-4437-9e0f-9223369022ae could not be found. Oct 10 23:25:43.806728 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:43.806728 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:43.806728 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:43.806728 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:43.806728 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:43.806728 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:43.806728 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:25:43.806728 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:25:43.806728 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a472045-8c28-4437-9e0f-9223369022ae could not be found. Oct 10 23:25:43.806728 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:43.809153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4cb3976a-f66a-4392-a819-94b12b3ea7f1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Returning 404 to user: Instance 3a472045-8c28-4437-9e0f-9223369022ae could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:25:43.814590 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4cb3976a-f66a-4392-a819-94b12b3ea7f1 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae" status: 404 len: 111 microversion: 2.25 time: 0.093849 Oct 10 23:25:43.815408 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1155/2326] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:43 2022] GET /compute/v2.1/servers/3a472045-8c28-4437-9e0f-9223369022ae => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:25:44.087891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-24bfaf41-e5ab-4a45-922c-e60f107a2d61 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:44.088529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-24bfaf41-e5ab-4a45-922c-e60f107a2d61 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:44.102045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24bfaf41-e5ab-4a45-922c-e60f107a2d61 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:44.104215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24bfaf41-e5ab-4a45-922c-e60f107a2d61 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:44.106525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24bfaf41-e5ab-4a45-922c-e60f107a2d61 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:44.107604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24bfaf41-e5ab-4a45-922c-e60f107a2d61 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:44.114108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24bfaf41-e5ab-4a45-922c-e60f107a2d61 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:44.115117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24bfaf41-e5ab-4a45-922c-e60f107a2d61 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:44.279556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-24bfaf41-e5ab-4a45-922c-e60f107a2d61 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:44.308536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-24bfaf41-e5ab-4a45-922c-e60f107a2d61 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:44.310141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-24bfaf41-e5ab-4a45-922c-e60f107a2d61 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:44.362929 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-24bfaf41-e5ab-4a45-922c-e60f107a2d61 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.277835 Oct 10 23:25:44.369574 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1156/2327] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:44 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:44.382717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-55f14325-f022-42ae-80b2-6b20446004bb tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:44.392277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-55f14325-f022-42ae-80b2-6b20446004bb tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] [instance: d3873d3f-2b48-4d60-b076-6b2bf69591b2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:44.411336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55f14325-f022-42ae-80b2-6b20446004bb tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:44.412460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55f14325-f022-42ae-80b2-6b20446004bb tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:44.415138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55f14325-f022-42ae-80b2-6b20446004bb tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:44.417931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55f14325-f022-42ae-80b2-6b20446004bb tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:44.419781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55f14325-f022-42ae-80b2-6b20446004bb tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:44.420614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55f14325-f022-42ae-80b2-6b20446004bb tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:44.459951 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-10c02914-bdfe-4080-a8ca-50b9c9924be1 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510" status: 200 len: 1439 microversion: 2.1 time: 1.388371 Oct 10 23:25:44.460582 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1172/2328] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:25:43 2022] GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510 => generated 1439 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:44.698323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-55f14325-f022-42ae-80b2-6b20446004bb tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:44.720122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-55f14325-f022-42ae-80b2-6b20446004bb tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:44.722558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-55f14325-f022-42ae-80b2-6b20446004bb tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:44.724384 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-55f14325-f022-42ae-80b2-6b20446004bb tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] 10.222.0.23 "GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2" status: 200 len: 1359 microversion: 2.21 time: 0.352630 Oct 10 23:25:44.735082 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1157/2329] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:44 2022] GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2 => generated 1359 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:44.748447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3899d7e6-8963-4a8f-82b7-c1715fb4d454 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:44.749308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3899d7e6-8963-4a8f-82b7-c1715fb4d454 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: 6c6f9198-4d2e-4064-9648-8136d5b0f14d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:44.768999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3899d7e6-8963-4a8f-82b7-c1715fb4d454 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:44.769845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3899d7e6-8963-4a8f-82b7-c1715fb4d454 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:44.770495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3899d7e6-8963-4a8f-82b7-c1715fb4d454 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:44.771410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3899d7e6-8963-4a8f-82b7-c1715fb4d454 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:44.772066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3899d7e6-8963-4a8f-82b7-c1715fb4d454 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:44.772830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3899d7e6-8963-4a8f-82b7-c1715fb4d454 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:44.796498 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-3899d7e6-8963-4a8f-82b7-c1715fb4d454 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] HTTP exception thrown: Instance 6c6f9198-4d2e-4064-9648-8136d5b0f14d could not be found. Oct 10 23:25:44.798345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3899d7e6-8963-4a8f-82b7-c1715fb4d454 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Request method failure captured: Oct 10 23:25:44.798345 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d HTTP/1.1 Oct 10 23:25:44.798345 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:25:44.798345 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:25:44.798345 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:25:44.798345 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:25:44.798345 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:25:44.798345 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:25:44.798345 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:25:44.798345 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:25:44.798345 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKmtYmUE_lup66dv5kMP14Di29cC5lLuI-_dfozACS2uvVCG2Vztg-zyzoj8bq-JCh1KcsiFX6oi_6pz1AKx4uc3ZZJ9wTtn2-GBsa2oiCH57UVDJ52qKCfoOU5c50FaJtlDQvnmeDeC7O-8fo0Zfnd_1eA_mynaUmPGNbPoYtqNmaI Oct 10 23:25:44.798345 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:25:44.798345 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:25:44.798345 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:25:44.798345 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:25:44.798345 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:25:44.798345 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:25:44.798345 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: b6f65dbe8455479391d42d0a97fa1305 Oct 10 23:25:44.798345 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1015997903 Oct 10 23:25:44.798345 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:25:44.798345 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:25:44.799522 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b6f65dbe8455479391d42d0a97fa1305"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b6f65dbe8455479391d42d0a97fa1305"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b6f65dbe8455479391d42d0a97fa1305"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b6f65dbe8455479391d42d0a97fa1305", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:25:44.799522 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1015997903 Oct 10 23:25:44.799522 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: b6f65dbe8455479391d42d0a97fa1305 Oct 10 23:25:44.799522 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1015997903 Oct 10 23:25:44.799522 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersAdminNegativeTestJSON-1015997903-project Oct 10 23:25:44.799522 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:25:44.799522 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:25:44.799522 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: be8faa9362e94ceab173df40b3008af1 Oct 10 23:25:44.799522 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1015997903-project Oct 10 23:25:44.799522 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:25:44.799522 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 6c6f9198-4d2e-4064-9648-8136d5b0f14d could not be found. Oct 10 23:25:44.799522 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '6c6f9198-4d2e-4064-9648-8136d5b0f14d'} Oct 10 23:25:44.800190 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:25:44.800190 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:44.800190 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:25:44.800190 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:25:44.800190 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:25:44.800190 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:25:44.800190 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:25:44.800190 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:25:44.800190 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:25:44.800190 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:25:44.800190 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c6f9198-4d2e-4064-9648-8136d5b0f14d could not be found. Oct 10 23:25:44.800190 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:44.800190 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:44.800190 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:44.800190 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:44.800190 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:44.800190 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:44.800190 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:25:44.800190 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:25:44.800190 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:25:44.801359 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:25:44.801359 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:25:44.801359 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:25:44.801359 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:25:44.801359 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:25:44.801359 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:25:44.801359 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:25:44.801359 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c6f9198-4d2e-4064-9648-8136d5b0f14d could not be found. Oct 10 23:25:44.801359 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:44.801359 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:44.801359 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:44.801359 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:44.801359 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:44.801359 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:44.801359 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:25:44.801359 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:25:44.801359 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c6f9198-4d2e-4064-9648-8136d5b0f14d could not be found. Oct 10 23:25:44.801359 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:44.804865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3899d7e6-8963-4a8f-82b7-c1715fb4d454 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Returning 404 to user: Instance 6c6f9198-4d2e-4064-9648-8136d5b0f14d could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:25:44.806052 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3899d7e6-8963-4a8f-82b7-c1715fb4d454 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d" status: 404 len: 111 microversion: 2.1 time: 0.064793 Oct 10 23:25:44.807122 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1158/2330] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:44 2022] GET /compute/v2.1/servers/6c6f9198-4d2e-4064-9648-8136d5b0f14d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:25:44.825242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2e2bfcc5-6289-4546-a944-56c6cbf25d84 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:44.826016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2e2bfcc5-6289-4546-a944-56c6cbf25d84 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: e47ddcc1-9723-4e88-8c1d-ded295d4e989] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:44.833721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e2bfcc5-6289-4546-a944-56c6cbf25d84 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:44.834691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e2bfcc5-6289-4546-a944-56c6cbf25d84 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:44.835425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e2bfcc5-6289-4546-a944-56c6cbf25d84 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:44.836444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e2bfcc5-6289-4546-a944-56c6cbf25d84 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:44.837288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e2bfcc5-6289-4546-a944-56c6cbf25d84 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:44.837964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e2bfcc5-6289-4546-a944-56c6cbf25d84 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:44.881642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2e2bfcc5-6289-4546-a944-56c6cbf25d84 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: e47ddcc1-9723-4e88-8c1d-ded295d4e989] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:25:45.065461 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2e2bfcc5-6289-4546-a944-56c6cbf25d84 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989" status: 204 len: 0 microversion: 2.1 time: 0.250751 Oct 10 23:25:45.066236 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1159/2331] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:25:44 2022] DELETE /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:25:45.096224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ebe1bfd4-01dc-485f-b59b-4e390c39405b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:45.097550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ebe1bfd4-01dc-485f-b59b-4e390c39405b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: e47ddcc1-9723-4e88-8c1d-ded295d4e989] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:45.113208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebe1bfd4-01dc-485f-b59b-4e390c39405b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:45.115682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebe1bfd4-01dc-485f-b59b-4e390c39405b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:45.117215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebe1bfd4-01dc-485f-b59b-4e390c39405b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:45.118420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebe1bfd4-01dc-485f-b59b-4e390c39405b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:45.120812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebe1bfd4-01dc-485f-b59b-4e390c39405b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:45.121561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebe1bfd4-01dc-485f-b59b-4e390c39405b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:45.300186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5e63abba-04da-4886-9e7b-8b7a42a239da tempest-NetworksTest-1251948811 tempest-NetworksTest-1251948811-project-admin] Calling method '.version_select at 0x7f662a854ca0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:45.362885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ebe1bfd4-01dc-485f-b59b-4e390c39405b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:45.375437 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ebe1bfd4-01dc-485f-b59b-4e390c39405b tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989" status: 200 len: 1478 microversion: 2.1 time: 0.303206 Oct 10 23:25:45.380046 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1160/2332] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:45 2022] GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989 => generated 1478 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:45.416226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8df8a5c0-e4f5-4e63-b6e9-d60948b8122e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:45.417863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8df8a5c0-e4f5-4e63-b6e9-d60948b8122e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:45.442763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8df8a5c0-e4f5-4e63-b6e9-d60948b8122e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:45.455837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8df8a5c0-e4f5-4e63-b6e9-d60948b8122e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:45.456319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8df8a5c0-e4f5-4e63-b6e9-d60948b8122e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:45.457095 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8df8a5c0-e4f5-4e63-b6e9-d60948b8122e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:45.457608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8df8a5c0-e4f5-4e63-b6e9-d60948b8122e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:45.458043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8df8a5c0-e4f5-4e63-b6e9-d60948b8122e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:45.653002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8df8a5c0-e4f5-4e63-b6e9-d60948b8122e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:45.668885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8df8a5c0-e4f5-4e63-b6e9-d60948b8122e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:45.680985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8df8a5c0-e4f5-4e63-b6e9-d60948b8122e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:45.686401 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8df8a5c0-e4f5-4e63-b6e9-d60948b8122e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1531 microversion: 2.91 time: 0.289669 Oct 10 23:25:45.697472 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1161/2333] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:45 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1531 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:25:45.697472 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e7acd560-66d5-451a-8d9a-793b4f37e49b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662ae87160>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:45.778979 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e7acd560-66d5-451a-8d9a-793b4f37e49b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510" status: 200 len: 1439 microversion: 2.1 time: 0.089698 Oct 10 23:25:45.787243 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1162/2334] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:25:45 2022] GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510 => generated 1439 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:45.793877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3384ed6b-b697-40d9-9cc6-f39a03a0c484 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:45.794768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3384ed6b-b697-40d9-9cc6-f39a03a0c484 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:45.805139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3384ed6b-b697-40d9-9cc6-f39a03a0c484 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:45.805826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3384ed6b-b697-40d9-9cc6-f39a03a0c484 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:45.807094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3384ed6b-b697-40d9-9cc6-f39a03a0c484 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:45.808535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3384ed6b-b697-40d9-9cc6-f39a03a0c484 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:45.809350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3384ed6b-b697-40d9-9cc6-f39a03a0c484 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:45.809953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3384ed6b-b697-40d9-9cc6-f39a03a0c484 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:45.912069 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5e63abba-04da-4886-9e7b-8b7a42a239da tempest-NetworksTest-1251948811 tempest-NetworksTest-1251948811-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks" status: 200 len: 5367 microversion: 2.1 time: 1.262162 Oct 10 23:25:45.913785 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1173/2335] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:25:44 2022] GET /compute/v2.1/os-networks => generated 5367 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:45.919845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c086a3f1-9f0e-4db4-9db6-5b1d03585014 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:45.920856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c086a3f1-9f0e-4db4-9db6-5b1d03585014 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] [instance: d3873d3f-2b48-4d60-b076-6b2bf69591b2] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:45.930430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c086a3f1-9f0e-4db4-9db6-5b1d03585014 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:45.931402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c086a3f1-9f0e-4db4-9db6-5b1d03585014 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:45.932047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c086a3f1-9f0e-4db4-9db6-5b1d03585014 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:45.933176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c086a3f1-9f0e-4db4-9db6-5b1d03585014 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:45.934089 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c086a3f1-9f0e-4db4-9db6-5b1d03585014 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:45.934792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c086a3f1-9f0e-4db4-9db6-5b1d03585014 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:46.042974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-3384ed6b-b697-40d9-9cc6-f39a03a0c484 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lazy-loading 'services' on Instance uuid 2031b270-ebc4-4583-8a2c-086ad7842cba {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:25:46.084324 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3384ed6b-b697-40d9-9cc6-f39a03a0c484 tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1936 microversion: 2.91 time: 0.301963 Oct 10 23:25:46.084937 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1163/2336] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:45 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1936 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:46.094055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0fb6d08b-b174-4ac6-bff1-6164fef18b7b tempest-NetworksTest-1251948811 tempest-NetworksTest-1251948811-project-admin] Calling method '.version_select at 0x7f662b3f5b80>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:46.167572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c086a3f1-9f0e-4db4-9db6-5b1d03585014 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:46.181458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c086a3f1-9f0e-4db4-9db6-5b1d03585014 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:46.183558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c086a3f1-9f0e-4db4-9db6-5b1d03585014 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:46.184989 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c086a3f1-9f0e-4db4-9db6-5b1d03585014 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] 10.222.0.23 "GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2" status: 200 len: 1359 microversion: 2.21 time: 0.270032 Oct 10 23:25:46.186145 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1174/2337] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:45 2022] GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2 => generated 1359 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:46.203731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-10907856-0d01-4ab9-bcac-eca45455c48f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:46.204782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-10907856-0d01-4ab9-bcac-eca45455c48f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:46.221919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10907856-0d01-4ab9-bcac-eca45455c48f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:46.232150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10907856-0d01-4ab9-bcac-eca45455c48f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:46.232937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10907856-0d01-4ab9-bcac-eca45455c48f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:46.234584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10907856-0d01-4ab9-bcac-eca45455c48f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:46.235256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10907856-0d01-4ab9-bcac-eca45455c48f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:46.235845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10907856-0d01-4ab9-bcac-eca45455c48f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:46.244105 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0fb6d08b-b174-4ac6-bff1-6164fef18b7b tempest-NetworksTest-1251948811 tempest-NetworksTest-1251948811-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks/c02b141d-e215-451f-8c75-8cc086d43089" status: 200 len: 652 microversion: 2.1 time: 0.157795 Oct 10 23:25:46.244708 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1164/2338] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 10 23:25:46 2022] GET /compute/v2.1/os-networks/c02b141d-e215-451f-8c75-8cc086d43089 => generated 652 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:25:46.254468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f00a0666-b5f9-49bd-a3ff-87c51320c83f tempest-NetworksTest-1251948811 tempest-NetworksTest-1251948811-project-admin] Calling method '.version_select at 0x7f662b4e7af0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:46.267468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-10907856-0d01-4ab9-bcac-eca45455c48f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lazy-loading 'flavor' on Instance uuid 2031b270-ebc4-4583-8a2c-086ad7842cba {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:25:46.763638 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-10907856-0d01-4ab9-bcac-eca45455c48f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "POST /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba/action" status: 202 len: 0 microversion: 2.91 time: 0.575950 Oct 10 23:25:46.769505 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1175/2339] 10.222.0.23 () {62 vars in 1319 bytes} [Mon Oct 10 23:25:46 2022] POST /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba/action => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:25:46.777238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-67efacc9-4307-4b5d-b0b2-ae2a190c9e43 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:46.778453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-67efacc9-4307-4b5d-b0b2-ae2a190c9e43 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: e47ddcc1-9723-4e88-8c1d-ded295d4e989] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:46.786839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67efacc9-4307-4b5d-b0b2-ae2a190c9e43 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:46.787378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67efacc9-4307-4b5d-b0b2-ae2a190c9e43 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:46.789612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67efacc9-4307-4b5d-b0b2-ae2a190c9e43 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:46.790491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67efacc9-4307-4b5d-b0b2-ae2a190c9e43 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:46.791234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67efacc9-4307-4b5d-b0b2-ae2a190c9e43 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:46.792197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67efacc9-4307-4b5d-b0b2-ae2a190c9e43 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:46.975479 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f00a0666-b5f9-49bd-a3ff-87c51320c83f tempest-NetworksTest-1251948811 tempest-NetworksTest-1251948811-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks" status: 200 len: 6053 microversion: 2.1 time: 0.725421 Oct 10 23:25:46.980349 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1165/2340] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:25:46 2022] GET /compute/v2.1/os-networks => generated 6053 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:25:46.986901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-f85f5e67-72be-4c7b-a417-af3ef5cb7dfc req-7dd7275d-d656-4933-96f3-a91f629a5f02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3873d3f-2b48-4d60-b076-6b2bf69591b2", "name": "network-vif-plugged", "status": "completed", "tag": "94befed5-51d0-4492-b73a-e591196ece3a"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:47.003112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f85f5e67-72be-4c7b-a417-af3ef5cb7dfc req-7dd7275d-d656-4933-96f3-a91f629a5f02 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:47.003882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f85f5e67-72be-4c7b-a417-af3ef5cb7dfc req-7dd7275d-d656-4933-96f3-a91f629a5f02 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:47.004533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f85f5e67-72be-4c7b-a417-af3ef5cb7dfc req-7dd7275d-d656-4933-96f3-a91f629a5f02 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:47.018742 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-f85f5e67-72be-4c7b-a417-af3ef5cb7dfc req-7dd7275d-d656-4933-96f3-a91f629a5f02 service nova] Creating event network-vif-plugged:94befed5-51d0-4492-b73a-e591196ece3a for instance d3873d3f-2b48-4d60-b076-6b2bf69591b2 on n-h1-860864-2 Oct 10 23:25:47.025658 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-f85f5e67-72be-4c7b-a417-af3ef5cb7dfc req-7dd7275d-d656-4933-96f3-a91f629a5f02 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043653 Oct 10 23:25:47.026830 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1166/2341] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:25:47.048994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a67ba004-02ad-4dab-8eee-b0e7daacfea4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:47.050306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a67ba004-02ad-4dab-8eee-b0e7daacfea4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:47.060698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a67ba004-02ad-4dab-8eee-b0e7daacfea4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:47.061734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a67ba004-02ad-4dab-8eee-b0e7daacfea4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:47.062935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a67ba004-02ad-4dab-8eee-b0e7daacfea4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:47.063971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a67ba004-02ad-4dab-8eee-b0e7daacfea4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:47.064588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a67ba004-02ad-4dab-8eee-b0e7daacfea4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:47.065349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a67ba004-02ad-4dab-8eee-b0e7daacfea4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:47.126674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:25:47.225505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a67ba004-02ad-4dab-8eee-b0e7daacfea4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:47.240429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a67ba004-02ad-4dab-8eee-b0e7daacfea4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:47.246444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a67ba004-02ad-4dab-8eee-b0e7daacfea4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:47.261721 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a67ba004-02ad-4dab-8eee-b0e7daacfea4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.232920 Oct 10 23:25:47.262996 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1167/2342] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:47 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:47.275524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-eb934103-46fc-4816-96c3-bfa32f729e66 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662ae87f70>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:47.359275 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-eb934103-46fc-4816-96c3-bfa32f729e66 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510" status: 200 len: 1439 microversion: 2.1 time: 0.093968 Oct 10 23:25:47.364883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-67efacc9-4307-4b5d-b0b2-ae2a190c9e43 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:47.368828 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1168/2343] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:25:47 2022] GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510 => generated 1439 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:47.374502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0fb5e836-ac40-44c1-b5a1-76098262b311 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:47.375665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0fb5e836-ac40-44c1-b5a1-76098262b311 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] [instance: d3873d3f-2b48-4d60-b076-6b2bf69591b2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:47.379841 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-67efacc9-4307-4b5d-b0b2-ae2a190c9e43 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989" status: 200 len: 1478 microversion: 2.1 time: 0.608537 Oct 10 23:25:47.393665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fb5e836-ac40-44c1-b5a1-76098262b311 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:47.393665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fb5e836-ac40-44c1-b5a1-76098262b311 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:47.393665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fb5e836-ac40-44c1-b5a1-76098262b311 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:47.393665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fb5e836-ac40-44c1-b5a1-76098262b311 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:47.394040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fb5e836-ac40-44c1-b5a1-76098262b311 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:47.394040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fb5e836-ac40-44c1-b5a1-76098262b311 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:47.394204 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1176/2344] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:46 2022] GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989 => generated 1478 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:47.753942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0aa392a9-dad1-4a44-a038-c561eaebc550 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:47.773233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0aa392a9-dad1-4a44-a038-c561eaebc550 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:47.773777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0aa392a9-dad1-4a44-a038-c561eaebc550 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:47.774230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0aa392a9-dad1-4a44-a038-c561eaebc550 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:47.836490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:25:47.853428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0aa392a9-dad1-4a44-a038-c561eaebc550 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Going to try to stop instance {{(pid=120614) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 23:25:48.013668 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0aa392a9-dad1-4a44-a038-c561eaebc550 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "POST /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc/action" status: 202 len: 0 microversion: 2.1 time: 0.264606 Oct 10 23:25:48.014909 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1177/2345] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:25:47 2022] POST /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 23:25:48.024350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0c6667f6-b90f-46e0-a2fd-75b0b5f42ffe tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:48.030445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0c6667f6-b90f-46e0-a2fd-75b0b5f42ffe tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:48.050092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c6667f6-b90f-46e0-a2fd-75b0b5f42ffe tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:48.050902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c6667f6-b90f-46e0-a2fd-75b0b5f42ffe tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:48.051733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c6667f6-b90f-46e0-a2fd-75b0b5f42ffe tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:48.053050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c6667f6-b90f-46e0-a2fd-75b0b5f42ffe tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:48.053792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c6667f6-b90f-46e0-a2fd-75b0b5f42ffe tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:48.054420 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c6667f6-b90f-46e0-a2fd-75b0b5f42ffe tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:48.308776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0fb5e836-ac40-44c1-b5a1-76098262b311 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:48.323298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0fb5e836-ac40-44c1-b5a1-76098262b311 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:48.324755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0fb5e836-ac40-44c1-b5a1-76098262b311 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:48.325954 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0fb5e836-ac40-44c1-b5a1-76098262b311 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] 10.222.0.23 "GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2" status: 200 len: 1359 microversion: 2.21 time: 0.956049 Oct 10 23:25:48.326517 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1169/2346] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:47 2022] GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2 => generated 1359 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:48.350013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2198cc71-c5dd-4b6c-8488-f9abd0c6564a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:48.351080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2198cc71-c5dd-4b6c-8488-f9abd0c6564a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:48.358303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2198cc71-c5dd-4b6c-8488-f9abd0c6564a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:48.359746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2198cc71-c5dd-4b6c-8488-f9abd0c6564a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:48.360559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2198cc71-c5dd-4b6c-8488-f9abd0c6564a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:48.361548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2198cc71-c5dd-4b6c-8488-f9abd0c6564a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:48.362433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2198cc71-c5dd-4b6c-8488-f9abd0c6564a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:48.363060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2198cc71-c5dd-4b6c-8488-f9abd0c6564a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:48.490184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2198cc71-c5dd-4b6c-8488-f9abd0c6564a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:48.519546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2198cc71-c5dd-4b6c-8488-f9abd0c6564a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:48.523222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2198cc71-c5dd-4b6c-8488-f9abd0c6564a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:48.531718 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2198cc71-c5dd-4b6c-8488-f9abd0c6564a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.188126 Oct 10 23:25:48.548814 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1170/2347] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:48 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:48.561265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e39ef98b-4abd-4fd7-82d9-09a5da9d8783 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662accb430>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:48.629430 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e39ef98b-4abd-4fd7-82d9-09a5da9d8783 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510" status: 200 len: 1439 microversion: 2.1 time: 0.079276 Oct 10 23:25:48.630270 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1171/2348] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:25:48 2022] GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510 => generated 1439 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:48.636666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-72c59326-e2b5-4906-ab4a-8430a784271a tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:48.637504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-72c59326-e2b5-4906-ab4a-8430a784271a tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: e47ddcc1-9723-4e88-8c1d-ded295d4e989] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:48.648653 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72c59326-e2b5-4906-ab4a-8430a784271a tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:48.649608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72c59326-e2b5-4906-ab4a-8430a784271a tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:48.651230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72c59326-e2b5-4906-ab4a-8430a784271a tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:48.652194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72c59326-e2b5-4906-ab4a-8430a784271a tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:48.652803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72c59326-e2b5-4906-ab4a-8430a784271a tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:48.653417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72c59326-e2b5-4906-ab4a-8430a784271a tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:48.778640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-72c59326-e2b5-4906-ab4a-8430a784271a tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:48.789767 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-72c59326-e2b5-4906-ab4a-8430a784271a tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989" status: 200 len: 1436 microversion: 2.1 time: 0.157374 Oct 10 23:25:48.790578 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1172/2349] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:48 2022] GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989 => generated 1436 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:48.909877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-56b08ecb-56b3-4cd4-b12b-0c2ae2f78d2c req-cb0af1b4-c9f2-48a2-9e6b-21617871bb7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47ddcc1-9723-4e88-8c1d-ded295d4e989", "name": "network-vif-deleted", "tag": "84337f7d-20d9-455a-81b0-82cecccbe13d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:48.955477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-56b08ecb-56b3-4cd4-b12b-0c2ae2f78d2c req-cb0af1b4-c9f2-48a2-9e6b-21617871bb7f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:48.955991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-56b08ecb-56b3-4cd4-b12b-0c2ae2f78d2c req-cb0af1b4-c9f2-48a2-9e6b-21617871bb7f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:48.958575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-56b08ecb-56b3-4cd4-b12b-0c2ae2f78d2c req-cb0af1b4-c9f2-48a2-9e6b-21617871bb7f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:48.981425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0c6667f6-b90f-46e0-a2fd-75b0b5f42ffe tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:48.982319 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-56b08ecb-56b3-4cd4-b12b-0c2ae2f78d2c req-cb0af1b4-c9f2-48a2-9e6b-21617871bb7f service nova] Creating event network-vif-deleted:84337f7d-20d9-455a-81b0-82cecccbe13d for instance e47ddcc1-9723-4e88-8c1d-ded295d4e989 on n-h1-860864-2 Oct 10 23:25:48.991278 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-56b08ecb-56b3-4cd4-b12b-0c2ae2f78d2c req-cb0af1b4-c9f2-48a2-9e6b-21617871bb7f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088013 Oct 10 23:25:48.992262 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1173/2350] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:25:48.996537 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0c6667f6-b90f-46e0-a2fd-75b0b5f42ffe tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1680 microversion: 2.1 time: 0.976602 Oct 10 23:25:49.011313 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1178/2351] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:48 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1680 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:49.361838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-95cd164d-5b8f-4044-98a7-0d443830908d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:49.362612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-95cd164d-5b8f-4044-98a7-0d443830908d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] [instance: d3873d3f-2b48-4d60-b076-6b2bf69591b2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:49.376951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95cd164d-5b8f-4044-98a7-0d443830908d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:49.379005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95cd164d-5b8f-4044-98a7-0d443830908d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:49.381617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95cd164d-5b8f-4044-98a7-0d443830908d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:49.382520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95cd164d-5b8f-4044-98a7-0d443830908d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:49.383021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95cd164d-5b8f-4044-98a7-0d443830908d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:49.385357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95cd164d-5b8f-4044-98a7-0d443830908d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:49.567243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-411688b0-a2f5-4e60-aaf6-42ec78070b35 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:49.569293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-411688b0-a2f5-4e60-aaf6-42ec78070b35 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:49.590733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-411688b0-a2f5-4e60-aaf6-42ec78070b35 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:49.591353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-411688b0-a2f5-4e60-aaf6-42ec78070b35 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:49.592592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-411688b0-a2f5-4e60-aaf6-42ec78070b35 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:49.593818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-411688b0-a2f5-4e60-aaf6-42ec78070b35 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:49.596967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-411688b0-a2f5-4e60-aaf6-42ec78070b35 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:49.597805 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-411688b0-a2f5-4e60-aaf6-42ec78070b35 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:49.834006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-411688b0-a2f5-4e60-aaf6-42ec78070b35 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:49.845604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-411688b0-a2f5-4e60-aaf6-42ec78070b35 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:49.854618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-411688b0-a2f5-4e60-aaf6-42ec78070b35 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:49.869365 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-411688b0-a2f5-4e60-aaf6-42ec78070b35 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.306434 Oct 10 23:25:49.871646 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1179/2352] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:49 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:49.880391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9c42df9f-50fb-4ea3-987f-5d8dec436f01 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662a7ed790>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:49.962135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-95cd164d-5b8f-4044-98a7-0d443830908d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:49.968434 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9c42df9f-50fb-4ea3-987f-5d8dec436f01 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510" status: 200 len: 1439 microversion: 2.1 time: 0.091506 Oct 10 23:25:49.969696 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1180/2353] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:25:49 2022] GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510 => generated 1439 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:49.974546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-95cd164d-5b8f-4044-98a7-0d443830908d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:49.976225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-95cd164d-5b8f-4044-98a7-0d443830908d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:49.983809 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-95cd164d-5b8f-4044-98a7-0d443830908d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] 10.222.0.23 "GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2" status: 200 len: 1552 microversion: 2.21 time: 0.623161 Oct 10 23:25:49.988978 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1174/2354] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:49 2022] GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2 => generated 1552 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:49.994100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c01884b0-ce82-44b0-bb32-ee4f9dbdd2d3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:50.001958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c01884b0-ce82-44b0-bb32-ee4f9dbdd2d3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: e47ddcc1-9723-4e88-8c1d-ded295d4e989] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:50.018651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ba527ec3-b208-46de-aad5-b612027b7d3f tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:50.019151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c01884b0-ce82-44b0-bb32-ee4f9dbdd2d3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:50.019429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ba527ec3-b208-46de-aad5-b612027b7d3f tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] [instance: d3873d3f-2b48-4d60-b076-6b2bf69591b2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:50.020006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c01884b0-ce82-44b0-bb32-ee4f9dbdd2d3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:50.020600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c01884b0-ce82-44b0-bb32-ee4f9dbdd2d3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:50.022016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c01884b0-ce82-44b0-bb32-ee4f9dbdd2d3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:50.025278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c01884b0-ce82-44b0-bb32-ee4f9dbdd2d3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:50.026098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c01884b0-ce82-44b0-bb32-ee4f9dbdd2d3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:50.035182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba527ec3-b208-46de-aad5-b612027b7d3f tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:50.039325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba527ec3-b208-46de-aad5-b612027b7d3f tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:50.041585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba527ec3-b208-46de-aad5-b612027b7d3f tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:50.043070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba527ec3-b208-46de-aad5-b612027b7d3f tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:50.043886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba527ec3-b208-46de-aad5-b612027b7d3f tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:50.048940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba527ec3-b208-46de-aad5-b612027b7d3f tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:50.109740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c01884b0-ce82-44b0-bb32-ee4f9dbdd2d3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:50.122185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c01884b0-ce82-44b0-bb32-ee4f9dbdd2d3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:50.126041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c01884b0-ce82-44b0-bb32-ee4f9dbdd2d3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:50.127270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-c01884b0-ce82-44b0-bb32-ee4f9dbdd2d3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lazy-loading 'fault' on Instance uuid e47ddcc1-9723-4e88-8c1d-ded295d4e989 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:25:50.127750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ba527ec3-b208-46de-aad5-b612027b7d3f tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] [instance: d3873d3f-2b48-4d60-b076-6b2bf69591b2] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:25:50.363559 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ba527ec3-b208-46de-aad5-b612027b7d3f tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2" status: 204 len: 0 microversion: 2.21 time: 0.348839 Oct 10 23:25:50.376302 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1175/2355] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:25:50 2022] DELETE /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:25:50.390283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8afee88f-9237-4981-ae88-78ca1f7e7dd7 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:50.391054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8afee88f-9237-4981-ae88-78ca1f7e7dd7 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:50.392098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c01884b0-ce82-44b0-bb32-ee4f9dbdd2d3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8faa9362e94ceab173df40b3008af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6f65dbe8455479391d42d0a97fa1305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:50.400153 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c01884b0-ce82-44b0-bb32-ee4f9dbdd2d3 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989" status: 200 len: 1312 microversion: 2.1 time: 0.416818 Oct 10 23:25:50.413822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8afee88f-9237-4981-ae88-78ca1f7e7dd7 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:50.413822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8afee88f-9237-4981-ae88-78ca1f7e7dd7 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:50.413822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8afee88f-9237-4981-ae88-78ca1f7e7dd7 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:50.414265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8afee88f-9237-4981-ae88-78ca1f7e7dd7 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:50.414769 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1181/2356] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:49 2022] GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989 => generated 1312 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:50.415111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8afee88f-9237-4981-ae88-78ca1f7e7dd7 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:50.415875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8afee88f-9237-4981-ae88-78ca1f7e7dd7 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:50.428220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5751ac8a-8f15-430b-97d0-7f5a9a7fb133 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:50.429076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5751ac8a-8f15-430b-97d0-7f5a9a7fb133 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] [instance: d3873d3f-2b48-4d60-b076-6b2bf69591b2] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:50.435712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5751ac8a-8f15-430b-97d0-7f5a9a7fb133 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:50.436569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5751ac8a-8f15-430b-97d0-7f5a9a7fb133 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:50.437982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5751ac8a-8f15-430b-97d0-7f5a9a7fb133 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:50.439084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5751ac8a-8f15-430b-97d0-7f5a9a7fb133 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:50.439843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5751ac8a-8f15-430b-97d0-7f5a9a7fb133 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:50.440420 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5751ac8a-8f15-430b-97d0-7f5a9a7fb133 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:50.862964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5751ac8a-8f15-430b-97d0-7f5a9a7fb133 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:50.886140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5751ac8a-8f15-430b-97d0-7f5a9a7fb133 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:50.892264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5751ac8a-8f15-430b-97d0-7f5a9a7fb133 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:50.901027 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5751ac8a-8f15-430b-97d0-7f5a9a7fb133 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] 10.222.0.23 "GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2" status: 200 len: 1558 microversion: 2.21 time: 0.484991 Oct 10 23:25:50.904996 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1182/2357] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:50 2022] GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2 => generated 1558 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:50.935719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7daae4d0-fbf1-464a-b4af-359772017c60 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:50.938723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7daae4d0-fbf1-464a-b4af-359772017c60 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:50.950948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7daae4d0-fbf1-464a-b4af-359772017c60 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:50.951739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7daae4d0-fbf1-464a-b4af-359772017c60 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:50.953754 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7daae4d0-fbf1-464a-b4af-359772017c60 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:50.954789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7daae4d0-fbf1-464a-b4af-359772017c60 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:50.961327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8afee88f-9237-4981-ae88-78ca1f7e7dd7 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:50.964888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7daae4d0-fbf1-464a-b4af-359772017c60 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:50.965339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7daae4d0-fbf1-464a-b4af-359772017c60 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:50.971092 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8afee88f-9237-4981-ae88-78ca1f7e7dd7 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1680 microversion: 2.1 time: 0.586408 Oct 10 23:25:50.975569 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1176/2358] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:50 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1680 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:50.989203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-59b2a55e-f4a5-4265-a76d-97a28f28129c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662acd81f0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:51.126012 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-59b2a55e-f4a5-4265-a76d-97a28f28129c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510" status: 200 len: 1439 microversion: 2.1 time: 0.144885 Oct 10 23:25:51.129015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7daae4d0-fbf1-464a-b4af-359772017c60 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:51.140741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7daae4d0-fbf1-464a-b4af-359772017c60 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:51.146186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7daae4d0-fbf1-464a-b4af-359772017c60 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:51.150228 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1177/2359] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:25:50 2022] GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510 => generated 1439 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:51.158388 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7daae4d0-fbf1-464a-b4af-359772017c60 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.252147 Oct 10 23:25:51.175430 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1183/2360] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:50 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:51.428462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-efc2dd22-f605-4173-95cb-07792e1ee9b8 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:51.429234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-efc2dd22-f605-4173-95cb-07792e1ee9b8 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] [instance: e47ddcc1-9723-4e88-8c1d-ded295d4e989] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:51.442865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-efc2dd22-f605-4173-95cb-07792e1ee9b8 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:51.448867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-efc2dd22-f605-4173-95cb-07792e1ee9b8 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:51.453798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-efc2dd22-f605-4173-95cb-07792e1ee9b8 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:51.454991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-efc2dd22-f605-4173-95cb-07792e1ee9b8 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:51.455643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-efc2dd22-f605-4173-95cb-07792e1ee9b8 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:51.458000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-efc2dd22-f605-4173-95cb-07792e1ee9b8 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:51.519611 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-efc2dd22-f605-4173-95cb-07792e1ee9b8 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] HTTP exception thrown: Instance e47ddcc1-9723-4e88-8c1d-ded295d4e989 could not be found. Oct 10 23:25:51.521473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-efc2dd22-f605-4173-95cb-07792e1ee9b8 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Request method failure captured: Oct 10 23:25:51.521473 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989 HTTP/1.1 Oct 10 23:25:51.521473 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:25:51.521473 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:25:51.521473 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:25:51.521473 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:25:51.521473 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:25:51.521473 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:25:51.521473 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:25:51.521473 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:25:51.521473 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKmtYmUE_lup66dv5kMP14Di29cC5lLuI-_dfozACS2uvVCG2Vztg-zyzoj8bq-JCh1KcsiFX6oi_6pz1AKx4uc3ZZJ9wTtn2-GBsa2oiCH57UVDJ52qKCfoOU5c50FaJtlDQvnmeDeC7O-8fo0Zfnd_1eA_mynaUmPGNbPoYtqNmaI Oct 10 23:25:51.521473 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:25:51.521473 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:25:51.521473 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:25:51.521473 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:25:51.521473 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:25:51.521473 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:25:51.521473 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: b6f65dbe8455479391d42d0a97fa1305 Oct 10 23:25:51.521473 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1015997903 Oct 10 23:25:51.521473 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:25:51.521473 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:25:51.522962 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b6f65dbe8455479391d42d0a97fa1305"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b6f65dbe8455479391d42d0a97fa1305"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b6f65dbe8455479391d42d0a97fa1305"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b6f65dbe8455479391d42d0a97fa1305", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:25:51.522962 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1015997903 Oct 10 23:25:51.522962 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: b6f65dbe8455479391d42d0a97fa1305 Oct 10 23:25:51.522962 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1015997903 Oct 10 23:25:51.522962 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersAdminNegativeTestJSON-1015997903-project Oct 10 23:25:51.522962 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:25:51.522962 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:25:51.522962 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: be8faa9362e94ceab173df40b3008af1 Oct 10 23:25:51.522962 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1015997903-project Oct 10 23:25:51.522962 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:25:51.522962 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance e47ddcc1-9723-4e88-8c1d-ded295d4e989 could not be found. Oct 10 23:25:51.522962 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'e47ddcc1-9723-4e88-8c1d-ded295d4e989'} Oct 10 23:25:51.523757 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:25:51.523757 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:51.523757 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:25:51.523757 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:25:51.523757 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:25:51.523757 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:25:51.523757 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:25:51.523757 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:25:51.523757 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:25:51.523757 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:25:51.523757 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e47ddcc1-9723-4e88-8c1d-ded295d4e989 could not be found. Oct 10 23:25:51.523757 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:51.523757 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:51.523757 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:51.523757 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:51.523757 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:51.523757 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:51.523757 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:25:51.523757 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:25:51.523757 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:25:51.525052 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:25:51.525052 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:25:51.525052 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:25:51.525052 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:25:51.525052 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:25:51.525052 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:25:51.525052 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:25:51.525052 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e47ddcc1-9723-4e88-8c1d-ded295d4e989 could not be found. Oct 10 23:25:51.525052 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:51.525052 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:51.525052 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:51.525052 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:51.525052 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:51.525052 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:51.525052 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:25:51.525052 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:25:51.525052 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e47ddcc1-9723-4e88-8c1d-ded295d4e989 could not be found. Oct 10 23:25:51.525052 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:51.526319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-efc2dd22-f605-4173-95cb-07792e1ee9b8 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] Returning 404 to user: Instance e47ddcc1-9723-4e88-8c1d-ded295d4e989 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:25:51.526319 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-efc2dd22-f605-4173-95cb-07792e1ee9b8 tempest-ServersAdminNegativeTestJSON-1015997903 tempest-ServersAdminNegativeTestJSON-1015997903-project] 10.222.0.23 "GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989" status: 404 len: 111 microversion: 2.1 time: 0.098468 Oct 10 23:25:51.567426 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1178/2361] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:51 2022] GET /compute/v2.1/servers/e47ddcc1-9723-4e88-8c1d-ded295d4e989 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:25:51.934225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d5f80455-1d03-4bee-ac74-6dfb800c916d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:51.935107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d5f80455-1d03-4bee-ac74-6dfb800c916d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] [instance: d3873d3f-2b48-4d60-b076-6b2bf69591b2] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:51.967364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d5f80455-1d03-4bee-ac74-6dfb800c916d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:51.968219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d5f80455-1d03-4bee-ac74-6dfb800c916d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:51.968866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d5f80455-1d03-4bee-ac74-6dfb800c916d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:51.970567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d5f80455-1d03-4bee-ac74-6dfb800c916d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:51.973496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d5f80455-1d03-4bee-ac74-6dfb800c916d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:51.975862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d5f80455-1d03-4bee-ac74-6dfb800c916d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:52.005922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-466f2b28-8904-4678-8599-c10c851b540a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:52.007221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-466f2b28-8904-4678-8599-c10c851b540a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:52.043312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-466f2b28-8904-4678-8599-c10c851b540a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:52.044158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-466f2b28-8904-4678-8599-c10c851b540a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:52.044624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-466f2b28-8904-4678-8599-c10c851b540a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:52.051626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-466f2b28-8904-4678-8599-c10c851b540a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:52.053022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-466f2b28-8904-4678-8599-c10c851b540a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:52.054645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-466f2b28-8904-4678-8599-c10c851b540a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:52.509151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-466f2b28-8904-4678-8599-c10c851b540a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:52.530107 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-466f2b28-8904-4678-8599-c10c851b540a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1680 microversion: 2.1 time: 0.528324 Oct 10 23:25:52.559628 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1179/2362] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:52 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1680 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:52.579302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7198bd9e-33f0-4ddc-97ee-3f2012f2046e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662b0249d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:52.685268 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7198bd9e-33f0-4ddc-97ee-3f2012f2046e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510" status: 200 len: 1439 microversion: 2.1 time: 0.123497 Oct 10 23:25:52.686542 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1180/2363] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:25:52 2022] GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510 => generated 1439 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:52.698609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-652fdb10-a4c6-4ad7-be3d-bb12bd4cd6df tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:52.700797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-652fdb10-a4c6-4ad7-be3d-bb12bd4cd6df tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:52.725247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-652fdb10-a4c6-4ad7-be3d-bb12bd4cd6df tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:52.726577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-652fdb10-a4c6-4ad7-be3d-bb12bd4cd6df tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:52.728784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-652fdb10-a4c6-4ad7-be3d-bb12bd4cd6df tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:52.731944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-652fdb10-a4c6-4ad7-be3d-bb12bd4cd6df tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:52.747827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-652fdb10-a4c6-4ad7-be3d-bb12bd4cd6df tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:52.748616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-652fdb10-a4c6-4ad7-be3d-bb12bd4cd6df tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:52.979323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-652fdb10-a4c6-4ad7-be3d-bb12bd4cd6df tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:52.997213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-652fdb10-a4c6-4ad7-be3d-bb12bd4cd6df tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:53.005997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-652fdb10-a4c6-4ad7-be3d-bb12bd4cd6df tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:53.039942 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-652fdb10-a4c6-4ad7-be3d-bb12bd4cd6df tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.340943 Oct 10 23:25:53.048518 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1181/2364] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:52 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:53.459030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d5f80455-1d03-4bee-ac74-6dfb800c916d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:53.473191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d5f80455-1d03-4bee-ac74-6dfb800c916d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:53.476277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d5f80455-1d03-4bee-ac74-6dfb800c916d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:53.477791 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d5f80455-1d03-4bee-ac74-6dfb800c916d tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] 10.222.0.23 "GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2" status: 200 len: 1558 microversion: 2.21 time: 1.547459 Oct 10 23:25:53.479013 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1184/2365] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:51 2022] GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2 => generated 1558 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:53.568392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5f152bef-58c1-409d-9566-73280db99927 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:53.569773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5f152bef-58c1-409d-9566-73280db99927 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:53.594991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f152bef-58c1-409d-9566-73280db99927 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:53.604189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f152bef-58c1-409d-9566-73280db99927 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:53.607217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f152bef-58c1-409d-9566-73280db99927 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:53.609898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f152bef-58c1-409d-9566-73280db99927 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:53.617080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f152bef-58c1-409d-9566-73280db99927 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:53.619629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f152bef-58c1-409d-9566-73280db99927 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:53.707016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7c4d57c3-30af-467f-954b-3e42237fcb70 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662a7ed040>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:53.920623 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7c4d57c3-30af-467f-954b-3e42237fcb70 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510" status: 200 len: 1439 microversion: 2.1 time: 0.222570 Oct 10 23:25:53.921264 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1185/2366] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:25:53 2022] GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510 => generated 1439 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:25:54.088264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9552499f-1860-4df7-9695-7baa3f262dbc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:54.089251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9552499f-1860-4df7-9695-7baa3f262dbc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:54.111885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5f152bef-58c1-409d-9566-73280db99927 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:54.127469 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5f152bef-58c1-409d-9566-73280db99927 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1680 microversion: 2.1 time: 0.558908 Oct 10 23:25:54.127841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9552499f-1860-4df7-9695-7baa3f262dbc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:54.132428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9552499f-1860-4df7-9695-7baa3f262dbc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:54.133328 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1182/2367] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:53 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1680 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:54.133969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9552499f-1860-4df7-9695-7baa3f262dbc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:54.134944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9552499f-1860-4df7-9695-7baa3f262dbc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:54.135822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9552499f-1860-4df7-9695-7baa3f262dbc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:54.136651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9552499f-1860-4df7-9695-7baa3f262dbc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:54.235116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-63805067-0e95-4121-850a-7d9501c1a873 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:54.235946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-63805067-0e95-4121-850a-7d9501c1a873 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:54.253192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63805067-0e95-4121-850a-7d9501c1a873 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:54.253964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63805067-0e95-4121-850a-7d9501c1a873 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:54.256808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63805067-0e95-4121-850a-7d9501c1a873 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:54.260000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63805067-0e95-4121-850a-7d9501c1a873 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:54.263023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63805067-0e95-4121-850a-7d9501c1a873 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:54.263679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63805067-0e95-4121-850a-7d9501c1a873 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:54.358379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-63805067-0e95-4121-850a-7d9501c1a873 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:25:54.619170 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-63805067-0e95-4121-850a-7d9501c1a873 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "DELETE /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 204 len: 0 microversion: 2.25 time: 0.390141 Oct 10 23:25:54.625283 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1183/2368] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:25:54 2022] DELETE /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 10 23:25:54.641557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d766cd5a-16d1-4dad-b29e-6bbdd5030179 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:54.642699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d766cd5a-16d1-4dad-b29e-6bbdd5030179 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] [instance: d3873d3f-2b48-4d60-b076-6b2bf69591b2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:54.680403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d766cd5a-16d1-4dad-b29e-6bbdd5030179 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:54.685518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d766cd5a-16d1-4dad-b29e-6bbdd5030179 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:54.686160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d766cd5a-16d1-4dad-b29e-6bbdd5030179 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:54.689679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d766cd5a-16d1-4dad-b29e-6bbdd5030179 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:54.694902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d766cd5a-16d1-4dad-b29e-6bbdd5030179 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:54.695621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d766cd5a-16d1-4dad-b29e-6bbdd5030179 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:54.742261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9552499f-1860-4df7-9695-7baa3f262dbc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:54.754139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9552499f-1860-4df7-9695-7baa3f262dbc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:54.759696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9552499f-1860-4df7-9695-7baa3f262dbc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:54.771078 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9552499f-1860-4df7-9695-7baa3f262dbc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.687599 Oct 10 23:25:54.774070 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1186/2369] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:54 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:54.779847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3fe88696-284c-40c7-b9c7-723e18aad563 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:54.780726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3fe88696-284c-40c7-b9c7-723e18aad563 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:54.788478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fe88696-284c-40c7-b9c7-723e18aad563 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:54.789268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fe88696-284c-40c7-b9c7-723e18aad563 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:54.789885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fe88696-284c-40c7-b9c7-723e18aad563 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:54.790835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fe88696-284c-40c7-b9c7-723e18aad563 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:54.791440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fe88696-284c-40c7-b9c7-723e18aad563 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:54.792323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fe88696-284c-40c7-b9c7-723e18aad563 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:55.423989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d766cd5a-16d1-4dad-b29e-6bbdd5030179 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:55.440234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d766cd5a-16d1-4dad-b29e-6bbdd5030179 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:55.468694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d766cd5a-16d1-4dad-b29e-6bbdd5030179 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:55.482319 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d766cd5a-16d1-4dad-b29e-6bbdd5030179 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] 10.222.0.23 "GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2" status: 200 len: 1558 microversion: 2.21 time: 0.850220 Oct 10 23:25:55.485185 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1184/2370] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:54 2022] GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2 => generated 1558 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:55.509334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ee290003-be80-4e31-81e7-77587f599505 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662acf43a0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:55.588122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3fe88696-284c-40c7-b9c7-723e18aad563 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:55.590911 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ee290003-be80-4e31-81e7-77587f599505 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510" status: 200 len: 1439 microversion: 2.1 time: 0.102923 Oct 10 23:25:55.604171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3fe88696-284c-40c7-b9c7-723e18aad563 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:55.606340 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1185/2371] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:25:55 2022] GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510 => generated 1439 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:55.610414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3fe88696-284c-40c7-b9c7-723e18aad563 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:55.615263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-66126764-a77e-498d-88fb-c1b2e3cdf651 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:55.615986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-66126764-a77e-498d-88fb-c1b2e3cdf651 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:55.619863 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3fe88696-284c-40c7-b9c7-723e18aad563 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1733 microversion: 2.25 time: 0.840853 Oct 10 23:25:55.624116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:25:55.633252 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1187/2372] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:54 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1733 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:55.660881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66126764-a77e-498d-88fb-c1b2e3cdf651 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:55.661600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66126764-a77e-498d-88fb-c1b2e3cdf651 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:55.661881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66126764-a77e-498d-88fb-c1b2e3cdf651 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:55.662608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66126764-a77e-498d-88fb-c1b2e3cdf651 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:55.663080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66126764-a77e-498d-88fb-c1b2e3cdf651 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:55.663515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66126764-a77e-498d-88fb-c1b2e3cdf651 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:55.806688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7041b475-175b-4e29-89ad-ab50319b0bc0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:55.807073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7041b475-175b-4e29-89ad-ab50319b0bc0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:55.822605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7041b475-175b-4e29-89ad-ab50319b0bc0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:55.823458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7041b475-175b-4e29-89ad-ab50319b0bc0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:55.826005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7041b475-175b-4e29-89ad-ab50319b0bc0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:55.827598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7041b475-175b-4e29-89ad-ab50319b0bc0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:55.832813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7041b475-175b-4e29-89ad-ab50319b0bc0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:55.833269 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7041b475-175b-4e29-89ad-ab50319b0bc0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:56.306501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-66126764-a77e-498d-88fb-c1b2e3cdf651 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:56.345986 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-66126764-a77e-498d-88fb-c1b2e3cdf651 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1680 microversion: 2.1 time: 0.737920 Oct 10 23:25:56.347005 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1186/2373] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:55 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1680 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:56.526380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-92fe0196-ba5b-4755-b021-42f639871d0a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:56.530047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-92fe0196-ba5b-4755-b021-42f639871d0a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] [instance: d3873d3f-2b48-4d60-b076-6b2bf69591b2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:56.578926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92fe0196-ba5b-4755-b021-42f639871d0a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:56.579947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92fe0196-ba5b-4755-b021-42f639871d0a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:56.580735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92fe0196-ba5b-4755-b021-42f639871d0a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:56.582010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92fe0196-ba5b-4755-b021-42f639871d0a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:56.582834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92fe0196-ba5b-4755-b021-42f639871d0a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:56.583545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92fe0196-ba5b-4755-b021-42f639871d0a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:56.624059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:25:56.912238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7041b475-175b-4e29-89ad-ab50319b0bc0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:56.914180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-92fe0196-ba5b-4755-b021-42f639871d0a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:56.942804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-92fe0196-ba5b-4755-b021-42f639871d0a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:56.953306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-92fe0196-ba5b-4755-b021-42f639871d0a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5508f1f7e16d4b98ad363f9647609ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2481a2904215494d8bdf9876a8be0822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:56.956082 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-92fe0196-ba5b-4755-b021-42f639871d0a tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] 10.222.0.23 "GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2" status: 200 len: 1516 microversion: 2.21 time: 0.436801 Oct 10 23:25:56.978824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7041b475-175b-4e29-89ad-ab50319b0bc0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:56.981489 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1187/2374] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:56 2022] GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2 => generated 1516 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:56.989764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7041b475-175b-4e29-89ad-ab50319b0bc0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:57.012091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-70e939c4-e842-4e6e-b2fe-107f400e8ae5 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662ac814c0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:57.017302 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7041b475-175b-4e29-89ad-ab50319b0bc0 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 1.214617 Oct 10 23:25:57.021770 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1188/2375] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:55 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:25:57.059986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-70b2105c-80ba-41bc-984e-aa8a1f711150 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:57.065812 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-70b2105c-80ba-41bc-984e-aa8a1f711150 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:57.089556 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70b2105c-80ba-41bc-984e-aa8a1f711150 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:57.090378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70b2105c-80ba-41bc-984e-aa8a1f711150 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:57.098326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70b2105c-80ba-41bc-984e-aa8a1f711150 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:57.102399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70b2105c-80ba-41bc-984e-aa8a1f711150 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:57.108259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70b2105c-80ba-41bc-984e-aa8a1f711150 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:57.109759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70b2105c-80ba-41bc-984e-aa8a1f711150 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:57.164465 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-70e939c4-e842-4e6e-b2fe-107f400e8ae5 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510" status: 200 len: 1439 microversion: 2.1 time: 0.179429 Oct 10 23:25:57.168134 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1188/2376] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:25:56 2022] GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510 => generated 1439 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:57.741225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-70b2105c-80ba-41bc-984e-aa8a1f711150 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:57.751912 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-70b2105c-80ba-41bc-984e-aa8a1f711150 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:57.760072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-70b2105c-80ba-41bc-984e-aa8a1f711150 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:57.761317 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-70b2105c-80ba-41bc-984e-aa8a1f711150 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1733 microversion: 2.25 time: 0.735880 Oct 10 23:25:57.761954 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1189/2377] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:57 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1733 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:57.774845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-abc6ba4c-1783-40a0-ae84-07743f62d13a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:57.784884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-abc6ba4c-1783-40a0-ae84-07743f62d13a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:57.810646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-abc6ba4c-1783-40a0-ae84-07743f62d13a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:57.813141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-abc6ba4c-1783-40a0-ae84-07743f62d13a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:57.813823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-abc6ba4c-1783-40a0-ae84-07743f62d13a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:57.816903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-abc6ba4c-1783-40a0-ae84-07743f62d13a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:57.817418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-abc6ba4c-1783-40a0-ae84-07743f62d13a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:57.817868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-abc6ba4c-1783-40a0-ae84-07743f62d13a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:58.093513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cfa9cc05-5a2e-4f56-aee0-49df692db661 tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Action: 'update', calling method: .version_select at 0x7f662aca9040>, body: {"quota_set": {"ram": "5120"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:58.410296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfa9cc05-5a2e-4f56-aee0-49df692db661 tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:58.411027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfa9cc05-5a2e-4f56-aee0-49df692db661 tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:58.411900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfa9cc05-5a2e-4f56-aee0-49df692db661 tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:58.412860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfa9cc05-5a2e-4f56-aee0-49df692db661 tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:58.414156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfa9cc05-5a2e-4f56-aee0-49df692db661 tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:58.414754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfa9cc05-5a2e-4f56-aee0-49df692db661 tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:58.484527 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cfa9cc05-5a2e-4f56-aee0-49df692db661 tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/2e7f9cea845b4186b638dafb938f00d8" status: 200 len: 240 microversion: 2.36 time: 1.312875 Oct 10 23:25:58.485458 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1189/2378] 10.222.0.23 () {62 vars in 1303 bytes} [Mon Oct 10 23:25:57 2022] PUT /compute/v2.1/os-quota-sets/2e7f9cea845b4186b638dafb938f00d8 => generated 240 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:25:58.502052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-15f021dc-24fd-4f36-b3c3-db6990e179d2 req-47722c3a-7329-486e-b40a-866236ce9f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3873d3f-2b48-4d60-b076-6b2bf69591b2", "name": "network-vif-deleted", "tag": "94befed5-51d0-4492-b73a-e591196ece3a"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:58.516606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-15f021dc-24fd-4f36-b3c3-db6990e179d2 req-47722c3a-7329-486e-b40a-866236ce9f12 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:58.517661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-15f021dc-24fd-4f36-b3c3-db6990e179d2 req-47722c3a-7329-486e-b40a-866236ce9f12 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:58.518297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-15f021dc-24fd-4f36-b3c3-db6990e179d2 req-47722c3a-7329-486e-b40a-866236ce9f12 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:58.537682 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-15f021dc-24fd-4f36-b3c3-db6990e179d2 req-47722c3a-7329-486e-b40a-866236ce9f12 service nova] Creating event network-vif-deleted:94befed5-51d0-4492-b73a-e591196ece3a for instance d3873d3f-2b48-4d60-b076-6b2bf69591b2 on n-h1-860864-2 Oct 10 23:25:58.547570 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-15f021dc-24fd-4f36-b3c3-db6990e179d2 req-47722c3a-7329-486e-b40a-866236ce9f12 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052403 Oct 10 23:25:58.550235 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1190/2379] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:25:58.557143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-00ec4b78-a106-419b-9405-75947125579c tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:58.558720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-00ec4b78-a106-419b-9405-75947125579c tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] [instance: d3873d3f-2b48-4d60-b076-6b2bf69591b2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:58.571860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00ec4b78-a106-419b-9405-75947125579c tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:58.572546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00ec4b78-a106-419b-9405-75947125579c tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:58.573179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00ec4b78-a106-419b-9405-75947125579c tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:58.575229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00ec4b78-a106-419b-9405-75947125579c tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:58.576116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00ec4b78-a106-419b-9405-75947125579c tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:58.576771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00ec4b78-a106-419b-9405-75947125579c tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:58.596938 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-00ec4b78-a106-419b-9405-75947125579c tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] HTTP exception thrown: Instance d3873d3f-2b48-4d60-b076-6b2bf69591b2 could not be found. Oct 10 23:25:58.599059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-00ec4b78-a106-419b-9405-75947125579c tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Request method failure captured: Oct 10 23:25:58.599059 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2 HTTP/1.1 Oct 10 23:25:58.599059 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:25:58.599059 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:25:58.599059 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:25:58.599059 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:25:58.599059 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:25:58.599059 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:25:58.599059 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:25:58.599059 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:25:58.599059 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKniCgtbd0nWcS4AtecHGlkefMdmLyWvxBQPf8sZZzxxp62fYc02jpVslfQVI-Z5YhhcPVeg9sBit6V2yJkhah0TpFT9GlEDtSunjCEs-n0UstCiMUpHpKcva1CiK5tZFKtUkomWRvkY0PMUj3hHPnm7Co_Kx6KrMdbeXJ2Ng-OJumc Oct 10 23:25:58.599059 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:25:58.599059 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:25:58.599059 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:25:58.599059 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:25:58.599059 n-d-860864-2 devstack@n-api.service[120613]: X-Openstack-Nova-Api-Version: 2.21 Oct 10 23:25:58.599059 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:25:58.599059 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:25:58.599059 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 2481a2904215494d8bdf9876a8be0822 Oct 10 23:25:58.599059 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1799952587 Oct 10 23:25:58.599059 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:25:58.599059 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:25:58.600619 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2481a2904215494d8bdf9876a8be0822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2481a2904215494d8bdf9876a8be0822"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2481a2904215494d8bdf9876a8be0822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2481a2904215494d8bdf9876a8be0822", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:25:58.600619 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-InstanceActionsV221TestJSON-1799952587 Oct 10 23:25:58.600619 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 2481a2904215494d8bdf9876a8be0822 Oct 10 23:25:58.600619 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1799952587 Oct 10 23:25:58.600619 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-InstanceActionsV221TestJSON-1799952587-project Oct 10 23:25:58.600619 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:25:58.600619 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:25:58.600619 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 5508f1f7e16d4b98ad363f9647609ca8 Oct 10 23:25:58.600619 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-InstanceActionsV221TestJSON-1799952587-project Oct 10 23:25:58.600619 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:25:58.600619 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance d3873d3f-2b48-4d60-b076-6b2bf69591b2 could not be found. Oct 10 23:25:58.600619 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'd3873d3f-2b48-4d60-b076-6b2bf69591b2'} Oct 10 23:25:58.601458 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:25:58.601458 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:58.601458 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:25:58.601458 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:25:58.601458 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:25:58.601458 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:25:58.601458 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:25:58.601458 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:25:58.601458 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:25:58.601458 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:25:58.601458 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3873d3f-2b48-4d60-b076-6b2bf69591b2 could not be found. Oct 10 23:25:58.601458 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:58.601458 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:58.601458 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:58.601458 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:58.601458 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:58.601458 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:58.601458 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:25:58.601458 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:25:58.601458 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:25:58.602796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:25:58.602796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:25:58.602796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:25:58.602796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:25:58.602796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:25:58.602796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:25:58.602796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:25:58.602796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3873d3f-2b48-4d60-b076-6b2bf69591b2 could not be found. Oct 10 23:25:58.602796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:58.602796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:58.602796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:58.602796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:58.602796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:58.602796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:58.602796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:25:58.602796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:25:58.602796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3873d3f-2b48-4d60-b076-6b2bf69591b2 could not be found. Oct 10 23:25:58.602796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:58.605412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-00ec4b78-a106-419b-9405-75947125579c tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Returning 404 to user: Instance d3873d3f-2b48-4d60-b076-6b2bf69591b2 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:25:58.606946 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-00ec4b78-a106-419b-9405-75947125579c tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] 10.222.0.23 "GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2" status: 404 len: 111 microversion: 2.21 time: 0.055177 Oct 10 23:25:58.608616 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1191/2380] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:58 2022] GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:25:58.615538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ece0e447-0140-4e9a-a224-569dcf0ccfdc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:58.617330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ece0e447-0140-4e9a-a224-569dcf0ccfdc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:58.628438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ece0e447-0140-4e9a-a224-569dcf0ccfdc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:58.629188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ece0e447-0140-4e9a-a224-569dcf0ccfdc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:58.629837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ece0e447-0140-4e9a-a224-569dcf0ccfdc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:58.630755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ece0e447-0140-4e9a-a224-569dcf0ccfdc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:58.631371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ece0e447-0140-4e9a-a224-569dcf0ccfdc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:58.632455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ece0e447-0140-4e9a-a224-569dcf0ccfdc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:58.740131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ece0e447-0140-4e9a-a224-569dcf0ccfdc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:58.752119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ece0e447-0140-4e9a-a224-569dcf0ccfdc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:58.754226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ece0e447-0140-4e9a-a224-569dcf0ccfdc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:58.762253 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ece0e447-0140-4e9a-a224-569dcf0ccfdc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.150648 Oct 10 23:25:58.763147 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1192/2381] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:58 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:58.769325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-47c24f41-753b-416d-99ea-92fb9126ff4e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662ac81ee0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:58.863654 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-47c24f41-753b-416d-99ea-92fb9126ff4e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510" status: 200 len: 1448 microversion: 2.1 time: 0.099057 Oct 10 23:25:58.864987 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1193/2382] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:25:58 2022] GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510 => generated 1448 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:58.973055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e6c344b2-dd6a-4cbb-9fde-80f006c60d49 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:58.985223 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e6c344b2-dd6a-4cbb-9fde-80f006c60d49 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.117771 Oct 10 23:25:58.992003 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1194/2383] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:25:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:25:59.003949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d70cd573-8881-4172-a636-35f5674dea67 tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Calling method '.version_select at 0x7f662b596ca0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:59.011623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-abc6ba4c-1783-40a0-ae84-07743f62d13a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:59.028302 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-abc6ba4c-1783-40a0-ae84-07743f62d13a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1680 microversion: 2.1 time: 1.265085 Oct 10 23:25:59.029146 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1190/2384] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:57 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1680 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:59.038231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3f9ff2c1-18db-4cf2-8410-086f907e72ee tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Calling method '.version_select at 0x7f662a7ae3a0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:59.042396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3f9ff2c1-18db-4cf2-8410-086f907e72ee tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] [instance: d3873d3f-2b48-4d60-b076-6b2bf69591b2] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:59.063941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f9ff2c1-18db-4cf2-8410-086f907e72ee tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:59.064622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f9ff2c1-18db-4cf2-8410-086f907e72ee tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:59.065220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f9ff2c1-18db-4cf2-8410-086f907e72ee tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:59.066115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f9ff2c1-18db-4cf2-8410-086f907e72ee tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:59.066716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f9ff2c1-18db-4cf2-8410-086f907e72ee tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:59.067311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f9ff2c1-18db-4cf2-8410-086f907e72ee tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:59.154055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d70cd573-8881-4172-a636-35f5674dea67 tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:59.164986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d70cd573-8881-4172-a636-35f5674dea67 tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:59.165644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d70cd573-8881-4172-a636-35f5674dea67 tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:59.166560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d70cd573-8881-4172-a636-35f5674dea67 tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:59.166977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d70cd573-8881-4172-a636-35f5674dea67 tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:59.177891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d70cd573-8881-4172-a636-35f5674dea67 tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:59.236507 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d70cd573-8881-4172-a636-35f5674dea67 tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/2e7f9cea845b4186b638dafb938f00d8/detail" status: 200 len: 672 microversion: 2.36 time: 0.236866 Oct 10 23:25:59.238256 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1195/2385] 10.222.0.23 () {60 vars in 1304 bytes} [Mon Oct 10 23:25:58 2022] GET /compute/v2.1/os-quota-sets/2e7f9cea845b4186b638dafb938f00d8/detail => generated 672 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:25:59.254364 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3f9ff2c1-18db-4cf2-8410-086f907e72ee tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] 10.222.0.23 "GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.223795 Oct 10 23:25:59.264040 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1191/2386] 10.222.0.23 () {60 vars in 1337 bytes} [Mon Oct 10 23:25:59 2022] GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2/os-instance-actions => generated 611 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:25:59.270780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c1b1bc61-9ce1-4c87-8609-f3a86dd8bf44 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662a7ec1f0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:59.277355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1c64254e-fcf9-4429-a913-effb88a07bec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:59.280869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1c64254e-fcf9-4429-a913-effb88a07bec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:59.290624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c64254e-fcf9-4429-a913-effb88a07bec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:59.292652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c64254e-fcf9-4429-a913-effb88a07bec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:59.294852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c64254e-fcf9-4429-a913-effb88a07bec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:59.296070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c64254e-fcf9-4429-a913-effb88a07bec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:59.297605 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c64254e-fcf9-4429-a913-effb88a07bec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:59.305252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c64254e-fcf9-4429-a913-effb88a07bec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:59.361120 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c1b1bc61-9ce1-4c87-8609-f3a86dd8bf44 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510" status: 200 len: 1448 microversion: 2.1 time: 0.095657 Oct 10 23:25:59.368325 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1192/2387] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:25:59 2022] GET /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510 => generated 1448 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:59.379309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5a2cf90b-c35d-46fa-8521-01b8c212f822 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:59.459013 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5a2cf90b-c35d-46fa-8521-01b8c212f822 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.089313 Oct 10 23:25:59.461190 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1193/2388] 10.222.0.23 () {58 vars in 1125 bytes} [Mon Oct 10 23:25:59 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:25:59.469729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8485f5a2-2303-40af-a0fd-5a80256681ec tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:59.474594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8485f5a2-2303-40af-a0fd-5a80256681ec tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] [instance: d3873d3f-2b48-4d60-b076-6b2bf69591b2] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:59.485189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8485f5a2-2303-40af-a0fd-5a80256681ec tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:59.486288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8485f5a2-2303-40af-a0fd-5a80256681ec tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:59.487314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8485f5a2-2303-40af-a0fd-5a80256681ec tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:59.488183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8485f5a2-2303-40af-a0fd-5a80256681ec tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:59.488708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8485f5a2-2303-40af-a0fd-5a80256681ec tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:59.489348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8485f5a2-2303-40af-a0fd-5a80256681ec tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:59.509155 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-8485f5a2-2303-40af-a0fd-5a80256681ec tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] HTTP exception thrown: Instance d3873d3f-2b48-4d60-b076-6b2bf69591b2 could not be found. Oct 10 23:25:59.512497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8485f5a2-2303-40af-a0fd-5a80256681ec tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Request method failure captured: Oct 10 23:25:59.512497 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2 HTTP/1.1 Oct 10 23:25:59.512497 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:25:59.512497 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:25:59.512497 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:25:59.512497 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:25:59.512497 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:25:59.512497 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:25:59.512497 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:25:59.512497 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:25:59.512497 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKniCgtbd0nWcS4AtecHGlkefMdmLyWvxBQPf8sZZzxxp62fYc02jpVslfQVI-Z5YhhcPVeg9sBit6V2yJkhah0TpFT9GlEDtSunjCEs-n0UstCiMUpHpKcva1CiK5tZFKtUkomWRvkY0PMUj3hHPnm7Co_Kx6KrMdbeXJ2Ng-OJumc Oct 10 23:25:59.512497 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:25:59.512497 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:25:59.512497 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:25:59.512497 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:25:59.512497 n-d-860864-2 devstack@n-api.service[120614]: X-Openstack-Nova-Api-Version: 2.21 Oct 10 23:25:59.512497 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:25:59.512497 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:25:59.512497 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 2481a2904215494d8bdf9876a8be0822 Oct 10 23:25:59.512497 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1799952587 Oct 10 23:25:59.512497 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:25:59.512497 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:25:59.513907 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2481a2904215494d8bdf9876a8be0822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2481a2904215494d8bdf9876a8be0822"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2481a2904215494d8bdf9876a8be0822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2481a2904215494d8bdf9876a8be0822", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:25:59.513907 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-InstanceActionsV221TestJSON-1799952587 Oct 10 23:25:59.513907 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 2481a2904215494d8bdf9876a8be0822 Oct 10 23:25:59.513907 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1799952587 Oct 10 23:25:59.513907 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-InstanceActionsV221TestJSON-1799952587-project Oct 10 23:25:59.513907 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:25:59.513907 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:25:59.513907 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 5508f1f7e16d4b98ad363f9647609ca8 Oct 10 23:25:59.513907 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-InstanceActionsV221TestJSON-1799952587-project Oct 10 23:25:59.513907 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:25:59.513907 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance d3873d3f-2b48-4d60-b076-6b2bf69591b2 could not be found. Oct 10 23:25:59.513907 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'd3873d3f-2b48-4d60-b076-6b2bf69591b2'} Oct 10 23:25:59.514595 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:25:59.514595 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:59.514595 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:25:59.514595 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:25:59.514595 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:25:59.514595 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:25:59.514595 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:25:59.514595 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:25:59.514595 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:25:59.514595 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:25:59.514595 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3873d3f-2b48-4d60-b076-6b2bf69591b2 could not be found. Oct 10 23:25:59.514595 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:59.514595 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:59.514595 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:59.514595 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:59.514595 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:59.514595 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:59.514595 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:25:59.514595 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:25:59.514595 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:25:59.517666 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:25:59.517666 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:25:59.517666 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:25:59.517666 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:25:59.517666 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:25:59.517666 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:25:59.517666 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:25:59.517666 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:25:59.517666 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:25:59.517666 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3873d3f-2b48-4d60-b076-6b2bf69591b2 could not be found. Oct 10 23:25:59.517666 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:59.517666 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:59.517666 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:59.517666 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:59.517666 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:59.517666 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:59.517666 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:25:59.517666 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:25:59.517666 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3873d3f-2b48-4d60-b076-6b2bf69591b2 could not be found. Oct 10 23:25:59.517666 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:25:59.521499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8485f5a2-2303-40af-a0fd-5a80256681ec tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Returning 404 to user: Instance d3873d3f-2b48-4d60-b076-6b2bf69591b2 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:25:59.522816 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8485f5a2-2303-40af-a0fd-5a80256681ec tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2" status: 404 len: 111 microversion: 2.21 time: 0.059225 Oct 10 23:25:59.523907 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1194/2389] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:25:59 2022] DELETE /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:25:59.528924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ea067b2f-4071-429c-bd90-56e0a6ee1b2b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662a7ae430>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:59.664264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1c64254e-fcf9-4429-a913-effb88a07bec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:59.676403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1c64254e-fcf9-4429-a913-effb88a07bec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:59.685751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1c64254e-fcf9-4429-a913-effb88a07bec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:25:59.687018 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1c64254e-fcf9-4429-a913-effb88a07bec tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1733 microversion: 2.25 time: 0.447614 Oct 10 23:25:59.687966 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1196/2390] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:59 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1733 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:25:59.694977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e0ff88b2-ff44-4a20-8a30-91377845756e tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:59.712504 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e0ff88b2-ff44-4a20-8a30-91377845756e tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023554 Oct 10 23:25:59.713103 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1197/2391] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:25:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:25:59.736251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8c00e4d2-03df-4d96-88bf-aaadd26b2999 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:25:59.736976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8c00e4d2-03df-4d96-88bf-aaadd26b2999 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] [instance: d3873d3f-2b48-4d60-b076-6b2bf69591b2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:25:59.752343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c00e4d2-03df-4d96-88bf-aaadd26b2999 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:59.753447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c00e4d2-03df-4d96-88bf-aaadd26b2999 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:59.755419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c00e4d2-03df-4d96-88bf-aaadd26b2999 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:59.756396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c00e4d2-03df-4d96-88bf-aaadd26b2999 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:59.757868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c00e4d2-03df-4d96-88bf-aaadd26b2999 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:59.758537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c00e4d2-03df-4d96-88bf-aaadd26b2999 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:59.787771 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-8c00e4d2-03df-4d96-88bf-aaadd26b2999 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] HTTP exception thrown: Instance d3873d3f-2b48-4d60-b076-6b2bf69591b2 could not be found. Oct 10 23:25:59.790445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8c00e4d2-03df-4d96-88bf-aaadd26b2999 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Request method failure captured: Oct 10 23:25:59.790445 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2 HTTP/1.1 Oct 10 23:25:59.790445 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:25:59.790445 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:25:59.790445 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:25:59.790445 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:25:59.790445 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:25:59.790445 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:25:59.790445 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:25:59.790445 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:25:59.790445 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKniCgtbd0nWcS4AtecHGlkefMdmLyWvxBQPf8sZZzxxp62fYc02jpVslfQVI-Z5YhhcPVeg9sBit6V2yJkhah0TpFT9GlEDtSunjCEs-n0UstCiMUpHpKcva1CiK5tZFKtUkomWRvkY0PMUj3hHPnm7Co_Kx6KrMdbeXJ2Ng-OJumc Oct 10 23:25:59.790445 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:25:59.790445 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:25:59.790445 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:25:59.790445 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:25:59.790445 n-d-860864-2 devstack@n-api.service[120613]: X-Openstack-Nova-Api-Version: 2.21 Oct 10 23:25:59.790445 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:25:59.790445 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:25:59.790445 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 2481a2904215494d8bdf9876a8be0822 Oct 10 23:25:59.790445 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1799952587 Oct 10 23:25:59.790445 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:25:59.790445 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:25:59.791927 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2481a2904215494d8bdf9876a8be0822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2481a2904215494d8bdf9876a8be0822"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2481a2904215494d8bdf9876a8be0822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2481a2904215494d8bdf9876a8be0822", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:25:59.791927 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-InstanceActionsV221TestJSON-1799952587 Oct 10 23:25:59.791927 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 2481a2904215494d8bdf9876a8be0822 Oct 10 23:25:59.791927 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1799952587 Oct 10 23:25:59.791927 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-InstanceActionsV221TestJSON-1799952587-project Oct 10 23:25:59.791927 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:25:59.791927 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:25:59.791927 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 5508f1f7e16d4b98ad363f9647609ca8 Oct 10 23:25:59.791927 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-InstanceActionsV221TestJSON-1799952587-project Oct 10 23:25:59.791927 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:25:59.791927 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance d3873d3f-2b48-4d60-b076-6b2bf69591b2 could not be found. Oct 10 23:25:59.791927 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'd3873d3f-2b48-4d60-b076-6b2bf69591b2'} Oct 10 23:25:59.793004 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:25:59.793004 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:59.793004 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:25:59.793004 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:25:59.793004 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:25:59.793004 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:25:59.793004 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:25:59.793004 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:25:59.793004 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:25:59.793004 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:25:59.793004 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3873d3f-2b48-4d60-b076-6b2bf69591b2 could not be found. Oct 10 23:25:59.793004 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:59.793004 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:59.793004 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:59.793004 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:59.793004 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:59.793004 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:59.793004 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:25:59.793004 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:25:59.793004 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:25:59.794371 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:25:59.794371 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:25:59.794371 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:25:59.794371 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:25:59.794371 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:25:59.794371 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:25:59.794371 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:25:59.794371 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3873d3f-2b48-4d60-b076-6b2bf69591b2 could not be found. Oct 10 23:25:59.794371 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:59.794371 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:25:59.794371 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:59.794371 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:25:59.794371 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:25:59.794371 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:25:59.794371 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:25:59.794371 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:25:59.794371 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3873d3f-2b48-4d60-b076-6b2bf69591b2 could not be found. Oct 10 23:25:59.794371 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:25:59.797328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8c00e4d2-03df-4d96-88bf-aaadd26b2999 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] Returning 404 to user: Instance d3873d3f-2b48-4d60-b076-6b2bf69591b2 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:25:59.799545 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8c00e4d2-03df-4d96-88bf-aaadd26b2999 tempest-InstanceActionsV221TestJSON-1799952587 tempest-InstanceActionsV221TestJSON-1799952587-project] 10.222.0.23 "GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2" status: 404 len: 111 microversion: 2.21 time: 0.084722 Oct 10 23:25:59.801673 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1198/2392] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:25:59 2022] GET /compute/v2.1/servers/d3873d3f-2b48-4d60-b076-6b2bf69591b2 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:25:59.814918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-51cde68a-971b-4a4c-9d52-4c7c7f2a5bbc tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Action: 'update', calling method: .version_select at 0x7f662aca9f70>, body: {"quota_set": {"ram": "2048"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:25:59.970145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51cde68a-971b-4a4c-9d52-4c7c7f2a5bbc tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:59.974862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51cde68a-971b-4a4c-9d52-4c7c7f2a5bbc tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:59.978727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51cde68a-971b-4a4c-9d52-4c7c7f2a5bbc tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:25:59.982163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51cde68a-971b-4a4c-9d52-4c7c7f2a5bbc tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:25:59.983334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51cde68a-971b-4a4c-9d52-4c7c7f2a5bbc tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:25:59.985497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51cde68a-971b-4a4c-9d52-4c7c7f2a5bbc tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:00.058194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51cde68a-971b-4a4c-9d52-4c7c7f2a5bbc tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:00.061890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51cde68a-971b-4a4c-9d52-4c7c7f2a5bbc tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:00.064204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51cde68a-971b-4a4c-9d52-4c7c7f2a5bbc tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:00.065229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51cde68a-971b-4a4c-9d52-4c7c7f2a5bbc tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:00.066161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51cde68a-971b-4a4c-9d52-4c7c7f2a5bbc tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:00.068440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51cde68a-971b-4a4c-9d52-4c7c7f2a5bbc tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:00.253482 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-51cde68a-971b-4a4c-9d52-4c7c7f2a5bbc tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/2e7f9cea845b4186b638dafb938f00d8?user_id=9ef2435b588a48b097bf6e1ef92ff7b4" status: 200 len: 240 microversion: 2.36 time: 0.447135 Oct 10 23:26:00.257653 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1199/2393] 10.222.0.23 () {62 vars in 1384 bytes} [Mon Oct 10 23:25:59 2022] PUT /compute/v2.1/os-quota-sets/2e7f9cea845b4186b638dafb938f00d8?user_id=9ef2435b588a48b097bf6e1ef92ff7b4 => generated 240 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:26:00.274312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f43186ac-f902-426c-ac8a-b4f66d222df4 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:00.290023 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f43186ac-f902-426c-ac8a-b4f66d222df4 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030811 Oct 10 23:26:00.296114 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1200/2394] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:26:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:00.318136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-188f77f6-f1ea-474d-b4ce-a5365d721ef4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:00.320741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-188f77f6-f1ea-474d-b4ce-a5365d721ef4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:00.337298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-188f77f6-f1ea-474d-b4ce-a5365d721ef4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:00.338117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-188f77f6-f1ea-474d-b4ce-a5365d721ef4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:00.338845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-188f77f6-f1ea-474d-b4ce-a5365d721ef4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:00.339954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-188f77f6-f1ea-474d-b4ce-a5365d721ef4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:00.340612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-188f77f6-f1ea-474d-b4ce-a5365d721ef4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:00.341369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-188f77f6-f1ea-474d-b4ce-a5365d721ef4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:00.616018 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ea067b2f-4071-429c-bd90-56e0a6ee1b2b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "DELETE /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510" status: 204 len: 0 microversion: 2.1 time: 1.090688 Oct 10 23:26:00.616845 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1195/2395] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:25:59 2022] DELETE /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510 => generated 0 bytes in 1092 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:26:00.627990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8669abbf-8a44-445e-907a-6677faa09e50 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:00.628619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8669abbf-8a44-445e-907a-6677faa09e50 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:00.642739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8669abbf-8a44-445e-907a-6677faa09e50 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:00.643493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8669abbf-8a44-445e-907a-6677faa09e50 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:00.644079 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8669abbf-8a44-445e-907a-6677faa09e50 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:00.644968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8669abbf-8a44-445e-907a-6677faa09e50 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:00.645648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8669abbf-8a44-445e-907a-6677faa09e50 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:00.646218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8669abbf-8a44-445e-907a-6677faa09e50 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:00.653652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-188f77f6-f1ea-474d-b4ce-a5365d721ef4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:00.663841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-188f77f6-f1ea-474d-b4ce-a5365d721ef4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:00.665288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-188f77f6-f1ea-474d-b4ce-a5365d721ef4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:00.692332 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-188f77f6-f1ea-474d-b4ce-a5365d721ef4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.393233 Oct 10 23:26:00.692932 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1201/2396] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:00 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:00.720360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1bac4202-cc8b-4f9e-a24e-9ef087379dc9 tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] Calling method '.version_select at 0x7f662ac81d30>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:00.847769 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1bac4202-cc8b-4f9e-a24e-9ef087379dc9 tempest-QuotasAdminTestV236-785021563 tempest-QuotasAdminTestV236-785021563-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/2e7f9cea845b4186b638dafb938f00d8?user_id=9ef2435b588a48b097bf6e1ef92ff7b4" status: 200 len: 282 microversion: 2.36 time: 0.132643 Oct 10 23:26:00.849150 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1202/2397] 10.222.0.23 () {60 vars in 1364 bytes} [Mon Oct 10 23:26:00 2022] GET /compute/v2.1/os-quota-sets/2e7f9cea845b4186b638dafb938f00d8?user_id=9ef2435b588a48b097bf6e1ef92ff7b4 => generated 282 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:26:00.860312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0c74f145-8cba-4ceb-87d5-4e198fddbb92 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:00.901095 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0c74f145-8cba-4ceb-87d5-4e198fddbb92 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.050485 Oct 10 23:26:00.902835 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1203/2398] 10.222.0.23 () {58 vars in 1165 bytes} [Mon Oct 10 23:26:00 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:00.910961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9da34e07-4784-493a-a559-5a36de5ff2af tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:00.911770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9da34e07-4784-493a-a559-5a36de5ff2af tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 5242250f-5274-4992-adb3-e8fdd3b65ed7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:00.923117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9da34e07-4784-493a-a559-5a36de5ff2af tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:00.923869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9da34e07-4784-493a-a559-5a36de5ff2af tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:00.924532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9da34e07-4784-493a-a559-5a36de5ff2af tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:00.925712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9da34e07-4784-493a-a559-5a36de5ff2af tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:00.926401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9da34e07-4784-493a-a559-5a36de5ff2af tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:00.927075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9da34e07-4784-493a-a559-5a36de5ff2af tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:00.983341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9da34e07-4784-493a-a559-5a36de5ff2af tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 5242250f-5274-4992-adb3-e8fdd3b65ed7] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:26:01.114636 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9da34e07-4784-493a-a559-5a36de5ff2af tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7" status: 204 len: 0 microversion: 2.1 time: 0.209173 Oct 10 23:26:01.127857 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1204/2399] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:26:00 2022] DELETE /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:26:01.172573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2ee38605-dd7b-4fe8-bde9-6b25e010042d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:01.174670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2ee38605-dd7b-4fe8-bde9-6b25e010042d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:01.195116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ee38605-dd7b-4fe8-bde9-6b25e010042d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:01.195867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ee38605-dd7b-4fe8-bde9-6b25e010042d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:01.198379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ee38605-dd7b-4fe8-bde9-6b25e010042d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:01.201902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ee38605-dd7b-4fe8-bde9-6b25e010042d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:01.202583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ee38605-dd7b-4fe8-bde9-6b25e010042d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:01.210334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ee38605-dd7b-4fe8-bde9-6b25e010042d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:01.385297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8669abbf-8a44-445e-907a-6677faa09e50 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:01.406513 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8669abbf-8a44-445e-907a-6677faa09e50 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1657 microversion: 2.1 time: 0.782626 Oct 10 23:26:01.408632 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1196/2400] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:00 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1657 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:01.421703 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-37e8ca3d-cb97-4bbd-b5ac-05c5a07c229f tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:01.448182 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-37e8ca3d-cb97-4bbd-b5ac-05c5a07c229f tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036742 Oct 10 23:26:01.458564 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1197/2401] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:26:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:01.463601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-65c3295e-29c7-4b4b-b587-5b0c02d16333 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:01.486561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65c3295e-29c7-4b4b-b587-5b0c02d16333 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:01.489499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65c3295e-29c7-4b4b-b587-5b0c02d16333 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:01.490677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65c3295e-29c7-4b4b-b587-5b0c02d16333 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:01.547365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-65c3295e-29c7-4b4b-b587-5b0c02d16333 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Going to try to start instance {{(pid=120614) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 10 23:26:01.629253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:01.636054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2ee38605-dd7b-4fe8-bde9-6b25e010042d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:01.673219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2ee38605-dd7b-4fe8-bde9-6b25e010042d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:01.679719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2ee38605-dd7b-4fe8-bde9-6b25e010042d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:01.688799 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2ee38605-dd7b-4fe8-bde9-6b25e010042d tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1665 microversion: 2.25 time: 0.529669 Oct 10 23:26:01.689469 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1205/2402] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:01 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1665 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:01.719770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f79d52d7-e87d-4880-9126-19c6315b3e0e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1254271456", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "2e70e5c7-da0e-4bbe-970c-c601496b5c6b"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:01.721185 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-65c3295e-29c7-4b4b-b587-5b0c02d16333 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "POST /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc/action" status: 202 len: 0 microversion: 2.1 time: 0.260045 Oct 10 23:26:01.726598 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1198/2403] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:26:01 2022] POST /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:26:01.736173 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8826d062-2db5-42fe-8613-7b7fea1bc18d tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:01.781587 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8826d062-2db5-42fe-8613-7b7fea1bc18d tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.056589 Oct 10 23:26:01.783029 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1199/2404] 10.222.0.23 () {58 vars in 1169 bytes} [Mon Oct 10 23:26:01 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:01.793486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-514d1cef-1a9f-4d0e-80a4-28c32da4e57f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:01.794552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-514d1cef-1a9f-4d0e-80a4-28c32da4e57f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:01.803877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-514d1cef-1a9f-4d0e-80a4-28c32da4e57f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:01.804873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-514d1cef-1a9f-4d0e-80a4-28c32da4e57f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:01.806132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-514d1cef-1a9f-4d0e-80a4-28c32da4e57f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:01.807283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-514d1cef-1a9f-4d0e-80a4-28c32da4e57f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:01.808051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-514d1cef-1a9f-4d0e-80a4-28c32da4e57f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:01.809592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-514d1cef-1a9f-4d0e-80a4-28c32da4e57f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:01.867796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-f79d52d7-e87d-4880-9126-19c6315b3e0e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] validate_networks() for [('2e70e5c7-da0e-4bbe-970c-c601496b5c6b', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:26:01.966242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-514d1cef-1a9f-4d0e-80a4-28c32da4e57f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:01.984702 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-514d1cef-1a9f-4d0e-80a4-28c32da4e57f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:01.990050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-514d1cef-1a9f-4d0e-80a4-28c32da4e57f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:02.007699 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-514d1cef-1a9f-4d0e-80a4-28c32da4e57f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.223742 Oct 10 23:26:02.008311 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1200/2405] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:01 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:02.017046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cadabebc-0a81-4c05-bb2a-414a642e3634 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:02.023654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cadabebc-0a81-4c05-bb2a-414a642e3634 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:02.044916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cadabebc-0a81-4c05-bb2a-414a642e3634 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:02.045497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cadabebc-0a81-4c05-bb2a-414a642e3634 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:02.049327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cadabebc-0a81-4c05-bb2a-414a642e3634 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:02.050232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cadabebc-0a81-4c05-bb2a-414a642e3634 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:02.052307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cadabebc-0a81-4c05-bb2a-414a642e3634 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:02.053131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cadabebc-0a81-4c05-bb2a-414a642e3634 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:02.690654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cadabebc-0a81-4c05-bb2a-414a642e3634 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:02.710627 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cadabebc-0a81-4c05-bb2a-414a642e3634 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1666 microversion: 2.1 time: 0.701233 Oct 10 23:26:02.714152 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1201/2406] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:02 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1666 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:02.726838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cf84bc7a-66d9-4b7c-96c9-c26aab268689 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:02.767947 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cf84bc7a-66d9-4b7c-96c9-c26aab268689 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.047510 Oct 10 23:26:02.786347 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1202/2407] 10.222.0.23 () {58 vars in 1161 bytes} [Mon Oct 10 23:26:02 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:02.798422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-a2e4c622-889b-45ce-8ca8-d3f0a7e3ae2f req-2ec29508-5695-4689-aa23-bd80ce5ecc31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58fcd7f0-d348-47b1-9b3d-f7514b940eb3", "name": "network-vif-deleted", "tag": "4ddf9b37-7413-4cc7-829c-ce7603a65f55"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:02.858674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a2e4c622-889b-45ce-8ca8-d3f0a7e3ae2f req-2ec29508-5695-4689-aa23-bd80ce5ecc31 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:02.859242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a2e4c622-889b-45ce-8ca8-d3f0a7e3ae2f req-2ec29508-5695-4689-aa23-bd80ce5ecc31 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:02.859685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a2e4c622-889b-45ce-8ca8-d3f0a7e3ae2f req-2ec29508-5695-4689-aa23-bd80ce5ecc31 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:02.874527 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-a2e4c622-889b-45ce-8ca8-d3f0a7e3ae2f req-2ec29508-5695-4689-aa23-bd80ce5ecc31 service nova] Creating event network-vif-deleted:4ddf9b37-7413-4cc7-829c-ce7603a65f55 for instance 58fcd7f0-d348-47b1-9b3d-f7514b940eb3 on n-h1-860864-2 Oct 10 23:26:02.898061 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-a2e4c622-889b-45ce-8ca8-d3f0a7e3ae2f req-2ec29508-5695-4689-aa23-bd80ce5ecc31 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109794 Oct 10 23:26:02.899300 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1203/2408] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:02.909144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eb6f99a1-fd41-430a-8628-37bafcb6e011 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:02.910939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eb6f99a1-fd41-430a-8628-37bafcb6e011 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:02.920160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb6f99a1-fd41-430a-8628-37bafcb6e011 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:02.922511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb6f99a1-fd41-430a-8628-37bafcb6e011 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:02.926925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb6f99a1-fd41-430a-8628-37bafcb6e011 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:02.928640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb6f99a1-fd41-430a-8628-37bafcb6e011 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:02.932586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb6f99a1-fd41-430a-8628-37bafcb6e011 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:02.933305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb6f99a1-fd41-430a-8628-37bafcb6e011 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:02.999185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb6f99a1-fd41-430a-8628-37bafcb6e011 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:03.001335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb6f99a1-fd41-430a-8628-37bafcb6e011 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:03.002108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb6f99a1-fd41-430a-8628-37bafcb6e011 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:03.003475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-eb6f99a1-fd41-430a-8628-37bafcb6e011 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lazy-loading 'fault' on Instance uuid 58fcd7f0-d348-47b1-9b3d-f7514b940eb3 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:26:03.176229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-eb6f99a1-fd41-430a-8628-37bafcb6e011 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:03.202130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-eb6f99a1-fd41-430a-8628-37bafcb6e011 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:03.202130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-eb6f99a1-fd41-430a-8628-37bafcb6e011 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:03.209339 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eb6f99a1-fd41-430a-8628-37bafcb6e011 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 200 len: 1376 microversion: 2.25 time: 0.308384 Oct 10 23:26:03.213575 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1204/2409] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:02 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 1376 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:03.229967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-021fcb4f-c2e2-4cde-a5b9-d3f949c0156e tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:03.243574 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-021fcb4f-c2e2-4cde-a5b9-d3f949c0156e tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029010 Oct 10 23:26:03.244169 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1205/2410] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:26:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:03.269305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-570a4245-b43b-416a-8115-ea3c0755e83b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:03.272460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-570a4245-b43b-416a-8115-ea3c0755e83b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:03.286304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-570a4245-b43b-416a-8115-ea3c0755e83b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:03.287165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-570a4245-b43b-416a-8115-ea3c0755e83b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:03.303707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-570a4245-b43b-416a-8115-ea3c0755e83b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:03.304946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-570a4245-b43b-416a-8115-ea3c0755e83b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:03.305850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-570a4245-b43b-416a-8115-ea3c0755e83b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:03.306499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-570a4245-b43b-416a-8115-ea3c0755e83b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:03.708484 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-570a4245-b43b-416a-8115-ea3c0755e83b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:03.729860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-570a4245-b43b-416a-8115-ea3c0755e83b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:03.736320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-570a4245-b43b-416a-8115-ea3c0755e83b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:03.749510 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-570a4245-b43b-416a-8115-ea3c0755e83b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.495378 Oct 10 23:26:03.751739 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1206/2411] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:03 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:03.774676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2c2f91de-6e55-4cbe-bf0d-4b12155d383d tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:03.794450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-f79d52d7-e87d-4880-9126-19c6315b3e0e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:26:03.795308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-f79d52d7-e87d-4880-9126-19c6315b3e0e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:26:03.795473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-f79d52d7-e87d-4880-9126-19c6315b3e0e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:26:03.795886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-f79d52d7-e87d-4880-9126-19c6315b3e0e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:26:03.797562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-f79d52d7-e87d-4880-9126-19c6315b3e0e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:26:03.824641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f79d52d7-e87d-4880-9126-19c6315b3e0e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:03.825419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f79d52d7-e87d-4880-9126-19c6315b3e0e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:03.826081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f79d52d7-e87d-4880-9126-19c6315b3e0e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:03.827067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f79d52d7-e87d-4880-9126-19c6315b3e0e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:03.827777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f79d52d7-e87d-4880-9126-19c6315b3e0e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:03.828567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f79d52d7-e87d-4880-9126-19c6315b3e0e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:03.876790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-f79d52d7-e87d-4880-9126-19c6315b3e0e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Getting quotas for project 451d034bd7474164a08bd3374680c0d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:26:03.886941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-f79d52d7-e87d-4880-9126-19c6315b3e0e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Getting quotas for user 60c692636a4b4667a4eff5cde6e183bc and project 451d034bd7474164a08bd3374680c0d2. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:26:03.910999 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2c2f91de-6e55-4cbe-bf0d-4b12155d383d tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.156985 Oct 10 23:26:03.917221 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1207/2412] 10.222.0.23 () {58 vars in 1167 bytes} [Mon Oct 10 23:26:03 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:03.919401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f79d52d7-e87d-4880-9126-19c6315b3e0e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:26:03.923108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-6c6d1a59-b635-4d7d-a049-5cb90e15ad30 req-2d5e0c27-2c00-4de6-9fa7-356be1f5d078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5242250f-5274-4992-adb3-e8fdd3b65ed7", "name": "network-vif-unplugged", "status": "completed", "tag": "90f86f41-ee10-436d-af23-bca655e7f68b"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:03.933747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f79d52d7-e87d-4880-9126-19c6315b3e0e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:26:03.949892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6c6d1a59-b635-4d7d-a049-5cb90e15ad30 req-2d5e0c27-2c00-4de6-9fa7-356be1f5d078 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:03.950894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6c6d1a59-b635-4d7d-a049-5cb90e15ad30 req-2d5e0c27-2c00-4de6-9fa7-356be1f5d078 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:03.950894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6c6d1a59-b635-4d7d-a049-5cb90e15ad30 req-2d5e0c27-2c00-4de6-9fa7-356be1f5d078 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:03.964664 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-6c6d1a59-b635-4d7d-a049-5cb90e15ad30 req-2d5e0c27-2c00-4de6-9fa7-356be1f5d078 service nova] Creating event network-vif-unplugged:90f86f41-ee10-436d-af23-bca655e7f68b for instance 5242250f-5274-4992-adb3-e8fdd3b65ed7 on n-h2-860864-2 Oct 10 23:26:03.974003 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-6c6d1a59-b635-4d7d-a049-5cb90e15ad30 req-2d5e0c27-2c00-4de6-9fa7-356be1f5d078 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054040 Oct 10 23:26:03.981307 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1208/2413] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:03.983606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:03.991088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-25763c5b-fe66-4785-81d6-8a42f219bd63 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:03.991819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-25763c5b-fe66-4785-81d6-8a42f219bd63 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:04.023069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25763c5b-fe66-4785-81d6-8a42f219bd63 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:04.023582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25763c5b-fe66-4785-81d6-8a42f219bd63 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:04.024031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25763c5b-fe66-4785-81d6-8a42f219bd63 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:04.024752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25763c5b-fe66-4785-81d6-8a42f219bd63 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:04.025212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25763c5b-fe66-4785-81d6-8a42f219bd63 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:04.025690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25763c5b-fe66-4785-81d6-8a42f219bd63 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:04.059705 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f79d52d7-e87d-4880-9126-19c6315b3e0e tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.366433 Oct 10 23:26:04.060383 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1206/2414] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:26:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:26:04.071441 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0437bc0b-1abf-4881-947c-938ec929cd16 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:04.087694 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0437bc0b-1abf-4881-947c-938ec929cd16 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025442 Oct 10 23:26:04.102535 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1207/2415] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:26:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:04.114316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2b49e342-1e9b-4a23-be6f-196153f74304 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:04.115493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2b49e342-1e9b-4a23-be6f-196153f74304 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:04.235985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2b49e342-1e9b-4a23-be6f-196153f74304 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:04.244475 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2b49e342-1e9b-4a23-be6f-196153f74304 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 200 len: 1208 microversion: 2.1 time: 0.140407 Oct 10 23:26:04.258903 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1208/2416] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:04 2022] GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 1208 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:04.267859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e54cd778-6a72-48b4-97a6-018e716384fa tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:04.305707 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e54cd778-6a72-48b4-97a6-018e716384fa tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] 10.222.0.23 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.041371 Oct 10 23:26:04.308656 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1209/2417] 10.222.0.23 () {58 vars in 1144 bytes} [Mon Oct 10 23:26:04 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:04.329973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7e5ab4b1-3195-45f8-98a4-a89400632bd0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:04.331069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7e5ab4b1-3195-45f8-98a4-a89400632bd0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 58fcd7f0-d348-47b1-9b3d-f7514b940eb3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:04.350551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e5ab4b1-3195-45f8-98a4-a89400632bd0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:04.351521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e5ab4b1-3195-45f8-98a4-a89400632bd0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:04.353620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e5ab4b1-3195-45f8-98a4-a89400632bd0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:04.354612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e5ab4b1-3195-45f8-98a4-a89400632bd0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:04.355570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e5ab4b1-3195-45f8-98a4-a89400632bd0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:04.356334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e5ab4b1-3195-45f8-98a4-a89400632bd0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:04.398593 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-7e5ab4b1-3195-45f8-98a4-a89400632bd0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] HTTP exception thrown: Instance 58fcd7f0-d348-47b1-9b3d-f7514b940eb3 could not be found. Oct 10 23:26:04.400294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7e5ab4b1-3195-45f8-98a4-a89400632bd0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Request method failure captured: Oct 10 23:26:04.400294 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 HTTP/1.1 Oct 10 23:26:04.400294 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:26:04.400294 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:26:04.400294 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:26:04.400294 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:26:04.400294 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:26:04.400294 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:26:04.400294 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:26:04.400294 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:26:04.400294 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKhZqIZA1oxOMX1OC1eOcdSguIJ_DulQxWj0Ue5q2p6UJYynRs89rlsdOHCTgWuGarrq4XPbdbJi1lOyN-sFKr9LDc3gLipfATB9fn3ccS9-q8j95xGd72XVQGzBCOv5WgjoJZH2hsshWwYRnCabpt4eWaX-xLDLlHvOK7BYGfK1cjo Oct 10 23:26:04.400294 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:26:04.400294 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:26:04.400294 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:26:04.400294 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:26:04.400294 n-d-860864-2 devstack@n-api.service[120613]: X-Openstack-Nova-Api-Version: 2.25 Oct 10 23:26:04.400294 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:26:04.400294 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:26:04.400294 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 01ebbb0c057c44be8b51615d59209d90 Oct 10 23:26:04.400294 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1185304471 Oct 10 23:26:04.400294 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:26:04.400294 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:26:04.401960 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/01ebbb0c057c44be8b51615d59209d90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/01ebbb0c057c44be8b51615d59209d90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/01ebbb0c057c44be8b51615d59209d90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_01ebbb0c057c44be8b51615d59209d90", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:26:04.401960 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1185304471 Oct 10 23:26:04.401960 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 01ebbb0c057c44be8b51615d59209d90 Oct 10 23:26:04.401960 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1185304471 Oct 10 23:26:04.401960 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-LiveAutoBlockMigrationV225Test-1185304471-project Oct 10 23:26:04.401960 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:26:04.401960 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:26:04.401960 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: fabfd9ac67b645bf9234590b623c27b0 Oct 10 23:26:04.401960 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1185304471-project Oct 10 23:26:04.401960 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:26:04.401960 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 58fcd7f0-d348-47b1-9b3d-f7514b940eb3 could not be found. Oct 10 23:26:04.401960 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '58fcd7f0-d348-47b1-9b3d-f7514b940eb3'} Oct 10 23:26:04.402668 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:26:04.402668 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:04.402668 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:26:04.402668 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:26:04.402668 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:26:04.402668 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:26:04.402668 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:26:04.402668 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:26:04.402668 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:26:04.402668 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:26:04.402668 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58fcd7f0-d348-47b1-9b3d-f7514b940eb3 could not be found. Oct 10 23:26:04.402668 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:04.402668 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:04.402668 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:04.402668 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:04.402668 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:04.402668 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:04.402668 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:26:04.402668 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:26:04.402668 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:26:04.403918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:26:04.403918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:26:04.403918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:26:04.403918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:26:04.403918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:26:04.403918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:26:04.403918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:26:04.403918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58fcd7f0-d348-47b1-9b3d-f7514b940eb3 could not be found. Oct 10 23:26:04.403918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:04.403918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:04.403918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:04.403918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:04.403918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:04.403918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:04.403918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:26:04.403918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:26:04.403918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58fcd7f0-d348-47b1-9b3d-f7514b940eb3 could not be found. Oct 10 23:26:04.403918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:04.416256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7e5ab4b1-3195-45f8-98a4-a89400632bd0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Returning 404 to user: Instance 58fcd7f0-d348-47b1-9b3d-f7514b940eb3 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:26:04.417812 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7e5ab4b1-3195-45f8-98a4-a89400632bd0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3" status: 404 len: 111 microversion: 2.25 time: 0.107493 Oct 10 23:26:04.418612 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1210/2418] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:04 2022] GET /compute/v2.1/servers/58fcd7f0-d348-47b1-9b3d-f7514b940eb3 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:26:04.426181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ae190864-35a8-40dc-9717-f3480d463002 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:04.442732 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ae190864-35a8-40dc-9717-f3480d463002 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022802 Oct 10 23:26:04.451499 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1211/2419] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:26:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:04.457905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4a38a36d-cbf5-4ad5-b53c-f846ab5df897 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '.version_select at 0x7f662acd8b80>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:04.507961 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4a38a36d-cbf5-4ad5-b53c-f846ab5df897 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107002667" status: 204 len: 0 microversion: 2.25 time: 0.054810 Oct 10 23:26:04.511141 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1212/2420] 10.222.0.23 () {60 vars in 1262 bytes} [Mon Oct 10 23:26:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107002667 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:26:04.535048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b7da085a-4015-4d07-9d14-3ad9de835497 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:04.601364 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b7da085a-4015-4d07-9d14-3ad9de835497 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] 10.222.0.23 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.087065 Oct 10 23:26:04.612088 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1213/2421] 10.222.0.23 () {58 vars in 1148 bytes} [Mon Oct 10 23:26:04 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:04.630853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-347ddaea-15b9-47ff-a631-f251a9687631 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:04.660624 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-347ddaea-15b9-47ff-a631-f251a9687631 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] 10.222.0.23 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.037306 Oct 10 23:26:04.674309 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1214/2422] 10.222.0.23 () {58 vars in 1140 bytes} [Mon Oct 10 23:26:04 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:04.685252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c52dae45-5371-4ffa-90f3-74fab4a9839e tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:04.702400 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c52dae45-5371-4ffa-90f3-74fab4a9839e tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025638 Oct 10 23:26:04.710938 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1215/2423] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:26:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:04.721046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ac317e5a-ca1d-4220-ae04-3b81e9bbf905 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:04.786238 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ac317e5a-ca1d-4220-ae04-3b81e9bbf905 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] 10.222.0.23 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.072733 Oct 10 23:26:04.795753 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1216/2424] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:26:04 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:04.813704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7203a7ed-3f09-468d-bde2-38f4666cf615 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:04.874451 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7203a7ed-3f09-468d-bde2-38f4666cf615 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076574 Oct 10 23:26:04.889361 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1217/2425] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:26:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:04.899494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-38bd24f1-3c4f-456d-8ad8-3ee876325305 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:04.900548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-38bd24f1-3c4f-456d-8ad8-3ee876325305 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:04.907628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38bd24f1-3c4f-456d-8ad8-3ee876325305 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:04.908429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38bd24f1-3c4f-456d-8ad8-3ee876325305 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:04.909068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38bd24f1-3c4f-456d-8ad8-3ee876325305 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:04.910034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38bd24f1-3c4f-456d-8ad8-3ee876325305 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:04.910700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38bd24f1-3c4f-456d-8ad8-3ee876325305 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:04.911335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38bd24f1-3c4f-456d-8ad8-3ee876325305 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:05.104538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-25763c5b-fe66-4785-81d6-8a42f219bd63 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:05.116833 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-25763c5b-fe66-4785-81d6-8a42f219bd63 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1666 microversion: 2.1 time: 1.132343 Oct 10 23:26:05.117478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-38bd24f1-3c4f-456d-8ad8-3ee876325305 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:05.118709 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1209/2426] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:03 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1666 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:05.130936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-abe61915-0473-4bc9-8580-12747b459b85 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:05.142349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-38bd24f1-3c4f-456d-8ad8-3ee876325305 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:05.145612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-38bd24f1-3c4f-456d-8ad8-3ee876325305 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:05.154474 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-abe61915-0473-4bc9-8580-12747b459b85 tempest-FlavorsV2TestJSON-381941265 tempest-FlavorsV2TestJSON-381941265-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033144 Oct 10 23:26:05.157942 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1210/2427] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:26:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:05.164206 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-38bd24f1-3c4f-456d-8ad8-3ee876325305 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.269959 Oct 10 23:26:05.187154 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1218/2428] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:04 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:05.279198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5f91fbe9-0bdd-40df-bc04-3eb4e6367fc4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:05.280206 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5f91fbe9-0bdd-40df-bc04-3eb4e6367fc4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:05.290520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f91fbe9-0bdd-40df-bc04-3eb4e6367fc4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:05.295089 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f91fbe9-0bdd-40df-bc04-3eb4e6367fc4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:05.295858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f91fbe9-0bdd-40df-bc04-3eb4e6367fc4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:05.297665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f91fbe9-0bdd-40df-bc04-3eb4e6367fc4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:05.300128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f91fbe9-0bdd-40df-bc04-3eb4e6367fc4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:05.304278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f91fbe9-0bdd-40df-bc04-3eb4e6367fc4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:05.499188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5f91fbe9-0bdd-40df-bc04-3eb4e6367fc4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:05.512818 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5f91fbe9-0bdd-40df-bc04-3eb4e6367fc4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 200 len: 1204 microversion: 2.1 time: 0.244034 Oct 10 23:26:05.517164 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1211/2429] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:05 2022] GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 1204 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:05.890278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-75ac8396-d4ca-4c75-bb4f-69e33d9e8a32 req-1921bf19-d810-4963-b6af-131b56cf3292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5242250f-5274-4992-adb3-e8fdd3b65ed7", "name": "network-vif-deleted", "tag": "90f86f41-ee10-436d-af23-bca655e7f68b"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:05.908810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-75ac8396-d4ca-4c75-bb4f-69e33d9e8a32 req-1921bf19-d810-4963-b6af-131b56cf3292 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:05.909300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-75ac8396-d4ca-4c75-bb4f-69e33d9e8a32 req-1921bf19-d810-4963-b6af-131b56cf3292 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:05.909780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-75ac8396-d4ca-4c75-bb4f-69e33d9e8a32 req-1921bf19-d810-4963-b6af-131b56cf3292 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:05.939148 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-75ac8396-d4ca-4c75-bb4f-69e33d9e8a32 req-1921bf19-d810-4963-b6af-131b56cf3292 service nova] Creating event network-vif-deleted:90f86f41-ee10-436d-af23-bca655e7f68b for instance 5242250f-5274-4992-adb3-e8fdd3b65ed7 on n-h2-860864-2 Oct 10 23:26:05.944913 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-75ac8396-d4ca-4c75-bb4f-69e33d9e8a32 req-1921bf19-d810-4963-b6af-131b56cf3292 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058197 Oct 10 23:26:05.946030 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1219/2430] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:06.152993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f89eb570-3dd3-49db-b00f-55394b6bb596 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:06.160910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f89eb570-3dd3-49db-b00f-55394b6bb596 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:06.171458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:06.203733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f89eb570-3dd3-49db-b00f-55394b6bb596 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:06.206706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f89eb570-3dd3-49db-b00f-55394b6bb596 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:06.207927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f89eb570-3dd3-49db-b00f-55394b6bb596 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:06.213766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f89eb570-3dd3-49db-b00f-55394b6bb596 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:06.218078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f89eb570-3dd3-49db-b00f-55394b6bb596 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:06.219423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f89eb570-3dd3-49db-b00f-55394b6bb596 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:06.226343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e70da31a-14c9-4f79-a846-abf8e453462b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:06.227760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e70da31a-14c9-4f79-a846-abf8e453462b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:06.244191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e70da31a-14c9-4f79-a846-abf8e453462b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:06.245471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e70da31a-14c9-4f79-a846-abf8e453462b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:06.246681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e70da31a-14c9-4f79-a846-abf8e453462b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:06.248159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e70da31a-14c9-4f79-a846-abf8e453462b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:06.249231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e70da31a-14c9-4f79-a846-abf8e453462b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:06.250813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e70da31a-14c9-4f79-a846-abf8e453462b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:06.530517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e70da31a-14c9-4f79-a846-abf8e453462b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:06.548788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e70da31a-14c9-4f79-a846-abf8e453462b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:06.553575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e70da31a-14c9-4f79-a846-abf8e453462b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:06.569516 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e70da31a-14c9-4f79-a846-abf8e453462b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.361109 Oct 10 23:26:06.585521 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1220/2431] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:06 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:06.591542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3aeaa715-42cc-420f-90bd-0ea9ae91dd9c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:06.593218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3aeaa715-42cc-420f-90bd-0ea9ae91dd9c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:06.602287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aeaa715-42cc-420f-90bd-0ea9ae91dd9c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:06.603962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aeaa715-42cc-420f-90bd-0ea9ae91dd9c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:06.605233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aeaa715-42cc-420f-90bd-0ea9ae91dd9c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:06.606407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aeaa715-42cc-420f-90bd-0ea9ae91dd9c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:06.607150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aeaa715-42cc-420f-90bd-0ea9ae91dd9c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:06.607800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aeaa715-42cc-420f-90bd-0ea9ae91dd9c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:06.757624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3aeaa715-42cc-420f-90bd-0ea9ae91dd9c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:06.780408 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3aeaa715-42cc-420f-90bd-0ea9ae91dd9c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 200 len: 1266 microversion: 2.1 time: 0.205228 Oct 10 23:26:06.788080 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1221/2432] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:06 2022] GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:06.891646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-264020e9-5ff2-4b47-8c96-8a3353e23e50 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:06.892333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-264020e9-5ff2-4b47-8c96-8a3353e23e50 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:06.900232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-264020e9-5ff2-4b47-8c96-8a3353e23e50 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:06.901008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-264020e9-5ff2-4b47-8c96-8a3353e23e50 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:06.901660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-264020e9-5ff2-4b47-8c96-8a3353e23e50 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:06.902417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-264020e9-5ff2-4b47-8c96-8a3353e23e50 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:06.903116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-264020e9-5ff2-4b47-8c96-8a3353e23e50 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:06.903554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-264020e9-5ff2-4b47-8c96-8a3353e23e50 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:06.934571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-264020e9-5ff2-4b47-8c96-8a3353e23e50 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:26:07.057177 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-264020e9-5ff2-4b47-8c96-8a3353e23e50 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 204 len: 0 microversion: 2.25 time: 0.169271 Oct 10 23:26:07.058253 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1222/2433] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:26:06 2022] DELETE /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 10 23:26:07.071406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-339da9d5-53ef-44b4-b0ac-ba2f7be6288a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:07.073304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-339da9d5-53ef-44b4-b0ac-ba2f7be6288a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:07.086902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-339da9d5-53ef-44b4-b0ac-ba2f7be6288a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:07.088102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-339da9d5-53ef-44b4-b0ac-ba2f7be6288a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:07.088779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-339da9d5-53ef-44b4-b0ac-ba2f7be6288a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:07.089953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-339da9d5-53ef-44b4-b0ac-ba2f7be6288a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:07.090802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-339da9d5-53ef-44b4-b0ac-ba2f7be6288a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:07.091482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-339da9d5-53ef-44b4-b0ac-ba2f7be6288a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:07.117715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:07.295415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f89eb570-3dd3-49db-b00f-55394b6bb596 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:07.314402 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f89eb570-3dd3-49db-b00f-55394b6bb596 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1666 microversion: 2.1 time: 1.168877 Oct 10 23:26:07.317208 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1212/2434] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:06 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1666 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:07.435250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-339da9d5-53ef-44b4-b0ac-ba2f7be6288a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:07.445115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-339da9d5-53ef-44b4-b0ac-ba2f7be6288a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:07.447625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-339da9d5-53ef-44b4-b0ac-ba2f7be6288a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:07.448830 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-339da9d5-53ef-44b4-b0ac-ba2f7be6288a tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1548 microversion: 2.25 time: 0.384976 Oct 10 23:26:07.449771 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1223/2435] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:07 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1548 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:07.607786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cd2a92e6-1102-4ec8-b04a-05435fcf13c7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:07.608554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cd2a92e6-1102-4ec8-b04a-05435fcf13c7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:07.629425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd2a92e6-1102-4ec8-b04a-05435fcf13c7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:07.631039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd2a92e6-1102-4ec8-b04a-05435fcf13c7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:07.631606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd2a92e6-1102-4ec8-b04a-05435fcf13c7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:07.632947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd2a92e6-1102-4ec8-b04a-05435fcf13c7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:07.637794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd2a92e6-1102-4ec8-b04a-05435fcf13c7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:07.637794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd2a92e6-1102-4ec8-b04a-05435fcf13c7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:07.805517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cd2a92e6-1102-4ec8-b04a-05435fcf13c7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:07.809285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8a79c3e0-33b2-4daa-9727-01bbde5d7493 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:07.809984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8a79c3e0-33b2-4daa-9727-01bbde5d7493 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:07.826563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a79c3e0-33b2-4daa-9727-01bbde5d7493 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:07.831218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a79c3e0-33b2-4daa-9727-01bbde5d7493 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:07.831857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a79c3e0-33b2-4daa-9727-01bbde5d7493 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:07.835030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a79c3e0-33b2-4daa-9727-01bbde5d7493 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:07.836074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cd2a92e6-1102-4ec8-b04a-05435fcf13c7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:07.836766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a79c3e0-33b2-4daa-9727-01bbde5d7493 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:07.838363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a79c3e0-33b2-4daa-9727-01bbde5d7493 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:07.842670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cd2a92e6-1102-4ec8-b04a-05435fcf13c7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:07.855052 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cd2a92e6-1102-4ec8-b04a-05435fcf13c7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.252820 Oct 10 23:26:07.859672 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1213/2436] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:07 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:07.977808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8a79c3e0-33b2-4daa-9727-01bbde5d7493 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:07.991576 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8a79c3e0-33b2-4daa-9727-01bbde5d7493 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 200 len: 1266 microversion: 2.1 time: 0.191068 Oct 10 23:26:07.992547 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1224/2437] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:07 2022] GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:08.348214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fb86ecf0-c38a-4924-9860-a4cbaf467f03 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:08.350570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fb86ecf0-c38a-4924-9860-a4cbaf467f03 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:08.358009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb86ecf0-c38a-4924-9860-a4cbaf467f03 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:08.358929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb86ecf0-c38a-4924-9860-a4cbaf467f03 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:08.359665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb86ecf0-c38a-4924-9860-a4cbaf467f03 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:08.361248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb86ecf0-c38a-4924-9860-a4cbaf467f03 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:08.361971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb86ecf0-c38a-4924-9860-a4cbaf467f03 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:08.362599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb86ecf0-c38a-4924-9860-a4cbaf467f03 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:08.475986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a2891429-640b-431c-81de-de2801bbd911 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:08.476883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a2891429-640b-431c-81de-de2801bbd911 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:08.486601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2891429-640b-431c-81de-de2801bbd911 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:08.487970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2891429-640b-431c-81de-de2801bbd911 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:08.488579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2891429-640b-431c-81de-de2801bbd911 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:08.489578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2891429-640b-431c-81de-de2801bbd911 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:08.490287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2891429-640b-431c-81de-de2801bbd911 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:08.490874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2891429-640b-431c-81de-de2801bbd911 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:08.981075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fb86ecf0-c38a-4924-9860-a4cbaf467f03 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:08.992221 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fb86ecf0-c38a-4924-9860-a4cbaf467f03 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1670 microversion: 2.1 time: 0.648791 Oct 10 23:26:08.995293 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1214/2438] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:08 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1670 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:09.013430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9df162cf-9a19-4571-8070-317de816d60c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:09.014283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9df162cf-9a19-4571-8070-317de816d60c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:09.023061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9df162cf-9a19-4571-8070-317de816d60c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:09.023555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9df162cf-9a19-4571-8070-317de816d60c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:09.030262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9df162cf-9a19-4571-8070-317de816d60c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:09.031566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9df162cf-9a19-4571-8070-317de816d60c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:09.032236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9df162cf-9a19-4571-8070-317de816d60c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:09.033008 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9df162cf-9a19-4571-8070-317de816d60c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:09.283792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a2891429-640b-431c-81de-de2801bbd911 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:09.307106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a2891429-640b-431c-81de-de2801bbd911 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:09.317252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a2891429-640b-431c-81de-de2801bbd911 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:09.319769 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a2891429-640b-431c-81de-de2801bbd911 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1548 microversion: 2.25 time: 0.848431 Oct 10 23:26:09.343431 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1225/2439] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:08 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1548 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:26:09.367333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9df162cf-9a19-4571-8070-317de816d60c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:09.373651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-366d9085-4ade-43dc-9069-efedfc90d705 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:09.379613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-366d9085-4ade-43dc-9069-efedfc90d705 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:09.383642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9df162cf-9a19-4571-8070-317de816d60c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:09.388228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9df162cf-9a19-4571-8070-317de816d60c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:09.397108 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9df162cf-9a19-4571-8070-317de816d60c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.400664 Oct 10 23:26:09.397738 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1215/2440] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:08 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:09.417171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-366d9085-4ade-43dc-9069-efedfc90d705 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:09.418295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-366d9085-4ade-43dc-9069-efedfc90d705 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:09.418995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-366d9085-4ade-43dc-9069-efedfc90d705 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:09.420184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-366d9085-4ade-43dc-9069-efedfc90d705 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:09.420876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-366d9085-4ade-43dc-9069-efedfc90d705 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:09.421596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-366d9085-4ade-43dc-9069-efedfc90d705 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:09.550414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-366d9085-4ade-43dc-9069-efedfc90d705 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:09.560904 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-366d9085-4ade-43dc-9069-efedfc90d705 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 200 len: 1266 microversion: 2.1 time: 0.214059 Oct 10 23:26:09.572404 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1226/2441] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:09 2022] GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:09.810760 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-17add6a4-72b2-4082-a9d5-c36aaed53b31 req-0d85a2ef-c9b1-4ec4-98c4-44a0769660a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3bb20a8-8b13-470d-ac2b-50b7a7bea206", "name": "network-vif-deleted", "tag": "cf309634-58e1-4dda-a8ad-e94e39638eb7"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:09.838264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-17add6a4-72b2-4082-a9d5-c36aaed53b31 req-0d85a2ef-c9b1-4ec4-98c4-44a0769660a7 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:09.840305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-17add6a4-72b2-4082-a9d5-c36aaed53b31 req-0d85a2ef-c9b1-4ec4-98c4-44a0769660a7 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:09.841080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-17add6a4-72b2-4082-a9d5-c36aaed53b31 req-0d85a2ef-c9b1-4ec4-98c4-44a0769660a7 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:09.891809 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-17add6a4-72b2-4082-a9d5-c36aaed53b31 req-0d85a2ef-c9b1-4ec4-98c4-44a0769660a7 service nova] Creating event network-vif-deleted:cf309634-58e1-4dda-a8ad-e94e39638eb7 for instance c3bb20a8-8b13-470d-ac2b-50b7a7bea206 on n-h1-860864-2 Oct 10 23:26:09.910305 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-17add6a4-72b2-4082-a9d5-c36aaed53b31 req-0d85a2ef-c9b1-4ec4-98c4-44a0769660a7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104192 Oct 10 23:26:09.917397 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1216/2442] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:10.349745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f51c1049-21c7-40df-8927-b370d6d8a183 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:10.351352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f51c1049-21c7-40df-8927-b370d6d8a183 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:10.378380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f51c1049-21c7-40df-8927-b370d6d8a183 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:10.380984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f51c1049-21c7-40df-8927-b370d6d8a183 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:10.381710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f51c1049-21c7-40df-8927-b370d6d8a183 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:10.383226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f51c1049-21c7-40df-8927-b370d6d8a183 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:10.383900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f51c1049-21c7-40df-8927-b370d6d8a183 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:10.384538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f51c1049-21c7-40df-8927-b370d6d8a183 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:10.435803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2485106d-8c58-4dbe-a2e6-0fc508b1500b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:10.438097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2485106d-8c58-4dbe-a2e6-0fc508b1500b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:10.447766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2485106d-8c58-4dbe-a2e6-0fc508b1500b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:10.448548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2485106d-8c58-4dbe-a2e6-0fc508b1500b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:10.449199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2485106d-8c58-4dbe-a2e6-0fc508b1500b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:10.449450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f51c1049-21c7-40df-8927-b370d6d8a183 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:10.450090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f51c1049-21c7-40df-8927-b370d6d8a183 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:10.451954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f51c1049-21c7-40df-8927-b370d6d8a183 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:10.452528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-f51c1049-21c7-40df-8927-b370d6d8a183 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lazy-loading 'fault' on Instance uuid c3bb20a8-8b13-470d-ac2b-50b7a7bea206 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:26:10.453356 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2485106d-8c58-4dbe-a2e6-0fc508b1500b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:10.454889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2485106d-8c58-4dbe-a2e6-0fc508b1500b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:10.456516 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2485106d-8c58-4dbe-a2e6-0fc508b1500b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:10.550055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f51c1049-21c7-40df-8927-b370d6d8a183 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:10.559298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f51c1049-21c7-40df-8927-b370d6d8a183 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:10.561210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f51c1049-21c7-40df-8927-b370d6d8a183 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:10.563495 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f51c1049-21c7-40df-8927-b370d6d8a183 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 200 len: 1352 microversion: 2.25 time: 0.216762 Oct 10 23:26:10.564705 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1227/2443] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:10 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 1352 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:10.702175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2485106d-8c58-4dbe-a2e6-0fc508b1500b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:10.725128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2485106d-8c58-4dbe-a2e6-0fc508b1500b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:10.730058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2485106d-8c58-4dbe-a2e6-0fc508b1500b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:10.742091 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2485106d-8c58-4dbe-a2e6-0fc508b1500b tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.313214 Oct 10 23:26:10.750592 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1217/2444] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:10 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:10.756892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-09d15888-3ffb-4ad5-893f-42b08ced423a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:10.760402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-09d15888-3ffb-4ad5-893f-42b08ced423a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:10.790822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09d15888-3ffb-4ad5-893f-42b08ced423a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:10.791322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09d15888-3ffb-4ad5-893f-42b08ced423a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:10.791761 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09d15888-3ffb-4ad5-893f-42b08ced423a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:10.792466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09d15888-3ffb-4ad5-893f-42b08ced423a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:10.793174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09d15888-3ffb-4ad5-893f-42b08ced423a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:10.793631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09d15888-3ffb-4ad5-893f-42b08ced423a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:10.839719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-92a142af-082a-45cf-a4a9-89fabc69903e tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Action: 'update', calling method: .version_select at 0x7f6633bb60d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:10.935754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92a142af-082a-45cf-a4a9-89fabc69903e tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:10.936530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92a142af-082a-45cf-a4a9-89fabc69903e tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:10.945335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92a142af-082a-45cf-a4a9-89fabc69903e tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:10.946225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92a142af-082a-45cf-a4a9-89fabc69903e tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:10.952872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92a142af-082a-45cf-a4a9-89fabc69903e tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:10.955530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92a142af-082a-45cf-a4a9-89fabc69903e tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:11.088777 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-92a142af-082a-45cf-a4a9-89fabc69903e tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/a3b9fbbd971c43d7a2caac3ef5119f51" status: 200 len: 148 microversion: 2.57 time: 0.522585 Oct 10 23:26:11.089511 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1228/2445] 10.222.0.23 () {62 vars in 1303 bytes} [Mon Oct 10 23:26:10 2022] PUT /compute/v2.1/os-quota-sets/a3b9fbbd971c43d7a2caac3ef5119f51 => generated 148 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:26:11.100848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-de2eb253-a670-4d23-9336-84a6861cc9e6 tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Calling method '.version_select at 0x7f6633baf430>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:11.509101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de2eb253-a670-4d23-9336-84a6861cc9e6 tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:11.509777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de2eb253-a670-4d23-9336-84a6861cc9e6 tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:11.510246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de2eb253-a670-4d23-9336-84a6861cc9e6 tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:11.511268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de2eb253-a670-4d23-9336-84a6861cc9e6 tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:11.512087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de2eb253-a670-4d23-9336-84a6861cc9e6 tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:11.512839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de2eb253-a670-4d23-9336-84a6861cc9e6 tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:11.552519 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-de2eb253-a670-4d23-9336-84a6861cc9e6 tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/a3b9fbbd971c43d7a2caac3ef5119f51/detail" status: 200 len: 463 microversion: 2.57 time: 0.455318 Oct 10 23:26:11.564112 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1229/2446] 10.222.0.23 () {60 vars in 1304 bytes} [Mon Oct 10 23:26:11 2022] GET /compute/v2.1/os-quota-sets/a3b9fbbd971c43d7a2caac3ef5119f51/detail => generated 463 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:26:11.598516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a6a1d8eb-f53c-431a-a3ef-d74bdd141570 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:11.599913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a6a1d8eb-f53c-431a-a3ef-d74bdd141570 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: c3bb20a8-8b13-470d-ac2b-50b7a7bea206] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:11.612825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6a1d8eb-f53c-431a-a3ef-d74bdd141570 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:11.614528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6a1d8eb-f53c-431a-a3ef-d74bdd141570 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:11.615868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6a1d8eb-f53c-431a-a3ef-d74bdd141570 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:11.619277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6a1d8eb-f53c-431a-a3ef-d74bdd141570 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:11.621962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6a1d8eb-f53c-431a-a3ef-d74bdd141570 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:11.623227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6a1d8eb-f53c-431a-a3ef-d74bdd141570 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:11.654150 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-a6a1d8eb-f53c-431a-a3ef-d74bdd141570 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] HTTP exception thrown: Instance c3bb20a8-8b13-470d-ac2b-50b7a7bea206 could not be found. Oct 10 23:26:11.658757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a6a1d8eb-f53c-431a-a3ef-d74bdd141570 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Request method failure captured: Oct 10 23:26:11.658757 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 HTTP/1.1 Oct 10 23:26:11.658757 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:26:11.658757 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:26:11.658757 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:26:11.658757 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:26:11.658757 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:26:11.658757 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:26:11.658757 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:26:11.658757 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:26:11.658757 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKhZqIZA1oxOMX1OC1eOcdSguIJ_DulQxWj0Ue5q2p6UJYynRs89rlsdOHCTgWuGarrq4XPbdbJi1lOyN-sFKr9LDc3gLipfATB9fn3ccS9-q8j95xGd72XVQGzBCOv5WgjoJZH2hsshWwYRnCabpt4eWaX-xLDLlHvOK7BYGfK1cjo Oct 10 23:26:11.658757 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:26:11.658757 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:26:11.658757 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:26:11.658757 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:26:11.658757 n-d-860864-2 devstack@n-api.service[120613]: X-Openstack-Nova-Api-Version: 2.25 Oct 10 23:26:11.658757 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:26:11.658757 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:26:11.658757 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 01ebbb0c057c44be8b51615d59209d90 Oct 10 23:26:11.658757 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1185304471 Oct 10 23:26:11.658757 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:26:11.658757 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:26:11.660011 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/01ebbb0c057c44be8b51615d59209d90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/01ebbb0c057c44be8b51615d59209d90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/01ebbb0c057c44be8b51615d59209d90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_01ebbb0c057c44be8b51615d59209d90", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:26:11.660011 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1185304471 Oct 10 23:26:11.660011 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 01ebbb0c057c44be8b51615d59209d90 Oct 10 23:26:11.660011 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1185304471 Oct 10 23:26:11.660011 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-LiveAutoBlockMigrationV225Test-1185304471-project Oct 10 23:26:11.660011 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:26:11.660011 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:26:11.660011 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: fabfd9ac67b645bf9234590b623c27b0 Oct 10 23:26:11.660011 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1185304471-project Oct 10 23:26:11.660011 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:26:11.660011 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance c3bb20a8-8b13-470d-ac2b-50b7a7bea206 could not be found. Oct 10 23:26:11.660011 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'c3bb20a8-8b13-470d-ac2b-50b7a7bea206'} Oct 10 23:26:11.660699 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:26:11.660699 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:11.660699 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:26:11.660699 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:26:11.660699 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:26:11.660699 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:26:11.660699 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:26:11.660699 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:26:11.660699 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:26:11.660699 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:26:11.660699 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3bb20a8-8b13-470d-ac2b-50b7a7bea206 could not be found. Oct 10 23:26:11.660699 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:11.660699 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:11.660699 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:11.660699 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:11.660699 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:11.660699 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:11.660699 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:26:11.660699 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:26:11.660699 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:26:11.661851 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:26:11.661851 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:26:11.661851 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:26:11.661851 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:26:11.661851 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:26:11.661851 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:26:11.661851 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:26:11.661851 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3bb20a8-8b13-470d-ac2b-50b7a7bea206 could not be found. Oct 10 23:26:11.661851 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:11.661851 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:11.661851 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:11.661851 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:11.661851 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:11.661851 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:11.661851 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:26:11.661851 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:26:11.661851 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3bb20a8-8b13-470d-ac2b-50b7a7bea206 could not be found. Oct 10 23:26:11.661851 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:11.666398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a6a1d8eb-f53c-431a-a3ef-d74bdd141570 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Returning 404 to user: Instance c3bb20a8-8b13-470d-ac2b-50b7a7bea206 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:26:11.669045 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a6a1d8eb-f53c-431a-a3ef-d74bdd141570 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206" status: 404 len: 111 microversion: 2.25 time: 0.076511 Oct 10 23:26:11.670150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-09d15888-3ffb-4ad5-893f-42b08ced423a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:11.673582 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1230/2447] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:11 2022] GET /compute/v2.1/servers/c3bb20a8-8b13-470d-ac2b-50b7a7bea206 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:26:11.683057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-623f6811-fce0-4f93-8da6-e8b841fcb1f7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:11.683833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-623f6811-fce0-4f93-8da6-e8b841fcb1f7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:11.685475 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-09d15888-3ffb-4ad5-893f-42b08ced423a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 200 len: 1308 microversion: 2.1 time: 0.933298 Oct 10 23:26:11.687644 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1218/2448] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:10 2022] GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 1308 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:11.710578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-623f6811-fce0-4f93-8da6-e8b841fcb1f7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:11.710822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-623f6811-fce0-4f93-8da6-e8b841fcb1f7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:11.711201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-623f6811-fce0-4f93-8da6-e8b841fcb1f7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:11.711919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-623f6811-fce0-4f93-8da6-e8b841fcb1f7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:11.712519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-623f6811-fce0-4f93-8da6-e8b841fcb1f7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:11.712798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-623f6811-fce0-4f93-8da6-e8b841fcb1f7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:11.759635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-19d4257f-4631-4242-8fc1-a51fbaba4eaa tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Action: 'update', calling method: .version_select at 0x7f662a7aeca0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:11.762798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-623f6811-fce0-4f93-8da6-e8b841fcb1f7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:26:11.976494 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-623f6811-fce0-4f93-8da6-e8b841fcb1f7 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 204 len: 0 microversion: 2.25 time: 0.299117 Oct 10 23:26:11.977945 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1231/2449] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:26:11 2022] DELETE /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:26:11.985729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a0c8f460-26f0-46c6-951b-77855e5913ba tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:11.989890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a0c8f460-26f0-46c6-951b-77855e5913ba tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:12.001938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0c8f460-26f0-46c6-951b-77855e5913ba tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:12.004108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0c8f460-26f0-46c6-951b-77855e5913ba tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:12.006189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0c8f460-26f0-46c6-951b-77855e5913ba tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:12.009201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0c8f460-26f0-46c6-951b-77855e5913ba tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:12.014919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0c8f460-26f0-46c6-951b-77855e5913ba tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:12.015919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0c8f460-26f0-46c6-951b-77855e5913ba tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:12.185495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a0c8f460-26f0-46c6-951b-77855e5913ba tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:12.185700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19d4257f-4631-4242-8fc1-a51fbaba4eaa tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:12.186677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19d4257f-4631-4242-8fc1-a51fbaba4eaa tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:12.188289 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19d4257f-4631-4242-8fc1-a51fbaba4eaa tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:12.190844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19d4257f-4631-4242-8fc1-a51fbaba4eaa tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:12.191515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19d4257f-4631-4242-8fc1-a51fbaba4eaa tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:12.192103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19d4257f-4631-4242-8fc1-a51fbaba4eaa tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:12.203850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a0c8f460-26f0-46c6-951b-77855e5913ba tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:12.207926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a0c8f460-26f0-46c6-951b-77855e5913ba tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:12.223177 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a0c8f460-26f0-46c6-951b-77855e5913ba tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.242768 Oct 10 23:26:12.223969 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1232/2450] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:11 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:12.248566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2c1468be-b861-4aa4-8fda-e75d67025460 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:12.249317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2c1468be-b861-4aa4-8fda-e75d67025460 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:12.256568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c1468be-b861-4aa4-8fda-e75d67025460 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:12.257124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c1468be-b861-4aa4-8fda-e75d67025460 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:12.257632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c1468be-b861-4aa4-8fda-e75d67025460 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:12.258352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c1468be-b861-4aa4-8fda-e75d67025460 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:12.258896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c1468be-b861-4aa4-8fda-e75d67025460 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:12.259239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c1468be-b861-4aa4-8fda-e75d67025460 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:12.277396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19d4257f-4631-4242-8fc1-a51fbaba4eaa tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:12.278406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19d4257f-4631-4242-8fc1-a51fbaba4eaa tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:12.279371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19d4257f-4631-4242-8fc1-a51fbaba4eaa tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:12.285676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19d4257f-4631-4242-8fc1-a51fbaba4eaa tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:12.286234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19d4257f-4631-4242-8fc1-a51fbaba4eaa tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:12.286687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19d4257f-4631-4242-8fc1-a51fbaba4eaa tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:12.419582 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-19d4257f-4631-4242-8fc1-a51fbaba4eaa tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/a3b9fbbd971c43d7a2caac3ef5119f51?user_id=8971bc863d51480daee12a3d7cc128f0" status: 200 len: 148 microversion: 2.57 time: 0.663899 Oct 10 23:26:12.420855 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1219/2451] 10.222.0.23 () {62 vars in 1384 bytes} [Mon Oct 10 23:26:11 2022] PUT /compute/v2.1/os-quota-sets/a3b9fbbd971c43d7a2caac3ef5119f51?user_id=8971bc863d51480daee12a3d7cc128f0 => generated 148 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 23:26:12.433686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5101b6cb-904c-444c-941c-4d58c1075692 tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] Calling method '.version_select at 0x7f662a6d05e0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:12.686370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2c1468be-b861-4aa4-8fda-e75d67025460 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:12.698645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2c1468be-b861-4aa4-8fda-e75d67025460 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:12.702463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2c1468be-b861-4aa4-8fda-e75d67025460 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:12.706457 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2c1468be-b861-4aa4-8fda-e75d67025460 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1564 microversion: 2.25 time: 0.481347 Oct 10 23:26:12.708235 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1233/2452] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:12 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1564 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:12.717981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-593896b3-e769-4873-8e30-f10cc538762f req-cd69b439-97d0-4a13-8938-0eadf51f9c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aaa34f0-fc6a-4ef0-9474-3df5dab16917", "tag": "74acb0df-5e5f-4bfa-982d-db062eb01948"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:12.747689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-593896b3-e769-4873-8e30-f10cc538762f req-cd69b439-97d0-4a13-8938-0eadf51f9c5e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:12.748047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-593896b3-e769-4873-8e30-f10cc538762f req-cd69b439-97d0-4a13-8938-0eadf51f9c5e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:12.751193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-593896b3-e769-4873-8e30-f10cc538762f req-cd69b439-97d0-4a13-8938-0eadf51f9c5e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:12.756590 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5101b6cb-904c-444c-941c-4d58c1075692 tempest-QuotasAdminTestV257-1938485905 tempest-QuotasAdminTestV257-1938485905-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/a3b9fbbd971c43d7a2caac3ef5119f51?user_id=8971bc863d51480daee12a3d7cc128f0" status: 200 len: 190 microversion: 2.57 time: 0.326308 Oct 10 23:26:12.758729 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1220/2453] 10.222.0.23 () {60 vars in 1364 bytes} [Mon Oct 10 23:26:12 2022] GET /compute/v2.1/os-quota-sets/a3b9fbbd971c43d7a2caac3ef5119f51?user_id=8971bc863d51480daee12a3d7cc128f0 => generated 190 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 23:26:12.769170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1a82a3cd-f61d-4972-9d2d-b8c77c2e77d4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:12.770356 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1a82a3cd-f61d-4972-9d2d-b8c77c2e77d4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:12.782574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a82a3cd-f61d-4972-9d2d-b8c77c2e77d4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:12.783763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a82a3cd-f61d-4972-9d2d-b8c77c2e77d4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:12.784783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a82a3cd-f61d-4972-9d2d-b8c77c2e77d4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:12.786203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a82a3cd-f61d-4972-9d2d-b8c77c2e77d4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:12.786882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a82a3cd-f61d-4972-9d2d-b8c77c2e77d4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:12.787511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a82a3cd-f61d-4972-9d2d-b8c77c2e77d4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:12.806226 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-593896b3-e769-4873-8e30-f10cc538762f req-cd69b439-97d0-4a13-8938-0eadf51f9c5e service nova] Creating event network-changed:74acb0df-5e5f-4bfa-982d-db062eb01948 for instance 3aaa34f0-fc6a-4ef0-9474-3df5dab16917 on n-h2-860864-2 Oct 10 23:26:12.814997 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-593896b3-e769-4873-8e30-f10cc538762f req-cd69b439-97d0-4a13-8938-0eadf51f9c5e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103053 Oct 10 23:26:12.815733 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1234/2454] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:13.254219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-36886b9b-93c4-482f-bb50-87ffc6aa155d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:13.255105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-36886b9b-93c4-482f-bb50-87ffc6aa155d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:13.272382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:13.274665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36886b9b-93c4-482f-bb50-87ffc6aa155d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:13.275341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36886b9b-93c4-482f-bb50-87ffc6aa155d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:13.275648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36886b9b-93c4-482f-bb50-87ffc6aa155d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:13.276369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36886b9b-93c4-482f-bb50-87ffc6aa155d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:13.276828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36886b9b-93c4-482f-bb50-87ffc6aa155d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:13.277258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36886b9b-93c4-482f-bb50-87ffc6aa155d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:13.693631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-36886b9b-93c4-482f-bb50-87ffc6aa155d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:13.709829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-36886b9b-93c4-482f-bb50-87ffc6aa155d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:13.715136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-36886b9b-93c4-482f-bb50-87ffc6aa155d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:13.729118 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-36886b9b-93c4-482f-bb50-87ffc6aa155d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1558 microversion: 2.91 time: 0.480242 Oct 10 23:26:13.731784 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1235/2455] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:13 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1558 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:13.739458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1cd615c3-9138-4308-83ed-2d995a956bd2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:13.740079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1cd615c3-9138-4308-83ed-2d995a956bd2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:13.746267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1cd615c3-9138-4308-83ed-2d995a956bd2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:13.747036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1cd615c3-9138-4308-83ed-2d995a956bd2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:13.747725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1cd615c3-9138-4308-83ed-2d995a956bd2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:13.748659 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1cd615c3-9138-4308-83ed-2d995a956bd2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:13.749332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1cd615c3-9138-4308-83ed-2d995a956bd2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:13.751030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1cd615c3-9138-4308-83ed-2d995a956bd2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:13.786255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1a82a3cd-f61d-4972-9d2d-b8c77c2e77d4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:13.797640 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1a82a3cd-f61d-4972-9d2d-b8c77c2e77d4 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 200 len: 1308 microversion: 2.1 time: 1.036634 Oct 10 23:26:13.802414 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1221/2456] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:12 2022] GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 1308 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:14.069176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1cd615c3-9138-4308-83ed-2d995a956bd2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:14.079394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1cd615c3-9138-4308-83ed-2d995a956bd2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:14.081779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1cd615c3-9138-4308-83ed-2d995a956bd2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:14.083424 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1cd615c3-9138-4308-83ed-2d995a956bd2 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1564 microversion: 2.25 time: 0.350590 Oct 10 23:26:14.084905 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1236/2457] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:13 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1564 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:14.763895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-86249806-b5ec-4a22-b2bc-d7dac661f21d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:14.764439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-86249806-b5ec-4a22-b2bc-d7dac661f21d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:14.793643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86249806-b5ec-4a22-b2bc-d7dac661f21d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:14.795506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86249806-b5ec-4a22-b2bc-d7dac661f21d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:14.795741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86249806-b5ec-4a22-b2bc-d7dac661f21d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:14.798320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86249806-b5ec-4a22-b2bc-d7dac661f21d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:14.799591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86249806-b5ec-4a22-b2bc-d7dac661f21d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:14.801630 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86249806-b5ec-4a22-b2bc-d7dac661f21d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:14.837902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-92ba7dae-40f0-4d46-97e2-728661096c89 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:14.839213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-92ba7dae-40f0-4d46-97e2-728661096c89 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:14.871664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92ba7dae-40f0-4d46-97e2-728661096c89 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:14.873490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92ba7dae-40f0-4d46-97e2-728661096c89 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:14.874200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92ba7dae-40f0-4d46-97e2-728661096c89 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:14.879489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92ba7dae-40f0-4d46-97e2-728661096c89 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:14.881034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92ba7dae-40f0-4d46-97e2-728661096c89 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:14.883379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92ba7dae-40f0-4d46-97e2-728661096c89 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:14.951046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-86249806-b5ec-4a22-b2bc-d7dac661f21d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:14.982967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-86249806-b5ec-4a22-b2bc-d7dac661f21d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:15.010237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-86249806-b5ec-4a22-b2bc-d7dac661f21d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:15.027234 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-86249806-b5ec-4a22-b2bc-d7dac661f21d tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.268861 Oct 10 23:26:15.028810 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1222/2458] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:14 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:15.046518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-0d1b5306-af14-44ab-88dd-ffa0e9c53cd0 req-a888844a-96cb-4a8c-8201-e02cd9c4da67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1847e3cf-10bd-40d5-b668-d5a1c73fc189", "name": "network-vif-deleted", "tag": "336fa68a-b02a-496e-bd84-6e77cd69df0f"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:15.074855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0d1b5306-af14-44ab-88dd-ffa0e9c53cd0 req-a888844a-96cb-4a8c-8201-e02cd9c4da67 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:15.076113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0d1b5306-af14-44ab-88dd-ffa0e9c53cd0 req-a888844a-96cb-4a8c-8201-e02cd9c4da67 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:15.076846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0d1b5306-af14-44ab-88dd-ffa0e9c53cd0 req-a888844a-96cb-4a8c-8201-e02cd9c4da67 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:15.088115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:15.111129 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-0d1b5306-af14-44ab-88dd-ffa0e9c53cd0 req-a888844a-96cb-4a8c-8201-e02cd9c4da67 service nova] Creating event network-vif-deleted:336fa68a-b02a-496e-bd84-6e77cd69df0f for instance 1847e3cf-10bd-40d5-b668-d5a1c73fc189 on n-h1-860864-2 Oct 10 23:26:15.118003 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-0d1b5306-af14-44ab-88dd-ffa0e9c53cd0 req-a888844a-96cb-4a8c-8201-e02cd9c4da67 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087096 Oct 10 23:26:15.120829 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1223/2459] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:15.137016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0f26a33f-2839-425f-961d-962fed1aaf34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:15.138081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0f26a33f-2839-425f-961d-962fed1aaf34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:15.174038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f26a33f-2839-425f-961d-962fed1aaf34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:15.174540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f26a33f-2839-425f-961d-962fed1aaf34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:15.174990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f26a33f-2839-425f-961d-962fed1aaf34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:15.175711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f26a33f-2839-425f-961d-962fed1aaf34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:15.179076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f26a33f-2839-425f-961d-962fed1aaf34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:15.180780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f26a33f-2839-425f-961d-962fed1aaf34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:15.283482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f26a33f-2839-425f-961d-962fed1aaf34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:15.283592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f26a33f-2839-425f-961d-962fed1aaf34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:15.286961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f26a33f-2839-425f-961d-962fed1aaf34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:15.287491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-0f26a33f-2839-425f-961d-962fed1aaf34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lazy-loading 'fault' on Instance uuid 1847e3cf-10bd-40d5-b668-d5a1c73fc189 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:26:15.377518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-92ba7dae-40f0-4d46-97e2-728661096c89 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:15.393836 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-92ba7dae-40f0-4d46-97e2-728661096c89 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 200 len: 1308 microversion: 2.1 time: 0.571257 Oct 10 23:26:15.401950 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1237/2460] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:14 2022] GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 1308 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:26:15.563286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0f26a33f-2839-425f-961d-962fed1aaf34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:15.582561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0f26a33f-2839-425f-961d-962fed1aaf34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:15.588808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0f26a33f-2839-425f-961d-962fed1aaf34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fabfd9ac67b645bf9234590b623c27b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ebbb0c057c44be8b51615d59209d90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:15.595780 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0f26a33f-2839-425f-961d-962fed1aaf34 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 200 len: 1352 microversion: 2.25 time: 0.468452 Oct 10 23:26:15.609710 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1224/2461] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:15 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 1352 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:16.060938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5ece8b1c-e41a-4152-b9e5-0671f2727d94 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:16.061775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5ece8b1c-e41a-4152-b9e5-0671f2727d94 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:16.069589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ece8b1c-e41a-4152-b9e5-0671f2727d94 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:16.070386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ece8b1c-e41a-4152-b9e5-0671f2727d94 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:16.071534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ece8b1c-e41a-4152-b9e5-0671f2727d94 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:16.072512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ece8b1c-e41a-4152-b9e5-0671f2727d94 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:16.073394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ece8b1c-e41a-4152-b9e5-0671f2727d94 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:16.077003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ece8b1c-e41a-4152-b9e5-0671f2727d94 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:16.268832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5ece8b1c-e41a-4152-b9e5-0671f2727d94 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:16.278490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5ece8b1c-e41a-4152-b9e5-0671f2727d94 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:16.295378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5ece8b1c-e41a-4152-b9e5-0671f2727d94 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:16.305477 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5ece8b1c-e41a-4152-b9e5-0671f2727d94 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.249236 Oct 10 23:26:16.307339 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1238/2462] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:16 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:16.428009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-89e79199-8340-4256-8ddf-b838571da2a8 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:16.430213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-89e79199-8340-4256-8ddf-b838571da2a8 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:16.448590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89e79199-8340-4256-8ddf-b838571da2a8 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:16.450620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89e79199-8340-4256-8ddf-b838571da2a8 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:16.451368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89e79199-8340-4256-8ddf-b838571da2a8 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:16.457860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89e79199-8340-4256-8ddf-b838571da2a8 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:16.462898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89e79199-8340-4256-8ddf-b838571da2a8 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:16.464817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-89e79199-8340-4256-8ddf-b838571da2a8 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:16.625235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0e5ee0c8-4167-4b56-bdb6-8dce56a844d0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:16.626417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0e5ee0c8-4167-4b56-bdb6-8dce56a844d0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] [instance: 1847e3cf-10bd-40d5-b668-d5a1c73fc189] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:16.642006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e5ee0c8-4167-4b56-bdb6-8dce56a844d0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:16.642958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e5ee0c8-4167-4b56-bdb6-8dce56a844d0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:16.643770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e5ee0c8-4167-4b56-bdb6-8dce56a844d0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:16.645987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e5ee0c8-4167-4b56-bdb6-8dce56a844d0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:16.646817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e5ee0c8-4167-4b56-bdb6-8dce56a844d0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:16.648248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e5ee0c8-4167-4b56-bdb6-8dce56a844d0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:16.683790 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-0e5ee0c8-4167-4b56-bdb6-8dce56a844d0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] HTTP exception thrown: Instance 1847e3cf-10bd-40d5-b668-d5a1c73fc189 could not be found. Oct 10 23:26:16.689426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0e5ee0c8-4167-4b56-bdb6-8dce56a844d0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Request method failure captured: Oct 10 23:26:16.689426 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 HTTP/1.1 Oct 10 23:26:16.689426 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:26:16.689426 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:26:16.689426 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:26:16.689426 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:26:16.689426 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:26:16.689426 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:26:16.689426 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:26:16.689426 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:26:16.689426 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKhZqIZA1oxOMX1OC1eOcdSguIJ_DulQxWj0Ue5q2p6UJYynRs89rlsdOHCTgWuGarrq4XPbdbJi1lOyN-sFKr9LDc3gLipfATB9fn3ccS9-q8j95xGd72XVQGzBCOv5WgjoJZH2hsshWwYRnCabpt4eWaX-xLDLlHvOK7BYGfK1cjo Oct 10 23:26:16.689426 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:26:16.689426 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:26:16.689426 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:26:16.689426 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:26:16.689426 n-d-860864-2 devstack@n-api.service[120613]: X-Openstack-Nova-Api-Version: 2.25 Oct 10 23:26:16.689426 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:26:16.689426 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:26:16.689426 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 01ebbb0c057c44be8b51615d59209d90 Oct 10 23:26:16.689426 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1185304471 Oct 10 23:26:16.689426 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:26:16.689426 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:26:16.690836 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/01ebbb0c057c44be8b51615d59209d90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/01ebbb0c057c44be8b51615d59209d90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/01ebbb0c057c44be8b51615d59209d90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_01ebbb0c057c44be8b51615d59209d90", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:26:16.690836 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1185304471 Oct 10 23:26:16.690836 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 01ebbb0c057c44be8b51615d59209d90 Oct 10 23:26:16.690836 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1185304471 Oct 10 23:26:16.690836 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-LiveAutoBlockMigrationV225Test-1185304471-project Oct 10 23:26:16.690836 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:26:16.690836 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:26:16.690836 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: fabfd9ac67b645bf9234590b623c27b0 Oct 10 23:26:16.690836 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1185304471-project Oct 10 23:26:16.690836 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:26:16.690836 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 1847e3cf-10bd-40d5-b668-d5a1c73fc189 could not be found. Oct 10 23:26:16.690836 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '1847e3cf-10bd-40d5-b668-d5a1c73fc189'} Oct 10 23:26:16.691506 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:26:16.691506 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:16.691506 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:26:16.691506 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:26:16.691506 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:26:16.691506 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:26:16.691506 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:26:16.691506 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:26:16.691506 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:26:16.691506 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:26:16.691506 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1847e3cf-10bd-40d5-b668-d5a1c73fc189 could not be found. Oct 10 23:26:16.691506 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:16.691506 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:16.691506 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:16.691506 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:16.691506 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:16.691506 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:16.691506 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:26:16.691506 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:26:16.691506 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:26:16.692627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:26:16.692627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:26:16.692627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:26:16.692627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:26:16.692627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:26:16.692627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:26:16.692627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:26:16.692627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1847e3cf-10bd-40d5-b668-d5a1c73fc189 could not be found. Oct 10 23:26:16.692627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:16.692627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:16.692627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:16.692627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:16.692627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:16.692627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:16.692627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:26:16.692627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:26:16.692627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1847e3cf-10bd-40d5-b668-d5a1c73fc189 could not be found. Oct 10 23:26:16.692627 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:16.695423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0e5ee0c8-4167-4b56-bdb6-8dce56a844d0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] Returning 404 to user: Instance 1847e3cf-10bd-40d5-b668-d5a1c73fc189 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:26:16.698596 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0e5ee0c8-4167-4b56-bdb6-8dce56a844d0 tempest-LiveAutoBlockMigrationV225Test-1185304471 tempest-LiveAutoBlockMigrationV225Test-1185304471-project] 10.222.0.23 "GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189" status: 404 len: 111 microversion: 2.25 time: 0.076988 Oct 10 23:26:16.699667 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1239/2463] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:16 2022] GET /compute/v2.1/servers/1847e3cf-10bd-40d5-b668-d5a1c73fc189 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 10 23:26:17.336869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a42f188c-48e7-4ef9-87a3-05f896985839 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:17.338564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a42f188c-48e7-4ef9-87a3-05f896985839 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:17.351283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a42f188c-48e7-4ef9-87a3-05f896985839 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:17.360939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a42f188c-48e7-4ef9-87a3-05f896985839 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:17.363626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a42f188c-48e7-4ef9-87a3-05f896985839 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:17.374354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a42f188c-48e7-4ef9-87a3-05f896985839 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:17.376662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-89e79199-8340-4256-8ddf-b838571da2a8 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:17.377464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a42f188c-48e7-4ef9-87a3-05f896985839 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:17.379141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a42f188c-48e7-4ef9-87a3-05f896985839 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:17.392438 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-89e79199-8340-4256-8ddf-b838571da2a8 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 200 len: 1308 microversion: 2.1 time: 0.965978 Oct 10 23:26:17.393551 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1225/2464] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:16 2022] GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 1308 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:17.694888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a42f188c-48e7-4ef9-87a3-05f896985839 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:17.712867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a42f188c-48e7-4ef9-87a3-05f896985839 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:17.726852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a42f188c-48e7-4ef9-87a3-05f896985839 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:17.762610 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a42f188c-48e7-4ef9-87a3-05f896985839 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.423722 Oct 10 23:26:17.763902 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1240/2465] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:17 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:18.426506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dd0c80e5-0b03-4a4b-9151-51ff213fc4e2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:18.427027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dd0c80e5-0b03-4a4b-9151-51ff213fc4e2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:18.445557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd0c80e5-0b03-4a4b-9151-51ff213fc4e2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:18.446195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd0c80e5-0b03-4a4b-9151-51ff213fc4e2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:18.446648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd0c80e5-0b03-4a4b-9151-51ff213fc4e2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:18.452892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd0c80e5-0b03-4a4b-9151-51ff213fc4e2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:18.458806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd0c80e5-0b03-4a4b-9151-51ff213fc4e2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:18.459386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd0c80e5-0b03-4a4b-9151-51ff213fc4e2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:18.802165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e70d2da8-bd2e-4b1d-9de5-48863302db31 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:18.804296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e70d2da8-bd2e-4b1d-9de5-48863302db31 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:18.843547 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e70d2da8-bd2e-4b1d-9de5-48863302db31 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:18.848414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e70d2da8-bd2e-4b1d-9de5-48863302db31 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:18.853159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e70d2da8-bd2e-4b1d-9de5-48863302db31 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:18.861570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e70d2da8-bd2e-4b1d-9de5-48863302db31 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:18.863888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e70d2da8-bd2e-4b1d-9de5-48863302db31 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:18.865622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e70d2da8-bd2e-4b1d-9de5-48863302db31 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:18.896466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:19.083723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dd0c80e5-0b03-4a4b-9151-51ff213fc4e2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:19.102471 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dd0c80e5-0b03-4a4b-9151-51ff213fc4e2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 200 len: 1308 microversion: 2.1 time: 0.674560 Oct 10 23:26:19.104379 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1226/2466] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:18 2022] GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 1308 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:19.216618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e70d2da8-bd2e-4b1d-9de5-48863302db31 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:19.231780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e70d2da8-bd2e-4b1d-9de5-48863302db31 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:19.233237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e70d2da8-bd2e-4b1d-9de5-48863302db31 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:19.277287 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e70d2da8-bd2e-4b1d-9de5-48863302db31 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.476002 Oct 10 23:26:19.283433 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1241/2467] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:18 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:26:20.133787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fccbffd5-ce68-4ba2-9ef5-8fe200eb38ba tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:20.134560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fccbffd5-ce68-4ba2-9ef5-8fe200eb38ba tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:20.154077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fccbffd5-ce68-4ba2-9ef5-8fe200eb38ba tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:20.166626 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fccbffd5-ce68-4ba2-9ef5-8fe200eb38ba tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:20.169661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fccbffd5-ce68-4ba2-9ef5-8fe200eb38ba tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:20.172258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fccbffd5-ce68-4ba2-9ef5-8fe200eb38ba tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:20.174992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fccbffd5-ce68-4ba2-9ef5-8fe200eb38ba tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:20.177649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fccbffd5-ce68-4ba2-9ef5-8fe200eb38ba tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:20.326286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-937359cf-dd17-4068-a3d1-3b1c15579d80 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:20.327060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-937359cf-dd17-4068-a3d1-3b1c15579d80 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:20.343473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-937359cf-dd17-4068-a3d1-3b1c15579d80 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:20.345228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-937359cf-dd17-4068-a3d1-3b1c15579d80 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:20.345817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-937359cf-dd17-4068-a3d1-3b1c15579d80 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:20.347077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-937359cf-dd17-4068-a3d1-3b1c15579d80 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:20.348399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-937359cf-dd17-4068-a3d1-3b1c15579d80 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:20.351074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-937359cf-dd17-4068-a3d1-3b1c15579d80 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:20.661002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fccbffd5-ce68-4ba2-9ef5-8fe200eb38ba tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:20.670548 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fccbffd5-ce68-4ba2-9ef5-8fe200eb38ba tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 200 len: 1308 microversion: 2.1 time: 0.541049 Oct 10 23:26:20.671148 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1227/2468] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:20 2022] GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 1308 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:20.818451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-937359cf-dd17-4068-a3d1-3b1c15579d80 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:20.832876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-937359cf-dd17-4068-a3d1-3b1c15579d80 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:20.840883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-937359cf-dd17-4068-a3d1-3b1c15579d80 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:20.857755 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-937359cf-dd17-4068-a3d1-3b1c15579d80 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.536085 Oct 10 23:26:20.870281 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1242/2469] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:20 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:26:21.699598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3c6df942-1b00-46bb-9c91-e6dae1118574 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:21.700206 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3c6df942-1b00-46bb-9c91-e6dae1118574 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:21.727423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c6df942-1b00-46bb-9c91-e6dae1118574 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:21.728380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=44 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:21.729927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=15 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:21.735924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c6df942-1b00-46bb-9c91-e6dae1118574 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:21.740801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c6df942-1b00-46bb-9c91-e6dae1118574 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:21.742142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-1142f309-f0aa-4701-b335-4516e074f857 req-4fe5d8f3-32dd-4b03-9826-5113461267a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aaa34f0-fc6a-4ef0-9474-3df5dab16917", "name": "network-vif-plugged", "status": "completed", "tag": "74acb0df-5e5f-4bfa-982d-db062eb01948"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:21.745414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c6df942-1b00-46bb-9c91-e6dae1118574 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:21.746201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c6df942-1b00-46bb-9c91-e6dae1118574 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:21.755361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c6df942-1b00-46bb-9c91-e6dae1118574 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:21.783941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1142f309-f0aa-4701-b335-4516e074f857 req-4fe5d8f3-32dd-4b03-9826-5113461267a9 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:21.792495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1142f309-f0aa-4701-b335-4516e074f857 req-4fe5d8f3-32dd-4b03-9826-5113461267a9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:21.793795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1142f309-f0aa-4701-b335-4516e074f857 req-4fe5d8f3-32dd-4b03-9826-5113461267a9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:21.846829 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-1142f309-f0aa-4701-b335-4516e074f857 req-4fe5d8f3-32dd-4b03-9826-5113461267a9 service nova] Creating event network-vif-plugged:74acb0df-5e5f-4bfa-982d-db062eb01948 for instance 3aaa34f0-fc6a-4ef0-9474-3df5dab16917 on n-h2-860864-2 Oct 10 23:26:21.856757 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-1142f309-f0aa-4701-b335-4516e074f857 req-4fe5d8f3-32dd-4b03-9826-5113461267a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129638 Oct 10 23:26:21.858274 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1243/2470] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:22.316640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e9668ad3-ef5b-4f42-815f-6eeae9742237 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1173905166", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "de4c0e75-354a-475e-8f5b-aa897d475c60"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:22.318497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=5 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:22.392905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3c6df942-1b00-46bb-9c91-e6dae1118574 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:22.405250 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3c6df942-1b00-46bb-9c91-e6dae1118574 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 200 len: 1308 microversion: 2.1 time: 0.711038 Oct 10 23:26:22.421435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-e9668ad3-ef5b-4f42-815f-6eeae9742237 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] validate_networks() for [('de4c0e75-354a-475e-8f5b-aa897d475c60', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:26:22.421671 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1228/2471] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:21 2022] GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 1308 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:22.441555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5cfb7c54-d542-4540-8e39-da747c09df37 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:22.442459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5cfb7c54-d542-4540-8e39-da747c09df37 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:22.465758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5cfb7c54-d542-4540-8e39-da747c09df37 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:22.470555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5cfb7c54-d542-4540-8e39-da747c09df37 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:22.479412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5cfb7c54-d542-4540-8e39-da747c09df37 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:22.480440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5cfb7c54-d542-4540-8e39-da747c09df37 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:22.480931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5cfb7c54-d542-4540-8e39-da747c09df37 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:22.481393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5cfb7c54-d542-4540-8e39-da747c09df37 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:22.694592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5cfb7c54-d542-4540-8e39-da747c09df37 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:22.712899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5cfb7c54-d542-4540-8e39-da747c09df37 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:22.716171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5cfb7c54-d542-4540-8e39-da747c09df37 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:22.725741 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5cfb7c54-d542-4540-8e39-da747c09df37 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.305518 Oct 10 23:26:22.727470 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1229/2472] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:22 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:22.746601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=16 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:22.901609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-963b2254-5b94-443e-a599-7958e8417a6d tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Action: 'update', calling method: .version_select at 0x7f662a8fb280>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:22.908182 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-963b2254-5b94-443e-a599-7958e8417a6d tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:22.910712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-963b2254-5b94-443e-a599-7958e8417a6d tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:22.937018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-963b2254-5b94-443e-a599-7958e8417a6d tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:22.966879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-963b2254-5b94-443e-a599-7958e8417a6d tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:22.968484 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-963b2254-5b94-443e-a599-7958e8417a6d tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:22.973803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-963b2254-5b94-443e-a599-7958e8417a6d tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:22.984888 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-963b2254-5b94-443e-a599-7958e8417a6d tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] HTTP exception thrown: Service 5e99a634-44cf-4a16-ab90-26bb7990f245 could not be found. Oct 10 23:26:22.993832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-963b2254-5b94-443e-a599-7958e8417a6d tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Request method failure captured: Oct 10 23:26:22.993832 n-d-860864-2 devstack@n-api.service[120614]: request: PUT /compute/v2.1/os-services/5e99a634-44cf-4a16-ab90-26bb7990f245 HTTP/1.1 Oct 10 23:26:22.993832 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:26:22.993832 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:26:22.993832 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:26:22.993832 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 56 Oct 10 23:26:22.993832 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:26:22.993832 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:26:22.993832 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:26:22.993832 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:26:22.993832 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKod2HZDG_5SkEF9lCltNmW0-SRCrHX7foxE-KdPtsadTr-S-MUTjCXYElpOeEdqUSuiZuvhVstpFU5-qcbiBTsuCy1Wv6TjmST9zuv5OgmxREM2OxrtInQdDViAWQyAUWqJnpbVu54TYYNpe38NZsUkK6qNNcd84sXVUUIYGTqgv8g Oct 10 23:26:22.993832 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:26:22.993832 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:26:22.993832 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:26:22.993832 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:26:22.993832 n-d-860864-2 devstack@n-api.service[120614]: X-Openstack-Nova-Api-Version: 2.53 Oct 10 23:26:22.993832 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:26:22.993832 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:26:22.993832 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 9b4c3dbfcd324f13af3a0e4fe8252215 Oct 10 23:26:22.993832 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-240971683 Oct 10 23:26:22.993832 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:26:22.993832 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:26:22.995262 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9b4c3dbfcd324f13af3a0e4fe8252215"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9b4c3dbfcd324f13af3a0e4fe8252215"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9b4c3dbfcd324f13af3a0e4fe8252215"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9b4c3dbfcd324f13af3a0e4fe8252215", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:26:22.995262 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-240971683 Oct 10 23:26:22.995262 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 9b4c3dbfcd324f13af3a0e4fe8252215 Oct 10 23:26:22.995262 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-240971683 Oct 10 23:26:22.995262 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin Oct 10 23:26:22.995262 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:26:22.995262 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:26:22.995262 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: d16d327a42844e4094d10faf2f54c80a Oct 10 23:26:22.995262 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin Oct 10 23:26:22.995262 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:26:22.995262 n-d-860864-2 devstack@n-api.service[120614]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 10 23:26:22.995262 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:26:22.995262 n-d-860864-2 devstack@n-api.service[120614]: exception: Service 5e99a634-44cf-4a16-ab90-26bb7990f245 could not be found. Oct 10 23:26:22.996294 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '5e99a634-44cf-4a16-ab90-26bb7990f245', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 10 23:26:22.996294 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:26:22.996294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:22.996294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 10 23:26:22.996294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 10 23:26:22.996294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 10 23:26:22.996294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 10 23:26:22.996294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 10 23:26:22.996294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:22.996294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:22.996294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:22.996294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:22.996294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 10 23:26:22.996294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 10 23:26:22.996294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 10 23:26:22.996294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 10 23:26:22.996294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 5e99a634-44cf-4a16-ab90-26bb7990f245 could not be found. Oct 10 23:26:22.996294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:22.996294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:22.996294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:22.996294 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:22.997774 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:22.997774 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:22.997774 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:26:22.997774 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:26:22.997774 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:26:22.997774 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:26:22.997774 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:26:22.997774 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:26:22.997774 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:26:22.997774 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:26:22.997774 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 10 23:26:22.997774 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:26:22.997774 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 5e99a634-44cf-4a16-ab90-26bb7990f245 could not be found. Oct 10 23:26:22.997774 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:22.997774 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:22.997774 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:22.997774 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:22.997774 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:22.997774 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:22.997774 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:26:22.998985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:26:22.998985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 5e99a634-44cf-4a16-ab90-26bb7990f245 could not be found. Oct 10 23:26:22.998985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:23.003483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-963b2254-5b94-443e-a599-7958e8417a6d tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Returning 404 to user: Service 5e99a634-44cf-4a16-ab90-26bb7990f245 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:26:23.004686 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-963b2254-5b94-443e-a599-7958e8417a6d tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/5e99a634-44cf-4a16-ab90-26bb7990f245" status: 404 len: 110 microversion: 2.53 time: 0.267069 Oct 10 23:26:23.005327 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1230/2473] 10.222.0.23 () {62 vars in 1309 bytes} [Mon Oct 10 23:26:22 2022] PUT /compute/v2.1/os-services/5e99a634-44cf-4a16-ab90-26bb7990f245 => generated 110 bytes in 269 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:26:23.017399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-be1e4ca4-12c7-4bac-b5d8-58eba7975337 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Action: 'update', calling method: .version_select at 0x7f662a7edd30>, body: {"status": "disabled"} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:23.021743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be1e4ca4-12c7-4bac-b5d8-58eba7975337 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:23.022236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be1e4ca4-12c7-4bac-b5d8-58eba7975337 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:23.022676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be1e4ca4-12c7-4bac-b5d8-58eba7975337 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:23.038128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be1e4ca4-12c7-4bac-b5d8-58eba7975337 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:23.038615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be1e4ca4-12c7-4bac-b5d8-58eba7975337 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:23.039049 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be1e4ca4-12c7-4bac-b5d8-58eba7975337 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:23.057767 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-be1e4ca4-12c7-4bac-b5d8-58eba7975337 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] HTTP exception thrown: Service 5e99a634-44cf-4a16-ab90-26bb7990f245 could not be found. Oct 10 23:26:23.065829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-be1e4ca4-12c7-4bac-b5d8-58eba7975337 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Request method failure captured: Oct 10 23:26:23.065829 n-d-860864-2 devstack@n-api.service[120614]: request: PUT /compute/v2.1/os-services/5e99a634-44cf-4a16-ab90-26bb7990f245 HTTP/1.1 Oct 10 23:26:23.065829 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:26:23.065829 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:26:23.065829 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:26:23.065829 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 22 Oct 10 23:26:23.065829 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:26:23.065829 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:26:23.065829 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:26:23.065829 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:26:23.065829 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKod2HZDG_5SkEF9lCltNmW0-SRCrHX7foxE-KdPtsadTr-S-MUTjCXYElpOeEdqUSuiZuvhVstpFU5-qcbiBTsuCy1Wv6TjmST9zuv5OgmxREM2OxrtInQdDViAWQyAUWqJnpbVu54TYYNpe38NZsUkK6qNNcd84sXVUUIYGTqgv8g Oct 10 23:26:23.065829 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:26:23.065829 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:26:23.065829 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:26:23.065829 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:26:23.065829 n-d-860864-2 devstack@n-api.service[120614]: X-Openstack-Nova-Api-Version: 2.53 Oct 10 23:26:23.065829 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:26:23.065829 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:26:23.065829 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 9b4c3dbfcd324f13af3a0e4fe8252215 Oct 10 23:26:23.065829 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-240971683 Oct 10 23:26:23.065829 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:26:23.065829 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:26:23.067270 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9b4c3dbfcd324f13af3a0e4fe8252215"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9b4c3dbfcd324f13af3a0e4fe8252215"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9b4c3dbfcd324f13af3a0e4fe8252215"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9b4c3dbfcd324f13af3a0e4fe8252215", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:26:23.067270 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-240971683 Oct 10 23:26:23.067270 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 9b4c3dbfcd324f13af3a0e4fe8252215 Oct 10 23:26:23.067270 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-240971683 Oct 10 23:26:23.067270 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin Oct 10 23:26:23.067270 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:26:23.067270 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:26:23.067270 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: d16d327a42844e4094d10faf2f54c80a Oct 10 23:26:23.067270 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin Oct 10 23:26:23.067270 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:26:23.067270 n-d-860864-2 devstack@n-api.service[120614]: {"status": "disabled"} Oct 10 23:26:23.067270 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:26:23.067270 n-d-860864-2 devstack@n-api.service[120614]: exception: Service 5e99a634-44cf-4a16-ab90-26bb7990f245 could not be found. Oct 10 23:26:23.067270 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '5e99a634-44cf-4a16-ab90-26bb7990f245', 'body': {'status': 'disabled'}} Oct 10 23:26:23.068033 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:26:23.068033 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:23.068033 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 10 23:26:23.068033 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 10 23:26:23.068033 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 10 23:26:23.068033 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 10 23:26:23.068033 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 10 23:26:23.068033 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:23.068033 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:23.068033 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:23.068033 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:23.068033 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 10 23:26:23.068033 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 10 23:26:23.068033 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 10 23:26:23.068033 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 10 23:26:23.068033 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 5e99a634-44cf-4a16-ab90-26bb7990f245 could not be found. Oct 10 23:26:23.068033 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:23.068033 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:23.068033 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:23.068033 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:23.068033 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:23.069170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:23.069170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:26:23.069170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:26:23.069170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:26:23.069170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:26:23.069170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:26:23.069170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:26:23.069170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:26:23.069170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:26:23.069170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 10 23:26:23.069170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:26:23.069170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 5e99a634-44cf-4a16-ab90-26bb7990f245 could not be found. Oct 10 23:26:23.069170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:23.069170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:23.069170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:23.069170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:23.069170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:23.069170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:23.069170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:26:23.069170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:26:23.071973 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 5e99a634-44cf-4a16-ab90-26bb7990f245 could not be found. Oct 10 23:26:23.071973 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:23.071973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-be1e4ca4-12c7-4bac-b5d8-58eba7975337 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Returning 404 to user: Service 5e99a634-44cf-4a16-ab90-26bb7990f245 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:26:23.072983 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-be1e4ca4-12c7-4bac-b5d8-58eba7975337 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/5e99a634-44cf-4a16-ab90-26bb7990f245" status: 404 len: 110 microversion: 2.53 time: 0.058625 Oct 10 23:26:23.077679 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1231/2474] 10.222.0.23 () {62 vars in 1309 bytes} [Mon Oct 10 23:26:23 2022] PUT /compute/v2.1/os-services/5e99a634-44cf-4a16-ab90-26bb7990f245 => generated 110 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:26:23.090140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-67973ac4-48b6-46e7-bcea-c1d3b3c0c030 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Action: 'update', calling method: .version_select at 0x7f662a6f4b80>, body: {"status": "enabled"} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:23.098433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67973ac4-48b6-46e7-bcea-c1d3b3c0c030 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:23.099693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67973ac4-48b6-46e7-bcea-c1d3b3c0c030 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:23.100159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67973ac4-48b6-46e7-bcea-c1d3b3c0c030 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:23.120229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67973ac4-48b6-46e7-bcea-c1d3b3c0c030 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:23.120741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67973ac4-48b6-46e7-bcea-c1d3b3c0c030 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:23.121186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67973ac4-48b6-46e7-bcea-c1d3b3c0c030 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:23.147120 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-67973ac4-48b6-46e7-bcea-c1d3b3c0c030 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] HTTP exception thrown: Service 5e99a634-44cf-4a16-ab90-26bb7990f245 could not be found. Oct 10 23:26:23.148723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-67973ac4-48b6-46e7-bcea-c1d3b3c0c030 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Request method failure captured: Oct 10 23:26:23.148723 n-d-860864-2 devstack@n-api.service[120614]: request: PUT /compute/v2.1/os-services/5e99a634-44cf-4a16-ab90-26bb7990f245 HTTP/1.1 Oct 10 23:26:23.148723 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:26:23.148723 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:26:23.148723 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:26:23.148723 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 21 Oct 10 23:26:23.148723 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:26:23.148723 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:26:23.148723 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:26:23.148723 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:26:23.148723 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKod2HZDG_5SkEF9lCltNmW0-SRCrHX7foxE-KdPtsadTr-S-MUTjCXYElpOeEdqUSuiZuvhVstpFU5-qcbiBTsuCy1Wv6TjmST9zuv5OgmxREM2OxrtInQdDViAWQyAUWqJnpbVu54TYYNpe38NZsUkK6qNNcd84sXVUUIYGTqgv8g Oct 10 23:26:23.148723 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:26:23.148723 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:26:23.148723 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:26:23.148723 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:26:23.148723 n-d-860864-2 devstack@n-api.service[120614]: X-Openstack-Nova-Api-Version: 2.53 Oct 10 23:26:23.148723 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:26:23.148723 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:26:23.148723 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 9b4c3dbfcd324f13af3a0e4fe8252215 Oct 10 23:26:23.148723 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-240971683 Oct 10 23:26:23.148723 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:26:23.148723 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:26:23.150017 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9b4c3dbfcd324f13af3a0e4fe8252215"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9b4c3dbfcd324f13af3a0e4fe8252215"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9b4c3dbfcd324f13af3a0e4fe8252215"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9b4c3dbfcd324f13af3a0e4fe8252215", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:26:23.150017 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-240971683 Oct 10 23:26:23.150017 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 9b4c3dbfcd324f13af3a0e4fe8252215 Oct 10 23:26:23.150017 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-240971683 Oct 10 23:26:23.150017 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin Oct 10 23:26:23.150017 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:26:23.150017 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:26:23.150017 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: d16d327a42844e4094d10faf2f54c80a Oct 10 23:26:23.150017 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin Oct 10 23:26:23.150017 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:26:23.150017 n-d-860864-2 devstack@n-api.service[120614]: {"status": "enabled"} Oct 10 23:26:23.150017 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:26:23.150017 n-d-860864-2 devstack@n-api.service[120614]: exception: Service 5e99a634-44cf-4a16-ab90-26bb7990f245 could not be found. Oct 10 23:26:23.150017 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '5e99a634-44cf-4a16-ab90-26bb7990f245', 'body': {'status': 'enabled'}} Oct 10 23:26:23.150811 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:26:23.150811 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:23.150811 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 10 23:26:23.150811 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 10 23:26:23.150811 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 10 23:26:23.150811 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 10 23:26:23.150811 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 10 23:26:23.150811 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:23.150811 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:23.150811 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:23.150811 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:23.150811 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 10 23:26:23.150811 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 10 23:26:23.150811 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 10 23:26:23.150811 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 10 23:26:23.150811 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 5e99a634-44cf-4a16-ab90-26bb7990f245 could not be found. Oct 10 23:26:23.150811 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:23.150811 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:23.150811 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:23.150811 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:23.150811 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:23.157156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:23.157156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:26:23.157156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:26:23.157156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:26:23.157156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:26:23.157156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:26:23.157156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:26:23.157156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:26:23.157156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:26:23.157156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 10 23:26:23.157156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:26:23.157156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 5e99a634-44cf-4a16-ab90-26bb7990f245 could not be found. Oct 10 23:26:23.157156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:23.157156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:23.157156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:23.157156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:23.157156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:23.157156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:23.157156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:26:23.157156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:26:23.158349 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 5e99a634-44cf-4a16-ab90-26bb7990f245 could not be found. Oct 10 23:26:23.158349 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:23.158349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-67973ac4-48b6-46e7-bcea-c1d3b3c0c030 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Returning 404 to user: Service 5e99a634-44cf-4a16-ab90-26bb7990f245 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:26:23.158349 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-67973ac4-48b6-46e7-bcea-c1d3b3c0c030 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/5e99a634-44cf-4a16-ab90-26bb7990f245" status: 404 len: 110 microversion: 2.53 time: 0.071441 Oct 10 23:26:23.167814 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1232/2475] 10.222.0.23 () {62 vars in 1309 bytes} [Mon Oct 10 23:26:23 2022] PUT /compute/v2.1/os-services/5e99a634-44cf-4a16-ab90-26bb7990f245 => generated 110 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:26:23.173054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ed38cd2f-fd6b-418e-be74-0606d7311127 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:23.176581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed38cd2f-fd6b-418e-be74-0606d7311127 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:23.177062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed38cd2f-fd6b-418e-be74-0606d7311127 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:23.198833 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed38cd2f-fd6b-418e-be74-0606d7311127 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:23.202099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed38cd2f-fd6b-418e-be74-0606d7311127 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:23.206034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed38cd2f-fd6b-418e-be74-0606d7311127 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:23.210049 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed38cd2f-fd6b-418e-be74-0606d7311127 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:23.273752 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ed38cd2f-fd6b-418e-be74-0606d7311127 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.104320 Oct 10 23:26:23.274371 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1233/2476] 10.222.0.23 () {60 vars in 1178 bytes} [Mon Oct 10 23:26:23 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:23.297289 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b8506fba-a92c-4898-8890-66ebfee184c1 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:23.300971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8506fba-a92c-4898-8890-66ebfee184c1 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:23.303688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8506fba-a92c-4898-8890-66ebfee184c1 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:23.304177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8506fba-a92c-4898-8890-66ebfee184c1 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:23.304935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8506fba-a92c-4898-8890-66ebfee184c1 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:23.305410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8506fba-a92c-4898-8890-66ebfee184c1 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:23.310874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8506fba-a92c-4898-8890-66ebfee184c1 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:23.353457 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b8506fba-a92c-4898-8890-66ebfee184c1 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.069624 Oct 10 23:26:23.364493 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1234/2477] 10.222.0.23 () {60 vars in 1211 bytes} [Mon Oct 10 23:26:23 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:23.369342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-23255202-3bc3-42a1-8f55-4a0877f56efb tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:23.373109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23255202-3bc3-42a1-8f55-4a0877f56efb tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:23.373493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23255202-3bc3-42a1-8f55-4a0877f56efb tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:23.382196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23255202-3bc3-42a1-8f55-4a0877f56efb tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:23.383633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23255202-3bc3-42a1-8f55-4a0877f56efb tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:23.384321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23255202-3bc3-42a1-8f55-4a0877f56efb tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:23.384773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23255202-3bc3-42a1-8f55-4a0877f56efb tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:23.444372 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-23255202-3bc3-42a1-8f55-4a0877f56efb tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.078650 Oct 10 23:26:23.445179 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1235/2478] 10.222.0.23 () {60 vars in 1178 bytes} [Mon Oct 10 23:26:23 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:23.449886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-300f427e-e74a-47c5-a6c3-b03c587583f6 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:23.450497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-300f427e-e74a-47c5-a6c3-b03c587583f6 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:23.458727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-300f427e-e74a-47c5-a6c3-b03c587583f6 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:23.459489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-300f427e-e74a-47c5-a6c3-b03c587583f6 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:23.459929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-300f427e-e74a-47c5-a6c3-b03c587583f6 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:23.460637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-300f427e-e74a-47c5-a6c3-b03c587583f6 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:23.461084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-300f427e-e74a-47c5-a6c3-b03c587583f6 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:23.461539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-300f427e-e74a-47c5-a6c3-b03c587583f6 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:24.008332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-300f427e-e74a-47c5-a6c3-b03c587583f6 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:24.024295 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-300f427e-e74a-47c5-a6c3-b03c587583f6 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 200 len: 1308 microversion: 2.1 time: 0.578124 Oct 10 23:26:24.025118 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1236/2479] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:23 2022] GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 1308 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:24.029530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ae077f06-dfc3-4cef-a979-fc89977e52b3 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:24.046694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae077f06-dfc3-4cef-a979-fc89977e52b3 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:24.047826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae077f06-dfc3-4cef-a979-fc89977e52b3 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:24.048300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae077f06-dfc3-4cef-a979-fc89977e52b3 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:24.049083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae077f06-dfc3-4cef-a979-fc89977e52b3 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:24.049576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae077f06-dfc3-4cef-a979-fc89977e52b3 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:24.050007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae077f06-dfc3-4cef-a979-fc89977e52b3 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:24.113737 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ae077f06-dfc3-4cef-a979-fc89977e52b3 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-860864-2&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.087630 Oct 10 23:26:24.128960 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1237/2480] 10.222.0.23 () {60 vars in 1235 bytes} [Mon Oct 10 23:26:24 2022] GET /compute/v2.1/os-services?host=n-d-860864-2&binary=xxx => generated 16 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:24.135127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7ac7062a-e350-4ca2-849b-8b89c8e30d77 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:24.140839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7ac7062a-e350-4ca2-849b-8b89c8e30d77 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:24.156107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ac7062a-e350-4ca2-849b-8b89c8e30d77 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:24.156944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ac7062a-e350-4ca2-849b-8b89c8e30d77 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:24.157871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ac7062a-e350-4ca2-849b-8b89c8e30d77 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:24.160329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ac7062a-e350-4ca2-849b-8b89c8e30d77 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:24.161057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ac7062a-e350-4ca2-849b-8b89c8e30d77 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:24.166160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ac7062a-e350-4ca2-849b-8b89c8e30d77 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:24.331499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7ac7062a-e350-4ca2-849b-8b89c8e30d77 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:24.344391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7ac7062a-e350-4ca2-849b-8b89c8e30d77 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:24.361872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7ac7062a-e350-4ca2-849b-8b89c8e30d77 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:24.380242 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7ac7062a-e350-4ca2-849b-8b89c8e30d77 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.249543 Oct 10 23:26:24.381302 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1238/2481] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:24 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:24.386229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4549844a-5917-459c-bd20-685235346b65 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:24.403363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4549844a-5917-459c-bd20-685235346b65 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:24.409561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4549844a-5917-459c-bd20-685235346b65 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:24.412654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4549844a-5917-459c-bd20-685235346b65 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:24.426066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4549844a-5917-459c-bd20-685235346b65 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:24.426736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4549844a-5917-459c-bd20-685235346b65 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:24.427195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4549844a-5917-459c-bd20-685235346b65 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:24.450687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e9668ad3-ef5b-4f42-815f-6eeae9742237 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:26:24.452005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e9668ad3-ef5b-4f42-815f-6eeae9742237 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:26:24.452711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e9668ad3-ef5b-4f42-815f-6eeae9742237 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:26:24.455732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e9668ad3-ef5b-4f42-815f-6eeae9742237 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:26:24.456607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e9668ad3-ef5b-4f42-815f-6eeae9742237 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:26:24.491449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9668ad3-ef5b-4f42-815f-6eeae9742237 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:24.492430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9668ad3-ef5b-4f42-815f-6eeae9742237 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:24.494882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9668ad3-ef5b-4f42-815f-6eeae9742237 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:24.496228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9668ad3-ef5b-4f42-815f-6eeae9742237 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:24.496909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9668ad3-ef5b-4f42-815f-6eeae9742237 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:24.499509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9668ad3-ef5b-4f42-815f-6eeae9742237 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:24.508644 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4549844a-5917-459c-bd20-685235346b65 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.125871 Oct 10 23:26:24.509333 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1239/2482] 10.222.0.23 () {60 vars in 1178 bytes} [Mon Oct 10 23:26:24 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:24.543734 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e95b41d7-6297-40e2-9b7c-fe1f563f6991 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:24.550763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e95b41d7-6297-40e2-9b7c-fe1f563f6991 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:24.555797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-e9668ad3-ef5b-4f42-815f-6eeae9742237 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Getting quotas for project 43bf1bebb02c4359a949d820dd31c49e. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:26:24.558579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e95b41d7-6297-40e2-9b7c-fe1f563f6991 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:24.559066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e95b41d7-6297-40e2-9b7c-fe1f563f6991 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:24.560028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e95b41d7-6297-40e2-9b7c-fe1f563f6991 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:24.560503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e95b41d7-6297-40e2-9b7c-fe1f563f6991 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:24.560937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e95b41d7-6297-40e2-9b7c-fe1f563f6991 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:24.574484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-e9668ad3-ef5b-4f42-815f-6eeae9742237 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Getting quotas for user 3fd164398b9e4a8dac71bcd96eccbb2a and project 43bf1bebb02c4359a949d820dd31c49e. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:26:24.607238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e9668ad3-ef5b-4f42-815f-6eeae9742237 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:26:24.615987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e9668ad3-ef5b-4f42-815f-6eeae9742237 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:26:24.747812 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e9668ad3-ef5b-4f42-815f-6eeae9742237 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.886812 Oct 10 23:26:24.754921 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1244/2483] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:26:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:26:24.784766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3a22964d-ae98-4640-853d-acf39d549ae7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:24.790617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3a22964d-ae98-4640-853d-acf39d549ae7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:25.353850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:25.372433 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e95b41d7-6297-40e2-9b7c-fe1f563f6991 tempest-ServicesAdminNegativeV253TestJSON-240971683 tempest-ServicesAdminNegativeV253TestJSON-240971683-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.848774 Oct 10 23:26:25.379916 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1240/2484] 10.222.0.23 () {60 vars in 1239 bytes} [Mon Oct 10 23:26:24 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:25.387637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-36f24049-d27d-4d80-8caf-db187d1e49a2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:25.388981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-36f24049-d27d-4d80-8caf-db187d1e49a2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:25.399294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36f24049-d27d-4d80-8caf-db187d1e49a2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:25.400601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36f24049-d27d-4d80-8caf-db187d1e49a2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:25.401967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36f24049-d27d-4d80-8caf-db187d1e49a2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:25.403578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36f24049-d27d-4d80-8caf-db187d1e49a2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:25.404316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36f24049-d27d-4d80-8caf-db187d1e49a2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:25.404971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36f24049-d27d-4d80-8caf-db187d1e49a2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:25.571957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3a22964d-ae98-4640-853d-acf39d549ae7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:25.579983 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3a22964d-ae98-4640-853d-acf39d549ae7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27" status: 200 len: 1224 microversion: 2.1 time: 0.816484 Oct 10 23:26:25.583753 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1245/2485] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:24 2022] GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27 => generated 1224 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:25.863657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5634524c-0d5d-4930-aa87-18cf677fa94d tempest-ServicesAdminNegativeV253TestJSON-1144154648 tempest-ServicesAdminNegativeV253TestJSON-1144154648-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:25.867828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5634524c-0d5d-4930-aa87-18cf677fa94d tempest-ServicesAdminNegativeV253TestJSON-1144154648 tempest-ServicesAdminNegativeV253TestJSON-1144154648-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '5258ae87f2ac4a2eacad0dedc9752dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535d51aa16e24502a71ae940cecf457e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:25.873029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5634524c-0d5d-4930-aa87-18cf677fa94d tempest-ServicesAdminNegativeV253TestJSON-1144154648 tempest-ServicesAdminNegativeV253TestJSON-1144154648-project] Request method failure captured: Oct 10 23:26:25.873029 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 10 23:26:25.873029 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:26:25.873029 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:26:25.873029 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:26:25.873029 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:26:25.873029 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:26:25.873029 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:26:25.873029 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:26:25.873029 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:26:25.873029 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKoc4lLf6B3WPAHisCPegV7Lx0LkGZXTZ-6r5kRtbfa_pHdZrC_UcMJZNo8xgi869UfsvkDOjXOPeq1ycYBkP7WJFwJ6E6mhYD57xtOo2naDmTFaIaxl3_yh34VUzSl1c27YBrtUyeYjccmk-b4D-KcM6mVwrCOHLeKpUsRU3hOBFnk Oct 10 23:26:25.873029 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:26:25.873029 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:26:25.873029 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:26:25.873029 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:26:25.873029 n-d-860864-2 devstack@n-api.service[120613]: X-Openstack-Nova-Api-Version: 2.53 Oct 10 23:26:25.873029 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:26:25.873029 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:26:25.873029 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 535d51aa16e24502a71ae940cecf457e Oct 10 23:26:25.873029 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1144154648 Oct 10 23:26:25.873029 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:26:25.873029 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:26:25.875541 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/535d51aa16e24502a71ae940cecf457e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/535d51aa16e24502a71ae940cecf457e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/535d51aa16e24502a71ae940cecf457e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_535d51aa16e24502a71ae940cecf457e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:26:25.875541 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1144154648 Oct 10 23:26:25.875541 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 535d51aa16e24502a71ae940cecf457e Oct 10 23:26:25.875541 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1144154648 Oct 10 23:26:25.875541 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1144154648-project Oct 10 23:26:25.875541 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:26:25.875541 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:26:25.875541 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 5258ae87f2ac4a2eacad0dedc9752dec Oct 10 23:26:25.875541 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1144154648-project Oct 10 23:26:25.875541 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:26:25.875541 n-d-860864-2 devstack@n-api.service[120613]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 10 23:26:25.875541 n-d-860864-2 devstack@n-api.service[120613]: action_args: {} Oct 10 23:26:25.877142 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:26:25.877142 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:25.877142 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:25.877142 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:25.877142 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:26:25.877142 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:26:25.877142 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 23:26:25.877142 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:26:25.877142 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 23:26:25.877142 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:26:25.877142 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:26:25.877142 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:26:25.877142 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 10 23:26:25.877142 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 10 23:26:25.877142 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:26:25.877142 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:26:25.877142 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:26:25.877142 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:26:25.877142 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:26:25.879545 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:26:25.879545 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:26:25.879545 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:26:25.879545 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:26:25.879545 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:26:25.879545 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:26:25.879545 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:26:25.879545 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:26:25.879545 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:26:25.879545 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 10 23:26:25.879545 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:25.879545 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:25.879545 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:25.879545 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:25.879545 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:25.879545 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:25.879545 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:26:25.879545 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:26:25.879545 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 10 23:26:25.879545 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:25.881215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-36f24049-d27d-4d80-8caf-db187d1e49a2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:25.882488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5634524c-0d5d-4930-aa87-18cf677fa94d tempest-ServicesAdminNegativeV253TestJSON-1144154648 tempest-ServicesAdminNegativeV253TestJSON-1144154648-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:26:25.882818 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5634524c-0d5d-4930-aa87-18cf677fa94d tempest-ServicesAdminNegativeV253TestJSON-1144154648 tempest-ServicesAdminNegativeV253TestJSON-1144154648-project] 10.222.0.23 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.297926 Oct 10 23:26:25.883405 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1246/2486] 10.222.0.23 () {60 vars in 1178 bytes} [Mon Oct 10 23:26:25 2022] GET /compute/v2.1/os-services => generated 112 bytes in 299 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:26:25.900091 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-36f24049-d27d-4d80-8caf-db187d1e49a2 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 200 len: 1487 microversion: 2.1 time: 0.517241 Oct 10 23:26:25.911813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-513209f8-1407-4e58-854c-018f6fb53bd4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:25.915565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-513209f8-1407-4e58-854c-018f6fb53bd4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:25.924904 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1241/2487] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:25 2022] GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 1487 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:25.941624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f7001a73-3655-42e7-ad05-aadb19bcad9c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-941640475"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:25.945550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-513209f8-1407-4e58-854c-018f6fb53bd4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:25.948013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-513209f8-1407-4e58-854c-018f6fb53bd4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:25.948495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-513209f8-1407-4e58-854c-018f6fb53bd4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:25.949214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f7001a73-3655-42e7-ad05-aadb19bcad9c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:25.949358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-513209f8-1407-4e58-854c-018f6fb53bd4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:25.949741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-513209f8-1407-4e58-854c-018f6fb53bd4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:25.950181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-513209f8-1407-4e58-854c-018f6fb53bd4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:25.977317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7001a73-3655-42e7-ad05-aadb19bcad9c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:25.977847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7001a73-3655-42e7-ad05-aadb19bcad9c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:25.978292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7001a73-3655-42e7-ad05-aadb19bcad9c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:25.979006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7001a73-3655-42e7-ad05-aadb19bcad9c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:25.979457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7001a73-3655-42e7-ad05-aadb19bcad9c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:25.987807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7001a73-3655-42e7-ad05-aadb19bcad9c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:26.313606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-513209f8-1407-4e58-854c-018f6fb53bd4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:26.333527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-513209f8-1407-4e58-854c-018f6fb53bd4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:26.342010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-513209f8-1407-4e58-854c-018f6fb53bd4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:26.366552 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-513209f8-1407-4e58-854c-018f6fb53bd4 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.474550 Oct 10 23:26:26.393395 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1247/2488] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:25 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:26.607769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c0cef8c6-451a-4f80-a3a4-29dc52cc8409 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:26.608350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c0cef8c6-451a-4f80-a3a4-29dc52cc8409 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:26.618905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0cef8c6-451a-4f80-a3a4-29dc52cc8409 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:26.619401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0cef8c6-451a-4f80-a3a4-29dc52cc8409 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:26.619845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0cef8c6-451a-4f80-a3a4-29dc52cc8409 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:26.620566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0cef8c6-451a-4f80-a3a4-29dc52cc8409 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:26.631273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0cef8c6-451a-4f80-a3a4-29dc52cc8409 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:26.632028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0cef8c6-451a-4f80-a3a4-29dc52cc8409 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:26.693848 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f7001a73-3655-42e7-ad05-aadb19bcad9c tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "POST /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917/action" status: 202 len: 0 microversion: 2.1 time: 0.766999 Oct 10 23:26:26.710523 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1242/2489] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:26:25 2022] POST /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917/action => generated 0 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 23:26:26.727242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4027e9e6-7e50-4a82-9e71-355746c4115b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662a6dfaf0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:26.843255 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4027e9e6-7e50-4a82-9e71-355746c4115b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/c1ab7d0e-40a5-4bdd-be98-c9b1896a37f5" status: 200 len: 1413 microversion: 2.1 time: 0.129656 Oct 10 23:26:26.846024 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1243/2490] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:26:26 2022] GET /compute/v2.1/images/c1ab7d0e-40a5-4bdd-be98-c9b1896a37f5 => generated 1413 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:26.863124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3e9d33a4-c5e7-4624-88e3-eaf9639adc73 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662a69a4c0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:26.938768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c0cef8c6-451a-4f80-a3a4-29dc52cc8409 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:26.958911 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c0cef8c6-451a-4f80-a3a4-29dc52cc8409 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27" status: 200 len: 1220 microversion: 2.1 time: 0.356721 Oct 10 23:26:26.962323 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1248/2491] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:26 2022] GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27 => generated 1220 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:26.972690 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3e9d33a4-c5e7-4624-88e3-eaf9639adc73 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/c1ab7d0e-40a5-4bdd-be98-c9b1896a37f5" status: 200 len: 1413 microversion: 2.1 time: 0.115228 Oct 10 23:26:26.975108 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1244/2492] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:26:26 2022] GET /compute/v2.1/images/c1ab7d0e-40a5-4bdd-be98-c9b1896a37f5 => generated 1413 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:26.990849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e2d07fd1-1b22-473b-a965-94b0aa31a45f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f6633ba35e0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:27.399965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0eb25fc1-3142-4fac-8165-34d77c727fe2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:27.400614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0eb25fc1-3142-4fac-8165-34d77c727fe2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:27.426697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0eb25fc1-3142-4fac-8165-34d77c727fe2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:27.430394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0eb25fc1-3142-4fac-8165-34d77c727fe2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:27.435937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0eb25fc1-3142-4fac-8165-34d77c727fe2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:27.439914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0eb25fc1-3142-4fac-8165-34d77c727fe2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:27.444014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0eb25fc1-3142-4fac-8165-34d77c727fe2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:27.450054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0eb25fc1-3142-4fac-8165-34d77c727fe2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:27.477342 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e2d07fd1-1b22-473b-a965-94b0aa31a45f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "DELETE /compute/v2.1/images/c1ab7d0e-40a5-4bdd-be98-c9b1896a37f5" status: 204 len: 0 microversion: 2.1 time: 0.490277 Oct 10 23:26:27.478296 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1249/2493] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:26 2022] DELETE /compute/v2.1/images/c1ab7d0e-40a5-4bdd-be98-c9b1896a37f5 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:26:27.490397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-51896ee5-3710-4ee8-acbe-9f5f0983696b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f6633bb6d30>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:27.541151 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-51896ee5-3710-4ee8-acbe-9f5f0983696b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] HTTP exception thrown: Image not found. Oct 10 23:26:27.545898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-51896ee5-3710-4ee8-acbe-9f5f0983696b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Request method failure captured: Oct 10 23:26:27.545898 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/images/c1ab7d0e-40a5-4bdd-be98-c9b1896a37f5 HTTP/1.1 Oct 10 23:26:27.545898 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:26:27.545898 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:26:27.545898 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:26:27.545898 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:26:27.545898 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:26:27.545898 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:26:27.545898 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:26:27.545898 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:26:27.545898 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKk3KVehVj7kfhzKO7tP10F0nlws0ecnjL84hxYafJIYLkjhpObR0LeWUMazGIolaSnKaUKcQW10Z2dzveaz0v3jU-Wyi7o3FT8_QKBHt6aDVoJ0Efrz6xLbsnLq3nzDe2RIbHuMTp0TY7juRUiIzABxnHu6L2zEztBJiX8mJ-c3jW8 Oct 10 23:26:27.545898 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:26:27.545898 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:26:27.545898 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:26:27.545898 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:26:27.545898 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:26:27.545898 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:26:27.545898 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:27.545898 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:27.545898 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:26:27.545898 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:26:27.547516 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_451d034bd7474164a08bd3374680c0d2", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:26:27.547516 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:27.547516 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:27.547516 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:27.547516 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:27.547516 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:26:27.547516 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:26:27.547516 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 60c692636a4b4667a4eff5cde6e183bc Oct 10 23:26:27.547516 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:27.547516 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:26:27.547516 n-d-860864-2 devstack@n-api.service[120613]: exception: Image not found. Oct 10 23:26:27.547516 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'c1ab7d0e-40a5-4bdd-be98-c9b1896a37f5'} Oct 10 23:26:27.547516 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:26:27.547516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:27.548411 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 23:26:27.548411 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 23:26:27.548411 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:26:27.548411 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:26:27.548411 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 23:26:27.548411 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 23:26:27.548411 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:26:27.548411 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:26:27.548411 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 23:26:27.548411 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 23:26:27.548411 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 23:26:27.548411 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 23:26:27.548411 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:26:27.548411 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:26:27.548411 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:26:27.548411 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:26:27.548411 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c1ab7d0e-40a5-4bdd-be98-c9b1896a37f5 Oct 10 23:26:27.548411 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:27.553899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:27.553899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:27.553899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:27.553899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 10 23:26:27.553899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 10 23:26:27.553899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 23:26:27.553899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 23:26:27.553899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 23:26:27.553899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 23:26:27.553899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 23:26:27.553899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 23:26:27.553899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 23:26:27.553899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 23:26:27.553899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:26:27.553899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:26:27.553899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 23:26:27.553899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 23:26:27.553899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:26:27.553899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:26:27.555106 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 23:26:27.555106 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 23:26:27.555106 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 23:26:27.555106 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 23:26:27.555106 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:26:27.555106 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:26:27.555106 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:26:27.555106 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:26:27.555106 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c1ab7d0e-40a5-4bdd-be98-c9b1896a37f5 could not be found. Oct 10 23:26:27.555106 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:27.555106 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:27.555106 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:27.555106 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:27.555106 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:27.555106 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:27.555106 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:26:27.555106 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:26:27.555106 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:26:27.555106 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:26:27.556246 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:26:27.556246 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:26:27.556246 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 10 23:26:27.556246 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 23:26:27.556246 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 23:26:27.556246 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:27.556246 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:27.556246 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:27.556246 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:27.556246 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:27.556246 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:27.556246 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:26:27.556246 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:26:27.556246 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 23:26:27.556246 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:27.556246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-51896ee5-3710-4ee8-acbe-9f5f0983696b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Returning 404 to user: Image not found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:26:27.556246 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-51896ee5-3710-4ee8-acbe-9f5f0983696b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/images/c1ab7d0e-40a5-4bdd-be98-c9b1896a37f5" status: 404 len: 62 microversion: 2.1 time: 0.065577 Oct 10 23:26:27.557168 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1250/2494] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:26:27 2022] GET /compute/v2.1/images/c1ab7d0e-40a5-4bdd-be98-c9b1896a37f5 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:26:27.570168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cf5bda72-e6d8-4037-858a-da3eaced4e67 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:27.572030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cf5bda72-e6d8-4037-858a-da3eaced4e67 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:27.616864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf5bda72-e6d8-4037-858a-da3eaced4e67 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:27.618998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf5bda72-e6d8-4037-858a-da3eaced4e67 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:27.621411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf5bda72-e6d8-4037-858a-da3eaced4e67 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:27.624636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf5bda72-e6d8-4037-858a-da3eaced4e67 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:27.627985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf5bda72-e6d8-4037-858a-da3eaced4e67 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:27.630443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf5bda72-e6d8-4037-858a-da3eaced4e67 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:27.761938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0eb25fc1-3142-4fac-8165-34d77c727fe2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:27.776380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0eb25fc1-3142-4fac-8165-34d77c727fe2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:27.786405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0eb25fc1-3142-4fac-8165-34d77c727fe2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:27.810606 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0eb25fc1-3142-4fac-8165-34d77c727fe2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.415605 Oct 10 23:26:27.811211 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1245/2495] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:27 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:26:27.988374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-195cbae7-4356-415f-8696-1b70c2b976a2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:27.989262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-195cbae7-4356-415f-8696-1b70c2b976a2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:28.002100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-195cbae7-4356-415f-8696-1b70c2b976a2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:28.008129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-195cbae7-4356-415f-8696-1b70c2b976a2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:28.008533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-195cbae7-4356-415f-8696-1b70c2b976a2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:28.009305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-195cbae7-4356-415f-8696-1b70c2b976a2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:28.009807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-195cbae7-4356-415f-8696-1b70c2b976a2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:28.010249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-195cbae7-4356-415f-8696-1b70c2b976a2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:28.098603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cf5bda72-e6d8-4037-858a-da3eaced4e67 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:28.113233 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cf5bda72-e6d8-4037-858a-da3eaced4e67 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 200 len: 1499 microversion: 2.1 time: 0.557534 Oct 10 23:26:28.115108 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1251/2496] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:27 2022] GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 1499 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:26:28.841849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-90dd924a-1e33-4cdf-bc3a-76928c00b94e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:28.842475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-90dd924a-1e33-4cdf-bc3a-76928c00b94e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:28.863704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90dd924a-1e33-4cdf-bc3a-76928c00b94e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:28.864213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90dd924a-1e33-4cdf-bc3a-76928c00b94e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:28.864666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90dd924a-1e33-4cdf-bc3a-76928c00b94e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:28.866671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90dd924a-1e33-4cdf-bc3a-76928c00b94e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:28.867141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90dd924a-1e33-4cdf-bc3a-76928c00b94e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:28.867576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90dd924a-1e33-4cdf-bc3a-76928c00b94e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:29.132220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-90dd924a-1e33-4cdf-bc3a-76928c00b94e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:29.150986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-90dd924a-1e33-4cdf-bc3a-76928c00b94e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:29.152498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-90dd924a-1e33-4cdf-bc3a-76928c00b94e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:29.172438 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-90dd924a-1e33-4cdf-bc3a-76928c00b94e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.335163 Oct 10 23:26:29.194870 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1252/2497] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:28 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:26:29.197895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-195cbae7-4356-415f-8696-1b70c2b976a2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:29.212697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1e3ee53a-8e60-4ba2-b3cc-be9e91cc2961 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:29.213397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1e3ee53a-8e60-4ba2-b3cc-be9e91cc2961 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:29.217663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:29.234036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e3ee53a-8e60-4ba2-b3cc-be9e91cc2961 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:29.234641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e3ee53a-8e60-4ba2-b3cc-be9e91cc2961 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:29.235092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e3ee53a-8e60-4ba2-b3cc-be9e91cc2961 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:29.235825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e3ee53a-8e60-4ba2-b3cc-be9e91cc2961 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:29.240621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e3ee53a-8e60-4ba2-b3cc-be9e91cc2961 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:29.242184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e3ee53a-8e60-4ba2-b3cc-be9e91cc2961 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:29.242513 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-195cbae7-4356-415f-8696-1b70c2b976a2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27" status: 200 len: 1282 microversion: 2.1 time: 1.258320 Oct 10 23:26:29.253216 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1246/2498] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:27 2022] GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27 => generated 1282 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:26:29.768950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1e3ee53a-8e60-4ba2-b3cc-be9e91cc2961 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:29.786347 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1e3ee53a-8e60-4ba2-b3cc-be9e91cc2961 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 200 len: 1505 microversion: 2.1 time: 0.589090 Oct 10 23:26:29.787319 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1253/2499] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:29 2022] GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 1505 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:30.207004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2a82c1b5-9294-41e6-8f23-68c86e46dd78 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:30.207624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2a82c1b5-9294-41e6-8f23-68c86e46dd78 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:30.246000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a82c1b5-9294-41e6-8f23-68c86e46dd78 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:30.246981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a82c1b5-9294-41e6-8f23-68c86e46dd78 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:30.247633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a82c1b5-9294-41e6-8f23-68c86e46dd78 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:30.255067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a82c1b5-9294-41e6-8f23-68c86e46dd78 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:30.255858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a82c1b5-9294-41e6-8f23-68c86e46dd78 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:30.263798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a82c1b5-9294-41e6-8f23-68c86e46dd78 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:30.284850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a1f5047f-8a72-4fb3-9bd6-dc468fa424a9 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:30.285583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a1f5047f-8a72-4fb3-9bd6-dc468fa424a9 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:30.329350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1f5047f-8a72-4fb3-9bd6-dc468fa424a9 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:30.329969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1f5047f-8a72-4fb3-9bd6-dc468fa424a9 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:30.337057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1f5047f-8a72-4fb3-9bd6-dc468fa424a9 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:30.338337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1f5047f-8a72-4fb3-9bd6-dc468fa424a9 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:30.343244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1f5047f-8a72-4fb3-9bd6-dc468fa424a9 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:30.349716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1f5047f-8a72-4fb3-9bd6-dc468fa424a9 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:30.661936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a1f5047f-8a72-4fb3-9bd6-dc468fa424a9 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:30.677326 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a1f5047f-8a72-4fb3-9bd6-dc468fa424a9 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27" status: 200 len: 1282 microversion: 2.1 time: 0.396397 Oct 10 23:26:30.680450 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1254/2500] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:30 2022] GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27 => generated 1282 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:26:30.823670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-44d2d9e9-2493-4b0f-a2e4-fab89437ca20 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:30.824556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-44d2d9e9-2493-4b0f-a2e4-fab89437ca20 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:30.844974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44d2d9e9-2493-4b0f-a2e4-fab89437ca20 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:30.845949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44d2d9e9-2493-4b0f-a2e4-fab89437ca20 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:30.847258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44d2d9e9-2493-4b0f-a2e4-fab89437ca20 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:30.849510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44d2d9e9-2493-4b0f-a2e4-fab89437ca20 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:30.851077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44d2d9e9-2493-4b0f-a2e4-fab89437ca20 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:30.851663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44d2d9e9-2493-4b0f-a2e4-fab89437ca20 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:31.298850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2a82c1b5-9294-41e6-8f23-68c86e46dd78 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:31.316146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2a82c1b5-9294-41e6-8f23-68c86e46dd78 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:31.321336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2a82c1b5-9294-41e6-8f23-68c86e46dd78 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:31.338033 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2a82c1b5-9294-41e6-8f23-68c86e46dd78 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 1.135853 Oct 10 23:26:31.340047 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1247/2501] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:30 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:31.711354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8f8f1a3a-d114-4a4b-b742-560e4ea64cb7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:31.712052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8f8f1a3a-d114-4a4b-b742-560e4ea64cb7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:31.723432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f8f1a3a-d114-4a4b-b742-560e4ea64cb7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:31.727584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f8f1a3a-d114-4a4b-b742-560e4ea64cb7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:31.728255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f8f1a3a-d114-4a4b-b742-560e4ea64cb7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:31.728982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f8f1a3a-d114-4a4b-b742-560e4ea64cb7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:31.729491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f8f1a3a-d114-4a4b-b742-560e4ea64cb7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:31.733108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f8f1a3a-d114-4a4b-b742-560e4ea64cb7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:31.973462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-44d2d9e9-2493-4b0f-a2e4-fab89437ca20 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:31.987964 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-44d2d9e9-2493-4b0f-a2e4-fab89437ca20 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 200 len: 1487 microversion: 2.1 time: 1.177304 Oct 10 23:26:32.009650 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1255/2502] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:30 2022] GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 1487 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:26:32.022062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-60ba1a29-d28f-48ab-8bfe-8ba0407cba1b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:32.024938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-60ba1a29-d28f-48ab-8bfe-8ba0407cba1b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:32.047412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60ba1a29-d28f-48ab-8bfe-8ba0407cba1b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:32.048297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60ba1a29-d28f-48ab-8bfe-8ba0407cba1b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:32.048962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60ba1a29-d28f-48ab-8bfe-8ba0407cba1b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:32.050035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60ba1a29-d28f-48ab-8bfe-8ba0407cba1b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:32.050720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60ba1a29-d28f-48ab-8bfe-8ba0407cba1b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:32.051361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60ba1a29-d28f-48ab-8bfe-8ba0407cba1b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:32.113944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-60ba1a29-d28f-48ab-8bfe-8ba0407cba1b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:26:32.333020 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-60ba1a29-d28f-48ab-8bfe-8ba0407cba1b tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 204 len: 0 microversion: 2.1 time: 0.315655 Oct 10 23:26:32.339146 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1256/2503] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:26:32 2022] DELETE /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 23:26:32.351610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-42c7e5a3-b781-407c-9f2e-956d76ea2aef tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f6633bcb160>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:32.405939 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-42c7e5a3-b781-407c-9f2e-956d76ea2aef tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] HTTP exception thrown: Image not found. Oct 10 23:26:32.408330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-42c7e5a3-b781-407c-9f2e-956d76ea2aef tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Request method failure captured: Oct 10 23:26:32.408330 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/images/c1ab7d0e-40a5-4bdd-be98-c9b1896a37f5 HTTP/1.1 Oct 10 23:26:32.408330 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:26:32.408330 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:26:32.408330 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:26:32.408330 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:26:32.408330 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:26:32.408330 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:26:32.408330 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:26:32.408330 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:26:32.408330 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKk3KVehVj7kfhzKO7tP10F0nlws0ecnjL84hxYafJIYLkjhpObR0LeWUMazGIolaSnKaUKcQW10Z2dzveaz0v3jU-Wyi7o3FT8_QKBHt6aDVoJ0Efrz6xLbsnLq3nzDe2RIbHuMTp0TY7juRUiIzABxnHu6L2zEztBJiX8mJ-c3jW8 Oct 10 23:26:32.408330 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:26:32.408330 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:26:32.408330 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:26:32.408330 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:26:32.408330 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:26:32.408330 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:26:32.408330 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:32.408330 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:32.408330 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:26:32.408330 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:26:32.409860 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_451d034bd7474164a08bd3374680c0d2", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:26:32.409860 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:32.409860 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:32.409860 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:32.409860 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:32.409860 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:26:32.409860 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:26:32.409860 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 60c692636a4b4667a4eff5cde6e183bc Oct 10 23:26:32.409860 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:32.409860 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:26:32.409860 n-d-860864-2 devstack@n-api.service[120613]: exception: Image not found. Oct 10 23:26:32.409860 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'c1ab7d0e-40a5-4bdd-be98-c9b1896a37f5'} Oct 10 23:26:32.409860 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:26:32.409860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:32.410720 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 23:26:32.410720 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 23:26:32.410720 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:26:32.410720 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:26:32.410720 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:26:32.410720 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:26:32.410720 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 23:26:32.410720 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 23:26:32.410720 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 23:26:32.410720 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 23:26:32.410720 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:26:32.410720 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:26:32.410720 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:26:32.410720 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:26:32.410720 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c1ab7d0e-40a5-4bdd-be98-c9b1896a37f5 to delete Oct 10 23:26:32.410720 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:32.410720 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:32.410720 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:32.410720 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:32.411988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 23:26:32.411988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 23:26:32.411988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 23:26:32.411988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 23:26:32.411988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 23:26:32.411988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 23:26:32.411988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c1ab7d0e-40a5-4bdd-be98-c9b1896a37f5 could not be found. Oct 10 23:26:32.411988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:32.411988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:32.411988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:32.411988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:32.411988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:32.411988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:32.411988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:26:32.411988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:26:32.411988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:26:32.411988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:26:32.411988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:26:32.411988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:26:32.411988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 23:26:32.413322 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 23:26:32.413322 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 23:26:32.413322 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:32.413322 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:32.413322 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:32.413322 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:32.413322 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:32.413322 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:32.413322 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:26:32.413322 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:26:32.413322 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 23:26:32.413322 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:32.422766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-42c7e5a3-b781-407c-9f2e-956d76ea2aef tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Returning 404 to user: Image not found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:26:32.422766 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-42c7e5a3-b781-407c-9f2e-956d76ea2aef tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "DELETE /compute/v2.1/images/c1ab7d0e-40a5-4bdd-be98-c9b1896a37f5" status: 404 len: 62 microversion: 2.1 time: 0.078749 Oct 10 23:26:32.423511 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1257/2504] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:32 2022] DELETE /compute/v2.1/images/c1ab7d0e-40a5-4bdd-be98-c9b1896a37f5 => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:26:32.435287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7667c7c5-72f9-4b16-974d-16d6b3dd5d2e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:32.436371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7667c7c5-72f9-4b16-974d-16d6b3dd5d2e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:32.450041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7667c7c5-72f9-4b16-974d-16d6b3dd5d2e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:32.450702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7667c7c5-72f9-4b16-974d-16d6b3dd5d2e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:32.451626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7667c7c5-72f9-4b16-974d-16d6b3dd5d2e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:32.452722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7667c7c5-72f9-4b16-974d-16d6b3dd5d2e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:32.454386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7667c7c5-72f9-4b16-974d-16d6b3dd5d2e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:32.455164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7667c7c5-72f9-4b16-974d-16d6b3dd5d2e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:32.620447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7667c7c5-72f9-4b16-974d-16d6b3dd5d2e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:32.641779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7667c7c5-72f9-4b16-974d-16d6b3dd5d2e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:32.647211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7667c7c5-72f9-4b16-974d-16d6b3dd5d2e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:32.669641 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7667c7c5-72f9-4b16-974d-16d6b3dd5d2e tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.240252 Oct 10 23:26:32.670635 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1258/2505] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:32 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:32.681140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b25a77ba-0265-4216-ace2-8673091a2d89 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:32.681656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b25a77ba-0265-4216-ace2-8673091a2d89 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:32.700600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b25a77ba-0265-4216-ace2-8673091a2d89 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:32.701101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b25a77ba-0265-4216-ace2-8673091a2d89 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:32.701683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b25a77ba-0265-4216-ace2-8673091a2d89 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:32.708821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b25a77ba-0265-4216-ace2-8673091a2d89 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:32.709546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b25a77ba-0265-4216-ace2-8673091a2d89 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:32.710297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b25a77ba-0265-4216-ace2-8673091a2d89 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:32.814892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b25a77ba-0265-4216-ace2-8673091a2d89 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:26:32.965932 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.compute.api [None req-b25a77ba-0265-4216-ace2-8673091a2d89 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Instance is already in deleting state, ignoring this request Oct 10 23:26:32.967067 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b25a77ba-0265-4216-ace2-8673091a2d89 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 204 len: 0 microversion: 2.1 time: 0.295452 Oct 10 23:26:32.968118 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1259/2506] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:26:32 2022] DELETE /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:26:32.980613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-99fb4f6a-f411-402a-85d1-0da914104966 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:32.988870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-99fb4f6a-f411-402a-85d1-0da914104966 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:33.007336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99fb4f6a-f411-402a-85d1-0da914104966 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:33.008124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99fb4f6a-f411-402a-85d1-0da914104966 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:33.008725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99fb4f6a-f411-402a-85d1-0da914104966 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:33.009655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99fb4f6a-f411-402a-85d1-0da914104966 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:33.010298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99fb4f6a-f411-402a-85d1-0da914104966 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:33.010924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99fb4f6a-f411-402a-85d1-0da914104966 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:33.405548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-99fb4f6a-f411-402a-85d1-0da914104966 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:33.416778 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-99fb4f6a-f411-402a-85d1-0da914104966 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 200 len: 1493 microversion: 2.1 time: 0.440534 Oct 10 23:26:33.422778 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1260/2507] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:32 2022] GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 1493 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:33.589859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8f8f1a3a-d114-4a4b-b742-560e4ea64cb7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:33.603305 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8f8f1a3a-d114-4a4b-b742-560e4ea64cb7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27" status: 200 len: 1324 microversion: 2.1 time: 1.896602 Oct 10 23:26:33.604889 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1248/2508] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:31 2022] GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27 => generated 1324 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:33.704594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-94029d48-5f31-493c-b4c7-4e5bc7e8e382 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:33.705667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-94029d48-5f31-493c-b4c7-4e5bc7e8e382 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:33.720730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94029d48-5f31-493c-b4c7-4e5bc7e8e382 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:33.721238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94029d48-5f31-493c-b4c7-4e5bc7e8e382 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:33.721710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94029d48-5f31-493c-b4c7-4e5bc7e8e382 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:33.731014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94029d48-5f31-493c-b4c7-4e5bc7e8e382 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:33.735077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94029d48-5f31-493c-b4c7-4e5bc7e8e382 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:33.738711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94029d48-5f31-493c-b4c7-4e5bc7e8e382 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:33.751824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:33.950353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-94029d48-5f31-493c-b4c7-4e5bc7e8e382 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:33.964323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-94029d48-5f31-493c-b4c7-4e5bc7e8e382 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:33.965832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-94029d48-5f31-493c-b4c7-4e5bc7e8e382 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:33.982752 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-94029d48-5f31-493c-b4c7-4e5bc7e8e382 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.280909 Oct 10 23:26:33.989438 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1261/2509] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:33 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:34.447340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5ecf43b7-3933-4695-80ef-24ec034e7e54 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:34.447972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5ecf43b7-3933-4695-80ef-24ec034e7e54 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:34.465314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ecf43b7-3933-4695-80ef-24ec034e7e54 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:34.479217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ecf43b7-3933-4695-80ef-24ec034e7e54 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:34.479792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ecf43b7-3933-4695-80ef-24ec034e7e54 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:34.480561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ecf43b7-3933-4695-80ef-24ec034e7e54 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:34.481042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ecf43b7-3933-4695-80ef-24ec034e7e54 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:34.481505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ecf43b7-3933-4695-80ef-24ec034e7e54 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:34.533817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ff02417e-1396-4626-b170-ed36893e2808 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2078527848", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:34.612086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:34.660023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=18 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:34.742446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-ff02417e-1396-4626-b170-ed36893e2808 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] validate_networks() for [('bc64707f-1e59-4628-9c89-b75279055564', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:26:35.576840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:35.727387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5ecf43b7-3933-4695-80ef-24ec034e7e54 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:35.736825 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5ecf43b7-3933-4695-80ef-24ec034e7e54 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 200 len: 1493 microversion: 2.1 time: 1.293983 Oct 10 23:26:35.745393 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1262/2510] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:34 2022] GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 1493 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:26:35.750626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-17391e1b-9f44-460c-91b8-04fa6161980f tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:35.755088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-17391e1b-9f44-460c-91b8-04fa6161980f tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:35.771974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17391e1b-9f44-460c-91b8-04fa6161980f tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:35.772732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17391e1b-9f44-460c-91b8-04fa6161980f tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:35.773348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17391e1b-9f44-460c-91b8-04fa6161980f tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:35.774275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17391e1b-9f44-460c-91b8-04fa6161980f tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:35.775160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17391e1b-9f44-460c-91b8-04fa6161980f tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:35.775745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17391e1b-9f44-460c-91b8-04fa6161980f tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:36.165317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-17391e1b-9f44-460c-91b8-04fa6161980f tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:36.184554 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-17391e1b-9f44-460c-91b8-04fa6161980f tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27" status: 200 len: 1324 microversion: 2.1 time: 0.434131 Oct 10 23:26:36.185462 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1263/2511] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:35 2022] GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27 => generated 1324 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:36.202141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-90eea311-4377-4da7-830d-7b4c00b56012 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:36.202776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-90eea311-4377-4da7-830d-7b4c00b56012 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:36.217261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90eea311-4377-4da7-830d-7b4c00b56012 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:36.217823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90eea311-4377-4da7-830d-7b4c00b56012 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:36.218265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90eea311-4377-4da7-830d-7b4c00b56012 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:36.219049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90eea311-4377-4da7-830d-7b4c00b56012 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:36.219514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90eea311-4377-4da7-830d-7b4c00b56012 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:36.220046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90eea311-4377-4da7-830d-7b4c00b56012 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:36.400362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-90eea311-4377-4da7-830d-7b4c00b56012 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:36.411582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-90eea311-4377-4da7-830d-7b4c00b56012 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:36.413349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-90eea311-4377-4da7-830d-7b4c00b56012 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:36.433528 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-90eea311-4377-4da7-830d-7b4c00b56012 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.234367 Oct 10 23:26:36.434248 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1264/2512] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:36 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:36.697219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d449b32e-9d2c-4496-96b8-e5110cfa0ec2 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-727922725", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:36.800142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-d449b32e-9d2c-4496-96b8-e5110cfa0ec2 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] validate_networks() for None {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:26:37.669257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d449b32e-9d2c-4496-96b8-e5110cfa0ec2 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:26:37.670009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d449b32e-9d2c-4496-96b8-e5110cfa0ec2 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:26:37.670892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d449b32e-9d2c-4496-96b8-e5110cfa0ec2 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:26:37.671455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d449b32e-9d2c-4496-96b8-e5110cfa0ec2 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:26:37.671886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d449b32e-9d2c-4496-96b8-e5110cfa0ec2 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:26:37.722544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d449b32e-9d2c-4496-96b8-e5110cfa0ec2 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:37.723125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d449b32e-9d2c-4496-96b8-e5110cfa0ec2 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:37.723467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d449b32e-9d2c-4496-96b8-e5110cfa0ec2 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:37.724202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d449b32e-9d2c-4496-96b8-e5110cfa0ec2 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:37.724753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d449b32e-9d2c-4496-96b8-e5110cfa0ec2 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:37.725503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d449b32e-9d2c-4496-96b8-e5110cfa0ec2 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:37.768887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ff02417e-1396-4626-b170-ed36893e2808 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:26:37.769447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ff02417e-1396-4626-b170-ed36893e2808 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:26:37.769962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ff02417e-1396-4626-b170-ed36893e2808 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:26:37.770468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ff02417e-1396-4626-b170-ed36893e2808 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:26:37.770972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ff02417e-1396-4626-b170-ed36893e2808 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:26:37.799658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff02417e-1396-4626-b170-ed36893e2808 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:37.801748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff02417e-1396-4626-b170-ed36893e2808 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:37.802466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff02417e-1396-4626-b170-ed36893e2808 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:37.804012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff02417e-1396-4626-b170-ed36893e2808 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:37.809972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff02417e-1396-4626-b170-ed36893e2808 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:37.814938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-d449b32e-9d2c-4496-96b8-e5110cfa0ec2 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Getting quotas for project c4ae586965414012b4aeded0508deb4e. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:26:37.816729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff02417e-1396-4626-b170-ed36893e2808 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:37.821140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:37.848106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-d449b32e-9d2c-4496-96b8-e5110cfa0ec2 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Getting quotas for user 80ef84f12c934e9aa1be187f2842b71f and project c4ae586965414012b4aeded0508deb4e. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:26:37.868808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ff02417e-1396-4626-b170-ed36893e2808 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Getting quotas for project 44777346e7e541389e24fe42c4d46cbf. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:26:37.881915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ff02417e-1396-4626-b170-ed36893e2808 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Getting quotas for user 1f1aca1de5b64298b6e5d0ba3c554fb7 and project 44777346e7e541389e24fe42c4d46cbf. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:26:37.885185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d449b32e-9d2c-4496-96b8-e5110cfa0ec2 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:26:37.893750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d449b32e-9d2c-4496-96b8-e5110cfa0ec2 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:26:37.927180 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ff02417e-1396-4626-b170-ed36893e2808 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:26:37.929962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ff02417e-1396-4626-b170-ed36893e2808 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:26:38.035625 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ff02417e-1396-4626-b170-ed36893e2808 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.114452 Oct 10 23:26:38.041905 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1249/2513] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:26:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 4121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:26:38.048272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1b8e6f5b-fece-404a-8ed9-c31925426141 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:38.060178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1b8e6f5b-fece-404a-8ed9-c31925426141 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:38.072166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b8e6f5b-fece-404a-8ed9-c31925426141 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:38.075201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b8e6f5b-fece-404a-8ed9-c31925426141 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:38.079578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b8e6f5b-fece-404a-8ed9-c31925426141 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:38.082385 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d449b32e-9d2c-4496-96b8-e5110cfa0ec2 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.646829 Oct 10 23:26:38.085635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b8e6f5b-fece-404a-8ed9-c31925426141 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:38.086314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b8e6f5b-fece-404a-8ed9-c31925426141 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:38.087798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b8e6f5b-fece-404a-8ed9-c31925426141 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:38.091092 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1265/2514] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:26:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:26:38.119973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ab055aee-43f0-4999-99ca-c6d9a3e5d09f tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:38.119973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ab055aee-43f0-4999-99ca-c6d9a3e5d09f tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:38.145263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab055aee-43f0-4999-99ca-c6d9a3e5d09f tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:38.145989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab055aee-43f0-4999-99ca-c6d9a3e5d09f tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:38.146551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab055aee-43f0-4999-99ca-c6d9a3e5d09f tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:38.148213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab055aee-43f0-4999-99ca-c6d9a3e5d09f tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:38.148995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab055aee-43f0-4999-99ca-c6d9a3e5d09f tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:38.151863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab055aee-43f0-4999-99ca-c6d9a3e5d09f tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:38.359887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1b8e6f5b-fece-404a-8ed9-c31925426141 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:38.373159 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1b8e6f5b-fece-404a-8ed9-c31925426141 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 200 len: 1451 microversion: 2.1 time: 0.326315 Oct 10 23:26:38.374351 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1250/2515] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:38 2022] GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 1451 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:38.385044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ed078c85-9a32-4e42-b21a-6b2a635555e7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:38.390791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ed078c85-9a32-4e42-b21a-6b2a635555e7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:38.406258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed078c85-9a32-4e42-b21a-6b2a635555e7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:38.412850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed078c85-9a32-4e42-b21a-6b2a635555e7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:38.413875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed078c85-9a32-4e42-b21a-6b2a635555e7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:38.414962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed078c85-9a32-4e42-b21a-6b2a635555e7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:38.415616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed078c85-9a32-4e42-b21a-6b2a635555e7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:38.417689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed078c85-9a32-4e42-b21a-6b2a635555e7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:38.595282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ab055aee-43f0-4999-99ca-c6d9a3e5d09f tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:38.625443 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ab055aee-43f0-4999-99ca-c6d9a3e5d09f tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27" status: 200 len: 1324 microversion: 2.1 time: 0.532408 Oct 10 23:26:38.627861 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1266/2516] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:38 2022] GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27 => generated 1324 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:38.642770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4b333e13-9562-4e4d-895a-dd55d83f2466 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:38.643857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4b333e13-9562-4e4d-895a-dd55d83f2466 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:38.788550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ed078c85-9a32-4e42-b21a-6b2a635555e7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:38.801009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ed078c85-9a32-4e42-b21a-6b2a635555e7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:38.843705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ed078c85-9a32-4e42-b21a-6b2a635555e7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:38.887702 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ed078c85-9a32-4e42-b21a-6b2a635555e7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.507751 Oct 10 23:26:38.901803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4b333e13-9562-4e4d-895a-dd55d83f2466 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:38.911245 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1251/2517] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:38 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:38.923480 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4b333e13-9562-4e4d-895a-dd55d83f2466 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1214 microversion: 2.1 time: 0.292488 Oct 10 23:26:38.924841 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1267/2518] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:38 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1214 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:38.937149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-35e8227b-74f5-4a2c-9a07-d40cbc13a36f tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:38.939078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-35e8227b-74f5-4a2c-9a07-d40cbc13a36f tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:38.952716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-e71425f2-e46c-433e-ab6a-efe8c5693c9a req-967aa20b-f376-4d2b-b0de-6437d68bf088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcb66932-449d-48cd-9a36-485807874e27", "tag": "c68baca6-c92c-4e7a-bef8-b00039aec8ff"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:38.976894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e71425f2-e46c-433e-ab6a-efe8c5693c9a req-967aa20b-f376-4d2b-b0de-6437d68bf088 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:38.990491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e71425f2-e46c-433e-ab6a-efe8c5693c9a req-967aa20b-f376-4d2b-b0de-6437d68bf088 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:38.991450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e71425f2-e46c-433e-ab6a-efe8c5693c9a req-967aa20b-f376-4d2b-b0de-6437d68bf088 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:39.024751 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-e71425f2-e46c-433e-ab6a-efe8c5693c9a req-967aa20b-f376-4d2b-b0de-6437d68bf088 service nova] Creating event network-changed:c68baca6-c92c-4e7a-bef8-b00039aec8ff for instance dcb66932-449d-48cd-9a36-485807874e27 on n-h1-860864-2 Oct 10 23:26:39.033504 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-e71425f2-e46c-433e-ab6a-efe8c5693c9a req-967aa20b-f376-4d2b-b0de-6437d68bf088 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105092 Oct 10 23:26:39.054624 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1268/2519] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:39.356777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-35e8227b-74f5-4a2c-9a07-d40cbc13a36f tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ef84f12c934e9aa1be187f2842b71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ae586965414012b4aeded0508deb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:39.392008 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-35e8227b-74f5-4a2c-9a07-d40cbc13a36f tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 200 len: 1216 microversion: 2.1 time: 0.471714 Oct 10 23:26:39.409396 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1252/2520] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:38 2022] GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 1216 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:39.412465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c028e0fd-3dbc-40c8-8857-73befbaf45dd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:39.414196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c028e0fd-3dbc-40c8-8857-73befbaf45dd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:39.487185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c028e0fd-3dbc-40c8-8857-73befbaf45dd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:39.487808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c028e0fd-3dbc-40c8-8857-73befbaf45dd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:39.488262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c028e0fd-3dbc-40c8-8857-73befbaf45dd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:39.494808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c028e0fd-3dbc-40c8-8857-73befbaf45dd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:39.497046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c028e0fd-3dbc-40c8-8857-73befbaf45dd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:39.500706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c028e0fd-3dbc-40c8-8857-73befbaf45dd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:39.664322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aae63a10-c28c-4ed5-8315-908e3ca51f84 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:39.665127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aae63a10-c28c-4ed5-8315-908e3ca51f84 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:39.692034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c028e0fd-3dbc-40c8-8857-73befbaf45dd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:39.692640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aae63a10-c28c-4ed5-8315-908e3ca51f84 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:39.693338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aae63a10-c28c-4ed5-8315-908e3ca51f84 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:39.698199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aae63a10-c28c-4ed5-8315-908e3ca51f84 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:39.700333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aae63a10-c28c-4ed5-8315-908e3ca51f84 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:39.700949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aae63a10-c28c-4ed5-8315-908e3ca51f84 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:39.704726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aae63a10-c28c-4ed5-8315-908e3ca51f84 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:39.708450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c028e0fd-3dbc-40c8-8857-73befbaf45dd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:39.718620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c028e0fd-3dbc-40c8-8857-73befbaf45dd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:39.720190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-c028e0fd-3dbc-40c8-8857-73befbaf45dd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lazy-loading 'fault' on Instance uuid 3aaa34f0-fc6a-4ef0-9474-3df5dab16917 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:26:39.820194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c028e0fd-3dbc-40c8-8857-73befbaf45dd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60c692636a4b4667a4eff5cde6e183bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d034bd7474164a08bd3374680c0d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:39.839436 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c028e0fd-3dbc-40c8-8857-73befbaf45dd tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 200 len: 1298 microversion: 2.1 time: 0.441407 Oct 10 23:26:39.849201 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1269/2521] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:39 2022] GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 1298 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:39.923545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-be88071a-6594-4906-bfd4-736bb3d18c64 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:39.929418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-be88071a-6594-4906-bfd4-736bb3d18c64 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:39.956602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be88071a-6594-4906-bfd4-736bb3d18c64 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:39.958068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be88071a-6594-4906-bfd4-736bb3d18c64 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:39.958626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be88071a-6594-4906-bfd4-736bb3d18c64 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:39.959724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be88071a-6594-4906-bfd4-736bb3d18c64 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:39.960495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be88071a-6594-4906-bfd4-736bb3d18c64 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:39.961166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be88071a-6594-4906-bfd4-736bb3d18c64 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:40.169768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-be88071a-6594-4906-bfd4-736bb3d18c64 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:40.218589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-be88071a-6594-4906-bfd4-736bb3d18c64 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:40.235275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-be88071a-6594-4906-bfd4-736bb3d18c64 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:40.247233 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-be88071a-6594-4906-bfd4-736bb3d18c64 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.328772 Oct 10 23:26:40.255681 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1270/2522] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:39 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:26:40.261227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-84bae919-eca7-494d-9b0d-6e9cdf916ce1 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:40.268731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-84bae919-eca7-494d-9b0d-6e9cdf916ce1 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:40.288396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84bae919-eca7-494d-9b0d-6e9cdf916ce1 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:40.289189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84bae919-eca7-494d-9b0d-6e9cdf916ce1 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:40.289802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84bae919-eca7-494d-9b0d-6e9cdf916ce1 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:40.290669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84bae919-eca7-494d-9b0d-6e9cdf916ce1 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:40.291271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84bae919-eca7-494d-9b0d-6e9cdf916ce1 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:40.291929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84bae919-eca7-494d-9b0d-6e9cdf916ce1 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:40.507688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-84bae919-eca7-494d-9b0d-6e9cdf916ce1 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:40.536997 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-84bae919-eca7-494d-9b0d-6e9cdf916ce1 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1218 microversion: 2.1 time: 0.279359 Oct 10 23:26:40.554595 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1271/2523] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:40 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1218 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:40.576405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aae63a10-c28c-4ed5-8315-908e3ca51f84 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:40.585742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4f44feb8-7253-4b41-bf1f-8e70033d7605 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:40.588178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4f44feb8-7253-4b41-bf1f-8e70033d7605 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:40.612732 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aae63a10-c28c-4ed5-8315-908e3ca51f84 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27" status: 200 len: 1324 microversion: 2.1 time: 0.938666 Oct 10 23:26:40.613436 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1253/2524] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:39 2022] GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27 => generated 1324 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:40.638357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f44feb8-7253-4b41-bf1f-8e70033d7605 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:40.641056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f44feb8-7253-4b41-bf1f-8e70033d7605 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:40.642831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f44feb8-7253-4b41-bf1f-8e70033d7605 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:40.646241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f44feb8-7253-4b41-bf1f-8e70033d7605 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:40.648143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f44feb8-7253-4b41-bf1f-8e70033d7605 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:40.650379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f44feb8-7253-4b41-bf1f-8e70033d7605 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:40.870418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4f44feb8-7253-4b41-bf1f-8e70033d7605 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ef84f12c934e9aa1be187f2842b71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ae586965414012b4aeded0508deb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:40.884624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4914ac61-d73d-4d57-a79d-8c1d877c60f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:40.885622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4914ac61-d73d-4d57-a79d-8c1d877c60f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 3aaa34f0-fc6a-4ef0-9474-3df5dab16917] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:40.903545 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4f44feb8-7253-4b41-bf1f-8e70033d7605 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 200 len: 1268 microversion: 2.1 time: 0.346967 Oct 10 23:26:40.904058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4914ac61-d73d-4d57-a79d-8c1d877c60f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:40.908290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4914ac61-d73d-4d57-a79d-8c1d877c60f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:40.908966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4914ac61-d73d-4d57-a79d-8c1d877c60f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:40.909916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4914ac61-d73d-4d57-a79d-8c1d877c60f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:40.911447 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1272/2525] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:40 2022] GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 1268 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:40.912166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4914ac61-d73d-4d57-a79d-8c1d877c60f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:40.912752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4914ac61-d73d-4d57-a79d-8c1d877c60f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:41.003850 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-4914ac61-d73d-4d57-a79d-8c1d877c60f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] HTTP exception thrown: Instance 3aaa34f0-fc6a-4ef0-9474-3df5dab16917 could not be found. Oct 10 23:26:41.016668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4914ac61-d73d-4d57-a79d-8c1d877c60f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Request method failure captured: Oct 10 23:26:41.016668 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 HTTP/1.1 Oct 10 23:26:41.016668 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:26:41.016668 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:26:41.016668 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:26:41.016668 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:26:41.016668 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:26:41.016668 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:26:41.016668 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:26:41.016668 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:26:41.016668 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKk3KVehVj7kfhzKO7tP10F0nlws0ecnjL84hxYafJIYLkjhpObR0LeWUMazGIolaSnKaUKcQW10Z2dzveaz0v3jU-Wyi7o3FT8_QKBHt6aDVoJ0Efrz6xLbsnLq3nzDe2RIbHuMTp0TY7juRUiIzABxnHu6L2zEztBJiX8mJ-c3jW8 Oct 10 23:26:41.016668 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:26:41.016668 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:26:41.016668 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:26:41.016668 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:26:41.016668 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:26:41.016668 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:26:41.016668 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:41.016668 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.016668 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:26:41.016668 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:26:41.018492 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_451d034bd7474164a08bd3374680c0d2", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:26:41.018492 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.018492 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:41.018492 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.018492 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:41.018492 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:26:41.018492 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:26:41.018492 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 60c692636a4b4667a4eff5cde6e183bc Oct 10 23:26:41.018492 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:41.018492 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:26:41.018492 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 3aaa34f0-fc6a-4ef0-9474-3df5dab16917 could not be found. Oct 10 23:26:41.018492 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '3aaa34f0-fc6a-4ef0-9474-3df5dab16917'} Oct 10 23:26:41.019330 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:26:41.019330 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.019330 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:26:41.019330 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:26:41.019330 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:26:41.019330 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:26:41.019330 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:26:41.019330 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:26:41.019330 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:26:41.019330 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:26:41.019330 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aaa34f0-fc6a-4ef0-9474-3df5dab16917 could not be found. Oct 10 23:26:41.019330 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.019330 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:41.019330 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.019330 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.019330 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:41.019330 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:41.019330 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:26:41.019330 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:26:41.019330 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:26:41.020735 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:26:41.020735 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:26:41.020735 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:26:41.020735 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:26:41.020735 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:26:41.020735 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:26:41.020735 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:26:41.020735 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aaa34f0-fc6a-4ef0-9474-3df5dab16917 could not be found. Oct 10 23:26:41.020735 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.020735 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:41.020735 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.020735 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.020735 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:41.020735 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:41.020735 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:26:41.020735 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:26:41.020735 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aaa34f0-fc6a-4ef0-9474-3df5dab16917 could not be found. Oct 10 23:26:41.020735 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.022345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4914ac61-d73d-4d57-a79d-8c1d877c60f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Returning 404 to user: Instance 3aaa34f0-fc6a-4ef0-9474-3df5dab16917 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:26:41.022345 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4914ac61-d73d-4d57-a79d-8c1d877c60f3 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917" status: 404 len: 111 microversion: 2.1 time: 0.137734 Oct 10 23:26:41.025296 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1254/2526] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:40 2022] GET /compute/v2.1/servers/3aaa34f0-fc6a-4ef0-9474-3df5dab16917 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:26:41.027354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2b01c861-b0b1-49fa-a82e-c236f5c98d74 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f6633b50e50>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:41.059001 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-2b01c861-b0b1-49fa-a82e-c236f5c98d74 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] HTTP exception thrown: Image not found. Oct 10 23:26:41.060897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2b01c861-b0b1-49fa-a82e-c236f5c98d74 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Request method failure captured: Oct 10 23:26:41.060897 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510 HTTP/1.1 Oct 10 23:26:41.060897 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:26:41.060897 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:26:41.060897 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:26:41.060897 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:26:41.060897 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:26:41.060897 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:26:41.060897 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:26:41.060897 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:26:41.060897 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKk3KVehVj7kfhzKO7tP10F0nlws0ecnjL84hxYafJIYLkjhpObR0LeWUMazGIolaSnKaUKcQW10Z2dzveaz0v3jU-Wyi7o3FT8_QKBHt6aDVoJ0Efrz6xLbsnLq3nzDe2RIbHuMTp0TY7juRUiIzABxnHu6L2zEztBJiX8mJ-c3jW8 Oct 10 23:26:41.060897 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:26:41.060897 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:26:41.060897 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:26:41.060897 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:26:41.060897 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:26:41.060897 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:26:41.060897 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:41.060897 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.060897 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:26:41.060897 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:26:41.062446 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_451d034bd7474164a08bd3374680c0d2", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:26:41.062446 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.062446 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:41.062446 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.062446 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:41.062446 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:26:41.062446 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:26:41.062446 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 60c692636a4b4667a4eff5cde6e183bc Oct 10 23:26:41.062446 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:41.062446 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:26:41.062446 n-d-860864-2 devstack@n-api.service[120613]: exception: Image not found. Oct 10 23:26:41.062446 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '17f23ac4-c14d-4f2d-bdcf-812bc2500510'} Oct 10 23:26:41.062446 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:26:41.062446 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.064203 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 23:26:41.064203 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 23:26:41.064203 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:26:41.064203 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:26:41.064203 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:26:41.064203 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:26:41.064203 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 23:26:41.064203 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 23:26:41.064203 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 23:26:41.064203 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 23:26:41.064203 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:26:41.064203 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:26:41.064203 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:26:41.064203 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:26:41.064203 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 17f23ac4-c14d-4f2d-bdcf-812bc2500510 to delete Oct 10 23:26:41.064203 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.064203 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:41.064203 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.064203 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.065632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 23:26:41.065632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 23:26:41.065632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 23:26:41.065632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 23:26:41.065632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 23:26:41.065632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 23:26:41.065632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 17f23ac4-c14d-4f2d-bdcf-812bc2500510 could not be found. Oct 10 23:26:41.065632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.065632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:41.065632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.065632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.065632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:41.065632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:41.065632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:26:41.065632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:26:41.065632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:26:41.065632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:26:41.065632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:26:41.065632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:26:41.065632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 23:26:41.066987 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 23:26:41.066987 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 23:26:41.066987 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.066987 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:41.066987 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.066987 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.066987 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:41.066987 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:41.066987 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:26:41.066987 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:26:41.066987 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 23:26:41.066987 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.066987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2b01c861-b0b1-49fa-a82e-c236f5c98d74 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Returning 404 to user: Image not found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:26:41.066987 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2b01c861-b0b1-49fa-a82e-c236f5c98d74 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "DELETE /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510" status: 404 len: 62 microversion: 2.1 time: 0.039040 Oct 10 23:26:41.066987 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1273/2527] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:41 2022] DELETE /compute/v2.1/images/17f23ac4-c14d-4f2d-bdcf-812bc2500510 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:26:41.073786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1080c4cd-8325-4f8c-bffb-bebd64960e5d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:41.076308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1080c4cd-8325-4f8c-bffb-bebd64960e5d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 5242250f-5274-4992-adb3-e8fdd3b65ed7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:41.090108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1080c4cd-8325-4f8c-bffb-bebd64960e5d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:41.090956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1080c4cd-8325-4f8c-bffb-bebd64960e5d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:41.091801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1080c4cd-8325-4f8c-bffb-bebd64960e5d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:41.097453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1080c4cd-8325-4f8c-bffb-bebd64960e5d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:41.098173 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1080c4cd-8325-4f8c-bffb-bebd64960e5d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:41.098747 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1080c4cd-8325-4f8c-bffb-bebd64960e5d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:41.122772 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-1080c4cd-8325-4f8c-bffb-bebd64960e5d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] HTTP exception thrown: Instance 5242250f-5274-4992-adb3-e8fdd3b65ed7 could not be found. Oct 10 23:26:41.124675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1080c4cd-8325-4f8c-bffb-bebd64960e5d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Request method failure captured: Oct 10 23:26:41.124675 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7 HTTP/1.1 Oct 10 23:26:41.124675 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:26:41.124675 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:26:41.124675 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:26:41.124675 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:26:41.124675 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:26:41.124675 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:26:41.124675 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:26:41.124675 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:26:41.124675 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKk3KVehVj7kfhzKO7tP10F0nlws0ecnjL84hxYafJIYLkjhpObR0LeWUMazGIolaSnKaUKcQW10Z2dzveaz0v3jU-Wyi7o3FT8_QKBHt6aDVoJ0Efrz6xLbsnLq3nzDe2RIbHuMTp0TY7juRUiIzABxnHu6L2zEztBJiX8mJ-c3jW8 Oct 10 23:26:41.124675 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:26:41.124675 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:26:41.124675 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:26:41.124675 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:26:41.124675 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:26:41.124675 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:26:41.124675 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:41.124675 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.124675 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:26:41.124675 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:26:41.126915 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_451d034bd7474164a08bd3374680c0d2", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:26:41.126915 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.126915 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:41.126915 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.126915 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:41.126915 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:26:41.126915 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:26:41.126915 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 60c692636a4b4667a4eff5cde6e183bc Oct 10 23:26:41.126915 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:41.126915 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:26:41.126915 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 5242250f-5274-4992-adb3-e8fdd3b65ed7 could not be found. Oct 10 23:26:41.126915 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '5242250f-5274-4992-adb3-e8fdd3b65ed7'} Oct 10 23:26:41.128329 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:26:41.128329 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.128329 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:26:41.128329 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:26:41.128329 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:26:41.128329 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:26:41.128329 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:26:41.128329 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:26:41.128329 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:26:41.128329 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:26:41.128329 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5242250f-5274-4992-adb3-e8fdd3b65ed7 could not be found. Oct 10 23:26:41.128329 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.128329 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:41.128329 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.128329 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.128329 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:41.128329 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:41.128329 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:26:41.128329 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:26:41.128329 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:26:41.131859 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:26:41.131859 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:26:41.131859 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:26:41.131859 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:26:41.131859 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:26:41.131859 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:26:41.131859 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:26:41.131859 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:26:41.131859 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:26:41.131859 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5242250f-5274-4992-adb3-e8fdd3b65ed7 could not be found. Oct 10 23:26:41.131859 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.131859 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:41.131859 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.131859 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.131859 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:41.131859 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:41.131859 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:26:41.131859 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:26:41.131859 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5242250f-5274-4992-adb3-e8fdd3b65ed7 could not be found. Oct 10 23:26:41.131859 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.137684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1080c4cd-8325-4f8c-bffb-bebd64960e5d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Returning 404 to user: Instance 5242250f-5274-4992-adb3-e8fdd3b65ed7 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:26:41.140252 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1080c4cd-8325-4f8c-bffb-bebd64960e5d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7" status: 404 len: 111 microversion: 2.1 time: 0.070328 Oct 10 23:26:41.144414 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1255/2528] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:26:41 2022] DELETE /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:26:41.149266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e1414f74-2548-4146-8694-e10e2e188e3a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:41.151127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e1414f74-2548-4146-8694-e10e2e188e3a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: 5242250f-5274-4992-adb3-e8fdd3b65ed7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:41.187536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1414f74-2548-4146-8694-e10e2e188e3a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:41.189237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1414f74-2548-4146-8694-e10e2e188e3a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:41.189632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1414f74-2548-4146-8694-e10e2e188e3a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:41.192119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1414f74-2548-4146-8694-e10e2e188e3a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:41.192589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1414f74-2548-4146-8694-e10e2e188e3a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:41.198245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1414f74-2548-4146-8694-e10e2e188e3a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:41.244967 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-e1414f74-2548-4146-8694-e10e2e188e3a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] HTTP exception thrown: Instance 5242250f-5274-4992-adb3-e8fdd3b65ed7 could not be found. Oct 10 23:26:41.249316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e1414f74-2548-4146-8694-e10e2e188e3a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Request method failure captured: Oct 10 23:26:41.249316 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7 HTTP/1.1 Oct 10 23:26:41.249316 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:26:41.249316 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:26:41.249316 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:26:41.249316 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:26:41.249316 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:26:41.249316 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:26:41.249316 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:26:41.249316 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:26:41.249316 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKk3KVehVj7kfhzKO7tP10F0nlws0ecnjL84hxYafJIYLkjhpObR0LeWUMazGIolaSnKaUKcQW10Z2dzveaz0v3jU-Wyi7o3FT8_QKBHt6aDVoJ0Efrz6xLbsnLq3nzDe2RIbHuMTp0TY7juRUiIzABxnHu6L2zEztBJiX8mJ-c3jW8 Oct 10 23:26:41.249316 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:26:41.249316 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:26:41.249316 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:26:41.249316 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:26:41.249316 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:26:41.249316 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:26:41.249316 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:41.249316 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.249316 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:26:41.249316 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:26:41.251410 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_451d034bd7474164a08bd3374680c0d2", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:26:41.251410 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.251410 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:41.251410 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.251410 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:41.251410 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:26:41.251410 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:26:41.251410 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 60c692636a4b4667a4eff5cde6e183bc Oct 10 23:26:41.251410 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:41.251410 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:26:41.251410 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 5242250f-5274-4992-adb3-e8fdd3b65ed7 could not be found. Oct 10 23:26:41.251410 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '5242250f-5274-4992-adb3-e8fdd3b65ed7'} Oct 10 23:26:41.252241 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:26:41.252241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.252241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:26:41.252241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:26:41.252241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:26:41.252241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:26:41.252241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:26:41.252241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:26:41.252241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:26:41.252241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:26:41.252241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5242250f-5274-4992-adb3-e8fdd3b65ed7 could not be found. Oct 10 23:26:41.252241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.252241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:41.252241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.252241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.252241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:41.252241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:41.252241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:26:41.252241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:26:41.252241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:26:41.253626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:26:41.253626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:26:41.253626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:26:41.253626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:26:41.253626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:26:41.253626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:26:41.253626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:26:41.253626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5242250f-5274-4992-adb3-e8fdd3b65ed7 could not be found. Oct 10 23:26:41.253626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.253626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:41.253626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.253626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.253626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:41.253626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:41.253626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:26:41.253626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:26:41.253626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5242250f-5274-4992-adb3-e8fdd3b65ed7 could not be found. Oct 10 23:26:41.253626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.254843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e1414f74-2548-4146-8694-e10e2e188e3a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Returning 404 to user: Instance 5242250f-5274-4992-adb3-e8fdd3b65ed7 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:26:41.254843 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e1414f74-2548-4146-8694-e10e2e188e3a tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7" status: 404 len: 111 microversion: 2.1 time: 0.106294 Oct 10 23:26:41.266572 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1274/2529] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:41 2022] GET /compute/v2.1/servers/5242250f-5274-4992-adb3-e8fdd3b65ed7 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:26:41.267156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-29b5c55c-4444-4edd-93f0-994a445c8723 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f662a818040>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:41.308695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a0048f5d-08ca-4bf4-bba9-cd8cb45111cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:41.309831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a0048f5d-08ca-4bf4-bba9-cd8cb45111cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:41.322531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0048f5d-08ca-4bf4-bba9-cd8cb45111cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:41.323196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0048f5d-08ca-4bf4-bba9-cd8cb45111cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:41.324651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0048f5d-08ca-4bf4-bba9-cd8cb45111cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:41.328932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0048f5d-08ca-4bf4-bba9-cd8cb45111cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:41.329821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0048f5d-08ca-4bf4-bba9-cd8cb45111cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:41.330174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0048f5d-08ca-4bf4-bba9-cd8cb45111cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:41.347238 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-29b5c55c-4444-4edd-93f0-994a445c8723 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] HTTP exception thrown: Image not found. Oct 10 23:26:41.358868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-29b5c55c-4444-4edd-93f0-994a445c8723 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Request method failure captured: Oct 10 23:26:41.358868 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3 HTTP/1.1 Oct 10 23:26:41.358868 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:26:41.358868 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:26:41.358868 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:26:41.358868 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:26:41.358868 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:26:41.358868 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:26:41.358868 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:26:41.358868 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:26:41.358868 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKk3KVehVj7kfhzKO7tP10F0nlws0ecnjL84hxYafJIYLkjhpObR0LeWUMazGIolaSnKaUKcQW10Z2dzveaz0v3jU-Wyi7o3FT8_QKBHt6aDVoJ0Efrz6xLbsnLq3nzDe2RIbHuMTp0TY7juRUiIzABxnHu6L2zEztBJiX8mJ-c3jW8 Oct 10 23:26:41.358868 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:26:41.358868 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:26:41.358868 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:26:41.358868 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:26:41.358868 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:26:41.358868 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:26:41.358868 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:41.358868 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.358868 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:26:41.358868 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:26:41.360808 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_451d034bd7474164a08bd3374680c0d2", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:26:41.360808 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.360808 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:41.360808 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.360808 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:41.360808 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:26:41.360808 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:26:41.360808 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 60c692636a4b4667a4eff5cde6e183bc Oct 10 23:26:41.360808 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:41.360808 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:26:41.360808 n-d-860864-2 devstack@n-api.service[120614]: exception: Image not found. Oct 10 23:26:41.360808 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '67a86ef6-0f97-4e5d-9efa-127f52e94db3'} Oct 10 23:26:41.360808 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:26:41.360808 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.361861 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 23:26:41.361861 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 23:26:41.361861 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:26:41.361861 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:26:41.361861 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:26:41.361861 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:26:41.361861 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 23:26:41.361861 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 23:26:41.361861 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 23:26:41.361861 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 23:26:41.361861 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:26:41.361861 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:26:41.361861 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:26:41.361861 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:26:41.361861 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 67a86ef6-0f97-4e5d-9efa-127f52e94db3 to delete Oct 10 23:26:41.361861 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.361861 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:41.361861 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.361861 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.363109 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 23:26:41.363109 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 23:26:41.363109 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 23:26:41.363109 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 23:26:41.363109 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 23:26:41.363109 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 23:26:41.363109 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 67a86ef6-0f97-4e5d-9efa-127f52e94db3 could not be found. Oct 10 23:26:41.363109 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.363109 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:41.363109 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.363109 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.363109 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:41.363109 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:41.363109 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:26:41.363109 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:26:41.363109 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:26:41.363109 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:26:41.363109 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:26:41.363109 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:26:41.363109 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 23:26:41.364188 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 23:26:41.364188 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 23:26:41.364188 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.364188 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:41.364188 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.364188 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.364188 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:41.364188 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:41.364188 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:26:41.364188 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:26:41.364188 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 23:26:41.364188 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.365820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-29b5c55c-4444-4edd-93f0-994a445c8723 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Returning 404 to user: Image not found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:26:41.366861 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-29b5c55c-4444-4edd-93f0-994a445c8723 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "DELETE /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3" status: 404 len: 62 microversion: 2.1 time: 0.110580 Oct 10 23:26:41.368275 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1256/2530] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:41 2022] DELETE /compute/v2.1/images/67a86ef6-0f97-4e5d-9efa-127f52e94db3 => generated 62 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:26:41.376431 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-9d2846f7-79dd-4e50-9867-4107399bf1d4 req-bc3da1af-0e2b-447b-9a22-5ebe4fa244d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aaa34f0-fc6a-4ef0-9474-3df5dab16917", "name": "network-vif-deleted", "tag": "74acb0df-5e5f-4bfa-982d-db062eb01948"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:41.393268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9d2846f7-79dd-4e50-9867-4107399bf1d4 req-bc3da1af-0e2b-447b-9a22-5ebe4fa244d0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:41.394034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9d2846f7-79dd-4e50-9867-4107399bf1d4 req-bc3da1af-0e2b-447b-9a22-5ebe4fa244d0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:41.395982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9d2846f7-79dd-4e50-9867-4107399bf1d4 req-bc3da1af-0e2b-447b-9a22-5ebe4fa244d0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:41.416869 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-9d2846f7-79dd-4e50-9867-4107399bf1d4 req-bc3da1af-0e2b-447b-9a22-5ebe4fa244d0 service nova] Creating event network-vif-deleted:74acb0df-5e5f-4bfa-982d-db062eb01948 for instance 3aaa34f0-fc6a-4ef0-9474-3df5dab16917 on n-h2-860864-2 Oct 10 23:26:41.424039 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-9d2846f7-79dd-4e50-9867-4107399bf1d4 req-bc3da1af-0e2b-447b-9a22-5ebe4fa244d0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054077 Oct 10 23:26:41.425206 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1257/2531] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:41.431959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-590c6bd2-20a7-45ae-b817-38f2d4798e64 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:41.432740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-590c6bd2-20a7-45ae-b817-38f2d4798e64 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:41.441043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-590c6bd2-20a7-45ae-b817-38f2d4798e64 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:41.442481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-590c6bd2-20a7-45ae-b817-38f2d4798e64 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:41.443084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-590c6bd2-20a7-45ae-b817-38f2d4798e64 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:41.443965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-590c6bd2-20a7-45ae-b817-38f2d4798e64 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:41.446022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-590c6bd2-20a7-45ae-b817-38f2d4798e64 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:41.446668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-590c6bd2-20a7-45ae-b817-38f2d4798e64 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:41.469790 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-590c6bd2-20a7-45ae-b817-38f2d4798e64 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] HTTP exception thrown: Instance abe142b1-562e-4ca2-a300-84a0bf7353ac could not be found. Oct 10 23:26:41.473766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-590c6bd2-20a7-45ae-b817-38f2d4798e64 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Request method failure captured: Oct 10 23:26:41.473766 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac HTTP/1.1 Oct 10 23:26:41.473766 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:26:41.473766 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:26:41.473766 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:26:41.473766 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:26:41.473766 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:26:41.473766 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:26:41.473766 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:26:41.473766 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:26:41.473766 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKk3KVehVj7kfhzKO7tP10F0nlws0ecnjL84hxYafJIYLkjhpObR0LeWUMazGIolaSnKaUKcQW10Z2dzveaz0v3jU-Wyi7o3FT8_QKBHt6aDVoJ0Efrz6xLbsnLq3nzDe2RIbHuMTp0TY7juRUiIzABxnHu6L2zEztBJiX8mJ-c3jW8 Oct 10 23:26:41.473766 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:26:41.473766 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:26:41.473766 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:26:41.473766 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:26:41.473766 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:26:41.473766 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:26:41.473766 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:41.473766 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.473766 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:26:41.473766 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:26:41.475015 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_451d034bd7474164a08bd3374680c0d2", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:26:41.475015 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.475015 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:41.475015 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.475015 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:41.475015 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:26:41.475015 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:26:41.475015 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 60c692636a4b4667a4eff5cde6e183bc Oct 10 23:26:41.475015 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:41.475015 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:26:41.475015 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance abe142b1-562e-4ca2-a300-84a0bf7353ac could not be found. Oct 10 23:26:41.475015 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'abe142b1-562e-4ca2-a300-84a0bf7353ac'} Oct 10 23:26:41.475699 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:26:41.475699 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.475699 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:26:41.475699 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:26:41.475699 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:26:41.475699 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:26:41.475699 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:26:41.475699 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:26:41.475699 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:26:41.475699 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:26:41.475699 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe142b1-562e-4ca2-a300-84a0bf7353ac could not be found. Oct 10 23:26:41.475699 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.475699 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:41.475699 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.475699 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.475699 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:41.475699 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:41.475699 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:26:41.475699 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:26:41.475699 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:26:41.476777 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:26:41.476777 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:26:41.476777 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:26:41.476777 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:26:41.476777 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:26:41.476777 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:26:41.476777 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:26:41.476777 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:26:41.476777 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:26:41.476777 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe142b1-562e-4ca2-a300-84a0bf7353ac could not be found. Oct 10 23:26:41.476777 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.476777 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:41.476777 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.476777 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.476777 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:41.476777 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:41.476777 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:26:41.476777 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:26:41.476777 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe142b1-562e-4ca2-a300-84a0bf7353ac could not be found. Oct 10 23:26:41.476777 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.499898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-590c6bd2-20a7-45ae-b817-38f2d4798e64 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Returning 404 to user: Instance abe142b1-562e-4ca2-a300-84a0bf7353ac could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:26:41.501547 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-590c6bd2-20a7-45ae-b817-38f2d4798e64 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 404 len: 111 microversion: 2.1 time: 0.074078 Oct 10 23:26:41.502293 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1258/2532] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:26:41 2022] DELETE /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:26:41.514847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fdc0fc38-fd8f-48c4-93db-803edccaefbc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:41.516302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fdc0fc38-fd8f-48c4-93db-803edccaefbc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: abe142b1-562e-4ca2-a300-84a0bf7353ac] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:41.529351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdc0fc38-fd8f-48c4-93db-803edccaefbc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:41.531733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdc0fc38-fd8f-48c4-93db-803edccaefbc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:41.532440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdc0fc38-fd8f-48c4-93db-803edccaefbc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:41.537228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdc0fc38-fd8f-48c4-93db-803edccaefbc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:41.538374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdc0fc38-fd8f-48c4-93db-803edccaefbc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:41.538970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdc0fc38-fd8f-48c4-93db-803edccaefbc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:41.574413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a0048f5d-08ca-4bf4-bba9-cd8cb45111cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:41.581924 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-fdc0fc38-fd8f-48c4-93db-803edccaefbc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] HTTP exception thrown: Instance abe142b1-562e-4ca2-a300-84a0bf7353ac could not be found. Oct 10 23:26:41.587730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fdc0fc38-fd8f-48c4-93db-803edccaefbc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Request method failure captured: Oct 10 23:26:41.587730 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac HTTP/1.1 Oct 10 23:26:41.587730 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:26:41.587730 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:26:41.587730 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:26:41.587730 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:26:41.587730 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:26:41.587730 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:26:41.587730 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:26:41.587730 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:26:41.587730 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKk3KVehVj7kfhzKO7tP10F0nlws0ecnjL84hxYafJIYLkjhpObR0LeWUMazGIolaSnKaUKcQW10Z2dzveaz0v3jU-Wyi7o3FT8_QKBHt6aDVoJ0Efrz6xLbsnLq3nzDe2RIbHuMTp0TY7juRUiIzABxnHu6L2zEztBJiX8mJ-c3jW8 Oct 10 23:26:41.587730 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:26:41.587730 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:26:41.587730 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:26:41.587730 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:26:41.587730 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:26:41.587730 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:26:41.587730 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:41.587730 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.587730 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:26:41.587730 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:26:41.589174 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_451d034bd7474164a08bd3374680c0d2", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:26:41.589174 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.589174 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:41.589174 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.589174 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:41.589174 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:26:41.589174 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:26:41.589174 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 60c692636a4b4667a4eff5cde6e183bc Oct 10 23:26:41.589174 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:41.589174 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:26:41.589174 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance abe142b1-562e-4ca2-a300-84a0bf7353ac could not be found. Oct 10 23:26:41.589174 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'abe142b1-562e-4ca2-a300-84a0bf7353ac'} Oct 10 23:26:41.592875 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:26:41.592875 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.592875 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:26:41.592875 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:26:41.592875 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:26:41.592875 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:26:41.592875 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:26:41.592875 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:26:41.592875 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:26:41.592875 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:26:41.592875 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe142b1-562e-4ca2-a300-84a0bf7353ac could not be found. Oct 10 23:26:41.592875 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.592875 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:41.592875 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.592875 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.592875 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:41.592875 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:41.592875 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:26:41.592875 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:26:41.592875 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:26:41.594318 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:26:41.594318 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:26:41.594318 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:26:41.594318 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:26:41.594318 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:26:41.594318 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:26:41.594318 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:26:41.594318 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe142b1-562e-4ca2-a300-84a0bf7353ac could not be found. Oct 10 23:26:41.594318 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.594318 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:41.594318 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.594318 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.594318 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:41.594318 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:41.594318 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:26:41.594318 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:26:41.594318 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe142b1-562e-4ca2-a300-84a0bf7353ac could not be found. Oct 10 23:26:41.594318 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.599547 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fdc0fc38-fd8f-48c4-93db-803edccaefbc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Returning 404 to user: Instance abe142b1-562e-4ca2-a300-84a0bf7353ac could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:26:41.602801 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fdc0fc38-fd8f-48c4-93db-803edccaefbc tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac" status: 404 len: 111 microversion: 2.1 time: 0.093179 Oct 10 23:26:41.605603 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1259/2533] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:41 2022] GET /compute/v2.1/servers/abe142b1-562e-4ca2-a300-84a0bf7353ac => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:26:41.622841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5b6e459f-4876-4aa4-ba67-faa055da69fc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:41.625018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a0048f5d-08ca-4bf4-bba9-cd8cb45111cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:41.625651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5b6e459f-4876-4aa4-ba67-faa055da69fc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:41.634555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a0048f5d-08ca-4bf4-bba9-cd8cb45111cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:41.658226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b6e459f-4876-4aa4-ba67-faa055da69fc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:41.660586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b6e459f-4876-4aa4-ba67-faa055da69fc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:41.661336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b6e459f-4876-4aa4-ba67-faa055da69fc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:41.663844 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a0048f5d-08ca-4bf4-bba9-cd8cb45111cd tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.359623 Oct 10 23:26:41.666096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b6e459f-4876-4aa4-ba67-faa055da69fc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:41.667169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b6e459f-4876-4aa4-ba67-faa055da69fc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:41.669133 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b6e459f-4876-4aa4-ba67-faa055da69fc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:41.690674 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1275/2534] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:41 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:41.718022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9dafd785-ba90-438a-83ba-6efa25d47277 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '.version_select at 0x7f6633b50ca0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:41.786021 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-9dafd785-ba90-438a-83ba-6efa25d47277 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] HTTP exception thrown: Image not found. Oct 10 23:26:41.787863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9dafd785-ba90-438a-83ba-6efa25d47277 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Request method failure captured: Oct 10 23:26:41.787863 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 HTTP/1.1 Oct 10 23:26:41.787863 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:26:41.787863 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:26:41.787863 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:26:41.787863 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:26:41.787863 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:26:41.787863 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:26:41.787863 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:26:41.787863 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:26:41.787863 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKk3KVehVj7kfhzKO7tP10F0nlws0ecnjL84hxYafJIYLkjhpObR0LeWUMazGIolaSnKaUKcQW10Z2dzveaz0v3jU-Wyi7o3FT8_QKBHt6aDVoJ0Efrz6xLbsnLq3nzDe2RIbHuMTp0TY7juRUiIzABxnHu6L2zEztBJiX8mJ-c3jW8 Oct 10 23:26:41.787863 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:26:41.787863 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:26:41.787863 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:26:41.787863 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:26:41.787863 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:26:41.787863 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:26:41.787863 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:41.787863 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.787863 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:26:41.787863 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:26:41.789142 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_451d034bd7474164a08bd3374680c0d2", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:26:41.789142 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.789142 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:41.789142 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:41.789142 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:41.789142 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:26:41.789142 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:26:41.789142 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 60c692636a4b4667a4eff5cde6e183bc Oct 10 23:26:41.789142 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:41.789142 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:26:41.789142 n-d-860864-2 devstack@n-api.service[120613]: exception: Image not found. Oct 10 23:26:41.789142 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '16aa3256-33c2-41a5-b1b8-491bbb0a0149'} Oct 10 23:26:41.789142 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:26:41.789142 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.789955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 23:26:41.789955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 23:26:41.789955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:26:41.789955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:26:41.789955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:26:41.789955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:26:41.789955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 23:26:41.789955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 23:26:41.789955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 23:26:41.789955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 23:26:41.789955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:26:41.789955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:26:41.789955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:26:41.789955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:26:41.789955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 16aa3256-33c2-41a5-b1b8-491bbb0a0149 to delete Oct 10 23:26:41.789955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.789955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:41.789955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.789955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.790972 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 23:26:41.790972 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 23:26:41.790972 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 23:26:41.790972 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 23:26:41.790972 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 23:26:41.790972 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 23:26:41.790972 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 16aa3256-33c2-41a5-b1b8-491bbb0a0149 could not be found. Oct 10 23:26:41.790972 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.790972 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:41.790972 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.790972 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.790972 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:41.790972 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:41.790972 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:26:41.790972 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:26:41.790972 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:26:41.790972 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:26:41.790972 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:26:41.790972 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:26:41.790972 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 23:26:41.792038 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 23:26:41.792038 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 23:26:41.792038 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.792038 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:41.792038 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.792038 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:41.792038 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:41.792038 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:41.792038 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:26:41.792038 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:26:41.792038 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 23:26:41.792038 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:41.792038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9dafd785-ba90-438a-83ba-6efa25d47277 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Returning 404 to user: Image not found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:26:41.792748 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9dafd785-ba90-438a-83ba-6efa25d47277 tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "DELETE /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149" status: 404 len: 62 microversion: 2.1 time: 0.099452 Oct 10 23:26:41.804197 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1276/2535] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:41 2022] DELETE /compute/v2.1/images/16aa3256-33c2-41a5-b1b8-491bbb0a0149 => generated 62 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:26:41.830098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3cfbb3b2-4886-48de-861a-3527a2de4109 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:41.834431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3cfbb3b2-4886-48de-861a-3527a2de4109 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:41.875869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cfbb3b2-4886-48de-861a-3527a2de4109 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:41.880576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cfbb3b2-4886-48de-861a-3527a2de4109 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:41.883378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cfbb3b2-4886-48de-861a-3527a2de4109 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:41.887741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cfbb3b2-4886-48de-861a-3527a2de4109 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:41.894323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cfbb3b2-4886-48de-861a-3527a2de4109 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:41.896387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cfbb3b2-4886-48de-861a-3527a2de4109 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:42.126911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5b6e459f-4876-4aa4-ba67-faa055da69fc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:42.142702 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5b6e459f-4876-4aa4-ba67-faa055da69fc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1210 microversion: 2.1 time: 0.535018 Oct 10 23:26:42.145848 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1260/2536] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:41 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1210 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:42.163505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3d7fb36a-8b2c-4a9e-b638-3244c88cf29f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:42.164921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3d7fb36a-8b2c-4a9e-b638-3244c88cf29f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: fe8a45b4-e6cb-434f-8e97-8caa78888257] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:42.183133 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d7fb36a-8b2c-4a9e-b638-3244c88cf29f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:42.183932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d7fb36a-8b2c-4a9e-b638-3244c88cf29f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:42.185136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d7fb36a-8b2c-4a9e-b638-3244c88cf29f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:42.186330 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d7fb36a-8b2c-4a9e-b638-3244c88cf29f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:42.189704 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d7fb36a-8b2c-4a9e-b638-3244c88cf29f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:42.191098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d7fb36a-8b2c-4a9e-b638-3244c88cf29f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:42.231069 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-3d7fb36a-8b2c-4a9e-b638-3244c88cf29f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] HTTP exception thrown: Instance fe8a45b4-e6cb-434f-8e97-8caa78888257 could not be found. Oct 10 23:26:42.237222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3d7fb36a-8b2c-4a9e-b638-3244c88cf29f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Request method failure captured: Oct 10 23:26:42.237222 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257 HTTP/1.1 Oct 10 23:26:42.237222 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:26:42.237222 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:26:42.237222 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:26:42.237222 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:26:42.237222 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:26:42.237222 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:26:42.237222 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:26:42.237222 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:26:42.237222 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKk3KVehVj7kfhzKO7tP10F0nlws0ecnjL84hxYafJIYLkjhpObR0LeWUMazGIolaSnKaUKcQW10Z2dzveaz0v3jU-Wyi7o3FT8_QKBHt6aDVoJ0Efrz6xLbsnLq3nzDe2RIbHuMTp0TY7juRUiIzABxnHu6L2zEztBJiX8mJ-c3jW8 Oct 10 23:26:42.237222 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:26:42.237222 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:26:42.237222 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:26:42.237222 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:26:42.237222 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:26:42.237222 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:26:42.237222 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:42.237222 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:42.237222 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:26:42.237222 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:26:42.238587 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_451d034bd7474164a08bd3374680c0d2", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:26:42.238587 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:42.238587 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:42.238587 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:42.238587 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:42.238587 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:26:42.238587 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:26:42.238587 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 60c692636a4b4667a4eff5cde6e183bc Oct 10 23:26:42.238587 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:42.238587 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:26:42.238587 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance fe8a45b4-e6cb-434f-8e97-8caa78888257 could not be found. Oct 10 23:26:42.238587 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'fe8a45b4-e6cb-434f-8e97-8caa78888257'} Oct 10 23:26:42.239260 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:26:42.239260 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:42.239260 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:26:42.239260 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:26:42.239260 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:26:42.239260 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:26:42.239260 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:26:42.239260 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:26:42.239260 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:26:42.239260 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:26:42.239260 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe8a45b4-e6cb-434f-8e97-8caa78888257 could not be found. Oct 10 23:26:42.239260 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:42.239260 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:42.239260 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:42.239260 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:42.239260 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:42.239260 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:42.239260 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:26:42.239260 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:26:42.239260 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:26:42.240348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:26:42.240348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:26:42.240348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:26:42.240348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:26:42.240348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:26:42.240348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:26:42.240348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:26:42.240348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:26:42.240348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:26:42.240348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe8a45b4-e6cb-434f-8e97-8caa78888257 could not be found. Oct 10 23:26:42.240348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:42.240348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:42.240348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:42.240348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:42.240348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:42.240348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:42.240348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:26:42.240348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:26:42.240348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe8a45b4-e6cb-434f-8e97-8caa78888257 could not be found. Oct 10 23:26:42.240348 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:26:42.241457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3d7fb36a-8b2c-4a9e-b638-3244c88cf29f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Returning 404 to user: Instance fe8a45b4-e6cb-434f-8e97-8caa78888257 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:26:42.241457 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3d7fb36a-8b2c-4a9e-b638-3244c88cf29f tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257" status: 404 len: 111 microversion: 2.1 time: 0.092265 Oct 10 23:26:42.246692 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1261/2537] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:26:42 2022] DELETE /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:26:42.256878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0e06def0-d8e8-4659-8919-3aa7e2b05b27 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:42.258034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0e06def0-d8e8-4659-8919-3aa7e2b05b27 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:42.274060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e06def0-d8e8-4659-8919-3aa7e2b05b27 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:42.277675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e06def0-d8e8-4659-8919-3aa7e2b05b27 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:42.279399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e06def0-d8e8-4659-8919-3aa7e2b05b27 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:42.280345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e06def0-d8e8-4659-8919-3aa7e2b05b27 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:42.282971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e06def0-d8e8-4659-8919-3aa7e2b05b27 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:42.283642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e06def0-d8e8-4659-8919-3aa7e2b05b27 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:42.319719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3cfbb3b2-4886-48de-861a-3527a2de4109 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:42.335395 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3cfbb3b2-4886-48de-861a-3527a2de4109 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27" status: 200 len: 1324 microversion: 2.1 time: 0.530017 Oct 10 23:26:42.349284 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1277/2538] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:41 2022] GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27 => generated 1324 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:42.369276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6f593a8f-7df7-4bfc-87ac-a056422d894d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:42.371554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6f593a8f-7df7-4bfc-87ac-a056422d894d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] [instance: fe8a45b4-e6cb-434f-8e97-8caa78888257] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:42.390877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f593a8f-7df7-4bfc-87ac-a056422d894d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:42.393191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f593a8f-7df7-4bfc-87ac-a056422d894d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:42.394085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f593a8f-7df7-4bfc-87ac-a056422d894d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:42.403338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f593a8f-7df7-4bfc-87ac-a056422d894d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:42.406202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f593a8f-7df7-4bfc-87ac-a056422d894d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:42.407037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f593a8f-7df7-4bfc-87ac-a056422d894d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:42.432292 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-6f593a8f-7df7-4bfc-87ac-a056422d894d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] HTTP exception thrown: Instance fe8a45b4-e6cb-434f-8e97-8caa78888257 could not be found. Oct 10 23:26:42.434257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6f593a8f-7df7-4bfc-87ac-a056422d894d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Request method failure captured: Oct 10 23:26:42.434257 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257 HTTP/1.1 Oct 10 23:26:42.434257 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:26:42.434257 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:26:42.434257 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:26:42.434257 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:26:42.434257 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:26:42.434257 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:26:42.434257 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:26:42.434257 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:26:42.434257 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKk3KVehVj7kfhzKO7tP10F0nlws0ecnjL84hxYafJIYLkjhpObR0LeWUMazGIolaSnKaUKcQW10Z2dzveaz0v3jU-Wyi7o3FT8_QKBHt6aDVoJ0Efrz6xLbsnLq3nzDe2RIbHuMTp0TY7juRUiIzABxnHu6L2zEztBJiX8mJ-c3jW8 Oct 10 23:26:42.434257 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:26:42.434257 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:26:42.434257 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:26:42.434257 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:26:42.434257 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:26:42.434257 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:26:42.434257 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:42.434257 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:42.434257 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:26:42.434257 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:26:42.435858 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/451d034bd7474164a08bd3374680c0d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_451d034bd7474164a08bd3374680c0d2", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:26:42.435858 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:42.435858 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 451d034bd7474164a08bd3374680c0d2 Oct 10 23:26:42.435858 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesTestJSON-1360299569 Oct 10 23:26:42.435858 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:42.435858 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:26:42.435858 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:26:42.435858 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 60c692636a4b4667a4eff5cde6e183bc Oct 10 23:26:42.435858 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesTestJSON-1360299569-project Oct 10 23:26:42.435858 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:26:42.435858 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance fe8a45b4-e6cb-434f-8e97-8caa78888257 could not be found. Oct 10 23:26:42.435858 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'fe8a45b4-e6cb-434f-8e97-8caa78888257'} Oct 10 23:26:42.436710 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:26:42.436710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:42.436710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:26:42.436710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:26:42.436710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:26:42.436710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:26:42.436710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:26:42.436710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:26:42.436710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:26:42.436710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:26:42.436710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe8a45b4-e6cb-434f-8e97-8caa78888257 could not be found. Oct 10 23:26:42.436710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:42.436710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:42.436710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:42.436710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:42.436710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:42.436710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:42.436710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:26:42.436710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:26:42.436710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:26:42.438338 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:26:42.438338 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:26:42.438338 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:26:42.438338 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:26:42.438338 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:26:42.438338 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:26:42.438338 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:26:42.438338 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe8a45b4-e6cb-434f-8e97-8caa78888257 could not be found. Oct 10 23:26:42.438338 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:42.438338 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:42.438338 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:42.438338 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:42.438338 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:42.438338 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:42.438338 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:26:42.438338 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:26:42.438338 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe8a45b4-e6cb-434f-8e97-8caa78888257 could not be found. Oct 10 23:26:42.438338 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:42.439421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0e06def0-d8e8-4659-8919-3aa7e2b05b27 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ef84f12c934e9aa1be187f2842b71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ae586965414012b4aeded0508deb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:42.440796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6f593a8f-7df7-4bfc-87ac-a056422d894d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] Returning 404 to user: Instance fe8a45b4-e6cb-434f-8e97-8caa78888257 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:26:42.441911 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6f593a8f-7df7-4bfc-87ac-a056422d894d tempest-ImagesTestJSON-1360299569 tempest-ImagesTestJSON-1360299569-project] 10.222.0.23 "GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257" status: 404 len: 111 microversion: 2.1 time: 0.085264 Oct 10 23:26:42.442687 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1278/2539] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:42 2022] GET /compute/v2.1/servers/fe8a45b4-e6cb-434f-8e97-8caa78888257 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:26:42.454513 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0e06def0-d8e8-4659-8919-3aa7e2b05b27 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 200 len: 1274 microversion: 2.1 time: 0.207355 Oct 10 23:26:42.471049 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1262/2540] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:42 2022] GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 1274 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:42.706517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cd90a2de-47e7-4d40-83c3-115b689923e8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:42.707506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cd90a2de-47e7-4d40-83c3-115b689923e8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:42.728702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd90a2de-47e7-4d40-83c3-115b689923e8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:42.737678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd90a2de-47e7-4d40-83c3-115b689923e8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:42.746836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd90a2de-47e7-4d40-83c3-115b689923e8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:42.748198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd90a2de-47e7-4d40-83c3-115b689923e8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:42.753917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd90a2de-47e7-4d40-83c3-115b689923e8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:42.754783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd90a2de-47e7-4d40-83c3-115b689923e8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:43.053752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cd90a2de-47e7-4d40-83c3-115b689923e8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:43.069493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cd90a2de-47e7-4d40-83c3-115b689923e8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:43.071389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cd90a2de-47e7-4d40-83c3-115b689923e8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:43.096697 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cd90a2de-47e7-4d40-83c3-115b689923e8 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.396576 Oct 10 23:26:43.098027 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1279/2541] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:42 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:43.175861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7d598d36-4ef1-4fb0-b73f-6f7953eaeaf3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:43.176601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7d598d36-4ef1-4fb0-b73f-6f7953eaeaf3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:43.199201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d598d36-4ef1-4fb0-b73f-6f7953eaeaf3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:43.206379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d598d36-4ef1-4fb0-b73f-6f7953eaeaf3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:43.206951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d598d36-4ef1-4fb0-b73f-6f7953eaeaf3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:43.207882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d598d36-4ef1-4fb0-b73f-6f7953eaeaf3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:43.208459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d598d36-4ef1-4fb0-b73f-6f7953eaeaf3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:43.208992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d598d36-4ef1-4fb0-b73f-6f7953eaeaf3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:43.379083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1ba56e0f-b5a7-4209-95f0-03e87c3d0e26 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:43.380328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1ba56e0f-b5a7-4209-95f0-03e87c3d0e26 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:43.388292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ba56e0f-b5a7-4209-95f0-03e87c3d0e26 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:43.389336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ba56e0f-b5a7-4209-95f0-03e87c3d0e26 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:43.390068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ba56e0f-b5a7-4209-95f0-03e87c3d0e26 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:43.391338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ba56e0f-b5a7-4209-95f0-03e87c3d0e26 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:43.391975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ba56e0f-b5a7-4209-95f0-03e87c3d0e26 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:43.392566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ba56e0f-b5a7-4209-95f0-03e87c3d0e26 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:43.587431 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7d598d36-4ef1-4fb0-b73f-6f7953eaeaf3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:43.603557 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7d598d36-4ef1-4fb0-b73f-6f7953eaeaf3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1272 microversion: 2.1 time: 0.433373 Oct 10 23:26:43.604923 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1263/2542] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:43 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1272 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:43.627906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ff44b999-5b8b-4327-9beb-71251034077a tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:43.634463 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ff44b999-5b8b-4327-9beb-71251034077a tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:43.648713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff44b999-5b8b-4327-9beb-71251034077a tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:43.656010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff44b999-5b8b-4327-9beb-71251034077a tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:43.658512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff44b999-5b8b-4327-9beb-71251034077a tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:43.659624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff44b999-5b8b-4327-9beb-71251034077a tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:43.669311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff44b999-5b8b-4327-9beb-71251034077a tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:43.673624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff44b999-5b8b-4327-9beb-71251034077a tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:43.836878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ff44b999-5b8b-4327-9beb-71251034077a tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ef84f12c934e9aa1be187f2842b71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ae586965414012b4aeded0508deb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:43.861977 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ff44b999-5b8b-4327-9beb-71251034077a tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 200 len: 1274 microversion: 2.1 time: 0.252355 Oct 10 23:26:43.882466 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1264/2543] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:43 2022] GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 1274 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:43.982895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1ba56e0f-b5a7-4209-95f0-03e87c3d0e26 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:44.005860 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1ba56e0f-b5a7-4209-95f0-03e87c3d0e26 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27" status: 200 len: 1324 microversion: 2.1 time: 0.633996 Oct 10 23:26:44.023571 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1280/2544] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:43 2022] GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27 => generated 1324 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:44.143877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-536305bd-efef-4085-9abc-a69cb26edfc7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:44.144580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-536305bd-efef-4085-9abc-a69cb26edfc7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:44.190610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-536305bd-efef-4085-9abc-a69cb26edfc7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:44.190610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-536305bd-efef-4085-9abc-a69cb26edfc7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:44.190610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-536305bd-efef-4085-9abc-a69cb26edfc7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:44.190610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-536305bd-efef-4085-9abc-a69cb26edfc7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:44.192100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-536305bd-efef-4085-9abc-a69cb26edfc7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:44.192100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-536305bd-efef-4085-9abc-a69cb26edfc7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:44.469181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-536305bd-efef-4085-9abc-a69cb26edfc7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:44.482294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-536305bd-efef-4085-9abc-a69cb26edfc7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:44.490501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-536305bd-efef-4085-9abc-a69cb26edfc7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:44.503408 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-536305bd-efef-4085-9abc-a69cb26edfc7 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.365644 Oct 10 23:26:44.510087 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1265/2545] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:44 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:44.632667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3c2e1800-7780-4db8-9cae-b4048485d3fc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:44.634353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3c2e1800-7780-4db8-9cae-b4048485d3fc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:44.653362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c2e1800-7780-4db8-9cae-b4048485d3fc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:44.654857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c2e1800-7780-4db8-9cae-b4048485d3fc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:44.655663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c2e1800-7780-4db8-9cae-b4048485d3fc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:44.658647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c2e1800-7780-4db8-9cae-b4048485d3fc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:44.659675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c2e1800-7780-4db8-9cae-b4048485d3fc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:44.660455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c2e1800-7780-4db8-9cae-b4048485d3fc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:44.889287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9ee116a2-f8c3-421d-a8ac-7cb958784dcc tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:44.890887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9ee116a2-f8c3-421d-a8ac-7cb958784dcc tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:44.909459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ee116a2-f8c3-421d-a8ac-7cb958784dcc tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:44.910169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ee116a2-f8c3-421d-a8ac-7cb958784dcc tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:44.910633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ee116a2-f8c3-421d-a8ac-7cb958784dcc tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:44.911813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ee116a2-f8c3-421d-a8ac-7cb958784dcc tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:44.915767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ee116a2-f8c3-421d-a8ac-7cb958784dcc tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:44.918408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ee116a2-f8c3-421d-a8ac-7cb958784dcc tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:44.976296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3c2e1800-7780-4db8-9cae-b4048485d3fc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:45.006994 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3c2e1800-7780-4db8-9cae-b4048485d3fc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1272 microversion: 2.1 time: 0.379027 Oct 10 23:26:45.022048 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1281/2546] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:44 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1272 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:45.041927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5b170282-efcb-45a2-8456-47a8a0e846df tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:45.043617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5b170282-efcb-45a2-8456-47a8a0e846df tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:45.053056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b170282-efcb-45a2-8456-47a8a0e846df tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:45.054016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b170282-efcb-45a2-8456-47a8a0e846df tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:45.054654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b170282-efcb-45a2-8456-47a8a0e846df tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:45.056763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b170282-efcb-45a2-8456-47a8a0e846df tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:45.058308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b170282-efcb-45a2-8456-47a8a0e846df tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:45.060295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b170282-efcb-45a2-8456-47a8a0e846df tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:45.408976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9ee116a2-f8c3-421d-a8ac-7cb958784dcc tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ef84f12c934e9aa1be187f2842b71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ae586965414012b4aeded0508deb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:45.430310 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9ee116a2-f8c3-421d-a8ac-7cb958784dcc tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 200 len: 1274 microversion: 2.1 time: 0.543041 Oct 10 23:26:45.431144 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1266/2547] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:44 2022] GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 1274 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:26:45.498451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5b170282-efcb-45a2-8456-47a8a0e846df tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:45.507395 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5b170282-efcb-45a2-8456-47a8a0e846df tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27" status: 200 len: 1324 microversion: 2.1 time: 0.477335 Oct 10 23:26:45.510770 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1282/2548] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:45 2022] GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27 => generated 1324 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:26:45.545225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ba37fc41-91f3-41b4-b74d-caf06182f47c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:45.546127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ba37fc41-91f3-41b4-b74d-caf06182f47c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:45.567593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba37fc41-91f3-41b4-b74d-caf06182f47c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:45.568190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba37fc41-91f3-41b4-b74d-caf06182f47c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:45.568711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba37fc41-91f3-41b4-b74d-caf06182f47c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:45.569557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba37fc41-91f3-41b4-b74d-caf06182f47c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:45.570096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba37fc41-91f3-41b4-b74d-caf06182f47c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:45.570597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba37fc41-91f3-41b4-b74d-caf06182f47c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:45.772122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ba37fc41-91f3-41b4-b74d-caf06182f47c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:45.783756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ba37fc41-91f3-41b4-b74d-caf06182f47c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:45.786428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ba37fc41-91f3-41b4-b74d-caf06182f47c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:45.794219 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ba37fc41-91f3-41b4-b74d-caf06182f47c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1553 microversion: 2.91 time: 0.253788 Oct 10 23:26:45.796752 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1267/2549] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:45 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1553 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:46.036733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0c9c96df-bb3d-4281-a9d6-12b18bf9f70a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:46.037557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0c9c96df-bb3d-4281-a9d6-12b18bf9f70a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:46.048205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0c9c96df-bb3d-4281-a9d6-12b18bf9f70a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:46.050184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0c9c96df-bb3d-4281-a9d6-12b18bf9f70a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:46.051918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0c9c96df-bb3d-4281-a9d6-12b18bf9f70a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:46.061080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0c9c96df-bb3d-4281-a9d6-12b18bf9f70a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:46.065571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0c9c96df-bb3d-4281-a9d6-12b18bf9f70a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:46.066589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0c9c96df-bb3d-4281-a9d6-12b18bf9f70a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:46.110776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:46.457445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6a4d122b-bba1-462c-9d4f-fcef07137e18 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:46.458079 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6a4d122b-bba1-462c-9d4f-fcef07137e18 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:46.476088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a4d122b-bba1-462c-9d4f-fcef07137e18 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:46.477497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a4d122b-bba1-462c-9d4f-fcef07137e18 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:46.478340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0c9c96df-bb3d-4281-a9d6-12b18bf9f70a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:46.479453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a4d122b-bba1-462c-9d4f-fcef07137e18 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:46.482247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a4d122b-bba1-462c-9d4f-fcef07137e18 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:46.484708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a4d122b-bba1-462c-9d4f-fcef07137e18 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:46.485449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a4d122b-bba1-462c-9d4f-fcef07137e18 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:46.503203 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0c9c96df-bb3d-4281-a9d6-12b18bf9f70a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1314 microversion: 2.1 time: 0.472105 Oct 10 23:26:46.525263 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1283/2550] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:46 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:46.537539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f89e0e4f-3be4-4738-a8ae-64165650d5d0 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:46.540496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f89e0e4f-3be4-4738-a8ae-64165650d5d0 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:46.549871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f89e0e4f-3be4-4738-a8ae-64165650d5d0 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:46.550717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f89e0e4f-3be4-4738-a8ae-64165650d5d0 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:46.551678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f89e0e4f-3be4-4738-a8ae-64165650d5d0 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:46.553068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f89e0e4f-3be4-4738-a8ae-64165650d5d0 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:46.553763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f89e0e4f-3be4-4738-a8ae-64165650d5d0 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:46.554392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f89e0e4f-3be4-4738-a8ae-64165650d5d0 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:47.067083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f89e0e4f-3be4-4738-a8ae-64165650d5d0 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:47.084067 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f89e0e4f-3be4-4738-a8ae-64165650d5d0 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27" status: 200 len: 1324 microversion: 2.1 time: 0.550271 Oct 10 23:26:47.084880 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1284/2551] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:46 2022] GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27 => generated 1324 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:47.103860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-832376e8-4cd5-4352-a656-bceaaee0627f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:47.105045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-832376e8-4cd5-4352-a656-bceaaee0627f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:47.116951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-832376e8-4cd5-4352-a656-bceaaee0627f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:47.117811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-832376e8-4cd5-4352-a656-bceaaee0627f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:47.118412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-832376e8-4cd5-4352-a656-bceaaee0627f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:47.119300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-832376e8-4cd5-4352-a656-bceaaee0627f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:47.122599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-832376e8-4cd5-4352-a656-bceaaee0627f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:47.123277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-832376e8-4cd5-4352-a656-bceaaee0627f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:47.283290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-832376e8-4cd5-4352-a656-bceaaee0627f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:47.293655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-832376e8-4cd5-4352-a656-bceaaee0627f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:47.295813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-832376e8-4cd5-4352-a656-bceaaee0627f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:47.302488 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-832376e8-4cd5-4352-a656-bceaaee0627f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1535 microversion: 2.91 time: 0.216771 Oct 10 23:26:47.303576 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1285/2552] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:47 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1535 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:47.312714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6a4d122b-bba1-462c-9d4f-fcef07137e18 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ef84f12c934e9aa1be187f2842b71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ae586965414012b4aeded0508deb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:47.328018 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6a4d122b-bba1-462c-9d4f-fcef07137e18 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 200 len: 1316 microversion: 2.1 time: 0.875856 Oct 10 23:26:47.331302 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1268/2553] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:46 2022] GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 1316 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:47.401246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cb4c1560-026f-4000-a88d-84d388478012 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:47.403954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cb4c1560-026f-4000-a88d-84d388478012 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:47.413539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb4c1560-026f-4000-a88d-84d388478012 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:47.414948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb4c1560-026f-4000-a88d-84d388478012 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:47.416184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb4c1560-026f-4000-a88d-84d388478012 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:47.417174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb4c1560-026f-4000-a88d-84d388478012 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:47.418614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb4c1560-026f-4000-a88d-84d388478012 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:47.420103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb4c1560-026f-4000-a88d-84d388478012 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:47.477608 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cb4c1560-026f-4000-a88d-84d388478012 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080381 Oct 10 23:26:47.481587 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1286/2554] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:26:47 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:26:47.533593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-92f23398-6239-440f-a25c-54b474d7db5e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:47.534292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-92f23398-6239-440f-a25c-54b474d7db5e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:47.549455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92f23398-6239-440f-a25c-54b474d7db5e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:47.553369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92f23398-6239-440f-a25c-54b474d7db5e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:47.554548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92f23398-6239-440f-a25c-54b474d7db5e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:47.555457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92f23398-6239-440f-a25c-54b474d7db5e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:47.557410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92f23398-6239-440f-a25c-54b474d7db5e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:47.559633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92f23398-6239-440f-a25c-54b474d7db5e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:47.606258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0da85b2a-7e6a-4864-a6b7-f8aeb6a518d6 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:47.606984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0da85b2a-7e6a-4864-a6b7-f8aeb6a518d6 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:47.615974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0da85b2a-7e6a-4864-a6b7-f8aeb6a518d6 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:47.623314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0da85b2a-7e6a-4864-a6b7-f8aeb6a518d6 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:47.623889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0da85b2a-7e6a-4864-a6b7-f8aeb6a518d6 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:47.624718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0da85b2a-7e6a-4864-a6b7-f8aeb6a518d6 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:47.626016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0da85b2a-7e6a-4864-a6b7-f8aeb6a518d6 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:47.626922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0da85b2a-7e6a-4864-a6b7-f8aeb6a518d6 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:47.682481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0da85b2a-7e6a-4864-a6b7-f8aeb6a518d6 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:26:47.788624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:47.831679 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0da85b2a-7e6a-4864-a6b7-f8aeb6a518d6 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "DELETE /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 204 len: 0 microversion: 2.1 time: 0.229396 Oct 10 23:26:47.832557 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1287/2555] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:26:47 2022] DELETE /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:26:47.842865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d1df894f-9994-415c-b3d3-9198ba9a7c74 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:47.845057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d1df894f-9994-415c-b3d3-9198ba9a7c74 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:47.849106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:47.853713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1df894f-9994-415c-b3d3-9198ba9a7c74 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:47.854659 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1df894f-9994-415c-b3d3-9198ba9a7c74 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:47.855632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1df894f-9994-415c-b3d3-9198ba9a7c74 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:47.857879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1df894f-9994-415c-b3d3-9198ba9a7c74 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:47.858726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1df894f-9994-415c-b3d3-9198ba9a7c74 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:47.859761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1df894f-9994-415c-b3d3-9198ba9a7c74 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:48.514743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-92f23398-6239-440f-a25c-54b474d7db5e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:48.539298 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-92f23398-6239-440f-a25c-54b474d7db5e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1314 microversion: 2.1 time: 1.007922 Oct 10 23:26:48.555816 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1269/2556] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:47 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1314 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:48.566539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ab33bd59-a683-4a21-a62e-7ea72dc35e5d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:48.568771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ab33bd59-a683-4a21-a62e-7ea72dc35e5d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:48.577463 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab33bd59-a683-4a21-a62e-7ea72dc35e5d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:48.578251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab33bd59-a683-4a21-a62e-7ea72dc35e5d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:48.579564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab33bd59-a683-4a21-a62e-7ea72dc35e5d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:48.580507 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab33bd59-a683-4a21-a62e-7ea72dc35e5d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:48.581181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab33bd59-a683-4a21-a62e-7ea72dc35e5d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:48.581846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab33bd59-a683-4a21-a62e-7ea72dc35e5d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:48.587200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:48.754924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d1df894f-9994-415c-b3d3-9198ba9a7c74 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:48.770030 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d1df894f-9994-415c-b3d3-9198ba9a7c74 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1676 microversion: 2.1 time: 0.931836 Oct 10 23:26:48.785413 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1288/2557] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:47 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1676 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:26:48.785413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4a6dbf14-d385-4d4a-ba56-e06e5b55b384 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:48.785413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4a6dbf14-d385-4d4a-ba56-e06e5b55b384 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:48.789159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a6dbf14-d385-4d4a-ba56-e06e5b55b384 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:48.790787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a6dbf14-d385-4d4a-ba56-e06e5b55b384 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:48.791448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a6dbf14-d385-4d4a-ba56-e06e5b55b384 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:48.792323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a6dbf14-d385-4d4a-ba56-e06e5b55b384 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:48.792929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a6dbf14-d385-4d4a-ba56-e06e5b55b384 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:48.793769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a6dbf14-d385-4d4a-ba56-e06e5b55b384 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:48.898660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:48.926661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ab33bd59-a683-4a21-a62e-7ea72dc35e5d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:48.942316 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ab33bd59-a683-4a21-a62e-7ea72dc35e5d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27" status: 200 len: 1324 microversion: 2.1 time: 0.384901 Oct 10 23:26:48.943249 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1270/2558] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:48 2022] GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27 => generated 1324 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:48.948085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-30db1793-c74a-462f-b4d4-0adf8b157742 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:48.953251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-30db1793-c74a-462f-b4d4-0adf8b157742 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:48.975393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30db1793-c74a-462f-b4d4-0adf8b157742 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:48.976208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30db1793-c74a-462f-b4d4-0adf8b157742 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:48.976837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30db1793-c74a-462f-b4d4-0adf8b157742 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:48.977778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30db1793-c74a-462f-b4d4-0adf8b157742 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:48.978429 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30db1793-c74a-462f-b4d4-0adf8b157742 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:48.979078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30db1793-c74a-462f-b4d4-0adf8b157742 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:49.054153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4a6dbf14-d385-4d4a-ba56-e06e5b55b384 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:49.090706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4a6dbf14-d385-4d4a-ba56-e06e5b55b384 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:49.095275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4a6dbf14-d385-4d4a-ba56-e06e5b55b384 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:49.114178 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4a6dbf14-d385-4d4a-ba56-e06e5b55b384 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1535 microversion: 2.91 time: 0.341948 Oct 10 23:26:49.116395 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1289/2559] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:48 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1535 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:49.124488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-224e6d4c-acd9-45de-b06d-dfd4b85b301c req-e474e6cc-6d3a-4971-ba3d-d952c63e7613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb66932-449d-48cd-9a36-485807874e27", "name": "network-vif-plugged", "status": "completed", "tag": "c68baca6-c92c-4e7a-bef8-b00039aec8ff"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:49.148169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-224e6d4c-acd9-45de-b06d-dfd4b85b301c req-e474e6cc-6d3a-4971-ba3d-d952c63e7613 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:49.148983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-224e6d4c-acd9-45de-b06d-dfd4b85b301c req-e474e6cc-6d3a-4971-ba3d-d952c63e7613 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:49.149559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-224e6d4c-acd9-45de-b06d-dfd4b85b301c req-e474e6cc-6d3a-4971-ba3d-d952c63e7613 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:49.163418 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-224e6d4c-acd9-45de-b06d-dfd4b85b301c req-e474e6cc-6d3a-4971-ba3d-d952c63e7613 service nova] Creating event network-vif-plugged:c68baca6-c92c-4e7a-bef8-b00039aec8ff for instance dcb66932-449d-48cd-9a36-485807874e27 on n-h1-860864-2 Oct 10 23:26:49.170020 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-224e6d4c-acd9-45de-b06d-dfd4b85b301c req-e474e6cc-6d3a-4971-ba3d-d952c63e7613 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051570 Oct 10 23:26:49.171347 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1290/2560] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:49.322467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-e6f96331-f0d6-40b1-9417-a7a02eacfabb req-8a4658e0-7dc2-4f1c-881f-5095e2a16740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6fbaa2c-2c0f-490a-974e-43b899dcc5bc", "tag": "7e626df1-9936-4b1c-b65c-f8e10f3d2223"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:49.346057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e6f96331-f0d6-40b1-9417-a7a02eacfabb req-8a4658e0-7dc2-4f1c-881f-5095e2a16740 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:49.348429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e6f96331-f0d6-40b1-9417-a7a02eacfabb req-8a4658e0-7dc2-4f1c-881f-5095e2a16740 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:49.350087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e6f96331-f0d6-40b1-9417-a7a02eacfabb req-8a4658e0-7dc2-4f1c-881f-5095e2a16740 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:49.380023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=8 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:49.390910 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-e6f96331-f0d6-40b1-9417-a7a02eacfabb req-8a4658e0-7dc2-4f1c-881f-5095e2a16740 service nova] Creating event network-changed:7e626df1-9936-4b1c-b65c-f8e10f3d2223 for instance f6fbaa2c-2c0f-490a-974e-43b899dcc5bc on n-h2-860864-2 Oct 10 23:26:49.397620 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-e6f96331-f0d6-40b1-9417-a7a02eacfabb req-8a4658e0-7dc2-4f1c-881f-5095e2a16740 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081841 Oct 10 23:26:49.398813 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1291/2561] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:26:49.532694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-30db1793-c74a-462f-b4d4-0adf8b157742 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ef84f12c934e9aa1be187f2842b71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ae586965414012b4aeded0508deb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:49.549187 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-30db1793-c74a-462f-b4d4-0adf8b157742 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 200 len: 1316 microversion: 2.1 time: 0.604604 Oct 10 23:26:49.550180 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1271/2562] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:48 2022] GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 1316 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:49.572353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-710bb557-98fb-46a9-a563-4a7b56d3fa04 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:49.574113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-710bb557-98fb-46a9-a563-4a7b56d3fa04 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:49.588187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-710bb557-98fb-46a9-a563-4a7b56d3fa04 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:49.591890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-710bb557-98fb-46a9-a563-4a7b56d3fa04 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:49.592628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-710bb557-98fb-46a9-a563-4a7b56d3fa04 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:49.595735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-710bb557-98fb-46a9-a563-4a7b56d3fa04 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:49.596714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-710bb557-98fb-46a9-a563-4a7b56d3fa04 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:49.597535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-710bb557-98fb-46a9-a563-4a7b56d3fa04 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:49.722307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-72050c88-153c-4863-b949-6acf84333865 req-40cf695a-8ad2-4ad5-b4b0-6a5ec49dcec2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b64a0f12-ba9a-4074-9ba0-0911bdab6c0f", "tag": "c3888bf2-97db-4f22-afff-a2d9b83792af"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:49.754446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-72050c88-153c-4863-b949-6acf84333865 req-40cf695a-8ad2-4ad5-b4b0-6a5ec49dcec2 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:49.758919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-72050c88-153c-4863-b949-6acf84333865 req-40cf695a-8ad2-4ad5-b4b0-6a5ec49dcec2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:49.761138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-72050c88-153c-4863-b949-6acf84333865 req-40cf695a-8ad2-4ad5-b4b0-6a5ec49dcec2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:49.795869 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-72050c88-153c-4863-b949-6acf84333865 req-40cf695a-8ad2-4ad5-b4b0-6a5ec49dcec2 service nova] Creating event network-changed:c3888bf2-97db-4f22-afff-a2d9b83792af for instance b64a0f12-ba9a-4074-9ba0-0911bdab6c0f on n-h2-860864-2 Oct 10 23:26:49.808920 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-72050c88-153c-4863-b949-6acf84333865 req-40cf695a-8ad2-4ad5-b4b0-6a5ec49dcec2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.405463 Oct 10 23:26:49.814011 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1292/2563] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:49.836130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-53308236-a68f-40be-9205-a7be18628b0f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:49.836850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-53308236-a68f-40be-9205-a7be18628b0f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:49.851856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53308236-a68f-40be-9205-a7be18628b0f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:49.853788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53308236-a68f-40be-9205-a7be18628b0f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:49.854370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53308236-a68f-40be-9205-a7be18628b0f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:49.855264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53308236-a68f-40be-9205-a7be18628b0f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:49.856792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53308236-a68f-40be-9205-a7be18628b0f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:49.857713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53308236-a68f-40be-9205-a7be18628b0f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:49.869324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-710bb557-98fb-46a9-a563-4a7b56d3fa04 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:49.878187 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-710bb557-98fb-46a9-a563-4a7b56d3fa04 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1314 microversion: 2.1 time: 0.310579 Oct 10 23:26:49.878792 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1272/2564] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:49 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:49.975220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-65219ed9-ae8e-40ff-8d6e-ffd5a98aea27 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:49.976616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-65219ed9-ae8e-40ff-8d6e-ffd5a98aea27 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:49.989169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65219ed9-ae8e-40ff-8d6e-ffd5a98aea27 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:49.990890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65219ed9-ae8e-40ff-8d6e-ffd5a98aea27 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:49.993703 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65219ed9-ae8e-40ff-8d6e-ffd5a98aea27 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:49.994491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65219ed9-ae8e-40ff-8d6e-ffd5a98aea27 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:49.996179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65219ed9-ae8e-40ff-8d6e-ffd5a98aea27 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:49.998794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-65219ed9-ae8e-40ff-8d6e-ffd5a98aea27 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:50.203675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-65219ed9-ae8e-40ff-8d6e-ffd5a98aea27 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:50.218611 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-65219ed9-ae8e-40ff-8d6e-ffd5a98aea27 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27" status: 200 len: 1324 microversion: 2.1 time: 0.249109 Oct 10 23:26:50.225902 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1273/2565] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:49 2022] GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27 => generated 1324 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:26:50.235849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-afe9106b-9f08-439f-af5e-3b350c09809f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:50.236534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-afe9106b-9f08-439f-af5e-3b350c09809f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:50.242782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afe9106b-9f08-439f-af5e-3b350c09809f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:50.243673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afe9106b-9f08-439f-af5e-3b350c09809f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:50.244281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afe9106b-9f08-439f-af5e-3b350c09809f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:50.245000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afe9106b-9f08-439f-af5e-3b350c09809f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:50.246434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afe9106b-9f08-439f-af5e-3b350c09809f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:50.246867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afe9106b-9f08-439f-af5e-3b350c09809f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:50.317621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-afe9106b-9f08-439f-af5e-3b350c09809f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:50.326412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-afe9106b-9f08-439f-af5e-3b350c09809f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:50.327933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-afe9106b-9f08-439f-af5e-3b350c09809f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:50.333440 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-afe9106b-9f08-439f-af5e-3b350c09809f tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1535 microversion: 2.91 time: 0.105527 Oct 10 23:26:50.334035 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1274/2566] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:50 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1535 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:50.381215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-53308236-a68f-40be-9205-a7be18628b0f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:50.389391 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-53308236-a68f-40be-9205-a7be18628b0f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1676 microversion: 2.1 time: 0.573776 Oct 10 23:26:50.390020 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1293/2567] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:49 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1676 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:50.574209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1171fc05-a37b-4db1-9c87-97c89743d18c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:50.574953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1171fc05-a37b-4db1-9c87-97c89743d18c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:50.582255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1171fc05-a37b-4db1-9c87-97c89743d18c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:50.582752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1171fc05-a37b-4db1-9c87-97c89743d18c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:50.583191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1171fc05-a37b-4db1-9c87-97c89743d18c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:50.583901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1171fc05-a37b-4db1-9c87-97c89743d18c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:50.584361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1171fc05-a37b-4db1-9c87-97c89743d18c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:50.584784 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1171fc05-a37b-4db1-9c87-97c89743d18c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:50.739971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1171fc05-a37b-4db1-9c87-97c89743d18c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ef84f12c934e9aa1be187f2842b71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ae586965414012b4aeded0508deb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:50.749181 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1171fc05-a37b-4db1-9c87-97c89743d18c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 200 len: 1316 microversion: 2.1 time: 0.178721 Oct 10 23:26:50.750334 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1275/2568] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:50 2022] GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:50.904813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4438fb2b-93c1-4914-921e-0124e7e15f3f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:50.907599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4438fb2b-93c1-4914-921e-0124e7e15f3f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:50.917832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4438fb2b-93c1-4914-921e-0124e7e15f3f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:50.919683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4438fb2b-93c1-4914-921e-0124e7e15f3f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:50.920383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4438fb2b-93c1-4914-921e-0124e7e15f3f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:50.921603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4438fb2b-93c1-4914-921e-0124e7e15f3f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:50.922381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4438fb2b-93c1-4914-921e-0124e7e15f3f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:50.923261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4438fb2b-93c1-4914-921e-0124e7e15f3f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:51.251632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d1143bc3-dd8b-4ace-8c9c-2a0e2c033d4a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:51.260036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d1143bc3-dd8b-4ace-8c9c-2a0e2c033d4a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:51.300423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1143bc3-dd8b-4ace-8c9c-2a0e2c033d4a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:51.303554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1143bc3-dd8b-4ace-8c9c-2a0e2c033d4a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:51.306383 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1143bc3-dd8b-4ace-8c9c-2a0e2c033d4a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:51.308722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1143bc3-dd8b-4ace-8c9c-2a0e2c033d4a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:51.309918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1143bc3-dd8b-4ace-8c9c-2a0e2c033d4a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:51.314294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1143bc3-dd8b-4ace-8c9c-2a0e2c033d4a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:51.539075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4438fb2b-93c1-4914-921e-0124e7e15f3f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:51.551917 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4438fb2b-93c1-4914-921e-0124e7e15f3f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1314 microversion: 2.1 time: 0.651987 Oct 10 23:26:51.565959 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1294/2569] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:50 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1314 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:51.582437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d1143bc3-dd8b-4ace-8c9c-2a0e2c033d4a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:51.597949 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d1143bc3-dd8b-4ace-8c9c-2a0e2c033d4a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27" status: 200 len: 1520 microversion: 2.1 time: 0.351708 Oct 10 23:26:51.602808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-96033f43-e456-4093-9d5c-539c8682e815 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:51.603065 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1276/2570] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:51 2022] GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27 => generated 1520 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:51.603429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-96033f43-e456-4093-9d5c-539c8682e815 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:51.614963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96033f43-e456-4093-9d5c-539c8682e815 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:51.616510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7604f25b-ae22-4fc0-b927-f6f84a935cf2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:51.617151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7604f25b-ae22-4fc0-b927-f6f84a935cf2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:51.618365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96033f43-e456-4093-9d5c-539c8682e815 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:51.620991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96033f43-e456-4093-9d5c-539c8682e815 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:51.623788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96033f43-e456-4093-9d5c-539c8682e815 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:51.625486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96033f43-e456-4093-9d5c-539c8682e815 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:51.628580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96033f43-e456-4093-9d5c-539c8682e815 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:51.632608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7604f25b-ae22-4fc0-b927-f6f84a935cf2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:51.633876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7604f25b-ae22-4fc0-b927-f6f84a935cf2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:51.634977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7604f25b-ae22-4fc0-b927-f6f84a935cf2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:51.636596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7604f25b-ae22-4fc0-b927-f6f84a935cf2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:51.637341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7604f25b-ae22-4fc0-b927-f6f84a935cf2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:51.645006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7604f25b-ae22-4fc0-b927-f6f84a935cf2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:52.362802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-96033f43-e456-4093-9d5c-539c8682e815 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:52.367624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7604f25b-ae22-4fc0-b927-f6f84a935cf2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:52.379718 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7604f25b-ae22-4fc0-b927-f6f84a935cf2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1676 microversion: 2.1 time: 0.774803 Oct 10 23:26:52.386835 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1277/2571] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:51 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1676 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:52.396414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8aa6daea-78e8-4b6b-9622-ad07c71167dc tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Action: 'create', calling method: .version_select at 0x7f662a872940>, body: {"pool": null} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:52.405604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-96033f43-e456-4093-9d5c-539c8682e815 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:52.409219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-96033f43-e456-4093-9d5c-539c8682e815 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:52.415140 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-96033f43-e456-4093-9d5c-539c8682e815 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1538 microversion: 2.91 time: 0.847919 Oct 10 23:26:52.416092 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1295/2572] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:51 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1538 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:52.440458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9a41e043-7b44-40d8-982e-8e4066422016 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:52.445102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9a41e043-7b44-40d8-982e-8e4066422016 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:52.460374 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a41e043-7b44-40d8-982e-8e4066422016 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:52.461294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a41e043-7b44-40d8-982e-8e4066422016 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:52.462717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a41e043-7b44-40d8-982e-8e4066422016 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:52.464832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a41e043-7b44-40d8-982e-8e4066422016 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:52.465601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a41e043-7b44-40d8-982e-8e4066422016 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:52.466223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a41e043-7b44-40d8-982e-8e4066422016 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:52.786241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9a41e043-7b44-40d8-982e-8e4066422016 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ef84f12c934e9aa1be187f2842b71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ae586965414012b4aeded0508deb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:52.799213 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9a41e043-7b44-40d8-982e-8e4066422016 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 200 len: 1316 microversion: 2.1 time: 0.381425 Oct 10 23:26:52.800847 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1296/2573] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:52 2022] GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 1316 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:52.819279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-685a27a3-6a35-4855-a98e-23e9d647f18a tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-860864-2"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:52.821756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-685a27a3-6a35-4855-a98e-23e9d647f18a tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:52.833154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-685a27a3-6a35-4855-a98e-23e9d647f18a tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:52.835809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-685a27a3-6a35-4855-a98e-23e9d647f18a tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:52.836414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-685a27a3-6a35-4855-a98e-23e9d647f18a tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:52.838844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-685a27a3-6a35-4855-a98e-23e9d647f18a tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:52.839459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-685a27a3-6a35-4855-a98e-23e9d647f18a tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:52.840872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-685a27a3-6a35-4855-a98e-23e9d647f18a tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:53.017021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-685a27a3-6a35-4855-a98e-23e9d647f18a tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-860864-2". {{(pid=120613) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 10 23:26:53.114177 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-685a27a3-6a35-4855-a98e-23e9d647f18a tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba/action" status: 202 len: 0 microversion: 2.91 time: 0.311901 Oct 10 23:26:53.114942 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1297/2574] 10.222.0.23 () {62 vars in 1319 bytes} [Mon Oct 10 23:26:52 2022] POST /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:26:53.129281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3fb98cf7-d0ae-49d4-b340-4c83f7bc436a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:53.130093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3fb98cf7-d0ae-49d4-b340-4c83f7bc436a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:53.140232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fb98cf7-d0ae-49d4-b340-4c83f7bc436a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:53.140970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fb98cf7-d0ae-49d4-b340-4c83f7bc436a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:53.141786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fb98cf7-d0ae-49d4-b340-4c83f7bc436a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:53.142974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fb98cf7-d0ae-49d4-b340-4c83f7bc436a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:53.143585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fb98cf7-d0ae-49d4-b340-4c83f7bc436a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:53.144206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fb98cf7-d0ae-49d4-b340-4c83f7bc436a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:53.525817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3fb98cf7-d0ae-49d4-b340-4c83f7bc436a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:53.529454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:53.544097 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3fb98cf7-d0ae-49d4-b340-4c83f7bc436a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1314 microversion: 2.1 time: 0.427971 Oct 10 23:26:53.565483 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1298/2575] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:53 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:53.570490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-08d52c19-a7eb-4ed3-a949-654cb2020f92 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:53.571592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-08d52c19-a7eb-4ed3-a949-654cb2020f92 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:53.578705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08d52c19-a7eb-4ed3-a949-654cb2020f92 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:53.579348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08d52c19-a7eb-4ed3-a949-654cb2020f92 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:53.579859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08d52c19-a7eb-4ed3-a949-654cb2020f92 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:53.580660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08d52c19-a7eb-4ed3-a949-654cb2020f92 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:53.581304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08d52c19-a7eb-4ed3-a949-654cb2020f92 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:53.582770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08d52c19-a7eb-4ed3-a949-654cb2020f92 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:53.771217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-08d52c19-a7eb-4ed3-a949-654cb2020f92 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:53.791481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-08d52c19-a7eb-4ed3-a949-654cb2020f92 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:53.795940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-08d52c19-a7eb-4ed3-a949-654cb2020f92 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:53.806328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:53.815416 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-08d52c19-a7eb-4ed3-a949-654cb2020f92 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1486 microversion: 2.91 time: 0.262169 Oct 10 23:26:53.819354 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1299/2576] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:53 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1486 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:53.839096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-38c0a6a7-c7de-4a16-a273-ace1a9ed4b8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:53.839732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-38c0a6a7-c7de-4a16-a273-ace1a9ed4b8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:53.853122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38c0a6a7-c7de-4a16-a273-ace1a9ed4b8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:53.853963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38c0a6a7-c7de-4a16-a273-ace1a9ed4b8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:53.854605 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38c0a6a7-c7de-4a16-a273-ace1a9ed4b8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:53.855544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38c0a6a7-c7de-4a16-a273-ace1a9ed4b8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:53.857015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38c0a6a7-c7de-4a16-a273-ace1a9ed4b8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:53.857721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38c0a6a7-c7de-4a16-a273-ace1a9ed4b8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:53.902271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38c0a6a7-c7de-4a16-a273-ace1a9ed4b8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:53.903102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38c0a6a7-c7de-4a16-a273-ace1a9ed4b8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:53.903748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38c0a6a7-c7de-4a16-a273-ace1a9ed4b8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:53.904450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-38c0a6a7-c7de-4a16-a273-ace1a9ed4b8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lazy-loading 'fault' on Instance uuid 10d4252b-2561-4a94-adf8-018fdec5c2cc {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:26:54.010599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-38c0a6a7-c7de-4a16-a273-ace1a9ed4b8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:54.023913 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-38c0a6a7-c7de-4a16-a273-ace1a9ed4b8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 200 len: 1328 microversion: 2.1 time: 0.200367 Oct 10 23:26:54.025026 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1300/2577] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:53 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 1328 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:54.326744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-d7244073-e566-4266-9df2-a9a66beb5012 req-c4e92c01-14f4-4c29-9cdf-0aca5dd3cdc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d4252b-2561-4a94-adf8-018fdec5c2cc", "name": "network-vif-deleted", "tag": "9fd315b0-8b11-4a9f-b09c-b6b5287bc293"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:54.371956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d7244073-e566-4266-9df2-a9a66beb5012 req-c4e92c01-14f4-4c29-9cdf-0aca5dd3cdc4 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:54.373314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d7244073-e566-4266-9df2-a9a66beb5012 req-c4e92c01-14f4-4c29-9cdf-0aca5dd3cdc4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:54.375035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d7244073-e566-4266-9df2-a9a66beb5012 req-c4e92c01-14f4-4c29-9cdf-0aca5dd3cdc4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:54.421795 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-d7244073-e566-4266-9df2-a9a66beb5012 req-c4e92c01-14f4-4c29-9cdf-0aca5dd3cdc4 service nova] Creating event network-vif-deleted:9fd315b0-8b11-4a9f-b09c-b6b5287bc293 for instance 10d4252b-2561-4a94-adf8-018fdec5c2cc on n-h2-860864-2 Oct 10 23:26:54.463081 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-d7244073-e566-4266-9df2-a9a66beb5012 req-c4e92c01-14f4-4c29-9cdf-0aca5dd3cdc4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.433735 Oct 10 23:26:54.470828 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1301/2578] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:54.504140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1f2be2b6-0b0c-49bd-8516-46e3696a067d tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:54.510041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1f2be2b6-0b0c-49bd-8516-46e3696a067d tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:54.528885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f2be2b6-0b0c-49bd-8516-46e3696a067d tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:54.533230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f2be2b6-0b0c-49bd-8516-46e3696a067d tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:54.533718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f2be2b6-0b0c-49bd-8516-46e3696a067d tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:54.534477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f2be2b6-0b0c-49bd-8516-46e3696a067d tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:54.535916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f2be2b6-0b0c-49bd-8516-46e3696a067d tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:54.535916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f2be2b6-0b0c-49bd-8516-46e3696a067d tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:54.895743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1f2be2b6-0b0c-49bd-8516-46e3696a067d tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ef84f12c934e9aa1be187f2842b71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ae586965414012b4aeded0508deb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:54.950224 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1f2be2b6-0b0c-49bd-8516-46e3696a067d tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 200 len: 1316 microversion: 2.1 time: 0.461908 Oct 10 23:26:54.961565 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1302/2579] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:54 2022] GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:54.964910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-508f1e2f-df96-4061-b293-d8916e948dc8 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:54.968875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-508f1e2f-df96-4061-b293-d8916e948dc8 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:54.994242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-508f1e2f-df96-4061-b293-d8916e948dc8 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:54.994753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-508f1e2f-df96-4061-b293-d8916e948dc8 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:55.007122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-508f1e2f-df96-4061-b293-d8916e948dc8 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:55.009827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-508f1e2f-df96-4061-b293-d8916e948dc8 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:55.013463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-508f1e2f-df96-4061-b293-d8916e948dc8 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:55.016439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-508f1e2f-df96-4061-b293-d8916e948dc8 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:55.378019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-508f1e2f-df96-4061-b293-d8916e948dc8 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:55.401871 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-508f1e2f-df96-4061-b293-d8916e948dc8 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1314 microversion: 2.1 time: 0.448250 Oct 10 23:26:55.417408 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1303/2580] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:54 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:55.417408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-080aff47-0bc3-461b-8ba7-e16ec29928cc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:55.417408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-080aff47-0bc3-461b-8ba7-e16ec29928cc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:55.432676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-080aff47-0bc3-461b-8ba7-e16ec29928cc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:55.433178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-080aff47-0bc3-461b-8ba7-e16ec29928cc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:55.433648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-080aff47-0bc3-461b-8ba7-e16ec29928cc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:55.434354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-080aff47-0bc3-461b-8ba7-e16ec29928cc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:55.434806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-080aff47-0bc3-461b-8ba7-e16ec29928cc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:55.435230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-080aff47-0bc3-461b-8ba7-e16ec29928cc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:55.596834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-080aff47-0bc3-461b-8ba7-e16ec29928cc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:55.613015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-080aff47-0bc3-461b-8ba7-e16ec29928cc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:55.614680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-080aff47-0bc3-461b-8ba7-e16ec29928cc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:55.633563 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-080aff47-0bc3-461b-8ba7-e16ec29928cc tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.224515 Oct 10 23:26:55.634731 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1304/2581] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:55 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:55.676765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e0ac6d8c-d4ad-45d2-840d-e6ec365984d3 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:55.677443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e0ac6d8c-d4ad-45d2-840d-e6ec365984d3 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:55.693924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0ac6d8c-d4ad-45d2-840d-e6ec365984d3 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:55.694350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0ac6d8c-d4ad-45d2-840d-e6ec365984d3 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:55.705189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0ac6d8c-d4ad-45d2-840d-e6ec365984d3 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:55.706067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0ac6d8c-d4ad-45d2-840d-e6ec365984d3 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:55.706952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0ac6d8c-d4ad-45d2-840d-e6ec365984d3 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:55.706952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0ac6d8c-d4ad-45d2-840d-e6ec365984d3 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:55.733201 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-e0ac6d8c-d4ad-45d2-840d-e6ec365984d3 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] HTTP exception thrown: Instance 10d4252b-2561-4a94-adf8-018fdec5c2cc could not be found. Oct 10 23:26:55.737728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e0ac6d8c-d4ad-45d2-840d-e6ec365984d3 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Request method failure captured: Oct 10 23:26:55.737728 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc HTTP/1.1 Oct 10 23:26:55.737728 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:26:55.737728 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:26:55.737728 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:26:55.737728 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:26:55.737728 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:26:55.737728 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:26:55.737728 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:26:55.737728 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:26:55.737728 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKlI_YkLpN74j_S3g3S6EcM7YKiKgbKXL7mTv6k3fUCYv3Ak1NWP8hxmuTXmVLoihl2334XejPqPrC-9pcqzYQS4P0aVciT3ekTGIZc0Q1dkz5tFbEWE8TV2EjVtyaSfcoSr32WmBQI0pkZHXYeq0SrBFvw6DpvWsvLH6YvOSkivg5E Oct 10 23:26:55.737728 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:26:55.737728 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:26:55.737728 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:26:55.737728 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:26:55.737728 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:26:55.737728 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:26:55.737728 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 6e7609ed88094dd083202e42b058ffd5 Oct 10 23:26:55.737728 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AttachVolumeTestJSON-168471984 Oct 10 23:26:55.737728 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:26:55.737728 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:26:55.739105 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6e7609ed88094dd083202e42b058ffd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6e7609ed88094dd083202e42b058ffd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6e7609ed88094dd083202e42b058ffd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6e7609ed88094dd083202e42b058ffd5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:26:55.739105 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AttachVolumeTestJSON-168471984 Oct 10 23:26:55.739105 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 6e7609ed88094dd083202e42b058ffd5 Oct 10 23:26:55.739105 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AttachVolumeTestJSON-168471984 Oct 10 23:26:55.739105 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AttachVolumeTestJSON-168471984-project Oct 10 23:26:55.739105 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:26:55.739105 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:26:55.739105 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: f9e8299b29f044b0ab99b74346bf4870 Oct 10 23:26:55.739105 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AttachVolumeTestJSON-168471984-project Oct 10 23:26:55.739105 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:26:55.739105 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 10d4252b-2561-4a94-adf8-018fdec5c2cc could not be found. Oct 10 23:26:55.739105 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '10d4252b-2561-4a94-adf8-018fdec5c2cc'} Oct 10 23:26:55.739919 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:26:55.739919 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:55.739919 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:26:55.739919 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:26:55.739919 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:26:55.739919 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:26:55.739919 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:26:55.739919 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:26:55.739919 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:26:55.739919 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:26:55.739919 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10d4252b-2561-4a94-adf8-018fdec5c2cc could not be found. Oct 10 23:26:55.739919 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:55.739919 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:55.739919 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:55.739919 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:55.739919 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:55.739919 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:55.739919 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:26:55.739919 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:26:55.739919 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:26:55.741055 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:26:55.741055 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:26:55.741055 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:26:55.741055 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:26:55.741055 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:26:55.741055 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:26:55.741055 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:26:55.741055 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10d4252b-2561-4a94-adf8-018fdec5c2cc could not be found. Oct 10 23:26:55.741055 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:55.741055 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:26:55.741055 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:55.741055 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:26:55.741055 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:26:55.741055 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:26:55.741055 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:26:55.741055 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:26:55.741055 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10d4252b-2561-4a94-adf8-018fdec5c2cc could not be found. Oct 10 23:26:55.741055 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:26:55.742103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e0ac6d8c-d4ad-45d2-840d-e6ec365984d3 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Returning 404 to user: Instance 10d4252b-2561-4a94-adf8-018fdec5c2cc could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:26:55.742103 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e0ac6d8c-d4ad-45d2-840d-e6ec365984d3 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 404 len: 111 microversion: 2.1 time: 0.085872 Oct 10 23:26:55.742103 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1305/2582] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:55 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:26:55.757494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7c0e0928-da7c-4f31-aeb3-a2d5a433262c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '.version_select at 0x7f6633b92430>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:55.804260 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7c0e0928-da7c-4f31-aeb3-a2d5a433262c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1642851461" status: 202 len: 0 microversion: 2.1 time: 0.052479 Oct 10 23:26:55.805305 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1306/2583] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 10 23:26:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1642851461 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:26:55.981733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-804a9396-1671-46d9-9b0f-580f0498fffc tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:55.982371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-804a9396-1671-46d9-9b0f-580f0498fffc tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:55.996679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-804a9396-1671-46d9-9b0f-580f0498fffc tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:55.997122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-804a9396-1671-46d9-9b0f-580f0498fffc tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:55.997836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-804a9396-1671-46d9-9b0f-580f0498fffc tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:55.998917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-804a9396-1671-46d9-9b0f-580f0498fffc tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:55.999450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-804a9396-1671-46d9-9b0f-580f0498fffc tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:56.001125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-804a9396-1671-46d9-9b0f-580f0498fffc tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:56.194204 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8aa6daea-78e8-4b6b-9622-ad07c71167dc tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.804429 Oct 10 23:26:56.195025 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1278/2584] 10.222.0.23 () {60 vars in 1170 bytes} [Mon Oct 10 23:26:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:56.301954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-804a9396-1671-46d9-9b0f-580f0498fffc tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ef84f12c934e9aa1be187f2842b71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ae586965414012b4aeded0508deb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:56.311527 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-804a9396-1671-46d9-9b0f-580f0498fffc tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 200 len: 1316 microversion: 2.1 time: 0.335195 Oct 10 23:26:56.329407 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1307/2585] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:55 2022] GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 1316 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:56.443941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ec35f130-5388-4a1b-a395-9396a80eeb58 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:56.446027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ec35f130-5388-4a1b-a395-9396a80eeb58 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:56.456717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:26:56.466439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec35f130-5388-4a1b-a395-9396a80eeb58 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:56.467249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec35f130-5388-4a1b-a395-9396a80eeb58 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:56.468062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec35f130-5388-4a1b-a395-9396a80eeb58 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:56.469262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec35f130-5388-4a1b-a395-9396a80eeb58 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:56.470437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec35f130-5388-4a1b-a395-9396a80eeb58 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:56.471289 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec35f130-5388-4a1b-a395-9396a80eeb58 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:56.573884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6eb2261c-9c7a-4021-bd80-ccddc40bf898 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1146340613", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "de4c0e75-354a-475e-8f5b-aa897d475c60"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:56.670219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-6eb2261c-9c7a-4021-bd80-ccddc40bf898 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] validate_networks() for [('de4c0e75-354a-475e-8f5b-aa897d475c60', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:26:56.762931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ec35f130-5388-4a1b-a395-9396a80eeb58 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:56.776103 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ec35f130-5388-4a1b-a395-9396a80eeb58 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1314 microversion: 2.1 time: 0.342914 Oct 10 23:26:56.777302 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1279/2586] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:56 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:26:56.795974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bc767996-bddd-48e0-a9e7-158f603e3f01 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:56.796979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bc767996-bddd-48e0-a9e7-158f603e3f01 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:56.839605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc767996-bddd-48e0-a9e7-158f603e3f01 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:56.840845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc767996-bddd-48e0-a9e7-158f603e3f01 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:56.841913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc767996-bddd-48e0-a9e7-158f603e3f01 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:56.843997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc767996-bddd-48e0-a9e7-158f603e3f01 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:56.846475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc767996-bddd-48e0-a9e7-158f603e3f01 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:56.847820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc767996-bddd-48e0-a9e7-158f603e3f01 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:56.982355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bc767996-bddd-48e0-a9e7-158f603e3f01 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:56.995715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bc767996-bddd-48e0-a9e7-158f603e3f01 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:57.001893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bc767996-bddd-48e0-a9e7-158f603e3f01 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:57.016422 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bc767996-bddd-48e0-a9e7-158f603e3f01 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.237942 Oct 10 23:26:57.038153 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1280/2587] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:56 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:57.285044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6eb2261c-9c7a-4021-bd80-ccddc40bf898 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:26:57.288274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6eb2261c-9c7a-4021-bd80-ccddc40bf898 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:26:57.289850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6eb2261c-9c7a-4021-bd80-ccddc40bf898 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:26:57.290627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6eb2261c-9c7a-4021-bd80-ccddc40bf898 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:26:57.291245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6eb2261c-9c7a-4021-bd80-ccddc40bf898 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:26:57.310338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6eb2261c-9c7a-4021-bd80-ccddc40bf898 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:57.311391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6eb2261c-9c7a-4021-bd80-ccddc40bf898 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:57.312268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6eb2261c-9c7a-4021-bd80-ccddc40bf898 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:57.316148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6eb2261c-9c7a-4021-bd80-ccddc40bf898 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:57.317164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6eb2261c-9c7a-4021-bd80-ccddc40bf898 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:57.317929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6eb2261c-9c7a-4021-bd80-ccddc40bf898 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:57.352998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-6eb2261c-9c7a-4021-bd80-ccddc40bf898 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Getting quotas for project 43bf1bebb02c4359a949d820dd31c49e. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:26:57.362272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-6eb2261c-9c7a-4021-bd80-ccddc40bf898 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Getting quotas for user 3fd164398b9e4a8dac71bcd96eccbb2a and project 43bf1bebb02c4359a949d820dd31c49e. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:26:57.408944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6eb2261c-9c7a-4021-bd80-ccddc40bf898 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:26:57.416226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6eb2261c-9c7a-4021-bd80-ccddc40bf898 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:26:57.420115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8da3b4c5-9681-4baf-8551-a0808ee554aa tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Action: 'create', calling method: .version_select at 0x7f662a7c83a0>, body: {"keypair": {"name": "tempest-keypair-1266723171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGR/LD+B5qPXsnI0p28nRsqmCto28k3gjWc50pFOU/si6oc2UhKF6ZuR95Oirfz9pO0Eo+iN+Vf5zpL03HBtzV88d4IHs9iNXluQvxUPfS8IVw9GJMMrrhPQxka/xU3pQ=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:57.477976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-8da3b4c5-9681-4baf-8551-a0808ee554aa tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Getting quotas for project e3028b49585d4b069e89de7aff9e9dcd. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:26:57.502853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-8da3b4c5-9681-4baf-8551-a0808ee554aa tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Getting quotas for user b4df569672b744509ed48a44d3d7de45 and project e3028b49585d4b069e89de7aff9e9dcd. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:26:57.556526 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6eb2261c-9c7a-4021-bd80-ccddc40bf898 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.983639 Oct 10 23:26:57.558150 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1308/2588] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:26:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 23:26:57.569279 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8da3b4c5-9681-4baf-8551-a0808ee554aa tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.517785 Oct 10 23:26:57.580054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a75715d1-14d6-41ee-a99b-b69befdf7497 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Action: 'create', calling method: .version_select at 0x7f6633b924c0>, body: {"keypair": {"name": "tempest-keypair-705951817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsc5t8r/iRCCReqUSa7OUHMeByHoPrH0Uueg7H9cPZkMK5QN/ieyKlSPXFlKSVtnIwpf6hvm7QcqOfjf6gQ88F0e0ICRCjkxis0Owu8bHDQL/FNX/AzkYrhad+mB7CSwg=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:57.581327 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1281/2589] 10.222.0.23 () {62 vars in 1199 bytes} [Mon Oct 10 23:26:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 542 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 10 23:26:57.596472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fd1411c4-5066-4342-b5a3-fe83ec5e286b tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:57.597684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fd1411c4-5066-4342-b5a3-fe83ec5e286b tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:57.606472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd1411c4-5066-4342-b5a3-fe83ec5e286b tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:57.607311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd1411c4-5066-4342-b5a3-fe83ec5e286b tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:57.608291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd1411c4-5066-4342-b5a3-fe83ec5e286b tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:57.611342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd1411c4-5066-4342-b5a3-fe83ec5e286b tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:57.612627 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd1411c4-5066-4342-b5a3-fe83ec5e286b tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:57.613852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd1411c4-5066-4342-b5a3-fe83ec5e286b tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:57.657717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-a75715d1-14d6-41ee-a99b-b69befdf7497 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Getting quotas for project 6e7609ed88094dd083202e42b058ffd5. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:26:57.680246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-a75715d1-14d6-41ee-a99b-b69befdf7497 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Getting quotas for user f9e8299b29f044b0ab99b74346bf4870 and project 6e7609ed88094dd083202e42b058ffd5. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:26:57.780894 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a75715d1-14d6-41ee-a99b-b69befdf7497 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.217166 Oct 10 23:26:57.791497 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1309/2590] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:26:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:57.815020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cc61bf89-9484-46e2-8b07-058b5cdfc991 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:57.815781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cc61bf89-9484-46e2-8b07-058b5cdfc991 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:58.089334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fd1411c4-5066-4342-b5a3-fe83ec5e286b tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ef84f12c934e9aa1be187f2842b71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ae586965414012b4aeded0508deb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:58.100210 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fd1411c4-5066-4342-b5a3-fe83ec5e286b tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 200 len: 1316 microversion: 2.1 time: 0.517512 Oct 10 23:26:58.100810 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1282/2591] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:57 2022] GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 1316 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:58.102065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cc61bf89-9484-46e2-8b07-058b5cdfc991 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:58.129525 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cc61bf89-9484-46e2-8b07-058b5cdfc991 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" status: 200 len: 1224 microversion: 2.1 time: 0.337743 Oct 10 23:26:58.130214 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1310/2592] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:57 2022] GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 => generated 1224 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:58.143569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-431e9ecf-45f4-48bb-807c-eb249b397497 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Calling method '.version_select at 0x7f662a818b80>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:58.147551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-27418feb-45f5-4c07-a0e8-7e152eec849f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:58.152244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-27418feb-45f5-4c07-a0e8-7e152eec849f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:58.168649 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-431e9ecf-45f4-48bb-807c-eb249b397497 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1266723171" status: 200 len: 513 microversion: 2.2 time: 0.055778 Oct 10 23:26:58.179939 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1283/2593] 10.222.0.23 () {60 vars in 1258 bytes} [Mon Oct 10 23:26:58 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1266723171 => generated 513 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:26:58.181909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27418feb-45f5-4c07-a0e8-7e152eec849f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:58.182421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27418feb-45f5-4c07-a0e8-7e152eec849f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:58.182852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27418feb-45f5-4c07-a0e8-7e152eec849f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:58.183572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27418feb-45f5-4c07-a0e8-7e152eec849f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:58.184034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27418feb-45f5-4c07-a0e8-7e152eec849f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:58.184463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27418feb-45f5-4c07-a0e8-7e152eec849f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:58.201651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3b668215-d44e-4cce-803b-ee162f0a8ff1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:58.211205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3b668215-d44e-4cce-803b-ee162f0a8ff1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:58.246217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b668215-d44e-4cce-803b-ee162f0a8ff1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:58.247223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b668215-d44e-4cce-803b-ee162f0a8ff1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:58.248722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b668215-d44e-4cce-803b-ee162f0a8ff1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:58.253877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b668215-d44e-4cce-803b-ee162f0a8ff1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:58.258146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b668215-d44e-4cce-803b-ee162f0a8ff1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:58.266151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b668215-d44e-4cce-803b-ee162f0a8ff1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:58.468321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3b668215-d44e-4cce-803b-ee162f0a8ff1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:58.488412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3b668215-d44e-4cce-803b-ee162f0a8ff1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:58.497902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3b668215-d44e-4cce-803b-ee162f0a8ff1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:58.514734 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3b668215-d44e-4cce-803b-ee162f0a8ff1 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.328828 Oct 10 23:26:58.516256 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1284/2594] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:58 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:26:58.527035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d2532126-3c3b-4fae-8eab-a93f46da5291 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Calling method '.version_select at 0x7f662a8729d0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:58.600217 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d2532126-3c3b-4fae-8eab-a93f46da5291 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1266723171" status: 204 len: 0 microversion: 2.2 time: 0.080311 Oct 10 23:26:58.601231 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1285/2595] 10.222.0.23 () {60 vars in 1261 bytes} [Mon Oct 10 23:26:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1266723171 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:26:58.673563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-27418feb-45f5-4c07-a0e8-7e152eec849f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:58.682244 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-27418feb-45f5-4c07-a0e8-7e152eec849f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1314 microversion: 2.1 time: 0.549781 Oct 10 23:26:58.682856 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1311/2596] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:58 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:58.706407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-610dc25e-b7cc-4483-a8a3-8c69721d823f tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Action: 'create', calling method: .version_select at 0x7f6633baf160>, body: {"keypair": {"name": "tempest-keypair-1085118036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOu26szYL5C/a40AgfXM/yBSWlytNRc7qvExGr89nPBB7gCD2zEB3vC3vWwre4kXSVy0i/z4GFt2DgkV6WlFPhmOoGllbks3lpi9xDgFcHBBXGTdqFB88RCWVYNWe6XKXg=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:58.767905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-610dc25e-b7cc-4483-a8a3-8c69721d823f tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Getting quotas for project e3028b49585d4b069e89de7aff9e9dcd. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:26:58.802201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-610dc25e-b7cc-4483-a8a3-8c69721d823f tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Getting quotas for user b4df569672b744509ed48a44d3d7de45 and project e3028b49585d4b069e89de7aff9e9dcd. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:26:58.901898 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-610dc25e-b7cc-4483-a8a3-8c69721d823f tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.210901 Oct 10 23:26:58.902537 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1312/2597] 10.222.0.23 () {62 vars in 1199 bytes} [Mon Oct 10 23:26:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 219 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 10 23:26:58.918161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6e4cbded-e334-4566-8814-d0535edb05a0 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Calling method '.version_select at 0x7f6633b275e0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:58.996027 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6e4cbded-e334-4566-8814-d0535edb05a0 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1085118036" status: 204 len: 0 microversion: 2.2 time: 0.081742 Oct 10 23:26:59.000116 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1313/2598] 10.222.0.23 () {60 vars in 1261 bytes} [Mon Oct 10 23:26:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1085118036 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:26:59.015765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-581f33ca-8c9d-4015-b875-6b7db92e65e5 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Action: 'create', calling method: .version_select at 0x7f6633b29b80>, body: {"keypair": {"name": "tempest-keypair-464099188", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:59.074019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-581f33ca-8c9d-4015-b875-6b7db92e65e5 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Getting quotas for project e3028b49585d4b069e89de7aff9e9dcd. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:26:59.080674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-581f33ca-8c9d-4015-b875-6b7db92e65e5 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Getting quotas for user b4df569672b744509ed48a44d3d7de45 and project e3028b49585d4b069e89de7aff9e9dcd. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:26:59.124047 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-581f33ca-8c9d-4015-b875-6b7db92e65e5 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.116882 Oct 10 23:26:59.129947 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1314/2599] 10.222.0.23 () {62 vars in 1199 bytes} [Mon Oct 10 23:26:59 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 10 23:26:59.147029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-832dbc98-3eca-4fc4-9355-e54d23f9b3a6 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:59.149501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-832dbc98-3eca-4fc4-9355-e54d23f9b3a6 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:59.170207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-832dbc98-3eca-4fc4-9355-e54d23f9b3a6 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:59.171971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-832dbc98-3eca-4fc4-9355-e54d23f9b3a6 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:59.174327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-832dbc98-3eca-4fc4-9355-e54d23f9b3a6 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:59.176262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-832dbc98-3eca-4fc4-9355-e54d23f9b3a6 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:59.178211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-832dbc98-3eca-4fc4-9355-e54d23f9b3a6 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:59.180246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-832dbc98-3eca-4fc4-9355-e54d23f9b3a6 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:59.212793 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9a30bff4-79d8-4059-a90f-4c5141398c55 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-277581758", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:26:59.362112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-9a30bff4-79d8-4059-a90f-4c5141398c55 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] validate_networks() for None {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:26:59.554073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-832dbc98-3eca-4fc4-9355-e54d23f9b3a6 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ef84f12c934e9aa1be187f2842b71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ae586965414012b4aeded0508deb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:26:59.577398 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-832dbc98-3eca-4fc4-9355-e54d23f9b3a6 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 200 len: 1316 microversion: 2.1 time: 0.445888 Oct 10 23:26:59.580514 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1315/2600] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:59 2022] GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 1316 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:26:59.595067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-29abc1b2-7373-462d-802a-18968ae99915 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Calling method '.version_select at 0x7f6633b29430>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:59.648893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-9a30bff4-79d8-4059-a90f-4c5141398c55 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:26:59.649938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-9a30bff4-79d8-4059-a90f-4c5141398c55 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:26:59.650732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-9a30bff4-79d8-4059-a90f-4c5141398c55 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:26:59.651244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-9a30bff4-79d8-4059-a90f-4c5141398c55 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:26:59.651644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-9a30bff4-79d8-4059-a90f-4c5141398c55 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:26:59.674060 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-29abc1b2-7373-462d-802a-18968ae99915 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-464099188" status: 204 len: 0 microversion: 2.2 time: 0.091427 Oct 10 23:26:59.676045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a30bff4-79d8-4059-a90f-4c5141398c55 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:59.676575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a30bff4-79d8-4059-a90f-4c5141398c55 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:59.677030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a30bff4-79d8-4059-a90f-4c5141398c55 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:59.678016 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1316/2601] 10.222.0.23 () {60 vars in 1258 bytes} [Mon Oct 10 23:26:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-464099188 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:26:59.681663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a30bff4-79d8-4059-a90f-4c5141398c55 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:59.684389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a30bff4-79d8-4059-a90f-4c5141398c55 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:59.685226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a30bff4-79d8-4059-a90f-4c5141398c55 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:59.690948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0325426e-e994-4711-ad08-d15ae62a4cb1 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:59.694850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0325426e-e994-4711-ad08-d15ae62a4cb1 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:59.764830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0325426e-e994-4711-ad08-d15ae62a4cb1 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:59.765488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0325426e-e994-4711-ad08-d15ae62a4cb1 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:59.766049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0325426e-e994-4711-ad08-d15ae62a4cb1 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:59.766984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0325426e-e994-4711-ad08-d15ae62a4cb1 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:26:59.776273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0325426e-e994-4711-ad08-d15ae62a4cb1 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:26:59.778955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0325426e-e994-4711-ad08-d15ae62a4cb1 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:26:59.799644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-9a30bff4-79d8-4059-a90f-4c5141398c55 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Getting quotas for project 4b2326c88f134b7299d87d1133041421. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:26:59.818253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-9a30bff4-79d8-4059-a90f-4c5141398c55 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Getting quotas for user d536874058b64c6fbb05b3414b6b100c and project 4b2326c88f134b7299d87d1133041421. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:26:59.855667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9a30bff4-79d8-4059-a90f-4c5141398c55 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:26:59.862265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9a30bff4-79d8-4059-a90f-4c5141398c55 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:26:59.967891 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9a30bff4-79d8-4059-a90f-4c5141398c55 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.365032 Oct 10 23:26:59.968836 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1286/2602] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:26:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:26:59.979877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-47201349-af84-45f9-bad7-56fb00f85c2a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:26:59.982793 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-47201349-af84-45f9-bad7-56fb00f85c2a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:26:59.997104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47201349-af84-45f9-bad7-56fb00f85c2a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:00.000243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47201349-af84-45f9-bad7-56fb00f85c2a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:00.002814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47201349-af84-45f9-bad7-56fb00f85c2a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:00.003739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47201349-af84-45f9-bad7-56fb00f85c2a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:00.005104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47201349-af84-45f9-bad7-56fb00f85c2a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:00.006544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47201349-af84-45f9-bad7-56fb00f85c2a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:00.042795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0325426e-e994-4711-ad08-d15ae62a4cb1 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:00.077978 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0325426e-e994-4711-ad08-d15ae62a4cb1 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" status: 200 len: 1276 microversion: 2.1 time: 0.392033 Oct 10 23:27:00.080426 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1317/2603] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:26:59 2022] GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 => generated 1276 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:00.103523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-91269269-963a-4026-b21e-d5b85e6487ec tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Action: 'create', calling method: .version_select at 0x7f6633bb6700>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-766676930", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDt78Shps32NdvYiliVvm+P2ILyWaFs83JbQF1zQTI6tnHIjv0EB1pRdSy0tevZjOZhcywImQijZglNfTpRsuDCOK26XCAAfiIbtK44e4u7uwdRV3eFHUOLOPGeuvJ3pTA=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:00.147419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-91269269-963a-4026-b21e-d5b85e6487ec tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Getting quotas for project e3028b49585d4b069e89de7aff9e9dcd. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:27:00.155851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-91269269-963a-4026-b21e-d5b85e6487ec tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Getting quotas for user b4df569672b744509ed48a44d3d7de45 and project e3028b49585d4b069e89de7aff9e9dcd. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:27:00.162603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:27:00.186164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-47201349-af84-45f9-bad7-56fb00f85c2a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:00.198653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-47201349-af84-45f9-bad7-56fb00f85c2a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:00.207530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-47201349-af84-45f9-bad7-56fb00f85c2a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:00.218640 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-47201349-af84-45f9-bad7-56fb00f85c2a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.245154 Oct 10 23:27:00.222231 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1287/2604] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:26:59 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:27:00.227440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-13e0dca6-dea7-48ac-b99b-4da5edea3f88 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:00.228057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-13e0dca6-dea7-48ac-b99b-4da5edea3f88 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:00.238617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13e0dca6-dea7-48ac-b99b-4da5edea3f88 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:00.239387 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13e0dca6-dea7-48ac-b99b-4da5edea3f88 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:00.240057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13e0dca6-dea7-48ac-b99b-4da5edea3f88 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:00.240969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13e0dca6-dea7-48ac-b99b-4da5edea3f88 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:00.241626 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13e0dca6-dea7-48ac-b99b-4da5edea3f88 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:00.242065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13e0dca6-dea7-48ac-b99b-4da5edea3f88 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:00.276262 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-91269269-963a-4026-b21e-d5b85e6487ec tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.190788 Oct 10 23:27:00.278037 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1318/2605] 10.222.0.23 () {62 vars in 1199 bytes} [Mon Oct 10 23:27:00 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 194 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 10 23:27:00.286520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b0b5f057-9cb9-42cf-9caf-c4286e65fb36 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1434231977", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:00.455882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-b0b5f057-9cb9-42cf-9caf-c4286e65fb36 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] validate_networks() for None {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:27:00.818624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-13e0dca6-dea7-48ac-b99b-4da5edea3f88 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:00.832028 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-13e0dca6-dea7-48ac-b99b-4da5edea3f88 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1314 microversion: 2.1 time: 0.608410 Oct 10 23:27:00.855946 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1288/2606] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:00 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1314 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:00.876268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5067f696-d15f-42c1-bff0-3006552da9b5 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Action: 'create', calling method: .version_select at 0x7f662a8a84c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-249213269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGY1gtChEwDlc6hWOL40xPwJNZ9ZKGaqgw/kesmr8F1Q3AgnvPvxe8r9j/GRUH22/1Z9QHwbbDIDxRbENJRmgmKdd6Miyj+hjbgTaWzSFE02Mk3A2vHJgtiW9dSngaOSoQ=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:00.920487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-5067f696-d15f-42c1-bff0-3006552da9b5 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Getting quotas for project e3028b49585d4b069e89de7aff9e9dcd. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:27:00.938717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-5067f696-d15f-42c1-bff0-3006552da9b5 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Getting quotas for user b4df569672b744509ed48a44d3d7de45 and project e3028b49585d4b069e89de7aff9e9dcd. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:27:00.998008 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5067f696-d15f-42c1-bff0-3006552da9b5 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.136621 Oct 10 23:27:01.014922 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1289/2607] 10.222.0.23 () {62 vars in 1199 bytes} [Mon Oct 10 23:27:00 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 159 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 10 23:27:01.029133 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-fa0acf37-73bc-4def-af31-a8ccf31f1de9 req-8c45df00-6612-4afb-aef1-c694f4076565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b64a0f12-ba9a-4074-9ba0-0911bdab6c0f", "name": "network-vif-plugged", "status": "completed", "tag": "c3888bf2-97db-4f22-afff-a2d9b83792af"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:01.071305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fa0acf37-73bc-4def-af31-a8ccf31f1de9 req-8c45df00-6612-4afb-aef1-c694f4076565 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:01.072930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fa0acf37-73bc-4def-af31-a8ccf31f1de9 req-8c45df00-6612-4afb-aef1-c694f4076565 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:01.073449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fa0acf37-73bc-4def-af31-a8ccf31f1de9 req-8c45df00-6612-4afb-aef1-c694f4076565 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:01.098257 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-fa0acf37-73bc-4def-af31-a8ccf31f1de9 req-8c45df00-6612-4afb-aef1-c694f4076565 service nova] Creating event network-vif-plugged:c3888bf2-97db-4f22-afff-a2d9b83792af for instance b64a0f12-ba9a-4074-9ba0-0911bdab6c0f on n-h2-860864-2 Oct 10 23:27:01.117966 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-fa0acf37-73bc-4def-af31-a8ccf31f1de9 req-8c45df00-6612-4afb-aef1-c694f4076565 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100126 Oct 10 23:27:01.120182 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1290/2608] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:27:01.139549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5a671c32-33d2-4e04-9e46-2ab80ff5fc26 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:01.144204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5a671c32-33d2-4e04-9e46-2ab80ff5fc26 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:01.155437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a671c32-33d2-4e04-9e46-2ab80ff5fc26 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:01.155940 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a671c32-33d2-4e04-9e46-2ab80ff5fc26 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:01.156381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a671c32-33d2-4e04-9e46-2ab80ff5fc26 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:01.160767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a671c32-33d2-4e04-9e46-2ab80ff5fc26 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:01.163214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a671c32-33d2-4e04-9e46-2ab80ff5fc26 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:01.163775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a671c32-33d2-4e04-9e46-2ab80ff5fc26 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:01.757956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-b0b5f057-9cb9-42cf-9caf-c4286e65fb36 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:27:01.758485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-b0b5f057-9cb9-42cf-9caf-c4286e65fb36 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:27:01.758844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-b0b5f057-9cb9-42cf-9caf-c4286e65fb36 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:27:01.759255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-b0b5f057-9cb9-42cf-9caf-c4286e65fb36 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:27:01.760075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-b0b5f057-9cb9-42cf-9caf-c4286e65fb36 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:27:01.777968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0b5f057-9cb9-42cf-9caf-c4286e65fb36 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:01.778538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0b5f057-9cb9-42cf-9caf-c4286e65fb36 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:01.779082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0b5f057-9cb9-42cf-9caf-c4286e65fb36 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:01.780184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0b5f057-9cb9-42cf-9caf-c4286e65fb36 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:01.780655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0b5f057-9cb9-42cf-9caf-c4286e65fb36 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:01.781250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0b5f057-9cb9-42cf-9caf-c4286e65fb36 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:01.803385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5a671c32-33d2-4e04-9e46-2ab80ff5fc26 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ef84f12c934e9aa1be187f2842b71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ae586965414012b4aeded0508deb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:01.828600 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5a671c32-33d2-4e04-9e46-2ab80ff5fc26 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 200 len: 1316 microversion: 2.1 time: 0.703167 Oct 10 23:27:01.836430 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1291/2609] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:01 2022] GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 1316 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:01.840116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-b0b5f057-9cb9-42cf-9caf-c4286e65fb36 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Getting quotas for project 4b2326c88f134b7299d87d1133041421. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:27:01.883359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-03c57220-d422-41c1-81d7-79997c969ac1 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Action: 'create', calling method: .version_select at 0x7f662a8a8a60>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1344952807", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfxEV3jdSSziin1iOpscIB8VhSeqdmEhUW0kpJ+BbdviXSv9NnPlswoUEOSfjNJYM7L9lL8qq0QVGl0rkovHUmnA4BTo7sPZPGxMB/sU53NDlPkhRECViZKEblSK03JhQ=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:01.896171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-b0b5f057-9cb9-42cf-9caf-c4286e65fb36 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Getting quotas for user d536874058b64c6fbb05b3414b6b100c and project 4b2326c88f134b7299d87d1133041421. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:27:01.960798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-03c57220-d422-41c1-81d7-79997c969ac1 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Getting quotas for project e3028b49585d4b069e89de7aff9e9dcd. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:27:01.965037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b0b5f057-9cb9-42cf-9caf-c4286e65fb36 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:27:01.973968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b0b5f057-9cb9-42cf-9caf-c4286e65fb36 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:27:01.984240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-03c57220-d422-41c1-81d7-79997c969ac1 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Getting quotas for user b4df569672b744509ed48a44d3d7de45 and project e3028b49585d4b069e89de7aff9e9dcd. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:27:02.074502 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-03c57220-d422-41c1-81d7-79997c969ac1 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.234652 Oct 10 23:27:02.076632 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1292/2610] 10.222.0.23 () {62 vars in 1199 bytes} [Mon Oct 10 23:27:01 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 239 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 10 23:27:02.087603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f4f55cba-eec0-4b3d-8511-bf0309c21ea2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:02.088520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f4f55cba-eec0-4b3d-8511-bf0309c21ea2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:02.136419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4f55cba-eec0-4b3d-8511-bf0309c21ea2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:02.138785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4f55cba-eec0-4b3d-8511-bf0309c21ea2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:02.139235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4f55cba-eec0-4b3d-8511-bf0309c21ea2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:02.139998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4f55cba-eec0-4b3d-8511-bf0309c21ea2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:02.149314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4f55cba-eec0-4b3d-8511-bf0309c21ea2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:02.150590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4f55cba-eec0-4b3d-8511-bf0309c21ea2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:02.175085 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b0b5f057-9cb9-42cf-9caf-c4286e65fb36 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.894177 Oct 10 23:27:02.179665 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1319/2611] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:27:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:27:02.197412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-68b091a6-98dd-4187-8ad2-a7c618e33a65 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:02.198930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-68b091a6-98dd-4187-8ad2-a7c618e33a65 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:02.212370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68b091a6-98dd-4187-8ad2-a7c618e33a65 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:02.220168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68b091a6-98dd-4187-8ad2-a7c618e33a65 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:02.222282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68b091a6-98dd-4187-8ad2-a7c618e33a65 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:02.226371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68b091a6-98dd-4187-8ad2-a7c618e33a65 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:02.227133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68b091a6-98dd-4187-8ad2-a7c618e33a65 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:02.227753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68b091a6-98dd-4187-8ad2-a7c618e33a65 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:02.478416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-68b091a6-98dd-4187-8ad2-a7c618e33a65 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:02.505188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-68b091a6-98dd-4187-8ad2-a7c618e33a65 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:02.524043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-68b091a6-98dd-4187-8ad2-a7c618e33a65 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:02.539804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f4f55cba-eec0-4b3d-8511-bf0309c21ea2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:02.547984 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-68b091a6-98dd-4187-8ad2-a7c618e33a65 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.366049 Oct 10 23:27:02.554665 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f4f55cba-eec0-4b3d-8511-bf0309c21ea2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" status: 200 len: 1282 microversion: 2.1 time: 0.476589 Oct 10 23:27:02.555399 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1293/2612] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:02 2022] GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 => generated 1282 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:02.558037 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1320/2613] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:27:02 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:27:02.568090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-71062900-59ef-42c1-9695-68bca9161fcf tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:02.568721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-701c03ff-95b5-4e15-9efd-3fb2f9b88084 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Calling method '.version_select at 0x7f6633b293a0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:02.573203 n-d-860864-2 devstack@n-api.service[120613]: WARNING oslo_db.sqlalchemy.utils [None req-701c03ff-95b5-4e15-9efd-3fb2f9b88084 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 10 23:27:02.581714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-71062900-59ef-42c1-9695-68bca9161fcf tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:02.603711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71062900-59ef-42c1-9695-68bca9161fcf tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:02.607059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71062900-59ef-42c1-9695-68bca9161fcf tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:02.608015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71062900-59ef-42c1-9695-68bca9161fcf tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:02.609302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71062900-59ef-42c1-9695-68bca9161fcf tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:02.615867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71062900-59ef-42c1-9695-68bca9161fcf tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:02.615979 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-701c03ff-95b5-4e15-9efd-3fb2f9b88084 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.055480 Oct 10 23:27:02.616488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71062900-59ef-42c1-9695-68bca9161fcf tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:02.616798 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1321/2614] 10.222.0.23 () {60 vars in 1177 bytes} [Mon Oct 10 23:27:02 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:02.624616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:27:02.633643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-09a19db5-2e10-4c47-b358-3ba7b41a7929 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:02.646643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-09a19db5-2e10-4c47-b358-3ba7b41a7929 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:02.917166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-09a19db5-2e10-4c47-b358-3ba7b41a7929 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:02.930686 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-09a19db5-2e10-4c47-b358-3ba7b41a7929 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee" status: 200 len: 1214 microversion: 2.1 time: 0.312730 Oct 10 23:27:02.933661 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1322/2615] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:02 2022] GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee => generated 1214 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:02.939405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-41cd8772-dda2-49a3-8a19-c7535ebb1a44 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Calling method '.version_select at 0x7f6633b10700>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:03.006765 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-41cd8772-dda2-49a3-8a19-c7535ebb1a44 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1344952807" status: 204 len: 0 microversion: 2.2 time: 0.071702 Oct 10 23:27:03.009964 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1323/2616] 10.222.0.23 () {60 vars in 1321 bytes} [Mon Oct 10 23:27:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1344952807 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:27:03.026035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6ecab084-a960-498b-ad44-108d922157d1 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:03.033016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6ecab084-a960-498b-ad44-108d922157d1 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:03.050669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ecab084-a960-498b-ad44-108d922157d1 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:03.061753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ecab084-a960-498b-ad44-108d922157d1 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:03.064097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ecab084-a960-498b-ad44-108d922157d1 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:03.066939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ecab084-a960-498b-ad44-108d922157d1 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:03.070779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ecab084-a960-498b-ad44-108d922157d1 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:03.072122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ecab084-a960-498b-ad44-108d922157d1 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:03.448018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-71062900-59ef-42c1-9695-68bca9161fcf tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:03.464596 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-71062900-59ef-42c1-9695-68bca9161fcf tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1314 microversion: 2.1 time: 0.904824 Oct 10 23:27:03.465981 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1294/2617] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:02 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1314 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:03.476666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3c4a1799-978d-4280-b907-a321e713a1bb tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Calling method '.version_select at 0x7f662a69a550>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:03.525179 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3c4a1799-978d-4280-b907-a321e713a1bb tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-249213269" status: 204 len: 0 microversion: 2.2 time: 0.057625 Oct 10 23:27:03.526044 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1295/2618] 10.222.0.23 () {60 vars in 1318 bytes} [Mon Oct 10 23:27:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-249213269 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:27:03.533393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-81ed8eda-ddbb-49d2-9fba-155d43827533 req-16356b24-d038-49b7-a1e6-a377496e0ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6fbaa2c-2c0f-490a-974e-43b899dcc5bc", "name": "network-vif-plugged", "status": "completed", "tag": "7e626df1-9936-4b1c-b65c-f8e10f3d2223"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:03.550311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-81ed8eda-ddbb-49d2-9fba-155d43827533 req-16356b24-d038-49b7-a1e6-a377496e0ac1 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:03.551376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-81ed8eda-ddbb-49d2-9fba-155d43827533 req-16356b24-d038-49b7-a1e6-a377496e0ac1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:03.552291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-81ed8eda-ddbb-49d2-9fba-155d43827533 req-16356b24-d038-49b7-a1e6-a377496e0ac1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:03.590436 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-81ed8eda-ddbb-49d2-9fba-155d43827533 req-16356b24-d038-49b7-a1e6-a377496e0ac1 service nova] Creating event network-vif-plugged:7e626df1-9936-4b1c-b65c-f8e10f3d2223 for instance f6fbaa2c-2c0f-490a-974e-43b899dcc5bc on n-h2-860864-2 Oct 10 23:27:03.605965 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-81ed8eda-ddbb-49d2-9fba-155d43827533 req-16356b24-d038-49b7-a1e6-a377496e0ac1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078631 Oct 10 23:27:03.607969 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1296/2619] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:27:03.620929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6ecab084-a960-498b-ad44-108d922157d1 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ef84f12c934e9aa1be187f2842b71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ae586965414012b4aeded0508deb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:03.631031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-43f36463-431b-4d7e-84ed-aedf0e403475 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Calling method '.version_select at 0x7f662a8b8a60>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:03.635322 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6ecab084-a960-498b-ad44-108d922157d1 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 200 len: 1316 microversion: 2.1 time: 0.619265 Oct 10 23:27:03.636814 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1324/2620] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:03 2022] GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 1316 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:03.643319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-150b208d-79f8-4e44-b482-68d0a31a16b9 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:03.650415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-150b208d-79f8-4e44-b482-68d0a31a16b9 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:03.673712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-150b208d-79f8-4e44-b482-68d0a31a16b9 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:03.678484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-150b208d-79f8-4e44-b482-68d0a31a16b9 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:03.681133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-150b208d-79f8-4e44-b482-68d0a31a16b9 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:03.682892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-150b208d-79f8-4e44-b482-68d0a31a16b9 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:03.686802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-150b208d-79f8-4e44-b482-68d0a31a16b9 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:03.691896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-150b208d-79f8-4e44-b482-68d0a31a16b9 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:03.692921 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-43f36463-431b-4d7e-84ed-aedf0e403475 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-766676930" status: 204 len: 0 microversion: 2.2 time: 0.081306 Oct 10 23:27:03.695016 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1297/2621] 10.222.0.23 () {60 vars in 1318 bytes} [Mon Oct 10 23:27:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-766676930 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:27:03.711061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-db9b0c23-2c80-4ada-8590-50732602a193 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:03.714543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-db9b0c23-2c80-4ada-8590-50732602a193 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:03.729952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db9b0c23-2c80-4ada-8590-50732602a193 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:03.731051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db9b0c23-2c80-4ada-8590-50732602a193 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:03.731729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db9b0c23-2c80-4ada-8590-50732602a193 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:03.732614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db9b0c23-2c80-4ada-8590-50732602a193 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:03.733243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db9b0c23-2c80-4ada-8590-50732602a193 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:03.733960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db9b0c23-2c80-4ada-8590-50732602a193 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:03.863894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-150b208d-79f8-4e44-b482-68d0a31a16b9 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:03.882537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-150b208d-79f8-4e44-b482-68d0a31a16b9 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:03.889188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-150b208d-79f8-4e44-b482-68d0a31a16b9 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:03.908170 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-150b208d-79f8-4e44-b482-68d0a31a16b9 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.268010 Oct 10 23:27:03.911256 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1325/2622] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:27:03 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:27:03.918046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8d73c87c-3066-4871-8efb-aedafcc7529f tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Action: 'create', calling method: .version_select at 0x7f6633b92550>, body: {"keypair": {"name": "tempest-keypair-1906647385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8+qWSwyNdLvUomFepPGrUpqP0ncEoStWc1KYpSu/GvMjQ85yYJHMHxx5oL9VRPPy6vMryCkV+23SzbUmIymrPSDvMQ7CrSesOtG6QjYS/K2IJ9y1oLex71ZAnMyGwKZA=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:03.972562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-8d73c87c-3066-4871-8efb-aedafcc7529f tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Getting quotas for project e3028b49585d4b069e89de7aff9e9dcd. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:27:03.978171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-8d73c87c-3066-4871-8efb-aedafcc7529f tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Getting quotas for user b4df569672b744509ed48a44d3d7de45 and project e3028b49585d4b069e89de7aff9e9dcd. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:27:04.009738 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8d73c87c-3066-4871-8efb-aedafcc7529f tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.096008 Oct 10 23:27:04.012312 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1326/2623] 10.222.0.23 () {62 vars in 1199 bytes} [Mon Oct 10 23:27:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 100 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 10 23:27:04.023689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a6f05962-2896-4d01-abb5-b037d592c896 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:04.024838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a6f05962-2896-4d01-abb5-b037d592c896 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:04.042437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6f05962-2896-4d01-abb5-b037d592c896 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:04.044041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6f05962-2896-4d01-abb5-b037d592c896 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:04.045508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6f05962-2896-4d01-abb5-b037d592c896 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:04.049001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6f05962-2896-4d01-abb5-b037d592c896 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:04.049752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6f05962-2896-4d01-abb5-b037d592c896 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:04.051872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6f05962-2896-4d01-abb5-b037d592c896 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:04.187668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a6f05962-2896-4d01-abb5-b037d592c896 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:04.202490 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a6f05962-2896-4d01-abb5-b037d592c896 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee" status: 200 len: 1210 microversion: 2.1 time: 0.188766 Oct 10 23:27:04.204080 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1327/2624] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:04 2022] GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee => generated 1210 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:04.211117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fe15adbe-918c-48b8-8fa5-7ea5e5703194 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-664013160", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e315d2cb-5853-42b6-8fd0-af46b9966171"}], "security_groups": [{"name": "tempest-securitygroup--882233609"}], "key_name": "tempest-keypair-705951817", "user_data": "}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:04.386172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-db9b0c23-2c80-4ada-8590-50732602a193 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:04.395129 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-db9b0c23-2c80-4ada-8590-50732602a193 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" status: 200 len: 1324 microversion: 2.1 time: 0.698579 Oct 10 23:27:04.398985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-fe15adbe-918c-48b8-8fa5-7ea5e5703194 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] validate_networks() for [('e315d2cb-5853-42b6-8fd0-af46b9966171', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:27:04.417342 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1298/2625] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:03 2022] GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 => generated 1324 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:04.423188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6d0de73b-9105-46b2-ae26-ad58c25bdd9a tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Calling method '.version_select at 0x7f662a81eaf0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:04.451472 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6d0de73b-9105-46b2-ae26-ad58c25bdd9a tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1906647385" status: 200 len: 513 microversion: 2.2 time: 0.032558 Oct 10 23:27:04.452413 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1299/2626] 10.222.0.23 () {60 vars in 1258 bytes} [Mon Oct 10 23:27:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1906647385 => generated 513 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:27:04.464605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-769d97a0-8b29-4597-8d14-49182457eab8 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Calling method '.version_select at 0x7f662a8b8820>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:04.469032 n-d-860864-2 devstack@n-api.service[120614]: WARNING oslo_db.sqlalchemy.utils [None req-769d97a0-8b29-4597-8d14-49182457eab8 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 10 23:27:04.485095 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-769d97a0-8b29-4597-8d14-49182457eab8 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.024313 Oct 10 23:27:04.485740 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1300/2627] 10.222.0.23 () {60 vars in 1177 bytes} [Mon Oct 10 23:27:04 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:27:04.494481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b616027c-26d2-482d-84d0-a6f2d71fcf7f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:04.498152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b616027c-26d2-482d-84d0-a6f2d71fcf7f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:04.502002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:27:04.518067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b616027c-26d2-482d-84d0-a6f2d71fcf7f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:04.518619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b616027c-26d2-482d-84d0-a6f2d71fcf7f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:04.519004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b616027c-26d2-482d-84d0-a6f2d71fcf7f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:04.522427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b616027c-26d2-482d-84d0-a6f2d71fcf7f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:04.523104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b616027c-26d2-482d-84d0-a6f2d71fcf7f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:04.530063 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b616027c-26d2-482d-84d0-a6f2d71fcf7f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:04.834352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b616027c-26d2-482d-84d0-a6f2d71fcf7f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:04.842745 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b616027c-26d2-482d-84d0-a6f2d71fcf7f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1314 microversion: 2.1 time: 0.352080 Oct 10 23:27:04.852896 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1301/2628] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:04 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:27:04.858081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1084e10c-ea50-441e-9ee2-899aad15bdd3 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Calling method '.version_select at 0x7f662a7e7ca0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:04.894824 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1084e10c-ea50-441e-9ee2-899aad15bdd3 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906647385" status: 204 len: 0 microversion: 2.2 time: 0.040430 Oct 10 23:27:04.895679 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1302/2629] 10.222.0.23 () {60 vars in 1261 bytes} [Mon Oct 10 23:27:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906647385 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:27:04.902749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3f71d7ce-6847-4931-82f4-fbc77a1cbdca tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:04.906153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3f71d7ce-6847-4931-82f4-fbc77a1cbdca tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:04.920158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f71d7ce-6847-4931-82f4-fbc77a1cbdca tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:04.925808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f71d7ce-6847-4931-82f4-fbc77a1cbdca tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:04.926496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f71d7ce-6847-4931-82f4-fbc77a1cbdca tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:04.927400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f71d7ce-6847-4931-82f4-fbc77a1cbdca tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:04.928014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f71d7ce-6847-4931-82f4-fbc77a1cbdca tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:04.928605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f71d7ce-6847-4931-82f4-fbc77a1cbdca tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:05.052388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-fe15adbe-918c-48b8-8fa5-7ea5e5703194 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:27:05.052958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-fe15adbe-918c-48b8-8fa5-7ea5e5703194 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:27:05.053743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-fe15adbe-918c-48b8-8fa5-7ea5e5703194 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:27:05.054423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-fe15adbe-918c-48b8-8fa5-7ea5e5703194 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:27:05.055251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-fe15adbe-918c-48b8-8fa5-7ea5e5703194 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:27:05.072028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe15adbe-918c-48b8-8fa5-7ea5e5703194 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:05.072925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe15adbe-918c-48b8-8fa5-7ea5e5703194 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:05.073783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe15adbe-918c-48b8-8fa5-7ea5e5703194 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:05.074777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe15adbe-918c-48b8-8fa5-7ea5e5703194 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:05.075477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe15adbe-918c-48b8-8fa5-7ea5e5703194 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:05.076156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe15adbe-918c-48b8-8fa5-7ea5e5703194 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:05.121851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-fe15adbe-918c-48b8-8fa5-7ea5e5703194 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Getting quotas for project 6e7609ed88094dd083202e42b058ffd5. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:27:05.128956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-fe15adbe-918c-48b8-8fa5-7ea5e5703194 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Getting quotas for user f9e8299b29f044b0ab99b74346bf4870 and project 6e7609ed88094dd083202e42b058ffd5. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:27:05.147023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fe15adbe-918c-48b8-8fa5-7ea5e5703194 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:27:05.149675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fe15adbe-918c-48b8-8fa5-7ea5e5703194 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:27:05.208370 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fe15adbe-918c-48b8-8fa5-7ea5e5703194 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.001029 Oct 10 23:27:05.209698 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1328/2630] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:27:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:27:05.222522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-08d35566-581e-4ad1-82e0-45efb70e82c9 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Action: 'create', calling method: .version_select at 0x7f6633b274c0>, body: {"keypair": {"name": "tempest-keypair-1063936384", "type": "x509"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:05.261079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-08d35566-581e-4ad1-82e0-45efb70e82c9 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Getting quotas for project e3028b49585d4b069e89de7aff9e9dcd. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:27:05.274801 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-08d35566-581e-4ad1-82e0-45efb70e82c9 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Getting quotas for user b4df569672b744509ed48a44d3d7de45 and project e3028b49585d4b069e89de7aff9e9dcd. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:27:05.324725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.processutils [None req-08d35566-581e-4ad1-82e0-45efb70e82c9 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp496ar4k6/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp496ar4k6/temp.key -subj /CN=b4df569672b744509ed48a44d3d7de45 -extensions v3_req_client {{(pid=120613) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 10 23:27:05.610367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.processutils [None req-08d35566-581e-4ad1-82e0-45efb70e82c9 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp496ar4k6/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp496ar4k6/temp.key -subj /CN=b4df569672b744509ed48a44d3d7de45 -extensions v3_req_client" returned: 0 in 0.285s {{(pid=120613) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 10 23:27:05.612546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.processutils [None req-08d35566-581e-4ad1-82e0-45efb70e82c9 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp496ar4k6/temp.key -password pass: {{(pid=120613) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 10 23:27:05.707535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.processutils [None req-08d35566-581e-4ad1-82e0-45efb70e82c9 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp496ar4k6/temp.key -password pass:" returned: 0 in 0.094s {{(pid=120613) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 10 23:27:05.748751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3f71d7ce-6847-4931-82f4-fbc77a1cbdca tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ef84f12c934e9aa1be187f2842b71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ae586965414012b4aeded0508deb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:05.773781 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3f71d7ce-6847-4931-82f4-fbc77a1cbdca tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 200 len: 1466 microversion: 2.1 time: 0.871490 Oct 10 23:27:05.777699 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1303/2631] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:04 2022] GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 1466 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:05.810476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-06bea7f4-a263-4f9d-af30-c26281017bed tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:05.825814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-06bea7f4-a263-4f9d-af30-c26281017bed tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:05.853126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-08d35566-581e-4ad1-82e0-45efb70e82c9 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Getting quotas for project e3028b49585d4b069e89de7aff9e9dcd. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:27:05.863332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06bea7f4-a263-4f9d-af30-c26281017bed tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:05.866813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06bea7f4-a263-4f9d-af30-c26281017bed tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:05.868186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06bea7f4-a263-4f9d-af30-c26281017bed tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:05.870368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06bea7f4-a263-4f9d-af30-c26281017bed tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:05.876883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06bea7f4-a263-4f9d-af30-c26281017bed tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:05.877828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06bea7f4-a263-4f9d-af30-c26281017bed tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:05.878823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-08d35566-581e-4ad1-82e0-45efb70e82c9 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Getting quotas for user b4df569672b744509ed48a44d3d7de45 and project e3028b49585d4b069e89de7aff9e9dcd. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:27:05.950578 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-08d35566-581e-4ad1-82e0-45efb70e82c9 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.739424 Oct 10 23:27:05.952494 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1329/2632] 10.222.0.23 () {62 vars in 1198 bytes} [Mon Oct 10 23:27:05 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 742 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:27:05.970939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0572f39e-0512-42d7-8fcb-e1cc8590858e tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:05.973076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0572f39e-0512-42d7-8fcb-e1cc8590858e tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:06.128041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0572f39e-0512-42d7-8fcb-e1cc8590858e tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:06.148284 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0572f39e-0512-42d7-8fcb-e1cc8590858e tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379" status: 200 len: 1236 microversion: 2.1 time: 0.191015 Oct 10 23:27:06.153551 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1330/2633] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:05 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 => generated 1236 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:06.186538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ded63ed1-5d92-43af-8121-4157531a8c66 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:06.196757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ded63ed1-5d92-43af-8121-4157531a8c66 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:06.237265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:27:06.245033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ded63ed1-5d92-43af-8121-4157531a8c66 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:06.245647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ded63ed1-5d92-43af-8121-4157531a8c66 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:06.246115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ded63ed1-5d92-43af-8121-4157531a8c66 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:06.247271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ded63ed1-5d92-43af-8121-4157531a8c66 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:06.247746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ded63ed1-5d92-43af-8121-4157531a8c66 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:06.248261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ded63ed1-5d92-43af-8121-4157531a8c66 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:06.423059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ded63ed1-5d92-43af-8121-4157531a8c66 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:06.433012 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ded63ed1-5d92-43af-8121-4157531a8c66 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee" status: 200 len: 1284 microversion: 2.1 time: 0.272865 Oct 10 23:27:06.434309 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1331/2634] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:06 2022] GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee => generated 1284 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:06.440425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8fafc26b-7b48-401c-bcf2-d48e15746987 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:06.441878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8fafc26b-7b48-401c-bcf2-d48e15746987 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:06.455409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8fafc26b-7b48-401c-bcf2-d48e15746987 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:06.459635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8fafc26b-7b48-401c-bcf2-d48e15746987 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:06.460501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8fafc26b-7b48-401c-bcf2-d48e15746987 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:06.462814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8fafc26b-7b48-401c-bcf2-d48e15746987 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:06.464068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8fafc26b-7b48-401c-bcf2-d48e15746987 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:06.468454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8fafc26b-7b48-401c-bcf2-d48e15746987 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:06.513801 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:27:06.846220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8fafc26b-7b48-401c-bcf2-d48e15746987 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:06.855344 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8fafc26b-7b48-401c-bcf2-d48e15746987 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" status: 200 len: 1324 microversion: 2.1 time: 0.419758 Oct 10 23:27:06.856850 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1332/2635] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:06 2022] GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 => generated 1324 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:06.873353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fef3243b-6aa9-4a66-b170-0add95a645f6 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-440964157", "metadata": {"image_type": "test"}}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:06.879643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fef3243b-6aa9-4a66-b170-0add95a645f6 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:06.899772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fef3243b-6aa9-4a66-b170-0add95a645f6 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:06.907878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fef3243b-6aa9-4a66-b170-0add95a645f6 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:06.908746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fef3243b-6aa9-4a66-b170-0add95a645f6 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:06.909705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fef3243b-6aa9-4a66-b170-0add95a645f6 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:06.910333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fef3243b-6aa9-4a66-b170-0add95a645f6 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:06.910915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fef3243b-6aa9-4a66-b170-0add95a645f6 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:07.017285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-fef3243b-6aa9-4a66-b170-0add95a645f6 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Getting quotas for project c4ae586965414012b4aeded0508deb4e. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:27:07.024217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-fef3243b-6aa9-4a66-b170-0add95a645f6 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Getting quotas for user 80ef84f12c934e9aa1be187f2842b71f and project c4ae586965414012b4aeded0508deb4e. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:27:07.084258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-06bea7f4-a263-4f9d-af30-c26281017bed tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:07.106620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-06bea7f4-a263-4f9d-af30-c26281017bed tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:07.116320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-06bea7f4-a263-4f9d-af30-c26281017bed tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:07.135207 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-06bea7f4-a263-4f9d-af30-c26281017bed tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 1.350335 Oct 10 23:27:07.137881 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1304/2636] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:27:05 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:27:07.185306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6532090d-8152-4998-baab-2a1996233957 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:07.186554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6532090d-8152-4998-baab-2a1996233957 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:07.194352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6532090d-8152-4998-baab-2a1996233957 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:07.195864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6532090d-8152-4998-baab-2a1996233957 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:07.196540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6532090d-8152-4998-baab-2a1996233957 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:07.198304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6532090d-8152-4998-baab-2a1996233957 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:07.199413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6532090d-8152-4998-baab-2a1996233957 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:07.200505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6532090d-8152-4998-baab-2a1996233957 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:07.439043 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fef3243b-6aa9-4a66-b170-0add95a645f6 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "POST /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f/action" status: 202 len: 0 microversion: 2.1 time: 0.580663 Oct 10 23:27:07.447062 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1333/2637] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:27:06 2022] POST /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 23:27:07.470898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9bf4232a-76b4-41cd-a93a-f8d3e8b88dd1 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Calling method '.version_select at 0x7f6633af5d30>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:07.494521 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9bf4232a-76b4-41cd-a93a-f8d3e8b88dd1 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1063936384" status: 200 len: 1534 microversion: 2.2 time: 0.042284 Oct 10 23:27:07.507940 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1334/2638] 10.222.0.23 () {60 vars in 1258 bytes} [Mon Oct 10 23:27:07 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1063936384 => generated 1534 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:07.521505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c240df79-8864-4447-b2ec-ad78bf664708 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:07.523433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c240df79-8864-4447-b2ec-ad78bf664708 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:07.538617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c240df79-8864-4447-b2ec-ad78bf664708 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:07.539551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c240df79-8864-4447-b2ec-ad78bf664708 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:07.540803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c240df79-8864-4447-b2ec-ad78bf664708 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:07.543579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c240df79-8864-4447-b2ec-ad78bf664708 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:07.544339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c240df79-8864-4447-b2ec-ad78bf664708 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:07.546294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c240df79-8864-4447-b2ec-ad78bf664708 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:07.701822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c240df79-8864-4447-b2ec-ad78bf664708 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:07.710733 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c240df79-8864-4447-b2ec-ad78bf664708 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379" status: 200 len: 1296 microversion: 2.1 time: 0.201274 Oct 10 23:27:07.715468 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1335/2639] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:07 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 => generated 1296 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:07.744715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-738affd8-76d3-4ea7-be65-13d6f0c26e8e tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f6633af5dc0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:07.834580 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-738affd8-76d3-4ea7-be65-13d6f0c26e8e tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 200 len: 1423 microversion: 2.1 time: 0.100596 Oct 10 23:27:07.835612 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1336/2640] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:07 2022] GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 1423 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:07.842113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9e4e3c13-4594-4261-8f64-895862403307 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:07.852421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9e4e3c13-4594-4261-8f64-895862403307 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:07.882186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e4e3c13-4594-4261-8f64-895862403307 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:07.883455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e4e3c13-4594-4261-8f64-895862403307 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:07.883910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e4e3c13-4594-4261-8f64-895862403307 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:07.884652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e4e3c13-4594-4261-8f64-895862403307 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:07.885113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e4e3c13-4594-4261-8f64-895862403307 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:07.889408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e4e3c13-4594-4261-8f64-895862403307 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:08.099034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9e4e3c13-4594-4261-8f64-895862403307 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:08.121313 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9e4e3c13-4594-4261-8f64-895862403307 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee" status: 200 len: 1272 microversion: 2.1 time: 0.283425 Oct 10 23:27:08.121985 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1337/2641] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:07 2022] GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee => generated 1272 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:08.146486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6532090d-8152-4998-baab-2a1996233957 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:08.159404 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6532090d-8152-4998-baab-2a1996233957 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1499 microversion: 2.1 time: 0.981215 Oct 10 23:27:08.160041 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1305/2642] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:07 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1499 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:08.173519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b8a843f1-5453-4069-9614-26e508b5ae58 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:08.173772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8106127a-f987-482e-9321-0689b128a1b6 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Calling method '.version_select at 0x7f6633b29040>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:08.185972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b8a843f1-5453-4069-9614-26e508b5ae58 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:08.189888 n-d-860864-2 devstack@n-api.service[120613]: WARNING oslo_db.sqlalchemy.utils [None req-8106127a-f987-482e-9321-0689b128a1b6 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 10 23:27:08.197882 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8106127a-f987-482e-9321-0689b128a1b6 tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.055897 Oct 10 23:27:08.204671 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1338/2643] 10.222.0.23 () {60 vars in 1177 bytes} [Mon Oct 10 23:27:08 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:08.205102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8a843f1-5453-4069-9614-26e508b5ae58 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:08.206838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-170b4864-b1f8-40e6-8b21-bad51fca48f3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:08.207604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-170b4864-b1f8-40e6-8b21-bad51fca48f3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:08.210164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8a843f1-5453-4069-9614-26e508b5ae58 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:08.210534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8a843f1-5453-4069-9614-26e508b5ae58 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:08.212898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8a843f1-5453-4069-9614-26e508b5ae58 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:08.214740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8a843f1-5453-4069-9614-26e508b5ae58 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:08.215365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8a843f1-5453-4069-9614-26e508b5ae58 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:08.216556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-170b4864-b1f8-40e6-8b21-bad51fca48f3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:08.217276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-170b4864-b1f8-40e6-8b21-bad51fca48f3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:08.217761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-170b4864-b1f8-40e6-8b21-bad51fca48f3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:08.218581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-170b4864-b1f8-40e6-8b21-bad51fca48f3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:08.219058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-170b4864-b1f8-40e6-8b21-bad51fca48f3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:08.226552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-170b4864-b1f8-40e6-8b21-bad51fca48f3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:08.385550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-170b4864-b1f8-40e6-8b21-bad51fca48f3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:08.396262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-170b4864-b1f8-40e6-8b21-bad51fca48f3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:08.401127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-170b4864-b1f8-40e6-8b21-bad51fca48f3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:08.419086 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-170b4864-b1f8-40e6-8b21-bad51fca48f3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.212862 Oct 10 23:27:08.419658 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1339/2644] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:27:08 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:27:08.437659 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b89aa1f7-29e8-4b3c-9c61-98afca126890 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:08.440253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b89aa1f7-29e8-4b3c-9c61-98afca126890 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:08.446752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b89aa1f7-29e8-4b3c-9c61-98afca126890 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:08.448194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b89aa1f7-29e8-4b3c-9c61-98afca126890 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:08.450459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b89aa1f7-29e8-4b3c-9c61-98afca126890 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:08.451292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b89aa1f7-29e8-4b3c-9c61-98afca126890 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:08.462051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b89aa1f7-29e8-4b3c-9c61-98afca126890 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:08.462696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b89aa1f7-29e8-4b3c-9c61-98afca126890 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:08.503854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-b89aa1f7-29e8-4b3c-9c61-98afca126890 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lazy-loading 'flavor' on Instance uuid f6fbaa2c-2c0f-490a-974e-43b899dcc5bc {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:27:08.635018 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b89aa1f7-29e8-4b3c-9c61-98afca126890 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "POST /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc/action" status: 200 len: 32 microversion: 2.1 time: 0.213214 Oct 10 23:27:08.644287 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1340/2645] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:27:08 2022] POST /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc/action => generated 32 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:27:08.659954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f48ff551-f740-488c-bcc4-5f160f30adbe tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] Calling method '.version_select at 0x7f6633b29670>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:08.739206 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f48ff551-f740-488c-bcc4-5f160f30adbe tempest-KeyPairsV22TestJSON-91296348 tempest-KeyPairsV22TestJSON-91296348-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1063936384" status: 204 len: 0 microversion: 2.2 time: 0.093186 Oct 10 23:27:08.741953 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1341/2646] 10.222.0.23 () {60 vars in 1261 bytes} [Mon Oct 10 23:27:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1063936384 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:27:08.757991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-1155cc05-3794-4394-bd79-5e6952254e1e req-ae476cc7-46e5-4d5a-ba80-16ea185ab3ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e94f4a-d35f-4d5f-abf3-4366dea38dd5", "tag": "cf591354-4fda-40dc-8468-a4548f51eeb1"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:08.816720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1155cc05-3794-4394-bd79-5e6952254e1e req-ae476cc7-46e5-4d5a-ba80-16ea185ab3ca service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:08.821320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1155cc05-3794-4394-bd79-5e6952254e1e req-ae476cc7-46e5-4d5a-ba80-16ea185ab3ca service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:08.821931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1155cc05-3794-4394-bd79-5e6952254e1e req-ae476cc7-46e5-4d5a-ba80-16ea185ab3ca service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:08.872085 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-1155cc05-3794-4394-bd79-5e6952254e1e req-ae476cc7-46e5-4d5a-ba80-16ea185ab3ca service nova] Creating event network-changed:cf591354-4fda-40dc-8468-a4548f51eeb1 for instance f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 on n-h1-860864-2 Oct 10 23:27:08.879811 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-1155cc05-3794-4394-bd79-5e6952254e1e req-ae476cc7-46e5-4d5a-ba80-16ea185ab3ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136154 Oct 10 23:27:08.881119 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1342/2647] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:27:08.886582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-91a39350-8e28-4e31-85b2-8e1a8a8c8c53 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:08.887899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-91a39350-8e28-4e31-85b2-8e1a8a8c8c53 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:08.896040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91a39350-8e28-4e31-85b2-8e1a8a8c8c53 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:08.896687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91a39350-8e28-4e31-85b2-8e1a8a8c8c53 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:08.897313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91a39350-8e28-4e31-85b2-8e1a8a8c8c53 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:08.898159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91a39350-8e28-4e31-85b2-8e1a8a8c8c53 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:08.898729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91a39350-8e28-4e31-85b2-8e1a8a8c8c53 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:08.900994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91a39350-8e28-4e31-85b2-8e1a8a8c8c53 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:09.410336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b8a843f1-5453-4069-9614-26e508b5ae58 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:09.425452 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b8a843f1-5453-4069-9614-26e508b5ae58 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" status: 200 len: 1324 microversion: 2.1 time: 1.264055 Oct 10 23:27:09.427348 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1306/2648] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:08 2022] GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 => generated 1324 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:09.436893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8b1e70a3-9c38-4684-93b0-bde8641d17e5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:09.441270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8b1e70a3-9c38-4684-93b0-bde8641d17e5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:09.456569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b1e70a3-9c38-4684-93b0-bde8641d17e5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:09.457962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b1e70a3-9c38-4684-93b0-bde8641d17e5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:09.460701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b1e70a3-9c38-4684-93b0-bde8641d17e5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:09.461836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b1e70a3-9c38-4684-93b0-bde8641d17e5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:09.464120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b1e70a3-9c38-4684-93b0-bde8641d17e5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:09.464937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b1e70a3-9c38-4684-93b0-bde8641d17e5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:09.665042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8b1e70a3-9c38-4684-93b0-bde8641d17e5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:09.679628 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8b1e70a3-9c38-4684-93b0-bde8641d17e5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379" status: 200 len: 1294 microversion: 2.1 time: 0.250922 Oct 10 23:27:09.681067 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1307/2649] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:09 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 => generated 1294 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:09.697664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-113b4bbb-4a21-4486-8fdc-dd8cb25d4d01 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662a89e040>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:09.748096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-91a39350-8e28-4e31-85b2-8e1a8a8c8c53 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:09.749337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:27:09.757817 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-91a39350-8e28-4e31-85b2-8e1a8a8c8c53 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1505 microversion: 2.1 time: 0.875298 Oct 10 23:27:09.778899 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1343/2650] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:08 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1505 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:09.801530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-886ab369-39c6-403d-9a50-b468ce48449b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:09.802199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-886ab369-39c6-403d-9a50-b468ce48449b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:09.807346 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-113b4bbb-4a21-4486-8fdc-dd8cb25d4d01 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 200 len: 1423 microversion: 2.1 time: 0.124863 Oct 10 23:27:09.808228 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1308/2651] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:09 2022] GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 1423 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:09.824067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-886ab369-39c6-403d-9a50-b468ce48449b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:09.824067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-886ab369-39c6-403d-9a50-b468ce48449b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:09.824427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bd6abab0-42b1-4e0f-8040-2d7632ac9610 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:09.824538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-886ab369-39c6-403d-9a50-b468ce48449b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:09.824623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bd6abab0-42b1-4e0f-8040-2d7632ac9610 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:09.824704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-886ab369-39c6-403d-9a50-b468ce48449b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:09.824704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-886ab369-39c6-403d-9a50-b468ce48449b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:09.824704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-886ab369-39c6-403d-9a50-b468ce48449b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:09.832952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd6abab0-42b1-4e0f-8040-2d7632ac9610 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:09.840640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd6abab0-42b1-4e0f-8040-2d7632ac9610 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:09.841141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd6abab0-42b1-4e0f-8040-2d7632ac9610 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:09.841936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd6abab0-42b1-4e0f-8040-2d7632ac9610 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:09.842457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd6abab0-42b1-4e0f-8040-2d7632ac9610 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:09.842848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd6abab0-42b1-4e0f-8040-2d7632ac9610 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:10.094436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-886ab369-39c6-403d-9a50-b468ce48449b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:10.103285 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-886ab369-39c6-403d-9a50-b468ce48449b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee" status: 200 len: 1272 microversion: 2.1 time: 0.323121 Oct 10 23:27:10.116435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bd6abab0-42b1-4e0f-8040-2d7632ac9610 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:10.119338 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1344/2652] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:09 2022] GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee => generated 1272 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:10.128799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bd6abab0-42b1-4e0f-8040-2d7632ac9610 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:10.130935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bd6abab0-42b1-4e0f-8040-2d7632ac9610 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:10.137043 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bd6abab0-42b1-4e0f-8040-2d7632ac9610 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.327433 Oct 10 23:27:10.151669 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1309/2653] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:27:09 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:27:10.448339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e3095e67-5465-47df-b420-cfb82f123f1a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:10.448969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e3095e67-5465-47df-b420-cfb82f123f1a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:10.455822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3095e67-5465-47df-b420-cfb82f123f1a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:10.456525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3095e67-5465-47df-b420-cfb82f123f1a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:10.457152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3095e67-5465-47df-b420-cfb82f123f1a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:10.458062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3095e67-5465-47df-b420-cfb82f123f1a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:10.458747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3095e67-5465-47df-b420-cfb82f123f1a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:10.459394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3095e67-5465-47df-b420-cfb82f123f1a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:10.707671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e2967133-65ab-4064-87b5-bca433a2dce8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:10.708206 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e2967133-65ab-4064-87b5-bca433a2dce8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:10.720611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e2967133-65ab-4064-87b5-bca433a2dce8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:10.721423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e2967133-65ab-4064-87b5-bca433a2dce8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:10.722037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e2967133-65ab-4064-87b5-bca433a2dce8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:10.723357 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e2967133-65ab-4064-87b5-bca433a2dce8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:10.725882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e2967133-65ab-4064-87b5-bca433a2dce8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:10.727016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e2967133-65ab-4064-87b5-bca433a2dce8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:10.741663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e3095e67-5465-47df-b420-cfb82f123f1a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:10.751589 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e3095e67-5465-47df-b420-cfb82f123f1a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" status: 200 len: 1324 microversion: 2.1 time: 0.307205 Oct 10 23:27:10.759147 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1345/2654] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:10 2022] GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 => generated 1324 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:10.796382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-41c5363a-3162-4353-8fe5-105b3f87ab05 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:10.798240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-41c5363a-3162-4353-8fe5-105b3f87ab05 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:10.810642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41c5363a-3162-4353-8fe5-105b3f87ab05 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:10.811416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41c5363a-3162-4353-8fe5-105b3f87ab05 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:10.813148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41c5363a-3162-4353-8fe5-105b3f87ab05 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:10.816132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41c5363a-3162-4353-8fe5-105b3f87ab05 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:10.816868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41c5363a-3162-4353-8fe5-105b3f87ab05 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:10.818049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41c5363a-3162-4353-8fe5-105b3f87ab05 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:10.893718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e2967133-65ab-4064-87b5-bca433a2dce8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:10.919043 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e2967133-65ab-4064-87b5-bca433a2dce8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379" status: 200 len: 1294 microversion: 2.1 time: 0.216362 Oct 10 23:27:10.930609 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1310/2655] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:10 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 => generated 1294 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:27:10.943479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-003a204f-be87-49b1-8be3-e94de1a4ca3d tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662a8b8040>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:11.067671 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-003a204f-be87-49b1-8be3-e94de1a4ca3d tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 200 len: 1423 microversion: 2.1 time: 0.135843 Oct 10 23:27:11.068317 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1311/2656] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:10 2022] GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 1423 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:11.102281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-41c5363a-3162-4353-8fe5-105b3f87ab05 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:11.111939 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-41c5363a-3162-4353-8fe5-105b3f87ab05 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1505 microversion: 2.1 time: 0.321169 Oct 10 23:27:11.112998 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1346/2657] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:10 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1505 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:27:11.138186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dae764ae-2f24-4815-a7c1-574e009474a5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:11.142322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dae764ae-2f24-4815-a7c1-574e009474a5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:11.156697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dae764ae-2f24-4815-a7c1-574e009474a5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:11.157765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dae764ae-2f24-4815-a7c1-574e009474a5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:11.158217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dae764ae-2f24-4815-a7c1-574e009474a5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:11.159056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dae764ae-2f24-4815-a7c1-574e009474a5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:11.163687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dae764ae-2f24-4815-a7c1-574e009474a5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:11.164148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dae764ae-2f24-4815-a7c1-574e009474a5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:11.174494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-08412b23-34a8-448a-8b06-afc71ed2e5c3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:11.175414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-08412b23-34a8-448a-8b06-afc71ed2e5c3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:11.190875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08412b23-34a8-448a-8b06-afc71ed2e5c3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:11.191368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08412b23-34a8-448a-8b06-afc71ed2e5c3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:11.191812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08412b23-34a8-448a-8b06-afc71ed2e5c3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:11.192518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08412b23-34a8-448a-8b06-afc71ed2e5c3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:11.192965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08412b23-34a8-448a-8b06-afc71ed2e5c3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:11.193602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08412b23-34a8-448a-8b06-afc71ed2e5c3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:11.395311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-08412b23-34a8-448a-8b06-afc71ed2e5c3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:11.409963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-08412b23-34a8-448a-8b06-afc71ed2e5c3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:11.411652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-08412b23-34a8-448a-8b06-afc71ed2e5c3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:11.440433 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-08412b23-34a8-448a-8b06-afc71ed2e5c3 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.268333 Oct 10 23:27:11.446530 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1347/2658] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:27:11 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:27:11.776060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c4d954f7-1237-4668-bc85-52477629270e tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:11.776684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c4d954f7-1237-4668-bc85-52477629270e tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:11.796027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4d954f7-1237-4668-bc85-52477629270e tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:11.796516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4d954f7-1237-4668-bc85-52477629270e tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:11.796952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4d954f7-1237-4668-bc85-52477629270e tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:11.808173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4d954f7-1237-4668-bc85-52477629270e tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:11.810969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4d954f7-1237-4668-bc85-52477629270e tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:11.811631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4d954f7-1237-4668-bc85-52477629270e tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:11.984457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dae764ae-2f24-4815-a7c1-574e009474a5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:12.011097 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dae764ae-2f24-4815-a7c1-574e009474a5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee" status: 200 len: 1314 microversion: 2.1 time: 0.883890 Oct 10 23:27:12.022467 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1312/2659] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:11 2022] GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee => generated 1314 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:12.041440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f2a57892-182c-42bd-af37-d24e4bcba6e6 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:12.048472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f2a57892-182c-42bd-af37-d24e4bcba6e6 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:12.072355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c4d954f7-1237-4668-bc85-52477629270e tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:12.082728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=18 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:27:12.085355 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c4d954f7-1237-4668-bc85-52477629270e tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" status: 200 len: 1324 microversion: 2.1 time: 0.313238 Oct 10 23:27:12.086768 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1348/2660] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:11 2022] GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 => generated 1324 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:27:12.095943 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2a57892-182c-42bd-af37-d24e4bcba6e6 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:12.096263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0e44a5e7-c75e-4c95-92a7-807c09c8b373 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f6633b29310>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:12.097781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2a57892-182c-42bd-af37-d24e4bcba6e6 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:12.098606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2a57892-182c-42bd-af37-d24e4bcba6e6 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:12.104099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2a57892-182c-42bd-af37-d24e4bcba6e6 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:12.106177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2a57892-182c-42bd-af37-d24e4bcba6e6 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:12.110610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2a57892-182c-42bd-af37-d24e4bcba6e6 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:12.179265 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0e44a5e7-c75e-4c95-92a7-807c09c8b373 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 200 len: 1423 microversion: 2.1 time: 0.091167 Oct 10 23:27:12.181983 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1349/2661] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:12 2022] GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 1423 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:12.196718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8827e92e-9604-4216-bbd4-5f4b0dc480a0 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:12.198433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8827e92e-9604-4216-bbd4-5f4b0dc480a0 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:12.214537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8827e92e-9604-4216-bbd4-5f4b0dc480a0 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:12.216415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8827e92e-9604-4216-bbd4-5f4b0dc480a0 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:12.217303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8827e92e-9604-4216-bbd4-5f4b0dc480a0 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:12.222121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8827e92e-9604-4216-bbd4-5f4b0dc480a0 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:12.223637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8827e92e-9604-4216-bbd4-5f4b0dc480a0 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:12.224782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8827e92e-9604-4216-bbd4-5f4b0dc480a0 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:12.643682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8827e92e-9604-4216-bbd4-5f4b0dc480a0 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:12.648573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:27:12.667702 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8827e92e-9604-4216-bbd4-5f4b0dc480a0 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1505 microversion: 2.1 time: 0.483895 Oct 10 23:27:12.693783 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1350/2662] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:12 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1505 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:12.731030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-810425d5-ddf5-4334-95ad-06f56b6f7977 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:12.734853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-810425d5-ddf5-4334-95ad-06f56b6f7977 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:12.770714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-810425d5-ddf5-4334-95ad-06f56b6f7977 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:12.774018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-810425d5-ddf5-4334-95ad-06f56b6f7977 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:12.777664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-810425d5-ddf5-4334-95ad-06f56b6f7977 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:12.781490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-810425d5-ddf5-4334-95ad-06f56b6f7977 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:12.784966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-810425d5-ddf5-4334-95ad-06f56b6f7977 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:12.786250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-810425d5-ddf5-4334-95ad-06f56b6f7977 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:12.998021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-810425d5-ddf5-4334-95ad-06f56b6f7977 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:13.023013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-810425d5-ddf5-4334-95ad-06f56b6f7977 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:13.027873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-810425d5-ddf5-4334-95ad-06f56b6f7977 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:13.062089 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-810425d5-ddf5-4334-95ad-06f56b6f7977 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.365230 Oct 10 23:27:13.063115 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1351/2663] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:27:12 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:27:13.075141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-adf231b5-9adf-4a82-aa56-5c32d9c1a9a4 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:13.085230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-adf231b5-9adf-4a82-aa56-5c32d9c1a9a4 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:13.109217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adf231b5-9adf-4a82-aa56-5c32d9c1a9a4 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:13.114704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adf231b5-9adf-4a82-aa56-5c32d9c1a9a4 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:13.118644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adf231b5-9adf-4a82-aa56-5c32d9c1a9a4 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:13.120035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adf231b5-9adf-4a82-aa56-5c32d9c1a9a4 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:13.121058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adf231b5-9adf-4a82-aa56-5c32d9c1a9a4 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:13.122430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adf231b5-9adf-4a82-aa56-5c32d9c1a9a4 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:13.489343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f2a57892-182c-42bd-af37-d24e4bcba6e6 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:13.498145 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f2a57892-182c-42bd-af37-d24e4bcba6e6 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379" status: 200 len: 1361 microversion: 2.1 time: 1.471605 Oct 10 23:27:13.515356 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1313/2664] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:12 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 => generated 1361 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:13.522216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-34c904ca-9816-4508-bb93-3ecdd5d5204c tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:13.524804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-34c904ca-9816-4508-bb93-3ecdd5d5204c tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:13.547125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-adf231b5-9adf-4a82-aa56-5c32d9c1a9a4 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:13.550032 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34c904ca-9816-4508-bb93-3ecdd5d5204c tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:13.550867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34c904ca-9816-4508-bb93-3ecdd5d5204c tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:13.557814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34c904ca-9816-4508-bb93-3ecdd5d5204c tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:13.559189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34c904ca-9816-4508-bb93-3ecdd5d5204c tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:13.560461 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-adf231b5-9adf-4a82-aa56-5c32d9c1a9a4 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee" status: 200 len: 1314 microversion: 2.1 time: 0.485168 Oct 10 23:27:13.561462 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1352/2665] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:13 2022] GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:13.562599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34c904ca-9816-4508-bb93-3ecdd5d5204c tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:13.566064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34c904ca-9816-4508-bb93-3ecdd5d5204c tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:13.577361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-029b0b98-67ca-4d9f-a999-3179fef1b551 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f6633ba35e0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:13.657796 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-029b0b98-67ca-4d9f-a999-3179fef1b551 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 200 len: 1423 microversion: 2.1 time: 0.095193 Oct 10 23:27:13.658391 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1353/2666] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:13 2022] GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 1423 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:13.706477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6417303b-2a07-45a6-80b4-b81ad2b6a055 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:13.707102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6417303b-2a07-45a6-80b4-b81ad2b6a055 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:13.716620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6417303b-2a07-45a6-80b4-b81ad2b6a055 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:13.717174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6417303b-2a07-45a6-80b4-b81ad2b6a055 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:13.717624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6417303b-2a07-45a6-80b4-b81ad2b6a055 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:13.718335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6417303b-2a07-45a6-80b4-b81ad2b6a055 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:13.718792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6417303b-2a07-45a6-80b4-b81ad2b6a055 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:13.719217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6417303b-2a07-45a6-80b4-b81ad2b6a055 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:14.103681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6417303b-2a07-45a6-80b4-b81ad2b6a055 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:14.120917 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6417303b-2a07-45a6-80b4-b81ad2b6a055 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1505 microversion: 2.1 time: 0.417226 Oct 10 23:27:14.122941 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1354/2667] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:13 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1505 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:27:14.133195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b2451642-e738-4d4e-ac82-eeea5da76bea tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:14.137119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b2451642-e738-4d4e-ac82-eeea5da76bea tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:14.154352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2451642-e738-4d4e-ac82-eeea5da76bea tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:14.154865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2451642-e738-4d4e-ac82-eeea5da76bea tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:14.155308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2451642-e738-4d4e-ac82-eeea5da76bea tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:14.156019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2451642-e738-4d4e-ac82-eeea5da76bea tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:14.156474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2451642-e738-4d4e-ac82-eeea5da76bea tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:14.169795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2451642-e738-4d4e-ac82-eeea5da76bea tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:14.329931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-34c904ca-9816-4508-bb93-3ecdd5d5204c tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:14.340796 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-34c904ca-9816-4508-bb93-3ecdd5d5204c tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" status: 200 len: 1324 microversion: 2.1 time: 0.823444 Oct 10 23:27:14.347037 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1314/2668] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:13 2022] GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 => generated 1324 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:14.391763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b2451642-e738-4d4e-ac82-eeea5da76bea tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:14.407045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b2451642-e738-4d4e-ac82-eeea5da76bea tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:14.408754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b2451642-e738-4d4e-ac82-eeea5da76bea tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:14.416250 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b2451642-e738-4d4e-ac82-eeea5da76bea tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.292069 Oct 10 23:27:14.421707 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1355/2669] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:27:14 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:27:14.525557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-04aa2a72-90e9-46e9-aaad-7b1a7390b070 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:14.526189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-04aa2a72-90e9-46e9-aaad-7b1a7390b070 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:14.560440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04aa2a72-90e9-46e9-aaad-7b1a7390b070 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:14.561105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04aa2a72-90e9-46e9-aaad-7b1a7390b070 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:14.566825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04aa2a72-90e9-46e9-aaad-7b1a7390b070 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:14.570437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04aa2a72-90e9-46e9-aaad-7b1a7390b070 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:14.570938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04aa2a72-90e9-46e9-aaad-7b1a7390b070 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:14.571386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04aa2a72-90e9-46e9-aaad-7b1a7390b070 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:14.759088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-85062ff5-3627-4d7e-a900-3806a254e5f6 req-ba1ca8a9-9227-44c1-8708-a07d043b4e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b64a0f12-ba9a-4074-9ba0-0911bdab6c0f", "name": "network-vif-plugged", "status": "completed", "tag": "c3888bf2-97db-4f22-afff-a2d9b83792af"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:14.785819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-85062ff5-3627-4d7e-a900-3806a254e5f6 req-ba1ca8a9-9227-44c1-8708-a07d043b4e86 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:14.787270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-85062ff5-3627-4d7e-a900-3806a254e5f6 req-ba1ca8a9-9227-44c1-8708-a07d043b4e86 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:14.788069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-85062ff5-3627-4d7e-a900-3806a254e5f6 req-ba1ca8a9-9227-44c1-8708-a07d043b4e86 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:14.804740 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-85062ff5-3627-4d7e-a900-3806a254e5f6 req-ba1ca8a9-9227-44c1-8708-a07d043b4e86 service nova] Creating event network-vif-plugged:c3888bf2-97db-4f22-afff-a2d9b83792af for instance b64a0f12-ba9a-4074-9ba0-0911bdab6c0f on n-h2-860864-2 Oct 10 23:27:14.811401 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-85062ff5-3627-4d7e-a900-3806a254e5f6 req-ba1ca8a9-9227-44c1-8708-a07d043b4e86 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.355343 Oct 10 23:27:14.812782 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1315/2670] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:27:14.820045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a0d3026d-1d61-45ad-8a6a-1b9d5192f1e1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:14.821434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a0d3026d-1d61-45ad-8a6a-1b9d5192f1e1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:14.829621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a0d3026d-1d61-45ad-8a6a-1b9d5192f1e1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:14.830432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a0d3026d-1d61-45ad-8a6a-1b9d5192f1e1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:14.831505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a0d3026d-1d61-45ad-8a6a-1b9d5192f1e1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:14.832500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a0d3026d-1d61-45ad-8a6a-1b9d5192f1e1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:14.834088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a0d3026d-1d61-45ad-8a6a-1b9d5192f1e1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:14.834972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a0d3026d-1d61-45ad-8a6a-1b9d5192f1e1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:15.092312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:27:15.242592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-04aa2a72-90e9-46e9-aaad-7b1a7390b070 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:15.262731 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-04aa2a72-90e9-46e9-aaad-7b1a7390b070 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379" status: 200 len: 1361 microversion: 2.1 time: 0.738597 Oct 10 23:27:15.270195 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1356/2671] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:14 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 => generated 1361 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:27:15.275304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3b086852-80a6-4031-b740-2f4ca6dc9da1 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f6633b29f70>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:15.363175 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3b086852-80a6-4031-b740-2f4ca6dc9da1 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 200 len: 1423 microversion: 2.1 time: 0.091539 Oct 10 23:27:15.365812 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1357/2672] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:15 2022] GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 1423 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:15.382388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-0bbdb69d-5939-4db3-9f11-9297eba1b502 req-6e677c0e-51f2-4dcf-a920-5f0aa541eef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3d268c6-2b9d-4858-b67f-1dced7831838", "tag": "3a4df9ab-2215-474a-bffb-e5b388a62d2d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:15.409850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a0d3026d-1d61-45ad-8a6a-1b9d5192f1e1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:15.410891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0bbdb69d-5939-4db3-9f11-9297eba1b502 req-6e677c0e-51f2-4dcf-a920-5f0aa541eef8 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:15.411390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0bbdb69d-5939-4db3-9f11-9297eba1b502 req-6e677c0e-51f2-4dcf-a920-5f0aa541eef8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:15.411824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0bbdb69d-5939-4db3-9f11-9297eba1b502 req-6e677c0e-51f2-4dcf-a920-5f0aa541eef8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:15.426877 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a0d3026d-1d61-45ad-8a6a-1b9d5192f1e1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee" status: 200 len: 1314 microversion: 2.1 time: 0.611649 Oct 10 23:27:15.431937 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1316/2673] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:14 2022] GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:15.440894 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-0bbdb69d-5939-4db3-9f11-9297eba1b502 req-6e677c0e-51f2-4dcf-a920-5f0aa541eef8 service nova] Creating event network-changed:3a4df9ab-2215-474a-bffb-e5b388a62d2d for instance a3d268c6-2b9d-4858-b67f-1dced7831838 on n-h2-860864-2 Oct 10 23:27:15.447918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-393a65f1-b6c0-475f-875f-3d7fd9b2f44c tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:15.451311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-393a65f1-b6c0-475f-875f-3d7fd9b2f44c tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:15.470399 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-0bbdb69d-5939-4db3-9f11-9297eba1b502 req-6e677c0e-51f2-4dcf-a920-5f0aa541eef8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091012 Oct 10 23:27:15.471603 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1358/2674] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:27:15.476255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-393a65f1-b6c0-475f-875f-3d7fd9b2f44c tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:15.476444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-393a65f1-b6c0-475f-875f-3d7fd9b2f44c tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:15.476967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-393a65f1-b6c0-475f-875f-3d7fd9b2f44c tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:15.478644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fff5be10-3a25-4c64-9242-cd9399e41865 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:15.478999 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-393a65f1-b6c0-475f-875f-3d7fd9b2f44c tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:15.479651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-393a65f1-b6c0-475f-875f-3d7fd9b2f44c tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:15.480192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-393a65f1-b6c0-475f-875f-3d7fd9b2f44c tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:15.480532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fff5be10-3a25-4c64-9242-cd9399e41865 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:15.500217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fff5be10-3a25-4c64-9242-cd9399e41865 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:15.501600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fff5be10-3a25-4c64-9242-cd9399e41865 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:15.502315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fff5be10-3a25-4c64-9242-cd9399e41865 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:15.503264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fff5be10-3a25-4c64-9242-cd9399e41865 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:15.503939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fff5be10-3a25-4c64-9242-cd9399e41865 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:15.504577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fff5be10-3a25-4c64-9242-cd9399e41865 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:16.020655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-393a65f1-b6c0-475f-875f-3d7fd9b2f44c tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:16.038550 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-393a65f1-b6c0-475f-875f-3d7fd9b2f44c tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1505 microversion: 2.1 time: 0.604647 Oct 10 23:27:16.050231 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1317/2675] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:15 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1505 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:16.059342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7bc63e8b-170a-4d68-85d4-5411b8743908 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:16.059342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7bc63e8b-170a-4d68-85d4-5411b8743908 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:16.092644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bc63e8b-170a-4d68-85d4-5411b8743908 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:16.104013 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bc63e8b-170a-4d68-85d4-5411b8743908 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:16.106340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bc63e8b-170a-4d68-85d4-5411b8743908 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:16.109189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bc63e8b-170a-4d68-85d4-5411b8743908 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:16.110500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bc63e8b-170a-4d68-85d4-5411b8743908 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:16.112778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bc63e8b-170a-4d68-85d4-5411b8743908 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:16.140218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=52 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:27:16.378980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7bc63e8b-170a-4d68-85d4-5411b8743908 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:16.406204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7bc63e8b-170a-4d68-85d4-5411b8743908 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:16.411157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7bc63e8b-170a-4d68-85d4-5411b8743908 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:16.429903 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7bc63e8b-170a-4d68-85d4-5411b8743908 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.380011 Oct 10 23:27:16.431979 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1318/2676] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:27:16 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:27:16.455554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e79da99f-345e-4d8b-9119-850bc3476db3 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:16.456594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e79da99f-345e-4d8b-9119-850bc3476db3 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:16.472070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e79da99f-345e-4d8b-9119-850bc3476db3 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:16.478698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e79da99f-345e-4d8b-9119-850bc3476db3 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:16.480052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e79da99f-345e-4d8b-9119-850bc3476db3 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:16.481272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e79da99f-345e-4d8b-9119-850bc3476db3 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:16.481919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e79da99f-345e-4d8b-9119-850bc3476db3 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:16.482697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e79da99f-345e-4d8b-9119-850bc3476db3 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:16.489432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:27:16.754063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fff5be10-3a25-4c64-9242-cd9399e41865 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:16.768633 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fff5be10-3a25-4c64-9242-cd9399e41865 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" status: 200 len: 1324 microversion: 2.1 time: 1.292332 Oct 10 23:27:16.789566 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1359/2677] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:15 2022] GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 => generated 1324 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:16.795539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2abb7560-e782-4a52-ae6f-e16fb87a8131 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f6633b82280>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:16.904907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e79da99f-345e-4d8b-9119-850bc3476db3 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:16.918569 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e79da99f-345e-4d8b-9119-850bc3476db3 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379" status: 200 len: 1361 microversion: 2.1 time: 0.475780 Oct 10 23:27:16.919406 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1319/2678] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:16 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 => generated 1361 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:16.935819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d3a02276-d147-44a5-9a12-dc57b5c05cb2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:16.936267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d3a02276-d147-44a5-9a12-dc57b5c05cb2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:16.948130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3a02276-d147-44a5-9a12-dc57b5c05cb2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:16.951735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3a02276-d147-44a5-9a12-dc57b5c05cb2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:16.952392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3a02276-d147-44a5-9a12-dc57b5c05cb2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:16.961532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3a02276-d147-44a5-9a12-dc57b5c05cb2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:16.962247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3a02276-d147-44a5-9a12-dc57b5c05cb2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:16.962866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3a02276-d147-44a5-9a12-dc57b5c05cb2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:16.972375 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2abb7560-e782-4a52-ae6f-e16fb87a8131 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 200 len: 1423 microversion: 2.1 time: 0.181322 Oct 10 23:27:16.972978 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1360/2679] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:16 2022] GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 1423 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:17.070788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-54b627ce-58be-476d-a6c3-a8682e6f2739 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:17.071413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-54b627ce-58be-476d-a6c3-a8682e6f2739 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:17.091652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54b627ce-58be-476d-a6c3-a8682e6f2739 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:17.092155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54b627ce-58be-476d-a6c3-a8682e6f2739 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:17.092593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54b627ce-58be-476d-a6c3-a8682e6f2739 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:17.093304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54b627ce-58be-476d-a6c3-a8682e6f2739 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:17.102995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54b627ce-58be-476d-a6c3-a8682e6f2739 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:17.103448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54b627ce-58be-476d-a6c3-a8682e6f2739 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:17.927874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-54b627ce-58be-476d-a6c3-a8682e6f2739 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:17.940465 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-54b627ce-58be-476d-a6c3-a8682e6f2739 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1505 microversion: 2.1 time: 0.875329 Oct 10 23:27:17.961402 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1361/2680] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:17 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1505 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:27:17.976979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-91965e96-fa67-4d8f-bf98-338b8d2f8057 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:17.994409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-91965e96-fa67-4d8f-bf98-338b8d2f8057 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:18.011345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91965e96-fa67-4d8f-bf98-338b8d2f8057 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:18.011883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91965e96-fa67-4d8f-bf98-338b8d2f8057 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:18.012339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91965e96-fa67-4d8f-bf98-338b8d2f8057 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:18.014980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91965e96-fa67-4d8f-bf98-338b8d2f8057 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:18.019350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91965e96-fa67-4d8f-bf98-338b8d2f8057 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:18.022179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91965e96-fa67-4d8f-bf98-338b8d2f8057 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:18.328564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-91965e96-fa67-4d8f-bf98-338b8d2f8057 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:18.363383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-91965e96-fa67-4d8f-bf98-338b8d2f8057 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:18.365327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-91965e96-fa67-4d8f-bf98-338b8d2f8057 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:18.372377 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-91965e96-fa67-4d8f-bf98-338b8d2f8057 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 0.419561 Oct 10 23:27:18.374288 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1362/2681] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:27:17 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:27:18.379394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-0c099cfd-2d26-442a-bb0e-d63a511a7dca req-cf8ff7f6-8296-4965-90be-42ad11e55c7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18753c2-80e8-4fea-b2ad-04fa1ae400ee", "tag": "2aba71f9-c43a-48db-ac3d-66f4596a4820"}, {"name": "network-changed", "server_uuid": "92e9f63c-d49b-4a32-80b8-b729b8530379", "tag": "421d6fa0-dcfc-4162-835a-af03c580d3a7"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:18.392910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0c099cfd-2d26-442a-bb0e-d63a511a7dca req-cf8ff7f6-8296-4965-90be-42ad11e55c7e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:18.393977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0c099cfd-2d26-442a-bb0e-d63a511a7dca req-cf8ff7f6-8296-4965-90be-42ad11e55c7e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:18.394852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0c099cfd-2d26-442a-bb0e-d63a511a7dca req-cf8ff7f6-8296-4965-90be-42ad11e55c7e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:18.409607 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-0c099cfd-2d26-442a-bb0e-d63a511a7dca req-cf8ff7f6-8296-4965-90be-42ad11e55c7e service nova] Creating event network-changed:2aba71f9-c43a-48db-ac3d-66f4596a4820 for instance e18753c2-80e8-4fea-b2ad-04fa1ae400ee on n-h1-860864-2 Oct 10 23:27:18.410381 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-0c099cfd-2d26-442a-bb0e-d63a511a7dca req-cf8ff7f6-8296-4965-90be-42ad11e55c7e service nova] Creating event network-changed:421d6fa0-dcfc-4162-835a-af03c580d3a7 for instance 92e9f63c-d49b-4a32-80b8-b729b8530379 on n-h2-860864-2 Oct 10 23:27:18.419797 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-0c099cfd-2d26-442a-bb0e-d63a511a7dca req-cf8ff7f6-8296-4965-90be-42ad11e55c7e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044065 Oct 10 23:27:18.421348 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1363/2682] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:27:18.427387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e3cc49ca-bbf7-4752-9e6d-25777b8e5604 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:18.428460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e3cc49ca-bbf7-4752-9e6d-25777b8e5604 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:18.437033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3cc49ca-bbf7-4752-9e6d-25777b8e5604 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:18.438376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3cc49ca-bbf7-4752-9e6d-25777b8e5604 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:18.439027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3cc49ca-bbf7-4752-9e6d-25777b8e5604 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:18.439962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3cc49ca-bbf7-4752-9e6d-25777b8e5604 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:18.440624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3cc49ca-bbf7-4752-9e6d-25777b8e5604 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:18.441216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3cc49ca-bbf7-4752-9e6d-25777b8e5604 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:18.819451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e3cc49ca-bbf7-4752-9e6d-25777b8e5604 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:18.837659 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e3cc49ca-bbf7-4752-9e6d-25777b8e5604 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" status: 200 len: 1324 microversion: 2.1 time: 0.410964 Oct 10 23:27:18.838346 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1364/2683] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:18 2022] GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 => generated 1324 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:18.848005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8884cd43-5607-4095-aa6c-60886d4604c1 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:18.848666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8884cd43-5607-4095-aa6c-60886d4604c1 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:18.872433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8884cd43-5607-4095-aa6c-60886d4604c1 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:18.873427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8884cd43-5607-4095-aa6c-60886d4604c1 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:18.873993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8884cd43-5607-4095-aa6c-60886d4604c1 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:18.894850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8884cd43-5607-4095-aa6c-60886d4604c1 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:18.897351 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8884cd43-5607-4095-aa6c-60886d4604c1 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:18.898003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8884cd43-5607-4095-aa6c-60886d4604c1 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:19.012566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d3a02276-d147-44a5-9a12-dc57b5c05cb2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:19.026795 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d3a02276-d147-44a5-9a12-dc57b5c05cb2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee" status: 200 len: 1314 microversion: 2.1 time: 2.106278 Oct 10 23:27:19.034608 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1320/2684] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:16 2022] GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee => generated 1314 bytes in 2115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:19.055193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f91cae77-06c4-4713-ba20-b7f7670a78f5 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662a8fbdc0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:19.387741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8884cd43-5607-4095-aa6c-60886d4604c1 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:19.408282 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8884cd43-5607-4095-aa6c-60886d4604c1 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379" status: 200 len: 1361 microversion: 2.1 time: 0.566071 Oct 10 23:27:19.429166 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1365/2685] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:18 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 => generated 1361 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:19.434521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6de09f3f-5c79-4be9-9710-cc3c42403d6f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:19.435364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6de09f3f-5c79-4be9-9710-cc3c42403d6f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:19.442990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6de09f3f-5c79-4be9-9710-cc3c42403d6f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:19.443652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6de09f3f-5c79-4be9-9710-cc3c42403d6f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:19.444260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6de09f3f-5c79-4be9-9710-cc3c42403d6f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:19.445122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6de09f3f-5c79-4be9-9710-cc3c42403d6f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:19.445781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6de09f3f-5c79-4be9-9710-cc3c42403d6f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:19.446356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6de09f3f-5c79-4be9-9710-cc3c42403d6f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:19.904057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6de09f3f-5c79-4be9-9710-cc3c42403d6f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:19.930543 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6de09f3f-5c79-4be9-9710-cc3c42403d6f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1505 microversion: 2.1 time: 0.499965 Oct 10 23:27:19.953431 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1366/2686] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:19 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1505 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:19.953431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b07fa644-aad0-4f1c-9b43-b393930b2f7c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:19.953431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b07fa644-aad0-4f1c-9b43-b393930b2f7c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:19.965543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b07fa644-aad0-4f1c-9b43-b393930b2f7c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:19.965986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b07fa644-aad0-4f1c-9b43-b393930b2f7c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:19.966442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b07fa644-aad0-4f1c-9b43-b393930b2f7c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:19.967753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b07fa644-aad0-4f1c-9b43-b393930b2f7c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:19.968219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b07fa644-aad0-4f1c-9b43-b393930b2f7c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:19.968650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b07fa644-aad0-4f1c-9b43-b393930b2f7c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:20.684107 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f91cae77-06c4-4713-ba20-b7f7670a78f5 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 200 len: 1423 microversion: 2.1 time: 1.647199 Oct 10 23:27:20.687894 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1321/2687] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:19 2022] GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 1423 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:20.701352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fc844938-5c79-43db-9344-812e98a639d8 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:20.705404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fc844938-5c79-43db-9344-812e98a639d8 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:20.726220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc844938-5c79-43db-9344-812e98a639d8 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:20.730039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc844938-5c79-43db-9344-812e98a639d8 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:20.731212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc844938-5c79-43db-9344-812e98a639d8 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:20.737024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc844938-5c79-43db-9344-812e98a639d8 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:20.738181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc844938-5c79-43db-9344-812e98a639d8 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:20.741759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc844938-5c79-43db-9344-812e98a639d8 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:20.886474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b07fa644-aad0-4f1c-9b43-b393930b2f7c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:20.905174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b07fa644-aad0-4f1c-9b43-b393930b2f7c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:20.917012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b07fa644-aad0-4f1c-9b43-b393930b2f7c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:20.961313 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b07fa644-aad0-4f1c-9b43-b393930b2f7c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1544 microversion: 2.91 time: 1.017164 Oct 10 23:27:20.967832 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1367/2688] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:27:19 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1544 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:27:20.996310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-26129674-f46e-4f3f-92ae-54bc206254b8 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:21.002189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-26129674-f46e-4f3f-92ae-54bc206254b8 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:21.031589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26129674-f46e-4f3f-92ae-54bc206254b8 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:21.042108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26129674-f46e-4f3f-92ae-54bc206254b8 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:21.045709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26129674-f46e-4f3f-92ae-54bc206254b8 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:21.049244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26129674-f46e-4f3f-92ae-54bc206254b8 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:21.050055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26129674-f46e-4f3f-92ae-54bc206254b8 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:21.050711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26129674-f46e-4f3f-92ae-54bc206254b8 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:21.199922 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fc844938-5c79-43db-9344-812e98a639d8 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:21.221170 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fc844938-5c79-43db-9344-812e98a639d8 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" status: 200 len: 1324 microversion: 2.1 time: 0.530860 Oct 10 23:27:21.225347 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1322/2689] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:20 2022] GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 => generated 1324 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:21.240782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-8c535486-0a31-4128-94b1-4ec4e922da70 req-5aaf5572-2692-4539-9749-7d78c85c5cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e94f4a-d35f-4d5f-abf3-4366dea38dd5", "name": "network-vif-plugged", "status": "completed", "tag": "cf591354-4fda-40dc-8468-a4548f51eeb1"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:21.279838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8c535486-0a31-4128-94b1-4ec4e922da70 req-5aaf5572-2692-4539-9749-7d78c85c5cd7 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:21.280334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8c535486-0a31-4128-94b1-4ec4e922da70 req-5aaf5572-2692-4539-9749-7d78c85c5cd7 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:21.280776 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8c535486-0a31-4128-94b1-4ec4e922da70 req-5aaf5572-2692-4539-9749-7d78c85c5cd7 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:21.330217 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-8c535486-0a31-4128-94b1-4ec4e922da70 req-5aaf5572-2692-4539-9749-7d78c85c5cd7 service nova] Creating event network-vif-plugged:cf591354-4fda-40dc-8468-a4548f51eeb1 for instance f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 on n-h1-860864-2 Oct 10 23:27:21.347206 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-8c535486-0a31-4128-94b1-4ec4e922da70 req-5aaf5572-2692-4539-9749-7d78c85c5cd7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119663 Oct 10 23:27:21.352795 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1323/2690] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:27:21.376939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ff5d39f4-f0be-446f-94d6-ce2322ab7867 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:21.383970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ff5d39f4-f0be-446f-94d6-ce2322ab7867 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:21.402360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff5d39f4-f0be-446f-94d6-ce2322ab7867 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:21.403087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff5d39f4-f0be-446f-94d6-ce2322ab7867 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:21.403754 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff5d39f4-f0be-446f-94d6-ce2322ab7867 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:21.405313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff5d39f4-f0be-446f-94d6-ce2322ab7867 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:21.406374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff5d39f4-f0be-446f-94d6-ce2322ab7867 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:21.408117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff5d39f4-f0be-446f-94d6-ce2322ab7867 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:21.551528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-26129674-f46e-4f3f-92ae-54bc206254b8 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:21.564556 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-26129674-f46e-4f3f-92ae-54bc206254b8 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee" status: 200 len: 1314 microversion: 2.1 time: 0.592993 Oct 10 23:27:21.584389 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1368/2691] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:20 2022] GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:21.591948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6fd24784-9e1e-402f-81c6-18de5e5bf5ac tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:21.593843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6fd24784-9e1e-402f-81c6-18de5e5bf5ac tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:21.605357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fd24784-9e1e-402f-81c6-18de5e5bf5ac tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:21.606248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fd24784-9e1e-402f-81c6-18de5e5bf5ac tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:21.606896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fd24784-9e1e-402f-81c6-18de5e5bf5ac tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:21.608099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fd24784-9e1e-402f-81c6-18de5e5bf5ac tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:21.608767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fd24784-9e1e-402f-81c6-18de5e5bf5ac tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:21.609565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fd24784-9e1e-402f-81c6-18de5e5bf5ac tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:22.023395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6fd24784-9e1e-402f-81c6-18de5e5bf5ac tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:22.040572 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6fd24784-9e1e-402f-81c6-18de5e5bf5ac tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1505 microversion: 2.1 time: 0.453656 Oct 10 23:27:22.062364 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1369/2692] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:21 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1505 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:22.070685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-96b303a0-7746-444b-aeab-56eb37336cf5 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f6633a78dc0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:22.167658 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-96b303a0-7746-444b-aeab-56eb37336cf5 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 200 len: 1423 microversion: 2.1 time: 0.103551 Oct 10 23:27:22.169488 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1370/2693] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:22 2022] GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 1423 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:22.190093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-02906eb8-d18d-46da-b064-2e53ddabcd8c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:22.197072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-02906eb8-d18d-46da-b064-2e53ddabcd8c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:22.222477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02906eb8-d18d-46da-b064-2e53ddabcd8c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:22.226955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02906eb8-d18d-46da-b064-2e53ddabcd8c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:22.228348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02906eb8-d18d-46da-b064-2e53ddabcd8c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:22.231889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02906eb8-d18d-46da-b064-2e53ddabcd8c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:22.237815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02906eb8-d18d-46da-b064-2e53ddabcd8c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:22.240791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02906eb8-d18d-46da-b064-2e53ddabcd8c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:22.389202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ff5d39f4-f0be-446f-94d6-ce2322ab7867 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:22.403667 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ff5d39f4-f0be-446f-94d6-ce2322ab7867 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379" status: 200 len: 1361 microversion: 2.1 time: 1.049335 Oct 10 23:27:22.406175 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1324/2694] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:21 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 => generated 1361 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:22.412483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-28c33e4d-c181-420b-b23f-2763b68eaa50 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:22.413837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-28c33e4d-c181-420b-b23f-2763b68eaa50 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:22.431070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28c33e4d-c181-420b-b23f-2763b68eaa50 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:22.435566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28c33e4d-c181-420b-b23f-2763b68eaa50 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:22.437241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28c33e4d-c181-420b-b23f-2763b68eaa50 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:22.441092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28c33e4d-c181-420b-b23f-2763b68eaa50 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:22.441986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28c33e4d-c181-420b-b23f-2763b68eaa50 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:22.442611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28c33e4d-c181-420b-b23f-2763b68eaa50 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:23.006523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-28c33e4d-c181-420b-b23f-2763b68eaa50 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:23.023232 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-28c33e4d-c181-420b-b23f-2763b68eaa50 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" status: 200 len: 1324 microversion: 2.1 time: 0.612972 Oct 10 23:27:23.027884 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1325/2695] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:22 2022] GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 => generated 1324 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:23.043214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-29e622e4-1ec3-4b2c-b5fc-f88c43f172dc tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:23.058450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-29e622e4-1ec3-4b2c-b5fc-f88c43f172dc tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:23.086890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29e622e4-1ec3-4b2c-b5fc-f88c43f172dc tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:23.088196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29e622e4-1ec3-4b2c-b5fc-f88c43f172dc tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:23.090433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29e622e4-1ec3-4b2c-b5fc-f88c43f172dc tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:23.092595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29e622e4-1ec3-4b2c-b5fc-f88c43f172dc tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:23.096488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29e622e4-1ec3-4b2c-b5fc-f88c43f172dc tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:23.098545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29e622e4-1ec3-4b2c-b5fc-f88c43f172dc tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:23.478093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-02906eb8-d18d-46da-b064-2e53ddabcd8c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:23.496050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-02906eb8-d18d-46da-b064-2e53ddabcd8c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:23.506047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-02906eb8-d18d-46da-b064-2e53ddabcd8c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:23.531725 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-02906eb8-d18d-46da-b064-2e53ddabcd8c tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1531 microversion: 2.91 time: 1.360960 Oct 10 23:27:23.537758 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1371/2696] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:27:22 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1531 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:27:23.559805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5979dcf0-c12a-4a01-b325-2c0052794b54 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:23.562076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5979dcf0-c12a-4a01-b325-2c0052794b54 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:23.585009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5979dcf0-c12a-4a01-b325-2c0052794b54 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:23.592874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5979dcf0-c12a-4a01-b325-2c0052794b54 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:23.610939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5979dcf0-c12a-4a01-b325-2c0052794b54 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:23.613039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5979dcf0-c12a-4a01-b325-2c0052794b54 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:23.614655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5979dcf0-c12a-4a01-b325-2c0052794b54 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:23.614907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5979dcf0-c12a-4a01-b325-2c0052794b54 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:23.658986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-29e622e4-1ec3-4b2c-b5fc-f88c43f172dc tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:23.679482 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-29e622e4-1ec3-4b2c-b5fc-f88c43f172dc tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee" status: 200 len: 1314 microversion: 2.1 time: 0.644351 Oct 10 23:27:23.684391 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1326/2697] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:23 2022] GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:23.709726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-04fcf18f-4e50-4fa6-a25d-fbe1d916cfc3 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662a8a88b0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:23.801244 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-04fcf18f-4e50-4fa6-a25d-fbe1d916cfc3 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 200 len: 1423 microversion: 2.1 time: 0.113980 Oct 10 23:27:23.805789 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1327/2698] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:23 2022] GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 1423 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:23.830404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c89ad92e-af9b-44f7-bcba-c051bddfcf31 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:23.839339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c89ad92e-af9b-44f7-bcba-c051bddfcf31 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:23.869725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c89ad92e-af9b-44f7-bcba-c051bddfcf31 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:23.870519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c89ad92e-af9b-44f7-bcba-c051bddfcf31 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:23.879159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c89ad92e-af9b-44f7-bcba-c051bddfcf31 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:23.881997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c89ad92e-af9b-44f7-bcba-c051bddfcf31 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:23.881997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c89ad92e-af9b-44f7-bcba-c051bddfcf31 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:23.885865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c89ad92e-af9b-44f7-bcba-c051bddfcf31 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:24.336718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5979dcf0-c12a-4a01-b325-2c0052794b54 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:24.339624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:27:24.356206 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5979dcf0-c12a-4a01-b325-2c0052794b54 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1505 microversion: 2.1 time: 0.811230 Oct 10 23:27:24.359291 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1372/2699] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:23 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1505 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:24.371416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-93becb13-d18a-4622-a4ef-0292bf64c3ac tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:24.372224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-93becb13-d18a-4622-a4ef-0292bf64c3ac tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:24.387238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93becb13-d18a-4622-a4ef-0292bf64c3ac tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:24.390856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93becb13-d18a-4622-a4ef-0292bf64c3ac tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:24.393211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93becb13-d18a-4622-a4ef-0292bf64c3ac tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:24.394475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93becb13-d18a-4622-a4ef-0292bf64c3ac tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:24.396014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93becb13-d18a-4622-a4ef-0292bf64c3ac tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:24.397072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93becb13-d18a-4622-a4ef-0292bf64c3ac tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:24.571334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-93becb13-d18a-4622-a4ef-0292bf64c3ac tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] Lazy-loading 'services' on Instance uuid 2031b270-ebc4-4583-8a2c-086ad7842cba {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:27:24.628121 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-93becb13-d18a-4622-a4ef-0292bf64c3ac tempest-UnshelveToHostMultiNodesTest-1057846644 tempest-UnshelveToHostMultiNodesTest-1057846644-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1936 microversion: 2.91 time: 0.263731 Oct 10 23:27:24.636251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c89ad92e-af9b-44f7-bcba-c051bddfcf31 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:24.643040 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1373/2700] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:27:24 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1936 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:27:24.651950 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c89ad92e-af9b-44f7-bcba-c051bddfcf31 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379" status: 200 len: 1361 microversion: 2.1 time: 0.842663 Oct 10 23:27:24.653782 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1328/2701] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:23 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 => generated 1361 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:24.662336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f621bbd8-e5c6-4947-b5b5-6674c5ffc95c tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:24.663993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f621bbd8-e5c6-4947-b5b5-6674c5ffc95c tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:24.680224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:27:24.683337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f621bbd8-e5c6-4947-b5b5-6674c5ffc95c tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:24.686042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6abdee2d-d3e0-4aa5-9047-e2eb73352dca tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:24.686678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6abdee2d-d3e0-4aa5-9047-e2eb73352dca tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:24.687312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f621bbd8-e5c6-4947-b5b5-6674c5ffc95c tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:24.688020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f621bbd8-e5c6-4947-b5b5-6674c5ffc95c tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:24.690618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f621bbd8-e5c6-4947-b5b5-6674c5ffc95c tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:24.691380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f621bbd8-e5c6-4947-b5b5-6674c5ffc95c tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:24.694959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f621bbd8-e5c6-4947-b5b5-6674c5ffc95c tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:24.697064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6abdee2d-d3e0-4aa5-9047-e2eb73352dca tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:24.697622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6abdee2d-d3e0-4aa5-9047-e2eb73352dca tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:24.702875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6abdee2d-d3e0-4aa5-9047-e2eb73352dca tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:24.711658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6abdee2d-d3e0-4aa5-9047-e2eb73352dca tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:24.713927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6abdee2d-d3e0-4aa5-9047-e2eb73352dca tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:24.714450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6abdee2d-d3e0-4aa5-9047-e2eb73352dca tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:24.798247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6abdee2d-d3e0-4aa5-9047-e2eb73352dca tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:27:24.998494 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6abdee2d-d3e0-4aa5-9047-e2eb73352dca tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 204 len: 0 microversion: 2.91 time: 0.316738 Oct 10 23:27:24.999852 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1329/2702] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:27:24 2022] DELETE /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:27:25.012847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-149f095b-a410-4548-8fc5-9c72a277ade3 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:25.015790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-149f095b-a410-4548-8fc5-9c72a277ade3 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:25.030990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-149f095b-a410-4548-8fc5-9c72a277ade3 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:25.031722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-149f095b-a410-4548-8fc5-9c72a277ade3 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:25.032475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-149f095b-a410-4548-8fc5-9c72a277ade3 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:25.033234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-149f095b-a410-4548-8fc5-9c72a277ade3 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:25.036327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-149f095b-a410-4548-8fc5-9c72a277ade3 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:25.036924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-149f095b-a410-4548-8fc5-9c72a277ade3 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:25.363674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-149f095b-a410-4548-8fc5-9c72a277ade3 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:25.374684 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-149f095b-a410-4548-8fc5-9c72a277ade3 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee" status: 200 len: 1314 microversion: 2.1 time: 0.373134 Oct 10 23:27:25.375866 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1330/2703] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:24 2022] GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:25.383177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9b3c58ed-c29f-4db9-b59c-c7189666b142 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662a742af0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:25.418396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f621bbd8-e5c6-4947-b5b5-6674c5ffc95c tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:25.431905 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f621bbd8-e5c6-4947-b5b5-6674c5ffc95c tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" status: 200 len: 1324 microversion: 2.1 time: 0.787699 Oct 10 23:27:25.434748 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1374/2704] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:24 2022] GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 => generated 1324 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:25.459594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-77242066-0a3a-4f6d-894b-c278a92432c2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:25.460237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-77242066-0a3a-4f6d-894b-c278a92432c2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:25.476239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77242066-0a3a-4f6d-894b-c278a92432c2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:25.478544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77242066-0a3a-4f6d-894b-c278a92432c2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:25.483342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77242066-0a3a-4f6d-894b-c278a92432c2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:25.487375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77242066-0a3a-4f6d-894b-c278a92432c2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:25.488046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77242066-0a3a-4f6d-894b-c278a92432c2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:25.490220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77242066-0a3a-4f6d-894b-c278a92432c2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:25.491217 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9b3c58ed-c29f-4db9-b59c-c7189666b142 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 200 len: 1423 microversion: 2.1 time: 0.114005 Oct 10 23:27:25.494038 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1331/2705] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:25 2022] GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 1423 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:25.524943 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-96bd83d1-386a-4084-83c2-a2b5298cd55e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:25.527343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-96bd83d1-386a-4084-83c2-a2b5298cd55e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:25.560380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96bd83d1-386a-4084-83c2-a2b5298cd55e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:25.564791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96bd83d1-386a-4084-83c2-a2b5298cd55e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:25.568202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96bd83d1-386a-4084-83c2-a2b5298cd55e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:25.572688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96bd83d1-386a-4084-83c2-a2b5298cd55e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:25.573714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96bd83d1-386a-4084-83c2-a2b5298cd55e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:25.580802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96bd83d1-386a-4084-83c2-a2b5298cd55e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:25.691563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-77242066-0a3a-4f6d-894b-c278a92432c2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:25.703650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-77242066-0a3a-4f6d-894b-c278a92432c2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:25.705865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-77242066-0a3a-4f6d-894b-c278a92432c2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:25.730428 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-77242066-0a3a-4f6d-894b-c278a92432c2 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.286581 Oct 10 23:27:25.732281 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1375/2706] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:27:25 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:27:25.751511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-780d2c77-dfd3-4357-8db6-39124e4015a8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:25.754943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-780d2c77-dfd3-4357-8db6-39124e4015a8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:25.770648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-780d2c77-dfd3-4357-8db6-39124e4015a8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:25.771075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-780d2c77-dfd3-4357-8db6-39124e4015a8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:25.771528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-780d2c77-dfd3-4357-8db6-39124e4015a8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:25.772358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-780d2c77-dfd3-4357-8db6-39124e4015a8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:25.776242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-780d2c77-dfd3-4357-8db6-39124e4015a8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:25.776824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-780d2c77-dfd3-4357-8db6-39124e4015a8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:26.199017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-96bd83d1-386a-4084-83c2-a2b5298cd55e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:26.215816 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-96bd83d1-386a-4084-83c2-a2b5298cd55e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1505 microversion: 2.1 time: 0.720347 Oct 10 23:27:26.221398 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1332/2707] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:25 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1505 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:26.303019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-780d2c77-dfd3-4357-8db6-39124e4015a8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:26.316895 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-780d2c77-dfd3-4357-8db6-39124e4015a8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379" status: 200 len: 1361 microversion: 2.1 time: 0.582613 Oct 10 23:27:26.318105 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1376/2708] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:25 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 => generated 1361 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:26.407624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ed8d3ca8-98fc-4354-baa7-0f1ba860a781 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:26.408661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ed8d3ca8-98fc-4354-baa7-0f1ba860a781 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:26.415685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed8d3ca8-98fc-4354-baa7-0f1ba860a781 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:26.416396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed8d3ca8-98fc-4354-baa7-0f1ba860a781 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:26.416840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed8d3ca8-98fc-4354-baa7-0f1ba860a781 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:26.417597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed8d3ca8-98fc-4354-baa7-0f1ba860a781 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:26.418260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed8d3ca8-98fc-4354-baa7-0f1ba860a781 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:26.418840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed8d3ca8-98fc-4354-baa7-0f1ba860a781 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:26.470932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-41dc5d00-4d7f-463f-8e34-7953ce9e9f17 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:26.472999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-41dc5d00-4d7f-463f-8e34-7953ce9e9f17 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:26.490840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41dc5d00-4d7f-463f-8e34-7953ce9e9f17 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:26.491675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41dc5d00-4d7f-463f-8e34-7953ce9e9f17 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:26.492393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41dc5d00-4d7f-463f-8e34-7953ce9e9f17 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:26.493146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41dc5d00-4d7f-463f-8e34-7953ce9e9f17 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:26.493656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41dc5d00-4d7f-463f-8e34-7953ce9e9f17 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:26.494090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41dc5d00-4d7f-463f-8e34-7953ce9e9f17 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:26.803010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ed8d3ca8-98fc-4354-baa7-0f1ba860a781 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:26.852962 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ed8d3ca8-98fc-4354-baa7-0f1ba860a781 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee" status: 200 len: 1314 microversion: 2.1 time: 0.455011 Oct 10 23:27:26.872323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-41dc5d00-4d7f-463f-8e34-7953ce9e9f17 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:26.877418 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1333/2709] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:26 2022] GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:26.882105 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-41dc5d00-4d7f-463f-8e34-7953ce9e9f17 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" status: 200 len: 1520 microversion: 2.1 time: 0.416732 Oct 10 23:27:26.883625 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1377/2710] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:26 2022] GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 => generated 1520 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:27:26.888290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-1a1b523a-21b5-4ed2-a06f-55af90626c9d req-5881b4ad-28a3-40df-87bd-a265debc603c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d268c6-2b9d-4858-b67f-1dced7831838", "name": "network-vif-plugged", "status": "completed", "tag": "3a4df9ab-2215-474a-bffb-e5b388a62d2d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:26.905753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2a403183-2bb1-4e03-bdad-4f00191e3ea3 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662a89e280>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:26.906707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1a1b523a-21b5-4ed2-a06f-55af90626c9d req-5881b4ad-28a3-40df-87bd-a265debc603c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:26.908273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1a1b523a-21b5-4ed2-a06f-55af90626c9d req-5881b4ad-28a3-40df-87bd-a265debc603c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:26.909152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1a1b523a-21b5-4ed2-a06f-55af90626c9d req-5881b4ad-28a3-40df-87bd-a265debc603c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:26.928567 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-1a1b523a-21b5-4ed2-a06f-55af90626c9d req-5881b4ad-28a3-40df-87bd-a265debc603c service nova] Creating event network-vif-plugged:3a4df9ab-2215-474a-bffb-e5b388a62d2d for instance a3d268c6-2b9d-4858-b67f-1dced7831838 on n-h2-860864-2 Oct 10 23:27:26.965938 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-1a1b523a-21b5-4ed2-a06f-55af90626c9d req-5881b4ad-28a3-40df-87bd-a265debc603c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060666 Oct 10 23:27:26.969277 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1378/2711] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:27:26.978870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4be7d88d-60f8-4399-a1da-56142118ba02 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:26.979949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4be7d88d-60f8-4399-a1da-56142118ba02 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:26.988893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4be7d88d-60f8-4399-a1da-56142118ba02 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:26.989679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4be7d88d-60f8-4399-a1da-56142118ba02 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:26.990599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4be7d88d-60f8-4399-a1da-56142118ba02 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:26.991777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4be7d88d-60f8-4399-a1da-56142118ba02 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:26.992456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4be7d88d-60f8-4399-a1da-56142118ba02 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:26.993117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4be7d88d-60f8-4399-a1da-56142118ba02 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:27.042598 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2a403183-2bb1-4e03-bdad-4f00191e3ea3 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 200 len: 1423 microversion: 2.1 time: 0.157688 Oct 10 23:27:27.045930 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1334/2712] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:26 2022] GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 1423 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:27.059554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-70870bfe-5496-4ecb-8a9c-1508b8d2a59d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.139"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:27.071462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-70870bfe-5496-4ecb-8a9c-1508b8d2a59d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:27.080439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70870bfe-5496-4ecb-8a9c-1508b8d2a59d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:27.081439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70870bfe-5496-4ecb-8a9c-1508b8d2a59d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:27.082120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70870bfe-5496-4ecb-8a9c-1508b8d2a59d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:27.083077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70870bfe-5496-4ecb-8a9c-1508b8d2a59d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:27.083791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70870bfe-5496-4ecb-8a9c-1508b8d2a59d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:27.084443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70870bfe-5496-4ecb-8a9c-1508b8d2a59d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:27.139350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70870bfe-5496-4ecb-8a9c-1508b8d2a59d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "refresh_cache-dcb66932-449d-48cd-9a36-485807874e27" {{(pid=120614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 23:27:27.143305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70870bfe-5496-4ecb-8a9c-1508b8d2a59d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquired lock "refresh_cache-dcb66932-449d-48cd-9a36-485807874e27" {{(pid=120614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 23:27:27.173151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4be7d88d-60f8-4399-a1da-56142118ba02 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:27.197305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4be7d88d-60f8-4399-a1da-56142118ba02 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:27.199849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4be7d88d-60f8-4399-a1da-56142118ba02 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3fb6dfdf3264af282e44d68d84153f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9492b98195e046748b5c136552563152', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:27.226789 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4be7d88d-60f8-4399-a1da-56142118ba02 tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 200 len: 1537 microversion: 2.91 time: 0.253920 Oct 10 23:27:27.228532 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1379/2713] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:27:26 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 1537 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:27:27.258634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7eac77a3-56e2-46b7-816e-3348daced8e4 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:27.260940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7eac77a3-56e2-46b7-816e-3348daced8e4 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:27.269399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7eac77a3-56e2-46b7-816e-3348daced8e4 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:27.270004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7eac77a3-56e2-46b7-816e-3348daced8e4 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:27.270511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7eac77a3-56e2-46b7-816e-3348daced8e4 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:27.271467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7eac77a3-56e2-46b7-816e-3348daced8e4 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:27.272212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7eac77a3-56e2-46b7-816e-3348daced8e4 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:27.272902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7eac77a3-56e2-46b7-816e-3348daced8e4 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:27.831154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7eac77a3-56e2-46b7-816e-3348daced8e4 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:27.849256 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7eac77a3-56e2-46b7-816e-3348daced8e4 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1505 microversion: 2.1 time: 0.604840 Oct 10 23:27:27.853037 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1380/2714] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:27 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1505 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:27.870598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1ddc9aa6-9a83-4f81-94e0-1ac9eadc4a8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:27.877106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1ddc9aa6-9a83-4f81-94e0-1ac9eadc4a8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:27.903944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ddc9aa6-9a83-4f81-94e0-1ac9eadc4a8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:27.908046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ddc9aa6-9a83-4f81-94e0-1ac9eadc4a8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:27.909002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ddc9aa6-9a83-4f81-94e0-1ac9eadc4a8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:27.913362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ddc9aa6-9a83-4f81-94e0-1ac9eadc4a8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:27.915625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ddc9aa6-9a83-4f81-94e0-1ac9eadc4a8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:27.916572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ddc9aa6-9a83-4f81-94e0-1ac9eadc4a8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:28.615379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1ddc9aa6-9a83-4f81-94e0-1ac9eadc4a8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:28.630717 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1ddc9aa6-9a83-4f81-94e0-1ac9eadc4a8f tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379" status: 200 len: 1361 microversion: 2.1 time: 0.772772 Oct 10 23:27:28.646763 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1381/2715] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:27 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 => generated 1361 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:28.651985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d515fbcc-9af1-4521-951d-ebc9a342da7c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:28.652841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d515fbcc-9af1-4521-951d-ebc9a342da7c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:28.661399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d515fbcc-9af1-4521-951d-ebc9a342da7c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:28.662180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d515fbcc-9af1-4521-951d-ebc9a342da7c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:28.662808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d515fbcc-9af1-4521-951d-ebc9a342da7c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:28.663675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d515fbcc-9af1-4521-951d-ebc9a342da7c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:28.664471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d515fbcc-9af1-4521-951d-ebc9a342da7c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:28.665234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d515fbcc-9af1-4521-951d-ebc9a342da7c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:29.139727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d515fbcc-9af1-4521-951d-ebc9a342da7c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:29.156921 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d515fbcc-9af1-4521-951d-ebc9a342da7c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee" status: 200 len: 1314 microversion: 2.1 time: 0.508626 Oct 10 23:27:29.159609 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1382/2716] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:28 2022] GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:29.169334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-51c374a9-9bbb-4dec-a916-552d64c8069a tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f6633bcbca0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:29.277780 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-51c374a9-9bbb-4dec-a916-552d64c8069a tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 200 len: 1423 microversion: 2.1 time: 0.114668 Oct 10 23:27:29.279928 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1383/2717] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:29 2022] GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 1423 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:29.292556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fff76b13-aa8e-42f8-85dd-57718d77572a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:29.293712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fff76b13-aa8e-42f8-85dd-57718d77572a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] [instance: 2031b270-ebc4-4583-8a2c-086ad7842cba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:29.302159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fff76b13-aa8e-42f8-85dd-57718d77572a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:29.302984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fff76b13-aa8e-42f8-85dd-57718d77572a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:29.304239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fff76b13-aa8e-42f8-85dd-57718d77572a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:29.305366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fff76b13-aa8e-42f8-85dd-57718d77572a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:29.306667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fff76b13-aa8e-42f8-85dd-57718d77572a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:29.307348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fff76b13-aa8e-42f8-85dd-57718d77572a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:29.352519 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-fff76b13-aa8e-42f8-85dd-57718d77572a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] HTTP exception thrown: Instance 2031b270-ebc4-4583-8a2c-086ad7842cba could not be found. Oct 10 23:27:29.355384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fff76b13-aa8e-42f8-85dd-57718d77572a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Request method failure captured: Oct 10 23:27:29.355384 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba HTTP/1.1 Oct 10 23:27:29.355384 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:27:29.355384 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:27:29.355384 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:27:29.355384 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:27:29.355384 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:27:29.355384 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:27:29.355384 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:27:29.355384 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:27:29.355384 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKmeTgeUEU3RVzSb8Bqe3nILzILg31Wad1sBYZ1blKVyZ04l72p9p3z8i0rk62v6yQBSUXKe9K196TDQ43GCY4W-i-simp7t8TF1ewvVumCRu2lJTUgz7bj5TGIBHEdfOCLrS-ssX0LYa1ffCqeRSf5Ya0b1E3WKfGwBeuDBbGXehjU Oct 10 23:27:29.355384 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:27:29.355384 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:27:29.355384 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:27:29.355384 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:27:29.355384 n-d-860864-2 devstack@n-api.service[120613]: X-Openstack-Nova-Api-Version: 2.91 Oct 10 23:27:29.355384 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:27:29.355384 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:27:29.355384 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 9492b98195e046748b5c136552563152 Oct 10 23:27:29.355384 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1325904182 Oct 10 23:27:29.355384 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:27:29.355384 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:27:29.356856 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9492b98195e046748b5c136552563152"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9492b98195e046748b5c136552563152"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9492b98195e046748b5c136552563152"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9492b98195e046748b5c136552563152", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:27:29.356856 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1325904182 Oct 10 23:27:29.356856 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 9492b98195e046748b5c136552563152 Oct 10 23:27:29.356856 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1325904182 Oct 10 23:27:29.356856 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-UnshelveToHostMultiNodesTest-1325904182-project Oct 10 23:27:29.356856 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:27:29.356856 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:27:29.356856 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: f3fb6dfdf3264af282e44d68d84153f1 Oct 10 23:27:29.356856 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1325904182-project Oct 10 23:27:29.356856 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:27:29.356856 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 2031b270-ebc4-4583-8a2c-086ad7842cba could not be found. Oct 10 23:27:29.356856 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '2031b270-ebc4-4583-8a2c-086ad7842cba'} Oct 10 23:27:29.357651 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:27:29.357651 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:27:29.357651 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:27:29.357651 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:27:29.357651 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:27:29.357651 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:27:29.357651 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:27:29.357651 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:27:29.357651 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:27:29.357651 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:27:29.357651 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2031b270-ebc4-4583-8a2c-086ad7842cba could not be found. Oct 10 23:27:29.357651 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:27:29.357651 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:27:29.357651 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:27:29.357651 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:27:29.357651 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:27:29.357651 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:27:29.357651 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:27:29.357651 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:27:29.357651 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:27:29.359174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:27:29.359174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:27:29.359174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:27:29.359174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:27:29.359174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:27:29.359174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:27:29.359174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:27:29.359174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2031b270-ebc4-4583-8a2c-086ad7842cba could not be found. Oct 10 23:27:29.359174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:27:29.359174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:27:29.359174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:27:29.359174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:27:29.359174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:27:29.359174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:27:29.359174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:27:29.359174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:27:29.359174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2031b270-ebc4-4583-8a2c-086ad7842cba could not be found. Oct 10 23:27:29.359174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:27:29.363321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fff76b13-aa8e-42f8-85dd-57718d77572a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] Returning 404 to user: Instance 2031b270-ebc4-4583-8a2c-086ad7842cba could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:27:29.364601 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fff76b13-aa8e-42f8-85dd-57718d77572a tempest-UnshelveToHostMultiNodesTest-1325904182 tempest-UnshelveToHostMultiNodesTest-1325904182-project] 10.222.0.23 "GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba" status: 404 len: 111 microversion: 2.91 time: 0.083370 Oct 10 23:27:29.365717 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1384/2718] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:27:29 2022] GET /compute/v2.1/servers/2031b270-ebc4-4583-8a2c-086ad7842cba => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:27:29.371118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-974cd271-8e51-4093-b7a1-c1495881c260 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:29.372791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-974cd271-8e51-4093-b7a1-c1495881c260 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:29.380548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-974cd271-8e51-4093-b7a1-c1495881c260 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:29.381353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-974cd271-8e51-4093-b7a1-c1495881c260 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:29.382342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-974cd271-8e51-4093-b7a1-c1495881c260 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:29.383252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-974cd271-8e51-4093-b7a1-c1495881c260 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:29.383894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-974cd271-8e51-4093-b7a1-c1495881c260 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:29.384711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-974cd271-8e51-4093-b7a1-c1495881c260 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:29.839220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-974cd271-8e51-4093-b7a1-c1495881c260 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:29.855465 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-974cd271-8e51-4093-b7a1-c1495881c260 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1505 microversion: 2.1 time: 0.482965 Oct 10 23:27:29.856339 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1385/2719] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:29 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1505 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:29.864149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-05c28609-1a06-40d7-a798-208ee37fd126 req-ffbc10a1-4ac7-45db-ab40-7ab5e8ec7482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18753c2-80e8-4fea-b2ad-04fa1ae400ee", "name": "network-vif-plugged", "status": "completed", "tag": "2aba71f9-c43a-48db-ac3d-66f4596a4820"}, {"server_uuid": "92e9f63c-d49b-4a32-80b8-b729b8530379", "name": "network-vif-plugged", "status": "completed", "tag": "421d6fa0-dcfc-4162-835a-af03c580d3a7"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:29.904098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-05c28609-1a06-40d7-a798-208ee37fd126 req-ffbc10a1-4ac7-45db-ab40-7ab5e8ec7482 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:29.904617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-05c28609-1a06-40d7-a798-208ee37fd126 req-ffbc10a1-4ac7-45db-ab40-7ab5e8ec7482 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:29.905084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-05c28609-1a06-40d7-a798-208ee37fd126 req-ffbc10a1-4ac7-45db-ab40-7ab5e8ec7482 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:29.943873 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-05c28609-1a06-40d7-a798-208ee37fd126 req-ffbc10a1-4ac7-45db-ab40-7ab5e8ec7482 service nova] Creating event network-vif-plugged:2aba71f9-c43a-48db-ac3d-66f4596a4820 for instance e18753c2-80e8-4fea-b2ad-04fa1ae400ee on n-h1-860864-2 Oct 10 23:27:29.944386 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-05c28609-1a06-40d7-a798-208ee37fd126 req-ffbc10a1-4ac7-45db-ab40-7ab5e8ec7482 service nova] Creating event network-vif-plugged:421d6fa0-dcfc-4162-835a-af03c580d3a7 for instance 92e9f63c-d49b-4a32-80b8-b729b8530379 on n-h2-860864-2 Oct 10 23:27:29.988591 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-05c28609-1a06-40d7-a798-208ee37fd126 req-ffbc10a1-4ac7-45db-ab40-7ab5e8ec7482 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.130906 Oct 10 23:27:29.989214 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1386/2720] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:27:30.009471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-60760b21-3091-4e97-a8ad-91f2a87feee8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:30.020739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-60760b21-3091-4e97-a8ad-91f2a87feee8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:30.044474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60760b21-3091-4e97-a8ad-91f2a87feee8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:30.045564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60760b21-3091-4e97-a8ad-91f2a87feee8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:30.048932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60760b21-3091-4e97-a8ad-91f2a87feee8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:30.050081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60760b21-3091-4e97-a8ad-91f2a87feee8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:30.052991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60760b21-3091-4e97-a8ad-91f2a87feee8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:30.053736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60760b21-3091-4e97-a8ad-91f2a87feee8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:30.533852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-60760b21-3091-4e97-a8ad-91f2a87feee8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:30.553027 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-60760b21-3091-4e97-a8ad-91f2a87feee8 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379" status: 200 len: 1361 microversion: 2.1 time: 0.556614 Oct 10 23:27:30.553688 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1387/2721] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:29 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 => generated 1361 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:30.575877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5b69db5f-6bea-402e-8a13-8b398c55aa4c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:30.576800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5b69db5f-6bea-402e-8a13-8b398c55aa4c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:30.590174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b69db5f-6bea-402e-8a13-8b398c55aa4c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:30.591334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b69db5f-6bea-402e-8a13-8b398c55aa4c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:30.591951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b69db5f-6bea-402e-8a13-8b398c55aa4c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:30.592849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b69db5f-6bea-402e-8a13-8b398c55aa4c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:30.593500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b69db5f-6bea-402e-8a13-8b398c55aa4c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:30.594121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b69db5f-6bea-402e-8a13-8b398c55aa4c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:31.132085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5b69db5f-6bea-402e-8a13-8b398c55aa4c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:31.166725 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5b69db5f-6bea-402e-8a13-8b398c55aa4c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee" status: 200 len: 1314 microversion: 2.1 time: 0.594795 Oct 10 23:27:31.167634 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1388/2722] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:30 2022] GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:31.184025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-70870bfe-5496-4ecb-8a9c-1508b8d2a59d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Building network info cache for instance {{(pid=120614) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 23:27:31.218939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1a420217-2359-4881-be00-ea8d38606cc8 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f6633b82430>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:31.338031 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1a420217-2359-4881-be00-ea8d38606cc8 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 200 len: 1423 microversion: 2.1 time: 0.146194 Oct 10 23:27:31.347614 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1389/2723] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:31 2022] GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 1423 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:31.372531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-535368d0-212e-4693-b616-e117960d075e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:31.373181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-535368d0-212e-4693-b616-e117960d075e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:31.385441 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-535368d0-212e-4693-b616-e117960d075e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:31.385914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-535368d0-212e-4693-b616-e117960d075e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:31.386521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-535368d0-212e-4693-b616-e117960d075e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:31.387619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-535368d0-212e-4693-b616-e117960d075e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:31.389892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-535368d0-212e-4693-b616-e117960d075e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:31.390530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-535368d0-212e-4693-b616-e117960d075e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:32.513656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-535368d0-212e-4693-b616-e117960d075e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:32.554012 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-535368d0-212e-4693-b616-e117960d075e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1505 microversion: 2.1 time: 1.209261 Oct 10 23:27:32.559977 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1390/2724] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:31 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1505 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:32.570947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-cd79f042-87f6-4474-9660-7c2a4a59e362 req-0acfe41c-af0b-4519-b1b4-f5f735fb4443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcb66932-449d-48cd-9a36-485807874e27", "tag": "c68baca6-c92c-4e7a-bef8-b00039aec8ff"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:32.614068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cd79f042-87f6-4474-9660-7c2a4a59e362 req-0acfe41c-af0b-4519-b1b4-f5f735fb4443 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:32.617484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cd79f042-87f6-4474-9660-7c2a4a59e362 req-0acfe41c-af0b-4519-b1b4-f5f735fb4443 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:32.619439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cd79f042-87f6-4474-9660-7c2a4a59e362 req-0acfe41c-af0b-4519-b1b4-f5f735fb4443 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:32.675823 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-cd79f042-87f6-4474-9660-7c2a4a59e362 req-0acfe41c-af0b-4519-b1b4-f5f735fb4443 service nova] Creating event network-changed:c68baca6-c92c-4e7a-bef8-b00039aec8ff for instance dcb66932-449d-48cd-9a36-485807874e27 on n-h1-860864-2 Oct 10 23:27:32.686292 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-cd79f042-87f6-4474-9660-7c2a4a59e362 req-0acfe41c-af0b-4519-b1b4-f5f735fb4443 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124581 Oct 10 23:27:32.687543 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1391/2725] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:27:32.694591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7a56f7a0-c45f-49fe-aadc-489d7b31e1c0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:32.696377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7a56f7a0-c45f-49fe-aadc-489d7b31e1c0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:32.707114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a56f7a0-c45f-49fe-aadc-489d7b31e1c0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:32.708179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a56f7a0-c45f-49fe-aadc-489d7b31e1c0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:32.709871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a56f7a0-c45f-49fe-aadc-489d7b31e1c0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:32.711081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a56f7a0-c45f-49fe-aadc-489d7b31e1c0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:32.712477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a56f7a0-c45f-49fe-aadc-489d7b31e1c0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:32.713275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a56f7a0-c45f-49fe-aadc-489d7b31e1c0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:32.755826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-70870bfe-5496-4ecb-8a9c-1508b8d2a59d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Updating instance_info_cache with network_info: [{"id": "c68baca6-c92c-4e7a-bef8-b00039aec8ff", "address": "fa:16:3e:71:f8:ff", "network": {"id": "de4c0e75-354a-475e-8f5b-aa897d475c60", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2117360887-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "43bf1bebb02c4359a949d820dd31c49e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc68baca6-c9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120614) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 23:27:32.772723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70870bfe-5496-4ecb-8a9c-1508b8d2a59d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Releasing lock "refresh_cache-dcb66932-449d-48cd-9a36-485807874e27" {{(pid=120614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 23:27:32.773907 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-70870bfe-5496-4ecb-8a9c-1508b8d2a59d tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "POST /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27/action" status: 202 len: 0 microversion: 2.1 time: 5.726756 Oct 10 23:27:32.774997 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1335/2726] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:27:27 2022] POST /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27/action => generated 0 bytes in 5728 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 23:27:32.794638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f49476b5-93b0-4e7b-b806-dc6b56a05c41 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:32.795538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f49476b5-93b0-4e7b-b806-dc6b56a05c41 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:32.833333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f49476b5-93b0-4e7b-b806-dc6b56a05c41 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:32.833988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f49476b5-93b0-4e7b-b806-dc6b56a05c41 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:32.834454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f49476b5-93b0-4e7b-b806-dc6b56a05c41 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:32.843170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f49476b5-93b0-4e7b-b806-dc6b56a05c41 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:32.843818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f49476b5-93b0-4e7b-b806-dc6b56a05c41 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:32.844292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f49476b5-93b0-4e7b-b806-dc6b56a05c41 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:33.681008 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f49476b5-93b0-4e7b-b806-dc6b56a05c41 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:33.701177 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f49476b5-93b0-4e7b-b806-dc6b56a05c41 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee" status: 200 len: 1463 microversion: 2.1 time: 0.924877 Oct 10 23:27:33.715622 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1336/2727] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:32 2022] GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee => generated 1463 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:33.727787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-27993ee9-7914-41eb-9cec-cab6be981676 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662a88ae50>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:33.819801 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-27993ee9-7914-41eb-9cec-cab6be981676 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 200 len: 1423 microversion: 2.1 time: 0.102766 Oct 10 23:27:33.829262 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1337/2728] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:33 2022] GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 1423 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:33.840201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-da5757da-6a92-43cc-9a5a-5879a12dc644 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.139"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:33.850089 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-da5757da-6a92-43cc-9a5a-5879a12dc644 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:33.870374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da5757da-6a92-43cc-9a5a-5879a12dc644 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:33.871160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da5757da-6a92-43cc-9a5a-5879a12dc644 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:33.874129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da5757da-6a92-43cc-9a5a-5879a12dc644 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:33.878895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da5757da-6a92-43cc-9a5a-5879a12dc644 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:33.880187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da5757da-6a92-43cc-9a5a-5879a12dc644 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:33.881816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da5757da-6a92-43cc-9a5a-5879a12dc644 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:33.964780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da5757da-6a92-43cc-9a5a-5879a12dc644 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "refresh_cache-f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" {{(pid=120614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 23:27:33.966561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da5757da-6a92-43cc-9a5a-5879a12dc644 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquired lock "refresh_cache-f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" {{(pid=120614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 23:27:34.362735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7a56f7a0-c45f-49fe-aadc-489d7b31e1c0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:34.378641 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7a56f7a0-c45f-49fe-aadc-489d7b31e1c0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379" status: 200 len: 1547 microversion: 2.1 time: 1.688890 Oct 10 23:27:34.393352 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1392/2729] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:32 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 => generated 1547 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:34.417442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-19cdc288-c19e-4935-a7a4-2a725756b31f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:34.418533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-19cdc288-c19e-4935-a7a4-2a725756b31f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:34.441943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19cdc288-c19e-4935-a7a4-2a725756b31f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:34.444401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19cdc288-c19e-4935-a7a4-2a725756b31f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:34.445018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19cdc288-c19e-4935-a7a4-2a725756b31f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:34.446699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19cdc288-c19e-4935-a7a4-2a725756b31f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:34.450879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19cdc288-c19e-4935-a7a4-2a725756b31f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:34.451654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19cdc288-c19e-4935-a7a4-2a725756b31f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:34.976300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-19cdc288-c19e-4935-a7a4-2a725756b31f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:34.979118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:27:34.998670 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-19cdc288-c19e-4935-a7a4-2a725756b31f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1505 microversion: 2.1 time: 0.603392 Oct 10 23:27:35.008001 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1393/2730] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:34 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1505 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:35.013252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3fa2eb48-2e4c-42d4-babf-a89a842ddbcc tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:35.013836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3fa2eb48-2e4c-42d4-babf-a89a842ddbcc tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:35.043235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fa2eb48-2e4c-42d4-babf-a89a842ddbcc tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:35.051409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fa2eb48-2e4c-42d4-babf-a89a842ddbcc tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:35.052128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fa2eb48-2e4c-42d4-babf-a89a842ddbcc tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:35.053115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fa2eb48-2e4c-42d4-babf-a89a842ddbcc tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:35.053789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fa2eb48-2e4c-42d4-babf-a89a842ddbcc tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:35.054401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fa2eb48-2e4c-42d4-babf-a89a842ddbcc tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:35.597782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3fa2eb48-2e4c-42d4-babf-a89a842ddbcc tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:35.609315 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3fa2eb48-2e4c-42d4-babf-a89a842ddbcc tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1463 microversion: 2.1 time: 0.599807 Oct 10 23:27:35.611399 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1394/2731] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:35 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1463 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:35.624069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-218e3959-9b3d-433a-a813-4a434e193aff tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:35.625586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-218e3959-9b3d-433a-a813-4a434e193aff tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:35.640403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-218e3959-9b3d-433a-a813-4a434e193aff tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:35.640835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-218e3959-9b3d-433a-a813-4a434e193aff tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:35.644551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-218e3959-9b3d-433a-a813-4a434e193aff tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:35.645323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-218e3959-9b3d-433a-a813-4a434e193aff tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:35.648777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-218e3959-9b3d-433a-a813-4a434e193aff tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:35.649465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-218e3959-9b3d-433a-a813-4a434e193aff tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:35.956276 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-218e3959-9b3d-433a-a813-4a434e193aff tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.342541 Oct 10 23:27:35.956276 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1395/2732] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Oct 10 23:27:35 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-interface => generated 284 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:27:35.961207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-15fa8d1c-8ab0-4f9f-8472-6ae933a8f19d tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f6633b0fca0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:36.055656 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-15fa8d1c-8ab0-4f9f-8472-6ae933a8f19d tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 200 len: 1423 microversion: 2.1 time: 0.098326 Oct 10 23:27:36.057800 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1396/2733] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:35 2022] GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 1423 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:36.078560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6db93cc1-4635-4a7c-b361-ac1fbe09f63f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1774742083", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "a3d268c6-2b9d-4858-b67f-1dced7831838"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:36.196479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-6db93cc1-4635-4a7c-b361-ac1fbe09f63f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] validate_networks() for None {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:27:37.864685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6db93cc1-4635-4a7c-b361-ac1fbe09f63f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:27:37.865931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6db93cc1-4635-4a7c-b361-ac1fbe09f63f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:27:37.866682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6db93cc1-4635-4a7c-b361-ac1fbe09f63f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:27:37.867425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6db93cc1-4635-4a7c-b361-ac1fbe09f63f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:27:37.868077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6db93cc1-4635-4a7c-b361-ac1fbe09f63f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:27:37.892999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6db93cc1-4635-4a7c-b361-ac1fbe09f63f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:37.893795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6db93cc1-4635-4a7c-b361-ac1fbe09f63f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:37.898174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6db93cc1-4635-4a7c-b361-ac1fbe09f63f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:37.899533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6db93cc1-4635-4a7c-b361-ac1fbe09f63f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:37.900255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6db93cc1-4635-4a7c-b361-ac1fbe09f63f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:37.900876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6db93cc1-4635-4a7c-b361-ac1fbe09f63f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:37.970489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-6db93cc1-4635-4a7c-b361-ac1fbe09f63f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Getting quotas for project 4b2326c88f134b7299d87d1133041421. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:27:37.983465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-6db93cc1-4635-4a7c-b361-ac1fbe09f63f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Getting quotas for user d536874058b64c6fbb05b3414b6b100c and project 4b2326c88f134b7299d87d1133041421. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:27:38.004771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6db93cc1-4635-4a7c-b361-ac1fbe09f63f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:27:38.009463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6db93cc1-4635-4a7c-b361-ac1fbe09f63f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: cc990503-6019-4b55-b2c9-24f72769eaca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:27:38.153166 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6db93cc1-4635-4a7c-b361-ac1fbe09f63f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.093472 Oct 10 23:27:38.159575 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1397/2734] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:27:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:27:38.178469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-232928d3-8d8b-4207-9617-427e3d629020 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:38.180878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-232928d3-8d8b-4207-9617-427e3d629020 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:38.207224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-232928d3-8d8b-4207-9617-427e3d629020 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:38.226090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-232928d3-8d8b-4207-9617-427e3d629020 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:38.230155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-232928d3-8d8b-4207-9617-427e3d629020 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:38.243335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-232928d3-8d8b-4207-9617-427e3d629020 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:38.244570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-232928d3-8d8b-4207-9617-427e3d629020 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:38.252890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-232928d3-8d8b-4207-9617-427e3d629020 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:38.951792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-232928d3-8d8b-4207-9617-427e3d629020 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:38.968457 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-232928d3-8d8b-4207-9617-427e3d629020 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1505 microversion: 2.1 time: 0.800476 Oct 10 23:27:38.970141 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1398/2735] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:38 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1505 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:38.975417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0b7d8edd-5dd4-416f-a090-b25f669c1676 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f6633b82430>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:39.129625 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0b7d8edd-5dd4-416f-a090-b25f669c1676 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 200 len: 1423 microversion: 2.1 time: 0.157750 Oct 10 23:27:39.138281 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1399/2736] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:38 2022] GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 1423 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:39.146726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a58cc749-0777-480e-b296-b7b4a2abe50d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:39.147455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a58cc749-0777-480e-b296-b7b4a2abe50d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: cc990503-6019-4b55-b2c9-24f72769eaca] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:39.501320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a58cc749-0777-480e-b296-b7b4a2abe50d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:39.519397 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a58cc749-0777-480e-b296-b7b4a2abe50d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca" status: 200 len: 1214 microversion: 2.1 time: 0.384947 Oct 10 23:27:39.520020 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1400/2737] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:39 2022] GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca => generated 1214 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:39.997190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d47f4ba3-39fa-4ac1-a5d8-c8a082cb99ee tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:39.997918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d47f4ba3-39fa-4ac1-a5d8-c8a082cb99ee tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:40.021816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d47f4ba3-39fa-4ac1-a5d8-c8a082cb99ee tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:40.025600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d47f4ba3-39fa-4ac1-a5d8-c8a082cb99ee tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:40.027799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d47f4ba3-39fa-4ac1-a5d8-c8a082cb99ee tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:40.033999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d47f4ba3-39fa-4ac1-a5d8-c8a082cb99ee tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:40.035199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d47f4ba3-39fa-4ac1-a5d8-c8a082cb99ee tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:40.039227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d47f4ba3-39fa-4ac1-a5d8-c8a082cb99ee tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:40.805061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d47f4ba3-39fa-4ac1-a5d8-c8a082cb99ee tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:40.818242 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d47f4ba3-39fa-4ac1-a5d8-c8a082cb99ee tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1485 microversion: 2.1 time: 0.820840 Oct 10 23:27:40.819458 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1401/2738] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:39 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1485 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:40.837856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-25c2feb0-392b-440f-8028-460546c601d1 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662acd89d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:40.997129 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-25c2feb0-392b-440f-8028-460546c601d1 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 200 len: 1423 microversion: 2.1 time: 0.176333 Oct 10 23:27:40.997780 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1402/2739] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:40 2022] GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 1423 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:41.012134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-02f54608-0d85-41bb-a70e-91965364b16a tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:41.014844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-02f54608-0d85-41bb-a70e-91965364b16a tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: cc990503-6019-4b55-b2c9-24f72769eaca] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:41.036004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02f54608-0d85-41bb-a70e-91965364b16a tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:41.036974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02f54608-0d85-41bb-a70e-91965364b16a tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:41.037890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02f54608-0d85-41bb-a70e-91965364b16a tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:41.040027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02f54608-0d85-41bb-a70e-91965364b16a tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:41.042003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02f54608-0d85-41bb-a70e-91965364b16a tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:41.043923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02f54608-0d85-41bb-a70e-91965364b16a tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:41.507393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-02f54608-0d85-41bb-a70e-91965364b16a tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:41.535332 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-02f54608-0d85-41bb-a70e-91965364b16a tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca" status: 200 len: 1266 microversion: 2.1 time: 0.528498 Oct 10 23:27:41.550896 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1403/2740] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:40 2022] GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca => generated 1266 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:41.557334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-14119c3a-d313-469d-9632-b91777534cce tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-225187177", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:41.835309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-14119c3a-d313-469d-9632-b91777534cce tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] validate_networks() for [('bc64707f-1e59-4628-9c89-b75279055564', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:27:43.606890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-14119c3a-d313-469d-9632-b91777534cce tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:27:43.607495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-14119c3a-d313-469d-9632-b91777534cce tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:27:43.607771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-14119c3a-d313-469d-9632-b91777534cce tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:27:43.608179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-14119c3a-d313-469d-9632-b91777534cce tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:27:43.608589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-14119c3a-d313-469d-9632-b91777534cce tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:27:43.656247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14119c3a-d313-469d-9632-b91777534cce tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:43.661960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14119c3a-d313-469d-9632-b91777534cce tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:43.662662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14119c3a-d313-469d-9632-b91777534cce tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:43.667135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14119c3a-d313-469d-9632-b91777534cce tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:43.667717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14119c3a-d313-469d-9632-b91777534cce tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:43.668179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14119c3a-d313-469d-9632-b91777534cce tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:43.745346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-14119c3a-d313-469d-9632-b91777534cce tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Getting quotas for project 44777346e7e541389e24fe42c4d46cbf. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:27:43.773408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-14119c3a-d313-469d-9632-b91777534cce tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Getting quotas for user 1f1aca1de5b64298b6e5d0ba3c554fb7 and project 44777346e7e541389e24fe42c4d46cbf. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:27:43.841677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-14119c3a-d313-469d-9632-b91777534cce tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:27:43.844225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-14119c3a-d313-469d-9632-b91777534cce tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:27:43.869073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:27:43.936181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:27:44.053974 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-14119c3a-d313-469d-9632-b91777534cce tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.507028 Oct 10 23:27:44.069291 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1404/2741] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:27:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 2524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:27:44.090513 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.network.neutron [None req-da5757da-6a92-43cc-9a5a-5879a12dc644 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] re-assign floating IP 172.25.5.139 from instance dcb66932-449d-48cd-9a36-485807874e27 Oct 10 23:27:44.114222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-deb13460-0b7a-4f71-9ec0-d7e73e526d34 req-2d3744d7-1d0a-4a03-a236-8f1900ea6ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92e9f63c-d49b-4a32-80b8-b729b8530379", "tag": "421d6fa0-dcfc-4162-835a-af03c580d3a7"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:44.132122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-deb13460-0b7a-4f71-9ec0-d7e73e526d34 req-2d3744d7-1d0a-4a03-a236-8f1900ea6ab9 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:44.132407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-deb13460-0b7a-4f71-9ec0-d7e73e526d34 req-2d3744d7-1d0a-4a03-a236-8f1900ea6ab9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:44.132799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-deb13460-0b7a-4f71-9ec0-d7e73e526d34 req-2d3744d7-1d0a-4a03-a236-8f1900ea6ab9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:44.170710 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-deb13460-0b7a-4f71-9ec0-d7e73e526d34 req-2d3744d7-1d0a-4a03-a236-8f1900ea6ab9 service nova] Creating event network-changed:421d6fa0-dcfc-4162-835a-af03c580d3a7 for instance 92e9f63c-d49b-4a32-80b8-b729b8530379 on n-h2-860864-2 Oct 10 23:27:44.192382 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-deb13460-0b7a-4f71-9ec0-d7e73e526d34 req-2d3744d7-1d0a-4a03-a236-8f1900ea6ab9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121323 Oct 10 23:27:44.207367 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1405/2742] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:27:44.257585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6de31576-e6ec-48a3-9691-98b8d23594e0 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f6633b739d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:44.360942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-da5757da-6a92-43cc-9a5a-5879a12dc644 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Building network info cache for instance {{(pid=120614) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 23:27:44.435767 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6de31576-e6ec-48a3-9691-98b8d23594e0 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 200 len: 1423 microversion: 2.1 time: 0.224802 Oct 10 23:27:44.437444 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1406/2743] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:44 2022] GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 1423 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:45.030604 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-406459cd-352b-4e49-8247-f0c7cf9dfe54 tempest-TenantUsagesNegativeTestJSON-1014697108 tempest-TenantUsagesNegativeTestJSON-1014697108-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-09T23%3A27%3A42.049605&end=2022-10-11T23%3A27%3A42.049605" status: 404 len: 112 microversion: - time: 0.592052 Oct 10 23:27:45.032769 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1407/2744] 10.222.0.23 () {58 vars in 1316 bytes} [Mon Oct 10 23:27:44 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-09T23%3A27%3A42.049605&end=2022-10-11T23%3A27%3A42.049605 => generated 112 bytes in 594 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 10 23:27:45.040778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-25e5684e-7f7c-4969-a375-f5d4e6a9f26b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:45.041972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-25e5684e-7f7c-4969-a375-f5d4e6a9f26b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: cc990503-6019-4b55-b2c9-24f72769eaca] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:45.066338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25e5684e-7f7c-4969-a375-f5d4e6a9f26b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:45.068506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25e5684e-7f7c-4969-a375-f5d4e6a9f26b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:45.069604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25e5684e-7f7c-4969-a375-f5d4e6a9f26b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:45.070944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25e5684e-7f7c-4969-a375-f5d4e6a9f26b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:45.071699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25e5684e-7f7c-4969-a375-f5d4e6a9f26b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:45.072433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25e5684e-7f7c-4969-a375-f5d4e6a9f26b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:45.262946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-25e5684e-7f7c-4969-a375-f5d4e6a9f26b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:45.279684 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-25e5684e-7f7c-4969-a375-f5d4e6a9f26b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca" status: 200 len: 1272 microversion: 2.1 time: 0.243705 Oct 10 23:27:45.283387 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1408/2745] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:45 2022] GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca => generated 1272 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:45.301035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-d15edbf9-cc15-4768-b3ac-f775894d251b req-2aecd11d-90f4-4be3-b63f-2d6ffc42a0ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcb66932-449d-48cd-9a36-485807874e27", "tag": "c68baca6-c92c-4e7a-bef8-b00039aec8ff"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:45.338736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d15edbf9-cc15-4768-b3ac-f775894d251b req-2aecd11d-90f4-4be3-b63f-2d6ffc42a0ee service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:45.339315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d15edbf9-cc15-4768-b3ac-f775894d251b req-2aecd11d-90f4-4be3-b63f-2d6ffc42a0ee service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:45.339674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d15edbf9-cc15-4768-b3ac-f775894d251b req-2aecd11d-90f4-4be3-b63f-2d6ffc42a0ee service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:45.397942 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-d15edbf9-cc15-4768-b3ac-f775894d251b req-2aecd11d-90f4-4be3-b63f-2d6ffc42a0ee service nova] Creating event network-changed:c68baca6-c92c-4e7a-bef8-b00039aec8ff for instance dcb66932-449d-48cd-9a36-485807874e27 on n-h1-860864-2 Oct 10 23:27:45.413632 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-d15edbf9-cc15-4768-b3ac-f775894d251b req-2aecd11d-90f4-4be3-b63f-2d6ffc42a0ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128281 Oct 10 23:27:45.427919 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1409/2746] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:27:45.456117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b03ba6c2-04b7-40b1-acdb-21f572421044 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:45.456736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b03ba6c2-04b7-40b1-acdb-21f572421044 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:45.661097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b03ba6c2-04b7-40b1-acdb-21f572421044 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:45.676129 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b03ba6c2-04b7-40b1-acdb-21f572421044 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1213 microversion: 2.1 time: 0.246198 Oct 10 23:27:45.687575 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1410/2747] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:45 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1213 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:45.708387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-05635d47-7128-4c7b-aa4b-2a04958ac7d8 tempest-TenantUsagesNegativeTestJSON-1014697108 tempest-TenantUsagesNegativeTestJSON-1014697108-project-admin] Calling method '.version_select at 0x7f6633a7f820>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:45.720834 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-05635d47-7128-4c7b-aa4b-2a04958ac7d8 tempest-TenantUsagesNegativeTestJSON-1014697108 tempest-TenantUsagesNegativeTestJSON-1014697108-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 10 23:27:45.733701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-05635d47-7128-4c7b-aa4b-2a04958ac7d8 tempest-TenantUsagesNegativeTestJSON-1014697108 tempest-TenantUsagesNegativeTestJSON-1014697108-project-admin] Request method failure captured: Oct 10 23:27:45.733701 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-simple-tenant-usage/75ba56bb64984433b34a496da3f24f76?start=2022-10-11T23%3A27%3A42.049605&end=2022-10-09T23%3A27%3A42.049605 HTTP/1.1 Oct 10 23:27:45.733701 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:27:45.733701 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:27:45.733701 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:27:45.733701 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:27:45.733701 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:27:45.733701 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:27:45.733701 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:27:45.733701 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:27:45.733701 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKpt92pcC5SScPwSLuaWrpKwYS_QaVel-qhX8MBJiiBXptRd-doq9BgMPzD2r-Q6tbqgk76fLikIxdacv-EuirsLDzbTFMOwuVaZyewD50UkIC0FkBMqbuMcyYBg44afRTmpzXMLwEYow78uNNbjybyp5lfk-pCpB61JBrCFXBMXWi0 Oct 10 23:27:45.733701 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:27:45.733701 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:27:45.733701 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:27:45.733701 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:27:45.733701 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:27:45.733701 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:27:45.733701 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 409f6feaf8254afcad938b601c0cac41 Oct 10 23:27:45.733701 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1014697108 Oct 10 23:27:45.733701 n-d-860864-2 devstack@n-api.service[120613]: X-Role: admin,member,reader Oct 10 23:27:45.733701 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: admin,member,reader Oct 10 23:27:45.735519 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/409f6feaf8254afcad938b601c0cac41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/409f6feaf8254afcad938b601c0cac41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/409f6feaf8254afcad938b601c0cac41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_409f6feaf8254afcad938b601c0cac41", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:27:45.735519 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1014697108 Oct 10 23:27:45.735519 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 409f6feaf8254afcad938b601c0cac41 Oct 10 23:27:45.735519 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1014697108 Oct 10 23:27:45.735519 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TenantUsagesNegativeTestJSON-1014697108-project-admin Oct 10 23:27:45.735519 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:27:45.735519 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:27:45.735519 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 6650aea3c9b54b80a241f05b8eeeebf6 Oct 10 23:27:45.735519 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1014697108-project-admin Oct 10 23:27:45.735519 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:27:45.735519 n-d-860864-2 devstack@n-api.service[120613]: exception: Invalid start time. The start time cannot occur after the end time. Oct 10 23:27:45.735519 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '75ba56bb64984433b34a496da3f24f76'} Oct 10 23:27:45.741988 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:27:45.741988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:27:45.741988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:27:45.741988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:27:45.741988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:27:45.741988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:27:45.741988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:27:45.741988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:27:45.741988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 23:27:45.741988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:27:45.741988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:27:45.741988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:27:45.741988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 10 23:27:45.741988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 10 23:27:45.741988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 10 23:27:45.741988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 10 23:27:45.741988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 10 23:27:45.741988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 10 23:27:45.741988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 10 23:27:45.743967 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:27:45.743967 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:27:45.743967 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:27:45.743967 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:27:45.743967 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:27:45.743967 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:27:45.743967 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:27:45.743967 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:27:45.743967 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 10 23:27:45.743967 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:27:45.743967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-05635d47-7128-4c7b-aa4b-2a04958ac7d8 tempest-TenantUsagesNegativeTestJSON-1014697108 tempest-TenantUsagesNegativeTestJSON-1014697108-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:27:45.743967 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-05635d47-7128-4c7b-aa4b-2a04958ac7d8 tempest-TenantUsagesNegativeTestJSON-1014697108 tempest-TenantUsagesNegativeTestJSON-1014697108-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/75ba56bb64984433b34a496da3f24f76?start=2022-10-11T23%3A27%3A42.049605&end=2022-10-09T23%3A27%3A42.049605" status: 400 len: 111 microversion: 2.1 time: 0.044382 Oct 10 23:27:45.744931 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1411/2748] 10.222.0.23 () {58 vars in 1412 bytes} [Mon Oct 10 23:27:45 2022] GET /compute/v2.1/os-simple-tenant-usage/75ba56bb64984433b34a496da3f24f76?start=2022-10-11T23%3A27%3A42.049605&end=2022-10-09T23%3A27%3A42.049605 => generated 111 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:27:45.744931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-18472d60-2529-4cd6-96b8-21c418c3a3bc tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662acd8b80>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:45.868137 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-18472d60-2529-4cd6-96b8-21c418c3a3bc tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 200 len: 1432 microversion: 2.1 time: 0.131002 Oct 10 23:27:45.868794 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1412/2749] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:45 2022] GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 1432 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:46.348839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b952934a-f135-41f9-8d65-a63dcdff890e tempest-TenantUsagesNegativeTestJSON-813170884 tempest-TenantUsagesNegativeTestJSON-813170884-project] Calling method '.version_select at 0x7f6633b0fe50>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:46.352352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b952934a-f135-41f9-8d65-a63dcdff890e tempest-TenantUsagesNegativeTestJSON-813170884 tempest-TenantUsagesNegativeTestJSON-813170884-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'f6594d45ad06467da29b7b860df69ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ba56bb64984433b34a496da3f24f76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:46.359500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b952934a-f135-41f9-8d65-a63dcdff890e tempest-TenantUsagesNegativeTestJSON-813170884 tempest-TenantUsagesNegativeTestJSON-813170884-project] Request method failure captured: Oct 10 23:27:46.359500 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-09T23%3A27%3A42.049605&end=2022-10-11T23%3A27%3A42.049605&detailed=1 HTTP/1.1 Oct 10 23:27:46.359500 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:27:46.359500 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:27:46.359500 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:27:46.359500 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:27:46.359500 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:27:46.359500 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:27:46.359500 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:27:46.359500 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:27:46.359500 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKpsI83snwu4zGw23Yo1YUUiacEbMxwsxEc881LZbxycT7KQuxZYv-KSLbg-idRyy6BzDQnyZyO0bDJYeNkG4BnE-fPASiGmXp6J6atLqjP4jO7iku9fl4Nmv1qQYn_huYlZcoK_OfrOIXxxkAYYHtNHh3G5z-POiqv6tfty1-3mk4M Oct 10 23:27:46.359500 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:27:46.359500 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:27:46.359500 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:27:46.359500 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:27:46.359500 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:27:46.359500 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:27:46.359500 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 75ba56bb64984433b34a496da3f24f76 Oct 10 23:27:46.359500 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-813170884 Oct 10 23:27:46.359500 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:27:46.359500 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:27:46.361625 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/75ba56bb64984433b34a496da3f24f76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/75ba56bb64984433b34a496da3f24f76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/75ba56bb64984433b34a496da3f24f76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_75ba56bb64984433b34a496da3f24f76", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:27:46.361625 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-813170884 Oct 10 23:27:46.361625 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 75ba56bb64984433b34a496da3f24f76 Oct 10 23:27:46.361625 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-813170884 Oct 10 23:27:46.361625 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TenantUsagesNegativeTestJSON-813170884-project Oct 10 23:27:46.361625 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:27:46.361625 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:27:46.361625 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: f6594d45ad06467da29b7b860df69ddf Oct 10 23:27:46.361625 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-813170884-project Oct 10 23:27:46.361625 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:27:46.361625 n-d-860864-2 devstack@n-api.service[120613]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 10 23:27:46.361625 n-d-860864-2 devstack@n-api.service[120613]: action_args: {} Oct 10 23:27:46.361625 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:27:46.362813 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:27:46.362813 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:27:46.362813 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:27:46.362813 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:27:46.362813 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:27:46.362813 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:27:46.362813 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:27:46.362813 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 23:27:46.362813 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:27:46.362813 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:27:46.362813 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:27:46.362813 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 10 23:27:46.362813 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 10 23:27:46.362813 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 10 23:27:46.362813 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 10 23:27:46.362813 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:27:46.362813 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:27:46.362813 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:27:46.362813 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:27:46.364319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:27:46.364319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:27:46.364319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:27:46.364319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:27:46.364319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:27:46.364319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:27:46.364319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:27:46.364319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:27:46.364319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:27:46.364319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:27:46.364319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 10 23:27:46.364319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:27:46.364319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:27:46.364319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:27:46.364319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:27:46.364319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:27:46.364319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:27:46.364319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:27:46.364319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:27:46.365825 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 10 23:27:46.365825 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:27:46.366252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b952934a-f135-41f9-8d65-a63dcdff890e tempest-TenantUsagesNegativeTestJSON-813170884 tempest-TenantUsagesNegativeTestJSON-813170884-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:27:46.368481 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b952934a-f135-41f9-8d65-a63dcdff890e tempest-TenantUsagesNegativeTestJSON-813170884 tempest-TenantUsagesNegativeTestJSON-813170884-project] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-09T23%3A27%3A42.049605&end=2022-10-11T23%3A27%3A42.049605&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.497522 Oct 10 23:27:46.370216 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1413/2750] 10.222.0.23 () {58 vars in 1335 bytes} [Mon Oct 10 23:27:45 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-09T23%3A27%3A42.049605&end=2022-10-11T23%3A27%3A42.049605&detailed=1 => generated 123 bytes in 501 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:27:46.408791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bbd1150c-6569-4fa5-8e70-a3c6f6e3fb74 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662accb820>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:46.549157 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bbd1150c-6569-4fa5-8e70-a3c6f6e3fb74 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 200 len: 1432 microversion: 2.1 time: 0.174242 Oct 10 23:27:46.553938 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1414/2751] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:46 2022] GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 1432 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:46.560658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-82dd26f6-b3a0-4f8e-9872-c69d9ee0178c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:46.571296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-82dd26f6-b3a0-4f8e-9872-c69d9ee0178c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: cc990503-6019-4b55-b2c9-24f72769eaca] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:46.583355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82dd26f6-b3a0-4f8e-9872-c69d9ee0178c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:46.605123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82dd26f6-b3a0-4f8e-9872-c69d9ee0178c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:46.607045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82dd26f6-b3a0-4f8e-9872-c69d9ee0178c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:46.609513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82dd26f6-b3a0-4f8e-9872-c69d9ee0178c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:46.615018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82dd26f6-b3a0-4f8e-9872-c69d9ee0178c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:46.628163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82dd26f6-b3a0-4f8e-9872-c69d9ee0178c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:46.978614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-82dd26f6-b3a0-4f8e-9872-c69d9ee0178c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:46.993290 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-82dd26f6-b3a0-4f8e-9872-c69d9ee0178c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca" status: 200 len: 1314 microversion: 2.1 time: 0.436742 Oct 10 23:27:46.996805 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1415/2752] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:46 2022] GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:47.011752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-29174871-52a8-4e14-af09-bd4c86cca807 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:47.013912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-29174871-52a8-4e14-af09-bd4c86cca807 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:47.033839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29174871-52a8-4e14-af09-bd4c86cca807 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:47.034516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29174871-52a8-4e14-af09-bd4c86cca807 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:47.036093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29174871-52a8-4e14-af09-bd4c86cca807 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:47.038541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29174871-52a8-4e14-af09-bd4c86cca807 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:47.039031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29174871-52a8-4e14-af09-bd4c86cca807 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:47.040610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29174871-52a8-4e14-af09-bd4c86cca807 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:47.374600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-29174871-52a8-4e14-af09-bd4c86cca807 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ef84f12c934e9aa1be187f2842b71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ae586965414012b4aeded0508deb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:47.409242 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-29174871-52a8-4e14-af09-bd4c86cca807 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 200 len: 1466 microversion: 2.1 time: 0.405668 Oct 10 23:27:47.411055 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1416/2753] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:46 2022] GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 1466 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:47.432256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5cb8c43a-d63e-4d12-8460-80fa07ffc129 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:47.433362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5cb8c43a-d63e-4d12-8460-80fa07ffc129 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:47.437397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:27:47.445018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cb8c43a-d63e-4d12-8460-80fa07ffc129 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:47.445915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cb8c43a-d63e-4d12-8460-80fa07ffc129 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:47.446687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cb8c43a-d63e-4d12-8460-80fa07ffc129 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:47.447894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cb8c43a-d63e-4d12-8460-80fa07ffc129 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:47.448374 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cb8c43a-d63e-4d12-8460-80fa07ffc129 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:47.460759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cb8c43a-d63e-4d12-8460-80fa07ffc129 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:47.606788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5cb8c43a-d63e-4d12-8460-80fa07ffc129 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:47.615884 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5cb8c43a-d63e-4d12-8460-80fa07ffc129 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1271 microversion: 2.1 time: 0.203994 Oct 10 23:27:47.616475 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1417/2754] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:47 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1271 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:47.635271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0b7cd714-91c3-4358-88ad-efea5761a467 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662aca9550>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:47.726596 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0b7cd714-91c3-4358-88ad-efea5761a467 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/70c986fa-2f30-4b1e-8ea0-fb6ffa975889" status: 200 len: 784 microversion: 2.1 time: 0.103128 Oct 10 23:27:47.726901 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1418/2755] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:47 2022] GET /compute/v2.1/images/70c986fa-2f30-4b1e-8ea0-fb6ffa975889 => generated 784 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:27:47.737046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-9f7c99f6-8f39-4da4-a33b-5f75c54a8797 req-057d06b4-d943-488c-ba88-298105fbe4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e94f4a-d35f-4d5f-abf3-4366dea38dd5", "tag": "cf591354-4fda-40dc-8468-a4548f51eeb1"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:47.779754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9f7c99f6-8f39-4da4-a33b-5f75c54a8797 req-057d06b4-d943-488c-ba88-298105fbe4f6 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:47.781770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9f7c99f6-8f39-4da4-a33b-5f75c54a8797 req-057d06b4-d943-488c-ba88-298105fbe4f6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:47.784780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9f7c99f6-8f39-4da4-a33b-5f75c54a8797 req-057d06b4-d943-488c-ba88-298105fbe4f6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:47.821828 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-9f7c99f6-8f39-4da4-a33b-5f75c54a8797 req-057d06b4-d943-488c-ba88-298105fbe4f6 service nova] Creating event network-changed:cf591354-4fda-40dc-8468-a4548f51eeb1 for instance f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 on n-h1-860864-2 Oct 10 23:27:47.835998 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-9f7c99f6-8f39-4da4-a33b-5f75c54a8797 req-057d06b4-d943-488c-ba88-298105fbe4f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107167 Oct 10 23:27:47.836628 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1419/2756] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:27:47.870750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7e66df52-8b8d-482d-a879-c23dcf43c3ba tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:47.921156 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7e66df52-8b8d-482d-a879-c23dcf43c3ba tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.078173 Oct 10 23:27:47.922860 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1420/2757] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:27:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:27:47.945987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cbdf3a5d-0bdd-4733-833d-2bc70f7c3d4c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662acf4430>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:49.343341 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cbdf3a5d-0bdd-4733-833d-2bc70f7c3d4c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "DELETE /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 204 len: 0 microversion: 2.1 time: 1.411261 Oct 10 23:27:49.345547 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1421/2758] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:47 2022] DELETE /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 0 bytes in 1413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:27:49.352680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bbf80c8a-70d4-492f-8ffe-dd9c0f14584a tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:49.353454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bbf80c8a-70d4-492f-8ffe-dd9c0f14584a tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: cc990503-6019-4b55-b2c9-24f72769eaca] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:49.383144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbf80c8a-70d4-492f-8ffe-dd9c0f14584a tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:49.383695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbf80c8a-70d4-492f-8ffe-dd9c0f14584a tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:49.385854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbf80c8a-70d4-492f-8ffe-dd9c0f14584a tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:49.387925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbf80c8a-70d4-492f-8ffe-dd9c0f14584a tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:49.389548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbf80c8a-70d4-492f-8ffe-dd9c0f14584a tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:49.390008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbf80c8a-70d4-492f-8ffe-dd9c0f14584a tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:49.766482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-da5757da-6a92-43cc-9a5a-5879a12dc644 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Updating instance_info_cache with network_info: [{"id": "c68baca6-c92c-4e7a-bef8-b00039aec8ff", "address": "fa:16:3e:71:f8:ff", "network": {"id": "de4c0e75-354a-475e-8f5b-aa897d475c60", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2117360887-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "43bf1bebb02c4359a949d820dd31c49e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc68baca6-c9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120614) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 23:27:49.803003 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-da5757da-6a92-43cc-9a5a-5879a12dc644 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Building network info cache for instance {{(pid=120614) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 23:27:49.879155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bbf80c8a-70d4-492f-8ffe-dd9c0f14584a tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:49.890409 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bbf80c8a-70d4-492f-8ffe-dd9c0f14584a tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca" status: 200 len: 1314 microversion: 2.1 time: 0.543452 Oct 10 23:27:49.891004 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1422/2759] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:49 2022] GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:49.911038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1d8eaa75-8d0f-43d3-aefc-9fb182a49448 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:49.911957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1d8eaa75-8d0f-43d3-aefc-9fb182a49448 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:49.931396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d8eaa75-8d0f-43d3-aefc-9fb182a49448 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:49.932150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d8eaa75-8d0f-43d3-aefc-9fb182a49448 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:49.932744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d8eaa75-8d0f-43d3-aefc-9fb182a49448 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:49.933667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d8eaa75-8d0f-43d3-aefc-9fb182a49448 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:49.934388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d8eaa75-8d0f-43d3-aefc-9fb182a49448 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:49.934813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d8eaa75-8d0f-43d3-aefc-9fb182a49448 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:50.068492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1d8eaa75-8d0f-43d3-aefc-9fb182a49448 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:50.093254 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1d8eaa75-8d0f-43d3-aefc-9fb182a49448 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1271 microversion: 2.1 time: 0.193763 Oct 10 23:27:50.096312 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1423/2760] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:49 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1271 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:50.119737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7d359794-1828-4cd9-9319-5f65c32351c7 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f6633ba3ee0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:50.165032 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-7d359794-1828-4cd9-9319-5f65c32351c7 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] HTTP exception thrown: Image not found. Oct 10 23:27:50.168687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7d359794-1828-4cd9-9319-5f65c32351c7 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Request method failure captured: Oct 10 23:27:50.168687 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 HTTP/1.1 Oct 10 23:27:50.168687 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:27:50.168687 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:27:50.168687 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:27:50.168687 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:27:50.168687 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:27:50.168687 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:27:50.168687 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:27:50.168687 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:27:50.168687 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKoqXKQlwCk9uKa3IrAGtd8C5xqhQAVk7aDyux8FQofTCZa9P3LOqi1r1yBNdD326XOM01daw7veG6kPv9w5pX-aVpeQYWc2fE-bz6p_RMovohUUF2zi1h8VJqN274Bi0xbY8Ln-JQhpPoG1vziC7mv_Th4z8d7YN86S81dxQd-9t40 Oct 10 23:27:50.168687 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:27:50.168687 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:27:50.168687 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:27:50.168687 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:27:50.168687 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:27:50.168687 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:27:50.168687 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: c4ae586965414012b4aeded0508deb4e Oct 10 23:27:50.168687 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesOneServerTestJSON-1028913219 Oct 10 23:27:50.168687 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:27:50.168687 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:27:50.171946 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c4ae586965414012b4aeded0508deb4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4ae586965414012b4aeded0508deb4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4ae586965414012b4aeded0508deb4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c4ae586965414012b4aeded0508deb4e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:27:50.171946 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesOneServerTestJSON-1028913219 Oct 10 23:27:50.171946 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: c4ae586965414012b4aeded0508deb4e Oct 10 23:27:50.171946 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1028913219 Oct 10 23:27:50.171946 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesOneServerTestJSON-1028913219-project Oct 10 23:27:50.171946 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:27:50.171946 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:27:50.171946 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 80ef84f12c934e9aa1be187f2842b71f Oct 10 23:27:50.171946 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesOneServerTestJSON-1028913219-project Oct 10 23:27:50.171946 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:27:50.171946 n-d-860864-2 devstack@n-api.service[120613]: exception: Image not found. Oct 10 23:27:50.171946 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '70baf84f-b4b9-4814-8b82-b56a307a9b06'} Oct 10 23:27:50.171946 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:27:50.174299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:27:50.174299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 23:27:50.174299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 23:27:50.174299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:27:50.174299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:27:50.174299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 23:27:50.174299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 23:27:50.174299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:27:50.174299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:27:50.174299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 23:27:50.174299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 23:27:50.174299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 23:27:50.174299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 23:27:50.174299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:27:50.174299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:27:50.174299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:27:50.174299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:27:50.174299 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 70baf84f-b4b9-4814-8b82-b56a307a9b06 Oct 10 23:27:50.176687 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:27:50.176687 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:27:50.176687 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:27:50.176687 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:27:50.176687 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 10 23:27:50.176687 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 10 23:27:50.176687 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 23:27:50.176687 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 23:27:50.176687 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 23:27:50.176687 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 23:27:50.176687 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 23:27:50.176687 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 23:27:50.176687 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 23:27:50.176687 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 23:27:50.176687 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:27:50.176687 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:27:50.176687 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 23:27:50.176687 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 23:27:50.176687 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:27:50.176687 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:27:50.179320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 23:27:50.179320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 23:27:50.179320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 23:27:50.179320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 23:27:50.179320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:27:50.179320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:27:50.179320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:27:50.179320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:27:50.179320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 70baf84f-b4b9-4814-8b82-b56a307a9b06 could not be found. Oct 10 23:27:50.179320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:27:50.179320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:27:50.179320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:27:50.179320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:27:50.179320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:27:50.179320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:27:50.179320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:27:50.179320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:27:50.179320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:27:50.179320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:27:50.181796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:27:50.181796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:27:50.181796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 10 23:27:50.181796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 23:27:50.181796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 23:27:50.181796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:27:50.181796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:27:50.181796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:27:50.181796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:27:50.181796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:27:50.181796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:27:50.181796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:27:50.181796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:27:50.181796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 23:27:50.181796 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:27:50.181796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7d359794-1828-4cd9-9319-5f65c32351c7 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Returning 404 to user: Image not found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:27:50.181796 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7d359794-1828-4cd9-9319-5f65c32351c7 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 404 len: 62 microversion: 2.1 time: 0.080254 Oct 10 23:27:50.184037 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1424/2761] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:50 2022] GET /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:27:50.212790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-53ae75b7-b0f4-44d2-936f-89fdb6350d81 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1432191732"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:50.218758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-53ae75b7-b0f4-44d2-936f-89fdb6350d81 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:50.238393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53ae75b7-b0f4-44d2-936f-89fdb6350d81 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:50.239056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53ae75b7-b0f4-44d2-936f-89fdb6350d81 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:50.240396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53ae75b7-b0f4-44d2-936f-89fdb6350d81 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:50.241243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53ae75b7-b0f4-44d2-936f-89fdb6350d81 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:50.241824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53ae75b7-b0f4-44d2-936f-89fdb6350d81 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:50.242332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53ae75b7-b0f4-44d2-936f-89fdb6350d81 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:50.684385 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-53ae75b7-b0f4-44d2-936f-89fdb6350d81 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "POST /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f/action" status: 202 len: 0 microversion: 2.1 time: 0.481965 Oct 10 23:27:50.685082 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1425/2762] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:27:50 2022] POST /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 23:27:50.721149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-93bf8887-a7bf-4f5d-bb39-867c78b8d4bc req-da109ddf-41c1-4554-a64f-3bf275630c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b64a0f12-ba9a-4074-9ba0-0911bdab6c0f", "name": "network-vif-unplugged", "status": "completed", "tag": "c3888bf2-97db-4f22-afff-a2d9b83792af"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:50.803176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-93bf8887-a7bf-4f5d-bb39-867c78b8d4bc req-da109ddf-41c1-4554-a64f-3bf275630c7b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:50.809778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-93bf8887-a7bf-4f5d-bb39-867c78b8d4bc req-da109ddf-41c1-4554-a64f-3bf275630c7b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:50.810918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-93bf8887-a7bf-4f5d-bb39-867c78b8d4bc req-da109ddf-41c1-4554-a64f-3bf275630c7b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:50.875726 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-93bf8887-a7bf-4f5d-bb39-867c78b8d4bc req-da109ddf-41c1-4554-a64f-3bf275630c7b service nova] Creating event network-vif-unplugged:c3888bf2-97db-4f22-afff-a2d9b83792af for instance b64a0f12-ba9a-4074-9ba0-0911bdab6c0f on n-h2-860864-2 Oct 10 23:27:50.886220 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-93bf8887-a7bf-4f5d-bb39-867c78b8d4bc req-da109ddf-41c1-4554-a64f-3bf275630c7b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.197224 Oct 10 23:27:50.887058 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1426/2763] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:27:50.896682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c4852086-4bde-4536-b8c3-e59aca1fe391 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662accbc10>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:51.005621 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c4852086-4bde-4536-b8c3-e59aca1fe391 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f" status: 200 len: 1429 microversion: 2.1 time: 0.116883 Oct 10 23:27:51.006923 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1427/2764] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:50 2022] GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f => generated 1429 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:51.025210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-27506cfb-2f71-4b3a-8bd1-a936de3e558c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:51.026439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-27506cfb-2f71-4b3a-8bd1-a936de3e558c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: cc990503-6019-4b55-b2c9-24f72769eaca] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:51.047488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27506cfb-2f71-4b3a-8bd1-a936de3e558c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:51.049013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27506cfb-2f71-4b3a-8bd1-a936de3e558c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:51.052960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27506cfb-2f71-4b3a-8bd1-a936de3e558c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:51.054709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27506cfb-2f71-4b3a-8bd1-a936de3e558c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:51.055451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27506cfb-2f71-4b3a-8bd1-a936de3e558c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:51.056411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27506cfb-2f71-4b3a-8bd1-a936de3e558c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:51.315871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-27506cfb-2f71-4b3a-8bd1-a936de3e558c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:51.341691 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-27506cfb-2f71-4b3a-8bd1-a936de3e558c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca" status: 200 len: 1314 microversion: 2.1 time: 0.333216 Oct 10 23:27:51.342536 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1428/2765] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:51 2022] GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:51.348216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fcccdaab-3f55-4de8-8dc7-76784ccff4cc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:51.349228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fcccdaab-3f55-4de8-8dc7-76784ccff4cc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:51.366861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fcccdaab-3f55-4de8-8dc7-76784ccff4cc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:51.367907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fcccdaab-3f55-4de8-8dc7-76784ccff4cc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:51.368548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fcccdaab-3f55-4de8-8dc7-76784ccff4cc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:51.369593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fcccdaab-3f55-4de8-8dc7-76784ccff4cc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:51.370243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fcccdaab-3f55-4de8-8dc7-76784ccff4cc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:51.370903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fcccdaab-3f55-4de8-8dc7-76784ccff4cc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:51.411704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:27:51.514676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fcccdaab-3f55-4de8-8dc7-76784ccff4cc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:51.527545 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fcccdaab-3f55-4de8-8dc7-76784ccff4cc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1271 microversion: 2.1 time: 0.183405 Oct 10 23:27:51.530063 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1429/2766] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:51 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1271 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:52.028435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4e7f50b7-0abe-4050-8ae8-e906eaa151b8 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662acd8b80>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:52.112172 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4e7f50b7-0abe-4050-8ae8-e906eaa151b8 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f" status: 200 len: 1429 microversion: 2.1 time: 0.087631 Oct 10 23:27:52.113099 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1430/2767] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:52 2022] GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f => generated 1429 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:52.368153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0675b78d-b0d4-40ef-a65e-066cb651ccdd tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:52.369537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0675b78d-b0d4-40ef-a65e-066cb651ccdd tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: cc990503-6019-4b55-b2c9-24f72769eaca] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:52.385035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0675b78d-b0d4-40ef-a65e-066cb651ccdd tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:52.387674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0675b78d-b0d4-40ef-a65e-066cb651ccdd tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:52.390316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0675b78d-b0d4-40ef-a65e-066cb651ccdd tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:52.394572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0675b78d-b0d4-40ef-a65e-066cb651ccdd tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:52.398257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0675b78d-b0d4-40ef-a65e-066cb651ccdd tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:52.399016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0675b78d-b0d4-40ef-a65e-066cb651ccdd tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:52.683861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0675b78d-b0d4-40ef-a65e-066cb651ccdd tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:52.697489 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0675b78d-b0d4-40ef-a65e-066cb651ccdd tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca" status: 200 len: 1314 microversion: 2.1 time: 0.333132 Oct 10 23:27:52.703351 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1431/2768] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:52 2022] GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:27:52.711118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-84e14089-8068-48fc-890d-edaf21459858 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:52.712045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-84e14089-8068-48fc-890d-edaf21459858 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:52.722568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84e14089-8068-48fc-890d-edaf21459858 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:52.723446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84e14089-8068-48fc-890d-edaf21459858 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:52.724313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84e14089-8068-48fc-890d-edaf21459858 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:52.725519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84e14089-8068-48fc-890d-edaf21459858 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:52.726812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84e14089-8068-48fc-890d-edaf21459858 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:52.727463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84e14089-8068-48fc-890d-edaf21459858 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:53.020103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-84e14089-8068-48fc-890d-edaf21459858 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:53.033285 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-84e14089-8068-48fc-890d-edaf21459858 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1313 microversion: 2.1 time: 0.327971 Oct 10 23:27:53.034151 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1432/2769] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:52 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:53.054630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-8c8acda7-0505-4996-a7f4-10ad1240bbc9 req-12da3d2a-331e-427d-9a2d-9a84bd240539 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc990503-6019-4b55-b2c9-24f72769eaca", "tag": "c82275f2-b750-4b8b-9d83-4eb2ffc91160"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:53.066995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8c8acda7-0505-4996-a7f4-10ad1240bbc9 req-12da3d2a-331e-427d-9a2d-9a84bd240539 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:53.067881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8c8acda7-0505-4996-a7f4-10ad1240bbc9 req-12da3d2a-331e-427d-9a2d-9a84bd240539 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:53.068542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8c8acda7-0505-4996-a7f4-10ad1240bbc9 req-12da3d2a-331e-427d-9a2d-9a84bd240539 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:53.080870 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-8c8acda7-0505-4996-a7f4-10ad1240bbc9 req-12da3d2a-331e-427d-9a2d-9a84bd240539 service nova] Creating event network-changed:c82275f2-b750-4b8b-9d83-4eb2ffc91160 for instance cc990503-6019-4b55-b2c9-24f72769eaca on n-h2-860864-2 Oct 10 23:27:53.087228 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-8c8acda7-0505-4996-a7f4-10ad1240bbc9 req-12da3d2a-331e-427d-9a2d-9a84bd240539 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035883 Oct 10 23:27:53.088515 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1433/2770] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:27:53.146366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ecf39801-e426-44ec-9ed0-cbcba6d3036e tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662accbc10>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:53.213664 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ecf39801-e426-44ec-9ed0-cbcba6d3036e tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f" status: 200 len: 1429 microversion: 2.1 time: 0.086511 Oct 10 23:27:53.214393 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1434/2771] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:53 2022] GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f => generated 1429 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:53.592271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-da5757da-6a92-43cc-9a5a-5879a12dc644 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Updating instance_info_cache with network_info: [{"id": "cf591354-4fda-40dc-8468-a4548f51eeb1", "address": "fa:16:3e:6c:7a:95", "network": {"id": "de4c0e75-354a-475e-8f5b-aa897d475c60", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2117360887-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "43bf1bebb02c4359a949d820dd31c49e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapcf591354-4f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120614) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 23:27:53.615713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da5757da-6a92-43cc-9a5a-5879a12dc644 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Releasing lock "refresh_cache-f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" {{(pid=120614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 23:27:53.620825 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-da5757da-6a92-43cc-9a5a-5879a12dc644 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "POST /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5/action" status: 202 len: 0 microversion: 2.1 time: 19.785208 Oct 10 23:27:53.623992 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1338/2772] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:27:33 2022] POST /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5/action => generated 0 bytes in 19794 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 23:27:53.636502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8a47970c-b6bc-468b-8b7f-8027f2c306f8 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.139"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:53.702174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:27:53.729071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d03f30f6-a211-4ca8-b0a7-b1371cfe5b72 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:53.729952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d03f30f6-a211-4ca8-b0a7-b1371cfe5b72 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: cc990503-6019-4b55-b2c9-24f72769eaca] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:53.738328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d03f30f6-a211-4ca8-b0a7-b1371cfe5b72 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:53.738846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d03f30f6-a211-4ca8-b0a7-b1371cfe5b72 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:53.739283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d03f30f6-a211-4ca8-b0a7-b1371cfe5b72 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:53.742087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d03f30f6-a211-4ca8-b0a7-b1371cfe5b72 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:53.743049 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d03f30f6-a211-4ca8-b0a7-b1371cfe5b72 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:53.744553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d03f30f6-a211-4ca8-b0a7-b1371cfe5b72 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:53.988645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8a47970c-b6bc-468b-8b7f-8027f2c306f8 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:54.004706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a47970c-b6bc-468b-8b7f-8027f2c306f8 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:54.007010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a47970c-b6bc-468b-8b7f-8027f2c306f8 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:54.007710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a47970c-b6bc-468b-8b7f-8027f2c306f8 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:54.008485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a47970c-b6bc-468b-8b7f-8027f2c306f8 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:54.008949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a47970c-b6bc-468b-8b7f-8027f2c306f8 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:54.009407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a47970c-b6bc-468b-8b7f-8027f2c306f8 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:54.179877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d03f30f6-a211-4ca8-b0a7-b1371cfe5b72 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:54.192312 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d03f30f6-a211-4ca8-b0a7-b1371cfe5b72 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca" status: 200 len: 1314 microversion: 2.1 time: 0.467356 Oct 10 23:27:54.195248 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1339/2773] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:53 2022] GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:27:54.202391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f406f076-c95d-4bbe-a6e5-4ca7d7cc2d1a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:54.203469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f406f076-c95d-4bbe-a6e5-4ca7d7cc2d1a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:54.234801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f406f076-c95d-4bbe-a6e5-4ca7d7cc2d1a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:54.237929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f406f076-c95d-4bbe-a6e5-4ca7d7cc2d1a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:54.239873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f406f076-c95d-4bbe-a6e5-4ca7d7cc2d1a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:54.242396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f406f076-c95d-4bbe-a6e5-4ca7d7cc2d1a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:54.244269 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f406f076-c95d-4bbe-a6e5-4ca7d7cc2d1a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:54.245611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f406f076-c95d-4bbe-a6e5-4ca7d7cc2d1a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:54.377640 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-8a47970c-b6bc-468b-8b7f-8027f2c306f8 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] HTTP exception thrown: Floating IP 172.25.5.139 is not associated with instance dcb66932-449d-48cd-9a36-485807874e27. Oct 10 23:27:54.380339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8a47970c-b6bc-468b-8b7f-8027f2c306f8 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Request method failure captured: Oct 10 23:27:54.380339 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27/action HTTP/1.1 Oct 10 23:27:54.380339 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:27:54.380339 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:27:54.380339 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:27:54.380339 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 49 Oct 10 23:27:54.380339 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:27:54.380339 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:27:54.380339 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:27:54.380339 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:27:54.380339 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKodH0fxs2_QqgQPZBXiRHxUGQToSGNphfb1ApTO4qdtCRqJk85ZpbJn4ADwdL_CkSvjLKmisPIKV-BgQrRusbGHcomt05nmdASfITn9BhMFFQMGOP4s6ko0XgbupUeZgJyM-nJ5ZHbN8-sRw5IXA1kqVGVPkK12Xm_L83qfNzxVJiw Oct 10 23:27:54.380339 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:27:54.380339 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:27:54.380339 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:27:54.380339 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:27:54.380339 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:27:54.380339 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:27:54.380339 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 43bf1bebb02c4359a949d820dd31c49e Oct 10 23:27:54.380339 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1763207518 Oct 10 23:27:54.380339 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:27:54.380339 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:27:54.382033 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/43bf1bebb02c4359a949d820dd31c49e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/43bf1bebb02c4359a949d820dd31c49e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/43bf1bebb02c4359a949d820dd31c49e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_43bf1bebb02c4359a949d820dd31c49e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:27:54.382033 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1763207518 Oct 10 23:27:54.382033 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 43bf1bebb02c4359a949d820dd31c49e Oct 10 23:27:54.382033 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1763207518 Oct 10 23:27:54.382033 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-FloatingIPsAssociationTestJSON-1763207518-project Oct 10 23:27:54.382033 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:27:54.382033 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:27:54.382033 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 3fd164398b9e4a8dac71bcd96eccbb2a Oct 10 23:27:54.382033 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1763207518-project Oct 10 23:27:54.382033 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:27:54.382033 n-d-860864-2 devstack@n-api.service[120613]: {"removeFloatingIp": {"address": "172.25.5.139"}} Oct 10 23:27:54.382033 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:27:54.382033 n-d-860864-2 devstack@n-api.service[120613]: exception: Floating IP 172.25.5.139 is not associated with instance dcb66932-449d-48cd-9a36-485807874e27. Oct 10 23:27:54.382907 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'dcb66932-449d-48cd-9a36-485807874e27', 'body': {'removeFloatingIp': {'address': '172.25.5.139'}}} Oct 10 23:27:54.382907 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:27:54.382907 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:27:54.382907 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:27:54.382907 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:27:54.382907 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:27:54.382907 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:27:54.382907 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:27:54.382907 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:27:54.382907 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:27:54.382907 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:27:54.382907 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:27:54.382907 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:27:54.382907 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 10 23:27:54.382907 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 23:27:54.382907 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.5.139 is not associated with instance dcb66932-449d-48cd-9a36-485807874e27. Oct 10 23:27:54.382907 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:27:54.382907 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:27:54.382907 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:27:54.382907 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:27:54.384245 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:27:54.384245 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:27:54.384245 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:27:54.384245 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:27:54.384245 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.5.139 is not associated with instance dcb66932-449d-48cd-9a36-485807874e27. Oct 10 23:27:54.384245 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:27:54.386456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8a47970c-b6bc-468b-8b7f-8027f2c306f8 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Returning 409 to user: Floating IP 172.25.5.139 is not associated with instance dcb66932-449d-48cd-9a36-485807874e27. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:27:54.387592 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8a47970c-b6bc-468b-8b7f-8027f2c306f8 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "POST /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27/action" status: 409 len: 146 microversion: 2.1 time: 0.758325 Oct 10 23:27:54.388973 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1435/2774] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:27:53 2022] POST /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27/action => generated 146 bytes in 760 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:27:54.397604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-99427c18-466f-4d2f-b388-857978e76a70 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662aca9e50>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:54.467320 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-99427c18-466f-4d2f-b388-857978e76a70 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f" status: 200 len: 1429 microversion: 2.1 time: 0.076523 Oct 10 23:27:54.468591 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1436/2775] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:54 2022] GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f => generated 1429 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:54.474564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b122be9b-6bc5-4cdd-a807-cf1aa2e84457 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.139"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:54.645562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b122be9b-6bc5-4cdd-a807-cf1aa2e84457 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:54.656199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b122be9b-6bc5-4cdd-a807-cf1aa2e84457 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:54.657580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b122be9b-6bc5-4cdd-a807-cf1aa2e84457 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:54.658672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b122be9b-6bc5-4cdd-a807-cf1aa2e84457 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:54.659623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b122be9b-6bc5-4cdd-a807-cf1aa2e84457 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:54.660720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b122be9b-6bc5-4cdd-a807-cf1aa2e84457 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:54.662170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b122be9b-6bc5-4cdd-a807-cf1aa2e84457 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:54.701179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f406f076-c95d-4bbe-a6e5-4ca7d7cc2d1a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:54.720497 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f406f076-c95d-4bbe-a6e5-4ca7d7cc2d1a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1313 microversion: 2.1 time: 0.521620 Oct 10 23:27:54.725639 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1340/2776] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:54 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1313 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:55.037079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b122be9b-6bc5-4cdd-a807-cf1aa2e84457 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "refresh_cache-f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" {{(pid=120613) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 23:27:55.038054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b122be9b-6bc5-4cdd-a807-cf1aa2e84457 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquired lock "refresh_cache-f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" {{(pid=120613) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 23:27:55.173351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-42f3ee45-686d-4cdc-99dc-659fba8233d6 req-37c52ad3-4915-45f5-9983-e54c31632cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fec8a1d6-8362-45be-88f9-beebbbb47091", "tag": "0388ec2d-008c-474c-ad89-b054a331ac12"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:55.223221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-42f3ee45-686d-4cdc-99dc-659fba8233d6 req-37c52ad3-4915-45f5-9983-e54c31632cc3 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:55.225538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-42f3ee45-686d-4cdc-99dc-659fba8233d6 req-37c52ad3-4915-45f5-9983-e54c31632cc3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:55.226257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-42f3ee45-686d-4cdc-99dc-659fba8233d6 req-37c52ad3-4915-45f5-9983-e54c31632cc3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:55.292609 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-42f3ee45-686d-4cdc-99dc-659fba8233d6 req-37c52ad3-4915-45f5-9983-e54c31632cc3 service nova] Creating event network-changed:0388ec2d-008c-474c-ad89-b054a331ac12 for instance fec8a1d6-8362-45be-88f9-beebbbb47091 on n-h1-860864-2 Oct 10 23:27:55.334108 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-42f3ee45-686d-4cdc-99dc-659fba8233d6 req-37c52ad3-4915-45f5-9983-e54c31632cc3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158535 Oct 10 23:27:55.339901 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1341/2777] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:27:55.357944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1d36229c-a8ba-4971-91f0-27872bc51dae tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:55.359507 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1d36229c-a8ba-4971-91f0-27872bc51dae tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: cc990503-6019-4b55-b2c9-24f72769eaca] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:55.370520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d36229c-a8ba-4971-91f0-27872bc51dae tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:55.372300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d36229c-a8ba-4971-91f0-27872bc51dae tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:55.372910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d36229c-a8ba-4971-91f0-27872bc51dae tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:55.374886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d36229c-a8ba-4971-91f0-27872bc51dae tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:55.376690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d36229c-a8ba-4971-91f0-27872bc51dae tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:55.377685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d36229c-a8ba-4971-91f0-27872bc51dae tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:55.675649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=16 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:27:55.887710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1d36229c-a8ba-4971-91f0-27872bc51dae tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:55.897008 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1d36229c-a8ba-4971-91f0-27872bc51dae tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca" status: 200 len: 1314 microversion: 2.1 time: 0.555793 Oct 10 23:27:55.897616 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1342/2778] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:55 2022] GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:55.913778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-36607478-6f4f-4c53-8543-128fc2a5ec40 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662a7e7ca0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:55.966019 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-36607478-6f4f-4c53-8543-128fc2a5ec40 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f" status: 200 len: 1429 microversion: 2.1 time: 0.067343 Oct 10 23:27:55.966600 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1343/2779] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:55 2022] GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f => generated 1429 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:55.984572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9c9bc816-4b5a-463a-a988-3a9914405c3a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:55.986426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9c9bc816-4b5a-463a-a988-3a9914405c3a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:55.999818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c9bc816-4b5a-463a-a988-3a9914405c3a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:56.000334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c9bc816-4b5a-463a-a988-3a9914405c3a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:56.001364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c9bc816-4b5a-463a-a988-3a9914405c3a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:56.002274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c9bc816-4b5a-463a-a988-3a9914405c3a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:56.002740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c9bc816-4b5a-463a-a988-3a9914405c3a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:56.003177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c9bc816-4b5a-463a-a988-3a9914405c3a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:56.087749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-b122be9b-6bc5-4cdd-a807-cf1aa2e84457 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Building network info cache for instance {{(pid=120613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 23:27:56.543070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9c9bc816-4b5a-463a-a988-3a9914405c3a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:56.554539 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9c9bc816-4b5a-463a-a988-3a9914405c3a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1313 microversion: 2.1 time: 0.578015 Oct 10 23:27:56.561005 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1344/2780] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:55 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1313 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:56.587606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-93d24655-5f38-43e3-9929-65007f920790 req-dc56c71d-2862-4757-9de8-a9ee02e5a05b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e94f4a-d35f-4d5f-abf3-4366dea38dd5", "tag": "cf591354-4fda-40dc-8468-a4548f51eeb1"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:56.631560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-93d24655-5f38-43e3-9929-65007f920790 req-dc56c71d-2862-4757-9de8-a9ee02e5a05b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:56.633025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-93d24655-5f38-43e3-9929-65007f920790 req-dc56c71d-2862-4757-9de8-a9ee02e5a05b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:56.636688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-93d24655-5f38-43e3-9929-65007f920790 req-dc56c71d-2862-4757-9de8-a9ee02e5a05b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:56.678695 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-93d24655-5f38-43e3-9929-65007f920790 req-dc56c71d-2862-4757-9de8-a9ee02e5a05b service nova] Creating event network-changed:cf591354-4fda-40dc-8468-a4548f51eeb1 for instance f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 on n-h1-860864-2 Oct 10 23:27:56.692420 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-93d24655-5f38-43e3-9929-65007f920790 req-dc56c71d-2862-4757-9de8-a9ee02e5a05b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119643 Oct 10 23:27:56.694110 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1345/2781] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:27:56.707883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-82e72a54-81dd-46b2-b655-aa2a072b66e5 req-4b883f78-cd98-4951-a3ff-36fd773fe1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b64a0f12-ba9a-4074-9ba0-0911bdab6c0f", "name": "network-vif-plugged", "status": "completed", "tag": "c3888bf2-97db-4f22-afff-a2d9b83792af"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:56.739413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-82e72a54-81dd-46b2-b655-aa2a072b66e5 req-4b883f78-cd98-4951-a3ff-36fd773fe1a3 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:56.740157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-82e72a54-81dd-46b2-b655-aa2a072b66e5 req-4b883f78-cd98-4951-a3ff-36fd773fe1a3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:56.740746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-82e72a54-81dd-46b2-b655-aa2a072b66e5 req-4b883f78-cd98-4951-a3ff-36fd773fe1a3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:56.768995 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-82e72a54-81dd-46b2-b655-aa2a072b66e5 req-4b883f78-cd98-4951-a3ff-36fd773fe1a3 service nova] Creating event network-vif-plugged:c3888bf2-97db-4f22-afff-a2d9b83792af for instance b64a0f12-ba9a-4074-9ba0-0911bdab6c0f on n-h2-860864-2 Oct 10 23:27:56.775892 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-82e72a54-81dd-46b2-b655-aa2a072b66e5 req-4b883f78-cd98-4951-a3ff-36fd773fe1a3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072708 Oct 10 23:27:56.777099 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1346/2782] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:27:56.921789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-62ef208b-0da0-4c19-87f5-ab69f364ae5c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:56.923738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-62ef208b-0da0-4c19-87f5-ab69f364ae5c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: cc990503-6019-4b55-b2c9-24f72769eaca] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:56.934753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62ef208b-0da0-4c19-87f5-ab69f364ae5c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:56.937755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62ef208b-0da0-4c19-87f5-ab69f364ae5c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:56.939069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62ef208b-0da0-4c19-87f5-ab69f364ae5c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:56.949513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62ef208b-0da0-4c19-87f5-ab69f364ae5c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:56.951670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62ef208b-0da0-4c19-87f5-ab69f364ae5c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:56.955563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62ef208b-0da0-4c19-87f5-ab69f364ae5c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:57.465132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-b122be9b-6bc5-4cdd-a807-cf1aa2e84457 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Updating instance_info_cache with network_info: [{"id": "cf591354-4fda-40dc-8468-a4548f51eeb1", "address": "fa:16:3e:6c:7a:95", "network": {"id": "de4c0e75-354a-475e-8f5b-aa897d475c60", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2117360887-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "43bf1bebb02c4359a949d820dd31c49e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapcf591354-4f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 23:27:57.495387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b122be9b-6bc5-4cdd-a807-cf1aa2e84457 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Releasing lock "refresh_cache-f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" {{(pid=120613) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 23:27:57.496547 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b122be9b-6bc5-4cdd-a807-cf1aa2e84457 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "POST /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5/action" status: 202 len: 0 microversion: 2.1 time: 3.026936 Oct 10 23:27:57.498481 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1437/2783] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:27:54 2022] POST /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5/action => generated 0 bytes in 3029 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 23:27:57.511799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b7ae5d13-b56f-4fcf-bb6d-47c4b1f7e6be tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f6633b0f5e0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:57.568953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-62ef208b-0da0-4c19-87f5-ab69f364ae5c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:57.581192 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-62ef208b-0da0-4c19-87f5-ab69f364ae5c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca" status: 200 len: 1314 microversion: 2.1 time: 0.663469 Oct 10 23:27:57.583208 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1347/2784] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:56 2022] GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca => generated 1314 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:57.596537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d957961a-e6dc-42f2-9f7d-a60d919f80b7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:57.598278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d957961a-e6dc-42f2-9f7d-a60d919f80b7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:57.615010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d957961a-e6dc-42f2-9f7d-a60d919f80b7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:57.615894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d957961a-e6dc-42f2-9f7d-a60d919f80b7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:57.616347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d957961a-e6dc-42f2-9f7d-a60d919f80b7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:57.617073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d957961a-e6dc-42f2-9f7d-a60d919f80b7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:57.617616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d957961a-e6dc-42f2-9f7d-a60d919f80b7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:57.617990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d957961a-e6dc-42f2-9f7d-a60d919f80b7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:57.677749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d957961a-e6dc-42f2-9f7d-a60d919f80b7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:27:57.871735 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d957961a-e6dc-42f2-9f7d-a60d919f80b7 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" status: 204 len: 0 microversion: 2.1 time: 0.286141 Oct 10 23:27:57.880058 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1348/2785] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:27:57 2022] DELETE /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:27:57.888036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1b034eba-4e8f-463e-91d6-1a19c37eb37a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:27:57.888936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1b034eba-4e8f-463e-91d6-1a19c37eb37a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:57.896698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b034eba-4e8f-463e-91d6-1a19c37eb37a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:57.897559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b034eba-4e8f-463e-91d6-1a19c37eb37a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:57.898186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b034eba-4e8f-463e-91d6-1a19c37eb37a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:57.899122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b034eba-4e8f-463e-91d6-1a19c37eb37a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:57.899881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b034eba-4e8f-463e-91d6-1a19c37eb37a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:57.900540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b034eba-4e8f-463e-91d6-1a19c37eb37a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:58.347152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1b034eba-4e8f-463e-91d6-1a19c37eb37a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:27:58.359377 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1b034eba-4e8f-463e-91d6-1a19c37eb37a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1313 microversion: 2.1 time: 0.477621 Oct 10 23:27:58.362320 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1349/2786] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:27:57 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1313 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:27:58.372585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-493341f0-4cb5-4d6f-9550-e927f45f749b tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.139"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:27:58.380812 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-493341f0-4cb5-4d6f-9550-e927f45f749b tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:27:58.394254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-493341f0-4cb5-4d6f-9550-e927f45f749b tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:58.396968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-493341f0-4cb5-4d6f-9550-e927f45f749b tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:58.401019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-493341f0-4cb5-4d6f-9550-e927f45f749b tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:58.401991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-493341f0-4cb5-4d6f-9550-e927f45f749b tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:27:58.402769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-493341f0-4cb5-4d6f-9550-e927f45f749b tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:27:58.403386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-493341f0-4cb5-4d6f-9550-e927f45f749b tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:27:58.472497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-493341f0-4cb5-4d6f-9550-e927f45f749b tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "refresh_cache-dcb66932-449d-48cd-9a36-485807874e27" {{(pid=120614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 23:27:58.472908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-493341f0-4cb5-4d6f-9550-e927f45f749b tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquired lock "refresh_cache-dcb66932-449d-48cd-9a36-485807874e27" {{(pid=120614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 23:28:03.875925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-493341f0-4cb5-4d6f-9550-e927f45f749b tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Building network info cache for instance {{(pid=120614) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 23:28:04.656140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=26 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:28:05.417311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-493341f0-4cb5-4d6f-9550-e927f45f749b tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Updating instance_info_cache with network_info: [{"id": "c68baca6-c92c-4e7a-bef8-b00039aec8ff", "address": "fa:16:3e:71:f8:ff", "network": {"id": "de4c0e75-354a-475e-8f5b-aa897d475c60", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2117360887-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "43bf1bebb02c4359a949d820dd31c49e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc68baca6-c9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120614) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 23:28:05.467810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-493341f0-4cb5-4d6f-9550-e927f45f749b tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Releasing lock "refresh_cache-dcb66932-449d-48cd-9a36-485807874e27" {{(pid=120614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 23:28:05.470227 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-493341f0-4cb5-4d6f-9550-e927f45f749b tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "POST /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27/action" status: 202 len: 0 microversion: 2.1 time: 7.103380 Oct 10 23:28:05.471306 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1350/2787] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:27:58 2022] POST /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27/action => generated 0 bytes in 7106 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 23:28:05.478498 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fa5a8aa4-e3c8-4fd6-b5d6-681b57273a31 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:05.479493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fa5a8aa4-e3c8-4fd6-b5d6-681b57273a31 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: cc990503-6019-4b55-b2c9-24f72769eaca] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:05.489150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa5a8aa4-e3c8-4fd6-b5d6-681b57273a31 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:05.489992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa5a8aa4-e3c8-4fd6-b5d6-681b57273a31 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:05.490658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa5a8aa4-e3c8-4fd6-b5d6-681b57273a31 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:05.491901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa5a8aa4-e3c8-4fd6-b5d6-681b57273a31 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:05.492573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa5a8aa4-e3c8-4fd6-b5d6-681b57273a31 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:05.493183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa5a8aa4-e3c8-4fd6-b5d6-681b57273a31 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:05.838216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fa5a8aa4-e3c8-4fd6-b5d6-681b57273a31 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:05.872646 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fa5a8aa4-e3c8-4fd6-b5d6-681b57273a31 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca" status: 200 len: 1314 microversion: 2.1 time: 0.393592 Oct 10 23:28:05.872646 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1351/2788] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:05 2022] GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:05.878469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eee3b8ab-1732-4581-9072-955fada0822f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:05.897551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eee3b8ab-1732-4581-9072-955fada0822f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:05.897551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eee3b8ab-1732-4581-9072-955fada0822f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:05.897551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eee3b8ab-1732-4581-9072-955fada0822f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:05.897551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eee3b8ab-1732-4581-9072-955fada0822f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:05.898685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eee3b8ab-1732-4581-9072-955fada0822f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:05.898685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eee3b8ab-1732-4581-9072-955fada0822f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:05.898685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eee3b8ab-1732-4581-9072-955fada0822f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:06.175395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-eee3b8ab-1732-4581-9072-955fada0822f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:06.184187 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eee3b8ab-1732-4581-9072-955fada0822f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1313 microversion: 2.1 time: 0.313234 Oct 10 23:28:06.186736 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1352/2789] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:05 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:06.192165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-ba4a81fa-8aa2-4da8-aa4d-f668ea7a0e2d req-dd089899-3cf1-4ada-a7b8-ccad0e7f3313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc990503-6019-4b55-b2c9-24f72769eaca", "name": "network-vif-plugged", "status": "completed", "tag": "c82275f2-b750-4b8b-9d83-4eb2ffc91160"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:06.204685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ba4a81fa-8aa2-4da8-aa4d-f668ea7a0e2d req-dd089899-3cf1-4ada-a7b8-ccad0e7f3313 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:06.205656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ba4a81fa-8aa2-4da8-aa4d-f668ea7a0e2d req-dd089899-3cf1-4ada-a7b8-ccad0e7f3313 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:06.206317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ba4a81fa-8aa2-4da8-aa4d-f668ea7a0e2d req-dd089899-3cf1-4ada-a7b8-ccad0e7f3313 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:06.221991 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-ba4a81fa-8aa2-4da8-aa4d-f668ea7a0e2d req-dd089899-3cf1-4ada-a7b8-ccad0e7f3313 service nova] Creating event network-vif-plugged:c82275f2-b750-4b8b-9d83-4eb2ffc91160 for instance cc990503-6019-4b55-b2c9-24f72769eaca on n-h2-860864-2 Oct 10 23:28:06.229077 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-ba4a81fa-8aa2-4da8-aa4d-f668ea7a0e2d req-dd089899-3cf1-4ada-a7b8-ccad0e7f3313 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040294 Oct 10 23:28:06.230503 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1353/2790] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:28:06.237895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-3bdd4a8e-3c44-48b3-99f9-7fe43ec9d6b5 req-a2b067d1-adec-4c0d-9245-ce3b41a8132d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcb66932-449d-48cd-9a36-485807874e27", "tag": "c68baca6-c92c-4e7a-bef8-b00039aec8ff"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:06.254471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3bdd4a8e-3c44-48b3-99f9-7fe43ec9d6b5 req-a2b067d1-adec-4c0d-9245-ce3b41a8132d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:06.255448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3bdd4a8e-3c44-48b3-99f9-7fe43ec9d6b5 req-a2b067d1-adec-4c0d-9245-ce3b41a8132d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:06.256277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3bdd4a8e-3c44-48b3-99f9-7fe43ec9d6b5 req-a2b067d1-adec-4c0d-9245-ce3b41a8132d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:06.271053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:28:06.273783 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-3bdd4a8e-3c44-48b3-99f9-7fe43ec9d6b5 req-a2b067d1-adec-4c0d-9245-ce3b41a8132d service nova] Creating event network-changed:c68baca6-c92c-4e7a-bef8-b00039aec8ff for instance dcb66932-449d-48cd-9a36-485807874e27 on n-h1-860864-2 Oct 10 23:28:06.280981 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-3bdd4a8e-3c44-48b3-99f9-7fe43ec9d6b5 req-a2b067d1-adec-4c0d-9245-ce3b41a8132d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048705 Oct 10 23:28:06.282439 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1354/2791] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:28:06.293783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c7c2bebe-3283-4d62-93eb-b0da222b5a3c tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '.version_select at 0x7f662a88a820>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:07.091580 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c7c2bebe-3283-4d62-93eb-b0da222b5a3c tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/8b601cca-2b6d-4708-b080-1701cca629c2" status: 200 len: 184 microversion: 2.1 time: 0.803404 Oct 10 23:28:07.092655 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1355/2792] 10.222.0.23 () {58 vars in 1260 bytes} [Mon Oct 10 23:28:06 2022] GET /compute/v2.1/os-floating-ips/8b601cca-2b6d-4708-b080-1701cca629c2 => generated 184 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:28:07.098112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dd9d6731-423e-4be9-9971-3591bccac304 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:07.099306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dd9d6731-423e-4be9-9971-3591bccac304 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: cc990503-6019-4b55-b2c9-24f72769eaca] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:07.114689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd9d6731-423e-4be9-9971-3591bccac304 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:07.117137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd9d6731-423e-4be9-9971-3591bccac304 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:07.117850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd9d6731-423e-4be9-9971-3591bccac304 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:07.118815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd9d6731-423e-4be9-9971-3591bccac304 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:07.120253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd9d6731-423e-4be9-9971-3591bccac304 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:07.122380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd9d6731-423e-4be9-9971-3591bccac304 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:07.480977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=29,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:28:07.750243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dd9d6731-423e-4be9-9971-3591bccac304 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:07.801124 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dd9d6731-423e-4be9-9971-3591bccac304 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca" status: 200 len: 1314 microversion: 2.1 time: 0.702068 Oct 10 23:28:07.801862 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1356/2793] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:07 2022] GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca => generated 1314 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:07.839727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8b7b466f-f2f3-475c-8cbe-9d1e2e115917 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.139"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:08.392641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8b7b466f-f2f3-475c-8cbe-9d1e2e115917 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:08.399665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b7b466f-f2f3-475c-8cbe-9d1e2e115917 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:08.399903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b7b466f-f2f3-475c-8cbe-9d1e2e115917 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:08.400657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b7b466f-f2f3-475c-8cbe-9d1e2e115917 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:08.401662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b7b466f-f2f3-475c-8cbe-9d1e2e115917 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:08.405890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b7b466f-f2f3-475c-8cbe-9d1e2e115917 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:08.406494 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b7b466f-f2f3-475c-8cbe-9d1e2e115917 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:09.231802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b7b466f-f2f3-475c-8cbe-9d1e2e115917 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "refresh_cache-dcb66932-449d-48cd-9a36-485807874e27" {{(pid=120614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 23:28:09.232095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b7b466f-f2f3-475c-8cbe-9d1e2e115917 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquired lock "refresh_cache-dcb66932-449d-48cd-9a36-485807874e27" {{(pid=120614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 23:28:10.594108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-8b7b466f-f2f3-475c-8cbe-9d1e2e115917 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Building network info cache for instance {{(pid=120614) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 23:28:11.090494 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b7ae5d13-b56f-4fcf-bb6d-47c4b1f7e6be tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f" status: 200 len: 1429 microversion: 2.1 time: 13.590364 Oct 10 23:28:11.100543 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1438/2794] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:27:57 2022] GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f => generated 1429 bytes in 13601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:11.109867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-76c0996c-830f-41c9-a25d-6c4a1ae6b7db tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:11.112906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-76c0996c-830f-41c9-a25d-6c4a1ae6b7db tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:11.137684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76c0996c-830f-41c9-a25d-6c4a1ae6b7db tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:11.138696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76c0996c-830f-41c9-a25d-6c4a1ae6b7db tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:11.140812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76c0996c-830f-41c9-a25d-6c4a1ae6b7db tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:11.145408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76c0996c-830f-41c9-a25d-6c4a1ae6b7db tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:11.146185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76c0996c-830f-41c9-a25d-6c4a1ae6b7db tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:11.148219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76c0996c-830f-41c9-a25d-6c4a1ae6b7db tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:11.428696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-76c0996c-830f-41c9-a25d-6c4a1ae6b7db tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:11.438414 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-76c0996c-830f-41c9-a25d-6c4a1ae6b7db tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1313 microversion: 2.1 time: 0.336176 Oct 10 23:28:11.440115 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1439/2795] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:11 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:11.448712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-9ea43d91-486b-4069-bae9-1b7e84bd556a req-1d8d0b8d-bba4-4eab-a143-c793ff05561f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fec8a1d6-8362-45be-88f9-beebbbb47091", "name": "network-vif-plugged", "status": "completed", "tag": "0388ec2d-008c-474c-ad89-b054a331ac12"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:11.461336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9ea43d91-486b-4069-bae9-1b7e84bd556a req-1d8d0b8d-bba4-4eab-a143-c793ff05561f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:11.462244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9ea43d91-486b-4069-bae9-1b7e84bd556a req-1d8d0b8d-bba4-4eab-a143-c793ff05561f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:11.462925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9ea43d91-486b-4069-bae9-1b7e84bd556a req-1d8d0b8d-bba4-4eab-a143-c793ff05561f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:11.479671 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-9ea43d91-486b-4069-bae9-1b7e84bd556a req-1d8d0b8d-bba4-4eab-a143-c793ff05561f service nova] Creating event network-vif-plugged:0388ec2d-008c-474c-ad89-b054a331ac12 for instance fec8a1d6-8362-45be-88f9-beebbbb47091 on n-h1-860864-2 Oct 10 23:28:11.487472 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-9ea43d91-486b-4069-bae9-1b7e84bd556a req-1d8d0b8d-bba4-4eab-a143-c793ff05561f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044945 Oct 10 23:28:11.488698 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1440/2796] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:28:11.497003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-0fcdf9a0-2617-426c-9fe9-72b6abca7a58 req-d91d47ce-40dc-4c3a-9e0c-d4ca40699c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e94f4a-d35f-4d5f-abf3-4366dea38dd5", "name": "network-vif-deleted", "tag": "cf591354-4fda-40dc-8468-a4548f51eeb1"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:11.511346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0fcdf9a0-2617-426c-9fe9-72b6abca7a58 req-d91d47ce-40dc-4c3a-9e0c-d4ca40699c31 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:11.512772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0fcdf9a0-2617-426c-9fe9-72b6abca7a58 req-d91d47ce-40dc-4c3a-9e0c-d4ca40699c31 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:11.513486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0fcdf9a0-2617-426c-9fe9-72b6abca7a58 req-d91d47ce-40dc-4c3a-9e0c-d4ca40699c31 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:11.530995 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-0fcdf9a0-2617-426c-9fe9-72b6abca7a58 req-d91d47ce-40dc-4c3a-9e0c-d4ca40699c31 service nova] Creating event network-vif-deleted:cf591354-4fda-40dc-8468-a4548f51eeb1 for instance f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 on n-h1-860864-2 Oct 10 23:28:11.557729 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-0fcdf9a0-2617-426c-9fe9-72b6abca7a58 req-d91d47ce-40dc-4c3a-9e0c-d4ca40699c31 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066585 Oct 10 23:28:11.559047 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1441/2797] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:28:11.570644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a6a4b08e-bb30-4a0d-afe1-122aa9b7a0d5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:11.573056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a6a4b08e-bb30-4a0d-afe1-122aa9b7a0d5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: cc990503-6019-4b55-b2c9-24f72769eaca] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:11.592641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6a4b08e-bb30-4a0d-afe1-122aa9b7a0d5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:11.593666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6a4b08e-bb30-4a0d-afe1-122aa9b7a0d5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:11.594475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6a4b08e-bb30-4a0d-afe1-122aa9b7a0d5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:11.595387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6a4b08e-bb30-4a0d-afe1-122aa9b7a0d5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:11.596018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6a4b08e-bb30-4a0d-afe1-122aa9b7a0d5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:11.599433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6a4b08e-bb30-4a0d-afe1-122aa9b7a0d5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:11.857406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a6a4b08e-bb30-4a0d-afe1-122aa9b7a0d5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:11.867245 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a6a4b08e-bb30-4a0d-afe1-122aa9b7a0d5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca" status: 200 len: 1464 microversion: 2.1 time: 0.306762 Oct 10 23:28:11.868556 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1442/2798] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:11 2022] GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca => generated 1464 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:12.019986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-8b7b466f-f2f3-475c-8cbe-9d1e2e115917 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Updating instance_info_cache with network_info: [{"id": "c68baca6-c92c-4e7a-bef8-b00039aec8ff", "address": "fa:16:3e:71:f8:ff", "network": {"id": "de4c0e75-354a-475e-8f5b-aa897d475c60", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2117360887-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "43bf1bebb02c4359a949d820dd31c49e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc68baca6-c9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120614) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 23:28:12.038116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b7b466f-f2f3-475c-8cbe-9d1e2e115917 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Releasing lock "refresh_cache-dcb66932-449d-48cd-9a36-485807874e27" {{(pid=120614) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 23:28:12.039615 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8b7b466f-f2f3-475c-8cbe-9d1e2e115917 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "POST /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27/action" status: 202 len: 0 microversion: 2.1 time: 4.234474 Oct 10 23:28:12.040516 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1357/2799] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:28:07 2022] POST /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27/action => generated 0 bytes in 4238 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 23:28:12.239387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b5237844-c484-4b2d-9152-af55e9d95bb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-304415660", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "d912709d-3fc5-45c5-ac6c-3212feff08e0"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:12.399868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-b5237844-c484-4b2d-9152-af55e9d95bb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] validate_networks() for [('d912709d-3fc5-45c5-ac6c-3212feff08e0', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:28:12.533658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-20c5fc2b-b4f1-4f78-80cf-7ff01878f02a tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:12.540088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-20c5fc2b-b4f1-4f78-80cf-7ff01878f02a tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Searching by: {'deleted': False, 'project_id': '7c369bc97cfa4564b599b03ef3052a47'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:28:12.576391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20c5fc2b-b4f1-4f78-80cf-7ff01878f02a tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:12.576904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20c5fc2b-b4f1-4f78-80cf-7ff01878f02a tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:12.577361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20c5fc2b-b4f1-4f78-80cf-7ff01878f02a tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:12.582736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20c5fc2b-b4f1-4f78-80cf-7ff01878f02a tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:12.583234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20c5fc2b-b4f1-4f78-80cf-7ff01878f02a tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:12.583702 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20c5fc2b-b4f1-4f78-80cf-7ff01878f02a tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:12.660944 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-20c5fc2b-b4f1-4f78-80cf-7ff01878f02a tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.614227 Oct 10 23:28:12.661982 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1358/2800] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:28:12 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:28:12.674109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-faa05f76-ab56-486d-8158-cd8c3c1c9035 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:12.675058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-faa05f76-ab56-486d-8158-cd8c3c1c9035 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:12.690026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faa05f76-ab56-486d-8158-cd8c3c1c9035 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:12.690775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faa05f76-ab56-486d-8158-cd8c3c1c9035 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:12.691431 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faa05f76-ab56-486d-8158-cd8c3c1c9035 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:12.692344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faa05f76-ab56-486d-8158-cd8c3c1c9035 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:12.693821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faa05f76-ab56-486d-8158-cd8c3c1c9035 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:12.694451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faa05f76-ab56-486d-8158-cd8c3c1c9035 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:12.717888 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-faa05f76-ab56-486d-8158-cd8c3c1c9035 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] HTTP exception thrown: Instance f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 could not be found. Oct 10 23:28:12.720978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-faa05f76-ab56-486d-8158-cd8c3c1c9035 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Request method failure captured: Oct 10 23:28:12.720978 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 HTTP/1.1 Oct 10 23:28:12.720978 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:28:12.720978 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:28:12.720978 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:28:12.720978 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:28:12.720978 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:28:12.720978 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:28:12.720978 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:28:12.720978 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:28:12.720978 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKodH0fxs2_QqgQPZBXiRHxUGQToSGNphfb1ApTO4qdtCRqJk85ZpbJn4ADwdL_CkSvjLKmisPIKV-BgQrRusbGHcomt05nmdASfITn9BhMFFQMGOP4s6ko0XgbupUeZgJyM-nJ5ZHbN8-sRw5IXA1kqVGVPkK12Xm_L83qfNzxVJiw Oct 10 23:28:12.720978 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:28:12.720978 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:28:12.720978 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:28:12.720978 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:28:12.720978 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:28:12.720978 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:28:12.720978 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 43bf1bebb02c4359a949d820dd31c49e Oct 10 23:28:12.720978 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1763207518 Oct 10 23:28:12.720978 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:28:12.720978 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:28:12.722383 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/43bf1bebb02c4359a949d820dd31c49e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/43bf1bebb02c4359a949d820dd31c49e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/43bf1bebb02c4359a949d820dd31c49e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_43bf1bebb02c4359a949d820dd31c49e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:28:12.722383 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1763207518 Oct 10 23:28:12.722383 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 43bf1bebb02c4359a949d820dd31c49e Oct 10 23:28:12.722383 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1763207518 Oct 10 23:28:12.722383 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-FloatingIPsAssociationTestJSON-1763207518-project Oct 10 23:28:12.722383 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:28:12.722383 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:28:12.722383 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 3fd164398b9e4a8dac71bcd96eccbb2a Oct 10 23:28:12.722383 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1763207518-project Oct 10 23:28:12.722383 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:28:12.722383 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 could not be found. Oct 10 23:28:12.722383 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'f2e94f4a-d35f-4d5f-abf3-4366dea38dd5'} Oct 10 23:28:12.723134 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:28:12.723134 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:12.723134 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:28:12.723134 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:28:12.723134 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:28:12.723134 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:28:12.723134 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:28:12.723134 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:28:12.723134 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:28:12.723134 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:28:12.723134 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 could not be found. Oct 10 23:28:12.723134 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:12.723134 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:12.723134 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:12.723134 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:12.723134 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:12.723134 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:12.723134 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:28:12.723134 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:28:12.723134 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:28:12.724402 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:28:12.724402 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:28:12.724402 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:28:12.724402 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:28:12.724402 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:28:12.724402 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:28:12.724402 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:28:12.724402 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:28:12.724402 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:28:12.724402 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 could not be found. Oct 10 23:28:12.724402 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:12.724402 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:12.724402 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:12.724402 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:12.724402 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:12.724402 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:12.724402 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:28:12.724402 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:28:12.724402 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 could not be found. Oct 10 23:28:12.724402 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:12.735994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-faa05f76-ab56-486d-8158-cd8c3c1c9035 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Returning 404 to user: Instance f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:28:12.737136 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-faa05f76-ab56-486d-8158-cd8c3c1c9035 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" status: 404 len: 111 microversion: 2.1 time: 0.073854 Oct 10 23:28:12.739925 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1359/2801] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:28:12 2022] DELETE /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:28:12.751623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-60a60914-2938-4ab2-b509-92a64dd85aad tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662a868af0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:12.858083 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-60a60914-2938-4ab2-b509-92a64dd85aad tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f" status: 200 len: 1429 microversion: 2.1 time: 0.116693 Oct 10 23:28:12.860919 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1360/2802] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:28:12 2022] GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f => generated 1429 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:12.882019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f56d2226-31a4-4b95-90f8-0e659130dff3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:12.887327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f56d2226-31a4-4b95-90f8-0e659130dff3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:12.914502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f56d2226-31a4-4b95-90f8-0e659130dff3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:12.915160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f56d2226-31a4-4b95-90f8-0e659130dff3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:12.915696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f56d2226-31a4-4b95-90f8-0e659130dff3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:12.916505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f56d2226-31a4-4b95-90f8-0e659130dff3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:12.917077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f56d2226-31a4-4b95-90f8-0e659130dff3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:12.918045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f56d2226-31a4-4b95-90f8-0e659130dff3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:13.063564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-b5237844-c484-4b2d-9152-af55e9d95bb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:28:13.064454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-b5237844-c484-4b2d-9152-af55e9d95bb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:28:13.065207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-b5237844-c484-4b2d-9152-af55e9d95bb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:28:13.065816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-b5237844-c484-4b2d-9152-af55e9d95bb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:28:13.066420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-b5237844-c484-4b2d-9152-af55e9d95bb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:28:13.083953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b5237844-c484-4b2d-9152-af55e9d95bb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:13.087135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b5237844-c484-4b2d-9152-af55e9d95bb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:13.088638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b5237844-c484-4b2d-9152-af55e9d95bb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:13.090338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b5237844-c484-4b2d-9152-af55e9d95bb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:13.091156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b5237844-c484-4b2d-9152-af55e9d95bb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:13.091898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b5237844-c484-4b2d-9152-af55e9d95bb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:13.112905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-b5237844-c484-4b2d-9152-af55e9d95bb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Getting quotas for project a1c4489c308e462d89b97edcf6c21572. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:28:13.119358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-b5237844-c484-4b2d-9152-af55e9d95bb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Getting quotas for user f891fce5072c448c97f96a9df58d981e and project a1c4489c308e462d89b97edcf6c21572. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:28:13.135400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b5237844-c484-4b2d-9152-af55e9d95bb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:28:13.138600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b5237844-c484-4b2d-9152-af55e9d95bb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:28:13.220300 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b5237844-c484-4b2d-9152-af55e9d95bb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.350033 Oct 10 23:28:13.227737 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1443/2803] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:28:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:28:13.233003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c84ffda3-d425-44ff-b8e0-b1134e1c6020 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:13.242796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c84ffda3-d425-44ff-b8e0-b1134e1c6020 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Searching by: {'deleted': False} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:28:13.258454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c84ffda3-d425-44ff-b8e0-b1134e1c6020 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:13.264386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c84ffda3-d425-44ff-b8e0-b1134e1c6020 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:13.266240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c84ffda3-d425-44ff-b8e0-b1134e1c6020 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:13.268970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c84ffda3-d425-44ff-b8e0-b1134e1c6020 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:13.269679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c84ffda3-d425-44ff-b8e0-b1134e1c6020 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:13.272255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c84ffda3-d425-44ff-b8e0-b1134e1c6020 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:13.307920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f56d2226-31a4-4b95-90f8-0e659130dff3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:13.322072 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f56d2226-31a4-4b95-90f8-0e659130dff3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1313 microversion: 2.1 time: 0.447373 Oct 10 23:28:13.328586 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1361/2804] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:12 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:13.350284 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f205d791-46fb-4176-94ce-32d50051f892 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:13.355980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f205d791-46fb-4176-94ce-32d50051f892 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: f2e94f4a-d35f-4d5f-abf3-4366dea38dd5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:13.381209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f205d791-46fb-4176-94ce-32d50051f892 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:13.381916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f205d791-46fb-4176-94ce-32d50051f892 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:13.382457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f205d791-46fb-4176-94ce-32d50051f892 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:13.383396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f205d791-46fb-4176-94ce-32d50051f892 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:13.383954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f205d791-46fb-4176-94ce-32d50051f892 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:13.386656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f205d791-46fb-4176-94ce-32d50051f892 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:13.445722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.multi_cell_list [None req-c84ffda3-d425-44ff-b8e0-b1134e1c6020 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Listed batch of 8 results from cell out of 999 limit. Returned 8 total so far. {{(pid=120613) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:28:13.479232 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-f205d791-46fb-4176-94ce-32d50051f892 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] HTTP exception thrown: Instance f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 could not be found. Oct 10 23:28:13.486410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f205d791-46fb-4176-94ce-32d50051f892 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Request method failure captured: Oct 10 23:28:13.486410 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 HTTP/1.1 Oct 10 23:28:13.486410 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:28:13.486410 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:28:13.486410 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:28:13.486410 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:28:13.486410 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:28:13.486410 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:28:13.486410 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:28:13.486410 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:28:13.486410 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKodH0fxs2_QqgQPZBXiRHxUGQToSGNphfb1ApTO4qdtCRqJk85ZpbJn4ADwdL_CkSvjLKmisPIKV-BgQrRusbGHcomt05nmdASfITn9BhMFFQMGOP4s6ko0XgbupUeZgJyM-nJ5ZHbN8-sRw5IXA1kqVGVPkK12Xm_L83qfNzxVJiw Oct 10 23:28:13.486410 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:28:13.486410 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:28:13.486410 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:28:13.486410 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:28:13.486410 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:28:13.486410 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:28:13.486410 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 43bf1bebb02c4359a949d820dd31c49e Oct 10 23:28:13.486410 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1763207518 Oct 10 23:28:13.486410 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:28:13.486410 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:28:13.488088 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/43bf1bebb02c4359a949d820dd31c49e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/43bf1bebb02c4359a949d820dd31c49e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/43bf1bebb02c4359a949d820dd31c49e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_43bf1bebb02c4359a949d820dd31c49e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:28:13.488088 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1763207518 Oct 10 23:28:13.488088 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 43bf1bebb02c4359a949d820dd31c49e Oct 10 23:28:13.488088 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1763207518 Oct 10 23:28:13.488088 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-FloatingIPsAssociationTestJSON-1763207518-project Oct 10 23:28:13.488088 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:28:13.488088 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:28:13.488088 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 3fd164398b9e4a8dac71bcd96eccbb2a Oct 10 23:28:13.488088 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1763207518-project Oct 10 23:28:13.488088 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:28:13.488088 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 could not be found. Oct 10 23:28:13.488088 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'f2e94f4a-d35f-4d5f-abf3-4366dea38dd5'} Oct 10 23:28:13.488971 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:28:13.488971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:13.488971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:28:13.488971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:28:13.488971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:28:13.488971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:28:13.488971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:28:13.488971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:28:13.488971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:28:13.488971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:28:13.488971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 could not be found. Oct 10 23:28:13.488971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:13.488971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:13.488971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:13.488971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:13.488971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:13.488971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:13.488971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:28:13.488971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:28:13.488971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:28:13.490436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:28:13.490436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:28:13.490436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:28:13.490436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:28:13.490436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:28:13.490436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:28:13.490436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:28:13.490436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 could not be found. Oct 10 23:28:13.490436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:13.490436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:13.490436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:13.490436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:13.490436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:13.490436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:13.490436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:28:13.490436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:28:13.490436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 could not be found. Oct 10 23:28:13.490436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:13.492379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f205d791-46fb-4176-94ce-32d50051f892 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Returning 404 to user: Instance f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:28:13.494687 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f205d791-46fb-4176-94ce-32d50051f892 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5" status: 404 len: 111 microversion: 2.1 time: 0.164506 Oct 10 23:28:13.501585 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1362/2805] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:13 2022] GET /compute/v2.1/servers/f2e94f4a-d35f-4d5f-abf3-4366dea38dd5 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:28:13.511168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bd2a9055-1a46-4557-ac8f-6985a95c9ad7 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:13.513434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bd2a9055-1a46-4557-ac8f-6985a95c9ad7 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:13.676180 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bd2a9055-1a46-4557-ac8f-6985a95c9ad7 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:13.676333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c84ffda3-d425-44ff-b8e0-b1134e1c6020 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:13.676333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c84ffda3-d425-44ff-b8e0-b1134e1c6020 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:13.676333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c84ffda3-d425-44ff-b8e0-b1134e1c6020 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:13.685268 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bd2a9055-1a46-4557-ac8f-6985a95c9ad7 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1224 microversion: 2.1 time: 0.183432 Oct 10 23:28:13.687818 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1363/2806] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:13 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1224 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:13.715621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-41c20bb0-4bf1-4d7a-9796-4d989160f779 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '.version_select at 0x7f662a7e7820>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:14.369668 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c84ffda3-d425-44ff-b8e0-b1134e1c6020 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 14319 microversion: 2.1 time: 1.140464 Oct 10 23:28:14.371294 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1444/2807] 10.222.0.23 () {58 vars in 1171 bytes} [Mon Oct 10 23:28:13 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 14319 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:28:14.376706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-2806a6e0-8510-4597-bffd-0c14fccedadd req-4ad4d7d7-5c9a-4718-8e63-d2f415b0226c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcb66932-449d-48cd-9a36-485807874e27", "tag": "c68baca6-c92c-4e7a-bef8-b00039aec8ff"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:14.424630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2806a6e0-8510-4597-bffd-0c14fccedadd req-4ad4d7d7-5c9a-4718-8e63-d2f415b0226c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:14.427771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2806a6e0-8510-4597-bffd-0c14fccedadd req-4ad4d7d7-5c9a-4718-8e63-d2f415b0226c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:14.428397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2806a6e0-8510-4597-bffd-0c14fccedadd req-4ad4d7d7-5c9a-4718-8e63-d2f415b0226c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:14.503103 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-2806a6e0-8510-4597-bffd-0c14fccedadd req-4ad4d7d7-5c9a-4718-8e63-d2f415b0226c service nova] Creating event network-changed:c68baca6-c92c-4e7a-bef8-b00039aec8ff for instance dcb66932-449d-48cd-9a36-485807874e27 on n-h1-860864-2 Oct 10 23:28:14.586553 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-2806a6e0-8510-4597-bffd-0c14fccedadd req-4ad4d7d7-5c9a-4718-8e63-d2f415b0226c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165415 Oct 10 23:28:14.587712 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1445/2808] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:28:14.593691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a918b23c-bb8b-49f9-969d-eaefd3ed4949 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f6633b731f0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:14.651696 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a918b23c-bb8b-49f9-969d-eaefd3ed4949 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f" status: 200 len: 1429 microversion: 2.1 time: 0.062448 Oct 10 23:28:14.652626 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1446/2809] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:28:14 2022] GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f => generated 1429 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:15.022359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-784c77b8-57ea-414f-947c-56637aac46e0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:15.023743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-784c77b8-57ea-414f-947c-56637aac46e0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:15.049923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-784c77b8-57ea-414f-947c-56637aac46e0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:15.050431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-784c77b8-57ea-414f-947c-56637aac46e0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:15.050875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-784c77b8-57ea-414f-947c-56637aac46e0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:15.069278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-784c77b8-57ea-414f-947c-56637aac46e0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:15.069931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-784c77b8-57ea-414f-947c-56637aac46e0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:15.070490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-784c77b8-57ea-414f-947c-56637aac46e0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:15.182131 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-784c77b8-57ea-414f-947c-56637aac46e0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/ips" status: 200 len: 145 microversion: 2.1 time: 0.528195 Oct 10 23:28:15.183734 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1447/2810] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 10 23:28:14 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/ips => generated 145 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:28:15.193099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2aed7951-df20-4acd-828d-911f7a377362 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:15.196979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2aed7951-df20-4acd-828d-911f7a377362 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:15.209455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2aed7951-df20-4acd-828d-911f7a377362 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:15.214530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2aed7951-df20-4acd-828d-911f7a377362 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:15.214996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2aed7951-df20-4acd-828d-911f7a377362 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:15.216284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2aed7951-df20-4acd-828d-911f7a377362 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:15.217320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2aed7951-df20-4acd-828d-911f7a377362 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:15.217957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2aed7951-df20-4acd-828d-911f7a377362 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:15.528365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2aed7951-df20-4acd-828d-911f7a377362 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:15.544823 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2aed7951-df20-4acd-828d-911f7a377362 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1497 microversion: 2.1 time: 0.358259 Oct 10 23:28:15.567688 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1448/2811] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:15 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1497 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:15.582263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8ce9c502-c35e-472f-9848-8718b6c31b85 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:15.601760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8ce9c502-c35e-472f-9848-8718b6c31b85 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Searching by: {'deleted': False, 'project_id': '7c369bc97cfa4564b599b03ef3052a47'} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:28:15.622350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ce9c502-c35e-472f-9848-8718b6c31b85 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:15.628665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ce9c502-c35e-472f-9848-8718b6c31b85 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:15.631335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ce9c502-c35e-472f-9848-8718b6c31b85 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:15.634229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ce9c502-c35e-472f-9848-8718b6c31b85 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:15.634918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ce9c502-c35e-472f-9848-8718b6c31b85 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:15.636343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ce9c502-c35e-472f-9848-8718b6c31b85 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:15.728178 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8ce9c502-c35e-472f-9848-8718b6c31b85 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?tenant_id=4b2326c88f134b7299d87d1133041421" status: 200 len: 15 microversion: 2.1 time: 0.157881 Oct 10 23:28:15.729166 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1449/2812] 10.222.0.23 () {58 vars in 1231 bytes} [Mon Oct 10 23:28:15 2022] GET /compute/v2.1/servers/detail?tenant_id=4b2326c88f134b7299d87d1133041421 => generated 15 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:28:15.744674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a7cdf049-53c7-4d61-9c7d-018d70a3ffde tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:15.748213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a7cdf049-53c7-4d61-9c7d-018d70a3ffde tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:15.764639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7cdf049-53c7-4d61-9c7d-018d70a3ffde tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:15.765145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7cdf049-53c7-4d61-9c7d-018d70a3ffde tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:15.766214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7cdf049-53c7-4d61-9c7d-018d70a3ffde tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:15.766445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7cdf049-53c7-4d61-9c7d-018d70a3ffde tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:15.778251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7cdf049-53c7-4d61-9c7d-018d70a3ffde tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:15.778894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7cdf049-53c7-4d61-9c7d-018d70a3ffde tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:16.054090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a7cdf049-53c7-4d61-9c7d-018d70a3ffde tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:16.066431 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a7cdf049-53c7-4d61-9c7d-018d70a3ffde tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1284 microversion: 2.1 time: 0.335879 Oct 10 23:28:16.067037 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1450/2813] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:15 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1284 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:16.105903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b18989e8-9dd8-4c2b-a9d0-55f1cb0308dc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:16.108360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b18989e8-9dd8-4c2b-a9d0-55f1cb0308dc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:16.134396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b18989e8-9dd8-4c2b-a9d0-55f1cb0308dc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:16.142557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b18989e8-9dd8-4c2b-a9d0-55f1cb0308dc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:16.143274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b18989e8-9dd8-4c2b-a9d0-55f1cb0308dc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:16.151215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b18989e8-9dd8-4c2b-a9d0-55f1cb0308dc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:16.151926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b18989e8-9dd8-4c2b-a9d0-55f1cb0308dc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:16.152553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b18989e8-9dd8-4c2b-a9d0-55f1cb0308dc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:16.232596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-b18989e8-9dd8-4c2b-a9d0-55f1cb0308dc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lazy-loading 'flavor' on Instance uuid fec8a1d6-8362-45be-88f9-beebbbb47091 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:28:16.448869 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b18989e8-9dd8-4c2b-a9d0-55f1cb0308dc tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "POST /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091/action" status: 200 len: 32 microversion: 2.1 time: 0.372028 Oct 10 23:28:16.466426 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1451/2814] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:28:16 2022] POST /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091/action => generated 32 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:28:16.472778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e99a4dc4-6d60-452b-9acf-8f5188b36f09 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f6633b0fdc0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:16.676744 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e99a4dc4-6d60-452b-9acf-8f5188b36f09 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f" status: 200 len: 1429 microversion: 2.1 time: 0.208824 Oct 10 23:28:16.678476 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1452/2815] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:28:16 2022] GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f => generated 1429 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:16.703678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1a6de2eb-9ade-4a9b-ba6e-a3180aeff8a9 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:16.734598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1a6de2eb-9ade-4a9b-ba6e-a3180aeff8a9 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Searching by: {'tenant_id': '4b2326c88f134b7299d87d1133041421', 'deleted': False} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:28:16.755593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a6de2eb-9ade-4a9b-ba6e-a3180aeff8a9 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:16.759881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a6de2eb-9ade-4a9b-ba6e-a3180aeff8a9 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:16.769053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a6de2eb-9ade-4a9b-ba6e-a3180aeff8a9 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:16.770226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a6de2eb-9ade-4a9b-ba6e-a3180aeff8a9 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:16.771087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a6de2eb-9ade-4a9b-ba6e-a3180aeff8a9 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:16.771763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a6de2eb-9ade-4a9b-ba6e-a3180aeff8a9 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:16.847396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.multi_cell_list [None req-1a6de2eb-9ade-4a9b-ba6e-a3180aeff8a9 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120613) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:28:16.973424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a6de2eb-9ade-4a9b-ba6e-a3180aeff8a9 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:16.976638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a6de2eb-9ade-4a9b-ba6e-a3180aeff8a9 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:16.982795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a6de2eb-9ade-4a9b-ba6e-a3180aeff8a9 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:17.507450 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1a6de2eb-9ade-4a9b-ba6e-a3180aeff8a9 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=4b2326c88f134b7299d87d1133041421" status: 200 len: 4826 microversion: 2.1 time: 0.827632 Oct 10 23:28:17.508563 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1453/2816] 10.222.0.23 () {58 vars in 1257 bytes} [Mon Oct 10 23:28:16 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=4b2326c88f134b7299d87d1133041421 => generated 4826 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:17.513637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c07db541-fe80-4a60-9748-551b4300d4ad tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:17.514691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c07db541-fe80-4a60-9748-551b4300d4ad tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:17.529102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c07db541-fe80-4a60-9748-551b4300d4ad tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:17.534258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c07db541-fe80-4a60-9748-551b4300d4ad tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:17.535348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c07db541-fe80-4a60-9748-551b4300d4ad tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:17.536699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c07db541-fe80-4a60-9748-551b4300d4ad tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:17.537466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c07db541-fe80-4a60-9748-551b4300d4ad tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:17.538798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c07db541-fe80-4a60-9748-551b4300d4ad tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:18.295417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c07db541-fe80-4a60-9748-551b4300d4ad tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:18.305933 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c07db541-fe80-4a60-9748-551b4300d4ad tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 0.796168 Oct 10 23:28:18.306533 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1454/2817] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:17 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:18.347300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8897f0fd-4786-441c-99c0-65d60d1f44be tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:18.349456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8897f0fd-4786-441c-99c0-65d60d1f44be tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:18.371152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8897f0fd-4786-441c-99c0-65d60d1f44be tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:18.371667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8897f0fd-4786-441c-99c0-65d60d1f44be tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:18.381599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8897f0fd-4786-441c-99c0-65d60d1f44be tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:18.389296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8897f0fd-4786-441c-99c0-65d60d1f44be tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:18.389840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8897f0fd-4786-441c-99c0-65d60d1f44be tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:18.394565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8897f0fd-4786-441c-99c0-65d60d1f44be tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:18.434742 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-41c20bb0-4bf1-4d7a-9796-4d989160f779 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/8b601cca-2b6d-4708-b080-1701cca629c2" status: 202 len: 0 microversion: 2.1 time: 4.740715 Oct 10 23:28:18.435926 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1364/2818] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 10 23:28:13 2022] DELETE /compute/v2.1/os-floating-ips/8b601cca-2b6d-4708-b080-1701cca629c2 => generated 0 bytes in 4747 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:28:18.447780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6288f93f-ae14-4bd4-a187-7d3693cefc6f tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:18.475219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6288f93f-ae14-4bd4-a187-7d3693cefc6f tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Searching by: {'tenant_id': '7c369bc97cfa4564b599b03ef3052a47', 'deleted': False} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:28:18.487563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:28:18.493536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6288f93f-ae14-4bd4-a187-7d3693cefc6f tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:18.494476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6288f93f-ae14-4bd4-a187-7d3693cefc6f tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:18.495576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6288f93f-ae14-4bd4-a187-7d3693cefc6f tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:18.517343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6288f93f-ae14-4bd4-a187-7d3693cefc6f tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:18.521294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6288f93f-ae14-4bd4-a187-7d3693cefc6f tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:18.522157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6288f93f-ae14-4bd4-a187-7d3693cefc6f tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:18.621285 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6288f93f-ae14-4bd4-a187-7d3693cefc6f tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7c369bc97cfa4564b599b03ef3052a47" status: 200 len: 15 microversion: 2.1 time: 0.183353 Oct 10 23:28:18.622849 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1365/2819] 10.222.0.23 () {58 vars in 1257 bytes} [Mon Oct 10 23:28:18 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7c369bc97cfa4564b599b03ef3052a47 => generated 15 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:28:18.629497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-092d76ff-81f7-4828-b7de-8ea1a79da70d tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662a9c1af0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:18.638171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8897f0fd-4786-441c-99c0-65d60d1f44be tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:18.658444 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8897f0fd-4786-441c-99c0-65d60d1f44be tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1282 microversion: 2.1 time: 0.322841 Oct 10 23:28:18.659098 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1455/2820] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:18 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1282 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:18.684535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0989f314-d938-4e64-9a8f-84f5eb49485a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:18.685053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0989f314-d938-4e64-9a8f-84f5eb49485a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:18.720815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0989f314-d938-4e64-9a8f-84f5eb49485a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:18.723825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0989f314-d938-4e64-9a8f-84f5eb49485a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:18.726541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0989f314-d938-4e64-9a8f-84f5eb49485a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:18.732626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0989f314-d938-4e64-9a8f-84f5eb49485a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:18.733826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0989f314-d938-4e64-9a8f-84f5eb49485a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:18.736875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0989f314-d938-4e64-9a8f-84f5eb49485a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:18.753830 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-092d76ff-81f7-4828-b7de-8ea1a79da70d tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f" status: 200 len: 1429 microversion: 2.1 time: 0.129420 Oct 10 23:28:18.756777 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1366/2821] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:28:18 2022] GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f => generated 1429 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:18.772679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5211817c-a1b2-4b15-bb87-c8125038f642 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:18.786379 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5211817c-a1b2-4b15-bb87-c8125038f642 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.026511 Oct 10 23:28:18.792536 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1367/2822] 10.222.0.23 () {58 vars in 1189 bytes} [Mon Oct 10 23:28:18 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:28:18.822691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-83371308-81cc-45a8-8c7b-1ef3c7eba460 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:18.826388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-83371308-81cc-45a8-8c7b-1ef3c7eba460 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:18.840148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83371308-81cc-45a8-8c7b-1ef3c7eba460 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:18.842615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83371308-81cc-45a8-8c7b-1ef3c7eba460 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:18.843828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83371308-81cc-45a8-8c7b-1ef3c7eba460 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:18.846735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83371308-81cc-45a8-8c7b-1ef3c7eba460 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:18.849868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83371308-81cc-45a8-8c7b-1ef3c7eba460 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:18.850489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83371308-81cc-45a8-8c7b-1ef3c7eba460 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:18.876832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0989f314-d938-4e64-9a8f-84f5eb49485a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:28:19.006471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:28:19.086581 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-83371308-81cc-45a8-8c7b-1ef3c7eba460 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838/action" status: 202 len: 0 microversion: 2.1 time: 0.268607 Oct 10 23:28:19.087394 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1368/2823] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:28:18 2022] POST /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 23:28:19.095281 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0989f314-d938-4e64-9a8f-84f5eb49485a tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27" status: 204 len: 0 microversion: 2.1 time: 0.430835 Oct 10 23:28:19.096072 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1456/2824] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:28:18 2022] DELETE /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:28:19.100744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4e499201-26f8-4d1f-a4b5-3dd564ae9e6c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:19.115815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ab9c1308-e015-448f-84e8-9d5ec553b9cd tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:19.116430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4e499201-26f8-4d1f-a4b5-3dd564ae9e6c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:19.117204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4e499201-26f8-4d1f-a4b5-3dd564ae9e6c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '4b2326c88f134b7299d87d1133041421'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:28:19.118377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ab9c1308-e015-448f-84e8-9d5ec553b9cd tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:19.129269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab9c1308-e015-448f-84e8-9d5ec553b9cd tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:19.130454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab9c1308-e015-448f-84e8-9d5ec553b9cd tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:19.131372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab9c1308-e015-448f-84e8-9d5ec553b9cd tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:19.132428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e499201-26f8-4d1f-a4b5-3dd564ae9e6c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:19.132926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e499201-26f8-4d1f-a4b5-3dd564ae9e6c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:19.133365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e499201-26f8-4d1f-a4b5-3dd564ae9e6c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:19.134147 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e499201-26f8-4d1f-a4b5-3dd564ae9e6c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:19.134796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e499201-26f8-4d1f-a4b5-3dd564ae9e6c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:19.134928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab9c1308-e015-448f-84e8-9d5ec553b9cd tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:19.136640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab9c1308-e015-448f-84e8-9d5ec553b9cd tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:19.137118 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e499201-26f8-4d1f-a4b5-3dd564ae9e6c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:19.137255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab9c1308-e015-448f-84e8-9d5ec553b9cd tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:19.170082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.multi_cell_list [None req-4e499201-26f8-4d1f-a4b5-3dd564ae9e6c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:28:19.271253 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4e499201-26f8-4d1f-a4b5-3dd564ae9e6c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.178184 Oct 10 23:28:19.282640 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1369/2825] 10.222.0.23 () {58 vars in 1150 bytes} [Mon Oct 10 23:28:19 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:28:19.319361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5a8b803d-a233-4256-acb1-c63234763fd8 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:19.322091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5a8b803d-a233-4256-acb1-c63234763fd8 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:19.339213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a8b803d-a233-4256-acb1-c63234763fd8 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:19.341438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a8b803d-a233-4256-acb1-c63234763fd8 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:19.342050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a8b803d-a233-4256-acb1-c63234763fd8 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:19.347298 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a8b803d-a233-4256-acb1-c63234763fd8 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:19.348044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a8b803d-a233-4256-acb1-c63234763fd8 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:19.349403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a8b803d-a233-4256-acb1-c63234763fd8 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:19.431285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ab9c1308-e015-448f-84e8-9d5ec553b9cd tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:19.449714 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ab9c1308-e015-448f-84e8-9d5ec553b9cd tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27" status: 200 len: 1526 microversion: 2.1 time: 0.346805 Oct 10 23:28:19.459176 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1457/2826] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:19 2022] GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27 => generated 1526 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:19.495078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9be1ded3-b0ff-4d84-be83-ff87326d24c6 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:19.495727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9be1ded3-b0ff-4d84-be83-ff87326d24c6 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:19.539443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9be1ded3-b0ff-4d84-be83-ff87326d24c6 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:19.544400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9be1ded3-b0ff-4d84-be83-ff87326d24c6 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:19.545087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9be1ded3-b0ff-4d84-be83-ff87326d24c6 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:19.546565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9be1ded3-b0ff-4d84-be83-ff87326d24c6 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:19.547338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9be1ded3-b0ff-4d84-be83-ff87326d24c6 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:19.549550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9be1ded3-b0ff-4d84-be83-ff87326d24c6 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:19.607648 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5a8b803d-a233-4256-acb1-c63234763fd8 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838/action" status: 202 len: 0 microversion: 2.1 time: 0.312498 Oct 10 23:28:19.612787 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1370/2827] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:28:19 2022] POST /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:28:19.618315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6cfbd54a-75b0-4a07-86cd-a81a220d178c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89f3878c-1155-4056-a83d-749a443dca23"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:19.621158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6cfbd54a-75b0-4a07-86cd-a81a220d178c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:19.636388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6cfbd54a-75b0-4a07-86cd-a81a220d178c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:19.638603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6cfbd54a-75b0-4a07-86cd-a81a220d178c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:19.639510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6cfbd54a-75b0-4a07-86cd-a81a220d178c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:19.640645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6cfbd54a-75b0-4a07-86cd-a81a220d178c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:19.645236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6cfbd54a-75b0-4a07-86cd-a81a220d178c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:19.646196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6cfbd54a-75b0-4a07-86cd-a81a220d178c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:20.048562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9be1ded3-b0ff-4d84-be83-ff87326d24c6 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:20.067884 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9be1ded3-b0ff-4d84-be83-ff87326d24c6 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 0.605544 Oct 10 23:28:20.081406 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1458/2828] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:19 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:20.082053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9e83431f-170f-4ed9-8424-6ac8ba4f5e6a tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:20.082263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9e83431f-170f-4ed9-8424-6ac8ba4f5e6a tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:20.103333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e83431f-170f-4ed9-8424-6ac8ba4f5e6a tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:20.104147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e83431f-170f-4ed9-8424-6ac8ba4f5e6a tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:20.106781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e83431f-170f-4ed9-8424-6ac8ba4f5e6a tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:20.110356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e83431f-170f-4ed9-8424-6ac8ba4f5e6a tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:20.111725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e83431f-170f-4ed9-8424-6ac8ba4f5e6a tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:20.112737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e83431f-170f-4ed9-8424-6ac8ba4f5e6a tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:20.287298 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6cfbd54a-75b0-4a07-86cd-a81a220d178c tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "POST /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.672853 Oct 10 23:28:20.289132 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1371/2829] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Oct 10 23:28:19 2022] POST /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-volume_attachments => generated 194 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:28:20.310048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ce29917e-046d-4f93-86cb-45751e467e70 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:20.312861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ce29917e-046d-4f93-86cb-45751e467e70 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:20.354976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce29917e-046d-4f93-86cb-45751e467e70 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:20.359853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce29917e-046d-4f93-86cb-45751e467e70 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:20.360641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce29917e-046d-4f93-86cb-45751e467e70 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:20.364228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce29917e-046d-4f93-86cb-45751e467e70 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:20.364898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce29917e-046d-4f93-86cb-45751e467e70 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:20.365592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce29917e-046d-4f93-86cb-45751e467e70 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:20.514399 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9e83431f-170f-4ed9-8424-6ac8ba4f5e6a tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1614 microversion: 2.1 time: 0.443297 Oct 10 23:28:20.519334 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1459/2830] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:20 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1614 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:20.552603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c1c27ca4-baa1-4e19-af84-a0819e494030 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662b4bc040>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:20.696787 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c1c27ca4-baa1-4e19-af84-a0819e494030 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f" status: 200 len: 1429 microversion: 2.1 time: 0.176201 Oct 10 23:28:20.697393 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1460/2831] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:28:20 2022] GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f => generated 1429 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:20.705182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1c367bfb-df1e-4536-845e-16491d88fa79 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:20.706942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1c367bfb-df1e-4536-845e-16491d88fa79 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:20.721635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c367bfb-df1e-4536-845e-16491d88fa79 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:20.723181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c367bfb-df1e-4536-845e-16491d88fa79 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:20.726509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c367bfb-df1e-4536-845e-16491d88fa79 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:20.728013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c367bfb-df1e-4536-845e-16491d88fa79 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:20.728661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c367bfb-df1e-4536-845e-16491d88fa79 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:20.729314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c367bfb-df1e-4536-845e-16491d88fa79 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:20.773284 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ce29917e-046d-4f93-86cb-45751e467e70 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:20.784062 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ce29917e-046d-4f93-86cb-45751e467e70 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1324 microversion: 2.1 time: 0.493464 Oct 10 23:28:20.808243 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1372/2832] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:20 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1324 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:20.829787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-461473a1-0557-43ec-8a2d-399ffc11651c tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:20.830598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-461473a1-0557-43ec-8a2d-399ffc11651c tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:20.863268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-461473a1-0557-43ec-8a2d-399ffc11651c tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:20.863778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-461473a1-0557-43ec-8a2d-399ffc11651c tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:20.864227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-461473a1-0557-43ec-8a2d-399ffc11651c tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:20.864949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-461473a1-0557-43ec-8a2d-399ffc11651c tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:20.865431 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-461473a1-0557-43ec-8a2d-399ffc11651c tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:20.865871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-461473a1-0557-43ec-8a2d-399ffc11651c tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:21.127922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1c367bfb-df1e-4536-845e-16491d88fa79 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:21.142399 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1c367bfb-df1e-4536-845e-16491d88fa79 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27" status: 200 len: 1526 microversion: 2.1 time: 0.443838 Oct 10 23:28:21.160898 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1461/2833] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:20 2022] GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27 => generated 1526 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:21.168465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fe2473e3-cec9-4cad-8052-8793cb572395 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:21.169468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fe2473e3-cec9-4cad-8052-8793cb572395 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:21.180154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe2473e3-cec9-4cad-8052-8793cb572395 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:21.181820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe2473e3-cec9-4cad-8052-8793cb572395 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:21.182691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe2473e3-cec9-4cad-8052-8793cb572395 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:21.183665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe2473e3-cec9-4cad-8052-8793cb572395 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:21.184371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe2473e3-cec9-4cad-8052-8793cb572395 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:21.185034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe2473e3-cec9-4cad-8052-8793cb572395 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:21.474978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fe2473e3-cec9-4cad-8052-8793cb572395 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:21.484956 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fe2473e3-cec9-4cad-8052-8793cb572395 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 0.322456 Oct 10 23:28:21.487015 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1462/2834] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:21 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:21.608115 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-461473a1-0557-43ec-8a2d-399ffc11651c tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1614 microversion: 2.1 time: 0.798659 Oct 10 23:28:21.609899 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1373/2835] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:20 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1614 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:21.636772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-08a9b517-45c5-428c-82b4-665257e690ce tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:21.648510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-08a9b517-45c5-428c-82b4-665257e690ce tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Searching by: {'host': 'n-h2-860864-2', 'deleted': False} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:28:21.673218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08a9b517-45c5-428c-82b4-665257e690ce tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:21.679414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08a9b517-45c5-428c-82b4-665257e690ce tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:21.680597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08a9b517-45c5-428c-82b4-665257e690ce tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:21.687929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08a9b517-45c5-428c-82b4-665257e690ce tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:21.688442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08a9b517-45c5-428c-82b4-665257e690ce tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:21.688898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08a9b517-45c5-428c-82b4-665257e690ce tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:21.714935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-28ca99c2-d0a4-4e3f-8d1d-72b08ea00f89 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662a9c15e0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:21.801271 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-28ca99c2-d0a4-4e3f-8d1d-72b08ea00f89 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f" status: 200 len: 1429 microversion: 2.1 time: 0.091610 Oct 10 23:28:21.804893 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1374/2836] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:28:21 2022] GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f => generated 1429 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:21.825344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a03e07c4-ab02-4daf-92dd-4724f6df2983 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:21.826081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a03e07c4-ab02-4daf-92dd-4724f6df2983 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:21.844262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a03e07c4-ab02-4daf-92dd-4724f6df2983 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:21.844977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a03e07c4-ab02-4daf-92dd-4724f6df2983 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:21.845481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a03e07c4-ab02-4daf-92dd-4724f6df2983 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:21.846210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a03e07c4-ab02-4daf-92dd-4724f6df2983 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:21.846671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a03e07c4-ab02-4daf-92dd-4724f6df2983 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:21.847105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a03e07c4-ab02-4daf-92dd-4724f6df2983 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:21.895488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.multi_cell_list [None req-08a9b517-45c5-428c-82b4-665257e690ce tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=120613) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:28:22.028612 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-08a9b517-45c5-428c-82b4-665257e690ce tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] 10.222.0.23 "GET /compute/v2.1/servers?host=n-h2-860864-2&all_tenants=1" status: 200 len: 1643 microversion: 2.1 time: 0.396169 Oct 10 23:28:22.029642 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1463/2837] 10.222.0.23 () {58 vars in 1190 bytes} [Mon Oct 10 23:28:21 2022] GET /compute/v2.1/servers?host=n-h2-860864-2&all_tenants=1 => generated 1643 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:22.052419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4739ee84-437d-4918-b215-595fc19417c6 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:22.059556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4739ee84-437d-4918-b215-595fc19417c6 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:28:22.079420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4739ee84-437d-4918-b215-595fc19417c6 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:22.080332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4739ee84-437d-4918-b215-595fc19417c6 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:22.081084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4739ee84-437d-4918-b215-595fc19417c6 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:22.082121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4739ee84-437d-4918-b215-595fc19417c6 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:22.082820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4739ee84-437d-4918-b215-595fc19417c6 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:22.083478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4739ee84-437d-4918-b215-595fc19417c6 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:22.123331 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4739ee84-437d-4918-b215-595fc19417c6 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] 10.222.0.23 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.074705 Oct 10 23:28:22.136967 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1464/2838] 10.222.0.23 () {58 vars in 1196 bytes} [Mon Oct 10 23:28:22 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:28:22.149980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7e32a77a-c23d-49c4-b3e7-90bfb3558854 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:22.150368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7e32a77a-c23d-49c4-b3e7-90bfb3558854 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:22.158102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e32a77a-c23d-49c4-b3e7-90bfb3558854 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:22.159052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e32a77a-c23d-49c4-b3e7-90bfb3558854 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:22.159800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e32a77a-c23d-49c4-b3e7-90bfb3558854 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:22.160958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e32a77a-c23d-49c4-b3e7-90bfb3558854 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:22.161698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e32a77a-c23d-49c4-b3e7-90bfb3558854 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:22.162597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e32a77a-c23d-49c4-b3e7-90bfb3558854 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:22.287478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a03e07c4-ab02-4daf-92dd-4724f6df2983 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:22.302148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=7,nova_cell1:RELEASE=1,nova_cell1:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:28:22.312819 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a03e07c4-ab02-4daf-92dd-4724f6df2983 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1324 microversion: 2.1 time: 0.496347 Oct 10 23:28:22.314453 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1375/2839] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:21 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1324 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:22.336532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6325e6b7-6d42-4849-8a0d-b64a5b41d3c2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:22.338773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6325e6b7-6d42-4849-8a0d-b64a5b41d3c2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:22.354439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6325e6b7-6d42-4849-8a0d-b64a5b41d3c2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:22.354983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6325e6b7-6d42-4849-8a0d-b64a5b41d3c2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:22.356023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6325e6b7-6d42-4849-8a0d-b64a5b41d3c2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:22.356761 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6325e6b7-6d42-4849-8a0d-b64a5b41d3c2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:22.359715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6325e6b7-6d42-4849-8a0d-b64a5b41d3c2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:22.360473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6325e6b7-6d42-4849-8a0d-b64a5b41d3c2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:22.440874 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7e32a77a-c23d-49c4-b3e7-90bfb3558854 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838/action" status: 202 len: 0 microversion: 2.1 time: 0.302343 Oct 10 23:28:22.454120 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1465/2840] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:28:22 2022] POST /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:28:22.465689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-68294912-ae84-4598-87cb-a3f382e1c837 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:22.495371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-68294912-ae84-4598-87cb-a3f382e1c837 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:22.539128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68294912-ae84-4598-87cb-a3f382e1c837 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:22.539128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68294912-ae84-4598-87cb-a3f382e1c837 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:22.539537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68294912-ae84-4598-87cb-a3f382e1c837 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:22.540218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68294912-ae84-4598-87cb-a3f382e1c837 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:22.540723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68294912-ae84-4598-87cb-a3f382e1c837 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:22.541188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68294912-ae84-4598-87cb-a3f382e1c837 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:22.740970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6325e6b7-6d42-4849-8a0d-b64a5b41d3c2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:22.751872 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6325e6b7-6d42-4849-8a0d-b64a5b41d3c2 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27" status: 200 len: 1526 microversion: 2.1 time: 0.433818 Oct 10 23:28:22.753977 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1376/2841] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:22 2022] GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27 => generated 1526 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:22.755766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-68294912-ae84-4598-87cb-a3f382e1c837 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:28:22.756225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-68294912-ae84-4598-87cb-a3f382e1c837 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:28:22.756658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-68294912-ae84-4598-87cb-a3f382e1c837 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:28:22.757069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-68294912-ae84-4598-87cb-a3f382e1c837 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:28:22.757519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-68294912-ae84-4598-87cb-a3f382e1c837 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:28:22.776722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cd85cd34-366b-4ad9-8ac9-4bd1b4441cec tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:22.778415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cd85cd34-366b-4ad9-8ac9-4bd1b4441cec tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:22.803110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd85cd34-366b-4ad9-8ac9-4bd1b4441cec tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:22.804057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd85cd34-366b-4ad9-8ac9-4bd1b4441cec tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:22.807888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd85cd34-366b-4ad9-8ac9-4bd1b4441cec tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:22.818138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd85cd34-366b-4ad9-8ac9-4bd1b4441cec tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:22.821184 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd85cd34-366b-4ad9-8ac9-4bd1b4441cec tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:22.823492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd85cd34-366b-4ad9-8ac9-4bd1b4441cec tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:23.028245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-68294912-ae84-4598-87cb-a3f382e1c837 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:23.037984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68294912-ae84-4598-87cb-a3f382e1c837 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:23.038701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68294912-ae84-4598-87cb-a3f382e1c837 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:23.039322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68294912-ae84-4598-87cb-a3f382e1c837 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:23.040212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68294912-ae84-4598-87cb-a3f382e1c837 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:23.040820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68294912-ae84-4598-87cb-a3f382e1c837 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:23.041439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68294912-ae84-4598-87cb-a3f382e1c837 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:23.083934 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-68294912-ae84-4598-87cb-a3f382e1c837 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "POST /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838/action" status: 202 len: 1067 microversion: 2.1 time: 0.628531 Oct 10 23:28:23.108975 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1466/2842] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:28:22 2022] POST /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838/action => generated 1067 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 10 23:28:23.114780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-29d74f49-6599-4a64-a21d-5866934842c7 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662ad37820>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:23.184330 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-29d74f49-6599-4a64-a21d-5866934842c7 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f" status: 200 len: 1429 microversion: 2.1 time: 0.071915 Oct 10 23:28:23.193193 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1467/2843] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:28:23 2022] GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f => generated 1429 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:23.224499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-056446e7-c6d5-4cd5-a836-1b2a95f0c396 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:23.225926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-056446e7-c6d5-4cd5-a836-1b2a95f0c396 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:23.251623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-056446e7-c6d5-4cd5-a836-1b2a95f0c396 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:23.253067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-056446e7-c6d5-4cd5-a836-1b2a95f0c396 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:23.254618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-056446e7-c6d5-4cd5-a836-1b2a95f0c396 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:23.256974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-056446e7-c6d5-4cd5-a836-1b2a95f0c396 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:23.259112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-056446e7-c6d5-4cd5-a836-1b2a95f0c396 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:23.261805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-056446e7-c6d5-4cd5-a836-1b2a95f0c396 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:23.669634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:28:23.751430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cd85cd34-366b-4ad9-8ac9-4bd1b4441cec tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:23.766365 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cd85cd34-366b-4ad9-8ac9-4bd1b4441cec tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 1.009142 Oct 10 23:28:23.768455 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1377/2844] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:22 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:23.781491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-823c4efd-ee96-4314-9f06-7e500189cd9d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:23.782925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-823c4efd-ee96-4314-9f06-7e500189cd9d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:23.800827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-823c4efd-ee96-4314-9f06-7e500189cd9d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:23.802801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-823c4efd-ee96-4314-9f06-7e500189cd9d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:23.803498 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-823c4efd-ee96-4314-9f06-7e500189cd9d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:23.805583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-823c4efd-ee96-4314-9f06-7e500189cd9d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:23.806441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-823c4efd-ee96-4314-9f06-7e500189cd9d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:23.809397 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-823c4efd-ee96-4314-9f06-7e500189cd9d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:24.228444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-056446e7-c6d5-4cd5-a836-1b2a95f0c396 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:24.241751 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-056446e7-c6d5-4cd5-a836-1b2a95f0c396 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1471 microversion: 2.1 time: 1.052331 Oct 10 23:28:24.242390 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1468/2845] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:23 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1471 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:24.263629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-cab1a73a-aa53-4704-bbc3-309d7fc8ce21 req-9352a967-b09e-44ee-8a56-ee6afac27cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb66932-449d-48cd-9a36-485807874e27", "name": "network-vif-deleted", "tag": "c68baca6-c92c-4e7a-bef8-b00039aec8ff"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:24.311964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cab1a73a-aa53-4704-bbc3-309d7fc8ce21 req-9352a967-b09e-44ee-8a56-ee6afac27cc6 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:24.314918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cab1a73a-aa53-4704-bbc3-309d7fc8ce21 req-9352a967-b09e-44ee-8a56-ee6afac27cc6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:24.316215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cab1a73a-aa53-4704-bbc3-309d7fc8ce21 req-9352a967-b09e-44ee-8a56-ee6afac27cc6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:24.363371 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-cab1a73a-aa53-4704-bbc3-309d7fc8ce21 req-9352a967-b09e-44ee-8a56-ee6afac27cc6 service nova] Creating event network-vif-deleted:c68baca6-c92c-4e7a-bef8-b00039aec8ff for instance dcb66932-449d-48cd-9a36-485807874e27 on n-h1-860864-2 Oct 10 23:28:24.381634 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-cab1a73a-aa53-4704-bbc3-309d7fc8ce21 req-9352a967-b09e-44ee-8a56-ee6afac27cc6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129874 Oct 10 23:28:24.384126 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1469/2846] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:28:24.403488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bdec8c06-e2dc-49d2-a6e3-725e92005767 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:24.405166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bdec8c06-e2dc-49d2-a6e3-725e92005767 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:24.427424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdec8c06-e2dc-49d2-a6e3-725e92005767 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:24.429621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-823c4efd-ee96-4314-9f06-7e500189cd9d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:24.433428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdec8c06-e2dc-49d2-a6e3-725e92005767 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:24.434470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdec8c06-e2dc-49d2-a6e3-725e92005767 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:24.438843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdec8c06-e2dc-49d2-a6e3-725e92005767 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:24.439915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdec8c06-e2dc-49d2-a6e3-725e92005767 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:24.440765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdec8c06-e2dc-49d2-a6e3-725e92005767 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:24.456617 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-823c4efd-ee96-4314-9f06-7e500189cd9d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1324 microversion: 2.1 time: 0.679827 Oct 10 23:28:24.474004 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1378/2847] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:23 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1324 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:24.493134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c049557b-df49-4215-91c4-fb1f430901a6 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662a8fb9d0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:24.505855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdec8c06-e2dc-49d2-a6e3-725e92005767 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:24.507781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdec8c06-e2dc-49d2-a6e3-725e92005767 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:24.508684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdec8c06-e2dc-49d2-a6e3-725e92005767 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:24.509651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-bdec8c06-e2dc-49d2-a6e3-725e92005767 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lazy-loading 'fault' on Instance uuid dcb66932-449d-48cd-9a36-485807874e27 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:28:24.597106 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c049557b-df49-4215-91c4-fb1f430901a6 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f" status: 200 len: 1429 microversion: 2.1 time: 0.121115 Oct 10 23:28:24.605185 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1379/2848] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:28:24 2022] GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f => generated 1429 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:24.618597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bdec8c06-e2dc-49d2-a6e3-725e92005767 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fd164398b9e4a8dac71bcd96eccbb2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bf1bebb02c4359a949d820dd31c49e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:24.631546 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bdec8c06-e2dc-49d2-a6e3-725e92005767 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27" status: 200 len: 1314 microversion: 2.1 time: 0.244140 Oct 10 23:28:24.633801 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1470/2849] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:24 2022] GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:24.798161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ce005e66-7d42-4f72-a31f-e136b6c836db tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:24.798934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ce005e66-7d42-4f72-a31f-e136b6c836db tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:24.825335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce005e66-7d42-4f72-a31f-e136b6c836db tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:24.826618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce005e66-7d42-4f72-a31f-e136b6c836db tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:24.836534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce005e66-7d42-4f72-a31f-e136b6c836db tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:24.845133 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce005e66-7d42-4f72-a31f-e136b6c836db tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:24.845716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce005e66-7d42-4f72-a31f-e136b6c836db tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:24.846411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce005e66-7d42-4f72-a31f-e136b6c836db tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:25.272418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-196c7560-d8f0-4d1e-a351-70bb98618450 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:25.273718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-196c7560-d8f0-4d1e-a351-70bb98618450 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:25.286961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-196c7560-d8f0-4d1e-a351-70bb98618450 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:25.288032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-196c7560-d8f0-4d1e-a351-70bb98618450 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:25.290069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-196c7560-d8f0-4d1e-a351-70bb98618450 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:25.291802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-196c7560-d8f0-4d1e-a351-70bb98618450 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:25.293659 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-196c7560-d8f0-4d1e-a351-70bb98618450 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:25.294339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-196c7560-d8f0-4d1e-a351-70bb98618450 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:25.576475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-196c7560-d8f0-4d1e-a351-70bb98618450 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:25.587683 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-196c7560-d8f0-4d1e-a351-70bb98618450 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1471 microversion: 2.1 time: 0.323460 Oct 10 23:28:25.594826 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1471/2850] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:25 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1471 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:25.608607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9c04fabd-6839-44af-b20e-6f60d3a98cb4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:25.609480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9c04fabd-6839-44af-b20e-6f60d3a98cb4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:25.622908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c04fabd-6839-44af-b20e-6f60d3a98cb4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:25.623522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c04fabd-6839-44af-b20e-6f60d3a98cb4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:25.624073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c04fabd-6839-44af-b20e-6f60d3a98cb4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:25.625701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c04fabd-6839-44af-b20e-6f60d3a98cb4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:25.626276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c04fabd-6839-44af-b20e-6f60d3a98cb4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:25.629909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c04fabd-6839-44af-b20e-6f60d3a98cb4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:25.649559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:28:25.682761 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ce005e66-7d42-4f72-a31f-e136b6c836db tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:25.691511 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ce005e66-7d42-4f72-a31f-e136b6c836db tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 0.899655 Oct 10 23:28:25.695333 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1380/2851] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:24 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:25.704788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b9d2f743-2610-4409-8d57-b0ba99924458 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662a89e9d0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:25.824077 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b9d2f743-2610-4409-8d57-b0ba99924458 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f" status: 200 len: 1429 microversion: 2.1 time: 0.125215 Oct 10 23:28:25.826865 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1381/2852] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:28:25 2022] GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f => generated 1429 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:25.839962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d5e3b0bf-651d-49ca-a753-89db956c2a80 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:25.850696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d5e3b0bf-651d-49ca-a753-89db956c2a80 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] [instance: dcb66932-449d-48cd-9a36-485807874e27] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:25.882716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d5e3b0bf-651d-49ca-a753-89db956c2a80 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:25.889739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d5e3b0bf-651d-49ca-a753-89db956c2a80 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:25.890768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d5e3b0bf-651d-49ca-a753-89db956c2a80 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:25.891685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d5e3b0bf-651d-49ca-a753-89db956c2a80 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:25.892165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d5e3b0bf-651d-49ca-a753-89db956c2a80 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:25.898566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d5e3b0bf-651d-49ca-a753-89db956c2a80 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:25.920762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9c04fabd-6839-44af-b20e-6f60d3a98cb4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:25.932981 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9c04fabd-6839-44af-b20e-6f60d3a98cb4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1324 microversion: 2.1 time: 0.336322 Oct 10 23:28:25.934209 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1472/2853] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:25 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1324 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:25.955657 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-d5e3b0bf-651d-49ca-a753-89db956c2a80 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] HTTP exception thrown: Instance dcb66932-449d-48cd-9a36-485807874e27 could not be found. Oct 10 23:28:25.959742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d5e3b0bf-651d-49ca-a753-89db956c2a80 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Request method failure captured: Oct 10 23:28:25.959742 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27 HTTP/1.1 Oct 10 23:28:25.959742 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:28:25.959742 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:28:25.959742 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:28:25.959742 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:28:25.959742 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:28:25.959742 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:28:25.959742 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:28:25.959742 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:28:25.959742 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKodH0fxs2_QqgQPZBXiRHxUGQToSGNphfb1ApTO4qdtCRqJk85ZpbJn4ADwdL_CkSvjLKmisPIKV-BgQrRusbGHcomt05nmdASfITn9BhMFFQMGOP4s6ko0XgbupUeZgJyM-nJ5ZHbN8-sRw5IXA1kqVGVPkK12Xm_L83qfNzxVJiw Oct 10 23:28:25.959742 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:28:25.959742 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:28:25.959742 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:28:25.959742 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:28:25.959742 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:28:25.959742 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:28:25.959742 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 43bf1bebb02c4359a949d820dd31c49e Oct 10 23:28:25.959742 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1763207518 Oct 10 23:28:25.959742 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:28:25.959742 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:28:25.961873 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/43bf1bebb02c4359a949d820dd31c49e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/43bf1bebb02c4359a949d820dd31c49e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/43bf1bebb02c4359a949d820dd31c49e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_43bf1bebb02c4359a949d820dd31c49e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:28:25.961873 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1763207518 Oct 10 23:28:25.961873 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 43bf1bebb02c4359a949d820dd31c49e Oct 10 23:28:25.961873 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1763207518 Oct 10 23:28:25.961873 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-FloatingIPsAssociationTestJSON-1763207518-project Oct 10 23:28:25.961873 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:28:25.961873 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:28:25.961873 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 3fd164398b9e4a8dac71bcd96eccbb2a Oct 10 23:28:25.961873 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1763207518-project Oct 10 23:28:25.961873 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:28:25.961873 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance dcb66932-449d-48cd-9a36-485807874e27 could not be found. Oct 10 23:28:25.961873 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'dcb66932-449d-48cd-9a36-485807874e27'} Oct 10 23:28:25.963002 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:28:25.963002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:25.963002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:28:25.963002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:28:25.963002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:28:25.963002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:28:25.963002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:28:25.963002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:28:25.963002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:28:25.963002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:28:25.963002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcb66932-449d-48cd-9a36-485807874e27 could not be found. Oct 10 23:28:25.963002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:25.963002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:25.963002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:25.963002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:25.963002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:25.963002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:25.963002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:28:25.963002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:28:25.963002 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:28:25.964628 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:28:25.964628 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:28:25.964628 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:28:25.964628 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:28:25.964628 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:28:25.964628 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:28:25.964628 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:28:25.964628 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcb66932-449d-48cd-9a36-485807874e27 could not be found. Oct 10 23:28:25.964628 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:25.964628 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:25.964628 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:25.964628 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:25.964628 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:25.964628 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:25.964628 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:28:25.964628 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:28:25.964628 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcb66932-449d-48cd-9a36-485807874e27 could not be found. Oct 10 23:28:25.964628 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:25.967958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d5e3b0bf-651d-49ca-a753-89db956c2a80 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] Returning 404 to user: Instance dcb66932-449d-48cd-9a36-485807874e27 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:28:25.974662 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d5e3b0bf-651d-49ca-a753-89db956c2a80 tempest-FloatingIPsAssociationTestJSON-1763207518 tempest-FloatingIPsAssociationTestJSON-1763207518-project] 10.222.0.23 "GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27" status: 404 len: 111 microversion: 2.1 time: 0.144287 Oct 10 23:28:25.975252 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1382/2854] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:25 2022] GET /compute/v2.1/servers/dcb66932-449d-48cd-9a36-485807874e27 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:28:26.422153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-77c8280c-23b0-4fab-88a9-96ca424f26aa req-ad6161b8-3ae7-4e22-a670-b3c4e4aa2bab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a119bb1-ed77-4246-8201-57fae68e75e4", "tag": "3a3f2632-b6c7-4012-8866-15e9790282c0"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:26.441504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-77c8280c-23b0-4fab-88a9-96ca424f26aa req-ad6161b8-3ae7-4e22-a670-b3c4e4aa2bab service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:26.442223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-77c8280c-23b0-4fab-88a9-96ca424f26aa req-ad6161b8-3ae7-4e22-a670-b3c4e4aa2bab service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:26.444460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-77c8280c-23b0-4fab-88a9-96ca424f26aa req-ad6161b8-3ae7-4e22-a670-b3c4e4aa2bab service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:26.471217 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-77c8280c-23b0-4fab-88a9-96ca424f26aa req-ad6161b8-3ae7-4e22-a670-b3c4e4aa2bab service nova] Creating event network-changed:3a3f2632-b6c7-4012-8866-15e9790282c0 for instance 8a119bb1-ed77-4246-8201-57fae68e75e4 on n-h1-860864-2 Oct 10 23:28:26.490024 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-77c8280c-23b0-4fab-88a9-96ca424f26aa req-ad6161b8-3ae7-4e22-a670-b3c4e4aa2bab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072339 Oct 10 23:28:26.497059 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1473/2855] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:28:26.621673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-83df6127-9ecf-4b6b-9e6a-1c0834846470 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:26.622433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-83df6127-9ecf-4b6b-9e6a-1c0834846470 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:26.642167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83df6127-9ecf-4b6b-9e6a-1c0834846470 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:26.642679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83df6127-9ecf-4b6b-9e6a-1c0834846470 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:26.643133 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83df6127-9ecf-4b6b-9e6a-1c0834846470 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:26.644427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83df6127-9ecf-4b6b-9e6a-1c0834846470 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:26.655040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83df6127-9ecf-4b6b-9e6a-1c0834846470 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:26.657011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83df6127-9ecf-4b6b-9e6a-1c0834846470 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:26.727457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8ab9c8e4-bcf9-406f-babf-577089f0455e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:26.728401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8ab9c8e4-bcf9-406f-babf-577089f0455e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:26.748000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ab9c8e4-bcf9-406f-babf-577089f0455e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:26.748790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ab9c8e4-bcf9-406f-babf-577089f0455e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:26.749754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ab9c8e4-bcf9-406f-babf-577089f0455e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:26.752975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ab9c8e4-bcf9-406f-babf-577089f0455e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:26.757499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ab9c8e4-bcf9-406f-babf-577089f0455e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:26.760033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ab9c8e4-bcf9-406f-babf-577089f0455e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:26.929877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=10 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:28:26.989227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-83df6127-9ecf-4b6b-9e6a-1c0834846470 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:26.998539 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-83df6127-9ecf-4b6b-9e6a-1c0834846470 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1471 microversion: 2.1 time: 0.381923 Oct 10 23:28:27.001356 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1383/2856] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:26 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1471 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:27.009250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4aaefa71-9a68-40f0-b686-0cb65a36606d tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662a89e790>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:27.078771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8ab9c8e4-bcf9-406f-babf-577089f0455e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:27.091659 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8ab9c8e4-bcf9-406f-babf-577089f0455e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 0.366224 Oct 10 23:28:27.097711 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1474/2857] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:26 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:27.114174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e0d38e94-76b6-4299-8134-30826fed4e86 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:27.114916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e0d38e94-76b6-4299-8134-30826fed4e86 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:27.120065 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4aaefa71-9a68-40f0-b686-0cb65a36606d tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f" status: 200 len: 1429 microversion: 2.1 time: 0.117697 Oct 10 23:28:27.121687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0d38e94-76b6-4299-8134-30826fed4e86 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:27.123840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0d38e94-76b6-4299-8134-30826fed4e86 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:27.126142 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1384/2858] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:28:27 2022] GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f => generated 1429 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:27.126901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0d38e94-76b6-4299-8134-30826fed4e86 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:27.127999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0d38e94-76b6-4299-8134-30826fed4e86 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:27.128963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0d38e94-76b6-4299-8134-30826fed4e86 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:27.131724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0d38e94-76b6-4299-8134-30826fed4e86 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:27.582374 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e0d38e94-76b6-4299-8134-30826fed4e86 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:27.595323 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e0d38e94-76b6-4299-8134-30826fed4e86 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1324 microversion: 2.1 time: 0.491981 Oct 10 23:28:27.596132 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1475/2859] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:27 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1324 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:28.026014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9489ef86-9c42-43cb-8e5b-932b1f2c199d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:28.027207 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9489ef86-9c42-43cb-8e5b-932b1f2c199d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:28.045138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9489ef86-9c42-43cb-8e5b-932b1f2c199d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:28.048215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9489ef86-9c42-43cb-8e5b-932b1f2c199d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:28.050595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9489ef86-9c42-43cb-8e5b-932b1f2c199d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:28.053195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9489ef86-9c42-43cb-8e5b-932b1f2c199d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:28.055426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9489ef86-9c42-43cb-8e5b-932b1f2c199d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:28.058273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9489ef86-9c42-43cb-8e5b-932b1f2c199d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:28.123133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8d275877-7ee7-472d-8603-9e5c4441f6ea tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:28.124823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8d275877-7ee7-472d-8603-9e5c4441f6ea tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:28.129358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:28:28.143909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d275877-7ee7-472d-8603-9e5c4441f6ea tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:28.144947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d275877-7ee7-472d-8603-9e5c4441f6ea tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:28.145784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d275877-7ee7-472d-8603-9e5c4441f6ea tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:28.146846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d275877-7ee7-472d-8603-9e5c4441f6ea tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:28.147464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d275877-7ee7-472d-8603-9e5c4441f6ea tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:28.148051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d275877-7ee7-472d-8603-9e5c4441f6ea tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:28.427791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9489ef86-9c42-43cb-8e5b-932b1f2c199d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:28.438662 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9489ef86-9c42-43cb-8e5b-932b1f2c199d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1471 microversion: 2.1 time: 0.416069 Oct 10 23:28:28.449959 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1385/2860] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:28 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1471 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:28.479947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-03a44cea-e488-461a-823c-448204154fb8 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662a89e430>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:28.590317 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-03a44cea-e488-461a-823c-448204154fb8 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f" status: 200 len: 1438 microversion: 2.1 time: 0.147053 Oct 10 23:28:28.591688 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1386/2861] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:28:28 2022] GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f => generated 1438 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:28.613534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-be12adf0-3a2f-4261-a550-a24e43b58261 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662a6f4f70>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:28.732979 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-be12adf0-3a2f-4261-a550-a24e43b58261 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f" status: 200 len: 1438 microversion: 2.1 time: 0.129131 Oct 10 23:28:28.734582 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1387/2862] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:28:28 2022] GET /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f => generated 1438 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:28.739740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0ad6a771-577e-439e-905b-3bdcdb783b25 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:28.740373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0ad6a771-577e-439e-905b-3bdcdb783b25 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:28.763082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ad6a771-577e-439e-905b-3bdcdb783b25 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:28.763413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8d275877-7ee7-472d-8603-9e5c4441f6ea tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:28.763834 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ad6a771-577e-439e-905b-3bdcdb783b25 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:28.764213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ad6a771-577e-439e-905b-3bdcdb783b25 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:28.765472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ad6a771-577e-439e-905b-3bdcdb783b25 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:28.766647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ad6a771-577e-439e-905b-3bdcdb783b25 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:28.767163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ad6a771-577e-439e-905b-3bdcdb783b25 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:28.776595 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8d275877-7ee7-472d-8603-9e5c4441f6ea tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 0.661744 Oct 10 23:28:28.781312 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1476/2863] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:28 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:28:28.792982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3871ef75-6c13-4c0e-993e-ad48e5d8d40a tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:28.795269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3871ef75-6c13-4c0e-993e-ad48e5d8d40a tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:28.807072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3871ef75-6c13-4c0e-993e-ad48e5d8d40a tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:28.811142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3871ef75-6c13-4c0e-993e-ad48e5d8d40a tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:28.811942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3871ef75-6c13-4c0e-993e-ad48e5d8d40a tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:28.813825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3871ef75-6c13-4c0e-993e-ad48e5d8d40a tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:28.816373 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3871ef75-6c13-4c0e-993e-ad48e5d8d40a tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:28.817018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3871ef75-6c13-4c0e-993e-ad48e5d8d40a tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:29.126441 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3871ef75-6c13-4c0e-993e-ad48e5d8d40a tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ef84f12c934e9aa1be187f2842b71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ae586965414012b4aeded0508deb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:29.135869 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3871ef75-6c13-4c0e-993e-ad48e5d8d40a tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 200 len: 1466 microversion: 2.1 time: 0.352954 Oct 10 23:28:29.136452 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1477/2864] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:28 2022] GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 1466 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:29.153155 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:28:29.172388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-feab36ef-a60b-49a3-81a4-129054c9589c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662b9090d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:29.355078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0ad6a771-577e-439e-905b-3bdcdb783b25 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:29.368680 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0ad6a771-577e-439e-905b-3bdcdb783b25 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1324 microversion: 2.1 time: 0.632538 Oct 10 23:28:29.374921 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1388/2865] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:28 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1324 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:29.468623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b80e6b8a-ee59-4689-a9f3-ddc5551e3717 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:29.469550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b80e6b8a-ee59-4689-a9f3-ddc5551e3717 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:29.497839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b80e6b8a-ee59-4689-a9f3-ddc5551e3717 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:29.498341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b80e6b8a-ee59-4689-a9f3-ddc5551e3717 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:29.498782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b80e6b8a-ee59-4689-a9f3-ddc5551e3717 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:29.499563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b80e6b8a-ee59-4689-a9f3-ddc5551e3717 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:29.500016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b80e6b8a-ee59-4689-a9f3-ddc5551e3717 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:29.500442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b80e6b8a-ee59-4689-a9f3-ddc5551e3717 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:30.054049 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b80e6b8a-ee59-4689-a9f3-ddc5551e3717 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:30.067882 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b80e6b8a-ee59-4689-a9f3-ddc5551e3717 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1471 microversion: 2.1 time: 0.605650 Oct 10 23:28:30.086050 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1389/2866] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:29 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1471 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:28:30.102787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f2d483be-36cb-4c91-924d-c5e7711ba537 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:30.105185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f2d483be-36cb-4c91-924d-c5e7711ba537 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:30.120128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2d483be-36cb-4c91-924d-c5e7711ba537 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:30.121713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2d483be-36cb-4c91-924d-c5e7711ba537 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:30.122740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2d483be-36cb-4c91-924d-c5e7711ba537 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:30.124782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2d483be-36cb-4c91-924d-c5e7711ba537 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:30.126689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2d483be-36cb-4c91-924d-c5e7711ba537 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:30.127335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2d483be-36cb-4c91-924d-c5e7711ba537 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:30.335683 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-feab36ef-a60b-49a3-81a4-129054c9589c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "DELETE /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f" status: 204 len: 0 microversion: 2.1 time: 1.174325 Oct 10 23:28:30.336680 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1478/2867] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:29 2022] DELETE /compute/v2.1/images/c87fda42-af15-410d-954a-7e97ad56403f => generated 0 bytes in 1176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:28:30.344413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ecdf9d11-78e3-44b2-acdc-87ed627dd7b9 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '.version_select at 0x7f662b505550>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:30.393109 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-ecdf9d11-78e3-44b2-acdc-87ed627dd7b9 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] HTTP exception thrown: Image not found. Oct 10 23:28:30.395577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ecdf9d11-78e3-44b2-acdc-87ed627dd7b9 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Request method failure captured: Oct 10 23:28:30.395577 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 HTTP/1.1 Oct 10 23:28:30.395577 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:28:30.395577 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:28:30.395577 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:28:30.395577 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:28:30.395577 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:28:30.395577 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:28:30.395577 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:28:30.395577 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:28:30.395577 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKoqXKQlwCk9uKa3IrAGtd8C5xqhQAVk7aDyux8FQofTCZa9P3LOqi1r1yBNdD326XOM01daw7veG6kPv9w5pX-aVpeQYWc2fE-bz6p_RMovohUUF2zi1h8VJqN274Bi0xbY8Ln-JQhpPoG1vziC7mv_Th4z8d7YN86S81dxQd-9t40 Oct 10 23:28:30.395577 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:28:30.395577 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:28:30.395577 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:28:30.395577 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:28:30.395577 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:28:30.395577 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:28:30.395577 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: c4ae586965414012b4aeded0508deb4e Oct 10 23:28:30.395577 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesOneServerTestJSON-1028913219 Oct 10 23:28:30.395577 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:28:30.395577 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:28:30.397228 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c4ae586965414012b4aeded0508deb4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4ae586965414012b4aeded0508deb4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4ae586965414012b4aeded0508deb4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c4ae586965414012b4aeded0508deb4e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:28:30.397228 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesOneServerTestJSON-1028913219 Oct 10 23:28:30.397228 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: c4ae586965414012b4aeded0508deb4e Oct 10 23:28:30.397228 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1028913219 Oct 10 23:28:30.397228 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesOneServerTestJSON-1028913219-project Oct 10 23:28:30.397228 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:28:30.397228 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:28:30.397228 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 80ef84f12c934e9aa1be187f2842b71f Oct 10 23:28:30.397228 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesOneServerTestJSON-1028913219-project Oct 10 23:28:30.397228 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:28:30.397228 n-d-860864-2 devstack@n-api.service[120613]: exception: Image not found. Oct 10 23:28:30.397228 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '70baf84f-b4b9-4814-8b82-b56a307a9b06'} Oct 10 23:28:30.397228 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:28:30.398122 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:30.398122 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 23:28:30.398122 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 23:28:30.398122 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:28:30.398122 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:28:30.398122 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:28:30.398122 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:28:30.398122 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 23:28:30.398122 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 23:28:30.398122 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 23:28:30.398122 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 23:28:30.398122 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:28:30.398122 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:28:30.398122 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:28:30.398122 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:28:30.398122 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 70baf84f-b4b9-4814-8b82-b56a307a9b06 to delete Oct 10 23:28:30.398122 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:30.398122 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:30.398122 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:30.399311 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:30.399311 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 23:28:30.399311 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 23:28:30.399311 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 23:28:30.399311 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 23:28:30.399311 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 23:28:30.399311 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 23:28:30.399311 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 70baf84f-b4b9-4814-8b82-b56a307a9b06 could not be found. Oct 10 23:28:30.399311 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:30.399311 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:30.399311 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:30.399311 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:30.399311 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:30.399311 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:30.399311 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:28:30.399311 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:28:30.399311 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:28:30.399311 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:28:30.399311 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:28:30.399311 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:28:30.403020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 23:28:30.403020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 23:28:30.403020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 23:28:30.403020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:30.403020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:30.403020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:30.403020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:30.403020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:30.403020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:30.403020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:28:30.403020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:28:30.403020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 23:28:30.403020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:30.403020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ecdf9d11-78e3-44b2-acdc-87ed627dd7b9 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Returning 404 to user: Image not found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:28:30.403020 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ecdf9d11-78e3-44b2-acdc-87ed627dd7b9 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "DELETE /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06" status: 404 len: 62 microversion: 2.1 time: 0.055997 Oct 10 23:28:30.405067 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1479/2868] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:30 2022] DELETE /compute/v2.1/images/70baf84f-b4b9-4814-8b82-b56a307a9b06 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:28:30.405732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cd36577f-aa93-48e2-9a5c-269098706d4b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:30.406492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cd36577f-aa93-48e2-9a5c-269098706d4b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:30.422600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd36577f-aa93-48e2-9a5c-269098706d4b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:30.424499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd36577f-aa93-48e2-9a5c-269098706d4b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:30.426034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd36577f-aa93-48e2-9a5c-269098706d4b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:30.428058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd36577f-aa93-48e2-9a5c-269098706d4b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:30.429896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd36577f-aa93-48e2-9a5c-269098706d4b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:30.430936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd36577f-aa93-48e2-9a5c-269098706d4b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:30.445514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f2d483be-36cb-4c91-924d-c5e7711ba537 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:30.469527 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f2d483be-36cb-4c91-924d-c5e7711ba537 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 0.381286 Oct 10 23:28:30.473552 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1390/2869] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:30 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:30.477894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-12fe69cb-abe2-4bd4-91b1-bd880b809f9c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:30.478587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-12fe69cb-abe2-4bd4-91b1-bd880b809f9c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:30.486125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12fe69cb-abe2-4bd4-91b1-bd880b809f9c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:30.486941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12fe69cb-abe2-4bd4-91b1-bd880b809f9c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:30.487574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12fe69cb-abe2-4bd4-91b1-bd880b809f9c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:30.488644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12fe69cb-abe2-4bd4-91b1-bd880b809f9c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:30.489332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12fe69cb-abe2-4bd4-91b1-bd880b809f9c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:30.489949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12fe69cb-abe2-4bd4-91b1-bd880b809f9c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:30.526724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-12fe69cb-abe2-4bd4-91b1-bd880b809f9c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:28:30.659296 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-12fe69cb-abe2-4bd4-91b1-bd880b809f9c tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 204 len: 0 microversion: 2.1 time: 0.187064 Oct 10 23:28:30.660358 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1391/2870] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:28:30 2022] DELETE /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:28:30.673639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b96c2de9-50f9-4374-926c-b677404a6352 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:30.677229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b96c2de9-50f9-4374-926c-b677404a6352 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:30.685294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b96c2de9-50f9-4374-926c-b677404a6352 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:30.687344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b96c2de9-50f9-4374-926c-b677404a6352 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:30.687999 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b96c2de9-50f9-4374-926c-b677404a6352 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:30.688973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b96c2de9-50f9-4374-926c-b677404a6352 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:30.690297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b96c2de9-50f9-4374-926c-b677404a6352 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:30.690935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b96c2de9-50f9-4374-926c-b677404a6352 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:30.889909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cd36577f-aa93-48e2-9a5c-269098706d4b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:30.899939 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cd36577f-aa93-48e2-9a5c-269098706d4b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1324 microversion: 2.1 time: 0.500539 Oct 10 23:28:30.901884 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1480/2871] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:30 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1324 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:31.063362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b96c2de9-50f9-4374-926c-b677404a6352 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ef84f12c934e9aa1be187f2842b71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ae586965414012b4aeded0508deb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:31.077971 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b96c2de9-50f9-4374-926c-b677404a6352 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 200 len: 1472 microversion: 2.1 time: 0.408891 Oct 10 23:28:31.079177 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1392/2872] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:30 2022] GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 1472 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:31.098957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4cb20238-c41e-4864-b67f-7fa68f018bd1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:31.099970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4cb20238-c41e-4864-b67f-7fa68f018bd1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:31.121108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cb20238-c41e-4864-b67f-7fa68f018bd1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:31.122107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cb20238-c41e-4864-b67f-7fa68f018bd1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:31.123181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cb20238-c41e-4864-b67f-7fa68f018bd1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:31.124588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cb20238-c41e-4864-b67f-7fa68f018bd1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:31.125844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cb20238-c41e-4864-b67f-7fa68f018bd1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:31.126580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cb20238-c41e-4864-b67f-7fa68f018bd1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:31.404339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4cb20238-c41e-4864-b67f-7fa68f018bd1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:31.443466 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4cb20238-c41e-4864-b67f-7fa68f018bd1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1471 microversion: 2.1 time: 0.348644 Oct 10 23:28:31.444402 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1481/2873] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:31 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1471 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:31.493973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-557d4a3b-880e-49d0-b4cd-4ac70cce6225 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:31.494590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-557d4a3b-880e-49d0-b4cd-4ac70cce6225 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:31.503731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-557d4a3b-880e-49d0-b4cd-4ac70cce6225 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:31.506258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-557d4a3b-880e-49d0-b4cd-4ac70cce6225 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:31.507059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-557d4a3b-880e-49d0-b4cd-4ac70cce6225 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:31.508416 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-557d4a3b-880e-49d0-b4cd-4ac70cce6225 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:31.509362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-557d4a3b-880e-49d0-b4cd-4ac70cce6225 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:31.509885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-557d4a3b-880e-49d0-b4cd-4ac70cce6225 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:31.914173 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-557d4a3b-880e-49d0-b4cd-4ac70cce6225 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:31.925220 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-557d4a3b-880e-49d0-b4cd-4ac70cce6225 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 0.435716 Oct 10 23:28:31.935061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-104c93ee-dfa5-426c-8102-9d014ad54dcf tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:31.935893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-104c93ee-dfa5-426c-8102-9d014ad54dcf tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:31.943842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-104c93ee-dfa5-426c-8102-9d014ad54dcf tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:31.944314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-104c93ee-dfa5-426c-8102-9d014ad54dcf tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:31.945228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-104c93ee-dfa5-426c-8102-9d014ad54dcf tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:31.946269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-104c93ee-dfa5-426c-8102-9d014ad54dcf tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:31.948616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-104c93ee-dfa5-426c-8102-9d014ad54dcf tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:31.948828 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1393/2874] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:31 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:31.949560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-104c93ee-dfa5-426c-8102-9d014ad54dcf tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:32.105418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=12 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:28:32.106738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c8d79c87-ef89-4953-b031-24584bfebaad tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:32.107371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c8d79c87-ef89-4953-b031-24584bfebaad tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:32.125649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8d79c87-ef89-4953-b031-24584bfebaad tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:32.125806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8d79c87-ef89-4953-b031-24584bfebaad tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:32.126315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8d79c87-ef89-4953-b031-24584bfebaad tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:32.128363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8d79c87-ef89-4953-b031-24584bfebaad tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:32.128869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8d79c87-ef89-4953-b031-24584bfebaad tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:32.132422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8d79c87-ef89-4953-b031-24584bfebaad tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:32.141839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-104c93ee-dfa5-426c-8102-9d014ad54dcf tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:32.153621 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-104c93ee-dfa5-426c-8102-9d014ad54dcf tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1324 microversion: 2.1 time: 0.226118 Oct 10 23:28:32.155034 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1482/2875] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:31 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1324 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:28:32.212787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-3c848882-7ed2-408a-9a3b-a3012842e72a req-5bee09e0-fc23-43ca-b5bd-8a5d565b8759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a119bb1-ed77-4246-8201-57fae68e75e4", "name": "network-vif-plugged", "status": "completed", "tag": "3a3f2632-b6c7-4012-8866-15e9790282c0"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:32.230819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3c848882-7ed2-408a-9a3b-a3012842e72a req-5bee09e0-fc23-43ca-b5bd-8a5d565b8759 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:32.232863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3c848882-7ed2-408a-9a3b-a3012842e72a req-5bee09e0-fc23-43ca-b5bd-8a5d565b8759 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:32.236325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3c848882-7ed2-408a-9a3b-a3012842e72a req-5bee09e0-fc23-43ca-b5bd-8a5d565b8759 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:32.268179 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-3c848882-7ed2-408a-9a3b-a3012842e72a req-5bee09e0-fc23-43ca-b5bd-8a5d565b8759 service nova] Creating event network-vif-plugged:3a3f2632-b6c7-4012-8866-15e9790282c0 for instance 8a119bb1-ed77-4246-8201-57fae68e75e4 on n-h1-860864-2 Oct 10 23:28:32.279006 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-3c848882-7ed2-408a-9a3b-a3012842e72a req-5bee09e0-fc23-43ca-b5bd-8a5d565b8759 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069514 Oct 10 23:28:32.283815 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1483/2876] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 10 23:28:32.454611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c8d79c87-ef89-4953-b031-24584bfebaad tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ef84f12c934e9aa1be187f2842b71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ae586965414012b4aeded0508deb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:32.470677 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c8d79c87-ef89-4953-b031-24584bfebaad tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 200 len: 1472 microversion: 2.1 time: 0.369429 Oct 10 23:28:32.471880 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1394/2877] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:32 2022] GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 1472 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:28:32.472870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-df4a301a-c8e7-4bd5-9fae-ff8ee452546c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:32.474467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-df4a301a-c8e7-4bd5-9fae-ff8ee452546c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:32.485451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df4a301a-c8e7-4bd5-9fae-ff8ee452546c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:32.486622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df4a301a-c8e7-4bd5-9fae-ff8ee452546c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:32.487234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df4a301a-c8e7-4bd5-9fae-ff8ee452546c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:32.488124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df4a301a-c8e7-4bd5-9fae-ff8ee452546c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:32.488749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df4a301a-c8e7-4bd5-9fae-ff8ee452546c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:32.489332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df4a301a-c8e7-4bd5-9fae-ff8ee452546c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:32.773066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-df4a301a-c8e7-4bd5-9fae-ff8ee452546c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:32.784418 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-df4a301a-c8e7-4bd5-9fae-ff8ee452546c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1471 microversion: 2.1 time: 0.319948 Oct 10 23:28:32.785022 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1484/2878] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:32 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1471 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:28:32.953886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-63f6fe55-4172-44ae-ac68-6090e0bc13a3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:32.956088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-63f6fe55-4172-44ae-ac68-6090e0bc13a3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:32.967558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63f6fe55-4172-44ae-ac68-6090e0bc13a3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:32.969028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63f6fe55-4172-44ae-ac68-6090e0bc13a3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:32.970197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63f6fe55-4172-44ae-ac68-6090e0bc13a3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:32.976859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63f6fe55-4172-44ae-ac68-6090e0bc13a3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:32.978571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63f6fe55-4172-44ae-ac68-6090e0bc13a3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:32.979606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63f6fe55-4172-44ae-ac68-6090e0bc13a3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:33.181310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0555ae9a-e4f9-4e3c-992c-303d688fb365 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:33.182296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0555ae9a-e4f9-4e3c-992c-303d688fb365 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:33.190775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0555ae9a-e4f9-4e3c-992c-303d688fb365 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:33.191795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0555ae9a-e4f9-4e3c-992c-303d688fb365 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:33.192690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0555ae9a-e4f9-4e3c-992c-303d688fb365 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:33.193963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0555ae9a-e4f9-4e3c-992c-303d688fb365 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:33.194648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0555ae9a-e4f9-4e3c-992c-303d688fb365 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:33.195340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0555ae9a-e4f9-4e3c-992c-303d688fb365 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:33.472106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0555ae9a-e4f9-4e3c-992c-303d688fb365 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:33.495759 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0555ae9a-e4f9-4e3c-992c-303d688fb365 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1324 microversion: 2.1 time: 0.319482 Oct 10 23:28:33.513062 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1485/2879] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:33 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1324 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:28:33.520123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2e38a511-115f-41cb-9c05-f94929d30722 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:33.521248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2e38a511-115f-41cb-9c05-f94929d30722 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:33.529257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e38a511-115f-41cb-9c05-f94929d30722 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:33.529951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e38a511-115f-41cb-9c05-f94929d30722 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:33.530802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e38a511-115f-41cb-9c05-f94929d30722 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:33.531886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e38a511-115f-41cb-9c05-f94929d30722 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:33.532515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e38a511-115f-41cb-9c05-f94929d30722 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:33.533234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e38a511-115f-41cb-9c05-f94929d30722 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:33.569156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-63f6fe55-4172-44ae-ac68-6090e0bc13a3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:33.596667 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-63f6fe55-4172-44ae-ac68-6090e0bc13a3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 0.648117 Oct 10 23:28:33.602136 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1395/2880] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:32 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:33.810626 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-954e1955-dba3-421f-a447-c9fc402eecc9 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:33.812895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-954e1955-dba3-421f-a447-c9fc402eecc9 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:33.821840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-954e1955-dba3-421f-a447-c9fc402eecc9 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:33.822683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-954e1955-dba3-421f-a447-c9fc402eecc9 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:33.823525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-954e1955-dba3-421f-a447-c9fc402eecc9 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:33.824690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-954e1955-dba3-421f-a447-c9fc402eecc9 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:33.825422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-954e1955-dba3-421f-a447-c9fc402eecc9 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:33.826116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-954e1955-dba3-421f-a447-c9fc402eecc9 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:33.834526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2e38a511-115f-41cb-9c05-f94929d30722 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ef84f12c934e9aa1be187f2842b71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ae586965414012b4aeded0508deb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:33.845564 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2e38a511-115f-41cb-9c05-f94929d30722 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 200 len: 1472 microversion: 2.1 time: 0.331035 Oct 10 23:28:33.846839 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1486/2881] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:33 2022] GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 1472 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:33.954407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:28:33.986799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-01fe1499-d489-473a-8614-1d88f344b803 req-b8ad05c5-0b55-4309-8897-1be38178da32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b64a0f12-ba9a-4074-9ba0-0911bdab6c0f", "name": "network-vif-deleted", "tag": "c3888bf2-97db-4f22-afff-a2d9b83792af"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:34.023233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-01fe1499-d489-473a-8614-1d88f344b803 req-b8ad05c5-0b55-4309-8897-1be38178da32 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:34.023736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-01fe1499-d489-473a-8614-1d88f344b803 req-b8ad05c5-0b55-4309-8897-1be38178da32 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:34.026106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-01fe1499-d489-473a-8614-1d88f344b803 req-b8ad05c5-0b55-4309-8897-1be38178da32 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:34.063303 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-01fe1499-d489-473a-8614-1d88f344b803 req-b8ad05c5-0b55-4309-8897-1be38178da32 service nova] Creating event network-vif-deleted:c3888bf2-97db-4f22-afff-a2d9b83792af for instance b64a0f12-ba9a-4074-9ba0-0911bdab6c0f on n-h2-860864-2 Oct 10 23:28:34.086954 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-01fe1499-d489-473a-8614-1d88f344b803 req-b8ad05c5-0b55-4309-8897-1be38178da32 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104299 Oct 10 23:28:34.087490 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1487/2882] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:28:34.174929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-954e1955-dba3-421f-a447-c9fc402eecc9 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:34.186953 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-954e1955-dba3-421f-a447-c9fc402eecc9 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1471 microversion: 2.1 time: 0.381620 Oct 10 23:28:34.188053 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1396/2883] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:33 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1471 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:34.398942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-5e61c114-02f4-4ce6-b902-0ba064e9dcfe req-77d45ff4-8f8e-43a6-b1cd-35452c02abce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b64a0f12-ba9a-4074-9ba0-0911bdab6c0f", "name": "network-vif-unplugged", "status": "completed", "tag": "c3888bf2-97db-4f22-afff-a2d9b83792af"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:34.425142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5e61c114-02f4-4ce6-b902-0ba064e9dcfe req-77d45ff4-8f8e-43a6-b1cd-35452c02abce service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:34.426586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5e61c114-02f4-4ce6-b902-0ba064e9dcfe req-77d45ff4-8f8e-43a6-b1cd-35452c02abce service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:34.428736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5e61c114-02f4-4ce6-b902-0ba064e9dcfe req-77d45ff4-8f8e-43a6-b1cd-35452c02abce service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:34.453362 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-5e61c114-02f4-4ce6-b902-0ba064e9dcfe req-77d45ff4-8f8e-43a6-b1cd-35452c02abce service nova] Creating event network-vif-unplugged:c3888bf2-97db-4f22-afff-a2d9b83792af for instance b64a0f12-ba9a-4074-9ba0-0911bdab6c0f on n-h2-860864-2 Oct 10 23:28:34.475966 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-5e61c114-02f4-4ce6-b902-0ba064e9dcfe req-77d45ff4-8f8e-43a6-b1cd-35452c02abce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092510 Oct 10 23:28:34.477426 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1488/2884] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:28:34.520054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6ced0871-ed9c-445b-bde2-a2170a3b5a4d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:34.520740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6ced0871-ed9c-445b-bde2-a2170a3b5a4d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:34.531693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ced0871-ed9c-445b-bde2-a2170a3b5a4d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:34.532148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ced0871-ed9c-445b-bde2-a2170a3b5a4d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:34.538528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ced0871-ed9c-445b-bde2-a2170a3b5a4d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:34.539969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ced0871-ed9c-445b-bde2-a2170a3b5a4d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:34.540468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ced0871-ed9c-445b-bde2-a2170a3b5a4d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:34.542302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ced0871-ed9c-445b-bde2-a2170a3b5a4d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:34.621141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-050b79b4-a700-4c50-95a0-5fc1b5a8b58b tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:34.621939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-050b79b4-a700-4c50-95a0-5fc1b5a8b58b tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:34.636430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-050b79b4-a700-4c50-95a0-5fc1b5a8b58b tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:34.636947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-050b79b4-a700-4c50-95a0-5fc1b5a8b58b tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:34.637434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-050b79b4-a700-4c50-95a0-5fc1b5a8b58b tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:34.638326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-050b79b4-a700-4c50-95a0-5fc1b5a8b58b tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:34.640422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-050b79b4-a700-4c50-95a0-5fc1b5a8b58b tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:34.641275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-050b79b4-a700-4c50-95a0-5fc1b5a8b58b tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:34.763285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6ced0871-ed9c-445b-bde2-a2170a3b5a4d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:34.773617 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6ced0871-ed9c-445b-bde2-a2170a3b5a4d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1519 microversion: 2.1 time: 0.258248 Oct 10 23:28:34.790310 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1397/2885] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:34 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1519 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:34.804109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4908eb64-61ca-4110-8891-b8405609daef tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:34.804866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4908eb64-61ca-4110-8891-b8405609daef tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:34.816456 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4908eb64-61ca-4110-8891-b8405609daef tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:34.817353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4908eb64-61ca-4110-8891-b8405609daef tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:34.817553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4908eb64-61ca-4110-8891-b8405609daef tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:34.822313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4908eb64-61ca-4110-8891-b8405609daef tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:34.823373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4908eb64-61ca-4110-8891-b8405609daef tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:34.824213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4908eb64-61ca-4110-8891-b8405609daef tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:34.900266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-050b79b4-a700-4c50-95a0-5fc1b5a8b58b tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:34.912592 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-050b79b4-a700-4c50-95a0-5fc1b5a8b58b tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 0.296095 Oct 10 23:28:34.913717 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1489/2886] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:34 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:34.918296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-421ac383-e4ee-4601-880c-e85c5f150f68 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:34.919274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-421ac383-e4ee-4601-880c-e85c5f150f68 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:34.927656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-421ac383-e4ee-4601-880c-e85c5f150f68 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:34.928409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-421ac383-e4ee-4601-880c-e85c5f150f68 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:34.929016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-421ac383-e4ee-4601-880c-e85c5f150f68 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:34.930466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-421ac383-e4ee-4601-880c-e85c5f150f68 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:34.931072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-421ac383-e4ee-4601-880c-e85c5f150f68 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:34.931906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-421ac383-e4ee-4601-880c-e85c5f150f68 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:34.986163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-421ac383-e4ee-4601-880c-e85c5f150f68 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:34.987313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-421ac383-e4ee-4601-880c-e85c5f150f68 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:34.988002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-421ac383-e4ee-4601-880c-e85c5f150f68 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:34.988889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-421ac383-e4ee-4601-880c-e85c5f150f68 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lazy-loading 'fault' on Instance uuid b64a0f12-ba9a-4074-9ba0-0911bdab6c0f {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:28:35.057848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-421ac383-e4ee-4601-880c-e85c5f150f68 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ef84f12c934e9aa1be187f2842b71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ae586965414012b4aeded0508deb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:35.067635 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-421ac383-e4ee-4601-880c-e85c5f150f68 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 200 len: 1306 microversion: 2.1 time: 0.152888 Oct 10 23:28:35.068430 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1490/2887] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:34 2022] GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 1306 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:35.089772 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4908eb64-61ca-4110-8891-b8405609daef tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:35.106307 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4908eb64-61ca-4110-8891-b8405609daef tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1519 microversion: 2.1 time: 0.306192 Oct 10 23:28:35.113790 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1398/2888] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:34 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1519 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:35.142177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b7966c33-7ed5-4ffa-9a6a-69e39e417465 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1048184947", "metadata": {"": ""}}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:35.148209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b7966c33-7ed5-4ffa-9a6a-69e39e417465 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Request method failure captured: Oct 10 23:28:35.148209 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4/action HTTP/1.1 Oct 10 23:28:35.148209 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:28:35.148209 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:28:35.148209 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:28:35.148209 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 107 Oct 10 23:28:35.148209 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:28:35.148209 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:28:35.148209 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:28:35.148209 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:28:35.148209 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKqJK3S3M2y3xprSZu9nbIarteybsMmlwBqzRadb_OvHrQS6zpz1qbhvGoRjPx1Bkq7rq6URwLI94Tf5sgLizi8MbWTsTS0dzR4a-9d6hn6BO9F5izkVX7qoGeFLYfTljzByP6rv99qdRHR7pF3ZU2UC3x7LIdHCYY6YUpc6lCdMgm4 Oct 10 23:28:35.148209 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:28:35.148209 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:28:35.148209 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:28:35.148209 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:28:35.148209 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:28:35.148209 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:28:35.148209 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:28:35.148209 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:28:35.148209 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:28:35.148209 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:28:35.149745 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a1c4489c308e462d89b97edcf6c21572", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:28:35.149745 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:28:35.149745 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:28:35.149745 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:28:35.149745 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:28:35.149745 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:28:35.149745 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:28:35.149745 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: f891fce5072c448c97f96a9df58d981e Oct 10 23:28:35.149745 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:28:35.149745 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:28:35.149745 n-d-860864-2 devstack@n-api.service[120613]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1048184947", "metadata": {"": ""}}} Oct 10 23:28:35.149745 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:28:35.150522 n-d-860864-2 devstack@n-api.service[120613]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:28:35.150522 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '8a119bb1-ed77-4246-8201-57fae68e75e4', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1048184947', 'metadata': {'': ''}}}} Oct 10 23:28:35.150522 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:28:35.150522 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:35.150522 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:28:35.150522 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:28:35.150522 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:28:35.150522 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:28:35.150522 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:28:35.150522 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:35.150522 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 10 23:28:35.150522 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 10 23:28:35.150522 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 10 23:28:35.150522 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 10 23:28:35.150522 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 10 23:28:35.150522 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:35.150522 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 10 23:28:35.150522 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi {'': ''} Oct 10 23:28:35.150522 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:35.150522 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:35.150522 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:35.151849 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:35.151849 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:35.151849 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:35.151849 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:28:35.151849 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:28:35.151849 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:28:35.151849 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:28:35.151849 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:28:35.151849 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:28:35.151849 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:28:35.151849 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:28:35.151849 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:28:35.151849 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:28:35.151849 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:28:35.151849 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:28:35.151849 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:28:35.151849 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:35.151849 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:35.151849 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:35.151849 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:35.153197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:35.153197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:35.153197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:28:35.153197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:28:35.153197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:28:35.153197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:35.155965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b7966c33-7ed5-4ffa-9a6a-69e39e417465 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:28:35.161007 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b7966c33-7ed5-4ffa-9a6a-69e39e417465 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "POST /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4/action" status: 400 len: 170 microversion: 2.1 time: 0.022062 Oct 10 23:28:35.161705 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1491/2889] 10.222.0.23 () {60 vars in 1279 bytes} [Mon Oct 10 23:28:35 2022] POST /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4/action => generated 170 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:28:35.171883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-42b2fd6c-991c-4b64-b940-0ec80ab0af92 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:35.173049 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-42b2fd6c-991c-4b64-b940-0ec80ab0af92 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:35.182322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42b2fd6c-991c-4b64-b940-0ec80ab0af92 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:35.182893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42b2fd6c-991c-4b64-b940-0ec80ab0af92 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:35.183395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42b2fd6c-991c-4b64-b940-0ec80ab0af92 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:35.184321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42b2fd6c-991c-4b64-b940-0ec80ab0af92 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:35.184854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42b2fd6c-991c-4b64-b940-0ec80ab0af92 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:35.185369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42b2fd6c-991c-4b64-b940-0ec80ab0af92 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:35.212028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-48609f7d-123a-4da5-8009-0b46e9d224c1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:35.212779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-48609f7d-123a-4da5-8009-0b46e9d224c1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:35.222156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-48609f7d-123a-4da5-8009-0b46e9d224c1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:35.222660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-48609f7d-123a-4da5-8009-0b46e9d224c1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:35.223104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-48609f7d-123a-4da5-8009-0b46e9d224c1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:35.223817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-48609f7d-123a-4da5-8009-0b46e9d224c1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:35.230680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-48609f7d-123a-4da5-8009-0b46e9d224c1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:35.234619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-48609f7d-123a-4da5-8009-0b46e9d224c1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:35.501343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-42b2fd6c-991c-4b64-b940-0ec80ab0af92 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:35.515596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-48609f7d-123a-4da5-8009-0b46e9d224c1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:35.523656 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-48609f7d-123a-4da5-8009-0b46e9d224c1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1471 microversion: 2.1 time: 0.315854 Oct 10 23:28:35.524247 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1492/2890] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:35 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1471 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:35.527244 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-42b2fd6c-991c-4b64-b940-0ec80ab0af92 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1519 microversion: 2.1 time: 0.356036 Oct 10 23:28:35.528091 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1399/2891] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:35 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1519 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:35.560366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-19d2938b-2e0f-4e77-bc54-689aeb026511 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:35.561567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-19d2938b-2e0f-4e77-bc54-689aeb026511 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:35.575811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19d2938b-2e0f-4e77-bc54-689aeb026511 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:35.576703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19d2938b-2e0f-4e77-bc54-689aeb026511 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:35.580678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19d2938b-2e0f-4e77-bc54-689aeb026511 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:35.581968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19d2938b-2e0f-4e77-bc54-689aeb026511 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:35.582925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19d2938b-2e0f-4e77-bc54-689aeb026511 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:35.585073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19d2938b-2e0f-4e77-bc54-689aeb026511 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:35.901582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-19d2938b-2e0f-4e77-bc54-689aeb026511 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:35.918368 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-19d2938b-2e0f-4e77-bc54-689aeb026511 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1519 microversion: 2.1 time: 0.362676 Oct 10 23:28:35.918978 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1493/2892] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:35 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1519 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:35.941959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5ea63105-3981-4ec0-8957-cefa40f9cf81 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:35.942461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-94b1dd36-463c-47f8-9bce-049b0f42732a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1406630207", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:35.942600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5ea63105-3981-4ec0-8957-cefa40f9cf81 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:35.947189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-94b1dd36-463c-47f8-9bce-049b0f42732a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Request method failure captured: Oct 10 23:28:35.947189 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4/action HTTP/1.1 Oct 10 23:28:35.947189 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:28:35.947189 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:28:35.947189 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:28:35.947189 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 619 Oct 10 23:28:35.947189 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:28:35.947189 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:28:35.947189 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:28:35.947189 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:28:35.947189 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKqJK3S3M2y3xprSZu9nbIarteybsMmlwBqzRadb_OvHrQS6zpz1qbhvGoRjPx1Bkq7rq6URwLI94Tf5sgLizi8MbWTsTS0dzR4a-9d6hn6BO9F5izkVX7qoGeFLYfTljzByP6rv99qdRHR7pF3ZU2UC3x7LIdHCYY6YUpc6lCdMgm4 Oct 10 23:28:35.947189 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:28:35.947189 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:28:35.947189 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:28:35.947189 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:28:35.947189 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:28:35.947189 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:28:35.947189 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:28:35.947189 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:28:35.947189 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:28:35.947189 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:28:35.948789 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a1c4489c308e462d89b97edcf6c21572", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:28:35.948789 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:28:35.948789 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:28:35.948789 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:28:35.948789 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:28:35.948789 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:28:35.948789 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:28:35.948789 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: f891fce5072c448c97f96a9df58d981e Oct 10 23:28:35.948789 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:28:35.948789 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:28:35.949618 n-d-860864-2 devstack@n-api.service[120614]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1406630207", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 10 23:28:35.949618 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:28:35.949618 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:28:35.949907 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '8a119bb1-ed77-4246-8201-57fae68e75e4', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1406630207', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 10 23:28:35.949907 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:28:35.949907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:35.949907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:28:35.949907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:28:35.949907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:28:35.949907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:28:35.949907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:28:35.949907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:35.949907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 10 23:28:35.949907 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 10 23:28:35.950778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 10 23:28:35.950778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 10 23:28:35.950778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 10 23:28:35.950778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:35.950778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 10 23:28:35.950778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 10 23:28:35.950778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:35.950778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:35.950778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:35.950778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:35.950778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:35.950778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:35.950778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:28:35.950778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:28:35.950778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:28:35.950778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:28:35.950778 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:28:35.952812 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:28:35.952812 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:28:35.952812 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:28:35.952812 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:28:35.952812 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:28:35.952812 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:28:35.952812 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:28:35.952812 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:28:35.952812 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:35.952812 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:35.952812 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:35.952812 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:35.954043 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:35.954043 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:35.954043 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:28:35.954043 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:28:35.954043 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:28:35.954043 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:35.954526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-94b1dd36-463c-47f8-9bce-049b0f42732a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:28:35.954689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ea63105-3981-4ec0-8957-cefa40f9cf81 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:35.954689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ea63105-3981-4ec0-8957-cefa40f9cf81 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:35.954689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ea63105-3981-4ec0-8957-cefa40f9cf81 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:35.954689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ea63105-3981-4ec0-8957-cefa40f9cf81 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:35.955050 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-94b1dd36-463c-47f8-9bce-049b0f42732a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "POST /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4/action" status: 400 len: 938 microversion: 2.1 time: 0.011914 Oct 10 23:28:35.955149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ea63105-3981-4ec0-8957-cefa40f9cf81 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:35.955149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ea63105-3981-4ec0-8957-cefa40f9cf81 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:35.955330 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1400/2893] 10.222.0.23 () {60 vars in 1279 bytes} [Mon Oct 10 23:28:35 2022] POST /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4/action => generated 938 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:28:35.962634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a2503641-9e0a-480d-beeb-73f943338024 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:35.966475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:28:35.970226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a2503641-9e0a-480d-beeb-73f943338024 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:35.982137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2503641-9e0a-480d-beeb-73f943338024 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:35.984506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2503641-9e0a-480d-beeb-73f943338024 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:35.986642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2503641-9e0a-480d-beeb-73f943338024 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:35.988510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2503641-9e0a-480d-beeb-73f943338024 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:35.989061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2503641-9e0a-480d-beeb-73f943338024 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:35.989660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2503641-9e0a-480d-beeb-73f943338024 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:36.121832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5ea63105-3981-4ec0-8957-cefa40f9cf81 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:36.131095 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5ea63105-3981-4ec0-8957-cefa40f9cf81 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 0.192826 Oct 10 23:28:36.132575 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1494/2894] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:35 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:28:36.141217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-03e1d301-9b7d-414d-a660-83909daf34a9 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:36.141708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-03e1d301-9b7d-414d-a660-83909daf34a9 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] [instance: b64a0f12-ba9a-4074-9ba0-0911bdab6c0f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:36.149020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03e1d301-9b7d-414d-a660-83909daf34a9 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:36.149627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03e1d301-9b7d-414d-a660-83909daf34a9 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:36.150137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03e1d301-9b7d-414d-a660-83909daf34a9 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:36.151060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03e1d301-9b7d-414d-a660-83909daf34a9 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:36.151695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03e1d301-9b7d-414d-a660-83909daf34a9 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:36.152132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03e1d301-9b7d-414d-a660-83909daf34a9 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:36.168152 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-03e1d301-9b7d-414d-a660-83909daf34a9 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] HTTP exception thrown: Instance b64a0f12-ba9a-4074-9ba0-0911bdab6c0f could not be found. Oct 10 23:28:36.170032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-03e1d301-9b7d-414d-a660-83909daf34a9 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Request method failure captured: Oct 10 23:28:36.170032 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f HTTP/1.1 Oct 10 23:28:36.170032 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:28:36.170032 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:28:36.170032 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:28:36.170032 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:28:36.170032 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:28:36.170032 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:28:36.170032 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:28:36.170032 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:28:36.170032 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKoqXKQlwCk9uKa3IrAGtd8C5xqhQAVk7aDyux8FQofTCZa9P3LOqi1r1yBNdD326XOM01daw7veG6kPv9w5pX-aVpeQYWc2fE-bz6p_RMovohUUF2zi1h8VJqN274Bi0xbY8Ln-JQhpPoG1vziC7mv_Th4z8d7YN86S81dxQd-9t40 Oct 10 23:28:36.170032 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:28:36.170032 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:28:36.170032 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:28:36.170032 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:28:36.170032 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:28:36.170032 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:28:36.170032 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: c4ae586965414012b4aeded0508deb4e Oct 10 23:28:36.170032 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesOneServerTestJSON-1028913219 Oct 10 23:28:36.170032 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:28:36.170032 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:28:36.171878 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c4ae586965414012b4aeded0508deb4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4ae586965414012b4aeded0508deb4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c4ae586965414012b4aeded0508deb4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c4ae586965414012b4aeded0508deb4e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:28:36.171878 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesOneServerTestJSON-1028913219 Oct 10 23:28:36.171878 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: c4ae586965414012b4aeded0508deb4e Oct 10 23:28:36.171878 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1028913219 Oct 10 23:28:36.171878 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesOneServerTestJSON-1028913219-project Oct 10 23:28:36.171878 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:28:36.171878 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:28:36.171878 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 80ef84f12c934e9aa1be187f2842b71f Oct 10 23:28:36.171878 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesOneServerTestJSON-1028913219-project Oct 10 23:28:36.171878 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:28:36.171878 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance b64a0f12-ba9a-4074-9ba0-0911bdab6c0f could not be found. Oct 10 23:28:36.171878 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'b64a0f12-ba9a-4074-9ba0-0911bdab6c0f'} Oct 10 23:28:36.172811 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:28:36.172811 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:36.172811 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:28:36.172811 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:28:36.172811 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:28:36.172811 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:28:36.172811 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:28:36.172811 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:28:36.172811 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:28:36.172811 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:28:36.172811 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b64a0f12-ba9a-4074-9ba0-0911bdab6c0f could not be found. Oct 10 23:28:36.172811 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:36.172811 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:36.172811 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:36.172811 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:36.172811 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:36.172811 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:36.172811 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:28:36.172811 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:28:36.172811 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:28:36.174174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:28:36.174174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:28:36.174174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:28:36.174174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:28:36.174174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:28:36.174174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:28:36.174174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:28:36.174174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b64a0f12-ba9a-4074-9ba0-0911bdab6c0f could not be found. Oct 10 23:28:36.174174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:36.174174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:36.174174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:36.174174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:36.174174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:36.174174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:36.174174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:28:36.174174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:28:36.174174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b64a0f12-ba9a-4074-9ba0-0911bdab6c0f could not be found. Oct 10 23:28:36.174174 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:36.176091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-03e1d301-9b7d-414d-a660-83909daf34a9 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] Returning 404 to user: Instance b64a0f12-ba9a-4074-9ba0-0911bdab6c0f could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:28:36.176091 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-03e1d301-9b7d-414d-a660-83909daf34a9 tempest-ImagesOneServerTestJSON-1028913219 tempest-ImagesOneServerTestJSON-1028913219-project] 10.222.0.23 "GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f" status: 404 len: 111 microversion: 2.1 time: 0.036678 Oct 10 23:28:36.176091 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1495/2895] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:36 2022] GET /compute/v2.1/servers/b64a0f12-ba9a-4074-9ba0-0911bdab6c0f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:28:36.376659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a2503641-9e0a-480d-beeb-73f943338024 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:36.385799 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a2503641-9e0a-480d-beeb-73f943338024 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1519 microversion: 2.1 time: 0.426811 Oct 10 23:28:36.386689 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1401/2896] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:35 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1519 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:36.414530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6f380199-0895-4d88-9e58-caf4c11845eb tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:36.415936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6f380199-0895-4d88-9e58-caf4c11845eb tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:36.424850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f380199-0895-4d88-9e58-caf4c11845eb tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:36.426299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f380199-0895-4d88-9e58-caf4c11845eb tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:36.426904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f380199-0895-4d88-9e58-caf4c11845eb tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:36.427749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f380199-0895-4d88-9e58-caf4c11845eb tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:36.428325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f380199-0895-4d88-9e58-caf4c11845eb tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:36.428843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f380199-0895-4d88-9e58-caf4c11845eb tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:36.546169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4ad102f9-b4ae-47cc-af51-1d24a8ad5cad tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:36.547032 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4ad102f9-b4ae-47cc-af51-1d24a8ad5cad tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:36.554792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ad102f9-b4ae-47cc-af51-1d24a8ad5cad tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:36.556375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ad102f9-b4ae-47cc-af51-1d24a8ad5cad tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:36.556984 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ad102f9-b4ae-47cc-af51-1d24a8ad5cad tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:36.558075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ad102f9-b4ae-47cc-af51-1d24a8ad5cad tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:36.558698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ad102f9-b4ae-47cc-af51-1d24a8ad5cad tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:36.559292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ad102f9-b4ae-47cc-af51-1d24a8ad5cad tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:36.740997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6f380199-0895-4d88-9e58-caf4c11845eb tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:36.749980 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6f380199-0895-4d88-9e58-caf4c11845eb tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1519 microversion: 2.1 time: 0.340008 Oct 10 23:28:36.755257 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1496/2897] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:36 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1519 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:36.783848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e6ad62c5-89b7-49c7-b5b0-c22464fcc3b0 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:36.789556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e6ad62c5-89b7-49c7-b5b0-c22464fcc3b0 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Request method failure captured: Oct 10 23:28:36.789556 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4/action HTTP/1.1 Oct 10 23:28:36.789556 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:28:36.789556 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:28:36.789556 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:28:36.789556 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 285 Oct 10 23:28:36.789556 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:28:36.789556 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:28:36.789556 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:28:36.789556 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:28:36.789556 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKqJK3S3M2y3xprSZu9nbIarteybsMmlwBqzRadb_OvHrQS6zpz1qbhvGoRjPx1Bkq7rq6URwLI94Tf5sgLizi8MbWTsTS0dzR4a-9d6hn6BO9F5izkVX7qoGeFLYfTljzByP6rv99qdRHR7pF3ZU2UC3x7LIdHCYY6YUpc6lCdMgm4 Oct 10 23:28:36.789556 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:28:36.789556 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:28:36.789556 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:28:36.789556 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:28:36.789556 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:28:36.789556 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:28:36.789556 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:28:36.789556 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:28:36.789556 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:28:36.789556 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:28:36.791267 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a1c4489c308e462d89b97edcf6c21572", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:28:36.791267 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:28:36.791267 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:28:36.791267 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:28:36.791267 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:28:36.791267 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:28:36.791267 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:28:36.791267 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: f891fce5072c448c97f96a9df58d981e Oct 10 23:28:36.791267 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:28:36.791267 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:28:36.791267 n-d-860864-2 devstack@n-api.service[120613]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 10 23:28:36.792095 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:28:36.792095 n-d-860864-2 devstack@n-api.service[120613]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 23:28:36.792095 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '8a119bb1-ed77-4246-8201-57fae68e75e4', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 10 23:28:36.792095 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:28:36.792095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:36.792095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:28:36.792095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:28:36.792095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:28:36.792095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:28:36.792095 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 23:28:36.792900 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:36.792900 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 10 23:28:36.792900 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 23:28:36.792900 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:36.792900 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 10 23:28:36.792900 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 10 23:28:36.792900 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:36.792900 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:36.792900 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:36.792900 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:36.792900 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:36.792900 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:36.792900 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:28:36.792900 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:28:36.792900 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:28:36.792900 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:28:36.792900 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:28:36.792900 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:28:36.792900 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:28:36.792900 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:28:36.794416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:28:36.794416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:28:36.794416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:28:36.794416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:28:36.794416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 23:28:36.794416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:36.794416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:36.794416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:36.794416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:36.794416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:36.794416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:36.794416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:28:36.794416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:28:36.795370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 23:28:36.795370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:36.798561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e6ad62c5-89b7-49c7-b5b0-c22464fcc3b0 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:28:36.799979 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e6ad62c5-89b7-49c7-b5b0-c22464fcc3b0 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "POST /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4/action" status: 400 len: 619 microversion: 2.1 time: 0.021175 Oct 10 23:28:36.801079 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1497/2898] 10.222.0.23 () {60 vars in 1279 bytes} [Mon Oct 10 23:28:36 2022] POST /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4/action => generated 619 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 23:28:36.823090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1c729c59-743f-4c70-a38e-753a4b398eca tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:36.824225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1c729c59-743f-4c70-a38e-753a4b398eca tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:36.833788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c729c59-743f-4c70-a38e-753a4b398eca tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:36.834570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c729c59-743f-4c70-a38e-753a4b398eca tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:36.835512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c729c59-743f-4c70-a38e-753a4b398eca tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:36.836494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c729c59-743f-4c70-a38e-753a4b398eca tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:36.837189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c729c59-743f-4c70-a38e-753a4b398eca tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:36.838003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c729c59-743f-4c70-a38e-753a4b398eca tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:37.178988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1c729c59-743f-4c70-a38e-753a4b398eca tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:37.194574 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1c729c59-743f-4c70-a38e-753a4b398eca tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1519 microversion: 2.1 time: 0.379803 Oct 10 23:28:37.211700 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1498/2899] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:36 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1519 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:37.220662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3c21d895-2fbd-4d76-89d6-0e76ecdeeca7 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:37.220843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4ad102f9-b4ae-47cc-af51-1d24a8ad5cad tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:37.221799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3c21d895-2fbd-4d76-89d6-0e76ecdeeca7 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:37.228268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c21d895-2fbd-4d76-89d6-0e76ecdeeca7 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:37.229086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c21d895-2fbd-4d76-89d6-0e76ecdeeca7 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:37.229471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c21d895-2fbd-4d76-89d6-0e76ecdeeca7 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:37.230518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c21d895-2fbd-4d76-89d6-0e76ecdeeca7 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:37.231327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c21d895-2fbd-4d76-89d6-0e76ecdeeca7 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:37.232194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c21d895-2fbd-4d76-89d6-0e76ecdeeca7 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:37.233709 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4ad102f9-b4ae-47cc-af51-1d24a8ad5cad tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1471 microversion: 2.1 time: 0.687438 Oct 10 23:28:37.234729 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1402/2900] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:36 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1471 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:37.245967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3615c4e6-97ed-4b75-a05e-bb08a951b5ef tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:37.246868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3615c4e6-97ed-4b75-a05e-bb08a951b5ef tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:37.261318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3615c4e6-97ed-4b75-a05e-bb08a951b5ef tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:37.264190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3615c4e6-97ed-4b75-a05e-bb08a951b5ef tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:37.264777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3615c4e6-97ed-4b75-a05e-bb08a951b5ef tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:37.265496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3615c4e6-97ed-4b75-a05e-bb08a951b5ef tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:37.265964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3615c4e6-97ed-4b75-a05e-bb08a951b5ef tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:37.266401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3615c4e6-97ed-4b75-a05e-bb08a951b5ef tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:37.562172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3c21d895-2fbd-4d76-89d6-0e76ecdeeca7 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:37.578962 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3c21d895-2fbd-4d76-89d6-0e76ecdeeca7 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 0.365509 Oct 10 23:28:37.583228 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1499/2901] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:37 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:37.651936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3615c4e6-97ed-4b75-a05e-bb08a951b5ef tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:37.662394 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3615c4e6-97ed-4b75-a05e-bb08a951b5ef tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1519 microversion: 2.1 time: 0.426374 Oct 10 23:28:37.662992 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1403/2902] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:37 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1519 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:37.687789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9b1dda29-fba7-4beb-adde-1b72709a436e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-398812932"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:37.690473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9b1dda29-fba7-4beb-adde-1b72709a436e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:37.716755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b1dda29-fba7-4beb-adde-1b72709a436e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:37.717757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b1dda29-fba7-4beb-adde-1b72709a436e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:37.719007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b1dda29-fba7-4beb-adde-1b72709a436e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:37.720085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b1dda29-fba7-4beb-adde-1b72709a436e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:37.725842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b1dda29-fba7-4beb-adde-1b72709a436e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:37.726594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b1dda29-fba7-4beb-adde-1b72709a436e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:38.259225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4ae4ff17-b9b0-4351-8430-d9a0345fc017 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:38.268004 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9b1dda29-fba7-4beb-adde-1b72709a436e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "POST /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4/action" status: 202 len: 0 microversion: 2.1 time: 0.584508 Oct 10 23:28:38.268817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4ae4ff17-b9b0-4351-8430-d9a0345fc017 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:38.272380 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1500/2903] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:28:37 2022] POST /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4/action => generated 0 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 23:28:38.293364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0ab0e38a-1c41-4d31-b97d-076e871b3fb9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-442219778"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:38.303076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ae4ff17-b9b0-4351-8430-d9a0345fc017 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:38.303338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0ab0e38a-1c41-4d31-b97d-076e871b3fb9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:38.303673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ae4ff17-b9b0-4351-8430-d9a0345fc017 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:38.304127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ae4ff17-b9b0-4351-8430-d9a0345fc017 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:38.304874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ae4ff17-b9b0-4351-8430-d9a0345fc017 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:38.305332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ae4ff17-b9b0-4351-8430-d9a0345fc017 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:38.314089 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ae4ff17-b9b0-4351-8430-d9a0345fc017 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:38.320219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ab0e38a-1c41-4d31-b97d-076e871b3fb9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:38.320782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ab0e38a-1c41-4d31-b97d-076e871b3fb9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:38.321769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ab0e38a-1c41-4d31-b97d-076e871b3fb9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:38.323356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ab0e38a-1c41-4d31-b97d-076e871b3fb9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:38.325618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ab0e38a-1c41-4d31-b97d-076e871b3fb9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:38.328148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ab0e38a-1c41-4d31-b97d-076e871b3fb9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:38.422122 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-0ab0e38a-1c41-4d31-b97d-076e871b3fb9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] HTTP exception thrown: Cannot 'createImage' instance 8a119bb1-ed77-4246-8201-57fae68e75e4 while it is in task_state image_snapshot_pending Oct 10 23:28:38.424275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0ab0e38a-1c41-4d31-b97d-076e871b3fb9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Request method failure captured: Oct 10 23:28:38.424275 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4/action HTTP/1.1 Oct 10 23:28:38.424275 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:28:38.424275 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:28:38.424275 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:28:38.424275 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 84 Oct 10 23:28:38.424275 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:28:38.424275 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:28:38.424275 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:28:38.424275 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:28:38.424275 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKqJK3S3M2y3xprSZu9nbIarteybsMmlwBqzRadb_OvHrQS6zpz1qbhvGoRjPx1Bkq7rq6URwLI94Tf5sgLizi8MbWTsTS0dzR4a-9d6hn6BO9F5izkVX7qoGeFLYfTljzByP6rv99qdRHR7pF3ZU2UC3x7LIdHCYY6YUpc6lCdMgm4 Oct 10 23:28:38.424275 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:28:38.424275 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:28:38.424275 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:28:38.424275 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:28:38.424275 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:28:38.424275 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:28:38.424275 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:28:38.424275 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:28:38.424275 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:28:38.424275 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:28:38.425942 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a1c4489c308e462d89b97edcf6c21572", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:28:38.425942 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:28:38.425942 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:28:38.425942 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:28:38.425942 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:28:38.425942 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:28:38.425942 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:28:38.425942 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: f891fce5072c448c97f96a9df58d981e Oct 10 23:28:38.425942 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:28:38.425942 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:28:38.425942 n-d-860864-2 devstack@n-api.service[120613]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-442219778"}} Oct 10 23:28:38.425942 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:28:38.426697 n-d-860864-2 devstack@n-api.service[120613]: exception: Cannot 'createImage' instance 8a119bb1-ed77-4246-8201-57fae68e75e4 while it is in task_state image_snapshot_pending Oct 10 23:28:38.426697 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '8a119bb1-ed77-4246-8201-57fae68e75e4', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-442219778'}}} Oct 10 23:28:38.426697 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:28:38.426697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:38.426697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 10 23:28:38.426697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 10 23:28:38.426697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 10 23:28:38.426697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 23:28:38.426697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8a119bb1-ed77-4246-8201-57fae68e75e4 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 10 23:28:38.426697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:38.426697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:38.426697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:38.426697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:38.426697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:38.426697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:38.426697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:28:38.426697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:28:38.426697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:28:38.426697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:28:38.427844 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:28:38.427844 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:28:38.427844 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:28:38.427844 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:28:38.427844 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 10 23:28:38.427844 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 23:28:38.427844 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 23:28:38.427844 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 23:28:38.427844 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 8a119bb1-ed77-4246-8201-57fae68e75e4 while it is in task_state image_snapshot_pending Oct 10 23:28:38.427844 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:38.427844 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:38.427844 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:38.427844 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:38.427844 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:38.427844 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:38.427844 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:28:38.427844 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:28:38.427844 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 8a119bb1-ed77-4246-8201-57fae68e75e4 while it is in task_state image_snapshot_pending Oct 10 23:28:38.427844 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:38.430471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0ab0e38a-1c41-4d31-b97d-076e871b3fb9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Returning 409 to user: Cannot 'createImage' instance 8a119bb1-ed77-4246-8201-57fae68e75e4 while it is in task_state image_snapshot_pending {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:28:38.432715 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0ab0e38a-1c41-4d31-b97d-076e871b3fb9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "POST /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4/action" status: 409 len: 167 microversion: 2.1 time: 0.152811 Oct 10 23:28:38.436974 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1501/2904] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:28:38 2022] POST /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4/action => generated 167 bytes in 158 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:28:38.447036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-302f76fc-9ae6-4341-9bc8-991f73433a0b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '.version_select at 0x7f66301d50d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:38.836239 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-302f76fc-9ae6-4341-9bc8-991f73433a0b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "DELETE /compute/v2.1/images/9f8f21d3-a540-4cd1-bc03-f167244afbd4" status: 204 len: 0 microversion: 2.1 time: 0.392226 Oct 10 23:28:38.840644 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1502/2905] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:38 2022] DELETE /compute/v2.1/images/9f8f21d3-a540-4cd1-bc03-f167244afbd4 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:28:38.854215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-db9072d7-6fe1-4fa3-9945-d92d0e7faf65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:38.856073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-db9072d7-6fe1-4fa3-9945-d92d0e7faf65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:38.874374 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db9072d7-6fe1-4fa3-9945-d92d0e7faf65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:38.875320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db9072d7-6fe1-4fa3-9945-d92d0e7faf65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:38.877144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db9072d7-6fe1-4fa3-9945-d92d0e7faf65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:38.879096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db9072d7-6fe1-4fa3-9945-d92d0e7faf65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:38.881793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db9072d7-6fe1-4fa3-9945-d92d0e7faf65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:38.885458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db9072d7-6fe1-4fa3-9945-d92d0e7faf65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:39.442527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-db9072d7-6fe1-4fa3-9945-d92d0e7faf65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:39.455373 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-db9072d7-6fe1-4fa3-9945-d92d0e7faf65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 0.611881 Oct 10 23:28:39.456084 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1503/2906] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:38 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:39.464989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d698f7f5-4539-4874-9847-fc75d273dcb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:39.469108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d698f7f5-4539-4874-9847-fc75d273dcb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:39.494393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d698f7f5-4539-4874-9847-fc75d273dcb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:39.503000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d698f7f5-4539-4874-9847-fc75d273dcb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:39.503992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d698f7f5-4539-4874-9847-fc75d273dcb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:39.505037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d698f7f5-4539-4874-9847-fc75d273dcb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:39.506109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d698f7f5-4539-4874-9847-fc75d273dcb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:39.507120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d698f7f5-4539-4874-9847-fc75d273dcb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:39.798798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4ae4ff17-b9b0-4351-8430-d9a0345fc017 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:39.818415 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4ae4ff17-b9b0-4351-8430-d9a0345fc017 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1471 microversion: 2.1 time: 1.565850 Oct 10 23:28:39.825075 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1404/2907] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:38 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1471 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:39.857633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0457bd4a-c37f-427a-b4c6-12e8f9cc7c57 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:39.865336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0457bd4a-c37f-427a-b4c6-12e8f9cc7c57 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:39.876950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d698f7f5-4539-4874-9847-fc75d273dcb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:39.880030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0457bd4a-c37f-427a-b4c6-12e8f9cc7c57 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:39.881637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0457bd4a-c37f-427a-b4c6-12e8f9cc7c57 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:39.882968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0457bd4a-c37f-427a-b4c6-12e8f9cc7c57 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:39.883884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0457bd4a-c37f-427a-b4c6-12e8f9cc7c57 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:39.886165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0457bd4a-c37f-427a-b4c6-12e8f9cc7c57 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:39.888314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0457bd4a-c37f-427a-b4c6-12e8f9cc7c57 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:39.890390 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d698f7f5-4539-4874-9847-fc75d273dcb2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1531 microversion: 2.1 time: 0.431624 Oct 10 23:28:39.905431 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1504/2908] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:39 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1531 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:39.964971 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0457bd4a-c37f-427a-b4c6-12e8f9cc7c57 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124128 Oct 10 23:28:39.967587 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1405/2909] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:28:39 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:28:39.993620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-255c9252-b65c-4a77-912d-bb4922eed2ca tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:39.994273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-255c9252-b65c-4a77-912d-bb4922eed2ca tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:40.016226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-255c9252-b65c-4a77-912d-bb4922eed2ca tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:40.018098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-255c9252-b65c-4a77-912d-bb4922eed2ca tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:40.020095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-255c9252-b65c-4a77-912d-bb4922eed2ca tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:40.021112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-255c9252-b65c-4a77-912d-bb4922eed2ca tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:40.025983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-255c9252-b65c-4a77-912d-bb4922eed2ca tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:40.026668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-255c9252-b65c-4a77-912d-bb4922eed2ca tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:40.109142 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-255c9252-b65c-4a77-912d-bb4922eed2ca tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-volume_attachments/89f3878c-1155-4056-a83d-749a443dca23" status: 200 len: 194 microversion: 2.1 time: 0.116328 Oct 10 23:28:40.115772 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1406/2910] 10.222.0.23 () {58 vars in 1413 bytes} [Mon Oct 10 23:28:39 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-volume_attachments/89f3878c-1155-4056-a83d-749a443dca23 => generated 194 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:28:40.173897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2ad3981b-c1a3-4e63-9dff-d39ec0bc66f5 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Action: 'create', calling method: .version_select at 0x7f662aca9af0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAxIvtK9Caw6df1hc+oe9TJUgjmSp+S7XHZIuRv+JMg1m7pAvyvEY/iAO5jed7Bq7LQN6xGzvEvqANXYKP2JtIHAHjBjwxzS5CGqrbuye9k+h9nYQI+pBZBZiTz696rqQ=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:40.181960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2ad3981b-c1a3-4e63-9dff-d39ec0bc66f5 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Request method failure captured: Oct 10 23:28:40.181960 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 10 23:28:40.181960 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:28:40.181960 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:28:40.181960 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:28:40.181960 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 257 Oct 10 23:28:40.181960 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:28:40.181960 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:28:40.181960 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:28:40.181960 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:28:40.181960 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKqnTwT2Kh1CRF6Bf4bTAT0gvQ48TKJwC6eBKKJ49UZGXH52h96hOvvamNuv7eRTlTzEX5FFHE8OhJ1-qSfdj_yavcVew61BlOKY7mk1uOfukZbeX-Y-4hl_fOprxW_9OjmcgqmWNbS-yG-7b90KG3kPEBQVIrJ4FoH5aU1sPF2DZfM Oct 10 23:28:40.181960 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:28:40.181960 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:28:40.181960 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:28:40.181960 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:28:40.181960 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:28:40.181960 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:28:40.181960 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 5688507bc46d4d8b89faa7ae4b7bd5d4 Oct 10 23:28:40.181960 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:40.181960 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:28:40.181960 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:28:40.183787 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5688507bc46d4d8b89faa7ae4b7bd5d4", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:28:40.183787 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:40.183787 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 5688507bc46d4d8b89faa7ae4b7bd5d4 Oct 10 23:28:40.183787 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:40.183787 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-KeyPairsNegativeTestJSON-1679965276-project Oct 10 23:28:40.183787 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:28:40.183787 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:28:40.183787 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: e9e6b76c999b4ada902aebfdca4a59d2 Oct 10 23:28:40.183787 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1679965276-project Oct 10 23:28:40.183787 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:28:40.183787 n-d-860864-2 devstack@n-api.service[120613]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAxIvtK9Caw6df1hc+oe9TJUgjmSp+S7XHZIuRv+JMg1m7pAvyvEY/iAO5jed7Bq7LQN6xGzvEvqANXYKP2JtIHAHjBjwxzS5CGqrbuye9k+h9nYQI+pBZBZiTz696rqQ=="}} Oct 10 23:28:40.184710 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:28:40.184710 n-d-860864-2 devstack@n-api.service[120613]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 10 23:28:40.184710 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAxIvtK9Caw6df1hc+oe9TJUgjmSp+S7XHZIuRv+JMg1m7pAvyvEY/iAO5jed7Bq7LQN6xGzvEvqANXYKP2JtIHAHjBjwxzS5CGqrbuye9k+h9nYQI+pBZBZiTz696rqQ=='}}} Oct 10 23:28:40.184710 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:28:40.184710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:40.184710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 10 23:28:40.184710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 10 23:28:40.184710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 10 23:28:40.184710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 10 23:28:40.184710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 10 23:28:40.184710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 10 23:28:40.184710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 10 23:28:40.184710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.184710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 10 23:28:40.184710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.184710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:40.184710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:28:40.186184 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:28:40.186184 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:28:40.186184 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:28:40.186184 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 10 23:28:40.186184 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.186184 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 10 23:28:40.186184 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 10 23:28:40.186184 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 10 23:28:40.186184 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 10 23:28:40.186184 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 10 23:28:40.186184 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.186184 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 10 23:28:40.186184 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 10 23:28:40.186184 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.186184 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:40.186184 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.186184 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:40.186184 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:40.186184 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:40.186184 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:28:40.186184 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:28:40.186184 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:28:40.186184 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:28:40.187925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:28:40.187925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:28:40.187925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:28:40.187925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:28:40.187925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:28:40.187925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:28:40.187925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:28:40.187925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:28:40.187925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:28:40.187925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:28:40.187925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 10 23:28:40.187925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.187925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:40.187925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.187925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:40.187925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:40.187925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:40.187925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:28:40.187925 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:28:40.189461 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 10 23:28:40.189461 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.189461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2ad3981b-c1a3-4e63-9dff-d39ec0bc66f5 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:28:40.190937 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2ad3981b-c1a3-4e63-9dff-d39ec0bc66f5 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.296639 Oct 10 23:28:40.195911 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1505/2911] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:28:39 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 302 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:28:40.201286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e84d7d7b-f491-4062-a1b0-41821b88e324 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Action: 'create', calling method: .version_select at 0x7f6630181d30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-346002858", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:40.239544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-e84d7d7b-f491-4062-a1b0-41821b88e324 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Getting quotas for project 5688507bc46d4d8b89faa7ae4b7bd5d4. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:28:40.252144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-e84d7d7b-f491-4062-a1b0-41821b88e324 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Getting quotas for user e9e6b76c999b4ada902aebfdca4a59d2 and project 5688507bc46d4d8b89faa7ae4b7bd5d4. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:28:40.315729 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-e84d7d7b-f491-4062-a1b0-41821b88e324 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e84d7d7b-f491-4062-a1b0-41821b88e324 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Request method failure captured: Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 2166 Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKqnTwT2Kh1CRF6Bf4bTAT0gvQ48TKJwC6eBKKJ49UZGXH52h96hOvvamNuv7eRTlTzEX5FFHE8OhJ1-qSfdj_yavcVew61BlOKY7mk1uOfukZbeX-Y-4hl_fOprxW_9OjmcgqmWNbS-yG-7b90KG3kPEBQVIrJ4FoH5aU1sPF2DZfM Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 5688507bc46d4d8b89faa7ae4b7bd5d4 Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5688507bc46d4d8b89faa7ae4b7bd5d4", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 5688507bc46d4d8b89faa7ae4b7bd5d4 Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-KeyPairsNegativeTestJSON-1679965276-project Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: e9e6b76c999b4ada902aebfdca4a59d2 Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1679965276-project Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-346002858", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:28:40.359439 n-d-860864-2 devstack@n-api.service[120614]: exception: Keypair data is invalid: failed to generate fingerprint Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-346002858', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:28:40.362399 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:28:40.365988 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:28:40.365988 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:28:40.365988 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:28:40.365988 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:28:40.365988 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 10 23:28:40.365988 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 10 23:28:40.365988 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 10 23:28:40.365988 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 10 23:28:40.365988 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 10 23:28:40.365988 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.365988 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:40.365988 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.365988 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:40.365988 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:40.365988 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:40.365988 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:28:40.365988 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:28:40.365988 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 10 23:28:40.365988 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.365988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e84d7d7b-f491-4062-a1b0-41821b88e324 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:28:40.368461 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e84d7d7b-f491-4062-a1b0-41821b88e324 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.169430 Oct 10 23:28:40.368461 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1407/2912] 10.222.0.23 () {60 vars in 1160 bytes} [Mon Oct 10 23:28:40 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 10 23:28:40.381795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3d088003-8602-49fa-81e4-a3e4f64b6f66 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Action: 'create', calling method: .version_select at 0x7f662b934a60>, body: {"keypair": {"name": "tempest-keypair-1980130502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5Ke3d/smwaf7uxPGhrhFoYYQ+y8mN4CcmEQc5pAPfvb+qv8Ta77F2SFTzyBVA96+duyFYOBwuAHUF+8aYMiTHWrxB1x2L8MM0FbV8BPr24/ENBo86pkdTWg9HJjhCflw=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:40.440874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-3d088003-8602-49fa-81e4-a3e4f64b6f66 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Getting quotas for project 5688507bc46d4d8b89faa7ae4b7bd5d4. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:28:40.454398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-3d088003-8602-49fa-81e4-a3e4f64b6f66 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Getting quotas for user e9e6b76c999b4ada902aebfdca4a59d2 and project 5688507bc46d4d8b89faa7ae4b7bd5d4. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:28:40.481871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7270dff6-0970-44ea-8859-dc6854b1c830 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:40.483744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7270dff6-0970-44ea-8859-dc6854b1c830 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:40.522996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7270dff6-0970-44ea-8859-dc6854b1c830 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:40.525919 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3d088003-8602-49fa-81e4-a3e4f64b6f66 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.147487 Oct 10 23:28:40.527526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7270dff6-0970-44ea-8859-dc6854b1c830 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:40.528313 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1506/2913] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:28:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:28:40.539102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7270dff6-0970-44ea-8859-dc6854b1c830 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:40.541178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7270dff6-0970-44ea-8859-dc6854b1c830 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:40.541721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7270dff6-0970-44ea-8859-dc6854b1c830 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:40.544873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3c35b9be-28e5-4f3e-bcca-86019b4fedc7 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Action: 'create', calling method: .version_select at 0x7f662b4829d0>, body: {"keypair": {"name": "tempest-keypair-1980130502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDONLL8GUpcwjVCPSmJNT//LFHC3+USPQsM3IZnb7HeETAIpo4t5tUFQGVWFcW6PZmaFHiHSoTAyb0aIN3mS7zLHJxyhlAD/7vj1dkzF1z8rJ7tKMZNiKAt08oRCNe7bQ=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:40.547479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7270dff6-0970-44ea-8859-dc6854b1c830 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:40.586363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-3c35b9be-28e5-4f3e-bcca-86019b4fedc7 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Getting quotas for project 5688507bc46d4d8b89faa7ae4b7bd5d4. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:28:40.603995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-3c35b9be-28e5-4f3e-bcca-86019b4fedc7 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Getting quotas for user e9e6b76c999b4ada902aebfdca4a59d2 and project 5688507bc46d4d8b89faa7ae4b7bd5d4. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:28:40.679452 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-3c35b9be-28e5-4f3e-bcca-86019b4fedc7 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] HTTP exception thrown: Key pair 'tempest-keypair-1980130502' already exists. Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3c35b9be-28e5-4f3e-bcca-86019b4fedc7 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Request method failure captured: Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 273 Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKqnTwT2Kh1CRF6Bf4bTAT0gvQ48TKJwC6eBKKJ49UZGXH52h96hOvvamNuv7eRTlTzEX5FFHE8OhJ1-qSfdj_yavcVew61BlOKY7mk1uOfukZbeX-Y-4hl_fOprxW_9OjmcgqmWNbS-yG-7b90KG3kPEBQVIrJ4FoH5aU1sPF2DZfM Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 5688507bc46d4d8b89faa7ae4b7bd5d4 Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5688507bc46d4d8b89faa7ae4b7bd5d4", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 5688507bc46d4d8b89faa7ae4b7bd5d4 Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-KeyPairsNegativeTestJSON-1679965276-project Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: e9e6b76c999b4ada902aebfdca4a59d2 Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1679965276-project Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: {"keypair": {"name": "tempest-keypair-1980130502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDONLL8GUpcwjVCPSmJNT//LFHC3+USPQsM3IZnb7HeETAIpo4t5tUFQGVWFcW6PZmaFHiHSoTAyb0aIN3mS7zLHJxyhlAD/7vj1dkzF1z8rJ7tKMZNiKAt08oRCNe7bQ=="}} Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: exception: Key pair 'tempest-keypair-1980130502' already exists. Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1980130502', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDONLL8GUpcwjVCPSmJNT//LFHC3+USPQsM3IZnb7HeETAIpo4t5tUFQGVWFcW6PZmaFHiHSoTAyb0aIN3mS7zLHJxyhlAD/7vj1dkzF1z8rJ7tKMZNiKAt08oRCNe7bQ=='}}} Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result.read() Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'e9e6b76c999b4ada902aebfdca4a59d2-tempest-keypair-1980130502' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 10 23:28:40.699753 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi session.flush() Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result.read() Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 10 23:28:40.705722 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'e9e6b76c999b4ada902aebfdca4a59d2-tempest-keypair-1980130502' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 10, 23, 28, 40, 657317), 'updated_at': None, 'name': 'tempest-keypair-1980130502', 'user_id': 'e9e6b76c999b4ada902aebfdca4a59d2', 'fingerprint': '60:5f:6f:85:b8:e4:22:7c:13:a5:bc:4f:c8:5f:f1:77', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDONLL8GUpcwjVCPSmJNT//LFHC3+USPQsM3IZnb7HeETAIpo4t5tUFQGVWFcW6PZmaFHiHSoTAyb0aIN3mS7zLHJxyhlAD/7vj1dkzF1z8rJ7tKMZNiKAt08oRCNe7bQ==', 'type': 'ssh'}] Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi keypair.create() Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._create() Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1980130502' already exists. Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 10 23:28:40.714390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1980130502' already exists. Oct 10 23:28:40.720239 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.720239 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:40.720239 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.720239 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:40.720239 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:40.720239 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:40.720239 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:28:40.720239 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:28:40.720239 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1980130502' already exists. Oct 10 23:28:40.720239 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.720239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3c35b9be-28e5-4f3e-bcca-86019b4fedc7 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Returning 409 to user: Key pair 'tempest-keypair-1980130502' already exists. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:28:40.720239 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3c35b9be-28e5-4f3e-bcca-86019b4fedc7 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.166716 Oct 10 23:28:40.720239 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1507/2914] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:28:40 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 169 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 10 23:28:40.728766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3ec28ce8-0143-463e-875e-01cc9fd3f3c5 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Calling method '.version_select at 0x7f6633b73670>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:40.788368 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3ec28ce8-0143-463e-875e-01cc9fd3f3c5 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1980130502" status: 202 len: 0 microversion: 2.1 time: 0.069049 Oct 10 23:28:40.789154 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1508/2915] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 10 23:28:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1980130502 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:28:40.812594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-796ad56a-33d0-437d-b581-2ed0dbaa11f3 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Action: 'create', calling method: .version_select at 0x7f662b94b040>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcNzEE3fQS1xSLhO3iTBbgAiXWI0GGl5K7KAAaqIllE21j1agO1ci3nulcjvENeW3DseiiBZW/7CkCJvwhIPps3u5YUB3yktaPa/KL8+g49ludVr3ewnLnIJmoTEVFmDA=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-796ad56a-33d0-437d-b581-2ed0dbaa11f3 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Request method failure captured: Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 247 Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKqnTwT2Kh1CRF6Bf4bTAT0gvQ48TKJwC6eBKKJ49UZGXH52h96hOvvamNuv7eRTlTzEX5FFHE8OhJ1-qSfdj_yavcVew61BlOKY7mk1uOfukZbeX-Y-4hl_fOprxW_9OjmcgqmWNbS-yG-7b90KG3kPEBQVIrJ4FoH5aU1sPF2DZfM Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 5688507bc46d4d8b89faa7ae4b7bd5d4 Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5688507bc46d4d8b89faa7ae4b7bd5d4", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 5688507bc46d4d8b89faa7ae4b7bd5d4 Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-KeyPairsNegativeTestJSON-1679965276-project Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: e9e6b76c999b4ada902aebfdca4a59d2 Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1679965276-project Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcNzEE3fQS1xSLhO3iTBbgAiXWI0GGl5K7KAAaqIllE21j1agO1ci3nulcjvENeW3DseiiBZW/7CkCJvwhIPps3u5YUB3yktaPa/KL8+g49ludVr3ewnLnIJmoTEVFmDA=="}} Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcNzEE3fQS1xSLhO3iTBbgAiXWI0GGl5K7KAAaqIllE21j1agO1ci3nulcjvENeW3DseiiBZW/7CkCJvwhIPps3u5YUB3yktaPa/KL8+g49ludVr3ewnLnIJmoTEVFmDA=='}}} Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi '' Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:28:40.831792 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:28:40.836624 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:28:40.836624 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:28:40.836624 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:28:40.836624 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:28:40.836624 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 10 23:28:40.836624 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.836624 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:40.836624 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.836624 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:40.836624 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:40.836624 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:40.836624 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:28:40.836624 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:28:40.836624 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 10 23:28:40.836624 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:40.842224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-796ad56a-33d0-437d-b581-2ed0dbaa11f3 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:28:40.845310 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-796ad56a-33d0-437d-b581-2ed0dbaa11f3 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.047034 Oct 10 23:28:40.858551 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1509/2916] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:28:40 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:28:40.881477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-34007784-13fb-444b-9af1-85825ba633c0 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:40.883746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-34007784-13fb-444b-9af1-85825ba633c0 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:40.907071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34007784-13fb-444b-9af1-85825ba633c0 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:40.908614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34007784-13fb-444b-9af1-85825ba633c0 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:40.909252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34007784-13fb-444b-9af1-85825ba633c0 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:40.913729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34007784-13fb-444b-9af1-85825ba633c0 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:40.917991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34007784-13fb-444b-9af1-85825ba633c0 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:40.923109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34007784-13fb-444b-9af1-85825ba633c0 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:41.293457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-34007784-13fb-444b-9af1-85825ba633c0 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:41.306018 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-34007784-13fb-444b-9af1-85825ba633c0 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1477 microversion: 2.1 time: 0.442993 Oct 10 23:28:41.328510 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1510/2917] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:40 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1477 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:41.335658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b20af7b1-fe0d-46d8-ae00-b55e89bef0ea tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Action: 'create', calling method: .version_select at 0x7f662b56de50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1450505536", "public_key": " "}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:41.399697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-b20af7b1-fe0d-46d8-ae00-b55e89bef0ea tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Getting quotas for project 5688507bc46d4d8b89faa7ae4b7bd5d4. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:28:41.412929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-b20af7b1-fe0d-46d8-ae00-b55e89bef0ea tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Getting quotas for user e9e6b76c999b4ada902aebfdca4a59d2 and project 5688507bc46d4d8b89faa7ae4b7bd5d4. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:28:41.469836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7270dff6-0970-44ea-8859-dc6854b1c830 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:41.471825 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-b20af7b1-fe0d-46d8-ae00-b55e89bef0ea tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 10 23:28:41.484852 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7270dff6-0970-44ea-8859-dc6854b1c830 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 1.005072 Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b20af7b1-fe0d-46d8-ae00-b55e89bef0ea tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Request method failure captured: Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 95 Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKqnTwT2Kh1CRF6Bf4bTAT0gvQ48TKJwC6eBKKJ49UZGXH52h96hOvvamNuv7eRTlTzEX5FFHE8OhJ1-qSfdj_yavcVew61BlOKY7mk1uOfukZbeX-Y-4hl_fOprxW_9OjmcgqmWNbS-yG-7b90KG3kPEBQVIrJ4FoH5aU1sPF2DZfM Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 5688507bc46d4d8b89faa7ae4b7bd5d4 Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5688507bc46d4d8b89faa7ae4b7bd5d4", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 5688507bc46d4d8b89faa7ae4b7bd5d4 Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-KeyPairsNegativeTestJSON-1679965276-project Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: e9e6b76c999b4ada902aebfdca4a59d2 Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1679965276-project Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1450505536", "public_key": " "}} Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: exception: Keypair data is invalid: failed to generate fingerprint Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1450505536', 'public_key': ' '}}} Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:41.485028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.502840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b20af7b1-fe0d-46d8-ae00-b55e89bef0ea tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:28:41.504594 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1408/2918] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:40 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:41.504685 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b20af7b1-fe0d-46d8-ae00-b55e89bef0ea tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.161892 Oct 10 23:28:41.504776 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-04f86c92-afdc-4327-b4c7-7a78ff0a39aa tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:41.504776 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-04f86c92-afdc-4327-b4c7-7a78ff0a39aa tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:41.504918 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1511/2919] 10.222.0.23 () {60 vars in 1158 bytes} [Mon Oct 10 23:28:41 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 23:28:41.505299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04f86c92-afdc-4327-b4c7-7a78ff0a39aa tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:41.509646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04f86c92-afdc-4327-b4c7-7a78ff0a39aa tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:41.510366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04f86c92-afdc-4327-b4c7-7a78ff0a39aa tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:41.511219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-16edb435-0859-4133-ab88-8958a48c299d tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Action: 'create', calling method: .version_select at 0x7f662b505b80>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaIg/8RqX3KY+qQlN8gXBUZUjZjY8CswSpXhEqnc2mfYRbnUSZq8xZoM/vS/RpBVgJfyjKp2cZJOnzt2O0BDfNupvUAElsG3E1tAJCpwIMt1xz0kVr/E5YjHufa+v2v1Q=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:41.511393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04f86c92-afdc-4327-b4c7-7a78ff0a39aa tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:41.512932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04f86c92-afdc-4327-b4c7-7a78ff0a39aa tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:41.513786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04f86c92-afdc-4327-b4c7-7a78ff0a39aa tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-16edb435-0859-4133-ab88-8958a48c299d tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Request method failure captured: Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 507 Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKqnTwT2Kh1CRF6Bf4bTAT0gvQ48TKJwC6eBKKJ49UZGXH52h96hOvvamNuv7eRTlTzEX5FFHE8OhJ1-qSfdj_yavcVew61BlOKY7mk1uOfukZbeX-Y-4hl_fOprxW_9OjmcgqmWNbS-yG-7b90KG3kPEBQVIrJ4FoH5aU1sPF2DZfM Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 5688507bc46d4d8b89faa7ae4b7bd5d4 Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5688507bc46d4d8b89faa7ae4b7bd5d4", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 5688507bc46d4d8b89faa7ae4b7bd5d4 Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-KeyPairsNegativeTestJSON-1679965276-project Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: e9e6b76c999b4ada902aebfdca4a59d2 Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1679965276-project Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaIg/8RqX3KY+qQlN8gXBUZUjZjY8CswSpXhEqnc2mfYRbnUSZq8xZoM/vS/RpBVgJfyjKp2cZJOnzt2O0BDfNupvUAElsG3E1tAJCpwIMt1xz0kVr/E5YjHufa+v2v1Q=="}} Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaIg/8RqX3KY+qQlN8gXBUZUjZjY8CswSpXhEqnc2mfYRbnUSZq8xZoM/vS/RpBVgJfyjKp2cZJOnzt2O0BDfNupvUAElsG3E1tAJCpwIMt1xz0kVr/E5YjHufa+v2v1Q=='}}} Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 10 23:28:41.535336 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-16edb435-0859-4133-ab88-8958a48c299d tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:28:41.538899 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-16edb435-0859-4133-ab88-8958a48c299d tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.033900 Oct 10 23:28:41.550070 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1512/2920] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:28:41 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:28:41.561665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4e39c91e-4d76-412c-a2fa-b9ecd109f93b tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Action: 'create', calling method: .version_select at 0x7f662b56daf0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-312795947", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:41.653355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-4e39c91e-4d76-412c-a2fa-b9ecd109f93b tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Getting quotas for project 5688507bc46d4d8b89faa7ae4b7bd5d4. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:28:41.670070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-4e39c91e-4d76-412c-a2fa-b9ecd109f93b tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Getting quotas for user e9e6b76c999b4ada902aebfdca4a59d2 and project 5688507bc46d4d8b89faa7ae4b7bd5d4. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:28:41.712964 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-4e39c91e-4d76-412c-a2fa-b9ecd109f93b tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4e39c91e-4d76-412c-a2fa-b9ecd109f93b tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Request method failure captured: Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 117 Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKqnTwT2Kh1CRF6Bf4bTAT0gvQ48TKJwC6eBKKJ49UZGXH52h96hOvvamNuv7eRTlTzEX5FFHE8OhJ1-qSfdj_yavcVew61BlOKY7mk1uOfukZbeX-Y-4hl_fOprxW_9OjmcgqmWNbS-yG-7b90KG3kPEBQVIrJ4FoH5aU1sPF2DZfM Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 5688507bc46d4d8b89faa7ae4b7bd5d4 Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5688507bc46d4d8b89faa7ae4b7bd5d4", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 5688507bc46d4d8b89faa7ae4b7bd5d4 Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-KeyPairsNegativeTestJSON-1679965276-project Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: e9e6b76c999b4ada902aebfdca4a59d2 Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1679965276-project Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-312795947", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: exception: Keypair data is invalid: failed to generate fingerprint Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-312795947', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 10 23:28:41.721476 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4e39c91e-4d76-412c-a2fa-b9ecd109f93b tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:28:41.726183 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4e39c91e-4d76-412c-a2fa-b9ecd109f93b tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.171817 Oct 10 23:28:41.737018 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1513/2921] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:28:41 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 186 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 23:28:41.742111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4219ba27-987a-4e24-80c6-be554d944b41 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Calling method '.version_select at 0x7f662b94bca0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:41.763983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:28:41.791299 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-4219ba27-987a-4e24-80c6-be554d944b41 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-170661734 not found for user e9e6b76c999b4ada902aebfdca4a59d2 Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4219ba27-987a-4e24-80c6-be554d944b41 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Request method failure captured: Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-170661734 HTTP/1.1 Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKqnTwT2Kh1CRF6Bf4bTAT0gvQ48TKJwC6eBKKJ49UZGXH52h96hOvvamNuv7eRTlTzEX5FFHE8OhJ1-qSfdj_yavcVew61BlOKY7mk1uOfukZbeX-Y-4hl_fOprxW_9OjmcgqmWNbS-yG-7b90KG3kPEBQVIrJ4FoH5aU1sPF2DZfM Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 5688507bc46d4d8b89faa7ae4b7bd5d4 Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5688507bc46d4d8b89faa7ae4b7bd5d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5688507bc46d4d8b89faa7ae4b7bd5d4", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 5688507bc46d4d8b89faa7ae4b7bd5d4 Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1679965276 Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-KeyPairsNegativeTestJSON-1679965276-project Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: e9e6b76c999b4ada902aebfdca4a59d2 Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1679965276-project Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: exception: Keypair tempest-keypair-non-existent-170661734 not found for user e9e6b76c999b4ada902aebfdca4a59d2 Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'tempest-keypair-non-existent-170661734'} Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-170661734 not found for user e9e6b76c999b4ada902aebfdca4a59d2 Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.793354 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-170661734 not found for user e9e6b76c999b4ada902aebfdca4a59d2 Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-170661734 not found for user e9e6b76c999b4ada902aebfdca4a59d2 Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4219ba27-987a-4e24-80c6-be554d944b41 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] Returning 404 to user: Keypair tempest-keypair-non-existent-170661734 not found for user e9e6b76c999b4ada902aebfdca4a59d2 {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:28:41.798356 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4219ba27-987a-4e24-80c6-be554d944b41 tempest-KeyPairsNegativeTestJSON-1679965276 tempest-KeyPairsNegativeTestJSON-1679965276-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-170661734" status: 404 len: 144 microversion: 2.1 time: 0.056659 Oct 10 23:28:41.801867 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1514/2922] 10.222.0.23 () {58 vars in 1257 bytes} [Mon Oct 10 23:28:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-170661734 => generated 144 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:28:41.933114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-04f86c92-afdc-4327-b4c7-7a78ff0a39aa tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:41.949318 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-04f86c92-afdc-4327-b4c7-7a78ff0a39aa tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1537 microversion: 2.1 time: 0.457560 Oct 10 23:28:41.950222 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1409/2923] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:41 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1537 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:42.337214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4715b0fb-b338-4cf9-8630-8b87ca9beff5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:42.338209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4715b0fb-b338-4cf9-8630-8b87ca9beff5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:42.361364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4715b0fb-b338-4cf9-8630-8b87ca9beff5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:42.364047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4715b0fb-b338-4cf9-8630-8b87ca9beff5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:42.368328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4715b0fb-b338-4cf9-8630-8b87ca9beff5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:42.369364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4715b0fb-b338-4cf9-8630-8b87ca9beff5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:42.374431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4715b0fb-b338-4cf9-8630-8b87ca9beff5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:42.375935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4715b0fb-b338-4cf9-8630-8b87ca9beff5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:42.510283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-48bf87e6-af76-4736-baad-502c3e5213a3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:42.516495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-48bf87e6-af76-4736-baad-502c3e5213a3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:42.541625 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48bf87e6-af76-4736-baad-502c3e5213a3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:42.544604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48bf87e6-af76-4736-baad-502c3e5213a3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:42.547272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48bf87e6-af76-4736-baad-502c3e5213a3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:42.548732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48bf87e6-af76-4736-baad-502c3e5213a3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:42.554095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48bf87e6-af76-4736-baad-502c3e5213a3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:42.555840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48bf87e6-af76-4736-baad-502c3e5213a3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:43.063267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4715b0fb-b338-4cf9-8630-8b87ca9beff5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:43.082659 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4715b0fb-b338-4cf9-8630-8b87ca9beff5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1477 microversion: 2.1 time: 0.750728 Oct 10 23:28:43.084858 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1515/2924] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:42 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1477 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:43.102828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-eecf63cd-c19d-4c5c-aa8a-078a5e419ba3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:43.104136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-eecf63cd-c19d-4c5c-aa8a-078a5e419ba3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:43.113395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eecf63cd-c19d-4c5c-aa8a-078a5e419ba3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:43.120810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eecf63cd-c19d-4c5c-aa8a-078a5e419ba3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:43.121694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eecf63cd-c19d-4c5c-aa8a-078a5e419ba3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:43.123316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eecf63cd-c19d-4c5c-aa8a-078a5e419ba3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:43.124026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eecf63cd-c19d-4c5c-aa8a-078a5e419ba3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:43.124790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eecf63cd-c19d-4c5c-aa8a-078a5e419ba3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:43.215689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-48bf87e6-af76-4736-baad-502c3e5213a3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:43.230116 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-48bf87e6-af76-4736-baad-502c3e5213a3 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 0.724374 Oct 10 23:28:43.262419 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1410/2925] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:42 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:28:43.270617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b270940a-80e8-4e43-8bb6-48793210b68a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0572e991-e14e-40b5-ab57-a7261a26c7fb"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:43.276291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b270940a-80e8-4e43-8bb6-48793210b68a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:43.309403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b270940a-80e8-4e43-8bb6-48793210b68a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:43.312730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b270940a-80e8-4e43-8bb6-48793210b68a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:43.315369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b270940a-80e8-4e43-8bb6-48793210b68a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:43.316711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b270940a-80e8-4e43-8bb6-48793210b68a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:43.317453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b270940a-80e8-4e43-8bb6-48793210b68a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:43.318364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b270940a-80e8-4e43-8bb6-48793210b68a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:43.612448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-eecf63cd-c19d-4c5c-aa8a-078a5e419ba3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:43.627899 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-eecf63cd-c19d-4c5c-aa8a-078a5e419ba3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1537 microversion: 2.1 time: 0.541473 Oct 10 23:28:43.628814 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1516/2926] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:43 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1537 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:43.897221 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b270940a-80e8-4e43-8bb6-48793210b68a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "POST /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.632776 Oct 10 23:28:43.901534 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1411/2927] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Oct 10 23:28:43 2022] POST /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-volume_attachments => generated 194 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:28:44.108888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cfb28ebb-66da-4681-810a-1cc46be653b2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:44.110268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cfb28ebb-66da-4681-810a-1cc46be653b2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:44.127118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfb28ebb-66da-4681-810a-1cc46be653b2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:44.127627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfb28ebb-66da-4681-810a-1cc46be653b2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:44.128077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfb28ebb-66da-4681-810a-1cc46be653b2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:44.129146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfb28ebb-66da-4681-810a-1cc46be653b2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:44.135819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfb28ebb-66da-4681-810a-1cc46be653b2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:44.136376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfb28ebb-66da-4681-810a-1cc46be653b2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:44.253199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-169df752-6b01-4e3e-88ca-6312c60c6c72 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Action: 'create', calling method: .version_select at 0x7f662b5ddc10>, body: {"keypair": {"name": "tempest-keypair-18508629", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOh8CsElQOFIaq1rxeZ6bwR7C8BNCOmZzoVGv2Bj8qgri2/6vlK9bpeqRnYLsvHOpS1EqLxckJh8X40r0jLwaEfQWH8suUqxKpbQqcH13lcKgjAHG2JduPiXq6ludDH4vg=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:44.318944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-169df752-6b01-4e3e-88ca-6312c60c6c72 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Getting quotas for project 24258516d0894c629fe91d0d0907bc3c. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:28:44.339372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-169df752-6b01-4e3e-88ca-6312c60c6c72 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Getting quotas for user 05eae0dd45364b3b9d20bf48903e78ca and project 24258516d0894c629fe91d0d0907bc3c. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:28:44.359111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:28:44.382830 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-169df752-6b01-4e3e-88ca-6312c60c6c72 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.32 time: 0.134637 Oct 10 23:28:44.384407 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1412/2928] 10.222.0.23 () {62 vars in 1200 bytes} [Mon Oct 10 23:28:44 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 23:28:44.394713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-df91d804-14f7-4461-bce6-323c925035d4 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:44.395517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-df91d804-14f7-4461-bce6-323c925035d4 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:44.411561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df91d804-14f7-4461-bce6-323c925035d4 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:44.412930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df91d804-14f7-4461-bce6-323c925035d4 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:44.413661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df91d804-14f7-4461-bce6-323c925035d4 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:44.414538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df91d804-14f7-4461-bce6-323c925035d4 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:44.415838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df91d804-14f7-4461-bce6-323c925035d4 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:44.416694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df91d804-14f7-4461-bce6-323c925035d4 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:44.800219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cfb28ebb-66da-4681-810a-1cc46be653b2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:44.818097 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cfb28ebb-66da-4681-810a-1cc46be653b2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1477 microversion: 2.1 time: 0.714434 Oct 10 23:28:44.826581 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1517/2929] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:44 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1477 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:44.839780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d6486719-27de-437c-848c-4cd1cb80affc tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:44.843909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d6486719-27de-437c-848c-4cd1cb80affc tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:44.863414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6486719-27de-437c-848c-4cd1cb80affc tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:44.870169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6486719-27de-437c-848c-4cd1cb80affc tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:44.871394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6486719-27de-437c-848c-4cd1cb80affc tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:44.874275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6486719-27de-437c-848c-4cd1cb80affc tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:44.881806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6486719-27de-437c-848c-4cd1cb80affc tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:44.882646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6486719-27de-437c-848c-4cd1cb80affc tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:44.898561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-df91d804-14f7-4461-bce6-323c925035d4 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:44.918550 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-df91d804-14f7-4461-bce6-323c925035d4 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 0.524126 Oct 10 23:28:44.926239 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1413/2930] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:44 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:45.288578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d6486719-27de-437c-848c-4cd1cb80affc tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:45.302106 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d6486719-27de-437c-848c-4cd1cb80affc tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1537 microversion: 2.1 time: 0.473746 Oct 10 23:28:45.305819 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1518/2931] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:44 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1537 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:45.848853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3e4a550b-5a4e-492a-8224-a1bdd90a2d7f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:45.849787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3e4a550b-5a4e-492a-8224-a1bdd90a2d7f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:45.893322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e4a550b-5a4e-492a-8224-a1bdd90a2d7f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:45.894139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e4a550b-5a4e-492a-8224-a1bdd90a2d7f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:45.896356 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e4a550b-5a4e-492a-8224-a1bdd90a2d7f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:45.897300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e4a550b-5a4e-492a-8224-a1bdd90a2d7f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:45.901612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e4a550b-5a4e-492a-8224-a1bdd90a2d7f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:45.902784 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e4a550b-5a4e-492a-8224-a1bdd90a2d7f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:46.197467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ce0fd9db-a685-4bd8-904a-05300e3730eb tempest-AbsoluteLimitsNegativeTestJSON-1270679940 tempest-AbsoluteLimitsNegativeTestJSON-1270679940-project] Calling method '.version_select at 0x7f662ae88af0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:46.229616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce0fd9db-a685-4bd8-904a-05300e3730eb tempest-AbsoluteLimitsNegativeTestJSON-1270679940 tempest-AbsoluteLimitsNegativeTestJSON-1270679940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:46.233852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce0fd9db-a685-4bd8-904a-05300e3730eb tempest-AbsoluteLimitsNegativeTestJSON-1270679940 tempest-AbsoluteLimitsNegativeTestJSON-1270679940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:46.237407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce0fd9db-a685-4bd8-904a-05300e3730eb tempest-AbsoluteLimitsNegativeTestJSON-1270679940 tempest-AbsoluteLimitsNegativeTestJSON-1270679940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:46.238606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce0fd9db-a685-4bd8-904a-05300e3730eb tempest-AbsoluteLimitsNegativeTestJSON-1270679940 tempest-AbsoluteLimitsNegativeTestJSON-1270679940-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:46.241366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce0fd9db-a685-4bd8-904a-05300e3730eb tempest-AbsoluteLimitsNegativeTestJSON-1270679940 tempest-AbsoluteLimitsNegativeTestJSON-1270679940-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:46.242044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce0fd9db-a685-4bd8-904a-05300e3730eb tempest-AbsoluteLimitsNegativeTestJSON-1270679940 tempest-AbsoluteLimitsNegativeTestJSON-1270679940-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:46.332235 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ce0fd9db-a685-4bd8-904a-05300e3730eb tempest-AbsoluteLimitsNegativeTestJSON-1270679940 tempest-AbsoluteLimitsNegativeTestJSON-1270679940-project] 10.222.0.23 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.471634 Oct 10 23:28:46.334950 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1519/2932] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Oct 10 23:28:45 2022] GET /compute/v2.1/limits => generated 511 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:28:46.341559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bab87f9e-31f3-42fa-9c3e-9dc6832f0b03 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:46.344657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bab87f9e-31f3-42fa-9c3e-9dc6832f0b03 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:46.395119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bab87f9e-31f3-42fa-9c3e-9dc6832f0b03 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:46.395875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bab87f9e-31f3-42fa-9c3e-9dc6832f0b03 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:46.396486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bab87f9e-31f3-42fa-9c3e-9dc6832f0b03 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:46.398606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bab87f9e-31f3-42fa-9c3e-9dc6832f0b03 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:46.399237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bab87f9e-31f3-42fa-9c3e-9dc6832f0b03 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:46.399995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bab87f9e-31f3-42fa-9c3e-9dc6832f0b03 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:46.681909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3e4a550b-5a4e-492a-8224-a1bdd90a2d7f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:46.685776 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:28:46.695382 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3e4a550b-5a4e-492a-8224-a1bdd90a2d7f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1477 microversion: 2.1 time: 0.851322 Oct 10 23:28:46.696867 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1414/2933] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:45 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1477 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:46.702960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bab87f9e-31f3-42fa-9c3e-9dc6832f0b03 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:46.704817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ae453e62-951a-4060-bae2-76075471b82b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:46.705657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ae453e62-951a-4060-bae2-76075471b82b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:46.713854 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bab87f9e-31f3-42fa-9c3e-9dc6832f0b03 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 0.377280 Oct 10 23:28:46.719124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae453e62-951a-4060-bae2-76075471b82b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:46.721060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae453e62-951a-4060-bae2-76075471b82b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:46.722048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae453e62-951a-4060-bae2-76075471b82b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:46.723792 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1520/2934] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:46 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:46.725626 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae453e62-951a-4060-bae2-76075471b82b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:46.727064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae453e62-951a-4060-bae2-76075471b82b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:46.728785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae453e62-951a-4060-bae2-76075471b82b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:46.740634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7be7d409-0d45-44af-abc3-0b367b6424d6 tempest-AbsoluteLimitsNegativeTestJSON-1270679940 tempest-AbsoluteLimitsNegativeTestJSON-1270679940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-648331178", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:46.831876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-7be7d409-0d45-44af-abc3-0b367b6424d6 tempest-AbsoluteLimitsNegativeTestJSON-1270679940 tempest-AbsoluteLimitsNegativeTestJSON-1270679940-project] validate_networks() for None {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:28:47.063524 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ae453e62-951a-4060-bae2-76075471b82b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:47.077849 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ae453e62-951a-4060-bae2-76075471b82b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1537 microversion: 2.1 time: 0.379128 Oct 10 23:28:47.080036 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1415/2935] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:46 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1537 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:47.243885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-728d4030-de6b-4ab6-966d-b1cfcf951319 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Action: 'create', calling method: .version_select at 0x7f662a6dfee0>, body: {"keypair": {"name": "tempest-keypair-1312694263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFs8gJPOYbCRxsMJXQK9riK7E8fsx3JCzpge/CJkrFZ4g1aGN8q189iaNrlihCP/v/aUU5IvWiJMa+45fXRfPZdTmKzdubHXMALW86S6avlTYXj3ozmONnMyeth6/BrBAQ=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:47.255737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-7be7d409-0d45-44af-abc3-0b367b6424d6 tempest-AbsoluteLimitsNegativeTestJSON-1270679940 tempest-AbsoluteLimitsNegativeTestJSON-1270679940-project] Getting quotas for project efd572bf14bd4f23aff9679821732022. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:28:47.274317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-7be7d409-0d45-44af-abc3-0b367b6424d6 tempest-AbsoluteLimitsNegativeTestJSON-1270679940 tempest-AbsoluteLimitsNegativeTestJSON-1270679940-project] Getting quotas for user ebef56a61c504f5eb97366d87d1ec99a and project efd572bf14bd4f23aff9679821732022. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:28:47.284822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-728d4030-de6b-4ab6-966d-b1cfcf951319 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Getting quotas for project a89b626b3b5443d3ae614b95df86b60f. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:28:47.298558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-728d4030-de6b-4ab6-966d-b1cfcf951319 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Getting quotas for user 9ccc95d3ba2d4250aecf432af338d7b1 and project a89b626b3b5443d3ae614b95df86b60f. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:28:47.312256 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-7be7d409-0d45-44af-abc3-0b367b6424d6 tempest-AbsoluteLimitsNegativeTestJSON-1270679940 tempest-AbsoluteLimitsNegativeTestJSON-1270679940-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7be7d409-0d45-44af-abc3-0b367b6424d6 tempest-AbsoluteLimitsNegativeTestJSON-1270679940 tempest-AbsoluteLimitsNegativeTestJSON-1270679940-project] Request method failure captured: Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 1751 Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKqt3jDJheuYA0ONRjdeMvvjMQOO7wzC9jC_OsjkkwXCKJkWvYaTVx4DItElNulKVlmuPROyfxmkZu0Xp3DN7Iuq4vxWcWcv9brGKmrPDEqehRM68G_VGMnCylVSiDdylfpo8l9wdSB9HE_497UQlCRSbsLlZ2QtLn3KWYjz7Go5NAA Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: efd572bf14bd4f23aff9679821732022 Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1270679940 Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/efd572bf14bd4f23aff9679821732022"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/efd572bf14bd4f23aff9679821732022"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/efd572bf14bd4f23aff9679821732022"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_efd572bf14bd4f23aff9679821732022", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1270679940 Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: efd572bf14bd4f23aff9679821732022 Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1270679940 Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1270679940-project Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: ebef56a61c504f5eb97366d87d1ec99a Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1270679940-project Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-648331178", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:28:47.315987 n-d-860864-2 devstack@n-api.service[120613]: exception: Maximum number of metadata items exceeds 128 Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-648331178', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:28:47.318801 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:28:47.322150 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:28:47.322150 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 23:28:47.322150 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 10 23:28:47.322150 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 10 23:28:47.322150 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 10 23:28:47.322150 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:47.322150 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:47.322150 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:47.322150 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:47.322150 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:47.322150 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:47.322150 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:28:47.322150 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:28:47.322150 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 10 23:28:47.322150 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:28:47.327056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7be7d409-0d45-44af-abc3-0b367b6424d6 tempest-AbsoluteLimitsNegativeTestJSON-1270679940 tempest-AbsoluteLimitsNegativeTestJSON-1270679940-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:28:47.330345 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7be7d409-0d45-44af-abc3-0b367b6424d6 tempest-AbsoluteLimitsNegativeTestJSON-1270679940 tempest-AbsoluteLimitsNegativeTestJSON-1270679940-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.595854 Oct 10 23:28:47.332122 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1521/2936] 10.222.0.23 () {60 vars in 1148 bytes} [Mon Oct 10 23:28:46 2022] POST /compute/v2.1/servers => generated 87 bytes in 607 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:28:47.348703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-6d61956c-f5e8-415d-947f-37a105c22f70 req-5e5d1fdf-01d5-479a-bc5b-27d3bc8bfcae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d268c6-2b9d-4858-b67f-1dced7831838", "name": "network-vif-unplugged", "status": "completed", "tag": "3a4df9ab-2215-474a-bffb-e5b388a62d2d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:47.378853 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-728d4030-de6b-4ab6-966d-b1cfcf951319 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.296322 Oct 10 23:28:47.380060 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1416/2937] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:28:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:28:47.382671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6d61956c-f5e8-415d-947f-37a105c22f70 req-5e5d1fdf-01d5-479a-bc5b-27d3bc8bfcae service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:47.383566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6d61956c-f5e8-415d-947f-37a105c22f70 req-5e5d1fdf-01d5-479a-bc5b-27d3bc8bfcae service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:47.384172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6d61956c-f5e8-415d-947f-37a105c22f70 req-5e5d1fdf-01d5-479a-bc5b-27d3bc8bfcae service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:47.406547 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-6d61956c-f5e8-415d-947f-37a105c22f70 req-5e5d1fdf-01d5-479a-bc5b-27d3bc8bfcae service nova] Creating event network-vif-unplugged:3a4df9ab-2215-474a-bffb-e5b388a62d2d for instance a3d268c6-2b9d-4858-b67f-1dced7831838 on n-h2-860864-2 Oct 10 23:28:47.417696 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-6d61956c-f5e8-415d-947f-37a105c22f70 req-5e5d1fdf-01d5-479a-bc5b-27d3bc8bfcae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071927 Oct 10 23:28:47.419319 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1522/2938] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:28:47.720136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dcab5071-79b0-4a57-8ea4-86a8ee769310 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:47.721025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dcab5071-79b0-4a57-8ea4-86a8ee769310 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:47.734534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcab5071-79b0-4a57-8ea4-86a8ee769310 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:47.735779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcab5071-79b0-4a57-8ea4-86a8ee769310 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:47.736246 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcab5071-79b0-4a57-8ea4-86a8ee769310 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:47.737048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcab5071-79b0-4a57-8ea4-86a8ee769310 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:47.737618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcab5071-79b0-4a57-8ea4-86a8ee769310 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:47.738115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcab5071-79b0-4a57-8ea4-86a8ee769310 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:47.745936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dc0bd4e6-29da-464f-b34a-c368072fa024 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:47.747623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dc0bd4e6-29da-464f-b34a-c368072fa024 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:47.799536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc0bd4e6-29da-464f-b34a-c368072fa024 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:47.803431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc0bd4e6-29da-464f-b34a-c368072fa024 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:47.805864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc0bd4e6-29da-464f-b34a-c368072fa024 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:47.817178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc0bd4e6-29da-464f-b34a-c368072fa024 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:47.821633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc0bd4e6-29da-464f-b34a-c368072fa024 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:47.823333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc0bd4e6-29da-464f-b34a-c368072fa024 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:47.887549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:28:48.285469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dc0bd4e6-29da-464f-b34a-c368072fa024 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:48.306838 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dc0bd4e6-29da-464f-b34a-c368072fa024 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 0.570055 Oct 10 23:28:48.314207 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1523/2939] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:47 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:48.321702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e06b8d2e-250c-4ef0-bc65-867fd0c76e33 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:48.322342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e06b8d2e-250c-4ef0-bc65-867fd0c76e33 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:48.336875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dcab5071-79b0-4a57-8ea4-86a8ee769310 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:48.344648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e06b8d2e-250c-4ef0-bc65-867fd0c76e33 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:48.345158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e06b8d2e-250c-4ef0-bc65-867fd0c76e33 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:48.350992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e06b8d2e-250c-4ef0-bc65-867fd0c76e33 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:48.350992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e06b8d2e-250c-4ef0-bc65-867fd0c76e33 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:48.358221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e06b8d2e-250c-4ef0-bc65-867fd0c76e33 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:48.359097 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dcab5071-79b0-4a57-8ea4-86a8ee769310 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1477 microversion: 2.1 time: 0.642646 Oct 10 23:28:48.359326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e06b8d2e-250c-4ef0-bc65-867fd0c76e33 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:48.372739 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1417/2940] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:47 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1477 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:48.852350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e06b8d2e-250c-4ef0-bc65-867fd0c76e33 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:48.864544 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e06b8d2e-250c-4ef0-bc65-867fd0c76e33 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1519 microversion: 2.1 time: 0.548491 Oct 10 23:28:48.865835 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1524/2941] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:48 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1519 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:48.890771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e9a37dbc-d3dc-4b49-8f59-feaa5af89587 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:48.893474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e9a37dbc-d3dc-4b49-8f59-feaa5af89587 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:48.907260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9a37dbc-d3dc-4b49-8f59-feaa5af89587 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:48.907786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9a37dbc-d3dc-4b49-8f59-feaa5af89587 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:48.908256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9a37dbc-d3dc-4b49-8f59-feaa5af89587 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:48.908981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9a37dbc-d3dc-4b49-8f59-feaa5af89587 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:48.911474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9a37dbc-d3dc-4b49-8f59-feaa5af89587 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:48.911987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9a37dbc-d3dc-4b49-8f59-feaa5af89587 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:48.916543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8ce9a0e8-5454-4216-9e85-426610c1fb86 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-356730114", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "025d95fb-8ee8-4138-85ce-71b41b638125"}, {"port": "240e1ee2-1172-4479-82d1-59dc4e88df9c", "tag": "port-1"}, {"port": "7e9ff285-00b1-425e-abd8-7ec7fce5505e", "tag": "port-2"}, {"uuid": "31bd48ff-713e-4a6c-b6de-d2375c467080", "tag": "net-1"}, {"uuid": "31bd48ff-713e-4a6c-b6de-d2375c467080"}, {"uuid": "7c22afd5-757f-4c83-b240-3db356498b2e", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7c22afd5-757f-4c83-b240-3db356498b2e", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "43b0c7f9-2cc0-430e-9ab6-f48039d7d335", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "59e3769e-4f25-4197-bd1f-6102e8fcc691", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "e079a711-4d45-4098-a891-67892d88f4c7", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1834225342"}], "key_name": "tempest-keypair-18508629", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:48.989622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e9a37dbc-d3dc-4b49-8f59-feaa5af89587 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:28:49.184788 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e9a37dbc-d3dc-4b49-8f59-feaa5af89587 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 204 len: 0 microversion: 2.1 time: 0.297958 Oct 10 23:28:49.186109 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1418/2942] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:28:48 2022] DELETE /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:28:49.190281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-8ce9a0e8-5454-4216-9e85-426610c1fb86 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] validate_networks() for [('025d95fb-8ee8-4138-85ce-71b41b638125', None, None, None, None, None), (None, None, '240e1ee2-1172-4479-82d1-59dc4e88df9c', None, None, None), (None, None, '7e9ff285-00b1-425e-abd8-7ec7fce5505e', None, None, None), ('31bd48ff-713e-4a6c-b6de-d2375c467080', None, None, None, None, None), ('31bd48ff-713e-4a6c-b6de-d2375c467080', None, None, None, None, None), ('7c22afd5-757f-4c83-b240-3db356498b2e', '10.2.2.100', None, None, None, None), ('7c22afd5-757f-4c83-b240-3db356498b2e', '10.2.2.200', None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:28:49.195797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f245a000-fbae-416c-af34-339ef48d4105 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:49.196709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f245a000-fbae-416c-af34-339ef48d4105 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:49.213164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f245a000-fbae-416c-af34-339ef48d4105 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:49.214423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f245a000-fbae-416c-af34-339ef48d4105 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:49.215068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f245a000-fbae-416c-af34-339ef48d4105 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:49.216046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f245a000-fbae-416c-af34-339ef48d4105 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:49.216668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f245a000-fbae-416c-af34-339ef48d4105 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:49.217329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f245a000-fbae-416c-af34-339ef48d4105 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:49.484141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f245a000-fbae-416c-af34-339ef48d4105 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:49.498026 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f245a000-fbae-416c-af34-339ef48d4105 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1525 microversion: 2.1 time: 0.304275 Oct 10 23:28:49.509436 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1419/2943] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:49 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1525 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:49.518981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b853c4da-301c-4073-80f8-9044683b1409 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:49.520098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b853c4da-301c-4073-80f8-9044683b1409 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:49.527428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b853c4da-301c-4073-80f8-9044683b1409 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:49.529017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b853c4da-301c-4073-80f8-9044683b1409 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:49.531046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b853c4da-301c-4073-80f8-9044683b1409 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:49.531983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b853c4da-301c-4073-80f8-9044683b1409 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:49.534630 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b853c4da-301c-4073-80f8-9044683b1409 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:49.535240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b853c4da-301c-4073-80f8-9044683b1409 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:49.783168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b853c4da-301c-4073-80f8-9044683b1409 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:49.793716 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b853c4da-301c-4073-80f8-9044683b1409 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 0.293425 Oct 10 23:28:49.794690 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1420/2944] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:49 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:49.821676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b4e5e89a-108d-4080-ad16-83109d0155bd tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:49.823223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b4e5e89a-108d-4080-ad16-83109d0155bd tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:49.831249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4e5e89a-108d-4080-ad16-83109d0155bd tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:49.832071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4e5e89a-108d-4080-ad16-83109d0155bd tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:49.832981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4e5e89a-108d-4080-ad16-83109d0155bd tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:49.834347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4e5e89a-108d-4080-ad16-83109d0155bd tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:49.835075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4e5e89a-108d-4080-ad16-83109d0155bd tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:49.835975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4e5e89a-108d-4080-ad16-83109d0155bd tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:50.104487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b4e5e89a-108d-4080-ad16-83109d0155bd tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:50.124664 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b4e5e89a-108d-4080-ad16-83109d0155bd tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1477 microversion: 2.1 time: 0.310320 Oct 10 23:28:50.126936 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1421/2945] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:49 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1477 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:50.522677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0c3a8753-e8e0-4e19-afb8-33ea90f9e2b0 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:50.523409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0c3a8753-e8e0-4e19-afb8-33ea90f9e2b0 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:50.540268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c3a8753-e8e0-4e19-afb8-33ea90f9e2b0 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:50.541927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c3a8753-e8e0-4e19-afb8-33ea90f9e2b0 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:50.547212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c3a8753-e8e0-4e19-afb8-33ea90f9e2b0 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:50.548741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c3a8753-e8e0-4e19-afb8-33ea90f9e2b0 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:50.549699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c3a8753-e8e0-4e19-afb8-33ea90f9e2b0 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:50.550315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c3a8753-e8e0-4e19-afb8-33ea90f9e2b0 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:50.940739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0c3a8753-e8e0-4e19-afb8-33ea90f9e2b0 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:50.958601 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0c3a8753-e8e0-4e19-afb8-33ea90f9e2b0 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1525 microversion: 2.1 time: 0.440692 Oct 10 23:28:50.959200 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1422/2946] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:50 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1525 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:50.977772 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-9a6af8fb-683e-47b2-98e7-8df3bd2d662b req-e28655e2-da1a-499e-83b2-792f83023c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a119bb1-ed77-4246-8201-57fae68e75e4", "name": "network-vif-plugged", "status": "completed", "tag": "3a3f2632-b6c7-4012-8866-15e9790282c0"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:50.993425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9a6af8fb-683e-47b2-98e7-8df3bd2d662b req-e28655e2-da1a-499e-83b2-792f83023c7e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:50.996485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9a6af8fb-683e-47b2-98e7-8df3bd2d662b req-e28655e2-da1a-499e-83b2-792f83023c7e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:50.997910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9a6af8fb-683e-47b2-98e7-8df3bd2d662b req-e28655e2-da1a-499e-83b2-792f83023c7e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:51.023888 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-9a6af8fb-683e-47b2-98e7-8df3bd2d662b req-e28655e2-da1a-499e-83b2-792f83023c7e service nova] Creating event network-vif-plugged:3a3f2632-b6c7-4012-8866-15e9790282c0 for instance 8a119bb1-ed77-4246-8201-57fae68e75e4 on n-h1-860864-2 Oct 10 23:28:51.040717 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-9a6af8fb-683e-47b2-98e7-8df3bd2d662b req-e28655e2-da1a-499e-83b2-792f83023c7e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079545 Oct 10 23:28:51.043479 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1423/2947] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:28:51.056458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-73003ec3-9752-474d-8e6b-4dd26cc8cb65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:51.060440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-73003ec3-9752-474d-8e6b-4dd26cc8cb65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:51.076110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73003ec3-9752-474d-8e6b-4dd26cc8cb65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:51.076675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73003ec3-9752-474d-8e6b-4dd26cc8cb65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:51.080016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73003ec3-9752-474d-8e6b-4dd26cc8cb65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:51.082494 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73003ec3-9752-474d-8e6b-4dd26cc8cb65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:51.084195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73003ec3-9752-474d-8e6b-4dd26cc8cb65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:51.085703 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73003ec3-9752-474d-8e6b-4dd26cc8cb65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:51.500450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-73003ec3-9752-474d-8e6b-4dd26cc8cb65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:51.534772 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-73003ec3-9752-474d-8e6b-4dd26cc8cb65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 0.489248 Oct 10 23:28:51.573358 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1424/2948] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:51 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:51.593629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2ca2f977-ee80-4c5d-8c8e-15fc218b9cf9 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:51.594780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2ca2f977-ee80-4c5d-8c8e-15fc218b9cf9 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:51.611715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ca2f977-ee80-4c5d-8c8e-15fc218b9cf9 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:51.614219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ca2f977-ee80-4c5d-8c8e-15fc218b9cf9 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:51.615696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ca2f977-ee80-4c5d-8c8e-15fc218b9cf9 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:51.616692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ca2f977-ee80-4c5d-8c8e-15fc218b9cf9 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:51.617707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ca2f977-ee80-4c5d-8c8e-15fc218b9cf9 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:51.618358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ca2f977-ee80-4c5d-8c8e-15fc218b9cf9 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:52.040733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2ca2f977-ee80-4c5d-8c8e-15fc218b9cf9 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:52.059920 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2ca2f977-ee80-4c5d-8c8e-15fc218b9cf9 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1477 microversion: 2.1 time: 0.482853 Oct 10 23:28:52.077457 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1425/2949] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:51 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1477 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:52.077457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-05bd1ed3-3a88-4e78-8f0c-b8d48408dc40 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:52.078365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-05bd1ed3-3a88-4e78-8f0c-b8d48408dc40 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:52.094845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05bd1ed3-3a88-4e78-8f0c-b8d48408dc40 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:52.095342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05bd1ed3-3a88-4e78-8f0c-b8d48408dc40 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:52.095777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05bd1ed3-3a88-4e78-8f0c-b8d48408dc40 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:52.100593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05bd1ed3-3a88-4e78-8f0c-b8d48408dc40 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:52.101171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05bd1ed3-3a88-4e78-8f0c-b8d48408dc40 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:52.101701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05bd1ed3-3a88-4e78-8f0c-b8d48408dc40 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:52.988336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-05bd1ed3-3a88-4e78-8f0c-b8d48408dc40 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:52.999218 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-05bd1ed3-3a88-4e78-8f0c-b8d48408dc40 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 200 len: 1525 microversion: 2.1 time: 0.933282 Oct 10 23:28:52.999962 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1426/2950] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:52 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 1525 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:53.027512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ac6a2877-5f09-4cf5-8193-a42a15a1a854 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-888915709", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "2b1923d8-132f-463c-ab01-b78bd4605be8"}], "security_groups": [{"name": "tempest-securitygroup--1615728351"}], "key_name": "tempest-keypair-1312694263", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:53.386045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-ac6a2877-5f09-4cf5-8193-a42a15a1a854 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] validate_networks() for [('2b1923d8-132f-463c-ab01-b78bd4605be8', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:28:55.008024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-8ce9a0e8-5454-4216-9e85-426610c1fb86 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:28:55.008536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-8ce9a0e8-5454-4216-9e85-426610c1fb86 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:28:55.008927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-8ce9a0e8-5454-4216-9e85-426610c1fb86 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:28:55.009741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-8ce9a0e8-5454-4216-9e85-426610c1fb86 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:28:55.010361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-8ce9a0e8-5454-4216-9e85-426610c1fb86 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:28:55.027545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ce9a0e8-5454-4216-9e85-426610c1fb86 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:55.028632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ce9a0e8-5454-4216-9e85-426610c1fb86 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:55.031925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ce9a0e8-5454-4216-9e85-426610c1fb86 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:55.033024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ce9a0e8-5454-4216-9e85-426610c1fb86 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:55.033753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ce9a0e8-5454-4216-9e85-426610c1fb86 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:55.034441 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ce9a0e8-5454-4216-9e85-426610c1fb86 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:55.090643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-8ce9a0e8-5454-4216-9e85-426610c1fb86 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Getting quotas for project 24258516d0894c629fe91d0d0907bc3c. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:28:55.098201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-8ce9a0e8-5454-4216-9e85-426610c1fb86 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Getting quotas for user 05eae0dd45364b3b9d20bf48903e78ca and project 24258516d0894c629fe91d0d0907bc3c. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:28:55.123343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ac6a2877-5f09-4cf5-8193-a42a15a1a854 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Getting quotas for project a89b626b3b5443d3ae614b95df86b60f. Resources: dict_keys(['metadata_items']) {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:28:55.140796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ac6a2877-5f09-4cf5-8193-a42a15a1a854 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Getting quotas for user 9ccc95d3ba2d4250aecf432af338d7b1 and project a89b626b3b5443d3ae614b95df86b60f. Resources: dict_keys(['metadata_items']) {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:28:55.263773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ac6a2877-5f09-4cf5-8193-a42a15a1a854 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:28:55.264575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ac6a2877-5f09-4cf5-8193-a42a15a1a854 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:28:55.265314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ac6a2877-5f09-4cf5-8193-a42a15a1a854 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:28:55.266866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ac6a2877-5f09-4cf5-8193-a42a15a1a854 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:28:55.267755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ac6a2877-5f09-4cf5-8193-a42a15a1a854 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:28:55.333992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac6a2877-5f09-4cf5-8193-a42a15a1a854 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:55.336111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac6a2877-5f09-4cf5-8193-a42a15a1a854 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:55.339144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac6a2877-5f09-4cf5-8193-a42a15a1a854 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:55.341258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac6a2877-5f09-4cf5-8193-a42a15a1a854 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:55.343366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac6a2877-5f09-4cf5-8193-a42a15a1a854 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:55.346005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac6a2877-5f09-4cf5-8193-a42a15a1a854 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:55.412770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ac6a2877-5f09-4cf5-8193-a42a15a1a854 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Getting quotas for project a89b626b3b5443d3ae614b95df86b60f. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:28:55.434639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ac6a2877-5f09-4cf5-8193-a42a15a1a854 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Getting quotas for user 9ccc95d3ba2d4250aecf432af338d7b1 and project a89b626b3b5443d3ae614b95df86b60f. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:28:55.482954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8ce9a0e8-5454-4216-9e85-426610c1fb86 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:28:55.487476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8ce9a0e8-5454-4216-9e85-426610c1fb86 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='43b0c7f9-2cc0-430e-9ab6-f48039d7d335',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='59e3769e-4f25-4197-bd1f-6102e8fcc691',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e079a711-4d45-4098-a891-67892d88f4c7',volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:28:55.491188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ac6a2877-5f09-4cf5-8193-a42a15a1a854 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:28:55.501110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ac6a2877-5f09-4cf5-8193-a42a15a1a854 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:28:55.648252 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ac6a2877-5f09-4cf5-8193-a42a15a1a854 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.626867 Oct 10 23:28:55.649494 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1427/2951] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:28:52 2022] POST /compute/v2.1/servers => generated 409 bytes in 2649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:28:55.658056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-04e67022-2ae7-4b71-b93e-a76a64a68063 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:55.659781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-04e67022-2ae7-4b71-b93e-a76a64a68063 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:55.676282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04e67022-2ae7-4b71-b93e-a76a64a68063 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:55.676791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04e67022-2ae7-4b71-b93e-a76a64a68063 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:55.677930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04e67022-2ae7-4b71-b93e-a76a64a68063 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:55.678667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04e67022-2ae7-4b71-b93e-a76a64a68063 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:55.679203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04e67022-2ae7-4b71-b93e-a76a64a68063 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:55.679643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04e67022-2ae7-4b71-b93e-a76a64a68063 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:56.173942 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8ce9a0e8-5454-4216-9e85-426610c1fb86 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 7.262300 Oct 10 23:28:56.175116 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1525/2952] 10.222.0.23 () {62 vars in 1189 bytes} [Mon Oct 10 23:28:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 7264 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 10 23:28:56.180294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fe45842a-d0dd-4d27-8785-de8bd678e29d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:56.181134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fe45842a-d0dd-4d27-8785-de8bd678e29d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:56.183729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-04e67022-2ae7-4b71-b93e-a76a64a68063 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:56.191674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe45842a-d0dd-4d27-8785-de8bd678e29d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:56.192318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe45842a-d0dd-4d27-8785-de8bd678e29d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:56.192998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe45842a-d0dd-4d27-8785-de8bd678e29d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:56.194105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe45842a-d0dd-4d27-8785-de8bd678e29d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:56.194675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe45842a-d0dd-4d27-8785-de8bd678e29d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:56.195267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe45842a-d0dd-4d27-8785-de8bd678e29d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:56.198561 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-04e67022-2ae7-4b71-b93e-a76a64a68063 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1483 microversion: 2.1 time: 0.546110 Oct 10 23:28:56.199134 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1428/2953] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:55 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1483 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:56.225898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-1ed03dbe-089c-4faa-bea2-5600610ea02b req-45a311f2-38aa-4b78-ad7f-432a384f692a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a119bb1-ed77-4246-8201-57fae68e75e4", "name": "network-vif-unplugged", "status": "completed", "tag": "3a3f2632-b6c7-4012-8866-15e9790282c0"}, {"server_uuid": "a3d268c6-2b9d-4858-b67f-1dced7831838", "name": "network-vif-plugged", "status": "completed", "tag": "3a4df9ab-2215-474a-bffb-e5b388a62d2d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:56.269035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1ed03dbe-089c-4faa-bea2-5600610ea02b req-45a311f2-38aa-4b78-ad7f-432a384f692a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:56.271561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1ed03dbe-089c-4faa-bea2-5600610ea02b req-45a311f2-38aa-4b78-ad7f-432a384f692a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:56.273005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1ed03dbe-089c-4faa-bea2-5600610ea02b req-45a311f2-38aa-4b78-ad7f-432a384f692a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:56.318255 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-1ed03dbe-089c-4faa-bea2-5600610ea02b req-45a311f2-38aa-4b78-ad7f-432a384f692a service nova] Creating event network-vif-unplugged:3a3f2632-b6c7-4012-8866-15e9790282c0 for instance 8a119bb1-ed77-4246-8201-57fae68e75e4 on n-h1-860864-2 Oct 10 23:28:56.320887 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-1ed03dbe-089c-4faa-bea2-5600610ea02b req-45a311f2-38aa-4b78-ad7f-432a384f692a service nova] Creating event network-vif-plugged:3a4df9ab-2215-474a-bffb-e5b388a62d2d for instance a3d268c6-2b9d-4858-b67f-1dced7831838 on n-h2-860864-2 Oct 10 23:28:56.349437 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-1ed03dbe-089c-4faa-bea2-5600610ea02b req-45a311f2-38aa-4b78-ad7f-432a384f692a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.132417 Oct 10 23:28:56.353187 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1429/2954] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:28:56.380713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3414cc8f-5a61-4fa2-9675-641b8fdedfd9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:56.383873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3414cc8f-5a61-4fa2-9675-641b8fdedfd9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:56.410324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3414cc8f-5a61-4fa2-9675-641b8fdedfd9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:56.410906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3414cc8f-5a61-4fa2-9675-641b8fdedfd9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:56.411293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3414cc8f-5a61-4fa2-9675-641b8fdedfd9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:56.415002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3414cc8f-5a61-4fa2-9675-641b8fdedfd9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:56.415491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3414cc8f-5a61-4fa2-9675-641b8fdedfd9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:56.415933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3414cc8f-5a61-4fa2-9675-641b8fdedfd9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:56.459941 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-3414cc8f-5a61-4fa2-9675-641b8fdedfd9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] HTTP exception thrown: Instance 8a119bb1-ed77-4246-8201-57fae68e75e4 could not be found. Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3414cc8f-5a61-4fa2-9675-641b8fdedfd9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Request method failure captured: Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 HTTP/1.1 Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKqJK3S3M2y3xprSZu9nbIarteybsMmlwBqzRadb_OvHrQS6zpz1qbhvGoRjPx1Bkq7rq6URwLI94Tf5sgLizi8MbWTsTS0dzR4a-9d6hn6BO9F5izkVX7qoGeFLYfTljzByP6rv99qdRHR7pF3ZU2UC3x7LIdHCYY6YUpc6lCdMgm4 Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a1c4489c308e462d89b97edcf6c21572", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: f891fce5072c448c97f96a9df58d981e Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 8a119bb1-ed77-4246-8201-57fae68e75e4 could not be found. Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '8a119bb1-ed77-4246-8201-57fae68e75e4'} Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a119bb1-ed77-4246-8201-57fae68e75e4 could not be found. Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a119bb1-ed77-4246-8201-57fae68e75e4 could not be found. Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:56.464531 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:28:56.469792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:56.469792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:28:56.469792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:28:56.469792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:28:56.469792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:28:56.469792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:28:56.469792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a119bb1-ed77-4246-8201-57fae68e75e4 could not be found. Oct 10 23:28:56.469792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:28:56.469792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3414cc8f-5a61-4fa2-9675-641b8fdedfd9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Returning 404 to user: Instance 8a119bb1-ed77-4246-8201-57fae68e75e4 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:28:56.469792 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3414cc8f-5a61-4fa2-9675-641b8fdedfd9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 404 len: 111 microversion: 2.1 time: 0.096433 Oct 10 23:28:56.470970 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1430/2955] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:56 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:28:56.478610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-c9fa143e-4124-4dc4-8b5a-da0bac2b6226 req-2552b430-7b39-4853-8ebc-d2ed52b8f341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a119bb1-ed77-4246-8201-57fae68e75e4", "name": "network-vif-deleted", "tag": "3a3f2632-b6c7-4012-8866-15e9790282c0"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:56.515610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c9fa143e-4124-4dc4-8b5a-da0bac2b6226 req-2552b430-7b39-4853-8ebc-d2ed52b8f341 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:56.516252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c9fa143e-4124-4dc4-8b5a-da0bac2b6226 req-2552b430-7b39-4853-8ebc-d2ed52b8f341 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:56.518440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c9fa143e-4124-4dc4-8b5a-da0bac2b6226 req-2552b430-7b39-4853-8ebc-d2ed52b8f341 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:56.552702 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-c9fa143e-4124-4dc4-8b5a-da0bac2b6226 req-2552b430-7b39-4853-8ebc-d2ed52b8f341 service nova] Creating event network-vif-deleted:3a3f2632-b6c7-4012-8866-15e9790282c0 for instance 8a119bb1-ed77-4246-8201-57fae68e75e4 on n-h1-860864-2 Oct 10 23:28:56.571460 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-c9fa143e-4124-4dc4-8b5a-da0bac2b6226 req-2552b430-7b39-4853-8ebc-d2ed52b8f341 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099434 Oct 10 23:28:56.574659 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1431/2956] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:28:56.594923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-231b9691-3cb3-47cd-a31c-3b8631409375 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:56.597605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-231b9691-3cb3-47cd-a31c-3b8631409375 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:56.615833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fe45842a-d0dd-4d27-8785-de8bd678e29d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:56.632688 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fe45842a-d0dd-4d27-8785-de8bd678e29d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1477 microversion: 2.1 time: 0.456375 Oct 10 23:28:56.637787 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1526/2957] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:56 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1477 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:56.660331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-83728d40-24a8-43fc-8089-ca58e2db9ddf tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:56.661318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-83728d40-24a8-43fc-8089-ca58e2db9ddf tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:56.795202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-83728d40-24a8-43fc-8089-ca58e2db9ddf tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:56.805073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-83728d40-24a8-43fc-8089-ca58e2db9ddf tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:56.813315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-83728d40-24a8-43fc-8089-ca58e2db9ddf tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:56.814799 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-83728d40-24a8-43fc-8089-ca58e2db9ddf tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1283 microversion: 2.32 time: 0.175207 Oct 10 23:28:56.821139 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1527/2958] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:28:56 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1283 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:28:56.836922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e0aa003d-ca6b-4857-8cbb-fa8071a54c65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:56.838053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e0aa003d-ca6b-4857-8cbb-fa8071a54c65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:56.861914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0aa003d-ca6b-4857-8cbb-fa8071a54c65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:56.865011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0aa003d-ca6b-4857-8cbb-fa8071a54c65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:56.865698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0aa003d-ca6b-4857-8cbb-fa8071a54c65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:56.866602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0aa003d-ca6b-4857-8cbb-fa8071a54c65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:56.869312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0aa003d-ca6b-4857-8cbb-fa8071a54c65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:56.870408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0aa003d-ca6b-4857-8cbb-fa8071a54c65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:57.084353 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e0aa003d-ca6b-4857-8cbb-fa8071a54c65 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "POST /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091/action" status: 202 len: 0 microversion: 2.1 time: 0.261457 Oct 10 23:28:57.085317 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1528/2959] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:28:56 2022] POST /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:28:57.127492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-51734605-7066-4c0a-bd5a-a3ee2da4330b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Action: 'create', calling method: .version_select at 0x7f662b843550>, body: {"keypair": {"name": "tempest-keypair-909384165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9xUJkAOA9MGgWA5fcmLSFoLhzI8VNuPKIcRugMMBQI6QLYFH7bDQcj6uiRXMfmumjDBcXPiCvW3Xuy4XuArPvGmqSBZyGQ0z8wCu+R6sLwjFf05bL6aNI2Xp0ZLV3MMA=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:28:57.210460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-51734605-7066-4c0a-bd5a-a3ee2da4330b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Getting quotas for project a1c4489c308e462d89b97edcf6c21572. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:28:57.229103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-51734605-7066-4c0a-bd5a-a3ee2da4330b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Getting quotas for user f891fce5072c448c97f96a9df58d981e and project a1c4489c308e462d89b97edcf6c21572. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:28:57.244159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-231b9691-3cb3-47cd-a31c-3b8631409375 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:57.257455 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-231b9691-3cb3-47cd-a31c-3b8631409375 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1277 microversion: 2.1 time: 0.677441 Oct 10 23:28:57.258463 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1432/2960] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:56 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1277 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:57.265712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-faee29ce-18d5-4959-8429-d11458fd5d19 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:57.266345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-faee29ce-18d5-4959-8429-d11458fd5d19 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:57.290612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faee29ce-18d5-4959-8429-d11458fd5d19 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:57.291118 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faee29ce-18d5-4959-8429-d11458fd5d19 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:57.291626 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faee29ce-18d5-4959-8429-d11458fd5d19 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:57.292348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faee29ce-18d5-4959-8429-d11458fd5d19 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:57.292806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faee29ce-18d5-4959-8429-d11458fd5d19 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:57.297708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faee29ce-18d5-4959-8429-d11458fd5d19 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:57.345648 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-51734605-7066-4c0a-bd5a-a3ee2da4330b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.258707 Oct 10 23:28:57.346389 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1529/2961] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:28:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:28:57.662708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c504113c-c622-4c59-b157-4915ba4f74f5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:57.664735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c504113c-c622-4c59-b157-4915ba4f74f5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:57.708088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c504113c-c622-4c59-b157-4915ba4f74f5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:57.712358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c504113c-c622-4c59-b157-4915ba4f74f5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:57.713879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c504113c-c622-4c59-b157-4915ba4f74f5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:57.716220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c504113c-c622-4c59-b157-4915ba4f74f5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:57.719190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c504113c-c622-4c59-b157-4915ba4f74f5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:57.720156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c504113c-c622-4c59-b157-4915ba4f74f5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:58.049902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c504113c-c622-4c59-b157-4915ba4f74f5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:58.059814 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c504113c-c622-4c59-b157-4915ba4f74f5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1477 microversion: 2.1 time: 0.403276 Oct 10 23:28:58.060580 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1530/2962] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:57 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1477 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:58.096992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-38b596ad-19b7-4e81-acb4-28b459b0627d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:58.097671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-38b596ad-19b7-4e81-acb4-28b459b0627d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:58.276019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-38b596ad-19b7-4e81-acb4-28b459b0627d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:58.300010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-38b596ad-19b7-4e81-acb4-28b459b0627d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:58.301786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-38b596ad-19b7-4e81-acb4-28b459b0627d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:58.303168 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-38b596ad-19b7-4e81-acb4-28b459b0627d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1283 microversion: 2.32 time: 0.211786 Oct 10 23:28:58.323177 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1531/2963] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:28:58 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1283 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:28:58.328935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d16a300c-7604-4c63-a3db-a3994e748eb6 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:58.329813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d16a300c-7604-4c63-a3db-a3994e748eb6 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:58.341308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d16a300c-7604-4c63-a3db-a3994e748eb6 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:58.342983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d16a300c-7604-4c63-a3db-a3994e748eb6 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:58.347162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d16a300c-7604-4c63-a3db-a3994e748eb6 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:58.348876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d16a300c-7604-4c63-a3db-a3994e748eb6 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:58.349791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d16a300c-7604-4c63-a3db-a3994e748eb6 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:58.350390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d16a300c-7604-4c63-a3db-a3994e748eb6 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:58.405779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-faee29ce-18d5-4959-8429-d11458fd5d19 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:58.427815 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-faee29ce-18d5-4959-8429-d11458fd5d19 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1491 microversion: 2.1 time: 1.165049 Oct 10 23:28:58.430586 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1433/2964] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:57 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1491 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:58.514495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d16a300c-7604-4c63-a3db-a3994e748eb6 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:58.530073 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d16a300c-7604-4c63-a3db-a3994e748eb6 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1337 microversion: 2.1 time: 0.198443 Oct 10 23:28:58.531182 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1532/2965] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:58 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1337 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:59.085271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e59dc599-2989-4837-bcdc-27c9c753b40d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:59.086857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e59dc599-2989-4837-bcdc-27c9c753b40d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:59.100701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e59dc599-2989-4837-bcdc-27c9c753b40d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:59.101238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e59dc599-2989-4837-bcdc-27c9c753b40d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:59.103733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e59dc599-2989-4837-bcdc-27c9c753b40d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:59.105255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e59dc599-2989-4837-bcdc-27c9c753b40d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:59.109609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e59dc599-2989-4837-bcdc-27c9c753b40d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:59.110727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e59dc599-2989-4837-bcdc-27c9c753b40d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:59.335341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d0c47267-a0be-42dd-8449-27cd10c289db tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:59.336766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d0c47267-a0be-42dd-8449-27cd10c289db tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:59.361938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0c47267-a0be-42dd-8449-27cd10c289db tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:59.362149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0c47267-a0be-42dd-8449-27cd10c289db tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:59.362575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0c47267-a0be-42dd-8449-27cd10c289db tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:59.363545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0c47267-a0be-42dd-8449-27cd10c289db tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:59.364186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0c47267-a0be-42dd-8449-27cd10c289db tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:59.364769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0c47267-a0be-42dd-8449-27cd10c289db tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:59.624703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d0c47267-a0be-42dd-8449-27cd10c289db tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:59.640990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d0c47267-a0be-42dd-8449-27cd10c289db tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:59.642529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d0c47267-a0be-42dd-8449-27cd10c289db tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:59.643757 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d0c47267-a0be-42dd-8449-27cd10c289db tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1573 microversion: 2.32 time: 0.316188 Oct 10 23:28:59.653444 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1533/2966] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:28:59 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1573 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:28:59.658690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e26b15ec-0735-4dd3-95f0-dfabb3b42aec tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:59.659601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e26b15ec-0735-4dd3-95f0-dfabb3b42aec tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:59.672298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e26b15ec-0735-4dd3-95f0-dfabb3b42aec tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:59.677631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e26b15ec-0735-4dd3-95f0-dfabb3b42aec tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:59.678393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e26b15ec-0735-4dd3-95f0-dfabb3b42aec tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:59.679529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e26b15ec-0735-4dd3-95f0-dfabb3b42aec tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:59.686159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e26b15ec-0735-4dd3-95f0-dfabb3b42aec tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:59.686925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e26b15ec-0735-4dd3-95f0-dfabb3b42aec tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:59.696829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e59dc599-2989-4837-bcdc-27c9c753b40d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:59.724611 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e59dc599-2989-4837-bcdc-27c9c753b40d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1477 microversion: 2.1 time: 0.639958 Oct 10 23:28:59.726030 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1434/2967] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:59 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1477 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:28:59.737898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-de4ddc3b-67fd-4eef-924f-4ae4ccfe1a7f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:28:59.739277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-de4ddc3b-67fd-4eef-924f-4ae4ccfe1a7f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:28:59.755540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de4ddc3b-67fd-4eef-924f-4ae4ccfe1a7f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:59.758382 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de4ddc3b-67fd-4eef-924f-4ae4ccfe1a7f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:59.762671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de4ddc3b-67fd-4eef-924f-4ae4ccfe1a7f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:59.763372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de4ddc3b-67fd-4eef-924f-4ae4ccfe1a7f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:28:59.764014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de4ddc3b-67fd-4eef-924f-4ae4ccfe1a7f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:28:59.768128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de4ddc3b-67fd-4eef-924f-4ae4ccfe1a7f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:28:59.827142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:28:59.918613 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-de4ddc3b-67fd-4eef-924f-4ae4ccfe1a7f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:28:59.929221 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-de4ddc3b-67fd-4eef-924f-4ae4ccfe1a7f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1335 microversion: 2.1 time: 0.201544 Oct 10 23:28:59.936316 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1435/2968] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:59 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1335 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:00.227448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e26b15ec-0735-4dd3-95f0-dfabb3b42aec tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:00.240587 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e26b15ec-0735-4dd3-95f0-dfabb3b42aec tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1491 microversion: 2.1 time: 0.585500 Oct 10 23:29:00.245766 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1534/2969] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:28:59 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1491 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:00.679825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bdfc21b9-eede-413e-83f3-b2a5e3cb06de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:00.680711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bdfc21b9-eede-413e-83f3-b2a5e3cb06de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:00.698892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdfc21b9-eede-413e-83f3-b2a5e3cb06de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:00.700112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdfc21b9-eede-413e-83f3-b2a5e3cb06de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:00.700739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdfc21b9-eede-413e-83f3-b2a5e3cb06de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:00.702184 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdfc21b9-eede-413e-83f3-b2a5e3cb06de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:00.702821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdfc21b9-eede-413e-83f3-b2a5e3cb06de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:00.703692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdfc21b9-eede-413e-83f3-b2a5e3cb06de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:00.753800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-328b7f5c-0721-4bbc-831c-e61835090197 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:00.755294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-328b7f5c-0721-4bbc-831c-e61835090197 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:00.769157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-328b7f5c-0721-4bbc-831c-e61835090197 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:00.771590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-328b7f5c-0721-4bbc-831c-e61835090197 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:00.774597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-328b7f5c-0721-4bbc-831c-e61835090197 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:00.776393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-328b7f5c-0721-4bbc-831c-e61835090197 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:00.782965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-328b7f5c-0721-4bbc-831c-e61835090197 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:00.784753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-328b7f5c-0721-4bbc-831c-e61835090197 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:00.914958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bdfc21b9-eede-413e-83f3-b2a5e3cb06de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:00.931143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bdfc21b9-eede-413e-83f3-b2a5e3cb06de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:00.933224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bdfc21b9-eede-413e-83f3-b2a5e3cb06de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:00.936236 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bdfc21b9-eede-413e-83f3-b2a5e3cb06de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1591 microversion: 2.32 time: 0.260477 Oct 10 23:29:00.937903 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1436/2970] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:00 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1591 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:00.971175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2a22adcd-3cff-4798-9fe3-2a8a42f420b7 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:00.972870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2a22adcd-3cff-4798-9fe3-2a8a42f420b7 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:00.988546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a22adcd-3cff-4798-9fe3-2a8a42f420b7 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:00.990304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a22adcd-3cff-4798-9fe3-2a8a42f420b7 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:00.995559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a22adcd-3cff-4798-9fe3-2a8a42f420b7 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:00.997888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a22adcd-3cff-4798-9fe3-2a8a42f420b7 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:01.000682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a22adcd-3cff-4798-9fe3-2a8a42f420b7 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:01.001946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a22adcd-3cff-4798-9fe3-2a8a42f420b7 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:01.083457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-328b7f5c-0721-4bbc-831c-e61835090197 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:01.096463 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-328b7f5c-0721-4bbc-831c-e61835090197 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1463 microversion: 2.1 time: 0.346038 Oct 10 23:29:01.100934 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1535/2971] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:00 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1463 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:01.112014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6e6a3b32-8ddc-4723-bb7d-a0b20b664c8d tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:01.117150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6e6a3b32-8ddc-4723-bb7d-a0b20b664c8d tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:01.143796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e6a3b32-8ddc-4723-bb7d-a0b20b664c8d tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:01.145205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e6a3b32-8ddc-4723-bb7d-a0b20b664c8d tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:01.145928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e6a3b32-8ddc-4723-bb7d-a0b20b664c8d tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:01.147676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e6a3b32-8ddc-4723-bb7d-a0b20b664c8d tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:01.152322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e6a3b32-8ddc-4723-bb7d-a0b20b664c8d tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:01.154705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e6a3b32-8ddc-4723-bb7d-a0b20b664c8d tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:01.254301 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6e6a3b32-8ddc-4723-bb7d-a0b20b664c8d tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.142986 Oct 10 23:29:01.255164 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1536/2972] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:29:01 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-volume_attachments => generated 371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:01.262407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e1444be6-c40e-4ac2-a2b0-63b411978872 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:01.268565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e1444be6-c40e-4ac2-a2b0-63b411978872 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:01.285748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1444be6-c40e-4ac2-a2b0-63b411978872 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:01.286449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1444be6-c40e-4ac2-a2b0-63b411978872 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:01.287056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1444be6-c40e-4ac2-a2b0-63b411978872 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:01.287947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1444be6-c40e-4ac2-a2b0-63b411978872 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:01.288617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1444be6-c40e-4ac2-a2b0-63b411978872 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:01.289229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1444be6-c40e-4ac2-a2b0-63b411978872 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:01.486570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2a22adcd-3cff-4798-9fe3-2a8a42f420b7 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:01.497083 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2a22adcd-3cff-4798-9fe3-2a8a42f420b7 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1403 microversion: 2.1 time: 0.535631 Oct 10 23:29:01.510921 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1437/2973] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:00 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1403 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:01.520242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d8a5c9bf-4102-453c-a118-f69ff414038f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:01.523974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d8a5c9bf-4102-453c-a118-f69ff414038f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:01.531419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e1444be6-c40e-4ac2-a2b0-63b411978872 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:01.540207 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e1444be6-c40e-4ac2-a2b0-63b411978872 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1463 microversion: 2.1 time: 0.283679 Oct 10 23:29:01.540804 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1537/2974] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:01 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1463 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:01.549004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2586b06d-80f3-4012-810c-67f26e48392a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:01.549737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2586b06d-80f3-4012-810c-67f26e48392a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:01.556405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2586b06d-80f3-4012-810c-67f26e48392a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:01.557285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2586b06d-80f3-4012-810c-67f26e48392a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:01.557749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8a5c9bf-4102-453c-a118-f69ff414038f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:01.558298 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8a5c9bf-4102-453c-a118-f69ff414038f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:01.558474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2586b06d-80f3-4012-810c-67f26e48392a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:01.558872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8a5c9bf-4102-453c-a118-f69ff414038f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:01.562643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2586b06d-80f3-4012-810c-67f26e48392a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:01.563536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2586b06d-80f3-4012-810c-67f26e48392a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:01.564333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8a5c9bf-4102-453c-a118-f69ff414038f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:01.564714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2586b06d-80f3-4012-810c-67f26e48392a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:01.564942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8a5c9bf-4102-453c-a118-f69ff414038f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:01.565496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8a5c9bf-4102-453c-a118-f69ff414038f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:01.612125 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2586b06d-80f3-4012-810c-67f26e48392a tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-volume_attachments/89f3878c-1155-4056-a83d-749a443dca23" status: 200 len: 194 microversion: 2.1 time: 0.067637 Oct 10 23:29:01.612751 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1538/2975] 10.222.0.23 () {58 vars in 1413 bytes} [Mon Oct 10 23:29:01 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-volume_attachments/89f3878c-1155-4056-a83d-749a443dca23 => generated 194 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:01.618360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-42fc43e9-eec7-46d1-a47e-2cefc10bc067 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:01.621547 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-42fc43e9-eec7-46d1-a47e-2cefc10bc067 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:01.630548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42fc43e9-eec7-46d1-a47e-2cefc10bc067 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:01.631464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42fc43e9-eec7-46d1-a47e-2cefc10bc067 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:01.632131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42fc43e9-eec7-46d1-a47e-2cefc10bc067 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:01.633082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42fc43e9-eec7-46d1-a47e-2cefc10bc067 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:01.634428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42fc43e9-eec7-46d1-a47e-2cefc10bc067 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:01.635091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42fc43e9-eec7-46d1-a47e-2cefc10bc067 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:01.743926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-42fc43e9-eec7-46d1-a47e-2cefc10bc067 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:29:01.744641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-42fc43e9-eec7-46d1-a47e-2cefc10bc067 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:29:01.745247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-42fc43e9-eec7-46d1-a47e-2cefc10bc067 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:29:01.745852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-42fc43e9-eec7-46d1-a47e-2cefc10bc067 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:29:01.746385 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-42fc43e9-eec7-46d1-a47e-2cefc10bc067 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:29:01.842762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-42fc43e9-eec7-46d1-a47e-2cefc10bc067 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:01.861699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42fc43e9-eec7-46d1-a47e-2cefc10bc067 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:01.863901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42fc43e9-eec7-46d1-a47e-2cefc10bc067 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:01.864531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42fc43e9-eec7-46d1-a47e-2cefc10bc067 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:01.865766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42fc43e9-eec7-46d1-a47e-2cefc10bc067 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:01.868413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42fc43e9-eec7-46d1-a47e-2cefc10bc067 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:01.869974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42fc43e9-eec7-46d1-a47e-2cefc10bc067 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:01.991111 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-42fc43e9-eec7-46d1-a47e-2cefc10bc067 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "POST /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838/action" status: 202 len: 1067 microversion: 2.1 time: 0.350265 Oct 10 23:29:01.995639 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1539/2976] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:29:01 2022] POST /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838/action => generated 1067 bytes in 381 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 10 23:29:02.019946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-13b50b2c-0ad3-4c4b-a3a2-9ec4967661e5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-563706808", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:02.064710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d8a5c9bf-4102-453c-a118-f69ff414038f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:02.073220 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d8a5c9bf-4102-453c-a118-f69ff414038f tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1491 microversion: 2.1 time: 0.560968 Oct 10 23:29:02.079378 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1438/2977] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:01 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1491 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:02.098075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c043824c-9194-4f0f-96a2-2a77c7f71c79 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:02.098988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c043824c-9194-4f0f-96a2-2a77c7f71c79 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:02.107349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c043824c-9194-4f0f-96a2-2a77c7f71c79 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:02.109602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c043824c-9194-4f0f-96a2-2a77c7f71c79 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:02.110325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c043824c-9194-4f0f-96a2-2a77c7f71c79 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:02.113970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c043824c-9194-4f0f-96a2-2a77c7f71c79 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:02.114655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c043824c-9194-4f0f-96a2-2a77c7f71c79 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:02.115291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c043824c-9194-4f0f-96a2-2a77c7f71c79 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:02.123310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-13b50b2c-0ad3-4c4b-a3a2-9ec4967661e5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] validate_networks() for [('d912709d-3fc5-45c5-ac6c-3212feff08e0', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:29:02.265323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-c043824c-9194-4f0f-96a2-2a77c7f71c79 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lazy-loading 'services' on Instance uuid 92e9f63c-d49b-4a32-80b8-b729b8530379 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:29:02.408496 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c043824c-9194-4f0f-96a2-2a77c7f71c79 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "DELETE /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-volume_attachments/89f3878c-1155-4056-a83d-749a443dca23" status: 202 len: 0 microversion: 2.1 time: 0.327499 Oct 10 23:29:02.417759 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1439/2978] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Oct 10 23:29:02 2022] DELETE /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-volume_attachments/89f3878c-1155-4056-a83d-749a443dca23 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:29:02.446499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a356e0f4-432a-4600-a247-46ebf717d0f3 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:02.448428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a356e0f4-432a-4600-a247-46ebf717d0f3 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:02.463971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:02.468178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a356e0f4-432a-4600-a247-46ebf717d0f3 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:02.471234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a356e0f4-432a-4600-a247-46ebf717d0f3 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:02.471603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a356e0f4-432a-4600-a247-46ebf717d0f3 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:02.472368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a356e0f4-432a-4600-a247-46ebf717d0f3 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:02.475054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a356e0f4-432a-4600-a247-46ebf717d0f3 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:02.475535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a356e0f4-432a-4600-a247-46ebf717d0f3 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:03.199187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a356e0f4-432a-4600-a247-46ebf717d0f3 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:03.216873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a356e0f4-432a-4600-a247-46ebf717d0f3 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:03.221971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a356e0f4-432a-4600-a247-46ebf717d0f3 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:03.226191 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a356e0f4-432a-4600-a247-46ebf717d0f3 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1591 microversion: 2.32 time: 0.806715 Oct 10 23:29:03.226880 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1440/2979] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:02 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1591 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:03.242990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f4a41bcd-569f-4ec4-b540-9b551a343a46 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:03.245430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f4a41bcd-569f-4ec4-b540-9b551a343a46 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:03.257740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-13b50b2c-0ad3-4c4b-a3a2-9ec4967661e5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:29:03.258303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-13b50b2c-0ad3-4c4b-a3a2-9ec4967661e5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:29:03.258893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-13b50b2c-0ad3-4c4b-a3a2-9ec4967661e5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:29:03.259561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-13b50b2c-0ad3-4c4b-a3a2-9ec4967661e5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:29:03.260198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-13b50b2c-0ad3-4c4b-a3a2-9ec4967661e5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:29:03.261552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4a41bcd-569f-4ec4-b540-9b551a343a46 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:03.264421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4a41bcd-569f-4ec4-b540-9b551a343a46 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:03.264726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:03.265291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4a41bcd-569f-4ec4-b540-9b551a343a46 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:03.266296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4a41bcd-569f-4ec4-b540-9b551a343a46 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:03.270392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4a41bcd-569f-4ec4-b540-9b551a343a46 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:03.271554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4a41bcd-569f-4ec4-b540-9b551a343a46 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:03.282917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13b50b2c-0ad3-4c4b-a3a2-9ec4967661e5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:03.286119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13b50b2c-0ad3-4c4b-a3a2-9ec4967661e5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:03.290913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13b50b2c-0ad3-4c4b-a3a2-9ec4967661e5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:03.291878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13b50b2c-0ad3-4c4b-a3a2-9ec4967661e5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:03.292466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13b50b2c-0ad3-4c4b-a3a2-9ec4967661e5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:03.293175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13b50b2c-0ad3-4c4b-a3a2-9ec4967661e5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:03.336868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-13b50b2c-0ad3-4c4b-a3a2-9ec4967661e5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Getting quotas for project a1c4489c308e462d89b97edcf6c21572. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:29:03.344722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-13b50b2c-0ad3-4c4b-a3a2-9ec4967661e5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Getting quotas for user f891fce5072c448c97f96a9df58d981e and project a1c4489c308e462d89b97edcf6c21572. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:29:03.367622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-13b50b2c-0ad3-4c4b-a3a2-9ec4967661e5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:29:03.391539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-13b50b2c-0ad3-4c4b-a3a2-9ec4967661e5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 532ff31c-bdc2-44d4-8e95-328263ebc63f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:29:03.484890 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-13b50b2c-0ad3-4c4b-a3a2-9ec4967661e5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.487659 Oct 10 23:29:03.492554 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1540/2980] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:29:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 1496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:29:03.520292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-84c4cd5c-e284-43e6-901a-939be8871d86 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:03.530732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-84c4cd5c-e284-43e6-901a-939be8871d86 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:03.545873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84c4cd5c-e284-43e6-901a-939be8871d86 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:03.546769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84c4cd5c-e284-43e6-901a-939be8871d86 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:03.547456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84c4cd5c-e284-43e6-901a-939be8871d86 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:03.550319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84c4cd5c-e284-43e6-901a-939be8871d86 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:03.551037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84c4cd5c-e284-43e6-901a-939be8871d86 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:03.552955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84c4cd5c-e284-43e6-901a-939be8871d86 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:03.594856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:04.141662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f4a41bcd-569f-4ec4-b540-9b551a343a46 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:04.161921 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f4a41bcd-569f-4ec4-b540-9b551a343a46 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1472 microversion: 2.1 time: 0.932211 Oct 10 23:29:04.164249 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1441/2981] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:03 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1472 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:04.186342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1bf2b767-f6b9-4570-9882-e677a60286af tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:04.187405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1bf2b767-f6b9-4570-9882-e677a60286af tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:04.203129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bf2b767-f6b9-4570-9882-e677a60286af tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:04.205875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bf2b767-f6b9-4570-9882-e677a60286af tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:04.206511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bf2b767-f6b9-4570-9882-e677a60286af tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:04.221363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bf2b767-f6b9-4570-9882-e677a60286af tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:04.221960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bf2b767-f6b9-4570-9882-e677a60286af tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:04.222413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bf2b767-f6b9-4570-9882-e677a60286af tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:04.809660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-84c4cd5c-e284-43e6-901a-939be8871d86 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:04.827831 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-84c4cd5c-e284-43e6-901a-939be8871d86 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1403 microversion: 2.1 time: 1.327175 Oct 10 23:29:04.828867 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1541/2982] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:03 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1403 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:04.865081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e21e3958-3d69-4f89-a566-fc5db87e82c5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:04.865796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e21e3958-3d69-4f89-a566-fc5db87e82c5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 532ff31c-bdc2-44d4-8e95-328263ebc63f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:04.895626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e21e3958-3d69-4f89-a566-fc5db87e82c5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:04.897507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e21e3958-3d69-4f89-a566-fc5db87e82c5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:04.897982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e21e3958-3d69-4f89-a566-fc5db87e82c5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:04.900727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e21e3958-3d69-4f89-a566-fc5db87e82c5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:04.901280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e21e3958-3d69-4f89-a566-fc5db87e82c5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:04.910735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e21e3958-3d69-4f89-a566-fc5db87e82c5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:05.082333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e21e3958-3d69-4f89-a566-fc5db87e82c5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:05.096656 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e21e3958-3d69-4f89-a566-fc5db87e82c5 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f" status: 200 len: 1220 microversion: 2.1 time: 0.266598 Oct 10 23:29:05.104455 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1542/2983] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:04 2022] GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f => generated 1220 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:05.115450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-92519cee-d2ed-466e-9936-9763a823bd6b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:05.118233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-92519cee-d2ed-466e-9936-9763a823bd6b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:05.136541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92519cee-d2ed-466e-9936-9763a823bd6b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:05.142170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92519cee-d2ed-466e-9936-9763a823bd6b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:05.142901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92519cee-d2ed-466e-9936-9763a823bd6b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:05.143884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92519cee-d2ed-466e-9936-9763a823bd6b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:05.144955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92519cee-d2ed-466e-9936-9763a823bd6b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:05.145639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-92519cee-d2ed-466e-9936-9763a823bd6b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:05.165100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1bf2b767-f6b9-4570-9882-e677a60286af tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:05.188966 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1bf2b767-f6b9-4570-9882-e677a60286af tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1497 microversion: 2.1 time: 1.019684 Oct 10 23:29:05.189671 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1442/2984] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:04 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1497 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:05.232961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-241a9458-0f7a-464b-ae08-b65ca79a5d1c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:05.234883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-241a9458-0f7a-464b-ae08-b65ca79a5d1c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:05.252597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-241a9458-0f7a-464b-ae08-b65ca79a5d1c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:05.253451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-241a9458-0f7a-464b-ae08-b65ca79a5d1c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:05.254097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-241a9458-0f7a-464b-ae08-b65ca79a5d1c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:05.259085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-241a9458-0f7a-464b-ae08-b65ca79a5d1c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:05.259943 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-241a9458-0f7a-464b-ae08-b65ca79a5d1c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:05.260560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-241a9458-0f7a-464b-ae08-b65ca79a5d1c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:05.378012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:05.569425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-92519cee-d2ed-466e-9936-9763a823bd6b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:05.586362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-92519cee-d2ed-466e-9936-9763a823bd6b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:05.588032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-92519cee-d2ed-466e-9936-9763a823bd6b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:05.589250 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-92519cee-d2ed-466e-9936-9763a823bd6b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1659 microversion: 2.32 time: 0.483515 Oct 10 23:29:05.590912 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1543/2985] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:05 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1659 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:05.597963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d40ddce7-772a-4668-9d6f-6b2c16772d07 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:05.598842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d40ddce7-772a-4668-9d6f-6b2c16772d07 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:05.606278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d40ddce7-772a-4668-9d6f-6b2c16772d07 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:05.611482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d40ddce7-772a-4668-9d6f-6b2c16772d07 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:05.613204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d40ddce7-772a-4668-9d6f-6b2c16772d07 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:05.614295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d40ddce7-772a-4668-9d6f-6b2c16772d07 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:05.615128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d40ddce7-772a-4668-9d6f-6b2c16772d07 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:05.617280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d40ddce7-772a-4668-9d6f-6b2c16772d07 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:05.679941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d40ddce7-772a-4668-9d6f-6b2c16772d07 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:29:05.915368 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d40ddce7-772a-4668-9d6f-6b2c16772d07 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 204 len: 0 microversion: 2.1 time: 0.320323 Oct 10 23:29:05.917267 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1544/2986] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:29:05 2022] DELETE /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:29:05.926255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-95600f8e-b283-4ff8-8a6b-939d5406a7e4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:05.927466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-95600f8e-b283-4ff8-8a6b-939d5406a7e4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:05.936546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95600f8e-b283-4ff8-8a6b-939d5406a7e4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:05.937365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95600f8e-b283-4ff8-8a6b-939d5406a7e4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:05.937976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95600f8e-b283-4ff8-8a6b-939d5406a7e4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:05.939006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95600f8e-b283-4ff8-8a6b-939d5406a7e4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:05.939607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95600f8e-b283-4ff8-8a6b-939d5406a7e4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:05.940249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95600f8e-b283-4ff8-8a6b-939d5406a7e4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:06.128088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-241a9458-0f7a-464b-ae08-b65ca79a5d1c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:06.143010 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-241a9458-0f7a-464b-ae08-b65ca79a5d1c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1472 microversion: 2.1 time: 0.912219 Oct 10 23:29:06.146484 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1443/2987] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:05 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1472 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:06.163275 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-52bb5c66-babc-4a6e-8c30-aabe32010113 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:06.164757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-52bb5c66-babc-4a6e-8c30-aabe32010113 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:06.184248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52bb5c66-babc-4a6e-8c30-aabe32010113 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:06.195546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52bb5c66-babc-4a6e-8c30-aabe32010113 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:06.196130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52bb5c66-babc-4a6e-8c30-aabe32010113 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:06.206669 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52bb5c66-babc-4a6e-8c30-aabe32010113 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:06.207176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52bb5c66-babc-4a6e-8c30-aabe32010113 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:06.207553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52bb5c66-babc-4a6e-8c30-aabe32010113 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:06.262768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-95600f8e-b283-4ff8-8a6b-939d5406a7e4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:06.277693 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-95600f8e-b283-4ff8-8a6b-939d5406a7e4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1403 microversion: 2.1 time: 0.358574 Oct 10 23:29:06.279020 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1545/2988] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:05 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1403 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:06.289180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c2276419-9a7a-49c4-bc8f-68377c5559bb tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:06.297412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c2276419-9a7a-49c4-bc8f-68377c5559bb tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 532ff31c-bdc2-44d4-8e95-328263ebc63f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:06.306030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2276419-9a7a-49c4-bc8f-68377c5559bb tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:06.306521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2276419-9a7a-49c4-bc8f-68377c5559bb tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:06.307077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2276419-9a7a-49c4-bc8f-68377c5559bb tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:06.307993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2276419-9a7a-49c4-bc8f-68377c5559bb tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:06.308189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2276419-9a7a-49c4-bc8f-68377c5559bb tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:06.308617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2276419-9a7a-49c4-bc8f-68377c5559bb tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:06.409677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c2276419-9a7a-49c4-bc8f-68377c5559bb tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:06.421151 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c2276419-9a7a-49c4-bc8f-68377c5559bb tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f" status: 200 len: 1282 microversion: 2.1 time: 0.140160 Oct 10 23:29:06.422117 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1546/2989] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:06 2022] GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f => generated 1282 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:06.427328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-ef160a52-a126-454a-8596-2eda70165fcf req-79844007-12d6-4e36-8035-7944d41a2e11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "094e9aed-7746-4a4c-81d5-ccc6d6c3d74e", "tag": "fb699f20-bd58-4051-be00-7bc3a1b04ec6"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:06.439893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ef160a52-a126-454a-8596-2eda70165fcf req-79844007-12d6-4e36-8035-7944d41a2e11 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:06.440517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ef160a52-a126-454a-8596-2eda70165fcf req-79844007-12d6-4e36-8035-7944d41a2e11 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:06.441038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ef160a52-a126-454a-8596-2eda70165fcf req-79844007-12d6-4e36-8035-7944d41a2e11 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:06.455408 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-ef160a52-a126-454a-8596-2eda70165fcf req-79844007-12d6-4e36-8035-7944d41a2e11 service nova] Creating event network-changed:fb699f20-bd58-4051-be00-7bc3a1b04ec6 for instance 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e on n-h1-860864-2 Oct 10 23:29:06.460124 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-ef160a52-a126-454a-8596-2eda70165fcf req-79844007-12d6-4e36-8035-7944d41a2e11 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036858 Oct 10 23:29:06.465480 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1547/2990] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:06.626811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f173e4d3-fbe6-45f0-85ea-1b8bec8fa7b5 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:06.627649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f173e4d3-fbe6-45f0-85ea-1b8bec8fa7b5 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:06.636303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f173e4d3-fbe6-45f0-85ea-1b8bec8fa7b5 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:06.637090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f173e4d3-fbe6-45f0-85ea-1b8bec8fa7b5 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:06.637673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f173e4d3-fbe6-45f0-85ea-1b8bec8fa7b5 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:06.638908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f173e4d3-fbe6-45f0-85ea-1b8bec8fa7b5 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:06.640252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f173e4d3-fbe6-45f0-85ea-1b8bec8fa7b5 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:06.641103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f173e4d3-fbe6-45f0-85ea-1b8bec8fa7b5 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:06.706823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-52bb5c66-babc-4a6e-8c30-aabe32010113 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:06.721600 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-52bb5c66-babc-4a6e-8c30-aabe32010113 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 0.573786 Oct 10 23:29:06.722872 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1444/2991] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:06 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:06.842544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f173e4d3-fbe6-45f0-85ea-1b8bec8fa7b5 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:06.853907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f173e4d3-fbe6-45f0-85ea-1b8bec8fa7b5 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:06.855536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f173e4d3-fbe6-45f0-85ea-1b8bec8fa7b5 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:06.856931 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f173e4d3-fbe6-45f0-85ea-1b8bec8fa7b5 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1706 microversion: 2.32 time: 0.240066 Oct 10 23:29:06.857668 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1548/2992] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:06 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1706 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:07.173437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b48acd20-f912-4046-9668-d4bc84196c85 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:07.174208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b48acd20-f912-4046-9668-d4bc84196c85 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:07.181320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b48acd20-f912-4046-9668-d4bc84196c85 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:07.182554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b48acd20-f912-4046-9668-d4bc84196c85 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:07.183183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b48acd20-f912-4046-9668-d4bc84196c85 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:07.184344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b48acd20-f912-4046-9668-d4bc84196c85 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:07.185646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b48acd20-f912-4046-9668-d4bc84196c85 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:07.186433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b48acd20-f912-4046-9668-d4bc84196c85 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:07.252970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=24 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:07.304490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1eabdd83-f135-46e5-8fb1-82ccfda9dbc4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:07.305103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1eabdd83-f135-46e5-8fb1-82ccfda9dbc4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:07.314793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1eabdd83-f135-46e5-8fb1-82ccfda9dbc4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:07.315379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1eabdd83-f135-46e5-8fb1-82ccfda9dbc4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:07.315914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1eabdd83-f135-46e5-8fb1-82ccfda9dbc4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:07.316918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1eabdd83-f135-46e5-8fb1-82ccfda9dbc4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:07.317478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1eabdd83-f135-46e5-8fb1-82ccfda9dbc4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:07.317982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1eabdd83-f135-46e5-8fb1-82ccfda9dbc4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:07.449857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b48acd20-f912-4046-9668-d4bc84196c85 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:07.463128 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b48acd20-f912-4046-9668-d4bc84196c85 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1472 microversion: 2.1 time: 0.294134 Oct 10 23:29:07.466799 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1445/2993] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:07 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1472 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:07.489555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1eabdd83-f135-46e5-8fb1-82ccfda9dbc4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:07.499416 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eaebe797-bd90-431f-991b-067a50f73e99 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:07.499767 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1eabdd83-f135-46e5-8fb1-82ccfda9dbc4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1403 microversion: 2.1 time: 0.199161 Oct 10 23:29:07.503598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eaebe797-bd90-431f-991b-067a50f73e99 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 532ff31c-bdc2-44d4-8e95-328263ebc63f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:07.510991 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1549/2994] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:07 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1403 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:29:07.529959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaebe797-bd90-431f-991b-067a50f73e99 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:07.530533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaebe797-bd90-431f-991b-067a50f73e99 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:07.533270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaebe797-bd90-431f-991b-067a50f73e99 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:07.534418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaebe797-bd90-431f-991b-067a50f73e99 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:07.535140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaebe797-bd90-431f-991b-067a50f73e99 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:07.535786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaebe797-bd90-431f-991b-067a50f73e99 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:07.796355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-555dfd5f-07ef-4974-885a-edd81ef54945 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Action: 'create', calling method: .version_select at 0x7f662b1c3ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1871086832", "description": "tempest-description-1627225684"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:07.871016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-eaebe797-bd90-431f-991b-067a50f73e99 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:07.883347 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eaebe797-bd90-431f-991b-067a50f73e99 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f" status: 200 len: 1324 microversion: 2.1 time: 0.398073 Oct 10 23:29:07.884206 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1446/2995] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:07 2022] GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f => generated 1324 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:07.889663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2e619351-0216-4bb8-8c03-1841bc87551e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:07.897799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2e619351-0216-4bb8-8c03-1841bc87551e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:07.911380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e619351-0216-4bb8-8c03-1841bc87551e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:07.912279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e619351-0216-4bb8-8c03-1841bc87551e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:07.912914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e619351-0216-4bb8-8c03-1841bc87551e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:07.924018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e619351-0216-4bb8-8c03-1841bc87551e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:07.925056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e619351-0216-4bb8-8c03-1841bc87551e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:07.925720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e619351-0216-4bb8-8c03-1841bc87551e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:08.038473 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-555dfd5f-07ef-4974-885a-edd81ef54945 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.339437 Oct 10 23:29:08.039087 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1550/2996] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:29:07 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:08.048581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0b20719e-a885-4eb4-bd11-510015d850bf tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:08.048581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0b20719e-a885-4eb4-bd11-510015d850bf tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:08.056657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b20719e-a885-4eb4-bd11-510015d850bf tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:08.057747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b20719e-a885-4eb4-bd11-510015d850bf tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:08.058416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b20719e-a885-4eb4-bd11-510015d850bf tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:08.059391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b20719e-a885-4eb4-bd11-510015d850bf tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:08.060774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b20719e-a885-4eb4-bd11-510015d850bf tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:08.061986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b20719e-a885-4eb4-bd11-510015d850bf tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:08.244279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2e619351-0216-4bb8-8c03-1841bc87551e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:08.258417 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2e619351-0216-4bb8-8c03-1841bc87551e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 0.369215 Oct 10 23:29:08.259345 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1447/2997] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:07 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:08.266859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9452afac-54d4-4b3a-88d2-25f467b2a0af tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Action: 'create', calling method: .version_select at 0x7f662b39e160>, body: {"security_group_rule": {"parent_group_id": "6a7d04e9-cc4e-423f-b5e3-442d901f898a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:08.298769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0b20719e-a885-4eb4-bd11-510015d850bf tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:08.314270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0b20719e-a885-4eb4-bd11-510015d850bf tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:08.315952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0b20719e-a885-4eb4-bd11-510015d850bf tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:08.317360 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0b20719e-a885-4eb4-bd11-510015d850bf tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1706 microversion: 2.32 time: 0.277333 Oct 10 23:29:08.318297 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1551/2998] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:08 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1706 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:08.497812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c9612d6f-464c-494b-9603-ae789d123806 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:08.498820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c9612d6f-464c-494b-9603-ae789d123806 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:08.516615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9612d6f-464c-494b-9603-ae789d123806 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:08.526741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9612d6f-464c-494b-9603-ae789d123806 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:08.527572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9612d6f-464c-494b-9603-ae789d123806 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:08.528446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9612d6f-464c-494b-9603-ae789d123806 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:08.529399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9612d6f-464c-494b-9603-ae789d123806 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:08.535146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9612d6f-464c-494b-9603-ae789d123806 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:08.764306 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9452afac-54d4-4b3a-88d2-25f467b2a0af tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.501607 Oct 10 23:29:08.765425 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1448/2999] 10.222.0.23 () {60 vars in 1195 bytes} [Mon Oct 10 23:29:08 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:08.771890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f3acf26b-4f7a-403a-bb51-7d984cf4f71c tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:08.772866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f3acf26b-4f7a-403a-bb51-7d984cf4f71c tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:08.790592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3acf26b-4f7a-403a-bb51-7d984cf4f71c tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:08.791322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3acf26b-4f7a-403a-bb51-7d984cf4f71c tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:08.791923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3acf26b-4f7a-403a-bb51-7d984cf4f71c tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:08.793015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3acf26b-4f7a-403a-bb51-7d984cf4f71c tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:08.795599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3acf26b-4f7a-403a-bb51-7d984cf4f71c tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:08.797265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3acf26b-4f7a-403a-bb51-7d984cf4f71c tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:08.933215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c9612d6f-464c-494b-9603-ae789d123806 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:08.945511 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c9612d6f-464c-494b-9603-ae789d123806 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1472 microversion: 2.1 time: 0.452159 Oct 10 23:29:08.952037 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1552/3000] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:08 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1472 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:29:08.965973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4184883f-30fb-4c66-9e37-0e48fbbb083b tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Action: 'create', calling method: .version_select at 0x7f662b5c7b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-939938869", "description": "tempest-description-1148960609"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:09.425230 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4184883f-30fb-4c66-9e37-0e48fbbb083b tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.470395 Oct 10 23:29:09.426307 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1553/3001] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:29:08 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:09.433116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d8f5d448-c289-411d-851f-e55a33095465 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:09.435068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d8f5d448-c289-411d-851f-e55a33095465 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 532ff31c-bdc2-44d4-8e95-328263ebc63f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:09.463632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8f5d448-c289-411d-851f-e55a33095465 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:09.466511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8f5d448-c289-411d-851f-e55a33095465 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:09.468785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8f5d448-c289-411d-851f-e55a33095465 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:09.472669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8f5d448-c289-411d-851f-e55a33095465 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:09.473491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8f5d448-c289-411d-851f-e55a33095465 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:09.478572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8f5d448-c289-411d-851f-e55a33095465 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:09.700067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f3acf26b-4f7a-403a-bb51-7d984cf4f71c tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:09.712494 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f3acf26b-4f7a-403a-bb51-7d984cf4f71c tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1403 microversion: 2.1 time: 0.942919 Oct 10 23:29:09.717719 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1449/3002] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:08 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1403 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:09.723928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-de608ccf-cf0f-4981-98a0-c648b0555d29 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:09.726440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-de608ccf-cf0f-4981-98a0-c648b0555d29 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:09.759900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de608ccf-cf0f-4981-98a0-c648b0555d29 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:09.760572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de608ccf-cf0f-4981-98a0-c648b0555d29 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:09.764165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de608ccf-cf0f-4981-98a0-c648b0555d29 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:09.765590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de608ccf-cf0f-4981-98a0-c648b0555d29 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:09.766817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de608ccf-cf0f-4981-98a0-c648b0555d29 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:09.770086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-de608ccf-cf0f-4981-98a0-c648b0555d29 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:09.915799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d8f5d448-c289-411d-851f-e55a33095465 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:09.932205 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d8f5d448-c289-411d-851f-e55a33095465 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f" status: 200 len: 1324 microversion: 2.1 time: 0.504061 Oct 10 23:29:09.932929 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1554/3003] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:09 2022] GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f => generated 1324 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:09.948970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-40f8924a-c9e5-4cb6-b90c-66cf830e9803 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:09.952401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-40f8924a-c9e5-4cb6-b90c-66cf830e9803 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:09.971888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40f8924a-c9e5-4cb6-b90c-66cf830e9803 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:09.972427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40f8924a-c9e5-4cb6-b90c-66cf830e9803 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:09.975928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40f8924a-c9e5-4cb6-b90c-66cf830e9803 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:09.976803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40f8924a-c9e5-4cb6-b90c-66cf830e9803 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:09.977365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40f8924a-c9e5-4cb6-b90c-66cf830e9803 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:09.977851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40f8924a-c9e5-4cb6-b90c-66cf830e9803 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:10.291007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-40f8924a-c9e5-4cb6-b90c-66cf830e9803 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:10.314085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-40f8924a-c9e5-4cb6-b90c-66cf830e9803 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:10.315557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-40f8924a-c9e5-4cb6-b90c-66cf830e9803 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:10.317697 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-40f8924a-c9e5-4cb6-b90c-66cf830e9803 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1753 microversion: 2.32 time: 0.383638 Oct 10 23:29:10.320197 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1555/3004] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:09 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1753 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:10.328275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dbfca168-18d9-4c93-b989-3cc7e625dbbf tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Action: 'create', calling method: .version_select at 0x7f662b1c3ca0>, body: {"security_group_rule": {"parent_group_id": "98047d83-d6b7-4abe-8e16-ef81c32c317b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:10.607132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-de608ccf-cf0f-4981-98a0-c648b0555d29 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:10.616606 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-de608ccf-cf0f-4981-98a0-c648b0555d29 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1503 microversion: 2.1 time: 0.897564 Oct 10 23:29:10.617227 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1450/3005] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:09 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1503 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:10.642795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-a3612c08-45ff-4aae-94a7-3b472b676e27 req-387fe93e-e721-41a9-9f8b-7eec78e86475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "532ff31c-bdc2-44d4-8e95-328263ebc63f", "tag": "6a32f134-8050-4053-8c4e-b1a5e53b0952"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:10.662927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a3612c08-45ff-4aae-94a7-3b472b676e27 req-387fe93e-e721-41a9-9f8b-7eec78e86475 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:10.663421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a3612c08-45ff-4aae-94a7-3b472b676e27 req-387fe93e-e721-41a9-9f8b-7eec78e86475 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:10.663863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a3612c08-45ff-4aae-94a7-3b472b676e27 req-387fe93e-e721-41a9-9f8b-7eec78e86475 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:10.696079 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-a3612c08-45ff-4aae-94a7-3b472b676e27 req-387fe93e-e721-41a9-9f8b-7eec78e86475 service nova] Creating event network-changed:6a32f134-8050-4053-8c4e-b1a5e53b0952 for instance 532ff31c-bdc2-44d4-8e95-328263ebc63f on n-h2-860864-2 Oct 10 23:29:10.711796 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-a3612c08-45ff-4aae-94a7-3b472b676e27 req-387fe93e-e721-41a9-9f8b-7eec78e86475 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093319 Oct 10 23:29:10.713465 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1451/3006] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:10.718950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ac6c5cbb-272b-4373-abab-46aa8158de21 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:10.719841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ac6c5cbb-272b-4373-abab-46aa8158de21 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:10.733503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac6c5cbb-272b-4373-abab-46aa8158de21 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:10.734212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac6c5cbb-272b-4373-abab-46aa8158de21 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:10.742372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac6c5cbb-272b-4373-abab-46aa8158de21 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:10.745293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac6c5cbb-272b-4373-abab-46aa8158de21 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:10.745969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac6c5cbb-272b-4373-abab-46aa8158de21 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:10.746694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac6c5cbb-272b-4373-abab-46aa8158de21 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:10.813758 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dbfca168-18d9-4c93-b989-3cc7e625dbbf tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.489976 Oct 10 23:29:10.822815 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1556/3007] 10.222.0.23 () {60 vars in 1195 bytes} [Mon Oct 10 23:29:10 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:10.828602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-148ec658-26fb-4334-b8a2-c871b58b6420 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:10.832977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-148ec658-26fb-4334-b8a2-c871b58b6420 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:10.844764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-148ec658-26fb-4334-b8a2-c871b58b6420 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:10.845604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-148ec658-26fb-4334-b8a2-c871b58b6420 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:10.846245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-148ec658-26fb-4334-b8a2-c871b58b6420 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:10.849847 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-148ec658-26fb-4334-b8a2-c871b58b6420 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:10.850531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-148ec658-26fb-4334-b8a2-c871b58b6420 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:10.851263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-148ec658-26fb-4334-b8a2-c871b58b6420 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:11.074493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-148ec658-26fb-4334-b8a2-c871b58b6420 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:11.086057 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-148ec658-26fb-4334-b8a2-c871b58b6420 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1403 microversion: 2.1 time: 0.261865 Oct 10 23:29:11.087575 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1557/3008] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:10 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1403 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:11.095686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-351068b0-36c7-4888-8d01-6f4631b9bc9b tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Action: 'create', calling method: .version_select at 0x7f662b4bf3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-230573827", "description": "tempest-description-1810800861"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:11.493706 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-351068b0-36c7-4888-8d01-6f4631b9bc9b tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.404696 Oct 10 23:29:11.494585 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1558/3009] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:29:11 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:11.508708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c5a55f27-4ef8-494f-98ab-1a1f9afad976 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:11.509239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c5a55f27-4ef8-494f-98ab-1a1f9afad976 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 532ff31c-bdc2-44d4-8e95-328263ebc63f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:11.522525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5a55f27-4ef8-494f-98ab-1a1f9afad976 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:11.523044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5a55f27-4ef8-494f-98ab-1a1f9afad976 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:11.523483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5a55f27-4ef8-494f-98ab-1a1f9afad976 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:11.524197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5a55f27-4ef8-494f-98ab-1a1f9afad976 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:11.524811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5a55f27-4ef8-494f-98ab-1a1f9afad976 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:11.525047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5a55f27-4ef8-494f-98ab-1a1f9afad976 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:11.579505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ac6c5cbb-272b-4373-abab-46aa8158de21 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:11.581961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:11.590081 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ac6c5cbb-272b-4373-abab-46aa8158de21 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1472 microversion: 2.1 time: 0.874924 Oct 10 23:29:11.590837 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1452/3010] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:10 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1472 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:11.598508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cdd215d8-a766-4bdc-9298-e93287b0ff9a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:11.599419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cdd215d8-a766-4bdc-9298-e93287b0ff9a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:11.609107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cdd215d8-a766-4bdc-9298-e93287b0ff9a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:11.609830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cdd215d8-a766-4bdc-9298-e93287b0ff9a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:11.610492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cdd215d8-a766-4bdc-9298-e93287b0ff9a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:11.611439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cdd215d8-a766-4bdc-9298-e93287b0ff9a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:11.612053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cdd215d8-a766-4bdc-9298-e93287b0ff9a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:11.612853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cdd215d8-a766-4bdc-9298-e93287b0ff9a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:11.989484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c5a55f27-4ef8-494f-98ab-1a1f9afad976 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:12.015786 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c5a55f27-4ef8-494f-98ab-1a1f9afad976 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f" status: 200 len: 1324 microversion: 2.1 time: 0.508075 Oct 10 23:29:12.018261 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1559/3011] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:11 2022] GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f => generated 1324 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:12.030189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7c0c8bc9-eec4-4eae-b880-ca3c87303607 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Action: 'create', calling method: .version_select at 0x7f662b1c3dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1980623165", "description": "tempest-description-138417373"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:12.053028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cdd215d8-a766-4bdc-9298-e93287b0ff9a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:12.072700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cdd215d8-a766-4bdc-9298-e93287b0ff9a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:12.074821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cdd215d8-a766-4bdc-9298-e93287b0ff9a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:12.080841 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cdd215d8-a766-4bdc-9298-e93287b0ff9a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1800 microversion: 2.32 time: 0.487692 Oct 10 23:29:12.090719 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1453/3012] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:11 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1800 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:12.106134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b7bf8ed0-d62a-4574-9ff9-fba1dc94ba8e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:12.107136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b7bf8ed0-d62a-4574-9ff9-fba1dc94ba8e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:12.130748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7bf8ed0-d62a-4574-9ff9-fba1dc94ba8e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:12.131627 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7bf8ed0-d62a-4574-9ff9-fba1dc94ba8e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:12.132459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7bf8ed0-d62a-4574-9ff9-fba1dc94ba8e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:12.133423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7bf8ed0-d62a-4574-9ff9-fba1dc94ba8e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:12.134141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7bf8ed0-d62a-4574-9ff9-fba1dc94ba8e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:12.134792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7bf8ed0-d62a-4574-9ff9-fba1dc94ba8e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:12.190699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7bf8ed0-d62a-4574-9ff9-fba1dc94ba8e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:12.192677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7bf8ed0-d62a-4574-9ff9-fba1dc94ba8e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:12.193417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7bf8ed0-d62a-4574-9ff9-fba1dc94ba8e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:12.194105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-b7bf8ed0-d62a-4574-9ff9-fba1dc94ba8e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lazy-loading 'fault' on Instance uuid fec8a1d6-8362-45be-88f9-beebbbb47091 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:29:12.252896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b7bf8ed0-d62a-4574-9ff9-fba1dc94ba8e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:12.268931 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b7bf8ed0-d62a-4574-9ff9-fba1dc94ba8e tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1303 microversion: 2.1 time: 0.166428 Oct 10 23:29:12.275639 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1454/3013] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:12 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1303 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:12.287883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-22ca3146-ea63-4a6e-97b5-e9244e6247fa tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:12.289167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-22ca3146-ea63-4a6e-97b5-e9244e6247fa tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:12.307810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22ca3146-ea63-4a6e-97b5-e9244e6247fa tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:12.308763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22ca3146-ea63-4a6e-97b5-e9244e6247fa tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:12.312214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22ca3146-ea63-4a6e-97b5-e9244e6247fa tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:12.313804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22ca3146-ea63-4a6e-97b5-e9244e6247fa tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:12.315807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22ca3146-ea63-4a6e-97b5-e9244e6247fa tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:12.317536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22ca3146-ea63-4a6e-97b5-e9244e6247fa tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:12.375564 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-22ca3146-ea63-4a6e-97b5-e9244e6247fa tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-volume_attachments/0572e991-e14e-40b5-ab57-a7261a26c7fb" status: 200 len: 194 microversion: 2.1 time: 0.097939 Oct 10 23:29:12.376947 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1455/3014] 10.222.0.23 () {58 vars in 1413 bytes} [Mon Oct 10 23:29:12 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-volume_attachments/0572e991-e14e-40b5-ab57-a7261a26c7fb => generated 194 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:12.383440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a1581627-d59c-4403-94db-39ebed4ec42f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:12.384717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a1581627-d59c-4403-94db-39ebed4ec42f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:12.393132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1581627-d59c-4403-94db-39ebed4ec42f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:12.393935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1581627-d59c-4403-94db-39ebed4ec42f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:12.394681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1581627-d59c-4403-94db-39ebed4ec42f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:12.395870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1581627-d59c-4403-94db-39ebed4ec42f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:12.396592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1581627-d59c-4403-94db-39ebed4ec42f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:12.397400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1581627-d59c-4403-94db-39ebed4ec42f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:12.551434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a1581627-d59c-4403-94db-39ebed4ec42f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:12.560766 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a1581627-d59c-4403-94db-39ebed4ec42f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1403 microversion: 2.1 time: 0.182363 Oct 10 23:29:12.577902 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1456/3015] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:12 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1403 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:12.584031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ca9e2c36-0cf3-4e39-b54a-00655c14e6e5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:12.584736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ca9e2c36-0cf3-4e39-b54a-00655c14e6e5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:12.592530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca9e2c36-0cf3-4e39-b54a-00655c14e6e5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:12.593184 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca9e2c36-0cf3-4e39-b54a-00655c14e6e5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:12.593901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca9e2c36-0cf3-4e39-b54a-00655c14e6e5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:12.594780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca9e2c36-0cf3-4e39-b54a-00655c14e6e5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:12.595412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca9e2c36-0cf3-4e39-b54a-00655c14e6e5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:12.596188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca9e2c36-0cf3-4e39-b54a-00655c14e6e5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:12.676358 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7c0c8bc9-eec4-4eae-b880-ca3c87303607 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.653530 Oct 10 23:29:12.678283 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1560/3016] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:29:12 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:12.683490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9f3fceaa-f7dd-4eeb-836b-12a0c7901c9b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:12.686306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9f3fceaa-f7dd-4eeb-836b-12a0c7901c9b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:12.727722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f3fceaa-f7dd-4eeb-836b-12a0c7901c9b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:12.728329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f3fceaa-f7dd-4eeb-836b-12a0c7901c9b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:12.728887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f3fceaa-f7dd-4eeb-836b-12a0c7901c9b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:12.730892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f3fceaa-f7dd-4eeb-836b-12a0c7901c9b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:12.731465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f3fceaa-f7dd-4eeb-836b-12a0c7901c9b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:12.734324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f3fceaa-f7dd-4eeb-836b-12a0c7901c9b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:12.796066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-ca9e2c36-0cf3-4e39-b54a-00655c14e6e5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lazy-loading 'services' on Instance uuid 92e9f63c-d49b-4a32-80b8-b729b8530379 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:29:12.975272 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ca9e2c36-0cf3-4e39-b54a-00655c14e6e5 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "DELETE /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-volume_attachments/0572e991-e14e-40b5-ab57-a7261a26c7fb" status: 202 len: 0 microversion: 2.1 time: 0.395947 Oct 10 23:29:12.976242 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1457/3017] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Oct 10 23:29:12 2022] DELETE /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-volume_attachments/0572e991-e14e-40b5-ab57-a7261a26c7fb => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:29:12.984549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c325e1c7-5628-4677-8854-571cbba9d533 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Action: 'create', calling method: .version_select at 0x7f662b3ef8b0>, body: {"security_group_rule": {"parent_group_id": "abc792e5-ec8e-46b4-bb92-d93288e838b3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "d073f8a2-37c4-4958-a12d-f9b128f8a88b"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:13.206430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9f3fceaa-f7dd-4eeb-836b-12a0c7901c9b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:13.215055 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9f3fceaa-f7dd-4eeb-836b-12a0c7901c9b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1472 microversion: 2.1 time: 0.535463 Oct 10 23:29:13.229411 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1561/3018] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:12 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1472 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:13.229411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-fadaa454-5490-4085-8a09-1e673d6b9b96 req-064f4e6f-68de-43ab-bb7d-7c09d9aaccb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fec8a1d6-8362-45be-88f9-beebbbb47091", "name": "network-vif-deleted", "tag": "0388ec2d-008c-474c-ad89-b054a331ac12"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:13.257548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-fadaa454-5490-4085-8a09-1e673d6b9b96 req-064f4e6f-68de-43ab-bb7d-7c09d9aaccb3 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:13.258597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-fadaa454-5490-4085-8a09-1e673d6b9b96 req-064f4e6f-68de-43ab-bb7d-7c09d9aaccb3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:13.259042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-fadaa454-5490-4085-8a09-1e673d6b9b96 req-064f4e6f-68de-43ab-bb7d-7c09d9aaccb3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:13.263906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:13.287015 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-fadaa454-5490-4085-8a09-1e673d6b9b96 req-064f4e6f-68de-43ab-bb7d-7c09d9aaccb3 service nova] Creating event network-vif-deleted:0388ec2d-008c-474c-ad89-b054a331ac12 for instance fec8a1d6-8362-45be-88f9-beebbbb47091 on n-h1-860864-2 Oct 10 23:29:13.306777 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-fadaa454-5490-4085-8a09-1e673d6b9b96 req-064f4e6f-68de-43ab-bb7d-7c09d9aaccb3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085817 Oct 10 23:29:13.307829 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1562/3019] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:13.318177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b66aaa67-07d6-4b7b-8843-e89070bd072f tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:13.318898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b66aaa67-07d6-4b7b-8843-e89070bd072f tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 532ff31c-bdc2-44d4-8e95-328263ebc63f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:13.320901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:13.342020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b66aaa67-07d6-4b7b-8843-e89070bd072f tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:13.342685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b66aaa67-07d6-4b7b-8843-e89070bd072f tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:13.347184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b66aaa67-07d6-4b7b-8843-e89070bd072f tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:13.347184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b66aaa67-07d6-4b7b-8843-e89070bd072f tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:13.351014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b66aaa67-07d6-4b7b-8843-e89070bd072f tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:13.351577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b66aaa67-07d6-4b7b-8843-e89070bd072f tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:13.355230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=42 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:13.566515 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c325e1c7-5628-4677-8854-571cbba9d533 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.588689 Oct 10 23:29:13.567133 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1458/3020] 10.222.0.23 () {60 vars in 1195 bytes} [Mon Oct 10 23:29:12 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:13.577829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-79ff2fd8-933e-4208-8406-657d2e4127fb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:13.580218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-79ff2fd8-933e-4208-8406-657d2e4127fb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:13.608081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79ff2fd8-933e-4208-8406-657d2e4127fb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:13.610332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79ff2fd8-933e-4208-8406-657d2e4127fb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:13.610948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79ff2fd8-933e-4208-8406-657d2e4127fb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:13.612228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79ff2fd8-933e-4208-8406-657d2e4127fb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:13.613311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79ff2fd8-933e-4208-8406-657d2e4127fb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:13.613965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79ff2fd8-933e-4208-8406-657d2e4127fb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:13.711632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b66aaa67-07d6-4b7b-8843-e89070bd072f tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:13.737402 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b66aaa67-07d6-4b7b-8843-e89070bd072f tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f" status: 200 len: 1324 microversion: 2.1 time: 0.426130 Oct 10 23:29:13.737402 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1563/3021] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:13 2022] GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f => generated 1324 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:13.754753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1e7eacc8-5711-427e-8a71-f8d982c7a112 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:13.762299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1e7eacc8-5711-427e-8a71-f8d982c7a112 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:13.776252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e7eacc8-5711-427e-8a71-f8d982c7a112 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:13.776987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e7eacc8-5711-427e-8a71-f8d982c7a112 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:13.786276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e7eacc8-5711-427e-8a71-f8d982c7a112 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:13.787041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e7eacc8-5711-427e-8a71-f8d982c7a112 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:13.787514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e7eacc8-5711-427e-8a71-f8d982c7a112 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:13.788061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e7eacc8-5711-427e-8a71-f8d982c7a112 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:13.847986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e7eacc8-5711-427e-8a71-f8d982c7a112 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:13.848562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e7eacc8-5711-427e-8a71-f8d982c7a112 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:13.849011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e7eacc8-5711-427e-8a71-f8d982c7a112 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:13.849497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-1e7eacc8-5711-427e-8a71-f8d982c7a112 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lazy-loading 'fault' on Instance uuid fec8a1d6-8362-45be-88f9-beebbbb47091 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:29:13.916526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1e7eacc8-5711-427e-8a71-f8d982c7a112 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:13.934355 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1e7eacc8-5711-427e-8a71-f8d982c7a112 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 200 len: 1303 microversion: 2.1 time: 0.197152 Oct 10 23:29:13.935144 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1564/3022] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:13 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 1303 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:13.946727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d8489c1a-825d-48da-9eec-0826594d3aef tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Action: 'create', calling method: .version_select at 0x7f662b143700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-548771694", "description": "tempest-description-800251323"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:14.049696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-79ff2fd8-933e-4208-8406-657d2e4127fb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:14.069419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-79ff2fd8-933e-4208-8406-657d2e4127fb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:14.072519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-79ff2fd8-933e-4208-8406-657d2e4127fb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:14.075087 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-79ff2fd8-933e-4208-8406-657d2e4127fb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1847 microversion: 2.32 time: 0.506384 Oct 10 23:29:14.076381 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1459/3023] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:13 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1847 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:14.082730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a9dc1e81-d608-454e-b641-95d02e4313d6 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:14.083719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a9dc1e81-d608-454e-b641-95d02e4313d6 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:14.093273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9dc1e81-d608-454e-b641-95d02e4313d6 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:14.094120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9dc1e81-d608-454e-b641-95d02e4313d6 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:14.095004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9dc1e81-d608-454e-b641-95d02e4313d6 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:14.096006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9dc1e81-d608-454e-b641-95d02e4313d6 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:14.096666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9dc1e81-d608-454e-b641-95d02e4313d6 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:14.097334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9dc1e81-d608-454e-b641-95d02e4313d6 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:14.134611 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d8489c1a-825d-48da-9eec-0826594d3aef tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.191691 Oct 10 23:29:14.143525 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1565/3024] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:29:13 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:14.149004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5f6478a7-fd47-42a5-b9f3-ba0ec24fe069 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Action: 'create', calling method: .version_select at 0x7f662b1434c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-755722151", "description": "tempest-description-1229401714"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:14.289241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a9dc1e81-d608-454e-b641-95d02e4313d6 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:14.300175 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a9dc1e81-d608-454e-b641-95d02e4313d6 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1403 microversion: 2.1 time: 0.221976 Oct 10 23:29:14.300843 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1460/3025] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:14 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1403 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:14.305520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e00fb0b0-49b0-4991-b82b-8b841d5a1c3d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:14.306432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e00fb0b0-49b0-4991-b82b-8b841d5a1c3d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:14.312763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e00fb0b0-49b0-4991-b82b-8b841d5a1c3d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:14.313533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e00fb0b0-49b0-4991-b82b-8b841d5a1c3d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:14.313977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e00fb0b0-49b0-4991-b82b-8b841d5a1c3d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:14.314845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e00fb0b0-49b0-4991-b82b-8b841d5a1c3d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:14.315311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e00fb0b0-49b0-4991-b82b-8b841d5a1c3d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:14.315740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e00fb0b0-49b0-4991-b82b-8b841d5a1c3d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:14.352467 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5f6478a7-fd47-42a5-b9f3-ba0ec24fe069 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.207361 Oct 10 23:29:14.354444 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1566/3026] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:29:14 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:14.368256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-704392d7-3d27-4ab4-a6c1-e881cf814363 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Action: 'create', calling method: .version_select at 0x7f662b0c6310>, body: {"security_group_rule": {"parent_group_id": "c9f1e5fa-d896-4a34-acd0-5cc657cfd4a4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "53c77b16-3df9-4065-88b8-fe091040b73d"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:14.556198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e00fb0b0-49b0-4991-b82b-8b841d5a1c3d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:14.566792 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e00fb0b0-49b0-4991-b82b-8b841d5a1c3d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1472 microversion: 2.1 time: 0.264663 Oct 10 23:29:14.569470 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1461/3027] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:14 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1472 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:14.759749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-61fadd0d-130b-405b-b310-71df826477a7 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:14.761901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-61fadd0d-130b-405b-b310-71df826477a7 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 532ff31c-bdc2-44d4-8e95-328263ebc63f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:14.793132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61fadd0d-130b-405b-b310-71df826477a7 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:14.794915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61fadd0d-130b-405b-b310-71df826477a7 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:14.796026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61fadd0d-130b-405b-b310-71df826477a7 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:14.796977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61fadd0d-130b-405b-b310-71df826477a7 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:14.797634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61fadd0d-130b-405b-b310-71df826477a7 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:14.798287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61fadd0d-130b-405b-b310-71df826477a7 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:15.014832 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-704392d7-3d27-4ab4-a6c1-e881cf814363 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.650870 Oct 10 23:29:15.021360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-61fadd0d-130b-405b-b310-71df826477a7 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:15.022969 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1567/3028] 10.222.0.23 () {60 vars in 1195 bytes} [Mon Oct 10 23:29:14 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:15.028102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d8321e21-4591-4f5b-9e33-5bc92986c517 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:15.029743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d8321e21-4591-4f5b-9e33-5bc92986c517 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: fec8a1d6-8362-45be-88f9-beebbbb47091] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:15.031955 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-61fadd0d-130b-405b-b310-71df826477a7 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f" status: 200 len: 1324 microversion: 2.1 time: 0.277213 Oct 10 23:29:15.034866 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1462/3029] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:14 2022] GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f => generated 1324 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:15.043490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f48d59d0-0fcc-4684-bf1a-95f4559e2450 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Calling method '.version_select at 0x7f662b753dc0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:15.066690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8321e21-4591-4f5b-9e33-5bc92986c517 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:15.067459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8321e21-4591-4f5b-9e33-5bc92986c517 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:15.068117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8321e21-4591-4f5b-9e33-5bc92986c517 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:15.069328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8321e21-4591-4f5b-9e33-5bc92986c517 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:15.070062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8321e21-4591-4f5b-9e33-5bc92986c517 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:15.070726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8321e21-4591-4f5b-9e33-5bc92986c517 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:15.086613 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-d8321e21-4591-4f5b-9e33-5bc92986c517 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] HTTP exception thrown: Instance fec8a1d6-8362-45be-88f9-beebbbb47091 could not be found. Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d8321e21-4591-4f5b-9e33-5bc92986c517 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Request method failure captured: Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 HTTP/1.1 Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKopDyARPUMe5H6ZWwZZ-NnryPbry3nBQ4z9GbYxFozcOEJzCAYfyagyta5JY6HEfLEIBCuMBRXVwUqflQwm3E4PWo9OQ5U_lMjjgFGTG1BMYA2n9-6gEdmZ8Ccbp_TZplqvsKcxtLLWhUB20ugWkRo3uiJqSr2WOf3_7XeyMTpA3qU Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 44777346e7e541389e24fe42c4d46cbf Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerRescueTestJSON-779207136 Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/44777346e7e541389e24fe42c4d46cbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44777346e7e541389e24fe42c4d46cbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44777346e7e541389e24fe42c4d46cbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_44777346e7e541389e24fe42c4d46cbf", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerRescueTestJSON-779207136 Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 44777346e7e541389e24fe42c4d46cbf Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerRescueTestJSON-779207136 Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerRescueTestJSON-779207136-project Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 1f1aca1de5b64298b6e5d0ba3c554fb7 Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerRescueTestJSON-779207136-project Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance fec8a1d6-8362-45be-88f9-beebbbb47091 could not be found. Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'fec8a1d6-8362-45be-88f9-beebbbb47091'} Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fec8a1d6-8362-45be-88f9-beebbbb47091 could not be found. Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fec8a1d6-8362-45be-88f9-beebbbb47091 could not be found. Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:15.089795 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:15.095989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:15.095989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:15.095989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:15.095989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:29:15.095989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:29:15.095989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fec8a1d6-8362-45be-88f9-beebbbb47091 could not be found. Oct 10 23:29:15.095989 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:15.099862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d8321e21-4591-4f5b-9e33-5bc92986c517 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Returning 404 to user: Instance fec8a1d6-8362-45be-88f9-beebbbb47091 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:29:15.100297 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d8321e21-4591-4f5b-9e33-5bc92986c517 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091" status: 404 len: 111 microversion: 2.1 time: 0.075675 Oct 10 23:29:15.104925 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1568/3030] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:15 2022] GET /compute/v2.1/servers/fec8a1d6-8362-45be-88f9-beebbbb47091 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:29:15.111530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2db3e817-3763-4c9b-857f-9e3c945c8a01 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:15.112934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2db3e817-3763-4c9b-857f-9e3c945c8a01 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:15.120223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2db3e817-3763-4c9b-857f-9e3c945c8a01 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:15.121103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2db3e817-3763-4c9b-857f-9e3c945c8a01 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:15.121845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2db3e817-3763-4c9b-857f-9e3c945c8a01 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:15.123490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2db3e817-3763-4c9b-857f-9e3c945c8a01 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:15.124189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2db3e817-3763-4c9b-857f-9e3c945c8a01 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:15.124829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2db3e817-3763-4c9b-857f-9e3c945c8a01 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:15.428739 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f48d59d0-0fcc-4684-bf1a-95f4559e2450 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/53c77b16-3df9-4065-88b8-fe091040b73d" status: 202 len: 0 microversion: 2.1 time: 0.392539 Oct 10 23:29:15.429348 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1463/3031] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:29:15 2022] DELETE /compute/v2.1/os-security-groups/53c77b16-3df9-4065-88b8-fe091040b73d => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:29:15.436117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-35b3058f-175b-42dd-96b7-cd51e91544ff tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:15.442911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-35b3058f-175b-42dd-96b7-cd51e91544ff tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:15.454767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35b3058f-175b-42dd-96b7-cd51e91544ff tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:15.455279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35b3058f-175b-42dd-96b7-cd51e91544ff tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:15.455725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35b3058f-175b-42dd-96b7-cd51e91544ff tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:15.456508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35b3058f-175b-42dd-96b7-cd51e91544ff tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:15.456948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35b3058f-175b-42dd-96b7-cd51e91544ff tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:15.457478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35b3058f-175b-42dd-96b7-cd51e91544ff tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:15.491849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-35b3058f-175b-42dd-96b7-cd51e91544ff tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:29:15.512956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2db3e817-3763-4c9b-857f-9e3c945c8a01 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:15.533142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2db3e817-3763-4c9b-857f-9e3c945c8a01 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:15.538633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2db3e817-3763-4c9b-857f-9e3c945c8a01 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:15.540150 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2db3e817-3763-4c9b-857f-9e3c945c8a01 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1847 microversion: 2.32 time: 0.433572 Oct 10 23:29:15.543389 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1569/3032] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:15 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1847 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:15.555243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-aa0643cd-8613-4c9c-9eb3-3823568e8def tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:15.556437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-aa0643cd-8613-4c9c-9eb3-3823568e8def tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:15.569965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa0643cd-8613-4c9c-9eb3-3823568e8def tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:15.570771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa0643cd-8613-4c9c-9eb3-3823568e8def tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:15.571470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa0643cd-8613-4c9c-9eb3-3823568e8def tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:15.572389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa0643cd-8613-4c9c-9eb3-3823568e8def tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:15.576945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa0643cd-8613-4c9c-9eb3-3823568e8def tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:15.577742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa0643cd-8613-4c9c-9eb3-3823568e8def tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:15.641190 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-35b3058f-175b-42dd-96b7-cd51e91544ff tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 204 len: 0 microversion: 2.1 time: 0.208260 Oct 10 23:29:15.643076 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1464/3033] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:29:15 2022] DELETE /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:29:15.649953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dfb49ecf-b218-42e0-9b0d-ec2021f7a9d3 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Calling method '.version_select at 0x7f662aa68940>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:15.710952 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dfb49ecf-b218-42e0-9b0d-ec2021f7a9d3 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/c9f1e5fa-d896-4a34-acd0-5cc657cfd4a4" status: 200 len: 246 microversion: 2.1 time: 0.066189 Oct 10 23:29:15.712430 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1465/3034] 10.222.0.23 () {58 vars in 1269 bytes} [Mon Oct 10 23:29:15 2022] GET /compute/v2.1/os-security-groups/c9f1e5fa-d896-4a34-acd0-5cc657cfd4a4 => generated 246 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:15.718568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d8294fce-bca8-4258-9834-05cbf18af0b5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:15.719607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d8294fce-bca8-4258-9834-05cbf18af0b5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:15.728775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8294fce-bca8-4258-9834-05cbf18af0b5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:15.729674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8294fce-bca8-4258-9834-05cbf18af0b5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:15.730332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8294fce-bca8-4258-9834-05cbf18af0b5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:15.731402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8294fce-bca8-4258-9834-05cbf18af0b5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:15.732164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8294fce-bca8-4258-9834-05cbf18af0b5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:15.732968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8294fce-bca8-4258-9834-05cbf18af0b5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:15.914531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d8294fce-bca8-4258-9834-05cbf18af0b5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:15.927227 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d8294fce-bca8-4258-9834-05cbf18af0b5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1472 microversion: 2.1 time: 0.212842 Oct 10 23:29:15.928363 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1466/3035] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:15 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1472 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:15.933480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fceb6661-819f-4453-9c47-2e91104f4f8a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:15.934337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fceb6661-819f-4453-9c47-2e91104f4f8a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:15.941793 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fceb6661-819f-4453-9c47-2e91104f4f8a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:15.942593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fceb6661-819f-4453-9c47-2e91104f4f8a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:15.943215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fceb6661-819f-4453-9c47-2e91104f4f8a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:15.944115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fceb6661-819f-4453-9c47-2e91104f4f8a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:15.944763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fceb6661-819f-4453-9c47-2e91104f4f8a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:15.945536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fceb6661-819f-4453-9c47-2e91104f4f8a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:16.099106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-aa0643cd-8613-4c9c-9eb3-3823568e8def tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:16.109145 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-aa0643cd-8613-4c9c-9eb3-3823568e8def tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1403 microversion: 2.1 time: 0.562420 Oct 10 23:29:16.114830 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1570/3036] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:15 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1403 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:16.121159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e632a4ec-4106-4813-bc91-29d0454be9e8 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Action: 'create', calling method: .version_select at 0x7f662b0c6dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-758702897", "description": "tempest-description-1328198720"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:16.158822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fceb6661-819f-4453-9c47-2e91104f4f8a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:16.169904 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fceb6661-819f-4453-9c47-2e91104f4f8a tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1491 microversion: 2.1 time: 0.239582 Oct 10 23:29:16.171228 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1467/3037] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:15 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1491 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:16.177028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d1038b0a-d387-4f2d-99a4-fc3935d83b17 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:16.177853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d1038b0a-d387-4f2d-99a4-fc3935d83b17 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 532ff31c-bdc2-44d4-8e95-328263ebc63f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:16.185644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1038b0a-d387-4f2d-99a4-fc3935d83b17 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:16.186302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1038b0a-d387-4f2d-99a4-fc3935d83b17 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:16.186857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1038b0a-d387-4f2d-99a4-fc3935d83b17 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:16.187715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1038b0a-d387-4f2d-99a4-fc3935d83b17 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:16.188306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1038b0a-d387-4f2d-99a4-fc3935d83b17 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:16.188840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1038b0a-d387-4f2d-99a4-fc3935d83b17 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:16.358492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d1038b0a-d387-4f2d-99a4-fc3935d83b17 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:16.369173 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d1038b0a-d387-4f2d-99a4-fc3935d83b17 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f" status: 200 len: 1324 microversion: 2.1 time: 0.196032 Oct 10 23:29:16.412229 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1468/3038] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:16 2022] GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f => generated 1324 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:16.484915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-13de69fb-2470-48d5-bbf7-4dc38be74871 req-b2b78533-19a5-417b-bfa6-9bea1ccb0628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "tag": "575d047b-0d89-4ae3-b746-a43054af851b"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:16.495921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-13de69fb-2470-48d5-bbf7-4dc38be74871 req-b2b78533-19a5-417b-bfa6-9bea1ccb0628 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:16.496427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-13de69fb-2470-48d5-bbf7-4dc38be74871 req-b2b78533-19a5-417b-bfa6-9bea1ccb0628 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:16.498142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-13de69fb-2470-48d5-bbf7-4dc38be74871 req-b2b78533-19a5-417b-bfa6-9bea1ccb0628 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:16.526961 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-13de69fb-2470-48d5-bbf7-4dc38be74871 req-b2b78533-19a5-417b-bfa6-9bea1ccb0628 service nova] Creating event network-changed:575d047b-0d89-4ae3-b746-a43054af851b for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:29:16.536254 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-13de69fb-2470-48d5-bbf7-4dc38be74871 req-b2b78533-19a5-417b-bfa6-9bea1ccb0628 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054533 Oct 10 23:29:16.537081 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1469/3039] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:16.577143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c08fc194-7051-47d4-9c70-e3fa51c243f9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:16.578271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c08fc194-7051-47d4-9c70-e3fa51c243f9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:16.597187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c08fc194-7051-47d4-9c70-e3fa51c243f9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:16.597804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c08fc194-7051-47d4-9c70-e3fa51c243f9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:16.598342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c08fc194-7051-47d4-9c70-e3fa51c243f9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:16.599479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c08fc194-7051-47d4-9c70-e3fa51c243f9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:16.600032 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c08fc194-7051-47d4-9c70-e3fa51c243f9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:16.600632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c08fc194-7051-47d4-9c70-e3fa51c243f9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:16.615141 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e632a4ec-4106-4813-bc91-29d0454be9e8 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.498926 Oct 10 23:29:16.625675 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1571/3040] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:29:16 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:16.630416 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:16.630756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-427908cf-6ac4-4079-9631-702dd3e8e7fc tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Action: 'create', calling method: .version_select at 0x7f662b17cee0>, body: {"security_group_rule": {"parent_group_id": "d7a883e6-3ffc-42a9-81b9-e03fe480d053", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:17.018168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c08fc194-7051-47d4-9c70-e3fa51c243f9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:17.028042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c08fc194-7051-47d4-9c70-e3fa51c243f9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:17.038706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c08fc194-7051-47d4-9c70-e3fa51c243f9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:17.043045 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c08fc194-7051-47d4-9c70-e3fa51c243f9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1847 microversion: 2.32 time: 0.469197 Oct 10 23:29:17.043900 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1470/3041] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:16 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1847 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:17.077681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-e81f1de4-dae6-42a5-9fbb-2f09602507f4 req-94faf7a1-5aaf-46a0-aca1-de04d7463ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "532ff31c-bdc2-44d4-8e95-328263ebc63f", "name": "network-vif-plugged", "status": "completed", "tag": "6a32f134-8050-4053-8c4e-b1a5e53b0952"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:17.095271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e81f1de4-dae6-42a5-9fbb-2f09602507f4 req-94faf7a1-5aaf-46a0-aca1-de04d7463ff8 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:17.098055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e81f1de4-dae6-42a5-9fbb-2f09602507f4 req-94faf7a1-5aaf-46a0-aca1-de04d7463ff8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:17.112177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e81f1de4-dae6-42a5-9fbb-2f09602507f4 req-94faf7a1-5aaf-46a0-aca1-de04d7463ff8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:17.167421 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-e81f1de4-dae6-42a5-9fbb-2f09602507f4 req-94faf7a1-5aaf-46a0-aca1-de04d7463ff8 service nova] Creating event network-vif-plugged:6a32f134-8050-4053-8c4e-b1a5e53b0952 for instance 532ff31c-bdc2-44d4-8e95-328263ebc63f on n-h2-860864-2 Oct 10 23:29:17.177039 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-e81f1de4-dae6-42a5-9fbb-2f09602507f4 req-94faf7a1-5aaf-46a0-aca1-de04d7463ff8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110580 Oct 10 23:29:17.195275 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1471/3042] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:17.205039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-38326d76-442f-4b64-a5a9-25557a199cb6 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:17.206079 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-38326d76-442f-4b64-a5a9-25557a199cb6 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:17.213697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38326d76-442f-4b64-a5a9-25557a199cb6 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:17.214453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38326d76-442f-4b64-a5a9-25557a199cb6 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:17.215052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38326d76-442f-4b64-a5a9-25557a199cb6 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:17.216083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38326d76-442f-4b64-a5a9-25557a199cb6 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:17.216704 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38326d76-442f-4b64-a5a9-25557a199cb6 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:17.217318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38326d76-442f-4b64-a5a9-25557a199cb6 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:17.470178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-38326d76-442f-4b64-a5a9-25557a199cb6 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:17.498859 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-38326d76-442f-4b64-a5a9-25557a199cb6 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1472 microversion: 2.1 time: 0.301748 Oct 10 23:29:17.501754 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1472/3043] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:17 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1472 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:17.533342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-41e561ef-ffca-4d40-857a-a68c5c935ed2 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:17.535592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-41e561ef-ffca-4d40-857a-a68c5c935ed2 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:17.552095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41e561ef-ffca-4d40-857a-a68c5c935ed2 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:17.553333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41e561ef-ffca-4d40-857a-a68c5c935ed2 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:17.553799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41e561ef-ffca-4d40-857a-a68c5c935ed2 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:17.562267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41e561ef-ffca-4d40-857a-a68c5c935ed2 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:17.563612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41e561ef-ffca-4d40-857a-a68c5c935ed2 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:17.564469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41e561ef-ffca-4d40-857a-a68c5c935ed2 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:17.639863 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-427908cf-6ac4-4079-9631-702dd3e8e7fc tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.012944 Oct 10 23:29:17.641457 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1572/3044] 10.222.0.23 () {60 vars in 1195 bytes} [Mon Oct 10 23:29:16 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:17.648808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e67b5006-edb4-4e27-9290-3c70b31363ef tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:17.650287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e67b5006-edb4-4e27-9290-3c70b31363ef tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:17.662596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e67b5006-edb4-4e27-9290-3c70b31363ef tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:17.663569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e67b5006-edb4-4e27-9290-3c70b31363ef tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:17.664208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e67b5006-edb4-4e27-9290-3c70b31363ef tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:17.665114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e67b5006-edb4-4e27-9290-3c70b31363ef tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:17.665763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e67b5006-edb4-4e27-9290-3c70b31363ef tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:17.666357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e67b5006-edb4-4e27-9290-3c70b31363ef tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:17.755355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-41e561ef-ffca-4d40-857a-a68c5c935ed2 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:17.769108 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-41e561ef-ffca-4d40-857a-a68c5c935ed2 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1403 microversion: 2.1 time: 0.247962 Oct 10 23:29:17.769999 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1473/3045] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:17 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1403 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:17.776282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2df4f54d-798f-4f0b-8218-caac9f048fbe tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:17.779189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2df4f54d-798f-4f0b-8218-caac9f048fbe tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 532ff31c-bdc2-44d4-8e95-328263ebc63f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:17.787317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2df4f54d-798f-4f0b-8218-caac9f048fbe tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:17.788080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2df4f54d-798f-4f0b-8218-caac9f048fbe tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:17.788693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2df4f54d-798f-4f0b-8218-caac9f048fbe tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:17.790657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2df4f54d-798f-4f0b-8218-caac9f048fbe tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:17.791356 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2df4f54d-798f-4f0b-8218-caac9f048fbe tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:17.792064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2df4f54d-798f-4f0b-8218-caac9f048fbe tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:18.073315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e67b5006-edb4-4e27-9290-3c70b31363ef tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:18.086354 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e67b5006-edb4-4e27-9290-3c70b31363ef tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1491 microversion: 2.1 time: 0.442159 Oct 10 23:29:18.087432 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1573/3046] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:17 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1491 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:18.093831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bc87ff51-7b88-43bf-999d-7f00d7bf48b6 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Action: 'create', calling method: .version_select at 0x7f662b13fca0>, body: {"security_group_rule": {"parent_group_id": "d7a883e6-3ffc-42a9-81b9-e03fe480d053", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:18.099742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2df4f54d-798f-4f0b-8218-caac9f048fbe tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:18.108710 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2df4f54d-798f-4f0b-8218-caac9f048fbe tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f" status: 200 len: 1324 microversion: 2.1 time: 0.337473 Oct 10 23:29:18.126795 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1474/3047] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:17 2022] GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f => generated 1324 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:18.133457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-082bf8c8-1e77-4f75-a82d-bd7e03b2dff1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:18.134491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-082bf8c8-1e77-4f75-a82d-bd7e03b2dff1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:18.141577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-082bf8c8-1e77-4f75-a82d-bd7e03b2dff1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:18.143615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-082bf8c8-1e77-4f75-a82d-bd7e03b2dff1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:18.144221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-082bf8c8-1e77-4f75-a82d-bd7e03b2dff1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:18.145099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-082bf8c8-1e77-4f75-a82d-bd7e03b2dff1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:18.145755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-082bf8c8-1e77-4f75-a82d-bd7e03b2dff1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:18.146347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-082bf8c8-1e77-4f75-a82d-bd7e03b2dff1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:18.484795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-082bf8c8-1e77-4f75-a82d-bd7e03b2dff1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:18.514224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-082bf8c8-1e77-4f75-a82d-bd7e03b2dff1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:18.518782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-082bf8c8-1e77-4f75-a82d-bd7e03b2dff1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:18.520784 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-082bf8c8-1e77-4f75-a82d-bd7e03b2dff1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1868 microversion: 2.32 time: 0.392373 Oct 10 23:29:18.521441 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bc87ff51-7b88-43bf-999d-7f00d7bf48b6 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.432656 Oct 10 23:29:18.522615 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1574/3048] 10.222.0.23 () {60 vars in 1195 bytes} [Mon Oct 10 23:29:18 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:18.524556 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1475/3049] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:18 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1868 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:18.529519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-684f464e-83c4-43b9-b6be-414471aa00de tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:18.531055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-684f464e-83c4-43b9-b6be-414471aa00de tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:18.534790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a0eda607-6cf9-4745-898d-f54a68c458f7 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Calling method '.version_select at 0x7f662b518940>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:18.539193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-684f464e-83c4-43b9-b6be-414471aa00de tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:18.539901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-684f464e-83c4-43b9-b6be-414471aa00de tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:18.541128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-684f464e-83c4-43b9-b6be-414471aa00de tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:18.542035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-684f464e-83c4-43b9-b6be-414471aa00de tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:18.542668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-684f464e-83c4-43b9-b6be-414471aa00de tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:18.543257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-684f464e-83c4-43b9-b6be-414471aa00de tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:18.662951 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a0eda607-6cf9-4745-898d-f54a68c458f7 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/d7a883e6-3ffc-42a9-81b9-e03fe480d053" status: 200 len: 664 microversion: 2.1 time: 0.132095 Oct 10 23:29:18.666385 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1476/3050] 10.222.0.23 () {58 vars in 1269 bytes} [Mon Oct 10 23:29:18 2022] GET /compute/v2.1/os-security-groups/d7a883e6-3ffc-42a9-81b9-e03fe480d053 => generated 664 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:29:18.682176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-c830c0f5-192b-4d53-b75f-ad6aaf677de9 req-23a561de-ee22-4e69-8856-7adf4ab38948 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "tag": "240e1ee2-1172-4479-82d1-59dc4e88df9c"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:18.694717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c830c0f5-192b-4d53-b75f-ad6aaf677de9 req-23a561de-ee22-4e69-8856-7adf4ab38948 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:18.695240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c830c0f5-192b-4d53-b75f-ad6aaf677de9 req-23a561de-ee22-4e69-8856-7adf4ab38948 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:18.695683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c830c0f5-192b-4d53-b75f-ad6aaf677de9 req-23a561de-ee22-4e69-8856-7adf4ab38948 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:18.709697 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-c830c0f5-192b-4d53-b75f-ad6aaf677de9 req-23a561de-ee22-4e69-8856-7adf4ab38948 service nova] Creating event network-changed:240e1ee2-1172-4479-82d1-59dc4e88df9c for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:29:18.719433 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-c830c0f5-192b-4d53-b75f-ad6aaf677de9 req-23a561de-ee22-4e69-8856-7adf4ab38948 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050902 Oct 10 23:29:18.720658 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1477/3051] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:18.727610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cbf07b31-89d0-4272-be6d-c0c28df4b5c1 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Calling method '.version_select at 0x7f662a9c11f0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:18.848215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-684f464e-83c4-43b9-b6be-414471aa00de tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:18.873783 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-684f464e-83c4-43b9-b6be-414471aa00de tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1472 microversion: 2.1 time: 0.349741 Oct 10 23:29:18.877784 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1575/3052] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:18 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1472 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:18.890220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-828cddd8-0343-4060-85de-0261dae31454 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:18.891174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-828cddd8-0343-4060-85de-0261dae31454 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:18.900784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-828cddd8-0343-4060-85de-0261dae31454 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:18.901281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-828cddd8-0343-4060-85de-0261dae31454 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:18.901835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-828cddd8-0343-4060-85de-0261dae31454 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:18.902434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-828cddd8-0343-4060-85de-0261dae31454 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:18.902887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-828cddd8-0343-4060-85de-0261dae31454 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:18.903455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-828cddd8-0343-4060-85de-0261dae31454 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:19.194419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-828cddd8-0343-4060-85de-0261dae31454 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:19.205852 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-828cddd8-0343-4060-85de-0261dae31454 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1403 microversion: 2.1 time: 0.326890 Oct 10 23:29:19.208686 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1576/3053] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:18 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1403 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:19.214425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-caeae1a3-0eec-4156-9d7a-3de9e45f3223 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:19.215269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-caeae1a3-0eec-4156-9d7a-3de9e45f3223 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:19.239249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-caeae1a3-0eec-4156-9d7a-3de9e45f3223 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:19.243566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-caeae1a3-0eec-4156-9d7a-3de9e45f3223 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:19.244225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-caeae1a3-0eec-4156-9d7a-3de9e45f3223 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:19.246564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-caeae1a3-0eec-4156-9d7a-3de9e45f3223 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:19.248082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-caeae1a3-0eec-4156-9d7a-3de9e45f3223 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:19.251669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-caeae1a3-0eec-4156-9d7a-3de9e45f3223 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:19.479402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-caeae1a3-0eec-4156-9d7a-3de9e45f3223 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1aca1de5b64298b6e5d0ba3c554fb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44777346e7e541389e24fe42c4d46cbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:19.490862 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-caeae1a3-0eec-4156-9d7a-3de9e45f3223 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 200 len: 1449 microversion: 2.1 time: 0.280823 Oct 10 23:29:19.507272 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1577/3054] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:19 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 1449 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:19.507272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-facb5b62-85f8-4369-b0bf-dddb48b906df tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:19.507272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-facb5b62-85f8-4369-b0bf-dddb48b906df tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 532ff31c-bdc2-44d4-8e95-328263ebc63f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:19.526382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-facb5b62-85f8-4369-b0bf-dddb48b906df tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:19.526806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-facb5b62-85f8-4369-b0bf-dddb48b906df tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:19.529362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-facb5b62-85f8-4369-b0bf-dddb48b906df tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:19.530221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-facb5b62-85f8-4369-b0bf-dddb48b906df tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:19.530699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-facb5b62-85f8-4369-b0bf-dddb48b906df tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:19.531134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-facb5b62-85f8-4369-b0bf-dddb48b906df tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:19.707517 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cbf07b31-89d0-4272-be6d-c0c28df4b5c1 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/52066217-3ad4-49ea-b62e-08aa43afde2c" status: 202 len: 0 microversion: 2.1 time: 0.985382 Oct 10 23:29:19.711035 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1478/3055] 10.222.0.23 () {58 vars in 1287 bytes} [Mon Oct 10 23:29:18 2022] DELETE /compute/v2.1/os-security-group-rules/52066217-3ad4-49ea-b62e-08aa43afde2c => generated 0 bytes in 989 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:29:19.719333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-909880aa-6e5c-4317-8305-c3b91476182c req-f2b974ab-d763-48fa-b0b8-2c6bad8b4ebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094e9aed-7746-4a4c-81d5-ccc6d6c3d74e", "name": "network-vif-plugged", "status": "completed", "tag": "fb699f20-bd58-4051-be00-7bc3a1b04ec6"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:19.746540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-909880aa-6e5c-4317-8305-c3b91476182c req-f2b974ab-d763-48fa-b0b8-2c6bad8b4ebc service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:19.747556 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-909880aa-6e5c-4317-8305-c3b91476182c req-f2b974ab-d763-48fa-b0b8-2c6bad8b4ebc service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:19.748279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-909880aa-6e5c-4317-8305-c3b91476182c req-f2b974ab-d763-48fa-b0b8-2c6bad8b4ebc service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:19.762391 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-909880aa-6e5c-4317-8305-c3b91476182c req-f2b974ab-d763-48fa-b0b8-2c6bad8b4ebc service nova] Creating event network-vif-plugged:fb699f20-bd58-4051-be00-7bc3a1b04ec6 for instance 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e on n-h1-860864-2 Oct 10 23:29:19.770184 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-909880aa-6e5c-4317-8305-c3b91476182c req-f2b974ab-d763-48fa-b0b8-2c6bad8b4ebc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057103 Oct 10 23:29:19.771068 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1479/3056] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:19.779629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-bfdcd706-5891-4666-b48c-cc54ce515913 req-75ef4c15-4bea-4530-b584-28037425075f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6fbaa2c-2c0f-490a-974e-43b899dcc5bc", "name": "network-vif-deleted", "tag": "7e626df1-9936-4b1c-b65c-f8e10f3d2223"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:19.798746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-bfdcd706-5891-4666-b48c-cc54ce515913 req-75ef4c15-4bea-4530-b584-28037425075f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:19.799616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-bfdcd706-5891-4666-b48c-cc54ce515913 req-75ef4c15-4bea-4530-b584-28037425075f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:19.800509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-bfdcd706-5891-4666-b48c-cc54ce515913 req-75ef4c15-4bea-4530-b584-28037425075f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:19.818048 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-bfdcd706-5891-4666-b48c-cc54ce515913 req-75ef4c15-4bea-4530-b584-28037425075f service nova] Creating event network-vif-deleted:7e626df1-9936-4b1c-b65c-f8e10f3d2223 for instance f6fbaa2c-2c0f-490a-974e-43b899dcc5bc on n-h2-860864-2 Oct 10 23:29:19.823983 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-bfdcd706-5891-4666-b48c-cc54ce515913 req-75ef4c15-4bea-4530-b584-28037425075f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051262 Oct 10 23:29:19.825756 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1480/3057] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:19.834294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-98376f61-725f-49cc-8cce-96be66137471 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:19.835339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-98376f61-725f-49cc-8cce-96be66137471 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:19.843599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98376f61-725f-49cc-8cce-96be66137471 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:19.844442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98376f61-725f-49cc-8cce-96be66137471 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:19.845814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98376f61-725f-49cc-8cce-96be66137471 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:19.846931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98376f61-725f-49cc-8cce-96be66137471 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:19.847832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98376f61-725f-49cc-8cce-96be66137471 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:19.848488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98376f61-725f-49cc-8cce-96be66137471 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:19.931132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-facb5b62-85f8-4369-b0bf-dddb48b906df tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:19.953620 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-facb5b62-85f8-4369-b0bf-dddb48b906df tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f" status: 200 len: 1519 microversion: 2.1 time: 0.454235 Oct 10 23:29:19.957339 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1578/3058] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:19 2022] GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f => generated 1519 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:19.964056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ae0df6e2-d33e-4800-82df-435bb6582b91 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Calling method '.version_select at 0x7f662b13f9d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:20.128541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-98376f61-725f-49cc-8cce-96be66137471 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:20.150289 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-98376f61-725f-49cc-8cce-96be66137471 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:20.155504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-98376f61-725f-49cc-8cce-96be66137471 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:20.161569 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-98376f61-725f-49cc-8cce-96be66137471 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1889 microversion: 2.32 time: 0.331571 Oct 10 23:29:20.164191 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1481/3059] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:19 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1889 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:20.178023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-afd60355-0241-4250-b9ac-6459717727ac tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:20.196061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-afd60355-0241-4250-b9ac-6459717727ac tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:20.219964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afd60355-0241-4250-b9ac-6459717727ac tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:20.225522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afd60355-0241-4250-b9ac-6459717727ac tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:20.228121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afd60355-0241-4250-b9ac-6459717727ac tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:20.230310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afd60355-0241-4250-b9ac-6459717727ac tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:20.233935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afd60355-0241-4250-b9ac-6459717727ac tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:20.236305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afd60355-0241-4250-b9ac-6459717727ac tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:20.383989 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ae0df6e2-d33e-4800-82df-435bb6582b91 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/d7a883e6-3ffc-42a9-81b9-e03fe480d053" status: 202 len: 0 microversion: 2.1 time: 0.425124 Oct 10 23:29:20.390175 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1579/3060] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:29:19 2022] DELETE /compute/v2.1/os-security-groups/d7a883e6-3ffc-42a9-81b9-e03fe480d053 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:29:20.396198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4e259d54-c737-4471-9b4e-91d3f3098771 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:20.397055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4e259d54-c737-4471-9b4e-91d3f3098771 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 532ff31c-bdc2-44d4-8e95-328263ebc63f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:20.433594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e259d54-c737-4471-9b4e-91d3f3098771 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:20.433594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e259d54-c737-4471-9b4e-91d3f3098771 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:20.433594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e259d54-c737-4471-9b4e-91d3f3098771 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:20.433594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e259d54-c737-4471-9b4e-91d3f3098771 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:20.433594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e259d54-c737-4471-9b4e-91d3f3098771 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:20.433594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e259d54-c737-4471-9b4e-91d3f3098771 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:20.581126 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-afd60355-0241-4250-b9ac-6459717727ac tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:20.597192 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-afd60355-0241-4250-b9ac-6459717727ac tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1472 microversion: 2.1 time: 0.428416 Oct 10 23:29:20.601588 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1482/3061] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:20 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1472 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:20.652109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d9c9fbed-90be-41cf-adf6-2b806cb3d8b1 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:20.652671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d9c9fbed-90be-41cf-adf6-2b806cb3d8b1 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:20.674153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4e259d54-c737-4471-9b4e-91d3f3098771 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:20.686984 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9c9fbed-90be-41cf-adf6-2b806cb3d8b1 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:20.687857 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4e259d54-c737-4471-9b4e-91d3f3098771 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f" status: 200 len: 1519 microversion: 2.1 time: 0.296365 Oct 10 23:29:20.688968 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1580/3062] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:20 2022] GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f => generated 1519 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:20.695144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9c9fbed-90be-41cf-adf6-2b806cb3d8b1 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:20.699620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-72aab79c-f36c-407c-b84e-234caa0503ea tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Calling method '.version_select at 0x7f662b94b1f0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:20.707720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9c9fbed-90be-41cf-adf6-2b806cb3d8b1 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:20.709099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9c9fbed-90be-41cf-adf6-2b806cb3d8b1 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:20.709610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9c9fbed-90be-41cf-adf6-2b806cb3d8b1 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:20.710045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9c9fbed-90be-41cf-adf6-2b806cb3d8b1 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:20.741762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG neutronclient.v2_0.client [None req-72aab79c-f36c-407c-b84e-234caa0503ea tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 53c77b16-3df9-4065-88b8-fe091040b73d does not exist", "detail": ""}} {{(pid=120613) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:29:20.742382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.security_group_api [None req-72aab79c-f36c-407c-b84e-234caa0503ea tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Neutron security group 53c77b16-3df9-4065-88b8-fe091040b73d not found {{(pid=120613) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 23:29:20.742923 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-72aab79c-f36c-407c-b84e-234caa0503ea tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] HTTP exception thrown: Security group 53c77b16-3df9-4065-88b8-fe091040b73d does not exist Oct 10 23:29:20.742923 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-3b2dceae-c1b1-47d0-9eaa-99398350045c'] Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-72aab79c-f36c-407c-b84e-234caa0503ea tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Request method failure captured: Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/os-security-groups/53c77b16-3df9-4065-88b8-fe091040b73d HTTP/1.1 Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKrDdz91M9e1gIUJnVCPU1DDDTELZPb2q9hK4aGUvwLfOVr_9NS5C-X7ZUgsMtKIdzTfAPBnZ4o9qrART_rS4gpIpf4rRvKkWXsH3NfgVhAQ8J6HO1C0owo6gm0fsAcvoNOElr9LSJvu8dFQNlJheeSIS3QYIA-s0B7XWwT-bhcuLJ4 Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 6e8f19921d334a43b4bdc3f1035d43ca Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1647389845 Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6e8f19921d334a43b4bdc3f1035d43ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6e8f19921d334a43b4bdc3f1035d43ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6e8f19921d334a43b4bdc3f1035d43ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6e8f19921d334a43b4bdc3f1035d43ca", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1647389845 Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 6e8f19921d334a43b4bdc3f1035d43ca Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1647389845 Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-SecurityGroupRulesTestJSON-1647389845-project Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 0bc970f5c2384e27b2a88c2b46b58209 Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1647389845-project Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: exception: Security group 53c77b16-3df9-4065-88b8-fe091040b73d does not exist Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-3b2dceae-c1b1-47d0-9eaa-99398350045c'] Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '53c77b16-3df9-4065-88b8-fe091040b73d'} Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:29:20.744786 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 53c77b16-3df9-4065-88b8-fe091040b73d does not exist Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b2dceae-c1b1-47d0-9eaa-99398350045c'] Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 53c77b16-3df9-4065-88b8-fe091040b73d does not exist Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b2dceae-c1b1-47d0-9eaa-99398350045c'] Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 53c77b16-3df9-4065-88b8-fe091040b73d does not exist Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b2dceae-c1b1-47d0-9eaa-99398350045c'] Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 53c77b16-3df9-4065-88b8-fe091040b73d does not exist Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3b2dceae-c1b1-47d0-9eaa-99398350045c'] Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-72aab79c-f36c-407c-b84e-234caa0503ea tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Returning 404 to user: Security group 53c77b16-3df9-4065-88b8-fe091040b73d does not exist Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-3b2dceae-c1b1-47d0-9eaa-99398350045c'] {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-72aab79c-f36c-407c-b84e-234caa0503ea tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/53c77b16-3df9-4065-88b8-fe091040b73d" status: 404 len: 194 microversion: 2.1 time: 0.055847 Oct 10 23:29:20.748736 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1581/3063] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:29:20 2022] DELETE /compute/v2.1/os-security-groups/53c77b16-3df9-4065-88b8-fe091040b73d => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:29:20.757666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5247b0b5-5222-48a9-88c2-d2d7d8bb3138 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:20.758301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5247b0b5-5222-48a9-88c2-d2d7d8bb3138 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] [instance: f6fbaa2c-2c0f-490a-974e-43b899dcc5bc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:20.786793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5247b0b5-5222-48a9-88c2-d2d7d8bb3138 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:20.787292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5247b0b5-5222-48a9-88c2-d2d7d8bb3138 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:20.787733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5247b0b5-5222-48a9-88c2-d2d7d8bb3138 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:20.788441 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5247b0b5-5222-48a9-88c2-d2d7d8bb3138 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:20.788893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5247b0b5-5222-48a9-88c2-d2d7d8bb3138 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:20.789338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5247b0b5-5222-48a9-88c2-d2d7d8bb3138 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:20.835590 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-5247b0b5-5222-48a9-88c2-d2d7d8bb3138 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] HTTP exception thrown: Instance f6fbaa2c-2c0f-490a-974e-43b899dcc5bc could not be found. Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5247b0b5-5222-48a9-88c2-d2d7d8bb3138 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Request method failure captured: Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc HTTP/1.1 Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKopDyARPUMe5H6ZWwZZ-NnryPbry3nBQ4z9GbYxFozcOEJzCAYfyagyta5JY6HEfLEIBCuMBRXVwUqflQwm3E4PWo9OQ5U_lMjjgFGTG1BMYA2n9-6gEdmZ8Ccbp_TZplqvsKcxtLLWhUB20ugWkRo3uiJqSr2WOf3_7XeyMTpA3qU Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 44777346e7e541389e24fe42c4d46cbf Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerRescueTestJSON-779207136 Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/44777346e7e541389e24fe42c4d46cbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44777346e7e541389e24fe42c4d46cbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/44777346e7e541389e24fe42c4d46cbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_44777346e7e541389e24fe42c4d46cbf", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerRescueTestJSON-779207136 Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 44777346e7e541389e24fe42c4d46cbf Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerRescueTestJSON-779207136 Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerRescueTestJSON-779207136-project Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 1f1aca1de5b64298b6e5d0ba3c554fb7 Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerRescueTestJSON-779207136-project Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance f6fbaa2c-2c0f-490a-974e-43b899dcc5bc could not be found. Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'f6fbaa2c-2c0f-490a-974e-43b899dcc5bc'} Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6fbaa2c-2c0f-490a-974e-43b899dcc5bc could not be found. Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6fbaa2c-2c0f-490a-974e-43b899dcc5bc could not be found. Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:20.837146 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:20.841988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:20.841988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:20.841988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:20.841988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:29:20.841988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:29:20.841988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6fbaa2c-2c0f-490a-974e-43b899dcc5bc could not be found. Oct 10 23:29:20.841988 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:20.842947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5247b0b5-5222-48a9-88c2-d2d7d8bb3138 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] Returning 404 to user: Instance f6fbaa2c-2c0f-490a-974e-43b899dcc5bc could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:29:20.843857 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5247b0b5-5222-48a9-88c2-d2d7d8bb3138 tempest-ServerRescueTestJSON-779207136 tempest-ServerRescueTestJSON-779207136-project] 10.222.0.23 "GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc" status: 404 len: 111 microversion: 2.1 time: 0.089875 Oct 10 23:29:20.848266 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1582/3064] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:20 2022] GET /compute/v2.1/servers/f6fbaa2c-2c0f-490a-974e-43b899dcc5bc => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:29:20.852885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4be2421b-db79-42ff-857e-18997e304424 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:20.855400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4be2421b-db79-42ff-857e-18997e304424 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:20.868343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4be2421b-db79-42ff-857e-18997e304424 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:20.869219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4be2421b-db79-42ff-857e-18997e304424 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:20.869848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4be2421b-db79-42ff-857e-18997e304424 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:20.870718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4be2421b-db79-42ff-857e-18997e304424 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:20.871328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4be2421b-db79-42ff-857e-18997e304424 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:20.872527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4be2421b-db79-42ff-857e-18997e304424 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:20.911463 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4be2421b-db79-42ff-857e-18997e304424 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062221 Oct 10 23:29:20.919261 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1583/3065] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:29:20 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:29:20.926332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-abcda08f-c239-44b7-ae6b-ef20a82c1d19 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-768267581"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:20.929077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-abcda08f-c239-44b7-ae6b-ef20a82c1d19 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 532ff31c-bdc2-44d4-8e95-328263ebc63f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:20.938543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abcda08f-c239-44b7-ae6b-ef20a82c1d19 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:20.940531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abcda08f-c239-44b7-ae6b-ef20a82c1d19 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:20.941137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abcda08f-c239-44b7-ae6b-ef20a82c1d19 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:20.942090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abcda08f-c239-44b7-ae6b-ef20a82c1d19 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:20.942795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abcda08f-c239-44b7-ae6b-ef20a82c1d19 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:20.943496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abcda08f-c239-44b7-ae6b-ef20a82c1d19 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:21.352432 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-abcda08f-c239-44b7-ae6b-ef20a82c1d19 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "POST /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f/action" status: 202 len: 0 microversion: 2.1 time: 0.427390 Oct 10 23:29:21.355789 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1584/3066] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:29:20 2022] POST /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 23:29:21.371873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-054477fa-854e-4b70-a1fd-c2ac122b369a tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Calling method '.version_select at 0x7f662b56dca0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:21.504930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d9c9fbed-90be-41cf-adf6-2b806cb3d8b1 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:21.520693 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d9c9fbed-90be-41cf-adf6-2b806cb3d8b1 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1403 microversion: 2.1 time: 0.916987 Oct 10 23:29:21.522005 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1483/3067] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:20 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1403 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:21.527124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-50089886-bec1-433e-81e4-46aeb4f5787f req-384253b6-2f33-4c2a-9d2c-84ea741161fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "tag": "7e9ff285-00b1-425e-abd8-7ec7fce5505e"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:21.562323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-50089886-bec1-433e-81e4-46aeb4f5787f req-384253b6-2f33-4c2a-9d2c-84ea741161fd service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:21.574191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-50089886-bec1-433e-81e4-46aeb4f5787f req-384253b6-2f33-4c2a-9d2c-84ea741161fd service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:21.574967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-50089886-bec1-433e-81e4-46aeb4f5787f req-384253b6-2f33-4c2a-9d2c-84ea741161fd service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:21.599784 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-50089886-bec1-433e-81e4-46aeb4f5787f req-384253b6-2f33-4c2a-9d2c-84ea741161fd service nova] Creating event network-changed:7e9ff285-00b1-425e-abd8-7ec7fce5505e for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:29:21.611208 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-50089886-bec1-433e-81e4-46aeb4f5787f req-384253b6-2f33-4c2a-9d2c-84ea741161fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087627 Oct 10 23:29:21.614186 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1484/3068] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:21.629357 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0a6fe905-cad8-45bd-9d49-e1e1d5630bc9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:21.630581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0a6fe905-cad8-45bd-9d49-e1e1d5630bc9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:21.649816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a6fe905-cad8-45bd-9d49-e1e1d5630bc9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:21.650738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a6fe905-cad8-45bd-9d49-e1e1d5630bc9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:21.651388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a6fe905-cad8-45bd-9d49-e1e1d5630bc9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:21.652317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a6fe905-cad8-45bd-9d49-e1e1d5630bc9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:21.652973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a6fe905-cad8-45bd-9d49-e1e1d5630bc9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:21.654137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a6fe905-cad8-45bd-9d49-e1e1d5630bc9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:22.072077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0a6fe905-cad8-45bd-9d49-e1e1d5630bc9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:22.085691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0a6fe905-cad8-45bd-9d49-e1e1d5630bc9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:22.088401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0a6fe905-cad8-45bd-9d49-e1e1d5630bc9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:22.096036 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0a6fe905-cad8-45bd-9d49-e1e1d5630bc9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1889 microversion: 2.32 time: 0.480351 Oct 10 23:29:22.097179 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1485/3069] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:21 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1889 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:22.110369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-18749964-4144-44e9-a2aa-4b0ae9bc5b3e tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:22.112730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-18749964-4144-44e9-a2aa-4b0ae9bc5b3e tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:22.126016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-18749964-4144-44e9-a2aa-4b0ae9bc5b3e tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:22.126829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-18749964-4144-44e9-a2aa-4b0ae9bc5b3e tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:22.127492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-18749964-4144-44e9-a2aa-4b0ae9bc5b3e tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:22.128395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-18749964-4144-44e9-a2aa-4b0ae9bc5b3e tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:22.129035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-18749964-4144-44e9-a2aa-4b0ae9bc5b3e tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:22.129667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-18749964-4144-44e9-a2aa-4b0ae9bc5b3e tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:22.164100 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-18749964-4144-44e9-a2aa-4b0ae9bc5b3e tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065691 Oct 10 23:29:22.168070 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1486/3070] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:29:22 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:29:22.176299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0af43c82-0387-46a2-9ae7-da8946bd0216 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '.version_select at 0x7f662aa68940>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:22.425472 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0af43c82-0387-46a2-9ae7-da8946bd0216 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "DELETE /compute/v2.1/images/1acd0ac6-ee9a-4f91-b858-e908d7defa34" status: 204 len: 0 microversion: 2.1 time: 0.254675 Oct 10 23:29:22.427080 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1487/3071] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:22 2022] DELETE /compute/v2.1/images/1acd0ac6-ee9a-4f91-b858-e908d7defa34 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:29:22.434762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d0d52d3e-9542-4bb5-91a7-e0912dd2263d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:22.437931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d0d52d3e-9542-4bb5-91a7-e0912dd2263d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:22.455953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0d52d3e-9542-4bb5-91a7-e0912dd2263d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:22.457785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0d52d3e-9542-4bb5-91a7-e0912dd2263d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:22.458424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0d52d3e-9542-4bb5-91a7-e0912dd2263d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:22.459234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0d52d3e-9542-4bb5-91a7-e0912dd2263d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:22.462956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0d52d3e-9542-4bb5-91a7-e0912dd2263d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:22.463541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0d52d3e-9542-4bb5-91a7-e0912dd2263d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:22.818198 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-054477fa-854e-4b70-a1fd-c2ac122b369a tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/c9f1e5fa-d896-4a34-acd0-5cc657cfd4a4" status: 202 len: 0 microversion: 2.1 time: 1.457867 Oct 10 23:29:22.818943 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1585/3072] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:29:21 2022] DELETE /compute/v2.1/os-security-groups/c9f1e5fa-d896-4a34-acd0-5cc657cfd4a4 => generated 0 bytes in 1463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:29:22.827233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fe7604c6-cb88-468f-b700-b7765008e2fd tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:22.828220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fe7604c6-cb88-468f-b700-b7765008e2fd tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:22.846227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe7604c6-cb88-468f-b700-b7765008e2fd tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:22.848345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe7604c6-cb88-468f-b700-b7765008e2fd tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:22.848970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe7604c6-cb88-468f-b700-b7765008e2fd tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:22.851632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe7604c6-cb88-468f-b700-b7765008e2fd tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:22.853473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe7604c6-cb88-468f-b700-b7765008e2fd tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:22.865091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe7604c6-cb88-468f-b700-b7765008e2fd tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:22.943829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fe7604c6-cb88-468f-b700-b7765008e2fd tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:29:22.977524 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d0d52d3e-9542-4bb5-91a7-e0912dd2263d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:22.991058 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d0d52d3e-9542-4bb5-91a7-e0912dd2263d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1472 microversion: 2.1 time: 0.559284 Oct 10 23:29:22.991704 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1488/3073] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:22 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1472 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:23.014745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-830a690e-7c03-4297-a618-bec0590efa9c req-6528c05e-b887-4e33-a73b-af4ab2ba42ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "tag": "b8d599b8-79fd-4f70-91f1-14f3dcfc2d85"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:23.025677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-830a690e-7c03-4297-a618-bec0590efa9c req-6528c05e-b887-4e33-a73b-af4ab2ba42ed service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:23.026468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-830a690e-7c03-4297-a618-bec0590efa9c req-6528c05e-b887-4e33-a73b-af4ab2ba42ed service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:23.027173 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-830a690e-7c03-4297-a618-bec0590efa9c req-6528c05e-b887-4e33-a73b-af4ab2ba42ed service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:23.041577 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-830a690e-7c03-4297-a618-bec0590efa9c req-6528c05e-b887-4e33-a73b-af4ab2ba42ed service nova] Creating event network-changed:b8d599b8-79fd-4f70-91f1-14f3dcfc2d85 for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:29:23.042511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:23.049292 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-830a690e-7c03-4297-a618-bec0590efa9c req-6528c05e-b887-4e33-a73b-af4ab2ba42ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041728 Oct 10 23:29:23.050525 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1489/3074] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:23.058314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d801c149-e157-4645-94c1-1b29652276e9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '.version_select at 0x7f662b764430>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:23.094036 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-d801c149-e157-4645-94c1-1b29652276e9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] HTTP exception thrown: Image not found. Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d801c149-e157-4645-94c1-1b29652276e9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Request method failure captured: Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/images/1acd0ac6-ee9a-4f91-b858-e908d7defa34 HTTP/1.1 Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKqJK3S3M2y3xprSZu9nbIarteybsMmlwBqzRadb_OvHrQS6zpz1qbhvGoRjPx1Bkq7rq6URwLI94Tf5sgLizi8MbWTsTS0dzR4a-9d6hn6BO9F5izkVX7qoGeFLYfTljzByP6rv99qdRHR7pF3ZU2UC3x7LIdHCYY6YUpc6lCdMgm4 Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a1c4489c308e462d89b97edcf6c21572", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: f891fce5072c448c97f96a9df58d981e Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: exception: Image not found. Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '1acd0ac6-ee9a-4f91-b858-e908d7defa34'} Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1acd0ac6-ee9a-4f91-b858-e908d7defa34 Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 23:29:23.096619 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1acd0ac6-ee9a-4f91-b858-e908d7defa34 could not be found. Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 23:29:23.103426 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:29:23.112828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d801c149-e157-4645-94c1-1b29652276e9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Returning 404 to user: Image not found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:29:23.114761 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d801c149-e157-4645-94c1-1b29652276e9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/images/1acd0ac6-ee9a-4f91-b858-e908d7defa34" status: 404 len: 62 microversion: 2.1 time: 0.062587 Oct 10 23:29:23.115976 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1490/3075] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:29:23 2022] GET /compute/v2.1/images/1acd0ac6-ee9a-4f91-b858-e908d7defa34 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:29:23.124196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-797c31f9-6cf3-4359-937e-52b730bbc4cd tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:23.125572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-797c31f9-6cf3-4359-937e-52b730bbc4cd tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:23.136845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-797c31f9-6cf3-4359-937e-52b730bbc4cd tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:23.138194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-797c31f9-6cf3-4359-937e-52b730bbc4cd tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:23.138926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-797c31f9-6cf3-4359-937e-52b730bbc4cd tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:23.140165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-797c31f9-6cf3-4359-937e-52b730bbc4cd tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:23.141158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-797c31f9-6cf3-4359-937e-52b730bbc4cd tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:23.141924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-797c31f9-6cf3-4359-937e-52b730bbc4cd tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:23.153696 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fe7604c6-cb88-468f-b700-b7765008e2fd tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "DELETE /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379" status: 204 len: 0 microversion: 2.1 time: 0.331549 Oct 10 23:29:23.161292 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1586/3076] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:29:22 2022] DELETE /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:29:23.167021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e58a3f56-60ef-4999-ac45-13823b14ed84 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Calling method '.version_select at 0x7f662b8433a0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:23.480094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-797c31f9-6cf3-4359-937e-52b730bbc4cd tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:23.495784 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-797c31f9-6cf3-4359-937e-52b730bbc4cd tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1591 microversion: 2.1 time: 0.377603 Oct 10 23:29:23.496560 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1491/3077] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:23 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1591 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:23.503859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-02704180-4669-4469-b4c1-95ce0702b098 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:23.504565 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-02704180-4669-4469-b4c1-95ce0702b098 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:23.511643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02704180-4669-4469-b4c1-95ce0702b098 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:23.512213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02704180-4669-4469-b4c1-95ce0702b098 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:23.513541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02704180-4669-4469-b4c1-95ce0702b098 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:23.522862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02704180-4669-4469-b4c1-95ce0702b098 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:23.528556 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02704180-4669-4469-b4c1-95ce0702b098 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:23.529224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02704180-4669-4469-b4c1-95ce0702b098 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:23.858774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-02704180-4669-4469-b4c1-95ce0702b098 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:23.886285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-02704180-4669-4469-b4c1-95ce0702b098 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:23.888443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-02704180-4669-4469-b4c1-95ce0702b098 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:23.889859 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-02704180-4669-4469-b4c1-95ce0702b098 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1889 microversion: 2.32 time: 0.389977 Oct 10 23:29:23.890709 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1492/3078] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:23 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1889 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:23.898537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bb59b986-9f75-46e9-ad37-0048b8eec6e9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:23.902166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bb59b986-9f75-46e9-ad37-0048b8eec6e9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 532ff31c-bdc2-44d4-8e95-328263ebc63f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:23.917121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb59b986-9f75-46e9-ad37-0048b8eec6e9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:23.919914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb59b986-9f75-46e9-ad37-0048b8eec6e9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:23.921023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb59b986-9f75-46e9-ad37-0048b8eec6e9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:23.922061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb59b986-9f75-46e9-ad37-0048b8eec6e9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:23.922759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb59b986-9f75-46e9-ad37-0048b8eec6e9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:23.923452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb59b986-9f75-46e9-ad37-0048b8eec6e9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:24.222357 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb59b986-9f75-46e9-ad37-0048b8eec6e9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:24.238421 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bb59b986-9f75-46e9-ad37-0048b8eec6e9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f" status: 200 len: 1537 microversion: 2.1 time: 0.345775 Oct 10 23:29:24.239744 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1493/3079] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:23 2022] GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f => generated 1537 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:24.245899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d987a056-1296-4f33-a115-94eced4499fe tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:24.251666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d987a056-1296-4f33-a115-94eced4499fe tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:24.265180 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:24.283960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d987a056-1296-4f33-a115-94eced4499fe tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:24.284794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d987a056-1296-4f33-a115-94eced4499fe tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:24.284794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d987a056-1296-4f33-a115-94eced4499fe tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:24.285404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d987a056-1296-4f33-a115-94eced4499fe tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:24.289665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d987a056-1296-4f33-a115-94eced4499fe tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:24.290108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d987a056-1296-4f33-a115-94eced4499fe tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:24.464873 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e58a3f56-60ef-4999-ac45-13823b14ed84 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/d073f8a2-37c4-4958-a12d-f9b128f8a88b" status: 202 len: 0 microversion: 2.1 time: 1.302064 Oct 10 23:29:24.465690 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1587/3080] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:29:23 2022] DELETE /compute/v2.1/os-security-groups/d073f8a2-37c4-4958-a12d-f9b128f8a88b => generated 0 bytes in 1304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:29:24.471384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e1bded62-2b35-4630-a096-e9bd65277ede tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:24.472391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e1bded62-2b35-4630-a096-e9bd65277ede tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:24.498267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1bded62-2b35-4630-a096-e9bd65277ede tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:24.500358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1bded62-2b35-4630-a096-e9bd65277ede tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:24.502731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1bded62-2b35-4630-a096-e9bd65277ede tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:24.503864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1bded62-2b35-4630-a096-e9bd65277ede tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:24.504949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1bded62-2b35-4630-a096-e9bd65277ede tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:24.505599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1bded62-2b35-4630-a096-e9bd65277ede tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:24.907073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d987a056-1296-4f33-a115-94eced4499fe tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:24.919890 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d987a056-1296-4f33-a115-94eced4499fe tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379" status: 200 len: 1671 microversion: 2.1 time: 0.677616 Oct 10 23:29:24.923581 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1494/3081] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:24 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 => generated 1671 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:24.954574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5d306d70-365d-4048-b792-4c8021cb8d49 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:24.955383 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5d306d70-365d-4048-b792-4c8021cb8d49 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:24.966888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d306d70-365d-4048-b792-4c8021cb8d49 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:24.971577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d306d70-365d-4048-b792-4c8021cb8d49 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:24.972038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d306d70-365d-4048-b792-4c8021cb8d49 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:24.972780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d306d70-365d-4048-b792-4c8021cb8d49 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:24.973240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d306d70-365d-4048-b792-4c8021cb8d49 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:24.973698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d306d70-365d-4048-b792-4c8021cb8d49 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:24.987451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:25.011574 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e1bded62-2b35-4630-a096-e9bd65277ede tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.544402 Oct 10 23:29:25.013292 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1588/3082] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Oct 10 23:29:24 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e/os-interface => generated 285 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:25.019163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f9418f09-da29-4d34-8c81-2c091665fa2a tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Calling method '.version_select at 0x7f662b8439d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:25.400294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5d306d70-365d-4048-b792-4c8021cb8d49 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:25.417242 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5d306d70-365d-4048-b792-4c8021cb8d49 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1472 microversion: 2.1 time: 0.475714 Oct 10 23:29:25.418067 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1495/3083] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:24 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1472 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:25.430146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d2c34382-2541-4f66-a79a-61b0dd982281 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:25.437538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d2c34382-2541-4f66-a79a-61b0dd982281 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:25.449748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2c34382-2541-4f66-a79a-61b0dd982281 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:25.450352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2c34382-2541-4f66-a79a-61b0dd982281 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:25.451092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2c34382-2541-4f66-a79a-61b0dd982281 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:25.451934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2c34382-2541-4f66-a79a-61b0dd982281 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:25.452405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2c34382-2541-4f66-a79a-61b0dd982281 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:25.452837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2c34382-2541-4f66-a79a-61b0dd982281 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:25.907335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d2c34382-2541-4f66-a79a-61b0dd982281 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:25.957234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d2c34382-2541-4f66-a79a-61b0dd982281 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:25.958870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d2c34382-2541-4f66-a79a-61b0dd982281 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:25.960102 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d2c34382-2541-4f66-a79a-61b0dd982281 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1889 microversion: 2.32 time: 0.538401 Oct 10 23:29:25.979312 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1496/3084] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:25 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1889 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:25.995741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-b569bd15-ea89-4468-9d59-a5deaba51ed3 req-2a0a8fd9-5abf-4723-9c70-c49a5e6e38f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "tag": "614bc975-55cc-4a02-8208-a141e064bf06"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:26.021324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b569bd15-ea89-4468-9d59-a5deaba51ed3 req-2a0a8fd9-5abf-4723-9c70-c49a5e6e38f6 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:26.021859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b569bd15-ea89-4468-9d59-a5deaba51ed3 req-2a0a8fd9-5abf-4723-9c70-c49a5e6e38f6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:26.022292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b569bd15-ea89-4468-9d59-a5deaba51ed3 req-2a0a8fd9-5abf-4723-9c70-c49a5e6e38f6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:26.046110 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-b569bd15-ea89-4468-9d59-a5deaba51ed3 req-2a0a8fd9-5abf-4723-9c70-c49a5e6e38f6 service nova] Creating event network-changed:614bc975-55cc-4a02-8208-a141e064bf06 for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:29:26.054594 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-b569bd15-ea89-4468-9d59-a5deaba51ed3 req-2a0a8fd9-5abf-4723-9c70-c49a5e6e38f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072568 Oct 10 23:29:26.055885 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1497/3085] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:26.064273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a6de3b71-7e14-4a05-a926-c386fc0b2057 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:26.078586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a6de3b71-7e14-4a05-a926-c386fc0b2057 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 532ff31c-bdc2-44d4-8e95-328263ebc63f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:26.087803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6de3b71-7e14-4a05-a926-c386fc0b2057 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:26.088365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6de3b71-7e14-4a05-a926-c386fc0b2057 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:26.089481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6de3b71-7e14-4a05-a926-c386fc0b2057 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:26.090910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6de3b71-7e14-4a05-a926-c386fc0b2057 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:26.091421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6de3b71-7e14-4a05-a926-c386fc0b2057 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:26.092203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6de3b71-7e14-4a05-a926-c386fc0b2057 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:26.501629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a6de3b71-7e14-4a05-a926-c386fc0b2057 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:26.522812 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a6de3b71-7e14-4a05-a926-c386fc0b2057 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f" status: 200 len: 1519 microversion: 2.1 time: 0.465417 Oct 10 23:29:26.532237 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1498/3086] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:26 2022] GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f => generated 1519 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:26.537271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e063f847-e88b-42d1-82a7-f2794ac79461 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:26.538199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e063f847-e88b-42d1-82a7-f2794ac79461 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:26.552046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e063f847-e88b-42d1-82a7-f2794ac79461 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:26.555025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e063f847-e88b-42d1-82a7-f2794ac79461 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:26.555757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e063f847-e88b-42d1-82a7-f2794ac79461 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:26.558223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e063f847-e88b-42d1-82a7-f2794ac79461 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:26.559314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e063f847-e88b-42d1-82a7-f2794ac79461 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:26.561439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e063f847-e88b-42d1-82a7-f2794ac79461 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:27.123857 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f9418f09-da29-4d34-8c81-2c091665fa2a tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/abc792e5-ec8e-46b4-bb92-d93288e838b3" status: 202 len: 0 microversion: 2.1 time: 2.108905 Oct 10 23:29:27.125496 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1589/3087] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:29:25 2022] DELETE /compute/v2.1/os-security-groups/abc792e5-ec8e-46b4-bb92-d93288e838b3 => generated 0 bytes in 2111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:29:27.131704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2ef2f493-c51b-4e64-838f-850a5e824322 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:27.133033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2ef2f493-c51b-4e64-838f-850a5e824322 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:27.159263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ef2f493-c51b-4e64-838f-850a5e824322 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:27.160789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ef2f493-c51b-4e64-838f-850a5e824322 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:27.161808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ef2f493-c51b-4e64-838f-850a5e824322 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:27.163684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ef2f493-c51b-4e64-838f-850a5e824322 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:27.167547 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ef2f493-c51b-4e64-838f-850a5e824322 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:27.172625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ef2f493-c51b-4e64-838f-850a5e824322 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:27.232862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e063f847-e88b-42d1-82a7-f2794ac79461 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:27.246805 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e063f847-e88b-42d1-82a7-f2794ac79461 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379" status: 200 len: 1671 microversion: 2.1 time: 0.713062 Oct 10 23:29:27.247697 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1499/3088] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:26 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 => generated 1671 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:27.252882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-80d71a03-e150-4737-ba80-5800e68affec tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:27.267534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-80d71a03-e150-4737-ba80-5800e68affec tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 532ff31c-bdc2-44d4-8e95-328263ebc63f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:27.299516 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80d71a03-e150-4737-ba80-5800e68affec tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:27.301353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80d71a03-e150-4737-ba80-5800e68affec tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:27.302109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80d71a03-e150-4737-ba80-5800e68affec tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:27.303389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80d71a03-e150-4737-ba80-5800e68affec tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:27.306010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80d71a03-e150-4737-ba80-5800e68affec tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:27.306859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80d71a03-e150-4737-ba80-5800e68affec tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:27.373922 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-80d71a03-e150-4737-ba80-5800e68affec tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 532ff31c-bdc2-44d4-8e95-328263ebc63f] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:29:27.650032 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-80d71a03-e150-4737-ba80-5800e68affec tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f" status: 204 len: 0 microversion: 2.1 time: 0.397647 Oct 10 23:29:27.650900 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1500/3089] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:29:27 2022] DELETE /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:29:27.671441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-55fb57f8-8c40-40e6-b638-1ebc8a33c15f req-bef99b47-6fd6-4fe5-8085-d6d582c6730d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "532ff31c-bdc2-44d4-8e95-328263ebc63f", "name": "network-vif-plugged", "status": "completed", "tag": "6a32f134-8050-4053-8c4e-b1a5e53b0952"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:27.697981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-55fb57f8-8c40-40e6-b638-1ebc8a33c15f req-bef99b47-6fd6-4fe5-8085-d6d582c6730d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:27.700822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-55fb57f8-8c40-40e6-b638-1ebc8a33c15f req-bef99b47-6fd6-4fe5-8085-d6d582c6730d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:27.702853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-55fb57f8-8c40-40e6-b638-1ebc8a33c15f req-bef99b47-6fd6-4fe5-8085-d6d582c6730d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:27.738539 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-55fb57f8-8c40-40e6-b638-1ebc8a33c15f req-bef99b47-6fd6-4fe5-8085-d6d582c6730d service nova] Creating event network-vif-plugged:6a32f134-8050-4053-8c4e-b1a5e53b0952 for instance 532ff31c-bdc2-44d4-8e95-328263ebc63f on n-h2-860864-2 Oct 10 23:29:27.751922 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-55fb57f8-8c40-40e6-b638-1ebc8a33c15f req-bef99b47-6fd6-4fe5-8085-d6d582c6730d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099206 Oct 10 23:29:27.753753 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1501/3090] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:27.759608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-96702f38-d3ec-4214-86f0-6cf2d7a97147 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:27.770297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-96702f38-d3ec-4214-86f0-6cf2d7a97147 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:27.786773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96702f38-d3ec-4214-86f0-6cf2d7a97147 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:27.787271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96702f38-d3ec-4214-86f0-6cf2d7a97147 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:27.787724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96702f38-d3ec-4214-86f0-6cf2d7a97147 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:27.788449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96702f38-d3ec-4214-86f0-6cf2d7a97147 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:27.788907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96702f38-d3ec-4214-86f0-6cf2d7a97147 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:27.789338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-96702f38-d3ec-4214-86f0-6cf2d7a97147 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:28.155129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2ef2f493-c51b-4e64-838f-850a5e824322 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:28.173217 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2ef2f493-c51b-4e64-838f-850a5e824322 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1472 microversion: 2.1 time: 1.046084 Oct 10 23:29:28.187177 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1590/3091] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:27 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1472 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:28.205388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0f648acb-7c7a-4923-8093-2b07f0f3fbcb tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Calling method '.version_select at 0x7f662b94bf70>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:28.382402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-96702f38-d3ec-4214-86f0-6cf2d7a97147 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:28.395964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-96702f38-d3ec-4214-86f0-6cf2d7a97147 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:28.397454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-96702f38-d3ec-4214-86f0-6cf2d7a97147 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:28.398685 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-96702f38-d3ec-4214-86f0-6cf2d7a97147 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1889 microversion: 2.32 time: 0.643815 Oct 10 23:29:28.403479 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1502/3092] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:27 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1889 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:28.427264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cb517b3a-57af-490f-ae65-a4cbea363b37 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:28.427895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cb517b3a-57af-490f-ae65-a4cbea363b37 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 532ff31c-bdc2-44d4-8e95-328263ebc63f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:28.442397 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb517b3a-57af-490f-ae65-a4cbea363b37 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:28.442897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb517b3a-57af-490f-ae65-a4cbea363b37 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:28.443331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb517b3a-57af-490f-ae65-a4cbea363b37 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:28.444036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb517b3a-57af-490f-ae65-a4cbea363b37 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:28.444490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb517b3a-57af-490f-ae65-a4cbea363b37 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:28.444917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb517b3a-57af-490f-ae65-a4cbea363b37 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:29.393306 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0f648acb-7c7a-4923-8093-2b07f0f3fbcb tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/98047d83-d6b7-4abe-8e16-ef81c32c317b" status: 202 len: 0 microversion: 2.1 time: 1.204863 Oct 10 23:29:29.394005 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1591/3093] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:29:28 2022] DELETE /compute/v2.1/os-security-groups/98047d83-d6b7-4abe-8e16-ef81c32c317b => generated 0 bytes in 1206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:29:29.404312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-01b0d444-45cb-488d-bbbd-aaf6fe32b7bb req-a4ff60bf-3629-4855-b3df-a86ccbea51c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "tag": "acfd32f6-5102-480d-b6cb-2c17b29cf9fc"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:29.415895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-01b0d444-45cb-488d-bbbd-aaf6fe32b7bb req-a4ff60bf-3629-4855-b3df-a86ccbea51c9 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:29.416647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-01b0d444-45cb-488d-bbbd-aaf6fe32b7bb req-a4ff60bf-3629-4855-b3df-a86ccbea51c9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:29.417254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-01b0d444-45cb-488d-bbbd-aaf6fe32b7bb req-a4ff60bf-3629-4855-b3df-a86ccbea51c9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:29.429366 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-01b0d444-45cb-488d-bbbd-aaf6fe32b7bb req-a4ff60bf-3629-4855-b3df-a86ccbea51c9 service nova] Creating event network-changed:acfd32f6-5102-480d-b6cb-2c17b29cf9fc for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:29:29.440040 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-01b0d444-45cb-488d-bbbd-aaf6fe32b7bb req-a4ff60bf-3629-4855-b3df-a86ccbea51c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039578 Oct 10 23:29:29.441273 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1592/3094] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:29.446126 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cb517b3a-57af-490f-ae65-a4cbea363b37 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:29.448291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1d5066d2-de3f-4b7f-9122-a4e32ba7fc80 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:29.449242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1d5066d2-de3f-4b7f-9122-a4e32ba7fc80 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:29.460092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d5066d2-de3f-4b7f-9122-a4e32ba7fc80 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:29.460771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d5066d2-de3f-4b7f-9122-a4e32ba7fc80 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:29.461110 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cb517b3a-57af-490f-ae65-a4cbea363b37 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f" status: 200 len: 1525 microversion: 2.1 time: 1.052128 Oct 10 23:29:29.461920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d5066d2-de3f-4b7f-9122-a4e32ba7fc80 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:29.464949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d5066d2-de3f-4b7f-9122-a4e32ba7fc80 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:29.477419 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1503/3095] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:28 2022] GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f => generated 1525 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:29.477419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-38e223cb-f825-4bb1-a5a8-3fa5f0185b27 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:29.477419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-38e223cb-f825-4bb1-a5a8-3fa5f0185b27 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:29.479219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d5066d2-de3f-4b7f-9122-a4e32ba7fc80 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:29.479915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d5066d2-de3f-4b7f-9122-a4e32ba7fc80 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:29.490194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38e223cb-f825-4bb1-a5a8-3fa5f0185b27 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:29.490705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38e223cb-f825-4bb1-a5a8-3fa5f0185b27 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:29.491153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38e223cb-f825-4bb1-a5a8-3fa5f0185b27 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:29.491875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38e223cb-f825-4bb1-a5a8-3fa5f0185b27 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:29.492328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38e223cb-f825-4bb1-a5a8-3fa5f0185b27 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:29.504606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38e223cb-f825-4bb1-a5a8-3fa5f0185b27 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:29.620885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1d5066d2-de3f-4b7f-9122-a4e32ba7fc80 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:29.635990 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1d5066d2-de3f-4b7f-9122-a4e32ba7fc80 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379" status: 200 len: 1604 microversion: 2.1 time: 0.192437 Oct 10 23:29:29.651313 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1593/3096] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:29 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 => generated 1604 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:29.674107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c968644c-692b-4de2-8890-125db0d486a8 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] Calling method '.version_select at 0x7f662b1c3ee0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:29.862712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-38e223cb-f825-4bb1-a5a8-3fa5f0185b27 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:29.896901 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-38e223cb-f825-4bb1-a5a8-3fa5f0185b27 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1472 microversion: 2.1 time: 0.429661 Oct 10 23:29:29.908589 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1504/3097] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:29 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1472 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:29.924686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a625885a-39f2-4c21-8c53-baee02c3609d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:29.929790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a625885a-39f2-4c21-8c53-baee02c3609d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:29.947892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a625885a-39f2-4c21-8c53-baee02c3609d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:29.960170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a625885a-39f2-4c21-8c53-baee02c3609d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:29.961584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a625885a-39f2-4c21-8c53-baee02c3609d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:29.965144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a625885a-39f2-4c21-8c53-baee02c3609d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:29.966594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a625885a-39f2-4c21-8c53-baee02c3609d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:29.967295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a625885a-39f2-4c21-8c53-baee02c3609d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:30.442077 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c968644c-692b-4de2-8890-125db0d486a8 tempest-SecurityGroupRulesTestJSON-1647389845 tempest-SecurityGroupRulesTestJSON-1647389845-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/6a7d04e9-cc4e-423f-b5e3-442d901f898a" status: 202 len: 0 microversion: 2.1 time: 0.789530 Oct 10 23:29:30.443809 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1594/3098] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:29:29 2022] DELETE /compute/v2.1/os-security-groups/6a7d04e9-cc4e-423f-b5e3-442d901f898a => generated 0 bytes in 792 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:29:30.449120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f7a087bc-eb68-452d-9f38-07426ef17430 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:30.450611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f7a087bc-eb68-452d-9f38-07426ef17430 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:30.462372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:30.486091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7a087bc-eb68-452d-9f38-07426ef17430 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:30.487683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7a087bc-eb68-452d-9f38-07426ef17430 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:30.494979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a625885a-39f2-4c21-8c53-baee02c3609d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:30.506993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7a087bc-eb68-452d-9f38-07426ef17430 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:30.519513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7a087bc-eb68-452d-9f38-07426ef17430 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:30.520497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7a087bc-eb68-452d-9f38-07426ef17430 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:30.526373 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7a087bc-eb68-452d-9f38-07426ef17430 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:30.531661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a625885a-39f2-4c21-8c53-baee02c3609d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:30.536748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a625885a-39f2-4c21-8c53-baee02c3609d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:30.538352 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a625885a-39f2-4c21-8c53-baee02c3609d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1889 microversion: 2.32 time: 0.628334 Oct 10 23:29:30.542874 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1505/3099] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:29 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1889 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:30.568141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-c517b385-ed25-4f14-8606-009a9965208e req-d44393a3-e358-4687-a42b-34ca0e537349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "094e9aed-7746-4a4c-81d5-ccc6d6c3d74e", "tag": "fb699f20-bd58-4051-be00-7bc3a1b04ec6"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:30.643542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c517b385-ed25-4f14-8606-009a9965208e req-d44393a3-e358-4687-a42b-34ca0e537349 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:30.649875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c517b385-ed25-4f14-8606-009a9965208e req-d44393a3-e358-4687-a42b-34ca0e537349 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:30.657183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c517b385-ed25-4f14-8606-009a9965208e req-d44393a3-e358-4687-a42b-34ca0e537349 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:30.754916 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-c517b385-ed25-4f14-8606-009a9965208e req-d44393a3-e358-4687-a42b-34ca0e537349 service nova] Creating event network-changed:fb699f20-bd58-4051-be00-7bc3a1b04ec6 for instance 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e on n-h1-860864-2 Oct 10 23:29:30.776445 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-c517b385-ed25-4f14-8606-009a9965208e req-d44393a3-e358-4687-a42b-34ca0e537349 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.229842 Oct 10 23:29:30.781143 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1506/3100] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:30.792291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-54a1f634-fb4e-4b49-89f8-783f8429dc74 req-b84781f8-c7db-4189-8bff-a2491504b511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e9f63c-d49b-4a32-80b8-b729b8530379", "name": "network-vif-unplugged", "status": "completed", "tag": "421d6fa0-dcfc-4162-835a-af03c580d3a7"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:30.838402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-54a1f634-fb4e-4b49-89f8-783f8429dc74 req-b84781f8-c7db-4189-8bff-a2491504b511 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:30.841667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-54a1f634-fb4e-4b49-89f8-783f8429dc74 req-b84781f8-c7db-4189-8bff-a2491504b511 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:30.842441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-54a1f634-fb4e-4b49-89f8-783f8429dc74 req-b84781f8-c7db-4189-8bff-a2491504b511 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:30.890445 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-54a1f634-fb4e-4b49-89f8-783f8429dc74 req-b84781f8-c7db-4189-8bff-a2491504b511 service nova] Creating event network-vif-unplugged:421d6fa0-dcfc-4162-835a-af03c580d3a7 for instance 92e9f63c-d49b-4a32-80b8-b729b8530379 on n-h2-860864-2 Oct 10 23:29:30.904611 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-54a1f634-fb4e-4b49-89f8-783f8429dc74 req-b84781f8-c7db-4189-8bff-a2491504b511 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121529 Oct 10 23:29:30.908524 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1507/3101] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:30.931536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-233ce4e2-3276-4293-9bdc-9c29f02bec30 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:30.936055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-233ce4e2-3276-4293-9bdc-9c29f02bec30 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 532ff31c-bdc2-44d4-8e95-328263ebc63f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:30.964485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-233ce4e2-3276-4293-9bdc-9c29f02bec30 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:30.965948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-233ce4e2-3276-4293-9bdc-9c29f02bec30 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:30.969608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-233ce4e2-3276-4293-9bdc-9c29f02bec30 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:30.974677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-233ce4e2-3276-4293-9bdc-9c29f02bec30 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:30.978063 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-233ce4e2-3276-4293-9bdc-9c29f02bec30 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:30.980599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-233ce4e2-3276-4293-9bdc-9c29f02bec30 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:31.693133 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-233ce4e2-3276-4293-9bdc-9c29f02bec30 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:31.710835 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-233ce4e2-3276-4293-9bdc-9c29f02bec30 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f" status: 200 len: 1525 microversion: 2.1 time: 0.797372 Oct 10 23:29:31.712160 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1508/3102] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:30 2022] GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f => generated 1525 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:31.717311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-22ff18c7-8f47-4809-b808-5993703873a9 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:31.720810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-22ff18c7-8f47-4809-b808-5993703873a9 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:31.734488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22ff18c7-8f47-4809-b808-5993703873a9 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:31.738028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22ff18c7-8f47-4809-b808-5993703873a9 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:31.738673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22ff18c7-8f47-4809-b808-5993703873a9 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:31.741321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22ff18c7-8f47-4809-b808-5993703873a9 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:31.742319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22ff18c7-8f47-4809-b808-5993703873a9 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:31.744899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22ff18c7-8f47-4809-b808-5993703873a9 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:31.761799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f7a087bc-eb68-452d-9f38-07426ef17430 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:31.772678 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f7a087bc-eb68-452d-9f38-07426ef17430 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1591 microversion: 2.1 time: 1.327426 Oct 10 23:29:31.776076 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1595/3103] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:30 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1591 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:31.782507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f73ef277-5224-4cbf-b3e3-067bc11f939d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:31.783130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f73ef277-5224-4cbf-b3e3-067bc11f939d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:31.803600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f73ef277-5224-4cbf-b3e3-067bc11f939d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:31.805977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f73ef277-5224-4cbf-b3e3-067bc11f939d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:31.806609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f73ef277-5224-4cbf-b3e3-067bc11f939d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:31.807515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f73ef277-5224-4cbf-b3e3-067bc11f939d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:31.809722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f73ef277-5224-4cbf-b3e3-067bc11f939d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:31.813716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f73ef277-5224-4cbf-b3e3-067bc11f939d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:31.824024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22ff18c7-8f47-4809-b808-5993703873a9 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:31.824568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22ff18c7-8f47-4809-b808-5993703873a9 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:31.825004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22ff18c7-8f47-4809-b808-5993703873a9 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:31.825485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-22ff18c7-8f47-4809-b808-5993703873a9 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lazy-loading 'fault' on Instance uuid 92e9f63c-d49b-4a32-80b8-b729b8530379 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:29:31.937777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-22ff18c7-8f47-4809-b808-5993703873a9 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e8299b29f044b0ab99b74346bf4870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7609ed88094dd083202e42b058ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:31.952657 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-22ff18c7-8f47-4809-b808-5993703873a9 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379" status: 200 len: 1326 microversion: 2.1 time: 0.239110 Oct 10 23:29:31.954884 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1509/3104] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:31 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 => generated 1326 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:31.963109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-2ff61dde-36d4-4f14-8af6-d3694f1e4e99 req-946b725a-1911-45d8-aea9-36cd3206c389 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "tag": "779175ee-abe1-40ae-bb85-14125427b898"}, {"server_uuid": "92e9f63c-d49b-4a32-80b8-b729b8530379", "name": "network-vif-deleted", "tag": "421d6fa0-dcfc-4162-835a-af03c580d3a7"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:31.994546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2ff61dde-36d4-4f14-8af6-d3694f1e4e99 req-946b725a-1911-45d8-aea9-36cd3206c389 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:31.998270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2ff61dde-36d4-4f14-8af6-d3694f1e4e99 req-946b725a-1911-45d8-aea9-36cd3206c389 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:31.998728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2ff61dde-36d4-4f14-8af6-d3694f1e4e99 req-946b725a-1911-45d8-aea9-36cd3206c389 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:32.021674 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-2ff61dde-36d4-4f14-8af6-d3694f1e4e99 req-946b725a-1911-45d8-aea9-36cd3206c389 service nova] Creating event network-changed:779175ee-abe1-40ae-bb85-14125427b898 for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:29:32.022080 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-2ff61dde-36d4-4f14-8af6-d3694f1e4e99 req-946b725a-1911-45d8-aea9-36cd3206c389 service nova] Creating event network-vif-deleted:421d6fa0-dcfc-4162-835a-af03c580d3a7 for instance 92e9f63c-d49b-4a32-80b8-b729b8530379 on n-h2-860864-2 Oct 10 23:29:32.046643 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-2ff61dde-36d4-4f14-8af6-d3694f1e4e99 req-946b725a-1911-45d8-aea9-36cd3206c389 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.088168 Oct 10 23:29:32.047364 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1510/3105] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:32.058463 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bb2f8ddf-8d0e-48cc-9013-9ed9dd5aa157 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:32.059735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bb2f8ddf-8d0e-48cc-9013-9ed9dd5aa157 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:32.078173 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb2f8ddf-8d0e-48cc-9013-9ed9dd5aa157 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:32.078737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb2f8ddf-8d0e-48cc-9013-9ed9dd5aa157 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:32.080253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb2f8ddf-8d0e-48cc-9013-9ed9dd5aa157 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:32.081027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb2f8ddf-8d0e-48cc-9013-9ed9dd5aa157 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:32.081531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb2f8ddf-8d0e-48cc-9013-9ed9dd5aa157 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:32.081969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb2f8ddf-8d0e-48cc-9013-9ed9dd5aa157 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:32.556835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f73ef277-5224-4cbf-b3e3-067bc11f939d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:32.572114 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f73ef277-5224-4cbf-b3e3-067bc11f939d tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1478 microversion: 2.1 time: 0.794896 Oct 10 23:29:32.574152 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1596/3106] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:31 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1478 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:32.743113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a6448e04-b104-48d3-b482-4f9160cbd9ec tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:32.743846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a6448e04-b104-48d3-b482-4f9160cbd9ec tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 532ff31c-bdc2-44d4-8e95-328263ebc63f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:32.756883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6448e04-b104-48d3-b482-4f9160cbd9ec tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:32.772306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6448e04-b104-48d3-b482-4f9160cbd9ec tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:32.774805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6448e04-b104-48d3-b482-4f9160cbd9ec tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:32.776219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6448e04-b104-48d3-b482-4f9160cbd9ec tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:32.780250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6448e04-b104-48d3-b482-4f9160cbd9ec tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:32.781050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6448e04-b104-48d3-b482-4f9160cbd9ec tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:32.954274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb2f8ddf-8d0e-48cc-9013-9ed9dd5aa157 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:32.972078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb2f8ddf-8d0e-48cc-9013-9ed9dd5aa157 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:32.978609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb2f8ddf-8d0e-48cc-9013-9ed9dd5aa157 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:32.988195 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bb2f8ddf-8d0e-48cc-9013-9ed9dd5aa157 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1889 microversion: 2.32 time: 0.937547 Oct 10 23:29:32.988818 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1511/3107] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:32 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1889 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:33.001683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-a0cb25e5-6b58-440e-ab2a-bbca4c113c6b req-03413f02-228c-4d68-a39a-eef156862dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "532ff31c-bdc2-44d4-8e95-328263ebc63f", "name": "network-vif-unplugged", "status": "completed", "tag": "6a32f134-8050-4053-8c4e-b1a5e53b0952"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:33.021980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a0cb25e5-6b58-440e-ab2a-bbca4c113c6b req-03413f02-228c-4d68-a39a-eef156862dfe service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:33.028206 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a0cb25e5-6b58-440e-ab2a-bbca4c113c6b req-03413f02-228c-4d68-a39a-eef156862dfe service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:33.028913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a0cb25e5-6b58-440e-ab2a-bbca4c113c6b req-03413f02-228c-4d68-a39a-eef156862dfe service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:33.055007 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-a0cb25e5-6b58-440e-ab2a-bbca4c113c6b req-03413f02-228c-4d68-a39a-eef156862dfe service nova] Creating event network-vif-unplugged:6a32f134-8050-4053-8c4e-b1a5e53b0952 for instance 532ff31c-bdc2-44d4-8e95-328263ebc63f on n-h2-860864-2 Oct 10 23:29:33.056749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a6448e04-b104-48d3-b482-4f9160cbd9ec tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:33.069465 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-a0cb25e5-6b58-440e-ab2a-bbca4c113c6b req-03413f02-228c-4d68-a39a-eef156862dfe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076504 Oct 10 23:29:33.073059 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1512/3108] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:33.074100 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a6448e04-b104-48d3-b482-4f9160cbd9ec tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f" status: 200 len: 1483 microversion: 2.1 time: 0.335511 Oct 10 23:29:33.081254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-85b8cc99-fc92-4523-9e1d-8620dd0c2aab tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:33.084488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-85b8cc99-fc92-4523-9e1d-8620dd0c2aab tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:33.095453 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1597/3109] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:32 2022] GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f => generated 1483 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:33.100376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85b8cc99-fc92-4523-9e1d-8620dd0c2aab tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:33.109296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85b8cc99-fc92-4523-9e1d-8620dd0c2aab tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:33.109786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85b8cc99-fc92-4523-9e1d-8620dd0c2aab tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:33.110542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85b8cc99-fc92-4523-9e1d-8620dd0c2aab tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:33.111004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85b8cc99-fc92-4523-9e1d-8620dd0c2aab tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:33.111436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85b8cc99-fc92-4523-9e1d-8620dd0c2aab tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:33.141598 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-85b8cc99-fc92-4523-9e1d-8620dd0c2aab tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] HTTP exception thrown: Instance 92e9f63c-d49b-4a32-80b8-b729b8530379 could not be found. Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-85b8cc99-fc92-4523-9e1d-8620dd0c2aab tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Request method failure captured: Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 HTTP/1.1 Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKlI_YkLpN74j_S3g3S6EcM7YKiKgbKXL7mTv6k3fUCYv3Ak1NWP8hxmuTXmVLoihl2334XejPqPrC-9pcqzYQS4P0aVciT3ekTGIZc0Q1dkz5tFbEWE8TV2EjVtyaSfcoSr32WmBQI0pkZHXYeq0SrBFvw6DpvWsvLH6YvOSkivg5E Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 6e7609ed88094dd083202e42b058ffd5 Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AttachVolumeTestJSON-168471984 Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6e7609ed88094dd083202e42b058ffd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6e7609ed88094dd083202e42b058ffd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6e7609ed88094dd083202e42b058ffd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6e7609ed88094dd083202e42b058ffd5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AttachVolumeTestJSON-168471984 Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 6e7609ed88094dd083202e42b058ffd5 Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AttachVolumeTestJSON-168471984 Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AttachVolumeTestJSON-168471984-project Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: f9e8299b29f044b0ab99b74346bf4870 Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AttachVolumeTestJSON-168471984-project Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 92e9f63c-d49b-4a32-80b8-b729b8530379 could not be found. Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '92e9f63c-d49b-4a32-80b8-b729b8530379'} Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92e9f63c-d49b-4a32-80b8-b729b8530379 could not be found. Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92e9f63c-d49b-4a32-80b8-b729b8530379 could not be found. Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:33.143610 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:29:33.148374 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:33.148374 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:33.148374 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:33.148374 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:29:33.148374 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:29:33.148374 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92e9f63c-d49b-4a32-80b8-b729b8530379 could not be found. Oct 10 23:29:33.148374 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:29:33.150566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-85b8cc99-fc92-4523-9e1d-8620dd0c2aab tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Returning 404 to user: Instance 92e9f63c-d49b-4a32-80b8-b729b8530379 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:29:33.151608 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-85b8cc99-fc92-4523-9e1d-8620dd0c2aab tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379" status: 404 len: 111 microversion: 2.1 time: 0.077375 Oct 10 23:29:33.152800 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1513/3110] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:33 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:29:33.160982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b1560514-5afc-45ba-b70d-57bfb84e8ee0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '.version_select at 0x7f662b482040>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:33.206031 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b1560514-5afc-45ba-b70d-57bfb84e8ee0 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-705951817" status: 202 len: 0 microversion: 2.1 time: 0.048593 Oct 10 23:29:33.207470 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1598/3111] 10.222.0.23 () {58 vars in 1218 bytes} [Mon Oct 10 23:29:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-705951817 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:29:33.600036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0403d2b1-855b-4d48-882e-8300f00f726b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:33.600877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0403d2b1-855b-4d48-882e-8300f00f726b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:33.611950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0403d2b1-855b-4d48-882e-8300f00f726b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:33.613618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0403d2b1-855b-4d48-882e-8300f00f726b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:33.614255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0403d2b1-855b-4d48-882e-8300f00f726b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:33.618287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0403d2b1-855b-4d48-882e-8300f00f726b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:33.619691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0403d2b1-855b-4d48-882e-8300f00f726b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:33.620301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0403d2b1-855b-4d48-882e-8300f00f726b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:33.678777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:34.021730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-82e0660e-ba76-48d1-a5ef-78677ea450de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:34.022362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-82e0660e-ba76-48d1-a5ef-78677ea450de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:34.042918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82e0660e-ba76-48d1-a5ef-78677ea450de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:34.045751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82e0660e-ba76-48d1-a5ef-78677ea450de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:34.046655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82e0660e-ba76-48d1-a5ef-78677ea450de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:34.047818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82e0660e-ba76-48d1-a5ef-78677ea450de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:34.048783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82e0660e-ba76-48d1-a5ef-78677ea450de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:34.049588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82e0660e-ba76-48d1-a5ef-78677ea450de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:35.223297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0403d2b1-855b-4d48-882e-8300f00f726b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:35.238931 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0403d2b1-855b-4d48-882e-8300f00f726b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1478 microversion: 2.1 time: 1.638793 Oct 10 23:29:35.254900 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1514/3112] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:33 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1478 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:35.269468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c3974a24-7f9b-4b45-be6b-cb73450fc36a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:35.271476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c3974a24-7f9b-4b45-be6b-cb73450fc36a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 532ff31c-bdc2-44d4-8e95-328263ebc63f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:35.287330 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3974a24-7f9b-4b45-be6b-cb73450fc36a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:35.288007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3974a24-7f9b-4b45-be6b-cb73450fc36a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:35.290295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3974a24-7f9b-4b45-be6b-cb73450fc36a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:35.291252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3974a24-7f9b-4b45-be6b-cb73450fc36a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:35.293143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3974a24-7f9b-4b45-be6b-cb73450fc36a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:35.293850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3974a24-7f9b-4b45-be6b-cb73450fc36a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:35.370745 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-c3974a24-7f9b-4b45-be6b-cb73450fc36a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] HTTP exception thrown: Instance 532ff31c-bdc2-44d4-8e95-328263ebc63f could not be found. Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c3974a24-7f9b-4b45-be6b-cb73450fc36a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Request method failure captured: Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f HTTP/1.1 Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKqJK3S3M2y3xprSZu9nbIarteybsMmlwBqzRadb_OvHrQS6zpz1qbhvGoRjPx1Bkq7rq6URwLI94Tf5sgLizi8MbWTsTS0dzR4a-9d6hn6BO9F5izkVX7qoGeFLYfTljzByP6rv99qdRHR7pF3ZU2UC3x7LIdHCYY6YUpc6lCdMgm4 Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a1c4489c308e462d89b97edcf6c21572", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: f891fce5072c448c97f96a9df58d981e Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 532ff31c-bdc2-44d4-8e95-328263ebc63f could not be found. Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '532ff31c-bdc2-44d4-8e95-328263ebc63f'} Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 532ff31c-bdc2-44d4-8e95-328263ebc63f could not be found. Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 532ff31c-bdc2-44d4-8e95-328263ebc63f could not be found. Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:29:35.372756 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:35.376775 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:29:35.376775 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:35.376775 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:35.376775 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:35.376775 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:29:35.376775 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:29:35.376775 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 532ff31c-bdc2-44d4-8e95-328263ebc63f could not be found. Oct 10 23:29:35.376775 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:29:35.385087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c3974a24-7f9b-4b45-be6b-cb73450fc36a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Returning 404 to user: Instance 532ff31c-bdc2-44d4-8e95-328263ebc63f could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:29:35.386426 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c3974a24-7f9b-4b45-be6b-cb73450fc36a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f" status: 404 len: 111 microversion: 2.1 time: 0.129942 Oct 10 23:29:35.389633 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1515/3113] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:35 2022] GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:29:35.404394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-3d3cc0a3-559c-441c-bddf-f6fcb5b006d5 req-ea046dc3-e380-4e79-ae21-863464886cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "532ff31c-bdc2-44d4-8e95-328263ebc63f", "name": "network-vif-deleted", "tag": "6a32f134-8050-4053-8c4e-b1a5e53b0952"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:35.441906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3d3cc0a3-559c-441c-bddf-f6fcb5b006d5 req-ea046dc3-e380-4e79-ae21-863464886cfb service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:35.450581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3d3cc0a3-559c-441c-bddf-f6fcb5b006d5 req-ea046dc3-e380-4e79-ae21-863464886cfb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:35.452677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3d3cc0a3-559c-441c-bddf-f6fcb5b006d5 req-ea046dc3-e380-4e79-ae21-863464886cfb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:35.491976 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-3d3cc0a3-559c-441c-bddf-f6fcb5b006d5 req-ea046dc3-e380-4e79-ae21-863464886cfb service nova] Creating event network-vif-deleted:6a32f134-8050-4053-8c4e-b1a5e53b0952 for instance 532ff31c-bdc2-44d4-8e95-328263ebc63f on n-h2-860864-2 Oct 10 23:29:35.516890 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-3d3cc0a3-559c-441c-bddf-f6fcb5b006d5 req-ea046dc3-e380-4e79-ae21-863464886cfb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123603 Oct 10 23:29:35.521912 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1516/3114] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:35.539826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-dd988d65-6479-45ae-b6c4-5d97e93b46a8 req-cf656033-2b6a-4e73-baa5-ace44806fe72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d268c6-2b9d-4858-b67f-1dced7831838", "name": "network-vif-unplugged", "status": "completed", "tag": "3a4df9ab-2215-474a-bffb-e5b388a62d2d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:35.584485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-dd988d65-6479-45ae-b6c4-5d97e93b46a8 req-cf656033-2b6a-4e73-baa5-ace44806fe72 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:35.586129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-dd988d65-6479-45ae-b6c4-5d97e93b46a8 req-cf656033-2b6a-4e73-baa5-ace44806fe72 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:35.589146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-dd988d65-6479-45ae-b6c4-5d97e93b46a8 req-cf656033-2b6a-4e73-baa5-ace44806fe72 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:35.633950 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-dd988d65-6479-45ae-b6c4-5d97e93b46a8 req-cf656033-2b6a-4e73-baa5-ace44806fe72 service nova] Creating event network-vif-unplugged:3a4df9ab-2215-474a-bffb-e5b388a62d2d for instance a3d268c6-2b9d-4858-b67f-1dced7831838 on n-h2-860864-2 Oct 10 23:29:35.651062 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-dd988d65-6479-45ae-b6c4-5d97e93b46a8 req-cf656033-2b6a-4e73-baa5-ace44806fe72 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124868 Oct 10 23:29:35.651627 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1517/3115] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:35.716045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-82e0660e-ba76-48d1-a5ef-78677ea450de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:35.728745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-82e0660e-ba76-48d1-a5ef-78677ea450de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:35.737287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-82e0660e-ba76-48d1-a5ef-78677ea450de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:35.739103 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-82e0660e-ba76-48d1-a5ef-78677ea450de tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1889 microversion: 2.32 time: 1.721466 Oct 10 23:29:35.742444 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1599/3116] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:34 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1889 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:35.752564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-09f8b0f2-acba-470c-a514-5e5213699107 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-190090364", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:35.886404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-09f8b0f2-acba-470c-a514-5e5213699107 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] validate_networks() for [('d912709d-3fc5-45c5-ac6c-3212feff08e0', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:29:36.043277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a949c938-14f2-4b39-a760-025a3347fc3a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1124566797", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": "none"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:36.172861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-a949c938-14f2-4b39-a760-025a3347fc3a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:29:36.174002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-a949c938-14f2-4b39-a760-025a3347fc3a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:29:36.174758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-a949c938-14f2-4b39-a760-025a3347fc3a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:29:36.176241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-a949c938-14f2-4b39-a760-025a3347fc3a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:29:36.179466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-a949c938-14f2-4b39-a760-025a3347fc3a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:29:36.205670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a949c938-14f2-4b39-a760-025a3347fc3a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:36.208059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a949c938-14f2-4b39-a760-025a3347fc3a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:36.208917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a949c938-14f2-4b39-a760-025a3347fc3a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:36.211304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a949c938-14f2-4b39-a760-025a3347fc3a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:36.212916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a949c938-14f2-4b39-a760-025a3347fc3a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:36.215495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a949c938-14f2-4b39-a760-025a3347fc3a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:36.264729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-a949c938-14f2-4b39-a760-025a3347fc3a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Getting quotas for project 236cac8b848c41e4ab7378ef3bc01c3b. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:29:36.272302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-a949c938-14f2-4b39-a760-025a3347fc3a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Getting quotas for user a9acee09f57e435a8c9e064819b850b7 and project 236cac8b848c41e4ab7378ef3bc01c3b. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:29:36.287473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a949c938-14f2-4b39-a760-025a3347fc3a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:29:36.291571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a949c938-14f2-4b39-a760-025a3347fc3a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: c8b65a13-be83-4de1-a380-b92079cf10c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:29:36.354220 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a949c938-14f2-4b39-a760-025a3347fc3a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.699104 Oct 10 23:29:36.355343 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1518/3117] 10.222.0.23 () {62 vars in 1188 bytes} [Mon Oct 10 23:29:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 23:29:36.361101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3f168656-dae9-4a66-b10f-2e672008c28c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:36.362412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3f168656-dae9-4a66-b10f-2e672008c28c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:36.370748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f168656-dae9-4a66-b10f-2e672008c28c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:36.371684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f168656-dae9-4a66-b10f-2e672008c28c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:36.372643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f168656-dae9-4a66-b10f-2e672008c28c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:36.373620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f168656-dae9-4a66-b10f-2e672008c28c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:36.374345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f168656-dae9-4a66-b10f-2e672008c28c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:36.374991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f168656-dae9-4a66-b10f-2e672008c28c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:37.958299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-09f8b0f2-acba-470c-a514-5e5213699107 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:29:37.958837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-09f8b0f2-acba-470c-a514-5e5213699107 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:29:37.959297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-09f8b0f2-acba-470c-a514-5e5213699107 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:29:37.959723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-09f8b0f2-acba-470c-a514-5e5213699107 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:29:37.962604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-09f8b0f2-acba-470c-a514-5e5213699107 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:29:37.991183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09f8b0f2-acba-470c-a514-5e5213699107 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:37.991696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09f8b0f2-acba-470c-a514-5e5213699107 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:37.992150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09f8b0f2-acba-470c-a514-5e5213699107 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:37.993705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09f8b0f2-acba-470c-a514-5e5213699107 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:37.994186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09f8b0f2-acba-470c-a514-5e5213699107 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:37.994628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09f8b0f2-acba-470c-a514-5e5213699107 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:38.066349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-09f8b0f2-acba-470c-a514-5e5213699107 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Getting quotas for project a1c4489c308e462d89b97edcf6c21572. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:29:38.088697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-09f8b0f2-acba-470c-a514-5e5213699107 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Getting quotas for user f891fce5072c448c97f96a9df58d981e and project a1c4489c308e462d89b97edcf6c21572. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:29:38.157805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-09f8b0f2-acba-470c-a514-5e5213699107 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:29:38.174270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-09f8b0f2-acba-470c-a514-5e5213699107 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 65aed129-f63a-4afd-9cc3-ad6061e5b35b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:29:38.331569 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-09f8b0f2-acba-470c-a514-5e5213699107 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.587430 Oct 10 23:29:38.332540 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1600/3118] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:29:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 2589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:29:38.356036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-57455a32-5535-4c62-a99b-8eb7eefe7f3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:38.357121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-57455a32-5535-4c62-a99b-8eb7eefe7f3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: c8b65a13-be83-4de1-a380-b92079cf10c7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:38.365554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57455a32-5535-4c62-a99b-8eb7eefe7f3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:38.366519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57455a32-5535-4c62-a99b-8eb7eefe7f3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:38.367183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57455a32-5535-4c62-a99b-8eb7eefe7f3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:38.369114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57455a32-5535-4c62-a99b-8eb7eefe7f3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:38.369957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57455a32-5535-4c62-a99b-8eb7eefe7f3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:38.381552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57455a32-5535-4c62-a99b-8eb7eefe7f3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:38.642002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-57455a32-5535-4c62-a99b-8eb7eefe7f3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:38.657855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-57455a32-5535-4c62-a99b-8eb7eefe7f3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:38.659333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-57455a32-5535-4c62-a99b-8eb7eefe7f3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:38.660551 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-57455a32-5535-4c62-a99b-8eb7eefe7f3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b65a13-be83-4de1-a380-b92079cf10c7" status: 200 len: 1330 microversion: 2.47 time: 0.326470 Oct 10 23:29:38.661074 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1601/3119] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:38 2022] GET /compute/v2.1/servers/c8b65a13-be83-4de1-a380-b92079cf10c7 => generated 1330 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:38.680612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bc9b8b5d-bd6c-48f6-ad1b-64db91b93941 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:38.688898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bc9b8b5d-bd6c-48f6-ad1b-64db91b93941 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:38.715839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc9b8b5d-bd6c-48f6-ad1b-64db91b93941 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:38.718042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc9b8b5d-bd6c-48f6-ad1b-64db91b93941 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:38.719129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc9b8b5d-bd6c-48f6-ad1b-64db91b93941 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:38.725785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc9b8b5d-bd6c-48f6-ad1b-64db91b93941 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:38.728117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc9b8b5d-bd6c-48f6-ad1b-64db91b93941 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:38.728740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc9b8b5d-bd6c-48f6-ad1b-64db91b93941 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:38.747065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3f168656-dae9-4a66-b10f-2e672008c28c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:38.771010 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3f168656-dae9-4a66-b10f-2e672008c28c tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1463 microversion: 2.1 time: 2.413802 Oct 10 23:29:38.773855 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1519/3120] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:36 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1463 bytes in 2418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:38.789736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-4c0ad929-2eb8-4a3a-bff5-593d1fc1ab5c req-2321676e-9e88-473d-94e9-240de28189a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d268c6-2b9d-4858-b67f-1dced7831838", "name": "network-vif-plugged", "status": "completed", "tag": "3a4df9ab-2215-474a-bffb-e5b388a62d2d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:38.845937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4c0ad929-2eb8-4a3a-bff5-593d1fc1ab5c req-2321676e-9e88-473d-94e9-240de28189a8 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:38.846245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4c0ad929-2eb8-4a3a-bff5-593d1fc1ab5c req-2321676e-9e88-473d-94e9-240de28189a8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:38.846686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4c0ad929-2eb8-4a3a-bff5-593d1fc1ab5c req-2321676e-9e88-473d-94e9-240de28189a8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:38.896393 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-4c0ad929-2eb8-4a3a-bff5-593d1fc1ab5c req-2321676e-9e88-473d-94e9-240de28189a8 service nova] Creating event network-vif-plugged:3a4df9ab-2215-474a-bffb-e5b388a62d2d for instance a3d268c6-2b9d-4858-b67f-1dced7831838 on n-h2-860864-2 Oct 10 23:29:38.914262 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-4c0ad929-2eb8-4a3a-bff5-593d1fc1ab5c req-2321676e-9e88-473d-94e9-240de28189a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139181 Oct 10 23:29:38.938835 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1520/3121] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:38.960993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d93afff6-98b5-44a6-87a1-a1259e0e4459 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:38.962823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d93afff6-98b5-44a6-87a1-a1259e0e4459 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 65aed129-f63a-4afd-9cc3-ad6061e5b35b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:39.146306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d93afff6-98b5-44a6-87a1-a1259e0e4459 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:39.156350 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d93afff6-98b5-44a6-87a1-a1259e0e4459 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b" status: 200 len: 1224 microversion: 2.1 time: 0.215794 Oct 10 23:29:39.158240 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1521/3122] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:38 2022] GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b => generated 1224 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:39.163038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d698e3ba-0cb9-4ee1-a84a-137fc7d6bd50 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-2024313171", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": "none"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:39.336468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bc9b8b5d-bd6c-48f6-ad1b-64db91b93941 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:39.342933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-d698e3ba-0cb9-4ee1-a84a-137fc7d6bd50 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:29:39.343606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-d698e3ba-0cb9-4ee1-a84a-137fc7d6bd50 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:29:39.344126 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-d698e3ba-0cb9-4ee1-a84a-137fc7d6bd50 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:29:39.344540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-d698e3ba-0cb9-4ee1-a84a-137fc7d6bd50 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:29:39.344956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-d698e3ba-0cb9-4ee1-a84a-137fc7d6bd50 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:29:39.349879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bc9b8b5d-bd6c-48f6-ad1b-64db91b93941 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:39.363232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bc9b8b5d-bd6c-48f6-ad1b-64db91b93941 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:39.364520 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bc9b8b5d-bd6c-48f6-ad1b-64db91b93941 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 0.689363 Oct 10 23:29:39.368684 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1602/3123] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:38 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:39.374541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c2c45c8d-a338-44e3-9c9c-837059a5f59d tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:39.376915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c2c45c8d-a338-44e3-9c9c-837059a5f59d tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:39.393978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d698e3ba-0cb9-4ee1-a84a-137fc7d6bd50 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:39.406076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d698e3ba-0cb9-4ee1-a84a-137fc7d6bd50 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:39.406993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d698e3ba-0cb9-4ee1-a84a-137fc7d6bd50 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:39.407599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2c45c8d-a338-44e3-9c9c-837059a5f59d tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:39.408102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2c45c8d-a338-44e3-9c9c-837059a5f59d tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:39.408613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2c45c8d-a338-44e3-9c9c-837059a5f59d tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:39.408917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d698e3ba-0cb9-4ee1-a84a-137fc7d6bd50 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:39.409339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2c45c8d-a338-44e3-9c9c-837059a5f59d tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:39.409824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2c45c8d-a338-44e3-9c9c-837059a5f59d tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:39.410202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d698e3ba-0cb9-4ee1-a84a-137fc7d6bd50 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:39.410316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2c45c8d-a338-44e3-9c9c-837059a5f59d tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:39.410983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d698e3ba-0cb9-4ee1-a84a-137fc7d6bd50 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:39.547253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-d698e3ba-0cb9-4ee1-a84a-137fc7d6bd50 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Getting quotas for project 236cac8b848c41e4ab7378ef3bc01c3b. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:29:39.593131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-d698e3ba-0cb9-4ee1-a84a-137fc7d6bd50 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Getting quotas for user a9acee09f57e435a8c9e064819b850b7 and project 236cac8b848c41e4ab7378ef3bc01c3b. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:29:39.629099 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c2c45c8d-a338-44e3-9c9c-837059a5f59d tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838/action" status: 202 len: 0 microversion: 2.1 time: 0.258896 Oct 10 23:29:39.634312 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1603/3124] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:29:39 2022] POST /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:29:39.645082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-47deead2-9023-4ac5-b9bb-c302b02b9629 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:39.646151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-47deead2-9023-4ac5-b9bb-c302b02b9629 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:39.660135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47deead2-9023-4ac5-b9bb-c302b02b9629 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:39.661066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47deead2-9023-4ac5-b9bb-c302b02b9629 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:39.664736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47deead2-9023-4ac5-b9bb-c302b02b9629 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:39.665898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47deead2-9023-4ac5-b9bb-c302b02b9629 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:39.670843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47deead2-9023-4ac5-b9bb-c302b02b9629 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:39.671741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47deead2-9023-4ac5-b9bb-c302b02b9629 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:39.676650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d698e3ba-0cb9-4ee1-a84a-137fc7d6bd50 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:29:39.687141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d698e3ba-0cb9-4ee1-a84a-137fc7d6bd50 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:29:39.764958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47deead2-9023-4ac5-b9bb-c302b02b9629 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:39.765736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47deead2-9023-4ac5-b9bb-c302b02b9629 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:39.766331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47deead2-9023-4ac5-b9bb-c302b02b9629 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:39.766964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-47deead2-9023-4ac5-b9bb-c302b02b9629 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lazy-loading 'fault' on Instance uuid a3d268c6-2b9d-4858-b67f-1dced7831838 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:29:39.828960 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d698e3ba-0cb9-4ee1-a84a-137fc7d6bd50 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.669540 Oct 10 23:29:39.830635 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1522/3125] 10.222.0.23 () {62 vars in 1188 bytes} [Mon Oct 10 23:29:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 23:29:39.847943 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4d848098-7f9f-423f-bf5e-698b30649547 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:39.853914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4d848098-7f9f-423f-bf5e-698b30649547 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:39.896535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:39.925743 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4d848098-7f9f-423f-bf5e-698b30649547 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "PUT /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 992 microversion: 2.47 time: 0.086926 Oct 10 23:29:39.927107 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1523/3126] 10.222.0.23 () {62 vars in 1297 bytes} [Mon Oct 10 23:29:39 2022] PUT /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 992 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 23:29:39.949151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c2b3fd82-dd67-420f-9c98-472ac75182a0 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:39.950964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c2b3fd82-dd67-420f-9c98-472ac75182a0 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:40.042189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c2b3fd82-dd67-420f-9c98-472ac75182a0 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:40.059968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c2b3fd82-dd67-420f-9c98-472ac75182a0 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:40.061685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c2b3fd82-dd67-420f-9c98-472ac75182a0 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:40.067846 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c2b3fd82-dd67-420f-9c98-472ac75182a0 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1278 microversion: 2.47 time: 0.120944 Oct 10 23:29:40.068911 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1524/3127] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:39 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1278 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:29:40.184191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a91c5781-cbea-4d7b-b0ce-cf52556efe2a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:40.184894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a91c5781-cbea-4d7b-b0ce-cf52556efe2a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 65aed129-f63a-4afd-9cc3-ad6061e5b35b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:40.214527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a91c5781-cbea-4d7b-b0ce-cf52556efe2a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:40.215705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a91c5781-cbea-4d7b-b0ce-cf52556efe2a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:40.220379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a91c5781-cbea-4d7b-b0ce-cf52556efe2a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:40.224489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a91c5781-cbea-4d7b-b0ce-cf52556efe2a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:40.225039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a91c5781-cbea-4d7b-b0ce-cf52556efe2a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:40.225532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a91c5781-cbea-4d7b-b0ce-cf52556efe2a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:40.369475 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-47deead2-9023-4ac5-b9bb-c302b02b9629 tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1597 microversion: 2.1 time: 0.728787 Oct 10 23:29:40.370089 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1604/3128] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:39 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1597 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:29:40.394960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-50cc9bc6-e3d8-43ac-a6c9-f1b2c1ca92d4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:40.395837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-50cc9bc6-e3d8-43ac-a6c9-f1b2c1ca92d4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:40.408234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50cc9bc6-e3d8-43ac-a6c9-f1b2c1ca92d4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:40.417276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50cc9bc6-e3d8-43ac-a6c9-f1b2c1ca92d4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:40.418102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50cc9bc6-e3d8-43ac-a6c9-f1b2c1ca92d4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:40.419060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50cc9bc6-e3d8-43ac-a6c9-f1b2c1ca92d4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:40.419574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50cc9bc6-e3d8-43ac-a6c9-f1b2c1ca92d4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:40.427977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50cc9bc6-e3d8-43ac-a6c9-f1b2c1ca92d4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:40.455680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a91c5781-cbea-4d7b-b0ce-cf52556efe2a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:40.465328 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a91c5781-cbea-4d7b-b0ce-cf52556efe2a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b" status: 200 len: 1276 microversion: 2.1 time: 0.285496 Oct 10 23:29:40.478017 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1525/3129] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:40 2022] GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b => generated 1276 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:29:40.482961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-16656e1b-1947-4803-a373-2eae70d0e81e tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:40.485348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-16656e1b-1947-4803-a373-2eae70d0e81e tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:40.511448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16656e1b-1947-4803-a373-2eae70d0e81e tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:40.512514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16656e1b-1947-4803-a373-2eae70d0e81e tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:40.513056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16656e1b-1947-4803-a373-2eae70d0e81e tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:40.513953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16656e1b-1947-4803-a373-2eae70d0e81e tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:40.514406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16656e1b-1947-4803-a373-2eae70d0e81e tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:40.514830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16656e1b-1947-4803-a373-2eae70d0e81e tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:40.867170 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-16656e1b-1947-4803-a373-2eae70d0e81e tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838/action" status: 202 len: 0 microversion: 2.1 time: 0.387902 Oct 10 23:29:40.867907 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1526/3130] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:29:40 2022] POST /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:29:40.876905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-68059673-65e6-42cf-bf1b-494bc08869de tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:40.877575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-68059673-65e6-42cf-bf1b-494bc08869de tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:40.889537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68059673-65e6-42cf-bf1b-494bc08869de tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:40.890033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68059673-65e6-42cf-bf1b-494bc08869de tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:40.890486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68059673-65e6-42cf-bf1b-494bc08869de tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:40.891175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68059673-65e6-42cf-bf1b-494bc08869de tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:40.891627 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68059673-65e6-42cf-bf1b-494bc08869de tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:40.892050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68059673-65e6-42cf-bf1b-494bc08869de tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:41.299818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-50cc9bc6-e3d8-43ac-a6c9-f1b2c1ca92d4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:41.319422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-50cc9bc6-e3d8-43ac-a6c9-f1b2c1ca92d4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:41.320880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-50cc9bc6-e3d8-43ac-a6c9-f1b2c1ca92d4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:41.322139 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-50cc9bc6-e3d8-43ac-a6c9-f1b2c1ca92d4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 0.931826 Oct 10 23:29:41.351926 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1605/3131] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:40 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:29:41.367450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-450ec16c-8f9a-4d24-9235-b2282525fe3d tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:41.368075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-450ec16c-8f9a-4d24-9235-b2282525fe3d tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:41.389589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-450ec16c-8f9a-4d24-9235-b2282525fe3d tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:41.390728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-450ec16c-8f9a-4d24-9235-b2282525fe3d tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:41.391321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-450ec16c-8f9a-4d24-9235-b2282525fe3d tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:41.393970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-450ec16c-8f9a-4d24-9235-b2282525fe3d tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:41.394668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-450ec16c-8f9a-4d24-9235-b2282525fe3d tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:41.396323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-450ec16c-8f9a-4d24-9235-b2282525fe3d tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:41.535812 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-68059673-65e6-42cf-bf1b-494bc08869de tempest-ServersAdminTestJSON-470053563 tempest-ServersAdminTestJSON-470053563-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1614 microversion: 2.1 time: 0.662529 Oct 10 23:29:41.541796 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1527/3132] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:40 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1614 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:29:41.547788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cefe6816-d8be-4015-b633-b5c176ade6ee tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:41.548411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cefe6816-d8be-4015-b633-b5c176ade6ee tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 65aed129-f63a-4afd-9cc3-ad6061e5b35b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:41.572660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-450ec16c-8f9a-4d24-9235-b2282525fe3d tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:41.581987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-450ec16c-8f9a-4d24-9235-b2282525fe3d tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:41.583438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-450ec16c-8f9a-4d24-9235-b2282525fe3d tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:41.584606 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-450ec16c-8f9a-4d24-9235-b2282525fe3d tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1282 microversion: 2.47 time: 0.231621 Oct 10 23:29:41.585176 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1606/3133] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:41 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1282 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:41.596778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cefe6816-d8be-4015-b633-b5c176ade6ee tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:41.597275 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cefe6816-d8be-4015-b633-b5c176ade6ee tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:41.598118 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cefe6816-d8be-4015-b633-b5c176ade6ee tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:41.598856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cefe6816-d8be-4015-b633-b5c176ade6ee tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:41.599321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cefe6816-d8be-4015-b633-b5c176ade6ee tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:41.599749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cefe6816-d8be-4015-b633-b5c176ade6ee tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:41.603615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b10a4935-7183-4bd7-a538-3f590411c493 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:41.604402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b10a4935-7183-4bd7-a538-3f590411c493 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: cc990503-6019-4b55-b2c9-24f72769eaca] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:41.620250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b10a4935-7183-4bd7-a538-3f590411c493 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:41.620855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b10a4935-7183-4bd7-a538-3f590411c493 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:41.621449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b10a4935-7183-4bd7-a538-3f590411c493 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:41.624099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b10a4935-7183-4bd7-a538-3f590411c493 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:41.624680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b10a4935-7183-4bd7-a538-3f590411c493 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:41.630444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b10a4935-7183-4bd7-a538-3f590411c493 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:41.680118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b10a4935-7183-4bd7-a538-3f590411c493 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: cc990503-6019-4b55-b2c9-24f72769eaca] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:29:41.685139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:41.802482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cefe6816-d8be-4015-b633-b5c176ade6ee tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:41.814780 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cefe6816-d8be-4015-b633-b5c176ade6ee tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b" status: 200 len: 1282 microversion: 2.1 time: 0.271832 Oct 10 23:29:41.815674 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1528/3134] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:41 2022] GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b => generated 1282 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:41.893250 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b10a4935-7183-4bd7-a538-3f590411c493 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca" status: 204 len: 0 microversion: 2.1 time: 0.293961 Oct 10 23:29:41.894179 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1607/3135] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:29:41 2022] DELETE /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:29:41.903772 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7c5a8c7d-356e-4c5e-9033-891dd96cf687 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:41.904929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7c5a8c7d-356e-4c5e-9033-891dd96cf687 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: cc990503-6019-4b55-b2c9-24f72769eaca] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:41.922946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c5a8c7d-356e-4c5e-9033-891dd96cf687 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:41.923699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c5a8c7d-356e-4c5e-9033-891dd96cf687 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:41.926342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c5a8c7d-356e-4c5e-9033-891dd96cf687 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:41.928110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c5a8c7d-356e-4c5e-9033-891dd96cf687 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:41.930463 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c5a8c7d-356e-4c5e-9033-891dd96cf687 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:41.931562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c5a8c7d-356e-4c5e-9033-891dd96cf687 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:42.283395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7c5a8c7d-356e-4c5e-9033-891dd96cf687 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:42.293762 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7c5a8c7d-356e-4c5e-9033-891dd96cf687 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca" status: 200 len: 1470 microversion: 2.1 time: 0.395045 Oct 10 23:29:42.294539 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1529/3136] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:41 2022] GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca => generated 1470 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:42.355071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9e1a5a2a-100d-4b9c-896f-71f91ce3a85a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:42.357716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9e1a5a2a-100d-4b9c-896f-71f91ce3a85a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:42.377405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e1a5a2a-100d-4b9c-896f-71f91ce3a85a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:42.378020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e1a5a2a-100d-4b9c-896f-71f91ce3a85a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:42.378736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e1a5a2a-100d-4b9c-896f-71f91ce3a85a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:42.379737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e1a5a2a-100d-4b9c-896f-71f91ce3a85a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:42.380767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e1a5a2a-100d-4b9c-896f-71f91ce3a85a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:42.382036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e1a5a2a-100d-4b9c-896f-71f91ce3a85a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:42.617852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ac677ae7-709d-4280-a864-aacfff8354fb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:42.619341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ac677ae7-709d-4280-a864-aacfff8354fb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:42.630101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac677ae7-709d-4280-a864-aacfff8354fb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:42.630903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac677ae7-709d-4280-a864-aacfff8354fb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:42.631497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac677ae7-709d-4280-a864-aacfff8354fb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:42.632384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac677ae7-709d-4280-a864-aacfff8354fb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:42.633080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac677ae7-709d-4280-a864-aacfff8354fb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:42.633979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ac677ae7-709d-4280-a864-aacfff8354fb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:42.697014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9e1a5a2a-100d-4b9c-896f-71f91ce3a85a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:42.727006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9e1a5a2a-100d-4b9c-896f-71f91ce3a85a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:42.737565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9e1a5a2a-100d-4b9c-896f-71f91ce3a85a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:42.739244 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9e1a5a2a-100d-4b9c-896f-71f91ce3a85a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 0.390812 Oct 10 23:29:42.743940 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1608/3137] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:42 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:42.841913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ac677ae7-709d-4280-a864-aacfff8354fb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:42.845656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ccff6882-f96f-4a4a-bf16-455dc9a06b10 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:42.846283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ccff6882-f96f-4a4a-bf16-455dc9a06b10 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 65aed129-f63a-4afd-9cc3-ad6061e5b35b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:42.850750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ac677ae7-709d-4280-a864-aacfff8354fb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:42.867499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ac677ae7-709d-4280-a864-aacfff8354fb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:42.872711 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ac677ae7-709d-4280-a864-aacfff8354fb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1330 microversion: 2.47 time: 0.259144 Oct 10 23:29:42.877505 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1530/3138] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:42 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1330 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:42.896820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccff6882-f96f-4a4a-bf16-455dc9a06b10 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:42.897403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccff6882-f96f-4a4a-bf16-455dc9a06b10 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:42.898141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccff6882-f96f-4a4a-bf16-455dc9a06b10 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:42.899950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccff6882-f96f-4a4a-bf16-455dc9a06b10 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:42.901798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccff6882-f96f-4a4a-bf16-455dc9a06b10 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:42.902270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccff6882-f96f-4a4a-bf16-455dc9a06b10 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:43.154372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ccff6882-f96f-4a4a-bf16-455dc9a06b10 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:43.167121 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ccff6882-f96f-4a4a-bf16-455dc9a06b10 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b" status: 200 len: 1282 microversion: 2.1 time: 0.331233 Oct 10 23:29:43.187413 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1609/3139] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:42 2022] GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b => generated 1282 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:29:43.321923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a2b8d2c0-fb60-4f2f-837d-5e6869ad9aea tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:43.323797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a2b8d2c0-fb60-4f2f-837d-5e6869ad9aea tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: cc990503-6019-4b55-b2c9-24f72769eaca] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:43.341908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2b8d2c0-fb60-4f2f-837d-5e6869ad9aea tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:43.343810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2b8d2c0-fb60-4f2f-837d-5e6869ad9aea tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:43.344340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2b8d2c0-fb60-4f2f-837d-5e6869ad9aea tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:43.345871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2b8d2c0-fb60-4f2f-837d-5e6869ad9aea tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:43.347625 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2b8d2c0-fb60-4f2f-837d-5e6869ad9aea tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:43.350073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2b8d2c0-fb60-4f2f-837d-5e6869ad9aea tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:43.767850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e14a808f-6b6a-454c-86f8-e7942b963da4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:43.769178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e14a808f-6b6a-454c-86f8-e7942b963da4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:43.777366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e14a808f-6b6a-454c-86f8-e7942b963da4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:43.778560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e14a808f-6b6a-454c-86f8-e7942b963da4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:43.779649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e14a808f-6b6a-454c-86f8-e7942b963da4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:43.780800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e14a808f-6b6a-454c-86f8-e7942b963da4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:43.781505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e14a808f-6b6a-454c-86f8-e7942b963da4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:43.782356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e14a808f-6b6a-454c-86f8-e7942b963da4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:44.041490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a2b8d2c0-fb60-4f2f-837d-5e6869ad9aea tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:44.054956 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a2b8d2c0-fb60-4f2f-837d-5e6869ad9aea tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca" status: 200 len: 1470 microversion: 2.1 time: 0.738131 Oct 10 23:29:44.055567 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1531/3140] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:43 2022] GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca => generated 1470 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:44.071621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2e8ea926-4f85-4891-9db2-fed83f102ddd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:44.072335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2e8ea926-4f85-4891-9db2-fed83f102ddd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:44.080698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e8ea926-4f85-4891-9db2-fed83f102ddd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:44.081193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e8ea926-4f85-4891-9db2-fed83f102ddd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:44.081662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e8ea926-4f85-4891-9db2-fed83f102ddd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:44.082373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e8ea926-4f85-4891-9db2-fed83f102ddd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:44.086890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e8ea926-4f85-4891-9db2-fed83f102ddd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:44.088826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e8ea926-4f85-4891-9db2-fed83f102ddd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:44.167087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e14a808f-6b6a-454c-86f8-e7942b963da4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:44.188569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e14a808f-6b6a-454c-86f8-e7942b963da4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:44.198597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e14a808f-6b6a-454c-86f8-e7942b963da4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:44.200855 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e14a808f-6b6a-454c-86f8-e7942b963da4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 0.436587 Oct 10 23:29:44.210107 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1610/3141] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:43 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:44.226993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-74fa813f-3b34-4a4b-b4b2-8427a7a710a3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:44.228035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-74fa813f-3b34-4a4b-b4b2-8427a7a710a3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 65aed129-f63a-4afd-9cc3-ad6061e5b35b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:44.237545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74fa813f-3b34-4a4b-b4b2-8427a7a710a3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:44.240106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74fa813f-3b34-4a4b-b4b2-8427a7a710a3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:44.241002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74fa813f-3b34-4a4b-b4b2-8427a7a710a3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:44.242265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74fa813f-3b34-4a4b-b4b2-8427a7a710a3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:44.243243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74fa813f-3b34-4a4b-b4b2-8427a7a710a3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:44.243873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74fa813f-3b34-4a4b-b4b2-8427a7a710a3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:44.330506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2e8ea926-4f85-4891-9db2-fed83f102ddd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:44.353931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2e8ea926-4f85-4891-9db2-fed83f102ddd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:44.357798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2e8ea926-4f85-4891-9db2-fed83f102ddd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:44.362849 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2e8ea926-4f85-4891-9db2-fed83f102ddd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1338 microversion: 2.47 time: 0.306237 Oct 10 23:29:44.363717 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1532/3142] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:44 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1338 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:44.548279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-74fa813f-3b34-4a4b-b4b2-8427a7a710a3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:44.556518 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-74fa813f-3b34-4a4b-b4b2-8427a7a710a3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b" status: 200 len: 1324 microversion: 2.1 time: 0.345128 Oct 10 23:29:44.567453 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1611/3143] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:44 2022] GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b => generated 1324 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:45.079236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c565207e-cfcc-4b25-917c-c34a197fdc75 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:45.080455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c565207e-cfcc-4b25-917c-c34a197fdc75 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: cc990503-6019-4b55-b2c9-24f72769eaca] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:45.102365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c565207e-cfcc-4b25-917c-c34a197fdc75 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:45.109196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c565207e-cfcc-4b25-917c-c34a197fdc75 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:45.109901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c565207e-cfcc-4b25-917c-c34a197fdc75 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:45.110840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c565207e-cfcc-4b25-917c-c34a197fdc75 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:45.111459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c565207e-cfcc-4b25-917c-c34a197fdc75 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:45.112064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c565207e-cfcc-4b25-917c-c34a197fdc75 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:45.229438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c0b24cd5-5235-4ff8-a6f6-e838b7690ae2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:45.231051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c0b24cd5-5235-4ff8-a6f6-e838b7690ae2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:45.240415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0b24cd5-5235-4ff8-a6f6-e838b7690ae2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:45.246397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0b24cd5-5235-4ff8-a6f6-e838b7690ae2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:45.249115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0b24cd5-5235-4ff8-a6f6-e838b7690ae2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:45.250230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0b24cd5-5235-4ff8-a6f6-e838b7690ae2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:45.251993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0b24cd5-5235-4ff8-a6f6-e838b7690ae2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:45.252691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0b24cd5-5235-4ff8-a6f6-e838b7690ae2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:45.720835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c0b24cd5-5235-4ff8-a6f6-e838b7690ae2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:45.734823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c0b24cd5-5235-4ff8-a6f6-e838b7690ae2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:45.736312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c0b24cd5-5235-4ff8-a6f6-e838b7690ae2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:45.737830 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c0b24cd5-5235-4ff8-a6f6-e838b7690ae2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 0.512094 Oct 10 23:29:45.738420 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1612/3144] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:45 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:29:45.757623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bd9f790f-49b0-4343-b912-3544202801bc tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:45.757623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bd9f790f-49b0-4343-b912-3544202801bc tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:45.778167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd9f790f-49b0-4343-b912-3544202801bc tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:45.778666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd9f790f-49b0-4343-b912-3544202801bc tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:45.779185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd9f790f-49b0-4343-b912-3544202801bc tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:45.780608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd9f790f-49b0-4343-b912-3544202801bc tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:45.781081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd9f790f-49b0-4343-b912-3544202801bc tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:45.781545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd9f790f-49b0-4343-b912-3544202801bc tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:45.815675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c565207e-cfcc-4b25-917c-c34a197fdc75 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:45.834035 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c565207e-cfcc-4b25-917c-c34a197fdc75 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca" status: 200 len: 1428 microversion: 2.1 time: 0.750441 Oct 10 23:29:45.834710 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1533/3145] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:45 2022] GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca => generated 1428 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:45.884799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6089f6c2-64b7-4dd4-a7e6-f7f680bcf93c tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:45.888017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6089f6c2-64b7-4dd4-a7e6-f7f680bcf93c tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 65aed129-f63a-4afd-9cc3-ad6061e5b35b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:45.909445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6089f6c2-64b7-4dd4-a7e6-f7f680bcf93c tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:45.911663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6089f6c2-64b7-4dd4-a7e6-f7f680bcf93c tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:45.912220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6089f6c2-64b7-4dd4-a7e6-f7f680bcf93c tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:45.914475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6089f6c2-64b7-4dd4-a7e6-f7f680bcf93c tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:45.915496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6089f6c2-64b7-4dd4-a7e6-f7f680bcf93c tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:45.916225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6089f6c2-64b7-4dd4-a7e6-f7f680bcf93c tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:45.930431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bd9f790f-49b0-4343-b912-3544202801bc tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:45.946413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bd9f790f-49b0-4343-b912-3544202801bc tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:45.951429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bd9f790f-49b0-4343-b912-3544202801bc tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:45.955314 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bd9f790f-49b0-4343-b912-3544202801bc tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1336 microversion: 2.47 time: 0.215626 Oct 10 23:29:45.956913 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1613/3146] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:45 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1336 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:46.615438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-5aa327c3-6931-46c6-bf54-2d3aa5dce2fa req-a788a865-4f48-4925-871a-2f855d5032e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc990503-6019-4b55-b2c9-24f72769eaca", "name": "network-vif-deleted", "tag": "c82275f2-b750-4b8b-9d83-4eb2ffc91160"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:46.641699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5aa327c3-6931-46c6-bf54-2d3aa5dce2fa req-a788a865-4f48-4925-871a-2f855d5032e5 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:46.642189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5aa327c3-6931-46c6-bf54-2d3aa5dce2fa req-a788a865-4f48-4925-871a-2f855d5032e5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:46.642623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5aa327c3-6931-46c6-bf54-2d3aa5dce2fa req-a788a865-4f48-4925-871a-2f855d5032e5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:46.678040 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-5aa327c3-6931-46c6-bf54-2d3aa5dce2fa req-a788a865-4f48-4925-871a-2f855d5032e5 service nova] Creating event network-vif-deleted:c82275f2-b750-4b8b-9d83-4eb2ffc91160 for instance cc990503-6019-4b55-b2c9-24f72769eaca on n-h2-860864-2 Oct 10 23:29:46.697861 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-5aa327c3-6931-46c6-bf54-2d3aa5dce2fa req-a788a865-4f48-4925-871a-2f855d5032e5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084723 Oct 10 23:29:46.702556 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1614/3147] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:29:46.773838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ecf35cf6-6734-4a8f-891b-0f3c7a3bef8b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:46.774940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ecf35cf6-6734-4a8f-891b-0f3c7a3bef8b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:46.783664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecf35cf6-6734-4a8f-891b-0f3c7a3bef8b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:46.784523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecf35cf6-6734-4a8f-891b-0f3c7a3bef8b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:46.785213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecf35cf6-6734-4a8f-891b-0f3c7a3bef8b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:46.786218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecf35cf6-6734-4a8f-891b-0f3c7a3bef8b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:46.786891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecf35cf6-6734-4a8f-891b-0f3c7a3bef8b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:46.787539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecf35cf6-6734-4a8f-891b-0f3c7a3bef8b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:47.010563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6089f6c2-64b7-4dd4-a7e6-f7f680bcf93c tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:47.038300 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6089f6c2-64b7-4dd4-a7e6-f7f680bcf93c tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b" status: 200 len: 1324 microversion: 2.1 time: 1.170440 Oct 10 23:29:47.042712 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1534/3148] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:45 2022] GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b => generated 1324 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:47.049401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-897c64f8-511f-456d-bb3f-63c0021c22da tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:47.050285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-897c64f8-511f-456d-bb3f-63c0021c22da tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: cc990503-6019-4b55-b2c9-24f72769eaca] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:47.058245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-897c64f8-511f-456d-bb3f-63c0021c22da tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:47.059422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-897c64f8-511f-456d-bb3f-63c0021c22da tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:47.060286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-897c64f8-511f-456d-bb3f-63c0021c22da tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:47.061014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-897c64f8-511f-456d-bb3f-63c0021c22da tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:47.061835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-897c64f8-511f-456d-bb3f-63c0021c22da tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:47.062323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-897c64f8-511f-456d-bb3f-63c0021c22da tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:47.140573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-897c64f8-511f-456d-bb3f-63c0021c22da tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:47.141216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-897c64f8-511f-456d-bb3f-63c0021c22da tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:47.141900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-897c64f8-511f-456d-bb3f-63c0021c22da tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:47.142997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-897c64f8-511f-456d-bb3f-63c0021c22da tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lazy-loading 'fault' on Instance uuid cc990503-6019-4b55-b2c9-24f72769eaca {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:29:47.172994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ecf35cf6-6734-4a8f-891b-0f3c7a3bef8b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:47.193088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ecf35cf6-6734-4a8f-891b-0f3c7a3bef8b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:47.196039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ecf35cf6-6734-4a8f-891b-0f3c7a3bef8b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:47.198313 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ecf35cf6-6734-4a8f-891b-0f3c7a3bef8b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 0.429757 Oct 10 23:29:47.199820 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1615/3149] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:46 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:29:47.208725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3beabf45-0f8c-4ec0-be0e-2575df376171 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:47.210239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3beabf45-0f8c-4ec0-be0e-2575df376171 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:47.223071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3beabf45-0f8c-4ec0-be0e-2575df376171 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:47.224265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3beabf45-0f8c-4ec0-be0e-2575df376171 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:47.225435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3beabf45-0f8c-4ec0-be0e-2575df376171 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:47.226969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3beabf45-0f8c-4ec0-be0e-2575df376171 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:47.228625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3beabf45-0f8c-4ec0-be0e-2575df376171 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:47.230023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3beabf45-0f8c-4ec0-be0e-2575df376171 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:47.343230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-897c64f8-511f-456d-bb3f-63c0021c22da tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:47.361134 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-897c64f8-511f-456d-bb3f-63c0021c22da tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca" status: 200 len: 1304 microversion: 2.1 time: 0.316996 Oct 10 23:29:47.362569 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1535/3150] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:47 2022] GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca => generated 1304 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:47.364582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3beabf45-0f8c-4ec0-be0e-2575df376171 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:47.380178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3beabf45-0f8c-4ec0-be0e-2575df376171 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:47.381669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3beabf45-0f8c-4ec0-be0e-2575df376171 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:47.382977 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3beabf45-0f8c-4ec0-be0e-2575df376171 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1357 microversion: 2.47 time: 0.181474 Oct 10 23:29:47.383559 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1616/3151] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:47 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:47.409944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fb1bb60e-bb95-4271-82b2-bfc787ee35a9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:47.413508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fb1bb60e-bb95-4271-82b2-bfc787ee35a9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:47.422304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb1bb60e-bb95-4271-82b2-bfc787ee35a9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:47.422965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb1bb60e-bb95-4271-82b2-bfc787ee35a9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:47.423517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb1bb60e-bb95-4271-82b2-bfc787ee35a9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:47.424656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb1bb60e-bb95-4271-82b2-bfc787ee35a9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:47.425233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb1bb60e-bb95-4271-82b2-bfc787ee35a9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:47.425979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb1bb60e-bb95-4271-82b2-bfc787ee35a9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:47.438838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:47.585540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-fb1bb60e-bb95-4271-82b2-bfc787ee35a9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:29:47.586396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-fb1bb60e-bb95-4271-82b2-bfc787ee35a9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:29:47.587140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-fb1bb60e-bb95-4271-82b2-bfc787ee35a9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:29:47.587926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-fb1bb60e-bb95-4271-82b2-bfc787ee35a9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:29:47.588678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-fb1bb60e-bb95-4271-82b2-bfc787ee35a9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:29:47.667492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fb1bb60e-bb95-4271-82b2-bfc787ee35a9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:47.678698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb1bb60e-bb95-4271-82b2-bfc787ee35a9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:47.679686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb1bb60e-bb95-4271-82b2-bfc787ee35a9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:47.680500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb1bb60e-bb95-4271-82b2-bfc787ee35a9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:47.681671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb1bb60e-bb95-4271-82b2-bfc787ee35a9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:47.683013 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb1bb60e-bb95-4271-82b2-bfc787ee35a9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:47.684108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb1bb60e-bb95-4271-82b2-bfc787ee35a9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:47.718500 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fb1bb60e-bb95-4271-82b2-bfc787ee35a9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "POST /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4/action" status: 202 len: 1079 microversion: 2.47 time: 0.312456 Oct 10 23:29:47.719568 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1536/3152] 10.222.0.23 () {62 vars in 1319 bytes} [Mon Oct 10 23:29:47 2022] POST /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4/action => generated 1079 bytes in 314 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 10 23:29:47.742174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c572a315-366b-41be-9f8c-8c77d3ec6c6c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:47.743507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c572a315-366b-41be-9f8c-8c77d3ec6c6c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:47.752273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c572a315-366b-41be-9f8c-8c77d3ec6c6c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:47.753100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c572a315-366b-41be-9f8c-8c77d3ec6c6c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:47.753829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c572a315-366b-41be-9f8c-8c77d3ec6c6c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:47.754776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c572a315-366b-41be-9f8c-8c77d3ec6c6c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:47.755309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c572a315-366b-41be-9f8c-8c77d3ec6c6c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:47.756777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c572a315-366b-41be-9f8c-8c77d3ec6c6c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:47.870981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c572a315-366b-41be-9f8c-8c77d3ec6c6c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:47.887862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c572a315-366b-41be-9f8c-8c77d3ec6c6c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:47.904647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c572a315-366b-41be-9f8c-8c77d3ec6c6c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:47.905958 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c572a315-366b-41be-9f8c-8c77d3ec6c6c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1366 microversion: 2.47 time: 0.167932 Oct 10 23:29:47.906680 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1617/3153] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:47 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:48.067655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2b185b0b-3e5e-4863-b2d6-add8c9ad4d7b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:48.068953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2b185b0b-3e5e-4863-b2d6-add8c9ad4d7b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 65aed129-f63a-4afd-9cc3-ad6061e5b35b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:48.082058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b185b0b-3e5e-4863-b2d6-add8c9ad4d7b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:48.082882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b185b0b-3e5e-4863-b2d6-add8c9ad4d7b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:48.084268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b185b0b-3e5e-4863-b2d6-add8c9ad4d7b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:48.088460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b185b0b-3e5e-4863-b2d6-add8c9ad4d7b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:48.089203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b185b0b-3e5e-4863-b2d6-add8c9ad4d7b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:48.090769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b185b0b-3e5e-4863-b2d6-add8c9ad4d7b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:48.251664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8bfc2e69-6118-4bdf-a960-56e9e56fd735 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:48.252427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8bfc2e69-6118-4bdf-a960-56e9e56fd735 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:48.261183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:48.269463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:48.273626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8bfc2e69-6118-4bdf-a960-56e9e56fd735 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:48.275417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8bfc2e69-6118-4bdf-a960-56e9e56fd735 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:48.278352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8bfc2e69-6118-4bdf-a960-56e9e56fd735 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:48.279437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8bfc2e69-6118-4bdf-a960-56e9e56fd735 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:48.281333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8bfc2e69-6118-4bdf-a960-56e9e56fd735 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:48.284072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8bfc2e69-6118-4bdf-a960-56e9e56fd735 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:48.743047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8bfc2e69-6118-4bdf-a960-56e9e56fd735 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:48.764386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8bfc2e69-6118-4bdf-a960-56e9e56fd735 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:48.766221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8bfc2e69-6118-4bdf-a960-56e9e56fd735 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:48.767624 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8bfc2e69-6118-4bdf-a960-56e9e56fd735 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 0.520663 Oct 10 23:29:48.782205 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1618/3154] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:48 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:48.810702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8c05ce97-0db4-4a0a-a2e3-0c90ea7e13c3 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:48.811437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8c05ce97-0db4-4a0a-a2e3-0c90ea7e13c3 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: cc990503-6019-4b55-b2c9-24f72769eaca] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:48.826638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c05ce97-0db4-4a0a-a2e3-0c90ea7e13c3 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:48.827147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c05ce97-0db4-4a0a-a2e3-0c90ea7e13c3 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:48.827586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c05ce97-0db4-4a0a-a2e3-0c90ea7e13c3 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:48.829246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c05ce97-0db4-4a0a-a2e3-0c90ea7e13c3 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:48.832208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c05ce97-0db4-4a0a-a2e3-0c90ea7e13c3 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:48.832676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c05ce97-0db4-4a0a-a2e3-0c90ea7e13c3 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:48.835806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2b185b0b-3e5e-4863-b2d6-add8c9ad4d7b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:48.845105 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2b185b0b-3e5e-4863-b2d6-add8c9ad4d7b tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b" status: 200 len: 1324 microversion: 2.1 time: 0.783781 Oct 10 23:29:48.862646 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1537/3155] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:48 2022] GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b => generated 1324 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:48.871283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-6a6056d3-f8ed-4fa5-80be-997a8d2d5e50 req-3399fe20-1e78-468f-8eb0-ba3134c01ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65aed129-f63a-4afd-9cc3-ad6061e5b35b", "tag": "908f4746-53e5-4919-9052-9bf8f7b743a5"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:48.882001 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-8c05ce97-0db4-4a0a-a2e3-0c90ea7e13c3 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] HTTP exception thrown: Instance cc990503-6019-4b55-b2c9-24f72769eaca could not be found. Oct 10 23:29:48.882864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6a6056d3-f8ed-4fa5-80be-997a8d2d5e50 req-3399fe20-1e78-468f-8eb0-ba3134c01ad0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:48.884255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6a6056d3-f8ed-4fa5-80be-997a8d2d5e50 req-3399fe20-1e78-468f-8eb0-ba3134c01ad0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:48.884728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6a6056d3-f8ed-4fa5-80be-997a8d2d5e50 req-3399fe20-1e78-468f-8eb0-ba3134c01ad0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8c05ce97-0db4-4a0a-a2e3-0c90ea7e13c3 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Request method failure captured: Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca HTTP/1.1 Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKpA79wa69yaYJMJw-3QmgQP_hV7sX62O83M5X-L94JQ1rLyIgxW5Ruc3lvxhFy3Av1NfdfEfyRhyEd_wFTCd6i75unkafFXbPSaFvegcFLPVDj0GaYZZV6U0ivHzzI46BEywHla9yZdFSZtzO3ASL0kXk-bD2Ozyg8n4yi8qcJYpW0 Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 4b2326c88f134b7299d87d1133041421 Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersAdminTestJSON-1076446732 Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4b2326c88f134b7299d87d1133041421"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b2326c88f134b7299d87d1133041421"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b2326c88f134b7299d87d1133041421"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4b2326c88f134b7299d87d1133041421", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersAdminTestJSON-1076446732 Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 4b2326c88f134b7299d87d1133041421 Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersAdminTestJSON-1076446732 Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersAdminTestJSON-1076446732-project Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: d536874058b64c6fbb05b3414b6b100c Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersAdminTestJSON-1076446732-project Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance cc990503-6019-4b55-b2c9-24f72769eaca could not be found. Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'cc990503-6019-4b55-b2c9-24f72769eaca'} Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc990503-6019-4b55-b2c9-24f72769eaca could not be found. Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc990503-6019-4b55-b2c9-24f72769eaca could not be found. Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:48.885314 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:48.897920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:48.897920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:48.897920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:48.897920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:29:48.897920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:29:48.897920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc990503-6019-4b55-b2c9-24f72769eaca could not be found. Oct 10 23:29:48.897920 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:48.897920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8c05ce97-0db4-4a0a-a2e3-0c90ea7e13c3 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Returning 404 to user: Instance cc990503-6019-4b55-b2c9-24f72769eaca could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:29:48.897920 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8c05ce97-0db4-4a0a-a2e3-0c90ea7e13c3 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca" status: 404 len: 111 microversion: 2.1 time: 0.103468 Oct 10 23:29:48.902155 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1619/3156] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:48 2022] GET /compute/v2.1/servers/cc990503-6019-4b55-b2c9-24f72769eaca => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:29:48.908706 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-6a6056d3-f8ed-4fa5-80be-997a8d2d5e50 req-3399fe20-1e78-468f-8eb0-ba3134c01ad0 service nova] Creating event network-changed:908f4746-53e5-4919-9052-9bf8f7b743a5 for instance 65aed129-f63a-4afd-9cc3-ad6061e5b35b on n-h1-860864-2 Oct 10 23:29:48.917492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-da5150a6-8507-451d-8794-d0aa705c37ee tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:48.919572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-da5150a6-8507-451d-8794-d0aa705c37ee tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:48.923527 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-6a6056d3-f8ed-4fa5-80be-997a8d2d5e50 req-3399fe20-1e78-468f-8eb0-ba3134c01ad0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059478 Oct 10 23:29:48.925137 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1538/3157] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:48.931987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da5150a6-8507-451d-8794-d0aa705c37ee tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:48.932798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da5150a6-8507-451d-8794-d0aa705c37ee tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:48.936590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da5150a6-8507-451d-8794-d0aa705c37ee tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:48.937796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da5150a6-8507-451d-8794-d0aa705c37ee tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:48.938494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da5150a6-8507-451d-8794-d0aa705c37ee tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:48.939142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da5150a6-8507-451d-8794-d0aa705c37ee tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:48.942308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7b842258-65da-44cd-b6d0-f3bc6d624a18 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:48.943176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7b842258-65da-44cd-b6d0-f3bc6d624a18 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:48.959830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b842258-65da-44cd-b6d0-f3bc6d624a18 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:48.960501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b842258-65da-44cd-b6d0-f3bc6d624a18 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:48.962032 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b842258-65da-44cd-b6d0-f3bc6d624a18 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:48.963554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b842258-65da-44cd-b6d0-f3bc6d624a18 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:48.965713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b842258-65da-44cd-b6d0-f3bc6d624a18 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:48.968711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b842258-65da-44cd-b6d0-f3bc6d624a18 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:48.974385 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-da5150a6-8507-451d-8794-d0aa705c37ee tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:29:49.121874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7b842258-65da-44cd-b6d0-f3bc6d624a18 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:49.136608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7b842258-65da-44cd-b6d0-f3bc6d624a18 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:49.139696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7b842258-65da-44cd-b6d0-f3bc6d624a18 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:49.144147 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7b842258-65da-44cd-b6d0-f3bc6d624a18 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1366 microversion: 2.47 time: 0.206552 Oct 10 23:29:49.147843 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1539/3158] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:48 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:29:49.204552 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-da5150a6-8507-451d-8794-d0aa705c37ee tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee" status: 204 len: 0 microversion: 2.1 time: 0.300092 Oct 10 23:29:49.205148 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1620/3159] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:29:48 2022] DELETE /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:29:49.213982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1429171b-d9b0-4863-af2e-f93201ea0499 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:49.215166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1429171b-d9b0-4863-af2e-f93201ea0499 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:49.235062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1429171b-d9b0-4863-af2e-f93201ea0499 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:49.236924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1429171b-d9b0-4863-af2e-f93201ea0499 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:49.241769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1429171b-d9b0-4863-af2e-f93201ea0499 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:49.242727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1429171b-d9b0-4863-af2e-f93201ea0499 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:49.243333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1429171b-d9b0-4863-af2e-f93201ea0499 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:49.243838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1429171b-d9b0-4863-af2e-f93201ea0499 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:49.475667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:49.504947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1429171b-d9b0-4863-af2e-f93201ea0499 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:49.515488 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1429171b-d9b0-4863-af2e-f93201ea0499 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee" status: 200 len: 1469 microversion: 2.1 time: 0.305997 Oct 10 23:29:49.519587 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1540/3160] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:49 2022] GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee => generated 1469 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:49.805441 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-46a35b1f-651c-4ca5-a703-d418dc659777 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:49.806766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-46a35b1f-651c-4ca5-a703-d418dc659777 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:49.822745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46a35b1f-651c-4ca5-a703-d418dc659777 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:49.823823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46a35b1f-651c-4ca5-a703-d418dc659777 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:49.824907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46a35b1f-651c-4ca5-a703-d418dc659777 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:49.826553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46a35b1f-651c-4ca5-a703-d418dc659777 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:49.827574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46a35b1f-651c-4ca5-a703-d418dc659777 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:49.828465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46a35b1f-651c-4ca5-a703-d418dc659777 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:49.878304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a8873bee-3240-4727-8afa-a2dd81bca21e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:49.879025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a8873bee-3240-4727-8afa-a2dd81bca21e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 65aed129-f63a-4afd-9cc3-ad6061e5b35b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:49.893117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8873bee-3240-4727-8afa-a2dd81bca21e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:49.895868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8873bee-3240-4727-8afa-a2dd81bca21e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:49.896586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8873bee-3240-4727-8afa-a2dd81bca21e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:49.897486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8873bee-3240-4727-8afa-a2dd81bca21e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:49.900553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8873bee-3240-4727-8afa-a2dd81bca21e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:49.901333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8873bee-3240-4727-8afa-a2dd81bca21e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:50.050563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=16 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:50.173216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-46a35b1f-651c-4ca5-a703-d418dc659777 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:50.188321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-46a35b1f-651c-4ca5-a703-d418dc659777 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:50.189853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-46a35b1f-651c-4ca5-a703-d418dc659777 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:50.191044 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-46a35b1f-651c-4ca5-a703-d418dc659777 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 0.390251 Oct 10 23:29:50.205469 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1621/3161] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:49 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:50.205469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9965ac38-e472-4bba-82c7-c266ea1b0d9e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:50.205469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9965ac38-e472-4bba-82c7-c266ea1b0d9e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:50.206086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9965ac38-e472-4bba-82c7-c266ea1b0d9e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:50.211293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9965ac38-e472-4bba-82c7-c266ea1b0d9e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:50.211293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9965ac38-e472-4bba-82c7-c266ea1b0d9e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:50.211293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9965ac38-e472-4bba-82c7-c266ea1b0d9e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:50.211293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9965ac38-e472-4bba-82c7-c266ea1b0d9e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:50.211293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9965ac38-e472-4bba-82c7-c266ea1b0d9e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:50.238742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:50.271515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a8873bee-3240-4727-8afa-a2dd81bca21e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:50.281913 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a8873bee-3240-4727-8afa-a2dd81bca21e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b" status: 200 len: 1324 microversion: 2.1 time: 0.408432 Oct 10 23:29:50.283532 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1541/3162] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:49 2022] GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b => generated 1324 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:50.292494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9965ac38-e472-4bba-82c7-c266ea1b0d9e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:50.303649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9965ac38-e472-4bba-82c7-c266ea1b0d9e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:50.305118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9965ac38-e472-4bba-82c7-c266ea1b0d9e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:50.306434 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9965ac38-e472-4bba-82c7-c266ea1b0d9e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1366 microversion: 2.47 time: 0.113086 Oct 10 23:29:50.307556 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1622/3163] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:50 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1366 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:50.546369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f3cf8a08-b07a-4999-acfd-56f021d690d1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:50.547501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f3cf8a08-b07a-4999-acfd-56f021d690d1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:50.554547 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3cf8a08-b07a-4999-acfd-56f021d690d1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:50.555409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3cf8a08-b07a-4999-acfd-56f021d690d1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:50.556630 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3cf8a08-b07a-4999-acfd-56f021d690d1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:50.557480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3cf8a08-b07a-4999-acfd-56f021d690d1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:50.558021 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3cf8a08-b07a-4999-acfd-56f021d690d1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:50.559074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3cf8a08-b07a-4999-acfd-56f021d690d1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:50.649190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f5adbf17-d921-4946-b6ce-e143a4c6db64 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:50.650094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f5adbf17-d921-4946-b6ce-e143a4c6db64 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:50.657216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5adbf17-d921-4946-b6ce-e143a4c6db64 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:50.658060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5adbf17-d921-4946-b6ce-e143a4c6db64 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:50.658740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5adbf17-d921-4946-b6ce-e143a4c6db64 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:50.659676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5adbf17-d921-4946-b6ce-e143a4c6db64 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:50.660344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5adbf17-d921-4946-b6ce-e143a4c6db64 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:50.661004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5adbf17-d921-4946-b6ce-e143a4c6db64 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:50.678089 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-f5adbf17-d921-4946-b6ce-e143a4c6db64 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] HTTP exception thrown: Instance 92e9f63c-d49b-4a32-80b8-b729b8530379 could not be found. Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f5adbf17-d921-4946-b6ce-e143a4c6db64 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Request method failure captured: Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 HTTP/1.1 Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKlI_YkLpN74j_S3g3S6EcM7YKiKgbKXL7mTv6k3fUCYv3Ak1NWP8hxmuTXmVLoihl2334XejPqPrC-9pcqzYQS4P0aVciT3ekTGIZc0Q1dkz5tFbEWE8TV2EjVtyaSfcoSr32WmBQI0pkZHXYeq0SrBFvw6DpvWsvLH6YvOSkivg5E Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 6e7609ed88094dd083202e42b058ffd5 Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AttachVolumeTestJSON-168471984 Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6e7609ed88094dd083202e42b058ffd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6e7609ed88094dd083202e42b058ffd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6e7609ed88094dd083202e42b058ffd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6e7609ed88094dd083202e42b058ffd5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AttachVolumeTestJSON-168471984 Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 6e7609ed88094dd083202e42b058ffd5 Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AttachVolumeTestJSON-168471984 Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AttachVolumeTestJSON-168471984-project Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: f9e8299b29f044b0ab99b74346bf4870 Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AttachVolumeTestJSON-168471984-project Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 92e9f63c-d49b-4a32-80b8-b729b8530379 could not be found. Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '92e9f63c-d49b-4a32-80b8-b729b8530379'} Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92e9f63c-d49b-4a32-80b8-b729b8530379 could not be found. Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:29:50.680191 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:29:50.686037 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92e9f63c-d49b-4a32-80b8-b729b8530379 could not be found. Oct 10 23:29:50.686037 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:50.686037 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:50.686037 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:50.686037 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:50.686037 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:50.686037 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:50.686037 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:29:50.686037 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:29:50.686037 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92e9f63c-d49b-4a32-80b8-b729b8530379 could not be found. Oct 10 23:29:50.686037 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:50.689442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f5adbf17-d921-4946-b6ce-e143a4c6db64 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Returning 404 to user: Instance 92e9f63c-d49b-4a32-80b8-b729b8530379 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:29:50.691033 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f5adbf17-d921-4946-b6ce-e143a4c6db64 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "DELETE /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379" status: 404 len: 111 microversion: 2.1 time: 0.047900 Oct 10 23:29:50.695725 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1623/3164] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:29:50 2022] DELETE /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:29:50.704331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-93a91aea-c32a-4842-b197-5aa6dd55bbf4 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:50.705197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-93a91aea-c32a-4842-b197-5aa6dd55bbf4 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 92e9f63c-d49b-4a32-80b8-b729b8530379] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:50.717875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93a91aea-c32a-4842-b197-5aa6dd55bbf4 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:50.718817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93a91aea-c32a-4842-b197-5aa6dd55bbf4 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:50.719523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93a91aea-c32a-4842-b197-5aa6dd55bbf4 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:50.720469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93a91aea-c32a-4842-b197-5aa6dd55bbf4 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:50.721197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93a91aea-c32a-4842-b197-5aa6dd55bbf4 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:50.721880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93a91aea-c32a-4842-b197-5aa6dd55bbf4 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:50.743316 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-93a91aea-c32a-4842-b197-5aa6dd55bbf4 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] HTTP exception thrown: Instance 92e9f63c-d49b-4a32-80b8-b729b8530379 could not be found. Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-93a91aea-c32a-4842-b197-5aa6dd55bbf4 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Request method failure captured: Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 HTTP/1.1 Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKlI_YkLpN74j_S3g3S6EcM7YKiKgbKXL7mTv6k3fUCYv3Ak1NWP8hxmuTXmVLoihl2334XejPqPrC-9pcqzYQS4P0aVciT3ekTGIZc0Q1dkz5tFbEWE8TV2EjVtyaSfcoSr32WmBQI0pkZHXYeq0SrBFvw6DpvWsvLH6YvOSkivg5E Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 6e7609ed88094dd083202e42b058ffd5 Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AttachVolumeTestJSON-168471984 Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6e7609ed88094dd083202e42b058ffd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6e7609ed88094dd083202e42b058ffd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6e7609ed88094dd083202e42b058ffd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6e7609ed88094dd083202e42b058ffd5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AttachVolumeTestJSON-168471984 Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 6e7609ed88094dd083202e42b058ffd5 Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AttachVolumeTestJSON-168471984 Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AttachVolumeTestJSON-168471984-project Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: f9e8299b29f044b0ab99b74346bf4870 Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AttachVolumeTestJSON-168471984-project Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 92e9f63c-d49b-4a32-80b8-b729b8530379 could not be found. Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '92e9f63c-d49b-4a32-80b8-b729b8530379'} Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92e9f63c-d49b-4a32-80b8-b729b8530379 could not be found. Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92e9f63c-d49b-4a32-80b8-b729b8530379 could not be found. Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:50.745367 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:50.750892 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:50.750892 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:50.750892 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:50.750892 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:29:50.750892 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:29:50.750892 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92e9f63c-d49b-4a32-80b8-b729b8530379 could not be found. Oct 10 23:29:50.750892 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:50.754612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-93a91aea-c32a-4842-b197-5aa6dd55bbf4 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Returning 404 to user: Instance 92e9f63c-d49b-4a32-80b8-b729b8530379 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:29:50.754612 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-93a91aea-c32a-4842-b197-5aa6dd55bbf4 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379" status: 404 len: 111 microversion: 2.1 time: 0.056033 Oct 10 23:29:50.757737 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1624/3165] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:50 2022] GET /compute/v2.1/servers/92e9f63c-d49b-4a32-80b8-b729b8530379 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:29:51.062686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f3cf8a08-b07a-4999-acfd-56f021d690d1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:51.075668 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f3cf8a08-b07a-4999-acfd-56f021d690d1 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee" status: 200 len: 1469 microversion: 2.1 time: 0.535150 Oct 10 23:29:51.085755 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1542/3166] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:50 2022] GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee => generated 1469 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:51.222543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a5b5eef1-3119-48b5-8614-ec1f1ae25ed1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:51.223779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a5b5eef1-3119-48b5-8614-ec1f1ae25ed1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:51.234457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5b5eef1-3119-48b5-8614-ec1f1ae25ed1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:51.235110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5b5eef1-3119-48b5-8614-ec1f1ae25ed1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:51.235859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5b5eef1-3119-48b5-8614-ec1f1ae25ed1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:51.236912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5b5eef1-3119-48b5-8614-ec1f1ae25ed1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:51.237853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5b5eef1-3119-48b5-8614-ec1f1ae25ed1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:51.238825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5b5eef1-3119-48b5-8614-ec1f1ae25ed1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:51.308518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-52064fba-bd31-4f26-a856-06e2116b43c3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:51.309958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-52064fba-bd31-4f26-a856-06e2116b43c3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 65aed129-f63a-4afd-9cc3-ad6061e5b35b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:51.325397 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52064fba-bd31-4f26-a856-06e2116b43c3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:51.326235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52064fba-bd31-4f26-a856-06e2116b43c3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:51.328802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52064fba-bd31-4f26-a856-06e2116b43c3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:51.331470 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52064fba-bd31-4f26-a856-06e2116b43c3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:51.332271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52064fba-bd31-4f26-a856-06e2116b43c3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:51.334677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52064fba-bd31-4f26-a856-06e2116b43c3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:51.630296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a5b5eef1-3119-48b5-8614-ec1f1ae25ed1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:51.644927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a5b5eef1-3119-48b5-8614-ec1f1ae25ed1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:51.647679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a5b5eef1-3119-48b5-8614-ec1f1ae25ed1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:51.649670 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a5b5eef1-3119-48b5-8614-ec1f1ae25ed1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 0.434717 Oct 10 23:29:51.667865 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1625/3167] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:51 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:51.685105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-aadfd135-cbc8-4731-a7fe-52197520aa4b tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:51.688715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-aadfd135-cbc8-4731-a7fe-52197520aa4b tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:51.703501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aadfd135-cbc8-4731-a7fe-52197520aa4b tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:51.704346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aadfd135-cbc8-4731-a7fe-52197520aa4b tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:51.705171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aadfd135-cbc8-4731-a7fe-52197520aa4b tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:51.706679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aadfd135-cbc8-4731-a7fe-52197520aa4b tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:51.708300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aadfd135-cbc8-4731-a7fe-52197520aa4b tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:51.709471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aadfd135-cbc8-4731-a7fe-52197520aa4b tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:51.832342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-aadfd135-cbc8-4731-a7fe-52197520aa4b tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:51.845078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-aadfd135-cbc8-4731-a7fe-52197520aa4b tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:51.846905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-aadfd135-cbc8-4731-a7fe-52197520aa4b tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:51.848290 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-aadfd135-cbc8-4731-a7fe-52197520aa4b tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1366 microversion: 2.47 time: 0.178998 Oct 10 23:29:51.866700 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1626/3168] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:51 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:52.112374 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-599105f3-8019-4cad-b4b7-01cf1dfad2ad tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:52.113181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-599105f3-8019-4cad-b4b7-01cf1dfad2ad tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:52.120274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-599105f3-8019-4cad-b4b7-01cf1dfad2ad tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:52.121624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-599105f3-8019-4cad-b4b7-01cf1dfad2ad tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:52.122133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-599105f3-8019-4cad-b4b7-01cf1dfad2ad tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:52.122883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-599105f3-8019-4cad-b4b7-01cf1dfad2ad tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:52.123349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-599105f3-8019-4cad-b4b7-01cf1dfad2ad tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:52.123950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-599105f3-8019-4cad-b4b7-01cf1dfad2ad tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:52.293197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-52064fba-bd31-4f26-a856-06e2116b43c3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:52.303675 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-52064fba-bd31-4f26-a856-06e2116b43c3 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b" status: 200 len: 1324 microversion: 2.1 time: 1.001146 Oct 10 23:29:52.317822 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1543/3169] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:51 2022] GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b => generated 1324 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:52.405711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-599105f3-8019-4cad-b4b7-01cf1dfad2ad tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:52.424847 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-599105f3-8019-4cad-b4b7-01cf1dfad2ad tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee" status: 200 len: 1469 microversion: 2.1 time: 0.314627 Oct 10 23:29:52.427226 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1627/3170] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:52 2022] GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee => generated 1469 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:29:52.684422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bb035cce-25ad-4342-bf61-90622396d17f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:52.685334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bb035cce-25ad-4342-bf61-90622396d17f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:52.698589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb035cce-25ad-4342-bf61-90622396d17f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:52.703339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb035cce-25ad-4342-bf61-90622396d17f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:52.704441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb035cce-25ad-4342-bf61-90622396d17f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:52.705736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb035cce-25ad-4342-bf61-90622396d17f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:52.706755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb035cce-25ad-4342-bf61-90622396d17f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:52.713244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb035cce-25ad-4342-bf61-90622396d17f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:52.878085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-22811423-6dcb-44dd-9502-1031cc059ad6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:52.879743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-22811423-6dcb-44dd-9502-1031cc059ad6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:52.892935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22811423-6dcb-44dd-9502-1031cc059ad6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:52.895081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22811423-6dcb-44dd-9502-1031cc059ad6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:52.896691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22811423-6dcb-44dd-9502-1031cc059ad6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:52.899100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22811423-6dcb-44dd-9502-1031cc059ad6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:52.907822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22811423-6dcb-44dd-9502-1031cc059ad6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:52.908772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22811423-6dcb-44dd-9502-1031cc059ad6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:53.049629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-22811423-6dcb-44dd-9502-1031cc059ad6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:53.075625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-22811423-6dcb-44dd-9502-1031cc059ad6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:53.085729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-22811423-6dcb-44dd-9502-1031cc059ad6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:53.087841 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-22811423-6dcb-44dd-9502-1031cc059ad6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1366 microversion: 2.47 time: 0.213040 Oct 10 23:29:53.090293 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1628/3171] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:52 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:29:53.330081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cdc4096d-87f5-4e7b-a213-870380dc881f tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:53.330753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cdc4096d-87f5-4e7b-a213-870380dc881f tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 65aed129-f63a-4afd-9cc3-ad6061e5b35b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:53.337485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdc4096d-87f5-4e7b-a213-870380dc881f tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:53.337969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdc4096d-87f5-4e7b-a213-870380dc881f tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:53.338415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdc4096d-87f5-4e7b-a213-870380dc881f tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:53.339154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdc4096d-87f5-4e7b-a213-870380dc881f tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:53.340147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdc4096d-87f5-4e7b-a213-870380dc881f tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:53.340581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdc4096d-87f5-4e7b-a213-870380dc881f tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:53.400355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb035cce-25ad-4342-bf61-90622396d17f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:53.418336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb035cce-25ad-4342-bf61-90622396d17f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:53.423260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb035cce-25ad-4342-bf61-90622396d17f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:53.424504 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bb035cce-25ad-4342-bf61-90622396d17f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 0.745248 Oct 10 23:29:53.429942 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1544/3172] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:52 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:53.453152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3a8c0b20-f50e-4c0c-bd8b-77b85ed46261 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:53.453771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3a8c0b20-f50e-4c0c-bd8b-77b85ed46261 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:53.461367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a8c0b20-f50e-4c0c-bd8b-77b85ed46261 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:53.465836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a8c0b20-f50e-4c0c-bd8b-77b85ed46261 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:53.466538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a8c0b20-f50e-4c0c-bd8b-77b85ed46261 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:53.467285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a8c0b20-f50e-4c0c-bd8b-77b85ed46261 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:53.467756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a8c0b20-f50e-4c0c-bd8b-77b85ed46261 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:53.468191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a8c0b20-f50e-4c0c-bd8b-77b85ed46261 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:53.532092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cdc4096d-87f5-4e7b-a213-870380dc881f tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:53.545698 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cdc4096d-87f5-4e7b-a213-870380dc881f tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b" status: 200 len: 1324 microversion: 2.1 time: 0.219648 Oct 10 23:29:53.547942 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1629/3173] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:53 2022] GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b => generated 1324 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:29:54.045840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3a8c0b20-f50e-4c0c-bd8b-77b85ed46261 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:54.061221 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3a8c0b20-f50e-4c0c-bd8b-77b85ed46261 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee" status: 200 len: 1469 microversion: 2.1 time: 0.612616 Oct 10 23:29:54.062672 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1545/3174] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:53 2022] GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee => generated 1469 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:54.121037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c59860f6-e25e-4fe6-adab-930bd230eaa2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:54.121947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c59860f6-e25e-4fe6-adab-930bd230eaa2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:54.142492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:54.149959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c59860f6-e25e-4fe6-adab-930bd230eaa2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:54.152486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c59860f6-e25e-4fe6-adab-930bd230eaa2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:54.154376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c59860f6-e25e-4fe6-adab-930bd230eaa2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:54.158229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c59860f6-e25e-4fe6-adab-930bd230eaa2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:54.159333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c59860f6-e25e-4fe6-adab-930bd230eaa2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:54.160687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c59860f6-e25e-4fe6-adab-930bd230eaa2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:54.316377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c59860f6-e25e-4fe6-adab-930bd230eaa2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:54.329107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c59860f6-e25e-4fe6-adab-930bd230eaa2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:54.331973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c59860f6-e25e-4fe6-adab-930bd230eaa2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:54.333683 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c59860f6-e25e-4fe6-adab-930bd230eaa2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1366 microversion: 2.47 time: 0.218783 Oct 10 23:29:54.335521 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1630/3175] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:54 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:54.459641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d8cebbd0-4db9-4dda-856c-af90537d5560 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:54.460888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d8cebbd0-4db9-4dda-856c-af90537d5560 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:54.472596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8cebbd0-4db9-4dda-856c-af90537d5560 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:54.475752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8cebbd0-4db9-4dda-856c-af90537d5560 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:54.476216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8cebbd0-4db9-4dda-856c-af90537d5560 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:54.476981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8cebbd0-4db9-4dda-856c-af90537d5560 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:54.477524 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8cebbd0-4db9-4dda-856c-af90537d5560 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:54.480716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8cebbd0-4db9-4dda-856c-af90537d5560 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:54.578888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a0362bb8-d47a-4edd-906f-60475335be86 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:54.579508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a0362bb8-d47a-4edd-906f-60475335be86 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 65aed129-f63a-4afd-9cc3-ad6061e5b35b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:54.597599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0362bb8-d47a-4edd-906f-60475335be86 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:54.598105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0362bb8-d47a-4edd-906f-60475335be86 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:54.598547 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0362bb8-d47a-4edd-906f-60475335be86 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:54.599264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0362bb8-d47a-4edd-906f-60475335be86 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:54.599712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0362bb8-d47a-4edd-906f-60475335be86 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:54.607585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0362bb8-d47a-4edd-906f-60475335be86 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:54.975974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a0362bb8-d47a-4edd-906f-60475335be86 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:54.998113 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a0362bb8-d47a-4edd-906f-60475335be86 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b" status: 200 len: 1324 microversion: 2.1 time: 0.424365 Oct 10 23:29:54.998753 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1631/3176] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:54 2022] GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b => generated 1324 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:29:55.018225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-cd5a5db2-730d-40da-94a6-e0a3f7a51fed req-53ee298a-72ba-4504-8316-78956940ce28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18753c2-80e8-4fea-b2ad-04fa1ae400ee", "name": "network-vif-deleted", "tag": "2aba71f9-c43a-48db-ac3d-66f4596a4820"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:55.069934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cd5a5db2-730d-40da-94a6-e0a3f7a51fed req-53ee298a-72ba-4504-8316-78956940ce28 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:55.072337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cd5a5db2-730d-40da-94a6-e0a3f7a51fed req-53ee298a-72ba-4504-8316-78956940ce28 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:55.072796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cd5a5db2-730d-40da-94a6-e0a3f7a51fed req-53ee298a-72ba-4504-8316-78956940ce28 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:55.109500 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-cd5a5db2-730d-40da-94a6-e0a3f7a51fed req-53ee298a-72ba-4504-8316-78956940ce28 service nova] Creating event network-vif-deleted:2aba71f9-c43a-48db-ac3d-66f4596a4820 for instance e18753c2-80e8-4fea-b2ad-04fa1ae400ee on n-h1-860864-2 Oct 10 23:29:55.122718 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-cd5a5db2-730d-40da-94a6-e0a3f7a51fed req-53ee298a-72ba-4504-8316-78956940ce28 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116643 Oct 10 23:29:55.124752 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1632/3177] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:55.145046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-34f2f685-5af2-45ac-af40-f631e0960a8f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:55.145792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-34f2f685-5af2-45ac-af40-f631e0960a8f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:55.161495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34f2f685-5af2-45ac-af40-f631e0960a8f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:55.162335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34f2f685-5af2-45ac-af40-f631e0960a8f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:55.163617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34f2f685-5af2-45ac-af40-f631e0960a8f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:55.164510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34f2f685-5af2-45ac-af40-f631e0960a8f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:55.165148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34f2f685-5af2-45ac-af40-f631e0960a8f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:55.165766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34f2f685-5af2-45ac-af40-f631e0960a8f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:55.262936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34f2f685-5af2-45ac-af40-f631e0960a8f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:55.263709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34f2f685-5af2-45ac-af40-f631e0960a8f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:55.264489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34f2f685-5af2-45ac-af40-f631e0960a8f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:55.276512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-34f2f685-5af2-45ac-af40-f631e0960a8f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lazy-loading 'fault' on Instance uuid e18753c2-80e8-4fea-b2ad-04fa1ae400ee {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:29:55.367455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d8cebbd0-4db9-4dda-856c-af90537d5560 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:55.393460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d8cebbd0-4db9-4dda-856c-af90537d5560 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:55.403144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-34f2f685-5af2-45ac-af40-f631e0960a8f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:55.405739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d8cebbd0-4db9-4dda-856c-af90537d5560 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:55.410869 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d8cebbd0-4db9-4dda-856c-af90537d5560 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 0.956021 Oct 10 23:29:55.411487 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1546/3178] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:54 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:55.429462 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-34f2f685-5af2-45ac-af40-f631e0960a8f tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee" status: 200 len: 1304 microversion: 2.1 time: 0.289271 Oct 10 23:29:55.430337 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1633/3179] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:55 2022] GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee => generated 1304 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:55.448163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-56a07847-2737-4a3d-8aa9-afb20cc993da tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:55.451443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-56a07847-2737-4a3d-8aa9-afb20cc993da tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:55.467851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56a07847-2737-4a3d-8aa9-afb20cc993da tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:55.470054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56a07847-2737-4a3d-8aa9-afb20cc993da tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:55.472918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56a07847-2737-4a3d-8aa9-afb20cc993da tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:55.475903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56a07847-2737-4a3d-8aa9-afb20cc993da tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:55.476526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56a07847-2737-4a3d-8aa9-afb20cc993da tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:55.477129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56a07847-2737-4a3d-8aa9-afb20cc993da tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:55.679386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-56a07847-2737-4a3d-8aa9-afb20cc993da tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:55.697447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-56a07847-2737-4a3d-8aa9-afb20cc993da tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:55.697447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-56a07847-2737-4a3d-8aa9-afb20cc993da tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:55.697447 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-56a07847-2737-4a3d-8aa9-afb20cc993da tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1366 microversion: 2.47 time: 0.270648 Oct 10 23:29:55.697447 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1547/3180] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:55 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:56.022564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-776bf3be-caec-4c8e-b730-d7df5666167d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:56.023189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-776bf3be-caec-4c8e-b730-d7df5666167d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 65aed129-f63a-4afd-9cc3-ad6061e5b35b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:56.031134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-776bf3be-caec-4c8e-b730-d7df5666167d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:56.031824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-776bf3be-caec-4c8e-b730-d7df5666167d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:56.032427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-776bf3be-caec-4c8e-b730-d7df5666167d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:56.033285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-776bf3be-caec-4c8e-b730-d7df5666167d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:56.033918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-776bf3be-caec-4c8e-b730-d7df5666167d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:56.034483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-776bf3be-caec-4c8e-b730-d7df5666167d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:56.231781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-776bf3be-caec-4c8e-b730-d7df5666167d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:56.254494 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-776bf3be-caec-4c8e-b730-d7df5666167d tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b" status: 200 len: 1324 microversion: 2.1 time: 0.235450 Oct 10 23:29:56.256056 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1634/3181] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:56 2022] GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b => generated 1324 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:56.450117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f3cc71ed-dd77-4faf-9bd2-dc073af5beda tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:56.453296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f3cc71ed-dd77-4faf-9bd2-dc073af5beda tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:56.472613 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3cc71ed-dd77-4faf-9bd2-dc073af5beda tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:56.473658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3cc71ed-dd77-4faf-9bd2-dc073af5beda tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:56.473658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3cc71ed-dd77-4faf-9bd2-dc073af5beda tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:56.473969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b4a9876a-0495-40c2-9f6d-88b79a27ad39 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:56.474481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b4a9876a-0495-40c2-9f6d-88b79a27ad39 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: e18753c2-80e8-4fea-b2ad-04fa1ae400ee] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:56.479131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3cc71ed-dd77-4faf-9bd2-dc073af5beda tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:56.480288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3cc71ed-dd77-4faf-9bd2-dc073af5beda tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:56.480753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3cc71ed-dd77-4faf-9bd2-dc073af5beda tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:56.483668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4a9876a-0495-40c2-9f6d-88b79a27ad39 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:56.484349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4a9876a-0495-40c2-9f6d-88b79a27ad39 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:56.484903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4a9876a-0495-40c2-9f6d-88b79a27ad39 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:56.485915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4a9876a-0495-40c2-9f6d-88b79a27ad39 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:56.486479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4a9876a-0495-40c2-9f6d-88b79a27ad39 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:56.487008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4a9876a-0495-40c2-9f6d-88b79a27ad39 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:56.507499 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-b4a9876a-0495-40c2-9f6d-88b79a27ad39 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] HTTP exception thrown: Instance e18753c2-80e8-4fea-b2ad-04fa1ae400ee could not be found. Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b4a9876a-0495-40c2-9f6d-88b79a27ad39 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Request method failure captured: Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee HTTP/1.1 Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKpA79wa69yaYJMJw-3QmgQP_hV7sX62O83M5X-L94JQ1rLyIgxW5Ruc3lvxhFy3Av1NfdfEfyRhyEd_wFTCd6i75unkafFXbPSaFvegcFLPVDj0GaYZZV6U0ivHzzI46BEywHla9yZdFSZtzO3ASL0kXk-bD2Ozyg8n4yi8qcJYpW0 Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 4b2326c88f134b7299d87d1133041421 Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersAdminTestJSON-1076446732 Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4b2326c88f134b7299d87d1133041421"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b2326c88f134b7299d87d1133041421"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b2326c88f134b7299d87d1133041421"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4b2326c88f134b7299d87d1133041421", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersAdminTestJSON-1076446732 Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 4b2326c88f134b7299d87d1133041421 Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersAdminTestJSON-1076446732 Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersAdminTestJSON-1076446732-project Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: d536874058b64c6fbb05b3414b6b100c Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersAdminTestJSON-1076446732-project Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance e18753c2-80e8-4fea-b2ad-04fa1ae400ee could not be found. Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'e18753c2-80e8-4fea-b2ad-04fa1ae400ee'} Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18753c2-80e8-4fea-b2ad-04fa1ae400ee could not be found. Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18753c2-80e8-4fea-b2ad-04fa1ae400ee could not be found. Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:56.510575 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:56.516381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:56.516381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:56.516381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:56.516381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:29:56.516381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:29:56.516381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18753c2-80e8-4fea-b2ad-04fa1ae400ee could not be found. Oct 10 23:29:56.516381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:56.518547 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b4a9876a-0495-40c2-9f6d-88b79a27ad39 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Returning 404 to user: Instance e18753c2-80e8-4fea-b2ad-04fa1ae400ee could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:29:56.520332 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b4a9876a-0495-40c2-9f6d-88b79a27ad39 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee" status: 404 len: 111 microversion: 2.1 time: 0.061978 Oct 10 23:29:56.521643 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1635/3182] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:56 2022] GET /compute/v2.1/servers/e18753c2-80e8-4fea-b2ad-04fa1ae400ee => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:29:56.529610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fae7c29b-b054-448c-af68-4dfc1c98d82b tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:56.530685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fae7c29b-b054-448c-af68-4dfc1c98d82b tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:56.548880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fae7c29b-b054-448c-af68-4dfc1c98d82b tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:56.550834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fae7c29b-b054-448c-af68-4dfc1c98d82b tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:56.551473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fae7c29b-b054-448c-af68-4dfc1c98d82b tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:56.552887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fae7c29b-b054-448c-af68-4dfc1c98d82b tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:56.553915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fae7c29b-b054-448c-af68-4dfc1c98d82b tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:56.554726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fae7c29b-b054-448c-af68-4dfc1c98d82b tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:56.583394 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-fae7c29b-b054-448c-af68-4dfc1c98d82b tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] HTTP exception thrown: Instance 10d4252b-2561-4a94-adf8-018fdec5c2cc could not be found. Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fae7c29b-b054-448c-af68-4dfc1c98d82b tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Request method failure captured: Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc HTTP/1.1 Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKlI_YkLpN74j_S3g3S6EcM7YKiKgbKXL7mTv6k3fUCYv3Ak1NWP8hxmuTXmVLoihl2334XejPqPrC-9pcqzYQS4P0aVciT3ekTGIZc0Q1dkz5tFbEWE8TV2EjVtyaSfcoSr32WmBQI0pkZHXYeq0SrBFvw6DpvWsvLH6YvOSkivg5E Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 6e7609ed88094dd083202e42b058ffd5 Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AttachVolumeTestJSON-168471984 Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6e7609ed88094dd083202e42b058ffd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6e7609ed88094dd083202e42b058ffd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6e7609ed88094dd083202e42b058ffd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6e7609ed88094dd083202e42b058ffd5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AttachVolumeTestJSON-168471984 Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 6e7609ed88094dd083202e42b058ffd5 Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AttachVolumeTestJSON-168471984 Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AttachVolumeTestJSON-168471984-project Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: f9e8299b29f044b0ab99b74346bf4870 Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AttachVolumeTestJSON-168471984-project Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 10d4252b-2561-4a94-adf8-018fdec5c2cc could not be found. Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '10d4252b-2561-4a94-adf8-018fdec5c2cc'} Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10d4252b-2561-4a94-adf8-018fdec5c2cc could not be found. Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:29:56.596090 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:29:56.600351 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10d4252b-2561-4a94-adf8-018fdec5c2cc could not be found. Oct 10 23:29:56.600351 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:56.600351 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:56.600351 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:56.600351 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:56.600351 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:56.600351 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:56.600351 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:29:56.600351 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:29:56.600351 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10d4252b-2561-4a94-adf8-018fdec5c2cc could not be found. Oct 10 23:29:56.600351 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:56.605772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fae7c29b-b054-448c-af68-4dfc1c98d82b tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Returning 404 to user: Instance 10d4252b-2561-4a94-adf8-018fdec5c2cc could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:29:56.605772 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fae7c29b-b054-448c-af68-4dfc1c98d82b tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "DELETE /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 404 len: 111 microversion: 2.1 time: 0.081649 Oct 10 23:29:56.607589 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1636/3183] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:29:56 2022] DELETE /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:29:56.615106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7ead7aac-2feb-44e1-99e9-d8b3dcd45db5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:56.615974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7ead7aac-2feb-44e1-99e9-d8b3dcd45db5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:56.625757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ead7aac-2feb-44e1-99e9-d8b3dcd45db5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:56.626642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ead7aac-2feb-44e1-99e9-d8b3dcd45db5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:56.627729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ead7aac-2feb-44e1-99e9-d8b3dcd45db5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:56.629131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ead7aac-2feb-44e1-99e9-d8b3dcd45db5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:56.630179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ead7aac-2feb-44e1-99e9-d8b3dcd45db5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:56.630876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ead7aac-2feb-44e1-99e9-d8b3dcd45db5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:56.698195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7ead7aac-2feb-44e1-99e9-d8b3dcd45db5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:29:56.851380 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7ead7aac-2feb-44e1-99e9-d8b3dcd45db5 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 204 len: 0 microversion: 2.1 time: 0.241398 Oct 10 23:29:56.852254 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1637/3184] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:29:56 2022] DELETE /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:29:56.861903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cd46cb73-8328-421a-bb73-15b9da2e2fb2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:56.862823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cd46cb73-8328-421a-bb73-15b9da2e2fb2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] [instance: 10d4252b-2561-4a94-adf8-018fdec5c2cc] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:56.872870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd46cb73-8328-421a-bb73-15b9da2e2fb2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:56.873564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd46cb73-8328-421a-bb73-15b9da2e2fb2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:56.874133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd46cb73-8328-421a-bb73-15b9da2e2fb2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:56.875685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd46cb73-8328-421a-bb73-15b9da2e2fb2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:56.875685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd46cb73-8328-421a-bb73-15b9da2e2fb2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:56.876363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd46cb73-8328-421a-bb73-15b9da2e2fb2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:56.895205 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-cd46cb73-8328-421a-bb73-15b9da2e2fb2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] HTTP exception thrown: Instance 10d4252b-2561-4a94-adf8-018fdec5c2cc could not be found. Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cd46cb73-8328-421a-bb73-15b9da2e2fb2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Request method failure captured: Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc HTTP/1.1 Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKlI_YkLpN74j_S3g3S6EcM7YKiKgbKXL7mTv6k3fUCYv3Ak1NWP8hxmuTXmVLoihl2334XejPqPrC-9pcqzYQS4P0aVciT3ekTGIZc0Q1dkz5tFbEWE8TV2EjVtyaSfcoSr32WmBQI0pkZHXYeq0SrBFvw6DpvWsvLH6YvOSkivg5E Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 6e7609ed88094dd083202e42b058ffd5 Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AttachVolumeTestJSON-168471984 Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6e7609ed88094dd083202e42b058ffd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6e7609ed88094dd083202e42b058ffd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6e7609ed88094dd083202e42b058ffd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6e7609ed88094dd083202e42b058ffd5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AttachVolumeTestJSON-168471984 Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 6e7609ed88094dd083202e42b058ffd5 Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AttachVolumeTestJSON-168471984 Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AttachVolumeTestJSON-168471984-project Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: f9e8299b29f044b0ab99b74346bf4870 Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AttachVolumeTestJSON-168471984-project Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 10d4252b-2561-4a94-adf8-018fdec5c2cc could not be found. Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '10d4252b-2561-4a94-adf8-018fdec5c2cc'} Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10d4252b-2561-4a94-adf8-018fdec5c2cc could not be found. Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10d4252b-2561-4a94-adf8-018fdec5c2cc could not be found. Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:29:56.897479 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:56.903220 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:29:56.903220 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:29:56.903220 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:29:56.903220 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:29:56.903220 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:29:56.903220 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10d4252b-2561-4a94-adf8-018fdec5c2cc could not be found. Oct 10 23:29:56.903220 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:29:56.903220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cd46cb73-8328-421a-bb73-15b9da2e2fb2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] Returning 404 to user: Instance 10d4252b-2561-4a94-adf8-018fdec5c2cc could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:29:56.903220 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cd46cb73-8328-421a-bb73-15b9da2e2fb2 tempest-AttachVolumeTestJSON-168471984 tempest-AttachVolumeTestJSON-168471984-project] 10.222.0.23 "GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc" status: 404 len: 111 microversion: 2.1 time: 0.045683 Oct 10 23:29:56.903220 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1638/3185] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:56 2022] GET /compute/v2.1/servers/10d4252b-2561-4a94-adf8-018fdec5c2cc => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:29:56.907943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-81d81a34-8a9a-47ae-9eee-f75e3e11dfd5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:56.912231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-81d81a34-8a9a-47ae-9eee-f75e3e11dfd5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:56.929258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81d81a34-8a9a-47ae-9eee-f75e3e11dfd5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:56.931147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81d81a34-8a9a-47ae-9eee-f75e3e11dfd5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:56.932147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81d81a34-8a9a-47ae-9eee-f75e3e11dfd5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:56.933503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81d81a34-8a9a-47ae-9eee-f75e3e11dfd5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:56.934206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81d81a34-8a9a-47ae-9eee-f75e3e11dfd5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:56.934728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81d81a34-8a9a-47ae-9eee-f75e3e11dfd5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:57.038489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f3cc71ed-dd77-4faf-9bd2-dc073af5beda tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:57.053300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f3cc71ed-dd77-4faf-9bd2-dc073af5beda tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:57.059738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f3cc71ed-dd77-4faf-9bd2-dc073af5beda tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:57.061242 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f3cc71ed-dd77-4faf-9bd2-dc073af5beda tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 0.618253 Oct 10 23:29:57.070334 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1548/3186] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:56 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:57.078652 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-be3e2495-c305-450a-a60a-47b0943e317b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:57.079237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-be3e2495-c305-450a-a60a-47b0943e317b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:57.101242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be3e2495-c305-450a-a60a-47b0943e317b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:57.101780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be3e2495-c305-450a-a60a-47b0943e317b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:57.102252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be3e2495-c305-450a-a60a-47b0943e317b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:57.103040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be3e2495-c305-450a-a60a-47b0943e317b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:57.103532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be3e2495-c305-450a-a60a-47b0943e317b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:57.103995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be3e2495-c305-450a-a60a-47b0943e317b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:57.401469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-be3e2495-c305-450a-a60a-47b0943e317b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:57.416556 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-be3e2495-c305-450a-a60a-47b0943e317b tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1469 microversion: 2.1 time: 0.344821 Oct 10 23:29:57.421503 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1549/3187] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:57 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1469 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:57.732674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3dff170e-306f-4039-95d0-ea3a8f792243 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Action: 'create', calling method: .version_select at 0x7f663027e430>, body: {"keypair": {"name": "tempest-keypair-355371435", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5Af+BnIJTFSzuJa/V6tZ/mqdnxxcNzDZpdlBZa07Y886ODTM+2dWxB+DZpUBD5tYoJhB68Qotl+KP8Z4/zWxuP+KPxk/zrQWfMJ9YiuCmYuoz1tF5erZWpi3lv1dyc6A=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:57.781021 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-3dff170e-306f-4039-95d0-ea3a8f792243 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Getting quotas for project 94d503df54a645478e49e6bec5886fa7. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:29:57.802218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-3dff170e-306f-4039-95d0-ea3a8f792243 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Getting quotas for user 6434f96f22354c9186f98f1abfd45ad7 and project 94d503df54a645478e49e6bec5886fa7. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:29:57.853746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-81d81a34-8a9a-47ae-9eee-f75e3e11dfd5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:57.859264 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3dff170e-306f-4039-95d0-ea3a8f792243 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.436473 Oct 10 23:29:57.860907 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1550/3188] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:29:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:57.868767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d6cd5a6a-e978-4446-b72c-e8fd8b345865 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:57.869734 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d6cd5a6a-e978-4446-b72c-e8fd8b345865 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 65aed129-f63a-4afd-9cc3-ad6061e5b35b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:57.873533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-81d81a34-8a9a-47ae-9eee-f75e3e11dfd5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:57.875231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-81d81a34-8a9a-47ae-9eee-f75e3e11dfd5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:57.876462 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-81d81a34-8a9a-47ae-9eee-f75e3e11dfd5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1366 microversion: 2.47 time: 0.974896 Oct 10 23:29:57.877041 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1639/3189] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:56 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1366 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:57.901532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-9bc07a36-7fb0-443e-b9fa-1dd0e635a7fb req-92e42ac6-817f-4128-ac2c-07fb859e0b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65aed129-f63a-4afd-9cc3-ad6061e5b35b", "name": "network-vif-plugged", "status": "completed", "tag": "908f4746-53e5-4919-9052-9bf8f7b743a5"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:29:57.901699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6cd5a6a-e978-4446-b72c-e8fd8b345865 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:57.901699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6cd5a6a-e978-4446-b72c-e8fd8b345865 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:57.909428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6cd5a6a-e978-4446-b72c-e8fd8b345865 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:57.911403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6cd5a6a-e978-4446-b72c-e8fd8b345865 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:57.914011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9bc07a36-7fb0-443e-b9fa-1dd0e635a7fb req-92e42ac6-817f-4128-ac2c-07fb859e0b46 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:57.914503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9bc07a36-7fb0-443e-b9fa-1dd0e635a7fb req-92e42ac6-817f-4128-ac2c-07fb859e0b46 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:57.914943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9bc07a36-7fb0-443e-b9fa-1dd0e635a7fb req-92e42ac6-817f-4128-ac2c-07fb859e0b46 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:57.922268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6cd5a6a-e978-4446-b72c-e8fd8b345865 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:57.923520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6cd5a6a-e978-4446-b72c-e8fd8b345865 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:57.936750 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-9bc07a36-7fb0-443e-b9fa-1dd0e635a7fb req-92e42ac6-817f-4128-ac2c-07fb859e0b46 service nova] Creating event network-vif-plugged:908f4746-53e5-4919-9052-9bf8f7b743a5 for instance 65aed129-f63a-4afd-9cc3-ad6061e5b35b on n-h1-860864-2 Oct 10 23:29:57.951865 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-9bc07a36-7fb0-443e-b9fa-1dd0e635a7fb req-92e42ac6-817f-4128-ac2c-07fb859e0b46 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062505 Oct 10 23:29:57.952499 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1640/3190] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:29:58.093318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9c866ad8-f3be-426e-a514-5aa692e6320e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:58.094069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9c866ad8-f3be-426e-a514-5aa692e6320e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:58.110047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c866ad8-f3be-426e-a514-5aa692e6320e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:58.110588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c866ad8-f3be-426e-a514-5aa692e6320e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:58.111037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c866ad8-f3be-426e-a514-5aa692e6320e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:58.111774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c866ad8-f3be-426e-a514-5aa692e6320e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:58.112247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c866ad8-f3be-426e-a514-5aa692e6320e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:58.112678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c866ad8-f3be-426e-a514-5aa692e6320e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:58.458660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d6cd5a6a-e978-4446-b72c-e8fd8b345865 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:58.471086 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d6cd5a6a-e978-4446-b72c-e8fd8b345865 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b" status: 200 len: 1324 microversion: 2.1 time: 0.604837 Oct 10 23:29:58.477712 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1551/3191] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:57 2022] GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b => generated 1324 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:58.484054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-df62bd8a-206a-403f-9125-250bf6a7f0f2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:58.489283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-df62bd8a-206a-403f-9125-250bf6a7f0f2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:58.512265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df62bd8a-206a-403f-9125-250bf6a7f0f2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:58.512775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df62bd8a-206a-403f-9125-250bf6a7f0f2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:58.513319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df62bd8a-206a-403f-9125-250bf6a7f0f2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:58.514130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df62bd8a-206a-403f-9125-250bf6a7f0f2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:58.514601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df62bd8a-206a-403f-9125-250bf6a7f0f2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:58.515069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df62bd8a-206a-403f-9125-250bf6a7f0f2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:58.583307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:58.693768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9c866ad8-f3be-426e-a514-5aa692e6320e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:58.700393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:29:58.736254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9c866ad8-f3be-426e-a514-5aa692e6320e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:58.743104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9c866ad8-f3be-426e-a514-5aa692e6320e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:58.747738 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9c866ad8-f3be-426e-a514-5aa692e6320e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 0.659384 Oct 10 23:29:58.750055 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1641/3192] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:58 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:29:58.910851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3b13f523-8f7c-4688-990c-a31592d2deb3 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:58.922047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3b13f523-8f7c-4688-990c-a31592d2deb3 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:58.942720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b13f523-8f7c-4688-990c-a31592d2deb3 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:58.944281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b13f523-8f7c-4688-990c-a31592d2deb3 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:58.945697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b13f523-8f7c-4688-990c-a31592d2deb3 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:58.947745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b13f523-8f7c-4688-990c-a31592d2deb3 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:58.949231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b13f523-8f7c-4688-990c-a31592d2deb3 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:58.951288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b13f523-8f7c-4688-990c-a31592d2deb3 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:59.096305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-df62bd8a-206a-403f-9125-250bf6a7f0f2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:59.106370 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-df62bd8a-206a-403f-9125-250bf6a7f0f2 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1469 microversion: 2.1 time: 0.627065 Oct 10 23:29:59.113753 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1552/3193] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:58 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1469 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:29:59.179147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3b13f523-8f7c-4688-990c-a31592d2deb3 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:59.191654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3b13f523-8f7c-4688-990c-a31592d2deb3 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:59.194239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3b13f523-8f7c-4688-990c-a31592d2deb3 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:29:59.195854 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3b13f523-8f7c-4688-990c-a31592d2deb3 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1366 microversion: 2.47 time: 0.289519 Oct 10 23:29:59.197032 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1642/3194] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:58 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:29:59.504341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fc96a2a0-b1f2-442f-8344-8b60f1efcb55 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:59.504967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fc96a2a0-b1f2-442f-8344-8b60f1efcb55 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 65aed129-f63a-4afd-9cc3-ad6061e5b35b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:59.523339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc96a2a0-b1f2-442f-8344-8b60f1efcb55 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:59.523845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc96a2a0-b1f2-442f-8344-8b60f1efcb55 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:59.524288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc96a2a0-b1f2-442f-8344-8b60f1efcb55 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:59.525011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc96a2a0-b1f2-442f-8344-8b60f1efcb55 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:59.525495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc96a2a0-b1f2-442f-8344-8b60f1efcb55 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:59.525926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc96a2a0-b1f2-442f-8344-8b60f1efcb55 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:59.787536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f2cbb4e0-4f8e-4de0-b5de-37fd2ad633ea tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:29:59.788188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f2cbb4e0-4f8e-4de0-b5de-37fd2ad633ea tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:29:59.799209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2cbb4e0-4f8e-4de0-b5de-37fd2ad633ea tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:59.799792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2cbb4e0-4f8e-4de0-b5de-37fd2ad633ea tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:59.800276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2cbb4e0-4f8e-4de0-b5de-37fd2ad633ea tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:29:59.801103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2cbb4e0-4f8e-4de0-b5de-37fd2ad633ea tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:29:59.801634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2cbb4e0-4f8e-4de0-b5de-37fd2ad633ea tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:29:59.802073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2cbb4e0-4f8e-4de0-b5de-37fd2ad633ea tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:00.405339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f2cbb4e0-4f8e-4de0-b5de-37fd2ad633ea tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:00.427124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f2cbb4e0-4f8e-4de0-b5de-37fd2ad633ea tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:00.429120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f2cbb4e0-4f8e-4de0-b5de-37fd2ad633ea tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:00.430742 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f2cbb4e0-4f8e-4de0-b5de-37fd2ad633ea tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 0.649885 Oct 10 23:30:00.435214 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1643/3195] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:29:59 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:00.447804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-790f90c8-ef86-4cd8-92d9-30752c05c727 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:00.450589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-790f90c8-ef86-4cd8-92d9-30752c05c727 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:00.465694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-790f90c8-ef86-4cd8-92d9-30752c05c727 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:00.467520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-790f90c8-ef86-4cd8-92d9-30752c05c727 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:00.468503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-790f90c8-ef86-4cd8-92d9-30752c05c727 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:00.472586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-790f90c8-ef86-4cd8-92d9-30752c05c727 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:00.473463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-790f90c8-ef86-4cd8-92d9-30752c05c727 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:00.474122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-790f90c8-ef86-4cd8-92d9-30752c05c727 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:00.523111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fc96a2a0-b1f2-442f-8344-8b60f1efcb55 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:00.573660 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fc96a2a0-b1f2-442f-8344-8b60f1efcb55 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b" status: 200 len: 1324 microversion: 2.1 time: 1.073074 Oct 10 23:30:00.582906 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1553/3196] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:29:59 2022] GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b => generated 1324 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:30:00.596134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-05539889-0bad-4319-b146-c1becbb3448c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:00.597148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-05539889-0bad-4319-b146-c1becbb3448c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:00.631863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05539889-0bad-4319-b146-c1becbb3448c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:00.632375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05539889-0bad-4319-b146-c1becbb3448c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:00.632827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05539889-0bad-4319-b146-c1becbb3448c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:00.633713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05539889-0bad-4319-b146-c1becbb3448c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:00.634183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05539889-0bad-4319-b146-c1becbb3448c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:00.634645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05539889-0bad-4319-b146-c1becbb3448c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:00.840035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-790f90c8-ef86-4cd8-92d9-30752c05c727 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd536874058b64c6fbb05b3414b6b100c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2326c88f134b7299d87d1133041421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:00.859453 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-790f90c8-ef86-4cd8-92d9-30752c05c727 tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 200 len: 1427 microversion: 2.1 time: 0.414058 Oct 10 23:30:00.861532 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1644/3197] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:00 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 1427 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:00.868432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-decc7281-f418-41cb-8021-97d131a37aa2 req-4b3cac7a-7e7f-4ea8-800d-eb0f4d13467a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d268c6-2b9d-4858-b67f-1dced7831838", "name": "network-vif-deleted", "tag": "3a4df9ab-2215-474a-bffb-e5b388a62d2d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:30:00.914148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-decc7281-f418-41cb-8021-97d131a37aa2 req-4b3cac7a-7e7f-4ea8-800d-eb0f4d13467a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:00.920259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-decc7281-f418-41cb-8021-97d131a37aa2 req-4b3cac7a-7e7f-4ea8-800d-eb0f4d13467a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:00.922374 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-decc7281-f418-41cb-8021-97d131a37aa2 req-4b3cac7a-7e7f-4ea8-800d-eb0f4d13467a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:00.946966 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-decc7281-f418-41cb-8021-97d131a37aa2 req-4b3cac7a-7e7f-4ea8-800d-eb0f4d13467a service nova] Creating event network-vif-deleted:3a4df9ab-2215-474a-bffb-e5b388a62d2d for instance a3d268c6-2b9d-4858-b67f-1dced7831838 on n-h2-860864-2 Oct 10 23:30:00.966825 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-decc7281-f418-41cb-8021-97d131a37aa2 req-4b3cac7a-7e7f-4ea8-800d-eb0f4d13467a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100905 Oct 10 23:30:00.968382 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1645/3198] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:01.004573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-05539889-0bad-4319-b146-c1becbb3448c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:01.023650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-05539889-0bad-4319-b146-c1becbb3448c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:01.025125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-05539889-0bad-4319-b146-c1becbb3448c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:01.031349 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-05539889-0bad-4319-b146-c1becbb3448c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1366 microversion: 2.47 time: 0.446908 Oct 10 23:30:01.031962 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1554/3199] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:00 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1366 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:01.471683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-95d63e42-b780-4612-81fc-6a2a7085e126 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:01.472423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-95d63e42-b780-4612-81fc-6a2a7085e126 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:01.489844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95d63e42-b780-4612-81fc-6a2a7085e126 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:01.490542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95d63e42-b780-4612-81fc-6a2a7085e126 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:01.491288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95d63e42-b780-4612-81fc-6a2a7085e126 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:01.492202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95d63e42-b780-4612-81fc-6a2a7085e126 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:01.492842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95d63e42-b780-4612-81fc-6a2a7085e126 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:01.493484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95d63e42-b780-4612-81fc-6a2a7085e126 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:01.611367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-33b1f764-02f1-411c-93e5-585fb55c1bb8 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:01.611984 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-33b1f764-02f1-411c-93e5-585fb55c1bb8 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 65aed129-f63a-4afd-9cc3-ad6061e5b35b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:01.625110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33b1f764-02f1-411c-93e5-585fb55c1bb8 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:01.626150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33b1f764-02f1-411c-93e5-585fb55c1bb8 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:01.626769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33b1f764-02f1-411c-93e5-585fb55c1bb8 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:01.628042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33b1f764-02f1-411c-93e5-585fb55c1bb8 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:01.634897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33b1f764-02f1-411c-93e5-585fb55c1bb8 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:01.636783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33b1f764-02f1-411c-93e5-585fb55c1bb8 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:01.874337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-95d63e42-b780-4612-81fc-6a2a7085e126 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:01.892013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-95d63e42-b780-4612-81fc-6a2a7085e126 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:01.899249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-95d63e42-b780-4612-81fc-6a2a7085e126 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:01.901311 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-95d63e42-b780-4612-81fc-6a2a7085e126 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 0.435410 Oct 10 23:30:01.902619 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1646/3200] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:01 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:01.916096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-adc97160-f046-46f4-a913-eab341402bde tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:01.918256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-adc97160-f046-46f4-a913-eab341402bde tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] [instance: a3d268c6-2b9d-4858-b67f-1dced7831838] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:01.932858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc97160-f046-46f4-a913-eab341402bde tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:01.937648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc97160-f046-46f4-a913-eab341402bde tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:01.938420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc97160-f046-46f4-a913-eab341402bde tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:01.939325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc97160-f046-46f4-a913-eab341402bde tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:01.939942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc97160-f046-46f4-a913-eab341402bde tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:01.940524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc97160-f046-46f4-a913-eab341402bde tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:01.970874 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-adc97160-f046-46f4-a913-eab341402bde tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] HTTP exception thrown: Instance a3d268c6-2b9d-4858-b67f-1dced7831838 could not be found. Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-adc97160-f046-46f4-a913-eab341402bde tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Request method failure captured: Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 HTTP/1.1 Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKpA79wa69yaYJMJw-3QmgQP_hV7sX62O83M5X-L94JQ1rLyIgxW5Ruc3lvxhFy3Av1NfdfEfyRhyEd_wFTCd6i75unkafFXbPSaFvegcFLPVDj0GaYZZV6U0ivHzzI46BEywHla9yZdFSZtzO3ASL0kXk-bD2Ozyg8n4yi8qcJYpW0 Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 4b2326c88f134b7299d87d1133041421 Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersAdminTestJSON-1076446732 Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4b2326c88f134b7299d87d1133041421"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b2326c88f134b7299d87d1133041421"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4b2326c88f134b7299d87d1133041421"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4b2326c88f134b7299d87d1133041421", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersAdminTestJSON-1076446732 Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 4b2326c88f134b7299d87d1133041421 Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersAdminTestJSON-1076446732 Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersAdminTestJSON-1076446732-project Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: d536874058b64c6fbb05b3414b6b100c Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersAdminTestJSON-1076446732-project Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance a3d268c6-2b9d-4858-b67f-1dced7831838 could not be found. Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'a3d268c6-2b9d-4858-b67f-1dced7831838'} Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3d268c6-2b9d-4858-b67f-1dced7831838 could not be found. Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3d268c6-2b9d-4858-b67f-1dced7831838 could not be found. Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:01.974507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:01.979465 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:01.979465 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:01.979465 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:01.979465 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:30:01.979465 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:30:01.979465 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3d268c6-2b9d-4858-b67f-1dced7831838 could not be found. Oct 10 23:30:01.979465 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:01.982286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-adc97160-f046-46f4-a913-eab341402bde tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] Returning 404 to user: Instance a3d268c6-2b9d-4858-b67f-1dced7831838 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:30:01.986311 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-adc97160-f046-46f4-a913-eab341402bde tempest-ServersAdminTestJSON-1076446732 tempest-ServersAdminTestJSON-1076446732-project] 10.222.0.23 "GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838" status: 404 len: 111 microversion: 2.1 time: 0.081426 Oct 10 23:30:01.987721 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1647/3201] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:01 2022] GET /compute/v2.1/servers/a3d268c6-2b9d-4858-b67f-1dced7831838 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:30:02.059741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fe54af08-31d8-4577-8783-34ba8738a759 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:02.060377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fe54af08-31d8-4577-8783-34ba8738a759 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:02.075213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe54af08-31d8-4577-8783-34ba8738a759 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:02.075943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe54af08-31d8-4577-8783-34ba8738a759 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:02.078363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe54af08-31d8-4577-8783-34ba8738a759 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:02.082420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe54af08-31d8-4577-8783-34ba8738a759 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:02.084225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe54af08-31d8-4577-8783-34ba8738a759 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:02.086177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe54af08-31d8-4577-8783-34ba8738a759 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:02.262236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fe54af08-31d8-4577-8783-34ba8738a759 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:02.277586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-33b1f764-02f1-411c-93e5-585fb55c1bb8 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:02.282713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fe54af08-31d8-4577-8783-34ba8738a759 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:02.290287 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-33b1f764-02f1-411c-93e5-585fb55c1bb8 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b" status: 200 len: 1519 microversion: 2.1 time: 0.683161 Oct 10 23:30:02.291216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fe54af08-31d8-4577-8783-34ba8738a759 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:02.293585 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fe54af08-31d8-4577-8783-34ba8738a759 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1366 microversion: 2.47 time: 0.238500 Oct 10 23:30:02.295326 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1648/3202] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:02 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:02.295669 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1555/3203] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:01 2022] GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b => generated 1519 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:02.345040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d0ae3e13-1e14-4be0-886d-0654604e6fd2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:02.345699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d0ae3e13-1e14-4be0-886d-0654604e6fd2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 65aed129-f63a-4afd-9cc3-ad6061e5b35b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:02.359089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0ae3e13-1e14-4be0-886d-0654604e6fd2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:02.359580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0ae3e13-1e14-4be0-886d-0654604e6fd2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:02.360018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0ae3e13-1e14-4be0-886d-0654604e6fd2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:02.372142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0ae3e13-1e14-4be0-886d-0654604e6fd2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:02.373027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0ae3e13-1e14-4be0-886d-0654604e6fd2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:02.374587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0ae3e13-1e14-4be0-886d-0654604e6fd2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:02.415195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d0ae3e13-1e14-4be0-886d-0654604e6fd2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 65aed129-f63a-4afd-9cc3-ad6061e5b35b] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:30:02.626355 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d0ae3e13-1e14-4be0-886d-0654604e6fd2 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b" status: 204 len: 0 microversion: 2.1 time: 0.291409 Oct 10 23:30:02.632046 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1649/3204] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:30:02 2022] DELETE /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:30:02.638870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-836ce0db-fb7c-4f3f-92e9-56d1deaad8f9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:02.640766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-836ce0db-fb7c-4f3f-92e9-56d1deaad8f9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 65aed129-f63a-4afd-9cc3-ad6061e5b35b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:02.666354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-836ce0db-fb7c-4f3f-92e9-56d1deaad8f9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:02.670476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-836ce0db-fb7c-4f3f-92e9-56d1deaad8f9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:02.671014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-836ce0db-fb7c-4f3f-92e9-56d1deaad8f9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:02.671788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-836ce0db-fb7c-4f3f-92e9-56d1deaad8f9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:02.674248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-836ce0db-fb7c-4f3f-92e9-56d1deaad8f9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:02.674765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-836ce0db-fb7c-4f3f-92e9-56d1deaad8f9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:02.936287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3cdd213a-4852-4149-9b34-c8fbfe9fee0d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:02.937202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3cdd213a-4852-4149-9b34-c8fbfe9fee0d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:02.953094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cdd213a-4852-4149-9b34-c8fbfe9fee0d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:02.954506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cdd213a-4852-4149-9b34-c8fbfe9fee0d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:02.955386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cdd213a-4852-4149-9b34-c8fbfe9fee0d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:02.957020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cdd213a-4852-4149-9b34-c8fbfe9fee0d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:02.957862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cdd213a-4852-4149-9b34-c8fbfe9fee0d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:02.958468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cdd213a-4852-4149-9b34-c8fbfe9fee0d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:03.591469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-836ce0db-fb7c-4f3f-92e9-56d1deaad8f9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:03.633075 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-836ce0db-fb7c-4f3f-92e9-56d1deaad8f9 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b" status: 200 len: 1525 microversion: 2.1 time: 1.000398 Oct 10 23:30:03.633424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3cdd213a-4852-4149-9b34-c8fbfe9fee0d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:03.640483 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1556/3205] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:02 2022] GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b => generated 1525 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:03.647818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3cdd213a-4852-4149-9b34-c8fbfe9fee0d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:03.650392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3cdd213a-4852-4149-9b34-c8fbfe9fee0d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:03.653597 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3cdd213a-4852-4149-9b34-c8fbfe9fee0d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 0.723882 Oct 10 23:30:03.657574 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1650/3206] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:02 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:03.682348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ff5bdd78-fa46-4397-acaf-8b2b598da3e4 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:03.685138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ff5bdd78-fa46-4397-acaf-8b2b598da3e4 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:03.709127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff5bdd78-fa46-4397-acaf-8b2b598da3e4 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:03.710483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff5bdd78-fa46-4397-acaf-8b2b598da3e4 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:03.711904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff5bdd78-fa46-4397-acaf-8b2b598da3e4 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:03.714477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff5bdd78-fa46-4397-acaf-8b2b598da3e4 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:03.715667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff5bdd78-fa46-4397-acaf-8b2b598da3e4 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:03.716750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff5bdd78-fa46-4397-acaf-8b2b598da3e4 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:03.931520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ff5bdd78-fa46-4397-acaf-8b2b598da3e4 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:03.941182 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ff5bdd78-fa46-4397-acaf-8b2b598da3e4 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:03.950651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ff5bdd78-fa46-4397-acaf-8b2b598da3e4 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:03.952311 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ff5bdd78-fa46-4397-acaf-8b2b598da3e4 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1366 microversion: 2.47 time: 0.309542 Oct 10 23:30:03.957404 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1557/3207] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:03 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1366 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:04.672548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f8cf29c7-3e2e-48b2-887b-68415f7612d8 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:04.673082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f8cf29c7-3e2e-48b2-887b-68415f7612d8 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 65aed129-f63a-4afd-9cc3-ad6061e5b35b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:04.709343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4e1d408a-eb4c-4eb4-a92b-53c78cd000eb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:04.710640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4e1d408a-eb4c-4eb4-a92b-53c78cd000eb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:04.724107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8cf29c7-3e2e-48b2-887b-68415f7612d8 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:04.746432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e1d408a-eb4c-4eb4-a92b-53c78cd000eb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:04.746949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e1d408a-eb4c-4eb4-a92b-53c78cd000eb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:04.747395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e1d408a-eb4c-4eb4-a92b-53c78cd000eb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:04.748126 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e1d408a-eb4c-4eb4-a92b-53c78cd000eb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:04.748620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e1d408a-eb4c-4eb4-a92b-53c78cd000eb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:04.753525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8cf29c7-3e2e-48b2-887b-68415f7612d8 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:04.754445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8cf29c7-3e2e-48b2-887b-68415f7612d8 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:04.755853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e1d408a-eb4c-4eb4-a92b-53c78cd000eb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:04.759459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8cf29c7-3e2e-48b2-887b-68415f7612d8 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:04.761498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8cf29c7-3e2e-48b2-887b-68415f7612d8 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:04.763363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8cf29c7-3e2e-48b2-887b-68415f7612d8 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:05.342602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f8cf29c7-3e2e-48b2-887b-68415f7612d8 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:05.374404 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f8cf29c7-3e2e-48b2-887b-68415f7612d8 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b" status: 200 len: 1483 microversion: 2.1 time: 0.713906 Oct 10 23:30:05.382618 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1651/3208] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:04 2022] GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b => generated 1483 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:05.409074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c5899ff3-5a42-4e0a-9405-a6d095bd53b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:05.411823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c5899ff3-5a42-4e0a-9405-a6d095bd53b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:05.432870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5899ff3-5a42-4e0a-9405-a6d095bd53b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:05.437698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5899ff3-5a42-4e0a-9405-a6d095bd53b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:05.443096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5899ff3-5a42-4e0a-9405-a6d095bd53b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:05.447002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5899ff3-5a42-4e0a-9405-a6d095bd53b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:05.448128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5899ff3-5a42-4e0a-9405-a6d095bd53b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:05.453355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5899ff3-5a42-4e0a-9405-a6d095bd53b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:05.733761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c5899ff3-5a42-4e0a-9405-a6d095bd53b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:05.747580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c5899ff3-5a42-4e0a-9405-a6d095bd53b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:05.753120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c5899ff3-5a42-4e0a-9405-a6d095bd53b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:05.755000 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c5899ff3-5a42-4e0a-9405-a6d095bd53b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1366 microversion: 2.47 time: 0.371268 Oct 10 23:30:05.756433 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1652/3209] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:05 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1366 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:05.778418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-40f826cb-30f5-4277-a8ed-e36b4626e9be req-7faa41ce-b7b2-40b1-b5b0-135997bbf945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65aed129-f63a-4afd-9cc3-ad6061e5b35b", "name": "network-vif-deleted", "tag": "908f4746-53e5-4919-9052-9bf8f7b743a5"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:30:05.834093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-40f826cb-30f5-4277-a8ed-e36b4626e9be req-7faa41ce-b7b2-40b1-b5b0-135997bbf945 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:05.834936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-40f826cb-30f5-4277-a8ed-e36b4626e9be req-7faa41ce-b7b2-40b1-b5b0-135997bbf945 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:05.838406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-40f826cb-30f5-4277-a8ed-e36b4626e9be req-7faa41ce-b7b2-40b1-b5b0-135997bbf945 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:05.910816 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-40f826cb-30f5-4277-a8ed-e36b4626e9be req-7faa41ce-b7b2-40b1-b5b0-135997bbf945 service nova] Creating event network-vif-deleted:908f4746-53e5-4919-9052-9bf8f7b743a5 for instance 65aed129-f63a-4afd-9cc3-ad6061e5b35b on n-h1-860864-2 Oct 10 23:30:05.927264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4e1d408a-eb4c-4eb4-a92b-53c78cd000eb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:05.948894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4e1d408a-eb4c-4eb4-a92b-53c78cd000eb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:05.953215 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-40f826cb-30f5-4277-a8ed-e36b4626e9be req-7faa41ce-b7b2-40b1-b5b0-135997bbf945 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185593 Oct 10 23:30:05.955258 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1653/3210] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:05.965243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4e1d408a-eb4c-4eb4-a92b-53c78cd000eb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:05.968386 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4e1d408a-eb4c-4eb4-a92b-53c78cd000eb tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 1.266835 Oct 10 23:30:05.972654 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1558/3211] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:04 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:30:06.411858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1632f00f-8733-40de-89b5-4876d684fb41 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:06.412580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1632f00f-8733-40de-89b5-4876d684fb41 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 65aed129-f63a-4afd-9cc3-ad6061e5b35b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:06.426214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1632f00f-8733-40de-89b5-4876d684fb41 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:06.430741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1632f00f-8733-40de-89b5-4876d684fb41 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:06.432044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1632f00f-8733-40de-89b5-4876d684fb41 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:06.434177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1632f00f-8733-40de-89b5-4876d684fb41 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:06.438814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1632f00f-8733-40de-89b5-4876d684fb41 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:06.444246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1632f00f-8733-40de-89b5-4876d684fb41 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:06.522029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1632f00f-8733-40de-89b5-4876d684fb41 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:06.522527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1632f00f-8733-40de-89b5-4876d684fb41 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:06.523595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1632f00f-8733-40de-89b5-4876d684fb41 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:06.524901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-1632f00f-8733-40de-89b5-4876d684fb41 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lazy-loading 'fault' on Instance uuid 65aed129-f63a-4afd-9cc3-ad6061e5b35b {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:30:06.643857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1632f00f-8733-40de-89b5-4876d684fb41 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f891fce5072c448c97f96a9df58d981e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c4489c308e462d89b97edcf6c21572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:06.663234 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1632f00f-8733-40de-89b5-4876d684fb41 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b" status: 200 len: 1314 microversion: 2.1 time: 0.255971 Oct 10 23:30:06.668241 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1654/3212] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:06 2022] GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:06.796416 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9b17cbd0-bf06-41b7-a430-c77b8e14f8cd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:06.797042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9b17cbd0-bf06-41b7-a430-c77b8e14f8cd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:06.822192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b17cbd0-bf06-41b7-a430-c77b8e14f8cd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:06.827281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b17cbd0-bf06-41b7-a430-c77b8e14f8cd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:06.829110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b17cbd0-bf06-41b7-a430-c77b8e14f8cd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:06.830166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b17cbd0-bf06-41b7-a430-c77b8e14f8cd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:06.830853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b17cbd0-bf06-41b7-a430-c77b8e14f8cd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:06.832128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b17cbd0-bf06-41b7-a430-c77b8e14f8cd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:06.950811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9b17cbd0-bf06-41b7-a430-c77b8e14f8cd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:06.962836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9b17cbd0-bf06-41b7-a430-c77b8e14f8cd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:06.969217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9b17cbd0-bf06-41b7-a430-c77b8e14f8cd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:06.970999 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9b17cbd0-bf06-41b7-a430-c77b8e14f8cd tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1366 microversion: 2.47 time: 0.180681 Oct 10 23:30:06.972074 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1559/3213] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:06 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:07.001260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e7a79da3-7d63-4231-949e-ce648317869c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:07.002104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e7a79da3-7d63-4231-949e-ce648317869c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:07.015744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7a79da3-7d63-4231-949e-ce648317869c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:07.016233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7a79da3-7d63-4231-949e-ce648317869c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:07.016666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7a79da3-7d63-4231-949e-ce648317869c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:07.017406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7a79da3-7d63-4231-949e-ce648317869c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:07.017892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7a79da3-7d63-4231-949e-ce648317869c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:07.018312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7a79da3-7d63-4231-949e-ce648317869c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:07.384829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e7a79da3-7d63-4231-949e-ce648317869c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:07.400795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e7a79da3-7d63-4231-949e-ce648317869c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:07.404697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e7a79da3-7d63-4231-949e-ce648317869c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:07.407087 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e7a79da3-7d63-4231-949e-ce648317869c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 0.410674 Oct 10 23:30:07.409634 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1655/3214] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:06 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:30:07.709994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cb4e4b00-dbe6-4651-a8e5-93293326d4a4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:07.711240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cb4e4b00-dbe6-4651-a8e5-93293326d4a4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 65aed129-f63a-4afd-9cc3-ad6061e5b35b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:07.729170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb4e4b00-dbe6-4651-a8e5-93293326d4a4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:07.732464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb4e4b00-dbe6-4651-a8e5-93293326d4a4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:07.742945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb4e4b00-dbe6-4651-a8e5-93293326d4a4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:07.746370 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb4e4b00-dbe6-4651-a8e5-93293326d4a4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:07.746897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb4e4b00-dbe6-4651-a8e5-93293326d4a4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:07.755682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb4e4b00-dbe6-4651-a8e5-93293326d4a4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:07.833530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:30:07.834612 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-cb4e4b00-dbe6-4651-a8e5-93293326d4a4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] HTTP exception thrown: Instance 65aed129-f63a-4afd-9cc3-ad6061e5b35b could not be found. Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cb4e4b00-dbe6-4651-a8e5-93293326d4a4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Request method failure captured: Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b HTTP/1.1 Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKqJK3S3M2y3xprSZu9nbIarteybsMmlwBqzRadb_OvHrQS6zpz1qbhvGoRjPx1Bkq7rq6URwLI94Tf5sgLizi8MbWTsTS0dzR4a-9d6hn6BO9F5izkVX7qoGeFLYfTljzByP6rv99qdRHR7pF3ZU2UC3x7LIdHCYY6YUpc6lCdMgm4 Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a1c4489c308e462d89b97edcf6c21572", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: f891fce5072c448c97f96a9df58d981e Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 65aed129-f63a-4afd-9cc3-ad6061e5b35b could not be found. Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '65aed129-f63a-4afd-9cc3-ad6061e5b35b'} Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65aed129-f63a-4afd-9cc3-ad6061e5b35b could not be found. Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65aed129-f63a-4afd-9cc3-ad6061e5b35b could not be found. Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:07.836317 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:07.840871 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:07.840871 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:07.840871 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:07.840871 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:07.840871 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:30:07.840871 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:30:07.840871 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65aed129-f63a-4afd-9cc3-ad6061e5b35b could not be found. Oct 10 23:30:07.840871 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:07.842321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cb4e4b00-dbe6-4651-a8e5-93293326d4a4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Returning 404 to user: Instance 65aed129-f63a-4afd-9cc3-ad6061e5b35b could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:30:07.851580 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cb4e4b00-dbe6-4651-a8e5-93293326d4a4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b" status: 404 len: 111 microversion: 2.1 time: 0.140218 Oct 10 23:30:07.855508 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1560/3215] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:07 2022] GET /compute/v2.1/servers/65aed129-f63a-4afd-9cc3-ad6061e5b35b => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:30:07.861878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-848273f2-9f14-4083-832d-131fa1bb04ac tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '.version_select at 0x7f662b17c820>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:07.906128 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-848273f2-9f14-4083-832d-131fa1bb04ac tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] HTTP exception thrown: Image not found. Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-848273f2-9f14-4083-832d-131fa1bb04ac tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Request method failure captured: Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/images/1acd0ac6-ee9a-4f91-b858-e908d7defa34 HTTP/1.1 Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKqJK3S3M2y3xprSZu9nbIarteybsMmlwBqzRadb_OvHrQS6zpz1qbhvGoRjPx1Bkq7rq6URwLI94Tf5sgLizi8MbWTsTS0dzR4a-9d6hn6BO9F5izkVX7qoGeFLYfTljzByP6rv99qdRHR7pF3ZU2UC3x7LIdHCYY6YUpc6lCdMgm4 Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a1c4489c308e462d89b97edcf6c21572", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: f891fce5072c448c97f96a9df58d981e Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: exception: Image not found. Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '1acd0ac6-ee9a-4f91-b858-e908d7defa34'} Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1acd0ac6-ee9a-4f91-b858-e908d7defa34 to delete Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1acd0ac6-ee9a-4f91-b858-e908d7defa34 could not be found. Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:07.908456 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:07.913295 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:07.913295 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:07.913295 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:07.913295 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:30:07.913295 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:30:07.913295 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:30:07.913295 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:30:07.913295 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:30:07.913295 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:30:07.913295 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 23:30:07.913295 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 23:30:07.913295 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 23:30:07.913295 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:07.913295 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:07.913295 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:07.913295 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:07.913295 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:07.913295 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:07.913295 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:30:07.913295 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:30:07.913295 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 23:30:07.913295 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:07.916686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-848273f2-9f14-4083-832d-131fa1bb04ac tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Returning 404 to user: Image not found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:30:07.920026 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-848273f2-9f14-4083-832d-131fa1bb04ac tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "DELETE /compute/v2.1/images/1acd0ac6-ee9a-4f91-b858-e908d7defa34" status: 404 len: 62 microversion: 2.1 time: 0.061810 Oct 10 23:30:07.924687 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1656/3216] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:07 2022] DELETE /compute/v2.1/images/1acd0ac6-ee9a-4f91-b858-e908d7defa34 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:30:07.937277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1cecde96-9f09-44bb-b5d6-b366603c2da4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:07.938381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1cecde96-9f09-44bb-b5d6-b366603c2da4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 532ff31c-bdc2-44d4-8e95-328263ebc63f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:07.946935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1cecde96-9f09-44bb-b5d6-b366603c2da4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:07.949199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1cecde96-9f09-44bb-b5d6-b366603c2da4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:07.949961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1cecde96-9f09-44bb-b5d6-b366603c2da4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:07.950938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1cecde96-9f09-44bb-b5d6-b366603c2da4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:07.952306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1cecde96-9f09-44bb-b5d6-b366603c2da4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:07.953177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1cecde96-9f09-44bb-b5d6-b366603c2da4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:07.971301 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-1cecde96-9f09-44bb-b5d6-b366603c2da4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] HTTP exception thrown: Instance 532ff31c-bdc2-44d4-8e95-328263ebc63f could not be found. Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1cecde96-9f09-44bb-b5d6-b366603c2da4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Request method failure captured: Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f HTTP/1.1 Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKqJK3S3M2y3xprSZu9nbIarteybsMmlwBqzRadb_OvHrQS6zpz1qbhvGoRjPx1Bkq7rq6URwLI94Tf5sgLizi8MbWTsTS0dzR4a-9d6hn6BO9F5izkVX7qoGeFLYfTljzByP6rv99qdRHR7pF3ZU2UC3x7LIdHCYY6YUpc6lCdMgm4 Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a1c4489c308e462d89b97edcf6c21572", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: f891fce5072c448c97f96a9df58d981e Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 532ff31c-bdc2-44d4-8e95-328263ebc63f could not be found. Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '532ff31c-bdc2-44d4-8e95-328263ebc63f'} Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 532ff31c-bdc2-44d4-8e95-328263ebc63f could not be found. Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:30:07.973328 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:30:07.978246 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 532ff31c-bdc2-44d4-8e95-328263ebc63f could not be found. Oct 10 23:30:07.978246 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:07.978246 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:07.978246 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:07.978246 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:07.978246 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:07.978246 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:07.978246 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:30:07.978246 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:30:07.978246 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 532ff31c-bdc2-44d4-8e95-328263ebc63f could not be found. Oct 10 23:30:07.978246 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:07.981478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1cecde96-9f09-44bb-b5d6-b366603c2da4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Returning 404 to user: Instance 532ff31c-bdc2-44d4-8e95-328263ebc63f could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:30:07.982632 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1cecde96-9f09-44bb-b5d6-b366603c2da4 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f" status: 404 len: 111 microversion: 2.1 time: 0.056673 Oct 10 23:30:07.983794 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1561/3217] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:30:07 2022] DELETE /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:30:08.014860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cfc34259-daf3-482c-8f59-fccc5c85a183 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:08.019272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cfc34259-daf3-482c-8f59-fccc5c85a183 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 532ff31c-bdc2-44d4-8e95-328263ebc63f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:08.029229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-87bf42bb-b3aa-48ca-914b-56036ef5278e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:08.038742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-87bf42bb-b3aa-48ca-914b-56036ef5278e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:08.058698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfc34259-daf3-482c-8f59-fccc5c85a183 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:08.059860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfc34259-daf3-482c-8f59-fccc5c85a183 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:08.063903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfc34259-daf3-482c-8f59-fccc5c85a183 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:08.065073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfc34259-daf3-482c-8f59-fccc5c85a183 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:08.065888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfc34259-daf3-482c-8f59-fccc5c85a183 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:08.068077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfc34259-daf3-482c-8f59-fccc5c85a183 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:08.070764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87bf42bb-b3aa-48ca-914b-56036ef5278e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:08.071587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87bf42bb-b3aa-48ca-914b-56036ef5278e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:08.076333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87bf42bb-b3aa-48ca-914b-56036ef5278e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:08.079116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87bf42bb-b3aa-48ca-914b-56036ef5278e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:08.082139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87bf42bb-b3aa-48ca-914b-56036ef5278e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:08.082924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87bf42bb-b3aa-48ca-914b-56036ef5278e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:08.094590 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-cfc34259-daf3-482c-8f59-fccc5c85a183 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] HTTP exception thrown: Instance 532ff31c-bdc2-44d4-8e95-328263ebc63f could not be found. Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cfc34259-daf3-482c-8f59-fccc5c85a183 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Request method failure captured: Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f HTTP/1.1 Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKqJK3S3M2y3xprSZu9nbIarteybsMmlwBqzRadb_OvHrQS6zpz1qbhvGoRjPx1Bkq7rq6URwLI94Tf5sgLizi8MbWTsTS0dzR4a-9d6hn6BO9F5izkVX7qoGeFLYfTljzByP6rv99qdRHR7pF3ZU2UC3x7LIdHCYY6YUpc6lCdMgm4 Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a1c4489c308e462d89b97edcf6c21572", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: f891fce5072c448c97f96a9df58d981e Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 532ff31c-bdc2-44d4-8e95-328263ebc63f could not be found. Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '532ff31c-bdc2-44d4-8e95-328263ebc63f'} Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 532ff31c-bdc2-44d4-8e95-328263ebc63f could not be found. Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 532ff31c-bdc2-44d4-8e95-328263ebc63f could not be found. Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:08.097171 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:08.104077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:08.104077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:08.104077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:08.104077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:08.104077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:30:08.104077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:30:08.104077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 532ff31c-bdc2-44d4-8e95-328263ebc63f could not be found. Oct 10 23:30:08.104077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:08.106848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cfc34259-daf3-482c-8f59-fccc5c85a183 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Returning 404 to user: Instance 532ff31c-bdc2-44d4-8e95-328263ebc63f could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:30:08.109719 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cfc34259-daf3-482c-8f59-fccc5c85a183 tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f" status: 404 len: 111 microversion: 2.1 time: 0.117020 Oct 10 23:30:08.110920 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1657/3218] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:07 2022] GET /compute/v2.1/servers/532ff31c-bdc2-44d4-8e95-328263ebc63f => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:30:08.121664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-313491f0-0a07-4c82-92e4-a65e797b8b0a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '.version_select at 0x7f662af7e040>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:08.143855 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-313491f0-0a07-4c82-92e4-a65e797b8b0a tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-909384165" status: 202 len: 0 microversion: 2.1 time: 0.028676 Oct 10 23:30:08.147289 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1658/3219] 10.222.0.23 () {58 vars in 1218 bytes} [Mon Oct 10 23:30:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-909384165 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 23:30:08.254482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-87bf42bb-b3aa-48ca-914b-56036ef5278e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:08.269324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-87bf42bb-b3aa-48ca-914b-56036ef5278e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:08.271838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-87bf42bb-b3aa-48ca-914b-56036ef5278e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:08.273687 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-87bf42bb-b3aa-48ca-914b-56036ef5278e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1366 microversion: 2.47 time: 0.266255 Oct 10 23:30:08.274606 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1562/3220] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:08 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:08.438300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aef2bf92-0afa-416e-9b08-007e74ba08c1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:08.439133 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aef2bf92-0afa-416e-9b08-007e74ba08c1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:08.453013 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:30:08.460571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aef2bf92-0afa-416e-9b08-007e74ba08c1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:08.461414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aef2bf92-0afa-416e-9b08-007e74ba08c1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:08.462945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aef2bf92-0afa-416e-9b08-007e74ba08c1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:08.466491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aef2bf92-0afa-416e-9b08-007e74ba08c1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:08.467199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aef2bf92-0afa-416e-9b08-007e74ba08c1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:08.467795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aef2bf92-0afa-416e-9b08-007e74ba08c1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:08.755902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bac63995-e68e-4868-bf98-fef963965a22 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Action: 'create', calling method: .version_select at 0x7f662ae70ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1470721250"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:30:08.937913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aef2bf92-0afa-416e-9b08-007e74ba08c1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:08.973049 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aef2bf92-0afa-416e-9b08-007e74ba08c1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:08.978934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aef2bf92-0afa-416e-9b08-007e74ba08c1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:08.993692 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aef2bf92-0afa-416e-9b08-007e74ba08c1 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 0.553952 Oct 10 23:30:08.993692 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1563/3221] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:08 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:30:09.313692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-12fe9ca1-08a5-45bd-a62a-d5eea960238c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:09.323963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-12fe9ca1-08a5-45bd-a62a-d5eea960238c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:09.379707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12fe9ca1-08a5-45bd-a62a-d5eea960238c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:09.380515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12fe9ca1-08a5-45bd-a62a-d5eea960238c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:09.381222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12fe9ca1-08a5-45bd-a62a-d5eea960238c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:09.382396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12fe9ca1-08a5-45bd-a62a-d5eea960238c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:09.383165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12fe9ca1-08a5-45bd-a62a-d5eea960238c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:09.383889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12fe9ca1-08a5-45bd-a62a-d5eea960238c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:09.576756 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bac63995-e68e-4868-bf98-fef963965a22 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.175400 Oct 10 23:30:09.593738 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1659/3222] 10.222.0.23 () {60 vars in 1155 bytes} [Mon Oct 10 23:30:08 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1183 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 10 23:30:09.603969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dc608424-cef1-4a40-a313-8f909e2f9e4f tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f662af7e040>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:09.605639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-12fe9ca1-08a5-45bd-a62a-d5eea960238c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:09.634263 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-12fe9ca1-08a5-45bd-a62a-d5eea960238c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:09.637904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-12fe9ca1-08a5-45bd-a62a-d5eea960238c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:09.639499 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-12fe9ca1-08a5-45bd-a62a-d5eea960238c tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1366 microversion: 2.47 time: 0.336538 Oct 10 23:30:09.654054 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1564/3223] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:09 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:09.729501 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dc608424-cef1-4a40-a313-8f909e2f9e4f tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88" status: 200 len: 345 microversion: 2.1 time: 0.131750 Oct 10 23:30:09.737830 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1660/3224] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:30:09 2022] GET /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88 => generated 345 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:09.738523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0f72966d-5032-4cf3-98f6-8e0224a62bdd tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '.version_select at 0x7f6633a87670>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:09.764955 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-0f72966d-5032-4cf3-98f6-8e0224a62bdd tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] HTTP exception thrown: Image not found. Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0f72966d-5032-4cf3-98f6-8e0224a62bdd tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Request method failure captured: Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/images/9f8f21d3-a540-4cd1-bc03-f167244afbd4 HTTP/1.1 Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKqJK3S3M2y3xprSZu9nbIarteybsMmlwBqzRadb_OvHrQS6zpz1qbhvGoRjPx1Bkq7rq6URwLI94Tf5sgLizi8MbWTsTS0dzR4a-9d6hn6BO9F5izkVX7qoGeFLYfTljzByP6rv99qdRHR7pF3ZU2UC3x7LIdHCYY6YUpc6lCdMgm4 Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a1c4489c308e462d89b97edcf6c21572", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: f891fce5072c448c97f96a9df58d981e Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: exception: Image not found. Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '9f8f21d3-a540-4cd1-bc03-f167244afbd4'} Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9f8f21d3-a540-4cd1-bc03-f167244afbd4 to delete Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9f8f21d3-a540-4cd1-bc03-f167244afbd4 could not be found. Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:09.766755 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0f72966d-5032-4cf3-98f6-8e0224a62bdd tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Returning 404 to user: Image not found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0f72966d-5032-4cf3-98f6-8e0224a62bdd tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "DELETE /compute/v2.1/images/9f8f21d3-a540-4cd1-bc03-f167244afbd4" status: 404 len: 62 microversion: 2.1 time: 0.045166 Oct 10 23:30:09.771546 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1565/3225] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:09 2022] DELETE /compute/v2.1/images/9f8f21d3-a540-4cd1-bc03-f167244afbd4 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 10 23:30:09.777990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3ff1c171-dfb5-456c-baa8-aff190bfec8e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:09.778488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3ff1c171-dfb5-456c-baa8-aff190bfec8e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:09.784992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ff1c171-dfb5-456c-baa8-aff190bfec8e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:09.785546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ff1c171-dfb5-456c-baa8-aff190bfec8e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:09.785988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ff1c171-dfb5-456c-baa8-aff190bfec8e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:09.786684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ff1c171-dfb5-456c-baa8-aff190bfec8e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:09.787132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ff1c171-dfb5-456c-baa8-aff190bfec8e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:09.787553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ff1c171-dfb5-456c-baa8-aff190bfec8e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-3ff1c171-dfb5-456c-baa8-aff190bfec8e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] HTTP exception thrown: Instance 8a119bb1-ed77-4246-8201-57fae68e75e4 could not be found. Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3ff1c171-dfb5-456c-baa8-aff190bfec8e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Request method failure captured: Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 HTTP/1.1 Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKqJK3S3M2y3xprSZu9nbIarteybsMmlwBqzRadb_OvHrQS6zpz1qbhvGoRjPx1Bkq7rq6URwLI94Tf5sgLizi8MbWTsTS0dzR4a-9d6hn6BO9F5izkVX7qoGeFLYfTljzByP6rv99qdRHR7pF3ZU2UC3x7LIdHCYY6YUpc6lCdMgm4 Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a1c4489c308e462d89b97edcf6c21572", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: f891fce5072c448c97f96a9df58d981e Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 8a119bb1-ed77-4246-8201-57fae68e75e4 could not be found. Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '8a119bb1-ed77-4246-8201-57fae68e75e4'} Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a119bb1-ed77-4246-8201-57fae68e75e4 could not be found. Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:30:09.809986 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:30:09.815402 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:30:09.815402 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:30:09.815402 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:30:09.815402 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a119bb1-ed77-4246-8201-57fae68e75e4 could not be found. Oct 10 23:30:09.815402 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:09.815402 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:09.815402 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:09.815402 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:09.815402 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:09.815402 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:09.815402 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:30:09.815402 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:30:09.815402 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a119bb1-ed77-4246-8201-57fae68e75e4 could not be found. Oct 10 23:30:09.815402 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:09.815402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3ff1c171-dfb5-456c-baa8-aff190bfec8e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Returning 404 to user: Instance 8a119bb1-ed77-4246-8201-57fae68e75e4 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:30:09.815402 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3ff1c171-dfb5-456c-baa8-aff190bfec8e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 404 len: 111 microversion: 2.1 time: 0.036179 Oct 10 23:30:09.826466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3fc7a4e2-c1ef-49e0-a15c-f524c171a05e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:09.827079 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3fc7a4e2-c1ef-49e0-a15c-f524c171a05e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] [instance: 8a119bb1-ed77-4246-8201-57fae68e75e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:09.830931 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1661/3226] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:30:09 2022] DELETE /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:30:09.835039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fc7a4e2-c1ef-49e0-a15c-f524c171a05e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:09.835529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fc7a4e2-c1ef-49e0-a15c-f524c171a05e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:09.835964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fc7a4e2-c1ef-49e0-a15c-f524c171a05e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:09.836760 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fc7a4e2-c1ef-49e0-a15c-f524c171a05e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:09.837104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fc7a4e2-c1ef-49e0-a15c-f524c171a05e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:09.837557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fc7a4e2-c1ef-49e0-a15c-f524c171a05e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:09.863561 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-3fc7a4e2-c1ef-49e0-a15c-f524c171a05e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] HTTP exception thrown: Instance 8a119bb1-ed77-4246-8201-57fae68e75e4 could not be found. Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3fc7a4e2-c1ef-49e0-a15c-f524c171a05e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Request method failure captured: Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 HTTP/1.1 Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKqJK3S3M2y3xprSZu9nbIarteybsMmlwBqzRadb_OvHrQS6zpz1qbhvGoRjPx1Bkq7rq6URwLI94Tf5sgLizi8MbWTsTS0dzR4a-9d6hn6BO9F5izkVX7qoGeFLYfTljzByP6rv99qdRHR7pF3ZU2UC3x7LIdHCYY6YUpc6lCdMgm4 Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a1c4489c308e462d89b97edcf6c21572"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a1c4489c308e462d89b97edcf6c21572", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: a1c4489c308e462d89b97edcf6c21572 Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250 Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: f891fce5072c448c97f96a9df58d981e Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1776489250-project Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 8a119bb1-ed77-4246-8201-57fae68e75e4 could not be found. Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '8a119bb1-ed77-4246-8201-57fae68e75e4'} Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a119bb1-ed77-4246-8201-57fae68e75e4 could not be found. Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a119bb1-ed77-4246-8201-57fae68e75e4 could not be found. Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:09.865518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:09.871845 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:09.871845 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:09.871845 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:09.871845 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:09.871845 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:30:09.871845 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:30:09.871845 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a119bb1-ed77-4246-8201-57fae68e75e4 could not be found. Oct 10 23:30:09.871845 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:09.871845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3fc7a4e2-c1ef-49e0-a15c-f524c171a05e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] Returning 404 to user: Instance 8a119bb1-ed77-4246-8201-57fae68e75e4 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:30:09.873213 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3fc7a4e2-c1ef-49e0-a15c-f524c171a05e tempest-ImagesOneServerNegativeTestJSON-1776489250 tempest-ImagesOneServerNegativeTestJSON-1776489250-project] 10.222.0.23 "GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4" status: 404 len: 111 microversion: 2.1 time: 0.049216 Oct 10 23:30:09.873878 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1566/3227] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:09 2022] GET /compute/v2.1/servers/8a119bb1-ed77-4246-8201-57fae68e75e4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:30:10.018377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6f69d172-435d-47c2-a1da-3b79ecf16f24 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:10.019006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6f69d172-435d-47c2-a1da-3b79ecf16f24 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:10.046989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f69d172-435d-47c2-a1da-3b79ecf16f24 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:10.053799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f69d172-435d-47c2-a1da-3b79ecf16f24 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:10.054833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f69d172-435d-47c2-a1da-3b79ecf16f24 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:10.064425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f69d172-435d-47c2-a1da-3b79ecf16f24 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:10.066737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f69d172-435d-47c2-a1da-3b79ecf16f24 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:10.068926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f69d172-435d-47c2-a1da-3b79ecf16f24 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:10.299366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a019a070-29b7-47c9-b063-8c018dd3f04f tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:10.303807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a019a070-29b7-47c9-b063-8c018dd3f04f tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:10.308486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a019a070-29b7-47c9-b063-8c018dd3f04f tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:10.309135 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a019a070-29b7-47c9-b063-8c018dd3f04f tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:10.310122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a019a070-29b7-47c9-b063-8c018dd3f04f tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:10.310777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a019a070-29b7-47c9-b063-8c018dd3f04f tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:10.311362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a019a070-29b7-47c9-b063-8c018dd3f04f tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:10.373482 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a019a070-29b7-47c9-b063-8c018dd3f04f tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.349758 Oct 10 23:30:10.374493 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1567/3228] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:30:10 2022] GET /compute/v2.1/os-services => generated 944 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:30:10.387901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7f7a8f64-95f7-407e-a0d4-b20db81795ba tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:10.394423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f7a8f64-95f7-407e-a0d4-b20db81795ba tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:10.397785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f7a8f64-95f7-407e-a0d4-b20db81795ba tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:10.398445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f7a8f64-95f7-407e-a0d4-b20db81795ba tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:10.399412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f7a8f64-95f7-407e-a0d4-b20db81795ba tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:10.404416 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f7a8f64-95f7-407e-a0d4-b20db81795ba tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:10.405093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f7a8f64-95f7-407e-a0d4-b20db81795ba tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:10.490876 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7f7a8f64-95f7-407e-a0d4-b20db81795ba tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.107826 Oct 10 23:30:10.491514 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1568/3229] 10.222.0.23 () {58 vars in 1170 bytes} [Mon Oct 10 23:30:10 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:30:10.516450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-20b196a9-a2b0-4d39-89b7-5c4465f912d7 req-d564c697-3135-455c-a2fb-f15a20c8f4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "name": "network-vif-plugged", "status": "completed", "tag": "575d047b-0d89-4ae3-b746-a43054af851b"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:30:10.560292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-20b196a9-a2b0-4d39-89b7-5c4465f912d7 req-d564c697-3135-455c-a2fb-f15a20c8f4ba service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:10.560773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-20b196a9-a2b0-4d39-89b7-5c4465f912d7 req-d564c697-3135-455c-a2fb-f15a20c8f4ba service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:10.561200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-20b196a9-a2b0-4d39-89b7-5c4465f912d7 req-d564c697-3135-455c-a2fb-f15a20c8f4ba service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:10.590677 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-20b196a9-a2b0-4d39-89b7-5c4465f912d7 req-d564c697-3135-455c-a2fb-f15a20c8f4ba service nova] Creating event network-vif-plugged:575d047b-0d89-4ae3-b746-a43054af851b for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:30:10.603229 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-20b196a9-a2b0-4d39-89b7-5c4465f912d7 req-d564c697-3135-455c-a2fb-f15a20c8f4ba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108923 Oct 10 23:30:10.605879 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1569/3230] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:10.617570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-57d95002-6bb0-4dbe-a814-080a6a6129b4 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:10.628404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57d95002-6bb0-4dbe-a814-080a6a6129b4 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:10.629809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57d95002-6bb0-4dbe-a814-080a6a6129b4 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:10.631246 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57d95002-6bb0-4dbe-a814-080a6a6129b4 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:10.633104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57d95002-6bb0-4dbe-a814-080a6a6129b4 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:10.638903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57d95002-6bb0-4dbe-a814-080a6a6129b4 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:10.639566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57d95002-6bb0-4dbe-a814-080a6a6129b4 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:10.703581 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-57d95002-6bb0-4dbe-a814-080a6a6129b4 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.096434 Oct 10 23:30:10.732281 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1570/3231] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:30:10 2022] GET /compute/v2.1/os-services => generated 944 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:10.739469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c329f1ff-0d76-4538-9ba9-faa58da803e9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:10.740449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c329f1ff-0d76-4538-9ba9-faa58da803e9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:10.748125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c329f1ff-0d76-4538-9ba9-faa58da803e9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:10.748841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c329f1ff-0d76-4538-9ba9-faa58da803e9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:10.749803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c329f1ff-0d76-4538-9ba9-faa58da803e9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:10.750697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c329f1ff-0d76-4538-9ba9-faa58da803e9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:10.751309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c329f1ff-0d76-4538-9ba9-faa58da803e9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:10.751892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c329f1ff-0d76-4538-9ba9-faa58da803e9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:10.860307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6f69d172-435d-47c2-a1da-3b79ecf16f24 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:10.883249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6f69d172-435d-47c2-a1da-3b79ecf16f24 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:10.888337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6f69d172-435d-47c2-a1da-3b79ecf16f24 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:10.894650 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6f69d172-435d-47c2-a1da-3b79ecf16f24 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 0.882501 Oct 10 23:30:10.900469 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1662/3232] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:10 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:10.927286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-54234f85-5ecf-47cf-832e-1c678b9a3ca8 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:10.932173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54234f85-5ecf-47cf-832e-1c678b9a3ca8 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:10.942665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54234f85-5ecf-47cf-832e-1c678b9a3ca8 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:10.943572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54234f85-5ecf-47cf-832e-1c678b9a3ca8 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:10.944866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54234f85-5ecf-47cf-832e-1c678b9a3ca8 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:10.945603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54234f85-5ecf-47cf-832e-1c678b9a3ca8 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:10.946256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54234f85-5ecf-47cf-832e-1c678b9a3ca8 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:10.975503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c329f1ff-0d76-4538-9ba9-faa58da803e9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:10.987811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c329f1ff-0d76-4538-9ba9-faa58da803e9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:10.989599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c329f1ff-0d76-4538-9ba9-faa58da803e9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:10.991748 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c329f1ff-0d76-4538-9ba9-faa58da803e9 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1366 microversion: 2.47 time: 0.257244 Oct 10 23:30:10.993070 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1571/3233] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:10 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:11.003946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2f577187-663c-4396-a56f-61079abe1d67 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f662a5d0670>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:11.018977 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-54234f85-5ecf-47cf-832e-1c678b9a3ca8 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-860864-2&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.116936 Oct 10 23:30:11.020263 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1663/3234] 10.222.0.23 () {58 vars in 1194 bytes} [Mon Oct 10 23:30:10 2022] GET /compute/v2.1/os-services?host=n-d-860864-2&binary=xxx => generated 16 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:30:11.034691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-04352517-e7c1-460c-90b5-4e97ebb50151 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:11.038541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04352517-e7c1-460c-90b5-4e97ebb50151 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:11.043212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04352517-e7c1-460c-90b5-4e97ebb50151 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:11.044123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04352517-e7c1-460c-90b5-4e97ebb50151 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:11.045514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04352517-e7c1-460c-90b5-4e97ebb50151 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:11.048367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04352517-e7c1-460c-90b5-4e97ebb50151 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:11.051355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04352517-e7c1-460c-90b5-4e97ebb50151 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:11.164381 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-04352517-e7c1-460c-90b5-4e97ebb50151 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.134727 Oct 10 23:30:11.176762 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2f577187-663c-4396-a56f-61079abe1d67 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88" status: 200 len: 345 microversion: 2.1 time: 0.182326 Oct 10 23:30:11.177509 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1572/3235] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:30:10 2022] GET /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88 => generated 345 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:11.183867 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1664/3236] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:30:11 2022] GET /compute/v2.1/os-services => generated 944 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:11.199612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dccd8f05-68b9-4aff-864c-29dd8fc3ea29 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:11.208702 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dccd8f05-68b9-4aff-864c-29dd8fc3ea29 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:11.212127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dccd8f05-68b9-4aff-864c-29dd8fc3ea29 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:11.212878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dccd8f05-68b9-4aff-864c-29dd8fc3ea29 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:11.218951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dccd8f05-68b9-4aff-864c-29dd8fc3ea29 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:11.221568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dccd8f05-68b9-4aff-864c-29dd8fc3ea29 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:11.222376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dccd8f05-68b9-4aff-864c-29dd8fc3ea29 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:11.302430 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dccd8f05-68b9-4aff-864c-29dd8fc3ea29 tempest-ServicesAdminNegativeTestJSON-1039482800 tempest-ServicesAdminNegativeTestJSON-1039482800-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.108572 Oct 10 23:30:11.304342 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1573/3237] 10.222.0.23 () {58 vars in 1198 bytes} [Mon Oct 10 23:30:11 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:30:11.561250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6a50ffd9-0668-426d-82aa-31388f8abd9c tempest-ServicesAdminNegativeTestJSON-689281071 tempest-ServicesAdminNegativeTestJSON-689281071-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:11.565635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6a50ffd9-0668-426d-82aa-31388f8abd9c tempest-ServicesAdminNegativeTestJSON-689281071 tempest-ServicesAdminNegativeTestJSON-689281071-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '2cfd94a492e2477cbaea205d65f2ce95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67700050153848e6a383ffc053354e1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6a50ffd9-0668-426d-82aa-31388f8abd9c tempest-ServicesAdminNegativeTestJSON-689281071 tempest-ServicesAdminNegativeTestJSON-689281071-project] Request method failure captured: Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKsAmkOfBUnibnAGZZM96fMS7H8TMIBrMjis5H9gp6ywTLS1ws-Rf6z56y4UXnVV4VIoC7daYLJof-27TnIp9_2p8J_Tbn74j43GZhpg5y0ahOys7lGbN7-eqhnRiV3Vrkh5wU_mPUBWxpNm2HySS0Ea0of4gKeH4i2x26otNmZPdOo Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 67700050153848e6a383ffc053354e1e Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-689281071 Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/67700050153848e6a383ffc053354e1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/67700050153848e6a383ffc053354e1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/67700050153848e6a383ffc053354e1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_67700050153848e6a383ffc053354e1e", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-689281071 Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 67700050153848e6a383ffc053354e1e Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-689281071 Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServicesAdminNegativeTestJSON-689281071-project Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 2cfd94a492e2477cbaea205d65f2ce95 Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-689281071-project Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: action_args: {} Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 10 23:30:11.571748 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:11.576116 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:11.576116 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:11.576116 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:11.576116 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:11.576116 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:11.576116 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 23:30:11.576116 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 23:30:11.576116 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 10 23:30:11.576116 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:11.576116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6a50ffd9-0668-426d-82aa-31388f8abd9c tempest-ServicesAdminNegativeTestJSON-689281071 tempest-ServicesAdminNegativeTestJSON-689281071-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:30:11.576116 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6a50ffd9-0668-426d-82aa-31388f8abd9c tempest-ServicesAdminNegativeTestJSON-689281071 tempest-ServicesAdminNegativeTestJSON-689281071-project] 10.222.0.23 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.254644 Oct 10 23:30:11.584741 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1665/3238] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:30:11 2022] GET /compute/v2.1/os-services => generated 112 bytes in 263 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:30:11.924738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bdff5b66-d1d7-4e61-bc88-9d299477c747 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:11.925294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bdff5b66-d1d7-4e61-bc88-9d299477c747 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:11.939631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdff5b66-d1d7-4e61-bc88-9d299477c747 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:11.939883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdff5b66-d1d7-4e61-bc88-9d299477c747 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:11.940212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdff5b66-d1d7-4e61-bc88-9d299477c747 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:11.940907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdff5b66-d1d7-4e61-bc88-9d299477c747 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:11.941365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdff5b66-d1d7-4e61-bc88-9d299477c747 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:11.941936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdff5b66-d1d7-4e61-bc88-9d299477c747 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:12.023715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9c16a283-c167-4a4e-a987-05736c94cef8 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:12.025000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9c16a283-c167-4a4e-a987-05736c94cef8 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:12.038266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c16a283-c167-4a4e-a987-05736c94cef8 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:12.039773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c16a283-c167-4a4e-a987-05736c94cef8 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:12.041271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c16a283-c167-4a4e-a987-05736c94cef8 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:12.044360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c16a283-c167-4a4e-a987-05736c94cef8 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:12.053445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c16a283-c167-4a4e-a987-05736c94cef8 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:12.054944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c16a283-c167-4a4e-a987-05736c94cef8 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:12.122877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:30:12.291138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bdff5b66-d1d7-4e61-bc88-9d299477c747 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:12.312720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bdff5b66-d1d7-4e61-bc88-9d299477c747 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:12.327599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bdff5b66-d1d7-4e61-bc88-9d299477c747 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:12.328973 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bdff5b66-d1d7-4e61-bc88-9d299477c747 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 0.408320 Oct 10 23:30:12.349445 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1574/3239] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:11 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:12.363796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-86105578-9a8e-4c42-b10e-13bc731863ac tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f662a5d0790>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:12.488756 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-86105578-9a8e-4c42-b10e-13bc731863ac tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88" status: 200 len: 346 microversion: 2.1 time: 0.143108 Oct 10 23:30:12.490060 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1575/3240] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:30:12 2022] GET /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88 => generated 346 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:12.510633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-15b9fc4a-e9b3-47ba-bb4c-ceb2924819ac tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Action: 'create', calling method: .version_select at 0x7f662a7aeaf0>, body: {"snapshot": {"volume_id": "75836d0e-8f77-40c4-b9b4-e281f5584a88", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-260038535"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:30:12.706025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9c16a283-c167-4a4e-a987-05736c94cef8 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:12.716292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9c16a283-c167-4a4e-a987-05736c94cef8 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:12.718983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9c16a283-c167-4a4e-a987-05736c94cef8 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:12.721259 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9c16a283-c167-4a4e-a987-05736c94cef8 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1366 microversion: 2.47 time: 0.702493 Oct 10 23:30:12.723059 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1666/3241] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:12 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1366 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:30:12.737812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-bbac76cb-d8ec-42e7-af50-1964c2279ffa req-21f97d58-795a-42a2-91b4-b1053392aa98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "name": "network-vif-plugged", "status": "completed", "tag": "b8d599b8-79fd-4f70-91f1-14f3dcfc2d85"}, {"server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "name": "network-vif-plugged", "status": "completed", "tag": "240e1ee2-1172-4479-82d1-59dc4e88df9c"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:30:12.751616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-bbac76cb-d8ec-42e7-af50-1964c2279ffa req-21f97d58-795a-42a2-91b4-b1053392aa98 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:12.752382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-bbac76cb-d8ec-42e7-af50-1964c2279ffa req-21f97d58-795a-42a2-91b4-b1053392aa98 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:12.752991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-bbac76cb-d8ec-42e7-af50-1964c2279ffa req-21f97d58-795a-42a2-91b4-b1053392aa98 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:12.784370 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-bbac76cb-d8ec-42e7-af50-1964c2279ffa req-21f97d58-795a-42a2-91b4-b1053392aa98 service nova] Creating event network-vif-plugged:b8d599b8-79fd-4f70-91f1-14f3dcfc2d85 for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:30:12.789461 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-bbac76cb-d8ec-42e7-af50-1964c2279ffa req-21f97d58-795a-42a2-91b4-b1053392aa98 service nova] Creating event network-vif-plugged:240e1ee2-1172-4479-82d1-59dc4e88df9c for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:30:12.793942 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-15b9fc4a-e9b3-47ba-bb4c-ceb2924819ac tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.285984 Oct 10 23:30:12.795010 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1576/3242] 10.222.0.23 () {60 vars in 1162 bytes} [Mon Oct 10 23:30:12 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:12.814871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dc2f3a93-0820-4e1c-891a-e1fe24a1cb3f tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f6633a4faf0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:12.825613 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-bbac76cb-d8ec-42e7-af50-1964c2279ffa req-21f97d58-795a-42a2-91b4-b1053392aa98 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.100915 Oct 10 23:30:12.833351 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1667/3243] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:12.877204 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dc2f3a93-0820-4e1c-891a-e1fe24a1cb3f tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/a8295aca-63ec-4d96-a0c3-1d480f9d017d" status: 200 len: 286 microversion: 2.1 time: 0.072465 Oct 10 23:30:12.877983 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1577/3244] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 10 23:30:12 2022] GET /compute/v2.1/os-snapshots/a8295aca-63ec-4d96-a0c3-1d480f9d017d => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:30:12.889938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2a4f51ff-80aa-459e-b5ab-f2d015d7d30a tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f662b482c10>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:13.003743 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2a4f51ff-80aa-459e-b5ab-f2d015d7d30a tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.118649 Oct 10 23:30:13.004604 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1668/3245] 10.222.0.23 () {58 vars in 1140 bytes} [Mon Oct 10 23:30:12 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:13.024957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4a128730-74da-420e-a200-caed4519047d tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f662a7aed30>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:13.080060 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4a128730-74da-420e-a200-caed4519047d tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/a8295aca-63ec-4d96-a0c3-1d480f9d017d" status: 200 len: 286 microversion: 2.1 time: 0.066757 Oct 10 23:30:13.080869 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1578/3246] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 10 23:30:13 2022] GET /compute/v2.1/os-snapshots/a8295aca-63ec-4d96-a0c3-1d480f9d017d => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:13.360997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b0c22517-9727-42ae-8c9c-730350f6cf04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:13.363875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b0c22517-9727-42ae-8c9c-730350f6cf04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:13.397726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0c22517-9727-42ae-8c9c-730350f6cf04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:13.402240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0c22517-9727-42ae-8c9c-730350f6cf04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:13.405865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0c22517-9727-42ae-8c9c-730350f6cf04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:13.406981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0c22517-9727-42ae-8c9c-730350f6cf04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:13.409169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0c22517-9727-42ae-8c9c-730350f6cf04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:13.409772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0c22517-9727-42ae-8c9c-730350f6cf04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:13.768309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aa27533f-3c74-4566-bfb9-ccf30b2e0195 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:13.770159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aa27533f-3c74-4566-bfb9-ccf30b2e0195 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:13.787618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa27533f-3c74-4566-bfb9-ccf30b2e0195 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:13.789565 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa27533f-3c74-4566-bfb9-ccf30b2e0195 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:13.790572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa27533f-3c74-4566-bfb9-ccf30b2e0195 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:13.791556 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa27533f-3c74-4566-bfb9-ccf30b2e0195 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:13.793128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa27533f-3c74-4566-bfb9-ccf30b2e0195 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:13.793791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa27533f-3c74-4566-bfb9-ccf30b2e0195 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:13.934808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aa27533f-3c74-4566-bfb9-ccf30b2e0195 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:13.965282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aa27533f-3c74-4566-bfb9-ccf30b2e0195 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:13.974723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aa27533f-3c74-4566-bfb9-ccf30b2e0195 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:13.981437 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aa27533f-3c74-4566-bfb9-ccf30b2e0195 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1366 microversion: 2.47 time: 0.218211 Oct 10 23:30:13.987066 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1579/3247] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:13 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:14.094198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c1534975-b0df-46e9-8b15-de1e942f1d95 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f6633a4f4c0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:14.102353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b0c22517-9727-42ae-8c9c-730350f6cf04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:14.152430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b0c22517-9727-42ae-8c9c-730350f6cf04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:14.160037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b0c22517-9727-42ae-8c9c-730350f6cf04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:14.164882 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b0c22517-9727-42ae-8c9c-730350f6cf04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 0.804673 Oct 10 23:30:14.167392 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1669/3248] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:13 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:14.201634 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c1534975-b0df-46e9-8b15-de1e942f1d95 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/a8295aca-63ec-4d96-a0c3-1d480f9d017d" status: 200 len: 286 microversion: 2.1 time: 0.113181 Oct 10 23:30:14.207224 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1580/3249] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 10 23:30:14 2022] GET /compute/v2.1/os-snapshots/a8295aca-63ec-4d96-a0c3-1d480f9d017d => generated 286 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:15.019112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6e5f9238-ec8f-4b8d-aead-74dab88d04b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:15.020923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6e5f9238-ec8f-4b8d-aead-74dab88d04b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:15.036479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e5f9238-ec8f-4b8d-aead-74dab88d04b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:15.037885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e5f9238-ec8f-4b8d-aead-74dab88d04b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:15.038706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e5f9238-ec8f-4b8d-aead-74dab88d04b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:15.041477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e5f9238-ec8f-4b8d-aead-74dab88d04b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:15.042335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e5f9238-ec8f-4b8d-aead-74dab88d04b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:15.044053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e5f9238-ec8f-4b8d-aead-74dab88d04b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:15.222419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3a70ea6a-c5dd-4baa-bddf-181f568ad54a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:15.223836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3a70ea6a-c5dd-4baa-bddf-181f568ad54a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:15.243583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a70ea6a-c5dd-4baa-bddf-181f568ad54a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:15.250392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a70ea6a-c5dd-4baa-bddf-181f568ad54a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:15.251220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a70ea6a-c5dd-4baa-bddf-181f568ad54a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:15.253336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a70ea6a-c5dd-4baa-bddf-181f568ad54a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:15.254154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a70ea6a-c5dd-4baa-bddf-181f568ad54a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:15.255076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3a70ea6a-c5dd-4baa-bddf-181f568ad54a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:15.344499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:30:15.516147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6e5f9238-ec8f-4b8d-aead-74dab88d04b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:15.535595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6e5f9238-ec8f-4b8d-aead-74dab88d04b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:15.552895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6e5f9238-ec8f-4b8d-aead-74dab88d04b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:15.555478 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6e5f9238-ec8f-4b8d-aead-74dab88d04b5 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1366 microversion: 2.47 time: 0.547143 Oct 10 23:30:15.562733 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1670/3250] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:15 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1366 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:15.597836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d500ebb3-85c8-48a9-aae3-0b1d7a6fd111 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f6633a95ee0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:15.745960 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d500ebb3-85c8-48a9-aae3-0b1d7a6fd111 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/a8295aca-63ec-4d96-a0c3-1d480f9d017d" status: 200 len: 286 microversion: 2.1 time: 0.178595 Oct 10 23:30:15.747554 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1671/3251] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 10 23:30:15 2022] GET /compute/v2.1/os-snapshots/a8295aca-63ec-4d96-a0c3-1d480f9d017d => generated 286 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:15.755770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-0c804fb3-69bc-4eb1-9c16-1c2d72ec2927 req-8a613c7a-32ad-45b4-bdeb-a3ea8a11ffc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "name": "network-vif-plugged", "status": "completed", "tag": "614bc975-55cc-4a02-8208-a141e064bf06"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:30:15.788515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0c804fb3-69bc-4eb1-9c16-1c2d72ec2927 req-8a613c7a-32ad-45b4-bdeb-a3ea8a11ffc2 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:15.789341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0c804fb3-69bc-4eb1-9c16-1c2d72ec2927 req-8a613c7a-32ad-45b4-bdeb-a3ea8a11ffc2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:15.790019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0c804fb3-69bc-4eb1-9c16-1c2d72ec2927 req-8a613c7a-32ad-45b4-bdeb-a3ea8a11ffc2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:15.851256 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-0c804fb3-69bc-4eb1-9c16-1c2d72ec2927 req-8a613c7a-32ad-45b4-bdeb-a3ea8a11ffc2 service nova] Creating event network-vif-plugged:614bc975-55cc-4a02-8208-a141e064bf06 for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:30:15.874787 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-0c804fb3-69bc-4eb1-9c16-1c2d72ec2927 req-8a613c7a-32ad-45b4-bdeb-a3ea8a11ffc2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121323 Oct 10 23:30:15.880224 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1672/3252] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:16.163299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3a70ea6a-c5dd-4baa-bddf-181f568ad54a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:16.181550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3a70ea6a-c5dd-4baa-bddf-181f568ad54a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:16.185500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3a70ea6a-c5dd-4baa-bddf-181f568ad54a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:16.190581 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3a70ea6a-c5dd-4baa-bddf-181f568ad54a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 0.998362 Oct 10 23:30:16.195325 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1581/3253] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:15 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:16.600519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4032fe81-922a-4f4b-8bee-43f75c0c4e3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:16.604639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4032fe81-922a-4f4b-8bee-43f75c0c4e3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:16.635405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4032fe81-922a-4f4b-8bee-43f75c0c4e3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:16.638695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4032fe81-922a-4f4b-8bee-43f75c0c4e3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:16.641128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4032fe81-922a-4f4b-8bee-43f75c0c4e3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:16.643756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4032fe81-922a-4f4b-8bee-43f75c0c4e3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:16.644259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4032fe81-922a-4f4b-8bee-43f75c0c4e3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:16.648696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4032fe81-922a-4f4b-8bee-43f75c0c4e3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:16.763666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3ba7310d-a552-4192-96c6-8f6e5d27e1d0 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f6633acdc10>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:16.841842 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3ba7310d-a552-4192-96c6-8f6e5d27e1d0 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/a8295aca-63ec-4d96-a0c3-1d480f9d017d" status: 200 len: 287 microversion: 2.1 time: 0.083374 Oct 10 23:30:16.849153 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1582/3254] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 10 23:30:16 2022] GET /compute/v2.1/os-snapshots/a8295aca-63ec-4d96-a0c3-1d480f9d017d => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:16.856390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d622cd4d-d2f5-422f-8501-d0cceb5dbd68 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f662a651160>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:17.090900 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d622cd4d-d2f5-422f-8501-d0cceb5dbd68 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/a8295aca-63ec-4d96-a0c3-1d480f9d017d" status: 202 len: 0 microversion: 2.1 time: 0.240250 Oct 10 23:30:17.095151 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1583/3255] 10.222.0.23 () {58 vars in 1254 bytes} [Mon Oct 10 23:30:16 2022] DELETE /compute/v2.1/os-snapshots/a8295aca-63ec-4d96-a0c3-1d480f9d017d => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:30:17.100852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e8814bce-f56c-4aad-bd59-6dc224ed632a tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f662a5d0af0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:17.186014 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e8814bce-f56c-4aad-bd59-6dc224ed632a tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/a8295aca-63ec-4d96-a0c3-1d480f9d017d" status: 200 len: 286 microversion: 2.1 time: 0.089334 Oct 10 23:30:17.200801 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1584/3256] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 10 23:30:17 2022] GET /compute/v2.1/os-snapshots/a8295aca-63ec-4d96-a0c3-1d480f9d017d => generated 286 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:17.232512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7bbbedef-8d11-4b09-9e06-3f0b06039fa7 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:17.233419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7bbbedef-8d11-4b09-9e06-3f0b06039fa7 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:17.246694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bbbedef-8d11-4b09-9e06-3f0b06039fa7 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:17.250466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bbbedef-8d11-4b09-9e06-3f0b06039fa7 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:17.251991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bbbedef-8d11-4b09-9e06-3f0b06039fa7 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:17.256230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bbbedef-8d11-4b09-9e06-3f0b06039fa7 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:17.259500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bbbedef-8d11-4b09-9e06-3f0b06039fa7 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:17.261136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bbbedef-8d11-4b09-9e06-3f0b06039fa7 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:17.383497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4032fe81-922a-4f4b-8bee-43f75c0c4e3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:17.434267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4032fe81-922a-4f4b-8bee-43f75c0c4e3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:17.460055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4032fe81-922a-4f4b-8bee-43f75c0c4e3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:17.473947 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4032fe81-922a-4f4b-8bee-43f75c0c4e3e tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1366 microversion: 2.47 time: 0.884071 Oct 10 23:30:17.495600 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1673/3257] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:16 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1366 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:17.829448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7bbbedef-8d11-4b09-9e06-3f0b06039fa7 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:17.868258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7bbbedef-8d11-4b09-9e06-3f0b06039fa7 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:17.873357 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7bbbedef-8d11-4b09-9e06-3f0b06039fa7 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:17.875798 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7bbbedef-8d11-4b09-9e06-3f0b06039fa7 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 0.648108 Oct 10 23:30:17.878340 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1585/3258] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:17 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:30:17.970721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-c6da6bf5-59a6-4a5f-838f-3038104f0647 req-eafc1313-8134-4c88-8a71-b2606b2fea69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "name": "network-vif-plugged", "status": "completed", "tag": "779175ee-abe1-40ae-bb85-14125427b898"}, {"server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "name": "network-vif-plugged", "status": "completed", "tag": "acfd32f6-5102-480d-b6cb-2c17b29cf9fc"}, {"server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "name": "network-vif-plugged", "status": "completed", "tag": "7e9ff285-00b1-425e-abd8-7ec7fce5505e"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:30:18.012764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c6da6bf5-59a6-4a5f-838f-3038104f0647 req-eafc1313-8134-4c88-8a71-b2606b2fea69 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:18.019627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c6da6bf5-59a6-4a5f-838f-3038104f0647 req-eafc1313-8134-4c88-8a71-b2606b2fea69 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:18.020300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c6da6bf5-59a6-4a5f-838f-3038104f0647 req-eafc1313-8134-4c88-8a71-b2606b2fea69 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:18.053911 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-c6da6bf5-59a6-4a5f-838f-3038104f0647 req-eafc1313-8134-4c88-8a71-b2606b2fea69 service nova] Creating event network-vif-plugged:779175ee-abe1-40ae-bb85-14125427b898 for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:30:18.056744 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-c6da6bf5-59a6-4a5f-838f-3038104f0647 req-eafc1313-8134-4c88-8a71-b2606b2fea69 service nova] Creating event network-vif-plugged:acfd32f6-5102-480d-b6cb-2c17b29cf9fc for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:30:18.059015 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-c6da6bf5-59a6-4a5f-838f-3038104f0647 req-eafc1313-8134-4c88-8a71-b2606b2fea69 service nova] Creating event network-vif-plugged:7e9ff285-00b1-425e-abd8-7ec7fce5505e for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:30:18.071664 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-c6da6bf5-59a6-4a5f-838f-3038104f0647 req-eafc1313-8134-4c88-8a71-b2606b2fea69 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.105569 Oct 10 23:30:18.074651 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1674/3259] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:18.200783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-78d306a8-65fa-4a31-b2df-8c1b86569f21 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f6633a4f700>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:18.270023 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-78d306a8-65fa-4a31-b2df-8c1b86569f21 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/a8295aca-63ec-4d96-a0c3-1d480f9d017d" status: 200 len: 286 microversion: 2.1 time: 0.074265 Oct 10 23:30:18.270612 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1586/3260] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 10 23:30:18 2022] GET /compute/v2.1/os-snapshots/a8295aca-63ec-4d96-a0c3-1d480f9d017d => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:30:18.511340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-df93ddbc-c614-4d2d-b5ee-ef9706cc5880 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:18.512177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-df93ddbc-c614-4d2d-b5ee-ef9706cc5880 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:18.534470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:30:18.536687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df93ddbc-c614-4d2d-b5ee-ef9706cc5880 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:18.543440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df93ddbc-c614-4d2d-b5ee-ef9706cc5880 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:18.543911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df93ddbc-c614-4d2d-b5ee-ef9706cc5880 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:18.544936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df93ddbc-c614-4d2d-b5ee-ef9706cc5880 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:18.548938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df93ddbc-c614-4d2d-b5ee-ef9706cc5880 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:18.550020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df93ddbc-c614-4d2d-b5ee-ef9706cc5880 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:18.687869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-df93ddbc-c614-4d2d-b5ee-ef9706cc5880 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:18.728831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-df93ddbc-c614-4d2d-b5ee-ef9706cc5880 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:18.735781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-df93ddbc-c614-4d2d-b5ee-ef9706cc5880 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:18.745023 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-df93ddbc-c614-4d2d-b5ee-ef9706cc5880 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1366 microversion: 2.47 time: 0.234906 Oct 10 23:30:18.747160 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1675/3261] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:18 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:18.918717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dc68bf64-56b4-468f-8490-5a2f62b62a44 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:18.920308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dc68bf64-56b4-468f-8490-5a2f62b62a44 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:18.934391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc68bf64-56b4-468f-8490-5a2f62b62a44 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:18.937425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc68bf64-56b4-468f-8490-5a2f62b62a44 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:18.940290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc68bf64-56b4-468f-8490-5a2f62b62a44 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:18.941634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc68bf64-56b4-468f-8490-5a2f62b62a44 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:18.943906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc68bf64-56b4-468f-8490-5a2f62b62a44 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:18.946376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc68bf64-56b4-468f-8490-5a2f62b62a44 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:19.299573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7605e16e-4564-45e5-bb50-24b34c50b517 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f662ae70280>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:19.365600 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7605e16e-4564-45e5-bb50-24b34c50b517 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/a8295aca-63ec-4d96-a0c3-1d480f9d017d" status: 200 len: 286 microversion: 2.1 time: 0.073752 Oct 10 23:30:19.367700 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1676/3262] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 10 23:30:19 2022] GET /compute/v2.1/os-snapshots/a8295aca-63ec-4d96-a0c3-1d480f9d017d => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:19.781158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9fa87515-a0f1-4e25-be10-4ed53d0de66f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:19.782274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9fa87515-a0f1-4e25-be10-4ed53d0de66f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:19.794184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fa87515-a0f1-4e25-be10-4ed53d0de66f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:19.797966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fa87515-a0f1-4e25-be10-4ed53d0de66f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:19.803180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fa87515-a0f1-4e25-be10-4ed53d0de66f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:19.854884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fa87515-a0f1-4e25-be10-4ed53d0de66f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:19.858761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fa87515-a0f1-4e25-be10-4ed53d0de66f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:19.864340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fa87515-a0f1-4e25-be10-4ed53d0de66f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:19.950800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dc68bf64-56b4-468f-8490-5a2f62b62a44 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:19.988528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dc68bf64-56b4-468f-8490-5a2f62b62a44 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:19.993449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dc68bf64-56b4-468f-8490-5a2f62b62a44 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:19.999905 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dc68bf64-56b4-468f-8490-5a2f62b62a44 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1877 microversion: 2.32 time: 1.087709 Oct 10 23:30:20.002719 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1587/3263] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:18 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1877 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:20.251031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9fa87515-a0f1-4e25-be10-4ed53d0de66f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:20.312436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9fa87515-a0f1-4e25-be10-4ed53d0de66f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:20.317073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9fa87515-a0f1-4e25-be10-4ed53d0de66f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:20.326304 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9fa87515-a0f1-4e25-be10-4ed53d0de66f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1372 microversion: 2.47 time: 0.549793 Oct 10 23:30:20.338249 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1677/3264] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:19 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1372 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:20.383111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dd14ab56-f2f9-49b0-9646-66972f3b63ba tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f6633a875e0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:20.551988 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dd14ab56-f2f9-49b0-9646-66972f3b63ba tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/a8295aca-63ec-4d96-a0c3-1d480f9d017d" status: 200 len: 286 microversion: 2.1 time: 0.174143 Oct 10 23:30:20.552578 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1588/3265] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 10 23:30:20 2022] GET /compute/v2.1/os-snapshots/a8295aca-63ec-4d96-a0c3-1d480f9d017d => generated 286 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:21.035129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-54584742-b106-4174-9817-0b91b0eb0cc8 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:21.036158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-54584742-b106-4174-9817-0b91b0eb0cc8 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:21.070325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:30:21.072212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54584742-b106-4174-9817-0b91b0eb0cc8 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:21.072755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54584742-b106-4174-9817-0b91b0eb0cc8 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:21.073348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54584742-b106-4174-9817-0b91b0eb0cc8 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:21.074340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54584742-b106-4174-9817-0b91b0eb0cc8 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:21.074803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54584742-b106-4174-9817-0b91b0eb0cc8 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:21.075234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54584742-b106-4174-9817-0b91b0eb0cc8 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:21.374704 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=8 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:30:21.379663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3af04122-b433-4509-8017-82499e7b5619 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:21.380493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3af04122-b433-4509-8017-82499e7b5619 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:21.406714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3af04122-b433-4509-8017-82499e7b5619 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:21.407293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3af04122-b433-4509-8017-82499e7b5619 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:21.407702 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3af04122-b433-4509-8017-82499e7b5619 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:21.408494 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3af04122-b433-4509-8017-82499e7b5619 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:21.408964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3af04122-b433-4509-8017-82499e7b5619 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:21.409732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3af04122-b433-4509-8017-82499e7b5619 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:21.590716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-54584742-b106-4174-9817-0b91b0eb0cc8 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:21.605077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-54584742-b106-4174-9817-0b91b0eb0cc8 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:21.616040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-54584742-b106-4174-9817-0b91b0eb0cc8 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:21.617585 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-54584742-b106-4174-9817-0b91b0eb0cc8 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 2830 microversion: 2.32 time: 0.589834 Oct 10 23:30:21.632259 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1678/3266] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:21 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 2830 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:21.670860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0b4c49f6-ab96-4c7e-8462-8d30c0671aec tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f662b17caf0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:21.748947 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-0b4c49f6-ab96-4c7e-8462-8d30c0671aec tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] HTTP exception thrown: Snapshot a8295aca-63ec-4d96-a0c3-1d480f9d017d could not be found. Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0b4c49f6-ab96-4c7e-8462-8d30c0671aec tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Request method failure captured: Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-snapshots/a8295aca-63ec-4d96-a0c3-1d480f9d017d HTTP/1.1 Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKsAqt5qDzWRCIrx1ssZbZl0FoDPYqO6F77uWjcxW91if_ZJvu9JvxzXVaxCV4zNK5S6Zb_lmWM3hgEmHk5tqv1cgC6D4zYG5KzCHW1Wd0Me7q3nwMLT3J27mt_HBt3knVYx2WdO4Tswy7PbD2Qh-DZ9Yvix0xUmuHxod5TiY-fseSE Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: ba51f340ad894c0a91f9b4e581b8d529 Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-544703407 Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ba51f340ad894c0a91f9b4e581b8d529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ba51f340ad894c0a91f9b4e581b8d529"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ba51f340ad894c0a91f9b4e581b8d529"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ba51f340ad894c0a91f9b4e581b8d529", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-VolumesSnapshotsTestJSON-544703407 Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: ba51f340ad894c0a91f9b4e581b8d529 Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-544703407 Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-VolumesSnapshotsTestJSON-544703407-project Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 408fa3cc8c3f4ab8884b8f3b819fb12d Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-VolumesSnapshotsTestJSON-544703407-project Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: exception: Snapshot a8295aca-63ec-4d96-a0c3-1d480f9d017d could not be found. Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'a8295aca-63ec-4d96-a0c3-1d480f9d017d'} Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a8295aca-63ec-4d96-a0c3-1d480f9d017d could not be found. (HTTP 404) (Request-ID: req-6b5ba1f4-7d14-4c05-8139-a4e0a3b41f55) Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 23:30:21.762535 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a8295aca-63ec-4d96-a0c3-1d480f9d017d could not be found. Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a8295aca-63ec-4d96-a0c3-1d480f9d017d could not be found. Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a8295aca-63ec-4d96-a0c3-1d480f9d017d could not be found. Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0b4c49f6-ab96-4c7e-8462-8d30c0671aec tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Returning 404 to user: Snapshot a8295aca-63ec-4d96-a0c3-1d480f9d017d could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0b4c49f6-ab96-4c7e-8462-8d30c0671aec tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/a8295aca-63ec-4d96-a0c3-1d480f9d017d" status: 404 len: 111 microversion: 2.1 time: 0.116377 Oct 10 23:30:21.766705 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1679/3267] 10.222.0.23 () {58 vars in 1251 bytes} [Mon Oct 10 23:30:21 2022] GET /compute/v2.1/os-snapshots/a8295aca-63ec-4d96-a0c3-1d480f9d017d => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:30:21.773295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3af04122-b433-4509-8017-82499e7b5619 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:21.775522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-70d2e9d1-47fb-4e84-a2e7-9e369dc52de3 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:21.782696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-70d2e9d1-47fb-4e84-a2e7-9e369dc52de3 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:21.790349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3af04122-b433-4509-8017-82499e7b5619 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:21.798345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3af04122-b433-4509-8017-82499e7b5619 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:21.799994 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3af04122-b433-4509-8017-82499e7b5619 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1372 microversion: 2.47 time: 0.427504 Oct 10 23:30:21.802466 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1589/3268] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:21 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1372 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:21.820766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ade83450-3d8e-455c-b9ca-32aefc0bbcb5 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f6633a4fc10>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:21.826526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70d2e9d1-47fb-4e84-a2e7-9e369dc52de3 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:21.829185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70d2e9d1-47fb-4e84-a2e7-9e369dc52de3 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:21.831210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70d2e9d1-47fb-4e84-a2e7-9e369dc52de3 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:21.833344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70d2e9d1-47fb-4e84-a2e7-9e369dc52de3 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:21.833864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70d2e9d1-47fb-4e84-a2e7-9e369dc52de3 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:21.834303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70d2e9d1-47fb-4e84-a2e7-9e369dc52de3 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:22.036700 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ade83450-3d8e-455c-b9ca-32aefc0bbcb5 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88" status: 202 len: 0 microversion: 2.1 time: 0.231354 Oct 10 23:30:22.037641 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1590/3269] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 10 23:30:21 2022] DELETE /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:30:22.048849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6ec8ea1c-bb8d-4d62-af2e-81782b9bc21b tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f662a5deb80>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:22.184037 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-70d2e9d1-47fb-4e84-a2e7-9e369dc52de3 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea/os-interface" status: 200 len: 1833 microversion: 2.32 time: 0.418769 Oct 10 23:30:22.184655 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1680/3270] 10.222.0.23 () {60 vars in 1316 bytes} [Mon Oct 10 23:30:21 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea/os-interface => generated 1833 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:22.190900 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6ec8ea1c-bb8d-4d62-af2e-81782b9bc21b tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88" status: 200 len: 345 microversion: 2.1 time: 0.148633 Oct 10 23:30:22.191972 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1591/3271] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:30:22 2022] GET /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88 => generated 345 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:22.839948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4bad2ee2-74f7-4b99-aaba-62d4e2c35940 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:22.840548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4bad2ee2-74f7-4b99-aaba-62d4e2c35940 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:22.852524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4bad2ee2-74f7-4b99-aaba-62d4e2c35940 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:22.861189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4bad2ee2-74f7-4b99-aaba-62d4e2c35940 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:22.870788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4bad2ee2-74f7-4b99-aaba-62d4e2c35940 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:22.872289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4bad2ee2-74f7-4b99-aaba-62d4e2c35940 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:22.872803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4bad2ee2-74f7-4b99-aaba-62d4e2c35940 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:22.875590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4bad2ee2-74f7-4b99-aaba-62d4e2c35940 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:23.211498 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f1cf80cb-0ae8-48c0-a301-c02afa451023 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f663029d0d0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:23.252207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4bad2ee2-74f7-4b99-aaba-62d4e2c35940 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:23.266953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4bad2ee2-74f7-4b99-aaba-62d4e2c35940 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:23.268468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4bad2ee2-74f7-4b99-aaba-62d4e2c35940 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:23.269769 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4bad2ee2-74f7-4b99-aaba-62d4e2c35940 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1357 microversion: 2.47 time: 0.434845 Oct 10 23:30:23.273182 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1681/3272] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:22 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1357 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:23.304697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cdda8a92-5655-4c9d-a93b-7e35c777a126 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-363693010", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:30:23.394674 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f1cf80cb-0ae8-48c0-a301-c02afa451023 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88" status: 200 len: 345 microversion: 2.1 time: 0.174152 Oct 10 23:30:23.404987 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1592/3273] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:30:23 2022] GET /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88 => generated 345 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:23.410372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8fd43d59-e559-4659-a3f5-d7752046345a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:23.416934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8fd43d59-e559-4659-a3f5-d7752046345a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:23.424065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-cdda8a92-5655-4c9d-a93b-7e35c777a126 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] validate_networks() for None {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:30:23.436926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8fd43d59-e559-4659-a3f5-d7752046345a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Searching by: {'deleted': False, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:30:23.451599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fd43d59-e559-4659-a3f5-d7752046345a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:23.452230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fd43d59-e559-4659-a3f5-d7752046345a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:23.458278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fd43d59-e559-4659-a3f5-d7752046345a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:23.459400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fd43d59-e559-4659-a3f5-d7752046345a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:23.460422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fd43d59-e559-4659-a3f5-d7752046345a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:23.461198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fd43d59-e559-4659-a3f5-d7752046345a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:23.693785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.multi_cell_list [None req-8fd43d59-e559-4659-a3f5-d7752046345a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:30:23.866770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8fd43d59-e559-4659-a3f5-d7752046345a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:23.906482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fd43d59-e559-4659-a3f5-d7752046345a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:23.907166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fd43d59-e559-4659-a3f5-d7752046345a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:23.907683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fd43d59-e559-4659-a3f5-d7752046345a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:23.938722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8fd43d59-e559-4659-a3f5-d7752046345a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:23.943188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8fd43d59-e559-4659-a3f5-d7752046345a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:24.083365 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8fd43d59-e559-4659-a3f5-d7752046345a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.676906 Oct 10 23:30:24.085043 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1593/3274] 10.222.0.23 () {60 vars in 1187 bytes} [Mon Oct 10 23:30:23 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:24.128318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6ebc44b9-0e15-4aae-a2c5-b7c7e9cb113a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:24.128828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6ebc44b9-0e15-4aae-a2c5-b7c7e9cb113a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:24.147604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ebc44b9-0e15-4aae-a2c5-b7c7e9cb113a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:24.150924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ebc44b9-0e15-4aae-a2c5-b7c7e9cb113a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:24.151615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ebc44b9-0e15-4aae-a2c5-b7c7e9cb113a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:24.152387 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ebc44b9-0e15-4aae-a2c5-b7c7e9cb113a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:24.152871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ebc44b9-0e15-4aae-a2c5-b7c7e9cb113a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:24.153310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ebc44b9-0e15-4aae-a2c5-b7c7e9cb113a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:24.244295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6ebc44b9-0e15-4aae-a2c5-b7c7e9cb113a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:30:24.358048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-cdda8a92-5655-4c9d-a93b-7e35c777a126 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:30:24.359470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-cdda8a92-5655-4c9d-a93b-7e35c777a126 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:30:24.360513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-cdda8a92-5655-4c9d-a93b-7e35c777a126 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:30:24.361586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-cdda8a92-5655-4c9d-a93b-7e35c777a126 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:30:24.362423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-cdda8a92-5655-4c9d-a93b-7e35c777a126 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:30:24.419061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdda8a92-5655-4c9d-a93b-7e35c777a126 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:24.424598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdda8a92-5655-4c9d-a93b-7e35c777a126 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:24.427579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdda8a92-5655-4c9d-a93b-7e35c777a126 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:24.429787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdda8a92-5655-4c9d-a93b-7e35c777a126 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:24.439896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdda8a92-5655-4c9d-a93b-7e35c777a126 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:24.443206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdda8a92-5655-4c9d-a93b-7e35c777a126 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:24.531338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-cdda8a92-5655-4c9d-a93b-7e35c777a126 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Getting quotas for project 01a439cf381d4136b8e1fb454adcfc8f. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:30:24.539914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-cdda8a92-5655-4c9d-a93b-7e35c777a126 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Getting quotas for user 11332bdf6b5242039d183f5bc6a04058 and project 01a439cf381d4136b8e1fb454adcfc8f. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:30:24.567511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cdda8a92-5655-4c9d-a93b-7e35c777a126 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:30:24.570314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cdda8a92-5655-4c9d-a93b-7e35c777a126 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:30:24.586027 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6ebc44b9-0e15-4aae-a2c5-b7c7e9cb113a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 204 len: 0 microversion: 2.47 time: 0.462853 Oct 10 23:30:24.587681 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1594/3275] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:30:24 2022] DELETE /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:30:24.599211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0fc59a6c-23b1-4dc0-94e3-05ff8b52e041 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f6633acddc0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:24.713951 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cdda8a92-5655-4c9d-a93b-7e35c777a126 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.438954 Oct 10 23:30:24.714664 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1682/3276] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:30:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:30:24.738842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b3167372-5c05-4e5a-8289-6c37f9fa0da2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:24.753100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b3167372-5c05-4e5a-8289-6c37f9fa0da2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:24.765605 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0fc59a6c-23b1-4dc0-94e3-05ff8b52e041 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88" status: 200 len: 345 microversion: 2.1 time: 0.173514 Oct 10 23:30:24.766748 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1595/3277] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:30:24 2022] GET /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88 => generated 345 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:24.783922 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-83608895-74bd-47cf-8ac8-7019462142f0 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:24.784692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-83608895-74bd-47cf-8ac8-7019462142f0 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:24.801749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3167372-5c05-4e5a-8289-6c37f9fa0da2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:24.802267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3167372-5c05-4e5a-8289-6c37f9fa0da2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:24.803846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3167372-5c05-4e5a-8289-6c37f9fa0da2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:24.805987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3167372-5c05-4e5a-8289-6c37f9fa0da2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:24.806977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3167372-5c05-4e5a-8289-6c37f9fa0da2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:24.808882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3167372-5c05-4e5a-8289-6c37f9fa0da2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:25.208287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-83608895-74bd-47cf-8ac8-7019462142f0 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11332bdf6b5242039d183f5bc6a04058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a439cf381d4136b8e1fb454adcfc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:25.228110 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-83608895-74bd-47cf-8ac8-7019462142f0 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] 10.222.0.23 "GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971" status: 200 len: 1214 microversion: 2.1 time: 0.459069 Oct 10 23:30:25.242743 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1596/3278] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:24 2022] GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971 => generated 1214 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:25.713413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b3167372-5c05-4e5a-8289-6c37f9fa0da2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:25.752028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b3167372-5c05-4e5a-8289-6c37f9fa0da2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:25.757760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b3167372-5c05-4e5a-8289-6c37f9fa0da2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:25.771061 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b3167372-5c05-4e5a-8289-6c37f9fa0da2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1363 microversion: 2.47 time: 1.043755 Oct 10 23:30:25.785404 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1683/3279] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:24 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1363 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:25.788136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1b085a18-cd2e-428d-86ec-edb9183c3231 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f6633a87790>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:26.029563 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1b085a18-cd2e-428d-86ec-edb9183c3231 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88" status: 200 len: 345 microversion: 2.1 time: 0.245024 Oct 10 23:30:26.032363 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1597/3280] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:30:25 2022] GET /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88 => generated 345 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:26.268038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8f4dfcb0-dd6b-4d7f-bc46-10141af3b295 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:26.270550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8f4dfcb0-dd6b-4d7f-bc46-10141af3b295 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:26.313453 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f4dfcb0-dd6b-4d7f-bc46-10141af3b295 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:26.315663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f4dfcb0-dd6b-4d7f-bc46-10141af3b295 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:26.316579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f4dfcb0-dd6b-4d7f-bc46-10141af3b295 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:26.319449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f4dfcb0-dd6b-4d7f-bc46-10141af3b295 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:26.321532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f4dfcb0-dd6b-4d7f-bc46-10141af3b295 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:26.324809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f4dfcb0-dd6b-4d7f-bc46-10141af3b295 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:26.492401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-6fbe6727-7277-4747-b150-670cf136fcc2 req-1b3465ac-6a94-47a6-ad30-eb7b234b7fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "tag": "575d047b-0d89-4ae3-b746-a43054af851b"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:30:26.595538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6fbe6727-7277-4747-b150-670cf136fcc2 req-1b3465ac-6a94-47a6-ad30-eb7b234b7fa0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:26.599272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6fbe6727-7277-4747-b150-670cf136fcc2 req-1b3465ac-6a94-47a6-ad30-eb7b234b7fa0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:26.599835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6fbe6727-7277-4747-b150-670cf136fcc2 req-1b3465ac-6a94-47a6-ad30-eb7b234b7fa0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:26.640965 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-6fbe6727-7277-4747-b150-670cf136fcc2 req-1b3465ac-6a94-47a6-ad30-eb7b234b7fa0 service nova] Creating event network-changed:575d047b-0d89-4ae3-b746-a43054af851b for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:30:26.660892 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-6fbe6727-7277-4747-b150-670cf136fcc2 req-1b3465ac-6a94-47a6-ad30-eb7b234b7fa0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176660 Oct 10 23:30:26.666967 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1598/3281] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:26.744566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8f4dfcb0-dd6b-4d7f-bc46-10141af3b295 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11332bdf6b5242039d183f5bc6a04058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a439cf381d4136b8e1fb454adcfc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:26.754861 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8f4dfcb0-dd6b-4d7f-bc46-10141af3b295 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] 10.222.0.23 "GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971" status: 200 len: 1218 microversion: 2.1 time: 0.496698 Oct 10 23:30:26.757447 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1684/3282] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:26 2022] GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971 => generated 1218 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:26.830876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f60fe523-6800-4c0f-b308-b0e55cbb9f54 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:26.839889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f60fe523-6800-4c0f-b308-b0e55cbb9f54 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:26.870535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f60fe523-6800-4c0f-b308-b0e55cbb9f54 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:26.872607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f60fe523-6800-4c0f-b308-b0e55cbb9f54 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:26.873064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f60fe523-6800-4c0f-b308-b0e55cbb9f54 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:26.873847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f60fe523-6800-4c0f-b308-b0e55cbb9f54 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:26.874307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f60fe523-6800-4c0f-b308-b0e55cbb9f54 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:26.878254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f60fe523-6800-4c0f-b308-b0e55cbb9f54 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:27.046014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b04f171a-54a2-4d81-b0ea-16f730dc1baa tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f662ae4a5e0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:27.111718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f60fe523-6800-4c0f-b308-b0e55cbb9f54 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:27.129844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f60fe523-6800-4c0f-b308-b0e55cbb9f54 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:27.132672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f60fe523-6800-4c0f-b308-b0e55cbb9f54 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:27.134300 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f60fe523-6800-4c0f-b308-b0e55cbb9f54 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 200 len: 1363 microversion: 2.47 time: 0.326529 Oct 10 23:30:27.142760 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1599/3283] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:26 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 1363 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:27.216041 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b04f171a-54a2-4d81-b0ea-16f730dc1baa tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88" status: 200 len: 345 microversion: 2.1 time: 0.175533 Oct 10 23:30:27.217249 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1685/3284] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:30:27 2022] GET /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88 => generated 345 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:30:27.783165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-32c3d0f4-cb98-467d-9ba0-8c92735a2860 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:27.784267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-32c3d0f4-cb98-467d-9ba0-8c92735a2860 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:27.792405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32c3d0f4-cb98-467d-9ba0-8c92735a2860 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:27.796056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32c3d0f4-cb98-467d-9ba0-8c92735a2860 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:27.796838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32c3d0f4-cb98-467d-9ba0-8c92735a2860 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:27.806306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32c3d0f4-cb98-467d-9ba0-8c92735a2860 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:27.807886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32c3d0f4-cb98-467d-9ba0-8c92735a2860 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:27.808640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32c3d0f4-cb98-467d-9ba0-8c92735a2860 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:28.181104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7cb49a27-8de6-434b-9e13-576a2b7ce02f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:28.182783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7cb49a27-8de6-434b-9e13-576a2b7ce02f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: 7e4423e2-2019-4355-81d4-f7e43915eac4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:28.208799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cb49a27-8de6-434b-9e13-576a2b7ce02f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:28.210928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cb49a27-8de6-434b-9e13-576a2b7ce02f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:28.212284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cb49a27-8de6-434b-9e13-576a2b7ce02f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:28.214779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cb49a27-8de6-434b-9e13-576a2b7ce02f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:28.218146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cb49a27-8de6-434b-9e13-576a2b7ce02f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:28.219876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cb49a27-8de6-434b-9e13-576a2b7ce02f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:28.284696 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-7cb49a27-8de6-434b-9e13-576a2b7ce02f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] HTTP exception thrown: Instance 7e4423e2-2019-4355-81d4-f7e43915eac4 could not be found. Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7cb49a27-8de6-434b-9e13-576a2b7ce02f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Request method failure captured: Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 HTTP/1.1 Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKreiSEGqHRLyvKpvR-BzGToTI2kynhhiRJjhnj1FC6C0mHLCKt06I1Y5l08L7R5qYeln32Zv0MzG6CUddpxkGdp2bm-yc6wn-tBR0IZuYrPDskRqSeIXknDLnOlUPEASf-HCgXxV50vEbTp2-Iskvgkl4wspwP9Eilv6WcglLojR4w Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: X-Openstack-Nova-Api-Version: 2.47 Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 236cac8b848c41e4ab7378ef3bc01c3b Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerShowV247Test-184044201 Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/236cac8b848c41e4ab7378ef3bc01c3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/236cac8b848c41e4ab7378ef3bc01c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/236cac8b848c41e4ab7378ef3bc01c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_236cac8b848c41e4ab7378ef3bc01c3b", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerShowV247Test-184044201 Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 236cac8b848c41e4ab7378ef3bc01c3b Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerShowV247Test-184044201 Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerShowV247Test-184044201-project Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a9acee09f57e435a8c9e064819b850b7 Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerShowV247Test-184044201-project Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 7e4423e2-2019-4355-81d4-f7e43915eac4 could not be found. Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '7e4423e2-2019-4355-81d4-f7e43915eac4'} Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e4423e2-2019-4355-81d4-f7e43915eac4 could not be found. Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e4423e2-2019-4355-81d4-f7e43915eac4 could not be found. Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:28.294374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:28.300124 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:28.300124 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:28.300124 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:28.300124 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:30:28.300124 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:30:28.300124 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e4423e2-2019-4355-81d4-f7e43915eac4 could not be found. Oct 10 23:30:28.300124 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:28.303074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7cb49a27-8de6-434b-9e13-576a2b7ce02f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Returning 404 to user: Instance 7e4423e2-2019-4355-81d4-f7e43915eac4 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:30:28.306509 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7cb49a27-8de6-434b-9e13-576a2b7ce02f tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4" status: 404 len: 111 microversion: 2.47 time: 0.132996 Oct 10 23:30:28.307871 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1686/3285] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:28 2022] GET /compute/v2.1/servers/7e4423e2-2019-4355-81d4-f7e43915eac4 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 10 23:30:28.322591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ed0c5e68-44f5-47c7-a8e1-a3bd4cd7211b tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f662aebcc10>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:28.360368 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-ed0c5e68-44f5-47c7-a8e1-a3bd4cd7211b tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] HTTP exception thrown: Volume 75836d0e-8f77-40c4-b9b4-e281f5584a88 could not be found. Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ed0c5e68-44f5-47c7-a8e1-a3bd4cd7211b tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Request method failure captured: Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88 HTTP/1.1 Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKsAqt5qDzWRCIrx1ssZbZl0FoDPYqO6F77uWjcxW91if_ZJvu9JvxzXVaxCV4zNK5S6Zb_lmWM3hgEmHk5tqv1cgC6D4zYG5KzCHW1Wd0Me7q3nwMLT3J27mt_HBt3knVYx2WdO4Tswy7PbD2Qh-DZ9Yvix0xUmuHxod5TiY-fseSE Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: ba51f340ad894c0a91f9b4e581b8d529 Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-544703407 Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ba51f340ad894c0a91f9b4e581b8d529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ba51f340ad894c0a91f9b4e581b8d529"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ba51f340ad894c0a91f9b4e581b8d529"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ba51f340ad894c0a91f9b4e581b8d529", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-VolumesSnapshotsTestJSON-544703407 Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: ba51f340ad894c0a91f9b4e581b8d529 Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-544703407 Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-VolumesSnapshotsTestJSON-544703407-project Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 408fa3cc8c3f4ab8884b8f3b819fb12d Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-VolumesSnapshotsTestJSON-544703407-project Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: exception: Volume 75836d0e-8f77-40c4-b9b4-e281f5584a88 could not be found. Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '75836d0e-8f77-40c4-b9b4-e281f5584a88'} Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 75836d0e-8f77-40c4-b9b4-e281f5584a88 could not be found. (HTTP 404) (Request-ID: req-eb14c91a-ed16-4179-8a9b-20820d84303e) Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 23:30:28.363525 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 75836d0e-8f77-40c4-b9b4-e281f5584a88 could not be found. Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 75836d0e-8f77-40c4-b9b4-e281f5584a88 could not be found. Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 75836d0e-8f77-40c4-b9b4-e281f5584a88 could not be found. Oct 10 23:30:28.367891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:28.377662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ed0c5e68-44f5-47c7-a8e1-a3bd4cd7211b tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Returning 404 to user: Volume 75836d0e-8f77-40c4-b9b4-e281f5584a88 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:30:28.378804 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ed0c5e68-44f5-47c7-a8e1-a3bd4cd7211b tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88" status: 404 len: 109 microversion: 2.1 time: 0.068667 Oct 10 23:30:28.379723 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1687/3286] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:30:28 2022] GET /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:30:28.391709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-39d689d4-74fe-4bb2-90bb-5250fa9ca48a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:28.392736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-39d689d4-74fe-4bb2-90bb-5250fa9ca48a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: c8b65a13-be83-4de1-a380-b92079cf10c7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:28.402489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39d689d4-74fe-4bb2-90bb-5250fa9ca48a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:28.403356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39d689d4-74fe-4bb2-90bb-5250fa9ca48a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:28.404046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39d689d4-74fe-4bb2-90bb-5250fa9ca48a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:28.405014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39d689d4-74fe-4bb2-90bb-5250fa9ca48a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:28.405762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39d689d4-74fe-4bb2-90bb-5250fa9ca48a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:28.406419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39d689d4-74fe-4bb2-90bb-5250fa9ca48a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:28.442821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-39d689d4-74fe-4bb2-90bb-5250fa9ca48a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: c8b65a13-be83-4de1-a380-b92079cf10c7] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:30:28.474040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-32c3d0f4-cb98-467d-9ba0-8c92735a2860 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11332bdf6b5242039d183f5bc6a04058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a439cf381d4136b8e1fb454adcfc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:28.485584 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-32c3d0f4-cb98-467d-9ba0-8c92735a2860 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] 10.222.0.23 "GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971" status: 200 len: 1274 microversion: 2.1 time: 0.706269 Oct 10 23:30:28.499167 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1600/3287] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:27 2022] GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971 => generated 1274 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:28.504724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-33bce608-68a2-4a32-a292-30038e1ce2f3 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a7ed310>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:28.648540 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-33bce608-68a2-4a32-a292-30038e1ce2f3 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/848be340-53fe-495b-82cf-77a5db3a3498" status: 200 len: 662 microversion: 2.1 time: 0.147429 Oct 10 23:30:28.658445 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1601/3288] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:30:28 2022] GET /compute/v2.1/images/848be340-53fe-495b-82cf-77a5db3a3498 => generated 662 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:28.668990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bacefca4-2bde-461d-97f7-ed0a80acf293 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f662a5de1f0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:28.766432 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-39d689d4-74fe-4bb2-90bb-5250fa9ca48a tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c8b65a13-be83-4de1-a380-b92079cf10c7" status: 204 len: 0 microversion: 2.47 time: 0.384646 Oct 10 23:30:28.768447 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1688/3289] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:30:28 2022] DELETE /compute/v2.1/servers/c8b65a13-be83-4de1-a380-b92079cf10c7 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:30:28.780816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-90a4eb90-e6f5-4954-b25e-31d7d15b9f2c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662aebcc10>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:28.798917 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-bacefca4-2bde-461d-97f7-ed0a80acf293 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] HTTP exception thrown: Volume 75836d0e-8f77-40c4-b9b4-e281f5584a88 could not be found. Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bacefca4-2bde-461d-97f7-ed0a80acf293 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Request method failure captured: Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88 HTTP/1.1 Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKsAqt5qDzWRCIrx1ssZbZl0FoDPYqO6F77uWjcxW91if_ZJvu9JvxzXVaxCV4zNK5S6Zb_lmWM3hgEmHk5tqv1cgC6D4zYG5KzCHW1Wd0Me7q3nwMLT3J27mt_HBt3knVYx2WdO4Tswy7PbD2Qh-DZ9Yvix0xUmuHxod5TiY-fseSE Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: ba51f340ad894c0a91f9b4e581b8d529 Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-544703407 Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ba51f340ad894c0a91f9b4e581b8d529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ba51f340ad894c0a91f9b4e581b8d529"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ba51f340ad894c0a91f9b4e581b8d529"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ba51f340ad894c0a91f9b4e581b8d529", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-VolumesSnapshotsTestJSON-544703407 Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: ba51f340ad894c0a91f9b4e581b8d529 Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-544703407 Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-VolumesSnapshotsTestJSON-544703407-project Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 408fa3cc8c3f4ab8884b8f3b819fb12d Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-VolumesSnapshotsTestJSON-544703407-project Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: exception: Volume 75836d0e-8f77-40c4-b9b4-e281f5584a88 could not be found. Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '75836d0e-8f77-40c4-b9b4-e281f5584a88'} Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 75836d0e-8f77-40c4-b9b4-e281f5584a88 could not be found. (HTTP 404) (Request-ID: req-17d1459d-a745-4a63-a197-9e082359c3fc) Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 23:30:28.827293 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 75836d0e-8f77-40c4-b9b4-e281f5584a88 could not be found. Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 75836d0e-8f77-40c4-b9b4-e281f5584a88 could not be found. Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 75836d0e-8f77-40c4-b9b4-e281f5584a88 could not be found. Oct 10 23:30:28.835537 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:28.842707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bacefca4-2bde-461d-97f7-ed0a80acf293 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Returning 404 to user: Volume 75836d0e-8f77-40c4-b9b4-e281f5584a88 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:30:28.842707 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bacefca4-2bde-461d-97f7-ed0a80acf293 tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88" status: 404 len: 109 microversion: 2.1 time: 0.189017 Oct 10 23:30:28.842707 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1602/3290] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 10 23:30:28 2022] DELETE /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88 => generated 109 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:30:28.886310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fcab49e6-7676-4918-a226-41a459e3adb2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:28.895150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fcab49e6-7676-4918-a226-41a459e3adb2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: c8b65a13-be83-4de1-a380-b92079cf10c7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:28.931320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fcab49e6-7676-4918-a226-41a459e3adb2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:28.931573 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-90a4eb90-e6f5-4954-b25e-31d7d15b9f2c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/848be340-53fe-495b-82cf-77a5db3a3498" status: 200 len: 662 microversion: 2.1 time: 0.161219 Oct 10 23:30:28.933113 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1689/3291] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:30:28 2022] GET /compute/v2.1/images/848be340-53fe-495b-82cf-77a5db3a3498 => generated 662 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:28.933793 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fcab49e6-7676-4918-a226-41a459e3adb2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:28.934537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fcab49e6-7676-4918-a226-41a459e3adb2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:28.936356 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fcab49e6-7676-4918-a226-41a459e3adb2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:28.937590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fcab49e6-7676-4918-a226-41a459e3adb2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:28.938213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fcab49e6-7676-4918-a226-41a459e3adb2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:28.939116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c119ffc0-17a2-4f4d-8ed8-4bdefcc4681b tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Calling method '.version_select at 0x7f6633a95940>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:28.995282 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-c119ffc0-17a2-4f4d-8ed8-4bdefcc4681b tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] HTTP exception thrown: Volume 75836d0e-8f77-40c4-b9b4-e281f5584a88 could not be found. Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c119ffc0-17a2-4f4d-8ed8-4bdefcc4681b tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Request method failure captured: Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88 HTTP/1.1 Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKsAqt5qDzWRCIrx1ssZbZl0FoDPYqO6F77uWjcxW91if_ZJvu9JvxzXVaxCV4zNK5S6Zb_lmWM3hgEmHk5tqv1cgC6D4zYG5KzCHW1Wd0Me7q3nwMLT3J27mt_HBt3knVYx2WdO4Tswy7PbD2Qh-DZ9Yvix0xUmuHxod5TiY-fseSE Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: ba51f340ad894c0a91f9b4e581b8d529 Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-544703407 Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ba51f340ad894c0a91f9b4e581b8d529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ba51f340ad894c0a91f9b4e581b8d529"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ba51f340ad894c0a91f9b4e581b8d529"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ba51f340ad894c0a91f9b4e581b8d529", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-VolumesSnapshotsTestJSON-544703407 Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: ba51f340ad894c0a91f9b4e581b8d529 Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-544703407 Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-VolumesSnapshotsTestJSON-544703407-project Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 408fa3cc8c3f4ab8884b8f3b819fb12d Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-VolumesSnapshotsTestJSON-544703407-project Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: exception: Volume 75836d0e-8f77-40c4-b9b4-e281f5584a88 could not be found. Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '75836d0e-8f77-40c4-b9b4-e281f5584a88'} Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 75836d0e-8f77-40c4-b9b4-e281f5584a88 could not be found. (HTTP 404) (Request-ID: req-0e899aeb-6b97-408d-b908-2e40aa53b55f) Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 23:30:28.997644 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 75836d0e-8f77-40c4-b9b4-e281f5584a88 could not be found. Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 75836d0e-8f77-40c4-b9b4-e281f5584a88 could not be found. Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 75836d0e-8f77-40c4-b9b4-e281f5584a88 could not be found. Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c119ffc0-17a2-4f4d-8ed8-4bdefcc4681b tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] Returning 404 to user: Volume 75836d0e-8f77-40c4-b9b4-e281f5584a88 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c119ffc0-17a2-4f4d-8ed8-4bdefcc4681b tempest-VolumesSnapshotsTestJSON-544703407 tempest-VolumesSnapshotsTestJSON-544703407-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88" status: 404 len: 109 microversion: 2.1 time: 0.066797 Oct 10 23:30:29.005634 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1690/3292] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:30:28 2022] GET /compute/v2.1/os-volumes/75836d0e-8f77-40c4-b9b4-e281f5584a88 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:30:29.224773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fcab49e6-7676-4918-a226-41a459e3adb2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:29.262455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fcab49e6-7676-4918-a226-41a459e3adb2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:29.268926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fcab49e6-7676-4918-a226-41a459e3adb2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:29.285127 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fcab49e6-7676-4918-a226-41a459e3adb2 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b65a13-be83-4de1-a380-b92079cf10c7" status: 200 len: 1363 microversion: 2.47 time: 0.433527 Oct 10 23:30:29.285795 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1603/3293] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:28 2022] GET /compute/v2.1/servers/c8b65a13-be83-4de1-a380-b92079cf10c7 => generated 1363 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:29.544877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-eba431d0-b316-410e-a89b-f3acf63c51dd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:29.546658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-eba431d0-b316-410e-a89b-f3acf63c51dd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:29.565331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eba431d0-b316-410e-a89b-f3acf63c51dd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:29.567505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eba431d0-b316-410e-a89b-f3acf63c51dd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:29.569825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eba431d0-b316-410e-a89b-f3acf63c51dd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:29.575059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eba431d0-b316-410e-a89b-f3acf63c51dd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:29.576790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eba431d0-b316-410e-a89b-f3acf63c51dd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:29.583253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eba431d0-b316-410e-a89b-f3acf63c51dd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:29.893392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-eba431d0-b316-410e-a89b-f3acf63c51dd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11332bdf6b5242039d183f5bc6a04058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a439cf381d4136b8e1fb454adcfc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:29.918236 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-eba431d0-b316-410e-a89b-f3acf63c51dd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] 10.222.0.23 "GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971" status: 200 len: 1272 microversion: 2.1 time: 0.381939 Oct 10 23:30:29.928501 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1691/3294] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:29 2022] GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971 => generated 1272 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:30.343191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-93ec1665-6a56-4843-8cb4-8f758ee3eaeb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:30.344149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-93ec1665-6a56-4843-8cb4-8f758ee3eaeb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: c8b65a13-be83-4de1-a380-b92079cf10c7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:30.372072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93ec1665-6a56-4843-8cb4-8f758ee3eaeb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:30.378296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93ec1665-6a56-4843-8cb4-8f758ee3eaeb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:30.379013 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93ec1665-6a56-4843-8cb4-8f758ee3eaeb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:30.380130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93ec1665-6a56-4843-8cb4-8f758ee3eaeb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:30.422954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93ec1665-6a56-4843-8cb4-8f758ee3eaeb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:30.424303 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93ec1665-6a56-4843-8cb4-8f758ee3eaeb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:30.973638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a4a985b1-95d2-4768-be00-953b3b0658a8 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:30.974416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a4a985b1-95d2-4768-be00-953b3b0658a8 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:31.006627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4a985b1-95d2-4768-be00-953b3b0658a8 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:31.009023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4a985b1-95d2-4768-be00-953b3b0658a8 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:31.012712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4a985b1-95d2-4768-be00-953b3b0658a8 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:31.016504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4a985b1-95d2-4768-be00-953b3b0658a8 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:31.022813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4a985b1-95d2-4768-be00-953b3b0658a8 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:31.024173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4a985b1-95d2-4768-be00-953b3b0658a8 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:31.109086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-93ec1665-6a56-4843-8cb4-8f758ee3eaeb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:31.143831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-93ec1665-6a56-4843-8cb4-8f758ee3eaeb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:31.161440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-93ec1665-6a56-4843-8cb4-8f758ee3eaeb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:31.168534 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-93ec1665-6a56-4843-8cb4-8f758ee3eaeb tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b65a13-be83-4de1-a380-b92079cf10c7" status: 200 len: 1363 microversion: 2.47 time: 0.831572 Oct 10 23:30:31.171794 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1604/3295] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:30 2022] GET /compute/v2.1/servers/c8b65a13-be83-4de1-a380-b92079cf10c7 => generated 1363 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:31.902349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a4a985b1-95d2-4768-be00-953b3b0658a8 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11332bdf6b5242039d183f5bc6a04058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a439cf381d4136b8e1fb454adcfc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:31.909452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:30:31.942553 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a4a985b1-95d2-4768-be00-953b3b0658a8 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] 10.222.0.23 "GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971" status: 200 len: 1272 microversion: 2.1 time: 0.985762 Oct 10 23:30:31.943942 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1692/3296] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:30 2022] GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971 => generated 1272 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:32.015139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2d840e20-8e5d-4040-ad78-f1f3024058b4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a7ed8b0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:32.164536 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2d840e20-8e5d-4040-ad78-f1f3024058b4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/2477dab9-f49e-435e-94bb-51d3c14f2204" status: 200 len: 662 microversion: 2.1 time: 0.153028 Oct 10 23:30:32.167267 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1605/3297] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:30:32 2022] GET /compute/v2.1/images/2477dab9-f49e-435e-94bb-51d3c14f2204 => generated 662 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:32.181840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fcc1747b-eb25-40ab-9197-a567e0d30cc4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662b17c9d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:32.202394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-401901a2-da58-414c-81c8-a015396adff6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:32.203129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-401901a2-da58-414c-81c8-a015396adff6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: c8b65a13-be83-4de1-a380-b92079cf10c7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:32.215242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-401901a2-da58-414c-81c8-a015396adff6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:32.215764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-401901a2-da58-414c-81c8-a015396adff6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:32.216339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-401901a2-da58-414c-81c8-a015396adff6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:32.217251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-401901a2-da58-414c-81c8-a015396adff6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:32.217783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-401901a2-da58-414c-81c8-a015396adff6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:32.219216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-401901a2-da58-414c-81c8-a015396adff6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:32.280426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-401901a2-da58-414c-81c8-a015396adff6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:32.281955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-401901a2-da58-414c-81c8-a015396adff6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:32.282675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-401901a2-da58-414c-81c8-a015396adff6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:32.283559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-401901a2-da58-414c-81c8-a015396adff6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lazy-loading 'fault' on Instance uuid c8b65a13-be83-4de1-a380-b92079cf10c7 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:30:32.332484 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fcc1747b-eb25-40ab-9197-a567e0d30cc4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/2477dab9-f49e-435e-94bb-51d3c14f2204" status: 200 len: 662 microversion: 2.1 time: 0.155354 Oct 10 23:30:32.345097 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1693/3298] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:30:32 2022] GET /compute/v2.1/images/2477dab9-f49e-435e-94bb-51d3c14f2204 => generated 662 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:32.590637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-401901a2-da58-414c-81c8-a015396adff6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:32.617874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-401901a2-da58-414c-81c8-a015396adff6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:32.626615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-401901a2-da58-414c-81c8-a015396adff6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9acee09f57e435a8c9e064819b850b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236cac8b848c41e4ab7378ef3bc01c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:32.632125 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-401901a2-da58-414c-81c8-a015396adff6 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b65a13-be83-4de1-a380-b92079cf10c7" status: 200 len: 1368 microversion: 2.47 time: 0.434816 Oct 10 23:30:32.635480 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1606/3299] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:32 2022] GET /compute/v2.1/servers/c8b65a13-be83-4de1-a380-b92079cf10c7 => generated 1368 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:30:32.984456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a027af44-f160-4b64-9460-0e60679e1e01 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:32.985094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a027af44-f160-4b64-9460-0e60679e1e01 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:33.004862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a027af44-f160-4b64-9460-0e60679e1e01 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:33.012957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a027af44-f160-4b64-9460-0e60679e1e01 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:33.013857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a027af44-f160-4b64-9460-0e60679e1e01 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:33.014954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a027af44-f160-4b64-9460-0e60679e1e01 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:33.015752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a027af44-f160-4b64-9460-0e60679e1e01 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:33.018730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a027af44-f160-4b64-9460-0e60679e1e01 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:33.705610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0b95ae2c-a3ca-4184-b7bf-100f31c1a411 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:33.707335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0b95ae2c-a3ca-4184-b7bf-100f31c1a411 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] [instance: c8b65a13-be83-4de1-a380-b92079cf10c7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:33.733038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:30:33.734740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a027af44-f160-4b64-9460-0e60679e1e01 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11332bdf6b5242039d183f5bc6a04058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a439cf381d4136b8e1fb454adcfc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:33.742849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b95ae2c-a3ca-4184-b7bf-100f31c1a411 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:33.750802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b95ae2c-a3ca-4184-b7bf-100f31c1a411 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:33.751879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b95ae2c-a3ca-4184-b7bf-100f31c1a411 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:33.755438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b95ae2c-a3ca-4184-b7bf-100f31c1a411 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:33.759307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b95ae2c-a3ca-4184-b7bf-100f31c1a411 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:33.762128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b95ae2c-a3ca-4184-b7bf-100f31c1a411 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:33.762470 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a027af44-f160-4b64-9460-0e60679e1e01 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] 10.222.0.23 "GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971" status: 200 len: 1314 microversion: 2.1 time: 0.777035 Oct 10 23:30:33.767224 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1694/3300] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:32 2022] GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971 => generated 1314 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:30:33.869512 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-0b95ae2c-a3ca-4184-b7bf-100f31c1a411 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] HTTP exception thrown: Instance c8b65a13-be83-4de1-a380-b92079cf10c7 could not be found. Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0b95ae2c-a3ca-4184-b7bf-100f31c1a411 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Request method failure captured: Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/c8b65a13-be83-4de1-a380-b92079cf10c7 HTTP/1.1 Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKreiSEGqHRLyvKpvR-BzGToTI2kynhhiRJjhnj1FC6C0mHLCKt06I1Y5l08L7R5qYeln32Zv0MzG6CUddpxkGdp2bm-yc6wn-tBR0IZuYrPDskRqSeIXknDLnOlUPEASf-HCgXxV50vEbTp2-Iskvgkl4wspwP9Eilv6WcglLojR4w Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: X-Openstack-Nova-Api-Version: 2.47 Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 236cac8b848c41e4ab7378ef3bc01c3b Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerShowV247Test-184044201 Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/236cac8b848c41e4ab7378ef3bc01c3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/236cac8b848c41e4ab7378ef3bc01c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/236cac8b848c41e4ab7378ef3bc01c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_236cac8b848c41e4ab7378ef3bc01c3b", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerShowV247Test-184044201 Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 236cac8b848c41e4ab7378ef3bc01c3b Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerShowV247Test-184044201 Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerShowV247Test-184044201-project Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: a9acee09f57e435a8c9e064819b850b7 Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerShowV247Test-184044201-project Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance c8b65a13-be83-4de1-a380-b92079cf10c7 could not be found. Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'c8b65a13-be83-4de1-a380-b92079cf10c7'} Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8b65a13-be83-4de1-a380-b92079cf10c7 could not be found. Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8b65a13-be83-4de1-a380-b92079cf10c7 could not be found. Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:30:33.877151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:33.888434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:30:33.888434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:30:33.888434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:30:33.888434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:30:33.888434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:30:33.888434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8b65a13-be83-4de1-a380-b92079cf10c7 could not be found. Oct 10 23:30:33.888434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:30:33.888434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0b95ae2c-a3ca-4184-b7bf-100f31c1a411 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] Returning 404 to user: Instance c8b65a13-be83-4de1-a380-b92079cf10c7 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:30:33.888434 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0b95ae2c-a3ca-4184-b7bf-100f31c1a411 tempest-ServerShowV247Test-184044201 tempest-ServerShowV247Test-184044201-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b65a13-be83-4de1-a380-b92079cf10c7" status: 404 len: 111 microversion: 2.47 time: 0.191982 Oct 10 23:30:33.901810 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1607/3301] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:30:33 2022] GET /compute/v2.1/servers/c8b65a13-be83-4de1-a380-b92079cf10c7 => generated 111 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:30:34.795885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8c263191-9aaf-4391-acb9-ab37e59a2943 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:34.797481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8c263191-9aaf-4391-acb9-ab37e59a2943 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:34.837508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:30:34.837508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:30:34.838925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c263191-9aaf-4391-acb9-ab37e59a2943 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:34.845337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c263191-9aaf-4391-acb9-ab37e59a2943 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:34.854767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c263191-9aaf-4391-acb9-ab37e59a2943 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:34.857230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c263191-9aaf-4391-acb9-ab37e59a2943 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:34.859138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c263191-9aaf-4391-acb9-ab37e59a2943 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:34.860529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c263191-9aaf-4391-acb9-ab37e59a2943 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:35.301629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-12e0692e-de18-43e7-8746-801caae3a7dc tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f663026ddc0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:35.309685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:30:35.390090 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-12e0692e-de18-43e7-8746-801caae3a7dc tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/4551a12a-abd6-43d9-b765-c22499874335" status: 200 len: 662 microversion: 2.1 time: 0.094223 Oct 10 23:30:35.403791 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1608/3302] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:30:35 2022] GET /compute/v2.1/images/4551a12a-abd6-43d9-b765-c22499874335 => generated 662 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:30:35.411326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-667bbbf4-459d-42f5-be25-ff22e966fab8 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f6633a4f3a0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:35.499713 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-667bbbf4-459d-42f5-be25-ff22e966fab8 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/4551a12a-abd6-43d9-b765-c22499874335" status: 200 len: 662 microversion: 2.1 time: 0.084067 Oct 10 23:30:35.505797 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1609/3303] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:30:35 2022] GET /compute/v2.1/images/4551a12a-abd6-43d9-b765-c22499874335 => generated 662 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:30:35.523078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8c263191-9aaf-4391-acb9-ab37e59a2943 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11332bdf6b5242039d183f5bc6a04058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a439cf381d4136b8e1fb454adcfc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:35.562420 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8c263191-9aaf-4391-acb9-ab37e59a2943 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] 10.222.0.23 "GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971" status: 200 len: 1314 microversion: 2.1 time: 0.771937 Oct 10 23:30:35.563602 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1695/3304] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:34 2022] GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971 => generated 1314 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:35.816826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c6b9a68d-776b-4127-acfe-366686d76031 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1936199905", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:30:35.986503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-c6b9a68d-776b-4127-acfe-366686d76031 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] validate_networks() for None {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:30:36.437295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-f64886e9-8727-4d31-b8f2-b6bdf82eacab req-fa3cf453-ee0f-4049-9231-8d68ea91acdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32e4a909-58d8-4585-8e6d-f7902e620971", "tag": "04e02de1-5580-458f-aae1-c3664bcffb65"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:30:36.489536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f64886e9-8727-4d31-b8f2-b6bdf82eacab req-fa3cf453-ee0f-4049-9231-8d68ea91acdf service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:36.490424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f64886e9-8727-4d31-b8f2-b6bdf82eacab req-fa3cf453-ee0f-4049-9231-8d68ea91acdf service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:36.491511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f64886e9-8727-4d31-b8f2-b6bdf82eacab req-fa3cf453-ee0f-4049-9231-8d68ea91acdf service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:36.511452 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-f64886e9-8727-4d31-b8f2-b6bdf82eacab req-fa3cf453-ee0f-4049-9231-8d68ea91acdf service nova] Creating event network-changed:04e02de1-5580-458f-aae1-c3664bcffb65 for instance 32e4a909-58d8-4585-8e6d-f7902e620971 on n-h1-860864-2 Oct 10 23:30:36.522922 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-f64886e9-8727-4d31-b8f2-b6bdf82eacab req-fa3cf453-ee0f-4049-9231-8d68ea91acdf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104905 Oct 10 23:30:36.530584 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1696/3305] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:36.596428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-21444923-96e6-41b1-be74-a43537d184ab tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:36.597342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-21444923-96e6-41b1-be74-a43537d184ab tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:36.615382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21444923-96e6-41b1-be74-a43537d184ab tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:36.630596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21444923-96e6-41b1-be74-a43537d184ab tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:36.632422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21444923-96e6-41b1-be74-a43537d184ab tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:36.634070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21444923-96e6-41b1-be74-a43537d184ab tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:36.635462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21444923-96e6-41b1-be74-a43537d184ab tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:36.636145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21444923-96e6-41b1-be74-a43537d184ab tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:36.974608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-21444923-96e6-41b1-be74-a43537d184ab tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11332bdf6b5242039d183f5bc6a04058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a439cf381d4136b8e1fb454adcfc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:36.992275 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-21444923-96e6-41b1-be74-a43537d184ab tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] 10.222.0.23 "GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971" status: 200 len: 1314 microversion: 2.1 time: 0.404563 Oct 10 23:30:36.996783 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1697/3306] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:36 2022] GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:30:37.323021 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c6b9a68d-776b-4127-acfe-366686d76031 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:30:37.324059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c6b9a68d-776b-4127-acfe-366686d76031 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:30:37.324640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c6b9a68d-776b-4127-acfe-366686d76031 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:30:37.324640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c6b9a68d-776b-4127-acfe-366686d76031 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:30:37.325085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c6b9a68d-776b-4127-acfe-366686d76031 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:30:37.367550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6b9a68d-776b-4127-acfe-366686d76031 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:37.374893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6b9a68d-776b-4127-acfe-366686d76031 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:37.380015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6b9a68d-776b-4127-acfe-366686d76031 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:37.383256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6b9a68d-776b-4127-acfe-366686d76031 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:37.387609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6b9a68d-776b-4127-acfe-366686d76031 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:37.390001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6b9a68d-776b-4127-acfe-366686d76031 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:37.503459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-c6b9a68d-776b-4127-acfe-366686d76031 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Getting quotas for project c8dfd604f5c14b5db14dec95b300a176. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:30:37.533159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-c6b9a68d-776b-4127-acfe-366686d76031 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Getting quotas for user b71aca6d5de04f06a30480f7d7409d62 and project c8dfd604f5c14b5db14dec95b300a176. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:30:37.601730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c6b9a68d-776b-4127-acfe-366686d76031 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:30:37.616665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c6b9a68d-776b-4127-acfe-366686d76031 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 430a8e18-4033-498b-8cf3-a224786b7363] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:30:37.836421 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c6b9a68d-776b-4127-acfe-366686d76031 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.022073 Oct 10 23:30:37.846929 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1610/3307] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:30:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:30:38.024888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dcc7d010-e4aa-4dd4-b793-18561ca115bd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:38.027050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dcc7d010-e4aa-4dd4-b793-18561ca115bd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:38.051525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dcc7d010-e4aa-4dd4-b793-18561ca115bd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:38.053529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dcc7d010-e4aa-4dd4-b793-18561ca115bd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:38.054787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dcc7d010-e4aa-4dd4-b793-18561ca115bd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:38.071150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dcc7d010-e4aa-4dd4-b793-18561ca115bd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:38.077820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dcc7d010-e4aa-4dd4-b793-18561ca115bd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:38.078846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dcc7d010-e4aa-4dd4-b793-18561ca115bd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:38.244289 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4bd42e64-bed0-45bf-9341-ec2388b61b76 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-650299072", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:30:38.419259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-4bd42e64-bed0-45bf-9341-ec2388b61b76 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] validate_networks() for None {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:30:39.174861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dcc7d010-e4aa-4dd4-b793-18561ca115bd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11332bdf6b5242039d183f5bc6a04058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a439cf381d4136b8e1fb454adcfc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:39.192799 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dcc7d010-e4aa-4dd4-b793-18561ca115bd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] 10.222.0.23 "GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971" status: 200 len: 1314 microversion: 2.1 time: 1.172830 Oct 10 23:30:39.205794 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1698/3308] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:38 2022] GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971 => generated 1314 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:39.577751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4bd42e64-bed0-45bf-9341-ec2388b61b76 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:30:39.579037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4bd42e64-bed0-45bf-9341-ec2388b61b76 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:30:39.579797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4bd42e64-bed0-45bf-9341-ec2388b61b76 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:30:39.580421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4bd42e64-bed0-45bf-9341-ec2388b61b76 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:30:39.581294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4bd42e64-bed0-45bf-9341-ec2388b61b76 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:30:39.591567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:30:39.604140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bd42e64-bed0-45bf-9341-ec2388b61b76 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:39.605049 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bd42e64-bed0-45bf-9341-ec2388b61b76 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:39.605807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bd42e64-bed0-45bf-9341-ec2388b61b76 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:39.607340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bd42e64-bed0-45bf-9341-ec2388b61b76 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:39.608565 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bd42e64-bed0-45bf-9341-ec2388b61b76 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:39.609237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bd42e64-bed0-45bf-9341-ec2388b61b76 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:39.676350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-4bd42e64-bed0-45bf-9341-ec2388b61b76 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Getting quotas for project c8dfd604f5c14b5db14dec95b300a176. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:30:39.718582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-4bd42e64-bed0-45bf-9341-ec2388b61b76 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Getting quotas for user b71aca6d5de04f06a30480f7d7409d62 and project c8dfd604f5c14b5db14dec95b300a176. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:30:39.766014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4bd42e64-bed0-45bf-9341-ec2388b61b76 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:30:39.779975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4bd42e64-bed0-45bf-9341-ec2388b61b76 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:30:39.977507 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4bd42e64-bed0-45bf-9341-ec2388b61b76 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.738488 Oct 10 23:30:39.979863 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1611/3309] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:30:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 23:30:39.997745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-151114aa-6d43-47b9-b642-ae0bf8ab8344 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:39.998915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-151114aa-6d43-47b9-b642-ae0bf8ab8344 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:40.138884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-151114aa-6d43-47b9-b642-ae0bf8ab8344 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:40.158088 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-151114aa-6d43-47b9-b642-ae0bf8ab8344 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1217 microversion: 2.1 time: 0.168693 Oct 10 23:30:40.167799 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1612/3310] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:39 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 1217 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:30:40.190040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fca26fe8-c3f7-433d-80e9-5404c09b9a00 tempest-VolumesTestJSON-1531590722 tempest-VolumesTestJSON-1531590722-project] Calling method '.version_select at 0x7f662a5deca0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:40.262245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f583311a-b7f9-4651-b5ff-fdbb58c548ca tempest-ExtensionsTest-117105648 tempest-ExtensionsTest-117105648-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:40.264879 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f583311a-b7f9-4651-b5ff-fdbb58c548ca tempest-ExtensionsTest-117105648 tempest-ExtensionsTest-117105648-project] 10.222.0.23 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.588450 Oct 10 23:30:40.266270 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1699/3311] 10.222.0.23 () {58 vars in 1170 bytes} [Mon Oct 10 23:30:39 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:40.288588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ce959ac5-37a2-4ed7-997b-42f35fcf22d1 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:40.295388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ce959ac5-37a2-4ed7-997b-42f35fcf22d1 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:40.310425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce959ac5-37a2-4ed7-997b-42f35fcf22d1 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:40.315290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce959ac5-37a2-4ed7-997b-42f35fcf22d1 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:40.319267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce959ac5-37a2-4ed7-997b-42f35fcf22d1 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:40.324995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce959ac5-37a2-4ed7-997b-42f35fcf22d1 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:40.327186 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fca26fe8-c3f7-433d-80e9-5404c09b9a00 tempest-VolumesTestJSON-1531590722 tempest-VolumesTestJSON-1531590722-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2d8765ad-1493-407d-8870-14a5dcc35d50" status: 200 len: 351 microversion: 2.1 time: 0.162462 Oct 10 23:30:40.327776 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1613/3312] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:30:40 2022] GET /compute/v2.1/os-volumes/2d8765ad-1493-407d-8870-14a5dcc35d50 => generated 351 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:40.329985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce959ac5-37a2-4ed7-997b-42f35fcf22d1 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:40.331492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce959ac5-37a2-4ed7-997b-42f35fcf22d1 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:40.341146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-31ae60f2-24e0-4f68-8f75-672139fc0177 tempest-ExtensionsTest-117105648 tempest-ExtensionsTest-117105648-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:40.344011 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-31ae60f2-24e0-4f68-8f75-672139fc0177 tempest-ExtensionsTest-117105648 tempest-ExtensionsTest-117105648-project] 10.222.0.23 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.007113 Oct 10 23:30:40.359745 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1614/3313] 10.222.0.23 () {58 vars in 1134 bytes} [Mon Oct 10 23:30:40 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:30:41.207642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dcca27b8-8018-44a9-ad64-e1095de5b794 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:41.209460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dcca27b8-8018-44a9-ad64-e1095de5b794 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:41.272765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ce959ac5-37a2-4ed7-997b-42f35fcf22d1 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11332bdf6b5242039d183f5bc6a04058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a439cf381d4136b8e1fb454adcfc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:41.303563 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ce959ac5-37a2-4ed7-997b-42f35fcf22d1 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] 10.222.0.23 "GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971" status: 200 len: 1314 microversion: 2.1 time: 1.030762 Oct 10 23:30:41.312849 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1700/3314] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:40 2022] GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971 => generated 1314 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:42.000225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dcca27b8-8018-44a9-ad64-e1095de5b794 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:42.015563 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dcca27b8-8018-44a9-ad64-e1095de5b794 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1217 microversion: 2.1 time: 0.813260 Oct 10 23:30:42.037967 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1615/3315] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:41 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 1217 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:30:42.346985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4df8c193-5504-42fe-a023-c1a398857a3d tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:42.348222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4df8c193-5504-42fe-a023-c1a398857a3d tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:42.381946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4df8c193-5504-42fe-a023-c1a398857a3d tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:42.385167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4df8c193-5504-42fe-a023-c1a398857a3d tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:42.385700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4df8c193-5504-42fe-a023-c1a398857a3d tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:42.386839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4df8c193-5504-42fe-a023-c1a398857a3d tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:42.390114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4df8c193-5504-42fe-a023-c1a398857a3d tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:42.390616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4df8c193-5504-42fe-a023-c1a398857a3d tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:43.057130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-34a6b540-1c8d-4023-8112-ccbcaec97c5c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:43.058602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-34a6b540-1c8d-4023-8112-ccbcaec97c5c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:43.113122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34a6b540-1c8d-4023-8112-ccbcaec97c5c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:43.122108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34a6b540-1c8d-4023-8112-ccbcaec97c5c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:43.123470 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34a6b540-1c8d-4023-8112-ccbcaec97c5c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:43.129059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34a6b540-1c8d-4023-8112-ccbcaec97c5c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:43.130226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34a6b540-1c8d-4023-8112-ccbcaec97c5c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:43.135761 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34a6b540-1c8d-4023-8112-ccbcaec97c5c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:44.004697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4df8c193-5504-42fe-a023-c1a398857a3d tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11332bdf6b5242039d183f5bc6a04058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a439cf381d4136b8e1fb454adcfc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:44.028702 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4df8c193-5504-42fe-a023-c1a398857a3d tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] 10.222.0.23 "GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971" status: 200 len: 1314 microversion: 2.1 time: 1.690003 Oct 10 23:30:44.040060 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1701/3316] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:42 2022] GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971 => generated 1314 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:44.534100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-34a6b540-1c8d-4023-8112-ccbcaec97c5c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:44.545366 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-34a6b540-1c8d-4023-8112-ccbcaec97c5c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1277 microversion: 2.1 time: 1.503587 Oct 10 23:30:44.546071 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1616/3317] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:43 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 1277 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:30:45.113329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0b9ce6e1-4c98-4c6a-b428-d6f803dd22b9 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:45.115673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0b9ce6e1-4c98-4c6a-b428-d6f803dd22b9 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:45.152671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b9ce6e1-4c98-4c6a-b428-d6f803dd22b9 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:45.157922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b9ce6e1-4c98-4c6a-b428-d6f803dd22b9 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:45.160874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b9ce6e1-4c98-4c6a-b428-d6f803dd22b9 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:45.166689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b9ce6e1-4c98-4c6a-b428-d6f803dd22b9 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:45.171359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b9ce6e1-4c98-4c6a-b428-d6f803dd22b9 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:45.173574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b9ce6e1-4c98-4c6a-b428-d6f803dd22b9 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:45.596182 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-356889ea-cc46-45f6-b934-c1b34aadbb5f tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:45.601755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-356889ea-cc46-45f6-b934-c1b34aadbb5f tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:45.662872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-356889ea-cc46-45f6-b934-c1b34aadbb5f tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:45.664211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-356889ea-cc46-45f6-b934-c1b34aadbb5f tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:45.669056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-356889ea-cc46-45f6-b934-c1b34aadbb5f tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:45.674899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-356889ea-cc46-45f6-b934-c1b34aadbb5f tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:45.675710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-356889ea-cc46-45f6-b934-c1b34aadbb5f tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:45.686006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-356889ea-cc46-45f6-b934-c1b34aadbb5f tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:45.760200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:30:46.024307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0b9ce6e1-4c98-4c6a-b428-d6f803dd22b9 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11332bdf6b5242039d183f5bc6a04058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a439cf381d4136b8e1fb454adcfc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:46.033236 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0b9ce6e1-4c98-4c6a-b428-d6f803dd22b9 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] 10.222.0.23 "GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971" status: 200 len: 1314 microversion: 2.1 time: 0.933279 Oct 10 23:30:46.049195 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1702/3318] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:45 2022] GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971 => generated 1314 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:46.107861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-356889ea-cc46-45f6-b934-c1b34aadbb5f tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:46.127066 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-356889ea-cc46-45f6-b934-c1b34aadbb5f tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1275 microversion: 2.1 time: 0.559171 Oct 10 23:30:46.134500 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1617/3319] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:45 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 1275 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:30:46.441341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f14b814d-dcdd-40ce-a4a1-46a76c38ee6b tempest-VolumesTestJSON-1531590722 tempest-VolumesTestJSON-1531590722-project] Calling method '.version_select at 0x7f662aeff430>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:46.593030 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f14b814d-dcdd-40ce-a4a1-46a76c38ee6b tempest-VolumesTestJSON-1531590722 tempest-VolumesTestJSON-1531590722-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/874c660d-237a-4da2-bf42-04ec8b5a527a" status: 200 len: 350 microversion: 2.1 time: 0.167183 Oct 10 23:30:46.593942 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1703/3320] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:30:46 2022] GET /compute/v2.1/os-volumes/874c660d-237a-4da2-bf42-04ec8b5a527a => generated 350 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:46.738975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b6f0f5ca-fa4b-4052-8d2a-996554791cdc tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:46.752715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b6f0f5ca-fa4b-4052-8d2a-996554791cdc tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:46.756735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b6f0f5ca-fa4b-4052-8d2a-996554791cdc tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Searching by: {'deleted': False, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:30:46.768084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6f0f5ca-fa4b-4052-8d2a-996554791cdc tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:46.769112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6f0f5ca-fa4b-4052-8d2a-996554791cdc tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:46.770438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6f0f5ca-fa4b-4052-8d2a-996554791cdc tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:46.772172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6f0f5ca-fa4b-4052-8d2a-996554791cdc tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:46.773148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6f0f5ca-fa4b-4052-8d2a-996554791cdc tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:46.774132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6f0f5ca-fa4b-4052-8d2a-996554791cdc tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:46.867385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.multi_cell_list [None req-b6f0f5ca-fa4b-4052-8d2a-996554791cdc tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:30:46.949584 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b6f0f5ca-fa4b-4052-8d2a-996554791cdc tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.221108 Oct 10 23:30:46.950851 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1618/3321] 10.222.0.23 () {58 vars in 1125 bytes} [Mon Oct 10 23:30:46 2022] GET /compute/v2.1/servers => generated 339 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:46.967247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0ac402ee-2c46-42fd-9db9-83cfd64db9bb tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:46.987922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0ac402ee-2c46-42fd-9db9-83cfd64db9bb tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:46.989161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0ac402ee-2c46-42fd-9db9-83cfd64db9bb tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Searching by: {'deleted': False, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f'} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:30:47.035715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ac402ee-2c46-42fd-9db9-83cfd64db9bb tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:47.036383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ac402ee-2c46-42fd-9db9-83cfd64db9bb tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:47.038177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ac402ee-2c46-42fd-9db9-83cfd64db9bb tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:47.039843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ac402ee-2c46-42fd-9db9-83cfd64db9bb tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:47.041705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ac402ee-2c46-42fd-9db9-83cfd64db9bb tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:47.042815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ac402ee-2c46-42fd-9db9-83cfd64db9bb tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:47.060065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ed392ba0-0d66-43e2-b8be-38e425bcf8d0 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:47.061174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ed392ba0-0d66-43e2-b8be-38e425bcf8d0 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:47.076385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed392ba0-0d66-43e2-b8be-38e425bcf8d0 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:47.077439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed392ba0-0d66-43e2-b8be-38e425bcf8d0 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:47.078119 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed392ba0-0d66-43e2-b8be-38e425bcf8d0 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:47.079547 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed392ba0-0d66-43e2-b8be-38e425bcf8d0 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:47.080226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed392ba0-0d66-43e2-b8be-38e425bcf8d0 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:47.080810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed392ba0-0d66-43e2-b8be-38e425bcf8d0 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:47.161324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.multi_cell_list [None req-0ac402ee-2c46-42fd-9db9-83cfd64db9bb tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120613) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:30:47.254372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0ac402ee-2c46-42fd-9db9-83cfd64db9bb tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:47.279891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ac402ee-2c46-42fd-9db9-83cfd64db9bb tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:47.282384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ac402ee-2c46-42fd-9db9-83cfd64db9bb tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:47.284903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ac402ee-2c46-42fd-9db9-83cfd64db9bb tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:48.529319 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0ac402ee-2c46-42fd-9db9-83cfd64db9bb tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 1.567713 Oct 10 23:30:48.530431 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1704/3322] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:30:46 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:48.574113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7c96e9fa-7f3a-4203-ab57-004e8bdd668c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:48.577892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7c96e9fa-7f3a-4203-ab57-004e8bdd668c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:48.585340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ed392ba0-0d66-43e2-b8be-38e425bcf8d0 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11332bdf6b5242039d183f5bc6a04058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a439cf381d4136b8e1fb454adcfc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:48.599891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:30:48.604078 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ed392ba0-0d66-43e2-b8be-38e425bcf8d0 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] 10.222.0.23 "GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971" status: 200 len: 1314 microversion: 2.1 time: 1.550561 Oct 10 23:30:48.604944 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1619/3323] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:47 2022] GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971 => generated 1314 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:30:48.620566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e7075da8-35fc-495e-8f88-e608f1339da2 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:48.626729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c96e9fa-7f3a-4203-ab57-004e8bdd668c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:48.627238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c96e9fa-7f3a-4203-ab57-004e8bdd668c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:48.627900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c96e9fa-7f3a-4203-ab57-004e8bdd668c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:48.628993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c96e9fa-7f3a-4203-ab57-004e8bdd668c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:48.635969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c96e9fa-7f3a-4203-ab57-004e8bdd668c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:48.636741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c96e9fa-7f3a-4203-ab57-004e8bdd668c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:48.649204 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e7075da8-35fc-495e-8f88-e608f1339da2 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.042649 Oct 10 23:30:48.650240 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1620/3324] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:30:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:48.764194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7c96e9fa-7f3a-4203-ab57-004e8bdd668c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:48.773253 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7c96e9fa-7f3a-4203-ab57-004e8bdd668c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1275 microversion: 2.1 time: 0.234334 Oct 10 23:30:48.779326 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1705/3325] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:48 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 1275 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:49.005569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fe92e28f-8395-4658-89ce-eebd456d0a01 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:49.007193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fe92e28f-8395-4658-89ce-eebd456d0a01 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:49.028223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe92e28f-8395-4658-89ce-eebd456d0a01 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:49.029725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe92e28f-8395-4658-89ce-eebd456d0a01 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:49.030419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe92e28f-8395-4658-89ce-eebd456d0a01 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:49.031479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe92e28f-8395-4658-89ce-eebd456d0a01 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:49.032095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe92e28f-8395-4658-89ce-eebd456d0a01 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:49.032857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe92e28f-8395-4658-89ce-eebd456d0a01 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:49.130244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fe92e28f-8395-4658-89ce-eebd456d0a01 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:30:49.596375 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fe92e28f-8395-4658-89ce-eebd456d0a01 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "DELETE /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 204 len: 0 microversion: 2.1 time: 0.596003 Oct 10 23:30:49.606209 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1621/3326] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:30:48 2022] DELETE /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 0 bytes in 609 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 23:30:49.619151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ce2ee433-b246-4327-a94a-d002b908a39a tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:49.622480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ce2ee433-b246-4327-a94a-d002b908a39a tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:49.642099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-32cc2021-2c31-48fb-83d2-1f7f30a3f60b tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:49.643261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-32cc2021-2c31-48fb-83d2-1f7f30a3f60b tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:49.659414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32cc2021-2c31-48fb-83d2-1f7f30a3f60b tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:49.659936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32cc2021-2c31-48fb-83d2-1f7f30a3f60b tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:49.660418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32cc2021-2c31-48fb-83d2-1f7f30a3f60b tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:49.661334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32cc2021-2c31-48fb-83d2-1f7f30a3f60b tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:49.668801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32cc2021-2c31-48fb-83d2-1f7f30a3f60b tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:49.674511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32cc2021-2c31-48fb-83d2-1f7f30a3f60b tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:49.719027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce2ee433-b246-4327-a94a-d002b908a39a tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:49.722558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce2ee433-b246-4327-a94a-d002b908a39a tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:49.724425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce2ee433-b246-4327-a94a-d002b908a39a tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:49.737617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce2ee433-b246-4327-a94a-d002b908a39a tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:49.738251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce2ee433-b246-4327-a94a-d002b908a39a tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:49.746233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce2ee433-b246-4327-a94a-d002b908a39a tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:50.639476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-32cc2021-2c31-48fb-83d2-1f7f30a3f60b tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11332bdf6b5242039d183f5bc6a04058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a439cf381d4136b8e1fb454adcfc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:50.655053 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-32cc2021-2c31-48fb-83d2-1f7f30a3f60b tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] 10.222.0.23 "GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971" status: 200 len: 1314 microversion: 2.1 time: 1.022913 Oct 10 23:30:50.675103 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1622/3327] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:49 2022] GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971 => generated 1314 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:50.686927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a0dd40b8-df21-424d-89a5-c259cc77accc tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:50.690503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a0dd40b8-df21-424d-89a5-c259cc77accc tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:50.711029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a0dd40b8-df21-424d-89a5-c259cc77accc tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:50.711538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a0dd40b8-df21-424d-89a5-c259cc77accc tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:50.712111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a0dd40b8-df21-424d-89a5-c259cc77accc tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:50.716759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a0dd40b8-df21-424d-89a5-c259cc77accc tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:50.717050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a0dd40b8-df21-424d-89a5-c259cc77accc tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:50.721193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a0dd40b8-df21-424d-89a5-c259cc77accc tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:51.001077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ce2ee433-b246-4327-a94a-d002b908a39a tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:51.031683 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ce2ee433-b246-4327-a94a-d002b908a39a tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1714 microversion: 2.1 time: 1.418217 Oct 10 23:30:51.062540 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1706/3328] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:49 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1714 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:51.077836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-277dfd53-854c-4cfb-980f-148a50489894 req-f18c9dde-8445-444b-80f6-ee470d370a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32e4a909-58d8-4585-8e6d-f7902e620971", "name": "network-vif-plugged", "status": "completed", "tag": "04e02de1-5580-458f-aae1-c3664bcffb65"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:30:51.095392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-277dfd53-854c-4cfb-980f-148a50489894 req-f18c9dde-8445-444b-80f6-ee470d370a02 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:51.095901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-277dfd53-854c-4cfb-980f-148a50489894 req-f18c9dde-8445-444b-80f6-ee470d370a02 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:51.096465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-277dfd53-854c-4cfb-980f-148a50489894 req-f18c9dde-8445-444b-80f6-ee470d370a02 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:51.120707 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-277dfd53-854c-4cfb-980f-148a50489894 req-f18c9dde-8445-444b-80f6-ee470d370a02 service nova] Creating event network-vif-plugged:04e02de1-5580-458f-aae1-c3664bcffb65 for instance 32e4a909-58d8-4585-8e6d-f7902e620971 on n-h1-860864-2 Oct 10 23:30:51.130407 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-277dfd53-854c-4cfb-980f-148a50489894 req-f18c9dde-8445-444b-80f6-ee470d370a02 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065654 Oct 10 23:30:51.131518 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1707/3329] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:51.138970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-19b170f2-c1d3-4567-afb1-c9e3e46ba99d tempest-VolumesTestJSON-1531590722 tempest-VolumesTestJSON-1531590722-project] Calling method '.version_select at 0x7f66339c9940>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:51.277432 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-19b170f2-c1d3-4567-afb1-c9e3e46ba99d tempest-VolumesTestJSON-1531590722 tempest-VolumesTestJSON-1531590722-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ca8a7e51-c7f0-41f0-bbfa-87fb64c2bda8" status: 200 len: 351 microversion: 2.1 time: 0.144484 Oct 10 23:30:51.278976 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1708/3330] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:30:51 2022] GET /compute/v2.1/os-volumes/ca8a7e51-c7f0-41f0-bbfa-87fb64c2bda8 => generated 351 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:51.299625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-72c0ee01-4ffa-4269-bf14-b8e998b3389d tempest-VolumesTestJSON-1531590722 tempest-VolumesTestJSON-1531590722-project] Calling method '.version_select at 0x7f662b0353a0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:51.428778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a0dd40b8-df21-424d-89a5-c259cc77accc tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:51.441983 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a0dd40b8-df21-424d-89a5-c259cc77accc tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1317 microversion: 2.1 time: 0.765503 Oct 10 23:30:51.445881 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1623/3331] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:50 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 1317 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:51.603354 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-72c0ee01-4ffa-4269-bf14-b8e998b3389d tempest-VolumesTestJSON-1531590722 tempest-VolumesTestJSON-1531590722-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.312374 Oct 10 23:30:51.605616 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1709/3332] 10.222.0.23 () {58 vars in 1134 bytes} [Mon Oct 10 23:30:51 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:51.626690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-db7c0648-94c7-4d02-b7ef-d65b8dfc4068 tempest-VolumesTestJSON-1531590722 tempest-VolumesTestJSON-1531590722-project] Calling method '.version_select at 0x7f662a4f65e0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:51.680104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1de5bb16-7797-4988-ac57-e5d99f3eed19 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:51.680761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1de5bb16-7797-4988-ac57-e5d99f3eed19 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:51.693842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1de5bb16-7797-4988-ac57-e5d99f3eed19 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:51.699849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1de5bb16-7797-4988-ac57-e5d99f3eed19 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:51.700399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1de5bb16-7797-4988-ac57-e5d99f3eed19 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:51.701182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1de5bb16-7797-4988-ac57-e5d99f3eed19 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:51.701700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1de5bb16-7797-4988-ac57-e5d99f3eed19 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:51.702282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1de5bb16-7797-4988-ac57-e5d99f3eed19 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:51.855088 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-db7c0648-94c7-4d02-b7ef-d65b8dfc4068 tempest-VolumesTestJSON-1531590722 tempest-VolumesTestJSON-1531590722-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.234959 Oct 10 23:30:51.867225 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1624/3333] 10.222.0.23 () {58 vars in 1149 bytes} [Mon Oct 10 23:30:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:51.876160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-86fd3aca-b265-46f7-bff4-d8737dbee748 tempest-VolumesTestJSON-1531590722 tempest-VolumesTestJSON-1531590722-project] Calling method '.version_select at 0x7f662a4efb80>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:52.006887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=16 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:30:52.095119 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-86fd3aca-b265-46f7-bff4-d8737dbee748 tempest-VolumesTestJSON-1531590722 tempest-VolumesTestJSON-1531590722-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.223653 Oct 10 23:30:52.106823 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1625/3334] 10.222.0.23 () {58 vars in 1134 bytes} [Mon Oct 10 23:30:51 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:52.119759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e5ef80ad-b854-4190-b399-10f76db10dda tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:52.120704 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e5ef80ad-b854-4190-b399-10f76db10dda tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:52.145273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5ef80ad-b854-4190-b399-10f76db10dda tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:52.146229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5ef80ad-b854-4190-b399-10f76db10dda tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:52.146676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5ef80ad-b854-4190-b399-10f76db10dda tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:52.147414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5ef80ad-b854-4190-b399-10f76db10dda tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:52.147873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5ef80ad-b854-4190-b399-10f76db10dda tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:52.148306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5ef80ad-b854-4190-b399-10f76db10dda tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:52.265113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1de5bb16-7797-4988-ac57-e5d99f3eed19 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11332bdf6b5242039d183f5bc6a04058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a439cf381d4136b8e1fb454adcfc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:52.279120 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1de5bb16-7797-4988-ac57-e5d99f3eed19 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] 10.222.0.23 "GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971" status: 200 len: 1314 microversion: 2.1 time: 0.602972 Oct 10 23:30:52.279773 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1710/3335] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:51 2022] GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971 => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:52.293408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7cd66156-8757-4c1f-8044-882511a49886 tempest-VolumesTestJSON-1531590722 tempest-VolumesTestJSON-1531590722-project] Calling method '.version_select at 0x7f662b0c6d30>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:52.506495 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7cd66156-8757-4c1f-8044-882511a49886 tempest-VolumesTestJSON-1531590722 tempest-VolumesTestJSON-1531590722-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.225102 Oct 10 23:30:52.508336 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1711/3336] 10.222.0.23 () {58 vars in 1167 bytes} [Mon Oct 10 23:30:52 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:52.519871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b8161fea-cc84-447f-b150-e607febf76cd tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:52.522757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b8161fea-cc84-447f-b150-e607febf76cd tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:52.542500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8161fea-cc84-447f-b150-e607febf76cd tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:52.543701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8161fea-cc84-447f-b150-e607febf76cd tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:52.545306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8161fea-cc84-447f-b150-e607febf76cd tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:52.547383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8161fea-cc84-447f-b150-e607febf76cd tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:52.548423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8161fea-cc84-447f-b150-e607febf76cd tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:52.549109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8161fea-cc84-447f-b150-e607febf76cd tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:52.913363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e5ef80ad-b854-4190-b399-10f76db10dda tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:52.926353 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e5ef80ad-b854-4190-b399-10f76db10dda tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1714 microversion: 2.1 time: 0.817957 Oct 10 23:30:52.927611 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1626/3337] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:52 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1714 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:52.951756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2eee53ff-9a5e-4d2d-8c6b-a7ea1e78d7e7 tempest-VolumesTestJSON-1531590722 tempest-VolumesTestJSON-1531590722-project] Calling method '.version_select at 0x7f6633ab1ca0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:53.012022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b8161fea-cc84-447f-b150-e607febf76cd tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:53.024061 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b8161fea-cc84-447f-b150-e607febf76cd tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1317 microversion: 2.1 time: 0.512741 Oct 10 23:30:53.027406 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1712/3338] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:52 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 1317 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:53.042675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-97ff0383-0261-4448-a101-6b42d9f8da6c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1784462658", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "2483d0ab-8d4b-46c0-980c-ee8388d20f66"}], "security_groups": [{"name": "tempest-securitygroup--69640422"}], "key_name": "tempest-keypair-355371435", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "c5acdac5-84ce-46ee-b8ff-48c9b3d3176e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:30:53.106014 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2eee53ff-9a5e-4d2d-8c6b-a7ea1e78d7e7 tempest-VolumesTestJSON-1531590722 tempest-VolumesTestJSON-1531590722-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.176868 Oct 10 23:30:53.106924 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1627/3339] 10.222.0.23 () {58 vars in 1170 bytes} [Mon Oct 10 23:30:52 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:53.122535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-656e9662-5e18-4335-81cf-9975cdfddaa8 tempest-VolumesTestJSON-1531590722 tempest-VolumesTestJSON-1531590722-project] Calling method '.version_select at 0x7f662a49c8b0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:53.261055 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-656e9662-5e18-4335-81cf-9975cdfddaa8 tempest-VolumesTestJSON-1531590722 tempest-VolumesTestJSON-1531590722-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.142599 Oct 10 23:30:53.261920 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1628/3340] 10.222.0.23 () {58 vars in 1155 bytes} [Mon Oct 10 23:30:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:53.283570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5097195b-bd63-4918-8ecf-ca1204390ea4 tempest-VolumesTestJSON-1531590722 tempest-VolumesTestJSON-1531590722-project] Calling method '.version_select at 0x7f662a5f5e50>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:53.415903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-97ff0383-0261-4448-a101-6b42d9f8da6c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] validate_networks() for [('2483d0ab-8d4b-46c0-980c-ee8388d20f66', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:30:53.517058 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5097195b-bd63-4918-8ecf-ca1204390ea4 tempest-VolumesTestJSON-1531590722 tempest-VolumesTestJSON-1531590722-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.237923 Oct 10 23:30:53.518780 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1629/3341] 10.222.0.23 () {58 vars in 1188 bytes} [Mon Oct 10 23:30:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:30:53.526107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e03b4bda-1a3a-429a-9ebc-0d0b945838a6 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:53.527491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e03b4bda-1a3a-429a-9ebc-0d0b945838a6 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:53.542530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e03b4bda-1a3a-429a-9ebc-0d0b945838a6 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:53.543374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e03b4bda-1a3a-429a-9ebc-0d0b945838a6 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:53.544024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e03b4bda-1a3a-429a-9ebc-0d0b945838a6 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:53.545265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e03b4bda-1a3a-429a-9ebc-0d0b945838a6 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:53.545964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e03b4bda-1a3a-429a-9ebc-0d0b945838a6 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:53.547263 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e03b4bda-1a3a-429a-9ebc-0d0b945838a6 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:54.106792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-97ff0383-0261-4448-a101-6b42d9f8da6c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Getting quotas for project 94d503df54a645478e49e6bec5886fa7. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:30:54.126583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-97ff0383-0261-4448-a101-6b42d9f8da6c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Getting quotas for user 6434f96f22354c9186f98f1abfd45ad7 and project 94d503df54a645478e49e6bec5886fa7. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:30:54.144649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e03b4bda-1a3a-429a-9ebc-0d0b945838a6 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11332bdf6b5242039d183f5bc6a04058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a439cf381d4136b8e1fb454adcfc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:54.160316 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e03b4bda-1a3a-429a-9ebc-0d0b945838a6 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] 10.222.0.23 "GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971" status: 200 len: 1464 microversion: 2.1 time: 0.640056 Oct 10 23:30:54.160911 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1630/3342] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:53 2022] GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971 => generated 1464 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:54.165280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-97ff0383-0261-4448-a101-6b42d9f8da6c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:30:54.165955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-97ff0383-0261-4448-a101-6b42d9f8da6c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:30:54.166781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-97ff0383-0261-4448-a101-6b42d9f8da6c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:30:54.167455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-97ff0383-0261-4448-a101-6b42d9f8da6c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:30:54.168121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-97ff0383-0261-4448-a101-6b42d9f8da6c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:30:54.169760 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0b4b8f8c-5a0d-45d0-95ff-fcf6a19885b9 tempest-VolumesTestJSON-1531590722 tempest-VolumesTestJSON-1531590722-project] Calling method '.version_select at 0x7f662a5f5550>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:54.180463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97ff0383-0261-4448-a101-6b42d9f8da6c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:54.182384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97ff0383-0261-4448-a101-6b42d9f8da6c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:54.183375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97ff0383-0261-4448-a101-6b42d9f8da6c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:54.184533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97ff0383-0261-4448-a101-6b42d9f8da6c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:54.185225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97ff0383-0261-4448-a101-6b42d9f8da6c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:54.186238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97ff0383-0261-4448-a101-6b42d9f8da6c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:54.266221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-97ff0383-0261-4448-a101-6b42d9f8da6c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Getting quotas for project 94d503df54a645478e49e6bec5886fa7. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:30:54.286962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-97ff0383-0261-4448-a101-6b42d9f8da6c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Getting quotas for user 6434f96f22354c9186f98f1abfd45ad7 and project 94d503df54a645478e49e6bec5886fa7. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:30:54.480616 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0b4b8f8c-5a0d-45d0-95ff-fcf6a19885b9 tempest-VolumesTestJSON-1531590722 tempest-VolumesTestJSON-1531590722-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.317353 Oct 10 23:30:54.481421 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1631/3343] 10.222.0.23 () {58 vars in 1155 bytes} [Mon Oct 10 23:30:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:54.509127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-97ff0383-0261-4448-a101-6b42d9f8da6c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:30:54.515055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-97ff0383-0261-4448-a101-6b42d9f8da6c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c5acdac5-84ce-46ee-b8ff-48c9b3d3176e',volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:30:54.515311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a7a643e0-8371-4836-b554-efd02697aa5f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:54.515985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a7a643e0-8371-4836-b554-efd02697aa5f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:54.561292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7a643e0-8371-4836-b554-efd02697aa5f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:54.565452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7a643e0-8371-4836-b554-efd02697aa5f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:54.579123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7a643e0-8371-4836-b554-efd02697aa5f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:54.581693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7a643e0-8371-4836-b554-efd02697aa5f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:54.582771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7a643e0-8371-4836-b554-efd02697aa5f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:54.584038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7a643e0-8371-4836-b554-efd02697aa5f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:54.998685 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-97ff0383-0261-4448-a101-6b42d9f8da6c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.969831 Oct 10 23:30:55.000251 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1713/3344] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:30:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 1972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:30:55.008449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-59cf3c5a-72bc-40a8-82cb-552d39d89573 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:55.012549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-59cf3c5a-72bc-40a8-82cb-552d39d89573 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:55.036708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59cf3c5a-72bc-40a8-82cb-552d39d89573 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:55.038303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59cf3c5a-72bc-40a8-82cb-552d39d89573 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:55.039625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59cf3c5a-72bc-40a8-82cb-552d39d89573 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:55.041305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59cf3c5a-72bc-40a8-82cb-552d39d89573 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:55.045614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59cf3c5a-72bc-40a8-82cb-552d39d89573 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:55.046839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59cf3c5a-72bc-40a8-82cb-552d39d89573 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:56.156000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-59cf3c5a-72bc-40a8-82cb-552d39d89573 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:56.170945 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-59cf3c5a-72bc-40a8-82cb-552d39d89573 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1317 microversion: 2.1 time: 1.167810 Oct 10 23:30:56.173755 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1714/3345] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:55 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 1317 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:56.182663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-87bf9d04-8fae-475e-be7d-981745535d72 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:56.191147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-87bf9d04-8fae-475e-be7d-981745535d72 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:56.222924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87bf9d04-8fae-475e-be7d-981745535d72 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:56.230593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87bf9d04-8fae-475e-be7d-981745535d72 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:56.233688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87bf9d04-8fae-475e-be7d-981745535d72 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:56.234589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87bf9d04-8fae-475e-be7d-981745535d72 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:56.235188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87bf9d04-8fae-475e-be7d-981745535d72 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:56.237920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87bf9d04-8fae-475e-be7d-981745535d72 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:56.335873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-87bf9d04-8fae-475e-be7d-981745535d72 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:30:56.518650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:30:56.734728 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-87bf9d04-8fae-475e-be7d-981745535d72 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] 10.222.0.23 "DELETE /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971" status: 204 len: 0 microversion: 2.1 time: 0.558654 Oct 10 23:30:56.735656 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1715/3346] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:30:56 2022] DELETE /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:30:56.757276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fe73674d-9859-4853-9702-bab3d0233ec7 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:56.761211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fe73674d-9859-4853-9702-bab3d0233ec7 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:56.779245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe73674d-9859-4853-9702-bab3d0233ec7 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:56.779763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe73674d-9859-4853-9702-bab3d0233ec7 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:56.780198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe73674d-9859-4853-9702-bab3d0233ec7 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:56.780935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe73674d-9859-4853-9702-bab3d0233ec7 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:56.781490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe73674d-9859-4853-9702-bab3d0233ec7 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:56.781978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe73674d-9859-4853-9702-bab3d0233ec7 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:56.823372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:30:56.961472 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fe73674d-9859-4853-9702-bab3d0233ec7 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:56.976629 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fe73674d-9859-4853-9702-bab3d0233ec7 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1163 microversion: 2.1 time: 0.236794 Oct 10 23:30:56.976882 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1716/3347] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:56 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1163 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:56.989600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-922337a5-8290-4ed3-80e6-0073e145ef19 req-d91c209c-4e8b-4bc8-b1e0-cfdea04a589b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094e9aed-7746-4a4c-81d5-ccc6d6c3d74e", "name": "network-vif-unplugged", "status": "completed", "tag": "fb699f20-bd58-4051-be00-7bc3a1b04ec6"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:30:56.989917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a7a643e0-8371-4836-b554-efd02697aa5f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:57.007939 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a7a643e0-8371-4836-b554-efd02697aa5f tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1714 microversion: 2.1 time: 2.518655 Oct 10 23:30:57.013843 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1632/3348] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:54 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1714 bytes in 2531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:57.038129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-922337a5-8290-4ed3-80e6-0073e145ef19 req-d91c209c-4e8b-4bc8-b1e0-cfdea04a589b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:57.038867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-922337a5-8290-4ed3-80e6-0073e145ef19 req-d91c209c-4e8b-4bc8-b1e0-cfdea04a589b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:57.039381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-922337a5-8290-4ed3-80e6-0073e145ef19 req-d91c209c-4e8b-4bc8-b1e0-cfdea04a589b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:57.043389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-07324347-58f2-4328-8eea-be3dea5c951d tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:57.049560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-07324347-58f2-4328-8eea-be3dea5c951d tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:57.071334 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-922337a5-8290-4ed3-80e6-0073e145ef19 req-d91c209c-4e8b-4bc8-b1e0-cfdea04a589b service nova] Creating event network-vif-unplugged:fb699f20-bd58-4051-be00-7bc3a1b04ec6 for instance 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e on n-h1-860864-2 Oct 10 23:30:57.088388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07324347-58f2-4328-8eea-be3dea5c951d tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:57.088928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07324347-58f2-4328-8eea-be3dea5c951d tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:57.097398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07324347-58f2-4328-8eea-be3dea5c951d tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:57.101757 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-922337a5-8290-4ed3-80e6-0073e145ef19 req-d91c209c-4e8b-4bc8-b1e0-cfdea04a589b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122338 Oct 10 23:30:57.101972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07324347-58f2-4328-8eea-be3dea5c951d tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:57.102536 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1717/3349] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:57.127345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07324347-58f2-4328-8eea-be3dea5c951d tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:57.132453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07324347-58f2-4328-8eea-be3dea5c951d tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:57.203141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-54afaf48-adbe-44aa-977b-eb068cca0fc4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:57.204752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-54afaf48-adbe-44aa-977b-eb068cca0fc4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:57.242042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54afaf48-adbe-44aa-977b-eb068cca0fc4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:57.244569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54afaf48-adbe-44aa-977b-eb068cca0fc4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:57.245234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54afaf48-adbe-44aa-977b-eb068cca0fc4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:57.247168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54afaf48-adbe-44aa-977b-eb068cca0fc4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:57.251224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54afaf48-adbe-44aa-977b-eb068cca0fc4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:57.252927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54afaf48-adbe-44aa-977b-eb068cca0fc4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:57.885086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-54afaf48-adbe-44aa-977b-eb068cca0fc4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:57.910827 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-54afaf48-adbe-44aa-977b-eb068cca0fc4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1317 microversion: 2.1 time: 0.711099 Oct 10 23:30:57.912000 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1718/3350] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:57 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 1317 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:57.928111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-6267ae69-b374-4cd8-9d08-75d67c193430 req-38714c42-3337-47d5-b66d-e2f05ea726c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "430a8e18-4033-498b-8cf3-a224786b7363", "tag": "a2e7d038-4684-44fd-a359-4f01f2732cbf"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:30:57.969989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6267ae69-b374-4cd8-9d08-75d67c193430 req-38714c42-3337-47d5-b66d-e2f05ea726c3 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:57.971048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6267ae69-b374-4cd8-9d08-75d67c193430 req-38714c42-3337-47d5-b66d-e2f05ea726c3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:57.972628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6267ae69-b374-4cd8-9d08-75d67c193430 req-38714c42-3337-47d5-b66d-e2f05ea726c3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:58.015801 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-6267ae69-b374-4cd8-9d08-75d67c193430 req-38714c42-3337-47d5-b66d-e2f05ea726c3 service nova] Creating event network-changed:a2e7d038-4684-44fd-a359-4f01f2732cbf for instance 430a8e18-4033-498b-8cf3-a224786b7363 on n-h2-860864-2 Oct 10 23:30:58.069356 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-6267ae69-b374-4cd8-9d08-75d67c193430 req-38714c42-3337-47d5-b66d-e2f05ea726c3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113777 Oct 10 23:30:58.080899 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1719/3351] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:30:58.104698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c09108f1-a234-4432-915d-738d843b9289 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:58.114622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c09108f1-a234-4432-915d-738d843b9289 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:58.154885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c09108f1-a234-4432-915d-738d843b9289 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:58.155615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c09108f1-a234-4432-915d-738d843b9289 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:58.157180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c09108f1-a234-4432-915d-738d843b9289 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:58.158051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c09108f1-a234-4432-915d-738d843b9289 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:58.162945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c09108f1-a234-4432-915d-738d843b9289 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:58.167686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c09108f1-a234-4432-915d-738d843b9289 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:58.502752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c09108f1-a234-4432-915d-738d843b9289 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:58.534502 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c09108f1-a234-4432-915d-738d843b9289 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1219 microversion: 2.1 time: 0.450316 Oct 10 23:30:58.545088 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1720/3352] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:58 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1219 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:58.572896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8e4f99f5-4b71-411c-8187-042c9a3ab173 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:58.577865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8e4f99f5-4b71-411c-8187-042c9a3ab173 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:58.620902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e4f99f5-4b71-411c-8187-042c9a3ab173 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:58.621846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e4f99f5-4b71-411c-8187-042c9a3ab173 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:58.625292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e4f99f5-4b71-411c-8187-042c9a3ab173 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:58.645530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e4f99f5-4b71-411c-8187-042c9a3ab173 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:58.647686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e4f99f5-4b71-411c-8187-042c9a3ab173 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:58.648356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e4f99f5-4b71-411c-8187-042c9a3ab173 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:58.816055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-07324347-58f2-4328-8eea-be3dea5c951d tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11332bdf6b5242039d183f5bc6a04058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a439cf381d4136b8e1fb454adcfc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:30:58.832905 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-07324347-58f2-4328-8eea-be3dea5c951d tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] 10.222.0.23 "GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971" status: 200 len: 1470 microversion: 2.1 time: 1.814382 Oct 10 23:30:58.835235 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1633/3353] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:57 2022] GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971 => generated 1470 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:30:58.936320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c95dbde6-85f5-4433-b4f2-fe27d9bea042 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:30:58.937347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c95dbde6-85f5-4433-b4f2-fe27d9bea042 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:30:58.949101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c95dbde6-85f5-4433-b4f2-fe27d9bea042 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:58.950266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c95dbde6-85f5-4433-b4f2-fe27d9bea042 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:58.952248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c95dbde6-85f5-4433-b4f2-fe27d9bea042 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:30:58.954573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c95dbde6-85f5-4433-b4f2-fe27d9bea042 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:30:58.956274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c95dbde6-85f5-4433-b4f2-fe27d9bea042 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:30:58.957995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c95dbde6-85f5-4433-b4f2-fe27d9bea042 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:00.648354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8e4f99f5-4b71-411c-8187-042c9a3ab173 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:00.675123 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8e4f99f5-4b71-411c-8187-042c9a3ab173 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1646 microversion: 2.1 time: 2.125908 Oct 10 23:31:00.678088 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1721/3354] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:58 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1646 bytes in 2132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:00.705478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d458f143-ef32-4076-8234-403ed40e7140 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:00.709733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d458f143-ef32-4076-8234-403ed40e7140 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:00.746511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d458f143-ef32-4076-8234-403ed40e7140 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:00.747025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d458f143-ef32-4076-8234-403ed40e7140 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:00.748263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d458f143-ef32-4076-8234-403ed40e7140 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:00.749623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d458f143-ef32-4076-8234-403ed40e7140 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:00.755440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d458f143-ef32-4076-8234-403ed40e7140 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:00.755955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d458f143-ef32-4076-8234-403ed40e7140 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:01.074679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d458f143-ef32-4076-8234-403ed40e7140 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:01.091626 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d458f143-ef32-4076-8234-403ed40e7140 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1237 microversion: 2.1 time: 0.410995 Oct 10 23:31:01.105171 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1722/3355] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:00 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1237 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:01.126679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-827ac0d2-1483-4a8f-b626-bc8630567463 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:01.127417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-827ac0d2-1483-4a8f-b626-bc8630567463 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:01.143856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-827ac0d2-1483-4a8f-b626-bc8630567463 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:01.146678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-827ac0d2-1483-4a8f-b626-bc8630567463 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:01.147438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-827ac0d2-1483-4a8f-b626-bc8630567463 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:01.148414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-827ac0d2-1483-4a8f-b626-bc8630567463 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:01.150578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-827ac0d2-1483-4a8f-b626-bc8630567463 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:01.151459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-827ac0d2-1483-4a8f-b626-bc8630567463 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:01.582183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-827ac0d2-1483-4a8f-b626-bc8630567463 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11332bdf6b5242039d183f5bc6a04058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a439cf381d4136b8e1fb454adcfc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:01.603969 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-827ac0d2-1483-4a8f-b626-bc8630567463 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] 10.222.0.23 "GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971" status: 200 len: 1470 microversion: 2.1 time: 0.494858 Oct 10 23:31:01.608301 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1723/3356] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:01 2022] GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971 => generated 1470 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:01.632267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-3af5d3cd-a3a9-42d7-8c17-45448893f721 req-d90b2858-3fe6-4175-a481-c6d6b08e3301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "037ebfb5-534f-42db-9838-462de4b299e1", "tag": "0945733a-182f-4aab-9346-e59fa6b3c813"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:31:01.657606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c95dbde6-85f5-4433-b4f2-fe27d9bea042 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:01.668158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3af5d3cd-a3a9-42d7-8c17-45448893f721 req-d90b2858-3fe6-4175-a481-c6d6b08e3301 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:01.668762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3af5d3cd-a3a9-42d7-8c17-45448893f721 req-d90b2858-3fe6-4175-a481-c6d6b08e3301 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:01.669173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3af5d3cd-a3a9-42d7-8c17-45448893f721 req-d90b2858-3fe6-4175-a481-c6d6b08e3301 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:01.682658 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c95dbde6-85f5-4433-b4f2-fe27d9bea042 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1317 microversion: 2.1 time: 2.743349 Oct 10 23:31:01.694609 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1634/3357] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:30:58 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 1317 bytes in 2763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:01.717053 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-3af5d3cd-a3a9-42d7-8c17-45448893f721 req-d90b2858-3fe6-4175-a481-c6d6b08e3301 service nova] Creating event network-changed:0945733a-182f-4aab-9346-e59fa6b3c813 for instance 037ebfb5-534f-42db-9838-462de4b299e1 on n-h2-860864-2 Oct 10 23:31:01.725786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-63618e76-4c10-4c64-a39a-3044bcf5b7e4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:01.735879 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-3af5d3cd-a3a9-42d7-8c17-45448893f721 req-d90b2858-3fe6-4175-a481-c6d6b08e3301 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125855 Oct 10 23:31:01.737241 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1724/3358] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:31:01.737623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-63618e76-4c10-4c64-a39a-3044bcf5b7e4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:01.761413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63618e76-4c10-4c64-a39a-3044bcf5b7e4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:01.762210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63618e76-4c10-4c64-a39a-3044bcf5b7e4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:01.762949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63618e76-4c10-4c64-a39a-3044bcf5b7e4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:01.764155 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63618e76-4c10-4c64-a39a-3044bcf5b7e4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:01.782523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63618e76-4c10-4c64-a39a-3044bcf5b7e4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:01.787295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63618e76-4c10-4c64-a39a-3044bcf5b7e4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:02.124010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-567fa32a-87a6-4fe3-a6f2-3a6dd8831f26 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:02.124982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-567fa32a-87a6-4fe3-a6f2-3a6dd8831f26 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:02.147963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-567fa32a-87a6-4fe3-a6f2-3a6dd8831f26 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:02.154012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-567fa32a-87a6-4fe3-a6f2-3a6dd8831f26 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:02.156149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-567fa32a-87a6-4fe3-a6f2-3a6dd8831f26 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:02.157138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-567fa32a-87a6-4fe3-a6f2-3a6dd8831f26 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:02.160448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-567fa32a-87a6-4fe3-a6f2-3a6dd8831f26 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:02.161162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-567fa32a-87a6-4fe3-a6f2-3a6dd8831f26 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:02.404671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-63618e76-4c10-4c64-a39a-3044bcf5b7e4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:02.492613 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-63618e76-4c10-4c64-a39a-3044bcf5b7e4 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1646 microversion: 2.1 time: 0.785467 Oct 10 23:31:02.526720 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1635/3359] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:01 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1646 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:02.585819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-567fa32a-87a6-4fe3-a6f2-3a6dd8831f26 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:02.598878 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-567fa32a-87a6-4fe3-a6f2-3a6dd8831f26 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1237 microversion: 2.1 time: 0.479681 Oct 10 23:31:02.615578 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1725/3360] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:02 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1237 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:02.645319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a3a62a3f-776a-425e-9701-5234168bfa9f tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:02.650725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a3a62a3f-776a-425e-9701-5234168bfa9f tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:02.673413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3a62a3f-776a-425e-9701-5234168bfa9f tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:02.674098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3a62a3f-776a-425e-9701-5234168bfa9f tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:02.674386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3a62a3f-776a-425e-9701-5234168bfa9f tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:02.675129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3a62a3f-776a-425e-9701-5234168bfa9f tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:02.675593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3a62a3f-776a-425e-9701-5234168bfa9f tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:02.676022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3a62a3f-776a-425e-9701-5234168bfa9f tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:02.720349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-42f72b21-caad-4084-80d7-c538ed439788 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:02.721019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-42f72b21-caad-4084-80d7-c538ed439788 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:02.748628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42f72b21-caad-4084-80d7-c538ed439788 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:02.749131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42f72b21-caad-4084-80d7-c538ed439788 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:02.796641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42f72b21-caad-4084-80d7-c538ed439788 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:02.800192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42f72b21-caad-4084-80d7-c538ed439788 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:02.800750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42f72b21-caad-4084-80d7-c538ed439788 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:02.803047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42f72b21-caad-4084-80d7-c538ed439788 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:03.626493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a3a62a3f-776a-425e-9701-5234168bfa9f tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11332bdf6b5242039d183f5bc6a04058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a439cf381d4136b8e1fb454adcfc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:03.651674 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a3a62a3f-776a-425e-9701-5234168bfa9f tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] 10.222.0.23 "GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971" status: 200 len: 1428 microversion: 2.1 time: 1.011149 Oct 10 23:31:03.675576 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1636/3361] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:02 2022] GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971 => generated 1428 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:03.740571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b45d6155-7b02-4e96-b273-303f8c2a653a tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:03.744312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b45d6155-7b02-4e96-b273-303f8c2a653a tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:03.765574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b45d6155-7b02-4e96-b273-303f8c2a653a tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:03.766728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b45d6155-7b02-4e96-b273-303f8c2a653a tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:03.768813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b45d6155-7b02-4e96-b273-303f8c2a653a tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:03.771979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b45d6155-7b02-4e96-b273-303f8c2a653a tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:03.773944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b45d6155-7b02-4e96-b273-303f8c2a653a tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:03.790489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b45d6155-7b02-4e96-b273-303f8c2a653a tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:03.915104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-42f72b21-caad-4084-80d7-c538ed439788 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:03.939031 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-42f72b21-caad-4084-80d7-c538ed439788 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1317 microversion: 2.1 time: 1.223509 Oct 10 23:31:03.963418 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1726/3362] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:02 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 1317 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:03.991993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bc851df5-2951-4be5-962b-b18d8ad9304c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:03.992622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bc851df5-2951-4be5-962b-b18d8ad9304c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:04.062381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc851df5-2951-4be5-962b-b18d8ad9304c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:04.062381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc851df5-2951-4be5-962b-b18d8ad9304c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:04.062381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc851df5-2951-4be5-962b-b18d8ad9304c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:04.062381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc851df5-2951-4be5-962b-b18d8ad9304c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:04.062381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc851df5-2951-4be5-962b-b18d8ad9304c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:04.062381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc851df5-2951-4be5-962b-b18d8ad9304c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:04.228335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:31:04.319555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=12 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:31:04.415456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bc851df5-2951-4be5-962b-b18d8ad9304c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:04.435906 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bc851df5-2951-4be5-962b-b18d8ad9304c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1237 microversion: 2.1 time: 0.467597 Oct 10 23:31:04.441186 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1727/3363] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:03 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1237 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:04.488361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-f9135c3a-1c87-433e-8479-68678f4a337b req-ec049503-4dd0-41a6-a423-5bd662c179a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32e4a909-58d8-4585-8e6d-f7902e620971", "name": "network-vif-deleted", "tag": "04e02de1-5580-458f-aae1-c3664bcffb65"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:31:04.519536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f9135c3a-1c87-433e-8479-68678f4a337b req-ec049503-4dd0-41a6-a423-5bd662c179a6 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:04.531796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f9135c3a-1c87-433e-8479-68678f4a337b req-ec049503-4dd0-41a6-a423-5bd662c179a6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:04.534381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f9135c3a-1c87-433e-8479-68678f4a337b req-ec049503-4dd0-41a6-a423-5bd662c179a6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:04.567390 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-f9135c3a-1c87-433e-8479-68678f4a337b req-ec049503-4dd0-41a6-a423-5bd662c179a6 service nova] Creating event network-vif-deleted:04e02de1-5580-458f-aae1-c3664bcffb65 for instance 32e4a909-58d8-4585-8e6d-f7902e620971 on n-h1-860864-2 Oct 10 23:31:04.577757 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-f9135c3a-1c87-433e-8479-68678f4a337b req-ec049503-4dd0-41a6-a423-5bd662c179a6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134830 Oct 10 23:31:04.580464 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1728/3364] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:31:04.583636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b45d6155-7b02-4e96-b273-303f8c2a653a tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:04.613785 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b45d6155-7b02-4e96-b273-303f8c2a653a tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1646 microversion: 2.1 time: 0.934384 Oct 10 23:31:04.639745 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1637/3365] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:03 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1646 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:04.696525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-feca2524-30f3-4463-acaa-07c0bdde7e55 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:04.697420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-feca2524-30f3-4463-acaa-07c0bdde7e55 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:04.710882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-feca2524-30f3-4463-acaa-07c0bdde7e55 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:04.718122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-feca2524-30f3-4463-acaa-07c0bdde7e55 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:04.729593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-feca2524-30f3-4463-acaa-07c0bdde7e55 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:04.748215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-feca2524-30f3-4463-acaa-07c0bdde7e55 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:04.749945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-feca2524-30f3-4463-acaa-07c0bdde7e55 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:04.751497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-feca2524-30f3-4463-acaa-07c0bdde7e55 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:04.973481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-feca2524-30f3-4463-acaa-07c0bdde7e55 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:04.977447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-feca2524-30f3-4463-acaa-07c0bdde7e55 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:04.986430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-feca2524-30f3-4463-acaa-07c0bdde7e55 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:04.987480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-feca2524-30f3-4463-acaa-07c0bdde7e55 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lazy-loading 'fault' on Instance uuid 32e4a909-58d8-4585-8e6d-f7902e620971 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:31:04.992773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c65be210-099d-4b9f-948b-a43371015ba7 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:04.996371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c65be210-099d-4b9f-948b-a43371015ba7 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:05.005150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c65be210-099d-4b9f-948b-a43371015ba7 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:05.006046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c65be210-099d-4b9f-948b-a43371015ba7 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:05.006727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c65be210-099d-4b9f-948b-a43371015ba7 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:05.007687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c65be210-099d-4b9f-948b-a43371015ba7 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:05.008371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c65be210-099d-4b9f-948b-a43371015ba7 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:05.009203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c65be210-099d-4b9f-948b-a43371015ba7 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:05.296796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-feca2524-30f3-4463-acaa-07c0bdde7e55 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11332bdf6b5242039d183f5bc6a04058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a439cf381d4136b8e1fb454adcfc8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:05.311865 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-feca2524-30f3-4463-acaa-07c0bdde7e55 tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] 10.222.0.23 "GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971" status: 200 len: 1304 microversion: 2.1 time: 0.620550 Oct 10 23:31:05.312471 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1729/3366] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:04 2022] GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971 => generated 1304 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:05.468294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e56b3bcc-1986-4d4e-85dc-fae2ce2fc05a tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:05.469552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e56b3bcc-1986-4d4e-85dc-fae2ce2fc05a tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:05.486060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e56b3bcc-1986-4d4e-85dc-fae2ce2fc05a tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:05.492730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e56b3bcc-1986-4d4e-85dc-fae2ce2fc05a tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:05.495086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e56b3bcc-1986-4d4e-85dc-fae2ce2fc05a tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:05.498679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e56b3bcc-1986-4d4e-85dc-fae2ce2fc05a tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:05.505127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e56b3bcc-1986-4d4e-85dc-fae2ce2fc05a tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:05.506473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e56b3bcc-1986-4d4e-85dc-fae2ce2fc05a tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:06.025223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c65be210-099d-4b9f-948b-a43371015ba7 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:06.068321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:31:06.138377 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c65be210-099d-4b9f-948b-a43371015ba7 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1317 microversion: 2.1 time: 1.149839 Oct 10 23:31:06.145276 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1638/3367] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:04 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 1317 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:06.163883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cc6a1290-3f07-49cd-b400-547f287ca039 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:06.183284 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cc6a1290-3f07-49cd-b400-547f287ca039 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:06.223981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc6a1290-3f07-49cd-b400-547f287ca039 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:06.226548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc6a1290-3f07-49cd-b400-547f287ca039 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:06.228884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc6a1290-3f07-49cd-b400-547f287ca039 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:06.237811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc6a1290-3f07-49cd-b400-547f287ca039 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:06.239299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc6a1290-3f07-49cd-b400-547f287ca039 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:06.245715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc6a1290-3f07-49cd-b400-547f287ca039 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:06.462554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc6a1290-3f07-49cd-b400-547f287ca039 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:06.464599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc6a1290-3f07-49cd-b400-547f287ca039 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:06.465350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc6a1290-3f07-49cd-b400-547f287ca039 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:06.466364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-cc6a1290-3f07-49cd-b400-547f287ca039 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lazy-loading 'fault' on Instance uuid 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:31:06.904047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cc6a1290-3f07-49cd-b400-547f287ca039 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ccc95d3ba2d4250aecf432af338d7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89b626b3b5443d3ae614b95df86b60f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:06.927909 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cc6a1290-3f07-49cd-b400-547f287ca039 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 200 len: 1367 microversion: 2.1 time: 0.781110 Oct 10 23:31:06.944603 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1639/3368] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:06 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 1367 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:06.984879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-047d9c8e-10c0-4243-a8b9-7b67db28fddd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:06.995799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-047d9c8e-10c0-4243-a8b9-7b67db28fddd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] [instance: 32e4a909-58d8-4585-8e6d-f7902e620971] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:07.034375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e56b3bcc-1986-4d4e-85dc-fae2ce2fc05a tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:07.051170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-047d9c8e-10c0-4243-a8b9-7b67db28fddd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:07.060181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-047d9c8e-10c0-4243-a8b9-7b67db28fddd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:07.066482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-047d9c8e-10c0-4243-a8b9-7b67db28fddd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:07.067893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-047d9c8e-10c0-4243-a8b9-7b67db28fddd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:07.074176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-047d9c8e-10c0-4243-a8b9-7b67db28fddd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:07.080445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-047d9c8e-10c0-4243-a8b9-7b67db28fddd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:07.084542 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e56b3bcc-1986-4d4e-85dc-fae2ce2fc05a tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1303 microversion: 2.1 time: 1.621620 Oct 10 23:31:07.109582 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1730/3369] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:05 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1303 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:07.147055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-9c1c75cb-3464-4a0f-8d17-c25e4a4ed9bb req-40b79e4d-df7e-49f9-8bec-555546e28b54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094e9aed-7746-4a4c-81d5-ccc6d6c3d74e", "name": "network-vif-deleted", "tag": "fb699f20-bd58-4051-be00-7bc3a1b04ec6"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:31:07.182447 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-047d9c8e-10c0-4243-a8b9-7b67db28fddd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] HTTP exception thrown: Instance 32e4a909-58d8-4585-8e6d-f7902e620971 could not be found. Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-047d9c8e-10c0-4243-a8b9-7b67db28fddd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Request method failure captured: Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971 HTTP/1.1 Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKsLNZU4h3rwe-K8bfDcx5qAaaeExOEVNyPcCXdO8mHw15MTpGz4dNbG9e2OdccO74AG8Mp4VVfUxIzoc5SxhGHR9G3so3ZnJ2kr4ihs0-MACE95tWBcpgVCx8vToIn5fxVVqvTnAmczrkuuycI-HTBdNLHpbAP2iN_q-_lsXBEZ-V4 Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 01a439cf381d4136b8e1fb454adcfc8f Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-VolumesNegativeTest-900245127 Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/01a439cf381d4136b8e1fb454adcfc8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/01a439cf381d4136b8e1fb454adcfc8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/01a439cf381d4136b8e1fb454adcfc8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_01a439cf381d4136b8e1fb454adcfc8f", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-VolumesNegativeTest-900245127 Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 01a439cf381d4136b8e1fb454adcfc8f Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-VolumesNegativeTest-900245127 Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-VolumesNegativeTest-900245127-project Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 11332bdf6b5242039d183f5bc6a04058 Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-VolumesNegativeTest-900245127-project Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 32e4a909-58d8-4585-8e6d-f7902e620971 could not be found. Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '32e4a909-58d8-4585-8e6d-f7902e620971'} Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32e4a909-58d8-4585-8e6d-f7902e620971 could not be found. Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32e4a909-58d8-4585-8e6d-f7902e620971 could not be found. Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:31:07.228346 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:31:07.235098 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:31:07.235098 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:31:07.235098 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:31:07.235098 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:31:07.235098 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:31:07.235098 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32e4a909-58d8-4585-8e6d-f7902e620971 could not be found. Oct 10 23:31:07.235098 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:31:07.251315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-047d9c8e-10c0-4243-a8b9-7b67db28fddd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] Returning 404 to user: Instance 32e4a909-58d8-4585-8e6d-f7902e620971 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:31:07.252898 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-047d9c8e-10c0-4243-a8b9-7b67db28fddd tempest-VolumesNegativeTest-900245127 tempest-VolumesNegativeTest-900245127-project] 10.222.0.23 "GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971" status: 404 len: 111 microversion: 2.1 time: 0.305929 Oct 10 23:31:07.254263 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1640/3370] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:06 2022] GET /compute/v2.1/servers/32e4a909-58d8-4585-8e6d-f7902e620971 => generated 111 bytes in 309 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:31:07.260630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9c1c75cb-3464-4a0f-8d17-c25e4a4ed9bb req-40b79e4d-df7e-49f9-8bec-555546e28b54 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:07.263783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9c1c75cb-3464-4a0f-8d17-c25e4a4ed9bb req-40b79e4d-df7e-49f9-8bec-555546e28b54 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:07.265676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9c1c75cb-3464-4a0f-8d17-c25e4a4ed9bb req-40b79e4d-df7e-49f9-8bec-555546e28b54 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:07.334967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-99c3cfc0-0fbc-4ff6-a048-7ebbfcb81acb tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:07.344464 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-9c1c75cb-3464-4a0f-8d17-c25e4a4ed9bb req-40b79e4d-df7e-49f9-8bec-555546e28b54 service nova] Creating event network-vif-deleted:fb699f20-bd58-4051-be00-7bc3a1b04ec6 for instance 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e on n-h1-860864-2 Oct 10 23:31:07.349568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-99c3cfc0-0fbc-4ff6-a048-7ebbfcb81acb tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:07.386590 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-9c1c75cb-3464-4a0f-8d17-c25e4a4ed9bb req-40b79e4d-df7e-49f9-8bec-555546e28b54 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.263566 Oct 10 23:31:07.387610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99c3cfc0-0fbc-4ff6-a048-7ebbfcb81acb tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:07.391837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99c3cfc0-0fbc-4ff6-a048-7ebbfcb81acb tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:07.391837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99c3cfc0-0fbc-4ff6-a048-7ebbfcb81acb tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:07.403769 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1731/3371] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:31:07.404087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99c3cfc0-0fbc-4ff6-a048-7ebbfcb81acb tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:07.404087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99c3cfc0-0fbc-4ff6-a048-7ebbfcb81acb tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:07.404087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99c3cfc0-0fbc-4ff6-a048-7ebbfcb81acb tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:07.990490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b95f79fa-ed1c-4752-bd58-da106dfc9b64 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:07.991550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b95f79fa-ed1c-4752-bd58-da106dfc9b64 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] [instance: 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:08.007672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b95f79fa-ed1c-4752-bd58-da106dfc9b64 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:08.008443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b95f79fa-ed1c-4752-bd58-da106dfc9b64 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:08.010123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b95f79fa-ed1c-4752-bd58-da106dfc9b64 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:08.011346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b95f79fa-ed1c-4752-bd58-da106dfc9b64 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:08.014143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b95f79fa-ed1c-4752-bd58-da106dfc9b64 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:08.014774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b95f79fa-ed1c-4752-bd58-da106dfc9b64 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:08.077100 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-b95f79fa-ed1c-4752-bd58-da106dfc9b64 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] HTTP exception thrown: Instance 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e could not be found. Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b95f79fa-ed1c-4752-bd58-da106dfc9b64 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Request method failure captured: Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e HTTP/1.1 Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKqu-z3D6g7r7K_9SfXvtPBivh1xuT98a4xGDpyqJmOsOjw63YHNT91mLUpgFhh-GTlVYJBhlJ2AsFHF2w43RYIx0VZZggD9QXYnmFhxz4kol3xqhmBF9WDhQNZeQ18L5OzrTXJFwaH-R5iEs0EGXCAF8Jp3eeDitiRddFXD61jTwDs Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: a89b626b3b5443d3ae614b95df86b60f Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersTestManualDisk-1616502161 Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a89b626b3b5443d3ae614b95df86b60f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a89b626b3b5443d3ae614b95df86b60f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a89b626b3b5443d3ae614b95df86b60f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a89b626b3b5443d3ae614b95df86b60f", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersTestManualDisk-1616502161 Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: a89b626b3b5443d3ae614b95df86b60f Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersTestManualDisk-1616502161 Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersTestManualDisk-1616502161-project Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 9ccc95d3ba2d4250aecf432af338d7b1 Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersTestManualDisk-1616502161-project Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e could not be found. Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '094e9aed-7746-4a4c-81d5-ccc6d6c3d74e'} Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e could not be found. Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e could not be found. Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:31:08.081074 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:31:08.085619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:31:08.085619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:31:08.085619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:31:08.085619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:31:08.085619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:31:08.085619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e could not be found. Oct 10 23:31:08.085619 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:31:08.085619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b95f79fa-ed1c-4752-bd58-da106dfc9b64 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Returning 404 to user: Instance 094e9aed-7746-4a4c-81d5-ccc6d6c3d74e could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:31:08.096291 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b95f79fa-ed1c-4752-bd58-da106dfc9b64 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e" status: 404 len: 111 microversion: 2.1 time: 0.110162 Oct 10 23:31:08.103191 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1732/3372] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:07 2022] GET /compute/v2.1/servers/094e9aed-7746-4a4c-81d5-ccc6d6c3d74e => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:31:08.120419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f6964741-644e-4800-bf56-0c884a932297 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] Calling method '.version_select at 0x7f662af4bdc0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:08.189096 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f6964741-644e-4800-bf56-0c884a932297 tempest-ServersTestManualDisk-1616502161 tempest-ServersTestManualDisk-1616502161-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312694263" status: 202 len: 0 microversion: 2.1 time: 0.083102 Oct 10 23:31:08.197591 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1733/3373] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 10 23:31:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312694263 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:31:08.209198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e558ab3f-d94a-47dd-9c5b-b3789dff8908 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:08.213289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e558ab3f-d94a-47dd-9c5b-b3789dff8908 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:08.225608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e558ab3f-d94a-47dd-9c5b-b3789dff8908 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:08.230946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e558ab3f-d94a-47dd-9c5b-b3789dff8908 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:08.232420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e558ab3f-d94a-47dd-9c5b-b3789dff8908 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:08.233369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e558ab3f-d94a-47dd-9c5b-b3789dff8908 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:08.236915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e558ab3f-d94a-47dd-9c5b-b3789dff8908 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:08.237775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e558ab3f-d94a-47dd-9c5b-b3789dff8908 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:09.283733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e558ab3f-d94a-47dd-9c5b-b3789dff8908 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:09.314213 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e558ab3f-d94a-47dd-9c5b-b3789dff8908 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1303 microversion: 2.1 time: 1.112705 Oct 10 23:31:09.347257 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1734/3374] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:08 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1303 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:09.385549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-513e3d53-6a82-4066-aa91-a085aa908dbc tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:09.402317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-513e3d53-6a82-4066-aa91-a085aa908dbc tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:09.423592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-513e3d53-6a82-4066-aa91-a085aa908dbc tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:09.424097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-513e3d53-6a82-4066-aa91-a085aa908dbc tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:09.424650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-513e3d53-6a82-4066-aa91-a085aa908dbc tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:09.440017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-513e3d53-6a82-4066-aa91-a085aa908dbc tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:09.440885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-513e3d53-6a82-4066-aa91-a085aa908dbc tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:09.443414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-513e3d53-6a82-4066-aa91-a085aa908dbc tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:10.163841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-513e3d53-6a82-4066-aa91-a085aa908dbc tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:10.184173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-513e3d53-6a82-4066-aa91-a085aa908dbc tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:10.187968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-513e3d53-6a82-4066-aa91-a085aa908dbc tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:10.193367 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-513e3d53-6a82-4066-aa91-a085aa908dbc tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 2948 microversion: 2.32 time: 0.839465 Oct 10 23:31:10.199776 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1735/3375] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:31:09 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 2948 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:31:10.242122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-78544857-da02-41ec-a282-a3a76869687c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:10.244198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-78544857-da02-41ec-a282-a3a76869687c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:10.255224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-78544857-da02-41ec-a282-a3a76869687c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:10.261254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-78544857-da02-41ec-a282-a3a76869687c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:10.261867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-78544857-da02-41ec-a282-a3a76869687c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:10.262914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-78544857-da02-41ec-a282-a3a76869687c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:10.263632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-78544857-da02-41ec-a282-a3a76869687c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:10.264884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-78544857-da02-41ec-a282-a3a76869687c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:10.310707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:31:10.782745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-99c3cfc0-0fbc-4ff6-a048-7ebbfcb81acb tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:10.808181 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-99c3cfc0-0fbc-4ff6-a048-7ebbfcb81acb tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1317 microversion: 2.1 time: 3.537614 Oct 10 23:31:10.831635 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1641/3376] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:07 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 1317 bytes in 3554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:10.841474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5efa3c55-4e19-483c-9c67-5473c31332f8 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:10.845625 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5efa3c55-4e19-483c-9c67-5473c31332f8 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:10.859212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:31:10.864424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5efa3c55-4e19-483c-9c67-5473c31332f8 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:10.865127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5efa3c55-4e19-483c-9c67-5473c31332f8 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:10.867427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5efa3c55-4e19-483c-9c67-5473c31332f8 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:10.871448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5efa3c55-4e19-483c-9c67-5473c31332f8 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:10.872175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5efa3c55-4e19-483c-9c67-5473c31332f8 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:10.873139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5efa3c55-4e19-483c-9c67-5473c31332f8 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:10.923180 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-78544857-da02-41ec-a282-a3a76869687c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea/os-interface" status: 200 len: 1833 microversion: 2.32 time: 0.687061 Oct 10 23:31:10.924164 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1736/3377] 10.222.0.23 () {60 vars in 1316 bytes} [Mon Oct 10 23:31:10 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea/os-interface => generated 1833 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:31:11.171445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-d6e220d0-e9fc-45e7-bf95-5ec79ef525b6 req-1c0585ca-06ab-44f3-9adb-dcfa7de1a86f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06fefb7b-6f57-4489-a760-47dbcf05cbc9", "tag": "9b65ff34-25c7-4c66-91ae-1e7da5c00e40"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:31:11.221740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d6e220d0-e9fc-45e7-bf95-5ec79ef525b6 req-1c0585ca-06ab-44f3-9adb-dcfa7de1a86f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:11.222280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d6e220d0-e9fc-45e7-bf95-5ec79ef525b6 req-1c0585ca-06ab-44f3-9adb-dcfa7de1a86f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:11.233805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d6e220d0-e9fc-45e7-bf95-5ec79ef525b6 req-1c0585ca-06ab-44f3-9adb-dcfa7de1a86f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:11.323425 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-d6e220d0-e9fc-45e7-bf95-5ec79ef525b6 req-1c0585ca-06ab-44f3-9adb-dcfa7de1a86f service nova] Creating event network-changed:9b65ff34-25c7-4c66-91ae-1e7da5c00e40 for instance 06fefb7b-6f57-4489-a760-47dbcf05cbc9 on n-h1-860864-2 Oct 10 23:31:11.366453 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-d6e220d0-e9fc-45e7-bf95-5ec79ef525b6 req-1c0585ca-06ab-44f3-9adb-dcfa7de1a86f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196277 Oct 10 23:31:11.370240 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1737/3378] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:31:11.836734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3c2692f4-de43-4789-a45c-a37731f0cb59 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:11.838743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3c2692f4-de43-4789-a45c-a37731f0cb59 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:11.846896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c2692f4-de43-4789-a45c-a37731f0cb59 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:11.847408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c2692f4-de43-4789-a45c-a37731f0cb59 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:11.847821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c2692f4-de43-4789-a45c-a37731f0cb59 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:11.848527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c2692f4-de43-4789-a45c-a37731f0cb59 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:11.848979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c2692f4-de43-4789-a45c-a37731f0cb59 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:11.884405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c2692f4-de43-4789-a45c-a37731f0cb59 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:12.626371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3c2692f4-de43-4789-a45c-a37731f0cb59 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:12.646936 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3c2692f4-de43-4789-a45c-a37731f0cb59 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1317 microversion: 2.1 time: 0.814594 Oct 10 23:31:12.666089 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1738/3379] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:11 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 1317 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:31:13.155638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5efa3c55-4e19-483c-9c67-5473c31332f8 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:13.164516 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5efa3c55-4e19-483c-9c67-5473c31332f8 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1303 microversion: 2.1 time: 2.335409 Oct 10 23:31:13.198391 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1642/3380] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:10 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1303 bytes in 2370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:13.694082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-16633a8a-2dc0-4eef-acdd-04b224aab535 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:13.702798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-16633a8a-2dc0-4eef-acdd-04b224aab535 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:13.732446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16633a8a-2dc0-4eef-acdd-04b224aab535 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:13.736461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16633a8a-2dc0-4eef-acdd-04b224aab535 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:13.736937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16633a8a-2dc0-4eef-acdd-04b224aab535 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:13.744866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16633a8a-2dc0-4eef-acdd-04b224aab535 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:13.745606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16633a8a-2dc0-4eef-acdd-04b224aab535 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:13.752111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16633a8a-2dc0-4eef-acdd-04b224aab535 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:14.188639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-adee6213-688a-45ad-b4b3-0dc2257285c1 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:14.190021 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-adee6213-688a-45ad-b4b3-0dc2257285c1 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:14.214828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adee6213-688a-45ad-b4b3-0dc2257285c1 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:14.214828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adee6213-688a-45ad-b4b3-0dc2257285c1 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:14.219040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adee6213-688a-45ad-b4b3-0dc2257285c1 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:14.229325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adee6213-688a-45ad-b4b3-0dc2257285c1 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:14.233019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adee6213-688a-45ad-b4b3-0dc2257285c1 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:14.236017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adee6213-688a-45ad-b4b3-0dc2257285c1 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:14.885721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-16633a8a-2dc0-4eef-acdd-04b224aab535 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:14.899063 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-16633a8a-2dc0-4eef-acdd-04b224aab535 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1317 microversion: 2.1 time: 1.211320 Oct 10 23:31:14.905211 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1739/3381] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:13 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 1317 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:15.931389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a64f0dcd-4eb5-44e9-b111-c51735f561e2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:15.933297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a64f0dcd-4eb5-44e9-b111-c51735f561e2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:15.952797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a64f0dcd-4eb5-44e9-b111-c51735f561e2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:15.953713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a64f0dcd-4eb5-44e9-b111-c51735f561e2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:15.954497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a64f0dcd-4eb5-44e9-b111-c51735f561e2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:15.956022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a64f0dcd-4eb5-44e9-b111-c51735f561e2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:15.956726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a64f0dcd-4eb5-44e9-b111-c51735f561e2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:15.957325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a64f0dcd-4eb5-44e9-b111-c51735f561e2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:16.290823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a64f0dcd-4eb5-44e9-b111-c51735f561e2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:16.304641 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a64f0dcd-4eb5-44e9-b111-c51735f561e2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1317 microversion: 2.1 time: 0.377564 Oct 10 23:31:16.325419 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1740/3382] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:15 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 1317 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:31:16.390256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-adee6213-688a-45ad-b4b3-0dc2257285c1 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:16.407475 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-adee6213-688a-45ad-b4b3-0dc2257285c1 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1303 microversion: 2.1 time: 2.222614 Oct 10 23:31:16.430565 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1643/3383] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:14 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1303 bytes in 2236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:17.347772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-37ced8f8-1957-419a-9111-ade3f3340ba0 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:17.348541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-37ced8f8-1957-419a-9111-ade3f3340ba0 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:17.364269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:31:17.366175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37ced8f8-1957-419a-9111-ade3f3340ba0 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:17.366990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37ced8f8-1957-419a-9111-ade3f3340ba0 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:17.367660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37ced8f8-1957-419a-9111-ade3f3340ba0 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:17.368714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37ced8f8-1957-419a-9111-ade3f3340ba0 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:17.373788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37ced8f8-1957-419a-9111-ade3f3340ba0 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:17.374662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37ced8f8-1957-419a-9111-ade3f3340ba0 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:17.456428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a46346ce-9a05-4aa0-a6c6-1512776af00b tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:17.462269 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a46346ce-9a05-4aa0-a6c6-1512776af00b tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:17.500803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a46346ce-9a05-4aa0-a6c6-1512776af00b tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:17.515612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a46346ce-9a05-4aa0-a6c6-1512776af00b tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:17.516171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a46346ce-9a05-4aa0-a6c6-1512776af00b tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:17.517159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a46346ce-9a05-4aa0-a6c6-1512776af00b tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:17.519650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a46346ce-9a05-4aa0-a6c6-1512776af00b tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:17.520389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a46346ce-9a05-4aa0-a6c6-1512776af00b tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:18.241693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-37ced8f8-1957-419a-9111-ade3f3340ba0 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:18.258716 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-37ced8f8-1957-419a-9111-ade3f3340ba0 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1317 microversion: 2.1 time: 0.908656 Oct 10 23:31:18.260958 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1741/3384] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:17 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 1317 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:18.288957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-9faac94d-ea16-4aaf-bfd0-49b748d30cd7 req-1dc8d06f-9701-4f85-8d15-a2e5a9aaee82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "037ebfb5-534f-42db-9838-462de4b299e1", "name": "network-vif-plugged", "status": "completed", "tag": "0945733a-182f-4aab-9346-e59fa6b3c813"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:31:18.323121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9faac94d-ea16-4aaf-bfd0-49b748d30cd7 req-1dc8d06f-9701-4f85-8d15-a2e5a9aaee82 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:18.324295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9faac94d-ea16-4aaf-bfd0-49b748d30cd7 req-1dc8d06f-9701-4f85-8d15-a2e5a9aaee82 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:18.325120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9faac94d-ea16-4aaf-bfd0-49b748d30cd7 req-1dc8d06f-9701-4f85-8d15-a2e5a9aaee82 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:18.351850 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-9faac94d-ea16-4aaf-bfd0-49b748d30cd7 req-1dc8d06f-9701-4f85-8d15-a2e5a9aaee82 service nova] Creating event network-vif-plugged:0945733a-182f-4aab-9346-e59fa6b3c813 for instance 037ebfb5-534f-42db-9838-462de4b299e1 on n-h2-860864-2 Oct 10 23:31:18.384648 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-9faac94d-ea16-4aaf-bfd0-49b748d30cd7 req-1dc8d06f-9701-4f85-8d15-a2e5a9aaee82 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119330 Oct 10 23:31:18.389917 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1742/3385] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:31:19.161769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a46346ce-9a05-4aa0-a6c6-1512776af00b tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:19.181492 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a46346ce-9a05-4aa0-a6c6-1512776af00b tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1303 microversion: 2.1 time: 1.732194 Oct 10 23:31:19.182110 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1644/3386] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:17 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1303 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:31:19.290908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4a3032c9-7a80-4777-b74a-fc60b63d3211 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:19.292013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4a3032c9-7a80-4777-b74a-fc60b63d3211 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:19.325115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a3032c9-7a80-4777-b74a-fc60b63d3211 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:19.332063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a3032c9-7a80-4777-b74a-fc60b63d3211 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:19.332636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a3032c9-7a80-4777-b74a-fc60b63d3211 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:19.333436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a3032c9-7a80-4777-b74a-fc60b63d3211 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:19.338460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a3032c9-7a80-4777-b74a-fc60b63d3211 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:19.347352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a3032c9-7a80-4777-b74a-fc60b63d3211 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:20.287518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0c69f82b-b001-4d21-9f12-d8a50ceea640 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Action: 'create', calling method: .version_select at 0x7f662a49c790>, body: {"keypair": {"name": "tempest-keypair-1341021018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRGM3fpi36gLkY1IEZoGnRhQTEg97mb2s4piomyHUaavCxKlOgQ2FYRjPmoCFRvFZf67NxzBeu9DicFy1Rrfcw9p24PFMTppE0W4025rocOTIgrf4XXw01X0KnGqZp0Iw=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:31:20.338884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-0c69f82b-b001-4d21-9f12-d8a50ceea640 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Getting quotas for project bde1993b939b4fa0bd402a34fbdadc14. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:31:20.358854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-0c69f82b-b001-4d21-9f12-d8a50ceea640 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Getting quotas for user 8383806f776c44e781fc965eb5c425db and project bde1993b939b4fa0bd402a34fbdadc14. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:31:20.423988 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0c69f82b-b001-4d21-9f12-d8a50ceea640 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.534796 Oct 10 23:31:20.427201 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1645/3387] 10.222.0.23 () {62 vars in 1200 bytes} [Mon Oct 10 23:31:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 539 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 10 23:31:20.456057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-015b0b11-8683-4e74-83bb-337645665059 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:20.463671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-015b0b11-8683-4e74-83bb-337645665059 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:20.486119 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-015b0b11-8683-4e74-83bb-337645665059 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:20.490215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-015b0b11-8683-4e74-83bb-337645665059 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:20.491510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-015b0b11-8683-4e74-83bb-337645665059 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:20.496620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-015b0b11-8683-4e74-83bb-337645665059 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:20.502427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-015b0b11-8683-4e74-83bb-337645665059 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:20.510302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-015b0b11-8683-4e74-83bb-337645665059 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:20.839259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4a3032c9-7a80-4777-b74a-fc60b63d3211 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:20.860768 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4a3032c9-7a80-4777-b74a-fc60b63d3211 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1317 microversion: 2.1 time: 1.577904 Oct 10 23:31:20.868978 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1743/3388] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:19 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 1317 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:20.887969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-33fe6af7-7164-4529-bb66-4993c8899d06 req-4e02b3d8-83f7-47c0-8d5f-af5448eac24d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430a8e18-4033-498b-8cf3-a224786b7363", "name": "network-vif-plugged", "status": "completed", "tag": "a2e7d038-4684-44fd-a359-4f01f2732cbf"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:31:20.913143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-33fe6af7-7164-4529-bb66-4993c8899d06 req-4e02b3d8-83f7-47c0-8d5f-af5448eac24d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:20.918558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-33fe6af7-7164-4529-bb66-4993c8899d06 req-4e02b3d8-83f7-47c0-8d5f-af5448eac24d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:20.919817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-33fe6af7-7164-4529-bb66-4993c8899d06 req-4e02b3d8-83f7-47c0-8d5f-af5448eac24d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:20.950524 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-33fe6af7-7164-4529-bb66-4993c8899d06 req-4e02b3d8-83f7-47c0-8d5f-af5448eac24d service nova] Creating event network-vif-plugged:a2e7d038-4684-44fd-a359-4f01f2732cbf for instance 430a8e18-4033-498b-8cf3-a224786b7363 on n-h2-860864-2 Oct 10 23:31:21.011073 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-33fe6af7-7164-4529-bb66-4993c8899d06 req-4e02b3d8-83f7-47c0-8d5f-af5448eac24d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139796 Oct 10 23:31:21.013079 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1744/3389] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:31:21.378789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-015b0b11-8683-4e74-83bb-337645665059 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:21.391950 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-015b0b11-8683-4e74-83bb-337645665059 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1291 microversion: 2.1 time: 0.962129 Oct 10 23:31:21.395021 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1646/3390] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:20 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1291 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:21.897211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0886b482-ab78-4ba7-87fd-40f340250105 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:21.899059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0886b482-ab78-4ba7-87fd-40f340250105 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:21.915463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0886b482-ab78-4ba7-87fd-40f340250105 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:21.918060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0886b482-ab78-4ba7-87fd-40f340250105 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:21.920804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0886b482-ab78-4ba7-87fd-40f340250105 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:21.922024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0886b482-ab78-4ba7-87fd-40f340250105 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:21.926119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0886b482-ab78-4ba7-87fd-40f340250105 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:21.926914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0886b482-ab78-4ba7-87fd-40f340250105 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:22.422742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-69437533-05b1-46e9-bf98-3519dbc0c126 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:22.423480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-69437533-05b1-46e9-bf98-3519dbc0c126 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:22.452767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69437533-05b1-46e9-bf98-3519dbc0c126 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:22.457476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69437533-05b1-46e9-bf98-3519dbc0c126 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:22.458190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69437533-05b1-46e9-bf98-3519dbc0c126 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:22.459115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69437533-05b1-46e9-bf98-3519dbc0c126 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:22.459740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69437533-05b1-46e9-bf98-3519dbc0c126 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:22.460452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69437533-05b1-46e9-bf98-3519dbc0c126 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:22.560437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0886b482-ab78-4ba7-87fd-40f340250105 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:22.568722 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0886b482-ab78-4ba7-87fd-40f340250105 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1466 microversion: 2.1 time: 0.677560 Oct 10 23:31:22.572640 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1745/3391] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:21 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 1466 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:22.598283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1112e35a-c16b-4917-b9c8-04813722d173 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:22.612157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1112e35a-c16b-4917-b9c8-04813722d173 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 430a8e18-4033-498b-8cf3-a224786b7363] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:22.635830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1112e35a-c16b-4917-b9c8-04813722d173 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:22.636444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1112e35a-c16b-4917-b9c8-04813722d173 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:22.636963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1112e35a-c16b-4917-b9c8-04813722d173 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:22.637799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1112e35a-c16b-4917-b9c8-04813722d173 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:22.638344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1112e35a-c16b-4917-b9c8-04813722d173 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:22.638862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1112e35a-c16b-4917-b9c8-04813722d173 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:22.981323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-69437533-05b1-46e9-bf98-3519dbc0c126 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:22.990656 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-69437533-05b1-46e9-bf98-3519dbc0c126 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1291 microversion: 2.1 time: 0.572524 Oct 10 23:31:23.019283 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1647/3392] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:22 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1291 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:31:23.339653 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1112e35a-c16b-4917-b9c8-04813722d173 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:23.353613 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1112e35a-c16b-4917-b9c8-04813722d173 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363" status: 200 len: 1318 microversion: 2.1 time: 0.758937 Oct 10 23:31:23.377936 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1746/3393] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:22 2022] GET /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363 => generated 1318 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:24.032949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-296a17c6-2cab-4cff-b54b-fcbbb88fc639 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:24.033742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-296a17c6-2cab-4cff-b54b-fcbbb88fc639 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:24.058594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-296a17c6-2cab-4cff-b54b-fcbbb88fc639 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:24.059456 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-296a17c6-2cab-4cff-b54b-fcbbb88fc639 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:24.060348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-296a17c6-2cab-4cff-b54b-fcbbb88fc639 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:24.061518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-296a17c6-2cab-4cff-b54b-fcbbb88fc639 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:24.062098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-296a17c6-2cab-4cff-b54b-fcbbb88fc639 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:24.062724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-296a17c6-2cab-4cff-b54b-fcbbb88fc639 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:24.392630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4106dd01-c24f-4b46-bd95-edcfb13a2a07 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:24.400866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4106dd01-c24f-4b46-bd95-edcfb13a2a07 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 430a8e18-4033-498b-8cf3-a224786b7363] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:24.454255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4106dd01-c24f-4b46-bd95-edcfb13a2a07 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:24.455581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4106dd01-c24f-4b46-bd95-edcfb13a2a07 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:24.456796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4106dd01-c24f-4b46-bd95-edcfb13a2a07 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:24.461953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4106dd01-c24f-4b46-bd95-edcfb13a2a07 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:24.463486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4106dd01-c24f-4b46-bd95-edcfb13a2a07 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:24.465025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4106dd01-c24f-4b46-bd95-edcfb13a2a07 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:24.915038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4106dd01-c24f-4b46-bd95-edcfb13a2a07 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:24.931726 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4106dd01-c24f-4b46-bd95-edcfb13a2a07 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363" status: 200 len: 1467 microversion: 2.1 time: 0.549066 Oct 10 23:31:24.946416 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1747/3394] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:24 2022] GET /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363 => generated 1467 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:24.967917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-831b4d2e-784d-4c80-a2f0-1ce4c4de9fe2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2085205152"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:31:24.973532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-831b4d2e-784d-4c80-a2f0-1ce4c4de9fe2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 430a8e18-4033-498b-8cf3-a224786b7363] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:24.992093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-831b4d2e-784d-4c80-a2f0-1ce4c4de9fe2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:24.993350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-831b4d2e-784d-4c80-a2f0-1ce4c4de9fe2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:24.995491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-831b4d2e-784d-4c80-a2f0-1ce4c4de9fe2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:24.997424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-831b4d2e-784d-4c80-a2f0-1ce4c4de9fe2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:24.997838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-831b4d2e-784d-4c80-a2f0-1ce4c4de9fe2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:24.999426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-831b4d2e-784d-4c80-a2f0-1ce4c4de9fe2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:25.082148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-296a17c6-2cab-4cff-b54b-fcbbb88fc639 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:25.096275 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-296a17c6-2cab-4cff-b54b-fcbbb88fc639 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1291 microversion: 2.1 time: 1.071693 Oct 10 23:31:25.108103 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1648/3395] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:24 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1291 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:25.730945 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-831b4d2e-784d-4c80-a2f0-1ce4c4de9fe2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "POST /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363/action" status: 202 len: 0 microversion: 2.1 time: 0.775441 Oct 10 23:31:25.747431 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1748/3396] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:31:24 2022] POST /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363/action => generated 0 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 23:31:25.748107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-66287d39-097b-48b5-a975-3fc11322ae64 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662b7821f0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:25.872445 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-66287d39-097b-48b5-a975-3fc11322ae64 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d" status: 200 len: 1453 microversion: 2.1 time: 0.128532 Oct 10 23:31:25.874275 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1649/3397] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:31:25 2022] GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d => generated 1453 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:26.146126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-113251c8-7e03-4aa5-85b4-84e67d275c70 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:26.151746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-113251c8-7e03-4aa5-85b4-84e67d275c70 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:26.184983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-113251c8-7e03-4aa5-85b4-84e67d275c70 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:26.187066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-113251c8-7e03-4aa5-85b4-84e67d275c70 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:26.188586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-113251c8-7e03-4aa5-85b4-84e67d275c70 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:26.190224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-113251c8-7e03-4aa5-85b4-84e67d275c70 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:26.191411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-113251c8-7e03-4aa5-85b4-84e67d275c70 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:26.192480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-113251c8-7e03-4aa5-85b4-84e67d275c70 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:26.620400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-113251c8-7e03-4aa5-85b4-84e67d275c70 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:26.636837 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-113251c8-7e03-4aa5-85b4-84e67d275c70 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1291 microversion: 2.1 time: 0.500409 Oct 10 23:31:26.652872 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1749/3398] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:26 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1291 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:26.908823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e58e997b-bb8c-42a1-bd3f-6e3e04aaf69f tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a46f790>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:26.993166 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e58e997b-bb8c-42a1-bd3f-6e3e04aaf69f tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d" status: 200 len: 1453 microversion: 2.1 time: 0.098734 Oct 10 23:31:26.994117 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1650/3399] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:31:26 2022] GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d => generated 1453 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:27.663072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-49f5dfea-a4a3-482b-a8ce-c97b769679b5 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:27.663728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-49f5dfea-a4a3-482b-a8ce-c97b769679b5 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:27.680897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49f5dfea-a4a3-482b-a8ce-c97b769679b5 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:27.681187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49f5dfea-a4a3-482b-a8ce-c97b769679b5 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:27.681556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49f5dfea-a4a3-482b-a8ce-c97b769679b5 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:27.685318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49f5dfea-a4a3-482b-a8ce-c97b769679b5 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:27.687356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49f5dfea-a4a3-482b-a8ce-c97b769679b5 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:27.688842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49f5dfea-a4a3-482b-a8ce-c97b769679b5 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:28.010694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e4503c2c-2f44-4304-bbc1-4e3f0a3ab7e5 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a4a91f0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:28.123536 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e4503c2c-2f44-4304-bbc1-4e3f0a3ab7e5 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d" status: 200 len: 1453 microversion: 2.1 time: 0.118297 Oct 10 23:31:28.127296 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1651/3400] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:31:28 2022] GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d => generated 1453 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:28.283534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-49f5dfea-a4a3-482b-a8ce-c97b769679b5 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:28.299765 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-49f5dfea-a4a3-482b-a8ce-c97b769679b5 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1291 microversion: 2.1 time: 0.640406 Oct 10 23:31:28.324181 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1750/3401] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:27 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1291 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:28.389945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fc286522-900d-4cf8-963f-a84b1564968d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1111154389", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f75204ba-88c2-48a1-9aaf-b4737fa6a06d"}], "security_groups": [{"name": "tempest-securitygroup--725539340"}], "key_name": "tempest-keypair-1341021018", "user_data": "}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:31:28.675857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-fc286522-900d-4cf8-963f-a84b1564968d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] validate_networks() for [('f75204ba-88c2-48a1-9aaf-b4737fa6a06d', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:31:29.141963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-165da8a6-fb21-4722-bea2-b417d9e4a5d3 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a70f4c0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:29.557839 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-165da8a6-fb21-4722-bea2-b417d9e4a5d3 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d" status: 200 len: 1453 microversion: 2.1 time: 0.421470 Oct 10 23:31:29.562857 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1751/3402] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:31:29 2022] GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d => generated 1453 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:29.572875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-282930d5-5cb4-41a2-9245-fa3f3f6f74ff tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:29.573780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-282930d5-5cb4-41a2-9245-fa3f3f6f74ff tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:29.591091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-282930d5-5cb4-41a2-9245-fa3f3f6f74ff tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:29.591858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-282930d5-5cb4-41a2-9245-fa3f3f6f74ff tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:29.592459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-282930d5-5cb4-41a2-9245-fa3f3f6f74ff tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:29.594063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-282930d5-5cb4-41a2-9245-fa3f3f6f74ff tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:29.599958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-282930d5-5cb4-41a2-9245-fa3f3f6f74ff tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:29.600796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-282930d5-5cb4-41a2-9245-fa3f3f6f74ff tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:30.005808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-282930d5-5cb4-41a2-9245-fa3f3f6f74ff tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:30.022347 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-282930d5-5cb4-41a2-9245-fa3f3f6f74ff tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1291 microversion: 2.1 time: 0.458076 Oct 10 23:31:30.023167 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1752/3403] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:29 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1291 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:30.384646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:31:30.473248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-fc286522-900d-4cf8-963f-a84b1564968d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:31:30.474026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-fc286522-900d-4cf8-963f-a84b1564968d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:31:30.475135 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-fc286522-900d-4cf8-963f-a84b1564968d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:31:30.475860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-fc286522-900d-4cf8-963f-a84b1564968d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:31:30.476765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-fc286522-900d-4cf8-963f-a84b1564968d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:31:30.518608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc286522-900d-4cf8-963f-a84b1564968d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:30.519658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc286522-900d-4cf8-963f-a84b1564968d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:30.520261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc286522-900d-4cf8-963f-a84b1564968d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:30.524993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc286522-900d-4cf8-963f-a84b1564968d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:30.525584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc286522-900d-4cf8-963f-a84b1564968d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:30.526245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc286522-900d-4cf8-963f-a84b1564968d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:30.574501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c9047c80-0e0d-42b4-8095-5a73f5324269 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a70f820>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:30.589855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-fc286522-900d-4cf8-963f-a84b1564968d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Getting quotas for project bde1993b939b4fa0bd402a34fbdadc14. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:31:30.607475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-fc286522-900d-4cf8-963f-a84b1564968d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Getting quotas for user 8383806f776c44e781fc965eb5c425db and project bde1993b939b4fa0bd402a34fbdadc14. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:31:30.647993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fc286522-900d-4cf8-963f-a84b1564968d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:31:30.651049 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fc286522-900d-4cf8-963f-a84b1564968d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:31:30.842207 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fc286522-900d-4cf8-963f-a84b1564968d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.452813 Oct 10 23:31:30.846874 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1652/3404] 10.222.0.23 () {62 vars in 1188 bytes} [Mon Oct 10 23:31:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 2462 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 23:31:30.871904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-6c50a051-5b22-4412-a475-accd693bda0c req-d9cfd857-38f5-44f6-9b8e-b7ef4f302827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06fefb7b-6f57-4489-a760-47dbcf05cbc9", "name": "network-vif-plugged", "status": "completed", "tag": "9b65ff34-25c7-4c66-91ae-1e7da5c00e40"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:31:30.906360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6c50a051-5b22-4412-a475-accd693bda0c req-d9cfd857-38f5-44f6-9b8e-b7ef4f302827 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:30.906708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6c50a051-5b22-4412-a475-accd693bda0c req-d9cfd857-38f5-44f6-9b8e-b7ef4f302827 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:30.907135 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6c50a051-5b22-4412-a475-accd693bda0c req-d9cfd857-38f5-44f6-9b8e-b7ef4f302827 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:30.965274 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-6c50a051-5b22-4412-a475-accd693bda0c req-d9cfd857-38f5-44f6-9b8e-b7ef4f302827 service nova] Creating event network-vif-plugged:9b65ff34-25c7-4c66-91ae-1e7da5c00e40 for instance 06fefb7b-6f57-4489-a760-47dbcf05cbc9 on n-h1-860864-2 Oct 10 23:31:30.974601 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-6c50a051-5b22-4412-a475-accd693bda0c req-d9cfd857-38f5-44f6-9b8e-b7ef4f302827 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124670 Oct 10 23:31:30.976175 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1653/3405] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:31:31.010862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ea994833-088d-40b1-9177-07dd8dd021e8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:31.016331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ea994833-088d-40b1-9177-07dd8dd021e8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:31.226740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ea994833-088d-40b1-9177-07dd8dd021e8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:31.236123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ea994833-088d-40b1-9177-07dd8dd021e8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:31.237628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ea994833-088d-40b1-9177-07dd8dd021e8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:31.238775 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ea994833-088d-40b1-9177-07dd8dd021e8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1282 microversion: 2.20 time: 0.257990 Oct 10 23:31:31.239355 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1654/3406] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:31:30 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1282 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:31:31.291768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5645995a-d40a-4ea3-a9b7-ccc723539a2c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:31.292399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5645995a-d40a-4ea3-a9b7-ccc723539a2c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:31.331576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5645995a-d40a-4ea3-a9b7-ccc723539a2c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:31.332015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5645995a-d40a-4ea3-a9b7-ccc723539a2c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:31.332462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5645995a-d40a-4ea3-a9b7-ccc723539a2c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:31.345654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5645995a-d40a-4ea3-a9b7-ccc723539a2c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:31.346525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5645995a-d40a-4ea3-a9b7-ccc723539a2c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:31.347348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5645995a-d40a-4ea3-a9b7-ccc723539a2c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:31.939358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5645995a-d40a-4ea3-a9b7-ccc723539a2c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:31.952870 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5645995a-d40a-4ea3-a9b7-ccc723539a2c tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1291 microversion: 2.1 time: 0.712415 Oct 10 23:31:31.953492 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1655/3407] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:31 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1291 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:32.272205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9c098c9f-738d-4ccd-8567-1727151199b7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:32.273190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9c098c9f-738d-4ccd-8567-1727151199b7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:32.297986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c098c9f-738d-4ccd-8567-1727151199b7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:32.299634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c098c9f-738d-4ccd-8567-1727151199b7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:32.305739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c098c9f-738d-4ccd-8567-1727151199b7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:32.307580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c098c9f-738d-4ccd-8567-1727151199b7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:32.309716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c098c9f-738d-4ccd-8567-1727151199b7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:32.314773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c098c9f-738d-4ccd-8567-1727151199b7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:32.536048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9c098c9f-738d-4ccd-8567-1727151199b7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:32.546114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9c098c9f-738d-4ccd-8567-1727151199b7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:32.547582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9c098c9f-738d-4ccd-8567-1727151199b7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:32.548725 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9c098c9f-738d-4ccd-8567-1727151199b7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1278 microversion: 2.20 time: 0.280592 Oct 10 23:31:32.560213 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1656/3408] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:31:32 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1278 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:31:32.980373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-621f55a0-1d8f-42c5-8ba8-9cd6d5c7cdd7 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:32.981420 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-621f55a0-1d8f-42c5-8ba8-9cd6d5c7cdd7 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:33.002027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-621f55a0-1d8f-42c5-8ba8-9cd6d5c7cdd7 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:33.010540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-621f55a0-1d8f-42c5-8ba8-9cd6d5c7cdd7 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:33.015116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-621f55a0-1d8f-42c5-8ba8-9cd6d5c7cdd7 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:33.027840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-621f55a0-1d8f-42c5-8ba8-9cd6d5c7cdd7 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:33.028952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-621f55a0-1d8f-42c5-8ba8-9cd6d5c7cdd7 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:33.029490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-621f55a0-1d8f-42c5-8ba8-9cd6d5c7cdd7 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:34.550522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-621f55a0-1d8f-42c5-8ba8-9cd6d5c7cdd7 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:34.567690 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-621f55a0-1d8f-42c5-8ba8-9cd6d5c7cdd7 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1291 microversion: 2.1 time: 1.593667 Oct 10 23:31:34.568661 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1657/3409] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:32 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1291 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:31:34.599228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-4fe70867-5e1f-41a3-9b47-16418cfa2cc6 req-0d275fec-4689-436e-ac6c-5c74e3d5fbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430a8e18-4033-498b-8cf3-a224786b7363", "name": "network-vif-plugged", "status": "completed", "tag": "a2e7d038-4684-44fd-a359-4f01f2732cbf"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:31:34.662771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4fe70867-5e1f-41a3-9b47-16418cfa2cc6 req-0d275fec-4689-436e-ac6c-5c74e3d5fbd7 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:34.679039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4fe70867-5e1f-41a3-9b47-16418cfa2cc6 req-0d275fec-4689-436e-ac6c-5c74e3d5fbd7 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:34.680464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4fe70867-5e1f-41a3-9b47-16418cfa2cc6 req-0d275fec-4689-436e-ac6c-5c74e3d5fbd7 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:34.760612 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-4fe70867-5e1f-41a3-9b47-16418cfa2cc6 req-0d275fec-4689-436e-ac6c-5c74e3d5fbd7 service nova] Creating event network-vif-plugged:a2e7d038-4684-44fd-a359-4f01f2732cbf for instance 430a8e18-4033-498b-8cf3-a224786b7363 on n-h2-860864-2 Oct 10 23:31:34.778672 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-4fe70867-5e1f-41a3-9b47-16418cfa2cc6 req-0d275fec-4689-436e-ac6c-5c74e3d5fbd7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201543 Oct 10 23:31:34.781153 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1658/3410] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:31:34.805302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f6bd887b-926b-4487-a28b-1cf337c662ee tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:34.811811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f6bd887b-926b-4487-a28b-1cf337c662ee tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:34.855592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6bd887b-926b-4487-a28b-1cf337c662ee tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:34.858908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6bd887b-926b-4487-a28b-1cf337c662ee tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:34.860113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6bd887b-926b-4487-a28b-1cf337c662ee tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:34.861327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6bd887b-926b-4487-a28b-1cf337c662ee tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:34.864020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6bd887b-926b-4487-a28b-1cf337c662ee tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:34.864595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6bd887b-926b-4487-a28b-1cf337c662ee tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:35.235508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f6bd887b-926b-4487-a28b-1cf337c662ee tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:35.257367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f6bd887b-926b-4487-a28b-1cf337c662ee tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:35.262901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f6bd887b-926b-4487-a28b-1cf337c662ee tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:35.274439 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f6bd887b-926b-4487-a28b-1cf337c662ee tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1340 microversion: 2.20 time: 0.481350 Oct 10 23:31:35.275643 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1659/3411] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:31:34 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1340 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:31:35.604449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0456bc7a-f711-4cd5-b504-d57bfb8892f8 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:35.617008 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0456bc7a-f711-4cd5-b504-d57bfb8892f8 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:35.642118 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0456bc7a-f711-4cd5-b504-d57bfb8892f8 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:35.642996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0456bc7a-f711-4cd5-b504-d57bfb8892f8 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:35.649700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0456bc7a-f711-4cd5-b504-d57bfb8892f8 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:35.650862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0456bc7a-f711-4cd5-b504-d57bfb8892f8 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:35.651502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0456bc7a-f711-4cd5-b504-d57bfb8892f8 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:35.652064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0456bc7a-f711-4cd5-b504-d57bfb8892f8 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:37.300236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0456bc7a-f711-4cd5-b504-d57bfb8892f8 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:37.307112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=88 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:31:37.317851 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0456bc7a-f711-4cd5-b504-d57bfb8892f8 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1482 microversion: 2.1 time: 1.715001 Oct 10 23:31:37.319449 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1660/3412] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:35 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1482 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:37.340293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a6177d23-7d90-43c6-9211-c4cc3297b794 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:37.355100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a6177d23-7d90-43c6-9211-c4cc3297b794 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:37.375470 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6177d23-7d90-43c6-9211-c4cc3297b794 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:37.376379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6177d23-7d90-43c6-9211-c4cc3297b794 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:37.377087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6177d23-7d90-43c6-9211-c4cc3297b794 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:37.378327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6177d23-7d90-43c6-9211-c4cc3297b794 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:37.380917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6177d23-7d90-43c6-9211-c4cc3297b794 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:37.385454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6177d23-7d90-43c6-9211-c4cc3297b794 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:37.625436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a6177d23-7d90-43c6-9211-c4cc3297b794 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:37.659081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a6177d23-7d90-43c6-9211-c4cc3297b794 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:37.660606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a6177d23-7d90-43c6-9211-c4cc3297b794 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:37.662029 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a6177d23-7d90-43c6-9211-c4cc3297b794 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1340 microversion: 2.20 time: 0.341557 Oct 10 23:31:37.664438 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1661/3413] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:31:37 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1340 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:31:37.672885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1d41e461-b567-4224-b3d4-dbb470eb1adf tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:37.673673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1d41e461-b567-4224-b3d4-dbb470eb1adf tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:37.690242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d41e461-b567-4224-b3d4-dbb470eb1adf tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:37.691053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d41e461-b567-4224-b3d4-dbb470eb1adf tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:37.691675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d41e461-b567-4224-b3d4-dbb470eb1adf tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:37.693124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d41e461-b567-4224-b3d4-dbb470eb1adf tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:37.693786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d41e461-b567-4224-b3d4-dbb470eb1adf tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:37.694425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d41e461-b567-4224-b3d4-dbb470eb1adf tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:38.029766 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1d41e461-b567-4224-b3d4-dbb470eb1adf tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.362840 Oct 10 23:31:38.039983 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1662/3414] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Oct 10 23:31:37 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9/os-interface => generated 285 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:31:38.760764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-69d00238-9df0-4f70-ab53-24ab2948a537 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:38.766022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-69d00238-9df0-4f70-ab53-24ab2948a537 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:38.791807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69d00238-9df0-4f70-ab53-24ab2948a537 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:38.794016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69d00238-9df0-4f70-ab53-24ab2948a537 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:38.797280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69d00238-9df0-4f70-ab53-24ab2948a537 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:38.798844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69d00238-9df0-4f70-ab53-24ab2948a537 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:38.805501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69d00238-9df0-4f70-ab53-24ab2948a537 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:38.806513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69d00238-9df0-4f70-ab53-24ab2948a537 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:39.591606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=21 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:31:40.027741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:31:40.546151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:31:40.870832 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c9047c80-0e0d-42b4-8095-5a73f5324269 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d" status: 200 len: 1453 microversion: 2.1 time: 10.300699 Oct 10 23:31:40.876607 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1753/3415] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:31:30 2022] GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d => generated 1453 bytes in 10307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:31:40.971036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-69d00238-9df0-4f70-ab53-24ab2948a537 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:41.010695 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-69d00238-9df0-4f70-ab53-24ab2948a537 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:41.021716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-69d00238-9df0-4f70-ab53-24ab2948a537 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:41.025959 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-69d00238-9df0-4f70-ab53-24ab2948a537 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1407 microversion: 2.20 time: 2.271058 Oct 10 23:31:41.030375 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1663/3416] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:31:38 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1407 bytes in 2276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:31:41.287808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-736d10ed-8beb-465e-848f-df64c4393b6a tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Action: 'create', calling method: .version_select at 0x7f662a70f5e0>, body: {"keypair": {"name": "tempest-keypair-1915257767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNn0CH4G/rjLm6r3qy9GAp9RMkMeAb+oOqdK1MZ2U/dqUOUwXjiph5L3mbM0QUmdnz6LSHIvTRTMBn2YSEP9A6eP7DJmJRNSFqJi5ai84vUDL6PiXAP2kKO7u8BHS7/Qw=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:31:41.356467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-736d10ed-8beb-465e-848f-df64c4393b6a tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Getting quotas for project dc49f6458751423bb1175f6fba6d6fdd. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:31:41.374739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-736d10ed-8beb-465e-848f-df64c4393b6a tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Getting quotas for user bf589ecefc364edbb3fbb47fdd18da3e and project dc49f6458751423bb1175f6fba6d6fdd. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:31:41.462826 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-736d10ed-8beb-465e-848f-df64c4393b6a tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.584710 Oct 10 23:31:41.471678 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1754/3417] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:31:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:31:41.892498 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-79174694-fd2e-4dd7-af91-669bff5dae2d tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a4f6940>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:41.938159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=8 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:31:42.053078 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-79174694-fd2e-4dd7-af91-669bff5dae2d tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d" status: 200 len: 1453 microversion: 2.1 time: 0.156721 Oct 10 23:31:42.053880 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1664/3418] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:31:41 2022] GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:42.064847 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-539ec713-653d-4263-9312-57c13f8bd386 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:42.065660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-539ec713-653d-4263-9312-57c13f8bd386 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:42.087529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-539ec713-653d-4263-9312-57c13f8bd386 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:42.088048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-539ec713-653d-4263-9312-57c13f8bd386 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:42.088500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-539ec713-653d-4263-9312-57c13f8bd386 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:42.089230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-539ec713-653d-4263-9312-57c13f8bd386 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:42.089761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-539ec713-653d-4263-9312-57c13f8bd386 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:42.090155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-539ec713-653d-4263-9312-57c13f8bd386 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:42.849649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-539ec713-653d-4263-9312-57c13f8bd386 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:42.864863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-539ec713-653d-4263-9312-57c13f8bd386 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:42.870650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-539ec713-653d-4263-9312-57c13f8bd386 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:42.872107 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-539ec713-653d-4263-9312-57c13f8bd386 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1407 microversion: 2.20 time: 0.813709 Oct 10 23:31:42.872710 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1755/3419] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:31:42 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1407 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:31:43.070982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5abfb564-1e72-4d4a-b312-bf9f179f0285 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a5def70>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:43.166922 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5abfb564-1e72-4d4a-b312-bf9f179f0285 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d" status: 200 len: 1453 microversion: 2.1 time: 0.101040 Oct 10 23:31:43.167861 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1665/3420] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:31:43 2022] GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:43.915070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1a673039-4b5a-4572-a051-e38b86d05c2b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:43.920568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1a673039-4b5a-4572-a051-e38b86d05c2b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:43.947202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a673039-4b5a-4572-a051-e38b86d05c2b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:43.956362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a673039-4b5a-4572-a051-e38b86d05c2b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:43.957263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a673039-4b5a-4572-a051-e38b86d05c2b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:43.961610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a673039-4b5a-4572-a051-e38b86d05c2b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:43.962494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a673039-4b5a-4572-a051-e38b86d05c2b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:43.964685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a673039-4b5a-4572-a051-e38b86d05c2b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:44.042989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-9ed308f5-049a-4640-b1c1-fed55eecc78e req-17828533-9405-4dde-a18f-6fae3408e8ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bd745fa-6826-4bd1-8f8d-ae65071fac12", "tag": "9a900297-53e2-4782-8def-24d4260702d5"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:31:44.079743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:31:44.102688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9ed308f5-049a-4640-b1c1-fed55eecc78e req-17828533-9405-4dde-a18f-6fae3408e8ca service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:44.103404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9ed308f5-049a-4640-b1c1-fed55eecc78e req-17828533-9405-4dde-a18f-6fae3408e8ca service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:44.103872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9ed308f5-049a-4640-b1c1-fed55eecc78e req-17828533-9405-4dde-a18f-6fae3408e8ca service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:44.132699 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-9ed308f5-049a-4640-b1c1-fed55eecc78e req-17828533-9405-4dde-a18f-6fae3408e8ca service nova] Creating event network-changed:9a900297-53e2-4782-8def-24d4260702d5 for instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 on n-h1-860864-2 Oct 10 23:31:44.147402 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-9ed308f5-049a-4640-b1c1-fed55eecc78e req-17828533-9405-4dde-a18f-6fae3408e8ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120795 Oct 10 23:31:44.148633 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1666/3421] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:31:44.185996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-74c896be-7cc0-4e53-ba9d-e56eb15f5c3f tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a5deee0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:44.274133 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-74c896be-7cc0-4e53-ba9d-e56eb15f5c3f tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d" status: 200 len: 1453 microversion: 2.1 time: 0.092099 Oct 10 23:31:44.281538 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1667/3422] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:31:44 2022] GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d => generated 1453 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:31:45.037725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1a673039-4b5a-4572-a051-e38b86d05c2b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:45.056746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1a673039-4b5a-4572-a051-e38b86d05c2b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:45.063721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1a673039-4b5a-4572-a051-e38b86d05c2b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:45.066363 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1a673039-4b5a-4572-a051-e38b86d05c2b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1407 microversion: 2.20 time: 1.158136 Oct 10 23:31:45.084422 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1756/3423] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:31:43 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1407 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:31:45.289873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cf1a9cdb-e08b-47a0-a6ef-af43260a388d tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:45.291052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cf1a9cdb-e08b-47a0-a6ef-af43260a388d tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:45.292730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f5437edb-b70b-4529-b8fa-aa83465d1f1b tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a70fdc0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:45.307917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf1a9cdb-e08b-47a0-a6ef-af43260a388d tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:45.309885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf1a9cdb-e08b-47a0-a6ef-af43260a388d tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:45.310331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf1a9cdb-e08b-47a0-a6ef-af43260a388d tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:45.311854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf1a9cdb-e08b-47a0-a6ef-af43260a388d tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:45.312329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf1a9cdb-e08b-47a0-a6ef-af43260a388d tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:45.312770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf1a9cdb-e08b-47a0-a6ef-af43260a388d tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:45.376299 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f5437edb-b70b-4529-b8fa-aa83465d1f1b tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d" status: 200 len: 1453 microversion: 2.1 time: 0.089988 Oct 10 23:31:45.378022 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1757/3424] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:31:45 2022] GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:45.385269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-5f9b0b3e-ed21-4505-b4ea-1f16513fbb0c req-9bb1c2bb-62da-45cf-b2ca-9536b6c7dd7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06fefb7b-6f57-4489-a760-47dbcf05cbc9", "tag": "9b65ff34-25c7-4c66-91ae-1e7da5c00e40"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:31:45.412788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5f9b0b3e-ed21-4505-b4ea-1f16513fbb0c req-9bb1c2bb-62da-45cf-b2ca-9536b6c7dd7b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:45.413493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5f9b0b3e-ed21-4505-b4ea-1f16513fbb0c req-9bb1c2bb-62da-45cf-b2ca-9536b6c7dd7b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:45.414388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5f9b0b3e-ed21-4505-b4ea-1f16513fbb0c req-9bb1c2bb-62da-45cf-b2ca-9536b6c7dd7b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:45.440487 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-5f9b0b3e-ed21-4505-b4ea-1f16513fbb0c req-9bb1c2bb-62da-45cf-b2ca-9536b6c7dd7b service nova] Creating event network-changed:9b65ff34-25c7-4c66-91ae-1e7da5c00e40 for instance 06fefb7b-6f57-4489-a760-47dbcf05cbc9 on n-h1-860864-2 Oct 10 23:31:45.453984 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-5f9b0b3e-ed21-4505-b4ea-1f16513fbb0c req-9bb1c2bb-62da-45cf-b2ca-9536b6c7dd7b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074246 Oct 10 23:31:45.454902 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1758/3425] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:31:45.943883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cf1a9cdb-e08b-47a0-a6ef-af43260a388d tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:45.967781 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cf1a9cdb-e08b-47a0-a6ef-af43260a388d tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1482 microversion: 2.1 time: 0.677629 Oct 10 23:31:45.968962 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1668/3426] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:45 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1482 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:46.104616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7c46f7dd-93ed-4d32-a93f-54af5685f5fb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:46.105466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7c46f7dd-93ed-4d32-a93f-54af5685f5fb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:46.118930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c46f7dd-93ed-4d32-a93f-54af5685f5fb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:46.123707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c46f7dd-93ed-4d32-a93f-54af5685f5fb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:46.124209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c46f7dd-93ed-4d32-a93f-54af5685f5fb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:46.124978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c46f7dd-93ed-4d32-a93f-54af5685f5fb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:46.125479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c46f7dd-93ed-4d32-a93f-54af5685f5fb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:46.130010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c46f7dd-93ed-4d32-a93f-54af5685f5fb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:46.394182 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3f56d3d8-0368-464d-be78-43700b7df2fe tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a7edd30>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:46.480600 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3f56d3d8-0368-464d-be78-43700b7df2fe tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d" status: 200 len: 1453 microversion: 2.1 time: 0.092085 Oct 10 23:31:46.481467 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1669/3427] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:31:46 2022] GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:46.913289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7c46f7dd-93ed-4d32-a93f-54af5685f5fb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:46.932525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7c46f7dd-93ed-4d32-a93f-54af5685f5fb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:46.939490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7c46f7dd-93ed-4d32-a93f-54af5685f5fb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:46.955304 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7c46f7dd-93ed-4d32-a93f-54af5685f5fb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1407 microversion: 2.20 time: 0.856451 Oct 10 23:31:46.974230 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1759/3428] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:31:46 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1407 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:31:47.499132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ae50ad6c-0254-4d24-93a9-ed272995cb51 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a3ff940>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:47.603112 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ae50ad6c-0254-4d24-93a9-ed272995cb51 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d" status: 200 len: 1453 microversion: 2.1 time: 0.110074 Oct 10 23:31:47.610847 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1670/3429] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:31:47 2022] GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:47.988762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9e71a14b-b0fd-4f9b-b368-7a75d85ba1a1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:47.990168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9e71a14b-b0fd-4f9b-b368-7a75d85ba1a1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:48.005330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e71a14b-b0fd-4f9b-b368-7a75d85ba1a1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:48.011429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e71a14b-b0fd-4f9b-b368-7a75d85ba1a1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:48.016140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e71a14b-b0fd-4f9b-b368-7a75d85ba1a1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:48.023844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e71a14b-b0fd-4f9b-b368-7a75d85ba1a1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:48.024238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e71a14b-b0fd-4f9b-b368-7a75d85ba1a1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:48.024658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e71a14b-b0fd-4f9b-b368-7a75d85ba1a1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:48.616337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9e71a14b-b0fd-4f9b-b368-7a75d85ba1a1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:48.623569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7e8c59c8-3705-4e93-a82d-5c663fd627e4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a475700>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:48.638794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9e71a14b-b0fd-4f9b-b368-7a75d85ba1a1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:48.659226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9e71a14b-b0fd-4f9b-b368-7a75d85ba1a1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:48.666930 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9e71a14b-b0fd-4f9b-b368-7a75d85ba1a1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1407 microversion: 2.20 time: 0.676888 Oct 10 23:31:48.670770 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1760/3430] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:31:47 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1407 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:31:48.724504 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7e8c59c8-3705-4e93-a82d-5c663fd627e4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d" status: 200 len: 1453 microversion: 2.1 time: 0.105828 Oct 10 23:31:48.725103 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1671/3431] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:31:48 2022] GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:31:49.697913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-161567b0-0659-4e3d-b84c-ece716360c08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:49.699126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-161567b0-0659-4e3d-b84c-ece716360c08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:49.722467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-161567b0-0659-4e3d-b84c-ece716360c08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:49.723277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-161567b0-0659-4e3d-b84c-ece716360c08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:49.723959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-161567b0-0659-4e3d-b84c-ece716360c08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:49.732602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-161567b0-0659-4e3d-b84c-ece716360c08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:49.733731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-161567b0-0659-4e3d-b84c-ece716360c08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:49.734781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-161567b0-0659-4e3d-b84c-ece716360c08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:49.740055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e35bc82e-8435-4f64-9732-20fab7288543 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a3ff8b0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:49.840872 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e35bc82e-8435-4f64-9732-20fab7288543 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d" status: 200 len: 1453 microversion: 2.1 time: 0.104490 Oct 10 23:31:49.841508 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1672/3432] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:31:49 2022] GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:50.513272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7fec4bb8-b712-415d-b8a1-eed890e68ccf tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-2000537811", "imageRef": "7f25b2cc-92b7-4726-a3cf-382e10821f0d", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "d57816c3-dd59-4932-b56b-7983334125d4"}], "security_groups": [{"name": "tempest-securitygroup--556513858"}], "key_name": "tempest-keypair-1915257767", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:31:50.793078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-161567b0-0659-4e3d-b84c-ece716360c08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:50.809423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-161567b0-0659-4e3d-b84c-ece716360c08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:50.812314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-161567b0-0659-4e3d-b84c-ece716360c08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:50.813531 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-161567b0-0659-4e3d-b84c-ece716360c08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1407 microversion: 2.20 time: 1.120373 Oct 10 23:31:50.841689 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1761/3433] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:31:49 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1407 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:31:50.856310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2934fa72-f066-4820-9cec-3a8b6a58c923 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a700ee0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:50.951423 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2934fa72-f066-4820-9cec-3a8b6a58c923 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d" status: 200 len: 1453 microversion: 2.1 time: 0.098881 Oct 10 23:31:50.952043 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1762/3434] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:31:50 2022] GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:31:51.686840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-7fec4bb8-b712-415d-b8a1-eed890e68ccf tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] validate_networks() for [('d57816c3-dd59-4932-b56b-7983334125d4', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:31:51.839583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:31:51.845696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ed6d7ac8-7081-44a0-b04e-fa88e4ecef3a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:51.846607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ed6d7ac8-7081-44a0-b04e-fa88e4ecef3a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:51.867818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed6d7ac8-7081-44a0-b04e-fa88e4ecef3a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:51.868681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed6d7ac8-7081-44a0-b04e-fa88e4ecef3a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:51.870876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed6d7ac8-7081-44a0-b04e-fa88e4ecef3a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:51.871912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed6d7ac8-7081-44a0-b04e-fa88e4ecef3a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:51.874237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed6d7ac8-7081-44a0-b04e-fa88e4ecef3a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:51.876567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed6d7ac8-7081-44a0-b04e-fa88e4ecef3a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:53.018357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ed6d7ac8-7081-44a0-b04e-fa88e4ecef3a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:53.034430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ed6d7ac8-7081-44a0-b04e-fa88e4ecef3a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:53.037790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ed6d7ac8-7081-44a0-b04e-fa88e4ecef3a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:53.040730 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ed6d7ac8-7081-44a0-b04e-fa88e4ecef3a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1407 microversion: 2.20 time: 1.201930 Oct 10 23:31:53.045336 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1763/3435] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:31:51 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1407 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:31:53.054331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2cdd486b-5b33-412f-9771-268eb1f954ee tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a6ca4c0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:53.162854 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2cdd486b-5b33-412f-9771-268eb1f954ee tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d" status: 200 len: 1453 microversion: 2.1 time: 0.115719 Oct 10 23:31:53.165361 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1764/3436] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:31:53 2022] GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:53.565497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-7fec4bb8-b712-415d-b8a1-eed890e68ccf tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:31:53.566084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-7fec4bb8-b712-415d-b8a1-eed890e68ccf tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:31:53.566651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-7fec4bb8-b712-415d-b8a1-eed890e68ccf tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:31:53.567268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-7fec4bb8-b712-415d-b8a1-eed890e68ccf tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:31:53.567700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-7fec4bb8-b712-415d-b8a1-eed890e68ccf tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:31:53.613279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fec4bb8-b712-415d-b8a1-eed890e68ccf tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:53.613911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fec4bb8-b712-415d-b8a1-eed890e68ccf tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:53.615369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fec4bb8-b712-415d-b8a1-eed890e68ccf tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:53.618377 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fec4bb8-b712-415d-b8a1-eed890e68ccf tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:53.620052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fec4bb8-b712-415d-b8a1-eed890e68ccf tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:53.621656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fec4bb8-b712-415d-b8a1-eed890e68ccf tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:53.699965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-7fec4bb8-b712-415d-b8a1-eed890e68ccf tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Getting quotas for project dc49f6458751423bb1175f6fba6d6fdd. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:31:53.721869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-7fec4bb8-b712-415d-b8a1-eed890e68ccf tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Getting quotas for user bf589ecefc364edbb3fbb47fdd18da3e and project dc49f6458751423bb1175f6fba6d6fdd. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:31:53.751281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7fec4bb8-b712-415d-b8a1-eed890e68ccf tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:31:53.755622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7fec4bb8-b712-415d-b8a1-eed890e68ccf tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7f25b2cc-92b7-4726-a3cf-382e10821f0d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:31:53.871779 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7fec4bb8-b712-415d-b8a1-eed890e68ccf tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.363391 Oct 10 23:31:53.892400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7eb32687-c386-433a-bb3f-169a6c7e2c24 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:53.895787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7eb32687-c386-433a-bb3f-169a6c7e2c24 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:53.899201 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1673/3437] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:31:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 3392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:31:54.035101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7eb32687-c386-433a-bb3f-169a6c7e2c24 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf589ecefc364edbb3fbb47fdd18da3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f6458751423bb1175f6fba6d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:54.045704 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7eb32687-c386-433a-bb3f-169a6c7e2c24 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 200 len: 1246 microversion: 2.1 time: 0.159402 Oct 10 23:31:54.064805 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1765/3438] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:53 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 1246 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:54.077235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-893ca5fc-4066-438f-870e-d9a018f6b28d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:54.079169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-893ca5fc-4066-438f-870e-d9a018f6b28d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:54.152086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-8cc2f629-31b5-4399-bc02-34852807ff3a req-233c673e-cfbc-4516-b627-ae6afef60bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bd745fa-6826-4bd1-8f8d-ae65071fac12", "name": "network-vif-plugged", "status": "completed", "tag": "9a900297-53e2-4782-8def-24d4260702d5"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:31:54.158097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-893ca5fc-4066-438f-870e-d9a018f6b28d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:54.159128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-893ca5fc-4066-438f-870e-d9a018f6b28d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:54.159821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-893ca5fc-4066-438f-870e-d9a018f6b28d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:54.160773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-893ca5fc-4066-438f-870e-d9a018f6b28d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:54.161478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-893ca5fc-4066-438f-870e-d9a018f6b28d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:54.164217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-893ca5fc-4066-438f-870e-d9a018f6b28d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:54.185296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8cc2f629-31b5-4399-bc02-34852807ff3a req-233c673e-cfbc-4516-b627-ae6afef60bb1 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:54.186609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8cc2f629-31b5-4399-bc02-34852807ff3a req-233c673e-cfbc-4516-b627-ae6afef60bb1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:54.188323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8cc2f629-31b5-4399-bc02-34852807ff3a req-233c673e-cfbc-4516-b627-ae6afef60bb1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:54.253789 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-8cc2f629-31b5-4399-bc02-34852807ff3a req-233c673e-cfbc-4516-b627-ae6afef60bb1 service nova] Creating event network-vif-plugged:9a900297-53e2-4782-8def-24d4260702d5 for instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 on n-h1-860864-2 Oct 10 23:31:54.279738 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-8cc2f629-31b5-4399-bc02-34852807ff3a req-233c673e-cfbc-4516-b627-ae6afef60bb1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131184 Oct 10 23:31:54.284034 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1766/3439] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:31:54.307689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-da2a8ed1-d9e8-4468-be20-472395572b0e tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a723dc0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:54.455308 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-da2a8ed1-d9e8-4468-be20-472395572b0e tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d" status: 200 len: 1453 microversion: 2.1 time: 0.141030 Oct 10 23:31:54.459537 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1767/3440] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:31:54 2022] GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:55.060489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-893ca5fc-4066-438f-870e-d9a018f6b28d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:55.072014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-502e7e48-b33f-4340-9371-3c1bed278275 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:55.072767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-502e7e48-b33f-4340-9371-3c1bed278275 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:55.121417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-893ca5fc-4066-438f-870e-d9a018f6b28d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:55.127318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-893ca5fc-4066-438f-870e-d9a018f6b28d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:55.128628 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-893ca5fc-4066-438f-870e-d9a018f6b28d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1407 microversion: 2.20 time: 1.057074 Oct 10 23:31:55.137467 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1674/3441] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:31:54 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1407 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:31:55.479216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4abf357b-cf80-4d23-b078-b14aee91c0cf tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a46f3a0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:55.485875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-502e7e48-b33f-4340-9371-3c1bed278275 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf589ecefc364edbb3fbb47fdd18da3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f6458751423bb1175f6fba6d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:55.517015 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-502e7e48-b33f-4340-9371-3c1bed278275 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 200 len: 1246 microversion: 2.1 time: 0.447613 Oct 10 23:31:55.518266 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1768/3442] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:55 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 1246 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:31:55.576452 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4abf357b-cf80-4d23-b078-b14aee91c0cf tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d" status: 200 len: 1453 microversion: 2.1 time: 0.102469 Oct 10 23:31:55.579446 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1675/3443] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:31:55 2022] GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d => generated 1453 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:56.165546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-06401fb7-7da9-4629-8047-e2af6a74fa87 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:56.166577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-06401fb7-7da9-4629-8047-e2af6a74fa87 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:56.197664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06401fb7-7da9-4629-8047-e2af6a74fa87 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:56.201593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06401fb7-7da9-4629-8047-e2af6a74fa87 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:56.203975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06401fb7-7da9-4629-8047-e2af6a74fa87 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:56.205445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06401fb7-7da9-4629-8047-e2af6a74fa87 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:56.207487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06401fb7-7da9-4629-8047-e2af6a74fa87 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:56.209833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06401fb7-7da9-4629-8047-e2af6a74fa87 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:56.549816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7ff3f29b-5586-4278-84f6-8c2a02ce32ab tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:56.550607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7ff3f29b-5586-4278-84f6-8c2a02ce32ab tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:56.582987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ff3f29b-5586-4278-84f6-8c2a02ce32ab tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:56.584205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ff3f29b-5586-4278-84f6-8c2a02ce32ab tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:56.584872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ff3f29b-5586-4278-84f6-8c2a02ce32ab tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:56.586651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ff3f29b-5586-4278-84f6-8c2a02ce32ab tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:56.587740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ff3f29b-5586-4278-84f6-8c2a02ce32ab tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:56.588515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ff3f29b-5586-4278-84f6-8c2a02ce32ab tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:56.744516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-06401fb7-7da9-4629-8047-e2af6a74fa87 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:56.758892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-06401fb7-7da9-4629-8047-e2af6a74fa87 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:56.767888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-06401fb7-7da9-4629-8047-e2af6a74fa87 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:56.775825 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-06401fb7-7da9-4629-8047-e2af6a74fa87 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1407 microversion: 2.20 time: 0.614124 Oct 10 23:31:56.777710 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1769/3444] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:31:56 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1407 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:31:56.788648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b6aad275-a81b-4571-8e33-b1748f248fc1 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a700ee0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:56.938660 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b6aad275-a81b-4571-8e33-b1748f248fc1 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d" status: 200 len: 1453 microversion: 2.1 time: 0.159559 Oct 10 23:31:56.941569 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1770/3445] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:31:56 2022] GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:57.032766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7ff3f29b-5586-4278-84f6-8c2a02ce32ab tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf589ecefc364edbb3fbb47fdd18da3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f6458751423bb1175f6fba6d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:57.055938 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7ff3f29b-5586-4278-84f6-8c2a02ce32ab tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 200 len: 1242 microversion: 2.1 time: 0.513463 Oct 10 23:31:57.059509 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1676/3446] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:56 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 1242 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:57.841254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-036682cf-d6a0-4867-b00e-d0a99db33ca9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:57.842088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-036682cf-d6a0-4867-b00e-d0a99db33ca9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:57.872375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-036682cf-d6a0-4867-b00e-d0a99db33ca9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:57.874323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-036682cf-d6a0-4867-b00e-d0a99db33ca9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:57.875867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-036682cf-d6a0-4867-b00e-d0a99db33ca9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:57.878499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-036682cf-d6a0-4867-b00e-d0a99db33ca9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:57.879268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-036682cf-d6a0-4867-b00e-d0a99db33ca9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:57.883842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-036682cf-d6a0-4867-b00e-d0a99db33ca9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:57.957444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-16b2cd61-41aa-44e6-9f0c-abd2b562918b tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a5de280>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:58.178564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-036682cf-d6a0-4867-b00e-d0a99db33ca9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:58.196754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-036682cf-d6a0-4867-b00e-d0a99db33ca9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:58.199673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-036682cf-d6a0-4867-b00e-d0a99db33ca9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:58.202267 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-036682cf-d6a0-4867-b00e-d0a99db33ca9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1599 microversion: 2.20 time: 0.393146 Oct 10 23:31:58.203436 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1771/3447] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:31:57 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1599 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:31:58.210001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6e7c4dc9-669c-4090-acbb-fa89ff950539 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:58.211230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6e7c4dc9-669c-4090-acbb-fa89ff950539 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:58.221126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e7c4dc9-669c-4090-acbb-fa89ff950539 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:58.221938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e7c4dc9-669c-4090-acbb-fa89ff950539 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:58.222613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e7c4dc9-669c-4090-acbb-fa89ff950539 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:58.223550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e7c4dc9-669c-4090-acbb-fa89ff950539 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:58.224332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e7c4dc9-669c-4090-acbb-fa89ff950539 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:58.224701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e7c4dc9-669c-4090-acbb-fa89ff950539 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:58.357202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6e7c4dc9-669c-4090-acbb-fa89ff950539 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf589ecefc364edbb3fbb47fdd18da3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f6458751423bb1175f6fba6d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:31:58.380257 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6e7c4dc9-669c-4090-acbb-fa89ff950539 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 200 len: 1304 microversion: 2.1 time: 0.172578 Oct 10 23:31:58.380764 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1772/3448] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:58 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 1304 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:31:58.408854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c73621d2-0208-4e80-9e7c-ff45089c7dd2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:58.410686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c73621d2-0208-4e80-9e7c-ff45089c7dd2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:58.433814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c73621d2-0208-4e80-9e7c-ff45089c7dd2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:58.435505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c73621d2-0208-4e80-9e7c-ff45089c7dd2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:58.436154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c73621d2-0208-4e80-9e7c-ff45089c7dd2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:58.440720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c73621d2-0208-4e80-9e7c-ff45089c7dd2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:58.441823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c73621d2-0208-4e80-9e7c-ff45089c7dd2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:58.443311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c73621d2-0208-4e80-9e7c-ff45089c7dd2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:58.623276 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c73621d2-0208-4e80-9e7c-ff45089c7dd2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.239646 Oct 10 23:31:58.624836 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1773/3449] 10.222.0.23 () {60 vars in 1316 bytes} [Mon Oct 10 23:31:58 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-interface => generated 284 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:31:59.412763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-243f758a-9c30-4004-9ec2-0424eba4c3a0 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:31:59.417129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-243f758a-9c30-4004-9ec2-0424eba4c3a0 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:31:59.458071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-243f758a-9c30-4004-9ec2-0424eba4c3a0 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:59.462242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-243f758a-9c30-4004-9ec2-0424eba4c3a0 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:59.463837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-243f758a-9c30-4004-9ec2-0424eba4c3a0 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:31:59.467081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-243f758a-9c30-4004-9ec2-0424eba4c3a0 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:31:59.470929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-243f758a-9c30-4004-9ec2-0424eba4c3a0 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:31:59.474454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-243f758a-9c30-4004-9ec2-0424eba4c3a0 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:00.154209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-243f758a-9c30-4004-9ec2-0424eba4c3a0 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf589ecefc364edbb3fbb47fdd18da3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f6458751423bb1175f6fba6d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:00.207703 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-243f758a-9c30-4004-9ec2-0424eba4c3a0 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 200 len: 1304 microversion: 2.1 time: 0.796703 Oct 10 23:32:00.239113 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1774/3450] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:31:59 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 1304 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:01.245130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d326c2fe-3fd7-4488-9608-5810fe729f41 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:01.246124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d326c2fe-3fd7-4488-9608-5810fe729f41 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:01.294201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d326c2fe-3fd7-4488-9608-5810fe729f41 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:01.294962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d326c2fe-3fd7-4488-9608-5810fe729f41 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:01.295409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d326c2fe-3fd7-4488-9608-5810fe729f41 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:01.296181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d326c2fe-3fd7-4488-9608-5810fe729f41 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:01.296674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d326c2fe-3fd7-4488-9608-5810fe729f41 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:01.306870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d326c2fe-3fd7-4488-9608-5810fe729f41 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:01.587964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d326c2fe-3fd7-4488-9608-5810fe729f41 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf589ecefc364edbb3fbb47fdd18da3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f6458751423bb1175f6fba6d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:01.601119 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d326c2fe-3fd7-4488-9608-5810fe729f41 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 200 len: 1304 microversion: 2.1 time: 0.359950 Oct 10 23:32:01.602084 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1775/3451] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:01 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 1304 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:32:01.913927 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-16b2cd61-41aa-44e6-9f0c-abd2b562918b tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d" status: 200 len: 1462 microversion: 2.1 time: 3.961022 Oct 10 23:32:01.916564 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1677/3452] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:31:57 2022] GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d => generated 1462 bytes in 3965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:32:01.933079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f5af2e42-ae29-4d4e-a62b-9dd319dae8be tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f6633a95670>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:02.030442 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f5af2e42-ae29-4d4e-a62b-9dd319dae8be tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d" status: 200 len: 1462 microversion: 2.1 time: 0.102199 Oct 10 23:32:02.047795 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1776/3453] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:01 2022] GET /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d => generated 1462 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:02.055302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eed0bde1-ad94-498f-83a9-8c82aab37489 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:02.056014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eed0bde1-ad94-498f-83a9-8c82aab37489 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 430a8e18-4033-498b-8cf3-a224786b7363] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:02.113306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eed0bde1-ad94-498f-83a9-8c82aab37489 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:02.116245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eed0bde1-ad94-498f-83a9-8c82aab37489 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:02.116921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eed0bde1-ad94-498f-83a9-8c82aab37489 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:02.120111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eed0bde1-ad94-498f-83a9-8c82aab37489 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:02.122256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eed0bde1-ad94-498f-83a9-8c82aab37489 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:02.123127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eed0bde1-ad94-498f-83a9-8c82aab37489 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:02.990213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-721ef0e5-ed72-4845-ae9c-7e844e782667 req-2f78fe8d-ec1d-4356-a1ae-a24b1a75c3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bd745fa-6826-4bd1-8f8d-ae65071fac12", "tag": "9a900297-53e2-4782-8def-24d4260702d5"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:32:03.032179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-721ef0e5-ed72-4845-ae9c-7e844e782667 req-2f78fe8d-ec1d-4356-a1ae-a24b1a75c3f2 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:03.032831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-721ef0e5-ed72-4845-ae9c-7e844e782667 req-2f78fe8d-ec1d-4356-a1ae-a24b1a75c3f2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:03.033400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-721ef0e5-ed72-4845-ae9c-7e844e782667 req-2f78fe8d-ec1d-4356-a1ae-a24b1a75c3f2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:03.100346 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-721ef0e5-ed72-4845-ae9c-7e844e782667 req-2f78fe8d-ec1d-4356-a1ae-a24b1a75c3f2 service nova] Creating event network-changed:9a900297-53e2-4782-8def-24d4260702d5 for instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 on n-h1-860864-2 Oct 10 23:32:03.150407 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-721ef0e5-ed72-4845-ae9c-7e844e782667 req-2f78fe8d-ec1d-4356-a1ae-a24b1a75c3f2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.641805 Oct 10 23:32:03.151295 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1777/3454] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:32:03.172962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cc5ba029-db24-49d1-8ed1-6196b4f9906e tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:03.173808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cc5ba029-db24-49d1-8ed1-6196b4f9906e tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:03.191560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc5ba029-db24-49d1-8ed1-6196b4f9906e tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:03.192626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc5ba029-db24-49d1-8ed1-6196b4f9906e tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:03.193269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc5ba029-db24-49d1-8ed1-6196b4f9906e tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:03.194190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc5ba029-db24-49d1-8ed1-6196b4f9906e tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:03.195397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc5ba029-db24-49d1-8ed1-6196b4f9906e tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:03.196318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc5ba029-db24-49d1-8ed1-6196b4f9906e tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:03.444484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cc5ba029-db24-49d1-8ed1-6196b4f9906e tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf589ecefc364edbb3fbb47fdd18da3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f6458751423bb1175f6fba6d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:03.463445 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cc5ba029-db24-49d1-8ed1-6196b4f9906e tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 200 len: 1304 microversion: 2.1 time: 0.304032 Oct 10 23:32:03.479471 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1778/3455] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:03 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 1304 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:03.625149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-eed0bde1-ad94-498f-83a9-8c82aab37489 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:03.644565 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eed0bde1-ad94-498f-83a9-8c82aab37489 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363" status: 200 len: 1480 microversion: 2.1 time: 1.596709 Oct 10 23:32:03.649095 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1678/3456] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:02 2022] GET /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363 => generated 1480 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:04.491749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f57632d1-eca7-4c4d-a26d-f4417c8dd05f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:04.492669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f57632d1-eca7-4c4d-a26d-f4417c8dd05f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:04.505367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f57632d1-eca7-4c4d-a26d-f4417c8dd05f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:04.523562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f57632d1-eca7-4c4d-a26d-f4417c8dd05f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:04.529128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f57632d1-eca7-4c4d-a26d-f4417c8dd05f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:04.531167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f57632d1-eca7-4c4d-a26d-f4417c8dd05f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:04.536573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f57632d1-eca7-4c4d-a26d-f4417c8dd05f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:04.538826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f57632d1-eca7-4c4d-a26d-f4417c8dd05f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:04.612962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:32:04.613969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:32:04.621070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2a181362-74da-490b-8e43-e34071065050 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-692249651", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "cf183ed3-22d9-4fba-bf2c-b2de25f09d2d"}, {"uuid": "be4ac8de-14c8-4c38-af4b-297481888db9"}, {"uuid": "cf183ed3-22d9-4fba-bf2c-b2de25f09d2d"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:32:04.794065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-2a181362-74da-490b-8e43-e34071065050 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] validate_networks() for [('cf183ed3-22d9-4fba-bf2c-b2de25f09d2d', None, None, None, None, None), ('be4ac8de-14c8-4c38-af4b-297481888db9', None, None, None, None, None), ('cf183ed3-22d9-4fba-bf2c-b2de25f09d2d', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:32:05.211818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f57632d1-eca7-4c4d-a26d-f4417c8dd05f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf589ecefc364edbb3fbb47fdd18da3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f6458751423bb1175f6fba6d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:05.254080 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f57632d1-eca7-4c4d-a26d-f4417c8dd05f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 200 len: 1371 microversion: 2.1 time: 0.766485 Oct 10 23:32:05.264188 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1779/3457] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:04 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 1371 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:05.284337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bfb12d33-1b9d-4ca1-8eb9-0f16d3fed306 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:05.303139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bfb12d33-1b9d-4ca1-8eb9-0f16d3fed306 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 430a8e18-4033-498b-8cf3-a224786b7363] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:05.331947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfb12d33-1b9d-4ca1-8eb9-0f16d3fed306 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:05.341203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfb12d33-1b9d-4ca1-8eb9-0f16d3fed306 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:05.343767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfb12d33-1b9d-4ca1-8eb9-0f16d3fed306 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:05.344666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfb12d33-1b9d-4ca1-8eb9-0f16d3fed306 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:05.351474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfb12d33-1b9d-4ca1-8eb9-0f16d3fed306 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:05.358228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bfb12d33-1b9d-4ca1-8eb9-0f16d3fed306 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:05.520807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:32:05.976361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bfb12d33-1b9d-4ca1-8eb9-0f16d3fed306 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:06.001184 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bfb12d33-1b9d-4ca1-8eb9-0f16d3fed306 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363" status: 200 len: 1467 microversion: 2.1 time: 0.729604 Oct 10 23:32:06.005290 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1780/3458] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:05 2022] GET /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363 => generated 1467 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:06.042915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d8aa73c2-ef1d-473b-905c-0bb33600e487 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-976144626"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:32:06.050889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d8aa73c2-ef1d-473b-905c-0bb33600e487 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:06.074082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8aa73c2-ef1d-473b-905c-0bb33600e487 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:06.075057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8aa73c2-ef1d-473b-905c-0bb33600e487 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:06.075681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8aa73c2-ef1d-473b-905c-0bb33600e487 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:06.076589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8aa73c2-ef1d-473b-905c-0bb33600e487 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:06.077219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8aa73c2-ef1d-473b-905c-0bb33600e487 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:06.078250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8aa73c2-ef1d-473b-905c-0bb33600e487 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:06.189847 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:32:07.882608 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d8aa73c2-ef1d-473b-905c-0bb33600e487 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "POST /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1/action" status: 202 len: 0 microversion: 2.1 time: 1.833483 Oct 10 23:32:07.888331 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1781/3459] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:32:06 2022] POST /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1/action => generated 0 bytes in 1855 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 23:32:07.896604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-178dd00f-19d9-470b-87aa-9fee589f9fcd tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:07.899631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-178dd00f-19d9-470b-87aa-9fee589f9fcd tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:07.906823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-178dd00f-19d9-470b-87aa-9fee589f9fcd tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:07.909763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-178dd00f-19d9-470b-87aa-9fee589f9fcd tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:07.910595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-178dd00f-19d9-470b-87aa-9fee589f9fcd tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:07.912607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-178dd00f-19d9-470b-87aa-9fee589f9fcd tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:07.921543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-178dd00f-19d9-470b-87aa-9fee589f9fcd tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:07.924578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-178dd00f-19d9-470b-87aa-9fee589f9fcd tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:09.225339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-178dd00f-19d9-470b-87aa-9fee589f9fcd tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf589ecefc364edbb3fbb47fdd18da3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f6458751423bb1175f6fba6d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:09.242763 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-178dd00f-19d9-470b-87aa-9fee589f9fcd tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 200 len: 1371 microversion: 2.1 time: 1.350984 Oct 10 23:32:09.266236 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1782/3460] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:07 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 1371 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:09.271900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-f944de99-b397-46a8-801b-7d8ba85edd93 req-b902f11c-4ee7-4c6f-9e93-609643c84c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430a8e18-4033-498b-8cf3-a224786b7363", "name": "network-vif-unplugged", "status": "completed", "tag": "a2e7d038-4684-44fd-a359-4f01f2732cbf"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:32:09.295781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f944de99-b397-46a8-801b-7d8ba85edd93 req-b902f11c-4ee7-4c6f-9e93-609643c84c3e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:09.298138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f944de99-b397-46a8-801b-7d8ba85edd93 req-b902f11c-4ee7-4c6f-9e93-609643c84c3e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:09.300739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f944de99-b397-46a8-801b-7d8ba85edd93 req-b902f11c-4ee7-4c6f-9e93-609643c84c3e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:09.330868 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-f944de99-b397-46a8-801b-7d8ba85edd93 req-b902f11c-4ee7-4c6f-9e93-609643c84c3e service nova] Creating event network-vif-unplugged:a2e7d038-4684-44fd-a359-4f01f2732cbf for instance 430a8e18-4033-498b-8cf3-a224786b7363 on n-h2-860864-2 Oct 10 23:32:09.350108 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-f944de99-b397-46a8-801b-7d8ba85edd93 req-b902f11c-4ee7-4c6f-9e93-609643c84c3e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076736 Oct 10 23:32:09.354978 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1783/3461] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:32:09.360729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8c7820d4-a0a6-4ea4-9d82-fd1b66d507d1 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a6dbf70>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:09.465180 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8c7820d4-a0a6-4ea4-9d82-fd1b66d507d1 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1" status: 200 len: 1452 microversion: 2.1 time: 0.108232 Oct 10 23:32:09.469469 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1784/3462] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:09 2022] GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1 => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:10.293586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b6cc0dd3-c7cd-4404-8768-868ab4640797 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:10.301016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b6cc0dd3-c7cd-4404-8768-868ab4640797 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:10.305456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:32:10.334878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6cc0dd3-c7cd-4404-8768-868ab4640797 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:10.339008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6cc0dd3-c7cd-4404-8768-868ab4640797 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:10.342294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6cc0dd3-c7cd-4404-8768-868ab4640797 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:10.344230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6cc0dd3-c7cd-4404-8768-868ab4640797 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:10.346861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6cc0dd3-c7cd-4404-8768-868ab4640797 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:10.348554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6cc0dd3-c7cd-4404-8768-868ab4640797 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:11.019201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b6cc0dd3-c7cd-4404-8768-868ab4640797 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf589ecefc364edbb3fbb47fdd18da3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f6458751423bb1175f6fba6d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:11.034470 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b6cc0dd3-c7cd-4404-8768-868ab4640797 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 200 len: 1371 microversion: 2.1 time: 0.749105 Oct 10 23:32:11.037741 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1785/3463] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:10 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 1371 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:11.051592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f17d71f1-2ad3-44b3-9e8d-ad8d61d4c63d tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a711ee0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:11.180181 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f17d71f1-2ad3-44b3-9e8d-ad8d61d4c63d tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1" status: 200 len: 1452 microversion: 2.1 time: 0.136955 Oct 10 23:32:11.190523 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1786/3464] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:11 2022] GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:11.593534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-2a181362-74da-490b-8e43-e34071065050 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:32:11.595444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-2a181362-74da-490b-8e43-e34071065050 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:32:11.596788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-2a181362-74da-490b-8e43-e34071065050 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:32:11.597940 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-2a181362-74da-490b-8e43-e34071065050 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:32:11.599397 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-2a181362-74da-490b-8e43-e34071065050 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:32:11.651484 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a181362-74da-490b-8e43-e34071065050 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:11.654165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a181362-74da-490b-8e43-e34071065050 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:11.656900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a181362-74da-490b-8e43-e34071065050 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:11.658598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a181362-74da-490b-8e43-e34071065050 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:11.661040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a181362-74da-490b-8e43-e34071065050 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:11.682532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a181362-74da-490b-8e43-e34071065050 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:11.729606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=46 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:32:11.768056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-2a181362-74da-490b-8e43-e34071065050 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Getting quotas for project 70836dfc36f744ab8f26c1b47be26ff4. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:32:11.781820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-2a181362-74da-490b-8e43-e34071065050 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Getting quotas for user 781bd1f2871245399de1db53d1d9ad42 and project 70836dfc36f744ab8f26c1b47be26ff4. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:32:11.808501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2a181362-74da-490b-8e43-e34071065050 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:32:11.834157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2a181362-74da-490b-8e43-e34071065050 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:32:11.943022 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2a181362-74da-490b-8e43-e34071065050 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.330924 Oct 10 23:32:11.951153 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1679/3465] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:32:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 7338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:32:11.962587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2b21d859-39ce-48e9-9fae-ad3d38ff2ac3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:11.963231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2b21d859-39ce-48e9-9fae-ad3d38ff2ac3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:12.067743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b4419f3d-a46e-4120-a014-a7508db3b338 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:12.068395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b4419f3d-a46e-4120-a014-a7508db3b338 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:12.097881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4419f3d-a46e-4120-a014-a7508db3b338 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:12.098396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4419f3d-a46e-4120-a014-a7508db3b338 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:12.098859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4419f3d-a46e-4120-a014-a7508db3b338 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:12.099790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4419f3d-a46e-4120-a014-a7508db3b338 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:12.100230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4419f3d-a46e-4120-a014-a7508db3b338 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:12.101280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4419f3d-a46e-4120-a014-a7508db3b338 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:12.232311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2b21d859-39ce-48e9-9fae-ad3d38ff2ac3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:12.251787 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2b21d859-39ce-48e9-9fae-ad3d38ff2ac3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1212 microversion: 2.1 time: 0.293225 Oct 10 23:32:12.255989 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1787/3466] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:11 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1212 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:12.282060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-91f77e89-221c-41ec-a671-5f4e85bcb4c7 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a6dba60>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:12.495191 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-91f77e89-221c-41ec-a671-5f4e85bcb4c7 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1" status: 200 len: 1452 microversion: 2.1 time: 0.233793 Oct 10 23:32:12.495879 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1788/3467] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:12 2022] GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1 => generated 1452 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:13.293613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dc39a5d3-509f-4151-87e2-33e0e70dad1e tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:13.294241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dc39a5d3-509f-4151-87e2-33e0e70dad1e tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:13.433185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b4419f3d-a46e-4120-a014-a7508db3b338 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf589ecefc364edbb3fbb47fdd18da3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f6458751423bb1175f6fba6d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:13.501126 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b4419f3d-a46e-4120-a014-a7508db3b338 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 200 len: 1371 microversion: 2.1 time: 1.422771 Oct 10 23:32:13.535506 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1680/3468] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:12 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 1371 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:32:13.833554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dc39a5d3-509f-4151-87e2-33e0e70dad1e tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:13.860279 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dc39a5d3-509f-4151-87e2-33e0e70dad1e tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1212 microversion: 2.1 time: 0.574204 Oct 10 23:32:13.892404 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1789/3469] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:13 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1212 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:13.912819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6de2ba04-0739-4f82-a0ab-4f2872cc3a47 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a6eb5e0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:14.107811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-32c75b7c-a417-4af7-a57f-4bf60385a769 req-7ba336e5-6385-4057-ba47-c43009de352c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9", "tag": "48151735-8714-45d6-be4d-dfcf9910b276"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:32:14.228193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:32:14.247120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-32c75b7c-a417-4af7-a57f-4bf60385a769 req-7ba336e5-6385-4057-ba47-c43009de352c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:14.252856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-32c75b7c-a417-4af7-a57f-4bf60385a769 req-7ba336e5-6385-4057-ba47-c43009de352c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:14.258896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-32c75b7c-a417-4af7-a57f-4bf60385a769 req-7ba336e5-6385-4057-ba47-c43009de352c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:14.346455 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-32c75b7c-a417-4af7-a57f-4bf60385a769 req-7ba336e5-6385-4057-ba47-c43009de352c service nova] Creating event network-changed:48151735-8714-45d6-be4d-dfcf9910b276 for instance 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 on n-h2-860864-2 Oct 10 23:32:14.389044 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-32c75b7c-a417-4af7-a57f-4bf60385a769 req-7ba336e5-6385-4057-ba47-c43009de352c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.837697 Oct 10 23:32:14.391949 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1681/3470] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:32:14.530668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-80d85d81-bbd4-4932-9695-fadc4189733d tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:14.532648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-80d85d81-bbd4-4932-9695-fadc4189733d tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:14.555479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80d85d81-bbd4-4932-9695-fadc4189733d tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:14.558169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80d85d81-bbd4-4932-9695-fadc4189733d tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:14.566344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80d85d81-bbd4-4932-9695-fadc4189733d tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:14.567509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80d85d81-bbd4-4932-9695-fadc4189733d tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:14.568291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80d85d81-bbd4-4932-9695-fadc4189733d tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:14.570744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80d85d81-bbd4-4932-9695-fadc4189733d tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:15.601339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-80d85d81-bbd4-4932-9695-fadc4189733d tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf589ecefc364edbb3fbb47fdd18da3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f6458751423bb1175f6fba6d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:15.615789 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-80d85d81-bbd4-4932-9695-fadc4189733d tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 200 len: 1371 microversion: 2.1 time: 1.087808 Oct 10 23:32:15.632202 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1682/3471] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:14 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 1371 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:16.330771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7212446b-c603-47b8-ada1-6aa2c64d37e4 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:16.343110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7212446b-c603-47b8-ada1-6aa2c64d37e4 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:16.348002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7212446b-c603-47b8-ada1-6aa2c64d37e4 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:16.355475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7212446b-c603-47b8-ada1-6aa2c64d37e4 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:16.363923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7212446b-c603-47b8-ada1-6aa2c64d37e4 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:16.369836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7212446b-c603-47b8-ada1-6aa2c64d37e4 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:16.373595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7212446b-c603-47b8-ada1-6aa2c64d37e4 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:16.484065 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7212446b-c603-47b8-ada1-6aa2c64d37e4 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.862681 Oct 10 23:32:16.487496 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1683/3472] 10.222.0.23 () {58 vars in 1185 bytes} [Mon Oct 10 23:32:15 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:32:16.500885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a82f0b44-9d06-437d-bfa0-772ca1a37a26 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:16.504555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a82f0b44-9d06-437d-bfa0-772ca1a37a26 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:16.521193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a82f0b44-9d06-437d-bfa0-772ca1a37a26 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:16.524689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a82f0b44-9d06-437d-bfa0-772ca1a37a26 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:16.526260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a82f0b44-9d06-437d-bfa0-772ca1a37a26 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:16.529146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a82f0b44-9d06-437d-bfa0-772ca1a37a26 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:16.530530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a82f0b44-9d06-437d-bfa0-772ca1a37a26 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:16.532775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a82f0b44-9d06-437d-bfa0-772ca1a37a26 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:17.279257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a82f0b44-9d06-437d-bfa0-772ca1a37a26 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:17.302346 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a82f0b44-9d06-437d-bfa0-772ca1a37a26 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1270 microversion: 2.1 time: 0.811797 Oct 10 23:32:17.305195 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1684/3473] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:16 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1270 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:17.327523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-43f4e473-5b4b-475e-85b3-96c5be78b78e tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:17.344525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-43f4e473-5b4b-475e-85b3-96c5be78b78e tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:17.345743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-43f4e473-5b4b-475e-85b3-96c5be78b78e tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Searching by: {'deleted': False, 'project_id': '94d503df54a645478e49e6bec5886fa7'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:32:17.365719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43f4e473-5b4b-475e-85b3-96c5be78b78e tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:17.366410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43f4e473-5b4b-475e-85b3-96c5be78b78e tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:17.369521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43f4e473-5b4b-475e-85b3-96c5be78b78e tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:17.370901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43f4e473-5b4b-475e-85b3-96c5be78b78e tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:17.373677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43f4e473-5b4b-475e-85b3-96c5be78b78e tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:17.377902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43f4e473-5b4b-475e-85b3-96c5be78b78e tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:17.458209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.multi_cell_list [None req-43f4e473-5b4b-475e-85b3-96c5be78b78e tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:32:17.575703 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-43f4e473-5b4b-475e-85b3-96c5be78b78e tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.264062 Oct 10 23:32:17.601876 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1685/3474] 10.222.0.23 () {58 vars in 1125 bytes} [Mon Oct 10 23:32:17 2022] GET /compute/v2.1/servers => generated 344 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:32:17.646022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2270e86c-4bca-4f0b-abbe-3329dc9fd95d tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:17.650251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2270e86c-4bca-4f0b-abbe-3329dc9fd95d tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:17.684025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2270e86c-4bca-4f0b-abbe-3329dc9fd95d tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:17.691220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2270e86c-4bca-4f0b-abbe-3329dc9fd95d tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:17.692401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2270e86c-4bca-4f0b-abbe-3329dc9fd95d tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:17.696264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2270e86c-4bca-4f0b-abbe-3329dc9fd95d tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:17.703147 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2270e86c-4bca-4f0b-abbe-3329dc9fd95d tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:17.704302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2270e86c-4bca-4f0b-abbe-3329dc9fd95d tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:18.450241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2270e86c-4bca-4f0b-abbe-3329dc9fd95d tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf589ecefc364edbb3fbb47fdd18da3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f6458751423bb1175f6fba6d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:18.463623 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2270e86c-4bca-4f0b-abbe-3329dc9fd95d tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 200 len: 1371 microversion: 2.1 time: 0.858967 Oct 10 23:32:18.464880 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1686/3475] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:17 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 1371 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:18.477911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-34a5b612-a98b-49dc-8714-288756bd5067 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-554665105", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "availability_zone": "nova:n-h2-860864-2", "networks": [{"uuid": "b69f9d41-1588-4e5d-96f8-c1e5b0da5782"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:32:19.393840 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6de2ba04-0739-4f82-a0ab-4f2872cc3a47 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1" status: 200 len: 1452 microversion: 2.1 time: 5.497583 Oct 10 23:32:19.396563 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1790/3476] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:13 2022] GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1 => generated 1452 bytes in 5503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:19.843855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-0d910e50-1792-4129-a644-bb340fabe1e2 req-00b7308b-c3a4-4bf1-b15e-dda090db4040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "037ebfb5-534f-42db-9838-462de4b299e1", "name": "network-vif-plugged", "status": "completed", "tag": "0945733a-182f-4aab-9346-e59fa6b3c813"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:32:19.892424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0d910e50-1792-4129-a644-bb340fabe1e2 req-00b7308b-c3a4-4bf1-b15e-dda090db4040 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:19.893972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0d910e50-1792-4129-a644-bb340fabe1e2 req-00b7308b-c3a4-4bf1-b15e-dda090db4040 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:19.895221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0d910e50-1792-4129-a644-bb340fabe1e2 req-00b7308b-c3a4-4bf1-b15e-dda090db4040 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:19.920638 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-0d910e50-1792-4129-a644-bb340fabe1e2 req-00b7308b-c3a4-4bf1-b15e-dda090db4040 service nova] Creating event network-vif-plugged:0945733a-182f-4aab-9346-e59fa6b3c813 for instance 037ebfb5-534f-42db-9838-462de4b299e1 on n-h2-860864-2 Oct 10 23:32:19.930599 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-0d910e50-1792-4129-a644-bb340fabe1e2 req-00b7308b-c3a4-4bf1-b15e-dda090db4040 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.529572 Oct 10 23:32:19.931823 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1791/3477] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:32:19.942935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cf2ae474-3567-4f44-8c10-2f5c0609cb71 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:19.981114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cf2ae474-3567-4f44-8c10-2f5c0609cb71 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:19.997135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cf2ae474-3567-4f44-8c10-2f5c0609cb71 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Searching by: {'deleted': False, 'project_id': '94d503df54a645478e49e6bec5886fa7'} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:32:20.003567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf2ae474-3567-4f44-8c10-2f5c0609cb71 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:20.004514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf2ae474-3567-4f44-8c10-2f5c0609cb71 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:20.005162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf2ae474-3567-4f44-8c10-2f5c0609cb71 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:20.006386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf2ae474-3567-4f44-8c10-2f5c0609cb71 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:20.007737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf2ae474-3567-4f44-8c10-2f5c0609cb71 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:20.008389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf2ae474-3567-4f44-8c10-2f5c0609cb71 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:20.060418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.multi_cell_list [None req-cf2ae474-3567-4f44-8c10-2f5c0609cb71 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120613) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:32:20.189337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cf2ae474-3567-4f44-8c10-2f5c0609cb71 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:20.221582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf2ae474-3567-4f44-8c10-2f5c0609cb71 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:20.223819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf2ae474-3567-4f44-8c10-2f5c0609cb71 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:20.226143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf2ae474-3567-4f44-8c10-2f5c0609cb71 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:20.541246 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cf2ae474-3567-4f44-8c10-2f5c0609cb71 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.606164 Oct 10 23:32:20.542636 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1792/3478] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:32:19 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:20.575300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3274517c-2fd4-47d9-9848-8ca6437450f0 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:20.576428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3274517c-2fd4-47d9-9848-8ca6437450f0 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:20.610074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3274517c-2fd4-47d9-9848-8ca6437450f0 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:20.610579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3274517c-2fd4-47d9-9848-8ca6437450f0 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:20.611022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3274517c-2fd4-47d9-9848-8ca6437450f0 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:20.611747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3274517c-2fd4-47d9-9848-8ca6437450f0 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:20.612199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3274517c-2fd4-47d9-9848-8ca6437450f0 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:20.612632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3274517c-2fd4-47d9-9848-8ca6437450f0 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:20.756069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-34a5b612-a98b-49dc-8714-288756bd5067 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] validate_networks() for [('b69f9d41-1588-4e5d-96f8-c1e5b0da5782', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:32:21.015268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3274517c-2fd4-47d9-9848-8ca6437450f0 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:21.028530 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3274517c-2fd4-47d9-9848-8ca6437450f0 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1333 microversion: 2.1 time: 0.482398 Oct 10 23:32:21.029787 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1793/3479] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:20 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1333 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:21.046989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e59d3de5-c2ca-4e6d-a158-d57fa979f529 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:21.048229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e59d3de5-c2ca-4e6d-a158-d57fa979f529 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:21.063921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e59d3de5-c2ca-4e6d-a158-d57fa979f529 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:21.064733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e59d3de5-c2ca-4e6d-a158-d57fa979f529 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:21.068526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e59d3de5-c2ca-4e6d-a158-d57fa979f529 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:21.070354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e59d3de5-c2ca-4e6d-a158-d57fa979f529 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:21.071077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e59d3de5-c2ca-4e6d-a158-d57fa979f529 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:21.071772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e59d3de5-c2ca-4e6d-a158-d57fa979f529 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:21.283790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e59d3de5-c2ca-4e6d-a158-d57fa979f529 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf589ecefc364edbb3fbb47fdd18da3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f6458751423bb1175f6fba6d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:21.295301 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e59d3de5-c2ca-4e6d-a158-d57fa979f529 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 200 len: 1371 microversion: 2.1 time: 0.264080 Oct 10 23:32:21.296125 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1794/3480] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:21 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 1371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:21.301544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4dbc4cc8-4358-4909-a8bd-5417d7619771 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a6dbe50>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:21.801811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:32:21.994793 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4dbc4cc8-4358-4909-a8bd-5417d7619771 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1" status: 200 len: 1452 microversion: 2.1 time: 0.697409 Oct 10 23:32:21.995609 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1795/3481] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:21 2022] GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1 => generated 1452 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:22.015160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7841332d-1007-40c2-9b23-8e785a14f4f5 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:22.065476 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7841332d-1007-40c2-9b23-8e785a14f4f5 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.068940 Oct 10 23:32:22.066083 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1796/3482] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:32:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:32:22.104942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3682e311-1356-47fd-9f66-7cd1deb04a40 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:22.105655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3682e311-1356-47fd-9f66-7cd1deb04a40 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:22.137940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3682e311-1356-47fd-9f66-7cd1deb04a40 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:22.143279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3682e311-1356-47fd-9f66-7cd1deb04a40 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:22.147624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3682e311-1356-47fd-9f66-7cd1deb04a40 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:22.149863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3682e311-1356-47fd-9f66-7cd1deb04a40 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:22.153528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3682e311-1356-47fd-9f66-7cd1deb04a40 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:22.157134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3682e311-1356-47fd-9f66-7cd1deb04a40 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:22.652811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3682e311-1356-47fd-9f66-7cd1deb04a40 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:22.671750 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3682e311-1356-47fd-9f66-7cd1deb04a40 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1354 microversion: 2.1 time: 0.588862 Oct 10 23:32:22.674354 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1797/3483] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:22 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1354 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:22.696177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a1160300-4cd5-4649-8aa6-1d9dcca9a5c7 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:22.699429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a1160300-4cd5-4649-8aa6-1d9dcca9a5c7 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:22.740572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1160300-4cd5-4649-8aa6-1d9dcca9a5c7 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:22.742124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1160300-4cd5-4649-8aa6-1d9dcca9a5c7 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:22.744501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1160300-4cd5-4649-8aa6-1d9dcca9a5c7 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:22.746072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1160300-4cd5-4649-8aa6-1d9dcca9a5c7 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:22.746910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1160300-4cd5-4649-8aa6-1d9dcca9a5c7 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:22.747655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1160300-4cd5-4649-8aa6-1d9dcca9a5c7 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:22.856040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-34a5b612-a98b-49dc-8714-288756bd5067 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:32:22.856785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-34a5b612-a98b-49dc-8714-288756bd5067 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:32:22.857700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-34a5b612-a98b-49dc-8714-288756bd5067 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:32:22.858672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-34a5b612-a98b-49dc-8714-288756bd5067 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:32:22.859716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-34a5b612-a98b-49dc-8714-288756bd5067 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:32:22.909618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34a5b612-a98b-49dc-8714-288756bd5067 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:22.910493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34a5b612-a98b-49dc-8714-288756bd5067 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:22.911119 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34a5b612-a98b-49dc-8714-288756bd5067 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:22.913006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34a5b612-a98b-49dc-8714-288756bd5067 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:22.913829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34a5b612-a98b-49dc-8714-288756bd5067 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:22.919796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34a5b612-a98b-49dc-8714-288756bd5067 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:22.988485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-34a5b612-a98b-49dc-8714-288756bd5067 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Getting quotas for project 660d21b04521487788ef25594b766535. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:32:23.003244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-34a5b612-a98b-49dc-8714-288756bd5067 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Getting quotas for user dd58422e676e49d89a5887adc4547afe and project 660d21b04521487788ef25594b766535. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:32:23.041024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-34a5b612-a98b-49dc-8714-288756bd5067 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:32:23.046571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-34a5b612-a98b-49dc-8714-288756bd5067 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: 1a33db0d-a765-49a1-b396-9c68f6ed22c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:32:23.190427 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-34a5b612-a98b-49dc-8714-288756bd5067 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.724042 Oct 10 23:32:23.190984 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1687/3484] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:32:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 4725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:32:23.222788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-582ef8cb-ada7-423e-9057-ca9bc5cc6cee tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:23.223302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-582ef8cb-ada7-423e-9057-ca9bc5cc6cee tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:23.242884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-582ef8cb-ada7-423e-9057-ca9bc5cc6cee tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:23.243377 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-582ef8cb-ada7-423e-9057-ca9bc5cc6cee tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:23.243826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-582ef8cb-ada7-423e-9057-ca9bc5cc6cee tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:23.244563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-582ef8cb-ada7-423e-9057-ca9bc5cc6cee tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:23.245064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-582ef8cb-ada7-423e-9057-ca9bc5cc6cee tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:23.252295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-582ef8cb-ada7-423e-9057-ca9bc5cc6cee tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:23.276256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a1160300-4cd5-4649-8aa6-1d9dcca9a5c7 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf589ecefc364edbb3fbb47fdd18da3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f6458751423bb1175f6fba6d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:23.291247 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a1160300-4cd5-4649-8aa6-1d9dcca9a5c7 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 200 len: 1371 microversion: 2.1 time: 0.610042 Oct 10 23:32:23.297205 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1798/3485] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:22 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 1371 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:23.304376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-57c2aa7c-a617-47a9-b980-616717e54a9d tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f6633994790>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:23.327890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-582ef8cb-ada7-423e-9057-ca9bc5cc6cee tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:32:23.566199 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-582ef8cb-ada7-423e-9057-ca9bc5cc6cee tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "DELETE /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 204 len: 0 microversion: 2.1 time: 0.367296 Oct 10 23:32:23.569247 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1688/3486] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:32:23 2022] DELETE /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:32:23.580348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ba6c84ce-02db-4eb6-b478-75701b46c811 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:23.580978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ba6c84ce-02db-4eb6-b478-75701b46c811 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: 1a33db0d-a765-49a1-b396-9c68f6ed22c0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:23.728091 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ba6c84ce-02db-4eb6-b478-75701b46c811 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0" status: 200 len: 1328 microversion: 2.1 time: 0.157424 Oct 10 23:32:23.730668 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1689/3487] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:23 2022] GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0 => generated 1328 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:23.740065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0f296ac2-f09b-4e1b-896b-8e9abee186b6 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:23.744907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0f296ac2-f09b-4e1b-896b-8e9abee186b6 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:23.758650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f296ac2-f09b-4e1b-896b-8e9abee186b6 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:23.759375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f296ac2-f09b-4e1b-896b-8e9abee186b6 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:23.761273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f296ac2-f09b-4e1b-896b-8e9abee186b6 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:23.763421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f296ac2-f09b-4e1b-896b-8e9abee186b6 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:23.764062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f296ac2-f09b-4e1b-896b-8e9abee186b6 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:23.766238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f296ac2-f09b-4e1b-896b-8e9abee186b6 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:23.826470 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-57c2aa7c-a617-47a9-b980-616717e54a9d tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1" status: 200 len: 1452 microversion: 2.1 time: 0.527854 Oct 10 23:32:23.834870 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1799/3488] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:23 2022] GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1 => generated 1452 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:23.854490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-76494466-956b-4662-af5f-bcfad79242e3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:23.861891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-76494466-956b-4662-af5f-bcfad79242e3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:23.878891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76494466-956b-4662-af5f-bcfad79242e3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:23.882683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76494466-956b-4662-af5f-bcfad79242e3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:23.886171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76494466-956b-4662-af5f-bcfad79242e3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:23.888373 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76494466-956b-4662-af5f-bcfad79242e3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:23.888870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76494466-956b-4662-af5f-bcfad79242e3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:23.889319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76494466-956b-4662-af5f-bcfad79242e3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:24.223832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0f296ac2-f09b-4e1b-896b-8e9abee186b6 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:24.248702 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0f296ac2-f09b-4e1b-896b-8e9abee186b6 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1607 microversion: 2.1 time: 0.516423 Oct 10 23:32:24.267149 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1690/3489] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:23 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1607 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:24.319875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-90cfaf08-d823-4a26-9c1e-8bafa8136db1 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:24.321087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-90cfaf08-d823-4a26-9c1e-8bafa8136db1 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:24.349082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90cfaf08-d823-4a26-9c1e-8bafa8136db1 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:24.350530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90cfaf08-d823-4a26-9c1e-8bafa8136db1 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:24.351980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90cfaf08-d823-4a26-9c1e-8bafa8136db1 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:24.355031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90cfaf08-d823-4a26-9c1e-8bafa8136db1 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:24.360882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90cfaf08-d823-4a26-9c1e-8bafa8136db1 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:24.364827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90cfaf08-d823-4a26-9c1e-8bafa8136db1 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:24.452169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-76494466-956b-4662-af5f-bcfad79242e3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:24.468867 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-76494466-956b-4662-af5f-bcfad79242e3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1354 microversion: 2.1 time: 0.632586 Oct 10 23:32:24.476668 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1800/3490] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:23 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1354 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:24.689199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-7fe44593-024f-4918-a068-a84172438d59 req-a5ccd2e3-1a66-47d5-9056-79c4f9b7a926 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3ca263a-16c7-4514-963e-6a008e39baa5", "tag": "c6c7d195-16f8-4f6a-bbf0-90c1e1cd08fd"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:32:24.715393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7fe44593-024f-4918-a068-a84172438d59 req-a5ccd2e3-1a66-47d5-9056-79c4f9b7a926 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:24.721434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7fe44593-024f-4918-a068-a84172438d59 req-a5ccd2e3-1a66-47d5-9056-79c4f9b7a926 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:24.722193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7fe44593-024f-4918-a068-a84172438d59 req-a5ccd2e3-1a66-47d5-9056-79c4f9b7a926 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:24.739682 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-7fe44593-024f-4918-a068-a84172438d59 req-a5ccd2e3-1a66-47d5-9056-79c4f9b7a926 service nova] Creating event network-changed:c6c7d195-16f8-4f6a-bbf0-90c1e1cd08fd for instance d3ca263a-16c7-4514-963e-6a008e39baa5 on n-h1-860864-2 Oct 10 23:32:24.769001 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-7fe44593-024f-4918-a068-a84172438d59 req-a5ccd2e3-1a66-47d5-9056-79c4f9b7a926 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083788 Oct 10 23:32:24.770321 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1801/3491] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:32:24.780647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3cf46891-28fb-4fed-bf82-7daace557e7f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:24.783208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3cf46891-28fb-4fed-bf82-7daace557e7f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: 1a33db0d-a765-49a1-b396-9c68f6ed22c0] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:24.814938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cf46891-28fb-4fed-bf82-7daace557e7f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:24.815716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cf46891-28fb-4fed-bf82-7daace557e7f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:24.816333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cf46891-28fb-4fed-bf82-7daace557e7f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:24.826278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cf46891-28fb-4fed-bf82-7daace557e7f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:24.827297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cf46891-28fb-4fed-bf82-7daace557e7f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:24.830594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cf46891-28fb-4fed-bf82-7daace557e7f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:24.953597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-90cfaf08-d823-4a26-9c1e-8bafa8136db1 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf589ecefc364edbb3fbb47fdd18da3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f6458751423bb1175f6fba6d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:24.969294 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-90cfaf08-d823-4a26-9c1e-8bafa8136db1 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 200 len: 1371 microversion: 2.1 time: 0.657991 Oct 10 23:32:24.980347 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1691/3492] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:24 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 1371 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:32:24.992457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2b192642-10e4-410f-bef2-1139576f4ee3 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a45c1f0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:25.041288 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3cf46891-28fb-4fed-bf82-7daace557e7f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0" status: 200 len: 1337 microversion: 2.1 time: 0.269224 Oct 10 23:32:25.042039 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1802/3493] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:24 2022] GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0 => generated 1337 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:25.293810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3d1caf2e-d529-4bbe-bb49-79888c10ee65 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:25.295616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3d1caf2e-d529-4bbe-bb49-79888c10ee65 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:25.321144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d1caf2e-d529-4bbe-bb49-79888c10ee65 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:25.331375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d1caf2e-d529-4bbe-bb49-79888c10ee65 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:25.332108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d1caf2e-d529-4bbe-bb49-79888c10ee65 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:25.334588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d1caf2e-d529-4bbe-bb49-79888c10ee65 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:25.335701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d1caf2e-d529-4bbe-bb49-79888c10ee65 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:25.336404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d1caf2e-d529-4bbe-bb49-79888c10ee65 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:25.465144 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2b192642-10e4-410f-bef2-1139576f4ee3 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1" status: 200 len: 1452 microversion: 2.1 time: 0.482757 Oct 10 23:32:25.467763 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1692/3494] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:24 2022] GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1 => generated 1452 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:25.514584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d940bbfd-515b-406c-9355-493fc9b1a1f8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:25.515690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d940bbfd-515b-406c-9355-493fc9b1a1f8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:25.547107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d940bbfd-515b-406c-9355-493fc9b1a1f8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:25.547757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d940bbfd-515b-406c-9355-493fc9b1a1f8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:25.550540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d940bbfd-515b-406c-9355-493fc9b1a1f8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:25.552277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d940bbfd-515b-406c-9355-493fc9b1a1f8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:25.552886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d940bbfd-515b-406c-9355-493fc9b1a1f8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:25.557219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d940bbfd-515b-406c-9355-493fc9b1a1f8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:25.641979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3d1caf2e-d529-4bbe-bb49-79888c10ee65 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:25.656922 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3d1caf2e-d529-4bbe-bb49-79888c10ee65 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1607 microversion: 2.1 time: 0.371641 Oct 10 23:32:25.658865 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1803/3495] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:25 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1607 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:25.998528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f0c49bca-43f4-4304-bdb2-0ef4f799c28f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:25.999456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f0c49bca-43f4-4304-bdb2-0ef4f799c28f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:26.014094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0c49bca-43f4-4304-bdb2-0ef4f799c28f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:26.016380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0c49bca-43f4-4304-bdb2-0ef4f799c28f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:26.016920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0c49bca-43f4-4304-bdb2-0ef4f799c28f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:26.020555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0c49bca-43f4-4304-bdb2-0ef4f799c28f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:26.021182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0c49bca-43f4-4304-bdb2-0ef4f799c28f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:26.023462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0c49bca-43f4-4304-bdb2-0ef4f799c28f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:26.143599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d940bbfd-515b-406c-9355-493fc9b1a1f8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:26.152329 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d940bbfd-515b-406c-9355-493fc9b1a1f8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1354 microversion: 2.1 time: 0.655573 Oct 10 23:32:26.159598 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1693/3496] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:25 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1354 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:26.173305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a803cd41-16ba-4d29-bf77-5cf3f6a38618 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:26.180230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a803cd41-16ba-4d29-bf77-5cf3f6a38618 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: 1a33db0d-a765-49a1-b396-9c68f6ed22c0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:26.201187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a803cd41-16ba-4d29-bf77-5cf3f6a38618 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:26.202899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a803cd41-16ba-4d29-bf77-5cf3f6a38618 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:26.203371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a803cd41-16ba-4d29-bf77-5cf3f6a38618 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:26.204124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a803cd41-16ba-4d29-bf77-5cf3f6a38618 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:26.204594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a803cd41-16ba-4d29-bf77-5cf3f6a38618 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:26.205030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a803cd41-16ba-4d29-bf77-5cf3f6a38618 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:26.413648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f0c49bca-43f4-4304-bdb2-0ef4f799c28f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf589ecefc364edbb3fbb47fdd18da3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f6458751423bb1175f6fba6d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:26.431796 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f0c49bca-43f4-4304-bdb2-0ef4f799c28f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 200 len: 1371 microversion: 2.1 time: 0.437203 Oct 10 23:32:26.432455 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1804/3497] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:25 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 1371 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:32:26.441346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-6570313b-8078-4535-a46a-8279b94e10ab req-ff263c99-2f63-46b3-883a-69fd01358230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9", "name": "network-vif-plugged", "status": "completed", "tag": "48151735-8714-45d6-be4d-dfcf9910b276"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:32:26.468824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6570313b-8078-4535-a46a-8279b94e10ab req-ff263c99-2f63-46b3-883a-69fd01358230 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:26.469331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6570313b-8078-4535-a46a-8279b94e10ab req-ff263c99-2f63-46b3-883a-69fd01358230 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:26.469845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6570313b-8078-4535-a46a-8279b94e10ab req-ff263c99-2f63-46b3-883a-69fd01358230 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:26.500408 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-6570313b-8078-4535-a46a-8279b94e10ab req-ff263c99-2f63-46b3-883a-69fd01358230 service nova] Creating event network-vif-plugged:48151735-8714-45d6-be4d-dfcf9910b276 for instance 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 on n-h2-860864-2 Oct 10 23:32:26.510344 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-6570313b-8078-4535-a46a-8279b94e10ab req-ff263c99-2f63-46b3-883a-69fd01358230 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076438 Oct 10 23:32:26.515286 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1805/3498] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:32:26.521632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-502734b6-fcd1-4f11-b263-4dfc89042340 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a7154c0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:26.604413 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-502734b6-fcd1-4f11-b263-4dfc89042340 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1" status: 200 len: 1452 microversion: 2.1 time: 0.087666 Oct 10 23:32:26.614823 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1806/3499] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:26 2022] GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1 => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:26.705930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-58f735ae-8742-49a6-9098-0662a5c2dd34 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:26.708147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-58f735ae-8742-49a6-9098-0662a5c2dd34 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:26.718446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58f735ae-8742-49a6-9098-0662a5c2dd34 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:26.719417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58f735ae-8742-49a6-9098-0662a5c2dd34 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:26.720437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58f735ae-8742-49a6-9098-0662a5c2dd34 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:26.721872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58f735ae-8742-49a6-9098-0662a5c2dd34 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:26.723816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58f735ae-8742-49a6-9098-0662a5c2dd34 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:26.724711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58f735ae-8742-49a6-9098-0662a5c2dd34 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:27.009063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-58f735ae-8742-49a6-9098-0662a5c2dd34 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:27.034000 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-58f735ae-8742-49a6-9098-0662a5c2dd34 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1607 microversion: 2.1 time: 0.332710 Oct 10 23:32:27.034648 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1807/3500] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:26 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1607 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:27.093475 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a803cd41-16ba-4d29-bf77-5cf3f6a38618 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0" status: 200 len: 1423 microversion: 2.1 time: 0.929371 Oct 10 23:32:27.117817 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1694/3501] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:26 2022] GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0 => generated 1423 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:27.197047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3844b5b8-ab33-4bb1-a3a8-1a49f385ca8d tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:27.198360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3844b5b8-ab33-4bb1-a3a8-1a49f385ca8d tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:27.220327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3844b5b8-ab33-4bb1-a3a8-1a49f385ca8d tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:27.220938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3844b5b8-ab33-4bb1-a3a8-1a49f385ca8d tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:27.222216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3844b5b8-ab33-4bb1-a3a8-1a49f385ca8d tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:27.222712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3844b5b8-ab33-4bb1-a3a8-1a49f385ca8d tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:27.223270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3844b5b8-ab33-4bb1-a3a8-1a49f385ca8d tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:27.223942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3844b5b8-ab33-4bb1-a3a8-1a49f385ca8d tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:27.462438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-51a2c926-b6f8-4410-8a12-3ae9dad38b9e tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:27.463301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-51a2c926-b6f8-4410-8a12-3ae9dad38b9e tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:27.470637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51a2c926-b6f8-4410-8a12-3ae9dad38b9e tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:27.471549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51a2c926-b6f8-4410-8a12-3ae9dad38b9e tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:27.472216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51a2c926-b6f8-4410-8a12-3ae9dad38b9e tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:27.473173 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51a2c926-b6f8-4410-8a12-3ae9dad38b9e tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:27.473895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51a2c926-b6f8-4410-8a12-3ae9dad38b9e tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:27.474548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51a2c926-b6f8-4410-8a12-3ae9dad38b9e tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:27.553622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3844b5b8-ab33-4bb1-a3a8-1a49f385ca8d tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:27.572967 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3844b5b8-ab33-4bb1-a3a8-1a49f385ca8d tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1354 microversion: 2.1 time: 0.381649 Oct 10 23:32:27.574986 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1808/3502] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:27 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1354 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:27.623288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-21a2e402-c267-479f-8279-93809ee76650 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662af4bdc0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:27.739871 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-21a2e402-c267-479f-8279-93809ee76650 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1" status: 200 len: 1452 microversion: 2.1 time: 0.121066 Oct 10 23:32:27.771596 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1809/3503] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:27 2022] GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:28.067886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cc22e402-9828-4811-b943-35d32f502131 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:28.069236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cc22e402-9828-4811-b943-35d32f502131 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:28.081647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc22e402-9828-4811-b943-35d32f502131 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:28.082635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc22e402-9828-4811-b943-35d32f502131 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:28.083190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc22e402-9828-4811-b943-35d32f502131 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:28.084248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc22e402-9828-4811-b943-35d32f502131 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:28.085442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc22e402-9828-4811-b943-35d32f502131 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:28.086026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc22e402-9828-4811-b943-35d32f502131 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:28.093790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:32:28.310554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cc22e402-9828-4811-b943-35d32f502131 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:28.324016 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cc22e402-9828-4811-b943-35d32f502131 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1607 microversion: 2.1 time: 0.265461 Oct 10 23:32:28.324629 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1810/3504] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:28 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1607 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:28.356610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-155bf94f-670f-4aae-9c9f-980cc3f24f68 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:28.359139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-155bf94f-670f-4aae-9c9f-980cc3f24f68 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: 1a33db0d-a765-49a1-b396-9c68f6ed22c0] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:28.370682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-155bf94f-670f-4aae-9c9f-980cc3f24f68 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:28.371187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-155bf94f-670f-4aae-9c9f-980cc3f24f68 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:28.372159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-155bf94f-670f-4aae-9c9f-980cc3f24f68 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:28.372878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-155bf94f-670f-4aae-9c9f-980cc3f24f68 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:28.373331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-155bf94f-670f-4aae-9c9f-980cc3f24f68 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:28.373786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-155bf94f-670f-4aae-9c9f-980cc3f24f68 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:28.498925 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-155bf94f-670f-4aae-9c9f-980cc3f24f68 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0" status: 200 len: 1421 microversion: 2.1 time: 0.156542 Oct 10 23:32:28.500059 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1811/3505] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:28 2022] GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0 => generated 1421 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:28.577366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-51a2c926-b6f8-4410-8a12-3ae9dad38b9e tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf589ecefc364edbb3fbb47fdd18da3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f6458751423bb1175f6fba6d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:28.607344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1d2877b3-7d51-4ed9-b419-0f13fed902db tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:28.611637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1d2877b3-7d51-4ed9-b419-0f13fed902db tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:28.626877 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-51a2c926-b6f8-4410-8a12-3ae9dad38b9e tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 200 len: 1371 microversion: 2.1 time: 1.169780 Oct 10 23:32:28.627769 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1695/3506] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:27 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 1371 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:28.672346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d2877b3-7d51-4ed9-b419-0f13fed902db tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:28.674720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d2877b3-7d51-4ed9-b419-0f13fed902db tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:28.675929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d2877b3-7d51-4ed9-b419-0f13fed902db tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:28.677262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d2877b3-7d51-4ed9-b419-0f13fed902db tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:28.685673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d2877b3-7d51-4ed9-b419-0f13fed902db tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:28.687008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d2877b3-7d51-4ed9-b419-0f13fed902db tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:28.758125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-20b4e7cf-fdb9-47a0-851b-486873415500 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a5f5ee0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:28.912254 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-20b4e7cf-fdb9-47a0-851b-486873415500 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1" status: 200 len: 1452 microversion: 2.1 time: 0.153348 Oct 10 23:32:28.914612 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1696/3507] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:28 2022] GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:32:29.166902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1d2877b3-7d51-4ed9-b419-0f13fed902db tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:29.183810 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1d2877b3-7d51-4ed9-b419-0f13fed902db tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1354 microversion: 2.1 time: 0.586823 Oct 10 23:32:29.194977 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1812/3508] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:28 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1354 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:29.357113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d3186a49-dfb5-4dc4-9a10-ef1e58ec1c78 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:29.358956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d3186a49-dfb5-4dc4-9a10-ef1e58ec1c78 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:29.377485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3186a49-dfb5-4dc4-9a10-ef1e58ec1c78 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:29.382536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3186a49-dfb5-4dc4-9a10-ef1e58ec1c78 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:29.383334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3186a49-dfb5-4dc4-9a10-ef1e58ec1c78 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:29.388892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3186a49-dfb5-4dc4-9a10-ef1e58ec1c78 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:29.389967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3186a49-dfb5-4dc4-9a10-ef1e58ec1c78 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:29.390722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3186a49-dfb5-4dc4-9a10-ef1e58ec1c78 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:29.511093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-8e4cf557-0c72-4b0c-b90d-2faa80692ab2 req-2ae750a8-6533-4f1c-8377-3943a1e9f932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3ca263a-16c7-4514-963e-6a008e39baa5", "tag": "d5ffc3e2-26b3-4e5c-9e72-e1e71d3304a4"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:32:29.539749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8e4cf557-0c72-4b0c-b90d-2faa80692ab2 req-2ae750a8-6533-4f1c-8377-3943a1e9f932 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:29.544943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8e4cf557-0c72-4b0c-b90d-2faa80692ab2 req-2ae750a8-6533-4f1c-8377-3943a1e9f932 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:29.545680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8e4cf557-0c72-4b0c-b90d-2faa80692ab2 req-2ae750a8-6533-4f1c-8377-3943a1e9f932 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:29.582733 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-8e4cf557-0c72-4b0c-b90d-2faa80692ab2 req-2ae750a8-6533-4f1c-8377-3943a1e9f932 service nova] Creating event network-changed:d5ffc3e2-26b3-4e5c-9e72-e1e71d3304a4 for instance d3ca263a-16c7-4514-963e-6a008e39baa5 on n-h1-860864-2 Oct 10 23:32:29.601121 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-8e4cf557-0c72-4b0c-b90d-2faa80692ab2 req-2ae750a8-6533-4f1c-8377-3943a1e9f932 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093569 Oct 10 23:32:29.622305 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1813/3509] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:32:29.648855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-013fc01e-94f0-4db8-b62b-cc67a6961c98 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:29.662342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-013fc01e-94f0-4db8-b62b-cc67a6961c98 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: 1a33db0d-a765-49a1-b396-9c68f6ed22c0] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:29.686084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-013fc01e-94f0-4db8-b62b-cc67a6961c98 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:29.687706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-013fc01e-94f0-4db8-b62b-cc67a6961c98 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:29.696961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-013fc01e-94f0-4db8-b62b-cc67a6961c98 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:29.699610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-013fc01e-94f0-4db8-b62b-cc67a6961c98 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:29.707600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-013fc01e-94f0-4db8-b62b-cc67a6961c98 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:29.712727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-013fc01e-94f0-4db8-b62b-cc67a6961c98 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:29.789889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d3186a49-dfb5-4dc4-9a10-ef1e58ec1c78 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:29.805235 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d3186a49-dfb5-4dc4-9a10-ef1e58ec1c78 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1541 microversion: 2.1 time: 0.455620 Oct 10 23:32:29.809534 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1697/3510] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:29 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1541 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:29.823599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f41030b9-b8b3-425a-9ae3-4c0187f7a6a1 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:29.831598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f41030b9-b8b3-425a-9ae3-4c0187f7a6a1 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:29.855387 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f41030b9-b8b3-425a-9ae3-4c0187f7a6a1 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:29.859513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f41030b9-b8b3-425a-9ae3-4c0187f7a6a1 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:29.860065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f41030b9-b8b3-425a-9ae3-4c0187f7a6a1 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:29.860896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f41030b9-b8b3-425a-9ae3-4c0187f7a6a1 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:29.861458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f41030b9-b8b3-425a-9ae3-4c0187f7a6a1 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:29.862158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f41030b9-b8b3-425a-9ae3-4c0187f7a6a1 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:30.028646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:32:30.171039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:32:30.375739 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-013fc01e-94f0-4db8-b62b-cc67a6961c98 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0" status: 200 len: 1463 microversion: 2.1 time: 0.751106 Oct 10 23:32:30.377001 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1814/3511] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:29 2022] GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0 => generated 1463 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:30.398689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ceca9322-9756-40f5-bff5-5994a67bcf17 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a6eb9d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:30.466221 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ceca9322-9756-40f5-bff5-5994a67bcf17 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1" status: 200 len: 1452 microversion: 2.1 time: 0.083022 Oct 10 23:32:30.487451 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1815/3512] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:30 2022] GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:30.502154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0e423a91-cefb-466b-88f5-a3b47dfcf341 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:30.503409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0e423a91-cefb-466b-88f5-a3b47dfcf341 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:30.521478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e423a91-cefb-466b-88f5-a3b47dfcf341 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:30.521478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e423a91-cefb-466b-88f5-a3b47dfcf341 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:30.521478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e423a91-cefb-466b-88f5-a3b47dfcf341 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:30.521478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e423a91-cefb-466b-88f5-a3b47dfcf341 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:30.521478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e423a91-cefb-466b-88f5-a3b47dfcf341 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:30.529761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e423a91-cefb-466b-88f5-a3b47dfcf341 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:30.693502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f41030b9-b8b3-425a-9ae3-4c0187f7a6a1 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf589ecefc364edbb3fbb47fdd18da3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f6458751423bb1175f6fba6d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:30.712052 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f41030b9-b8b3-425a-9ae3-4c0187f7a6a1 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 200 len: 1558 microversion: 2.1 time: 0.901271 Oct 10 23:32:30.728321 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1698/3513] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:29 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 1558 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:30.741501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1ba9cf24-ef7d-4ad5-97f2-22c40d19a2dd tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:30.742390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1ba9cf24-ef7d-4ad5-97f2-22c40d19a2dd tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:30.753807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ba9cf24-ef7d-4ad5-97f2-22c40d19a2dd tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:30.755071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ba9cf24-ef7d-4ad5-97f2-22c40d19a2dd tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:30.755985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ba9cf24-ef7d-4ad5-97f2-22c40d19a2dd tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:30.757513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ba9cf24-ef7d-4ad5-97f2-22c40d19a2dd tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:30.759096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ba9cf24-ef7d-4ad5-97f2-22c40d19a2dd tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:30.759800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ba9cf24-ef7d-4ad5-97f2-22c40d19a2dd tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:30.787294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:32:30.897980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0e423a91-cefb-466b-88f5-a3b47dfcf341 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:30.931272 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0e423a91-cefb-466b-88f5-a3b47dfcf341 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1354 microversion: 2.1 time: 0.440263 Oct 10 23:32:30.934253 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1816/3514] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:30 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1354 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:30.947112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5c378f84-c3ae-46b8-baae-1b8a7fc5ebc3 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:30.953322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5c378f84-c3ae-46b8-baae-1b8a7fc5ebc3 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:30.968994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c378f84-c3ae-46b8-baae-1b8a7fc5ebc3 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:30.969988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c378f84-c3ae-46b8-baae-1b8a7fc5ebc3 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:30.970283 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1ba9cf24-ef7d-4ad5-97f2-22c40d19a2dd tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.233678 Oct 10 23:32:30.970790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c378f84-c3ae-46b8-baae-1b8a7fc5ebc3 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:30.971646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c378f84-c3ae-46b8-baae-1b8a7fc5ebc3 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:30.972074 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1699/3515] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Oct 10 23:32:30 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9/os-interface => generated 285 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:32:30.981361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c378f84-c3ae-46b8-baae-1b8a7fc5ebc3 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:30.981361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c378f84-c3ae-46b8-baae-1b8a7fc5ebc3 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:31.169009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5c378f84-c3ae-46b8-baae-1b8a7fc5ebc3 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:31.182769 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5c378f84-c3ae-46b8-baae-1b8a7fc5ebc3 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1541 microversion: 2.1 time: 0.246524 Oct 10 23:32:31.184565 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1817/3516] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:30 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1541 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:31.403621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0b1bfa7d-646e-43a3-85d4-2aebd53c8baa tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:31.404249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0b1bfa7d-646e-43a3-85d4-2aebd53c8baa tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: 1a33db0d-a765-49a1-b396-9c68f6ed22c0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:31.417018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b1bfa7d-646e-43a3-85d4-2aebd53c8baa tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:31.417560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b1bfa7d-646e-43a3-85d4-2aebd53c8baa tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:31.417985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b1bfa7d-646e-43a3-85d4-2aebd53c8baa tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:31.418705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b1bfa7d-646e-43a3-85d4-2aebd53c8baa tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:31.419202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b1bfa7d-646e-43a3-85d4-2aebd53c8baa tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:31.419883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b1bfa7d-646e-43a3-85d4-2aebd53c8baa tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:31.490271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2c998964-b512-43cf-9b39-57088695534b tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f66339851f0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:32.382924 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2c998964-b512-43cf-9b39-57088695534b tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1" status: 200 len: 1452 microversion: 2.1 time: 0.896593 Oct 10 23:32:32.383876 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1818/3517] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:31 2022] GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1 => generated 1452 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:32.389640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-baef68cc-e6c4-4c55-bef0-105299604310 req-727d3ca5-de28-49bb-9005-7849f17d3eea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06fefb7b-6f57-4489-a760-47dbcf05cbc9", "name": "network-vif-deleted", "tag": "9b65ff34-25c7-4c66-91ae-1e7da5c00e40"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:32:32.474543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-baef68cc-e6c4-4c55-bef0-105299604310 req-727d3ca5-de28-49bb-9005-7849f17d3eea service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:32.495195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-baef68cc-e6c4-4c55-bef0-105299604310 req-727d3ca5-de28-49bb-9005-7849f17d3eea service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:32.495731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-baef68cc-e6c4-4c55-bef0-105299604310 req-727d3ca5-de28-49bb-9005-7849f17d3eea service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:32.523941 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-baef68cc-e6c4-4c55-bef0-105299604310 req-727d3ca5-de28-49bb-9005-7849f17d3eea service nova] Creating event network-vif-deleted:9b65ff34-25c7-4c66-91ae-1e7da5c00e40 for instance 06fefb7b-6f57-4489-a760-47dbcf05cbc9 on n-h1-860864-2 Oct 10 23:32:32.534770 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-baef68cc-e6c4-4c55-bef0-105299604310 req-727d3ca5-de28-49bb-9005-7849f17d3eea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149607 Oct 10 23:32:32.536062 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1819/3518] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:32:32.555003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-adc144a1-40a6-465d-93bb-ce749cd4e7a2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:32.570206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-adc144a1-40a6-465d-93bb-ce749cd4e7a2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:32.591853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc144a1-40a6-465d-93bb-ce749cd4e7a2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:32.592644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc144a1-40a6-465d-93bb-ce749cd4e7a2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:32.593361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc144a1-40a6-465d-93bb-ce749cd4e7a2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:32.594317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc144a1-40a6-465d-93bb-ce749cd4e7a2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:32.594948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc144a1-40a6-465d-93bb-ce749cd4e7a2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:32.595547 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc144a1-40a6-465d-93bb-ce749cd4e7a2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:32.957956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=8 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:32:33.035193 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0b1bfa7d-646e-43a3-85d4-2aebd53c8baa tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0" status: 200 len: 1463 microversion: 2.1 time: 1.637028 Oct 10 23:32:33.035804 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1700/3519] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:31 2022] GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0 => generated 1463 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:33.063283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d59e2557-13d4-400b-9dc8-83cf1404e51e tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:33.063919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d59e2557-13d4-400b-9dc8-83cf1404e51e tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:33.084950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d59e2557-13d4-400b-9dc8-83cf1404e51e tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:33.085619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d59e2557-13d4-400b-9dc8-83cf1404e51e tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:33.099062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d59e2557-13d4-400b-9dc8-83cf1404e51e tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:33.101059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d59e2557-13d4-400b-9dc8-83cf1404e51e tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:33.103616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d59e2557-13d4-400b-9dc8-83cf1404e51e tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:33.105579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d59e2557-13d4-400b-9dc8-83cf1404e51e tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:33.355269 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d59e2557-13d4-400b-9dc8-83cf1404e51e tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:33.373620 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d59e2557-13d4-400b-9dc8-83cf1404e51e tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1252 microversion: 2.1 time: 0.336669 Oct 10 23:32:33.374279 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1701/3520] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:33 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1252 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:33.401151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d3e799a2-cbcf-4c98-848a-5447e7887352 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a3c3670>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:33.520975 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d3e799a2-cbcf-4c98-848a-5447e7887352 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1" status: 200 len: 1452 microversion: 2.1 time: 0.116174 Oct 10 23:32:33.524983 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1702/3521] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:33 2022] GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1 => generated 1452 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:32:33.909181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-adc144a1-40a6-465d-93bb-ce749cd4e7a2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:33.924151 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-adc144a1-40a6-465d-93bb-ce749cd4e7a2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1354 microversion: 2.1 time: 1.386383 Oct 10 23:32:33.934136 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1820/3522] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:32 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1354 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:34.064107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=8 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:32:34.074325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9b17825e-7cec-4973-b937-19daf53d583f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:34.074899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9b17825e-7cec-4973-b937-19daf53d583f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: 1a33db0d-a765-49a1-b396-9c68f6ed22c0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:34.093512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b17825e-7cec-4973-b937-19daf53d583f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:34.094221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b17825e-7cec-4973-b937-19daf53d583f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:34.094862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b17825e-7cec-4973-b937-19daf53d583f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:34.095804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b17825e-7cec-4973-b937-19daf53d583f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:34.096420 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b17825e-7cec-4973-b937-19daf53d583f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:34.097009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b17825e-7cec-4973-b937-19daf53d583f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:34.238192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-62c4459b-7ae2-409e-8786-bb648a0bf92a req-6823c20c-6654-4948-ac45-53c7acd91619 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9", "tag": "48151735-8714-45d6-be4d-dfcf9910b276"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:32:34.262157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-62c4459b-7ae2-409e-8786-bb648a0bf92a req-6823c20c-6654-4948-ac45-53c7acd91619 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:34.263290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-62c4459b-7ae2-409e-8786-bb648a0bf92a req-6823c20c-6654-4948-ac45-53c7acd91619 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:34.264682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-62c4459b-7ae2-409e-8786-bb648a0bf92a req-6823c20c-6654-4948-ac45-53c7acd91619 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:34.314225 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-62c4459b-7ae2-409e-8786-bb648a0bf92a req-6823c20c-6654-4948-ac45-53c7acd91619 service nova] Creating event network-changed:48151735-8714-45d6-be4d-dfcf9910b276 for instance 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 on n-h2-860864-2 Oct 10 23:32:34.343033 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-62c4459b-7ae2-409e-8786-bb648a0bf92a req-6823c20c-6654-4948-ac45-53c7acd91619 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108427 Oct 10 23:32:34.344436 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1821/3523] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:32:34.405027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9b10a7ef-e92c-48af-84df-89682a223a1f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:34.406243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9b10a7ef-e92c-48af-84df-89682a223a1f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:34.438473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b10a7ef-e92c-48af-84df-89682a223a1f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:34.439817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b10a7ef-e92c-48af-84df-89682a223a1f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:34.443293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b10a7ef-e92c-48af-84df-89682a223a1f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:34.448077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b10a7ef-e92c-48af-84df-89682a223a1f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:34.454973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b10a7ef-e92c-48af-84df-89682a223a1f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:34.458544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b10a7ef-e92c-48af-84df-89682a223a1f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:34.691573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9b10a7ef-e92c-48af-84df-89682a223a1f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:34.700544 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9b10a7ef-e92c-48af-84df-89682a223a1f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1252 microversion: 2.1 time: 0.300637 Oct 10 23:32:34.701161 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1822/3524] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:34 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1252 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:32:34.737110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1dad381c-c676-4847-84ec-221c7b3f3010 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a6db940>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:34.847430 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1dad381c-c676-4847-84ec-221c7b3f3010 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1" status: 200 len: 1452 microversion: 2.1 time: 0.119567 Oct 10 23:32:34.848352 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1823/3525] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:34 2022] GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1 => generated 1452 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:34.910322 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9b17825e-7cec-4973-b937-19daf53d583f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0" status: 200 len: 1463 microversion: 2.1 time: 0.847153 Oct 10 23:32:34.917110 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1703/3526] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:34 2022] GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0 => generated 1463 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:34.962286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d49350db-ef60-4ac3-be35-47a804450f5b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:34.963036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d49350db-ef60-4ac3-be35-47a804450f5b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:34.977502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-c14cdf6c-efc4-4a4c-a5b2-ed8c0257ec0b req-bb1b2b84-04d7-405e-930e-7a4666f5c99e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a33db0d-a765-49a1-b396-9c68f6ed22c0", "tag": "92595afa-bb6f-4233-b8c4-ca6163d7f856"}, {"name": "network-changed", "server_uuid": "d3ca263a-16c7-4514-963e-6a008e39baa5", "tag": "754eb733-038d-4f6b-a16c-1e4489b638de"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:32:34.983245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d49350db-ef60-4ac3-be35-47a804450f5b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:34.994299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d49350db-ef60-4ac3-be35-47a804450f5b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:34.997021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d49350db-ef60-4ac3-be35-47a804450f5b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:34.998066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d49350db-ef60-4ac3-be35-47a804450f5b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:35.000788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d49350db-ef60-4ac3-be35-47a804450f5b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:35.001556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d49350db-ef60-4ac3-be35-47a804450f5b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:35.005752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c14cdf6c-efc4-4a4c-a5b2-ed8c0257ec0b req-bb1b2b84-04d7-405e-930e-7a4666f5c99e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:35.010223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c14cdf6c-efc4-4a4c-a5b2-ed8c0257ec0b req-bb1b2b84-04d7-405e-930e-7a4666f5c99e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:35.011018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c14cdf6c-efc4-4a4c-a5b2-ed8c0257ec0b req-bb1b2b84-04d7-405e-930e-7a4666f5c99e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:35.066048 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-c14cdf6c-efc4-4a4c-a5b2-ed8c0257ec0b req-bb1b2b84-04d7-405e-930e-7a4666f5c99e service nova] Creating event network-changed:92595afa-bb6f-4233-b8c4-ca6163d7f856 for instance 1a33db0d-a765-49a1-b396-9c68f6ed22c0 on n-h2-860864-2 Oct 10 23:32:35.066697 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-c14cdf6c-efc4-4a4c-a5b2-ed8c0257ec0b req-bb1b2b84-04d7-405e-930e-7a4666f5c99e service nova] Creating event network-changed:754eb733-038d-4f6b-a16c-1e4489b638de for instance d3ca263a-16c7-4514-963e-6a008e39baa5 on n-h1-860864-2 Oct 10 23:32:35.097777 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-c14cdf6c-efc4-4a4c-a5b2-ed8c0257ec0b req-bb1b2b84-04d7-405e-930e-7a4666f5c99e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.124996 Oct 10 23:32:35.103308 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1704/3527] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:32:35.476004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d49350db-ef60-4ac3-be35-47a804450f5b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:35.487376 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d49350db-ef60-4ac3-be35-47a804450f5b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1354 microversion: 2.1 time: 0.529654 Oct 10 23:32:35.515933 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1824/3528] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:34 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1354 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:32:35.727562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fa62266d-6f21-4a56-8dd1-d980bacc1933 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:35.728799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fa62266d-6f21-4a56-8dd1-d980bacc1933 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:35.745722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa62266d-6f21-4a56-8dd1-d980bacc1933 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:35.746631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa62266d-6f21-4a56-8dd1-d980bacc1933 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:35.747366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa62266d-6f21-4a56-8dd1-d980bacc1933 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:35.748509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa62266d-6f21-4a56-8dd1-d980bacc1933 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:35.749157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa62266d-6f21-4a56-8dd1-d980bacc1933 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:35.749787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa62266d-6f21-4a56-8dd1-d980bacc1933 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:35.868020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a35ff835-9ac1-4a63-a1bf-01f88c14418e tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a68d8b0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:35.904796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fa62266d-6f21-4a56-8dd1-d980bacc1933 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:35.931768 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fa62266d-6f21-4a56-8dd1-d980bacc1933 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1252 microversion: 2.1 time: 0.207333 Oct 10 23:32:35.935131 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1705/3529] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:35 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1252 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:35.963318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b884afde-a2e8-4f8d-93c3-f172c5908737 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:35.964607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b884afde-a2e8-4f8d-93c3-f172c5908737 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: 1a33db0d-a765-49a1-b396-9c68f6ed22c0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:35.984065 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a35ff835-9ac1-4a63-a1bf-01f88c14418e tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1" status: 200 len: 1452 microversion: 2.1 time: 0.119658 Oct 10 23:32:35.985764 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1825/3530] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:35 2022] GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1 => generated 1452 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:32:35.989078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b884afde-a2e8-4f8d-93c3-f172c5908737 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:35.990042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b884afde-a2e8-4f8d-93c3-f172c5908737 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:35.990678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b884afde-a2e8-4f8d-93c3-f172c5908737 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:35.991736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b884afde-a2e8-4f8d-93c3-f172c5908737 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:35.993408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b884afde-a2e8-4f8d-93c3-f172c5908737 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:35.994251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b884afde-a2e8-4f8d-93c3-f172c5908737 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:36.526606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8a60d43f-f45c-4b9c-b0a6-f1017bc60e33 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:36.527494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8a60d43f-f45c-4b9c-b0a6-f1017bc60e33 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:36.542210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a60d43f-f45c-4b9c-b0a6-f1017bc60e33 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:36.544974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a60d43f-f45c-4b9c-b0a6-f1017bc60e33 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:36.546586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a60d43f-f45c-4b9c-b0a6-f1017bc60e33 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:36.549122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a60d43f-f45c-4b9c-b0a6-f1017bc60e33 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:36.551914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a60d43f-f45c-4b9c-b0a6-f1017bc60e33 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:36.552672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a60d43f-f45c-4b9c-b0a6-f1017bc60e33 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:36.762101 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b884afde-a2e8-4f8d-93c3-f172c5908737 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0" status: 200 len: 1463 microversion: 2.1 time: 0.810881 Oct 10 23:32:36.762713 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1706/3531] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:35 2022] GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0 => generated 1463 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:36.844675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8a60d43f-f45c-4b9c-b0a6-f1017bc60e33 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:36.855269 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8a60d43f-f45c-4b9c-b0a6-f1017bc60e33 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1354 microversion: 2.1 time: 0.335782 Oct 10 23:32:36.862270 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1826/3532] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:36 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1354 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:32:36.961798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3afba535-aaeb-4ae6-ae58-4c39de8d637d tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:36.963012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3afba535-aaeb-4ae6-ae58-4c39de8d637d tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:36.975971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3afba535-aaeb-4ae6-ae58-4c39de8d637d tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:36.979101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3afba535-aaeb-4ae6-ae58-4c39de8d637d tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:36.979759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3afba535-aaeb-4ae6-ae58-4c39de8d637d tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:36.980672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3afba535-aaeb-4ae6-ae58-4c39de8d637d tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:36.981290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3afba535-aaeb-4ae6-ae58-4c39de8d637d tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:36.985244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3afba535-aaeb-4ae6-ae58-4c39de8d637d tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:37.000696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4d53d3e3-2f06-4f55-a3ef-aaffa75994da tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a68d310>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:37.081981 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4d53d3e3-2f06-4f55-a3ef-aaffa75994da tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1" status: 200 len: 1452 microversion: 2.1 time: 0.085113 Oct 10 23:32:37.087402 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1827/3533] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:36 2022] GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1 => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:32:37.282166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3afba535-aaeb-4ae6-ae58-4c39de8d637d tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:37.302849 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3afba535-aaeb-4ae6-ae58-4c39de8d637d tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1252 microversion: 2.1 time: 0.343747 Oct 10 23:32:37.304900 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1707/3534] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:36 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1252 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:37.790682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b3c71d03-62b2-490c-b248-7656cc2bf800 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:37.791717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b3c71d03-62b2-490c-b248-7656cc2bf800 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: 1a33db0d-a765-49a1-b396-9c68f6ed22c0] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:37.808901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3c71d03-62b2-490c-b248-7656cc2bf800 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:37.821049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3c71d03-62b2-490c-b248-7656cc2bf800 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:37.835889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3c71d03-62b2-490c-b248-7656cc2bf800 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:37.836609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3c71d03-62b2-490c-b248-7656cc2bf800 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:37.837139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3c71d03-62b2-490c-b248-7656cc2bf800 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:37.837679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3c71d03-62b2-490c-b248-7656cc2bf800 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:37.895927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a5ea8cb5-3dac-41ed-b40e-fb1d66a16a7a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:37.897361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a5ea8cb5-3dac-41ed-b40e-fb1d66a16a7a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:37.911587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5ea8cb5-3dac-41ed-b40e-fb1d66a16a7a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:37.913672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5ea8cb5-3dac-41ed-b40e-fb1d66a16a7a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:37.917117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5ea8cb5-3dac-41ed-b40e-fb1d66a16a7a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:37.918174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5ea8cb5-3dac-41ed-b40e-fb1d66a16a7a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:37.921240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5ea8cb5-3dac-41ed-b40e-fb1d66a16a7a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:37.922104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5ea8cb5-3dac-41ed-b40e-fb1d66a16a7a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:38.177581 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b3c71d03-62b2-490c-b248-7656cc2bf800 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0" status: 200 len: 1463 microversion: 2.1 time: 0.387102 Oct 10 23:32:38.197412 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1828/3535] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:37 2022] GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0 => generated 1463 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:38.203090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-af875ed7-069d-4712-933d-2757784d46e0 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f6633994160>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:38.338013 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-af875ed7-069d-4712-933d-2757784d46e0 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1" status: 200 len: 1452 microversion: 2.1 time: 0.151864 Oct 10 23:32:38.339315 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1829/3536] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:38 2022] GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:38.358982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3193a723-f05e-40b8-a644-f74d98cf5c93 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:38.361746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3193a723-f05e-40b8-a644-f74d98cf5c93 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:38.382170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3193a723-f05e-40b8-a644-f74d98cf5c93 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:38.391978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3193a723-f05e-40b8-a644-f74d98cf5c93 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:38.392876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3193a723-f05e-40b8-a644-f74d98cf5c93 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:38.395727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3193a723-f05e-40b8-a644-f74d98cf5c93 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:38.396497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3193a723-f05e-40b8-a644-f74d98cf5c93 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:38.398022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3193a723-f05e-40b8-a644-f74d98cf5c93 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:38.578927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3193a723-f05e-40b8-a644-f74d98cf5c93 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:38.595773 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3193a723-f05e-40b8-a644-f74d98cf5c93 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1252 microversion: 2.1 time: 0.255028 Oct 10 23:32:38.602700 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1830/3537] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:38 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1252 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:39.103896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a5ea8cb5-3dac-41ed-b40e-fb1d66a16a7a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:39.130397 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a5ea8cb5-3dac-41ed-b40e-fb1d66a16a7a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1354 microversion: 2.1 time: 1.238375 Oct 10 23:32:39.145766 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1708/3538] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:37 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1354 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:32:39.212149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e13505a9-d359-4c12-8738-a8368a899c43 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:39.213084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e13505a9-d359-4c12-8738-a8368a899c43 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: 1a33db0d-a765-49a1-b396-9c68f6ed22c0] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:39.228704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e13505a9-d359-4c12-8738-a8368a899c43 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:39.229206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e13505a9-d359-4c12-8738-a8368a899c43 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:39.229877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e13505a9-d359-4c12-8738-a8368a899c43 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:39.231940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e13505a9-d359-4c12-8738-a8368a899c43 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:39.232651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e13505a9-d359-4c12-8738-a8368a899c43 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:39.234074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e13505a9-d359-4c12-8738-a8368a899c43 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:39.357245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6cf2b1fb-49b6-4356-a3a0-5809844dfbd5 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f663027eca0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:39.521254 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6cf2b1fb-49b6-4356-a3a0-5809844dfbd5 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1" status: 200 len: 1452 microversion: 2.1 time: 0.170096 Oct 10 23:32:39.526611 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1709/3539] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:39 2022] GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1 => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:39.562981 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e13505a9-d359-4c12-8738-a8368a899c43 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0" status: 200 len: 1463 microversion: 2.1 time: 0.356046 Oct 10 23:32:39.564646 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1831/3540] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:39 2022] GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0 => generated 1463 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:32:39.633553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5e27909c-5a53-46b2-b387-e333232a1b06 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:39.635064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5e27909c-5a53-46b2-b387-e333232a1b06 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:39.664851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e27909c-5a53-46b2-b387-e333232a1b06 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:39.666954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e27909c-5a53-46b2-b387-e333232a1b06 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:39.674680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e27909c-5a53-46b2-b387-e333232a1b06 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:39.676850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e27909c-5a53-46b2-b387-e333232a1b06 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:39.678248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e27909c-5a53-46b2-b387-e333232a1b06 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:39.679015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e27909c-5a53-46b2-b387-e333232a1b06 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:39.891045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5e27909c-5a53-46b2-b387-e333232a1b06 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:39.905252 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5e27909c-5a53-46b2-b387-e333232a1b06 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1252 microversion: 2.1 time: 0.284614 Oct 10 23:32:39.923081 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1710/3541] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:39 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1252 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:32:40.034539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-f662d5d9-b367-4b80-942b-8dc1e3b46584 req-d4ae20e2-388d-49e9-a85a-3c596d96f9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a33db0d-a765-49a1-b396-9c68f6ed22c0", "name": "network-vif-plugged", "status": "completed", "tag": "92595afa-bb6f-4233-b8c4-ca6163d7f856"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:32:40.049047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f662d5d9-b367-4b80-942b-8dc1e3b46584 req-d4ae20e2-388d-49e9-a85a-3c596d96f9f0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:40.050382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f662d5d9-b367-4b80-942b-8dc1e3b46584 req-d4ae20e2-388d-49e9-a85a-3c596d96f9f0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:40.051123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f662d5d9-b367-4b80-942b-8dc1e3b46584 req-d4ae20e2-388d-49e9-a85a-3c596d96f9f0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:40.069576 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-f662d5d9-b367-4b80-942b-8dc1e3b46584 req-d4ae20e2-388d-49e9-a85a-3c596d96f9f0 service nova] Creating event network-vif-plugged:92595afa-bb6f-4233-b8c4-ca6163d7f856 for instance 1a33db0d-a765-49a1-b396-9c68f6ed22c0 on n-h2-860864-2 Oct 10 23:32:40.075878 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-f662d5d9-b367-4b80-942b-8dc1e3b46584 req-d4ae20e2-388d-49e9-a85a-3c596d96f9f0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049313 Oct 10 23:32:40.076524 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1832/3542] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:32:40.180992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ece7e64b-3adc-474f-a5cb-89a1f2e75ebb tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:40.182196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ece7e64b-3adc-474f-a5cb-89a1f2e75ebb tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:40.193300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ece7e64b-3adc-474f-a5cb-89a1f2e75ebb tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:40.194400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ece7e64b-3adc-474f-a5cb-89a1f2e75ebb tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:40.195281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ece7e64b-3adc-474f-a5cb-89a1f2e75ebb tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:40.196260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ece7e64b-3adc-474f-a5cb-89a1f2e75ebb tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:40.197187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ece7e64b-3adc-474f-a5cb-89a1f2e75ebb tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:40.197837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ece7e64b-3adc-474f-a5cb-89a1f2e75ebb tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:40.555193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6fb586a1-ed60-4444-9261-b173ee3f9d38 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f66339c9e50>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:40.599525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ece7e64b-3adc-474f-a5cb-89a1f2e75ebb tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:40.613877 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ece7e64b-3adc-474f-a5cb-89a1f2e75ebb tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1354 microversion: 2.1 time: 0.442001 Oct 10 23:32:40.617118 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1711/3543] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:40 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1354 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:40.621969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-14414fda-8467-4db2-9764-0d717287f205 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:40.622633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-14414fda-8467-4db2-9764-0d717287f205 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: 1a33db0d-a765-49a1-b396-9c68f6ed22c0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:40.648209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14414fda-8467-4db2-9764-0d717287f205 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:40.649158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14414fda-8467-4db2-9764-0d717287f205 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:40.653310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14414fda-8467-4db2-9764-0d717287f205 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:40.655330 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14414fda-8467-4db2-9764-0d717287f205 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:40.656817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14414fda-8467-4db2-9764-0d717287f205 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:40.657598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14414fda-8467-4db2-9764-0d717287f205 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:40.681670 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6fb586a1-ed60-4444-9261-b173ee3f9d38 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1" status: 200 len: 1461 microversion: 2.1 time: 0.134001 Oct 10 23:32:40.695850 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1833/3544] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:40 2022] GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1 => generated 1461 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:32:40.701413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-34b97b3a-ce48-411d-b163-4efd067a2d26 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f66339858b0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:40.786952 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-34b97b3a-ce48-411d-b163-4efd067a2d26 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1" status: 200 len: 1461 microversion: 2.1 time: 0.087924 Oct 10 23:32:40.790137 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1834/3545] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:40 2022] GET /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1 => generated 1461 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:40.824427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5aa21717-ef13-4597-957c-b773bc16dc96 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:40.836545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5aa21717-ef13-4597-957c-b773bc16dc96 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:40.843893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=76 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:32:40.847117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5aa21717-ef13-4597-957c-b773bc16dc96 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:40.847804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5aa21717-ef13-4597-957c-b773bc16dc96 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:40.848690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5aa21717-ef13-4597-957c-b773bc16dc96 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:40.850249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5aa21717-ef13-4597-957c-b773bc16dc96 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:40.851222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5aa21717-ef13-4597-957c-b773bc16dc96 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:40.852084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5aa21717-ef13-4597-957c-b773bc16dc96 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:40.923362 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-14414fda-8467-4db2-9764-0d717287f205 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0" status: 200 len: 1463 microversion: 2.1 time: 0.306248 Oct 10 23:32:40.923984 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1712/3546] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:40 2022] GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0 => generated 1463 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:40.931343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b7c4d33f-4e6e-41d2-b9f1-268d41c72f63 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:40.932397 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b7c4d33f-4e6e-41d2-b9f1-268d41c72f63 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:40.944892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7c4d33f-4e6e-41d2-b9f1-268d41c72f63 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:40.945896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7c4d33f-4e6e-41d2-b9f1-268d41c72f63 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:40.946618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7c4d33f-4e6e-41d2-b9f1-268d41c72f63 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:40.947617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7c4d33f-4e6e-41d2-b9f1-268d41c72f63 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:40.948368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7c4d33f-4e6e-41d2-b9f1-268d41c72f63 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:40.949052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7c4d33f-4e6e-41d2-b9f1-268d41c72f63 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:41.060253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b7c4d33f-4e6e-41d2-b9f1-268d41c72f63 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:41.074995 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b7c4d33f-4e6e-41d2-b9f1-268d41c72f63 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1252 microversion: 2.1 time: 0.149404 Oct 10 23:32:41.076238 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1713/3547] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:40 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1252 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:41.147986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5aa21717-ef13-4597-957c-b773bc16dc96 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:41.157693 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5aa21717-ef13-4597-957c-b773bc16dc96 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1466 microversion: 2.1 time: 0.348654 Oct 10 23:32:41.158488 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1835/3548] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:40 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 1466 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:41.185799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7b5ab918-4ddd-410d-bb5c-67bf7ecdf2a4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-621309311"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:32:41.188493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7b5ab918-4ddd-410d-bb5c-67bf7ecdf2a4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 430a8e18-4033-498b-8cf3-a224786b7363] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:41.199234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b5ab918-4ddd-410d-bb5c-67bf7ecdf2a4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:41.200124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b5ab918-4ddd-410d-bb5c-67bf7ecdf2a4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:41.200927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b5ab918-4ddd-410d-bb5c-67bf7ecdf2a4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:41.202407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b5ab918-4ddd-410d-bb5c-67bf7ecdf2a4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:41.203205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b5ab918-4ddd-410d-bb5c-67bf7ecdf2a4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:41.203966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b5ab918-4ddd-410d-bb5c-67bf7ecdf2a4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:41.482145 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7b5ab918-4ddd-410d-bb5c-67bf7ecdf2a4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "POST /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363/action" status: 202 len: 0 microversion: 2.1 time: 0.298835 Oct 10 23:32:41.484272 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1714/3549] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:32:41 2022] POST /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 10 23:32:41.503627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dad58bbe-f16f-4539-b8c0-729131f72ba4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a6cac10>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:41.567721 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dad58bbe-f16f-4539-b8c0-729131f72ba4 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1452 microversion: 2.1 time: 0.071171 Oct 10 23:32:41.569122 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1836/3550] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:41 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1452 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:41.659561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4cda5786-1605-44a5-81c7-129da2729242 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:41.660603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4cda5786-1605-44a5-81c7-129da2729242 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:41.668214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cda5786-1605-44a5-81c7-129da2729242 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:41.669153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cda5786-1605-44a5-81c7-129da2729242 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:41.670199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cda5786-1605-44a5-81c7-129da2729242 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:41.671277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cda5786-1605-44a5-81c7-129da2729242 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:41.672025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cda5786-1605-44a5-81c7-129da2729242 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:41.672691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4cda5786-1605-44a5-81c7-129da2729242 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:41.909480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4cda5786-1605-44a5-81c7-129da2729242 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:41.939929 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4cda5786-1605-44a5-81c7-129da2729242 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1354 microversion: 2.1 time: 0.284601 Oct 10 23:32:41.948195 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1715/3551] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:41 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1354 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:41.965259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-df64dbb0-329e-4671-84f4-5c811e69b3ea tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:41.966663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-df64dbb0-329e-4671-84f4-5c811e69b3ea tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: 1a33db0d-a765-49a1-b396-9c68f6ed22c0] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:41.981459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df64dbb0-329e-4671-84f4-5c811e69b3ea tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:41.985652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df64dbb0-329e-4671-84f4-5c811e69b3ea tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:41.987519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df64dbb0-329e-4671-84f4-5c811e69b3ea tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:41.990548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df64dbb0-329e-4671-84f4-5c811e69b3ea tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:41.992664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df64dbb0-329e-4671-84f4-5c811e69b3ea tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:41.993868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df64dbb0-329e-4671-84f4-5c811e69b3ea tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:42.110572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d75e2641-a3d2-488b-83c4-16d32722ee3f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:42.114882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d75e2641-a3d2-488b-83c4-16d32722ee3f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:42.138336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d75e2641-a3d2-488b-83c4-16d32722ee3f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:42.139077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d75e2641-a3d2-488b-83c4-16d32722ee3f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:42.139802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d75e2641-a3d2-488b-83c4-16d32722ee3f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:42.140971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d75e2641-a3d2-488b-83c4-16d32722ee3f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:42.148858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d75e2641-a3d2-488b-83c4-16d32722ee3f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:42.150075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d75e2641-a3d2-488b-83c4-16d32722ee3f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:42.292737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d75e2641-a3d2-488b-83c4-16d32722ee3f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:42.295004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d75e2641-a3d2-488b-83c4-16d32722ee3f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:42.295887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d75e2641-a3d2-488b-83c4-16d32722ee3f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:42.296660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-d75e2641-a3d2-488b-83c4-16d32722ee3f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lazy-loading 'fault' on Instance uuid 06fefb7b-6f57-4489-a760-47dbcf05cbc9 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:32:42.357150 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-df64dbb0-329e-4671-84f4-5c811e69b3ea tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0" status: 200 len: 1648 microversion: 2.1 time: 0.399816 Oct 10 23:32:42.378343 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1837/3552] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:41 2022] GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0 => generated 1648 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:42.383775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-960eec03-643e-4a10-8fb3-3a6700314dac tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:42.384882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-960eec03-643e-4a10-8fb3-3a6700314dac tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: 1a33db0d-a765-49a1-b396-9c68f6ed22c0] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:42.392714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-960eec03-643e-4a10-8fb3-3a6700314dac tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:42.394380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-960eec03-643e-4a10-8fb3-3a6700314dac tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:42.395104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-960eec03-643e-4a10-8fb3-3a6700314dac tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:42.396095 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-960eec03-643e-4a10-8fb3-3a6700314dac tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:42.397324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-960eec03-643e-4a10-8fb3-3a6700314dac tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:42.398599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-960eec03-643e-4a10-8fb3-3a6700314dac tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:42.441023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:32:42.748860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d75e2641-a3d2-488b-83c4-16d32722ee3f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6434f96f22354c9186f98f1abfd45ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94d503df54a645478e49e6bec5886fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:42.774433 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d75e2641-a3d2-488b-83c4-16d32722ee3f tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 200 len: 1257 microversion: 2.1 time: 0.678656 Oct 10 23:32:42.776272 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1716/3553] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:42 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 1257 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:42.782777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c57c1e62-ad4a-4382-9e49-34d76893ea87 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a47bf70>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:42.856390 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-960eec03-643e-4a10-8fb3-3a6700314dac tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0" status: 200 len: 1648 microversion: 2.1 time: 0.476716 Oct 10 23:32:42.861446 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1838/3554] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:42 2022] GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0 => generated 1648 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:42.894993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f5cffb8d-c27d-4782-8443-ce0c1a2e9dd5 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:42.895837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f5cffb8d-c27d-4782-8443-ce0c1a2e9dd5 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: 1a33db0d-a765-49a1-b396-9c68f6ed22c0] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:42.911409 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c57c1e62-ad4a-4382-9e49-34d76893ea87 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1452 microversion: 2.1 time: 0.133705 Oct 10 23:32:42.911864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5cffb8d-c27d-4782-8443-ce0c1a2e9dd5 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:42.912404 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1717/3555] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:42 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1452 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:42.912655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5cffb8d-c27d-4782-8443-ce0c1a2e9dd5 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:42.913513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5cffb8d-c27d-4782-8443-ce0c1a2e9dd5 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:42.917105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5cffb8d-c27d-4782-8443-ce0c1a2e9dd5 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:42.917528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5cffb8d-c27d-4782-8443-ce0c1a2e9dd5 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:42.918072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5cffb8d-c27d-4782-8443-ce0c1a2e9dd5 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:42.970583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e7e7b84e-85a4-4616-b4a7-e5f3d2208dd6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:42.971479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e7e7b84e-85a4-4616-b4a7-e5f3d2208dd6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:42.985490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7e7b84e-85a4-4616-b4a7-e5f3d2208dd6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:42.986856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7e7b84e-85a4-4616-b4a7-e5f3d2208dd6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:42.989031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7e7b84e-85a4-4616-b4a7-e5f3d2208dd6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:42.991648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7e7b84e-85a4-4616-b4a7-e5f3d2208dd6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:42.993402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7e7b84e-85a4-4616-b4a7-e5f3d2208dd6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:42.994858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7e7b84e-85a4-4616-b4a7-e5f3d2208dd6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:43.027500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:32:43.259957 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f5cffb8d-c27d-4782-8443-ce0c1a2e9dd5 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0" status: 200 len: 1648 microversion: 2.1 time: 0.379591 Oct 10 23:32:43.282283 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1839/3556] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:42 2022] GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0 => generated 1648 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:43.460743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-df3310b4-3c76-49b9-a2bb-6a367b7535ad tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-23158430", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "availability_zone": "nova:n-h1-860864-2", "networks": [{"uuid": "b69f9d41-1588-4e5d-96f8-c1e5b0da5782"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:32:43.507666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e7e7b84e-85a4-4616-b4a7-e5f3d2208dd6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:43.520772 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e7e7b84e-85a4-4616-b4a7-e5f3d2208dd6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1354 microversion: 2.1 time: 0.555217 Oct 10 23:32:43.527968 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1718/3557] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:42 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1354 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:43.606843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-df3310b4-3c76-49b9-a2bb-6a367b7535ad tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] validate_networks() for [('b69f9d41-1588-4e5d-96f8-c1e5b0da5782', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:32:43.806007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ae724845-9d39-4ab1-97e2-535ddbb58145 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:43.807427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ae724845-9d39-4ab1-97e2-535ddbb58145 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] [instance: 06fefb7b-6f57-4489-a760-47dbcf05cbc9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:43.830030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae724845-9d39-4ab1-97e2-535ddbb58145 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:43.831502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae724845-9d39-4ab1-97e2-535ddbb58145 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:43.832412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae724845-9d39-4ab1-97e2-535ddbb58145 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:43.836195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae724845-9d39-4ab1-97e2-535ddbb58145 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:43.837424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae724845-9d39-4ab1-97e2-535ddbb58145 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:43.838545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae724845-9d39-4ab1-97e2-535ddbb58145 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:43.876143 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-ae724845-9d39-4ab1-97e2-535ddbb58145 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] HTTP exception thrown: Instance 06fefb7b-6f57-4489-a760-47dbcf05cbc9 could not be found. Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ae724845-9d39-4ab1-97e2-535ddbb58145 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Request method failure captured: Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 HTTP/1.1 Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKr0B71p3BZvd_sVKWPjlvRlK2V3ceHFjLXu1ASGAVzPa7oSIkXslP6pRQwffv6oy3bVX_f5OcqL1rdAVIvtmmTM9GQ-4sCv8ZDdp0Ur4pquEKu9Yd8P06VUXHVEBex2v3ZwSp5OU9A85k7y0H43IBIaW3zAb8-BGD89NrJiPxnTAvw Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 94d503df54a645478e49e6bec5886fa7 Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersTestBootFromVolume-1460085638 Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/94d503df54a645478e49e6bec5886fa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94d503df54a645478e49e6bec5886fa7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/94d503df54a645478e49e6bec5886fa7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_94d503df54a645478e49e6bec5886fa7", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersTestBootFromVolume-1460085638 Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 94d503df54a645478e49e6bec5886fa7 Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1460085638 Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersTestBootFromVolume-1460085638-project Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 6434f96f22354c9186f98f1abfd45ad7 Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersTestBootFromVolume-1460085638-project Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 06fefb7b-6f57-4489-a760-47dbcf05cbc9 could not be found. Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '06fefb7b-6f57-4489-a760-47dbcf05cbc9'} Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06fefb7b-6f57-4489-a760-47dbcf05cbc9 could not be found. Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06fefb7b-6f57-4489-a760-47dbcf05cbc9 could not be found. Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:32:43.879968 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:32:43.890688 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:32:43.890688 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:32:43.890688 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:32:43.890688 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:32:43.890688 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:32:43.890688 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06fefb7b-6f57-4489-a760-47dbcf05cbc9 could not be found. Oct 10 23:32:43.890688 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:32:43.893684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ae724845-9d39-4ab1-97e2-535ddbb58145 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Returning 404 to user: Instance 06fefb7b-6f57-4489-a760-47dbcf05cbc9 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:32:43.895482 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ae724845-9d39-4ab1-97e2-535ddbb58145 tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9" status: 404 len: 111 microversion: 2.1 time: 0.096925 Oct 10 23:32:43.903685 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1719/3558] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:43 2022] GET /compute/v2.1/servers/06fefb7b-6f57-4489-a760-47dbcf05cbc9 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:32:43.915513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-330ec2ca-4afd-48af-a1f9-b5abee6ca45e tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] Calling method '.version_select at 0x7f662a45cca0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:43.958322 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-330ec2ca-4afd-48af-a1f9-b5abee6ca45e tempest-ServersTestBootFromVolume-1460085638 tempest-ServersTestBootFromVolume-1460085638-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-355371435" status: 202 len: 0 microversion: 2.1 time: 0.052539 Oct 10 23:32:43.967316 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1720/3559] 10.222.0.23 () {58 vars in 1218 bytes} [Mon Oct 10 23:32:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-355371435 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:32:43.978189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-92e7a255-d785-4849-87e2-546e3bd17d8a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a472dc0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:44.143078 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-92e7a255-d785-4849-87e2-546e3bd17d8a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1452 microversion: 2.1 time: 0.174006 Oct 10 23:32:44.143706 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1721/3560] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:43 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:44.240293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-c0f9f855-101e-4b15-b24d-51cb1ae51c77 req-9f06cc16-e40a-46b7-80ac-9515e1eeaef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "037ebfb5-534f-42db-9838-462de4b299e1", "name": "network-vif-unplugged", "status": "completed", "tag": "0945733a-182f-4aab-9346-e59fa6b3c813"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:32:44.290525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:32:44.304900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c0f9f855-101e-4b15-b24d-51cb1ae51c77 req-9f06cc16-e40a-46b7-80ac-9515e1eeaef4 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:44.306158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c0f9f855-101e-4b15-b24d-51cb1ae51c77 req-9f06cc16-e40a-46b7-80ac-9515e1eeaef4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:44.307301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c0f9f855-101e-4b15-b24d-51cb1ae51c77 req-9f06cc16-e40a-46b7-80ac-9515e1eeaef4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:44.352854 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-c0f9f855-101e-4b15-b24d-51cb1ae51c77 req-9f06cc16-e40a-46b7-80ac-9515e1eeaef4 service nova] Creating event network-vif-unplugged:0945733a-182f-4aab-9346-e59fa6b3c813 for instance 037ebfb5-534f-42db-9838-462de4b299e1 on n-h2-860864-2 Oct 10 23:32:44.386393 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-c0f9f855-101e-4b15-b24d-51cb1ae51c77 req-9f06cc16-e40a-46b7-80ac-9515e1eeaef4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.165643 Oct 10 23:32:44.389141 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1722/3561] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:32:44.570276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-75b37409-d17f-435e-8dc1-3e7e811c9f6b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:44.576673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-75b37409-d17f-435e-8dc1-3e7e811c9f6b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:44.603074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75b37409-d17f-435e-8dc1-3e7e811c9f6b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:44.605071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75b37409-d17f-435e-8dc1-3e7e811c9f6b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:44.606029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75b37409-d17f-435e-8dc1-3e7e811c9f6b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:44.607614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75b37409-d17f-435e-8dc1-3e7e811c9f6b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:44.608528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75b37409-d17f-435e-8dc1-3e7e811c9f6b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:44.609596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75b37409-d17f-435e-8dc1-3e7e811c9f6b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:44.839839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-df3310b4-3c76-49b9-a2bb-6a367b7535ad tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:32:44.841530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-df3310b4-3c76-49b9-a2bb-6a367b7535ad tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:32:44.843036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-df3310b4-3c76-49b9-a2bb-6a367b7535ad tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:32:44.843928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-df3310b4-3c76-49b9-a2bb-6a367b7535ad tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:32:44.844921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-df3310b4-3c76-49b9-a2bb-6a367b7535ad tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:32:44.886308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df3310b4-3c76-49b9-a2bb-6a367b7535ad tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:44.887697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df3310b4-3c76-49b9-a2bb-6a367b7535ad tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:44.888893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df3310b4-3c76-49b9-a2bb-6a367b7535ad tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:44.890391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df3310b4-3c76-49b9-a2bb-6a367b7535ad tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:44.891396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df3310b4-3c76-49b9-a2bb-6a367b7535ad tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:44.892295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df3310b4-3c76-49b9-a2bb-6a367b7535ad tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:44.960998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-df3310b4-3c76-49b9-a2bb-6a367b7535ad tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Getting quotas for project 660d21b04521487788ef25594b766535. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:32:44.976250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-df3310b4-3c76-49b9-a2bb-6a367b7535ad tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Getting quotas for user dd58422e676e49d89a5887adc4547afe and project 660d21b04521487788ef25594b766535. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:32:45.005525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-df3310b4-3c76-49b9-a2bb-6a367b7535ad tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:32:45.012056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-df3310b4-3c76-49b9-a2bb-6a367b7535ad tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: ee9ef754-080c-4b56-a1f2-d5287268fb2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:32:45.124360 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-df3310b4-3c76-49b9-a2bb-6a367b7535ad tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.670219 Oct 10 23:32:45.139333 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1840/3562] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:32:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:32:45.151295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8db7dfd5-17ad-44fb-8cc7-203d2a5d60e9 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:45.152934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8db7dfd5-17ad-44fb-8cc7-203d2a5d60e9 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: ee9ef754-080c-4b56-a1f2-d5287268fb2f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:45.308927 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8db7dfd5-17ad-44fb-8cc7-203d2a5d60e9 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f" status: 200 len: 1327 microversion: 2.1 time: 0.167462 Oct 10 23:32:45.316518 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1841/3563] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:45 2022] GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f => generated 1327 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:45.370054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fe391820-5f1b-447e-8ebf-8a0a33b397af tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a6cac10>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:45.455938 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fe391820-5f1b-447e-8ebf-8a0a33b397af tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1452 microversion: 2.1 time: 0.114227 Oct 10 23:32:45.478439 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1842/3564] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:45 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:45.609918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-75b37409-d17f-435e-8dc1-3e7e811c9f6b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:45.644858 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-75b37409-d17f-435e-8dc1-3e7e811c9f6b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1354 microversion: 2.1 time: 1.082345 Oct 10 23:32:45.652442 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1723/3565] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:44 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1354 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:32:46.370211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-67f431eb-d550-48e6-a257-f1998ac2403b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:46.373447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-67f431eb-d550-48e6-a257-f1998ac2403b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: ee9ef754-080c-4b56-a1f2-d5287268fb2f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:46.443865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67f431eb-d550-48e6-a257-f1998ac2403b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:46.446568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67f431eb-d550-48e6-a257-f1998ac2403b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:46.450479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67f431eb-d550-48e6-a257-f1998ac2403b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:46.452499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67f431eb-d550-48e6-a257-f1998ac2403b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:46.453318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67f431eb-d550-48e6-a257-f1998ac2403b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:46.458799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67f431eb-d550-48e6-a257-f1998ac2403b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:46.515047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f4c74653-905a-4bd0-9502-03f291a4cc61 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f6633a87790>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:46.743393 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f4c74653-905a-4bd0-9502-03f291a4cc61 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1452 microversion: 2.1 time: 0.247387 Oct 10 23:32:46.747210 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1724/3566] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:46 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1452 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:32:46.776172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-175229a0-8abd-47a7-a178-5f4fedd7a40a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:46.779157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-175229a0-8abd-47a7-a178-5f4fedd7a40a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:46.801280 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-67f431eb-d550-48e6-a257-f1998ac2403b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f" status: 200 len: 1344 microversion: 2.1 time: 0.440111 Oct 10 23:32:46.807537 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1843/3567] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:46 2022] GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f => generated 1344 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:46.850587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-175229a0-8abd-47a7-a178-5f4fedd7a40a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:46.860104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-175229a0-8abd-47a7-a178-5f4fedd7a40a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:46.863726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-175229a0-8abd-47a7-a178-5f4fedd7a40a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:46.874503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-175229a0-8abd-47a7-a178-5f4fedd7a40a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:46.880744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-175229a0-8abd-47a7-a178-5f4fedd7a40a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:46.883236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-175229a0-8abd-47a7-a178-5f4fedd7a40a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:47.415383 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-175229a0-8abd-47a7-a178-5f4fedd7a40a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:47.426842 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-175229a0-8abd-47a7-a178-5f4fedd7a40a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1354 microversion: 2.1 time: 0.676010 Oct 10 23:32:47.428685 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1725/3568] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:46 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1354 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:47.763899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-45c66b7a-28b8-4051-9af2-397821270b61 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a6eba60>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:47.840987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5b0b922e-d5a4-4d67-b838-d4bf29115137 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:47.843290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5b0b922e-d5a4-4d67-b838-d4bf29115137 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: ee9ef754-080c-4b56-a1f2-d5287268fb2f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:47.866595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b0b922e-d5a4-4d67-b838-d4bf29115137 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:47.868618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b0b922e-d5a4-4d67-b838-d4bf29115137 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:47.871842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b0b922e-d5a4-4d67-b838-d4bf29115137 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:47.875057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b0b922e-d5a4-4d67-b838-d4bf29115137 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:47.885339 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-45c66b7a-28b8-4051-9af2-397821270b61 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1452 microversion: 2.1 time: 0.126384 Oct 10 23:32:47.886298 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1844/3569] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:47 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1452 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:32:47.894757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b0b922e-d5a4-4d67-b838-d4bf29115137 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:47.895757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b0b922e-d5a4-4d67-b838-d4bf29115137 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:48.204642 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5b0b922e-d5a4-4d67-b838-d4bf29115137 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f" status: 200 len: 1414 microversion: 2.1 time: 0.374795 Oct 10 23:32:48.209623 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1726/3570] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:47 2022] GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f => generated 1414 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:48.458184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-29354d5d-b88e-447d-b9fb-0e1af3723178 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:48.460590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-29354d5d-b88e-447d-b9fb-0e1af3723178 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:48.496160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29354d5d-b88e-447d-b9fb-0e1af3723178 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:48.499894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29354d5d-b88e-447d-b9fb-0e1af3723178 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:48.504555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29354d5d-b88e-447d-b9fb-0e1af3723178 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:48.509417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29354d5d-b88e-447d-b9fb-0e1af3723178 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:48.510384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29354d5d-b88e-447d-b9fb-0e1af3723178 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:48.511098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29354d5d-b88e-447d-b9fb-0e1af3723178 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:48.905324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ed102104-64e9-4847-91e1-a93a794884ca tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662aa80430>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:49.021144 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ed102104-64e9-4847-91e1-a93a794884ca tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1452 microversion: 2.1 time: 0.121902 Oct 10 23:32:49.031637 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1727/3571] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:48 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1452 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:32:49.239461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-78067906-b9a3-4221-8ae8-1baa778bf80f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:49.241040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-78067906-b9a3-4221-8ae8-1baa778bf80f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: ee9ef754-080c-4b56-a1f2-d5287268fb2f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:49.276526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78067906-b9a3-4221-8ae8-1baa778bf80f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:49.277499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78067906-b9a3-4221-8ae8-1baa778bf80f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:49.278311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78067906-b9a3-4221-8ae8-1baa778bf80f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:49.279618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78067906-b9a3-4221-8ae8-1baa778bf80f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:49.280462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78067906-b9a3-4221-8ae8-1baa778bf80f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:49.281265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78067906-b9a3-4221-8ae8-1baa778bf80f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:49.895505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-29354d5d-b88e-447d-b9fb-0e1af3723178 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:49.918315 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-29354d5d-b88e-447d-b9fb-0e1af3723178 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1354 microversion: 2.1 time: 1.460842 Oct 10 23:32:49.946142 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1845/3572] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:48 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1354 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:50.025225 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-78067906-b9a3-4221-8ae8-1baa778bf80f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f" status: 200 len: 1462 microversion: 2.1 time: 0.791879 Oct 10 23:32:50.028234 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1728/3573] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:49 2022] GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f => generated 1462 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:50.051361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2d9082e3-ea55-489c-845f-75ce325db71d tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a711e50>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:50.184262 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2d9082e3-ea55-489c-845f-75ce325db71d tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1452 microversion: 2.1 time: 0.145977 Oct 10 23:32:50.187332 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1846/3574] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:50 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:50.547691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-24b0ddff-50dd-4726-b1a1-269dd84ddd87 req-55612578-1990-43e5-b8c4-a7264b12d93a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430a8e18-4033-498b-8cf3-a224786b7363", "name": "network-vif-plugged", "status": "completed", "tag": "a2e7d038-4684-44fd-a359-4f01f2732cbf"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:32:50.562570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-24b0ddff-50dd-4726-b1a1-269dd84ddd87 req-55612578-1990-43e5-b8c4-a7264b12d93a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:50.563238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-24b0ddff-50dd-4726-b1a1-269dd84ddd87 req-55612578-1990-43e5-b8c4-a7264b12d93a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:50.563788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-24b0ddff-50dd-4726-b1a1-269dd84ddd87 req-55612578-1990-43e5-b8c4-a7264b12d93a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:50.587008 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-24b0ddff-50dd-4726-b1a1-269dd84ddd87 req-55612578-1990-43e5-b8c4-a7264b12d93a service nova] Creating event network-vif-plugged:a2e7d038-4684-44fd-a359-4f01f2732cbf for instance 430a8e18-4033-498b-8cf3-a224786b7363 on n-h2-860864-2 Oct 10 23:32:50.596510 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-24b0ddff-50dd-4726-b1a1-269dd84ddd87 req-55612578-1990-43e5-b8c4-a7264b12d93a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053802 Oct 10 23:32:50.598313 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1729/3575] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:32:50.965561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f4a40321-8f77-4a69-b3e0-8c9b8e74c038 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:50.970427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f4a40321-8f77-4a69-b3e0-8c9b8e74c038 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:51.046195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4a40321-8f77-4a69-b3e0-8c9b8e74c038 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:51.053883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4a40321-8f77-4a69-b3e0-8c9b8e74c038 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:51.055204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4a40321-8f77-4a69-b3e0-8c9b8e74c038 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:51.057956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4a40321-8f77-4a69-b3e0-8c9b8e74c038 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:51.060095 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4a40321-8f77-4a69-b3e0-8c9b8e74c038 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:51.061241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4a40321-8f77-4a69-b3e0-8c9b8e74c038 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:51.079520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-365ef67a-bd78-429c-af24-526d8181fc7d tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:51.081786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-365ef67a-bd78-429c-af24-526d8181fc7d tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: ee9ef754-080c-4b56-a1f2-d5287268fb2f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:51.097833 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-365ef67a-bd78-429c-af24-526d8181fc7d tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:51.099105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-365ef67a-bd78-429c-af24-526d8181fc7d tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:51.100641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-365ef67a-bd78-429c-af24-526d8181fc7d tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:51.102427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-365ef67a-bd78-429c-af24-526d8181fc7d tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:51.103855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-365ef67a-bd78-429c-af24-526d8181fc7d tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:51.105785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-365ef67a-bd78-429c-af24-526d8181fc7d tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:51.629847 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f4a40321-8f77-4a69-b3e0-8c9b8e74c038 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:51.647765 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f4a40321-8f77-4a69-b3e0-8c9b8e74c038 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1354 microversion: 2.1 time: 0.695511 Oct 10 23:32:51.652922 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1847/3576] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:50 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1354 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:51.674413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-151155b7-e392-427e-9b7a-a2138f857ed7 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a68da60>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:51.843532 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-151155b7-e392-427e-9b7a-a2138f857ed7 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1452 microversion: 2.1 time: 0.187401 Oct 10 23:32:51.844218 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1848/3577] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:51 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1452 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:51.871673 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-365ef67a-bd78-429c-af24-526d8181fc7d tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f" status: 200 len: 1462 microversion: 2.1 time: 0.800842 Oct 10 23:32:51.876575 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1730/3578] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:51 2022] GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f => generated 1462 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:52.236864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-4000a1eb-1d9e-49f1-8d72-320a1a5114ff req-6912d530-24be-4ac1-9195-9c97d726773a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee9ef754-080c-4b56-a1f2-d5287268fb2f", "tag": "62fa7642-76b0-409d-a11e-491c4a8e08af"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:32:52.276725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4000a1eb-1d9e-49f1-8d72-320a1a5114ff req-6912d530-24be-4ac1-9195-9c97d726773a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:52.278556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4000a1eb-1d9e-49f1-8d72-320a1a5114ff req-6912d530-24be-4ac1-9195-9c97d726773a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:52.283263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4000a1eb-1d9e-49f1-8d72-320a1a5114ff req-6912d530-24be-4ac1-9195-9c97d726773a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:52.332716 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-4000a1eb-1d9e-49f1-8d72-320a1a5114ff req-6912d530-24be-4ac1-9195-9c97d726773a service nova] Creating event network-changed:62fa7642-76b0-409d-a11e-491c4a8e08af for instance ee9ef754-080c-4b56-a1f2-d5287268fb2f on n-h1-860864-2 Oct 10 23:32:52.345221 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-4000a1eb-1d9e-49f1-8d72-320a1a5114ff req-6912d530-24be-4ac1-9195-9c97d726773a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115742 Oct 10 23:32:52.350090 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1849/3579] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:32:52.643461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-bedfcc1f-145c-4d9e-a877-2dd55c4ac4a7 req-b42b5ca2-06da-4218-b60e-b5cb6c82c050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ca263a-16c7-4514-963e-6a008e39baa5", "name": "network-vif-plugged", "status": "completed", "tag": "754eb733-038d-4f6b-a16c-1e4489b638de"}, {"server_uuid": "d3ca263a-16c7-4514-963e-6a008e39baa5", "name": "network-vif-plugged", "status": "completed", "tag": "d5ffc3e2-26b3-4e5c-9e72-e1e71d3304a4"}, {"server_uuid": "d3ca263a-16c7-4514-963e-6a008e39baa5", "name": "network-vif-plugged", "status": "completed", "tag": "c6c7d195-16f8-4f6a-bbf0-90c1e1cd08fd"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:32:52.681616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-bedfcc1f-145c-4d9e-a877-2dd55c4ac4a7 req-b42b5ca2-06da-4218-b60e-b5cb6c82c050 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:52.694212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9c67d4c6-6990-4c7b-ab51-ac39c9e542df tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:52.695197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9c67d4c6-6990-4c7b-ab51-ac39c9e542df tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:52.697773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-bedfcc1f-145c-4d9e-a877-2dd55c4ac4a7 req-b42b5ca2-06da-4218-b60e-b5cb6c82c050 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:52.700128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-bedfcc1f-145c-4d9e-a877-2dd55c4ac4a7 req-b42b5ca2-06da-4218-b60e-b5cb6c82c050 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:52.723059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c67d4c6-6990-4c7b-ab51-ac39c9e542df tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:52.727171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c67d4c6-6990-4c7b-ab51-ac39c9e542df tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:52.733632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c67d4c6-6990-4c7b-ab51-ac39c9e542df tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:52.736443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c67d4c6-6990-4c7b-ab51-ac39c9e542df tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:52.737399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c67d4c6-6990-4c7b-ab51-ac39c9e542df tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:52.742018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c67d4c6-6990-4c7b-ab51-ac39c9e542df tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:52.767309 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-bedfcc1f-145c-4d9e-a877-2dd55c4ac4a7 req-b42b5ca2-06da-4218-b60e-b5cb6c82c050 service nova] Creating event network-vif-plugged:754eb733-038d-4f6b-a16c-1e4489b638de for instance d3ca263a-16c7-4514-963e-6a008e39baa5 on n-h1-860864-2 Oct 10 23:32:52.773062 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-bedfcc1f-145c-4d9e-a877-2dd55c4ac4a7 req-b42b5ca2-06da-4218-b60e-b5cb6c82c050 service nova] Creating event network-vif-plugged:d5ffc3e2-26b3-4e5c-9e72-e1e71d3304a4 for instance d3ca263a-16c7-4514-963e-6a008e39baa5 on n-h1-860864-2 Oct 10 23:32:52.774352 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-bedfcc1f-145c-4d9e-a877-2dd55c4ac4a7 req-b42b5ca2-06da-4218-b60e-b5cb6c82c050 service nova] Creating event network-vif-plugged:c6c7d195-16f8-4f6a-bbf0-90c1e1cd08fd for instance d3ca263a-16c7-4514-963e-6a008e39baa5 on n-h1-860864-2 Oct 10 23:32:52.817573 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-bedfcc1f-145c-4d9e-a877-2dd55c4ac4a7 req-b42b5ca2-06da-4218-b60e-b5cb6c82c050 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.179174 Oct 10 23:32:52.824483 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1731/3580] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:32:52.870823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-084a6eb6-39a0-4c9e-ac4d-26099e54ba2c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a430430>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:53.006564 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-084a6eb6-39a0-4c9e-ac4d-26099e54ba2c tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1452 microversion: 2.1 time: 0.147631 Oct 10 23:32:53.012460 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1732/3581] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:52 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:53.022610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-63ebdbaa-9ccb-4396-94f7-477742ccf02b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:53.024243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-63ebdbaa-9ccb-4396-94f7-477742ccf02b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: ee9ef754-080c-4b56-a1f2-d5287268fb2f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:53.035967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63ebdbaa-9ccb-4396-94f7-477742ccf02b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:53.037321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63ebdbaa-9ccb-4396-94f7-477742ccf02b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:53.038438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63ebdbaa-9ccb-4396-94f7-477742ccf02b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:53.040154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63ebdbaa-9ccb-4396-94f7-477742ccf02b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:53.041278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63ebdbaa-9ccb-4396-94f7-477742ccf02b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:53.042333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63ebdbaa-9ccb-4396-94f7-477742ccf02b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:53.250035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9c67d4c6-6990-4c7b-ab51-ac39c9e542df tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:53.271775 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9c67d4c6-6990-4c7b-ab51-ac39c9e542df tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1354 microversion: 2.1 time: 0.585434 Oct 10 23:32:53.285403 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1850/3582] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:52 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1354 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:53.410865 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-63ebdbaa-9ccb-4396-94f7-477742ccf02b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f" status: 200 len: 1462 microversion: 2.1 time: 0.395830 Oct 10 23:32:53.430362 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1733/3583] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:53 2022] GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f => generated 1462 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:54.033201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b549dd4a-a8ee-4c07-884f-c8b38343cc72 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a5f5c10>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:54.092333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2fda3355-be40-4e72-a1ab-80661f6af815 tempest-PortsAdminExtendedAttrsIpV6TestJSON-828883613 tempest-PortsAdminExtendedAttrsIpV6TestJSON-828883613-project-admin] Calling method '.version_select at 0x7f662a64d430>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:54.094882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fda3355-be40-4e72-a1ab-80661f6af815 tempest-PortsAdminExtendedAttrsIpV6TestJSON-828883613 tempest-PortsAdminExtendedAttrsIpV6TestJSON-828883613-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:54.095494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fda3355-be40-4e72-a1ab-80661f6af815 tempest-PortsAdminExtendedAttrsIpV6TestJSON-828883613 tempest-PortsAdminExtendedAttrsIpV6TestJSON-828883613-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:54.096043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fda3355-be40-4e72-a1ab-80661f6af815 tempest-PortsAdminExtendedAttrsIpV6TestJSON-828883613 tempest-PortsAdminExtendedAttrsIpV6TestJSON-828883613-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:54.116224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fda3355-be40-4e72-a1ab-80661f6af815 tempest-PortsAdminExtendedAttrsIpV6TestJSON-828883613 tempest-PortsAdminExtendedAttrsIpV6TestJSON-828883613-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:54.117075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fda3355-be40-4e72-a1ab-80661f6af815 tempest-PortsAdminExtendedAttrsIpV6TestJSON-828883613 tempest-PortsAdminExtendedAttrsIpV6TestJSON-828883613-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:54.117880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fda3355-be40-4e72-a1ab-80661f6af815 tempest-PortsAdminExtendedAttrsIpV6TestJSON-828883613 tempest-PortsAdminExtendedAttrsIpV6TestJSON-828883613-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:54.137989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fda3355-be40-4e72-a1ab-80661f6af815 tempest-PortsAdminExtendedAttrsIpV6TestJSON-828883613 tempest-PortsAdminExtendedAttrsIpV6TestJSON-828883613-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:54.138888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fda3355-be40-4e72-a1ab-80661f6af815 tempest-PortsAdminExtendedAttrsIpV6TestJSON-828883613 tempest-PortsAdminExtendedAttrsIpV6TestJSON-828883613-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:54.139589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fda3355-be40-4e72-a1ab-80661f6af815 tempest-PortsAdminExtendedAttrsIpV6TestJSON-828883613 tempest-PortsAdminExtendedAttrsIpV6TestJSON-828883613-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:54.149427 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2fda3355-be40-4e72-a1ab-80661f6af815 tempest-PortsAdminExtendedAttrsIpV6TestJSON-828883613 tempest-PortsAdminExtendedAttrsIpV6TestJSON-828883613-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.294768 Oct 10 23:32:54.158697 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1851/3584] 10.222.0.23 () {58 vars in 1146 bytes} [Mon Oct 10 23:32:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:32:54.225992 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b549dd4a-a8ee-4c07-884f-c8b38343cc72 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1452 microversion: 2.1 time: 0.197301 Oct 10 23:32:54.237563 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1734/3585] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:54 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1452 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:32:54.316228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1e9c9d25-6f0a-459c-98b5-1c57712d8d58 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:54.328037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1e9c9d25-6f0a-459c-98b5-1c57712d8d58 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:54.329692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e9c9d25-6f0a-459c-98b5-1c57712d8d58 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:54.331364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e9c9d25-6f0a-459c-98b5-1c57712d8d58 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:54.331876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e9c9d25-6f0a-459c-98b5-1c57712d8d58 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:54.332947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e9c9d25-6f0a-459c-98b5-1c57712d8d58 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:54.333608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e9c9d25-6f0a-459c-98b5-1c57712d8d58 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:54.334838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e9c9d25-6f0a-459c-98b5-1c57712d8d58 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:54.462415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-662084b3-52fd-426f-9732-acf84ebc8cc6 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:54.463097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-662084b3-52fd-426f-9732-acf84ebc8cc6 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: ee9ef754-080c-4b56-a1f2-d5287268fb2f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:54.472609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-662084b3-52fd-426f-9732-acf84ebc8cc6 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:54.473331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-662084b3-52fd-426f-9732-acf84ebc8cc6 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:54.473954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-662084b3-52fd-426f-9732-acf84ebc8cc6 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:54.478257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-662084b3-52fd-426f-9732-acf84ebc8cc6 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:54.479064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-662084b3-52fd-426f-9732-acf84ebc8cc6 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:54.479708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-662084b3-52fd-426f-9732-acf84ebc8cc6 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:54.725970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1e9c9d25-6f0a-459c-98b5-1c57712d8d58 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:54.736513 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1e9c9d25-6f0a-459c-98b5-1c57712d8d58 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1354 microversion: 2.1 time: 0.438317 Oct 10 23:32:54.751173 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1852/3586] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:54 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1354 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:54.812064 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-662084b3-52fd-426f-9732-acf84ebc8cc6 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f" status: 200 len: 1462 microversion: 2.1 time: 0.369476 Oct 10 23:32:54.812064 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1735/3587] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:54 2022] GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f => generated 1462 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:55.252233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-528e3f67-af9e-47bf-830e-f4360309a854 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662b94b280>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:55.281444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:32:55.317209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:32:55.432069 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-528e3f67-af9e-47bf-830e-f4360309a854 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1452 microversion: 2.1 time: 0.190524 Oct 10 23:32:55.433180 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1853/3588] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:55 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1452 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:55.765237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-db05fec0-6fd6-4faf-850e-c24e4aab0091 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:55.766958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-db05fec0-6fd6-4faf-850e-c24e4aab0091 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:55.782756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db05fec0-6fd6-4faf-850e-c24e4aab0091 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:55.785643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db05fec0-6fd6-4faf-850e-c24e4aab0091 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:55.790194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db05fec0-6fd6-4faf-850e-c24e4aab0091 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:55.791605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db05fec0-6fd6-4faf-850e-c24e4aab0091 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:55.792257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db05fec0-6fd6-4faf-850e-c24e4aab0091 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:55.792869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db05fec0-6fd6-4faf-850e-c24e4aab0091 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:55.847178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0735af15-2b60-4de5-988f-2c67180be6b0 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:55.849535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0735af15-2b60-4de5-988f-2c67180be6b0 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: ee9ef754-080c-4b56-a1f2-d5287268fb2f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:55.886191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0735af15-2b60-4de5-988f-2c67180be6b0 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:55.892499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0735af15-2b60-4de5-988f-2c67180be6b0 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:55.894550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0735af15-2b60-4de5-988f-2c67180be6b0 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:55.895508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0735af15-2b60-4de5-988f-2c67180be6b0 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:55.899311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0735af15-2b60-4de5-988f-2c67180be6b0 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:55.901785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0735af15-2b60-4de5-988f-2c67180be6b0 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:56.341725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-db05fec0-6fd6-4faf-850e-c24e4aab0091 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:56.353882 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-db05fec0-6fd6-4faf-850e-c24e4aab0091 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1354 microversion: 2.1 time: 0.595146 Oct 10 23:32:56.355193 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1736/3589] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:55 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1354 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:56.463287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-71837ccc-7d81-46bf-85a7-b98e52e8ebca tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a3e1820>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:56.530467 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0735af15-2b60-4de5-988f-2c67180be6b0 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f" status: 200 len: 1462 microversion: 2.1 time: 0.686258 Oct 10 23:32:56.532401 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1854/3590] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:55 2022] GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f => generated 1462 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:56.564515 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-71837ccc-7d81-46bf-85a7-b98e52e8ebca tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1452 microversion: 2.1 time: 0.106666 Oct 10 23:32:56.565730 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1737/3591] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:56 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:57.398502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-97076b69-7448-457f-9d15-7229086904cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:57.399604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-97076b69-7448-457f-9d15-7229086904cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:57.432985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97076b69-7448-457f-9d15-7229086904cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:57.436912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97076b69-7448-457f-9d15-7229086904cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:57.438704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97076b69-7448-457f-9d15-7229086904cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:57.440721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97076b69-7448-457f-9d15-7229086904cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:57.442679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97076b69-7448-457f-9d15-7229086904cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:57.445320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97076b69-7448-457f-9d15-7229086904cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:57.571438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-038dd89b-8a85-4c2a-a28a-4adfe127f404 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:57.576715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-038dd89b-8a85-4c2a-a28a-4adfe127f404 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: ee9ef754-080c-4b56-a1f2-d5287268fb2f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:57.604057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-038dd89b-8a85-4c2a-a28a-4adfe127f404 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:57.606923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-038dd89b-8a85-4c2a-a28a-4adfe127f404 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:57.609474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-038dd89b-8a85-4c2a-a28a-4adfe127f404 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:57.611988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-038dd89b-8a85-4c2a-a28a-4adfe127f404 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:57.615146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-038dd89b-8a85-4c2a-a28a-4adfe127f404 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:57.616925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-038dd89b-8a85-4c2a-a28a-4adfe127f404 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:57.799635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-97076b69-7448-457f-9d15-7229086904cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:57.853926 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-97076b69-7448-457f-9d15-7229086904cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1354 microversion: 2.1 time: 0.463474 Oct 10 23:32:57.867392 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1855/3592] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:57 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1354 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:57.899431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fcdcec20-b2ca-4d1a-9b15-ecafa53a0b75 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a6eb700>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:57.997887 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fcdcec20-b2ca-4d1a-9b15-ecafa53a0b75 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1452 microversion: 2.1 time: 0.128916 Oct 10 23:32:58.009724 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1856/3593] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:57 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1452 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:58.364765 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-038dd89b-8a85-4c2a-a28a-4adfe127f404 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f" status: 200 len: 1462 microversion: 2.1 time: 0.803281 Oct 10 23:32:58.366949 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1738/3594] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:57 2022] GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f => generated 1462 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:58.886294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d739bbe4-ea6d-4c84-bda7-9ac26f5cd767 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:58.887164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d739bbe4-ea6d-4c84-bda7-9ac26f5cd767 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:58.902102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d739bbe4-ea6d-4c84-bda7-9ac26f5cd767 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:58.903436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d739bbe4-ea6d-4c84-bda7-9ac26f5cd767 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:58.904457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d739bbe4-ea6d-4c84-bda7-9ac26f5cd767 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:58.905534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d739bbe4-ea6d-4c84-bda7-9ac26f5cd767 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:58.906473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d739bbe4-ea6d-4c84-bda7-9ac26f5cd767 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:58.907141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d739bbe4-ea6d-4c84-bda7-9ac26f5cd767 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:59.015741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-35599e27-e566-4283-8eaa-5ae42a9b3906 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a475790>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:59.118732 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-35599e27-e566-4283-8eaa-5ae42a9b3906 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1452 microversion: 2.1 time: 0.107294 Oct 10 23:32:59.120039 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1739/3595] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:32:59 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:59.225986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d739bbe4-ea6d-4c84-bda7-9ac26f5cd767 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:32:59.259946 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d739bbe4-ea6d-4c84-bda7-9ac26f5cd767 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1805 microversion: 2.1 time: 0.380706 Oct 10 23:32:59.262160 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1857/3596] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:58 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1805 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:32:59.300054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f90d4485-a28c-45e6-8932-a30dc1a14142 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:59.302258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f90d4485-a28c-45e6-8932-a30dc1a14142 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:59.328113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f90d4485-a28c-45e6-8932-a30dc1a14142 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:59.328619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f90d4485-a28c-45e6-8932-a30dc1a14142 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:59.329069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f90d4485-a28c-45e6-8932-a30dc1a14142 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:59.329842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f90d4485-a28c-45e6-8932-a30dc1a14142 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:59.330306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f90d4485-a28c-45e6-8932-a30dc1a14142 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:59.330748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f90d4485-a28c-45e6-8932-a30dc1a14142 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:59.366705 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f90d4485-a28c-45e6-8932-a30dc1a14142 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5/ips" status: 200 len: 219 microversion: 2.1 time: 0.074015 Oct 10 23:32:59.380333 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1740/3597] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 10 23:32:59 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5/ips => generated 219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:32:59.385313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6692c64f-6235-4d16-b748-d0081d2e2438 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:59.385874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6692c64f-6235-4d16-b748-d0081d2e2438 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:59.403176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ca28a9a5-75f2-4369-a7b8-9eb97e5ca459 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:59.404938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6692c64f-6235-4d16-b748-d0081d2e2438 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:59.405583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6692c64f-6235-4d16-b748-d0081d2e2438 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:59.406285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6692c64f-6235-4d16-b748-d0081d2e2438 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:59.407515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6692c64f-6235-4d16-b748-d0081d2e2438 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:59.407813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ca28a9a5-75f2-4369-a7b8-9eb97e5ca459 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: ee9ef754-080c-4b56-a1f2-d5287268fb2f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:59.408482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6692c64f-6235-4d16-b748-d0081d2e2438 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:59.418074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6692c64f-6235-4d16-b748-d0081d2e2438 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:59.423210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca28a9a5-75f2-4369-a7b8-9eb97e5ca459 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:59.423731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca28a9a5-75f2-4369-a7b8-9eb97e5ca459 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:59.424175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca28a9a5-75f2-4369-a7b8-9eb97e5ca459 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:59.424923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca28a9a5-75f2-4369-a7b8-9eb97e5ca459 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:59.425419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca28a9a5-75f2-4369-a7b8-9eb97e5ca459 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:59.425871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca28a9a5-75f2-4369-a7b8-9eb97e5ca459 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:59.480947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6692c64f-6235-4d16-b748-d0081d2e2438 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:32:59.676020 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6692c64f-6235-4d16-b748-d0081d2e2438 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 204 len: 0 microversion: 2.1 time: 0.292948 Oct 10 23:32:59.684469 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1858/3598] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:32:59 2022] DELETE /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:32:59.704486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8221ab36-c57f-48bb-83a4-05d5dafa829b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:32:59.704486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8221ab36-c57f-48bb-83a4-05d5dafa829b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:32:59.714022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8221ab36-c57f-48bb-83a4-05d5dafa829b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:59.714866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8221ab36-c57f-48bb-83a4-05d5dafa829b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:59.716205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8221ab36-c57f-48bb-83a4-05d5dafa829b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:32:59.717312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8221ab36-c57f-48bb-83a4-05d5dafa829b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:32:59.718105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8221ab36-c57f-48bb-83a4-05d5dafa829b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:32:59.719177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8221ab36-c57f-48bb-83a4-05d5dafa829b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:00.264351 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ca28a9a5-75f2-4369-a7b8-9eb97e5ca459 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f" status: 200 len: 1462 microversion: 2.1 time: 0.869799 Oct 10 23:33:00.283040 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1741/3599] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:59 2022] GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f => generated 1462 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:33:00.290793 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-525ee729-a9f0-4a66-b9dc-ce68938d139d tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a47be50>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:00.343458 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-525ee729-a9f0-4a66-b9dc-ce68938d139d tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1452 microversion: 2.1 time: 0.057595 Oct 10 23:33:00.344620 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1742/3600] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:33:00 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1452 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:00.399620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8221ab36-c57f-48bb-83a4-05d5dafa829b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:00.425537 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8221ab36-c57f-48bb-83a4-05d5dafa829b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1811 microversion: 2.1 time: 0.732295 Oct 10 23:33:00.427512 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1859/3601] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:32:59 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1811 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:01.296053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b5d465c1-e1c9-4eed-b431-df7ded238b9e tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:01.296689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b5d465c1-e1c9-4eed-b431-df7ded238b9e tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: ee9ef754-080c-4b56-a1f2-d5287268fb2f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:01.329310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5d465c1-e1c9-4eed-b431-df7ded238b9e tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:01.339629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5d465c1-e1c9-4eed-b431-df7ded238b9e tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:01.340845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5d465c1-e1c9-4eed-b431-df7ded238b9e tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:01.346636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5d465c1-e1c9-4eed-b431-df7ded238b9e tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:01.347724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5d465c1-e1c9-4eed-b431-df7ded238b9e tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:01.350206 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5d465c1-e1c9-4eed-b431-df7ded238b9e tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:01.369580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-397e7ab5-2098-4f2c-90ed-932886f222fa tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662aebc790>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:01.513264 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-397e7ab5-2098-4f2c-90ed-932886f222fa tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1452 microversion: 2.1 time: 0.151379 Oct 10 23:33:01.517834 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1860/3602] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:33:01 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:01.543133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1c7f50b7-dbc2-4870-a85e-42d3b0ddbec4 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:01.544957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1c7f50b7-dbc2-4870-a85e-42d3b0ddbec4 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:01.570015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c7f50b7-dbc2-4870-a85e-42d3b0ddbec4 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:01.571353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c7f50b7-dbc2-4870-a85e-42d3b0ddbec4 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:01.572657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c7f50b7-dbc2-4870-a85e-42d3b0ddbec4 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:01.575368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c7f50b7-dbc2-4870-a85e-42d3b0ddbec4 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:01.576796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c7f50b7-dbc2-4870-a85e-42d3b0ddbec4 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:01.579536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c7f50b7-dbc2-4870-a85e-42d3b0ddbec4 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:02.012499 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b5d465c1-e1c9-4eed-b431-df7ded238b9e tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f" status: 200 len: 1462 microversion: 2.1 time: 0.723223 Oct 10 23:33:02.027606 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1743/3603] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:01 2022] GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f => generated 1462 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:02.048601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-03f15b80-0e05-44db-bbb7-711bd52ecbee req-55cbaceb-7684-4572-be78-3b953e66fb42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9ef754-080c-4b56-a1f2-d5287268fb2f", "name": "network-vif-plugged", "status": "completed", "tag": "62fa7642-76b0-409d-a11e-491c4a8e08af"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:33:02.065523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-03f15b80-0e05-44db-bbb7-711bd52ecbee req-55cbaceb-7684-4572-be78-3b953e66fb42 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:02.066337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-03f15b80-0e05-44db-bbb7-711bd52ecbee req-55cbaceb-7684-4572-be78-3b953e66fb42 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:02.067292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-03f15b80-0e05-44db-bbb7-711bd52ecbee req-55cbaceb-7684-4572-be78-3b953e66fb42 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:02.090739 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-03f15b80-0e05-44db-bbb7-711bd52ecbee req-55cbaceb-7684-4572-be78-3b953e66fb42 service nova] Creating event network-vif-plugged:62fa7642-76b0-409d-a11e-491c4a8e08af for instance ee9ef754-080c-4b56-a1f2-d5287268fb2f on n-h1-860864-2 Oct 10 23:33:02.103490 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-03f15b80-0e05-44db-bbb7-711bd52ecbee req-55cbaceb-7684-4572-be78-3b953e66fb42 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073988 Oct 10 23:33:02.104492 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1744/3604] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:33:02.233262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1c7f50b7-dbc2-4870-a85e-42d3b0ddbec4 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:02.256872 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1c7f50b7-dbc2-4870-a85e-42d3b0ddbec4 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1811 microversion: 2.1 time: 0.735966 Oct 10 23:33:02.258018 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1861/3605] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:01 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1811 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:02.531389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b48d943b-fc10-4965-b3b3-1290f2b83453 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a47be50>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:02.682284 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b48d943b-fc10-4965-b3b3-1290f2b83453 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1452 microversion: 2.1 time: 0.155468 Oct 10 23:33:02.696018 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1745/3606] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:33:02 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1452 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:33:02.708473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-04f849cc-ec71-40be-8f18-ac8e7674964d req-8eb39ebe-eb85-48ce-ad70-11e233224b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ca263a-16c7-4514-963e-6a008e39baa5", "name": "network-vif-deleted", "tag": "d5ffc3e2-26b3-4e5c-9e72-e1e71d3304a4"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:33:02.734899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-04f849cc-ec71-40be-8f18-ac8e7674964d req-8eb39ebe-eb85-48ce-ad70-11e233224b0e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:02.735764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-04f849cc-ec71-40be-8f18-ac8e7674964d req-8eb39ebe-eb85-48ce-ad70-11e233224b0e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:02.743118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-04f849cc-ec71-40be-8f18-ac8e7674964d req-8eb39ebe-eb85-48ce-ad70-11e233224b0e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:02.769554 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-04f849cc-ec71-40be-8f18-ac8e7674964d req-8eb39ebe-eb85-48ce-ad70-11e233224b0e service nova] Creating event network-vif-deleted:d5ffc3e2-26b3-4e5c-9e72-e1e71d3304a4 for instance d3ca263a-16c7-4514-963e-6a008e39baa5 on n-h1-860864-2 Oct 10 23:33:02.795099 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-04f849cc-ec71-40be-8f18-ac8e7674964d req-8eb39ebe-eb85-48ce-ad70-11e233224b0e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090281 Oct 10 23:33:02.806476 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1862/3607] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:33:03.049361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-941ba2b5-f1a2-4bc6-95ab-d77422c67f5f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:03.050165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-941ba2b5-f1a2-4bc6-95ab-d77422c67f5f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: ee9ef754-080c-4b56-a1f2-d5287268fb2f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:03.067068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-941ba2b5-f1a2-4bc6-95ab-d77422c67f5f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:03.073908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-941ba2b5-f1a2-4bc6-95ab-d77422c67f5f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:03.075048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-941ba2b5-f1a2-4bc6-95ab-d77422c67f5f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:03.076387 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-941ba2b5-f1a2-4bc6-95ab-d77422c67f5f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:03.077262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-941ba2b5-f1a2-4bc6-95ab-d77422c67f5f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:03.078088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-941ba2b5-f1a2-4bc6-95ab-d77422c67f5f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:03.303427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-46ad88d3-2b97-4ff5-a7b1-01b755e8b064 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:03.309967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-46ad88d3-2b97-4ff5-a7b1-01b755e8b064 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:03.345600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46ad88d3-2b97-4ff5-a7b1-01b755e8b064 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:03.349086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46ad88d3-2b97-4ff5-a7b1-01b755e8b064 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:03.354066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46ad88d3-2b97-4ff5-a7b1-01b755e8b064 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:03.355554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46ad88d3-2b97-4ff5-a7b1-01b755e8b064 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:03.366544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46ad88d3-2b97-4ff5-a7b1-01b755e8b064 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:03.367688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46ad88d3-2b97-4ff5-a7b1-01b755e8b064 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:03.449437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:33:03.916890 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-941ba2b5-f1a2-4bc6-95ab-d77422c67f5f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f" status: 200 len: 1462 microversion: 2.1 time: 0.872945 Oct 10 23:33:03.941494 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1746/3608] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:03 2022] GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f => generated 1462 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:03.959613 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-111d539f-2bd5-48d6-91da-5cef860e6fc8 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a48b8b0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:03.978329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-46ad88d3-2b97-4ff5-a7b1-01b755e8b064 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:04.001291 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-46ad88d3-2b97-4ff5-a7b1-01b755e8b064 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1632 microversion: 2.1 time: 0.710994 Oct 10 23:33:04.003113 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1863/3609] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:03 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1632 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:04.103066 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-111d539f-2bd5-48d6-91da-5cef860e6fc8 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1452 microversion: 2.1 time: 0.154837 Oct 10 23:33:04.110047 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1747/3610] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:33:03 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:04.885334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-37afda83-179a-4c15-8da4-fa45592815c0 req-dfa4461d-a3ac-4e43-b74c-c49867b1e93c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ca263a-16c7-4514-963e-6a008e39baa5", "name": "network-vif-deleted", "tag": "c6c7d195-16f8-4f6a-bbf0-90c1e1cd08fd"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:33:04.927188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-37afda83-179a-4c15-8da4-fa45592815c0 req-dfa4461d-a3ac-4e43-b74c-c49867b1e93c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:04.929641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-37afda83-179a-4c15-8da4-fa45592815c0 req-dfa4461d-a3ac-4e43-b74c-c49867b1e93c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:04.938920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-37afda83-179a-4c15-8da4-fa45592815c0 req-dfa4461d-a3ac-4e43-b74c-c49867b1e93c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:04.965543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-500d1e5e-00c8-4548-8639-0fa8c06e48eb tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:04.967781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-500d1e5e-00c8-4548-8639-0fa8c06e48eb tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: ee9ef754-080c-4b56-a1f2-d5287268fb2f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:04.989537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-500d1e5e-00c8-4548-8639-0fa8c06e48eb tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:04.994308 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-37afda83-179a-4c15-8da4-fa45592815c0 req-dfa4461d-a3ac-4e43-b74c-c49867b1e93c service nova] Creating event network-vif-deleted:c6c7d195-16f8-4f6a-bbf0-90c1e1cd08fd for instance d3ca263a-16c7-4514-963e-6a008e39baa5 on n-h1-860864-2 Oct 10 23:33:04.999927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-500d1e5e-00c8-4548-8639-0fa8c06e48eb tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:05.000387 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-500d1e5e-00c8-4548-8639-0fa8c06e48eb tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:05.001139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-500d1e5e-00c8-4548-8639-0fa8c06e48eb tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:05.001685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-500d1e5e-00c8-4548-8639-0fa8c06e48eb tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:05.002339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-500d1e5e-00c8-4548-8639-0fa8c06e48eb tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:05.031873 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-37afda83-179a-4c15-8da4-fa45592815c0 req-dfa4461d-a3ac-4e43-b74c-c49867b1e93c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154445 Oct 10 23:33:05.032768 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1864/3611] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:33:05.051828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3634d672-4629-4ad4-a19b-bccce9156ad8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:05.064769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3634d672-4629-4ad4-a19b-bccce9156ad8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:05.080263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3634d672-4629-4ad4-a19b-bccce9156ad8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:05.089922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3634d672-4629-4ad4-a19b-bccce9156ad8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:05.090839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3634d672-4629-4ad4-a19b-bccce9156ad8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:05.092708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3634d672-4629-4ad4-a19b-bccce9156ad8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:05.094305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3634d672-4629-4ad4-a19b-bccce9156ad8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:05.094968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3634d672-4629-4ad4-a19b-bccce9156ad8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:05.485682 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-500d1e5e-00c8-4548-8639-0fa8c06e48eb tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f" status: 200 len: 1646 microversion: 2.1 time: 0.536266 Oct 10 23:33:05.486589 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1748/3612] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:04 2022] GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f => generated 1646 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:33:05.502253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6090f98f-52cd-4675-8929-9284741ad12e tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a5f5c10>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:05.581957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3634d672-4629-4ad4-a19b-bccce9156ad8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:05.600754 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6090f98f-52cd-4675-8929-9284741ad12e tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1452 microversion: 2.1 time: 0.112199 Oct 10 23:33:05.608096 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1749/3613] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:33:05 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1452 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:05.616654 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3634d672-4629-4ad4-a19b-bccce9156ad8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1496 microversion: 2.1 time: 0.559361 Oct 10 23:33:05.631259 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1865/3614] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:05 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1496 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:05.645007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-92a4af82-d74b-456e-a512-34a57a5fd1a1 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:05.653750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-92a4af82-d74b-456e-a512-34a57a5fd1a1 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: ee9ef754-080c-4b56-a1f2-d5287268fb2f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:05.665411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92a4af82-d74b-456e-a512-34a57a5fd1a1 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:05.665989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92a4af82-d74b-456e-a512-34a57a5fd1a1 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:05.666538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92a4af82-d74b-456e-a512-34a57a5fd1a1 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:05.667366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92a4af82-d74b-456e-a512-34a57a5fd1a1 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:05.667956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92a4af82-d74b-456e-a512-34a57a5fd1a1 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:05.668392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92a4af82-d74b-456e-a512-34a57a5fd1a1 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:06.238094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:33:06.269421 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-92a4af82-d74b-456e-a512-34a57a5fd1a1 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f" status: 200 len: 1646 microversion: 2.1 time: 0.658456 Oct 10 23:33:06.275118 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1750/3615] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:05 2022] GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f => generated 1646 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:06.309106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6da91469-d1c4-43ab-a2c4-4be4cbadcb2a tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:06.310315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6da91469-d1c4-43ab-a2c4-4be4cbadcb2a tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: ee9ef754-080c-4b56-a1f2-d5287268fb2f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:06.333407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6da91469-d1c4-43ab-a2c4-4be4cbadcb2a tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:06.336854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6da91469-d1c4-43ab-a2c4-4be4cbadcb2a tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:06.338837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6da91469-d1c4-43ab-a2c4-4be4cbadcb2a tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:06.341578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6da91469-d1c4-43ab-a2c4-4be4cbadcb2a tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:06.344010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6da91469-d1c4-43ab-a2c4-4be4cbadcb2a tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:06.345446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6da91469-d1c4-43ab-a2c4-4be4cbadcb2a tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:06.628101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e9a21eb9-5c38-416d-8f95-a2e7bd931204 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a45c550>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:06.718439 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e9a21eb9-5c38-416d-8f95-a2e7bd931204 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1452 microversion: 2.1 time: 0.092011 Oct 10 23:33:06.735999 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1751/3616] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:33:06 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:06.746972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-47c49576-94d0-4a6b-a9eb-44628cb642cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:06.748474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-47c49576-94d0-4a6b-a9eb-44628cb642cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:06.760192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47c49576-94d0-4a6b-a9eb-44628cb642cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:06.761621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47c49576-94d0-4a6b-a9eb-44628cb642cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:06.762734 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47c49576-94d0-4a6b-a9eb-44628cb642cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:06.764291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47c49576-94d0-4a6b-a9eb-44628cb642cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:06.765469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47c49576-94d0-4a6b-a9eb-44628cb642cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:06.766519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47c49576-94d0-4a6b-a9eb-44628cb642cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:06.876939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47c49576-94d0-4a6b-a9eb-44628cb642cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:06.879097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47c49576-94d0-4a6b-a9eb-44628cb642cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:06.880061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47c49576-94d0-4a6b-a9eb-44628cb642cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:06.881824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-47c49576-94d0-4a6b-a9eb-44628cb642cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lazy-loading 'fault' on Instance uuid d3ca263a-16c7-4514-963e-6a008e39baa5 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:33:06.955735 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6da91469-d1c4-43ab-a2c4-4be4cbadcb2a tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f" status: 200 len: 1646 microversion: 2.1 time: 0.653219 Oct 10 23:33:06.964586 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1866/3617] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:06 2022] GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f => generated 1646 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:07.018277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3d97cf9a-0adb-4d5b-96e5-fe18335f4700 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:07.022366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3d97cf9a-0adb-4d5b-96e5-fe18335f4700 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: ee9ef754-080c-4b56-a1f2-d5287268fb2f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:07.032598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-47c49576-94d0-4a6b-a9eb-44628cb642cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:07.063252 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-47c49576-94d0-4a6b-a9eb-44628cb642cf tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 200 len: 1302 microversion: 2.1 time: 0.325346 Oct 10 23:33:07.067183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d97cf9a-0adb-4d5b-96e5-fe18335f4700 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:07.070762 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1752/3618] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:06 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 1302 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:07.083816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d97cf9a-0adb-4d5b-96e5-fe18335f4700 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:07.091768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d97cf9a-0adb-4d5b-96e5-fe18335f4700 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:07.094802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d97cf9a-0adb-4d5b-96e5-fe18335f4700 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:07.096724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d97cf9a-0adb-4d5b-96e5-fe18335f4700 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:07.097362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d97cf9a-0adb-4d5b-96e5-fe18335f4700 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:07.116118 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-92e53082-18ec-4ab3-ba4a-7dbf8f1328bc req-accda2e9-bf87-4405-b0b0-c24a403d0360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3ca263a-16c7-4514-963e-6a008e39baa5", "name": "network-vif-deleted", "tag": "754eb733-038d-4f6b-a16c-1e4489b638de"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:33:07.138533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-92e53082-18ec-4ab3-ba4a-7dbf8f1328bc req-accda2e9-bf87-4405-b0b0-c24a403d0360 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:07.139249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-92e53082-18ec-4ab3-ba4a-7dbf8f1328bc req-accda2e9-bf87-4405-b0b0-c24a403d0360 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:07.139865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-92e53082-18ec-4ab3-ba4a-7dbf8f1328bc req-accda2e9-bf87-4405-b0b0-c24a403d0360 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:07.169781 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-92e53082-18ec-4ab3-ba4a-7dbf8f1328bc req-accda2e9-bf87-4405-b0b0-c24a403d0360 service nova] Creating event network-vif-deleted:754eb733-038d-4f6b-a16c-1e4489b638de for instance d3ca263a-16c7-4514-963e-6a008e39baa5 on n-h1-860864-2 Oct 10 23:33:07.182403 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-92e53082-18ec-4ab3-ba4a-7dbf8f1328bc req-accda2e9-bf87-4405-b0b0-c24a403d0360 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077947 Oct 10 23:33:07.186290 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1753/3619] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:33:07.213271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3d97cf9a-0adb-4d5b-96e5-fe18335f4700 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: ee9ef754-080c-4b56-a1f2-d5287268fb2f] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:33:07.477392 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3d97cf9a-0adb-4d5b-96e5-fe18335f4700 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f" status: 204 len: 0 microversion: 2.1 time: 0.479838 Oct 10 23:33:07.482039 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1867/3620] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:33:06 2022] DELETE /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:33:07.489333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ab0e1ade-ef79-44da-bf08-e52667e75111 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:07.491610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ab0e1ade-ef79-44da-bf08-e52667e75111 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: ee9ef754-080c-4b56-a1f2-d5287268fb2f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:07.523606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab0e1ade-ef79-44da-bf08-e52667e75111 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:07.525590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab0e1ade-ef79-44da-bf08-e52667e75111 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:07.528483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab0e1ade-ef79-44da-bf08-e52667e75111 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:07.531551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab0e1ade-ef79-44da-bf08-e52667e75111 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:07.533057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab0e1ade-ef79-44da-bf08-e52667e75111 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:07.536240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab0e1ade-ef79-44da-bf08-e52667e75111 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:07.742196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7520371e-fa30-4f21-833f-83c8553ea461 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a64d820>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:07.822683 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7520371e-fa30-4f21-833f-83c8553ea461 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1452 microversion: 2.1 time: 0.085914 Oct 10 23:33:07.823296 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1868/3621] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:33:07 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1452 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:33:07.922853 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ab0e1ade-ef79-44da-bf08-e52667e75111 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f" status: 200 len: 1652 microversion: 2.1 time: 0.438316 Oct 10 23:33:07.924050 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1754/3622] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:07 2022] GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f => generated 1652 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:08.102695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-02b6291f-2a5b-436e-879a-6b61e27bfbbd tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:08.103932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-02b6291f-2a5b-436e-879a-6b61e27bfbbd tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:08.130020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02b6291f-2a5b-436e-879a-6b61e27bfbbd tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:08.131699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02b6291f-2a5b-436e-879a-6b61e27bfbbd tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:08.135582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02b6291f-2a5b-436e-879a-6b61e27bfbbd tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:08.136898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02b6291f-2a5b-436e-879a-6b61e27bfbbd tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:08.140136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02b6291f-2a5b-436e-879a-6b61e27bfbbd tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:08.144858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02b6291f-2a5b-436e-879a-6b61e27bfbbd tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:08.221277 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-02b6291f-2a5b-436e-879a-6b61e27bfbbd tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] HTTP exception thrown: Instance d3ca263a-16c7-4514-963e-6a008e39baa5 could not be found. Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-02b6291f-2a5b-436e-879a-6b61e27bfbbd tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Request method failure captured: Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 HTTP/1.1 Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKtpt25BnebxWGCA4Z7GvH1_E9dL58H8zbLekWHv8xuthsidwuoYDmMOh4PjTvqQ7uWj24A_LYKBzljHxvV1jPQGLL6bG0YhgNQa9d_w2OdxSzo6TCgqXMPKtf1DrAMlyYRbvmvrq4Y_eQAaQhqnzXu4VJZbjxLAbrgLQ6Sir6trSlg Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 70836dfc36f744ab8f26c1b47be26ff4 Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersTestMultiNic-738319113 Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/70836dfc36f744ab8f26c1b47be26ff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70836dfc36f744ab8f26c1b47be26ff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70836dfc36f744ab8f26c1b47be26ff4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_70836dfc36f744ab8f26c1b47be26ff4", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersTestMultiNic-738319113 Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 70836dfc36f744ab8f26c1b47be26ff4 Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersTestMultiNic-738319113 Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersTestMultiNic-738319113-project Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 781bd1f2871245399de1db53d1d9ad42 Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersTestMultiNic-738319113-project Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance d3ca263a-16c7-4514-963e-6a008e39baa5 could not be found. Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'd3ca263a-16c7-4514-963e-6a008e39baa5'} Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3ca263a-16c7-4514-963e-6a008e39baa5 could not be found. Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3ca263a-16c7-4514-963e-6a008e39baa5 could not be found. Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:33:08.229188 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:33:08.235248 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:33:08.235248 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:33:08.235248 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:33:08.235248 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:33:08.235248 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:33:08.235248 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3ca263a-16c7-4514-963e-6a008e39baa5 could not be found. Oct 10 23:33:08.235248 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:33:08.235248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-02b6291f-2a5b-436e-879a-6b61e27bfbbd tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Returning 404 to user: Instance d3ca263a-16c7-4514-963e-6a008e39baa5 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:33:08.238755 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-02b6291f-2a5b-436e-879a-6b61e27bfbbd tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 404 len: 111 microversion: 2.1 time: 0.140196 Oct 10 23:33:08.246029 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1869/3623] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:08 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:33:08.851268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dc0f0169-cfc5-4a20-b5b4-43414352119b tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a475b80>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:08.939383 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dc0f0169-cfc5-4a20-b5b4-43414352119b tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1452 microversion: 2.1 time: 0.094055 Oct 10 23:33:08.940257 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1755/3624] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:33:08 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:08.965906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d0a6a8d8-db36-45a6-a003-162aaab86259 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:08.966555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d0a6a8d8-db36-45a6-a003-162aaab86259 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: ee9ef754-080c-4b56-a1f2-d5287268fb2f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:08.976071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0a6a8d8-db36-45a6-a003-162aaab86259 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:08.976569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0a6a8d8-db36-45a6-a003-162aaab86259 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:08.977032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0a6a8d8-db36-45a6-a003-162aaab86259 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:08.977767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0a6a8d8-db36-45a6-a003-162aaab86259 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:08.978273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0a6a8d8-db36-45a6-a003-162aaab86259 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:08.978728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0a6a8d8-db36-45a6-a003-162aaab86259 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:09.176744 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d0a6a8d8-db36-45a6-a003-162aaab86259 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f" status: 200 len: 1652 microversion: 2.1 time: 0.216559 Oct 10 23:33:09.178632 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1870/3625] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:08 2022] GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f => generated 1652 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:09.962983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0118804a-a3d2-4a25-b3bf-aaaa8a4750d2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a3fa790>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:10.149457 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0118804a-a3d2-4a25-b3bf-aaaa8a4750d2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1461 microversion: 2.1 time: 0.194147 Oct 10 23:33:10.165818 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1756/3626] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:33:09 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1461 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:10.167016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-31cb23c9-1794-4884-bfcc-3706f41ee42e tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a6fc790>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:10.213310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0657bd7e-88f0-4e60-84c0-86afafe46bbe tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:10.214580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0657bd7e-88f0-4e60-84c0-86afafe46bbe tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: ee9ef754-080c-4b56-a1f2-d5287268fb2f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:10.236640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0657bd7e-88f0-4e60-84c0-86afafe46bbe tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:10.237139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0657bd7e-88f0-4e60-84c0-86afafe46bbe tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:10.237627 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0657bd7e-88f0-4e60-84c0-86afafe46bbe tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:10.238844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0657bd7e-88f0-4e60-84c0-86afafe46bbe tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:10.260627 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0657bd7e-88f0-4e60-84c0-86afafe46bbe tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:10.262320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0657bd7e-88f0-4e60-84c0-86afafe46bbe tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:10.311762 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-31cb23c9-1794-4884-bfcc-3706f41ee42e tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 200 len: 1461 microversion: 2.1 time: 0.145026 Oct 10 23:33:10.312753 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1871/3627] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:33:10 2022] GET /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 1461 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:10.350988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c959eccd-b065-4e7d-b024-de78ec5ddd38 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:10.351641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c959eccd-b065-4e7d-b024-de78ec5ddd38 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 430a8e18-4033-498b-8cf3-a224786b7363] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:10.382334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c959eccd-b065-4e7d-b024-de78ec5ddd38 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:10.382868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c959eccd-b065-4e7d-b024-de78ec5ddd38 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:10.387573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c959eccd-b065-4e7d-b024-de78ec5ddd38 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:10.389550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c959eccd-b065-4e7d-b024-de78ec5ddd38 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:10.392269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c959eccd-b065-4e7d-b024-de78ec5ddd38 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:10.392735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c959eccd-b065-4e7d-b024-de78ec5ddd38 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:10.775101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c959eccd-b065-4e7d-b024-de78ec5ddd38 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:10.787805 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c959eccd-b065-4e7d-b024-de78ec5ddd38 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363" status: 200 len: 1467 microversion: 2.1 time: 0.450497 Oct 10 23:33:10.791603 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1872/3628] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:10 2022] GET /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363 => generated 1467 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:33:10.884804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0b7ee331-1e5a-4275-aabb-8e85c7b4ea63 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f663399fe50>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:11.218032 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0b7ee331-1e5a-4275-aabb-8e85c7b4ea63 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images?changes-since=2022-10-10T23%3A30%3A33Z" status: 200 len: 2328 microversion: 2.1 time: 0.375139 Oct 10 23:33:11.220490 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1873/3629] 10.222.0.23 () {58 vars in 1199 bytes} [Mon Oct 10 23:33:10 2022] GET /compute/v2.1/images?changes-since=2022-10-10T23%3A30%3A33Z => generated 2328 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:11.242571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a276cba8-0198-497b-95e4-b0d0727188a2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a6ab9d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:11.381926 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a276cba8-0198-497b-95e4-b0d0727188a2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1254732773" status: 200 len: 485 microversion: 2.1 time: 0.146291 Oct 10 23:33:11.394372 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1874/3630] 10.222.0.23 () {58 vars in 1231 bytes} [Mon Oct 10 23:33:11 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1254732773 => generated 485 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:33:11.401442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-94dbb608-f6f3-40eb-a007-ab236aa8e07e tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f66339c99d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:11.596626 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-94dbb608-f6f3-40eb-a007-ab236aa8e07e tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images?server=430a8e18-4033-498b-8cf3-a224786b7363" status: 200 len: 957 microversion: 2.1 time: 0.199422 Oct 10 23:33:11.600516 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1875/3631] 10.222.0.23 () {58 vars in 1209 bytes} [Mon Oct 10 23:33:11 2022] GET /compute/v2.1/images?server=430a8e18-4033-498b-8cf3-a224786b7363 => generated 957 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:33:11.619168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-aacb9264-5e38-47bd-a1be-ba673b3c16c6 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662af4bee0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:11.661662 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0657bd7e-88f0-4e60-84c0-86afafe46bbe tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f" status: 200 len: 1652 microversion: 2.1 time: 1.455701 Oct 10 23:33:11.683494 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1757/3632] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:10 2022] GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f => generated 1652 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:11.741422 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-aacb9264-5e38-47bd-a1be-ba673b3c16c6 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2F037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 484 microversion: 2.1 time: 0.129092 Oct 10 23:33:11.742197 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1876/3633] 10.222.0.23 () {58 vars in 1317 bytes} [Mon Oct 10 23:33:11 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2F037ebfb5-534f-42db-9838-462de4b299e1 => generated 484 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:33:11.764643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-29d0ad95-3b16-4d1f-860e-b1b1ffee72db tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a475dc0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:11.928303 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-29d0ad95-3b16-4d1f-860e-b1b1ffee72db tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2F037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 484 microversion: 2.1 time: 0.167392 Oct 10 23:33:11.934879 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1758/3634] 10.222.0.23 () {58 vars in 1303 bytes} [Mon Oct 10 23:33:11 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2F037ebfb5-534f-42db-9838-462de4b299e1 => generated 484 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:33:11.965142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-139738d8-53ba-413c-ad61-efe3b39cdebd tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a64d1f0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:12.628386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-44feeb97-7c08-4217-92b5-26a3ef3892a6 req-3a663a79-4afd-4c3c-8c95-b293bb6a0f68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9ef754-080c-4b56-a1f2-d5287268fb2f", "name": "network-vif-deleted", "tag": "62fa7642-76b0-409d-a11e-491c4a8e08af"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:33:12.725601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-44feeb97-7c08-4217-92b5-26a3ef3892a6 req-3a663a79-4afd-4c3c-8c95-b293bb6a0f68 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:12.726558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-44feeb97-7c08-4217-92b5-26a3ef3892a6 req-3a663a79-4afd-4c3c-8c95-b293bb6a0f68 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:12.731016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-44feeb97-7c08-4217-92b5-26a3ef3892a6 req-3a663a79-4afd-4c3c-8c95-b293bb6a0f68 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:12.800521 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-139738d8-53ba-413c-ad61-efe3b39cdebd tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3707 microversion: 2.1 time: 0.835096 Oct 10 23:33:12.802234 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1877/3635] 10.222.0.23 () {58 vars in 1149 bytes} [Mon Oct 10 23:33:11 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3707 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:12.815634 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-44feeb97-7c08-4217-92b5-26a3ef3892a6 req-3a663a79-4afd-4c3c-8c95-b293bb6a0f68 service nova] Creating event network-vif-deleted:62fa7642-76b0-409d-a11e-491c4a8e08af for instance ee9ef754-080c-4b56-a1f2-d5287268fb2f on n-h1-860864-2 Oct 10 23:33:12.836729 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-44feeb97-7c08-4217-92b5-26a3ef3892a6 req-3a663a79-4afd-4c3c-8c95-b293bb6a0f68 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217295 Oct 10 23:33:12.849740 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1759/3636] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:33:12.851037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a53092c9-63d1-4a52-819c-1c99bc9af473 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:12.856153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a53092c9-63d1-4a52-819c-1c99bc9af473 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: ee9ef754-080c-4b56-a1f2-d5287268fb2f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:12.869924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e887492b-048c-48f4-af8c-2abfb4c7db49 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a4003a0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:12.906691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:33:12.912300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a53092c9-63d1-4a52-819c-1c99bc9af473 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:12.914067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a53092c9-63d1-4a52-819c-1c99bc9af473 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:12.915338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a53092c9-63d1-4a52-819c-1c99bc9af473 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:12.918606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a53092c9-63d1-4a52-819c-1c99bc9af473 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:12.920222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a53092c9-63d1-4a52-819c-1c99bc9af473 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:12.921676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a53092c9-63d1-4a52-819c-1c99bc9af473 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:13.095886 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e887492b-048c-48f4-af8c-2abfb4c7db49 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.242889 Oct 10 23:33:13.098618 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1760/3637] 10.222.0.23 () {58 vars in 1149 bytes} [Mon Oct 10 23:33:12 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:13.106775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a53092c9-63d1-4a52-819c-1c99bc9af473 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:13.108547 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a53092c9-63d1-4a52-819c-1c99bc9af473 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:13.109780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a53092c9-63d1-4a52-819c-1c99bc9af473 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:13.111546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-a53092c9-63d1-4a52-819c-1c99bc9af473 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lazy-loading 'fault' on Instance uuid ee9ef754-080c-4b56-a1f2-d5287268fb2f {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:33:13.141913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-94bd20aa-0ab6-4bd2-b62a-a6a73443fb1f tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a3e1310>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:13.230516 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-94bd20aa-0ab6-4bd2-b62a-a6a73443fb1f tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.113024 Oct 10 23:33:13.250180 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1761/3638] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:33:13 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:33:13.256840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-62e356a4-ac42-4f26-8852-a9fede2fea63 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a3e1430>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:13.306409 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a53092c9-63d1-4a52-819c-1c99bc9af473 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f" status: 200 len: 1452 microversion: 2.1 time: 0.500967 Oct 10 23:33:13.324014 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1878/3639] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:12 2022] GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f => generated 1452 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:13.478587 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-62e356a4-ac42-4f26-8852-a9fede2fea63 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/detail?changes-since=2022-10-10T23%3A30%3A26Z" status: 200 len: 7016 microversion: 2.1 time: 0.226451 Oct 10 23:33:13.479599 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1762/3640] 10.222.0.23 () {58 vars in 1220 bytes} [Mon Oct 10 23:33:13 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-10T23%3A30%3A26Z => generated 7016 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:13.524353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d48d0491-ad56-45a6-831e-531a779af24b tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a6ab820>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:13.613218 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d48d0491-ad56-45a6-831e-531a779af24b tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1254732773" status: 200 len: 665 microversion: 2.1 time: 0.092944 Oct 10 23:33:13.615905 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1879/3641] 10.222.0.23 () {58 vars in 1252 bytes} [Mon Oct 10 23:33:13 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1254732773 => generated 665 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:33:13.637834 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cd37d233-b0d1-4837-baf5-a5d95b746bfb tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a4001f0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:13.765350 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cd37d233-b0d1-4837-baf5-a5d95b746bfb tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2F037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1464 microversion: 2.1 time: 0.133336 Oct 10 23:33:13.770023 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1763/3642] 10.222.0.23 () {58 vars in 1338 bytes} [Mon Oct 10 23:33:13 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2F037ebfb5-534f-42db-9838-462de4b299e1 => generated 1464 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:13.791164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bfe9edb1-1861-4a99-8044-1269655e711e tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a711430>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:13.876302 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bfe9edb1-1861-4a99-8044-1269655e711e tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2F037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1464 microversion: 2.1 time: 0.092920 Oct 10 23:33:13.877687 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1880/3643] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Oct 10 23:33:13 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2F037ebfb5-534f-42db-9838-462de4b299e1 => generated 1464 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:13.914956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0892c0bb-7b12-4e2a-b1dd-6c01138d93d7 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a7aea60>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:14.050165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-693fd7b6-1a32-41ae-8917-456a4235fa6b tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfc51710-517e-4d16-868f-c8728704908a"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:33:14.052750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-693fd7b6-1a32-41ae-8917-456a4235fa6b tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:14.062138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-693fd7b6-1a32-41ae-8917-456a4235fa6b tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:14.062827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-693fd7b6-1a32-41ae-8917-456a4235fa6b tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:14.063447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-693fd7b6-1a32-41ae-8917-456a4235fa6b tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:14.064548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-693fd7b6-1a32-41ae-8917-456a4235fa6b tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:14.065293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-693fd7b6-1a32-41ae-8917-456a4235fa6b tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:14.066516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-693fd7b6-1a32-41ae-8917-456a4235fa6b tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:14.128244 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0892c0bb-7b12-4e2a-b1dd-6c01138d93d7 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7791 microversion: 2.1 time: 0.227934 Oct 10 23:33:14.146958 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1764/3644] 10.222.0.23 () {58 vars in 1170 bytes} [Mon Oct 10 23:33:13 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7791 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:14.165212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6f54cfc3-4141-47b1-a628-b8c9e4302720 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a3e13a0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:14.387284 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6f54cfc3-4141-47b1-a628-b8c9e4302720 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.230942 Oct 10 23:33:14.397017 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1765/3645] 10.222.0.23 () {58 vars in 1170 bytes} [Mon Oct 10 23:33:14 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:14.401324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9e0bd082-86cc-45c1-97c1-865c81719312 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:14.405947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9e0bd082-86cc-45c1-97c1-865c81719312 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: ee9ef754-080c-4b56-a1f2-d5287268fb2f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:14.434662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e0bd082-86cc-45c1-97c1-865c81719312 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:14.436669 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e0bd082-86cc-45c1-97c1-865c81719312 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:14.438244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e0bd082-86cc-45c1-97c1-865c81719312 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:14.440853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e0bd082-86cc-45c1-97c1-865c81719312 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:14.442651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e0bd082-86cc-45c1-97c1-865c81719312 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:14.443627 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e0bd082-86cc-45c1-97c1-865c81719312 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:14.488729 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-9e0bd082-86cc-45c1-97c1-865c81719312 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] HTTP exception thrown: Instance ee9ef754-080c-4b56-a1f2-d5287268fb2f could not be found. Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9e0bd082-86cc-45c1-97c1-865c81719312 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Request method failure captured: Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f HTTP/1.1 Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKt-UKkylrQuBEl5xnlOBJy0U6Y_3tYu_KJPG93cTrHowRhRdCS0sLYRJ5UdRD6u0dyQ3A0YSGxpqMr5wNoaX4T_nqG0C5hokfVctDW3qxzNgrA_WjwbYB42PvHA9oU6weOY9F4X-dll0QKQ2Tdk6TLJaesm1gKs9XL4GHtQhkXlsNY Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 660d21b04521487788ef25594b766535 Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TestServerMultinode-1977921484 Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/660d21b04521487788ef25594b766535"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/660d21b04521487788ef25594b766535"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/660d21b04521487788ef25594b766535"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_660d21b04521487788ef25594b766535", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TestServerMultinode-1977921484 Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 660d21b04521487788ef25594b766535 Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestServerMultinode-1977921484 Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TestServerMultinode-1977921484-project-admin Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: dd58422e676e49d89a5887adc4547afe Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TestServerMultinode-1977921484-project-admin Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance ee9ef754-080c-4b56-a1f2-d5287268fb2f could not be found. Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'ee9ef754-080c-4b56-a1f2-d5287268fb2f'} Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee9ef754-080c-4b56-a1f2-d5287268fb2f could not be found. Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee9ef754-080c-4b56-a1f2-d5287268fb2f could not be found. Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:33:14.499238 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:33:14.506128 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:33:14.506128 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:33:14.506128 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:33:14.506128 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:33:14.506128 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:33:14.506128 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee9ef754-080c-4b56-a1f2-d5287268fb2f could not be found. Oct 10 23:33:14.506128 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:33:14.511140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9e0bd082-86cc-45c1-97c1-865c81719312 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Returning 404 to user: Instance ee9ef754-080c-4b56-a1f2-d5287268fb2f could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:33:14.511140 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9e0bd082-86cc-45c1-97c1-865c81719312 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f" status: 404 len: 111 microversion: 2.1 time: 0.111917 Oct 10 23:33:14.511140 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1766/3646] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:14 2022] GET /compute/v2.1/servers/ee9ef754-080c-4b56-a1f2-d5287268fb2f => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:33:14.531106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9380318c-df8d-4688-be0d-e77950f917b6 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a3d6ee0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:14.616624 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9380318c-df8d-4688-be0d-e77950f917b6 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/70c986fa-2f30-4b1e-8ea0-fb6ffa975889" status: 200 len: 784 microversion: 2.1 time: 0.098523 Oct 10 23:33:14.617336 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1767/3647] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:33:14 2022] GET /compute/v2.1/images/70c986fa-2f30-4b1e-8ea0-fb6ffa975889 => generated 784 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:33:14.639545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-80eab1fe-e64f-4db7-ba58-5573bf01ad1c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:14.641883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-80eab1fe-e64f-4db7-ba58-5573bf01ad1c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:14.651721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=52 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:33:14.678890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80eab1fe-e64f-4db7-ba58-5573bf01ad1c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:14.693615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80eab1fe-e64f-4db7-ba58-5573bf01ad1c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:14.694633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80eab1fe-e64f-4db7-ba58-5573bf01ad1c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:14.701031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80eab1fe-e64f-4db7-ba58-5573bf01ad1c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:14.703763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80eab1fe-e64f-4db7-ba58-5573bf01ad1c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:14.704813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80eab1fe-e64f-4db7-ba58-5573bf01ad1c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:14.745925 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-693fd7b6-1a32-41ae-8917-456a4235fa6b tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "POST /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.683053 Oct 10 23:33:14.746705 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1881/3648] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Oct 10 23:33:14 2022] POST /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:33:14.747626 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-80eab1fe-e64f-4db7-ba58-5573bf01ad1c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/ips" status: 200 len: 152 microversion: 2.20 time: 0.128854 Oct 10 23:33:14.748208 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1768/3649] 10.222.0.23 () {60 vars in 1289 bytes} [Mon Oct 10 23:33:14 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/ips => generated 152 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:33:14.764958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2e981c92-86f1-40bf-9aff-fc5e030098ed tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a3e1160>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:14.794797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-65dafbf1-2c94-48d7-9a9f-297bdbc51148 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:14.800526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-65dafbf1-2c94-48d7-9a9f-297bdbc51148 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: 1a33db0d-a765-49a1-b396-9c68f6ed22c0] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:14.840329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65dafbf1-2c94-48d7-9a9f-297bdbc51148 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:14.841028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65dafbf1-2c94-48d7-9a9f-297bdbc51148 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:14.842356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65dafbf1-2c94-48d7-9a9f-297bdbc51148 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:14.843623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65dafbf1-2c94-48d7-9a9f-297bdbc51148 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:14.844910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65dafbf1-2c94-48d7-9a9f-297bdbc51148 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:14.846257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65dafbf1-2c94-48d7-9a9f-297bdbc51148 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:14.897179 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2e981c92-86f1-40bf-9aff-fc5e030098ed tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.146437 Oct 10 23:33:14.914630 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1769/3650] 10.222.0.23 () {58 vars in 1158 bytes} [Mon Oct 10 23:33:14 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:14.928743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-1af08006-8868-4b0a-960b-d47bbdce97a4 req-358f9439-32e2-458e-992e-bfafde89fe0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430a8e18-4033-498b-8cf3-a224786b7363", "name": "network-vif-unplugged", "status": "completed", "tag": "a2e7d038-4684-44fd-a359-4f01f2732cbf"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:33:14.959490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-65dafbf1-2c94-48d7-9a9f-297bdbc51148 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: 1a33db0d-a765-49a1-b396-9c68f6ed22c0] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:33:14.980422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1af08006-8868-4b0a-960b-d47bbdce97a4 req-358f9439-32e2-458e-992e-bfafde89fe0c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:14.980422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1af08006-8868-4b0a-960b-d47bbdce97a4 req-358f9439-32e2-458e-992e-bfafde89fe0c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:15.004434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1af08006-8868-4b0a-960b-d47bbdce97a4 req-358f9439-32e2-458e-992e-bfafde89fe0c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:15.049104 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-1af08006-8868-4b0a-960b-d47bbdce97a4 req-358f9439-32e2-458e-992e-bfafde89fe0c service nova] Creating event network-vif-unplugged:a2e7d038-4684-44fd-a359-4f01f2732cbf for instance 430a8e18-4033-498b-8cf3-a224786b7363 on n-h2-860864-2 Oct 10 23:33:15.075642 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-1af08006-8868-4b0a-960b-d47bbdce97a4 req-358f9439-32e2-458e-992e-bfafde89fe0c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156749 Oct 10 23:33:15.085110 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1770/3651] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:33:15.096168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-38e398f3-8ec8-4629-b9df-1cac821d2c40 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a3fa820>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:15.289146 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-65dafbf1-2c94-48d7-9a9f-297bdbc51148 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0" status: 204 len: 0 microversion: 2.1 time: 0.534304 Oct 10 23:33:15.298883 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1882/3652] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:33:14 2022] DELETE /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:33:15.317088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5e8bf68b-0b70-4166-8d69-81da41c0ee76 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:15.320160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5e8bf68b-0b70-4166-8d69-81da41c0ee76 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: 1a33db0d-a765-49a1-b396-9c68f6ed22c0] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:15.349884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e8bf68b-0b70-4166-8d69-81da41c0ee76 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:15.352166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e8bf68b-0b70-4166-8d69-81da41c0ee76 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:15.355575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e8bf68b-0b70-4166-8d69-81da41c0ee76 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:15.361717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e8bf68b-0b70-4166-8d69-81da41c0ee76 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:15.362180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e8bf68b-0b70-4166-8d69-81da41c0ee76 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:15.363966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e8bf68b-0b70-4166-8d69-81da41c0ee76 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:15.914029 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5e8bf68b-0b70-4166-8d69-81da41c0ee76 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0" status: 200 len: 1654 microversion: 2.1 time: 0.612613 Oct 10 23:33:15.915928 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1883/3653] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:15 2022] GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0 => generated 1654 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:33:16.950535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e4ca737a-bc72-4651-8b26-03358c383194 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:16.951790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e4ca737a-bc72-4651-8b26-03358c383194 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: 1a33db0d-a765-49a1-b396-9c68f6ed22c0] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:16.969069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4ca737a-bc72-4651-8b26-03358c383194 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:16.969515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4ca737a-bc72-4651-8b26-03358c383194 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:16.973469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4ca737a-bc72-4651-8b26-03358c383194 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:16.978412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4ca737a-bc72-4651-8b26-03358c383194 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:16.979078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4ca737a-bc72-4651-8b26-03358c383194 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:16.979672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4ca737a-bc72-4651-8b26-03358c383194 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:17.279215 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-38e398f3-8ec8-4629-b9df-1cac821d2c40 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "DELETE /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2" status: 204 len: 0 microversion: 2.1 time: 2.191857 Oct 10 23:33:17.283217 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1771/3654] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:15 2022] DELETE /compute/v2.1/images/0786a467-b60f-4d3e-9c05-817b030d34a2 => generated 0 bytes in 2194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:33:17.288833 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3d30d2a9-ea95-469c-85d7-515bcb94dec6 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a46d3a0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:17.764655 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e4ca737a-bc72-4651-8b26-03358c383194 tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0" status: 200 len: 1654 microversion: 2.1 time: 0.817777 Oct 10 23:33:17.768168 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1884/3655] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:16 2022] GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0 => generated 1654 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:33:18.474629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7ad4d6f9-efe8-4087-bb98-1bd9aa022c32 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:18.475711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7ad4d6f9-efe8-4087-bb98-1bd9aa022c32 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:18.499717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ad4d6f9-efe8-4087-bb98-1bd9aa022c32 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:18.502049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ad4d6f9-efe8-4087-bb98-1bd9aa022c32 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:18.503435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ad4d6f9-efe8-4087-bb98-1bd9aa022c32 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:18.506529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ad4d6f9-efe8-4087-bb98-1bd9aa022c32 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:18.509230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ad4d6f9-efe8-4087-bb98-1bd9aa022c32 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:18.510733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ad4d6f9-efe8-4087-bb98-1bd9aa022c32 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:18.644829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:33:18.680167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7ad4d6f9-efe8-4087-bb98-1bd9aa022c32 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:33:19.030573 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7ad4d6f9-efe8-4087-bb98-1bd9aa022c32 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "DELETE /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 204 len: 0 microversion: 2.32 time: 1.245099 Oct 10 23:33:19.049458 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1885/3656] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:33:17 2022] DELETE /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 0 bytes in 1263 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:33:19.068675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3ca2bd7e-4585-4bea-bf84-5737feafc63b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:19.091698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3ca2bd7e-4585-4bea-bf84-5737feafc63b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: 1a33db0d-a765-49a1-b396-9c68f6ed22c0] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:19.138963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ca2bd7e-4585-4bea-bf84-5737feafc63b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:19.142395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ca2bd7e-4585-4bea-bf84-5737feafc63b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:19.143324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ca2bd7e-4585-4bea-bf84-5737feafc63b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:19.150880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ca2bd7e-4585-4bea-bf84-5737feafc63b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:19.151727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ca2bd7e-4585-4bea-bf84-5737feafc63b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:19.152716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ca2bd7e-4585-4bea-bf84-5737feafc63b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:19.379193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ca2bd7e-4585-4bea-bf84-5737feafc63b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:19.380786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ca2bd7e-4585-4bea-bf84-5737feafc63b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:19.392046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ca2bd7e-4585-4bea-bf84-5737feafc63b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:19.392902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-3ca2bd7e-4585-4bea-bf84-5737feafc63b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lazy-loading 'fault' on Instance uuid 1a33db0d-a765-49a1-b396-9c68f6ed22c0 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:33:19.404344 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3d30d2a9-ea95-469c-85d7-515bcb94dec6 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "DELETE /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1" status: 204 len: 0 microversion: 2.1 time: 2.119810 Oct 10 23:33:19.414144 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1772/3657] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:17 2022] DELETE /compute/v2.1/images/4bbceadb-5b1c-4239-8b5b-a0cd0bee79a1 => generated 0 bytes in 2122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:33:19.433180 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-90e7d375-d33e-4ac7-8470-1116c4216b2a req-0e483628-247a-4fba-a12e-3cc1150d2467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a33db0d-a765-49a1-b396-9c68f6ed22c0", "name": "network-vif-deleted", "tag": "92595afa-bb6f-4233-b8c4-ca6163d7f856"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:33:19.503426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-90e7d375-d33e-4ac7-8470-1116c4216b2a req-0e483628-247a-4fba-a12e-3cc1150d2467 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:19.503920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-90e7d375-d33e-4ac7-8470-1116c4216b2a req-0e483628-247a-4fba-a12e-3cc1150d2467 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:19.504338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-90e7d375-d33e-4ac7-8470-1116c4216b2a req-0e483628-247a-4fba-a12e-3cc1150d2467 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:19.554219 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-90e7d375-d33e-4ac7-8470-1116c4216b2a req-0e483628-247a-4fba-a12e-3cc1150d2467 service nova] Creating event network-vif-deleted:92595afa-bb6f-4233-b8c4-ca6163d7f856 for instance 1a33db0d-a765-49a1-b396-9c68f6ed22c0 on n-h2-860864-2 Oct 10 23:33:19.577569 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-90e7d375-d33e-4ac7-8470-1116c4216b2a req-0e483628-247a-4fba-a12e-3cc1150d2467 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159720 Oct 10 23:33:19.581856 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1773/3658] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:33:19.596302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fa561d1f-384b-4347-aacf-b191fa699217 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:19.601651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fa561d1f-384b-4347-aacf-b191fa699217 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:19.640532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa561d1f-384b-4347-aacf-b191fa699217 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:19.644783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa561d1f-384b-4347-aacf-b191fa699217 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:19.646694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa561d1f-384b-4347-aacf-b191fa699217 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:19.656443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa561d1f-384b-4347-aacf-b191fa699217 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:19.657046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa561d1f-384b-4347-aacf-b191fa699217 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:19.657604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa561d1f-384b-4347-aacf-b191fa699217 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:20.270579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fa561d1f-384b-4347-aacf-b191fa699217 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:20.292003 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fa561d1f-384b-4347-aacf-b191fa699217 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:20.335370 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fa561d1f-384b-4347-aacf-b191fa699217 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:20.339367 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fa561d1f-384b-4347-aacf-b191fa699217 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 2954 microversion: 2.32 time: 0.755436 Oct 10 23:33:20.348601 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1774/3659] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:19 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 2954 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:20.350649 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3ca2bd7e-4585-4bea-bf84-5737feafc63b tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0" status: 200 len: 1453 microversion: 2.1 time: 1.278333 Oct 10 23:33:20.388384 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1886/3660] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:19 2022] GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0 => generated 1453 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:20.406515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-18a0b1ae-cecf-459b-acbf-dd80794297f2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a4754c0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:20.416371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-510dd692-3ca1-4738-8e63-fcccf5d43027 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:33:20.436139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-510dd692-3ca1-4738-8e63-fcccf5d43027 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:20.470612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-510dd692-3ca1-4738-8e63-fcccf5d43027 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:20.481033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-510dd692-3ca1-4738-8e63-fcccf5d43027 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:20.482129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-510dd692-3ca1-4738-8e63-fcccf5d43027 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:20.483021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-510dd692-3ca1-4738-8e63-fcccf5d43027 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:20.483733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-510dd692-3ca1-4738-8e63-fcccf5d43027 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:20.484288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-510dd692-3ca1-4738-8e63-fcccf5d43027 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:20.539096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-510dd692-3ca1-4738-8e63-fcccf5d43027 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lazy-loading 'flavor' on Instance uuid 3bd745fa-6826-4bd1-8f8d-ae65071fac12 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:33:21.307818 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-510dd692-3ca1-4738-8e63-fcccf5d43027 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "POST /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/action" status: 202 len: 0 microversion: 2.20 time: 0.911174 Oct 10 23:33:21.324084 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1887/3661] 10.222.0.23 () {62 vars in 1319 bytes} [Mon Oct 10 23:33:20 2022] POST /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/action => generated 0 bytes in 935 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:33:21.405574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-52adfbe7-97dd-40f0-9f01-b3424fad78df tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:21.412090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-52adfbe7-97dd-40f0-9f01-b3424fad78df tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:21.475740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52adfbe7-97dd-40f0-9f01-b3424fad78df tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:21.477720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52adfbe7-97dd-40f0-9f01-b3424fad78df tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:21.482596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52adfbe7-97dd-40f0-9f01-b3424fad78df tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:21.484077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52adfbe7-97dd-40f0-9f01-b3424fad78df tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:21.484756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52adfbe7-97dd-40f0-9f01-b3424fad78df tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:21.485704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52adfbe7-97dd-40f0-9f01-b3424fad78df tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:22.283268 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-18a0b1ae-cecf-459b-acbf-dd80794297f2 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "DELETE /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d" status: 204 len: 0 microversion: 2.1 time: 1.892981 Oct 10 23:33:22.288655 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1775/3662] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:20 2022] DELETE /compute/v2.1/images/592992a1-5017-4b61-a083-568670a7569d => generated 0 bytes in 1915 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:33:22.304992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0309a0ea-c002-431d-85fe-7e2d375850b2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:22.305650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0309a0ea-c002-431d-85fe-7e2d375850b2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:22.347169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0309a0ea-c002-431d-85fe-7e2d375850b2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:22.348043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0309a0ea-c002-431d-85fe-7e2d375850b2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:22.349281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0309a0ea-c002-431d-85fe-7e2d375850b2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:22.372875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0309a0ea-c002-431d-85fe-7e2d375850b2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:22.373898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0309a0ea-c002-431d-85fe-7e2d375850b2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:22.374668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0309a0ea-c002-431d-85fe-7e2d375850b2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:23.397802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-52adfbe7-97dd-40f0-9f01-b3424fad78df tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:23.412591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-52adfbe7-97dd-40f0-9f01-b3424fad78df tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:23.419316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-52adfbe7-97dd-40f0-9f01-b3424fad78df tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:23.421239 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-52adfbe7-97dd-40f0-9f01-b3424fad78df tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1724 microversion: 2.20 time: 2.053663 Oct 10 23:33:23.425551 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1888/3663] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:21 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1724 bytes in 2070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:23.443886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-08f2946d-6aff-4c32-8913-ca8c51d6ef1f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:23.445237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-08f2946d-6aff-4c32-8913-ca8c51d6ef1f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] [instance: 1a33db0d-a765-49a1-b396-9c68f6ed22c0] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:23.470603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08f2946d-6aff-4c32-8913-ca8c51d6ef1f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:23.471890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08f2946d-6aff-4c32-8913-ca8c51d6ef1f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:23.472909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08f2946d-6aff-4c32-8913-ca8c51d6ef1f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:23.474396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08f2946d-6aff-4c32-8913-ca8c51d6ef1f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:23.480069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08f2946d-6aff-4c32-8913-ca8c51d6ef1f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:23.480791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08f2946d-6aff-4c32-8913-ca8c51d6ef1f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:23.525939 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-08f2946d-6aff-4c32-8913-ca8c51d6ef1f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] HTTP exception thrown: Instance 1a33db0d-a765-49a1-b396-9c68f6ed22c0 could not be found. Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-08f2946d-6aff-4c32-8913-ca8c51d6ef1f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Request method failure captured: Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0 HTTP/1.1 Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKt-UKkylrQuBEl5xnlOBJy0U6Y_3tYu_KJPG93cTrHowRhRdCS0sLYRJ5UdRD6u0dyQ3A0YSGxpqMr5wNoaX4T_nqG0C5hokfVctDW3qxzNgrA_WjwbYB42PvHA9oU6weOY9F4X-dll0QKQ2Tdk6TLJaesm1gKs9XL4GHtQhkXlsNY Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 660d21b04521487788ef25594b766535 Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestServerMultinode-1977921484 Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: X-Role: admin,member,reader Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: admin,member,reader Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/660d21b04521487788ef25594b766535"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/660d21b04521487788ef25594b766535"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/660d21b04521487788ef25594b766535"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_660d21b04521487788ef25594b766535", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestServerMultinode-1977921484 Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 660d21b04521487788ef25594b766535 Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestServerMultinode-1977921484 Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestServerMultinode-1977921484-project-admin Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: dd58422e676e49d89a5887adc4547afe Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestServerMultinode-1977921484-project-admin Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 1a33db0d-a765-49a1-b396-9c68f6ed22c0 could not be found. Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '1a33db0d-a765-49a1-b396-9c68f6ed22c0'} Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a33db0d-a765-49a1-b396-9c68f6ed22c0 could not be found. Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a33db0d-a765-49a1-b396-9c68f6ed22c0 could not be found. Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:33:23.527671 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:33:23.532952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:33:23.532952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:33:23.532952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:33:23.532952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:33:23.532952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:33:23.532952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a33db0d-a765-49a1-b396-9c68f6ed22c0 could not be found. Oct 10 23:33:23.532952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:33:23.532952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-08f2946d-6aff-4c32-8913-ca8c51d6ef1f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] Returning 404 to user: Instance 1a33db0d-a765-49a1-b396-9c68f6ed22c0 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:33:23.532952 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-08f2946d-6aff-4c32-8913-ca8c51d6ef1f tempest-TestServerMultinode-1977921484 tempest-TestServerMultinode-1977921484-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0" status: 404 len: 111 microversion: 2.1 time: 0.102311 Oct 10 23:33:23.540326 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1889/3664] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:23 2022] GET /compute/v2.1/servers/1a33db0d-a765-49a1-b396-9c68f6ed22c0 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:33:23.574229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f020941f-d8d6-4dc4-bc2f-064694fe3290 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:23.575070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f020941f-d8d6-4dc4-bc2f-064694fe3290 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:23.601444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f020941f-d8d6-4dc4-bc2f-064694fe3290 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:23.611362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f020941f-d8d6-4dc4-bc2f-064694fe3290 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:23.613045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f020941f-d8d6-4dc4-bc2f-064694fe3290 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:23.614146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f020941f-d8d6-4dc4-bc2f-064694fe3290 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:23.615289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f020941f-d8d6-4dc4-bc2f-064694fe3290 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:23.616097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f020941f-d8d6-4dc4-bc2f-064694fe3290 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:23.661823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f020941f-d8d6-4dc4-bc2f-064694fe3290 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:33:23.717626 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0309a0ea-c002-431d-85fe-7e2d375850b2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:23.770314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0309a0ea-c002-431d-85fe-7e2d375850b2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:23.785722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0309a0ea-c002-431d-85fe-7e2d375850b2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:23.789858 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0309a0ea-c002-431d-85fe-7e2d375850b2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 2954 microversion: 2.32 time: 1.503595 Oct 10 23:33:23.792913 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1776/3665] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:22 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 2954 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:23.809771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-35d2dc21-f11f-42e7-8fcb-9f23160fb18b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1392963288", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "4cca0719-1caf-4507-8dbd-6909a0237a23"}, {"uuid": "afedf49d-3f3e-4b6a-8b1c-8d130c1f8941"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:33:23.971097 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f020941f-d8d6-4dc4-bc2f-064694fe3290 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "DELETE /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 204 len: 0 microversion: 2.1 time: 0.428494 Oct 10 23:33:23.974340 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1890/3666] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:33:23 2022] DELETE /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:33:23.988282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6ad7869d-21ae-4aac-a525-ebfbf9d13ea6 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:23.989533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6ad7869d-21ae-4aac-a525-ebfbf9d13ea6 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:23.998157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ad7869d-21ae-4aac-a525-ebfbf9d13ea6 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:23.999270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ad7869d-21ae-4aac-a525-ebfbf9d13ea6 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:24.000235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ad7869d-21ae-4aac-a525-ebfbf9d13ea6 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:24.001876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ad7869d-21ae-4aac-a525-ebfbf9d13ea6 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:24.002739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ad7869d-21ae-4aac-a525-ebfbf9d13ea6 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:24.003316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ad7869d-21ae-4aac-a525-ebfbf9d13ea6 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:24.034038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-35d2dc21-f11f-42e7-8fcb-9f23160fb18b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] validate_networks() for [('4cca0719-1caf-4507-8dbd-6909a0237a23', None, None, None, None, None), ('afedf49d-3f3e-4b6a-8b1c-8d130c1f8941', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:33:24.730401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6ad7869d-21ae-4aac-a525-ebfbf9d13ea6 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:24.754313 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6ad7869d-21ae-4aac-a525-ebfbf9d13ea6 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1472 microversion: 2.1 time: 0.773101 Oct 10 23:33:24.760363 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1891/3667] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:23 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 1472 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:24.779664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fc17a4af-2362-42b3-ac60-e68a9094adca tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:24.780541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fc17a4af-2362-42b3-ac60-e68a9094adca tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:24.799917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc17a4af-2362-42b3-ac60-e68a9094adca tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:24.807026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc17a4af-2362-42b3-ac60-e68a9094adca tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:24.807860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc17a4af-2362-42b3-ac60-e68a9094adca tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:24.809588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc17a4af-2362-42b3-ac60-e68a9094adca tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:24.809814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc17a4af-2362-42b3-ac60-e68a9094adca tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:24.836715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc17a4af-2362-42b3-ac60-e68a9094adca tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:25.296393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fc17a4af-2362-42b3-ac60-e68a9094adca tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:25.315335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fc17a4af-2362-42b3-ac60-e68a9094adca tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:25.326068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fc17a4af-2362-42b3-ac60-e68a9094adca tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:25.331962 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fc17a4af-2362-42b3-ac60-e68a9094adca tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1724 microversion: 2.20 time: 0.565964 Oct 10 23:33:25.342980 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1892/3668] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:24 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1724 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:25.356498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-50ca86ac-b05d-498c-860c-ab12a41750f2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:25.373187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-50ca86ac-b05d-498c-860c-ab12a41750f2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:25.397585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50ca86ac-b05d-498c-860c-ab12a41750f2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:25.411360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50ca86ac-b05d-498c-860c-ab12a41750f2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:25.421327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50ca86ac-b05d-498c-860c-ab12a41750f2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:25.429759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50ca86ac-b05d-498c-860c-ab12a41750f2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:25.430384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50ca86ac-b05d-498c-860c-ab12a41750f2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:25.430849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50ca86ac-b05d-498c-860c-ab12a41750f2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:25.978724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-50ca86ac-b05d-498c-860c-ab12a41750f2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:25.998382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-50ca86ac-b05d-498c-860c-ab12a41750f2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:26.001519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-50ca86ac-b05d-498c-860c-ab12a41750f2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:26.007937 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-50ca86ac-b05d-498c-860c-ab12a41750f2 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 2954 microversion: 2.32 time: 0.662376 Oct 10 23:33:26.011260 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1893/3669] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:25 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 2954 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:26.026452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bd7662fc-1c84-4216-96dd-cad6e4e6a555 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:26.032155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bd7662fc-1c84-4216-96dd-cad6e4e6a555 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:26.054985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd7662fc-1c84-4216-96dd-cad6e4e6a555 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:26.056037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd7662fc-1c84-4216-96dd-cad6e4e6a555 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:26.059331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd7662fc-1c84-4216-96dd-cad6e4e6a555 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:26.061911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd7662fc-1c84-4216-96dd-cad6e4e6a555 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:26.062912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd7662fc-1c84-4216-96dd-cad6e4e6a555 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:26.065204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd7662fc-1c84-4216-96dd-cad6e4e6a555 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:26.914710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bd7662fc-1c84-4216-96dd-cad6e4e6a555 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:26.932388 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bd7662fc-1c84-4216-96dd-cad6e4e6a555 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1472 microversion: 2.1 time: 0.919480 Oct 10 23:33:26.938094 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1894/3670] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:26 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 1472 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:26.947199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-6c0848f1-a592-47cb-a41f-7645537e9d06 req-3cb16dec-1e47-4564-8463-bc12bffb8b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "name": "network-vif-unplugged", "status": "completed", "tag": "575d047b-0d89-4ae3-b746-a43054af851b"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:33:26.980869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6c0848f1-a592-47cb-a41f-7645537e9d06 req-3cb16dec-1e47-4564-8463-bc12bffb8b71 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:26.981519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6c0848f1-a592-47cb-a41f-7645537e9d06 req-3cb16dec-1e47-4564-8463-bc12bffb8b71 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:26.985316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6c0848f1-a592-47cb-a41f-7645537e9d06 req-3cb16dec-1e47-4564-8463-bc12bffb8b71 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:27.010364 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-6c0848f1-a592-47cb-a41f-7645537e9d06 req-3cb16dec-1e47-4564-8463-bc12bffb8b71 service nova] Creating event network-vif-unplugged:575d047b-0d89-4ae3-b746-a43054af851b for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:33:27.016226 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-6c0848f1-a592-47cb-a41f-7645537e9d06 req-3cb16dec-1e47-4564-8463-bc12bffb8b71 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073419 Oct 10 23:33:27.017586 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1895/3671] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:33:27.025155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7dcd086c-1cc7-48a1-b095-44b0d6859cdf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:27.026119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7dcd086c-1cc7-48a1-b095-44b0d6859cdf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:27.036817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7dcd086c-1cc7-48a1-b095-44b0d6859cdf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:27.044443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7dcd086c-1cc7-48a1-b095-44b0d6859cdf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:27.045402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7dcd086c-1cc7-48a1-b095-44b0d6859cdf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:27.046286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7dcd086c-1cc7-48a1-b095-44b0d6859cdf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:27.046878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7dcd086c-1cc7-48a1-b095-44b0d6859cdf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:27.047449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7dcd086c-1cc7-48a1-b095-44b0d6859cdf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:27.767645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7dcd086c-1cc7-48a1-b095-44b0d6859cdf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:27.785886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7dcd086c-1cc7-48a1-b095-44b0d6859cdf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:27.798681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7dcd086c-1cc7-48a1-b095-44b0d6859cdf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:27.804441 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7dcd086c-1cc7-48a1-b095-44b0d6859cdf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1724 microversion: 2.20 time: 0.784822 Oct 10 23:33:27.820576 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1896/3672] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:27 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1724 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:27.822314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-17e0ca05-3479-4b09-8d01-c5e7040dc935 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:27.825916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-17e0ca05-3479-4b09-8d01-c5e7040dc935 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:27.844061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17e0ca05-3479-4b09-8d01-c5e7040dc935 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:27.845024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17e0ca05-3479-4b09-8d01-c5e7040dc935 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:27.846113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17e0ca05-3479-4b09-8d01-c5e7040dc935 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:27.854368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17e0ca05-3479-4b09-8d01-c5e7040dc935 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:27.855179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17e0ca05-3479-4b09-8d01-c5e7040dc935 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:27.862230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17e0ca05-3479-4b09-8d01-c5e7040dc935 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:28.614929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-17e0ca05-3479-4b09-8d01-c5e7040dc935 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:28.623416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:33:28.639171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-17e0ca05-3479-4b09-8d01-c5e7040dc935 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:28.641226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-17e0ca05-3479-4b09-8d01-c5e7040dc935 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:28.645198 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-17e0ca05-3479-4b09-8d01-c5e7040dc935 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 2933 microversion: 2.32 time: 0.834002 Oct 10 23:33:28.648393 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1897/3673] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:27 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 2933 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:28.662166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bee27224-5c8a-49d9-b5d2-123729bd9e8a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:28.663228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bee27224-5c8a-49d9-b5d2-123729bd9e8a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:28.679809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bee27224-5c8a-49d9-b5d2-123729bd9e8a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:28.685098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bee27224-5c8a-49d9-b5d2-123729bd9e8a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:28.685959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bee27224-5c8a-49d9-b5d2-123729bd9e8a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:28.688302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bee27224-5c8a-49d9-b5d2-123729bd9e8a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:28.689016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bee27224-5c8a-49d9-b5d2-123729bd9e8a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:28.693800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bee27224-5c8a-49d9-b5d2-123729bd9e8a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:28.837507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bee27224-5c8a-49d9-b5d2-123729bd9e8a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:28.853577 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bee27224-5c8a-49d9-b5d2-123729bd9e8a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 200 len: 1430 microversion: 2.1 time: 0.203684 Oct 10 23:33:28.855515 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1898/3674] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:28 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 1430 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:28.876629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f625420e-75f1-48c1-ac73-ed1c8441178e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:28.878393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f625420e-75f1-48c1-ac73-ed1c8441178e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:28.887899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f625420e-75f1-48c1-ac73-ed1c8441178e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:28.891376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f625420e-75f1-48c1-ac73-ed1c8441178e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:28.896827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f625420e-75f1-48c1-ac73-ed1c8441178e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:28.898100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f625420e-75f1-48c1-ac73-ed1c8441178e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:28.898710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f625420e-75f1-48c1-ac73-ed1c8441178e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:28.899340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f625420e-75f1-48c1-ac73-ed1c8441178e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:29.371367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f625420e-75f1-48c1-ac73-ed1c8441178e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:29.399663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f625420e-75f1-48c1-ac73-ed1c8441178e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:29.415229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f625420e-75f1-48c1-ac73-ed1c8441178e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:29.431292 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f625420e-75f1-48c1-ac73-ed1c8441178e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1724 microversion: 2.20 time: 0.570972 Oct 10 23:33:29.432729 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1899/3675] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:28 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1724 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:29.455026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-b676b007-51ee-40c4-808d-52480bf8a85e req-6678bcad-3dea-45da-aa56-755ea0fed7e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "name": "network-vif-unplugged", "status": "completed", "tag": "b8d599b8-79fd-4f70-91f1-14f3dcfc2d85"}, {"server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "name": "network-vif-unplugged", "status": "completed", "tag": "614bc975-55cc-4a02-8208-a141e064bf06"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:33:29.519509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b676b007-51ee-40c4-808d-52480bf8a85e req-6678bcad-3dea-45da-aa56-755ea0fed7e6 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:29.524439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b676b007-51ee-40c4-808d-52480bf8a85e req-6678bcad-3dea-45da-aa56-755ea0fed7e6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:29.525309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b676b007-51ee-40c4-808d-52480bf8a85e req-6678bcad-3dea-45da-aa56-755ea0fed7e6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:29.573089 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-b676b007-51ee-40c4-808d-52480bf8a85e req-6678bcad-3dea-45da-aa56-755ea0fed7e6 service nova] Creating event network-vif-unplugged:b8d599b8-79fd-4f70-91f1-14f3dcfc2d85 for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:33:29.578452 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-b676b007-51ee-40c4-808d-52480bf8a85e req-6678bcad-3dea-45da-aa56-755ea0fed7e6 service nova] Creating event network-vif-unplugged:614bc975-55cc-4a02-8208-a141e064bf06 for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:33:29.586155 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-b676b007-51ee-40c4-808d-52480bf8a85e req-6678bcad-3dea-45da-aa56-755ea0fed7e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.147359 Oct 10 23:33:29.589761 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1900/3676] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:33:29.610660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-173f2b13-9954-4eea-a82d-3b39997629b1 req-26d15a5a-c61e-480d-9758-3dbff77c5f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "037ebfb5-534f-42db-9838-462de4b299e1", "name": "network-vif-deleted", "tag": "0945733a-182f-4aab-9346-e59fa6b3c813"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:33:29.662117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-173f2b13-9954-4eea-a82d-3b39997629b1 req-26d15a5a-c61e-480d-9758-3dbff77c5f21 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:29.663114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-173f2b13-9954-4eea-a82d-3b39997629b1 req-26d15a5a-c61e-480d-9758-3dbff77c5f21 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:29.663854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-173f2b13-9954-4eea-a82d-3b39997629b1 req-26d15a5a-c61e-480d-9758-3dbff77c5f21 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:29.711925 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-173f2b13-9954-4eea-a82d-3b39997629b1 req-26d15a5a-c61e-480d-9758-3dbff77c5f21 service nova] Creating event network-vif-deleted:0945733a-182f-4aab-9346-e59fa6b3c813 for instance 037ebfb5-534f-42db-9838-462de4b299e1 on n-h2-860864-2 Oct 10 23:33:29.738576 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-173f2b13-9954-4eea-a82d-3b39997629b1 req-26d15a5a-c61e-480d-9758-3dbff77c5f21 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146915 Oct 10 23:33:29.748954 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1901/3677] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:33:29.759524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6d9f7c68-5a53-4f38-9ed7-c3d51c8b3857 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:29.767877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6d9f7c68-5a53-4f38-9ed7-c3d51c8b3857 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:29.778796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d9f7c68-5a53-4f38-9ed7-c3d51c8b3857 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:29.789946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d9f7c68-5a53-4f38-9ed7-c3d51c8b3857 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:29.790604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d9f7c68-5a53-4f38-9ed7-c3d51c8b3857 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:29.791783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d9f7c68-5a53-4f38-9ed7-c3d51c8b3857 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:29.792535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d9f7c68-5a53-4f38-9ed7-c3d51c8b3857 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:29.793107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d9f7c68-5a53-4f38-9ed7-c3d51c8b3857 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:30.431374 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6d9f7c68-5a53-4f38-9ed7-c3d51c8b3857 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:30.441111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6d9f7c68-5a53-4f38-9ed7-c3d51c8b3857 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:30.442959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6d9f7c68-5a53-4f38-9ed7-c3d51c8b3857 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:30.450609 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6d9f7c68-5a53-4f38-9ed7-c3d51c8b3857 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 2933 microversion: 2.32 time: 0.699986 Oct 10 23:33:30.451209 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1902/3678] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:29 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 2933 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:30.468243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8931d64f-cef8-4f35-83d5-8eaf8f836f7a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:30.468929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8931d64f-cef8-4f35-83d5-8eaf8f836f7a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 037ebfb5-534f-42db-9838-462de4b299e1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:30.475439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8931d64f-cef8-4f35-83d5-8eaf8f836f7a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:30.476098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8931d64f-cef8-4f35-83d5-8eaf8f836f7a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:30.476433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8931d64f-cef8-4f35-83d5-8eaf8f836f7a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:30.477617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8931d64f-cef8-4f35-83d5-8eaf8f836f7a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:30.478336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8931d64f-cef8-4f35-83d5-8eaf8f836f7a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:30.478968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8931d64f-cef8-4f35-83d5-8eaf8f836f7a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:30.495951 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-8931d64f-cef8-4f35-83d5-8eaf8f836f7a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] HTTP exception thrown: Instance 037ebfb5-534f-42db-9838-462de4b299e1 could not be found. Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8931d64f-cef8-4f35-83d5-8eaf8f836f7a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Request method failure captured: Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 HTTP/1.1 Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKsRv1gZpWjcHJj5-e51Go7mko0ZB17IoEO-WMEbZaiDfPAe_CrEI9-HktZzNbRBYSLO7ZDJsRldb48zM3iipQysY9UA7VYOOVKCeDIXUb84Nh1tn7G9Fx22px1DJU744b4AwGM1zMmhb2Ys98JqXbEiaa2QJrzZMOSbTE09i2-sNi4 Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: c8dfd604f5c14b5db14dec95b300a176 Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ListImageFiltersTestJSON-189026498 Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8dfd604f5c14b5db14dec95b300a176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8dfd604f5c14b5db14dec95b300a176"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8dfd604f5c14b5db14dec95b300a176"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8dfd604f5c14b5db14dec95b300a176", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ListImageFiltersTestJSON-189026498 Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: c8dfd604f5c14b5db14dec95b300a176 Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-189026498 Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ListImageFiltersTestJSON-189026498-project Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: b71aca6d5de04f06a30480f7d7409d62 Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ListImageFiltersTestJSON-189026498-project Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 037ebfb5-534f-42db-9838-462de4b299e1 could not be found. Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '037ebfb5-534f-42db-9838-462de4b299e1'} Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 037ebfb5-534f-42db-9838-462de4b299e1 could not be found. Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 037ebfb5-534f-42db-9838-462de4b299e1 could not be found. Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:33:30.498229 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:33:30.503014 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:33:30.503014 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:33:30.503014 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:33:30.503014 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:33:30.503014 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:33:30.503014 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 037ebfb5-534f-42db-9838-462de4b299e1 could not be found. Oct 10 23:33:30.503014 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:33:30.505871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8931d64f-cef8-4f35-83d5-8eaf8f836f7a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Returning 404 to user: Instance 037ebfb5-534f-42db-9838-462de4b299e1 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:33:30.508341 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8931d64f-cef8-4f35-83d5-8eaf8f836f7a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1" status: 404 len: 111 microversion: 2.1 time: 0.056057 Oct 10 23:33:30.509824 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1903/3679] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:30 2022] GET /compute/v2.1/servers/037ebfb5-534f-42db-9838-462de4b299e1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:33:30.517155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-86eb6098-343e-4e9b-8287-2b88214f71b4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:30.518169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-86eb6098-343e-4e9b-8287-2b88214f71b4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:30.526535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86eb6098-343e-4e9b-8287-2b88214f71b4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:30.527681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86eb6098-343e-4e9b-8287-2b88214f71b4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:30.528337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86eb6098-343e-4e9b-8287-2b88214f71b4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:30.529257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86eb6098-343e-4e9b-8287-2b88214f71b4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:30.529979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86eb6098-343e-4e9b-8287-2b88214f71b4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:30.530609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86eb6098-343e-4e9b-8287-2b88214f71b4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:30.565368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-35d2dc21-f11f-42e7-8fcb-9f23160fb18b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:33:30.565946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-35d2dc21-f11f-42e7-8fcb-9f23160fb18b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:33:30.566244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-35d2dc21-f11f-42e7-8fcb-9f23160fb18b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:33:30.566666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-35d2dc21-f11f-42e7-8fcb-9f23160fb18b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:33:30.567093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-35d2dc21-f11f-42e7-8fcb-9f23160fb18b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:33:30.603565 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35d2dc21-f11f-42e7-8fcb-9f23160fb18b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:30.604388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35d2dc21-f11f-42e7-8fcb-9f23160fb18b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:30.605038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35d2dc21-f11f-42e7-8fcb-9f23160fb18b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:30.606109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35d2dc21-f11f-42e7-8fcb-9f23160fb18b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:30.606859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35d2dc21-f11f-42e7-8fcb-9f23160fb18b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:30.607557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35d2dc21-f11f-42e7-8fcb-9f23160fb18b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:30.672663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-35d2dc21-f11f-42e7-8fcb-9f23160fb18b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Getting quotas for project 70836dfc36f744ab8f26c1b47be26ff4. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:33:30.683186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-35d2dc21-f11f-42e7-8fcb-9f23160fb18b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Getting quotas for user 781bd1f2871245399de1db53d1d9ad42 and project 70836dfc36f744ab8f26c1b47be26ff4. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:33:30.710637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-35d2dc21-f11f-42e7-8fcb-9f23160fb18b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:33:30.714789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-35d2dc21-f11f-42e7-8fcb-9f23160fb18b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:33:30.835419 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-35d2dc21-f11f-42e7-8fcb-9f23160fb18b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.040594 Oct 10 23:33:30.853616 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1777/3680] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:33:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 7060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:33:30.863111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-80a59376-c8f2-4d0c-a577-2a6d5cbb3902 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:30.864137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-80a59376-c8f2-4d0c-a577-2a6d5cbb3902 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 430a8e18-4033-498b-8cf3-a224786b7363] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:30.874403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80a59376-c8f2-4d0c-a577-2a6d5cbb3902 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:30.875407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80a59376-c8f2-4d0c-a577-2a6d5cbb3902 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:30.876171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80a59376-c8f2-4d0c-a577-2a6d5cbb3902 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:30.877809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80a59376-c8f2-4d0c-a577-2a6d5cbb3902 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:30.878870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80a59376-c8f2-4d0c-a577-2a6d5cbb3902 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:30.880311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80a59376-c8f2-4d0c-a577-2a6d5cbb3902 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:30.964822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-80a59376-c8f2-4d0c-a577-2a6d5cbb3902 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 430a8e18-4033-498b-8cf3-a224786b7363] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:33:31.130260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-86eb6098-343e-4e9b-8287-2b88214f71b4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:31.141086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-86eb6098-343e-4e9b-8287-2b88214f71b4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:31.158212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-86eb6098-343e-4e9b-8287-2b88214f71b4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:31.159429 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-80a59376-c8f2-4d0c-a577-2a6d5cbb3902 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "DELETE /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363" status: 204 len: 0 microversion: 2.1 time: 0.303353 Oct 10 23:33:31.159567 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-86eb6098-343e-4e9b-8287-2b88214f71b4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1724 microversion: 2.20 time: 0.647266 Oct 10 23:33:31.160780 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1778/3681] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:33:30 2022] DELETE /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:33:31.170903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7c743f53-6244-4c75-bfb1-e3b17354bc85 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:31.173208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7c743f53-6244-4c75-bfb1-e3b17354bc85 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:31.188174 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1904/3682] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:30 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1724 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:31.198873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c399e7fa-c6ba-4d00-ae73-c917b45a7a52 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:31.200812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c399e7fa-c6ba-4d00-ae73-c917b45a7a52 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 430a8e18-4033-498b-8cf3-a224786b7363] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:31.218540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c399e7fa-c6ba-4d00-ae73-c917b45a7a52 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:31.219280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c399e7fa-c6ba-4d00-ae73-c917b45a7a52 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:31.220981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c399e7fa-c6ba-4d00-ae73-c917b45a7a52 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:31.221820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c399e7fa-c6ba-4d00-ae73-c917b45a7a52 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:31.225066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c399e7fa-c6ba-4d00-ae73-c917b45a7a52 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:31.225760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c399e7fa-c6ba-4d00-ae73-c917b45a7a52 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:31.392686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7c743f53-6244-4c75-bfb1-e3b17354bc85 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:31.406666 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7c743f53-6244-4c75-bfb1-e3b17354bc85 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1213 microversion: 2.1 time: 0.242578 Oct 10 23:33:31.409747 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1779/3683] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:31 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1213 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:31.496164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-060f2e43-7485-4640-beb2-5407c4328c64 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:31.497864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-060f2e43-7485-4640-beb2-5407c4328c64 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:31.515621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-060f2e43-7485-4640-beb2-5407c4328c64 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:31.517781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-060f2e43-7485-4640-beb2-5407c4328c64 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:31.519831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-060f2e43-7485-4640-beb2-5407c4328c64 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:31.521349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-060f2e43-7485-4640-beb2-5407c4328c64 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:31.525092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-060f2e43-7485-4640-beb2-5407c4328c64 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:31.525795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-060f2e43-7485-4640-beb2-5407c4328c64 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:31.773731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c399e7fa-c6ba-4d00-ae73-c917b45a7a52 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:31.847750 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c399e7fa-c6ba-4d00-ae73-c917b45a7a52 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363" status: 200 len: 1473 microversion: 2.1 time: 0.653772 Oct 10 23:33:31.862110 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1905/3684] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:31 2022] GET /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363 => generated 1473 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:31.882271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-0cffbf1b-c0d9-4922-b81b-ce5a99d0299d req-f0ad2380-0210-4d58-85b4-6bd0980f885a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "name": "network-vif-unplugged", "status": "completed", "tag": "7e9ff285-00b1-425e-abd8-7ec7fce5505e"}, {"server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "name": "network-vif-unplugged", "status": "completed", "tag": "779175ee-abe1-40ae-bb85-14125427b898"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:33:31.933788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0cffbf1b-c0d9-4922-b81b-ce5a99d0299d req-f0ad2380-0210-4d58-85b4-6bd0980f885a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:31.935439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0cffbf1b-c0d9-4922-b81b-ce5a99d0299d req-f0ad2380-0210-4d58-85b4-6bd0980f885a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:31.936378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0cffbf1b-c0d9-4922-b81b-ce5a99d0299d req-f0ad2380-0210-4d58-85b4-6bd0980f885a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:31.968834 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-0cffbf1b-c0d9-4922-b81b-ce5a99d0299d req-f0ad2380-0210-4d58-85b4-6bd0980f885a service nova] Creating event network-vif-unplugged:7e9ff285-00b1-425e-abd8-7ec7fce5505e for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:33:31.970339 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-0cffbf1b-c0d9-4922-b81b-ce5a99d0299d req-f0ad2380-0210-4d58-85b4-6bd0980f885a service nova] Creating event network-vif-unplugged:779175ee-abe1-40ae-bb85-14125427b898 for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:33:31.983992 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-0cffbf1b-c0d9-4922-b81b-ce5a99d0299d req-f0ad2380-0210-4d58-85b4-6bd0980f885a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.107242 Oct 10 23:33:31.985797 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1906/3685] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:33:32.219899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1bf0a599-a307-4eba-84e6-8fc5d559c0c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:32.229131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1bf0a599-a307-4eba-84e6-8fc5d559c0c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:32.259330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bf0a599-a307-4eba-84e6-8fc5d559c0c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:32.272500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bf0a599-a307-4eba-84e6-8fc5d559c0c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:32.274995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bf0a599-a307-4eba-84e6-8fc5d559c0c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:32.277220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bf0a599-a307-4eba-84e6-8fc5d559c0c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:32.280017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bf0a599-a307-4eba-84e6-8fc5d559c0c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:32.283463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bf0a599-a307-4eba-84e6-8fc5d559c0c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:32.535875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-060f2e43-7485-4640-beb2-5407c4328c64 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:32.554961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-060f2e43-7485-4640-beb2-5407c4328c64 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:32.556455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-060f2e43-7485-4640-beb2-5407c4328c64 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:32.557894 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-060f2e43-7485-4640-beb2-5407c4328c64 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 2912 microversion: 2.32 time: 1.067059 Oct 10 23:33:32.583724 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1780/3686] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:31 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 2912 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:33:32.592650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7900115a-d6f2-4eed-ba01-1bc94f701164 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:32.593252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7900115a-d6f2-4eed-ba01-1bc94f701164 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:32.611987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7900115a-d6f2-4eed-ba01-1bc94f701164 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:32.614728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7900115a-d6f2-4eed-ba01-1bc94f701164 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:32.615369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7900115a-d6f2-4eed-ba01-1bc94f701164 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:32.616363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7900115a-d6f2-4eed-ba01-1bc94f701164 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:32.617195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7900115a-d6f2-4eed-ba01-1bc94f701164 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:32.617825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7900115a-d6f2-4eed-ba01-1bc94f701164 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:33.072539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1bf0a599-a307-4eba-84e6-8fc5d559c0c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:33.110846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1bf0a599-a307-4eba-84e6-8fc5d559c0c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:33.115561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1bf0a599-a307-4eba-84e6-8fc5d559c0c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:33.119223 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1bf0a599-a307-4eba-84e6-8fc5d559c0c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1724 microversion: 2.20 time: 0.932362 Oct 10 23:33:33.120988 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1907/3687] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:32 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1724 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:33.132181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ade1a36e-f857-48b3-9e30-b363529d1372 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:33.135065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ade1a36e-f857-48b3-9e30-b363529d1372 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 430a8e18-4033-498b-8cf3-a224786b7363] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:33.147626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ade1a36e-f857-48b3-9e30-b363529d1372 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:33.167017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ade1a36e-f857-48b3-9e30-b363529d1372 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:33.168150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ade1a36e-f857-48b3-9e30-b363529d1372 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:33.169246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ade1a36e-f857-48b3-9e30-b363529d1372 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:33.170218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ade1a36e-f857-48b3-9e30-b363529d1372 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:33.170692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ade1a36e-f857-48b3-9e30-b363529d1372 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:33.222095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7900115a-d6f2-4eed-ba01-1bc94f701164 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:33.234371 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7900115a-d6f2-4eed-ba01-1bc94f701164 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1209 microversion: 2.1 time: 0.649273 Oct 10 23:33:33.234973 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1781/3688] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:32 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1209 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:33.499321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ade1a36e-f857-48b3-9e30-b363529d1372 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:33.511142 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ade1a36e-f857-48b3-9e30-b363529d1372 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363" status: 200 len: 1473 microversion: 2.1 time: 0.388276 Oct 10 23:33:33.511742 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1908/3689] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:33 2022] GET /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363 => generated 1473 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:33.598080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-ac6e8a89-6465-4d3b-899c-4cbe3512bab1 req-9e8c5854-7a6e-494f-bb57-bac0715a10d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "name": "network-vif-deleted", "tag": "614bc975-55cc-4a02-8208-a141e064bf06"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:33:33.598391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b46e25a9-9cb5-4485-9a1d-64e2c87d6a82 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:33.601652 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b46e25a9-9cb5-4485-9a1d-64e2c87d6a82 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:33.628260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b46e25a9-9cb5-4485-9a1d-64e2c87d6a82 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:33.632484 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b46e25a9-9cb5-4485-9a1d-64e2c87d6a82 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:33.634460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ac6e8a89-6465-4d3b-899c-4cbe3512bab1 req-9e8c5854-7a6e-494f-bb57-bac0715a10d4 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:33.635682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ac6e8a89-6465-4d3b-899c-4cbe3512bab1 req-9e8c5854-7a6e-494f-bb57-bac0715a10d4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:33.636460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ac6e8a89-6465-4d3b-899c-4cbe3512bab1 req-9e8c5854-7a6e-494f-bb57-bac0715a10d4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:33.638348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b46e25a9-9cb5-4485-9a1d-64e2c87d6a82 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:33.640579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b46e25a9-9cb5-4485-9a1d-64e2c87d6a82 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:33.641086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b46e25a9-9cb5-4485-9a1d-64e2c87d6a82 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:33.641642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b46e25a9-9cb5-4485-9a1d-64e2c87d6a82 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:33.711216 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-ac6e8a89-6465-4d3b-899c-4cbe3512bab1 req-9e8c5854-7a6e-494f-bb57-bac0715a10d4 service nova] Creating event network-vif-deleted:614bc975-55cc-4a02-8208-a141e064bf06 for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:33:33.734766 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-ac6e8a89-6465-4d3b-899c-4cbe3512bab1 req-9e8c5854-7a6e-494f-bb57-bac0715a10d4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146204 Oct 10 23:33:33.739536 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1909/3690] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:33:34.014855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-7c454bab-9b33-4a75-be4f-d8087fa84b82 req-92669606-224c-4941-9c95-116847a95b95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "name": "network-vif-unplugged", "status": "completed", "tag": "acfd32f6-5102-480d-b6cb-2c17b29cf9fc"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:33:34.064782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7c454bab-9b33-4a75-be4f-d8087fa84b82 req-92669606-224c-4941-9c95-116847a95b95 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:34.065275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7c454bab-9b33-4a75-be4f-d8087fa84b82 req-92669606-224c-4941-9c95-116847a95b95 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:34.074450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7c454bab-9b33-4a75-be4f-d8087fa84b82 req-92669606-224c-4941-9c95-116847a95b95 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:34.103003 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-7c454bab-9b33-4a75-be4f-d8087fa84b82 req-92669606-224c-4941-9c95-116847a95b95 service nova] Creating event network-vif-unplugged:acfd32f6-5102-480d-b6cb-2c17b29cf9fc for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:33:34.113626 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-7c454bab-9b33-4a75-be4f-d8087fa84b82 req-92669606-224c-4941-9c95-116847a95b95 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106613 Oct 10 23:33:34.115791 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1910/3691] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:33:34.156235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b3e11964-fa84-4ba6-becd-89326770f87f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:34.157016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b3e11964-fa84-4ba6-becd-89326770f87f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:34.167243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3e11964-fa84-4ba6-becd-89326770f87f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:34.167785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3e11964-fa84-4ba6-becd-89326770f87f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:34.168243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3e11964-fa84-4ba6-becd-89326770f87f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:34.168959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3e11964-fa84-4ba6-becd-89326770f87f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:34.169445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3e11964-fa84-4ba6-becd-89326770f87f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:34.170136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3e11964-fa84-4ba6-becd-89326770f87f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:34.605079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b3e11964-fa84-4ba6-becd-89326770f87f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:34.624203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b3e11964-fa84-4ba6-becd-89326770f87f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:34.626401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b3e11964-fa84-4ba6-becd-89326770f87f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:34.667320 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b3e11964-fa84-4ba6-becd-89326770f87f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1745 microversion: 2.20 time: 0.479218 Oct 10 23:33:34.668690 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1911/3692] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:34 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1745 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:34.690040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0faf18f6-9a57-45d7-84d5-aabd133dd9f2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:34.691372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0faf18f6-9a57-45d7-84d5-aabd133dd9f2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:34.714768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0faf18f6-9a57-45d7-84d5-aabd133dd9f2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:34.715723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0faf18f6-9a57-45d7-84d5-aabd133dd9f2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:34.716841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0faf18f6-9a57-45d7-84d5-aabd133dd9f2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:34.719824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0faf18f6-9a57-45d7-84d5-aabd133dd9f2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:34.722401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0faf18f6-9a57-45d7-84d5-aabd133dd9f2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:34.726977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0faf18f6-9a57-45d7-84d5-aabd133dd9f2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:34.890303 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b46e25a9-9cb5-4485-9a1d-64e2c87d6a82 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:34.909180 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b46e25a9-9cb5-4485-9a1d-64e2c87d6a82 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:34.910610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b46e25a9-9cb5-4485-9a1d-64e2c87d6a82 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:34.912857 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b46e25a9-9cb5-4485-9a1d-64e2c87d6a82 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 2865 microversion: 2.32 time: 1.326094 Oct 10 23:33:34.913475 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1782/3693] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:33 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 2865 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:34.932167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d1bb0917-d685-4175-8249-f8989bf0abd1 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:34.933010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d1bb0917-d685-4175-8249-f8989bf0abd1 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 430a8e18-4033-498b-8cf3-a224786b7363] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:34.943577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1bb0917-d685-4175-8249-f8989bf0abd1 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:34.946628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1bb0917-d685-4175-8249-f8989bf0abd1 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:34.947333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1bb0917-d685-4175-8249-f8989bf0abd1 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:34.948276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1bb0917-d685-4175-8249-f8989bf0abd1 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:34.955981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1bb0917-d685-4175-8249-f8989bf0abd1 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:34.956682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1bb0917-d685-4175-8249-f8989bf0abd1 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:35.024042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0faf18f6-9a57-45d7-84d5-aabd133dd9f2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:35.054453 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0faf18f6-9a57-45d7-84d5-aabd133dd9f2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1271 microversion: 2.1 time: 0.383972 Oct 10 23:33:35.056375 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1912/3694] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:34 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1271 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:35.164971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-848c2439-9777-470d-b552-4017b75b4264 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:35.168968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-848c2439-9777-470d-b552-4017b75b4264 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:35.181504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-848c2439-9777-470d-b552-4017b75b4264 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:35.182709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-848c2439-9777-470d-b552-4017b75b4264 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:35.183588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-848c2439-9777-470d-b552-4017b75b4264 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:35.185064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-848c2439-9777-470d-b552-4017b75b4264 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:35.186217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-848c2439-9777-470d-b552-4017b75b4264 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:35.187244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-848c2439-9777-470d-b552-4017b75b4264 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:35.241863 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-848c2439-9777-470d-b552-4017b75b4264 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083769 Oct 10 23:33:35.249025 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1913/3695] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:33:35 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:33:35.257484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ca0055f2-31fd-41de-8aa7-aeb3fe5a4956 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:35.258479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ca0055f2-31fd-41de-8aa7-aeb3fe5a4956 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:35.267393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ca0055f2-31fd-41de-8aa7-aeb3fe5a4956 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:35.268162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ca0055f2-31fd-41de-8aa7-aeb3fe5a4956 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:35.268908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ca0055f2-31fd-41de-8aa7-aeb3fe5a4956 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:35.270141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ca0055f2-31fd-41de-8aa7-aeb3fe5a4956 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:35.271243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ca0055f2-31fd-41de-8aa7-aeb3fe5a4956 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:35.271949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ca0055f2-31fd-41de-8aa7-aeb3fe5a4956 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:35.536941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-ca0055f2-31fd-41de-8aa7-aeb3fe5a4956 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lazy-loading 'services' on Instance uuid 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:33:35.784994 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ca0055f2-31fd-41de-8aa7-aeb3fe5a4956 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9/os-volume_attachments/cfc51710-517e-4d16-868f-c8728704908a" status: 202 len: 0 microversion: 2.1 time: 0.529230 Oct 10 23:33:35.787093 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1914/3696] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Oct 10 23:33:35 2022] DELETE /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9/os-volume_attachments/cfc51710-517e-4d16-868f-c8728704908a => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:33:35.822073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2d056119-70f8-49ba-986c-2119ebb0653b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:35.840746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2d056119-70f8-49ba-986c-2119ebb0653b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:35.869493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d056119-70f8-49ba-986c-2119ebb0653b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:35.870006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d056119-70f8-49ba-986c-2119ebb0653b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:35.870461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d056119-70f8-49ba-986c-2119ebb0653b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:35.881219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d056119-70f8-49ba-986c-2119ebb0653b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:35.882114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d056119-70f8-49ba-986c-2119ebb0653b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:35.882776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d056119-70f8-49ba-986c-2119ebb0653b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:36.247720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d1bb0917-d685-4175-8249-f8989bf0abd1 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:36.259446 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d1bb0917-d685-4175-8249-f8989bf0abd1 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363" status: 200 len: 1473 microversion: 2.1 time: 1.332815 Oct 10 23:33:36.276679 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1783/3697] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:34 2022] GET /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363 => generated 1473 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:36.306231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-246f96a8-9ded-409a-8967-d62f90d69311 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:36.307110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-246f96a8-9ded-409a-8967-d62f90d69311 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:36.317599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-246f96a8-9ded-409a-8967-d62f90d69311 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:36.318386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-246f96a8-9ded-409a-8967-d62f90d69311 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:36.319192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-246f96a8-9ded-409a-8967-d62f90d69311 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:36.320491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-246f96a8-9ded-409a-8967-d62f90d69311 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:36.321638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-246f96a8-9ded-409a-8967-d62f90d69311 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:36.324373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-246f96a8-9ded-409a-8967-d62f90d69311 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:37.044354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2d056119-70f8-49ba-986c-2119ebb0653b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:37.073532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2d056119-70f8-49ba-986c-2119ebb0653b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:37.079393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2d056119-70f8-49ba-986c-2119ebb0653b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:37.089944 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2d056119-70f8-49ba-986c-2119ebb0653b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1745 microversion: 2.20 time: 1.298372 Oct 10 23:33:37.091957 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1915/3698] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:35 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1745 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:37.099853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9db7a56b-ffed-4e64-a085-63a405cda256 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:37.100899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9db7a56b-ffed-4e64-a085-63a405cda256 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:37.121175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9db7a56b-ffed-4e64-a085-63a405cda256 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:37.135632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9db7a56b-ffed-4e64-a085-63a405cda256 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:37.137881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9db7a56b-ffed-4e64-a085-63a405cda256 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:37.142401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9db7a56b-ffed-4e64-a085-63a405cda256 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:37.143481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9db7a56b-ffed-4e64-a085-63a405cda256 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:37.144194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9db7a56b-ffed-4e64-a085-63a405cda256 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:37.315558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9db7a56b-ffed-4e64-a085-63a405cda256 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:37.353651 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9db7a56b-ffed-4e64-a085-63a405cda256 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1271 microversion: 2.1 time: 0.259349 Oct 10 23:33:37.354701 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1916/3699] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:37 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1271 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:37.366733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-db6da70a-fa02-4bb7-8548-e7231861a226 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:37.368385 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-db6da70a-fa02-4bb7-8548-e7231861a226 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 430a8e18-4033-498b-8cf3-a224786b7363] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:37.387597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db6da70a-fa02-4bb7-8548-e7231861a226 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:37.392137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db6da70a-fa02-4bb7-8548-e7231861a226 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:37.392863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db6da70a-fa02-4bb7-8548-e7231861a226 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:37.393848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db6da70a-fa02-4bb7-8548-e7231861a226 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:37.394487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db6da70a-fa02-4bb7-8548-e7231861a226 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:37.395123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db6da70a-fa02-4bb7-8548-e7231861a226 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:37.821924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-db6da70a-fa02-4bb7-8548-e7231861a226 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:37.852854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:33:37.884246 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-db6da70a-fa02-4bb7-8548-e7231861a226 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363" status: 200 len: 1473 microversion: 2.1 time: 0.526748 Oct 10 23:33:37.886861 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1917/3700] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:37 2022] GET /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363 => generated 1473 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:38.059128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-b6005c2b-0687-4a11-a10f-d80592e9f12c req-e81f474a-ae91-4b0f-bd49-ad4e54fa6cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bd745fa-6826-4bd1-8f8d-ae65071fac12", "name": "network-vif-plugged", "status": "completed", "tag": "9a900297-53e2-4782-8def-24d4260702d5"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:33:38.150367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b6005c2b-0687-4a11-a10f-d80592e9f12c req-e81f474a-ae91-4b0f-bd49-ad4e54fa6cbd service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:38.151536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b6005c2b-0687-4a11-a10f-d80592e9f12c req-e81f474a-ae91-4b0f-bd49-ad4e54fa6cbd service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:38.154250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b6005c2b-0687-4a11-a10f-d80592e9f12c req-e81f474a-ae91-4b0f-bd49-ad4e54fa6cbd service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:38.272410 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-b6005c2b-0687-4a11-a10f-d80592e9f12c req-e81f474a-ae91-4b0f-bd49-ad4e54fa6cbd service nova] Creating event network-vif-plugged:9a900297-53e2-4782-8def-24d4260702d5 for instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 on n-h1-860864-2 Oct 10 23:33:38.288297 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-b6005c2b-0687-4a11-a10f-d80592e9f12c req-e81f474a-ae91-4b0f-bd49-ad4e54fa6cbd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235656 Oct 10 23:33:38.303635 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1918/3701] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:33:38.335587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-abb45439-b345-49ad-b1fb-4ebe792fd600 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:38.338957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-abb45439-b345-49ad-b1fb-4ebe792fd600 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:38.348908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:33:38.413480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abb45439-b345-49ad-b1fb-4ebe792fd600 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:38.423663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abb45439-b345-49ad-b1fb-4ebe792fd600 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:38.426375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abb45439-b345-49ad-b1fb-4ebe792fd600 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:38.430745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abb45439-b345-49ad-b1fb-4ebe792fd600 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:38.431891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abb45439-b345-49ad-b1fb-4ebe792fd600 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:38.436294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abb45439-b345-49ad-b1fb-4ebe792fd600 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:39.864739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-246f96a8-9ded-409a-8967-d62f90d69311 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:39.882143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:33:39.887648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-246f96a8-9ded-409a-8967-d62f90d69311 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:39.900524 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-246f96a8-9ded-409a-8967-d62f90d69311 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:39.921215 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-246f96a8-9ded-409a-8967-d62f90d69311 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 2704 microversion: 2.32 time: 3.633969 Oct 10 23:33:39.925814 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1784/3702] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:36 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 2704 bytes in 3648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:39.962030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-abb45439-b345-49ad-b1fb-4ebe792fd600 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:39.992522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c1288346-31af-45a4-8c15-1726e667dd03 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:40.003468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c1288346-31af-45a4-8c15-1726e667dd03 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:40.010024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-abb45439-b345-49ad-b1fb-4ebe792fd600 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:40.011614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-abb45439-b345-49ad-b1fb-4ebe792fd600 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:40.030314 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-abb45439-b345-49ad-b1fb-4ebe792fd600 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1745 microversion: 2.20 time: 1.719255 Oct 10 23:33:40.033207 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1919/3703] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:38 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1745 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:40.054131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bb86c65f-15dc-4d28-9262-5b957868256a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:40.056697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bb86c65f-15dc-4d28-9262-5b957868256a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 430a8e18-4033-498b-8cf3-a224786b7363] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:40.065947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1288346-31af-45a4-8c15-1726e667dd03 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:40.067464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1288346-31af-45a4-8c15-1726e667dd03 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:40.068851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1288346-31af-45a4-8c15-1726e667dd03 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:40.073254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1288346-31af-45a4-8c15-1726e667dd03 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:40.076107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1288346-31af-45a4-8c15-1726e667dd03 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:40.078524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb86c65f-15dc-4d28-9262-5b957868256a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:40.079043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb86c65f-15dc-4d28-9262-5b957868256a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:40.079495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb86c65f-15dc-4d28-9262-5b957868256a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:40.080142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1288346-31af-45a4-8c15-1726e667dd03 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:40.090769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb86c65f-15dc-4d28-9262-5b957868256a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:40.093807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb86c65f-15dc-4d28-9262-5b957868256a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:40.097762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb86c65f-15dc-4d28-9262-5b957868256a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:40.236433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb86c65f-15dc-4d28-9262-5b957868256a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:40.236936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb86c65f-15dc-4d28-9262-5b957868256a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:40.237406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb86c65f-15dc-4d28-9262-5b957868256a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:40.237909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-bb86c65f-15dc-4d28-9262-5b957868256a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lazy-loading 'fault' on Instance uuid 430a8e18-4033-498b-8cf3-a224786b7363 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:33:40.644021 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:33:40.699685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bb86c65f-15dc-4d28-9262-5b957868256a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71aca6d5de04f06a30480f7d7409d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8dfd604f5c14b5db14dec95b300a176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:40.751116 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bb86c65f-15dc-4d28-9262-5b957868256a tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363" status: 200 len: 1308 microversion: 2.1 time: 0.698289 Oct 10 23:33:40.765470 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1920/3704] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:40 2022] GET /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363 => generated 1308 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:40.802805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-c1a7dc94-ec72-42d8-8e24-18fa5b59749e req-9d9417a0-8cf3-4927-b1d9-3a5038c8b966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430a8e18-4033-498b-8cf3-a224786b7363", "name": "network-vif-deleted", "tag": "a2e7d038-4684-44fd-a359-4f01f2732cbf"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:33:40.897207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c1a7dc94-ec72-42d8-8e24-18fa5b59749e req-9d9417a0-8cf3-4927-b1d9-3a5038c8b966 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:40.897675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c1a7dc94-ec72-42d8-8e24-18fa5b59749e req-9d9417a0-8cf3-4927-b1d9-3a5038c8b966 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:40.900923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c1a7dc94-ec72-42d8-8e24-18fa5b59749e req-9d9417a0-8cf3-4927-b1d9-3a5038c8b966 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:40.944003 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-c1a7dc94-ec72-42d8-8e24-18fa5b59749e req-9d9417a0-8cf3-4927-b1d9-3a5038c8b966 service nova] Creating event network-vif-deleted:a2e7d038-4684-44fd-a359-4f01f2732cbf for instance 430a8e18-4033-498b-8cf3-a224786b7363 on n-h2-860864-2 Oct 10 23:33:40.951669 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-c1a7dc94-ec72-42d8-8e24-18fa5b59749e req-9d9417a0-8cf3-4927-b1d9-3a5038c8b966 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182002 Oct 10 23:33:40.953044 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1921/3705] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:33:40.971918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5517bc6f-9ac8-42e1-a2c6-f2469821815a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:40.975148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5517bc6f-9ac8-42e1-a2c6-f2469821815a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:40.990348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5517bc6f-9ac8-42e1-a2c6-f2469821815a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:40.991687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5517bc6f-9ac8-42e1-a2c6-f2469821815a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:40.992422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5517bc6f-9ac8-42e1-a2c6-f2469821815a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:40.993592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5517bc6f-9ac8-42e1-a2c6-f2469821815a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:40.994392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5517bc6f-9ac8-42e1-a2c6-f2469821815a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:40.998417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5517bc6f-9ac8-42e1-a2c6-f2469821815a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:41.399465 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=8 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:33:42.203790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c1288346-31af-45a4-8c15-1726e667dd03 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:42.238203 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c1288346-31af-45a4-8c15-1726e667dd03 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1313 microversion: 2.1 time: 2.281123 Oct 10 23:33:42.243199 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1785/3706] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:39 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1313 bytes in 2317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:42.262722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-694e33fc-74fb-413c-a61f-3276ad1f3337 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:42.263957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-694e33fc-74fb-413c-a61f-3276ad1f3337 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:42.281183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-694e33fc-74fb-413c-a61f-3276ad1f3337 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:42.282560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-694e33fc-74fb-413c-a61f-3276ad1f3337 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:42.283574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-694e33fc-74fb-413c-a61f-3276ad1f3337 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:42.285059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-694e33fc-74fb-413c-a61f-3276ad1f3337 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:42.288614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-694e33fc-74fb-413c-a61f-3276ad1f3337 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:42.289797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-694e33fc-74fb-413c-a61f-3276ad1f3337 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:42.656285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5517bc6f-9ac8-42e1-a2c6-f2469821815a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:42.680986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5517bc6f-9ac8-42e1-a2c6-f2469821815a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:42.687729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5517bc6f-9ac8-42e1-a2c6-f2469821815a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:42.694579 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5517bc6f-9ac8-42e1-a2c6-f2469821815a tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 2704 microversion: 2.32 time: 1.725958 Oct 10 23:33:42.729564 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1922/3707] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:40 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 2704 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:42.759224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4f44634d-9eb1-4474-96d7-051f9dec61d8 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:42.760918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4f44634d-9eb1-4474-96d7-051f9dec61d8 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] [instance: 430a8e18-4033-498b-8cf3-a224786b7363] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:42.777046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f44634d-9eb1-4474-96d7-051f9dec61d8 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:42.778844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f44634d-9eb1-4474-96d7-051f9dec61d8 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:42.780134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f44634d-9eb1-4474-96d7-051f9dec61d8 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:42.781972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f44634d-9eb1-4474-96d7-051f9dec61d8 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:42.783221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f44634d-9eb1-4474-96d7-051f9dec61d8 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:42.784411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f44634d-9eb1-4474-96d7-051f9dec61d8 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:42.811091 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-4f44634d-9eb1-4474-96d7-051f9dec61d8 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] HTTP exception thrown: Instance 430a8e18-4033-498b-8cf3-a224786b7363 could not be found. Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4f44634d-9eb1-4474-96d7-051f9dec61d8 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Request method failure captured: Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363 HTTP/1.1 Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKsRv1gZpWjcHJj5-e51Go7mko0ZB17IoEO-WMEbZaiDfPAe_CrEI9-HktZzNbRBYSLO7ZDJsRldb48zM3iipQysY9UA7VYOOVKCeDIXUb84Nh1tn7G9Fx22px1DJU744b4AwGM1zMmhb2Ys98JqXbEiaa2QJrzZMOSbTE09i2-sNi4 Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: c8dfd604f5c14b5db14dec95b300a176 Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ListImageFiltersTestJSON-189026498 Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8dfd604f5c14b5db14dec95b300a176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8dfd604f5c14b5db14dec95b300a176"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8dfd604f5c14b5db14dec95b300a176"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8dfd604f5c14b5db14dec95b300a176", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ListImageFiltersTestJSON-189026498 Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: c8dfd604f5c14b5db14dec95b300a176 Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-189026498 Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ListImageFiltersTestJSON-189026498-project Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: b71aca6d5de04f06a30480f7d7409d62 Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ListImageFiltersTestJSON-189026498-project Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 430a8e18-4033-498b-8cf3-a224786b7363 could not be found. Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '430a8e18-4033-498b-8cf3-a224786b7363'} Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 430a8e18-4033-498b-8cf3-a224786b7363 could not be found. Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 430a8e18-4033-498b-8cf3-a224786b7363 could not be found. Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:33:42.813952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:33:42.822952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:33:42.822952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:33:42.822952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:33:42.822952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:33:42.822952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:33:42.822952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 430a8e18-4033-498b-8cf3-a224786b7363 could not be found. Oct 10 23:33:42.822952 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:33:42.826257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4f44634d-9eb1-4474-96d7-051f9dec61d8 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Returning 404 to user: Instance 430a8e18-4033-498b-8cf3-a224786b7363 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:33:42.827757 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4f44634d-9eb1-4474-96d7-051f9dec61d8 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "GET /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363" status: 404 len: 111 microversion: 2.1 time: 0.078794 Oct 10 23:33:42.829276 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1923/3708] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:42 2022] GET /compute/v2.1/servers/430a8e18-4033-498b-8cf3-a224786b7363 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:33:42.846487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1aeac43b-9101-4017-b888-9bea35d3570e tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662ae560d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:43.132792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-694e33fc-74fb-413c-a61f-3276ad1f3337 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:43.147125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-694e33fc-74fb-413c-a61f-3276ad1f3337 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:43.155177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-694e33fc-74fb-413c-a61f-3276ad1f3337 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:43.160141 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-694e33fc-74fb-413c-a61f-3276ad1f3337 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1740 microversion: 2.20 time: 0.915432 Oct 10 23:33:43.163292 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1786/3709] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:42 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1740 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:43.272096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-638bf882-df86-47cc-ba2e-615d44452c39 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:43.273286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-638bf882-df86-47cc-ba2e-615d44452c39 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:43.303543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-638bf882-df86-47cc-ba2e-615d44452c39 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:43.306098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-638bf882-df86-47cc-ba2e-615d44452c39 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:43.306571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-638bf882-df86-47cc-ba2e-615d44452c39 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:43.310222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-638bf882-df86-47cc-ba2e-615d44452c39 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:43.311393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-638bf882-df86-47cc-ba2e-615d44452c39 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:43.312057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-638bf882-df86-47cc-ba2e-615d44452c39 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:44.467806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-638bf882-df86-47cc-ba2e-615d44452c39 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:44.500779 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-638bf882-df86-47cc-ba2e-615d44452c39 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1313 microversion: 2.1 time: 1.234888 Oct 10 23:33:44.507847 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1787/3710] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:43 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1313 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:44.525811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a320200a-78cc-4809-83b7-606427f2ba08 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:44.535014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a320200a-78cc-4809-83b7-606427f2ba08 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:44.559106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a320200a-78cc-4809-83b7-606427f2ba08 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:44.560223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a320200a-78cc-4809-83b7-606427f2ba08 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:44.562949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a320200a-78cc-4809-83b7-606427f2ba08 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:44.570358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a320200a-78cc-4809-83b7-606427f2ba08 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:44.571813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a320200a-78cc-4809-83b7-606427f2ba08 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:44.572767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a320200a-78cc-4809-83b7-606427f2ba08 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:46.825593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a320200a-78cc-4809-83b7-606427f2ba08 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:46.890586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a320200a-78cc-4809-83b7-606427f2ba08 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:46.893016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a320200a-78cc-4809-83b7-606427f2ba08 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:46.894848 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a320200a-78cc-4809-83b7-606427f2ba08 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 2657 microversion: 2.32 time: 2.385225 Oct 10 23:33:46.904671 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1788/3711] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:44 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 2657 bytes in 2396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:46.943692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-40a2658c-91d2-48a5-abac-ce714cbb5ea7 req-dfb51bed-b516-4706-9840-f5eebdf8e383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "name": "network-vif-deleted", "tag": "779175ee-abe1-40ae-bb85-14125427b898"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:33:47.004023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:33:47.008663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-40a2658c-91d2-48a5-abac-ce714cbb5ea7 req-dfb51bed-b516-4706-9840-f5eebdf8e383 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:47.012909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-40a2658c-91d2-48a5-abac-ce714cbb5ea7 req-dfb51bed-b516-4706-9840-f5eebdf8e383 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:47.017449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-40a2658c-91d2-48a5-abac-ce714cbb5ea7 req-dfb51bed-b516-4706-9840-f5eebdf8e383 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:47.078711 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-40a2658c-91d2-48a5-abac-ce714cbb5ea7 req-dfb51bed-b516-4706-9840-f5eebdf8e383 service nova] Creating event network-vif-deleted:779175ee-abe1-40ae-bb85-14125427b898 for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:33:47.111446 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-40a2658c-91d2-48a5-abac-ce714cbb5ea7 req-dfb51bed-b516-4706-9840-f5eebdf8e383 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171498 Oct 10 23:33:47.131908 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1789/3712] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:33:47.182236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b98731e5-be60-499f-828f-ba50516ec7bb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:47.191113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b98731e5-be60-499f-828f-ba50516ec7bb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:47.238252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b98731e5-be60-499f-828f-ba50516ec7bb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:47.240908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b98731e5-be60-499f-828f-ba50516ec7bb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:47.242998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b98731e5-be60-499f-828f-ba50516ec7bb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:47.253482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b98731e5-be60-499f-828f-ba50516ec7bb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:47.258895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b98731e5-be60-499f-828f-ba50516ec7bb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:47.259868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b98731e5-be60-499f-828f-ba50516ec7bb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:48.929490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b98731e5-be60-499f-828f-ba50516ec7bb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:48.954078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b98731e5-be60-499f-828f-ba50516ec7bb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:48.965090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b98731e5-be60-499f-828f-ba50516ec7bb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:48.970381 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b98731e5-be60-499f-828f-ba50516ec7bb tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1740 microversion: 2.20 time: 1.829869 Oct 10 23:33:48.977954 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1790/3713] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:47 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1740 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:48.995473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c6674049-4175-4213-bfc9-adfd69d1de58 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:49.003744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c6674049-4175-4213-bfc9-adfd69d1de58 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:49.025251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6674049-4175-4213-bfc9-adfd69d1de58 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:49.027142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6674049-4175-4213-bfc9-adfd69d1de58 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:49.030094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6674049-4175-4213-bfc9-adfd69d1de58 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:49.038544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6674049-4175-4213-bfc9-adfd69d1de58 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:49.039329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6674049-4175-4213-bfc9-adfd69d1de58 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:49.046007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6674049-4175-4213-bfc9-adfd69d1de58 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:50.297976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c6674049-4175-4213-bfc9-adfd69d1de58 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:50.337596 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c6674049-4175-4213-bfc9-adfd69d1de58 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1334 microversion: 2.1 time: 1.357872 Oct 10 23:33:50.346116 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1791/3714] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:48 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1334 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:50.362731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a78cc180-749a-4669-823b-8f20fd048b41 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:50.363366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a78cc180-749a-4669-823b-8f20fd048b41 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:50.417656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a78cc180-749a-4669-823b-8f20fd048b41 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:50.418519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a78cc180-749a-4669-823b-8f20fd048b41 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:50.419294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a78cc180-749a-4669-823b-8f20fd048b41 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:50.431720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a78cc180-749a-4669-823b-8f20fd048b41 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:50.434114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a78cc180-749a-4669-823b-8f20fd048b41 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:50.435574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a78cc180-749a-4669-823b-8f20fd048b41 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:51.338407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a78cc180-749a-4669-823b-8f20fd048b41 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:51.367657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a78cc180-749a-4669-823b-8f20fd048b41 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:51.377618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a78cc180-749a-4669-823b-8f20fd048b41 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:51.381771 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a78cc180-749a-4669-823b-8f20fd048b41 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 2496 microversion: 2.32 time: 1.034118 Oct 10 23:33:51.385569 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1792/3715] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:50 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 2496 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:51.401672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-368b7250-20c5-4fbc-af9f-441d534c85e1 req-a4312f91-d50c-4f75-a174-bf2dad55ca1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "name": "network-vif-deleted", "tag": "acfd32f6-5102-480d-b6cb-2c17b29cf9fc"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:33:51.444825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-368b7250-20c5-4fbc-af9f-441d534c85e1 req-a4312f91-d50c-4f75-a174-bf2dad55ca1d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:51.445756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-368b7250-20c5-4fbc-af9f-441d534c85e1 req-a4312f91-d50c-4f75-a174-bf2dad55ca1d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:51.450872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-368b7250-20c5-4fbc-af9f-441d534c85e1 req-a4312f91-d50c-4f75-a174-bf2dad55ca1d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:51.490840 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-368b7250-20c5-4fbc-af9f-441d534c85e1 req-a4312f91-d50c-4f75-a174-bf2dad55ca1d service nova] Creating event network-vif-deleted:acfd32f6-5102-480d-b6cb-2c17b29cf9fc for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:33:51.506717 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-368b7250-20c5-4fbc-af9f-441d534c85e1 req-a4312f91-d50c-4f75-a174-bf2dad55ca1d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117928 Oct 10 23:33:51.513579 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1793/3716] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:33:51.536384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-29ed8a1e-7609-45b2-b51d-a335b80ce686 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:51.537552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-29ed8a1e-7609-45b2-b51d-a335b80ce686 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:51.555758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29ed8a1e-7609-45b2-b51d-a335b80ce686 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:51.561790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29ed8a1e-7609-45b2-b51d-a335b80ce686 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:51.562389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29ed8a1e-7609-45b2-b51d-a335b80ce686 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:51.563189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29ed8a1e-7609-45b2-b51d-a335b80ce686 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:51.563668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29ed8a1e-7609-45b2-b51d-a335b80ce686 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:51.564108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29ed8a1e-7609-45b2-b51d-a335b80ce686 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:52.170765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-29ed8a1e-7609-45b2-b51d-a335b80ce686 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:52.188690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-29ed8a1e-7609-45b2-b51d-a335b80ce686 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:52.190184 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-29ed8a1e-7609-45b2-b51d-a335b80ce686 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:52.191409 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-29ed8a1e-7609-45b2-b51d-a335b80ce686 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1740 microversion: 2.20 time: 0.676024 Oct 10 23:33:52.218480 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1794/3717] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:51 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1740 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:52.228698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8dc9d220-612e-4266-ad56-af24f9c8b326 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:52.229332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8dc9d220-612e-4266-ad56-af24f9c8b326 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:52.253846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8dc9d220-612e-4266-ad56-af24f9c8b326 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:52.253846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8dc9d220-612e-4266-ad56-af24f9c8b326 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:52.253846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8dc9d220-612e-4266-ad56-af24f9c8b326 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:52.253846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8dc9d220-612e-4266-ad56-af24f9c8b326 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:52.253846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8dc9d220-612e-4266-ad56-af24f9c8b326 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:52.253846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8dc9d220-612e-4266-ad56-af24f9c8b326 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:52.788258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=11 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:33:52.809148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=26 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:33:54.218260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8dc9d220-612e-4266-ad56-af24f9c8b326 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:54.235764 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8dc9d220-612e-4266-ad56-af24f9c8b326 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1334 microversion: 2.1 time: 2.015916 Oct 10 23:33:54.238393 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1795/3718] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:52 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1334 bytes in 2019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:54.260975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5b317466-1816-4531-9306-db090d485293 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:54.271060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5b317466-1816-4531-9306-db090d485293 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:54.293809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b317466-1816-4531-9306-db090d485293 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:54.294333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b317466-1816-4531-9306-db090d485293 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:54.301680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b317466-1816-4531-9306-db090d485293 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:54.305789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b317466-1816-4531-9306-db090d485293 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:54.308827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b317466-1816-4531-9306-db090d485293 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:54.310187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b317466-1816-4531-9306-db090d485293 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:54.510155 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5b317466-1816-4531-9306-db090d485293 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.267707 Oct 10 23:33:54.516921 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1796/3719] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:33:54 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9/os-volume_attachments => generated 25 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:33:54.528682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3bd38654-fcc9-46d7-94f1-e87eb9a60ffd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:54.529558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3bd38654-fcc9-46d7-94f1-e87eb9a60ffd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:54.538744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3bd38654-fcc9-46d7-94f1-e87eb9a60ffd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:54.539844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3bd38654-fcc9-46d7-94f1-e87eb9a60ffd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:54.540633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3bd38654-fcc9-46d7-94f1-e87eb9a60ffd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:54.541853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3bd38654-fcc9-46d7-94f1-e87eb9a60ffd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:54.542550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3bd38654-fcc9-46d7-94f1-e87eb9a60ffd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:54.543148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3bd38654-fcc9-46d7-94f1-e87eb9a60ffd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:54.702201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3bd38654-fcc9-46d7-94f1-e87eb9a60ffd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:54.718498 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3bd38654-fcc9-46d7-94f1-e87eb9a60ffd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:54.719953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3bd38654-fcc9-46d7-94f1-e87eb9a60ffd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:54.734206 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3bd38654-fcc9-46d7-94f1-e87eb9a60ffd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1602 microversion: 2.32 time: 0.196944 Oct 10 23:33:54.736530 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1797/3720] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:54 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1602 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:54.758907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-961a3581-1c43-4c0a-be96-606cf306ebd2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:54.764354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-961a3581-1c43-4c0a-be96-606cf306ebd2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:54.794442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-961a3581-1c43-4c0a-be96-606cf306ebd2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:54.810894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-961a3581-1c43-4c0a-be96-606cf306ebd2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:54.814857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-961a3581-1c43-4c0a-be96-606cf306ebd2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:54.816438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-961a3581-1c43-4c0a-be96-606cf306ebd2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:54.818752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-961a3581-1c43-4c0a-be96-606cf306ebd2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:54.820114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-961a3581-1c43-4c0a-be96-606cf306ebd2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:55.748879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-961a3581-1c43-4c0a-be96-606cf306ebd2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:55.767974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-961a3581-1c43-4c0a-be96-606cf306ebd2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:55.772846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-961a3581-1c43-4c0a-be96-606cf306ebd2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:55.776606 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-961a3581-1c43-4c0a-be96-606cf306ebd2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1740 microversion: 2.20 time: 1.034381 Oct 10 23:33:55.778336 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1798/3721] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:54 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1740 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:55.789590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-7ce527e5-a5c3-4400-b49a-3f6bdce3cff8 req-2517aee3-8989-4920-89a0-a497567959c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "name": "network-vif-deleted", "tag": "575d047b-0d89-4ae3-b746-a43054af851b"}, {"name": "network-changed", "server_uuid": "ce9a3be2-bbf6-4abd-bbb1-452785322946", "tag": "404743c5-d63d-416d-ae9c-ee2596213ec8"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:33:55.836594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7ce527e5-a5c3-4400-b49a-3f6bdce3cff8 req-2517aee3-8989-4920-89a0-a497567959c2 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:55.840334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7ce527e5-a5c3-4400-b49a-3f6bdce3cff8 req-2517aee3-8989-4920-89a0-a497567959c2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:55.842752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7ce527e5-a5c3-4400-b49a-3f6bdce3cff8 req-2517aee3-8989-4920-89a0-a497567959c2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:55.899264 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-7ce527e5-a5c3-4400-b49a-3f6bdce3cff8 req-2517aee3-8989-4920-89a0-a497567959c2 service nova] Creating event network-vif-deleted:575d047b-0d89-4ae3-b746-a43054af851b for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:33:55.911876 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-7ce527e5-a5c3-4400-b49a-3f6bdce3cff8 req-2517aee3-8989-4920-89a0-a497567959c2 service nova] Creating event network-changed:404743c5-d63d-416d-ae9c-ee2596213ec8 for instance ce9a3be2-bbf6-4abd-bbb1-452785322946 on n-h1-860864-2 Oct 10 23:33:55.927851 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-7ce527e5-a5c3-4400-b49a-3f6bdce3cff8 req-2517aee3-8989-4920-89a0-a497567959c2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.147859 Oct 10 23:33:55.928740 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1799/3722] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:33:55.935445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5139a62a-31d6-448e-8130-6136994b4e13 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:55.939890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5139a62a-31d6-448e-8130-6136994b4e13 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:55.959461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5139a62a-31d6-448e-8130-6136994b4e13 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:55.963151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5139a62a-31d6-448e-8130-6136994b4e13 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:55.965002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5139a62a-31d6-448e-8130-6136994b4e13 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:55.966093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5139a62a-31d6-448e-8130-6136994b4e13 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:55.969813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5139a62a-31d6-448e-8130-6136994b4e13 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:55.972581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5139a62a-31d6-448e-8130-6136994b4e13 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:56.068144 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5139a62a-31d6-448e-8130-6136994b4e13 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.137946 Oct 10 23:33:56.075928 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1800/3723] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:33:55 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9/os-volume_attachments => generated 25 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:33:56.089485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-28931c44-213f-4cf8-a903-0e2aa67aeab2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:56.090124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-28931c44-213f-4cf8-a903-0e2aa67aeab2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:56.108378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28931c44-213f-4cf8-a903-0e2aa67aeab2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:56.110673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28931c44-213f-4cf8-a903-0e2aa67aeab2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:56.112759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28931c44-213f-4cf8-a903-0e2aa67aeab2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:56.114978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28931c44-213f-4cf8-a903-0e2aa67aeab2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:56.116581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28931c44-213f-4cf8-a903-0e2aa67aeab2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:56.117920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28931c44-213f-4cf8-a903-0e2aa67aeab2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:57.250771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-28931c44-213f-4cf8-a903-0e2aa67aeab2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:57.271229 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-28931c44-213f-4cf8-a903-0e2aa67aeab2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1334 microversion: 2.1 time: 1.193405 Oct 10 23:33:57.273755 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1801/3724] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:56 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1334 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:57.282086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bd818d1a-7b25-4d92-b15e-2764d84e6a5c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:57.288812 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bd818d1a-7b25-4d92-b15e-2764d84e6a5c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:57.307774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd818d1a-7b25-4d92-b15e-2764d84e6a5c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:57.309932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd818d1a-7b25-4d92-b15e-2764d84e6a5c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:57.310614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd818d1a-7b25-4d92-b15e-2764d84e6a5c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:57.314017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd818d1a-7b25-4d92-b15e-2764d84e6a5c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:57.315774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd818d1a-7b25-4d92-b15e-2764d84e6a5c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:57.317486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd818d1a-7b25-4d92-b15e-2764d84e6a5c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:57.712298 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bd818d1a-7b25-4d92-b15e-2764d84e6a5c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:57.728295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bd818d1a-7b25-4d92-b15e-2764d84e6a5c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:57.741168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bd818d1a-7b25-4d92-b15e-2764d84e6a5c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:57.742482 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bd818d1a-7b25-4d92-b15e-2764d84e6a5c tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1602 microversion: 2.32 time: 0.466530 Oct 10 23:33:57.754303 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1802/3725] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:57 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1602 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:57.779644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3cef19bb-161c-4d44-bec1-bd4792e91859 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:57.780520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3cef19bb-161c-4d44-bec1-bd4792e91859 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:57.808426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3cef19bb-161c-4d44-bec1-bd4792e91859 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:57.822817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3cef19bb-161c-4d44-bec1-bd4792e91859 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:57.825507 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3cef19bb-161c-4d44-bec1-bd4792e91859 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:57.826572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3cef19bb-161c-4d44-bec1-bd4792e91859 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:57.827313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3cef19bb-161c-4d44-bec1-bd4792e91859 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:57.827985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3cef19bb-161c-4d44-bec1-bd4792e91859 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:57.861591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:33:57.880995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3cef19bb-161c-4d44-bec1-bd4792e91859 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:33:58.003171 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3cef19bb-161c-4d44-bec1-bd4792e91859 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 204 len: 0 microversion: 2.1 time: 0.244823 Oct 10 23:33:58.011413 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1803/3726] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:33:57 2022] DELETE /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:33:58.026629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8f3ea792-9048-42cc-b1d4-d6fda44821cc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:58.027866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8f3ea792-9048-42cc-b1d4-d6fda44821cc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:58.047986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f3ea792-9048-42cc-b1d4-d6fda44821cc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:58.052191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f3ea792-9048-42cc-b1d4-d6fda44821cc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:58.053536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f3ea792-9048-42cc-b1d4-d6fda44821cc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:58.054782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f3ea792-9048-42cc-b1d4-d6fda44821cc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:58.055666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f3ea792-9048-42cc-b1d4-d6fda44821cc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:58.057683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f3ea792-9048-42cc-b1d4-d6fda44821cc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:58.482373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8f3ea792-9048-42cc-b1d4-d6fda44821cc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:58.494445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8f3ea792-9048-42cc-b1d4-d6fda44821cc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:58.500799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8f3ea792-9048-42cc-b1d4-d6fda44821cc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:58.502889 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8f3ea792-9048-42cc-b1d4-d6fda44821cc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1740 microversion: 2.20 time: 0.486948 Oct 10 23:33:58.507695 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1804/3727] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:58 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1740 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:33:58.520107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6b776cf9-500e-4e3d-8a3f-15f976256b5a tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:58.524887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6b776cf9-500e-4e3d-8a3f-15f976256b5a tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:58.545243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b776cf9-500e-4e3d-8a3f-15f976256b5a tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:58.546252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b776cf9-500e-4e3d-8a3f-15f976256b5a tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:58.552626 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b776cf9-500e-4e3d-8a3f-15f976256b5a tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:58.553831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b776cf9-500e-4e3d-8a3f-15f976256b5a tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:58.557942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b776cf9-500e-4e3d-8a3f-15f976256b5a tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:58.559532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b776cf9-500e-4e3d-8a3f-15f976256b5a tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:59.173063 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6b776cf9-500e-4e3d-8a3f-15f976256b5a tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf589ecefc364edbb3fbb47fdd18da3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f6458751423bb1175f6fba6d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:59.186461 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6b776cf9-500e-4e3d-8a3f-15f976256b5a tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 200 len: 1683 microversion: 2.1 time: 0.676788 Oct 10 23:33:59.187792 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1805/3728] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:58 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 1683 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:59.195982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-1d50f83e-b080-4926-b108-158676aafbd2 req-661dc0ec-2acb-4cec-b39e-3e8d5b8c53dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c9f989-440a-4037-9757-8e96402a9aea", "name": "network-vif-deleted", "tag": "b8d599b8-79fd-4f70-91f1-14f3dcfc2d85"}, {"name": "network-changed", "server_uuid": "ce9a3be2-bbf6-4abd-bbb1-452785322946", "tag": "eac62ee6-3195-444b-b747-98b82a33a616"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:33:59.215018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1d50f83e-b080-4926-b108-158676aafbd2 req-661dc0ec-2acb-4cec-b39e-3e8d5b8c53dd service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:59.215611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1d50f83e-b080-4926-b108-158676aafbd2 req-661dc0ec-2acb-4cec-b39e-3e8d5b8c53dd service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:59.216099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1d50f83e-b080-4926-b108-158676aafbd2 req-661dc0ec-2acb-4cec-b39e-3e8d5b8c53dd service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:59.251192 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-1d50f83e-b080-4926-b108-158676aafbd2 req-661dc0ec-2acb-4cec-b39e-3e8d5b8c53dd service nova] Creating event network-vif-deleted:b8d599b8-79fd-4f70-91f1-14f3dcfc2d85 for instance 25c9f989-440a-4037-9757-8e96402a9aea on n-h1-860864-2 Oct 10 23:33:59.251847 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-1d50f83e-b080-4926-b108-158676aafbd2 req-661dc0ec-2acb-4cec-b39e-3e8d5b8c53dd service nova] Creating event network-changed:eac62ee6-3195-444b-b747-98b82a33a616 for instance ce9a3be2-bbf6-4abd-bbb1-452785322946 on n-h1-860864-2 Oct 10 23:33:59.273504 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-1d50f83e-b080-4926-b108-158676aafbd2 req-661dc0ec-2acb-4cec-b39e-3e8d5b8c53dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.083309 Oct 10 23:33:59.284736 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1806/3729] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:33:59.306743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8006dba6-7502-4627-996a-49f919b5c685 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:59.310905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8006dba6-7502-4627-996a-49f919b5c685 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:59.333455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8006dba6-7502-4627-996a-49f919b5c685 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:59.338585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8006dba6-7502-4627-996a-49f919b5c685 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:59.339057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8006dba6-7502-4627-996a-49f919b5c685 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:59.339878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8006dba6-7502-4627-996a-49f919b5c685 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:59.340351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8006dba6-7502-4627-996a-49f919b5c685 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:59.340944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8006dba6-7502-4627-996a-49f919b5c685 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:59.676813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8006dba6-7502-4627-996a-49f919b5c685 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:33:59.704354 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8006dba6-7502-4627-996a-49f919b5c685 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1334 microversion: 2.1 time: 0.414414 Oct 10 23:33:59.710923 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1807/3730] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:59 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1334 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:33:59.729400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-249ee65d-f4b1-46c4-9efc-c6f8985a208e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:33:59.736887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-249ee65d-f4b1-46c4-9efc-c6f8985a208e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:33:59.762839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-249ee65d-f4b1-46c4-9efc-c6f8985a208e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:59.765643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-249ee65d-f4b1-46c4-9efc-c6f8985a208e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:59.768434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-249ee65d-f4b1-46c4-9efc-c6f8985a208e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:33:59.770181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-249ee65d-f4b1-46c4-9efc-c6f8985a208e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:33:59.770870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-249ee65d-f4b1-46c4-9efc-c6f8985a208e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:33:59.772713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-249ee65d-f4b1-46c4-9efc-c6f8985a208e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:00.162181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-249ee65d-f4b1-46c4-9efc-c6f8985a208e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:00.182009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-249ee65d-f4b1-46c4-9efc-c6f8985a208e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:00.196884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-249ee65d-f4b1-46c4-9efc-c6f8985a208e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:00.221491 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-249ee65d-f4b1-46c4-9efc-c6f8985a208e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1602 microversion: 2.32 time: 0.492457 Oct 10 23:34:00.222187 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1808/3731] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:33:59 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1602 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:00.240792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-13d8dd15-f68c-4f46-b3ec-bdbb266cd9a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:00.241850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-13d8dd15-f68c-4f46-b3ec-bdbb266cd9a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:00.277598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13d8dd15-f68c-4f46-b3ec-bdbb266cd9a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:00.278388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13d8dd15-f68c-4f46-b3ec-bdbb266cd9a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:00.278860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13d8dd15-f68c-4f46-b3ec-bdbb266cd9a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:00.279616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13d8dd15-f68c-4f46-b3ec-bdbb266cd9a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:00.286731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13d8dd15-f68c-4f46-b3ec-bdbb266cd9a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:00.287994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13d8dd15-f68c-4f46-b3ec-bdbb266cd9a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:01.091335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-13d8dd15-f68c-4f46-b3ec-bdbb266cd9a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:01.106489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-13d8dd15-f68c-4f46-b3ec-bdbb266cd9a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:01.119493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-13d8dd15-f68c-4f46-b3ec-bdbb266cd9a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:01.126575 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-13d8dd15-f68c-4f46-b3ec-bdbb266cd9a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1740 microversion: 2.20 time: 0.897526 Oct 10 23:34:01.130433 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1809/3732] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:00 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1740 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:01.144124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9116a016-95a4-4df1-af0a-51670dae48a9 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:01.155207 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9116a016-95a4-4df1-af0a-51670dae48a9 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:01.186017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9116a016-95a4-4df1-af0a-51670dae48a9 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:01.186017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9116a016-95a4-4df1-af0a-51670dae48a9 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:01.186017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9116a016-95a4-4df1-af0a-51670dae48a9 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:01.186468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9116a016-95a4-4df1-af0a-51670dae48a9 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:01.186999 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9116a016-95a4-4df1-af0a-51670dae48a9 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:01.189415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9116a016-95a4-4df1-af0a-51670dae48a9 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:01.874874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9116a016-95a4-4df1-af0a-51670dae48a9 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf589ecefc364edbb3fbb47fdd18da3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f6458751423bb1175f6fba6d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:01.887125 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9116a016-95a4-4df1-af0a-51670dae48a9 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 200 len: 1683 microversion: 2.1 time: 0.755102 Oct 10 23:34:01.890672 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1810/3733] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:01 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 1683 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:34:01.902964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-12283254-c2ca-4da2-b320-12a22e774304 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:01.903926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-12283254-c2ca-4da2-b320-12a22e774304 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:01.925305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12283254-c2ca-4da2-b320-12a22e774304 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:01.927175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12283254-c2ca-4da2-b320-12a22e774304 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:01.927872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12283254-c2ca-4da2-b320-12a22e774304 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:01.931912 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12283254-c2ca-4da2-b320-12a22e774304 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:01.932882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12283254-c2ca-4da2-b320-12a22e774304 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:01.933737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12283254-c2ca-4da2-b320-12a22e774304 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:02.392954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-12283254-c2ca-4da2-b320-12a22e774304 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:02.404122 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-12283254-c2ca-4da2-b320-12a22e774304 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1334 microversion: 2.1 time: 0.512091 Oct 10 23:34:02.430258 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1811/3734] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:01 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1334 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:34:02.439758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dc613564-3521-4460-8256-610f55d7983f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:02.440384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dc613564-3521-4460-8256-610f55d7983f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:02.462048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc613564-3521-4460-8256-610f55d7983f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:02.462545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc613564-3521-4460-8256-610f55d7983f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:02.462990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc613564-3521-4460-8256-610f55d7983f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:02.466324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc613564-3521-4460-8256-610f55d7983f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:02.477696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc613564-3521-4460-8256-610f55d7983f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:02.478504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc613564-3521-4460-8256-610f55d7983f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:02.730036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dc613564-3521-4460-8256-610f55d7983f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:02.757626 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dc613564-3521-4460-8256-610f55d7983f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:02.766759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dc613564-3521-4460-8256-610f55d7983f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:02.772017 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dc613564-3521-4460-8256-610f55d7983f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1602 microversion: 2.32 time: 0.340552 Oct 10 23:34:02.772977 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1812/3735] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:02 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1602 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:02.814157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2efc8832-e25c-4ebf-992f-91f56c8b87a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:02.819703 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2efc8832-e25c-4ebf-992f-91f56c8b87a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:02.849869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2efc8832-e25c-4ebf-992f-91f56c8b87a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:02.850435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2efc8832-e25c-4ebf-992f-91f56c8b87a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:02.859826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2efc8832-e25c-4ebf-992f-91f56c8b87a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:02.860876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2efc8832-e25c-4ebf-992f-91f56c8b87a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:02.862234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2efc8832-e25c-4ebf-992f-91f56c8b87a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:02.863385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2efc8832-e25c-4ebf-992f-91f56c8b87a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:03.668938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2efc8832-e25c-4ebf-992f-91f56c8b87a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:03.685015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2efc8832-e25c-4ebf-992f-91f56c8b87a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:03.689006 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1aeac43b-9101-4017-b888-9bea35d3570e tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "DELETE /compute/v2.1/images/4551a12a-abd6-43d9-b765-c22499874335" status: 204 len: 0 microversion: 2.1 time: 20.851482 Oct 10 23:34:03.693613 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2efc8832-e25c-4ebf-992f-91f56c8b87a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:03.693934 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1924/3736] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:33:42 2022] DELETE /compute/v2.1/images/4551a12a-abd6-43d9-b765-c22499874335 => generated 0 bytes in 20855 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:34:03.695484 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2efc8832-e25c-4ebf-992f-91f56c8b87a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1740 microversion: 2.20 time: 0.892254 Oct 10 23:34:03.701172 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1813/3737] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:02 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1740 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:03.709039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b16f8c28-d656-480d-a587-1fa8d5b6dab8 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:03.713295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b16f8c28-d656-480d-a587-1fa8d5b6dab8 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:03.727987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c199ff4a-74e8-45f0-a4d0-8f174e2edc38 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:03.728641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c199ff4a-74e8-45f0-a4d0-8f174e2edc38 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:03.743310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b16f8c28-d656-480d-a587-1fa8d5b6dab8 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:03.744234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c199ff4a-74e8-45f0-a4d0-8f174e2edc38 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:03.744767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c199ff4a-74e8-45f0-a4d0-8f174e2edc38 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:03.744904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b16f8c28-d656-480d-a587-1fa8d5b6dab8 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:03.746579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c199ff4a-74e8-45f0-a4d0-8f174e2edc38 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:03.748574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b16f8c28-d656-480d-a587-1fa8d5b6dab8 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:03.748841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c199ff4a-74e8-45f0-a4d0-8f174e2edc38 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:03.750428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c199ff4a-74e8-45f0-a4d0-8f174e2edc38 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:03.751663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c199ff4a-74e8-45f0-a4d0-8f174e2edc38 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:03.768214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b16f8c28-d656-480d-a587-1fa8d5b6dab8 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:03.771767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b16f8c28-d656-480d-a587-1fa8d5b6dab8 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:03.773657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b16f8c28-d656-480d-a587-1fa8d5b6dab8 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:04.523259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c199ff4a-74e8-45f0-a4d0-8f174e2edc38 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:04.534848 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c199ff4a-74e8-45f0-a4d0-8f174e2edc38 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1334 microversion: 2.1 time: 0.832197 Oct 10 23:34:04.549424 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1814/3738] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:03 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1334 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:34:04.549424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4ee37614-1770-4e01-8923-3cb8a9abfc75 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662a3fa160>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:04.841675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b16f8c28-d656-480d-a587-1fa8d5b6dab8 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf589ecefc364edbb3fbb47fdd18da3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc49f6458751423bb1175f6fba6d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:04.863242 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b16f8c28-d656-480d-a587-1fa8d5b6dab8 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 200 len: 1616 microversion: 2.1 time: 1.158846 Oct 10 23:34:04.866638 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1925/3739] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:03 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 1616 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:34:04.881978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-160f97f5-3c83-4245-a627-6f53a0217cca tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:04.894391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-160f97f5-3c83-4245-a627-6f53a0217cca tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:04.921053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-160f97f5-3c83-4245-a627-6f53a0217cca tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:04.921666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-160f97f5-3c83-4245-a627-6f53a0217cca tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:04.922130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-160f97f5-3c83-4245-a627-6f53a0217cca tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:04.922887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-160f97f5-3c83-4245-a627-6f53a0217cca tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:04.930405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-160f97f5-3c83-4245-a627-6f53a0217cca tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:04.930742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-160f97f5-3c83-4245-a627-6f53a0217cca tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:05.185097 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4ee37614-1770-4e01-8923-3cb8a9abfc75 tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "DELETE /compute/v2.1/images/2477dab9-f49e-435e-94bb-51d3c14f2204" status: 204 len: 0 microversion: 2.1 time: 0.644395 Oct 10 23:34:05.185965 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1815/3740] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:04 2022] DELETE /compute/v2.1/images/2477dab9-f49e-435e-94bb-51d3c14f2204 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:34:05.195268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-b564ec7b-247c-450c-bc48-ddcd67c8963d req-b2329d37-cf11-4b39-a1a1-f13c39bc1e7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9", "name": "network-vif-deleted", "tag": "48151735-8714-45d6-be4d-dfcf9910b276"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:34:05.240216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b564ec7b-247c-450c-bc48-ddcd67c8963d req-b2329d37-cf11-4b39-a1a1-f13c39bc1e7e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:05.248542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b564ec7b-247c-450c-bc48-ddcd67c8963d req-b2329d37-cf11-4b39-a1a1-f13c39bc1e7e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:05.256950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b564ec7b-247c-450c-bc48-ddcd67c8963d req-b2329d37-cf11-4b39-a1a1-f13c39bc1e7e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:05.297944 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-b564ec7b-247c-450c-bc48-ddcd67c8963d req-b2329d37-cf11-4b39-a1a1-f13c39bc1e7e service nova] Creating event network-vif-deleted:48151735-8714-45d6-be4d-dfcf9910b276 for instance 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 on n-h2-860864-2 Oct 10 23:34:05.314845 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-b564ec7b-247c-450c-bc48-ddcd67c8963d req-b2329d37-cf11-4b39-a1a1-f13c39bc1e7e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124567 Oct 10 23:34:05.318748 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1816/3741] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:34:05.336866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-15bf96a5-4586-486a-869e-9e358eb4afc9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:05.338887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-15bf96a5-4586-486a-869e-9e358eb4afc9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:05.347849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15bf96a5-4586-486a-869e-9e358eb4afc9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:05.353244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15bf96a5-4586-486a-869e-9e358eb4afc9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:05.355617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15bf96a5-4586-486a-869e-9e358eb4afc9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:05.357473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15bf96a5-4586-486a-869e-9e358eb4afc9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:05.358073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15bf96a5-4586-486a-869e-9e358eb4afc9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:05.359568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-160f97f5-3c83-4245-a627-6f53a0217cca tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:05.360879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15bf96a5-4586-486a-869e-9e358eb4afc9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:05.370715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-160f97f5-3c83-4245-a627-6f53a0217cca tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:05.385223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-160f97f5-3c83-4245-a627-6f53a0217cca tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:05.393292 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-160f97f5-3c83-4245-a627-6f53a0217cca tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1602 microversion: 2.32 time: 0.522093 Oct 10 23:34:05.437118 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1926/3742] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:04 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1602 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:05.443052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-07cfd86f-7db2-4f02-9788-03094e29e2da tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] Calling method '.version_select at 0x7f662ae56670>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:05.790993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-15bf96a5-4586-486a-869e-9e358eb4afc9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:05.802049 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-15bf96a5-4586-486a-869e-9e358eb4afc9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:05.819111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-15bf96a5-4586-486a-869e-9e358eb4afc9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:05.823884 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-15bf96a5-4586-486a-869e-9e358eb4afc9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1740 microversion: 2.20 time: 0.502536 Oct 10 23:34:05.827634 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1817/3743] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:05 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1740 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:05.842988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5f0629e6-d6c4-492c-a6e9-5730a1c0e11c tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:05.859318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5f0629e6-d6c4-492c-a6e9-5730a1c0e11c tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:05.884027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f0629e6-d6c4-492c-a6e9-5730a1c0e11c tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:05.885646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f0629e6-d6c4-492c-a6e9-5730a1c0e11c tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:05.887188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f0629e6-d6c4-492c-a6e9-5730a1c0e11c tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:05.893645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f0629e6-d6c4-492c-a6e9-5730a1c0e11c tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:05.894464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f0629e6-d6c4-492c-a6e9-5730a1c0e11c tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:05.896400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f0629e6-d6c4-492c-a6e9-5730a1c0e11c tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:06.193642 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-07cfd86f-7db2-4f02-9788-03094e29e2da tempest-ListImageFiltersTestJSON-189026498 tempest-ListImageFiltersTestJSON-189026498-project] 10.222.0.23 "DELETE /compute/v2.1/images/848be340-53fe-495b-82cf-77a5db3a3498" status: 204 len: 0 microversion: 2.1 time: 0.754038 Oct 10 23:34:06.194963 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1927/3744] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:05 2022] DELETE /compute/v2.1/images/848be340-53fe-495b-82cf-77a5db3a3498 => generated 0 bytes in 757 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:34:06.221625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a171b4d9-5df0-49a9-ad50-ff7012a649cb tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:06.222408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a171b4d9-5df0-49a9-ad50-ff7012a649cb tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:06.253185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a171b4d9-5df0-49a9-ad50-ff7012a649cb tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:06.253819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a171b4d9-5df0-49a9-ad50-ff7012a649cb tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:06.255645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a171b4d9-5df0-49a9-ad50-ff7012a649cb tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:06.259326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a171b4d9-5df0-49a9-ad50-ff7012a649cb tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:06.273695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a171b4d9-5df0-49a9-ad50-ff7012a649cb tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:06.277106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a171b4d9-5df0-49a9-ad50-ff7012a649cb tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:06.354490 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-a171b4d9-5df0-49a9-ad50-ff7012a649cb tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] HTTP exception thrown: Instance 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 could not be found. Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a171b4d9-5df0-49a9-ad50-ff7012a649cb tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Request method failure captured: Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 HTTP/1.1 Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKsbr-nQ-8ykeAZLQ9zASh20ChWgiECH2Zo2uD_QHVx1O4ahuGph2jXyni5JINjuSdbSqfGSglBO76ovEKQYIp7so1ClavwKK7MjMcBvhQP2o410jrQv1DriSRkm8nG98Nn62a2H4nFrFDH4OYOnxXaugxu-yZvNBX9zuYbmLcLvdAY Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: dc49f6458751423bb1175f6fba6d6fdd Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-44369368 Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc49f6458751423bb1175f6fba6d6fdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc49f6458751423bb1175f6fba6d6fdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc49f6458751423bb1175f6fba6d6fdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc49f6458751423bb1175f6fba6d6fdd", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-44369368 Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: dc49f6458751423bb1175f6fba6d6fdd Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-44369368 Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AttachSCSIVolumeTestJSON-44369368-project Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: bf589ecefc364edbb3fbb47fdd18da3e Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-44369368-project Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 could not be found. Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9'} Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 could not be found. Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 could not be found. Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:06.360326 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:34:06.366730 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:06.366730 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:06.366730 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:06.366730 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:34:06.366730 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:34:06.366730 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 could not be found. Oct 10 23:34:06.366730 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:34:06.371253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a171b4d9-5df0-49a9-ad50-ff7012a649cb tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Returning 404 to user: Instance 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:34:06.372510 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a171b4d9-5df0-49a9-ad50-ff7012a649cb tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 404 len: 111 microversion: 2.1 time: 0.176254 Oct 10 23:34:06.382697 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1928/3745] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:06 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:34:06.410358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5f0629e6-d6c4-492c-a6e9-5730a1c0e11c tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:06.418268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-549a6185-751e-428a-9b68-ba77f94cc066 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '.version_select at 0x7f662ae56280>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:06.424805 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5f0629e6-d6c4-492c-a6e9-5730a1c0e11c tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1334 microversion: 2.1 time: 0.594358 Oct 10 23:34:06.437882 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1818/3746] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:05 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1334 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:34:06.461070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aa44ac1b-bfc2-458d-a9dd-81ed3bbb81d9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:06.462245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aa44ac1b-bfc2-458d-a9dd-81ed3bbb81d9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:06.500566 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-549a6185-751e-428a-9b68-ba77f94cc066 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1915257767" status: 202 len: 0 microversion: 2.1 time: 0.113690 Oct 10 23:34:06.501951 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1929/3747] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 10 23:34:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1915257767 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:34:06.514874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa44ac1b-bfc2-458d-a9dd-81ed3bbb81d9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:06.517226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa44ac1b-bfc2-458d-a9dd-81ed3bbb81d9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:06.517860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa44ac1b-bfc2-458d-a9dd-81ed3bbb81d9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:06.521088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa44ac1b-bfc2-458d-a9dd-81ed3bbb81d9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:06.524104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa44ac1b-bfc2-458d-a9dd-81ed3bbb81d9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:06.524659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa44ac1b-bfc2-458d-a9dd-81ed3bbb81d9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:06.854928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-eaacf1d1-26bf-4813-8d7b-b7504e0125c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:06.855864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-eaacf1d1-26bf-4813-8d7b-b7504e0125c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:06.910186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eaacf1d1-26bf-4813-8d7b-b7504e0125c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:06.910797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eaacf1d1-26bf-4813-8d7b-b7504e0125c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:06.911251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eaacf1d1-26bf-4813-8d7b-b7504e0125c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:06.920744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eaacf1d1-26bf-4813-8d7b-b7504e0125c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:06.921259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eaacf1d1-26bf-4813-8d7b-b7504e0125c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:06.921749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eaacf1d1-26bf-4813-8d7b-b7504e0125c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:06.976076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aa44ac1b-bfc2-458d-a9dd-81ed3bbb81d9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:07.013788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aa44ac1b-bfc2-458d-a9dd-81ed3bbb81d9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:07.042257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aa44ac1b-bfc2-458d-a9dd-81ed3bbb81d9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:07.043451 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aa44ac1b-bfc2-458d-a9dd-81ed3bbb81d9 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1602 microversion: 2.32 time: 0.601803 Oct 10 23:34:07.068756 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1819/3748] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:06 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1602 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:07.454138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-91553d3a-4ba6-452b-9e1f-93e3e2d8608f tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:07.455552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-91553d3a-4ba6-452b-9e1f-93e3e2d8608f tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:07.468480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91553d3a-4ba6-452b-9e1f-93e3e2d8608f tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:07.471726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91553d3a-4ba6-452b-9e1f-93e3e2d8608f tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:07.472978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91553d3a-4ba6-452b-9e1f-93e3e2d8608f tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:07.475893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91553d3a-4ba6-452b-9e1f-93e3e2d8608f tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:07.482924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91553d3a-4ba6-452b-9e1f-93e3e2d8608f tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:07.487420 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91553d3a-4ba6-452b-9e1f-93e3e2d8608f tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:07.970978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-eaacf1d1-26bf-4813-8d7b-b7504e0125c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:07.983421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-eaacf1d1-26bf-4813-8d7b-b7504e0125c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:07.987067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-eaacf1d1-26bf-4813-8d7b-b7504e0125c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:07.993683 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-eaacf1d1-26bf-4813-8d7b-b7504e0125c9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1740 microversion: 2.20 time: 1.143205 Oct 10 23:34:07.996513 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1930/3749] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:06 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1740 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:34:08.082975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dc5ec3cc-5126-4f33-bfe1-8ed1ed46e460 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:08.084224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dc5ec3cc-5126-4f33-bfe1-8ed1ed46e460 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:08.100279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc5ec3cc-5126-4f33-bfe1-8ed1ed46e460 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:08.104525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc5ec3cc-5126-4f33-bfe1-8ed1ed46e460 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:08.107689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc5ec3cc-5126-4f33-bfe1-8ed1ed46e460 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:08.111130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc5ec3cc-5126-4f33-bfe1-8ed1ed46e460 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:08.117673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc5ec3cc-5126-4f33-bfe1-8ed1ed46e460 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:08.118204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc5ec3cc-5126-4f33-bfe1-8ed1ed46e460 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:08.527555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dc5ec3cc-5126-4f33-bfe1-8ed1ed46e460 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:08.550050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dc5ec3cc-5126-4f33-bfe1-8ed1ed46e460 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:08.553095 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dc5ec3cc-5126-4f33-bfe1-8ed1ed46e460 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:08.554713 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dc5ec3cc-5126-4f33-bfe1-8ed1ed46e460 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1602 microversion: 2.32 time: 0.476740 Oct 10 23:34:08.558466 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1931/3750] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:08 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1602 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:08.838938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-91553d3a-4ba6-452b-9e1f-93e3e2d8608f tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:08.847188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:34:08.880626 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-91553d3a-4ba6-452b-9e1f-93e3e2d8608f tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1334 microversion: 2.1 time: 1.424205 Oct 10 23:34:08.885479 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1820/3751] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:07 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1334 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:34:09.027376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-484485bf-4077-454e-a884-4e21a5d32c2f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:09.028192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-484485bf-4077-454e-a884-4e21a5d32c2f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:09.050682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-484485bf-4077-454e-a884-4e21a5d32c2f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:09.059725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-484485bf-4077-454e-a884-4e21a5d32c2f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:09.063267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-484485bf-4077-454e-a884-4e21a5d32c2f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:09.072303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-484485bf-4077-454e-a884-4e21a5d32c2f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:09.075927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-484485bf-4077-454e-a884-4e21a5d32c2f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:09.079585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-484485bf-4077-454e-a884-4e21a5d32c2f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:09.603617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a77efe1b-461f-463e-99cd-a7ac1ab24c7e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:09.604335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a77efe1b-461f-463e-99cd-a7ac1ab24c7e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:09.624865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a77efe1b-461f-463e-99cd-a7ac1ab24c7e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:09.625400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a77efe1b-461f-463e-99cd-a7ac1ab24c7e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:09.625876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a77efe1b-461f-463e-99cd-a7ac1ab24c7e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:09.640265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a77efe1b-461f-463e-99cd-a7ac1ab24c7e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:09.640777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a77efe1b-461f-463e-99cd-a7ac1ab24c7e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:09.641218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a77efe1b-461f-463e-99cd-a7ac1ab24c7e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:10.003768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a77efe1b-461f-463e-99cd-a7ac1ab24c7e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:10.026346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a77efe1b-461f-463e-99cd-a7ac1ab24c7e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:10.034682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a77efe1b-461f-463e-99cd-a7ac1ab24c7e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:10.040096 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a77efe1b-461f-463e-99cd-a7ac1ab24c7e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1602 microversion: 2.32 time: 0.442640 Oct 10 23:34:10.042808 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1821/3752] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:09 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1602 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:10.053926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8c3cdbbd-f9b3-4902-9c2c-fc74c3d5f10d tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:10.062706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8c3cdbbd-f9b3-4902-9c2c-fc74c3d5f10d tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:10.083183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c3cdbbd-f9b3-4902-9c2c-fc74c3d5f10d tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:10.090446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c3cdbbd-f9b3-4902-9c2c-fc74c3d5f10d tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:10.093259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c3cdbbd-f9b3-4902-9c2c-fc74c3d5f10d tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:10.095623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c3cdbbd-f9b3-4902-9c2c-fc74c3d5f10d tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:10.097296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c3cdbbd-f9b3-4902-9c2c-fc74c3d5f10d tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:10.099532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c3cdbbd-f9b3-4902-9c2c-fc74c3d5f10d tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:10.377935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-484485bf-4077-454e-a884-4e21a5d32c2f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:10.408884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-484485bf-4077-454e-a884-4e21a5d32c2f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:10.417660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-484485bf-4077-454e-a884-4e21a5d32c2f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:10.418953 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-484485bf-4077-454e-a884-4e21a5d32c2f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1740 microversion: 2.20 time: 1.396739 Oct 10 23:34:10.437413 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1932/3753] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:09 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1740 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:10.889029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8c3cdbbd-f9b3-4902-9c2c-fc74c3d5f10d tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:10.906031 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8c3cdbbd-f9b3-4902-9c2c-fc74c3d5f10d tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1334 microversion: 2.1 time: 0.859704 Oct 10 23:34:10.921996 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1822/3754] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:10 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1334 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:34:11.073780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-73e67a96-32de-48f8-9c9e-bc2f79288023 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:11.074512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-73e67a96-32de-48f8-9c9e-bc2f79288023 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:11.086634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73e67a96-32de-48f8-9c9e-bc2f79288023 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:11.088337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73e67a96-32de-48f8-9c9e-bc2f79288023 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:11.090691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73e67a96-32de-48f8-9c9e-bc2f79288023 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:11.092292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73e67a96-32de-48f8-9c9e-bc2f79288023 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:11.094742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73e67a96-32de-48f8-9c9e-bc2f79288023 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:11.096723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73e67a96-32de-48f8-9c9e-bc2f79288023 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:11.243238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-73e67a96-32de-48f8-9c9e-bc2f79288023 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:11.268235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-73e67a96-32de-48f8-9c9e-bc2f79288023 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:11.270693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-73e67a96-32de-48f8-9c9e-bc2f79288023 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:11.278508 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-73e67a96-32de-48f8-9c9e-bc2f79288023 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1602 microversion: 2.32 time: 0.208658 Oct 10 23:34:11.299877 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1933/3755] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:11 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1602 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:11.452257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-560be016-a951-49b3-b8b6-a4e8fd78750c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:11.452868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-560be016-a951-49b3-b8b6-a4e8fd78750c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:11.471304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-560be016-a951-49b3-b8b6-a4e8fd78750c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:11.471671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-560be016-a951-49b3-b8b6-a4e8fd78750c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:11.473366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-560be016-a951-49b3-b8b6-a4e8fd78750c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:11.480660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-560be016-a951-49b3-b8b6-a4e8fd78750c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:11.481156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-560be016-a951-49b3-b8b6-a4e8fd78750c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:11.482122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-560be016-a951-49b3-b8b6-a4e8fd78750c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:11.734147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-37c2f0d0-67a5-4dc9-a200-2685a86fbf88 tempest-ListImageFiltersNegativeTestJSON-169879169 tempest-ListImageFiltersNegativeTestJSON-169879169-project] Calling method '.version_select at 0x7f662a700550>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:11.775536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-560be016-a951-49b3-b8b6-a4e8fd78750c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:11.788148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-560be016-a951-49b3-b8b6-a4e8fd78750c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:11.789674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-560be016-a951-49b3-b8b6-a4e8fd78750c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:11.791968 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-560be016-a951-49b3-b8b6-a4e8fd78750c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1740 microversion: 2.20 time: 0.344795 Oct 10 23:34:11.804580 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1823/3756] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:11 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1740 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:11.962958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1fe193f9-b651-4777-b50d-a1ced27a56b3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:11.963904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1fe193f9-b651-4777-b50d-a1ced27a56b3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:11.977803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fe193f9-b651-4777-b50d-a1ced27a56b3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:11.978517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fe193f9-b651-4777-b50d-a1ced27a56b3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:11.979225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fe193f9-b651-4777-b50d-a1ced27a56b3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:11.980287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fe193f9-b651-4777-b50d-a1ced27a56b3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:11.981101 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-37c2f0d0-67a5-4dc9-a200-2685a86fbf88 tempest-ListImageFiltersNegativeTestJSON-169879169 tempest-ListImageFiltersNegativeTestJSON-169879169-project] HTTP exception thrown: Image not found. Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-37c2f0d0-67a5-4dc9-a200-2685a86fbf88 tempest-ListImageFiltersNegativeTestJSON-169879169 tempest-ListImageFiltersNegativeTestJSON-169879169-project] Request method failure captured: Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/images/f10b462a-78ab-44d2-a75e-5b23cd1d8183 HTTP/1.1 Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKvzyf7ZeJokSY3OsyEEH-z-E_41zd6xydWMVy0o_GCH7Bq3acBgengpJLx_ChPSU2Og9NLfJ4ktmDi0SoLYUjuhyg0uT_opcRm5xbCVKLFOzigK2EVRSej3dcIGWWQrtmnZybfneaZd82kzc0fb6uAQbCvseEaeTOKeRMX_0pnJcvo Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 30519b179e2f44cd9191ad0f947d1c56 Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-169879169 Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/30519b179e2f44cd9191ad0f947d1c56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30519b179e2f44cd9191ad0f947d1c56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30519b179e2f44cd9191ad0f947d1c56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_30519b179e2f44cd9191ad0f947d1c56", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-169879169 Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 30519b179e2f44cd9191ad0f947d1c56 Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-169879169 Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ListImageFiltersNegativeTestJSON-169879169-project Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: ea3c9f7f635e4ae6b45fcbfe12fa1e56 Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-169879169-project Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: exception: Image not found. Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'f10b462a-78ab-44d2-a75e-5b23cd1d8183'} Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f10b462a-78ab-44d2-a75e-5b23cd1d8183 Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 23:34:11.983310 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f10b462a-78ab-44d2-a75e-5b23cd1d8183 could not be found. Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 23:34:11.989435 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:34:11.993217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fe193f9-b651-4777-b50d-a1ced27a56b3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:11.993217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fe193f9-b651-4777-b50d-a1ced27a56b3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:11.996069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-37c2f0d0-67a5-4dc9-a200-2685a86fbf88 tempest-ListImageFiltersNegativeTestJSON-169879169 tempest-ListImageFiltersNegativeTestJSON-169879169-project] Returning 404 to user: Image not found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:34:11.996069 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-37c2f0d0-67a5-4dc9-a200-2685a86fbf88 tempest-ListImageFiltersNegativeTestJSON-169879169 tempest-ListImageFiltersNegativeTestJSON-169879169-project] 10.222.0.23 "GET /compute/v2.1/images/f10b462a-78ab-44d2-a75e-5b23cd1d8183" status: 404 len: 62 microversion: 2.1 time: 0.538665 Oct 10 23:34:11.996069 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1934/3757] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Oct 10 23:34:11 2022] GET /compute/v2.1/images/f10b462a-78ab-44d2-a75e-5b23cd1d8183 => generated 62 bytes in 540 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 10 23:34:12.310439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f3229277-020a-4b4e-bae4-be785c278951 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:12.313468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f3229277-020a-4b4e-bae4-be785c278951 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:12.339144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3229277-020a-4b4e-bae4-be785c278951 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:12.339770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3229277-020a-4b4e-bae4-be785c278951 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:12.340242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3229277-020a-4b4e-bae4-be785c278951 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:12.341026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3229277-020a-4b4e-bae4-be785c278951 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:12.341627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3229277-020a-4b4e-bae4-be785c278951 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:12.342075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3229277-020a-4b4e-bae4-be785c278951 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:12.480193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1fe193f9-b651-4777-b50d-a1ced27a56b3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:12.496141 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1fe193f9-b651-4777-b50d-a1ced27a56b3 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1334 microversion: 2.1 time: 0.540870 Oct 10 23:34:12.497848 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1824/3758] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:11 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1334 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:34:12.587073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f3229277-020a-4b4e-bae4-be785c278951 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:12.628125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f3229277-020a-4b4e-bae4-be785c278951 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:12.630266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f3229277-020a-4b4e-bae4-be785c278951 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:12.632133 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f3229277-020a-4b4e-bae4-be785c278951 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1602 microversion: 2.32 time: 0.328104 Oct 10 23:34:12.657486 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1935/3759] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:12 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1602 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:12.658001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-91a0ff88-49a6-4091-ba97-837434897769 req-6cab6fc4-f94a-4ab5-9cc0-c5b5fd622954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9a3be2-bbf6-4abd-bbb1-452785322946", "name": "network-vif-plugged", "status": "completed", "tag": "eac62ee6-3195-444b-b747-98b82a33a616"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:34:12.686044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-91a0ff88-49a6-4091-ba97-837434897769 req-6cab6fc4-f94a-4ab5-9cc0-c5b5fd622954 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:12.691151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-91a0ff88-49a6-4091-ba97-837434897769 req-6cab6fc4-f94a-4ab5-9cc0-c5b5fd622954 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:12.691796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-91a0ff88-49a6-4091-ba97-837434897769 req-6cab6fc4-f94a-4ab5-9cc0-c5b5fd622954 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:12.747155 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-91a0ff88-49a6-4091-ba97-837434897769 req-6cab6fc4-f94a-4ab5-9cc0-c5b5fd622954 service nova] Creating event network-vif-plugged:eac62ee6-3195-444b-b747-98b82a33a616 for instance ce9a3be2-bbf6-4abd-bbb1-452785322946 on n-h1-860864-2 Oct 10 23:34:12.761896 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-91a0ff88-49a6-4091-ba97-837434897769 req-6cab6fc4-f94a-4ab5-9cc0-c5b5fd622954 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113902 Oct 10 23:34:12.762564 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1825/3760] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:34:12.824092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-62b9b0bf-c5cb-485c-b5ae-a0af3b67cd04 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:12.824883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-62b9b0bf-c5cb-485c-b5ae-a0af3b67cd04 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:12.838590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62b9b0bf-c5cb-485c-b5ae-a0af3b67cd04 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:12.839096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62b9b0bf-c5cb-485c-b5ae-a0af3b67cd04 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:12.839541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62b9b0bf-c5cb-485c-b5ae-a0af3b67cd04 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:12.840264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62b9b0bf-c5cb-485c-b5ae-a0af3b67cd04 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:12.840737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62b9b0bf-c5cb-485c-b5ae-a0af3b67cd04 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:12.847916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62b9b0bf-c5cb-485c-b5ae-a0af3b67cd04 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:13.247110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-62b9b0bf-c5cb-485c-b5ae-a0af3b67cd04 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:13.278609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-62b9b0bf-c5cb-485c-b5ae-a0af3b67cd04 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:13.282123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-62b9b0bf-c5cb-485c-b5ae-a0af3b67cd04 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:13.286882 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-62b9b0bf-c5cb-485c-b5ae-a0af3b67cd04 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1740 microversion: 2.20 time: 0.468193 Oct 10 23:34:13.287504 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1936/3761] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:12 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1740 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:13.525099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2f51e034-a5f8-4b2f-aaa1-902fc649d216 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:13.526201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2f51e034-a5f8-4b2f-aaa1-902fc649d216 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:13.563869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f51e034-a5f8-4b2f-aaa1-902fc649d216 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:13.564608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f51e034-a5f8-4b2f-aaa1-902fc649d216 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:13.569087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f51e034-a5f8-4b2f-aaa1-902fc649d216 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:13.578992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f51e034-a5f8-4b2f-aaa1-902fc649d216 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:13.580044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f51e034-a5f8-4b2f-aaa1-902fc649d216 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:13.580831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f51e034-a5f8-4b2f-aaa1-902fc649d216 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:13.695723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2e010abd-8217-4630-b045-0430dc1ff1cd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:13.697357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2e010abd-8217-4630-b045-0430dc1ff1cd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:13.742359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e010abd-8217-4630-b045-0430dc1ff1cd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:13.758270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e010abd-8217-4630-b045-0430dc1ff1cd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:13.766902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e010abd-8217-4630-b045-0430dc1ff1cd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:13.768768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e010abd-8217-4630-b045-0430dc1ff1cd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:13.773542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e010abd-8217-4630-b045-0430dc1ff1cd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:13.776602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e010abd-8217-4630-b045-0430dc1ff1cd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:14.066687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2f51e034-a5f8-4b2f-aaa1-902fc649d216 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:14.083472 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2f51e034-a5f8-4b2f-aaa1-902fc649d216 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1334 microversion: 2.1 time: 0.563838 Oct 10 23:34:14.084876 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1826/3762] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:13 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1334 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:34:14.165858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2e010abd-8217-4630-b045-0430dc1ff1cd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:14.192570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2e010abd-8217-4630-b045-0430dc1ff1cd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:14.203119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2e010abd-8217-4630-b045-0430dc1ff1cd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:14.204628 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2e010abd-8217-4630-b045-0430dc1ff1cd tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1602 microversion: 2.32 time: 0.515307 Oct 10 23:34:14.208504 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1937/3763] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:13 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1602 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:34:14.322399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9aed988b-7edb-488e-9422-9383258a4daa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:14.323533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9aed988b-7edb-488e-9422-9383258a4daa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:14.371715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9aed988b-7edb-488e-9422-9383258a4daa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:14.375380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9aed988b-7edb-488e-9422-9383258a4daa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:14.375875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9aed988b-7edb-488e-9422-9383258a4daa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:14.376668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9aed988b-7edb-488e-9422-9383258a4daa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:14.377153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9aed988b-7edb-488e-9422-9383258a4daa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:14.384975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9aed988b-7edb-488e-9422-9383258a4daa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:14.737786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9aed988b-7edb-488e-9422-9383258a4daa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:14.753143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9aed988b-7edb-488e-9422-9383258a4daa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:14.757641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9aed988b-7edb-488e-9422-9383258a4daa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:14.759174 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9aed988b-7edb-488e-9422-9383258a4daa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1740 microversion: 2.20 time: 0.444733 Oct 10 23:34:14.761271 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1827/3764] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:14 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1740 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:15.014615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-3a965430-5948-4f99-8e8b-db3fbd57613e req-252e0c59-fdd2-4c8b-b5fc-ab2f12c207ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9a3be2-bbf6-4abd-bbb1-452785322946", "name": "network-vif-plugged", "status": "completed", "tag": "404743c5-d63d-416d-ae9c-ee2596213ec8"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:34:15.058337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3a965430-5948-4f99-8e8b-db3fbd57613e req-252e0c59-fdd2-4c8b-b5fc-ab2f12c207ef service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:15.079409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3a965430-5948-4f99-8e8b-db3fbd57613e req-252e0c59-fdd2-4c8b-b5fc-ab2f12c207ef service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:15.080238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3a965430-5948-4f99-8e8b-db3fbd57613e req-252e0c59-fdd2-4c8b-b5fc-ab2f12c207ef service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:15.114013 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-86eb692b-7c71-4e10-a65d-f94858ea1480 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:15.115202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-86eb692b-7c71-4e10-a65d-f94858ea1480 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:15.122781 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-3a965430-5948-4f99-8e8b-db3fbd57613e req-252e0c59-fdd2-4c8b-b5fc-ab2f12c207ef service nova] Creating event network-vif-plugged:404743c5-d63d-416d-ae9c-ee2596213ec8 for instance ce9a3be2-bbf6-4abd-bbb1-452785322946 on n-h1-860864-2 Oct 10 23:34:15.125656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86eb692b-7c71-4e10-a65d-f94858ea1480 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:15.127807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86eb692b-7c71-4e10-a65d-f94858ea1480 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:15.130915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86eb692b-7c71-4e10-a65d-f94858ea1480 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:15.132487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86eb692b-7c71-4e10-a65d-f94858ea1480 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:15.133206 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86eb692b-7c71-4e10-a65d-f94858ea1480 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:15.135256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86eb692b-7c71-4e10-a65d-f94858ea1480 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:15.141518 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-3a965430-5948-4f99-8e8b-db3fbd57613e req-252e0c59-fdd2-4c8b-b5fc-ab2f12c207ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131043 Oct 10 23:34:15.142153 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1938/3765] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:34:15.236483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fbb5bf80-10eb-45cb-9bdd-7a235527e74b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:15.238204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fbb5bf80-10eb-45cb-9bdd-7a235527e74b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:15.252395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fbb5bf80-10eb-45cb-9bdd-7a235527e74b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:15.253415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fbb5bf80-10eb-45cb-9bdd-7a235527e74b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:15.260223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fbb5bf80-10eb-45cb-9bdd-7a235527e74b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:15.261224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fbb5bf80-10eb-45cb-9bdd-7a235527e74b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:15.263533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fbb5bf80-10eb-45cb-9bdd-7a235527e74b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:15.265974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fbb5bf80-10eb-45cb-9bdd-7a235527e74b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:15.539986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fbb5bf80-10eb-45cb-9bdd-7a235527e74b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:15.558699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fbb5bf80-10eb-45cb-9bdd-7a235527e74b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:15.560546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fbb5bf80-10eb-45cb-9bdd-7a235527e74b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:15.566002 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fbb5bf80-10eb-45cb-9bdd-7a235527e74b tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1602 microversion: 2.32 time: 0.331573 Oct 10 23:34:15.583052 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1939/3766] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:15 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1602 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:34:15.599577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-86eb692b-7c71-4e10-a65d-f94858ea1480 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:15.614869 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-86eb692b-7c71-4e10-a65d-f94858ea1480 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1334 microversion: 2.1 time: 0.506284 Oct 10 23:34:15.615750 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1828/3767] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:15 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1334 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:34:15.791424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2d77fbaf-ded2-4b8a-8d22-a04c620d3bb2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:15.792552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2d77fbaf-ded2-4b8a-8d22-a04c620d3bb2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:15.805596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d77fbaf-ded2-4b8a-8d22-a04c620d3bb2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:15.806397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d77fbaf-ded2-4b8a-8d22-a04c620d3bb2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:15.807014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d77fbaf-ded2-4b8a-8d22-a04c620d3bb2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:15.807960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d77fbaf-ded2-4b8a-8d22-a04c620d3bb2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:15.808590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d77fbaf-ded2-4b8a-8d22-a04c620d3bb2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:15.812463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d77fbaf-ded2-4b8a-8d22-a04c620d3bb2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:16.136921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2d77fbaf-ded2-4b8a-8d22-a04c620d3bb2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:16.148564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2d77fbaf-ded2-4b8a-8d22-a04c620d3bb2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:16.154737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2d77fbaf-ded2-4b8a-8d22-a04c620d3bb2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:16.156035 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2d77fbaf-ded2-4b8a-8d22-a04c620d3bb2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1740 microversion: 2.20 time: 0.368581 Oct 10 23:34:16.177781 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1940/3768] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:15 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1740 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:16.599537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9de64711-c2e4-4cde-8b58-a90c12fb473d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:16.600237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9de64711-c2e4-4cde-8b58-a90c12fb473d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:16.620786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9de64711-c2e4-4cde-8b58-a90c12fb473d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:16.620786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9de64711-c2e4-4cde-8b58-a90c12fb473d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:16.620786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9de64711-c2e4-4cde-8b58-a90c12fb473d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:16.620786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9de64711-c2e4-4cde-8b58-a90c12fb473d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:16.631940 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9de64711-c2e4-4cde-8b58-a90c12fb473d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:16.631940 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9de64711-c2e4-4cde-8b58-a90c12fb473d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:16.643932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-10d3bea2-9999-4327-ad0d-b234aace5a2e tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:16.648469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-10d3bea2-9999-4327-ad0d-b234aace5a2e tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:16.664360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10d3bea2-9999-4327-ad0d-b234aace5a2e tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:16.666233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10d3bea2-9999-4327-ad0d-b234aace5a2e tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:16.669899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10d3bea2-9999-4327-ad0d-b234aace5a2e tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:16.671113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10d3bea2-9999-4327-ad0d-b234aace5a2e tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:16.679271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10d3bea2-9999-4327-ad0d-b234aace5a2e tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:16.686230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10d3bea2-9999-4327-ad0d-b234aace5a2e tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:16.832859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9de64711-c2e4-4cde-8b58-a90c12fb473d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:16.859384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9de64711-c2e4-4cde-8b58-a90c12fb473d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:16.868312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9de64711-c2e4-4cde-8b58-a90c12fb473d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:16.873086 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9de64711-c2e4-4cde-8b58-a90c12fb473d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1602 microversion: 2.32 time: 0.277828 Oct 10 23:34:16.893278 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1829/3769] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:16 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1602 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:17.190016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-04215fbd-01de-4ef5-acf0-da092831afc5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:17.192007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-04215fbd-01de-4ef5-acf0-da092831afc5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:17.204525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:34:17.209039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04215fbd-01de-4ef5-acf0-da092831afc5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:17.211725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04215fbd-01de-4ef5-acf0-da092831afc5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:17.213304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04215fbd-01de-4ef5-acf0-da092831afc5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:17.221806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04215fbd-01de-4ef5-acf0-da092831afc5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:17.223755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04215fbd-01de-4ef5-acf0-da092831afc5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:17.224656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04215fbd-01de-4ef5-acf0-da092831afc5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:17.257537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-10d3bea2-9999-4327-ad0d-b234aace5a2e tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:17.279742 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-10d3bea2-9999-4327-ad0d-b234aace5a2e tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1334 microversion: 2.1 time: 0.640500 Oct 10 23:34:17.302558 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1941/3770] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:16 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1334 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:34:17.547388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-04215fbd-01de-4ef5-acf0-da092831afc5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:17.562489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-04215fbd-01de-4ef5-acf0-da092831afc5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:17.569836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-04215fbd-01de-4ef5-acf0-da092831afc5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:17.573932 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-04215fbd-01de-4ef5-acf0-da092831afc5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1740 microversion: 2.20 time: 0.388110 Oct 10 23:34:17.581519 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1830/3771] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:17 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1740 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:34:17.919386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-368c1719-418c-42b9-97b7-aebe6b66afe4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:17.957764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-368c1719-418c-42b9-97b7-aebe6b66afe4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:17.981023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-368c1719-418c-42b9-97b7-aebe6b66afe4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:17.984467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-368c1719-418c-42b9-97b7-aebe6b66afe4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:17.989596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-368c1719-418c-42b9-97b7-aebe6b66afe4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:17.991358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-368c1719-418c-42b9-97b7-aebe6b66afe4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:17.994347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-368c1719-418c-42b9-97b7-aebe6b66afe4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:17.995909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-368c1719-418c-42b9-97b7-aebe6b66afe4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:18.314364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d72ccd47-28eb-437a-806d-48ac369ba508 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:18.315742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d72ccd47-28eb-437a-806d-48ac369ba508 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:18.334959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d72ccd47-28eb-437a-806d-48ac369ba508 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:18.335449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d72ccd47-28eb-437a-806d-48ac369ba508 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:18.336016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d72ccd47-28eb-437a-806d-48ac369ba508 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:18.336744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d72ccd47-28eb-437a-806d-48ac369ba508 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:18.337337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d72ccd47-28eb-437a-806d-48ac369ba508 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:18.337805 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d72ccd47-28eb-437a-806d-48ac369ba508 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:18.376182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-368c1719-418c-42b9-97b7-aebe6b66afe4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:18.396640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-368c1719-418c-42b9-97b7-aebe6b66afe4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:18.405405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-368c1719-418c-42b9-97b7-aebe6b66afe4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:18.409760 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-368c1719-418c-42b9-97b7-aebe6b66afe4 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1602 microversion: 2.32 time: 0.502843 Oct 10 23:34:18.417256 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1942/3772] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:17 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1602 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:18.693761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e1dcadcc-cbc1-4a46-b53b-7294c7c9e4d2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:18.695731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e1dcadcc-cbc1-4a46-b53b-7294c7c9e4d2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:18.716655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1dcadcc-cbc1-4a46-b53b-7294c7c9e4d2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:18.717686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1dcadcc-cbc1-4a46-b53b-7294c7c9e4d2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:18.718415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1dcadcc-cbc1-4a46-b53b-7294c7c9e4d2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:18.719551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1dcadcc-cbc1-4a46-b53b-7294c7c9e4d2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:18.720414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1dcadcc-cbc1-4a46-b53b-7294c7c9e4d2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:18.721160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1dcadcc-cbc1-4a46-b53b-7294c7c9e4d2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:18.894037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d72ccd47-28eb-437a-806d-48ac369ba508 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:18.907772 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d72ccd47-28eb-437a-806d-48ac369ba508 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1670 microversion: 2.1 time: 0.600215 Oct 10 23:34:18.928004 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1831/3773] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:18 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1670 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:34:18.933663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d61d0880-03a2-47fc-94da-18cba2f2685a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:18.934425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d61d0880-03a2-47fc-94da-18cba2f2685a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:18.957350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d61d0880-03a2-47fc-94da-18cba2f2685a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:18.958221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d61d0880-03a2-47fc-94da-18cba2f2685a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:18.958947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d61d0880-03a2-47fc-94da-18cba2f2685a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:18.959838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d61d0880-03a2-47fc-94da-18cba2f2685a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:18.960466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d61d0880-03a2-47fc-94da-18cba2f2685a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:18.961076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d61d0880-03a2-47fc-94da-18cba2f2685a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:18.990803 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d61d0880-03a2-47fc-94da-18cba2f2685a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946/ips" status: 200 len: 180 microversion: 2.1 time: 0.061027 Oct 10 23:34:18.991651 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1832/3774] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 10 23:34:18 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946/ips => generated 180 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:34:19.004652 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7afbc3f3-4007-4c9c-b337-0a54c98418b2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:19.005587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7afbc3f3-4007-4c9c-b337-0a54c98418b2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:19.012609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7afbc3f3-4007-4c9c-b337-0a54c98418b2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:19.013343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7afbc3f3-4007-4c9c-b337-0a54c98418b2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:19.013964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7afbc3f3-4007-4c9c-b337-0a54c98418b2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:19.015002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7afbc3f3-4007-4c9c-b337-0a54c98418b2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:19.015631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7afbc3f3-4007-4c9c-b337-0a54c98418b2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:19.016223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7afbc3f3-4007-4c9c-b337-0a54c98418b2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:19.052533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7afbc3f3-4007-4c9c-b337-0a54c98418b2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:34:19.186398 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7afbc3f3-4007-4c9c-b337-0a54c98418b2 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 204 len: 0 microversion: 2.1 time: 0.185754 Oct 10 23:34:19.192147 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1833/3775] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:34:18 2022] DELETE /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:34:19.206520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aa4aa9d1-8927-4819-b1a9-97fdc7e0e87a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:19.209762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aa4aa9d1-8927-4819-b1a9-97fdc7e0e87a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:19.237733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa4aa9d1-8927-4819-b1a9-97fdc7e0e87a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:19.238185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa4aa9d1-8927-4819-b1a9-97fdc7e0e87a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:19.238849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa4aa9d1-8927-4819-b1a9-97fdc7e0e87a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:19.239864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa4aa9d1-8927-4819-b1a9-97fdc7e0e87a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:19.240323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa4aa9d1-8927-4819-b1a9-97fdc7e0e87a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:19.240763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa4aa9d1-8927-4819-b1a9-97fdc7e0e87a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:19.481718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e1dcadcc-cbc1-4a46-b53b-7294c7c9e4d2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:19.491121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e1dcadcc-cbc1-4a46-b53b-7294c7c9e4d2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:19.492601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e1dcadcc-cbc1-4a46-b53b-7294c7c9e4d2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:19.500171 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e1dcadcc-cbc1-4a46-b53b-7294c7c9e4d2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1722 microversion: 2.20 time: 0.813392 Oct 10 23:34:19.510572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aa4aa9d1-8927-4819-b1a9-97fdc7e0e87a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:19.511173 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1943/3776] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:18 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1722 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:19.513440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-58b6128a-86e1-448d-b923-276b9f9fc39d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:19.514078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-58b6128a-86e1-448d-b923-276b9f9fc39d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:19.518019 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aa4aa9d1-8927-4819-b1a9-97fdc7e0e87a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1676 microversion: 2.1 time: 0.321143 Oct 10 23:34:19.527195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58b6128a-86e1-448d-b923-276b9f9fc39d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:19.527707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58b6128a-86e1-448d-b923-276b9f9fc39d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:19.528149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58b6128a-86e1-448d-b923-276b9f9fc39d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:19.528867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58b6128a-86e1-448d-b923-276b9f9fc39d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:19.529324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58b6128a-86e1-448d-b923-276b9f9fc39d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:19.529935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58b6128a-86e1-448d-b923-276b9f9fc39d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:19.533052 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1834/3777] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:19 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1676 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:34:20.138785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-58b6128a-86e1-448d-b923-276b9f9fc39d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:20.161157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-58b6128a-86e1-448d-b923-276b9f9fc39d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:20.166461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-58b6128a-86e1-448d-b923-276b9f9fc39d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:20.170396 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-58b6128a-86e1-448d-b923-276b9f9fc39d tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1602 microversion: 2.32 time: 0.665814 Oct 10 23:34:20.173164 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1944/3778] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:19 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1602 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:20.287510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-abd97e4a-d30a-4d9a-915f-aabe13a5094c req-766c6e7a-3777-4e2e-b05f-60713ee9f01a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bd745fa-6826-4bd1-8f8d-ae65071fac12", "name": "network-vif-unplugged", "status": "completed", "tag": "9a900297-53e2-4782-8def-24d4260702d5"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:34:20.348820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-abd97e4a-d30a-4d9a-915f-aabe13a5094c req-766c6e7a-3777-4e2e-b05f-60713ee9f01a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:20.350310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-abd97e4a-d30a-4d9a-915f-aabe13a5094c req-766c6e7a-3777-4e2e-b05f-60713ee9f01a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:20.351651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-abd97e4a-d30a-4d9a-915f-aabe13a5094c req-766c6e7a-3777-4e2e-b05f-60713ee9f01a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:20.383328 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-abd97e4a-d30a-4d9a-915f-aabe13a5094c req-766c6e7a-3777-4e2e-b05f-60713ee9f01a service nova] Creating event network-vif-unplugged:9a900297-53e2-4782-8def-24d4260702d5 for instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 on n-h1-860864-2 Oct 10 23:34:20.395315 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-abd97e4a-d30a-4d9a-915f-aabe13a5094c req-766c6e7a-3777-4e2e-b05f-60713ee9f01a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113757 Oct 10 23:34:20.397308 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1835/3779] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:34:20.531116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-226858ce-6c4c-469a-80c1-249e08e9f6ea tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:20.532143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-226858ce-6c4c-469a-80c1-249e08e9f6ea tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:20.549974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-26ffeff3-0835-43ed-a29e-a0441579bcdd tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:20.551076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-26ffeff3-0835-43ed-a29e-a0441579bcdd tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:20.570031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26ffeff3-0835-43ed-a29e-a0441579bcdd tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:20.570576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26ffeff3-0835-43ed-a29e-a0441579bcdd tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:20.571038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26ffeff3-0835-43ed-a29e-a0441579bcdd tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:20.571790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26ffeff3-0835-43ed-a29e-a0441579bcdd tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:20.572488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26ffeff3-0835-43ed-a29e-a0441579bcdd tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:20.572932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26ffeff3-0835-43ed-a29e-a0441579bcdd tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:20.574926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-226858ce-6c4c-469a-80c1-249e08e9f6ea tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:20.575742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-226858ce-6c4c-469a-80c1-249e08e9f6ea tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:20.576467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-226858ce-6c4c-469a-80c1-249e08e9f6ea tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:20.577824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-226858ce-6c4c-469a-80c1-249e08e9f6ea tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:20.578611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-226858ce-6c4c-469a-80c1-249e08e9f6ea tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:20.579421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-226858ce-6c4c-469a-80c1-249e08e9f6ea tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:21.104461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-26ffeff3-0835-43ed-a29e-a0441579bcdd tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:21.117959 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-26ffeff3-0835-43ed-a29e-a0441579bcdd tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1676 microversion: 2.1 time: 0.573408 Oct 10 23:34:21.130654 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1836/3780] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:20 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1676 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:34:21.204504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-01f35fe3-c206-4950-a561-351e878b6437 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:21.205619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-01f35fe3-c206-4950-a561-351e878b6437 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:21.228205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01f35fe3-c206-4950-a561-351e878b6437 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:21.229240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01f35fe3-c206-4950-a561-351e878b6437 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:21.232406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01f35fe3-c206-4950-a561-351e878b6437 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:21.234252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01f35fe3-c206-4950-a561-351e878b6437 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:21.239152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01f35fe3-c206-4950-a561-351e878b6437 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:21.254935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01f35fe3-c206-4950-a561-351e878b6437 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:21.285635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-226858ce-6c4c-469a-80c1-249e08e9f6ea tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:21.291844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:34:21.334294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-226858ce-6c4c-469a-80c1-249e08e9f6ea tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:21.337154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-226858ce-6c4c-469a-80c1-249e08e9f6ea tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:21.346257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:34:21.348059 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-226858ce-6c4c-469a-80c1-249e08e9f6ea tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1722 microversion: 2.20 time: 0.814713 Oct 10 23:34:21.359490 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1945/3781] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:20 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1722 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:21.484889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-01f35fe3-c206-4950-a561-351e878b6437 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:21.510240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-01f35fe3-c206-4950-a561-351e878b6437 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:21.515097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-01f35fe3-c206-4950-a561-351e878b6437 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:21.518605 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-01f35fe3-c206-4950-a561-351e878b6437 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1602 microversion: 2.32 time: 0.318234 Oct 10 23:34:21.540976 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1837/3782] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:21 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1602 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:34:22.147263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c7efdbe7-4cd7-46bc-b659-777a8074f95b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:22.147898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c7efdbe7-4cd7-46bc-b659-777a8074f95b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:22.167985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7efdbe7-4cd7-46bc-b659-777a8074f95b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:22.177430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7efdbe7-4cd7-46bc-b659-777a8074f95b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:22.178215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7efdbe7-4cd7-46bc-b659-777a8074f95b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:22.181608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7efdbe7-4cd7-46bc-b659-777a8074f95b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:22.186701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7efdbe7-4cd7-46bc-b659-777a8074f95b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:22.195970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7efdbe7-4cd7-46bc-b659-777a8074f95b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:22.380401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8e70d2ad-db16-4990-bdd8-5a8a82106180 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:22.381018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8e70d2ad-db16-4990-bdd8-5a8a82106180 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:22.394140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e70d2ad-db16-4990-bdd8-5a8a82106180 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:22.395180 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e70d2ad-db16-4990-bdd8-5a8a82106180 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:22.395644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e70d2ad-db16-4990-bdd8-5a8a82106180 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:22.396369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e70d2ad-db16-4990-bdd8-5a8a82106180 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:22.396822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e70d2ad-db16-4990-bdd8-5a8a82106180 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:22.397247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e70d2ad-db16-4990-bdd8-5a8a82106180 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:23.095298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c7efdbe7-4cd7-46bc-b659-777a8074f95b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:23.112841 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c7efdbe7-4cd7-46bc-b659-777a8074f95b tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1676 microversion: 2.1 time: 0.969969 Oct 10 23:34:23.115002 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1946/3783] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:22 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1676 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:34:23.138436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7f8852f0-1314-488d-9ac2-e64ea6312a8f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:23.142821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7f8852f0-1314-488d-9ac2-e64ea6312a8f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:23.170381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f8852f0-1314-488d-9ac2-e64ea6312a8f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:23.178829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f8852f0-1314-488d-9ac2-e64ea6312a8f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:23.179894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f8852f0-1314-488d-9ac2-e64ea6312a8f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:23.181619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f8852f0-1314-488d-9ac2-e64ea6312a8f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:23.184513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f8852f0-1314-488d-9ac2-e64ea6312a8f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:23.197479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f8852f0-1314-488d-9ac2-e64ea6312a8f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:23.237210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8e70d2ad-db16-4990-bdd8-5a8a82106180 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:23.275709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8e70d2ad-db16-4990-bdd8-5a8a82106180 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:23.296229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8e70d2ad-db16-4990-bdd8-5a8a82106180 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:23.302357 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8e70d2ad-db16-4990-bdd8-5a8a82106180 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1725 microversion: 2.20 time: 0.926327 Oct 10 23:34:23.318665 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1838/3784] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:22 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1725 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:23.338639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a870290c-53f5-4143-9ec1-1a4455ed7665 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4579f6f8-eb27-4d9b-9414-3e169eabf935"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:34:23.348371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a870290c-53f5-4143-9ec1-1a4455ed7665 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:23.355765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a870290c-53f5-4143-9ec1-1a4455ed7665 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:23.363868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a870290c-53f5-4143-9ec1-1a4455ed7665 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:23.364756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a870290c-53f5-4143-9ec1-1a4455ed7665 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:23.365795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a870290c-53f5-4143-9ec1-1a4455ed7665 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:23.366531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a870290c-53f5-4143-9ec1-1a4455ed7665 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:23.368363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a870290c-53f5-4143-9ec1-1a4455ed7665 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:23.453042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7f8852f0-1314-488d-9ac2-e64ea6312a8f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:23.505167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7f8852f0-1314-488d-9ac2-e64ea6312a8f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:23.536927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7f8852f0-1314-488d-9ac2-e64ea6312a8f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:23.556543 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7f8852f0-1314-488d-9ac2-e64ea6312a8f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1602 microversion: 2.32 time: 0.433315 Oct 10 23:34:23.569084 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1947/3785] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:23 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1602 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:24.147116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f4a11a1a-4673-4db5-b7dd-fac2995f35a8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:24.148121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f4a11a1a-4673-4db5-b7dd-fac2995f35a8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:24.178970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4a11a1a-4673-4db5-b7dd-fac2995f35a8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:24.180223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4a11a1a-4673-4db5-b7dd-fac2995f35a8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:24.181173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4a11a1a-4673-4db5-b7dd-fac2995f35a8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:24.182172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4a11a1a-4673-4db5-b7dd-fac2995f35a8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:24.182874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4a11a1a-4673-4db5-b7dd-fac2995f35a8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:24.183557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4a11a1a-4673-4db5-b7dd-fac2995f35a8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:24.504687 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a870290c-53f5-4143-9ec1-1a4455ed7665 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "POST /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.170222 Oct 10 23:34:24.515239 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1839/3786] 10.222.0.23 () {62 vars in 1364 bytes} [Mon Oct 10 23:34:23 2022] POST /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-volume_attachments => generated 188 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:34:24.568342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f4a11a1a-4673-4db5-b7dd-fac2995f35a8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:24.577465 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f4a11a1a-4673-4db5-b7dd-fac2995f35a8 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1676 microversion: 2.1 time: 0.438613 Oct 10 23:34:24.587788 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1948/3787] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:24 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1676 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:34:24.597204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-acf0a3f9-7d9f-4018-adfc-5a523697b71e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:24.598585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-acf0a3f9-7d9f-4018-adfc-5a523697b71e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:24.622379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf0a3f9-7d9f-4018-adfc-5a523697b71e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:24.622978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf0a3f9-7d9f-4018-adfc-5a523697b71e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:24.623441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf0a3f9-7d9f-4018-adfc-5a523697b71e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:24.629700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf0a3f9-7d9f-4018-adfc-5a523697b71e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:24.632116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf0a3f9-7d9f-4018-adfc-5a523697b71e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:24.632817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf0a3f9-7d9f-4018-adfc-5a523697b71e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:24.949708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-acf0a3f9-7d9f-4018-adfc-5a523697b71e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:24.973001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-acf0a3f9-7d9f-4018-adfc-5a523697b71e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:24.994212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-acf0a3f9-7d9f-4018-adfc-5a523697b71e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:24.995828 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-acf0a3f9-7d9f-4018-adfc-5a523697b71e tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1602 microversion: 2.32 time: 0.404263 Oct 10 23:34:24.996659 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1840/3788] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:24 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1602 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:25.338226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-09406bc9-db99-46f9-af9c-9120569382c1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:34:25.345648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6ef1257a-dbbc-4e68-a652-b3c215405a82 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:25.346254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6ef1257a-dbbc-4e68-a652-b3c215405a82 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:25.349642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-09406bc9-db99-46f9-af9c-9120569382c1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:25.362805 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ef1257a-dbbc-4e68-a652-b3c215405a82 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:25.364415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ef1257a-dbbc-4e68-a652-b3c215405a82 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:25.365163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ef1257a-dbbc-4e68-a652-b3c215405a82 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:25.384026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09406bc9-db99-46f9-af9c-9120569382c1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:25.384548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09406bc9-db99-46f9-af9c-9120569382c1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:25.385008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09406bc9-db99-46f9-af9c-9120569382c1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:25.385808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09406bc9-db99-46f9-af9c-9120569382c1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:25.386283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09406bc9-db99-46f9-af9c-9120569382c1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:25.386727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09406bc9-db99-46f9-af9c-9120569382c1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:25.390461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ef1257a-dbbc-4e68-a652-b3c215405a82 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:25.390974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ef1257a-dbbc-4e68-a652-b3c215405a82 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:25.391437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ef1257a-dbbc-4e68-a652-b3c215405a82 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:25.444628 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-6ef1257a-dbbc-4e68-a652-b3c215405a82 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] HTTP exception thrown: Instance 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 could not be found. Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6ef1257a-dbbc-4e68-a652-b3c215405a82 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Request method failure captured: Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 HTTP/1.1 Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKsbr-nQ-8ykeAZLQ9zASh20ChWgiECH2Zo2uD_QHVx1O4ahuGph2jXyni5JINjuSdbSqfGSglBO76ovEKQYIp7so1ClavwKK7MjMcBvhQP2o410jrQv1DriSRkm8nG98Nn62a2H4nFrFDH4OYOnxXaugxu-yZvNBX9zuYbmLcLvdAY Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: dc49f6458751423bb1175f6fba6d6fdd Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-44369368 Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc49f6458751423bb1175f6fba6d6fdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc49f6458751423bb1175f6fba6d6fdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc49f6458751423bb1175f6fba6d6fdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc49f6458751423bb1175f6fba6d6fdd", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-44369368 Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: dc49f6458751423bb1175f6fba6d6fdd Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-44369368 Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AttachSCSIVolumeTestJSON-44369368-project Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: bf589ecefc364edbb3fbb47fdd18da3e Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-44369368-project Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 could not be found. Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9'} Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 could not be found. Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:34:25.459180 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:34:25.465028 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 could not be found. Oct 10 23:34:25.465028 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:25.465028 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:25.465028 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:25.465028 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:25.465028 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:25.465028 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:25.465028 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:34:25.465028 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:34:25.465028 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 could not be found. Oct 10 23:34:25.465028 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:25.471016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6ef1257a-dbbc-4e68-a652-b3c215405a82 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Returning 404 to user: Instance 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:34:25.478385 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6ef1257a-dbbc-4e68-a652-b3c215405a82 tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 404 len: 111 microversion: 2.1 time: 0.138971 Oct 10 23:34:25.479605 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1841/3789] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:34:25 2022] DELETE /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:34:25.490616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-e0878939-dc65-4988-acbe-14b5d62bd354 req-1afe9585-c282-45d3-8a6f-71ea4a7f571b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9a3be2-bbf6-4abd-bbb1-452785322946", "name": "network-vif-deleted", "tag": "404743c5-d63d-416d-ae9c-ee2596213ec8"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:34:25.511603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e0878939-dc65-4988-acbe-14b5d62bd354 req-1afe9585-c282-45d3-8a6f-71ea4a7f571b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:25.513938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-09406bc9-db99-46f9-af9c-9120569382c1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120613) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 10 23:34:25.522199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e0878939-dc65-4988-acbe-14b5d62bd354 req-1afe9585-c282-45d3-8a6f-71ea4a7f571b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:25.523004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e0878939-dc65-4988-acbe-14b5d62bd354 req-1afe9585-c282-45d3-8a6f-71ea4a7f571b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:25.549043 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-e0878939-dc65-4988-acbe-14b5d62bd354 req-1afe9585-c282-45d3-8a6f-71ea4a7f571b service nova] Creating event network-vif-deleted:404743c5-d63d-416d-ae9c-ee2596213ec8 for instance ce9a3be2-bbf6-4abd-bbb1-452785322946 on n-h1-860864-2 Oct 10 23:34:25.569951 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-e0878939-dc65-4988-acbe-14b5d62bd354 req-1afe9585-c282-45d3-8a6f-71ea4a7f571b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084337 Oct 10 23:34:25.572062 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1842/3790] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:34:25.587873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c9959d43-d60d-46e0-a1a6-d630609a5f2f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:25.588733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c9959d43-d60d-46e0-a1a6-d630609a5f2f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] [instance: 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:25.610149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9959d43-d60d-46e0-a1a6-d630609a5f2f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:25.610997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9959d43-d60d-46e0-a1a6-d630609a5f2f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:25.611679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9959d43-d60d-46e0-a1a6-d630609a5f2f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:25.614825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9959d43-d60d-46e0-a1a6-d630609a5f2f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:25.615851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9959d43-d60d-46e0-a1a6-d630609a5f2f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:25.617119 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9959d43-d60d-46e0-a1a6-d630609a5f2f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:25.635116 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-c9959d43-d60d-46e0-a1a6-d630609a5f2f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] HTTP exception thrown: Instance 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 could not be found. Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c9959d43-d60d-46e0-a1a6-d630609a5f2f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Request method failure captured: Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 HTTP/1.1 Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKsbr-nQ-8ykeAZLQ9zASh20ChWgiECH2Zo2uD_QHVx1O4ahuGph2jXyni5JINjuSdbSqfGSglBO76ovEKQYIp7so1ClavwKK7MjMcBvhQP2o410jrQv1DriSRkm8nG98Nn62a2H4nFrFDH4OYOnxXaugxu-yZvNBX9zuYbmLcLvdAY Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: dc49f6458751423bb1175f6fba6d6fdd Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-44369368 Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc49f6458751423bb1175f6fba6d6fdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc49f6458751423bb1175f6fba6d6fdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc49f6458751423bb1175f6fba6d6fdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc49f6458751423bb1175f6fba6d6fdd", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-44369368 Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: dc49f6458751423bb1175f6fba6d6fdd Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-44369368 Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AttachSCSIVolumeTestJSON-44369368-project Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: bf589ecefc364edbb3fbb47fdd18da3e Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-44369368-project Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 could not be found. Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9'} Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 could not be found. Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 could not be found. Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:25.637719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:25.642987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:25.642987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:25.642987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:25.642987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:34:25.642987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:34:25.642987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 could not be found. Oct 10 23:34:25.642987 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:25.647631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c9959d43-d60d-46e0-a1a6-d630609a5f2f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] Returning 404 to user: Instance 8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:34:25.648922 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c9959d43-d60d-46e0-a1a6-d630609a5f2f tempest-AttachSCSIVolumeTestJSON-44369368 tempest-AttachSCSIVolumeTestJSON-44369368-project] 10.222.0.23 "GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9" status: 404 len: 111 microversion: 2.1 time: 0.075316 Oct 10 23:34:25.649901 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1843/3791] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:25 2022] GET /compute/v2.1/servers/8b5ba1d3-e580-4c72-bf7f-688b1df1fbd9 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:34:25.663414 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-09406bc9-db99-46f9-af9c-9120569382c1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "POST /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/action" status: 202 len: 0 microversion: 2.20 time: 0.336651 Oct 10 23:34:25.664476 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1949/3792] 10.222.0.23 () {62 vars in 1319 bytes} [Mon Oct 10 23:34:25 2022] POST /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:34:25.669792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-25172f8b-0fb9-40c1-b75b-8428cc6183f0 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:25.673286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9333af76-dbba-48e1-bed9-156aa6c9f2d0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:25.674543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-25172f8b-0fb9-40c1-b75b-8428cc6183f0 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:25.679275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9333af76-dbba-48e1-bed9-156aa6c9f2d0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:25.690679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25172f8b-0fb9-40c1-b75b-8428cc6183f0 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:25.693752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25172f8b-0fb9-40c1-b75b-8428cc6183f0 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:25.695993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25172f8b-0fb9-40c1-b75b-8428cc6183f0 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:25.700745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25172f8b-0fb9-40c1-b75b-8428cc6183f0 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:25.701389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25172f8b-0fb9-40c1-b75b-8428cc6183f0 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:25.701955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25172f8b-0fb9-40c1-b75b-8428cc6183f0 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:25.706260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9333af76-dbba-48e1-bed9-156aa6c9f2d0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:25.714366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9333af76-dbba-48e1-bed9-156aa6c9f2d0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:25.714776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9333af76-dbba-48e1-bed9-156aa6c9f2d0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:25.715514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9333af76-dbba-48e1-bed9-156aa6c9f2d0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:25.715993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9333af76-dbba-48e1-bed9-156aa6c9f2d0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:25.716557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9333af76-dbba-48e1-bed9-156aa6c9f2d0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:26.437207 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-25172f8b-0fb9-40c1-b75b-8428cc6183f0 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:26.450165 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-25172f8b-0fb9-40c1-b75b-8428cc6183f0 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1496 microversion: 2.1 time: 0.783384 Oct 10 23:34:26.450165 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1844/3793] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:25 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1496 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:34:26.461146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b55a55a0-2a31-4af0-9415-ab5536a82f04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:26.479260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b55a55a0-2a31-4af0-9415-ab5536a82f04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:26.508832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b55a55a0-2a31-4af0-9415-ab5536a82f04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:26.509789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b55a55a0-2a31-4af0-9415-ab5536a82f04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:26.510568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b55a55a0-2a31-4af0-9415-ab5536a82f04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:26.511577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b55a55a0-2a31-4af0-9415-ab5536a82f04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:26.512349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b55a55a0-2a31-4af0-9415-ab5536a82f04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:26.513908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b55a55a0-2a31-4af0-9415-ab5536a82f04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:26.556876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9333af76-dbba-48e1-bed9-156aa6c9f2d0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:26.570345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9333af76-dbba-48e1-bed9-156aa6c9f2d0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:26.571951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9333af76-dbba-48e1-bed9-156aa6c9f2d0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:26.579427 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9333af76-dbba-48e1-bed9-156aa6c9f2d0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1751 microversion: 2.20 time: 0.904378 Oct 10 23:34:26.580595 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1950/3794] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:25 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1751 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:34:27.216788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-9c4c4be3-be0b-4e98-a459-e9ebb67d00e7 req-6991d0fc-b2de-4c3f-9d3c-045b6249577c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9a3be2-bbf6-4abd-bbb1-452785322946", "name": "network-vif-unplugged", "status": "completed", "tag": "eac62ee6-3195-444b-b747-98b82a33a616"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:34:27.257069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9c4c4be3-be0b-4e98-a459-e9ebb67d00e7 req-6991d0fc-b2de-4c3f-9d3c-045b6249577c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:27.260819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9c4c4be3-be0b-4e98-a459-e9ebb67d00e7 req-6991d0fc-b2de-4c3f-9d3c-045b6249577c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:27.264656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9c4c4be3-be0b-4e98-a459-e9ebb67d00e7 req-6991d0fc-b2de-4c3f-9d3c-045b6249577c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:27.321663 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-9c4c4be3-be0b-4e98-a459-e9ebb67d00e7 req-6991d0fc-b2de-4c3f-9d3c-045b6249577c service nova] Creating event network-vif-unplugged:eac62ee6-3195-444b-b747-98b82a33a616 for instance ce9a3be2-bbf6-4abd-bbb1-452785322946 on n-h1-860864-2 Oct 10 23:34:27.348986 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-9c4c4be3-be0b-4e98-a459-e9ebb67d00e7 req-6991d0fc-b2de-4c3f-9d3c-045b6249577c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134450 Oct 10 23:34:27.353845 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1951/3795] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:34:27.486261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3189e388-988c-47fd-a612-68518d6447d6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:27.487511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3189e388-988c-47fd-a612-68518d6447d6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:27.541223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3189e388-988c-47fd-a612-68518d6447d6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:27.546508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3189e388-988c-47fd-a612-68518d6447d6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:27.547233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3189e388-988c-47fd-a612-68518d6447d6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:27.557841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3189e388-988c-47fd-a612-68518d6447d6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:27.559009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3189e388-988c-47fd-a612-68518d6447d6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:27.561759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3189e388-988c-47fd-a612-68518d6447d6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:27.664181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b55a55a0-2a31-4af0-9415-ab5536a82f04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:27.682109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b55a55a0-2a31-4af0-9415-ab5536a82f04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:27.689517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b55a55a0-2a31-4af0-9415-ab5536a82f04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:27.691799 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b55a55a0-2a31-4af0-9415-ab5536a82f04 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1602 microversion: 2.32 time: 1.241734 Oct 10 23:34:27.695504 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1845/3796] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:26 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1602 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:27.707978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-47de9fc7-d1eb-4b7a-b4d3-396687e1e95b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:27.708888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-47de9fc7-d1eb-4b7a-b4d3-396687e1e95b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:27.717398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47de9fc7-d1eb-4b7a-b4d3-396687e1e95b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:27.718684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47de9fc7-d1eb-4b7a-b4d3-396687e1e95b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:27.721229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47de9fc7-d1eb-4b7a-b4d3-396687e1e95b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:27.722243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47de9fc7-d1eb-4b7a-b4d3-396687e1e95b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:27.723024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47de9fc7-d1eb-4b7a-b4d3-396687e1e95b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:27.723690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47de9fc7-d1eb-4b7a-b4d3-396687e1e95b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:28.127259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3189e388-988c-47fd-a612-68518d6447d6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:28.138409 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3189e388-988c-47fd-a612-68518d6447d6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1496 microversion: 2.1 time: 0.666239 Oct 10 23:34:28.139402 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1952/3797] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:27 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1496 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:34:28.360369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-47de9fc7-d1eb-4b7a-b4d3-396687e1e95b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:28.382419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-47de9fc7-d1eb-4b7a-b4d3-396687e1e95b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:28.391156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-47de9fc7-d1eb-4b7a-b4d3-396687e1e95b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:28.398796 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-47de9fc7-d1eb-4b7a-b4d3-396687e1e95b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1751 microversion: 2.20 time: 0.700050 Oct 10 23:34:28.426643 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1846/3798] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:27 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1751 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:28.748267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4f24f3cd-3abe-4fba-8d84-2bf8389ec315 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:28.748965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4f24f3cd-3abe-4fba-8d84-2bf8389ec315 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:28.782192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f24f3cd-3abe-4fba-8d84-2bf8389ec315 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:28.782758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f24f3cd-3abe-4fba-8d84-2bf8389ec315 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:28.783221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f24f3cd-3abe-4fba-8d84-2bf8389ec315 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:28.790673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f24f3cd-3abe-4fba-8d84-2bf8389ec315 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:28.791525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f24f3cd-3abe-4fba-8d84-2bf8389ec315 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:28.792284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f24f3cd-3abe-4fba-8d84-2bf8389ec315 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:29.075372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4f24f3cd-3abe-4fba-8d84-2bf8389ec315 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:29.123789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4f24f3cd-3abe-4fba-8d84-2bf8389ec315 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:29.136679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4f24f3cd-3abe-4fba-8d84-2bf8389ec315 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:29.146319 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4f24f3cd-3abe-4fba-8d84-2bf8389ec315 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1602 microversion: 2.32 time: 0.400025 Oct 10 23:34:29.168699 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1953/3799] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:28 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1602 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:29.169149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4bf09772-81ce-4c34-8650-b01bd9e6b810 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:29.174526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4bf09772-81ce-4c34-8650-b01bd9e6b810 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:29.196697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bf09772-81ce-4c34-8650-b01bd9e6b810 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:29.206360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bf09772-81ce-4c34-8650-b01bd9e6b810 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:29.208346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bf09772-81ce-4c34-8650-b01bd9e6b810 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:29.209856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bf09772-81ce-4c34-8650-b01bd9e6b810 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:29.210849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bf09772-81ce-4c34-8650-b01bd9e6b810 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:29.211816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bf09772-81ce-4c34-8650-b01bd9e6b810 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:29.295448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-d1b2c415-3355-4c2a-9ea6-e846e293661b req-d7f4baaf-a2e1-4c1a-9bb5-636002c5ce24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce9a3be2-bbf6-4abd-bbb1-452785322946", "name": "network-vif-deleted", "tag": "eac62ee6-3195-444b-b747-98b82a33a616"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:34:29.310252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d1b2c415-3355-4c2a-9ea6-e846e293661b req-d7f4baaf-a2e1-4c1a-9bb5-636002c5ce24 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:29.311210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d1b2c415-3355-4c2a-9ea6-e846e293661b req-d7f4baaf-a2e1-4c1a-9bb5-636002c5ce24 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:29.311896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d1b2c415-3355-4c2a-9ea6-e846e293661b req-d7f4baaf-a2e1-4c1a-9bb5-636002c5ce24 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:29.343000 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-d1b2c415-3355-4c2a-9ea6-e846e293661b req-d7f4baaf-a2e1-4c1a-9bb5-636002c5ce24 service nova] Creating event network-vif-deleted:eac62ee6-3195-444b-b747-98b82a33a616 for instance ce9a3be2-bbf6-4abd-bbb1-452785322946 on n-h1-860864-2 Oct 10 23:34:29.370714 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-d1b2c415-3355-4c2a-9ea6-e846e293661b req-d7f4baaf-a2e1-4c1a-9bb5-636002c5ce24 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079933 Oct 10 23:34:29.374643 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1954/3800] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:34:29.449997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-edfc5cc2-86e7-41b5-908f-25e99f1f59a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:29.451368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-edfc5cc2-86e7-41b5-908f-25e99f1f59a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:29.476904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-edfc5cc2-86e7-41b5-908f-25e99f1f59a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:29.477551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-edfc5cc2-86e7-41b5-908f-25e99f1f59a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:29.478010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-edfc5cc2-86e7-41b5-908f-25e99f1f59a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:29.484462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-edfc5cc2-86e7-41b5-908f-25e99f1f59a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:29.485193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-edfc5cc2-86e7-41b5-908f-25e99f1f59a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:29.485676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-edfc5cc2-86e7-41b5-908f-25e99f1f59a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:29.520779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4bf09772-81ce-4c34-8650-b01bd9e6b810 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781bd1f2871245399de1db53d1d9ad42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70836dfc36f744ab8f26c1b47be26ff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:29.562272 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4bf09772-81ce-4c34-8650-b01bd9e6b810 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 200 len: 1454 microversion: 2.1 time: 0.400547 Oct 10 23:34:29.573424 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1847/3801] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:29 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 1454 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:34:30.203501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b4b9b465-b318-479b-ae4c-59881c2e1a0f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:30.205084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b4b9b465-b318-479b-ae4c-59881c2e1a0f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:30.230439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4b9b465-b318-479b-ae4c-59881c2e1a0f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:30.239670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4b9b465-b318-479b-ae4c-59881c2e1a0f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:30.240798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4b9b465-b318-479b-ae4c-59881c2e1a0f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:30.242114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4b9b465-b318-479b-ae4c-59881c2e1a0f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:30.245215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4b9b465-b318-479b-ae4c-59881c2e1a0f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:30.246040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4b9b465-b318-479b-ae4c-59881c2e1a0f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:30.352030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4b9b465-b318-479b-ae4c-59881c2e1a0f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:30.352835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4b9b465-b318-479b-ae4c-59881c2e1a0f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:30.353702 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4b9b465-b318-479b-ae4c-59881c2e1a0f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:30.354296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-b4b9b465-b318-479b-ae4c-59881c2e1a0f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lazy-loading 'fault' on Instance uuid 25c9f989-440a-4037-9757-8e96402a9aea {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:34:30.640054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b4b9b465-b318-479b-ae4c-59881c2e1a0f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:30.653045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b4b9b465-b318-479b-ae4c-59881c2e1a0f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:30.695896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b4b9b465-b318-479b-ae4c-59881c2e1a0f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '05eae0dd45364b3b9d20bf48903e78ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24258516d0894c629fe91d0d0907bc3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:30.716684 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b4b9b465-b318-479b-ae4c-59881c2e1a0f tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 200 len: 1607 microversion: 2.32 time: 0.511447 Oct 10 23:34:30.718120 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1848/3802] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:30 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 1607 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:34:30.759993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cbcb3797-e779-4c31-8398-a14c4f19d246 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:30.760641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cbcb3797-e779-4c31-8398-a14c4f19d246 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:30.781947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cbcb3797-e779-4c31-8398-a14c4f19d246 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:30.782463 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cbcb3797-e779-4c31-8398-a14c4f19d246 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:30.783037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cbcb3797-e779-4c31-8398-a14c4f19d246 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:30.783766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cbcb3797-e779-4c31-8398-a14c4f19d246 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:30.784240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cbcb3797-e779-4c31-8398-a14c4f19d246 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:30.784682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cbcb3797-e779-4c31-8398-a14c4f19d246 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:30.827355 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-cbcb3797-e779-4c31-8398-a14c4f19d246 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] HTTP exception thrown: Instance ce9a3be2-bbf6-4abd-bbb1-452785322946 could not be found. Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cbcb3797-e779-4c31-8398-a14c4f19d246 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Request method failure captured: Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 HTTP/1.1 Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKtpt25BnebxWGCA4Z7GvH1_E9dL58H8zbLekWHv8xuthsidwuoYDmMOh4PjTvqQ7uWj24A_LYKBzljHxvV1jPQGLL6bG0YhgNQa9d_w2OdxSzo6TCgqXMPKtf1DrAMlyYRbvmvrq4Y_eQAaQhqnzXu4VJZbjxLAbrgLQ6Sir6trSlg Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 70836dfc36f744ab8f26c1b47be26ff4 Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersTestMultiNic-738319113 Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/70836dfc36f744ab8f26c1b47be26ff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70836dfc36f744ab8f26c1b47be26ff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70836dfc36f744ab8f26c1b47be26ff4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_70836dfc36f744ab8f26c1b47be26ff4", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersTestMultiNic-738319113 Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 70836dfc36f744ab8f26c1b47be26ff4 Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersTestMultiNic-738319113 Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersTestMultiNic-738319113-project Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 781bd1f2871245399de1db53d1d9ad42 Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersTestMultiNic-738319113-project Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance ce9a3be2-bbf6-4abd-bbb1-452785322946 could not be found. Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'ce9a3be2-bbf6-4abd-bbb1-452785322946'} Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce9a3be2-bbf6-4abd-bbb1-452785322946 could not be found. Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce9a3be2-bbf6-4abd-bbb1-452785322946 could not be found. Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:30.830383 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:30.836698 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:30.836698 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:30.836698 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:30.836698 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:34:30.836698 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:34:30.836698 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce9a3be2-bbf6-4abd-bbb1-452785322946 could not be found. Oct 10 23:34:30.836698 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:30.838738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cbcb3797-e779-4c31-8398-a14c4f19d246 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Returning 404 to user: Instance ce9a3be2-bbf6-4abd-bbb1-452785322946 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:34:30.839850 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cbcb3797-e779-4c31-8398-a14c4f19d246 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 404 len: 111 microversion: 2.1 time: 0.120445 Oct 10 23:34:30.840977 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1849/3803] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:30 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:34:30.867951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-edfc5cc2-86e7-41b5-908f-25e99f1f59a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:30.892816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-edfc5cc2-86e7-41b5-908f-25e99f1f59a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:30.902800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-edfc5cc2-86e7-41b5-908f-25e99f1f59a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:30.906934 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-edfc5cc2-86e7-41b5-908f-25e99f1f59a6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1753 microversion: 2.20 time: 1.462014 Oct 10 23:34:30.908069 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1955/3804] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:29 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1753 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:31.745559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bdcedd24-1576-4df4-b567-048c7e221133 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:31.750259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bdcedd24-1576-4df4-b567-048c7e221133 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:31.793843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdcedd24-1576-4df4-b567-048c7e221133 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:31.795129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdcedd24-1576-4df4-b567-048c7e221133 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:31.796252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdcedd24-1576-4df4-b567-048c7e221133 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:31.797474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdcedd24-1576-4df4-b567-048c7e221133 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:31.798219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdcedd24-1576-4df4-b567-048c7e221133 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:31.804663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdcedd24-1576-4df4-b567-048c7e221133 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:31.859551 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-bdcedd24-1576-4df4-b567-048c7e221133 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] HTTP exception thrown: Instance 25c9f989-440a-4037-9757-8e96402a9aea could not be found. Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bdcedd24-1576-4df4-b567-048c7e221133 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Request method failure captured: Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea HTTP/1.1 Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKpeg-pzeJYdIr2l6htWenyiwwFOvnlFnyGmARS5oxVeuEaDFT2pIfEGynM9b0eXavzQE8TyQax0TeCd3MxS03bqHFoiyx1mkcnwO0K-I4dgPDTKmvMg0oH5dYmUhIg6VfWkBddHFC9t3h22dYP2fvhNed5jfrvASKlBlMJCFdlfmoI Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: X-Openstack-Nova-Api-Version: 2.32 Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 24258516d0894c629fe91d0d0907bc3c Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TaggedBootDevicesTest-1375908580 Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/24258516d0894c629fe91d0d0907bc3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/24258516d0894c629fe91d0d0907bc3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/24258516d0894c629fe91d0d0907bc3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_24258516d0894c629fe91d0d0907bc3c", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TaggedBootDevicesTest-1375908580 Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 24258516d0894c629fe91d0d0907bc3c Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1375908580 Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TaggedBootDevicesTest-1375908580-project Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 05eae0dd45364b3b9d20bf48903e78ca Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TaggedBootDevicesTest-1375908580-project Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 25c9f989-440a-4037-9757-8e96402a9aea could not be found. Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '25c9f989-440a-4037-9757-8e96402a9aea'} Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c9f989-440a-4037-9757-8e96402a9aea could not be found. Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c9f989-440a-4037-9757-8e96402a9aea could not be found. Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:31.861483 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:31.867091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:31.867091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:31.867091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:31.867091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:31.867091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:34:31.867091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:34:31.867091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c9f989-440a-4037-9757-8e96402a9aea could not be found. Oct 10 23:34:31.867091 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:31.867091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bdcedd24-1576-4df4-b567-048c7e221133 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Returning 404 to user: Instance 25c9f989-440a-4037-9757-8e96402a9aea could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:34:31.867091 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bdcedd24-1576-4df4-b567-048c7e221133 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 404 len: 111 microversion: 2.32 time: 0.122179 Oct 10 23:34:31.874870 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1850/3805] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:31 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:34:31.881269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7aac942b-b634-4bee-a3ea-a9a3fd0f7b98 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '.version_select at 0x7f662a6ab160>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:31.923929 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7aac942b-b634-4bee-a3ea-a9a3fd0f7b98 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-18508629" status: 204 len: 0 microversion: 2.32 time: 0.047191 Oct 10 23:34:31.929279 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1956/3806] 10.222.0.23 () {60 vars in 1256 bytes} [Mon Oct 10 23:34:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-18508629 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:34:31.961169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-af835f3e-a7e4-4536-84b2-d3f9b6bacaf7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:31.961929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-af835f3e-a7e4-4536-84b2-d3f9b6bacaf7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:31.971969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af835f3e-a7e4-4536-84b2-d3f9b6bacaf7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:31.972985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af835f3e-a7e4-4536-84b2-d3f9b6bacaf7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:31.973448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af835f3e-a7e4-4536-84b2-d3f9b6bacaf7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:31.974177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af835f3e-a7e4-4536-84b2-d3f9b6bacaf7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:31.974632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af835f3e-a7e4-4536-84b2-d3f9b6bacaf7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:31.975057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af835f3e-a7e4-4536-84b2-d3f9b6bacaf7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:32.680530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-af835f3e-a7e4-4536-84b2-d3f9b6bacaf7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:32.710683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-af835f3e-a7e4-4536-84b2-d3f9b6bacaf7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:32.714871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-af835f3e-a7e4-4536-84b2-d3f9b6bacaf7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:32.718442 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-af835f3e-a7e4-4536-84b2-d3f9b6bacaf7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1753 microversion: 2.20 time: 0.763058 Oct 10 23:34:32.720742 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1851/3807] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:31 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1753 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:33.752583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e8d7e1aa-2883-4a0a-bda1-8d17a2744278 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:33.755040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e8d7e1aa-2883-4a0a-bda1-8d17a2744278 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:33.763364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:34:33.785497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8d7e1aa-2883-4a0a-bda1-8d17a2744278 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:33.787791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8d7e1aa-2883-4a0a-bda1-8d17a2744278 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:33.788949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8d7e1aa-2883-4a0a-bda1-8d17a2744278 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:33.793126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8d7e1aa-2883-4a0a-bda1-8d17a2744278 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:33.794998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8d7e1aa-2883-4a0a-bda1-8d17a2744278 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:33.801529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8d7e1aa-2883-4a0a-bda1-8d17a2744278 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:34.508665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e8d7e1aa-2883-4a0a-bda1-8d17a2744278 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:34.521668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e8d7e1aa-2883-4a0a-bda1-8d17a2744278 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:34.523913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e8d7e1aa-2883-4a0a-bda1-8d17a2744278 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:34.525966 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e8d7e1aa-2883-4a0a-bda1-8d17a2744278 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1753 microversion: 2.20 time: 0.780492 Oct 10 23:34:34.539810 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1957/3808] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:33 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1753 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:34.760813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6339ae20-e026-45c6-99dd-7b0ee1d692fe tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Action: 'create', calling method: .version_select at 0x7f6633a6c0d0>, body: {"keypair": {"name": "tempest-keypair-1059753393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGg8g/IMxq/n+zfKNsY5Qm2JPZQwPKuGD+Q7EPYgzutNBaWlrRHKZ+6Swz+OiNZodgOmzfAAS6xBocOm8duLwIlFZemAHak2ean4cksQlatjvi3RkgMn/W+6PJ6YZlG2Sg=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:34:34.804513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-6339ae20-e026-45c6-99dd-7b0ee1d692fe tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Getting quotas for project 196e430563ce4e65a2a5d4485aaa02b1. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:34:34.824021 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-6339ae20-e026-45c6-99dd-7b0ee1d692fe tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Getting quotas for user 6a9c6f195e2a491097e771787e454a82 and project 196e430563ce4e65a2a5d4485aaa02b1. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:34:34.879375 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6339ae20-e026-45c6-99dd-7b0ee1d692fe tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.274263 Oct 10 23:34:34.886332 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1852/3809] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:34:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:34:35.576531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6d0a0bd5-8268-4633-addb-7e0dbbfcd3e6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:35.579912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6d0a0bd5-8268-4633-addb-7e0dbbfcd3e6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:35.608844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d0a0bd5-8268-4633-addb-7e0dbbfcd3e6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:35.609361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d0a0bd5-8268-4633-addb-7e0dbbfcd3e6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:35.609845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d0a0bd5-8268-4633-addb-7e0dbbfcd3e6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:35.610572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d0a0bd5-8268-4633-addb-7e0dbbfcd3e6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:35.615265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d0a0bd5-8268-4633-addb-7e0dbbfcd3e6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:35.622848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d0a0bd5-8268-4633-addb-7e0dbbfcd3e6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:36.840785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6d0a0bd5-8268-4633-addb-7e0dbbfcd3e6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:36.860240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6d0a0bd5-8268-4633-addb-7e0dbbfcd3e6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:36.862555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6d0a0bd5-8268-4633-addb-7e0dbbfcd3e6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:36.875616 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6d0a0bd5-8268-4633-addb-7e0dbbfcd3e6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1753 microversion: 2.20 time: 1.309228 Oct 10 23:34:36.876802 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1958/3810] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:35 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1753 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:37.921661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ee1ce68d-721a-4a53-bc9b-5db309224dbc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:37.923261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ee1ce68d-721a-4a53-bc9b-5db309224dbc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:37.948809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee1ce68d-721a-4a53-bc9b-5db309224dbc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:37.953099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee1ce68d-721a-4a53-bc9b-5db309224dbc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:37.953449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee1ce68d-721a-4a53-bc9b-5db309224dbc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:37.957405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee1ce68d-721a-4a53-bc9b-5db309224dbc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:37.958016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee1ce68d-721a-4a53-bc9b-5db309224dbc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:37.962577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee1ce68d-721a-4a53-bc9b-5db309224dbc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:38.552638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ee1ce68d-721a-4a53-bc9b-5db309224dbc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:38.593560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ee1ce68d-721a-4a53-bc9b-5db309224dbc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:38.602438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ee1ce68d-721a-4a53-bc9b-5db309224dbc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:38.618894 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ee1ce68d-721a-4a53-bc9b-5db309224dbc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1753 microversion: 2.20 time: 0.703609 Oct 10 23:34:38.620017 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1853/3811] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:37 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1753 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:38.777918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a439d512-1265-4085-825a-5e86abe1a3b6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:38.778948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a439d512-1265-4085-825a-5e86abe1a3b6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:38.806921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a439d512-1265-4085-825a-5e86abe1a3b6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:38.808173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a439d512-1265-4085-825a-5e86abe1a3b6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:38.809868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a439d512-1265-4085-825a-5e86abe1a3b6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:38.816775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a439d512-1265-4085-825a-5e86abe1a3b6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:38.817804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a439d512-1265-4085-825a-5e86abe1a3b6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:38.827079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a439d512-1265-4085-825a-5e86abe1a3b6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:38.856535 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-a439d512-1265-4085-825a-5e86abe1a3b6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] HTTP exception thrown: Instance ce9a3be2-bbf6-4abd-bbb1-452785322946 could not be found. Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a439d512-1265-4085-825a-5e86abe1a3b6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Request method failure captured: Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 HTTP/1.1 Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKtpt25BnebxWGCA4Z7GvH1_E9dL58H8zbLekWHv8xuthsidwuoYDmMOh4PjTvqQ7uWj24A_LYKBzljHxvV1jPQGLL6bG0YhgNQa9d_w2OdxSzo6TCgqXMPKtf1DrAMlyYRbvmvrq4Y_eQAaQhqnzXu4VJZbjxLAbrgLQ6Sir6trSlg Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 70836dfc36f744ab8f26c1b47be26ff4 Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersTestMultiNic-738319113 Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/70836dfc36f744ab8f26c1b47be26ff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70836dfc36f744ab8f26c1b47be26ff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70836dfc36f744ab8f26c1b47be26ff4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_70836dfc36f744ab8f26c1b47be26ff4", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersTestMultiNic-738319113 Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 70836dfc36f744ab8f26c1b47be26ff4 Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersTestMultiNic-738319113 Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersTestMultiNic-738319113-project Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 781bd1f2871245399de1db53d1d9ad42 Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersTestMultiNic-738319113-project Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance ce9a3be2-bbf6-4abd-bbb1-452785322946 could not be found. Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'ce9a3be2-bbf6-4abd-bbb1-452785322946'} Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce9a3be2-bbf6-4abd-bbb1-452785322946 could not be found. Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:34:38.859532 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:34:38.866615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce9a3be2-bbf6-4abd-bbb1-452785322946 could not be found. Oct 10 23:34:38.866615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:34:38.866615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:38.866615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:34:38.866615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:38.866615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:38.866615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:38.866615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:34:38.866615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:34:38.866615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce9a3be2-bbf6-4abd-bbb1-452785322946 could not be found. Oct 10 23:34:38.866615 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:34:38.866615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a439d512-1265-4085-825a-5e86abe1a3b6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Returning 404 to user: Instance ce9a3be2-bbf6-4abd-bbb1-452785322946 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:34:38.874684 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a439d512-1265-4085-825a-5e86abe1a3b6 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 404 len: 111 microversion: 2.1 time: 0.093853 Oct 10 23:34:38.874684 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1959/3812] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:34:38 2022] DELETE /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:34:38.883854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e809fa69-9da8-4641-9703-e90cfbef0f47 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:38.883854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e809fa69-9da8-4641-9703-e90cfbef0f47 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: ce9a3be2-bbf6-4abd-bbb1-452785322946] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:38.900366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e809fa69-9da8-4641-9703-e90cfbef0f47 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:38.901292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e809fa69-9da8-4641-9703-e90cfbef0f47 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:38.901803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e809fa69-9da8-4641-9703-e90cfbef0f47 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:38.904381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e809fa69-9da8-4641-9703-e90cfbef0f47 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:38.904938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e809fa69-9da8-4641-9703-e90cfbef0f47 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:38.905550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e809fa69-9da8-4641-9703-e90cfbef0f47 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:38.945632 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-e809fa69-9da8-4641-9703-e90cfbef0f47 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] HTTP exception thrown: Instance ce9a3be2-bbf6-4abd-bbb1-452785322946 could not be found. Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e809fa69-9da8-4641-9703-e90cfbef0f47 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Request method failure captured: Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 HTTP/1.1 Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKtpt25BnebxWGCA4Z7GvH1_E9dL58H8zbLekWHv8xuthsidwuoYDmMOh4PjTvqQ7uWj24A_LYKBzljHxvV1jPQGLL6bG0YhgNQa9d_w2OdxSzo6TCgqXMPKtf1DrAMlyYRbvmvrq4Y_eQAaQhqnzXu4VJZbjxLAbrgLQ6Sir6trSlg Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 70836dfc36f744ab8f26c1b47be26ff4 Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersTestMultiNic-738319113 Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/70836dfc36f744ab8f26c1b47be26ff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70836dfc36f744ab8f26c1b47be26ff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70836dfc36f744ab8f26c1b47be26ff4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_70836dfc36f744ab8f26c1b47be26ff4", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersTestMultiNic-738319113 Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 70836dfc36f744ab8f26c1b47be26ff4 Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersTestMultiNic-738319113 Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersTestMultiNic-738319113-project Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 781bd1f2871245399de1db53d1d9ad42 Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersTestMultiNic-738319113-project Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance ce9a3be2-bbf6-4abd-bbb1-452785322946 could not be found. Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'ce9a3be2-bbf6-4abd-bbb1-452785322946'} Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce9a3be2-bbf6-4abd-bbb1-452785322946 could not be found. Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce9a3be2-bbf6-4abd-bbb1-452785322946 could not be found. Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:38.948052 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:38.953612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:38.953612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:38.953612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:38.953612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:34:38.953612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:34:38.953612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce9a3be2-bbf6-4abd-bbb1-452785322946 could not be found. Oct 10 23:34:38.953612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:38.955140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e809fa69-9da8-4641-9703-e90cfbef0f47 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Returning 404 to user: Instance ce9a3be2-bbf6-4abd-bbb1-452785322946 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:34:38.956208 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e809fa69-9da8-4641-9703-e90cfbef0f47 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946" status: 404 len: 111 microversion: 2.1 time: 0.082091 Oct 10 23:34:38.958015 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1854/3813] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:38 2022] GET /compute/v2.1/servers/ce9a3be2-bbf6-4abd-bbb1-452785322946 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:34:38.968984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6bf22b12-c136-4c08-a035-51c249d0c944 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:38.969753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6bf22b12-c136-4c08-a035-51c249d0c944 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:38.986875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bf22b12-c136-4c08-a035-51c249d0c944 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:38.987459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bf22b12-c136-4c08-a035-51c249d0c944 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:38.988268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bf22b12-c136-4c08-a035-51c249d0c944 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:38.989238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bf22b12-c136-4c08-a035-51c249d0c944 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:38.990185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bf22b12-c136-4c08-a035-51c249d0c944 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:38.990965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bf22b12-c136-4c08-a035-51c249d0c944 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:39.021869 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-6bf22b12-c136-4c08-a035-51c249d0c944 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] HTTP exception thrown: Instance d3ca263a-16c7-4514-963e-6a008e39baa5 could not be found. Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6bf22b12-c136-4c08-a035-51c249d0c944 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Request method failure captured: Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 HTTP/1.1 Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKtpt25BnebxWGCA4Z7GvH1_E9dL58H8zbLekWHv8xuthsidwuoYDmMOh4PjTvqQ7uWj24A_LYKBzljHxvV1jPQGLL6bG0YhgNQa9d_w2OdxSzo6TCgqXMPKtf1DrAMlyYRbvmvrq4Y_eQAaQhqnzXu4VJZbjxLAbrgLQ6Sir6trSlg Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 70836dfc36f744ab8f26c1b47be26ff4 Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersTestMultiNic-738319113 Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/70836dfc36f744ab8f26c1b47be26ff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70836dfc36f744ab8f26c1b47be26ff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70836dfc36f744ab8f26c1b47be26ff4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_70836dfc36f744ab8f26c1b47be26ff4", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersTestMultiNic-738319113 Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 70836dfc36f744ab8f26c1b47be26ff4 Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersTestMultiNic-738319113 Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersTestMultiNic-738319113-project Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 781bd1f2871245399de1db53d1d9ad42 Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersTestMultiNic-738319113-project Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance d3ca263a-16c7-4514-963e-6a008e39baa5 could not be found. Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'd3ca263a-16c7-4514-963e-6a008e39baa5'} Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3ca263a-16c7-4514-963e-6a008e39baa5 could not be found. Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:34:39.024080 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:34:39.029428 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3ca263a-16c7-4514-963e-6a008e39baa5 could not be found. Oct 10 23:34:39.029428 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:34:39.029428 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:39.029428 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:34:39.029428 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:39.029428 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:39.029428 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:39.029428 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:34:39.029428 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:34:39.029428 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3ca263a-16c7-4514-963e-6a008e39baa5 could not be found. Oct 10 23:34:39.029428 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:34:39.029428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6bf22b12-c136-4c08-a035-51c249d0c944 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Returning 404 to user: Instance d3ca263a-16c7-4514-963e-6a008e39baa5 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:34:39.031270 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6bf22b12-c136-4c08-a035-51c249d0c944 tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 404 len: 111 microversion: 2.1 time: 0.068283 Oct 10 23:34:39.032295 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1960/3814] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:34:38 2022] DELETE /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:34:39.041865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0540f86b-a6c5-451b-a394-2f158e530b0a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:39.042825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0540f86b-a6c5-451b-a394-2f158e530b0a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] [instance: d3ca263a-16c7-4514-963e-6a008e39baa5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:39.062608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0540f86b-a6c5-451b-a394-2f158e530b0a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:39.072199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0540f86b-a6c5-451b-a394-2f158e530b0a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:39.073324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0540f86b-a6c5-451b-a394-2f158e530b0a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:39.079015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0540f86b-a6c5-451b-a394-2f158e530b0a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:39.080035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0540f86b-a6c5-451b-a394-2f158e530b0a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:39.080669 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0540f86b-a6c5-451b-a394-2f158e530b0a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:39.113237 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-0540f86b-a6c5-451b-a394-2f158e530b0a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] HTTP exception thrown: Instance d3ca263a-16c7-4514-963e-6a008e39baa5 could not be found. Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0540f86b-a6c5-451b-a394-2f158e530b0a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Request method failure captured: Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 HTTP/1.1 Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKtpt25BnebxWGCA4Z7GvH1_E9dL58H8zbLekWHv8xuthsidwuoYDmMOh4PjTvqQ7uWj24A_LYKBzljHxvV1jPQGLL6bG0YhgNQa9d_w2OdxSzo6TCgqXMPKtf1DrAMlyYRbvmvrq4Y_eQAaQhqnzXu4VJZbjxLAbrgLQ6Sir6trSlg Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 70836dfc36f744ab8f26c1b47be26ff4 Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersTestMultiNic-738319113 Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/70836dfc36f744ab8f26c1b47be26ff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70836dfc36f744ab8f26c1b47be26ff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/70836dfc36f744ab8f26c1b47be26ff4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_70836dfc36f744ab8f26c1b47be26ff4", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersTestMultiNic-738319113 Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 70836dfc36f744ab8f26c1b47be26ff4 Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersTestMultiNic-738319113 Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersTestMultiNic-738319113-project Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 781bd1f2871245399de1db53d1d9ad42 Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersTestMultiNic-738319113-project Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance d3ca263a-16c7-4514-963e-6a008e39baa5 could not be found. Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'd3ca263a-16c7-4514-963e-6a008e39baa5'} Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3ca263a-16c7-4514-963e-6a008e39baa5 could not be found. Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3ca263a-16c7-4514-963e-6a008e39baa5 could not be found. Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:39.114924 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:39.120590 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:39.120590 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:39.120590 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:39.120590 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:34:39.120590 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:34:39.120590 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3ca263a-16c7-4514-963e-6a008e39baa5 could not be found. Oct 10 23:34:39.120590 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:39.120590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0540f86b-a6c5-451b-a394-2f158e530b0a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] Returning 404 to user: Instance d3ca263a-16c7-4514-963e-6a008e39baa5 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:34:39.120590 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0540f86b-a6c5-451b-a394-2f158e530b0a tempest-ServersTestMultiNic-738319113 tempest-ServersTestMultiNic-738319113-project] 10.222.0.23 "GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5" status: 404 len: 111 microversion: 2.1 time: 0.079344 Oct 10 23:34:39.130997 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1855/3815] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:39 2022] GET /compute/v2.1/servers/d3ca263a-16c7-4514-963e-6a008e39baa5 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:34:39.651982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d1a7f674-3c4d-4f97-8d68-5fd1673b6c96 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:39.652603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d1a7f674-3c4d-4f97-8d68-5fd1673b6c96 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:39.663702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1a7f674-3c4d-4f97-8d68-5fd1673b6c96 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:39.664479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1a7f674-3c4d-4f97-8d68-5fd1673b6c96 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:39.665199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1a7f674-3c4d-4f97-8d68-5fd1673b6c96 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:39.666687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1a7f674-3c4d-4f97-8d68-5fd1673b6c96 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:39.668770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1a7f674-3c4d-4f97-8d68-5fd1673b6c96 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:39.669473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1a7f674-3c4d-4f97-8d68-5fd1673b6c96 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:40.408612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d1a7f674-3c4d-4f97-8d68-5fd1673b6c96 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:40.432757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d1a7f674-3c4d-4f97-8d68-5fd1673b6c96 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:40.436309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d1a7f674-3c4d-4f97-8d68-5fd1673b6c96 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:40.438520 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d1a7f674-3c4d-4f97-8d68-5fd1673b6c96 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1809 microversion: 2.20 time: 0.791753 Oct 10 23:34:40.442841 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1961/3816] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:39 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1809 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:41.476530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-47d84594-f3d3-4587-8c1c-e974bf66724e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:41.477491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-47d84594-f3d3-4587-8c1c-e974bf66724e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:41.527956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47d84594-f3d3-4587-8c1c-e974bf66724e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:41.528619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47d84594-f3d3-4587-8c1c-e974bf66724e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:41.529159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47d84594-f3d3-4587-8c1c-e974bf66724e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:41.530030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47d84594-f3d3-4587-8c1c-e974bf66724e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:41.530585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47d84594-f3d3-4587-8c1c-e974bf66724e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:41.544654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47d84594-f3d3-4587-8c1c-e974bf66724e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:42.732226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-47d84594-f3d3-4587-8c1c-e974bf66724e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:42.734870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:34:42.751576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-47d84594-f3d3-4587-8c1c-e974bf66724e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:42.757027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-47d84594-f3d3-4587-8c1c-e974bf66724e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:42.761157 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-47d84594-f3d3-4587-8c1c-e974bf66724e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1809 microversion: 2.20 time: 1.288461 Oct 10 23:34:42.764110 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1856/3817] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:41 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1809 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:34:43.811658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a78068a6-ccb3-462e-aeab-4866cb60c7ac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:43.813671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a78068a6-ccb3-462e-aeab-4866cb60c7ac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:43.835257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a78068a6-ccb3-462e-aeab-4866cb60c7ac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:43.841368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a78068a6-ccb3-462e-aeab-4866cb60c7ac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:43.843735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a78068a6-ccb3-462e-aeab-4866cb60c7ac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:43.846156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a78068a6-ccb3-462e-aeab-4866cb60c7ac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:43.848344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a78068a6-ccb3-462e-aeab-4866cb60c7ac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:43.871737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a78068a6-ccb3-462e-aeab-4866cb60c7ac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:43.966029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-2e249958-6370-47fb-a77a-13579ea76509 req-e227afa7-979c-4805-94b4-5c58b0b86b12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bd745fa-6826-4bd1-8f8d-ae65071fac12", "tag": "9a900297-53e2-4782-8def-24d4260702d5"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:34:44.024567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2e249958-6370-47fb-a77a-13579ea76509 req-e227afa7-979c-4805-94b4-5c58b0b86b12 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:44.025435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2e249958-6370-47fb-a77a-13579ea76509 req-e227afa7-979c-4805-94b4-5c58b0b86b12 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:44.026129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2e249958-6370-47fb-a77a-13579ea76509 req-e227afa7-979c-4805-94b4-5c58b0b86b12 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:44.068275 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-2e249958-6370-47fb-a77a-13579ea76509 req-e227afa7-979c-4805-94b4-5c58b0b86b12 service nova] Creating event network-changed:9a900297-53e2-4782-8def-24d4260702d5 for instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 on n-h2-860864-2 Oct 10 23:34:44.089172 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-2e249958-6370-47fb-a77a-13579ea76509 req-e227afa7-979c-4805-94b4-5c58b0b86b12 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135168 Oct 10 23:34:44.090370 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1857/3818] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 10 23:34:44.125450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-56d03864-b98f-424b-ab6d-8ec48b929d9d tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "e6863b47-7fb1-405b-8d4c-616d71ecb023"}], "security_groups": [{"name": "tempest-securitygroup--1532174574"}], "key_name": "tempest-keypair-1059753393", "user_data": "}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:34:44.489574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-56d03864-b98f-424b-ab6d-8ec48b929d9d tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] validate_networks() for [('e6863b47-7fb1-405b-8d4c-616d71ecb023', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:34:44.847556 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:34:45.050849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a78068a6-ccb3-462e-aeab-4866cb60c7ac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:45.073810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a78068a6-ccb3-462e-aeab-4866cb60c7ac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:45.077806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a78068a6-ccb3-462e-aeab-4866cb60c7ac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:45.080777 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a78068a6-ccb3-462e-aeab-4866cb60c7ac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1809 microversion: 2.20 time: 1.274818 Oct 10 23:34:45.083151 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1962/3819] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:43 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1809 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:45.998833 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-56d03864-b98f-424b-ab6d-8ec48b929d9d tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:34:46.000367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-56d03864-b98f-424b-ab6d-8ec48b929d9d tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:34:46.002151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-56d03864-b98f-424b-ab6d-8ec48b929d9d tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:34:46.002595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-56d03864-b98f-424b-ab6d-8ec48b929d9d tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:34:46.003040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-56d03864-b98f-424b-ab6d-8ec48b929d9d tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:34:46.015374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56d03864-b98f-424b-ab6d-8ec48b929d9d tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:46.015374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56d03864-b98f-424b-ab6d-8ec48b929d9d tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:46.015733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56d03864-b98f-424b-ab6d-8ec48b929d9d tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:46.016567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56d03864-b98f-424b-ab6d-8ec48b929d9d tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:46.017058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56d03864-b98f-424b-ab6d-8ec48b929d9d tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:46.017916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56d03864-b98f-424b-ab6d-8ec48b929d9d tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:46.043253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-56d03864-b98f-424b-ab6d-8ec48b929d9d tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Getting quotas for project 196e430563ce4e65a2a5d4485aaa02b1. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:34:46.051665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-56d03864-b98f-424b-ab6d-8ec48b929d9d tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Getting quotas for user 6a9c6f195e2a491097e771787e454a82 and project 196e430563ce4e65a2a5d4485aaa02b1. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:34:46.073708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-56d03864-b98f-424b-ab6d-8ec48b929d9d tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:34:46.077407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-56d03864-b98f-424b-ab6d-8ec48b929d9d tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:34:46.110985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8df1a6b4-ce6a-422b-8d35-13a3dd4667a9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:46.112277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8df1a6b4-ce6a-422b-8d35-13a3dd4667a9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:46.126064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8df1a6b4-ce6a-422b-8d35-13a3dd4667a9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:46.127470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8df1a6b4-ce6a-422b-8d35-13a3dd4667a9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:46.134771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8df1a6b4-ce6a-422b-8d35-13a3dd4667a9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:46.135880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8df1a6b4-ce6a-422b-8d35-13a3dd4667a9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:46.136560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8df1a6b4-ce6a-422b-8d35-13a3dd4667a9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:46.137200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8df1a6b4-ce6a-422b-8d35-13a3dd4667a9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:46.188769 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-56d03864-b98f-424b-ab6d-8ec48b929d9d tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.096997 Oct 10 23:34:46.194325 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1858/3820] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:34:44 2022] POST /compute/v2.1/servers => generated 409 bytes in 2103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:34:46.210866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c50eb02f-5aae-4762-a313-3e0d4b7a32ec tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:46.215563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c50eb02f-5aae-4762-a313-3e0d4b7a32ec tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:46.762292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c50eb02f-5aae-4762-a313-3e0d4b7a32ec tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:46.789665 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c50eb02f-5aae-4762-a313-3e0d4b7a32ec tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1226 microversion: 2.1 time: 0.587635 Oct 10 23:34:46.793595 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1859/3821] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:46 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1226 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:34:47.417706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8df1a6b4-ce6a-422b-8d35-13a3dd4667a9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:47.440354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8df1a6b4-ce6a-422b-8d35-13a3dd4667a9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:47.468879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8df1a6b4-ce6a-422b-8d35-13a3dd4667a9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:47.471221 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8df1a6b4-ce6a-422b-8d35-13a3dd4667a9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1809 microversion: 2.20 time: 1.364702 Oct 10 23:34:47.472763 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1963/3822] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:46 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1809 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:34:47.841594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e9dbe349-e2d3-4f00-8497-2ac13db10f24 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:47.841594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e9dbe349-e2d3-4f00-8497-2ac13db10f24 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:47.847063 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:34:47.852775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9dbe349-e2d3-4f00-8497-2ac13db10f24 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:47.863277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9dbe349-e2d3-4f00-8497-2ac13db10f24 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:47.866691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9dbe349-e2d3-4f00-8497-2ac13db10f24 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:47.868021 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9dbe349-e2d3-4f00-8497-2ac13db10f24 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:47.869945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9dbe349-e2d3-4f00-8497-2ac13db10f24 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:47.889812 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e9dbe349-e2d3-4f00-8497-2ac13db10f24 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:48.502877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-672e88e5-819b-4984-a74f-88f622f90ac7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:48.503457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-672e88e5-819b-4984-a74f-88f622f90ac7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:48.516668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-672e88e5-819b-4984-a74f-88f622f90ac7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:48.527213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-672e88e5-819b-4984-a74f-88f622f90ac7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:48.527762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-672e88e5-819b-4984-a74f-88f622f90ac7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:48.528550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-672e88e5-819b-4984-a74f-88f622f90ac7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:48.529033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-672e88e5-819b-4984-a74f-88f622f90ac7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:48.529509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-672e88e5-819b-4984-a74f-88f622f90ac7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:49.111074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e9dbe349-e2d3-4f00-8497-2ac13db10f24 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:49.126545 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e9dbe349-e2d3-4f00-8497-2ac13db10f24 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1222 microversion: 2.1 time: 1.306899 Oct 10 23:34:49.129514 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1860/3823] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:47 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1222 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:34:49.162608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-85c4a2f3-c00f-4911-b3de-920f1167703d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Action: 'create', calling method: .version_select at 0x7f6633a6cd30>, body: {"keypair": {"name": "tempest-keypair-849918376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXFV+DP/m88pPE8YCDUP/FJdbknpXuWqwCHZIye9t9zruz8ZLQ6JneRCKh9+BTNh0hr2aHCQ0DwsRL4ZhvdGgOMrPRo1ZfVGPyNnwA8l3222y9I3IX6sitaYkDDdX8mOQ=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:34:49.231221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-85c4a2f3-c00f-4911-b3de-920f1167703d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Getting quotas for project e304771fabdc4108aef00b2e4c4b7c70. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:34:49.238244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-85c4a2f3-c00f-4911-b3de-920f1167703d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Getting quotas for user c18b5a7071d34eca9bd7915250027f99 and project e304771fabdc4108aef00b2e4c4b7c70. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:34:49.304383 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-85c4a2f3-c00f-4911-b3de-920f1167703d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.173221 Oct 10 23:34:49.321907 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1861/3824] 10.222.0.23 () {62 vars in 1200 bytes} [Mon Oct 10 23:34:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 192 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 23:34:49.364643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d1b1e3e9-75f1-4b8d-bd34-28af00b99b10 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:49.365920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d1b1e3e9-75f1-4b8d-bd34-28af00b99b10 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:49.377616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1b1e3e9-75f1-4b8d-bd34-28af00b99b10 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:49.383208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1b1e3e9-75f1-4b8d-bd34-28af00b99b10 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:49.384146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1b1e3e9-75f1-4b8d-bd34-28af00b99b10 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:49.386105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1b1e3e9-75f1-4b8d-bd34-28af00b99b10 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:49.386901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1b1e3e9-75f1-4b8d-bd34-28af00b99b10 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:49.387667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1b1e3e9-75f1-4b8d-bd34-28af00b99b10 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:49.428065 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-d1b1e3e9-75f1-4b8d-bd34-28af00b99b10 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] HTTP exception thrown: Instance 25c9f989-440a-4037-9757-8e96402a9aea could not be found. Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d1b1e3e9-75f1-4b8d-bd34-28af00b99b10 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Request method failure captured: Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea HTTP/1.1 Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKpeg-pzeJYdIr2l6htWenyiwwFOvnlFnyGmARS5oxVeuEaDFT2pIfEGynM9b0eXavzQE8TyQax0TeCd3MxS03bqHFoiyx1mkcnwO0K-I4dgPDTKmvMg0oH5dYmUhIg6VfWkBddHFC9t3h22dYP2fvhNed5jfrvASKlBlMJCFdlfmoI Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: X-Openstack-Nova-Api-Version: 2.32 Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 24258516d0894c629fe91d0d0907bc3c Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TaggedBootDevicesTest-1375908580 Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/24258516d0894c629fe91d0d0907bc3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/24258516d0894c629fe91d0d0907bc3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/24258516d0894c629fe91d0d0907bc3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_24258516d0894c629fe91d0d0907bc3c", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TaggedBootDevicesTest-1375908580 Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 24258516d0894c629fe91d0d0907bc3c Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1375908580 Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TaggedBootDevicesTest-1375908580-project Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 05eae0dd45364b3b9d20bf48903e78ca Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TaggedBootDevicesTest-1375908580-project Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 25c9f989-440a-4037-9757-8e96402a9aea could not be found. Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '25c9f989-440a-4037-9757-8e96402a9aea'} Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c9f989-440a-4037-9757-8e96402a9aea could not be found. Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:34:49.432892 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:34:49.438568 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c9f989-440a-4037-9757-8e96402a9aea could not be found. Oct 10 23:34:49.438568 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:49.438568 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:49.438568 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:49.438568 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:49.438568 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:49.438568 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:49.438568 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:34:49.438568 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:34:49.438568 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c9f989-440a-4037-9757-8e96402a9aea could not be found. Oct 10 23:34:49.438568 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:49.442643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d1b1e3e9-75f1-4b8d-bd34-28af00b99b10 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Returning 404 to user: Instance 25c9f989-440a-4037-9757-8e96402a9aea could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:34:49.446625 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d1b1e3e9-75f1-4b8d-bd34-28af00b99b10 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "DELETE /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 404 len: 111 microversion: 2.32 time: 0.090049 Oct 10 23:34:49.448577 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1862/3825] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:34:49 2022] DELETE /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:34:49.460998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6831ca05-a354-48bf-ad00-0ae597d513a0 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:49.463901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6831ca05-a354-48bf-ad00-0ae597d513a0 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] [instance: 25c9f989-440a-4037-9757-8e96402a9aea] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:49.485070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6831ca05-a354-48bf-ad00-0ae597d513a0 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:49.485656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6831ca05-a354-48bf-ad00-0ae597d513a0 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:49.486300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6831ca05-a354-48bf-ad00-0ae597d513a0 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:49.487238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6831ca05-a354-48bf-ad00-0ae597d513a0 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:49.490178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6831ca05-a354-48bf-ad00-0ae597d513a0 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:49.490933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6831ca05-a354-48bf-ad00-0ae597d513a0 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:49.529948 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-6831ca05-a354-48bf-ad00-0ae597d513a0 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] HTTP exception thrown: Instance 25c9f989-440a-4037-9757-8e96402a9aea could not be found. Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6831ca05-a354-48bf-ad00-0ae597d513a0 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Request method failure captured: Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea HTTP/1.1 Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKpeg-pzeJYdIr2l6htWenyiwwFOvnlFnyGmARS5oxVeuEaDFT2pIfEGynM9b0eXavzQE8TyQax0TeCd3MxS03bqHFoiyx1mkcnwO0K-I4dgPDTKmvMg0oH5dYmUhIg6VfWkBddHFC9t3h22dYP2fvhNed5jfrvASKlBlMJCFdlfmoI Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: X-Openstack-Nova-Api-Version: 2.32 Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 24258516d0894c629fe91d0d0907bc3c Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TaggedBootDevicesTest-1375908580 Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/24258516d0894c629fe91d0d0907bc3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/24258516d0894c629fe91d0d0907bc3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/24258516d0894c629fe91d0d0907bc3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_24258516d0894c629fe91d0d0907bc3c", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TaggedBootDevicesTest-1375908580 Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 24258516d0894c629fe91d0d0907bc3c Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1375908580 Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TaggedBootDevicesTest-1375908580-project Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 05eae0dd45364b3b9d20bf48903e78ca Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TaggedBootDevicesTest-1375908580-project Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 25c9f989-440a-4037-9757-8e96402a9aea could not be found. Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '25c9f989-440a-4037-9757-8e96402a9aea'} Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c9f989-440a-4037-9757-8e96402a9aea could not be found. Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c9f989-440a-4037-9757-8e96402a9aea could not be found. Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:49.531855 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:34:49.538093 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:49.538093 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:34:49.538093 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:34:49.538093 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:34:49.538093 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:34:49.538093 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:34:49.538093 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c9f989-440a-4037-9757-8e96402a9aea could not be found. Oct 10 23:34:49.538093 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:34:49.539776 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6831ca05-a354-48bf-ad00-0ae597d513a0 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] Returning 404 to user: Instance 25c9f989-440a-4037-9757-8e96402a9aea could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:34:49.542140 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6831ca05-a354-48bf-ad00-0ae597d513a0 tempest-TaggedBootDevicesTest-1375908580 tempest-TaggedBootDevicesTest-1375908580-project] 10.222.0.23 "GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea" status: 404 len: 111 microversion: 2.32 time: 0.089371 Oct 10 23:34:49.543885 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1863/3826] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:49 2022] GET /compute/v2.1/servers/25c9f989-440a-4037-9757-8e96402a9aea => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:34:49.787787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-672e88e5-819b-4984-a74f-88f622f90ac7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:49.826572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-672e88e5-819b-4984-a74f-88f622f90ac7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:49.835650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-672e88e5-819b-4984-a74f-88f622f90ac7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:49.844006 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-672e88e5-819b-4984-a74f-88f622f90ac7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1809 microversion: 2.20 time: 1.340831 Oct 10 23:34:49.845773 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1964/3827] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:48 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1809 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:34:50.151107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c83050bf-9cd5-4202-bff3-0ba8d6d94e53 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:50.152384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c83050bf-9cd5-4202-bff3-0ba8d6d94e53 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:50.184371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c83050bf-9cd5-4202-bff3-0ba8d6d94e53 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:50.187471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c83050bf-9cd5-4202-bff3-0ba8d6d94e53 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:50.190229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c83050bf-9cd5-4202-bff3-0ba8d6d94e53 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:50.192211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c83050bf-9cd5-4202-bff3-0ba8d6d94e53 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:50.193345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c83050bf-9cd5-4202-bff3-0ba8d6d94e53 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:50.199668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c83050bf-9cd5-4202-bff3-0ba8d6d94e53 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:50.478735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c83050bf-9cd5-4202-bff3-0ba8d6d94e53 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:50.493268 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c83050bf-9cd5-4202-bff3-0ba8d6d94e53 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1284 microversion: 2.1 time: 0.346022 Oct 10 23:34:50.505554 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1864/3828] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:50 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1284 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:34:50.881585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-60dcb0b6-0d01-47b6-862b-2ecaa02029e0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:50.882591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-60dcb0b6-0d01-47b6-862b-2ecaa02029e0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:50.900635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60dcb0b6-0d01-47b6-862b-2ecaa02029e0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:50.903121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60dcb0b6-0d01-47b6-862b-2ecaa02029e0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:50.905030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60dcb0b6-0d01-47b6-862b-2ecaa02029e0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:50.908166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60dcb0b6-0d01-47b6-862b-2ecaa02029e0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:50.909036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60dcb0b6-0d01-47b6-862b-2ecaa02029e0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:50.912993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60dcb0b6-0d01-47b6-862b-2ecaa02029e0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:50.989995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:34:51.267509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-60dcb0b6-0d01-47b6-862b-2ecaa02029e0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:51.282110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-60dcb0b6-0d01-47b6-862b-2ecaa02029e0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:51.287232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-60dcb0b6-0d01-47b6-862b-2ecaa02029e0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:51.288759 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-60dcb0b6-0d01-47b6-862b-2ecaa02029e0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1809 microversion: 2.20 time: 0.413234 Oct 10 23:34:51.311660 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1965/3829] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:50 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1809 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:51.531765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d712e9e5-9a57-4fa4-a000-f198d8bfde5f tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:51.532623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d712e9e5-9a57-4fa4-a000-f198d8bfde5f tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:51.556023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d712e9e5-9a57-4fa4-a000-f198d8bfde5f tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:51.562181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d712e9e5-9a57-4fa4-a000-f198d8bfde5f tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:51.568434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d712e9e5-9a57-4fa4-a000-f198d8bfde5f tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:51.569635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d712e9e5-9a57-4fa4-a000-f198d8bfde5f tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:51.571748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d712e9e5-9a57-4fa4-a000-f198d8bfde5f tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:51.578250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d712e9e5-9a57-4fa4-a000-f198d8bfde5f tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:52.173477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d712e9e5-9a57-4fa4-a000-f198d8bfde5f tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:52.193837 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d712e9e5-9a57-4fa4-a000-f198d8bfde5f tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1284 microversion: 2.1 time: 0.661255 Oct 10 23:34:52.215167 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1865/3830] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:51 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1284 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:34:52.326701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e7edded1-6737-4158-acff-7b225244bdc4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:52.328630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e7edded1-6737-4158-acff-7b225244bdc4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:52.371272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7edded1-6737-4158-acff-7b225244bdc4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:52.378280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7edded1-6737-4158-acff-7b225244bdc4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:52.379551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7edded1-6737-4158-acff-7b225244bdc4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:52.380888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7edded1-6737-4158-acff-7b225244bdc4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:52.384841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7edded1-6737-4158-acff-7b225244bdc4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:52.388036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7edded1-6737-4158-acff-7b225244bdc4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:53.116313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e7edded1-6737-4158-acff-7b225244bdc4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:53.150259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e7edded1-6737-4158-acff-7b225244bdc4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:53.154935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e7edded1-6737-4158-acff-7b225244bdc4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:53.157490 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e7edded1-6737-4158-acff-7b225244bdc4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1809 microversion: 2.20 time: 0.838382 Oct 10 23:34:53.158769 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1966/3831] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:52 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1809 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:53.239664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d4cea059-4347-4c5f-9ba2-3296d338a80c tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:53.240367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d4cea059-4347-4c5f-9ba2-3296d338a80c tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:53.265947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4cea059-4347-4c5f-9ba2-3296d338a80c tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:53.266457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4cea059-4347-4c5f-9ba2-3296d338a80c tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:53.271823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4cea059-4347-4c5f-9ba2-3296d338a80c tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:53.272835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4cea059-4347-4c5f-9ba2-3296d338a80c tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:53.280309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4cea059-4347-4c5f-9ba2-3296d338a80c tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:53.280848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4cea059-4347-4c5f-9ba2-3296d338a80c tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:54.191571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-899be73c-fe16-4bc5-9d25-df777efa89c6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:54.193826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-899be73c-fe16-4bc5-9d25-df777efa89c6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:54.218931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-899be73c-fe16-4bc5-9d25-df777efa89c6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:54.225126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-899be73c-fe16-4bc5-9d25-df777efa89c6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:54.226005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-899be73c-fe16-4bc5-9d25-df777efa89c6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:54.227333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-899be73c-fe16-4bc5-9d25-df777efa89c6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:54.228172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-899be73c-fe16-4bc5-9d25-df777efa89c6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:54.229116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-899be73c-fe16-4bc5-9d25-df777efa89c6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:54.659000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d4cea059-4347-4c5f-9ba2-3296d338a80c tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:54.676577 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d4cea059-4347-4c5f-9ba2-3296d338a80c tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1352 microversion: 2.1 time: 1.456404 Oct 10 23:34:54.690135 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1866/3832] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:53 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1352 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:34:54.859478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-899be73c-fe16-4bc5-9d25-df777efa89c6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:54.880545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-899be73c-fe16-4bc5-9d25-df777efa89c6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:54.889587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-899be73c-fe16-4bc5-9d25-df777efa89c6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:54.893083 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-899be73c-fe16-4bc5-9d25-df777efa89c6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1809 microversion: 2.20 time: 0.708094 Oct 10 23:34:54.894728 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1967/3833] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:54 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1809 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:55.712622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6b26addc-0ede-41d5-8dfb-d2745027d887 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:55.725739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6b26addc-0ede-41d5-8dfb-d2745027d887 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:55.752790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b26addc-0ede-41d5-8dfb-d2745027d887 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:55.753408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b26addc-0ede-41d5-8dfb-d2745027d887 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:55.764576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b26addc-0ede-41d5-8dfb-d2745027d887 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:55.765366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b26addc-0ede-41d5-8dfb-d2745027d887 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:55.765870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b26addc-0ede-41d5-8dfb-d2745027d887 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:55.766322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b26addc-0ede-41d5-8dfb-d2745027d887 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:55.928625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4d442654-2f2e-4498-a8c2-86116d3750e2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:55.929532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4d442654-2f2e-4498-a8c2-86116d3750e2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:55.961405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d442654-2f2e-4498-a8c2-86116d3750e2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:55.962077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d442654-2f2e-4498-a8c2-86116d3750e2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:55.962688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d442654-2f2e-4498-a8c2-86116d3750e2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:55.965242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d442654-2f2e-4498-a8c2-86116d3750e2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:55.966667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d442654-2f2e-4498-a8c2-86116d3750e2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:55.968927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d442654-2f2e-4498-a8c2-86116d3750e2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:56.031525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:34:56.390668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4d442654-2f2e-4498-a8c2-86116d3750e2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:56.410062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4d442654-2f2e-4498-a8c2-86116d3750e2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:56.411612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4d442654-2f2e-4498-a8c2-86116d3750e2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:56.412985 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4d442654-2f2e-4498-a8c2-86116d3750e2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1809 microversion: 2.20 time: 0.489868 Oct 10 23:34:56.417143 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1968/3834] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:55 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1809 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:34:56.425905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ae1bb442-cb55-49f0-a6e1-b8dfeccc451f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1809806817", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2226650a-41eb-4b3a-872c-06fc0121ef85"}, {"port": "64c20742-7660-4d0e-82e1-e69776bd552d", "tag": "port-1"}, {"port": "f52a21e1-4980-41cd-920e-a646400a6fc3", "tag": "port-2"}, {"uuid": "29ce9d50-a6a8-430a-996f-d6d6984e4a26", "tag": "net-1"}, {"uuid": "29ce9d50-a6a8-430a-996f-d6d6984e4a26"}, {"uuid": "395c8a5c-3da9-4654-837b-465176f6ed05", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "395c8a5c-3da9-4654-837b-465176f6ed05", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "73dc687b-5e05-420e-bf88-f3a5ceeb108b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "9b4c7387-6ce3-4f81-a6f4-b76ab7bcad6b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "0ca58c73-443b-4715-a631-0f4d2b48401f", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2119696232"}], "key_name": "tempest-keypair-849918376", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:34:56.955390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6b26addc-0ede-41d5-8dfb-d2745027d887 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:57.000490 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6b26addc-0ede-41d5-8dfb-d2745027d887 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1352 microversion: 2.1 time: 1.295097 Oct 10 23:34:57.021120 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1867/3835] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:55 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1352 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:34:57.202203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-ae1bb442-cb55-49f0-a6e1-b8dfeccc451f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] validate_networks() for [('2226650a-41eb-4b3a-872c-06fc0121ef85', None, None, None, None, None), (None, None, '64c20742-7660-4d0e-82e1-e69776bd552d', None, None, None), (None, None, 'f52a21e1-4980-41cd-920e-a646400a6fc3', None, None, None), ('29ce9d50-a6a8-430a-996f-d6d6984e4a26', None, None, None, None, None), ('29ce9d50-a6a8-430a-996f-d6d6984e4a26', None, None, None, None, None), ('395c8a5c-3da9-4654-837b-465176f6ed05', '10.2.2.100', None, None, None, None), ('395c8a5c-3da9-4654-837b-465176f6ed05', '10.2.2.200', None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:34:57.451218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a8e505ab-a0d1-4065-b5b0-dd124d07baec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:57.452557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a8e505ab-a0d1-4065-b5b0-dd124d07baec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:57.476763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e505ab-a0d1-4065-b5b0-dd124d07baec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:57.478168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e505ab-a0d1-4065-b5b0-dd124d07baec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:57.491735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e505ab-a0d1-4065-b5b0-dd124d07baec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:57.494795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e505ab-a0d1-4065-b5b0-dd124d07baec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:57.497449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e505ab-a0d1-4065-b5b0-dd124d07baec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:57.500168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e505ab-a0d1-4065-b5b0-dd124d07baec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:58.784891 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a8e505ab-a0d1-4065-b5b0-dd124d07baec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:58.828544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a8e505ab-a0d1-4065-b5b0-dd124d07baec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:58.850765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a8e505ab-a0d1-4065-b5b0-dd124d07baec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:34:58.853205 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a8e505ab-a0d1-4065-b5b0-dd124d07baec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1809 microversion: 2.20 time: 1.411004 Oct 10 23:34:58.864775 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1868/3836] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:34:57 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1809 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:34:58.890446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7a20a65b-599f-4027-bfab-70b1b0ab6eff tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:34:58.898745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7a20a65b-599f-4027-bfab-70b1b0ab6eff tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:34:58.928046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a20a65b-599f-4027-bfab-70b1b0ab6eff tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:58.928549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a20a65b-599f-4027-bfab-70b1b0ab6eff tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:58.929124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a20a65b-599f-4027-bfab-70b1b0ab6eff tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:58.930023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a20a65b-599f-4027-bfab-70b1b0ab6eff tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:34:58.930870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a20a65b-599f-4027-bfab-70b1b0ab6eff tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:34:58.940844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a20a65b-599f-4027-bfab-70b1b0ab6eff tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:34:59.276398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=12 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:35:00.022730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7a20a65b-599f-4027-bfab-70b1b0ab6eff tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:00.031106 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7a20a65b-599f-4027-bfab-70b1b0ab6eff tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1352 microversion: 2.1 time: 1.175490 Oct 10 23:35:00.031720 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1869/3837] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:34:58 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1352 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:00.037068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c294e0ad-6fcb-443d-b7dc-5f66d4f0c839 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:00.053256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c294e0ad-6fcb-443d-b7dc-5f66d4f0c839 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:00.101257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c294e0ad-6fcb-443d-b7dc-5f66d4f0c839 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:00.101802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c294e0ad-6fcb-443d-b7dc-5f66d4f0c839 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:00.102254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c294e0ad-6fcb-443d-b7dc-5f66d4f0c839 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:00.102995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c294e0ad-6fcb-443d-b7dc-5f66d4f0c839 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:00.103461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c294e0ad-6fcb-443d-b7dc-5f66d4f0c839 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:00.103903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c294e0ad-6fcb-443d-b7dc-5f66d4f0c839 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:00.579794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c294e0ad-6fcb-443d-b7dc-5f66d4f0c839 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:00.624506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c294e0ad-6fcb-443d-b7dc-5f66d4f0c839 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:00.633990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c294e0ad-6fcb-443d-b7dc-5f66d4f0c839 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:00.641041 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c294e0ad-6fcb-443d-b7dc-5f66d4f0c839 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1809 microversion: 2.20 time: 0.605725 Oct 10 23:35:00.648907 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1870/3838] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:00 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1809 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:00.865975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-722fc8ee-4375-46e9-a576-acba3f131d52 req-ac723b96-6491-451d-b524-fff4a72563c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00dec699-50e1-4f85-9274-c8a2b115f13c", "tag": "ad7cc15e-cb3c-4db4-b0e3-9e9e677aedb1"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:35:00.885913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-722fc8ee-4375-46e9-a576-acba3f131d52 req-ac723b96-6491-451d-b524-fff4a72563c0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:00.892080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-722fc8ee-4375-46e9-a576-acba3f131d52 req-ac723b96-6491-451d-b524-fff4a72563c0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:00.893128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-722fc8ee-4375-46e9-a576-acba3f131d52 req-ac723b96-6491-451d-b524-fff4a72563c0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:00.927149 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-722fc8ee-4375-46e9-a576-acba3f131d52 req-ac723b96-6491-451d-b524-fff4a72563c0 service nova] Creating event network-changed:ad7cc15e-cb3c-4db4-b0e3-9e9e677aedb1 for instance 00dec699-50e1-4f85-9274-c8a2b115f13c on n-h1-860864-2 Oct 10 23:35:00.944575 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-722fc8ee-4375-46e9-a576-acba3f131d52 req-ac723b96-6491-451d-b524-fff4a72563c0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084024 Oct 10 23:35:00.947860 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1871/3839] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:35:01.060723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6b2ce907-cb13-4b85-a875-ef93d8712d54 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:01.061298 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6b2ce907-cb13-4b85-a875-ef93d8712d54 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:01.075973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b2ce907-cb13-4b85-a875-ef93d8712d54 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:01.076368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b2ce907-cb13-4b85-a875-ef93d8712d54 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:01.077016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b2ce907-cb13-4b85-a875-ef93d8712d54 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:01.078329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b2ce907-cb13-4b85-a875-ef93d8712d54 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:01.080522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b2ce907-cb13-4b85-a875-ef93d8712d54 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:01.081790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b2ce907-cb13-4b85-a875-ef93d8712d54 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:01.422856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6b2ce907-cb13-4b85-a875-ef93d8712d54 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:01.437389 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6b2ce907-cb13-4b85-a875-ef93d8712d54 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1352 microversion: 2.1 time: 0.380983 Oct 10 23:35:01.438800 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1872/3840] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:01 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1352 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:01.685775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-32fbe28d-17d3-444c-b3c0-21d6b2227085 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:01.686800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-32fbe28d-17d3-444c-b3c0-21d6b2227085 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:01.703047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32fbe28d-17d3-444c-b3c0-21d6b2227085 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:01.704728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32fbe28d-17d3-444c-b3c0-21d6b2227085 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:01.705546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32fbe28d-17d3-444c-b3c0-21d6b2227085 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:01.708385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32fbe28d-17d3-444c-b3c0-21d6b2227085 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:01.709928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32fbe28d-17d3-444c-b3c0-21d6b2227085 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:01.711143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32fbe28d-17d3-444c-b3c0-21d6b2227085 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:02.192466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-32fbe28d-17d3-444c-b3c0-21d6b2227085 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:02.220987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-32fbe28d-17d3-444c-b3c0-21d6b2227085 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:02.224596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-32fbe28d-17d3-444c-b3c0-21d6b2227085 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:02.237949 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-32fbe28d-17d3-444c-b3c0-21d6b2227085 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1809 microversion: 2.20 time: 0.545850 Oct 10 23:35:02.239891 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1873/3841] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:01 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1809 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:02.468551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6a4fde5c-3eb6-494a-98b6-2bccc86aa276 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:02.469236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6a4fde5c-3eb6-494a-98b6-2bccc86aa276 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:02.480785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a4fde5c-3eb6-494a-98b6-2bccc86aa276 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:02.481329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a4fde5c-3eb6-494a-98b6-2bccc86aa276 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:02.481800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a4fde5c-3eb6-494a-98b6-2bccc86aa276 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:02.485681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a4fde5c-3eb6-494a-98b6-2bccc86aa276 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:02.486545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a4fde5c-3eb6-494a-98b6-2bccc86aa276 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:02.491715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a4fde5c-3eb6-494a-98b6-2bccc86aa276 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:03.907313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6a4fde5c-3eb6-494a-98b6-2bccc86aa276 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:03.929317 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6a4fde5c-3eb6-494a-98b6-2bccc86aa276 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1352 microversion: 2.1 time: 1.461233 Oct 10 23:35:03.930466 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1874/3842] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:02 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1352 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:35:03.961861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cf1516cd-d098-4903-b63e-a3b172f57099 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:03.962487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cf1516cd-d098-4903-b63e-a3b172f57099 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:03.979191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf1516cd-d098-4903-b63e-a3b172f57099 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:03.979703 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf1516cd-d098-4903-b63e-a3b172f57099 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:03.980178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf1516cd-d098-4903-b63e-a3b172f57099 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:03.980872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf1516cd-d098-4903-b63e-a3b172f57099 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:03.981349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf1516cd-d098-4903-b63e-a3b172f57099 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:03.985473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf1516cd-d098-4903-b63e-a3b172f57099 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:04.316259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cf1516cd-d098-4903-b63e-a3b172f57099 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:04.334810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cf1516cd-d098-4903-b63e-a3b172f57099 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:04.338249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cf1516cd-d098-4903-b63e-a3b172f57099 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:04.354661 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cf1516cd-d098-4903-b63e-a3b172f57099 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1809 microversion: 2.20 time: 0.393915 Oct 10 23:35:04.358528 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1875/3843] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:03 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1809 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:04.970004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-952b2e8c-80bc-45ee-be4d-236079a00fe5 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:04.972619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-952b2e8c-80bc-45ee-be4d-236079a00fe5 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:05.022620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-952b2e8c-80bc-45ee-be4d-236079a00fe5 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:05.023534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-952b2e8c-80bc-45ee-be4d-236079a00fe5 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:05.043238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-952b2e8c-80bc-45ee-be4d-236079a00fe5 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:05.045067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-952b2e8c-80bc-45ee-be4d-236079a00fe5 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:05.051803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-952b2e8c-80bc-45ee-be4d-236079a00fe5 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:05.055737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-952b2e8c-80bc-45ee-be4d-236079a00fe5 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:05.894168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-952b2e8c-80bc-45ee-be4d-236079a00fe5 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:05.936864 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-952b2e8c-80bc-45ee-be4d-236079a00fe5 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1352 microversion: 2.1 time: 0.974893 Oct 10 23:35:05.957232 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1876/3844] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:04 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1352 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:35:05.991203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2c80fe43-f9fa-4a58-a7f3-8192aca6d31a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:05.992230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2c80fe43-f9fa-4a58-a7f3-8192aca6d31a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:06.021181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c80fe43-f9fa-4a58-a7f3-8192aca6d31a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:06.025827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c80fe43-f9fa-4a58-a7f3-8192aca6d31a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:06.026665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c80fe43-f9fa-4a58-a7f3-8192aca6d31a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:06.027988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c80fe43-f9fa-4a58-a7f3-8192aca6d31a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:06.034716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c80fe43-f9fa-4a58-a7f3-8192aca6d31a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:06.035592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c80fe43-f9fa-4a58-a7f3-8192aca6d31a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:06.408237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=22 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:35:06.488266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2c80fe43-f9fa-4a58-a7f3-8192aca6d31a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:06.532749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2c80fe43-f9fa-4a58-a7f3-8192aca6d31a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:06.535303 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2c80fe43-f9fa-4a58-a7f3-8192aca6d31a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:06.537132 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2c80fe43-f9fa-4a58-a7f3-8192aca6d31a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1809 microversion: 2.20 time: 0.569838 Oct 10 23:35:06.539674 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1877/3845] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:05 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1809 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:06.992220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-21223469-ef2a-4667-98d5-c717efcf5f65 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:06.993209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-21223469-ef2a-4667-98d5-c717efcf5f65 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:07.020866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21223469-ef2a-4667-98d5-c717efcf5f65 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:07.021445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21223469-ef2a-4667-98d5-c717efcf5f65 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:07.021903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21223469-ef2a-4667-98d5-c717efcf5f65 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:07.027048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21223469-ef2a-4667-98d5-c717efcf5f65 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:07.027538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21223469-ef2a-4667-98d5-c717efcf5f65 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:07.030022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21223469-ef2a-4667-98d5-c717efcf5f65 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:07.602388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-21223469-ef2a-4667-98d5-c717efcf5f65 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:07.608759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:35:07.633926 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-21223469-ef2a-4667-98d5-c717efcf5f65 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1352 microversion: 2.1 time: 0.647790 Oct 10 23:35:07.635739 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1878/3846] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:06 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1352 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:35:07.654944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a6de3d6a-b226-405d-8098-edeeb163a0b5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:07.656764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a6de3d6a-b226-405d-8098-edeeb163a0b5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:07.675871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6de3d6a-b226-405d-8098-edeeb163a0b5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:07.676400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6de3d6a-b226-405d-8098-edeeb163a0b5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:07.678666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6de3d6a-b226-405d-8098-edeeb163a0b5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:07.679655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6de3d6a-b226-405d-8098-edeeb163a0b5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:07.683933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6de3d6a-b226-405d-8098-edeeb163a0b5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:07.685045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6de3d6a-b226-405d-8098-edeeb163a0b5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:07.847924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-ae1bb442-cb55-49f0-a6e1-b8dfeccc451f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:35:07.848599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-ae1bb442-cb55-49f0-a6e1-b8dfeccc451f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:35:07.848777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-ae1bb442-cb55-49f0-a6e1-b8dfeccc451f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:35:07.849134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-ae1bb442-cb55-49f0-a6e1-b8dfeccc451f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:35:07.864988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-ae1bb442-cb55-49f0-a6e1-b8dfeccc451f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:35:07.882514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=28 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:35:07.910126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae1bb442-cb55-49f0-a6e1-b8dfeccc451f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:07.937843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae1bb442-cb55-49f0-a6e1-b8dfeccc451f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:07.939146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae1bb442-cb55-49f0-a6e1-b8dfeccc451f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:07.940213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae1bb442-cb55-49f0-a6e1-b8dfeccc451f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:07.941171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae1bb442-cb55-49f0-a6e1-b8dfeccc451f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:07.941819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae1bb442-cb55-49f0-a6e1-b8dfeccc451f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:08.025284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-ae1bb442-cb55-49f0-a6e1-b8dfeccc451f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Getting quotas for project e304771fabdc4108aef00b2e4c4b7c70. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:35:08.032033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-ae1bb442-cb55-49f0-a6e1-b8dfeccc451f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Getting quotas for user c18b5a7071d34eca9bd7915250027f99 and project e304771fabdc4108aef00b2e4c4b7c70. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:35:08.330022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a6de3d6a-b226-405d-8098-edeeb163a0b5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:08.373116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a6de3d6a-b226-405d-8098-edeeb163a0b5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:08.381883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a6de3d6a-b226-405d-8098-edeeb163a0b5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:08.385931 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a6de3d6a-b226-405d-8098-edeeb163a0b5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1809 microversion: 2.20 time: 0.745910 Oct 10 23:35:08.386554 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1879/3847] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:07 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1809 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:08.464998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ae1bb442-cb55-49f0-a6e1-b8dfeccc451f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:35:08.468178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ae1bb442-cb55-49f0-a6e1-b8dfeccc451f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='73dc687b-5e05-420e-bf88-f3a5ceeb108b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='9b4c7387-6ce3-4f81-a6f4-b76ab7bcad6b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0ca58c73-443b-4715-a631-0f4d2b48401f',volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:35:08.679492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-faf30c4e-fb54-41fe-876c-c512a158d5a5 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:08.680119 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-faf30c4e-fb54-41fe-876c-c512a158d5a5 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:08.690047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faf30c4e-fb54-41fe-876c-c512a158d5a5 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:08.694654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faf30c4e-fb54-41fe-876c-c512a158d5a5 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:08.696578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faf30c4e-fb54-41fe-876c-c512a158d5a5 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:08.701107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faf30c4e-fb54-41fe-876c-c512a158d5a5 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:08.702496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faf30c4e-fb54-41fe-876c-c512a158d5a5 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:08.703603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faf30c4e-fb54-41fe-876c-c512a158d5a5 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:09.272251 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ae1bb442-cb55-49f0-a6e1-b8dfeccc451f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 12.853888 Oct 10 23:35:09.276222 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1969/3848] 10.222.0.23 () {62 vars in 1189 bytes} [Mon Oct 10 23:34:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 12858 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 23:35:09.293652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f75df929-8157-49a9-a2ee-e92f5a525f34 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:09.297836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f75df929-8157-49a9-a2ee-e92f5a525f34 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:09.486475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f75df929-8157-49a9-a2ee-e92f5a525f34 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:09.507214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f75df929-8157-49a9-a2ee-e92f5a525f34 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:09.513940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f75df929-8157-49a9-a2ee-e92f5a525f34 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:09.516970 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f75df929-8157-49a9-a2ee-e92f5a525f34 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1285 microversion: 2.42 time: 0.232597 Oct 10 23:35:09.519309 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1970/3849] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:09 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1285 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:09.528998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d369ffc3-e6a6-47d0-845b-dda7c03f30dc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:09.530813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d369ffc3-e6a6-47d0-845b-dda7c03f30dc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:09.544032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d369ffc3-e6a6-47d0-845b-dda7c03f30dc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:09.545496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d369ffc3-e6a6-47d0-845b-dda7c03f30dc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:09.546883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d369ffc3-e6a6-47d0-845b-dda7c03f30dc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:09.548739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d369ffc3-e6a6-47d0-845b-dda7c03f30dc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:09.550017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d369ffc3-e6a6-47d0-845b-dda7c03f30dc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:09.551427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d369ffc3-e6a6-47d0-845b-dda7c03f30dc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:09.586983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-faf30c4e-fb54-41fe-876c-c512a158d5a5 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:09.628853 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-faf30c4e-fb54-41fe-876c-c512a158d5a5 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1352 microversion: 2.1 time: 0.951528 Oct 10 23:35:09.632627 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1880/3850] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:08 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1352 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:35:10.201817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d369ffc3-e6a6-47d0-845b-dda7c03f30dc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:10.233125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d369ffc3-e6a6-47d0-845b-dda7c03f30dc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:10.245030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d369ffc3-e6a6-47d0-845b-dda7c03f30dc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:10.249827 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d369ffc3-e6a6-47d0-845b-dda7c03f30dc tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1809 microversion: 2.20 time: 0.728093 Oct 10 23:35:10.255918 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1971/3851] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:09 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1809 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:10.563918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-38a3f0d1-032a-47a9-953a-bea3e1743125 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:10.568567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-38a3f0d1-032a-47a9-953a-bea3e1743125 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:10.666578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e1b244e3-e695-4722-98f3-793b33ece148 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:10.671256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e1b244e3-e695-4722-98f3-793b33ece148 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:10.717135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1b244e3-e695-4722-98f3-793b33ece148 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:10.723455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1b244e3-e695-4722-98f3-793b33ece148 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:10.725944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1b244e3-e695-4722-98f3-793b33ece148 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:10.734270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1b244e3-e695-4722-98f3-793b33ece148 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:10.735839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1b244e3-e695-4722-98f3-793b33ece148 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:10.736908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1b244e3-e695-4722-98f3-793b33ece148 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:11.189358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-38a3f0d1-032a-47a9-953a-bea3e1743125 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:11.217476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-38a3f0d1-032a-47a9-953a-bea3e1743125 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:11.227400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-38a3f0d1-032a-47a9-953a-bea3e1743125 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:11.228813 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-38a3f0d1-032a-47a9-953a-bea3e1743125 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1285 microversion: 2.42 time: 0.681645 Oct 10 23:35:11.232474 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1881/3852] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:10 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1285 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:35:11.309399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e94134b8-3c5a-482c-81c5-1d4d2958ae3c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:11.310024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e94134b8-3c5a-482c-81c5-1d4d2958ae3c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:11.327101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e94134b8-3c5a-482c-81c5-1d4d2958ae3c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:11.327354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e94134b8-3c5a-482c-81c5-1d4d2958ae3c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:11.327595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e94134b8-3c5a-482c-81c5-1d4d2958ae3c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:11.334112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e94134b8-3c5a-482c-81c5-1d4d2958ae3c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:11.334920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e94134b8-3c5a-482c-81c5-1d4d2958ae3c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:11.335632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e94134b8-3c5a-482c-81c5-1d4d2958ae3c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:11.862457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e1b244e3-e695-4722-98f3-793b33ece148 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:11.870813 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e1b244e3-e695-4722-98f3-793b33ece148 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1352 microversion: 2.1 time: 1.214066 Oct 10 23:35:11.871413 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1972/3853] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:10 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1352 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:12.280937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6d2381d1-69bf-4ec3-aa15-1ef7adf27f10 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:12.281917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6d2381d1-69bf-4ec3-aa15-1ef7adf27f10 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:12.296793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d2381d1-69bf-4ec3-aa15-1ef7adf27f10 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:12.297843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d2381d1-69bf-4ec3-aa15-1ef7adf27f10 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:12.299291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d2381d1-69bf-4ec3-aa15-1ef7adf27f10 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:12.302502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d2381d1-69bf-4ec3-aa15-1ef7adf27f10 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:12.304184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d2381d1-69bf-4ec3-aa15-1ef7adf27f10 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:12.305388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d2381d1-69bf-4ec3-aa15-1ef7adf27f10 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:12.451092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e94134b8-3c5a-482c-81c5-1d4d2958ae3c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:12.462682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e94134b8-3c5a-482c-81c5-1d4d2958ae3c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:12.466066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e94134b8-3c5a-482c-81c5-1d4d2958ae3c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:12.476359 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e94134b8-3c5a-482c-81c5-1d4d2958ae3c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1809 microversion: 2.20 time: 1.170680 Oct 10 23:35:12.477155 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1882/3854] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:11 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1809 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:35:12.897324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f10d5d58-ca70-47c6-98bd-272f4e66f008 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:12.898758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f10d5d58-ca70-47c6-98bd-272f4e66f008 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:12.903626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6d2381d1-69bf-4ec3-aa15-1ef7adf27f10 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:12.935316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6d2381d1-69bf-4ec3-aa15-1ef7adf27f10 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:12.937467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f10d5d58-ca70-47c6-98bd-272f4e66f008 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:12.939553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6d2381d1-69bf-4ec3-aa15-1ef7adf27f10 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:12.941911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f10d5d58-ca70-47c6-98bd-272f4e66f008 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:12.943572 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6d2381d1-69bf-4ec3-aa15-1ef7adf27f10 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1583 microversion: 2.42 time: 0.667143 Oct 10 23:35:12.945473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f10d5d58-ca70-47c6-98bd-272f4e66f008 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:12.949719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f10d5d58-ca70-47c6-98bd-272f4e66f008 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:12.952037 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1973/3855] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:12 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1583 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:35:12.952829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f10d5d58-ca70-47c6-98bd-272f4e66f008 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:12.955618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f10d5d58-ca70-47c6-98bd-272f4e66f008 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:13.508237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d43b828c-b083-4448-8f91-43d611eed868 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:13.508866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d43b828c-b083-4448-8f91-43d611eed868 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:13.530138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d43b828c-b083-4448-8f91-43d611eed868 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:13.530676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d43b828c-b083-4448-8f91-43d611eed868 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:13.532627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d43b828c-b083-4448-8f91-43d611eed868 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:13.533620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d43b828c-b083-4448-8f91-43d611eed868 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:13.536550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d43b828c-b083-4448-8f91-43d611eed868 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:13.537226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d43b828c-b083-4448-8f91-43d611eed868 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:14.155022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f10d5d58-ca70-47c6-98bd-272f4e66f008 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:14.164560 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f10d5d58-ca70-47c6-98bd-272f4e66f008 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1352 microversion: 2.1 time: 1.271862 Oct 10 23:35:14.180732 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1883/3856] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:12 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1352 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:14.185919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1f370e7c-d2f4-4040-af11-50fde6e0e8ee tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:14.187057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1f370e7c-d2f4-4040-af11-50fde6e0e8ee tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:14.200660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f370e7c-d2f4-4040-af11-50fde6e0e8ee tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:14.205757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f370e7c-d2f4-4040-af11-50fde6e0e8ee tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:14.206836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f370e7c-d2f4-4040-af11-50fde6e0e8ee tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:14.208100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f370e7c-d2f4-4040-af11-50fde6e0e8ee tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:14.208684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f370e7c-d2f4-4040-af11-50fde6e0e8ee tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:14.209219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f370e7c-d2f4-4040-af11-50fde6e0e8ee tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:14.418090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d43b828c-b083-4448-8f91-43d611eed868 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:14.434297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d43b828c-b083-4448-8f91-43d611eed868 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:14.440854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d43b828c-b083-4448-8f91-43d611eed868 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:14.443461 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d43b828c-b083-4448-8f91-43d611eed868 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1809 microversion: 2.20 time: 0.940427 Oct 10 23:35:14.448435 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1974/3857] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:13 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1809 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:35:14.588265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1f370e7c-d2f4-4040-af11-50fde6e0e8ee tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:14.660951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1f370e7c-d2f4-4040-af11-50fde6e0e8ee tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:14.664985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1f370e7c-d2f4-4040-af11-50fde6e0e8ee tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:14.673971 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1f370e7c-d2f4-4040-af11-50fde6e0e8ee tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1593 microversion: 2.42 time: 0.502422 Oct 10 23:35:14.676353 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1884/3858] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:14 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1593 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:15.193056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7bed9cf7-778d-4b8c-acb7-6c125d6e9a72 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:15.200265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7bed9cf7-778d-4b8c-acb7-6c125d6e9a72 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:15.240159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bed9cf7-778d-4b8c-acb7-6c125d6e9a72 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:15.241667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bed9cf7-778d-4b8c-acb7-6c125d6e9a72 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:15.249029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bed9cf7-778d-4b8c-acb7-6c125d6e9a72 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:15.260634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bed9cf7-778d-4b8c-acb7-6c125d6e9a72 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:15.275832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bed9cf7-778d-4b8c-acb7-6c125d6e9a72 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:15.276739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bed9cf7-778d-4b8c-acb7-6c125d6e9a72 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:15.480792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-76921fe7-1178-4d4a-a49e-fa79541ac04b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:15.483909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-76921fe7-1178-4d4a-a49e-fa79541ac04b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:15.517039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76921fe7-1178-4d4a-a49e-fa79541ac04b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:15.521069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76921fe7-1178-4d4a-a49e-fa79541ac04b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:15.522155 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76921fe7-1178-4d4a-a49e-fa79541ac04b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:15.529668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76921fe7-1178-4d4a-a49e-fa79541ac04b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:15.530972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76921fe7-1178-4d4a-a49e-fa79541ac04b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:15.532061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76921fe7-1178-4d4a-a49e-fa79541ac04b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:16.228909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-76921fe7-1178-4d4a-a49e-fa79541ac04b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:16.247398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-76921fe7-1178-4d4a-a49e-fa79541ac04b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:16.251854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-76921fe7-1178-4d4a-a49e-fa79541ac04b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:16.256555 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-76921fe7-1178-4d4a-a49e-fa79541ac04b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1809 microversion: 2.20 time: 0.780527 Oct 10 23:35:16.287619 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1885/3859] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:15 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1809 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:16.293399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e007dbbd-f68a-4379-8342-6684d3b2eb66 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:16.294638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e007dbbd-f68a-4379-8342-6684d3b2eb66 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:16.313835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e007dbbd-f68a-4379-8342-6684d3b2eb66 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:16.314414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e007dbbd-f68a-4379-8342-6684d3b2eb66 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:16.314882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e007dbbd-f68a-4379-8342-6684d3b2eb66 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:16.324849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e007dbbd-f68a-4379-8342-6684d3b2eb66 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:16.327588 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e007dbbd-f68a-4379-8342-6684d3b2eb66 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:16.331522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e007dbbd-f68a-4379-8342-6684d3b2eb66 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:16.608228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7bed9cf7-778d-4b8c-acb7-6c125d6e9a72 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:16.638699 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7bed9cf7-778d-4b8c-acb7-6c125d6e9a72 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1352 microversion: 2.1 time: 1.453092 Oct 10 23:35:16.649833 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1975/3860] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:15 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1352 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:16.658818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-61178ce4-2533-487d-b1f4-f6d74652a515 req-a5492d51-ea41-4a4e-be4b-1b76ac2a9a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bd745fa-6826-4bd1-8f8d-ae65071fac12", "name": "network-vif-plugged", "status": "completed", "tag": "9a900297-53e2-4782-8def-24d4260702d5"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:35:16.706675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-61178ce4-2533-487d-b1f4-f6d74652a515 req-a5492d51-ea41-4a4e-be4b-1b76ac2a9a19 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:16.709753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-61178ce4-2533-487d-b1f4-f6d74652a515 req-a5492d51-ea41-4a4e-be4b-1b76ac2a9a19 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:16.710476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-61178ce4-2533-487d-b1f4-f6d74652a515 req-a5492d51-ea41-4a4e-be4b-1b76ac2a9a19 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:16.743654 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-61178ce4-2533-487d-b1f4-f6d74652a515 req-a5492d51-ea41-4a4e-be4b-1b76ac2a9a19 service nova] Creating event network-vif-plugged:9a900297-53e2-4782-8def-24d4260702d5 for instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 on n-h2-860864-2 Oct 10 23:35:16.756041 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-61178ce4-2533-487d-b1f4-f6d74652a515 req-a5492d51-ea41-4a4e-be4b-1b76ac2a9a19 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100148 Oct 10 23:35:16.759911 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1976/3861] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:35:17.202698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e007dbbd-f68a-4379-8342-6684d3b2eb66 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:17.216191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e007dbbd-f68a-4379-8342-6684d3b2eb66 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:17.223037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e007dbbd-f68a-4379-8342-6684d3b2eb66 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:17.225716 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e007dbbd-f68a-4379-8342-6684d3b2eb66 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1593 microversion: 2.42 time: 0.936522 Oct 10 23:35:17.226592 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1886/3862] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:16 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1593 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:17.299105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b93a5388-0c4d-4eb5-915d-35349dc9cd1b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:17.300251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b93a5388-0c4d-4eb5-915d-35349dc9cd1b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:17.328254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b93a5388-0c4d-4eb5-915d-35349dc9cd1b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:17.328991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b93a5388-0c4d-4eb5-915d-35349dc9cd1b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:17.329822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b93a5388-0c4d-4eb5-915d-35349dc9cd1b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:17.330785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b93a5388-0c4d-4eb5-915d-35349dc9cd1b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:17.332124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b93a5388-0c4d-4eb5-915d-35349dc9cd1b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:17.332780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b93a5388-0c4d-4eb5-915d-35349dc9cd1b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:17.665081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b93a5388-0c4d-4eb5-915d-35349dc9cd1b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:17.685731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0783187b-3b26-46af-b632-da898b198e7b tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:17.687067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0783187b-3b26-46af-b632-da898b198e7b tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:17.722770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b93a5388-0c4d-4eb5-915d-35349dc9cd1b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:17.724593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0783187b-3b26-46af-b632-da898b198e7b tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:17.730611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0783187b-3b26-46af-b632-da898b198e7b tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:17.731575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0783187b-3b26-46af-b632-da898b198e7b tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:17.738896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b93a5388-0c4d-4eb5-915d-35349dc9cd1b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:17.740487 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b93a5388-0c4d-4eb5-915d-35349dc9cd1b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1809 microversion: 2.20 time: 0.456527 Oct 10 23:35:17.741207 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0783187b-3b26-46af-b632-da898b198e7b tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:17.742381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0783187b-3b26-46af-b632-da898b198e7b tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:17.744266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0783187b-3b26-46af-b632-da898b198e7b tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:17.755831 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1977/3863] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:17 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1809 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:18.194205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0783187b-3b26-46af-b632-da898b198e7b tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:18.217459 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0783187b-3b26-46af-b632-da898b198e7b tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1352 microversion: 2.1 time: 0.538049 Oct 10 23:35:18.225869 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1887/3864] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:17 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1352 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:18.256305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-de658c17-0bd4-404d-acb1-db07190d84f5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:18.256939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-de658c17-0bd4-404d-acb1-db07190d84f5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:18.260071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:35:18.265177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de658c17-0bd4-404d-acb1-db07190d84f5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:18.266086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de658c17-0bd4-404d-acb1-db07190d84f5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:18.267011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de658c17-0bd4-404d-acb1-db07190d84f5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:18.268113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de658c17-0bd4-404d-acb1-db07190d84f5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:18.269226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de658c17-0bd4-404d-acb1-db07190d84f5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:18.269885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de658c17-0bd4-404d-acb1-db07190d84f5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:18.776129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bdc07564-707e-453d-81ef-3ecc2432f3f4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:18.776852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bdc07564-707e-453d-81ef-3ecc2432f3f4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:18.780025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:35:18.795517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdc07564-707e-453d-81ef-3ecc2432f3f4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:18.806881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdc07564-707e-453d-81ef-3ecc2432f3f4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:18.807353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdc07564-707e-453d-81ef-3ecc2432f3f4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:18.808125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdc07564-707e-453d-81ef-3ecc2432f3f4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:18.808603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdc07564-707e-453d-81ef-3ecc2432f3f4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:18.809089 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bdc07564-707e-453d-81ef-3ecc2432f3f4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:19.225147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-de658c17-0bd4-404d-acb1-db07190d84f5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:19.236819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-de658c17-0bd4-404d-acb1-db07190d84f5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:19.241178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-de658c17-0bd4-404d-acb1-db07190d84f5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:19.243529 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-de658c17-0bd4-404d-acb1-db07190d84f5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1661 microversion: 2.42 time: 0.991906 Oct 10 23:35:19.244198 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1978/3865] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:18 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1661 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:35:19.251826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-c7882ffb-ff32-48d1-a82f-373741166a44 req-b2ae7220-574f-4157-a4e0-ee080ef353f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00dec699-50e1-4f85-9274-c8a2b115f13c", "name": "network-vif-plugged", "status": "completed", "tag": "ad7cc15e-cb3c-4db4-b0e3-9e9e677aedb1"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:35:19.287610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c7882ffb-ff32-48d1-a82f-373741166a44 req-b2ae7220-574f-4157-a4e0-ee080ef353f1 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:19.291054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c7882ffb-ff32-48d1-a82f-373741166a44 req-b2ae7220-574f-4157-a4e0-ee080ef353f1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:19.292373 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c7882ffb-ff32-48d1-a82f-373741166a44 req-b2ae7220-574f-4157-a4e0-ee080ef353f1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:19.374575 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-c7882ffb-ff32-48d1-a82f-373741166a44 req-b2ae7220-574f-4157-a4e0-ee080ef353f1 service nova] Creating event network-vif-plugged:ad7cc15e-cb3c-4db4-b0e3-9e9e677aedb1 for instance 00dec699-50e1-4f85-9274-c8a2b115f13c on n-h1-860864-2 Oct 10 23:35:19.393246 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-c7882ffb-ff32-48d1-a82f-373741166a44 req-b2ae7220-574f-4157-a4e0-ee080ef353f1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145610 Oct 10 23:35:19.411444 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1979/3866] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:35:19.442621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b6240e0e-a9c7-4e18-ba76-953e1d8660b6 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:19.447252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b6240e0e-a9c7-4e18-ba76-953e1d8660b6 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:19.468293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6240e0e-a9c7-4e18-ba76-953e1d8660b6 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:19.500440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6240e0e-a9c7-4e18-ba76-953e1d8660b6 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:19.502306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6240e0e-a9c7-4e18-ba76-953e1d8660b6 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:19.510371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6240e0e-a9c7-4e18-ba76-953e1d8660b6 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:19.510884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6240e0e-a9c7-4e18-ba76-953e1d8660b6 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:19.511343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6240e0e-a9c7-4e18-ba76-953e1d8660b6 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:19.512939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:35:20.419271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b6240e0e-a9c7-4e18-ba76-953e1d8660b6 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:20.441578 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b6240e0e-a9c7-4e18-ba76-953e1d8660b6 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1352 microversion: 2.1 time: 1.027483 Oct 10 23:35:20.444598 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1980/3867] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:19 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1352 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:20.466750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-45e09289-ed99-4e2e-b6de-8d0bcac6d02c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:20.469074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bdc07564-707e-453d-81ef-3ecc2432f3f4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:20.474037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-45e09289-ed99-4e2e-b6de-8d0bcac6d02c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:20.482943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45e09289-ed99-4e2e-b6de-8d0bcac6d02c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:20.484007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45e09289-ed99-4e2e-b6de-8d0bcac6d02c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:20.484291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bdc07564-707e-453d-81ef-3ecc2432f3f4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:20.485405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45e09289-ed99-4e2e-b6de-8d0bcac6d02c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:20.486686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45e09289-ed99-4e2e-b6de-8d0bcac6d02c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:20.487937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45e09289-ed99-4e2e-b6de-8d0bcac6d02c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:20.488618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45e09289-ed99-4e2e-b6de-8d0bcac6d02c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:20.496193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bdc07564-707e-453d-81ef-3ecc2432f3f4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:20.497502 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bdc07564-707e-453d-81ef-3ecc2432f3f4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1809 microversion: 2.20 time: 1.725533 Oct 10 23:35:20.500951 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1888/3868] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:18 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1809 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:21.151858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-45e09289-ed99-4e2e-b6de-8d0bcac6d02c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:21.190962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-45e09289-ed99-4e2e-b6de-8d0bcac6d02c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:21.201196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-45e09289-ed99-4e2e-b6de-8d0bcac6d02c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:21.230550 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-45e09289-ed99-4e2e-b6de-8d0bcac6d02c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1661 microversion: 2.42 time: 0.771747 Oct 10 23:35:21.246098 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1981/3869] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:20 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1661 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:21.472098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-30dc69d5-ebf2-442c-80ec-c4cac164413c tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:21.472842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-30dc69d5-ebf2-442c-80ec-c4cac164413c tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:21.488519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:35:21.499699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30dc69d5-ebf2-442c-80ec-c4cac164413c tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:21.500498 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30dc69d5-ebf2-442c-80ec-c4cac164413c tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:21.505537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30dc69d5-ebf2-442c-80ec-c4cac164413c tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:21.508083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30dc69d5-ebf2-442c-80ec-c4cac164413c tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:21.514254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30dc69d5-ebf2-442c-80ec-c4cac164413c tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:21.518269 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30dc69d5-ebf2-442c-80ec-c4cac164413c tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:21.538267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1b99bd6a-ab8c-4f93-b4a2-5cb849027e35 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:21.542729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1b99bd6a-ab8c-4f93-b4a2-5cb849027e35 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:21.594796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b99bd6a-ab8c-4f93-b4a2-5cb849027e35 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:21.596217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b99bd6a-ab8c-4f93-b4a2-5cb849027e35 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:21.598100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b99bd6a-ab8c-4f93-b4a2-5cb849027e35 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:21.599864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b99bd6a-ab8c-4f93-b4a2-5cb849027e35 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:21.601057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b99bd6a-ab8c-4f93-b4a2-5cb849027e35 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:21.602237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b99bd6a-ab8c-4f93-b4a2-5cb849027e35 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:23.181523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1b99bd6a-ab8c-4f93-b4a2-5cb849027e35 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:23.196338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1b99bd6a-ab8c-4f93-b4a2-5cb849027e35 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:23.198865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1b99bd6a-ab8c-4f93-b4a2-5cb849027e35 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:23.199447 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1b99bd6a-ab8c-4f93-b4a2-5cb849027e35 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1796 microversion: 2.20 time: 1.670239 Oct 10 23:35:23.200048 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1982/3870] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:21 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1796 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:23.217779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d0436728-f7e5-494a-b813-bed28a7930bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:23.230415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d0436728-f7e5-494a-b813-bed28a7930bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:23.258296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0436728-f7e5-494a-b813-bed28a7930bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:23.262187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0436728-f7e5-494a-b813-bed28a7930bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:23.262875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0436728-f7e5-494a-b813-bed28a7930bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:23.266184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0436728-f7e5-494a-b813-bed28a7930bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:23.266945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0436728-f7e5-494a-b813-bed28a7930bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:23.274207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0436728-f7e5-494a-b813-bed28a7930bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:23.330501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-30dc69d5-ebf2-442c-80ec-c4cac164413c tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:23.353256 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-30dc69d5-ebf2-442c-80ec-c4cac164413c tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1352 microversion: 2.1 time: 1.874167 Oct 10 23:35:23.355956 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1889/3871] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:21 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1352 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:24.133199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d0436728-f7e5-494a-b813-bed28a7930bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:24.155557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d0436728-f7e5-494a-b813-bed28a7930bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:24.157286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d0436728-f7e5-494a-b813-bed28a7930bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:24.159469 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d0436728-f7e5-494a-b813-bed28a7930bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1661 microversion: 2.42 time: 0.947005 Oct 10 23:35:24.170635 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1983/3872] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:23 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1661 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:24.400092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-23c15097-060a-47c6-9f56-8976eedabdab tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:24.400895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-23c15097-060a-47c6-9f56-8976eedabdab tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:24.442744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23c15097-060a-47c6-9f56-8976eedabdab tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:24.443299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23c15097-060a-47c6-9f56-8976eedabdab tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:24.443732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23c15097-060a-47c6-9f56-8976eedabdab tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:24.444509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23c15097-060a-47c6-9f56-8976eedabdab tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:24.444987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23c15097-060a-47c6-9f56-8976eedabdab tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:24.445462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23c15097-060a-47c6-9f56-8976eedabdab tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:25.220874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9d3e2c04-bc95-4ce8-a1a7-e5e29a044452 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2073019157", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "d3777005-851a-44f1-be2b-d4f3d09bbf72"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:35:25.364411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-9d3e2c04-bc95-4ce8-a1a7-e5e29a044452 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] validate_networks() for [('d3777005-851a-44f1-be2b-d4f3d09bbf72', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:35:25.870367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-23c15097-060a-47c6-9f56-8976eedabdab tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:25.912771 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-23c15097-060a-47c6-9f56-8976eedabdab tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1542 microversion: 2.1 time: 1.516637 Oct 10 23:35:25.920225 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1890/3873] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:24 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1542 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:35:25.972703 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7680aad3-a8cf-4215-8fed-fb66698d88be tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:25.973344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7680aad3-a8cf-4215-8fed-fb66698d88be tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:26.012462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7680aad3-a8cf-4215-8fed-fb66698d88be tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:26.013305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7680aad3-a8cf-4215-8fed-fb66698d88be tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:26.013485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7680aad3-a8cf-4215-8fed-fb66698d88be tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:26.014167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7680aad3-a8cf-4215-8fed-fb66698d88be tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:26.014634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7680aad3-a8cf-4215-8fed-fb66698d88be tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:26.015066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7680aad3-a8cf-4215-8fed-fb66698d88be tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:26.763063 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7680aad3-a8cf-4215-8fed-fb66698d88be tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:26.806941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7680aad3-a8cf-4215-8fed-fb66698d88be tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:26.825483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7680aad3-a8cf-4215-8fed-fb66698d88be tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:26.827122 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7680aad3-a8cf-4215-8fed-fb66698d88be tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1708 microversion: 2.42 time: 0.903669 Oct 10 23:35:26.845561 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1891/3874] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:25 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1708 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:26.845561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-98660653-5fde-4b2e-9ec7-af0ea2ddd1d1 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:26.845561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-98660653-5fde-4b2e-9ec7-af0ea2ddd1d1 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:26.861553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98660653-5fde-4b2e-9ec7-af0ea2ddd1d1 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:26.861553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98660653-5fde-4b2e-9ec7-af0ea2ddd1d1 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:26.861553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98660653-5fde-4b2e-9ec7-af0ea2ddd1d1 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:26.861553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98660653-5fde-4b2e-9ec7-af0ea2ddd1d1 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:26.861553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98660653-5fde-4b2e-9ec7-af0ea2ddd1d1 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:26.861553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98660653-5fde-4b2e-9ec7-af0ea2ddd1d1 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:27.359559 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-98660653-5fde-4b2e-9ec7-af0ea2ddd1d1 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.526966 Oct 10 23:35:27.364686 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1892/3875] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Oct 10 23:35:26 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c/os-interface => generated 284 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:35:27.877193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-06eda00d-b719-474b-b69b-89e093534a3e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:27.883933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-06eda00d-b719-474b-b69b-89e093534a3e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:27.894158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06eda00d-b719-474b-b69b-89e093534a3e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:27.900850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06eda00d-b719-474b-b69b-89e093534a3e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:27.904392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06eda00d-b719-474b-b69b-89e093534a3e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:27.905611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06eda00d-b719-474b-b69b-89e093534a3e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:27.910703 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06eda00d-b719-474b-b69b-89e093534a3e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:27.911588 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06eda00d-b719-474b-b69b-89e093534a3e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:28.488530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-9d3e2c04-bc95-4ce8-a1a7-e5e29a044452 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:35:28.489352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-9d3e2c04-bc95-4ce8-a1a7-e5e29a044452 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:35:28.489600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-9d3e2c04-bc95-4ce8-a1a7-e5e29a044452 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:35:28.490213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-9d3e2c04-bc95-4ce8-a1a7-e5e29a044452 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:35:28.490829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-9d3e2c04-bc95-4ce8-a1a7-e5e29a044452 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:35:28.503778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d3e2c04-bc95-4ce8-a1a7-e5e29a044452 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:28.508075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d3e2c04-bc95-4ce8-a1a7-e5e29a044452 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:28.508943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d3e2c04-bc95-4ce8-a1a7-e5e29a044452 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:28.510835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d3e2c04-bc95-4ce8-a1a7-e5e29a044452 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:28.513769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d3e2c04-bc95-4ce8-a1a7-e5e29a044452 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:28.514490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d3e2c04-bc95-4ce8-a1a7-e5e29a044452 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:28.558268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-9d3e2c04-bc95-4ce8-a1a7-e5e29a044452 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Getting quotas for project e7d42cb00f2544abbde09cae76f3e3a1. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:35:28.572237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-9d3e2c04-bc95-4ce8-a1a7-e5e29a044452 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Getting quotas for user 7cc066774b344a24a91fb41e990f5234 and project e7d42cb00f2544abbde09cae76f3e3a1. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:35:28.645471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9d3e2c04-bc95-4ce8-a1a7-e5e29a044452 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:35:28.645471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9d3e2c04-bc95-4ce8-a1a7-e5e29a044452 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:35:28.801838 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9d3e2c04-bc95-4ce8-a1a7-e5e29a044452 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.943905 Oct 10 23:35:28.803662 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1984/3876] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:35:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:35:28.841293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8169e9dd-1e91-4839-94c3-62692ebab0df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:28.844333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8169e9dd-1e91-4839-94c3-62692ebab0df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:29.212376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8169e9dd-1e91-4839-94c3-62692ebab0df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:29.225138 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8169e9dd-1e91-4839-94c3-62692ebab0df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5" status: 200 len: 1215 microversion: 2.1 time: 0.412885 Oct 10 23:35:29.226142 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1985/3877] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:28 2022] GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 => generated 1215 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:29.842322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-06eda00d-b719-474b-b69b-89e093534a3e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:29.863838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-06eda00d-b719-474b-b69b-89e093534a3e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:29.866193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-06eda00d-b719-474b-b69b-89e093534a3e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:29.879213 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-06eda00d-b719-474b-b69b-89e093534a3e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1755 microversion: 2.42 time: 2.006178 Oct 10 23:35:29.880619 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1893/3878] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:27 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1755 bytes in 2016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:35:30.257635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-82aafb0f-7c6c-45c4-a713-68c78adaa649 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:30.259823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-82aafb0f-7c6c-45c4-a713-68c78adaa649 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:30.288356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82aafb0f-7c6c-45c4-a713-68c78adaa649 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:30.293917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82aafb0f-7c6c-45c4-a713-68c78adaa649 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:30.294686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82aafb0f-7c6c-45c4-a713-68c78adaa649 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:30.295672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82aafb0f-7c6c-45c4-a713-68c78adaa649 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:30.298065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82aafb0f-7c6c-45c4-a713-68c78adaa649 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:30.298846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82aafb0f-7c6c-45c4-a713-68c78adaa649 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:30.491596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-82aafb0f-7c6c-45c4-a713-68c78adaa649 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:30.514902 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-82aafb0f-7c6c-45c4-a713-68c78adaa649 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5" status: 200 len: 1219 microversion: 2.1 time: 0.264423 Oct 10 23:35:30.516193 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1986/3879] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:30 2022] GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 => generated 1219 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:30.924832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9c6e7e12-2203-414f-b025-2a5c31e29814 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:30.925714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9c6e7e12-2203-414f-b025-2a5c31e29814 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:30.973992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c6e7e12-2203-414f-b025-2a5c31e29814 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:30.974976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c6e7e12-2203-414f-b025-2a5c31e29814 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:30.975859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c6e7e12-2203-414f-b025-2a5c31e29814 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:30.978262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c6e7e12-2203-414f-b025-2a5c31e29814 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:30.979831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c6e7e12-2203-414f-b025-2a5c31e29814 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:30.981908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c6e7e12-2203-414f-b025-2a5c31e29814 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:31.389926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9c6e7e12-2203-414f-b025-2a5c31e29814 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:31.405483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9c6e7e12-2203-414f-b025-2a5c31e29814 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:31.421410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9c6e7e12-2203-414f-b025-2a5c31e29814 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:31.423395 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9c6e7e12-2203-414f-b025-2a5c31e29814 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1755 microversion: 2.42 time: 0.513195 Oct 10 23:35:31.424856 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1894/3880] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:30 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1755 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:31.548862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9b29da65-db94-45e1-aa5d-8fa02d5abc37 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:31.551308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9b29da65-db94-45e1-aa5d-8fa02d5abc37 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:31.574342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b29da65-db94-45e1-aa5d-8fa02d5abc37 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:31.575477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b29da65-db94-45e1-aa5d-8fa02d5abc37 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:31.576457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b29da65-db94-45e1-aa5d-8fa02d5abc37 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:31.577589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b29da65-db94-45e1-aa5d-8fa02d5abc37 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:31.578538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b29da65-db94-45e1-aa5d-8fa02d5abc37 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:31.579211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b29da65-db94-45e1-aa5d-8fa02d5abc37 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:32.098964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9b29da65-db94-45e1-aa5d-8fa02d5abc37 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:32.112942 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9b29da65-db94-45e1-aa5d-8fa02d5abc37 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5" status: 200 len: 1285 microversion: 2.1 time: 0.569715 Oct 10 23:35:32.130634 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1987/3881] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:31 2022] GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 => generated 1285 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:32.268363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-922c9d5e-8130-4fbe-ae92-49509a4dafe1 req-f51b5fe1-69eb-4073-9c04-f781b04e4060 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00dec699-50e1-4f85-9274-c8a2b115f13c", "tag": "ad7cc15e-cb3c-4db4-b0e3-9e9e677aedb1"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:35:32.298586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-922c9d5e-8130-4fbe-ae92-49509a4dafe1 req-f51b5fe1-69eb-4073-9c04-f781b04e4060 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:32.302474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-922c9d5e-8130-4fbe-ae92-49509a4dafe1 req-f51b5fe1-69eb-4073-9c04-f781b04e4060 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:32.303811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-922c9d5e-8130-4fbe-ae92-49509a4dafe1 req-f51b5fe1-69eb-4073-9c04-f781b04e4060 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:32.332973 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-922c9d5e-8130-4fbe-ae92-49509a4dafe1 req-f51b5fe1-69eb-4073-9c04-f781b04e4060 service nova] Creating event network-changed:ad7cc15e-cb3c-4db4-b0e3-9e9e677aedb1 for instance 00dec699-50e1-4f85-9274-c8a2b115f13c on n-h1-860864-2 Oct 10 23:35:32.347060 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-922c9d5e-8130-4fbe-ae92-49509a4dafe1 req-f51b5fe1-69eb-4073-9c04-f781b04e4060 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080113 Oct 10 23:35:32.347733 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1895/3882] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:35:32.453981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-df87d782-bd4a-40d7-8584-04ccab07c838 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:32.454613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-df87d782-bd4a-40d7-8584-04ccab07c838 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:32.467224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df87d782-bd4a-40d7-8584-04ccab07c838 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:32.467733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df87d782-bd4a-40d7-8584-04ccab07c838 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:32.472702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df87d782-bd4a-40d7-8584-04ccab07c838 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:32.473670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df87d782-bd4a-40d7-8584-04ccab07c838 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:32.474169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df87d782-bd4a-40d7-8584-04ccab07c838 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:32.474618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df87d782-bd4a-40d7-8584-04ccab07c838 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:33.148595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8e1efb30-0f76-42ea-bb20-1a3f3f879158 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:33.149327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8e1efb30-0f76-42ea-bb20-1a3f3f879158 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:33.160040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e1efb30-0f76-42ea-bb20-1a3f3f879158 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:33.160549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e1efb30-0f76-42ea-bb20-1a3f3f879158 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:33.161008 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e1efb30-0f76-42ea-bb20-1a3f3f879158 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:33.168608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e1efb30-0f76-42ea-bb20-1a3f3f879158 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:33.169113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e1efb30-0f76-42ea-bb20-1a3f3f879158 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:33.169684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e1efb30-0f76-42ea-bb20-1a3f3f879158 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:33.462726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-df87d782-bd4a-40d7-8584-04ccab07c838 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:33.476208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-df87d782-bd4a-40d7-8584-04ccab07c838 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:33.478038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-df87d782-bd4a-40d7-8584-04ccab07c838 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:33.480075 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-df87d782-bd4a-40d7-8584-04ccab07c838 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1802 microversion: 2.42 time: 1.030206 Oct 10 23:35:33.501583 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1988/3883] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:32 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1802 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:33.830136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8e1efb30-0f76-42ea-bb20-1a3f3f879158 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:33.850703 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8e1efb30-0f76-42ea-bb20-1a3f3f879158 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5" status: 200 len: 1273 microversion: 2.1 time: 0.706859 Oct 10 23:35:33.851563 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1896/3884] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:33 2022] GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 => generated 1273 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:35:34.511545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a9a775c1-7498-4d29-9329-b27d6f5ea8c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:34.512893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a9a775c1-7498-4d29-9329-b27d6f5ea8c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:34.528590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a9a775c1-7498-4d29-9329-b27d6f5ea8c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:34.529482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a9a775c1-7498-4d29-9329-b27d6f5ea8c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:34.530775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a9a775c1-7498-4d29-9329-b27d6f5ea8c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:34.534172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a9a775c1-7498-4d29-9329-b27d6f5ea8c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:34.536782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a9a775c1-7498-4d29-9329-b27d6f5ea8c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:34.537732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a9a775c1-7498-4d29-9329-b27d6f5ea8c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:34.883056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1bba7f29-c0dd-41ef-865b-1adafd0a220f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:34.885088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1bba7f29-c0dd-41ef-865b-1adafd0a220f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:34.912123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bba7f29-c0dd-41ef-865b-1adafd0a220f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:34.913554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bba7f29-c0dd-41ef-865b-1adafd0a220f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:34.914331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bba7f29-c0dd-41ef-865b-1adafd0a220f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:34.915306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bba7f29-c0dd-41ef-865b-1adafd0a220f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:34.926225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bba7f29-c0dd-41ef-865b-1adafd0a220f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:34.927024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bba7f29-c0dd-41ef-865b-1adafd0a220f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:34.959116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:35:35.124594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1bba7f29-c0dd-41ef-865b-1adafd0a220f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:35.147171 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1bba7f29-c0dd-41ef-865b-1adafd0a220f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5" status: 200 len: 1273 microversion: 2.1 time: 0.271012 Oct 10 23:35:35.151796 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1897/3885] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:34 2022] GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 => generated 1273 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:35.524855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a9a775c1-7498-4d29-9329-b27d6f5ea8c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:35.574902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a9a775c1-7498-4d29-9329-b27d6f5ea8c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:35.583117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a9a775c1-7498-4d29-9329-b27d6f5ea8c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:35.586483 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a9a775c1-7498-4d29-9329-b27d6f5ea8c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1849 microversion: 2.42 time: 1.077950 Oct 10 23:35:35.601474 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1989/3886] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:34 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1849 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:36.175773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d54543f2-edba-40e8-9a2f-774b9a7ec6aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:36.177333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d54543f2-edba-40e8-9a2f-774b9a7ec6aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:36.192826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d54543f2-edba-40e8-9a2f-774b9a7ec6aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:36.193606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d54543f2-edba-40e8-9a2f-774b9a7ec6aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:36.194230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d54543f2-edba-40e8-9a2f-774b9a7ec6aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:36.195098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d54543f2-edba-40e8-9a2f-774b9a7ec6aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:36.195712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d54543f2-edba-40e8-9a2f-774b9a7ec6aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:36.196294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d54543f2-edba-40e8-9a2f-774b9a7ec6aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:36.625628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d54543f2-edba-40e8-9a2f-774b9a7ec6aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:36.625838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4fbccdec-ebee-4d08-baf1-4c4776b58b87 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:36.626763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4fbccdec-ebee-4d08-baf1-4c4776b58b87 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:36.642556 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d54543f2-edba-40e8-9a2f-774b9a7ec6aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5" status: 200 len: 1315 microversion: 2.1 time: 0.471119 Oct 10 23:35:36.645423 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1898/3887] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:36 2022] GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:36.661976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fbccdec-ebee-4d08-baf1-4c4776b58b87 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:36.664452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fbccdec-ebee-4d08-baf1-4c4776b58b87 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:36.666399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fbccdec-ebee-4d08-baf1-4c4776b58b87 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:36.667867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fbccdec-ebee-4d08-baf1-4c4776b58b87 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:36.669037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fbccdec-ebee-4d08-baf1-4c4776b58b87 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:36.670359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fbccdec-ebee-4d08-baf1-4c4776b58b87 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:36.724091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=99 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:35:36.959400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-f5f023ca-1356-4ab8-b04d-59a4c105f424 req-59857443-d2bf-47b3-a3a5-7e8f4d5a3185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "tag": "ba3bc036-b9db-4323-b4e1-9d329301f767"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:35:36.976623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f5f023ca-1356-4ab8-b04d-59a4c105f424 req-59857443-d2bf-47b3-a3a5-7e8f4d5a3185 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:36.978349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f5f023ca-1356-4ab8-b04d-59a4c105f424 req-59857443-d2bf-47b3-a3a5-7e8f4d5a3185 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:36.978796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f5f023ca-1356-4ab8-b04d-59a4c105f424 req-59857443-d2bf-47b3-a3a5-7e8f4d5a3185 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:37.004262 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-f5f023ca-1356-4ab8-b04d-59a4c105f424 req-59857443-d2bf-47b3-a3a5-7e8f4d5a3185 service nova] Creating event network-changed:ba3bc036-b9db-4323-b4e1-9d329301f767 for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:35:37.011110 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-f5f023ca-1356-4ab8-b04d-59a4c105f424 req-59857443-d2bf-47b3-a3a5-7e8f4d5a3185 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056300 Oct 10 23:35:37.013151 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1899/3888] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:35:37.675363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3d6da721-c7a6-432f-b727-fbd32ee4be51 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:37.676264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3d6da721-c7a6-432f-b727-fbd32ee4be51 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:37.698136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d6da721-c7a6-432f-b727-fbd32ee4be51 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:37.699473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d6da721-c7a6-432f-b727-fbd32ee4be51 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:37.700545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d6da721-c7a6-432f-b727-fbd32ee4be51 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:37.702676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d6da721-c7a6-432f-b727-fbd32ee4be51 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:37.703887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d6da721-c7a6-432f-b727-fbd32ee4be51 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:37.706129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d6da721-c7a6-432f-b727-fbd32ee4be51 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:37.976584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4fbccdec-ebee-4d08-baf1-4c4776b58b87 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:37.986584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4fbccdec-ebee-4d08-baf1-4c4776b58b87 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:37.999779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4fbccdec-ebee-4d08-baf1-4c4776b58b87 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:38.001266 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4fbccdec-ebee-4d08-baf1-4c4776b58b87 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1849 microversion: 2.42 time: 1.384432 Oct 10 23:35:38.002282 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1990/3889] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:36 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1849 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:39.056873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4d6cae34-185b-4764-bb72-fb9d8e45aa7e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:39.059307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4d6cae34-185b-4764-bb72-fb9d8e45aa7e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:39.082037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:35:39.088208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:35:39.092664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d6cae34-185b-4764-bb72-fb9d8e45aa7e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:39.094082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d6cae34-185b-4764-bb72-fb9d8e45aa7e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:39.095048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d6cae34-185b-4764-bb72-fb9d8e45aa7e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:39.099487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d6cae34-185b-4764-bb72-fb9d8e45aa7e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:39.100581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d6cae34-185b-4764-bb72-fb9d8e45aa7e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:39.101600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d6cae34-185b-4764-bb72-fb9d8e45aa7e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:39.218124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:35:39.642462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4d6cae34-185b-4764-bb72-fb9d8e45aa7e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:39.653072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4d6cae34-185b-4764-bb72-fb9d8e45aa7e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:39.661121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4d6cae34-185b-4764-bb72-fb9d8e45aa7e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:39.664944 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4d6cae34-185b-4764-bb72-fb9d8e45aa7e tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1849 microversion: 2.42 time: 0.617976 Oct 10 23:35:39.665722 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1991/3890] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:39 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1849 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:35:39.697237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3d6da721-c7a6-432f-b727-fbd32ee4be51 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:39.723978 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3d6da721-c7a6-432f-b727-fbd32ee4be51 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5" status: 200 len: 1315 microversion: 2.1 time: 2.055785 Oct 10 23:35:39.724970 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1900/3891] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:37 2022] GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 => generated 1315 bytes in 2058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:35:40.189608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-a0716ee4-1af5-44a6-bcf3-806206367cdc req-cc62bc5e-6709-4c8e-9dc9-ad5049421903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fa1908d-4b1e-4814-96c3-c30d60d579e5", "tag": "eeb3a072-64d8-48df-af8c-388891de90fc"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:35:40.213332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a0716ee4-1af5-44a6-bcf3-806206367cdc req-cc62bc5e-6709-4c8e-9dc9-ad5049421903 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:40.217028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a0716ee4-1af5-44a6-bcf3-806206367cdc req-cc62bc5e-6709-4c8e-9dc9-ad5049421903 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:40.217842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a0716ee4-1af5-44a6-bcf3-806206367cdc req-cc62bc5e-6709-4c8e-9dc9-ad5049421903 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:40.248799 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a0716ee4-1af5-44a6-bcf3-806206367cdc req-cc62bc5e-6709-4c8e-9dc9-ad5049421903 service nova] Creating event network-changed:eeb3a072-64d8-48df-af8c-388891de90fc for instance 0fa1908d-4b1e-4814-96c3-c30d60d579e5 on n-h1-860864-2 Oct 10 23:35:40.271127 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-a0716ee4-1af5-44a6-bcf3-806206367cdc req-cc62bc5e-6709-4c8e-9dc9-ad5049421903 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085298 Oct 10 23:35:40.272076 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1992/3892] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:35:40.722340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0c110b31-44ab-4d39-88e0-8d9aef2a25bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:40.731467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0c110b31-44ab-4d39-88e0-8d9aef2a25bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:40.761337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3aac70e1-41b5-413a-b662-206e347ab9df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:40.762846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3aac70e1-41b5-413a-b662-206e347ab9df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:40.794023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c110b31-44ab-4d39-88e0-8d9aef2a25bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:40.795396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c110b31-44ab-4d39-88e0-8d9aef2a25bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:40.838625 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c110b31-44ab-4d39-88e0-8d9aef2a25bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.043s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:40.842362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aac70e1-41b5-413a-b662-206e347ab9df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:40.845646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c110b31-44ab-4d39-88e0-8d9aef2a25bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:40.855177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c110b31-44ab-4d39-88e0-8d9aef2a25bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:40.857803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aac70e1-41b5-413a-b662-206e347ab9df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:40.858587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aac70e1-41b5-413a-b662-206e347ab9df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:40.863954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c110b31-44ab-4d39-88e0-8d9aef2a25bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:40.875176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aac70e1-41b5-413a-b662-206e347ab9df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:40.876057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aac70e1-41b5-413a-b662-206e347ab9df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:40.876853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aac70e1-41b5-413a-b662-206e347ab9df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:41.687408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3aac70e1-41b5-413a-b662-206e347ab9df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:41.708475 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3aac70e1-41b5-413a-b662-206e347ab9df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5" status: 200 len: 1315 microversion: 2.1 time: 0.961820 Oct 10 23:35:41.710169 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1993/3893] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:40 2022] GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 => generated 1315 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:41.800497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0c110b31-44ab-4d39-88e0-8d9aef2a25bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:41.841422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0c110b31-44ab-4d39-88e0-8d9aef2a25bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:41.843917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0c110b31-44ab-4d39-88e0-8d9aef2a25bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:41.847805 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0c110b31-44ab-4d39-88e0-8d9aef2a25bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1870 microversion: 2.42 time: 1.136296 Oct 10 23:35:41.848885 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1901/3894] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:40 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1870 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:42.396222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-66465a12-95fc-403d-84cb-6515538b56e8 req-5ab3d4e6-b57c-4586-a49d-79d8957eb5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "tag": "64c20742-7660-4d0e-82e1-e69776bd552d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:35:42.410226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-66465a12-95fc-403d-84cb-6515538b56e8 req-5ab3d4e6-b57c-4586-a49d-79d8957eb5a3 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:42.415364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-66465a12-95fc-403d-84cb-6515538b56e8 req-5ab3d4e6-b57c-4586-a49d-79d8957eb5a3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:42.424452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-66465a12-95fc-403d-84cb-6515538b56e8 req-5ab3d4e6-b57c-4586-a49d-79d8957eb5a3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:42.447621 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-66465a12-95fc-403d-84cb-6515538b56e8 req-5ab3d4e6-b57c-4586-a49d-79d8957eb5a3 service nova] Creating event network-changed:64c20742-7660-4d0e-82e1-e69776bd552d for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:35:42.456702 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-66465a12-95fc-403d-84cb-6515538b56e8 req-5ab3d4e6-b57c-4586-a49d-79d8957eb5a3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065223 Oct 10 23:35:42.457681 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1994/3895] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:35:42.742642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d51e0215-2925-4825-9ea1-e3b36bcd048e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:42.743269 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d51e0215-2925-4825-9ea1-e3b36bcd048e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:42.755799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d51e0215-2925-4825-9ea1-e3b36bcd048e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:42.762303 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d51e0215-2925-4825-9ea1-e3b36bcd048e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:42.765790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d51e0215-2925-4825-9ea1-e3b36bcd048e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:42.767770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d51e0215-2925-4825-9ea1-e3b36bcd048e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:42.771558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d51e0215-2925-4825-9ea1-e3b36bcd048e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:42.772244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d51e0215-2925-4825-9ea1-e3b36bcd048e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:42.885461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8aea0dd7-6609-4f8a-be89-f973e6ec9ddb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:42.893243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8aea0dd7-6609-4f8a-be89-f973e6ec9ddb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:42.927234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8aea0dd7-6609-4f8a-be89-f973e6ec9ddb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:42.929844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8aea0dd7-6609-4f8a-be89-f973e6ec9ddb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:42.931469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8aea0dd7-6609-4f8a-be89-f973e6ec9ddb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:42.937479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8aea0dd7-6609-4f8a-be89-f973e6ec9ddb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:42.939426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8aea0dd7-6609-4f8a-be89-f973e6ec9ddb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:42.941080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8aea0dd7-6609-4f8a-be89-f973e6ec9ddb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:43.670964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8aea0dd7-6609-4f8a-be89-f973e6ec9ddb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:43.686549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8aea0dd7-6609-4f8a-be89-f973e6ec9ddb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:43.688739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8aea0dd7-6609-4f8a-be89-f973e6ec9ddb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:43.691369 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8aea0dd7-6609-4f8a-be89-f973e6ec9ddb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1891 microversion: 2.42 time: 0.814885 Oct 10 23:35:43.692951 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1995/3896] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:42 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1891 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:35:43.789251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d51e0215-2925-4825-9ea1-e3b36bcd048e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:43.807205 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d51e0215-2925-4825-9ea1-e3b36bcd048e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5" status: 200 len: 1315 microversion: 2.1 time: 1.069963 Oct 10 23:35:43.808361 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1902/3897] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:42 2022] GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 => generated 1315 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:44.498190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-b80353d3-48c1-49fb-b6a5-412db5f2756a req-51371752-ba29-47e4-b8ee-e8c8449a69f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "tag": "f52a21e1-4980-41cd-920e-a646400a6fc3"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:35:44.537853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b80353d3-48c1-49fb-b6a5-412db5f2756a req-51371752-ba29-47e4-b8ee-e8c8449a69f4 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:44.540280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b80353d3-48c1-49fb-b6a5-412db5f2756a req-51371752-ba29-47e4-b8ee-e8c8449a69f4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:44.543030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b80353d3-48c1-49fb-b6a5-412db5f2756a req-51371752-ba29-47e4-b8ee-e8c8449a69f4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:44.584800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3ce83951-6dd0-4f1f-ba7d-1b32f7e067f4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Action: 'create', calling method: .version_select at 0x7f6633a95c10>, body: {"keypair": {"name": "tempest-keypair-846854929", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvj/Vxaw2iLvGHWk8DofIBb+EE0WptsI0qLHbiEpky0JrK7NO9BPvPZJieM1i37fuiYLOuBF+QZh0L94OwCiNUredDSyP/nn/L38pKCwwqf+kFoOYEtOjcOCqufPB0ksA=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:35:44.589903 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-b80353d3-48c1-49fb-b6a5-412db5f2756a req-51371752-ba29-47e4-b8ee-e8c8449a69f4 service nova] Creating event network-changed:f52a21e1-4980-41cd-920e-a646400a6fc3 for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:35:44.608820 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-b80353d3-48c1-49fb-b6a5-412db5f2756a req-51371752-ba29-47e4-b8ee-e8c8449a69f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116104 Oct 10 23:35:44.614724 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1903/3898] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:35:44.679809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-3ce83951-6dd0-4f1f-ba7d-1b32f7e067f4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Getting quotas for project 7030e994103a48d6bb58a2f6fd440074. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:35:44.700145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-3ce83951-6dd0-4f1f-ba7d-1b32f7e067f4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Getting quotas for user 7595dc3ad9b546348a01ae0a638b110d and project 7030e994103a48d6bb58a2f6fd440074. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:35:44.727381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c2fae40b-8f3d-4a32-b38c-4c98c22832b2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:44.728901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c2fae40b-8f3d-4a32-b38c-4c98c22832b2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:44.755814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2fae40b-8f3d-4a32-b38c-4c98c22832b2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:44.756326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2fae40b-8f3d-4a32-b38c-4c98c22832b2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:44.763055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2fae40b-8f3d-4a32-b38c-4c98c22832b2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:44.763890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2fae40b-8f3d-4a32-b38c-4c98c22832b2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:44.767528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2fae40b-8f3d-4a32-b38c-4c98c22832b2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:44.768513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2fae40b-8f3d-4a32-b38c-4c98c22832b2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:44.797171 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3ce83951-6dd0-4f1f-ba7d-1b32f7e067f4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.630419 Oct 10 23:35:44.799737 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1996/3899] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:35:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:35:44.843249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0669f5d1-2add-48ff-a5c0-e84d32706488 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:44.844864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0669f5d1-2add-48ff-a5c0-e84d32706488 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:44.856493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0669f5d1-2add-48ff-a5c0-e84d32706488 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:44.870623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0669f5d1-2add-48ff-a5c0-e84d32706488 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:44.876987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0669f5d1-2add-48ff-a5c0-e84d32706488 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:44.878550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0669f5d1-2add-48ff-a5c0-e84d32706488 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:44.881354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0669f5d1-2add-48ff-a5c0-e84d32706488 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:44.882099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0669f5d1-2add-48ff-a5c0-e84d32706488 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:45.140139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0669f5d1-2add-48ff-a5c0-e84d32706488 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:45.157309 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0669f5d1-2add-48ff-a5c0-e84d32706488 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5" status: 200 len: 1315 microversion: 2.1 time: 0.327118 Oct 10 23:35:45.177762 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1997/3900] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:44 2022] GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:45.975789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c2fae40b-8f3d-4a32-b38c-4c98c22832b2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:46.003786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c2fae40b-8f3d-4a32-b38c-4c98c22832b2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:46.012293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c2fae40b-8f3d-4a32-b38c-4c98c22832b2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:46.015888 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c2fae40b-8f3d-4a32-b38c-4c98c22832b2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1891 microversion: 2.42 time: 1.296005 Oct 10 23:35:46.020547 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1904/3901] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:44 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1891 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:46.198342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e9e68ecd-ce81-4b7c-9f31-426d7dec35a1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:46.199230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e9e68ecd-ce81-4b7c-9f31-426d7dec35a1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:46.213594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9e68ecd-ce81-4b7c-9f31-426d7dec35a1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:46.214438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9e68ecd-ce81-4b7c-9f31-426d7dec35a1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:46.214904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9e68ecd-ce81-4b7c-9f31-426d7dec35a1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:46.215676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9e68ecd-ce81-4b7c-9f31-426d7dec35a1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:46.216144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9e68ecd-ce81-4b7c-9f31-426d7dec35a1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:46.216981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9e68ecd-ce81-4b7c-9f31-426d7dec35a1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:46.584254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e9e68ecd-ce81-4b7c-9f31-426d7dec35a1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:46.614012 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e9e68ecd-ce81-4b7c-9f31-426d7dec35a1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5" status: 200 len: 1315 microversion: 2.1 time: 0.421657 Oct 10 23:35:46.631881 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1998/3902] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:46 2022] GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:47.053208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-df03d82b-c5ef-448b-9340-e48fae10ca5c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:47.054874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-df03d82b-c5ef-448b-9340-e48fae10ca5c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:47.069154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df03d82b-c5ef-448b-9340-e48fae10ca5c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:47.071962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df03d82b-c5ef-448b-9340-e48fae10ca5c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:47.072651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df03d82b-c5ef-448b-9340-e48fae10ca5c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:47.074960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df03d82b-c5ef-448b-9340-e48fae10ca5c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:47.078179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df03d82b-c5ef-448b-9340-e48fae10ca5c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:47.078887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df03d82b-c5ef-448b-9340-e48fae10ca5c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:47.651784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8b28fc7f-a108-4c30-9442-f64fe4d9664c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:47.652568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8b28fc7f-a108-4c30-9442-f64fe4d9664c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:47.679019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b28fc7f-a108-4c30-9442-f64fe4d9664c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:47.679696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b28fc7f-a108-4c30-9442-f64fe4d9664c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:47.680481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b28fc7f-a108-4c30-9442-f64fe4d9664c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:47.681359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b28fc7f-a108-4c30-9442-f64fe4d9664c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:47.682558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b28fc7f-a108-4c30-9442-f64fe4d9664c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:47.686480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b28fc7f-a108-4c30-9442-f64fe4d9664c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:47.789652 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-df03d82b-c5ef-448b-9340-e48fae10ca5c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:47.807315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-df03d82b-c5ef-448b-9340-e48fae10ca5c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:47.813276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-df03d82b-c5ef-448b-9340-e48fae10ca5c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:47.817314 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-df03d82b-c5ef-448b-9340-e48fae10ca5c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.772126 Oct 10 23:35:47.823010 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1905/3903] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:47 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:48.113664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8b28fc7f-a108-4c30-9442-f64fe4d9664c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:48.166366 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8b28fc7f-a108-4c30-9442-f64fe4d9664c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5" status: 200 len: 1315 microversion: 2.1 time: 0.517819 Oct 10 23:35:48.167441 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 1999/3904] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:47 2022] GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:35:48.584077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-372f3de9-e956-474e-b9fb-c0ffee0e98ff req-6f6b756e-1f0b-4959-835a-fd7a4497064f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "tag": "696f4f58-fa1e-4ecd-a136-8232df92640f"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:35:48.610529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-372f3de9-e956-474e-b9fb-c0ffee0e98ff req-6f6b756e-1f0b-4959-835a-fd7a4497064f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:48.614544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-372f3de9-e956-474e-b9fb-c0ffee0e98ff req-6f6b756e-1f0b-4959-835a-fd7a4497064f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:48.618461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-372f3de9-e956-474e-b9fb-c0ffee0e98ff req-6f6b756e-1f0b-4959-835a-fd7a4497064f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:48.651412 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-372f3de9-e956-474e-b9fb-c0ffee0e98ff req-6f6b756e-1f0b-4959-835a-fd7a4497064f service nova] Creating event network-changed:696f4f58-fa1e-4ecd-a136-8232df92640f for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:35:48.663332 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-372f3de9-e956-474e-b9fb-c0ffee0e98ff req-6f6b756e-1f0b-4959-835a-fd7a4497064f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085038 Oct 10 23:35:48.667208 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1906/3905] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:35:48.866261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-018bab70-df0d-40fa-a493-6fce47474a6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:48.868390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-018bab70-df0d-40fa-a493-6fce47474a6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:48.894439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-018bab70-df0d-40fa-a493-6fce47474a6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:48.895264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-018bab70-df0d-40fa-a493-6fce47474a6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:48.896474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-018bab70-df0d-40fa-a493-6fce47474a6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:48.897472 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-018bab70-df0d-40fa-a493-6fce47474a6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:48.898640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-018bab70-df0d-40fa-a493-6fce47474a6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:48.899266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-018bab70-df0d-40fa-a493-6fce47474a6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:49.206831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3b2e6aa9-4ed4-432c-9f93-b0e599a4de07 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:49.208354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3b2e6aa9-4ed4-432c-9f93-b0e599a4de07 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:49.216655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=38 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:35:49.219859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b2e6aa9-4ed4-432c-9f93-b0e599a4de07 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:49.220606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b2e6aa9-4ed4-432c-9f93-b0e599a4de07 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:49.222184 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b2e6aa9-4ed4-432c-9f93-b0e599a4de07 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:49.223137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b2e6aa9-4ed4-432c-9f93-b0e599a4de07 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:49.223803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b2e6aa9-4ed4-432c-9f93-b0e599a4de07 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:49.224574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b2e6aa9-4ed4-432c-9f93-b0e599a4de07 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:49.420769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-018bab70-df0d-40fa-a493-6fce47474a6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:49.443573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-018bab70-df0d-40fa-a493-6fce47474a6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:49.447404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-018bab70-df0d-40fa-a493-6fce47474a6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:49.449605 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-018bab70-df0d-40fa-a493-6fce47474a6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.600015 Oct 10 23:35:49.453420 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2000/3906] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:48 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:49.464062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-c560ddb5-854e-4ad6-afb4-41cc208177ff req-06c5aa1d-94ae-42e8-9645-3037cc0a20dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa1908d-4b1e-4814-96c3-c30d60d579e5", "name": "network-vif-plugged", "status": "completed", "tag": "eeb3a072-64d8-48df-af8c-388891de90fc"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:35:49.491775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c560ddb5-854e-4ad6-afb4-41cc208177ff req-06c5aa1d-94ae-42e8-9645-3037cc0a20dd service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:49.492334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c560ddb5-854e-4ad6-afb4-41cc208177ff req-06c5aa1d-94ae-42e8-9645-3037cc0a20dd service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:49.492775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c560ddb5-854e-4ad6-afb4-41cc208177ff req-06c5aa1d-94ae-42e8-9645-3037cc0a20dd service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:49.521363 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-c560ddb5-854e-4ad6-afb4-41cc208177ff req-06c5aa1d-94ae-42e8-9645-3037cc0a20dd service nova] Creating event network-vif-plugged:eeb3a072-64d8-48df-af8c-388891de90fc for instance 0fa1908d-4b1e-4814-96c3-c30d60d579e5 on n-h1-860864-2 Oct 10 23:35:49.538190 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-c560ddb5-854e-4ad6-afb4-41cc208177ff req-06c5aa1d-94ae-42e8-9645-3037cc0a20dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082586 Oct 10 23:35:49.548876 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2001/3907] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:35:49.814483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a0d672b9-c39a-4efe-845a-4b048d86b503 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-90040017", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "469208fa-af0c-43b6-b5ec-4ff2467769f1"}], "security_groups": [{"name": "tempest-securitygroup--98572030"}], "key_name": "tempest-keypair-846854929", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:35:49.952342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3b2e6aa9-4ed4-432c-9f93-b0e599a4de07 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:49.982046 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3b2e6aa9-4ed4-432c-9f93-b0e599a4de07 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5" status: 200 len: 1315 microversion: 2.1 time: 0.791479 Oct 10 23:35:49.984311 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1907/3908] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:49 2022] GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 => generated 1315 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:49.992737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-a0d672b9-c39a-4efe-845a-4b048d86b503 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] validate_networks() for [('469208fa-af0c-43b6-b5ec-4ff2467769f1', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:35:50.485638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-adcd8c26-5b2f-46a9-a9cc-81a31bfcaaff tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:50.486441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-adcd8c26-5b2f-46a9-a9cc-81a31bfcaaff tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:50.493559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adcd8c26-5b2f-46a9-a9cc-81a31bfcaaff tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:50.494387 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adcd8c26-5b2f-46a9-a9cc-81a31bfcaaff tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:50.495043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adcd8c26-5b2f-46a9-a9cc-81a31bfcaaff tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:50.496007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adcd8c26-5b2f-46a9-a9cc-81a31bfcaaff tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:50.497148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adcd8c26-5b2f-46a9-a9cc-81a31bfcaaff tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:50.497826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adcd8c26-5b2f-46a9-a9cc-81a31bfcaaff tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:50.751601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a0d672b9-c39a-4efe-845a-4b048d86b503 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:35:50.752013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a0d672b9-c39a-4efe-845a-4b048d86b503 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:35:50.753821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a0d672b9-c39a-4efe-845a-4b048d86b503 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:35:50.753821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a0d672b9-c39a-4efe-845a-4b048d86b503 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:35:50.754489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a0d672b9-c39a-4efe-845a-4b048d86b503 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:35:50.764233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0d672b9-c39a-4efe-845a-4b048d86b503 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:50.764996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0d672b9-c39a-4efe-845a-4b048d86b503 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:50.765649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0d672b9-c39a-4efe-845a-4b048d86b503 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:50.766562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0d672b9-c39a-4efe-845a-4b048d86b503 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:50.767027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0d672b9-c39a-4efe-845a-4b048d86b503 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:50.767457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0d672b9-c39a-4efe-845a-4b048d86b503 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:50.788629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-a0d672b9-c39a-4efe-845a-4b048d86b503 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Getting quotas for project 7030e994103a48d6bb58a2f6fd440074. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:35:50.795567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-a0d672b9-c39a-4efe-845a-4b048d86b503 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Getting quotas for user 7595dc3ad9b546348a01ae0a638b110d and project 7030e994103a48d6bb58a2f6fd440074. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:35:50.831970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a0d672b9-c39a-4efe-845a-4b048d86b503 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:35:50.836032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a0d672b9-c39a-4efe-845a-4b048d86b503 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:35:50.895095 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a0d672b9-c39a-4efe-845a-4b048d86b503 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.084465 Oct 10 23:35:50.896413 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2002/3909] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:35:49 2022] POST /compute/v2.1/servers => generated 404 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 23:35:50.913032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-61e05471-b4cb-4c36-8640-cd24d497426e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:50.914199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-61e05471-b4cb-4c36-8640-cd24d497426e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:51.002015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-61e05471-b4cb-4c36-8640-cd24d497426e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:51.018810 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-61e05471-b4cb-4c36-8640-cd24d497426e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 200 len: 1239 microversion: 2.1 time: 0.115269 Oct 10 23:35:51.021485 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2003/3910] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:50 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 1239 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:35:51.028050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fa6ffa5a-6b32-4082-a320-5e8492356d27 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:51.029410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fa6ffa5a-6b32-4082-a320-5e8492356d27 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:51.047571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa6ffa5a-6b32-4082-a320-5e8492356d27 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:51.048092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa6ffa5a-6b32-4082-a320-5e8492356d27 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:51.048789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa6ffa5a-6b32-4082-a320-5e8492356d27 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:51.049881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa6ffa5a-6b32-4082-a320-5e8492356d27 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:51.050370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa6ffa5a-6b32-4082-a320-5e8492356d27 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:51.051667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa6ffa5a-6b32-4082-a320-5e8492356d27 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:51.160111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-adcd8c26-5b2f-46a9-a9cc-81a31bfcaaff tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:51.183772 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-adcd8c26-5b2f-46a9-a9cc-81a31bfcaaff tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:51.186262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-adcd8c26-5b2f-46a9-a9cc-81a31bfcaaff tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:51.188211 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-adcd8c26-5b2f-46a9-a9cc-81a31bfcaaff tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.706514 Oct 10 23:35:51.206057 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1908/3911] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:50 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:35:51.206057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-e878223c-f0be-43ed-acf4-a2c00fa527d5 req-f11f6139-6fa2-4cd3-ae41-6933c002aaab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "tag": "4efdef6b-01db-43d4-9af9-1d488725b03c"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:35:51.210191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e878223c-f0be-43ed-acf4-a2c00fa527d5 req-f11f6139-6fa2-4cd3-ae41-6933c002aaab service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:51.210956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e878223c-f0be-43ed-acf4-a2c00fa527d5 req-f11f6139-6fa2-4cd3-ae41-6933c002aaab service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:51.212212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e878223c-f0be-43ed-acf4-a2c00fa527d5 req-f11f6139-6fa2-4cd3-ae41-6933c002aaab service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:51.233152 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-e878223c-f0be-43ed-acf4-a2c00fa527d5 req-f11f6139-6fa2-4cd3-ae41-6933c002aaab service nova] Creating event network-changed:4efdef6b-01db-43d4-9af9-1d488725b03c for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:35:51.240224 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-e878223c-f0be-43ed-acf4-a2c00fa527d5 req-f11f6139-6fa2-4cd3-ae41-6933c002aaab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046410 Oct 10 23:35:51.241199 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1909/3912] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:35:51.292585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fa6ffa5a-6b32-4082-a320-5e8492356d27 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:51.324526 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fa6ffa5a-6b32-4082-a320-5e8492356d27 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5" status: 200 len: 1315 microversion: 2.1 time: 0.298815 Oct 10 23:35:51.328326 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2004/3913] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:51 2022] GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:52.052382 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d3364211-51e2-4cba-a821-96d47c6c6bc9 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:52.053246 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d3364211-51e2-4cba-a821-96d47c6c6bc9 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:52.067887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3364211-51e2-4cba-a821-96d47c6c6bc9 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:52.068969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3364211-51e2-4cba-a821-96d47c6c6bc9 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:52.069653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3364211-51e2-4cba-a821-96d47c6c6bc9 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:52.070681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3364211-51e2-4cba-a821-96d47c6c6bc9 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:52.071352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3364211-51e2-4cba-a821-96d47c6c6bc9 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:52.071984 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3364211-51e2-4cba-a821-96d47c6c6bc9 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:52.220113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-900d9e1c-7af0-48f1-a3e1-f872d2f43e7c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:52.220761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-900d9e1c-7af0-48f1-a3e1-f872d2f43e7c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:52.227975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-900d9e1c-7af0-48f1-a3e1-f872d2f43e7c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:52.228664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-900d9e1c-7af0-48f1-a3e1-f872d2f43e7c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:52.229114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-900d9e1c-7af0-48f1-a3e1-f872d2f43e7c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:52.229858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-900d9e1c-7af0-48f1-a3e1-f872d2f43e7c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:52.230475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-900d9e1c-7af0-48f1-a3e1-f872d2f43e7c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:52.230910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-900d9e1c-7af0-48f1-a3e1-f872d2f43e7c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:52.340452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d3364211-51e2-4cba-a821-96d47c6c6bc9 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:52.354775 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d3364211-51e2-4cba-a821-96d47c6c6bc9 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 200 len: 1291 microversion: 2.1 time: 0.310040 Oct 10 23:35:52.355407 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1910/3914] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:52 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 1291 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:52.369457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ba9c05a8-3116-4d6a-b90e-bfc2b6a44ba0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:52.370082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ba9c05a8-3116-4d6a-b90e-bfc2b6a44ba0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:52.389549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba9c05a8-3116-4d6a-b90e-bfc2b6a44ba0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:52.390052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba9c05a8-3116-4d6a-b90e-bfc2b6a44ba0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:52.390489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba9c05a8-3116-4d6a-b90e-bfc2b6a44ba0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:52.397349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba9c05a8-3116-4d6a-b90e-bfc2b6a44ba0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:52.397920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba9c05a8-3116-4d6a-b90e-bfc2b6a44ba0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:52.398368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba9c05a8-3116-4d6a-b90e-bfc2b6a44ba0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:52.510658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-900d9e1c-7af0-48f1-a3e1-f872d2f43e7c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:52.527048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-900d9e1c-7af0-48f1-a3e1-f872d2f43e7c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:52.529208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-900d9e1c-7af0-48f1-a3e1-f872d2f43e7c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:52.530822 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-900d9e1c-7af0-48f1-a3e1-f872d2f43e7c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.314796 Oct 10 23:35:52.532393 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2005/3915] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:52 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:35:53.115923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ba9c05a8-3116-4d6a-b90e-bfc2b6a44ba0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:53.125245 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ba9c05a8-3116-4d6a-b90e-bfc2b6a44ba0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5" status: 200 len: 1501 microversion: 2.1 time: 0.759628 Oct 10 23:35:53.126606 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1911/3916] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:52 2022] GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 => generated 1501 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:35:53.154115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-128887ee-453c-405f-b321-3e7ef7b261df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:53.155153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-128887ee-453c-405f-b321-3e7ef7b261df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:53.162911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-128887ee-453c-405f-b321-3e7ef7b261df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:53.165345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-128887ee-453c-405f-b321-3e7ef7b261df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:53.165820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-128887ee-453c-405f-b321-3e7ef7b261df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:53.166551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-128887ee-453c-405f-b321-3e7ef7b261df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:53.167018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-128887ee-453c-405f-b321-3e7ef7b261df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:53.171532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-128887ee-453c-405f-b321-3e7ef7b261df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:53.227156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-128887ee-453c-405f-b321-3e7ef7b261df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:35:53.383204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3b348327-3e77-4062-8f9f-fb92a0d879ee tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:53.385334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3b348327-3e77-4062-8f9f-fb92a0d879ee tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:53.393348 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-128887ee-453c-405f-b321-3e7ef7b261df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5" status: 204 len: 0 microversion: 2.1 time: 0.241105 Oct 10 23:35:53.395688 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2006/3917] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:35:53 2022] DELETE /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:35:53.397342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b348327-3e77-4062-8f9f-fb92a0d879ee tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:53.398911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b348327-3e77-4062-8f9f-fb92a0d879ee tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:53.402934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b348327-3e77-4062-8f9f-fb92a0d879ee tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:53.406003 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b348327-3e77-4062-8f9f-fb92a0d879ee tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:53.409721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b348327-3e77-4062-8f9f-fb92a0d879ee tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:53.411236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b348327-3e77-4062-8f9f-fb92a0d879ee tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:53.414447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-45e4c788-254f-49dd-8758-5adde0cc2748 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:53.418372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-45e4c788-254f-49dd-8758-5adde0cc2748 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:53.447826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45e4c788-254f-49dd-8758-5adde0cc2748 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:53.449586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45e4c788-254f-49dd-8758-5adde0cc2748 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:53.451192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45e4c788-254f-49dd-8758-5adde0cc2748 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:53.452637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45e4c788-254f-49dd-8758-5adde0cc2748 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:53.455414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45e4c788-254f-49dd-8758-5adde0cc2748 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:53.456326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45e4c788-254f-49dd-8758-5adde0cc2748 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:53.746883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3b348327-3e77-4062-8f9f-fb92a0d879ee tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:53.756364 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3b348327-3e77-4062-8f9f-fb92a0d879ee tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 200 len: 1297 microversion: 2.1 time: 0.377591 Oct 10 23:35:53.774084 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1912/3918] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:53 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 1297 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:53.779904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-70675e04-2e93-4977-9824-116382fce15d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:53.780779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-70675e04-2e93-4977-9824-116382fce15d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:53.788882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70675e04-2e93-4977-9824-116382fce15d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:53.789696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70675e04-2e93-4977-9824-116382fce15d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:53.790299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70675e04-2e93-4977-9824-116382fce15d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:53.791385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70675e04-2e93-4977-9824-116382fce15d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:53.792001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70675e04-2e93-4977-9824-116382fce15d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:53.792581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70675e04-2e93-4977-9824-116382fce15d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:53.941243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-45e4c788-254f-49dd-8758-5adde0cc2748 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:53.958377 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-45e4c788-254f-49dd-8758-5adde0cc2748 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5" status: 200 len: 1507 microversion: 2.1 time: 0.557607 Oct 10 23:35:53.959632 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2007/3919] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:53 2022] GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 => generated 1507 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:53.964839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-eac1da67-e377-490b-9bd4-cdf48b2c7b60 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:53.965338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-eac1da67-e377-490b-9bd4-cdf48b2c7b60 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:53.971937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eac1da67-e377-490b-9bd4-cdf48b2c7b60 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:53.972672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eac1da67-e377-490b-9bd4-cdf48b2c7b60 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:53.973515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eac1da67-e377-490b-9bd4-cdf48b2c7b60 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:53.974460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eac1da67-e377-490b-9bd4-cdf48b2c7b60 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:53.975071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eac1da67-e377-490b-9bd4-cdf48b2c7b60 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:53.975650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eac1da67-e377-490b-9bd4-cdf48b2c7b60 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:54.023249 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-eac1da67-e377-490b-9bd4-cdf48b2c7b60 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-volume_attachments/4579f6f8-eb27-4d9b-9414-3e169eabf935" status: 200 len: 194 microversion: 2.20 time: 0.062184 Oct 10 23:35:54.027074 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2008/3920] 10.222.0.23 () {60 vars in 1454 bytes} [Mon Oct 10 23:35:53 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-volume_attachments/4579f6f8-eb27-4d9b-9414-3e169eabf935 => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:35:54.155472 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fc5c60d9-01fe-4af9-9588-1b2a5aa59166 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:54.155986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fc5c60d9-01fe-4af9-9588-1b2a5aa59166 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:54.162772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc5c60d9-01fe-4af9-9588-1b2a5aa59166 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:54.163363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc5c60d9-01fe-4af9-9588-1b2a5aa59166 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:54.165418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc5c60d9-01fe-4af9-9588-1b2a5aa59166 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:54.166845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc5c60d9-01fe-4af9-9588-1b2a5aa59166 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:54.168416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc5c60d9-01fe-4af9-9588-1b2a5aa59166 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:54.168416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc5c60d9-01fe-4af9-9588-1b2a5aa59166 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:54.359680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:35:54.364863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-fc5c60d9-01fe-4af9-9588-1b2a5aa59166 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lazy-loading 'services' on Instance uuid 3bd745fa-6826-4bd1-8f8d-ae65071fac12 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:35:54.391692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-70675e04-2e93-4977-9824-116382fce15d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:54.415420 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-70675e04-2e93-4977-9824-116382fce15d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:54.416953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-70675e04-2e93-4977-9824-116382fce15d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:54.418237 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-70675e04-2e93-4977-9824-116382fce15d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.642870 Oct 10 23:35:54.429437 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1913/3921] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:53 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:54.498310 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fc5c60d9-01fe-4af9-9588-1b2a5aa59166 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-volume_attachments/4579f6f8-eb27-4d9b-9414-3e169eabf935" status: 202 len: 0 microversion: 2.20 time: 0.345890 Oct 10 23:35:54.508246 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2009/3922] 10.222.0.23 () {60 vars in 1457 bytes} [Mon Oct 10 23:35:54 2022] DELETE /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-volume_attachments/4579f6f8-eb27-4d9b-9414-3e169eabf935 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 10 23:35:54.522959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a2cad76c-d4a2-4652-aa88-1c7ab038060a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:54.529410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a2cad76c-d4a2-4652-aa88-1c7ab038060a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:54.560142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2cad76c-d4a2-4652-aa88-1c7ab038060a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:54.561132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2cad76c-d4a2-4652-aa88-1c7ab038060a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:54.561621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2cad76c-d4a2-4652-aa88-1c7ab038060a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:54.573865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2cad76c-d4a2-4652-aa88-1c7ab038060a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:54.574430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2cad76c-d4a2-4652-aa88-1c7ab038060a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:54.574896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2cad76c-d4a2-4652-aa88-1c7ab038060a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:54.619710 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a2cad76c-d4a2-4652-aa88-1c7ab038060a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.109062 Oct 10 23:35:54.625462 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1914/3923] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Oct 10 23:35:54 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:35:54.783785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-09cfbcf1-9885-447e-b285-2f2cc57f0abf tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:54.784789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-09cfbcf1-9885-447e-b285-2f2cc57f0abf tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:54.791959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09cfbcf1-9885-447e-b285-2f2cc57f0abf tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:54.792455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09cfbcf1-9885-447e-b285-2f2cc57f0abf tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:54.792897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09cfbcf1-9885-447e-b285-2f2cc57f0abf tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:54.794122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09cfbcf1-9885-447e-b285-2f2cc57f0abf tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:54.794498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09cfbcf1-9885-447e-b285-2f2cc57f0abf tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:54.794910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09cfbcf1-9885-447e-b285-2f2cc57f0abf tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:54.871847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-349f38c4-40dc-4e84-9776-82e0bbe14927 req-33db9a20-7c8f-4e67-869f-d1d6b0b94404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "tag": "7961149e-16c2-40ba-bb9c-9da27106648b"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:35:54.882148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-09cfbcf1-9885-447e-b285-2f2cc57f0abf tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:54.882403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-349f38c4-40dc-4e84-9776-82e0bbe14927 req-33db9a20-7c8f-4e67-869f-d1d6b0b94404 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:54.883069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-349f38c4-40dc-4e84-9776-82e0bbe14927 req-33db9a20-7c8f-4e67-869f-d1d6b0b94404 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:54.883651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-349f38c4-40dc-4e84-9776-82e0bbe14927 req-33db9a20-7c8f-4e67-869f-d1d6b0b94404 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:54.892413 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-09cfbcf1-9885-447e-b285-2f2cc57f0abf tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 200 len: 1297 microversion: 2.1 time: 0.115679 Oct 10 23:35:54.893735 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2010/3924] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:54 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 1297 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:54.912069 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-349f38c4-40dc-4e84-9776-82e0bbe14927 req-33db9a20-7c8f-4e67-869f-d1d6b0b94404 service nova] Creating event network-changed:7961149e-16c2-40ba-bb9c-9da27106648b for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:35:54.919717 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-349f38c4-40dc-4e84-9776-82e0bbe14927 req-33db9a20-7c8f-4e67-869f-d1d6b0b94404 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050894 Oct 10 23:35:54.922506 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1915/3925] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:35:54.983439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-42edc309-b62f-42bf-aab9-16ededcb7633 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:54.984278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-42edc309-b62f-42bf-aab9-16ededcb7633 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:54.991390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42edc309-b62f-42bf-aab9-16ededcb7633 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:54.992094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42edc309-b62f-42bf-aab9-16ededcb7633 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:54.992537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42edc309-b62f-42bf-aab9-16ededcb7633 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:54.993241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42edc309-b62f-42bf-aab9-16ededcb7633 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:54.993734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42edc309-b62f-42bf-aab9-16ededcb7633 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:54.994164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42edc309-b62f-42bf-aab9-16ededcb7633 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:55.248477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-42edc309-b62f-42bf-aab9-16ededcb7633 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:55.269047 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-42edc309-b62f-42bf-aab9-16ededcb7633 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5" status: 200 len: 1507 microversion: 2.1 time: 0.288365 Oct 10 23:35:55.270278 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2011/3926] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:54 2022] GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 => generated 1507 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:55.449367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fc18c809-9cdd-4466-afb0-324de99a6467 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:55.450218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fc18c809-9cdd-4466-afb0-324de99a6467 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:55.464471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc18c809-9cdd-4466-afb0-324de99a6467 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:55.467692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc18c809-9cdd-4466-afb0-324de99a6467 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:55.468221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc18c809-9cdd-4466-afb0-324de99a6467 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:55.469251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc18c809-9cdd-4466-afb0-324de99a6467 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:55.469901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc18c809-9cdd-4466-afb0-324de99a6467 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:55.472883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc18c809-9cdd-4466-afb0-324de99a6467 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:55.634879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0ea0bb47-31a5-4f74-8d3e-a39b3c19f5f8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:55.638329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0ea0bb47-31a5-4f74-8d3e-a39b3c19f5f8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:55.653944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ea0bb47-31a5-4f74-8d3e-a39b3c19f5f8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:55.654483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ea0bb47-31a5-4f74-8d3e-a39b3c19f5f8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:55.655062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ea0bb47-31a5-4f74-8d3e-a39b3c19f5f8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:55.655782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ea0bb47-31a5-4f74-8d3e-a39b3c19f5f8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:55.656344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ea0bb47-31a5-4f74-8d3e-a39b3c19f5f8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:55.656921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ea0bb47-31a5-4f74-8d3e-a39b3c19f5f8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:55.733102 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0ea0bb47-31a5-4f74-8d3e-a39b3c19f5f8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.102868 Oct 10 23:35:55.742997 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2012/3927] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Oct 10 23:35:55 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:35:55.917149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-17bf03df-b7f7-4f7b-bc15-964343ce5497 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:55.918252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-17bf03df-b7f7-4f7b-bc15-964343ce5497 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:55.936883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17bf03df-b7f7-4f7b-bc15-964343ce5497 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:55.937482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17bf03df-b7f7-4f7b-bc15-964343ce5497 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:55.940875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17bf03df-b7f7-4f7b-bc15-964343ce5497 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:55.943805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17bf03df-b7f7-4f7b-bc15-964343ce5497 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:55.944675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17bf03df-b7f7-4f7b-bc15-964343ce5497 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:55.946698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17bf03df-b7f7-4f7b-bc15-964343ce5497 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:56.084237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-17bf03df-b7f7-4f7b-bc15-964343ce5497 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:56.102819 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-17bf03df-b7f7-4f7b-bc15-964343ce5497 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 200 len: 1297 microversion: 2.1 time: 0.185459 Oct 10 23:35:56.122243 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2013/3928] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:55 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 1297 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:35:56.300552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dafe6812-7a59-4ee5-ac36-e7b7949cad3c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:56.304431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dafe6812-7a59-4ee5-ac36-e7b7949cad3c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:56.325948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dafe6812-7a59-4ee5-ac36-e7b7949cad3c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:56.326562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dafe6812-7a59-4ee5-ac36-e7b7949cad3c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:56.327141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dafe6812-7a59-4ee5-ac36-e7b7949cad3c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:56.330952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dafe6812-7a59-4ee5-ac36-e7b7949cad3c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:56.331835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dafe6812-7a59-4ee5-ac36-e7b7949cad3c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:56.335114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dafe6812-7a59-4ee5-ac36-e7b7949cad3c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:56.690936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dafe6812-7a59-4ee5-ac36-e7b7949cad3c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:56.703640 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dafe6812-7a59-4ee5-ac36-e7b7949cad3c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5" status: 200 len: 1507 microversion: 2.1 time: 0.414639 Oct 10 23:35:56.708614 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2014/3929] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:56 2022] GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 => generated 1507 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:56.748904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f7030d31-4ddf-431a-b513-4efd10095668 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:56.753576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f7030d31-4ddf-431a-b513-4efd10095668 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:56.775643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7030d31-4ddf-431a-b513-4efd10095668 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:56.778158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7030d31-4ddf-431a-b513-4efd10095668 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:56.779889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7030d31-4ddf-431a-b513-4efd10095668 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:56.784058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7030d31-4ddf-431a-b513-4efd10095668 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:56.788721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7030d31-4ddf-431a-b513-4efd10095668 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:56.789340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7030d31-4ddf-431a-b513-4efd10095668 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:56.867617 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f7030d31-4ddf-431a-b513-4efd10095668 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.124772 Oct 10 23:35:56.868151 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2015/3930] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Oct 10 23:35:56 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 23:35:57.131973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0072cbc3-ee14-4e74-bcd5-51e2509c4ac1 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:57.132523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0072cbc3-ee14-4e74-bcd5-51e2509c4ac1 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:57.143156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0072cbc3-ee14-4e74-bcd5-51e2509c4ac1 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:57.145755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0072cbc3-ee14-4e74-bcd5-51e2509c4ac1 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:57.146281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0072cbc3-ee14-4e74-bcd5-51e2509c4ac1 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:57.147050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0072cbc3-ee14-4e74-bcd5-51e2509c4ac1 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:57.147819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0072cbc3-ee14-4e74-bcd5-51e2509c4ac1 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:57.150772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0072cbc3-ee14-4e74-bcd5-51e2509c4ac1 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:57.278910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0072cbc3-ee14-4e74-bcd5-51e2509c4ac1 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:57.299442 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0072cbc3-ee14-4e74-bcd5-51e2509c4ac1 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 200 len: 1297 microversion: 2.1 time: 0.172723 Oct 10 23:35:57.306819 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2016/3931] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:57 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 1297 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:35:57.404138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fc18c809-9cdd-4466-afb0-324de99a6467 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:57.428903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fc18c809-9cdd-4466-afb0-324de99a6467 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:57.435156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fc18c809-9cdd-4466-afb0-324de99a6467 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:57.436902 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fc18c809-9cdd-4466-afb0-324de99a6467 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 1.993415 Oct 10 23:35:57.438183 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1916/3932] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:55 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 1995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:57.746375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6b83f8eb-3389-479b-b870-a7e4c2cf529b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:57.747038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6b83f8eb-3389-479b-b870-a7e4c2cf529b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:57.758899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b83f8eb-3389-479b-b870-a7e4c2cf529b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:57.759662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b83f8eb-3389-479b-b870-a7e4c2cf529b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:57.760263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b83f8eb-3389-479b-b870-a7e4c2cf529b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:57.761522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b83f8eb-3389-479b-b870-a7e4c2cf529b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:57.762137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b83f8eb-3389-479b-b870-a7e4c2cf529b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:57.762740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b83f8eb-3389-479b-b870-a7e4c2cf529b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:57.862094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6b83f8eb-3389-479b-b870-a7e4c2cf529b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:57.882808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a1bc12ff-d721-462f-b90e-2b0c60b5a909 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:57.885414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a1bc12ff-d721-462f-b90e-2b0c60b5a909 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:57.898183 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6b83f8eb-3389-479b-b870-a7e4c2cf529b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5" status: 200 len: 1465 microversion: 2.1 time: 0.168156 Oct 10 23:35:57.903815 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2017/3933] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:57 2022] GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 => generated 1465 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:57.922582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1bc12ff-d721-462f-b90e-2b0c60b5a909 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:57.940988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1bc12ff-d721-462f-b90e-2b0c60b5a909 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:57.942386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1bc12ff-d721-462f-b90e-2b0c60b5a909 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:57.945760 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1bc12ff-d721-462f-b90e-2b0c60b5a909 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:57.947122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1bc12ff-d721-462f-b90e-2b0c60b5a909 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:57.949281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a1bc12ff-d721-462f-b90e-2b0c60b5a909 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:57.978948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-d156fbbc-d436-4545-ac11-44d2706d4b7b req-8ee99b23-0608-43ff-af87-40b672ebc3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa1908d-4b1e-4814-96c3-c30d60d579e5", "name": "network-vif-deleted", "tag": "eeb3a072-64d8-48df-af8c-388891de90fc"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:35:57.999544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:35:58.017281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d156fbbc-d436-4545-ac11-44d2706d4b7b req-8ee99b23-0608-43ff-af87-40b672ebc3d2 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:58.039241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d156fbbc-d436-4545-ac11-44d2706d4b7b req-8ee99b23-0608-43ff-af87-40b672ebc3d2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:58.042451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d156fbbc-d436-4545-ac11-44d2706d4b7b req-8ee99b23-0608-43ff-af87-40b672ebc3d2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:58.048917 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a1bc12ff-d721-462f-b90e-2b0c60b5a909 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.172220 Oct 10 23:35:58.052570 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1917/3934] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Oct 10 23:35:57 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:35:58.080009 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-d156fbbc-d436-4545-ac11-44d2706d4b7b req-8ee99b23-0608-43ff-af87-40b672ebc3d2 service nova] Creating event network-vif-deleted:eeb3a072-64d8-48df-af8c-388891de90fc for instance 0fa1908d-4b1e-4814-96c3-c30d60d579e5 on n-h1-860864-2 Oct 10 23:35:58.100883 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-d156fbbc-d436-4545-ac11-44d2706d4b7b req-8ee99b23-0608-43ff-af87-40b672ebc3d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125848 Oct 10 23:35:58.117648 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2018/3935] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:35:58.330920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8c1f58c0-8d47-432c-8f23-d75e0ae94107 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:58.332685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8c1f58c0-8d47-432c-8f23-d75e0ae94107 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:58.355035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c1f58c0-8d47-432c-8f23-d75e0ae94107 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:58.357769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c1f58c0-8d47-432c-8f23-d75e0ae94107 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:58.358603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c1f58c0-8d47-432c-8f23-d75e0ae94107 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:58.362622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c1f58c0-8d47-432c-8f23-d75e0ae94107 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:58.363128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c1f58c0-8d47-432c-8f23-d75e0ae94107 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:58.363581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c1f58c0-8d47-432c-8f23-d75e0ae94107 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:58.467203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-194160bc-d9d0-4bf8-abe8-de483de94e8b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:58.468069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-194160bc-d9d0-4bf8-abe8-de483de94e8b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:58.481342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-194160bc-d9d0-4bf8-abe8-de483de94e8b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:58.494184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-194160bc-d9d0-4bf8-abe8-de483de94e8b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:58.494792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-194160bc-d9d0-4bf8-abe8-de483de94e8b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:58.499817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-194160bc-d9d0-4bf8-abe8-de483de94e8b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:58.500865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-194160bc-d9d0-4bf8-abe8-de483de94e8b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:58.501620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-194160bc-d9d0-4bf8-abe8-de483de94e8b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:59.076874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-194160bc-d9d0-4bf8-abe8-de483de94e8b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:59.092943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-194160bc-d9d0-4bf8-abe8-de483de94e8b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:59.097029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-194160bc-d9d0-4bf8-abe8-de483de94e8b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:59.099162 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-194160bc-d9d0-4bf8-abe8-de483de94e8b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.636950 Oct 10 23:35:59.099982 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2019/3936] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:35:58 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:35:59.107164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e3a218b7-da89-4f29-abdb-a0119e8a4560 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:59.108083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e3a218b7-da89-4f29-abdb-a0119e8a4560 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:59.115489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3a218b7-da89-4f29-abdb-a0119e8a4560 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:59.116699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3a218b7-da89-4f29-abdb-a0119e8a4560 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:59.117436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3a218b7-da89-4f29-abdb-a0119e8a4560 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:59.118387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3a218b7-da89-4f29-abdb-a0119e8a4560 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:59.119175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3a218b7-da89-4f29-abdb-a0119e8a4560 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:59.120742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3a218b7-da89-4f29-abdb-a0119e8a4560 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:59.145804 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-e3a218b7-da89-4f29-abdb-a0119e8a4560 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] HTTP exception thrown: Instance 0fa1908d-4b1e-4814-96c3-c30d60d579e5 could not be found. Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e3a218b7-da89-4f29-abdb-a0119e8a4560 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Request method failure captured: Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 HTTP/1.1 Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKw8hCLXWIFTJ3HaJf5ifgl6Pm7vGD8ptwfQXuGQAkf1M-RWSvV8nlygpWidDM338TQR6cXdzFUy8zgn8XWf4EUtX06mIecSablgYBXm9sJQ78u324dyYAXvHBKQ5Ge8XY02Fdf2X0InpWnugNSR9M1ccFMQnfZYNbqSwCmT2w9EOBY Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d42cb00f2544abbde09cae76f3e3a1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-DeleteServersTestJSON-837712631 Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 7cc066774b344a24a91fb41e990f5234 Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 0fa1908d-4b1e-4814-96c3-c30d60d579e5 could not be found. Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '0fa1908d-4b1e-4814-96c3-c30d60d579e5'} Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa1908d-4b1e-4814-96c3-c30d60d579e5 could not be found. Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa1908d-4b1e-4814-96c3-c30d60d579e5 could not be found. Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:35:59.148749 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:35:59.152309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:35:59.152309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:35:59.152309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:35:59.152309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:35:59.152309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:35:59.152309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa1908d-4b1e-4814-96c3-c30d60d579e5 could not be found. Oct 10 23:35:59.152309 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:35:59.152309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e3a218b7-da89-4f29-abdb-a0119e8a4560 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Returning 404 to user: Instance 0fa1908d-4b1e-4814-96c3-c30d60d579e5 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:35:59.153774 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e3a218b7-da89-4f29-abdb-a0119e8a4560 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5" status: 404 len: 111 microversion: 2.1 time: 0.051255 Oct 10 23:35:59.153774 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2020/3937] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:59 2022] GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:35:59.346387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-56f6f92d-f1dd-4bda-a7e2-8f74011ea2ed tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1821940474", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:35:59.410451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-56f6f92d-f1dd-4bda-a7e2-8f74011ea2ed tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] validate_networks() for [('341e3e89-9f32-4889-8f79-fb51e702b8d6', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:35:59.597869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8c1f58c0-8d47-432c-8f23-d75e0ae94107 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:35:59.609786 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8c1f58c0-8d47-432c-8f23-d75e0ae94107 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 200 len: 1363 microversion: 2.1 time: 1.288946 Oct 10 23:35:59.611209 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1918/3938] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:35:58 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 1363 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:35:59.621161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fd8464e8-6639-4017-831a-07d40fc03286 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:35:59.624880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fd8464e8-6639-4017-831a-07d40fc03286 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:35:59.638640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd8464e8-6639-4017-831a-07d40fc03286 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:59.640047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd8464e8-6639-4017-831a-07d40fc03286 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:59.641411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd8464e8-6639-4017-831a-07d40fc03286 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:59.648121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd8464e8-6639-4017-831a-07d40fc03286 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:59.649060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd8464e8-6639-4017-831a-07d40fc03286 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:59.649917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd8464e8-6639-4017-831a-07d40fc03286 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:59.737022 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fd8464e8-6639-4017-831a-07d40fc03286 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.121840 Oct 10 23:35:59.739168 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1919/3939] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Oct 10 23:35:59 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:35:59.747202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c91b7dd0-1a51-446d-bc9a-c6b6084372a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1696737078", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "d3777005-851a-44f1-be2b-d4f3d09bbf72"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:35:59.836248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-c91b7dd0-1a51-446d-bc9a-c6b6084372a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] validate_networks() for [('d3777005-851a-44f1-be2b-d4f3d09bbf72', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:35:59.891207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-56f6f92d-f1dd-4bda-a7e2-8f74011ea2ed tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:35:59.891639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-56f6f92d-f1dd-4bda-a7e2-8f74011ea2ed tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:35:59.892126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-56f6f92d-f1dd-4bda-a7e2-8f74011ea2ed tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:35:59.892543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-56f6f92d-f1dd-4bda-a7e2-8f74011ea2ed tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:35:59.892999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-56f6f92d-f1dd-4bda-a7e2-8f74011ea2ed tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:35:59.904125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56f6f92d-f1dd-4bda-a7e2-8f74011ea2ed tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:59.904445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56f6f92d-f1dd-4bda-a7e2-8f74011ea2ed tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:59.905229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56f6f92d-f1dd-4bda-a7e2-8f74011ea2ed tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:59.906184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56f6f92d-f1dd-4bda-a7e2-8f74011ea2ed tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:35:59.907633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56f6f92d-f1dd-4bda-a7e2-8f74011ea2ed tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:35:59.911761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56f6f92d-f1dd-4bda-a7e2-8f74011ea2ed tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:35:59.936413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-56f6f92d-f1dd-4bda-a7e2-8f74011ea2ed tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Getting quotas for project b94305235aa94d318fcfe2813e7948ba. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:35:59.938856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:35:59.945977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-56f6f92d-f1dd-4bda-a7e2-8f74011ea2ed tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Getting quotas for user 663f0305b525435eb3df4f1d2184eccc and project b94305235aa94d318fcfe2813e7948ba. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:35:59.965574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-56f6f92d-f1dd-4bda-a7e2-8f74011ea2ed tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:35:59.968737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-56f6f92d-f1dd-4bda-a7e2-8f74011ea2ed tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:36:00.046164 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-56f6f92d-f1dd-4bda-a7e2-8f74011ea2ed tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.888314 Oct 10 23:36:00.047230 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2021/3940] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:35:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:36:00.060598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e5f049b3-577d-4048-920a-69ef10c84fd1 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:00.061315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e5f049b3-577d-4048-920a-69ef10c84fd1 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:00.182488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e5f049b3-577d-4048-920a-69ef10c84fd1 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:00.213058 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e5f049b3-577d-4048-920a-69ef10c84fd1 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1223 microversion: 2.1 time: 0.157391 Oct 10 23:36:00.217419 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2022/3941] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:00 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1223 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:00.230255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a2f79c71-7289-42b0-bbc0-1dd04c6e1b3d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:00.231028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a2f79c71-7289-42b0-bbc0-1dd04c6e1b3d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:00.260546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2f79c71-7289-42b0-bbc0-1dd04c6e1b3d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:00.261517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2f79c71-7289-42b0-bbc0-1dd04c6e1b3d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:00.262099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2f79c71-7289-42b0-bbc0-1dd04c6e1b3d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:00.262948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2f79c71-7289-42b0-bbc0-1dd04c6e1b3d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:00.268367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2f79c71-7289-42b0-bbc0-1dd04c6e1b3d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:00.270003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2f79c71-7289-42b0-bbc0-1dd04c6e1b3d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:00.532009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a2f79c71-7289-42b0-bbc0-1dd04c6e1b3d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:00.545121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a2f79c71-7289-42b0-bbc0-1dd04c6e1b3d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:00.547219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a2f79c71-7289-42b0-bbc0-1dd04c6e1b3d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:00.548614 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a2f79c71-7289-42b0-bbc0-1dd04c6e1b3d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.330038 Oct 10 23:36:00.550059 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2023/3942] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:00 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:00.590191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-651c11e4-7e8c-4050-b1a9-9255a0613357 req-cf02434c-4bfa-4214-8ff4-4f2503d18823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "tag": "9382b9bb-ac70-49e6-a877-15684a47dcb9"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:00.612279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-651c11e4-7e8c-4050-b1a9-9255a0613357 req-cf02434c-4bfa-4214-8ff4-4f2503d18823 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:00.613229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-651c11e4-7e8c-4050-b1a9-9255a0613357 req-cf02434c-4bfa-4214-8ff4-4f2503d18823 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:00.613910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-651c11e4-7e8c-4050-b1a9-9255a0613357 req-cf02434c-4bfa-4214-8ff4-4f2503d18823 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:00.632605 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-651c11e4-7e8c-4050-b1a9-9255a0613357 req-cf02434c-4bfa-4214-8ff4-4f2503d18823 service nova] Creating event network-changed:9382b9bb-ac70-49e6-a877-15684a47dcb9 for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:36:00.638668 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-651c11e4-7e8c-4050-b1a9-9255a0613357 req-cf02434c-4bfa-4214-8ff4-4f2503d18823 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058134 Oct 10 23:36:00.641027 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2024/3943] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:36:00.652284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-32d78388-fa96-42bf-ab7d-42d7ad4d51ba tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:00.653317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-32d78388-fa96-42bf-ab7d-42d7ad4d51ba tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:00.663956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32d78388-fa96-42bf-ab7d-42d7ad4d51ba tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:00.665589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32d78388-fa96-42bf-ab7d-42d7ad4d51ba tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:00.666564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32d78388-fa96-42bf-ab7d-42d7ad4d51ba tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:00.667559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32d78388-fa96-42bf-ab7d-42d7ad4d51ba tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:00.668206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32d78388-fa96-42bf-ab7d-42d7ad4d51ba tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:00.668892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32d78388-fa96-42bf-ab7d-42d7ad4d51ba tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:00.974956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-32d78388-fa96-42bf-ab7d-42d7ad4d51ba tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:00.994801 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-32d78388-fa96-42bf-ab7d-42d7ad4d51ba tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 200 len: 1363 microversion: 2.1 time: 0.351987 Oct 10 23:36:00.995413 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2025/3944] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:00 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 1363 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:01.005236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e2e56ee5-1d68-4800-b755-2adc6455bcea tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:01.015485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e2e56ee5-1d68-4800-b755-2adc6455bcea tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:01.027002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e2e56ee5-1d68-4800-b755-2adc6455bcea tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:01.027812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e2e56ee5-1d68-4800-b755-2adc6455bcea tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:01.028489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e2e56ee5-1d68-4800-b755-2adc6455bcea tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:01.029910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e2e56ee5-1d68-4800-b755-2adc6455bcea tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:01.030871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e2e56ee5-1d68-4800-b755-2adc6455bcea tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:01.031952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e2e56ee5-1d68-4800-b755-2adc6455bcea tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:01.077971 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e2e56ee5-1d68-4800-b755-2adc6455bcea tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080206 Oct 10 23:36:01.081461 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2026/3945] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Oct 10 23:36:00 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:36:01.243503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d97a61f0-6770-4b7d-9156-5487eb6f7d57 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:01.244414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d97a61f0-6770-4b7d-9156-5487eb6f7d57 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:01.255901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d97a61f0-6770-4b7d-9156-5487eb6f7d57 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:01.256469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d97a61f0-6770-4b7d-9156-5487eb6f7d57 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:01.256920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d97a61f0-6770-4b7d-9156-5487eb6f7d57 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:01.259046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d97a61f0-6770-4b7d-9156-5487eb6f7d57 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:01.260121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d97a61f0-6770-4b7d-9156-5487eb6f7d57 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:01.260786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d97a61f0-6770-4b7d-9156-5487eb6f7d57 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:01.381657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d97a61f0-6770-4b7d-9156-5487eb6f7d57 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:01.396719 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d97a61f0-6770-4b7d-9156-5487eb6f7d57 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1275 microversion: 2.1 time: 0.160105 Oct 10 23:36:01.409416 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2027/3946] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:01 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:36:01.585714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-14ad821d-a453-429e-9640-0effbad1c762 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:01.588443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-14ad821d-a453-429e-9640-0effbad1c762 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:01.619000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14ad821d-a453-429e-9640-0effbad1c762 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:01.619521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14ad821d-a453-429e-9640-0effbad1c762 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:01.621788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14ad821d-a453-429e-9640-0effbad1c762 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:01.622611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14ad821d-a453-429e-9640-0effbad1c762 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:01.623380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14ad821d-a453-429e-9640-0effbad1c762 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:01.623830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14ad821d-a453-429e-9640-0effbad1c762 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:01.835088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c91b7dd0-1a51-446d-bc9a-c6b6084372a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:36:01.837238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c91b7dd0-1a51-446d-bc9a-c6b6084372a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:36:01.840610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c91b7dd0-1a51-446d-bc9a-c6b6084372a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:36:01.841082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c91b7dd0-1a51-446d-bc9a-c6b6084372a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:36:01.841640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c91b7dd0-1a51-446d-bc9a-c6b6084372a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:36:01.852697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c91b7dd0-1a51-446d-bc9a-c6b6084372a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:01.853607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c91b7dd0-1a51-446d-bc9a-c6b6084372a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:01.854592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c91b7dd0-1a51-446d-bc9a-c6b6084372a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:01.856597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c91b7dd0-1a51-446d-bc9a-c6b6084372a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:01.857259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c91b7dd0-1a51-446d-bc9a-c6b6084372a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:01.858015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c91b7dd0-1a51-446d-bc9a-c6b6084372a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:01.890241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-c91b7dd0-1a51-446d-bc9a-c6b6084372a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Getting quotas for project e7d42cb00f2544abbde09cae76f3e3a1. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:36:01.899657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-c91b7dd0-1a51-446d-bc9a-c6b6084372a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Getting quotas for user 7cc066774b344a24a91fb41e990f5234 and project e7d42cb00f2544abbde09cae76f3e3a1. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:36:01.931371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c91b7dd0-1a51-446d-bc9a-c6b6084372a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:36:01.935725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c91b7dd0-1a51-446d-bc9a-c6b6084372a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:36:02.053571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-14ad821d-a453-429e-9640-0effbad1c762 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:02.067137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-14ad821d-a453-429e-9640-0effbad1c762 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:02.068633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-14ad821d-a453-429e-9640-0effbad1c762 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:02.069941 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-14ad821d-a453-429e-9640-0effbad1c762 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.494416 Oct 10 23:36:02.073434 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2028/3947] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:01 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:36:02.075948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b8dc7320-0aae-4736-ae27-89b4d7af5d7d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:02.076584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b8dc7320-0aae-4736-ae27-89b4d7af5d7d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:02.094874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8dc7320-0aae-4736-ae27-89b4d7af5d7d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:02.095646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8dc7320-0aae-4736-ae27-89b4d7af5d7d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:02.096746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8dc7320-0aae-4736-ae27-89b4d7af5d7d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:02.098196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8dc7320-0aae-4736-ae27-89b4d7af5d7d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:02.098978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8dc7320-0aae-4736-ae27-89b4d7af5d7d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:02.099528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8dc7320-0aae-4736-ae27-89b4d7af5d7d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:02.122586 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c91b7dd0-1a51-446d-bc9a-c6b6084372a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.381716 Oct 10 23:36:02.125432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:36:02.134915 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1920/3948] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:35:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:36:02.163445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6f674840-6bd3-4d30-b645-292f385a16f8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:02.165954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6f674840-6bd3-4d30-b645-292f385a16f8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:02.200167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f674840-6bd3-4d30-b645-292f385a16f8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:02.200683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f674840-6bd3-4d30-b645-292f385a16f8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:02.201139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f674840-6bd3-4d30-b645-292f385a16f8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:02.201916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f674840-6bd3-4d30-b645-292f385a16f8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:02.202387 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f674840-6bd3-4d30-b645-292f385a16f8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:02.202827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f674840-6bd3-4d30-b645-292f385a16f8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:02.301880 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6f674840-6bd3-4d30-b645-292f385a16f8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.164664 Oct 10 23:36:02.308676 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1921/3949] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Oct 10 23:36:02 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:36:02.315662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-75a1e085-8f60-4536-96ff-28b21f8648b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:02.316301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-75a1e085-8f60-4536-96ff-28b21f8648b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:02.327058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b8dc7320-0aae-4736-ae27-89b4d7af5d7d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:02.339539 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b8dc7320-0aae-4736-ae27-89b4d7af5d7d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 200 len: 1363 microversion: 2.1 time: 0.267309 Oct 10 23:36:02.340701 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2029/3950] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:02 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:02.425180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-050772a5-bb9c-485d-9879-d16b91aad131 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:02.426291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-050772a5-bb9c-485d-9879-d16b91aad131 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:02.442896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-050772a5-bb9c-485d-9879-d16b91aad131 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:02.445847 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-050772a5-bb9c-485d-9879-d16b91aad131 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:02.446627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-050772a5-bb9c-485d-9879-d16b91aad131 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:02.449794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-050772a5-bb9c-485d-9879-d16b91aad131 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:02.450165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-050772a5-bb9c-485d-9879-d16b91aad131 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:02.450699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-050772a5-bb9c-485d-9879-d16b91aad131 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:02.562168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-75a1e085-8f60-4536-96ff-28b21f8648b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:02.573964 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-75a1e085-8f60-4536-96ff-28b21f8648b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 200 len: 1215 microversion: 2.1 time: 0.263969 Oct 10 23:36:02.576506 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1922/3951] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:02 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 1215 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:02.603886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-050772a5-bb9c-485d-9879-d16b91aad131 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:02.618897 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-050772a5-bb9c-485d-9879-d16b91aad131 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1281 microversion: 2.1 time: 0.198470 Oct 10 23:36:02.623328 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2030/3952] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:02 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1281 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:36:03.100622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ae803e6a-bb4c-4b27-8852-c5fe2cfae270 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:03.102074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ae803e6a-bb4c-4b27-8852-c5fe2cfae270 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:03.110776 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae803e6a-bb4c-4b27-8852-c5fe2cfae270 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:03.111815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae803e6a-bb4c-4b27-8852-c5fe2cfae270 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:03.112503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae803e6a-bb4c-4b27-8852-c5fe2cfae270 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:03.113863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae803e6a-bb4c-4b27-8852-c5fe2cfae270 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:03.114557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae803e6a-bb4c-4b27-8852-c5fe2cfae270 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:03.115197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae803e6a-bb4c-4b27-8852-c5fe2cfae270 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:03.315282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-aa1f03dc-55e9-43c9-bdb2-f27357f16888 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:03.317854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-aa1f03dc-55e9-43c9-bdb2-f27357f16888 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:03.325068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa1f03dc-55e9-43c9-bdb2-f27357f16888 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:03.325671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa1f03dc-55e9-43c9-bdb2-f27357f16888 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:03.326353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa1f03dc-55e9-43c9-bdb2-f27357f16888 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:03.327529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa1f03dc-55e9-43c9-bdb2-f27357f16888 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:03.329047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa1f03dc-55e9-43c9-bdb2-f27357f16888 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:03.330733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa1f03dc-55e9-43c9-bdb2-f27357f16888 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:03.373291 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-aa1f03dc-55e9-43c9-bdb2-f27357f16888 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062086 Oct 10 23:36:03.393485 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2031/3953] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Oct 10 23:36:03 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:36:03.406061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0b90885e-6c78-41dc-916b-bef56022cbb8 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:03.410125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0b90885e-6c78-41dc-916b-bef56022cbb8 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:03.433537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b90885e-6c78-41dc-916b-bef56022cbb8 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:03.434103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b90885e-6c78-41dc-916b-bef56022cbb8 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:03.435707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b90885e-6c78-41dc-916b-bef56022cbb8 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:03.437732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b90885e-6c78-41dc-916b-bef56022cbb8 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:03.438426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b90885e-6c78-41dc-916b-bef56022cbb8 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:03.440144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b90885e-6c78-41dc-916b-bef56022cbb8 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:03.733643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0b90885e-6c78-41dc-916b-bef56022cbb8 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:03.747322 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0b90885e-6c78-41dc-916b-bef56022cbb8 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 200 len: 1363 microversion: 2.1 time: 0.349380 Oct 10 23:36:03.762106 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2032/3954] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:03 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 1363 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:03.773538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-d01190aa-2cf3-4d63-b68d-c2851e38e21c req-cd89fc1b-5abf-4f24-b8ff-f267f47f17f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16b9ff1a-05a0-46ff-8bac-2e12e7853f4f", "tag": "b231ca15-d59d-47a6-8ac7-16f1ba7ae25d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:03.788925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d01190aa-2cf3-4d63-b68d-c2851e38e21c req-cd89fc1b-5abf-4f24-b8ff-f267f47f17f5 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:03.789948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d01190aa-2cf3-4d63-b68d-c2851e38e21c req-cd89fc1b-5abf-4f24-b8ff-f267f47f17f5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:03.790613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d01190aa-2cf3-4d63-b68d-c2851e38e21c req-cd89fc1b-5abf-4f24-b8ff-f267f47f17f5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:03.805917 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-d01190aa-2cf3-4d63-b68d-c2851e38e21c req-cd89fc1b-5abf-4f24-b8ff-f267f47f17f5 service nova] Creating event network-changed:b231ca15-d59d-47a6-8ac7-16f1ba7ae25d for instance 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f on n-h1-860864-2 Oct 10 23:36:03.820207 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-d01190aa-2cf3-4d63-b68d-c2851e38e21c req-cd89fc1b-5abf-4f24-b8ff-f267f47f17f5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055566 Oct 10 23:36:03.821542 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2033/3955] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:36:03.833071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c0c1d267-883f-43a1-af35-099b470787fe tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:03.835363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c0c1d267-883f-43a1-af35-099b470787fe tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:03.855720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0c1d267-883f-43a1-af35-099b470787fe tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:03.856626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0c1d267-883f-43a1-af35-099b470787fe tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:03.858047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0c1d267-883f-43a1-af35-099b470787fe tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:03.859237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0c1d267-883f-43a1-af35-099b470787fe tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:03.859973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0c1d267-883f-43a1-af35-099b470787fe tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:03.860647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0c1d267-883f-43a1-af35-099b470787fe tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:03.904338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c0c1d267-883f-43a1-af35-099b470787fe tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:36:04.046057 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c0c1d267-883f-43a1-af35-099b470787fe tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 204 len: 0 microversion: 2.20 time: 0.222612 Oct 10 23:36:04.047894 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2034/3956] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:36:03 2022] DELETE /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:36:04.055823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3bf806a5-208a-437e-9550-c5119a433a6e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:04.056797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3bf806a5-208a-437e-9550-c5119a433a6e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:04.065861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3bf806a5-208a-437e-9550-c5119a433a6e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:04.066661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3bf806a5-208a-437e-9550-c5119a433a6e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:04.068024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3bf806a5-208a-437e-9550-c5119a433a6e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:04.069998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3bf806a5-208a-437e-9550-c5119a433a6e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:04.071335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3bf806a5-208a-437e-9550-c5119a433a6e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:04.072339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3bf806a5-208a-437e-9550-c5119a433a6e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:04.206715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3bf806a5-208a-437e-9550-c5119a433a6e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:04.217228 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3bf806a5-208a-437e-9550-c5119a433a6e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 200 len: 1285 microversion: 2.1 time: 0.166312 Oct 10 23:36:04.217867 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2035/3957] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:04 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 1285 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:04.228579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b50e2ab2-5317-4d72-ac41-bbb6dcc74589 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:04.231679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b50e2ab2-5317-4d72-ac41-bbb6dcc74589 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:04.250009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b50e2ab2-5317-4d72-ac41-bbb6dcc74589 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:04.250544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b50e2ab2-5317-4d72-ac41-bbb6dcc74589 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:04.251031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b50e2ab2-5317-4d72-ac41-bbb6dcc74589 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:04.258035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b50e2ab2-5317-4d72-ac41-bbb6dcc74589 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:04.258586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b50e2ab2-5317-4d72-ac41-bbb6dcc74589 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:04.260206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b50e2ab2-5317-4d72-ac41-bbb6dcc74589 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:04.409869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b50e2ab2-5317-4d72-ac41-bbb6dcc74589 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:04.423283 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b50e2ab2-5317-4d72-ac41-bbb6dcc74589 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1281 microversion: 2.1 time: 0.204309 Oct 10 23:36:04.440079 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2036/3958] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:04 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1281 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:04.453434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9355179d-219f-4790-9ad9-f1969d74fd08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:04.454184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9355179d-219f-4790-9ad9-f1969d74fd08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:04.471190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9355179d-219f-4790-9ad9-f1969d74fd08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:04.471913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9355179d-219f-4790-9ad9-f1969d74fd08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:04.473975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9355179d-219f-4790-9ad9-f1969d74fd08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:04.474737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9355179d-219f-4790-9ad9-f1969d74fd08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:04.476424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9355179d-219f-4790-9ad9-f1969d74fd08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:04.476731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9355179d-219f-4790-9ad9-f1969d74fd08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:04.479750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ae803e6a-bb4c-4b27-8852-c5fe2cfae270 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:04.491847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ae803e6a-bb4c-4b27-8852-c5fe2cfae270 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:04.493352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ae803e6a-bb4c-4b27-8852-c5fe2cfae270 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:04.503527 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ae803e6a-bb4c-4b27-8852-c5fe2cfae270 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 1.409000 Oct 10 23:36:04.504493 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1923/3959] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:03 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:04.760611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9355179d-219f-4790-9ad9-f1969d74fd08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:04.773963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9355179d-219f-4790-9ad9-f1969d74fd08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:04.775779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9355179d-219f-4790-9ad9-f1969d74fd08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:04.777348 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9355179d-219f-4790-9ad9-f1969d74fd08 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1724 microversion: 2.20 time: 0.335552 Oct 10 23:36:04.778003 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-14344e56-07e5-4038-a8b0-772055495aa9 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:04.778693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-14344e56-07e5-4038-a8b0-772055495aa9 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:04.778932 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2037/3960] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:04 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1724 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:04.799772 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14344e56-07e5-4038-a8b0-772055495aa9 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:04.800273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14344e56-07e5-4038-a8b0-772055495aa9 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:04.800830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14344e56-07e5-4038-a8b0-772055495aa9 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:04.801584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14344e56-07e5-4038-a8b0-772055495aa9 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:04.802046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14344e56-07e5-4038-a8b0-772055495aa9 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:04.802479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14344e56-07e5-4038-a8b0-772055495aa9 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:05.180045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-14344e56-07e5-4038-a8b0-772055495aa9 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:05.192371 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-14344e56-07e5-4038-a8b0-772055495aa9 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 200 len: 1363 microversion: 2.1 time: 0.417879 Oct 10 23:36:05.192911 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1924/3961] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:04 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 1363 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:36:05.248578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-edc5fd93-6958-47f9-a7b8-15896040a74c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:05.249234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-edc5fd93-6958-47f9-a7b8-15896040a74c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:05.255916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-edc5fd93-6958-47f9-a7b8-15896040a74c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:05.256440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-edc5fd93-6958-47f9-a7b8-15896040a74c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:05.256890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-edc5fd93-6958-47f9-a7b8-15896040a74c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:05.257654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-edc5fd93-6958-47f9-a7b8-15896040a74c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:05.258122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-edc5fd93-6958-47f9-a7b8-15896040a74c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:05.258559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-edc5fd93-6958-47f9-a7b8-15896040a74c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:05.371370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-edc5fd93-6958-47f9-a7b8-15896040a74c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:05.380188 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-edc5fd93-6958-47f9-a7b8-15896040a74c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 200 len: 1273 microversion: 2.1 time: 0.135363 Oct 10 23:36:05.380552 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2038/3962] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:05 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 1273 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:36:05.463235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b665f50c-934a-4749-869a-b54b4c21cfa5 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:05.463880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b665f50c-934a-4749-869a-b54b4c21cfa5 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:05.470276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b665f50c-934a-4749-869a-b54b4c21cfa5 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:05.471323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b665f50c-934a-4749-869a-b54b4c21cfa5 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:05.472218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b665f50c-934a-4749-869a-b54b4c21cfa5 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:05.472970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b665f50c-934a-4749-869a-b54b4c21cfa5 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:05.473469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b665f50c-934a-4749-869a-b54b4c21cfa5 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:05.474304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b665f50c-934a-4749-869a-b54b4c21cfa5 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:05.542615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-79c718dc-b33d-4938-a5d4-ab0fe51076fc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:05.545266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-79c718dc-b33d-4938-a5d4-ab0fe51076fc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:05.572844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79c718dc-b33d-4938-a5d4-ab0fe51076fc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:05.574081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79c718dc-b33d-4938-a5d4-ab0fe51076fc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:05.574746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79c718dc-b33d-4938-a5d4-ab0fe51076fc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:05.576194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79c718dc-b33d-4938-a5d4-ab0fe51076fc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:05.577348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79c718dc-b33d-4938-a5d4-ab0fe51076fc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:05.578648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79c718dc-b33d-4938-a5d4-ab0fe51076fc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:05.836455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b665f50c-934a-4749-869a-b54b4c21cfa5 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:05.848142 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b665f50c-934a-4749-869a-b54b4c21cfa5 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1323 microversion: 2.1 time: 0.388868 Oct 10 23:36:05.849161 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1925/3963] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:05 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1323 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:05.854756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d16cbc57-ee4c-49a5-8dd0-2028b463c528 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:05.855735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d16cbc57-ee4c-49a5-8dd0-2028b463c528 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:05.864736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d16cbc57-ee4c-49a5-8dd0-2028b463c528 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:05.865668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d16cbc57-ee4c-49a5-8dd0-2028b463c528 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:05.866334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d16cbc57-ee4c-49a5-8dd0-2028b463c528 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:05.867305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d16cbc57-ee4c-49a5-8dd0-2028b463c528 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:05.867988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d16cbc57-ee4c-49a5-8dd0-2028b463c528 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:05.868728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d16cbc57-ee4c-49a5-8dd0-2028b463c528 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:06.075330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-79c718dc-b33d-4938-a5d4-ab0fe51076fc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:06.090343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-79c718dc-b33d-4938-a5d4-ab0fe51076fc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:06.092447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-79c718dc-b33d-4938-a5d4-ab0fe51076fc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:06.093931 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-79c718dc-b33d-4938-a5d4-ab0fe51076fc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.561001 Oct 10 23:36:06.095279 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2039/3964] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:05 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:36:06.216553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-436f4aa5-38d9-4f4c-b716-7a38165e7f11 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:06.217611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-436f4aa5-38d9-4f4c-b716-7a38165e7f11 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:06.229501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-436f4aa5-38d9-4f4c-b716-7a38165e7f11 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:06.230959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-436f4aa5-38d9-4f4c-b716-7a38165e7f11 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:06.231926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-436f4aa5-38d9-4f4c-b716-7a38165e7f11 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:06.233323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-436f4aa5-38d9-4f4c-b716-7a38165e7f11 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:06.234283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-436f4aa5-38d9-4f4c-b716-7a38165e7f11 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:06.235238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-436f4aa5-38d9-4f4c-b716-7a38165e7f11 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:06.331146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d16cbc57-ee4c-49a5-8dd0-2028b463c528 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:06.343373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d16cbc57-ee4c-49a5-8dd0-2028b463c528 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:06.345156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d16cbc57-ee4c-49a5-8dd0-2028b463c528 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:06.347242 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d16cbc57-ee4c-49a5-8dd0-2028b463c528 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1724 microversion: 2.20 time: 0.496645 Oct 10 23:36:06.348063 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1926/3965] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:05 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1724 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:06.404269 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aeee3a6a-7e64-4279-8598-eb815b668f90 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:06.405134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aeee3a6a-7e64-4279-8598-eb815b668f90 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:06.412884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeee3a6a-7e64-4279-8598-eb815b668f90 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:06.413489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeee3a6a-7e64-4279-8598-eb815b668f90 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:06.413996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeee3a6a-7e64-4279-8598-eb815b668f90 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:06.414767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeee3a6a-7e64-4279-8598-eb815b668f90 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:06.415408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeee3a6a-7e64-4279-8598-eb815b668f90 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:06.415928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeee3a6a-7e64-4279-8598-eb815b668f90 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:06.505093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-436f4aa5-38d9-4f4c-b716-7a38165e7f11 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:06.514124 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-436f4aa5-38d9-4f4c-b716-7a38165e7f11 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 200 len: 1363 microversion: 2.1 time: 0.301680 Oct 10 23:36:06.515007 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2040/3966] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:06 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:36:06.568253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aeee3a6a-7e64-4279-8598-eb815b668f90 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:06.579006 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aeee3a6a-7e64-4279-8598-eb815b668f90 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 200 len: 1273 microversion: 2.1 time: 0.178566 Oct 10 23:36:06.579615 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1927/3967] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:06 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 1273 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:06.877085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7a0f3127-db81-4758-ae27-2f3766eb0970 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:06.878687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7a0f3127-db81-4758-ae27-2f3766eb0970 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:06.886011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a0f3127-db81-4758-ae27-2f3766eb0970 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:06.886519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a0f3127-db81-4758-ae27-2f3766eb0970 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:06.886974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a0f3127-db81-4758-ae27-2f3766eb0970 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:06.888129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a0f3127-db81-4758-ae27-2f3766eb0970 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:06.888604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a0f3127-db81-4758-ae27-2f3766eb0970 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:06.889210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a0f3127-db81-4758-ae27-2f3766eb0970 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:07.140319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-3b1338a3-c1fe-48f1-b768-1e01abb1bac4 req-947749dc-402f-4f7e-8cc0-94f8c2541ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bd745fa-6826-4bd1-8f8d-ae65071fac12", "name": "network-vif-deleted", "tag": "9a900297-53e2-4782-8def-24d4260702d5"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:07.159238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7a0f3127-db81-4758-ae27-2f3766eb0970 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:07.168524 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7a0f3127-db81-4758-ae27-2f3766eb0970 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1323 microversion: 2.1 time: 0.296043 Oct 10 23:36:07.178958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3b1338a3-c1fe-48f1-b768-1e01abb1bac4 req-947749dc-402f-4f7e-8cc0-94f8c2541ae3 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:07.180751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3b1338a3-c1fe-48f1-b768-1e01abb1bac4 req-947749dc-402f-4f7e-8cc0-94f8c2541ae3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:07.181409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3b1338a3-c1fe-48f1-b768-1e01abb1bac4 req-947749dc-402f-4f7e-8cc0-94f8c2541ae3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:07.197632 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2041/3968] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:06 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1323 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:07.199757 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-3b1338a3-c1fe-48f1-b768-1e01abb1bac4 req-947749dc-402f-4f7e-8cc0-94f8c2541ae3 service nova] Creating event network-vif-deleted:9a900297-53e2-4782-8def-24d4260702d5 for instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 on n-h2-860864-2 Oct 10 23:36:07.208598 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-3b1338a3-c1fe-48f1-b768-1e01abb1bac4 req-947749dc-402f-4f7e-8cc0-94f8c2541ae3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087954 Oct 10 23:36:07.209970 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1928/3969] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:36:07.212959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4126f34f-aace-4741-998b-e98cf146a8b0 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:07.213869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4126f34f-aace-4741-998b-e98cf146a8b0 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:07.237359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4126f34f-aace-4741-998b-e98cf146a8b0 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:07.238296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4126f34f-aace-4741-998b-e98cf146a8b0 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:07.238987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4126f34f-aace-4741-998b-e98cf146a8b0 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:07.239934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4126f34f-aace-4741-998b-e98cf146a8b0 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:07.240607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4126f34f-aace-4741-998b-e98cf146a8b0 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:07.241247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4126f34f-aace-4741-998b-e98cf146a8b0 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:07.385512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3728b4f6-c5f1-46b2-984c-5287bd2c4a48 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:07.387821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3728b4f6-c5f1-46b2-984c-5287bd2c4a48 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:07.399455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3728b4f6-c5f1-46b2-984c-5287bd2c4a48 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:07.400142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3728b4f6-c5f1-46b2-984c-5287bd2c4a48 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:07.400920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3728b4f6-c5f1-46b2-984c-5287bd2c4a48 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:07.401912 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3728b4f6-c5f1-46b2-984c-5287bd2c4a48 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:07.402465 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3728b4f6-c5f1-46b2-984c-5287bd2c4a48 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:07.403044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3728b4f6-c5f1-46b2-984c-5287bd2c4a48 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:07.466043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3728b4f6-c5f1-46b2-984c-5287bd2c4a48 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:07.466624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3728b4f6-c5f1-46b2-984c-5287bd2c4a48 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:07.467146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3728b4f6-c5f1-46b2-984c-5287bd2c4a48 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:07.467822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-3728b4f6-c5f1-46b2-984c-5287bd2c4a48 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lazy-loading 'fault' on Instance uuid 3bd745fa-6826-4bd1-8f8d-ae65071fac12 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:36:07.545816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4126f34f-aace-4741-998b-e98cf146a8b0 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:07.557880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4126f34f-aace-4741-998b-e98cf146a8b0 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:07.559325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4126f34f-aace-4741-998b-e98cf146a8b0 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:07.560832 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4126f34f-aace-4741-998b-e98cf146a8b0 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.361848 Oct 10 23:36:07.575661 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2042/3970] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:07 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:07.575661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0e7b4f82-95c7-4e67-ae2e-7b86c64d6db5 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:07.575661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0e7b4f82-95c7-4e67-ae2e-7b86c64d6db5 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:07.575661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e7b4f82-95c7-4e67-ae2e-7b86c64d6db5 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:07.575661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e7b4f82-95c7-4e67-ae2e-7b86c64d6db5 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:07.575661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e7b4f82-95c7-4e67-ae2e-7b86c64d6db5 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:07.576188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e7b4f82-95c7-4e67-ae2e-7b86c64d6db5 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:07.576820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e7b4f82-95c7-4e67-ae2e-7b86c64d6db5 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:07.577265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e7b4f82-95c7-4e67-ae2e-7b86c64d6db5 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:07.605241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3728b4f6-c5f1-46b2-984c-5287bd2c4a48 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:07.625252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3728b4f6-c5f1-46b2-984c-5287bd2c4a48 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:07.626712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3728b4f6-c5f1-46b2-984c-5287bd2c4a48 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:07.640277 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3728b4f6-c5f1-46b2-984c-5287bd2c4a48 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 200 len: 1372 microversion: 2.20 time: 0.268203 Oct 10 23:36:07.661571 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1929/3971] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:07 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 1372 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:36:07.670119 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1a04f825-f382-4088-beb3-f1775e4393eb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:07.670854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1a04f825-f382-4088-beb3-f1775e4393eb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:07.678988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a04f825-f382-4088-beb3-f1775e4393eb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:07.679803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a04f825-f382-4088-beb3-f1775e4393eb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:07.680485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a04f825-f382-4088-beb3-f1775e4393eb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:07.681673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a04f825-f382-4088-beb3-f1775e4393eb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:07.682622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a04f825-f382-4088-beb3-f1775e4393eb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:07.683265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a04f825-f382-4088-beb3-f1775e4393eb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:07.774225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0e7b4f82-95c7-4e67-ae2e-7b86c64d6db5 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:07.788455 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0e7b4f82-95c7-4e67-ae2e-7b86c64d6db5 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 200 len: 1363 microversion: 2.1 time: 0.226022 Oct 10 23:36:07.789458 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2043/3972] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:07 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:08.198694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a948ec1f-4030-4dde-9f96-81a29f0cb8ac tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:08.199695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a948ec1f-4030-4dde-9f96-81a29f0cb8ac tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:08.208370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a948ec1f-4030-4dde-9f96-81a29f0cb8ac tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:08.208874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a948ec1f-4030-4dde-9f96-81a29f0cb8ac tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:08.209323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a948ec1f-4030-4dde-9f96-81a29f0cb8ac tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:08.210211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a948ec1f-4030-4dde-9f96-81a29f0cb8ac tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:08.210681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a948ec1f-4030-4dde-9f96-81a29f0cb8ac tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:08.211112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a948ec1f-4030-4dde-9f96-81a29f0cb8ac tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:08.412146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a948ec1f-4030-4dde-9f96-81a29f0cb8ac tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:08.426380 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a948ec1f-4030-4dde-9f96-81a29f0cb8ac tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1323 microversion: 2.1 time: 0.231271 Oct 10 23:36:08.427496 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2044/3973] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:08 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1323 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:08.448645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1a04f825-f382-4088-beb3-f1775e4393eb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:08.458109 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1a04f825-f382-4088-beb3-f1775e4393eb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 200 len: 1315 microversion: 2.1 time: 0.794477 Oct 10 23:36:08.458849 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1930/3974] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:07 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 1315 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:08.595366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cee49dfb-5ea0-4ff2-bf1e-223cd44804c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:08.596898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cee49dfb-5ea0-4ff2-bf1e-223cd44804c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:08.603448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cee49dfb-5ea0-4ff2-bf1e-223cd44804c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:08.604230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cee49dfb-5ea0-4ff2-bf1e-223cd44804c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:08.604679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cee49dfb-5ea0-4ff2-bf1e-223cd44804c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:08.605498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cee49dfb-5ea0-4ff2-bf1e-223cd44804c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:08.605942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cee49dfb-5ea0-4ff2-bf1e-223cd44804c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:08.606298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cee49dfb-5ea0-4ff2-bf1e-223cd44804c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:08.610855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:36:08.669310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6b74a293-30cb-4fe7-93f5-3e1e4daf0073 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:08.672650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6b74a293-30cb-4fe7-93f5-3e1e4daf0073 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:08.680854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b74a293-30cb-4fe7-93f5-3e1e4daf0073 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:08.681654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b74a293-30cb-4fe7-93f5-3e1e4daf0073 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:08.683277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b74a293-30cb-4fe7-93f5-3e1e4daf0073 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:08.684000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b74a293-30cb-4fe7-93f5-3e1e4daf0073 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:08.684617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b74a293-30cb-4fe7-93f5-3e1e4daf0073 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:08.686547 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b74a293-30cb-4fe7-93f5-3e1e4daf0073 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:08.712097 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-6b74a293-30cb-4fe7-93f5-3e1e4daf0073 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] HTTP exception thrown: Instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 could not be found. Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6b74a293-30cb-4fe7-93f5-3e1e4daf0073 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Request method failure captured: Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 HTTP/1.1 Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKtHddx7WnsPKFRkNmvq2bpqhJ9CbWeF40H-fRJeV_tNk0xGgU03-6jZ4MU1LnTbjoP94-WzbXoZf8XAS9noOdTxqNalj4jiFUY8-Bi-DfBoGmUdVLBd4VMK_d3rC2ACB6wqH8PphzGg3eJlM858fdwn-TUi_Kdck6pUpxPdRl-KLVQ Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: bde1993b939b4fa0bd402a34fbdadc14 Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-562796264 Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bde1993b939b4fa0bd402a34fbdadc14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bde1993b939b4fa0bd402a34fbdadc14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bde1993b939b4fa0bd402a34fbdadc14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bde1993b939b4fa0bd402a34fbdadc14", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AttachVolumeShelveTestJSON-562796264 Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: bde1993b939b4fa0bd402a34fbdadc14 Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-562796264 Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AttachVolumeShelveTestJSON-562796264-project Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 8383806f776c44e781fc965eb5c425db Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AttachVolumeShelveTestJSON-562796264-project Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 could not be found. Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '3bd745fa-6826-4bd1-8f8d-ae65071fac12'} Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 could not be found. Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 could not be found. Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:36:08.714710 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:36:08.718128 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:36:08.718128 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:36:08.718128 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:36:08.718128 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:36:08.718128 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:36:08.718128 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:36:08.718128 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 could not be found. Oct 10 23:36:08.718128 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:36:08.718128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6b74a293-30cb-4fe7-93f5-3e1e4daf0073 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Returning 404 to user: Instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:36:08.718128 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6b74a293-30cb-4fe7-93f5-3e1e4daf0073 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 404 len: 111 microversion: 2.20 time: 0.051854 Oct 10 23:36:08.720330 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1931/3975] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:08 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 10 23:36:08.726377 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-300e6be1-5a1b-4388-8628-317b00167131 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '.version_select at 0x7f662b5c4a60>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:08.749678 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-300e6be1-5a1b-4388-8628-317b00167131 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1341021018" status: 204 len: 0 microversion: 2.20 time: 0.027289 Oct 10 23:36:08.757477 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1932/3976] 10.222.0.23 () {60 vars in 1262 bytes} [Mon Oct 10 23:36:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1341021018 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:36:08.816233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f73727fe-f5ea-43f7-bec2-b0d57aa3bb9e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:08.818582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f73727fe-f5ea-43f7-bec2-b0d57aa3bb9e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:08.830224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f73727fe-f5ea-43f7-bec2-b0d57aa3bb9e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:08.831601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f73727fe-f5ea-43f7-bec2-b0d57aa3bb9e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:08.832578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f73727fe-f5ea-43f7-bec2-b0d57aa3bb9e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:08.833765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f73727fe-f5ea-43f7-bec2-b0d57aa3bb9e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:08.834313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f73727fe-f5ea-43f7-bec2-b0d57aa3bb9e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:08.835096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f73727fe-f5ea-43f7-bec2-b0d57aa3bb9e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:08.879049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cee49dfb-5ea0-4ff2-bf1e-223cd44804c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:08.888837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cee49dfb-5ea0-4ff2-bf1e-223cd44804c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:08.890439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cee49dfb-5ea0-4ff2-bf1e-223cd44804c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:08.891730 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cee49dfb-5ea0-4ff2-bf1e-223cd44804c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.301481 Oct 10 23:36:08.892397 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2045/3977] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:08 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:09.452055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4d01f2fd-3f93-4e9e-88d8-bc9665e74585 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:09.454267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4d01f2fd-3f93-4e9e-88d8-bc9665e74585 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:09.462384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d01f2fd-3f93-4e9e-88d8-bc9665e74585 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:09.463431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d01f2fd-3f93-4e9e-88d8-bc9665e74585 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:09.463950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d01f2fd-3f93-4e9e-88d8-bc9665e74585 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:09.464864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d01f2fd-3f93-4e9e-88d8-bc9665e74585 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:09.465522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d01f2fd-3f93-4e9e-88d8-bc9665e74585 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:09.466038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d01f2fd-3f93-4e9e-88d8-bc9665e74585 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:09.638962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4d01f2fd-3f93-4e9e-88d8-bc9665e74585 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:09.648813 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4d01f2fd-3f93-4e9e-88d8-bc9665e74585 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1323 microversion: 2.1 time: 0.201179 Oct 10 23:36:09.649425 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2046/3978] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:09 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1323 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:36:09.654346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-45b9ae2e-a3ec-49ab-9d70-391f913f99fd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:09.655194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-45b9ae2e-a3ec-49ab-9d70-391f913f99fd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:09.661828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45b9ae2e-a3ec-49ab-9d70-391f913f99fd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:09.662691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45b9ae2e-a3ec-49ab-9d70-391f913f99fd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:09.663293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45b9ae2e-a3ec-49ab-9d70-391f913f99fd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:09.664340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45b9ae2e-a3ec-49ab-9d70-391f913f99fd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:09.665016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45b9ae2e-a3ec-49ab-9d70-391f913f99fd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:09.665669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45b9ae2e-a3ec-49ab-9d70-391f913f99fd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:09.758169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f73727fe-f5ea-43f7-bec2-b0d57aa3bb9e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:09.768781 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f73727fe-f5ea-43f7-bec2-b0d57aa3bb9e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 200 len: 1363 microversion: 2.1 time: 0.958010 Oct 10 23:36:09.774426 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1933/3979] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:08 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 1363 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:09.782084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-14712d22-1f09-47b7-9e77-992d13c513ba tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Action: 'create', calling method: .version_select at 0x7f663026dee0>, body: {"keypair": {"name": "tempest-keypair-1010653897", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRo9w7LIj0S6kZvPqIeWcZWD4iuQhERj/Xptx+7BhHl3rXIhSsBB7rZhUBgInMWE99IQKjTg3laYtqgagtO8Q1NnoU+coOnV+XbmKkNhJtWMzp6uAlwtqPs3rjhK58hcA=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:09.831485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-14712d22-1f09-47b7-9e77-992d13c513ba tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Getting quotas for project bde1993b939b4fa0bd402a34fbdadc14. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:36:09.840060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-14712d22-1f09-47b7-9e77-992d13c513ba tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Getting quotas for user 8383806f776c44e781fc965eb5c425db and project bde1993b939b4fa0bd402a34fbdadc14. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:36:09.858836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-45b9ae2e-a3ec-49ab-9d70-391f913f99fd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:09.873181 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-14712d22-1f09-47b7-9e77-992d13c513ba tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.096890 Oct 10 23:36:09.874085 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1934/3980] 10.222.0.23 () {62 vars in 1200 bytes} [Mon Oct 10 23:36:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 23:36:09.879054 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-45b9ae2e-a3ec-49ab-9d70-391f913f99fd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 200 len: 1315 microversion: 2.1 time: 0.228081 Oct 10 23:36:09.880048 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2047/3981] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:09 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:09.921123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a9cfdb75-e809-4555-bef4-3303cf46ab01 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:09.922238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a9cfdb75-e809-4555-bef4-3303cf46ab01 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:09.930295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9cfdb75-e809-4555-bef4-3303cf46ab01 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:09.930810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9cfdb75-e809-4555-bef4-3303cf46ab01 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:09.931238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9cfdb75-e809-4555-bef4-3303cf46ab01 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:09.932313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9cfdb75-e809-4555-bef4-3303cf46ab01 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:09.932775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9cfdb75-e809-4555-bef4-3303cf46ab01 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:09.933352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9cfdb75-e809-4555-bef4-3303cf46ab01 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:10.678865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e21765c8-1764-406f-90a4-c3ede92cac1e tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:10.680843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e21765c8-1764-406f-90a4-c3ede92cac1e tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:10.684649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:36:10.686398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=20 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:36:10.697251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e21765c8-1764-406f-90a4-c3ede92cac1e tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:10.698006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e21765c8-1764-406f-90a4-c3ede92cac1e tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:10.698630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e21765c8-1764-406f-90a4-c3ede92cac1e tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:10.701882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e21765c8-1764-406f-90a4-c3ede92cac1e tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:10.702803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e21765c8-1764-406f-90a4-c3ede92cac1e tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:10.703731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e21765c8-1764-406f-90a4-c3ede92cac1e tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:10.788458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a9cfdb75-e809-4555-bef4-3303cf46ab01 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:10.805331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a9cfdb75-e809-4555-bef4-3303cf46ab01 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:10.807875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a9cfdb75-e809-4555-bef4-3303cf46ab01 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:10.809939 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a9cfdb75-e809-4555-bef4-3303cf46ab01 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.894039 Oct 10 23:36:10.812904 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1935/3982] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:09 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:10.823613 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-838c01de-2706-4cdf-add2-fd4e8218a28b tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:10.824244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-838c01de-2706-4cdf-add2-fd4e8218a28b tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:10.842008 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-838c01de-2706-4cdf-add2-fd4e8218a28b tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:10.844803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-838c01de-2706-4cdf-add2-fd4e8218a28b tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:10.845829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-838c01de-2706-4cdf-add2-fd4e8218a28b tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:10.848813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-838c01de-2706-4cdf-add2-fd4e8218a28b tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:10.849445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-838c01de-2706-4cdf-add2-fd4e8218a28b tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:10.849893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-838c01de-2706-4cdf-add2-fd4e8218a28b tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:10.976778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e21765c8-1764-406f-90a4-c3ede92cac1e tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:10.989737 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e21765c8-1764-406f-90a4-c3ede92cac1e tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1323 microversion: 2.1 time: 0.318251 Oct 10 23:36:10.990721 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2048/3983] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:10 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1323 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:10.995963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4adfe5f7-7db0-4d56-8b56-65ecb50fd368 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:10.996913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4adfe5f7-7db0-4d56-8b56-65ecb50fd368 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:11.006172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4adfe5f7-7db0-4d56-8b56-65ecb50fd368 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:11.007101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4adfe5f7-7db0-4d56-8b56-65ecb50fd368 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:11.007646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4adfe5f7-7db0-4d56-8b56-65ecb50fd368 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:11.008597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4adfe5f7-7db0-4d56-8b56-65ecb50fd368 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:11.009157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4adfe5f7-7db0-4d56-8b56-65ecb50fd368 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:11.009720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4adfe5f7-7db0-4d56-8b56-65ecb50fd368 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:11.275744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4adfe5f7-7db0-4d56-8b56-65ecb50fd368 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:11.289687 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4adfe5f7-7db0-4d56-8b56-65ecb50fd368 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 200 len: 1315 microversion: 2.1 time: 0.297675 Oct 10 23:36:11.303713 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2049/3984] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:10 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:11.319241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-50778e52-25ab-42c1-91c1-29ed211af4ec req-c2a125cd-fe62-492f-a6e9-fb13801d9552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b9ff1a-05a0-46ff-8bac-2e12e7853f4f", "name": "network-vif-plugged", "status": "completed", "tag": "b231ca15-d59d-47a6-8ac7-16f1ba7ae25d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:11.332709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-50778e52-25ab-42c1-91c1-29ed211af4ec req-c2a125cd-fe62-492f-a6e9-fb13801d9552 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:11.333646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-50778e52-25ab-42c1-91c1-29ed211af4ec req-c2a125cd-fe62-492f-a6e9-fb13801d9552 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:11.334307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-50778e52-25ab-42c1-91c1-29ed211af4ec req-c2a125cd-fe62-492f-a6e9-fb13801d9552 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:11.350227 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-50778e52-25ab-42c1-91c1-29ed211af4ec req-c2a125cd-fe62-492f-a6e9-fb13801d9552 service nova] Creating event network-vif-plugged:b231ca15-d59d-47a6-8ac7-16f1ba7ae25d for instance 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f on n-h1-860864-2 Oct 10 23:36:11.356234 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-50778e52-25ab-42c1-91c1-29ed211af4ec req-c2a125cd-fe62-492f-a6e9-fb13801d9552 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042018 Oct 10 23:36:11.357438 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2050/3985] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:36:11.742965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e882d176-899f-41e7-8de1-4e6ac2dd011c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1207707684", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f75204ba-88c2-48a1-9aaf-b4737fa6a06d"}], "security_groups": [{"name": "tempest-securitygroup--1294403166"}], "key_name": "tempest-keypair-1010653897", "user_data": "}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:11.867292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-838c01de-2706-4cdf-add2-fd4e8218a28b tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:11.875053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:36:11.878278 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-838c01de-2706-4cdf-add2-fd4e8218a28b tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 200 len: 1363 microversion: 2.1 time: 1.063690 Oct 10 23:36:11.879263 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1936/3986] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:10 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 1363 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:11.884279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0ed944be-c07b-42f6-a5ca-73560635704b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:11.884914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0ed944be-c07b-42f6-a5ca-73560635704b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:11.898796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ed944be-c07b-42f6-a5ca-73560635704b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:11.899938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ed944be-c07b-42f6-a5ca-73560635704b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:11.900848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ed944be-c07b-42f6-a5ca-73560635704b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:11.902000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ed944be-c07b-42f6-a5ca-73560635704b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:11.902630 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ed944be-c07b-42f6-a5ca-73560635704b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:11.903377 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ed944be-c07b-42f6-a5ca-73560635704b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:12.190478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-e882d176-899f-41e7-8de1-4e6ac2dd011c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] validate_networks() for [('f75204ba-88c2-48a1-9aaf-b4737fa6a06d', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:36:12.512815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0ed944be-c07b-42f6-a5ca-73560635704b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:12.574146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0ed944be-c07b-42f6-a5ca-73560635704b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:12.583977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0ed944be-c07b-42f6-a5ca-73560635704b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:12.590643 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0ed944be-c07b-42f6-a5ca-73560635704b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.708239 Oct 10 23:36:12.593188 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1937/3987] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:11 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:12.603976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ab78d7b4-63d8-4df3-b96b-b3b0d9fb2248 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:12.605179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ab78d7b4-63d8-4df3-b96b-b3b0d9fb2248 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:12.619173 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab78d7b4-63d8-4df3-b96b-b3b0d9fb2248 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:12.619702 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab78d7b4-63d8-4df3-b96b-b3b0d9fb2248 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:12.620490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab78d7b4-63d8-4df3-b96b-b3b0d9fb2248 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:12.621221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab78d7b4-63d8-4df3-b96b-b3b0d9fb2248 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:12.621850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab78d7b4-63d8-4df3-b96b-b3b0d9fb2248 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:12.622315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab78d7b4-63d8-4df3-b96b-b3b0d9fb2248 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:12.843718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e882d176-899f-41e7-8de1-4e6ac2dd011c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:36:12.844477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e882d176-899f-41e7-8de1-4e6ac2dd011c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:36:12.845078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e882d176-899f-41e7-8de1-4e6ac2dd011c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:36:12.846361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e882d176-899f-41e7-8de1-4e6ac2dd011c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:36:12.847021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e882d176-899f-41e7-8de1-4e6ac2dd011c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:36:12.859486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e882d176-899f-41e7-8de1-4e6ac2dd011c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:12.860106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e882d176-899f-41e7-8de1-4e6ac2dd011c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:12.862173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e882d176-899f-41e7-8de1-4e6ac2dd011c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:12.863581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e882d176-899f-41e7-8de1-4e6ac2dd011c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:12.863842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e882d176-899f-41e7-8de1-4e6ac2dd011c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:12.864518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e882d176-899f-41e7-8de1-4e6ac2dd011c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:12.887897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-e882d176-899f-41e7-8de1-4e6ac2dd011c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Getting quotas for project bde1993b939b4fa0bd402a34fbdadc14. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:36:12.895231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-e882d176-899f-41e7-8de1-4e6ac2dd011c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Getting quotas for user 8383806f776c44e781fc965eb5c425db and project bde1993b939b4fa0bd402a34fbdadc14. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:36:12.913865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e882d176-899f-41e7-8de1-4e6ac2dd011c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:36:12.916633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e882d176-899f-41e7-8de1-4e6ac2dd011c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:36:12.965334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ab78d7b4-63d8-4df3-b96b-b3b0d9fb2248 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:12.968384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:36:12.982644 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ab78d7b4-63d8-4df3-b96b-b3b0d9fb2248 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1323 microversion: 2.1 time: 0.383784 Oct 10 23:36:12.998194 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1938/3988] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:12 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1323 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:13.008037 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e882d176-899f-41e7-8de1-4e6ac2dd011c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.269247 Oct 10 23:36:13.008969 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2051/3989] 10.222.0.23 () {62 vars in 1188 bytes} [Mon Oct 10 23:36:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 1274 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 10 23:36:13.011910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-78e724c1-baf3-4f2e-9800-0ca6ffc05e04 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:13.012548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-78e724c1-baf3-4f2e-9800-0ca6ffc05e04 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:13.026781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78e724c1-baf3-4f2e-9800-0ca6ffc05e04 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:13.027280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78e724c1-baf3-4f2e-9800-0ca6ffc05e04 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:13.029248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78e724c1-baf3-4f2e-9800-0ca6ffc05e04 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:13.032151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78e724c1-baf3-4f2e-9800-0ca6ffc05e04 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:13.032637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78e724c1-baf3-4f2e-9800-0ca6ffc05e04 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:13.032853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-d4fc1fae-ee58-4c5d-93c2-a100690ed35e req-9a2cc9bb-8c8f-40e1-a612-dfaa0d72a38b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d", "tag": "0ca323c5-08ed-433b-892e-43a213787a79"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:13.033405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78e724c1-baf3-4f2e-9800-0ca6ffc05e04 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:13.045515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d4fc1fae-ee58-4c5d-93c2-a100690ed35e req-9a2cc9bb-8c8f-40e1-a612-dfaa0d72a38b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:13.046797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d4fc1fae-ee58-4c5d-93c2-a100690ed35e req-9a2cc9bb-8c8f-40e1-a612-dfaa0d72a38b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:13.047399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d4fc1fae-ee58-4c5d-93c2-a100690ed35e req-9a2cc9bb-8c8f-40e1-a612-dfaa0d72a38b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:13.062941 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-d4fc1fae-ee58-4c5d-93c2-a100690ed35e req-9a2cc9bb-8c8f-40e1-a612-dfaa0d72a38b service nova] Creating event network-changed:0ca323c5-08ed-433b-892e-43a213787a79 for instance 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d on n-h1-860864-2 Oct 10 23:36:13.068824 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-d4fc1fae-ee58-4c5d-93c2-a100690ed35e req-9a2cc9bb-8c8f-40e1-a612-dfaa0d72a38b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055573 Oct 10 23:36:13.070750 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2052/3990] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:36:13.076135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8ff11f47-f0a1-4b68-872c-cf32195a4f37 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:13.077181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8ff11f47-f0a1-4b68-872c-cf32195a4f37 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:13.084837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ff11f47-f0a1-4b68-872c-cf32195a4f37 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:13.085664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ff11f47-f0a1-4b68-872c-cf32195a4f37 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:13.086268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ff11f47-f0a1-4b68-872c-cf32195a4f37 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:13.087327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ff11f47-f0a1-4b68-872c-cf32195a4f37 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:13.087946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ff11f47-f0a1-4b68-872c-cf32195a4f37 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:13.088807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ff11f47-f0a1-4b68-872c-cf32195a4f37 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:13.386255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8ff11f47-f0a1-4b68-872c-cf32195a4f37 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:13.398197 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8ff11f47-f0a1-4b68-872c-cf32195a4f37 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 200 len: 1363 microversion: 2.1 time: 0.326024 Oct 10 23:36:13.399125 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2053/3991] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:13 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:13.403690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-94cebe35-7686-4c4d-8107-dc06cfd1bc7e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:13.404399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-94cebe35-7686-4c4d-8107-dc06cfd1bc7e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:13.412752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:36:13.488751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-94cebe35-7686-4c4d-8107-dc06cfd1bc7e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:13.501000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-94cebe35-7686-4c4d-8107-dc06cfd1bc7e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:13.512000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-94cebe35-7686-4c4d-8107-dc06cfd1bc7e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:13.513365 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-94cebe35-7686-4c4d-8107-dc06cfd1bc7e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1282 microversion: 2.20 time: 0.113378 Oct 10 23:36:13.518923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-78e724c1-baf3-4f2e-9800-0ca6ffc05e04 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:13.519766 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2054/3992] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:13 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1282 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:13.540341 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-78e724c1-baf3-4f2e-9800-0ca6ffc05e04 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 200 len: 1315 microversion: 2.1 time: 0.538294 Oct 10 23:36:13.550463 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1939/3993] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:13 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:13.622494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0a15ea15-1ced-4861-ad3c-896de6d74cb5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:13.623421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0a15ea15-1ced-4861-ad3c-896de6d74cb5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:13.633327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a15ea15-1ced-4861-ad3c-896de6d74cb5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:13.634014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a15ea15-1ced-4861-ad3c-896de6d74cb5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:13.634457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a15ea15-1ced-4861-ad3c-896de6d74cb5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:13.635420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a15ea15-1ced-4861-ad3c-896de6d74cb5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:13.635941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a15ea15-1ced-4861-ad3c-896de6d74cb5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:13.636451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a15ea15-1ced-4861-ad3c-896de6d74cb5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:13.945426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0a15ea15-1ced-4861-ad3c-896de6d74cb5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:13.956411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0a15ea15-1ced-4861-ad3c-896de6d74cb5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:13.958075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0a15ea15-1ced-4861-ad3c-896de6d74cb5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:13.959367 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0a15ea15-1ced-4861-ad3c-896de6d74cb5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.341491 Oct 10 23:36:13.960405 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2055/3994] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:13 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:14.009918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-183e0358-5e0c-4445-8c67-47d07e522dc5 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:14.010726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-183e0358-5e0c-4445-8c67-47d07e522dc5 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:14.016864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-183e0358-5e0c-4445-8c67-47d07e522dc5 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:14.017364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-183e0358-5e0c-4445-8c67-47d07e522dc5 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:14.019187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-183e0358-5e0c-4445-8c67-47d07e522dc5 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:14.020231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-183e0358-5e0c-4445-8c67-47d07e522dc5 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:14.020819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-183e0358-5e0c-4445-8c67-47d07e522dc5 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:14.021165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-183e0358-5e0c-4445-8c67-47d07e522dc5 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:14.196093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-183e0358-5e0c-4445-8c67-47d07e522dc5 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:14.205953 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-183e0358-5e0c-4445-8c67-47d07e522dc5 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1323 microversion: 2.1 time: 0.200167 Oct 10 23:36:14.206730 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1940/3995] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:14 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1323 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:14.426846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8bc6d9af-f530-4b0b-8070-5458ce372f82 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:14.427488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8bc6d9af-f530-4b0b-8070-5458ce372f82 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:14.434155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8bc6d9af-f530-4b0b-8070-5458ce372f82 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:14.435052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8bc6d9af-f530-4b0b-8070-5458ce372f82 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:14.436088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8bc6d9af-f530-4b0b-8070-5458ce372f82 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:14.436982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8bc6d9af-f530-4b0b-8070-5458ce372f82 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:14.437686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8bc6d9af-f530-4b0b-8070-5458ce372f82 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:14.438345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8bc6d9af-f530-4b0b-8070-5458ce372f82 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:14.544604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5bb47e3c-d422-4eaf-a4a8-4e9d4bcd9a0e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:14.545218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5bb47e3c-d422-4eaf-a4a8-4e9d4bcd9a0e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:14.553628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5bb47e3c-d422-4eaf-a4a8-4e9d4bcd9a0e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:14.554127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5bb47e3c-d422-4eaf-a4a8-4e9d4bcd9a0e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:14.554571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5bb47e3c-d422-4eaf-a4a8-4e9d4bcd9a0e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:14.555280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5bb47e3c-d422-4eaf-a4a8-4e9d4bcd9a0e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:14.555954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5bb47e3c-d422-4eaf-a4a8-4e9d4bcd9a0e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:14.556387 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5bb47e3c-d422-4eaf-a4a8-4e9d4bcd9a0e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:14.630649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5bb47e3c-d422-4eaf-a4a8-4e9d4bcd9a0e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:14.635951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5bb47e3c-d422-4eaf-a4a8-4e9d4bcd9a0e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:14.637441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5bb47e3c-d422-4eaf-a4a8-4e9d4bcd9a0e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:14.638585 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5bb47e3c-d422-4eaf-a4a8-4e9d4bcd9a0e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1334 microversion: 2.20 time: 0.098133 Oct 10 23:36:14.641819 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1941/3996] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:14 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1334 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:36:14.643941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5ec5d975-74a9-4414-8345-0fc043b5ac66 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:14.644560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5ec5d975-74a9-4414-8345-0fc043b5ac66 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:14.647435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:36:14.651892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ec5d975-74a9-4414-8345-0fc043b5ac66 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:14.652599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ec5d975-74a9-4414-8345-0fc043b5ac66 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:14.653207 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ec5d975-74a9-4414-8345-0fc043b5ac66 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:14.654154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ec5d975-74a9-4414-8345-0fc043b5ac66 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:14.654788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ec5d975-74a9-4414-8345-0fc043b5ac66 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:14.655383 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ec5d975-74a9-4414-8345-0fc043b5ac66 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:14.787031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8bc6d9af-f530-4b0b-8070-5458ce372f82 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:14.795039 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8bc6d9af-f530-4b0b-8070-5458ce372f82 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 200 len: 1552 microversion: 2.1 time: 0.373845 Oct 10 23:36:14.795970 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2056/3997] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:14 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 1552 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:14.821042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3ac935c3-7267-4bda-83d4-aea058f4c767 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:14.821602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3ac935c3-7267-4bda-83d4-aea058f4c767 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:14.828440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ac935c3-7267-4bda-83d4-aea058f4c767 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:14.828921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ac935c3-7267-4bda-83d4-aea058f4c767 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:14.829354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ac935c3-7267-4bda-83d4-aea058f4c767 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:14.830417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ac935c3-7267-4bda-83d4-aea058f4c767 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:14.830894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ac935c3-7267-4bda-83d4-aea058f4c767 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:14.831311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ac935c3-7267-4bda-83d4-aea058f4c767 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:14.835904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5ec5d975-74a9-4414-8345-0fc043b5ac66 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:14.847098 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5ec5d975-74a9-4414-8345-0fc043b5ac66 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 200 len: 1315 microversion: 2.1 time: 0.206415 Oct 10 23:36:14.847950 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1942/3998] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:14 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:14.947570 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3ac935c3-7267-4bda-83d4-aea058f4c767 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131304 Oct 10 23:36:14.948183 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2057/3999] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Oct 10 23:36:14 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:36:14.985923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-326313c7-c033-4f81-8de0-58e39717d13a tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:14.987798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-326313c7-c033-4f81-8de0-58e39717d13a tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:15.000918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-326313c7-c033-4f81-8de0-58e39717d13a tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:15.001925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-326313c7-c033-4f81-8de0-58e39717d13a tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:15.003190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-326313c7-c033-4f81-8de0-58e39717d13a tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:15.003911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-326313c7-c033-4f81-8de0-58e39717d13a tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:15.004531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-326313c7-c033-4f81-8de0-58e39717d13a tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:15.004961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-326313c7-c033-4f81-8de0-58e39717d13a tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:15.130148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-2a7991e6-ae1b-4968-840b-18fd05f76d82 req-ceb06787-f27d-4064-b1ba-c662f3e4432c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0299384f-1c8e-41ee-9d98-9823342a6a72", "tag": "ffe2514f-3db6-4c1c-8e18-3ce1be0107b9"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:15.140978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2a7991e6-ae1b-4968-840b-18fd05f76d82 req-ceb06787-f27d-4064-b1ba-c662f3e4432c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:15.141528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2a7991e6-ae1b-4968-840b-18fd05f76d82 req-ceb06787-f27d-4064-b1ba-c662f3e4432c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:15.142021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2a7991e6-ae1b-4968-840b-18fd05f76d82 req-ceb06787-f27d-4064-b1ba-c662f3e4432c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:15.156569 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-2a7991e6-ae1b-4968-840b-18fd05f76d82 req-ceb06787-f27d-4064-b1ba-c662f3e4432c service nova] Creating event network-changed:ffe2514f-3db6-4c1c-8e18-3ce1be0107b9 for instance 0299384f-1c8e-41ee-9d98-9823342a6a72 on n-h2-860864-2 Oct 10 23:36:15.165170 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-2a7991e6-ae1b-4968-840b-18fd05f76d82 req-ceb06787-f27d-4064-b1ba-c662f3e4432c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038264 Oct 10 23:36:15.166137 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2058/4000] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:36:15.230747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-095bdffd-87e0-44d6-b509-d048c7a32008 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:15.231837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-095bdffd-87e0-44d6-b509-d048c7a32008 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:15.240887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-095bdffd-87e0-44d6-b509-d048c7a32008 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:15.241766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-095bdffd-87e0-44d6-b509-d048c7a32008 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:15.243091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-095bdffd-87e0-44d6-b509-d048c7a32008 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:15.244087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-095bdffd-87e0-44d6-b509-d048c7a32008 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:15.244760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-095bdffd-87e0-44d6-b509-d048c7a32008 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:15.245715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-095bdffd-87e0-44d6-b509-d048c7a32008 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:15.530877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-095bdffd-87e0-44d6-b509-d048c7a32008 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:15.542961 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-095bdffd-87e0-44d6-b509-d048c7a32008 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1323 microversion: 2.1 time: 0.316157 Oct 10 23:36:15.558169 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2059/4001] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:15 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1323 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:36:15.666894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2ec4ef8e-2844-4f31-928a-0f4fa3cad34e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:15.667721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2ec4ef8e-2844-4f31-928a-0f4fa3cad34e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:15.675941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ec4ef8e-2844-4f31-928a-0f4fa3cad34e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:15.676796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ec4ef8e-2844-4f31-928a-0f4fa3cad34e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:15.677643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ec4ef8e-2844-4f31-928a-0f4fa3cad34e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:15.678584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ec4ef8e-2844-4f31-928a-0f4fa3cad34e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:15.679293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ec4ef8e-2844-4f31-928a-0f4fa3cad34e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:15.679901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ec4ef8e-2844-4f31-928a-0f4fa3cad34e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:15.778384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-326313c7-c033-4f81-8de0-58e39717d13a tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:15.787717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2ec4ef8e-2844-4f31-928a-0f4fa3cad34e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:15.791813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-326313c7-c033-4f81-8de0-58e39717d13a tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:15.793797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-326313c7-c033-4f81-8de0-58e39717d13a tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:15.795271 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-326313c7-c033-4f81-8de0-58e39717d13a tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.813526 Oct 10 23:36:15.796428 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1943/4002] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:14 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:15.815209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2ec4ef8e-2844-4f31-928a-0f4fa3cad34e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:15.815209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2ec4ef8e-2844-4f31-928a-0f4fa3cad34e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:15.819756 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2ec4ef8e-2844-4f31-928a-0f4fa3cad34e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1334 microversion: 2.20 time: 0.151016 Oct 10 23:36:15.835061 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2060/4003] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:15 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1334 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:15.878302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-68b986ab-fa8e-44ca-bfa0-b9bebd5278f9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:15.884864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-68b986ab-fa8e-44ca-bfa0-b9bebd5278f9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:15.896455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68b986ab-fa8e-44ca-bfa0-b9bebd5278f9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:15.899788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68b986ab-fa8e-44ca-bfa0-b9bebd5278f9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:15.901159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68b986ab-fa8e-44ca-bfa0-b9bebd5278f9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:15.904617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68b986ab-fa8e-44ca-bfa0-b9bebd5278f9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:15.907033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68b986ab-fa8e-44ca-bfa0-b9bebd5278f9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:15.907657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68b986ab-fa8e-44ca-bfa0-b9bebd5278f9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:16.575127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5fcccca2-5162-4fea-8960-006b591a2eb6 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:16.578562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5fcccca2-5162-4fea-8960-006b591a2eb6 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:16.587796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fcccca2-5162-4fea-8960-006b591a2eb6 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:16.591032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fcccca2-5162-4fea-8960-006b591a2eb6 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:16.592197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fcccca2-5162-4fea-8960-006b591a2eb6 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:16.593211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fcccca2-5162-4fea-8960-006b591a2eb6 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:16.593986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fcccca2-5162-4fea-8960-006b591a2eb6 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:16.595165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fcccca2-5162-4fea-8960-006b591a2eb6 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:16.626153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-68b986ab-fa8e-44ca-bfa0-b9bebd5278f9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:16.648537 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-68b986ab-fa8e-44ca-bfa0-b9bebd5278f9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 200 len: 1315 microversion: 2.1 time: 0.780882 Oct 10 23:36:16.664337 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1944/4004] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:15 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 1315 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:16.827424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-53673f65-9851-47c6-890d-54188e924442 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:16.828098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-53673f65-9851-47c6-890d-54188e924442 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:16.835727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53673f65-9851-47c6-890d-54188e924442 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:16.836610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53673f65-9851-47c6-890d-54188e924442 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:16.837311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53673f65-9851-47c6-890d-54188e924442 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:16.838284 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53673f65-9851-47c6-890d-54188e924442 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:16.838969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53673f65-9851-47c6-890d-54188e924442 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:16.839608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53673f65-9851-47c6-890d-54188e924442 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:17.142262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5fcccca2-5162-4fea-8960-006b591a2eb6 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:17.150456 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5fcccca2-5162-4fea-8960-006b591a2eb6 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1323 microversion: 2.1 time: 0.586028 Oct 10 23:36:17.165804 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2061/4005] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:16 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1323 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:17.177032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fb913cbe-c881-41ce-818a-83f2b616b1d8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:17.177871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fb913cbe-c881-41ce-818a-83f2b616b1d8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:17.184375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb913cbe-c881-41ce-818a-83f2b616b1d8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:17.185127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb913cbe-c881-41ce-818a-83f2b616b1d8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:17.185983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb913cbe-c881-41ce-818a-83f2b616b1d8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:17.186891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb913cbe-c881-41ce-818a-83f2b616b1d8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:17.187556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb913cbe-c881-41ce-818a-83f2b616b1d8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:17.188171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb913cbe-c881-41ce-818a-83f2b616b1d8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:17.274530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fb913cbe-c881-41ce-818a-83f2b616b1d8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:17.293964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fb913cbe-c881-41ce-818a-83f2b616b1d8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:17.296238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fb913cbe-c881-41ce-818a-83f2b616b1d8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:17.299390 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fb913cbe-c881-41ce-818a-83f2b616b1d8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1340 microversion: 2.20 time: 0.131638 Oct 10 23:36:17.301081 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2062/4006] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:17 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1340 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:17.678280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-da6780b3-3527-4a51-bc96-c75654ff1d67 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:17.678996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-da6780b3-3527-4a51-bc96-c75654ff1d67 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:17.686643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da6780b3-3527-4a51-bc96-c75654ff1d67 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:17.687670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da6780b3-3527-4a51-bc96-c75654ff1d67 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:17.688415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da6780b3-3527-4a51-bc96-c75654ff1d67 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:17.689722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da6780b3-3527-4a51-bc96-c75654ff1d67 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:17.691064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da6780b3-3527-4a51-bc96-c75654ff1d67 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:17.691684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da6780b3-3527-4a51-bc96-c75654ff1d67 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:17.949636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-53673f65-9851-47c6-890d-54188e924442 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:17.968921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-53673f65-9851-47c6-890d-54188e924442 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:17.973047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-53673f65-9851-47c6-890d-54188e924442 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:17.975494 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-53673f65-9851-47c6-890d-54188e924442 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 1.152324 Oct 10 23:36:17.976935 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1945/4007] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:16 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:18.008454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-da6780b3-3527-4a51-bc96-c75654ff1d67 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:18.021647 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-da6780b3-3527-4a51-bc96-c75654ff1d67 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 200 len: 1315 microversion: 2.1 time: 0.346091 Oct 10 23:36:18.023146 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2063/4008] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:17 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:36:18.177888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8b08f6f6-75aa-4bda-ae80-52087d944a4d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:18.179417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8b08f6f6-75aa-4bda-ae80-52087d944a4d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:18.186946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b08f6f6-75aa-4bda-ae80-52087d944a4d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:18.187531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b08f6f6-75aa-4bda-ae80-52087d944a4d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:18.188038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b08f6f6-75aa-4bda-ae80-52087d944a4d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:18.188833 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b08f6f6-75aa-4bda-ae80-52087d944a4d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:18.190097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b08f6f6-75aa-4bda-ae80-52087d944a4d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:18.190630 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b08f6f6-75aa-4bda-ae80-52087d944a4d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:18.332961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e4781e0e-db17-4305-9ffb-83c524bf953c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:18.337026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e4781e0e-db17-4305-9ffb-83c524bf953c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:18.345232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4781e0e-db17-4305-9ffb-83c524bf953c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:18.346695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4781e0e-db17-4305-9ffb-83c524bf953c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:18.347686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4781e0e-db17-4305-9ffb-83c524bf953c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:18.349297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4781e0e-db17-4305-9ffb-83c524bf953c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:18.351224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4781e0e-db17-4305-9ffb-83c524bf953c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:18.351899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4781e0e-db17-4305-9ffb-83c524bf953c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:18.655468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e4781e0e-db17-4305-9ffb-83c524bf953c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:18.666329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e4781e0e-db17-4305-9ffb-83c524bf953c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:18.670548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e4781e0e-db17-4305-9ffb-83c524bf953c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:18.672066 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e4781e0e-db17-4305-9ffb-83c524bf953c tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1408 microversion: 2.20 time: 0.346992 Oct 10 23:36:18.672646 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2064/4009] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:18 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1408 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:18.754262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8b08f6f6-75aa-4bda-ae80-52087d944a4d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:18.762893 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8b08f6f6-75aa-4bda-ae80-52087d944a4d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1323 microversion: 2.1 time: 0.588876 Oct 10 23:36:18.769817 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1946/4010] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:18 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1323 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:18.957353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-f0e160d7-9aea-4fbb-a9fe-6bdb0ad2a7b5 req-0dca009c-fe0a-4788-9c4a-19d834b853e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81f5c98e-777a-4d5b-aed5-89fd026f1734", "tag": "14e55a18-a2c4-41ce-8ca8-1d0de903ab65"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:18.978306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f0e160d7-9aea-4fbb-a9fe-6bdb0ad2a7b5 req-0dca009c-fe0a-4788-9c4a-19d834b853e1 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:18.981266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f0e160d7-9aea-4fbb-a9fe-6bdb0ad2a7b5 req-0dca009c-fe0a-4788-9c4a-19d834b853e1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:18.981953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f0e160d7-9aea-4fbb-a9fe-6bdb0ad2a7b5 req-0dca009c-fe0a-4788-9c4a-19d834b853e1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:19.003400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4b72eca8-1c5d-4ea2-98e0-298e562fc29d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:19.004278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4b72eca8-1c5d-4ea2-98e0-298e562fc29d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:19.011830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b72eca8-1c5d-4ea2-98e0-298e562fc29d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:19.012201 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-f0e160d7-9aea-4fbb-a9fe-6bdb0ad2a7b5 req-0dca009c-fe0a-4788-9c4a-19d834b853e1 service nova] Creating event network-changed:14e55a18-a2c4-41ce-8ca8-1d0de903ab65 for instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 on n-h2-860864-2 Oct 10 23:36:19.022349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b72eca8-1c5d-4ea2-98e0-298e562fc29d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:19.022814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b72eca8-1c5d-4ea2-98e0-298e562fc29d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:19.023842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b72eca8-1c5d-4ea2-98e0-298e562fc29d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:19.025846 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-f0e160d7-9aea-4fbb-a9fe-6bdb0ad2a7b5 req-0dca009c-fe0a-4788-9c4a-19d834b853e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074668 Oct 10 23:36:19.028093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b72eca8-1c5d-4ea2-98e0-298e562fc29d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:19.028715 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2065/4011] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:36:19.029596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b72eca8-1c5d-4ea2-98e0-298e562fc29d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:19.035011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-7074ba19-79d1-49e3-9a06-23370fa151d1 req-843d1b87-7d8c-4e95-b7b0-284d9cfe25a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0299384f-1c8e-41ee-9d98-9823342a6a72", "name": "network-vif-plugged", "status": "completed", "tag": "ffe2514f-3db6-4c1c-8e18-3ce1be0107b9"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:19.045091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7074ba19-79d1-49e3-9a06-23370fa151d1 req-843d1b87-7d8c-4e95-b7b0-284d9cfe25a9 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:19.045617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7074ba19-79d1-49e3-9a06-23370fa151d1 req-843d1b87-7d8c-4e95-b7b0-284d9cfe25a9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:19.046058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7074ba19-79d1-49e3-9a06-23370fa151d1 req-843d1b87-7d8c-4e95-b7b0-284d9cfe25a9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:19.058834 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-7074ba19-79d1-49e3-9a06-23370fa151d1 req-843d1b87-7d8c-4e95-b7b0-284d9cfe25a9 service nova] Creating event network-vif-plugged:ffe2514f-3db6-4c1c-8e18-3ce1be0107b9 for instance 0299384f-1c8e-41ee-9d98-9823342a6a72 on n-h2-860864-2 Oct 10 23:36:19.065303 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-7074ba19-79d1-49e3-9a06-23370fa151d1 req-843d1b87-7d8c-4e95-b7b0-284d9cfe25a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034133 Oct 10 23:36:19.066378 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2066/4012] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:36:19.072388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2b15abc7-b5f6-4798-9a46-4b2f90b0be11 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:19.073392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2b15abc7-b5f6-4798-9a46-4b2f90b0be11 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:19.080700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b15abc7-b5f6-4798-9a46-4b2f90b0be11 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:19.081524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b15abc7-b5f6-4798-9a46-4b2f90b0be11 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:19.082155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b15abc7-b5f6-4798-9a46-4b2f90b0be11 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:19.083061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b15abc7-b5f6-4798-9a46-4b2f90b0be11 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:19.083714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b15abc7-b5f6-4798-9a46-4b2f90b0be11 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:19.084325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b15abc7-b5f6-4798-9a46-4b2f90b0be11 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:19.089772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:36:19.341119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2b15abc7-b5f6-4798-9a46-4b2f90b0be11 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:19.356484 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2b15abc7-b5f6-4798-9a46-4b2f90b0be11 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 200 len: 1315 microversion: 2.1 time: 0.288614 Oct 10 23:36:19.371862 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2067/4013] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:19 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:19.447399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-04b2a6c6-1507-4c79-afc8-69c8d719f652 req-8b1e4787-cf77-4027-b7b9-5cd481ecacbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16b9ff1a-05a0-46ff-8bac-2e12e7853f4f", "tag": "b231ca15-d59d-47a6-8ac7-16f1ba7ae25d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:19.466329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-04b2a6c6-1507-4c79-afc8-69c8d719f652 req-8b1e4787-cf77-4027-b7b9-5cd481ecacbb service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:19.467163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-04b2a6c6-1507-4c79-afc8-69c8d719f652 req-8b1e4787-cf77-4027-b7b9-5cd481ecacbb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:19.467786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-04b2a6c6-1507-4c79-afc8-69c8d719f652 req-8b1e4787-cf77-4027-b7b9-5cd481ecacbb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:19.481598 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-04b2a6c6-1507-4c79-afc8-69c8d719f652 req-8b1e4787-cf77-4027-b7b9-5cd481ecacbb service nova] Creating event network-changed:b231ca15-d59d-47a6-8ac7-16f1ba7ae25d for instance 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f on n-h1-860864-2 Oct 10 23:36:19.490449 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-04b2a6c6-1507-4c79-afc8-69c8d719f652 req-8b1e4787-cf77-4027-b7b9-5cd481ecacbb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049234 Oct 10 23:36:19.491721 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2068/4014] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:36:19.629224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4b72eca8-1c5d-4ea2-98e0-298e562fc29d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:19.645532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4b72eca8-1c5d-4ea2-98e0-298e562fc29d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:19.647344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4b72eca8-1c5d-4ea2-98e0-298e562fc29d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:19.648577 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4b72eca8-1c5d-4ea2-98e0-298e562fc29d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.649385 Oct 10 23:36:19.649762 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1947/4015] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:18 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:19.698312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d991304c-86ac-4fd5-a5b7-289fc0b98209 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:19.699250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d991304c-86ac-4fd5-a5b7-289fc0b98209 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:19.706817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d991304c-86ac-4fd5-a5b7-289fc0b98209 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:19.707558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d991304c-86ac-4fd5-a5b7-289fc0b98209 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:19.708144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d991304c-86ac-4fd5-a5b7-289fc0b98209 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:19.708998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d991304c-86ac-4fd5-a5b7-289fc0b98209 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:19.709622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d991304c-86ac-4fd5-a5b7-289fc0b98209 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:19.710188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d991304c-86ac-4fd5-a5b7-289fc0b98209 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:19.792253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a27781cc-a8d6-41f4-afcd-702ad8e75fdf tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:19.792776 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a27781cc-a8d6-41f4-afcd-702ad8e75fdf tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:19.799767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a27781cc-a8d6-41f4-afcd-702ad8e75fdf tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:19.800654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a27781cc-a8d6-41f4-afcd-702ad8e75fdf tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:19.801275 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a27781cc-a8d6-41f4-afcd-702ad8e75fdf tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:19.807995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a27781cc-a8d6-41f4-afcd-702ad8e75fdf tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:19.808735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a27781cc-a8d6-41f4-afcd-702ad8e75fdf tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:19.809334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a27781cc-a8d6-41f4-afcd-702ad8e75fdf tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:19.851770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=12 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:36:19.875941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d991304c-86ac-4fd5-a5b7-289fc0b98209 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:19.884910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d991304c-86ac-4fd5-a5b7-289fc0b98209 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:19.886392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d991304c-86ac-4fd5-a5b7-289fc0b98209 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:19.887566 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d991304c-86ac-4fd5-a5b7-289fc0b98209 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1408 microversion: 2.20 time: 0.193573 Oct 10 23:36:19.888299 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2069/4016] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:19 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:20.118257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a27781cc-a8d6-41f4-afcd-702ad8e75fdf tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:20.141729 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a27781cc-a8d6-41f4-afcd-702ad8e75fdf tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1323 microversion: 2.1 time: 0.353301 Oct 10 23:36:20.145315 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1948/4017] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:19 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1323 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:36:20.385728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d6e6b291-168d-41f8-80f6-9feb72f20a21 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:20.386363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d6e6b291-168d-41f8-80f6-9feb72f20a21 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:20.399246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6e6b291-168d-41f8-80f6-9feb72f20a21 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:20.401924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6e6b291-168d-41f8-80f6-9feb72f20a21 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:20.402382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6e6b291-168d-41f8-80f6-9feb72f20a21 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:20.403338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6e6b291-168d-41f8-80f6-9feb72f20a21 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:20.409204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6e6b291-168d-41f8-80f6-9feb72f20a21 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:20.409861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6e6b291-168d-41f8-80f6-9feb72f20a21 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:20.582201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d6e6b291-168d-41f8-80f6-9feb72f20a21 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:20.591515 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d6e6b291-168d-41f8-80f6-9feb72f20a21 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 200 len: 1315 microversion: 2.1 time: 0.209752 Oct 10 23:36:20.592984 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2070/4018] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:20 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:20.681197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1254cee1-4cef-4d42-bb13-471cb1e6ad53 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:20.682226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1254cee1-4cef-4d42-bb13-471cb1e6ad53 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:20.692888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1254cee1-4cef-4d42-bb13-471cb1e6ad53 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:20.699546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1254cee1-4cef-4d42-bb13-471cb1e6ad53 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:20.700283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1254cee1-4cef-4d42-bb13-471cb1e6ad53 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:20.701324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1254cee1-4cef-4d42-bb13-471cb1e6ad53 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:20.701842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1254cee1-4cef-4d42-bb13-471cb1e6ad53 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:20.702283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1254cee1-4cef-4d42-bb13-471cb1e6ad53 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:21.045625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f0ce25c5-ff8a-4bd8-a68e-8657dc31f2b8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:21.046486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f0ce25c5-ff8a-4bd8-a68e-8657dc31f2b8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:21.057880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0ce25c5-ff8a-4bd8-a68e-8657dc31f2b8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:21.059648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0ce25c5-ff8a-4bd8-a68e-8657dc31f2b8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:21.060439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0ce25c5-ff8a-4bd8-a68e-8657dc31f2b8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:21.062082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0ce25c5-ff8a-4bd8-a68e-8657dc31f2b8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:21.062948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0ce25c5-ff8a-4bd8-a68e-8657dc31f2b8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:21.063938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0ce25c5-ff8a-4bd8-a68e-8657dc31f2b8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:21.135024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1254cee1-4cef-4d42-bb13-471cb1e6ad53 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:21.149571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1254cee1-4cef-4d42-bb13-471cb1e6ad53 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:21.151626 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1254cee1-4cef-4d42-bb13-471cb1e6ad53 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:21.153016 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1254cee1-4cef-4d42-bb13-471cb1e6ad53 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.479929 Oct 10 23:36:21.178707 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1949/4019] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:20 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:21.184852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-1d042405-705a-463b-8a66-d6874cdb2f30 req-bb86b8f9-c350-4b1b-8223-3a250cc24b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d", "name": "network-vif-plugged", "status": "completed", "tag": "0ca323c5-08ed-433b-892e-43a213787a79"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:21.197843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1d042405-705a-463b-8a66-d6874cdb2f30 req-bb86b8f9-c350-4b1b-8223-3a250cc24b6d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:21.198784 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1d042405-705a-463b-8a66-d6874cdb2f30 req-bb86b8f9-c350-4b1b-8223-3a250cc24b6d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:21.199401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1d042405-705a-463b-8a66-d6874cdb2f30 req-bb86b8f9-c350-4b1b-8223-3a250cc24b6d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:21.214708 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-1d042405-705a-463b-8a66-d6874cdb2f30 req-bb86b8f9-c350-4b1b-8223-3a250cc24b6d service nova] Creating event network-vif-plugged:0ca323c5-08ed-433b-892e-43a213787a79 for instance 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d on n-h1-860864-2 Oct 10 23:36:21.222329 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-1d042405-705a-463b-8a66-d6874cdb2f30 req-bb86b8f9-c350-4b1b-8223-3a250cc24b6d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041878 Oct 10 23:36:21.223222 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1950/4020] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:36:21.230492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0600c00c-a9b0-48f1-9ef6-60fb80c5d6a1 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:21.231381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0600c00c-a9b0-48f1-9ef6-60fb80c5d6a1 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:21.240124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0600c00c-a9b0-48f1-9ef6-60fb80c5d6a1 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:21.240497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0600c00c-a9b0-48f1-9ef6-60fb80c5d6a1 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:21.240912 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0600c00c-a9b0-48f1-9ef6-60fb80c5d6a1 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:21.241684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0600c00c-a9b0-48f1-9ef6-60fb80c5d6a1 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:21.242152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0600c00c-a9b0-48f1-9ef6-60fb80c5d6a1 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:21.242583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0600c00c-a9b0-48f1-9ef6-60fb80c5d6a1 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:21.316116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f0ce25c5-ff8a-4bd8-a68e-8657dc31f2b8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:21.328270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f0ce25c5-ff8a-4bd8-a68e-8657dc31f2b8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:21.331504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f0ce25c5-ff8a-4bd8-a68e-8657dc31f2b8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:21.332382 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f0ce25c5-ff8a-4bd8-a68e-8657dc31f2b8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1408 microversion: 2.20 time: 0.422408 Oct 10 23:36:21.333317 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2071/4021] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:20 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1408 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:21.608657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0600c00c-a9b0-48f1-9ef6-60fb80c5d6a1 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:21.618167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-354b90b5-9939-42e2-9197-b945625d21c4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:21.619480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-354b90b5-9939-42e2-9197-b945625d21c4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:21.627913 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0600c00c-a9b0-48f1-9ef6-60fb80c5d6a1 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1323 microversion: 2.1 time: 0.402406 Oct 10 23:36:21.628792 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1951/4022] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:21 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1323 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:21.646133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-354b90b5-9939-42e2-9197-b945625d21c4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:21.646636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-354b90b5-9939-42e2-9197-b945625d21c4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:21.647080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-354b90b5-9939-42e2-9197-b945625d21c4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:21.651397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-354b90b5-9939-42e2-9197-b945625d21c4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:21.651882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-354b90b5-9939-42e2-9197-b945625d21c4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:21.652322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-354b90b5-9939-42e2-9197-b945625d21c4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:21.911343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-354b90b5-9939-42e2-9197-b945625d21c4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:21.920738 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-354b90b5-9939-42e2-9197-b945625d21c4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 200 len: 1315 microversion: 2.1 time: 0.307311 Oct 10 23:36:21.922958 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2072/4023] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:21 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:22.183683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8b0c1dc1-630c-4401-b370-a926a4ac8ade tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:22.184418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8b0c1dc1-630c-4401-b370-a926a4ac8ade tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:22.191734 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b0c1dc1-630c-4401-b370-a926a4ac8ade tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:22.192585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b0c1dc1-630c-4401-b370-a926a4ac8ade tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:22.193256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b0c1dc1-630c-4401-b370-a926a4ac8ade tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:22.194213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b0c1dc1-630c-4401-b370-a926a4ac8ade tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:22.194900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b0c1dc1-630c-4401-b370-a926a4ac8ade tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:22.195522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b0c1dc1-630c-4401-b370-a926a4ac8ade tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:22.363531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-66ce64a3-2cbe-44b2-9f9b-f888125987ff tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:22.364504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-66ce64a3-2cbe-44b2-9f9b-f888125987ff tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:22.373138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66ce64a3-2cbe-44b2-9f9b-f888125987ff tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:22.373869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66ce64a3-2cbe-44b2-9f9b-f888125987ff tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:22.374312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66ce64a3-2cbe-44b2-9f9b-f888125987ff tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:22.375308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66ce64a3-2cbe-44b2-9f9b-f888125987ff tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:22.375934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66ce64a3-2cbe-44b2-9f9b-f888125987ff tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:22.376517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66ce64a3-2cbe-44b2-9f9b-f888125987ff tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:22.514952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8b0c1dc1-630c-4401-b370-a926a4ac8ade tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:22.525754 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8b0c1dc1-630c-4401-b370-a926a4ac8ade tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:22.527266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8b0c1dc1-630c-4401-b370-a926a4ac8ade tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:22.528458 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8b0c1dc1-630c-4401-b370-a926a4ac8ade tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.348726 Oct 10 23:36:22.529036 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1952/4024] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:22 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:22.629513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-66ce64a3-2cbe-44b2-9f9b-f888125987ff tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:22.640550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-66ce64a3-2cbe-44b2-9f9b-f888125987ff tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:22.642052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-66ce64a3-2cbe-44b2-9f9b-f888125987ff tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:22.643306 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-66ce64a3-2cbe-44b2-9f9b-f888125987ff tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1408 microversion: 2.20 time: 0.285348 Oct 10 23:36:22.644427 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2073/4025] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:22 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1408 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:36:22.651639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f2d2b518-d50f-473b-b4fc-a83ba2f836cb tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:22.652192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f2d2b518-d50f-473b-b4fc-a83ba2f836cb tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:22.659647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2d2b518-d50f-473b-b4fc-a83ba2f836cb tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:22.660393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2d2b518-d50f-473b-b4fc-a83ba2f836cb tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:22.661006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2d2b518-d50f-473b-b4fc-a83ba2f836cb tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:22.661901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2d2b518-d50f-473b-b4fc-a83ba2f836cb tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:22.662496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2d2b518-d50f-473b-b4fc-a83ba2f836cb tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:22.663066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2d2b518-d50f-473b-b4fc-a83ba2f836cb tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:22.812567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f2d2b518-d50f-473b-b4fc-a83ba2f836cb tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:22.824032 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f2d2b518-d50f-473b-b4fc-a83ba2f836cb tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1323 microversion: 2.1 time: 0.175544 Oct 10 23:36:22.844532 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1953/4026] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:22 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1323 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:22.946703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-404f99c6-efde-4920-86c0-b22e7cad5eae tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:22.952105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-404f99c6-efde-4920-86c0-b22e7cad5eae tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:22.962332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:36:22.968151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-404f99c6-efde-4920-86c0-b22e7cad5eae tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:22.971681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-404f99c6-efde-4920-86c0-b22e7cad5eae tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:22.972433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-404f99c6-efde-4920-86c0-b22e7cad5eae tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:22.973366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-404f99c6-efde-4920-86c0-b22e7cad5eae tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:22.974005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-404f99c6-efde-4920-86c0-b22e7cad5eae tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:22.974715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-404f99c6-efde-4920-86c0-b22e7cad5eae tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:23.290665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-404f99c6-efde-4920-86c0-b22e7cad5eae tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:23.292195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-7a78ace1-aaa2-48e3-81d4-e2c8b8fb2ad4 req-9e5e15c5-1835-496e-a01d-56c8a604309b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f5c98e-777a-4d5b-aed5-89fd026f1734", "name": "network-vif-plugged", "status": "completed", "tag": "14e55a18-a2c4-41ce-8ca8-1d0de903ab65"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:23.306951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7a78ace1-aaa2-48e3-81d4-e2c8b8fb2ad4 req-9e5e15c5-1835-496e-a01d-56c8a604309b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:23.310792 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-404f99c6-efde-4920-86c0-b22e7cad5eae tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 200 len: 1502 microversion: 2.1 time: 0.367981 Oct 10 23:36:23.314736 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2074/4027] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:22 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 1502 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:23.315963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7a78ace1-aaa2-48e3-81d4-e2c8b8fb2ad4 req-9e5e15c5-1835-496e-a01d-56c8a604309b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:23.316895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7a78ace1-aaa2-48e3-81d4-e2c8b8fb2ad4 req-9e5e15c5-1835-496e-a01d-56c8a604309b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:23.335303 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-7a78ace1-aaa2-48e3-81d4-e2c8b8fb2ad4 req-9e5e15c5-1835-496e-a01d-56c8a604309b service nova] Creating event network-vif-plugged:14e55a18-a2c4-41ce-8ca8-1d0de903ab65 for instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 on n-h2-860864-2 Oct 10 23:36:23.344922 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-7a78ace1-aaa2-48e3-81d4-e2c8b8fb2ad4 req-9e5e15c5-1835-496e-a01d-56c8a604309b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058934 Oct 10 23:36:23.346513 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1954/4028] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:36:23.559376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-54636f2e-2a5a-478a-8573-68f4ce44aa26 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:23.560113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-54636f2e-2a5a-478a-8573-68f4ce44aa26 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:23.562618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:36:23.571115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54636f2e-2a5a-478a-8573-68f4ce44aa26 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:23.571964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54636f2e-2a5a-478a-8573-68f4ce44aa26 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:23.574383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54636f2e-2a5a-478a-8573-68f4ce44aa26 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:23.575587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54636f2e-2a5a-478a-8573-68f4ce44aa26 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:23.576604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54636f2e-2a5a-478a-8573-68f4ce44aa26 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:23.578075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54636f2e-2a5a-478a-8573-68f4ce44aa26 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:23.672477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f801ea80-cc1e-4e75-b9c9-382e6401b66b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:23.673272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f801ea80-cc1e-4e75-b9c9-382e6401b66b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:23.682783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f801ea80-cc1e-4e75-b9c9-382e6401b66b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:23.684268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f801ea80-cc1e-4e75-b9c9-382e6401b66b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:23.685187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f801ea80-cc1e-4e75-b9c9-382e6401b66b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:23.686489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f801ea80-cc1e-4e75-b9c9-382e6401b66b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:23.687230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f801ea80-cc1e-4e75-b9c9-382e6401b66b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:23.688028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f801ea80-cc1e-4e75-b9c9-382e6401b66b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:23.947571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f801ea80-cc1e-4e75-b9c9-382e6401b66b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:23.957926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f801ea80-cc1e-4e75-b9c9-382e6401b66b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:23.959612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f801ea80-cc1e-4e75-b9c9-382e6401b66b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:23.960843 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f801ea80-cc1e-4e75-b9c9-382e6401b66b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1408 microversion: 2.20 time: 0.293805 Oct 10 23:36:23.961797 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1955/4029] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:23 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1408 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:36:23.966551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1e2981bf-8f8e-4ad3-b774-c3b15e5d3956 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:23.967235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1e2981bf-8f8e-4ad3-b774-c3b15e5d3956 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:23.974511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e2981bf-8f8e-4ad3-b774-c3b15e5d3956 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:23.975224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e2981bf-8f8e-4ad3-b774-c3b15e5d3956 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:23.975890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e2981bf-8f8e-4ad3-b774-c3b15e5d3956 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:23.976818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e2981bf-8f8e-4ad3-b774-c3b15e5d3956 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:23.977717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e2981bf-8f8e-4ad3-b774-c3b15e5d3956 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:23.978344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e2981bf-8f8e-4ad3-b774-c3b15e5d3956 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:24.056214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-54636f2e-2a5a-478a-8573-68f4ce44aa26 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:24.068036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-54636f2e-2a5a-478a-8573-68f4ce44aa26 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:24.069665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-54636f2e-2a5a-478a-8573-68f4ce44aa26 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:24.070887 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-54636f2e-2a5a-478a-8573-68f4ce44aa26 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.518544 Oct 10 23:36:24.086701 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2075/4030] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:23 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:24.185970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1e2981bf-8f8e-4ad3-b774-c3b15e5d3956 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:24.188820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:36:24.196928 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1e2981bf-8f8e-4ad3-b774-c3b15e5d3956 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1518 microversion: 2.1 time: 0.233876 Oct 10 23:36:24.197782 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1956/4031] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:23 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1518 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:24.229467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-61f5c356-7cbf-46ca-a585-e6aa271dbb0b tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:24.232021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-61f5c356-7cbf-46ca-a585-e6aa271dbb0b tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:24.245658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61f5c356-7cbf-46ca-a585-e6aa271dbb0b tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:24.246442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61f5c356-7cbf-46ca-a585-e6aa271dbb0b tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:24.247118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61f5c356-7cbf-46ca-a585-e6aa271dbb0b tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:24.248048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61f5c356-7cbf-46ca-a585-e6aa271dbb0b tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:24.248715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61f5c356-7cbf-46ca-a585-e6aa271dbb0b tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:24.249473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61f5c356-7cbf-46ca-a585-e6aa271dbb0b tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:24.297871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-61f5c356-7cbf-46ca-a585-e6aa271dbb0b tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lazy-loading 'flavor' on Instance uuid 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:36:24.487077 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-61f5c356-7cbf-46ca-a585-e6aa271dbb0b tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "POST /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d/action" status: 200 len: 32 microversion: 2.1 time: 0.269134 Oct 10 23:36:24.494277 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2076/4032] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:36:24 2022] POST /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d/action => generated 32 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:36:24.498173 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-79ddacb7-9645-4cda-bde1-5db75b57a976 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:24.499472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-79ddacb7-9645-4cda-bde1-5db75b57a976 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:24.510317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79ddacb7-9645-4cda-bde1-5db75b57a976 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:24.513715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79ddacb7-9645-4cda-bde1-5db75b57a976 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:24.514431 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79ddacb7-9645-4cda-bde1-5db75b57a976 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:24.519660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79ddacb7-9645-4cda-bde1-5db75b57a976 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:24.520697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79ddacb7-9645-4cda-bde1-5db75b57a976 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:24.521222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79ddacb7-9645-4cda-bde1-5db75b57a976 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:24.907699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-79ddacb7-9645-4cda-bde1-5db75b57a976 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:24.919603 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-79ddacb7-9645-4cda-bde1-5db75b57a976 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1524 microversion: 2.1 time: 0.425727 Oct 10 23:36:24.920387 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1957/4033] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:24 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1524 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:24.989093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-86d65db6-faed-4d59-988a-bb853c1b582d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:24.989880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-86d65db6-faed-4d59-988a-bb853c1b582d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:24.997545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86d65db6-faed-4d59-988a-bb853c1b582d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:24.997939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86d65db6-faed-4d59-988a-bb853c1b582d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:24.998380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86d65db6-faed-4d59-988a-bb853c1b582d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:24.999102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86d65db6-faed-4d59-988a-bb853c1b582d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:24.999558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86d65db6-faed-4d59-988a-bb853c1b582d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:24.999987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86d65db6-faed-4d59-988a-bb853c1b582d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:25.106297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-84430287-e59f-47a0-b6e3-36bb1f73abd2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:25.107020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-84430287-e59f-47a0-b6e3-36bb1f73abd2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:25.114257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-84430287-e59f-47a0-b6e3-36bb1f73abd2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:25.114855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-84430287-e59f-47a0-b6e3-36bb1f73abd2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:25.115366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-84430287-e59f-47a0-b6e3-36bb1f73abd2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:25.116156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-84430287-e59f-47a0-b6e3-36bb1f73abd2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:25.116885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-84430287-e59f-47a0-b6e3-36bb1f73abd2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:25.117845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-84430287-e59f-47a0-b6e3-36bb1f73abd2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:25.162040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-86d65db6-faed-4d59-988a-bb853c1b582d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:25.171419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-86d65db6-faed-4d59-988a-bb853c1b582d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:25.173273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-86d65db6-faed-4d59-988a-bb853c1b582d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:25.175110 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-86d65db6-faed-4d59-988a-bb853c1b582d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1600 microversion: 2.20 time: 0.190997 Oct 10 23:36:25.175779 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2077/4034] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:24 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1600 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:25.201199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-23ffd07b-9835-4735-963d-9156cbc98abe tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:25.201829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-23ffd07b-9835-4735-963d-9156cbc98abe tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:25.208662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23ffd07b-9835-4735-963d-9156cbc98abe tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:25.209255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23ffd07b-9835-4735-963d-9156cbc98abe tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:25.209805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23ffd07b-9835-4735-963d-9156cbc98abe tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:25.210619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23ffd07b-9835-4735-963d-9156cbc98abe tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:25.211152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23ffd07b-9835-4735-963d-9156cbc98abe tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:25.211590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23ffd07b-9835-4735-963d-9156cbc98abe tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:25.291754 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-23ffd07b-9835-4735-963d-9156cbc98abe tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094662 Oct 10 23:36:25.292365 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2078/4035] 10.222.0.23 () {60 vars in 1316 bytes} [Mon Oct 10 23:36:25 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 23:36:25.550387 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-84430287-e59f-47a0-b6e3-36bb1f73abd2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:25.563174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-84430287-e59f-47a0-b6e3-36bb1f73abd2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:25.565109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-84430287-e59f-47a0-b6e3-36bb1f73abd2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:25.567601 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-84430287-e59f-47a0-b6e3-36bb1f73abd2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.464061 Oct 10 23:36:25.568199 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1958/4036] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:25 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:36:25.944976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a8e17abb-6946-4aad-a375-5a41ff10d853 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:25.945826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a8e17abb-6946-4aad-a375-5a41ff10d853 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:25.952595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8e17abb-6946-4aad-a375-5a41ff10d853 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:25.953301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8e17abb-6946-4aad-a375-5a41ff10d853 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:25.953910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8e17abb-6946-4aad-a375-5a41ff10d853 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:25.955353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8e17abb-6946-4aad-a375-5a41ff10d853 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:25.956277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8e17abb-6946-4aad-a375-5a41ff10d853 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:25.957038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8e17abb-6946-4aad-a375-5a41ff10d853 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:25.978855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d9d87755-762a-4ed8-b5c0-9c854bb1e8a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97ad6a52-f18c-453c-83b8-2a0bff221f86"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:25.981351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d9d87755-762a-4ed8-b5c0-9c854bb1e8a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:25.993405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d87755-762a-4ed8-b5c0-9c854bb1e8a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:25.993905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d87755-762a-4ed8-b5c0-9c854bb1e8a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:25.995329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d87755-762a-4ed8-b5c0-9c854bb1e8a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:25.996257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d87755-762a-4ed8-b5c0-9c854bb1e8a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:25.996888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d87755-762a-4ed8-b5c0-9c854bb1e8a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:25.997506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9d87755-762a-4ed8-b5c0-9c854bb1e8a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:26.322028 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d9d87755-762a-4ed8-b5c0-9c854bb1e8a3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "POST /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.346936 Oct 10 23:36:26.328499 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1959/4037] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Oct 10 23:36:25 2022] POST /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72/os-volume_attachments => generated 194 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:36:26.523663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a8e17abb-6946-4aad-a375-5a41ff10d853 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:26.532425 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a8e17abb-6946-4aad-a375-5a41ff10d853 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1524 microversion: 2.1 time: 0.591228 Oct 10 23:36:26.549994 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2079/4038] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:25 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1524 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:26.597085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6f6da81b-43f6-4f29-9ab5-21cee02cad6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:26.599819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6f6da81b-43f6-4f29-9ab5-21cee02cad6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:26.614110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f6da81b-43f6-4f29-9ab5-21cee02cad6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:26.615764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f6da81b-43f6-4f29-9ab5-21cee02cad6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:26.621941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f6da81b-43f6-4f29-9ab5-21cee02cad6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:26.623167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f6da81b-43f6-4f29-9ab5-21cee02cad6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:26.624548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f6da81b-43f6-4f29-9ab5-21cee02cad6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:26.625806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f6da81b-43f6-4f29-9ab5-21cee02cad6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:26.830401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-b075ea49-b52f-40b7-9d1c-f00e2284820c req-8561ccf1-3597-45e6-a74a-700d7aa9e256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81f5c98e-777a-4d5b-aed5-89fd026f1734", "tag": "14e55a18-a2c4-41ce-8ca8-1d0de903ab65"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:26.841197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b075ea49-b52f-40b7-9d1c-f00e2284820c req-8561ccf1-3597-45e6-a74a-700d7aa9e256 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:26.842059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b075ea49-b52f-40b7-9d1c-f00e2284820c req-8561ccf1-3597-45e6-a74a-700d7aa9e256 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:26.842768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b075ea49-b52f-40b7-9d1c-f00e2284820c req-8561ccf1-3597-45e6-a74a-700d7aa9e256 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:26.869838 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-b075ea49-b52f-40b7-9d1c-f00e2284820c req-8561ccf1-3597-45e6-a74a-700d7aa9e256 service nova] Creating event network-changed:14e55a18-a2c4-41ce-8ca8-1d0de903ab65 for instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 on n-h2-860864-2 Oct 10 23:36:26.879049 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-b075ea49-b52f-40b7-9d1c-f00e2284820c req-8561ccf1-3597-45e6-a74a-700d7aa9e256 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061243 Oct 10 23:36:26.880431 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2080/4039] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:36:26.978874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6f6da81b-43f6-4f29-9ab5-21cee02cad6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:26.990378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6f6da81b-43f6-4f29-9ab5-21cee02cad6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:26.992074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6f6da81b-43f6-4f29-9ab5-21cee02cad6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:26.993542 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6f6da81b-43f6-4f29-9ab5-21cee02cad6c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.402531 Oct 10 23:36:26.997935 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1960/4040] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:26 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:27.561069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-46ceb534-fe9d-4101-8f1b-4fb29f8e7ec7 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:27.561787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-46ceb534-fe9d-4101-8f1b-4fb29f8e7ec7 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:27.575680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46ceb534-fe9d-4101-8f1b-4fb29f8e7ec7 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:27.576187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46ceb534-fe9d-4101-8f1b-4fb29f8e7ec7 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:27.576635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46ceb534-fe9d-4101-8f1b-4fb29f8e7ec7 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:27.577349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46ceb534-fe9d-4101-8f1b-4fb29f8e7ec7 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:27.578077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46ceb534-fe9d-4101-8f1b-4fb29f8e7ec7 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:27.578723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46ceb534-fe9d-4101-8f1b-4fb29f8e7ec7 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:27.786619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-46ceb534-fe9d-4101-8f1b-4fb29f8e7ec7 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:27.800158 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-46ceb534-fe9d-4101-8f1b-4fb29f8e7ec7 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1524 microversion: 2.1 time: 0.241688 Oct 10 23:36:27.822382 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2081/4041] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:27 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1524 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:28.038902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c44684eb-aadd-4642-8b32-4b96b5a1b1eb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:28.039515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c44684eb-aadd-4642-8b32-4b96b5a1b1eb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:28.055225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c44684eb-aadd-4642-8b32-4b96b5a1b1eb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:28.059917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c44684eb-aadd-4642-8b32-4b96b5a1b1eb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:28.060566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c44684eb-aadd-4642-8b32-4b96b5a1b1eb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:28.061594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c44684eb-aadd-4642-8b32-4b96b5a1b1eb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:28.062201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c44684eb-aadd-4642-8b32-4b96b5a1b1eb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:28.063205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c44684eb-aadd-4642-8b32-4b96b5a1b1eb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:28.382887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c44684eb-aadd-4642-8b32-4b96b5a1b1eb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:28.396395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c44684eb-aadd-4642-8b32-4b96b5a1b1eb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:28.397882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c44684eb-aadd-4642-8b32-4b96b5a1b1eb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:28.400243 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c44684eb-aadd-4642-8b32-4b96b5a1b1eb tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.379730 Oct 10 23:36:28.400975 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1961/4042] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:28 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:28.828056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8ae5c603-6aa2-4df9-8e61-24f528e3586a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:28.828689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8ae5c603-6aa2-4df9-8e61-24f528e3586a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:28.837310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ae5c603-6aa2-4df9-8e61-24f528e3586a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:28.837827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ae5c603-6aa2-4df9-8e61-24f528e3586a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:28.838470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ae5c603-6aa2-4df9-8e61-24f528e3586a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:28.839364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ae5c603-6aa2-4df9-8e61-24f528e3586a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:28.839831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ae5c603-6aa2-4df9-8e61-24f528e3586a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:28.840268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ae5c603-6aa2-4df9-8e61-24f528e3586a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:29.075802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8ae5c603-6aa2-4df9-8e61-24f528e3586a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:29.086366 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8ae5c603-6aa2-4df9-8e61-24f528e3586a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1524 microversion: 2.1 time: 0.261838 Oct 10 23:36:29.093804 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2082/4043] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:28 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1524 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:29.429728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b4a24499-0428-4a68-91ff-089ba93a599f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:29.430489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b4a24499-0428-4a68-91ff-089ba93a599f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:29.438502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4a24499-0428-4a68-91ff-089ba93a599f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:29.439213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4a24499-0428-4a68-91ff-089ba93a599f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:29.439740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4a24499-0428-4a68-91ff-089ba93a599f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:29.440539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4a24499-0428-4a68-91ff-089ba93a599f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:29.441111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4a24499-0428-4a68-91ff-089ba93a599f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:29.441794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b4a24499-0428-4a68-91ff-089ba93a599f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:29.642978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b4a24499-0428-4a68-91ff-089ba93a599f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:29.653874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b4a24499-0428-4a68-91ff-089ba93a599f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:29.656188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b4a24499-0428-4a68-91ff-089ba93a599f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:29.657714 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b4a24499-0428-4a68-91ff-089ba93a599f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.232728 Oct 10 23:36:29.677039 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1962/4044] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:29 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:30.112250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0b6410c1-785f-4667-be41-9cac18215059 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:30.113004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0b6410c1-785f-4667-be41-9cac18215059 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:30.125768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b6410c1-785f-4667-be41-9cac18215059 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:30.126309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b6410c1-785f-4667-be41-9cac18215059 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:30.129872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b6410c1-785f-4667-be41-9cac18215059 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:30.134242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b6410c1-785f-4667-be41-9cac18215059 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:30.134964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b6410c1-785f-4667-be41-9cac18215059 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:30.135198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b6410c1-785f-4667-be41-9cac18215059 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:30.160715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:36:30.429819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0b6410c1-785f-4667-be41-9cac18215059 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:30.443544 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0b6410c1-785f-4667-be41-9cac18215059 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1524 microversion: 2.1 time: 0.335094 Oct 10 23:36:30.462960 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2083/4045] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:30 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1524 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:30.684739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aa2bc41a-73da-4959-ae0e-6152d0bd2816 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:30.686384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aa2bc41a-73da-4959-ae0e-6152d0bd2816 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:30.695128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa2bc41a-73da-4959-ae0e-6152d0bd2816 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:30.695640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa2bc41a-73da-4959-ae0e-6152d0bd2816 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:30.696449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa2bc41a-73da-4959-ae0e-6152d0bd2816 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:30.697321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa2bc41a-73da-4959-ae0e-6152d0bd2816 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:30.697972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa2bc41a-73da-4959-ae0e-6152d0bd2816 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:30.698411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa2bc41a-73da-4959-ae0e-6152d0bd2816 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:30.944581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aa2bc41a-73da-4959-ae0e-6152d0bd2816 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:30.964174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aa2bc41a-73da-4959-ae0e-6152d0bd2816 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:30.966443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aa2bc41a-73da-4959-ae0e-6152d0bd2816 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:30.968022 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aa2bc41a-73da-4959-ae0e-6152d0bd2816 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.287865 Oct 10 23:36:30.968603 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1963/4046] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:30 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:31.471237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5f09d2f9-48c6-4b4b-b060-a76271314c4c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:31.472005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5f09d2f9-48c6-4b4b-b060-a76271314c4c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:31.483924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f09d2f9-48c6-4b4b-b060-a76271314c4c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:31.484667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f09d2f9-48c6-4b4b-b060-a76271314c4c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:31.485839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f09d2f9-48c6-4b4b-b060-a76271314c4c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:31.486944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f09d2f9-48c6-4b4b-b060-a76271314c4c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:31.488380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f09d2f9-48c6-4b4b-b060-a76271314c4c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:31.488975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f09d2f9-48c6-4b4b-b060-a76271314c4c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:31.725934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5f09d2f9-48c6-4b4b-b060-a76271314c4c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:31.735322 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5f09d2f9-48c6-4b4b-b060-a76271314c4c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1524 microversion: 2.1 time: 0.270093 Oct 10 23:36:31.749813 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2084/4047] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:31 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1524 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:31.999937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-67314aaa-dd55-47de-ae4c-b8bb901bc580 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:32.000708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-67314aaa-dd55-47de-ae4c-b8bb901bc580 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:32.015709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67314aaa-dd55-47de-ae4c-b8bb901bc580 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:32.016322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67314aaa-dd55-47de-ae4c-b8bb901bc580 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:32.016839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67314aaa-dd55-47de-ae4c-b8bb901bc580 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:32.018239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67314aaa-dd55-47de-ae4c-b8bb901bc580 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:32.019694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67314aaa-dd55-47de-ae4c-b8bb901bc580 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:32.020217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67314aaa-dd55-47de-ae4c-b8bb901bc580 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:32.326906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-67314aaa-dd55-47de-ae4c-b8bb901bc580 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:32.340888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-67314aaa-dd55-47de-ae4c-b8bb901bc580 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:32.343194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-67314aaa-dd55-47de-ae4c-b8bb901bc580 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:32.348195 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-67314aaa-dd55-47de-ae4c-b8bb901bc580 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.352677 Oct 10 23:36:32.364616 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1964/4048] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:31 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:32.765849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-44c2084e-0975-4cab-973f-793bd3eb8dca tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:32.766353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-44c2084e-0975-4cab-973f-793bd3eb8dca tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:32.774636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44c2084e-0975-4cab-973f-793bd3eb8dca tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:32.775230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44c2084e-0975-4cab-973f-793bd3eb8dca tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:32.775677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44c2084e-0975-4cab-973f-793bd3eb8dca tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:32.776517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44c2084e-0975-4cab-973f-793bd3eb8dca tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:32.776997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44c2084e-0975-4cab-973f-793bd3eb8dca tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:32.777621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44c2084e-0975-4cab-973f-793bd3eb8dca tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:32.957273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-44c2084e-0975-4cab-973f-793bd3eb8dca tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:32.969160 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-44c2084e-0975-4cab-973f-793bd3eb8dca tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1524 microversion: 2.1 time: 0.207586 Oct 10 23:36:32.982888 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2085/4049] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:32 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1524 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:33.377281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3cefbae3-9ce1-41b7-97f9-e70beea44060 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:33.378167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3cefbae3-9ce1-41b7-97f9-e70beea44060 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:33.386041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3cefbae3-9ce1-41b7-97f9-e70beea44060 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:33.386735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3cefbae3-9ce1-41b7-97f9-e70beea44060 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:33.387168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3cefbae3-9ce1-41b7-97f9-e70beea44060 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:33.387873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3cefbae3-9ce1-41b7-97f9-e70beea44060 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:33.388322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3cefbae3-9ce1-41b7-97f9-e70beea44060 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:33.388752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3cefbae3-9ce1-41b7-97f9-e70beea44060 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:33.995654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fdde7e21-e396-40ba-b51b-8cca3f554289 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:33.996608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fdde7e21-e396-40ba-b51b-8cca3f554289 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:34.006067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fdde7e21-e396-40ba-b51b-8cca3f554289 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:34.006706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fdde7e21-e396-40ba-b51b-8cca3f554289 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:34.007254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fdde7e21-e396-40ba-b51b-8cca3f554289 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:34.008071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fdde7e21-e396-40ba-b51b-8cca3f554289 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:34.008661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fdde7e21-e396-40ba-b51b-8cca3f554289 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:34.009198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fdde7e21-e396-40ba-b51b-8cca3f554289 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:34.173011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3cefbae3-9ce1-41b7-97f9-e70beea44060 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:34.206400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3cefbae3-9ce1-41b7-97f9-e70beea44060 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:34.207221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fdde7e21-e396-40ba-b51b-8cca3f554289 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:34.208730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3cefbae3-9ce1-41b7-97f9-e70beea44060 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:34.210768 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3cefbae3-9ce1-41b7-97f9-e70beea44060 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.838424 Oct 10 23:36:34.212175 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1965/4050] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:33 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:34.217071 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fdde7e21-e396-40ba-b51b-8cca3f554289 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1524 microversion: 2.1 time: 0.225338 Oct 10 23:36:34.230057 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2086/4051] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:33 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1524 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:35.244087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c7e3d2db-1f24-4e0b-9d25-6331a95a5ccc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:35.245144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3b84fc70-5d07-43a2-944a-cd8468961e5c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:35.246121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3b84fc70-5d07-43a2-944a-cd8468961e5c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:35.246481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c7e3d2db-1f24-4e0b-9d25-6331a95a5ccc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:35.264746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b84fc70-5d07-43a2-944a-cd8468961e5c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:35.265208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7e3d2db-1f24-4e0b-9d25-6331a95a5ccc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:35.265845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7e3d2db-1f24-4e0b-9d25-6331a95a5ccc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:35.266552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7e3d2db-1f24-4e0b-9d25-6331a95a5ccc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:35.267094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b84fc70-5d07-43a2-944a-cd8468961e5c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:35.267944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7e3d2db-1f24-4e0b-9d25-6331a95a5ccc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:35.268486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b84fc70-5d07-43a2-944a-cd8468961e5c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:35.269295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b84fc70-5d07-43a2-944a-cd8468961e5c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:35.269862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7e3d2db-1f24-4e0b-9d25-6331a95a5ccc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:35.270441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7e3d2db-1f24-4e0b-9d25-6331a95a5ccc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:35.271756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b84fc70-5d07-43a2-944a-cd8468961e5c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:35.276843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b84fc70-5d07-43a2-944a-cd8468961e5c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:35.492861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c7e3d2db-1f24-4e0b-9d25-6331a95a5ccc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:35.506064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c7e3d2db-1f24-4e0b-9d25-6331a95a5ccc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:35.507771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c7e3d2db-1f24-4e0b-9d25-6331a95a5ccc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:35.509136 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c7e3d2db-1f24-4e0b-9d25-6331a95a5ccc tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.276793 Oct 10 23:36:35.512108 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1966/4052] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:35 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:35.817697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3b84fc70-5d07-43a2-944a-cd8468961e5c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:35.828142 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3b84fc70-5d07-43a2-944a-cd8468961e5c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1524 microversion: 2.1 time: 0.591231 Oct 10 23:36:35.828852 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2087/4053] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:35 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1524 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:36.536245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6dac3b22-12e0-496f-ac59-a89deb331037 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:36.536792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6dac3b22-12e0-496f-ac59-a89deb331037 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:36.543732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6dac3b22-12e0-496f-ac59-a89deb331037 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:36.544231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6dac3b22-12e0-496f-ac59-a89deb331037 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:36.544675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6dac3b22-12e0-496f-ac59-a89deb331037 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:36.545398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6dac3b22-12e0-496f-ac59-a89deb331037 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:36.545856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6dac3b22-12e0-496f-ac59-a89deb331037 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:36.546329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6dac3b22-12e0-496f-ac59-a89deb331037 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:36.737211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6dac3b22-12e0-496f-ac59-a89deb331037 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:36.748547 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6dac3b22-12e0-496f-ac59-a89deb331037 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:36.750052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6dac3b22-12e0-496f-ac59-a89deb331037 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:36.751249 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6dac3b22-12e0-496f-ac59-a89deb331037 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.219187 Oct 10 23:36:36.752098 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1967/4054] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:36 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:36.852709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7351753f-988c-44f8-ba76-62b652fcc772 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:36.853329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7351753f-988c-44f8-ba76-62b652fcc772 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:36.860401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7351753f-988c-44f8-ba76-62b652fcc772 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:36.861620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7351753f-988c-44f8-ba76-62b652fcc772 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:36.862072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7351753f-988c-44f8-ba76-62b652fcc772 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:36.862796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7351753f-988c-44f8-ba76-62b652fcc772 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:36.863260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7351753f-988c-44f8-ba76-62b652fcc772 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:36.863692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7351753f-988c-44f8-ba76-62b652fcc772 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:37.074748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7351753f-988c-44f8-ba76-62b652fcc772 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:37.083403 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7351753f-988c-44f8-ba76-62b652fcc772 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1524 microversion: 2.1 time: 0.234572 Oct 10 23:36:37.084110 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2088/4055] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:36 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1524 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:36:37.780233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-922a82c9-3a8f-401b-9767-a070f5f2dcc4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:37.780877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-922a82c9-3a8f-401b-9767-a070f5f2dcc4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:37.790916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-922a82c9-3a8f-401b-9767-a070f5f2dcc4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:37.791815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-922a82c9-3a8f-401b-9767-a070f5f2dcc4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:37.792263 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-922a82c9-3a8f-401b-9767-a070f5f2dcc4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:37.792985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-922a82c9-3a8f-401b-9767-a070f5f2dcc4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:37.793490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-922a82c9-3a8f-401b-9767-a070f5f2dcc4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:37.793923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-922a82c9-3a8f-401b-9767-a070f5f2dcc4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:37.997803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-922a82c9-3a8f-401b-9767-a070f5f2dcc4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:38.007844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-922a82c9-3a8f-401b-9767-a070f5f2dcc4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:38.009587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-922a82c9-3a8f-401b-9767-a070f5f2dcc4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:38.010916 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-922a82c9-3a8f-401b-9767-a070f5f2dcc4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.237297 Oct 10 23:36:38.026051 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1968/4056] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:37 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:38.107490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-03aee91d-309a-4a36-9910-057c126e2df0 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:38.108240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-03aee91d-309a-4a36-9910-057c126e2df0 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:38.117292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03aee91d-309a-4a36-9910-057c126e2df0 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:38.117814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03aee91d-309a-4a36-9910-057c126e2df0 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:38.118449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03aee91d-309a-4a36-9910-057c126e2df0 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:38.119172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03aee91d-309a-4a36-9910-057c126e2df0 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:38.119632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03aee91d-309a-4a36-9910-057c126e2df0 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:38.120065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03aee91d-309a-4a36-9910-057c126e2df0 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:38.697740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-03aee91d-309a-4a36-9910-057c126e2df0 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:38.706208 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-03aee91d-309a-4a36-9910-057c126e2df0 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1524 microversion: 2.1 time: 0.602330 Oct 10 23:36:38.706812 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2089/4057] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:38 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1524 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:39.040766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7a4e9017-3af1-43e4-84fa-80d995ae3507 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:39.041924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7a4e9017-3af1-43e4-84fa-80d995ae3507 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:39.061683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a4e9017-3af1-43e4-84fa-80d995ae3507 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:39.062183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a4e9017-3af1-43e4-84fa-80d995ae3507 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:39.062722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a4e9017-3af1-43e4-84fa-80d995ae3507 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:39.063398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a4e9017-3af1-43e4-84fa-80d995ae3507 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:39.063870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a4e9017-3af1-43e4-84fa-80d995ae3507 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:39.065259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a4e9017-3af1-43e4-84fa-80d995ae3507 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:39.263085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7a4e9017-3af1-43e4-84fa-80d995ae3507 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:39.273795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7a4e9017-3af1-43e4-84fa-80d995ae3507 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:39.275136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7a4e9017-3af1-43e4-84fa-80d995ae3507 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:39.276707 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7a4e9017-3af1-43e4-84fa-80d995ae3507 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.240725 Oct 10 23:36:39.277294 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1969/4058] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:39 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:36:39.474423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1e4a32cf-8f35-4246-8400-95abf7c29dd6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:39.474970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1e4a32cf-8f35-4246-8400-95abf7c29dd6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:39.481864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e4a32cf-8f35-4246-8400-95abf7c29dd6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:39.482371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e4a32cf-8f35-4246-8400-95abf7c29dd6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:39.482818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e4a32cf-8f35-4246-8400-95abf7c29dd6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:39.483532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e4a32cf-8f35-4246-8400-95abf7c29dd6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:39.483995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e4a32cf-8f35-4246-8400-95abf7c29dd6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:39.484431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e4a32cf-8f35-4246-8400-95abf7c29dd6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:39.511304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1e4a32cf-8f35-4246-8400-95abf7c29dd6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:36:39.612413 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1e4a32cf-8f35-4246-8400-95abf7c29dd6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 204 len: 0 microversion: 2.1 time: 0.142144 Oct 10 23:36:39.613109 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2090/4059] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:36:39 2022] DELETE /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 23:36:39.621993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6779d98c-221d-4fd0-a7ba-41b57ede6036 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:39.622722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6779d98c-221d-4fd0-a7ba-41b57ede6036 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:39.631671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6779d98c-221d-4fd0-a7ba-41b57ede6036 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:39.632269 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6779d98c-221d-4fd0-a7ba-41b57ede6036 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:39.633051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6779d98c-221d-4fd0-a7ba-41b57ede6036 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:39.633878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6779d98c-221d-4fd0-a7ba-41b57ede6036 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:39.634400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6779d98c-221d-4fd0-a7ba-41b57ede6036 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:39.634998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6779d98c-221d-4fd0-a7ba-41b57ede6036 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:39.730782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3786a0f0-3d16-4d57-b45e-26d7062693ae tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:39.731653 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3786a0f0-3d16-4d57-b45e-26d7062693ae tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:39.740214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3786a0f0-3d16-4d57-b45e-26d7062693ae tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:39.740715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3786a0f0-3d16-4d57-b45e-26d7062693ae tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:39.741186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3786a0f0-3d16-4d57-b45e-26d7062693ae tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:39.741914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3786a0f0-3d16-4d57-b45e-26d7062693ae tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:39.742529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3786a0f0-3d16-4d57-b45e-26d7062693ae tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:39.742968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3786a0f0-3d16-4d57-b45e-26d7062693ae tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:39.787785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6779d98c-221d-4fd0-a7ba-41b57ede6036 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:39.796578 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6779d98c-221d-4fd0-a7ba-41b57ede6036 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 200 len: 1554 microversion: 2.1 time: 0.178726 Oct 10 23:36:39.797442 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1970/4060] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:39 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:39.954349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3786a0f0-3d16-4d57-b45e-26d7062693ae tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:39.962363 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3786a0f0-3d16-4d57-b45e-26d7062693ae tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1524 microversion: 2.1 time: 0.235818 Oct 10 23:36:39.962954 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2091/4061] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:39 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1524 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:36:40.304942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3cccabe6-8dfa-4bbf-882e-cfa2bf44a219 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:40.305802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3cccabe6-8dfa-4bbf-882e-cfa2bf44a219 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:40.318716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3cccabe6-8dfa-4bbf-882e-cfa2bf44a219 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:40.319354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3cccabe6-8dfa-4bbf-882e-cfa2bf44a219 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:40.319870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3cccabe6-8dfa-4bbf-882e-cfa2bf44a219 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:40.320655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3cccabe6-8dfa-4bbf-882e-cfa2bf44a219 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:40.321179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3cccabe6-8dfa-4bbf-882e-cfa2bf44a219 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:40.321748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3cccabe6-8dfa-4bbf-882e-cfa2bf44a219 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:40.522813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3cccabe6-8dfa-4bbf-882e-cfa2bf44a219 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:40.532341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3cccabe6-8dfa-4bbf-882e-cfa2bf44a219 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:40.534333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3cccabe6-8dfa-4bbf-882e-cfa2bf44a219 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:40.535537 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3cccabe6-8dfa-4bbf-882e-cfa2bf44a219 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.235087 Oct 10 23:36:40.536115 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1971/4062] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:40 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:40.822358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e9ed8dd7-6617-4a6b-8510-21523ce7a03b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:40.823518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e9ed8dd7-6617-4a6b-8510-21523ce7a03b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:40.831605 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9ed8dd7-6617-4a6b-8510-21523ce7a03b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:40.832476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9ed8dd7-6617-4a6b-8510-21523ce7a03b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:40.833125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9ed8dd7-6617-4a6b-8510-21523ce7a03b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:40.834125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9ed8dd7-6617-4a6b-8510-21523ce7a03b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:40.834813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9ed8dd7-6617-4a6b-8510-21523ce7a03b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:40.835461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9ed8dd7-6617-4a6b-8510-21523ce7a03b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:40.992993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4d778257-1c71-483b-8053-f63ffcfff160 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:40.998224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4d778257-1c71-483b-8053-f63ffcfff160 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:41.013649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d778257-1c71-483b-8053-f63ffcfff160 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:41.020673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d778257-1c71-483b-8053-f63ffcfff160 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:41.021509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d778257-1c71-483b-8053-f63ffcfff160 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:41.022364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d778257-1c71-483b-8053-f63ffcfff160 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:41.022983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d778257-1c71-483b-8053-f63ffcfff160 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:41.023422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d778257-1c71-483b-8053-f63ffcfff160 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:41.026716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:36:41.187478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4d778257-1c71-483b-8053-f63ffcfff160 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:41.202609 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4d778257-1c71-483b-8053-f63ffcfff160 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1524 microversion: 2.1 time: 0.220099 Oct 10 23:36:41.203645 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1972/4063] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:40 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1524 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:41.240020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e9ed8dd7-6617-4a6b-8510-21523ce7a03b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:41.248977 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e9ed8dd7-6617-4a6b-8510-21523ce7a03b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 200 len: 1554 microversion: 2.1 time: 0.430661 Oct 10 23:36:41.249586 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2092/4064] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:40 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 1554 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:41.567222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1ebc6112-4883-44af-be88-97c730d00f5b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:41.568029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1ebc6112-4883-44af-be88-97c730d00f5b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:41.577228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ebc6112-4883-44af-be88-97c730d00f5b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:41.577862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ebc6112-4883-44af-be88-97c730d00f5b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:41.578314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ebc6112-4883-44af-be88-97c730d00f5b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:41.580586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ebc6112-4883-44af-be88-97c730d00f5b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:41.581118 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ebc6112-4883-44af-be88-97c730d00f5b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:41.581594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ebc6112-4883-44af-be88-97c730d00f5b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:41.880351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1ebc6112-4883-44af-be88-97c730d00f5b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:41.901679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1ebc6112-4883-44af-be88-97c730d00f5b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:41.903142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1ebc6112-4883-44af-be88-97c730d00f5b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:41.904311 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1ebc6112-4883-44af-be88-97c730d00f5b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.341553 Oct 10 23:36:41.905068 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1973/4065] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:41 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:42.234540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-584caf01-030c-48e7-aa34-ec53be6f3745 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:42.235234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-584caf01-030c-48e7-aa34-ec53be6f3745 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:42.250720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-584caf01-030c-48e7-aa34-ec53be6f3745 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:42.251175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-584caf01-030c-48e7-aa34-ec53be6f3745 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:42.254749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-584caf01-030c-48e7-aa34-ec53be6f3745 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:42.255594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-584caf01-030c-48e7-aa34-ec53be6f3745 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:42.256542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-584caf01-030c-48e7-aa34-ec53be6f3745 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:42.258759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-584caf01-030c-48e7-aa34-ec53be6f3745 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:42.276908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-44b7b800-b105-49f9-97e5-29a3fb7e1085 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:42.278338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-44b7b800-b105-49f9-97e5-29a3fb7e1085 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:42.299008 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44b7b800-b105-49f9-97e5-29a3fb7e1085 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:42.311424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44b7b800-b105-49f9-97e5-29a3fb7e1085 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:42.316427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44b7b800-b105-49f9-97e5-29a3fb7e1085 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:42.320632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44b7b800-b105-49f9-97e5-29a3fb7e1085 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:42.323133 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44b7b800-b105-49f9-97e5-29a3fb7e1085 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:42.323858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44b7b800-b105-49f9-97e5-29a3fb7e1085 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:42.530120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-44b7b800-b105-49f9-97e5-29a3fb7e1085 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:42.542362 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-44b7b800-b105-49f9-97e5-29a3fb7e1085 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 200 len: 1346 microversion: 2.1 time: 0.270963 Oct 10 23:36:42.557657 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1974/4066] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:42 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 1346 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:42.557657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-86e60378-ca18-4211-9424-12db7a81d201 req-237f7f4b-41a5-4c94-9f9a-d413b716bfc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0299384f-1c8e-41ee-9d98-9823342a6a72", "name": "network-vif-deleted", "tag": "ffe2514f-3db6-4c1c-8e18-3ce1be0107b9"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:42.583001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-86e60378-ca18-4211-9424-12db7a81d201 req-237f7f4b-41a5-4c94-9f9a-d413b716bfc5 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:42.583665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-86e60378-ca18-4211-9424-12db7a81d201 req-237f7f4b-41a5-4c94-9f9a-d413b716bfc5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:42.583923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-86e60378-ca18-4211-9424-12db7a81d201 req-237f7f4b-41a5-4c94-9f9a-d413b716bfc5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:42.603630 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-86e60378-ca18-4211-9424-12db7a81d201 req-237f7f4b-41a5-4c94-9f9a-d413b716bfc5 service nova] Creating event network-vif-deleted:ffe2514f-3db6-4c1c-8e18-3ce1be0107b9 for instance 0299384f-1c8e-41ee-9d98-9823342a6a72 on n-h2-860864-2 Oct 10 23:36:42.612942 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-86e60378-ca18-4211-9424-12db7a81d201 req-237f7f4b-41a5-4c94-9f9a-d413b716bfc5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064515 Oct 10 23:36:42.614460 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1975/4067] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:36:42.737640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-584caf01-030c-48e7-aa34-ec53be6f3745 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:42.755175 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-584caf01-030c-48e7-aa34-ec53be6f3745 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1524 microversion: 2.1 time: 0.530763 Oct 10 23:36:42.770064 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2093/4068] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:42 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1524 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:42.931556 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f475e44a-e6e7-4ccb-afb9-bda980575190 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:42.932274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f475e44a-e6e7-4ccb-afb9-bda980575190 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:42.969246 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f475e44a-e6e7-4ccb-afb9-bda980575190 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:42.973883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f475e44a-e6e7-4ccb-afb9-bda980575190 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:42.974382 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f475e44a-e6e7-4ccb-afb9-bda980575190 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:42.975354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f475e44a-e6e7-4ccb-afb9-bda980575190 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:42.976542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f475e44a-e6e7-4ccb-afb9-bda980575190 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:42.978024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f475e44a-e6e7-4ccb-afb9-bda980575190 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:43.273574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-00d67b13-9fc4-41ce-a019-4994727cc46d req-c69aac9c-9bf7-4f12-aae8-ea9386645088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "name": "network-vif-plugged", "status": "completed", "tag": "64c20742-7660-4d0e-82e1-e69776bd552d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:43.301555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-00d67b13-9fc4-41ce-a019-4994727cc46d req-c69aac9c-9bf7-4f12-aae8-ea9386645088 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:43.303133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-00d67b13-9fc4-41ce-a019-4994727cc46d req-c69aac9c-9bf7-4f12-aae8-ea9386645088 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:43.303535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-00d67b13-9fc4-41ce-a019-4994727cc46d req-c69aac9c-9bf7-4f12-aae8-ea9386645088 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:43.342896 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-00d67b13-9fc4-41ce-a019-4994727cc46d req-c69aac9c-9bf7-4f12-aae8-ea9386645088 service nova] Creating event network-vif-plugged:64c20742-7660-4d0e-82e1-e69776bd552d for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:36:43.354946 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-00d67b13-9fc4-41ce-a019-4994727cc46d req-c69aac9c-9bf7-4f12-aae8-ea9386645088 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087761 Oct 10 23:36:43.356350 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2094/4069] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:36:43.538534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f475e44a-e6e7-4ccb-afb9-bda980575190 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:43.554247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f475e44a-e6e7-4ccb-afb9-bda980575190 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:43.558044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f475e44a-e6e7-4ccb-afb9-bda980575190 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:43.560147 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f475e44a-e6e7-4ccb-afb9-bda980575190 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.632967 Oct 10 23:36:43.561389 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1976/4070] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:42 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:43.590092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0fd511c6-aaa9-4407-b041-f4d9fb10c306 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:43.591137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0fd511c6-aaa9-4407-b041-f4d9fb10c306 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:43.599276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:36:43.601289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fd511c6-aaa9-4407-b041-f4d9fb10c306 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:43.602115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fd511c6-aaa9-4407-b041-f4d9fb10c306 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:43.602777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fd511c6-aaa9-4407-b041-f4d9fb10c306 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:43.603883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fd511c6-aaa9-4407-b041-f4d9fb10c306 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:43.604708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fd511c6-aaa9-4407-b041-f4d9fb10c306 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:43.605336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fd511c6-aaa9-4407-b041-f4d9fb10c306 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:43.690260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0fd511c6-aaa9-4407-b041-f4d9fb10c306 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:43.704253 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0fd511c6-aaa9-4407-b041-f4d9fb10c306 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 200 len: 1346 microversion: 2.1 time: 0.128888 Oct 10 23:36:43.706139 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2095/4071] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:43 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 1346 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:43.784807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cdf58904-08ab-42fc-8840-77da69ba193a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:43.785641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cdf58904-08ab-42fc-8840-77da69ba193a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:43.798121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cdf58904-08ab-42fc-8840-77da69ba193a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:43.800078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cdf58904-08ab-42fc-8840-77da69ba193a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:43.805491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cdf58904-08ab-42fc-8840-77da69ba193a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:43.806188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cdf58904-08ab-42fc-8840-77da69ba193a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:43.806665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cdf58904-08ab-42fc-8840-77da69ba193a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:43.807092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cdf58904-08ab-42fc-8840-77da69ba193a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:44.219930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cdf58904-08ab-42fc-8840-77da69ba193a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:44.229324 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cdf58904-08ab-42fc-8840-77da69ba193a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1524 microversion: 2.1 time: 0.450468 Oct 10 23:36:44.246493 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1977/4072] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:43 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1524 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:44.594753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b834e873-d476-43f4-9151-e70a3ca2df09 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:44.596282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b834e873-d476-43f4-9151-e70a3ca2df09 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:44.604733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b834e873-d476-43f4-9151-e70a3ca2df09 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:44.605764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b834e873-d476-43f4-9151-e70a3ca2df09 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:44.606474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b834e873-d476-43f4-9151-e70a3ca2df09 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:44.607468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b834e873-d476-43f4-9151-e70a3ca2df09 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:44.608194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b834e873-d476-43f4-9151-e70a3ca2df09 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:44.610017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b834e873-d476-43f4-9151-e70a3ca2df09 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:44.733779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5b6b111a-67c0-40dd-a5c1-4851a0fdadff tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:44.734825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5b6b111a-67c0-40dd-a5c1-4851a0fdadff tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:44.739065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=72 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:36:44.755963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b6b111a-67c0-40dd-a5c1-4851a0fdadff tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:44.758787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b6b111a-67c0-40dd-a5c1-4851a0fdadff tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:44.759383 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b6b111a-67c0-40dd-a5c1-4851a0fdadff tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:44.761083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b6b111a-67c0-40dd-a5c1-4851a0fdadff tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:44.764078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b6b111a-67c0-40dd-a5c1-4851a0fdadff tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:44.764649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b6b111a-67c0-40dd-a5c1-4851a0fdadff tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:44.941451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5b6b111a-67c0-40dd-a5c1-4851a0fdadff tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:44.959759 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5b6b111a-67c0-40dd-a5c1-4851a0fdadff tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 200 len: 1346 microversion: 2.1 time: 0.229124 Oct 10 23:36:44.961089 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1978/4073] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:44 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 1346 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:45.255486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-881d8f6d-aa41-4d6c-94a4-455cf9f89bd2 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:45.256515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-881d8f6d-aa41-4d6c-94a4-455cf9f89bd2 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:45.265254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-881d8f6d-aa41-4d6c-94a4-455cf9f89bd2 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:45.266102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-881d8f6d-aa41-4d6c-94a4-455cf9f89bd2 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:45.266717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-881d8f6d-aa41-4d6c-94a4-455cf9f89bd2 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:45.268282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-881d8f6d-aa41-4d6c-94a4-455cf9f89bd2 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:45.269868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-881d8f6d-aa41-4d6c-94a4-455cf9f89bd2 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:45.270934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-881d8f6d-aa41-4d6c-94a4-455cf9f89bd2 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:45.281797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b834e873-d476-43f4-9151-e70a3ca2df09 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:45.293121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b834e873-d476-43f4-9151-e70a3ca2df09 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:45.295349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b834e873-d476-43f4-9151-e70a3ca2df09 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:45.296786 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b834e873-d476-43f4-9151-e70a3ca2df09 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.706146 Oct 10 23:36:45.297803 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2096/4074] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:44 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:45.423747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-a64746a4-ff00-4ee5-851f-70ddf6edfe4c req-157b71ae-6772-4b9a-88ab-ace04c1d9d2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "name": "network-vif-plugged", "status": "completed", "tag": "7961149e-16c2-40ba-bb9c-9da27106648b"}, {"server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "name": "network-vif-plugged", "status": "completed", "tag": "f52a21e1-4980-41cd-920e-a646400a6fc3"}, {"server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "name": "network-vif-plugged", "status": "completed", "tag": "4efdef6b-01db-43d4-9af9-1d488725b03c"}, {"server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "name": "network-vif-plugged", "status": "completed", "tag": "9382b9bb-ac70-49e6-a877-15684a47dcb9"}, {"server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "name": "network-vif-plugged", "status": "completed", "tag": "696f4f58-fa1e-4ecd-a136-8232df92640f"}, {"server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "name": "network-vif-plugged", "status": "completed", "tag": "ba3bc036-b9db-4323-b4e1-9d329301f767"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:45.436766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a64746a4-ff00-4ee5-851f-70ddf6edfe4c req-157b71ae-6772-4b9a-88ab-ace04c1d9d2b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:45.437696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a64746a4-ff00-4ee5-851f-70ddf6edfe4c req-157b71ae-6772-4b9a-88ab-ace04c1d9d2b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:45.438419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a64746a4-ff00-4ee5-851f-70ddf6edfe4c req-157b71ae-6772-4b9a-88ab-ace04c1d9d2b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:45.453253 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a64746a4-ff00-4ee5-851f-70ddf6edfe4c req-157b71ae-6772-4b9a-88ab-ace04c1d9d2b service nova] Creating event network-vif-plugged:7961149e-16c2-40ba-bb9c-9da27106648b for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:36:45.454061 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a64746a4-ff00-4ee5-851f-70ddf6edfe4c req-157b71ae-6772-4b9a-88ab-ace04c1d9d2b service nova] Creating event network-vif-plugged:f52a21e1-4980-41cd-920e-a646400a6fc3 for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:36:45.455309 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a64746a4-ff00-4ee5-851f-70ddf6edfe4c req-157b71ae-6772-4b9a-88ab-ace04c1d9d2b service nova] Creating event network-vif-plugged:4efdef6b-01db-43d4-9af9-1d488725b03c for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:36:45.456625 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a64746a4-ff00-4ee5-851f-70ddf6edfe4c req-157b71ae-6772-4b9a-88ab-ace04c1d9d2b service nova] Creating event network-vif-plugged:9382b9bb-ac70-49e6-a877-15684a47dcb9 for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:36:45.457932 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a64746a4-ff00-4ee5-851f-70ddf6edfe4c req-157b71ae-6772-4b9a-88ab-ace04c1d9d2b service nova] Creating event network-vif-plugged:696f4f58-fa1e-4ecd-a136-8232df92640f for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:36:45.458836 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a64746a4-ff00-4ee5-851f-70ddf6edfe4c req-157b71ae-6772-4b9a-88ab-ace04c1d9d2b service nova] Creating event network-vif-plugged:ba3bc036-b9db-4323-b4e1-9d329301f767 for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:36:45.465831 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-a64746a4-ff00-4ee5-851f-70ddf6edfe4c req-157b71ae-6772-4b9a-88ab-ace04c1d9d2b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.046821 Oct 10 23:36:45.467286 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2097/4075] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:45.489052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-881d8f6d-aa41-4d6c-94a4-455cf9f89bd2 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:45.520149 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-881d8f6d-aa41-4d6c-94a4-455cf9f89bd2 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1524 microversion: 2.1 time: 0.268669 Oct 10 23:36:45.540722 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1979/4076] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:45 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1524 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:45.990571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-41ac49c0-0063-4994-9672-b9056ba271c9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:45.991596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-41ac49c0-0063-4994-9672-b9056ba271c9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:45.998554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41ac49c0-0063-4994-9672-b9056ba271c9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:45.999126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41ac49c0-0063-4994-9672-b9056ba271c9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:45.999637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41ac49c0-0063-4994-9672-b9056ba271c9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:46.000465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41ac49c0-0063-4994-9672-b9056ba271c9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:46.001011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41ac49c0-0063-4994-9672-b9056ba271c9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:46.001672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41ac49c0-0063-4994-9672-b9056ba271c9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:46.087964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-41ac49c0-0063-4994-9672-b9056ba271c9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:46.098471 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-41ac49c0-0063-4994-9672-b9056ba271c9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 200 len: 1346 microversion: 2.1 time: 0.114388 Oct 10 23:36:46.113842 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2098/4077] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:45 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 1346 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:46.330163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-27baaaa1-54f0-4f93-b5c0-df990527fe81 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:46.330799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-27baaaa1-54f0-4f93-b5c0-df990527fe81 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:46.337452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27baaaa1-54f0-4f93-b5c0-df990527fe81 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:46.338179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27baaaa1-54f0-4f93-b5c0-df990527fe81 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:46.338624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27baaaa1-54f0-4f93-b5c0-df990527fe81 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:46.339327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27baaaa1-54f0-4f93-b5c0-df990527fe81 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:46.339789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27baaaa1-54f0-4f93-b5c0-df990527fe81 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:46.340245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27baaaa1-54f0-4f93-b5c0-df990527fe81 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:46.545943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-36e1d877-a1c3-43b1-919d-6b73f79d90f0 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:46.546909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-36e1d877-a1c3-43b1-919d-6b73f79d90f0 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:46.554795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36e1d877-a1c3-43b1-919d-6b73f79d90f0 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:46.555484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36e1d877-a1c3-43b1-919d-6b73f79d90f0 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:46.556040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36e1d877-a1c3-43b1-919d-6b73f79d90f0 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:46.557057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36e1d877-a1c3-43b1-919d-6b73f79d90f0 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:46.557823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36e1d877-a1c3-43b1-919d-6b73f79d90f0 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:46.559146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36e1d877-a1c3-43b1-919d-6b73f79d90f0 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:46.566852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-27baaaa1-54f0-4f93-b5c0-df990527fe81 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:46.574994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-27baaaa1-54f0-4f93-b5c0-df990527fe81 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:46.576762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-27baaaa1-54f0-4f93-b5c0-df990527fe81 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:46.578445 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-27baaaa1-54f0-4f93-b5c0-df990527fe81 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1879 microversion: 2.42 time: 0.252985 Oct 10 23:36:46.579351 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1980/4078] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:46 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1879 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:36:46.815259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-36e1d877-a1c3-43b1-919d-6b73f79d90f0 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:46.836075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:36:46.838956 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-36e1d877-a1c3-43b1-919d-6b73f79d90f0 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1524 microversion: 2.1 time: 0.298172 Oct 10 23:36:46.845879 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2099/4079] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:46 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1524 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:47.123921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5115ccca-db63-4b42-b0b4-917b5cb6b08f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:47.124551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5115ccca-db63-4b42-b0b4-917b5cb6b08f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:47.148956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5115ccca-db63-4b42-b0b4-917b5cb6b08f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:47.149727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5115ccca-db63-4b42-b0b4-917b5cb6b08f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:47.150323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5115ccca-db63-4b42-b0b4-917b5cb6b08f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:47.151208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5115ccca-db63-4b42-b0b4-917b5cb6b08f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:47.151816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5115ccca-db63-4b42-b0b4-917b5cb6b08f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:47.152398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5115ccca-db63-4b42-b0b4-917b5cb6b08f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:47.295326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5115ccca-db63-4b42-b0b4-917b5cb6b08f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:47.306330 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5115ccca-db63-4b42-b0b4-917b5cb6b08f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 200 len: 1346 microversion: 2.1 time: 0.185427 Oct 10 23:36:47.307582 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1981/4080] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:47 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 1346 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:47.609089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cfef20b7-f0cf-491f-8fe0-04a914c464f7 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:47.610348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cfef20b7-f0cf-491f-8fe0-04a914c464f7 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:47.623541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfef20b7-f0cf-491f-8fe0-04a914c464f7 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:47.624350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfef20b7-f0cf-491f-8fe0-04a914c464f7 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:47.624981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfef20b7-f0cf-491f-8fe0-04a914c464f7 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:47.626766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfef20b7-f0cf-491f-8fe0-04a914c464f7 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:47.626766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfef20b7-f0cf-491f-8fe0-04a914c464f7 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:47.627208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfef20b7-f0cf-491f-8fe0-04a914c464f7 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:47.866370 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-daa89617-b0e5-44a2-a0fc-d5dbd572ca69 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:47.867584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-daa89617-b0e5-44a2-a0fc-d5dbd572ca69 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:47.874722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-daa89617-b0e5-44a2-a0fc-d5dbd572ca69 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:47.875743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-daa89617-b0e5-44a2-a0fc-d5dbd572ca69 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:47.877510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-daa89617-b0e5-44a2-a0fc-d5dbd572ca69 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:47.878450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-daa89617-b0e5-44a2-a0fc-d5dbd572ca69 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:47.879122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-daa89617-b0e5-44a2-a0fc-d5dbd572ca69 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:47.879773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-daa89617-b0e5-44a2-a0fc-d5dbd572ca69 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:47.903046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cfef20b7-f0cf-491f-8fe0-04a914c464f7 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:47.915566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cfef20b7-f0cf-491f-8fe0-04a914c464f7 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:47.917029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cfef20b7-f0cf-491f-8fe0-04a914c464f7 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:47.918608 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cfef20b7-f0cf-491f-8fe0-04a914c464f7 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 2839 microversion: 2.42 time: 0.315223 Oct 10 23:36:47.918951 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2100/4081] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:36:47 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 2839 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:36:47.949904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3bb6a011-682e-46cd-a3f3-ec456e7bb02c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:47.950947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3bb6a011-682e-46cd-a3f3-ec456e7bb02c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:47.957352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3bb6a011-682e-46cd-a3f3-ec456e7bb02c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:47.958114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3bb6a011-682e-46cd-a3f3-ec456e7bb02c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:47.958739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3bb6a011-682e-46cd-a3f3-ec456e7bb02c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:47.959617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3bb6a011-682e-46cd-a3f3-ec456e7bb02c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:47.960421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3bb6a011-682e-46cd-a3f3-ec456e7bb02c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:47.961018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3bb6a011-682e-46cd-a3f3-ec456e7bb02c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:48.129865 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3bb6a011-682e-46cd-a3f3-ec456e7bb02c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.184143 Oct 10 23:36:48.130617 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2101/4082] 10.222.0.23 () {60 vars in 1316 bytes} [Mon Oct 10 23:36:47 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39/os-interface => generated 1833 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:36:48.207802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-daa89617-b0e5-44a2-a0fc-d5dbd572ca69 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:48.217354 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-daa89617-b0e5-44a2-a0fc-d5dbd572ca69 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1524 microversion: 2.1 time: 0.355455 Oct 10 23:36:48.229870 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1982/4083] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:47 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1524 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:36:48.339370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-841fb471-b446-44c3-88b4-c4805d8f05c7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:48.340687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-841fb471-b446-44c3-88b4-c4805d8f05c7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:48.350751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-841fb471-b446-44c3-88b4-c4805d8f05c7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:48.351445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-841fb471-b446-44c3-88b4-c4805d8f05c7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:48.352172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-841fb471-b446-44c3-88b4-c4805d8f05c7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:48.352979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-841fb471-b446-44c3-88b4-c4805d8f05c7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:48.353485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-841fb471-b446-44c3-88b4-c4805d8f05c7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:48.353947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-841fb471-b446-44c3-88b4-c4805d8f05c7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:48.391366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-841fb471-b446-44c3-88b4-c4805d8f05c7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:48.391366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-841fb471-b446-44c3-88b4-c4805d8f05c7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:48.391366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-841fb471-b446-44c3-88b4-c4805d8f05c7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:48.391366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-841fb471-b446-44c3-88b4-c4805d8f05c7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lazy-loading 'fault' on Instance uuid 0299384f-1c8e-41ee-9d98-9823342a6a72 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:36:48.481122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-841fb471-b446-44c3-88b4-c4805d8f05c7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:48.492126 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-841fb471-b446-44c3-88b4-c4805d8f05c7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 200 len: 1351 microversion: 2.1 time: 0.158804 Oct 10 23:36:48.493050 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2102/4084] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:48 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 1351 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:49.246829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-427ed9ad-5a54-4b98-9123-0a6ec2b38e0c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:49.247344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-427ed9ad-5a54-4b98-9123-0a6ec2b38e0c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:49.255803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-427ed9ad-5a54-4b98-9123-0a6ec2b38e0c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:49.256303 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-427ed9ad-5a54-4b98-9123-0a6ec2b38e0c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:49.256998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-427ed9ad-5a54-4b98-9123-0a6ec2b38e0c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:49.257928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-427ed9ad-5a54-4b98-9123-0a6ec2b38e0c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:49.258397 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-427ed9ad-5a54-4b98-9123-0a6ec2b38e0c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:49.258837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-427ed9ad-5a54-4b98-9123-0a6ec2b38e0c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:49.466884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-427ed9ad-5a54-4b98-9123-0a6ec2b38e0c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:49.476462 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-427ed9ad-5a54-4b98-9123-0a6ec2b38e0c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1524 microversion: 2.1 time: 0.233692 Oct 10 23:36:49.477068 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1983/4085] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:49 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1524 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:49.520770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0ce93d90-1879-464e-9d15-2f05fb893409 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:49.521964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0ce93d90-1879-464e-9d15-2f05fb893409 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:49.534275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ce93d90-1879-464e-9d15-2f05fb893409 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:49.534979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ce93d90-1879-464e-9d15-2f05fb893409 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:49.535593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ce93d90-1879-464e-9d15-2f05fb893409 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:49.536467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ce93d90-1879-464e-9d15-2f05fb893409 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:49.537085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ce93d90-1879-464e-9d15-2f05fb893409 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:49.537546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ce93d90-1879-464e-9d15-2f05fb893409 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:49.559771 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-0ce93d90-1879-464e-9d15-2f05fb893409 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] HTTP exception thrown: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0ce93d90-1879-464e-9d15-2f05fb893409 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Request method failure captured: Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 HTTP/1.1 Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKw8hCLXWIFTJ3HaJf5ifgl6Pm7vGD8ptwfQXuGQAkf1M-RWSvV8nlygpWidDM338TQR6cXdzFUy8zgn8XWf4EUtX06mIecSablgYBXm9sJQ78u324dyYAXvHBKQ5Ge8XY02Fdf2X0InpWnugNSR9M1ccFMQnfZYNbqSwCmT2w9EOBY Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d42cb00f2544abbde09cae76f3e3a1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-DeleteServersTestJSON-837712631 Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 7cc066774b344a24a91fb41e990f5234 Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '0299384f-1c8e-41ee-9d98-9823342a6a72'} Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:36:49.562515 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:36:49.567258 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:36:49.567258 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:36:49.567258 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:36:49.567258 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:36:49.567258 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:36:49.567258 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. Oct 10 23:36:49.567258 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:36:49.568666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0ce93d90-1879-464e-9d15-2f05fb893409 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Returning 404 to user: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:36:49.569811 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0ce93d90-1879-464e-9d15-2f05fb893409 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 404 len: 111 microversion: 2.1 time: 0.056417 Oct 10 23:36:49.573894 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2103/4086] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:49 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:36:49.678710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-42ece6d3-529b-4236-95a6-10a97f85bc8f req-12d8e48b-4cb6-4c12-b7c5-7e65c0c28d8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "tag": "ba3bc036-b9db-4323-b4e1-9d329301f767"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:49.718020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-42ece6d3-529b-4236-95a6-10a97f85bc8f req-12d8e48b-4cb6-4c12-b7c5-7e65c0c28d8e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:49.718927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-42ece6d3-529b-4236-95a6-10a97f85bc8f req-12d8e48b-4cb6-4c12-b7c5-7e65c0c28d8e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:49.719651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-42ece6d3-529b-4236-95a6-10a97f85bc8f req-12d8e48b-4cb6-4c12-b7c5-7e65c0c28d8e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:49.721763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6a33daf8-da41-4bdb-9f0e-46d617a850df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:49.725106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6a33daf8-da41-4bdb-9f0e-46d617a850df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:49.737121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a33daf8-da41-4bdb-9f0e-46d617a850df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:49.741915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a33daf8-da41-4bdb-9f0e-46d617a850df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:49.742421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a33daf8-da41-4bdb-9f0e-46d617a850df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:49.743259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a33daf8-da41-4bdb-9f0e-46d617a850df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:49.743897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a33daf8-da41-4bdb-9f0e-46d617a850df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:49.744143 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-42ece6d3-529b-4236-95a6-10a97f85bc8f req-12d8e48b-4cb6-4c12-b7c5-7e65c0c28d8e service nova] Creating event network-changed:ba3bc036-b9db-4323-b4e1-9d329301f767 for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:36:49.744606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a33daf8-da41-4bdb-9f0e-46d617a850df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:49.751477 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-42ece6d3-529b-4236-95a6-10a97f85bc8f req-12d8e48b-4cb6-4c12-b7c5-7e65c0c28d8e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078611 Oct 10 23:36:49.753152 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1984/4087] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:36:49.770779 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-6a33daf8-da41-4bdb-9f0e-46d617a850df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] HTTP exception thrown: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6a33daf8-da41-4bdb-9f0e-46d617a850df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Request method failure captured: Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72/os-volume_attachments HTTP/1.1 Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKw8hCLXWIFTJ3HaJf5ifgl6Pm7vGD8ptwfQXuGQAkf1M-RWSvV8nlygpWidDM338TQR6cXdzFUy8zgn8XWf4EUtX06mIecSablgYBXm9sJQ78u324dyYAXvHBKQ5Ge8XY02Fdf2X0InpWnugNSR9M1ccFMQnfZYNbqSwCmT2w9EOBY Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d42cb00f2544abbde09cae76f3e3a1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-DeleteServersTestJSON-837712631 Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 7cc066774b344a24a91fb41e990f5234 Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'server_id': '0299384f-1c8e-41ee-9d98-9823342a6a72'} Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:36:49.773007 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:36:49.776788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. Oct 10 23:36:49.776788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:36:49.776788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:36:49.776788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:36:49.776788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:36:49.776788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:36:49.776788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:36:49.776788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:36:49.776788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:36:49.776788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. Oct 10 23:36:49.776788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:36:49.779148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6a33daf8-da41-4bdb-9f0e-46d617a850df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Returning 404 to user: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:36:49.780367 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6a33daf8-da41-4bdb-9f0e-46d617a850df tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.063217 Oct 10 23:36:49.781485 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2104/4088] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:36:49 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72/os-volume_attachments => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:36:49.974422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7feaf8a1-1092-48c8-9483-39057c2d4ba5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-829144914", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "d3777005-851a-44f1-be2b-d4f3d09bbf72"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:50.067375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-7feaf8a1-1092-48c8-9483-39057c2d4ba5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] validate_networks() for [('d3777005-851a-44f1-be2b-d4f3d09bbf72', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:36:50.502980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fa8e1d8f-4b20-4e1a-8bbc-ca6932c66326 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:50.503604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fa8e1d8f-4b20-4e1a-8bbc-ca6932c66326 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:50.521242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa8e1d8f-4b20-4e1a-8bbc-ca6932c66326 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:50.522261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa8e1d8f-4b20-4e1a-8bbc-ca6932c66326 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:50.522681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa8e1d8f-4b20-4e1a-8bbc-ca6932c66326 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:50.523548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa8e1d8f-4b20-4e1a-8bbc-ca6932c66326 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:50.523942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa8e1d8f-4b20-4e1a-8bbc-ca6932c66326 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:50.525608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa8e1d8f-4b20-4e1a-8bbc-ca6932c66326 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:50.828613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fa8e1d8f-4b20-4e1a-8bbc-ca6932c66326 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:50.847463 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fa8e1d8f-4b20-4e1a-8bbc-ca6932c66326 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1524 microversion: 2.1 time: 0.349230 Oct 10 23:36:50.851808 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2105/4089] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:50 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1524 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:36:51.431994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-7feaf8a1-1092-48c8-9483-39057c2d4ba5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:36:51.433447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-7feaf8a1-1092-48c8-9483-39057c2d4ba5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:36:51.434168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-7feaf8a1-1092-48c8-9483-39057c2d4ba5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:36:51.434760 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-7feaf8a1-1092-48c8-9483-39057c2d4ba5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:36:51.435183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-7feaf8a1-1092-48c8-9483-39057c2d4ba5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:36:51.448564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7feaf8a1-1092-48c8-9483-39057c2d4ba5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:51.449064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7feaf8a1-1092-48c8-9483-39057c2d4ba5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:51.449550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7feaf8a1-1092-48c8-9483-39057c2d4ba5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:51.450283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7feaf8a1-1092-48c8-9483-39057c2d4ba5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:51.450733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7feaf8a1-1092-48c8-9483-39057c2d4ba5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:51.451312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7feaf8a1-1092-48c8-9483-39057c2d4ba5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:51.472044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-7feaf8a1-1092-48c8-9483-39057c2d4ba5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Getting quotas for project e7d42cb00f2544abbde09cae76f3e3a1. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:36:51.478815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-7feaf8a1-1092-48c8-9483-39057c2d4ba5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Getting quotas for user 7cc066774b344a24a91fb41e990f5234 and project e7d42cb00f2544abbde09cae76f3e3a1. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:36:51.495267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7feaf8a1-1092-48c8-9483-39057c2d4ba5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:36:51.498244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7feaf8a1-1092-48c8-9483-39057c2d4ba5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: c5541b0c-6e19-40ee-bad8-7b491c397a34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:36:51.552411 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7feaf8a1-1092-48c8-9483-39057c2d4ba5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.585370 Oct 10 23:36:51.553114 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1985/4090] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:36:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:36:51.564914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-87be4a20-a0a8-4602-bb89-a98341c974dd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:51.565630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-87be4a20-a0a8-4602-bb89-a98341c974dd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: c5541b0c-6e19-40ee-bad8-7b491c397a34] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:51.678057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-87be4a20-a0a8-4602-bb89-a98341c974dd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:51.700388 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-87be4a20-a0a8-4602-bb89-a98341c974dd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/c5541b0c-6e19-40ee-bad8-7b491c397a34" status: 200 len: 1214 microversion: 2.1 time: 0.139447 Oct 10 23:36:51.706819 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2106/4091] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:51 2022] GET /compute/v2.1/servers/c5541b0c-6e19-40ee-bad8-7b491c397a34 => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:51.739833 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-13ca09c9-e524-43d2-807e-f9175ca13c82 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:51.740427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-13ca09c9-e524-43d2-807e-f9175ca13c82 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: c5541b0c-6e19-40ee-bad8-7b491c397a34] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:51.775709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-13ca09c9-e524-43d2-807e-f9175ca13c82 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: c5541b0c-6e19-40ee-bad8-7b491c397a34] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:36:51.888429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e25c24d6-5a8b-4321-baf6-cc392b1c1c1c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:51.889497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e25c24d6-5a8b-4321-baf6-cc392b1c1c1c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:51.906260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e25c24d6-5a8b-4321-baf6-cc392b1c1c1c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:51.908182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e25c24d6-5a8b-4321-baf6-cc392b1c1c1c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:51.909049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e25c24d6-5a8b-4321-baf6-cc392b1c1c1c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:51.910015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e25c24d6-5a8b-4321-baf6-cc392b1c1c1c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:51.910674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e25c24d6-5a8b-4321-baf6-cc392b1c1c1c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:51.911377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e25c24d6-5a8b-4321-baf6-cc392b1c1c1c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:52.199019 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.scheduler.client.report [None req-13ca09c9-e524-43d2-807e-f9175ca13c82 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Deleted allocations for instance c5541b0c-6e19-40ee-bad8-7b491c397a34 Oct 10 23:36:52.206292 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.compute.api [None req-13ca09c9-e524-43d2-807e-f9175ca13c82 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: c5541b0c-6e19-40ee-bad8-7b491c397a34] Instance Mapping does not exist while attempting local delete cleanup. Oct 10 23:36:52.209592 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-13ca09c9-e524-43d2-807e-f9175ca13c82 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c5541b0c-6e19-40ee-bad8-7b491c397a34" status: 204 len: 0 microversion: 2.1 time: 0.476214 Oct 10 23:36:52.215277 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1986/4092] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:36:51 2022] DELETE /compute/v2.1/servers/c5541b0c-6e19-40ee-bad8-7b491c397a34 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:36:52.230240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5b97da39-9f96-4226-99da-224cc80666cc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:52.230928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5b97da39-9f96-4226-99da-224cc80666cc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: c5541b0c-6e19-40ee-bad8-7b491c397a34] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:52.240349 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-5b97da39-9f96-4226-99da-224cc80666cc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] HTTP exception thrown: Instance c5541b0c-6e19-40ee-bad8-7b491c397a34 could not be found. Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5b97da39-9f96-4226-99da-224cc80666cc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Request method failure captured: Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/c5541b0c-6e19-40ee-bad8-7b491c397a34 HTTP/1.1 Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKw8hCLXWIFTJ3HaJf5ifgl6Pm7vGD8ptwfQXuGQAkf1M-RWSvV8nlygpWidDM338TQR6cXdzFUy8zgn8XWf4EUtX06mIecSablgYBXm9sJQ78u324dyYAXvHBKQ5Ge8XY02Fdf2X0InpWnugNSR9M1ccFMQnfZYNbqSwCmT2w9EOBY Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d42cb00f2544abbde09cae76f3e3a1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-DeleteServersTestJSON-837712631 Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 7cc066774b344a24a91fb41e990f5234 Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance c5541b0c-6e19-40ee-bad8-7b491c397a34 could not be found. Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'c5541b0c-6e19-40ee-bad8-7b491c397a34'} Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5541b0c-6e19-40ee-bad8-7b491c397a34 could not be found. Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5541b0c-6e19-40ee-bad8-7b491c397a34 could not be found. Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:36:52.244434 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:36:52.248573 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:36:52.248573 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:36:52.248573 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:36:52.248573 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5541b0c-6e19-40ee-bad8-7b491c397a34 could not be found. Oct 10 23:36:52.248573 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:36:52.251243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5b97da39-9f96-4226-99da-224cc80666cc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Returning 404 to user: Instance c5541b0c-6e19-40ee-bad8-7b491c397a34 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:36:52.253411 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5b97da39-9f96-4226-99da-224cc80666cc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/c5541b0c-6e19-40ee-bad8-7b491c397a34" status: 404 len: 111 microversion: 2.1 time: 0.035838 Oct 10 23:36:52.254169 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1987/4093] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:52 2022] GET /compute/v2.1/servers/c5541b0c-6e19-40ee-bad8-7b491c397a34 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:36:52.362588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e25c24d6-5a8b-4321-baf6-cc392b1c1c1c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:52.368531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9cdcd36a-05c9-46e4-aa7b-7e93139e22d8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-449490396", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "d3777005-851a-44f1-be2b-d4f3d09bbf72"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:52.372760 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e25c24d6-5a8b-4321-baf6-cc392b1c1c1c tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1524 microversion: 2.1 time: 0.489726 Oct 10 23:36:52.385503 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2107/4094] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:51 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1524 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:52.489927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-9cdcd36a-05c9-46e4-aa7b-7e93139e22d8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] validate_networks() for [('d3777005-851a-44f1-be2b-d4f3d09bbf72', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:36:53.283310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-9cdcd36a-05c9-46e4-aa7b-7e93139e22d8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:36:53.284015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-9cdcd36a-05c9-46e4-aa7b-7e93139e22d8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:36:53.284667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-9cdcd36a-05c9-46e4-aa7b-7e93139e22d8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:36:53.285280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-9cdcd36a-05c9-46e4-aa7b-7e93139e22d8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:36:53.285998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-9cdcd36a-05c9-46e4-aa7b-7e93139e22d8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:36:53.303194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9cdcd36a-05c9-46e4-aa7b-7e93139e22d8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:53.303706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9cdcd36a-05c9-46e4-aa7b-7e93139e22d8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:53.306544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9cdcd36a-05c9-46e4-aa7b-7e93139e22d8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:53.307511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9cdcd36a-05c9-46e4-aa7b-7e93139e22d8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:53.309565 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9cdcd36a-05c9-46e4-aa7b-7e93139e22d8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:53.310057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9cdcd36a-05c9-46e4-aa7b-7e93139e22d8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:53.356066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-9cdcd36a-05c9-46e4-aa7b-7e93139e22d8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Getting quotas for project e7d42cb00f2544abbde09cae76f3e3a1. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:36:53.364983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-9cdcd36a-05c9-46e4-aa7b-7e93139e22d8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Getting quotas for user 7cc066774b344a24a91fb41e990f5234 and project e7d42cb00f2544abbde09cae76f3e3a1. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:36:53.381426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9cdcd36a-05c9-46e4-aa7b-7e93139e22d8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:36:53.384189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9cdcd36a-05c9-46e4-aa7b-7e93139e22d8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:36:53.404567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-11e3ff30-fabc-40b4-8473-0bb15c023cfb tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:53.405941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-11e3ff30-fabc-40b4-8473-0bb15c023cfb tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:53.414913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11e3ff30-fabc-40b4-8473-0bb15c023cfb tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:53.415645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11e3ff30-fabc-40b4-8473-0bb15c023cfb tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:53.416338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11e3ff30-fabc-40b4-8473-0bb15c023cfb tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:53.417215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11e3ff30-fabc-40b4-8473-0bb15c023cfb tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:53.418526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11e3ff30-fabc-40b4-8473-0bb15c023cfb tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:53.419135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11e3ff30-fabc-40b4-8473-0bb15c023cfb tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:53.479944 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9cdcd36a-05c9-46e4-aa7b-7e93139e22d8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.116005 Oct 10 23:36:53.484553 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1988/4095] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:36:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 23:36:53.496818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a612434c-30d7-4fe7-b0f9-c96a22a63501 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:53.498382 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a612434c-30d7-4fe7-b0f9-c96a22a63501 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:53.685725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-11e3ff30-fabc-40b4-8473-0bb15c023cfb tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:53.697647 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-11e3ff30-fabc-40b4-8473-0bb15c023cfb tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1524 microversion: 2.1 time: 0.297565 Oct 10 23:36:53.700027 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2108/4096] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:53 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1524 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:36:53.715142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a612434c-30d7-4fe7-b0f9-c96a22a63501 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:53.734520 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a612434c-30d7-4fe7-b0f9-c96a22a63501 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7" status: 200 len: 1214 microversion: 2.1 time: 0.242829 Oct 10 23:36:53.737778 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1989/4097] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:53 2022] GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 => generated 1214 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:54.747908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7364e378-e397-4020-9f20-611bf85604fc tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:54.748914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7364e378-e397-4020-9f20-611bf85604fc tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:54.766264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9f201e4a-7da3-4c39-8a07-e505d0f19514 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:54.767111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9f201e4a-7da3-4c39-8a07-e505d0f19514 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:54.779989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f201e4a-7da3-4c39-8a07-e505d0f19514 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:54.780483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f201e4a-7da3-4c39-8a07-e505d0f19514 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:54.781082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f201e4a-7da3-4c39-8a07-e505d0f19514 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:54.784637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f201e4a-7da3-4c39-8a07-e505d0f19514 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:54.785289 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f201e4a-7da3-4c39-8a07-e505d0f19514 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:54.787755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f201e4a-7da3-4c39-8a07-e505d0f19514 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:54.796733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7364e378-e397-4020-9f20-611bf85604fc tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:54.805150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7364e378-e397-4020-9f20-611bf85604fc tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:54.807941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7364e378-e397-4020-9f20-611bf85604fc tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:54.808779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7364e378-e397-4020-9f20-611bf85604fc tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:54.810934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7364e378-e397-4020-9f20-611bf85604fc tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:54.811395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7364e378-e397-4020-9f20-611bf85604fc tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:54.950275 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9f201e4a-7da3-4c39-8a07-e505d0f19514 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:54.960442 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9f201e4a-7da3-4c39-8a07-e505d0f19514 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7" status: 200 len: 1266 microversion: 2.1 time: 0.197751 Oct 10 23:36:55.018558 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1990/4098] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:54 2022] GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:36:55.146436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7364e378-e397-4020-9f20-611bf85604fc tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:55.156796 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7364e378-e397-4020-9f20-611bf85604fc tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1504 microversion: 2.1 time: 0.423304 Oct 10 23:36:55.170756 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2109/4099] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:54 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1504 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:55.183501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2068c28c-885f-434c-a875-61e76c5df295 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Action: 'create', calling method: .version_select at 0x7f662b4ec820>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1217046181", "description": "tempest-description-1634988513"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:55.740316 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2068c28c-885f-434c-a875-61e76c5df295 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.560926 Oct 10 23:36:55.740933 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1991/4100] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:36:55 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:36:55.755199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-916c79c7-12e5-4d7b-a389-5a5f8938bcd9 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1217046181"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:55.755967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-916c79c7-12e5-4d7b-a389-5a5f8938bcd9 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:55.762955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-916c79c7-12e5-4d7b-a389-5a5f8938bcd9 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:55.763432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-916c79c7-12e5-4d7b-a389-5a5f8938bcd9 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:55.763868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-916c79c7-12e5-4d7b-a389-5a5f8938bcd9 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:55.764588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-916c79c7-12e5-4d7b-a389-5a5f8938bcd9 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:55.765049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-916c79c7-12e5-4d7b-a389-5a5f8938bcd9 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:55.765511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-916c79c7-12e5-4d7b-a389-5a5f8938bcd9 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:55.950217 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.network.security_group_api [None req-916c79c7-12e5-4d7b-a389-5a5f8938bcd9 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Adding security group b8a58296-2de9-4f36-b641-5ca464c73e34 to port 0ca323c5-08ed-433b-892e-43a213787a79 Oct 10 23:36:55.998697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e42bd9f3-ab0f-40de-84b5-c2ad423104cd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:56.000122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e42bd9f3-ab0f-40de-84b5-c2ad423104cd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:56.009506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e42bd9f3-ab0f-40de-84b5-c2ad423104cd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:56.010377 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e42bd9f3-ab0f-40de-84b5-c2ad423104cd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:56.011076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e42bd9f3-ab0f-40de-84b5-c2ad423104cd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:56.012071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e42bd9f3-ab0f-40de-84b5-c2ad423104cd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:56.012868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e42bd9f3-ab0f-40de-84b5-c2ad423104cd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:56.013729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e42bd9f3-ab0f-40de-84b5-c2ad423104cd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:56.144013 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e42bd9f3-ab0f-40de-84b5-c2ad423104cd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:56.153716 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e42bd9f3-ab0f-40de-84b5-c2ad423104cd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7" status: 200 len: 1272 microversion: 2.1 time: 0.162290 Oct 10 23:36:56.175691 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1992/4101] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:55 2022] GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 => generated 1272 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:36:56.185359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a51bbd88-b5f5-4c33-a343-cb45b49dd467 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:56.186822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a51bbd88-b5f5-4c33-a343-cb45b49dd467 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:56.203574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a51bbd88-b5f5-4c33-a343-cb45b49dd467 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:56.204073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a51bbd88-b5f5-4c33-a343-cb45b49dd467 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:56.204793 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a51bbd88-b5f5-4c33-a343-cb45b49dd467 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:56.205710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a51bbd88-b5f5-4c33-a343-cb45b49dd467 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:56.210820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a51bbd88-b5f5-4c33-a343-cb45b49dd467 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:56.214151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a51bbd88-b5f5-4c33-a343-cb45b49dd467 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:56.265070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a51bbd88-b5f5-4c33-a343-cb45b49dd467 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:36:56.354078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:36:56.388138 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a51bbd88-b5f5-4c33-a343-cb45b49dd467 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "DELETE /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 204 len: 0 microversion: 2.1 time: 0.210698 Oct 10 23:36:56.389983 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1993/4102] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:36:56 2022] DELETE /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:36:56.408370 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bd85723f-559a-4dc5-8c92-9d6c64230104 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:56.409519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bd85723f-559a-4dc5-8c92-9d6c64230104 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:56.421767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd85723f-559a-4dc5-8c92-9d6c64230104 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:56.423089 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd85723f-559a-4dc5-8c92-9d6c64230104 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:56.426311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd85723f-559a-4dc5-8c92-9d6c64230104 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:56.427619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd85723f-559a-4dc5-8c92-9d6c64230104 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:56.431491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd85723f-559a-4dc5-8c92-9d6c64230104 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:56.434972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd85723f-559a-4dc5-8c92-9d6c64230104 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:56.459884 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-916c79c7-12e5-4d7b-a389-5a5f8938bcd9 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "POST /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d/action" status: 202 len: 0 microversion: 2.1 time: 0.708285 Oct 10 23:36:56.461366 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2110/4103] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:36:55 2022] POST /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d/action => generated 0 bytes in 711 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:36:56.489402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bc44ef65-6f91-4e63-bc7b-685e318fb777 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1217046181"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:56.494791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bc44ef65-6f91-4e63-bc7b-685e318fb777 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:56.507890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc44ef65-6f91-4e63-bc7b-685e318fb777 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:56.508535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc44ef65-6f91-4e63-bc7b-685e318fb777 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:56.509015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc44ef65-6f91-4e63-bc7b-685e318fb777 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:56.513967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc44ef65-6f91-4e63-bc7b-685e318fb777 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:56.514778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc44ef65-6f91-4e63-bc7b-685e318fb777 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:56.516748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc44ef65-6f91-4e63-bc7b-685e318fb777 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:56.769578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bd85723f-559a-4dc5-8c92-9d6c64230104 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:56.780952 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bd85723f-559a-4dc5-8c92-9d6c64230104 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1666 microversion: 2.1 time: 0.385911 Oct 10 23:36:56.785645 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.network.security_group_api [None req-bc44ef65-6f91-4e63-bc7b-685e318fb777 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Removing security group b8a58296-2de9-4f36-b641-5ca464c73e34 from port 0ca323c5-08ed-433b-892e-43a213787a79 Oct 10 23:36:56.787570 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1994/4104] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:56 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1666 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:56.810252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-a6fe2043-1ab8-46b4-b102-492abe1eb880 req-6edbfb90-2cd9-4047-85cf-743df0ad1f1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d", "tag": "0ca323c5-08ed-433b-892e-43a213787a79"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:56.837067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a6fe2043-1ab8-46b4-b102-492abe1eb880 req-6edbfb90-2cd9-4047-85cf-743df0ad1f1f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:56.837667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a6fe2043-1ab8-46b4-b102-492abe1eb880 req-6edbfb90-2cd9-4047-85cf-743df0ad1f1f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:56.838197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a6fe2043-1ab8-46b4-b102-492abe1eb880 req-6edbfb90-2cd9-4047-85cf-743df0ad1f1f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:56.887949 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-a6fe2043-1ab8-46b4-b102-492abe1eb880 req-6edbfb90-2cd9-4047-85cf-743df0ad1f1f service nova] Creating event network-changed:0ca323c5-08ed-433b-892e-43a213787a79 for instance 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d on n-h1-860864-2 Oct 10 23:36:56.898929 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-a6fe2043-1ab8-46b4-b102-492abe1eb880 req-6edbfb90-2cd9-4047-85cf-743df0ad1f1f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092035 Oct 10 23:36:56.901206 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1995/4105] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:36:57.184771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-80a19d4a-877a-41b9-af3d-f2a8e90d2f6f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:57.185527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-80a19d4a-877a-41b9-af3d-f2a8e90d2f6f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:57.199103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80a19d4a-877a-41b9-af3d-f2a8e90d2f6f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:57.199608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80a19d4a-877a-41b9-af3d-f2a8e90d2f6f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:57.200053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80a19d4a-877a-41b9-af3d-f2a8e90d2f6f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:57.200775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80a19d4a-877a-41b9-af3d-f2a8e90d2f6f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:57.201235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80a19d4a-877a-41b9-af3d-f2a8e90d2f6f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:57.201760 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-80a19d4a-877a-41b9-af3d-f2a8e90d2f6f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:57.354757 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bc44ef65-6f91-4e63-bc7b-685e318fb777 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "POST /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d/action" status: 202 len: 0 microversion: 2.1 time: 0.880407 Oct 10 23:36:57.356127 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2111/4106] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:36:56 2022] POST /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d/action => generated 0 bytes in 882 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:36:57.366818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7e00365b-6585-44a3-9d72-933b8b318217 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Action: 'create', calling method: .version_select at 0x7f662b8a1ee0>, body: {"pool": null} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:57.404788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-80a19d4a-877a-41b9-af3d-f2a8e90d2f6f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:57.421776 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-80a19d4a-877a-41b9-af3d-f2a8e90d2f6f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7" status: 200 len: 1272 microversion: 2.1 time: 0.242148 Oct 10 23:36:57.423899 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1996/4107] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:57 2022] GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 => generated 1272 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:36:57.826112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ccefdd37-c5a9-4af7-955b-9ddcb82f7c54 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:57.827124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ccefdd37-c5a9-4af7-955b-9ddcb82f7c54 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:57.836935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccefdd37-c5a9-4af7-955b-9ddcb82f7c54 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:57.837781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccefdd37-c5a9-4af7-955b-9ddcb82f7c54 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:57.838531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccefdd37-c5a9-4af7-955b-9ddcb82f7c54 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:57.839709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccefdd37-c5a9-4af7-955b-9ddcb82f7c54 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:57.840334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccefdd37-c5a9-4af7-955b-9ddcb82f7c54 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:57.840970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccefdd37-c5a9-4af7-955b-9ddcb82f7c54 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:58.557602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ccefdd37-c5a9-4af7-955b-9ddcb82f7c54 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:58.579608 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ccefdd37-c5a9-4af7-955b-9ddcb82f7c54 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1666 microversion: 2.1 time: 0.769907 Oct 10 23:36:58.584204 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1997/4108] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:57 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1666 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:36:58.592609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ef46fe32-16cd-4252-b214-4a8670601d5b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:58.593510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ef46fe32-16cd-4252-b214-4a8670601d5b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:58.617277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef46fe32-16cd-4252-b214-4a8670601d5b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:58.618305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef46fe32-16cd-4252-b214-4a8670601d5b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:58.620561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef46fe32-16cd-4252-b214-4a8670601d5b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:58.623277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef46fe32-16cd-4252-b214-4a8670601d5b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:58.624384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef46fe32-16cd-4252-b214-4a8670601d5b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:58.624981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef46fe32-16cd-4252-b214-4a8670601d5b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:59.402951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ef46fe32-16cd-4252-b214-4a8670601d5b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:36:59.423926 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ef46fe32-16cd-4252-b214-4a8670601d5b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7" status: 200 len: 1314 microversion: 2.1 time: 0.836837 Oct 10 23:36:59.426640 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1998/4109] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:58 2022] GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 => generated 1314 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:36:59.443366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-1e33cddc-e73d-475c-89d9-8345417c365c req-246bafd2-c532-4d53-a0cb-da96cfd44225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d", "tag": "0ca323c5-08ed-433b-892e-43a213787a79"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:36:59.469405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1e33cddc-e73d-475c-89d9-8345417c365c req-246bafd2-c532-4d53-a0cb-da96cfd44225 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:59.470737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1e33cddc-e73d-475c-89d9-8345417c365c req-246bafd2-c532-4d53-a0cb-da96cfd44225 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:59.479286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1e33cddc-e73d-475c-89d9-8345417c365c req-246bafd2-c532-4d53-a0cb-da96cfd44225 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:59.503900 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-1e33cddc-e73d-475c-89d9-8345417c365c req-246bafd2-c532-4d53-a0cb-da96cfd44225 service nova] Creating event network-changed:0ca323c5-08ed-433b-892e-43a213787a79 for instance 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d on n-h1-860864-2 Oct 10 23:36:59.521486 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-1e33cddc-e73d-475c-89d9-8345417c365c req-246bafd2-c532-4d53-a0cb-da96cfd44225 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091133 Oct 10 23:36:59.522823 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 1999/4110] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:36:59.622144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-41732c8d-76a8-478d-9ed4-843ecd702b23 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:36:59.623265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-41732c8d-76a8-478d-9ed4-843ecd702b23 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:36:59.633900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41732c8d-76a8-478d-9ed4-843ecd702b23 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:59.635034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41732c8d-76a8-478d-9ed4-843ecd702b23 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:59.635997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41732c8d-76a8-478d-9ed4-843ecd702b23 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:36:59.637481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41732c8d-76a8-478d-9ed4-843ecd702b23 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:36:59.638492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41732c8d-76a8-478d-9ed4-843ecd702b23 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:36:59.639410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41732c8d-76a8-478d-9ed4-843ecd702b23 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:00.217949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-41732c8d-76a8-478d-9ed4-843ecd702b23 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:00.246363 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-41732c8d-76a8-478d-9ed4-843ecd702b23 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1666 microversion: 2.1 time: 0.631573 Oct 10 23:37:00.247535 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2000/4111] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:36:59 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1666 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:00.475722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-463d22a8-7837-4df5-99f5-cc9bf3b72668 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:00.476348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-463d22a8-7837-4df5-99f5-cc9bf3b72668 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:00.487141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-463d22a8-7837-4df5-99f5-cc9bf3b72668 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:00.489267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-463d22a8-7837-4df5-99f5-cc9bf3b72668 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:00.491290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-463d22a8-7837-4df5-99f5-cc9bf3b72668 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:00.492443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-463d22a8-7837-4df5-99f5-cc9bf3b72668 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:00.494000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-463d22a8-7837-4df5-99f5-cc9bf3b72668 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:00.497661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-463d22a8-7837-4df5-99f5-cc9bf3b72668 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:00.968722 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7e00365b-6585-44a3-9d72-933b8b318217 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.605622 Oct 10 23:37:00.969257 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2112/4112] 10.222.0.23 () {60 vars in 1170 bytes} [Mon Oct 10 23:36:57 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:37:00.982200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ae9e7753-c324-40bf-b56d-f56f08a2b601 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.34"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:37:00.986342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ae9e7753-c324-40bf-b56d-f56f08a2b601 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:00.993495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae9e7753-c324-40bf-b56d-f56f08a2b601 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:00.994377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae9e7753-c324-40bf-b56d-f56f08a2b601 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:00.995055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae9e7753-c324-40bf-b56d-f56f08a2b601 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:00.996166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae9e7753-c324-40bf-b56d-f56f08a2b601 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:00.996929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae9e7753-c324-40bf-b56d-f56f08a2b601 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:00.997779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae9e7753-c324-40bf-b56d-f56f08a2b601 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:01.029563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae9e7753-c324-40bf-b56d-f56f08a2b601 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "refresh_cache-2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" {{(pid=120613) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 23:37:01.030214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae9e7753-c324-40bf-b56d-f56f08a2b601 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquired lock "refresh_cache-2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" {{(pid=120613) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 23:37:01.675026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-463d22a8-7837-4df5-99f5-cc9bf3b72668 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:01.684919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:37:01.705548 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-463d22a8-7837-4df5-99f5-cc9bf3b72668 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7" status: 200 len: 1314 microversion: 2.1 time: 1.229095 Oct 10 23:37:01.721613 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2001/4113] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:00 2022] GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 => generated 1314 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:01.744090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-db7f0374-223f-48c4-a711-9c5c3cd0382a tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:01.745074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-db7f0374-223f-48c4-a711-9c5c3cd0382a tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:01.756144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db7f0374-223f-48c4-a711-9c5c3cd0382a tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:01.757909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db7f0374-223f-48c4-a711-9c5c3cd0382a tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:01.759157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db7f0374-223f-48c4-a711-9c5c3cd0382a tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:01.760733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db7f0374-223f-48c4-a711-9c5c3cd0382a tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:01.761639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db7f0374-223f-48c4-a711-9c5c3cd0382a tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:01.762495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db7f0374-223f-48c4-a711-9c5c3cd0382a tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:02.082402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-db7f0374-223f-48c4-a711-9c5c3cd0382a tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:02.108659 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-db7f0374-223f-48c4-a711-9c5c3cd0382a tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1598 microversion: 2.1 time: 0.384991 Oct 10 23:37:02.109708 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2002/4114] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:01 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1598 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:02.115660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-86c2dd06-26fc-4724-a1b6-380e837bf4e1 req-190c9f5a-deac-43ba-94e4-87d802da0618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cef2e8cb-d283-45de-8e1d-d957f72ac8b7", "tag": "3c8ac517-3ea4-4d79-9a7e-20ab787b5542"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:37:02.138897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-86c2dd06-26fc-4724-a1b6-380e837bf4e1 req-190c9f5a-deac-43ba-94e4-87d802da0618 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:02.150237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-86c2dd06-26fc-4724-a1b6-380e837bf4e1 req-190c9f5a-deac-43ba-94e4-87d802da0618 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:02.151080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-86c2dd06-26fc-4724-a1b6-380e837bf4e1 req-190c9f5a-deac-43ba-94e4-87d802da0618 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:02.168496 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-86c2dd06-26fc-4724-a1b6-380e837bf4e1 req-190c9f5a-deac-43ba-94e4-87d802da0618 service nova] Creating event network-changed:3c8ac517-3ea4-4d79-9a7e-20ab787b5542 for instance cef2e8cb-d283-45de-8e1d-d957f72ac8b7 on n-h2-860864-2 Oct 10 23:37:02.186558 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-86c2dd06-26fc-4724-a1b6-380e837bf4e1 req-190c9f5a-deac-43ba-94e4-87d802da0618 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074897 Oct 10 23:37:02.188340 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2003/4115] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:37:02.749178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aeedc1fb-5503-47bd-9292-c1cc56c39b2f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:02.750195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aeedc1fb-5503-47bd-9292-c1cc56c39b2f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:02.791643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeedc1fb-5503-47bd-9292-c1cc56c39b2f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:02.793593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeedc1fb-5503-47bd-9292-c1cc56c39b2f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:02.794136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeedc1fb-5503-47bd-9292-c1cc56c39b2f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:02.794952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeedc1fb-5503-47bd-9292-c1cc56c39b2f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:02.795446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeedc1fb-5503-47bd-9292-c1cc56c39b2f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:02.795894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeedc1fb-5503-47bd-9292-c1cc56c39b2f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:03.131573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aeedc1fb-5503-47bd-9292-c1cc56c39b2f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:03.149334 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aeedc1fb-5503-47bd-9292-c1cc56c39b2f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7" status: 200 len: 1314 microversion: 2.1 time: 0.406956 Oct 10 23:37:03.152188 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2004/4116] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:02 2022] GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:03.158055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-54f5168e-745f-4c38-aee6-4ec85e858f6e tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:03.159050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-54f5168e-745f-4c38-aee6-4ec85e858f6e tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:03.180047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54f5168e-745f-4c38-aee6-4ec85e858f6e tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:03.180700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54f5168e-745f-4c38-aee6-4ec85e858f6e tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:03.181158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54f5168e-745f-4c38-aee6-4ec85e858f6e tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:03.182371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54f5168e-745f-4c38-aee6-4ec85e858f6e tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:03.182881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54f5168e-745f-4c38-aee6-4ec85e858f6e tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:03.185616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54f5168e-745f-4c38-aee6-4ec85e858f6e tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:03.263288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:37:03.265847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54f5168e-745f-4c38-aee6-4ec85e858f6e tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:03.266573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54f5168e-745f-4c38-aee6-4ec85e858f6e tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:03.267799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54f5168e-745f-4c38-aee6-4ec85e858f6e tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:03.270671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-54f5168e-745f-4c38-aee6-4ec85e858f6e tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lazy-loading 'fault' on Instance uuid 00dec699-50e1-4f85-9274-c8a2b115f13c {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:37:03.349550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:37:03.357507 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-54f5168e-745f-4c38-aee6-4ec85e858f6e tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a9c6f195e2a491097e771787e454a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196e430563ce4e65a2a5d4485aaa02b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:03.371802 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-54f5168e-745f-4c38-aee6-4ec85e858f6e tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 200 len: 1316 microversion: 2.1 time: 0.218167 Oct 10 23:37:03.372436 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2005/4117] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:03 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:03.453023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9cb1e407-b5ed-4257-8b01-e25213ba6acf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:03.453766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9cb1e407-b5ed-4257-8b01-e25213ba6acf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:03.460982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9cb1e407-b5ed-4257-8b01-e25213ba6acf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:03.461697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9cb1e407-b5ed-4257-8b01-e25213ba6acf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:03.462268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9cb1e407-b5ed-4257-8b01-e25213ba6acf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:03.463158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9cb1e407-b5ed-4257-8b01-e25213ba6acf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:03.463751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9cb1e407-b5ed-4257-8b01-e25213ba6acf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:03.464328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9cb1e407-b5ed-4257-8b01-e25213ba6acf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:03.497490 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9cb1e407-b5ed-4257-8b01-e25213ba6acf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734/ips" status: 200 len: 152 microversion: 2.20 time: 0.048485 Oct 10 23:37:03.498540 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2006/4118] 10.222.0.23 () {60 vars in 1289 bytes} [Mon Oct 10 23:37:03 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734/ips => generated 152 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 23:37:04.185981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f391ea2b-60e2-43e7-94c2-7b5c285df7a6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:04.187256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f391ea2b-60e2-43e7-94c2-7b5c285df7a6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:04.229700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=16 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:37:04.241647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f391ea2b-60e2-43e7-94c2-7b5c285df7a6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:04.241647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f391ea2b-60e2-43e7-94c2-7b5c285df7a6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:04.242085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f391ea2b-60e2-43e7-94c2-7b5c285df7a6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:04.242978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f391ea2b-60e2-43e7-94c2-7b5c285df7a6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:04.243539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f391ea2b-60e2-43e7-94c2-7b5c285df7a6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:04.244455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f391ea2b-60e2-43e7-94c2-7b5c285df7a6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:04.960210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f391ea2b-60e2-43e7-94c2-7b5c285df7a6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:04.975546 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f391ea2b-60e2-43e7-94c2-7b5c285df7a6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7" status: 200 len: 1314 microversion: 2.1 time: 0.797142 Oct 10 23:37:04.975546 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2007/4119] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:04 2022] GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 => generated 1314 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:37:05.007328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-d91f10d0-aba2-463e-a747-cbe30c8ec9c2 req-7abbc925-f6d1-4096-811c-9cbebeae3eaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00dec699-50e1-4f85-9274-c8a2b115f13c", "name": "network-vif-deleted", "tag": "ad7cc15e-cb3c-4db4-b0e3-9e9e677aedb1"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:37:05.022829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d91f10d0-aba2-463e-a747-cbe30c8ec9c2 req-7abbc925-f6d1-4096-811c-9cbebeae3eaa service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:05.024225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d91f10d0-aba2-463e-a747-cbe30c8ec9c2 req-7abbc925-f6d1-4096-811c-9cbebeae3eaa service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:05.024838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d91f10d0-aba2-463e-a747-cbe30c8ec9c2 req-7abbc925-f6d1-4096-811c-9cbebeae3eaa service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:05.042217 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-d91f10d0-aba2-463e-a747-cbe30c8ec9c2 req-7abbc925-f6d1-4096-811c-9cbebeae3eaa service nova] Creating event network-vif-deleted:ad7cc15e-cb3c-4db4-b0e3-9e9e677aedb1 for instance 00dec699-50e1-4f85-9274-c8a2b115f13c on n-h1-860864-2 Oct 10 23:37:05.049179 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-d91f10d0-aba2-463e-a747-cbe30c8ec9c2 req-7abbc925-f6d1-4096-811c-9cbebeae3eaa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059871 Oct 10 23:37:05.050407 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2008/4120] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:37:05.057034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-03dbe65c-9a5d-4727-b0c9-7e9b0ea3f3a6 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:05.057718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-03dbe65c-9a5d-4727-b0c9-7e9b0ea3f3a6 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] [instance: 00dec699-50e1-4f85-9274-c8a2b115f13c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:05.068105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03dbe65c-9a5d-4727-b0c9-7e9b0ea3f3a6 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:05.068760 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03dbe65c-9a5d-4727-b0c9-7e9b0ea3f3a6 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:05.069519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03dbe65c-9a5d-4727-b0c9-7e9b0ea3f3a6 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:05.070391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03dbe65c-9a5d-4727-b0c9-7e9b0ea3f3a6 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:05.071005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03dbe65c-9a5d-4727-b0c9-7e9b0ea3f3a6 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:05.071575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03dbe65c-9a5d-4727-b0c9-7e9b0ea3f3a6 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:05.101068 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-03dbe65c-9a5d-4727-b0c9-7e9b0ea3f3a6 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] HTTP exception thrown: Instance 00dec699-50e1-4f85-9274-c8a2b115f13c could not be found. Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-03dbe65c-9a5d-4727-b0c9-7e9b0ea3f3a6 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Request method failure captured: Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c HTTP/1.1 Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKwKdyQnEO4M_J5hTTNiUWnLjdJZTYY2L6dNP2N1hTH1uSQHiRAIVPvFLtmTd7ZQQ5ni58ADajb3C290LPFx7IqgjGp1poOyb2-EwPJwrvHoh7adlqAlfqYcreY7hltDyeDSwf4Rl3YXMeU09fqDaiDrwD4DTvIXgJjGHa_6500xtcY Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 196e430563ce4e65a2a5d4485aaa02b1 Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersTestFqdnHostnames-625887008 Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/196e430563ce4e65a2a5d4485aaa02b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/196e430563ce4e65a2a5d4485aaa02b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/196e430563ce4e65a2a5d4485aaa02b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_196e430563ce4e65a2a5d4485aaa02b1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersTestFqdnHostnames-625887008 Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 196e430563ce4e65a2a5d4485aaa02b1 Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-625887008 Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersTestFqdnHostnames-625887008-project Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 6a9c6f195e2a491097e771787e454a82 Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersTestFqdnHostnames-625887008-project Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 00dec699-50e1-4f85-9274-c8a2b115f13c could not be found. Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '00dec699-50e1-4f85-9274-c8a2b115f13c'} Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00dec699-50e1-4f85-9274-c8a2b115f13c could not be found. Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00dec699-50e1-4f85-9274-c8a2b115f13c could not be found. Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:37:05.103047 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:37:05.106847 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:37:05.106847 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:37:05.106847 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:37:05.106847 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:37:05.106847 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:37:05.106847 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00dec699-50e1-4f85-9274-c8a2b115f13c could not be found. Oct 10 23:37:05.106847 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:37:05.108863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-03dbe65c-9a5d-4727-b0c9-7e9b0ea3f3a6 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Returning 404 to user: Instance 00dec699-50e1-4f85-9274-c8a2b115f13c could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:37:05.114726 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-03dbe65c-9a5d-4727-b0c9-7e9b0ea3f3a6 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c" status: 404 len: 111 microversion: 2.1 time: 0.062347 Oct 10 23:37:05.115637 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2009/4121] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:05 2022] GET /compute/v2.1/servers/00dec699-50e1-4f85-9274-c8a2b115f13c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:37:05.124059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-458cb8a2-1503-420a-b005-3b9c32d25421 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] Calling method '.version_select at 0x7f662abed160>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:05.168107 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-458cb8a2-1503-420a-b005-3b9c32d25421 tempest-ServersTestFqdnHostnames-625887008 tempest-ServersTestFqdnHostnames-625887008-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1059753393" status: 202 len: 0 microversion: 2.1 time: 0.047428 Oct 10 23:37:05.170828 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2010/4122] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 10 23:37:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1059753393 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:37:05.801979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-ae9e7753-c324-40bf-b56d-f56f08a2b601 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Building network info cache for instance {{(pid=120613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 23:37:06.010261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-3a8723cb-ff3a-46a9-8e27-eded733d092e req-e0775c42-66e7-47a7-80a6-0778b94c3075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d", "tag": "0ca323c5-08ed-433b-892e-43a213787a79"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:37:06.044830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3a8723cb-ff3a-46a9-8e27-eded733d092e req-e0775c42-66e7-47a7-80a6-0778b94c3075 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:06.045631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3a8723cb-ff3a-46a9-8e27-eded733d092e req-e0775c42-66e7-47a7-80a6-0778b94c3075 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:06.046213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3a8723cb-ff3a-46a9-8e27-eded733d092e req-e0775c42-66e7-47a7-80a6-0778b94c3075 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:06.071782 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-3a8723cb-ff3a-46a9-8e27-eded733d092e req-e0775c42-66e7-47a7-80a6-0778b94c3075 service nova] Creating event network-changed:0ca323c5-08ed-433b-892e-43a213787a79 for instance 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d on n-h1-860864-2 Oct 10 23:37:06.090929 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-3a8723cb-ff3a-46a9-8e27-eded733d092e req-e0775c42-66e7-47a7-80a6-0778b94c3075 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227883 Oct 10 23:37:06.091699 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2011/4123] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:37:06.109323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f141b60c-a38f-4837-9b68-3f4e3d8d8762 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:06.113568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f141b60c-a38f-4837-9b68-3f4e3d8d8762 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:06.135996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f141b60c-a38f-4837-9b68-3f4e3d8d8762 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:06.138199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f141b60c-a38f-4837-9b68-3f4e3d8d8762 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:06.140452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f141b60c-a38f-4837-9b68-3f4e3d8d8762 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:06.141488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f141b60c-a38f-4837-9b68-3f4e3d8d8762 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:06.146457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f141b60c-a38f-4837-9b68-3f4e3d8d8762 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:06.147242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f141b60c-a38f-4837-9b68-3f4e3d8d8762 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:06.776985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-ae9e7753-c324-40bf-b56d-f56f08a2b601 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Updating instance_info_cache with network_info: [{"id": "0ca323c5-08ed-433b-892e-43a213787a79", "address": "fa:16:3e:ec:7b:6a", "network": {"id": "341e3e89-9f32-4889-8f79-fb51e702b8d6", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-665765847-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b94305235aa94d318fcfe2813e7948ba", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0ca323c5-08", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 23:37:06.797681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f141b60c-a38f-4837-9b68-3f4e3d8d8762 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:06.803887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae9e7753-c324-40bf-b56d-f56f08a2b601 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Releasing lock "refresh_cache-2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" {{(pid=120613) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 23:37:06.804754 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ae9e7753-c324-40bf-b56d-f56f08a2b601 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "POST /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d/action" status: 202 len: 0 microversion: 2.1 time: 5.826627 Oct 10 23:37:06.805368 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2113/4124] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:37:00 2022] POST /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d/action => generated 0 bytes in 5828 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 23:37:06.826428 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f141b60c-a38f-4837-9b68-3f4e3d8d8762 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7" status: 200 len: 1314 microversion: 2.1 time: 0.733329 Oct 10 23:37:06.830624 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2012/4125] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:06 2022] GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 => generated 1314 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:06.831653 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9050352a-8d50-4452-afeb-44668e484949 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.34"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:37:07.073743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9050352a-8d50-4452-afeb-44668e484949 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:07.082415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9050352a-8d50-4452-afeb-44668e484949 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:07.083187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9050352a-8d50-4452-afeb-44668e484949 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:07.084371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9050352a-8d50-4452-afeb-44668e484949 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:07.085280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9050352a-8d50-4452-afeb-44668e484949 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:07.085941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9050352a-8d50-4452-afeb-44668e484949 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:07.087383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9050352a-8d50-4452-afeb-44668e484949 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:07.457362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9050352a-8d50-4452-afeb-44668e484949 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "refresh_cache-2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" {{(pid=120613) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 23:37:07.458309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9050352a-8d50-4452-afeb-44668e484949 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquired lock "refresh_cache-2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" {{(pid=120613) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 23:37:07.803599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d09fd4f4-f1d1-4b27-8e41-fed5c6661b75 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:37:07.804501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d09fd4f4-f1d1-4b27-8e41-fed5c6661b75 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:07.824806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d09fd4f4-f1d1-4b27-8e41-fed5c6661b75 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:07.825602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d09fd4f4-f1d1-4b27-8e41-fed5c6661b75 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:07.826193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d09fd4f4-f1d1-4b27-8e41-fed5c6661b75 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:07.829479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d09fd4f4-f1d1-4b27-8e41-fed5c6661b75 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:07.830930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d09fd4f4-f1d1-4b27-8e41-fed5c6661b75 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:07.831865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d09fd4f4-f1d1-4b27-8e41-fed5c6661b75 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:07.896598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-d09fd4f4-f1d1-4b27-8e41-fed5c6661b75 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lazy-loading 'flavor' on Instance uuid 81f5c98e-777a-4d5b-aed5-89fd026f1734 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:37:08.056304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=97,nova_cell1:UPDATE=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:37:08.401401 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d09fd4f4-f1d1-4b27-8e41-fed5c6661b75 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "POST /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734/action" status: 202 len: 0 microversion: 2.20 time: 0.602104 Oct 10 23:37:08.406075 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2013/4126] 10.222.0.23 () {62 vars in 1319 bytes} [Mon Oct 10 23:37:07 2022] POST /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:37:08.422166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-838179b8-d9f4-448d-b0e6-36ff255bf0fa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:08.437525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-838179b8-d9f4-448d-b0e6-36ff255bf0fa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:08.478274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-838179b8-d9f4-448d-b0e6-36ff255bf0fa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:08.478945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-838179b8-d9f4-448d-b0e6-36ff255bf0fa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:08.479410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-838179b8-d9f4-448d-b0e6-36ff255bf0fa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:08.480262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-838179b8-d9f4-448d-b0e6-36ff255bf0fa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:08.480731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-838179b8-d9f4-448d-b0e6-36ff255bf0fa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:08.481204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-838179b8-d9f4-448d-b0e6-36ff255bf0fa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:09.201844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-838179b8-d9f4-448d-b0e6-36ff255bf0fa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:09.211128 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-838179b8-d9f4-448d-b0e6-36ff255bf0fa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7" status: 200 len: 1314 microversion: 2.1 time: 0.803670 Oct 10 23:37:09.215197 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2014/4127] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:08 2022] GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 => generated 1314 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:09.221029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ab8ed332-dd25-4d76-bf91-ef7f7b9882c1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:09.221843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ab8ed332-dd25-4d76-bf91-ef7f7b9882c1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:09.242416 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab8ed332-dd25-4d76-bf91-ef7f7b9882c1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:09.246859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab8ed332-dd25-4d76-bf91-ef7f7b9882c1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:09.247503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab8ed332-dd25-4d76-bf91-ef7f7b9882c1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:09.248403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab8ed332-dd25-4d76-bf91-ef7f7b9882c1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:09.249011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab8ed332-dd25-4d76-bf91-ef7f7b9882c1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:09.250734 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab8ed332-dd25-4d76-bf91-ef7f7b9882c1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:09.564074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ab8ed332-dd25-4d76-bf91-ef7f7b9882c1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:09.574151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ab8ed332-dd25-4d76-bf91-ef7f7b9882c1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:09.591315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ab8ed332-dd25-4d76-bf91-ef7f7b9882c1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:09.592756 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ab8ed332-dd25-4d76-bf91-ef7f7b9882c1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1725 microversion: 2.20 time: 0.376376 Oct 10 23:37:09.594011 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2015/4128] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:09 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1725 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:37:09.598981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-892e35cc-f183-4fa6-9b56-8e11db58d1ae req-19de2145-3b58-454b-afb8-868d927c4c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cef2e8cb-d283-45de-8e1d-d957f72ac8b7", "name": "network-vif-plugged", "status": "completed", "tag": "3c8ac517-3ea4-4d79-9a7e-20ab787b5542"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:37:09.615552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-892e35cc-f183-4fa6-9b56-8e11db58d1ae req-19de2145-3b58-454b-afb8-868d927c4c12 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:09.616366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-892e35cc-f183-4fa6-9b56-8e11db58d1ae req-19de2145-3b58-454b-afb8-868d927c4c12 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:09.619044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-892e35cc-f183-4fa6-9b56-8e11db58d1ae req-19de2145-3b58-454b-afb8-868d927c4c12 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:09.645694 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-892e35cc-f183-4fa6-9b56-8e11db58d1ae req-19de2145-3b58-454b-afb8-868d927c4c12 service nova] Creating event network-vif-plugged:3c8ac517-3ea4-4d79-9a7e-20ab787b5542 for instance cef2e8cb-d283-45de-8e1d-d957f72ac8b7 on n-h2-860864-2 Oct 10 23:37:09.657139 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-892e35cc-f183-4fa6-9b56-8e11db58d1ae req-19de2145-3b58-454b-afb8-868d927c4c12 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061722 Oct 10 23:37:09.658547 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2016/4129] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:37:10.083637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-9050352a-8d50-4452-afeb-44668e484949 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Building network info cache for instance {{(pid=120613) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 23:37:10.092574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-6fa81e00-2fc1-4756-aee2-fffafee4dae5 req-ee90858a-bf9a-44b9-9ae6-de0febde8929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d", "tag": "0ca323c5-08ed-433b-892e-43a213787a79"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:37:10.112827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6fa81e00-2fc1-4756-aee2-fffafee4dae5 req-ee90858a-bf9a-44b9-9ae6-de0febde8929 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:10.114272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6fa81e00-2fc1-4756-aee2-fffafee4dae5 req-ee90858a-bf9a-44b9-9ae6-de0febde8929 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:10.114808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6fa81e00-2fc1-4756-aee2-fffafee4dae5 req-ee90858a-bf9a-44b9-9ae6-de0febde8929 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:10.137180 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-6fa81e00-2fc1-4756-aee2-fffafee4dae5 req-ee90858a-bf9a-44b9-9ae6-de0febde8929 service nova] Creating event network-changed:0ca323c5-08ed-433b-892e-43a213787a79 for instance 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d on n-h1-860864-2 Oct 10 23:37:10.152602 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-6fa81e00-2fc1-4756-aee2-fffafee4dae5 req-ee90858a-bf9a-44b9-9ae6-de0febde8929 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055193 Oct 10 23:37:10.155870 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2017/4130] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:37:10.238369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-75b68ab8-2a25-449c-8984-8da5c9659728 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:10.240419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-75b68ab8-2a25-449c-8984-8da5c9659728 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:10.249611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75b68ab8-2a25-449c-8984-8da5c9659728 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:10.250401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75b68ab8-2a25-449c-8984-8da5c9659728 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:10.251616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75b68ab8-2a25-449c-8984-8da5c9659728 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:10.253658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75b68ab8-2a25-449c-8984-8da5c9659728 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:10.254300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75b68ab8-2a25-449c-8984-8da5c9659728 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:10.255365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75b68ab8-2a25-449c-8984-8da5c9659728 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:10.771638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-75b68ab8-2a25-449c-8984-8da5c9659728 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:10.783418 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-75b68ab8-2a25-449c-8984-8da5c9659728 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7" status: 200 len: 1314 microversion: 2.1 time: 0.550518 Oct 10 23:37:10.784050 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2018/4131] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:10 2022] GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:37:10.799058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5ac56151-eeb5-413a-b917-55df02141650 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:10.800235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5ac56151-eeb5-413a-b917-55df02141650 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:10.811625 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ac56151-eeb5-413a-b917-55df02141650 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:10.817651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ac56151-eeb5-413a-b917-55df02141650 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:10.820494 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ac56151-eeb5-413a-b917-55df02141650 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:10.821276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ac56151-eeb5-413a-b917-55df02141650 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:10.821783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ac56151-eeb5-413a-b917-55df02141650 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:10.822215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ac56151-eeb5-413a-b917-55df02141650 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:11.795834 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5ac56151-eeb5-413a-b917-55df02141650 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:11.802204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-9050352a-8d50-4452-afeb-44668e484949 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Updating instance_info_cache with network_info: [{"id": "0ca323c5-08ed-433b-892e-43a213787a79", "address": "fa:16:3e:ec:7b:6a", "network": {"id": "341e3e89-9f32-4889-8f79-fb51e702b8d6", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-665765847-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b94305235aa94d318fcfe2813e7948ba", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0ca323c5-08", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 23:37:11.825965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5ac56151-eeb5-413a-b917-55df02141650 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:11.828043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5ac56151-eeb5-413a-b917-55df02141650 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:11.830118 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5ac56151-eeb5-413a-b917-55df02141650 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1725 microversion: 2.20 time: 1.043617 Oct 10 23:37:11.835036 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2019/4132] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:10 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1725 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:37:11.842773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-97fffbf9-58fe-4dc3-9230-ceccf01e5e7a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:11.847485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-97fffbf9-58fe-4dc3-9230-ceccf01e5e7a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:11.851828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9050352a-8d50-4452-afeb-44668e484949 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Releasing lock "refresh_cache-2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" {{(pid=120613) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 23:37:11.853351 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9050352a-8d50-4452-afeb-44668e484949 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "POST /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d/action" status: 202 len: 0 microversion: 2.1 time: 5.040692 Oct 10 23:37:11.859446 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2114/4133] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:37:06 2022] POST /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d/action => generated 0 bytes in 5043 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 23:37:11.872133 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97fffbf9-58fe-4dc3-9230-ceccf01e5e7a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:11.874509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97fffbf9-58fe-4dc3-9230-ceccf01e5e7a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:11.875794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97fffbf9-58fe-4dc3-9230-ceccf01e5e7a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:11.877872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97fffbf9-58fe-4dc3-9230-ceccf01e5e7a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:11.880247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97fffbf9-58fe-4dc3-9230-ceccf01e5e7a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:11.880960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-97fffbf9-58fe-4dc3-9230-ceccf01e5e7a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:11.887626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-58adcc77-715e-449e-81cf-957461662857 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '.version_select at 0x7f662b94b280>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:12.325631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-97fffbf9-58fe-4dc3-9230-ceccf01e5e7a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:12.335371 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-97fffbf9-58fe-4dc3-9230-ceccf01e5e7a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7" status: 200 len: 1501 microversion: 2.1 time: 0.498369 Oct 10 23:37:12.342261 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2020/4134] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:11 2022] GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 => generated 1501 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:12.372390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9dd0ef3c-ae92-4bc5-bd8e-2f845defbd1e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:37:12.372935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9dd0ef3c-ae92-4bc5-bd8e-2f845defbd1e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:12.383779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9dd0ef3c-ae92-4bc5-bd8e-2f845defbd1e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:12.384288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9dd0ef3c-ae92-4bc5-bd8e-2f845defbd1e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:12.384730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9dd0ef3c-ae92-4bc5-bd8e-2f845defbd1e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:12.385492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9dd0ef3c-ae92-4bc5-bd8e-2f845defbd1e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:12.385956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9dd0ef3c-ae92-4bc5-bd8e-2f845defbd1e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:12.386389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9dd0ef3c-ae92-4bc5-bd8e-2f845defbd1e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:12.545958 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9dd0ef3c-ae92-4bc5-bd8e-2f845defbd1e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "POST /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7/action" status: 202 len: 0 microversion: 2.1 time: 0.172926 Oct 10 23:37:12.547167 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2021/4135] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:37:12 2022] POST /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:37:12.561733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5f957649-3863-4fca-86b9-b2e34105e4ad tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:12.563068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5f957649-3863-4fca-86b9-b2e34105e4ad tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:12.579654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f957649-3863-4fca-86b9-b2e34105e4ad tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:12.580176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f957649-3863-4fca-86b9-b2e34105e4ad tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:12.580677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f957649-3863-4fca-86b9-b2e34105e4ad tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:12.581608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f957649-3863-4fca-86b9-b2e34105e4ad tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:12.581954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f957649-3863-4fca-86b9-b2e34105e4ad tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:12.582406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f957649-3863-4fca-86b9-b2e34105e4ad tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:13.589828 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-58adcc77-715e-449e-81cf-957461662857 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/4c22f2ef-f133-4853-b7d5-7b1af7c43a51" status: 202 len: 0 microversion: 2.1 time: 1.717960 Oct 10 23:37:13.595974 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2115/4136] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 10 23:37:11 2022] DELETE /compute/v2.1/os-floating-ips/4c22f2ef-f133-4853-b7d5-7b1af7c43a51 => generated 0 bytes in 1737 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:37:13.603316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-99ff5923-c98d-42d9-bffe-3468851addf5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:13.604656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-99ff5923-c98d-42d9-bffe-3468851addf5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:13.619364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99ff5923-c98d-42d9-bffe-3468851addf5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:13.622316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99ff5923-c98d-42d9-bffe-3468851addf5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:13.623023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99ff5923-c98d-42d9-bffe-3468851addf5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:13.624464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99ff5923-c98d-42d9-bffe-3468851addf5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:13.625230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99ff5923-c98d-42d9-bffe-3468851addf5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:13.626128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99ff5923-c98d-42d9-bffe-3468851addf5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:13.726837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5f957649-3863-4fca-86b9-b2e34105e4ad tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:13.742437 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5f957649-3863-4fca-86b9-b2e34105e4ad tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7" status: 200 len: 1506 microversion: 2.1 time: 1.188123 Oct 10 23:37:13.743670 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2022/4137] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:12 2022] GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 => generated 1506 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:13.756624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-229d17bd-629a-42f3-8544-31c99352c95d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '.version_select at 0x7f662b764e50>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:13.830131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-99ff5923-c98d-42d9-bffe-3468851addf5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:13.840399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-99ff5923-c98d-42d9-bffe-3468851addf5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:13.842010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-99ff5923-c98d-42d9-bffe-3468851addf5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:13.843335 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-99ff5923-c98d-42d9-bffe-3468851addf5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1725 microversion: 2.20 time: 0.245582 Oct 10 23:37:13.844294 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2116/4138] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:13 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1725 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:37:14.550531 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-229d17bd-629a-42f3-8544-31c99352c95d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/b8a58296-2de9-4f36-b641-5ca464c73e34" status: 202 len: 0 microversion: 2.1 time: 0.805535 Oct 10 23:37:14.551682 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2023/4139] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:37:13 2022] DELETE /compute/v2.1/os-security-groups/b8a58296-2de9-4f36-b641-5ca464c73e34 => generated 0 bytes in 807 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:37:14.560816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b3856338-bb24-44fa-97e4-3e8bed35a647 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:14.561348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b3856338-bb24-44fa-97e4-3e8bed35a647 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:14.563241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=44 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:37:14.572889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3856338-bb24-44fa-97e4-3e8bed35a647 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:14.572889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3856338-bb24-44fa-97e4-3e8bed35a647 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:14.572889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3856338-bb24-44fa-97e4-3e8bed35a647 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:14.573665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3856338-bb24-44fa-97e4-3e8bed35a647 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:14.574313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3856338-bb24-44fa-97e4-3e8bed35a647 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:14.574874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3856338-bb24-44fa-97e4-3e8bed35a647 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:14.609716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b3856338-bb24-44fa-97e4-3e8bed35a647 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:37:14.718727 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b3856338-bb24-44fa-97e4-3e8bed35a647 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 204 len: 0 microversion: 2.1 time: 0.161622 Oct 10 23:37:14.719618 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2117/4140] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:37:14 2022] DELETE /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:37:14.742953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-36b721d5-4027-4188-88fd-c24f7ee080ff tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:14.744246 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-36b721d5-4027-4188-88fd-c24f7ee080ff tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:14.773046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36b721d5-4027-4188-88fd-c24f7ee080ff tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:14.775032 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36b721d5-4027-4188-88fd-c24f7ee080ff tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:14.779447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36b721d5-4027-4188-88fd-c24f7ee080ff tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:14.780922 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36b721d5-4027-4188-88fd-c24f7ee080ff tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:14.781832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36b721d5-4027-4188-88fd-c24f7ee080ff tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:14.782735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36b721d5-4027-4188-88fd-c24f7ee080ff tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:14.786691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-669c78c4-afa2-43cd-b080-101b38d73459 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:14.789703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-669c78c4-afa2-43cd-b080-101b38d73459 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:14.796949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-669c78c4-afa2-43cd-b080-101b38d73459 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:14.798313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-669c78c4-afa2-43cd-b080-101b38d73459 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:14.798730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-669c78c4-afa2-43cd-b080-101b38d73459 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:14.800052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-669c78c4-afa2-43cd-b080-101b38d73459 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:14.801555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-669c78c4-afa2-43cd-b080-101b38d73459 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:14.802443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-669c78c4-afa2-43cd-b080-101b38d73459 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:14.811196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:37:15.033791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-669c78c4-afa2-43cd-b080-101b38d73459 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:15.055212 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-669c78c4-afa2-43cd-b080-101b38d73459 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7" status: 200 len: 1486 microversion: 2.1 time: 0.289109 Oct 10 23:37:15.056314 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2118/4141] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:14 2022] GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 => generated 1486 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:15.066251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9e64dc37-41d0-4313-8df0-580ea8437baa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:15.068552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9e64dc37-41d0-4313-8df0-580ea8437baa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:15.082464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e64dc37-41d0-4313-8df0-580ea8437baa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:15.083679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e64dc37-41d0-4313-8df0-580ea8437baa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:15.085100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e64dc37-41d0-4313-8df0-580ea8437baa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:15.086676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e64dc37-41d0-4313-8df0-580ea8437baa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:15.087528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e64dc37-41d0-4313-8df0-580ea8437baa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:15.088326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e64dc37-41d0-4313-8df0-580ea8437baa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:15.278380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9e64dc37-41d0-4313-8df0-580ea8437baa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:15.292789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9e64dc37-41d0-4313-8df0-580ea8437baa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:15.294628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9e64dc37-41d0-4313-8df0-580ea8437baa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:15.296063 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9e64dc37-41d0-4313-8df0-580ea8437baa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1725 microversion: 2.20 time: 0.237860 Oct 10 23:37:15.300794 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2119/4142] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:15 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1725 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:37:15.303426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b1259fe8-17e9-4ae7-8069-e125fc98b15a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:15.303990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b1259fe8-17e9-4ae7-8069-e125fc98b15a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:15.311837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1259fe8-17e9-4ae7-8069-e125fc98b15a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:15.312596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1259fe8-17e9-4ae7-8069-e125fc98b15a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:15.313216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1259fe8-17e9-4ae7-8069-e125fc98b15a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:15.314688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1259fe8-17e9-4ae7-8069-e125fc98b15a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:15.315279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1259fe8-17e9-4ae7-8069-e125fc98b15a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:15.315816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1259fe8-17e9-4ae7-8069-e125fc98b15a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:15.383439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b1259fe8-17e9-4ae7-8069-e125fc98b15a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:37:15.511829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-36b721d5-4027-4188-88fd-c24f7ee080ff tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:15.556461 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-36b721d5-4027-4188-88fd-c24f7ee080ff tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1510 microversion: 2.1 time: 0.831094 Oct 10 23:37:15.557410 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2024/4143] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:14 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1510 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:37:15.632158 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b1259fe8-17e9-4ae7-8069-e125fc98b15a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7" status: 204 len: 0 microversion: 2.1 time: 0.332567 Oct 10 23:37:15.633338 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2120/4144] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:37:15 2022] DELETE /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:37:15.652018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-794eda4c-58bb-4564-866f-6762a7312778 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:15.653043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-794eda4c-58bb-4564-866f-6762a7312778 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:15.672925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-794eda4c-58bb-4564-866f-6762a7312778 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:15.674017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-794eda4c-58bb-4564-866f-6762a7312778 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:15.674793 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-794eda4c-58bb-4564-866f-6762a7312778 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:15.676057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-794eda4c-58bb-4564-866f-6762a7312778 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:15.676861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-794eda4c-58bb-4564-866f-6762a7312778 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:15.677884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-794eda4c-58bb-4564-866f-6762a7312778 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:16.098349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-794eda4c-58bb-4564-866f-6762a7312778 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:16.115290 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-794eda4c-58bb-4564-866f-6762a7312778 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7" status: 200 len: 1492 microversion: 2.1 time: 0.474818 Oct 10 23:37:16.116892 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2025/4145] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:15 2022] GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 => generated 1492 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:16.338316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d28b718d-dd6e-4aab-b489-1d6c8371e975 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:16.339290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d28b718d-dd6e-4aab-b489-1d6c8371e975 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:16.352714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d28b718d-dd6e-4aab-b489-1d6c8371e975 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:16.353420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d28b718d-dd6e-4aab-b489-1d6c8371e975 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:16.354041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d28b718d-dd6e-4aab-b489-1d6c8371e975 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:16.355161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d28b718d-dd6e-4aab-b489-1d6c8371e975 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:16.355987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d28b718d-dd6e-4aab-b489-1d6c8371e975 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:16.356984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d28b718d-dd6e-4aab-b489-1d6c8371e975 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:16.597597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-26b07628-08d9-4075-a99d-0708a5018a6a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:16.598505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-26b07628-08d9-4075-a99d-0708a5018a6a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:16.622042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26b07628-08d9-4075-a99d-0708a5018a6a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:16.630257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26b07628-08d9-4075-a99d-0708a5018a6a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:16.631643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26b07628-08d9-4075-a99d-0708a5018a6a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:16.633265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26b07628-08d9-4075-a99d-0708a5018a6a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:16.634428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26b07628-08d9-4075-a99d-0708a5018a6a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:16.635421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26b07628-08d9-4075-a99d-0708a5018a6a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:16.649782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d28b718d-dd6e-4aab-b489-1d6c8371e975 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:16.662942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d28b718d-dd6e-4aab-b489-1d6c8371e975 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:16.664884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d28b718d-dd6e-4aab-b489-1d6c8371e975 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:16.667094 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d28b718d-dd6e-4aab-b489-1d6c8371e975 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1725 microversion: 2.20 time: 0.334653 Oct 10 23:37:16.668487 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2121/4146] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:16 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1725 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:37:17.130186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-26b07628-08d9-4075-a99d-0708a5018a6a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:17.146696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6ab21efa-d53f-41bd-a0d5-8e4296c12362 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:17.147584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6ab21efa-d53f-41bd-a0d5-8e4296c12362 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:17.149607 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-26b07628-08d9-4075-a99d-0708a5018a6a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1510 microversion: 2.1 time: 0.571154 Oct 10 23:37:17.151523 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2026/4147] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:16 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1510 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:37:17.160802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ab21efa-d53f-41bd-a0d5-8e4296c12362 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:17.166083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ab21efa-d53f-41bd-a0d5-8e4296c12362 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:17.168795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ab21efa-d53f-41bd-a0d5-8e4296c12362 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:17.170990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ab21efa-d53f-41bd-a0d5-8e4296c12362 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:17.172068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ab21efa-d53f-41bd-a0d5-8e4296c12362 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:17.173932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ab21efa-d53f-41bd-a0d5-8e4296c12362 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:17.703190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-472dcb49-f680-4af6-9669-51b005c91269 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:17.706446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-472dcb49-f680-4af6-9669-51b005c91269 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:17.731757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-472dcb49-f680-4af6-9669-51b005c91269 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:17.732545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-472dcb49-f680-4af6-9669-51b005c91269 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:17.734375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-472dcb49-f680-4af6-9669-51b005c91269 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:17.736994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-472dcb49-f680-4af6-9669-51b005c91269 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:17.742356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6ab21efa-d53f-41bd-a0d5-8e4296c12362 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:17.751664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-472dcb49-f680-4af6-9669-51b005c91269 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:17.753038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-472dcb49-f680-4af6-9669-51b005c91269 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:17.767336 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6ab21efa-d53f-41bd-a0d5-8e4296c12362 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7" status: 200 len: 1492 microversion: 2.1 time: 0.620452 Oct 10 23:37:17.768003 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2122/4148] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:17 2022] GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 => generated 1492 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:37:18.180473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-485ccd49-8e98-4853-8113-91ee7e106054 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:18.181347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-485ccd49-8e98-4853-8113-91ee7e106054 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:18.196430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-485ccd49-8e98-4853-8113-91ee7e106054 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:18.197762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-485ccd49-8e98-4853-8113-91ee7e106054 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:18.198727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-485ccd49-8e98-4853-8113-91ee7e106054 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:18.200738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-485ccd49-8e98-4853-8113-91ee7e106054 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:18.201876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-485ccd49-8e98-4853-8113-91ee7e106054 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:18.203001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-485ccd49-8e98-4853-8113-91ee7e106054 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:18.422066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-485ccd49-8e98-4853-8113-91ee7e106054 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:18.432601 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-485ccd49-8e98-4853-8113-91ee7e106054 tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1510 microversion: 2.1 time: 0.259248 Oct 10 23:37:18.434093 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2123/4149] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:18 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1510 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:18.808893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8691bf1d-4106-4f56-a85d-a0b3150d0fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:18.819241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8691bf1d-4106-4f56-a85d-a0b3150d0fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:18.839105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8691bf1d-4106-4f56-a85d-a0b3150d0fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:18.839724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8691bf1d-4106-4f56-a85d-a0b3150d0fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:18.841182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8691bf1d-4106-4f56-a85d-a0b3150d0fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:18.841977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8691bf1d-4106-4f56-a85d-a0b3150d0fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:18.842553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8691bf1d-4106-4f56-a85d-a0b3150d0fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:18.843087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8691bf1d-4106-4f56-a85d-a0b3150d0fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:18.916486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-472dcb49-f680-4af6-9669-51b005c91269 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:18.934161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-472dcb49-f680-4af6-9669-51b005c91269 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:18.936199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-472dcb49-f680-4af6-9669-51b005c91269 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:18.941938 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-472dcb49-f680-4af6-9669-51b005c91269 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1725 microversion: 2.20 time: 1.243837 Oct 10 23:37:18.944189 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2027/4150] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:17 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1725 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:37:19.375082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8691bf1d-4106-4f56-a85d-a0b3150d0fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:19.394935 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8691bf1d-4106-4f56-a85d-a0b3150d0fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7" status: 200 len: 1492 microversion: 2.1 time: 0.591342 Oct 10 23:37:19.412814 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2124/4151] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:18 2022] GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 => generated 1492 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:37:19.475459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ed281e3b-1041-46a6-bf0e-4cc5427c553a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:19.476189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ed281e3b-1041-46a6-bf0e-4cc5427c553a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:19.490534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed281e3b-1041-46a6-bf0e-4cc5427c553a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:19.491303 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed281e3b-1041-46a6-bf0e-4cc5427c553a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:19.491897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed281e3b-1041-46a6-bf0e-4cc5427c553a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:19.492786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed281e3b-1041-46a6-bf0e-4cc5427c553a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:19.493477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed281e3b-1041-46a6-bf0e-4cc5427c553a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:19.494054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed281e3b-1041-46a6-bf0e-4cc5427c553a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:19.684198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ed281e3b-1041-46a6-bf0e-4cc5427c553a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663f0305b525435eb3df4f1d2184eccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94305235aa94d318fcfe2813e7948ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:19.710042 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ed281e3b-1041-46a6-bf0e-4cc5427c553a tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 200 len: 1468 microversion: 2.1 time: 0.242638 Oct 10 23:37:19.711477 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2028/4152] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:19 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 1468 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:19.986149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4c892903-53d4-4da0-833d-c6ca87c631b0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:19.987742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4c892903-53d4-4da0-833d-c6ca87c631b0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:20.011093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c892903-53d4-4da0-833d-c6ca87c631b0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:20.012113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c892903-53d4-4da0-833d-c6ca87c631b0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:20.013011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c892903-53d4-4da0-833d-c6ca87c631b0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:20.014430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c892903-53d4-4da0-833d-c6ca87c631b0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:20.015377 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c892903-53d4-4da0-833d-c6ca87c631b0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:20.018799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c892903-53d4-4da0-833d-c6ca87c631b0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:20.106262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-b8bc23a9-148d-4f7a-b662-0bda1e74f5a2 req-c957676c-d1b6-4bfe-b107-1ae4e0e5a79d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cef2e8cb-d283-45de-8e1d-d957f72ac8b7", "name": "network-vif-deleted", "tag": "3c8ac517-3ea4-4d79-9a7e-20ab787b5542"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:37:20.160746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b8bc23a9-148d-4f7a-b662-0bda1e74f5a2 req-c957676c-d1b6-4bfe-b107-1ae4e0e5a79d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:20.162781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b8bc23a9-148d-4f7a-b662-0bda1e74f5a2 req-c957676c-d1b6-4bfe-b107-1ae4e0e5a79d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:20.163919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b8bc23a9-148d-4f7a-b662-0bda1e74f5a2 req-c957676c-d1b6-4bfe-b107-1ae4e0e5a79d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:20.206937 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-b8bc23a9-148d-4f7a-b662-0bda1e74f5a2 req-c957676c-d1b6-4bfe-b107-1ae4e0e5a79d service nova] Creating event network-vif-deleted:3c8ac517-3ea4-4d79-9a7e-20ab787b5542 for instance cef2e8cb-d283-45de-8e1d-d957f72ac8b7 on n-h2-860864-2 Oct 10 23:37:20.221969 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-b8bc23a9-148d-4f7a-b662-0bda1e74f5a2 req-c957676c-d1b6-4bfe-b107-1ae4e0e5a79d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.476738 Oct 10 23:37:20.225054 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2125/4153] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:37:20.427631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-138922c3-6f63-4ea5-860e-0ab5c8a19638 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:20.432129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-138922c3-6f63-4ea5-860e-0ab5c8a19638 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:20.456557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-138922c3-6f63-4ea5-860e-0ab5c8a19638 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:20.457034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-138922c3-6f63-4ea5-860e-0ab5c8a19638 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:20.461631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-138922c3-6f63-4ea5-860e-0ab5c8a19638 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:20.463204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-138922c3-6f63-4ea5-860e-0ab5c8a19638 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:20.464009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-138922c3-6f63-4ea5-860e-0ab5c8a19638 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:20.464734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-138922c3-6f63-4ea5-860e-0ab5c8a19638 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:20.577260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-138922c3-6f63-4ea5-860e-0ab5c8a19638 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:20.577780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-138922c3-6f63-4ea5-860e-0ab5c8a19638 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:20.578216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-138922c3-6f63-4ea5-860e-0ab5c8a19638 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:20.578813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-138922c3-6f63-4ea5-860e-0ab5c8a19638 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lazy-loading 'fault' on Instance uuid cef2e8cb-d283-45de-8e1d-d957f72ac8b7 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:37:20.627778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4c892903-53d4-4da0-833d-c6ca87c631b0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:20.662228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4c892903-53d4-4da0-833d-c6ca87c631b0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:20.664201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4c892903-53d4-4da0-833d-c6ca87c631b0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:20.677146 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4c892903-53d4-4da0-833d-c6ca87c631b0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1725 microversion: 2.20 time: 0.685926 Oct 10 23:37:20.678113 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2029/4154] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:19 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1725 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:37:20.741607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e49268e9-be8b-4216-9650-1dc44137b55d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:20.742709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e49268e9-be8b-4216-9650-1dc44137b55d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] [instance: 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:20.749890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e49268e9-be8b-4216-9650-1dc44137b55d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:20.758332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e49268e9-be8b-4216-9650-1dc44137b55d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:20.758898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e49268e9-be8b-4216-9650-1dc44137b55d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:20.759655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e49268e9-be8b-4216-9650-1dc44137b55d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:20.760120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e49268e9-be8b-4216-9650-1dc44137b55d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:20.760710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e49268e9-be8b-4216-9650-1dc44137b55d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:20.820369 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-e49268e9-be8b-4216-9650-1dc44137b55d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] HTTP exception thrown: Instance 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d could not be found. Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e49268e9-be8b-4216-9650-1dc44137b55d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Request method failure captured: Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d HTTP/1.1 Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKxeTdbTsSUKzPBhWiNDvFgu7hWJuxbgyvwh8ffxKH2NXQ1muI-YRr8vt2QY0G6Vpro1qUwOkFWv_USQelT0YtccvJOX_5EQ8BEfG63bx9aU67BoaBJODsPCSeka6QTaMnbitrvWRX8hlOp96mqGukspwMX5ailos8xraKT9WRQVpGU Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: b94305235aa94d318fcfe2813e7948ba Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-2026284047 Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b94305235aa94d318fcfe2813e7948ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b94305235aa94d318fcfe2813e7948ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b94305235aa94d318fcfe2813e7948ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b94305235aa94d318fcfe2813e7948ba", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-2026284047 Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: b94305235aa94d318fcfe2813e7948ba Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-2026284047 Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerRescueTestJSONUnderV235-2026284047-project Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 663f0305b525435eb3df4f1d2184eccc Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-2026284047-project Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d could not be found. Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d'} Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d could not be found. Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d could not be found. Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:37:20.842512 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:37:20.849191 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:37:20.849191 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:37:20.849191 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:37:20.849191 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:37:20.849191 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:37:20.849191 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:37:20.849191 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d could not be found. Oct 10 23:37:20.849191 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:37:20.849191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e49268e9-be8b-4216-9650-1dc44137b55d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] Returning 404 to user: Instance 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:37:20.849191 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e49268e9-be8b-4216-9650-1dc44137b55d tempest-ServerRescueTestJSONUnderV235-2026284047 tempest-ServerRescueTestJSONUnderV235-2026284047-project] 10.222.0.23 "GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d" status: 404 len: 111 microversion: 2.1 time: 0.111139 Oct 10 23:37:20.860742 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2030/4155] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:20 2022] GET /compute/v2.1/servers/2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:37:21.088464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-138922c3-6f63-4ea5-860e-0ab5c8a19638 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:21.104133 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-138922c3-6f63-4ea5-860e-0ab5c8a19638 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7" status: 200 len: 1304 microversion: 2.1 time: 0.687279 Oct 10 23:37:21.105516 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2126/4156] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:20 2022] GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 => generated 1304 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:21.711237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8daa0f26-978c-443d-aea9-a4ca7a192dc1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:21.712001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8daa0f26-978c-443d-aea9-a4ca7a192dc1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:21.730550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8daa0f26-978c-443d-aea9-a4ca7a192dc1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:21.731074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8daa0f26-978c-443d-aea9-a4ca7a192dc1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:21.731543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8daa0f26-978c-443d-aea9-a4ca7a192dc1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:21.732554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8daa0f26-978c-443d-aea9-a4ca7a192dc1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:21.733077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8daa0f26-978c-443d-aea9-a4ca7a192dc1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:21.733840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8daa0f26-978c-443d-aea9-a4ca7a192dc1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:22.150818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a5c47514-47ac-496e-b83b-551c3542e136 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:22.152606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a5c47514-47ac-496e-b83b-551c3542e136 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:22.169977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5c47514-47ac-496e-b83b-551c3542e136 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:22.170885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5c47514-47ac-496e-b83b-551c3542e136 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:22.171512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5c47514-47ac-496e-b83b-551c3542e136 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:22.173605 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5c47514-47ac-496e-b83b-551c3542e136 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:22.175493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5c47514-47ac-496e-b83b-551c3542e136 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:22.176346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5c47514-47ac-496e-b83b-551c3542e136 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:22.200709 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-a5c47514-47ac-496e-b83b-551c3542e136 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] HTTP exception thrown: Instance cef2e8cb-d283-45de-8e1d-d957f72ac8b7 could not be found. Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a5c47514-47ac-496e-b83b-551c3542e136 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Request method failure captured: Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 HTTP/1.1 Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKw8hCLXWIFTJ3HaJf5ifgl6Pm7vGD8ptwfQXuGQAkf1M-RWSvV8nlygpWidDM338TQR6cXdzFUy8zgn8XWf4EUtX06mIecSablgYBXm9sJQ78u324dyYAXvHBKQ5Ge8XY02Fdf2X0InpWnugNSR9M1ccFMQnfZYNbqSwCmT2w9EOBY Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d42cb00f2544abbde09cae76f3e3a1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-DeleteServersTestJSON-837712631 Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 7cc066774b344a24a91fb41e990f5234 Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance cef2e8cb-d283-45de-8e1d-d957f72ac8b7 could not be found. Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'cef2e8cb-d283-45de-8e1d-d957f72ac8b7'} Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cef2e8cb-d283-45de-8e1d-d957f72ac8b7 could not be found. Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cef2e8cb-d283-45de-8e1d-d957f72ac8b7 could not be found. Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:37:22.204955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:37:22.210039 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:37:22.210039 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:37:22.210039 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:37:22.210039 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:37:22.210039 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:37:22.210039 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cef2e8cb-d283-45de-8e1d-d957f72ac8b7 could not be found. Oct 10 23:37:22.210039 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:37:22.212816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a5c47514-47ac-496e-b83b-551c3542e136 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Returning 404 to user: Instance cef2e8cb-d283-45de-8e1d-d957f72ac8b7 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:37:22.214164 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a5c47514-47ac-496e-b83b-551c3542e136 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7" status: 404 len: 111 microversion: 2.1 time: 0.069640 Oct 10 23:37:22.215731 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2127/4157] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:22 2022] GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:37:22.239831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8daa0f26-978c-443d-aea9-a4ca7a192dc1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:22.259718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8daa0f26-978c-443d-aea9-a4ca7a192dc1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:22.261450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8daa0f26-978c-443d-aea9-a4ca7a192dc1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:22.262850 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8daa0f26-978c-443d-aea9-a4ca7a192dc1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1725 microversion: 2.20 time: 0.556858 Oct 10 23:37:22.281560 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2031/4158] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:21 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1725 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:37:22.395636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-32e7a171-13af-4079-b692-06d32e8cffa9 req-50993d2a-ae69-4a9b-860b-4bffb41baf09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d", "name": "network-vif-deleted", "tag": "0ca323c5-08ed-433b-892e-43a213787a79"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:37:22.411156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-32e7a171-13af-4079-b692-06d32e8cffa9 req-50993d2a-ae69-4a9b-860b-4bffb41baf09 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:22.411891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-32e7a171-13af-4079-b692-06d32e8cffa9 req-50993d2a-ae69-4a9b-860b-4bffb41baf09 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:22.412476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-32e7a171-13af-4079-b692-06d32e8cffa9 req-50993d2a-ae69-4a9b-860b-4bffb41baf09 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:22.427997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-57c1e653-ea58-4a92-816f-b7da6b7e1fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1131793017", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "d3777005-851a-44f1-be2b-d4f3d09bbf72"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:37:22.436002 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-32e7a171-13af-4079-b692-06d32e8cffa9 req-50993d2a-ae69-4a9b-860b-4bffb41baf09 service nova] Creating event network-vif-deleted:0ca323c5-08ed-433b-892e-43a213787a79 for instance 2f2da83b-d13a-4e4d-a6e7-408f26aa3b1d on n-h1-860864-2 Oct 10 23:37:22.445878 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-32e7a171-13af-4079-b692-06d32e8cffa9 req-50993d2a-ae69-4a9b-860b-4bffb41baf09 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058051 Oct 10 23:37:22.446830 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2128/4159] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:37:22.527084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-57c1e653-ea58-4a92-816f-b7da6b7e1fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] validate_networks() for [('d3777005-851a-44f1-be2b-d4f3d09bbf72', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:37:23.296556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6e3ea050-9a02-4b47-a04e-0f9b6571d5b1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:23.299160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6e3ea050-9a02-4b47-a04e-0f9b6571d5b1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:23.306251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e3ea050-9a02-4b47-a04e-0f9b6571d5b1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:23.306887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e3ea050-9a02-4b47-a04e-0f9b6571d5b1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:23.307398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e3ea050-9a02-4b47-a04e-0f9b6571d5b1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:23.308626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e3ea050-9a02-4b47-a04e-0f9b6571d5b1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:23.309156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e3ea050-9a02-4b47-a04e-0f9b6571d5b1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:23.309678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e3ea050-9a02-4b47-a04e-0f9b6571d5b1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:23.540453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-57c1e653-ea58-4a92-816f-b7da6b7e1fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:37:23.540951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-57c1e653-ea58-4a92-816f-b7da6b7e1fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:37:23.541353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-57c1e653-ea58-4a92-816f-b7da6b7e1fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:37:23.541798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-57c1e653-ea58-4a92-816f-b7da6b7e1fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:37:23.542219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-57c1e653-ea58-4a92-816f-b7da6b7e1fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:37:23.560137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57c1e653-ea58-4a92-816f-b7da6b7e1fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:23.560905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57c1e653-ea58-4a92-816f-b7da6b7e1fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:23.561577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57c1e653-ea58-4a92-816f-b7da6b7e1fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:23.562523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57c1e653-ea58-4a92-816f-b7da6b7e1fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:23.564897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57c1e653-ea58-4a92-816f-b7da6b7e1fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:23.565581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57c1e653-ea58-4a92-816f-b7da6b7e1fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:23.584485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6e3ea050-9a02-4b47-a04e-0f9b6571d5b1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:23.597462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:37:23.611737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6e3ea050-9a02-4b47-a04e-0f9b6571d5b1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:23.616071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6e3ea050-9a02-4b47-a04e-0f9b6571d5b1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:23.616378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-57c1e653-ea58-4a92-816f-b7da6b7e1fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Getting quotas for project e7d42cb00f2544abbde09cae76f3e3a1. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:37:23.623376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-57c1e653-ea58-4a92-816f-b7da6b7e1fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Getting quotas for user 7cc066774b344a24a91fb41e990f5234 and project e7d42cb00f2544abbde09cae76f3e3a1. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:37:23.623580 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6e3ea050-9a02-4b47-a04e-0f9b6571d5b1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1725 microversion: 2.20 time: 0.329079 Oct 10 23:37:23.627607 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2129/4160] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:23 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1725 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:37:23.655614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-57c1e653-ea58-4a92-816f-b7da6b7e1fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:37:23.664396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-57c1e653-ea58-4a92-816f-b7da6b7e1fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:37:23.761194 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-57c1e653-ea58-4a92-816f-b7da6b7e1fb2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.338221 Oct 10 23:37:23.762215 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2032/4161] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:37:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:37:23.776189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d45929e4-c112-4147-b513-e0073a248a67 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:23.779352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d45929e4-c112-4147-b513-e0073a248a67 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:23.967783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d45929e4-c112-4147-b513-e0073a248a67 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:24.004712 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d45929e4-c112-4147-b513-e0073a248a67 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1215 microversion: 2.1 time: 0.233962 Oct 10 23:37:24.032133 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2130/4162] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:23 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1215 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:24.652840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-54b8e352-10ba-4505-b407-6f87463b6c41 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:24.654381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-54b8e352-10ba-4505-b407-6f87463b6c41 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:24.671680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54b8e352-10ba-4505-b407-6f87463b6c41 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:24.674869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54b8e352-10ba-4505-b407-6f87463b6c41 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:24.675597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54b8e352-10ba-4505-b407-6f87463b6c41 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:24.678975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54b8e352-10ba-4505-b407-6f87463b6c41 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:24.679775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54b8e352-10ba-4505-b407-6f87463b6c41 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:24.685860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54b8e352-10ba-4505-b407-6f87463b6c41 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:25.066618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d12a6047-19b8-4eaf-a665-b73c38edc339 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:25.072344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d12a6047-19b8-4eaf-a665-b73c38edc339 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:25.110086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d12a6047-19b8-4eaf-a665-b73c38edc339 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:25.112149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d12a6047-19b8-4eaf-a665-b73c38edc339 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:25.113470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d12a6047-19b8-4eaf-a665-b73c38edc339 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:25.115317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d12a6047-19b8-4eaf-a665-b73c38edc339 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:25.117322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d12a6047-19b8-4eaf-a665-b73c38edc339 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:25.118497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d12a6047-19b8-4eaf-a665-b73c38edc339 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:25.224821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-54b8e352-10ba-4505-b407-6f87463b6c41 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:25.245197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-54b8e352-10ba-4505-b407-6f87463b6c41 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:25.252618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-54b8e352-10ba-4505-b407-6f87463b6c41 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:25.256227 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-54b8e352-10ba-4505-b407-6f87463b6c41 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1746 microversion: 2.20 time: 0.606128 Oct 10 23:37:25.258784 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2033/4163] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:24 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1746 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:37:25.351420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d12a6047-19b8-4eaf-a665-b73c38edc339 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:25.377252 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d12a6047-19b8-4eaf-a665-b73c38edc339 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1219 microversion: 2.1 time: 0.324821 Oct 10 23:37:25.377994 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2131/4164] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:25 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1219 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:26.305671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0e8c3f02-001e-4953-8377-7448345b085e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:26.306400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0e8c3f02-001e-4953-8377-7448345b085e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:26.337686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e8c3f02-001e-4953-8377-7448345b085e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:26.338796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e8c3f02-001e-4953-8377-7448345b085e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:26.339727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e8c3f02-001e-4953-8377-7448345b085e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:26.341661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e8c3f02-001e-4953-8377-7448345b085e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:26.342764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e8c3f02-001e-4953-8377-7448345b085e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:26.347039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e8c3f02-001e-4953-8377-7448345b085e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:26.439093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9e02120c-15d4-48fc-95a8-34f6f6f24eda tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:26.439855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9e02120c-15d4-48fc-95a8-34f6f6f24eda tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:26.467830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e02120c-15d4-48fc-95a8-34f6f6f24eda tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:26.471375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e02120c-15d4-48fc-95a8-34f6f6f24eda tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:26.475755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e02120c-15d4-48fc-95a8-34f6f6f24eda tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:26.480491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e02120c-15d4-48fc-95a8-34f6f6f24eda tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:26.481326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e02120c-15d4-48fc-95a8-34f6f6f24eda tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:26.481916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e02120c-15d4-48fc-95a8-34f6f6f24eda tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:26.700196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9e02120c-15d4-48fc-95a8-34f6f6f24eda tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:26.722987 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9e02120c-15d4-48fc-95a8-34f6f6f24eda tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1273 microversion: 2.1 time: 0.296746 Oct 10 23:37:26.724287 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2132/4165] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:26 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1273 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:27.026612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0e8c3f02-001e-4953-8377-7448345b085e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:27.053907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0e8c3f02-001e-4953-8377-7448345b085e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:27.061903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0e8c3f02-001e-4953-8377-7448345b085e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:27.066250 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0e8c3f02-001e-4953-8377-7448345b085e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1741 microversion: 2.20 time: 0.773360 Oct 10 23:37:27.067407 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2034/4166] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:26 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1741 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:37:27.752692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4c5ae054-00d8-43d5-a46b-dd37ebaab49a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:27.753438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4c5ae054-00d8-43d5-a46b-dd37ebaab49a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:27.764396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c5ae054-00d8-43d5-a46b-dd37ebaab49a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:27.765327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c5ae054-00d8-43d5-a46b-dd37ebaab49a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:27.765959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c5ae054-00d8-43d5-a46b-dd37ebaab49a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:27.766992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c5ae054-00d8-43d5-a46b-dd37ebaab49a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:27.767783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c5ae054-00d8-43d5-a46b-dd37ebaab49a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:27.768455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c5ae054-00d8-43d5-a46b-dd37ebaab49a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:28.103732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a9917757-ad73-4e38-a7cd-6aa89fbe23ef tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:28.104580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a9917757-ad73-4e38-a7cd-6aa89fbe23ef tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:28.155515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9917757-ad73-4e38-a7cd-6aa89fbe23ef tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:28.161807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9917757-ad73-4e38-a7cd-6aa89fbe23ef tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:28.162284 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9917757-ad73-4e38-a7cd-6aa89fbe23ef tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:28.163056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9917757-ad73-4e38-a7cd-6aa89fbe23ef tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:28.163778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9917757-ad73-4e38-a7cd-6aa89fbe23ef tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:28.164545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9917757-ad73-4e38-a7cd-6aa89fbe23ef tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:28.810402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4c5ae054-00d8-43d5-a46b-dd37ebaab49a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:28.824410 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4c5ae054-00d8-43d5-a46b-dd37ebaab49a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1315 microversion: 2.1 time: 1.075880 Oct 10 23:37:28.831600 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2133/4167] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:27 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1315 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:29.332565 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a9917757-ad73-4e38-a7cd-6aa89fbe23ef tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:29.350465 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a9917757-ad73-4e38-a7cd-6aa89fbe23ef tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:29.357724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a9917757-ad73-4e38-a7cd-6aa89fbe23ef tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:29.359869 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a9917757-ad73-4e38-a7cd-6aa89fbe23ef tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1741 microversion: 2.20 time: 1.264832 Oct 10 23:37:29.363426 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2035/4168] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:28 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1741 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:37:29.857461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7f54d792-acc3-47b0-8f26-f172fd1a7125 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:29.858299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7f54d792-acc3-47b0-8f26-f172fd1a7125 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:29.874235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f54d792-acc3-47b0-8f26-f172fd1a7125 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:29.876204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f54d792-acc3-47b0-8f26-f172fd1a7125 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:29.877818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f54d792-acc3-47b0-8f26-f172fd1a7125 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:29.881773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f54d792-acc3-47b0-8f26-f172fd1a7125 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:29.882567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f54d792-acc3-47b0-8f26-f172fd1a7125 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:29.885723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f54d792-acc3-47b0-8f26-f172fd1a7125 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:30.393252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a82011f9-7fba-47b8-956e-f7adaf07f09e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:30.399823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a82011f9-7fba-47b8-956e-f7adaf07f09e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:30.435694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a82011f9-7fba-47b8-956e-f7adaf07f09e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:30.436387 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a82011f9-7fba-47b8-956e-f7adaf07f09e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:30.437058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a82011f9-7fba-47b8-956e-f7adaf07f09e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:30.438379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a82011f9-7fba-47b8-956e-f7adaf07f09e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:30.447553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a82011f9-7fba-47b8-956e-f7adaf07f09e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:30.448305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a82011f9-7fba-47b8-956e-f7adaf07f09e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:30.573289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7f54d792-acc3-47b0-8f26-f172fd1a7125 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:30.648592 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7f54d792-acc3-47b0-8f26-f172fd1a7125 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1315 microversion: 2.1 time: 0.794952 Oct 10 23:37:30.654298 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2134/4169] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:29 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1315 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:31.958042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-a2ec6118-4471-4279-b365-cdfe10354b4c req-cc7058e0-381d-4fdc-ab85-31c7b6d2cee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f5c98e-777a-4d5b-aed5-89fd026f1734", "name": "network-vif-plugged", "status": "completed", "tag": "14e55a18-a2c4-41ce-8ca8-1d0de903ab65"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:37:31.991737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a2ec6118-4471-4279-b365-cdfe10354b4c req-cc7058e0-381d-4fdc-ab85-31c7b6d2cee6 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:31.992300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a2ec6118-4471-4279-b365-cdfe10354b4c req-cc7058e0-381d-4fdc-ab85-31c7b6d2cee6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:31.992757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a2ec6118-4471-4279-b365-cdfe10354b4c req-cc7058e0-381d-4fdc-ab85-31c7b6d2cee6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:32.047021 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a2ec6118-4471-4279-b365-cdfe10354b4c req-cc7058e0-381d-4fdc-ab85-31c7b6d2cee6 service nova] Creating event network-vif-plugged:14e55a18-a2c4-41ce-8ca8-1d0de903ab65 for instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 on n-h2-860864-2 Oct 10 23:37:32.095064 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-a2ec6118-4471-4279-b365-cdfe10354b4c req-cc7058e0-381d-4fdc-ab85-31c7b6d2cee6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.697147 Oct 10 23:37:32.096707 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2135/4170] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:37:32.120837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-40bd403b-17c8-4117-821e-74a65fb9a280 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:32.121619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-40bd403b-17c8-4117-821e-74a65fb9a280 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:32.139338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40bd403b-17c8-4117-821e-74a65fb9a280 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:32.139860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40bd403b-17c8-4117-821e-74a65fb9a280 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:32.140320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40bd403b-17c8-4117-821e-74a65fb9a280 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:32.141061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40bd403b-17c8-4117-821e-74a65fb9a280 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:32.158347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40bd403b-17c8-4117-821e-74a65fb9a280 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:32.158931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40bd403b-17c8-4117-821e-74a65fb9a280 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:32.226041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:37:32.319012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a82011f9-7fba-47b8-956e-f7adaf07f09e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:32.339820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a82011f9-7fba-47b8-956e-f7adaf07f09e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:32.345406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a82011f9-7fba-47b8-956e-f7adaf07f09e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:32.348786 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a82011f9-7fba-47b8-956e-f7adaf07f09e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1741 microversion: 2.20 time: 1.960219 Oct 10 23:37:32.353901 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2036/4171] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:30 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1741 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:37:32.825049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-40bd403b-17c8-4117-821e-74a65fb9a280 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:32.855567 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-40bd403b-17c8-4117-821e-74a65fb9a280 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1315 microversion: 2.1 time: 0.745583 Oct 10 23:37:32.860721 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2136/4172] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:32 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1315 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:33.184959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-f59cfc58-da00-4529-a11e-d27886ee3c37 req-7a612cf8-f5c9-464f-be66-ac80e3e47d85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "961f5a5b-1142-497e-8b88-b16f193e66e4", "tag": "20d071d9-a8db-44d0-a2e2-ac7754ed4e80"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:37:33.214262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f59cfc58-da00-4529-a11e-d27886ee3c37 req-7a612cf8-f5c9-464f-be66-ac80e3e47d85 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:33.214751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f59cfc58-da00-4529-a11e-d27886ee3c37 req-7a612cf8-f5c9-464f-be66-ac80e3e47d85 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:33.215184 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f59cfc58-da00-4529-a11e-d27886ee3c37 req-7a612cf8-f5c9-464f-be66-ac80e3e47d85 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:33.272187 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-f59cfc58-da00-4529-a11e-d27886ee3c37 req-7a612cf8-f5c9-464f-be66-ac80e3e47d85 service nova] Creating event network-changed:20d071d9-a8db-44d0-a2e2-ac7754ed4e80 for instance 961f5a5b-1142-497e-8b88-b16f193e66e4 on n-h1-860864-2 Oct 10 23:37:33.287659 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-f59cfc58-da00-4529-a11e-d27886ee3c37 req-7a612cf8-f5c9-464f-be66-ac80e3e47d85 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108139 Oct 10 23:37:33.288294 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2037/4173] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:37:33.381926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d8ba1827-9ccc-4764-a2cc-b20ac470eee6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:33.382567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d8ba1827-9ccc-4764-a2cc-b20ac470eee6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:33.403886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8ba1827-9ccc-4764-a2cc-b20ac470eee6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:33.404455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8ba1827-9ccc-4764-a2cc-b20ac470eee6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:33.404908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8ba1827-9ccc-4764-a2cc-b20ac470eee6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:33.411995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8ba1827-9ccc-4764-a2cc-b20ac470eee6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:33.414065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8ba1827-9ccc-4764-a2cc-b20ac470eee6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:33.419508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8ba1827-9ccc-4764-a2cc-b20ac470eee6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:33.886714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ec2821cd-176b-46a9-9217-8d1fd22025d0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:33.888173 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ec2821cd-176b-46a9-9217-8d1fd22025d0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:33.890965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:37:33.896675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:37:33.897773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:37:33.916159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec2821cd-176b-46a9-9217-8d1fd22025d0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:33.919158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec2821cd-176b-46a9-9217-8d1fd22025d0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:33.919917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec2821cd-176b-46a9-9217-8d1fd22025d0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:33.921134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec2821cd-176b-46a9-9217-8d1fd22025d0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:33.925338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec2821cd-176b-46a9-9217-8d1fd22025d0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:33.926075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec2821cd-176b-46a9-9217-8d1fd22025d0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:33.978679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:37:34.363062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d8ba1827-9ccc-4764-a2cc-b20ac470eee6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:34.404492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d8ba1827-9ccc-4764-a2cc-b20ac470eee6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:34.409564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d8ba1827-9ccc-4764-a2cc-b20ac470eee6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:34.417042 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d8ba1827-9ccc-4764-a2cc-b20ac470eee6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1741 microversion: 2.20 time: 1.041071 Oct 10 23:37:34.438793 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2137/4174] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:33 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1741 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:37:34.767385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ec2821cd-176b-46a9-9217-8d1fd22025d0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:34.785317 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ec2821cd-176b-46a9-9217-8d1fd22025d0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1315 microversion: 2.1 time: 0.903301 Oct 10 23:37:34.816443 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2038/4175] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:33 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1315 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:35.445100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6e3dd235-6f59-44e0-824d-39ed29f2c910 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-807161420", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "f88b2ee3-c989-48ff-ae39-08248cc357a2"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:37:35.450665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dd0963ab-e886-46b1-acf7-e81b128875e7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:35.451283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dd0963ab-e886-46b1-acf7-e81b128875e7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:35.464242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd0963ab-e886-46b1-acf7-e81b128875e7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:35.465364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd0963ab-e886-46b1-acf7-e81b128875e7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:35.466038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd0963ab-e886-46b1-acf7-e81b128875e7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:35.467188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd0963ab-e886-46b1-acf7-e81b128875e7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:35.467852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd0963ab-e886-46b1-acf7-e81b128875e7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:35.468463 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd0963ab-e886-46b1-acf7-e81b128875e7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:35.574972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-6e3dd235-6f59-44e0-824d-39ed29f2c910 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] validate_networks() for [('f88b2ee3-c989-48ff-ae39-08248cc357a2', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:37:35.710581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dd0963ab-e886-46b1-acf7-e81b128875e7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:35.723508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dd0963ab-e886-46b1-acf7-e81b128875e7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:35.727304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dd0963ab-e886-46b1-acf7-e81b128875e7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:35.728981 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dd0963ab-e886-46b1-acf7-e81b128875e7 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1741 microversion: 2.20 time: 0.283782 Oct 10 23:37:35.729821 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2039/4176] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:35 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1741 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:37:35.822589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8f89d006-817c-4966-abd0-4c3b4e708ecd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:35.823651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8f89d006-817c-4966-abd0-4c3b4e708ecd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:35.840105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f89d006-817c-4966-abd0-4c3b4e708ecd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:35.841913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f89d006-817c-4966-abd0-4c3b4e708ecd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:35.844366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f89d006-817c-4966-abd0-4c3b4e708ecd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:35.847240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f89d006-817c-4966-abd0-4c3b4e708ecd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:35.850101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f89d006-817c-4966-abd0-4c3b4e708ecd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:35.850985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f89d006-817c-4966-abd0-4c3b4e708ecd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:36.149190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8f89d006-817c-4966-abd0-4c3b4e708ecd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:36.164362 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8f89d006-817c-4966-abd0-4c3b4e708ecd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1315 microversion: 2.1 time: 0.350615 Oct 10 23:37:36.186514 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2040/4177] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:35 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:36.757595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-99a10ec6-b8bc-426b-8b2b-2b522d00fd3e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:36.759290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-99a10ec6-b8bc-426b-8b2b-2b522d00fd3e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:36.768427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99a10ec6-b8bc-426b-8b2b-2b522d00fd3e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:36.770055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99a10ec6-b8bc-426b-8b2b-2b522d00fd3e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:36.770789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99a10ec6-b8bc-426b-8b2b-2b522d00fd3e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:36.771851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99a10ec6-b8bc-426b-8b2b-2b522d00fd3e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:36.772582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99a10ec6-b8bc-426b-8b2b-2b522d00fd3e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:36.773326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99a10ec6-b8bc-426b-8b2b-2b522d00fd3e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:37.044770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-99a10ec6-b8bc-426b-8b2b-2b522d00fd3e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:37.065314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-99a10ec6-b8bc-426b-8b2b-2b522d00fd3e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:37.069270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-99a10ec6-b8bc-426b-8b2b-2b522d00fd3e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:37.072062 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-99a10ec6-b8bc-426b-8b2b-2b522d00fd3e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1741 microversion: 2.20 time: 0.318326 Oct 10 23:37:37.074075 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2041/4178] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:36 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1741 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:37:37.194525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-662ef06e-8389-415b-a4e2-19d7dc759ec2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:37.196013 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-662ef06e-8389-415b-a4e2-19d7dc759ec2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:37.209656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-662ef06e-8389-415b-a4e2-19d7dc759ec2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:37.210444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-662ef06e-8389-415b-a4e2-19d7dc759ec2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:37.211667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-662ef06e-8389-415b-a4e2-19d7dc759ec2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:37.212951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-662ef06e-8389-415b-a4e2-19d7dc759ec2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:37.219440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-662ef06e-8389-415b-a4e2-19d7dc759ec2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:37.220677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-662ef06e-8389-415b-a4e2-19d7dc759ec2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:37.575195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-662ef06e-8389-415b-a4e2-19d7dc759ec2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:37.590558 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-662ef06e-8389-415b-a4e2-19d7dc759ec2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1315 microversion: 2.1 time: 0.401289 Oct 10 23:37:37.606183 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2042/4179] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:37 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:37.755893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6e3dd235-6f59-44e0-824d-39ed29f2c910 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:37:37.756986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6e3dd235-6f59-44e0-824d-39ed29f2c910 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:37:37.757851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6e3dd235-6f59-44e0-824d-39ed29f2c910 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:37:37.758626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6e3dd235-6f59-44e0-824d-39ed29f2c910 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:37:37.759454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6e3dd235-6f59-44e0-824d-39ed29f2c910 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:37:37.780330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e3dd235-6f59-44e0-824d-39ed29f2c910 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:37.781438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e3dd235-6f59-44e0-824d-39ed29f2c910 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:37.783416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e3dd235-6f59-44e0-824d-39ed29f2c910 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:37.784598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e3dd235-6f59-44e0-824d-39ed29f2c910 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:37.786305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e3dd235-6f59-44e0-824d-39ed29f2c910 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:37.788268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e3dd235-6f59-44e0-824d-39ed29f2c910 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:37.843819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-6e3dd235-6f59-44e0-824d-39ed29f2c910 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Getting quotas for project 0696923efb3c49c087db1a92119a0a04. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:37:37.861479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-6e3dd235-6f59-44e0-824d-39ed29f2c910 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Getting quotas for user 73044d4a69d649acb214d74f42c950e4 and project 0696923efb3c49c087db1a92119a0a04. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:37:37.890887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6e3dd235-6f59-44e0-824d-39ed29f2c910 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:37:37.898110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6e3dd235-6f59-44e0-824d-39ed29f2c910 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] [instance: 909982c3-4e0f-4811-b8f9-2f085d7c31c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:37:38.026042 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6e3dd235-6f59-44e0-824d-39ed29f2c910 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.755907 Oct 10 23:37:38.029821 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2138/4180] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:37:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:37:38.043575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dd9f27ce-46bc-4066-8b8f-5422f359d599 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:38.044777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dd9f27ce-46bc-4066-8b8f-5422f359d599 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] [instance: 909982c3-4e0f-4811-b8f9-2f085d7c31c7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:38.118205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-742ed164-3641-42dd-b29f-9a29faf9aa2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:38.120407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-742ed164-3641-42dd-b29f-9a29faf9aa2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:38.139448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-742ed164-3641-42dd-b29f-9a29faf9aa2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:38.139968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-742ed164-3641-42dd-b29f-9a29faf9aa2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:38.146253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-742ed164-3641-42dd-b29f-9a29faf9aa2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:38.147661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-742ed164-3641-42dd-b29f-9a29faf9aa2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:38.148373 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-742ed164-3641-42dd-b29f-9a29faf9aa2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:38.148596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-742ed164-3641-42dd-b29f-9a29faf9aa2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:38.181215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dd9f27ce-46bc-4066-8b8f-5422f359d599 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73044d4a69d649acb214d74f42c950e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0696923efb3c49c087db1a92119a0a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:38.206350 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dd9f27ce-46bc-4066-8b8f-5422f359d599 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] 10.222.0.23 "GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7" status: 200 len: 1224 microversion: 2.1 time: 0.167687 Oct 10 23:37:38.207166 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2043/4181] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:38 2022] GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7 => generated 1224 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:38.631180 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e52b7d48-281d-447a-b746-b889939094d1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:38.631849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e52b7d48-281d-447a-b746-b889939094d1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:38.685045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e52b7d48-281d-447a-b746-b889939094d1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:38.688647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e52b7d48-281d-447a-b746-b889939094d1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:38.691738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e52b7d48-281d-447a-b746-b889939094d1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:38.694884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e52b7d48-281d-447a-b746-b889939094d1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:38.695726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e52b7d48-281d-447a-b746-b889939094d1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:38.696806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e52b7d48-281d-447a-b746-b889939094d1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:38.808376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-742ed164-3641-42dd-b29f-9a29faf9aa2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:38.834559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-742ed164-3641-42dd-b29f-9a29faf9aa2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:38.844861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-742ed164-3641-42dd-b29f-9a29faf9aa2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:38.849067 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-742ed164-3641-42dd-b29f-9a29faf9aa2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1741 microversion: 2.20 time: 0.749354 Oct 10 23:37:38.852000 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2139/4182] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:38 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1741 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:37:39.075142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e52b7d48-281d-447a-b746-b889939094d1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:39.096089 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e52b7d48-281d-447a-b746-b889939094d1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1315 microversion: 2.1 time: 0.474831 Oct 10 23:37:39.102954 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2044/4183] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:38 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:39.233249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-236a9592-47fd-4923-a6fe-416a861834c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:39.233867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-236a9592-47fd-4923-a6fe-416a861834c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] [instance: 909982c3-4e0f-4811-b8f9-2f085d7c31c7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:39.244693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-236a9592-47fd-4923-a6fe-416a861834c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:39.245211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-236a9592-47fd-4923-a6fe-416a861834c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:39.245687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-236a9592-47fd-4923-a6fe-416a861834c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:39.246420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-236a9592-47fd-4923-a6fe-416a861834c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:39.257026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-236a9592-47fd-4923-a6fe-416a861834c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:39.258905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-236a9592-47fd-4923-a6fe-416a861834c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:39.858121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-236a9592-47fd-4923-a6fe-416a861834c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73044d4a69d649acb214d74f42c950e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0696923efb3c49c087db1a92119a0a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:39.883619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c3059ad3-3f98-4a6b-a870-1bd47a5db9ad tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:39.884458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c3059ad3-3f98-4a6b-a870-1bd47a5db9ad tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:39.930696 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-236a9592-47fd-4923-a6fe-416a861834c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] 10.222.0.23 "GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7" status: 200 len: 1228 microversion: 2.1 time: 0.702109 Oct 10 23:37:39.932583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3059ad3-3f98-4a6b-a870-1bd47a5db9ad tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:39.936819 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2140/4184] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:39 2022] GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7 => generated 1228 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:39.941282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3059ad3-3f98-4a6b-a870-1bd47a5db9ad tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:39.942365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3059ad3-3f98-4a6b-a870-1bd47a5db9ad tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:39.950601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3059ad3-3f98-4a6b-a870-1bd47a5db9ad tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:39.952783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3059ad3-3f98-4a6b-a870-1bd47a5db9ad tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:39.962506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3059ad3-3f98-4a6b-a870-1bd47a5db9ad tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:40.132541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a3d1f047-2021-45ba-af76-13b4a8e8813d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:40.132541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a3d1f047-2021-45ba-af76-13b4a8e8813d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:40.166212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3d1f047-2021-45ba-af76-13b4a8e8813d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:40.173834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3d1f047-2021-45ba-af76-13b4a8e8813d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:40.181822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3d1f047-2021-45ba-af76-13b4a8e8813d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:40.201274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3d1f047-2021-45ba-af76-13b4a8e8813d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:40.207766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3d1f047-2021-45ba-af76-13b4a8e8813d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:40.210154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3d1f047-2021-45ba-af76-13b4a8e8813d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:40.774874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a3d1f047-2021-45ba-af76-13b4a8e8813d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:40.794879 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a3d1f047-2021-45ba-af76-13b4a8e8813d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1315 microversion: 2.1 time: 0.669065 Oct 10 23:37:40.795823 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2141/4185] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:40 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1315 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:40.842826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c3059ad3-3f98-4a6b-a870-1bd47a5db9ad tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:40.861203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c3059ad3-3f98-4a6b-a870-1bd47a5db9ad tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:40.866406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c3059ad3-3f98-4a6b-a870-1bd47a5db9ad tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:40.869324 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c3059ad3-3f98-4a6b-a870-1bd47a5db9ad tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1741 microversion: 2.20 time: 0.991755 Oct 10 23:37:40.873027 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2045/4186] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:39 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1741 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:37:40.985899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9414d3be-98fc-400c-9f71-ed8805d1165c tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:40.987420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9414d3be-98fc-400c-9f71-ed8805d1165c tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] [instance: 909982c3-4e0f-4811-b8f9-2f085d7c31c7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:41.017236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9414d3be-98fc-400c-9f71-ed8805d1165c tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:41.019689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9414d3be-98fc-400c-9f71-ed8805d1165c tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:41.026856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9414d3be-98fc-400c-9f71-ed8805d1165c tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:41.033072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9414d3be-98fc-400c-9f71-ed8805d1165c tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:41.034521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9414d3be-98fc-400c-9f71-ed8805d1165c tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:41.038414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9414d3be-98fc-400c-9f71-ed8805d1165c tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:41.305086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9414d3be-98fc-400c-9f71-ed8805d1165c tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73044d4a69d649acb214d74f42c950e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0696923efb3c49c087db1a92119a0a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:41.333313 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9414d3be-98fc-400c-9f71-ed8805d1165c tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] 10.222.0.23 "GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7" status: 200 len: 1276 microversion: 2.1 time: 0.352899 Oct 10 23:37:41.335574 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2142/4187] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:40 2022] GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7 => generated 1276 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:41.827150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2551478b-468e-49e1-a13d-d1191e28fb77 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:41.828264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2551478b-468e-49e1-a13d-d1191e28fb77 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:41.865230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2551478b-468e-49e1-a13d-d1191e28fb77 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:41.880778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2551478b-468e-49e1-a13d-d1191e28fb77 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:41.884784 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2551478b-468e-49e1-a13d-d1191e28fb77 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:41.892956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2551478b-468e-49e1-a13d-d1191e28fb77 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:41.896353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2551478b-468e-49e1-a13d-d1191e28fb77 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:41.908705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9fad9fae-4fc9-4448-b0e2-e1c0796c30d3 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:41.909703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9fad9fae-4fc9-4448-b0e2-e1c0796c30d3 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:41.914595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2551478b-468e-49e1-a13d-d1191e28fb77 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:41.934756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fad9fae-4fc9-4448-b0e2-e1c0796c30d3 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:41.937058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fad9fae-4fc9-4448-b0e2-e1c0796c30d3 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:41.944228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fad9fae-4fc9-4448-b0e2-e1c0796c30d3 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:41.958391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fad9fae-4fc9-4448-b0e2-e1c0796c30d3 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:41.963413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fad9fae-4fc9-4448-b0e2-e1c0796c30d3 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:41.968274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fad9fae-4fc9-4448-b0e2-e1c0796c30d3 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:42.957403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2551478b-468e-49e1-a13d-d1191e28fb77 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:42.979020 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2551478b-468e-49e1-a13d-d1191e28fb77 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1315 microversion: 2.1 time: 1.158324 Oct 10 23:37:42.979651 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2046/4188] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:41 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1315 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:42.995831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4b283855-f0d6-44f4-bc72-370d34514226 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:42.996384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4b283855-f0d6-44f4-bc72-370d34514226 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] [instance: 909982c3-4e0f-4811-b8f9-2f085d7c31c7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:43.013803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b283855-f0d6-44f4-bc72-370d34514226 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:43.014326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b283855-f0d6-44f4-bc72-370d34514226 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:43.014766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b283855-f0d6-44f4-bc72-370d34514226 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:43.026725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b283855-f0d6-44f4-bc72-370d34514226 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:43.027475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b283855-f0d6-44f4-bc72-370d34514226 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:43.028116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b283855-f0d6-44f4-bc72-370d34514226 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:43.348376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9fad9fae-4fc9-4448-b0e2-e1c0796c30d3 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:43.363350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9fad9fae-4fc9-4448-b0e2-e1c0796c30d3 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:43.364820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9fad9fae-4fc9-4448-b0e2-e1c0796c30d3 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:43.366079 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9fad9fae-4fc9-4448-b0e2-e1c0796c30d3 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1741 microversion: 2.20 time: 1.462121 Oct 10 23:37:43.370353 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2143/4189] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:41 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1741 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:37:43.386395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-23c531e8-1e71-47ac-868a-0c2982a905c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:43.387017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-23c531e8-1e71-47ac-868a-0c2982a905c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:43.409470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23c531e8-1e71-47ac-868a-0c2982a905c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:43.409988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23c531e8-1e71-47ac-868a-0c2982a905c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:43.410440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23c531e8-1e71-47ac-868a-0c2982a905c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:43.411282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23c531e8-1e71-47ac-868a-0c2982a905c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:43.411862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23c531e8-1e71-47ac-868a-0c2982a905c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:43.412306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23c531e8-1e71-47ac-868a-0c2982a905c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:43.905085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-23c531e8-1e71-47ac-868a-0c2982a905c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:43.925545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-23c531e8-1e71-47ac-868a-0c2982a905c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:43.927019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-23c531e8-1e71-47ac-868a-0c2982a905c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:43.928358 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-23c531e8-1e71-47ac-868a-0c2982a905c2 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 2958 microversion: 2.42 time: 0.556997 Oct 10 23:37:43.928944 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2144/4190] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:43 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 2958 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:37:43.950859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-6a849948-d03d-492c-9893-d704700783d3 req-f6039512-0c53-4275-befc-5a6ec09c36c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "961f5a5b-1142-497e-8b88-b16f193e66e4", "name": "network-vif-plugged", "status": "completed", "tag": "20d071d9-a8db-44d0-a2e2-ac7754ed4e80"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:37:43.987104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6a849948-d03d-492c-9893-d704700783d3 req-f6039512-0c53-4275-befc-5a6ec09c36c5 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:43.987594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6a849948-d03d-492c-9893-d704700783d3 req-f6039512-0c53-4275-befc-5a6ec09c36c5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:43.988037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6a849948-d03d-492c-9893-d704700783d3 req-f6039512-0c53-4275-befc-5a6ec09c36c5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:44.016978 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-6a849948-d03d-492c-9893-d704700783d3 req-f6039512-0c53-4275-befc-5a6ec09c36c5 service nova] Creating event network-vif-plugged:20d071d9-a8db-44d0-a2e2-ac7754ed4e80 for instance 961f5a5b-1142-497e-8b88-b16f193e66e4 on n-h1-860864-2 Oct 10 23:37:44.031690 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-6a849948-d03d-492c-9893-d704700783d3 req-f6039512-0c53-4275-befc-5a6ec09c36c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099062 Oct 10 23:37:44.040056 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2145/4191] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:37:44.046503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-037a1785-311f-48b3-aede-d9ec40684a12 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:44.050053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-037a1785-311f-48b3-aede-d9ec40684a12 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:44.068331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-037a1785-311f-48b3-aede-d9ec40684a12 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:44.069780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-037a1785-311f-48b3-aede-d9ec40684a12 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:44.076150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-037a1785-311f-48b3-aede-d9ec40684a12 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:44.082579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-037a1785-311f-48b3-aede-d9ec40684a12 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:44.083335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-037a1785-311f-48b3-aede-d9ec40684a12 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:44.083937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-037a1785-311f-48b3-aede-d9ec40684a12 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:44.126964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4b283855-f0d6-44f4-bc72-370d34514226 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73044d4a69d649acb214d74f42c950e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0696923efb3c49c087db1a92119a0a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:44.146381 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4b283855-f0d6-44f4-bc72-370d34514226 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] 10.222.0.23 "GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7" status: 200 len: 1282 microversion: 2.1 time: 1.165623 Oct 10 23:37:44.150120 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2047/4192] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:42 2022] GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7 => generated 1282 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:44.158599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b3f08886-e172-4f15-a039-909f4d6c7489 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:44.160588 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b3f08886-e172-4f15-a039-909f4d6c7489 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:44.174503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3f08886-e172-4f15-a039-909f4d6c7489 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:44.175769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3f08886-e172-4f15-a039-909f4d6c7489 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:44.177236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3f08886-e172-4f15-a039-909f4d6c7489 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:44.178314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3f08886-e172-4f15-a039-909f4d6c7489 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:44.179067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3f08886-e172-4f15-a039-909f4d6c7489 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:44.179834 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3f08886-e172-4f15-a039-909f4d6c7489 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:44.351382 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-037a1785-311f-48b3-aede-d9ec40684a12 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.309451 Oct 10 23:37:44.352000 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2146/4193] 10.222.0.23 () {60 vars in 1316 bytes} [Mon Oct 10 23:37:44 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39/os-interface => generated 1833 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:37:44.409943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-46678695-163b-413b-9ab2-d304b2915a2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:44.410548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-46678695-163b-413b-9ab2-d304b2915a2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:44.424431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46678695-163b-413b-9ab2-d304b2915a2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:44.425092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46678695-163b-413b-9ab2-d304b2915a2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:44.425673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46678695-163b-413b-9ab2-d304b2915a2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:44.426506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46678695-163b-413b-9ab2-d304b2915a2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:44.429044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46678695-163b-413b-9ab2-d304b2915a2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:44.429801 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46678695-163b-413b-9ab2-d304b2915a2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:45.004485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-46678695-163b-413b-9ab2-d304b2915a2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:45.013491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-46678695-163b-413b-9ab2-d304b2915a2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:45.024457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-46678695-163b-413b-9ab2-d304b2915a2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:45.026056 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-46678695-163b-413b-9ab2-d304b2915a2e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1741 microversion: 2.20 time: 0.622632 Oct 10 23:37:45.027315 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2147/4194] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:44 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1741 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:37:45.097821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b3f08886-e172-4f15-a039-909f4d6c7489 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:45.114967 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b3f08886-e172-4f15-a039-909f4d6c7489 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1315 microversion: 2.1 time: 0.963318 Oct 10 23:37:45.116035 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2048/4195] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:44 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1315 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:45.178284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f66003ee-6e66-4298-8f5f-d778d5b087ba tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:45.179360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f66003ee-6e66-4298-8f5f-d778d5b087ba tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] [instance: 909982c3-4e0f-4811-b8f9-2f085d7c31c7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:45.190173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:37:45.192749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f66003ee-6e66-4298-8f5f-d778d5b087ba tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:45.193603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f66003ee-6e66-4298-8f5f-d778d5b087ba tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:45.194301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f66003ee-6e66-4298-8f5f-d778d5b087ba tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:45.200057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f66003ee-6e66-4298-8f5f-d778d5b087ba tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:45.200889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f66003ee-6e66-4298-8f5f-d778d5b087ba tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:45.201577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f66003ee-6e66-4298-8f5f-d778d5b087ba tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:45.879451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f66003ee-6e66-4298-8f5f-d778d5b087ba tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73044d4a69d649acb214d74f42c950e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0696923efb3c49c087db1a92119a0a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:45.934794 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f66003ee-6e66-4298-8f5f-d778d5b087ba tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] 10.222.0.23 "GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7" status: 200 len: 1324 microversion: 2.1 time: 0.760173 Oct 10 23:37:45.936668 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2148/4196] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:45 2022] GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7 => generated 1324 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:37:46.070459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-17165732-760c-45d8-8cca-f075c7e922be tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:46.071170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-17165732-760c-45d8-8cca-f075c7e922be tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:46.081746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17165732-760c-45d8-8cca-f075c7e922be tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:46.085367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17165732-760c-45d8-8cca-f075c7e922be tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:46.091346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17165732-760c-45d8-8cca-f075c7e922be tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:46.092331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17165732-760c-45d8-8cca-f075c7e922be tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:46.101111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17165732-760c-45d8-8cca-f075c7e922be tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:46.103830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17165732-760c-45d8-8cca-f075c7e922be tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:46.146963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c01929b9-541a-44e6-a5fc-54c87eb7fc36 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:46.148284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c01929b9-541a-44e6-a5fc-54c87eb7fc36 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:46.180246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c01929b9-541a-44e6-a5fc-54c87eb7fc36 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:46.181724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c01929b9-541a-44e6-a5fc-54c87eb7fc36 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:46.184292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c01929b9-541a-44e6-a5fc-54c87eb7fc36 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:46.193977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c01929b9-541a-44e6-a5fc-54c87eb7fc36 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:46.195291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c01929b9-541a-44e6-a5fc-54c87eb7fc36 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:46.208280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c01929b9-541a-44e6-a5fc-54c87eb7fc36 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:47.164752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-17165732-760c-45d8-8cca-f075c7e922be tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:47.217136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-17165732-760c-45d8-8cca-f075c7e922be tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:47.239259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-17165732-760c-45d8-8cca-f075c7e922be tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:47.242629 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-17165732-760c-45d8-8cca-f075c7e922be tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1741 microversion: 2.20 time: 1.182482 Oct 10 23:37:47.271502 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2049/4197] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:46 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1741 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:37:47.285761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c01929b9-541a-44e6-a5fc-54c87eb7fc36 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:47.295272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7783c8c9-2f78-4914-ba16-2bf8673fe5c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:47.300871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7783c8c9-2f78-4914-ba16-2bf8673fe5c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] [instance: 909982c3-4e0f-4811-b8f9-2f085d7c31c7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:47.321483 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c01929b9-541a-44e6-a5fc-54c87eb7fc36 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1315 microversion: 2.1 time: 1.169616 Oct 10 23:37:47.322566 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2149/4198] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:46 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1315 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:47.326657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7783c8c9-2f78-4914-ba16-2bf8673fe5c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:47.329935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7783c8c9-2f78-4914-ba16-2bf8673fe5c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:47.330677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7783c8c9-2f78-4914-ba16-2bf8673fe5c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:47.338905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7783c8c9-2f78-4914-ba16-2bf8673fe5c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:47.342123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7783c8c9-2f78-4914-ba16-2bf8673fe5c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:47.342948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7783c8c9-2f78-4914-ba16-2bf8673fe5c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:47.682316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7783c8c9-2f78-4914-ba16-2bf8673fe5c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73044d4a69d649acb214d74f42c950e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0696923efb3c49c087db1a92119a0a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:47.722025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-703ea13d-958d-4246-9036-c681d9c0ab76 req-379c77c4-76bf-4797-a638-d5afaf91b78d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "909982c3-4e0f-4811-b8f9-2f085d7c31c7", "tag": "a851375c-cfa5-4c3f-b784-24809890b8dc"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:37:47.746680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-703ea13d-958d-4246-9036-c681d9c0ab76 req-379c77c4-76bf-4797-a638-d5afaf91b78d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:47.749530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-703ea13d-958d-4246-9036-c681d9c0ab76 req-379c77c4-76bf-4797-a638-d5afaf91b78d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:47.750878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-703ea13d-958d-4246-9036-c681d9c0ab76 req-379c77c4-76bf-4797-a638-d5afaf91b78d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:47.782616 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7783c8c9-2f78-4914-ba16-2bf8673fe5c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] 10.222.0.23 "GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7" status: 200 len: 1324 microversion: 2.1 time: 0.504364 Oct 10 23:37:47.788220 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-703ea13d-958d-4246-9036-c681d9c0ab76 req-379c77c4-76bf-4797-a638-d5afaf91b78d service nova] Creating event network-changed:a851375c-cfa5-4c3f-b784-24809890b8dc for instance 909982c3-4e0f-4811-b8f9-2f085d7c31c7 on n-h2-860864-2 Oct 10 23:37:47.789755 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2050/4199] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:47 2022] GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7 => generated 1324 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:47.805693 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-703ea13d-958d-4246-9036-c681d9c0ab76 req-379c77c4-76bf-4797-a638-d5afaf91b78d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088390 Oct 10 23:37:47.808016 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2150/4200] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:37:48.290456 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0c6618d4-890e-473c-821a-5325fb1d384a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:48.291190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0c6618d4-890e-473c-821a-5325fb1d384a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:48.316525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:37:48.318744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c6618d4-890e-473c-821a-5325fb1d384a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:48.320028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c6618d4-890e-473c-821a-5325fb1d384a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:48.321939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c6618d4-890e-473c-821a-5325fb1d384a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:48.326810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c6618d4-890e-473c-821a-5325fb1d384a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:48.331700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c6618d4-890e-473c-821a-5325fb1d384a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:48.336061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c6618d4-890e-473c-821a-5325fb1d384a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:48.356032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:37:48.359078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:37:48.365655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-25b2c61d-e71b-4baa-afa5-39ff3f2c208f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:48.377890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-25b2c61d-e71b-4baa-afa5-39ff3f2c208f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:48.380430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:37:48.399852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25b2c61d-e71b-4baa-afa5-39ff3f2c208f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:48.401029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25b2c61d-e71b-4baa-afa5-39ff3f2c208f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:48.405797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25b2c61d-e71b-4baa-afa5-39ff3f2c208f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:48.407901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25b2c61d-e71b-4baa-afa5-39ff3f2c208f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:48.408621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25b2c61d-e71b-4baa-afa5-39ff3f2c208f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:48.410595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25b2c61d-e71b-4baa-afa5-39ff3f2c208f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:49.013166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0c6618d4-890e-473c-821a-5325fb1d384a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:49.027074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0c6618d4-890e-473c-821a-5325fb1d384a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:49.041342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0c6618d4-890e-473c-821a-5325fb1d384a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:49.045017 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0c6618d4-890e-473c-821a-5325fb1d384a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1741 microversion: 2.20 time: 0.761245 Oct 10 23:37:49.071151 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2051/4201] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:48 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1741 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:37:49.076801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d73165aa-6886-4e46-aac5-9cf72f2c9c94 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:49.077719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d73165aa-6886-4e46-aac5-9cf72f2c9c94 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] [instance: 909982c3-4e0f-4811-b8f9-2f085d7c31c7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:49.085615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d73165aa-6886-4e46-aac5-9cf72f2c9c94 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:49.086437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d73165aa-6886-4e46-aac5-9cf72f2c9c94 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:49.087149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d73165aa-6886-4e46-aac5-9cf72f2c9c94 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:49.088079 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d73165aa-6886-4e46-aac5-9cf72f2c9c94 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:49.088690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d73165aa-6886-4e46-aac5-9cf72f2c9c94 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:49.089575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d73165aa-6886-4e46-aac5-9cf72f2c9c94 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:49.444900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d73165aa-6886-4e46-aac5-9cf72f2c9c94 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73044d4a69d649acb214d74f42c950e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0696923efb3c49c087db1a92119a0a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:49.462337 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d73165aa-6886-4e46-aac5-9cf72f2c9c94 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] 10.222.0.23 "GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7" status: 200 len: 1324 microversion: 2.1 time: 0.389643 Oct 10 23:37:49.463261 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2052/4202] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:49 2022] GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7 => generated 1324 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:49.787586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-25b2c61d-e71b-4baa-afa5-39ff3f2c208f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:49.800430 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-25b2c61d-e71b-4baa-afa5-39ff3f2c208f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1502 microversion: 2.1 time: 1.445304 Oct 10 23:37:49.801756 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2151/4203] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:48 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1502 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:49.824558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2fa8a350-0224-459c-88d0-39bb52be6845 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:37:49.825540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2fa8a350-0224-459c-88d0-39bb52be6845 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:49.833753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fa8a350-0224-459c-88d0-39bb52be6845 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:49.834613 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fa8a350-0224-459c-88d0-39bb52be6845 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:49.835140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fa8a350-0224-459c-88d0-39bb52be6845 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:49.835918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fa8a350-0224-459c-88d0-39bb52be6845 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:49.836454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fa8a350-0224-459c-88d0-39bb52be6845 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:49.836938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fa8a350-0224-459c-88d0-39bb52be6845 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:49.867086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-2fa8a350-0224-459c-88d0-39bb52be6845 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lazy-loading 'flavor' on Instance uuid 961f5a5b-1142-497e-8b88-b16f193e66e4 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:37:50.080062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0d4f7454-1b7a-4ae2-aaad-9847fa75ae36 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:50.080959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0d4f7454-1b7a-4ae2-aaad-9847fa75ae36 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:50.089115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d4f7454-1b7a-4ae2-aaad-9847fa75ae36 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:50.095731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d4f7454-1b7a-4ae2-aaad-9847fa75ae36 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:50.096462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d4f7454-1b7a-4ae2-aaad-9847fa75ae36 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:50.097419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d4f7454-1b7a-4ae2-aaad-9847fa75ae36 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:50.098112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d4f7454-1b7a-4ae2-aaad-9847fa75ae36 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:50.099223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d4f7454-1b7a-4ae2-aaad-9847fa75ae36 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:50.214225 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2fa8a350-0224-459c-88d0-39bb52be6845 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "POST /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4/action" status: 202 len: 0 microversion: 2.1 time: 0.392827 Oct 10 23:37:50.216281 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2053/4204] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:37:49 2022] POST /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:37:50.226874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-49bab213-99de-41b9-b94b-5878c51d78b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:50.227925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-49bab213-99de-41b9-b94b-5878c51d78b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:50.236815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49bab213-99de-41b9-b94b-5878c51d78b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:50.237348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49bab213-99de-41b9-b94b-5878c51d78b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:50.237956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49bab213-99de-41b9-b94b-5878c51d78b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:50.239029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49bab213-99de-41b9-b94b-5878c51d78b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:50.239573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49bab213-99de-41b9-b94b-5878c51d78b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:50.240161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49bab213-99de-41b9-b94b-5878c51d78b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:50.430365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-49bab213-99de-41b9-b94b-5878c51d78b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:50.439340 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-49bab213-99de-41b9-b94b-5878c51d78b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1508 microversion: 2.1 time: 0.217575 Oct 10 23:37:50.441396 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2054/4205] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:50 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1508 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:37:50.493361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d08739a7-5f65-4241-8d77-626ff5a12164 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:50.494956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d08739a7-5f65-4241-8d77-626ff5a12164 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] [instance: 909982c3-4e0f-4811-b8f9-2f085d7c31c7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:50.504853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d08739a7-5f65-4241-8d77-626ff5a12164 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:50.505360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d08739a7-5f65-4241-8d77-626ff5a12164 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:50.505828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d08739a7-5f65-4241-8d77-626ff5a12164 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:50.506668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d08739a7-5f65-4241-8d77-626ff5a12164 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:50.507134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d08739a7-5f65-4241-8d77-626ff5a12164 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:50.508018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d08739a7-5f65-4241-8d77-626ff5a12164 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:50.635166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0d4f7454-1b7a-4ae2-aaad-9847fa75ae36 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:50.652151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0d4f7454-1b7a-4ae2-aaad-9847fa75ae36 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:50.653644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0d4f7454-1b7a-4ae2-aaad-9847fa75ae36 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:50.654862 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0d4f7454-1b7a-4ae2-aaad-9847fa75ae36 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1741 microversion: 2.20 time: 0.580003 Oct 10 23:37:50.655441 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2152/4206] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:50 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1741 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:37:50.706344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0c982565-f435-4bbc-9b35-6617d9c4cc80 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e97dcbca-8980-452c-b03c-3541e1be961e"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:37:50.717486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0c982565-f435-4bbc-9b35-6617d9c4cc80 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:50.724033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0c982565-f435-4bbc-9b35-6617d9c4cc80 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:50.724535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0c982565-f435-4bbc-9b35-6617d9c4cc80 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:50.724981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0c982565-f435-4bbc-9b35-6617d9c4cc80 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:50.725725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0c982565-f435-4bbc-9b35-6617d9c4cc80 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:50.726345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0c982565-f435-4bbc-9b35-6617d9c4cc80 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:50.726785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0c982565-f435-4bbc-9b35-6617d9c4cc80 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:51.060312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d08739a7-5f65-4241-8d77-626ff5a12164 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73044d4a69d649acb214d74f42c950e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0696923efb3c49c087db1a92119a0a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:51.075426 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d08739a7-5f65-4241-8d77-626ff5a12164 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] 10.222.0.23 "GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7" status: 200 len: 1324 microversion: 2.1 time: 0.586779 Oct 10 23:37:51.091148 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2055/4207] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:50 2022] GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7 => generated 1324 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:51.240949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-49edbef7-7e41-4d0b-9e98-aba77414516a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-61338750", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:37:51.293863 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0c982565-f435-4bbc-9b35-6617d9c4cc80 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "POST /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.594195 Oct 10 23:37:51.295356 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2153/4208] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Oct 10 23:37:50 2022] POST /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments => generated 194 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:37:51.412608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-49edbef7-7e41-4d0b-9e98-aba77414516a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] validate_networks() for [('dc12d571-0c0a-4079-aba6-42ef73a68903', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:37:51.465092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2512e873-9045-42c1-a055-190c4b23532f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:51.466971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2512e873-9045-42c1-a055-190c4b23532f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:51.484137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2512e873-9045-42c1-a055-190c4b23532f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:51.495551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2512e873-9045-42c1-a055-190c4b23532f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:51.497084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2512e873-9045-42c1-a055-190c4b23532f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:51.498357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2512e873-9045-42c1-a055-190c4b23532f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:51.499080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2512e873-9045-42c1-a055-190c4b23532f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:51.499754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2512e873-9045-42c1-a055-190c4b23532f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:51.510372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:37:51.998022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2512e873-9045-42c1-a055-190c4b23532f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:52.014456 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2512e873-9045-42c1-a055-190c4b23532f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1508 microversion: 2.1 time: 0.553757 Oct 10 23:37:52.015224 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2154/4209] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:51 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1508 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:37:52.030097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2a4545cd-c1ef-450c-b302-b053dfc68676 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:52.030545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2a4545cd-c1ef-450c-b302-b053dfc68676 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:52.043152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a4545cd-c1ef-450c-b302-b053dfc68676 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:52.043152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a4545cd-c1ef-450c-b302-b053dfc68676 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:52.043628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a4545cd-c1ef-450c-b302-b053dfc68676 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:52.044304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a4545cd-c1ef-450c-b302-b053dfc68676 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:52.044776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a4545cd-c1ef-450c-b302-b053dfc68676 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:52.045211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a4545cd-c1ef-450c-b302-b053dfc68676 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:52.379504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2a4545cd-c1ef-450c-b302-b053dfc68676 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:52.394525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2a4545cd-c1ef-450c-b302-b053dfc68676 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:52.396003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2a4545cd-c1ef-450c-b302-b053dfc68676 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:52.397236 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2a4545cd-c1ef-450c-b302-b053dfc68676 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1741 microversion: 2.20 time: 0.381296 Oct 10 23:37:52.402416 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2155/4210] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:52 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1741 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:37:52.415752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fe5e898e-3cff-47fc-b756-3c3bc35462b7 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:52.416506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fe5e898e-3cff-47fc-b756-3c3bc35462b7 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] [instance: 909982c3-4e0f-4811-b8f9-2f085d7c31c7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:52.427111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe5e898e-3cff-47fc-b756-3c3bc35462b7 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:52.427605 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe5e898e-3cff-47fc-b756-3c3bc35462b7 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:52.428072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe5e898e-3cff-47fc-b756-3c3bc35462b7 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:52.428778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe5e898e-3cff-47fc-b756-3c3bc35462b7 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:52.429504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe5e898e-3cff-47fc-b756-3c3bc35462b7 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:52.429913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe5e898e-3cff-47fc-b756-3c3bc35462b7 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:53.046708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fe5e898e-3cff-47fc-b756-3c3bc35462b7 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73044d4a69d649acb214d74f42c950e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0696923efb3c49c087db1a92119a0a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:53.069317 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fe5e898e-3cff-47fc-b756-3c3bc35462b7 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] 10.222.0.23 "GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7" status: 200 len: 1324 microversion: 2.1 time: 0.654623 Oct 10 23:37:53.070064 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2156/4211] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:52 2022] GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7 => generated 1324 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:53.110886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-83bef9ba-89c2-4d58-b6fb-566d493184d4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:53.112902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-83bef9ba-89c2-4d58-b6fb-566d493184d4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:53.131881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83bef9ba-89c2-4d58-b6fb-566d493184d4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:53.133597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83bef9ba-89c2-4d58-b6fb-566d493184d4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:53.134085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83bef9ba-89c2-4d58-b6fb-566d493184d4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:53.139277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83bef9ba-89c2-4d58-b6fb-566d493184d4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:53.139775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83bef9ba-89c2-4d58-b6fb-566d493184d4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:53.140224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83bef9ba-89c2-4d58-b6fb-566d493184d4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:53.322250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-49edbef7-7e41-4d0b-9e98-aba77414516a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:37:53.323288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-49edbef7-7e41-4d0b-9e98-aba77414516a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:37:53.323930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-49edbef7-7e41-4d0b-9e98-aba77414516a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:37:53.324772 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-49edbef7-7e41-4d0b-9e98-aba77414516a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:37:53.325342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-49edbef7-7e41-4d0b-9e98-aba77414516a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:37:53.341809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49edbef7-7e41-4d0b-9e98-aba77414516a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:53.342988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49edbef7-7e41-4d0b-9e98-aba77414516a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:53.343622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49edbef7-7e41-4d0b-9e98-aba77414516a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:53.345526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49edbef7-7e41-4d0b-9e98-aba77414516a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:53.346210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49edbef7-7e41-4d0b-9e98-aba77414516a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:53.346807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49edbef7-7e41-4d0b-9e98-aba77414516a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:53.369352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-49edbef7-7e41-4d0b-9e98-aba77414516a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Getting quotas for project 8986c214fcc944acb2731cc5af19ef0c. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:37:53.375902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-49edbef7-7e41-4d0b-9e98-aba77414516a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Getting quotas for user 585d2834c2a94c5eaa8267cf2ba58ac0 and project 8986c214fcc944acb2731cc5af19ef0c. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:37:53.393785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-49edbef7-7e41-4d0b-9e98-aba77414516a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:37:53.397049 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-49edbef7-7e41-4d0b-9e98-aba77414516a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:37:53.482575 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-49edbef7-7e41-4d0b-9e98-aba77414516a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.318721 Oct 10 23:37:53.485698 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2056/4212] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:37:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 2324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:37:53.496678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-adce118a-00d6-4d50-96b8-88d0b37872f6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:53.498819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-adce118a-00d6-4d50-96b8-88d0b37872f6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:53.520991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adce118a-00d6-4d50-96b8-88d0b37872f6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:53.523099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adce118a-00d6-4d50-96b8-88d0b37872f6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:53.523915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adce118a-00d6-4d50-96b8-88d0b37872f6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:53.524818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adce118a-00d6-4d50-96b8-88d0b37872f6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:53.529259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adce118a-00d6-4d50-96b8-88d0b37872f6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:53.529926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-adce118a-00d6-4d50-96b8-88d0b37872f6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:53.894059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-adce118a-00d6-4d50-96b8-88d0b37872f6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:53.906068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-adce118a-00d6-4d50-96b8-88d0b37872f6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:53.908669 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-adce118a-00d6-4d50-96b8-88d0b37872f6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:53.910044 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-adce118a-00d6-4d50-96b8-88d0b37872f6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1741 microversion: 2.20 time: 0.422491 Oct 10 23:37:53.911072 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2057/4213] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:53 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1741 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:37:53.915978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fbeb99a0-1ef9-4a81-a781-344301db0eaf tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:53.917532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fbeb99a0-1ef9-4a81-a781-344301db0eaf tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:54.002917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fbeb99a0-1ef9-4a81-a781-344301db0eaf tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:54.008274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-83bef9ba-89c2-4d58-b6fb-566d493184d4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:54.011250 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fbeb99a0-1ef9-4a81-a781-344301db0eaf tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1220 microversion: 2.1 time: 0.099032 Oct 10 23:37:54.039054 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2058/4214] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:53 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1220 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:54.060001 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-83bef9ba-89c2-4d58-b6fb-566d493184d4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1508 microversion: 2.1 time: 0.958981 Oct 10 23:37:54.064923 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2157/4215] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:53 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1508 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:54.102503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2a05e289-d7e8-4a04-9fa1-85db771a8436 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:54.103319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2a05e289-d7e8-4a04-9fa1-85db771a8436 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] [instance: 909982c3-4e0f-4811-b8f9-2f085d7c31c7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:54.124353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a05e289-d7e8-4a04-9fa1-85db771a8436 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:54.124986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a05e289-d7e8-4a04-9fa1-85db771a8436 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:54.126131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a05e289-d7e8-4a04-9fa1-85db771a8436 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:54.130733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a05e289-d7e8-4a04-9fa1-85db771a8436 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:54.132523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a05e289-d7e8-4a04-9fa1-85db771a8436 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:54.133459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a05e289-d7e8-4a04-9fa1-85db771a8436 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:54.179085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d4db6649-1c37-4c82-b035-7271c514786c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1898170746", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:37:54.282419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-d4db6649-1c37-4c82-b035-7271c514786c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] validate_networks() for [('dc12d571-0c0a-4079-aba6-42ef73a68903', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:37:54.499986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2a05e289-d7e8-4a04-9fa1-85db771a8436 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73044d4a69d649acb214d74f42c950e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0696923efb3c49c087db1a92119a0a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:54.510779 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2a05e289-d7e8-4a04-9fa1-85db771a8436 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] 10.222.0.23 "GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7" status: 200 len: 1324 microversion: 2.1 time: 0.418310 Oct 10 23:37:54.533422 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2059/4216] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:54 2022] GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7 => generated 1324 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:54.953962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6a27b81a-b3c3-4154-87dc-7047b49e078d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:54.954665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6a27b81a-b3c3-4154-87dc-7047b49e078d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:54.961688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a27b81a-b3c3-4154-87dc-7047b49e078d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:54.970866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a27b81a-b3c3-4154-87dc-7047b49e078d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:54.971666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a27b81a-b3c3-4154-87dc-7047b49e078d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:54.973060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a27b81a-b3c3-4154-87dc-7047b49e078d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:54.973795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a27b81a-b3c3-4154-87dc-7047b49e078d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:54.974478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a27b81a-b3c3-4154-87dc-7047b49e078d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:55.751541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6a27b81a-b3c3-4154-87dc-7047b49e078d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:55.816041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6a27b81a-b3c3-4154-87dc-7047b49e078d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:55.831622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6a27b81a-b3c3-4154-87dc-7047b49e078d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:55.834178 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6a27b81a-b3c3-4154-87dc-7047b49e078d tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1741 microversion: 2.20 time: 0.891208 Oct 10 23:37:55.839324 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2060/4217] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:54 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1741 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:37:55.860576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bb10239c-f268-48b2-bb1a-98f6bfb1f51d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:55.862378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bb10239c-f268-48b2-bb1a-98f6bfb1f51d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:55.913239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb10239c-f268-48b2-bb1a-98f6bfb1f51d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:55.914465 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb10239c-f268-48b2-bb1a-98f6bfb1f51d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:55.917472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb10239c-f268-48b2-bb1a-98f6bfb1f51d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:55.927748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb10239c-f268-48b2-bb1a-98f6bfb1f51d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:55.929105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb10239c-f268-48b2-bb1a-98f6bfb1f51d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:55.930064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb10239c-f268-48b2-bb1a-98f6bfb1f51d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:56.727308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d4db6649-1c37-4c82-b035-7271c514786c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:37:56.727827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d4db6649-1c37-4c82-b035-7271c514786c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:37:56.728218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d4db6649-1c37-4c82-b035-7271c514786c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:37:56.728639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d4db6649-1c37-4c82-b035-7271c514786c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:37:56.729369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d4db6649-1c37-4c82-b035-7271c514786c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:37:56.749868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4db6649-1c37-4c82-b035-7271c514786c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:56.754445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4db6649-1c37-4c82-b035-7271c514786c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:56.755043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4db6649-1c37-4c82-b035-7271c514786c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:56.755881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4db6649-1c37-4c82-b035-7271c514786c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:56.756365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4db6649-1c37-4c82-b035-7271c514786c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:56.756807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4db6649-1c37-4c82-b035-7271c514786c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:56.803660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-d4db6649-1c37-4c82-b035-7271c514786c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Getting quotas for project 8986c214fcc944acb2731cc5af19ef0c. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:37:56.837114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-d4db6649-1c37-4c82-b035-7271c514786c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Getting quotas for user 585d2834c2a94c5eaa8267cf2ba58ac0 and project 8986c214fcc944acb2731cc5af19ef0c. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:37:56.868278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d4db6649-1c37-4c82-b035-7271c514786c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:37:56.879500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d4db6649-1c37-4c82-b035-7271c514786c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:37:56.936561 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d4db6649-1c37-4c82-b035-7271c514786c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.762140 Oct 10 23:37:56.945686 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2158/4218] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:37:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 2772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:37:56.953246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ae03505f-eafb-4ab6-853e-608afda03b7a tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:56.954361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ae03505f-eafb-4ab6-853e-608afda03b7a tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] [instance: 909982c3-4e0f-4811-b8f9-2f085d7c31c7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:56.963595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae03505f-eafb-4ab6-853e-608afda03b7a tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:56.964328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae03505f-eafb-4ab6-853e-608afda03b7a tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:56.966095 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae03505f-eafb-4ab6-853e-608afda03b7a tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:56.967290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae03505f-eafb-4ab6-853e-608afda03b7a tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:56.968097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae03505f-eafb-4ab6-853e-608afda03b7a tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:56.968737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae03505f-eafb-4ab6-853e-608afda03b7a tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:57.149007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb10239c-f268-48b2-bb1a-98f6bfb1f51d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:57.163293 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bb10239c-f268-48b2-bb1a-98f6bfb1f51d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1508 microversion: 2.1 time: 1.314300 Oct 10 23:37:57.166132 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2061/4219] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:55 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1508 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:57.176175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ec2c1c16-6613-4120-951b-603eb959ad8b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:57.177069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ec2c1c16-6613-4120-951b-603eb959ad8b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:57.209765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec2c1c16-6613-4120-951b-603eb959ad8b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:57.210740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec2c1c16-6613-4120-951b-603eb959ad8b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:57.218175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec2c1c16-6613-4120-951b-603eb959ad8b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:57.218952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec2c1c16-6613-4120-951b-603eb959ad8b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:57.219867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec2c1c16-6613-4120-951b-603eb959ad8b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:57.221877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec2c1c16-6613-4120-951b-603eb959ad8b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:57.882661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ec2c1c16-6613-4120-951b-603eb959ad8b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:57.899125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ec2c1c16-6613-4120-951b-603eb959ad8b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:57.900584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ec2c1c16-6613-4120-951b-603eb959ad8b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:57.902451 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ec2c1c16-6613-4120-951b-603eb959ad8b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1741 microversion: 2.20 time: 0.734752 Oct 10 23:37:57.903666 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2062/4220] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:57 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1741 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:37:57.916467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-34528b1c-082e-4e39-948e-6f0f4965119c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:57.917655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-34528b1c-082e-4e39-948e-6f0f4965119c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:58.057647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-34528b1c-082e-4e39-948e-6f0f4965119c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:58.072328 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-34528b1c-082e-4e39-948e-6f0f4965119c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1222 microversion: 2.1 time: 0.167234 Oct 10 23:37:58.073003 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2063/4221] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:57 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1222 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:58.087373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-9ce91351-6738-4ec4-b134-2b86ab149ca6 req-62774032-2389-42d8-8258-a5ad1c361b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909982c3-4e0f-4811-b8f9-2f085d7c31c7", "name": "network-vif-plugged", "status": "completed", "tag": "a851375c-cfa5-4c3f-b784-24809890b8dc"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:37:58.088756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ae03505f-eafb-4ab6-853e-608afda03b7a tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73044d4a69d649acb214d74f42c950e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0696923efb3c49c087db1a92119a0a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:58.099298 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ae03505f-eafb-4ab6-853e-608afda03b7a tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] 10.222.0.23 "GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7" status: 200 len: 1324 microversion: 2.1 time: 1.151846 Oct 10 23:37:58.100557 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2159/4222] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:56 2022] GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7 => generated 1324 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:58.123031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9ce91351-6738-4ec4-b134-2b86ab149ca6 req-62774032-2389-42d8-8258-a5ad1c361b97 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:58.123619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9ce91351-6738-4ec4-b134-2b86ab149ca6 req-62774032-2389-42d8-8258-a5ad1c361b97 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:58.124127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9ce91351-6738-4ec4-b134-2b86ab149ca6 req-62774032-2389-42d8-8258-a5ad1c361b97 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:58.136781 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-9ce91351-6738-4ec4-b134-2b86ab149ca6 req-62774032-2389-42d8-8258-a5ad1c361b97 service nova] Creating event network-vif-plugged:a851375c-cfa5-4c3f-b784-24809890b8dc for instance 909982c3-4e0f-4811-b8f9-2f085d7c31c7 on n-h2-860864-2 Oct 10 23:37:58.143506 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-9ce91351-6738-4ec4-b134-2b86ab149ca6 req-62774032-2389-42d8-8258-a5ad1c361b97 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068789 Oct 10 23:37:58.144745 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2064/4223] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:37:58.192673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2d541c22-de22-428a-82fb-01ed49759b55 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:58.193391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2d541c22-de22-428a-82fb-01ed49759b55 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:58.223663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d541c22-de22-428a-82fb-01ed49759b55 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:58.225242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d541c22-de22-428a-82fb-01ed49759b55 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:58.225872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d541c22-de22-428a-82fb-01ed49759b55 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:58.227473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d541c22-de22-428a-82fb-01ed49759b55 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:58.228161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d541c22-de22-428a-82fb-01ed49759b55 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:58.228981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d541c22-de22-428a-82fb-01ed49759b55 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:58.468612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2d541c22-de22-428a-82fb-01ed49759b55 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:58.489529 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2d541c22-de22-428a-82fb-01ed49759b55 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1508 microversion: 2.1 time: 0.302437 Oct 10 23:37:58.492509 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2160/4224] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:58 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1508 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:58.933955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b5582ca7-6b15-40fd-a017-95037f0d9fac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:58.935451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b5582ca7-6b15-40fd-a017-95037f0d9fac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:58.950266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5582ca7-6b15-40fd-a017-95037f0d9fac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:58.951151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5582ca7-6b15-40fd-a017-95037f0d9fac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:58.954167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5582ca7-6b15-40fd-a017-95037f0d9fac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:58.956408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5582ca7-6b15-40fd-a017-95037f0d9fac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:58.957562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5582ca7-6b15-40fd-a017-95037f0d9fac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:58.958294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5582ca7-6b15-40fd-a017-95037f0d9fac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:59.104477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a2645639-b898-4d72-960e-8dc02c528f3e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:59.106458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a2645639-b898-4d72-960e-8dc02c528f3e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:59.115497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2645639-b898-4d72-960e-8dc02c528f3e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:59.116240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2645639-b898-4d72-960e-8dc02c528f3e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:59.116887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2645639-b898-4d72-960e-8dc02c528f3e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:59.117831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2645639-b898-4d72-960e-8dc02c528f3e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:59.118486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2645639-b898-4d72-960e-8dc02c528f3e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:59.119110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2645639-b898-4d72-960e-8dc02c528f3e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:59.254465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a2645639-b898-4d72-960e-8dc02c528f3e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:59.274745 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a2645639-b898-4d72-960e-8dc02c528f3e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1280 microversion: 2.1 time: 0.171170 Oct 10 23:37:59.275747 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2161/4225] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:59 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1280 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:37:59.280991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e6cbb928-ba0a-49f4-adfc-2e3a76b222c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:59.281664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e6cbb928-ba0a-49f4-adfc-2e3a76b222c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] [instance: 909982c3-4e0f-4811-b8f9-2f085d7c31c7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:59.306849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6cbb928-ba0a-49f4-adfc-2e3a76b222c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:59.307361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6cbb928-ba0a-49f4-adfc-2e3a76b222c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:59.307961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6cbb928-ba0a-49f4-adfc-2e3a76b222c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:59.308698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6cbb928-ba0a-49f4-adfc-2e3a76b222c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:59.309158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6cbb928-ba0a-49f4-adfc-2e3a76b222c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:59.309624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6cbb928-ba0a-49f4-adfc-2e3a76b222c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:59.515708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b5582ca7-6b15-40fd-a017-95037f0d9fac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:59.530556 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b5582ca7-6b15-40fd-a017-95037f0d9fac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:59.539421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b5582ca7-6b15-40fd-a017-95037f0d9fac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:59.543991 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b5582ca7-6b15-40fd-a017-95037f0d9fac tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1723 microversion: 2.20 time: 0.614091 Oct 10 23:37:59.561336 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2065/4226] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:37:58 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1723 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:37:59.576915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-63b4345a-d460-43a2-8f79-c4ae88eb89e2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:37:59.577843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-63b4345a-d460-43a2-8f79-c4ae88eb89e2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:37:59.598898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63b4345a-d460-43a2-8f79-c4ae88eb89e2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:59.599408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63b4345a-d460-43a2-8f79-c4ae88eb89e2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:59.599852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63b4345a-d460-43a2-8f79-c4ae88eb89e2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:59.604294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63b4345a-d460-43a2-8f79-c4ae88eb89e2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:37:59.604813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63b4345a-d460-43a2-8f79-c4ae88eb89e2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:37:59.605256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63b4345a-d460-43a2-8f79-c4ae88eb89e2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:37:59.853870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e6cbb928-ba0a-49f4-adfc-2e3a76b222c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73044d4a69d649acb214d74f42c950e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0696923efb3c49c087db1a92119a0a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:37:59.873596 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e6cbb928-ba0a-49f4-adfc-2e3a76b222c5 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] 10.222.0.23 "GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7" status: 200 len: 1324 microversion: 2.1 time: 0.596443 Oct 10 23:37:59.889812 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2162/4227] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:59 2022] GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7 => generated 1324 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:00.305437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ef70c325-f38c-4319-9102-07dc02675463 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:00.306394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ef70c325-f38c-4319-9102-07dc02675463 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:00.314117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef70c325-f38c-4319-9102-07dc02675463 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:00.314662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef70c325-f38c-4319-9102-07dc02675463 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:00.315113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef70c325-f38c-4319-9102-07dc02675463 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:00.315827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef70c325-f38c-4319-9102-07dc02675463 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:00.316277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef70c325-f38c-4319-9102-07dc02675463 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:00.316701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef70c325-f38c-4319-9102-07dc02675463 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:00.471713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ef70c325-f38c-4319-9102-07dc02675463 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:00.481959 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ef70c325-f38c-4319-9102-07dc02675463 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1280 microversion: 2.1 time: 0.180322 Oct 10 23:38:00.483749 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2163/4228] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:00 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1280 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:38:00.576873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a3133b26-193f-426b-829c-71380771eb3f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:00.580243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a3133b26-193f-426b-829c-71380771eb3f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:00.584675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3133b26-193f-426b-829c-71380771eb3f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:00.585560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3133b26-193f-426b-829c-71380771eb3f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:00.586008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3133b26-193f-426b-829c-71380771eb3f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:00.586724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3133b26-193f-426b-829c-71380771eb3f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:00.587181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3133b26-193f-426b-829c-71380771eb3f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:00.587614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3133b26-193f-426b-829c-71380771eb3f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:00.588994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-63b4345a-d460-43a2-8f79-c4ae88eb89e2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:00.597257 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-63b4345a-d460-43a2-8f79-c4ae88eb89e2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1508 microversion: 2.1 time: 1.034353 Oct 10 23:38:00.598613 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2066/4229] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:37:59 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1508 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:00.749969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a3133b26-193f-426b-829c-71380771eb3f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:00.761277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a3133b26-193f-426b-829c-71380771eb3f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:00.762751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a3133b26-193f-426b-829c-71380771eb3f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:00.764150 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a3133b26-193f-426b-829c-71380771eb3f tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1723 microversion: 2.20 time: 0.191630 Oct 10 23:38:00.764730 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2164/4230] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:38:00 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:38:00.901712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aec9a8c0-4f06-4674-8e34-98893c8d19f9 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:00.902603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aec9a8c0-4f06-4674-8e34-98893c8d19f9 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] [instance: 909982c3-4e0f-4811-b8f9-2f085d7c31c7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:00.909362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aec9a8c0-4f06-4674-8e34-98893c8d19f9 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:00.909893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aec9a8c0-4f06-4674-8e34-98893c8d19f9 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:00.910321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aec9a8c0-4f06-4674-8e34-98893c8d19f9 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:00.911215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aec9a8c0-4f06-4674-8e34-98893c8d19f9 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:00.911670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aec9a8c0-4f06-4674-8e34-98893c8d19f9 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:00.912096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aec9a8c0-4f06-4674-8e34-98893c8d19f9 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:01.279759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aec9a8c0-4f06-4674-8e34-98893c8d19f9 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73044d4a69d649acb214d74f42c950e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0696923efb3c49c087db1a92119a0a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:01.293076 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aec9a8c0-4f06-4674-8e34-98893c8d19f9 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] 10.222.0.23 "GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7" status: 200 len: 1521 microversion: 2.1 time: 0.395336 Oct 10 23:38:01.294710 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2067/4231] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:00 2022] GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7 => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:01.321191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7945e75c-1929-447f-9ddd-6ed803b804c0 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:01.322065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7945e75c-1929-447f-9ddd-6ed803b804c0 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] [instance: 909982c3-4e0f-4811-b8f9-2f085d7c31c7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:01.331724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7945e75c-1929-447f-9ddd-6ed803b804c0 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:01.332223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7945e75c-1929-447f-9ddd-6ed803b804c0 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:01.332664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7945e75c-1929-447f-9ddd-6ed803b804c0 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:01.333414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7945e75c-1929-447f-9ddd-6ed803b804c0 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:01.333868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7945e75c-1929-447f-9ddd-6ed803b804c0 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:01.334287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7945e75c-1929-447f-9ddd-6ed803b804c0 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:01.382847 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-7945e75c-1929-447f-9ddd-6ed803b804c0 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] HTTP exception thrown: Action 999 not found Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7945e75c-1929-447f-9ddd-6ed803b804c0 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Request method failure captured: Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7/os-instance-actions/999 HTTP/1.1 Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKy_IqbRpDRXY-wT2NOUy_8q6oycen6R3pOw3ogYeii8Aslc0AOSQKC7fyLY6Vnm6mtBH9pERypB1yy6T_CkgrnPD5R_fZG-yzVW_8VeneC97uDAgznEEKxmMrUj3ch1K-Xoz1NUBAJUL5GwG9plVg4s-qbammgLYtiRxBlo_DPB8sI Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 0696923efb3c49c087db1a92119a0a04 Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-289315660 Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0696923efb3c49c087db1a92119a0a04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0696923efb3c49c087db1a92119a0a04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0696923efb3c49c087db1a92119a0a04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0696923efb3c49c087db1a92119a0a04", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-289315660 Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 0696923efb3c49c087db1a92119a0a04 Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-289315660 Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-InstanceActionsNegativeTestJSON-289315660-project Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 73044d4a69d649acb214d74f42c950e4 Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-289315660-project Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: exception: Action 999 not found Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'server_id': '909982c3-4e0f-4811-b8f9-2f085d7c31c7', 'id': '999'} Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 10 23:38:01.393163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:38:01.398854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7945e75c-1929-447f-9ddd-6ed803b804c0 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Returning 404 to user: Action 999 not found {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:38:01.399863 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7945e75c-1929-447f-9ddd-6ed803b804c0 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] 10.222.0.23 "GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.083187 Oct 10 23:38:01.400583 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2165/4232] 10.222.0.23 () {58 vars in 1308 bytes} [Mon Oct 10 23:38:01 2022] GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7/os-instance-actions/999 => generated 66 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:38:01.412945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-447d7e72-4704-4cb0-bd3c-c419546c0763 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Calling method '.version_select at 0x7f662a863700>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:01.413925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-447d7e72-4704-4cb0-bd3c-c419546c0763 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] [instance: 75c0464b-0b28-4e70-afca-66bdd0491903] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:01.423851 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-447d7e72-4704-4cb0-bd3c-c419546c0763 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] HTTP exception thrown: Instance 75c0464b-0b28-4e70-afca-66bdd0491903 could not be found. Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-447d7e72-4704-4cb0-bd3c-c419546c0763 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Request method failure captured: Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/75c0464b-0b28-4e70-afca-66bdd0491903/os-instance-actions HTTP/1.1 Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKy_IqbRpDRXY-wT2NOUy_8q6oycen6R3pOw3ogYeii8Aslc0AOSQKC7fyLY6Vnm6mtBH9pERypB1yy6T_CkgrnPD5R_fZG-yzVW_8VeneC97uDAgznEEKxmMrUj3ch1K-Xoz1NUBAJUL5GwG9plVg4s-qbammgLYtiRxBlo_DPB8sI Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 0696923efb3c49c087db1a92119a0a04 Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-289315660 Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0696923efb3c49c087db1a92119a0a04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0696923efb3c49c087db1a92119a0a04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0696923efb3c49c087db1a92119a0a04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0696923efb3c49c087db1a92119a0a04", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-289315660 Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 0696923efb3c49c087db1a92119a0a04 Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-289315660 Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-InstanceActionsNegativeTestJSON-289315660-project Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 73044d4a69d649acb214d74f42c950e4 Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-289315660-project Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 75c0464b-0b28-4e70-afca-66bdd0491903 could not be found. Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'server_id': '75c0464b-0b28-4e70-afca-66bdd0491903'} Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75c0464b-0b28-4e70-afca-66bdd0491903 could not be found. Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:38:01.426069 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:38:01.433631 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75c0464b-0b28-4e70-afca-66bdd0491903 could not be found. Oct 10 23:38:01.433631 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:01.433631 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:38:01.433631 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:01.433631 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:01.433631 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:38:01.433631 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:38:01.433631 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:38:01.433631 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:38:01.433631 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75c0464b-0b28-4e70-afca-66bdd0491903 could not be found. Oct 10 23:38:01.433631 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:01.433631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-447d7e72-4704-4cb0-bd3c-c419546c0763 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Returning 404 to user: Instance 75c0464b-0b28-4e70-afca-66bdd0491903 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:38:01.433631 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-447d7e72-4704-4cb0-bd3c-c419546c0763 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] 10.222.0.23 "GET /compute/v2.1/servers/75c0464b-0b28-4e70-afca-66bdd0491903/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.019696 Oct 10 23:38:01.433631 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2068/4233] 10.222.0.23 () {58 vars in 1296 bytes} [Mon Oct 10 23:38:01 2022] GET /compute/v2.1/servers/75c0464b-0b28-4e70-afca-66bdd0491903/os-instance-actions => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:38:01.440860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e54107ee-97cc-435f-9614-1c8dd5ce1363 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:01.441602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e54107ee-97cc-435f-9614-1c8dd5ce1363 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] [instance: 909982c3-4e0f-4811-b8f9-2f085d7c31c7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:01.450555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e54107ee-97cc-435f-9614-1c8dd5ce1363 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:01.452918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e54107ee-97cc-435f-9614-1c8dd5ce1363 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:01.456810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e54107ee-97cc-435f-9614-1c8dd5ce1363 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:01.459277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e54107ee-97cc-435f-9614-1c8dd5ce1363 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:01.459775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e54107ee-97cc-435f-9614-1c8dd5ce1363 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:01.464928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e54107ee-97cc-435f-9614-1c8dd5ce1363 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:01.502491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e54107ee-97cc-435f-9614-1c8dd5ce1363 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] [instance: 909982c3-4e0f-4811-b8f9-2f085d7c31c7] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:38:01.508654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-24783aed-5038-4f3b-9562-3fdb3b6fa6e1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:01.509478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-24783aed-5038-4f3b-9562-3fdb3b6fa6e1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:01.523349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24783aed-5038-4f3b-9562-3fdb3b6fa6e1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:01.523894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24783aed-5038-4f3b-9562-3fdb3b6fa6e1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:01.524579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24783aed-5038-4f3b-9562-3fdb3b6fa6e1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:01.526107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24783aed-5038-4f3b-9562-3fdb3b6fa6e1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:01.526810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24783aed-5038-4f3b-9562-3fdb3b6fa6e1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:01.527512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24783aed-5038-4f3b-9562-3fdb3b6fa6e1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:01.603919 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e54107ee-97cc-435f-9614-1c8dd5ce1363 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] 10.222.0.23 "DELETE /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7" status: 204 len: 0 microversion: 2.1 time: 0.167958 Oct 10 23:38:01.605187 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2166/4234] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:38:01 2022] DELETE /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:38:01.617537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9ac65974-3082-45aa-9470-2c952d705381 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:01.618505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9ac65974-3082-45aa-9470-2c952d705381 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] [instance: 909982c3-4e0f-4811-b8f9-2f085d7c31c7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:01.625116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ac65974-3082-45aa-9470-2c952d705381 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:01.626658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ac65974-3082-45aa-9470-2c952d705381 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:01.627383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ac65974-3082-45aa-9470-2c952d705381 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:01.628281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ac65974-3082-45aa-9470-2c952d705381 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:01.629044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ac65974-3082-45aa-9470-2c952d705381 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:01.629545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ac65974-3082-45aa-9470-2c952d705381 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:01.643575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-24783aed-5038-4f3b-9562-3fdb3b6fa6e1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:01.662220 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-24783aed-5038-4f3b-9562-3fdb3b6fa6e1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1280 microversion: 2.1 time: 0.158798 Oct 10 23:38:01.662844 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2069/4235] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:01 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1280 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:01.674542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8a0e8679-ea9d-4f3b-8c2e-34526e30654b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:01.675195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8a0e8679-ea9d-4f3b-8c2e-34526e30654b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:01.681490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a0e8679-ea9d-4f3b-8c2e-34526e30654b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:01.682233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a0e8679-ea9d-4f3b-8c2e-34526e30654b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:01.682870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a0e8679-ea9d-4f3b-8c2e-34526e30654b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:01.683765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a0e8679-ea9d-4f3b-8c2e-34526e30654b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:01.684407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a0e8679-ea9d-4f3b-8c2e-34526e30654b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:01.685027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a0e8679-ea9d-4f3b-8c2e-34526e30654b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:01.691642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:01.891181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9ac65974-3082-45aa-9470-2c952d705381 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73044d4a69d649acb214d74f42c950e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0696923efb3c49c087db1a92119a0a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:01.901918 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9ac65974-3082-45aa-9470-2c952d705381 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] 10.222.0.23 "GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7" status: 200 len: 1527 microversion: 2.1 time: 0.290843 Oct 10 23:38:01.902732 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2167/4236] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:01 2022] GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7 => generated 1527 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:01.924974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-aa343d8e-95f9-49d6-93ad-5a53089a3cc6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:01.925927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-aa343d8e-95f9-49d6-93ad-5a53089a3cc6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:01.932318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa343d8e-95f9-49d6-93ad-5a53089a3cc6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:01.933074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa343d8e-95f9-49d6-93ad-5a53089a3cc6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:01.933643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa343d8e-95f9-49d6-93ad-5a53089a3cc6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:01.934595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa343d8e-95f9-49d6-93ad-5a53089a3cc6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:01.935160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa343d8e-95f9-49d6-93ad-5a53089a3cc6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:01.936110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa343d8e-95f9-49d6-93ad-5a53089a3cc6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:02.036777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8a0e8679-ea9d-4f3b-8c2e-34526e30654b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:02.050224 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8a0e8679-ea9d-4f3b-8c2e-34526e30654b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1508 microversion: 2.1 time: 0.386229 Oct 10 23:38:02.061459 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2070/4237] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:01 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1508 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:02.072985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-beca9c1b-00c0-4db4-98ad-393c51995414 req-c267d2f2-e265-49cc-b6a0-f6ea488a5402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f5c98e-777a-4d5b-aed5-89fd026f1734", "name": "network-vif-unplugged", "status": "completed", "tag": "14e55a18-a2c4-41ce-8ca8-1d0de903ab65"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:02.089930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-beca9c1b-00c0-4db4-98ad-393c51995414 req-c267d2f2-e265-49cc-b6a0-f6ea488a5402 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:02.090647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-beca9c1b-00c0-4db4-98ad-393c51995414 req-c267d2f2-e265-49cc-b6a0-f6ea488a5402 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:02.091254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-beca9c1b-00c0-4db4-98ad-393c51995414 req-c267d2f2-e265-49cc-b6a0-f6ea488a5402 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:02.101590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-aa343d8e-95f9-49d6-93ad-5a53089a3cc6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:02.112263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-aa343d8e-95f9-49d6-93ad-5a53089a3cc6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:02.114224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-aa343d8e-95f9-49d6-93ad-5a53089a3cc6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:02.115617 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-aa343d8e-95f9-49d6-93ad-5a53089a3cc6 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1723 microversion: 2.20 time: 0.195845 Oct 10 23:38:02.122342 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-beca9c1b-00c0-4db4-98ad-393c51995414 req-c267d2f2-e265-49cc-b6a0-f6ea488a5402 service nova] Creating event network-vif-unplugged:14e55a18-a2c4-41ce-8ca8-1d0de903ab65 for instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 on n-h2-860864-2 Oct 10 23:38:02.126171 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2168/4238] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:38:01 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:38:02.128451 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-beca9c1b-00c0-4db4-98ad-393c51995414 req-c267d2f2-e265-49cc-b6a0-f6ea488a5402 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065285 Oct 10 23:38:02.129551 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2071/4239] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:02.401343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-1db5df34-ae44-48e9-9067-064e3001438f req-3c478d46-6d78-4a7b-8842-3b6f42e6f035 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f01cc76-fa39-4e39-8e4d-e0263388c690", "tag": "0e86eed0-1a80-408f-a2af-bad1d359822c"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:02.433358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1db5df34-ae44-48e9-9067-064e3001438f req-3c478d46-6d78-4a7b-8842-3b6f42e6f035 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:02.434254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1db5df34-ae44-48e9-9067-064e3001438f req-3c478d46-6d78-4a7b-8842-3b6f42e6f035 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:02.434703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1db5df34-ae44-48e9-9067-064e3001438f req-3c478d46-6d78-4a7b-8842-3b6f42e6f035 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:02.449008 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-1db5df34-ae44-48e9-9067-064e3001438f req-3c478d46-6d78-4a7b-8842-3b6f42e6f035 service nova] Creating event network-changed:0e86eed0-1a80-408f-a2af-bad1d359822c for instance 0f01cc76-fa39-4e39-8e4d-e0263388c690 on n-h1-860864-2 Oct 10 23:38:02.456947 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-1db5df34-ae44-48e9-9067-064e3001438f req-3c478d46-6d78-4a7b-8842-3b6f42e6f035 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059708 Oct 10 23:38:02.457601 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2169/4240] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:02.686845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ffd53d55-e2d3-4e88-b802-6fe9869def74 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:02.687557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ffd53d55-e2d3-4e88-b802-6fe9869def74 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:02.703052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffd53d55-e2d3-4e88-b802-6fe9869def74 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:02.705754 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffd53d55-e2d3-4e88-b802-6fe9869def74 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:02.706575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffd53d55-e2d3-4e88-b802-6fe9869def74 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:02.707548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffd53d55-e2d3-4e88-b802-6fe9869def74 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:02.708209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffd53d55-e2d3-4e88-b802-6fe9869def74 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:02.709033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffd53d55-e2d3-4e88-b802-6fe9869def74 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:02.940358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d7de32d6-132d-46dd-8203-d17515b6f7b4 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:02.942920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d7de32d6-132d-46dd-8203-d17515b6f7b4 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] [instance: 909982c3-4e0f-4811-b8f9-2f085d7c31c7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:02.961590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7de32d6-132d-46dd-8203-d17515b6f7b4 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:02.962463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7de32d6-132d-46dd-8203-d17515b6f7b4 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:02.963270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7de32d6-132d-46dd-8203-d17515b6f7b4 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:02.964860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7de32d6-132d-46dd-8203-d17515b6f7b4 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:02.965867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7de32d6-132d-46dd-8203-d17515b6f7b4 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:02.966615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7de32d6-132d-46dd-8203-d17515b6f7b4 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:02.987371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:03.035553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ffd53d55-e2d3-4e88-b802-6fe9869def74 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:03.043999 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ffd53d55-e2d3-4e88-b802-6fe9869def74 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1322 microversion: 2.1 time: 0.361737 Oct 10 23:38:03.044601 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2072/4241] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:02 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1322 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:03.079728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-755ccfe7-a668-4dd6-8663-2d2aa0ab3403 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:03.080659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-755ccfe7-a668-4dd6-8663-2d2aa0ab3403 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:03.087826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-755ccfe7-a668-4dd6-8663-2d2aa0ab3403 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:03.089442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-755ccfe7-a668-4dd6-8663-2d2aa0ab3403 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:03.093799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-755ccfe7-a668-4dd6-8663-2d2aa0ab3403 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:03.095476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-755ccfe7-a668-4dd6-8663-2d2aa0ab3403 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:03.099535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-755ccfe7-a668-4dd6-8663-2d2aa0ab3403 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:03.100156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-755ccfe7-a668-4dd6-8663-2d2aa0ab3403 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:03.236612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d7de32d6-132d-46dd-8203-d17515b6f7b4 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73044d4a69d649acb214d74f42c950e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0696923efb3c49c087db1a92119a0a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:03.244659 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d7de32d6-132d-46dd-8203-d17515b6f7b4 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] 10.222.0.23 "GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7" status: 200 len: 1527 microversion: 2.1 time: 0.318081 Oct 10 23:38:03.245407 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2170/4242] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:02 2022] GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7 => generated 1527 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:03.252918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c39a1603-b476-4b39-a69c-43b8c5be1213 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:03.253833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c39a1603-b476-4b39-a69c-43b8c5be1213 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:03.265591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c39a1603-b476-4b39-a69c-43b8c5be1213 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:03.267497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c39a1603-b476-4b39-a69c-43b8c5be1213 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:03.268256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c39a1603-b476-4b39-a69c-43b8c5be1213 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:03.269085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c39a1603-b476-4b39-a69c-43b8c5be1213 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:03.269935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c39a1603-b476-4b39-a69c-43b8c5be1213 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:03.270435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c39a1603-b476-4b39-a69c-43b8c5be1213 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:03.358591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:03.428739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-755ccfe7-a668-4dd6-8663-2d2aa0ab3403 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:03.437660 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-755ccfe7-a668-4dd6-8663-2d2aa0ab3403 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1508 microversion: 2.1 time: 0.365263 Oct 10 23:38:03.457959 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2073/4243] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:03 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1508 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:03.514092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c39a1603-b476-4b39-a69c-43b8c5be1213 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:03.523324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c39a1603-b476-4b39-a69c-43b8c5be1213 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:03.524909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c39a1603-b476-4b39-a69c-43b8c5be1213 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:03.527293 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c39a1603-b476-4b39-a69c-43b8c5be1213 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1723 microversion: 2.20 time: 0.280696 Oct 10 23:38:03.527867 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2171/4244] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:38:03 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:38:04.074171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-787767b2-adb2-41c7-9ff4-1691e82933cc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:04.075174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-787767b2-adb2-41c7-9ff4-1691e82933cc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:04.077581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:04.084038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-787767b2-adb2-41c7-9ff4-1691e82933cc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:04.084586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-787767b2-adb2-41c7-9ff4-1691e82933cc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:04.085022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-787767b2-adb2-41c7-9ff4-1691e82933cc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:04.085748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-787767b2-adb2-41c7-9ff4-1691e82933cc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:04.086201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-787767b2-adb2-41c7-9ff4-1691e82933cc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:04.086751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-787767b2-adb2-41c7-9ff4-1691e82933cc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:04.282392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3979dc0d-87f2-4016-8402-f3f2d4e7b9c7 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:04.283283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3979dc0d-87f2-4016-8402-f3f2d4e7b9c7 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] [instance: 909982c3-4e0f-4811-b8f9-2f085d7c31c7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:04.290608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3979dc0d-87f2-4016-8402-f3f2d4e7b9c7 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:04.291118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3979dc0d-87f2-4016-8402-f3f2d4e7b9c7 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:04.291594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3979dc0d-87f2-4016-8402-f3f2d4e7b9c7 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:04.292320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3979dc0d-87f2-4016-8402-f3f2d4e7b9c7 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:04.292784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3979dc0d-87f2-4016-8402-f3f2d4e7b9c7 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:04.293418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3979dc0d-87f2-4016-8402-f3f2d4e7b9c7 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:04.466039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3979dc0d-87f2-4016-8402-f3f2d4e7b9c7 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73044d4a69d649acb214d74f42c950e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0696923efb3c49c087db1a92119a0a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:04.477022 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3979dc0d-87f2-4016-8402-f3f2d4e7b9c7 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] 10.222.0.23 "GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7" status: 200 len: 1527 microversion: 2.1 time: 0.199613 Oct 10 23:38:04.490503 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2172/4245] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:04 2022] GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7 => generated 1527 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:04.499632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9d4c1fef-986f-4fa2-a116-7c826c856f42 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:04.501743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9d4c1fef-986f-4fa2-a116-7c826c856f42 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:04.516105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d4c1fef-986f-4fa2-a116-7c826c856f42 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:04.520998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d4c1fef-986f-4fa2-a116-7c826c856f42 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:04.522012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d4c1fef-986f-4fa2-a116-7c826c856f42 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:04.523871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d4c1fef-986f-4fa2-a116-7c826c856f42 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:04.525277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d4c1fef-986f-4fa2-a116-7c826c856f42 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:04.525947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d4c1fef-986f-4fa2-a116-7c826c856f42 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:04.651165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-787767b2-adb2-41c7-9ff4-1691e82933cc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:04.660732 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-787767b2-adb2-41c7-9ff4-1691e82933cc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1322 microversion: 2.1 time: 0.593311 Oct 10 23:38:04.662210 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2074/4246] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:04 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1322 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:04.668243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bc0fbb71-e922-4dfe-b426-08f9bb1a3d1e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:04.669031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bc0fbb71-e922-4dfe-b426-08f9bb1a3d1e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:04.677200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc0fbb71-e922-4dfe-b426-08f9bb1a3d1e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:04.677723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc0fbb71-e922-4dfe-b426-08f9bb1a3d1e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:04.678214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc0fbb71-e922-4dfe-b426-08f9bb1a3d1e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:04.678921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc0fbb71-e922-4dfe-b426-08f9bb1a3d1e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:04.679549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc0fbb71-e922-4dfe-b426-08f9bb1a3d1e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:04.680128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc0fbb71-e922-4dfe-b426-08f9bb1a3d1e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:04.696375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9d4c1fef-986f-4fa2-a116-7c826c856f42 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:04.710544 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9d4c1fef-986f-4fa2-a116-7c826c856f42 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1508 microversion: 2.1 time: 0.218510 Oct 10 23:38:04.722886 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2173/4247] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:04 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:04.728103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-2c94880c-62ad-498a-85c7-77c8fd42b139 req-f6cf0de4-38a9-49a5-9ce6-d1ee3ae8d64c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1421397-3387-4b28-8473-51140ba79621", "tag": "7176c745-60e5-4b19-922f-8af0d0c66741"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:04.739432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2c94880c-62ad-498a-85c7-77c8fd42b139 req-f6cf0de4-38a9-49a5-9ce6-d1ee3ae8d64c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:04.739927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2c94880c-62ad-498a-85c7-77c8fd42b139 req-f6cf0de4-38a9-49a5-9ce6-d1ee3ae8d64c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:04.740367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2c94880c-62ad-498a-85c7-77c8fd42b139 req-f6cf0de4-38a9-49a5-9ce6-d1ee3ae8d64c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:04.753753 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-2c94880c-62ad-498a-85c7-77c8fd42b139 req-f6cf0de4-38a9-49a5-9ce6-d1ee3ae8d64c service nova] Creating event network-changed:7176c745-60e5-4b19-922f-8af0d0c66741 for instance c1421397-3387-4b28-8473-51140ba79621 on n-h1-860864-2 Oct 10 23:38:04.758702 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-2c94880c-62ad-498a-85c7-77c8fd42b139 req-f6cf0de4-38a9-49a5-9ce6-d1ee3ae8d64c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034478 Oct 10 23:38:04.759199 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2174/4248] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:04.908430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bc0fbb71-e922-4dfe-b426-08f9bb1a3d1e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:04.917961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bc0fbb71-e922-4dfe-b426-08f9bb1a3d1e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:04.919499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bc0fbb71-e922-4dfe-b426-08f9bb1a3d1e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:04.920907 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bc0fbb71-e922-4dfe-b426-08f9bb1a3d1e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1666 microversion: 2.20 time: 0.257556 Oct 10 23:38:04.921626 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2075/4249] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:38:04 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1666 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:38:04.952766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4cc0c90d-ffa8-454f-99fe-5d826d070ad4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfeb31a2-516c-453e-a5ed-1f71b0b0b2e6"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:04.956171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4cc0c90d-ffa8-454f-99fe-5d826d070ad4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:04.974285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cc0c90d-ffa8-454f-99fe-5d826d070ad4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:04.974799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cc0c90d-ffa8-454f-99fe-5d826d070ad4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:04.975237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cc0c90d-ffa8-454f-99fe-5d826d070ad4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:04.983353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cc0c90d-ffa8-454f-99fe-5d826d070ad4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:04.983844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cc0c90d-ffa8-454f-99fe-5d826d070ad4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:04.984290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cc0c90d-ffa8-454f-99fe-5d826d070ad4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:05.415502 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4cc0c90d-ffa8-454f-99fe-5d826d070ad4 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "POST /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.467860 Oct 10 23:38:05.422126 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2175/4250] 10.222.0.23 () {62 vars in 1364 bytes} [Mon Oct 10 23:38:04 2022] POST /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734/os-volume_attachments => generated 188 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:38:05.505129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6a8f2649-5652-4bb6-bfe2-0fd831ef3832 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:05.506146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6a8f2649-5652-4bb6-bfe2-0fd831ef3832 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] [instance: 909982c3-4e0f-4811-b8f9-2f085d7c31c7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:05.514090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a8f2649-5652-4bb6-bfe2-0fd831ef3832 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:05.514667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a8f2649-5652-4bb6-bfe2-0fd831ef3832 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:05.515181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a8f2649-5652-4bb6-bfe2-0fd831ef3832 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:05.516090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a8f2649-5652-4bb6-bfe2-0fd831ef3832 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:05.517273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a8f2649-5652-4bb6-bfe2-0fd831ef3832 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:05.518001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a8f2649-5652-4bb6-bfe2-0fd831ef3832 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:05.556755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a8f2649-5652-4bb6-bfe2-0fd831ef3832 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:05.557243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a8f2649-5652-4bb6-bfe2-0fd831ef3832 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:05.557827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6a8f2649-5652-4bb6-bfe2-0fd831ef3832 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:05.558579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-6a8f2649-5652-4bb6-bfe2-0fd831ef3832 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lazy-loading 'fault' on Instance uuid 909982c3-4e0f-4811-b8f9-2f085d7c31c7 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:38:05.568852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7020c4e7-c6f9-406d-9eb0-e5bc27056f38 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:05.569922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7020c4e7-c6f9-406d-9eb0-e5bc27056f38 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:05.578357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7020c4e7-c6f9-406d-9eb0-e5bc27056f38 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:05.579297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7020c4e7-c6f9-406d-9eb0-e5bc27056f38 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:05.582412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7020c4e7-c6f9-406d-9eb0-e5bc27056f38 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:05.583669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7020c4e7-c6f9-406d-9eb0-e5bc27056f38 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:05.584285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7020c4e7-c6f9-406d-9eb0-e5bc27056f38 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:05.584731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7020c4e7-c6f9-406d-9eb0-e5bc27056f38 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:05.607157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6a8f2649-5652-4bb6-bfe2-0fd831ef3832 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73044d4a69d649acb214d74f42c950e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0696923efb3c49c087db1a92119a0a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:05.615961 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6a8f2649-5652-4bb6-bfe2-0fd831ef3832 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] 10.222.0.23 "GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7" status: 200 len: 1314 microversion: 2.1 time: 0.115785 Oct 10 23:38:05.616550 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2076/4251] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:05 2022] GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7 => generated 1314 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:05.684559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3c204972-98f6-4c25-a882-7214f07dc288 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:05.685103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3c204972-98f6-4c25-a882-7214f07dc288 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:05.693186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c204972-98f6-4c25-a882-7214f07dc288 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:05.694141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c204972-98f6-4c25-a882-7214f07dc288 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:05.694724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c204972-98f6-4c25-a882-7214f07dc288 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:05.695440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c204972-98f6-4c25-a882-7214f07dc288 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:05.696112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c204972-98f6-4c25-a882-7214f07dc288 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:05.696540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c204972-98f6-4c25-a882-7214f07dc288 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:05.928757 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7020c4e7-c6f9-406d-9eb0-e5bc27056f38 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "DELETE /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734/os-volume_attachments/bfeb31a2-516c-453e-a5ed-1f71b0b0b2e6" status: 202 len: 0 microversion: 2.20 time: 0.362464 Oct 10 23:38:05.930586 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2176/4252] 10.222.0.23 () {60 vars in 1457 bytes} [Mon Oct 10 23:38:05 2022] DELETE /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734/os-volume_attachments/bfeb31a2-516c-453e-a5ed-1f71b0b0b2e6 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:38:05.943550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-efc097db-be28-4f93-bb24-d7e7ffe4d243 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:05.947562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-efc097db-be28-4f93-bb24-d7e7ffe4d243 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:05.964597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-efc097db-be28-4f93-bb24-d7e7ffe4d243 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:05.966106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3c204972-98f6-4c25-a882-7214f07dc288 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:05.966718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-efc097db-be28-4f93-bb24-d7e7ffe4d243 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:05.967167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-efc097db-be28-4f93-bb24-d7e7ffe4d243 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:05.967886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-efc097db-be28-4f93-bb24-d7e7ffe4d243 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:05.968340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-efc097db-be28-4f93-bb24-d7e7ffe4d243 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:05.968765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-efc097db-be28-4f93-bb24-d7e7ffe4d243 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:05.977615 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3c204972-98f6-4c25-a882-7214f07dc288 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1322 microversion: 2.1 time: 0.297231 Oct 10 23:38:05.978445 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2077/4253] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:05 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:38:06.022709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-010bdcd5-83ea-4871-97fd-082f43b5e715 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:06.023489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-010bdcd5-83ea-4871-97fd-082f43b5e715 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:06.045295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-010bdcd5-83ea-4871-97fd-082f43b5e715 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:06.047906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-010bdcd5-83ea-4871-97fd-082f43b5e715 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:06.049131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-010bdcd5-83ea-4871-97fd-082f43b5e715 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:06.050327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-010bdcd5-83ea-4871-97fd-082f43b5e715 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:06.050816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-010bdcd5-83ea-4871-97fd-082f43b5e715 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:06.051852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-010bdcd5-83ea-4871-97fd-082f43b5e715 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:06.151751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-010bdcd5-83ea-4871-97fd-082f43b5e715 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120614) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 10 23:38:06.274789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-efc097db-be28-4f93-bb24-d7e7ffe4d243 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:06.283929 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-efc097db-be28-4f93-bb24-d7e7ffe4d243 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1508 microversion: 2.1 time: 0.351994 Oct 10 23:38:06.285836 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2177/4254] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:05 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1508 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:06.293327 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-010bdcd5-83ea-4871-97fd-082f43b5e715 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "POST /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734/action" status: 202 len: 0 microversion: 2.20 time: 0.274567 Oct 10 23:38:06.301736 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2078/4255] 10.222.0.23 () {62 vars in 1319 bytes} [Mon Oct 10 23:38:06 2022] POST /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 10 23:38:06.304106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-53185b51-e892-4012-bbc6-f457f1b26db2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:06.304938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-53185b51-e892-4012-bbc6-f457f1b26db2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:06.312702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53185b51-e892-4012-bbc6-f457f1b26db2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:06.313621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53185b51-e892-4012-bbc6-f457f1b26db2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:06.314015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53185b51-e892-4012-bbc6-f457f1b26db2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:06.314948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53185b51-e892-4012-bbc6-f457f1b26db2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:06.315536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53185b51-e892-4012-bbc6-f457f1b26db2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:06.315965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53185b51-e892-4012-bbc6-f457f1b26db2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:06.486282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-53185b51-e892-4012-bbc6-f457f1b26db2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:06.496570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-53185b51-e892-4012-bbc6-f457f1b26db2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:06.498683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-53185b51-e892-4012-bbc6-f457f1b26db2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:06.501780 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-53185b51-e892-4012-bbc6-f457f1b26db2 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1674 microversion: 2.20 time: 0.201813 Oct 10 23:38:06.503499 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2178/4256] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:38:06 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1674 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:38:06.641527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b04a5e59-9f76-424e-990d-09940a65aef9 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:06.643153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b04a5e59-9f76-424e-990d-09940a65aef9 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] [instance: 909982c3-4e0f-4811-b8f9-2f085d7c31c7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:06.657548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b04a5e59-9f76-424e-990d-09940a65aef9 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:06.659036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b04a5e59-9f76-424e-990d-09940a65aef9 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:06.659728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b04a5e59-9f76-424e-990d-09940a65aef9 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:06.660956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b04a5e59-9f76-424e-990d-09940a65aef9 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:06.661682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b04a5e59-9f76-424e-990d-09940a65aef9 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:06.662323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b04a5e59-9f76-424e-990d-09940a65aef9 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:06.686121 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-b04a5e59-9f76-424e-990d-09940a65aef9 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] HTTP exception thrown: Instance 909982c3-4e0f-4811-b8f9-2f085d7c31c7 could not be found. Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b04a5e59-9f76-424e-990d-09940a65aef9 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Request method failure captured: Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7 HTTP/1.1 Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKy_IqbRpDRXY-wT2NOUy_8q6oycen6R3pOw3ogYeii8Aslc0AOSQKC7fyLY6Vnm6mtBH9pERypB1yy6T_CkgrnPD5R_fZG-yzVW_8VeneC97uDAgznEEKxmMrUj3ch1K-Xoz1NUBAJUL5GwG9plVg4s-qbammgLYtiRxBlo_DPB8sI Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 0696923efb3c49c087db1a92119a0a04 Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-289315660 Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0696923efb3c49c087db1a92119a0a04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0696923efb3c49c087db1a92119a0a04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0696923efb3c49c087db1a92119a0a04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0696923efb3c49c087db1a92119a0a04", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-289315660 Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 0696923efb3c49c087db1a92119a0a04 Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-289315660 Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-InstanceActionsNegativeTestJSON-289315660-project Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 73044d4a69d649acb214d74f42c950e4 Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-289315660-project Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 909982c3-4e0f-4811-b8f9-2f085d7c31c7 could not be found. Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '909982c3-4e0f-4811-b8f9-2f085d7c31c7'} Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 909982c3-4e0f-4811-b8f9-2f085d7c31c7 could not be found. Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 909982c3-4e0f-4811-b8f9-2f085d7c31c7 could not be found. Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:06.691901 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:38:06.696936 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:06.696936 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:06.696936 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:38:06.696936 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:38:06.696936 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:38:06.696936 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:38:06.696936 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 909982c3-4e0f-4811-b8f9-2f085d7c31c7 could not be found. Oct 10 23:38:06.696936 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:06.698494 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b04a5e59-9f76-424e-990d-09940a65aef9 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] Returning 404 to user: Instance 909982c3-4e0f-4811-b8f9-2f085d7c31c7 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:38:06.699361 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b04a5e59-9f76-424e-990d-09940a65aef9 tempest-InstanceActionsNegativeTestJSON-289315660 tempest-InstanceActionsNegativeTestJSON-289315660-project] 10.222.0.23 "GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7" status: 404 len: 111 microversion: 2.1 time: 0.063413 Oct 10 23:38:06.699930 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2079/4257] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:06 2022] GET /compute/v2.1/servers/909982c3-4e0f-4811-b8f9-2f085d7c31c7 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:38:06.784771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-1034f683-c65b-44a9-92e0-5c074bfb80ed req-e61c2349-e752-4148-b51f-338937c1df2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909982c3-4e0f-4811-b8f9-2f085d7c31c7", "name": "network-vif-deleted", "tag": "a851375c-cfa5-4c3f-b784-24809890b8dc"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:06.809784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:06.817418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1034f683-c65b-44a9-92e0-5c074bfb80ed req-e61c2349-e752-4148-b51f-338937c1df2d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:06.818297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1034f683-c65b-44a9-92e0-5c074bfb80ed req-e61c2349-e752-4148-b51f-338937c1df2d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:06.823807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1034f683-c65b-44a9-92e0-5c074bfb80ed req-e61c2349-e752-4148-b51f-338937c1df2d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:06.849708 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-1034f683-c65b-44a9-92e0-5c074bfb80ed req-e61c2349-e752-4148-b51f-338937c1df2d service nova] Creating event network-vif-deleted:a851375c-cfa5-4c3f-b784-24809890b8dc for instance 909982c3-4e0f-4811-b8f9-2f085d7c31c7 on n-h2-860864-2 Oct 10 23:38:06.854881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:06.858833 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-1034f683-c65b-44a9-92e0-5c074bfb80ed req-e61c2349-e752-4148-b51f-338937c1df2d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078876 Oct 10 23:38:06.860653 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2179/4258] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:07.005175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2f51cb68-f080-45e1-8d79-0cc2b1d7bd94 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:07.005990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2f51cb68-f080-45e1-8d79-0cc2b1d7bd94 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:07.014216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f51cb68-f080-45e1-8d79-0cc2b1d7bd94 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:07.018526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f51cb68-f080-45e1-8d79-0cc2b1d7bd94 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:07.018526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f51cb68-f080-45e1-8d79-0cc2b1d7bd94 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:07.021504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f51cb68-f080-45e1-8d79-0cc2b1d7bd94 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:07.022202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f51cb68-f080-45e1-8d79-0cc2b1d7bd94 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:07.023053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2f51cb68-f080-45e1-8d79-0cc2b1d7bd94 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:07.310787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-61b730bf-91bb-4bae-a9a8-badfb5872fab tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:07.311074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-61b730bf-91bb-4bae-a9a8-badfb5872fab tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:07.325278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61b730bf-91bb-4bae-a9a8-badfb5872fab tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:07.326640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61b730bf-91bb-4bae-a9a8-badfb5872fab tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:07.327087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61b730bf-91bb-4bae-a9a8-badfb5872fab tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:07.330282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61b730bf-91bb-4bae-a9a8-badfb5872fab tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:07.331308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61b730bf-91bb-4bae-a9a8-badfb5872fab tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:07.336588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61b730bf-91bb-4bae-a9a8-badfb5872fab tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:07.466346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2f51cb68-f080-45e1-8d79-0cc2b1d7bd94 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:07.481043 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2f51cb68-f080-45e1-8d79-0cc2b1d7bd94 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1322 microversion: 2.1 time: 0.476886 Oct 10 23:38:07.494051 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2080/4259] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:06 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1322 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:07.705566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-61b730bf-91bb-4bae-a9a8-badfb5872fab tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:07.722388 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-61b730bf-91bb-4bae-a9a8-badfb5872fab tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1508 microversion: 2.1 time: 0.412884 Oct 10 23:38:07.728545 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2180/4260] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:07 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1508 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:07.742288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2a523ae5-66be-4683-a4bc-a0fba448b394 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:07.743155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2a523ae5-66be-4683-a4bc-a0fba448b394 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:07.757169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a523ae5-66be-4683-a4bc-a0fba448b394 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:07.760947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a523ae5-66be-4683-a4bc-a0fba448b394 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:07.761810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a523ae5-66be-4683-a4bc-a0fba448b394 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:07.762826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a523ae5-66be-4683-a4bc-a0fba448b394 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:07.763293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a523ae5-66be-4683-a4bc-a0fba448b394 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:07.763732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a523ae5-66be-4683-a4bc-a0fba448b394 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:07.847231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d323ac09-8d68-4763-8fca-0ad60a0474c7 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "64c94ffe-502c-4492-bfdb-37b920a6128f"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:07.849789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d323ac09-8d68-4763-8fca-0ad60a0474c7 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:07.860212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d323ac09-8d68-4763-8fca-0ad60a0474c7 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:07.866218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d323ac09-8d68-4763-8fca-0ad60a0474c7 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:07.866722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d323ac09-8d68-4763-8fca-0ad60a0474c7 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:07.867453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d323ac09-8d68-4763-8fca-0ad60a0474c7 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:07.867926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d323ac09-8d68-4763-8fca-0ad60a0474c7 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:07.868357 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d323ac09-8d68-4763-8fca-0ad60a0474c7 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:08.062659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=10 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:08.088628 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-d323ac09-8d68-4763-8fca-0ad60a0474c7 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] HTTP exception thrown: Volume 64c94ffe-502c-4492-bfdb-37b920a6128f could not be found. Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d323ac09-8d68-4763-8fca-0ad60a0474c7 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] Request method failure captured: Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: request: PUT /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments/e97dcbca-8980-452c-b03c-3541e1be961e HTTP/1.1 Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 74 Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKxP5LL8K_5KsNe2a_9XZSSWfLGI4XXMrYH9uzIY5rX7Z8OzrhFlFlwQvDCccm3-mUC09J5tJ0WK7-AGTbtKKrLjXILScJcDY5KI-u2APetiQxyxwKK7kEU2oZ_Lr0XCf6kjQWHInv_MHyViKU6wbrZTMP6z8vHHkCLWrKwGljMrkoE Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 1150cb5f48034e19b468c02104a64565 Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-VolumesAdminNegativeTest-732847487 Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1150cb5f48034e19b468c02104a64565"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1150cb5f48034e19b468c02104a64565"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1150cb5f48034e19b468c02104a64565"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1150cb5f48034e19b468c02104a64565", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-VolumesAdminNegativeTest-732847487 Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 1150cb5f48034e19b468c02104a64565 Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-732847487 Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-VolumesAdminNegativeTest-732847487-project-admin Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 5c484d9e964b4bcfbc84faeb0a443647 Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-VolumesAdminNegativeTest-732847487-project-admin Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: {"volumeAttachment": {"volumeId": "64c94ffe-502c-4492-bfdb-37b920a6128f"}} Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: exception: Volume 64c94ffe-502c-4492-bfdb-37b920a6128f could not be found. Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'server_id': '16b9ff1a-05a0-46ff-8bac-2e12e7853f4f', 'id': 'e97dcbca-8980-452c-b03c-3541e1be961e', 'body': {'volumeAttachment': {'volumeId': '64c94ffe-502c-4492-bfdb-37b920a6128f'}}} Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 64c94ffe-502c-4492-bfdb-37b920a6128f could not be found. (HTTP 404) (Request-ID: req-036df5d5-418f-40f0-b2f9-a430bf0da5eb) Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 23:38:08.093360 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 64c94ffe-502c-4492-bfdb-37b920a6128f could not be found. Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 64c94ffe-502c-4492-bfdb-37b920a6128f could not be found. Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 64c94ffe-502c-4492-bfdb-37b920a6128f could not be found. Oct 10 23:38:08.097187 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:08.106518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d323ac09-8d68-4763-8fca-0ad60a0474c7 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] Returning 400 to user: Volume 64c94ffe-502c-4492-bfdb-37b920a6128f could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:38:08.107740 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d323ac09-8d68-4763-8fca-0ad60a0474c7 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] 10.222.0.23 "PUT /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments/e97dcbca-8980-452c-b03c-3541e1be961e" status: 400 len: 107 microversion: 2.1 time: 0.612546 Oct 10 23:38:08.108868 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2081/4261] 10.222.0.23 () {60 vars in 1433 bytes} [Mon Oct 10 23:38:07 2022] PUT /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments/e97dcbca-8980-452c-b03c-3541e1be961e => generated 107 bytes in 614 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:38:08.137013 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-b259031f-7498-4ecb-9f60-602142016fda req-dc9a5dfc-1f4e-4690-afbc-a898ac63c5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f01cc76-fa39-4e39-8e4d-e0263388c690", "name": "network-vif-plugged", "status": "completed", "tag": "0e86eed0-1a80-408f-a2af-bad1d359822c"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:08.203375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b259031f-7498-4ecb-9f60-602142016fda req-dc9a5dfc-1f4e-4690-afbc-a898ac63c5ef service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:08.205854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b259031f-7498-4ecb-9f60-602142016fda req-dc9a5dfc-1f4e-4690-afbc-a898ac63c5ef service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:08.208296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b259031f-7498-4ecb-9f60-602142016fda req-dc9a5dfc-1f4e-4690-afbc-a898ac63c5ef service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:08.238299 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-b259031f-7498-4ecb-9f60-602142016fda req-dc9a5dfc-1f4e-4690-afbc-a898ac63c5ef service nova] Creating event network-vif-plugged:0e86eed0-1a80-408f-a2af-bad1d359822c for instance 0f01cc76-fa39-4e39-8e4d-e0263388c690 on n-h1-860864-2 Oct 10 23:38:08.251820 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-b259031f-7498-4ecb-9f60-602142016fda req-dc9a5dfc-1f4e-4690-afbc-a898ac63c5ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136860 Oct 10 23:38:08.254220 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2082/4262] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:08.284139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8c21acfe-c96e-4084-b4b2-2e81bcf8d11d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:08.285235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8c21acfe-c96e-4084-b4b2-2e81bcf8d11d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:08.293657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c21acfe-c96e-4084-b4b2-2e81bcf8d11d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:08.294601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c21acfe-c96e-4084-b4b2-2e81bcf8d11d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:08.295250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c21acfe-c96e-4084-b4b2-2e81bcf8d11d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:08.296209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c21acfe-c96e-4084-b4b2-2e81bcf8d11d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:08.296901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c21acfe-c96e-4084-b4b2-2e81bcf8d11d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:08.297694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c21acfe-c96e-4084-b4b2-2e81bcf8d11d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:08.418948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-8c21acfe-c96e-4084-b4b2-2e81bcf8d11d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lazy-loading 'services' on Instance uuid 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:38:08.486647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2a523ae5-66be-4683-a4bc-a0fba448b394 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:08.502523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2a523ae5-66be-4683-a4bc-a0fba448b394 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:08.506651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2a523ae5-66be-4683-a4bc-a0fba448b394 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:08.510240 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2a523ae5-66be-4683-a4bc-a0fba448b394 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1732 microversion: 2.20 time: 0.779995 Oct 10 23:38:08.511025 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2181/4263] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:38:07 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1732 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:38:08.522066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-43f34bf2-9b90-410a-ad57-e4ac144861f8 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:08.524112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-43f34bf2-9b90-410a-ad57-e4ac144861f8 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:08.536997 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8c21acfe-c96e-4084-b4b2-2e81bcf8d11d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "DELETE /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments/e97dcbca-8980-452c-b03c-3541e1be961e" status: 202 len: 0 microversion: 2.1 time: 0.257840 Oct 10 23:38:08.537956 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2083/4264] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Oct 10 23:38:08 2022] DELETE /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments/e97dcbca-8980-452c-b03c-3541e1be961e => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:38:08.540301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43f34bf2-9b90-410a-ad57-e4ac144861f8 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:08.549306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43f34bf2-9b90-410a-ad57-e4ac144861f8 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:08.549306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43f34bf2-9b90-410a-ad57-e4ac144861f8 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:08.549306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43f34bf2-9b90-410a-ad57-e4ac144861f8 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:08.549306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43f34bf2-9b90-410a-ad57-e4ac144861f8 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:08.549306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43f34bf2-9b90-410a-ad57-e4ac144861f8 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:08.558446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-77c387f2-6003-4450-a01c-825e66a5014a tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:08.561087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-77c387f2-6003-4450-a01c-825e66a5014a tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:08.568725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77c387f2-6003-4450-a01c-825e66a5014a tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:08.569433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77c387f2-6003-4450-a01c-825e66a5014a tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:08.570188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77c387f2-6003-4450-a01c-825e66a5014a tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:08.571163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77c387f2-6003-4450-a01c-825e66a5014a tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:08.572304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77c387f2-6003-4450-a01c-825e66a5014a tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:08.573355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77c387f2-6003-4450-a01c-825e66a5014a tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:08.630512 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-77c387f2-6003-4450-a01c-825e66a5014a tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078153 Oct 10 23:38:08.631101 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2084/4265] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:38:08 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:38:08.748461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7715305c-4acd-4550-b1f7-9897fbe3f6dd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:08.749468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7715305c-4acd-4550-b1f7-9897fbe3f6dd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:08.765666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7715305c-4acd-4550-b1f7-9897fbe3f6dd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:08.769762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7715305c-4acd-4550-b1f7-9897fbe3f6dd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:08.770475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7715305c-4acd-4550-b1f7-9897fbe3f6dd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:08.771438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7715305c-4acd-4550-b1f7-9897fbe3f6dd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:08.772130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7715305c-4acd-4550-b1f7-9897fbe3f6dd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:08.772767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7715305c-4acd-4550-b1f7-9897fbe3f6dd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:08.800829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-43f34bf2-9b90-410a-ad57-e4ac144861f8 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:08.833316 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-43f34bf2-9b90-410a-ad57-e4ac144861f8 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1322 microversion: 2.1 time: 0.307461 Oct 10 23:38:08.834207 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2182/4266] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:08 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1322 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:09.058529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7715305c-4acd-4550-b1f7-9897fbe3f6dd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:09.072261 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7715305c-4acd-4550-b1f7-9897fbe3f6dd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1508 microversion: 2.1 time: 0.328256 Oct 10 23:38:09.072935 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2085/4267] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:08 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1508 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:38:09.543358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-57c7f2dc-08ef-4bc1-9646-6be884585256 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:09.544616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-57c7f2dc-08ef-4bc1-9646-6be884585256 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:09.560740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57c7f2dc-08ef-4bc1-9646-6be884585256 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:09.563966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57c7f2dc-08ef-4bc1-9646-6be884585256 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:09.565907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57c7f2dc-08ef-4bc1-9646-6be884585256 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:09.568283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57c7f2dc-08ef-4bc1-9646-6be884585256 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:09.569932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57c7f2dc-08ef-4bc1-9646-6be884585256 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:09.572007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57c7f2dc-08ef-4bc1-9646-6be884585256 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:09.583299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:09.647564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a84eff32-bcc3-4864-a28d-fe09d63f7512 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:09.651208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a84eff32-bcc3-4864-a28d-fe09d63f7512 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:09.670561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a84eff32-bcc3-4864-a28d-fe09d63f7512 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:09.675657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a84eff32-bcc3-4864-a28d-fe09d63f7512 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:09.679312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a84eff32-bcc3-4864-a28d-fe09d63f7512 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:09.680402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a84eff32-bcc3-4864-a28d-fe09d63f7512 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:09.683518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a84eff32-bcc3-4864-a28d-fe09d63f7512 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:09.685701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a84eff32-bcc3-4864-a28d-fe09d63f7512 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:09.788092 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a84eff32-bcc3-4864-a28d-fe09d63f7512 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144792 Oct 10 23:38:09.799621 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2086/4268] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:38:09 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:09.859173 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e084cc13-7d1f-4712-9c64-45afccc8bdda tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:09.860303 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e084cc13-7d1f-4712-9c64-45afccc8bdda tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:09.877058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e084cc13-7d1f-4712-9c64-45afccc8bdda tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:09.878679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e084cc13-7d1f-4712-9c64-45afccc8bdda tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:09.879985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e084cc13-7d1f-4712-9c64-45afccc8bdda tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:09.882365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e084cc13-7d1f-4712-9c64-45afccc8bdda tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:09.883663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e084cc13-7d1f-4712-9c64-45afccc8bdda tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:09.884875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e084cc13-7d1f-4712-9c64-45afccc8bdda tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:09.894412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:10.163202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-57c7f2dc-08ef-4bc1-9646-6be884585256 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:10.174876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-57c7f2dc-08ef-4bc1-9646-6be884585256 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:10.177610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-57c7f2dc-08ef-4bc1-9646-6be884585256 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:10.179856 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-57c7f2dc-08ef-4bc1-9646-6be884585256 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1732 microversion: 2.20 time: 0.640996 Oct 10 23:38:10.194648 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2183/4269] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:38:09 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1732 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:38:10.208722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5e792417-f158-4adc-9e20-5f8a237be70c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:10.209799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5e792417-f158-4adc-9e20-5f8a237be70c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:10.218006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e792417-f158-4adc-9e20-5f8a237be70c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:10.218859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e792417-f158-4adc-9e20-5f8a237be70c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:10.219735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e792417-f158-4adc-9e20-5f8a237be70c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:10.220798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e792417-f158-4adc-9e20-5f8a237be70c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:10.221539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e792417-f158-4adc-9e20-5f8a237be70c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:10.222237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e792417-f158-4adc-9e20-5f8a237be70c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:10.441352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5e792417-f158-4adc-9e20-5f8a237be70c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:10.450521 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5e792417-f158-4adc-9e20-5f8a237be70c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1508 microversion: 2.1 time: 0.254535 Oct 10 23:38:10.453428 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2184/4270] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:10 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1508 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:10.569472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e084cc13-7d1f-4712-9c64-45afccc8bdda tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:10.578924 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e084cc13-7d1f-4712-9c64-45afccc8bdda tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1322 microversion: 2.1 time: 0.724747 Oct 10 23:38:10.579402 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2087/4271] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:09 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1322 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:10.809182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-85c69711-5cb0-4ffa-ae1b-7e131ddf7d1b tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:10.814259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-85c69711-5cb0-4ffa-ae1b-7e131ddf7d1b tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:10.832316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85c69711-5cb0-4ffa-ae1b-7e131ddf7d1b tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:10.833323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85c69711-5cb0-4ffa-ae1b-7e131ddf7d1b tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:10.834139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85c69711-5cb0-4ffa-ae1b-7e131ddf7d1b tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:10.835241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85c69711-5cb0-4ffa-ae1b-7e131ddf7d1b tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:10.835969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85c69711-5cb0-4ffa-ae1b-7e131ddf7d1b tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:10.836711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85c69711-5cb0-4ffa-ae1b-7e131ddf7d1b tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:10.925198 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-85c69711-5cb0-4ffa-ae1b-7e131ddf7d1b tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121501 Oct 10 23:38:10.927700 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2185/4272] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:38:10 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:11.211965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-68d41440-e5ba-479a-b8e3-0145b2adf097 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:11.212580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-68d41440-e5ba-479a-b8e3-0145b2adf097 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:11.246474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68d41440-e5ba-479a-b8e3-0145b2adf097 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:11.259373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68d41440-e5ba-479a-b8e3-0145b2adf097 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:11.262108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68d41440-e5ba-479a-b8e3-0145b2adf097 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:11.264511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68d41440-e5ba-479a-b8e3-0145b2adf097 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:11.268905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68d41440-e5ba-479a-b8e3-0145b2adf097 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:11.270698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68d41440-e5ba-479a-b8e3-0145b2adf097 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:11.570772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-add4732f-8689-4b0b-9343-1a8b97c90b5f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:11.571398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-add4732f-8689-4b0b-9343-1a8b97c90b5f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:11.593559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-add4732f-8689-4b0b-9343-1a8b97c90b5f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:11.594681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-add4732f-8689-4b0b-9343-1a8b97c90b5f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:11.645103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-add4732f-8689-4b0b-9343-1a8b97c90b5f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.051s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:11.646900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-add4732f-8689-4b0b-9343-1a8b97c90b5f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:11.649101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-add4732f-8689-4b0b-9343-1a8b97c90b5f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:11.655124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-add4732f-8689-4b0b-9343-1a8b97c90b5f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:12.197231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-68d41440-e5ba-479a-b8e3-0145b2adf097 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:12.214765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-68d41440-e5ba-479a-b8e3-0145b2adf097 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:12.220119 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-68d41440-e5ba-479a-b8e3-0145b2adf097 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:12.225555 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-68d41440-e5ba-479a-b8e3-0145b2adf097 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1732 microversion: 2.20 time: 1.017745 Oct 10 23:38:12.228867 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2088/4273] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:38:11 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1732 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:38:12.235489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-40d9be46-a553-4caa-bca2-a7c33080b199 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:12.236353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-40d9be46-a553-4caa-bca2-a7c33080b199 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:12.278676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40d9be46-a553-4caa-bca2-a7c33080b199 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:12.280790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40d9be46-a553-4caa-bca2-a7c33080b199 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:12.285104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40d9be46-a553-4caa-bca2-a7c33080b199 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:12.289758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40d9be46-a553-4caa-bca2-a7c33080b199 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:12.293162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40d9be46-a553-4caa-bca2-a7c33080b199 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:12.295974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40d9be46-a553-4caa-bca2-a7c33080b199 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:12.545726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-add4732f-8689-4b0b-9343-1a8b97c90b5f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:12.561907 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-add4732f-8689-4b0b-9343-1a8b97c90b5f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1508 microversion: 2.1 time: 0.995449 Oct 10 23:38:12.570763 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2186/4274] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:11 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1508 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:12.584795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e56347c2-b392-46ff-ba4c-5fc31f1c0436 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:12.593065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e56347c2-b392-46ff-ba4c-5fc31f1c0436 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:12.615804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e56347c2-b392-46ff-ba4c-5fc31f1c0436 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:12.624612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e56347c2-b392-46ff-ba4c-5fc31f1c0436 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:12.626078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e56347c2-b392-46ff-ba4c-5fc31f1c0436 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:12.632979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e56347c2-b392-46ff-ba4c-5fc31f1c0436 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:12.633740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e56347c2-b392-46ff-ba4c-5fc31f1c0436 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:12.634498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e56347c2-b392-46ff-ba4c-5fc31f1c0436 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:12.708468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-40d9be46-a553-4caa-bca2-a7c33080b199 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:12.721932 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e56347c2-b392-46ff-ba4c-5fc31f1c0436 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147863 Oct 10 23:38:12.726994 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2187/4275] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:38:12 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:12.733062 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-40d9be46-a553-4caa-bca2-a7c33080b199 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1322 microversion: 2.1 time: 0.502356 Oct 10 23:38:12.742002 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2089/4276] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:12 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1322 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:13.256277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-78d4a8d7-3af9-4964-92cb-ad3ce94549a8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:13.256905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-78d4a8d7-3af9-4964-92cb-ad3ce94549a8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:13.279198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:13.289457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-78d4a8d7-3af9-4964-92cb-ad3ce94549a8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:13.290361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-78d4a8d7-3af9-4964-92cb-ad3ce94549a8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:13.291002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-78d4a8d7-3af9-4964-92cb-ad3ce94549a8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:13.296037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-78d4a8d7-3af9-4964-92cb-ad3ce94549a8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:13.296787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-78d4a8d7-3af9-4964-92cb-ad3ce94549a8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:13.297946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-78d4a8d7-3af9-4964-92cb-ad3ce94549a8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:13.601095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-83637ae9-09b4-43a9-8e41-b5526dfc568e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:13.602547 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-83637ae9-09b4-43a9-8e41-b5526dfc568e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:13.646278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83637ae9-09b4-43a9-8e41-b5526dfc568e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:13.648179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83637ae9-09b4-43a9-8e41-b5526dfc568e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:13.652753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83637ae9-09b4-43a9-8e41-b5526dfc568e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:13.655531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83637ae9-09b4-43a9-8e41-b5526dfc568e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:13.659341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83637ae9-09b4-43a9-8e41-b5526dfc568e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:13.660129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83637ae9-09b4-43a9-8e41-b5526dfc568e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:13.955996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-78d4a8d7-3af9-4964-92cb-ad3ce94549a8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:13.970775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-78d4a8d7-3af9-4964-92cb-ad3ce94549a8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:13.988395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-78d4a8d7-3af9-4964-92cb-ad3ce94549a8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:13.990064 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-78d4a8d7-3af9-4964-92cb-ad3ce94549a8 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1732 microversion: 2.20 time: 0.738863 Oct 10 23:38:13.996570 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2188/4277] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:38:13 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1732 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:38:14.019091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1da68318-b26f-4cee-b02c-6a64bcd67201 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:14.023743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1da68318-b26f-4cee-b02c-6a64bcd67201 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:14.053228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1da68318-b26f-4cee-b02c-6a64bcd67201 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:14.054159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1da68318-b26f-4cee-b02c-6a64bcd67201 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:14.061333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1da68318-b26f-4cee-b02c-6a64bcd67201 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:14.063505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1da68318-b26f-4cee-b02c-6a64bcd67201 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:14.064421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-83637ae9-09b4-43a9-8e41-b5526dfc568e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:14.064635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1da68318-b26f-4cee-b02c-6a64bcd67201 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:14.065268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1da68318-b26f-4cee-b02c-6a64bcd67201 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:14.083552 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-83637ae9-09b4-43a9-8e41-b5526dfc568e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1508 microversion: 2.1 time: 0.487129 Oct 10 23:38:14.088541 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2090/4278] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:13 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1508 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:14.099777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9580ed5c-ec62-442e-b24e-8c174a673484 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:14.102483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9580ed5c-ec62-442e-b24e-8c174a673484 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:14.118145 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9580ed5c-ec62-442e-b24e-8c174a673484 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:14.122337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9580ed5c-ec62-442e-b24e-8c174a673484 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:14.122991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9580ed5c-ec62-442e-b24e-8c174a673484 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:14.123965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9580ed5c-ec62-442e-b24e-8c174a673484 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:14.126862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9580ed5c-ec62-442e-b24e-8c174a673484 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:14.127953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9580ed5c-ec62-442e-b24e-8c174a673484 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:14.154913 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1da68318-b26f-4cee-b02c-6a64bcd67201 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155602 Oct 10 23:38:14.163548 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2189/4279] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:38:13 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:14.558381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9580ed5c-ec62-442e-b24e-8c174a673484 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:14.579938 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9580ed5c-ec62-442e-b24e-8c174a673484 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1322 microversion: 2.1 time: 0.488371 Oct 10 23:38:14.581149 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2091/4280] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:14 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1322 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:15.026704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dfcf46fd-3003-4c5e-aee8-c070db21d674 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:15.028163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dfcf46fd-3003-4c5e-aee8-c070db21d674 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:15.041525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfcf46fd-3003-4c5e-aee8-c070db21d674 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:15.052362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfcf46fd-3003-4c5e-aee8-c070db21d674 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:15.053156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfcf46fd-3003-4c5e-aee8-c070db21d674 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:15.054432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfcf46fd-3003-4c5e-aee8-c070db21d674 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:15.055614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfcf46fd-3003-4c5e-aee8-c070db21d674 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:15.056300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfcf46fd-3003-4c5e-aee8-c070db21d674 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:15.111888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4f8fc307-ee5e-45bd-a221-c23e5beade19 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:15.113075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4f8fc307-ee5e-45bd-a221-c23e5beade19 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:15.128019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f8fc307-ee5e-45bd-a221-c23e5beade19 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:15.128516 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f8fc307-ee5e-45bd-a221-c23e5beade19 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:15.128960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f8fc307-ee5e-45bd-a221-c23e5beade19 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:15.133708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f8fc307-ee5e-45bd-a221-c23e5beade19 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:15.134740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f8fc307-ee5e-45bd-a221-c23e5beade19 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:15.135248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f8fc307-ee5e-45bd-a221-c23e5beade19 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:15.445804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dfcf46fd-3003-4c5e-aee8-c070db21d674 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:15.459628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dfcf46fd-3003-4c5e-aee8-c070db21d674 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:15.461309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dfcf46fd-3003-4c5e-aee8-c070db21d674 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:15.483606 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dfcf46fd-3003-4c5e-aee8-c070db21d674 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1732 microversion: 2.20 time: 0.460677 Oct 10 23:38:15.487945 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2190/4281] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:38:15 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1732 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:38:15.498269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e1dae622-3f87-47fd-a32a-9450fab63084 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:15.500166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4f8fc307-ee5e-45bd-a221-c23e5beade19 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:15.507077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e1dae622-3f87-47fd-a32a-9450fab63084 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:15.521112 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4f8fc307-ee5e-45bd-a221-c23e5beade19 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1508 microversion: 2.1 time: 0.413808 Oct 10 23:38:15.522329 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2092/4282] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:15 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1508 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:15.544008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1dae622-3f87-47fd-a32a-9450fab63084 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:15.544890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1dae622-3f87-47fd-a32a-9450fab63084 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:15.547722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1dae622-3f87-47fd-a32a-9450fab63084 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:15.555323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1dae622-3f87-47fd-a32a-9450fab63084 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:15.556145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1dae622-3f87-47fd-a32a-9450fab63084 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:15.559121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1dae622-3f87-47fd-a32a-9450fab63084 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:15.607374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-353b2fdc-74a6-4504-bf49-e2c9582e5cb5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:15.608005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-353b2fdc-74a6-4504-bf49-e2c9582e5cb5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:15.612585 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e1dae622-3f87-47fd-a32a-9450fab63084 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123074 Oct 10 23:38:15.614014 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2191/4283] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:38:15 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:15.623444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-353b2fdc-74a6-4504-bf49-e2c9582e5cb5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:15.625130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-353b2fdc-74a6-4504-bf49-e2c9582e5cb5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:15.626820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-353b2fdc-74a6-4504-bf49-e2c9582e5cb5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:15.629676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-353b2fdc-74a6-4504-bf49-e2c9582e5cb5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:15.630453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-353b2fdc-74a6-4504-bf49-e2c9582e5cb5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:15.632327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-353b2fdc-74a6-4504-bf49-e2c9582e5cb5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:15.989122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-353b2fdc-74a6-4504-bf49-e2c9582e5cb5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:15.998673 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-353b2fdc-74a6-4504-bf49-e2c9582e5cb5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1322 microversion: 2.1 time: 0.395201 Oct 10 23:38:16.001627 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2093/4284] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:15 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:38:16.162937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-a1e921dd-f609-4b01-986c-0d6a891c91d2 req-086a189c-7a7c-400d-9d45-e3041fbb357b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1421397-3387-4b28-8473-51140ba79621", "name": "network-vif-plugged", "status": "completed", "tag": "7176c745-60e5-4b19-922f-8af0d0c66741"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:16.181324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a1e921dd-f609-4b01-986c-0d6a891c91d2 req-086a189c-7a7c-400d-9d45-e3041fbb357b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:16.182818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a1e921dd-f609-4b01-986c-0d6a891c91d2 req-086a189c-7a7c-400d-9d45-e3041fbb357b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:16.183621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a1e921dd-f609-4b01-986c-0d6a891c91d2 req-086a189c-7a7c-400d-9d45-e3041fbb357b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:16.200862 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a1e921dd-f609-4b01-986c-0d6a891c91d2 req-086a189c-7a7c-400d-9d45-e3041fbb357b service nova] Creating event network-vif-plugged:7176c745-60e5-4b19-922f-8af0d0c66741 for instance c1421397-3387-4b28-8473-51140ba79621 on n-h1-860864-2 Oct 10 23:38:16.208083 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-a1e921dd-f609-4b01-986c-0d6a891c91d2 req-086a189c-7a7c-400d-9d45-e3041fbb357b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051518 Oct 10 23:38:16.209538 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2192/4285] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:16.527973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-795d730d-b032-4856-813a-a9a5166f4261 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:16.528591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-795d730d-b032-4856-813a-a9a5166f4261 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:16.558602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-985f012a-1457-40b8-960f-0c1f7477b458 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:16.559574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-985f012a-1457-40b8-960f-0c1f7477b458 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:16.565646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795d730d-b032-4856-813a-a9a5166f4261 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:16.567424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795d730d-b032-4856-813a-a9a5166f4261 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:16.568919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795d730d-b032-4856-813a-a9a5166f4261 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:16.574807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795d730d-b032-4856-813a-a9a5166f4261 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:16.575605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795d730d-b032-4856-813a-a9a5166f4261 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:16.577050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795d730d-b032-4856-813a-a9a5166f4261 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:16.585575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-985f012a-1457-40b8-960f-0c1f7477b458 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:16.586552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-985f012a-1457-40b8-960f-0c1f7477b458 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:16.589341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-985f012a-1457-40b8-960f-0c1f7477b458 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:16.592496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-985f012a-1457-40b8-960f-0c1f7477b458 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:16.593240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-985f012a-1457-40b8-960f-0c1f7477b458 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:16.595023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-985f012a-1457-40b8-960f-0c1f7477b458 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:16.897630 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-795d730d-b032-4856-813a-a9a5166f4261 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:16.913787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-795d730d-b032-4856-813a-a9a5166f4261 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:16.915385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-795d730d-b032-4856-813a-a9a5166f4261 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:16.920749 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-795d730d-b032-4856-813a-a9a5166f4261 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1732 microversion: 2.20 time: 0.395853 Oct 10 23:38:16.921656 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2094/4286] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:38:16 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1732 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:38:16.936478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-25b1d7a5-ea22-487c-9ea8-aef9da373cea tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:16.943638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-25b1d7a5-ea22-487c-9ea8-aef9da373cea tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:16.962221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25b1d7a5-ea22-487c-9ea8-aef9da373cea tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:16.962847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25b1d7a5-ea22-487c-9ea8-aef9da373cea tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:16.963190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25b1d7a5-ea22-487c-9ea8-aef9da373cea tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:16.964195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25b1d7a5-ea22-487c-9ea8-aef9da373cea tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:16.968115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25b1d7a5-ea22-487c-9ea8-aef9da373cea tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:16.968913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25b1d7a5-ea22-487c-9ea8-aef9da373cea tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:17.025823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-985f012a-1457-40b8-960f-0c1f7477b458 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:17.041178 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-985f012a-1457-40b8-960f-0c1f7477b458 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1508 microversion: 2.1 time: 0.485013 Oct 10 23:38:17.042521 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2193/4287] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:16 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1508 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:17.051192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2bc359eb-22e2-40ff-9f24-19a397269a09 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:17.054554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2bc359eb-22e2-40ff-9f24-19a397269a09 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:17.068698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bc359eb-22e2-40ff-9f24-19a397269a09 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:17.070571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bc359eb-22e2-40ff-9f24-19a397269a09 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:17.072388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bc359eb-22e2-40ff-9f24-19a397269a09 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:17.073778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bc359eb-22e2-40ff-9f24-19a397269a09 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:17.075160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bc359eb-22e2-40ff-9f24-19a397269a09 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:17.075604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bc359eb-22e2-40ff-9f24-19a397269a09 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:17.081402 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-25b1d7a5-ea22-487c-9ea8-aef9da373cea tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157558 Oct 10 23:38:17.082229 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2095/4288] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:38:16 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:17.359261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2bc359eb-22e2-40ff-9f24-19a397269a09 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:17.376528 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2bc359eb-22e2-40ff-9f24-19a397269a09 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1322 microversion: 2.1 time: 0.332609 Oct 10 23:38:17.377946 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2194/4289] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:17 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:17.949921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-21e149a8-21fc-41ca-adc7-10a848a4ac00 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:17.951312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-21e149a8-21fc-41ca-adc7-10a848a4ac00 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:17.972605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21e149a8-21fc-41ca-adc7-10a848a4ac00 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:17.979223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21e149a8-21fc-41ca-adc7-10a848a4ac00 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:17.980740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21e149a8-21fc-41ca-adc7-10a848a4ac00 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:17.988364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21e149a8-21fc-41ca-adc7-10a848a4ac00 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:17.990233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21e149a8-21fc-41ca-adc7-10a848a4ac00 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:17.990233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21e149a8-21fc-41ca-adc7-10a848a4ac00 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:18.071032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6abc90f7-8315-433c-b4a7-b44ef3962697 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:18.074650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6abc90f7-8315-433c-b4a7-b44ef3962697 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:18.093631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6abc90f7-8315-433c-b4a7-b44ef3962697 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:18.102211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6abc90f7-8315-433c-b4a7-b44ef3962697 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:18.103115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6abc90f7-8315-433c-b4a7-b44ef3962697 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:18.104037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6abc90f7-8315-433c-b4a7-b44ef3962697 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:18.105463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6abc90f7-8315-433c-b4a7-b44ef3962697 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:18.114118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6abc90f7-8315-433c-b4a7-b44ef3962697 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:18.388213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-21e149a8-21fc-41ca-adc7-10a848a4ac00 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:18.407981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-21e149a8-21fc-41ca-adc7-10a848a4ac00 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:18.411235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-21e149a8-21fc-41ca-adc7-10a848a4ac00 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:18.414005 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-21e149a8-21fc-41ca-adc7-10a848a4ac00 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1732 microversion: 2.20 time: 0.468478 Oct 10 23:38:18.415893 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2096/4290] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:38:17 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1732 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:38:18.422922 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9e50059a-500a-4bcd-8e8b-07fa1fcc17d3 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:18.427154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9e50059a-500a-4bcd-8e8b-07fa1fcc17d3 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:18.433989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e50059a-500a-4bcd-8e8b-07fa1fcc17d3 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:18.435062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e50059a-500a-4bcd-8e8b-07fa1fcc17d3 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:18.436057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e50059a-500a-4bcd-8e8b-07fa1fcc17d3 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:18.437067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e50059a-500a-4bcd-8e8b-07fa1fcc17d3 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:18.437789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e50059a-500a-4bcd-8e8b-07fa1fcc17d3 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:18.438919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e50059a-500a-4bcd-8e8b-07fa1fcc17d3 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:18.511495 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9e50059a-500a-4bcd-8e8b-07fa1fcc17d3 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093720 Oct 10 23:38:18.524640 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2097/4291] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:38:18 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:18.535316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fb721960-9d6c-43cb-86b9-e999498b8fd9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:18.539284 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fb721960-9d6c-43cb-86b9-e999498b8fd9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:18.553240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb721960-9d6c-43cb-86b9-e999498b8fd9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:18.558094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb721960-9d6c-43cb-86b9-e999498b8fd9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:18.558832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb721960-9d6c-43cb-86b9-e999498b8fd9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:18.562200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb721960-9d6c-43cb-86b9-e999498b8fd9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:18.563088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb721960-9d6c-43cb-86b9-e999498b8fd9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:18.566564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fb721960-9d6c-43cb-86b9-e999498b8fd9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:18.772765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6abc90f7-8315-433c-b4a7-b44ef3962697 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:18.784842 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6abc90f7-8315-433c-b4a7-b44ef3962697 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1529 microversion: 2.1 time: 0.718063 Oct 10 23:38:18.808512 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2195/4292] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:18 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1529 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:18.870069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fb721960-9d6c-43cb-86b9-e999498b8fd9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:18.884425 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fb721960-9d6c-43cb-86b9-e999498b8fd9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1516 microversion: 2.1 time: 0.358235 Oct 10 23:38:18.886468 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2098/4293] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:18 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1516 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:18.914418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-883a9630-e39d-441f-aa8a-ae1c8b5c0814 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:18.917368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-883a9630-e39d-441f-aa8a-ae1c8b5c0814 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:18.926502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-883a9630-e39d-441f-aa8a-ae1c8b5c0814 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:18.927257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-883a9630-e39d-441f-aa8a-ae1c8b5c0814 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:18.927934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-883a9630-e39d-441f-aa8a-ae1c8b5c0814 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:18.929275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-883a9630-e39d-441f-aa8a-ae1c8b5c0814 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:18.930069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-883a9630-e39d-441f-aa8a-ae1c8b5c0814 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:18.930823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-883a9630-e39d-441f-aa8a-ae1c8b5c0814 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:18.963202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-883a9630-e39d-441f-aa8a-ae1c8b5c0814 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lazy-loading 'flavor' on Instance uuid c1421397-3387-4b28-8473-51140ba79621 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:38:19.096470 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-883a9630-e39d-441f-aa8a-ae1c8b5c0814 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "POST /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621/action" status: 200 len: 32 microversion: 2.1 time: 0.186494 Oct 10 23:38:19.107890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ba7e86a0-4e58-4b01-804f-10652618ca92 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:19.109438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ba7e86a0-4e58-4b01-804f-10652618ca92 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:19.113344 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2196/4294] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:38:18 2022] POST /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621/action => generated 32 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:38:19.130939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba7e86a0-4e58-4b01-804f-10652618ca92 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:19.135955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba7e86a0-4e58-4b01-804f-10652618ca92 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:19.137230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba7e86a0-4e58-4b01-804f-10652618ca92 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:19.140491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba7e86a0-4e58-4b01-804f-10652618ca92 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:19.144278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba7e86a0-4e58-4b01-804f-10652618ca92 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:19.145888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba7e86a0-4e58-4b01-804f-10652618ca92 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:19.455603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a807e4b3-d62a-4cc8-9204-282aad1a0dcf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:19.456468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a807e4b3-d62a-4cc8-9204-282aad1a0dcf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:19.494322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a807e4b3-d62a-4cc8-9204-282aad1a0dcf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:19.495111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a807e4b3-d62a-4cc8-9204-282aad1a0dcf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:19.495708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a807e4b3-d62a-4cc8-9204-282aad1a0dcf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:19.496586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a807e4b3-d62a-4cc8-9204-282aad1a0dcf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:19.497198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a807e4b3-d62a-4cc8-9204-282aad1a0dcf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:19.497803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a807e4b3-d62a-4cc8-9204-282aad1a0dcf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:19.915618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a807e4b3-d62a-4cc8-9204-282aad1a0dcf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:19.932273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a807e4b3-d62a-4cc8-9204-282aad1a0dcf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:19.936271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a807e4b3-d62a-4cc8-9204-282aad1a0dcf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:19.939322 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a807e4b3-d62a-4cc8-9204-282aad1a0dcf tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1732 microversion: 2.20 time: 0.492042 Oct 10 23:38:19.940652 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2197/4295] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:38:19 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1732 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:38:19.963534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bd79e12c-b09f-447a-9468-abb16a7e419d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:19.967652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bd79e12c-b09f-447a-9468-abb16a7e419d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:19.984082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd79e12c-b09f-447a-9468-abb16a7e419d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:19.985925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd79e12c-b09f-447a-9468-abb16a7e419d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:19.989911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd79e12c-b09f-447a-9468-abb16a7e419d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:19.991084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd79e12c-b09f-447a-9468-abb16a7e419d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:19.991838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd79e12c-b09f-447a-9468-abb16a7e419d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:19.993199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd79e12c-b09f-447a-9468-abb16a7e419d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:20.039911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:20.080411 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bd79e12c-b09f-447a-9468-abb16a7e419d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138311 Oct 10 23:38:20.082440 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2198/4296] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:38:19 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:20.097057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-873cd126-a856-4e25-a22d-624a766313d3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:20.098106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-873cd126-a856-4e25-a22d-624a766313d3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:20.116188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-873cd126-a856-4e25-a22d-624a766313d3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:20.117076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-873cd126-a856-4e25-a22d-624a766313d3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:20.117784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-873cd126-a856-4e25-a22d-624a766313d3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:20.119137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-873cd126-a856-4e25-a22d-624a766313d3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:20.120294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-873cd126-a856-4e25-a22d-624a766313d3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:20.123320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-873cd126-a856-4e25-a22d-624a766313d3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:20.227099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ba7e86a0-4e58-4b01-804f-10652618ca92 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:20.244651 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ba7e86a0-4e58-4b01-804f-10652618ca92 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1522 microversion: 2.1 time: 1.141744 Oct 10 23:38:20.266176 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2099/4297] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:19 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1522 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:38:20.549366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-873cd126-a856-4e25-a22d-624a766313d3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:20.576157 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-873cd126-a856-4e25-a22d-624a766313d3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1529 microversion: 2.1 time: 0.485292 Oct 10 23:38:20.578198 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2199/4298] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:20 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1529 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:20.966737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f88e52a3-e002-4c8f-a693-8e5250af336a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:20.967728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f88e52a3-e002-4c8f-a693-8e5250af336a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:20.977039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f88e52a3-e002-4c8f-a693-8e5250af336a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:20.977604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f88e52a3-e002-4c8f-a693-8e5250af336a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:20.978094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f88e52a3-e002-4c8f-a693-8e5250af336a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:20.978840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f88e52a3-e002-4c8f-a693-8e5250af336a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:20.979300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f88e52a3-e002-4c8f-a693-8e5250af336a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:20.979733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f88e52a3-e002-4c8f-a693-8e5250af336a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:21.098931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0d1eb2a5-5792-46e6-8be5-74689dbc7338 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:21.101358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0d1eb2a5-5792-46e6-8be5-74689dbc7338 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:21.140572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d1eb2a5-5792-46e6-8be5-74689dbc7338 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:21.141906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d1eb2a5-5792-46e6-8be5-74689dbc7338 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:21.158198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d1eb2a5-5792-46e6-8be5-74689dbc7338 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:21.159157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d1eb2a5-5792-46e6-8be5-74689dbc7338 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:21.159656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d1eb2a5-5792-46e6-8be5-74689dbc7338 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:21.160106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d1eb2a5-5792-46e6-8be5-74689dbc7338 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:21.288943 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0d1eb2a5-5792-46e6-8be5-74689dbc7338 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.197149 Oct 10 23:38:21.289582 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2200/4299] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:38:21 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:21.308332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-250dc169-07b0-486f-8c1c-ee2906223a20 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:21.309110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-250dc169-07b0-486f-8c1c-ee2906223a20 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:21.332885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-250dc169-07b0-486f-8c1c-ee2906223a20 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:21.333418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-250dc169-07b0-486f-8c1c-ee2906223a20 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:21.333873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-250dc169-07b0-486f-8c1c-ee2906223a20 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:21.339403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-250dc169-07b0-486f-8c1c-ee2906223a20 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:21.339893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-250dc169-07b0-486f-8c1c-ee2906223a20 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:21.340337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-250dc169-07b0-486f-8c1c-ee2906223a20 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:21.570620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-250dc169-07b0-486f-8c1c-ee2906223a20 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:21.586542 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-250dc169-07b0-486f-8c1c-ee2906223a20 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1522 microversion: 2.1 time: 0.293807 Oct 10 23:38:21.597937 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2201/4300] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:21 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:21.618589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5dadf537-235f-4414-990e-8096805c6937 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:21.621721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5dadf537-235f-4414-990e-8096805c6937 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:21.630117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5dadf537-235f-4414-990e-8096805c6937 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:21.631671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5dadf537-235f-4414-990e-8096805c6937 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:21.632308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5dadf537-235f-4414-990e-8096805c6937 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:21.633255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5dadf537-235f-4414-990e-8096805c6937 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:21.634042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5dadf537-235f-4414-990e-8096805c6937 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:21.635533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5dadf537-235f-4414-990e-8096805c6937 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:21.757202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f88e52a3-e002-4c8f-a693-8e5250af336a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:21.768141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f88e52a3-e002-4c8f-a693-8e5250af336a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:21.777084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f88e52a3-e002-4c8f-a693-8e5250af336a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:21.778363 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f88e52a3-e002-4c8f-a693-8e5250af336a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1732 microversion: 2.20 time: 0.816423 Oct 10 23:38:21.807151 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2100/4301] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:38:20 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1732 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:38:21.880409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5dadf537-235f-4414-990e-8096805c6937 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:21.889922 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5dadf537-235f-4414-990e-8096805c6937 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1529 microversion: 2.1 time: 0.284030 Oct 10 23:38:21.892271 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2202/4302] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:21 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1529 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:22.291345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-27fec7f0-ecde-4e93-a1dc-8320697b523c req-fb44a147-4075-4185-aa45-55622018bd49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "961f5a5b-1142-497e-8b88-b16f193e66e4", "name": "network-vif-plugged", "status": "completed", "tag": "20d071d9-a8db-44d0-a2e2-ac7754ed4e80"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:22.302754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-844761e8-ae7e-4cb4-bfda-ef23cd7b0df6 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:22.305728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-844761e8-ae7e-4cb4-bfda-ef23cd7b0df6 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:22.318902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-844761e8-ae7e-4cb4-bfda-ef23cd7b0df6 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:22.319800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-844761e8-ae7e-4cb4-bfda-ef23cd7b0df6 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:22.320430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-844761e8-ae7e-4cb4-bfda-ef23cd7b0df6 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:22.321684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-844761e8-ae7e-4cb4-bfda-ef23cd7b0df6 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:22.321841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-27fec7f0-ecde-4e93-a1dc-8320697b523c req-fb44a147-4075-4185-aa45-55622018bd49 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:22.322229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-27fec7f0-ecde-4e93-a1dc-8320697b523c req-fb44a147-4075-4185-aa45-55622018bd49 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:22.322651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-27fec7f0-ecde-4e93-a1dc-8320697b523c req-fb44a147-4075-4185-aa45-55622018bd49 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:22.322916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-844761e8-ae7e-4cb4-bfda-ef23cd7b0df6 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:22.330248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-844761e8-ae7e-4cb4-bfda-ef23cd7b0df6 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:22.347644 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-27fec7f0-ecde-4e93-a1dc-8320697b523c req-fb44a147-4075-4185-aa45-55622018bd49 service nova] Creating event network-vif-plugged:20d071d9-a8db-44d0-a2e2-ac7754ed4e80 for instance 961f5a5b-1142-497e-8b88-b16f193e66e4 on n-h1-860864-2 Oct 10 23:38:22.360195 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-27fec7f0-ecde-4e93-a1dc-8320697b523c req-fb44a147-4075-4185-aa45-55622018bd49 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072503 Oct 10 23:38:22.362401 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2101/4303] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:22.399905 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-844761e8-ae7e-4cb4-bfda-ef23cd7b0df6 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102213 Oct 10 23:38:22.402692 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2203/4304] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:38:22 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:38:22.613976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5aa3fda8-5521-4cce-b645-976d835d8ae0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:22.615448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5aa3fda8-5521-4cce-b645-976d835d8ae0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:22.623136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5aa3fda8-5521-4cce-b645-976d835d8ae0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:22.624037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5aa3fda8-5521-4cce-b645-976d835d8ae0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:22.624917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5aa3fda8-5521-4cce-b645-976d835d8ae0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:22.626728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5aa3fda8-5521-4cce-b645-976d835d8ae0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:22.627313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5aa3fda8-5521-4cce-b645-976d835d8ae0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:22.627774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5aa3fda8-5521-4cce-b645-976d835d8ae0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:22.815863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f1b5df94-502e-48cc-8e10-9990371673db tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:22.816896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f1b5df94-502e-48cc-8e10-9990371673db tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:22.824755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1b5df94-502e-48cc-8e10-9990371673db tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:22.826458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1b5df94-502e-48cc-8e10-9990371673db tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:22.827401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1b5df94-502e-48cc-8e10-9990371673db tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:22.828394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1b5df94-502e-48cc-8e10-9990371673db tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:22.829307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1b5df94-502e-48cc-8e10-9990371673db tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:22.830168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1b5df94-502e-48cc-8e10-9990371673db tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:23.073334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5aa3fda8-5521-4cce-b645-976d835d8ae0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:23.090643 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5aa3fda8-5521-4cce-b645-976d835d8ae0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1522 microversion: 2.1 time: 0.481592 Oct 10 23:38:23.101562 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2102/4305] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:22 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1522 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:23.111525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b05b64fc-cb20-405f-a526-99861c74f313 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:23.112405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b05b64fc-cb20-405f-a526-99861c74f313 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:23.121123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b05b64fc-cb20-405f-a526-99861c74f313 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:23.121937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b05b64fc-cb20-405f-a526-99861c74f313 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:23.122562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b05b64fc-cb20-405f-a526-99861c74f313 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:23.123503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b05b64fc-cb20-405f-a526-99861c74f313 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:23.124116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b05b64fc-cb20-405f-a526-99861c74f313 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:23.125485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b05b64fc-cb20-405f-a526-99861c74f313 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:23.181238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f1b5df94-502e-48cc-8e10-9990371673db tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:23.191736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f1b5df94-502e-48cc-8e10-9990371673db tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:23.194834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f1b5df94-502e-48cc-8e10-9990371673db tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:23.199529 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f1b5df94-502e-48cc-8e10-9990371673db tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1732 microversion: 2.20 time: 0.389210 Oct 10 23:38:23.200376 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2204/4306] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:38:22 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1732 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:38:23.398904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b05b64fc-cb20-405f-a526-99861c74f313 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:23.415520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4621593a-c508-4e0e-b401-1f89f5c402eb tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:23.419438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4621593a-c508-4e0e-b401-1f89f5c402eb tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:23.420270 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b05b64fc-cb20-405f-a526-99861c74f313 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1529 microversion: 2.1 time: 0.314532 Oct 10 23:38:23.421274 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2103/4307] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:23 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1529 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:23.429986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4621593a-c508-4e0e-b401-1f89f5c402eb tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:23.430752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4621593a-c508-4e0e-b401-1f89f5c402eb tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:23.431412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4621593a-c508-4e0e-b401-1f89f5c402eb tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:23.432323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4621593a-c508-4e0e-b401-1f89f5c402eb tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:23.432994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4621593a-c508-4e0e-b401-1f89f5c402eb tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:23.435338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4621593a-c508-4e0e-b401-1f89f5c402eb tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:23.482632 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4621593a-c508-4e0e-b401-1f89f5c402eb tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071113 Oct 10 23:38:23.483920 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2205/4308] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:38:23 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:38:23.665400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cb3985ee-a74f-4a7a-b8df-58c1dd4d4a66 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-243343973", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "469208fa-af0c-43b6-b5ec-4ff2467769f1"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:23.734327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-cb3985ee-a74f-4a7a-b8df-58c1dd4d4a66 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] validate_networks() for [('469208fa-af0c-43b6-b5ec-4ff2467769f1', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:38:24.132225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ec8808e4-a221-4663-9a32-e74669ce60df tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:24.133054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ec8808e4-a221-4663-9a32-e74669ce60df tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:24.161000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ec8808e4-a221-4663-9a32-e74669ce60df tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:24.161975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ec8808e4-a221-4663-9a32-e74669ce60df tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:24.163843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ec8808e4-a221-4663-9a32-e74669ce60df tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:24.165614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ec8808e4-a221-4663-9a32-e74669ce60df tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:24.168812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ec8808e4-a221-4663-9a32-e74669ce60df tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:24.169505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ec8808e4-a221-4663-9a32-e74669ce60df tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:24.269409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-cb3985ee-a74f-4a7a-b8df-58c1dd4d4a66 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:38:24.270500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-cb3985ee-a74f-4a7a-b8df-58c1dd4d4a66 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:38:24.271136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-cb3985ee-a74f-4a7a-b8df-58c1dd4d4a66 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:38:24.271704 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-cb3985ee-a74f-4a7a-b8df-58c1dd4d4a66 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:38:24.272292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-cb3985ee-a74f-4a7a-b8df-58c1dd4d4a66 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:38:24.284699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb3985ee-a74f-4a7a-b8df-58c1dd4d4a66 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:24.289723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb3985ee-a74f-4a7a-b8df-58c1dd4d4a66 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:24.290608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb3985ee-a74f-4a7a-b8df-58c1dd4d4a66 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:24.292431 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb3985ee-a74f-4a7a-b8df-58c1dd4d4a66 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:24.295576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb3985ee-a74f-4a7a-b8df-58c1dd4d4a66 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:24.296214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb3985ee-a74f-4a7a-b8df-58c1dd4d4a66 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:24.349006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-cb3985ee-a74f-4a7a-b8df-58c1dd4d4a66 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Getting quotas for project 7030e994103a48d6bb58a2f6fd440074. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:38:24.364059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-cb3985ee-a74f-4a7a-b8df-58c1dd4d4a66 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Getting quotas for user 7595dc3ad9b546348a01ae0a638b110d and project 7030e994103a48d6bb58a2f6fd440074. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:38:24.389875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cb3985ee-a74f-4a7a-b8df-58c1dd4d4a66 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:38:24.392799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cb3985ee-a74f-4a7a-b8df-58c1dd4d4a66 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:38:24.464298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ec8808e4-a221-4663-9a32-e74669ce60df tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:24.474610 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ec8808e4-a221-4663-9a32-e74669ce60df tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1522 microversion: 2.1 time: 0.349050 Oct 10 23:38:24.487807 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2206/4309] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:24 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:24.494984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2ebdcb7d-2d57-4f27-9cd2-5a7ea0af0821 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:24.494984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2ebdcb7d-2d57-4f27-9cd2-5a7ea0af0821 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:24.507284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ebdcb7d-2d57-4f27-9cd2-5a7ea0af0821 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:24.508061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ebdcb7d-2d57-4f27-9cd2-5a7ea0af0821 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:24.512462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ebdcb7d-2d57-4f27-9cd2-5a7ea0af0821 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:24.513815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ebdcb7d-2d57-4f27-9cd2-5a7ea0af0821 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:24.515524 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cb3985ee-a74f-4a7a-b8df-58c1dd4d4a66 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.853881 Oct 10 23:38:24.515677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ebdcb7d-2d57-4f27-9cd2-5a7ea0af0821 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:24.516247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ebdcb7d-2d57-4f27-9cd2-5a7ea0af0821 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:24.519440 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2104/4310] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:38:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:38:24.527145 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a3045d76-26a9-43bd-97c0-3dd0fd3c8505 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:24.528458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a3045d76-26a9-43bd-97c0-3dd0fd3c8505 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:24.550365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3045d76-26a9-43bd-97c0-3dd0fd3c8505 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:24.551726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3045d76-26a9-43bd-97c0-3dd0fd3c8505 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:24.555078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3045d76-26a9-43bd-97c0-3dd0fd3c8505 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:24.557318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3045d76-26a9-43bd-97c0-3dd0fd3c8505 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:24.557980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3045d76-26a9-43bd-97c0-3dd0fd3c8505 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:24.558653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3045d76-26a9-43bd-97c0-3dd0fd3c8505 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:24.562829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:24.874468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a3045d76-26a9-43bd-97c0-3dd0fd3c8505 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:24.886985 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a3045d76-26a9-43bd-97c0-3dd0fd3c8505 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1524 microversion: 2.1 time: 0.365970 Oct 10 23:38:24.895644 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2105/4311] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:24 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1524 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:24.902366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e798ac10-f08e-48ea-8cd7-e018169cd767 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:24.903179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e798ac10-f08e-48ea-8cd7-e018169cd767 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:25.027162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e798ac10-f08e-48ea-8cd7-e018169cd767 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:25.046946 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e798ac10-f08e-48ea-8cd7-e018169cd767 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb" status: 200 len: 1217 microversion: 2.1 time: 0.145391 Oct 10 23:38:25.057466 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2106/4312] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:24 2022] GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb => generated 1217 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:25.268481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2ebdcb7d-2d57-4f27-9cd2-5a7ea0af0821 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:25.285686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2ebdcb7d-2d57-4f27-9cd2-5a7ea0af0821 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:25.290925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2ebdcb7d-2d57-4f27-9cd2-5a7ea0af0821 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:25.292207 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2ebdcb7d-2d57-4f27-9cd2-5a7ea0af0821 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1732 microversion: 2.20 time: 0.812654 Oct 10 23:38:25.321972 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2207/4313] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:38:24 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1732 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:38:25.503668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-57898b7b-2fc8-4609-8ef6-89011e30ef91 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:25.504371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-57898b7b-2fc8-4609-8ef6-89011e30ef91 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:25.523573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57898b7b-2fc8-4609-8ef6-89011e30ef91 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:25.524316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57898b7b-2fc8-4609-8ef6-89011e30ef91 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:25.527094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57898b7b-2fc8-4609-8ef6-89011e30ef91 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:25.528098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57898b7b-2fc8-4609-8ef6-89011e30ef91 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:25.529651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57898b7b-2fc8-4609-8ef6-89011e30ef91 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:25.531681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57898b7b-2fc8-4609-8ef6-89011e30ef91 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:25.861942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-57898b7b-2fc8-4609-8ef6-89011e30ef91 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:25.875268 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-57898b7b-2fc8-4609-8ef6-89011e30ef91 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1522 microversion: 2.1 time: 0.377331 Oct 10 23:38:25.892220 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2107/4314] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:25 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:25.916214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d79c11f2-0f8f-45e0-a2b5-070b540f0652 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:25.917554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d79c11f2-0f8f-45e0-a2b5-070b540f0652 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:25.936332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d79c11f2-0f8f-45e0-a2b5-070b540f0652 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:25.937220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d79c11f2-0f8f-45e0-a2b5-070b540f0652 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:25.940065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d79c11f2-0f8f-45e0-a2b5-070b540f0652 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:25.941257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d79c11f2-0f8f-45e0-a2b5-070b540f0652 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:25.943727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d79c11f2-0f8f-45e0-a2b5-070b540f0652 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:25.946367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d79c11f2-0f8f-45e0-a2b5-070b540f0652 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:26.074291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aea9fadc-504a-491d-87c4-b32bb0e19f68 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:26.074910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aea9fadc-504a-491d-87c4-b32bb0e19f68 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:26.089974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aea9fadc-504a-491d-87c4-b32bb0e19f68 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:26.092559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aea9fadc-504a-491d-87c4-b32bb0e19f68 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:26.093165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aea9fadc-504a-491d-87c4-b32bb0e19f68 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:26.094520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aea9fadc-504a-491d-87c4-b32bb0e19f68 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:26.094993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aea9fadc-504a-491d-87c4-b32bb0e19f68 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:26.095476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aea9fadc-504a-491d-87c4-b32bb0e19f68 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:26.269301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aea9fadc-504a-491d-87c4-b32bb0e19f68 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:26.294017 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aea9fadc-504a-491d-87c4-b32bb0e19f68 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb" status: 200 len: 1269 microversion: 2.1 time: 0.223692 Oct 10 23:38:26.297970 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2108/4315] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:26 2022] GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb => generated 1269 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:38:26.330270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-94614753-2231-4204-b1f8-a0162fbfd07a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:26.332003 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-94614753-2231-4204-b1f8-a0162fbfd07a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:26.347673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94614753-2231-4204-b1f8-a0162fbfd07a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:26.348602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94614753-2231-4204-b1f8-a0162fbfd07a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:26.350160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94614753-2231-4204-b1f8-a0162fbfd07a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:26.354399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94614753-2231-4204-b1f8-a0162fbfd07a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:26.355403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94614753-2231-4204-b1f8-a0162fbfd07a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:26.356086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94614753-2231-4204-b1f8-a0162fbfd07a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:26.555010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d79c11f2-0f8f-45e0-a2b5-070b540f0652 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:26.569921 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d79c11f2-0f8f-45e0-a2b5-070b540f0652 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1524 microversion: 2.1 time: 0.657956 Oct 10 23:38:26.576699 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2208/4316] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:25 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1524 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:26.907535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-18123ed0-95a0-45f6-82a0-b6aad561a871 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:26.911258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-18123ed0-95a0-45f6-82a0-b6aad561a871 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:26.926004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18123ed0-95a0-45f6-82a0-b6aad561a871 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:26.927153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18123ed0-95a0-45f6-82a0-b6aad561a871 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:26.927784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18123ed0-95a0-45f6-82a0-b6aad561a871 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:26.928678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18123ed0-95a0-45f6-82a0-b6aad561a871 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:26.932445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18123ed0-95a0-45f6-82a0-b6aad561a871 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:26.933275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18123ed0-95a0-45f6-82a0-b6aad561a871 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:27.169924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-94614753-2231-4204-b1f8-a0162fbfd07a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:27.197069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-94614753-2231-4204-b1f8-a0162fbfd07a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:27.200337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-94614753-2231-4204-b1f8-a0162fbfd07a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:27.205279 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-94614753-2231-4204-b1f8-a0162fbfd07a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1732 microversion: 2.20 time: 0.880577 Oct 10 23:38:27.211584 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2109/4317] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:38:26 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1732 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:38:27.329359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-121b55fc-b4a4-4692-a914-de2c91faba11 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:27.330075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-121b55fc-b4a4-4692-a914-de2c91faba11 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:27.343628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-121b55fc-b4a4-4692-a914-de2c91faba11 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:27.344298 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-121b55fc-b4a4-4692-a914-de2c91faba11 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:27.344732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-121b55fc-b4a4-4692-a914-de2c91faba11 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:27.345583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-121b55fc-b4a4-4692-a914-de2c91faba11 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:27.346051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-121b55fc-b4a4-4692-a914-de2c91faba11 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:27.346486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-121b55fc-b4a4-4692-a914-de2c91faba11 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:27.579869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-18123ed0-95a0-45f6-82a0-b6aad561a871 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:27.591683 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-18123ed0-95a0-45f6-82a0-b6aad561a871 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1522 microversion: 2.1 time: 0.689474 Oct 10 23:38:27.595071 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2209/4318] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:26 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1522 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:27.601111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f0f6c081-5a6d-406a-85e2-be8a4c98e93d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:27.611555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f0f6c081-5a6d-406a-85e2-be8a4c98e93d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:27.646761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0f6c081-5a6d-406a-85e2-be8a4c98e93d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:27.655155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0f6c081-5a6d-406a-85e2-be8a4c98e93d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:27.657961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0f6c081-5a6d-406a-85e2-be8a4c98e93d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:27.659334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0f6c081-5a6d-406a-85e2-be8a4c98e93d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:27.660043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0f6c081-5a6d-406a-85e2-be8a4c98e93d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:27.662637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f0f6c081-5a6d-406a-85e2-be8a4c98e93d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:27.917491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-121b55fc-b4a4-4692-a914-de2c91faba11 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:27.926578 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-121b55fc-b4a4-4692-a914-de2c91faba11 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb" status: 200 len: 1275 microversion: 2.1 time: 0.603926 Oct 10 23:38:27.933110 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2110/4319] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:27 2022] GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb => generated 1275 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:27.970129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f0f6c081-5a6d-406a-85e2-be8a4c98e93d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:27.985669 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f0f6c081-5a6d-406a-85e2-be8a4c98e93d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1524 microversion: 2.1 time: 0.387021 Oct 10 23:38:27.988134 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2210/4320] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:27 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1524 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:28.240433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-083d09f4-4a03-4ea3-8dbb-8926563ba46a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:28.241530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-083d09f4-4a03-4ea3-8dbb-8926563ba46a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:28.257813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-083d09f4-4a03-4ea3-8dbb-8926563ba46a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:28.262458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-083d09f4-4a03-4ea3-8dbb-8926563ba46a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:28.263190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-083d09f4-4a03-4ea3-8dbb-8926563ba46a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:28.264102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-083d09f4-4a03-4ea3-8dbb-8926563ba46a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:28.272017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-083d09f4-4a03-4ea3-8dbb-8926563ba46a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:28.272576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-083d09f4-4a03-4ea3-8dbb-8926563ba46a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:28.304485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9d54db73-6be5-4e9a-9dec-0b4e59e98c59 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-2000550209", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "6207edcd-cb21-4a0a-93ef-d4b2fb2efd01"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:28.434021 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-9d54db73-6be5-4e9a-9dec-0b4e59e98c59 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] validate_networks() for [('6207edcd-cb21-4a0a-93ef-d4b2fb2efd01', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:38:29.036314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-083d09f4-4a03-4ea3-8dbb-8926563ba46a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:29.045898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-083d09f4-4a03-4ea3-8dbb-8926563ba46a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:29.047772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-083d09f4-4a03-4ea3-8dbb-8926563ba46a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:29.049517 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-083d09f4-4a03-4ea3-8dbb-8926563ba46a tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1732 microversion: 2.20 time: 0.813820 Oct 10 23:38:29.052265 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2211/4321] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:38:28 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1732 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:38:29.057523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2762deb5-2e84-4d0e-8ab8-28ea2d7b3afa tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:29.058468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2762deb5-2e84-4d0e-8ab8-28ea2d7b3afa tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:29.066723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2762deb5-2e84-4d0e-8ab8-28ea2d7b3afa tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:29.067694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2762deb5-2e84-4d0e-8ab8-28ea2d7b3afa tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:29.068353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2762deb5-2e84-4d0e-8ab8-28ea2d7b3afa tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:29.069692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2762deb5-2e84-4d0e-8ab8-28ea2d7b3afa tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:29.070345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2762deb5-2e84-4d0e-8ab8-28ea2d7b3afa tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:29.071108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2762deb5-2e84-4d0e-8ab8-28ea2d7b3afa tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:29.282947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2762deb5-2e84-4d0e-8ab8-28ea2d7b3afa tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:29.293909 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2762deb5-2e84-4d0e-8ab8-28ea2d7b3afa tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1522 microversion: 2.1 time: 0.240396 Oct 10 23:38:29.294927 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2212/4322] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:29 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:29.300649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3ce6690c-0df6-4b19-a316-22b11e268b00 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:29.303314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3ce6690c-0df6-4b19-a316-22b11e268b00 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:29.315907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ce6690c-0df6-4b19-a316-22b11e268b00 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:29.316665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ce6690c-0df6-4b19-a316-22b11e268b00 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:29.317514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ce6690c-0df6-4b19-a316-22b11e268b00 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:29.318419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ce6690c-0df6-4b19-a316-22b11e268b00 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:29.319108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ce6690c-0df6-4b19-a316-22b11e268b00 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:29.319841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ce6690c-0df6-4b19-a316-22b11e268b00 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:29.634588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3ce6690c-0df6-4b19-a316-22b11e268b00 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:29.653299 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3ce6690c-0df6-4b19-a316-22b11e268b00 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb" status: 200 len: 1317 microversion: 2.1 time: 0.357113 Oct 10 23:38:29.654496 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2213/4323] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:29 2022] GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:29.662666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e92ce085-a8e1-42d1-8338-c1ed871d48f7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:29.670226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e92ce085-a8e1-42d1-8338-c1ed871d48f7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:29.680953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e92ce085-a8e1-42d1-8338-c1ed871d48f7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:29.681678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e92ce085-a8e1-42d1-8338-c1ed871d48f7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:29.690553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e92ce085-a8e1-42d1-8338-c1ed871d48f7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:29.691736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e92ce085-a8e1-42d1-8338-c1ed871d48f7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:29.692372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e92ce085-a8e1-42d1-8338-c1ed871d48f7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:29.692958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e92ce085-a8e1-42d1-8338-c1ed871d48f7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:30.037243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e92ce085-a8e1-42d1-8338-c1ed871d48f7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:30.050595 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e92ce085-a8e1-42d1-8338-c1ed871d48f7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1524 microversion: 2.1 time: 0.394531 Oct 10 23:38:30.051574 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2214/4324] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:29 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1524 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:30.083059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-03bb059a-49e9-4b66-be60-644d2a240dc4 req-6809ab33-be7f-45db-a2c8-9c14f14e806e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f5c98e-777a-4d5b-aed5-89fd026f1734", "name": "network-vif-plugged", "status": "completed", "tag": "14e55a18-a2c4-41ce-8ca8-1d0de903ab65"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:30.116899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-03bb059a-49e9-4b66-be60-644d2a240dc4 req-6809ab33-be7f-45db-a2c8-9c14f14e806e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:30.117600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-03bb059a-49e9-4b66-be60-644d2a240dc4 req-6809ab33-be7f-45db-a2c8-9c14f14e806e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:30.119032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-03bb059a-49e9-4b66-be60-644d2a240dc4 req-6809ab33-be7f-45db-a2c8-9c14f14e806e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:30.130413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:30.154171 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-03bb059a-49e9-4b66-be60-644d2a240dc4 req-6809ab33-be7f-45db-a2c8-9c14f14e806e service nova] Creating event network-vif-plugged:14e55a18-a2c4-41ce-8ca8-1d0de903ab65 for instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 on n-h2-860864-2 Oct 10 23:38:30.164598 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-03bb059a-49e9-4b66-be60-644d2a240dc4 req-6809ab33-be7f-45db-a2c8-9c14f14e806e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087389 Oct 10 23:38:30.167364 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2215/4325] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:38:30.185844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-461501cb-3912-45f9-af21-7d714bfb75ec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:30.189590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-461501cb-3912-45f9-af21-7d714bfb75ec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:30.206722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-461501cb-3912-45f9-af21-7d714bfb75ec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:30.208085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-461501cb-3912-45f9-af21-7d714bfb75ec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:30.211254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-461501cb-3912-45f9-af21-7d714bfb75ec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:30.212291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-461501cb-3912-45f9-af21-7d714bfb75ec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:30.213088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-461501cb-3912-45f9-af21-7d714bfb75ec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:30.213808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-461501cb-3912-45f9-af21-7d714bfb75ec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:30.460685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-9d54db73-6be5-4e9a-9dec-0b4e59e98c59 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:38:30.461770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-9d54db73-6be5-4e9a-9dec-0b4e59e98c59 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:38:30.462264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-9d54db73-6be5-4e9a-9dec-0b4e59e98c59 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:38:30.462678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-9d54db73-6be5-4e9a-9dec-0b4e59e98c59 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:38:30.463300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-9d54db73-6be5-4e9a-9dec-0b4e59e98c59 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:38:30.467057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:30.494028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d54db73-6be5-4e9a-9dec-0b4e59e98c59 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:30.502969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d54db73-6be5-4e9a-9dec-0b4e59e98c59 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:30.504055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d54db73-6be5-4e9a-9dec-0b4e59e98c59 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:30.512522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d54db73-6be5-4e9a-9dec-0b4e59e98c59 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:30.514396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d54db73-6be5-4e9a-9dec-0b4e59e98c59 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:30.514861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d54db73-6be5-4e9a-9dec-0b4e59e98c59 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:30.565230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-9d54db73-6be5-4e9a-9dec-0b4e59e98c59 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Getting quotas for project d32a42ea929d4de29a9a37afc03f4b2b. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:38:30.568829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-461501cb-3912-45f9-af21-7d714bfb75ec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:30.574874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-9d54db73-6be5-4e9a-9dec-0b4e59e98c59 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Getting quotas for user 2a7ffba096424668a5d3c1320056533e and project d32a42ea929d4de29a9a37afc03f4b2b. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:38:30.583450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-461501cb-3912-45f9-af21-7d714bfb75ec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:30.585136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-461501cb-3912-45f9-af21-7d714bfb75ec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:30.586603 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-461501cb-3912-45f9-af21-7d714bfb75ec tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1732 microversion: 2.20 time: 0.410715 Oct 10 23:38:30.597067 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2216/4326] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:38:30 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1732 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:38:30.598738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9d54db73-6be5-4e9a-9dec-0b4e59e98c59 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Going to run 2 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:38:30.601523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9d54db73-6be5-4e9a-9dec-0b4e59e98c59 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 8fd7d94f-f58e-4be5-8e0f-11e9f12fb93f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:38:30.602782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-553b9089-1ab3-426e-8068-1e1a65042fe2 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:30.603598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-553b9089-1ab3-426e-8068-1e1a65042fe2 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:30.620020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-553b9089-1ab3-426e-8068-1e1a65042fe2 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:30.620660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-553b9089-1ab3-426e-8068-1e1a65042fe2 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:30.621198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-553b9089-1ab3-426e-8068-1e1a65042fe2 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:30.622044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-553b9089-1ab3-426e-8068-1e1a65042fe2 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:30.622728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-553b9089-1ab3-426e-8068-1e1a65042fe2 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:30.623370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-553b9089-1ab3-426e-8068-1e1a65042fe2 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:30.654208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9d54db73-6be5-4e9a-9dec-0b4e59e98c59 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 5900f1b9-105d-4c6d-8455-e772d3e5012a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=8fd7d94f-f58e-4be5-8e0f-11e9f12fb93f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:38:30.847469 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9d54db73-6be5-4e9a-9dec-0b4e59e98c59 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.817776 Oct 10 23:38:30.854032 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2111/4327] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:38:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:38:30.860135 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2680716a-3277-4bbe-91f6-06339af5b3c4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:30.860776 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2680716a-3277-4bbe-91f6-06339af5b3c4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:30.880731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2680716a-3277-4bbe-91f6-06339af5b3c4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:30.881398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2680716a-3277-4bbe-91f6-06339af5b3c4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:30.881992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2680716a-3277-4bbe-91f6-06339af5b3c4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:30.882847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2680716a-3277-4bbe-91f6-06339af5b3c4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:30.883335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2680716a-3277-4bbe-91f6-06339af5b3c4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:30.883776 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2680716a-3277-4bbe-91f6-06339af5b3c4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:31.007326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-553b9089-1ab3-426e-8068-1e1a65042fe2 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:31.018616 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-553b9089-1ab3-426e-8068-1e1a65042fe2 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1522 microversion: 2.1 time: 0.419667 Oct 10 23:38:31.020732 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2217/4328] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:30 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:31.026342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b2e1775c-5bc0-45ec-ac61-e9dc438a3ff4 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:31.032343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b2e1775c-5bc0-45ec-ac61-e9dc438a3ff4 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:31.033528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b2e1775c-5bc0-45ec-ac61-e9dc438a3ff4 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Searching by: {'deleted': False, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b'} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:38:31.069664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2e1775c-5bc0-45ec-ac61-e9dc438a3ff4 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:31.073187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2e1775c-5bc0-45ec-ac61-e9dc438a3ff4 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:31.074028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2e1775c-5bc0-45ec-ac61-e9dc438a3ff4 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:31.075077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2e1775c-5bc0-45ec-ac61-e9dc438a3ff4 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:31.075766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2e1775c-5bc0-45ec-ac61-e9dc438a3ff4 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:31.077646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2e1775c-5bc0-45ec-ac61-e9dc438a3ff4 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:31.159930 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b2e1775c-5bc0-45ec-ac61-e9dc438a3ff4 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.137597 Oct 10 23:38:31.161119 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2218/4329] 10.222.0.23 () {58 vars in 1125 bytes} [Mon Oct 10 23:38:31 2022] GET /compute/v2.1/servers => generated 677 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:31.176392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-54fbdaf5-e628-412b-8172-ea17fa250850 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:31.182885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-54fbdaf5-e628-412b-8172-ea17fa250850 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:31.198983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54fbdaf5-e628-412b-8172-ea17fa250850 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:31.202173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54fbdaf5-e628-412b-8172-ea17fa250850 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:31.202729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54fbdaf5-e628-412b-8172-ea17fa250850 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:31.204946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54fbdaf5-e628-412b-8172-ea17fa250850 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:31.205082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54fbdaf5-e628-412b-8172-ea17fa250850 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:31.208011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54fbdaf5-e628-412b-8172-ea17fa250850 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:31.491063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-54fbdaf5-e628-412b-8172-ea17fa250850 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:31.503012 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-54fbdaf5-e628-412b-8172-ea17fa250850 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1524 microversion: 2.1 time: 0.331830 Oct 10 23:38:31.504004 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2219/4330] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:31 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1524 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:31.514399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b2f5c501-dc26-4fd7-a3a3-ee2341f36069 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:31.515021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b2f5c501-dc26-4fd7-a3a3-ee2341f36069 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 5900f1b9-105d-4c6d-8455-e772d3e5012a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:31.562771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2680716a-3277-4bbe-91f6-06339af5b3c4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:31.574775 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2680716a-3277-4bbe-91f6-06339af5b3c4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb" status: 200 len: 1317 microversion: 2.1 time: 0.720000 Oct 10 23:38:31.576087 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2112/4331] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:30 2022] GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb => generated 1317 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:31.616177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b2f5c501-dc26-4fd7-a3a3-ee2341f36069 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:31.625275 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eccba7e2-96e1-47f1-a9a3-9f5614a00f61 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:31.625589 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b2f5c501-dc26-4fd7-a3a3-ee2341f36069 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a" status: 200 len: 1220 microversion: 2.1 time: 0.118841 Oct 10 23:38:31.626270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eccba7e2-96e1-47f1-a9a3-9f5614a00f61 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:31.637645 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2220/4332] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:31 2022] GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a => generated 1220 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:31.647718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eccba7e2-96e1-47f1-a9a3-9f5614a00f61 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:31.648335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eccba7e2-96e1-47f1-a9a3-9f5614a00f61 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:31.648832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eccba7e2-96e1-47f1-a9a3-9f5614a00f61 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:31.649578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eccba7e2-96e1-47f1-a9a3-9f5614a00f61 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:31.650032 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eccba7e2-96e1-47f1-a9a3-9f5614a00f61 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:31.650813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eccba7e2-96e1-47f1-a9a3-9f5614a00f61 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:32.041167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-528530f6-893d-41bf-a953-1bba0fe06677 req-831e79a2-a858-40d0-9445-73d902a1e941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb", "tag": "c8a3b1ab-895f-48f5-bcc5-2bf399bb9df5"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:32.061003 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-eccba7e2-96e1-47f1-a9a3-9f5614a00f61 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:32.073744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-528530f6-893d-41bf-a953-1bba0fe06677 req-831e79a2-a858-40d0-9445-73d902a1e941 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:32.082457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-528530f6-893d-41bf-a953-1bba0fe06677 req-831e79a2-a858-40d0-9445-73d902a1e941 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:32.082948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-eccba7e2-96e1-47f1-a9a3-9f5614a00f61 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:32.084005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-528530f6-893d-41bf-a953-1bba0fe06677 req-831e79a2-a858-40d0-9445-73d902a1e941 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:32.086842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-eccba7e2-96e1-47f1-a9a3-9f5614a00f61 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:32.092661 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eccba7e2-96e1-47f1-a9a3-9f5614a00f61 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1732 microversion: 2.20 time: 0.471999 Oct 10 23:38:32.114339 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2113/4333] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:38:31 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1732 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:38:32.122675 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-528530f6-893d-41bf-a953-1bba0fe06677 req-831e79a2-a858-40d0-9445-73d902a1e941 service nova] Creating event network-changed:c8a3b1ab-895f-48f5-bcc5-2bf399bb9df5 for instance fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb on n-h2-860864-2 Oct 10 23:38:32.128674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-502af65d-83ea-4da0-a394-a22ffa779ceb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:32.129521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-502af65d-83ea-4da0-a394-a22ffa779ceb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:32.142846 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-528530f6-893d-41bf-a953-1bba0fe06677 req-831e79a2-a858-40d0-9445-73d902a1e941 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105669 Oct 10 23:38:32.147289 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-502af65d-83ea-4da0-a394-a22ffa779ceb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:32.161778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-502af65d-83ea-4da0-a394-a22ffa779ceb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:32.163164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-502af65d-83ea-4da0-a394-a22ffa779ceb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:32.163353 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2221/4334] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:32.164312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-502af65d-83ea-4da0-a394-a22ffa779ceb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:32.164999 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-502af65d-83ea-4da0-a394-a22ffa779ceb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:32.166165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-502af65d-83ea-4da0-a394-a22ffa779ceb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:32.535044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0d358497-70fd-423c-9117-1001e120176d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:32.535761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0d358497-70fd-423c-9117-1001e120176d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:32.551235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d358497-70fd-423c-9117-1001e120176d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:32.551748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d358497-70fd-423c-9117-1001e120176d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:32.552194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d358497-70fd-423c-9117-1001e120176d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:32.558299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d358497-70fd-423c-9117-1001e120176d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:32.558895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d358497-70fd-423c-9117-1001e120176d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:32.559335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d358497-70fd-423c-9117-1001e120176d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:32.819997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-502af65d-83ea-4da0-a394-a22ffa779ceb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:32.843748 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-502af65d-83ea-4da0-a394-a22ffa779ceb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1522 microversion: 2.1 time: 0.727750 Oct 10 23:38:32.860708 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2114/4335] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:32 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1522 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:32.865891 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cedde0e1-f026-4868-af8e-f0b0754d8aef tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:32.880347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cedde0e1-f026-4868-af8e-f0b0754d8aef tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:32.909946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cedde0e1-f026-4868-af8e-f0b0754d8aef tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:32.911092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cedde0e1-f026-4868-af8e-f0b0754d8aef tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:32.913741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cedde0e1-f026-4868-af8e-f0b0754d8aef tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:32.916483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cedde0e1-f026-4868-af8e-f0b0754d8aef tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:32.917579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cedde0e1-f026-4868-af8e-f0b0754d8aef tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:32.921029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cedde0e1-f026-4868-af8e-f0b0754d8aef tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:33.006508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0d358497-70fd-423c-9117-1001e120176d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:33.024668 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0d358497-70fd-423c-9117-1001e120176d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1524 microversion: 2.1 time: 0.490539 Oct 10 23:38:33.034081 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2222/4336] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:32 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1524 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:33.051026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-51b152f1-585e-48fc-a48d-da024c391ea6 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:33.052001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-51b152f1-585e-48fc-a48d-da024c391ea6 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 5900f1b9-105d-4c6d-8455-e772d3e5012a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:33.073716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51b152f1-585e-48fc-a48d-da024c391ea6 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:33.088488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51b152f1-585e-48fc-a48d-da024c391ea6 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:33.099938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51b152f1-585e-48fc-a48d-da024c391ea6 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:33.101155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51b152f1-585e-48fc-a48d-da024c391ea6 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:33.101866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51b152f1-585e-48fc-a48d-da024c391ea6 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:33.106402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51b152f1-585e-48fc-a48d-da024c391ea6 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:33.312043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-51b152f1-585e-48fc-a48d-da024c391ea6 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:33.333699 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-51b152f1-585e-48fc-a48d-da024c391ea6 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a" status: 200 len: 1216 microversion: 2.1 time: 0.300365 Oct 10 23:38:33.338581 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2223/4337] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:33 2022] GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a => generated 1216 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:33.352389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-749b32a8-13f3-4fad-96fd-2b2a749ab464 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:33.354243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-749b32a8-13f3-4fad-96fd-2b2a749ab464 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:33.391306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-749b32a8-13f3-4fad-96fd-2b2a749ab464 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:33.394289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-749b32a8-13f3-4fad-96fd-2b2a749ab464 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:33.394951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-749b32a8-13f3-4fad-96fd-2b2a749ab464 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:33.396799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-749b32a8-13f3-4fad-96fd-2b2a749ab464 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:33.397600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-749b32a8-13f3-4fad-96fd-2b2a749ab464 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:33.400771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-749b32a8-13f3-4fad-96fd-2b2a749ab464 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:33.590196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cedde0e1-f026-4868-af8e-f0b0754d8aef tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:33.607054 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cedde0e1-f026-4868-af8e-f0b0754d8aef tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb" status: 200 len: 1317 microversion: 2.1 time: 0.744789 Oct 10 23:38:33.627099 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2115/4338] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:32 2022] GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb => generated 1317 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:33.805750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-749b32a8-13f3-4fad-96fd-2b2a749ab464 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:33.816494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-749b32a8-13f3-4fad-96fd-2b2a749ab464 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:33.821321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-749b32a8-13f3-4fad-96fd-2b2a749ab464 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:33.826356 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-749b32a8-13f3-4fad-96fd-2b2a749ab464 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1732 microversion: 2.20 time: 0.485384 Oct 10 23:38:33.829997 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2224/4339] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:38:33 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1732 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:38:33.883366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a55213cb-6040-4b22-8a24-3deff56ce0ad tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:33.884581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a55213cb-6040-4b22-8a24-3deff56ce0ad tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:33.896808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a55213cb-6040-4b22-8a24-3deff56ce0ad tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:33.897230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a55213cb-6040-4b22-8a24-3deff56ce0ad tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:33.897769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a55213cb-6040-4b22-8a24-3deff56ce0ad tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:33.898488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a55213cb-6040-4b22-8a24-3deff56ce0ad tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:33.898947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a55213cb-6040-4b22-8a24-3deff56ce0ad tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:33.899373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a55213cb-6040-4b22-8a24-3deff56ce0ad tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:34.054233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3066a281-af85-42c0-8320-af4a2689c5f9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:34.055172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3066a281-af85-42c0-8320-af4a2689c5f9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:34.071057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3066a281-af85-42c0-8320-af4a2689c5f9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:34.084565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3066a281-af85-42c0-8320-af4a2689c5f9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:34.088021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3066a281-af85-42c0-8320-af4a2689c5f9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:34.092885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3066a281-af85-42c0-8320-af4a2689c5f9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:34.093509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3066a281-af85-42c0-8320-af4a2689c5f9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:34.102375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3066a281-af85-42c0-8320-af4a2689c5f9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:34.366830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a55213cb-6040-4b22-8a24-3deff56ce0ad tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:34.384643 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a55213cb-6040-4b22-8a24-3deff56ce0ad tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1522 microversion: 2.1 time: 0.506676 Oct 10 23:38:34.385567 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2116/4340] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:33 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1522 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:34.391699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d1451978-10c2-4801-ad45-184410e9a454 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:34.395485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d1451978-10c2-4801-ad45-184410e9a454 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 5900f1b9-105d-4c6d-8455-e772d3e5012a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:34.395843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3066a281-af85-42c0-8320-af4a2689c5f9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:34.407372 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3066a281-af85-42c0-8320-af4a2689c5f9 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1524 microversion: 2.1 time: 0.355943 Oct 10 23:38:34.409330 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1451978-10c2-4801-ad45-184410e9a454 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:34.409845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1451978-10c2-4801-ad45-184410e9a454 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:34.410304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1451978-10c2-4801-ad45-184410e9a454 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:34.411012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1451978-10c2-4801-ad45-184410e9a454 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:34.411460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1451978-10c2-4801-ad45-184410e9a454 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:34.411879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1451978-10c2-4801-ad45-184410e9a454 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:34.417663 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2225/4341] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:34 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1524 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:38:34.512629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d1451978-10c2-4801-ad45-184410e9a454 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:34.524838 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d1451978-10c2-4801-ad45-184410e9a454 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a" status: 200 len: 1272 microversion: 2.1 time: 0.137958 Oct 10 23:38:34.526243 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2117/4342] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:34 2022] GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a => generated 1272 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:34.635057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-980939ba-a988-441b-a80a-d5718637f65e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:34.635777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-980939ba-a988-441b-a80a-d5718637f65e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:34.647587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-980939ba-a988-441b-a80a-d5718637f65e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:34.650148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-980939ba-a988-441b-a80a-d5718637f65e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:34.650661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-980939ba-a988-441b-a80a-d5718637f65e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:34.652240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-980939ba-a988-441b-a80a-d5718637f65e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:34.652719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-980939ba-a988-441b-a80a-d5718637f65e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:34.654990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-980939ba-a988-441b-a80a-d5718637f65e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:34.870506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2eec9638-66e0-4161-ac26-0325e2411c10 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:34.871599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2eec9638-66e0-4161-ac26-0325e2411c10 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:34.902562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2eec9638-66e0-4161-ac26-0325e2411c10 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:34.918547 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2eec9638-66e0-4161-ac26-0325e2411c10 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:34.919000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2eec9638-66e0-4161-ac26-0325e2411c10 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:34.919762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2eec9638-66e0-4161-ac26-0325e2411c10 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:34.920489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2eec9638-66e0-4161-ac26-0325e2411c10 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:34.921134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2eec9638-66e0-4161-ac26-0325e2411c10 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:35.085691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-980939ba-a988-441b-a80a-d5718637f65e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:35.103465 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-980939ba-a988-441b-a80a-d5718637f65e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb" status: 200 len: 1317 microversion: 2.1 time: 0.472532 Oct 10 23:38:35.126133 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2226/4343] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:34 2022] GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb => generated 1317 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:35.412263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-77655e82-fb54-48e0-b533-294892cc06c4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:35.412980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-77655e82-fb54-48e0-b533-294892cc06c4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:35.424629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77655e82-fb54-48e0-b533-294892cc06c4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:35.424629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77655e82-fb54-48e0-b533-294892cc06c4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:35.427403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77655e82-fb54-48e0-b533-294892cc06c4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:35.428368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77655e82-fb54-48e0-b533-294892cc06c4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:35.429965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77655e82-fb54-48e0-b533-294892cc06c4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:35.430832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77655e82-fb54-48e0-b533-294892cc06c4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:35.579204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2eec9638-66e0-4161-ac26-0325e2411c10 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:35.593283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2eec9638-66e0-4161-ac26-0325e2411c10 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:35.595243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2eec9638-66e0-4161-ac26-0325e2411c10 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:35.596340 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2eec9638-66e0-4161-ac26-0325e2411c10 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1719 microversion: 2.20 time: 0.742562 Oct 10 23:38:35.597262 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2118/4344] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:38:34 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1719 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:38:35.601974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-38304d98-a039-4c77-a3e3-3eaa586502a4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:35.602899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-38304d98-a039-4c77-a3e3-3eaa586502a4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:35.629223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38304d98-a039-4c77-a3e3-3eaa586502a4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:35.633363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38304d98-a039-4c77-a3e3-3eaa586502a4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:35.634114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38304d98-a039-4c77-a3e3-3eaa586502a4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:35.635032 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38304d98-a039-4c77-a3e3-3eaa586502a4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:35.635883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38304d98-a039-4c77-a3e3-3eaa586502a4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:35.645042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38304d98-a039-4c77-a3e3-3eaa586502a4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:35.869117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-77655e82-fb54-48e0-b533-294892cc06c4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:35.884007 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-77655e82-fb54-48e0-b533-294892cc06c4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1522 microversion: 2.1 time: 0.474157 Oct 10 23:38:35.886062 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2227/4345] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:35 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1522 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:38:35.898117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-32d61bc3-06f1-46fc-93e9-8c06b5aed046 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:35.898770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-32d61bc3-06f1-46fc-93e9-8c06b5aed046 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 5900f1b9-105d-4c6d-8455-e772d3e5012a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:35.915334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32d61bc3-06f1-46fc-93e9-8c06b5aed046 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:35.915842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32d61bc3-06f1-46fc-93e9-8c06b5aed046 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:35.916290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32d61bc3-06f1-46fc-93e9-8c06b5aed046 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:35.917016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32d61bc3-06f1-46fc-93e9-8c06b5aed046 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:35.921024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32d61bc3-06f1-46fc-93e9-8c06b5aed046 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:35.921778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32d61bc3-06f1-46fc-93e9-8c06b5aed046 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:36.066852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-32d61bc3-06f1-46fc-93e9-8c06b5aed046 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:36.105323 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-32d61bc3-06f1-46fc-93e9-8c06b5aed046 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a" status: 200 len: 1290 microversion: 2.1 time: 0.194061 Oct 10 23:38:36.117967 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2228/4346] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:35 2022] GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a => generated 1290 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:36.147199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-debb4058-1133-4024-9846-bb71378a06fa tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:36.150866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-debb4058-1133-4024-9846-bb71378a06fa tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:36.162967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-debb4058-1133-4024-9846-bb71378a06fa tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:36.164627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-debb4058-1133-4024-9846-bb71378a06fa tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:36.164999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-debb4058-1133-4024-9846-bb71378a06fa tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:36.165957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-debb4058-1133-4024-9846-bb71378a06fa tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:36.166705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-debb4058-1133-4024-9846-bb71378a06fa tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:36.169973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-debb4058-1133-4024-9846-bb71378a06fa tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:36.200803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-38304d98-a039-4c77-a3e3-3eaa586502a4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:36.211356 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-38304d98-a039-4c77-a3e3-3eaa586502a4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1524 microversion: 2.1 time: 0.612775 Oct 10 23:38:36.216105 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2119/4347] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:35 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1524 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:36.438737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-debb4058-1133-4024-9846-bb71378a06fa tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:36.451716 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-debb4058-1133-4024-9846-bb71378a06fa tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb" status: 200 len: 1317 microversion: 2.1 time: 0.317811 Oct 10 23:38:36.455396 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2229/4348] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:36 2022] GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:36.912719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9ea63e14-bbbf-49f2-9cce-a08a54f28c70 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:36.913218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9ea63e14-bbbf-49f2-9cce-a08a54f28c70 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:36.933019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ea63e14-bbbf-49f2-9cce-a08a54f28c70 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:36.933721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ea63e14-bbbf-49f2-9cce-a08a54f28c70 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:36.936113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ea63e14-bbbf-49f2-9cce-a08a54f28c70 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:36.937667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ea63e14-bbbf-49f2-9cce-a08a54f28c70 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:36.938337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ea63e14-bbbf-49f2-9cce-a08a54f28c70 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:36.938932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9ea63e14-bbbf-49f2-9cce-a08a54f28c70 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:37.136418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-afe9a85a-67f1-4524-b01e-46c8241be4d2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:37.137858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-afe9a85a-67f1-4524-b01e-46c8241be4d2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 5900f1b9-105d-4c6d-8455-e772d3e5012a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:37.177495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-afe9a85a-67f1-4524-b01e-46c8241be4d2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:37.177731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-afe9a85a-67f1-4524-b01e-46c8241be4d2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:37.178163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-afe9a85a-67f1-4524-b01e-46c8241be4d2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:37.178934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-afe9a85a-67f1-4524-b01e-46c8241be4d2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:37.179421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-afe9a85a-67f1-4524-b01e-46c8241be4d2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:37.179882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-afe9a85a-67f1-4524-b01e-46c8241be4d2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:37.386144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9ea63e14-bbbf-49f2-9cce-a08a54f28c70 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:37.408570 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9ea63e14-bbbf-49f2-9cce-a08a54f28c70 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1522 microversion: 2.1 time: 0.493806 Oct 10 23:38:37.409909 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2120/4349] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:36 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1522 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:37.416054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-66029c98-8f63-4de4-8a3a-06046ce9cd8a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:37.416887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-66029c98-8f63-4de4-8a3a-06046ce9cd8a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:37.437166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66029c98-8f63-4de4-8a3a-06046ce9cd8a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:37.438571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66029c98-8f63-4de4-8a3a-06046ce9cd8a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:37.442131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66029c98-8f63-4de4-8a3a-06046ce9cd8a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:37.443043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66029c98-8f63-4de4-8a3a-06046ce9cd8a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:37.446908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66029c98-8f63-4de4-8a3a-06046ce9cd8a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:37.449499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66029c98-8f63-4de4-8a3a-06046ce9cd8a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:37.456762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-afe9a85a-67f1-4524-b01e-46c8241be4d2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:37.483966 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-afe9a85a-67f1-4524-b01e-46c8241be4d2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a" status: 200 len: 1278 microversion: 2.1 time: 0.354416 Oct 10 23:38:37.485407 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2230/4350] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:37 2022] GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a => generated 1278 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:37.493172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-75d6bc6e-80d2-475d-ba66-8fc534aa02a4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:37.494063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-75d6bc6e-80d2-475d-ba66-8fc534aa02a4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:37.504637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75d6bc6e-80d2-475d-ba66-8fc534aa02a4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:37.505423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75d6bc6e-80d2-475d-ba66-8fc534aa02a4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:37.506686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75d6bc6e-80d2-475d-ba66-8fc534aa02a4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:37.507612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75d6bc6e-80d2-475d-ba66-8fc534aa02a4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:37.508421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75d6bc6e-80d2-475d-ba66-8fc534aa02a4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:37.509158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75d6bc6e-80d2-475d-ba66-8fc534aa02a4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:37.843466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-66029c98-8f63-4de4-8a3a-06046ce9cd8a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:37.859122 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-66029c98-8f63-4de4-8a3a-06046ce9cd8a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1524 microversion: 2.1 time: 0.444858 Oct 10 23:38:37.861987 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2121/4351] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:37 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1524 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:37.891625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-75d6bc6e-80d2-475d-ba66-8fc534aa02a4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:37.907041 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-75d6bc6e-80d2-475d-ba66-8fc534aa02a4 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb" status: 200 len: 1317 microversion: 2.1 time: 0.419922 Oct 10 23:38:37.908510 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2231/4352] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:37 2022] GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb => generated 1317 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:38.435500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b94b0b59-9824-4632-be49-91eda09ef372 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:38.436924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b94b0b59-9824-4632-be49-91eda09ef372 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:38.458815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b94b0b59-9824-4632-be49-91eda09ef372 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:38.463982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b94b0b59-9824-4632-be49-91eda09ef372 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:38.467809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b94b0b59-9824-4632-be49-91eda09ef372 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:38.468834 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b94b0b59-9824-4632-be49-91eda09ef372 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:38.469701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b94b0b59-9824-4632-be49-91eda09ef372 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:38.471514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b94b0b59-9824-4632-be49-91eda09ef372 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:38.514581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c8a16102-aea8-4965-bf1c-7f652ea24e28 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:38.518163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c8a16102-aea8-4965-bf1c-7f652ea24e28 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 5900f1b9-105d-4c6d-8455-e772d3e5012a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:38.538297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8a16102-aea8-4965-bf1c-7f652ea24e28 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:38.540468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8a16102-aea8-4965-bf1c-7f652ea24e28 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:38.542798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8a16102-aea8-4965-bf1c-7f652ea24e28 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:38.571031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8a16102-aea8-4965-bf1c-7f652ea24e28 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:38.573690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8a16102-aea8-4965-bf1c-7f652ea24e28 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:38.582589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8a16102-aea8-4965-bf1c-7f652ea24e28 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:38.768061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b94b0b59-9824-4632-be49-91eda09ef372 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:38.776841 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b94b0b59-9824-4632-be49-91eda09ef372 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1522 microversion: 2.1 time: 0.345814 Oct 10 23:38:38.793402 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2122/4353] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:38 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:38.808810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-675499e4-f9d2-497f-965d-90a154af85cc req-c80d1318-c13d-474e-90f9-362d175276a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fd7d94f-f58e-4be5-8e0f-11e9f12fb93f", "tag": "367c2fce-8d92-43a8-9e5b-e46dabbe97cb"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:38.855063 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-675499e4-f9d2-497f-965d-90a154af85cc req-c80d1318-c13d-474e-90f9-362d175276a5 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:38.855554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-675499e4-f9d2-497f-965d-90a154af85cc req-c80d1318-c13d-474e-90f9-362d175276a5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:38.855993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-675499e4-f9d2-497f-965d-90a154af85cc req-c80d1318-c13d-474e-90f9-362d175276a5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:38.879773 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-675499e4-f9d2-497f-965d-90a154af85cc req-c80d1318-c13d-474e-90f9-362d175276a5 service nova] Creating event network-changed:367c2fce-8d92-43a8-9e5b-e46dabbe97cb for instance 8fd7d94f-f58e-4be5-8e0f-11e9f12fb93f on n-h2-860864-2 Oct 10 23:38:38.893826 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-675499e4-f9d2-497f-965d-90a154af85cc req-c80d1318-c13d-474e-90f9-362d175276a5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103109 Oct 10 23:38:38.896729 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2123/4354] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:38.907192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a8e01a8c-56d0-447c-98da-d446adf6beab tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:38.917254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a8e01a8c-56d0-447c-98da-d446adf6beab tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:38.932465 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e01a8c-56d0-447c-98da-d446adf6beab tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:38.933551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e01a8c-56d0-447c-98da-d446adf6beab tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:38.934194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e01a8c-56d0-447c-98da-d446adf6beab tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:38.935097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e01a8c-56d0-447c-98da-d446adf6beab tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:38.935716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e01a8c-56d0-447c-98da-d446adf6beab tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:38.937025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e01a8c-56d0-447c-98da-d446adf6beab tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:38.955446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:39.010609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c8a16102-aea8-4965-bf1c-7f652ea24e28 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:39.030425 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c8a16102-aea8-4965-bf1c-7f652ea24e28 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a" status: 200 len: 1320 microversion: 2.1 time: 0.520542 Oct 10 23:38:39.034856 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2232/4355] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:38 2022] GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a => generated 1320 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:39.059594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fcbf6dd8-d889-41a1-b85b-8eb1b8b48777 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:39.065481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fcbf6dd8-d889-41a1-b85b-8eb1b8b48777 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:39.092055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fcbf6dd8-d889-41a1-b85b-8eb1b8b48777 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:39.092564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fcbf6dd8-d889-41a1-b85b-8eb1b8b48777 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:39.095629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fcbf6dd8-d889-41a1-b85b-8eb1b8b48777 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:39.098671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fcbf6dd8-d889-41a1-b85b-8eb1b8b48777 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:39.099375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fcbf6dd8-d889-41a1-b85b-8eb1b8b48777 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:39.100047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fcbf6dd8-d889-41a1-b85b-8eb1b8b48777 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:39.241568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a8e01a8c-56d0-447c-98da-d446adf6beab tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:39.252211 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a8e01a8c-56d0-447c-98da-d446adf6beab tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1524 microversion: 2.1 time: 0.351679 Oct 10 23:38:39.255806 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2124/4356] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:38 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1524 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:39.457645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fcbf6dd8-d889-41a1-b85b-8eb1b8b48777 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:39.467374 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fcbf6dd8-d889-41a1-b85b-8eb1b8b48777 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb" status: 200 len: 1317 microversion: 2.1 time: 0.431029 Oct 10 23:38:39.486137 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2233/4357] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:39 2022] GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:39.806584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d3942437-783a-4770-a815-c7df0d45b2d6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:39.807268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-bdcf06be-56b5-4d70-ba4a-4b0cec9f8861 req-91b2dd1b-41a2-4752-9f7b-ccc211059e7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5900f1b9-105d-4c6d-8455-e772d3e5012a", "tag": "35b58dd8-e33e-441c-91a5-9a30ecdb7ef5"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:39.807658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d3942437-783a-4770-a815-c7df0d45b2d6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:39.815746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3942437-783a-4770-a815-c7df0d45b2d6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:39.819545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3942437-783a-4770-a815-c7df0d45b2d6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:39.820793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3942437-783a-4770-a815-c7df0d45b2d6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:39.827596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3942437-783a-4770-a815-c7df0d45b2d6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:39.829188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3942437-783a-4770-a815-c7df0d45b2d6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:39.830267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3942437-783a-4770-a815-c7df0d45b2d6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:39.842037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-bdcf06be-56b5-4d70-ba4a-4b0cec9f8861 req-91b2dd1b-41a2-4752-9f7b-ccc211059e7d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:39.842524 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-bdcf06be-56b5-4d70-ba4a-4b0cec9f8861 req-91b2dd1b-41a2-4752-9f7b-ccc211059e7d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:39.847230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-bdcf06be-56b5-4d70-ba4a-4b0cec9f8861 req-91b2dd1b-41a2-4752-9f7b-ccc211059e7d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:39.864967 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-bdcf06be-56b5-4d70-ba4a-4b0cec9f8861 req-91b2dd1b-41a2-4752-9f7b-ccc211059e7d service nova] Creating event network-changed:35b58dd8-e33e-441c-91a5-9a30ecdb7ef5 for instance 5900f1b9-105d-4c6d-8455-e772d3e5012a on n-h2-860864-2 Oct 10 23:38:39.871179 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-bdcf06be-56b5-4d70-ba4a-4b0cec9f8861 req-91b2dd1b-41a2-4752-9f7b-ccc211059e7d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071549 Oct 10 23:38:39.872044 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2125/4358] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:39.991915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d3942437-783a-4770-a815-c7df0d45b2d6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:39.996816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:40.004784 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d3942437-783a-4770-a815-c7df0d45b2d6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1522 microversion: 2.1 time: 0.201610 Oct 10 23:38:40.006268 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2234/4359] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:39 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:38:40.057349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-786b8300-3762-499f-be48-653ab1241154 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:40.058059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-786b8300-3762-499f-be48-653ab1241154 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 5900f1b9-105d-4c6d-8455-e772d3e5012a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:40.065171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-786b8300-3762-499f-be48-653ab1241154 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:40.066030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-786b8300-3762-499f-be48-653ab1241154 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:40.066465 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-786b8300-3762-499f-be48-653ab1241154 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:40.067388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-786b8300-3762-499f-be48-653ab1241154 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:40.068002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-786b8300-3762-499f-be48-653ab1241154 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:40.068586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-786b8300-3762-499f-be48-653ab1241154 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:40.225120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-85c30eae-6ac6-404e-8046-a0d289b07a4d req-f510e9e2-9791-4c89-8d29-2119775e292c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb", "name": "network-vif-plugged", "status": "completed", "tag": "c8a3b1ab-895f-48f5-bcc5-2bf399bb9df5"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:40.244996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-85c30eae-6ac6-404e-8046-a0d289b07a4d req-f510e9e2-9791-4c89-8d29-2119775e292c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:40.245905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-85c30eae-6ac6-404e-8046-a0d289b07a4d req-f510e9e2-9791-4c89-8d29-2119775e292c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:40.246500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-85c30eae-6ac6-404e-8046-a0d289b07a4d req-f510e9e2-9791-4c89-8d29-2119775e292c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:40.260626 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-85c30eae-6ac6-404e-8046-a0d289b07a4d req-f510e9e2-9791-4c89-8d29-2119775e292c service nova] Creating event network-vif-plugged:c8a3b1ab-895f-48f5-bcc5-2bf399bb9df5 for instance fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb on n-h2-860864-2 Oct 10 23:38:40.271509 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-85c30eae-6ac6-404e-8046-a0d289b07a4d req-f510e9e2-9791-4c89-8d29-2119775e292c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049737 Oct 10 23:38:40.272422 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2235/4360] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:40.281583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a38d5890-7730-4b4a-99c8-6439f46c0fe6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:40.283076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a38d5890-7730-4b4a-99c8-6439f46c0fe6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:40.290745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a38d5890-7730-4b4a-99c8-6439f46c0fe6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:40.291431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a38d5890-7730-4b4a-99c8-6439f46c0fe6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:40.292041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a38d5890-7730-4b4a-99c8-6439f46c0fe6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:40.292892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a38d5890-7730-4b4a-99c8-6439f46c0fe6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:40.293521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a38d5890-7730-4b4a-99c8-6439f46c0fe6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:40.294096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a38d5890-7730-4b4a-99c8-6439f46c0fe6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:40.354550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-786b8300-3762-499f-be48-653ab1241154 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:40.365150 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-786b8300-3762-499f-be48-653ab1241154 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a" status: 200 len: 1320 microversion: 2.1 time: 0.312533 Oct 10 23:38:40.366393 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2126/4361] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:40 2022] GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a => generated 1320 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:40.448454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a38d5890-7730-4b4a-99c8-6439f46c0fe6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:40.458175 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a38d5890-7730-4b4a-99c8-6439f46c0fe6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1524 microversion: 2.1 time: 0.182152 Oct 10 23:38:40.459032 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2236/4362] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:40 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1524 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:38:40.492163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eedae37f-ae8d-4958-a90d-c4e520623b15 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:40.492771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eedae37f-ae8d-4958-a90d-c4e520623b15 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:40.502060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eedae37f-ae8d-4958-a90d-c4e520623b15 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:40.502812 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eedae37f-ae8d-4958-a90d-c4e520623b15 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:40.503440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eedae37f-ae8d-4958-a90d-c4e520623b15 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:40.504499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eedae37f-ae8d-4958-a90d-c4e520623b15 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:40.505172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eedae37f-ae8d-4958-a90d-c4e520623b15 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:40.505697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eedae37f-ae8d-4958-a90d-c4e520623b15 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:40.539552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:40.585856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=14 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:40.950394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-eedae37f-ae8d-4958-a90d-c4e520623b15 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:40.969514 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eedae37f-ae8d-4958-a90d-c4e520623b15 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb" status: 200 len: 1317 microversion: 2.1 time: 0.479404 Oct 10 23:38:40.974817 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2127/4363] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:40 2022] GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb => generated 1317 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:41.035386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-125b4748-6278-4669-93cf-97e12b5eb339 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:41.036042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-125b4748-6278-4669-93cf-97e12b5eb339 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:41.043023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:41.045533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-125b4748-6278-4669-93cf-97e12b5eb339 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:41.047425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-125b4748-6278-4669-93cf-97e12b5eb339 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:41.048205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-125b4748-6278-4669-93cf-97e12b5eb339 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:41.049494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-125b4748-6278-4669-93cf-97e12b5eb339 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:41.050046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-125b4748-6278-4669-93cf-97e12b5eb339 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:41.050708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-125b4748-6278-4669-93cf-97e12b5eb339 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:41.116597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:41.286311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-125b4748-6278-4669-93cf-97e12b5eb339 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:41.304367 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-125b4748-6278-4669-93cf-97e12b5eb339 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1522 microversion: 2.1 time: 0.274663 Oct 10 23:38:41.321556 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2237/4364] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:41 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:41.388312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a13b0bdf-c194-4c99-abff-f0eb467e36e2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:41.388927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a13b0bdf-c194-4c99-abff-f0eb467e36e2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 5900f1b9-105d-4c6d-8455-e772d3e5012a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:41.395723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a13b0bdf-c194-4c99-abff-f0eb467e36e2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:41.396218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a13b0bdf-c194-4c99-abff-f0eb467e36e2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:41.396777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a13b0bdf-c194-4c99-abff-f0eb467e36e2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:41.397775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a13b0bdf-c194-4c99-abff-f0eb467e36e2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:41.398413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a13b0bdf-c194-4c99-abff-f0eb467e36e2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:41.398857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a13b0bdf-c194-4c99-abff-f0eb467e36e2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:41.484070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b81de2bd-2a0e-40fc-b453-0a92eb28c1b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:41.485540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b81de2bd-2a0e-40fc-b453-0a92eb28c1b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:41.494004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b81de2bd-2a0e-40fc-b453-0a92eb28c1b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:41.494700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b81de2bd-2a0e-40fc-b453-0a92eb28c1b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:41.495243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b81de2bd-2a0e-40fc-b453-0a92eb28c1b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:41.496141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b81de2bd-2a0e-40fc-b453-0a92eb28c1b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:41.496946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b81de2bd-2a0e-40fc-b453-0a92eb28c1b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:41.497745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b81de2bd-2a0e-40fc-b453-0a92eb28c1b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:41.550107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a13b0bdf-c194-4c99-abff-f0eb467e36e2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:41.562355 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a13b0bdf-c194-4c99-abff-f0eb467e36e2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a" status: 200 len: 1320 microversion: 2.1 time: 0.177899 Oct 10 23:38:41.563875 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2128/4365] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:41 2022] GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a => generated 1320 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:41.624742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:41.662905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b81de2bd-2a0e-40fc-b453-0a92eb28c1b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:41.671304 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b81de2bd-2a0e-40fc-b453-0a92eb28c1b5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1524 microversion: 2.1 time: 0.191889 Oct 10 23:38:41.672351 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2238/4366] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:41 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1524 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:38:41.997757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7e6f7d12-9d90-4c17-8a92-f92b477e7486 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:41.999059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7e6f7d12-9d90-4c17-8a92-f92b477e7486 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:42.007266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e6f7d12-9d90-4c17-8a92-f92b477e7486 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:42.008262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e6f7d12-9d90-4c17-8a92-f92b477e7486 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:42.008933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e6f7d12-9d90-4c17-8a92-f92b477e7486 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:42.009911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e6f7d12-9d90-4c17-8a92-f92b477e7486 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:42.010584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e6f7d12-9d90-4c17-8a92-f92b477e7486 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:42.011227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e6f7d12-9d90-4c17-8a92-f92b477e7486 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:42.328072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4ea1b087-ee1c-4f7a-b22b-150371bd6e8a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:42.330504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4ea1b087-ee1c-4f7a-b22b-150371bd6e8a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:42.346617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ea1b087-ee1c-4f7a-b22b-150371bd6e8a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:42.347415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ea1b087-ee1c-4f7a-b22b-150371bd6e8a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:42.348044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ea1b087-ee1c-4f7a-b22b-150371bd6e8a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:42.348949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ea1b087-ee1c-4f7a-b22b-150371bd6e8a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:42.353708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ea1b087-ee1c-4f7a-b22b-150371bd6e8a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:42.354404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ea1b087-ee1c-4f7a-b22b-150371bd6e8a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:42.362051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7e6f7d12-9d90-4c17-8a92-f92b477e7486 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:42.372337 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7e6f7d12-9d90-4c17-8a92-f92b477e7486 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb" status: 200 len: 1317 microversion: 2.1 time: 0.379352 Oct 10 23:38:42.373134 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2129/4367] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:41 2022] GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:42.595004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-224ccbae-4f5b-44b8-84b8-f78da4d6b527 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:42.596748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-224ccbae-4f5b-44b8-84b8-f78da4d6b527 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 5900f1b9-105d-4c6d-8455-e772d3e5012a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:42.608523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-224ccbae-4f5b-44b8-84b8-f78da4d6b527 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:42.609555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-224ccbae-4f5b-44b8-84b8-f78da4d6b527 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:42.610454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-224ccbae-4f5b-44b8-84b8-f78da4d6b527 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:42.611499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-224ccbae-4f5b-44b8-84b8-f78da4d6b527 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:42.612243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-224ccbae-4f5b-44b8-84b8-f78da4d6b527 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:42.613508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-224ccbae-4f5b-44b8-84b8-f78da4d6b527 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:42.681470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4ea1b087-ee1c-4f7a-b22b-150371bd6e8a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:42.694879 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4ea1b087-ee1c-4f7a-b22b-150371bd6e8a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1522 microversion: 2.1 time: 0.370644 Oct 10 23:38:42.700466 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2239/4368] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:42 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:38:42.711725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e919eb45-aff1-4770-b1eb-fccd4261b7cc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:42.712667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e919eb45-aff1-4770-b1eb-fccd4261b7cc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:42.721978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e919eb45-aff1-4770-b1eb-fccd4261b7cc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:42.722811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e919eb45-aff1-4770-b1eb-fccd4261b7cc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:42.723430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e919eb45-aff1-4770-b1eb-fccd4261b7cc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:42.724289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e919eb45-aff1-4770-b1eb-fccd4261b7cc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:42.724963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e919eb45-aff1-4770-b1eb-fccd4261b7cc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:42.725751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e919eb45-aff1-4770-b1eb-fccd4261b7cc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:43.029273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e919eb45-aff1-4770-b1eb-fccd4261b7cc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:43.046251 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e919eb45-aff1-4770-b1eb-fccd4261b7cc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1524 microversion: 2.1 time: 0.342799 Oct 10 23:38:43.047767 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2240/4369] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:42 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1524 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:43.051155 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-224ccbae-4f5b-44b8-84b8-f78da4d6b527 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:43.062497 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-224ccbae-4f5b-44b8-84b8-f78da4d6b527 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a" status: 200 len: 1320 microversion: 2.1 time: 0.477422 Oct 10 23:38:43.064080 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2130/4370] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:42 2022] GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a => generated 1320 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:43.396473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3e4570bd-8e98-40ce-9677-1929e891ff8e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:43.397485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3e4570bd-8e98-40ce-9677-1929e891ff8e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:43.409483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e4570bd-8e98-40ce-9677-1929e891ff8e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:43.410215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e4570bd-8e98-40ce-9677-1929e891ff8e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:43.410835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e4570bd-8e98-40ce-9677-1929e891ff8e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:43.412238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e4570bd-8e98-40ce-9677-1929e891ff8e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:43.412852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e4570bd-8e98-40ce-9677-1929e891ff8e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:43.413473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e4570bd-8e98-40ce-9677-1929e891ff8e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:43.569357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3e4570bd-8e98-40ce-9677-1929e891ff8e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:43.581278 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3e4570bd-8e98-40ce-9677-1929e891ff8e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb" status: 200 len: 1506 microversion: 2.1 time: 0.189065 Oct 10 23:38:43.582599 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2241/4371] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:43 2022] GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:43.725935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2efe7916-55f0-46a8-bb9e-7d764c0cb085 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:43.726968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2efe7916-55f0-46a8-bb9e-7d764c0cb085 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:43.742272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2efe7916-55f0-46a8-bb9e-7d764c0cb085 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:43.745483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2efe7916-55f0-46a8-bb9e-7d764c0cb085 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:43.746300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2efe7916-55f0-46a8-bb9e-7d764c0cb085 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:43.749954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2efe7916-55f0-46a8-bb9e-7d764c0cb085 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:43.750993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2efe7916-55f0-46a8-bb9e-7d764c0cb085 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:43.752805 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2efe7916-55f0-46a8-bb9e-7d764c0cb085 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:44.035171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2efe7916-55f0-46a8-bb9e-7d764c0cb085 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:44.044702 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2efe7916-55f0-46a8-bb9e-7d764c0cb085 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1522 microversion: 2.1 time: 0.324398 Oct 10 23:38:44.045873 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2131/4372] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:43 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:44.076979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1e668905-9217-4dba-8e1e-c607f3051ea3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:44.077790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1e668905-9217-4dba-8e1e-c607f3051ea3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:44.091136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c8238044-476b-4a12-bca7-790f65382768 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:44.091753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c8238044-476b-4a12-bca7-790f65382768 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 5900f1b9-105d-4c6d-8455-e772d3e5012a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:44.107730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e668905-9217-4dba-8e1e-c607f3051ea3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:44.108443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e668905-9217-4dba-8e1e-c607f3051ea3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:44.110229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e668905-9217-4dba-8e1e-c607f3051ea3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:44.112230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8238044-476b-4a12-bca7-790f65382768 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:44.113460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e668905-9217-4dba-8e1e-c607f3051ea3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:44.114193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e668905-9217-4dba-8e1e-c607f3051ea3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:44.115475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8238044-476b-4a12-bca7-790f65382768 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:44.116157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e668905-9217-4dba-8e1e-c607f3051ea3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:44.116887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8238044-476b-4a12-bca7-790f65382768 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:44.119156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8238044-476b-4a12-bca7-790f65382768 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:44.119690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8238044-476b-4a12-bca7-790f65382768 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:44.120703 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8238044-476b-4a12-bca7-790f65382768 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:44.300097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1e668905-9217-4dba-8e1e-c607f3051ea3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:44.309170 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1e668905-9217-4dba-8e1e-c607f3051ea3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1524 microversion: 2.1 time: 0.237908 Oct 10 23:38:44.310144 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2242/4373] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:44 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1524 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:44.450595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c8238044-476b-4a12-bca7-790f65382768 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:44.470859 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c8238044-476b-4a12-bca7-790f65382768 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a" status: 200 len: 1320 microversion: 2.1 time: 0.380517 Oct 10 23:38:44.471491 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2132/4374] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:44 2022] GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a => generated 1320 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:38:45.080667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e0e5b143-f8e1-4afb-9b3a-710ca1a2562e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:45.082667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e0e5b143-f8e1-4afb-9b3a-710ca1a2562e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:45.091643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0e5b143-f8e1-4afb-9b3a-710ca1a2562e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:45.092396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0e5b143-f8e1-4afb-9b3a-710ca1a2562e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:45.093816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0e5b143-f8e1-4afb-9b3a-710ca1a2562e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:45.094871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0e5b143-f8e1-4afb-9b3a-710ca1a2562e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:45.095688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0e5b143-f8e1-4afb-9b3a-710ca1a2562e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:45.097462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0e5b143-f8e1-4afb-9b3a-710ca1a2562e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:45.296035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e0e5b143-f8e1-4afb-9b3a-710ca1a2562e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:45.308477 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e0e5b143-f8e1-4afb-9b3a-710ca1a2562e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1522 microversion: 2.1 time: 0.231913 Oct 10 23:38:45.327265 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2243/4375] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:45 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:45.333596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-394f4727-121d-4e2b-9c8c-54cd08abaed8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:45.334304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-394f4727-121d-4e2b-9c8c-54cd08abaed8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:45.342034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-394f4727-121d-4e2b-9c8c-54cd08abaed8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:45.342617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-394f4727-121d-4e2b-9c8c-54cd08abaed8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:45.343129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-394f4727-121d-4e2b-9c8c-54cd08abaed8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:45.344526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-394f4727-121d-4e2b-9c8c-54cd08abaed8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:45.344983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-394f4727-121d-4e2b-9c8c-54cd08abaed8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:45.345511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-394f4727-121d-4e2b-9c8c-54cd08abaed8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:45.494614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bdf79ddd-5cd2-46f4-8121-644075fe4019 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:45.495239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bdf79ddd-5cd2-46f4-8121-644075fe4019 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 5900f1b9-105d-4c6d-8455-e772d3e5012a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:45.502597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdf79ddd-5cd2-46f4-8121-644075fe4019 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:45.503058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdf79ddd-5cd2-46f4-8121-644075fe4019 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:45.503514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdf79ddd-5cd2-46f4-8121-644075fe4019 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:45.504225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdf79ddd-5cd2-46f4-8121-644075fe4019 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:45.504694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdf79ddd-5cd2-46f4-8121-644075fe4019 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:45.505118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdf79ddd-5cd2-46f4-8121-644075fe4019 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:45.576964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-394f4727-121d-4e2b-9c8c-54cd08abaed8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:45.588451 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-394f4727-121d-4e2b-9c8c-54cd08abaed8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1524 microversion: 2.1 time: 0.258580 Oct 10 23:38:45.589746 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2133/4376] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:45 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1524 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:45.685454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bdf79ddd-5cd2-46f4-8121-644075fe4019 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:45.709996 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bdf79ddd-5cd2-46f4-8121-644075fe4019 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a" status: 200 len: 1320 microversion: 2.1 time: 0.216051 Oct 10 23:38:45.709996 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2244/4377] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:45 2022] GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a => generated 1320 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:46.180803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b1023977-128e-478d-820e-0c3fa3e0cd18 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "3ce17c6c-c646-4459-b326-49b4516dc830"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:46.184065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b1023977-128e-478d-820e-0c3fa3e0cd18 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] [instance: fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:46.201118 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1023977-128e-478d-820e-0c3fa3e0cd18 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:46.201650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1023977-128e-478d-820e-0c3fa3e0cd18 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:46.202096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1023977-128e-478d-820e-0c3fa3e0cd18 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:46.202811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1023977-128e-478d-820e-0c3fa3e0cd18 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:46.203861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1023977-128e-478d-820e-0c3fa3e0cd18 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:46.204297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1023977-128e-478d-820e-0c3fa3e0cd18 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:46.279062 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-b1023977-128e-478d-820e-0c3fa3e0cd18 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] HTTP exception thrown: Volume 78ac4038-2fee-453d-9c57-c32f63ad4f42 could not be found. Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b1023977-128e-478d-820e-0c3fa3e0cd18 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] Request method failure captured: Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: request: PUT /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb/os-volume_attachments/78ac4038-2fee-453d-9c57-c32f63ad4f42 HTTP/1.1 Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 74 Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKxP5LL8K_5KsNe2a_9XZSSWfLGI4XXMrYH9uzIY5rX7Z8OzrhFlFlwQvDCccm3-mUC09J5tJ0WK7-AGTbtKKrLjXILScJcDY5KI-u2APetiQxyxwKK7kEU2oZ_Lr0XCf6kjQWHInv_MHyViKU6wbrZTMP6z8vHHkCLWrKwGljMrkoE Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 1150cb5f48034e19b468c02104a64565 Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-VolumesAdminNegativeTest-732847487 Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: X-Role: admin,member,reader Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: admin,member,reader Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1150cb5f48034e19b468c02104a64565"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1150cb5f48034e19b468c02104a64565"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1150cb5f48034e19b468c02104a64565"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1150cb5f48034e19b468c02104a64565", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-VolumesAdminNegativeTest-732847487 Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 1150cb5f48034e19b468c02104a64565 Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-732847487 Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-VolumesAdminNegativeTest-732847487-project-admin Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 5c484d9e964b4bcfbc84faeb0a443647 Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-VolumesAdminNegativeTest-732847487-project-admin Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: {"volumeAttachment": {"volumeId": "3ce17c6c-c646-4459-b326-49b4516dc830"}} Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: exception: Volume 78ac4038-2fee-453d-9c57-c32f63ad4f42 could not be found. Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'server_id': 'fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb', 'id': '78ac4038-2fee-453d-9c57-c32f63ad4f42', 'body': {'volumeAttachment': {'volumeId': '3ce17c6c-c646-4459-b326-49b4516dc830'}}} Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 78ac4038-2fee-453d-9c57-c32f63ad4f42 could not be found. (HTTP 404) (Request-ID: req-dc81877e-7060-49d6-8421-5d21a23756ca) Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 23:38:46.281819 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 78ac4038-2fee-453d-9c57-c32f63ad4f42 could not be found. Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 78ac4038-2fee-453d-9c57-c32f63ad4f42 could not be found. Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 78ac4038-2fee-453d-9c57-c32f63ad4f42 could not be found. Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b1023977-128e-478d-820e-0c3fa3e0cd18 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] Returning 404 to user: Volume 78ac4038-2fee-453d-9c57-c32f63ad4f42 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b1023977-128e-478d-820e-0c3fa3e0cd18 tempest-VolumesAdminNegativeTest-732847487 tempest-VolumesAdminNegativeTest-732847487-project-admin] 10.222.0.23 "PUT /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb/os-volume_attachments/78ac4038-2fee-453d-9c57-c32f63ad4f42" status: 404 len: 109 microversion: 2.1 time: 0.107408 Oct 10 23:38:46.291075 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2134/4378] 10.222.0.23 () {60 vars in 1433 bytes} [Mon Oct 10 23:38:46 2022] PUT /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb/os-volume_attachments/78ac4038-2fee-453d-9c57-c32f63ad4f42 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:38:46.335625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-442c5e13-1dda-4945-a4e2-e3af6e33e5a4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:46.336287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-442c5e13-1dda-4945-a4e2-e3af6e33e5a4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:46.349353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-442c5e13-1dda-4945-a4e2-e3af6e33e5a4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:46.350721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-442c5e13-1dda-4945-a4e2-e3af6e33e5a4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:46.351385 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-442c5e13-1dda-4945-a4e2-e3af6e33e5a4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:46.356853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-442c5e13-1dda-4945-a4e2-e3af6e33e5a4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:46.357549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-442c5e13-1dda-4945-a4e2-e3af6e33e5a4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:46.358216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-442c5e13-1dda-4945-a4e2-e3af6e33e5a4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:46.423790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-99c4df9b-6346-4706-a941-4ef2ae1750eb req-aee5597c-9765-4227-9346-36f467f03e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fd7d94f-f58e-4be5-8e0f-11e9f12fb93f", "name": "network-vif-plugged", "status": "completed", "tag": "367c2fce-8d92-43a8-9e5b-e46dabbe97cb"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:46.466885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-99c4df9b-6346-4706-a941-4ef2ae1750eb req-aee5597c-9765-4227-9346-36f467f03e89 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:46.468164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-99c4df9b-6346-4706-a941-4ef2ae1750eb req-aee5597c-9765-4227-9346-36f467f03e89 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:46.469104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-99c4df9b-6346-4706-a941-4ef2ae1750eb req-aee5597c-9765-4227-9346-36f467f03e89 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:46.483688 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-99c4df9b-6346-4706-a941-4ef2ae1750eb req-aee5597c-9765-4227-9346-36f467f03e89 service nova] Creating event network-vif-plugged:367c2fce-8d92-43a8-9e5b-e46dabbe97cb for instance 8fd7d94f-f58e-4be5-8e0f-11e9f12fb93f on n-h2-860864-2 Oct 10 23:38:46.492532 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-99c4df9b-6346-4706-a941-4ef2ae1750eb req-aee5597c-9765-4227-9346-36f467f03e89 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073450 Oct 10 23:38:46.493800 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2135/4379] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:46.584209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-442c5e13-1dda-4945-a4e2-e3af6e33e5a4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:46.594780 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-442c5e13-1dda-4945-a4e2-e3af6e33e5a4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1522 microversion: 2.1 time: 0.262273 Oct 10 23:38:46.596064 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2245/4380] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:46 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:46.623402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-06c36837-6fcf-412e-8cd1-f19bc527aff8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:46.624405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-06c36837-6fcf-412e-8cd1-f19bc527aff8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:46.635565 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06c36837-6fcf-412e-8cd1-f19bc527aff8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:46.640313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06c36837-6fcf-412e-8cd1-f19bc527aff8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:46.641593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06c36837-6fcf-412e-8cd1-f19bc527aff8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:46.642715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06c36837-6fcf-412e-8cd1-f19bc527aff8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:46.643592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06c36837-6fcf-412e-8cd1-f19bc527aff8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:46.647823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06c36837-6fcf-412e-8cd1-f19bc527aff8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:46.733430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fb15d002-08a5-4275-b356-343a2eeec41a tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:46.734487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fb15d002-08a5-4275-b356-343a2eeec41a tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 5900f1b9-105d-4c6d-8455-e772d3e5012a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:46.742861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb15d002-08a5-4275-b356-343a2eeec41a tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:46.743699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb15d002-08a5-4275-b356-343a2eeec41a tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:46.744822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb15d002-08a5-4275-b356-343a2eeec41a tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:46.746240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb15d002-08a5-4275-b356-343a2eeec41a tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:46.746937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb15d002-08a5-4275-b356-343a2eeec41a tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:46.747637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb15d002-08a5-4275-b356-343a2eeec41a tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:46.827604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-06c36837-6fcf-412e-8cd1-f19bc527aff8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:46.837406 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-06c36837-6fcf-412e-8cd1-f19bc527aff8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1506 microversion: 2.1 time: 0.218536 Oct 10 23:38:46.850399 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2136/4381] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:46 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1506 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:46.919725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fb15d002-08a5-4275-b356-343a2eeec41a tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:46.931056 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fb15d002-08a5-4275-b356-343a2eeec41a tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a" status: 200 len: 1320 microversion: 2.1 time: 0.201547 Oct 10 23:38:46.945614 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2246/4382] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:46 2022] GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a => generated 1320 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:38:47.619521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-41bde210-c87f-44d5-824f-ae1369123279 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:47.620142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-41bde210-c87f-44d5-824f-ae1369123279 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:47.628192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41bde210-c87f-44d5-824f-ae1369123279 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:47.628697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41bde210-c87f-44d5-824f-ae1369123279 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:47.629144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41bde210-c87f-44d5-824f-ae1369123279 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:47.629898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41bde210-c87f-44d5-824f-ae1369123279 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:47.630360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41bde210-c87f-44d5-824f-ae1369123279 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:47.631541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41bde210-c87f-44d5-824f-ae1369123279 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:47.786000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-41bde210-c87f-44d5-824f-ae1369123279 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:47.800141 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-41bde210-c87f-44d5-824f-ae1369123279 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1522 microversion: 2.1 time: 0.184752 Oct 10 23:38:47.800852 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2137/4383] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:47 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:47.865020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-540d4e9d-81e0-4536-96fa-8d0b3fab6d24 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:47.865687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-540d4e9d-81e0-4536-96fa-8d0b3fab6d24 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:47.873931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-540d4e9d-81e0-4536-96fa-8d0b3fab6d24 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:47.874683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-540d4e9d-81e0-4536-96fa-8d0b3fab6d24 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:47.875575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-540d4e9d-81e0-4536-96fa-8d0b3fab6d24 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:47.876683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-540d4e9d-81e0-4536-96fa-8d0b3fab6d24 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:47.877341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-540d4e9d-81e0-4536-96fa-8d0b3fab6d24 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:47.877989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-540d4e9d-81e0-4536-96fa-8d0b3fab6d24 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:47.963408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bf37620d-9c2f-4fad-99d4-7939c96a5c44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:47.964040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bf37620d-9c2f-4fad-99d4-7939c96a5c44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 5900f1b9-105d-4c6d-8455-e772d3e5012a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:47.988144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf37620d-9c2f-4fad-99d4-7939c96a5c44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:47.990110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf37620d-9c2f-4fad-99d4-7939c96a5c44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:47.995349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf37620d-9c2f-4fad-99d4-7939c96a5c44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:47.996482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf37620d-9c2f-4fad-99d4-7939c96a5c44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:47.997996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf37620d-9c2f-4fad-99d4-7939c96a5c44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:48.003172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf37620d-9c2f-4fad-99d4-7939c96a5c44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:48.123623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-540d4e9d-81e0-4536-96fa-8d0b3fab6d24 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:48.132759 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-540d4e9d-81e0-4536-96fa-8d0b3fab6d24 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1506 microversion: 2.1 time: 0.271921 Oct 10 23:38:48.145789 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2247/4384] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:47 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:48.275490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bf37620d-9c2f-4fad-99d4-7939c96a5c44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:48.299980 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bf37620d-9c2f-4fad-99d4-7939c96a5c44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a" status: 200 len: 1320 microversion: 2.1 time: 0.347254 Oct 10 23:38:48.314678 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2138/4385] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:47 2022] GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a => generated 1320 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:38:48.562883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-ce32ccac-34ef-45b4-8727-80acfbceb7f1 req-91e4b636-244b-4267-9e4e-8ff867387296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "961f5a5b-1142-497e-8b88-b16f193e66e4", "name": "network-vif-unplugged", "status": "completed", "tag": "20d071d9-a8db-44d0-a2e2-ac7754ed4e80"}, {"server_uuid": "5900f1b9-105d-4c6d-8455-e772d3e5012a", "name": "network-vif-plugged", "status": "completed", "tag": "35b58dd8-e33e-441c-91a5-9a30ecdb7ef5"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:48.598914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ce32ccac-34ef-45b4-8727-80acfbceb7f1 req-91e4b636-244b-4267-9e4e-8ff867387296 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:48.599414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ce32ccac-34ef-45b4-8727-80acfbceb7f1 req-91e4b636-244b-4267-9e4e-8ff867387296 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:48.599903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ce32ccac-34ef-45b4-8727-80acfbceb7f1 req-91e4b636-244b-4267-9e4e-8ff867387296 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:48.632675 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-ce32ccac-34ef-45b4-8727-80acfbceb7f1 req-91e4b636-244b-4267-9e4e-8ff867387296 service nova] Creating event network-vif-unplugged:20d071d9-a8db-44d0-a2e2-ac7754ed4e80 for instance 961f5a5b-1142-497e-8b88-b16f193e66e4 on n-h1-860864-2 Oct 10 23:38:48.633506 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-ce32ccac-34ef-45b4-8727-80acfbceb7f1 req-91e4b636-244b-4267-9e4e-8ff867387296 service nova] Creating event network-vif-plugged:35b58dd8-e33e-441c-91a5-9a30ecdb7ef5 for instance 5900f1b9-105d-4c6d-8455-e772d3e5012a on n-h2-860864-2 Oct 10 23:38:48.652588 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-ce32ccac-34ef-45b4-8727-80acfbceb7f1 req-91e4b636-244b-4267-9e4e-8ff867387296 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.093157 Oct 10 23:38:48.659105 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2248/4386] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:48.824613 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-86ac6c33-eb49-4d0e-8ec2-5701305affbb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:48.825837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-86ac6c33-eb49-4d0e-8ec2-5701305affbb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:48.834138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86ac6c33-eb49-4d0e-8ec2-5701305affbb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:48.834872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86ac6c33-eb49-4d0e-8ec2-5701305affbb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:48.835496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86ac6c33-eb49-4d0e-8ec2-5701305affbb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:48.836377 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86ac6c33-eb49-4d0e-8ec2-5701305affbb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:48.836986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86ac6c33-eb49-4d0e-8ec2-5701305affbb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:48.838182 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86ac6c33-eb49-4d0e-8ec2-5701305affbb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:48.986502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-86ac6c33-eb49-4d0e-8ec2-5701305affbb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:48.994470 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-86ac6c33-eb49-4d0e-8ec2-5701305affbb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1522 microversion: 2.1 time: 0.173790 Oct 10 23:38:48.995042 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2139/4387] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:48 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:49.161766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b1680e93-9128-496e-9e51-61f947175cf1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:49.162587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b1680e93-9128-496e-9e51-61f947175cf1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:49.169092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1680e93-9128-496e-9e51-61f947175cf1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:49.169617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1680e93-9128-496e-9e51-61f947175cf1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:49.170058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1680e93-9128-496e-9e51-61f947175cf1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:49.170823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1680e93-9128-496e-9e51-61f947175cf1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:49.171254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1680e93-9128-496e-9e51-61f947175cf1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:49.171717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1680e93-9128-496e-9e51-61f947175cf1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:49.322687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b1680e93-9128-496e-9e51-61f947175cf1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:49.335324 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b1680e93-9128-496e-9e51-61f947175cf1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 200 len: 1509 microversion: 2.1 time: 0.179272 Oct 10 23:38:49.336638 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2249/4388] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:49 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 1509 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:49.336791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-79deef69-1248-49e0-82aa-508f807c032b tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:49.337632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-79deef69-1248-49e0-82aa-508f807c032b tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 5900f1b9-105d-4c6d-8455-e772d3e5012a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:49.344696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79deef69-1248-49e0-82aa-508f807c032b tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:49.345217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79deef69-1248-49e0-82aa-508f807c032b tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:49.345739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79deef69-1248-49e0-82aa-508f807c032b tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:49.346415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79deef69-1248-49e0-82aa-508f807c032b tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:49.347055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79deef69-1248-49e0-82aa-508f807c032b tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:49.347482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79deef69-1248-49e0-82aa-508f807c032b tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:49.360325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2a4a3d52-d42c-4e30-a27e-a20f21163942 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:49.360830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2a4a3d52-d42c-4e30-a27e-a20f21163942 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:49.367256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a4a3d52-d42c-4e30-a27e-a20f21163942 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:49.367728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a4a3d52-d42c-4e30-a27e-a20f21163942 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:49.368158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a4a3d52-d42c-4e30-a27e-a20f21163942 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:49.369052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a4a3d52-d42c-4e30-a27e-a20f21163942 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:49.369701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a4a3d52-d42c-4e30-a27e-a20f21163942 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:49.370156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a4a3d52-d42c-4e30-a27e-a20f21163942 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:49.407982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2a4a3d52-d42c-4e30-a27e-a20f21163942 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:38:49.416074 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.compute.api [None req-2a4a3d52-d42c-4e30-a27e-a20f21163942 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Working on deleting snapshot d4cfe0cf-7329-4b13-894c-0b70ba4fb47a from shelved instance... Oct 10 23:38:49.537119 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-79deef69-1248-49e0-82aa-508f807c032b tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:49.546508 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-79deef69-1248-49e0-82aa-508f807c032b tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a" status: 200 len: 1320 microversion: 2.1 time: 0.214284 Oct 10 23:38:49.548297 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2140/4389] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:49 2022] GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a => generated 1320 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:38:49.669427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-25b92fac-1bc5-4838-886c-b09bbb27db8d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:49.670006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-25b92fac-1bc5-4838-886c-b09bbb27db8d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:49.677819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25b92fac-1bc5-4838-886c-b09bbb27db8d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:49.678039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25b92fac-1bc5-4838-886c-b09bbb27db8d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:49.678574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25b92fac-1bc5-4838-886c-b09bbb27db8d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:49.679321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25b92fac-1bc5-4838-886c-b09bbb27db8d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:49.679997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25b92fac-1bc5-4838-886c-b09bbb27db8d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:49.680638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25b92fac-1bc5-4838-886c-b09bbb27db8d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:49.712035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-25b92fac-1bc5-4838-886c-b09bbb27db8d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:38:49.744640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:49.845952 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-25b92fac-1bc5-4838-886c-b09bbb27db8d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb" status: 204 len: 0 microversion: 2.1 time: 0.179741 Oct 10 23:38:49.847675 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2141/4390] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:38:49 2022] DELETE /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 23:38:49.860360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f39ca990-51c6-44b9-a0d6-4b1f3fb29f74 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:49.863403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f39ca990-51c6-44b9-a0d6-4b1f3fb29f74 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:49.876707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f39ca990-51c6-44b9-a0d6-4b1f3fb29f74 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:49.877731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f39ca990-51c6-44b9-a0d6-4b1f3fb29f74 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:49.878485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f39ca990-51c6-44b9-a0d6-4b1f3fb29f74 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:49.879571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f39ca990-51c6-44b9-a0d6-4b1f3fb29f74 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:49.880168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f39ca990-51c6-44b9-a0d6-4b1f3fb29f74 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:49.881043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f39ca990-51c6-44b9-a0d6-4b1f3fb29f74 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:50.098987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f39ca990-51c6-44b9-a0d6-4b1f3fb29f74 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:50.110778 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f39ca990-51c6-44b9-a0d6-4b1f3fb29f74 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb" status: 200 len: 1512 microversion: 2.1 time: 0.255725 Oct 10 23:38:50.111867 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2142/4391] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:49 2022] GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb => generated 1512 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:50.118035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2d754f1d-9964-40d1-abd9-cf997f384562 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:50.118897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2d754f1d-9964-40d1-abd9-cf997f384562 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:50.127264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d754f1d-9964-40d1-abd9-cf997f384562 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:50.127812 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d754f1d-9964-40d1-abd9-cf997f384562 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:50.128486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d754f1d-9964-40d1-abd9-cf997f384562 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:50.129139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d754f1d-9964-40d1-abd9-cf997f384562 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:50.129645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d754f1d-9964-40d1-abd9-cf997f384562 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:50.130084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d754f1d-9964-40d1-abd9-cf997f384562 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:50.290438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2d754f1d-9964-40d1-abd9-cf997f384562 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:50.300573 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2d754f1d-9964-40d1-abd9-cf997f384562 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1522 microversion: 2.1 time: 0.187440 Oct 10 23:38:50.301569 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2143/4392] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:50 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:50.323456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2a4a3d52-d42c-4e30-a27e-a20f21163942 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Doing local delete in cell c35e3cac-0e4f-44cc-a53a-8910e1eecc88(cell1) {{(pid=120613) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 10 23:38:50.324475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a4a3d52-d42c-4e30-a27e-a20f21163942 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:50.325197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a4a3d52-d42c-4e30-a27e-a20f21163942 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:50.325807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a4a3d52-d42c-4e30-a27e-a20f21163942 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:50.326328 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.compute.api [None req-2a4a3d52-d42c-4e30-a27e-a20f21163942 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 10 23:38:50.330573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-2a4a3d52-d42c-4e30-a27e-a20f21163942 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] deallocate_for_instance() {{(pid=120613) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 10 23:38:50.572322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-71d57f83-ab2e-4e1f-8d99-0047878ce510 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:50.572941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-71d57f83-ab2e-4e1f-8d99-0047878ce510 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 5900f1b9-105d-4c6d-8455-e772d3e5012a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:50.579165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71d57f83-ab2e-4e1f-8d99-0047878ce510 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:50.579660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71d57f83-ab2e-4e1f-8d99-0047878ce510 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:50.580099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71d57f83-ab2e-4e1f-8d99-0047878ce510 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:50.580803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71d57f83-ab2e-4e1f-8d99-0047878ce510 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:50.581258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71d57f83-ab2e-4e1f-8d99-0047878ce510 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:50.581714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71d57f83-ab2e-4e1f-8d99-0047878ce510 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:50.718280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-71d57f83-ab2e-4e1f-8d99-0047878ce510 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:50.728786 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-71d57f83-ab2e-4e1f-8d99-0047878ce510 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a" status: 200 len: 1320 microversion: 2.1 time: 0.160470 Oct 10 23:38:50.729652 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2144/4393] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:50 2022] GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a => generated 1320 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:38:50.862929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-bab18ecb-7966-42ce-80f0-c328f88ccb33 req-b7529b75-8f21-47ee-88d3-06f8da02f1be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "961f5a5b-1142-497e-8b88-b16f193e66e4", "name": "network-vif-deleted", "tag": "20d071d9-a8db-44d0-a2e2-ac7754ed4e80"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:50.877683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-bab18ecb-7966-42ce-80f0-c328f88ccb33 req-b7529b75-8f21-47ee-88d3-06f8da02f1be service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:50.878587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-bab18ecb-7966-42ce-80f0-c328f88ccb33 req-b7529b75-8f21-47ee-88d3-06f8da02f1be service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:50.878712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-2a4a3d52-d42c-4e30-a27e-a20f21163942 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Updating instance_info_cache with network_info: [] {{(pid=120613) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 23:38:50.879333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-bab18ecb-7966-42ce-80f0-c328f88ccb33 req-b7529b75-8f21-47ee-88d3-06f8da02f1be service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:50.889992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:SAVEPOINT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:50.901620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.compute.server_external_events [req-bab18ecb-7966-42ce-80f0-c328f88ccb33 req-b7529b75-8f21-47ee-88d3-06f8da02f1be service nova] Unable to find a host for instance 961f5a5b-1142-497e-8b88-b16f193e66e4. Dropping event network-vif-deleted {{(pid=120614) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 10 23:38:50.903303 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-bab18ecb-7966-42ce-80f0-c328f88ccb33 req-b7529b75-8f21-47ee-88d3-06f8da02f1be service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.045289 Oct 10 23:38:50.903987 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2145/4394] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 10 23:38:51.137227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cff0e507-7e83-4a53-b9ba-cb76e25f5c2a tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:51.138894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cff0e507-7e83-4a53-b9ba-cb76e25f5c2a tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:51.149486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cff0e507-7e83-4a53-b9ba-cb76e25f5c2a tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:51.150450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cff0e507-7e83-4a53-b9ba-cb76e25f5c2a tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:51.151139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cff0e507-7e83-4a53-b9ba-cb76e25f5c2a tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:51.152327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cff0e507-7e83-4a53-b9ba-cb76e25f5c2a tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:51.153001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cff0e507-7e83-4a53-b9ba-cb76e25f5c2a tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:51.153803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cff0e507-7e83-4a53-b9ba-cb76e25f5c2a tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:51.248379 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2a4a3d52-d42c-4e30-a27e-a20f21163942 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "DELETE /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 204 len: 0 microversion: 2.1 time: 1.892017 Oct 10 23:38:51.249783 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2250/4395] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:38:49 2022] DELETE /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 0 bytes in 1894 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 23:38:51.263245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8764c828-180e-45fc-8f3b-7aef09df0828 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:51.264092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8764c828-180e-45fc-8f3b-7aef09df0828 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:51.272101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8764c828-180e-45fc-8f3b-7aef09df0828 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:51.272855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8764c828-180e-45fc-8f3b-7aef09df0828 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:51.273548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8764c828-180e-45fc-8f3b-7aef09df0828 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:51.274448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8764c828-180e-45fc-8f3b-7aef09df0828 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:51.275152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8764c828-180e-45fc-8f3b-7aef09df0828 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:51.275883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8764c828-180e-45fc-8f3b-7aef09df0828 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:51.296303 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-8764c828-180e-45fc-8f3b-7aef09df0828 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] HTTP exception thrown: Instance 961f5a5b-1142-497e-8b88-b16f193e66e4 could not be found. Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8764c828-180e-45fc-8f3b-7aef09df0828 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Request method failure captured: Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 HTTP/1.1 Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKw8hCLXWIFTJ3HaJf5ifgl6Pm7vGD8ptwfQXuGQAkf1M-RWSvV8nlygpWidDM338TQR6cXdzFUy8zgn8XWf4EUtX06mIecSablgYBXm9sJQ78u324dyYAXvHBKQ5Ge8XY02Fdf2X0InpWnugNSR9M1ccFMQnfZYNbqSwCmT2w9EOBY Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d42cb00f2544abbde09cae76f3e3a1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-DeleteServersTestJSON-837712631 Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 7cc066774b344a24a91fb41e990f5234 Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 961f5a5b-1142-497e-8b88-b16f193e66e4 could not be found. Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '961f5a5b-1142-497e-8b88-b16f193e66e4'} Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 961f5a5b-1142-497e-8b88-b16f193e66e4 could not be found. Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 961f5a5b-1142-497e-8b88-b16f193e66e4 could not be found. Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:38:51.298882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:38:51.304135 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:51.304135 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:38:51.304135 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:38:51.304135 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:38:51.304135 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:38:51.304135 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 961f5a5b-1142-497e-8b88-b16f193e66e4 could not be found. Oct 10 23:38:51.304135 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:38:51.305851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8764c828-180e-45fc-8f3b-7aef09df0828 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Returning 404 to user: Instance 961f5a5b-1142-497e-8b88-b16f193e66e4 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:38:51.307238 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8764c828-180e-45fc-8f3b-7aef09df0828 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 404 len: 111 microversion: 2.1 time: 0.051344 Oct 10 23:38:51.308380 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2251/4396] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:51 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:38:51.329844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6d9f455b-0e49-4a0a-ba15-e72c0ed6be60 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:51.331497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6d9f455b-0e49-4a0a-ba15-e72c0ed6be60 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:51.339716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d9f455b-0e49-4a0a-ba15-e72c0ed6be60 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:51.340297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d9f455b-0e49-4a0a-ba15-e72c0ed6be60 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:51.340743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d9f455b-0e49-4a0a-ba15-e72c0ed6be60 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:51.342149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d9f455b-0e49-4a0a-ba15-e72c0ed6be60 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:51.342823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d9f455b-0e49-4a0a-ba15-e72c0ed6be60 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:51.343472 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d9f455b-0e49-4a0a-ba15-e72c0ed6be60 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:51.386191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cff0e507-7e83-4a53-b9ba-cb76e25f5c2a tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:51.397423 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cff0e507-7e83-4a53-b9ba-cb76e25f5c2a tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb" status: 200 len: 1512 microversion: 2.1 time: 0.266360 Oct 10 23:38:51.398038 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2146/4397] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:51 2022] GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb => generated 1512 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:38:51.446728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ee0543bf-b3d1-48ed-b48c-8c94d9534b03 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1586855556", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "d3777005-851a-44f1-be2b-d4f3d09bbf72"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:51.509325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-ee0543bf-b3d1-48ed-b48c-8c94d9534b03 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] validate_networks() for [('d3777005-851a-44f1-be2b-d4f3d09bbf72', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:38:51.517820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6d9f455b-0e49-4a0a-ba15-e72c0ed6be60 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:51.526223 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6d9f455b-0e49-4a0a-ba15-e72c0ed6be60 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1502 microversion: 2.1 time: 0.201599 Oct 10 23:38:51.526820 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2252/4398] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:51 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1502 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:38:51.550819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-adf4a00a-fc38-4813-a921-c5a8cb2ec2c0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:51.551642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-adf4a00a-fc38-4813-a921-c5a8cb2ec2c0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:51.558552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adf4a00a-fc38-4813-a921-c5a8cb2ec2c0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:51.559052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adf4a00a-fc38-4813-a921-c5a8cb2ec2c0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:51.559493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adf4a00a-fc38-4813-a921-c5a8cb2ec2c0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:51.560235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adf4a00a-fc38-4813-a921-c5a8cb2ec2c0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:51.560692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adf4a00a-fc38-4813-a921-c5a8cb2ec2c0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:51.561124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adf4a00a-fc38-4813-a921-c5a8cb2ec2c0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:51.790654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-adf4a00a-fc38-4813-a921-c5a8cb2ec2c0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:51.800193 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-adf4a00a-fc38-4813-a921-c5a8cb2ec2c0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1515 microversion: 2.1 time: 0.254456 Oct 10 23:38:51.800801 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2253/4399] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:51 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1515 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:38:51.807615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1f13cc82-1277-4c0c-87ae-8b3cc978d8d5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:51.808235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1f13cc82-1277-4c0c-87ae-8b3cc978d8d5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 5900f1b9-105d-4c6d-8455-e772d3e5012a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:51.840317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f13cc82-1277-4c0c-87ae-8b3cc978d8d5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:51.840929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f13cc82-1277-4c0c-87ae-8b3cc978d8d5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:51.841485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f13cc82-1277-4c0c-87ae-8b3cc978d8d5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:51.842277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f13cc82-1277-4c0c-87ae-8b3cc978d8d5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:51.842816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f13cc82-1277-4c0c-87ae-8b3cc978d8d5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:51.843329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f13cc82-1277-4c0c-87ae-8b3cc978d8d5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:52.008881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1f13cc82-1277-4c0c-87ae-8b3cc978d8d5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:52.018438 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1f13cc82-1277-4c0c-87ae-8b3cc978d8d5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a" status: 200 len: 1509 microversion: 2.1 time: 0.216592 Oct 10 23:38:52.019163 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2254/4400] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:51 2022] GET /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a => generated 1509 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:52.024820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-753d613f-9b36-4026-9889-0b73b593b854 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:52.032106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-753d613f-9b36-4026-9889-0b73b593b854 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 4e45f300-2ee1-4015-8d47-03c90aea1d08] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:52.041340 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-753d613f-9b36-4026-9889-0b73b593b854 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] HTTP exception thrown: Instance 4e45f300-2ee1-4015-8d47-03c90aea1d08 could not be found. Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-753d613f-9b36-4026-9889-0b73b593b854 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Request method failure captured: Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/4e45f300-2ee1-4015-8d47-03c90aea1d08/action HTTP/1.1 Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 14 Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKzOYlZsv7rRo2sa7kQc2eFaI8v-TMGvuh-sVU-zvganQJF5vXcDouizKP05ne1GDSQKrDkWUQDAU6qxxYttyNZ_6Byu14LDFhfplUKI_eaTrPi0t5xENermj156ZGMg1lyNDKMrSevusXHHA-zCISDm6SLPwivXrQErNiD9Jy9X9Qs Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 8986c214fcc944acb2731cc5af19ef0c Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8986c214fcc944acb2731cc5af19ef0c", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 8986c214fcc944acb2731cc5af19ef0c Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerRescueNegativeTestJSON-906322093-project Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 585d2834c2a94c5eaa8267cf2ba58ac0 Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerRescueNegativeTestJSON-906322093-project Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: {"rescue": {}} Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 4e45f300-2ee1-4015-8d47-03c90aea1d08 could not be found. Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '4e45f300-2ee1-4015-8d47-03c90aea1d08', 'body': {'rescue': {}}} Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e45f300-2ee1-4015-8d47-03c90aea1d08 could not be found. Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e45f300-2ee1-4015-8d47-03c90aea1d08 could not be found. Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:38:52.050704 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:52.054689 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:38:52.054689 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:38:52.054689 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:38:52.054689 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:38:52.054689 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e45f300-2ee1-4015-8d47-03c90aea1d08 could not be found. Oct 10 23:38:52.054689 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:38:52.054689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-753d613f-9b36-4026-9889-0b73b593b854 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Returning 404 to user: Instance 4e45f300-2ee1-4015-8d47-03c90aea1d08 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:38:52.054689 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-753d613f-9b36-4026-9889-0b73b593b854 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "POST /compute/v2.1/servers/4e45f300-2ee1-4015-8d47-03c90aea1d08/action" status: 404 len: 111 microversion: 2.1 time: 0.032206 Oct 10 23:38:52.054689 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2255/4401] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:38:52 2022] POST /compute/v2.1/servers/4e45f300-2ee1-4015-8d47-03c90aea1d08/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:38:52.063037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b54ce1f3-1edd-4aa8-8a8d-e5c18010fc62 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:52.064016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b54ce1f3-1edd-4aa8-8a8d-e5c18010fc62 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 8fd7d94f-f58e-4be5-8e0f-11e9f12fb93f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:52.070924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b54ce1f3-1edd-4aa8-8a8d-e5c18010fc62 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:52.071416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b54ce1f3-1edd-4aa8-8a8d-e5c18010fc62 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:52.071856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b54ce1f3-1edd-4aa8-8a8d-e5c18010fc62 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:52.072556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b54ce1f3-1edd-4aa8-8a8d-e5c18010fc62 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:52.073010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b54ce1f3-1edd-4aa8-8a8d-e5c18010fc62 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:52.073468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b54ce1f3-1edd-4aa8-8a8d-e5c18010fc62 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:52.244729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b54ce1f3-1edd-4aa8-8a8d-e5c18010fc62 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:52.253579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ee0543bf-b3d1-48ed-b48c-8c94d9534b03 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:38:52.254677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ee0543bf-b3d1-48ed-b48c-8c94d9534b03 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:38:52.255116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ee0543bf-b3d1-48ed-b48c-8c94d9534b03 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:38:52.255774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ee0543bf-b3d1-48ed-b48c-8c94d9534b03 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:38:52.256478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ee0543bf-b3d1-48ed-b48c-8c94d9534b03 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:38:52.258718 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b54ce1f3-1edd-4aa8-8a8d-e5c18010fc62 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/8fd7d94f-f58e-4be5-8e0f-11e9f12fb93f" status: 200 len: 1508 microversion: 2.1 time: 0.204822 Oct 10 23:38:52.259708 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2256/4402] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:52 2022] GET /compute/v2.1/servers/8fd7d94f-f58e-4be5-8e0f-11e9f12fb93f => generated 1508 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:52.266185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-62f5a6b8-5b31-4b1c-ab30-10762a5bc7d6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:52.267427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-62f5a6b8-5b31-4b1c-ab30-10762a5bc7d6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:52.267934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee0543bf-b3d1-48ed-b48c-8c94d9534b03 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:52.268366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee0543bf-b3d1-48ed-b48c-8c94d9534b03 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:52.268882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee0543bf-b3d1-48ed-b48c-8c94d9534b03 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:52.269786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee0543bf-b3d1-48ed-b48c-8c94d9534b03 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:52.270246 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee0543bf-b3d1-48ed-b48c-8c94d9534b03 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:52.270758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee0543bf-b3d1-48ed-b48c-8c94d9534b03 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:52.274033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62f5a6b8-5b31-4b1c-ab30-10762a5bc7d6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:52.274525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62f5a6b8-5b31-4b1c-ab30-10762a5bc7d6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:52.274965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62f5a6b8-5b31-4b1c-ab30-10762a5bc7d6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:52.275793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62f5a6b8-5b31-4b1c-ab30-10762a5bc7d6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:52.276409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62f5a6b8-5b31-4b1c-ab30-10762a5bc7d6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:52.276880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62f5a6b8-5b31-4b1c-ab30-10762a5bc7d6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:52.291220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ee0543bf-b3d1-48ed-b48c-8c94d9534b03 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Getting quotas for project e7d42cb00f2544abbde09cae76f3e3a1. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:38:52.294026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:52.300256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ee0543bf-b3d1-48ed-b48c-8c94d9534b03 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Getting quotas for user 7cc066774b344a24a91fb41e990f5234 and project e7d42cb00f2544abbde09cae76f3e3a1. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:38:52.319077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ee0543bf-b3d1-48ed-b48c-8c94d9534b03 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:38:52.320898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ee0543bf-b3d1-48ed-b48c-8c94d9534b03 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:38:52.361610 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-62f5a6b8-5b31-4b1c-ab30-10762a5bc7d6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "POST /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690/action" status: 202 len: 0 microversion: 2.1 time: 0.098409 Oct 10 23:38:52.369457 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2257/4403] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:38:52 2022] POST /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:38:52.374308 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ee0543bf-b3d1-48ed-b48c-8c94d9534b03 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.932454 Oct 10 23:38:52.376240 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2147/4404] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:38:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:38:52.379180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-50f5cd58-9d52-4f19-98c8-9734000bdccf tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:52.380176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-50f5cd58-9d52-4f19-98c8-9734000bdccf tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 8fd7d94f-f58e-4be5-8e0f-11e9f12fb93f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:52.382683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-100b1cae-014c-4ae5-b2cb-7646c69d90d0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:52.383500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-100b1cae-014c-4ae5-b2cb-7646c69d90d0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:52.388734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50f5cd58-9d52-4f19-98c8-9734000bdccf tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:52.389254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50f5cd58-9d52-4f19-98c8-9734000bdccf tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:52.390124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50f5cd58-9d52-4f19-98c8-9734000bdccf tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:52.391662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-100b1cae-014c-4ae5-b2cb-7646c69d90d0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:52.391970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50f5cd58-9d52-4f19-98c8-9734000bdccf tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:52.392180 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-100b1cae-014c-4ae5-b2cb-7646c69d90d0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:52.392690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-100b1cae-014c-4ae5-b2cb-7646c69d90d0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:52.393160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50f5cd58-9d52-4f19-98c8-9734000bdccf tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:52.393491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-100b1cae-014c-4ae5-b2cb-7646c69d90d0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:52.393956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-100b1cae-014c-4ae5-b2cb-7646c69d90d0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:52.394274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50f5cd58-9d52-4f19-98c8-9734000bdccf tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:52.394419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-100b1cae-014c-4ae5-b2cb-7646c69d90d0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:52.451940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-50f5cd58-9d52-4f19-98c8-9734000bdccf tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 8fd7d94f-f58e-4be5-8e0f-11e9f12fb93f] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:38:52.591866 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-50f5cd58-9d52-4f19-98c8-9734000bdccf tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8fd7d94f-f58e-4be5-8e0f-11e9f12fb93f" status: 204 len: 0 microversion: 2.1 time: 0.220589 Oct 10 23:38:52.597449 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2258/4405] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:38:52 2022] DELETE /compute/v2.1/servers/8fd7d94f-f58e-4be5-8e0f-11e9f12fb93f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:38:52.606339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ee3edb5b-2408-4b84-a657-e87fc0c60ddb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:52.607069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ee3edb5b-2408-4b84-a657-e87fc0c60ddb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:52.689196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ee3edb5b-2408-4b84-a657-e87fc0c60ddb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:52.697019 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ee3edb5b-2408-4b84-a657-e87fc0c60ddb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1215 microversion: 2.1 time: 0.101307 Oct 10 23:38:52.697960 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2259/4406] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:52 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:52.724752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-474ca345-1c5e-4268-b32b-f9134b8bd4ae tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:52.725306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-474ca345-1c5e-4268-b32b-f9134b8bd4ae tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:52.734015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-474ca345-1c5e-4268-b32b-f9134b8bd4ae tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:52.734785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-474ca345-1c5e-4268-b32b-f9134b8bd4ae tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:52.735329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-474ca345-1c5e-4268-b32b-f9134b8bd4ae tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:52.736056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-474ca345-1c5e-4268-b32b-f9134b8bd4ae tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:52.736571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-474ca345-1c5e-4268-b32b-f9134b8bd4ae tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:52.737134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-474ca345-1c5e-4268-b32b-f9134b8bd4ae tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:52.744282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-100b1cae-014c-4ae5-b2cb-7646c69d90d0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:52.756319 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-100b1cae-014c-4ae5-b2cb-7646c69d90d0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1520 microversion: 2.1 time: 0.378703 Oct 10 23:38:52.757338 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2148/4407] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:52 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1520 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:52.762678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-8f947930-cb4a-4f75-ae1e-7260be0a6ba6 req-2362205e-1bb2-458e-b753-3ca3f5bbb6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb", "name": "network-vif-deleted", "tag": "c8a3b1ab-895f-48f5-bcc5-2bf399bb9df5"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:52.776230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8f947930-cb4a-4f75-ae1e-7260be0a6ba6 req-2362205e-1bb2-458e-b753-3ca3f5bbb6c4 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:52.776961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8f947930-cb4a-4f75-ae1e-7260be0a6ba6 req-2362205e-1bb2-458e-b753-3ca3f5bbb6c4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:52.777591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8f947930-cb4a-4f75-ae1e-7260be0a6ba6 req-2362205e-1bb2-458e-b753-3ca3f5bbb6c4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:52.789572 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-8f947930-cb4a-4f75-ae1e-7260be0a6ba6 req-2362205e-1bb2-458e-b753-3ca3f5bbb6c4 service nova] Creating event network-vif-deleted:c8a3b1ab-895f-48f5-bcc5-2bf399bb9df5 for instance fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb on n-h2-860864-2 Oct 10 23:38:52.794871 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-8f947930-cb4a-4f75-ae1e-7260be0a6ba6 req-2362205e-1bb2-458e-b753-3ca3f5bbb6c4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035981 Oct 10 23:38:52.795171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-474ca345-1c5e-4268-b32b-f9134b8bd4ae tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:52.795363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-474ca345-1c5e-4268-b32b-f9134b8bd4ae tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:52.795839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-474ca345-1c5e-4268-b32b-f9134b8bd4ae tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:52.796092 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2149/4408] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:52.796333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-474ca345-1c5e-4268-b32b-f9134b8bd4ae tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lazy-loading 'fault' on Instance uuid fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:38:52.805787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bc232be4-3292-450a-b1d3-98337efbf9ef tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:52.806385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bc232be4-3292-450a-b1d3-98337efbf9ef tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 5900f1b9-105d-4c6d-8455-e772d3e5012a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:52.814720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc232be4-3292-450a-b1d3-98337efbf9ef tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:52.815253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc232be4-3292-450a-b1d3-98337efbf9ef tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:52.815629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc232be4-3292-450a-b1d3-98337efbf9ef tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:52.816331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc232be4-3292-450a-b1d3-98337efbf9ef tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:52.816780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc232be4-3292-450a-b1d3-98337efbf9ef tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:52.819655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc232be4-3292-450a-b1d3-98337efbf9ef tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:52.854461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bc232be4-3292-450a-b1d3-98337efbf9ef tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 5900f1b9-105d-4c6d-8455-e772d3e5012a] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:38:52.866528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-474ca345-1c5e-4268-b32b-f9134b8bd4ae tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:52.877323 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-474ca345-1c5e-4268-b32b-f9134b8bd4ae tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb" status: 200 len: 1307 microversion: 2.1 time: 0.163082 Oct 10 23:38:52.878383 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2260/4409] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:52 2022] GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb => generated 1307 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:52.964726 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bc232be4-3292-450a-b1d3-98337efbf9ef tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a" status: 204 len: 0 microversion: 2.1 time: 0.162934 Oct 10 23:38:52.965560 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2150/4410] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:38:52 2022] DELETE /compute/v2.1/servers/5900f1b9-105d-4c6d-8455-e772d3e5012a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:38:53.117196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7bd5bde9-e8cc-4063-9adc-e0a1b035fbb1 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-95461018", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "6207edcd-cb21-4a0a-93ef-d4b2fb2efd01"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:53.172543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-7bd5bde9-e8cc-4063-9adc-e0a1b035fbb1 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] validate_networks() for [('6207edcd-cb21-4a0a-93ef-d4b2fb2efd01', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:38:53.572097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7bd5bde9-e8cc-4063-9adc-e0a1b035fbb1 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:38:53.572645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7bd5bde9-e8cc-4063-9adc-e0a1b035fbb1 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:38:53.573004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7bd5bde9-e8cc-4063-9adc-e0a1b035fbb1 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:38:53.573444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7bd5bde9-e8cc-4063-9adc-e0a1b035fbb1 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:38:53.573863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7bd5bde9-e8cc-4063-9adc-e0a1b035fbb1 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:38:53.583791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bd5bde9-e8cc-4063-9adc-e0a1b035fbb1 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:53.584263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bd5bde9-e8cc-4063-9adc-e0a1b035fbb1 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:53.584704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bd5bde9-e8cc-4063-9adc-e0a1b035fbb1 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:53.585462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bd5bde9-e8cc-4063-9adc-e0a1b035fbb1 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:53.586338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bd5bde9-e8cc-4063-9adc-e0a1b035fbb1 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:53.586338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bd5bde9-e8cc-4063-9adc-e0a1b035fbb1 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:53.605055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-7bd5bde9-e8cc-4063-9adc-e0a1b035fbb1 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Getting quotas for project d32a42ea929d4de29a9a37afc03f4b2b. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:38:53.611201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-7bd5bde9-e8cc-4063-9adc-e0a1b035fbb1 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Getting quotas for user 2a7ffba096424668a5d3c1320056533e and project d32a42ea929d4de29a9a37afc03f4b2b. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:38:53.623794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7bd5bde9-e8cc-4063-9adc-e0a1b035fbb1 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Going to run 2 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:38:53.626988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7bd5bde9-e8cc-4063-9adc-e0a1b035fbb1 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 510bed7b-8cea-4bd7-8dbd-1778adabddfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:38:53.663491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7bd5bde9-e8cc-4063-9adc-e0a1b035fbb1 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=510bed7b-8cea-4bd7-8dbd-1778adabddfd,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:38:53.721655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5517bc25-894b-422f-a1f4-c0b2c0db472c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:53.722277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5517bc25-894b-422f-a1f4-c0b2c0db472c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:53.730317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5517bc25-894b-422f-a1f4-c0b2c0db472c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:53.731069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5517bc25-894b-422f-a1f4-c0b2c0db472c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:53.731715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5517bc25-894b-422f-a1f4-c0b2c0db472c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:53.732021 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7bd5bde9-e8cc-4063-9adc-e0a1b035fbb1 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.618301 Oct 10 23:38:53.732737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5517bc25-894b-422f-a1f4-c0b2c0db472c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:53.733351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5517bc25-894b-422f-a1f4-c0b2c0db472c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:53.733950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5517bc25-894b-422f-a1f4-c0b2c0db472c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:53.736420 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2261/4411] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:38:53 2022] POST /compute/v2.1/servers => generated 32 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 10 23:38:53.742490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ac8c5c74-2dae-42e9-9961-3ea050b0abf5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:53.747726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ac8c5c74-2dae-42e9-9961-3ea050b0abf5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:53.751065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ac8c5c74-2dae-42e9-9961-3ea050b0abf5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Searching by: {'deleted': False, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b'} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 23:38:53.794485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac8c5c74-2dae-42e9-9961-3ea050b0abf5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:53.795059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac8c5c74-2dae-42e9-9961-3ea050b0abf5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:53.795575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac8c5c74-2dae-42e9-9961-3ea050b0abf5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:53.796434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac8c5c74-2dae-42e9-9961-3ea050b0abf5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:53.797710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac8c5c74-2dae-42e9-9961-3ea050b0abf5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:53.798322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac8c5c74-2dae-42e9-9961-3ea050b0abf5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:53.833517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.multi_cell_list [None req-ac8c5c74-2dae-42e9-9961-3ea050b0abf5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=120613) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 23:38:53.841080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5517bc25-894b-422f-a1f4-c0b2c0db472c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:53.850481 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5517bc25-894b-422f-a1f4-c0b2c0db472c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1219 microversion: 2.1 time: 0.134009 Oct 10 23:38:53.852824 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2151/4412] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:53 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1219 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:38:53.870667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5b105137-33fe-4065-985b-6450187cf8b5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:53.874725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5b105137-33fe-4065-985b-6450187cf8b5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:53.884657 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ac8c5c74-2dae-42e9-9961-3ea050b0abf5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.146846 Oct 10 23:38:53.885648 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2262/4413] 10.222.0.23 () {58 vars in 1125 bytes} [Mon Oct 10 23:38:53 2022] GET /compute/v2.1/servers => generated 1333 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:53.891050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b105137-33fe-4065-985b-6450187cf8b5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:53.892989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b105137-33fe-4065-985b-6450187cf8b5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:53.898067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b105137-33fe-4065-985b-6450187cf8b5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:53.898857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b105137-33fe-4065-985b-6450187cf8b5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:53.899210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5f631ee3-462f-4c9d-a083-c4f31ddf6684 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:53.899832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5f631ee3-462f-4c9d-a083-c4f31ddf6684 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:53.900064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b105137-33fe-4065-985b-6450187cf8b5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:53.900502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5b105137-33fe-4065-985b-6450187cf8b5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:53.995779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5f631ee3-462f-4c9d-a083-c4f31ddf6684 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:54.005762 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5f631ee3-462f-4c9d-a083-c4f31ddf6684 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab" status: 200 len: 1216 microversion: 2.1 time: 0.110375 Oct 10 23:38:54.010826 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2263/4414] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:53 2022] GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab => generated 1216 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:54.016873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1f76be9e-a84c-4480-a45d-59efaef5b176 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:54.017580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1f76be9e-a84c-4480-a45d-59efaef5b176 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:54.024098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f76be9e-a84c-4480-a45d-59efaef5b176 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:54.024589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f76be9e-a84c-4480-a45d-59efaef5b176 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:54.025012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f76be9e-a84c-4480-a45d-59efaef5b176 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:54.025751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f76be9e-a84c-4480-a45d-59efaef5b176 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:54.026481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f76be9e-a84c-4480-a45d-59efaef5b176 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:54.026906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f76be9e-a84c-4480-a45d-59efaef5b176 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:54.032752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:RELEASE=1,nova_cell1:SELECT=80,nova_cell1:UPDATE=15,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:54.067389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f76be9e-a84c-4480-a45d-59efaef5b176 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:54.068330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f76be9e-a84c-4480-a45d-59efaef5b176 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:54.068963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f76be9e-a84c-4480-a45d-59efaef5b176 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:54.069664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-1f76be9e-a84c-4480-a45d-59efaef5b176 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lazy-loading 'fault' on Instance uuid fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:38:54.104853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5b105137-33fe-4065-985b-6450187cf8b5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:54.113666 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5b105137-33fe-4065-985b-6450187cf8b5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1500 microversion: 2.1 time: 0.251531 Oct 10 23:38:54.114650 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2152/4415] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:53 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1500 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:54.137645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-137a30c6-96a7-40cf-b570-98a9d1c564ed tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:54.141194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-137a30c6-96a7-40cf-b570-98a9d1c564ed tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:54.148647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-137a30c6-96a7-40cf-b570-98a9d1c564ed tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:54.149570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-137a30c6-96a7-40cf-b570-98a9d1c564ed tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:54.150239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-137a30c6-96a7-40cf-b570-98a9d1c564ed tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:54.151837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-137a30c6-96a7-40cf-b570-98a9d1c564ed tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:54.152678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-137a30c6-96a7-40cf-b570-98a9d1c564ed tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:54.153204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-137a30c6-96a7-40cf-b570-98a9d1c564ed tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:54.164823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1f76be9e-a84c-4480-a45d-59efaef5b176 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:54.175442 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1f76be9e-a84c-4480-a45d-59efaef5b176 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb" status: 200 len: 1307 microversion: 2.1 time: 0.162984 Oct 10 23:38:54.176824 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2264/4416] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:54 2022] GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb => generated 1307 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:54.190887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-137a30c6-96a7-40cf-b570-98a9d1c564ed tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lazy-loading 'flavor' on Instance uuid 0f01cc76-fa39-4e39-8e4d-e0263388c690 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:38:54.205504 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-137a30c6-96a7-40cf-b570-98a9d1c564ed tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] HTTP exception thrown: Cannot 'rescue' instance 0f01cc76-fa39-4e39-8e4d-e0263388c690 while it is in vm_state paused Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-137a30c6-96a7-40cf-b570-98a9d1c564ed tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Request method failure captured: Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690/action HTTP/1.1 Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 14 Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKzOYlZsv7rRo2sa7kQc2eFaI8v-TMGvuh-sVU-zvganQJF5vXcDouizKP05ne1GDSQKrDkWUQDAU6qxxYttyNZ_6Byu14LDFhfplUKI_eaTrPi0t5xENermj156ZGMg1lyNDKMrSevusXHHA-zCISDm6SLPwivXrQErNiD9Jy9X9Qs Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 8986c214fcc944acb2731cc5af19ef0c Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8986c214fcc944acb2731cc5af19ef0c", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 8986c214fcc944acb2731cc5af19ef0c Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerRescueNegativeTestJSON-906322093-project Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 585d2834c2a94c5eaa8267cf2ba58ac0 Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerRescueNegativeTestJSON-906322093-project Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: {"rescue": {}} Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: exception: Cannot 'rescue' instance 0f01cc76-fa39-4e39-8e4d-e0263388c690 while it is in vm_state paused Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '0f01cc76-fa39-4e39-8e4d-e0263388c690', 'body': {'rescue': {}}} Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f01cc76-fa39-4e39-8e4d-e0263388c690 in vm_state paused. Cannot rescue while the instance is in this state. Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 0f01cc76-fa39-4e39-8e4d-e0263388c690 while it is in vm_state paused Oct 10 23:38:54.208228 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:54.217265 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:38:54.217265 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:54.217265 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:54.217265 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:38:54.217265 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:38:54.217265 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:38:54.217265 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:38:54.217265 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 0f01cc76-fa39-4e39-8e4d-e0263388c690 while it is in vm_state paused Oct 10 23:38:54.217265 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:38:54.217265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-137a30c6-96a7-40cf-b570-98a9d1c564ed tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Returning 409 to user: Cannot 'rescue' instance 0f01cc76-fa39-4e39-8e4d-e0263388c690 while it is in vm_state paused {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:38:54.217265 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-137a30c6-96a7-40cf-b570-98a9d1c564ed tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "POST /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690/action" status: 409 len: 144 microversion: 2.1 time: 0.076236 Oct 10 23:38:54.217265 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2153/4417] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:38:54 2022] POST /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690/action => generated 144 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 10 23:38:54.220287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d7919c24-45d6-452c-bb37-0bedd82cea6f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:54.220959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d7919c24-45d6-452c-bb37-0bedd82cea6f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:54.228215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7919c24-45d6-452c-bb37-0bedd82cea6f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:54.228694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7919c24-45d6-452c-bb37-0bedd82cea6f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:54.229124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7919c24-45d6-452c-bb37-0bedd82cea6f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:54.229969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7919c24-45d6-452c-bb37-0bedd82cea6f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:54.230424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7919c24-45d6-452c-bb37-0bedd82cea6f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:54.230844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7919c24-45d6-452c-bb37-0bedd82cea6f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:54.306519 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d7919c24-45d6-452c-bb37-0bedd82cea6f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "POST /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690/action" status: 202 len: 0 microversion: 2.1 time: 0.091004 Oct 10 23:38:54.307419 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2265/4418] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:38:54 2022] POST /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 23:38:54.323228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d2b56405-4188-4db8-8ffd-c15a376b4100 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:54.324467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d2b56405-4188-4db8-8ffd-c15a376b4100 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:54.334926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2b56405-4188-4db8-8ffd-c15a376b4100 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:54.335822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2b56405-4188-4db8-8ffd-c15a376b4100 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:54.337607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2b56405-4188-4db8-8ffd-c15a376b4100 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:54.339190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2b56405-4188-4db8-8ffd-c15a376b4100 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:54.340275 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2b56405-4188-4db8-8ffd-c15a376b4100 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:54.341094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2b56405-4188-4db8-8ffd-c15a376b4100 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:54.542897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d2b56405-4188-4db8-8ffd-c15a376b4100 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:54.555165 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d2b56405-4188-4db8-8ffd-c15a376b4100 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1507 microversion: 2.1 time: 0.240980 Oct 10 23:38:54.573508 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2154/4419] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:54 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1507 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:54.882546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3b9f7f2e-af48-42aa-8dff-1b2695338ee7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:54.883713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3b9f7f2e-af48-42aa-8dff-1b2695338ee7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:54.891832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b9f7f2e-af48-42aa-8dff-1b2695338ee7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:54.892687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b9f7f2e-af48-42aa-8dff-1b2695338ee7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:54.893301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b9f7f2e-af48-42aa-8dff-1b2695338ee7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:54.894307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b9f7f2e-af48-42aa-8dff-1b2695338ee7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:54.894982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b9f7f2e-af48-42aa-8dff-1b2695338ee7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:54.895568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b9f7f2e-af48-42aa-8dff-1b2695338ee7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:54.970529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3b9f7f2e-af48-42aa-8dff-1b2695338ee7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:54.978694 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3b9f7f2e-af48-42aa-8dff-1b2695338ee7 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1211 microversion: 2.1 time: 0.101256 Oct 10 23:38:54.979267 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2266/4420] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:54 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1211 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:55.030348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b6737101-ce31-433b-8f13-caa1cee1f3d2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:55.030973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b6737101-ce31-433b-8f13-caa1cee1f3d2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:55.038146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6737101-ce31-433b-8f13-caa1cee1f3d2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:55.038641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6737101-ce31-433b-8f13-caa1cee1f3d2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:55.039078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6737101-ce31-433b-8f13-caa1cee1f3d2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:55.039779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6737101-ce31-433b-8f13-caa1cee1f3d2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:55.040235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6737101-ce31-433b-8f13-caa1cee1f3d2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:55.040665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6737101-ce31-433b-8f13-caa1cee1f3d2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:55.110335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b6737101-ce31-433b-8f13-caa1cee1f3d2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:55.117987 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b6737101-ce31-433b-8f13-caa1cee1f3d2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab" status: 200 len: 1268 microversion: 2.1 time: 0.091908 Oct 10 23:38:55.118559 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2155/4421] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:55 2022] GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab => generated 1268 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:55.199221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f7ed2cd5-baee-4b8a-bf7b-405e5593148e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:55.199862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f7ed2cd5-baee-4b8a-bf7b-405e5593148e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:55.201870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:55.208555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7ed2cd5-baee-4b8a-bf7b-405e5593148e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:55.209049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7ed2cd5-baee-4b8a-bf7b-405e5593148e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:55.209515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7ed2cd5-baee-4b8a-bf7b-405e5593148e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:55.210215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7ed2cd5-baee-4b8a-bf7b-405e5593148e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:55.210661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7ed2cd5-baee-4b8a-bf7b-405e5593148e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:55.211082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7ed2cd5-baee-4b8a-bf7b-405e5593148e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:55.245785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7ed2cd5-baee-4b8a-bf7b-405e5593148e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:55.246266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7ed2cd5-baee-4b8a-bf7b-405e5593148e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:55.246719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7ed2cd5-baee-4b8a-bf7b-405e5593148e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:55.247183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-f7ed2cd5-baee-4b8a-bf7b-405e5593148e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lazy-loading 'fault' on Instance uuid fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:38:55.294760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f7ed2cd5-baee-4b8a-bf7b-405e5593148e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:55.310822 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f7ed2cd5-baee-4b8a-bf7b-405e5593148e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb" status: 200 len: 1307 microversion: 2.1 time: 0.115655 Oct 10 23:38:55.311395 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2267/4422] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:55 2022] GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb => generated 1307 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:55.586344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-754de03e-51bc-4099-8e83-12374b7f1534 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:55.587264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-754de03e-51bc-4099-8e83-12374b7f1534 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:55.602259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-754de03e-51bc-4099-8e83-12374b7f1534 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:55.602767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-754de03e-51bc-4099-8e83-12374b7f1534 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:55.603435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-754de03e-51bc-4099-8e83-12374b7f1534 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:55.604358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-754de03e-51bc-4099-8e83-12374b7f1534 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:55.604822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-754de03e-51bc-4099-8e83-12374b7f1534 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:55.605245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-754de03e-51bc-4099-8e83-12374b7f1534 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:56.005620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5322dced-01a2-4e4d-8750-9e19ac9c7c87 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:56.007197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5322dced-01a2-4e4d-8750-9e19ac9c7c87 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:56.028778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5322dced-01a2-4e4d-8750-9e19ac9c7c87 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:56.030146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5322dced-01a2-4e4d-8750-9e19ac9c7c87 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:56.030765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5322dced-01a2-4e4d-8750-9e19ac9c7c87 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:56.032416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5322dced-01a2-4e4d-8750-9e19ac9c7c87 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:56.033149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5322dced-01a2-4e4d-8750-9e19ac9c7c87 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:56.034645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5322dced-01a2-4e4d-8750-9e19ac9c7c87 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:56.173614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5322dced-01a2-4e4d-8750-9e19ac9c7c87 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:56.199692 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5322dced-01a2-4e4d-8750-9e19ac9c7c87 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1267 microversion: 2.1 time: 0.187352 Oct 10 23:38:56.207831 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2268/4423] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:55 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:56.230811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-35df7d39-5691-48d1-8954-77540b2a1125 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:56.232898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-35df7d39-5691-48d1-8954-77540b2a1125 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:56.244055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-35df7d39-5691-48d1-8954-77540b2a1125 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:56.244809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-35df7d39-5691-48d1-8954-77540b2a1125 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:56.245575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-35df7d39-5691-48d1-8954-77540b2a1125 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:56.246465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-35df7d39-5691-48d1-8954-77540b2a1125 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:56.247182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-35df7d39-5691-48d1-8954-77540b2a1125 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:56.247907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-35df7d39-5691-48d1-8954-77540b2a1125 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:56.347942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-754de03e-51bc-4099-8e83-12374b7f1534 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:56.357748 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-754de03e-51bc-4099-8e83-12374b7f1534 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1515 microversion: 2.1 time: 0.775703 Oct 10 23:38:56.362872 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2156/4424] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:55 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1515 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:56.368968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-7e38e1df-1e40-4c49-beed-eb30887e1b2c req-3ef2068b-6304-48b5-bba1-4ad7afc0a963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5900f1b9-105d-4c6d-8455-e772d3e5012a", "name": "network-vif-deleted", "tag": "35b58dd8-e33e-441c-91a5-9a30ecdb7ef5"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:56.403475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-35df7d39-5691-48d1-8954-77540b2a1125 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:56.409434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7e38e1df-1e40-4c49-beed-eb30887e1b2c req-3ef2068b-6304-48b5-bba1-4ad7afc0a963 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:56.413054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7e38e1df-1e40-4c49-beed-eb30887e1b2c req-3ef2068b-6304-48b5-bba1-4ad7afc0a963 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:56.418467 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-35df7d39-5691-48d1-8954-77540b2a1125 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab" status: 200 len: 1274 microversion: 2.1 time: 0.209229 Oct 10 23:38:56.418768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7e38e1df-1e40-4c49-beed-eb30887e1b2c req-3ef2068b-6304-48b5-bba1-4ad7afc0a963 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:56.419216 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2269/4425] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:56 2022] GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab => generated 1274 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:56.424556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-69eca69b-4fe6-48dd-903a-1a1fc2797b75 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:56.425263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-69eca69b-4fe6-48dd-903a-1a1fc2797b75 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:56.448255 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-7e38e1df-1e40-4c49-beed-eb30887e1b2c req-3ef2068b-6304-48b5-bba1-4ad7afc0a963 service nova] Creating event network-vif-deleted:35b58dd8-e33e-441c-91a5-9a30ecdb7ef5 for instance 5900f1b9-105d-4c6d-8455-e772d3e5012a on n-h2-860864-2 Oct 10 23:38:56.450335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69eca69b-4fe6-48dd-903a-1a1fc2797b75 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:56.450850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69eca69b-4fe6-48dd-903a-1a1fc2797b75 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:56.451294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69eca69b-4fe6-48dd-903a-1a1fc2797b75 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:56.452008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69eca69b-4fe6-48dd-903a-1a1fc2797b75 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:56.453472 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69eca69b-4fe6-48dd-903a-1a1fc2797b75 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:56.454084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69eca69b-4fe6-48dd-903a-1a1fc2797b75 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:56.460351 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-7e38e1df-1e40-4c49-beed-eb30887e1b2c req-3ef2068b-6304-48b5-bba1-4ad7afc0a963 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095816 Oct 10 23:38:56.464014 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2157/4426] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:38:56.485422 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-69eca69b-4fe6-48dd-903a-1a1fc2797b75 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] HTTP exception thrown: Instance fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb could not be found. Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-69eca69b-4fe6-48dd-903a-1a1fc2797b75 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Request method failure captured: Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb HTTP/1.1 Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKw3z-Sqpxym_jJHHXgCcJ1wVGzJaphSXe685TCJ0FMt_1f6lnXmRKSTlr_crjIVs1S0hrGbN2P0_oJIkbADzLlwVV5ASSCxTREfZ1WfxCqn6JcQ_Q2gDvqxUiZdXDuARO712AlIVZqA8BvFLLTrWvQled_51r12cH41oDLJaleX8zE Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 7030e994103a48d6bb58a2f6fd440074 Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-VolumesAdminNegativeTest-1562061530 Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7030e994103a48d6bb58a2f6fd440074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7030e994103a48d6bb58a2f6fd440074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7030e994103a48d6bb58a2f6fd440074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7030e994103a48d6bb58a2f6fd440074", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-VolumesAdminNegativeTest-1562061530 Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 7030e994103a48d6bb58a2f6fd440074 Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1562061530 Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-VolumesAdminNegativeTest-1562061530-project Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 7595dc3ad9b546348a01ae0a638b110d Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-VolumesAdminNegativeTest-1562061530-project Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb could not be found. Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb'} Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb could not be found. Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb could not be found. Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:38:56.487253 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:38:56.491108 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:38:56.491108 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:38:56.491108 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:38:56.491108 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:38:56.491108 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:38:56.491108 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb could not be found. Oct 10 23:38:56.491108 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:38:56.491108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-69eca69b-4fe6-48dd-903a-1a1fc2797b75 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Returning 404 to user: Instance fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:38:56.491108 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-69eca69b-4fe6-48dd-903a-1a1fc2797b75 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb" status: 404 len: 111 microversion: 2.1 time: 0.068384 Oct 10 23:38:56.493190 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2270/4427] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:56 2022] GET /compute/v2.1/servers/fb8a688d-86ea-4b27-8ad4-e3ab20d57bdb => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:38:56.583061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-11cbf06f-c4ed-4969-9ca5-7c5032a45862 req-532f9f65-97f8-4d52-8fd0-2f02b4f1ad22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fd7d94f-f58e-4be5-8e0f-11e9f12fb93f", "name": "network-vif-deleted", "tag": "367c2fce-8d92-43a8-9e5b-e46dabbe97cb"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:56.598014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-11cbf06f-c4ed-4969-9ca5-7c5032a45862 req-532f9f65-97f8-4d52-8fd0-2f02b4f1ad22 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:56.600150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-11cbf06f-c4ed-4969-9ca5-7c5032a45862 req-532f9f65-97f8-4d52-8fd0-2f02b4f1ad22 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:56.600905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-11cbf06f-c4ed-4969-9ca5-7c5032a45862 req-532f9f65-97f8-4d52-8fd0-2f02b4f1ad22 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:56.640697 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-11cbf06f-c4ed-4969-9ca5-7c5032a45862 req-532f9f65-97f8-4d52-8fd0-2f02b4f1ad22 service nova] Creating event network-vif-deleted:367c2fce-8d92-43a8-9e5b-e46dabbe97cb for instance 8fd7d94f-f58e-4be5-8e0f-11e9f12fb93f on n-h2-860864-2 Oct 10 23:38:56.663421 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-11cbf06f-c4ed-4969-9ca5-7c5032a45862 req-532f9f65-97f8-4d52-8fd0-2f02b4f1ad22 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089910 Oct 10 23:38:56.665449 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2158/4428] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:38:57.232038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0bf6815e-50a7-497b-9edc-8fcf31a54a8f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:57.232895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0bf6815e-50a7-497b-9edc-8fcf31a54a8f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:57.245985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0bf6815e-50a7-497b-9edc-8fcf31a54a8f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:57.246482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0bf6815e-50a7-497b-9edc-8fcf31a54a8f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:57.249563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0bf6815e-50a7-497b-9edc-8fcf31a54a8f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:57.257253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0bf6815e-50a7-497b-9edc-8fcf31a54a8f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:57.257827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0bf6815e-50a7-497b-9edc-8fcf31a54a8f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:57.258278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0bf6815e-50a7-497b-9edc-8fcf31a54a8f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:57.396500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0bf6815e-50a7-497b-9edc-8fcf31a54a8f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:57.405943 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0bf6815e-50a7-497b-9edc-8fcf31a54a8f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1273 microversion: 2.1 time: 0.178695 Oct 10 23:38:57.407379 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2271/4429] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:57 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1273 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:57.444743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3e71d37d-4d66-418c-b37c-9779216e4e88 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:57.445495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3e71d37d-4d66-418c-b37c-9779216e4e88 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:57.474987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e71d37d-4d66-418c-b37c-9779216e4e88 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:57.475499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e71d37d-4d66-418c-b37c-9779216e4e88 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:57.475949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e71d37d-4d66-418c-b37c-9779216e4e88 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:57.476681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e71d37d-4d66-418c-b37c-9779216e4e88 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:57.477139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e71d37d-4d66-418c-b37c-9779216e4e88 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:57.503968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e71d37d-4d66-418c-b37c-9779216e4e88 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:57.512284 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:38:57.986906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3e71d37d-4d66-418c-b37c-9779216e4e88 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:58.005138 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3e71d37d-4d66-418c-b37c-9779216e4e88 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab" status: 200 len: 1274 microversion: 2.1 time: 0.565590 Oct 10 23:38:58.005792 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2159/4430] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:57 2022] GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab => generated 1274 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:58.434298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a27c7466-dd51-4bda-ad7e-62fc3e382e2c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:58.452040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a27c7466-dd51-4bda-ad7e-62fc3e382e2c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:58.467280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a27c7466-dd51-4bda-ad7e-62fc3e382e2c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:58.473416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a27c7466-dd51-4bda-ad7e-62fc3e382e2c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:58.477341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a27c7466-dd51-4bda-ad7e-62fc3e382e2c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:58.482532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a27c7466-dd51-4bda-ad7e-62fc3e382e2c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:58.483019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a27c7466-dd51-4bda-ad7e-62fc3e382e2c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:58.483679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a27c7466-dd51-4bda-ad7e-62fc3e382e2c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:58.763290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a27c7466-dd51-4bda-ad7e-62fc3e382e2c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:38:58.775115 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a27c7466-dd51-4bda-ad7e-62fc3e382e2c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1273 microversion: 2.1 time: 0.345227 Oct 10 23:38:58.795003 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2272/4431] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:58 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1273 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:38:59.037829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-59d14feb-6c6e-47ec-a4b3-30a428740bd5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:59.038454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-59d14feb-6c6e-47ec-a4b3-30a428740bd5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:59.056451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59d14feb-6c6e-47ec-a4b3-30a428740bd5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:59.062466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59d14feb-6c6e-47ec-a4b3-30a428740bd5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:59.063153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59d14feb-6c6e-47ec-a4b3-30a428740bd5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:59.063916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59d14feb-6c6e-47ec-a4b3-30a428740bd5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:59.064381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59d14feb-6c6e-47ec-a4b3-30a428740bd5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:59.064855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59d14feb-6c6e-47ec-a4b3-30a428740bd5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:59.402023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a56b9a4b-2e73-4d91-89b5-5eb08c755bc1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:38:59.404884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a56b9a4b-2e73-4d91-89b5-5eb08c755bc1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:59.444048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a56b9a4b-2e73-4d91-89b5-5eb08c755bc1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:59.448388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a56b9a4b-2e73-4d91-89b5-5eb08c755bc1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:59.449090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a56b9a4b-2e73-4d91-89b5-5eb08c755bc1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:59.451490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a56b9a4b-2e73-4d91-89b5-5eb08c755bc1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:59.452627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a56b9a4b-2e73-4d91-89b5-5eb08c755bc1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:59.453915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a56b9a4b-2e73-4d91-89b5-5eb08c755bc1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:59.555876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-a56b9a4b-2e73-4d91-89b5-5eb08c755bc1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lazy-loading 'flavor' on Instance uuid 0f01cc76-fa39-4e39-8e4d-e0263388c690 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:38:59.691363 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a56b9a4b-2e73-4d91-89b5-5eb08c755bc1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "POST /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690/action" status: 200 len: 32 microversion: 2.1 time: 0.295399 Oct 10 23:38:59.697963 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2273/4432] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:38:59 2022] POST /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690/action => generated 32 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:38:59.704840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d9f0870d-4532-4764-80b1-a0af5c9a7360 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:38:59.705608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d9f0870d-4532-4764-80b1-a0af5c9a7360 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:38:59.715796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9f0870d-4532-4764-80b1-a0af5c9a7360 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:59.717163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9f0870d-4532-4764-80b1-a0af5c9a7360 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:59.718246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9f0870d-4532-4764-80b1-a0af5c9a7360 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:38:59.720945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9f0870d-4532-4764-80b1-a0af5c9a7360 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:38:59.722581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9f0870d-4532-4764-80b1-a0af5c9a7360 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:38:59.723442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9f0870d-4532-4764-80b1-a0af5c9a7360 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:00.008385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-59d14feb-6c6e-47ec-a4b3-30a428740bd5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:00.023834 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-59d14feb-6c6e-47ec-a4b3-30a428740bd5 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab" status: 200 len: 1316 microversion: 2.1 time: 0.989506 Oct 10 23:39:00.026116 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2160/4433] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:59 2022] GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab => generated 1316 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:39:00.036925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4477995c-3b0a-44f7-a020-f4bbf2e65f54 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:00.038524 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4477995c-3b0a-44f7-a020-f4bbf2e65f54 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:00.056372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4477995c-3b0a-44f7-a020-f4bbf2e65f54 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:00.057707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4477995c-3b0a-44f7-a020-f4bbf2e65f54 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:00.058746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4477995c-3b0a-44f7-a020-f4bbf2e65f54 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:00.060731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4477995c-3b0a-44f7-a020-f4bbf2e65f54 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:00.061841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4477995c-3b0a-44f7-a020-f4bbf2e65f54 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:00.063069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4477995c-3b0a-44f7-a020-f4bbf2e65f54 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:00.430988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d9f0870d-4532-4764-80b1-a0af5c9a7360 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:00.443511 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d9f0870d-4532-4764-80b1-a0af5c9a7360 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1521 microversion: 2.1 time: 0.743497 Oct 10 23:39:00.444197 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2274/4434] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:38:59 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1521 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:00.925519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4477995c-3b0a-44f7-a020-f4bbf2e65f54 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:00.942613 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4477995c-3b0a-44f7-a020-f4bbf2e65f54 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1315 microversion: 2.1 time: 0.914324 Oct 10 23:39:00.943488 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2161/4435] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:00 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1315 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:01.052347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b2ede15c-a3c7-404f-9e3f-1b3f9ff68796 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:01.053768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b2ede15c-a3c7-404f-9e3f-1b3f9ff68796 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:01.064777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2ede15c-a3c7-404f-9e3f-1b3f9ff68796 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:01.066090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2ede15c-a3c7-404f-9e3f-1b3f9ff68796 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:01.066741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2ede15c-a3c7-404f-9e3f-1b3f9ff68796 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:01.067650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2ede15c-a3c7-404f-9e3f-1b3f9ff68796 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:01.068322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2ede15c-a3c7-404f-9e3f-1b3f9ff68796 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:01.068957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2ede15c-a3c7-404f-9e3f-1b3f9ff68796 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:01.400676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b2ede15c-a3c7-404f-9e3f-1b3f9ff68796 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:01.425808 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b2ede15c-a3c7-404f-9e3f-1b3f9ff68796 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab" status: 200 len: 1316 microversion: 2.1 time: 0.379474 Oct 10 23:39:01.434104 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2275/4436] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:01 2022] GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab => generated 1316 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:01.466973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2468fa1a-5772-4762-9465-4bb616ead9f9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:01.467670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2468fa1a-5772-4762-9465-4bb616ead9f9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:01.479878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2468fa1a-5772-4762-9465-4bb616ead9f9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:01.480387 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2468fa1a-5772-4762-9465-4bb616ead9f9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:01.480842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2468fa1a-5772-4762-9465-4bb616ead9f9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:01.481591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2468fa1a-5772-4762-9465-4bb616ead9f9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:01.482049 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2468fa1a-5772-4762-9465-4bb616ead9f9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:01.482475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2468fa1a-5772-4762-9465-4bb616ead9f9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:01.584231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-c6f68524-ae06-45c5-bd38-a75b99552636 req-716e20ca-d2a0-42ce-ae87-62e9db10b7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "510bed7b-8cea-4bd7-8dbd-1778adabddfd", "tag": "18c83e6f-0ffd-4682-989b-3f2f0d6af2f2"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:01.607746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c6f68524-ae06-45c5-bd38-a75b99552636 req-716e20ca-d2a0-42ce-ae87-62e9db10b7b5 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:01.608235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c6f68524-ae06-45c5-bd38-a75b99552636 req-716e20ca-d2a0-42ce-ae87-62e9db10b7b5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:01.608676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c6f68524-ae06-45c5-bd38-a75b99552636 req-716e20ca-d2a0-42ce-ae87-62e9db10b7b5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:01.633584 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-c6f68524-ae06-45c5-bd38-a75b99552636 req-716e20ca-d2a0-42ce-ae87-62e9db10b7b5 service nova] Creating event network-changed:18c83e6f-0ffd-4682-989b-3f2f0d6af2f2 for instance 510bed7b-8cea-4bd7-8dbd-1778adabddfd on n-h2-860864-2 Oct 10 23:39:01.689292 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-c6f68524-ae06-45c5-bd38-a75b99552636 req-716e20ca-d2a0-42ce-ae87-62e9db10b7b5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110151 Oct 10 23:39:01.691242 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2276/4437] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:39:01.762780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-4e8522c1-462f-4aef-9bff-f1cc812ca90b req-e78ec480-35e4-41eb-b78b-4cc1ad6d100d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af3e70e-1099-4d72-91d6-6c1e0e84d9ab", "tag": "d85999ba-e72b-443e-8fee-cf4eb695d87b"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:01.782646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4e8522c1-462f-4aef-9bff-f1cc812ca90b req-e78ec480-35e4-41eb-b78b-4cc1ad6d100d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:01.794240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4e8522c1-462f-4aef-9bff-f1cc812ca90b req-e78ec480-35e4-41eb-b78b-4cc1ad6d100d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:01.795008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4e8522c1-462f-4aef-9bff-f1cc812ca90b req-e78ec480-35e4-41eb-b78b-4cc1ad6d100d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:01.817736 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-4e8522c1-462f-4aef-9bff-f1cc812ca90b req-e78ec480-35e4-41eb-b78b-4cc1ad6d100d service nova] Creating event network-changed:d85999ba-e72b-443e-8fee-cf4eb695d87b for instance 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab on n-h1-860864-2 Oct 10 23:39:01.835304 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-4e8522c1-462f-4aef-9bff-f1cc812ca90b req-e78ec480-35e4-41eb-b78b-4cc1ad6d100d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079385 Oct 10 23:39:01.836274 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2277/4438] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:39:01.966791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-30c50231-1d19-4dc1-a62e-c4f3573932a0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:01.967631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-30c50231-1d19-4dc1-a62e-c4f3573932a0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:01.985670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30c50231-1d19-4dc1-a62e-c4f3573932a0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:01.986191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30c50231-1d19-4dc1-a62e-c4f3573932a0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:01.986656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30c50231-1d19-4dc1-a62e-c4f3573932a0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:01.987370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30c50231-1d19-4dc1-a62e-c4f3573932a0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:01.987828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30c50231-1d19-4dc1-a62e-c4f3573932a0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:01.988251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30c50231-1d19-4dc1-a62e-c4f3573932a0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:02.004329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2468fa1a-5772-4762-9465-4bb616ead9f9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:02.023147 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2468fa1a-5772-4762-9465-4bb616ead9f9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1521 microversion: 2.1 time: 0.559971 Oct 10 23:39:02.024446 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2162/4439] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:01 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1521 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:02.284484 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7b04b981-ec23-40af-830a-ec0babec8288 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:02.285365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7b04b981-ec23-40af-830a-ec0babec8288 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:02.287610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:39:02.304187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b04b981-ec23-40af-830a-ec0babec8288 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:02.305120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b04b981-ec23-40af-830a-ec0babec8288 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:02.306037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b04b981-ec23-40af-830a-ec0babec8288 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:02.306989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b04b981-ec23-40af-830a-ec0babec8288 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:02.307669 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b04b981-ec23-40af-830a-ec0babec8288 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:02.309070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b04b981-ec23-40af-830a-ec0babec8288 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:02.309789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:39:02.380645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7b04b981-ec23-40af-830a-ec0babec8288 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:39:02.476674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-30c50231-1d19-4dc1-a62e-c4f3573932a0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:02.486297 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-30c50231-1d19-4dc1-a62e-c4f3573932a0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1315 microversion: 2.1 time: 0.523890 Oct 10 23:39:02.490081 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2278/4440] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:01 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1315 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:39:02.499468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f42c814e-53cb-483e-bb7c-f7de32735a33 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:02.506444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f42c814e-53cb-483e-bb7c-f7de32735a33 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:02.513818 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7b04b981-ec23-40af-830a-ec0babec8288 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "DELETE /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 204 len: 0 microversion: 2.1 time: 0.233527 Oct 10 23:39:02.521535 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2163/4441] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:39:02 2022] DELETE /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 23:39:02.530603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f42c814e-53cb-483e-bb7c-f7de32735a33 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:02.531624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f42c814e-53cb-483e-bb7c-f7de32735a33 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:02.532259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f42c814e-53cb-483e-bb7c-f7de32735a33 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:02.535094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4daf7029-5f51-44cd-a064-64f8063566c3 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:02.536718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f42c814e-53cb-483e-bb7c-f7de32735a33 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:02.537238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f42c814e-53cb-483e-bb7c-f7de32735a33 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:02.538242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4daf7029-5f51-44cd-a064-64f8063566c3 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:02.540030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f42c814e-53cb-483e-bb7c-f7de32735a33 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:02.561226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4daf7029-5f51-44cd-a064-64f8063566c3 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:02.561680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4daf7029-5f51-44cd-a064-64f8063566c3 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:02.562818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4daf7029-5f51-44cd-a064-64f8063566c3 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:02.563951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:39:02.565119 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4daf7029-5f51-44cd-a064-64f8063566c3 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:02.565609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4daf7029-5f51-44cd-a064-64f8063566c3 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:02.566040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4daf7029-5f51-44cd-a064-64f8063566c3 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:02.769677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f42c814e-53cb-483e-bb7c-f7de32735a33 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:02.778130 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f42c814e-53cb-483e-bb7c-f7de32735a33 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab" status: 200 len: 1316 microversion: 2.1 time: 0.286645 Oct 10 23:39:02.778894 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2279/4442] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:02 2022] GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:02.881238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4daf7029-5f51-44cd-a064-64f8063566c3 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:02.900412 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4daf7029-5f51-44cd-a064-64f8063566c3 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 200 len: 1675 microversion: 2.1 time: 0.375135 Oct 10 23:39:02.902995 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2164/4443] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:02 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 1675 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:03.051800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d7a36b67-81a1-46a4-b90c-e800c156123b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:03.052777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d7a36b67-81a1-46a4-b90c-e800c156123b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:03.060546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7a36b67-81a1-46a4-b90c-e800c156123b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:03.061198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7a36b67-81a1-46a4-b90c-e800c156123b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:03.061791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7a36b67-81a1-46a4-b90c-e800c156123b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:03.062694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7a36b67-81a1-46a4-b90c-e800c156123b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:03.063332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7a36b67-81a1-46a4-b90c-e800c156123b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:03.063869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d7a36b67-81a1-46a4-b90c-e800c156123b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:03.215158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d7a36b67-81a1-46a4-b90c-e800c156123b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:03.223923 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d7a36b67-81a1-46a4-b90c-e800c156123b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1521 microversion: 2.1 time: 0.177817 Oct 10 23:39:03.225229 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2280/4444] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:03 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:03.514899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fbe5efe0-4454-4f03-a69f-7cfeab3920d2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:03.516145 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fbe5efe0-4454-4f03-a69f-7cfeab3920d2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:03.525430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbe5efe0-4454-4f03-a69f-7cfeab3920d2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:03.526175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbe5efe0-4454-4f03-a69f-7cfeab3920d2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:03.526671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbe5efe0-4454-4f03-a69f-7cfeab3920d2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:03.527370 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbe5efe0-4454-4f03-a69f-7cfeab3920d2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:03.527836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbe5efe0-4454-4f03-a69f-7cfeab3920d2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:03.528254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbe5efe0-4454-4f03-a69f-7cfeab3920d2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:03.775056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fbe5efe0-4454-4f03-a69f-7cfeab3920d2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:03.784194 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fbe5efe0-4454-4f03-a69f-7cfeab3920d2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1315 microversion: 2.1 time: 0.272994 Oct 10 23:39:03.785160 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2165/4445] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:03 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:03.808518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-709305f0-224f-4147-a830-15a1a28d98f9 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:03.809143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-709305f0-224f-4147-a830-15a1a28d98f9 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:03.812522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:39:03.826296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-709305f0-224f-4147-a830-15a1a28d98f9 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:03.827111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-709305f0-224f-4147-a830-15a1a28d98f9 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:03.827752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-709305f0-224f-4147-a830-15a1a28d98f9 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:03.829323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-709305f0-224f-4147-a830-15a1a28d98f9 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:03.830259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-709305f0-224f-4147-a830-15a1a28d98f9 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:03.830902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-709305f0-224f-4147-a830-15a1a28d98f9 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:03.874342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-b8a527bb-2dcf-4b35-9414-ca07804a8d64 req-add087c8-0cfd-4f6d-b874-4b5827000416 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b579635a-eb7c-4e99-8b52-faeba843197f", "tag": "0c8dc7fa-f8ea-47e2-bff4-fc128b9d33a5"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:03.888832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b8a527bb-2dcf-4b35-9414-ca07804a8d64 req-add087c8-0cfd-4f6d-b874-4b5827000416 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:03.889794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b8a527bb-2dcf-4b35-9414-ca07804a8d64 req-add087c8-0cfd-4f6d-b874-4b5827000416 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:03.891312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b8a527bb-2dcf-4b35-9414-ca07804a8d64 req-add087c8-0cfd-4f6d-b874-4b5827000416 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:03.904319 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-b8a527bb-2dcf-4b35-9414-ca07804a8d64 req-add087c8-0cfd-4f6d-b874-4b5827000416 service nova] Creating event network-changed:0c8dc7fa-f8ea-47e2-bff4-fc128b9d33a5 for instance b579635a-eb7c-4e99-8b52-faeba843197f on n-h2-860864-2 Oct 10 23:39:03.911406 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-b8a527bb-2dcf-4b35-9414-ca07804a8d64 req-add087c8-0cfd-4f6d-b874-4b5827000416 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041479 Oct 10 23:39:03.912914 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2166/4446] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:39:03.929479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9bcb3911-5db7-42c2-99b3-d58c781d8f9e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:03.930670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9bcb3911-5db7-42c2-99b3-d58c781d8f9e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:03.947652 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bcb3911-5db7-42c2-99b3-d58c781d8f9e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:03.948563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bcb3911-5db7-42c2-99b3-d58c781d8f9e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:03.949225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bcb3911-5db7-42c2-99b3-d58c781d8f9e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:03.950824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bcb3911-5db7-42c2-99b3-d58c781d8f9e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:03.951510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bcb3911-5db7-42c2-99b3-d58c781d8f9e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:03.952276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bcb3911-5db7-42c2-99b3-d58c781d8f9e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:04.005990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=10 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:39:04.066678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-709305f0-224f-4147-a830-15a1a28d98f9 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:04.076401 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-709305f0-224f-4147-a830-15a1a28d98f9 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab" status: 200 len: 1316 microversion: 2.1 time: 0.272652 Oct 10 23:39:04.091483 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2281/4447] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:03 2022] GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:04.247861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cbbb5dc5-7273-4854-baf1-a216b40f3c86 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:04.248629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cbbb5dc5-7273-4854-baf1-a216b40f3c86 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:04.255838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbbb5dc5-7273-4854-baf1-a216b40f3c86 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:04.256467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbbb5dc5-7273-4854-baf1-a216b40f3c86 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:04.257010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbbb5dc5-7273-4854-baf1-a216b40f3c86 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:04.257834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbbb5dc5-7273-4854-baf1-a216b40f3c86 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:04.258371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbbb5dc5-7273-4854-baf1-a216b40f3c86 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:04.258877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbbb5dc5-7273-4854-baf1-a216b40f3c86 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:04.436376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cbbb5dc5-7273-4854-baf1-a216b40f3c86 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:04.446822 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cbbb5dc5-7273-4854-baf1-a216b40f3c86 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1521 microversion: 2.1 time: 0.202765 Oct 10 23:39:04.448013 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2282/4448] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:04 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:39:04.510307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9bcb3911-5db7-42c2-99b3-d58c781d8f9e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:04.519310 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9bcb3911-5db7-42c2-99b3-d58c781d8f9e tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 200 len: 1675 microversion: 2.1 time: 0.598927 Oct 10 23:39:04.519904 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2167/4449] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:03 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 1675 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:04.808248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-068445b1-5aeb-47e5-b83f-3ade54a3752c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:04.809225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-068445b1-5aeb-47e5-b83f-3ade54a3752c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:04.816323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-068445b1-5aeb-47e5-b83f-3ade54a3752c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:04.817047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-068445b1-5aeb-47e5-b83f-3ade54a3752c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:04.817685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-068445b1-5aeb-47e5-b83f-3ade54a3752c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:04.818565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-068445b1-5aeb-47e5-b83f-3ade54a3752c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:04.820888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-068445b1-5aeb-47e5-b83f-3ade54a3752c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:04.821338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-068445b1-5aeb-47e5-b83f-3ade54a3752c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:04.962355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-068445b1-5aeb-47e5-b83f-3ade54a3752c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:04.970570 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-068445b1-5aeb-47e5-b83f-3ade54a3752c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1315 microversion: 2.1 time: 0.166274 Oct 10 23:39:04.971144 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2283/4450] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:04 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:05.101697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fca5a2bf-783b-4a2d-b6cc-733fe179afa2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:05.102455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fca5a2bf-783b-4a2d-b6cc-733fe179afa2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:05.110857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fca5a2bf-783b-4a2d-b6cc-733fe179afa2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:05.111231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fca5a2bf-783b-4a2d-b6cc-733fe179afa2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:05.111666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fca5a2bf-783b-4a2d-b6cc-733fe179afa2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:05.112359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fca5a2bf-783b-4a2d-b6cc-733fe179afa2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:05.112985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fca5a2bf-783b-4a2d-b6cc-733fe179afa2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:05.113426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fca5a2bf-783b-4a2d-b6cc-733fe179afa2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:05.345866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fca5a2bf-783b-4a2d-b6cc-733fe179afa2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:05.355108 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fca5a2bf-783b-4a2d-b6cc-733fe179afa2 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab" status: 200 len: 1316 microversion: 2.1 time: 0.257586 Oct 10 23:39:05.355894 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2168/4451] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:05 2022] GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:05.472457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1dc37316-84c4-4266-9156-c9e667f7625e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:05.473217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1dc37316-84c4-4266-9156-c9e667f7625e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:05.480567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1dc37316-84c4-4266-9156-c9e667f7625e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:05.481417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1dc37316-84c4-4266-9156-c9e667f7625e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:05.482091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1dc37316-84c4-4266-9156-c9e667f7625e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:05.482874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1dc37316-84c4-4266-9156-c9e667f7625e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:05.483542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1dc37316-84c4-4266-9156-c9e667f7625e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:05.484048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1dc37316-84c4-4266-9156-c9e667f7625e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:05.544147 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-16cb63e9-c6b5-4885-a5eb-b9c95e054a49 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:05.544782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-16cb63e9-c6b5-4885-a5eb-b9c95e054a49 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:05.552550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16cb63e9-c6b5-4885-a5eb-b9c95e054a49 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:05.553301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16cb63e9-c6b5-4885-a5eb-b9c95e054a49 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:05.553773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16cb63e9-c6b5-4885-a5eb-b9c95e054a49 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:05.555161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16cb63e9-c6b5-4885-a5eb-b9c95e054a49 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:05.555622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16cb63e9-c6b5-4885-a5eb-b9c95e054a49 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:05.556060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16cb63e9-c6b5-4885-a5eb-b9c95e054a49 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:05.701570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1dc37316-84c4-4266-9156-c9e667f7625e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:05.714215 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1dc37316-84c4-4266-9156-c9e667f7625e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1521 microversion: 2.1 time: 0.245867 Oct 10 23:39:05.715732 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2284/4452] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:05 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:05.730692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-16cb63e9-c6b5-4885-a5eb-b9c95e054a49 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:05.739925 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-16cb63e9-c6b5-4885-a5eb-b9c95e054a49 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 200 len: 1675 microversion: 2.1 time: 0.199758 Oct 10 23:39:05.740824 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2169/4453] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:05 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 1675 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:39:05.994629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4183c984-cb20-46be-8dd1-a0778d1d2dc5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:05.995248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4183c984-cb20-46be-8dd1-a0778d1d2dc5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:06.001777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4183c984-cb20-46be-8dd1-a0778d1d2dc5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:06.002271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4183c984-cb20-46be-8dd1-a0778d1d2dc5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:06.002714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4183c984-cb20-46be-8dd1-a0778d1d2dc5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:06.003409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4183c984-cb20-46be-8dd1-a0778d1d2dc5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:06.003898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4183c984-cb20-46be-8dd1-a0778d1d2dc5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:06.004329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4183c984-cb20-46be-8dd1-a0778d1d2dc5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:06.143071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4183c984-cb20-46be-8dd1-a0778d1d2dc5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:06.152598 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4183c984-cb20-46be-8dd1-a0778d1d2dc5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1315 microversion: 2.1 time: 0.161814 Oct 10 23:39:06.169521 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2285/4454] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:05 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:06.381184 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-292c58e4-117c-453a-bfd9-e17070c0cd42 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:06.381829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-292c58e4-117c-453a-bfd9-e17070c0cd42 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:06.394073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-292c58e4-117c-453a-bfd9-e17070c0cd42 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:06.394577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-292c58e4-117c-453a-bfd9-e17070c0cd42 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:06.395020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-292c58e4-117c-453a-bfd9-e17070c0cd42 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:06.395738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-292c58e4-117c-453a-bfd9-e17070c0cd42 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:06.396198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-292c58e4-117c-453a-bfd9-e17070c0cd42 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:06.396620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-292c58e4-117c-453a-bfd9-e17070c0cd42 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:06.541358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-292c58e4-117c-453a-bfd9-e17070c0cd42 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:06.552174 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-292c58e4-117c-453a-bfd9-e17070c0cd42 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab" status: 200 len: 1316 microversion: 2.1 time: 0.175138 Oct 10 23:39:06.553226 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2170/4455] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:06 2022] GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:06.741998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8016aa71-b3e2-4cd6-af51-913640cc6938 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:06.742744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8016aa71-b3e2-4cd6-af51-913640cc6938 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:06.765280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fa25bdb2-83a4-49bb-814a-fa2917e2b79d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:06.769050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fa25bdb2-83a4-49bb-814a-fa2917e2b79d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:06.780731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8016aa71-b3e2-4cd6-af51-913640cc6938 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:06.782548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8016aa71-b3e2-4cd6-af51-913640cc6938 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:06.783078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8016aa71-b3e2-4cd6-af51-913640cc6938 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:06.792932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8016aa71-b3e2-4cd6-af51-913640cc6938 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:06.793498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8016aa71-b3e2-4cd6-af51-913640cc6938 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:06.793973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8016aa71-b3e2-4cd6-af51-913640cc6938 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:06.802025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa25bdb2-83a4-49bb-814a-fa2917e2b79d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:06.802025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa25bdb2-83a4-49bb-814a-fa2917e2b79d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:06.802025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa25bdb2-83a4-49bb-814a-fa2917e2b79d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:06.806341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa25bdb2-83a4-49bb-814a-fa2917e2b79d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:06.807223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa25bdb2-83a4-49bb-814a-fa2917e2b79d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:06.808799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa25bdb2-83a4-49bb-814a-fa2917e2b79d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:06.970487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8016aa71-b3e2-4cd6-af51-913640cc6938 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:06.979807 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8016aa71-b3e2-4cd6-af51-913640cc6938 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1521 microversion: 2.1 time: 0.243661 Oct 10 23:39:06.980394 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2286/4456] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:06 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:07.176600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3e469098-f215-428a-bf90-0691b63adb41 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:07.177338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3e469098-f215-428a-bf90-0691b63adb41 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:07.185417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e469098-f215-428a-bf90-0691b63adb41 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:07.186082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e469098-f215-428a-bf90-0691b63adb41 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:07.187130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e469098-f215-428a-bf90-0691b63adb41 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:07.189219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e469098-f215-428a-bf90-0691b63adb41 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:07.190354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e469098-f215-428a-bf90-0691b63adb41 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:07.191371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e469098-f215-428a-bf90-0691b63adb41 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:07.207347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fa25bdb2-83a4-49bb-814a-fa2917e2b79d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:07.224441 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fa25bdb2-83a4-49bb-814a-fa2917e2b79d tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 200 len: 1675 microversion: 2.1 time: 0.463687 Oct 10 23:39:07.233418 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2171/4457] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:06 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 1675 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:39:07.364587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3e469098-f215-428a-bf90-0691b63adb41 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:07.373186 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3e469098-f215-428a-bf90-0691b63adb41 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1315 microversion: 2.1 time: 0.200737 Oct 10 23:39:07.373924 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2287/4458] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:07 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:39:07.575339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b03dbb68-e8ce-4818-a673-0d1ee9e942de tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:07.575965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b03dbb68-e8ce-4818-a673-0d1ee9e942de tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:07.584833 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b03dbb68-e8ce-4818-a673-0d1ee9e942de tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:07.585625 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b03dbb68-e8ce-4818-a673-0d1ee9e942de tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:07.586259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b03dbb68-e8ce-4818-a673-0d1ee9e942de tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:07.586976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b03dbb68-e8ce-4818-a673-0d1ee9e942de tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:07.587436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b03dbb68-e8ce-4818-a673-0d1ee9e942de tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:07.587869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b03dbb68-e8ce-4818-a673-0d1ee9e942de tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:07.893509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b03dbb68-e8ce-4818-a673-0d1ee9e942de tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:07.907067 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b03dbb68-e8ce-4818-a673-0d1ee9e942de tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab" status: 200 len: 1316 microversion: 2.1 time: 0.335014 Oct 10 23:39:07.907677 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2172/4459] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:07 2022] GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:39:08.005086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-56e37f11-70db-4739-ba5f-4aa3ad781be8 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:08.006394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-56e37f11-70db-4739-ba5f-4aa3ad781be8 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:08.014924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56e37f11-70db-4739-ba5f-4aa3ad781be8 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:08.016488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56e37f11-70db-4739-ba5f-4aa3ad781be8 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:08.017911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56e37f11-70db-4739-ba5f-4aa3ad781be8 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:08.019312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56e37f11-70db-4739-ba5f-4aa3ad781be8 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:08.020009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56e37f11-70db-4739-ba5f-4aa3ad781be8 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:08.021211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56e37f11-70db-4739-ba5f-4aa3ad781be8 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:08.207512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-e0afe3a2-576c-4116-89ca-625a0a64063e req-22c55ac5-0b9b-491d-8599-7efb8cc3abcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b9ff1a-05a0-46ff-8bac-2e12e7853f4f", "name": "network-vif-deleted", "tag": "b231ca15-d59d-47a6-8ac7-16f1ba7ae25d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:08.228426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e0afe3a2-576c-4116-89ca-625a0a64063e req-22c55ac5-0b9b-491d-8599-7efb8cc3abcf service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:08.228882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e0afe3a2-576c-4116-89ca-625a0a64063e req-22c55ac5-0b9b-491d-8599-7efb8cc3abcf service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:08.229333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e0afe3a2-576c-4116-89ca-625a0a64063e req-22c55ac5-0b9b-491d-8599-7efb8cc3abcf service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:08.240913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-56e37f11-70db-4739-ba5f-4aa3ad781be8 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:08.255463 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-e0afe3a2-576c-4116-89ca-625a0a64063e req-22c55ac5-0b9b-491d-8599-7efb8cc3abcf service nova] Creating event network-vif-deleted:b231ca15-d59d-47a6-8ac7-16f1ba7ae25d for instance 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f on n-h1-860864-2 Oct 10 23:39:08.260882 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-56e37f11-70db-4739-ba5f-4aa3ad781be8 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1521 microversion: 2.1 time: 0.260900 Oct 10 23:39:08.261885 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2288/4460] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:07 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:08.263913 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-e0afe3a2-576c-4116-89ca-625a0a64063e req-22c55ac5-0b9b-491d-8599-7efb8cc3abcf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060342 Oct 10 23:39:08.264732 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2173/4461] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:39:08.271792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-20a523e8-100d-47a3-8453-e6925875cdb6 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:08.272657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-20a523e8-100d-47a3-8453-e6925875cdb6 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:08.280123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-20a523e8-100d-47a3-8453-e6925875cdb6 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:08.280916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-20a523e8-100d-47a3-8453-e6925875cdb6 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:08.281846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-20a523e8-100d-47a3-8453-e6925875cdb6 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:08.283176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-20a523e8-100d-47a3-8453-e6925875cdb6 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:08.284049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-20a523e8-100d-47a3-8453-e6925875cdb6 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:08.284670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-20a523e8-100d-47a3-8453-e6925875cdb6 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:08.386796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-20a523e8-100d-47a3-8453-e6925875cdb6 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7595dc3ad9b546348a01ae0a638b110d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7030e994103a48d6bb58a2f6fd440074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:08.411770 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-20a523e8-100d-47a3-8453-e6925875cdb6 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 200 len: 1324 microversion: 2.1 time: 0.148486 Oct 10 23:39:08.418528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-31a330bb-636b-44a1-9c3c-44aa464b1e3e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:08.420701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-31a330bb-636b-44a1-9c3c-44aa464b1e3e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:08.434406 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2289/4462] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:08 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 1324 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:08.439106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31a330bb-636b-44a1-9c3c-44aa464b1e3e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:08.439829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31a330bb-636b-44a1-9c3c-44aa464b1e3e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:08.440429 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31a330bb-636b-44a1-9c3c-44aa464b1e3e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:08.441295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31a330bb-636b-44a1-9c3c-44aa464b1e3e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:08.442055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31a330bb-636b-44a1-9c3c-44aa464b1e3e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:08.442746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31a330bb-636b-44a1-9c3c-44aa464b1e3e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:08.501636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-600c0af4-c8a0-4158-b214-06a2a5c7e752 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:08.504175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-600c0af4-c8a0-4158-b214-06a2a5c7e752 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:08.529900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-600c0af4-c8a0-4158-b214-06a2a5c7e752 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:08.530740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-600c0af4-c8a0-4158-b214-06a2a5c7e752 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:08.531984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-600c0af4-c8a0-4158-b214-06a2a5c7e752 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:08.533039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-600c0af4-c8a0-4158-b214-06a2a5c7e752 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:08.533734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-600c0af4-c8a0-4158-b214-06a2a5c7e752 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:08.534393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-600c0af4-c8a0-4158-b214-06a2a5c7e752 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:08.573143 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-600c0af4-c8a0-4158-b214-06a2a5c7e752 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.077292 Oct 10 23:39:08.580796 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2290/4463] 10.222.0.23 () {60 vars in 1343 bytes} [Mon Oct 10 23:39:08 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:08.675322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2fa53634-ca03-494d-9f49-4337135da4d0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:08.675829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2fa53634-ca03-494d-9f49-4337135da4d0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:08.683662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-31a330bb-636b-44a1-9c3c-44aa464b1e3e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:08.691834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fa53634-ca03-494d-9f49-4337135da4d0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:08.692338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fa53634-ca03-494d-9f49-4337135da4d0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:08.692776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fa53634-ca03-494d-9f49-4337135da4d0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:08.693514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fa53634-ca03-494d-9f49-4337135da4d0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:08.693988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fa53634-ca03-494d-9f49-4337135da4d0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:08.694409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fa53634-ca03-494d-9f49-4337135da4d0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:08.696873 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-31a330bb-636b-44a1-9c3c-44aa464b1e3e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1315 microversion: 2.1 time: 0.298377 Oct 10 23:39:08.697603 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2174/4464] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:08 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:08.735332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2fa53634-ca03-494d-9f49-4337135da4d0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:39:08.829554 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2fa53634-ca03-494d-9f49-4337135da4d0 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "DELETE /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 204 len: 0 microversion: 2.20 time: 0.157775 Oct 10 23:39:08.833521 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2291/4465] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:39:08 2022] DELETE /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:39:08.839996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-29879a82-12b6-4766-8eb2-9226ad44117b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:08.842328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-29879a82-12b6-4766-8eb2-9226ad44117b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:08.852104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29879a82-12b6-4766-8eb2-9226ad44117b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:08.853134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29879a82-12b6-4766-8eb2-9226ad44117b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:08.854041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29879a82-12b6-4766-8eb2-9226ad44117b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:08.855216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29879a82-12b6-4766-8eb2-9226ad44117b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:08.856097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29879a82-12b6-4766-8eb2-9226ad44117b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:08.856885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29879a82-12b6-4766-8eb2-9226ad44117b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:08.876863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:39:08.932108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3dcd5668-df88-4798-89bb-ac1a9cf861e4 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:08.933154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3dcd5668-df88-4798-89bb-ac1a9cf861e4 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:08.945881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3dcd5668-df88-4798-89bb-ac1a9cf861e4 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:08.946482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3dcd5668-df88-4798-89bb-ac1a9cf861e4 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:08.946945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3dcd5668-df88-4798-89bb-ac1a9cf861e4 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:08.948439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3dcd5668-df88-4798-89bb-ac1a9cf861e4 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:08.948930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3dcd5668-df88-4798-89bb-ac1a9cf861e4 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:08.949401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3dcd5668-df88-4798-89bb-ac1a9cf861e4 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:09.079544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-29879a82-12b6-4766-8eb2-9226ad44117b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:09.088684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-29879a82-12b6-4766-8eb2-9226ad44117b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:09.090403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-29879a82-12b6-4766-8eb2-9226ad44117b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:09.091800 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-29879a82-12b6-4766-8eb2-9226ad44117b tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1725 microversion: 2.20 time: 0.256233 Oct 10 23:39:09.092947 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2175/4466] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:39:08 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1725 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:39:09.174952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3dcd5668-df88-4798-89bb-ac1a9cf861e4 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:09.186327 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3dcd5668-df88-4798-89bb-ac1a9cf861e4 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab" status: 200 len: 1316 microversion: 2.1 time: 0.258821 Oct 10 23:39:09.188533 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2292/4467] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:08 2022] GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab => generated 1316 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:39:09.234039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-6eccf9ac-d410-4d16-8c73-c13bd69082cf req-e389d168-7f23-49ff-b174-be4df8a86864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "510bed7b-8cea-4bd7-8dbd-1778adabddfd", "name": "network-vif-plugged", "status": "completed", "tag": "18c83e6f-0ffd-4682-989b-3f2f0d6af2f2"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:09.244390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6eccf9ac-d410-4d16-8c73-c13bd69082cf req-e389d168-7f23-49ff-b174-be4df8a86864 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:09.245802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6eccf9ac-d410-4d16-8c73-c13bd69082cf req-e389d168-7f23-49ff-b174-be4df8a86864 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:09.246495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6eccf9ac-d410-4d16-8c73-c13bd69082cf req-e389d168-7f23-49ff-b174-be4df8a86864 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:09.260562 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-6eccf9ac-d410-4d16-8c73-c13bd69082cf req-e389d168-7f23-49ff-b174-be4df8a86864 service nova] Creating event network-vif-plugged:18c83e6f-0ffd-4682-989b-3f2f0d6af2f2 for instance 510bed7b-8cea-4bd7-8dbd-1778adabddfd on n-h2-860864-2 Oct 10 23:39:09.265161 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-6eccf9ac-d410-4d16-8c73-c13bd69082cf req-e389d168-7f23-49ff-b174-be4df8a86864 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034739 Oct 10 23:39:09.267613 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2176/4468] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:39:09.290525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bf971960-5f4c-4c05-9af0-b826776689a7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:09.291155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bf971960-5f4c-4c05-9af0-b826776689a7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:09.298606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf971960-5f4c-4c05-9af0-b826776689a7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:09.299108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf971960-5f4c-4c05-9af0-b826776689a7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:09.299875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf971960-5f4c-4c05-9af0-b826776689a7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:09.300507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf971960-5f4c-4c05-9af0-b826776689a7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:09.301132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf971960-5f4c-4c05-9af0-b826776689a7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:09.301636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf971960-5f4c-4c05-9af0-b826776689a7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:09.445314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-71cca6b9-b6e2-4bda-8f9f-ded4d5fab9e2 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:09.446372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-71cca6b9-b6e2-4bda-8f9f-ded4d5fab9e2 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] [instance: 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:09.453895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71cca6b9-b6e2-4bda-8f9f-ded4d5fab9e2 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:09.455074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71cca6b9-b6e2-4bda-8f9f-ded4d5fab9e2 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:09.455738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71cca6b9-b6e2-4bda-8f9f-ded4d5fab9e2 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:09.456686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71cca6b9-b6e2-4bda-8f9f-ded4d5fab9e2 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:09.457428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71cca6b9-b6e2-4bda-8f9f-ded4d5fab9e2 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:09.458107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71cca6b9-b6e2-4bda-8f9f-ded4d5fab9e2 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:09.480689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bf971960-5f4c-4c05-9af0-b826776689a7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:09.494013 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bf971960-5f4c-4c05-9af0-b826776689a7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1521 microversion: 2.1 time: 0.207577 Oct 10 23:39:09.494907 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-71cca6b9-b6e2-4bda-8f9f-ded4d5fab9e2 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] HTTP exception thrown: Instance 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f could not be found. Oct 10 23:39:09.496141 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2293/4469] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:09 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-71cca6b9-b6e2-4bda-8f9f-ded4d5fab9e2 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Request method failure captured: Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f HTTP/1.1 Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKw3z-Sqpxym_jJHHXgCcJ1wVGzJaphSXe685TCJ0FMt_1f6lnXmRKSTlr_crjIVs1S0hrGbN2P0_oJIkbADzLlwVV5ASSCxTREfZ1WfxCqn6JcQ_Q2gDvqxUiZdXDuARO712AlIVZqA8BvFLLTrWvQled_51r12cH41oDLJaleX8zE Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 7030e994103a48d6bb58a2f6fd440074 Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-VolumesAdminNegativeTest-1562061530 Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7030e994103a48d6bb58a2f6fd440074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7030e994103a48d6bb58a2f6fd440074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7030e994103a48d6bb58a2f6fd440074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7030e994103a48d6bb58a2f6fd440074", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-VolumesAdminNegativeTest-1562061530 Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 7030e994103a48d6bb58a2f6fd440074 Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1562061530 Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-VolumesAdminNegativeTest-1562061530-project Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 7595dc3ad9b546348a01ae0a638b110d Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-VolumesAdminNegativeTest-1562061530-project Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f could not be found. Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '16b9ff1a-05a0-46ff-8bac-2e12e7853f4f'} Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f could not be found. Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f could not be found. Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:09.496932 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:09.504550 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:09.504550 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:09.504550 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:09.504550 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:39:09.504550 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:39:09.504550 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f could not be found. Oct 10 23:39:09.504550 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:09.504550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-71cca6b9-b6e2-4bda-8f9f-ded4d5fab9e2 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Returning 404 to user: Instance 16b9ff1a-05a0-46ff-8bac-2e12e7853f4f could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:39:09.504550 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-71cca6b9-b6e2-4bda-8f9f-ded4d5fab9e2 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f" status: 404 len: 111 microversion: 2.1 time: 0.057991 Oct 10 23:39:09.504550 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2177/4470] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:09 2022] GET /compute/v2.1/servers/16b9ff1a-05a0-46ff-8bac-2e12e7853f4f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:39:09.513764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-edaa90db-0556-42e8-861a-8c39088a3190 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] Calling method '.version_select at 0x7f6633a46820>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:09.538741 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-edaa90db-0556-42e8-861a-8c39088a3190 tempest-VolumesAdminNegativeTest-1562061530 tempest-VolumesAdminNegativeTest-1562061530-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-846854929" status: 202 len: 0 microversion: 2.1 time: 0.031242 Oct 10 23:39:09.539375 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2294/4471] 10.222.0.23 () {58 vars in 1218 bytes} [Mon Oct 10 23:39:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-846854929 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:39:09.722087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1a3dd82a-9a70-43f8-80b9-c2a2cfbeaffd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:09.723813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1a3dd82a-9a70-43f8-80b9-c2a2cfbeaffd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:09.731548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a3dd82a-9a70-43f8-80b9-c2a2cfbeaffd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:09.733487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a3dd82a-9a70-43f8-80b9-c2a2cfbeaffd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:09.735171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a3dd82a-9a70-43f8-80b9-c2a2cfbeaffd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:09.737125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a3dd82a-9a70-43f8-80b9-c2a2cfbeaffd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:09.737866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a3dd82a-9a70-43f8-80b9-c2a2cfbeaffd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:09.739036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a3dd82a-9a70-43f8-80b9-c2a2cfbeaffd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:10.018554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1a3dd82a-9a70-43f8-80b9-c2a2cfbeaffd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:10.036730 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1a3dd82a-9a70-43f8-80b9-c2a2cfbeaffd tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1315 microversion: 2.1 time: 0.320197 Oct 10 23:39:10.055836 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2178/4472] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:09 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:10.120891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-072f5a03-6ba7-4775-b2f5-97aa718f8e89 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:10.121982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-072f5a03-6ba7-4775-b2f5-97aa718f8e89 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:10.137213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-072f5a03-6ba7-4775-b2f5-97aa718f8e89 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:10.138192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-072f5a03-6ba7-4775-b2f5-97aa718f8e89 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:10.138837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-072f5a03-6ba7-4775-b2f5-97aa718f8e89 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:10.139800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-072f5a03-6ba7-4775-b2f5-97aa718f8e89 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:10.140637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-072f5a03-6ba7-4775-b2f5-97aa718f8e89 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:10.141319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-072f5a03-6ba7-4775-b2f5-97aa718f8e89 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:10.173587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:39:10.212223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6ee39e18-5bfd-4bd0-9fce-81e51f7faeb7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:10.213525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6ee39e18-5bfd-4bd0-9fce-81e51f7faeb7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:10.224258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ee39e18-5bfd-4bd0-9fce-81e51f7faeb7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:10.225944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ee39e18-5bfd-4bd0-9fce-81e51f7faeb7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:10.229916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ee39e18-5bfd-4bd0-9fce-81e51f7faeb7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:10.230938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ee39e18-5bfd-4bd0-9fce-81e51f7faeb7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:10.231641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ee39e18-5bfd-4bd0-9fce-81e51f7faeb7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:10.232338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ee39e18-5bfd-4bd0-9fce-81e51f7faeb7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:10.538534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-072f5a03-6ba7-4775-b2f5-97aa718f8e89 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:10.555837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-072f5a03-6ba7-4775-b2f5-97aa718f8e89 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:10.557305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-072f5a03-6ba7-4775-b2f5-97aa718f8e89 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:10.558608 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-072f5a03-6ba7-4775-b2f5-97aa718f8e89 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1725 microversion: 2.20 time: 0.443144 Oct 10 23:39:10.559169 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2295/4473] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:39:10 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1725 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:39:10.565590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0e4b9f80-7abe-46d4-9f0a-8ed6bda268e6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:10.565590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0e4b9f80-7abe-46d4-9f0a-8ed6bda268e6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:10.571698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e4b9f80-7abe-46d4-9f0a-8ed6bda268e6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:10.572372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e4b9f80-7abe-46d4-9f0a-8ed6bda268e6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:10.573002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e4b9f80-7abe-46d4-9f0a-8ed6bda268e6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:10.573998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e4b9f80-7abe-46d4-9f0a-8ed6bda268e6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:10.574681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e4b9f80-7abe-46d4-9f0a-8ed6bda268e6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:10.575342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e4b9f80-7abe-46d4-9f0a-8ed6bda268e6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:10.638291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6ee39e18-5bfd-4bd0-9fce-81e51f7faeb7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:10.660480 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6ee39e18-5bfd-4bd0-9fce-81e51f7faeb7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab" status: 200 len: 1316 microversion: 2.1 time: 0.452087 Oct 10 23:39:10.661119 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2179/4474] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:10 2022] GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab => generated 1316 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:39:10.779310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0e4b9f80-7abe-46d4-9f0a-8ed6bda268e6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:10.790559 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0e4b9f80-7abe-46d4-9f0a-8ed6bda268e6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1521 microversion: 2.1 time: 0.230177 Oct 10 23:39:10.791807 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2296/4475] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:10 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:11.066614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9cdfb2d8-b4a9-4d3c-a236-ce818b7016d5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:11.067340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9cdfb2d8-b4a9-4d3c-a236-ce818b7016d5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:11.087120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9cdfb2d8-b4a9-4d3c-a236-ce818b7016d5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:11.087631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9cdfb2d8-b4a9-4d3c-a236-ce818b7016d5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:11.088067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9cdfb2d8-b4a9-4d3c-a236-ce818b7016d5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:11.088795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9cdfb2d8-b4a9-4d3c-a236-ce818b7016d5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:11.089369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9cdfb2d8-b4a9-4d3c-a236-ce818b7016d5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:11.090340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9cdfb2d8-b4a9-4d3c-a236-ce818b7016d5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:11.304555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-49e84bc9-6253-43f2-9963-c5883847c68c req-831ace56-39fd-4ac4-b619-8c35d6d24978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b579635a-eb7c-4e99-8b52-faeba843197f", "name": "network-vif-plugged", "status": "completed", "tag": "0c8dc7fa-f8ea-47e2-bff4-fc128b9d33a5"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:11.316327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-49e84bc9-6253-43f2-9963-c5883847c68c req-831ace56-39fd-4ac4-b619-8c35d6d24978 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:11.316840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-49e84bc9-6253-43f2-9963-c5883847c68c req-831ace56-39fd-4ac4-b619-8c35d6d24978 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:11.317249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-49e84bc9-6253-43f2-9963-c5883847c68c req-831ace56-39fd-4ac4-b619-8c35d6d24978 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:11.341002 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-49e84bc9-6253-43f2-9963-c5883847c68c req-831ace56-39fd-4ac4-b619-8c35d6d24978 service nova] Creating event network-vif-plugged:0c8dc7fa-f8ea-47e2-bff4-fc128b9d33a5 for instance b579635a-eb7c-4e99-8b52-faeba843197f on n-h2-860864-2 Oct 10 23:39:11.355231 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-49e84bc9-6253-43f2-9963-c5883847c68c req-831ace56-39fd-4ac4-b619-8c35d6d24978 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062260 Oct 10 23:39:11.356034 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2297/4476] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:39:11.523355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9cdfb2d8-b4a9-4d3c-a236-ce818b7016d5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:11.539936 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9cdfb2d8-b4a9-4d3c-a236-ce818b7016d5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1315 microversion: 2.1 time: 0.478408 Oct 10 23:39:11.540649 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2180/4477] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:11 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:11.602906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-516945b6-ba64-427f-b934-6cafdb2477c5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:11.608172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-516945b6-ba64-427f-b934-6cafdb2477c5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:11.627207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-516945b6-ba64-427f-b934-6cafdb2477c5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:11.627917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-516945b6-ba64-427f-b934-6cafdb2477c5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:11.629461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-516945b6-ba64-427f-b934-6cafdb2477c5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:11.630398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-516945b6-ba64-427f-b934-6cafdb2477c5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:11.633357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-516945b6-ba64-427f-b934-6cafdb2477c5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:11.633999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-516945b6-ba64-427f-b934-6cafdb2477c5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:11.689584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3f617655-493f-4b2e-982f-7f69cd58c56f tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:11.690069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3f617655-493f-4b2e-982f-7f69cd58c56f tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:11.705001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f617655-493f-4b2e-982f-7f69cd58c56f tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:11.706118 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f617655-493f-4b2e-982f-7f69cd58c56f tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:11.722600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f617655-493f-4b2e-982f-7f69cd58c56f tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:11.723597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f617655-493f-4b2e-982f-7f69cd58c56f tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:11.724231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f617655-493f-4b2e-982f-7f69cd58c56f tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:11.725399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f617655-493f-4b2e-982f-7f69cd58c56f tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:11.864140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-516945b6-ba64-427f-b934-6cafdb2477c5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:11.876935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-516945b6-ba64-427f-b934-6cafdb2477c5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:11.878707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-516945b6-ba64-427f-b934-6cafdb2477c5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:11.884520 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-516945b6-ba64-427f-b934-6cafdb2477c5 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1657 microversion: 2.20 time: 0.298651 Oct 10 23:39:11.885796 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2298/4478] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:39:11 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1657 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:39:11.892987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-29e639ef-b2a0-4483-a144-f84cf37db723 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:11.894370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-29e639ef-b2a0-4483-a144-f84cf37db723 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:11.902735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29e639ef-b2a0-4483-a144-f84cf37db723 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:11.903412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29e639ef-b2a0-4483-a144-f84cf37db723 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:11.904175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29e639ef-b2a0-4483-a144-f84cf37db723 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:11.905147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29e639ef-b2a0-4483-a144-f84cf37db723 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:11.905790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29e639ef-b2a0-4483-a144-f84cf37db723 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:11.906824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29e639ef-b2a0-4483-a144-f84cf37db723 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:12.132420 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3f617655-493f-4b2e-982f-7f69cd58c56f tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:12.142376 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3f617655-493f-4b2e-982f-7f69cd58c56f tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab" status: 200 len: 1316 microversion: 2.1 time: 0.457965 Oct 10 23:39:12.142991 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2181/4479] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:11 2022] GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab => generated 1316 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:12.165346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-c29f68bf-bdc7-431c-988e-de4547b41326 req-e06bf3a7-489a-45c4-ad93-61b1f49ff745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f5c98e-777a-4d5b-aed5-89fd026f1734", "name": "network-vif-deleted", "tag": "14e55a18-a2c4-41ce-8ca8-1d0de903ab65"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:12.214983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c29f68bf-bdc7-431c-988e-de4547b41326 req-e06bf3a7-489a-45c4-ad93-61b1f49ff745 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:12.215785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c29f68bf-bdc7-431c-988e-de4547b41326 req-e06bf3a7-489a-45c4-ad93-61b1f49ff745 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:12.216631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c29f68bf-bdc7-431c-988e-de4547b41326 req-e06bf3a7-489a-45c4-ad93-61b1f49ff745 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:12.233666 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-c29f68bf-bdc7-431c-988e-de4547b41326 req-e06bf3a7-489a-45c4-ad93-61b1f49ff745 service nova] Creating event network-vif-deleted:14e55a18-a2c4-41ce-8ca8-1d0de903ab65 for instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 on n-h2-860864-2 Oct 10 23:39:12.239541 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-c29f68bf-bdc7-431c-988e-de4547b41326 req-e06bf3a7-489a-45c4-ad93-61b1f49ff745 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091378 Oct 10 23:39:12.240305 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2182/4480] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:39:12.373416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-29e639ef-b2a0-4483-a144-f84cf37db723 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:12.386847 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-29e639ef-b2a0-4483-a144-f84cf37db723 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1521 microversion: 2.1 time: 0.499681 Oct 10 23:39:12.404108 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2299/4481] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:11 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1521 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:12.569578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d566f5ae-9702-4762-a07b-6f396fb2de19 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:12.570735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d566f5ae-9702-4762-a07b-6f396fb2de19 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:12.580326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d566f5ae-9702-4762-a07b-6f396fb2de19 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:12.580981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d566f5ae-9702-4762-a07b-6f396fb2de19 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:12.581630 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d566f5ae-9702-4762-a07b-6f396fb2de19 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:12.582532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d566f5ae-9702-4762-a07b-6f396fb2de19 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:12.583151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d566f5ae-9702-4762-a07b-6f396fb2de19 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:12.583756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d566f5ae-9702-4762-a07b-6f396fb2de19 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:12.919675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-63e7e54c-58fb-4ec3-b997-f55756d25192 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:12.922128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-63e7e54c-58fb-4ec3-b997-f55756d25192 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:12.949569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63e7e54c-58fb-4ec3-b997-f55756d25192 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:12.950639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63e7e54c-58fb-4ec3-b997-f55756d25192 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:12.952552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63e7e54c-58fb-4ec3-b997-f55756d25192 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:12.954104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63e7e54c-58fb-4ec3-b997-f55756d25192 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:12.959243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63e7e54c-58fb-4ec3-b997-f55756d25192 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:12.961879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63e7e54c-58fb-4ec3-b997-f55756d25192 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:13.077122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63e7e54c-58fb-4ec3-b997-f55756d25192 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:13.078231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63e7e54c-58fb-4ec3-b997-f55756d25192 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:13.080616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63e7e54c-58fb-4ec3-b997-f55756d25192 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:13.083785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-63e7e54c-58fb-4ec3-b997-f55756d25192 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lazy-loading 'fault' on Instance uuid 81f5c98e-777a-4d5b-aed5-89fd026f1734 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:39:13.168590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-63e7e54c-58fb-4ec3-b997-f55756d25192 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:13.217781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-63e7e54c-58fb-4ec3-b997-f55756d25192 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:13.222100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-63e7e54c-58fb-4ec3-b997-f55756d25192 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8383806f776c44e781fc965eb5c425db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde1993b939b4fa0bd402a34fbdadc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:13.224726 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-63e7e54c-58fb-4ec3-b997-f55756d25192 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 200 len: 1372 microversion: 2.20 time: 0.311763 Oct 10 23:39:13.230919 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2300/4482] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:39:12 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 1372 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:39:13.243230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b9d9eb39-b384-4081-ac74-ae2c4f0a0d90 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:13.248050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b9d9eb39-b384-4081-ac74-ae2c4f0a0d90 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:13.290418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9d9eb39-b384-4081-ac74-ae2c4f0a0d90 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:13.291099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9d9eb39-b384-4081-ac74-ae2c4f0a0d90 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:13.291564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9d9eb39-b384-4081-ac74-ae2c4f0a0d90 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:13.292307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9d9eb39-b384-4081-ac74-ae2c4f0a0d90 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:13.292840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9d9eb39-b384-4081-ac74-ae2c4f0a0d90 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:13.297086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9d9eb39-b384-4081-ac74-ae2c4f0a0d90 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:13.306004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d566f5ae-9702-4762-a07b-6f396fb2de19 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:13.316946 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d566f5ae-9702-4762-a07b-6f396fb2de19 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1315 microversion: 2.1 time: 0.754133 Oct 10 23:39:13.318184 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2183/4483] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:12 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1315 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:13.412908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3e723c04-b419-4959-9a59-c1da3f4145c4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:13.413750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3e723c04-b419-4959-9a59-c1da3f4145c4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:13.423913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e723c04-b419-4959-9a59-c1da3f4145c4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:13.426781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e723c04-b419-4959-9a59-c1da3f4145c4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:13.427273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e723c04-b419-4959-9a59-c1da3f4145c4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:13.428124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e723c04-b419-4959-9a59-c1da3f4145c4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:13.428854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e723c04-b419-4959-9a59-c1da3f4145c4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:13.432981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e723c04-b419-4959-9a59-c1da3f4145c4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:13.590446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b9d9eb39-b384-4081-ac74-ae2c4f0a0d90 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:13.619197 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b9d9eb39-b384-4081-ac74-ae2c4f0a0d90 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab" status: 200 len: 1316 microversion: 2.1 time: 0.383902 Oct 10 23:39:13.620488 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2301/4484] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:13 2022] GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab => generated 1316 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:13.627672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-e48d082f-71c9-474d-a40b-f94392204220 req-6a15584c-d9c1-4072-9230-f7fcc56aee47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af3e70e-1099-4d72-91d6-6c1e0e84d9ab", "name": "network-vif-plugged", "status": "completed", "tag": "d85999ba-e72b-443e-8fee-cf4eb695d87b"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:13.651448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e48d082f-71c9-474d-a40b-f94392204220 req-6a15584c-d9c1-4072-9230-f7fcc56aee47 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:13.654819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e48d082f-71c9-474d-a40b-f94392204220 req-6a15584c-d9c1-4072-9230-f7fcc56aee47 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:13.655494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e48d082f-71c9-474d-a40b-f94392204220 req-6a15584c-d9c1-4072-9230-f7fcc56aee47 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:13.683120 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-e48d082f-71c9-474d-a40b-f94392204220 req-6a15584c-d9c1-4072-9230-f7fcc56aee47 service nova] Creating event network-vif-plugged:d85999ba-e72b-443e-8fee-cf4eb695d87b for instance 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab on n-h1-860864-2 Oct 10 23:39:13.690749 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-e48d082f-71c9-474d-a40b-f94392204220 req-6a15584c-d9c1-4072-9230-f7fcc56aee47 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068467 Oct 10 23:39:13.691654 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2302/4485] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:39:13.763587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3e723c04-b419-4959-9a59-c1da3f4145c4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:13.778769 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3e723c04-b419-4959-9a59-c1da3f4145c4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1521 microversion: 2.1 time: 0.370579 Oct 10 23:39:13.780642 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2184/4486] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:13 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:14.279506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f1b3132d-5af6-4ca4-8dec-685928164e7e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:14.282896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f1b3132d-5af6-4ca4-8dec-685928164e7e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:14.296029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1b3132d-5af6-4ca4-8dec-685928164e7e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:14.300479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1b3132d-5af6-4ca4-8dec-685928164e7e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:14.302262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1b3132d-5af6-4ca4-8dec-685928164e7e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:14.303679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1b3132d-5af6-4ca4-8dec-685928164e7e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:14.314660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1b3132d-5af6-4ca4-8dec-685928164e7e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:14.319214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1b3132d-5af6-4ca4-8dec-685928164e7e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:14.353157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-40bf702e-92cf-44ca-a094-5c7598f3562c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:14.354103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-40bf702e-92cf-44ca-a094-5c7598f3562c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:14.375231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40bf702e-92cf-44ca-a094-5c7598f3562c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:14.376389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40bf702e-92cf-44ca-a094-5c7598f3562c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:14.379808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40bf702e-92cf-44ca-a094-5c7598f3562c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:14.386332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40bf702e-92cf-44ca-a094-5c7598f3562c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:14.387852 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-f1b3132d-5af6-4ca4-8dec-685928164e7e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] HTTP exception thrown: Instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 could not be found. Oct 10 23:39:14.393191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40bf702e-92cf-44ca-a094-5c7598f3562c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:14.394265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40bf702e-92cf-44ca-a094-5c7598f3562c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f1b3132d-5af6-4ca4-8dec-685928164e7e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Request method failure captured: Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 HTTP/1.1 Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKtHddx7WnsPKFRkNmvq2bpqhJ9CbWeF40H-fRJeV_tNk0xGgU03-6jZ4MU1LnTbjoP94-WzbXoZf8XAS9noOdTxqNalj4jiFUY8-Bi-DfBoGmUdVLBd4VMK_d3rC2ACB6wqH8PphzGg3eJlM858fdwn-TUi_Kdck6pUpxPdRl-KLVQ Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: bde1993b939b4fa0bd402a34fbdadc14 Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-562796264 Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bde1993b939b4fa0bd402a34fbdadc14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bde1993b939b4fa0bd402a34fbdadc14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bde1993b939b4fa0bd402a34fbdadc14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bde1993b939b4fa0bd402a34fbdadc14", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AttachVolumeShelveTestJSON-562796264 Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: bde1993b939b4fa0bd402a34fbdadc14 Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-562796264 Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AttachVolumeShelveTestJSON-562796264-project Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 8383806f776c44e781fc965eb5c425db Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AttachVolumeShelveTestJSON-562796264-project Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 could not be found. Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '81f5c98e-777a-4d5b-aed5-89fd026f1734'} Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 could not be found. Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 could not be found. Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:14.396537 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:14.404066 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:14.404066 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:14.404066 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:14.404066 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:14.404066 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:39:14.404066 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:39:14.404066 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 could not be found. Oct 10 23:39:14.404066 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:14.411109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f1b3132d-5af6-4ca4-8dec-685928164e7e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Returning 404 to user: Instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:39:14.412833 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f1b3132d-5af6-4ca4-8dec-685928164e7e tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 404 len: 111 microversion: 2.20 time: 0.140702 Oct 10 23:39:14.417582 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2303/4487] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:39:14 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:39:14.438347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-167ac9f0-501b-4432-83b3-43d7303800aa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '.version_select at 0x7f6633a46550>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:14.535887 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-167ac9f0-501b-4432-83b3-43d7303800aa tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010653897" status: 204 len: 0 microversion: 2.20 time: 0.107538 Oct 10 23:39:14.541492 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2304/4488] 10.222.0.23 () {60 vars in 1262 bytes} [Mon Oct 10 23:39:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010653897 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:39:14.650754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-884cb990-9b78-4ef7-b40d-9758777088c9 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:14.654285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-884cb990-9b78-4ef7-b40d-9758777088c9 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:14.685085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-884cb990-9b78-4ef7-b40d-9758777088c9 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:14.686047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-884cb990-9b78-4ef7-b40d-9758777088c9 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:14.687070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-884cb990-9b78-4ef7-b40d-9758777088c9 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:14.694993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-884cb990-9b78-4ef7-b40d-9758777088c9 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:14.699010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-884cb990-9b78-4ef7-b40d-9758777088c9 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:14.700441 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-884cb990-9b78-4ef7-b40d-9758777088c9 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:14.804968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-40bf702e-92cf-44ca-a094-5c7598f3562c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:14.817264 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-40bf702e-92cf-44ca-a094-5c7598f3562c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1502 microversion: 2.1 time: 0.468789 Oct 10 23:39:14.819095 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2185/4489] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:14 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1502 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:39:14.829737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e68a0d79-9402-442a-aea2-08f745c7b305 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:14.832907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e68a0d79-9402-442a-aea2-08f745c7b305 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:14.846151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e68a0d79-9402-442a-aea2-08f745c7b305 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:14.849432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e68a0d79-9402-442a-aea2-08f745c7b305 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:14.850113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e68a0d79-9402-442a-aea2-08f745c7b305 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:14.851023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e68a0d79-9402-442a-aea2-08f745c7b305 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:14.851651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e68a0d79-9402-442a-aea2-08f745c7b305 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:14.854897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e68a0d79-9402-442a-aea2-08f745c7b305 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:15.139079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-884cb990-9b78-4ef7-b40d-9758777088c9 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:15.155620 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-884cb990-9b78-4ef7-b40d-9758777088c9 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab" status: 200 len: 1316 microversion: 2.1 time: 0.513522 Oct 10 23:39:15.171636 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2305/4490] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:14 2022] GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab => generated 1316 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:15.190892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9a8b1b5d-f1de-44e0-9d31-dd65059c88fc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:15.200927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a8b1b5d-f1de-44e0-9d31-dd65059c88fc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:15.202066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a8b1b5d-f1de-44e0-9d31-dd65059c88fc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:15.203539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a8b1b5d-f1de-44e0-9d31-dd65059c88fc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:15.250548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9a8b1b5d-f1de-44e0-9d31-dd65059c88fc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Going to try to stop instance {{(pid=120613) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 23:39:15.331879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e68a0d79-9402-442a-aea2-08f745c7b305 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:15.333929 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9a8b1b5d-f1de-44e0-9d31-dd65059c88fc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "POST /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f/action" status: 202 len: 0 microversion: 2.1 time: 0.160015 Oct 10 23:39:15.334711 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2306/4491] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:39:15 2022] POST /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:39:15.350634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f9273eab-48fc-421f-9cf8-315f00e4f366 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:15.352759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f9273eab-48fc-421f-9cf8-315f00e4f366 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:15.359691 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e68a0d79-9402-442a-aea2-08f745c7b305 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1521 microversion: 2.1 time: 0.539327 Oct 10 23:39:15.381282 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2186/4492] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:14 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1521 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:15.381513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9273eab-48fc-421f-9cf8-315f00e4f366 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:15.381513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9273eab-48fc-421f-9cf8-315f00e4f366 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:15.381735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9273eab-48fc-421f-9cf8-315f00e4f366 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:15.382870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9273eab-48fc-421f-9cf8-315f00e4f366 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:15.391693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9273eab-48fc-421f-9cf8-315f00e4f366 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:15.395333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9273eab-48fc-421f-9cf8-315f00e4f366 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:15.652866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f9273eab-48fc-421f-9cf8-315f00e4f366 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:15.671399 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f9273eab-48fc-421f-9cf8-315f00e4f366 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1512 microversion: 2.1 time: 0.330081 Oct 10 23:39:15.673294 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2307/4493] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:15 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1512 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:39:16.197171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d3fcecfb-c1f5-47ce-8fea-97e1615bcb4e tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:16.202784 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d3fcecfb-c1f5-47ce-8fea-97e1615bcb4e tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:16.227408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:39:16.238421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3fcecfb-c1f5-47ce-8fea-97e1615bcb4e tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:16.242268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3fcecfb-c1f5-47ce-8fea-97e1615bcb4e tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:16.243399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3fcecfb-c1f5-47ce-8fea-97e1615bcb4e tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:16.253369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3fcecfb-c1f5-47ce-8fea-97e1615bcb4e tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:16.254184 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3fcecfb-c1f5-47ce-8fea-97e1615bcb4e tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:16.256223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d3fcecfb-c1f5-47ce-8fea-97e1615bcb4e tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:16.392400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5016ccc9-912f-4034-9d5f-1ef925db9fb0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:16.393498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5016ccc9-912f-4034-9d5f-1ef925db9fb0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:16.407266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5016ccc9-912f-4034-9d5f-1ef925db9fb0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:16.408233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5016ccc9-912f-4034-9d5f-1ef925db9fb0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:16.409216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5016ccc9-912f-4034-9d5f-1ef925db9fb0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:16.410681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5016ccc9-912f-4034-9d5f-1ef925db9fb0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:16.411543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5016ccc9-912f-4034-9d5f-1ef925db9fb0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:16.412378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5016ccc9-912f-4034-9d5f-1ef925db9fb0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:16.485402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d3fcecfb-c1f5-47ce-8fea-97e1615bcb4e tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:16.503448 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d3fcecfb-c1f5-47ce-8fea-97e1615bcb4e tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab" status: 200 len: 1504 microversion: 2.1 time: 0.314077 Oct 10 23:39:16.522520 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2187/4494] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:16 2022] GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab => generated 1504 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:16.551770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3aef22dd-82c5-48b7-9c93-fbce2a24ea06 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:16.553318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3aef22dd-82c5-48b7-9c93-fbce2a24ea06 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 510bed7b-8cea-4bd7-8dbd-1778adabddfd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:16.565327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3aef22dd-82c5-48b7-9c93-fbce2a24ea06 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:16.566499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3aef22dd-82c5-48b7-9c93-fbce2a24ea06 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:16.567511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3aef22dd-82c5-48b7-9c93-fbce2a24ea06 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:16.569747 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3aef22dd-82c5-48b7-9c93-fbce2a24ea06 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:16.570781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3aef22dd-82c5-48b7-9c93-fbce2a24ea06 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:16.571765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3aef22dd-82c5-48b7-9c93-fbce2a24ea06 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:16.777886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3aef22dd-82c5-48b7-9c93-fbce2a24ea06 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:16.791897 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3aef22dd-82c5-48b7-9c93-fbce2a24ea06 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/510bed7b-8cea-4bd7-8dbd-1778adabddfd" status: 200 len: 1504 microversion: 2.1 time: 0.248343 Oct 10 23:39:16.792823 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2188/4495] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:16 2022] GET /compute/v2.1/servers/510bed7b-8cea-4bd7-8dbd-1778adabddfd => generated 1504 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:16.800238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5016ccc9-912f-4034-9d5f-1ef925db9fb0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:16.809032 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f342c8cb-c769-40e9-921d-7c2282bb78de tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:16.811096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f342c8cb-c769-40e9-921d-7c2282bb78de tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:16.822674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f342c8cb-c769-40e9-921d-7c2282bb78de tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:16.824899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f342c8cb-c769-40e9-921d-7c2282bb78de tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:16.832884 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5016ccc9-912f-4034-9d5f-1ef925db9fb0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1501 microversion: 2.1 time: 0.449120 Oct 10 23:39:16.834183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f342c8cb-c769-40e9-921d-7c2282bb78de tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:16.835136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f342c8cb-c769-40e9-921d-7c2282bb78de tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:16.835772 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f342c8cb-c769-40e9-921d-7c2282bb78de tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:16.836363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f342c8cb-c769-40e9-921d-7c2282bb78de tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:16.847570 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2308/4496] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:16 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1501 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:16.872214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-af2efc69-9e55-4531-aafa-9989fa472622 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:16.872879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-af2efc69-9e55-4531-aafa-9989fa472622 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 510bed7b-8cea-4bd7-8dbd-1778adabddfd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:16.895723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af2efc69-9e55-4531-aafa-9989fa472622 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:16.896382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af2efc69-9e55-4531-aafa-9989fa472622 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:16.897033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af2efc69-9e55-4531-aafa-9989fa472622 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:16.897893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af2efc69-9e55-4531-aafa-9989fa472622 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:16.898463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af2efc69-9e55-4531-aafa-9989fa472622 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:16.899022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af2efc69-9e55-4531-aafa-9989fa472622 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:16.960360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-af2efc69-9e55-4531-aafa-9989fa472622 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 510bed7b-8cea-4bd7-8dbd-1778adabddfd] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:39:17.064933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:39:17.069284 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f342c8cb-c769-40e9-921d-7c2282bb78de tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:17.091165 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f342c8cb-c769-40e9-921d-7c2282bb78de tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1512 microversion: 2.1 time: 0.295862 Oct 10 23:39:17.098983 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2189/4497] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:16 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1512 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:17.103855 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-af2efc69-9e55-4531-aafa-9989fa472622 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "DELETE /compute/v2.1/servers/510bed7b-8cea-4bd7-8dbd-1778adabddfd" status: 204 len: 0 microversion: 2.1 time: 0.253890 Oct 10 23:39:17.106702 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2309/4498] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:39:16 2022] DELETE /compute/v2.1/servers/510bed7b-8cea-4bd7-8dbd-1778adabddfd => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:39:17.108769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aa2bd57d-4601-4ff8-ba8a-79892f494fc5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e83cd934-aced-402a-a0e2-fc0e2d049621"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:17.117355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-77d7a224-86d8-418b-a636-704e06e7d834 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:17.118239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-77d7a224-86d8-418b-a636-704e06e7d834 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:17.119734 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aa2bd57d-4601-4ff8-ba8a-79892f494fc5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:17.139847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa2bd57d-4601-4ff8-ba8a-79892f494fc5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:17.143794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa2bd57d-4601-4ff8-ba8a-79892f494fc5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:17.144461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa2bd57d-4601-4ff8-ba8a-79892f494fc5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:17.146801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa2bd57d-4601-4ff8-ba8a-79892f494fc5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:17.151572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa2bd57d-4601-4ff8-ba8a-79892f494fc5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:17.153007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa2bd57d-4601-4ff8-ba8a-79892f494fc5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:17.163712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77d7a224-86d8-418b-a636-704e06e7d834 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:17.164316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77d7a224-86d8-418b-a636-704e06e7d834 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:17.172150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77d7a224-86d8-418b-a636-704e06e7d834 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:17.173210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77d7a224-86d8-418b-a636-704e06e7d834 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:17.173886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77d7a224-86d8-418b-a636-704e06e7d834 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:17.174488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77d7a224-86d8-418b-a636-704e06e7d834 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:17.219800 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-aa2bd57d-4601-4ff8-ba8a-79892f494fc5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] HTTP exception thrown: Cannot 'attach_volume' instance 0f01cc76-fa39-4e39-8e4d-e0263388c690 while it is in vm_state rescued Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aa2bd57d-4601-4ff8-ba8a-79892f494fc5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Request method failure captured: Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690/os-volume_attachments HTTP/1.1 Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 74 Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKzOYlZsv7rRo2sa7kQc2eFaI8v-TMGvuh-sVU-zvganQJF5vXcDouizKP05ne1GDSQKrDkWUQDAU6qxxYttyNZ_6Byu14LDFhfplUKI_eaTrPi0t5xENermj156ZGMg1lyNDKMrSevusXHHA-zCISDm6SLPwivXrQErNiD9Jy9X9Qs Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 8986c214fcc944acb2731cc5af19ef0c Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8986c214fcc944acb2731cc5af19ef0c", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 8986c214fcc944acb2731cc5af19ef0c Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerRescueNegativeTestJSON-906322093-project Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 585d2834c2a94c5eaa8267cf2ba58ac0 Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerRescueNegativeTestJSON-906322093-project Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: {"volumeAttachment": {"volumeId": "e83cd934-aced-402a-a0e2-fc0e2d049621"}} Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: exception: Cannot 'attach_volume' instance 0f01cc76-fa39-4e39-8e4d-e0263388c690 while it is in vm_state rescued Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'server_id': '0f01cc76-fa39-4e39-8e4d-e0263388c690', 'body': {'volumeAttachment': {'volumeId': 'e83cd934-aced-402a-a0e2-fc0e2d049621'}}} Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f01cc76-fa39-4e39-8e4d-e0263388c690 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 10 23:39:17.228670 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 23:39:17.233421 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 23:39:17.233421 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 23:39:17.233421 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0f01cc76-fa39-4e39-8e4d-e0263388c690 while it is in vm_state rescued Oct 10 23:39:17.233421 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:17.233421 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:17.233421 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:17.233421 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:17.233421 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:17.233421 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:17.233421 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:39:17.233421 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:39:17.233421 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0f01cc76-fa39-4e39-8e4d-e0263388c690 while it is in vm_state rescued Oct 10 23:39:17.233421 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:17.237155 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aa2bd57d-4601-4ff8-ba8a-79892f494fc5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Returning 409 to user: Cannot 'attach_volume' instance 0f01cc76-fa39-4e39-8e4d-e0263388c690 while it is in vm_state rescued {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:39:17.238243 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aa2bd57d-4601-4ff8-ba8a-79892f494fc5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "POST /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.142665 Oct 10 23:39:17.239306 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2190/4499] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Oct 10 23:39:17 2022] POST /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690/os-volume_attachments => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:39:17.253281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7b46360b-758e-404c-a11f-2655fd09d814 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:17.255411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7b46360b-758e-404c-a11f-2655fd09d814 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:17.267851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b46360b-758e-404c-a11f-2655fd09d814 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:17.268373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b46360b-758e-404c-a11f-2655fd09d814 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:17.268823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b46360b-758e-404c-a11f-2655fd09d814 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:17.269572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b46360b-758e-404c-a11f-2655fd09d814 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:17.270033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b46360b-758e-404c-a11f-2655fd09d814 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:17.270463 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b46360b-758e-404c-a11f-2655fd09d814 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:17.272867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-77d7a224-86d8-418b-a636-704e06e7d834 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:39:17.356365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:39:17.380027 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7b46360b-758e-404c-a11f-2655fd09d814 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "POST /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690/action" status: 202 len: 0 microversion: 2.1 time: 0.133408 Oct 10 23:39:17.381180 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2191/4500] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:39:17 2022] POST /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 23:39:17.408006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dc62f4ac-b9e4-46bd-a2e5-c92fdcbfda9e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:17.412477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dc62f4ac-b9e4-46bd-a2e5-c92fdcbfda9e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:17.460306 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-77d7a224-86d8-418b-a636-704e06e7d834 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab" status: 204 len: 0 microversion: 2.1 time: 0.346009 Oct 10 23:39:17.463172 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2310/4501] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:39:17 2022] DELETE /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:39:17.470226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc62f4ac-b9e4-46bd-a2e5-c92fdcbfda9e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:17.470732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc62f4ac-b9e4-46bd-a2e5-c92fdcbfda9e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:17.471176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc62f4ac-b9e4-46bd-a2e5-c92fdcbfda9e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:17.483031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc62f4ac-b9e4-46bd-a2e5-c92fdcbfda9e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:17.486222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc62f4ac-b9e4-46bd-a2e5-c92fdcbfda9e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:17.487041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc62f4ac-b9e4-46bd-a2e5-c92fdcbfda9e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:17.491522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4b1f7956-9f49-4e57-ba7c-b1b1880247d7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:17.492259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4b1f7956-9f49-4e57-ba7c-b1b1880247d7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 510bed7b-8cea-4bd7-8dbd-1778adabddfd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:17.507723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b1f7956-9f49-4e57-ba7c-b1b1880247d7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:17.508233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b1f7956-9f49-4e57-ba7c-b1b1880247d7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:17.508681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b1f7956-9f49-4e57-ba7c-b1b1880247d7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:17.512020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b1f7956-9f49-4e57-ba7c-b1b1880247d7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:17.517714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b1f7956-9f49-4e57-ba7c-b1b1880247d7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:17.518184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b1f7956-9f49-4e57-ba7c-b1b1880247d7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:17.775256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dc62f4ac-b9e4-46bd-a2e5-c92fdcbfda9e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:17.790538 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dc62f4ac-b9e4-46bd-a2e5-c92fdcbfda9e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1509 microversion: 2.1 time: 0.404744 Oct 10 23:39:17.791320 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2192/4502] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:17 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1509 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:17.995519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4b1f7956-9f49-4e57-ba7c-b1b1880247d7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:18.008767 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4b1f7956-9f49-4e57-ba7c-b1b1880247d7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/510bed7b-8cea-4bd7-8dbd-1778adabddfd" status: 200 len: 1510 microversion: 2.1 time: 0.541460 Oct 10 23:39:18.009924 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2311/4503] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:17 2022] GET /compute/v2.1/servers/510bed7b-8cea-4bd7-8dbd-1778adabddfd => generated 1510 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:39:18.123267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e63aa95e-3e06-4688-940c-1b2223798d84 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:18.124146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e63aa95e-3e06-4688-940c-1b2223798d84 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:18.132940 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e63aa95e-3e06-4688-940c-1b2223798d84 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:18.133709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e63aa95e-3e06-4688-940c-1b2223798d84 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:18.134419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e63aa95e-3e06-4688-940c-1b2223798d84 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:18.135741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e63aa95e-3e06-4688-940c-1b2223798d84 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:18.136327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e63aa95e-3e06-4688-940c-1b2223798d84 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:18.136766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e63aa95e-3e06-4688-940c-1b2223798d84 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:18.153686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:39:18.406702 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e63aa95e-3e06-4688-940c-1b2223798d84 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:18.415785 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e63aa95e-3e06-4688-940c-1b2223798d84 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1512 microversion: 2.1 time: 0.300607 Oct 10 23:39:18.416919 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2193/4504] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:18 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1512 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:18.815933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0fd6f63a-49bc-4459-8e1c-69ecd7bd1d05 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:18.816553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0fd6f63a-49bc-4459-8e1c-69ecd7bd1d05 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:18.833036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fd6f63a-49bc-4459-8e1c-69ecd7bd1d05 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:18.833579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fd6f63a-49bc-4459-8e1c-69ecd7bd1d05 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:18.834208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fd6f63a-49bc-4459-8e1c-69ecd7bd1d05 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:18.835108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fd6f63a-49bc-4459-8e1c-69ecd7bd1d05 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:18.835769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fd6f63a-49bc-4459-8e1c-69ecd7bd1d05 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:18.836406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0fd6f63a-49bc-4459-8e1c-69ecd7bd1d05 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:19.009814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0fd6f63a-49bc-4459-8e1c-69ecd7bd1d05 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:19.019561 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0fd6f63a-49bc-4459-8e1c-69ecd7bd1d05 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1509 microversion: 2.1 time: 0.207580 Oct 10 23:39:19.020507 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2312/4505] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:18 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1509 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:19.033044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-43c8d9fe-60ba-41e8-b607-28e9e64e9115 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:19.033905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-43c8d9fe-60ba-41e8-b607-28e9e64e9115 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 510bed7b-8cea-4bd7-8dbd-1778adabddfd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:19.047911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43c8d9fe-60ba-41e8-b607-28e9e64e9115 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:19.048418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43c8d9fe-60ba-41e8-b607-28e9e64e9115 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:19.048861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43c8d9fe-60ba-41e8-b607-28e9e64e9115 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:19.049613 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43c8d9fe-60ba-41e8-b607-28e9e64e9115 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:19.050336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43c8d9fe-60ba-41e8-b607-28e9e64e9115 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:19.050765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43c8d9fe-60ba-41e8-b607-28e9e64e9115 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:19.441355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-83c6c446-6409-4767-b43b-5bf0c48f92af tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:19.444332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-83c6c446-6409-4767-b43b-5bf0c48f92af tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:19.456517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83c6c446-6409-4767-b43b-5bf0c48f92af tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:19.457409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83c6c446-6409-4767-b43b-5bf0c48f92af tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:19.458015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83c6c446-6409-4767-b43b-5bf0c48f92af tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:19.458910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83c6c446-6409-4767-b43b-5bf0c48f92af tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:19.459570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83c6c446-6409-4767-b43b-5bf0c48f92af tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:19.460359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83c6c446-6409-4767-b43b-5bf0c48f92af tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:19.625463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-83c6c446-6409-4767-b43b-5bf0c48f92af tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:19.635906 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-83c6c446-6409-4767-b43b-5bf0c48f92af tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1512 microversion: 2.1 time: 0.199440 Oct 10 23:39:19.637269 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2313/4506] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:19 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1512 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:39:19.645935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-95a805ff-7c6a-4b42-9dc1-158feb2096b9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:19.646879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-95a805ff-7c6a-4b42-9dc1-158feb2096b9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:19.654432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95a805ff-7c6a-4b42-9dc1-158feb2096b9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:19.655104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95a805ff-7c6a-4b42-9dc1-158feb2096b9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:19.655753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95a805ff-7c6a-4b42-9dc1-158feb2096b9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:19.656936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95a805ff-7c6a-4b42-9dc1-158feb2096b9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:19.657787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95a805ff-7c6a-4b42-9dc1-158feb2096b9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:19.658707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95a805ff-7c6a-4b42-9dc1-158feb2096b9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:19.696554 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-95a805ff-7c6a-4b42-9dc1-158feb2096b9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] HTTP exception thrown: Instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 could not be found. Oct 10 23:39:19.699057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-43c8d9fe-60ba-41e8-b607-28e9e64e9115 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-95a805ff-7c6a-4b42-9dc1-158feb2096b9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Request method failure captured: Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 HTTP/1.1 Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKtHddx7WnsPKFRkNmvq2bpqhJ9CbWeF40H-fRJeV_tNk0xGgU03-6jZ4MU1LnTbjoP94-WzbXoZf8XAS9noOdTxqNalj4jiFUY8-Bi-DfBoGmUdVLBd4VMK_d3rC2ACB6wqH8PphzGg3eJlM858fdwn-TUi_Kdck6pUpxPdRl-KLVQ Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: bde1993b939b4fa0bd402a34fbdadc14 Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-562796264 Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bde1993b939b4fa0bd402a34fbdadc14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bde1993b939b4fa0bd402a34fbdadc14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bde1993b939b4fa0bd402a34fbdadc14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bde1993b939b4fa0bd402a34fbdadc14", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AttachVolumeShelveTestJSON-562796264 Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: bde1993b939b4fa0bd402a34fbdadc14 Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-562796264 Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AttachVolumeShelveTestJSON-562796264-project Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 8383806f776c44e781fc965eb5c425db Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AttachVolumeShelveTestJSON-562796264-project Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 could not be found. Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '81f5c98e-777a-4d5b-aed5-89fd026f1734'} Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 could not be found. Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:39:19.702514 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:39:19.707730 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 could not be found. Oct 10 23:39:19.707730 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:19.707730 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:19.707730 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:19.707730 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:19.707730 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:19.707730 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:19.707730 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:39:19.707730 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:39:19.707730 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 could not be found. Oct 10 23:39:19.707730 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:19.709739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-95a805ff-7c6a-4b42-9dc1-158feb2096b9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Returning 404 to user: Instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:39:19.710919 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-95a805ff-7c6a-4b42-9dc1-158feb2096b9 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "DELETE /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 404 len: 111 microversion: 2.20 time: 0.072181 Oct 10 23:39:19.711666 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2314/4507] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:39:19 2022] DELETE /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:39:19.717199 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-43c8d9fe-60ba-41e8-b607-28e9e64e9115 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/510bed7b-8cea-4bd7-8dbd-1778adabddfd" status: 200 len: 1510 microversion: 2.1 time: 0.688668 Oct 10 23:39:19.721129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a777f94a-2b75-4cf5-9b42-6ed16bd1a165 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:19.721347 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2194/4508] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:19 2022] GET /compute/v2.1/servers/510bed7b-8cea-4bd7-8dbd-1778adabddfd => generated 1510 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:19.722765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a777f94a-2b75-4cf5-9b42-6ed16bd1a165 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 81f5c98e-777a-4d5b-aed5-89fd026f1734] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:19.735218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a777f94a-2b75-4cf5-9b42-6ed16bd1a165 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:19.736147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a777f94a-2b75-4cf5-9b42-6ed16bd1a165 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:19.737051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a777f94a-2b75-4cf5-9b42-6ed16bd1a165 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:19.738470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a777f94a-2b75-4cf5-9b42-6ed16bd1a165 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:19.739169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a777f94a-2b75-4cf5-9b42-6ed16bd1a165 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:19.739817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a777f94a-2b75-4cf5-9b42-6ed16bd1a165 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:19.759119 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-a777f94a-2b75-4cf5-9b42-6ed16bd1a165 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] HTTP exception thrown: Instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 could not be found. Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a777f94a-2b75-4cf5-9b42-6ed16bd1a165 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Request method failure captured: Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 HTTP/1.1 Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKtHddx7WnsPKFRkNmvq2bpqhJ9CbWeF40H-fRJeV_tNk0xGgU03-6jZ4MU1LnTbjoP94-WzbXoZf8XAS9noOdTxqNalj4jiFUY8-Bi-DfBoGmUdVLBd4VMK_d3rC2ACB6wqH8PphzGg3eJlM858fdwn-TUi_Kdck6pUpxPdRl-KLVQ Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: bde1993b939b4fa0bd402a34fbdadc14 Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-562796264 Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bde1993b939b4fa0bd402a34fbdadc14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bde1993b939b4fa0bd402a34fbdadc14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bde1993b939b4fa0bd402a34fbdadc14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bde1993b939b4fa0bd402a34fbdadc14", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AttachVolumeShelveTestJSON-562796264 Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: bde1993b939b4fa0bd402a34fbdadc14 Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-562796264 Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AttachVolumeShelveTestJSON-562796264-project Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 8383806f776c44e781fc965eb5c425db Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AttachVolumeShelveTestJSON-562796264-project Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 could not be found. Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '81f5c98e-777a-4d5b-aed5-89fd026f1734'} Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 could not be found. Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 could not be found. Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:19.761078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:19.765859 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:19.765859 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:19.765859 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:19.765859 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:19.765859 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:39:19.765859 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:39:19.765859 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 could not be found. Oct 10 23:39:19.765859 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:19.770362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a777f94a-2b75-4cf5-9b42-6ed16bd1a165 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Returning 404 to user: Instance 81f5c98e-777a-4d5b-aed5-89fd026f1734 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:39:19.771504 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a777f94a-2b75-4cf5-9b42-6ed16bd1a165 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734" status: 404 len: 111 microversion: 2.20 time: 0.055023 Oct 10 23:39:19.772614 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2315/4509] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:39:19 2022] GET /compute/v2.1/servers/81f5c98e-777a-4d5b-aed5-89fd026f1734 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:39:20.057899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7aa1eb92-943a-4706-9bf7-7f630a67f5ef tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:20.059430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7aa1eb92-943a-4706-9bf7-7f630a67f5ef tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:20.068006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7aa1eb92-943a-4706-9bf7-7f630a67f5ef tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:20.069625 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7aa1eb92-943a-4706-9bf7-7f630a67f5ef tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:20.070249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7aa1eb92-943a-4706-9bf7-7f630a67f5ef tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:20.071366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7aa1eb92-943a-4706-9bf7-7f630a67f5ef tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:20.072149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7aa1eb92-943a-4706-9bf7-7f630a67f5ef tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:20.072932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7aa1eb92-943a-4706-9bf7-7f630a67f5ef tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:20.677043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bb4861de-5231-4b35-8d94-fb1a34188e26 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:20.677835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bb4861de-5231-4b35-8d94-fb1a34188e26 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:20.690969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb4861de-5231-4b35-8d94-fb1a34188e26 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:20.713085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb4861de-5231-4b35-8d94-fb1a34188e26 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:20.713638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb4861de-5231-4b35-8d94-fb1a34188e26 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:20.714407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb4861de-5231-4b35-8d94-fb1a34188e26 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:20.715108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb4861de-5231-4b35-8d94-fb1a34188e26 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:20.715724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb4861de-5231-4b35-8d94-fb1a34188e26 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:20.965996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bb4861de-5231-4b35-8d94-fb1a34188e26 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:20.979792 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bb4861de-5231-4b35-8d94-fb1a34188e26 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1512 microversion: 2.1 time: 0.306736 Oct 10 23:39:20.981444 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2316/4510] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:20 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1512 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:20.990145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-de58adb0-c907-4d6b-8edf-094aaae0de86 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:20.990942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-de58adb0-c907-4d6b-8edf-094aaae0de86 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 510bed7b-8cea-4bd7-8dbd-1778adabddfd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:20.998843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de58adb0-c907-4d6b-8edf-094aaae0de86 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:20.999555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de58adb0-c907-4d6b-8edf-094aaae0de86 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:21.000384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de58adb0-c907-4d6b-8edf-094aaae0de86 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:21.001858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de58adb0-c907-4d6b-8edf-094aaae0de86 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:21.003341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de58adb0-c907-4d6b-8edf-094aaae0de86 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:21.004062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de58adb0-c907-4d6b-8edf-094aaae0de86 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:21.219449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-de58adb0-c907-4d6b-8edf-094aaae0de86 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:21.239519 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-de58adb0-c907-4d6b-8edf-094aaae0de86 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/510bed7b-8cea-4bd7-8dbd-1778adabddfd" status: 200 len: 1510 microversion: 2.1 time: 0.256601 Oct 10 23:39:21.240127 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2317/4511] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:20 2022] GET /compute/v2.1/servers/510bed7b-8cea-4bd7-8dbd-1778adabddfd => generated 1510 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:21.267651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7aa1eb92-943a-4706-9bf7-7f630a67f5ef tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:21.311553 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7aa1eb92-943a-4706-9bf7-7f630a67f5ef tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1509 microversion: 2.1 time: 1.270206 Oct 10 23:39:21.314529 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2195/4512] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:20 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1509 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:22.018569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b1c738e9-31f5-4b20-bf78-185b34d053b3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:22.019444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b1c738e9-31f5-4b20-bf78-185b34d053b3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:22.042274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1c738e9-31f5-4b20-bf78-185b34d053b3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:22.045706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1c738e9-31f5-4b20-bf78-185b34d053b3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:22.046231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1c738e9-31f5-4b20-bf78-185b34d053b3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:22.047137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1c738e9-31f5-4b20-bf78-185b34d053b3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:22.047616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1c738e9-31f5-4b20-bf78-185b34d053b3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:22.048054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1c738e9-31f5-4b20-bf78-185b34d053b3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:22.208188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-dbd0b24d-f2e9-429c-a45a-b84e39d60fc1 req-2f401d99-7aef-4656-8b93-05e0831e2d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "510bed7b-8cea-4bd7-8dbd-1778adabddfd", "name": "network-vif-deleted", "tag": "18c83e6f-0ffd-4682-989b-3f2f0d6af2f2"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:22.248758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-dbd0b24d-f2e9-429c-a45a-b84e39d60fc1 req-2f401d99-7aef-4656-8b93-05e0831e2d25 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:22.258388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-dbd0b24d-f2e9-429c-a45a-b84e39d60fc1 req-2f401d99-7aef-4656-8b93-05e0831e2d25 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:22.261267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-dbd0b24d-f2e9-429c-a45a-b84e39d60fc1 req-2f401d99-7aef-4656-8b93-05e0831e2d25 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:22.302751 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-dbd0b24d-f2e9-429c-a45a-b84e39d60fc1 req-2f401d99-7aef-4656-8b93-05e0831e2d25 service nova] Creating event network-vif-deleted:18c83e6f-0ffd-4682-989b-3f2f0d6af2f2 for instance 510bed7b-8cea-4bd7-8dbd-1778adabddfd on n-h2-860864-2 Oct 10 23:39:22.350213 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-dbd0b24d-f2e9-429c-a45a-b84e39d60fc1 req-2f401d99-7aef-4656-8b93-05e0831e2d25 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145373 Oct 10 23:39:22.352136 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2196/4513] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:39:22.367189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-09f18778-9af4-413d-b054-4824d0e13b44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:22.372193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-09f18778-9af4-413d-b054-4824d0e13b44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 510bed7b-8cea-4bd7-8dbd-1778adabddfd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:22.400413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09f18778-9af4-413d-b054-4824d0e13b44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:22.413696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09f18778-9af4-413d-b054-4824d0e13b44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:22.415090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09f18778-9af4-413d-b054-4824d0e13b44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:22.416200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09f18778-9af4-413d-b054-4824d0e13b44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:22.416942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09f18778-9af4-413d-b054-4824d0e13b44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:22.418300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09f18778-9af4-413d-b054-4824d0e13b44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:22.451481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b1c738e9-31f5-4b20-bf78-185b34d053b3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:22.472672 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b1c738e9-31f5-4b20-bf78-185b34d053b3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1512 microversion: 2.1 time: 0.458437 Oct 10 23:39:22.486942 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2318/4514] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:22 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1512 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:22.504992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-35e8dae0-b059-45f9-9e3b-36fb3ec083d9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:22.505737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-35e8dae0-b059-45f9-9e3b-36fb3ec083d9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:22.527059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-35e8dae0-b059-45f9-9e3b-36fb3ec083d9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:22.529624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09f18778-9af4-413d-b054-4824d0e13b44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:22.530277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09f18778-9af4-413d-b054-4824d0e13b44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:22.530855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09f18778-9af4-413d-b054-4824d0e13b44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:22.532520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-35e8dae0-b059-45f9-9e3b-36fb3ec083d9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:22.533608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-35e8dae0-b059-45f9-9e3b-36fb3ec083d9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:22.535994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-09f18778-9af4-413d-b054-4824d0e13b44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lazy-loading 'fault' on Instance uuid 510bed7b-8cea-4bd7-8dbd-1778adabddfd {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:39:22.537342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-35e8dae0-b059-45f9-9e3b-36fb3ec083d9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:22.543078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-35e8dae0-b059-45f9-9e3b-36fb3ec083d9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:22.543758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-35e8dae0-b059-45f9-9e3b-36fb3ec083d9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:22.695371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-09f18778-9af4-413d-b054-4824d0e13b44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:22.731285 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-09f18778-9af4-413d-b054-4824d0e13b44 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/510bed7b-8cea-4bd7-8dbd-1778adabddfd" status: 200 len: 1306 microversion: 2.1 time: 0.377505 Oct 10 23:39:22.743574 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2197/4515] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:22 2022] GET /compute/v2.1/servers/510bed7b-8cea-4bd7-8dbd-1778adabddfd => generated 1306 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:22.890635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-35e8dae0-b059-45f9-9e3b-36fb3ec083d9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:22.901456 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-35e8dae0-b059-45f9-9e3b-36fb3ec083d9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1509 microversion: 2.1 time: 0.412732 Oct 10 23:39:22.902339 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2319/4516] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:22 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1509 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:23.512346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3b2ffd8f-147f-4e3b-a576-e1da9a8d5fde tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:23.517964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3b2ffd8f-147f-4e3b-a576-e1da9a8d5fde tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:23.557841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b2ffd8f-147f-4e3b-a576-e1da9a8d5fde tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:23.559280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b2ffd8f-147f-4e3b-a576-e1da9a8d5fde tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:23.564012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b2ffd8f-147f-4e3b-a576-e1da9a8d5fde tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:23.565198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b2ffd8f-147f-4e3b-a576-e1da9a8d5fde tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:23.567794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b2ffd8f-147f-4e3b-a576-e1da9a8d5fde tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:23.568762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b2ffd8f-147f-4e3b-a576-e1da9a8d5fde tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:23.766900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2befee49-7923-48d8-a534-ef805789e2c7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:23.767963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2befee49-7923-48d8-a534-ef805789e2c7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 510bed7b-8cea-4bd7-8dbd-1778adabddfd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:23.793877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2befee49-7923-48d8-a534-ef805789e2c7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:23.798187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2befee49-7923-48d8-a534-ef805789e2c7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:23.799195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2befee49-7923-48d8-a534-ef805789e2c7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:23.801727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2befee49-7923-48d8-a534-ef805789e2c7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:23.806819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2befee49-7923-48d8-a534-ef805789e2c7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:23.808164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2befee49-7923-48d8-a534-ef805789e2c7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:23.867657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3b2ffd8f-147f-4e3b-a576-e1da9a8d5fde tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:23.902563 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-2befee49-7923-48d8-a534-ef805789e2c7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] HTTP exception thrown: Instance 510bed7b-8cea-4bd7-8dbd-1778adabddfd could not be found. Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2befee49-7923-48d8-a534-ef805789e2c7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Request method failure captured: Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/510bed7b-8cea-4bd7-8dbd-1778adabddfd HTTP/1.1 Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKzzDNvxK7MAlzhWFbavwvqMLE_7tymTRUTRe9i7bbqHRRMezTYEHpIjR22MxXX2XkKXZRk1bSnZVKC0wPenUZ_aC7WyjhptMhedm2gwfz0qtWyb45dEHJ8By7DCfKoUwGPSMwj_1-Q789UFXoKf6u2xP8W823g9yqJn8KqzAUf5sys Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: d32a42ea929d4de29a9a37afc03f4b2b Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-MultipleCreateTestJSON-1259939200 Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d32a42ea929d4de29a9a37afc03f4b2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d32a42ea929d4de29a9a37afc03f4b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d32a42ea929d4de29a9a37afc03f4b2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d32a42ea929d4de29a9a37afc03f4b2b", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-MultipleCreateTestJSON-1259939200 Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: d32a42ea929d4de29a9a37afc03f4b2b Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1259939200 Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-MultipleCreateTestJSON-1259939200-project Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 2a7ffba096424668a5d3c1320056533e Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-MultipleCreateTestJSON-1259939200-project Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 510bed7b-8cea-4bd7-8dbd-1778adabddfd could not be found. Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '510bed7b-8cea-4bd7-8dbd-1778adabddfd'} Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 510bed7b-8cea-4bd7-8dbd-1778adabddfd could not be found. Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 510bed7b-8cea-4bd7-8dbd-1778adabddfd could not be found. Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:23.904298 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:23.912083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:23.912083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:23.912083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:23.912083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:39:23.912083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:39:23.912083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 510bed7b-8cea-4bd7-8dbd-1778adabddfd could not be found. Oct 10 23:39:23.912083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:23.912649 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3b2ffd8f-147f-4e3b-a576-e1da9a8d5fde tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1512 microversion: 2.1 time: 0.397782 Oct 10 23:39:23.912649 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2198/4517] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:23 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1512 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:23.913612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2befee49-7923-48d8-a534-ef805789e2c7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Returning 404 to user: Instance 510bed7b-8cea-4bd7-8dbd-1778adabddfd could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:39:23.914631 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2befee49-7923-48d8-a534-ef805789e2c7 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/510bed7b-8cea-4bd7-8dbd-1778adabddfd" status: 404 len: 111 microversion: 2.1 time: 0.151773 Oct 10 23:39:23.916255 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2320/4518] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:23 2022] GET /compute/v2.1/servers/510bed7b-8cea-4bd7-8dbd-1778adabddfd => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:39:23.929504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1a8dd07f-0218-4d4c-b380-cc4d8d26c103 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:23.933770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1a8dd07f-0218-4d4c-b380-cc4d8d26c103 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:23.957978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-845e1bf7-9cdc-4dbc-9179-c1ae53a15022 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:23.958607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-845e1bf7-9cdc-4dbc-9179-c1ae53a15022 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:23.960879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a8dd07f-0218-4d4c-b380-cc4d8d26c103 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:23.962957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a8dd07f-0218-4d4c-b380-cc4d8d26c103 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:23.964793 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a8dd07f-0218-4d4c-b380-cc4d8d26c103 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:23.969015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a8dd07f-0218-4d4c-b380-cc4d8d26c103 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:23.969914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a8dd07f-0218-4d4c-b380-cc4d8d26c103 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:23.970564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a8dd07f-0218-4d4c-b380-cc4d8d26c103 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:23.993148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-845e1bf7-9cdc-4dbc-9179-c1ae53a15022 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:23.999771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-845e1bf7-9cdc-4dbc-9179-c1ae53a15022 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:24.000568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-845e1bf7-9cdc-4dbc-9179-c1ae53a15022 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:24.002259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-845e1bf7-9cdc-4dbc-9179-c1ae53a15022 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:24.003591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-845e1bf7-9cdc-4dbc-9179-c1ae53a15022 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:24.006059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-845e1bf7-9cdc-4dbc-9179-c1ae53a15022 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:24.075801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a8dd07f-0218-4d4c-b380-cc4d8d26c103 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:24.078578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a8dd07f-0218-4d4c-b380-cc4d8d26c103 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:24.079043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a8dd07f-0218-4d4c-b380-cc4d8d26c103 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:24.079658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-1a8dd07f-0218-4d4c-b380-cc4d8d26c103 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lazy-loading 'fault' on Instance uuid 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:39:24.129521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1a8dd07f-0218-4d4c-b380-cc4d8d26c103 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7ffba096424668a5d3c1320056533e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32a42ea929d4de29a9a37afc03f4b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:24.139307 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1a8dd07f-0218-4d4c-b380-cc4d8d26c103 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab" status: 200 len: 1306 microversion: 2.1 time: 0.218150 Oct 10 23:39:24.154615 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2199/4519] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:23 2022] GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab => generated 1306 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:24.365120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-845e1bf7-9cdc-4dbc-9179-c1ae53a15022 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:24.384501 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-845e1bf7-9cdc-4dbc-9179-c1ae53a15022 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1509 microversion: 2.1 time: 0.443876 Oct 10 23:39:24.385859 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2321/4520] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:23 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1509 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:24.702453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-e2567e1f-776a-441f-a071-42073f275d1c req-66cde5b5-853c-46ab-a163-3217f0aedd76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af3e70e-1099-4d72-91d6-6c1e0e84d9ab", "name": "network-vif-deleted", "tag": "d85999ba-e72b-443e-8fee-cf4eb695d87b"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:24.720123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e2567e1f-776a-441f-a071-42073f275d1c req-66cde5b5-853c-46ab-a163-3217f0aedd76 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:24.720123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e2567e1f-776a-441f-a071-42073f275d1c req-66cde5b5-853c-46ab-a163-3217f0aedd76 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:24.720469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e2567e1f-776a-441f-a071-42073f275d1c req-66cde5b5-853c-46ab-a163-3217f0aedd76 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:24.739126 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-e2567e1f-776a-441f-a071-42073f275d1c req-66cde5b5-853c-46ab-a163-3217f0aedd76 service nova] Creating event network-vif-deleted:d85999ba-e72b-443e-8fee-cf4eb695d87b for instance 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab on n-h1-860864-2 Oct 10 23:39:24.746619 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-e2567e1f-776a-441f-a071-42073f275d1c req-66cde5b5-853c-46ab-a163-3217f0aedd76 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050891 Oct 10 23:39:24.751138 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2200/4521] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:39:24.935595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c6f723f8-ec7d-4dd2-9f8c-1e782690007f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:24.936415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c6f723f8-ec7d-4dd2-9f8c-1e782690007f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:24.960050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6f723f8-ec7d-4dd2-9f8c-1e782690007f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:24.960915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6f723f8-ec7d-4dd2-9f8c-1e782690007f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:24.963936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6f723f8-ec7d-4dd2-9f8c-1e782690007f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:24.965203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6f723f8-ec7d-4dd2-9f8c-1e782690007f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:24.965870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6f723f8-ec7d-4dd2-9f8c-1e782690007f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:24.969445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6f723f8-ec7d-4dd2-9f8c-1e782690007f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:25.178118 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4ca80172-b49f-41f9-b207-0117fb7ef6e6 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:25.183692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4ca80172-b49f-41f9-b207-0117fb7ef6e6 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] [instance: 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:25.213694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ca80172-b49f-41f9-b207-0117fb7ef6e6 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:25.214744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ca80172-b49f-41f9-b207-0117fb7ef6e6 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:25.220224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ca80172-b49f-41f9-b207-0117fb7ef6e6 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:25.221997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ca80172-b49f-41f9-b207-0117fb7ef6e6 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:25.223034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ca80172-b49f-41f9-b207-0117fb7ef6e6 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:25.223711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ca80172-b49f-41f9-b207-0117fb7ef6e6 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:25.246072 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-4ca80172-b49f-41f9-b207-0117fb7ef6e6 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] HTTP exception thrown: Instance 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab could not be found. Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4ca80172-b49f-41f9-b207-0117fb7ef6e6 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Request method failure captured: Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab HTTP/1.1 Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKzzDNvxK7MAlzhWFbavwvqMLE_7tymTRUTRe9i7bbqHRRMezTYEHpIjR22MxXX2XkKXZRk1bSnZVKC0wPenUZ_aC7WyjhptMhedm2gwfz0qtWyb45dEHJ8By7DCfKoUwGPSMwj_1-Q789UFXoKf6u2xP8W823g9yqJn8KqzAUf5sys Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: d32a42ea929d4de29a9a37afc03f4b2b Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-MultipleCreateTestJSON-1259939200 Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d32a42ea929d4de29a9a37afc03f4b2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d32a42ea929d4de29a9a37afc03f4b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d32a42ea929d4de29a9a37afc03f4b2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d32a42ea929d4de29a9a37afc03f4b2b", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-MultipleCreateTestJSON-1259939200 Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: d32a42ea929d4de29a9a37afc03f4b2b Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1259939200 Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-MultipleCreateTestJSON-1259939200-project Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 2a7ffba096424668a5d3c1320056533e Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-MultipleCreateTestJSON-1259939200-project Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab could not be found. Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '1af3e70e-1099-4d72-91d6-6c1e0e84d9ab'} Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab could not be found. Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab could not be found. Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:25.248762 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:25.255396 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:25.255396 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:25.255396 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:25.255396 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:39:25.255396 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:39:25.255396 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab could not be found. Oct 10 23:39:25.255396 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:25.257985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4ca80172-b49f-41f9-b207-0117fb7ef6e6 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] Returning 404 to user: Instance 1af3e70e-1099-4d72-91d6-6c1e0e84d9ab could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:39:25.259120 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4ca80172-b49f-41f9-b207-0117fb7ef6e6 tempest-MultipleCreateTestJSON-1259939200 tempest-MultipleCreateTestJSON-1259939200-project] 10.222.0.23 "GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab" status: 404 len: 111 microversion: 2.1 time: 0.097090 Oct 10 23:39:25.260191 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2201/4522] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:25 2022] GET /compute/v2.1/servers/1af3e70e-1099-4d72-91d6-6c1e0e84d9ab => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:39:25.274820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c6f723f8-ec7d-4dd2-9f8c-1e782690007f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:25.291139 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c6f723f8-ec7d-4dd2-9f8c-1e782690007f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1512 microversion: 2.1 time: 0.360023 Oct 10 23:39:25.291758 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2322/4523] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:24 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1512 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:25.408235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a54a4ea9-634c-44c4-a194-fd7ead0a9fae tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:25.416934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a54a4ea9-634c-44c4-a194-fd7ead0a9fae tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:25.418943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a08447a6-247d-445a-9e7e-ef7fc7139306 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:25.419574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a08447a6-247d-445a-9e7e-ef7fc7139306 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:25.445402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a08447a6-247d-445a-9e7e-ef7fc7139306 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:25.448382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a08447a6-247d-445a-9e7e-ef7fc7139306 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:25.449761 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a54a4ea9-634c-44c4-a194-fd7ead0a9fae tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:25.450277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a54a4ea9-634c-44c4-a194-fd7ead0a9fae tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:25.450723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a54a4ea9-634c-44c4-a194-fd7ead0a9fae tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:25.451033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a08447a6-247d-445a-9e7e-ef7fc7139306 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:25.451437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a54a4ea9-634c-44c4-a194-fd7ead0a9fae tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:25.451898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a54a4ea9-634c-44c4-a194-fd7ead0a9fae tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:25.452324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a54a4ea9-634c-44c4-a194-fd7ead0a9fae tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:25.456923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a08447a6-247d-445a-9e7e-ef7fc7139306 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:25.457695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a08447a6-247d-445a-9e7e-ef7fc7139306 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:25.460059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a08447a6-247d-445a-9e7e-ef7fc7139306 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:25.494976 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-a54a4ea9-634c-44c4-a194-fd7ead0a9fae tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] HTTP exception thrown: Instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 could not be found. Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a54a4ea9-634c-44c4-a194-fd7ead0a9fae tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Request method failure captured: Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 HTTP/1.1 Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKtHddx7WnsPKFRkNmvq2bpqhJ9CbWeF40H-fRJeV_tNk0xGgU03-6jZ4MU1LnTbjoP94-WzbXoZf8XAS9noOdTxqNalj4jiFUY8-Bi-DfBoGmUdVLBd4VMK_d3rC2ACB6wqH8PphzGg3eJlM858fdwn-TUi_Kdck6pUpxPdRl-KLVQ Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: bde1993b939b4fa0bd402a34fbdadc14 Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-562796264 Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bde1993b939b4fa0bd402a34fbdadc14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bde1993b939b4fa0bd402a34fbdadc14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bde1993b939b4fa0bd402a34fbdadc14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bde1993b939b4fa0bd402a34fbdadc14", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AttachVolumeShelveTestJSON-562796264 Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: bde1993b939b4fa0bd402a34fbdadc14 Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-562796264 Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AttachVolumeShelveTestJSON-562796264-project Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 8383806f776c44e781fc965eb5c425db Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AttachVolumeShelveTestJSON-562796264-project Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 could not be found. Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '3bd745fa-6826-4bd1-8f8d-ae65071fac12'} Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 could not be found. Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:39:25.500160 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:39:25.505433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 could not be found. Oct 10 23:39:25.505433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:25.505433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:25.505433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:25.505433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:25.505433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:25.505433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:25.505433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:39:25.505433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:39:25.505433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 could not be found. Oct 10 23:39:25.505433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:25.507427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a54a4ea9-634c-44c4-a194-fd7ead0a9fae tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Returning 404 to user: Instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:39:25.518026 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a54a4ea9-634c-44c4-a194-fd7ead0a9fae tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 404 len: 111 microversion: 2.20 time: 0.138988 Oct 10 23:39:25.518878 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2202/4524] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:39:25 2022] DELETE /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:39:25.528425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a7265e8b-bfe7-49b1-a832-d7bff457b4f1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:25.530275 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a7265e8b-bfe7-49b1-a832-d7bff457b4f1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] [instance: 3bd745fa-6826-4bd1-8f8d-ae65071fac12] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:25.537745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7265e8b-bfe7-49b1-a832-d7bff457b4f1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:25.538496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7265e8b-bfe7-49b1-a832-d7bff457b4f1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:25.539170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7265e8b-bfe7-49b1-a832-d7bff457b4f1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:25.540048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7265e8b-bfe7-49b1-a832-d7bff457b4f1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:25.540766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7265e8b-bfe7-49b1-a832-d7bff457b4f1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:25.541346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7265e8b-bfe7-49b1-a832-d7bff457b4f1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:25.607003 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-a7265e8b-bfe7-49b1-a832-d7bff457b4f1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] HTTP exception thrown: Instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 could not be found. Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a7265e8b-bfe7-49b1-a832-d7bff457b4f1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Request method failure captured: Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 HTTP/1.1 Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKtHddx7WnsPKFRkNmvq2bpqhJ9CbWeF40H-fRJeV_tNk0xGgU03-6jZ4MU1LnTbjoP94-WzbXoZf8XAS9noOdTxqNalj4jiFUY8-Bi-DfBoGmUdVLBd4VMK_d3rC2ACB6wqH8PphzGg3eJlM858fdwn-TUi_Kdck6pUpxPdRl-KLVQ Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: X-Openstack-Nova-Api-Version: 2.20 Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: bde1993b939b4fa0bd402a34fbdadc14 Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-562796264 Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bde1993b939b4fa0bd402a34fbdadc14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bde1993b939b4fa0bd402a34fbdadc14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bde1993b939b4fa0bd402a34fbdadc14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bde1993b939b4fa0bd402a34fbdadc14", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AttachVolumeShelveTestJSON-562796264 Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: bde1993b939b4fa0bd402a34fbdadc14 Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-562796264 Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AttachVolumeShelveTestJSON-562796264-project Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 8383806f776c44e781fc965eb5c425db Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AttachVolumeShelveTestJSON-562796264-project Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 could not be found. Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '3bd745fa-6826-4bd1-8f8d-ae65071fac12'} Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 could not be found. Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 could not be found. Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:25.611386 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:25.615865 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:25.615865 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:25.615865 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:25.615865 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:25.615865 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:39:25.615865 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:39:25.615865 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 could not be found. Oct 10 23:39:25.615865 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:25.615865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a7265e8b-bfe7-49b1-a832-d7bff457b4f1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] Returning 404 to user: Instance 3bd745fa-6826-4bd1-8f8d-ae65071fac12 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:39:25.615865 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a7265e8b-bfe7-49b1-a832-d7bff457b4f1 tempest-AttachVolumeShelveTestJSON-562796264 tempest-AttachVolumeShelveTestJSON-562796264-project] 10.222.0.23 "GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12" status: 404 len: 111 microversion: 2.20 time: 0.089843 Oct 10 23:39:25.621847 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2203/4525] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:39:25 2022] GET /compute/v2.1/servers/3bd745fa-6826-4bd1-8f8d-ae65071fac12 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 10 23:39:26.000433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a08447a6-247d-445a-9e7e-ef7fc7139306 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:26.012436 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a08447a6-247d-445a-9e7e-ef7fc7139306 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1515 microversion: 2.1 time: 0.596203 Oct 10 23:39:26.016807 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2323/4526] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:25 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1515 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:26.329566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-530da287-1540-4091-9af0-c20d361ae1b4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:26.332044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-530da287-1540-4091-9af0-c20d361ae1b4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:26.350971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-530da287-1540-4091-9af0-c20d361ae1b4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:26.352403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-530da287-1540-4091-9af0-c20d361ae1b4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:26.353511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-530da287-1540-4091-9af0-c20d361ae1b4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:26.355749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-530da287-1540-4091-9af0-c20d361ae1b4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:26.356623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-530da287-1540-4091-9af0-c20d361ae1b4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:26.357336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-530da287-1540-4091-9af0-c20d361ae1b4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:27.527116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-530da287-1540-4091-9af0-c20d361ae1b4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:27.539108 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-530da287-1540-4091-9af0-c20d361ae1b4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1512 microversion: 2.1 time: 1.222245 Oct 10 23:39:27.554038 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2204/4527] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:26 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1512 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:28.566173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6c4f0523-9760-4932-b417-0ce74208059a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:28.567074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6c4f0523-9760-4932-b417-0ce74208059a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:28.584953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c4f0523-9760-4932-b417-0ce74208059a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:28.585489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c4f0523-9760-4932-b417-0ce74208059a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:28.586073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c4f0523-9760-4932-b417-0ce74208059a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:28.586663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c4f0523-9760-4932-b417-0ce74208059a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:28.587132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c4f0523-9760-4932-b417-0ce74208059a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:28.587561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c4f0523-9760-4932-b417-0ce74208059a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:28.863023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c3d75f78-bf15-4749-8158-a35e38ca5b8d tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Action: 'create', calling method: .version_select at 0x7f662a7c8ca0>, body: {"keypair": {"name": "tempest-keypair-1692647442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm39nbanfj2OV7bUS7fYqwyIZqV8TnDggtd+r26z0Hp3doco3wrtAHCigoiZhnF9HYbMLN1+zRUMwCkfSJvVx/uq+DAgrnOjMOB1VRvyyj63+OvodRvhzzfSb1voziwdw=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:28.931977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6c4f0523-9760-4932-b417-0ce74208059a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:28.933108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-c3d75f78-bf15-4749-8158-a35e38ca5b8d tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Getting quotas for project 8986c214fcc944acb2731cc5af19ef0c. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:39:28.947442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-c3d75f78-bf15-4749-8158-a35e38ca5b8d tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Getting quotas for user 585d2834c2a94c5eaa8267cf2ba58ac0 and project 8986c214fcc944acb2731cc5af19ef0c. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:39:28.948631 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6c4f0523-9760-4932-b417-0ce74208059a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1512 microversion: 2.1 time: 0.387592 Oct 10 23:39:28.949591 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2324/4528] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:28 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1512 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:28.972235 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c3d75f78-bf15-4749-8158-a35e38ca5b8d tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.117187 Oct 10 23:39:28.983927 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2205/4529] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:39:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:39:29.993719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-68d1fbe7-6941-4b02-a382-2040854f2670 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:29.995287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-68d1fbe7-6941-4b02-a382-2040854f2670 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:30.019767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68d1fbe7-6941-4b02-a382-2040854f2670 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:30.020657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68d1fbe7-6941-4b02-a382-2040854f2670 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:30.022798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68d1fbe7-6941-4b02-a382-2040854f2670 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:30.024098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68d1fbe7-6941-4b02-a382-2040854f2670 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:30.025224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68d1fbe7-6941-4b02-a382-2040854f2670 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:30.026953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68d1fbe7-6941-4b02-a382-2040854f2670 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:30.240085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a51dad2c-894b-49ab-abaf-f8eea267ed09 tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] Calling method '.version_select at 0x7f6633a4aa60>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:30.292598 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-a51dad2c-894b-49ab-abaf-f8eea267ed09 tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] HTTP exception thrown: Image not found. Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a51dad2c-894b-49ab-abaf-f8eea267ed09 tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] Request method failure captured: Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/images/17f5c3d4-ddc4-4563-8995-4c0a80b87bbd/metadata/os_distro HTTP/1.1 Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK0xqKpV6wcOwWii7_kR-16Lc0OFxXzEzbWkHM7WnurrA9jbe4yMSPHnhMYNOR2kXf6HfJfHN5sSzaW2vlynjn3O5xkUscj-2Nv-ahpoV-g4pr1u36s-gT2flQXAWcd9cQSyO0cwFdS0-Y7YCWb6-OivMkb-S2JfaTSXFNZjdZDxCeA Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 415a2a71b2f04603879218ad9da27bd3 Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-245743243 Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/415a2a71b2f04603879218ad9da27bd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/415a2a71b2f04603879218ad9da27bd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/415a2a71b2f04603879218ad9da27bd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_415a2a71b2f04603879218ad9da27bd3", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-245743243 Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 415a2a71b2f04603879218ad9da27bd3 Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-245743243 Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesMetadataNegativeTestJSON-245743243-project Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 1adcfe6844a242f99a573c80252d814b Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-245743243-project Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: exception: Image not found. Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'image_id': '17f5c3d4-ddc4-4563-8995-4c0a80b87bbd', 'id': 'os_distro'} Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 17f5c3d4-ddc4-4563-8995-4c0a80b87bbd Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 23:39:30.306139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 17f5c3d4-ddc4-4563-8995-4c0a80b87bbd could not be found. Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a51dad2c-894b-49ab-abaf-f8eea267ed09 tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] Returning 404 to user: Image not found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a51dad2c-894b-49ab-abaf-f8eea267ed09 tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] 10.222.0.23 "DELETE /compute/v2.1/images/17f5c3d4-ddc4-4563-8995-4c0a80b87bbd/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.416331 Oct 10 23:39:30.315662 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2325/4530] 10.222.0.23 () {58 vars in 1293 bytes} [Mon Oct 10 23:39:29 2022] DELETE /compute/v2.1/images/17f5c3d4-ddc4-4563-8995-4c0a80b87bbd/metadata/os_distro => generated 62 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:39:30.329573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-984c77a6-f4c9-4da5-bd1a-0a77cf21b78b tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] Calling method '.version_select at 0x7f662add58b0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:30.358219 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-984c77a6-f4c9-4da5-bd1a-0a77cf21b78b tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] HTTP exception thrown: Image not found. Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-984c77a6-f4c9-4da5-bd1a-0a77cf21b78b tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] Request method failure captured: Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/images/8ba0de42-8d19-440a-9b3a-7561782f0c90/metadata/os_version HTTP/1.1 Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK0xqKpV6wcOwWii7_kR-16Lc0OFxXzEzbWkHM7WnurrA9jbe4yMSPHnhMYNOR2kXf6HfJfHN5sSzaW2vlynjn3O5xkUscj-2Nv-ahpoV-g4pr1u36s-gT2flQXAWcd9cQSyO0cwFdS0-Y7YCWb6-OivMkb-S2JfaTSXFNZjdZDxCeA Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 415a2a71b2f04603879218ad9da27bd3 Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-245743243 Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/415a2a71b2f04603879218ad9da27bd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/415a2a71b2f04603879218ad9da27bd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/415a2a71b2f04603879218ad9da27bd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_415a2a71b2f04603879218ad9da27bd3", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-245743243 Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 415a2a71b2f04603879218ad9da27bd3 Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-245743243 Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesMetadataNegativeTestJSON-245743243-project Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 1adcfe6844a242f99a573c80252d814b Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-245743243-project Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: exception: Image not found. Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'image_id': '8ba0de42-8d19-440a-9b3a-7561782f0c90', 'id': 'os_version'} Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8ba0de42-8d19-440a-9b3a-7561782f0c90 Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 23:39:30.359589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8ba0de42-8d19-440a-9b3a-7561782f0c90 could not be found. Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 23:39:30.364148 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.367544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-984c77a6-f4c9-4da5-bd1a-0a77cf21b78b tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] Returning 404 to user: Image not found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:39:30.369611 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-984c77a6-f4c9-4da5-bd1a-0a77cf21b78b tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] 10.222.0.23 "GET /compute/v2.1/images/8ba0de42-8d19-440a-9b3a-7561782f0c90/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.052201 Oct 10 23:39:30.370712 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2326/4531] 10.222.0.23 () {58 vars in 1293 bytes} [Mon Oct 10 23:39:30 2022] GET /compute/v2.1/images/8ba0de42-8d19-440a-9b3a-7561782f0c90/metadata/os_version => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:39:30.382019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2ab88345-2c95-4c01-b579-987b3243252b tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] Calling method '.version_select at 0x7f6633a45d30>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:30.421992 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-2ab88345-2c95-4c01-b579-987b3243252b tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] HTTP exception thrown: Image not found. Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2ab88345-2c95-4c01-b579-987b3243252b tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] Request method failure captured: Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/images/1d88e988-7fe5-4f65-847c-bf7c7aee653c/metadata HTTP/1.1 Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK0xqKpV6wcOwWii7_kR-16Lc0OFxXzEzbWkHM7WnurrA9jbe4yMSPHnhMYNOR2kXf6HfJfHN5sSzaW2vlynjn3O5xkUscj-2Nv-ahpoV-g4pr1u36s-gT2flQXAWcd9cQSyO0cwFdS0-Y7YCWb6-OivMkb-S2JfaTSXFNZjdZDxCeA Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 415a2a71b2f04603879218ad9da27bd3 Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-245743243 Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/415a2a71b2f04603879218ad9da27bd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/415a2a71b2f04603879218ad9da27bd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/415a2a71b2f04603879218ad9da27bd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_415a2a71b2f04603879218ad9da27bd3", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-245743243 Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 415a2a71b2f04603879218ad9da27bd3 Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-245743243 Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesMetadataNegativeTestJSON-245743243-project Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 1adcfe6844a242f99a573c80252d814b Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-245743243-project Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: exception: Image not found. Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'image_id': '1d88e988-7fe5-4f65-847c-bf7c7aee653c'} Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1d88e988-7fe5-4f65-847c-bf7c7aee653c Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 23:39:30.424770 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1d88e988-7fe5-4f65-847c-bf7c7aee653c could not be found. Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 23:39:30.429016 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.438583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2ab88345-2c95-4c01-b579-987b3243252b tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] Returning 404 to user: Image not found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:39:30.439859 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2ab88345-2c95-4c01-b579-987b3243252b tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] 10.222.0.23 "GET /compute/v2.1/images/1d88e988-7fe5-4f65-847c-bf7c7aee653c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.062477 Oct 10 23:39:30.441051 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2327/4532] 10.222.0.23 () {58 vars in 1260 bytes} [Mon Oct 10 23:39:30 2022] GET /compute/v2.1/images/1d88e988-7fe5-4f65-847c-bf7c7aee653c/metadata => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:39:30.453206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-770370f7-ba9c-44db-b99d-8e21f5e2fbe5 tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] Action: 'update_all', calling method: .version_select at 0x7f6633a4a160>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:30.482862 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-770370f7-ba9c-44db-b99d-8e21f5e2fbe5 tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] HTTP exception thrown: Image not found. Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-770370f7-ba9c-44db-b99d-8e21f5e2fbe5 tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] Request method failure captured: Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: request: PUT /compute/v2.1/images/d3e52295-1018-47b9-ac64-3e3daa5f146e/metadata HTTP/1.1 Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 57 Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK0xqKpV6wcOwWii7_kR-16Lc0OFxXzEzbWkHM7WnurrA9jbe4yMSPHnhMYNOR2kXf6HfJfHN5sSzaW2vlynjn3O5xkUscj-2Nv-ahpoV-g4pr1u36s-gT2flQXAWcd9cQSyO0cwFdS0-Y7YCWb6-OivMkb-S2JfaTSXFNZjdZDxCeA Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 415a2a71b2f04603879218ad9da27bd3 Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-245743243 Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/415a2a71b2f04603879218ad9da27bd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/415a2a71b2f04603879218ad9da27bd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/415a2a71b2f04603879218ad9da27bd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_415a2a71b2f04603879218ad9da27bd3", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-245743243 Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 415a2a71b2f04603879218ad9da27bd3 Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-245743243 Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesMetadataNegativeTestJSON-245743243-project Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 1adcfe6844a242f99a573c80252d814b Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-245743243-project Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: exception: Image not found. Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'image_id': 'd3e52295-1018-47b9-ac64-3e3daa5f146e', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d3e52295-1018-47b9-ac64-3e3daa5f146e Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 23:39:30.485396 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d3e52295-1018-47b9-ac64-3e3daa5f146e could not be found. Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 23:39:30.490487 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.496490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-770370f7-ba9c-44db-b99d-8e21f5e2fbe5 tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] Returning 404 to user: Image not found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:39:30.496625 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-770370f7-ba9c-44db-b99d-8e21f5e2fbe5 tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] 10.222.0.23 "PUT /compute/v2.1/images/d3e52295-1018-47b9-ac64-3e3daa5f146e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.049788 Oct 10 23:39:30.497363 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2328/4533] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:39:30 2022] PUT /compute/v2.1/images/d3e52295-1018-47b9-ac64-3e3daa5f146e/metadata => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:39:30.510381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-88af8302-e58f-4774-a829-4bcc2ba8667a tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] Action: 'update', calling method: .version_select at 0x7f6633982160>, body: {"meta": {"os_distro": "alt"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:30.519816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-68d1fbe7-6941-4b02-a382-2040854f2670 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:30.547353 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-68d1fbe7-6941-4b02-a382-2040854f2670 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1512 microversion: 2.1 time: 0.559232 Oct 10 23:39:30.557265 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-88af8302-e58f-4774-a829-4bcc2ba8667a tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] HTTP exception thrown: Image not found. Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-88af8302-e58f-4774-a829-4bcc2ba8667a tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] Request method failure captured: Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: request: PUT /compute/v2.1/images/14bb6463-711b-4a80-b3ec-4b003f55579a/metadata/os_distro HTTP/1.1 Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 30 Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK0xqKpV6wcOwWii7_kR-16Lc0OFxXzEzbWkHM7WnurrA9jbe4yMSPHnhMYNOR2kXf6HfJfHN5sSzaW2vlynjn3O5xkUscj-2Nv-ahpoV-g4pr1u36s-gT2flQXAWcd9cQSyO0cwFdS0-Y7YCWb6-OivMkb-S2JfaTSXFNZjdZDxCeA Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 415a2a71b2f04603879218ad9da27bd3 Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-245743243 Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/415a2a71b2f04603879218ad9da27bd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/415a2a71b2f04603879218ad9da27bd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/415a2a71b2f04603879218ad9da27bd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_415a2a71b2f04603879218ad9da27bd3", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-245743243 Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 415a2a71b2f04603879218ad9da27bd3 Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-245743243 Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ImagesMetadataNegativeTestJSON-245743243-project Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 1adcfe6844a242f99a573c80252d814b Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-245743243-project Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: {"meta": {"os_distro": "alt"}} Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: exception: Image not found. Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'image_id': '14bb6463-711b-4a80-b3ec-4b003f55579a', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 14bb6463-711b-4a80-b3ec-4b003f55579a Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 23:39:30.561721 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 14bb6463-711b-4a80-b3ec-4b003f55579a could not be found. Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 23:39:30.566221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.575125 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2206/4534] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:29 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1512 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:30.577470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-88af8302-e58f-4774-a829-4bcc2ba8667a tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] Returning 404 to user: Image not found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:39:30.579849 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-88af8302-e58f-4774-a829-4bcc2ba8667a tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] 10.222.0.23 "PUT /compute/v2.1/images/14bb6463-711b-4a80-b3ec-4b003f55579a/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.075781 Oct 10 23:39:30.591656 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2329/4535] 10.222.0.23 () {60 vars in 1310 bytes} [Mon Oct 10 23:39:30 2022] PUT /compute/v2.1/images/14bb6463-711b-4a80-b3ec-4b003f55579a/metadata/os_distro => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:39:30.593735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0890fe02-6443-4c35-a898-f96a9a4e0ac5 tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] Action: 'create', calling method: .version_select at 0x7f662a3af670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:30.631656 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-0890fe02-6443-4c35-a898-f96a9a4e0ac5 tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] HTTP exception thrown: Image not found. Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0890fe02-6443-4c35-a898-f96a9a4e0ac5 tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] Request method failure captured: Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/images/8cbd7b65-afa5-40bf-bef5-0ce40807a3e7/metadata HTTP/1.1 Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 57 Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK0xqKpV6wcOwWii7_kR-16Lc0OFxXzEzbWkHM7WnurrA9jbe4yMSPHnhMYNOR2kXf6HfJfHN5sSzaW2vlynjn3O5xkUscj-2Nv-ahpoV-g4pr1u36s-gT2flQXAWcd9cQSyO0cwFdS0-Y7YCWb6-OivMkb-S2JfaTSXFNZjdZDxCeA Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 415a2a71b2f04603879218ad9da27bd3 Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-245743243 Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/415a2a71b2f04603879218ad9da27bd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/415a2a71b2f04603879218ad9da27bd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/415a2a71b2f04603879218ad9da27bd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_415a2a71b2f04603879218ad9da27bd3", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-245743243 Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 415a2a71b2f04603879218ad9da27bd3 Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-245743243 Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ImagesMetadataNegativeTestJSON-245743243-project Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 1adcfe6844a242f99a573c80252d814b Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-245743243-project Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: exception: Image not found. Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'image_id': '8cbd7b65-afa5-40bf-bef5-0ce40807a3e7', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8cbd7b65-afa5-40bf-bef5-0ce40807a3e7 Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 23:39:30.634459 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8cbd7b65-afa5-40bf-bef5-0ce40807a3e7 could not be found. Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 23:39:30.640873 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:30.648654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0890fe02-6443-4c35-a898-f96a9a4e0ac5 tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] Returning 404 to user: Image not found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:39:30.650421 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0890fe02-6443-4c35-a898-f96a9a4e0ac5 tempest-ImagesMetadataNegativeTestJSON-245743243 tempest-ImagesMetadataNegativeTestJSON-245743243-project] 10.222.0.23 "POST /compute/v2.1/images/8cbd7b65-afa5-40bf-bef5-0ce40807a3e7/metadata" status: 404 len: 62 microversion: 2.1 time: 0.062085 Oct 10 23:39:30.656078 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2207/4536] 10.222.0.23 () {60 vars in 1281 bytes} [Mon Oct 10 23:39:30 2022] POST /compute/v2.1/images/8cbd7b65-afa5-40bf-bef5-0ce40807a3e7/metadata => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:39:31.601601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-41ec0674-f6bf-4b50-b9a7-4431d18bf67a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:31.602367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-41ec0674-f6bf-4b50-b9a7-4431d18bf67a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:31.626610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41ec0674-f6bf-4b50-b9a7-4431d18bf67a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:31.630810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41ec0674-f6bf-4b50-b9a7-4431d18bf67a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:31.636377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41ec0674-f6bf-4b50-b9a7-4431d18bf67a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:31.637674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41ec0674-f6bf-4b50-b9a7-4431d18bf67a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:31.641471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41ec0674-f6bf-4b50-b9a7-4431d18bf67a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:31.641977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41ec0674-f6bf-4b50-b9a7-4431d18bf67a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:32.567789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-41ec0674-f6bf-4b50-b9a7-4431d18bf67a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:32.583835 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-41ec0674-f6bf-4b50-b9a7-4431d18bf67a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1512 microversion: 2.1 time: 0.990025 Oct 10 23:39:32.584517 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2330/4537] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:31 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1512 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:33.227328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-260b068b-72fc-4dc5-af61-0d38c826c549 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1832100979", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc12d571-0c0a-4079-aba6-42ef73a68903"}], "security_groups": [{"name": "tempest-securitygroup--1901767416"}], "key_name": "tempest-keypair-1692647442", "user_data": "}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:33.445127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-260b068b-72fc-4dc5-af61-0d38c826c549 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] validate_networks() for [('dc12d571-0c0a-4079-aba6-42ef73a68903', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:39:33.565124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f62d8fe0-b8ae-4a39-82b0-3d153352d8e3 tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Action: 'create', calling method: .version_select at 0x7f6633983ca0>, body: {"keypair": {"name": "tempest-keypair-1157619060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi/DLB7DYHEiqlumkCwL+7Yd82YgmkiT3QXtB9dL8baIKY3jM5v5jhtnwHXuQoxs5QMbs/dM6XfMNmofOmfTNQ6qp1i1KWd+53djFA2IypzbQRsMrlKKxy1/5PXjAoHxQ=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:33.637587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-f62d8fe0-b8ae-4a39-82b0-3d153352d8e3 tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Getting quotas for project 6a64eada593d4a00b0ed038b1a318821. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:39:33.651916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-f62d8fe0-b8ae-4a39-82b0-3d153352d8e3 tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Getting quotas for user c0b4926875534cb58b92dfb97c0824b2 and project 6a64eada593d4a00b0ed038b1a318821. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:39:33.688113 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f62d8fe0-b8ae-4a39-82b0-3d153352d8e3 tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.353958 Oct 10 23:39:33.691341 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2331/4538] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:39:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:39:33.697702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3337b421-4ec2-46d2-b5d8-be65dbf0ad8b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:33.698676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3337b421-4ec2-46d2-b5d8-be65dbf0ad8b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:33.710449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3337b421-4ec2-46d2-b5d8-be65dbf0ad8b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:33.711958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3337b421-4ec2-46d2-b5d8-be65dbf0ad8b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:33.712817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3337b421-4ec2-46d2-b5d8-be65dbf0ad8b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:33.714674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3337b421-4ec2-46d2-b5d8-be65dbf0ad8b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:33.715395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3337b421-4ec2-46d2-b5d8-be65dbf0ad8b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:33.716059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3337b421-4ec2-46d2-b5d8-be65dbf0ad8b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:34.151193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3337b421-4ec2-46d2-b5d8-be65dbf0ad8b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:34.173894 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3337b421-4ec2-46d2-b5d8-be65dbf0ad8b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1512 microversion: 2.1 time: 0.480067 Oct 10 23:39:34.175419 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2332/4539] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:33 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1512 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:34.180873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b4946aac-b20e-44a3-a0c1-ddd7c3f9f9fd tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Calling method '.version_select at 0x7f6633a54a60>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:34.202384 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b4946aac-b20e-44a3-a0c1-ddd7c3f9f9fd tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1157619060" status: 200 len: 498 microversion: 2.1 time: 0.016591 Oct 10 23:39:34.214753 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2333/4540] 10.222.0.23 () {58 vars in 1218 bytes} [Mon Oct 10 23:39:34 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1157619060 => generated 498 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:39:34.223579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ee729b84-8fd7-4d33-b424-227de8e9ae28 tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Calling method '.version_select at 0x7f6633a4ab80>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:34.253523 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ee729b84-8fd7-4d33-b424-227de8e9ae28 tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1157619060" status: 202 len: 0 microversion: 2.1 time: 0.037075 Oct 10 23:39:34.254462 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2334/4541] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 10 23:39:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1157619060 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:39:34.286945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f14a323a-6216-4e04-b861-34b6bc77ea93 tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Action: 'create', calling method: .version_select at 0x7f6633a69dc0>, body: {"keypair": {"name": "tempest-keypair-1586129837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUxQWGTecXu+uTwYVARx64InNSwyDL/0Artw8X6uQMxwIUzx9nzgKENyccBUoaFgh93TsyelZCPJzyu+ZGr793GRWTh21HjqFU5XQZiMnCrAP3471E1aZ8uOMqU1ghC3w=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:34.345691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-f14a323a-6216-4e04-b861-34b6bc77ea93 tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Getting quotas for project 6a64eada593d4a00b0ed038b1a318821. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:39:34.354266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-f14a323a-6216-4e04-b861-34b6bc77ea93 tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Getting quotas for user c0b4926875534cb58b92dfb97c0824b2 and project 6a64eada593d4a00b0ed038b1a318821. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:39:34.406782 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f14a323a-6216-4e04-b861-34b6bc77ea93 tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.132245 Oct 10 23:39:34.408268 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2335/4542] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:39:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:39:34.424860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f80a7ac2-02b7-486a-8280-51955d63929d tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Calling method '.version_select at 0x7f6633a69700>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:34.459293 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f80a7ac2-02b7-486a-8280-51955d63929d tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586129837" status: 202 len: 0 microversion: 2.1 time: 0.042123 Oct 10 23:39:34.469171 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2336/4543] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 10 23:39:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586129837 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:39:34.485598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b14cbef4-c740-41f3-bb18-c2bfd2c93f9d tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Action: 'create', calling method: .version_select at 0x7f6633a4aa60>, body: {"keypair": {"name": "tempest-keypair-90990351", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:34.511945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-b14cbef4-c740-41f3-bb18-c2bfd2c93f9d tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Getting quotas for project 6a64eada593d4a00b0ed038b1a318821. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:39:34.526221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-b14cbef4-c740-41f3-bb18-c2bfd2c93f9d tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Getting quotas for user c0b4926875534cb58b92dfb97c0824b2 and project 6a64eada593d4a00b0ed038b1a318821. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:39:34.567260 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b14cbef4-c740-41f3-bb18-c2bfd2c93f9d tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 572 microversion: 2.1 time: 0.090696 Oct 10 23:39:34.569539 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2337/4544] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:39:34 2022] POST /compute/v2.1/os-keypairs => generated 572 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:39:34.581054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f6725ae1-7b18-417c-a287-822fe964a35e tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Calling method '.version_select at 0x7f662a724e50>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:34.604397 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f6725ae1-7b18-417c-a287-822fe964a35e tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-90990351" status: 202 len: 0 microversion: 2.1 time: 0.028231 Oct 10 23:39:34.612820 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2338/4545] 10.222.0.23 () {58 vars in 1215 bytes} [Mon Oct 10 23:39:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-90990351 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:39:34.618353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-51b85311-7ccc-43f8-b57a-400c1967f0d2 tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Action: 'create', calling method: .version_select at 0x7f6633a465e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1931092761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgGSpiVxVa7YH8QtTKmbgNElgJaSkKDBR/LOXr/6p/3GTj1rMXU4SS5KgzNRoa7AWoCL/Um6MKJeWT2RaFuWDPIgrnE+mzzlhHcoYWR90MhPHCdQV8kWOXxS2uvacftpw=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:34.635912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-51b85311-7ccc-43f8-b57a-400c1967f0d2 tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Getting quotas for project 6a64eada593d4a00b0ed038b1a318821. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:39:34.637481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:39:34.645007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-51b85311-7ccc-43f8-b57a-400c1967f0d2 tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Getting quotas for user c0b4926875534cb58b92dfb97c0824b2 and project 6a64eada593d4a00b0ed038b1a318821. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:39:34.677497 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-51b85311-7ccc-43f8-b57a-400c1967f0d2 tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.063128 Oct 10 23:39:34.688039 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2339/4546] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:39:34 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:39:34.693733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bfac8575-15b5-4521-8292-937b1437ee5b tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Action: 'create', calling method: .version_select at 0x7f66339adee0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-967803162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsfTIo2MttsOxcQV2yHJfBvV2QUXtFqkDgkduvrFHHHUspec5hiu0UMpa8kz1HOJoIlzszSLK4Uj96wS97Wif+M7asyDczrNTCPVGlxCJiOHdhlNuRSjNQNDmDAfkQ4Vg=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:34.712522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-bfac8575-15b5-4521-8292-937b1437ee5b tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Getting quotas for project 6a64eada593d4a00b0ed038b1a318821. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:39:34.721357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-bfac8575-15b5-4521-8292-937b1437ee5b tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Getting quotas for user c0b4926875534cb58b92dfb97c0824b2 and project 6a64eada593d4a00b0ed038b1a318821. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:39:34.769843 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bfac8575-15b5-4521-8292-937b1437ee5b tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.080058 Oct 10 23:39:34.778794 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2340/4547] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:39:34 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:39:34.801486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-21bbed80-a402-4d45-b97a-f9153c18c633 tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Action: 'create', calling method: .version_select at 0x7f6633a4a4c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1148969842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgWoC0CbrJrKrHAWUzkqUAqMGPdrY+8cD30edNGefHPJEfcF0aPKDYc8zV5r8pCyGV4QEb5BnRo1q11jBBIKluXczLEpt8ajhbVjbibBuzHRc2+y9zAsqViG5gkI3B3+g=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:34.827211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-260b068b-72fc-4dc5-af61-0d38c826c549 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:39:34.830450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-260b068b-72fc-4dc5-af61-0d38c826c549 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:39:34.830450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-260b068b-72fc-4dc5-af61-0d38c826c549 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:39:34.830450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-260b068b-72fc-4dc5-af61-0d38c826c549 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:39:34.830450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-260b068b-72fc-4dc5-af61-0d38c826c549 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:39:34.851690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-21bbed80-a402-4d45-b97a-f9153c18c633 tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Getting quotas for project 6a64eada593d4a00b0ed038b1a318821. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:39:34.856110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-260b068b-72fc-4dc5-af61-0d38c826c549 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:34.856611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-260b068b-72fc-4dc5-af61-0d38c826c549 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:34.857059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-260b068b-72fc-4dc5-af61-0d38c826c549 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:34.857839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-260b068b-72fc-4dc5-af61-0d38c826c549 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:34.858303 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-260b068b-72fc-4dc5-af61-0d38c826c549 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:34.858741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-260b068b-72fc-4dc5-af61-0d38c826c549 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:34.884626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-21bbed80-a402-4d45-b97a-f9153c18c633 tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Getting quotas for user c0b4926875534cb58b92dfb97c0824b2 and project 6a64eada593d4a00b0ed038b1a318821. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:39:34.910739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-260b068b-72fc-4dc5-af61-0d38c826c549 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Getting quotas for project 8986c214fcc944acb2731cc5af19ef0c. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:39:34.925841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-260b068b-72fc-4dc5-af61-0d38c826c549 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Getting quotas for user 585d2834c2a94c5eaa8267cf2ba58ac0 and project 8986c214fcc944acb2731cc5af19ef0c. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:39:34.961627 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-21bbed80-a402-4d45-b97a-f9153c18c633 tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.181193 Oct 10 23:39:34.963726 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2341/4548] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:39:34 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:39:34.965369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-260b068b-72fc-4dc5-af61-0d38c826c549 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:39:34.969286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-260b068b-72fc-4dc5-af61-0d38c826c549 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:39:34.982642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c4a7a71e-9b47-42de-960c-976f87879574 tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Calling method '.version_select at 0x7f662a724e50>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:35.010968 n-d-860864-2 devstack@n-api.service[120613]: WARNING oslo_db.sqlalchemy.utils [None req-c4a7a71e-9b47-42de-960c-976f87879574 tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 10 23:39:35.034852 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c4a7a71e-9b47-42de-960c-976f87879574 tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.064902 Oct 10 23:39:35.041217 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2342/4549] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:39:34 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:35.043345 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-260b068b-72fc-4dc5-af61-0d38c826c549 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.825165 Oct 10 23:39:35.044948 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2208/4550] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:39:33 2022] POST /compute/v2.1/servers => generated 409 bytes in 1828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:39:35.065214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c8d087d4-12c6-4d42-93f7-f2e517325fed tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Calling method '.version_select at 0x7f6633a46d30>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:35.091689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-46bf4f8c-1968-4f3a-a1f7-7eebd9dcd803 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:35.092259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-46bf4f8c-1968-4f3a-a1f7-7eebd9dcd803 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:35.110785 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c8d087d4-12c6-4d42-93f7-f2e517325fed tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1148969842" status: 202 len: 0 microversion: 2.1 time: 0.066848 Oct 10 23:39:35.112312 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2343/4551] 10.222.0.23 () {58 vars in 1278 bytes} [Mon Oct 10 23:39:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1148969842 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:39:35.150197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f61f6082-6ba1-4a32-a1fc-3f13126018ca tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Calling method '.version_select at 0x7f6633983af0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:35.211586 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f61f6082-6ba1-4a32-a1fc-3f13126018ca tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-967803162" status: 202 len: 0 microversion: 2.1 time: 0.074757 Oct 10 23:39:35.213884 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2344/4552] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Oct 10 23:39:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-967803162 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:39:35.221311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4b8cd586-f55c-4294-ab95-7c695f59a16a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:35.223244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4b8cd586-f55c-4294-ab95-7c695f59a16a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:35.230185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b8cd586-f55c-4294-ab95-7c695f59a16a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:35.230683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b8cd586-f55c-4294-ab95-7c695f59a16a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:35.231268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b8cd586-f55c-4294-ab95-7c695f59a16a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:35.232611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b8cd586-f55c-4294-ab95-7c695f59a16a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:35.232993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b8cd586-f55c-4294-ab95-7c695f59a16a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:35.233636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b8cd586-f55c-4294-ab95-7c695f59a16a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:35.264812 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-46bf4f8c-1968-4f3a-a1f7-7eebd9dcd803 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:35.278779 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-46bf4f8c-1968-4f3a-a1f7-7eebd9dcd803 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1246 microversion: 2.1 time: 0.215144 Oct 10 23:39:35.279236 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2209/4553] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:35 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1246 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:35.296165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-440483fd-a5f6-40e6-a208-e5a2a395cc36 tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] Calling method '.version_select at 0x7f6633ab15e0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:35.384217 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-440483fd-a5f6-40e6-a208-e5a2a395cc36 tempest-KeyPairsV2TestJSON-490002857 tempest-KeyPairsV2TestJSON-490002857-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1931092761" status: 202 len: 0 microversion: 2.1 time: 0.095738 Oct 10 23:39:35.386339 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2210/4554] 10.222.0.23 () {58 vars in 1278 bytes} [Mon Oct 10 23:39:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1931092761 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:39:35.746210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4b8cd586-f55c-4294-ab95-7c695f59a16a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:35.761229 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4b8cd586-f55c-4294-ab95-7c695f59a16a tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1512 microversion: 2.1 time: 0.540527 Oct 10 23:39:35.761945 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2345/4555] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:35 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1512 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:36.317188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e896e46b-fd82-4896-9e22-a440fec86ca7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:36.318623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e896e46b-fd82-4896-9e22-a440fec86ca7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:36.525634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e896e46b-fd82-4896-9e22-a440fec86ca7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:36.541798 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e896e46b-fd82-4896-9e22-a440fec86ca7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1246 microversion: 2.1 time: 0.228718 Oct 10 23:39:36.544587 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2211/4556] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:36 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1246 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:36.799937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6d864165-a6f7-4686-9181-6dc4aee03b00 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:36.802768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6d864165-a6f7-4686-9181-6dc4aee03b00 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:36.838073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d864165-a6f7-4686-9181-6dc4aee03b00 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:36.841996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d864165-a6f7-4686-9181-6dc4aee03b00 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:36.845630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d864165-a6f7-4686-9181-6dc4aee03b00 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:36.847992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d864165-a6f7-4686-9181-6dc4aee03b00 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:36.848661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d864165-a6f7-4686-9181-6dc4aee03b00 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:36.849932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d864165-a6f7-4686-9181-6dc4aee03b00 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:37.157767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6d864165-a6f7-4686-9181-6dc4aee03b00 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:37.161715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:39:37.167682 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6d864165-a6f7-4686-9181-6dc4aee03b00 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1512 microversion: 2.1 time: 0.376367 Oct 10 23:39:37.178203 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2346/4557] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:36 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1512 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:37.573986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b1abc26b-54ff-4ac7-9153-b139289dc187 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:37.574607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b1abc26b-54ff-4ac7-9153-b139289dc187 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:37.595970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1abc26b-54ff-4ac7-9153-b139289dc187 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:37.596477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1abc26b-54ff-4ac7-9153-b139289dc187 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:37.596921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1abc26b-54ff-4ac7-9153-b139289dc187 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:37.597679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1abc26b-54ff-4ac7-9153-b139289dc187 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:37.598143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1abc26b-54ff-4ac7-9153-b139289dc187 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:37.598576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1abc26b-54ff-4ac7-9153-b139289dc187 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:37.812843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b1abc26b-54ff-4ac7-9153-b139289dc187 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:37.829688 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b1abc26b-54ff-4ac7-9153-b139289dc187 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1316 microversion: 2.1 time: 0.259382 Oct 10 23:39:37.830244 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2212/4558] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:37 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:38.206800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3356ecc1-6bcc-41b6-ae0a-b53b7cc01d57 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:38.211601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3356ecc1-6bcc-41b6-ae0a-b53b7cc01d57 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:38.241788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3356ecc1-6bcc-41b6-ae0a-b53b7cc01d57 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:38.251677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3356ecc1-6bcc-41b6-ae0a-b53b7cc01d57 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:38.252728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3356ecc1-6bcc-41b6-ae0a-b53b7cc01d57 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:38.256478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3356ecc1-6bcc-41b6-ae0a-b53b7cc01d57 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:38.258277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3356ecc1-6bcc-41b6-ae0a-b53b7cc01d57 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:38.260822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3356ecc1-6bcc-41b6-ae0a-b53b7cc01d57 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:38.687696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3356ecc1-6bcc-41b6-ae0a-b53b7cc01d57 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:38.697730 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3356ecc1-6bcc-41b6-ae0a-b53b7cc01d57 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1512 microversion: 2.1 time: 0.499411 Oct 10 23:39:38.698912 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2347/4559] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:38 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1512 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:38.859930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-81fa52e2-116f-4877-821a-e2e2b2228fe5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:38.859930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-81fa52e2-116f-4877-821a-e2e2b2228fe5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:38.872995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81fa52e2-116f-4877-821a-e2e2b2228fe5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:38.877068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81fa52e2-116f-4877-821a-e2e2b2228fe5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:38.877638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81fa52e2-116f-4877-821a-e2e2b2228fe5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:38.878502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81fa52e2-116f-4877-821a-e2e2b2228fe5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:38.879290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81fa52e2-116f-4877-821a-e2e2b2228fe5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:38.880288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-81fa52e2-116f-4877-821a-e2e2b2228fe5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:39.283893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-81fa52e2-116f-4877-821a-e2e2b2228fe5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:39.295046 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-81fa52e2-116f-4877-821a-e2e2b2228fe5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1372 microversion: 2.1 time: 0.442101 Oct 10 23:39:39.300975 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2213/4560] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:38 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1372 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:39.728348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d69fd847-ceee-47cf-a9c9-c471464070b8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:39.728969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d69fd847-ceee-47cf-a9c9-c471464070b8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:39.743156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d69fd847-ceee-47cf-a9c9-c471464070b8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:39.752590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d69fd847-ceee-47cf-a9c9-c471464070b8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:39.753344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d69fd847-ceee-47cf-a9c9-c471464070b8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:39.755363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d69fd847-ceee-47cf-a9c9-c471464070b8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:39.755832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d69fd847-ceee-47cf-a9c9-c471464070b8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:39.756270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d69fd847-ceee-47cf-a9c9-c471464070b8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:40.055917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d69fd847-ceee-47cf-a9c9-c471464070b8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:40.065652 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d69fd847-ceee-47cf-a9c9-c471464070b8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1512 microversion: 2.1 time: 0.341758 Oct 10 23:39:40.079070 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2348/4561] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:39 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1512 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:40.119267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-c26110c3-8d16-4313-9c50-ff11c3d41836 req-f97fce69-9166-42ef-b89d-ae2850f985f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7a4001-50e2-4247-a60d-f82367072f61", "tag": "b24cdf0d-a2fa-4fcb-a031-a363754246f9"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:40.136295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c26110c3-8d16-4313-9c50-ff11c3d41836 req-f97fce69-9166-42ef-b89d-ae2850f985f4 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:40.136782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c26110c3-8d16-4313-9c50-ff11c3d41836 req-f97fce69-9166-42ef-b89d-ae2850f985f4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:40.137218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c26110c3-8d16-4313-9c50-ff11c3d41836 req-f97fce69-9166-42ef-b89d-ae2850f985f4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:40.164444 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-c26110c3-8d16-4313-9c50-ff11c3d41836 req-f97fce69-9166-42ef-b89d-ae2850f985f4 service nova] Creating event network-changed:b24cdf0d-a2fa-4fcb-a031-a363754246f9 for instance aa7a4001-50e2-4247-a60d-f82367072f61 on n-h1-860864-2 Oct 10 23:39:40.177485 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-c26110c3-8d16-4313-9c50-ff11c3d41836 req-f97fce69-9166-42ef-b89d-ae2850f985f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061852 Oct 10 23:39:40.178032 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2214/4562] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:39:40.320870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ed3b76a7-0a35-45cb-bff2-56e17329e092 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:40.321583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ed3b76a7-0a35-45cb-bff2-56e17329e092 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:40.328888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed3b76a7-0a35-45cb-bff2-56e17329e092 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:40.329427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed3b76a7-0a35-45cb-bff2-56e17329e092 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:40.329872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed3b76a7-0a35-45cb-bff2-56e17329e092 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:40.330588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed3b76a7-0a35-45cb-bff2-56e17329e092 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:40.345527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed3b76a7-0a35-45cb-bff2-56e17329e092 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:40.346190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed3b76a7-0a35-45cb-bff2-56e17329e092 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:40.734851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ed3b76a7-0a35-45cb-bff2-56e17329e092 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:40.740712 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ed3b76a7-0a35-45cb-bff2-56e17329e092 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1372 microversion: 2.1 time: 0.423573 Oct 10 23:39:40.742731 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2349/4563] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:40 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1372 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:41.103104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3e337ec8-bef6-45f6-b1fd-c20a14c9f019 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:41.105277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3e337ec8-bef6-45f6-b1fd-c20a14c9f019 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:41.114650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e337ec8-bef6-45f6-b1fd-c20a14c9f019 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:41.115447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e337ec8-bef6-45f6-b1fd-c20a14c9f019 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:41.116180 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e337ec8-bef6-45f6-b1fd-c20a14c9f019 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:41.117216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e337ec8-bef6-45f6-b1fd-c20a14c9f019 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:41.117960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e337ec8-bef6-45f6-b1fd-c20a14c9f019 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:41.118631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e337ec8-bef6-45f6-b1fd-c20a14c9f019 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:41.505882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3e337ec8-bef6-45f6-b1fd-c20a14c9f019 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:41.517094 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3e337ec8-bef6-45f6-b1fd-c20a14c9f019 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1512 microversion: 2.1 time: 0.419113 Oct 10 23:39:41.534174 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2215/4564] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:41 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1512 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:41.774335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6c714ec4-683e-419c-830a-9aefc39a5ea9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:41.777643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6c714ec4-683e-419c-830a-9aefc39a5ea9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:41.800742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c714ec4-683e-419c-830a-9aefc39a5ea9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:41.801606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c714ec4-683e-419c-830a-9aefc39a5ea9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:41.812934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c714ec4-683e-419c-830a-9aefc39a5ea9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:41.814407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c714ec4-683e-419c-830a-9aefc39a5ea9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:41.815338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c714ec4-683e-419c-830a-9aefc39a5ea9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:41.816197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c714ec4-683e-419c-830a-9aefc39a5ea9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:42.233270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6c714ec4-683e-419c-830a-9aefc39a5ea9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:42.256537 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6c714ec4-683e-419c-830a-9aefc39a5ea9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1372 microversion: 2.1 time: 0.489623 Oct 10 23:39:42.270231 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2350/4565] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:41 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1372 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:39:42.541540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b1f99b86-4f92-4258-bc49-545a0e1a7f68 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:42.542294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b1f99b86-4f92-4258-bc49-545a0e1a7f68 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:42.550910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1f99b86-4f92-4258-bc49-545a0e1a7f68 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:42.551411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1f99b86-4f92-4258-bc49-545a0e1a7f68 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:42.551845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1f99b86-4f92-4258-bc49-545a0e1a7f68 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:42.552751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1f99b86-4f92-4258-bc49-545a0e1a7f68 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:42.566168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1f99b86-4f92-4258-bc49-545a0e1a7f68 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:42.566875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1f99b86-4f92-4258-bc49-545a0e1a7f68 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:43.104541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b1f99b86-4f92-4258-bc49-545a0e1a7f68 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:43.112950 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b1f99b86-4f92-4258-bc49-545a0e1a7f68 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1512 microversion: 2.1 time: 0.575376 Oct 10 23:39:43.129658 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2216/4566] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:42 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1512 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:43.296829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ff4edf64-ab96-4915-8c66-5bd01d053861 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:43.297890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ff4edf64-ab96-4915-8c66-5bd01d053861 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:43.310460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff4edf64-ab96-4915-8c66-5bd01d053861 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:43.310856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff4edf64-ab96-4915-8c66-5bd01d053861 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:43.311302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff4edf64-ab96-4915-8c66-5bd01d053861 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:43.312104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff4edf64-ab96-4915-8c66-5bd01d053861 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:43.312568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff4edf64-ab96-4915-8c66-5bd01d053861 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:43.312994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff4edf64-ab96-4915-8c66-5bd01d053861 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:43.888758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ff4edf64-ab96-4915-8c66-5bd01d053861 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:43.918944 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ff4edf64-ab96-4915-8c66-5bd01d053861 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1372 microversion: 2.1 time: 0.626339 Oct 10 23:39:43.920191 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2351/4567] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:43 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1372 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:39:44.139693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fe343afb-eee5-41d8-930e-452a3697f250 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:44.142446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fe343afb-eee5-41d8-930e-452a3697f250 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:44.150659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe343afb-eee5-41d8-930e-452a3697f250 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:44.151403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe343afb-eee5-41d8-930e-452a3697f250 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:44.152256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe343afb-eee5-41d8-930e-452a3697f250 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:44.153130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe343afb-eee5-41d8-930e-452a3697f250 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:44.156506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe343afb-eee5-41d8-930e-452a3697f250 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:44.157246 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe343afb-eee5-41d8-930e-452a3697f250 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:44.887752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:39:44.947373 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=24 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:39:44.951772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ce4615c4-b86a-46bb-b664-76f709e2925d tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:44.952471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ce4615c4-b86a-46bb-b664-76f709e2925d tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:44.960588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce4615c4-b86a-46bb-b664-76f709e2925d tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:44.961227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce4615c4-b86a-46bb-b664-76f709e2925d tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:44.961762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce4615c4-b86a-46bb-b664-76f709e2925d tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:44.962721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce4615c4-b86a-46bb-b664-76f709e2925d tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:44.963101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce4615c4-b86a-46bb-b664-76f709e2925d tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:44.963597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce4615c4-b86a-46bb-b664-76f709e2925d tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:45.064355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fe343afb-eee5-41d8-930e-452a3697f250 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:45.112740 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fe343afb-eee5-41d8-930e-452a3697f250 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1512 microversion: 2.1 time: 0.976907 Oct 10 23:39:45.114961 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2217/4568] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:44 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1512 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:45.582649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ce4615c4-b86a-46bb-b664-76f709e2925d tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:45.614919 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ce4615c4-b86a-46bb-b664-76f709e2925d tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1372 microversion: 2.1 time: 0.669662 Oct 10 23:39:45.619534 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2352/4569] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:44 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1372 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:39:46.159090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8623c79a-dbb3-43e2-af42-cbedc723fc12 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:46.163356 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8623c79a-dbb3-43e2-af42-cbedc723fc12 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:46.199999 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8623c79a-dbb3-43e2-af42-cbedc723fc12 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:46.201171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8623c79a-dbb3-43e2-af42-cbedc723fc12 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:46.201992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8623c79a-dbb3-43e2-af42-cbedc723fc12 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:46.208952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8623c79a-dbb3-43e2-af42-cbedc723fc12 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:46.210308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8623c79a-dbb3-43e2-af42-cbedc723fc12 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:46.211541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8623c79a-dbb3-43e2-af42-cbedc723fc12 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:46.538346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=14 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:39:46.671840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3f43d5bf-c77b-4fed-be2c-dc11bde3d87a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:46.674158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3f43d5bf-c77b-4fed-be2c-dc11bde3d87a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:46.724626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f43d5bf-c77b-4fed-be2c-dc11bde3d87a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:46.725480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f43d5bf-c77b-4fed-be2c-dc11bde3d87a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:46.726193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f43d5bf-c77b-4fed-be2c-dc11bde3d87a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:46.727273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f43d5bf-c77b-4fed-be2c-dc11bde3d87a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:46.728080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f43d5bf-c77b-4fed-be2c-dc11bde3d87a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:46.728744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f43d5bf-c77b-4fed-be2c-dc11bde3d87a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:46.777330 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8623c79a-dbb3-43e2-af42-cbedc723fc12 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:46.806488 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8623c79a-dbb3-43e2-af42-cbedc723fc12 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1489 microversion: 2.1 time: 0.662125 Oct 10 23:39:46.811195 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2218/4570] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:46 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1489 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:46.856630 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2d4da34b-0d14-477c-931c-41a8cbc29ba2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:46.857812 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2d4da34b-0d14-477c-931c-41a8cbc29ba2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:46.866850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:39:46.868752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d4da34b-0d14-477c-931c-41a8cbc29ba2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:46.869561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d4da34b-0d14-477c-931c-41a8cbc29ba2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:46.870186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d4da34b-0d14-477c-931c-41a8cbc29ba2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:46.871634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d4da34b-0d14-477c-931c-41a8cbc29ba2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:46.872670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d4da34b-0d14-477c-931c-41a8cbc29ba2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:46.873507 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d4da34b-0d14-477c-931c-41a8cbc29ba2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:46.914752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:39:46.923958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2d4da34b-0d14-477c-931c-41a8cbc29ba2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:39:47.164496 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2d4da34b-0d14-477c-931c-41a8cbc29ba2 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 204 len: 0 microversion: 2.1 time: 0.326064 Oct 10 23:39:47.165552 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2219/4571] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:39:46 2022] DELETE /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:39:47.196341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-980e9467-54d3-4bb5-8384-b3a689c21f38 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:47.197057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-980e9467-54d3-4bb5-8384-b3a689c21f38 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:47.210442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-980e9467-54d3-4bb5-8384-b3a689c21f38 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:47.214765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-980e9467-54d3-4bb5-8384-b3a689c21f38 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:47.215438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-980e9467-54d3-4bb5-8384-b3a689c21f38 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:47.216338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-980e9467-54d3-4bb5-8384-b3a689c21f38 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:47.216956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-980e9467-54d3-4bb5-8384-b3a689c21f38 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:47.219517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-980e9467-54d3-4bb5-8384-b3a689c21f38 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:47.405395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3f43d5bf-c77b-4fed-be2c-dc11bde3d87a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:47.418009 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3f43d5bf-c77b-4fed-be2c-dc11bde3d87a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1372 microversion: 2.1 time: 0.762566 Oct 10 23:39:47.429937 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2353/4572] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:46 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1372 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:47.791035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-980e9467-54d3-4bb5-8384-b3a689c21f38 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:47.801536 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-980e9467-54d3-4bb5-8384-b3a689c21f38 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1495 microversion: 2.1 time: 0.622781 Oct 10 23:39:47.807894 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2220/4573] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:47 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1495 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:48.448621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d2850b5e-d468-48ba-b768-e7f14991c833 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:48.449268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d2850b5e-d468-48ba-b768-e7f14991c833 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:48.495769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2850b5e-d468-48ba-b768-e7f14991c833 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:48.496399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2850b5e-d468-48ba-b768-e7f14991c833 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:48.504144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2850b5e-d468-48ba-b768-e7f14991c833 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:48.505860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2850b5e-d468-48ba-b768-e7f14991c833 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:48.508730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2850b5e-d468-48ba-b768-e7f14991c833 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:48.516578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2850b5e-d468-48ba-b768-e7f14991c833 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:48.837751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dc50fe91-49a5-4760-b280-64e7416fc93b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:48.838535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dc50fe91-49a5-4760-b280-64e7416fc93b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:48.914693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc50fe91-49a5-4760-b280-64e7416fc93b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:48.915666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc50fe91-49a5-4760-b280-64e7416fc93b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:48.923310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc50fe91-49a5-4760-b280-64e7416fc93b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:48.926126 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc50fe91-49a5-4760-b280-64e7416fc93b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:48.927261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc50fe91-49a5-4760-b280-64e7416fc93b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:48.930947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc50fe91-49a5-4760-b280-64e7416fc93b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:49.152213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d2850b5e-d468-48ba-b768-e7f14991c833 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:49.162705 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d2850b5e-d468-48ba-b768-e7f14991c833 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1372 microversion: 2.1 time: 0.721697 Oct 10 23:39:49.192474 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2354/4574] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:48 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1372 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:49.869601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0e81b0fb-66ec-4593-b61c-2c598667c72f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:49.870291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0e81b0fb-66ec-4593-b61c-2c598667c72f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:49.883683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e81b0fb-66ec-4593-b61c-2c598667c72f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:49.893165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e81b0fb-66ec-4593-b61c-2c598667c72f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:49.893744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e81b0fb-66ec-4593-b61c-2c598667c72f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:49.894519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e81b0fb-66ec-4593-b61c-2c598667c72f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:49.894993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e81b0fb-66ec-4593-b61c-2c598667c72f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:49.895403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e81b0fb-66ec-4593-b61c-2c598667c72f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:49.980808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0e81b0fb-66ec-4593-b61c-2c598667c72f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:39:50.179487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dc50fe91-49a5-4760-b280-64e7416fc93b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:50.196319 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dc50fe91-49a5-4760-b280-64e7416fc93b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1495 microversion: 2.1 time: 1.367440 Oct 10 23:39:50.197914 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2221/4575] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:48 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1495 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:50.249985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9d131faa-3db2-44fd-969f-ee3a72ea68dd tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:50.251793 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9d131faa-3db2-44fd-969f-ee3a72ea68dd tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:50.286195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d131faa-3db2-44fd-969f-ee3a72ea68dd tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:50.289109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d131faa-3db2-44fd-969f-ee3a72ea68dd tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:50.290194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d131faa-3db2-44fd-969f-ee3a72ea68dd tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:50.293787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d131faa-3db2-44fd-969f-ee3a72ea68dd tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:50.297590 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0e81b0fb-66ec-4593-b61c-2c598667c72f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 204 len: 0 microversion: 2.42 time: 1.101533 Oct 10 23:39:50.298902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d131faa-3db2-44fd-969f-ee3a72ea68dd tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:50.300347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d131faa-3db2-44fd-969f-ee3a72ea68dd tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:50.312387 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2355/4576] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:39:49 2022] DELETE /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 0 bytes in 1118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:39:50.342272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7b8950e0-192f-4ea8-97a8-2892b8f71d4c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:50.343970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7b8950e0-192f-4ea8-97a8-2892b8f71d4c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:50.365816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b8950e0-192f-4ea8-97a8-2892b8f71d4c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:50.366725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b8950e0-192f-4ea8-97a8-2892b8f71d4c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:50.367328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b8950e0-192f-4ea8-97a8-2892b8f71d4c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:50.368222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b8950e0-192f-4ea8-97a8-2892b8f71d4c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:50.368973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b8950e0-192f-4ea8-97a8-2892b8f71d4c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:50.369452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b8950e0-192f-4ea8-97a8-2892b8f71d4c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:51.253612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7b8950e0-192f-4ea8-97a8-2892b8f71d4c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:51.290438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9d131faa-3db2-44fd-969f-ee3a72ea68dd tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:51.307357 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9d131faa-3db2-44fd-969f-ee3a72ea68dd tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1372 microversion: 2.1 time: 1.074502 Oct 10 23:39:51.331147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7b8950e0-192f-4ea8-97a8-2892b8f71d4c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:51.333454 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2222/4577] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:50 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1372 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:51.338746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7b8950e0-192f-4ea8-97a8-2892b8f71d4c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:51.345786 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7b8950e0-192f-4ea8-97a8-2892b8f71d4c tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 2964 microversion: 2.42 time: 1.024913 Oct 10 23:39:51.350612 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2356/4578] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:39:50 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 2964 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:39:51.351622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bad70f2f-2034-422b-be92-e04541cadcec tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:51.354316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bad70f2f-2034-422b-be92-e04541cadcec tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:51.385877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bad70f2f-2034-422b-be92-e04541cadcec tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:51.391975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bad70f2f-2034-422b-be92-e04541cadcec tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:51.398522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bad70f2f-2034-422b-be92-e04541cadcec tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:51.400350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bad70f2f-2034-422b-be92-e04541cadcec tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:51.414170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bad70f2f-2034-422b-be92-e04541cadcec tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:51.414924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bad70f2f-2034-422b-be92-e04541cadcec tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:51.596353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bad70f2f-2034-422b-be92-e04541cadcec tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:51.612588 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bad70f2f-2034-422b-be92-e04541cadcec tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1453 microversion: 2.1 time: 0.276994 Oct 10 23:39:51.614213 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2223/4579] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:51 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1453 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:51.759238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-1489c294-bae3-49ae-a1c7-21145bc5d7f7 req-d0283dc1-0907-4f26-934e-cd9dcac00cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b579635a-eb7c-4e99-8b52-faeba843197f", "name": "network-vif-deleted", "tag": "0c8dc7fa-f8ea-47e2-bff4-fc128b9d33a5"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:51.789100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1489c294-bae3-49ae-a1c7-21145bc5d7f7 req-d0283dc1-0907-4f26-934e-cd9dcac00cda service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:51.789862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1489c294-bae3-49ae-a1c7-21145bc5d7f7 req-d0283dc1-0907-4f26-934e-cd9dcac00cda service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:51.790537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1489c294-bae3-49ae-a1c7-21145bc5d7f7 req-d0283dc1-0907-4f26-934e-cd9dcac00cda service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:51.811088 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-1489c294-bae3-49ae-a1c7-21145bc5d7f7 req-d0283dc1-0907-4f26-934e-cd9dcac00cda service nova] Creating event network-vif-deleted:0c8dc7fa-f8ea-47e2-bff4-fc128b9d33a5 for instance b579635a-eb7c-4e99-8b52-faeba843197f on n-h2-860864-2 Oct 10 23:39:51.822642 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-1489c294-bae3-49ae-a1c7-21145bc5d7f7 req-d0283dc1-0907-4f26-934e-cd9dcac00cda service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077739 Oct 10 23:39:51.824530 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2357/4580] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:39:52.340558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b7a67868-f3fe-4b12-9e16-742e578224e4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:52.342689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b7a67868-f3fe-4b12-9e16-742e578224e4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:52.368283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7a67868-f3fe-4b12-9e16-742e578224e4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:52.371678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7a67868-f3fe-4b12-9e16-742e578224e4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:52.378703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7a67868-f3fe-4b12-9e16-742e578224e4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:52.381989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7a67868-f3fe-4b12-9e16-742e578224e4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:52.383326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7a67868-f3fe-4b12-9e16-742e578224e4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:52.384203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7a67868-f3fe-4b12-9e16-742e578224e4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:52.664034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ebade8df-afc6-43fc-a69d-1659f22ffd05 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-708310106", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "56312001-1818-436a-b45d-ba4ef2d96639"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:52.794455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-ebade8df-afc6-43fc-a69d-1659f22ffd05 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] validate_networks() for [('56312001-1818-436a-b45d-ba4ef2d96639', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:39:53.134329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b7a67868-f3fe-4b12-9e16-742e578224e4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:53.144264 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b7a67868-f3fe-4b12-9e16-742e578224e4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1372 microversion: 2.1 time: 0.810275 Oct 10 23:39:53.145220 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2358/4581] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:52 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1372 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:53.150266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a4e79aea-bc5d-40c5-a783-c111561c4119 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:53.150878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a4e79aea-bc5d-40c5-a783-c111561c4119 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:53.158278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4e79aea-bc5d-40c5-a783-c111561c4119 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:53.158795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4e79aea-bc5d-40c5-a783-c111561c4119 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:53.159228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4e79aea-bc5d-40c5-a783-c111561c4119 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:53.159940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4e79aea-bc5d-40c5-a783-c111561c4119 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:53.160366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4e79aea-bc5d-40c5-a783-c111561c4119 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:53.160965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4e79aea-bc5d-40c5-a783-c111561c4119 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:53.768490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a4e79aea-bc5d-40c5-a783-c111561c4119 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:53.787795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a4e79aea-bc5d-40c5-a783-c111561c4119 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:53.790242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a4e79aea-bc5d-40c5-a783-c111561c4119 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:53.793669 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a4e79aea-bc5d-40c5-a783-c111561c4119 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 2964 microversion: 2.42 time: 0.647274 Oct 10 23:39:53.796957 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2359/4582] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:39:53 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 2964 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:39:53.811969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-13df5356-929c-4650-84f8-5afad2ed0197 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:53.816901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-13df5356-929c-4650-84f8-5afad2ed0197 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:53.847721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13df5356-929c-4650-84f8-5afad2ed0197 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:53.848233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13df5356-929c-4650-84f8-5afad2ed0197 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:53.854030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13df5356-929c-4650-84f8-5afad2ed0197 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:53.854821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13df5356-929c-4650-84f8-5afad2ed0197 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:53.855308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13df5356-929c-4650-84f8-5afad2ed0197 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:53.855761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13df5356-929c-4650-84f8-5afad2ed0197 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:53.960971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13df5356-929c-4650-84f8-5afad2ed0197 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:53.964542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13df5356-929c-4650-84f8-5afad2ed0197 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:53.965295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13df5356-929c-4650-84f8-5afad2ed0197 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:53.966727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-13df5356-929c-4650-84f8-5afad2ed0197 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lazy-loading 'fault' on Instance uuid b579635a-eb7c-4e99-8b52-faeba843197f {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:39:54.116660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-13df5356-929c-4650-84f8-5afad2ed0197 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:54.134695 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-13df5356-929c-4650-84f8-5afad2ed0197 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 200 len: 1305 microversion: 2.1 time: 0.333379 Oct 10 23:39:54.136766 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2360/4583] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:53 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 1305 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:54.154391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-0ea7a917-0d14-48c2-a452-eeadde241787 req-eab5d6d8-1341-4b8e-9d6d-4755fd5b62bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7a4001-50e2-4247-a60d-f82367072f61", "name": "network-vif-plugged", "status": "completed", "tag": "b24cdf0d-a2fa-4fcb-a031-a363754246f9"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:54.185271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0ea7a917-0d14-48c2-a452-eeadde241787 req-eab5d6d8-1341-4b8e-9d6d-4755fd5b62bc service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:54.186108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0ea7a917-0d14-48c2-a452-eeadde241787 req-eab5d6d8-1341-4b8e-9d6d-4755fd5b62bc service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:54.186726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0ea7a917-0d14-48c2-a452-eeadde241787 req-eab5d6d8-1341-4b8e-9d6d-4755fd5b62bc service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:54.217242 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-0ea7a917-0d14-48c2-a452-eeadde241787 req-eab5d6d8-1341-4b8e-9d6d-4755fd5b62bc service nova] Creating event network-vif-plugged:b24cdf0d-a2fa-4fcb-a031-a363754246f9 for instance aa7a4001-50e2-4247-a60d-f82367072f61 on n-h1-860864-2 Oct 10 23:39:54.233725 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-0ea7a917-0d14-48c2-a452-eeadde241787 req-eab5d6d8-1341-4b8e-9d6d-4755fd5b62bc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091501 Oct 10 23:39:54.235203 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2361/4584] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:39:54.258787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-04765b18-bb68-4e78-83fe-83401cec92b7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:54.259535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-04765b18-bb68-4e78-83fe-83401cec92b7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:54.291077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04765b18-bb68-4e78-83fe-83401cec92b7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:54.291332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04765b18-bb68-4e78-83fe-83401cec92b7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:54.293652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04765b18-bb68-4e78-83fe-83401cec92b7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:54.294449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04765b18-bb68-4e78-83fe-83401cec92b7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:54.295276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04765b18-bb68-4e78-83fe-83401cec92b7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:54.302375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04765b18-bb68-4e78-83fe-83401cec92b7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:54.815318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-04765b18-bb68-4e78-83fe-83401cec92b7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:54.820530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:39:54.839047 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-04765b18-bb68-4e78-83fe-83401cec92b7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1372 microversion: 2.1 time: 0.602948 Oct 10 23:39:54.849542 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2362/4585] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:54 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1372 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:54.860014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-292ebc3d-0d29-46c7-8740-8846576baa0f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:54.882993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-292ebc3d-0d29-46c7-8740-8846576baa0f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:54.929834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-292ebc3d-0d29-46c7-8740-8846576baa0f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:54.930526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-292ebc3d-0d29-46c7-8740-8846576baa0f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:54.930998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-292ebc3d-0d29-46c7-8740-8846576baa0f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:54.931778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-292ebc3d-0d29-46c7-8740-8846576baa0f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:54.932254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-292ebc3d-0d29-46c7-8740-8846576baa0f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:54.932699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-292ebc3d-0d29-46c7-8740-8846576baa0f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:55.289813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ebade8df-afc6-43fc-a69d-1659f22ffd05 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:39:55.290310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ebade8df-afc6-43fc-a69d-1659f22ffd05 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:39:55.290806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ebade8df-afc6-43fc-a69d-1659f22ffd05 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:39:55.291227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ebade8df-afc6-43fc-a69d-1659f22ffd05 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:39:55.291664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ebade8df-afc6-43fc-a69d-1659f22ffd05 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:39:55.311274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebade8df-afc6-43fc-a69d-1659f22ffd05 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:55.311764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebade8df-afc6-43fc-a69d-1659f22ffd05 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:55.312259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebade8df-afc6-43fc-a69d-1659f22ffd05 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:55.313290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebade8df-afc6-43fc-a69d-1659f22ffd05 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:55.313952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebade8df-afc6-43fc-a69d-1659f22ffd05 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:55.314541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebade8df-afc6-43fc-a69d-1659f22ffd05 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:55.364956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ebade8df-afc6-43fc-a69d-1659f22ffd05 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Getting quotas for project 7586bc93b2f04b918195ee2c9e490b92. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:39:55.381732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ebade8df-afc6-43fc-a69d-1659f22ffd05 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Getting quotas for user 538606670f9e4f239347abb3f5da8ac8 and project 7586bc93b2f04b918195ee2c9e490b92. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:39:55.411578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ebade8df-afc6-43fc-a69d-1659f22ffd05 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:39:55.414831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ebade8df-afc6-43fc-a69d-1659f22ffd05 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] [instance: cdd533e1-ff6e-4525-b6cb-e425440195cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:39:55.531838 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ebade8df-afc6-43fc-a69d-1659f22ffd05 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.198756 Oct 10 23:39:55.532521 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2224/4586] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:39:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 3201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:39:55.542315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3b3ddbd2-8f03-467a-95b3-13c3a8e7c84b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:55.542936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3b3ddbd2-8f03-467a-95b3-13c3a8e7c84b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:55.576316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b3ddbd2-8f03-467a-95b3-13c3a8e7c84b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:55.576817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b3ddbd2-8f03-467a-95b3-13c3a8e7c84b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:55.582402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b3ddbd2-8f03-467a-95b3-13c3a8e7c84b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:55.585086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b3ddbd2-8f03-467a-95b3-13c3a8e7c84b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:55.586352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b3ddbd2-8f03-467a-95b3-13c3a8e7c84b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:55.588142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b3ddbd2-8f03-467a-95b3-13c3a8e7c84b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:55.629745 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-3b3ddbd2-8f03-467a-95b3-13c3a8e7c84b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] HTTP exception thrown: Instance b579635a-eb7c-4e99-8b52-faeba843197f could not be found. Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3b3ddbd2-8f03-467a-95b3-13c3a8e7c84b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Request method failure captured: Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f HTTP/1.1 Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKw8hCLXWIFTJ3HaJf5ifgl6Pm7vGD8ptwfQXuGQAkf1M-RWSvV8nlygpWidDM338TQR6cXdzFUy8zgn8XWf4EUtX06mIecSablgYBXm9sJQ78u324dyYAXvHBKQ5Ge8XY02Fdf2X0InpWnugNSR9M1ccFMQnfZYNbqSwCmT2w9EOBY Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d42cb00f2544abbde09cae76f3e3a1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-DeleteServersTestJSON-837712631 Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 7cc066774b344a24a91fb41e990f5234 Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance b579635a-eb7c-4e99-8b52-faeba843197f could not be found. Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'b579635a-eb7c-4e99-8b52-faeba843197f'} Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b579635a-eb7c-4e99-8b52-faeba843197f could not be found. Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b579635a-eb7c-4e99-8b52-faeba843197f could not be found. Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:39:55.631454 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:55.638915 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:39:55.638915 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:39:55.638915 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:39:55.638915 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:39:55.638915 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:39:55.638915 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b579635a-eb7c-4e99-8b52-faeba843197f could not be found. Oct 10 23:39:55.638915 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:39:55.638915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3b3ddbd2-8f03-467a-95b3-13c3a8e7c84b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Returning 404 to user: Instance b579635a-eb7c-4e99-8b52-faeba843197f could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:39:55.638915 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3b3ddbd2-8f03-467a-95b3-13c3a8e7c84b tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 404 len: 111 microversion: 2.1 time: 0.097863 Oct 10 23:39:55.638915 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2225/4587] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:55 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:39:55.638915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ae266bbb-1196-4c99-818a-f3d7090541d0 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:55.641016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ae266bbb-1196-4c99-818a-f3d7090541d0 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] [instance: cdd533e1-ff6e-4525-b6cb-e425440195cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:55.833787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ae266bbb-1196-4c99-818a-f3d7090541d0 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538606670f9e4f239347abb3f5da8ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7586bc93b2f04b918195ee2c9e490b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:55.844002 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ae266bbb-1196-4c99-818a-f3d7090541d0 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb" status: 200 len: 1223 microversion: 2.1 time: 0.208617 Oct 10 23:39:55.849778 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2226/4588] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:55 2022] GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb => generated 1223 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:55.875877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-91fd14a2-c202-4ec6-85b1-617020301c47 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:55.876915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-91fd14a2-c202-4ec6-85b1-617020301c47 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:55.902447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91fd14a2-c202-4ec6-85b1-617020301c47 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:55.902947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91fd14a2-c202-4ec6-85b1-617020301c47 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:55.903381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91fd14a2-c202-4ec6-85b1-617020301c47 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:55.904107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91fd14a2-c202-4ec6-85b1-617020301c47 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:55.904567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91fd14a2-c202-4ec6-85b1-617020301c47 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:55.904996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91fd14a2-c202-4ec6-85b1-617020301c47 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:56.581320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-292ebc3d-0d29-46c7-8740-8846576baa0f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:56.596476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-292ebc3d-0d29-46c7-8740-8846576baa0f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:56.601598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-292ebc3d-0d29-46c7-8740-8846576baa0f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:56.605880 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-292ebc3d-0d29-46c7-8740-8846576baa0f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 2964 microversion: 2.42 time: 1.754340 Oct 10 23:39:56.623600 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2363/4589] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:39:54 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 2964 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:39:56.650698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-500fd7ad-a70e-480e-a9e3-3672367223aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-880505890", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "d3777005-851a-44f1-be2b-d4f3d09bbf72"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:56.826367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-500fd7ad-a70e-480e-a9e3-3672367223aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] validate_networks() for [('d3777005-851a-44f1-be2b-d4f3d09bbf72', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:39:57.345203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-91fd14a2-c202-4ec6-85b1-617020301c47 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:57.366049 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-91fd14a2-c202-4ec6-85b1-617020301c47 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1372 microversion: 2.1 time: 1.486251 Oct 10 23:39:57.371621 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2227/4590] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:55 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1372 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:57.388722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-baffba26-e54b-4a2d-84a3-763709608fca tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:57.394575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-baffba26-e54b-4a2d-84a3-763709608fca tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] [instance: cdd533e1-ff6e-4525-b6cb-e425440195cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:57.429856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-baffba26-e54b-4a2d-84a3-763709608fca tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:57.431549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-baffba26-e54b-4a2d-84a3-763709608fca tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:57.432306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-baffba26-e54b-4a2d-84a3-763709608fca tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:57.438306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-baffba26-e54b-4a2d-84a3-763709608fca tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:57.442193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-baffba26-e54b-4a2d-84a3-763709608fca tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:57.452804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-baffba26-e54b-4a2d-84a3-763709608fca tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:57.708267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-baffba26-e54b-4a2d-84a3-763709608fca tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538606670f9e4f239347abb3f5da8ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7586bc93b2f04b918195ee2c9e490b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:57.726948 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-baffba26-e54b-4a2d-84a3-763709608fca tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb" status: 200 len: 1219 microversion: 2.1 time: 0.349539 Oct 10 23:39:57.730524 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2228/4591] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:57 2022] GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb => generated 1219 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:39:57.739408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-fc5d81f7-5125-424e-ae02-9eabb37afc05 req-bf208f87-a2ab-4cd4-a8fb-9e228859a356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "name": "network-vif-unplugged", "status": "completed", "tag": "64c20742-7660-4d0e-82e1-e69776bd552d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:57.795531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fc5d81f7-5125-424e-ae02-9eabb37afc05 req-bf208f87-a2ab-4cd4-a8fb-9e228859a356 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:57.798610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fc5d81f7-5125-424e-ae02-9eabb37afc05 req-bf208f87-a2ab-4cd4-a8fb-9e228859a356 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:57.799964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fc5d81f7-5125-424e-ae02-9eabb37afc05 req-bf208f87-a2ab-4cd4-a8fb-9e228859a356 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:57.858094 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-fc5d81f7-5125-424e-ae02-9eabb37afc05 req-bf208f87-a2ab-4cd4-a8fb-9e228859a356 service nova] Creating event network-vif-unplugged:64c20742-7660-4d0e-82e1-e69776bd552d for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:39:57.873212 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-fc5d81f7-5125-424e-ae02-9eabb37afc05 req-bf208f87-a2ab-4cd4-a8fb-9e228859a356 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135732 Oct 10 23:39:57.875815 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2229/4592] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:39:57.896456 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-27bd804e-c762-463d-97da-b739860cfc77 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:57.898186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-27bd804e-c762-463d-97da-b739860cfc77 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:57.918576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27bd804e-c762-463d-97da-b739860cfc77 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:57.919619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27bd804e-c762-463d-97da-b739860cfc77 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:57.920288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27bd804e-c762-463d-97da-b739860cfc77 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:57.923005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27bd804e-c762-463d-97da-b739860cfc77 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:57.923738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27bd804e-c762-463d-97da-b739860cfc77 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:57.926232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27bd804e-c762-463d-97da-b739860cfc77 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:58.736943 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-27bd804e-c762-463d-97da-b739860cfc77 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:58.764057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-27bd804e-c762-463d-97da-b739860cfc77 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:58.784055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-27bd804e-c762-463d-97da-b739860cfc77 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:39:58.785409 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-27bd804e-c762-463d-97da-b739860cfc77 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 2943 microversion: 2.42 time: 0.907101 Oct 10 23:39:58.792448 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2230/4593] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:39:57 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 2943 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:39:59.451654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-500fd7ad-a70e-480e-a9e3-3672367223aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:39:59.453652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-500fd7ad-a70e-480e-a9e3-3672367223aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:39:59.454500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-500fd7ad-a70e-480e-a9e3-3672367223aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:39:59.455198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-500fd7ad-a70e-480e-a9e3-3672367223aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:39:59.455801 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-500fd7ad-a70e-480e-a9e3-3672367223aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:39:59.483601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6fd1dca1-e351-4bbf-8db1-bd18354565df tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Action: 'create', calling method: .version_select at 0x7f662a3ae4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1185500481", "description": "tempest-description-1079458712"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:39:59.490383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-500fd7ad-a70e-480e-a9e3-3672367223aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:59.491574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-500fd7ad-a70e-480e-a9e3-3672367223aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:59.492471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-500fd7ad-a70e-480e-a9e3-3672367223aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:59.496336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-500fd7ad-a70e-480e-a9e3-3672367223aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:59.499459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-500fd7ad-a70e-480e-a9e3-3672367223aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:59.501715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-500fd7ad-a70e-480e-a9e3-3672367223aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:59.569260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-500fd7ad-a70e-480e-a9e3-3672367223aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Getting quotas for project e7d42cb00f2544abbde09cae76f3e3a1. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:39:59.586536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-500fd7ad-a70e-480e-a9e3-3672367223aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Getting quotas for user 7cc066774b344a24a91fb41e990f5234 and project e7d42cb00f2544abbde09cae76f3e3a1. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:39:59.641960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-500fd7ad-a70e-480e-a9e3-3672367223aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:39:59.649116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-500fd7ad-a70e-480e-a9e3-3672367223aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:39:59.703448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:39:59.792947 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-500fd7ad-a70e-480e-a9e3-3672367223aa tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.168125 Oct 10 23:39:59.799613 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2364/4594] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:39:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:39:59.812149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ac9e52f5-31e3-40b0-9f6e-bab1c5c0d003 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:39:59.817915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ac9e52f5-31e3-40b0-9f6e-bab1c5c0d003 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:39:59.835250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac9e52f5-31e3-40b0-9f6e-bab1c5c0d003 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:59.836496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac9e52f5-31e3-40b0-9f6e-bab1c5c0d003 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:59.837256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac9e52f5-31e3-40b0-9f6e-bab1c5c0d003 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:39:59.838354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac9e52f5-31e3-40b0-9f6e-bab1c5c0d003 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:39:59.839062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac9e52f5-31e3-40b0-9f6e-bab1c5c0d003 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:39:59.839801 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac9e52f5-31e3-40b0-9f6e-bab1c5c0d003 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:00.729829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ac9e52f5-31e3-40b0-9f6e-bab1c5c0d003 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:00.752962 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ac9e52f5-31e3-40b0-9f6e-bab1c5c0d003 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1566 microversion: 2.1 time: 0.951153 Oct 10 23:40:00.753609 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2365/4595] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:39:59 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1566 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:00.763735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-89f4dcbe-f71d-481c-bdec-bb13ba7046a1 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:00.783576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-89f4dcbe-f71d-481c-bdec-bb13ba7046a1 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] [instance: cdd533e1-ff6e-4525-b6cb-e425440195cb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:00.825672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89f4dcbe-f71d-481c-bdec-bb13ba7046a1 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:00.826181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89f4dcbe-f71d-481c-bdec-bb13ba7046a1 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:00.826627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89f4dcbe-f71d-481c-bdec-bb13ba7046a1 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:00.827349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89f4dcbe-f71d-481c-bdec-bb13ba7046a1 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:00.828701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89f4dcbe-f71d-481c-bdec-bb13ba7046a1 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:00.829367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89f4dcbe-f71d-481c-bdec-bb13ba7046a1 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:01.172582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-89f4dcbe-f71d-481c-bdec-bb13ba7046a1 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538606670f9e4f239347abb3f5da8ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7586bc93b2f04b918195ee2c9e490b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:01.187022 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-89f4dcbe-f71d-481c-bdec-bb13ba7046a1 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb" status: 200 len: 1281 microversion: 2.1 time: 0.428061 Oct 10 23:40:01.192199 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2366/4596] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:00 2022] GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb => generated 1281 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:01.199843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-db9240a8-4a88-4159-99ca-1a8d68f96ba0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:01.207479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-db9240a8-4a88-4159-99ca-1a8d68f96ba0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:01.222747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db9240a8-4a88-4159-99ca-1a8d68f96ba0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:01.238224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db9240a8-4a88-4159-99ca-1a8d68f96ba0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:01.238788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db9240a8-4a88-4159-99ca-1a8d68f96ba0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:01.246333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db9240a8-4a88-4159-99ca-1a8d68f96ba0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:01.247146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db9240a8-4a88-4159-99ca-1a8d68f96ba0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:01.253171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db9240a8-4a88-4159-99ca-1a8d68f96ba0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:01.398129 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6fd1dca1-e351-4bbf-8db1-bd18354565df tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 2.603232 Oct 10 23:40:01.399474 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2231/4597] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:39:58 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 2606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:40:01.402929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-db9240a8-4a88-4159-99ca-1a8d68f96ba0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:01.408718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cc57e9c3-41c6-475b-84d8-ca14f6e111b9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:01.411691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cc57e9c3-41c6-475b-84d8-ca14f6e111b9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:01.413041 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-db9240a8-4a88-4159-99ca-1a8d68f96ba0 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 200 len: 1210 microversion: 2.1 time: 0.219406 Oct 10 23:40:01.413678 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2367/4598] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:01 2022] GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 1210 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:01.423621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-62d490fa-df85-44ef-93d7-898013b5d275 req-e901ff32-dc21-47cc-ac78-94434b3810d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "name": "network-vif-unplugged", "status": "completed", "tag": "7961149e-16c2-40ba-bb9c-9da27106648b"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:01.447500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc57e9c3-41c6-475b-84d8-ca14f6e111b9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:01.450104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc57e9c3-41c6-475b-84d8-ca14f6e111b9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:01.450880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc57e9c3-41c6-475b-84d8-ca14f6e111b9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:01.451781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-62d490fa-df85-44ef-93d7-898013b5d275 req-e901ff32-dc21-47cc-ac78-94434b3810d7 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:01.451995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc57e9c3-41c6-475b-84d8-ca14f6e111b9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:01.452284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-62d490fa-df85-44ef-93d7-898013b5d275 req-e901ff32-dc21-47cc-ac78-94434b3810d7 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:01.452988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-62d490fa-df85-44ef-93d7-898013b5d275 req-e901ff32-dc21-47cc-ac78-94434b3810d7 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:01.455580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc57e9c3-41c6-475b-84d8-ca14f6e111b9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:01.456475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc57e9c3-41c6-475b-84d8-ca14f6e111b9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:01.486822 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-62d490fa-df85-44ef-93d7-898013b5d275 req-e901ff32-dc21-47cc-ac78-94434b3810d7 service nova] Creating event network-vif-unplugged:7961149e-16c2-40ba-bb9c-9da27106648b for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:40:01.499444 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-62d490fa-df85-44ef-93d7-898013b5d275 req-e901ff32-dc21-47cc-ac78-94434b3810d7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079432 Oct 10 23:40:01.507370 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2368/4599] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:40:01.518587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d4fd7391-3b41-44e8-a4d5-6dbf3ea43ce9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:01.519636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d4fd7391-3b41-44e8-a4d5-6dbf3ea43ce9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:01.528249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4fd7391-3b41-44e8-a4d5-6dbf3ea43ce9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:01.528952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4fd7391-3b41-44e8-a4d5-6dbf3ea43ce9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:01.529554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4fd7391-3b41-44e8-a4d5-6dbf3ea43ce9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:01.530492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4fd7391-3b41-44e8-a4d5-6dbf3ea43ce9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:01.532446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4fd7391-3b41-44e8-a4d5-6dbf3ea43ce9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:01.532955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d4fd7391-3b41-44e8-a4d5-6dbf3ea43ce9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:01.867240 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d4fd7391-3b41-44e8-a4d5-6dbf3ea43ce9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.358104 Oct 10 23:40:01.873107 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2369/4600] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Oct 10 23:40:01 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-interface => generated 284 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:40:01.893753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c531ae16-1d55-4b62-a832-6e617592ae91 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Action: 'create', calling method: .version_select at 0x7f6633a54a60>, body: {"security_group_rule": {"parent_group_id": "a332edab-feec-44ca-9043-1bd357bb7a18", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:02.032211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cc57e9c3-41c6-475b-84d8-ca14f6e111b9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:02.051203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cc57e9c3-41c6-475b-84d8-ca14f6e111b9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:02.055994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cc57e9c3-41c6-475b-84d8-ca14f6e111b9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:02.064133 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cc57e9c3-41c6-475b-84d8-ca14f6e111b9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 2922 microversion: 2.42 time: 0.663308 Oct 10 23:40:02.065046 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2232/4601] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:01 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 2922 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:02.216224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-24cb6f5e-8719-4968-bb6d-c169f3eae011 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:02.219345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-24cb6f5e-8719-4968-bb6d-c169f3eae011 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] [instance: cdd533e1-ff6e-4525-b6cb-e425440195cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:02.229823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24cb6f5e-8719-4968-bb6d-c169f3eae011 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:02.234716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24cb6f5e-8719-4968-bb6d-c169f3eae011 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:02.237334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24cb6f5e-8719-4968-bb6d-c169f3eae011 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:02.247473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24cb6f5e-8719-4968-bb6d-c169f3eae011 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:02.248458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24cb6f5e-8719-4968-bb6d-c169f3eae011 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:02.249147 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24cb6f5e-8719-4968-bb6d-c169f3eae011 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:04.085580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-24cb6f5e-8719-4968-bb6d-c169f3eae011 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538606670f9e4f239347abb3f5da8ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7586bc93b2f04b918195ee2c9e490b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:04.111498 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-24cb6f5e-8719-4968-bb6d-c169f3eae011 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb" status: 200 len: 1323 microversion: 2.1 time: 1.897214 Oct 10 23:40:04.126509 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2233/4602] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:02 2022] GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb => generated 1323 bytes in 1916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:40:04.159200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f16d4d9c-4c0b-44e8-a7a4-087c9cd5f13f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:04.160309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f16d4d9c-4c0b-44e8-a7a4-087c9cd5f13f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:04.181983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f16d4d9c-4c0b-44e8-a7a4-087c9cd5f13f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:04.184046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f16d4d9c-4c0b-44e8-a7a4-087c9cd5f13f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:04.187655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f16d4d9c-4c0b-44e8-a7a4-087c9cd5f13f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:04.190735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f16d4d9c-4c0b-44e8-a7a4-087c9cd5f13f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:04.193677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f16d4d9c-4c0b-44e8-a7a4-087c9cd5f13f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:04.194452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f16d4d9c-4c0b-44e8-a7a4-087c9cd5f13f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:04.635645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f16d4d9c-4c0b-44e8-a7a4-087c9cd5f13f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:04.650345 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f16d4d9c-4c0b-44e8-a7a4-087c9cd5f13f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 200 len: 1272 microversion: 2.1 time: 0.521692 Oct 10 23:40:04.656331 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2234/4603] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:04 2022] GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 1272 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:04.670057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-334945d7-f308-424b-a85e-11e1cb5cf57f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:04.671786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-334945d7-f308-424b-a85e-11e1cb5cf57f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:04.681638 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c531ae16-1d55-4b62-a832-6e617592ae91 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.794378 Oct 10 23:40:04.682262 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2370/4604] 10.222.0.23 () {60 vars in 1195 bytes} [Mon Oct 10 23:40:01 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:40:04.688931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-7e2b8fd0-5c85-44b7-9a41-039420bd25e0 req-bbc1b136-b9a9-4487-a0ad-b32f9841b5f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "name": "network-vif-unplugged", "status": "completed", "tag": "4efdef6b-01db-43d4-9af9-1d488725b03c"}, {"server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "name": "network-vif-unplugged", "status": "completed", "tag": "9382b9bb-ac70-49e6-a877-15684a47dcb9"}, {"server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "name": "network-vif-unplugged", "status": "completed", "tag": "696f4f58-fa1e-4ecd-a136-8232df92640f"}, {"server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "name": "network-vif-unplugged", "status": "completed", "tag": "ba3bc036-b9db-4323-b4e1-9d329301f767"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:04.707508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-334945d7-f308-424b-a85e-11e1cb5cf57f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:04.713149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-334945d7-f308-424b-a85e-11e1cb5cf57f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:04.716297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-334945d7-f308-424b-a85e-11e1cb5cf57f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:04.719990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-334945d7-f308-424b-a85e-11e1cb5cf57f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:04.724477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-334945d7-f308-424b-a85e-11e1cb5cf57f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:04.728287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-334945d7-f308-424b-a85e-11e1cb5cf57f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:04.773028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7e2b8fd0-5c85-44b7-9a41-039420bd25e0 req-bbc1b136-b9a9-4487-a0ad-b32f9841b5f7 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:04.777276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7e2b8fd0-5c85-44b7-9a41-039420bd25e0 req-bbc1b136-b9a9-4487-a0ad-b32f9841b5f7 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:04.780369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7e2b8fd0-5c85-44b7-9a41-039420bd25e0 req-bbc1b136-b9a9-4487-a0ad-b32f9841b5f7 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:04.841726 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-7e2b8fd0-5c85-44b7-9a41-039420bd25e0 req-bbc1b136-b9a9-4487-a0ad-b32f9841b5f7 service nova] Creating event network-vif-unplugged:4efdef6b-01db-43d4-9af9-1d488725b03c for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:40:04.846180 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-7e2b8fd0-5c85-44b7-9a41-039420bd25e0 req-bbc1b136-b9a9-4487-a0ad-b32f9841b5f7 service nova] Creating event network-vif-unplugged:9382b9bb-ac70-49e6-a877-15684a47dcb9 for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:40:04.846180 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-7e2b8fd0-5c85-44b7-9a41-039420bd25e0 req-bbc1b136-b9a9-4487-a0ad-b32f9841b5f7 service nova] Creating event network-vif-unplugged:696f4f58-fa1e-4ecd-a136-8232df92640f for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:40:04.848281 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-7e2b8fd0-5c85-44b7-9a41-039420bd25e0 req-bbc1b136-b9a9-4487-a0ad-b32f9841b5f7 service nova] Creating event network-vif-unplugged:ba3bc036-b9db-4323-b4e1-9d329301f767 for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:40:04.875061 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-7e2b8fd0-5c85-44b7-9a41-039420bd25e0 req-bbc1b136-b9a9-4487-a0ad-b32f9841b5f7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.186804 Oct 10 23:40:04.880854 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2371/4605] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:40:04.904677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-3288b916-908c-4a66-8a4f-0b4cf706bef2 req-5e3ce949-655d-4b17-a0c8-534e8fa318e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "name": "network-vif-deleted", "tag": "9382b9bb-ac70-49e6-a877-15684a47dcb9"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:04.960312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3288b916-908c-4a66-8a4f-0b4cf706bef2 req-5e3ce949-655d-4b17-a0c8-534e8fa318e4 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:04.961271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3288b916-908c-4a66-8a4f-0b4cf706bef2 req-5e3ce949-655d-4b17-a0c8-534e8fa318e4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:04.974094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3288b916-908c-4a66-8a4f-0b4cf706bef2 req-5e3ce949-655d-4b17-a0c8-534e8fa318e4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:05.035545 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-3288b916-908c-4a66-8a4f-0b4cf706bef2 req-5e3ce949-655d-4b17-a0c8-534e8fa318e4 service nova] Creating event network-vif-deleted:9382b9bb-ac70-49e6-a877-15684a47dcb9 for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:40:05.053178 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-3288b916-908c-4a66-8a4f-0b4cf706bef2 req-5e3ce949-655d-4b17-a0c8-534e8fa318e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164737 Oct 10 23:40:05.069714 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2372/4606] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:40:05.090812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1f585552-461a-444d-a032-9ca08d820e31 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Action: 'create', calling method: .version_select at 0x7f6633a4a4c0>, body: {"security_group_rule": {"parent_group_id": "a332edab-feec-44ca-9043-1bd357bb7a18", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:05.336681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:40:05.775686 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-1f585552-461a-444d-a032-9ca08d820e31 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] HTTP exception thrown: This rule already exists in group a332edab-feec-44ca-9043-1bd357bb7a18 Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1f585552-461a-444d-a032-9ca08d820e31 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Request method failure captured: Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 138 Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK1OcODvGgTn8sjRn5SKyB1x0fH61tjIEZ_cV5FIVPZTNSTV6m3NXcExVenuMOuf3nJVuTLQ8bJbb91tmmN3zsnNTGFKxiJIqSfVlmij6FIx2h-M6XuWvl3bqOYrEWokGUAkDP6ZgbA-B5yHxLilrmFCS4YP6jjqZGeJxOuxGeWUmUo Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 3c564a1d1a7f41b1a027381c4ca1226f Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c564a1d1a7f41b1a027381c4ca1226f", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 3c564a1d1a7f41b1a027381c4ca1226f Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: d601cf80ff384dffa01cbfe5746a72ac Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: {"security_group_rule": {"parent_group_id": "a332edab-feec-44ca-9043-1bd357bb7a18", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: exception: This rule already exists in group a332edab-feec-44ca-9043-1bd357bb7a18 Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a332edab-feec-44ca-9043-1bd357bb7a18', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group a332edab-feec-44ca-9043-1bd357bb7a18 Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group a332edab-feec-44ca-9043-1bd357bb7a18 Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:05.793768 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:05.800294 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:05.800294 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:05.800294 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group a332edab-feec-44ca-9043-1bd357bb7a18 Oct 10 23:40:05.800294 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:05.802005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1f585552-461a-444d-a032-9ca08d820e31 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Returning 400 to user: This rule already exists in group a332edab-feec-44ca-9043-1bd357bb7a18 {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:05.807046 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1f585552-461a-444d-a032-9ca08d820e31 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.730525 Oct 10 23:40:05.809072 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2373/4607] 10.222.0.23 () {60 vars in 1195 bytes} [Mon Oct 10 23:40:05 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 738 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:40:05.843710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=8 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:40:05.853185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6d232e55-d6b7-4cae-8b69-81a074ce9b55 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:05.856458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6d232e55-d6b7-4cae-8b69-81a074ce9b55 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] [instance: cdd533e1-ff6e-4525-b6cb-e425440195cb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:05.884560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d232e55-d6b7-4cae-8b69-81a074ce9b55 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:05.887639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d232e55-d6b7-4cae-8b69-81a074ce9b55 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:05.891915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d232e55-d6b7-4cae-8b69-81a074ce9b55 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:05.901585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d232e55-d6b7-4cae-8b69-81a074ce9b55 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:05.903129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d232e55-d6b7-4cae-8b69-81a074ce9b55 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:05.904643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d232e55-d6b7-4cae-8b69-81a074ce9b55 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:06.315217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-334945d7-f308-424b-a85e-11e1cb5cf57f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:06.331266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-334945d7-f308-424b-a85e-11e1cb5cf57f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:06.336181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-334945d7-f308-424b-a85e-11e1cb5cf57f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:06.339638 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-334945d7-f308-424b-a85e-11e1cb5cf57f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 2875 microversion: 2.42 time: 1.681518 Oct 10 23:40:06.340978 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2235/4608] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:04 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 2875 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:06.359706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f2dd8fab-c400-444a-aec8-fcd19347e7eb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:06.360599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f2dd8fab-c400-444a-aec8-fcd19347e7eb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:06.374445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2dd8fab-c400-444a-aec8-fcd19347e7eb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:06.376477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2dd8fab-c400-444a-aec8-fcd19347e7eb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:06.377322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2dd8fab-c400-444a-aec8-fcd19347e7eb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:06.379171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2dd8fab-c400-444a-aec8-fcd19347e7eb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:06.380942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2dd8fab-c400-444a-aec8-fcd19347e7eb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:06.384777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2dd8fab-c400-444a-aec8-fcd19347e7eb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:06.677957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6d232e55-d6b7-4cae-8b69-81a074ce9b55 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538606670f9e4f239347abb3f5da8ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7586bc93b2f04b918195ee2c9e490b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:06.691528 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6d232e55-d6b7-4cae-8b69-81a074ce9b55 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb" status: 200 len: 1323 microversion: 2.1 time: 0.876590 Oct 10 23:40:06.711499 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2374/4609] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:05 2022] GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb => generated 1323 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:06.719892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3f7f978b-3a89-40a8-9f56-c2d295b03bd2 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Calling method '.version_select at 0x7f662a62eaf0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:06.737690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f2dd8fab-c400-444a-aec8-fcd19347e7eb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:06.749077 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f2dd8fab-c400-444a-aec8-fcd19347e7eb tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 200 len: 1272 microversion: 2.1 time: 0.405942 Oct 10 23:40:06.772841 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2236/4610] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:06 2022] GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 1272 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:06.792401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-0158ea03-406d-4e71-bdab-35d795114d9c req-8d065b74-2497-4e33-981a-51be3842e4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7a4001-50e2-4247-a60d-f82367072f61", "tag": "b24cdf0d-a2fa-4fcb-a031-a363754246f9"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:06.814915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0158ea03-406d-4e71-bdab-35d795114d9c req-8d065b74-2497-4e33-981a-51be3842e4b3 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:06.817820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0158ea03-406d-4e71-bdab-35d795114d9c req-8d065b74-2497-4e33-981a-51be3842e4b3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:06.821196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0158ea03-406d-4e71-bdab-35d795114d9c req-8d065b74-2497-4e33-981a-51be3842e4b3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:06.832059 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-0158ea03-406d-4e71-bdab-35d795114d9c req-8d065b74-2497-4e33-981a-51be3842e4b3 service nova] Creating event network-changed:b24cdf0d-a2fa-4fcb-a031-a363754246f9 for instance aa7a4001-50e2-4247-a60d-f82367072f61 on n-h1-860864-2 Oct 10 23:40:06.854355 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-0158ea03-406d-4e71-bdab-35d795114d9c req-8d065b74-2497-4e33-981a-51be3842e4b3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070970 Oct 10 23:40:06.855783 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2237/4611] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:40:07.175646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-b6e4db67-6596-4020-ad3e-e05e257627e9 req-cc26d45b-e9a8-4f9d-bb70-21262fecf1ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "name": "network-vif-deleted", "tag": "4efdef6b-01db-43d4-9af9-1d488725b03c"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:07.199779 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3f7f978b-3a89-40a8-9f56-c2d295b03bd2 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/fcba8cf0-7ded-4799-896a-f4e290528e9f" status: 202 len: 0 microversion: 2.1 time: 0.487047 Oct 10 23:40:07.200282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b6e4db67-6596-4020-ad3e-e05e257627e9 req-cc26d45b-e9a8-4f9d-bb70-21262fecf1ee service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:07.200395 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2375/4612] 10.222.0.23 () {58 vars in 1287 bytes} [Mon Oct 10 23:40:06 2022] DELETE /compute/v2.1/os-security-group-rules/fcba8cf0-7ded-4799-896a-f4e290528e9f => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:40:07.205483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b6e4db67-6596-4020-ad3e-e05e257627e9 req-cc26d45b-e9a8-4f9d-bb70-21262fecf1ee service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:07.205483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b6e4db67-6596-4020-ad3e-e05e257627e9 req-cc26d45b-e9a8-4f9d-bb70-21262fecf1ee service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:07.211149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a16292c6-0956-4761-957a-3b2bc3a76b59 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Action: 'create', calling method: .version_select at 0x7f66339828b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-614840690", "description": "tempest-description-717498004"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:07.234603 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-b6e4db67-6596-4020-ad3e-e05e257627e9 req-cc26d45b-e9a8-4f9d-bb70-21262fecf1ee service nova] Creating event network-vif-deleted:4efdef6b-01db-43d4-9af9-1d488725b03c for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:40:07.242132 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-b6e4db67-6596-4020-ad3e-e05e257627e9 req-cc26d45b-e9a8-4f9d-bb70-21262fecf1ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072296 Oct 10 23:40:07.258359 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2238/4613] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:40:07.383528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3ebe10f5-8c8f-4af0-8548-6cfed73bfede tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:07.384643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3ebe10f5-8c8f-4af0-8548-6cfed73bfede tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:07.435344 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a16292c6-0956-4761-957a-3b2bc3a76b59 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.218220 Oct 10 23:40:07.435764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ebe10f5-8c8f-4af0-8548-6cfed73bfede tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:07.435764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ebe10f5-8c8f-4af0-8548-6cfed73bfede tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:07.435764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ebe10f5-8c8f-4af0-8548-6cfed73bfede tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:07.435764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ebe10f5-8c8f-4af0-8548-6cfed73bfede tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:07.436452 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2376/4614] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:40:07 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:40:07.438313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ebe10f5-8c8f-4af0-8548-6cfed73bfede tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:07.442533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1936b8b3-12d9-4ad2-a35c-e32d6d865c9d tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Action: 'create', calling method: .version_select at 0x7f6633990790>, body: {"security_group_rule": {"parent_group_id": "9e21b939-a42d-48fd-bbf4-6278cce45596", "ip_protocol": "tcp", "from_port": 1908229822, "to_port": 22}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:07.443230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ebe10f5-8c8f-4af0-8548-6cfed73bfede tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:07.486336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:40:07.527461 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-1936b8b3-12d9-4ad2-a35c-e32d6d865c9d tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] HTTP exception thrown: Invalid port range 1908229822:22. Former value cannot be greater than the later Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1936b8b3-12d9-4ad2-a35c-e32d6d865c9d tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Request method failure captured: Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 146 Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK1OcODvGgTn8sjRn5SKyB1x0fH61tjIEZ_cV5FIVPZTNSTV6m3NXcExVenuMOuf3nJVuTLQ8bJbb91tmmN3zsnNTGFKxiJIqSfVlmij6FIx2h-M6XuWvl3bqOYrEWokGUAkDP6ZgbA-B5yHxLilrmFCS4YP6jjqZGeJxOuxGeWUmUo Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 3c564a1d1a7f41b1a027381c4ca1226f Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c564a1d1a7f41b1a027381c4ca1226f", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 3c564a1d1a7f41b1a027381c4ca1226f Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: d601cf80ff384dffa01cbfe5746a72ac Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: {"security_group_rule": {"parent_group_id": "9e21b939-a42d-48fd-bbf4-6278cce45596", "ip_protocol": "tcp", "from_port": 1908229822, "to_port": 22}} Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: exception: Invalid port range 1908229822:22. Former value cannot be greater than the later Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9e21b939-a42d-48fd-bbf4-6278cce45596', 'ip_protocol': 'tcp', 'from_port': 1908229822, 'to_port': 22}}} Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1908229822:22. Former value cannot be greater than the later Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1908229822:22. Former value cannot be greater than the later Oct 10 23:40:07.529319 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:07.545400 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:07.545400 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:07.545400 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:07.545400 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:07.545400 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:07.545400 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:07.545400 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:07.545400 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1908229822:22. Former value cannot be greater than the later Oct 10 23:40:07.545400 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:07.545400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1936b8b3-12d9-4ad2-a35c-e32d6d865c9d tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Returning 400 to user: Invalid port range 1908229822:22. Former value cannot be greater than the later {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:07.545400 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1936b8b3-12d9-4ad2-a35c-e32d6d865c9d tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.096463 Oct 10 23:40:07.545400 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2377/4615] 10.222.0.23 () {60 vars in 1195 bytes} [Mon Oct 10 23:40:07 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:40:07.545400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c347dba1-4466-4598-bce6-5251a5371c89 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Action: 'create', calling method: .version_select at 0x7f6633a699d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1725441557", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-c347dba1-4466-4598-bce6-5251a5371c89 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] HTTP exception thrown: Security group id should be uuid Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c347dba1-4466-4598-bce6-5251a5371c89 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Request method failure captured: Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 131 Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK1OcODvGgTn8sjRn5SKyB1x0fH61tjIEZ_cV5FIVPZTNSTV6m3NXcExVenuMOuf3nJVuTLQ8bJbb91tmmN3zsnNTGFKxiJIqSfVlmij6FIx2h-M6XuWvl3bqOYrEWokGUAkDP6ZgbA-B5yHxLilrmFCS4YP6jjqZGeJxOuxGeWUmUo Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 3c564a1d1a7f41b1a027381c4ca1226f Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c564a1d1a7f41b1a027381c4ca1226f", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 3c564a1d1a7f41b1a027381c4ca1226f Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: d601cf80ff384dffa01cbfe5746a72ac Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1725441557", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: exception: Security group id should be uuid Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1725441557', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:07.550276 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:07.568894 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:07.568894 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:07.568894 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:07.568894 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 10 23:40:07.568894 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:07.568894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c347dba1-4466-4598-bce6-5251a5371c89 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Returning 400 to user: Security group id should be uuid {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:07.568894 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c347dba1-4466-4598-bce6-5251a5371c89 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.011813 Oct 10 23:40:07.568894 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2378/4616] 10.222.0.23 () {60 vars in 1195 bytes} [Mon Oct 10 23:40:07 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 23:40:07.572183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f8bcea17-6818-4ce8-a8c7-cbd5fa787d4e tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Action: 'create', calling method: .version_select at 0x7f662a6291f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-582376174", "description": "tempest-description-679917571"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:07.840292 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f8bcea17-6818-4ce8-a8c7-cbd5fa787d4e tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.273434 Oct 10 23:40:07.841057 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2379/4617] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:40:07 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:40:07.847409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-96047f92-ce06-4d0a-b478-4e327cdcc9d4 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:07.848204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-96047f92-ce06-4d0a-b478-4e327cdcc9d4 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] [instance: cdd533e1-ff6e-4525-b6cb-e425440195cb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:07.872347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96047f92-ce06-4d0a-b478-4e327cdcc9d4 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:07.873051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96047f92-ce06-4d0a-b478-4e327cdcc9d4 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:07.873701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96047f92-ce06-4d0a-b478-4e327cdcc9d4 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:07.874784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96047f92-ce06-4d0a-b478-4e327cdcc9d4 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:07.875432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96047f92-ce06-4d0a-b478-4e327cdcc9d4 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:07.876162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96047f92-ce06-4d0a-b478-4e327cdcc9d4 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:08.087968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-96047f92-ce06-4d0a-b478-4e327cdcc9d4 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538606670f9e4f239347abb3f5da8ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7586bc93b2f04b918195ee2c9e490b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:08.098060 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-96047f92-ce06-4d0a-b478-4e327cdcc9d4 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb" status: 200 len: 1323 microversion: 2.1 time: 0.255746 Oct 10 23:40:08.098671 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2380/4618] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:07 2022] GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb => generated 1323 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:08.126619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f3290446-57c1-47bf-9da9-170d23071897 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:08.128174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f3290446-57c1-47bf-9da9-170d23071897 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:08.136600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3290446-57c1-47bf-9da9-170d23071897 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:08.137657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3290446-57c1-47bf-9da9-170d23071897 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:08.139036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3290446-57c1-47bf-9da9-170d23071897 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:08.140268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3290446-57c1-47bf-9da9-170d23071897 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:08.141044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3290446-57c1-47bf-9da9-170d23071897 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:08.141507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3290446-57c1-47bf-9da9-170d23071897 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:08.220311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f3290446-57c1-47bf-9da9-170d23071897 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:08.230466 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f3290446-57c1-47bf-9da9-170d23071897 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 200 len: 1272 microversion: 2.1 time: 0.117547 Oct 10 23:40:08.231238 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2381/4619] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:08 2022] GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 1272 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:08.242732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-15fa1cac-cc80-48ff-8073-528b40e5b5eb tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Action: 'create', calling method: .version_select at 0x7f66339905e0>, body: {"security_group_rule": {"parent_group_id": "9b143211-8d32-4c90-8840-a9b096d7cd2a", "ip_protocol": "tempest-999-1084684541", "from_port": 22, "to_port": 22}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:08.392510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3ebe10f5-8c8f-4af0-8548-6cfed73bfede tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:08.470831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3ebe10f5-8c8f-4af0-8548-6cfed73bfede tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:08.474886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3ebe10f5-8c8f-4af0-8548-6cfed73bfede tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:08.476227 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3ebe10f5-8c8f-4af0-8548-6cfed73bfede tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 2714 microversion: 2.42 time: 1.098211 Oct 10 23:40:08.483059 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2239/4620] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:07 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 2714 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:40:08.778010 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-15fa1cac-cc80-48ff-8073-528b40e5b5eb tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] HTTP exception thrown: Invalid IP protocol tempest-999-1084684541. Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-15fa1cac-cc80-48ff-8073-528b40e5b5eb tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Request method failure captured: Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 157 Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK1OcODvGgTn8sjRn5SKyB1x0fH61tjIEZ_cV5FIVPZTNSTV6m3NXcExVenuMOuf3nJVuTLQ8bJbb91tmmN3zsnNTGFKxiJIqSfVlmij6FIx2h-M6XuWvl3bqOYrEWokGUAkDP6ZgbA-B5yHxLilrmFCS4YP6jjqZGeJxOuxGeWUmUo Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 3c564a1d1a7f41b1a027381c4ca1226f Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c564a1d1a7f41b1a027381c4ca1226f", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 3c564a1d1a7f41b1a027381c4ca1226f Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: d601cf80ff384dffa01cbfe5746a72ac Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: {"security_group_rule": {"parent_group_id": "9b143211-8d32-4c90-8840-a9b096d7cd2a", "ip_protocol": "tempest-999-1084684541", "from_port": 22, "to_port": 22}} Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: exception: Invalid IP protocol tempest-999-1084684541. Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9b143211-8d32-4c90-8840-a9b096d7cd2a', 'ip_protocol': 'tempest-999-1084684541', 'from_port': 22, 'to_port': 22}}} Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1084684541. Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1084684541. Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:08.780057 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:08.785149 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:08.785149 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:08.785149 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:08.785149 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:08.785149 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:08.785149 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:08.785149 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1084684541. Oct 10 23:40:08.785149 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:08.786834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-15fa1cac-cc80-48ff-8073-528b40e5b5eb tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Returning 400 to user: Invalid IP protocol tempest-999-1084684541. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:08.787940 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-15fa1cac-cc80-48ff-8073-528b40e5b5eb tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.555769 Oct 10 23:40:08.789017 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2382/4621] 10.222.0.23 () {60 vars in 1195 bytes} [Mon Oct 10 23:40:08 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 557 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 23:40:08.803666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f7b025a8-edcd-4887-a5e9-fb6d5e303ea6 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Action: 'create', calling method: .version_select at 0x7f662a3b1f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-638108065", "description": "tempest-description-293102701"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:09.125623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e849f166-84fe-45ab-9709-324439074fc5 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:09.126458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e849f166-84fe-45ab-9709-324439074fc5 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] [instance: cdd533e1-ff6e-4525-b6cb-e425440195cb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:09.143530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e849f166-84fe-45ab-9709-324439074fc5 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:09.145994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e849f166-84fe-45ab-9709-324439074fc5 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:09.146455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e849f166-84fe-45ab-9709-324439074fc5 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:09.153854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e849f166-84fe-45ab-9709-324439074fc5 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:09.154354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e849f166-84fe-45ab-9709-324439074fc5 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:09.154831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e849f166-84fe-45ab-9709-324439074fc5 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:09.364018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e849f166-84fe-45ab-9709-324439074fc5 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538606670f9e4f239347abb3f5da8ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7586bc93b2f04b918195ee2c9e490b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:09.383773 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e849f166-84fe-45ab-9709-324439074fc5 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb" status: 200 len: 1323 microversion: 2.1 time: 0.264547 Oct 10 23:40:09.387440 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2383/4622] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:09 2022] GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb => generated 1323 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:09.399793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3f70e825-8861-44eb-838b-bc794cebc14e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:09.400988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3f70e825-8861-44eb-838b-bc794cebc14e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:09.420243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f70e825-8861-44eb-838b-bc794cebc14e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:09.420755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f70e825-8861-44eb-838b-bc794cebc14e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:09.422051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f70e825-8861-44eb-838b-bc794cebc14e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:09.422865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f70e825-8861-44eb-838b-bc794cebc14e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:09.423300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f70e825-8861-44eb-838b-bc794cebc14e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:09.423988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f70e825-8861-44eb-838b-bc794cebc14e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:09.533306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:40:09.636795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:40:09.711130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3f70e825-8861-44eb-838b-bc794cebc14e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:09.727426 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3f70e825-8861-44eb-838b-bc794cebc14e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 200 len: 1314 microversion: 2.1 time: 0.334429 Oct 10 23:40:09.741400 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2384/4623] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:09 2022] GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:09.746110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-eb61c80a-2579-49f7-a2c0-1bb4e4d39dbf tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:09.747930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-eb61c80a-2579-49f7-a2c0-1bb4e4d39dbf tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:09.758352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb61c80a-2579-49f7-a2c0-1bb4e4d39dbf tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:09.759851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb61c80a-2579-49f7-a2c0-1bb4e4d39dbf tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:09.760498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb61c80a-2579-49f7-a2c0-1bb4e4d39dbf tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:09.761474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb61c80a-2579-49f7-a2c0-1bb4e4d39dbf tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:09.762018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb61c80a-2579-49f7-a2c0-1bb4e4d39dbf tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:09.763586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb61c80a-2579-49f7-a2c0-1bb4e4d39dbf tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:10.034250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-eb61c80a-2579-49f7-a2c0-1bb4e4d39dbf tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:10.059366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-eb61c80a-2579-49f7-a2c0-1bb4e4d39dbf tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:10.063352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-eb61c80a-2579-49f7-a2c0-1bb4e4d39dbf tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:10.066059 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-eb61c80a-2579-49f7-a2c0-1bb4e4d39dbf tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 2667 microversion: 2.42 time: 0.327810 Oct 10 23:40:10.067593 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2385/4624] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:09 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 2667 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:10.078004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-186645ee-872a-42aa-9ed8-584311af104c req-193bc9c6-47f4-4b3d-a3fc-b838498ecd35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdd533e1-ff6e-4525-b6cb-e425440195cb", "tag": "11024cf8-8768-4f1d-8051-9bfef8831788"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:10.103932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-186645ee-872a-42aa-9ed8-584311af104c req-193bc9c6-47f4-4b3d-a3fc-b838498ecd35 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:10.104385 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-186645ee-872a-42aa-9ed8-584311af104c req-193bc9c6-47f4-4b3d-a3fc-b838498ecd35 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:10.115038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-186645ee-872a-42aa-9ed8-584311af104c req-193bc9c6-47f4-4b3d-a3fc-b838498ecd35 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:10.145167 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-186645ee-872a-42aa-9ed8-584311af104c req-193bc9c6-47f4-4b3d-a3fc-b838498ecd35 service nova] Creating event network-changed:11024cf8-8768-4f1d-8051-9bfef8831788 for instance cdd533e1-ff6e-4525-b6cb-e425440195cb on n-h2-860864-2 Oct 10 23:40:10.154322 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-186645ee-872a-42aa-9ed8-584311af104c req-193bc9c6-47f4-4b3d-a3fc-b838498ecd35 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083050 Oct 10 23:40:10.157037 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2386/4625] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:40:10.284510 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f7b025a8-edcd-4887-a5e9-fb6d5e303ea6 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.489301 Oct 10 23:40:10.289886 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2240/4626] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:40:08 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:40:10.302152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1048cad4-2792-4cec-b78d-3ff7c2064620 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Action: 'create', calling method: .version_select at 0x7f6633a46040>, body: {"security_group_rule": {"parent_group_id": "cb80be84-8520-4d7f-abbc-7a52f34bee43", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:10.402372 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-1048cad4-2792-4cec-b78d-3ff7c2064620 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1048cad4-2792-4cec-b78d-3ff7c2064620 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Request method failure captured: Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 138 Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK1OcODvGgTn8sjRn5SKyB1x0fH61tjIEZ_cV5FIVPZTNSTV6m3NXcExVenuMOuf3nJVuTLQ8bJbb91tmmN3zsnNTGFKxiJIqSfVlmij6FIx2h-M6XuWvl3bqOYrEWokGUAkDP6ZgbA-B5yHxLilrmFCS4YP6jjqZGeJxOuxGeWUmUo Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 3c564a1d1a7f41b1a027381c4ca1226f Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c564a1d1a7f41b1a027381c4ca1226f", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 3c564a1d1a7f41b1a027381c4ca1226f Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: d601cf80ff384dffa01cbfe5746a72ac Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: {"security_group_rule": {"parent_group_id": "cb80be84-8520-4d7f-abbc-7a52f34bee43", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cb80be84-8520-4d7f-abbc-7a52f34bee43', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 10 23:40:10.406737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:10.412162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:10.412162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:10.412162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:10.412162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:10.412162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:10.412162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:10.412162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:10.412162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 10 23:40:10.412162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:10.415334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1048cad4-2792-4cec-b78d-3ff7c2064620 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:10.416845 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1048cad4-2792-4cec-b78d-3ff7c2064620 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.120364 Oct 10 23:40:10.418326 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2387/4627] 10.222.0.23 () {60 vars in 1195 bytes} [Mon Oct 10 23:40:10 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:40:10.419649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e904415d-5371-4c05-b9d4-80f499815945 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:10.420293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e904415d-5371-4c05-b9d4-80f499815945 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] [instance: cdd533e1-ff6e-4525-b6cb-e425440195cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:10.430699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e904415d-5371-4c05-b9d4-80f499815945 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:10.431534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e904415d-5371-4c05-b9d4-80f499815945 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:10.431914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e904415d-5371-4c05-b9d4-80f499815945 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:10.434057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e904415d-5371-4c05-b9d4-80f499815945 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:10.435135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3fe77fb1-034c-406c-ac7c-ac998cc01546 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Action: 'create', calling method: .version_select at 0x7f6633a699d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-527212489", "description": "tempest-description-1000105612"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:10.435364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e904415d-5371-4c05-b9d4-80f499815945 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:10.435773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e904415d-5371-4c05-b9d4-80f499815945 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:10.705851 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3fe77fb1-034c-406c-ac7c-ac998cc01546 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.278723 Oct 10 23:40:10.708494 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2388/4628] 10.222.0.23 () {60 vars in 1180 bytes} [Mon Oct 10 23:40:10 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:40:10.722370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e60e5a50-3e7d-4913-95e1-8dcd0ff005de tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Action: 'create', calling method: .version_select at 0x7f6633990f70>, body: {"security_group_rule": {"parent_group_id": "6af772bf-bfb5-404c-8441-f314eb147357", "ip_protocol": "tcp", "from_port": 22, "to_port": 1027682668}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:10.787449 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-e60e5a50-3e7d-4913-95e1-8dcd0ff005de tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] HTTP exception thrown: Invalid port range 22:1027682668. Valid TCP ports should be between 1-65535 Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e60e5a50-3e7d-4913-95e1-8dcd0ff005de tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Request method failure captured: Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 146 Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK1OcODvGgTn8sjRn5SKyB1x0fH61tjIEZ_cV5FIVPZTNSTV6m3NXcExVenuMOuf3nJVuTLQ8bJbb91tmmN3zsnNTGFKxiJIqSfVlmij6FIx2h-M6XuWvl3bqOYrEWokGUAkDP6ZgbA-B5yHxLilrmFCS4YP6jjqZGeJxOuxGeWUmUo Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 3c564a1d1a7f41b1a027381c4ca1226f Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c564a1d1a7f41b1a027381c4ca1226f", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 3c564a1d1a7f41b1a027381c4ca1226f Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: d601cf80ff384dffa01cbfe5746a72ac Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: {"security_group_rule": {"parent_group_id": "6af772bf-bfb5-404c-8441-f314eb147357", "ip_protocol": "tcp", "from_port": 22, "to_port": 1027682668}} Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: exception: Invalid port range 22:1027682668. Valid TCP ports should be between 1-65535 Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6af772bf-bfb5-404c-8441-f314eb147357', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1027682668}}} Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1027682668. Valid TCP ports should be between 1-65535 Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1027682668. Valid TCP ports should be between 1-65535 Oct 10 23:40:10.792596 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:10.810204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:10.810204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:10.810204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:10.810204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:10.810204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:10.810204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:10.810204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:10.810204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1027682668. Valid TCP ports should be between 1-65535 Oct 10 23:40:10.810204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:10.810204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e60e5a50-3e7d-4913-95e1-8dcd0ff005de tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Returning 400 to user: Invalid port range 22:1027682668. Valid TCP ports should be between 1-65535 {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:10.810204 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e60e5a50-3e7d-4913-95e1-8dcd0ff005de tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.082046 Oct 10 23:40:10.810204 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2389/4629] 10.222.0.23 () {60 vars in 1195 bytes} [Mon Oct 10 23:40:10 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:40:10.814207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cb54a3d4-f00e-4a2c-b0f0-c8e67ef51f56 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:10.815906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cb54a3d4-f00e-4a2c-b0f0-c8e67ef51f56 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:10.825167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb54a3d4-f00e-4a2c-b0f0-c8e67ef51f56 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:10.826209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb54a3d4-f00e-4a2c-b0f0-c8e67ef51f56 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:10.826668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb54a3d4-f00e-4a2c-b0f0-c8e67ef51f56 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:10.827406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb54a3d4-f00e-4a2c-b0f0-c8e67ef51f56 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:10.828495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb54a3d4-f00e-4a2c-b0f0-c8e67ef51f56 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:10.829091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb54a3d4-f00e-4a2c-b0f0-c8e67ef51f56 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:11.102656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cb54a3d4-f00e-4a2c-b0f0-c8e67ef51f56 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:11.125080 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cb54a3d4-f00e-4a2c-b0f0-c8e67ef51f56 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 200 len: 1314 microversion: 2.1 time: 0.320730 Oct 10 23:40:11.145432 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2390/4630] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:10 2022] GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:11.164225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9333755d-a3f9-4bd0-b8e7-506509d888d1 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Action: 'create', calling method: .version_select at 0x7f662a62ed30>, body: {"security_group_rule": {"parent_group_id": "4ce12db6-6ea7-45e3-88c4-1a59d4ad2927", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:11.219908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e904415d-5371-4c05-b9d4-80f499815945 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538606670f9e4f239347abb3f5da8ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7586bc93b2f04b918195ee2c9e490b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:11.254552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG neutronclient.v2_0.client [None req-9333755d-a3f9-4bd0-b8e7-506509d888d1 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4ce12db6-6ea7-45e3-88c4-1a59d4ad2927 does not exist", "detail": ""}} {{(pid=120613) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:40:11.256797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.security_group_api [None req-9333755d-a3f9-4bd0-b8e7-506509d888d1 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Neutron security group 4ce12db6-6ea7-45e3-88c4-1a59d4ad2927 not found {{(pid=120613) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 23:40:11.258224 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-9333755d-a3f9-4bd0-b8e7-506509d888d1 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] HTTP exception thrown: Security group 4ce12db6-6ea7-45e3-88c4-1a59d4ad2927 does not exist Oct 10 23:40:11.258224 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-e1dcf8df-ac9b-49a0-a1a5-15da350ca5c9'] Oct 10 23:40:11.258721 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e904415d-5371-4c05-b9d4-80f499815945 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb" status: 200 len: 1323 microversion: 2.1 time: 0.831693 Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9333755d-a3f9-4bd0-b8e7-506509d888d1 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Request method failure captured: Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 138 Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK1OcODvGgTn8sjRn5SKyB1x0fH61tjIEZ_cV5FIVPZTNSTV6m3NXcExVenuMOuf3nJVuTLQ8bJbb91tmmN3zsnNTGFKxiJIqSfVlmij6FIx2h-M6XuWvl3bqOYrEWokGUAkDP6ZgbA-B5yHxLilrmFCS4YP6jjqZGeJxOuxGeWUmUo Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 3c564a1d1a7f41b1a027381c4ca1226f Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c564a1d1a7f41b1a027381c4ca1226f", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 3c564a1d1a7f41b1a027381c4ca1226f Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: d601cf80ff384dffa01cbfe5746a72ac Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: {"security_group_rule": {"parent_group_id": "4ce12db6-6ea7-45e3-88c4-1a59d4ad2927", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: exception: Security group 4ce12db6-6ea7-45e3-88c4-1a59d4ad2927 does not exist Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-e1dcf8df-ac9b-49a0-a1a5-15da350ca5c9'] Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4ce12db6-6ea7-45e3-88c4-1a59d4ad2927', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:40:11.276640 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4ce12db6-6ea7-45e3-88c4-1a59d4ad2927 does not exist Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1dcf8df-ac9b-49a0-a1a5-15da350ca5c9'] Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4ce12db6-6ea7-45e3-88c4-1a59d4ad2927 does not exist Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1dcf8df-ac9b-49a0-a1a5-15da350ca5c9'] Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4ce12db6-6ea7-45e3-88c4-1a59d4ad2927 does not exist Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1dcf8df-ac9b-49a0-a1a5-15da350ca5c9'] Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4ce12db6-6ea7-45e3-88c4-1a59d4ad2927 does not exist Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1dcf8df-ac9b-49a0-a1a5-15da350ca5c9'] Oct 10 23:40:11.287609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:11.299776 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2241/4631] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:10 2022] GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb => generated 1323 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:40:11.301748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9333755d-a3f9-4bd0-b8e7-506509d888d1 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Returning 404 to user: Security group 4ce12db6-6ea7-45e3-88c4-1a59d4ad2927 does not exist Oct 10 23:40:11.301748 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-e1dcf8df-ac9b-49a0-a1a5-15da350ca5c9'] {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:11.301748 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9333755d-a3f9-4bd0-b8e7-506509d888d1 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.139180 Oct 10 23:40:11.301748 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2391/4632] 10.222.0.23 () {60 vars in 1195 bytes} [Mon Oct 10 23:40:11 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:40:11.306613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b8db9070-1b27-444f-9089-149aec40abaa tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Calling method '.version_select at 0x7f6633a69160>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:11.317693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-08bf1e46-bcf0-472c-877e-dce5f959b6bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:11.318273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-08bf1e46-bcf0-472c-877e-dce5f959b6bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:11.350605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08bf1e46-bcf0-472c-877e-dce5f959b6bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:11.357200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG neutronclient.v2_0.client [None req-b8db9070-1b27-444f-9089-149aec40abaa tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 31c4331a-f91e-47f0-8cd1-15e940182c69 does not exist", "detail": ""}} {{(pid=120613) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 23:40:11.358240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08bf1e46-bcf0-472c-877e-dce5f959b6bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:11.358976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.security_group_api [None req-b8db9070-1b27-444f-9089-149aec40abaa tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Neutron security group rule 31c4331a-f91e-47f0-8cd1-15e940182c69 not found {{(pid=120613) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 10 23:40:11.359644 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-b8db9070-1b27-444f-9089-149aec40abaa tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] HTTP exception thrown: Security group rule 31c4331a-f91e-47f0-8cd1-15e940182c69 does not exist Oct 10 23:40:11.359644 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-a8ec036c-2ba1-437f-96f6-17da51b2a624'] Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b8db9070-1b27-444f-9089-149aec40abaa tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Request method failure captured: Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/os-security-group-rules/31c4331a-f91e-47f0-8cd1-15e940182c69 HTTP/1.1 Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK1OcODvGgTn8sjRn5SKyB1x0fH61tjIEZ_cV5FIVPZTNSTV6m3NXcExVenuMOuf3nJVuTLQ8bJbb91tmmN3zsnNTGFKxiJIqSfVlmij6FIx2h-M6XuWvl3bqOYrEWokGUAkDP6ZgbA-B5yHxLilrmFCS4YP6jjqZGeJxOuxGeWUmUo Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 3c564a1d1a7f41b1a027381c4ca1226f Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3c564a1d1a7f41b1a027381c4ca1226f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3c564a1d1a7f41b1a027381c4ca1226f", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 3c564a1d1a7f41b1a027381c4ca1226f Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921 Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: d601cf80ff384dffa01cbfe5746a72ac Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: exception: Security group rule 31c4331a-f91e-47f0-8cd1-15e940182c69 does not exist Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-a8ec036c-2ba1-437f-96f6-17da51b2a624'] Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '31c4331a-f91e-47f0-8cd1-15e940182c69'} Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 23:40:11.361860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 31c4331a-f91e-47f0-8cd1-15e940182c69 does not exist Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8ec036c-2ba1-437f-96f6-17da51b2a624'] Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 31c4331a-f91e-47f0-8cd1-15e940182c69 does not exist Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8ec036c-2ba1-437f-96f6-17da51b2a624'] Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 31c4331a-f91e-47f0-8cd1-15e940182c69 does not exist Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8ec036c-2ba1-437f-96f6-17da51b2a624'] Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 31c4331a-f91e-47f0-8cd1-15e940182c69 does not exist Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8ec036c-2ba1-437f-96f6-17da51b2a624'] Oct 10 23:40:11.370328 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:11.376555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08bf1e46-bcf0-472c-877e-dce5f959b6bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:11.376555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08bf1e46-bcf0-472c-877e-dce5f959b6bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:11.376555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08bf1e46-bcf0-472c-877e-dce5f959b6bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:11.376555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08bf1e46-bcf0-472c-877e-dce5f959b6bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:11.378165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b8db9070-1b27-444f-9089-149aec40abaa tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Returning 404 to user: Security group rule 31c4331a-f91e-47f0-8cd1-15e940182c69 does not exist Oct 10 23:40:11.378165 n-d-860864-2 devstack@n-api.service[120613]: Neutron server returns request_ids: ['req-a8ec036c-2ba1-437f-96f6-17da51b2a624'] {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:11.378721 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b8db9070-1b27-444f-9089-149aec40abaa tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/31c4331a-f91e-47f0-8cd1-15e940182c69" status: 404 len: 199 microversion: 2.1 time: 0.077569 Oct 10 23:40:11.383391 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2392/4633] 10.222.0.23 () {58 vars in 1287 bytes} [Mon Oct 10 23:40:11 2022] DELETE /compute/v2.1/os-security-group-rules/31c4331a-f91e-47f0-8cd1-15e940182c69 => generated 199 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:40:11.400242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e9a8f02e-7263-426a-9157-18d51df9d6a6 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Calling method '.version_select at 0x7f6633a45d30>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:11.707594 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e9a8f02e-7263-426a-9157-18d51df9d6a6 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/6af772bf-bfb5-404c-8441-f314eb147357" status: 202 len: 0 microversion: 2.1 time: 0.317851 Oct 10 23:40:11.708614 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2393/4634] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:40:11 2022] DELETE /compute/v2.1/os-security-groups/6af772bf-bfb5-404c-8441-f314eb147357 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 23:40:11.734240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0735608e-5499-470d-afc8-688bc5b0a8b3 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Calling method '.version_select at 0x7f6633a69c10>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:12.209310 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0735608e-5499-470d-afc8-688bc5b0a8b3 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/cb80be84-8520-4d7f-abbc-7a52f34bee43" status: 202 len: 0 microversion: 2.1 time: 0.490902 Oct 10 23:40:12.213663 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2394/4635] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:40:11 2022] DELETE /compute/v2.1/os-security-groups/cb80be84-8520-4d7f-abbc-7a52f34bee43 => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:40:12.219667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-89a34270-1074-438c-895c-b6617dc88308 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:12.220554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-89a34270-1074-438c-895c-b6617dc88308 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:12.678206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89a34270-1074-438c-895c-b6617dc88308 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:12.679594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89a34270-1074-438c-895c-b6617dc88308 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:12.680726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89a34270-1074-438c-895c-b6617dc88308 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:12.682406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89a34270-1074-438c-895c-b6617dc88308 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:12.684320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89a34270-1074-438c-895c-b6617dc88308 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:12.685524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89a34270-1074-438c-895c-b6617dc88308 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:12.800265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-08bf1e46-bcf0-472c-877e-dce5f959b6bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:12.820481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-08bf1e46-bcf0-472c-877e-dce5f959b6bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:12.826235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-08bf1e46-bcf0-472c-877e-dce5f959b6bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:12.827733 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-08bf1e46-bcf0-472c-877e-dce5f959b6bd tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 2667 microversion: 2.42 time: 1.543631 Oct 10 23:40:12.829621 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2242/4636] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:11 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 2667 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:12.876214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-070a7011-d8f6-4f72-bb96-4faa07cab7ae tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Calling method '.version_select at 0x7f662a430280>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:13.005943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-89a34270-1074-438c-895c-b6617dc88308 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:13.016557 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-89a34270-1074-438c-895c-b6617dc88308 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 200 len: 1314 microversion: 2.1 time: 0.801515 Oct 10 23:40:13.041559 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2395/4637] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:12 2022] GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 1314 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:13.066276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-87fcbc63-91bc-436f-8888-5549a14789a4 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:13.068968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-87fcbc63-91bc-436f-8888-5549a14789a4 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] [instance: cdd533e1-ff6e-4525-b6cb-e425440195cb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:13.081103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87fcbc63-91bc-436f-8888-5549a14789a4 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:13.083376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87fcbc63-91bc-436f-8888-5549a14789a4 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:13.084381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87fcbc63-91bc-436f-8888-5549a14789a4 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:13.086375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87fcbc63-91bc-436f-8888-5549a14789a4 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:13.087420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87fcbc63-91bc-436f-8888-5549a14789a4 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:13.088040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87fcbc63-91bc-436f-8888-5549a14789a4 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:13.410735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-87fcbc63-91bc-436f-8888-5549a14789a4 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538606670f9e4f239347abb3f5da8ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7586bc93b2f04b918195ee2c9e490b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:13.424489 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-87fcbc63-91bc-436f-8888-5549a14789a4 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb" status: 200 len: 1323 microversion: 2.1 time: 0.378244 Oct 10 23:40:13.438942 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2396/4638] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:13 2022] GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb => generated 1323 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:13.463113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-8766ea99-3c3d-464c-9c04-72b428055ce5 req-9f7512d7-4990-4c6d-a99e-84ca7b4f3c69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "name": "network-vif-deleted", "tag": "ba3bc036-b9db-4323-b4e1-9d329301f767"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:13.496940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8766ea99-3c3d-464c-9c04-72b428055ce5 req-9f7512d7-4990-4c6d-a99e-84ca7b4f3c69 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:13.497478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8766ea99-3c3d-464c-9c04-72b428055ce5 req-9f7512d7-4990-4c6d-a99e-84ca7b4f3c69 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:13.501630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8766ea99-3c3d-464c-9c04-72b428055ce5 req-9f7512d7-4990-4c6d-a99e-84ca7b4f3c69 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:13.538444 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-8766ea99-3c3d-464c-9c04-72b428055ce5 req-9f7512d7-4990-4c6d-a99e-84ca7b4f3c69 service nova] Creating event network-vif-deleted:ba3bc036-b9db-4323-b4e1-9d329301f767 for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:40:13.563987 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-8766ea99-3c3d-464c-9c04-72b428055ce5 req-9f7512d7-4990-4c6d-a99e-84ca7b4f3c69 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118510 Oct 10 23:40:13.565186 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2397/4639] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:40:13.884050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0c7bf3f6-67f5-4648-8103-ff5395139b6f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:13.892324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0c7bf3f6-67f5-4648-8103-ff5395139b6f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:13.931516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0c7bf3f6-67f5-4648-8103-ff5395139b6f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:13.940503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0c7bf3f6-67f5-4648-8103-ff5395139b6f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:13.941909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0c7bf3f6-67f5-4648-8103-ff5395139b6f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:13.943537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0c7bf3f6-67f5-4648-8103-ff5395139b6f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:13.944800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0c7bf3f6-67f5-4648-8103-ff5395139b6f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:13.945913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0c7bf3f6-67f5-4648-8103-ff5395139b6f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:14.362158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0c7bf3f6-67f5-4648-8103-ff5395139b6f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:14.368113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:40:14.383168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0c7bf3f6-67f5-4648-8103-ff5395139b6f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:14.386013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0c7bf3f6-67f5-4648-8103-ff5395139b6f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:14.389094 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0c7bf3f6-67f5-4648-8103-ff5395139b6f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 2327 microversion: 2.42 time: 0.526198 Oct 10 23:40:14.390866 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2398/4640] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:13 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 2327 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:14.410646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-37c17183-dd79-42e8-a7f5-25f989b99305 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:14.413258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-37c17183-dd79-42e8-a7f5-25f989b99305 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:14.434184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37c17183-dd79-42e8-a7f5-25f989b99305 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:14.435465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37c17183-dd79-42e8-a7f5-25f989b99305 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:14.435736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37c17183-dd79-42e8-a7f5-25f989b99305 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:14.437301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37c17183-dd79-42e8-a7f5-25f989b99305 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:14.438870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37c17183-dd79-42e8-a7f5-25f989b99305 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:14.439529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37c17183-dd79-42e8-a7f5-25f989b99305 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:14.721810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-37c17183-dd79-42e8-a7f5-25f989b99305 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:14.740562 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-37c17183-dd79-42e8-a7f5-25f989b99305 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 200 len: 1314 microversion: 2.1 time: 0.341182 Oct 10 23:40:14.741149 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2399/4641] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:14 2022] GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:14.764431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-69600130-7203-4faf-af6f-b8ff52e1a601 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:14.769494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-69600130-7203-4faf-af6f-b8ff52e1a601 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] [instance: cdd533e1-ff6e-4525-b6cb-e425440195cb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:14.784881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69600130-7203-4faf-af6f-b8ff52e1a601 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:14.785625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69600130-7203-4faf-af6f-b8ff52e1a601 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:14.786151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69600130-7203-4faf-af6f-b8ff52e1a601 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:14.787764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69600130-7203-4faf-af6f-b8ff52e1a601 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:14.788551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69600130-7203-4faf-af6f-b8ff52e1a601 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:14.789694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69600130-7203-4faf-af6f-b8ff52e1a601 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:14.908132 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-070a7011-d8f6-4f72-bb96-4faa07cab7ae tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/9b143211-8d32-4c90-8840-a9b096d7cd2a" status: 202 len: 0 microversion: 2.1 time: 2.055030 Oct 10 23:40:14.910397 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2243/4642] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:40:12 2022] DELETE /compute/v2.1/os-security-groups/9b143211-8d32-4c90-8840-a9b096d7cd2a => generated 0 bytes in 2081 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:40:14.926618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aa6db44c-3296-4716-96e5-c13c00d5c433 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Calling method '.version_select at 0x7f662a430af0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:15.254520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-69600130-7203-4faf-af6f-b8ff52e1a601 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538606670f9e4f239347abb3f5da8ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7586bc93b2f04b918195ee2c9e490b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:15.267808 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-69600130-7203-4faf-af6f-b8ff52e1a601 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb" status: 200 len: 1323 microversion: 2.1 time: 0.519027 Oct 10 23:40:15.268441 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2400/4643] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:14 2022] GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb => generated 1323 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:15.378358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-d84a51eb-98a4-4d51-8800-06640ba69bb0 req-917af62f-90a4-41a0-bd77-6815a4077bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd533e1-ff6e-4525-b6cb-e425440195cb", "name": "network-vif-plugged", "status": "completed", "tag": "11024cf8-8768-4f1d-8051-9bfef8831788"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:15.395551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d84a51eb-98a4-4d51-8800-06640ba69bb0 req-917af62f-90a4-41a0-bd77-6815a4077bfc service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:15.396578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d84a51eb-98a4-4d51-8800-06640ba69bb0 req-917af62f-90a4-41a0-bd77-6815a4077bfc service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:15.398001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d84a51eb-98a4-4d51-8800-06640ba69bb0 req-917af62f-90a4-41a0-bd77-6815a4077bfc service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:15.432563 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-d84a51eb-98a4-4d51-8800-06640ba69bb0 req-917af62f-90a4-41a0-bd77-6815a4077bfc service nova] Creating event network-vif-plugged:11024cf8-8768-4f1d-8051-9bfef8831788 for instance cdd533e1-ff6e-4525-b6cb-e425440195cb on n-h2-860864-2 Oct 10 23:40:15.440525 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-d84a51eb-98a4-4d51-8800-06640ba69bb0 req-917af62f-90a4-41a0-bd77-6815a4077bfc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067140 Oct 10 23:40:15.443246 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2401/4644] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:40:15.455978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a1634565-623f-4e55-bb12-078711833da6 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:15.463499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a1634565-623f-4e55-bb12-078711833da6 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:15.482968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1634565-623f-4e55-bb12-078711833da6 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:15.483475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1634565-623f-4e55-bb12-078711833da6 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:15.484488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1634565-623f-4e55-bb12-078711833da6 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:15.485226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1634565-623f-4e55-bb12-078711833da6 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:15.490192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1634565-623f-4e55-bb12-078711833da6 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:15.490908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1634565-623f-4e55-bb12-078711833da6 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:15.691083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a1634565-623f-4e55-bb12-078711833da6 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:15.706824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a1634565-623f-4e55-bb12-078711833da6 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:15.708418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a1634565-623f-4e55-bb12-078711833da6 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:15.709743 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a1634565-623f-4e55-bb12-078711833da6 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 2259 microversion: 2.42 time: 0.264880 Oct 10 23:40:15.710317 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2402/4645] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:15 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 2259 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:15.736234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-c5ecb119-17a5-4ed2-9d71-fead372016cf req-f0a319bb-f0c5-4759-aa67-63da490088ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "name": "network-vif-deleted", "tag": "696f4f58-fa1e-4ecd-a136-8232df92640f"}, {"name": "network-changed", "server_uuid": "03efae6a-4cc3-40bd-8ff4-71fce7fc1e22", "tag": "db582bb9-a330-48b9-abb9-cf5fe58cfb6b"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:15.750072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c5ecb119-17a5-4ed2-9d71-fead372016cf req-f0a319bb-f0c5-4759-aa67-63da490088ba service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:15.750643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c5ecb119-17a5-4ed2-9d71-fead372016cf req-f0a319bb-f0c5-4759-aa67-63da490088ba service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:15.751369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c5ecb119-17a5-4ed2-9d71-fead372016cf req-f0a319bb-f0c5-4759-aa67-63da490088ba service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:15.778165 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-c5ecb119-17a5-4ed2-9d71-fead372016cf req-f0a319bb-f0c5-4759-aa67-63da490088ba service nova] Creating event network-vif-deleted:696f4f58-fa1e-4ecd-a136-8232df92640f for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:40:15.778711 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-c5ecb119-17a5-4ed2-9d71-fead372016cf req-f0a319bb-f0c5-4759-aa67-63da490088ba service nova] Creating event network-changed:db582bb9-a330-48b9-abb9-cf5fe58cfb6b for instance 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 on n-h2-860864-2 Oct 10 23:40:15.796420 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-c5ecb119-17a5-4ed2-9d71-fead372016cf req-f0a319bb-f0c5-4759-aa67-63da490088ba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.071414 Oct 10 23:40:15.799053 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2403/4646] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:40:15.809214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2d6b2acc-627f-4967-aaf8-b6634bfb2b5d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:15.809214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2d6b2acc-627f-4967-aaf8-b6634bfb2b5d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:15.817210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d6b2acc-627f-4967-aaf8-b6634bfb2b5d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:15.817855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d6b2acc-627f-4967-aaf8-b6634bfb2b5d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:15.818594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d6b2acc-627f-4967-aaf8-b6634bfb2b5d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:15.819000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d6b2acc-627f-4967-aaf8-b6634bfb2b5d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:15.819982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d6b2acc-627f-4967-aaf8-b6634bfb2b5d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:15.819982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d6b2acc-627f-4967-aaf8-b6634bfb2b5d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:15.896853 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aa6db44c-3296-4716-96e5-c13c00d5c433 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/9e21b939-a42d-48fd-bbf4-6278cce45596" status: 202 len: 0 microversion: 2.1 time: 0.980192 Oct 10 23:40:15.897873 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2244/4647] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:40:14 2022] DELETE /compute/v2.1/os-security-groups/9e21b939-a42d-48fd-bbf4-6278cce45596 => generated 0 bytes in 982 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 23:40:15.913671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4ddbce62-30cb-41b3-b73b-0da58553c368 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] Calling method '.version_select at 0x7f662a868820>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:16.035203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2d6b2acc-627f-4967-aaf8-b6634bfb2b5d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:16.046814 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2d6b2acc-627f-4967-aaf8-b6634bfb2b5d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 200 len: 1314 microversion: 2.1 time: 0.246113 Oct 10 23:40:16.048087 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2404/4648] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:15 2022] GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:16.297408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-666a8f0f-1b7f-48d4-80c5-e3fc09eb2767 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:16.298331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-666a8f0f-1b7f-48d4-80c5-e3fc09eb2767 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] [instance: cdd533e1-ff6e-4525-b6cb-e425440195cb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:16.314642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-666a8f0f-1b7f-48d4-80c5-e3fc09eb2767 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:16.315114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-666a8f0f-1b7f-48d4-80c5-e3fc09eb2767 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:16.315440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-666a8f0f-1b7f-48d4-80c5-e3fc09eb2767 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:16.316155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-666a8f0f-1b7f-48d4-80c5-e3fc09eb2767 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:16.316623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-666a8f0f-1b7f-48d4-80c5-e3fc09eb2767 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:16.319525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-666a8f0f-1b7f-48d4-80c5-e3fc09eb2767 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:16.361849 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4ddbce62-30cb-41b3-b73b-0da58553c368 tempest-SecurityGroupRulesNegativeTestJSON-1166538921 tempest-SecurityGroupRulesNegativeTestJSON-1166538921-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/a332edab-feec-44ca-9043-1bd357bb7a18" status: 202 len: 0 microversion: 2.1 time: 0.458431 Oct 10 23:40:16.362993 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2245/4649] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:40:15 2022] DELETE /compute/v2.1/os-security-groups/a332edab-feec-44ca-9043-1bd357bb7a18 => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:40:16.662515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-666a8f0f-1b7f-48d4-80c5-e3fc09eb2767 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538606670f9e4f239347abb3f5da8ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7586bc93b2f04b918195ee2c9e490b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:16.674672 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-666a8f0f-1b7f-48d4-80c5-e3fc09eb2767 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb" status: 200 len: 1323 microversion: 2.1 time: 0.384409 Oct 10 23:40:16.675282 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2405/4650] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:16 2022] GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb => generated 1323 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:16.741750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-090bd95b-8a09-4cae-98db-eae73406364b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:16.742485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-090bd95b-8a09-4cae-98db-eae73406364b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:16.760616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-090bd95b-8a09-4cae-98db-eae73406364b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:16.761117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-090bd95b-8a09-4cae-98db-eae73406364b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:16.761804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-090bd95b-8a09-4cae-98db-eae73406364b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:16.762693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-090bd95b-8a09-4cae-98db-eae73406364b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:16.763310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-090bd95b-8a09-4cae-98db-eae73406364b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:16.763900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-090bd95b-8a09-4cae-98db-eae73406364b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:16.913410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-090bd95b-8a09-4cae-98db-eae73406364b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:16.934157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-090bd95b-8a09-4cae-98db-eae73406364b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:16.935939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-090bd95b-8a09-4cae-98db-eae73406364b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:16.943207 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-090bd95b-8a09-4cae-98db-eae73406364b tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1604 microversion: 2.42 time: 0.205742 Oct 10 23:40:16.946917 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2246/4651] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:16 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1604 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:17.072578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b30dacf0-4969-4c74-9e0c-b57d0f074df4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:17.073211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b30dacf0-4969-4c74-9e0c-b57d0f074df4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:17.083535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b30dacf0-4969-4c74-9e0c-b57d0f074df4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:17.087016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b30dacf0-4969-4c74-9e0c-b57d0f074df4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:17.093569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b30dacf0-4969-4c74-9e0c-b57d0f074df4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:17.095400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b30dacf0-4969-4c74-9e0c-b57d0f074df4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:17.098611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b30dacf0-4969-4c74-9e0c-b57d0f074df4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:17.099412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b30dacf0-4969-4c74-9e0c-b57d0f074df4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:17.407451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b30dacf0-4969-4c74-9e0c-b57d0f074df4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:17.445876 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b30dacf0-4969-4c74-9e0c-b57d0f074df4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 200 len: 1314 microversion: 2.1 time: 0.377008 Oct 10 23:40:17.447263 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2406/4652] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:17 2022] GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:17.698604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c1fd7c6d-cf85-41af-8262-f1ee21c10535 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:17.699425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c1fd7c6d-cf85-41af-8262-f1ee21c10535 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] [instance: cdd533e1-ff6e-4525-b6cb-e425440195cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:17.708347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:40:17.713564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1fd7c6d-cf85-41af-8262-f1ee21c10535 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:17.715535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1fd7c6d-cf85-41af-8262-f1ee21c10535 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:17.717460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1fd7c6d-cf85-41af-8262-f1ee21c10535 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:17.718769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1fd7c6d-cf85-41af-8262-f1ee21c10535 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:17.726327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1fd7c6d-cf85-41af-8262-f1ee21c10535 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:17.727082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1fd7c6d-cf85-41af-8262-f1ee21c10535 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:17.919600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-58f89f00-db4d-42b6-92ff-c69e2bce3555 req-9bbde51d-b7c5-4ac6-83f2-e8339793dc39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57d5936-a36d-4048-902a-6bf9e7ad7b39", "name": "network-vif-deleted", "tag": "7961149e-16c2-40ba-bb9c-9da27106648b"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:17.985318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-58f89f00-db4d-42b6-92ff-c69e2bce3555 req-9bbde51d-b7c5-4ac6-83f2-e8339793dc39 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:17.989082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-58f89f00-db4d-42b6-92ff-c69e2bce3555 req-9bbde51d-b7c5-4ac6-83f2-e8339793dc39 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:17.992466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-58f89f00-db4d-42b6-92ff-c69e2bce3555 req-9bbde51d-b7c5-4ac6-83f2-e8339793dc39 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:18.051598 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-58f89f00-db4d-42b6-92ff-c69e2bce3555 req-9bbde51d-b7c5-4ac6-83f2-e8339793dc39 service nova] Creating event network-vif-deleted:7961149e-16c2-40ba-bb9c-9da27106648b for instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 on n-h2-860864-2 Oct 10 23:40:18.064432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c1fd7c6d-cf85-41af-8262-f1ee21c10535 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538606670f9e4f239347abb3f5da8ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7586bc93b2f04b918195ee2c9e490b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:18.070627 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-58f89f00-db4d-42b6-92ff-c69e2bce3555 req-9bbde51d-b7c5-4ac6-83f2-e8339793dc39 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158229 Oct 10 23:40:18.073866 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2407/4653] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:40:18.077679 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c1fd7c6d-cf85-41af-8262-f1ee21c10535 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb" status: 200 len: 1519 microversion: 2.1 time: 0.383035 Oct 10 23:40:18.094592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8409bc42-feee-48a8-a767-beb657fd5bea tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:18.094592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8409bc42-feee-48a8-a767-beb657fd5bea tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:18.104700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8409bc42-feee-48a8-a767-beb657fd5bea tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:18.105700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8409bc42-feee-48a8-a767-beb657fd5bea tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:18.105903 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2247/4654] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:17 2022] GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb => generated 1519 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:18.110272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8409bc42-feee-48a8-a767-beb657fd5bea tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:18.111714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8409bc42-feee-48a8-a767-beb657fd5bea tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:18.116451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8409bc42-feee-48a8-a767-beb657fd5bea tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:18.117144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8409bc42-feee-48a8-a767-beb657fd5bea tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:18.368614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-86edadc1-9480-49bc-a0b0-75a8a13c12af tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-384927959", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "56312001-1818-436a-b45d-ba4ef2d96639"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-86edadc1-9480-49bc-a0b0-75a8a13c12af tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Request method failure captured: Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 242 Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK1Hx73UhQ9Tcz8_JcmdumqVV-h9fcpXIMetJjFVPi6AYh36xa3dQAyR4NHHvvJlw9NV_zNIlIgjlYpPn8rvI2-vU4x3n5g28huZNuVcUXnH81Ez4CmnUC2HxwqLOIxyKyeMQ27c7Jy94HPRpfcpRfxv7dY01d_0itL3zMUzGVVAHjE Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 7586bc93b2f04b918195ee2c9e490b92 Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7586bc93b2f04b918195ee2c9e490b92", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 7586bc93b2f04b918195ee2c9e490b92 Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerMetadataNegativeTestJSON-1108766416-project Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 538606670f9e4f239347abb3f5da8ac8 Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1108766416-project Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-384927959", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "56312001-1818-436a-b45d-ba4ef2d96639"}]}} Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-384927959', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '56312001-1818-436a-b45d-ba4ef2d96639'}]}}} Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:18.374001 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:40:18.378361 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:40:18.378361 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:40:18.378361 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:40:18.378361 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:40:18.378361 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:40:18.378361 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:40:18.378361 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:40:18.378361 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:40:18.378361 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.378361 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:18.378361 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.378361 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:18.378361 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:18.378361 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:18.378361 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:40:18.378361 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:40:18.378361 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:40:18.378361 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.397963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-86edadc1-9480-49bc-a0b0-75a8a13c12af tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:18.402529 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-86edadc1-9480-49bc-a0b0-75a8a13c12af tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.036535 Oct 10 23:40:18.403843 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2248/4655] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:40:18 2022] POST /compute/v2.1/servers => generated 175 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:40:18.425852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-da2a9a59-5c06-4e9d-b882-8cc0e1874e28 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:18.427222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-da2a9a59-5c06-4e9d-b882-8cc0e1874e28 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] [instance: 946f46ff-a54a-44dc-b517-0061343baee5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:18.441825 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-da2a9a59-5c06-4e9d-b882-8cc0e1874e28 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] HTTP exception thrown: Instance 946f46ff-a54a-44dc-b517-0061343baee5 could not be found. Oct 10 23:40:18.449254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8409bc42-feee-48a8-a767-beb657fd5bea tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-da2a9a59-5c06-4e9d-b882-8cc0e1874e28 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Request method failure captured: Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/946f46ff-a54a-44dc-b517-0061343baee5/metadata HTTP/1.1 Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK1Hx73UhQ9Tcz8_JcmdumqVV-h9fcpXIMetJjFVPi6AYh36xa3dQAyR4NHHvvJlw9NV_zNIlIgjlYpPn8rvI2-vU4x3n5g28huZNuVcUXnH81Ez4CmnUC2HxwqLOIxyKyeMQ27c7Jy94HPRpfcpRfxv7dY01d_0itL3zMUzGVVAHjE Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 7586bc93b2f04b918195ee2c9e490b92 Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7586bc93b2f04b918195ee2c9e490b92", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 7586bc93b2f04b918195ee2c9e490b92 Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerMetadataNegativeTestJSON-1108766416-project Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 538606670f9e4f239347abb3f5da8ac8 Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1108766416-project Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 946f46ff-a54a-44dc-b517-0061343baee5 could not be found. Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'server_id': '946f46ff-a54a-44dc-b517-0061343baee5'} Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 946f46ff-a54a-44dc-b517-0061343baee5 could not be found. Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 946f46ff-a54a-44dc-b517-0061343baee5 could not be found. Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:18.458067 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:18.462487 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:18.462487 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:18.462487 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 946f46ff-a54a-44dc-b517-0061343baee5 could not be found. Oct 10 23:40:18.462487 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.462487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-da2a9a59-5c06-4e9d-b882-8cc0e1874e28 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Returning 404 to user: Instance 946f46ff-a54a-44dc-b517-0061343baee5 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:18.462487 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-da2a9a59-5c06-4e9d-b882-8cc0e1874e28 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "GET /compute/v2.1/servers/946f46ff-a54a-44dc-b517-0061343baee5/metadata" status: 404 len: 111 microversion: 2.1 time: 0.047146 Oct 10 23:40:18.463167 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2249/4656] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 10 23:40:18 2022] GET /compute/v2.1/servers/946f46ff-a54a-44dc-b517-0061343baee5/metadata => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:40:18.478014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8409bc42-feee-48a8-a767-beb657fd5bea tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:18.485812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8409bc42-feee-48a8-a767-beb657fd5bea tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:18.487398 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8409bc42-feee-48a8-a767-beb657fd5bea tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1604 microversion: 2.42 time: 0.411407 Oct 10 23:40:18.491204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0dcca3ef-9d60-4f87-8a91-20804cb426f4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:18.492302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0dcca3ef-9d60-4f87-8a91-20804cb426f4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:18.492519 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2408/4657] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:18 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1604 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:18.518920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0dcca3ef-9d60-4f87-8a91-20804cb426f4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:18.519680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0dcca3ef-9d60-4f87-8a91-20804cb426f4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:18.520349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0dcca3ef-9d60-4f87-8a91-20804cb426f4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:18.524113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0dcca3ef-9d60-4f87-8a91-20804cb426f4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:18.525712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0dcca3ef-9d60-4f87-8a91-20804cb426f4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:18.526322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0dcca3ef-9d60-4f87-8a91-20804cb426f4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:18.599621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1d43d21b-47a7-4e92-b03e-bb98844ea482 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-619854461", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "56312001-1818-436a-b45d-ba4ef2d96639"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1d43d21b-47a7-4e92-b03e-bb98844ea482 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Request method failure captured: Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 498 Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK1Hx73UhQ9Tcz8_JcmdumqVV-h9fcpXIMetJjFVPi6AYh36xa3dQAyR4NHHvvJlw9NV_zNIlIgjlYpPn8rvI2-vU4x3n5g28huZNuVcUXnH81Ez4CmnUC2HxwqLOIxyKyeMQ27c7Jy94HPRpfcpRfxv7dY01d_0itL3zMUzGVVAHjE Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 7586bc93b2f04b918195ee2c9e490b92 Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7586bc93b2f04b918195ee2c9e490b92", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 7586bc93b2f04b918195ee2c9e490b92 Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerMetadataNegativeTestJSON-1108766416-project Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 538606670f9e4f239347abb3f5da8ac8 Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1108766416-project Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-619854461", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "56312001-1818-436a-b45d-ba4ef2d96639"}]}} Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-619854461', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '56312001-1818-436a-b45d-ba4ef2d96639'}]}}} Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 10 23:40:18.613357 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.620300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1d43d21b-47a7-4e92-b03e-bb98844ea482 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:18.629798 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1d43d21b-47a7-4e92-b03e-bb98844ea482 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.030650 Oct 10 23:40:18.633821 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2409/4658] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:40:18 2022] POST /compute/v2.1/servers => generated 687 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:40:18.858862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9d200e31-ab6a-4121-9017-0fa495c6e596 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-217083177", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "56312001-1818-436a-b45d-ba4ef2d96639"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9d200e31-ab6a-4121-9017-0fa495c6e596 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Request method failure captured: Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 499 Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK1Hx73UhQ9Tcz8_JcmdumqVV-h9fcpXIMetJjFVPi6AYh36xa3dQAyR4NHHvvJlw9NV_zNIlIgjlYpPn8rvI2-vU4x3n5g28huZNuVcUXnH81Ez4CmnUC2HxwqLOIxyKyeMQ27c7Jy94HPRpfcpRfxv7dY01d_0itL3zMUzGVVAHjE Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 7586bc93b2f04b918195ee2c9e490b92 Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7586bc93b2f04b918195ee2c9e490b92", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 7586bc93b2f04b918195ee2c9e490b92 Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerMetadataNegativeTestJSON-1108766416-project Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 538606670f9e4f239347abb3f5da8ac8 Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1108766416-project Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-217083177", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "56312001-1818-436a-b45d-ba4ef2d96639"}]}} Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-217083177', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '56312001-1818-436a-b45d-ba4ef2d96639'}]}}} Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 10 23:40:18.864376 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:40:18.867769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.871443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9d200e31-ab6a-4121-9017-0fa495c6e596 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:18.872740 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9d200e31-ab6a-4121-9017-0fa495c6e596 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.017833 Oct 10 23:40:18.887221 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2410/4659] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:40:18 2022] POST /compute/v2.1/servers => generated 689 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 23:40:18.945474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-59a4cfe6-1698-4fc0-9805-2219518a37e8 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-778254204", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "56312001-1818-436a-b45d-ba4ef2d96639"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-59a4cfe6-1698-4fc0-9805-2219518a37e8 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Request method failure captured: Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 753 Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK1Hx73UhQ9Tcz8_JcmdumqVV-h9fcpXIMetJjFVPi6AYh36xa3dQAyR4NHHvvJlw9NV_zNIlIgjlYpPn8rvI2-vU4x3n5g28huZNuVcUXnH81Ez4CmnUC2HxwqLOIxyKyeMQ27c7Jy94HPRpfcpRfxv7dY01d_0itL3zMUzGVVAHjE Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 7586bc93b2f04b918195ee2c9e490b92 Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7586bc93b2f04b918195ee2c9e490b92", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 7586bc93b2f04b918195ee2c9e490b92 Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerMetadataNegativeTestJSON-1108766416-project Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 538606670f9e4f239347abb3f5da8ac8 Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1108766416-project Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-778254204", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "56312001-1818-436a-b45d-ba4ef2d96639"}]}} Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-778254204', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '56312001-1818-436a-b45d-ba4ef2d96639'}]}}} Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:40:18.954050 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:40:18.956714 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:40:18.961108 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:40:18.961108 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:18.963213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-59a4cfe6-1698-4fc0-9805-2219518a37e8 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:18.965126 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-59a4cfe6-1698-4fc0-9805-2219518a37e8 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.026271 Oct 10 23:40:18.966841 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2411/4660] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:40:18 2022] POST /compute/v2.1/servers => generated 1197 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 10 23:40:19.047083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0dcca3ef-9d60-4f87-8a91-20804cb426f4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:19.071506 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0dcca3ef-9d60-4f87-8a91-20804cb426f4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 200 len: 1314 microversion: 2.1 time: 0.590905 Oct 10 23:40:19.078458 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2250/4661] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:18 2022] GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 1314 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:19.197004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0ad6a0ba-41c0-4def-9688-92e72f889fb1 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1310423328", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "56312001-1818-436a-b45d-ba4ef2d96639"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0ad6a0ba-41c0-4def-9688-92e72f889fb1 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Request method failure captured: Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 1266 Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK1Hx73UhQ9Tcz8_JcmdumqVV-h9fcpXIMetJjFVPi6AYh36xa3dQAyR4NHHvvJlw9NV_zNIlIgjlYpPn8rvI2-vU4x3n5g28huZNuVcUXnH81Ez4CmnUC2HxwqLOIxyKyeMQ27c7Jy94HPRpfcpRfxv7dY01d_0itL3zMUzGVVAHjE Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 7586bc93b2f04b918195ee2c9e490b92 Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7586bc93b2f04b918195ee2c9e490b92", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 7586bc93b2f04b918195ee2c9e490b92 Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerMetadataNegativeTestJSON-1108766416-project Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 538606670f9e4f239347abb3f5da8ac8 Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1108766416-project Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1310423328", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "56312001-1818-436a-b45d-ba4ef2d96639"}]}} Oct 10 23:40:19.208383 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:40:19.211578 n-d-860864-2 devstack@n-api.service[120613]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:40:19.211578 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1310423328', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '56312001-1818-436a-b45d-ba4ef2d96639'}]}}} Oct 10 23:40:19.211578 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:19.211578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:19.211578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:40:19.211578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:40:19.211578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:40:19.211578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:40:19.211578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:40:19.211578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:19.211578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 10 23:40:19.211578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 10 23:40:19.211578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 10 23:40:19.211578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 10 23:40:19.211578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 10 23:40:19.211578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:19.211578 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:40:19.212882 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:40:19.214682 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 10 23:40:19.214682 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:19.220500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0ad6a0ba-41c0-4def-9688-92e72f889fb1 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:19.222459 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0ad6a0ba-41c0-4def-9688-92e72f889fb1 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.031759 Oct 10 23:40:19.223615 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2412/4662] 10.222.0.23 () {60 vars in 1148 bytes} [Mon Oct 10 23:40:19 2022] POST /compute/v2.1/servers => generated 2221 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 10 23:40:19.236157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f59bb77d-9ecf-494c-b23e-c2a5b6ca2620 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:19.236665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f59bb77d-9ecf-494c-b23e-c2a5b6ca2620 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] [instance: 3fc7f5ad-f8a9-4509-be46-e3eb0c5a05d5] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:19.246857 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-f59bb77d-9ecf-494c-b23e-c2a5b6ca2620 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] HTTP exception thrown: Instance 3fc7f5ad-f8a9-4509-be46-e3eb0c5a05d5 could not be found. Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f59bb77d-9ecf-494c-b23e-c2a5b6ca2620 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Request method failure captured: Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/3fc7f5ad-f8a9-4509-be46-e3eb0c5a05d5/metadata/test2 HTTP/1.1 Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK1Hx73UhQ9Tcz8_JcmdumqVV-h9fcpXIMetJjFVPi6AYh36xa3dQAyR4NHHvvJlw9NV_zNIlIgjlYpPn8rvI2-vU4x3n5g28huZNuVcUXnH81Ez4CmnUC2HxwqLOIxyKyeMQ27c7Jy94HPRpfcpRfxv7dY01d_0itL3zMUzGVVAHjE Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 7586bc93b2f04b918195ee2c9e490b92 Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7586bc93b2f04b918195ee2c9e490b92", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 7586bc93b2f04b918195ee2c9e490b92 Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerMetadataNegativeTestJSON-1108766416-project Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 538606670f9e4f239347abb3f5da8ac8 Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1108766416-project Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 3fc7f5ad-f8a9-4509-be46-e3eb0c5a05d5 could not be found. Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'server_id': '3fc7f5ad-f8a9-4509-be46-e3eb0c5a05d5', 'id': 'test2'} Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fc7f5ad-f8a9-4509-be46-e3eb0c5a05d5 could not be found. Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fc7f5ad-f8a9-4509-be46-e3eb0c5a05d5 could not be found. Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:19.258979 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:19.264215 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:19.264215 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:19.264215 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fc7f5ad-f8a9-4509-be46-e3eb0c5a05d5 could not be found. Oct 10 23:40:19.264215 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:19.271396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f59bb77d-9ecf-494c-b23e-c2a5b6ca2620 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Returning 404 to user: Instance 3fc7f5ad-f8a9-4509-be46-e3eb0c5a05d5 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:19.272277 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f59bb77d-9ecf-494c-b23e-c2a5b6ca2620 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "GET /compute/v2.1/servers/3fc7f5ad-f8a9-4509-be46-e3eb0c5a05d5/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.042086 Oct 10 23:40:19.288922 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2251/4663] 10.222.0.23 () {58 vars in 1281 bytes} [Mon Oct 10 23:40:19 2022] GET /compute/v2.1/servers/3fc7f5ad-f8a9-4509-be46-e3eb0c5a05d5/metadata/test2 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:40:19.296006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dea81e7d-d24f-499a-aed1-8c606c73e64b tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:19.297795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dea81e7d-d24f-499a-aed1-8c606c73e64b tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] [instance: cdd533e1-ff6e-4525-b6cb-e425440195cb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:19.310623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dea81e7d-d24f-499a-aed1-8c606c73e64b tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:19.311132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dea81e7d-d24f-499a-aed1-8c606c73e64b tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:19.311573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dea81e7d-d24f-499a-aed1-8c606c73e64b tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:19.317840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dea81e7d-d24f-499a-aed1-8c606c73e64b tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:19.318701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dea81e7d-d24f-499a-aed1-8c606c73e64b tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:19.319379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dea81e7d-d24f-499a-aed1-8c606c73e64b tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:19.356487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dea81e7d-d24f-499a-aed1-8c606c73e64b tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] [instance: cdd533e1-ff6e-4525-b6cb-e425440195cb] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:40:19.529805 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-56ad355b-264a-42e8-9bfd-5c7bdb38c0a4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:19.531253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-56ad355b-264a-42e8-9bfd-5c7bdb38c0a4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:19.548900 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dea81e7d-d24f-499a-aed1-8c606c73e64b tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb" status: 204 len: 0 microversion: 2.1 time: 0.254072 Oct 10 23:40:19.550239 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2413/4664] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:40:19 2022] DELETE /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 23:40:19.564086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ebe6c35c-5ee7-4145-aecb-5d26fb2d8ebf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:19.567499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ebe6c35c-5ee7-4145-aecb-5d26fb2d8ebf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] [instance: cdd533e1-ff6e-4525-b6cb-e425440195cb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:19.570565 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56ad355b-264a-42e8-9bfd-5c7bdb38c0a4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:19.572262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56ad355b-264a-42e8-9bfd-5c7bdb38c0a4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:19.573505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56ad355b-264a-42e8-9bfd-5c7bdb38c0a4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:19.575131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56ad355b-264a-42e8-9bfd-5c7bdb38c0a4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:19.578038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56ad355b-264a-42e8-9bfd-5c7bdb38c0a4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:19.578730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebe6c35c-5ee7-4145-aecb-5d26fb2d8ebf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:19.579416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebe6c35c-5ee7-4145-aecb-5d26fb2d8ebf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:19.579645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56ad355b-264a-42e8-9bfd-5c7bdb38c0a4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:19.580213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebe6c35c-5ee7-4145-aecb-5d26fb2d8ebf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:19.581121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebe6c35c-5ee7-4145-aecb-5d26fb2d8ebf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:19.582036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebe6c35c-5ee7-4145-aecb-5d26fb2d8ebf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:19.582636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebe6c35c-5ee7-4145-aecb-5d26fb2d8ebf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:19.745361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-56ad355b-264a-42e8-9bfd-5c7bdb38c0a4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:19.758455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-56ad355b-264a-42e8-9bfd-5c7bdb38c0a4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:19.764299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-56ad355b-264a-42e8-9bfd-5c7bdb38c0a4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:19.774268 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-56ad355b-264a-42e8-9bfd-5c7bdb38c0a4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1604 microversion: 2.42 time: 0.250455 Oct 10 23:40:19.780275 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2252/4665] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:19 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1604 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:19.887799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ebe6c35c-5ee7-4145-aecb-5d26fb2d8ebf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538606670f9e4f239347abb3f5da8ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7586bc93b2f04b918195ee2c9e490b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:19.902677 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ebe6c35c-5ee7-4145-aecb-5d26fb2d8ebf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb" status: 200 len: 1525 microversion: 2.1 time: 0.347512 Oct 10 23:40:19.903890 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2414/4666] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:19 2022] GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb => generated 1525 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:20.105998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b1dda548-fb16-422c-b47d-10484b91b380 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:20.107489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b1dda548-fb16-422c-b47d-10484b91b380 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:20.123788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1dda548-fb16-422c-b47d-10484b91b380 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:20.129958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1dda548-fb16-422c-b47d-10484b91b380 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:20.130915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1dda548-fb16-422c-b47d-10484b91b380 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:20.131985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1dda548-fb16-422c-b47d-10484b91b380 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:20.132704 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1dda548-fb16-422c-b47d-10484b91b380 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:20.134311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1dda548-fb16-422c-b47d-10484b91b380 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:20.635155 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b1dda548-fb16-422c-b47d-10484b91b380 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:20.651333 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b1dda548-fb16-422c-b47d-10484b91b380 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 200 len: 1314 microversion: 2.1 time: 0.550860 Oct 10 23:40:20.657451 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2253/4667] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:20 2022] GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:20.810687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-89fbed3e-d304-4849-916e-2c66e988d65f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:20.812239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-89fbed3e-d304-4849-916e-2c66e988d65f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:20.832515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89fbed3e-d304-4849-916e-2c66e988d65f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:20.833058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89fbed3e-d304-4849-916e-2c66e988d65f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:20.833627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89fbed3e-d304-4849-916e-2c66e988d65f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:20.839700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89fbed3e-d304-4849-916e-2c66e988d65f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:20.840259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89fbed3e-d304-4849-916e-2c66e988d65f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:20.840759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89fbed3e-d304-4849-916e-2c66e988d65f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:20.929144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b0b7a17e-4220-40ff-9c09-81efe343abce tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:20.930083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b0b7a17e-4220-40ff-9c09-81efe343abce tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] [instance: cdd533e1-ff6e-4525-b6cb-e425440195cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:20.943599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0b7a17e-4220-40ff-9c09-81efe343abce tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:20.945368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0b7a17e-4220-40ff-9c09-81efe343abce tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:20.946398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0b7a17e-4220-40ff-9c09-81efe343abce tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:20.949944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0b7a17e-4220-40ff-9c09-81efe343abce tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:20.950670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0b7a17e-4220-40ff-9c09-81efe343abce tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:20.951435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0b7a17e-4220-40ff-9c09-81efe343abce tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:21.008290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-89fbed3e-d304-4849-916e-2c66e988d65f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:21.026613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-89fbed3e-d304-4849-916e-2c66e988d65f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:21.028073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-89fbed3e-d304-4849-916e-2c66e988d65f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:21.038723 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-89fbed3e-d304-4849-916e-2c66e988d65f tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1604 microversion: 2.42 time: 0.234052 Oct 10 23:40:21.054651 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2415/4668] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:20 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1604 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:21.391250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b0b7a17e-4220-40ff-9c09-81efe343abce tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538606670f9e4f239347abb3f5da8ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7586bc93b2f04b918195ee2c9e490b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:21.406542 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b0b7a17e-4220-40ff-9c09-81efe343abce tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb" status: 200 len: 1525 microversion: 2.1 time: 0.481959 Oct 10 23:40:21.426116 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2254/4669] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:20 2022] GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb => generated 1525 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:40:21.480399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-062b2e01-225b-4336-958d-abf74acdb89b req-efe61bbe-b89d-431f-b5a2-6fcc8e946640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03efae6a-4cc3-40bd-8ff4-71fce7fc1e22", "name": "network-vif-plugged", "status": "completed", "tag": "db582bb9-a330-48b9-abb9-cf5fe58cfb6b"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:21.524457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-062b2e01-225b-4336-958d-abf74acdb89b req-efe61bbe-b89d-431f-b5a2-6fcc8e946640 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:21.525066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-062b2e01-225b-4336-958d-abf74acdb89b req-efe61bbe-b89d-431f-b5a2-6fcc8e946640 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:21.525651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-062b2e01-225b-4336-958d-abf74acdb89b req-efe61bbe-b89d-431f-b5a2-6fcc8e946640 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:21.555809 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-062b2e01-225b-4336-958d-abf74acdb89b req-efe61bbe-b89d-431f-b5a2-6fcc8e946640 service nova] Creating event network-vif-plugged:db582bb9-a330-48b9-abb9-cf5fe58cfb6b for instance 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 on n-h2-860864-2 Oct 10 23:40:21.564801 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-062b2e01-225b-4336-958d-abf74acdb89b req-efe61bbe-b89d-431f-b5a2-6fcc8e946640 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091999 Oct 10 23:40:21.566559 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2416/4670] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:40:21.680891 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-356e7770-ac00-4515-adb5-b38c6b1a1835 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:21.682695 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-356e7770-ac00-4515-adb5-b38c6b1a1835 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:21.698587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-356e7770-ac00-4515-adb5-b38c6b1a1835 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:21.700108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-356e7770-ac00-4515-adb5-b38c6b1a1835 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:21.700749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-356e7770-ac00-4515-adb5-b38c6b1a1835 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:21.706300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-356e7770-ac00-4515-adb5-b38c6b1a1835 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:21.707003 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-356e7770-ac00-4515-adb5-b38c6b1a1835 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:21.707623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-356e7770-ac00-4515-adb5-b38c6b1a1835 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:22.088457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0a67b5c6-7211-4401-870b-79c43463ec73 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:22.093596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0a67b5c6-7211-4401-870b-79c43463ec73 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:22.124512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a67b5c6-7211-4401-870b-79c43463ec73 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:22.128275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a67b5c6-7211-4401-870b-79c43463ec73 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:22.130078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a67b5c6-7211-4401-870b-79c43463ec73 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:22.135004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a67b5c6-7211-4401-870b-79c43463ec73 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:22.136234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a67b5c6-7211-4401-870b-79c43463ec73 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:22.138391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a67b5c6-7211-4401-870b-79c43463ec73 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:22.143323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-356e7770-ac00-4515-adb5-b38c6b1a1835 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:22.157531 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-356e7770-ac00-4515-adb5-b38c6b1a1835 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 200 len: 1314 microversion: 2.1 time: 0.481544 Oct 10 23:40:22.167496 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2255/4671] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:21 2022] GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:22.431434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6ff63f64-dfce-43f6-9ad3-5200e95f62af tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:22.432339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6ff63f64-dfce-43f6-9ad3-5200e95f62af tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] [instance: cdd533e1-ff6e-4525-b6cb-e425440195cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:22.450954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ff63f64-dfce-43f6-9ad3-5200e95f62af tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:22.451474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ff63f64-dfce-43f6-9ad3-5200e95f62af tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:22.451925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ff63f64-dfce-43f6-9ad3-5200e95f62af tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:22.452841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ff63f64-dfce-43f6-9ad3-5200e95f62af tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:22.458276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ff63f64-dfce-43f6-9ad3-5200e95f62af tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:22.458731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ff63f64-dfce-43f6-9ad3-5200e95f62af tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:22.566096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0a67b5c6-7211-4401-870b-79c43463ec73 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:22.583000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0a67b5c6-7211-4401-870b-79c43463ec73 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:22.586638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0a67b5c6-7211-4401-870b-79c43463ec73 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:22.591852 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0a67b5c6-7211-4401-870b-79c43463ec73 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1604 microversion: 2.42 time: 0.509529 Oct 10 23:40:22.595449 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2417/4672] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:22 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1604 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:22.776776 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6ff63f64-dfce-43f6-9ad3-5200e95f62af tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538606670f9e4f239347abb3f5da8ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7586bc93b2f04b918195ee2c9e490b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:22.795640 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6ff63f64-dfce-43f6-9ad3-5200e95f62af tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb" status: 200 len: 1483 microversion: 2.1 time: 0.367950 Oct 10 23:40:22.812939 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2256/4673] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:22 2022] GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb => generated 1483 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:22.858473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-ba131451-1a14-4ee3-997e-a8a502263f1f req-7ba48b55-51eb-44da-bc28-a83073d7e5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd533e1-ff6e-4525-b6cb-e425440195cb", "name": "network-vif-deleted", "tag": "11024cf8-8768-4f1d-8051-9bfef8831788"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:22.910688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ba131451-1a14-4ee3-997e-a8a502263f1f req-7ba48b55-51eb-44da-bc28-a83073d7e5a8 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:22.912752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ba131451-1a14-4ee3-997e-a8a502263f1f req-7ba48b55-51eb-44da-bc28-a83073d7e5a8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:22.914817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ba131451-1a14-4ee3-997e-a8a502263f1f req-7ba48b55-51eb-44da-bc28-a83073d7e5a8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:22.967680 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-ba131451-1a14-4ee3-997e-a8a502263f1f req-7ba48b55-51eb-44da-bc28-a83073d7e5a8 service nova] Creating event network-vif-deleted:11024cf8-8768-4f1d-8051-9bfef8831788 for instance cdd533e1-ff6e-4525-b6cb-e425440195cb on n-h2-860864-2 Oct 10 23:40:23.003162 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-ba131451-1a14-4ee3-997e-a8a502263f1f req-7ba48b55-51eb-44da-bc28-a83073d7e5a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147090 Oct 10 23:40:23.005424 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2418/4674] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:40:23.185616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f08e562f-b725-4395-8dcf-d2f103fea1d5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:23.187209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f08e562f-b725-4395-8dcf-d2f103fea1d5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:23.224346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f08e562f-b725-4395-8dcf-d2f103fea1d5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:23.231108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f08e562f-b725-4395-8dcf-d2f103fea1d5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:23.233491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f08e562f-b725-4395-8dcf-d2f103fea1d5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:23.235729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f08e562f-b725-4395-8dcf-d2f103fea1d5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:23.241916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f08e562f-b725-4395-8dcf-d2f103fea1d5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:23.243076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f08e562f-b725-4395-8dcf-d2f103fea1d5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:23.634985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-45ad47f4-88ea-4c73-8dbf-892f5d2241c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:23.635930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-45ad47f4-88ea-4c73-8dbf-892f5d2241c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:23.643604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45ad47f4-88ea-4c73-8dbf-892f5d2241c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:23.644099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45ad47f4-88ea-4c73-8dbf-892f5d2241c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:23.644566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45ad47f4-88ea-4c73-8dbf-892f5d2241c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:23.645256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45ad47f4-88ea-4c73-8dbf-892f5d2241c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:23.645741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45ad47f4-88ea-4c73-8dbf-892f5d2241c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:23.646168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45ad47f4-88ea-4c73-8dbf-892f5d2241c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:23.845715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f08e562f-b725-4395-8dcf-d2f103fea1d5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:23.859678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-45ad47f4-88ea-4c73-8dbf-892f5d2241c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:23.865613 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f08e562f-b725-4395-8dcf-d2f103fea1d5 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 200 len: 1314 microversion: 2.1 time: 0.683631 Oct 10 23:40:23.877079 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2257/4675] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:23 2022] GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 1314 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:40:23.891704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-45ad47f4-88ea-4c73-8dbf-892f5d2241c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:23.894005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-12017d70-21d2-4c25-8290-63cc96fa8ecf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:23.894849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-12017d70-21d2-4c25-8290-63cc96fa8ecf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] [instance: cdd533e1-ff6e-4525-b6cb-e425440195cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:23.899848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-45ad47f4-88ea-4c73-8dbf-892f5d2241c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:23.904179 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-45ad47f4-88ea-4c73-8dbf-892f5d2241c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1604 microversion: 2.42 time: 0.282024 Oct 10 23:40:23.911114 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2419/4676] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:23 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1604 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:23.918920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12017d70-21d2-4c25-8290-63cc96fa8ecf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:23.922568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12017d70-21d2-4c25-8290-63cc96fa8ecf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:23.922568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12017d70-21d2-4c25-8290-63cc96fa8ecf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:23.922568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12017d70-21d2-4c25-8290-63cc96fa8ecf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:23.922568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12017d70-21d2-4c25-8290-63cc96fa8ecf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:23.922568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12017d70-21d2-4c25-8290-63cc96fa8ecf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:23.990237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12017d70-21d2-4c25-8290-63cc96fa8ecf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:23.991091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12017d70-21d2-4c25-8290-63cc96fa8ecf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:23.991775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12017d70-21d2-4c25-8290-63cc96fa8ecf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:23.992465 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-12017d70-21d2-4c25-8290-63cc96fa8ecf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lazy-loading 'fault' on Instance uuid cdd533e1-ff6e-4525-b6cb-e425440195cb {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:40:24.131535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-12017d70-21d2-4c25-8290-63cc96fa8ecf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538606670f9e4f239347abb3f5da8ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7586bc93b2f04b918195ee2c9e490b92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:24.139636 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-12017d70-21d2-4c25-8290-63cc96fa8ecf tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb" status: 200 len: 1313 microversion: 2.1 time: 0.260783 Oct 10 23:40:24.143794 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2258/4677] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:23 2022] GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:24.937307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-252b6ec1-cdd4-4af1-b578-c081e5ee8fad tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:24.942446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-252b6ec1-cdd4-4af1-b578-c081e5ee8fad tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:24.949199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e0dbf495-cfbe-45de-8a01-7d4c8c018493 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:24.950717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e0dbf495-cfbe-45de-8a01-7d4c8c018493 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:24.957800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-252b6ec1-cdd4-4af1-b578-c081e5ee8fad tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:24.958559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-252b6ec1-cdd4-4af1-b578-c081e5ee8fad tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:24.959358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-252b6ec1-cdd4-4af1-b578-c081e5ee8fad tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:24.960494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-252b6ec1-cdd4-4af1-b578-c081e5ee8fad tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:24.961322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-252b6ec1-cdd4-4af1-b578-c081e5ee8fad tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:24.961964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-252b6ec1-cdd4-4af1-b578-c081e5ee8fad tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:24.965336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0dbf495-cfbe-45de-8a01-7d4c8c018493 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:24.966137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0dbf495-cfbe-45de-8a01-7d4c8c018493 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:24.966588 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0dbf495-cfbe-45de-8a01-7d4c8c018493 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:24.970721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0dbf495-cfbe-45de-8a01-7d4c8c018493 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:24.971219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0dbf495-cfbe-45de-8a01-7d4c8c018493 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:24.971661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0dbf495-cfbe-45de-8a01-7d4c8c018493 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:25.115803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e0dbf495-cfbe-45de-8a01-7d4c8c018493 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:25.135831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e0dbf495-cfbe-45de-8a01-7d4c8c018493 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:25.147896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e0dbf495-cfbe-45de-8a01-7d4c8c018493 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:25.149265 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e0dbf495-cfbe-45de-8a01-7d4c8c018493 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1604 microversion: 2.42 time: 0.204495 Oct 10 23:40:25.150765 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2259/4678] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:24 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1604 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:25.173025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d484eb91-c040-4643-91a3-f79dc697fa65 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:25.174011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d484eb91-c040-4643-91a3-f79dc697fa65 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] [instance: cdd533e1-ff6e-4525-b6cb-e425440195cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:25.200385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d484eb91-c040-4643-91a3-f79dc697fa65 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:25.201038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d484eb91-c040-4643-91a3-f79dc697fa65 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:25.203060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d484eb91-c040-4643-91a3-f79dc697fa65 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:25.207770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d484eb91-c040-4643-91a3-f79dc697fa65 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:25.208267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d484eb91-c040-4643-91a3-f79dc697fa65 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:25.210374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d484eb91-c040-4643-91a3-f79dc697fa65 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:25.237890 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-d484eb91-c040-4643-91a3-f79dc697fa65 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] HTTP exception thrown: Instance cdd533e1-ff6e-4525-b6cb-e425440195cb could not be found. Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d484eb91-c040-4643-91a3-f79dc697fa65 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Request method failure captured: Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb HTTP/1.1 Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK1Hx73UhQ9Tcz8_JcmdumqVV-h9fcpXIMetJjFVPi6AYh36xa3dQAyR4NHHvvJlw9NV_zNIlIgjlYpPn8rvI2-vU4x3n5g28huZNuVcUXnH81Ez4CmnUC2HxwqLOIxyKyeMQ27c7Jy94HPRpfcpRfxv7dY01d_0itL3zMUzGVVAHjE Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 7586bc93b2f04b918195ee2c9e490b92 Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7586bc93b2f04b918195ee2c9e490b92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7586bc93b2f04b918195ee2c9e490b92", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 7586bc93b2f04b918195ee2c9e490b92 Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1108766416 Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerMetadataNegativeTestJSON-1108766416-project Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 538606670f9e4f239347abb3f5da8ac8 Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1108766416-project Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance cdd533e1-ff6e-4525-b6cb-e425440195cb could not be found. Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'cdd533e1-ff6e-4525-b6cb-e425440195cb'} Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdd533e1-ff6e-4525-b6cb-e425440195cb could not be found. Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdd533e1-ff6e-4525-b6cb-e425440195cb could not be found. Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:25.239807 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:25.244766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:25.244766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:25.244766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:25.244766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:25.244766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:25.244766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:25.244766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdd533e1-ff6e-4525-b6cb-e425440195cb could not be found. Oct 10 23:40:25.244766 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:25.250649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d484eb91-c040-4643-91a3-f79dc697fa65 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] Returning 404 to user: Instance cdd533e1-ff6e-4525-b6cb-e425440195cb could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:25.256736 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d484eb91-c040-4643-91a3-f79dc697fa65 tempest-ServerMetadataNegativeTestJSON-1108766416 tempest-ServerMetadataNegativeTestJSON-1108766416-project] 10.222.0.23 "GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb" status: 404 len: 111 microversion: 2.1 time: 0.084405 Oct 10 23:40:25.258273 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2260/4679] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:25 2022] GET /compute/v2.1/servers/cdd533e1-ff6e-4525-b6cb-e425440195cb => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:40:25.811306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-252b6ec1-cdd4-4af1-b578-c081e5ee8fad tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:25.835483 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-252b6ec1-cdd4-4af1-b578-c081e5ee8fad tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 200 len: 1500 microversion: 2.1 time: 0.907079 Oct 10 23:40:25.837999 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2420/4680] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:24 2022] GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 1500 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:25.868089 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bd7b6d1f-e4fd-470f-9291-41532edfd073 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:25.868089 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bd7b6d1f-e4fd-470f-9291-41532edfd073 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:25.880700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd7b6d1f-e4fd-470f-9291-41532edfd073 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:25.881957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd7b6d1f-e4fd-470f-9291-41532edfd073 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:25.882080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd7b6d1f-e4fd-470f-9291-41532edfd073 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:25.886439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd7b6d1f-e4fd-470f-9291-41532edfd073 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:25.886965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd7b6d1f-e4fd-470f-9291-41532edfd073 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:25.887432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bd7b6d1f-e4fd-470f-9291-41532edfd073 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:25.984638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-bd7b6d1f-e4fd-470f-9291-41532edfd073 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lazy-loading 'flavor' on Instance uuid 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:40:26.100141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:40:26.118927 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bd7b6d1f-e4fd-470f-9291-41532edfd073 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "POST /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22/action" status: 202 len: 0 microversion: 2.1 time: 0.256128 Oct 10 23:40:26.125618 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2261/4681] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:40:25 2022] POST /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:40:26.135931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-713098e0-6427-4f8c-b177-cfc931495c68 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:26.137519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-713098e0-6427-4f8c-b177-cfc931495c68 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:26.151148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-713098e0-6427-4f8c-b177-cfc931495c68 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:26.154001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-713098e0-6427-4f8c-b177-cfc931495c68 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:26.155298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-713098e0-6427-4f8c-b177-cfc931495c68 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:26.158013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-713098e0-6427-4f8c-b177-cfc931495c68 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:26.158702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-713098e0-6427-4f8c-b177-cfc931495c68 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:26.160784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-713098e0-6427-4f8c-b177-cfc931495c68 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:26.173580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:40:26.182662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-62702f90-a30e-4f4a-8ec9-bd9634f01111 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:26.183853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-62702f90-a30e-4f4a-8ec9-bd9634f01111 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:26.206722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62702f90-a30e-4f4a-8ec9-bd9634f01111 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:26.207466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62702f90-a30e-4f4a-8ec9-bd9634f01111 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:26.207966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62702f90-a30e-4f4a-8ec9-bd9634f01111 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:26.208725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62702f90-a30e-4f4a-8ec9-bd9634f01111 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:26.209198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62702f90-a30e-4f4a-8ec9-bd9634f01111 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:26.209677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62702f90-a30e-4f4a-8ec9-bd9634f01111 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:26.492585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-62702f90-a30e-4f4a-8ec9-bd9634f01111 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:26.509626 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-62702f90-a30e-4f4a-8ec9-bd9634f01111 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:26.511278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-62702f90-a30e-4f4a-8ec9-bd9634f01111 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:26.515408 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-62702f90-a30e-4f4a-8ec9-bd9634f01111 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1604 microversion: 2.42 time: 0.337363 Oct 10 23:40:26.519074 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2262/4682] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:26 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1604 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:26.548994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-713098e0-6427-4f8c-b177-cfc931495c68 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:26.568863 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-713098e0-6427-4f8c-b177-cfc931495c68 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 200 len: 1508 microversion: 2.1 time: 0.435306 Oct 10 23:40:26.573171 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2421/4683] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:26 2022] GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 1508 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:27.587206 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9055ad13-d3f2-42d9-9cf4-d20fcf70cdd1 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:27.592510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9055ad13-d3f2-42d9-9cf4-d20fcf70cdd1 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:27.617221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-665da35b-156b-4fb8-8c33-7817a5c2dacc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:27.617872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-665da35b-156b-4fb8-8c33-7817a5c2dacc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:27.626350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9055ad13-d3f2-42d9-9cf4-d20fcf70cdd1 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:27.626875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9055ad13-d3f2-42d9-9cf4-d20fcf70cdd1 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:27.627362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9055ad13-d3f2-42d9-9cf4-d20fcf70cdd1 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:27.628869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9055ad13-d3f2-42d9-9cf4-d20fcf70cdd1 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:27.629391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9055ad13-d3f2-42d9-9cf4-d20fcf70cdd1 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:27.630543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9055ad13-d3f2-42d9-9cf4-d20fcf70cdd1 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:27.636882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-665da35b-156b-4fb8-8c33-7817a5c2dacc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:27.642777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-665da35b-156b-4fb8-8c33-7817a5c2dacc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:27.644368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-665da35b-156b-4fb8-8c33-7817a5c2dacc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:27.645171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-665da35b-156b-4fb8-8c33-7817a5c2dacc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:27.645670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-665da35b-156b-4fb8-8c33-7817a5c2dacc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:27.646109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-665da35b-156b-4fb8-8c33-7817a5c2dacc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:27.923010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9055ad13-d3f2-42d9-9cf4-d20fcf70cdd1 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:27.938525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9055ad13-d3f2-42d9-9cf4-d20fcf70cdd1 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:27.951650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9055ad13-d3f2-42d9-9cf4-d20fcf70cdd1 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:27.951650 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9055ad13-d3f2-42d9-9cf4-d20fcf70cdd1 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1604 microversion: 2.42 time: 0.377832 Oct 10 23:40:27.952063 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2263/4684] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:27 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1604 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:27.955062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-665da35b-156b-4fb8-8c33-7817a5c2dacc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:27.972166 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-665da35b-156b-4fb8-8c33-7817a5c2dacc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 200 len: 1491 microversion: 2.1 time: 0.359226 Oct 10 23:40:27.973210 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2422/4685] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:27 2022] GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 1491 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:40:28.009803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f1d10feb-c84c-47ea-861d-b26b320007de tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:28.010311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f1d10feb-c84c-47ea-861d-b26b320007de tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:28.028429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1d10feb-c84c-47ea-861d-b26b320007de tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:28.031825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1d10feb-c84c-47ea-861d-b26b320007de tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:28.032637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1d10feb-c84c-47ea-861d-b26b320007de tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:28.033629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1d10feb-c84c-47ea-861d-b26b320007de tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:28.035964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1d10feb-c84c-47ea-861d-b26b320007de tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:28.038322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1d10feb-c84c-47ea-861d-b26b320007de tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:28.119958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f1d10feb-c84c-47ea-861d-b26b320007de tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:40:28.278193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b24f5a7a-576d-4355-bfb2-da65a4932792 tempest-MultipleCreateNegativeTestJSON-1714632821 tempest-MultipleCreateNegativeTestJSON-1714632821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-378922087", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:28.294222 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-b24f5a7a-576d-4355-bfb2-da65a4932792 tempest-MultipleCreateNegativeTestJSON-1714632821 tempest-MultipleCreateNegativeTestJSON-1714632821-project] HTTP exception thrown: min_count must be <= max_count Oct 10 23:40:28.297803 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f1d10feb-c84c-47ea-861d-b26b320007de tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "DELETE /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 204 len: 0 microversion: 2.1 time: 0.292255 Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b24f5a7a-576d-4355-bfb2-da65a4932792 tempest-MultipleCreateNegativeTestJSON-1714632821 tempest-MultipleCreateNegativeTestJSON-1714632821-project] Request method failure captured: Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 183 Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK1rdyFUgknQ-BdwONIBPoWXAfNCS7q2fEwdYrid9tF8-CDIqT6OXk59FtrpbP-18JNzrwZOcRWuUOVpz2kM5sZu5uT8eYWHfYuxfbEz73M9v-78DJgEC3E7MbD2IHG0D8BY75v3MqU454GL-5CAVq8veyT8n8HYT5NWSxuWkAjmJzk Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 51a197e37e294d6dae5627cbf0542068 Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1714632821 Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/51a197e37e294d6dae5627cbf0542068"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51a197e37e294d6dae5627cbf0542068"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51a197e37e294d6dae5627cbf0542068"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_51a197e37e294d6dae5627cbf0542068", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1714632821 Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 51a197e37e294d6dae5627cbf0542068 Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1714632821 Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-MultipleCreateNegativeTestJSON-1714632821-project Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: abdeb303eb65429ab91c5638627d72e2 Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1714632821-project Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-378922087", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: exception: min_count must be <= max_count Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-378922087', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 10 23:40:28.300335 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.309990 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2423/4686] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:40:28 2022] DELETE /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 23:40:28.312441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b24f5a7a-576d-4355-bfb2-da65a4932792 tempest-MultipleCreateNegativeTestJSON-1714632821 tempest-MultipleCreateNegativeTestJSON-1714632821-project] Returning 400 to user: min_count must be <= max_count {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:28.313838 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b24f5a7a-576d-4355-bfb2-da65a4932792 tempest-MultipleCreateNegativeTestJSON-1714632821 tempest-MultipleCreateNegativeTestJSON-1714632821-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.360134 Oct 10 23:40:28.314914 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2264/4687] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:40:27 2022] POST /compute/v2.1/servers => generated 74 bytes in 362 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 23:40:28.323388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-aac78874-048e-4a79-8e2d-f6af58e12c4f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:28.325919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-aac78874-048e-4a79-8e2d-f6af58e12c4f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:28.363721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aac78874-048e-4a79-8e2d-f6af58e12c4f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:28.364252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aac78874-048e-4a79-8e2d-f6af58e12c4f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:28.365351 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aac78874-048e-4a79-8e2d-f6af58e12c4f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:28.367908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aac78874-048e-4a79-8e2d-f6af58e12c4f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:28.368409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aac78874-048e-4a79-8e2d-f6af58e12c4f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:28.368833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aac78874-048e-4a79-8e2d-f6af58e12c4f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:28.548975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6dc3c2fe-2531-4b92-86f7-21dc8c7ffdfa tempest-MultipleCreateNegativeTestJSON-1714632821 tempest-MultipleCreateNegativeTestJSON-1714632821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-14568071", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "max_count": 0}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6dc3c2fe-2531-4b92-86f7-21dc8c7ffdfa tempest-MultipleCreateNegativeTestJSON-1714632821 tempest-MultipleCreateNegativeTestJSON-1714632821-project] Request method failure captured: Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 166 Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK1rdyFUgknQ-BdwONIBPoWXAfNCS7q2fEwdYrid9tF8-CDIqT6OXk59FtrpbP-18JNzrwZOcRWuUOVpz2kM5sZu5uT8eYWHfYuxfbEz73M9v-78DJgEC3E7MbD2IHG0D8BY75v3MqU454GL-5CAVq8veyT8n8HYT5NWSxuWkAjmJzk Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 51a197e37e294d6dae5627cbf0542068 Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1714632821 Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/51a197e37e294d6dae5627cbf0542068"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51a197e37e294d6dae5627cbf0542068"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51a197e37e294d6dae5627cbf0542068"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_51a197e37e294d6dae5627cbf0542068", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1714632821 Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 51a197e37e294d6dae5627cbf0542068 Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1714632821 Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-MultipleCreateNegativeTestJSON-1714632821-project Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: abdeb303eb65429ab91c5638627d72e2 Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1714632821-project Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-14568071", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "max_count": 0}} Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-14568071', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452', 'max_count': 0}}} Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 0 Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:40:28.572149 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:40:28.580073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:40:28.580073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:40:28.580073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:40:28.580073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:40:28.580073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 10 23:40:28.580073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.580073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:28.580073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.580073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:28.580073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:28.580073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:28.580073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:40:28.580073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:40:28.580073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 10 23:40:28.580073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.580073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6dc3c2fe-2531-4b92-86f7-21dc8c7ffdfa tempest-MultipleCreateNegativeTestJSON-1714632821 tempest-MultipleCreateNegativeTestJSON-1714632821-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:28.580073 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6dc3c2fe-2531-4b92-86f7-21dc8c7ffdfa tempest-MultipleCreateNegativeTestJSON-1714632821 tempest-MultipleCreateNegativeTestJSON-1714632821-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.029847 Oct 10 23:40:28.585568 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2265/4688] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:40:28 2022] POST /compute/v2.1/servers => generated 130 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 23:40:28.695354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-40f24df3-66d7-4cb7-a09f-bbd931d1b71b tempest-MultipleCreateNegativeTestJSON-1714632821 tempest-MultipleCreateNegativeTestJSON-1714632821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-271977363", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "max_count": 2.5}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-40f24df3-66d7-4cb7-a09f-bbd931d1b71b tempest-MultipleCreateNegativeTestJSON-1714632821 tempest-MultipleCreateNegativeTestJSON-1714632821-project] Request method failure captured: Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 169 Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK1rdyFUgknQ-BdwONIBPoWXAfNCS7q2fEwdYrid9tF8-CDIqT6OXk59FtrpbP-18JNzrwZOcRWuUOVpz2kM5sZu5uT8eYWHfYuxfbEz73M9v-78DJgEC3E7MbD2IHG0D8BY75v3MqU454GL-5CAVq8veyT8n8HYT5NWSxuWkAjmJzk Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 51a197e37e294d6dae5627cbf0542068 Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1714632821 Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/51a197e37e294d6dae5627cbf0542068"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51a197e37e294d6dae5627cbf0542068"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51a197e37e294d6dae5627cbf0542068"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_51a197e37e294d6dae5627cbf0542068", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1714632821 Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 51a197e37e294d6dae5627cbf0542068 Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1714632821 Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-MultipleCreateNegativeTestJSON-1714632821-project Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: abdeb303eb65429ab91c5638627d72e2 Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1714632821-project Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-271977363", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "max_count": 2.5}} Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-271977363', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452', 'max_count': 2.5}}} Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 2.5 Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:40:28.707966 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:40:28.717706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:40:28.717706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:40:28.717706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:40:28.717706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:40:28.717706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 10 23:40:28.717706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.717706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:28.717706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.717706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:28.717706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:28.717706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:28.717706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:40:28.717706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:40:28.717706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 10 23:40:28.717706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.717706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-40f24df3-66d7-4cb7-a09f-bbd931d1b71b tempest-MultipleCreateNegativeTestJSON-1714632821 tempest-MultipleCreateNegativeTestJSON-1714632821-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:28.717706 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-40f24df3-66d7-4cb7-a09f-bbd931d1b71b tempest-MultipleCreateNegativeTestJSON-1714632821 tempest-MultipleCreateNegativeTestJSON-1714632821-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.023694 Oct 10 23:40:28.726568 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2266/4689] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:40:28 2022] POST /compute/v2.1/servers => generated 139 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:40:28.850213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f34dc714-fb7f-4b88-a56c-0d6f1379872b tempest-MultipleCreateNegativeTestJSON-1714632821 tempest-MultipleCreateNegativeTestJSON-1714632821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2115105674", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "min_count": 0}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f34dc714-fb7f-4b88-a56c-0d6f1379872b tempest-MultipleCreateNegativeTestJSON-1714632821 tempest-MultipleCreateNegativeTestJSON-1714632821-project] Request method failure captured: Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 168 Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK1rdyFUgknQ-BdwONIBPoWXAfNCS7q2fEwdYrid9tF8-CDIqT6OXk59FtrpbP-18JNzrwZOcRWuUOVpz2kM5sZu5uT8eYWHfYuxfbEz73M9v-78DJgEC3E7MbD2IHG0D8BY75v3MqU454GL-5CAVq8veyT8n8HYT5NWSxuWkAjmJzk Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 51a197e37e294d6dae5627cbf0542068 Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1714632821 Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/51a197e37e294d6dae5627cbf0542068"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51a197e37e294d6dae5627cbf0542068"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51a197e37e294d6dae5627cbf0542068"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_51a197e37e294d6dae5627cbf0542068", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1714632821 Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 51a197e37e294d6dae5627cbf0542068 Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1714632821 Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-MultipleCreateNegativeTestJSON-1714632821-project Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: abdeb303eb65429ab91c5638627d72e2 Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1714632821-project Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2115105674", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "min_count": 0}} Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2115105674', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452', 'min_count': 0}}} Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 0 Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:40:28.870115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:40:28.883066 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:40:28.883066 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:40:28.883066 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:40:28.883066 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:40:28.883066 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 10 23:40:28.883066 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.883066 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:28.883066 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.883066 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:28.883066 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:28.883066 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:28.883066 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:40:28.883066 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:40:28.883066 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 10 23:40:28.883066 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:28.883066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f34dc714-fb7f-4b88-a56c-0d6f1379872b tempest-MultipleCreateNegativeTestJSON-1714632821 tempest-MultipleCreateNegativeTestJSON-1714632821-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:28.883066 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f34dc714-fb7f-4b88-a56c-0d6f1379872b tempest-MultipleCreateNegativeTestJSON-1714632821 tempest-MultipleCreateNegativeTestJSON-1714632821-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.033728 Oct 10 23:40:28.883066 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2267/4690] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:40:28 2022] POST /compute/v2.1/servers => generated 130 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:40:28.888783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-aac78874-048e-4a79-8e2d-f6af58e12c4f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:28.924094 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-aac78874-048e-4a79-8e2d-f6af58e12c4f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 200 len: 1497 microversion: 2.1 time: 0.618421 Oct 10 23:40:28.927050 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2424/4691] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:28 2022] GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 1497 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:29.017869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-79a8ba18-bc70-40ec-8674-785570cde625 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:29.019971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-79a8ba18-bc70-40ec-8674-785570cde625 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:29.043724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79a8ba18-bc70-40ec-8674-785570cde625 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:29.047687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79a8ba18-bc70-40ec-8674-785570cde625 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:29.049357 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79a8ba18-bc70-40ec-8674-785570cde625 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:29.056648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79a8ba18-bc70-40ec-8674-785570cde625 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:29.058546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79a8ba18-bc70-40ec-8674-785570cde625 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:29.059249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79a8ba18-bc70-40ec-8674-785570cde625 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:29.138401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8ac2b87f-3e7f-4cc3-a60f-09d74381d141 tempest-MultipleCreateNegativeTestJSON-1714632821 tempest-MultipleCreateNegativeTestJSON-1714632821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2027286434", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "min_count": 2.5}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8ac2b87f-3e7f-4cc3-a60f-09d74381d141 tempest-MultipleCreateNegativeTestJSON-1714632821 tempest-MultipleCreateNegativeTestJSON-1714632821-project] Request method failure captured: Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 170 Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK1rdyFUgknQ-BdwONIBPoWXAfNCS7q2fEwdYrid9tF8-CDIqT6OXk59FtrpbP-18JNzrwZOcRWuUOVpz2kM5sZu5uT8eYWHfYuxfbEz73M9v-78DJgEC3E7MbD2IHG0D8BY75v3MqU454GL-5CAVq8veyT8n8HYT5NWSxuWkAjmJzk Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 51a197e37e294d6dae5627cbf0542068 Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1714632821 Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/51a197e37e294d6dae5627cbf0542068"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51a197e37e294d6dae5627cbf0542068"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/51a197e37e294d6dae5627cbf0542068"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_51a197e37e294d6dae5627cbf0542068", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1714632821 Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 51a197e37e294d6dae5627cbf0542068 Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1714632821 Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-MultipleCreateNegativeTestJSON-1714632821-project Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: abdeb303eb65429ab91c5638627d72e2 Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1714632821-project Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2027286434", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "min_count": 2.5}} Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2027286434', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452', 'min_count': 2.5}}} Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 2.5 Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:40:29.163692 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:40:29.174075 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:40:29.174075 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:40:29.174075 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:40:29.174075 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:40:29.174075 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 10 23:40:29.174075 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:29.174075 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:29.174075 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:29.174075 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:29.174075 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:29.174075 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:29.174075 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:40:29.174075 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:40:29.174075 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 10 23:40:29.174075 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:29.174075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8ac2b87f-3e7f-4cc3-a60f-09d74381d141 tempest-MultipleCreateNegativeTestJSON-1714632821 tempest-MultipleCreateNegativeTestJSON-1714632821-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:29.176240 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8ac2b87f-3e7f-4cc3-a60f-09d74381d141 tempest-MultipleCreateNegativeTestJSON-1714632821 tempest-MultipleCreateNegativeTestJSON-1714632821-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.043330 Oct 10 23:40:29.193237 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2425/4692] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:40:29 2022] POST /compute/v2.1/servers => generated 139 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:40:29.272569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-79a8ba18-bc70-40ec-8674-785570cde625 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:29.285010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-79a8ba18-bc70-40ec-8674-785570cde625 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:29.287438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-79a8ba18-bc70-40ec-8674-785570cde625 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:29.289409 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-79a8ba18-bc70-40ec-8674-785570cde625 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1604 microversion: 2.42 time: 0.301689 Oct 10 23:40:29.290799 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2268/4693] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:28 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1604 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:29.982114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cb1c876e-bbbb-4c43-aa94-7a3942a36389 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:30.005591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cb1c876e-bbbb-4c43-aa94-7a3942a36389 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:30.028278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=93,nova_api:UPDATE=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:40:30.056557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb1c876e-bbbb-4c43-aa94-7a3942a36389 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:30.058985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb1c876e-bbbb-4c43-aa94-7a3942a36389 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:30.061552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb1c876e-bbbb-4c43-aa94-7a3942a36389 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:30.065754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb1c876e-bbbb-4c43-aa94-7a3942a36389 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:30.066868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb1c876e-bbbb-4c43-aa94-7a3942a36389 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:30.067805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb1c876e-bbbb-4c43-aa94-7a3942a36389 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:30.324446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3d7648fa-3e46-409a-9ad6-c6f9164f66c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:30.326505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3d7648fa-3e46-409a-9ad6-c6f9164f66c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:30.350725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d7648fa-3e46-409a-9ad6-c6f9164f66c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:30.353812 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d7648fa-3e46-409a-9ad6-c6f9164f66c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:30.360142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d7648fa-3e46-409a-9ad6-c6f9164f66c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:30.362161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d7648fa-3e46-409a-9ad6-c6f9164f66c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:30.363998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d7648fa-3e46-409a-9ad6-c6f9164f66c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:30.365993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d7648fa-3e46-409a-9ad6-c6f9164f66c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:30.412814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cb1c876e-bbbb-4c43-aa94-7a3942a36389 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:30.432269 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cb1c876e-bbbb-4c43-aa94-7a3942a36389 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 200 len: 1497 microversion: 2.1 time: 0.461091 Oct 10 23:40:30.459781 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2426/4694] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:29 2022] GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 1497 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:30.714766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3d7648fa-3e46-409a-9ad6-c6f9164f66c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:30.735448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3d7648fa-3e46-409a-9ad6-c6f9164f66c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:30.745367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3d7648fa-3e46-409a-9ad6-c6f9164f66c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:30.747996 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3d7648fa-3e46-409a-9ad6-c6f9164f66c3 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1604 microversion: 2.42 time: 0.430397 Oct 10 23:40:30.766084 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2269/4695] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:30 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1604 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:40:31.466443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8740c7b8-a395-440c-aa18-6b5855152ec1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:31.467280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8740c7b8-a395-440c-aa18-6b5855152ec1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:31.487882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8740c7b8-a395-440c-aa18-6b5855152ec1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:31.491795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8740c7b8-a395-440c-aa18-6b5855152ec1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:31.496114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8740c7b8-a395-440c-aa18-6b5855152ec1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:31.498711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8740c7b8-a395-440c-aa18-6b5855152ec1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:31.501907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8740c7b8-a395-440c-aa18-6b5855152ec1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:31.502975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8740c7b8-a395-440c-aa18-6b5855152ec1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:31.694300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8740c7b8-a395-440c-aa18-6b5855152ec1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:31.707172 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8740c7b8-a395-440c-aa18-6b5855152ec1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 200 len: 1455 microversion: 2.1 time: 0.243806 Oct 10 23:40:31.723620 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2427/4696] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:31 2022] GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 1455 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:40:31.791639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-00344f03-9d69-43b7-9712-4460a4d8b920 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:31.794490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-00344f03-9d69-43b7-9712-4460a4d8b920 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:31.843801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-00344f03-9d69-43b7-9712-4460a4d8b920 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:31.846044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-00344f03-9d69-43b7-9712-4460a4d8b920 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:31.847007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-00344f03-9d69-43b7-9712-4460a4d8b920 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:31.848493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-00344f03-9d69-43b7-9712-4460a4d8b920 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:31.859835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-00344f03-9d69-43b7-9712-4460a4d8b920 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:31.861021 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-00344f03-9d69-43b7-9712-4460a4d8b920 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:31.869811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-e601ee16-0f7e-4aad-b038-ab5ceb5790e2 req-8d580908-438f-4bc2-b1e1-9af4f8a095fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03efae6a-4cc3-40bd-8ff4-71fce7fc1e22", "name": "network-vif-deleted", "tag": "db582bb9-a330-48b9-abb9-cf5fe58cfb6b"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:31.905639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e601ee16-0f7e-4aad-b038-ab5ceb5790e2 req-8d580908-438f-4bc2-b1e1-9af4f8a095fc service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:31.913973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e601ee16-0f7e-4aad-b038-ab5ceb5790e2 req-8d580908-438f-4bc2-b1e1-9af4f8a095fc service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:31.914999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e601ee16-0f7e-4aad-b038-ab5ceb5790e2 req-8d580908-438f-4bc2-b1e1-9af4f8a095fc service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:32.000566 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-e601ee16-0f7e-4aad-b038-ab5ceb5790e2 req-8d580908-438f-4bc2-b1e1-9af4f8a095fc service nova] Creating event network-vif-deleted:db582bb9-a330-48b9-abb9-cf5fe58cfb6b for instance 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 on n-h2-860864-2 Oct 10 23:40:32.055857 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-e601ee16-0f7e-4aad-b038-ab5ceb5790e2 req-8d580908-438f-4bc2-b1e1-9af4f8a095fc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189930 Oct 10 23:40:32.060350 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2428/4697] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:40:32.099385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-00344f03-9d69-43b7-9712-4460a4d8b920 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:32.126478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-00344f03-9d69-43b7-9712-4460a4d8b920 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:32.127923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-00344f03-9d69-43b7-9712-4460a4d8b920 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:32.147575 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-00344f03-9d69-43b7-9712-4460a4d8b920 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1604 microversion: 2.42 time: 0.364011 Oct 10 23:40:32.154510 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2270/4698] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:31 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1604 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:32.740847 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0082f2af-9e37-405c-b450-fd346362d73c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:32.744170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0082f2af-9e37-405c-b450-fd346362d73c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:32.771127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0082f2af-9e37-405c-b450-fd346362d73c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:32.772590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0082f2af-9e37-405c-b450-fd346362d73c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:32.777899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0082f2af-9e37-405c-b450-fd346362d73c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:32.780001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0082f2af-9e37-405c-b450-fd346362d73c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:32.783677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0082f2af-9e37-405c-b450-fd346362d73c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:32.784409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0082f2af-9e37-405c-b450-fd346362d73c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:32.867925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0082f2af-9e37-405c-b450-fd346362d73c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:32.868446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0082f2af-9e37-405c-b450-fd346362d73c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:32.872756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0082f2af-9e37-405c-b450-fd346362d73c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:32.873422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-0082f2af-9e37-405c-b450-fd346362d73c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lazy-loading 'fault' on Instance uuid 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:40:33.033867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0082f2af-9e37-405c-b450-fd346362d73c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cc066774b344a24a91fb41e990f5234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d42cb00f2544abbde09cae76f3e3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:33.052466 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0082f2af-9e37-405c-b450-fd346362d73c tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 200 len: 1304 microversion: 2.1 time: 0.321638 Oct 10 23:40:33.053826 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2429/4699] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:32 2022] GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 1304 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:40:33.186555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b2c0e7db-0985-4098-8e0a-eab3d1dabc19 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:33.188550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b2c0e7db-0985-4098-8e0a-eab3d1dabc19 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:33.212208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2c0e7db-0985-4098-8e0a-eab3d1dabc19 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:33.213103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2c0e7db-0985-4098-8e0a-eab3d1dabc19 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:33.213862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2c0e7db-0985-4098-8e0a-eab3d1dabc19 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:33.214858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2c0e7db-0985-4098-8e0a-eab3d1dabc19 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:33.215559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2c0e7db-0985-4098-8e0a-eab3d1dabc19 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:33.216209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2c0e7db-0985-4098-8e0a-eab3d1dabc19 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:33.431653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b2c0e7db-0985-4098-8e0a-eab3d1dabc19 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:33.460543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b2c0e7db-0985-4098-8e0a-eab3d1dabc19 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:33.467224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b2c0e7db-0985-4098-8e0a-eab3d1dabc19 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:33.471861 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b2c0e7db-0985-4098-8e0a-eab3d1dabc19 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1604 microversion: 2.42 time: 0.288869 Oct 10 23:40:33.474112 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2271/4700] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:33 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1604 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:34.081138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e45232c2-5058-4b32-b6ba-6258063ca1d1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:34.081855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e45232c2-5058-4b32-b6ba-6258063ca1d1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:34.098764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e45232c2-5058-4b32-b6ba-6258063ca1d1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:34.105252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e45232c2-5058-4b32-b6ba-6258063ca1d1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:34.106120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e45232c2-5058-4b32-b6ba-6258063ca1d1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:34.111305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e45232c2-5058-4b32-b6ba-6258063ca1d1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:34.113618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e45232c2-5058-4b32-b6ba-6258063ca1d1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:34.114120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e45232c2-5058-4b32-b6ba-6258063ca1d1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:34.154971 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-e45232c2-5058-4b32-b6ba-6258063ca1d1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] HTTP exception thrown: Instance 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 could not be found. Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e45232c2-5058-4b32-b6ba-6258063ca1d1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Request method failure captured: Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 HTTP/1.1 Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKw8hCLXWIFTJ3HaJf5ifgl6Pm7vGD8ptwfQXuGQAkf1M-RWSvV8nlygpWidDM338TQR6cXdzFUy8zgn8XWf4EUtX06mIecSablgYBXm9sJQ78u324dyYAXvHBKQ5Ge8XY02Fdf2X0InpWnugNSR9M1ccFMQnfZYNbqSwCmT2w9EOBY Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d42cb00f2544abbde09cae76f3e3a1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 7cc066774b344a24a91fb41e990f5234 Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 could not be found. Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '03efae6a-4cc3-40bd-8ff4-71fce7fc1e22'} Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 could not be found. Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 could not be found. Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:34.156881 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.161892 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.161892 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:34.161892 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:34.161892 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:34.161892 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:34.161892 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 could not be found. Oct 10 23:40:34.161892 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.161892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e45232c2-5058-4b32-b6ba-6258063ca1d1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Returning 404 to user: Instance 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:34.161892 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e45232c2-5058-4b32-b6ba-6258063ca1d1 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 404 len: 111 microversion: 2.1 time: 0.083759 Oct 10 23:40:34.161892 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2430/4701] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:34 2022] GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:40:34.170549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-61350d02-5c73-47f6-902f-4c9620d92b92 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:34.172197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-61350d02-5c73-47f6-902f-4c9620d92b92 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:34.181221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61350d02-5c73-47f6-902f-4c9620d92b92 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:34.181777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61350d02-5c73-47f6-902f-4c9620d92b92 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:34.182426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61350d02-5c73-47f6-902f-4c9620d92b92 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:34.183399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61350d02-5c73-47f6-902f-4c9620d92b92 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:34.183879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61350d02-5c73-47f6-902f-4c9620d92b92 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:34.184317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61350d02-5c73-47f6-902f-4c9620d92b92 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:34.210624 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-61350d02-5c73-47f6-902f-4c9620d92b92 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] HTTP exception thrown: Instance 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 could not be found. Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-61350d02-5c73-47f6-902f-4c9620d92b92 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Request method failure captured: Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 HTTP/1.1 Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKw8hCLXWIFTJ3HaJf5ifgl6Pm7vGD8ptwfQXuGQAkf1M-RWSvV8nlygpWidDM338TQR6cXdzFUy8zgn8XWf4EUtX06mIecSablgYBXm9sJQ78u324dyYAXvHBKQ5Ge8XY02Fdf2X0InpWnugNSR9M1ccFMQnfZYNbqSwCmT2w9EOBY Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d42cb00f2544abbde09cae76f3e3a1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 7cc066774b344a24a91fb41e990f5234 Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 could not be found. Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '03efae6a-4cc3-40bd-8ff4-71fce7fc1e22'} Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 could not be found. Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:40:34.215018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:40:34.228985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 could not be found. Oct 10 23:40:34.228985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.228985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:34.228985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.228985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.228985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:34.228985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:34.228985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:34.228985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:34.228985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 could not be found. Oct 10 23:40:34.228985 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.228985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-61350d02-5c73-47f6-902f-4c9620d92b92 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Returning 404 to user: Instance 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:34.228985 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-61350d02-5c73-47f6-902f-4c9620d92b92 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "DELETE /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 404 len: 111 microversion: 2.1 time: 0.060206 Oct 10 23:40:34.228985 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2272/4702] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:40:34 2022] DELETE /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:40:34.246003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-25695b3c-bffd-441f-9af4-2053ab18fed6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:34.249972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-25695b3c-bffd-441f-9af4-2053ab18fed6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:34.269318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25695b3c-bffd-441f-9af4-2053ab18fed6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:34.270534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25695b3c-bffd-441f-9af4-2053ab18fed6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:34.272493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25695b3c-bffd-441f-9af4-2053ab18fed6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:34.274265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25695b3c-bffd-441f-9af4-2053ab18fed6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:34.274846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25695b3c-bffd-441f-9af4-2053ab18fed6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:34.275453 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-25695b3c-bffd-441f-9af4-2053ab18fed6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:34.311048 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-25695b3c-bffd-441f-9af4-2053ab18fed6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] HTTP exception thrown: Instance 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 could not be found. Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-25695b3c-bffd-441f-9af4-2053ab18fed6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Request method failure captured: Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 HTTP/1.1 Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKw8hCLXWIFTJ3HaJf5ifgl6Pm7vGD8ptwfQXuGQAkf1M-RWSvV8nlygpWidDM338TQR6cXdzFUy8zgn8XWf4EUtX06mIecSablgYBXm9sJQ78u324dyYAXvHBKQ5Ge8XY02Fdf2X0InpWnugNSR9M1ccFMQnfZYNbqSwCmT2w9EOBY Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d42cb00f2544abbde09cae76f3e3a1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 7cc066774b344a24a91fb41e990f5234 Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 could not be found. Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '03efae6a-4cc3-40bd-8ff4-71fce7fc1e22'} Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 could not be found. Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 could not be found. Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:34.315630 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.321228 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.321228 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:34.321228 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:34.321228 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:34.321228 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:34.321228 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 could not be found. Oct 10 23:40:34.321228 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.321228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-25695b3c-bffd-441f-9af4-2053ab18fed6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Returning 404 to user: Instance 03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:34.321228 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-25695b3c-bffd-441f-9af4-2053ab18fed6 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22" status: 404 len: 111 microversion: 2.1 time: 0.085414 Oct 10 23:40:34.325589 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2431/4703] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:34 2022] GET /compute/v2.1/servers/03efae6a-4cc3-40bd-8ff4-71fce7fc1e22 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:40:34.335582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-25566a2a-d7fd-473b-9665-fe269e9c6fc4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:34.336098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-25566a2a-d7fd-473b-9665-fe269e9c6fc4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:34.347656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25566a2a-d7fd-473b-9665-fe269e9c6fc4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:34.348247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25566a2a-d7fd-473b-9665-fe269e9c6fc4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:34.348688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25566a2a-d7fd-473b-9665-fe269e9c6fc4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:34.349680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25566a2a-d7fd-473b-9665-fe269e9c6fc4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:34.354417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25566a2a-d7fd-473b-9665-fe269e9c6fc4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:34.354873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25566a2a-d7fd-473b-9665-fe269e9c6fc4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:34.390505 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-25566a2a-d7fd-473b-9665-fe269e9c6fc4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] HTTP exception thrown: Instance b579635a-eb7c-4e99-8b52-faeba843197f could not be found. Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-25566a2a-d7fd-473b-9665-fe269e9c6fc4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Request method failure captured: Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f HTTP/1.1 Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKw8hCLXWIFTJ3HaJf5ifgl6Pm7vGD8ptwfQXuGQAkf1M-RWSvV8nlygpWidDM338TQR6cXdzFUy8zgn8XWf4EUtX06mIecSablgYBXm9sJQ78u324dyYAXvHBKQ5Ge8XY02Fdf2X0InpWnugNSR9M1ccFMQnfZYNbqSwCmT2w9EOBY Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d42cb00f2544abbde09cae76f3e3a1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 7cc066774b344a24a91fb41e990f5234 Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance b579635a-eb7c-4e99-8b52-faeba843197f could not be found. Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'b579635a-eb7c-4e99-8b52-faeba843197f'} Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b579635a-eb7c-4e99-8b52-faeba843197f could not be found. Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:40:34.392685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:40:34.399835 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b579635a-eb7c-4e99-8b52-faeba843197f could not be found. Oct 10 23:40:34.399835 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.399835 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:34.399835 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.399835 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.399835 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:34.399835 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:34.399835 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:34.399835 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:34.399835 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b579635a-eb7c-4e99-8b52-faeba843197f could not be found. Oct 10 23:40:34.399835 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.399835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-25566a2a-d7fd-473b-9665-fe269e9c6fc4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Returning 404 to user: Instance b579635a-eb7c-4e99-8b52-faeba843197f could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:34.399835 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-25566a2a-d7fd-473b-9665-fe269e9c6fc4 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 404 len: 111 microversion: 2.1 time: 0.066160 Oct 10 23:40:34.399835 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2273/4704] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:40:34 2022] DELETE /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:40:34.408540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7fa7793d-f207-4d46-a2e8-904dc5e74a30 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:34.408741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7fa7793d-f207-4d46-a2e8-904dc5e74a30 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: b579635a-eb7c-4e99-8b52-faeba843197f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:34.422637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fa7793d-f207-4d46-a2e8-904dc5e74a30 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:34.423336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fa7793d-f207-4d46-a2e8-904dc5e74a30 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:34.423760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fa7793d-f207-4d46-a2e8-904dc5e74a30 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:34.424506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fa7793d-f207-4d46-a2e8-904dc5e74a30 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:34.424972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fa7793d-f207-4d46-a2e8-904dc5e74a30 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:34.425427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fa7793d-f207-4d46-a2e8-904dc5e74a30 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:34.461418 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-7fa7793d-f207-4d46-a2e8-904dc5e74a30 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] HTTP exception thrown: Instance b579635a-eb7c-4e99-8b52-faeba843197f could not be found. Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7fa7793d-f207-4d46-a2e8-904dc5e74a30 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Request method failure captured: Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f HTTP/1.1 Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKw8hCLXWIFTJ3HaJf5ifgl6Pm7vGD8ptwfQXuGQAkf1M-RWSvV8nlygpWidDM338TQR6cXdzFUy8zgn8XWf4EUtX06mIecSablgYBXm9sJQ78u324dyYAXvHBKQ5Ge8XY02Fdf2X0InpWnugNSR9M1ccFMQnfZYNbqSwCmT2w9EOBY Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d42cb00f2544abbde09cae76f3e3a1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 7cc066774b344a24a91fb41e990f5234 Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance b579635a-eb7c-4e99-8b52-faeba843197f could not be found. Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'b579635a-eb7c-4e99-8b52-faeba843197f'} Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b579635a-eb7c-4e99-8b52-faeba843197f could not be found. Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b579635a-eb7c-4e99-8b52-faeba843197f could not be found. Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:34.466520 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.473241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.473241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:34.473241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:34.473241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:34.473241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:34.473241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b579635a-eb7c-4e99-8b52-faeba843197f could not be found. Oct 10 23:40:34.473241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.473241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7fa7793d-f207-4d46-a2e8-904dc5e74a30 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Returning 404 to user: Instance b579635a-eb7c-4e99-8b52-faeba843197f could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:34.473241 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7fa7793d-f207-4d46-a2e8-904dc5e74a30 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f" status: 404 len: 111 microversion: 2.1 time: 0.065673 Oct 10 23:40:34.473241 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2432/4705] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:34 2022] GET /compute/v2.1/servers/b579635a-eb7c-4e99-8b52-faeba843197f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:40:34.481159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-735fd446-ab8f-44cd-8269-e7d59bcb3cfc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:34.481698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-735fd446-ab8f-44cd-8269-e7d59bcb3cfc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:34.503177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-735fd446-ab8f-44cd-8269-e7d59bcb3cfc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:34.503935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-735fd446-ab8f-44cd-8269-e7d59bcb3cfc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:34.504457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-735fd446-ab8f-44cd-8269-e7d59bcb3cfc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:34.505482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f6f9891e-0198-4be9-8b1b-3414b75d6990 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:34.505985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-735fd446-ab8f-44cd-8269-e7d59bcb3cfc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:34.506107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f6f9891e-0198-4be9-8b1b-3414b75d6990 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:34.507102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-735fd446-ab8f-44cd-8269-e7d59bcb3cfc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:34.507808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-735fd446-ab8f-44cd-8269-e7d59bcb3cfc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:34.516349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6f9891e-0198-4be9-8b1b-3414b75d6990 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:34.516858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6f9891e-0198-4be9-8b1b-3414b75d6990 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:34.517305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6f9891e-0198-4be9-8b1b-3414b75d6990 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:34.518067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6f9891e-0198-4be9-8b1b-3414b75d6990 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:34.518534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6f9891e-0198-4be9-8b1b-3414b75d6990 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:34.518969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6f9891e-0198-4be9-8b1b-3414b75d6990 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:34.544795 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-735fd446-ab8f-44cd-8269-e7d59bcb3cfc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] HTTP exception thrown: Instance 961f5a5b-1142-497e-8b88-b16f193e66e4 could not be found. Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-735fd446-ab8f-44cd-8269-e7d59bcb3cfc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Request method failure captured: Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 HTTP/1.1 Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKw8hCLXWIFTJ3HaJf5ifgl6Pm7vGD8ptwfQXuGQAkf1M-RWSvV8nlygpWidDM338TQR6cXdzFUy8zgn8XWf4EUtX06mIecSablgYBXm9sJQ78u324dyYAXvHBKQ5Ge8XY02Fdf2X0InpWnugNSR9M1ccFMQnfZYNbqSwCmT2w9EOBY Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d42cb00f2544abbde09cae76f3e3a1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 7cc066774b344a24a91fb41e990f5234 Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 961f5a5b-1142-497e-8b88-b16f193e66e4 could not be found. Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '961f5a5b-1142-497e-8b88-b16f193e66e4'} Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 961f5a5b-1142-497e-8b88-b16f193e66e4 could not be found. Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:40:34.571540 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:40:34.576195 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 961f5a5b-1142-497e-8b88-b16f193e66e4 could not be found. Oct 10 23:40:34.576195 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.576195 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:34.576195 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.576195 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.576195 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:34.576195 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:34.576195 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:34.576195 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:34.576195 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 961f5a5b-1142-497e-8b88-b16f193e66e4 could not be found. Oct 10 23:40:34.576195 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.582423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-735fd446-ab8f-44cd-8269-e7d59bcb3cfc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Returning 404 to user: Instance 961f5a5b-1142-497e-8b88-b16f193e66e4 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:34.583507 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-735fd446-ab8f-44cd-8269-e7d59bcb3cfc tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "DELETE /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 404 len: 111 microversion: 2.1 time: 0.108507 Oct 10 23:40:34.589697 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2274/4706] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:40:34 2022] DELETE /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:40:34.602547 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-44bfce19-9515-4d3e-946f-b8bc731d03d3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:34.605550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-44bfce19-9515-4d3e-946f-b8bc731d03d3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 961f5a5b-1142-497e-8b88-b16f193e66e4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:34.621001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44bfce19-9515-4d3e-946f-b8bc731d03d3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:34.623638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44bfce19-9515-4d3e-946f-b8bc731d03d3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:34.627543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44bfce19-9515-4d3e-946f-b8bc731d03d3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:34.628773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44bfce19-9515-4d3e-946f-b8bc731d03d3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:34.631448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44bfce19-9515-4d3e-946f-b8bc731d03d3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:34.633112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44bfce19-9515-4d3e-946f-b8bc731d03d3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:34.683065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f6f9891e-0198-4be9-8b1b-3414b75d6990 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:34.683414 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-44bfce19-9515-4d3e-946f-b8bc731d03d3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] HTTP exception thrown: Instance 961f5a5b-1142-497e-8b88-b16f193e66e4 could not be found. Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-44bfce19-9515-4d3e-946f-b8bc731d03d3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Request method failure captured: Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 HTTP/1.1 Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKw8hCLXWIFTJ3HaJf5ifgl6Pm7vGD8ptwfQXuGQAkf1M-RWSvV8nlygpWidDM338TQR6cXdzFUy8zgn8XWf4EUtX06mIecSablgYBXm9sJQ78u324dyYAXvHBKQ5Ge8XY02Fdf2X0InpWnugNSR9M1ccFMQnfZYNbqSwCmT2w9EOBY Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d42cb00f2544abbde09cae76f3e3a1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 7cc066774b344a24a91fb41e990f5234 Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 961f5a5b-1142-497e-8b88-b16f193e66e4 could not be found. Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '961f5a5b-1142-497e-8b88-b16f193e66e4'} Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 961f5a5b-1142-497e-8b88-b16f193e66e4 could not be found. Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 961f5a5b-1142-497e-8b88-b16f193e66e4 could not be found. Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:34.685746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.690738 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.690738 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:34.690738 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:34.690738 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:34.690738 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:34.690738 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 961f5a5b-1142-497e-8b88-b16f193e66e4 could not be found. Oct 10 23:40:34.690738 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.693494 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-44bfce19-9515-4d3e-946f-b8bc731d03d3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Returning 404 to user: Instance 961f5a5b-1142-497e-8b88-b16f193e66e4 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:34.694958 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-44bfce19-9515-4d3e-946f-b8bc731d03d3 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4" status: 404 len: 111 microversion: 2.1 time: 0.101781 Oct 10 23:40:34.696508 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2275/4707] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:34 2022] GET /compute/v2.1/servers/961f5a5b-1142-497e-8b88-b16f193e66e4 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:40:34.702937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f6f9891e-0198-4be9-8b1b-3414b75d6990 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:34.704524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f6f9891e-0198-4be9-8b1b-3414b75d6990 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:34.705819 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f6f9891e-0198-4be9-8b1b-3414b75d6990 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1604 microversion: 2.42 time: 0.204933 Oct 10 23:40:34.706393 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2433/4708] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:34 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1604 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:40:34.713250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a160d516-9c3f-4e31-939d-3e2ceb9711b8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:34.714173 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a160d516-9c3f-4e31-939d-3e2ceb9711b8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:34.750392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a160d516-9c3f-4e31-939d-3e2ceb9711b8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:34.750986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a160d516-9c3f-4e31-939d-3e2ceb9711b8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:34.751439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a160d516-9c3f-4e31-939d-3e2ceb9711b8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:34.752188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a160d516-9c3f-4e31-939d-3e2ceb9711b8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:34.752644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a160d516-9c3f-4e31-939d-3e2ceb9711b8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:34.753064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a160d516-9c3f-4e31-939d-3e2ceb9711b8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:34.824959 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-a160d516-9c3f-4e31-939d-3e2ceb9711b8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] HTTP exception thrown: Instance cef2e8cb-d283-45de-8e1d-d957f72ac8b7 could not be found. Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a160d516-9c3f-4e31-939d-3e2ceb9711b8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Request method failure captured: Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 HTTP/1.1 Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKw8hCLXWIFTJ3HaJf5ifgl6Pm7vGD8ptwfQXuGQAkf1M-RWSvV8nlygpWidDM338TQR6cXdzFUy8zgn8XWf4EUtX06mIecSablgYBXm9sJQ78u324dyYAXvHBKQ5Ge8XY02Fdf2X0InpWnugNSR9M1ccFMQnfZYNbqSwCmT2w9EOBY Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d42cb00f2544abbde09cae76f3e3a1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 7cc066774b344a24a91fb41e990f5234 Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance cef2e8cb-d283-45de-8e1d-d957f72ac8b7 could not be found. Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'cef2e8cb-d283-45de-8e1d-d957f72ac8b7'} Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cef2e8cb-d283-45de-8e1d-d957f72ac8b7 could not be found. Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:40:34.841333 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:40:34.846707 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cef2e8cb-d283-45de-8e1d-d957f72ac8b7 could not be found. Oct 10 23:40:34.846707 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.846707 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:34.846707 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.846707 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.846707 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:34.846707 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:34.846707 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:34.846707 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:34.846707 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cef2e8cb-d283-45de-8e1d-d957f72ac8b7 could not be found. Oct 10 23:40:34.846707 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.846707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a160d516-9c3f-4e31-939d-3e2ceb9711b8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Returning 404 to user: Instance cef2e8cb-d283-45de-8e1d-d957f72ac8b7 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:34.846707 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a160d516-9c3f-4e31-939d-3e2ceb9711b8 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7" status: 404 len: 111 microversion: 2.1 time: 0.146085 Oct 10 23:40:34.849152 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2276/4709] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:40:34 2022] DELETE /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:40:34.858020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-62d75da5-e834-4b78-8da4-61317bf88b0d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:34.859697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-62d75da5-e834-4b78-8da4-61317bf88b0d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: cef2e8cb-d283-45de-8e1d-d957f72ac8b7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:34.874846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62d75da5-e834-4b78-8da4-61317bf88b0d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:34.875358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62d75da5-e834-4b78-8da4-61317bf88b0d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:34.880557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62d75da5-e834-4b78-8da4-61317bf88b0d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:34.883148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62d75da5-e834-4b78-8da4-61317bf88b0d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:34.886271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62d75da5-e834-4b78-8da4-61317bf88b0d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:34.887323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62d75da5-e834-4b78-8da4-61317bf88b0d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:34.922984 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-62d75da5-e834-4b78-8da4-61317bf88b0d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] HTTP exception thrown: Instance cef2e8cb-d283-45de-8e1d-d957f72ac8b7 could not be found. Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-62d75da5-e834-4b78-8da4-61317bf88b0d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Request method failure captured: Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 HTTP/1.1 Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKw8hCLXWIFTJ3HaJf5ifgl6Pm7vGD8ptwfQXuGQAkf1M-RWSvV8nlygpWidDM338TQR6cXdzFUy8zgn8XWf4EUtX06mIecSablgYBXm9sJQ78u324dyYAXvHBKQ5Ge8XY02Fdf2X0InpWnugNSR9M1ccFMQnfZYNbqSwCmT2w9EOBY Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d42cb00f2544abbde09cae76f3e3a1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 7cc066774b344a24a91fb41e990f5234 Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance cef2e8cb-d283-45de-8e1d-d957f72ac8b7 could not be found. Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'cef2e8cb-d283-45de-8e1d-d957f72ac8b7'} Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cef2e8cb-d283-45de-8e1d-d957f72ac8b7 could not be found. Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cef2e8cb-d283-45de-8e1d-d957f72ac8b7 could not be found. Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:34.929162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.938018 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.938018 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:34.938018 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:34.938018 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:34.938018 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:34.938018 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cef2e8cb-d283-45de-8e1d-d957f72ac8b7 could not be found. Oct 10 23:40:34.938018 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.939908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-62d75da5-e834-4b78-8da4-61317bf88b0d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Returning 404 to user: Instance cef2e8cb-d283-45de-8e1d-d957f72ac8b7 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:34.940977 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-62d75da5-e834-4b78-8da4-61317bf88b0d tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7" status: 404 len: 111 microversion: 2.1 time: 0.087277 Oct 10 23:40:34.942080 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2434/4710] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:34 2022] GET /compute/v2.1/servers/cef2e8cb-d283-45de-8e1d-d957f72ac8b7 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:40:34.950392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8a342012-4b95-4e4f-a00e-50e6a23a1d96 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:34.951037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8a342012-4b95-4e4f-a00e-50e6a23a1d96 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: c5541b0c-6e19-40ee-bad8-7b491c397a34] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:34.961672 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-8a342012-4b95-4e4f-a00e-50e6a23a1d96 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] HTTP exception thrown: Instance c5541b0c-6e19-40ee-bad8-7b491c397a34 could not be found. Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8a342012-4b95-4e4f-a00e-50e6a23a1d96 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Request method failure captured: Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/c5541b0c-6e19-40ee-bad8-7b491c397a34 HTTP/1.1 Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKw8hCLXWIFTJ3HaJf5ifgl6Pm7vGD8ptwfQXuGQAkf1M-RWSvV8nlygpWidDM338TQR6cXdzFUy8zgn8XWf4EUtX06mIecSablgYBXm9sJQ78u324dyYAXvHBKQ5Ge8XY02Fdf2X0InpWnugNSR9M1ccFMQnfZYNbqSwCmT2w9EOBY Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d42cb00f2544abbde09cae76f3e3a1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 7cc066774b344a24a91fb41e990f5234 Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance c5541b0c-6e19-40ee-bad8-7b491c397a34 could not be found. Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'c5541b0c-6e19-40ee-bad8-7b491c397a34'} Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5541b0c-6e19-40ee-bad8-7b491c397a34 could not be found. Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5541b0c-6e19-40ee-bad8-7b491c397a34 could not be found. Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:34.967060 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.973835 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:34.973835 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:34.973835 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:34.973835 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:34.973835 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:34.973835 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5541b0c-6e19-40ee-bad8-7b491c397a34 could not be found. Oct 10 23:40:34.973835 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:34.993072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8a342012-4b95-4e4f-a00e-50e6a23a1d96 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Returning 404 to user: Instance c5541b0c-6e19-40ee-bad8-7b491c397a34 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:34.994149 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8a342012-4b95-4e4f-a00e-50e6a23a1d96 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c5541b0c-6e19-40ee-bad8-7b491c397a34" status: 404 len: 111 microversion: 2.1 time: 0.047789 Oct 10 23:40:34.995330 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2277/4711] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:40:34 2022] DELETE /compute/v2.1/servers/c5541b0c-6e19-40ee-bad8-7b491c397a34 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:40:35.003787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-426f135f-89ca-4a33-b0b0-2dba98140342 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:35.004416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-426f135f-89ca-4a33-b0b0-2dba98140342 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: c5541b0c-6e19-40ee-bad8-7b491c397a34] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:35.010464 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-426f135f-89ca-4a33-b0b0-2dba98140342 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] HTTP exception thrown: Instance c5541b0c-6e19-40ee-bad8-7b491c397a34 could not be found. Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-426f135f-89ca-4a33-b0b0-2dba98140342 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Request method failure captured: Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/c5541b0c-6e19-40ee-bad8-7b491c397a34 HTTP/1.1 Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKw8hCLXWIFTJ3HaJf5ifgl6Pm7vGD8ptwfQXuGQAkf1M-RWSvV8nlygpWidDM338TQR6cXdzFUy8zgn8XWf4EUtX06mIecSablgYBXm9sJQ78u324dyYAXvHBKQ5Ge8XY02Fdf2X0InpWnugNSR9M1ccFMQnfZYNbqSwCmT2w9EOBY Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d42cb00f2544abbde09cae76f3e3a1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 7cc066774b344a24a91fb41e990f5234 Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance c5541b0c-6e19-40ee-bad8-7b491c397a34 could not be found. Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'c5541b0c-6e19-40ee-bad8-7b491c397a34'} Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5541b0c-6e19-40ee-bad8-7b491c397a34 could not be found. Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5541b0c-6e19-40ee-bad8-7b491c397a34 could not be found. Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:35.012466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:35.018089 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:35.018089 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:35.018089 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:35.018089 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5541b0c-6e19-40ee-bad8-7b491c397a34 could not be found. Oct 10 23:40:35.018089 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:35.019279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-426f135f-89ca-4a33-b0b0-2dba98140342 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Returning 404 to user: Instance c5541b0c-6e19-40ee-bad8-7b491c397a34 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:35.020319 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-426f135f-89ca-4a33-b0b0-2dba98140342 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/c5541b0c-6e19-40ee-bad8-7b491c397a34" status: 404 len: 111 microversion: 2.1 time: 0.020864 Oct 10 23:40:35.021404 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2435/4712] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:34 2022] GET /compute/v2.1/servers/c5541b0c-6e19-40ee-bad8-7b491c397a34 => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:40:35.740516 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bfad0a47-dae4-442e-b7bf-7055dd08fd0d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:35.741231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bfad0a47-dae4-442e-b7bf-7055dd08fd0d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:35.770268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bfad0a47-dae4-442e-b7bf-7055dd08fd0d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:35.776853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bfad0a47-dae4-442e-b7bf-7055dd08fd0d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:35.777670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bfad0a47-dae4-442e-b7bf-7055dd08fd0d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:35.780045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bfad0a47-dae4-442e-b7bf-7055dd08fd0d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:35.783163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bfad0a47-dae4-442e-b7bf-7055dd08fd0d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:35.787310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bfad0a47-dae4-442e-b7bf-7055dd08fd0d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:35.978150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bfad0a47-dae4-442e-b7bf-7055dd08fd0d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:36.011845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bfad0a47-dae4-442e-b7bf-7055dd08fd0d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:36.016949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bfad0a47-dae4-442e-b7bf-7055dd08fd0d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:36.020906 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bfad0a47-dae4-442e-b7bf-7055dd08fd0d tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1604 microversion: 2.42 time: 0.285175 Oct 10 23:40:36.028488 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2278/4713] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:35 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1604 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:40:37.067136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-15328f34-3302-4f65-9850-35dde4545df5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:37.068371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-15328f34-3302-4f65-9850-35dde4545df5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:37.081929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15328f34-3302-4f65-9850-35dde4545df5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:37.083025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15328f34-3302-4f65-9850-35dde4545df5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:37.089336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15328f34-3302-4f65-9850-35dde4545df5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:37.090420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15328f34-3302-4f65-9850-35dde4545df5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:37.091076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15328f34-3302-4f65-9850-35dde4545df5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:37.091739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15328f34-3302-4f65-9850-35dde4545df5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:37.305257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-15328f34-3302-4f65-9850-35dde4545df5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:37.350571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-15328f34-3302-4f65-9850-35dde4545df5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:37.353682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-15328f34-3302-4f65-9850-35dde4545df5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:37.355849 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-15328f34-3302-4f65-9850-35dde4545df5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1604 microversion: 2.42 time: 0.293448 Oct 10 23:40:37.356435 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2436/4714] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:37 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1604 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:38.388493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f48b43fa-4615-411c-a0aa-b8c2aead32c9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:38.389687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f48b43fa-4615-411c-a0aa-b8c2aead32c9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:38.406121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f48b43fa-4615-411c-a0aa-b8c2aead32c9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:38.406711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f48b43fa-4615-411c-a0aa-b8c2aead32c9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:38.407212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f48b43fa-4615-411c-a0aa-b8c2aead32c9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:38.408138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f48b43fa-4615-411c-a0aa-b8c2aead32c9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:38.411994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f48b43fa-4615-411c-a0aa-b8c2aead32c9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:38.418028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f48b43fa-4615-411c-a0aa-b8c2aead32c9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:38.720419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f48b43fa-4615-411c-a0aa-b8c2aead32c9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:38.740572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f48b43fa-4615-411c-a0aa-b8c2aead32c9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:38.742178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f48b43fa-4615-411c-a0aa-b8c2aead32c9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:38.743412 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f48b43fa-4615-411c-a0aa-b8c2aead32c9 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1604 microversion: 2.42 time: 0.359594 Oct 10 23:40:38.749930 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2279/4715] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:38 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1604 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:40:39.779804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d946f738-9363-4049-833e-5dd0b70de0e4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:39.781057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d946f738-9363-4049-833e-5dd0b70de0e4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:39.800825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d946f738-9363-4049-833e-5dd0b70de0e4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:39.801344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d946f738-9363-4049-833e-5dd0b70de0e4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:39.802080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d946f738-9363-4049-833e-5dd0b70de0e4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:39.802905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d946f738-9363-4049-833e-5dd0b70de0e4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:39.803408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d946f738-9363-4049-833e-5dd0b70de0e4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:39.803875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d946f738-9363-4049-833e-5dd0b70de0e4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:40.143617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d946f738-9363-4049-833e-5dd0b70de0e4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:40.181288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d946f738-9363-4049-833e-5dd0b70de0e4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:40.194330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d946f738-9363-4049-833e-5dd0b70de0e4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:40.197588 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d946f738-9363-4049-833e-5dd0b70de0e4 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1604 microversion: 2.42 time: 0.423395 Oct 10 23:40:40.229779 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2437/4716] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:39 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1604 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:41.248818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c2338a4f-215d-4555-92ca-df7791372963 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:41.250225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c2338a4f-215d-4555-92ca-df7791372963 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:41.265853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2338a4f-215d-4555-92ca-df7791372963 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:41.266345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2338a4f-215d-4555-92ca-df7791372963 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:41.266784 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2338a4f-215d-4555-92ca-df7791372963 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:41.267495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2338a4f-215d-4555-92ca-df7791372963 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:41.276553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2338a4f-215d-4555-92ca-df7791372963 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:41.277306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2338a4f-215d-4555-92ca-df7791372963 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:41.487999 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c2338a4f-215d-4555-92ca-df7791372963 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:41.514933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c2338a4f-215d-4555-92ca-df7791372963 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:41.522325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c2338a4f-215d-4555-92ca-df7791372963 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c18b5a7071d34eca9bd7915250027f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304771fabdc4108aef00b2e4c4b7c70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:41.526505 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c2338a4f-215d-4555-92ca-df7791372963 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 200 len: 1604 microversion: 2.42 time: 0.281948 Oct 10 23:40:41.540436 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2280/4717] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:41 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 1604 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:42.568125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-baed16f3-dab0-4fe4-aefe-5800c530eb98 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:42.569448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-baed16f3-dab0-4fe4-aefe-5800c530eb98 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:42.600446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-baed16f3-dab0-4fe4-aefe-5800c530eb98 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:42.603923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-baed16f3-dab0-4fe4-aefe-5800c530eb98 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:42.608553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-baed16f3-dab0-4fe4-aefe-5800c530eb98 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:42.610344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-baed16f3-dab0-4fe4-aefe-5800c530eb98 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:42.615900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-baed16f3-dab0-4fe4-aefe-5800c530eb98 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:42.618531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-baed16f3-dab0-4fe4-aefe-5800c530eb98 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:42.679416 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-baed16f3-dab0-4fe4-aefe-5800c530eb98 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] HTTP exception thrown: Instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 could not be found. Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-baed16f3-dab0-4fe4-aefe-5800c530eb98 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Request method failure captured: Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 HTTP/1.1 Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKu7WNi2uvQW3PKHriU8-GUnRKyKdErbRdfktcffbnHQrrmgmvYdaB02vm9BuOSDHBhYLJ8tmadux4PW1d6f_zk0DOej-Ct1gFl1XxsNuyINWvLzuUXg-VBmZXuVx7H-KeHRMPOIhXjG-BRD8PLzs6Nx35bpJkr_iEqlgSDLouOsukc Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: X-Openstack-Nova-Api-Version: 2.42 Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e304771fabdc4108aef00b2e4c4b7c70 Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1748411738 Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e304771fabdc4108aef00b2e4c4b7c70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e304771fabdc4108aef00b2e4c4b7c70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e304771fabdc4108aef00b2e4c4b7c70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e304771fabdc4108aef00b2e4c4b7c70", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1748411738 Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e304771fabdc4108aef00b2e4c4b7c70 Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1748411738 Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TaggedBootDevicesTest_v242-1748411738-project Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: c18b5a7071d34eca9bd7915250027f99 Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1748411738-project Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 could not be found. Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'e57d5936-a36d-4048-902a-6bf9e7ad7b39'} Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 could not be found. Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 could not be found. Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:42.685782 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:42.692194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:42.692194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:42.692194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:42.692194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:42.692194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:42.692194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:42.692194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 could not be found. Oct 10 23:40:42.692194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:42.703356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-baed16f3-dab0-4fe4-aefe-5800c530eb98 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Returning 404 to user: Instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:42.704514 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-baed16f3-dab0-4fe4-aefe-5800c530eb98 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 404 len: 111 microversion: 2.42 time: 0.142928 Oct 10 23:40:42.707098 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2438/4718] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:42 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:40:42.716439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c97a5f64-31c0-4717-9432-fa75bd9cba91 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '.version_select at 0x7f662a3ae4c0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:42.757557 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c97a5f64-31c0-4717-9432-fa75bd9cba91 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-849918376" status: 204 len: 0 microversion: 2.42 time: 0.043981 Oct 10 23:40:42.767933 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2281/4719] 10.222.0.23 () {60 vars in 1259 bytes} [Mon Oct 10 23:40:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-849918376 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:40:45.177501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c10fe5e8-958a-48b5-af6b-6707d7bc47cd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1452740210", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "8bded6b0-4fc6-4ea4-b629-f36233583a9e"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:45.299782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-c10fe5e8-958a-48b5-af6b-6707d7bc47cd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] validate_networks() for [('8bded6b0-4fc6-4ea4-b629-f36233583a9e', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:40:47.960320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c10fe5e8-958a-48b5-af6b-6707d7bc47cd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:40:47.960981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c10fe5e8-958a-48b5-af6b-6707d7bc47cd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:40:47.961194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c10fe5e8-958a-48b5-af6b-6707d7bc47cd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:40:47.962061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c10fe5e8-958a-48b5-af6b-6707d7bc47cd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:40:47.962761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c10fe5e8-958a-48b5-af6b-6707d7bc47cd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:40:48.020817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c10fe5e8-958a-48b5-af6b-6707d7bc47cd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:48.028902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c10fe5e8-958a-48b5-af6b-6707d7bc47cd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:48.048221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c10fe5e8-958a-48b5-af6b-6707d7bc47cd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:48.066607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c10fe5e8-958a-48b5-af6b-6707d7bc47cd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:48.067856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c10fe5e8-958a-48b5-af6b-6707d7bc47cd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:48.070296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c10fe5e8-958a-48b5-af6b-6707d7bc47cd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:48.315843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-c10fe5e8-958a-48b5-af6b-6707d7bc47cd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Getting quotas for project 18ae02c15157453b9782d9db5f48888a. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:40:48.433844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-c10fe5e8-958a-48b5-af6b-6707d7bc47cd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Getting quotas for user 52158c9d014c45439fedef97ac84b693 and project 18ae02c15157453b9782d9db5f48888a. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:40:48.491329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c10fe5e8-958a-48b5-af6b-6707d7bc47cd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:40:48.506765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c10fe5e8-958a-48b5-af6b-6707d7bc47cd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] [instance: ab793909-b8f7-47cb-bab7-de87cefe7783] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:40:48.770956 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c10fe5e8-958a-48b5-af6b-6707d7bc47cd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.097515 Oct 10 23:40:48.779509 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2439/4720] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:40:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 4107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:40:48.795980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-32a0c4e3-1b0d-4bb3-8140-26e62e0a6c7d tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:48.797511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-32a0c4e3-1b0d-4bb3-8140-26e62e0a6c7d tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] [instance: ab793909-b8f7-47cb-bab7-de87cefe7783] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:48.860444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:40:49.346924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-32a0c4e3-1b0d-4bb3-8140-26e62e0a6c7d tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52158c9d014c45439fedef97ac84b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae02c15157453b9782d9db5f48888a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:49.379371 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-32a0c4e3-1b0d-4bb3-8140-26e62e0a6c7d tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] 10.222.0.23 "GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783" status: 200 len: 1216 microversion: 2.1 time: 0.591414 Oct 10 23:40:49.381874 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2282/4721] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:48 2022] GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783 => generated 1216 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:50.457276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bf4daccb-ec01-4b30-9883-fb3bbeb929a1 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:50.462311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bf4daccb-ec01-4b30-9883-fb3bbeb929a1 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] [instance: ab793909-b8f7-47cb-bab7-de87cefe7783] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:50.724203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bf4daccb-ec01-4b30-9883-fb3bbeb929a1 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52158c9d014c45439fedef97ac84b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae02c15157453b9782d9db5f48888a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:50.758084 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bf4daccb-ec01-4b30-9883-fb3bbeb929a1 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] 10.222.0.23 "GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783" status: 200 len: 1216 microversion: 2.1 time: 0.325122 Oct 10 23:40:50.762261 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2440/4722] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:50 2022] GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783 => generated 1216 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:51.009127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cbf1601a-76c6-4938-9c3e-b581d9c7a73e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:51.016463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cbf1601a-76c6-4938-9c3e-b581d9c7a73e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:51.050828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbf1601a-76c6-4938-9c3e-b581d9c7a73e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:51.051657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbf1601a-76c6-4938-9c3e-b581d9c7a73e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:51.056763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbf1601a-76c6-4938-9c3e-b581d9c7a73e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:51.057947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbf1601a-76c6-4938-9c3e-b581d9c7a73e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:51.061443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbf1601a-76c6-4938-9c3e-b581d9c7a73e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:51.066044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbf1601a-76c6-4938-9c3e-b581d9c7a73e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:51.133246 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-cbf1601a-76c6-4938-9c3e-b581d9c7a73e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] HTTP exception thrown: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cbf1601a-76c6-4938-9c3e-b581d9c7a73e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Request method failure captured: Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 HTTP/1.1 Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKw8hCLXWIFTJ3HaJf5ifgl6Pm7vGD8ptwfQXuGQAkf1M-RWSvV8nlygpWidDM338TQR6cXdzFUy8zgn8XWf4EUtX06mIecSablgYBXm9sJQ78u324dyYAXvHBKQ5Ge8XY02Fdf2X0InpWnugNSR9M1ccFMQnfZYNbqSwCmT2w9EOBY Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d42cb00f2544abbde09cae76f3e3a1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 7cc066774b344a24a91fb41e990f5234 Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '0299384f-1c8e-41ee-9d98-9823342a6a72'} Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:40:51.144853 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:40:51.152031 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. Oct 10 23:40:51.152031 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:51.152031 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:51.152031 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:51.152031 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:51.152031 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:51.152031 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:51.152031 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:51.152031 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:51.152031 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. Oct 10 23:40:51.152031 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:51.159206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cbf1601a-76c6-4938-9c3e-b581d9c7a73e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Returning 404 to user: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:51.164714 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cbf1601a-76c6-4938-9c3e-b581d9c7a73e tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 404 len: 111 microversion: 2.1 time: 0.163414 Oct 10 23:40:51.168777 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2441/4723] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:40:50 2022] DELETE /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:40:51.201506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a208bce7-3bb9-45aa-86e8-ea2368d18b9f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:51.204289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a208bce7-3bb9-45aa-86e8-ea2368d18b9f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0299384f-1c8e-41ee-9d98-9823342a6a72] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:51.236066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a208bce7-3bb9-45aa-86e8-ea2368d18b9f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:51.237655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a208bce7-3bb9-45aa-86e8-ea2368d18b9f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:51.240340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a208bce7-3bb9-45aa-86e8-ea2368d18b9f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:51.244761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a208bce7-3bb9-45aa-86e8-ea2368d18b9f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:51.246036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a208bce7-3bb9-45aa-86e8-ea2368d18b9f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:51.247727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a208bce7-3bb9-45aa-86e8-ea2368d18b9f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:51.306094 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-a208bce7-3bb9-45aa-86e8-ea2368d18b9f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] HTTP exception thrown: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a208bce7-3bb9-45aa-86e8-ea2368d18b9f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Request method failure captured: Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 HTTP/1.1 Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKw8hCLXWIFTJ3HaJf5ifgl6Pm7vGD8ptwfQXuGQAkf1M-RWSvV8nlygpWidDM338TQR6cXdzFUy8zgn8XWf4EUtX06mIecSablgYBXm9sJQ78u324dyYAXvHBKQ5Ge8XY02Fdf2X0InpWnugNSR9M1ccFMQnfZYNbqSwCmT2w9EOBY Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d42cb00f2544abbde09cae76f3e3a1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 7cc066774b344a24a91fb41e990f5234 Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '0299384f-1c8e-41ee-9d98-9823342a6a72'} Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:51.323788 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:51.328947 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:51.328947 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:51.328947 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:51.328947 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:51.328947 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:51.328947 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. Oct 10 23:40:51.328947 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:51.333471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a208bce7-3bb9-45aa-86e8-ea2368d18b9f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Returning 404 to user: Instance 0299384f-1c8e-41ee-9d98-9823342a6a72 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:51.341309 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a208bce7-3bb9-45aa-86e8-ea2368d18b9f tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72" status: 404 len: 111 microversion: 2.1 time: 0.169323 Oct 10 23:40:51.349817 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2442/4724] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:51 2022] GET /compute/v2.1/servers/0299384f-1c8e-41ee-9d98-9823342a6a72 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:40:51.357144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1708618c-ff4a-4976-badd-68587ec2d671 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:51.357986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1708618c-ff4a-4976-badd-68587ec2d671 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:51.366827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1708618c-ff4a-4976-badd-68587ec2d671 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:51.367712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1708618c-ff4a-4976-badd-68587ec2d671 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:51.368383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1708618c-ff4a-4976-badd-68587ec2d671 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:51.369330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1708618c-ff4a-4976-badd-68587ec2d671 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:51.370138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1708618c-ff4a-4976-badd-68587ec2d671 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:51.370798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1708618c-ff4a-4976-badd-68587ec2d671 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:51.396076 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-1708618c-ff4a-4976-badd-68587ec2d671 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] HTTP exception thrown: Instance 0fa1908d-4b1e-4814-96c3-c30d60d579e5 could not be found. Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1708618c-ff4a-4976-badd-68587ec2d671 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Request method failure captured: Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 HTTP/1.1 Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKw8hCLXWIFTJ3HaJf5ifgl6Pm7vGD8ptwfQXuGQAkf1M-RWSvV8nlygpWidDM338TQR6cXdzFUy8zgn8XWf4EUtX06mIecSablgYBXm9sJQ78u324dyYAXvHBKQ5Ge8XY02Fdf2X0InpWnugNSR9M1ccFMQnfZYNbqSwCmT2w9EOBY Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d42cb00f2544abbde09cae76f3e3a1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 7cc066774b344a24a91fb41e990f5234 Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 0fa1908d-4b1e-4814-96c3-c30d60d579e5 could not be found. Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '0fa1908d-4b1e-4814-96c3-c30d60d579e5'} Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa1908d-4b1e-4814-96c3-c30d60d579e5 could not be found. Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:40:51.398647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:40:51.404489 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa1908d-4b1e-4814-96c3-c30d60d579e5 could not be found. Oct 10 23:40:51.404489 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:51.404489 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:51.404489 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:51.404489 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:51.404489 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:51.404489 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:51.404489 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:51.404489 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:51.404489 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa1908d-4b1e-4814-96c3-c30d60d579e5 could not be found. Oct 10 23:40:51.404489 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:51.408416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1708618c-ff4a-4976-badd-68587ec2d671 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Returning 404 to user: Instance 0fa1908d-4b1e-4814-96c3-c30d60d579e5 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:51.410204 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1708618c-ff4a-4976-badd-68587ec2d671 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5" status: 404 len: 111 microversion: 2.1 time: 0.058812 Oct 10 23:40:51.411031 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2443/4725] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:40:51 2022] DELETE /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:40:51.429603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5a559904-e01a-451c-b151-80da13893800 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:51.430416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5a559904-e01a-451c-b151-80da13893800 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] [instance: 0fa1908d-4b1e-4814-96c3-c30d60d579e5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:51.446627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a559904-e01a-451c-b151-80da13893800 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:51.447271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a559904-e01a-451c-b151-80da13893800 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:51.447581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a559904-e01a-451c-b151-80da13893800 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:51.448503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a559904-e01a-451c-b151-80da13893800 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:51.450715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a559904-e01a-451c-b151-80da13893800 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:51.451346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a559904-e01a-451c-b151-80da13893800 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:51.497532 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-5a559904-e01a-451c-b151-80da13893800 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] HTTP exception thrown: Instance 0fa1908d-4b1e-4814-96c3-c30d60d579e5 could not be found. Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5a559904-e01a-451c-b151-80da13893800 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Request method failure captured: Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 HTTP/1.1 Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKw8hCLXWIFTJ3HaJf5ifgl6Pm7vGD8ptwfQXuGQAkf1M-RWSvV8nlygpWidDM338TQR6cXdzFUy8zgn8XWf4EUtX06mIecSablgYBXm9sJQ78u324dyYAXvHBKQ5Ge8XY02Fdf2X0InpWnugNSR9M1ccFMQnfZYNbqSwCmT2w9EOBY Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e7d42cb00f2544abbde09cae76f3e3a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e7d42cb00f2544abbde09cae76f3e3a1", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e7d42cb00f2544abbde09cae76f3e3a1 Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-DeleteServersTestJSON-837712631 Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 7cc066774b344a24a91fb41e990f5234 Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-DeleteServersTestJSON-837712631-project Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 0fa1908d-4b1e-4814-96c3-c30d60d579e5 could not be found. Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '0fa1908d-4b1e-4814-96c3-c30d60d579e5'} Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa1908d-4b1e-4814-96c3-c30d60d579e5 could not be found. Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa1908d-4b1e-4814-96c3-c30d60d579e5 could not be found. Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:51.502910 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:51.508083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:51.508083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:51.508083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:51.508083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:51.508083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:51.508083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa1908d-4b1e-4814-96c3-c30d60d579e5 could not be found. Oct 10 23:40:51.508083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:51.508730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=64 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:40:51.510542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5a559904-e01a-451c-b151-80da13893800 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] Returning 404 to user: Instance 0fa1908d-4b1e-4814-96c3-c30d60d579e5 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:51.517513 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5a559904-e01a-451c-b151-80da13893800 tempest-DeleteServersTestJSON-837712631 tempest-DeleteServersTestJSON-837712631-project] 10.222.0.23 "GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5" status: 404 len: 111 microversion: 2.1 time: 0.095502 Oct 10 23:40:51.518691 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2444/4726] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:51 2022] GET /compute/v2.1/servers/0fa1908d-4b1e-4814-96c3-c30d60d579e5 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:40:51.685192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2e1a4abf-c368-4aa4-bd87-417d34818559 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1290945401", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "b1f55d9d-e262-4b2f-9b4b-8e8f2297011e"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:51.789540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7feafc37-0ea7-4e30-b312-47762eabfed1 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:51.790521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7feafc37-0ea7-4e30-b312-47762eabfed1 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] [instance: ab793909-b8f7-47cb-bab7-de87cefe7783] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:51.791916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-2e1a4abf-c368-4aa4-bd87-417d34818559 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] validate_networks() for [('b1f55d9d-e262-4b2f-9b4b-8e8f2297011e', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:40:51.818022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7feafc37-0ea7-4e30-b312-47762eabfed1 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:51.822402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7feafc37-0ea7-4e30-b312-47762eabfed1 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:51.827375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7feafc37-0ea7-4e30-b312-47762eabfed1 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:51.831947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7feafc37-0ea7-4e30-b312-47762eabfed1 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:51.833276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7feafc37-0ea7-4e30-b312-47762eabfed1 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:51.834002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7feafc37-0ea7-4e30-b312-47762eabfed1 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:52.148316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7feafc37-0ea7-4e30-b312-47762eabfed1 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52158c9d014c45439fedef97ac84b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae02c15157453b9782d9db5f48888a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:52.177454 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7feafc37-0ea7-4e30-b312-47762eabfed1 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] 10.222.0.23 "GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783" status: 200 len: 1268 microversion: 2.1 time: 0.392690 Oct 10 23:40:52.181907 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2445/4727] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:51 2022] GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783 => generated 1268 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:53.210218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-96004b76-6edc-4812-ae52-089e09fd8d51 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:53.210880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-96004b76-6edc-4812-ae52-089e09fd8d51 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] [instance: ab793909-b8f7-47cb-bab7-de87cefe7783] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:53.240777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96004b76-6edc-4812-ae52-089e09fd8d51 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:53.241297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96004b76-6edc-4812-ae52-089e09fd8d51 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:53.241770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96004b76-6edc-4812-ae52-089e09fd8d51 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:53.246097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96004b76-6edc-4812-ae52-089e09fd8d51 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:53.246572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96004b76-6edc-4812-ae52-089e09fd8d51 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:53.252833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96004b76-6edc-4812-ae52-089e09fd8d51 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:53.268780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:40:53.500949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-96004b76-6edc-4812-ae52-089e09fd8d51 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52158c9d014c45439fedef97ac84b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae02c15157453b9782d9db5f48888a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:53.531892 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-96004b76-6edc-4812-ae52-089e09fd8d51 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] 10.222.0.23 "GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783" status: 200 len: 1274 microversion: 2.1 time: 0.334014 Oct 10 23:40:53.533222 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2446/4728] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:53 2022] GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783 => generated 1274 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:54.558841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fe40d024-695f-4a1f-b520-f289078f5408 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:54.559490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fe40d024-695f-4a1f-b520-f289078f5408 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] [instance: ab793909-b8f7-47cb-bab7-de87cefe7783] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:54.586026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe40d024-695f-4a1f-b520-f289078f5408 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:54.586803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe40d024-695f-4a1f-b520-f289078f5408 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:54.587465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe40d024-695f-4a1f-b520-f289078f5408 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:54.589313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe40d024-695f-4a1f-b520-f289078f5408 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:54.590173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe40d024-695f-4a1f-b520-f289078f5408 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:54.590841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe40d024-695f-4a1f-b520-f289078f5408 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:54.749978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fe40d024-695f-4a1f-b520-f289078f5408 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52158c9d014c45439fedef97ac84b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae02c15157453b9782d9db5f48888a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:54.769985 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fe40d024-695f-4a1f-b520-f289078f5408 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] 10.222.0.23 "GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783" status: 200 len: 1274 microversion: 2.1 time: 0.214864 Oct 10 23:40:54.778536 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2447/4729] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:54 2022] GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783 => generated 1274 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:40:54.993635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-2e1a4abf-c368-4aa4-bd87-417d34818559 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:40:54.994139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-2e1a4abf-c368-4aa4-bd87-417d34818559 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:40:54.994509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-2e1a4abf-c368-4aa4-bd87-417d34818559 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:40:54.994920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-2e1a4abf-c368-4aa4-bd87-417d34818559 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:40:54.995337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-2e1a4abf-c368-4aa4-bd87-417d34818559 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:40:55.023932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e1a4abf-c368-4aa4-bd87-417d34818559 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:55.024506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e1a4abf-c368-4aa4-bd87-417d34818559 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:55.025152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e1a4abf-c368-4aa4-bd87-417d34818559 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:55.027403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e1a4abf-c368-4aa4-bd87-417d34818559 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:55.027933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e1a4abf-c368-4aa4-bd87-417d34818559 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:55.029846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e1a4abf-c368-4aa4-bd87-417d34818559 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:55.050372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-2e1a4abf-c368-4aa4-bd87-417d34818559 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Getting quotas for project c7184ac4c159435a8588308d72195f94. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:40:55.056557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-2e1a4abf-c368-4aa4-bd87-417d34818559 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Getting quotas for user f85593306d444a17aab3416165b72bf9 and project c7184ac4c159435a8588308d72195f94. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:40:55.069944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2e1a4abf-c368-4aa4-bd87-417d34818559 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:40:55.072503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2e1a4abf-c368-4aa4-bd87-417d34818559 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:40:55.129302 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2e1a4abf-c368-4aa4-bd87-417d34818559 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 4.533402 Oct 10 23:40:55.130640 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2283/4730] 10.222.0.23 () {62 vars in 1188 bytes} [Mon Oct 10 23:40:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 4536 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 23:40:55.142595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3c8e18ff-1a2a-4120-95c7-db1f7a48e434 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:55.143480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3c8e18ff-1a2a-4120-95c7-db1f7a48e434 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:55.401880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3c8e18ff-1a2a-4120-95c7-db1f7a48e434 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:55.424832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3c8e18ff-1a2a-4120-95c7-db1f7a48e434 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:55.441785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3c8e18ff-1a2a-4120-95c7-db1f7a48e434 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:55.446439 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3c8e18ff-1a2a-4120-95c7-db1f7a48e434 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92" status: 200 len: 1262 microversion: 2.26 time: 0.308744 Oct 10 23:40:55.447558 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2448/4731] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:55 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 => generated 1262 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:55.804328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-248423a6-97cd-4040-8467-78f754cee065 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:55.805148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-248423a6-97cd-4040-8467-78f754cee065 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] [instance: ab793909-b8f7-47cb-bab7-de87cefe7783] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:55.822160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-248423a6-97cd-4040-8467-78f754cee065 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:55.822655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-248423a6-97cd-4040-8467-78f754cee065 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:55.823092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-248423a6-97cd-4040-8467-78f754cee065 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:55.823801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-248423a6-97cd-4040-8467-78f754cee065 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:55.824250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-248423a6-97cd-4040-8467-78f754cee065 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:55.839014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-248423a6-97cd-4040-8467-78f754cee065 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:56.478232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1654037d-51b4-4aa7-9b4b-c2c67999bac8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:56.479471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1654037d-51b4-4aa7-9b4b-c2c67999bac8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:56.496242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1654037d-51b4-4aa7-9b4b-c2c67999bac8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:56.496773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1654037d-51b4-4aa7-9b4b-c2c67999bac8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:56.497225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1654037d-51b4-4aa7-9b4b-c2c67999bac8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:56.498021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1654037d-51b4-4aa7-9b4b-c2c67999bac8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:56.498486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1654037d-51b4-4aa7-9b4b-c2c67999bac8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:56.498950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1654037d-51b4-4aa7-9b4b-c2c67999bac8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:56.505051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-248423a6-97cd-4040-8467-78f754cee065 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52158c9d014c45439fedef97ac84b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae02c15157453b9782d9db5f48888a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:56.517530 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-248423a6-97cd-4040-8467-78f754cee065 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] 10.222.0.23 "GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783" status: 200 len: 1316 microversion: 2.1 time: 0.717182 Oct 10 23:40:56.518125 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2284/4732] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:55 2022] GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783 => generated 1316 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:56.961452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1654037d-51b4-4aa7-9b4b-c2c67999bac8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:56.976063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1654037d-51b4-4aa7-9b4b-c2c67999bac8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:56.979394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1654037d-51b4-4aa7-9b4b-c2c67999bac8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:56.981494 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1654037d-51b4-4aa7-9b4b-c2c67999bac8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92" status: 200 len: 1258 microversion: 2.26 time: 0.507933 Oct 10 23:40:56.983077 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2449/4733] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:56 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 => generated 1258 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:57.256101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f647aedf-b5bc-4dd1-807b-eda04d6e8ec5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:57.256889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f647aedf-b5bc-4dd1-807b-eda04d6e8ec5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:57.268553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f647aedf-b5bc-4dd1-807b-eda04d6e8ec5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:57.272846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f647aedf-b5bc-4dd1-807b-eda04d6e8ec5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:57.273562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f647aedf-b5bc-4dd1-807b-eda04d6e8ec5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:57.274452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f647aedf-b5bc-4dd1-807b-eda04d6e8ec5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:57.275062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f647aedf-b5bc-4dd1-807b-eda04d6e8ec5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:57.275641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f647aedf-b5bc-4dd1-807b-eda04d6e8ec5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:57.295254 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-f647aedf-b5bc-4dd1-807b-eda04d6e8ec5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] HTTP exception thrown: Instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 could not be found. Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f647aedf-b5bc-4dd1-807b-eda04d6e8ec5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Request method failure captured: Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 HTTP/1.1 Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKu7WNi2uvQW3PKHriU8-GUnRKyKdErbRdfktcffbnHQrrmgmvYdaB02vm9BuOSDHBhYLJ8tmadux4PW1d6f_zk0DOej-Ct1gFl1XxsNuyINWvLzuUXg-VBmZXuVx7H-KeHRMPOIhXjG-BRD8PLzs6Nx35bpJkr_iEqlgSDLouOsukc Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: X-Openstack-Nova-Api-Version: 2.42 Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: e304771fabdc4108aef00b2e4c4b7c70 Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1748411738 Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e304771fabdc4108aef00b2e4c4b7c70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e304771fabdc4108aef00b2e4c4b7c70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e304771fabdc4108aef00b2e4c4b7c70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e304771fabdc4108aef00b2e4c4b7c70", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1748411738 Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: e304771fabdc4108aef00b2e4c4b7c70 Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1748411738 Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TaggedBootDevicesTest_v242-1748411738-project Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: c18b5a7071d34eca9bd7915250027f99 Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1748411738-project Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 could not be found. Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'e57d5936-a36d-4048-902a-6bf9e7ad7b39'} Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 could not be found. Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:40:57.297790 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:40:57.302764 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 could not be found. Oct 10 23:40:57.302764 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:57.302764 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:57.302764 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:57.302764 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:57.302764 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:57.302764 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:57.302764 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:57.302764 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:57.302764 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 could not be found. Oct 10 23:40:57.302764 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:40:57.304782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f647aedf-b5bc-4dd1-807b-eda04d6e8ec5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Returning 404 to user: Instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:57.305952 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f647aedf-b5bc-4dd1-807b-eda04d6e8ec5 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 404 len: 111 microversion: 2.42 time: 0.055165 Oct 10 23:40:57.309979 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2285/4734] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:40:57 2022] DELETE /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:40:57.318925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5957e108-e0e3-4d63-9b1e-188d2534e424 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:57.319565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5957e108-e0e3-4d63-9b1e-188d2534e424 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] [instance: e57d5936-a36d-4048-902a-6bf9e7ad7b39] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:57.331186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5957e108-e0e3-4d63-9b1e-188d2534e424 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:57.343433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5957e108-e0e3-4d63-9b1e-188d2534e424 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:57.346967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5957e108-e0e3-4d63-9b1e-188d2534e424 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:57.353203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5957e108-e0e3-4d63-9b1e-188d2534e424 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:57.355721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5957e108-e0e3-4d63-9b1e-188d2534e424 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:57.356868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5957e108-e0e3-4d63-9b1e-188d2534e424 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:57.401232 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-5957e108-e0e3-4d63-9b1e-188d2534e424 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] HTTP exception thrown: Instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 could not be found. Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5957e108-e0e3-4d63-9b1e-188d2534e424 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Request method failure captured: Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 HTTP/1.1 Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKu7WNi2uvQW3PKHriU8-GUnRKyKdErbRdfktcffbnHQrrmgmvYdaB02vm9BuOSDHBhYLJ8tmadux4PW1d6f_zk0DOej-Ct1gFl1XxsNuyINWvLzuUXg-VBmZXuVx7H-KeHRMPOIhXjG-BRD8PLzs6Nx35bpJkr_iEqlgSDLouOsukc Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: X-Openstack-Nova-Api-Version: 2.42 Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: e304771fabdc4108aef00b2e4c4b7c70 Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1748411738 Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e304771fabdc4108aef00b2e4c4b7c70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e304771fabdc4108aef00b2e4c4b7c70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e304771fabdc4108aef00b2e4c4b7c70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e304771fabdc4108aef00b2e4c4b7c70", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1748411738 Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: e304771fabdc4108aef00b2e4c4b7c70 Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1748411738 Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TaggedBootDevicesTest_v242-1748411738-project Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: c18b5a7071d34eca9bd7915250027f99 Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1748411738-project Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 could not be found. Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'e57d5936-a36d-4048-902a-6bf9e7ad7b39'} Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 could not be found. Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 could not be found. Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:57.407139 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:40:57.411378 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:57.411378 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:40:57.411378 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:40:57.411378 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:40:57.411378 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:40:57.411378 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:40:57.411378 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 could not be found. Oct 10 23:40:57.411378 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:40:57.411378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5957e108-e0e3-4d63-9b1e-188d2534e424 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] Returning 404 to user: Instance e57d5936-a36d-4048-902a-6bf9e7ad7b39 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:40:57.412475 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5957e108-e0e3-4d63-9b1e-188d2534e424 tempest-TaggedBootDevicesTest_v242-1748411738 tempest-TaggedBootDevicesTest_v242-1748411738-project] 10.222.0.23 "GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39" status: 404 len: 111 microversion: 2.42 time: 0.101108 Oct 10 23:40:57.417102 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2450/4735] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:57 2022] GET /compute/v2.1/servers/e57d5936-a36d-4048-902a-6bf9e7ad7b39 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 10 23:40:57.541590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-21ba0b10-6e5b-4bcf-8b1d-246c15fbc6f4 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:57.542248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-21ba0b10-6e5b-4bcf-8b1d-246c15fbc6f4 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] [instance: ab793909-b8f7-47cb-bab7-de87cefe7783] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:57.560266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21ba0b10-6e5b-4bcf-8b1d-246c15fbc6f4 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:57.571474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21ba0b10-6e5b-4bcf-8b1d-246c15fbc6f4 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:57.572050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21ba0b10-6e5b-4bcf-8b1d-246c15fbc6f4 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:57.572812 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21ba0b10-6e5b-4bcf-8b1d-246c15fbc6f4 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:57.573282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21ba0b10-6e5b-4bcf-8b1d-246c15fbc6f4 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:57.584945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21ba0b10-6e5b-4bcf-8b1d-246c15fbc6f4 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:58.019526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c8239682-e76d-40b9-8528-635344d187ab tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:58.020201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c8239682-e76d-40b9-8528-635344d187ab tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:58.047236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8239682-e76d-40b9-8528-635344d187ab tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:58.054110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8239682-e76d-40b9-8528-635344d187ab tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:58.059842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8239682-e76d-40b9-8528-635344d187ab tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:58.068583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8239682-e76d-40b9-8528-635344d187ab tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:58.068870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8239682-e76d-40b9-8528-635344d187ab tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:58.069334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8239682-e76d-40b9-8528-635344d187ab tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:58.172762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:40:58.315475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c8239682-e76d-40b9-8528-635344d187ab tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:58.334450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c8239682-e76d-40b9-8528-635344d187ab tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:58.335855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c8239682-e76d-40b9-8528-635344d187ab tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:58.337048 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c8239682-e76d-40b9-8528-635344d187ab tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92" status: 200 len: 1320 microversion: 2.26 time: 0.326080 Oct 10 23:40:58.359549 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2451/4736] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:58 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 => generated 1320 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:40:58.540809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-21ba0b10-6e5b-4bcf-8b1d-246c15fbc6f4 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52158c9d014c45439fedef97ac84b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae02c15157453b9782d9db5f48888a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:58.555954 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-21ba0b10-6e5b-4bcf-8b1d-246c15fbc6f4 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] 10.222.0.23 "GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783" status: 200 len: 1316 microversion: 2.1 time: 1.019360 Oct 10 23:40:58.586540 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2286/4737] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:57 2022] GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783 => generated 1316 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:40:59.064232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-edc5acc5-732c-4c61-86e7-bcce8ff9ca4b req-989b9a9e-c23a-4cc7-abd5-336642c0c527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab793909-b8f7-47cb-bab7-de87cefe7783", "tag": "b8b269f4-ea3f-43e3-9eb7-116462c32482"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:40:59.087788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-edc5acc5-732c-4c61-86e7-bcce8ff9ca4b req-989b9a9e-c23a-4cc7-abd5-336642c0c527 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:59.088280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-edc5acc5-732c-4c61-86e7-bcce8ff9ca4b req-989b9a9e-c23a-4cc7-abd5-336642c0c527 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:59.088715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-edc5acc5-732c-4c61-86e7-bcce8ff9ca4b req-989b9a9e-c23a-4cc7-abd5-336642c0c527 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:59.122495 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-edc5acc5-732c-4c61-86e7-bcce8ff9ca4b req-989b9a9e-c23a-4cc7-abd5-336642c0c527 service nova] Creating event network-changed:b8b269f4-ea3f-43e3-9eb7-116462c32482 for instance ab793909-b8f7-47cb-bab7-de87cefe7783 on n-h2-860864-2 Oct 10 23:40:59.135312 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-edc5acc5-732c-4c61-86e7-bcce8ff9ca4b req-989b9a9e-c23a-4cc7-abd5-336642c0c527 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076571 Oct 10 23:40:59.136674 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2452/4738] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:40:59.385916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aeed6981-f9a4-48fc-bba3-06b8c92a2d2e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:59.386952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aeed6981-f9a4-48fc-bba3-06b8c92a2d2e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:59.416291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeed6981-f9a4-48fc-bba3-06b8c92a2d2e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:59.416620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeed6981-f9a4-48fc-bba3-06b8c92a2d2e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:59.417204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeed6981-f9a4-48fc-bba3-06b8c92a2d2e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:59.418260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeed6981-f9a4-48fc-bba3-06b8c92a2d2e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:59.419104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeed6981-f9a4-48fc-bba3-06b8c92a2d2e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:59.419936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeed6981-f9a4-48fc-bba3-06b8c92a2d2e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:59.594195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e69a9798-bab7-4dc9-87ce-4ccec217a7bd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:40:59.594921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e69a9798-bab7-4dc9-87ce-4ccec217a7bd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] [instance: ab793909-b8f7-47cb-bab7-de87cefe7783] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:40:59.611882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e69a9798-bab7-4dc9-87ce-4ccec217a7bd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:59.620255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e69a9798-bab7-4dc9-87ce-4ccec217a7bd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:59.621284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e69a9798-bab7-4dc9-87ce-4ccec217a7bd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:59.628651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e69a9798-bab7-4dc9-87ce-4ccec217a7bd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:40:59.630675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e69a9798-bab7-4dc9-87ce-4ccec217a7bd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:40:59.631518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e69a9798-bab7-4dc9-87ce-4ccec217a7bd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:40:59.860757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aeed6981-f9a4-48fc-bba3-06b8c92a2d2e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:59.894189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aeed6981-f9a4-48fc-bba3-06b8c92a2d2e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:59.896971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aeed6981-f9a4-48fc-bba3-06b8c92a2d2e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:40:59.898419 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aeed6981-f9a4-48fc-bba3-06b8c92a2d2e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92" status: 200 len: 1320 microversion: 2.26 time: 0.519245 Oct 10 23:40:59.907408 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2287/4739] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:40:59 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 => generated 1320 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:41:00.522772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e69a9798-bab7-4dc9-87ce-4ccec217a7bd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52158c9d014c45439fedef97ac84b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae02c15157453b9782d9db5f48888a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:00.554544 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e69a9798-bab7-4dc9-87ce-4ccec217a7bd tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] 10.222.0.23 "GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783" status: 200 len: 1316 microversion: 2.1 time: 0.967578 Oct 10 23:41:00.569574 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2453/4740] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:40:59 2022] GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783 => generated 1316 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:00.939107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c00cf660-5656-420c-b5e6-702addbb0f45 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:00.944700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c00cf660-5656-420c-b5e6-702addbb0f45 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:00.973817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c00cf660-5656-420c-b5e6-702addbb0f45 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:00.978914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c00cf660-5656-420c-b5e6-702addbb0f45 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:00.979372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c00cf660-5656-420c-b5e6-702addbb0f45 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:00.980127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c00cf660-5656-420c-b5e6-702addbb0f45 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:00.988203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c00cf660-5656-420c-b5e6-702addbb0f45 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:00.995144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c00cf660-5656-420c-b5e6-702addbb0f45 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:01.294590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c00cf660-5656-420c-b5e6-702addbb0f45 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:01.308404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c00cf660-5656-420c-b5e6-702addbb0f45 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:01.310367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c00cf660-5656-420c-b5e6-702addbb0f45 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:01.312011 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c00cf660-5656-420c-b5e6-702addbb0f45 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92" status: 200 len: 1320 microversion: 2.26 time: 0.381177 Oct 10 23:41:01.313213 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2288/4741] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:41:00 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 => generated 1320 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:41:01.595960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-89cd1b23-785d-4abf-93a3-3243da4c754f tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:01.621130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-89cd1b23-785d-4abf-93a3-3243da4c754f tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] [instance: ab793909-b8f7-47cb-bab7-de87cefe7783] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:01.623484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:41:01.636545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89cd1b23-785d-4abf-93a3-3243da4c754f tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:01.637485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89cd1b23-785d-4abf-93a3-3243da4c754f tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:01.638741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89cd1b23-785d-4abf-93a3-3243da4c754f tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:01.639460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89cd1b23-785d-4abf-93a3-3243da4c754f tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:01.640710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89cd1b23-785d-4abf-93a3-3243da4c754f tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:01.641356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89cd1b23-785d-4abf-93a3-3243da4c754f tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:02.045972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-89cd1b23-785d-4abf-93a3-3243da4c754f tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52158c9d014c45439fedef97ac84b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae02c15157453b9782d9db5f48888a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:02.064822 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-89cd1b23-785d-4abf-93a3-3243da4c754f tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] 10.222.0.23 "GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783" status: 200 len: 1316 microversion: 2.1 time: 0.483484 Oct 10 23:41:02.066226 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2454/4742] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:01 2022] GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783 => generated 1316 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:41:02.354226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-48a6a3e9-426d-4cf2-b211-6cb1c4a1d409 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:02.354834 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-48a6a3e9-426d-4cf2-b211-6cb1c4a1d409 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:02.395128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48a6a3e9-426d-4cf2-b211-6cb1c4a1d409 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:02.411277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48a6a3e9-426d-4cf2-b211-6cb1c4a1d409 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:02.411946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48a6a3e9-426d-4cf2-b211-6cb1c4a1d409 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:02.418026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48a6a3e9-426d-4cf2-b211-6cb1c4a1d409 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:02.418525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48a6a3e9-426d-4cf2-b211-6cb1c4a1d409 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:02.418968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48a6a3e9-426d-4cf2-b211-6cb1c4a1d409 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:03.106954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3b8beaec-0f6b-43c0-87c6-f1337e605f90 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:03.108168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3b8beaec-0f6b-43c0-87c6-f1337e605f90 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] [instance: ab793909-b8f7-47cb-bab7-de87cefe7783] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:03.126588 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-48a6a3e9-426d-4cf2-b211-6cb1c4a1d409 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:03.137184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b8beaec-0f6b-43c0-87c6-f1337e605f90 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:03.137934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b8beaec-0f6b-43c0-87c6-f1337e605f90 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:03.138382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b8beaec-0f6b-43c0-87c6-f1337e605f90 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:03.139341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b8beaec-0f6b-43c0-87c6-f1337e605f90 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:03.140362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b8beaec-0f6b-43c0-87c6-f1337e605f90 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:03.141014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b8beaec-0f6b-43c0-87c6-f1337e605f90 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:03.147119 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-48a6a3e9-426d-4cf2-b211-6cb1c4a1d409 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:03.162025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-48a6a3e9-426d-4cf2-b211-6cb1c4a1d409 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:03.163543 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-48a6a3e9-426d-4cf2-b211-6cb1c4a1d409 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92" status: 200 len: 1362 microversion: 2.26 time: 0.825922 Oct 10 23:41:03.164744 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2289/4743] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:41:02 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 => generated 1362 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:41:03.965695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3b8beaec-0f6b-43c0-87c6-f1337e605f90 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52158c9d014c45439fedef97ac84b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae02c15157453b9782d9db5f48888a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:03.981156 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3b8beaec-0f6b-43c0-87c6-f1337e605f90 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] 10.222.0.23 "GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783" status: 200 len: 1316 microversion: 2.1 time: 0.878103 Oct 10 23:41:03.982512 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2455/4744] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:03 2022] GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783 => generated 1316 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:41:04.195583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5619ad92-f9c1-4325-a933-86d1ce003a74 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:04.196796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5619ad92-f9c1-4325-a933-86d1ce003a74 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:04.207120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5619ad92-f9c1-4325-a933-86d1ce003a74 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:04.214119 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5619ad92-f9c1-4325-a933-86d1ce003a74 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:04.214814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5619ad92-f9c1-4325-a933-86d1ce003a74 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:04.215714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5619ad92-f9c1-4325-a933-86d1ce003a74 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:04.216331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5619ad92-f9c1-4325-a933-86d1ce003a74 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:04.216928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5619ad92-f9c1-4325-a933-86d1ce003a74 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:04.845269 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5619ad92-f9c1-4325-a933-86d1ce003a74 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:04.862562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5619ad92-f9c1-4325-a933-86d1ce003a74 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:04.864222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5619ad92-f9c1-4325-a933-86d1ce003a74 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:04.865444 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5619ad92-f9c1-4325-a933-86d1ce003a74 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92" status: 200 len: 1362 microversion: 2.26 time: 0.674684 Oct 10 23:41:04.866309 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2290/4745] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:41:04 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 => generated 1362 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:41:05.011122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fc6ca03f-e3e6-4e88-a4fe-468cb9666aea tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:05.013218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fc6ca03f-e3e6-4e88-a4fe-468cb9666aea tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] [instance: ab793909-b8f7-47cb-bab7-de87cefe7783] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:05.040432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc6ca03f-e3e6-4e88-a4fe-468cb9666aea tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:05.041226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc6ca03f-e3e6-4e88-a4fe-468cb9666aea tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:05.041696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc6ca03f-e3e6-4e88-a4fe-468cb9666aea tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:05.045208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc6ca03f-e3e6-4e88-a4fe-468cb9666aea tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:05.046552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc6ca03f-e3e6-4e88-a4fe-468cb9666aea tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:05.051233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc6ca03f-e3e6-4e88-a4fe-468cb9666aea tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:05.272580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-4da64cd1-9c65-4353-8703-c79fb8c73dcd req-175b5028-2106-46ab-8aa1-73bbcc8546e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5881f190-248d-4ff8-9a2b-42ff42625f92", "tag": "86b384d4-6193-46d1-ba48-a32119e2046c"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:41:05.287170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:41:05.292850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=8 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:41:05.338062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4da64cd1-9c65-4353-8703-c79fb8c73dcd req-175b5028-2106-46ab-8aa1-73bbcc8546e9 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:05.338062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4da64cd1-9c65-4353-8703-c79fb8c73dcd req-175b5028-2106-46ab-8aa1-73bbcc8546e9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:05.340441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4da64cd1-9c65-4353-8703-c79fb8c73dcd req-175b5028-2106-46ab-8aa1-73bbcc8546e9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:05.364762 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-4da64cd1-9c65-4353-8703-c79fb8c73dcd req-175b5028-2106-46ab-8aa1-73bbcc8546e9 service nova] Creating event network-changed:86b384d4-6193-46d1-ba48-a32119e2046c for instance 5881f190-248d-4ff8-9a2b-42ff42625f92 on n-h1-860864-2 Oct 10 23:41:05.382355 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-4da64cd1-9c65-4353-8703-c79fb8c73dcd req-175b5028-2106-46ab-8aa1-73bbcc8546e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115142 Oct 10 23:41:05.383285 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2291/4746] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:41:05.420065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=10 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:41:05.450151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fc6ca03f-e3e6-4e88-a4fe-468cb9666aea tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52158c9d014c45439fedef97ac84b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae02c15157453b9782d9db5f48888a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:05.466402 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fc6ca03f-e3e6-4e88-a4fe-468cb9666aea tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] 10.222.0.23 "GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783" status: 200 len: 1316 microversion: 2.1 time: 0.461735 Oct 10 23:41:05.467485 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2456/4747] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:05 2022] GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783 => generated 1316 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:05.855409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-c52f6f48-38a7-4cdd-96eb-4da10cb785ea req-22ab03e5-1757-4c70-8634-9a8789ce99ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab793909-b8f7-47cb-bab7-de87cefe7783", "name": "network-vif-plugged", "status": "completed", "tag": "b8b269f4-ea3f-43e3-9eb7-116462c32482"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:41:05.868394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c52f6f48-38a7-4cdd-96eb-4da10cb785ea req-22ab03e5-1757-4c70-8634-9a8789ce99ba service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:05.869500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c52f6f48-38a7-4cdd-96eb-4da10cb785ea req-22ab03e5-1757-4c70-8634-9a8789ce99ba service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:05.870434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c52f6f48-38a7-4cdd-96eb-4da10cb785ea req-22ab03e5-1757-4c70-8634-9a8789ce99ba service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:05.888130 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-c52f6f48-38a7-4cdd-96eb-4da10cb785ea req-22ab03e5-1757-4c70-8634-9a8789ce99ba service nova] Creating event network-vif-plugged:b8b269f4-ea3f-43e3-9eb7-116462c32482 for instance ab793909-b8f7-47cb-bab7-de87cefe7783 on n-h2-860864-2 Oct 10 23:41:05.894739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e6e71657-3c80-4ed3-884d-2f0ca897e2ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:05.895378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e6e71657-3c80-4ed3-884d-2f0ca897e2ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:05.895679 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-c52f6f48-38a7-4cdd-96eb-4da10cb785ea req-22ab03e5-1757-4c70-8634-9a8789ce99ba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046581 Oct 10 23:41:05.896890 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2292/4748] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:41:05.914861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6e71657-3c80-4ed3-884d-2f0ca897e2ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:05.915504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6e71657-3c80-4ed3-884d-2f0ca897e2ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:05.915958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6e71657-3c80-4ed3-884d-2f0ca897e2ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:05.924856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6e71657-3c80-4ed3-884d-2f0ca897e2ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:05.925489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6e71657-3c80-4ed3-884d-2f0ca897e2ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:05.926088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6e71657-3c80-4ed3-884d-2f0ca897e2ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:06.285734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e6e71657-3c80-4ed3-884d-2f0ca897e2ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:06.317472 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e6e71657-3c80-4ed3-884d-2f0ca897e2ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:06.327666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e6e71657-3c80-4ed3-884d-2f0ca897e2ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:06.337774 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e6e71657-3c80-4ed3-884d-2f0ca897e2ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92" status: 200 len: 1362 microversion: 2.26 time: 0.446314 Oct 10 23:41:06.338691 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2457/4749] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:41:05 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 => generated 1362 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:41:06.491333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c07d0814-152b-44fd-87a2-8aad3ea46cbb tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:06.492033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c07d0814-152b-44fd-87a2-8aad3ea46cbb tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] [instance: ab793909-b8f7-47cb-bab7-de87cefe7783] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:06.504064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c07d0814-152b-44fd-87a2-8aad3ea46cbb tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:06.512985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c07d0814-152b-44fd-87a2-8aad3ea46cbb tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:06.515067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c07d0814-152b-44fd-87a2-8aad3ea46cbb tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:06.516895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c07d0814-152b-44fd-87a2-8aad3ea46cbb tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:06.518044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c07d0814-152b-44fd-87a2-8aad3ea46cbb tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:06.518837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c07d0814-152b-44fd-87a2-8aad3ea46cbb tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:06.796752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c07d0814-152b-44fd-87a2-8aad3ea46cbb tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52158c9d014c45439fedef97ac84b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae02c15157453b9782d9db5f48888a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:06.805134 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c07d0814-152b-44fd-87a2-8aad3ea46cbb tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] 10.222.0.23 "GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783" status: 200 len: 1316 microversion: 2.1 time: 0.318783 Oct 10 23:41:06.813852 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2293/4750] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:06 2022] GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783 => generated 1316 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:07.368774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c1d973be-9e03-43cc-924f-2a5dbc7ed803 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:07.370321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c1d973be-9e03-43cc-924f-2a5dbc7ed803 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:07.396411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1d973be-9e03-43cc-924f-2a5dbc7ed803 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:07.397219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1d973be-9e03-43cc-924f-2a5dbc7ed803 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:07.398793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1d973be-9e03-43cc-924f-2a5dbc7ed803 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:07.400754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1d973be-9e03-43cc-924f-2a5dbc7ed803 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:07.402223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1d973be-9e03-43cc-924f-2a5dbc7ed803 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:07.405319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1d973be-9e03-43cc-924f-2a5dbc7ed803 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:07.716278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c1d973be-9e03-43cc-924f-2a5dbc7ed803 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:07.727580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c1d973be-9e03-43cc-924f-2a5dbc7ed803 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:07.729265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c1d973be-9e03-43cc-924f-2a5dbc7ed803 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:07.730844 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c1d973be-9e03-43cc-924f-2a5dbc7ed803 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92" status: 200 len: 1362 microversion: 2.26 time: 0.367636 Oct 10 23:41:07.731626 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2458/4751] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:41:07 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 => generated 1362 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:41:07.833486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8df91cdf-95ed-44ee-9961-468e61aec95b tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:07.835029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8df91cdf-95ed-44ee-9961-468e61aec95b tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] [instance: ab793909-b8f7-47cb-bab7-de87cefe7783] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:07.851769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8df91cdf-95ed-44ee-9961-468e61aec95b tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:07.853120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8df91cdf-95ed-44ee-9961-468e61aec95b tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:07.856274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8df91cdf-95ed-44ee-9961-468e61aec95b tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:07.856946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8df91cdf-95ed-44ee-9961-468e61aec95b tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:07.857585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8df91cdf-95ed-44ee-9961-468e61aec95b tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:07.859815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8df91cdf-95ed-44ee-9961-468e61aec95b tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:08.301525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8df91cdf-95ed-44ee-9961-468e61aec95b tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52158c9d014c45439fedef97ac84b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae02c15157453b9782d9db5f48888a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:08.318127 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8df91cdf-95ed-44ee-9961-468e61aec95b tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] 10.222.0.23 "GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783" status: 200 len: 1503 microversion: 2.1 time: 0.489474 Oct 10 23:41:08.318813 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2294/4752] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:07 2022] GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783 => generated 1503 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:08.341814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7351ce2c-14c1-4ddf-9aeb-67634c1b68cf tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:08.342561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7351ce2c-14c1-4ddf-9aeb-67634c1b68cf tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] [instance: ab793909-b8f7-47cb-bab7-de87cefe7783] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:08.349602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7351ce2c-14c1-4ddf-9aeb-67634c1b68cf tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:08.350527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7351ce2c-14c1-4ddf-9aeb-67634c1b68cf tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:08.351275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7351ce2c-14c1-4ddf-9aeb-67634c1b68cf tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:08.352480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7351ce2c-14c1-4ddf-9aeb-67634c1b68cf tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:08.353098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7351ce2c-14c1-4ddf-9aeb-67634c1b68cf tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:08.353729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7351ce2c-14c1-4ddf-9aeb-67634c1b68cf tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:08.455549 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7351ce2c-14c1-4ddf-9aeb-67634c1b68cf tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.117024 Oct 10 23:41:08.462226 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2459/4753] 10.222.0.23 () {58 vars in 1296 bytes} [Mon Oct 10 23:41:08 2022] DELETE /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783/os-server-password => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:41:08.467439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-225a1027-351b-4be2-a21f-830448208bb5 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:08.467649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-225a1027-351b-4be2-a21f-830448208bb5 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] [instance: ab793909-b8f7-47cb-bab7-de87cefe7783] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:08.479214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-225a1027-351b-4be2-a21f-830448208bb5 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:08.479743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-225a1027-351b-4be2-a21f-830448208bb5 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:08.485919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-225a1027-351b-4be2-a21f-830448208bb5 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:08.486914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-225a1027-351b-4be2-a21f-830448208bb5 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:08.487491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-225a1027-351b-4be2-a21f-830448208bb5 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:08.487928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-225a1027-351b-4be2-a21f-830448208bb5 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:08.544412 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-225a1027-351b-4be2-a21f-830448208bb5 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] 10.222.0.23 "GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.081684 Oct 10 23:41:08.548341 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2295/4754] 10.222.0.23 () {58 vars in 1293 bytes} [Mon Oct 10 23:41:08 2022] GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783/os-server-password => generated 16 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:41:08.559393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d92698ff-12f1-43ea-bbfc-75b85246a940 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:08.559905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d92698ff-12f1-43ea-bbfc-75b85246a940 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] [instance: ab793909-b8f7-47cb-bab7-de87cefe7783] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:08.569317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d92698ff-12f1-43ea-bbfc-75b85246a940 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:08.572774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d92698ff-12f1-43ea-bbfc-75b85246a940 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:08.573787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d92698ff-12f1-43ea-bbfc-75b85246a940 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:08.575229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d92698ff-12f1-43ea-bbfc-75b85246a940 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:08.575712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d92698ff-12f1-43ea-bbfc-75b85246a940 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:08.576150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d92698ff-12f1-43ea-bbfc-75b85246a940 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:08.690507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d92698ff-12f1-43ea-bbfc-75b85246a940 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] [instance: ab793909-b8f7-47cb-bab7-de87cefe7783] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:41:08.766244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-748133be-c849-4a39-8c54-492ef60f20d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:08.769504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-748133be-c849-4a39-8c54-492ef60f20d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:08.779771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-748133be-c849-4a39-8c54-492ef60f20d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:08.785984 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-748133be-c849-4a39-8c54-492ef60f20d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:08.787459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-748133be-c849-4a39-8c54-492ef60f20d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:08.790376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-748133be-c849-4a39-8c54-492ef60f20d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:08.791754 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-748133be-c849-4a39-8c54-492ef60f20d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:08.793969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-748133be-c849-4a39-8c54-492ef60f20d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:08.878008 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d92698ff-12f1-43ea-bbfc-75b85246a940 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783" status: 204 len: 0 microversion: 2.1 time: 0.322206 Oct 10 23:41:08.878921 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2460/4755] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:41:08 2022] DELETE /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:41:08.890052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a6ddccc9-4c49-4f37-81f0-668c122cc4b0 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:08.894307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a6ddccc9-4c49-4f37-81f0-668c122cc4b0 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] [instance: ab793909-b8f7-47cb-bab7-de87cefe7783] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:08.919113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6ddccc9-4c49-4f37-81f0-668c122cc4b0 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:08.920013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6ddccc9-4c49-4f37-81f0-668c122cc4b0 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:08.920694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6ddccc9-4c49-4f37-81f0-668c122cc4b0 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:08.921812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6ddccc9-4c49-4f37-81f0-668c122cc4b0 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:08.922571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6ddccc9-4c49-4f37-81f0-668c122cc4b0 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:08.923241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6ddccc9-4c49-4f37-81f0-668c122cc4b0 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:09.191204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-748133be-c849-4a39-8c54-492ef60f20d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:09.206940 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-748133be-c849-4a39-8c54-492ef60f20d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:09.209802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-748133be-c849-4a39-8c54-492ef60f20d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:09.215120 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-748133be-c849-4a39-8c54-492ef60f20d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92" status: 200 len: 1362 microversion: 2.26 time: 0.455688 Oct 10 23:41:09.217510 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2296/4756] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:41:08 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 => generated 1362 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:41:09.225567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a6ddccc9-4c49-4f37-81f0-668c122cc4b0 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52158c9d014c45439fedef97ac84b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae02c15157453b9782d9db5f48888a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:09.235618 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a6ddccc9-4c49-4f37-81f0-668c122cc4b0 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] 10.222.0.23 "GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783" status: 200 len: 1509 microversion: 2.1 time: 0.352396 Oct 10 23:41:09.249572 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2461/4757] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:08 2022] GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783 => generated 1509 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:41:10.251537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c2e817a4-0950-4576-8523-9f7b36cc31ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:10.252242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c2e817a4-0950-4576-8523-9f7b36cc31ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:10.264098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2e817a4-0950-4576-8523-9f7b36cc31ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:10.265513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2e817a4-0950-4576-8523-9f7b36cc31ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:10.272450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2e817a4-0950-4576-8523-9f7b36cc31ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:10.273589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2e817a4-0950-4576-8523-9f7b36cc31ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:10.276609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2e817a4-0950-4576-8523-9f7b36cc31ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:10.276828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5d62d8a9-3862-4601-a8e6-60391ab1bd64 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:10.277505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5d62d8a9-3862-4601-a8e6-60391ab1bd64 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] [instance: ab793909-b8f7-47cb-bab7-de87cefe7783] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:10.278822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2e817a4-0950-4576-8523-9f7b36cc31ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:10.294474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d62d8a9-3862-4601-a8e6-60391ab1bd64 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:10.298410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d62d8a9-3862-4601-a8e6-60391ab1bd64 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:10.298895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d62d8a9-3862-4601-a8e6-60391ab1bd64 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:10.299641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d62d8a9-3862-4601-a8e6-60391ab1bd64 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:10.300122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d62d8a9-3862-4601-a8e6-60391ab1bd64 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:10.300552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d62d8a9-3862-4601-a8e6-60391ab1bd64 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:10.369229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:41:10.732703 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c2e817a4-0950-4576-8523-9f7b36cc31ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:10.742924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c2e817a4-0950-4576-8523-9f7b36cc31ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:10.744371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c2e817a4-0950-4576-8523-9f7b36cc31ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:10.745574 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c2e817a4-0950-4576-8523-9f7b36cc31ec tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92" status: 200 len: 1362 microversion: 2.26 time: 0.501234 Oct 10 23:41:10.746143 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2297/4758] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:41:10 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 => generated 1362 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:41:11.450771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-65046895-ef2c-4b9a-9104-0a65347282d0 req-7eac6689-5b0b-4cbb-a043-b3c58ac8b957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab793909-b8f7-47cb-bab7-de87cefe7783", "name": "network-vif-deleted", "tag": "b8b269f4-ea3f-43e3-9eb7-116462c32482"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:41:11.482413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-65046895-ef2c-4b9a-9104-0a65347282d0 req-7eac6689-5b0b-4cbb-a043-b3c58ac8b957 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:11.485038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-65046895-ef2c-4b9a-9104-0a65347282d0 req-7eac6689-5b0b-4cbb-a043-b3c58ac8b957 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:11.485807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-65046895-ef2c-4b9a-9104-0a65347282d0 req-7eac6689-5b0b-4cbb-a043-b3c58ac8b957 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:11.527651 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-65046895-ef2c-4b9a-9104-0a65347282d0 req-7eac6689-5b0b-4cbb-a043-b3c58ac8b957 service nova] Creating event network-vif-deleted:b8b269f4-ea3f-43e3-9eb7-116462c32482 for instance ab793909-b8f7-47cb-bab7-de87cefe7783 on n-h2-860864-2 Oct 10 23:41:11.536038 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-65046895-ef2c-4b9a-9104-0a65347282d0 req-7eac6689-5b0b-4cbb-a043-b3c58ac8b957 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088968 Oct 10 23:41:11.538039 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2298/4759] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:41:11.778483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-63f3d433-cc03-4e9a-864b-0036cd7c56e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:11.779400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-63f3d433-cc03-4e9a-864b-0036cd7c56e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:11.797572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63f3d433-cc03-4e9a-864b-0036cd7c56e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:11.802248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63f3d433-cc03-4e9a-864b-0036cd7c56e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:11.803218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63f3d433-cc03-4e9a-864b-0036cd7c56e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:11.804091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63f3d433-cc03-4e9a-864b-0036cd7c56e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:11.809538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63f3d433-cc03-4e9a-864b-0036cd7c56e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:11.810517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63f3d433-cc03-4e9a-864b-0036cd7c56e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:11.950347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5d62d8a9-3862-4601-a8e6-60391ab1bd64 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52158c9d014c45439fedef97ac84b693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ae02c15157453b9782d9db5f48888a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:11.963634 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5d62d8a9-3862-4601-a8e6-60391ab1bd64 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] 10.222.0.23 "GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783" status: 200 len: 1509 microversion: 2.1 time: 1.693484 Oct 10 23:41:11.965598 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2462/4760] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:10 2022] GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783 => generated 1509 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:12.227222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-63f3d433-cc03-4e9a-864b-0036cd7c56e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:12.242098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-63f3d433-cc03-4e9a-864b-0036cd7c56e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:12.250075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-63f3d433-cc03-4e9a-864b-0036cd7c56e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:12.255498 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-63f3d433-cc03-4e9a-864b-0036cd7c56e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92" status: 200 len: 1362 microversion: 2.26 time: 0.481583 Oct 10 23:41:12.258006 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2299/4761] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:41:11 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 => generated 1362 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:41:12.990840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2f346950-04cb-4dfc-bcfc-a420364dfee5 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:12.995710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2f346950-04cb-4dfc-bcfc-a420364dfee5 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] [instance: ab793909-b8f7-47cb-bab7-de87cefe7783] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:13.022400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f346950-04cb-4dfc-bcfc-a420364dfee5 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:13.029756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f346950-04cb-4dfc-bcfc-a420364dfee5 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:13.030657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f346950-04cb-4dfc-bcfc-a420364dfee5 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:13.038048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f346950-04cb-4dfc-bcfc-a420364dfee5 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:13.038855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f346950-04cb-4dfc-bcfc-a420364dfee5 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:13.039512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f346950-04cb-4dfc-bcfc-a420364dfee5 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:13.058774 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-2f346950-04cb-4dfc-bcfc-a420364dfee5 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] HTTP exception thrown: Instance ab793909-b8f7-47cb-bab7-de87cefe7783 could not be found. Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2f346950-04cb-4dfc-bcfc-a420364dfee5 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Request method failure captured: Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783 HTTP/1.1 Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK18WrayIeAEm8pdJdSQbOe-AYehzhmLLdZMtC-MqNdiL20b02T46qT9MQbJn0se4L_Hkk1-vlVqbLTc8NP0_kQ_v8Elob6m9TITrY-_TA3LQkavjMp92xszvMcM6XC3uxilaDA0lGsjO2fVtvCnJMCHxvcoXFHHiBgai0eB5yQ41FQ Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 18ae02c15157453b9782d9db5f48888a Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerPasswordTestJSON-2010492632 Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/18ae02c15157453b9782d9db5f48888a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/18ae02c15157453b9782d9db5f48888a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/18ae02c15157453b9782d9db5f48888a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_18ae02c15157453b9782d9db5f48888a", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerPasswordTestJSON-2010492632 Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 18ae02c15157453b9782d9db5f48888a Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerPasswordTestJSON-2010492632 Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerPasswordTestJSON-2010492632-project Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 52158c9d014c45439fedef97ac84b693 Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerPasswordTestJSON-2010492632-project Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance ab793909-b8f7-47cb-bab7-de87cefe7783 could not be found. Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'ab793909-b8f7-47cb-bab7-de87cefe7783'} Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab793909-b8f7-47cb-bab7-de87cefe7783 could not be found. Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab793909-b8f7-47cb-bab7-de87cefe7783 could not be found. Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:41:13.063047 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:41:13.069065 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:41:13.069065 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:41:13.069065 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:41:13.069065 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:41:13.069065 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:41:13.069065 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab793909-b8f7-47cb-bab7-de87cefe7783 could not be found. Oct 10 23:41:13.069065 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:41:13.070521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2f346950-04cb-4dfc-bcfc-a420364dfee5 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] Returning 404 to user: Instance ab793909-b8f7-47cb-bab7-de87cefe7783 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:41:13.076378 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2f346950-04cb-4dfc-bcfc-a420364dfee5 tempest-ServerPasswordTestJSON-2010492632 tempest-ServerPasswordTestJSON-2010492632-project] 10.222.0.23 "GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783" status: 404 len: 111 microversion: 2.1 time: 0.089663 Oct 10 23:41:13.082087 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2463/4762] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:12 2022] GET /compute/v2.1/servers/ab793909-b8f7-47cb-bab7-de87cefe7783 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:41:13.303792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9f5a5205-967d-431e-8d11-b7641a1a4db3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:13.304507 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9f5a5205-967d-431e-8d11-b7641a1a4db3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:13.346202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f5a5205-967d-431e-8d11-b7641a1a4db3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:13.346717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f5a5205-967d-431e-8d11-b7641a1a4db3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:13.347164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f5a5205-967d-431e-8d11-b7641a1a4db3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:13.347887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f5a5205-967d-431e-8d11-b7641a1a4db3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:13.348346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f5a5205-967d-431e-8d11-b7641a1a4db3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:13.348773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f5a5205-967d-431e-8d11-b7641a1a4db3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:13.970025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9f5a5205-967d-431e-8d11-b7641a1a4db3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:13.980684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9f5a5205-967d-431e-8d11-b7641a1a4db3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:13.989760 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9f5a5205-967d-431e-8d11-b7641a1a4db3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:13.992986 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9f5a5205-967d-431e-8d11-b7641a1a4db3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92" status: 200 len: 1362 microversion: 2.26 time: 0.703342 Oct 10 23:41:13.993975 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2300/4763] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:41:13 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 => generated 1362 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:41:15.039827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7475b57d-f921-4fc3-89f3-5a21e16d4cc3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:15.041088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7475b57d-f921-4fc3-89f3-5a21e16d4cc3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:15.051713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7475b57d-f921-4fc3-89f3-5a21e16d4cc3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:15.055667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7475b57d-f921-4fc3-89f3-5a21e16d4cc3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:15.056719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7475b57d-f921-4fc3-89f3-5a21e16d4cc3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:15.059043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7475b57d-f921-4fc3-89f3-5a21e16d4cc3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:15.065777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7475b57d-f921-4fc3-89f3-5a21e16d4cc3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:15.066922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7475b57d-f921-4fc3-89f3-5a21e16d4cc3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:15.582777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7475b57d-f921-4fc3-89f3-5a21e16d4cc3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:15.598196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7475b57d-f921-4fc3-89f3-5a21e16d4cc3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:15.614270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7475b57d-f921-4fc3-89f3-5a21e16d4cc3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:15.618141 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7475b57d-f921-4fc3-89f3-5a21e16d4cc3 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92" status: 200 len: 1362 microversion: 2.26 time: 0.586319 Oct 10 23:41:15.620428 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2464/4764] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:41:15 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 => generated 1362 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:41:15.736924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-48c61ef9-f776-4a30-a51c-96fe6c353b01 req-ff034634-1e9c-4661-ae89-115538883556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5881f190-248d-4ff8-9a2b-42ff42625f92", "name": "network-vif-plugged", "status": "completed", "tag": "86b384d4-6193-46d1-ba48-a32119e2046c"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:41:15.776825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-48c61ef9-f776-4a30-a51c-96fe6c353b01 req-ff034634-1e9c-4661-ae89-115538883556 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:15.782439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-48c61ef9-f776-4a30-a51c-96fe6c353b01 req-ff034634-1e9c-4661-ae89-115538883556 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:15.783270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-48c61ef9-f776-4a30-a51c-96fe6c353b01 req-ff034634-1e9c-4661-ae89-115538883556 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:15.830064 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-48c61ef9-f776-4a30-a51c-96fe6c353b01 req-ff034634-1e9c-4661-ae89-115538883556 service nova] Creating event network-vif-plugged:86b384d4-6193-46d1-ba48-a32119e2046c for instance 5881f190-248d-4ff8-9a2b-42ff42625f92 on n-h1-860864-2 Oct 10 23:41:15.841058 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-48c61ef9-f776-4a30-a51c-96fe6c353b01 req-ff034634-1e9c-4661-ae89-115538883556 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108858 Oct 10 23:41:15.844755 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2301/4765] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:41:16.655448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1f326ff9-e07b-4c23-bc21-aee37b7568bc tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:16.656202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1f326ff9-e07b-4c23-bc21-aee37b7568bc tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:16.673022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f326ff9-e07b-4c23-bc21-aee37b7568bc tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:16.673571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f326ff9-e07b-4c23-bc21-aee37b7568bc tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:16.674015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f326ff9-e07b-4c23-bc21-aee37b7568bc tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:16.674739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f326ff9-e07b-4c23-bc21-aee37b7568bc tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:16.675198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f326ff9-e07b-4c23-bc21-aee37b7568bc tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:16.675696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f326ff9-e07b-4c23-bc21-aee37b7568bc tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:17.272726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1f326ff9-e07b-4c23-bc21-aee37b7568bc tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:17.296640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1f326ff9-e07b-4c23-bc21-aee37b7568bc tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:17.299649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1f326ff9-e07b-4c23-bc21-aee37b7568bc tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:17.300187 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1f326ff9-e07b-4c23-bc21-aee37b7568bc tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92" status: 200 len: 1362 microversion: 2.26 time: 0.648802 Oct 10 23:41:17.326606 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2465/4766] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:41:16 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 => generated 1362 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:41:18.291111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-13d00228-1207-40e9-a568-7063df00574c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'create', calling method: .version_select at 0x7f662a3ae1f0>, body: {"keypair": {"name": "tempest-keypair-1136214815", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdY0Tdirl07D2ZHBZsOXkutt+m6ujyS5Bb7l0uVLHhXls032CCKywHH15B/86SxPBMXmzTWD1ouAdCjlkaVH/qr+d1o10ai0cG+FRKV8FlNvbUyXNGJoegk5OXtOWpHhg=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:41:18.329186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-091b1e89-ae1b-46b7-b6fe-88b007597251 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:18.330070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-091b1e89-ae1b-46b7-b6fe-88b007597251 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:18.342117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-13d00228-1207-40e9-a568-7063df00574c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Getting quotas for project f798f5f5321f40b89fc5bacc3b9389fe. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:41:18.348435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-091b1e89-ae1b-46b7-b6fe-88b007597251 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:18.348935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-091b1e89-ae1b-46b7-b6fe-88b007597251 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:18.352687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-091b1e89-ae1b-46b7-b6fe-88b007597251 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:18.353684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-091b1e89-ae1b-46b7-b6fe-88b007597251 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:18.354423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-091b1e89-ae1b-46b7-b6fe-88b007597251 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:18.355021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-091b1e89-ae1b-46b7-b6fe-88b007597251 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:18.364291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-13d00228-1207-40e9-a568-7063df00574c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Getting quotas for user cfd8618ee1864d1d86de2def024b49bb and project f798f5f5321f40b89fc5bacc3b9389fe. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:41:18.440940 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-13d00228-1207-40e9-a568-7063df00574c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.407229 Oct 10 23:41:18.442027 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2302/4767] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:41:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:41:19.050974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-091b1e89-ae1b-46b7-b6fe-88b007597251 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:19.063958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-091b1e89-ae1b-46b7-b6fe-88b007597251 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:19.068841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-091b1e89-ae1b-46b7-b6fe-88b007597251 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:19.072581 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-091b1e89-ae1b-46b7-b6fe-88b007597251 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92" status: 200 len: 1362 microversion: 2.26 time: 0.747464 Oct 10 23:41:19.074754 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2466/4768] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:41:18 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 => generated 1362 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:41:20.106651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a8e4ce6e-f6d8-47bf-b260-4b0c9c45151c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:20.107413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a8e4ce6e-f6d8-47bf-b260-4b0c9c45151c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:20.110828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:41:20.124518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e4ce6e-f6d8-47bf-b260-4b0c9c45151c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:20.130195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e4ce6e-f6d8-47bf-b260-4b0c9c45151c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:20.130959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e4ce6e-f6d8-47bf-b260-4b0c9c45151c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:20.131905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e4ce6e-f6d8-47bf-b260-4b0c9c45151c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:20.133160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e4ce6e-f6d8-47bf-b260-4b0c9c45151c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:20.133832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8e4ce6e-f6d8-47bf-b260-4b0c9c45151c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:20.721052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-82670c26-52ba-45b0-95e7-080f2ca59bbf tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12e3d7cb-3c2b-48f2-8ded-94465d9037e5"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:41:20.723459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-82670c26-52ba-45b0-95e7-080f2ca59bbf tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:20.755939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82670c26-52ba-45b0-95e7-080f2ca59bbf tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:20.756536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82670c26-52ba-45b0-95e7-080f2ca59bbf tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:20.756995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82670c26-52ba-45b0-95e7-080f2ca59bbf tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:20.757771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82670c26-52ba-45b0-95e7-080f2ca59bbf tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:20.758231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82670c26-52ba-45b0-95e7-080f2ca59bbf tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:20.768133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82670c26-52ba-45b0-95e7-080f2ca59bbf tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:21.442912 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-82670c26-52ba-45b0-95e7-080f2ca59bbf tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "POST /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.726375 Oct 10 23:41:21.459909 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2467/4769] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Oct 10 23:41:20 2022] POST /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments => generated 194 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:41:21.564724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a8e4ce6e-f6d8-47bf-b260-4b0c9c45151c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:21.612541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=93 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:41:21.643207 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a8e4ce6e-f6d8-47bf-b260-4b0c9c45151c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:21.644825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a8e4ce6e-f6d8-47bf-b260-4b0c9c45151c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:21.663936 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a8e4ce6e-f6d8-47bf-b260-4b0c9c45151c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92" status: 200 len: 1545 microversion: 2.26 time: 1.561481 Oct 10 23:41:21.669155 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2303/4770] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:41:20 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 => generated 1545 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:41:21.701937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-67bcaee1-b8b5-41cd-9fae-569181e2f9d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '.version_select at 0x7f6633bb6e50>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:21.737639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67bcaee1-b8b5-41cd-9fae-569181e2f9d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:21.744804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67bcaee1-b8b5-41cd-9fae-569181e2f9d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:21.746961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67bcaee1-b8b5-41cd-9fae-569181e2f9d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:21.747921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-67bcaee1-b8b5-41cd-9fae-569181e2f9d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:21.763786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67bcaee1-b8b5-41cd-9fae-569181e2f9d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:21.766225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67bcaee1-b8b5-41cd-9fae-569181e2f9d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:21.768621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67bcaee1-b8b5-41cd-9fae-569181e2f9d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:21.771191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67bcaee1-b8b5-41cd-9fae-569181e2f9d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:21.773554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67bcaee1-b8b5-41cd-9fae-569181e2f9d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:21.774239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67bcaee1-b8b5-41cd-9fae-569181e2f9d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:21.852626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67bcaee1-b8b5-41cd-9fae-569181e2f9d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:21.860314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67bcaee1-b8b5-41cd-9fae-569181e2f9d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:21.862092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67bcaee1-b8b5-41cd-9fae-569181e2f9d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:21.889279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67bcaee1-b8b5-41cd-9fae-569181e2f9d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:21.890130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67bcaee1-b8b5-41cd-9fae-569181e2f9d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:21.891076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67bcaee1-b8b5-41cd-9fae-569181e2f9d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:21.933742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-67bcaee1-b8b5-41cd-9fae-569181e2f9d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lazy-loading 'flavor' on Instance uuid 5881f190-248d-4ff8-9a2b-42ff42625f92 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:41:21.958795 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-67bcaee1-b8b5-41cd-9fae-569181e2f9d8 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "PUT /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags/tempest-tag-761233045" status: 201 len: 0 microversion: 2.26 time: 0.262299 Oct 10 23:41:21.961343 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2468/4771] 10.222.0.23 () {62 vars in 1377 bytes} [Mon Oct 10 23:41:21 2022] PUT /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags/tempest-tag-761233045 => generated 0 bytes in 266 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 10 23:41:21.971645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-74e08929-6c7d-4afe-9b7c-f6cbf5ef0c71 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '.version_select at 0x7f662a4f1c10>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:21.991078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74e08929-6c7d-4afe-9b7c-f6cbf5ef0c71 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:21.992144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74e08929-6c7d-4afe-9b7c-f6cbf5ef0c71 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:21.993013 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74e08929-6c7d-4afe-9b7c-f6cbf5ef0c71 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:22.021783 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-74e08929-6c7d-4afe-9b7c-f6cbf5ef0c71 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags/tempest-tag-761233045" status: 204 len: 0 microversion: 2.26 time: 0.054327 Oct 10 23:41:22.025730 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2304/4772] 10.222.0.23 () {60 vars in 1358 bytes} [Mon Oct 10 23:41:21 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags/tempest-tag-761233045 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:41:22.035298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d5dc157a-a0cb-4e40-95a5-f1a0eccd123e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '.version_select at 0x7f662ae87160>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:22.054490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5dc157a-a0cb-4e40-95a5-f1a0eccd123e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:22.055511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5dc157a-a0cb-4e40-95a5-f1a0eccd123e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:22.055978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5dc157a-a0cb-4e40-95a5-f1a0eccd123e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:22.056545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d5dc157a-a0cb-4e40-95a5-f1a0eccd123e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:22.079118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5dc157a-a0cb-4e40-95a5-f1a0eccd123e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:22.079914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5dc157a-a0cb-4e40-95a5-f1a0eccd123e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:22.080642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5dc157a-a0cb-4e40-95a5-f1a0eccd123e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:22.081658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5dc157a-a0cb-4e40-95a5-f1a0eccd123e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:22.082366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5dc157a-a0cb-4e40-95a5-f1a0eccd123e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:22.083037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5dc157a-a0cb-4e40-95a5-f1a0eccd123e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:22.128887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5dc157a-a0cb-4e40-95a5-f1a0eccd123e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:22.133192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5dc157a-a0cb-4e40-95a5-f1a0eccd123e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:22.134519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5dc157a-a0cb-4e40-95a5-f1a0eccd123e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:22.170030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-d5dc157a-a0cb-4e40-95a5-f1a0eccd123e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lazy-loading 'flavor' on Instance uuid 5881f190-248d-4ff8-9a2b-42ff42625f92 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:41:22.216742 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d5dc157a-a0cb-4e40-95a5-f1a0eccd123e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags" status: 204 len: 0 microversion: 2.26 time: 0.186584 Oct 10 23:41:22.219951 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2469/4773] 10.222.0.23 () {60 vars in 1295 bytes} [Mon Oct 10 23:41:22 2022] DELETE /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:41:22.231805 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-586b22b0-92fd-466e-aee0-c0b83df9db08 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '.version_select at 0x7f662a4f1940>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:22.251671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-586b22b0-92fd-466e-aee0-c0b83df9db08 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:22.259362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-586b22b0-92fd-466e-aee0-c0b83df9db08 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:22.265540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-586b22b0-92fd-466e-aee0-c0b83df9db08 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:22.303330 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-586b22b0-92fd-466e-aee0-c0b83df9db08 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags" status: 200 len: 12 microversion: 2.26 time: 0.075232 Oct 10 23:41:22.304748 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2305/4774] 10.222.0.23 () {60 vars in 1292 bytes} [Mon Oct 10 23:41:22 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags => generated 12 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:22.316683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7b051693-e5c6-406d-82b5-eab8f34dc46f tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '.version_select at 0x7f6633b0f1f0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:22.364652 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9e2b78d5-0c66-4492-a4dd-0f5a4391e482 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1094122757", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "17157a6b-ea9d-4593-b208-9ce16ed44768"}], "security_groups": [{"name": "tempest-securitygroup--716353696"}], "key_name": "tempest-keypair-1136214815", "user_data": "}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:41:22.385132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b051693-e5c6-406d-82b5-eab8f34dc46f tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:22.385594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b051693-e5c6-406d-82b5-eab8f34dc46f tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:22.386042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b051693-e5c6-406d-82b5-eab8f34dc46f tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:22.391763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7b051693-e5c6-406d-82b5-eab8f34dc46f tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:22.422782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b051693-e5c6-406d-82b5-eab8f34dc46f tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:22.429478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b051693-e5c6-406d-82b5-eab8f34dc46f tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:22.429959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b051693-e5c6-406d-82b5-eab8f34dc46f tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:22.430723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b051693-e5c6-406d-82b5-eab8f34dc46f tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:22.435674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b051693-e5c6-406d-82b5-eab8f34dc46f tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:22.436160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b051693-e5c6-406d-82b5-eab8f34dc46f tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:22.576405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b051693-e5c6-406d-82b5-eab8f34dc46f tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:22.576919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b051693-e5c6-406d-82b5-eab8f34dc46f tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:22.578105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b051693-e5c6-406d-82b5-eab8f34dc46f tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:22.605910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b051693-e5c6-406d-82b5-eab8f34dc46f tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:22.606587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b051693-e5c6-406d-82b5-eab8f34dc46f tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:22.606840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b051693-e5c6-406d-82b5-eab8f34dc46f tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:22.660656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-7b051693-e5c6-406d-82b5-eab8f34dc46f tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lazy-loading 'flavor' on Instance uuid 5881f190-248d-4ff8-9a2b-42ff42625f92 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:41:22.695436 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7b051693-e5c6-406d-82b5-eab8f34dc46f tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "PUT /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags/tempest-tag-1832341802" status: 201 len: 0 microversion: 2.26 time: 0.384219 Oct 10 23:41:22.700816 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2470/4775] 10.222.0.23 () {62 vars in 1380 bytes} [Mon Oct 10 23:41:22 2022] PUT /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags/tempest-tag-1832341802 => generated 0 bytes in 386 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 10 23:41:22.720364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-549a49ff-23b2-4a90-813b-488bce530e31 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '.version_select at 0x7f6633bcb5e0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:22.739835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-549a49ff-23b2-4a90-813b-488bce530e31 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:22.741003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-549a49ff-23b2-4a90-813b-488bce530e31 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:22.741731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-549a49ff-23b2-4a90-813b-488bce530e31 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:22.762607 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-549a49ff-23b2-4a90-813b-488bce530e31 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags" status: 200 len: 36 microversion: 2.26 time: 0.058342 Oct 10 23:41:22.766120 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2471/4776] 10.222.0.23 () {60 vars in 1292 bytes} [Mon Oct 10 23:41:22 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags => generated 36 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:41:22.788136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a35304bd-e649-4082-bfb3-611133226b18 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '.version_select at 0x7f6633b0f3a0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:22.798703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a35304bd-e649-4082-bfb3-611133226b18 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:22.799471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a35304bd-e649-4082-bfb3-611133226b18 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:22.800437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a35304bd-e649-4082-bfb3-611133226b18 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:22.801100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a35304bd-e649-4082-bfb3-611133226b18 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:22.808738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a35304bd-e649-4082-bfb3-611133226b18 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:22.809234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a35304bd-e649-4082-bfb3-611133226b18 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:22.809876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a35304bd-e649-4082-bfb3-611133226b18 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:22.811719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a35304bd-e649-4082-bfb3-611133226b18 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:22.812361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a35304bd-e649-4082-bfb3-611133226b18 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:22.813682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a35304bd-e649-4082-bfb3-611133226b18 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:22.945259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a35304bd-e649-4082-bfb3-611133226b18 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:22.950284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a35304bd-e649-4082-bfb3-611133226b18 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:22.959353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a35304bd-e649-4082-bfb3-611133226b18 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:23.061097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-a35304bd-e649-4082-bfb3-611133226b18 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lazy-loading 'flavor' on Instance uuid 5881f190-248d-4ff8-9a2b-42ff42625f92 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:41:23.099982 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a35304bd-e649-4082-bfb3-611133226b18 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags/tempest-tag-1832341802" status: 204 len: 0 microversion: 2.26 time: 0.322797 Oct 10 23:41:23.102709 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2472/4777] 10.222.0.23 () {60 vars in 1364 bytes} [Mon Oct 10 23:41:22 2022] DELETE /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags/tempest-tag-1832341802 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 10 23:41:23.117018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0434ff52-7802-4296-bc2b-3a7489c6dbbc tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '.version_select at 0x7f662ae879d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:23.140110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0434ff52-7802-4296-bc2b-3a7489c6dbbc tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:23.142018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0434ff52-7802-4296-bc2b-3a7489c6dbbc tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:23.144575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0434ff52-7802-4296-bc2b-3a7489c6dbbc tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:23.172106 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0434ff52-7802-4296-bc2b-3a7489c6dbbc tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags" status: 200 len: 12 microversion: 2.26 time: 0.062537 Oct 10 23:41:23.179824 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2473/4778] 10.222.0.23 () {60 vars in 1292 bytes} [Mon Oct 10 23:41:23 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags => generated 12 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:23.191873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-9e2b78d5-0c66-4492-a4dd-0f5a4391e482 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] validate_networks() for [('17157a6b-ea9d-4593-b208-9ce16ed44768', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:41:23.203265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-032a38ad-6c82-4562-869e-10268abc907c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '.version_select at 0x7f6633b0f4c0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:23.229995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-032a38ad-6c82-4562-869e-10268abc907c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:23.230886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-032a38ad-6c82-4562-869e-10268abc907c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:23.231792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-032a38ad-6c82-4562-869e-10268abc907c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:23.232028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-032a38ad-6c82-4562-869e-10268abc907c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:23.253935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-032a38ad-6c82-4562-869e-10268abc907c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:23.257104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-032a38ad-6c82-4562-869e-10268abc907c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:23.257872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-032a38ad-6c82-4562-869e-10268abc907c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:23.258456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-032a38ad-6c82-4562-869e-10268abc907c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:23.258928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-032a38ad-6c82-4562-869e-10268abc907c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:23.259363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-032a38ad-6c82-4562-869e-10268abc907c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:23.333713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:41:23.345909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-032a38ad-6c82-4562-869e-10268abc907c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:23.346427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-032a38ad-6c82-4562-869e-10268abc907c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:23.346879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-032a38ad-6c82-4562-869e-10268abc907c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:23.389134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-032a38ad-6c82-4562-869e-10268abc907c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lazy-loading 'flavor' on Instance uuid 5881f190-248d-4ff8-9a2b-42ff42625f92 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:41:23.434295 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-032a38ad-6c82-4562-869e-10268abc907c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags" status: 204 len: 0 microversion: 2.26 time: 0.245649 Oct 10 23:41:23.434295 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2474/4779] 10.222.0.23 () {60 vars in 1295 bytes} [Mon Oct 10 23:41:23 2022] DELETE /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:41:23.441636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e4665e7c-611f-4417-99f7-f2a183776d06 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '.version_select at 0x7f6633bcbca0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:23.482855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4665e7c-611f-4417-99f7-f2a183776d06 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:23.487372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4665e7c-611f-4417-99f7-f2a183776d06 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:23.487931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4665e7c-611f-4417-99f7-f2a183776d06 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:23.488469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e4665e7c-611f-4417-99f7-f2a183776d06 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:23.507357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4665e7c-611f-4417-99f7-f2a183776d06 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:23.507858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4665e7c-611f-4417-99f7-f2a183776d06 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:23.509720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4665e7c-611f-4417-99f7-f2a183776d06 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:23.510480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4665e7c-611f-4417-99f7-f2a183776d06 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:23.510954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4665e7c-611f-4417-99f7-f2a183776d06 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:23.511390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4665e7c-611f-4417-99f7-f2a183776d06 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:23.612234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4665e7c-611f-4417-99f7-f2a183776d06 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:23.613250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4665e7c-611f-4417-99f7-f2a183776d06 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:23.613985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4665e7c-611f-4417-99f7-f2a183776d06 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:23.627857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4665e7c-611f-4417-99f7-f2a183776d06 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:23.628713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4665e7c-611f-4417-99f7-f2a183776d06 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:23.629422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4665e7c-611f-4417-99f7-f2a183776d06 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:23.669531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-e4665e7c-611f-4417-99f7-f2a183776d06 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lazy-loading 'flavor' on Instance uuid 5881f190-248d-4ff8-9a2b-42ff42625f92 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:41:23.695151 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e4665e7c-611f-4417-99f7-f2a183776d06 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "PUT /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags/tempest-tag-1565138477" status: 201 len: 0 microversion: 2.26 time: 0.258684 Oct 10 23:41:23.696236 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2475/4780] 10.222.0.23 () {62 vars in 1380 bytes} [Mon Oct 10 23:41:23 2022] PUT /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags/tempest-tag-1565138477 => generated 0 bytes in 261 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 10 23:41:23.710945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3f95c911-7583-4016-9d48-a7b13999dfb7 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '.version_select at 0x7f662aca94c0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:23.728380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f95c911-7583-4016-9d48-a7b13999dfb7 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:23.729183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f95c911-7583-4016-9d48-a7b13999dfb7 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:23.731071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f95c911-7583-4016-9d48-a7b13999dfb7 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:23.732911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3f95c911-7583-4016-9d48-a7b13999dfb7 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:23.762868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f95c911-7583-4016-9d48-a7b13999dfb7 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:23.763696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f95c911-7583-4016-9d48-a7b13999dfb7 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:23.764263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f95c911-7583-4016-9d48-a7b13999dfb7 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:23.765255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f95c911-7583-4016-9d48-a7b13999dfb7 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:23.769879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f95c911-7583-4016-9d48-a7b13999dfb7 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:23.771267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f95c911-7583-4016-9d48-a7b13999dfb7 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:23.888745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f95c911-7583-4016-9d48-a7b13999dfb7 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:23.891248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f95c911-7583-4016-9d48-a7b13999dfb7 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:23.893161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f95c911-7583-4016-9d48-a7b13999dfb7 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:23.926226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f95c911-7583-4016-9d48-a7b13999dfb7 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:23.928067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f95c911-7583-4016-9d48-a7b13999dfb7 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:23.929173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f95c911-7583-4016-9d48-a7b13999dfb7 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:23.991119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-3f95c911-7583-4016-9d48-a7b13999dfb7 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lazy-loading 'flavor' on Instance uuid 5881f190-248d-4ff8-9a2b-42ff42625f92 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:41:24.050473 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3f95c911-7583-4016-9d48-a7b13999dfb7 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "PUT /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags/tempest-tag-1965022905" status: 201 len: 0 microversion: 2.26 time: 0.342163 Oct 10 23:41:24.058845 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2476/4781] 10.222.0.23 () {62 vars in 1380 bytes} [Mon Oct 10 23:41:23 2022] PUT /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags/tempest-tag-1965022905 => generated 0 bytes in 354 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 10 23:41:24.072019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-57109674-81c1-4c68-95dc-533f8dcc8257 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '.version_select at 0x7f6633b0f9d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:24.097282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57109674-81c1-4c68-95dc-533f8dcc8257 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:24.097901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57109674-81c1-4c68-95dc-533f8dcc8257 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:24.098574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57109674-81c1-4c68-95dc-533f8dcc8257 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:24.099074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-57109674-81c1-4c68-95dc-533f8dcc8257 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:24.117424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57109674-81c1-4c68-95dc-533f8dcc8257 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:24.118434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57109674-81c1-4c68-95dc-533f8dcc8257 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:24.119252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57109674-81c1-4c68-95dc-533f8dcc8257 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:24.120307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57109674-81c1-4c68-95dc-533f8dcc8257 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:24.120934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57109674-81c1-4c68-95dc-533f8dcc8257 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:24.122278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57109674-81c1-4c68-95dc-533f8dcc8257 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:24.179849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57109674-81c1-4c68-95dc-533f8dcc8257 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:24.181085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57109674-81c1-4c68-95dc-533f8dcc8257 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:24.181831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57109674-81c1-4c68-95dc-533f8dcc8257 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:24.206437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-57109674-81c1-4c68-95dc-533f8dcc8257 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lazy-loading 'flavor' on Instance uuid 5881f190-248d-4ff8-9a2b-42ff42625f92 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:41:24.243139 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-57109674-81c1-4c68-95dc-533f8dcc8257 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags" status: 204 len: 0 microversion: 2.26 time: 0.183013 Oct 10 23:41:24.243841 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2477/4782] 10.222.0.23 () {60 vars in 1295 bytes} [Mon Oct 10 23:41:24 2022] DELETE /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:41:24.254487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9f01d9e9-aa86-4ced-883b-99a430be2935 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '.version_select at 0x7f6633bcb3a0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:24.281280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f01d9e9-aa86-4ced-883b-99a430be2935 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:24.281792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f01d9e9-aa86-4ced-883b-99a430be2935 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:24.282238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f01d9e9-aa86-4ced-883b-99a430be2935 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:24.304657 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9f01d9e9-aa86-4ced-883b-99a430be2935 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags" status: 200 len: 12 microversion: 2.26 time: 0.056276 Oct 10 23:41:24.305353 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2478/4783] 10.222.0.23 () {60 vars in 1292 bytes} [Mon Oct 10 23:41:24 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags => generated 12 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:24.318429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2651aed8-2bc4-4adb-8291-4a19d2c52651 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '.version_select at 0x7f662b4c2790>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:24.343985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2651aed8-2bc4-4adb-8291-4a19d2c52651 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:24.348539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2651aed8-2bc4-4adb-8291-4a19d2c52651 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:24.350723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2651aed8-2bc4-4adb-8291-4a19d2c52651 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:24.351554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2651aed8-2bc4-4adb-8291-4a19d2c52651 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:24.369639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2651aed8-2bc4-4adb-8291-4a19d2c52651 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:24.370684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2651aed8-2bc4-4adb-8291-4a19d2c52651 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:24.371410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2651aed8-2bc4-4adb-8291-4a19d2c52651 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:24.372350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2651aed8-2bc4-4adb-8291-4a19d2c52651 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:24.373011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2651aed8-2bc4-4adb-8291-4a19d2c52651 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:24.373767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2651aed8-2bc4-4adb-8291-4a19d2c52651 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:24.412636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2651aed8-2bc4-4adb-8291-4a19d2c52651 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:24.413111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2651aed8-2bc4-4adb-8291-4a19d2c52651 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:24.413606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2651aed8-2bc4-4adb-8291-4a19d2c52651 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:24.445155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-2651aed8-2bc4-4adb-8291-4a19d2c52651 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lazy-loading 'flavor' on Instance uuid 5881f190-248d-4ff8-9a2b-42ff42625f92 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:41:24.476387 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2651aed8-2bc4-4adb-8291-4a19d2c52651 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags" status: 204 len: 0 microversion: 2.26 time: 0.164786 Oct 10 23:41:24.477477 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2479/4784] 10.222.0.23 () {60 vars in 1295 bytes} [Mon Oct 10 23:41:24 2022] DELETE /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:41:24.495547 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5c8cef83-6ef6-4d20-91cb-8c363f032368 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '.version_select at 0x7f6633b82ca0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:24.516947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c8cef83-6ef6-4d20-91cb-8c363f032368 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:24.517652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c8cef83-6ef6-4d20-91cb-8c363f032368 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:24.518923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c8cef83-6ef6-4d20-91cb-8c363f032368 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:24.519505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5c8cef83-6ef6-4d20-91cb-8c363f032368 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:24.527727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c8cef83-6ef6-4d20-91cb-8c363f032368 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:24.529044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c8cef83-6ef6-4d20-91cb-8c363f032368 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:24.533307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c8cef83-6ef6-4d20-91cb-8c363f032368 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:24.534454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c8cef83-6ef6-4d20-91cb-8c363f032368 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:24.535028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c8cef83-6ef6-4d20-91cb-8c363f032368 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:24.536441 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c8cef83-6ef6-4d20-91cb-8c363f032368 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:24.635948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c8cef83-6ef6-4d20-91cb-8c363f032368 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:24.640508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c8cef83-6ef6-4d20-91cb-8c363f032368 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:24.644925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c8cef83-6ef6-4d20-91cb-8c363f032368 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:24.681272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c8cef83-6ef6-4d20-91cb-8c363f032368 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:24.682030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c8cef83-6ef6-4d20-91cb-8c363f032368 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:24.682285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c8cef83-6ef6-4d20-91cb-8c363f032368 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:24.761422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-5c8cef83-6ef6-4d20-91cb-8c363f032368 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lazy-loading 'flavor' on Instance uuid 5881f190-248d-4ff8-9a2b-42ff42625f92 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:41:24.834126 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5c8cef83-6ef6-4d20-91cb-8c363f032368 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "PUT /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags/tempest-tag-684976587" status: 201 len: 0 microversion: 2.26 time: 0.350549 Oct 10 23:41:24.835255 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2480/4785] 10.222.0.23 () {62 vars in 1377 bytes} [Mon Oct 10 23:41:24 2022] PUT /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags/tempest-tag-684976587 => generated 0 bytes in 353 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 10 23:41:24.853674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cae0470a-7104-4ae1-b46c-7bb39f1e0849 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '.version_select at 0x7f6633b73700>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:24.887574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cae0470a-7104-4ae1-b46c-7bb39f1e0849 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:24.888081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cae0470a-7104-4ae1-b46c-7bb39f1e0849 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:24.888958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cae0470a-7104-4ae1-b46c-7bb39f1e0849 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:24.894522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cae0470a-7104-4ae1-b46c-7bb39f1e0849 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:24.925895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cae0470a-7104-4ae1-b46c-7bb39f1e0849 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:24.926684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cae0470a-7104-4ae1-b46c-7bb39f1e0849 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:24.926918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cae0470a-7104-4ae1-b46c-7bb39f1e0849 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:24.927879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cae0470a-7104-4ae1-b46c-7bb39f1e0849 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:24.928356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cae0470a-7104-4ae1-b46c-7bb39f1e0849 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:24.928907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cae0470a-7104-4ae1-b46c-7bb39f1e0849 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:25.013584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cae0470a-7104-4ae1-b46c-7bb39f1e0849 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:25.014261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cae0470a-7104-4ae1-b46c-7bb39f1e0849 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:25.015450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cae0470a-7104-4ae1-b46c-7bb39f1e0849 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:25.027007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cae0470a-7104-4ae1-b46c-7bb39f1e0849 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:25.028052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cae0470a-7104-4ae1-b46c-7bb39f1e0849 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:25.028726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cae0470a-7104-4ae1-b46c-7bb39f1e0849 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:25.078569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-cae0470a-7104-4ae1-b46c-7bb39f1e0849 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lazy-loading 'flavor' on Instance uuid 5881f190-248d-4ff8-9a2b-42ff42625f92 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:41:25.118910 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cae0470a-7104-4ae1-b46c-7bb39f1e0849 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "PUT /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags/tempest-tag-1291408354" status: 201 len: 0 microversion: 2.26 time: 0.276345 Oct 10 23:41:25.127013 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2481/4786] 10.222.0.23 () {62 vars in 1380 bytes} [Mon Oct 10 23:41:24 2022] PUT /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags/tempest-tag-1291408354 => generated 0 bytes in 281 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 10 23:41:25.135649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1989b5f3-3511-4033-a413-71f88638deba tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Action: 'update_all', calling method: .version_select at 0x7f6633b0fdc0>, body: {"tags": ["tempest-tag-1307799769", "tempest-tag-1917017638"]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:41:25.182537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1989b5f3-3511-4033-a413-71f88638deba tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:25.188089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1989b5f3-3511-4033-a413-71f88638deba tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:25.191347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1989b5f3-3511-4033-a413-71f88638deba tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:25.194148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1989b5f3-3511-4033-a413-71f88638deba tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:25.220175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1989b5f3-3511-4033-a413-71f88638deba tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:25.222895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1989b5f3-3511-4033-a413-71f88638deba tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:25.227012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1989b5f3-3511-4033-a413-71f88638deba tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:25.229532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1989b5f3-3511-4033-a413-71f88638deba tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:25.232275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1989b5f3-3511-4033-a413-71f88638deba tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:25.232733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1989b5f3-3511-4033-a413-71f88638deba tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:25.319623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=85,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=4,nova_cell1:INSERT=4,nova_cell1:RELEASE=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:41:25.329194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1989b5f3-3511-4033-a413-71f88638deba tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:25.329756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1989b5f3-3511-4033-a413-71f88638deba tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:25.330210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1989b5f3-3511-4033-a413-71f88638deba tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:25.414479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-1989b5f3-3511-4033-a413-71f88638deba tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lazy-loading 'flavor' on Instance uuid 5881f190-248d-4ff8-9a2b-42ff42625f92 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:41:25.491282 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1989b5f3-3511-4033-a413-71f88638deba tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "PUT /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags" status: 200 len: 62 microversion: 2.26 time: 0.362692 Oct 10 23:41:25.499517 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2482/4787] 10.222.0.23 () {62 vars in 1312 bytes} [Mon Oct 10 23:41:25 2022] PUT /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags => generated 62 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:25.516728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-eefa6af8-1d4e-4280-9758-e9c4deff5e45 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '.version_select at 0x7f6633b82670>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:25.537296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eefa6af8-1d4e-4280-9758-e9c4deff5e45 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:25.537296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eefa6af8-1d4e-4280-9758-e9c4deff5e45 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:25.537296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eefa6af8-1d4e-4280-9758-e9c4deff5e45 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:25.562139 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-eefa6af8-1d4e-4280-9758-e9c4deff5e45 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags" status: 200 len: 62 microversion: 2.26 time: 0.051355 Oct 10 23:41:25.562887 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2483/4788] 10.222.0.23 () {60 vars in 1292 bytes} [Mon Oct 10 23:41:25 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags => generated 62 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:25.584771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ebed2c05-07df-4368-9acf-ba89681250e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '.version_select at 0x7f6633bb6dc0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:25.620263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebed2c05-07df-4368-9acf-ba89681250e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:25.625309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebed2c05-07df-4368-9acf-ba89681250e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:25.625699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebed2c05-07df-4368-9acf-ba89681250e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:25.626277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ebed2c05-07df-4368-9acf-ba89681250e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:25.643869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebed2c05-07df-4368-9acf-ba89681250e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:25.644399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebed2c05-07df-4368-9acf-ba89681250e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:25.644839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebed2c05-07df-4368-9acf-ba89681250e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:25.645613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebed2c05-07df-4368-9acf-ba89681250e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:25.646076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebed2c05-07df-4368-9acf-ba89681250e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:25.646492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebed2c05-07df-4368-9acf-ba89681250e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:25.712959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebed2c05-07df-4368-9acf-ba89681250e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:25.726220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebed2c05-07df-4368-9acf-ba89681250e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:25.726220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebed2c05-07df-4368-9acf-ba89681250e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:25.735894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-9e2b78d5-0c66-4492-a4dd-0f5a4391e482 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:41:25.741983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-9e2b78d5-0c66-4492-a4dd-0f5a4391e482 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:41:25.745949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-9e2b78d5-0c66-4492-a4dd-0f5a4391e482 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:41:25.747513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-9e2b78d5-0c66-4492-a4dd-0f5a4391e482 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:41:25.748301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-9e2b78d5-0c66-4492-a4dd-0f5a4391e482 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:41:25.753706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-ebed2c05-07df-4368-9acf-ba89681250e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lazy-loading 'flavor' on Instance uuid 5881f190-248d-4ff8-9a2b-42ff42625f92 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:41:25.785873 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ebed2c05-07df-4368-9acf-ba89681250e9 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags" status: 204 len: 0 microversion: 2.26 time: 0.215403 Oct 10 23:41:25.787081 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2484/4789] 10.222.0.23 () {60 vars in 1295 bytes} [Mon Oct 10 23:41:25 2022] DELETE /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92/tags => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 10 23:41:25.789895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e2b78d5-0c66-4492-a4dd-0f5a4391e482 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:25.793828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e2b78d5-0c66-4492-a4dd-0f5a4391e482 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:25.795408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e2b78d5-0c66-4492-a4dd-0f5a4391e482 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:25.797991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-df7db5eb-a55e-4a9e-9ca1-a84e3fc11889 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:25.803734 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e2b78d5-0c66-4492-a4dd-0f5a4391e482 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:25.804203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e2b78d5-0c66-4492-a4dd-0f5a4391e482 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:25.805098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-df7db5eb-a55e-4a9e-9ca1-a84e3fc11889 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:25.810729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e2b78d5-0c66-4492-a4dd-0f5a4391e482 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:25.822494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df7db5eb-a55e-4a9e-9ca1-a84e3fc11889 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:25.823363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df7db5eb-a55e-4a9e-9ca1-a84e3fc11889 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:25.824046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df7db5eb-a55e-4a9e-9ca1-a84e3fc11889 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:25.825831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df7db5eb-a55e-4a9e-9ca1-a84e3fc11889 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:25.831421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df7db5eb-a55e-4a9e-9ca1-a84e3fc11889 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:25.833324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df7db5eb-a55e-4a9e-9ca1-a84e3fc11889 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:25.889056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-9e2b78d5-0c66-4492-a4dd-0f5a4391e482 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Getting quotas for project f798f5f5321f40b89fc5bacc3b9389fe. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:41:25.901977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-df7db5eb-a55e-4a9e-9ca1-a84e3fc11889 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:41:25.910890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-9e2b78d5-0c66-4492-a4dd-0f5a4391e482 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Getting quotas for user cfd8618ee1864d1d86de2def024b49bb and project f798f5f5321f40b89fc5bacc3b9389fe. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:41:25.950081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9e2b78d5-0c66-4492-a4dd-0f5a4391e482 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:41:25.953421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9e2b78d5-0c66-4492-a4dd-0f5a4391e482 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:41:26.053037 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9e2b78d5-0c66-4492-a4dd-0f5a4391e482 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.723098 Oct 10 23:41:26.053516 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2306/4790] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:41:22 2022] POST /compute/v2.1/servers => generated 408 bytes in 3726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 23:41:26.064701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2acf72d0-1bce-4b9d-9d4c-61fc4d59997a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:26.065745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2acf72d0-1bce-4b9d-9d4c-61fc4d59997a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:26.158122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:41:26.192599 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-df7db5eb-a55e-4a9e-9ca1-a84e3fc11889 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92" status: 204 len: 0 microversion: 2.26 time: 0.399484 Oct 10 23:41:26.198359 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2485/4791] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:41:25 2022] DELETE /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 10 23:41:26.225739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ea70ff15-9f59-4bcb-a3b0-ef0427559a78 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:26.229724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ea70ff15-9f59-4bcb-a3b0-ef0427559a78 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:26.253393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea70ff15-9f59-4bcb-a3b0-ef0427559a78 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:26.253896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea70ff15-9f59-4bcb-a3b0-ef0427559a78 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:26.254342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea70ff15-9f59-4bcb-a3b0-ef0427559a78 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:26.259829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea70ff15-9f59-4bcb-a3b0-ef0427559a78 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:26.260325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea70ff15-9f59-4bcb-a3b0-ef0427559a78 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:26.260773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea70ff15-9f59-4bcb-a3b0-ef0427559a78 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:26.430620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2acf72d0-1bce-4b9d-9d4c-61fc4d59997a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:26.444544 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2acf72d0-1bce-4b9d-9d4c-61fc4d59997a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1239 microversion: 2.1 time: 0.383690 Oct 10 23:41:26.450032 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2307/4792] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:26 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1239 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:41:26.667205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ea70ff15-9f59-4bcb-a3b0-ef0427559a78 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:26.690105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ea70ff15-9f59-4bcb-a3b0-ef0427559a78 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:26.693781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ea70ff15-9f59-4bcb-a3b0-ef0427559a78 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:26.700549 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ea70ff15-9f59-4bcb-a3b0-ef0427559a78 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92" status: 200 len: 1551 microversion: 2.26 time: 0.494643 Oct 10 23:41:26.701805 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2486/4793] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:41:26 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 => generated 1551 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:41:27.478053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-59685b79-d103-4639-bf9c-f9826f208660 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:27.479449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-59685b79-d103-4639-bf9c-f9826f208660 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:27.499472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59685b79-d103-4639-bf9c-f9826f208660 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:27.500154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59685b79-d103-4639-bf9c-f9826f208660 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:27.500763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59685b79-d103-4639-bf9c-f9826f208660 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:27.511887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59685b79-d103-4639-bf9c-f9826f208660 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:27.512955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59685b79-d103-4639-bf9c-f9826f208660 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:27.515777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59685b79-d103-4639-bf9c-f9826f208660 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:27.742270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ce63ffa9-6ff1-43ed-97e8-6a4a685fde4e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:27.743293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ce63ffa9-6ff1-43ed-97e8-6a4a685fde4e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:27.765406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce63ffa9-6ff1-43ed-97e8-6a4a685fde4e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:27.766032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce63ffa9-6ff1-43ed-97e8-6a4a685fde4e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:27.766491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce63ffa9-6ff1-43ed-97e8-6a4a685fde4e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:27.770808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce63ffa9-6ff1-43ed-97e8-6a4a685fde4e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:27.776454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce63ffa9-6ff1-43ed-97e8-6a4a685fde4e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:27.780948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce63ffa9-6ff1-43ed-97e8-6a4a685fde4e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:27.850898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-59685b79-d103-4639-bf9c-f9826f208660 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:27.866562 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-59685b79-d103-4639-bf9c-f9826f208660 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1235 microversion: 2.1 time: 0.392655 Oct 10 23:41:27.895670 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2308/4794] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:27 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1235 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:28.089156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ce63ffa9-6ff1-43ed-97e8-6a4a685fde4e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:28.109535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ce63ffa9-6ff1-43ed-97e8-6a4a685fde4e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:28.113622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ce63ffa9-6ff1-43ed-97e8-6a4a685fde4e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:28.115541 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ce63ffa9-6ff1-43ed-97e8-6a4a685fde4e tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92" status: 200 len: 1551 microversion: 2.26 time: 0.382667 Oct 10 23:41:28.116122 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2487/4795] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:41:27 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 => generated 1551 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:41:28.926779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8842283d-ad48-41e5-8012-4194d420ada8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:28.929347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8842283d-ad48-41e5-8012-4194d420ada8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:28.984869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8842283d-ad48-41e5-8012-4194d420ada8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:28.985407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8842283d-ad48-41e5-8012-4194d420ada8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:28.986316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8842283d-ad48-41e5-8012-4194d420ada8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:28.986597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8842283d-ad48-41e5-8012-4194d420ada8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:29.000891 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8842283d-ad48-41e5-8012-4194d420ada8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:29.001906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8842283d-ad48-41e5-8012-4194d420ada8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:29.147637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0915b4a7-002e-48c1-91d0-20a0dd3ab07c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:29.148778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0915b4a7-002e-48c1-91d0-20a0dd3ab07c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:29.180022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0915b4a7-002e-48c1-91d0-20a0dd3ab07c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:29.180529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0915b4a7-002e-48c1-91d0-20a0dd3ab07c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:29.181239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0915b4a7-002e-48c1-91d0-20a0dd3ab07c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:29.185953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0915b4a7-002e-48c1-91d0-20a0dd3ab07c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:29.186520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0915b4a7-002e-48c1-91d0-20a0dd3ab07c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:29.186983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0915b4a7-002e-48c1-91d0-20a0dd3ab07c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:29.278100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8842283d-ad48-41e5-8012-4194d420ada8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:29.301408 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8842283d-ad48-41e5-8012-4194d420ada8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1297 microversion: 2.1 time: 0.391840 Oct 10 23:41:29.318593 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2309/4796] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:28 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1297 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:29.860228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0915b4a7-002e-48c1-91d0-20a0dd3ab07c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:29.878908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0915b4a7-002e-48c1-91d0-20a0dd3ab07c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:29.881516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0915b4a7-002e-48c1-91d0-20a0dd3ab07c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:29.882825 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0915b4a7-002e-48c1-91d0-20a0dd3ab07c tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92" status: 200 len: 1551 microversion: 2.26 time: 0.742115 Oct 10 23:41:29.887111 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2488/4797] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:41:29 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 => generated 1551 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:41:29.961211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-5198d26e-35af-4f08-95e9-cf06d1d3df24 req-9ed579ab-d624-477f-a34e-2485251b7351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5881f190-248d-4ff8-9a2b-42ff42625f92", "name": "network-vif-deleted", "tag": "86b384d4-6193-46d1-ba48-a32119e2046c"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:41:30.014959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5198d26e-35af-4f08-95e9-cf06d1d3df24 req-9ed579ab-d624-477f-a34e-2485251b7351 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:30.018792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5198d26e-35af-4f08-95e9-cf06d1d3df24 req-9ed579ab-d624-477f-a34e-2485251b7351 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:30.019525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5198d26e-35af-4f08-95e9-cf06d1d3df24 req-9ed579ab-d624-477f-a34e-2485251b7351 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:30.079682 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-5198d26e-35af-4f08-95e9-cf06d1d3df24 req-9ed579ab-d624-477f-a34e-2485251b7351 service nova] Creating event network-vif-deleted:86b384d4-6193-46d1-ba48-a32119e2046c for instance 5881f190-248d-4ff8-9a2b-42ff42625f92 on n-h1-860864-2 Oct 10 23:41:30.105411 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-5198d26e-35af-4f08-95e9-cf06d1d3df24 req-9ed579ab-d624-477f-a34e-2485251b7351 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149548 Oct 10 23:41:30.106096 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2310/4798] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:41:30.330187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-40e9612d-cf0f-423f-98bc-d6ac5af63fb4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:30.331225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-40e9612d-cf0f-423f-98bc-d6ac5af63fb4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:30.375234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40e9612d-cf0f-423f-98bc-d6ac5af63fb4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:30.375831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40e9612d-cf0f-423f-98bc-d6ac5af63fb4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:30.376263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40e9612d-cf0f-423f-98bc-d6ac5af63fb4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:30.380772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40e9612d-cf0f-423f-98bc-d6ac5af63fb4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:30.385263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40e9612d-cf0f-423f-98bc-d6ac5af63fb4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:30.385813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40e9612d-cf0f-423f-98bc-d6ac5af63fb4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:30.611851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-40e9612d-cf0f-423f-98bc-d6ac5af63fb4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:30.648860 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-40e9612d-cf0f-423f-98bc-d6ac5af63fb4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1297 microversion: 2.1 time: 0.317289 Oct 10 23:41:30.650088 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2489/4799] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:30 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1297 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:30.922509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-46e033a5-48b6-4b20-84c0-696722787882 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:30.923534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-46e033a5-48b6-4b20-84c0-696722787882 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:30.937084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46e033a5-48b6-4b20-84c0-696722787882 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:30.937623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46e033a5-48b6-4b20-84c0-696722787882 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:30.938073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46e033a5-48b6-4b20-84c0-696722787882 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:30.938829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46e033a5-48b6-4b20-84c0-696722787882 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:30.949948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46e033a5-48b6-4b20-84c0-696722787882 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:30.950443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46e033a5-48b6-4b20-84c0-696722787882 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:31.114037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46e033a5-48b6-4b20-84c0-696722787882 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:31.114927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46e033a5-48b6-4b20-84c0-696722787882 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:31.118141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46e033a5-48b6-4b20-84c0-696722787882 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:31.119231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-46e033a5-48b6-4b20-84c0-696722787882 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lazy-loading 'fault' on Instance uuid 5881f190-248d-4ff8-9a2b-42ff42625f92 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:41:31.358917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-46e033a5-48b6-4b20-84c0-696722787882 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:31.374412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-46e033a5-48b6-4b20-84c0-696722787882 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:31.376934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-46e033a5-48b6-4b20-84c0-696722787882 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f85593306d444a17aab3416165b72bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7184ac4c159435a8588308d72195f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:31.380985 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-46e033a5-48b6-4b20-84c0-696722787882 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92" status: 200 len: 1352 microversion: 2.26 time: 0.464319 Oct 10 23:41:31.382132 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2311/4800] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:41:30 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 => generated 1352 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:41:31.678806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3278d932-c22b-4809-ada0-3f436ceeddd9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:31.679486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3278d932-c22b-4809-ada0-3f436ceeddd9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:31.701887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3278d932-c22b-4809-ada0-3f436ceeddd9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:31.704105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3278d932-c22b-4809-ada0-3f436ceeddd9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:31.704567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3278d932-c22b-4809-ada0-3f436ceeddd9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:31.711249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3278d932-c22b-4809-ada0-3f436ceeddd9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:31.711813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3278d932-c22b-4809-ada0-3f436ceeddd9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:31.712560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3278d932-c22b-4809-ada0-3f436ceeddd9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:32.410821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e54f9545-810c-4b83-8970-9f5d643caf46 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:32.412041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e54f9545-810c-4b83-8970-9f5d643caf46 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] [instance: 5881f190-248d-4ff8-9a2b-42ff42625f92] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:32.428273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e54f9545-810c-4b83-8970-9f5d643caf46 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:32.430850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e54f9545-810c-4b83-8970-9f5d643caf46 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:32.431580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e54f9545-810c-4b83-8970-9f5d643caf46 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:32.432565 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e54f9545-810c-4b83-8970-9f5d643caf46 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:32.434960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e54f9545-810c-4b83-8970-9f5d643caf46 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:32.436623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e54f9545-810c-4b83-8970-9f5d643caf46 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:32.485150 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-e54f9545-810c-4b83-8970-9f5d643caf46 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] HTTP exception thrown: Instance 5881f190-248d-4ff8-9a2b-42ff42625f92 could not be found. Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e54f9545-810c-4b83-8970-9f5d643caf46 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Request method failure captured: Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 HTTP/1.1 Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK2BE3eI6G4vO0i7HLQmCsoqhehpJ2dP2jK25rBhoYGq3CRGdLM973z9zbijUlFNac5QbU0gk8mv_hRRw7pGst-N-fIAJeseikPhDNHSEx9mxEdMUNNjSede-zExRzjtC_V2EjOyGH3gdhk3CGcd324cuO-BcjN7lyB7F4pdyRSdMAs Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: X-Openstack-Nova-Api-Version: 2.26 Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: c7184ac4c159435a8588308d72195f94 Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerTagsTestJSON-825971803 Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c7184ac4c159435a8588308d72195f94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7184ac4c159435a8588308d72195f94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7184ac4c159435a8588308d72195f94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c7184ac4c159435a8588308d72195f94", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerTagsTestJSON-825971803 Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: c7184ac4c159435a8588308d72195f94 Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerTagsTestJSON-825971803 Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerTagsTestJSON-825971803-project Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: f85593306d444a17aab3416165b72bf9 Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerTagsTestJSON-825971803-project Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 5881f190-248d-4ff8-9a2b-42ff42625f92 could not be found. Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '5881f190-248d-4ff8-9a2b-42ff42625f92'} Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5881f190-248d-4ff8-9a2b-42ff42625f92 could not be found. Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5881f190-248d-4ff8-9a2b-42ff42625f92 could not be found. Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:41:32.489115 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:41:32.495639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:41:32.495639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:41:32.495639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:41:32.495639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:41:32.495639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:41:32.495639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5881f190-248d-4ff8-9a2b-42ff42625f92 could not be found. Oct 10 23:41:32.495639 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:41:32.500055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e54f9545-810c-4b83-8970-9f5d643caf46 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] Returning 404 to user: Instance 5881f190-248d-4ff8-9a2b-42ff42625f92 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:41:32.501886 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e54f9545-810c-4b83-8970-9f5d643caf46 tempest-ServerTagsTestJSON-825971803 tempest-ServerTagsTestJSON-825971803-project] 10.222.0.23 "GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92" status: 404 len: 111 microversion: 2.26 time: 0.097188 Oct 10 23:41:32.508010 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2312/4801] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:41:32 2022] GET /compute/v2.1/servers/5881f190-248d-4ff8-9a2b-42ff42625f92 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 10 23:41:32.535802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3278d932-c22b-4809-ada0-3f436ceeddd9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:32.556322 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3278d932-c22b-4809-ada0-3f436ceeddd9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1364 microversion: 2.1 time: 0.883720 Oct 10 23:41:32.557416 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2490/4802] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:31 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1364 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:33.580901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e19547e6-43ca-4361-ae8e-ee4ae70fbc18 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:33.582416 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e19547e6-43ca-4361-ae8e-ee4ae70fbc18 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:33.596261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e19547e6-43ca-4361-ae8e-ee4ae70fbc18 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:33.597122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e19547e6-43ca-4361-ae8e-ee4ae70fbc18 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:33.600429 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e19547e6-43ca-4361-ae8e-ee4ae70fbc18 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:33.601620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e19547e6-43ca-4361-ae8e-ee4ae70fbc18 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:33.602579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e19547e6-43ca-4361-ae8e-ee4ae70fbc18 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:33.605644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e19547e6-43ca-4361-ae8e-ee4ae70fbc18 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:34.222706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e19547e6-43ca-4361-ae8e-ee4ae70fbc18 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:34.238553 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e19547e6-43ca-4361-ae8e-ee4ae70fbc18 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1364 microversion: 2.1 time: 0.661547 Oct 10 23:41:34.241493 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2313/4803] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:33 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1364 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:34.623568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-2d1f9f41-af18-4aac-9084-79b4e71e1447 req-e34cb532-3b3b-4921-b17d-e4d68f7aad71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88c65eb2-4a59-4b1e-bf11-e2094d984d0a", "tag": "db12b09d-2d47-4f71-9616-ebcc385cf4ab"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:41:34.659411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2d1f9f41-af18-4aac-9084-79b4e71e1447 req-e34cb532-3b3b-4921-b17d-e4d68f7aad71 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:34.660245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2d1f9f41-af18-4aac-9084-79b4e71e1447 req-e34cb532-3b3b-4921-b17d-e4d68f7aad71 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:34.661087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2d1f9f41-af18-4aac-9084-79b4e71e1447 req-e34cb532-3b3b-4921-b17d-e4d68f7aad71 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:34.692561 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-2d1f9f41-af18-4aac-9084-79b4e71e1447 req-e34cb532-3b3b-4921-b17d-e4d68f7aad71 service nova] Creating event network-changed:db12b09d-2d47-4f71-9616-ebcc385cf4ab for instance 88c65eb2-4a59-4b1e-bf11-e2094d984d0a on n-h2-860864-2 Oct 10 23:41:34.698688 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-2d1f9f41-af18-4aac-9084-79b4e71e1447 req-e34cb532-3b3b-4921-b17d-e4d68f7aad71 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079003 Oct 10 23:41:34.700310 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2491/4804] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:41:35.267005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-647aab1d-8680-4fbf-8468-27f83e3a6a89 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:35.267632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-647aab1d-8680-4fbf-8468-27f83e3a6a89 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:35.285915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-647aab1d-8680-4fbf-8468-27f83e3a6a89 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:35.286404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-647aab1d-8680-4fbf-8468-27f83e3a6a89 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:35.286838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-647aab1d-8680-4fbf-8468-27f83e3a6a89 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:35.287545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-647aab1d-8680-4fbf-8468-27f83e3a6a89 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:35.287994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-647aab1d-8680-4fbf-8468-27f83e3a6a89 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:35.288421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-647aab1d-8680-4fbf-8468-27f83e3a6a89 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:35.745763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-647aab1d-8680-4fbf-8468-27f83e3a6a89 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:35.762614 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-647aab1d-8680-4fbf-8468-27f83e3a6a89 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1364 microversion: 2.1 time: 0.500708 Oct 10 23:41:35.763959 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2314/4805] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:35 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1364 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:36.793358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-66115e6c-f0d0-4f19-b362-219068031df1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:36.798164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-66115e6c-f0d0-4f19-b362-219068031df1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:36.826015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66115e6c-f0d0-4f19-b362-219068031df1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:36.826533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66115e6c-f0d0-4f19-b362-219068031df1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:36.827506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66115e6c-f0d0-4f19-b362-219068031df1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:36.842482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66115e6c-f0d0-4f19-b362-219068031df1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:36.843235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66115e6c-f0d0-4f19-b362-219068031df1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:36.843951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66115e6c-f0d0-4f19-b362-219068031df1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:37.856143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-66115e6c-f0d0-4f19-b362-219068031df1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:37.882489 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-66115e6c-f0d0-4f19-b362-219068031df1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1364 microversion: 2.1 time: 1.095282 Oct 10 23:41:37.903550 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2492/4806] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:36 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1364 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:38.921624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-98563ad1-f3ad-4d33-af25-b4cd7e377373 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:38.929617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-98563ad1-f3ad-4d33-af25-b4cd7e377373 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:38.939804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:41:38.968927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=12 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:41:38.991821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f4f1e7b6-d22f-4603-be7c-bd8582bb8798 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:41:39.011855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f4f1e7b6-d22f-4603-be7c-bd8582bb8798 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:39.037407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98563ad1-f3ad-4d33-af25-b4cd7e377373 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:39.043619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98563ad1-f3ad-4d33-af25-b4cd7e377373 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:39.047572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98563ad1-f3ad-4d33-af25-b4cd7e377373 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:39.055354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98563ad1-f3ad-4d33-af25-b4cd7e377373 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:39.058621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98563ad1-f3ad-4d33-af25-b4cd7e377373 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:39.062990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98563ad1-f3ad-4d33-af25-b4cd7e377373 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:39.066989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4f1e7b6-d22f-4603-be7c-bd8582bb8798 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:39.067711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4f1e7b6-d22f-4603-be7c-bd8582bb8798 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:39.068328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4f1e7b6-d22f-4603-be7c-bd8582bb8798 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:39.069212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4f1e7b6-d22f-4603-be7c-bd8582bb8798 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:39.069857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4f1e7b6-d22f-4603-be7c-bd8582bb8798 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:39.070446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4f1e7b6-d22f-4603-be7c-bd8582bb8798 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:39.115828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-f4f1e7b6-d22f-4603-be7c-bd8582bb8798 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lazy-loading 'flavor' on Instance uuid aa7a4001-50e2-4247-a60d-f82367072f61 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:41:39.334817 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f4f1e7b6-d22f-4603-be7c-bd8582bb8798 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "POST /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/action" status: 200 len: 32 microversion: 2.1 time: 0.355121 Oct 10 23:41:39.337797 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2493/4807] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:41:38 2022] POST /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/action => generated 32 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:41:39.351647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4f9e9101-7172-4a85-908a-b31e2d98be0b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:39.352660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4f9e9101-7172-4a85-908a-b31e2d98be0b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:39.384248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f9e9101-7172-4a85-908a-b31e2d98be0b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:39.386145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f9e9101-7172-4a85-908a-b31e2d98be0b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:39.387089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f9e9101-7172-4a85-908a-b31e2d98be0b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:39.414282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f9e9101-7172-4a85-908a-b31e2d98be0b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:39.416097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f9e9101-7172-4a85-908a-b31e2d98be0b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:39.416861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f9e9101-7172-4a85-908a-b31e2d98be0b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:40.727070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4f9e9101-7172-4a85-908a-b31e2d98be0b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:40.747523 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4f9e9101-7172-4a85-908a-b31e2d98be0b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1737 microversion: 2.1 time: 1.401642 Oct 10 23:41:40.748514 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2494/4808] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:39 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1737 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:41:41.093065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-98563ad1-f3ad-4d33-af25-b4cd7e377373 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:41.112674 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-98563ad1-f3ad-4d33-af25-b4cd7e377373 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1364 microversion: 2.1 time: 2.201427 Oct 10 23:41:41.117926 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2315/4809] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:38 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1364 bytes in 2211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:41.775495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-562f230e-4bc7-4956-a8d9-59a79a3e4e82 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:41.776182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-562f230e-4bc7-4956-a8d9-59a79a3e4e82 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:41.794552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-562f230e-4bc7-4956-a8d9-59a79a3e4e82 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:41.795065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-562f230e-4bc7-4956-a8d9-59a79a3e4e82 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:41.795758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-562f230e-4bc7-4956-a8d9-59a79a3e4e82 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:41.796820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-562f230e-4bc7-4956-a8d9-59a79a3e4e82 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:41.797139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-562f230e-4bc7-4956-a8d9-59a79a3e4e82 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:41.805824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-562f230e-4bc7-4956-a8d9-59a79a3e4e82 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:41.893244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=92,nova_cell1:DELETE=2,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:41:42.136582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-23cae9fd-29f6-41e9-b118-e6aeece265ea tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:42.137353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-23cae9fd-29f6-41e9-b118-e6aeece265ea tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:42.156591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23cae9fd-29f6-41e9-b118-e6aeece265ea tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:42.157107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23cae9fd-29f6-41e9-b118-e6aeece265ea tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:42.157587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23cae9fd-29f6-41e9-b118-e6aeece265ea tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:42.158324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23cae9fd-29f6-41e9-b118-e6aeece265ea tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:42.158788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23cae9fd-29f6-41e9-b118-e6aeece265ea tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:42.159219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-23cae9fd-29f6-41e9-b118-e6aeece265ea tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:42.440783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-562f230e-4bc7-4956-a8d9-59a79a3e4e82 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:42.450335 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-562f230e-4bc7-4956-a8d9-59a79a3e4e82 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1737 microversion: 2.1 time: 0.678666 Oct 10 23:41:42.450952 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2495/4810] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:41 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1737 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:42.769487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-846a5a0d-6d6d-45db-91f3-bb84855c116d req-75cbef4f-854d-49d9-9cd6-3e441bb85125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c65eb2-4a59-4b1e-bf11-e2094d984d0a", "name": "network-vif-plugged", "status": "completed", "tag": "db12b09d-2d47-4f71-9616-ebcc385cf4ab"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:41:42.790010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-846a5a0d-6d6d-45db-91f3-bb84855c116d req-75cbef4f-854d-49d9-9cd6-3e441bb85125 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:42.790870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-846a5a0d-6d6d-45db-91f3-bb84855c116d req-75cbef4f-854d-49d9-9cd6-3e441bb85125 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:42.792142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-846a5a0d-6d6d-45db-91f3-bb84855c116d req-75cbef4f-854d-49d9-9cd6-3e441bb85125 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:42.820320 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-846a5a0d-6d6d-45db-91f3-bb84855c116d req-75cbef4f-854d-49d9-9cd6-3e441bb85125 service nova] Creating event network-vif-plugged:db12b09d-2d47-4f71-9616-ebcc385cf4ab for instance 88c65eb2-4a59-4b1e-bf11-e2094d984d0a on n-h2-860864-2 Oct 10 23:41:42.835357 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-846a5a0d-6d6d-45db-91f3-bb84855c116d req-75cbef4f-854d-49d9-9cd6-3e441bb85125 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070497 Oct 10 23:41:42.838583 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2496/4811] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:41:43.490619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7a68c453-da11-4af3-8a69-8e1dfa937057 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:43.491785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7a68c453-da11-4af3-8a69-8e1dfa937057 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:43.508934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a68c453-da11-4af3-8a69-8e1dfa937057 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:43.512308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a68c453-da11-4af3-8a69-8e1dfa937057 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:43.517836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a68c453-da11-4af3-8a69-8e1dfa937057 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:43.520315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a68c453-da11-4af3-8a69-8e1dfa937057 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:43.521067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a68c453-da11-4af3-8a69-8e1dfa937057 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:43.521976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a68c453-da11-4af3-8a69-8e1dfa937057 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:43.700807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-23cae9fd-29f6-41e9-b118-e6aeece265ea tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:43.714406 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-23cae9fd-29f6-41e9-b118-e6aeece265ea tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1364 microversion: 2.1 time: 1.581909 Oct 10 23:41:43.717836 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2316/4812] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:42 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1364 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:41:44.182902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7a68c453-da11-4af3-8a69-8e1dfa937057 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:44.219991 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7a68c453-da11-4af3-8a69-8e1dfa937057 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1737 microversion: 2.1 time: 0.730575 Oct 10 23:41:44.223912 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2497/4813] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:43 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1737 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:41:44.741723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b0e0cef7-7712-4609-8a61-913a53a3e6ee tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:44.742453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b0e0cef7-7712-4609-8a61-913a53a3e6ee tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:44.756596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0e0cef7-7712-4609-8a61-913a53a3e6ee tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:44.766352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0e0cef7-7712-4609-8a61-913a53a3e6ee tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:44.776573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0e0cef7-7712-4609-8a61-913a53a3e6ee tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:44.777952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0e0cef7-7712-4609-8a61-913a53a3e6ee tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:44.779383 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0e0cef7-7712-4609-8a61-913a53a3e6ee tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:44.779908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0e0cef7-7712-4609-8a61-913a53a3e6ee tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:45.249410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d5339435-d273-4aae-9f5a-55af16e1bdbc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:45.250655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d5339435-d273-4aae-9f5a-55af16e1bdbc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:45.286878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5339435-d273-4aae-9f5a-55af16e1bdbc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:45.288191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5339435-d273-4aae-9f5a-55af16e1bdbc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:45.288638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5339435-d273-4aae-9f5a-55af16e1bdbc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:45.289678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5339435-d273-4aae-9f5a-55af16e1bdbc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:45.290318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5339435-d273-4aae-9f5a-55af16e1bdbc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:45.290923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5339435-d273-4aae-9f5a-55af16e1bdbc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:45.389979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b0e0cef7-7712-4609-8a61-913a53a3e6ee tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:45.398826 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b0e0cef7-7712-4609-8a61-913a53a3e6ee tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1364 microversion: 2.1 time: 0.660904 Oct 10 23:41:45.440235 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2317/4814] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:44 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1364 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:46.146703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d5339435-d273-4aae-9f5a-55af16e1bdbc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:46.182769 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d5339435-d273-4aae-9f5a-55af16e1bdbc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1737 microversion: 2.1 time: 0.936523 Oct 10 23:41:46.183629 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2498/4815] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:45 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1737 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:41:46.450841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-31f20f18-309a-4748-b3a9-9ad8766b98a6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:46.453081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-31f20f18-309a-4748-b3a9-9ad8766b98a6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:46.478208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31f20f18-309a-4748-b3a9-9ad8766b98a6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:46.479044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31f20f18-309a-4748-b3a9-9ad8766b98a6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:46.480972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31f20f18-309a-4748-b3a9-9ad8766b98a6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:46.482255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31f20f18-309a-4748-b3a9-9ad8766b98a6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:46.486065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31f20f18-309a-4748-b3a9-9ad8766b98a6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:46.486883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31f20f18-309a-4748-b3a9-9ad8766b98a6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:46.804865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-31f20f18-309a-4748-b3a9-9ad8766b98a6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:46.821834 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-31f20f18-309a-4748-b3a9-9ad8766b98a6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1551 microversion: 2.1 time: 0.375383 Oct 10 23:41:46.828480 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2318/4816] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:46 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1551 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:46.866753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8492f78a-481a-47b0-8e21-6fb6f7a2e1a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:46.868588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8492f78a-481a-47b0-8e21-6fb6f7a2e1a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:46.890182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8492f78a-481a-47b0-8e21-6fb6f7a2e1a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:46.893359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8492f78a-481a-47b0-8e21-6fb6f7a2e1a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:46.895718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8492f78a-481a-47b0-8e21-6fb6f7a2e1a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:46.896836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8492f78a-481a-47b0-8e21-6fb6f7a2e1a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:46.899661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8492f78a-481a-47b0-8e21-6fb6f7a2e1a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:46.901322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8492f78a-481a-47b0-8e21-6fb6f7a2e1a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:47.187065 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8492f78a-481a-47b0-8e21-6fb6f7a2e1a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.334761 Oct 10 23:41:47.187682 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2499/4817] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Oct 10 23:41:46 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/os-interface => generated 285 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:41:47.210376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3b362091-e9f3-46c4-85a4-fe9532dd6438 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:47.211178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3b362091-e9f3-46c4-85a4-fe9532dd6438 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:47.230668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b362091-e9f3-46c4-85a4-fe9532dd6438 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:47.234766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b362091-e9f3-46c4-85a4-fe9532dd6438 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:47.235457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b362091-e9f3-46c4-85a4-fe9532dd6438 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:47.240297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b362091-e9f3-46c4-85a4-fe9532dd6438 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:47.240963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b362091-e9f3-46c4-85a4-fe9532dd6438 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:47.241610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b362091-e9f3-46c4-85a4-fe9532dd6438 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:47.722080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2be457e6-80a9-4425-9fce-b026291dd222 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1379159485", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:41:47.871573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-2be457e6-80a9-4425-9fce-b026291dd222 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] validate_networks() for [('fa0ea560-35bf-4417-8cad-eb62562b3005', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:41:48.034930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3b362091-e9f3-46c4-85a4-fe9532dd6438 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:48.051862 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3b362091-e9f3-46c4-85a4-fe9532dd6438 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1737 microversion: 2.1 time: 0.842652 Oct 10 23:41:48.052838 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2500/4818] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:47 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1737 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:41:48.077670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3b362091-e9f3-46c4-85a4-fe9532dd6438 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:48.079572 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3b362091-e9f3-46c4-85a4-fe9532dd6438 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.010353 Oct 10 23:41:48.088459 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2501/4819] 10.222.0.23 () {56 vars in 886 bytes} [Mon Oct 10 23:41:48 2022] GET /compute/ => generated 377 bytes in 20 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 10 23:41:49.080492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-959aa831-fbf3-4ab0-8efa-f7abfc11b367 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:49.081160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-959aa831-fbf3-4ab0-8efa-f7abfc11b367 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:49.096764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-959aa831-fbf3-4ab0-8efa-f7abfc11b367 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:49.097305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-959aa831-fbf3-4ab0-8efa-f7abfc11b367 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:49.098038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-959aa831-fbf3-4ab0-8efa-f7abfc11b367 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:49.098975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-959aa831-fbf3-4ab0-8efa-f7abfc11b367 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:49.106252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-959aa831-fbf3-4ab0-8efa-f7abfc11b367 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:49.106999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-959aa831-fbf3-4ab0-8efa-f7abfc11b367 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:49.380946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-2be457e6-80a9-4425-9fce-b026291dd222 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:41:49.387408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-2be457e6-80a9-4425-9fce-b026291dd222 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:41:49.388225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-2be457e6-80a9-4425-9fce-b026291dd222 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:41:49.390443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-2be457e6-80a9-4425-9fce-b026291dd222 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:41:49.390959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-2be457e6-80a9-4425-9fce-b026291dd222 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:41:49.417050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2be457e6-80a9-4425-9fce-b026291dd222 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:49.417897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2be457e6-80a9-4425-9fce-b026291dd222 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:49.418449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2be457e6-80a9-4425-9fce-b026291dd222 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:49.421018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2be457e6-80a9-4425-9fce-b026291dd222 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:49.423468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2be457e6-80a9-4425-9fce-b026291dd222 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:49.424108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2be457e6-80a9-4425-9fce-b026291dd222 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:49.474601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-2be457e6-80a9-4425-9fce-b026291dd222 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Getting quotas for project 36ec432047e846409dbced00d713aa71. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:41:49.490472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-2be457e6-80a9-4425-9fce-b026291dd222 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Getting quotas for user 847536250ff1495c91a80222a0307788 and project 36ec432047e846409dbced00d713aa71. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:41:49.524621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2be457e6-80a9-4425-9fce-b026291dd222 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:41:49.530702 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2be457e6-80a9-4425-9fce-b026291dd222 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:41:49.648159 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2be457e6-80a9-4425-9fce-b026291dd222 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.573370 Oct 10 23:41:49.649608 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2319/4820] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:41:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 23:41:49.664904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a27b8c5d-edca-4217-ab1f-c6217c2cb8c5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:49.665616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a27b8c5d-edca-4217-ab1f-c6217c2cb8c5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:49.973991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-959aa831-fbf3-4ab0-8efa-f7abfc11b367 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:49.990992 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-959aa831-fbf3-4ab0-8efa-f7abfc11b367 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1737 microversion: 2.1 time: 0.914661 Oct 10 23:41:49.992362 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2502/4821] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:49 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1737 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:41:50.240495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a27b8c5d-edca-4217-ab1f-c6217c2cb8c5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:50.255263 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a27b8c5d-edca-4217-ab1f-c6217c2cb8c5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1217 microversion: 2.1 time: 0.596685 Oct 10 23:41:50.256912 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2320/4822] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:49 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1217 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:50.795871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-ebbae678-b617-4bc4-8682-a1d9e34c6047 req-69b81ad2-7c9d-4054-abab-622a02899a0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88c65eb2-4a59-4b1e-bf11-e2094d984d0a", "tag": "db12b09d-2d47-4f71-9616-ebcc385cf4ab"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:41:50.831979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ebbae678-b617-4bc4-8682-a1d9e34c6047 req-69b81ad2-7c9d-4054-abab-622a02899a0d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:50.836734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ebbae678-b617-4bc4-8682-a1d9e34c6047 req-69b81ad2-7c9d-4054-abab-622a02899a0d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:50.839643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ebbae678-b617-4bc4-8682-a1d9e34c6047 req-69b81ad2-7c9d-4054-abab-622a02899a0d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:50.901846 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-ebbae678-b617-4bc4-8682-a1d9e34c6047 req-69b81ad2-7c9d-4054-abab-622a02899a0d service nova] Creating event network-changed:db12b09d-2d47-4f71-9616-ebcc385cf4ab for instance 88c65eb2-4a59-4b1e-bf11-e2094d984d0a on n-h2-860864-2 Oct 10 23:41:50.917182 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-ebbae678-b617-4bc4-8682-a1d9e34c6047 req-69b81ad2-7c9d-4054-abab-622a02899a0d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124800 Oct 10 23:41:50.918140 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2503/4823] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:41:51.022558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0a5c52ad-1d2d-4797-90d6-9fff1bea0cbc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:51.023576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0a5c52ad-1d2d-4797-90d6-9fff1bea0cbc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:51.027804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:41:51.058408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a5c52ad-1d2d-4797-90d6-9fff1bea0cbc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:51.062092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a5c52ad-1d2d-4797-90d6-9fff1bea0cbc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:51.062646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a5c52ad-1d2d-4797-90d6-9fff1bea0cbc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:51.069829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a5c52ad-1d2d-4797-90d6-9fff1bea0cbc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:51.079480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a5c52ad-1d2d-4797-90d6-9fff1bea0cbc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:51.080002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a5c52ad-1d2d-4797-90d6-9fff1bea0cbc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:51.288630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-51733b18-36e2-4d3b-807f-6706c6802603 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:51.289691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-51733b18-36e2-4d3b-807f-6706c6802603 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:51.312860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51733b18-36e2-4d3b-807f-6706c6802603 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:51.315803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51733b18-36e2-4d3b-807f-6706c6802603 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:51.316648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51733b18-36e2-4d3b-807f-6706c6802603 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:51.319666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51733b18-36e2-4d3b-807f-6706c6802603 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:51.336959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51733b18-36e2-4d3b-807f-6706c6802603 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:51.337921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51733b18-36e2-4d3b-807f-6706c6802603 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:51.604977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-51733b18-36e2-4d3b-807f-6706c6802603 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:51.614573 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-51733b18-36e2-4d3b-807f-6706c6802603 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1213 microversion: 2.1 time: 0.331617 Oct 10 23:41:51.618602 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2504/4824] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:51 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1213 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:51.778065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0a5c52ad-1d2d-4797-90d6-9fff1bea0cbc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:51.839749 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0a5c52ad-1d2d-4797-90d6-9fff1bea0cbc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1737 microversion: 2.1 time: 0.818220 Oct 10 23:41:51.848285 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2321/4825] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:51 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1737 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:52.654723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-075388c3-f380-4dda-928d-c3e98c4d6822 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:52.655428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-075388c3-f380-4dda-928d-c3e98c4d6822 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:52.671676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-075388c3-f380-4dda-928d-c3e98c4d6822 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:52.673556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-075388c3-f380-4dda-928d-c3e98c4d6822 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:52.675358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-075388c3-f380-4dda-928d-c3e98c4d6822 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:52.676145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-075388c3-f380-4dda-928d-c3e98c4d6822 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:52.678875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-075388c3-f380-4dda-928d-c3e98c4d6822 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:52.679802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-075388c3-f380-4dda-928d-c3e98c4d6822 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:52.875094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c68ea0d4-7c69-46ad-8428-2602d0e1732b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:52.875878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c68ea0d4-7c69-46ad-8428-2602d0e1732b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:52.910597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c68ea0d4-7c69-46ad-8428-2602d0e1732b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:52.916737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c68ea0d4-7c69-46ad-8428-2602d0e1732b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:52.917260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c68ea0d4-7c69-46ad-8428-2602d0e1732b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:52.918380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c68ea0d4-7c69-46ad-8428-2602d0e1732b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:52.926966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c68ea0d4-7c69-46ad-8428-2602d0e1732b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:52.929073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c68ea0d4-7c69-46ad-8428-2602d0e1732b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:52.948855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=78 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:41:53.168067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-075388c3-f380-4dda-928d-c3e98c4d6822 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:53.183558 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-075388c3-f380-4dda-928d-c3e98c4d6822 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1287 microversion: 2.1 time: 0.533044 Oct 10 23:41:53.184167 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2505/4826] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:52 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1287 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:53.759133 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c68ea0d4-7c69-46ad-8428-2602d0e1732b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:53.781562 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c68ea0d4-7c69-46ad-8428-2602d0e1732b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1737 microversion: 2.1 time: 0.908832 Oct 10 23:41:53.787153 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2322/4827] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:52 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1737 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:53.901058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bad5343a-dc62-48d6-8e0a-f3959ef24320 tempest-QuotasTestJSON-1390699733 tempest-QuotasTestJSON-1390699733-project] Calling method '.version_select at 0x7f662b4bc160>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:54.040160 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bad5343a-dc62-48d6-8e0a-f3959ef24320 tempest-QuotasTestJSON-1390699733 tempest-QuotasTestJSON-1390699733-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/b1ed02110e1048d5a08639e79cc1cbc9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.452782 Oct 10 23:41:54.040991 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2506/4828] 10.222.0.23 () {58 vars in 1269 bytes} [Mon Oct 10 23:41:53 2022] GET /compute/v2.1/os-quota-sets/b1ed02110e1048d5a08639e79cc1cbc9/defaults => generated 371 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:41:54.056151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f5a86b32-2d89-41de-acac-cdc22607ceeb tempest-QuotasTestJSON-1390699733 tempest-QuotasTestJSON-1390699733-project] Calling method '.version_select at 0x7f662a362670>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:54.210122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ab75e0c3-d400-4c23-b53b-bbb54c7a0788 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:54.211108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ab75e0c3-d400-4c23-b53b-bbb54c7a0788 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:54.228030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab75e0c3-d400-4c23-b53b-bbb54c7a0788 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:54.228853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab75e0c3-d400-4c23-b53b-bbb54c7a0788 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:54.232653 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab75e0c3-d400-4c23-b53b-bbb54c7a0788 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:54.233828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab75e0c3-d400-4c23-b53b-bbb54c7a0788 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:54.235509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab75e0c3-d400-4c23-b53b-bbb54c7a0788 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:54.236886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab75e0c3-d400-4c23-b53b-bbb54c7a0788 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:54.391689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ab75e0c3-d400-4c23-b53b-bbb54c7a0788 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:54.408577 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ab75e0c3-d400-4c23-b53b-bbb54c7a0788 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1275 microversion: 2.1 time: 0.198688 Oct 10 23:41:54.409914 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2507/4829] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:54 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1275 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:41:54.569594 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f5a86b32-2d89-41de-acac-cdc22607ceeb tempest-QuotasTestJSON-1390699733 tempest-QuotasTestJSON-1390699733-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/b1ed02110e1048d5a08639e79cc1cbc9" status: 200 len: 371 microversion: 2.1 time: 0.518488 Oct 10 23:41:54.570535 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2323/4830] 10.222.0.23 () {58 vars in 1242 bytes} [Mon Oct 10 23:41:54 2022] GET /compute/v2.1/os-quota-sets/b1ed02110e1048d5a08639e79cc1cbc9 => generated 371 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:41:54.594332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b417f4ba-b1e3-439e-bc62-c3476c941eec tempest-QuotasTestJSON-1390699733 tempest-QuotasTestJSON-1390699733-project] Calling method '.version_select at 0x7f662ac8b550>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:54.830477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ca0bb704-57ff-49fa-be2b-b17c7f2adff6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:54.831857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ca0bb704-57ff-49fa-be2b-b17c7f2adff6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:54.842127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca0bb704-57ff-49fa-be2b-b17c7f2adff6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:54.843173 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca0bb704-57ff-49fa-be2b-b17c7f2adff6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:54.844056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca0bb704-57ff-49fa-be2b-b17c7f2adff6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:54.845729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca0bb704-57ff-49fa-be2b-b17c7f2adff6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:54.846689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca0bb704-57ff-49fa-be2b-b17c7f2adff6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:54.847604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca0bb704-57ff-49fa-be2b-b17c7f2adff6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:55.072342 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b417f4ba-b1e3-439e-bc62-c3476c941eec tempest-QuotasTestJSON-1390699733 tempest-QuotasTestJSON-1390699733-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/b1ed02110e1048d5a08639e79cc1cbc9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.485381 Oct 10 23:41:55.084442 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2508/4831] 10.222.0.23 () {58 vars in 1269 bytes} [Mon Oct 10 23:41:54 2022] GET /compute/v2.1/os-quota-sets/b1ed02110e1048d5a08639e79cc1cbc9/defaults => generated 371 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:41:55.090169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-75675ea1-5c03-4df4-8236-00af6a8c5696 tempest-QuotasTestJSON-1390699733 tempest-QuotasTestJSON-1390699733-project] Calling method '.version_select at 0x7f662bb9c280>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:55.256194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ca0bb704-57ff-49fa-be2b-b17c7f2adff6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:55.272805 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ca0bb704-57ff-49fa-be2b-b17c7f2adff6 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1737 microversion: 2.1 time: 0.465363 Oct 10 23:41:55.275170 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-75675ea1-5c03-4df4-8236-00af6a8c5696 tempest-QuotasTestJSON-1390699733 tempest-QuotasTestJSON-1390699733-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/b1ed02110e1048d5a08639e79cc1cbc9" status: 200 len: 371 microversion: 2.1 time: 0.188931 Oct 10 23:41:55.284401 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2324/4832] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:54 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1737 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:55.286330 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2509/4833] 10.222.0.23 () {58 vars in 1242 bytes} [Mon Oct 10 23:41:55 2022] GET /compute/v2.1/os-quota-sets/b1ed02110e1048d5a08639e79cc1cbc9 => generated 371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:41:55.302075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bfc89bf0-e5f0-4a8a-94d5-b7cc26924898 tempest-QuotasTestJSON-1390699733 tempest-QuotasTestJSON-1390699733-project] Calling method '.version_select at 0x7f662a32c9d0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:55.435059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8444be3b-bb40-45ed-ba19-c172654b1175 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:55.435681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8444be3b-bb40-45ed-ba19-c172654b1175 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:55.450807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8444be3b-bb40-45ed-ba19-c172654b1175 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:55.451613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8444be3b-bb40-45ed-ba19-c172654b1175 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:55.452765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8444be3b-bb40-45ed-ba19-c172654b1175 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:55.453816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8444be3b-bb40-45ed-ba19-c172654b1175 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:55.454523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8444be3b-bb40-45ed-ba19-c172654b1175 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:55.455031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8444be3b-bb40-45ed-ba19-c172654b1175 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:55.717914 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bfc89bf0-e5f0-4a8a-94d5-b7cc26924898 tempest-QuotasTestJSON-1390699733 tempest-QuotasTestJSON-1390699733-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/b1ed02110e1048d5a08639e79cc1cbc9?user_id=88ca2f72c04e49f79aa3552570356a81" status: 200 len: 371 microversion: 2.1 time: 0.430417 Oct 10 23:41:55.718886 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2325/4834] 10.222.0.23 () {58 vars in 1323 bytes} [Mon Oct 10 23:41:55 2022] GET /compute/v2.1/os-quota-sets/b1ed02110e1048d5a08639e79cc1cbc9?user_id=88ca2f72c04e49f79aa3552570356a81 => generated 371 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:41:56.017815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8444be3b-bb40-45ed-ba19-c172654b1175 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:56.036934 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8444be3b-bb40-45ed-ba19-c172654b1175 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1317 microversion: 2.1 time: 0.605811 Oct 10 23:41:56.041470 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2510/4835] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:55 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1317 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:41:56.303106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7fc25cad-ab84-4cd8-9fc7-e50c36e38613 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:56.304580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7fc25cad-ab84-4cd8-9fc7-e50c36e38613 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:56.324400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fc25cad-ab84-4cd8-9fc7-e50c36e38613 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:56.325090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fc25cad-ab84-4cd8-9fc7-e50c36e38613 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:56.326045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fc25cad-ab84-4cd8-9fc7-e50c36e38613 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:56.329792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fc25cad-ab84-4cd8-9fc7-e50c36e38613 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:56.331704 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fc25cad-ab84-4cd8-9fc7-e50c36e38613 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:56.333725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fc25cad-ab84-4cd8-9fc7-e50c36e38613 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:56.904673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7fc25cad-ab84-4cd8-9fc7-e50c36e38613 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:56.921657 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7fc25cad-ab84-4cd8-9fc7-e50c36e38613 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1737 microversion: 2.1 time: 0.624120 Oct 10 23:41:56.933636 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2326/4836] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:56 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1737 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:56.980982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-888382ab-aac6-4d3a-aee8-c720fbf43f51 req-ed09be61-973b-4719-9b49-f69a168d672b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efc9e449-6324-411e-8af9-0533b23a4e3c", "tag": "c8d69949-457f-46f6-9402-4c349227f0a2"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:41:57.003385 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=52 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:41:57.006675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-888382ab-aac6-4d3a-aee8-c720fbf43f51 req-ed09be61-973b-4719-9b49-f69a168d672b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:57.007462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-888382ab-aac6-4d3a-aee8-c720fbf43f51 req-ed09be61-973b-4719-9b49-f69a168d672b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:57.008050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-888382ab-aac6-4d3a-aee8-c720fbf43f51 req-ed09be61-973b-4719-9b49-f69a168d672b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:57.025633 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-888382ab-aac6-4d3a-aee8-c720fbf43f51 req-ed09be61-973b-4719-9b49-f69a168d672b service nova] Creating event network-changed:c8d69949-457f-46f6-9402-4c349227f0a2 for instance efc9e449-6324-411e-8af9-0533b23a4e3c on n-h2-860864-2 Oct 10 23:41:57.034280 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-888382ab-aac6-4d3a-aee8-c720fbf43f51 req-ed09be61-973b-4719-9b49-f69a168d672b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056598 Oct 10 23:41:57.035801 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2511/4837] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:41:57.064000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6fdd58d6-cf7a-44ae-929f-47732e77e8c4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:57.064810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6fdd58d6-cf7a-44ae-929f-47732e77e8c4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:57.076522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6fdd58d6-cf7a-44ae-929f-47732e77e8c4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:57.080436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6fdd58d6-cf7a-44ae-929f-47732e77e8c4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:57.081156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6fdd58d6-cf7a-44ae-929f-47732e77e8c4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:57.081926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6fdd58d6-cf7a-44ae-929f-47732e77e8c4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:57.082397 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6fdd58d6-cf7a-44ae-929f-47732e77e8c4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:57.086548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6fdd58d6-cf7a-44ae-929f-47732e77e8c4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:57.560860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6fdd58d6-cf7a-44ae-929f-47732e77e8c4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:57.589527 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6fdd58d6-cf7a-44ae-929f-47732e77e8c4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1317 microversion: 2.1 time: 0.531762 Oct 10 23:41:57.590057 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2327/4838] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:57 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1317 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:57.949060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4cbc7893-6970-44e6-a9a5-7d45ac994c65 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:57.949807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4cbc7893-6970-44e6-a9a5-7d45ac994c65 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:57.960975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cbc7893-6970-44e6-a9a5-7d45ac994c65 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:57.962284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cbc7893-6970-44e6-a9a5-7d45ac994c65 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:57.963376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cbc7893-6970-44e6-a9a5-7d45ac994c65 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:57.964283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cbc7893-6970-44e6-a9a5-7d45ac994c65 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:57.965067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cbc7893-6970-44e6-a9a5-7d45ac994c65 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:57.965542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cbc7893-6970-44e6-a9a5-7d45ac994c65 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:58.234805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4cbc7893-6970-44e6-a9a5-7d45ac994c65 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:58.246392 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4cbc7893-6970-44e6-a9a5-7d45ac994c65 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1737 microversion: 2.1 time: 0.301470 Oct 10 23:41:58.247094 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2512/4839] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:57 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1737 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:58.614056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-12137360-4445-4439-92c4-0b783d09b9a4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:58.614678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-12137360-4445-4439-92c4-0b783d09b9a4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:58.631695 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12137360-4445-4439-92c4-0b783d09b9a4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:58.632561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12137360-4445-4439-92c4-0b783d09b9a4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:58.634347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12137360-4445-4439-92c4-0b783d09b9a4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:58.635310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12137360-4445-4439-92c4-0b783d09b9a4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:58.636015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12137360-4445-4439-92c4-0b783d09b9a4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:58.636799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12137360-4445-4439-92c4-0b783d09b9a4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:59.058844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-12137360-4445-4439-92c4-0b783d09b9a4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:59.074067 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-12137360-4445-4439-92c4-0b783d09b9a4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1317 microversion: 2.1 time: 0.463614 Oct 10 23:41:59.080177 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2328/4840] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:58 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1317 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:41:59.272706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4acd887d-0a85-429b-ae85-f41b494039d5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:41:59.273435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4acd887d-0a85-429b-ae85-f41b494039d5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:41:59.291238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4acd887d-0a85-429b-ae85-f41b494039d5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:59.291904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4acd887d-0a85-429b-ae85-f41b494039d5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:59.293630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4acd887d-0a85-429b-ae85-f41b494039d5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:59.298212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4acd887d-0a85-429b-ae85-f41b494039d5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:41:59.300792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4acd887d-0a85-429b-ae85-f41b494039d5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:41:59.301529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4acd887d-0a85-429b-ae85-f41b494039d5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:41:59.935977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4acd887d-0a85-429b-ae85-f41b494039d5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:41:59.953780 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4acd887d-0a85-429b-ae85-f41b494039d5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1717 microversion: 2.1 time: 0.685903 Oct 10 23:41:59.954383 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2513/4841] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:41:59 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1717 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:00.107425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f182f4f0-bd68-4f5c-b09d-081fb2cfd98d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:00.110155 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f182f4f0-bd68-4f5c-b09d-081fb2cfd98d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:00.122972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:42:00.131638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f182f4f0-bd68-4f5c-b09d-081fb2cfd98d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:00.133308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f182f4f0-bd68-4f5c-b09d-081fb2cfd98d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:00.135342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f182f4f0-bd68-4f5c-b09d-081fb2cfd98d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:00.137527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f182f4f0-bd68-4f5c-b09d-081fb2cfd98d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:00.141161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f182f4f0-bd68-4f5c-b09d-081fb2cfd98d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:00.143357 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f182f4f0-bd68-4f5c-b09d-081fb2cfd98d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:00.226375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0d548adc-0f1a-4c4e-a29b-deced726129c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:00.226882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0d548adc-0f1a-4c4e-a29b-deced726129c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:00.236933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d548adc-0f1a-4c4e-a29b-deced726129c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:00.237558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d548adc-0f1a-4c4e-a29b-deced726129c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:00.238016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d548adc-0f1a-4c4e-a29b-deced726129c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:00.238758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d548adc-0f1a-4c4e-a29b-deced726129c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:00.239221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d548adc-0f1a-4c4e-a29b-deced726129c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:00.239651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d548adc-0f1a-4c4e-a29b-deced726129c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:00.419984 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-0d548adc-0f1a-4c4e-a29b-deced726129c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] HTTP exception thrown: Cannot 'detach_volume' instance aa7a4001-50e2-4247-a60d-f82367072f61 while it is in vm_state rescued Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0d548adc-0f1a-4c4e-a29b-deced726129c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Request method failure captured: Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments/12e3d7cb-3c2b-48f2-8ded-94465d9037e5 HTTP/1.1 Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRKzOYlZsv7rRo2sa7kQc2eFaI8v-TMGvuh-sVU-zvganQJF5vXcDouizKP05ne1GDSQKrDkWUQDAU6qxxYttyNZ_6Byu14LDFhfplUKI_eaTrPi0t5xENermj156ZGMg1lyNDKMrSevusXHHA-zCISDm6SLPwivXrQErNiD9Jy9X9Qs Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 8986c214fcc944acb2731cc5af19ef0c Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8986c214fcc944acb2731cc5af19ef0c", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 8986c214fcc944acb2731cc5af19ef0c Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerRescueNegativeTestJSON-906322093-project Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 585d2834c2a94c5eaa8267cf2ba58ac0 Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerRescueNegativeTestJSON-906322093-project Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: exception: Cannot 'detach_volume' instance aa7a4001-50e2-4247-a60d-f82367072f61 while it is in vm_state rescued Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'server_id': 'aa7a4001-50e2-4247-a60d-f82367072f61', 'id': '12e3d7cb-3c2b-48f2-8ded-94465d9037e5'} Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aa7a4001-50e2-4247-a60d-f82367072f61 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance aa7a4001-50e2-4247-a60d-f82367072f61 while it is in vm_state rescued Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:00.423226 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:00.427543 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:00.427543 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:00.427543 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:42:00.427543 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:42:00.427543 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance aa7a4001-50e2-4247-a60d-f82367072f61 while it is in vm_state rescued Oct 10 23:42:00.427543 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:00.430007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0d548adc-0f1a-4c4e-a29b-deced726129c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Returning 409 to user: Cannot 'detach_volume' instance aa7a4001-50e2-4247-a60d-f82367072f61 while it is in vm_state rescued {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:42:00.431670 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0d548adc-0f1a-4c4e-a29b-deced726129c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments/12e3d7cb-3c2b-48f2-8ded-94465d9037e5" status: 409 len: 152 microversion: 2.1 time: 0.213170 Oct 10 23:42:00.433054 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2514/4842] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Oct 10 23:42:00 2022] DELETE /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments/12e3d7cb-3c2b-48f2-8ded-94465d9037e5 => generated 152 bytes in 215 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:42:00.442665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cd6fde29-56d2-435a-b31a-91840cff7fe3 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:00.443731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cd6fde29-56d2-435a-b31a-91840cff7fe3 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:00.454127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd6fde29-56d2-435a-b31a-91840cff7fe3 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:00.455124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd6fde29-56d2-435a-b31a-91840cff7fe3 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:00.456518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd6fde29-56d2-435a-b31a-91840cff7fe3 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:00.457562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd6fde29-56d2-435a-b31a-91840cff7fe3 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:00.458251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd6fde29-56d2-435a-b31a-91840cff7fe3 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:00.458925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd6fde29-56d2-435a-b31a-91840cff7fe3 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:00.577778 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cd6fde29-56d2-435a-b31a-91840cff7fe3 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "POST /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/action" status: 202 len: 0 microversion: 2.1 time: 0.126684 Oct 10 23:42:00.582949 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2515/4843] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:42:00 2022] POST /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 23:42:00.611492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3f91c78a-79db-4e70-bf6c-b10b54cfe4aa tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:00.614783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3f91c78a-79db-4e70-bf6c-b10b54cfe4aa tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:00.632280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f91c78a-79db-4e70-bf6c-b10b54cfe4aa tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:00.634031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f91c78a-79db-4e70-bf6c-b10b54cfe4aa tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:00.635931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f91c78a-79db-4e70-bf6c-b10b54cfe4aa tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:00.638004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f91c78a-79db-4e70-bf6c-b10b54cfe4aa tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:00.640483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f91c78a-79db-4e70-bf6c-b10b54cfe4aa tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:00.642439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f91c78a-79db-4e70-bf6c-b10b54cfe4aa tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:00.896392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f182f4f0-bd68-4f5c-b09d-081fb2cfd98d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:00.913215 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f182f4f0-bd68-4f5c-b09d-081fb2cfd98d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1317 microversion: 2.1 time: 0.810705 Oct 10 23:42:00.919961 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2329/4844] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:00 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1317 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:00.966888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3f91c78a-79db-4e70-bf6c-b10b54cfe4aa tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:00.981361 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3f91c78a-79db-4e70-bf6c-b10b54cfe4aa tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1725 microversion: 2.1 time: 0.393476 Oct 10 23:42:01.001902 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2516/4845] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:00 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1725 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:01.951259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-17f1ca21-0808-4085-95af-60d00a988161 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:01.954530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-17f1ca21-0808-4085-95af-60d00a988161 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:01.970205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17f1ca21-0808-4085-95af-60d00a988161 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:01.970750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17f1ca21-0808-4085-95af-60d00a988161 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:01.974604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17f1ca21-0808-4085-95af-60d00a988161 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:01.975417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17f1ca21-0808-4085-95af-60d00a988161 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:01.975902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17f1ca21-0808-4085-95af-60d00a988161 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:01.976350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17f1ca21-0808-4085-95af-60d00a988161 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:02.012200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-928e48ad-edcc-4c45-8be0-ee114f9ecd1e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:02.013665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-928e48ad-edcc-4c45-8be0-ee114f9ecd1e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:02.032521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-928e48ad-edcc-4c45-8be0-ee114f9ecd1e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:02.035122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-928e48ad-edcc-4c45-8be0-ee114f9ecd1e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:02.037344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-928e48ad-edcc-4c45-8be0-ee114f9ecd1e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:02.039486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-928e48ad-edcc-4c45-8be0-ee114f9ecd1e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:02.043550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-928e48ad-edcc-4c45-8be0-ee114f9ecd1e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:02.044200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-928e48ad-edcc-4c45-8be0-ee114f9ecd1e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:02.059661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:42:02.329842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-928e48ad-edcc-4c45-8be0-ee114f9ecd1e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:02.348763 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-928e48ad-edcc-4c45-8be0-ee114f9ecd1e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1725 microversion: 2.1 time: 0.339843 Oct 10 23:42:02.353017 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2517/4846] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:02 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1725 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:02.730037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-17f1ca21-0808-4085-95af-60d00a988161 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:02.746982 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-17f1ca21-0808-4085-95af-60d00a988161 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1317 microversion: 2.1 time: 0.804783 Oct 10 23:42:02.747590 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2330/4847] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:01 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1317 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:03.380708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-49c876cd-2cdd-4217-afff-9de940f9bca1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:03.381517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-49c876cd-2cdd-4217-afff-9de940f9bca1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:03.398672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49c876cd-2cdd-4217-afff-9de940f9bca1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:03.401301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49c876cd-2cdd-4217-afff-9de940f9bca1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:03.402107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49c876cd-2cdd-4217-afff-9de940f9bca1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:03.403319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49c876cd-2cdd-4217-afff-9de940f9bca1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:03.404878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49c876cd-2cdd-4217-afff-9de940f9bca1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:03.408815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49c876cd-2cdd-4217-afff-9de940f9bca1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:03.679244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-49c876cd-2cdd-4217-afff-9de940f9bca1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:03.690140 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-49c876cd-2cdd-4217-afff-9de940f9bca1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1725 microversion: 2.1 time: 0.314078 Oct 10 23:42:03.695483 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2518/4848] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:03 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1725 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:03.776160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c5c43f91-2eb5-46ae-85b0-1f9724f51225 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:03.778351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c5c43f91-2eb5-46ae-85b0-1f9724f51225 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:03.802569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5c43f91-2eb5-46ae-85b0-1f9724f51225 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:03.806264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5c43f91-2eb5-46ae-85b0-1f9724f51225 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:03.807116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5c43f91-2eb5-46ae-85b0-1f9724f51225 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:03.808309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5c43f91-2eb5-46ae-85b0-1f9724f51225 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:03.809369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5c43f91-2eb5-46ae-85b0-1f9724f51225 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:03.810707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5c43f91-2eb5-46ae-85b0-1f9724f51225 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:04.124899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-dddb661f-cbb6-4e26-960a-93bed6da519f req-b8536a16-dbd5-4298-a576-a523a3cdc97a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc9e449-6324-411e-8af9-0533b23a4e3c", "name": "network-vif-plugged", "status": "completed", "tag": "c8d69949-457f-46f6-9402-4c349227f0a2"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:04.144789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-dddb661f-cbb6-4e26-960a-93bed6da519f req-b8536a16-dbd5-4298-a576-a523a3cdc97a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:04.145274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-dddb661f-cbb6-4e26-960a-93bed6da519f req-b8536a16-dbd5-4298-a576-a523a3cdc97a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:04.147926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-dddb661f-cbb6-4e26-960a-93bed6da519f req-b8536a16-dbd5-4298-a576-a523a3cdc97a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:04.169026 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-dddb661f-cbb6-4e26-960a-93bed6da519f req-b8536a16-dbd5-4298-a576-a523a3cdc97a service nova] Creating event network-vif-plugged:c8d69949-457f-46f6-9402-4c349227f0a2 for instance efc9e449-6324-411e-8af9-0533b23a4e3c on n-h2-860864-2 Oct 10 23:42:04.187435 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-dddb661f-cbb6-4e26-960a-93bed6da519f req-b8536a16-dbd5-4298-a576-a523a3cdc97a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066420 Oct 10 23:42:04.195735 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2519/4849] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:42:04.236672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c5c43f91-2eb5-46ae-85b0-1f9724f51225 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:04.265771 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c5c43f91-2eb5-46ae-85b0-1f9724f51225 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1317 microversion: 2.1 time: 0.490772 Oct 10 23:42:04.269591 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2331/4850] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:03 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:04.716652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-57735a4a-979e-4e7d-b0d4-52dc9ccb9508 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:04.718372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-57735a4a-979e-4e7d-b0d4-52dc9ccb9508 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:04.733059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57735a4a-979e-4e7d-b0d4-52dc9ccb9508 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:04.737859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57735a4a-979e-4e7d-b0d4-52dc9ccb9508 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:04.738415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57735a4a-979e-4e7d-b0d4-52dc9ccb9508 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:04.739237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57735a4a-979e-4e7d-b0d4-52dc9ccb9508 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:04.739911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57735a4a-979e-4e7d-b0d4-52dc9ccb9508 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:04.740575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-57735a4a-979e-4e7d-b0d4-52dc9ccb9508 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:05.207005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-57735a4a-979e-4e7d-b0d4-52dc9ccb9508 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:05.229453 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-57735a4a-979e-4e7d-b0d4-52dc9ccb9508 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1725 microversion: 2.1 time: 0.516896 Oct 10 23:42:05.234841 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2520/4851] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:04 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1725 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:05.297861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1282ac6c-c0cd-4660-86ff-4726b7565028 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:05.298726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1282ac6c-c0cd-4660-86ff-4726b7565028 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:05.315365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:42:05.320895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1282ac6c-c0cd-4660-86ff-4726b7565028 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:05.322238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1282ac6c-c0cd-4660-86ff-4726b7565028 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:05.325302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1282ac6c-c0cd-4660-86ff-4726b7565028 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:05.329885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1282ac6c-c0cd-4660-86ff-4726b7565028 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:05.330561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1282ac6c-c0cd-4660-86ff-4726b7565028 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:05.331144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1282ac6c-c0cd-4660-86ff-4726b7565028 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:05.340381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-32773eec-05eb-477f-8408-e4c80b5da1b8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-843074541", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "99aa30e7-a2c6-4b17-b974-bb1c36c895bd"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:05.429291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-32773eec-05eb-477f-8408-e4c80b5da1b8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] validate_networks() for [('99aa30e7-a2c6-4b17-b974-bb1c36c895bd', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:42:05.579141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1282ac6c-c0cd-4660-86ff-4726b7565028 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:05.589449 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1282ac6c-c0cd-4660-86ff-4726b7565028 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1317 microversion: 2.1 time: 0.296853 Oct 10 23:42:05.601979 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2521/4852] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:05 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:05.709788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=14 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:42:06.258658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-de7184ed-5254-4455-869b-4641e34aa815 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:06.259114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-de7184ed-5254-4455-869b-4641e34aa815 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:06.267257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de7184ed-5254-4455-869b-4641e34aa815 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:06.268109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de7184ed-5254-4455-869b-4641e34aa815 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:06.268751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de7184ed-5254-4455-869b-4641e34aa815 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:06.269858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de7184ed-5254-4455-869b-4641e34aa815 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:06.270583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de7184ed-5254-4455-869b-4641e34aa815 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:06.271186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de7184ed-5254-4455-869b-4641e34aa815 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:06.510765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-de7184ed-5254-4455-869b-4641e34aa815 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:06.513542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-32773eec-05eb-477f-8408-e4c80b5da1b8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:42:06.515588 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-32773eec-05eb-477f-8408-e4c80b5da1b8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:42:06.516058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-32773eec-05eb-477f-8408-e4c80b5da1b8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:42:06.516292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-32773eec-05eb-477f-8408-e4c80b5da1b8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:42:06.516820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-32773eec-05eb-477f-8408-e4c80b5da1b8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:42:06.526735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32773eec-05eb-477f-8408-e4c80b5da1b8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:06.527237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32773eec-05eb-477f-8408-e4c80b5da1b8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:06.527737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32773eec-05eb-477f-8408-e4c80b5da1b8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:06.528669 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32773eec-05eb-477f-8408-e4c80b5da1b8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:06.529327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32773eec-05eb-477f-8408-e4c80b5da1b8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:06.531043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32773eec-05eb-477f-8408-e4c80b5da1b8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:06.537570 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-de7184ed-5254-4455-869b-4641e34aa815 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1731 microversion: 2.1 time: 0.283124 Oct 10 23:42:06.542573 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2522/4853] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:06 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1731 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:06.560532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-32773eec-05eb-477f-8408-e4c80b5da1b8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Getting quotas for project fea9f7995c3349008497343ab1940287. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:42:06.575656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-843b095b-b7f7-4718-84e6-4938636119af tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:06.575946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-32773eec-05eb-477f-8408-e4c80b5da1b8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Getting quotas for user 8eb15e7a60664cc7a0e5f7236dada33c and project fea9f7995c3349008497343ab1940287. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:42:06.576980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-843b095b-b7f7-4718-84e6-4938636119af tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:06.594643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-843b095b-b7f7-4718-84e6-4938636119af tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:06.595951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-843b095b-b7f7-4718-84e6-4938636119af tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:06.596644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-843b095b-b7f7-4718-84e6-4938636119af tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:06.597821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-843b095b-b7f7-4718-84e6-4938636119af tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:06.599090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-843b095b-b7f7-4718-84e6-4938636119af tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:06.599773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-843b095b-b7f7-4718-84e6-4938636119af tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:06.602830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-32773eec-05eb-477f-8408-e4c80b5da1b8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:42:06.609217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-32773eec-05eb-477f-8408-e4c80b5da1b8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:42:06.730144 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-843b095b-b7f7-4718-84e6-4938636119af tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.159291 Oct 10 23:42:06.731558 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2523/4854] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Oct 10 23:42:06 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:42:06.737231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fd77c6c1-fab7-4a03-8e48-75a768e0ca3d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:06.738177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fd77c6c1-fab7-4a03-8e48-75a768e0ca3d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:06.746575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd77c6c1-fab7-4a03-8e48-75a768e0ca3d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:06.747689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd77c6c1-fab7-4a03-8e48-75a768e0ca3d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:06.748383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd77c6c1-fab7-4a03-8e48-75a768e0ca3d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:06.749394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd77c6c1-fab7-4a03-8e48-75a768e0ca3d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:06.750132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd77c6c1-fab7-4a03-8e48-75a768e0ca3d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:06.750802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd77c6c1-fab7-4a03-8e48-75a768e0ca3d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:06.762257 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-32773eec-05eb-477f-8408-e4c80b5da1b8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.748846 Oct 10 23:42:06.770904 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2332/4855] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:42:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 23:42:06.780335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-60d50439-c2d5-4451-a40c-09a8b66ad80c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:06.784969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-60d50439-c2d5-4451-a40c-09a8b66ad80c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:06.874589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-60d50439-c2d5-4451-a40c-09a8b66ad80c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:06.882961 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-60d50439-c2d5-4451-a40c-09a8b66ad80c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1217 microversion: 2.1 time: 0.110549 Oct 10 23:42:06.893970 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2333/4856] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:06 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1217 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:42:07.042031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fd77c6c1-fab7-4a03-8e48-75a768e0ca3d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:07.054599 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fd77c6c1-fab7-4a03-8e48-75a768e0ca3d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.321520 Oct 10 23:42:07.074544 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2524/4857] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:06 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:07.328792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3aa61e3c-acc6-42c7-9dcc-1e27df6e3239 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-508248364", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:07.443845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-3aa61e3c-acc6-42c7-9dcc-1e27df6e3239 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] validate_networks() for [('fa0ea560-35bf-4417-8cad-eb62562b3005', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:42:07.908238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8e67f583-ea23-43d2-82bb-b9a85b100e86 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:07.910736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8e67f583-ea23-43d2-82bb-b9a85b100e86 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:07.932870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e67f583-ea23-43d2-82bb-b9a85b100e86 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:07.934972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e67f583-ea23-43d2-82bb-b9a85b100e86 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:07.935593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e67f583-ea23-43d2-82bb-b9a85b100e86 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:07.936905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e67f583-ea23-43d2-82bb-b9a85b100e86 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:07.940714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e67f583-ea23-43d2-82bb-b9a85b100e86 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:07.941710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e67f583-ea23-43d2-82bb-b9a85b100e86 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:08.079738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8e67f583-ea23-43d2-82bb-b9a85b100e86 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:08.093534 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8e67f583-ea23-43d2-82bb-b9a85b100e86 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1213 microversion: 2.1 time: 0.189993 Oct 10 23:42:08.095217 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2525/4858] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:07 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1213 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:09.118941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9070eb20-b62b-4ecd-a905-0ed1e4c17df9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:09.120272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9070eb20-b62b-4ecd-a905-0ed1e4c17df9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:09.129496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9070eb20-b62b-4ecd-a905-0ed1e4c17df9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:09.130003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9070eb20-b62b-4ecd-a905-0ed1e4c17df9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:09.130532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9070eb20-b62b-4ecd-a905-0ed1e4c17df9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:09.131388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9070eb20-b62b-4ecd-a905-0ed1e4c17df9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:09.131959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9070eb20-b62b-4ecd-a905-0ed1e4c17df9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:09.132471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9070eb20-b62b-4ecd-a905-0ed1e4c17df9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:09.302675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9070eb20-b62b-4ecd-a905-0ed1e4c17df9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:09.316992 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9070eb20-b62b-4ecd-a905-0ed1e4c17df9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1275 microversion: 2.1 time: 0.198839 Oct 10 23:42:09.317538 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2526/4859] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:09 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1275 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:09.603546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3aa61e3c-acc6-42c7-9dcc-1e27df6e3239 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:42:09.604082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3aa61e3c-acc6-42c7-9dcc-1e27df6e3239 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:42:09.604936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3aa61e3c-acc6-42c7-9dcc-1e27df6e3239 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:42:09.605364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3aa61e3c-acc6-42c7-9dcc-1e27df6e3239 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:42:09.605364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3aa61e3c-acc6-42c7-9dcc-1e27df6e3239 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:42:09.636301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3aa61e3c-acc6-42c7-9dcc-1e27df6e3239 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:09.636716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3aa61e3c-acc6-42c7-9dcc-1e27df6e3239 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:09.637104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3aa61e3c-acc6-42c7-9dcc-1e27df6e3239 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:09.637867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3aa61e3c-acc6-42c7-9dcc-1e27df6e3239 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:09.638321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3aa61e3c-acc6-42c7-9dcc-1e27df6e3239 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:09.638747 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3aa61e3c-acc6-42c7-9dcc-1e27df6e3239 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:09.704231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-3aa61e3c-acc6-42c7-9dcc-1e27df6e3239 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Getting quotas for project 36ec432047e846409dbced00d713aa71. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:42:09.719992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-3aa61e3c-acc6-42c7-9dcc-1e27df6e3239 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Getting quotas for user 847536250ff1495c91a80222a0307788 and project 36ec432047e846409dbced00d713aa71. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:42:09.748851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3aa61e3c-acc6-42c7-9dcc-1e27df6e3239 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:42:09.756592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3aa61e3c-acc6-42c7-9dcc-1e27df6e3239 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6195ee8f-6f37-4b7a-9b30-c813010aa4cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:42:09.936394 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3aa61e3c-acc6-42c7-9dcc-1e27df6e3239 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.608856 Oct 10 23:42:09.939386 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2334/4860] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:42:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 23:42:09.950235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-771fad96-fdd7-4d7d-9638-64b5ee58eb6d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:09.951296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-771fad96-fdd7-4d7d-9638-64b5ee58eb6d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6195ee8f-6f37-4b7a-9b30-c813010aa4cb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:10.059711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-771fad96-fdd7-4d7d-9638-64b5ee58eb6d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:10.070043 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-771fad96-fdd7-4d7d-9638-64b5ee58eb6d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb" status: 200 len: 1216 microversion: 2.1 time: 0.123700 Oct 10 23:42:10.072753 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2527/4861] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:09 2022] GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb => generated 1216 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:42:10.344758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-93848ef4-c6e7-4bd5-a38d-55aa90334611 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:10.345563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-93848ef4-c6e7-4bd5-a38d-55aa90334611 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:10.360448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93848ef4-c6e7-4bd5-a38d-55aa90334611 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:10.362451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93848ef4-c6e7-4bd5-a38d-55aa90334611 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:10.363129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93848ef4-c6e7-4bd5-a38d-55aa90334611 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:10.364063 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93848ef4-c6e7-4bd5-a38d-55aa90334611 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:10.369079 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93848ef4-c6e7-4bd5-a38d-55aa90334611 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:10.370986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93848ef4-c6e7-4bd5-a38d-55aa90334611 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:10.560690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-a50bea8a-dfe1-4862-925b-c568a85e80ca req-2db5504e-980d-48a2-8ae1-646a0576f7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7a4001-50e2-4247-a60d-f82367072f61", "tag": "b24cdf0d-a2fa-4fcb-a031-a363754246f9"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:10.592838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a50bea8a-dfe1-4862-925b-c568a85e80ca req-2db5504e-980d-48a2-8ae1-646a0576f7a2 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:10.598996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a50bea8a-dfe1-4862-925b-c568a85e80ca req-2db5504e-980d-48a2-8ae1-646a0576f7a2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:10.601755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a50bea8a-dfe1-4862-925b-c568a85e80ca req-2db5504e-980d-48a2-8ae1-646a0576f7a2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:10.654426 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a50bea8a-dfe1-4862-925b-c568a85e80ca req-2db5504e-980d-48a2-8ae1-646a0576f7a2 service nova] Creating event network-changed:b24cdf0d-a2fa-4fcb-a031-a363754246f9 for instance aa7a4001-50e2-4247-a60d-f82367072f61 on n-h1-860864-2 Oct 10 23:42:10.663230 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-a50bea8a-dfe1-4862-925b-c568a85e80ca req-2db5504e-980d-48a2-8ae1-646a0576f7a2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112181 Oct 10 23:42:10.667465 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2528/4862] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:42:11.086880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-93848ef4-c6e7-4bd5-a38d-55aa90334611 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:11.103634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a8d481fa-8e0e-48ef-944d-710a9dfb9ad5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:11.104512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a8d481fa-8e0e-48ef-944d-710a9dfb9ad5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6195ee8f-6f37-4b7a-9b30-c813010aa4cb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:11.133266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8d481fa-8e0e-48ef-944d-710a9dfb9ad5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:11.136916 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-93848ef4-c6e7-4bd5-a38d-55aa90334611 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1317 microversion: 2.1 time: 0.796747 Oct 10 23:42:11.137777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8d481fa-8e0e-48ef-944d-710a9dfb9ad5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:11.139065 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2335/4863] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:10 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1317 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:11.145317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8d481fa-8e0e-48ef-944d-710a9dfb9ad5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:11.151005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8d481fa-8e0e-48ef-944d-710a9dfb9ad5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:11.151806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8d481fa-8e0e-48ef-944d-710a9dfb9ad5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:11.153961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8d481fa-8e0e-48ef-944d-710a9dfb9ad5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:11.485601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a8d481fa-8e0e-48ef-944d-710a9dfb9ad5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:11.503524 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a8d481fa-8e0e-48ef-944d-710a9dfb9ad5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb" status: 200 len: 1220 microversion: 2.1 time: 0.404588 Oct 10 23:42:11.504940 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2529/4864] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:11 2022] GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb => generated 1220 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:12.162417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6da198f7-0586-4070-b473-74892e85cf60 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:12.163035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6da198f7-0586-4070-b473-74892e85cf60 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:12.177569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6da198f7-0586-4070-b473-74892e85cf60 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:12.177974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6da198f7-0586-4070-b473-74892e85cf60 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:12.178421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6da198f7-0586-4070-b473-74892e85cf60 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:12.179419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6da198f7-0586-4070-b473-74892e85cf60 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:12.179904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6da198f7-0586-4070-b473-74892e85cf60 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:12.180337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6da198f7-0586-4070-b473-74892e85cf60 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:12.528329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-16714c5c-3eec-42fd-bd5b-54e8b20c8be4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:12.528942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-16714c5c-3eec-42fd-bd5b-54e8b20c8be4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6195ee8f-6f37-4b7a-9b30-c813010aa4cb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:12.542560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16714c5c-3eec-42fd-bd5b-54e8b20c8be4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:12.543260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16714c5c-3eec-42fd-bd5b-54e8b20c8be4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:12.543704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16714c5c-3eec-42fd-bd5b-54e8b20c8be4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:12.544424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16714c5c-3eec-42fd-bd5b-54e8b20c8be4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:12.544881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16714c5c-3eec-42fd-bd5b-54e8b20c8be4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:12.545310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16714c5c-3eec-42fd-bd5b-54e8b20c8be4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:12.716149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6da198f7-0586-4070-b473-74892e85cf60 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:12.727029 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6da198f7-0586-4070-b473-74892e85cf60 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1317 microversion: 2.1 time: 0.568362 Oct 10 23:42:12.727650 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2336/4865] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:12 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1317 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:12.735839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-a584ae07-77c2-4381-9dee-bf40cdb68dc4 req-2a199d44-54c4-4b13-95ee-2554bc0a748f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7a4001-50e2-4247-a60d-f82367072f61", "tag": "b24cdf0d-a2fa-4fcb-a031-a363754246f9"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:12.757795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a584ae07-77c2-4381-9dee-bf40cdb68dc4 req-2a199d44-54c4-4b13-95ee-2554bc0a748f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:12.758193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a584ae07-77c2-4381-9dee-bf40cdb68dc4 req-2a199d44-54c4-4b13-95ee-2554bc0a748f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:12.762018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a584ae07-77c2-4381-9dee-bf40cdb68dc4 req-2a199d44-54c4-4b13-95ee-2554bc0a748f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:12.775867 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-a584ae07-77c2-4381-9dee-bf40cdb68dc4 req-2a199d44-54c4-4b13-95ee-2554bc0a748f service nova] Creating event network-changed:b24cdf0d-a2fa-4fcb-a031-a363754246f9 for instance aa7a4001-50e2-4247-a60d-f82367072f61 on n-h1-860864-2 Oct 10 23:42:12.783824 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-a584ae07-77c2-4381-9dee-bf40cdb68dc4 req-2a199d44-54c4-4b13-95ee-2554bc0a748f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053589 Oct 10 23:42:12.784710 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2337/4866] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:42:13.025120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-16714c5c-3eec-42fd-bd5b-54e8b20c8be4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:13.039274 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-16714c5c-3eec-42fd-bd5b-54e8b20c8be4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb" status: 200 len: 1274 microversion: 2.1 time: 0.515775 Oct 10 23:42:13.040534 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2530/4867] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:12 2022] GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb => generated 1274 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:42:13.433693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-776d7910-cde6-4e9d-abcc-8818384f8e47 req-7e9dc1bf-f279-4bd7-9cf2-199ef5a627a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e82c4dac-b092-4a01-a6ba-faeaf147e079", "tag": "eb15cec0-009b-460d-896d-f8a2f8e16987"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:13.454743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-776d7910-cde6-4e9d-abcc-8818384f8e47 req-7e9dc1bf-f279-4bd7-9cf2-199ef5a627a9 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:13.457032 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-776d7910-cde6-4e9d-abcc-8818384f8e47 req-7e9dc1bf-f279-4bd7-9cf2-199ef5a627a9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:13.457540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-776d7910-cde6-4e9d-abcc-8818384f8e47 req-7e9dc1bf-f279-4bd7-9cf2-199ef5a627a9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:13.479889 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-776d7910-cde6-4e9d-abcc-8818384f8e47 req-7e9dc1bf-f279-4bd7-9cf2-199ef5a627a9 service nova] Creating event network-changed:eb15cec0-009b-460d-896d-f8a2f8e16987 for instance e82c4dac-b092-4a01-a6ba-faeaf147e079 on n-h2-860864-2 Oct 10 23:42:13.487472 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-776d7910-cde6-4e9d-abcc-8818384f8e47 req-7e9dc1bf-f279-4bd7-9cf2-199ef5a627a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.325021 Oct 10 23:42:13.489157 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2338/4868] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:42:13.756358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7540cb5e-04d1-4901-8ecd-f0d18f53f341 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:13.757021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7540cb5e-04d1-4901-8ecd-f0d18f53f341 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:13.778216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7540cb5e-04d1-4901-8ecd-f0d18f53f341 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:13.778737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7540cb5e-04d1-4901-8ecd-f0d18f53f341 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:13.779367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7540cb5e-04d1-4901-8ecd-f0d18f53f341 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:13.781364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7540cb5e-04d1-4901-8ecd-f0d18f53f341 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:13.781882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7540cb5e-04d1-4901-8ecd-f0d18f53f341 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:13.782327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7540cb5e-04d1-4901-8ecd-f0d18f53f341 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:14.005341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7540cb5e-04d1-4901-8ecd-f0d18f53f341 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:14.018516 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7540cb5e-04d1-4901-8ecd-f0d18f53f341 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1317 microversion: 2.1 time: 0.266218 Oct 10 23:42:14.019125 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2531/4869] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:13 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:14.066324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b22bee2c-b12f-4154-9fc7-fe58535fc00c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:14.067172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b22bee2c-b12f-4154-9fc7-fe58535fc00c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6195ee8f-6f37-4b7a-9b30-c813010aa4cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:14.075911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b22bee2c-b12f-4154-9fc7-fe58535fc00c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:14.078668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b22bee2c-b12f-4154-9fc7-fe58535fc00c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:14.081213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b22bee2c-b12f-4154-9fc7-fe58535fc00c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:14.083319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b22bee2c-b12f-4154-9fc7-fe58535fc00c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:14.085059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b22bee2c-b12f-4154-9fc7-fe58535fc00c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:14.085752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b22bee2c-b12f-4154-9fc7-fe58535fc00c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:14.237495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b22bee2c-b12f-4154-9fc7-fe58535fc00c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:14.246882 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b22bee2c-b12f-4154-9fc7-fe58535fc00c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb" status: 200 len: 1274 microversion: 2.1 time: 0.185508 Oct 10 23:42:14.248154 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2339/4870] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:14 2022] GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb => generated 1274 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:15.089988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-63e3302b-bf04-4aa9-8798-4c3188c75dda tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:15.098524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-63e3302b-bf04-4aa9-8798-4c3188c75dda tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:15.121882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63e3302b-bf04-4aa9-8798-4c3188c75dda tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:15.123294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63e3302b-bf04-4aa9-8798-4c3188c75dda tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:15.123964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63e3302b-bf04-4aa9-8798-4c3188c75dda tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:15.134156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63e3302b-bf04-4aa9-8798-4c3188c75dda tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:15.135405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63e3302b-bf04-4aa9-8798-4c3188c75dda tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:15.135971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63e3302b-bf04-4aa9-8798-4c3188c75dda tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:15.275025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-856f03c7-4f77-4d4e-9551-b634585eb6aa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:15.276363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-856f03c7-4f77-4d4e-9551-b634585eb6aa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6195ee8f-6f37-4b7a-9b30-c813010aa4cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:15.305048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-856f03c7-4f77-4d4e-9551-b634585eb6aa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:15.310200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-856f03c7-4f77-4d4e-9551-b634585eb6aa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:15.320457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-856f03c7-4f77-4d4e-9551-b634585eb6aa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:15.321223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-856f03c7-4f77-4d4e-9551-b634585eb6aa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:15.321719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-856f03c7-4f77-4d4e-9551-b634585eb6aa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:15.322151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-856f03c7-4f77-4d4e-9551-b634585eb6aa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:15.813994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-63e3302b-bf04-4aa9-8798-4c3188c75dda tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:15.823959 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-63e3302b-bf04-4aa9-8798-4c3188c75dda tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1317 microversion: 2.1 time: 0.783555 Oct 10 23:42:15.836212 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2532/4871] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:15 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1317 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:16.175622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-856f03c7-4f77-4d4e-9551-b634585eb6aa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:16.186758 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-856f03c7-4f77-4d4e-9551-b634585eb6aa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb" status: 200 len: 1316 microversion: 2.1 time: 0.915206 Oct 10 23:42:16.208433 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2340/4872] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:15 2022] GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb => generated 1316 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:42:16.485790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-cd916319-8451-4e27-8f48-070698cb89ff req-8d8cea32-ffce-4551-a290-c62ce55170ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6195ee8f-6f37-4b7a-9b30-c813010aa4cb", "tag": "e1e5362b-2914-434e-8643-278df7867b73"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:16.539086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cd916319-8451-4e27-8f48-070698cb89ff req-8d8cea32-ffce-4551-a290-c62ce55170ee service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:16.543503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cd916319-8451-4e27-8f48-070698cb89ff req-8d8cea32-ffce-4551-a290-c62ce55170ee service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:16.549287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cd916319-8451-4e27-8f48-070698cb89ff req-8d8cea32-ffce-4551-a290-c62ce55170ee service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:16.599810 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-cd916319-8451-4e27-8f48-070698cb89ff req-8d8cea32-ffce-4551-a290-c62ce55170ee service nova] Creating event network-changed:e1e5362b-2914-434e-8643-278df7867b73 for instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb on n-h1-860864-2 Oct 10 23:42:16.615497 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-cd916319-8451-4e27-8f48-070698cb89ff req-8d8cea32-ffce-4551-a290-c62ce55170ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137308 Oct 10 23:42:16.617078 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2533/4873] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:42:16.849464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-46f271bc-78d2-4368-abda-85af1d372a99 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:16.850909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-46f271bc-78d2-4368-abda-85af1d372a99 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:16.875080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46f271bc-78d2-4368-abda-85af1d372a99 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:16.875597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46f271bc-78d2-4368-abda-85af1d372a99 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:16.876047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46f271bc-78d2-4368-abda-85af1d372a99 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:16.876822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46f271bc-78d2-4368-abda-85af1d372a99 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:16.877350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46f271bc-78d2-4368-abda-85af1d372a99 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:16.886115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46f271bc-78d2-4368-abda-85af1d372a99 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:17.216888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ffb6c3ab-5eb9-4bbd-9270-bc9ecf31cb5a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:17.218314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ffb6c3ab-5eb9-4bbd-9270-bc9ecf31cb5a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6195ee8f-6f37-4b7a-9b30-c813010aa4cb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:17.228390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ffb6c3ab-5eb9-4bbd-9270-bc9ecf31cb5a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:17.234484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ffb6c3ab-5eb9-4bbd-9270-bc9ecf31cb5a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:17.236062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ffb6c3ab-5eb9-4bbd-9270-bc9ecf31cb5a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:17.237059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ffb6c3ab-5eb9-4bbd-9270-bc9ecf31cb5a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:17.238395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ffb6c3ab-5eb9-4bbd-9270-bc9ecf31cb5a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:17.240315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ffb6c3ab-5eb9-4bbd-9270-bc9ecf31cb5a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:17.267469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-46f271bc-78d2-4368-abda-85af1d372a99 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:17.285690 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-46f271bc-78d2-4368-abda-85af1d372a99 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1317 microversion: 2.1 time: 0.440824 Oct 10 23:42:17.288681 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2341/4874] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:16 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1317 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:17.867772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ffb6c3ab-5eb9-4bbd-9270-bc9ecf31cb5a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:17.903493 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ffb6c3ab-5eb9-4bbd-9270-bc9ecf31cb5a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb" status: 200 len: 1316 microversion: 2.1 time: 0.690397 Oct 10 23:42:17.909008 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2534/4875] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:17 2022] GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb => generated 1316 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:18.350134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-819de888-36ee-4711-864b-0cc19e4a356d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:18.351489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-819de888-36ee-4711-864b-0cc19e4a356d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:18.365619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-819de888-36ee-4711-864b-0cc19e4a356d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:18.370560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-819de888-36ee-4711-864b-0cc19e4a356d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:18.371178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-819de888-36ee-4711-864b-0cc19e4a356d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:18.372045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-819de888-36ee-4711-864b-0cc19e4a356d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:18.372567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-819de888-36ee-4711-864b-0cc19e4a356d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:18.373243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-819de888-36ee-4711-864b-0cc19e4a356d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:18.710195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-819de888-36ee-4711-864b-0cc19e4a356d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:18.720338 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-819de888-36ee-4711-864b-0cc19e4a356d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1317 microversion: 2.1 time: 0.374456 Oct 10 23:42:18.721057 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2342/4876] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:18 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:18.939663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-43927340-6cc7-4282-8a78-efc66e413e9f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:18.940857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-43927340-6cc7-4282-8a78-efc66e413e9f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6195ee8f-6f37-4b7a-9b30-c813010aa4cb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:18.957209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43927340-6cc7-4282-8a78-efc66e413e9f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:18.957748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43927340-6cc7-4282-8a78-efc66e413e9f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:18.958322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43927340-6cc7-4282-8a78-efc66e413e9f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:18.958932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43927340-6cc7-4282-8a78-efc66e413e9f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:18.959631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43927340-6cc7-4282-8a78-efc66e413e9f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:18.960064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43927340-6cc7-4282-8a78-efc66e413e9f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:19.324326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-43927340-6cc7-4282-8a78-efc66e413e9f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:19.354464 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-43927340-6cc7-4282-8a78-efc66e413e9f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb" status: 200 len: 1316 microversion: 2.1 time: 0.418953 Oct 10 23:42:19.359941 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2535/4877] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:18 2022] GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb => generated 1316 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:19.746599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a8ba47df-e70f-4f5d-9083-f110e5761025 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:19.747253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a8ba47df-e70f-4f5d-9083-f110e5761025 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:19.751004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:42:19.753839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=14 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:42:19.766198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8ba47df-e70f-4f5d-9083-f110e5761025 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:19.767539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8ba47df-e70f-4f5d-9083-f110e5761025 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:19.769085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8ba47df-e70f-4f5d-9083-f110e5761025 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:19.770610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8ba47df-e70f-4f5d-9083-f110e5761025 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:19.771382 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8ba47df-e70f-4f5d-9083-f110e5761025 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:19.772218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8ba47df-e70f-4f5d-9083-f110e5761025 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:20.164027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:42:20.174186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-6ebf2321-90cc-4ee5-b003-800f1ece5773 req-b109bd46-77dd-43c3-b30a-2958a1bb154e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e82c4dac-b092-4a01-a6ba-faeaf147e079", "name": "network-vif-plugged", "status": "completed", "tag": "eb15cec0-009b-460d-896d-f8a2f8e16987"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:20.224557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6ebf2321-90cc-4ee5-b003-800f1ece5773 req-b109bd46-77dd-43c3-b30a-2958a1bb154e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:20.225056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6ebf2321-90cc-4ee5-b003-800f1ece5773 req-b109bd46-77dd-43c3-b30a-2958a1bb154e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:20.225509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6ebf2321-90cc-4ee5-b003-800f1ece5773 req-b109bd46-77dd-43c3-b30a-2958a1bb154e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:20.267971 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-6ebf2321-90cc-4ee5-b003-800f1ece5773 req-b109bd46-77dd-43c3-b30a-2958a1bb154e service nova] Creating event network-vif-plugged:eb15cec0-009b-460d-896d-f8a2f8e16987 for instance e82c4dac-b092-4a01-a6ba-faeaf147e079 on n-h2-860864-2 Oct 10 23:42:20.279881 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-6ebf2321-90cc-4ee5-b003-800f1ece5773 req-b109bd46-77dd-43c3-b30a-2958a1bb154e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117691 Oct 10 23:42:20.281282 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2536/4878] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:42:20.303709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a8ba47df-e70f-4f5d-9083-f110e5761025 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:20.318246 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a8ba47df-e70f-4f5d-9083-f110e5761025 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1317 microversion: 2.1 time: 0.575762 Oct 10 23:42:20.318917 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2343/4879] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:19 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1317 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:42:20.391730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-74d1a037-9363-4c92-9a2c-4a5c847c91d1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:20.392448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-74d1a037-9363-4c92-9a2c-4a5c847c91d1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6195ee8f-6f37-4b7a-9b30-c813010aa4cb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:20.409764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74d1a037-9363-4c92-9a2c-4a5c847c91d1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:20.410556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74d1a037-9363-4c92-9a2c-4a5c847c91d1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:20.411160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74d1a037-9363-4c92-9a2c-4a5c847c91d1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:20.412357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74d1a037-9363-4c92-9a2c-4a5c847c91d1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:20.413002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74d1a037-9363-4c92-9a2c-4a5c847c91d1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:20.413761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74d1a037-9363-4c92-9a2c-4a5c847c91d1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:20.977998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-74d1a037-9363-4c92-9a2c-4a5c847c91d1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:20.981227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:42:20.990881 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-74d1a037-9363-4c92-9a2c-4a5c847c91d1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb" status: 200 len: 1316 microversion: 2.1 time: 0.605552 Oct 10 23:42:20.991491 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2537/4880] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:20 2022] GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb => generated 1316 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:21.348333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a572061e-d9ce-4381-9ab3-ec30d50fbd2a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:21.349964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a572061e-d9ce-4381-9ab3-ec30d50fbd2a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:21.367519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:42:21.379914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a572061e-d9ce-4381-9ab3-ec30d50fbd2a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:21.381100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a572061e-d9ce-4381-9ab3-ec30d50fbd2a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:21.386060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a572061e-d9ce-4381-9ab3-ec30d50fbd2a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:21.387674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a572061e-d9ce-4381-9ab3-ec30d50fbd2a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:21.389060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a572061e-d9ce-4381-9ab3-ec30d50fbd2a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:21.394013 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a572061e-d9ce-4381-9ab3-ec30d50fbd2a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:21.498134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:42:21.906354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a572061e-d9ce-4381-9ab3-ec30d50fbd2a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:21.927073 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a572061e-d9ce-4381-9ab3-ec30d50fbd2a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1317 microversion: 2.1 time: 0.587191 Oct 10 23:42:21.943650 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2344/4881] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:21 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1317 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:22.025431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-97e2f71f-f934-40f2-8416-a659a011bcf7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:22.027576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-97e2f71f-f934-40f2-8416-a659a011bcf7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6195ee8f-6f37-4b7a-9b30-c813010aa4cb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:22.037506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97e2f71f-f934-40f2-8416-a659a011bcf7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:22.038054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97e2f71f-f934-40f2-8416-a659a011bcf7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:22.041040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97e2f71f-f934-40f2-8416-a659a011bcf7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:22.042387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97e2f71f-f934-40f2-8416-a659a011bcf7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:22.043318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97e2f71f-f934-40f2-8416-a659a011bcf7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:22.044142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97e2f71f-f934-40f2-8416-a659a011bcf7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:22.434005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-97e2f71f-f934-40f2-8416-a659a011bcf7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:22.455600 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-97e2f71f-f934-40f2-8416-a659a011bcf7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb" status: 200 len: 1316 microversion: 2.1 time: 0.434381 Oct 10 23:42:22.457445 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2538/4882] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:22 2022] GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:22.968687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bfb24ae5-b78d-46b5-af71-eb5d8004d247 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:22.972318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bfb24ae5-b78d-46b5-af71-eb5d8004d247 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:22.979910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bfb24ae5-b78d-46b5-af71-eb5d8004d247 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:22.980952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bfb24ae5-b78d-46b5-af71-eb5d8004d247 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:22.982288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bfb24ae5-b78d-46b5-af71-eb5d8004d247 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:22.983658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bfb24ae5-b78d-46b5-af71-eb5d8004d247 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:22.984619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bfb24ae5-b78d-46b5-af71-eb5d8004d247 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:22.985700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bfb24ae5-b78d-46b5-af71-eb5d8004d247 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:23.234694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bfb24ae5-b78d-46b5-af71-eb5d8004d247 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:23.246336 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bfb24ae5-b78d-46b5-af71-eb5d8004d247 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1508 microversion: 2.1 time: 0.282717 Oct 10 23:42:23.247208 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2345/4883] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:22 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1508 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:23.270444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ecacace1-5d66-4531-8d87-f3835e8c6ee4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:23.271672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ecacace1-5d66-4531-8d87-f3835e8c6ee4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:23.280809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecacace1-5d66-4531-8d87-f3835e8c6ee4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:23.281988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecacace1-5d66-4531-8d87-f3835e8c6ee4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:23.282612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecacace1-5d66-4531-8d87-f3835e8c6ee4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:23.283522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecacace1-5d66-4531-8d87-f3835e8c6ee4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:23.284149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecacace1-5d66-4531-8d87-f3835e8c6ee4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:23.284771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecacace1-5d66-4531-8d87-f3835e8c6ee4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:23.484290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9c0805b6-2c10-4c5d-ad67-758122c072c1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:23.485526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9c0805b6-2c10-4c5d-ad67-758122c072c1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6195ee8f-6f37-4b7a-9b30-c813010aa4cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:23.497985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c0805b6-2c10-4c5d-ad67-758122c072c1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:23.502893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c0805b6-2c10-4c5d-ad67-758122c072c1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:23.503773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c0805b6-2c10-4c5d-ad67-758122c072c1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:23.505295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c0805b6-2c10-4c5d-ad67-758122c072c1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:23.507054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c0805b6-2c10-4c5d-ad67-758122c072c1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:23.507695 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c0805b6-2c10-4c5d-ad67-758122c072c1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:23.540535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ecacace1-5d66-4531-8d87-f3835e8c6ee4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:23.550766 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ecacace1-5d66-4531-8d87-f3835e8c6ee4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1508 microversion: 2.1 time: 0.284700 Oct 10 23:42:23.551365 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2539/4884] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:23 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1508 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:23.586848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-26bfb52f-98a7-44df-867a-6ca8e62a512a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:23.591607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-26bfb52f-98a7-44df-867a-6ca8e62a512a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:23.605243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26bfb52f-98a7-44df-867a-6ca8e62a512a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:23.606019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26bfb52f-98a7-44df-867a-6ca8e62a512a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:23.606642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26bfb52f-98a7-44df-867a-6ca8e62a512a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:23.607531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26bfb52f-98a7-44df-867a-6ca8e62a512a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:23.608424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26bfb52f-98a7-44df-867a-6ca8e62a512a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:23.608982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26bfb52f-98a7-44df-867a-6ca8e62a512a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:23.704318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-26bfb52f-98a7-44df-867a-6ca8e62a512a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:42:23.705004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-26bfb52f-98a7-44df-867a-6ca8e62a512a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:42:23.705694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-26bfb52f-98a7-44df-867a-6ca8e62a512a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:42:23.706389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-26bfb52f-98a7-44df-867a-6ca8e62a512a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:42:23.706967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-26bfb52f-98a7-44df-867a-6ca8e62a512a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:42:23.806124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-26bfb52f-98a7-44df-867a-6ca8e62a512a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:23.830932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26bfb52f-98a7-44df-867a-6ca8e62a512a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:23.831541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26bfb52f-98a7-44df-867a-6ca8e62a512a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:23.832049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26bfb52f-98a7-44df-867a-6ca8e62a512a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:23.833040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26bfb52f-98a7-44df-867a-6ca8e62a512a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:23.833614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26bfb52f-98a7-44df-867a-6ca8e62a512a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:23.834106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26bfb52f-98a7-44df-867a-6ca8e62a512a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:23.884727 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-26bfb52f-98a7-44df-867a-6ca8e62a512a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "POST /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079/action" status: 202 len: 1110 microversion: 2.1 time: 0.301148 Oct 10 23:42:23.886026 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2540/4885] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:42:23 2022] POST /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079/action => generated 1110 bytes in 304 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 10 23:42:23.917544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4d29bfec-cb1b-438c-894c-daf2e144f11c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:23.925308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4d29bfec-cb1b-438c-894c-daf2e144f11c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:23.974179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d29bfec-cb1b-438c-894c-daf2e144f11c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:23.974877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d29bfec-cb1b-438c-894c-daf2e144f11c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:23.975510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d29bfec-cb1b-438c-894c-daf2e144f11c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:23.976748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d29bfec-cb1b-438c-894c-daf2e144f11c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:23.977640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d29bfec-cb1b-438c-894c-daf2e144f11c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:23.979312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d29bfec-cb1b-438c-894c-daf2e144f11c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:24.010564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9c0805b6-2c10-4c5d-ad67-758122c072c1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:24.034474 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9c0805b6-2c10-4c5d-ad67-758122c072c1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb" status: 200 len: 1316 microversion: 2.1 time: 0.553965 Oct 10 23:42:24.035125 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2346/4886] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:23 2022] GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb => generated 1316 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:24.122079 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e762875d-3037-40e1-aff7-102e13d1c1da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:24.123170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e762875d-3037-40e1-aff7-102e13d1c1da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:24.154374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e762875d-3037-40e1-aff7-102e13d1c1da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:24.155218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e762875d-3037-40e1-aff7-102e13d1c1da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:24.155691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e762875d-3037-40e1-aff7-102e13d1c1da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:24.156446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e762875d-3037-40e1-aff7-102e13d1c1da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:24.156909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e762875d-3037-40e1-aff7-102e13d1c1da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:24.157340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e762875d-3037-40e1-aff7-102e13d1c1da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:24.218859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4d29bfec-cb1b-438c-894c-daf2e144f11c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:24.238943 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4d29bfec-cb1b-438c-894c-daf2e144f11c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1515 microversion: 2.1 time: 0.327908 Oct 10 23:42:24.239986 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2541/4887] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:23 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1515 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:24.258931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-67428b1a-3239-4773-8bbe-6a04f4eafdc6 req-dc473525-8f21-47ae-9597-10036ba8e82b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6195ee8f-6f37-4b7a-9b30-c813010aa4cb", "name": "network-vif-plugged", "status": "completed", "tag": "e1e5362b-2914-434e-8643-278df7867b73"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:24.270314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-67428b1a-3239-4773-8bbe-6a04f4eafdc6 req-dc473525-8f21-47ae-9597-10036ba8e82b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:24.270799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-67428b1a-3239-4773-8bbe-6a04f4eafdc6 req-dc473525-8f21-47ae-9597-10036ba8e82b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:24.272040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-67428b1a-3239-4773-8bbe-6a04f4eafdc6 req-dc473525-8f21-47ae-9597-10036ba8e82b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:24.286722 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-67428b1a-3239-4773-8bbe-6a04f4eafdc6 req-dc473525-8f21-47ae-9597-10036ba8e82b service nova] Creating event network-vif-plugged:e1e5362b-2914-434e-8643-278df7867b73 for instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb on n-h1-860864-2 Oct 10 23:42:24.292911 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-67428b1a-3239-4773-8bbe-6a04f4eafdc6 req-dc473525-8f21-47ae-9597-10036ba8e82b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051309 Oct 10 23:42:24.294389 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2542/4888] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:42:24.855550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e762875d-3037-40e1-aff7-102e13d1c1da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:24.868888 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e762875d-3037-40e1-aff7-102e13d1c1da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.755364 Oct 10 23:42:24.869849 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2347/4889] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:24 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:24.895410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dfa09862-8f46-4a87-b26a-2171644d74b2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:24.898511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dfa09862-8f46-4a87-b26a-2171644d74b2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:24.914588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfa09862-8f46-4a87-b26a-2171644d74b2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:24.919545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfa09862-8f46-4a87-b26a-2171644d74b2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:24.920140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfa09862-8f46-4a87-b26a-2171644d74b2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:24.924338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfa09862-8f46-4a87-b26a-2171644d74b2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:24.925015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfa09862-8f46-4a87-b26a-2171644d74b2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:24.925765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfa09862-8f46-4a87-b26a-2171644d74b2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:25.078066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-20abfba2-eb4b-41a8-ac62-740df331db7b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:25.078879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-20abfba2-eb4b-41a8-ac62-740df331db7b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6195ee8f-6f37-4b7a-9b30-c813010aa4cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:25.091849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20abfba2-eb4b-41a8-ac62-740df331db7b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:25.094691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20abfba2-eb4b-41a8-ac62-740df331db7b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:25.095185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20abfba2-eb4b-41a8-ac62-740df331db7b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:25.095935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20abfba2-eb4b-41a8-ac62-740df331db7b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:25.096400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20abfba2-eb4b-41a8-ac62-740df331db7b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:25.096834 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20abfba2-eb4b-41a8-ac62-740df331db7b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:25.166480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dfa09862-8f46-4a87-b26a-2171644d74b2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:25.175317 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dfa09862-8f46-4a87-b26a-2171644d74b2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.284338 Oct 10 23:42:25.194108 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2543/4890] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:24 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:25.208803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6b825592-f9e3-4f94-92f5-e071db036a2e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:25.209762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6b825592-f9e3-4f94-92f5-e071db036a2e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:25.226321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b825592-f9e3-4f94-92f5-e071db036a2e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:25.227076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b825592-f9e3-4f94-92f5-e071db036a2e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:25.227859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b825592-f9e3-4f94-92f5-e071db036a2e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:25.228863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b825592-f9e3-4f94-92f5-e071db036a2e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:25.229554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b825592-f9e3-4f94-92f5-e071db036a2e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:25.231614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b825592-f9e3-4f94-92f5-e071db036a2e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:25.659582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6b825592-f9e3-4f94-92f5-e071db036a2e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:25.678340 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6b825592-f9e3-4f94-92f5-e071db036a2e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.469138 Oct 10 23:42:25.696025 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2544/4891] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:25 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:42:25.713271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-be6682d0-5aca-4f76-83b7-c920493c97dd tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:25.713957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-be6682d0-5aca-4f76-83b7-c920493c97dd tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:25.754314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be6682d0-5aca-4f76-83b7-c920493c97dd tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:25.754822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be6682d0-5aca-4f76-83b7-c920493c97dd tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:25.758581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be6682d0-5aca-4f76-83b7-c920493c97dd tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:25.762275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be6682d0-5aca-4f76-83b7-c920493c97dd tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:25.767345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be6682d0-5aca-4f76-83b7-c920493c97dd tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:25.769065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be6682d0-5aca-4f76-83b7-c920493c97dd tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:25.893860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-20abfba2-eb4b-41a8-ac62-740df331db7b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:25.903034 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-20abfba2-eb4b-41a8-ac62-740df331db7b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb" status: 200 len: 1316 microversion: 2.1 time: 0.829803 Oct 10 23:42:25.903624 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2348/4892] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:25 2022] GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb => generated 1316 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:42:25.915623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0959f1ad-02ac-4d3e-8031-4b4b4cc641bc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-243139401"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:25.922783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0959f1ad-02ac-4d3e-8031-4b4b4cc641bc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:25.940296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0959f1ad-02ac-4d3e-8031-4b4b4cc641bc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:25.941027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0959f1ad-02ac-4d3e-8031-4b4b4cc641bc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:25.941713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0959f1ad-02ac-4d3e-8031-4b4b4cc641bc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:25.942615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0959f1ad-02ac-4d3e-8031-4b4b4cc641bc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:25.943936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0959f1ad-02ac-4d3e-8031-4b4b4cc641bc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:25.947226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0959f1ad-02ac-4d3e-8031-4b4b4cc641bc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:26.069495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-be6682d0-5aca-4f76-83b7-c920493c97dd tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:26.080011 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-be6682d0-5aca-4f76-83b7-c920493c97dd tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1515 microversion: 2.1 time: 0.380255 Oct 10 23:42:26.084588 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2545/4893] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:25 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1515 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:26.402036 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0959f1ad-02ac-4d3e-8031-4b4b4cc641bc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action" status: 202 len: 0 microversion: 2.1 time: 0.494830 Oct 10 23:42:26.414102 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2349/4894] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:42:25 2022] POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 10 23:42:26.932356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b07dfa3a-7fdf-4ce2-ace3-508b56045779 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:26.932959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b07dfa3a-7fdf-4ce2-ace3-508b56045779 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6195ee8f-6f37-4b7a-9b30-c813010aa4cb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:26.949818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b07dfa3a-7fdf-4ce2-ace3-508b56045779 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:26.950604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b07dfa3a-7fdf-4ce2-ace3-508b56045779 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:26.951303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b07dfa3a-7fdf-4ce2-ace3-508b56045779 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:26.952678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b07dfa3a-7fdf-4ce2-ace3-508b56045779 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:26.953404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b07dfa3a-7fdf-4ce2-ace3-508b56045779 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:26.954198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b07dfa3a-7fdf-4ce2-ace3-508b56045779 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:27.113428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-70342e1a-556c-4b52-8fcf-c8559a7d5d78 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:27.114358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-70342e1a-556c-4b52-8fcf-c8559a7d5d78 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:27.122255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70342e1a-556c-4b52-8fcf-c8559a7d5d78 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:27.123014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70342e1a-556c-4b52-8fcf-c8559a7d5d78 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:27.124286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70342e1a-556c-4b52-8fcf-c8559a7d5d78 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:27.125016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70342e1a-556c-4b52-8fcf-c8559a7d5d78 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:27.125492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70342e1a-556c-4b52-8fcf-c8559a7d5d78 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:27.125925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70342e1a-556c-4b52-8fcf-c8559a7d5d78 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:27.236330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b07dfa3a-7fdf-4ce2-ace3-508b56045779 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:27.253472 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b07dfa3a-7fdf-4ce2-ace3-508b56045779 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb" status: 200 len: 1505 microversion: 2.1 time: 0.326078 Oct 10 23:42:27.254479 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2546/4895] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:26 2022] GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:27.277335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-87cc1c5e-deca-4bf7-bac3-e9e27ef9d26f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:27.278100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-87cc1c5e-deca-4bf7-bac3-e9e27ef9d26f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6195ee8f-6f37-4b7a-9b30-c813010aa4cb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:27.281921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=78 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:42:27.293572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87cc1c5e-deca-4bf7-bac3-e9e27ef9d26f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:27.294256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87cc1c5e-deca-4bf7-bac3-e9e27ef9d26f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:27.294867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87cc1c5e-deca-4bf7-bac3-e9e27ef9d26f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:27.296669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87cc1c5e-deca-4bf7-bac3-e9e27ef9d26f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:27.297335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87cc1c5e-deca-4bf7-bac3-e9e27ef9d26f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:27.297958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87cc1c5e-deca-4bf7-bac3-e9e27ef9d26f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:27.339131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-87cc1c5e-deca-4bf7-bac3-e9e27ef9d26f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6195ee8f-6f37-4b7a-9b30-c813010aa4cb] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:42:27.402040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-70342e1a-556c-4b52-8fcf-c8559a7d5d78 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:27.443314 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-70342e1a-556c-4b52-8fcf-c8559a7d5d78 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1515 microversion: 2.1 time: 0.335968 Oct 10 23:42:27.444273 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2350/4896] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:27 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1515 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:27.498193 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-87cc1c5e-deca-4bf7-bac3-e9e27ef9d26f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb" status: 204 len: 0 microversion: 2.1 time: 0.224201 Oct 10 23:42:27.501757 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2547/4897] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:42:27 2022] DELETE /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 23:42:27.508775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8fdb76ce-5f43-4abe-b1b6-b2f26d27e7e7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:27.510437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8fdb76ce-5f43-4abe-b1b6-b2f26d27e7e7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6195ee8f-6f37-4b7a-9b30-c813010aa4cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:27.520399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fdb76ce-5f43-4abe-b1b6-b2f26d27e7e7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:27.521458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fdb76ce-5f43-4abe-b1b6-b2f26d27e7e7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:27.522339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fdb76ce-5f43-4abe-b1b6-b2f26d27e7e7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:27.524751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fdb76ce-5f43-4abe-b1b6-b2f26d27e7e7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:27.525745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fdb76ce-5f43-4abe-b1b6-b2f26d27e7e7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:27.526659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8fdb76ce-5f43-4abe-b1b6-b2f26d27e7e7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:27.796126 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8fdb76ce-5f43-4abe-b1b6-b2f26d27e7e7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:27.812187 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8fdb76ce-5f43-4abe-b1b6-b2f26d27e7e7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb" status: 200 len: 1511 microversion: 2.1 time: 0.306627 Oct 10 23:42:27.814563 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2351/4898] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:27 2022] GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb => generated 1511 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:28.469407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8c4457fe-95c9-432d-a458-81c40824d847 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:28.470144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8c4457fe-95c9-432d-a458-81c40824d847 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:28.479957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c4457fe-95c9-432d-a458-81c40824d847 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:28.480765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c4457fe-95c9-432d-a458-81c40824d847 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:28.481611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c4457fe-95c9-432d-a458-81c40824d847 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:28.482534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c4457fe-95c9-432d-a458-81c40824d847 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:28.484490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c4457fe-95c9-432d-a458-81c40824d847 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:28.484936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c4457fe-95c9-432d-a458-81c40824d847 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:28.725085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8c4457fe-95c9-432d-a458-81c40824d847 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:28.734325 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8c4457fe-95c9-432d-a458-81c40824d847 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1515 microversion: 2.1 time: 0.269608 Oct 10 23:42:28.735206 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2548/4899] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:28 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1515 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:28.836191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-69a54ecf-755c-402f-a4da-b90a60cc8e3f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:28.837448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-69a54ecf-755c-402f-a4da-b90a60cc8e3f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6195ee8f-6f37-4b7a-9b30-c813010aa4cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:28.850954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69a54ecf-755c-402f-a4da-b90a60cc8e3f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:28.863698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69a54ecf-755c-402f-a4da-b90a60cc8e3f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:28.864427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69a54ecf-755c-402f-a4da-b90a60cc8e3f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:28.865525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69a54ecf-755c-402f-a4da-b90a60cc8e3f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:28.866253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69a54ecf-755c-402f-a4da-b90a60cc8e3f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:28.866881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69a54ecf-755c-402f-a4da-b90a60cc8e3f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:29.203824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-69a54ecf-755c-402f-a4da-b90a60cc8e3f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:29.211396 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-69a54ecf-755c-402f-a4da-b90a60cc8e3f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb" status: 200 len: 1511 microversion: 2.1 time: 0.379013 Oct 10 23:42:29.211990 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2352/4900] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:28 2022] GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb => generated 1511 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:29.762940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-89bc6acf-4b32-49fd-9cbb-25be12a85af6 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:29.763755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-89bc6acf-4b32-49fd-9cbb-25be12a85af6 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:29.771072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89bc6acf-4b32-49fd-9cbb-25be12a85af6 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:29.771721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89bc6acf-4b32-49fd-9cbb-25be12a85af6 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:29.772257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89bc6acf-4b32-49fd-9cbb-25be12a85af6 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:29.773072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89bc6acf-4b32-49fd-9cbb-25be12a85af6 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:29.773664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89bc6acf-4b32-49fd-9cbb-25be12a85af6 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:29.774202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89bc6acf-4b32-49fd-9cbb-25be12a85af6 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:29.994629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-89bc6acf-4b32-49fd-9cbb-25be12a85af6 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:30.023933 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-89bc6acf-4b32-49fd-9cbb-25be12a85af6 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1515 microversion: 2.1 time: 0.248911 Oct 10 23:42:30.026220 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2549/4901] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:29 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1515 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:30.237368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-73c8f720-c3c5-44ec-b66c-2fafd7f3f266 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:30.238418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-73c8f720-c3c5-44ec-b66c-2fafd7f3f266 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6195ee8f-6f37-4b7a-9b30-c813010aa4cb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:30.254356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73c8f720-c3c5-44ec-b66c-2fafd7f3f266 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:30.254892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73c8f720-c3c5-44ec-b66c-2fafd7f3f266 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:30.260848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73c8f720-c3c5-44ec-b66c-2fafd7f3f266 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:30.261686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73c8f720-c3c5-44ec-b66c-2fafd7f3f266 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:30.262186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73c8f720-c3c5-44ec-b66c-2fafd7f3f266 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:30.263640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73c8f720-c3c5-44ec-b66c-2fafd7f3f266 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:30.489472 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-73c8f720-c3c5-44ec-b66c-2fafd7f3f266 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:30.501906 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-73c8f720-c3c5-44ec-b66c-2fafd7f3f266 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb" status: 200 len: 1301 microversion: 2.1 time: 0.268643 Oct 10 23:42:30.503937 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2550/4902] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:30 2022] GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb => generated 1301 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:30.698109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-8998a640-d8bb-4b53-b358-ad0432c62b93 req-007d5cdc-0d1b-41bc-a376-48659f1b78a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6195ee8f-6f37-4b7a-9b30-c813010aa4cb", "name": "network-vif-deleted", "tag": "e1e5362b-2914-434e-8643-278df7867b73"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:30.740438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8998a640-d8bb-4b53-b358-ad0432c62b93 req-007d5cdc-0d1b-41bc-a376-48659f1b78a1 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:30.742079 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8998a640-d8bb-4b53-b358-ad0432c62b93 req-007d5cdc-0d1b-41bc-a376-48659f1b78a1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:30.757663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8998a640-d8bb-4b53-b358-ad0432c62b93 req-007d5cdc-0d1b-41bc-a376-48659f1b78a1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:30.790356 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-8998a640-d8bb-4b53-b358-ad0432c62b93 req-007d5cdc-0d1b-41bc-a376-48659f1b78a1 service nova] Creating event network-vif-deleted:e1e5362b-2914-434e-8643-278df7867b73 for instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb on n-h1-860864-2 Oct 10 23:42:30.806907 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-8998a640-d8bb-4b53-b358-ad0432c62b93 req-007d5cdc-0d1b-41bc-a376-48659f1b78a1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.579114 Oct 10 23:42:30.808732 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2353/4903] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:42:31.051614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-03b01e03-607c-43c8-abc6-2f26c830e33d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:31.052250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-03b01e03-607c-43c8-abc6-2f26c830e33d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:31.070554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03b01e03-607c-43c8-abc6-2f26c830e33d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:31.072423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03b01e03-607c-43c8-abc6-2f26c830e33d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:31.072899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03b01e03-607c-43c8-abc6-2f26c830e33d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:31.093614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03b01e03-607c-43c8-abc6-2f26c830e33d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:31.094236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03b01e03-607c-43c8-abc6-2f26c830e33d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:31.094856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03b01e03-607c-43c8-abc6-2f26c830e33d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:31.111957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:42:31.432483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-03b01e03-607c-43c8-abc6-2f26c830e33d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:31.447740 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-03b01e03-607c-43c8-abc6-2f26c830e33d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1515 microversion: 2.1 time: 0.399426 Oct 10 23:42:31.452847 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2551/4904] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:31 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1515 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:42:31.532266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-679d1cf2-0021-494e-b7e9-957b822f54ed tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:31.533699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-679d1cf2-0021-494e-b7e9-957b822f54ed tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6195ee8f-6f37-4b7a-9b30-c813010aa4cb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:31.555797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-679d1cf2-0021-494e-b7e9-957b822f54ed tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:31.556320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-679d1cf2-0021-494e-b7e9-957b822f54ed tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:31.556745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-679d1cf2-0021-494e-b7e9-957b822f54ed tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:31.557507 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-679d1cf2-0021-494e-b7e9-957b822f54ed tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:31.557980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-679d1cf2-0021-494e-b7e9-957b822f54ed tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:31.558395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-679d1cf2-0021-494e-b7e9-957b822f54ed tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:31.597437 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-679d1cf2-0021-494e-b7e9-957b822f54ed tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-679d1cf2-0021-494e-b7e9-957b822f54ed tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb HTTP/1.1 Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '6195ee8f-6f37-4b7a-9b30-c813010aa4cb'} Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:31.599422 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:31.605559 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:31.605559 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:31.605559 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:31.605559 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:42:31.605559 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:42:31.605559 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:42:31.605559 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:31.609661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-679d1cf2-0021-494e-b7e9-957b822f54ed tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 404 to user: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:42:31.610446 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-679d1cf2-0021-494e-b7e9-957b822f54ed tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb" status: 404 len: 111 microversion: 2.1 time: 0.086430 Oct 10 23:42:31.611200 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2354/4905] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:31 2022] GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:42:31.620312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-270fa313-399b-4032-9780-ee25d66064f2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:31.621138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-270fa313-399b-4032-9780-ee25d66064f2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:31.631396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-270fa313-399b-4032-9780-ee25d66064f2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:31.639730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-270fa313-399b-4032-9780-ee25d66064f2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:31.648836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-270fa313-399b-4032-9780-ee25d66064f2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:31.649712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-270fa313-399b-4032-9780-ee25d66064f2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:31.651716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-270fa313-399b-4032-9780-ee25d66064f2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:31.652384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-270fa313-399b-4032-9780-ee25d66064f2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:31.955343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-270fa313-399b-4032-9780-ee25d66064f2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:31.971777 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-270fa313-399b-4032-9780-ee25d66064f2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.355404 Oct 10 23:42:31.977887 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2552/4906] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:31 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:32.192895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a1833c24-f24a-4792-8a70-b22f7422b09e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a1833c24-f24a-4792-8a70-b22f7422b09e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 163 Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: {"server": {"name": 12345, "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452', 'networks': [{'uuid': 'fa0ea560-35bf-4417-8cad-eb62562b3005'}]}}} Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 12345 Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:42:32.196603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:42:32.204206 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:42:32.204206 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 10 23:42:32.204206 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:32.204206 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:32.204206 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:32.204206 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:32.204206 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:32.204206 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:32.204206 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:42:32.204206 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:42:32.204206 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 10 23:42:32.204206 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:32.204206 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a1833c24-f24a-4792-8a70-b22f7422b09e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:42:32.204206 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a1833c24-f24a-4792-8a70-b22f7422b09e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.012783 Oct 10 23:42:32.207813 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2355/4907] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:42:32 2022] POST /compute/v2.1/servers => generated 127 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:42:32.212216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dc58984c-8f7d-481a-89c0-26537fa6df8e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:32.212860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dc58984c-8f7d-481a-89c0-26537fa6df8e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:32.252686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc58984c-8f7d-481a-89c0-26537fa6df8e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:32.253266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc58984c-8f7d-481a-89c0-26537fa6df8e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:32.254865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc58984c-8f7d-481a-89c0-26537fa6df8e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:32.255656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc58984c-8f7d-481a-89c0-26537fa6df8e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:32.256132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc58984c-8f7d-481a-89c0-26537fa6df8e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:32.256682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc58984c-8f7d-481a-89c0-26537fa6df8e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:32.484276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a3de4ff3-d045-4257-b0b9-e6f67ca23e97 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:32.485165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a3de4ff3-d045-4257-b0b9-e6f67ca23e97 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:32.499886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3de4ff3-d045-4257-b0b9-e6f67ca23e97 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:32.500659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3de4ff3-d045-4257-b0b9-e6f67ca23e97 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:32.501347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3de4ff3-d045-4257-b0b9-e6f67ca23e97 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:32.502287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3de4ff3-d045-4257-b0b9-e6f67ca23e97 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:32.502905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3de4ff3-d045-4257-b0b9-e6f67ca23e97 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:32.503508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a3de4ff3-d045-4257-b0b9-e6f67ca23e97 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:32.908850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a3de4ff3-d045-4257-b0b9-e6f67ca23e97 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:32.922114 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a3de4ff3-d045-4257-b0b9-e6f67ca23e97 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1515 microversion: 2.1 time: 0.442030 Oct 10 23:42:32.925746 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2356/4908] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:32 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1515 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:42:33.015357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dc58984c-8f7d-481a-89c0-26537fa6df8e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:33.038762 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dc58984c-8f7d-481a-89c0-26537fa6df8e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.830429 Oct 10 23:42:33.039393 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2553/4909] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:32 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:33.072623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-be867fc3-27b9-4f51-b38b-a71548373bb0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:33.075262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-be867fc3-27b9-4f51-b38b-a71548373bb0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:33.090724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be867fc3-27b9-4f51-b38b-a71548373bb0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:33.091233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be867fc3-27b9-4f51-b38b-a71548373bb0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:33.094629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be867fc3-27b9-4f51-b38b-a71548373bb0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:33.095464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be867fc3-27b9-4f51-b38b-a71548373bb0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:33.098855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be867fc3-27b9-4f51-b38b-a71548373bb0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:33.099415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be867fc3-27b9-4f51-b38b-a71548373bb0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:33.336187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-2827a2e5-aebf-48f1-a7c9-755357bd85e9 req-05d5d9bb-25e8-4b00-8761-842a3f5aa64a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c65eb2-4a59-4b1e-bf11-e2094d984d0a", "name": "network-vif-plugged", "status": "completed", "tag": "db12b09d-2d47-4f71-9616-ebcc385cf4ab"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:33.363245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2827a2e5-aebf-48f1-a7c9-755357bd85e9 req-05d5d9bb-25e8-4b00-8761-842a3f5aa64a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:33.363789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2827a2e5-aebf-48f1-a7c9-755357bd85e9 req-05d5d9bb-25e8-4b00-8761-842a3f5aa64a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:33.364208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2827a2e5-aebf-48f1-a7c9-755357bd85e9 req-05d5d9bb-25e8-4b00-8761-842a3f5aa64a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:33.393367 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-2827a2e5-aebf-48f1-a7c9-755357bd85e9 req-05d5d9bb-25e8-4b00-8761-842a3f5aa64a service nova] Creating event network-vif-plugged:db12b09d-2d47-4f71-9616-ebcc385cf4ab for instance 88c65eb2-4a59-4b1e-bf11-e2094d984d0a on n-h2-860864-2 Oct 10 23:42:33.404122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-be867fc3-27b9-4f51-b38b-a71548373bb0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:33.425406 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-be867fc3-27b9-4f51-b38b-a71548373bb0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.360422 Oct 10 23:42:33.430153 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-2827a2e5-aebf-48f1-a7c9-755357bd85e9 req-05d5d9bb-25e8-4b00-8761-842a3f5aa64a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.501371 Oct 10 23:42:33.430765 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2357/4910] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:42:33.431921 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2554/4911] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:33 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:33.960163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6ba9619e-1e5a-4bab-a453-d065cdafb0cc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:33.961090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6ba9619e-1e5a-4bab-a453-d065cdafb0cc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:33.982466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ba9619e-1e5a-4bab-a453-d065cdafb0cc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:33.985826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ba9619e-1e5a-4bab-a453-d065cdafb0cc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:33.990575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ba9619e-1e5a-4bab-a453-d065cdafb0cc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:33.998430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ba9619e-1e5a-4bab-a453-d065cdafb0cc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:34.001087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ba9619e-1e5a-4bab-a453-d065cdafb0cc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:34.006235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ba9619e-1e5a-4bab-a453-d065cdafb0cc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:34.824369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6ba9619e-1e5a-4bab-a453-d065cdafb0cc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:34.854070 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6ba9619e-1e5a-4bab-a453-d065cdafb0cc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1515 microversion: 2.1 time: 0.900265 Oct 10 23:42:34.856595 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2358/4912] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:33 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1515 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:35.887335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bf850292-e0d8-4805-b901-442762187ad2 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:35.887968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bf850292-e0d8-4805-b901-442762187ad2 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:35.915512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf850292-e0d8-4805-b901-442762187ad2 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:35.916015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf850292-e0d8-4805-b901-442762187ad2 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:35.916457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf850292-e0d8-4805-b901-442762187ad2 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:35.917705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf850292-e0d8-4805-b901-442762187ad2 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:35.919654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf850292-e0d8-4805-b901-442762187ad2 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:35.920095 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf850292-e0d8-4805-b901-442762187ad2 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:36.544671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bf850292-e0d8-4805-b901-442762187ad2 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:36.573831 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bf850292-e0d8-4805-b901-442762187ad2 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1515 microversion: 2.1 time: 0.690579 Oct 10 23:42:36.574724 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2555/4913] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:35 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1515 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:37.128165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5f0301bb-10a3-4c0a-ac03-adce294082f5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-694844223", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "1bc4e3db-db28-484a-9bd7-8acf3162a5d5", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:37.350116 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-5f0301bb-10a3-4c0a-ac03-adce294082f5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Block Device 1bc4e3db-db28-484a-9bd7-8acf3162a5d5 is not bootable. Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5f0301bb-10a3-4c0a-ac03-adce294082f5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 357 Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-694844223", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "1bc4e3db-db28-484a-9bd7-8acf3162a5d5", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: exception: Block Device 1bc4e3db-db28-484a-9bd7-8acf3162a5d5 is not bootable. Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-694844223', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '1bc4e3db-db28-484a-9bd7-8acf3162a5d5'}], 'networks': [{'uuid': 'fa0ea560-35bf-4417-8cad-eb62562b3005'}]}}} Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 1bc4e3db-db28-484a-9bd7-8acf3162a5d5 is not bootable. Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:42:37.367185 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:42:37.372593 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:42:37.372593 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:42:37.372593 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:42:37.372593 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 23:42:37.372593 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 10 23:42:37.372593 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 10 23:42:37.372593 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 1bc4e3db-db28-484a-9bd7-8acf3162a5d5 is not bootable. Oct 10 23:42:37.372593 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:37.372593 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:37.372593 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:37.372593 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:37.372593 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:37.372593 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:37.372593 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:42:37.372593 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:42:37.372593 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 1bc4e3db-db28-484a-9bd7-8acf3162a5d5 is not bootable. Oct 10 23:42:37.372593 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:37.375380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5f0301bb-10a3-4c0a-ac03-adce294082f5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 400 to user: Block Device 1bc4e3db-db28-484a-9bd7-8acf3162a5d5 is not bootable. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:42:37.376456 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5f0301bb-10a3-4c0a-ac03-adce294082f5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.253479 Oct 10 23:42:37.377587 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2359/4914] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:42:37 2022] POST /compute/v2.1/servers => generated 110 bytes in 255 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:42:37.392468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2b207edb-702f-454b-a481-3d18cebe8f6f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:37.398867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2b207edb-702f-454b-a481-3d18cebe8f6f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:37.427122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b207edb-702f-454b-a481-3d18cebe8f6f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:37.427977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b207edb-702f-454b-a481-3d18cebe8f6f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:37.428564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b207edb-702f-454b-a481-3d18cebe8f6f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:37.458927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b207edb-702f-454b-a481-3d18cebe8f6f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:37.459804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b207edb-702f-454b-a481-3d18cebe8f6f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:37.464162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b207edb-702f-454b-a481-3d18cebe8f6f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:37.616447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-794a2d32-ef41-4ef4-8250-2d398ea227b9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:37.617417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-794a2d32-ef41-4ef4-8250-2d398ea227b9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:37.627750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-794a2d32-ef41-4ef4-8250-2d398ea227b9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:37.630048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-794a2d32-ef41-4ef4-8250-2d398ea227b9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:37.640246 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-794a2d32-ef41-4ef4-8250-2d398ea227b9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:37.641200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-794a2d32-ef41-4ef4-8250-2d398ea227b9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:37.641875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-794a2d32-ef41-4ef4-8250-2d398ea227b9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:37.642714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-794a2d32-ef41-4ef4-8250-2d398ea227b9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:37.842808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2b207edb-702f-454b-a481-3d18cebe8f6f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:37.869078 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2b207edb-702f-454b-a481-3d18cebe8f6f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.482585 Oct 10 23:42:37.872458 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2556/4915] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:37 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:37.899269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1acab0f4-c4e5-44c6-bfac-1dc719ce8dfa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:37.900160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1acab0f4-c4e5-44c6-bfac-1dc719ce8dfa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:37.914986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1acab0f4-c4e5-44c6-bfac-1dc719ce8dfa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:37.915786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1acab0f4-c4e5-44c6-bfac-1dc719ce8dfa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:37.916407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1acab0f4-c4e5-44c6-bfac-1dc719ce8dfa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:37.917291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1acab0f4-c4e5-44c6-bfac-1dc719ce8dfa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:37.921623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1acab0f4-c4e5-44c6-bfac-1dc719ce8dfa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:37.922878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1acab0f4-c4e5-44c6-bfac-1dc719ce8dfa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:38.053614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-794a2d32-ef41-4ef4-8250-2d398ea227b9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:38.064218 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-794a2d32-ef41-4ef4-8250-2d398ea227b9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1515 microversion: 2.1 time: 0.451707 Oct 10 23:42:38.064817 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2360/4916] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:37 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1515 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:42:38.626707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1acab0f4-c4e5-44c6-bfac-1dc719ce8dfa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:38.642547 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1acab0f4-c4e5-44c6-bfac-1dc719ce8dfa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.747076 Oct 10 23:42:38.646142 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2557/4917] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:37 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:42:39.090313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5fb6c025-2c23-4fda-be87-786b666ae5d1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:39.090927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5fb6c025-2c23-4fda-be87-786b666ae5d1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:39.133691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5fb6c025-2c23-4fda-be87-786b666ae5d1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:39.134609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5fb6c025-2c23-4fda-be87-786b666ae5d1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:39.135443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5fb6c025-2c23-4fda-be87-786b666ae5d1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:39.136385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5fb6c025-2c23-4fda-be87-786b666ae5d1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:39.141234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5fb6c025-2c23-4fda-be87-786b666ae5d1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:39.141958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5fb6c025-2c23-4fda-be87-786b666ae5d1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:39.634821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5fb6c025-2c23-4fda-be87-786b666ae5d1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:39.645897 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5fb6c025-2c23-4fda-be87-786b666ae5d1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1515 microversion: 2.1 time: 0.561288 Oct 10 23:42:39.649637 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2361/4918] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:39 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1515 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:40.690783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3b337b98-00db-422f-a8e1-3d1bafc4fa0f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:40.691397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3b337b98-00db-422f-a8e1-3d1bafc4fa0f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:40.714341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b337b98-00db-422f-a8e1-3d1bafc4fa0f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:40.715082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b337b98-00db-422f-a8e1-3d1bafc4fa0f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:40.719082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b337b98-00db-422f-a8e1-3d1bafc4fa0f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:40.720301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b337b98-00db-422f-a8e1-3d1bafc4fa0f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:40.721098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b337b98-00db-422f-a8e1-3d1bafc4fa0f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:40.722365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b337b98-00db-422f-a8e1-3d1bafc4fa0f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:41.513128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3b337b98-00db-422f-a8e1-3d1bafc4fa0f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:41.571583 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3b337b98-00db-422f-a8e1-3d1bafc4fa0f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1515 microversion: 2.1 time: 0.886292 Oct 10 23:42:41.579632 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2558/4919] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:40 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1515 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:41.821361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6d062758-d848-452b-b596-2abec57ba7dc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1089138677", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "destination_type": "local"}, {"source_type": "volume", "uuid": "ded5c497-6f13-4fec-a026-4cc6a41f44ad", "destination_type": "invalid"}], "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6d062758-d848-452b-b596-2abec57ba7dc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 495 Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1089138677", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "destination_type": "local"}, {"source_type": "volume", "uuid": "ded5c497-6f13-4fec-a026-4cc6a41f44ad", "destination_type": "invalid"}], "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1089138677', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'ded5c497-6f13-4fec-a026-4cc6a41f44ad', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'fa0ea560-35bf-4417-8cad-eb62562b3005'}]}}} Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'invalid' Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:42:41.848753 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:42:41.852793 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:42:41.852793 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:42:41.852793 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:42:41.852793 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:42:41.852793 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:42:41.852793 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:42:41.852793 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:42:41.852793 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:42:41.852793 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:42:41.852793 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 10 23:42:41.852793 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:41.852793 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:41.852793 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:41.852793 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:41.852793 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:41.852793 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:41.852793 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:42:41.852793 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:42:41.852793 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 10 23:42:41.852793 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:41.856397 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6d062758-d848-452b-b596-2abec57ba7dc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:42:41.860946 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6d062758-d848-452b-b596-2abec57ba7dc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.043500 Oct 10 23:42:41.865507 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2362/4920] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:42:41 2022] POST /compute/v2.1/servers => generated 155 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:42:41.871718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-857eb35b-e486-421a-ba07-a7bcaa5fc5fd tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:41.875401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-857eb35b-e486-421a-ba07-a7bcaa5fc5fd tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:41.898954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-857eb35b-e486-421a-ba07-a7bcaa5fc5fd tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:41.899770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-857eb35b-e486-421a-ba07-a7bcaa5fc5fd tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:41.900422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-857eb35b-e486-421a-ba07-a7bcaa5fc5fd tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:41.906148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-857eb35b-e486-421a-ba07-a7bcaa5fc5fd tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:41.906894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-857eb35b-e486-421a-ba07-a7bcaa5fc5fd tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:41.907496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-857eb35b-e486-421a-ba07-a7bcaa5fc5fd tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:42.394507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-857eb35b-e486-421a-ba07-a7bcaa5fc5fd tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:42.403813 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-857eb35b-e486-421a-ba07-a7bcaa5fc5fd tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.537212 Oct 10 23:42:42.408303 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2559/4921] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:41 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:42.433090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f5d224b8-5aa4-4540-9795-71f78e4e6753 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:42.433737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f5d224b8-5aa4-4540-9795-71f78e4e6753 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:42.449341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5d224b8-5aa4-4540-9795-71f78e4e6753 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:42.449867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5d224b8-5aa4-4540-9795-71f78e4e6753 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:42.450319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5d224b8-5aa4-4540-9795-71f78e4e6753 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:42.451059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5d224b8-5aa4-4540-9795-71f78e4e6753 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:42.456389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5d224b8-5aa4-4540-9795-71f78e4e6753 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:42.458532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5d224b8-5aa4-4540-9795-71f78e4e6753 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:42.607187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-50172493-f8be-45ff-bb75-7127782ff16d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:42.607807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-50172493-f8be-45ff-bb75-7127782ff16d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:42.618566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50172493-f8be-45ff-bb75-7127782ff16d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:42.634189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50172493-f8be-45ff-bb75-7127782ff16d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:42.634871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50172493-f8be-45ff-bb75-7127782ff16d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:42.635798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50172493-f8be-45ff-bb75-7127782ff16d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:42.636260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50172493-f8be-45ff-bb75-7127782ff16d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:42.636809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50172493-f8be-45ff-bb75-7127782ff16d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:42.741277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f5d224b8-5aa4-4540-9795-71f78e4e6753 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:42.752004 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f5d224b8-5aa4-4540-9795-71f78e4e6753 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.324181 Oct 10 23:42:42.754944 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2363/4922] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:42 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:43.049124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-14189b24-027a-4069-92d7-5e70747eceb2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-895461252", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-14189b24-027a-4069-92d7-5e70747eceb2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 491 Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-895461252", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-895461252', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'fa0ea560-35bf-4417-8cad-eb62562b3005'}]}}} Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:43.056484 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 10 23:42:43.060981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:43.065344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-14189b24-027a-4069-92d7-5e70747eceb2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:42:43.071127 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-14189b24-027a-4069-92d7-5e70747eceb2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.026944 Oct 10 23:42:43.076422 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2364/4923] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:42:43 2022] POST /compute/v2.1/servers => generated 624 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 23:42:43.111820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6c212bdc-9d72-4658-bb77-096df35f0025 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:43.113398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6c212bdc-9d72-4658-bb77-096df35f0025 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:43.131944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c212bdc-9d72-4658-bb77-096df35f0025 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:43.132577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c212bdc-9d72-4658-bb77-096df35f0025 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:43.133363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c212bdc-9d72-4658-bb77-096df35f0025 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:43.136739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c212bdc-9d72-4658-bb77-096df35f0025 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:43.139103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c212bdc-9d72-4658-bb77-096df35f0025 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:43.141149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c212bdc-9d72-4658-bb77-096df35f0025 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:43.157849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-50172493-f8be-45ff-bb75-7127782ff16d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:43.167167 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-50172493-f8be-45ff-bb75-7127782ff16d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1515 microversion: 2.1 time: 0.563810 Oct 10 23:42:43.185588 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2560/4924] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:42 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1515 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:43.661610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6c212bdc-9d72-4658-bb77-096df35f0025 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:43.664861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:42:43.679427 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6c212bdc-9d72-4658-bb77-096df35f0025 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.594595 Oct 10 23:42:43.680283 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2365/4925] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:43 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:43.710332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-942aac26-95ec-4da7-8fdb-0894dc8894a0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:43.710332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-942aac26-95ec-4da7-8fdb-0894dc8894a0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:43.726988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-942aac26-95ec-4da7-8fdb-0894dc8894a0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:43.728219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-942aac26-95ec-4da7-8fdb-0894dc8894a0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:43.729270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-942aac26-95ec-4da7-8fdb-0894dc8894a0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:43.730974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-942aac26-95ec-4da7-8fdb-0894dc8894a0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:43.732173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-942aac26-95ec-4da7-8fdb-0894dc8894a0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:43.733315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-942aac26-95ec-4da7-8fdb-0894dc8894a0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:44.182032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-942aac26-95ec-4da7-8fdb-0894dc8894a0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:44.194657 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-942aac26-95ec-4da7-8fdb-0894dc8894a0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.493034 Oct 10 23:42:44.195706 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2561/4926] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:43 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:44.216160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e5037b51-cd83-4430-a2d1-739e85fa0fca tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:44.216986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e5037b51-cd83-4430-a2d1-739e85fa0fca tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:44.238071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5037b51-cd83-4430-a2d1-739e85fa0fca tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:44.238990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5037b51-cd83-4430-a2d1-739e85fa0fca tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:44.239627 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5037b51-cd83-4430-a2d1-739e85fa0fca tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:44.240720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5037b51-cd83-4430-a2d1-739e85fa0fca tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:44.241192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5037b51-cd83-4430-a2d1-739e85fa0fca tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:44.241669 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5037b51-cd83-4430-a2d1-739e85fa0fca tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:44.512216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-480598a5-10ff-4a7a-a1a0-946ca77ea04e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-480598a5-10ff-4a7a-a1a0-946ca77ea04e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 416 Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452', 'networks': [{'uuid': 'fa0ea560-35bf-4417-8cad-eb62562b3005'}]}}} Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:44.542072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:44.546507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-480598a5-10ff-4a7a-a1a0-946ca77ea04e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:42:44.548957 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-480598a5-10ff-4a7a-a1a0-946ca77ea04e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.045937 Oct 10 23:42:44.556594 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2562/4927] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:42:44 2022] POST /compute/v2.1/servers => generated 619 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:42:44.577466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2f1c2889-0283-4aff-9e97-6f07ec5b7f6e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:44.578090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2f1c2889-0283-4aff-9e97-6f07ec5b7f6e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:44.601295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f1c2889-0283-4aff-9e97-6f07ec5b7f6e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:44.602010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f1c2889-0283-4aff-9e97-6f07ec5b7f6e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:44.602470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f1c2889-0283-4aff-9e97-6f07ec5b7f6e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:44.603222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f1c2889-0283-4aff-9e97-6f07ec5b7f6e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:44.603677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f1c2889-0283-4aff-9e97-6f07ec5b7f6e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:44.604118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f1c2889-0283-4aff-9e97-6f07ec5b7f6e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:44.646061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e5037b51-cd83-4430-a2d1-739e85fa0fca tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:44.662656 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e5037b51-cd83-4430-a2d1-739e85fa0fca tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1515 microversion: 2.1 time: 0.453247 Oct 10 23:42:44.668405 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2366/4928] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:44 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1515 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:45.144075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2f1c2889-0283-4aff-9e97-6f07ec5b7f6e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:45.159151 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2f1c2889-0283-4aff-9e97-6f07ec5b7f6e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.601350 Oct 10 23:42:45.162859 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2563/4929] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:44 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:45.208968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7d156497-4dc2-4d4a-bdd3-2751239befa3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:45.210074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7d156497-4dc2-4d4a-bdd3-2751239befa3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:45.219650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d156497-4dc2-4d4a-bdd3-2751239befa3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:45.221597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d156497-4dc2-4d4a-bdd3-2751239befa3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:45.222307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d156497-4dc2-4d4a-bdd3-2751239befa3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:45.223425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d156497-4dc2-4d4a-bdd3-2751239befa3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:45.224226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d156497-4dc2-4d4a-bdd3-2751239befa3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:45.225067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d156497-4dc2-4d4a-bdd3-2751239befa3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:45.540711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7d156497-4dc2-4d4a-bdd3-2751239befa3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:45.553532 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7d156497-4dc2-4d4a-bdd3-2751239befa3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.347940 Oct 10 23:42:45.556295 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2367/4930] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:45 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:45.688950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-53a8371e-98ec-4d20-bcab-9789c7df4b3b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:45.689735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-53a8371e-98ec-4d20-bcab-9789c7df4b3b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:45.699310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53a8371e-98ec-4d20-bcab-9789c7df4b3b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:45.699815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53a8371e-98ec-4d20-bcab-9789c7df4b3b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:45.700267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53a8371e-98ec-4d20-bcab-9789c7df4b3b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:45.703457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53a8371e-98ec-4d20-bcab-9789c7df4b3b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:45.707044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53a8371e-98ec-4d20-bcab-9789c7df4b3b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:45.708135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53a8371e-98ec-4d20-bcab-9789c7df4b3b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:45.795055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4669cec3-d9b4-46d2-b710-487c140328da tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-411899588", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": -1, "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:45.815504 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-4669cec3-d9b4-46d2-b710-487c140328da tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Flavor -1 could not be found. Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4669cec3-d9b4-46d2-b710-487c140328da tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 205 Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-411899588", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": -1, "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: exception: Flavor -1 could not be found. Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-411899588', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': -1, 'networks': [{'uuid': 'fa0ea560-35bf-4417-8cad-eb62562b3005'}]}}} Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:42:45.833818 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:42:45.839581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:42:45.839581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:42:45.839581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:42:45.839581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:42:45.839581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 23:42:45.839581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 10 23:42:45.839581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 10 23:42:45.839581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 10 23:42:45.839581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:45.839581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:45.839581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:45.839581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:45.839581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:45.839581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:45.839581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:42:45.839581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:42:45.839581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 10 23:42:45.839581 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:45.839581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4669cec3-d9b4-46d2-b710-487c140328da tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:42:45.846024 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4669cec3-d9b4-46d2-b710-487c140328da tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.044608 Oct 10 23:42:45.854633 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2368/4931] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:42:45 2022] POST /compute/v2.1/servers => generated 73 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 23:42:45.913329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0ea6416d-a631-488d-8af4-3e791feccd89 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:45.913329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0ea6416d-a631-488d-8af4-3e791feccd89 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:45.923850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ea6416d-a631-488d-8af4-3e791feccd89 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:45.924366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ea6416d-a631-488d-8af4-3e791feccd89 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:45.924876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ea6416d-a631-488d-8af4-3e791feccd89 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:45.925651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ea6416d-a631-488d-8af4-3e791feccd89 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:45.926099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ea6416d-a631-488d-8af4-3e791feccd89 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:45.926543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ea6416d-a631-488d-8af4-3e791feccd89 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:46.090833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-53a8371e-98ec-4d20-bcab-9789c7df4b3b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:46.125759 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-53a8371e-98ec-4d20-bcab-9789c7df4b3b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1515 microversion: 2.1 time: 0.440647 Oct 10 23:42:46.130931 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2564/4932] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:45 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1515 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:46.240054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0ea6416d-a631-488d-8af4-3e791feccd89 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:46.250323 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0ea6416d-a631-488d-8af4-3e791feccd89 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.394136 Oct 10 23:42:46.251727 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2369/4933] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:45 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:46.288364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a927a757-e592-4046-b6d4-b1c2024098b4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:46.289012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a927a757-e592-4046-b6d4-b1c2024098b4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:46.296813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a927a757-e592-4046-b6d4-b1c2024098b4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:46.298873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a927a757-e592-4046-b6d4-b1c2024098b4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:46.300067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a927a757-e592-4046-b6d4-b1c2024098b4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:46.301561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a927a757-e592-4046-b6d4-b1c2024098b4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:46.302268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a927a757-e592-4046-b6d4-b1c2024098b4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:46.303127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a927a757-e592-4046-b6d4-b1c2024098b4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:46.662428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a927a757-e592-4046-b6d4-b1c2024098b4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:46.691990 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a927a757-e592-4046-b6d4-b1c2024098b4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.413127 Oct 10 23:42:46.693604 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2565/4934] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:46 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:47.066235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-53f08116-36bc-4e2b-945d-e12127e11ab7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1642981220", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-53f08116-36bc-4e2b-945d-e12127e11ab7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 173 Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1642981220", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1642981220', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'fa0ea560-35bf-4417-8cad-eb62562b3005'}]}}} Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi -1 Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:42:47.070711 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:42:47.078133 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:42:47.078133 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:42:47.078133 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:42:47.078133 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 10 23:42:47.078133 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:47.078133 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:47.078133 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:47.078133 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:47.078133 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:47.078133 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:47.078133 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:42:47.078133 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:42:47.078133 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 10 23:42:47.078133 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:47.078133 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-53f08116-36bc-4e2b-945d-e12127e11ab7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:42:47.094681 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-53f08116-36bc-4e2b-945d-e12127e11ab7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.035915 Oct 10 23:42:47.095326 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2370/4935] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:42:47 2022] POST /compute/v2.1/servers => generated 145 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:42:47.105070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d37eb25e-a277-4964-a874-f5481e39cc4f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:47.105070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d37eb25e-a277-4964-a874-f5481e39cc4f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:47.135341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d37eb25e-a277-4964-a874-f5481e39cc4f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:47.135852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d37eb25e-a277-4964-a874-f5481e39cc4f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:47.136300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d37eb25e-a277-4964-a874-f5481e39cc4f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:47.137067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d37eb25e-a277-4964-a874-f5481e39cc4f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:47.137566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d37eb25e-a277-4964-a874-f5481e39cc4f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:47.138001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d37eb25e-a277-4964-a874-f5481e39cc4f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:47.152529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fe4926f1-5870-4c81-be2f-6e81060113f4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:47.155483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fe4926f1-5870-4c81-be2f-6e81060113f4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:47.167069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe4926f1-5870-4c81-be2f-6e81060113f4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:47.167958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe4926f1-5870-4c81-be2f-6e81060113f4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:47.168635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe4926f1-5870-4c81-be2f-6e81060113f4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:47.169681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe4926f1-5870-4c81-be2f-6e81060113f4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:47.170880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe4926f1-5870-4c81-be2f-6e81060113f4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:47.172341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe4926f1-5870-4c81-be2f-6e81060113f4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:47.410819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d37eb25e-a277-4964-a874-f5481e39cc4f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:47.431504 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d37eb25e-a277-4964-a874-f5481e39cc4f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.331335 Oct 10 23:42:47.432743 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2566/4936] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:47 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:42:47.464431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-30143fdf-47e3-4f59-a9ed-b0c25510d462 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:47.465636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-30143fdf-47e3-4f59-a9ed-b0c25510d462 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:47.473663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30143fdf-47e3-4f59-a9ed-b0c25510d462 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:47.474530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30143fdf-47e3-4f59-a9ed-b0c25510d462 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:47.475171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30143fdf-47e3-4f59-a9ed-b0c25510d462 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:47.476438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30143fdf-47e3-4f59-a9ed-b0c25510d462 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:47.477173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30143fdf-47e3-4f59-a9ed-b0c25510d462 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:47.478034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30143fdf-47e3-4f59-a9ed-b0c25510d462 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:47.639662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fe4926f1-5870-4c81-be2f-6e81060113f4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:47.653252 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fe4926f1-5870-4c81-be2f-6e81060113f4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1515 microversion: 2.1 time: 0.505477 Oct 10 23:42:47.669880 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2371/4937] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:47 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1515 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:42:47.792183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-30143fdf-47e3-4f59-a9ed-b0c25510d462 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:47.804054 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-30143fdf-47e3-4f59-a9ed-b0c25510d462 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.345770 Oct 10 23:42:47.806838 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2567/4938] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:47 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:47.941056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1c8644c0-ca59-4d96-9e03-7586a879d824 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1101704605", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:47.947339 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-1c8644c0-ca59-4d96-9e03-7586a879d824 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1c8644c0-ca59-4d96-9e03-7586a879d824 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 216 Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1101704605", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1101704605', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:47.949803 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:47.956409 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:47.956409 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:47.956409 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:47.956409 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:47.956409 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:42:47.956409 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:42:47.956409 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 10 23:42:47.956409 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:47.960048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1c8644c0-ca59-4d96-9e03-7586a879d824 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:42:47.961908 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1c8644c0-ca59-4d96-9e03-7586a879d824 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.026656 Oct 10 23:42:47.966907 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2372/4939] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:42:47 2022] POST /compute/v2.1/servers => generated 123 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:42:47.978970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-37fdc512-80b1-4498-9e27-4fff709b10fe tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:47.979978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-37fdc512-80b1-4498-9e27-4fff709b10fe tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:47.992425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37fdc512-80b1-4498-9e27-4fff709b10fe tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:47.993242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37fdc512-80b1-4498-9e27-4fff709b10fe tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:47.993975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37fdc512-80b1-4498-9e27-4fff709b10fe tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:47.994910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37fdc512-80b1-4498-9e27-4fff709b10fe tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:47.995555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37fdc512-80b1-4498-9e27-4fff709b10fe tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:47.996158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37fdc512-80b1-4498-9e27-4fff709b10fe tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:48.478402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-37fdc512-80b1-4498-9e27-4fff709b10fe tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:48.521314 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-37fdc512-80b1-4498-9e27-4fff709b10fe tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.546516 Oct 10 23:42:48.534649 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2568/4940] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:47 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:48.567247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-77fff81f-925e-4874-a077-0636825f2ce4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:48.567976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-77fff81f-925e-4874-a077-0636825f2ce4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:48.593035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77fff81f-925e-4874-a077-0636825f2ce4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:48.593910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77fff81f-925e-4874-a077-0636825f2ce4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:48.595594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77fff81f-925e-4874-a077-0636825f2ce4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:48.600283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77fff81f-925e-4874-a077-0636825f2ce4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:48.600821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77fff81f-925e-4874-a077-0636825f2ce4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:48.602924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77fff81f-925e-4874-a077-0636825f2ce4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:48.683731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1592f97b-8ccd-4e45-ad93-a995e98b2e63 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:48.689710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1592f97b-8ccd-4e45-ad93-a995e98b2e63 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:48.699410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1592f97b-8ccd-4e45-ad93-a995e98b2e63 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:48.703095 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1592f97b-8ccd-4e45-ad93-a995e98b2e63 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:48.704443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1592f97b-8ccd-4e45-ad93-a995e98b2e63 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:48.705999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1592f97b-8ccd-4e45-ad93-a995e98b2e63 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:48.707878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1592f97b-8ccd-4e45-ad93-a995e98b2e63 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:48.708659 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1592f97b-8ccd-4e45-ad93-a995e98b2e63 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:48.715675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:42:48.911839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-77fff81f-925e-4874-a077-0636825f2ce4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:48.944832 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-77fff81f-925e-4874-a077-0636825f2ce4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.382695 Oct 10 23:42:48.956203 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2373/4941] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:48 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:49.106940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1592f97b-8ccd-4e45-ad93-a995e98b2e63 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:49.122165 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1592f97b-8ccd-4e45-ad93-a995e98b2e63 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1515 microversion: 2.1 time: 0.446287 Oct 10 23:42:49.137947 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2569/4942] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:48 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1515 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:49.138151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b4e4f050-3e4e-4e00-a5bb-f8d91b3323b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-594403126", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "key_name": "tempest-key-357380590", "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:49.270269 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-b4e4f050-3e4e-4e00-a5bb-f8d91b3323b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] validate_networks() for [('fa0ea560-35bf-4417-8cad-eb62562b3005', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:42:50.149293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d36ecc9b-0c28-420c-bedf-ed1bd986bef1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:50.150662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d36ecc9b-0c28-420c-bedf-ed1bd986bef1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:50.173480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d36ecc9b-0c28-420c-bedf-ed1bd986bef1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:50.176822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d36ecc9b-0c28-420c-bedf-ed1bd986bef1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:50.179299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d36ecc9b-0c28-420c-bedf-ed1bd986bef1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:50.184337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d36ecc9b-0c28-420c-bedf-ed1bd986bef1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:50.185091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d36ecc9b-0c28-420c-bedf-ed1bd986bef1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:50.189359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d36ecc9b-0c28-420c-bedf-ed1bd986bef1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:50.454072 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-b4e4f050-3e4e-4e00-a5bb-f8d91b3323b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Invalid key_name provided. Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b4e4f050-3e4e-4e00-a5bb-f8d91b3323b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 245 Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-594403126", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "key_name": "tempest-key-357380590", "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid key_name provided. Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-594403126', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452', 'key_name': 'tempest-key-357380590', 'networks': [{'uuid': 'fa0ea560-35bf-4417-8cad-eb62562b3005'}]}}} Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-357380590 not found for user 847536250ff1495c91a80222a0307788 Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:50.457358 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 10 23:42:50.463405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:50.469089 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b4e4f050-3e4e-4e00-a5bb-f8d91b3323b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 400 to user: Invalid key_name provided. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:42:50.472190 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b4e4f050-3e4e-4e00-a5bb-f8d91b3323b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.344508 Oct 10 23:42:50.473360 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2374/4943] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:42:49 2022] POST /compute/v2.1/servers => generated 70 bytes in 1346 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 23:42:50.482418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d128d055-c26d-4423-ab14-0914002e6341 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:50.483901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d128d055-c26d-4423-ab14-0914002e6341 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:50.499744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d128d055-c26d-4423-ab14-0914002e6341 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:50.500823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d128d055-c26d-4423-ab14-0914002e6341 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:50.501569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d128d055-c26d-4423-ab14-0914002e6341 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:50.503111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d128d055-c26d-4423-ab14-0914002e6341 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:50.504023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d128d055-c26d-4423-ab14-0914002e6341 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:50.504827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d128d055-c26d-4423-ab14-0914002e6341 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:50.751720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d36ecc9b-0c28-420c-bedf-ed1bd986bef1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:50.805040 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d36ecc9b-0c28-420c-bedf-ed1bd986bef1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1515 microversion: 2.1 time: 0.654132 Oct 10 23:42:50.806135 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2570/4944] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:50 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1515 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:51.039222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d128d055-c26d-4423-ab14-0914002e6341 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:51.052052 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d128d055-c26d-4423-ab14-0914002e6341 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.574443 Oct 10 23:42:51.058291 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2375/4945] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:50 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:51.082427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f7e22fd7-8d4b-4a4e-865b-9b43a18062af tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:51.083302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f7e22fd7-8d4b-4a4e-865b-9b43a18062af tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:51.102904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7e22fd7-8d4b-4a4e-865b-9b43a18062af tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:51.104901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7e22fd7-8d4b-4a4e-865b-9b43a18062af tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:51.105764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7e22fd7-8d4b-4a4e-865b-9b43a18062af tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:51.106675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7e22fd7-8d4b-4a4e-865b-9b43a18062af tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:51.107305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7e22fd7-8d4b-4a4e-865b-9b43a18062af tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:51.107964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7e22fd7-8d4b-4a4e-865b-9b43a18062af tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:51.745698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f7e22fd7-8d4b-4a4e-865b-9b43a18062af tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:51.766982 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f7e22fd7-8d4b-4a4e-865b-9b43a18062af tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.689813 Oct 10 23:42:51.791745 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2571/4946] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:51 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:51.841866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-49c8e141-2e59-4900-8de1-b2bbd95ca731 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:51.843488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-49c8e141-2e59-4900-8de1-b2bbd95ca731 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:51.845973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=56 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:42:51.857735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49c8e141-2e59-4900-8de1-b2bbd95ca731 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:51.860575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49c8e141-2e59-4900-8de1-b2bbd95ca731 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:51.861868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49c8e141-2e59-4900-8de1-b2bbd95ca731 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:51.869292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49c8e141-2e59-4900-8de1-b2bbd95ca731 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:51.872320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49c8e141-2e59-4900-8de1-b2bbd95ca731 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:51.872952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-49c8e141-2e59-4900-8de1-b2bbd95ca731 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:52.014871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d4494086-94ad-465f-ad81-20544cc2e5fb tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1755699752", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:52.478292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-49c8e141-2e59-4900-8de1-b2bbd95ca731 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:52.496940 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-49c8e141-2e59-4900-8de1-b2bbd95ca731 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1515 microversion: 2.1 time: 0.663125 Oct 10 23:42:52.503334 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2376/4947] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:51 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1515 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:52.510256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.security_group_api [None req-d4494086-94ad-465f-ad81-20544cc2e5fb tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Neutron security group does_not_exist not found {{(pid=120613) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 10 23:42:52.511314 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-d4494086-94ad-465f-ad81-20544cc2e5fb tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d4494086-94ad-465f-ad81-20544cc2e5fb tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 258 Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1755699752", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1755699752', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'fa0ea560-35bf-4417-8cad-eb62562b3005'}]}}} Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 10 23:42:52.527776 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 10 23:42:52.533516 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:52.538202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d4494086-94ad-465f-ad81-20544cc2e5fb tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:42:52.539602 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d4494086-94ad-465f-ad81-20544cc2e5fb tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.527817 Oct 10 23:42:52.540041 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2572/4948] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:42:52 2022] POST /compute/v2.1/servers => generated 106 bytes in 530 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 23:42:52.550870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-31c21ac5-d618-4ece-bf27-5ff72f226338 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:52.551798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-31c21ac5-d618-4ece-bf27-5ff72f226338 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:52.563628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31c21ac5-d618-4ece-bf27-5ff72f226338 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:52.567098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31c21ac5-d618-4ece-bf27-5ff72f226338 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:52.568945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31c21ac5-d618-4ece-bf27-5ff72f226338 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:52.570512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31c21ac5-d618-4ece-bf27-5ff72f226338 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:52.576262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31c21ac5-d618-4ece-bf27-5ff72f226338 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:52.578445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31c21ac5-d618-4ece-bf27-5ff72f226338 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:53.128641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-31c21ac5-d618-4ece-bf27-5ff72f226338 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:53.137176 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-31c21ac5-d618-4ece-bf27-5ff72f226338 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.592162 Oct 10 23:42:53.142796 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2377/4949] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:52 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:53.168707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-46c74c77-b467-4705-a6b6-271a6a6fb9e1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:53.170278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-46c74c77-b467-4705-a6b6-271a6a6fb9e1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:53.188823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46c74c77-b467-4705-a6b6-271a6a6fb9e1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:53.192719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46c74c77-b467-4705-a6b6-271a6a6fb9e1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:53.193765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46c74c77-b467-4705-a6b6-271a6a6fb9e1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:53.197339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46c74c77-b467-4705-a6b6-271a6a6fb9e1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:53.200817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46c74c77-b467-4705-a6b6-271a6a6fb9e1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:53.203065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46c74c77-b467-4705-a6b6-271a6a6fb9e1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:53.525093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f08fbdcb-c0fa-4d08-91b8-277092917efe tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:53.526511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f08fbdcb-c0fa-4d08-91b8-277092917efe tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:53.537111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f08fbdcb-c0fa-4d08-91b8-277092917efe tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:53.539092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f08fbdcb-c0fa-4d08-91b8-277092917efe tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:53.541969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f08fbdcb-c0fa-4d08-91b8-277092917efe tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:53.543021 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f08fbdcb-c0fa-4d08-91b8-277092917efe tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:53.544464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f08fbdcb-c0fa-4d08-91b8-277092917efe tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:53.546760 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f08fbdcb-c0fa-4d08-91b8-277092917efe tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:53.773217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-46c74c77-b467-4705-a6b6-271a6a6fb9e1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:53.803266 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-46c74c77-b467-4705-a6b6-271a6a6fb9e1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.638278 Oct 10 23:42:53.812879 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2573/4950] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:53 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:53.847079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-100bb429-9187-46f2-bf1b-f0ac0cec456a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:53.861109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-100bb429-9187-46f2-bf1b-f0ac0cec456a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 5e35a2f7-a560-4b3a-bb74-6976d41e3287] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:53.874962 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-100bb429-9187-46f2-bf1b-f0ac0cec456a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Instance 5e35a2f7-a560-4b3a-bb74-6976d41e3287 could not be found. Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-100bb429-9187-46f2-bf1b-f0ac0cec456a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/5e35a2f7-a560-4b3a-bb74-6976d41e3287 HTTP/1.1 Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 5e35a2f7-a560-4b3a-bb74-6976d41e3287 could not be found. Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '5e35a2f7-a560-4b3a-bb74-6976d41e3287'} Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e35a2f7-a560-4b3a-bb74-6976d41e3287 could not be found. Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e35a2f7-a560-4b3a-bb74-6976d41e3287 could not be found. Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:53.876841 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:53.886163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:53.886163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:53.886163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:53.886163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:53.886163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:42:53.886163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:42:53.886163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e35a2f7-a560-4b3a-bb74-6976d41e3287 could not be found. Oct 10 23:42:53.886163 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:53.888689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-100bb429-9187-46f2-bf1b-f0ac0cec456a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 404 to user: Instance 5e35a2f7-a560-4b3a-bb74-6976d41e3287 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:42:53.892098 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-100bb429-9187-46f2-bf1b-f0ac0cec456a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5e35a2f7-a560-4b3a-bb74-6976d41e3287" status: 404 len: 111 microversion: 2.1 time: 0.059122 Oct 10 23:42:53.893224 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2574/4951] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:42:53 2022] DELETE /compute/v2.1/servers/5e35a2f7-a560-4b3a-bb74-6976d41e3287 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:42:53.913410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-810c0378-5a99-49ce-9b1a-f152efd572b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:53.915927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-810c0378-5a99-49ce-9b1a-f152efd572b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:53.945711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-810c0378-5a99-49ce-9b1a-f152efd572b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:53.950523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-810c0378-5a99-49ce-9b1a-f152efd572b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:53.951202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-810c0378-5a99-49ce-9b1a-f152efd572b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:53.953549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-810c0378-5a99-49ce-9b1a-f152efd572b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:53.954495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-810c0378-5a99-49ce-9b1a-f152efd572b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:53.955547 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-810c0378-5a99-49ce-9b1a-f152efd572b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:54.139898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f08fbdcb-c0fa-4d08-91b8-277092917efe tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:54.153010 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f08fbdcb-c0fa-4d08-91b8-277092917efe tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1515 microversion: 2.1 time: 0.632269 Oct 10 23:42:54.161857 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2378/4952] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:53 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1515 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:54.225303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-810c0378-5a99-49ce-9b1a-f152efd572b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:54.236438 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-810c0378-5a99-49ce-9b1a-f152efd572b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.337907 Oct 10 23:42:54.253769 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2575/4953] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:53 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:54.262819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8a37e930-1d2e-4818-a1f8-15ed41f6e5aa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:54.264612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8a37e930-1d2e-4818-a1f8-15ed41f6e5aa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:54.291291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a37e930-1d2e-4818-a1f8-15ed41f6e5aa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:54.296223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a37e930-1d2e-4818-a1f8-15ed41f6e5aa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:54.297337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a37e930-1d2e-4818-a1f8-15ed41f6e5aa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:54.301245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a37e930-1d2e-4818-a1f8-15ed41f6e5aa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:54.303153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a37e930-1d2e-4818-a1f8-15ed41f6e5aa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:54.311673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a37e930-1d2e-4818-a1f8-15ed41f6e5aa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:54.708398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8a37e930-1d2e-4818-a1f8-15ed41f6e5aa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:54.726646 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8a37e930-1d2e-4818-a1f8-15ed41f6e5aa tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.468543 Oct 10 23:42:54.759090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2bb641c3-3e26-4007-bc4e-f617a1ed7b3c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:54.759569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2bb641c3-3e26-4007-bc4e-f617a1ed7b3c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 10 23:42:54.760682 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-2bb641c3-3e26-4007-bc4e-f617a1ed7b3c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 10 23:42:54.762068 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2379/4954] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:54 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2bb641c3-3e26-4007-bc4e-f617a1ed7b3c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 9223372036854775808 could not be found. Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '9223372036854775808'} Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:54.769243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:54.774901 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:54.774901 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:42:54.774901 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:42:54.774901 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 10 23:42:54.774901 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:54.776703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2bb641c3-3e26-4007-bc4e-f617a1ed7b3c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:42:54.777803 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2bb641c3-3e26-4007-bc4e-f617a1ed7b3c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.022669 Oct 10 23:42:54.782654 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2576/4955] 10.222.0.23 () {58 vars in 1188 bytes} [Mon Oct 10 23:42:54 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:42:54.792766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4aa2746c-c44a-40e5-961a-88e2f4947174 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:54.794922 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4aa2746c-c44a-40e5-961a-88e2f4947174 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:54.808274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4aa2746c-c44a-40e5-961a-88e2f4947174 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:54.808779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4aa2746c-c44a-40e5-961a-88e2f4947174 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:54.809218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4aa2746c-c44a-40e5-961a-88e2f4947174 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:54.815418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4aa2746c-c44a-40e5-961a-88e2f4947174 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:54.815927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4aa2746c-c44a-40e5-961a-88e2f4947174 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:54.825899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4aa2746c-c44a-40e5-961a-88e2f4947174 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:55.194274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-70ade4d7-bd1f-495b-9624-f75366eb2595 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:55.195248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-70ade4d7-bd1f-495b-9624-f75366eb2595 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:55.225464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70ade4d7-bd1f-495b-9624-f75366eb2595 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:55.226416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70ade4d7-bd1f-495b-9624-f75366eb2595 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:55.226578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70ade4d7-bd1f-495b-9624-f75366eb2595 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:55.227328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70ade4d7-bd1f-495b-9624-f75366eb2595 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:55.227797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70ade4d7-bd1f-495b-9624-f75366eb2595 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:55.228229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70ade4d7-bd1f-495b-9624-f75366eb2595 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:55.285392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4aa2746c-c44a-40e5-961a-88e2f4947174 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:55.309702 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4aa2746c-c44a-40e5-961a-88e2f4947174 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.525617 Oct 10 23:42:55.313952 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2380/4956] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:54 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:55.347482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f810dced-6d8a-4a43-b38c-ce34874f7629 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:55.348108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f810dced-6d8a-4a43-b38c-ce34874f7629 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:55.365277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f810dced-6d8a-4a43-b38c-ce34874f7629 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:55.365813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f810dced-6d8a-4a43-b38c-ce34874f7629 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:55.368715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f810dced-6d8a-4a43-b38c-ce34874f7629 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:55.369517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f810dced-6d8a-4a43-b38c-ce34874f7629 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:55.370021 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f810dced-6d8a-4a43-b38c-ce34874f7629 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:55.373197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f810dced-6d8a-4a43-b38c-ce34874f7629 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:55.651300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f810dced-6d8a-4a43-b38c-ce34874f7629 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:55.660547 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f810dced-6d8a-4a43-b38c-ce34874f7629 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.317957 Oct 10 23:42:55.678136 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2381/4957] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:55 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:55.686715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ee76eb42-e448-46ce-8c0b-d861f4d68532 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:55.688585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ee76eb42-e448-46ce-8c0b-d861f4d68532 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Failed to fetch instance by id -1 {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 10 23:42:55.689452 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-ee76eb42-e448-46ce-8c0b-d861f4d68532 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Instance -1 could not be found. Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ee76eb42-e448-46ce-8c0b-d861f4d68532 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance -1 could not be found. Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '-1'} Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:55.691405 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:55.696393 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:42:55.696393 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:42:55.696393 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 10 23:42:55.696393 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:55.699268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ee76eb42-e448-46ce-8c0b-d861f4d68532 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:42:55.700445 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ee76eb42-e448-46ce-8c0b-d861f4d68532 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.018082 Oct 10 23:42:55.705604 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2382/4958] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:42:55 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:42:55.711482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9b0b0294-9c91-492e-b804-7bc08105564e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:55.721663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9b0b0294-9c91-492e-b804-7bc08105564e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:55.748137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b0b0294-9c91-492e-b804-7bc08105564e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:55.750661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b0b0294-9c91-492e-b804-7bc08105564e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:55.754746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b0b0294-9c91-492e-b804-7bc08105564e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:55.755892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b0b0294-9c91-492e-b804-7bc08105564e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:55.758873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b0b0294-9c91-492e-b804-7bc08105564e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:55.761094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b0b0294-9c91-492e-b804-7bc08105564e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:56.116371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9b0b0294-9c91-492e-b804-7bc08105564e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:56.131740 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9b0b0294-9c91-492e-b804-7bc08105564e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.424501 Oct 10 23:42:56.146871 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2383/4959] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:55 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:56.163800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-70ade4d7-bd1f-495b-9624-f75366eb2595 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:56.165389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-98aeb07f-dbad-48c0-a616-a02b7c7b35f7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:56.167838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-98aeb07f-dbad-48c0-a616-a02b7c7b35f7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:56.172551 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-70ade4d7-bd1f-495b-9624-f75366eb2595 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1515 microversion: 2.1 time: 0.997361 Oct 10 23:42:56.185667 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2577/4960] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:55 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1515 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:56.198484 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98aeb07f-dbad-48c0-a616-a02b7c7b35f7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:56.199625 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98aeb07f-dbad-48c0-a616-a02b7c7b35f7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:56.200379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98aeb07f-dbad-48c0-a616-a02b7c7b35f7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:56.202580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98aeb07f-dbad-48c0-a616-a02b7c7b35f7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:56.203336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98aeb07f-dbad-48c0-a616-a02b7c7b35f7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:56.204099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98aeb07f-dbad-48c0-a616-a02b7c7b35f7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:56.599227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-98aeb07f-dbad-48c0-a616-a02b7c7b35f7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:56.625895 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-98aeb07f-dbad-48c0-a616-a02b7c7b35f7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.467785 Oct 10 23:42:56.626504 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2384/4961] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:56 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:56.654568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d3f6e935-82b7-4150-a419-6062d7889fc9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:56.656507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d3f6e935-82b7-4150-a419-6062d7889fc9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 89500a4b-8bae-448e-b042-3ceb736624d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:56.677181 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-d3f6e935-82b7-4150-a419-6062d7889fc9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Instance 89500a4b-8bae-448e-b042-3ceb736624d3 could not be found. Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d3f6e935-82b7-4150-a419-6062d7889fc9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/89500a4b-8bae-448e-b042-3ceb736624d3/action HTTP/1.1 Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 19 Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: {"forceDelete": {}} Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 89500a4b-8bae-448e-b042-3ceb736624d3 could not be found. Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '89500a4b-8bae-448e-b042-3ceb736624d3', 'body': {'forceDelete': {}}} Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89500a4b-8bae-448e-b042-3ceb736624d3 could not be found. Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89500a4b-8bae-448e-b042-3ceb736624d3 could not be found. Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:56.689609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:56.695540 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:42:56.695540 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:42:56.695540 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89500a4b-8bae-448e-b042-3ceb736624d3 could not be found. Oct 10 23:42:56.695540 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:42:56.696199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d3f6e935-82b7-4150-a419-6062d7889fc9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 404 to user: Instance 89500a4b-8bae-448e-b042-3ceb736624d3 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:42:56.697085 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d3f6e935-82b7-4150-a419-6062d7889fc9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/89500a4b-8bae-448e-b042-3ceb736624d3/action" status: 404 len: 111 microversion: 2.1 time: 0.048142 Oct 10 23:42:56.697835 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2578/4962] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:42:56 2022] POST /compute/v2.1/servers/89500a4b-8bae-448e-b042-3ceb736624d3/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:42:56.708587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-98da1d96-8204-4abf-8da5-b02e4f00c085 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:56.709125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-98da1d96-8204-4abf-8da5-b02e4f00c085 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:56.719922 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98da1d96-8204-4abf-8da5-b02e4f00c085 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:56.720428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98da1d96-8204-4abf-8da5-b02e4f00c085 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:56.720873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98da1d96-8204-4abf-8da5-b02e4f00c085 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:56.721623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98da1d96-8204-4abf-8da5-b02e4f00c085 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:56.722287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98da1d96-8204-4abf-8da5-b02e4f00c085 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:56.722887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98da1d96-8204-4abf-8da5-b02e4f00c085 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:57.053607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-98da1d96-8204-4abf-8da5-b02e4f00c085 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:57.062466 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-98da1d96-8204-4abf-8da5-b02e4f00c085 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.358758 Oct 10 23:42:57.079254 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2385/4963] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:56 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:57.093409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e123d15f-9204-4013-bd0a-788e8b93a5eb tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:57.093823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e123d15f-9204-4013-bd0a-788e8b93a5eb tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:57.101818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e123d15f-9204-4013-bd0a-788e8b93a5eb tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:57.102318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e123d15f-9204-4013-bd0a-788e8b93a5eb tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:57.103001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e123d15f-9204-4013-bd0a-788e8b93a5eb tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:57.103990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e123d15f-9204-4013-bd0a-788e8b93a5eb tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:57.104648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e123d15f-9204-4013-bd0a-788e8b93a5eb tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:57.105253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e123d15f-9204-4013-bd0a-788e8b93a5eb tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:57.200660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-72474a16-388a-45aa-b987-b718fa622f31 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:57.202552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-72474a16-388a-45aa-b987-b718fa622f31 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:57.233978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72474a16-388a-45aa-b987-b718fa622f31 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:57.235015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72474a16-388a-45aa-b987-b718fa622f31 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:57.236831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72474a16-388a-45aa-b987-b718fa622f31 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:57.243057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72474a16-388a-45aa-b987-b718fa622f31 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:57.244007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72474a16-388a-45aa-b987-b718fa622f31 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:57.244840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72474a16-388a-45aa-b987-b718fa622f31 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:57.547854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e123d15f-9204-4013-bd0a-788e8b93a5eb tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:57.567202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-72474a16-388a-45aa-b987-b718fa622f31 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:57.568744 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e123d15f-9204-4013-bd0a-788e8b93a5eb tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.479588 Oct 10 23:42:57.579747 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-72474a16-388a-45aa-b987-b718fa622f31 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1521 microversion: 2.1 time: 0.381550 Oct 10 23:42:57.581346 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2386/4964] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:57 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:57.607010 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2579/4965] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:57 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:57.612673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-012c52fb-ea12-47ee-a081-6f916e582b43 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:57.615380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-012c52fb-ea12-47ee-a081-6f916e582b43 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 1b36756b-0578-4dd0-b241-ce6f3b442d69] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:57.628807 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-012c52fb-ea12-47ee-a081-6f916e582b43 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Instance 1b36756b-0578-4dd0-b241-ce6f3b442d69 could not be found. Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-012c52fb-ea12-47ee-a081-6f916e582b43 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/1b36756b-0578-4dd0-b241-ce6f3b442d69/action HTTP/1.1 Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 39 Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: {"os-getConsoleOutput": {"length": 10}} Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 1b36756b-0578-4dd0-b241-ce6f3b442d69 could not be found. Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '1b36756b-0578-4dd0-b241-ce6f3b442d69', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b36756b-0578-4dd0-b241-ce6f3b442d69 could not be found. Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b36756b-0578-4dd0-b241-ce6f3b442d69 could not be found. Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:57.636976 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:57.643527 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:57.643527 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:57.643527 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:42:57.643527 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:42:57.643527 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b36756b-0578-4dd0-b241-ce6f3b442d69 could not be found. Oct 10 23:42:57.643527 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:57.645254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-012c52fb-ea12-47ee-a081-6f916e582b43 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 404 to user: Instance 1b36756b-0578-4dd0-b241-ce6f3b442d69 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:42:57.647109 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-012c52fb-ea12-47ee-a081-6f916e582b43 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/1b36756b-0578-4dd0-b241-ce6f3b442d69/action" status: 404 len: 111 microversion: 2.1 time: 0.039101 Oct 10 23:42:57.650400 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2387/4966] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:42:57 2022] POST /compute/v2.1/servers/1b36756b-0578-4dd0-b241-ce6f3b442d69/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:42:57.658986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7515de37-7239-4e19-a60d-facbe6e3c24d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:57.659981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7515de37-7239-4e19-a60d-facbe6e3c24d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:57.669219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:42:57.707717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7515de37-7239-4e19-a60d-facbe6e3c24d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:57.708397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7515de37-7239-4e19-a60d-facbe6e3c24d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:57.708861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7515de37-7239-4e19-a60d-facbe6e3c24d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:57.716587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7515de37-7239-4e19-a60d-facbe6e3c24d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:57.717027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7515de37-7239-4e19-a60d-facbe6e3c24d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:57.717767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7515de37-7239-4e19-a60d-facbe6e3c24d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:58.025907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7515de37-7239-4e19-a60d-facbe6e3c24d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:58.053481 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7515de37-7239-4e19-a60d-facbe6e3c24d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.400756 Oct 10 23:42:58.094976 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2580/4967] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:57 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:58.129596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c9695077-3ebe-4ec6-990e-0998eac5f30c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:58.131839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c9695077-3ebe-4ec6-990e-0998eac5f30c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:58.158756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9695077-3ebe-4ec6-990e-0998eac5f30c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:58.159994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9695077-3ebe-4ec6-990e-0998eac5f30c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:58.160994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9695077-3ebe-4ec6-990e-0998eac5f30c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:58.162865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9695077-3ebe-4ec6-990e-0998eac5f30c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:58.163977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9695077-3ebe-4ec6-990e-0998eac5f30c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:58.165038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9695077-3ebe-4ec6-990e-0998eac5f30c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:58.201252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:42:58.497977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-990b440d-f23e-4ddd-8d43-1c67211a9296 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:58.498718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-990b440d-f23e-4ddd-8d43-1c67211a9296 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:58.510810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-990b440d-f23e-4ddd-8d43-1c67211a9296 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:58.512169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-990b440d-f23e-4ddd-8d43-1c67211a9296 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:58.513800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-990b440d-f23e-4ddd-8d43-1c67211a9296 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:58.516966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-990b440d-f23e-4ddd-8d43-1c67211a9296 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:58.517652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-990b440d-f23e-4ddd-8d43-1c67211a9296 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:58.518269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-990b440d-f23e-4ddd-8d43-1c67211a9296 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:58.550948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c9695077-3ebe-4ec6-990e-0998eac5f30c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:58.565045 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c9695077-3ebe-4ec6-990e-0998eac5f30c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.441324 Oct 10 23:42:58.567775 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2388/4968] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:58 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:58.594307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6edbb625-a132-4539-ab88-1a54a9c336f1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:58.595539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6edbb625-a132-4539-ab88-1a54a9c336f1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 66d6c8bb-c014-45e0-b333-5d79e44fb450] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:58.608553 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-6edbb625-a132-4539-ab88-1a54a9c336f1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Instance 66d6c8bb-c014-45e0-b333-5d79e44fb450 could not be found. Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6edbb625-a132-4539-ab88-1a54a9c336f1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/66d6c8bb-c014-45e0-b333-5d79e44fb450 HTTP/1.1 Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 66d6c8bb-c014-45e0-b333-5d79e44fb450 could not be found. Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '66d6c8bb-c014-45e0-b333-5d79e44fb450'} Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66d6c8bb-c014-45e0-b333-5d79e44fb450 could not be found. Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66d6c8bb-c014-45e0-b333-5d79e44fb450 could not be found. Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:42:58.612792 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:42:58.618944 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:42:58.618944 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:42:58.618944 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:42:58.618944 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66d6c8bb-c014-45e0-b333-5d79e44fb450 could not be found. Oct 10 23:42:58.618944 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:42:58.621010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6edbb625-a132-4539-ab88-1a54a9c336f1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 404 to user: Instance 66d6c8bb-c014-45e0-b333-5d79e44fb450 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:42:58.625784 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6edbb625-a132-4539-ab88-1a54a9c336f1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/66d6c8bb-c014-45e0-b333-5d79e44fb450" status: 404 len: 111 microversion: 2.1 time: 0.037163 Oct 10 23:42:58.628943 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2389/4969] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:58 2022] GET /compute/v2.1/servers/66d6c8bb-c014-45e0-b333-5d79e44fb450 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:42:58.644280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-75d5b890-3b8b-4ae3-aac9-14b593c64e3f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:58.645175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-75d5b890-3b8b-4ae3-aac9-14b593c64e3f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:58.659091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75d5b890-3b8b-4ae3-aac9-14b593c64e3f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:58.660997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75d5b890-3b8b-4ae3-aac9-14b593c64e3f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:58.661840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75d5b890-3b8b-4ae3-aac9-14b593c64e3f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:58.663422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75d5b890-3b8b-4ae3-aac9-14b593c64e3f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:58.664325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75d5b890-3b8b-4ae3-aac9-14b593c64e3f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:58.664940 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75d5b890-3b8b-4ae3-aac9-14b593c64e3f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:58.834436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-990b440d-f23e-4ddd-8d43-1c67211a9296 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:58.870605 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-990b440d-f23e-4ddd-8d43-1c67211a9296 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.376886 Oct 10 23:42:58.873030 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2581/4970] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:58 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:42:58.880579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6c9da1e5-9f8e-4417-b7d1-057ee5513d2a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:58.885224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6c9da1e5-9f8e-4417-b7d1-057ee5513d2a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:58.903569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c9da1e5-9f8e-4417-b7d1-057ee5513d2a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:58.904420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c9da1e5-9f8e-4417-b7d1-057ee5513d2a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:58.912325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c9da1e5-9f8e-4417-b7d1-057ee5513d2a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:58.913471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c9da1e5-9f8e-4417-b7d1-057ee5513d2a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:58.914166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c9da1e5-9f8e-4417-b7d1-057ee5513d2a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:58.914838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c9da1e5-9f8e-4417-b7d1-057ee5513d2a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:59.048693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-75d5b890-3b8b-4ae3-aac9-14b593c64e3f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:59.060839 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-75d5b890-3b8b-4ae3-aac9-14b593c64e3f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1521 microversion: 2.1 time: 0.430431 Oct 10 23:42:59.073788 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2390/4971] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:58 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1521 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:59.082364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f7f7a0df-7886-4ec2-9e67-5832cd089eb0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:59.082866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f7f7a0df-7886-4ec2-9e67-5832cd089eb0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:59.090539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7f7a0df-7886-4ec2-9e67-5832cd089eb0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:59.091425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7f7a0df-7886-4ec2-9e67-5832cd089eb0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:59.092883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7f7a0df-7886-4ec2-9e67-5832cd089eb0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:59.095452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7f7a0df-7886-4ec2-9e67-5832cd089eb0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:59.096376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7f7a0df-7886-4ec2-9e67-5832cd089eb0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:59.097074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7f7a0df-7886-4ec2-9e67-5832cd089eb0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:59.212008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6c9da1e5-9f8e-4417-b7d1-057ee5513d2a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:59.220913 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6c9da1e5-9f8e-4417-b7d1-057ee5513d2a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.344067 Oct 10 23:42:59.223598 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2582/4972] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:58 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:59.230292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ddbd702e-633a-45b6-b7fb-a6175603dd78 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-288898976"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:42:59.234282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ddbd702e-633a-45b6-b7fb-a6175603dd78 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:59.259692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddbd702e-633a-45b6-b7fb-a6175603dd78 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:59.260486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddbd702e-633a-45b6-b7fb-a6175603dd78 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:59.261236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddbd702e-633a-45b6-b7fb-a6175603dd78 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:59.262313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddbd702e-633a-45b6-b7fb-a6175603dd78 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:59.266095 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddbd702e-633a-45b6-b7fb-a6175603dd78 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:59.266637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddbd702e-633a-45b6-b7fb-a6175603dd78 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:59.320962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-f7f7a0df-7886-4ec2-9e67-5832cd089eb0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lazy-loading 'services' on Instance uuid aa7a4001-50e2-4247-a60d-f82367072f61 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:42:59.438241 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f7f7a0df-7886-4ec2-9e67-5832cd089eb0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments/12e3d7cb-3c2b-48f2-8ded-94465d9037e5" status: 202 len: 0 microversion: 2.1 time: 0.360901 Oct 10 23:42:59.439387 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2391/4973] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Oct 10 23:42:59 2022] DELETE /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments/12e3d7cb-3c2b-48f2-8ded-94465d9037e5 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:42:59.452687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8a7a2188-13f7-4f7e-a9d6-be9abb6accdd tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:59.453993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8a7a2188-13f7-4f7e-a9d6-be9abb6accdd tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:59.473423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a7a2188-13f7-4f7e-a9d6-be9abb6accdd tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:59.474279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a7a2188-13f7-4f7e-a9d6-be9abb6accdd tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:59.475073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a7a2188-13f7-4f7e-a9d6-be9abb6accdd tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:59.475981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a7a2188-13f7-4f7e-a9d6-be9abb6accdd tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:59.477315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a7a2188-13f7-4f7e-a9d6-be9abb6accdd tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:59.480807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a7a2188-13f7-4f7e-a9d6-be9abb6accdd tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:59.667590 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ddbd702e-633a-45b6-b7fb-a6175603dd78 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action" status: 202 len: 0 microversion: 2.1 time: 0.441303 Oct 10 23:42:59.668655 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2583/4974] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:42:59 2022] POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 10 23:42:59.687485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f6b9c84d-4e17-4d33-a704-4b190d109aa5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:42:59.692545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f6b9c84d-4e17-4d33-a704-4b190d109aa5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:42:59.700951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6b9c84d-4e17-4d33-a704-4b190d109aa5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:59.701992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6b9c84d-4e17-4d33-a704-4b190d109aa5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:59.702687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6b9c84d-4e17-4d33-a704-4b190d109aa5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:59.703636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6b9c84d-4e17-4d33-a704-4b190d109aa5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:42:59.704276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6b9c84d-4e17-4d33-a704-4b190d109aa5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:42:59.704901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6b9c84d-4e17-4d33-a704-4b190d109aa5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:42:59.730140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8a7a2188-13f7-4f7e-a9d6-be9abb6accdd tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:42:59.740580 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f6b9c84d-4e17-4d33-a704-4b190d109aa5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070406 Oct 10 23:42:59.741681 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2584/4975] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:42:59 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:42:59.742801 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8a7a2188-13f7-4f7e-a9d6-be9abb6accdd tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.299999 Oct 10 23:42:59.743504 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2392/4976] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:42:59 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:42:59.981957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ec6454cb-c6a8-4943-9c06-58aaf7b4f3c7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-571778618", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ec6454cb-c6a8-4943-9c06-58aaf7b4f3c7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 237 Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-571778618", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-571778618', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'fa0ea560-35bf-4417-8cad-eb62562b3005'}]}}} Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:00.046916 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 10 23:43:00.053283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:00.064998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ec6454cb-c6a8-4943-9c06-58aaf7b4f3c7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:43:00.064998 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ec6454cb-c6a8-4943-9c06-58aaf7b4f3c7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.082698 Oct 10 23:43:00.064998 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2585/4977] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:42:59 2022] POST /compute/v2.1/servers => generated 139 bytes in 84 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:43:00.069200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-92292531-76e6-4c00-bb92-2923ce53b182 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:00.069863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-92292531-76e6-4c00-bb92-2923ce53b182 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:00.086364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1e42176f-bf08-4848-b03b-4ab8c03daa28 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:00.087236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1e42176f-bf08-4848-b03b-4ab8c03daa28 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:00.094659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92292531-76e6-4c00-bb92-2923ce53b182 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:00.095216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92292531-76e6-4c00-bb92-2923ce53b182 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:00.098667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92292531-76e6-4c00-bb92-2923ce53b182 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:00.099492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92292531-76e6-4c00-bb92-2923ce53b182 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:00.099977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92292531-76e6-4c00-bb92-2923ce53b182 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:00.106366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e42176f-bf08-4848-b03b-4ab8c03daa28 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:00.106874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e42176f-bf08-4848-b03b-4ab8c03daa28 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:00.107271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e42176f-bf08-4848-b03b-4ab8c03daa28 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:00.108865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e42176f-bf08-4848-b03b-4ab8c03daa28 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:00.112225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92292531-76e6-4c00-bb92-2923ce53b182 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:00.120109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e42176f-bf08-4848-b03b-4ab8c03daa28 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:00.120876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e42176f-bf08-4848-b03b-4ab8c03daa28 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:00.397689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1e42176f-bf08-4848-b03b-4ab8c03daa28 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:00.413056 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1e42176f-bf08-4848-b03b-4ab8c03daa28 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1521 microversion: 2.1 time: 0.330775 Oct 10 23:43:00.425403 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2586/4978] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:00 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:00.508032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-91828183-5992-40cd-ba5d-a652e19a2b0b req-d5430ff6-8f84-44af-9205-5d6ba32ff1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e82c4dac-b092-4a01-a6ba-faeaf147e079", "name": "network-vif-unplugged", "status": "completed", "tag": "eb15cec0-009b-460d-896d-f8a2f8e16987"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:00.528230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-91828183-5992-40cd-ba5d-a652e19a2b0b req-d5430ff6-8f84-44af-9205-5d6ba32ff1c0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:00.528396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-91828183-5992-40cd-ba5d-a652e19a2b0b req-d5430ff6-8f84-44af-9205-5d6ba32ff1c0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:00.535525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-91828183-5992-40cd-ba5d-a652e19a2b0b req-d5430ff6-8f84-44af-9205-5d6ba32ff1c0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:00.568737 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-91828183-5992-40cd-ba5d-a652e19a2b0b req-d5430ff6-8f84-44af-9205-5d6ba32ff1c0 service nova] Creating event network-vif-unplugged:eb15cec0-009b-460d-896d-f8a2f8e16987 for instance e82c4dac-b092-4a01-a6ba-faeaf147e079 on n-h2-860864-2 Oct 10 23:43:00.574275 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-91828183-5992-40cd-ba5d-a652e19a2b0b req-d5430ff6-8f84-44af-9205-5d6ba32ff1c0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071989 Oct 10 23:43:00.575395 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2587/4979] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:43:00.622561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-92292531-76e6-4c00-bb92-2923ce53b182 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:00.635084 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-92292531-76e6-4c00-bb92-2923ce53b182 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.569603 Oct 10 23:43:00.636241 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2393/4980] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:00 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:00.668436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-314e14c7-9db3-4714-b4c2-608b34ef7259 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:00.671187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-314e14c7-9db3-4714-b4c2-608b34ef7259 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:00.684489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-314e14c7-9db3-4714-b4c2-608b34ef7259 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:00.685259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-314e14c7-9db3-4714-b4c2-608b34ef7259 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:00.686224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-314e14c7-9db3-4714-b4c2-608b34ef7259 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:00.687359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-314e14c7-9db3-4714-b4c2-608b34ef7259 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:00.688054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-314e14c7-9db3-4714-b4c2-608b34ef7259 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:00.688712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-314e14c7-9db3-4714-b4c2-608b34ef7259 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:00.753277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e36330f4-1d16-44ba-9bd9-037a0d19371c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:00.755851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e36330f4-1d16-44ba-9bd9-037a0d19371c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:00.767894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e36330f4-1d16-44ba-9bd9-037a0d19371c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:00.768566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e36330f4-1d16-44ba-9bd9-037a0d19371c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:00.769124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e36330f4-1d16-44ba-9bd9-037a0d19371c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:00.770207 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e36330f4-1d16-44ba-9bd9-037a0d19371c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:00.771483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e36330f4-1d16-44ba-9bd9-037a0d19371c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:00.772032 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e36330f4-1d16-44ba-9bd9-037a0d19371c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:00.845133 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e36330f4-1d16-44ba-9bd9-037a0d19371c tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096508 Oct 10 23:43:00.847896 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2394/4981] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:43:00 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:43:00.974999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-314e14c7-9db3-4714-b4c2-608b34ef7259 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:00.989731 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-314e14c7-9db3-4714-b4c2-608b34ef7259 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.325788 Oct 10 23:43:00.993733 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2588/4982] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:00 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:01.280225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bc736008-6d20-4f7b-b519-182b8e111474 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-295299142", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bc736008-6d20-4f7b-b519-182b8e111474 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 234 Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-295299142", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-295299142', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'fa0ea560-35bf-4417-8cad-eb62562b3005'}]}}} Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:01.288611 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 10 23:43:01.295241 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:01.301942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bc736008-6d20-4f7b-b519-182b8e111474 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:43:01.304876 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bc736008-6d20-4f7b-b519-182b8e111474 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.028147 Oct 10 23:43:01.312268 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2395/4983] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:43:01 2022] POST /compute/v2.1/servers => generated 133 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 23:43:01.328169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-46aadbb9-ea4c-468b-b0a2-c9cce81441e9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:01.330336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-46aadbb9-ea4c-468b-b0a2-c9cce81441e9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:01.346052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46aadbb9-ea4c-468b-b0a2-c9cce81441e9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:01.346664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46aadbb9-ea4c-468b-b0a2-c9cce81441e9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:01.347194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46aadbb9-ea4c-468b-b0a2-c9cce81441e9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:01.348061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46aadbb9-ea4c-468b-b0a2-c9cce81441e9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:01.348616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46aadbb9-ea4c-468b-b0a2-c9cce81441e9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:01.349128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46aadbb9-ea4c-468b-b0a2-c9cce81441e9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:01.461429 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-66b97de0-a62f-4823-aa3d-30fafae40f5a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:01.464045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-66b97de0-a62f-4823-aa3d-30fafae40f5a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:01.482410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66b97de0-a62f-4823-aa3d-30fafae40f5a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:01.485182 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66b97de0-a62f-4823-aa3d-30fafae40f5a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:01.485931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66b97de0-a62f-4823-aa3d-30fafae40f5a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:01.486920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66b97de0-a62f-4823-aa3d-30fafae40f5a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:01.487605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66b97de0-a62f-4823-aa3d-30fafae40f5a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:01.488264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66b97de0-a62f-4823-aa3d-30fafae40f5a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:01.666751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-46aadbb9-ea4c-468b-b0a2-c9cce81441e9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:01.685566 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-46aadbb9-ea4c-468b-b0a2-c9cce81441e9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.374523 Oct 10 23:43:01.687381 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2589/4984] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:01 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:01.714926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e78c5da7-534b-4eba-81b3-7e0475561848 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:01.716111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e78c5da7-534b-4eba-81b3-7e0475561848 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:01.741457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e78c5da7-534b-4eba-81b3-7e0475561848 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:01.742696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e78c5da7-534b-4eba-81b3-7e0475561848 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:01.743775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e78c5da7-534b-4eba-81b3-7e0475561848 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:01.745117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e78c5da7-534b-4eba-81b3-7e0475561848 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:01.745986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e78c5da7-534b-4eba-81b3-7e0475561848 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:01.750797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e78c5da7-534b-4eba-81b3-7e0475561848 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:01.815061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:43:02.073902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-66b97de0-a62f-4823-aa3d-30fafae40f5a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:02.095062 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-66b97de0-a62f-4823-aa3d-30fafae40f5a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1521 microversion: 2.1 time: 0.659608 Oct 10 23:43:02.115474 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2396/4985] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:01 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1521 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:02.115696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e78c5da7-534b-4eba-81b3-7e0475561848 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:02.122190 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e78c5da7-534b-4eba-81b3-7e0475561848 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.412913 Oct 10 23:43:02.133297 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2590/4986] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:01 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:02.133811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-60a241a1-e40a-4889-8ad8-2ad262f299ae tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:02.133811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-60a241a1-e40a-4889-8ad8-2ad262f299ae tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:02.150471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ef0f9153-fc45-42a1-b39a-920ecd403523 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:02.150738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60a241a1-e40a-4889-8ad8-2ad262f299ae tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:02.151357 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60a241a1-e40a-4889-8ad8-2ad262f299ae tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:02.151920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60a241a1-e40a-4889-8ad8-2ad262f299ae tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:02.152209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ef0f9153-fc45-42a1-b39a-920ecd403523 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 3906b05e-b09d-411e-baca-d4b86b6cc877] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:02.152748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60a241a1-e40a-4889-8ad8-2ad262f299ae tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:02.153258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60a241a1-e40a-4889-8ad8-2ad262f299ae tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:02.154659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60a241a1-e40a-4889-8ad8-2ad262f299ae tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:02.164437 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-ef0f9153-fc45-42a1-b39a-920ecd403523 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Instance 3906b05e-b09d-411e-baca-d4b86b6cc877 could not be found. Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ef0f9153-fc45-42a1-b39a-920ecd403523 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/3906b05e-b09d-411e-baca-d4b86b6cc877/action HTTP/1.1 Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 13 Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: {"pause": {}} Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 3906b05e-b09d-411e-baca-d4b86b6cc877 could not be found. Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '3906b05e-b09d-411e-baca-d4b86b6cc877', 'body': {'pause': {}}} Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3906b05e-b09d-411e-baca-d4b86b6cc877 could not be found. Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3906b05e-b09d-411e-baca-d4b86b6cc877 could not be found. Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:02.175608 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:02.187460 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:43:02.187460 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:43:02.187460 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3906b05e-b09d-411e-baca-d4b86b6cc877 could not be found. Oct 10 23:43:02.187460 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:02.187460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ef0f9153-fc45-42a1-b39a-920ecd403523 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 404 to user: Instance 3906b05e-b09d-411e-baca-d4b86b6cc877 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:43:02.187460 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ef0f9153-fc45-42a1-b39a-920ecd403523 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/3906b05e-b09d-411e-baca-d4b86b6cc877/action" status: 404 len: 111 microversion: 2.1 time: 0.031655 Oct 10 23:43:02.187460 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2591/4987] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:43:02 2022] POST /compute/v2.1/servers/3906b05e-b09d-411e-baca-d4b86b6cc877/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:43:02.197670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bee1ac1c-76dc-43b3-ae0c-a22fa8cc7d51 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:02.198443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bee1ac1c-76dc-43b3-ae0c-a22fa8cc7d51 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:02.230701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bee1ac1c-76dc-43b3-ae0c-a22fa8cc7d51 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:02.231475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bee1ac1c-76dc-43b3-ae0c-a22fa8cc7d51 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:02.231926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bee1ac1c-76dc-43b3-ae0c-a22fa8cc7d51 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:02.232698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bee1ac1c-76dc-43b3-ae0c-a22fa8cc7d51 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:02.234066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bee1ac1c-76dc-43b3-ae0c-a22fa8cc7d51 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:02.234850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bee1ac1c-76dc-43b3-ae0c-a22fa8cc7d51 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:02.277047 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-60a241a1-e40a-4889-8ad8-2ad262f299ae tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165217 Oct 10 23:43:02.290066 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2397/4988] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:43:02 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:43:02.746109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-492e435c-ec6f-4244-b3fd-d17e7bc5815a req-8a53a96e-00f6-444a-a403-29f974c5b896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e82c4dac-b092-4a01-a6ba-faeaf147e079", "name": "network-vif-plugged", "status": "completed", "tag": "eb15cec0-009b-460d-896d-f8a2f8e16987"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:02.772473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-492e435c-ec6f-4244-b3fd-d17e7bc5815a req-8a53a96e-00f6-444a-a403-29f974c5b896 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:02.772960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-492e435c-ec6f-4244-b3fd-d17e7bc5815a req-8a53a96e-00f6-444a-a403-29f974c5b896 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:02.773424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-492e435c-ec6f-4244-b3fd-d17e7bc5815a req-8a53a96e-00f6-444a-a403-29f974c5b896 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:02.793347 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-492e435c-ec6f-4244-b3fd-d17e7bc5815a req-8a53a96e-00f6-444a-a403-29f974c5b896 service nova] Creating event network-vif-plugged:eb15cec0-009b-460d-896d-f8a2f8e16987 for instance e82c4dac-b092-4a01-a6ba-faeaf147e079 on n-h2-860864-2 Oct 10 23:43:02.800748 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-492e435c-ec6f-4244-b3fd-d17e7bc5815a req-8a53a96e-00f6-444a-a403-29f974c5b896 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059958 Oct 10 23:43:02.801777 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2398/4989] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:43:02.857162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bee1ac1c-76dc-43b3-ae0c-a22fa8cc7d51 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:02.888498 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bee1ac1c-76dc-43b3-ae0c-a22fa8cc7d51 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.696620 Oct 10 23:43:02.888906 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2592/4990] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:02 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:02.919514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8d519c7a-3a57-4b99-8f6e-a322c012c344 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:02.921116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8d519c7a-3a57-4b99-8f6e-a322c012c344 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:02.956281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d519c7a-3a57-4b99-8f6e-a322c012c344 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:02.963415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d519c7a-3a57-4b99-8f6e-a322c012c344 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:02.969603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d519c7a-3a57-4b99-8f6e-a322c012c344 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:02.970591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d519c7a-3a57-4b99-8f6e-a322c012c344 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:02.971230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d519c7a-3a57-4b99-8f6e-a322c012c344 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:02.972457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d519c7a-3a57-4b99-8f6e-a322c012c344 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:03.123734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6495befc-50f2-45d9-a33e-69587476d2b9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:03.127135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6495befc-50f2-45d9-a33e-69587476d2b9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:03.143640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6495befc-50f2-45d9-a33e-69587476d2b9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:03.145477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6495befc-50f2-45d9-a33e-69587476d2b9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:03.149727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6495befc-50f2-45d9-a33e-69587476d2b9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:03.150699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6495befc-50f2-45d9-a33e-69587476d2b9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:03.151339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6495befc-50f2-45d9-a33e-69587476d2b9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:03.152103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6495befc-50f2-45d9-a33e-69587476d2b9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:03.615892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6495befc-50f2-45d9-a33e-69587476d2b9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:03.631806 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6495befc-50f2-45d9-a33e-69587476d2b9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1521 microversion: 2.1 time: 0.513117 Oct 10 23:43:03.636103 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2593/4991] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:03 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1521 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:03.649680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1af4f3ce-535f-4535-a4cc-3264b420f8b1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:03.652392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1af4f3ce-535f-4535-a4cc-3264b420f8b1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:03.679795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1af4f3ce-535f-4535-a4cc-3264b420f8b1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:03.682710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1af4f3ce-535f-4535-a4cc-3264b420f8b1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:03.684848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1af4f3ce-535f-4535-a4cc-3264b420f8b1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:03.686720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1af4f3ce-535f-4535-a4cc-3264b420f8b1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:03.689633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1af4f3ce-535f-4535-a4cc-3264b420f8b1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:03.690275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1af4f3ce-535f-4535-a4cc-3264b420f8b1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:03.787475 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1af4f3ce-535f-4535-a4cc-3264b420f8b1 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150190 Oct 10 23:43:03.792162 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2594/4992] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:43:03 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:43:03.918158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8d519c7a-3a57-4b99-8f6e-a322c012c344 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:03.941917 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8d519c7a-3a57-4b99-8f6e-a322c012c344 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 1.027666 Oct 10 23:43:03.942522 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2399/4993] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:02 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:03.969703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-eec35a3d-a1c2-4f77-9f81-601cdad0dbb3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:03.970259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-eec35a3d-a1c2-4f77-9f81-601cdad0dbb3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:03.980085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eec35a3d-a1c2-4f77-9f81-601cdad0dbb3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:03.980662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eec35a3d-a1c2-4f77-9f81-601cdad0dbb3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:03.981158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eec35a3d-a1c2-4f77-9f81-601cdad0dbb3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:03.981902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eec35a3d-a1c2-4f77-9f81-601cdad0dbb3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:03.982358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eec35a3d-a1c2-4f77-9f81-601cdad0dbb3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:03.982967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eec35a3d-a1c2-4f77-9f81-601cdad0dbb3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:04.156748 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-eec35a3d-a1c2-4f77-9f81-601cdad0dbb3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action" status: 202 len: 0 microversion: 2.1 time: 0.192110 Oct 10 23:43:04.161877 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2595/4994] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:43:03 2022] POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:43:04.167886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6f81d1b5-fcfe-4401-8454-04ede25fe037 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:04.169748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6f81d1b5-fcfe-4401-8454-04ede25fe037 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:04.184767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f81d1b5-fcfe-4401-8454-04ede25fe037 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:04.185733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f81d1b5-fcfe-4401-8454-04ede25fe037 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:04.187085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f81d1b5-fcfe-4401-8454-04ede25fe037 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:04.190495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f81d1b5-fcfe-4401-8454-04ede25fe037 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:04.191260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f81d1b5-fcfe-4401-8454-04ede25fe037 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:04.191939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f81d1b5-fcfe-4401-8454-04ede25fe037 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:04.662424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-708fc18d-db83-42d7-b0a4-f69383fdc5cc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:04.663149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-708fc18d-db83-42d7-b0a4-f69383fdc5cc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:04.671248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-708fc18d-db83-42d7-b0a4-f69383fdc5cc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:04.671895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-708fc18d-db83-42d7-b0a4-f69383fdc5cc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:04.672365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-708fc18d-db83-42d7-b0a4-f69383fdc5cc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:04.673116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-708fc18d-db83-42d7-b0a4-f69383fdc5cc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:04.688341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-708fc18d-db83-42d7-b0a4-f69383fdc5cc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:04.692734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-708fc18d-db83-42d7-b0a4-f69383fdc5cc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:05.017063 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6f81d1b5-fcfe-4401-8454-04ede25fe037 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:05.028236 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6f81d1b5-fcfe-4401-8454-04ede25fe037 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1512 microversion: 2.1 time: 0.865881 Oct 10 23:43:05.029231 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2400/4995] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:04 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1512 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:05.049994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8d78dbbd-7ee4-4fad-ab9f-6e543f5106bc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:05.063930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8d78dbbd-7ee4-4fad-ab9f-6e543f5106bc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:05.083457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d78dbbd-7ee4-4fad-ab9f-6e543f5106bc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:05.086548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d78dbbd-7ee4-4fad-ab9f-6e543f5106bc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:05.087231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d78dbbd-7ee4-4fad-ab9f-6e543f5106bc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:05.089045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d78dbbd-7ee4-4fad-ab9f-6e543f5106bc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:05.090924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d78dbbd-7ee4-4fad-ab9f-6e543f5106bc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:05.093275 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d78dbbd-7ee4-4fad-ab9f-6e543f5106bc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:05.184878 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8d78dbbd-7ee4-4fad-ab9f-6e543f5106bc tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153290 Oct 10 23:43:05.186225 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2401/4996] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:43:05 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:43:05.196923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-ee812ab1-5364-482b-acff-99acd77083f8 req-211c06c6-d5c7-434a-8abe-f07b387d0121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c65eb2-4a59-4b1e-bf11-e2094d984d0a", "name": "network-vif-unplugged", "status": "completed", "tag": "db12b09d-2d47-4f71-9616-ebcc385cf4ab"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:05.221565 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ee812ab1-5364-482b-acff-99acd77083f8 req-211c06c6-d5c7-434a-8abe-f07b387d0121 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:05.223092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ee812ab1-5364-482b-acff-99acd77083f8 req-211c06c6-d5c7-434a-8abe-f07b387d0121 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:05.226813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ee812ab1-5364-482b-acff-99acd77083f8 req-211c06c6-d5c7-434a-8abe-f07b387d0121 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:05.266989 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-ee812ab1-5364-482b-acff-99acd77083f8 req-211c06c6-d5c7-434a-8abe-f07b387d0121 service nova] Creating event network-vif-unplugged:db12b09d-2d47-4f71-9616-ebcc385cf4ab for instance 88c65eb2-4a59-4b1e-bf11-e2094d984d0a on n-h2-860864-2 Oct 10 23:43:05.283290 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-ee812ab1-5364-482b-acff-99acd77083f8 req-211c06c6-d5c7-434a-8abe-f07b387d0121 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094915 Oct 10 23:43:05.283936 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2402/4997] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:43:05.611774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-708fc18d-db83-42d7-b0a4-f69383fdc5cc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:05.637928 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-708fc18d-db83-42d7-b0a4-f69383fdc5cc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1521 microversion: 2.1 time: 0.981013 Oct 10 23:43:05.649351 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2596/4998] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:04 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1521 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:06.056506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4b6fe7d7-fa7f-4ee6-8831-6cfe6537fdec tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:06.059069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4b6fe7d7-fa7f-4ee6-8831-6cfe6537fdec tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:06.083812 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b6fe7d7-fa7f-4ee6-8831-6cfe6537fdec tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:06.085084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b6fe7d7-fa7f-4ee6-8831-6cfe6537fdec tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:06.085890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b6fe7d7-fa7f-4ee6-8831-6cfe6537fdec tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:06.087168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b6fe7d7-fa7f-4ee6-8831-6cfe6537fdec tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:06.087654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b6fe7d7-fa7f-4ee6-8831-6cfe6537fdec tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:06.088098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b6fe7d7-fa7f-4ee6-8831-6cfe6537fdec tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:06.198004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4e2639cd-d10a-4f39-9afd-f6002e767e59 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:06.201515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4e2639cd-d10a-4f39-9afd-f6002e767e59 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:06.219358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e2639cd-d10a-4f39-9afd-f6002e767e59 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:06.219806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e2639cd-d10a-4f39-9afd-f6002e767e59 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:06.220274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e2639cd-d10a-4f39-9afd-f6002e767e59 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:06.223207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e2639cd-d10a-4f39-9afd-f6002e767e59 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:06.223725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e2639cd-d10a-4f39-9afd-f6002e767e59 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:06.224179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e2639cd-d10a-4f39-9afd-f6002e767e59 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:06.291829 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4e2639cd-d10a-4f39-9afd-f6002e767e59 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098004 Oct 10 23:43:06.293123 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2597/4999] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:43:06 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:43:06.395997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4b6fe7d7-fa7f-4ee6-8831-6cfe6537fdec tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:06.409794 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4b6fe7d7-fa7f-4ee6-8831-6cfe6537fdec tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1492 microversion: 2.1 time: 0.359818 Oct 10 23:43:06.423141 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2403/5000] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:06 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1492 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:06.438362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-64bfca8a-84f8-4226-9449-d0caa0eb105a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:06.439148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-64bfca8a-84f8-4226-9449-d0caa0eb105a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:06.447805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64bfca8a-84f8-4226-9449-d0caa0eb105a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:06.448975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64bfca8a-84f8-4226-9449-d0caa0eb105a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:06.450001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64bfca8a-84f8-4226-9449-d0caa0eb105a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:06.451250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64bfca8a-84f8-4226-9449-d0caa0eb105a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:06.452745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64bfca8a-84f8-4226-9449-d0caa0eb105a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:06.453575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64bfca8a-84f8-4226-9449-d0caa0eb105a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:06.490677 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-64bfca8a-84f8-4226-9449-d0caa0eb105a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Cannot 'pause' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state paused Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-64bfca8a-84f8-4226-9449-d0caa0eb105a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action HTTP/1.1 Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 13 Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: {"pause": {}} Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: exception: Cannot 'pause' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state paused Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'efc9e449-6324-411e-8af9-0533b23a4e3c', 'body': {'pause': {}}} Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance efc9e449-6324-411e-8af9-0533b23a4e3c in vm_state paused. Cannot pause while the instance is in this state. Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state paused Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:06.493679 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:06.501198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:06.501198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:43:06.501198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:43:06.501198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state paused Oct 10 23:43:06.501198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:06.503657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-64bfca8a-84f8-4226-9449-d0caa0eb105a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 409 to user: Cannot 'pause' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state paused {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:43:06.504807 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-64bfca8a-84f8-4226-9449-d0caa0eb105a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action" status: 409 len: 143 microversion: 2.1 time: 0.072764 Oct 10 23:43:06.505630 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2598/5001] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:43:06 2022] POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action => generated 143 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:43:06.514907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9bd3dbb4-b490-4783-941d-39d017bca8d1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:06.515561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9bd3dbb4-b490-4783-941d-39d017bca8d1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:06.532467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bd3dbb4-b490-4783-941d-39d017bca8d1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:06.532952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bd3dbb4-b490-4783-941d-39d017bca8d1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:06.533420 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bd3dbb4-b490-4783-941d-39d017bca8d1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:06.534137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bd3dbb4-b490-4783-941d-39d017bca8d1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:06.534586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bd3dbb4-b490-4783-941d-39d017bca8d1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:06.540698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bd3dbb4-b490-4783-941d-39d017bca8d1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:06.677643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6c12dbbb-80c8-42a8-8f18-c0367ef81e35 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:06.678264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6c12dbbb-80c8-42a8-8f18-c0367ef81e35 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:06.690078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c12dbbb-80c8-42a8-8f18-c0367ef81e35 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:06.690621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c12dbbb-80c8-42a8-8f18-c0367ef81e35 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:06.691169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c12dbbb-80c8-42a8-8f18-c0367ef81e35 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:06.691911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c12dbbb-80c8-42a8-8f18-c0367ef81e35 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:06.692367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c12dbbb-80c8-42a8-8f18-c0367ef81e35 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:06.692794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c12dbbb-80c8-42a8-8f18-c0367ef81e35 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:06.729681 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9bd3dbb4-b490-4783-941d-39d017bca8d1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action" status: 202 len: 0 microversion: 2.1 time: 0.217861 Oct 10 23:43:06.732431 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2404/5002] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:43:06 2022] POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:43:06.741560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-66c3f8d2-4ead-43bc-a402-87b28636bea2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:06.743714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-66c3f8d2-4ead-43bc-a402-87b28636bea2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:06.779804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66c3f8d2-4ead-43bc-a402-87b28636bea2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:06.780464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66c3f8d2-4ead-43bc-a402-87b28636bea2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:06.784971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66c3f8d2-4ead-43bc-a402-87b28636bea2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:06.786944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66c3f8d2-4ead-43bc-a402-87b28636bea2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:06.793547 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66c3f8d2-4ead-43bc-a402-87b28636bea2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:06.797039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66c3f8d2-4ead-43bc-a402-87b28636bea2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:07.272842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-66c3f8d2-4ead-43bc-a402-87b28636bea2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:07.282591 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-66c3f8d2-4ead-43bc-a402-87b28636bea2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1499 microversion: 2.1 time: 0.546671 Oct 10 23:43:07.310303 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2405/5003] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:06 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1499 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:07.323939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ff10fa9e-77ee-4d9c-a156-163a3034776d tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:07.326849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ff10fa9e-77ee-4d9c-a156-163a3034776d tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:07.343444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6c12dbbb-80c8-42a8-8f18-c0367ef81e35 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:07.344116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff10fa9e-77ee-4d9c-a156-163a3034776d tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:07.344633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff10fa9e-77ee-4d9c-a156-163a3034776d tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:07.345086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff10fa9e-77ee-4d9c-a156-163a3034776d tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:07.351638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff10fa9e-77ee-4d9c-a156-163a3034776d tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:07.352348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff10fa9e-77ee-4d9c-a156-163a3034776d tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:07.353053 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6c12dbbb-80c8-42a8-8f18-c0367ef81e35 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1506 microversion: 2.1 time: 0.679864 Oct 10 23:43:07.353582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ff10fa9e-77ee-4d9c-a156-163a3034776d tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:07.357186 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2599/5004] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:06 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1506 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:07.381076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-52a16bd6-3cec-4821-a7da-73c2cf9b76f6 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:07.384260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-52a16bd6-3cec-4821-a7da-73c2cf9b76f6 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:07.426041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52a16bd6-3cec-4821-a7da-73c2cf9b76f6 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:07.428320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52a16bd6-3cec-4821-a7da-73c2cf9b76f6 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:07.428774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52a16bd6-3cec-4821-a7da-73c2cf9b76f6 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:07.432333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52a16bd6-3cec-4821-a7da-73c2cf9b76f6 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:07.432815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52a16bd6-3cec-4821-a7da-73c2cf9b76f6 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:07.433259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52a16bd6-3cec-4821-a7da-73c2cf9b76f6 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:07.493068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:43:07.497613 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ff10fa9e-77ee-4d9c-a156-163a3034776d tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185522 Oct 10 23:43:07.501698 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2406/5005] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:43:07 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:43:07.603849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-432b5429-786d-441b-84b5-52281e8daf1f req-5dc254fb-1bc2-4102-9ecd-23f7504e718a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c65eb2-4a59-4b1e-bf11-e2094d984d0a", "name": "network-vif-plugged", "status": "completed", "tag": "db12b09d-2d47-4f71-9616-ebcc385cf4ab"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:07.644072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-432b5429-786d-441b-84b5-52281e8daf1f req-5dc254fb-1bc2-4102-9ecd-23f7504e718a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:07.653620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-432b5429-786d-441b-84b5-52281e8daf1f req-5dc254fb-1bc2-4102-9ecd-23f7504e718a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:07.659773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-432b5429-786d-441b-84b5-52281e8daf1f req-5dc254fb-1bc2-4102-9ecd-23f7504e718a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:07.728107 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-432b5429-786d-441b-84b5-52281e8daf1f req-5dc254fb-1bc2-4102-9ecd-23f7504e718a service nova] Creating event network-vif-plugged:db12b09d-2d47-4f71-9616-ebcc385cf4ab for instance 88c65eb2-4a59-4b1e-bf11-e2094d984d0a on n-h2-860864-2 Oct 10 23:43:07.755177 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-432b5429-786d-441b-84b5-52281e8daf1f req-5dc254fb-1bc2-4102-9ecd-23f7504e718a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158786 Oct 10 23:43:07.760930 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2407/5006] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:43:07.942883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-52a16bd6-3cec-4821-a7da-73c2cf9b76f6 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:07.957116 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-52a16bd6-3cec-4821-a7da-73c2cf9b76f6 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 200 len: 1506 microversion: 2.1 time: 0.580755 Oct 10 23:43:07.965610 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2600/5007] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:07 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 1506 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:07.989078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a9aa4a73-3146-41d4-84fb-34e6addcf52d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:07.992094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a9aa4a73-3146-41d4-84fb-34e6addcf52d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:08.008003 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9aa4a73-3146-41d4-84fb-34e6addcf52d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:08.008518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9aa4a73-3146-41d4-84fb-34e6addcf52d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:08.008973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9aa4a73-3146-41d4-84fb-34e6addcf52d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:08.013508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9aa4a73-3146-41d4-84fb-34e6addcf52d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:08.014132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9aa4a73-3146-41d4-84fb-34e6addcf52d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:08.014916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9aa4a73-3146-41d4-84fb-34e6addcf52d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:08.130382 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a9aa4a73-3146-41d4-84fb-34e6addcf52d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:43:08.339160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5a8b9a14-fde8-41ab-9ea7-9cf3f1378711 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:08.344620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5a8b9a14-fde8-41ab-9ea7-9cf3f1378711 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:08.353116 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a9aa4a73-3146-41d4-84fb-34e6addcf52d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 204 len: 0 microversion: 2.1 time: 0.368113 Oct 10 23:43:08.355296 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2408/5008] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:43:07 2022] DELETE /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:43:08.409406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a8b9a14-fde8-41ab-9ea7-9cf3f1378711 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:08.426699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a8b9a14-fde8-41ab-9ea7-9cf3f1378711 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:08.427633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a8b9a14-fde8-41ab-9ea7-9cf3f1378711 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:08.440292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a8b9a14-fde8-41ab-9ea7-9cf3f1378711 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:08.440980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a8b9a14-fde8-41ab-9ea7-9cf3f1378711 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:08.450361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a8b9a14-fde8-41ab-9ea7-9cf3f1378711 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:08.512744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-46e954aa-6565-40c4-964c-ab4e3c0dcf81 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:08.520440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-46e954aa-6565-40c4-964c-ab4e3c0dcf81 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:08.557248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46e954aa-6565-40c4-964c-ab4e3c0dcf81 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:08.562682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46e954aa-6565-40c4-964c-ab4e3c0dcf81 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:08.567302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46e954aa-6565-40c4-964c-ab4e3c0dcf81 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:08.568318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46e954aa-6565-40c4-964c-ab4e3c0dcf81 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:08.571297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46e954aa-6565-40c4-964c-ab4e3c0dcf81 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:08.575342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46e954aa-6565-40c4-964c-ab4e3c0dcf81 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:08.723095 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-46e954aa-6565-40c4-964c-ab4e3c0dcf81 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.216362 Oct 10 23:43:08.738376 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2409/5009] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:43:08 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments => generated 197 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:43:08.755501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-50861457-b4ab-4b2c-bc70-ab33ab2c8ea9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1729095253", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "99aa30e7-a2c6-4b17-b974-bb1c36c895bd"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:08.966696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-50861457-b4ab-4b2c-bc70-ab33ab2c8ea9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] validate_networks() for [('99aa30e7-a2c6-4b17-b974-bb1c36c895bd', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:43:09.226610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5a8b9a14-fde8-41ab-9ea7-9cf3f1378711 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:09.243627 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5a8b9a14-fde8-41ab-9ea7-9cf3f1378711 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.938448 Oct 10 23:43:09.247975 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2601/5010] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:08 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:09.278632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b1a1b763-3b22-4f73-8ef4-55dbbf2a93f8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:09.279487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b1a1b763-3b22-4f73-8ef4-55dbbf2a93f8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:09.307168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1a1b763-3b22-4f73-8ef4-55dbbf2a93f8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:09.307680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1a1b763-3b22-4f73-8ef4-55dbbf2a93f8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:09.308214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1a1b763-3b22-4f73-8ef4-55dbbf2a93f8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:09.309947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1a1b763-3b22-4f73-8ef4-55dbbf2a93f8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:09.310422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1a1b763-3b22-4f73-8ef4-55dbbf2a93f8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:09.310862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1a1b763-3b22-4f73-8ef4-55dbbf2a93f8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:09.839127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b1a1b763-3b22-4f73-8ef4-55dbbf2a93f8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:09.854260 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b1a1b763-3b22-4f73-8ef4-55dbbf2a93f8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.578653 Oct 10 23:43:09.856967 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2602/5011] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:09 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:09.869983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8f02ca16-b76b-45a8-aaf1-108224ac2fc0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:09.875152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8f02ca16-b76b-45a8-aaf1-108224ac2fc0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:09.888115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f02ca16-b76b-45a8-aaf1-108224ac2fc0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:09.889994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f02ca16-b76b-45a8-aaf1-108224ac2fc0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:09.890948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f02ca16-b76b-45a8-aaf1-108224ac2fc0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:09.898945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f02ca16-b76b-45a8-aaf1-108224ac2fc0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:09.900614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f02ca16-b76b-45a8-aaf1-108224ac2fc0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:09.903585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f02ca16-b76b-45a8-aaf1-108224ac2fc0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:09.993074 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8f02ca16-b76b-45a8-aaf1-108224ac2fc0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133125 Oct 10 23:43:09.997471 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2603/5012] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:43:09 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:43:10.019534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ad013656-3bd2-4d9c-83bb-fb8a8bb18756 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:10.022511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ad013656-3bd2-4d9c-83bb-fb8a8bb18756 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6195ee8f-6f37-4b7a-9b30-c813010aa4cb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:10.046061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad013656-3bd2-4d9c-83bb-fb8a8bb18756 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:10.048186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad013656-3bd2-4d9c-83bb-fb8a8bb18756 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:10.050246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad013656-3bd2-4d9c-83bb-fb8a8bb18756 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:10.051243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad013656-3bd2-4d9c-83bb-fb8a8bb18756 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:10.054841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad013656-3bd2-4d9c-83bb-fb8a8bb18756 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:10.056030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad013656-3bd2-4d9c-83bb-fb8a8bb18756 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:10.089955 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-ad013656-3bd2-4d9c-83bb-fb8a8bb18756 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ad013656-3bd2-4d9c-83bb-fb8a8bb18756 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb/action HTTP/1.1 Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 28 Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: {"reboot": {"type": "SOFT"}} Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '6195ee8f-6f37-4b7a-9b30-c813010aa4cb', 'body': {'reboot': {'type': 'SOFT'}}} Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:43:10.096268 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:43:10.105967 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:43:10.105967 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:10.105967 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:10.105967 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:10.105967 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:10.105967 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:10.105967 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:10.105967 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:43:10.105967 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:43:10.105967 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:43:10.105967 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:10.105967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ad013656-3bd2-4d9c-83bb-fb8a8bb18756 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 404 to user: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:43:10.105967 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ad013656-3bd2-4d9c-83bb-fb8a8bb18756 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb/action" status: 404 len: 111 microversion: 2.1 time: 0.092915 Oct 10 23:43:10.105967 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2604/5013] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:43:09 2022] POST /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb/action => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:43:10.111109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3d56c950-969d-4e32-bab8-56c2bcf1075c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:10.111750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3d56c950-969d-4e32-bab8-56c2bcf1075c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:10.129901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d56c950-969d-4e32-bab8-56c2bcf1075c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:10.130405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d56c950-969d-4e32-bab8-56c2bcf1075c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:10.130844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d56c950-969d-4e32-bab8-56c2bcf1075c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:10.137367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d56c950-969d-4e32-bab8-56c2bcf1075c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:10.137924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d56c950-969d-4e32-bab8-56c2bcf1075c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:10.138348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d56c950-969d-4e32-bab8-56c2bcf1075c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:10.825778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3d56c950-969d-4e32-bab8-56c2bcf1075c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:10.836424 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3d56c950-969d-4e32-bab8-56c2bcf1075c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.730036 Oct 10 23:43:10.839484 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2605/5014] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:10 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:10.876639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4e9c11d0-d158-4f48-a6ec-df8e7278544b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:10.877592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4e9c11d0-d158-4f48-a6ec-df8e7278544b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:10.892169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e9c11d0-d158-4f48-a6ec-df8e7278544b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:10.892679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e9c11d0-d158-4f48-a6ec-df8e7278544b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:10.893121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e9c11d0-d158-4f48-a6ec-df8e7278544b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:10.893893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e9c11d0-d158-4f48-a6ec-df8e7278544b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:10.903467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e9c11d0-d158-4f48-a6ec-df8e7278544b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:10.904013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e9c11d0-d158-4f48-a6ec-df8e7278544b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:10.908681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-50861457-b4ab-4b2c-bc70-ab33ab2c8ea9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:43:10.909415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-50861457-b4ab-4b2c-bc70-ab33ab2c8ea9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:43:10.909928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-50861457-b4ab-4b2c-bc70-ab33ab2c8ea9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:43:10.910343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-50861457-b4ab-4b2c-bc70-ab33ab2c8ea9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:43:10.910758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-50861457-b4ab-4b2c-bc70-ab33ab2c8ea9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:43:10.941892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50861457-b4ab-4b2c-bc70-ab33ab2c8ea9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:10.942662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50861457-b4ab-4b2c-bc70-ab33ab2c8ea9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:10.943286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50861457-b4ab-4b2c-bc70-ab33ab2c8ea9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:10.944196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50861457-b4ab-4b2c-bc70-ab33ab2c8ea9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:10.944960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50861457-b4ab-4b2c-bc70-ab33ab2c8ea9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:10.945640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50861457-b4ab-4b2c-bc70-ab33ab2c8ea9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:10.995124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-50861457-b4ab-4b2c-bc70-ab33ab2c8ea9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Getting quotas for project fea9f7995c3349008497343ab1940287. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:43:11.007785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-50861457-b4ab-4b2c-bc70-ab33ab2c8ea9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Getting quotas for user 8eb15e7a60664cc7a0e5f7236dada33c and project fea9f7995c3349008497343ab1940287. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:43:11.040747 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-50861457-b4ab-4b2c-bc70-ab33ab2c8ea9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:43:11.053969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-50861457-b4ab-4b2c-bc70-ab33ab2c8ea9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:43:11.114961 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-50861457-b4ab-4b2c-bc70-ab33ab2c8ea9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.375354 Oct 10 23:43:11.118127 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2410/5015] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:43:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:43:11.129113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c96ada3c-adf0-45ae-96d4-4a4b3d81597f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:11.132820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c96ada3c-adf0-45ae-96d4-4a4b3d81597f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:11.144859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c96ada3c-adf0-45ae-96d4-4a4b3d81597f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:11.145764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c96ada3c-adf0-45ae-96d4-4a4b3d81597f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:11.146421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c96ada3c-adf0-45ae-96d4-4a4b3d81597f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:11.147324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c96ada3c-adf0-45ae-96d4-4a4b3d81597f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:11.148050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c96ada3c-adf0-45ae-96d4-4a4b3d81597f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:11.148650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c96ada3c-adf0-45ae-96d4-4a4b3d81597f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:11.188917 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c96ada3c-adf0-45ae-96d4-4a4b3d81597f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069316 Oct 10 23:43:11.190186 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2411/5016] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:43:11 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:43:11.207816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-19d77fed-3fd9-4049-a791-d5a61272ef26 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:11.209323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-19d77fed-3fd9-4049-a791-d5a61272ef26 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:11.458210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4e9c11d0-d158-4f48-a6ec-df8e7278544b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:11.466124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-19d77fed-3fd9-4049-a791-d5a61272ef26 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:11.470188 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4e9c11d0-d158-4f48-a6ec-df8e7278544b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.605366 Oct 10 23:43:11.472375 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2606/5017] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:10 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:11.482170 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-19d77fed-3fd9-4049-a791-d5a61272ef26 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1218 microversion: 2.1 time: 0.283281 Oct 10 23:43:11.482170 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2412/5018] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:11 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1218 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:11.496742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5f46edeb-3d92-4536-90d5-a9eddb788969 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:11.499978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5f46edeb-3d92-4536-90d5-a9eddb788969 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:11.504044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-0dfff314-6362-4b83-a46e-72b223f92b21 req-25e24abd-94f4-4a92-ae20-62be8171a2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e82c4dac-b092-4a01-a6ba-faeaf147e079", "name": "network-vif-deleted", "tag": "eb15cec0-009b-460d-896d-f8a2f8e16987"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:11.518812 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f46edeb-3d92-4536-90d5-a9eddb788969 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:11.522263 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f46edeb-3d92-4536-90d5-a9eddb788969 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:11.522831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f46edeb-3d92-4536-90d5-a9eddb788969 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:11.525080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f46edeb-3d92-4536-90d5-a9eddb788969 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:11.530226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0dfff314-6362-4b83-a46e-72b223f92b21 req-25e24abd-94f4-4a92-ae20-62be8171a2f9 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:11.531113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0dfff314-6362-4b83-a46e-72b223f92b21 req-25e24abd-94f4-4a92-ae20-62be8171a2f9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:11.531745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f46edeb-3d92-4536-90d5-a9eddb788969 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:11.532321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f46edeb-3d92-4536-90d5-a9eddb788969 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:11.533540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0dfff314-6362-4b83-a46e-72b223f92b21 req-25e24abd-94f4-4a92-ae20-62be8171a2f9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:11.590745 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-0dfff314-6362-4b83-a46e-72b223f92b21 req-25e24abd-94f4-4a92-ae20-62be8171a2f9 service nova] Creating event network-vif-deleted:eb15cec0-009b-460d-896d-f8a2f8e16987 for instance e82c4dac-b092-4a01-a6ba-faeaf147e079 on n-h2-860864-2 Oct 10 23:43:11.612728 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-0dfff314-6362-4b83-a46e-72b223f92b21 req-25e24abd-94f4-4a92-ae20-62be8171a2f9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118020 Oct 10 23:43:11.621477 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2607/5019] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:43:11.621939 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-5f46edeb-3d92-4536-90d5-a9eddb788969 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] HTTP exception thrown: Cannot 'reboot' instance c1421397-3387-4b28-8473-51140ba79621 while it is in vm_state rescued Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5f46edeb-3d92-4536-90d5-a9eddb788969 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Request method failure captured: Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621/action HTTP/1.1 Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 28 Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKzOYlZsv7rRo2sa7kQc2eFaI8v-TMGvuh-sVU-zvganQJF5vXcDouizKP05ne1GDSQKrDkWUQDAU6qxxYttyNZ_6Byu14LDFhfplUKI_eaTrPi0t5xENermj156ZGMg1lyNDKMrSevusXHHA-zCISDm6SLPwivXrQErNiD9Jy9X9Qs Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 8986c214fcc944acb2731cc5af19ef0c Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8986c214fcc944acb2731cc5af19ef0c", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 8986c214fcc944acb2731cc5af19ef0c Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerRescueNegativeTestJSON-906322093-project Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 585d2834c2a94c5eaa8267cf2ba58ac0 Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerRescueNegativeTestJSON-906322093-project Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: {"reboot": {"type": "HARD"}} Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: exception: Cannot 'reboot' instance c1421397-3387-4b28-8473-51140ba79621 while it is in vm_state rescued Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'c1421397-3387-4b28-8473-51140ba79621', 'body': {'reboot': {'type': 'HARD'}}} Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c1421397-3387-4b28-8473-51140ba79621 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 23:43:11.643493 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 23:43:11.648283 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance c1421397-3387-4b28-8473-51140ba79621 while it is in vm_state rescued Oct 10 23:43:11.648283 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:11.648283 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:11.648283 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:11.648283 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:11.648283 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:11.648283 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:11.648283 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:43:11.648283 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:43:11.648283 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance c1421397-3387-4b28-8473-51140ba79621 while it is in vm_state rescued Oct 10 23:43:11.648283 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:11.648283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5f46edeb-3d92-4536-90d5-a9eddb788969 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Returning 409 to user: Cannot 'reboot' instance c1421397-3387-4b28-8473-51140ba79621 while it is in vm_state rescued {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:43:11.648283 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5f46edeb-3d92-4536-90d5-a9eddb788969 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "POST /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621/action" status: 409 len: 145 microversion: 2.1 time: 0.163185 Oct 10 23:43:11.650748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a37ad4ca-5ee3-4abe-bcb2-8805ee99cf34 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:11.652253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a37ad4ca-5ee3-4abe-bcb2-8805ee99cf34 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 0ba157a1-17de-422b-8182-3a42b078905d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:11.657716 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2413/5020] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:43:11 2022] POST /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621/action => generated 145 bytes in 181 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:43:11.666742 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-a37ad4ca-5ee3-4abe-bcb2-8805ee99cf34 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Instance 0ba157a1-17de-422b-8182-3a42b078905d could not be found. Oct 10 23:43:11.667450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-54c2570b-240f-4931-9b5d-b4182335ed63 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a37ad4ca-5ee3-4abe-bcb2-8805ee99cf34 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/0ba157a1-17de-422b-8182-3a42b078905d/action HTTP/1.1 Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 28 Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: {"reboot": {"type": "SOFT"}} Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 0ba157a1-17de-422b-8182-3a42b078905d could not be found. Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '0ba157a1-17de-422b-8182-3a42b078905d', 'body': {'reboot': {'type': 'SOFT'}}} Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ba157a1-17de-422b-8182-3a42b078905d could not be found. Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba157a1-17de-422b-8182-3a42b078905d could not be found. Oct 10 23:43:11.669884 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:11.676886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:11.676886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:11.676886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:11.676886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:11.676886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:11.676886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:43:11.676886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:43:11.676886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba157a1-17de-422b-8182-3a42b078905d could not be found. Oct 10 23:43:11.676886 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:11.676886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a37ad4ca-5ee3-4abe-bcb2-8805ee99cf34 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 404 to user: Instance 0ba157a1-17de-422b-8182-3a42b078905d could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:43:11.676886 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a37ad4ca-5ee3-4abe-bcb2-8805ee99cf34 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/0ba157a1-17de-422b-8182-3a42b078905d/action" status: 404 len: 111 microversion: 2.1 time: 0.046863 Oct 10 23:43:11.678895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-54c2570b-240f-4931-9b5d-b4182335ed63 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:11.681745 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2608/5021] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:43:11 2022] POST /compute/v2.1/servers/0ba157a1-17de-422b-8182-3a42b078905d/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:43:11.690908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54c2570b-240f-4931-9b5d-b4182335ed63 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:11.696454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54c2570b-240f-4931-9b5d-b4182335ed63 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:11.697495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54c2570b-240f-4931-9b5d-b4182335ed63 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:11.697655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0b18fc5d-60f5-4576-8931-033f6dcdeaa1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:11.698381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0b18fc5d-60f5-4576-8931-033f6dcdeaa1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:11.699407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54c2570b-240f-4931-9b5d-b4182335ed63 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:11.701160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54c2570b-240f-4931-9b5d-b4182335ed63 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:11.702182 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54c2570b-240f-4931-9b5d-b4182335ed63 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:11.724833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b18fc5d-60f5-4576-8931-033f6dcdeaa1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:11.725771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b18fc5d-60f5-4576-8931-033f6dcdeaa1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:11.726484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b18fc5d-60f5-4576-8931-033f6dcdeaa1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:11.727425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b18fc5d-60f5-4576-8931-033f6dcdeaa1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:11.729939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b18fc5d-60f5-4576-8931-033f6dcdeaa1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:11.730615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b18fc5d-60f5-4576-8931-033f6dcdeaa1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:11.767746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:43:11.798487 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-54c2570b-240f-4931-9b5d-b4182335ed63 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] HTTP exception thrown: Cannot 'rebuild' instance c1421397-3387-4b28-8473-51140ba79621 while it is in vm_state rescued Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-54c2570b-240f-4931-9b5d-b4182335ed63 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Request method failure captured: Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621/action HTTP/1.1 Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 65 Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKzOYlZsv7rRo2sa7kQc2eFaI8v-TMGvuh-sVU-zvganQJF5vXcDouizKP05ne1GDSQKrDkWUQDAU6qxxYttyNZ_6Byu14LDFhfplUKI_eaTrPi0t5xENermj156ZGMg1lyNDKMrSevusXHHA-zCISDm6SLPwivXrQErNiD9Jy9X9Qs Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 8986c214fcc944acb2731cc5af19ef0c Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8986c214fcc944acb2731cc5af19ef0c", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 8986c214fcc944acb2731cc5af19ef0c Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerRescueNegativeTestJSON-906322093-project Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 585d2834c2a94c5eaa8267cf2ba58ac0 Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerRescueNegativeTestJSON-906322093-project Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: {"rebuild": {"imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889"}} Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: exception: Cannot 'rebuild' instance c1421397-3387-4b28-8473-51140ba79621 while it is in vm_state rescued Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'c1421397-3387-4b28-8473-51140ba79621', 'body': {'rebuild': {'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889'}}} Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c1421397-3387-4b28-8473-51140ba79621 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:43:11.805030 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:43:11.812207 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:43:11.812207 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 10 23:43:11.812207 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 10 23:43:11.812207 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 23:43:11.812207 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 23:43:11.812207 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 23:43:11.812207 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance c1421397-3387-4b28-8473-51140ba79621 while it is in vm_state rescued Oct 10 23:43:11.812207 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:11.812207 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:11.812207 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:11.812207 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:11.812207 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:11.812207 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:11.812207 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:43:11.812207 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:43:11.812207 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance c1421397-3387-4b28-8473-51140ba79621 while it is in vm_state rescued Oct 10 23:43:11.812207 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:11.812207 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-54c2570b-240f-4931-9b5d-b4182335ed63 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Returning 409 to user: Cannot 'rebuild' instance c1421397-3387-4b28-8473-51140ba79621 while it is in vm_state rescued {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:43:11.814174 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-54c2570b-240f-4931-9b5d-b4182335ed63 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "POST /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621/action" status: 409 len: 146 microversion: 2.1 time: 0.150987 Oct 10 23:43:11.830086 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2414/5022] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:43:11 2022] POST /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621/action => generated 146 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:43:11.838357 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0a0b769c-7519-4ef0-be29-5cdfe8fec97f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:11.846323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0a0b769c-7519-4ef0-be29-5cdfe8fec97f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:11.855969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a0b769c-7519-4ef0-be29-5cdfe8fec97f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:11.860563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a0b769c-7519-4ef0-be29-5cdfe8fec97f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:11.861519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a0b769c-7519-4ef0-be29-5cdfe8fec97f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:11.866796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a0b769c-7519-4ef0-be29-5cdfe8fec97f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:11.867764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a0b769c-7519-4ef0-be29-5cdfe8fec97f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:11.868557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a0b769c-7519-4ef0-be29-5cdfe8fec97f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:11.934812 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0a0b769c-7519-4ef0-be29-5cdfe8fec97f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:43:12.141523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:43:12.169804 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0a0b769c-7519-4ef0-be29-5cdfe8fec97f tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 204 len: 0 microversion: 2.1 time: 0.338156 Oct 10 23:43:12.172514 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2415/5023] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:43:11 2022] DELETE /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:43:12.189421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f845635a-e82d-45b1-9d8a-f6f42474ce2a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:12.191443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f845635a-e82d-45b1-9d8a-f6f42474ce2a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:12.216688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f845635a-e82d-45b1-9d8a-f6f42474ce2a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:12.218602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f845635a-e82d-45b1-9d8a-f6f42474ce2a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:12.219467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f845635a-e82d-45b1-9d8a-f6f42474ce2a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:12.220466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f845635a-e82d-45b1-9d8a-f6f42474ce2a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:12.222221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f845635a-e82d-45b1-9d8a-f6f42474ce2a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:12.223019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f845635a-e82d-45b1-9d8a-f6f42474ce2a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:12.353448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0b18fc5d-60f5-4576-8931-033f6dcdeaa1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:12.371432 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0b18fc5d-60f5-4576-8931-033f6dcdeaa1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.688209 Oct 10 23:43:12.376800 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2609/5024] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:11 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:12.401708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3ff5e293-8a1b-4485-9d54-f96ff2e5974f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:12.402332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3ff5e293-8a1b-4485-9d54-f96ff2e5974f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:12.445861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ff5e293-8a1b-4485-9d54-f96ff2e5974f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:12.450250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ff5e293-8a1b-4485-9d54-f96ff2e5974f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:12.450795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ff5e293-8a1b-4485-9d54-f96ff2e5974f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:12.457085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ff5e293-8a1b-4485-9d54-f96ff2e5974f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:12.462369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ff5e293-8a1b-4485-9d54-f96ff2e5974f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:12.463850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ff5e293-8a1b-4485-9d54-f96ff2e5974f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:12.765701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f845635a-e82d-45b1-9d8a-f6f42474ce2a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:12.778778 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f845635a-e82d-45b1-9d8a-f6f42474ce2a tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1691 microversion: 2.1 time: 0.601167 Oct 10 23:43:12.782232 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2416/5025] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:12 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1691 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:12.798165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ea562f41-d816-480c-b0aa-2682118f19f8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:12.799190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ea562f41-d816-480c-b0aa-2682118f19f8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:12.827981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea562f41-d816-480c-b0aa-2682118f19f8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:12.829067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea562f41-d816-480c-b0aa-2682118f19f8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:12.829807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea562f41-d816-480c-b0aa-2682118f19f8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:12.830922 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea562f41-d816-480c-b0aa-2682118f19f8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:12.831739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea562f41-d816-480c-b0aa-2682118f19f8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:12.832509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea562f41-d816-480c-b0aa-2682118f19f8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:12.967962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ea562f41-d816-480c-b0aa-2682118f19f8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:12.977292 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ea562f41-d816-480c-b0aa-2682118f19f8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1222 microversion: 2.1 time: 0.193607 Oct 10 23:43:12.985122 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2417/5026] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:12 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1222 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:13.809944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0f7d2c3b-f14d-4e36-9680-588810a42784 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:13.813258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0f7d2c3b-f14d-4e36-9680-588810a42784 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:13.885296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3ff5e293-8a1b-4485-9d54-f96ff2e5974f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:13.885877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f7d2c3b-f14d-4e36-9680-588810a42784 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:13.890630 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f7d2c3b-f14d-4e36-9680-588810a42784 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:13.898606 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3ff5e293-8a1b-4485-9d54-f96ff2e5974f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 1.502453 Oct 10 23:43:13.899830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f7d2c3b-f14d-4e36-9680-588810a42784 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:13.900600 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2610/5027] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:12 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:13.903881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f7d2c3b-f14d-4e36-9680-588810a42784 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:13.905878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f7d2c3b-f14d-4e36-9680-588810a42784 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:13.906621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0f7d2c3b-f14d-4e36-9680-588810a42784 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:13.936980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7bc8a55d-62eb-4794-b45b-4f314484771b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:13.947359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7bc8a55d-62eb-4794-b45b-4f314484771b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6195ee8f-6f37-4b7a-9b30-c813010aa4cb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:14.023476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bc8a55d-62eb-4794-b45b-4f314484771b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:14.026406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bc8a55d-62eb-4794-b45b-4f314484771b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:14.028691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bc8a55d-62eb-4794-b45b-4f314484771b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:14.032375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bc8a55d-62eb-4794-b45b-4f314484771b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:14.033079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bc8a55d-62eb-4794-b45b-4f314484771b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:14.036781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bc8a55d-62eb-4794-b45b-4f314484771b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:14.072455 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-7bc8a55d-62eb-4794-b45b-4f314484771b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7bc8a55d-62eb-4794-b45b-4f314484771b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb/action HTTP/1.1 Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 65 Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: {"rebuild": {"imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889"}} Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '6195ee8f-6f37-4b7a-9b30-c813010aa4cb', 'body': {'rebuild': {'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889'}}} Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 10 23:43:14.075234 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 10 23:43:14.081710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 10 23:43:14.081710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:43:14.081710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:43:14.081710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:43:14.081710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:43:14.081710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:43:14.081710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:14.081710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:14.081710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:14.081710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:14.081710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:14.081710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:14.081710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:43:14.081710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:43:14.081710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:43:14.081710 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:14.086864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7bc8a55d-62eb-4794-b45b-4f314484771b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 404 to user: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:43:14.087938 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7bc8a55d-62eb-4794-b45b-4f314484771b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb/action" status: 404 len: 111 microversion: 2.1 time: 0.167717 Oct 10 23:43:14.089085 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2611/5028] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:43:13 2022] POST /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb/action => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:43:14.096691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4f2280af-669d-4bbf-a985-12c6c43e87b4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:14.097654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4f2280af-669d-4bbf-a985-12c6c43e87b4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:14.125614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f2280af-669d-4bbf-a985-12c6c43e87b4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:14.129157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f2280af-669d-4bbf-a985-12c6c43e87b4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:14.129887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f2280af-669d-4bbf-a985-12c6c43e87b4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:14.132549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f2280af-669d-4bbf-a985-12c6c43e87b4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:14.133938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f2280af-669d-4bbf-a985-12c6c43e87b4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:14.137045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f2280af-669d-4bbf-a985-12c6c43e87b4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:14.359562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0f7d2c3b-f14d-4e36-9680-588810a42784 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:14.369816 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0f7d2c3b-f14d-4e36-9680-588810a42784 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1691 microversion: 2.1 time: 0.567878 Oct 10 23:43:14.375369 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2418/5029] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:13 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1691 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:14.380555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-53cf23b8-a987-4c20-9445-2eba385adba1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:14.381527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-53cf23b8-a987-4c20-9445-2eba385adba1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:14.419165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53cf23b8-a987-4c20-9445-2eba385adba1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:14.419704 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53cf23b8-a987-4c20-9445-2eba385adba1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:14.420166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53cf23b8-a987-4c20-9445-2eba385adba1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:14.425068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53cf23b8-a987-4c20-9445-2eba385adba1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:14.428425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53cf23b8-a987-4c20-9445-2eba385adba1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:14.429345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53cf23b8-a987-4c20-9445-2eba385adba1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:14.513230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4f2280af-669d-4bbf-a985-12c6c43e87b4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:14.567387 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4f2280af-669d-4bbf-a985-12c6c43e87b4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1278 microversion: 2.1 time: 0.475766 Oct 10 23:43:14.573252 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2612/5030] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:14 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1278 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:14.783835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-53cf23b8-a987-4c20-9445-2eba385adba1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:14.796589 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-53cf23b8-a987-4c20-9445-2eba385adba1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.419599 Oct 10 23:43:14.797223 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2419/5031] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:14 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:14.839601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-647dd415-0c84-4581-8939-65a974fab842 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:14.840821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-647dd415-0c84-4581-8939-65a974fab842 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:14.850990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-647dd415-0c84-4581-8939-65a974fab842 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:14.852047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-647dd415-0c84-4581-8939-65a974fab842 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:14.852748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-647dd415-0c84-4581-8939-65a974fab842 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:14.853712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-647dd415-0c84-4581-8939-65a974fab842 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:14.854370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-647dd415-0c84-4581-8939-65a974fab842 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:14.854976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-647dd415-0c84-4581-8939-65a974fab842 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:15.399082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-58581f6b-3667-418c-a093-0ddd594939b5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:15.399939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-58581f6b-3667-418c-a093-0ddd594939b5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:15.429039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58581f6b-3667-418c-a093-0ddd594939b5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:15.432519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58581f6b-3667-418c-a093-0ddd594939b5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:15.433026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58581f6b-3667-418c-a093-0ddd594939b5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:15.442615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58581f6b-3667-418c-a093-0ddd594939b5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:15.446314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58581f6b-3667-418c-a093-0ddd594939b5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:15.446959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58581f6b-3667-418c-a093-0ddd594939b5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:15.564968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-647dd415-0c84-4581-8939-65a974fab842 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:15.580400 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-647dd415-0c84-4581-8939-65a974fab842 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.749708 Oct 10 23:43:15.586581 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2613/5032] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:14 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:15.613771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fcb302a4-6dd5-4032-816e-dec09dc95820 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:15.621705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fcb302a4-6dd5-4032-816e-dec09dc95820 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:15.643048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fcb302a4-6dd5-4032-816e-dec09dc95820 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:15.647030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fcb302a4-6dd5-4032-816e-dec09dc95820 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:15.651552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fcb302a4-6dd5-4032-816e-dec09dc95820 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:15.658407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fcb302a4-6dd5-4032-816e-dec09dc95820 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:15.665947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fcb302a4-6dd5-4032-816e-dec09dc95820 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:15.666795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fcb302a4-6dd5-4032-816e-dec09dc95820 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:16.238105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-58581f6b-3667-418c-a093-0ddd594939b5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:16.250932 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-58581f6b-3667-418c-a093-0ddd594939b5 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1691 microversion: 2.1 time: 0.857049 Oct 10 23:43:16.269420 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2420/5033] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:15 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1691 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:16.269420 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-81020abf-71a8-4168-abc5-e9dcfb92add9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:16.269420 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-81020abf-71a8-4168-abc5-e9dcfb92add9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 8bc77db5-95cc-460d-92da-bc5ff87693e0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:16.310328 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-81020abf-71a8-4168-abc5-e9dcfb92add9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Instance 8bc77db5-95cc-460d-92da-bc5ff87693e0 could not be found. Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-81020abf-71a8-4168-abc5-e9dcfb92add9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/8bc77db5-95cc-460d-92da-bc5ff87693e0/action HTTP/1.1 Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 65 Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: {"rebuild": {"imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889"}} Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 8bc77db5-95cc-460d-92da-bc5ff87693e0 could not be found. Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '8bc77db5-95cc-460d-92da-bc5ff87693e0', 'body': {'rebuild': {'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889'}}} Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bc77db5-95cc-460d-92da-bc5ff87693e0 could not be found. Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 10 23:43:16.313433 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:43:16.322156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:43:16.322156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:43:16.322156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:43:16.322156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bc77db5-95cc-460d-92da-bc5ff87693e0 could not be found. Oct 10 23:43:16.322156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:16.322156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:16.322156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:16.322156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:16.322156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:16.322156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:16.322156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:43:16.322156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:43:16.322156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bc77db5-95cc-460d-92da-bc5ff87693e0 could not be found. Oct 10 23:43:16.322156 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:16.322156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-81020abf-71a8-4168-abc5-e9dcfb92add9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 404 to user: Instance 8bc77db5-95cc-460d-92da-bc5ff87693e0 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:43:16.322156 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-81020abf-71a8-4168-abc5-e9dcfb92add9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/8bc77db5-95cc-460d-92da-bc5ff87693e0/action" status: 404 len: 111 microversion: 2.1 time: 0.056148 Oct 10 23:43:16.325541 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2421/5034] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:43:16 2022] POST /compute/v2.1/servers/8bc77db5-95cc-460d-92da-bc5ff87693e0/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:43:16.344811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fcb302a4-6dd5-4032-816e-dec09dc95820 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:16.347396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4d0489cb-dcb9-4b70-bc89-75cad8431f3f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:16.350947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4d0489cb-dcb9-4b70-bc89-75cad8431f3f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:16.357214 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fcb302a4-6dd5-4032-816e-dec09dc95820 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1276 microversion: 2.1 time: 0.754222 Oct 10 23:43:16.358507 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2614/5035] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:15 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1276 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:16.379120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d0489cb-dcb9-4b70-bc89-75cad8431f3f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:16.380264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d0489cb-dcb9-4b70-bc89-75cad8431f3f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:16.381296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d0489cb-dcb9-4b70-bc89-75cad8431f3f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:16.384601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d0489cb-dcb9-4b70-bc89-75cad8431f3f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:16.388823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d0489cb-dcb9-4b70-bc89-75cad8431f3f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:16.390311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4d0489cb-dcb9-4b70-bc89-75cad8431f3f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:17.288261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2afedf0c-434a-44bd-af50-208242fc1aa9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:17.289643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2afedf0c-434a-44bd-af50-208242fc1aa9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:17.299377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2afedf0c-434a-44bd-af50-208242fc1aa9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:17.300315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2afedf0c-434a-44bd-af50-208242fc1aa9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:17.300315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2afedf0c-434a-44bd-af50-208242fc1aa9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:17.300993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2afedf0c-434a-44bd-af50-208242fc1aa9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:17.307634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2afedf0c-434a-44bd-af50-208242fc1aa9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:17.308473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2afedf0c-434a-44bd-af50-208242fc1aa9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:17.794086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4d0489cb-dcb9-4b70-bc89-75cad8431f3f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:17.808910 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4d0489cb-dcb9-4b70-bc89-75cad8431f3f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 1.483053 Oct 10 23:43:17.810413 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2422/5036] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:16 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:17.828151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2e404dab-86ab-40e5-9276-1cd1f39e254f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:17.835478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2e404dab-86ab-40e5-9276-1cd1f39e254f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:17.860855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e404dab-86ab-40e5-9276-1cd1f39e254f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:17.861842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e404dab-86ab-40e5-9276-1cd1f39e254f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:17.863453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e404dab-86ab-40e5-9276-1cd1f39e254f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:17.865760 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e404dab-86ab-40e5-9276-1cd1f39e254f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:17.866583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e404dab-86ab-40e5-9276-1cd1f39e254f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:17.867309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e404dab-86ab-40e5-9276-1cd1f39e254f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:18.070067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2e404dab-86ab-40e5-9276-1cd1f39e254f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:18.105200 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2e404dab-86ab-40e5-9276-1cd1f39e254f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1276 microversion: 2.1 time: 0.290181 Oct 10 23:43:18.141770 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2423/5037] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:17 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1276 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:18.149802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-015ae8ef-04fb-46e7-8204-2d65a12422df tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:18.162374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-015ae8ef-04fb-46e7-8204-2d65a12422df tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:18.169121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-015ae8ef-04fb-46e7-8204-2d65a12422df tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:18.169975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-015ae8ef-04fb-46e7-8204-2d65a12422df tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:18.174480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-015ae8ef-04fb-46e7-8204-2d65a12422df tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:18.175764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-015ae8ef-04fb-46e7-8204-2d65a12422df tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:18.176445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-015ae8ef-04fb-46e7-8204-2d65a12422df tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:18.177075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-015ae8ef-04fb-46e7-8204-2d65a12422df tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:18.182283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:43:18.744420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2afedf0c-434a-44bd-af50-208242fc1aa9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:18.759721 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2afedf0c-434a-44bd-af50-208242fc1aa9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1691 microversion: 2.1 time: 1.476326 Oct 10 23:43:18.760371 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2615/5038] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:17 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1691 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:19.149923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ba8063f7-8efa-4bd1-9b8b-609920393a14 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:19.151036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ba8063f7-8efa-4bd1-9b8b-609920393a14 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:19.168990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba8063f7-8efa-4bd1-9b8b-609920393a14 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:19.176248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba8063f7-8efa-4bd1-9b8b-609920393a14 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:19.181278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba8063f7-8efa-4bd1-9b8b-609920393a14 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:19.182372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba8063f7-8efa-4bd1-9b8b-609920393a14 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:19.184168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba8063f7-8efa-4bd1-9b8b-609920393a14 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:19.190369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba8063f7-8efa-4bd1-9b8b-609920393a14 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:20.273565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ba8063f7-8efa-4bd1-9b8b-609920393a14 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:20.282579 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ba8063f7-8efa-4bd1-9b8b-609920393a14 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1318 microversion: 2.1 time: 1.136989 Oct 10 23:43:20.283179 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2616/5039] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:19 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1318 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:20.297789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-015ae8ef-04fb-46e7-8204-2d65a12422df tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:20.299322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-712380b2-dd40-4654-92e4-41bba0b2b829 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:20.300260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-712380b2-dd40-4654-92e4-41bba0b2b829 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:20.320874 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-015ae8ef-04fb-46e7-8204-2d65a12422df tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 2.177060 Oct 10 23:43:20.338360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-712380b2-dd40-4654-92e4-41bba0b2b829 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:20.338875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-712380b2-dd40-4654-92e4-41bba0b2b829 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:20.339442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-712380b2-dd40-4654-92e4-41bba0b2b829 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:20.340089 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2424/5040] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:18 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 2182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:20.346405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-712380b2-dd40-4654-92e4-41bba0b2b829 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:20.351811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-014ae339-14d2-4863-85ad-d35fab3d2abb tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:20.352671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-014ae339-14d2-4863-85ad-d35fab3d2abb tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 82bdeb42-f007-43cb-a8bc-16b7a04e6483] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:20.353947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-712380b2-dd40-4654-92e4-41bba0b2b829 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:20.354423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-712380b2-dd40-4654-92e4-41bba0b2b829 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:20.387580 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-014ae339-14d2-4863-85ad-d35fab3d2abb tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Instance 82bdeb42-f007-43cb-a8bc-16b7a04e6483 could not be found. Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-014ae339-14d2-4863-85ad-d35fab3d2abb tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/82bdeb42-f007-43cb-a8bc-16b7a04e6483/action HTTP/1.1 Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 15 Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: {"restore": {}} Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 82bdeb42-f007-43cb-a8bc-16b7a04e6483 could not be found. Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '82bdeb42-f007-43cb-a8bc-16b7a04e6483', 'body': {'restore': {}}} Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82bdeb42-f007-43cb-a8bc-16b7a04e6483 could not be found. Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82bdeb42-f007-43cb-a8bc-16b7a04e6483 could not be found. Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:20.390464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:20.395654 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:43:20.395654 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:43:20.395654 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82bdeb42-f007-43cb-a8bc-16b7a04e6483 could not be found. Oct 10 23:43:20.395654 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:20.406805 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-014ae339-14d2-4863-85ad-d35fab3d2abb tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 404 to user: Instance 82bdeb42-f007-43cb-a8bc-16b7a04e6483 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:43:20.411047 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-014ae339-14d2-4863-85ad-d35fab3d2abb tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/82bdeb42-f007-43cb-a8bc-16b7a04e6483/action" status: 404 len: 111 microversion: 2.1 time: 0.063245 Oct 10 23:43:20.421192 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2425/5041] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:43:20 2022] POST /compute/v2.1/servers/82bdeb42-f007-43cb-a8bc-16b7a04e6483/action => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:43:20.433190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-10a1fe4c-39d4-4fe2-aafa-26b6c1466a7a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:20.454427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-10a1fe4c-39d4-4fe2-aafa-26b6c1466a7a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:20.506219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10a1fe4c-39d4-4fe2-aafa-26b6c1466a7a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:20.506770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10a1fe4c-39d4-4fe2-aafa-26b6c1466a7a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:20.510437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10a1fe4c-39d4-4fe2-aafa-26b6c1466a7a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:20.518059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10a1fe4c-39d4-4fe2-aafa-26b6c1466a7a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:20.519775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10a1fe4c-39d4-4fe2-aafa-26b6c1466a7a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:20.520240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10a1fe4c-39d4-4fe2-aafa-26b6c1466a7a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:20.565101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-712380b2-dd40-4654-92e4-41bba0b2b829 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:20.581266 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-712380b2-dd40-4654-92e4-41bba0b2b829 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 200 len: 1623 microversion: 2.1 time: 0.297018 Oct 10 23:43:20.581905 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2617/5042] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:20 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 1623 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:20.613790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-c81e66d6-404b-44de-a4b0-b26182af5117 req-8751b96d-6f3a-49c6-acb0-22fd89761569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7a4001-50e2-4247-a60d-f82367072f61", "name": "network-vif-deleted", "tag": "b24cdf0d-a2fa-4fcb-a031-a363754246f9"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:20.657810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c81e66d6-404b-44de-a4b0-b26182af5117 req-8751b96d-6f3a-49c6-acb0-22fd89761569 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:20.658343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c81e66d6-404b-44de-a4b0-b26182af5117 req-8751b96d-6f3a-49c6-acb0-22fd89761569 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:20.658902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c81e66d6-404b-44de-a4b0-b26182af5117 req-8751b96d-6f3a-49c6-acb0-22fd89761569 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:20.696337 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-c81e66d6-404b-44de-a4b0-b26182af5117 req-8751b96d-6f3a-49c6-acb0-22fd89761569 service nova] Creating event network-vif-deleted:b24cdf0d-a2fa-4fcb-a031-a363754246f9 for instance aa7a4001-50e2-4247-a60d-f82367072f61 on n-h1-860864-2 Oct 10 23:43:20.722518 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-c81e66d6-404b-44de-a4b0-b26182af5117 req-8751b96d-6f3a-49c6-acb0-22fd89761569 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113041 Oct 10 23:43:20.728319 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2618/5043] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:43:20.971969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:43:21.309291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-423e1c71-71de-4e91-a1c1-0fa3daa6b96a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:21.310083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-423e1c71-71de-4e91-a1c1-0fa3daa6b96a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:21.325822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-423e1c71-71de-4e91-a1c1-0fa3daa6b96a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:21.326325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-423e1c71-71de-4e91-a1c1-0fa3daa6b96a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:21.327155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-423e1c71-71de-4e91-a1c1-0fa3daa6b96a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:21.327975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-423e1c71-71de-4e91-a1c1-0fa3daa6b96a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:21.328443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-423e1c71-71de-4e91-a1c1-0fa3daa6b96a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:21.333627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-423e1c71-71de-4e91-a1c1-0fa3daa6b96a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:21.474194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=8 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:43:21.503108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-10a1fe4c-39d4-4fe2-aafa-26b6c1466a7a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:21.518580 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-10a1fe4c-39d4-4fe2-aafa-26b6c1466a7a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 1.093972 Oct 10 23:43:21.557076 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2426/5044] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:20 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:21.580690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3b49e29a-8bd3-4d4e-8f2d-9923078cf649 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:21.584919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3b49e29a-8bd3-4d4e-8f2d-9923078cf649 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:21.596496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b49e29a-8bd3-4d4e-8f2d-9923078cf649 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:21.596980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b49e29a-8bd3-4d4e-8f2d-9923078cf649 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:21.597467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b49e29a-8bd3-4d4e-8f2d-9923078cf649 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:21.598216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b49e29a-8bd3-4d4e-8f2d-9923078cf649 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:21.598683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b49e29a-8bd3-4d4e-8f2d-9923078cf649 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:21.599221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b49e29a-8bd3-4d4e-8f2d-9923078cf649 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:22.012069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3b49e29a-8bd3-4d4e-8f2d-9923078cf649 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:22.032222 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3b49e29a-8bd3-4d4e-8f2d-9923078cf649 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.471678 Oct 10 23:43:22.034568 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2427/5045] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:21 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:22.062072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a8b040df-b9f0-4e4c-8854-8e833d999293 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:22.063064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a8b040df-b9f0-4e4c-8854-8e833d999293 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: aa7a4001-50e2-4247-a60d-f82367072f61] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:22.073934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8b040df-b9f0-4e4c-8854-8e833d999293 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:22.074746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8b040df-b9f0-4e4c-8854-8e833d999293 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:22.078944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8b040df-b9f0-4e4c-8854-8e833d999293 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:22.080056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8b040df-b9f0-4e4c-8854-8e833d999293 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:22.080713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8b040df-b9f0-4e4c-8854-8e833d999293 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:22.085447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8b040df-b9f0-4e4c-8854-8e833d999293 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:22.110174 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-a8b040df-b9f0-4e4c-8854-8e833d999293 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] HTTP exception thrown: Instance aa7a4001-50e2-4247-a60d-f82367072f61 could not be found. Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a8b040df-b9f0-4e4c-8854-8e833d999293 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Request method failure captured: Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 HTTP/1.1 Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKzOYlZsv7rRo2sa7kQc2eFaI8v-TMGvuh-sVU-zvganQJF5vXcDouizKP05ne1GDSQKrDkWUQDAU6qxxYttyNZ_6Byu14LDFhfplUKI_eaTrPi0t5xENermj156ZGMg1lyNDKMrSevusXHHA-zCISDm6SLPwivXrQErNiD9Jy9X9Qs Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 8986c214fcc944acb2731cc5af19ef0c Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8986c214fcc944acb2731cc5af19ef0c", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 8986c214fcc944acb2731cc5af19ef0c Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerRescueNegativeTestJSON-906322093-project Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 585d2834c2a94c5eaa8267cf2ba58ac0 Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerRescueNegativeTestJSON-906322093-project Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance aa7a4001-50e2-4247-a60d-f82367072f61 could not be found. Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'aa7a4001-50e2-4247-a60d-f82367072f61'} Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa7a4001-50e2-4247-a60d-f82367072f61 could not be found. Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa7a4001-50e2-4247-a60d-f82367072f61 could not be found. Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:22.112891 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:22.120058 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:22.120058 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:22.120058 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:22.120058 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:22.120058 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:43:22.120058 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:43:22.120058 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa7a4001-50e2-4247-a60d-f82367072f61 could not be found. Oct 10 23:43:22.120058 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:22.124596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a8b040df-b9f0-4e4c-8854-8e833d999293 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Returning 404 to user: Instance aa7a4001-50e2-4247-a60d-f82367072f61 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:43:22.125775 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a8b040df-b9f0-4e4c-8854-8e833d999293 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61" status: 404 len: 111 microversion: 2.1 time: 0.085167 Oct 10 23:43:22.127582 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2428/5046] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:22 2022] GET /compute/v2.1/servers/aa7a4001-50e2-4247-a60d-f82367072f61 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:43:22.137085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-32ddd69c-b3e1-4902-a454-b7755cc41b23 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:22.137976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-32ddd69c-b3e1-4902-a454-b7755cc41b23 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:22.145641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32ddd69c-b3e1-4902-a454-b7755cc41b23 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:22.146593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32ddd69c-b3e1-4902-a454-b7755cc41b23 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:22.147318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32ddd69c-b3e1-4902-a454-b7755cc41b23 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:22.148316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32ddd69c-b3e1-4902-a454-b7755cc41b23 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:22.148986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32ddd69c-b3e1-4902-a454-b7755cc41b23 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:22.149661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32ddd69c-b3e1-4902-a454-b7755cc41b23 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:22.210333 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-32ddd69c-b3e1-4902-a454-b7755cc41b23 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Cannot 'restore' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state active Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-32ddd69c-b3e1-4902-a454-b7755cc41b23 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action HTTP/1.1 Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 15 Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: {"restore": {}} Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: exception: Cannot 'restore' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state active Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'efc9e449-6324-411e-8af9-0533b23a4e3c', 'body': {'restore': {}}} Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance efc9e449-6324-411e-8af9-0533b23a4e3c in vm_state active. Cannot restore while the instance is in this state. Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state active Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:22.222024 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:22.227273 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:22.227273 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:43:22.227273 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:43:22.227273 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state active Oct 10 23:43:22.227273 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:22.229753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-32ddd69c-b3e1-4902-a454-b7755cc41b23 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 409 to user: Cannot 'restore' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state active {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:43:22.230911 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-32ddd69c-b3e1-4902-a454-b7755cc41b23 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action" status: 409 len: 145 microversion: 2.1 time: 0.099523 Oct 10 23:43:22.231713 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2429/5047] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:43:22 2022] POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action => generated 145 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:43:22.248221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a4bcf728-8b6e-43b3-9252-0a444945d8c9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '.version_select at 0x7f662a8ee940>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:22.311757 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a4bcf728-8b6e-43b3-9252-0a444945d8c9 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1692647442" status: 202 len: 0 microversion: 2.1 time: 0.067701 Oct 10 23:43:22.317367 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2430/5048] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 10 23:43:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1692647442 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:43:22.340292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-68022f58-f948-46ad-a8ba-b25ec27e72b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:22.341187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-68022f58-f948-46ad-a8ba-b25ec27e72b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:22.369129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-423e1c71-71de-4e91-a1c1-0fa3daa6b96a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:22.378737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68022f58-f948-46ad-a8ba-b25ec27e72b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:22.379018 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-423e1c71-71de-4e91-a1c1-0fa3daa6b96a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1318 microversion: 2.1 time: 1.074080 Oct 10 23:43:22.379235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68022f58-f948-46ad-a8ba-b25ec27e72b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:22.379378 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2619/5049] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:21 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1318 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:22.383783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68022f58-f948-46ad-a8ba-b25ec27e72b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:22.384577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68022f58-f948-46ad-a8ba-b25ec27e72b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:22.385061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68022f58-f948-46ad-a8ba-b25ec27e72b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:22.385570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68022f58-f948-46ad-a8ba-b25ec27e72b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:22.900805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-c0615aea-082e-41dd-b5bd-56716a51c8c5 req-7f7c87b6-2ca2-4291-8dfd-4a489f86b9de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b27c2a97-533c-436b-8974-f05beb1027fd", "tag": "ff1e9960-44ed-4760-8712-c79e1b463cf9"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:22.927358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c0615aea-082e-41dd-b5bd-56716a51c8c5 req-7f7c87b6-2ca2-4291-8dfd-4a489f86b9de service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:22.928482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c0615aea-082e-41dd-b5bd-56716a51c8c5 req-7f7c87b6-2ca2-4291-8dfd-4a489f86b9de service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:22.933897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c0615aea-082e-41dd-b5bd-56716a51c8c5 req-7f7c87b6-2ca2-4291-8dfd-4a489f86b9de service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:22.989826 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-c0615aea-082e-41dd-b5bd-56716a51c8c5 req-7f7c87b6-2ca2-4291-8dfd-4a489f86b9de service nova] Creating event network-changed:ff1e9960-44ed-4760-8712-c79e1b463cf9 for instance b27c2a97-533c-436b-8974-f05beb1027fd on n-h2-860864-2 Oct 10 23:43:23.032639 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-c0615aea-082e-41dd-b5bd-56716a51c8c5 req-7f7c87b6-2ca2-4291-8dfd-4a489f86b9de service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133583 Oct 10 23:43:23.034660 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2620/5050] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:43:23.413926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5bc6f75a-3f09-4af6-b526-fbd47c490ae9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:23.415339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5bc6f75a-3f09-4af6-b526-fbd47c490ae9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:23.443452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bc6f75a-3f09-4af6-b526-fbd47c490ae9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:23.451435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bc6f75a-3f09-4af6-b526-fbd47c490ae9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:23.459559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bc6f75a-3f09-4af6-b526-fbd47c490ae9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:23.460823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bc6f75a-3f09-4af6-b526-fbd47c490ae9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:23.461365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bc6f75a-3f09-4af6-b526-fbd47c490ae9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:23.461853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bc6f75a-3f09-4af6-b526-fbd47c490ae9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:23.524826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-68022f58-f948-46ad-a8ba-b25ec27e72b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:23.549942 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-68022f58-f948-46ad-a8ba-b25ec27e72b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 1.223856 Oct 10 23:43:23.551626 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2431/5051] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:22 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:23.580736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-83b57fae-348f-43ae-bf89-0dc2f71d3b63 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:23.582825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-83b57fae-348f-43ae-bf89-0dc2f71d3b63 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:23.590932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83b57fae-348f-43ae-bf89-0dc2f71d3b63 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:23.607545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83b57fae-348f-43ae-bf89-0dc2f71d3b63 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:23.613400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83b57fae-348f-43ae-bf89-0dc2f71d3b63 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:23.614408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83b57fae-348f-43ae-bf89-0dc2f71d3b63 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:23.615009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83b57fae-348f-43ae-bf89-0dc2f71d3b63 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:23.618004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83b57fae-348f-43ae-bf89-0dc2f71d3b63 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:24.111519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5bc6f75a-3f09-4af6-b526-fbd47c490ae9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:24.127297 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5bc6f75a-3f09-4af6-b526-fbd47c490ae9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1318 microversion: 2.1 time: 0.718843 Oct 10 23:43:24.127938 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2621/5052] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:23 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1318 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:24.142713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-83b57fae-348f-43ae-bf89-0dc2f71d3b63 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:24.159810 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-83b57fae-348f-43ae-bf89-0dc2f71d3b63 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.583209 Oct 10 23:43:24.160675 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2432/5053] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:23 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:24.182789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d17d35e5-b49d-4c5a-8fda-2953448d3cd3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:24.183633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d17d35e5-b49d-4c5a-8fda-2953448d3cd3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: ac734511-7976-4aa8-8c20-c94d79bcf941] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:24.199179 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-d17d35e5-b49d-4c5a-8fda-2953448d3cd3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Instance ac734511-7976-4aa8-8c20-c94d79bcf941 could not be found. Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d17d35e5-b49d-4c5a-8fda-2953448d3cd3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/ac734511-7976-4aa8-8c20-c94d79bcf941/action HTTP/1.1 Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 14 Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: {"resume": {}} Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance ac734511-7976-4aa8-8c20-c94d79bcf941 could not be found. Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'ac734511-7976-4aa8-8c20-c94d79bcf941', 'body': {'resume': {}}} Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac734511-7976-4aa8-8c20-c94d79bcf941 could not be found. Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac734511-7976-4aa8-8c20-c94d79bcf941 could not be found. Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:24.205466 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:24.212167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:43:24.212167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:43:24.212167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac734511-7976-4aa8-8c20-c94d79bcf941 could not be found. Oct 10 23:43:24.212167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:24.213535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d17d35e5-b49d-4c5a-8fda-2953448d3cd3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 404 to user: Instance ac734511-7976-4aa8-8c20-c94d79bcf941 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:43:24.214836 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d17d35e5-b49d-4c5a-8fda-2953448d3cd3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/ac734511-7976-4aa8-8c20-c94d79bcf941/action" status: 404 len: 111 microversion: 2.1 time: 0.036299 Oct 10 23:43:24.215624 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2622/5054] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:43:24 2022] POST /compute/v2.1/servers/ac734511-7976-4aa8-8c20-c94d79bcf941/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:43:24.224826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-54f2768f-3a54-49eb-bf3a-369ecd5708c1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:24.225847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-54f2768f-3a54-49eb-bf3a-369ecd5708c1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:24.240958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54f2768f-3a54-49eb-bf3a-369ecd5708c1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:24.247925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54f2768f-3a54-49eb-bf3a-369ecd5708c1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:24.249226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54f2768f-3a54-49eb-bf3a-369ecd5708c1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:24.250184 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54f2768f-3a54-49eb-bf3a-369ecd5708c1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:24.251043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54f2768f-3a54-49eb-bf3a-369ecd5708c1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:24.251894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54f2768f-3a54-49eb-bf3a-369ecd5708c1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:24.955441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-54f2768f-3a54-49eb-bf3a-369ecd5708c1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:24.967438 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-54f2768f-3a54-49eb-bf3a-369ecd5708c1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.746312 Oct 10 23:43:24.978401 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2433/5055] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:24 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:25.004666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-89da59f2-17f6-4ba1-9a95-e12ae7f1b60f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:25.006001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-89da59f2-17f6-4ba1-9a95-e12ae7f1b60f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:25.026960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89da59f2-17f6-4ba1-9a95-e12ae7f1b60f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:25.028094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89da59f2-17f6-4ba1-9a95-e12ae7f1b60f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:25.028854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89da59f2-17f6-4ba1-9a95-e12ae7f1b60f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:25.032385 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89da59f2-17f6-4ba1-9a95-e12ae7f1b60f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:25.033158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89da59f2-17f6-4ba1-9a95-e12ae7f1b60f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:25.033883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89da59f2-17f6-4ba1-9a95-e12ae7f1b60f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:25.164735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-82c9b4eb-a14e-4277-9cb8-d1362115fa2c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:25.165821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-82c9b4eb-a14e-4277-9cb8-d1362115fa2c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:25.173229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82c9b4eb-a14e-4277-9cb8-d1362115fa2c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:25.174153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82c9b4eb-a14e-4277-9cb8-d1362115fa2c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:25.174845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82c9b4eb-a14e-4277-9cb8-d1362115fa2c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:25.175808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82c9b4eb-a14e-4277-9cb8-d1362115fa2c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:25.176503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82c9b4eb-a14e-4277-9cb8-d1362115fa2c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:25.177226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82c9b4eb-a14e-4277-9cb8-d1362115fa2c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:25.490544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-82c9b4eb-a14e-4277-9cb8-d1362115fa2c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:25.503169 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-82c9b4eb-a14e-4277-9cb8-d1362115fa2c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1318 microversion: 2.1 time: 0.354337 Oct 10 23:43:25.504236 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2434/5056] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:25 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:25.870989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-89da59f2-17f6-4ba1-9a95-e12ae7f1b60f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:25.889132 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-89da59f2-17f6-4ba1-9a95-e12ae7f1b60f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.890662 Oct 10 23:43:25.894691 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2623/5057] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:24 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:25.920652 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cc19c367-215a-447b-8902-573196a38c09 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:25.921555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cc19c367-215a-447b-8902-573196a38c09 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:25.940196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc19c367-215a-447b-8902-573196a38c09 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:25.940986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc19c367-215a-447b-8902-573196a38c09 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:25.941761 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc19c367-215a-447b-8902-573196a38c09 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:25.942770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc19c367-215a-447b-8902-573196a38c09 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:25.949335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc19c367-215a-447b-8902-573196a38c09 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:25.950088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc19c367-215a-447b-8902-573196a38c09 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:25.992507 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-cc19c367-215a-447b-8902-573196a38c09 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Cannot 'resume' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state active Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cc19c367-215a-447b-8902-573196a38c09 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action HTTP/1.1 Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 14 Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: {"resume": {}} Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: exception: Cannot 'resume' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state active Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'efc9e449-6324-411e-8af9-0533b23a4e3c', 'body': {'resume': {}}} Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance efc9e449-6324-411e-8af9-0533b23a4e3c in vm_state active. Cannot resume while the instance is in this state. Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state active Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:25.995029 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:26.000377 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:26.000377 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:26.000377 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:26.000377 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:43:26.000377 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:43:26.000377 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state active Oct 10 23:43:26.000377 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:26.003312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cc19c367-215a-447b-8902-573196a38c09 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 409 to user: Cannot 'resume' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state active {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:43:26.004426 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cc19c367-215a-447b-8902-573196a38c09 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action" status: 409 len: 144 microversion: 2.1 time: 0.087866 Oct 10 23:43:26.013758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-793f4b2a-0eaf-41d4-a51d-450dfdcfaf79 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:26.015175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-793f4b2a-0eaf-41d4-a51d-450dfdcfaf79 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:26.020277 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2435/5058] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:43:25 2022] POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action => generated 144 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:43:26.023483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-793f4b2a-0eaf-41d4-a51d-450dfdcfaf79 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:26.024288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-793f4b2a-0eaf-41d4-a51d-450dfdcfaf79 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:26.024988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-793f4b2a-0eaf-41d4-a51d-450dfdcfaf79 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:26.025987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-793f4b2a-0eaf-41d4-a51d-450dfdcfaf79 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:26.026696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-793f4b2a-0eaf-41d4-a51d-450dfdcfaf79 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:26.027354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-793f4b2a-0eaf-41d4-a51d-450dfdcfaf79 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:26.532627 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aac72d0e-0776-4dfb-862e-3d59723a0f3c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:26.542272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aac72d0e-0776-4dfb-862e-3d59723a0f3c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:26.553154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aac72d0e-0776-4dfb-862e-3d59723a0f3c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:26.556710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aac72d0e-0776-4dfb-862e-3d59723a0f3c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:26.558206 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aac72d0e-0776-4dfb-862e-3d59723a0f3c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:26.566671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aac72d0e-0776-4dfb-862e-3d59723a0f3c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:26.568411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aac72d0e-0776-4dfb-862e-3d59723a0f3c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:26.570418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aac72d0e-0776-4dfb-862e-3d59723a0f3c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:26.778137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-793f4b2a-0eaf-41d4-a51d-450dfdcfaf79 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:26.803924 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-793f4b2a-0eaf-41d4-a51d-450dfdcfaf79 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.794064 Oct 10 23:43:26.805079 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2624/5059] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:26 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:26.829494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-21925aad-c595-4610-9309-d4bbf4ba4207 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:26.830398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-21925aad-c595-4610-9309-d4bbf4ba4207 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:26.838678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aac72d0e-0776-4dfb-862e-3d59723a0f3c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:26.857902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21925aad-c595-4610-9309-d4bbf4ba4207 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:26.859574 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aac72d0e-0776-4dfb-862e-3d59723a0f3c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1318 microversion: 2.1 time: 0.331283 Oct 10 23:43:26.860434 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2436/5060] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:26 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:26.861329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21925aad-c595-4610-9309-d4bbf4ba4207 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:26.862106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21925aad-c595-4610-9309-d4bbf4ba4207 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:26.863082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21925aad-c595-4610-9309-d4bbf4ba4207 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:26.863770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21925aad-c595-4610-9309-d4bbf4ba4207 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:26.864449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21925aad-c595-4610-9309-d4bbf4ba4207 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:27.883577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-54bee2ed-1f04-43e6-a591-81c63382b31e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:27.884589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-54bee2ed-1f04-43e6-a591-81c63382b31e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:27.894764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54bee2ed-1f04-43e6-a591-81c63382b31e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:27.895781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54bee2ed-1f04-43e6-a591-81c63382b31e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:27.897169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54bee2ed-1f04-43e6-a591-81c63382b31e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:27.898990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54bee2ed-1f04-43e6-a591-81c63382b31e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:27.899821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54bee2ed-1f04-43e6-a591-81c63382b31e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:27.900937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54bee2ed-1f04-43e6-a591-81c63382b31e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:28.026132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-21925aad-c595-4610-9309-d4bbf4ba4207 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:28.047196 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-21925aad-c595-4610-9309-d4bbf4ba4207 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 1.217642 Oct 10 23:43:28.052354 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2625/5061] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:26 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:28.319788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-54bee2ed-1f04-43e6-a591-81c63382b31e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:28.347659 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-54bee2ed-1f04-43e6-a591-81c63382b31e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1318 microversion: 2.1 time: 0.467827 Oct 10 23:43:28.353768 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2437/5062] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:27 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1318 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:28.400683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b07230ac-8b52-46a2-82ee-8c450e1d6ada tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b07230ac-8b52-46a2-82ee-8c450e1d6ada tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 160 Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: {"server": {"name": "", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "fa0ea560-35bf-4417-8cad-eb62562b3005"}]}} Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'server': {'name': '', 'imageRef': '70c986fa-2f30-4b1e-8ea0-fb6ffa975889', 'flavorRef': '452', 'networks': [{'uuid': 'fa0ea560-35bf-4417-8cad-eb62562b3005'}]}}} Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi '' Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:43:28.418616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:43:28.425061 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:43:28.425061 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 10 23:43:28.425061 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:28.425061 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:28.425061 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:28.425061 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:28.425061 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:28.425061 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:28.425061 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:43:28.425061 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:43:28.425061 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 10 23:43:28.425061 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:43:28.434057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b07230ac-8b52-46a2-82ee-8c450e1d6ada tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:43:28.437247 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b07230ac-8b52-46a2-82ee-8c450e1d6ada tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.040217 Oct 10 23:43:28.448633 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2626/5063] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:43:28 2022] POST /compute/v2.1/servers => generated 108 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:43:28.454650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0375f337-1c8f-4352-a255-78bb33ea304d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:28.455473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0375f337-1c8f-4352-a255-78bb33ea304d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:28.464898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0375f337-1c8f-4352-a255-78bb33ea304d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:28.472402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0375f337-1c8f-4352-a255-78bb33ea304d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:28.473130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0375f337-1c8f-4352-a255-78bb33ea304d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:28.474200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0375f337-1c8f-4352-a255-78bb33ea304d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:28.475536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0375f337-1c8f-4352-a255-78bb33ea304d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:28.476252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0375f337-1c8f-4352-a255-78bb33ea304d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:28.734392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0375f337-1c8f-4352-a255-78bb33ea304d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:28.764812 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0375f337-1c8f-4352-a255-78bb33ea304d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.312836 Oct 10 23:43:28.768647 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2438/5064] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:28 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:28.793548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0be92d29-8bc8-425a-a5f4-ab5dc091ce5a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:28.793950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0be92d29-8bc8-425a-a5f4-ab5dc091ce5a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:28.831298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=90 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:43:28.839862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0be92d29-8bc8-425a-a5f4-ab5dc091ce5a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:28.844256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0be92d29-8bc8-425a-a5f4-ab5dc091ce5a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:28.845025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0be92d29-8bc8-425a-a5f4-ab5dc091ce5a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:28.851606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0be92d29-8bc8-425a-a5f4-ab5dc091ce5a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:28.852341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0be92d29-8bc8-425a-a5f4-ab5dc091ce5a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:28.854815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0be92d29-8bc8-425a-a5f4-ab5dc091ce5a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:29.238687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0be92d29-8bc8-425a-a5f4-ab5dc091ce5a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:29.248040 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0be92d29-8bc8-425a-a5f4-ab5dc091ce5a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.458718 Oct 10 23:43:29.274639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-349b5b92-d352-40aa-a1eb-3495bdd94e19 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:29.275747 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-349b5b92-d352-40aa-a1eb-3495bdd94e19 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 0c9649ac-a6f6-446f-a235-aa95bbc68a03] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:29.282530 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2627/5065] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:28 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:29.301294 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-349b5b92-d352-40aa-a1eb-3495bdd94e19 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Instance 0c9649ac-a6f6-446f-a235-aa95bbc68a03 could not be found. Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-349b5b92-d352-40aa-a1eb-3495bdd94e19 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/0c9649ac-a6f6-446f-a235-aa95bbc68a03/action HTTP/1.1 Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 14 Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: {"shelve": {}} Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 0c9649ac-a6f6-446f-a235-aa95bbc68a03 could not be found. Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '0c9649ac-a6f6-446f-a235-aa95bbc68a03', 'body': {'shelve': {}}} Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c9649ac-a6f6-446f-a235-aa95bbc68a03 could not be found. Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c9649ac-a6f6-446f-a235-aa95bbc68a03 could not be found. Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:29.309020 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:29.315197 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:43:29.315197 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:43:29.315197 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c9649ac-a6f6-446f-a235-aa95bbc68a03 could not be found. Oct 10 23:43:29.315197 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:29.318875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-349b5b92-d352-40aa-a1eb-3495bdd94e19 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 404 to user: Instance 0c9649ac-a6f6-446f-a235-aa95bbc68a03 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:43:29.319938 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-349b5b92-d352-40aa-a1eb-3495bdd94e19 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/0c9649ac-a6f6-446f-a235-aa95bbc68a03/action" status: 404 len: 111 microversion: 2.1 time: 0.050520 Oct 10 23:43:29.329749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b8325854-de67-4ed6-8cbb-82a490af6c21 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:29.330689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b8325854-de67-4ed6-8cbb-82a490af6c21 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:29.334069 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2439/5066] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:43:29 2022] POST /compute/v2.1/servers/0c9649ac-a6f6-446f-a235-aa95bbc68a03/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:43:29.346004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8325854-de67-4ed6-8cbb-82a490af6c21 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:29.346691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8325854-de67-4ed6-8cbb-82a490af6c21 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:29.347304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8325854-de67-4ed6-8cbb-82a490af6c21 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:29.348238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8325854-de67-4ed6-8cbb-82a490af6c21 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:29.348873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8325854-de67-4ed6-8cbb-82a490af6c21 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:29.349538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8325854-de67-4ed6-8cbb-82a490af6c21 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:29.380396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7558e71f-ad78-45aa-98b5-504849611309 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:29.381327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7558e71f-ad78-45aa-98b5-504849611309 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:29.413678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7558e71f-ad78-45aa-98b5-504849611309 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:29.425239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7558e71f-ad78-45aa-98b5-504849611309 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:29.442766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7558e71f-ad78-45aa-98b5-504849611309 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:29.445897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7558e71f-ad78-45aa-98b5-504849611309 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:29.454548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7558e71f-ad78-45aa-98b5-504849611309 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:29.461660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7558e71f-ad78-45aa-98b5-504849611309 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:29.860272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7558e71f-ad78-45aa-98b5-504849611309 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:29.880897 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7558e71f-ad78-45aa-98b5-504849611309 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1318 microversion: 2.1 time: 0.504187 Oct 10 23:43:29.881545 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2440/5067] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:29 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1318 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:30.312751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b8325854-de67-4ed6-8cbb-82a490af6c21 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:30.334250 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b8325854-de67-4ed6-8cbb-82a490af6c21 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 1.008962 Oct 10 23:43:30.335105 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2628/5068] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:29 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:30.368422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1fcb4672-8ab9-4e6e-8a27-8a5b1d2d708e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:30.370858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1fcb4672-8ab9-4e6e-8a27-8a5b1d2d708e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:30.387018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fcb4672-8ab9-4e6e-8a27-8a5b1d2d708e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:30.390831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fcb4672-8ab9-4e6e-8a27-8a5b1d2d708e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:30.393932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fcb4672-8ab9-4e6e-8a27-8a5b1d2d708e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:30.397264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fcb4672-8ab9-4e6e-8a27-8a5b1d2d708e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:30.401019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fcb4672-8ab9-4e6e-8a27-8a5b1d2d708e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:30.411454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fcb4672-8ab9-4e6e-8a27-8a5b1d2d708e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:30.777178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1fcb4672-8ab9-4e6e-8a27-8a5b1d2d708e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:30.785830 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1fcb4672-8ab9-4e6e-8a27-8a5b1d2d708e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.421318 Oct 10 23:43:30.803306 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2441/5069] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:30 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:30.837293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e2fafe6a-6596-4171-bcb9-316eec3538f3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:30.837885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e2fafe6a-6596-4171-bcb9-316eec3538f3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:30.849129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e2fafe6a-6596-4171-bcb9-316eec3538f3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:30.849912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e2fafe6a-6596-4171-bcb9-316eec3538f3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:30.850562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e2fafe6a-6596-4171-bcb9-316eec3538f3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:30.854380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e2fafe6a-6596-4171-bcb9-316eec3538f3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:30.855209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e2fafe6a-6596-4171-bcb9-316eec3538f3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:30.855861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e2fafe6a-6596-4171-bcb9-316eec3538f3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:30.910138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-603d6263-6564-414a-9033-2ab1a50083f4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:30.910764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-603d6263-6564-414a-9033-2ab1a50083f4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:30.926308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-603d6263-6564-414a-9033-2ab1a50083f4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:30.926923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-603d6263-6564-414a-9033-2ab1a50083f4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:30.928220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-603d6263-6564-414a-9033-2ab1a50083f4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:30.928220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-603d6263-6564-414a-9033-2ab1a50083f4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:30.936205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-e2fafe6a-6596-4171-bcb9-316eec3538f3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lazy-loading 'flavor' on Instance uuid efc9e449-6324-411e-8af9-0533b23a4e3c {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:43:30.947743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-603d6263-6564-414a-9033-2ab1a50083f4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:30.948249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-603d6263-6564-414a-9033-2ab1a50083f4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:31.060561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:43:31.428714 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e2fafe6a-6596-4171-bcb9-316eec3538f3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action" status: 202 len: 0 microversion: 2.1 time: 0.607018 Oct 10 23:43:31.450291 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2629/5070] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:43:30 2022] POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action => generated 0 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:43:31.474681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4e75b791-a260-4547-8453-f0af7f46b143 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:31.475704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4e75b791-a260-4547-8453-f0af7f46b143 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:31.492491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e75b791-a260-4547-8453-f0af7f46b143 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:31.497353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e75b791-a260-4547-8453-f0af7f46b143 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:31.498101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e75b791-a260-4547-8453-f0af7f46b143 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:31.499395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e75b791-a260-4547-8453-f0af7f46b143 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:31.500744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e75b791-a260-4547-8453-f0af7f46b143 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:31.501630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e75b791-a260-4547-8453-f0af7f46b143 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:31.716739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-603d6263-6564-414a-9033-2ab1a50083f4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:31.736019 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-603d6263-6564-414a-9033-2ab1a50083f4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1318 microversion: 2.1 time: 0.829970 Oct 10 23:43:31.759221 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2442/5071] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:30 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1318 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:32.082455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4e75b791-a260-4547-8453-f0af7f46b143 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:32.130924 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4e75b791-a260-4547-8453-f0af7f46b143 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1513 microversion: 2.1 time: 0.678582 Oct 10 23:43:32.141032 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2630/5072] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:31 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1513 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:32.763620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1904086f-f174-4b6f-883b-524011fc8371 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:32.764598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1904086f-f174-4b6f-883b-524011fc8371 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:32.783413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1904086f-f174-4b6f-883b-524011fc8371 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:32.783951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1904086f-f174-4b6f-883b-524011fc8371 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:32.784362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1904086f-f174-4b6f-883b-524011fc8371 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:32.785087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1904086f-f174-4b6f-883b-524011fc8371 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:32.785581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1904086f-f174-4b6f-883b-524011fc8371 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:32.786020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1904086f-f174-4b6f-883b-524011fc8371 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:33.164611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d22921ba-ce65-4ad5-a5e9-dda897555b9a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:33.165240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d22921ba-ce65-4ad5-a5e9-dda897555b9a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:33.176522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d22921ba-ce65-4ad5-a5e9-dda897555b9a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:33.177028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d22921ba-ce65-4ad5-a5e9-dda897555b9a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:33.189221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d22921ba-ce65-4ad5-a5e9-dda897555b9a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:33.190380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d22921ba-ce65-4ad5-a5e9-dda897555b9a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:33.190885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d22921ba-ce65-4ad5-a5e9-dda897555b9a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:33.191337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d22921ba-ce65-4ad5-a5e9-dda897555b9a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:33.382813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1904086f-f174-4b6f-883b-524011fc8371 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:33.394409 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1904086f-f174-4b6f-883b-524011fc8371 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1318 microversion: 2.1 time: 0.634576 Oct 10 23:43:33.428895 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2443/5073] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:32 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1318 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:34.277162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d22921ba-ce65-4ad5-a5e9-dda897555b9a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:34.292855 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d22921ba-ce65-4ad5-a5e9-dda897555b9a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1513 microversion: 2.1 time: 1.131321 Oct 10 23:43:34.294812 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2631/5074] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:33 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1513 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:34.438500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a0cc2e83-cb30-4dd2-8e9f-d793fba78fa5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:34.439167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a0cc2e83-cb30-4dd2-8e9f-d793fba78fa5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:34.460262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a0cc2e83-cb30-4dd2-8e9f-d793fba78fa5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:34.467025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a0cc2e83-cb30-4dd2-8e9f-d793fba78fa5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:34.467630 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a0cc2e83-cb30-4dd2-8e9f-d793fba78fa5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:34.468486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a0cc2e83-cb30-4dd2-8e9f-d793fba78fa5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:34.477260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a0cc2e83-cb30-4dd2-8e9f-d793fba78fa5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:34.484528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a0cc2e83-cb30-4dd2-8e9f-d793fba78fa5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:34.942209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a0cc2e83-cb30-4dd2-8e9f-d793fba78fa5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:34.964016 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a0cc2e83-cb30-4dd2-8e9f-d793fba78fa5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1318 microversion: 2.1 time: 0.527647 Oct 10 23:43:34.984728 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2444/5075] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:34 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1318 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:35.319044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-731be487-803a-4a14-bba1-9658a7480713 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:35.320988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-731be487-803a-4a14-bba1-9658a7480713 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:35.337785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-731be487-803a-4a14-bba1-9658a7480713 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:35.338574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-731be487-803a-4a14-bba1-9658a7480713 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:35.342188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-731be487-803a-4a14-bba1-9658a7480713 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:35.343496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-731be487-803a-4a14-bba1-9658a7480713 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:35.344197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-731be487-803a-4a14-bba1-9658a7480713 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:35.344866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-731be487-803a-4a14-bba1-9658a7480713 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:35.795833 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-faa0a0c2-b675-4ba7-9c1e-4c0757e788b6 req-84911e06-27d6-44c1-bb4a-2998f16d9e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27c2a97-533c-436b-8974-f05beb1027fd", "name": "network-vif-plugged", "status": "completed", "tag": "ff1e9960-44ed-4760-8712-c79e1b463cf9"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:35.839580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-faa0a0c2-b675-4ba7-9c1e-4c0757e788b6 req-84911e06-27d6-44c1-bb4a-2998f16d9e01 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:35.840359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-faa0a0c2-b675-4ba7-9c1e-4c0757e788b6 req-84911e06-27d6-44c1-bb4a-2998f16d9e01 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:35.841010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-faa0a0c2-b675-4ba7-9c1e-4c0757e788b6 req-84911e06-27d6-44c1-bb4a-2998f16d9e01 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:35.855191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-731be487-803a-4a14-bba1-9658a7480713 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:35.878675 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-731be487-803a-4a14-bba1-9658a7480713 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1513 microversion: 2.1 time: 0.564258 Oct 10 23:43:35.880015 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2632/5076] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:35 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1513 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:35.892117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:43:35.896264 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-faa0a0c2-b675-4ba7-9c1e-4c0757e788b6 req-84911e06-27d6-44c1-bb4a-2998f16d9e01 service nova] Creating event network-vif-plugged:ff1e9960-44ed-4760-8712-c79e1b463cf9 for instance b27c2a97-533c-436b-8974-f05beb1027fd on n-h2-860864-2 Oct 10 23:43:35.912270 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-faa0a0c2-b675-4ba7-9c1e-4c0757e788b6 req-84911e06-27d6-44c1-bb4a-2998f16d9e01 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124018 Oct 10 23:43:35.913526 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2445/5077] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:43:35.997542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6cd0fb5c-3213-4a9a-acf8-c75b6acec9c3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:35.998513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6cd0fb5c-3213-4a9a-acf8-c75b6acec9c3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:36.013402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6cd0fb5c-3213-4a9a-acf8-c75b6acec9c3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:36.014457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6cd0fb5c-3213-4a9a-acf8-c75b6acec9c3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:36.016965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6cd0fb5c-3213-4a9a-acf8-c75b6acec9c3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:36.018194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6cd0fb5c-3213-4a9a-acf8-c75b6acec9c3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:36.022360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6cd0fb5c-3213-4a9a-acf8-c75b6acec9c3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:36.024054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6cd0fb5c-3213-4a9a-acf8-c75b6acec9c3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:36.535309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6cd0fb5c-3213-4a9a-acf8-c75b6acec9c3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:36.547601 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6cd0fb5c-3213-4a9a-acf8-c75b6acec9c3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1318 microversion: 2.1 time: 0.555241 Oct 10 23:43:36.562118 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2633/5078] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:35 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1318 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:36.912888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2e629533-4ff2-4be9-ae0f-91f96f2d53ac tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:36.913661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2e629533-4ff2-4be9-ae0f-91f96f2d53ac tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:36.923320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e629533-4ff2-4be9-ae0f-91f96f2d53ac tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:36.924215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e629533-4ff2-4be9-ae0f-91f96f2d53ac tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:36.925057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e629533-4ff2-4be9-ae0f-91f96f2d53ac tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:36.926057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e629533-4ff2-4be9-ae0f-91f96f2d53ac tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:36.926721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e629533-4ff2-4be9-ae0f-91f96f2d53ac tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:36.927331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2e629533-4ff2-4be9-ae0f-91f96f2d53ac tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:37.394589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2e629533-4ff2-4be9-ae0f-91f96f2d53ac tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:37.403892 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2e629533-4ff2-4be9-ae0f-91f96f2d53ac tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1513 microversion: 2.1 time: 0.497732 Oct 10 23:43:37.411815 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2446/5079] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:36 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1513 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:37.577894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-88219ea2-fe29-41e0-94f2-9a698cc5cbe0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:37.578681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-88219ea2-fe29-41e0-94f2-9a698cc5cbe0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:37.604499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88219ea2-fe29-41e0-94f2-9a698cc5cbe0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:37.605041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88219ea2-fe29-41e0-94f2-9a698cc5cbe0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:37.605531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88219ea2-fe29-41e0-94f2-9a698cc5cbe0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:37.621519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88219ea2-fe29-41e0-94f2-9a698cc5cbe0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:37.625673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88219ea2-fe29-41e0-94f2-9a698cc5cbe0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:37.630323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88219ea2-fe29-41e0-94f2-9a698cc5cbe0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:38.167405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-88219ea2-fe29-41e0-94f2-9a698cc5cbe0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:38.184248 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-88219ea2-fe29-41e0-94f2-9a698cc5cbe0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1318 microversion: 2.1 time: 0.608540 Oct 10 23:43:38.185575 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2634/5080] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:37 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1318 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:38.366764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-41c46cf6-7077-442a-9964-a44df30d09fb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:38.368761 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-41c46cf6-7077-442a-9964-a44df30d09fb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:38.411359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41c46cf6-7077-442a-9964-a44df30d09fb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:38.411939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41c46cf6-7077-442a-9964-a44df30d09fb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:38.412380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41c46cf6-7077-442a-9964-a44df30d09fb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:38.418700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41c46cf6-7077-442a-9964-a44df30d09fb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:38.419194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41c46cf6-7077-442a-9964-a44df30d09fb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:38.419646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41c46cf6-7077-442a-9964-a44df30d09fb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:38.441156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-861f0b64-4d13-4dac-aa48-0567fc1f3c46 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:38.443220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-861f0b64-4d13-4dac-aa48-0567fc1f3c46 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:38.457713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-861f0b64-4d13-4dac-aa48-0567fc1f3c46 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:38.469034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-861f0b64-4d13-4dac-aa48-0567fc1f3c46 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:38.470357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-861f0b64-4d13-4dac-aa48-0567fc1f3c46 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:38.471940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-861f0b64-4d13-4dac-aa48-0567fc1f3c46 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:38.472836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-861f0b64-4d13-4dac-aa48-0567fc1f3c46 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:38.473616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-861f0b64-4d13-4dac-aa48-0567fc1f3c46 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:38.515660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-41c46cf6-7077-442a-9964-a44df30d09fb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:43:38.770573 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-41c46cf6-7077-442a-9964-a44df30d09fb tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 204 len: 0 microversion: 2.1 time: 0.406385 Oct 10 23:43:38.774179 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2447/5081] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:43:38 2022] DELETE /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:43:38.791207 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2fab71a9-cce6-403f-a793-8d10b299ca6b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:38.792307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2fab71a9-cce6-403f-a793-8d10b299ca6b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:38.852550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fab71a9-cce6-403f-a793-8d10b299ca6b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:38.853318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fab71a9-cce6-403f-a793-8d10b299ca6b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:38.853996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fab71a9-cce6-403f-a793-8d10b299ca6b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:38.855088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fab71a9-cce6-403f-a793-8d10b299ca6b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:38.855732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fab71a9-cce6-403f-a793-8d10b299ca6b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:38.856732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fab71a9-cce6-403f-a793-8d10b299ca6b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:39.118329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-861f0b64-4d13-4dac-aa48-0567fc1f3c46 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:39.134643 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-861f0b64-4d13-4dac-aa48-0567fc1f3c46 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1513 microversion: 2.1 time: 0.698626 Oct 10 23:43:39.137097 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2635/5082] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:38 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1513 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:39.179807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cd9d6b2a-3df0-4434-a128-205914d691ab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:39.182132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cd9d6b2a-3df0-4434-a128-205914d691ab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:39.202822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd9d6b2a-3df0-4434-a128-205914d691ab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:39.203701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd9d6b2a-3df0-4434-a128-205914d691ab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:39.211970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd9d6b2a-3df0-4434-a128-205914d691ab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:39.212908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd9d6b2a-3df0-4434-a128-205914d691ab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:39.213350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd9d6b2a-3df0-4434-a128-205914d691ab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:39.213831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd9d6b2a-3df0-4434-a128-205914d691ab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:39.412983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2fab71a9-cce6-403f-a793-8d10b299ca6b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:39.426312 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2fab71a9-cce6-403f-a793-8d10b299ca6b tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1508 microversion: 2.1 time: 0.645860 Oct 10 23:43:39.429672 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2448/5083] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:38 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1508 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:39.444988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-774b5972-4949-4a68-904f-bc4c387b37c5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:39.446194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-774b5972-4949-4a68-904f-bc4c387b37c5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:39.467009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-774b5972-4949-4a68-904f-bc4c387b37c5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:39.470196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-774b5972-4949-4a68-904f-bc4c387b37c5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:39.470658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-774b5972-4949-4a68-904f-bc4c387b37c5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:39.471408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-774b5972-4949-4a68-904f-bc4c387b37c5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:39.471871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-774b5972-4949-4a68-904f-bc4c387b37c5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:39.472299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-774b5972-4949-4a68-904f-bc4c387b37c5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:39.604235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cd9d6b2a-3df0-4434-a128-205914d691ab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:39.624090 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cd9d6b2a-3df0-4434-a128-205914d691ab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.450912 Oct 10 23:43:39.625299 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2636/5084] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:39 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:39.653553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0d3bdc6e-9cd3-469c-b0f2-adc3bcb112a2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1647395495"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:39.657622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0d3bdc6e-9cd3-469c-b0f2-adc3bcb112a2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:39.680157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d3bdc6e-9cd3-469c-b0f2-adc3bcb112a2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:39.680816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d3bdc6e-9cd3-469c-b0f2-adc3bcb112a2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:39.682119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d3bdc6e-9cd3-469c-b0f2-adc3bcb112a2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:39.683325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d3bdc6e-9cd3-469c-b0f2-adc3bcb112a2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:39.687722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d3bdc6e-9cd3-469c-b0f2-adc3bcb112a2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:39.688582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d3bdc6e-9cd3-469c-b0f2-adc3bcb112a2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:39.807305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-774b5972-4949-4a68-904f-bc4c387b37c5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:39.837307 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-774b5972-4949-4a68-904f-bc4c387b37c5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1509 microversion: 2.1 time: 0.406279 Oct 10 23:43:39.841953 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2449/5085] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:39 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1509 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:39.869249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fbf93b04-3860-4c73-9702-7876bc414c67 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:39.870082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fbf93b04-3860-4c73-9702-7876bc414c67 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:39.880510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbf93b04-3860-4c73-9702-7876bc414c67 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:39.883064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbf93b04-3860-4c73-9702-7876bc414c67 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:39.883557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbf93b04-3860-4c73-9702-7876bc414c67 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:39.884284 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbf93b04-3860-4c73-9702-7876bc414c67 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:39.884747 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbf93b04-3860-4c73-9702-7876bc414c67 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:39.885175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbf93b04-3860-4c73-9702-7876bc414c67 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:40.223245 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0d3bdc6e-9cd3-469c-b0f2-adc3bcb112a2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action" status: 202 len: 0 microversion: 2.1 time: 0.573665 Oct 10 23:43:40.223961 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2637/5086] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:43:39 2022] POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 10 23:43:40.237856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-94b0f1f6-4829-4a7a-9a63-af7d06bdb0f7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:40.243477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-94b0f1f6-4829-4a7a-9a63-af7d06bdb0f7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:40.264194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94b0f1f6-4829-4a7a-9a63-af7d06bdb0f7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:40.267523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94b0f1f6-4829-4a7a-9a63-af7d06bdb0f7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:40.272519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94b0f1f6-4829-4a7a-9a63-af7d06bdb0f7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:40.274017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94b0f1f6-4829-4a7a-9a63-af7d06bdb0f7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:40.275080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94b0f1f6-4829-4a7a-9a63-af7d06bdb0f7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:40.275911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94b0f1f6-4829-4a7a-9a63-af7d06bdb0f7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:40.470105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fbf93b04-3860-4c73-9702-7876bc414c67 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:40.484159 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fbf93b04-3860-4c73-9702-7876bc414c67 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1509 microversion: 2.1 time: 0.616373 Oct 10 23:43:40.484684 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2450/5087] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:39 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1509 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:40.503724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d43ac995-a3c5-4401-9275-7ffe74e9cc56 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:40.509572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d43ac995-a3c5-4401-9275-7ffe74e9cc56 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:40.528831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d43ac995-a3c5-4401-9275-7ffe74e9cc56 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:40.530323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d43ac995-a3c5-4401-9275-7ffe74e9cc56 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:40.532873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d43ac995-a3c5-4401-9275-7ffe74e9cc56 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:40.533921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d43ac995-a3c5-4401-9275-7ffe74e9cc56 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:40.537120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d43ac995-a3c5-4401-9275-7ffe74e9cc56 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:40.537824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d43ac995-a3c5-4401-9275-7ffe74e9cc56 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:40.852206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-94b0f1f6-4829-4a7a-9a63-af7d06bdb0f7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:40.862306 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-94b0f1f6-4829-4a7a-9a63-af7d06bdb0f7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1513 microversion: 2.1 time: 0.636639 Oct 10 23:43:40.862908 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2638/5088] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:40 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1513 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:40.874874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8fc9641d-858b-4f9c-a154-fcc97ad2465e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:40.875620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8fc9641d-858b-4f9c-a154-fcc97ad2465e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:40.898866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8fc9641d-858b-4f9c-a154-fcc97ad2465e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:40.899443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8fc9641d-858b-4f9c-a154-fcc97ad2465e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:40.899845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8fc9641d-858b-4f9c-a154-fcc97ad2465e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:40.900642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8fc9641d-858b-4f9c-a154-fcc97ad2465e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:40.901114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8fc9641d-858b-4f9c-a154-fcc97ad2465e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:40.911193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8fc9641d-858b-4f9c-a154-fcc97ad2465e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:41.336098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d43ac995-a3c5-4401-9275-7ffe74e9cc56 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:41.351628 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d43ac995-a3c5-4401-9275-7ffe74e9cc56 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1680 microversion: 2.1 time: 0.856253 Oct 10 23:43:41.353124 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2451/5089] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:40 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1680 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:41.369707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-640ec566-59f2-4df4-ba1f-84f6985090a7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:41.381608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-640ec566-59f2-4df4-ba1f-84f6985090a7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:41.398844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-640ec566-59f2-4df4-ba1f-84f6985090a7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:41.401540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-640ec566-59f2-4df4-ba1f-84f6985090a7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:41.402281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-640ec566-59f2-4df4-ba1f-84f6985090a7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:41.403033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-640ec566-59f2-4df4-ba1f-84f6985090a7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:41.405902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-640ec566-59f2-4df4-ba1f-84f6985090a7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:41.406853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-640ec566-59f2-4df4-ba1f-84f6985090a7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:41.570846 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-640ec566-59f2-4df4-ba1f-84f6985090a7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "PUT /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1081 microversion: 2.1 time: 0.215854 Oct 10 23:43:41.581122 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2452/5090] 10.222.0.23 () {60 vars in 1256 bytes} [Mon Oct 10 23:43:41 2022] PUT /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1081 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:41.607559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0c758b8c-6d5a-453b-88b5-8a7b52b45781 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:41.608704 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0c758b8c-6d5a-453b-88b5-8a7b52b45781 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:41.622813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c758b8c-6d5a-453b-88b5-8a7b52b45781 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:41.624311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c758b8c-6d5a-453b-88b5-8a7b52b45781 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:41.627033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c758b8c-6d5a-453b-88b5-8a7b52b45781 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:41.631800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c758b8c-6d5a-453b-88b5-8a7b52b45781 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:41.632553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c758b8c-6d5a-453b-88b5-8a7b52b45781 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:41.633252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c758b8c-6d5a-453b-88b5-8a7b52b45781 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:41.894319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8fc9641d-858b-4f9c-a154-fcc97ad2465e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:41.908759 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8fc9641d-858b-4f9c-a154-fcc97ad2465e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 200 len: 1508 microversion: 2.1 time: 1.042200 Oct 10 23:43:41.914922 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2639/5091] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:40 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 1508 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:41.947147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-8eb857d5-1be2-4b96-9536-1fdd3c52e508 req-c36975e9-ec56-493d-9bba-a6137dc36719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1421397-3387-4b28-8473-51140ba79621", "name": "network-vif-deleted", "tag": "7176c745-60e5-4b19-922f-8af0d0c66741"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:41.971376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8eb857d5-1be2-4b96-9536-1fdd3c52e508 req-c36975e9-ec56-493d-9bba-a6137dc36719 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:41.972134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8eb857d5-1be2-4b96-9536-1fdd3c52e508 req-c36975e9-ec56-493d-9bba-a6137dc36719 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:41.972703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8eb857d5-1be2-4b96-9536-1fdd3c52e508 req-c36975e9-ec56-493d-9bba-a6137dc36719 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:41.989043 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-8eb857d5-1be2-4b96-9536-1fdd3c52e508 req-c36975e9-ec56-493d-9bba-a6137dc36719 service nova] Creating event network-vif-deleted:7176c745-60e5-4b19-922f-8af0d0c66741 for instance c1421397-3387-4b28-8473-51140ba79621 on n-h1-860864-2 Oct 10 23:43:41.999218 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-8eb857d5-1be2-4b96-9536-1fdd3c52e508 req-c36975e9-ec56-493d-9bba-a6137dc36719 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082242 Oct 10 23:43:42.003697 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2640/5092] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:43:42.016077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-638e8d14-c280-47b8-841e-46606722eab4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:42.022677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-638e8d14-c280-47b8-841e-46606722eab4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:42.041099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-638e8d14-c280-47b8-841e-46606722eab4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:42.042078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-638e8d14-c280-47b8-841e-46606722eab4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:42.047187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-638e8d14-c280-47b8-841e-46606722eab4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:42.048354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-638e8d14-c280-47b8-841e-46606722eab4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:42.049079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-638e8d14-c280-47b8-841e-46606722eab4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:42.049822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-638e8d14-c280-47b8-841e-46606722eab4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:42.077309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0c758b8c-6d5a-453b-88b5-8a7b52b45781 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:42.094586 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0c758b8c-6d5a-453b-88b5-8a7b52b45781 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1507 microversion: 2.1 time: 0.482905 Oct 10 23:43:42.098156 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2453/5093] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:41 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1507 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:42.129484 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-12aac870-0a0c-4737-8cd8-99bffe3a675e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:42.131599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-12aac870-0a0c-4737-8cd8-99bffe3a675e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:42.156261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12aac870-0a0c-4737-8cd8-99bffe3a675e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:42.160853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12aac870-0a0c-4737-8cd8-99bffe3a675e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:42.161986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12aac870-0a0c-4737-8cd8-99bffe3a675e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:42.173282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12aac870-0a0c-4737-8cd8-99bffe3a675e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:42.174525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12aac870-0a0c-4737-8cd8-99bffe3a675e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:42.175674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12aac870-0a0c-4737-8cd8-99bffe3a675e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:42.442665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-638e8d14-c280-47b8-841e-46606722eab4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:42.482014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-12aac870-0a0c-4737-8cd8-99bffe3a675e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:42.494592 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-638e8d14-c280-47b8-841e-46606722eab4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1513 microversion: 2.1 time: 0.451859 Oct 10 23:43:42.499283 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-12aac870-0a0c-4737-8cd8-99bffe3a675e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1507 microversion: 2.1 time: 0.373051 Oct 10 23:43:42.503711 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2454/5094] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:42 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1507 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:42.513193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e0e8daab-04ed-49a5-929b-1df63d24619f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:42.518379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e0e8daab-04ed-49a5-929b-1df63d24619f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:42.520998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:43:42.525968 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2641/5095] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:42 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1513 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:42.540872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0e8daab-04ed-49a5-929b-1df63d24619f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:42.541972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0e8daab-04ed-49a5-929b-1df63d24619f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:42.546191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0e8daab-04ed-49a5-929b-1df63d24619f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:42.548105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0e8daab-04ed-49a5-929b-1df63d24619f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:42.548291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-664c84a2-5599-4331-a459-c40d92c4ea36 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:42.549086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0e8daab-04ed-49a5-929b-1df63d24619f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:42.549872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0e8daab-04ed-49a5-929b-1df63d24619f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:42.561392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-664c84a2-5599-4331-a459-c40d92c4ea36 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:42.611877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-664c84a2-5599-4331-a459-c40d92c4ea36 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:42.614278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-664c84a2-5599-4331-a459-c40d92c4ea36 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:42.616147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-664c84a2-5599-4331-a459-c40d92c4ea36 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:42.621836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-664c84a2-5599-4331-a459-c40d92c4ea36 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:42.622692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-664c84a2-5599-4331-a459-c40d92c4ea36 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:42.623400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-664c84a2-5599-4331-a459-c40d92c4ea36 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:42.791660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e0e8daab-04ed-49a5-929b-1df63d24619f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:42.809169 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e0e8daab-04ed-49a5-929b-1df63d24619f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1688 microversion: 2.1 time: 0.303476 Oct 10 23:43:42.818873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-664c84a2-5599-4331-a459-c40d92c4ea36 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:43:42.821142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-664c84a2-5599-4331-a459-c40d92c4ea36 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:43:42.822804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-664c84a2-5599-4331-a459-c40d92c4ea36 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:43:42.823262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-664c84a2-5599-4331-a459-c40d92c4ea36 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:43:42.823686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-664c84a2-5599-4331-a459-c40d92c4ea36 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:43:42.834681 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2455/5096] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:42 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1688 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:42.914893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:43:42.943876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-14e5e45d-9f4c-402b-bec5-b3292ca494ee tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:42.944927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-14e5e45d-9f4c-402b-bec5-b3292ca494ee tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: c1421397-3387-4b28-8473-51140ba79621] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:42.948400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-664c84a2-5599-4331-a459-c40d92c4ea36 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:42.956396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14e5e45d-9f4c-402b-bec5-b3292ca494ee tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:42.957990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14e5e45d-9f4c-402b-bec5-b3292ca494ee tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:42.958444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14e5e45d-9f4c-402b-bec5-b3292ca494ee tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:42.959558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14e5e45d-9f4c-402b-bec5-b3292ca494ee tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:42.961497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-664c84a2-5599-4331-a459-c40d92c4ea36 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:42.962681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-664c84a2-5599-4331-a459-c40d92c4ea36 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:42.963452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-664c84a2-5599-4331-a459-c40d92c4ea36 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:42.964906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-664c84a2-5599-4331-a459-c40d92c4ea36 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:42.965790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-664c84a2-5599-4331-a459-c40d92c4ea36 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:42.966905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-664c84a2-5599-4331-a459-c40d92c4ea36 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:42.968541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14e5e45d-9f4c-402b-bec5-b3292ca494ee tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:42.969591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14e5e45d-9f4c-402b-bec5-b3292ca494ee tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:42.996046 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-14e5e45d-9f4c-402b-bec5-b3292ca494ee tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] HTTP exception thrown: Instance c1421397-3387-4b28-8473-51140ba79621 could not be found. Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-14e5e45d-9f4c-402b-bec5-b3292ca494ee tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Request method failure captured: Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 HTTP/1.1 Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKzOYlZsv7rRo2sa7kQc2eFaI8v-TMGvuh-sVU-zvganQJF5vXcDouizKP05ne1GDSQKrDkWUQDAU6qxxYttyNZ_6Byu14LDFhfplUKI_eaTrPi0t5xENermj156ZGMg1lyNDKMrSevusXHHA-zCISDm6SLPwivXrQErNiD9Jy9X9Qs Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 8986c214fcc944acb2731cc5af19ef0c Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8986c214fcc944acb2731cc5af19ef0c", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 8986c214fcc944acb2731cc5af19ef0c Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerRescueNegativeTestJSON-906322093-project Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 585d2834c2a94c5eaa8267cf2ba58ac0 Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerRescueNegativeTestJSON-906322093-project Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance c1421397-3387-4b28-8473-51140ba79621 could not be found. Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'c1421397-3387-4b28-8473-51140ba79621'} Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1421397-3387-4b28-8473-51140ba79621 could not be found. Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1421397-3387-4b28-8473-51140ba79621 could not be found. Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:43.018616 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:43.023886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:43.023886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:43.023886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:43.023886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:43.023886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:43:43.023886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:43:43.023886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1421397-3387-4b28-8473-51140ba79621 could not be found. Oct 10 23:43:43.023886 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:43.023886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-14e5e45d-9f4c-402b-bec5-b3292ca494ee tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Returning 404 to user: Instance c1421397-3387-4b28-8473-51140ba79621 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:43:43.026495 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-14e5e45d-9f4c-402b-bec5-b3292ca494ee tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621" status: 404 len: 111 microversion: 2.1 time: 0.080400 Oct 10 23:43:43.028555 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2456/5097] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:42 2022] GET /compute/v2.1/servers/c1421397-3387-4b28-8473-51140ba79621 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:43:43.045145 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-664c84a2-5599-4331-a459-c40d92c4ea36 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "POST /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd/action" status: 202 len: 1113 microversion: 2.1 time: 0.516561 Oct 10 23:43:43.048550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d1fbb2bc-5c1c-4547-809c-49b962f0d1f7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:43.049078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d1fbb2bc-5c1c-4547-809c-49b962f0d1f7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:43.052783 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2642/5098] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:43:42 2022] POST /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd/action => generated 1113 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 10 23:43:43.059759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1fbb2bc-5c1c-4547-809c-49b962f0d1f7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:43.060285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1fbb2bc-5c1c-4547-809c-49b962f0d1f7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:43.060720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1fbb2bc-5c1c-4547-809c-49b962f0d1f7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:43.072784 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1fbb2bc-5c1c-4547-809c-49b962f0d1f7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:43.073299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1fbb2bc-5c1c-4547-809c-49b962f0d1f7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:43.073782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1fbb2bc-5c1c-4547-809c-49b962f0d1f7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:43.080165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-697dabe0-cd92-43bd-86f8-9ac675dd5ad3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:43.080823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-697dabe0-cd92-43bd-86f8-9ac675dd5ad3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:43.091836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-697dabe0-cd92-43bd-86f8-9ac675dd5ad3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:43.095725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-697dabe0-cd92-43bd-86f8-9ac675dd5ad3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:43.099341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-697dabe0-cd92-43bd-86f8-9ac675dd5ad3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:43.100767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-697dabe0-cd92-43bd-86f8-9ac675dd5ad3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:43.101618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-697dabe0-cd92-43bd-86f8-9ac675dd5ad3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:43.103525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-697dabe0-cd92-43bd-86f8-9ac675dd5ad3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:43.178824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d1fbb2bc-5c1c-4547-809c-49b962f0d1f7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:43:43.363344 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d1fbb2bc-5c1c-4547-809c-49b962f0d1f7 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 204 len: 0 microversion: 2.1 time: 0.333268 Oct 10 23:43:43.364318 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2457/5099] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:43:43 2022] DELETE /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:43:43.374537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-c68dc391-3483-432e-892e-359fe2a165cc req-5ee89024-2dfc-4643-be04-c3b57f5215e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c65eb2-4a59-4b1e-bf11-e2094d984d0a", "name": "network-vif-unplugged", "status": "completed", "tag": "db12b09d-2d47-4f71-9616-ebcc385cf4ab"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:43.387034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c68dc391-3483-432e-892e-359fe2a165cc req-5ee89024-2dfc-4643-be04-c3b57f5215e4 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:43.387564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c68dc391-3483-432e-892e-359fe2a165cc req-5ee89024-2dfc-4643-be04-c3b57f5215e4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:43.388356 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c68dc391-3483-432e-892e-359fe2a165cc req-5ee89024-2dfc-4643-be04-c3b57f5215e4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:43.423886 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-c68dc391-3483-432e-892e-359fe2a165cc req-5ee89024-2dfc-4643-be04-c3b57f5215e4 service nova] Creating event network-vif-unplugged:db12b09d-2d47-4f71-9616-ebcc385cf4ab for instance 88c65eb2-4a59-4b1e-bf11-e2094d984d0a on n-h2-860864-2 Oct 10 23:43:43.431076 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-c68dc391-3483-432e-892e-359fe2a165cc req-5ee89024-2dfc-4643-be04-c3b57f5215e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061237 Oct 10 23:43:43.438479 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2458/5100] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:43:43.455322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-484b5d5f-ad63-4925-b496-169b179cac5e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:43.456272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-484b5d5f-ad63-4925-b496-169b179cac5e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:43.465032 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-484b5d5f-ad63-4925-b496-169b179cac5e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:43.465860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-484b5d5f-ad63-4925-b496-169b179cac5e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:43.466483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-484b5d5f-ad63-4925-b496-169b179cac5e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:43.467696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-484b5d5f-ad63-4925-b496-169b179cac5e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:43.468846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-484b5d5f-ad63-4925-b496-169b179cac5e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:43.469668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-484b5d5f-ad63-4925-b496-169b179cac5e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:43.757237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-697dabe0-cd92-43bd-86f8-9ac675dd5ad3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:43.782418 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-697dabe0-cd92-43bd-86f8-9ac675dd5ad3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1518 microversion: 2.1 time: 0.705349 Oct 10 23:43:43.786535 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2643/5101] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:43 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1518 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:43.798038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2f3adafc-c963-4ed8-b035-c4fed3794694 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:43.801837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2f3adafc-c963-4ed8-b035-c4fed3794694 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:43.847760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f3adafc-c963-4ed8-b035-c4fed3794694 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:43.848644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f3adafc-c963-4ed8-b035-c4fed3794694 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:43.849889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f3adafc-c963-4ed8-b035-c4fed3794694 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:43.851244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f3adafc-c963-4ed8-b035-c4fed3794694 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:43.853317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f3adafc-c963-4ed8-b035-c4fed3794694 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:43.856158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f3adafc-c963-4ed8-b035-c4fed3794694 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:43.908221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-484b5d5f-ad63-4925-b496-169b179cac5e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:43.914902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:43:43.940824 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-484b5d5f-ad63-4925-b496-169b179cac5e tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1521 microversion: 2.1 time: 0.497490 Oct 10 23:43:43.971827 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2459/5102] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:43 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1521 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:43.981683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-95cf29c3-0cb2-4c89-bdd1-ef0b78608cce tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:43.982313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-95cf29c3-0cb2-4c89-bdd1-ef0b78608cce tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:44.023247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95cf29c3-0cb2-4c89-bdd1-ef0b78608cce tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:44.023465 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95cf29c3-0cb2-4c89-bdd1-ef0b78608cce tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:44.030876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95cf29c3-0cb2-4c89-bdd1-ef0b78608cce tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:44.032894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95cf29c3-0cb2-4c89-bdd1-ef0b78608cce tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:44.033460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95cf29c3-0cb2-4c89-bdd1-ef0b78608cce tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:44.033921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95cf29c3-0cb2-4c89-bdd1-ef0b78608cce tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:44.570623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-95cf29c3-0cb2-4c89-bdd1-ef0b78608cce tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:44.589224 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-95cf29c3-0cb2-4c89-bdd1-ef0b78608cce tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1683 microversion: 2.1 time: 0.615865 Oct 10 23:43:44.601433 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2460/5103] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:43 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1683 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:44.777838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2f3adafc-c963-4ed8-b035-c4fed3794694 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:44.798078 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2f3adafc-c963-4ed8-b035-c4fed3794694 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1513 microversion: 2.1 time: 1.009735 Oct 10 23:43:44.835992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-75ac3cf1-d7cb-4f2d-bc12-b75cc07e2a7f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:44.840961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-75ac3cf1-d7cb-4f2d-bc12-b75cc07e2a7f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:44.842745 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2644/5104] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:43 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1513 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:44.852333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75ac3cf1-d7cb-4f2d-bc12-b75cc07e2a7f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:44.852840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75ac3cf1-d7cb-4f2d-bc12-b75cc07e2a7f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:44.853279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75ac3cf1-d7cb-4f2d-bc12-b75cc07e2a7f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:44.868573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75ac3cf1-d7cb-4f2d-bc12-b75cc07e2a7f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:44.869522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75ac3cf1-d7cb-4f2d-bc12-b75cc07e2a7f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:44.869973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-75ac3cf1-d7cb-4f2d-bc12-b75cc07e2a7f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:44.979586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-275fe34f-1a16-499f-bec6-9f3a847b3ac4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:44.980480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-275fe34f-1a16-499f-bec6-9f3a847b3ac4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:45.008199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-275fe34f-1a16-499f-bec6-9f3a847b3ac4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:45.010610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-275fe34f-1a16-499f-bec6-9f3a847b3ac4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:45.011184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-275fe34f-1a16-499f-bec6-9f3a847b3ac4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:45.013327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-275fe34f-1a16-499f-bec6-9f3a847b3ac4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:45.015126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-275fe34f-1a16-499f-bec6-9f3a847b3ac4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:45.015690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-275fe34f-1a16-499f-bec6-9f3a847b3ac4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:45.556516 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-75ac3cf1-d7cb-4f2d-bc12-b75cc07e2a7f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:45.571180 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-75ac3cf1-d7cb-4f2d-bc12-b75cc07e2a7f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1518 microversion: 2.1 time: 0.745435 Oct 10 23:43:45.589943 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2461/5105] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:44 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1518 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:45.627881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fe8809d1-c5ac-4665-b649-3cf3b40371ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:45.628515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fe8809d1-c5ac-4665-b649-3cf3b40371ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:45.640559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe8809d1-c5ac-4665-b649-3cf3b40371ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:45.641064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe8809d1-c5ac-4665-b649-3cf3b40371ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:45.641540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe8809d1-c5ac-4665-b649-3cf3b40371ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:45.642299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe8809d1-c5ac-4665-b649-3cf3b40371ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:45.642768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe8809d1-c5ac-4665-b649-3cf3b40371ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:45.666831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe8809d1-c5ac-4665-b649-3cf3b40371ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:45.740332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-275fe34f-1a16-499f-bec6-9f3a847b3ac4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:45.754440 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-275fe34f-1a16-499f-bec6-9f3a847b3ac4 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1521 microversion: 2.1 time: 0.780990 Oct 10 23:43:45.755398 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2645/5106] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:44 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1521 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:45.825791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ca36244c-ceb7-417a-8110-d88fe5b34837 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:45.826327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ca36244c-ceb7-417a-8110-d88fe5b34837 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:45.840879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ca36244c-ceb7-417a-8110-d88fe5b34837 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:45.841312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ca36244c-ceb7-417a-8110-d88fe5b34837 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:45.841799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ca36244c-ceb7-417a-8110-d88fe5b34837 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:45.842677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ca36244c-ceb7-417a-8110-d88fe5b34837 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:45.843143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ca36244c-ceb7-417a-8110-d88fe5b34837 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:45.843606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ca36244c-ceb7-417a-8110-d88fe5b34837 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:46.397699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fe8809d1-c5ac-4665-b649-3cf3b40371ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:46.413455 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fe8809d1-c5ac-4665-b649-3cf3b40371ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1683 microversion: 2.1 time: 0.787375 Oct 10 23:43:46.414509 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2462/5107] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:45 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1683 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:46.529420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ca36244c-ceb7-417a-8110-d88fe5b34837 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:46.542844 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ca36244c-ceb7-417a-8110-d88fe5b34837 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1513 microversion: 2.1 time: 0.721873 Oct 10 23:43:46.565860 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2646/5108] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:45 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1513 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:46.599801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d7cb8c88-ad27-47da-9869-67d346966961 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:46.601176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d7cb8c88-ad27-47da-9869-67d346966961 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:46.621323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7cb8c88-ad27-47da-9869-67d346966961 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:46.622366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7cb8c88-ad27-47da-9869-67d346966961 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:46.624535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7cb8c88-ad27-47da-9869-67d346966961 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:46.625729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7cb8c88-ad27-47da-9869-67d346966961 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:46.630967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7cb8c88-ad27-47da-9869-67d346966961 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:46.632846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7cb8c88-ad27-47da-9869-67d346966961 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:46.786620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8089c175-0012-4fa3-b9d4-6a9995c21455 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:46.787605 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8089c175-0012-4fa3-b9d4-6a9995c21455 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:46.807783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8089c175-0012-4fa3-b9d4-6a9995c21455 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:46.808495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8089c175-0012-4fa3-b9d4-6a9995c21455 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:46.809063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8089c175-0012-4fa3-b9d4-6a9995c21455 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:46.809910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8089c175-0012-4fa3-b9d4-6a9995c21455 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:46.820261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8089c175-0012-4fa3-b9d4-6a9995c21455 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:46.821652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8089c175-0012-4fa3-b9d4-6a9995c21455 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:47.604156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d7cb8c88-ad27-47da-9869-67d346966961 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:47.618192 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d7cb8c88-ad27-47da-9869-67d346966961 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1518 microversion: 2.1 time: 1.023800 Oct 10 23:43:47.626251 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2463/5109] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:46 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1518 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:47.644014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e82526d7-3e08-4cf5-859a-8faddaa34a49 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:47.644646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e82526d7-3e08-4cf5-859a-8faddaa34a49 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:47.674457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e82526d7-3e08-4cf5-859a-8faddaa34a49 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:47.675015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e82526d7-3e08-4cf5-859a-8faddaa34a49 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:47.675585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e82526d7-3e08-4cf5-859a-8faddaa34a49 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:47.676184 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e82526d7-3e08-4cf5-859a-8faddaa34a49 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:47.676648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e82526d7-3e08-4cf5-859a-8faddaa34a49 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:47.677076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e82526d7-3e08-4cf5-859a-8faddaa34a49 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:47.697091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8089c175-0012-4fa3-b9d4-6a9995c21455 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:47.721098 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8089c175-0012-4fa3-b9d4-6a9995c21455 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1521 microversion: 2.1 time: 0.940265 Oct 10 23:43:47.723681 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2647/5110] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:46 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1521 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:47.734887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4d6e7848-2815-44b8-b61c-a69bf6178417 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:47.741139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4d6e7848-2815-44b8-b61c-a69bf6178417 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:47.761622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d6e7848-2815-44b8-b61c-a69bf6178417 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:47.762128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d6e7848-2815-44b8-b61c-a69bf6178417 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:47.764817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d6e7848-2815-44b8-b61c-a69bf6178417 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:47.772164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d6e7848-2815-44b8-b61c-a69bf6178417 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:47.772662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d6e7848-2815-44b8-b61c-a69bf6178417 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:47.781841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d6e7848-2815-44b8-b61c-a69bf6178417 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:48.386253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4d6e7848-2815-44b8-b61c-a69bf6178417 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:48.395227 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4d6e7848-2815-44b8-b61c-a69bf6178417 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1513 microversion: 2.1 time: 0.664995 Oct 10 23:43:48.418678 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2648/5111] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:47 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1513 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:48.604447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e82526d7-3e08-4cf5-859a-8faddaa34a49 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:48.625907 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e82526d7-3e08-4cf5-859a-8faddaa34a49 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1683 microversion: 2.1 time: 0.998216 Oct 10 23:43:48.637898 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2464/5112] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:47 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1683 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:48.647034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a1833321-18df-414c-9a89-35e2cade1c0a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:48.647820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a1833321-18df-414c-9a89-35e2cade1c0a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:48.675706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1833321-18df-414c-9a89-35e2cade1c0a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:48.680464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1833321-18df-414c-9a89-35e2cade1c0a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:48.681051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1833321-18df-414c-9a89-35e2cade1c0a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:48.682109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1833321-18df-414c-9a89-35e2cade1c0a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:48.685956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1833321-18df-414c-9a89-35e2cade1c0a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:48.686427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1833321-18df-414c-9a89-35e2cade1c0a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:48.750617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8256b6a5-0a7d-4808-923e-a1202035d8f0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:48.751495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8256b6a5-0a7d-4808-923e-a1202035d8f0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:48.768451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8256b6a5-0a7d-4808-923e-a1202035d8f0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:48.778322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8256b6a5-0a7d-4808-923e-a1202035d8f0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:48.778925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8256b6a5-0a7d-4808-923e-a1202035d8f0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:48.783050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8256b6a5-0a7d-4808-923e-a1202035d8f0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:48.790214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8256b6a5-0a7d-4808-923e-a1202035d8f0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:48.790708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8256b6a5-0a7d-4808-923e-a1202035d8f0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:49.219965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a1833321-18df-414c-9a89-35e2cade1c0a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:49.235413 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a1833321-18df-414c-9a89-35e2cade1c0a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1518 microversion: 2.1 time: 0.592817 Oct 10 23:43:49.239466 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2649/5113] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:48 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1518 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:49.341880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8256b6a5-0a7d-4808-923e-a1202035d8f0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:49.363227 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8256b6a5-0a7d-4808-923e-a1202035d8f0 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1521 microversion: 2.1 time: 0.618620 Oct 10 23:43:49.366139 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2465/5114] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:48 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1521 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:49.426658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-674a6622-af46-417f-9cc4-e94f30846a71 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:49.428245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-674a6622-af46-417f-9cc4-e94f30846a71 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:49.439238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-674a6622-af46-417f-9cc4-e94f30846a71 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:49.440178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-674a6622-af46-417f-9cc4-e94f30846a71 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:49.440873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-674a6622-af46-417f-9cc4-e94f30846a71 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:49.442001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-674a6622-af46-417f-9cc4-e94f30846a71 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:49.442995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-674a6622-af46-417f-9cc4-e94f30846a71 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:49.443974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-674a6622-af46-417f-9cc4-e94f30846a71 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:49.582513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-7dbcc025-b5f7-457a-99d5-c7cb9f3c628b req-1686aad2-d2d4-4d11-a20d-d419b3713848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f01cc76-fa39-4e39-8e4d-e0263388c690", "name": "network-vif-deleted", "tag": "0e86eed0-1a80-408f-a2af-bad1d359822c"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:49.631954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7dbcc025-b5f7-457a-99d5-c7cb9f3c628b req-1686aad2-d2d4-4d11-a20d-d419b3713848 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:49.635959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7dbcc025-b5f7-457a-99d5-c7cb9f3c628b req-1686aad2-d2d4-4d11-a20d-d419b3713848 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:49.636707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7dbcc025-b5f7-457a-99d5-c7cb9f3c628b req-1686aad2-d2d4-4d11-a20d-d419b3713848 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:49.746822 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-7dbcc025-b5f7-457a-99d5-c7cb9f3c628b req-1686aad2-d2d4-4d11-a20d-d419b3713848 service nova] Creating event network-vif-deleted:0e86eed0-1a80-408f-a2af-bad1d359822c for instance 0f01cc76-fa39-4e39-8e4d-e0263388c690 on n-h1-860864-2 Oct 10 23:43:49.759236 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-7dbcc025-b5f7-457a-99d5-c7cb9f3c628b req-1686aad2-d2d4-4d11-a20d-d419b3713848 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185246 Oct 10 23:43:49.761555 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2466/5115] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:43:49.786093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a2d82bc6-f171-471f-8a69-83125aa5f90f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:49.787094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a2d82bc6-f171-471f-8a69-83125aa5f90f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:49.831937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2d82bc6-f171-471f-8a69-83125aa5f90f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:49.832446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2d82bc6-f171-471f-8a69-83125aa5f90f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:49.832895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2d82bc6-f171-471f-8a69-83125aa5f90f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:49.833658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2d82bc6-f171-471f-8a69-83125aa5f90f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:49.834121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2d82bc6-f171-471f-8a69-83125aa5f90f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:49.834551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2d82bc6-f171-471f-8a69-83125aa5f90f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:49.937623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-674a6622-af46-417f-9cc4-e94f30846a71 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:49.953163 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-674a6622-af46-417f-9cc4-e94f30846a71 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1513 microversion: 2.1 time: 0.531566 Oct 10 23:43:49.953751 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2650/5116] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:49 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1513 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:50.123750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-06f84647-6827-4563-b0b6-5b1183e0364d req-c65c02c9-2db8-4c17-85d0-ba0036637b04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c65eb2-4a59-4b1e-bf11-e2094d984d0a", "name": "network-vif-plugged", "status": "completed", "tag": "db12b09d-2d47-4f71-9616-ebcc385cf4ab"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:50.146030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-06f84647-6827-4563-b0b6-5b1183e0364d req-c65c02c9-2db8-4c17-85d0-ba0036637b04 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:50.146699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-06f84647-6827-4563-b0b6-5b1183e0364d req-c65c02c9-2db8-4c17-85d0-ba0036637b04 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:50.147155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-06f84647-6827-4563-b0b6-5b1183e0364d req-c65c02c9-2db8-4c17-85d0-ba0036637b04 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:50.222128 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-06f84647-6827-4563-b0b6-5b1183e0364d req-c65c02c9-2db8-4c17-85d0-ba0036637b04 service nova] Creating event network-vif-plugged:db12b09d-2d47-4f71-9616-ebcc385cf4ab for instance 88c65eb2-4a59-4b1e-bf11-e2094d984d0a on n-h2-860864-2 Oct 10 23:43:50.275317 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-06f84647-6827-4563-b0b6-5b1183e0364d req-c65c02c9-2db8-4c17-85d0-ba0036637b04 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149180 Oct 10 23:43:50.278660 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2651/5117] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:43:50.293670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b506e60e-e8f6-4d2c-b827-3b8b9a5214d1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:50.294980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b506e60e-e8f6-4d2c-b827-3b8b9a5214d1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:50.320929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b506e60e-e8f6-4d2c-b827-3b8b9a5214d1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:50.323107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b506e60e-e8f6-4d2c-b827-3b8b9a5214d1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:50.323563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b506e60e-e8f6-4d2c-b827-3b8b9a5214d1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:50.324409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b506e60e-e8f6-4d2c-b827-3b8b9a5214d1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:50.324754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b506e60e-e8f6-4d2c-b827-3b8b9a5214d1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:50.325414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b506e60e-e8f6-4d2c-b827-3b8b9a5214d1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:50.352952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a2d82bc6-f171-471f-8a69-83125aa5f90f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:50.364239 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a2d82bc6-f171-471f-8a69-83125aa5f90f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1683 microversion: 2.1 time: 0.600928 Oct 10 23:43:50.364613 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2467/5118] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:49 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1683 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:50.394253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b6d3a286-ee13-4b00-967a-82e3e3ac57e3 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:50.395161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b6d3a286-ee13-4b00-967a-82e3e3ac57e3 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:50.403752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6d3a286-ee13-4b00-967a-82e3e3ac57e3 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:50.404620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6d3a286-ee13-4b00-967a-82e3e3ac57e3 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:50.405942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6d3a286-ee13-4b00-967a-82e3e3ac57e3 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:50.407122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6d3a286-ee13-4b00-967a-82e3e3ac57e3 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:50.407824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6d3a286-ee13-4b00-967a-82e3e3ac57e3 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:50.408504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6d3a286-ee13-4b00-967a-82e3e3ac57e3 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:50.452420 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6d3a286-ee13-4b00-967a-82e3e3ac57e3 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:50.453236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6d3a286-ee13-4b00-967a-82e3e3ac57e3 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:50.453928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6d3a286-ee13-4b00-967a-82e3e3ac57e3 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:50.454595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-b6d3a286-ee13-4b00-967a-82e3e3ac57e3 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lazy-loading 'fault' on Instance uuid 0f01cc76-fa39-4e39-8e4d-e0263388c690 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:43:50.610875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b6d3a286-ee13-4b00-967a-82e3e3ac57e3 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '585d2834c2a94c5eaa8267cf2ba58ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8986c214fcc944acb2731cc5af19ef0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:50.619119 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b6d3a286-ee13-4b00-967a-82e3e3ac57e3 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 200 len: 1310 microversion: 2.1 time: 0.230390 Oct 10 23:43:50.624754 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2468/5119] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:50 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 1310 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:50.762044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b506e60e-e8f6-4d2c-b827-3b8b9a5214d1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:50.778136 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b506e60e-e8f6-4d2c-b827-3b8b9a5214d1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1518 microversion: 2.1 time: 0.497844 Oct 10 23:43:50.778696 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2652/5120] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:50 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1518 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:50.985915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-595089e8-938c-4f90-8fd5-1940c1d3f553 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:50.987846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-595089e8-938c-4f90-8fd5-1940c1d3f553 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:51.001440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-595089e8-938c-4f90-8fd5-1940c1d3f553 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:51.002917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-595089e8-938c-4f90-8fd5-1940c1d3f553 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:51.004064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-595089e8-938c-4f90-8fd5-1940c1d3f553 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:51.006251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-595089e8-938c-4f90-8fd5-1940c1d3f553 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:51.009767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-595089e8-938c-4f90-8fd5-1940c1d3f553 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:51.011894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-595089e8-938c-4f90-8fd5-1940c1d3f553 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:51.029352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1f37c0b1-b47d-406a-8d9c-33c8210f4f1d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2106918691", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "f411452a-97c5-471c-bc9b-c79e58a05eb2"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:43:51.172566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-1f37c0b1-b47d-406a-8d9c-33c8210f4f1d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] validate_networks() for [('f411452a-97c5-471c-bc9b-c79e58a05eb2', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:43:51.392669 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-595089e8-938c-4f90-8fd5-1940c1d3f553 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:51.420545 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-595089e8-938c-4f90-8fd5-1940c1d3f553 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1513 microversion: 2.1 time: 0.444617 Oct 10 23:43:51.424634 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2469/5121] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:50 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1513 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:51.441132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8ee8dbfb-9215-408a-a41e-1d9f5135a0fa tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:51.444873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8ee8dbfb-9215-408a-a41e-1d9f5135a0fa tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:51.457063 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8ee8dbfb-9215-408a-a41e-1d9f5135a0fa tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:51.465466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8ee8dbfb-9215-408a-a41e-1d9f5135a0fa tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:51.468296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8ee8dbfb-9215-408a-a41e-1d9f5135a0fa tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:51.469600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8ee8dbfb-9215-408a-a41e-1d9f5135a0fa tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:51.471474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8ee8dbfb-9215-408a-a41e-1d9f5135a0fa tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:51.472381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8ee8dbfb-9215-408a-a41e-1d9f5135a0fa tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:51.911282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8ee8dbfb-9215-408a-a41e-1d9f5135a0fa tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:51.933608 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8ee8dbfb-9215-408a-a41e-1d9f5135a0fa tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1683 microversion: 2.1 time: 0.506420 Oct 10 23:43:51.938475 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2470/5122] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:51 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1683 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:51.956735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0c8e7287-127b-4db6-8231-2d342070a518 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:51.957837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0c8e7287-127b-4db6-8231-2d342070a518 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] [instance: 0f01cc76-fa39-4e39-8e4d-e0263388c690] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:51.969700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c8e7287-127b-4db6-8231-2d342070a518 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:51.972433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c8e7287-127b-4db6-8231-2d342070a518 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:51.973083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c8e7287-127b-4db6-8231-2d342070a518 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:51.974999 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c8e7287-127b-4db6-8231-2d342070a518 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:51.976442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c8e7287-127b-4db6-8231-2d342070a518 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:51.979785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c8e7287-127b-4db6-8231-2d342070a518 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:52.022542 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-0c8e7287-127b-4db6-8231-2d342070a518 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] HTTP exception thrown: Instance 0f01cc76-fa39-4e39-8e4d-e0263388c690 could not be found. Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0c8e7287-127b-4db6-8231-2d342070a518 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Request method failure captured: Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 HTTP/1.1 Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRKzOYlZsv7rRo2sa7kQc2eFaI8v-TMGvuh-sVU-zvganQJF5vXcDouizKP05ne1GDSQKrDkWUQDAU6qxxYttyNZ_6Byu14LDFhfplUKI_eaTrPi0t5xENermj156ZGMg1lyNDKMrSevusXHHA-zCISDm6SLPwivXrQErNiD9Jy9X9Qs Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 8986c214fcc944acb2731cc5af19ef0c Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8986c214fcc944acb2731cc5af19ef0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8986c214fcc944acb2731cc5af19ef0c", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 8986c214fcc944acb2731cc5af19ef0c Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-906322093 Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerRescueNegativeTestJSON-906322093-project Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 585d2834c2a94c5eaa8267cf2ba58ac0 Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerRescueNegativeTestJSON-906322093-project Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 0f01cc76-fa39-4e39-8e4d-e0263388c690 could not be found. Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '0f01cc76-fa39-4e39-8e4d-e0263388c690'} Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f01cc76-fa39-4e39-8e4d-e0263388c690 could not be found. Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f01cc76-fa39-4e39-8e4d-e0263388c690 could not be found. Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:52.025561 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:43:52.032073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:52.032073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:43:52.032073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:43:52.032073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:43:52.032073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:43:52.032073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:43:52.032073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f01cc76-fa39-4e39-8e4d-e0263388c690 could not be found. Oct 10 23:43:52.032073 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:43:52.035046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0c8e7287-127b-4db6-8231-2d342070a518 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] Returning 404 to user: Instance 0f01cc76-fa39-4e39-8e4d-e0263388c690 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:43:52.036226 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0c8e7287-127b-4db6-8231-2d342070a518 tempest-ServerRescueNegativeTestJSON-906322093 tempest-ServerRescueNegativeTestJSON-906322093-project] 10.222.0.23 "GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690" status: 404 len: 111 microversion: 2.1 time: 0.096461 Oct 10 23:43:52.037428 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2471/5123] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:51 2022] GET /compute/v2.1/servers/0f01cc76-fa39-4e39-8e4d-e0263388c690 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:43:52.042475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8b4d7cfd-70c1-48c2-8a7d-77b8988efcc1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:52.043602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8b4d7cfd-70c1-48c2-8a7d-77b8988efcc1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:52.051300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b4d7cfd-70c1-48c2-8a7d-77b8988efcc1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:52.052251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b4d7cfd-70c1-48c2-8a7d-77b8988efcc1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:52.052950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b4d7cfd-70c1-48c2-8a7d-77b8988efcc1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:52.054022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b4d7cfd-70c1-48c2-8a7d-77b8988efcc1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:52.054965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b4d7cfd-70c1-48c2-8a7d-77b8988efcc1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:52.055638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b4d7cfd-70c1-48c2-8a7d-77b8988efcc1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:52.579506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8b4d7cfd-70c1-48c2-8a7d-77b8988efcc1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:52.599977 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8b4d7cfd-70c1-48c2-8a7d-77b8988efcc1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1518 microversion: 2.1 time: 0.561251 Oct 10 23:43:52.635406 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2472/5124] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:52 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1518 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:52.650721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8484d960-205b-47c5-8d73-4aff230b5d12 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:52.651814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8484d960-205b-47c5-8d73-4aff230b5d12 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:52.663667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8484d960-205b-47c5-8d73-4aff230b5d12 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:52.664309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8484d960-205b-47c5-8d73-4aff230b5d12 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:52.664859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8484d960-205b-47c5-8d73-4aff230b5d12 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:52.665885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8484d960-205b-47c5-8d73-4aff230b5d12 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:52.666617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8484d960-205b-47c5-8d73-4aff230b5d12 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:52.667496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8484d960-205b-47c5-8d73-4aff230b5d12 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:52.700933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-1f37c0b1-b47d-406a-8d9c-33c8210f4f1d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:43:52.702105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-1f37c0b1-b47d-406a-8d9c-33c8210f4f1d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:43:52.702328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-1f37c0b1-b47d-406a-8d9c-33c8210f4f1d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:43:52.702885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-1f37c0b1-b47d-406a-8d9c-33c8210f4f1d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:43:52.703350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-1f37c0b1-b47d-406a-8d9c-33c8210f4f1d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:43:52.732496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f37c0b1-b47d-406a-8d9c-33c8210f4f1d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:52.738031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f37c0b1-b47d-406a-8d9c-33c8210f4f1d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:52.739011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f37c0b1-b47d-406a-8d9c-33c8210f4f1d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:52.740098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f37c0b1-b47d-406a-8d9c-33c8210f4f1d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:52.741352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f37c0b1-b47d-406a-8d9c-33c8210f4f1d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:52.741990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f37c0b1-b47d-406a-8d9c-33c8210f4f1d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:52.806676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-1f37c0b1-b47d-406a-8d9c-33c8210f4f1d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Getting quotas for project a087b5d73d9240e3b5330975a2b39ea0. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:43:52.840018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-1f37c0b1-b47d-406a-8d9c-33c8210f4f1d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Getting quotas for user 2613b3445bde4bd6b8a350f594458490 and project a087b5d73d9240e3b5330975a2b39ea0. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:43:52.864258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1f37c0b1-b47d-406a-8d9c-33c8210f4f1d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:43:52.873097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1f37c0b1-b47d-406a-8d9c-33c8210f4f1d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 1f082ddb-a09e-4a05-9233-108fa544b12b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:43:52.989653 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1f37c0b1-b47d-406a-8d9c-33c8210f4f1d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.964165 Oct 10 23:43:52.990769 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2653/5125] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:43:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:43:53.001420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c0d5b8e0-ccec-4701-a9d4-e766c717986f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:53.004099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c0d5b8e0-ccec-4701-a9d4-e766c717986f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:53.049012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0d5b8e0-ccec-4701-a9d4-e766c717986f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:53.049553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0d5b8e0-ccec-4701-a9d4-e766c717986f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:53.050000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0d5b8e0-ccec-4701-a9d4-e766c717986f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:53.050785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0d5b8e0-ccec-4701-a9d4-e766c717986f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:53.059686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0d5b8e0-ccec-4701-a9d4-e766c717986f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:53.062807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0d5b8e0-ccec-4701-a9d4-e766c717986f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:54.104063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c0d5b8e0-ccec-4701-a9d4-e766c717986f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:54.136220 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c0d5b8e0-ccec-4701-a9d4-e766c717986f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1683 microversion: 2.1 time: 1.143640 Oct 10 23:43:54.144025 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2654/5126] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:52 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1683 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:54.171514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8e85251d-1ac6-4b8f-87c9-cbb977f55268 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:54.173445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8e85251d-1ac6-4b8f-87c9-cbb977f55268 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 1f082ddb-a09e-4a05-9233-108fa544b12b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:54.202312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e85251d-1ac6-4b8f-87c9-cbb977f55268 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:54.221839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e85251d-1ac6-4b8f-87c9-cbb977f55268 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:54.222402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e85251d-1ac6-4b8f-87c9-cbb977f55268 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:54.223173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e85251d-1ac6-4b8f-87c9-cbb977f55268 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:54.223639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e85251d-1ac6-4b8f-87c9-cbb977f55268 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:54.224265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e85251d-1ac6-4b8f-87c9-cbb977f55268 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:54.385738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8484d960-205b-47c5-8d73-4aff230b5d12 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:54.396288 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8484d960-205b-47c5-8d73-4aff230b5d12 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1513 microversion: 2.1 time: 1.759364 Oct 10 23:43:54.396889 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2473/5127] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:52 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1513 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:54.423123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-28f1bf00-011c-4151-b860-1f35e21444f9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:54.423761 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-28f1bf00-011c-4151-b860-1f35e21444f9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:54.439034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28f1bf00-011c-4151-b860-1f35e21444f9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:54.440405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28f1bf00-011c-4151-b860-1f35e21444f9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:54.441203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28f1bf00-011c-4151-b860-1f35e21444f9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:54.445081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28f1bf00-011c-4151-b860-1f35e21444f9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:54.445786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28f1bf00-011c-4151-b860-1f35e21444f9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:54.446722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28f1bf00-011c-4151-b860-1f35e21444f9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:54.504915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8e85251d-1ac6-4b8f-87c9-cbb977f55268 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:54.514697 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8e85251d-1ac6-4b8f-87c9-cbb977f55268 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b" status: 200 len: 1223 microversion: 2.1 time: 0.368102 Oct 10 23:43:54.524880 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2655/5128] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:54 2022] GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b => generated 1223 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:55.048005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-28f1bf00-011c-4151-b860-1f35e21444f9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:55.070487 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-28f1bf00-011c-4151-b860-1f35e21444f9 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1518 microversion: 2.1 time: 0.662023 Oct 10 23:43:55.072970 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2474/5129] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:54 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1518 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:55.180432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e4f336e0-c59d-408d-bede-6ab29c2cd897 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:55.181229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e4f336e0-c59d-408d-bede-6ab29c2cd897 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:55.198423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4f336e0-c59d-408d-bede-6ab29c2cd897 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:55.201007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4f336e0-c59d-408d-bede-6ab29c2cd897 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:55.203287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4f336e0-c59d-408d-bede-6ab29c2cd897 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:55.208827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4f336e0-c59d-408d-bede-6ab29c2cd897 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:55.209810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4f336e0-c59d-408d-bede-6ab29c2cd897 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:55.211396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4f336e0-c59d-408d-bede-6ab29c2cd897 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:55.427985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-30629251-a160-48b2-9b1c-43b4d19fee12 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:55.429147 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-30629251-a160-48b2-9b1c-43b4d19fee12 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:55.462582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30629251-a160-48b2-9b1c-43b4d19fee12 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:55.463127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30629251-a160-48b2-9b1c-43b4d19fee12 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:55.465820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30629251-a160-48b2-9b1c-43b4d19fee12 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:55.469118 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30629251-a160-48b2-9b1c-43b4d19fee12 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:55.470658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30629251-a160-48b2-9b1c-43b4d19fee12 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:55.471277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30629251-a160-48b2-9b1c-43b4d19fee12 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:55.802827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e4f336e0-c59d-408d-bede-6ab29c2cd897 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:55.823408 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e4f336e0-c59d-408d-bede-6ab29c2cd897 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1683 microversion: 2.1 time: 0.647074 Oct 10 23:43:55.827527 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2656/5130] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:55 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1683 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:55.832750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5024b8b2-7bb6-4686-814c-624ee8616088 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:55.833774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5024b8b2-7bb6-4686-814c-624ee8616088 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 1f082ddb-a09e-4a05-9233-108fa544b12b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:55.854515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5024b8b2-7bb6-4686-814c-624ee8616088 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:55.861978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5024b8b2-7bb6-4686-814c-624ee8616088 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:55.862730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5024b8b2-7bb6-4686-814c-624ee8616088 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:55.863700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5024b8b2-7bb6-4686-814c-624ee8616088 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:55.864536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5024b8b2-7bb6-4686-814c-624ee8616088 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:55.865142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5024b8b2-7bb6-4686-814c-624ee8616088 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:55.992654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5024b8b2-7bb6-4686-814c-624ee8616088 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:56.001804 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5024b8b2-7bb6-4686-814c-624ee8616088 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b" status: 200 len: 1277 microversion: 2.1 time: 0.172878 Oct 10 23:43:56.008397 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2657/5131] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:55 2022] GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:56.100423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e205927f-5d54-4f37-a509-3bfbd19496ac tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:56.101058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e205927f-5d54-4f37-a509-3bfbd19496ac tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:56.108783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e205927f-5d54-4f37-a509-3bfbd19496ac tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:56.114361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e205927f-5d54-4f37-a509-3bfbd19496ac tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:56.115219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e205927f-5d54-4f37-a509-3bfbd19496ac tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:56.116153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e205927f-5d54-4f37-a509-3bfbd19496ac tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:56.116799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e205927f-5d54-4f37-a509-3bfbd19496ac tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:56.117424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e205927f-5d54-4f37-a509-3bfbd19496ac tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:56.293927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-30629251-a160-48b2-9b1c-43b4d19fee12 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:56.321862 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-30629251-a160-48b2-9b1c-43b4d19fee12 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1513 microversion: 2.1 time: 0.883005 Oct 10 23:43:56.337122 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2475/5132] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:55 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1513 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:56.827387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e205927f-5d54-4f37-a509-3bfbd19496ac tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:56.839281 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e205927f-5d54-4f37-a509-3bfbd19496ac tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1518 microversion: 2.1 time: 0.743215 Oct 10 23:43:56.849336 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2658/5133] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:56 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1518 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:56.852422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-471fb715-0c11-42d0-8153-40aacbd3afc4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:56.853056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-471fb715-0c11-42d0-8153-40aacbd3afc4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:56.864755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-471fb715-0c11-42d0-8153-40aacbd3afc4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:56.865631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-471fb715-0c11-42d0-8153-40aacbd3afc4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:56.866376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-471fb715-0c11-42d0-8153-40aacbd3afc4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:56.867387 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-471fb715-0c11-42d0-8153-40aacbd3afc4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:56.868108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-471fb715-0c11-42d0-8153-40aacbd3afc4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:56.868795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-471fb715-0c11-42d0-8153-40aacbd3afc4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:57.043545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6aa45db3-214c-4331-90bd-0783e4185768 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:57.044236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6aa45db3-214c-4331-90bd-0783e4185768 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 1f082ddb-a09e-4a05-9233-108fa544b12b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:57.059971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6aa45db3-214c-4331-90bd-0783e4185768 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:57.060844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6aa45db3-214c-4331-90bd-0783e4185768 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:57.064087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6aa45db3-214c-4331-90bd-0783e4185768 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:57.065842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6aa45db3-214c-4331-90bd-0783e4185768 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:57.066645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6aa45db3-214c-4331-90bd-0783e4185768 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:57.068507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6aa45db3-214c-4331-90bd-0783e4185768 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:57.236825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6aa45db3-214c-4331-90bd-0783e4185768 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:57.251569 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6aa45db3-214c-4331-90bd-0783e4185768 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b" status: 200 len: 1277 microversion: 2.1 time: 0.211997 Oct 10 23:43:57.252814 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2659/5134] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:57 2022] GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b => generated 1277 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:57.347867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fac2028a-4162-424b-bf07-795986082565 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:57.348481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fac2028a-4162-424b-bf07-795986082565 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:57.360675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fac2028a-4162-424b-bf07-795986082565 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:57.361184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fac2028a-4162-424b-bf07-795986082565 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:57.362640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fac2028a-4162-424b-bf07-795986082565 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:57.367668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fac2028a-4162-424b-bf07-795986082565 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:57.369346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fac2028a-4162-424b-bf07-795986082565 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:57.370328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fac2028a-4162-424b-bf07-795986082565 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:57.383748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:43:57.834031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fac2028a-4162-424b-bf07-795986082565 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:57.848655 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fac2028a-4162-424b-bf07-795986082565 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1513 microversion: 2.1 time: 0.505041 Oct 10 23:43:57.849256 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2660/5135] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:57 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1513 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:57.867499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c93d7c07-afaf-4dd9-bc58-cc5a0c4487c0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:57.872508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c93d7c07-afaf-4dd9-bc58-cc5a0c4487c0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:57.882102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c93d7c07-afaf-4dd9-bc58-cc5a0c4487c0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:57.882693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c93d7c07-afaf-4dd9-bc58-cc5a0c4487c0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:57.883170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c93d7c07-afaf-4dd9-bc58-cc5a0c4487c0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:57.883880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c93d7c07-afaf-4dd9-bc58-cc5a0c4487c0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:57.884341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c93d7c07-afaf-4dd9-bc58-cc5a0c4487c0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:57.884766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c93d7c07-afaf-4dd9-bc58-cc5a0c4487c0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:57.996596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-471fb715-0c11-42d0-8153-40aacbd3afc4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:58.029278 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-471fb715-0c11-42d0-8153-40aacbd3afc4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1683 microversion: 2.1 time: 1.180610 Oct 10 23:43:58.030670 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2476/5136] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:56 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1683 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:58.280690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-340603ba-faa6-4edc-bbec-48a61f8bab1a tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:58.282734 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-340603ba-faa6-4edc-bbec-48a61f8bab1a tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 1f082ddb-a09e-4a05-9233-108fa544b12b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:58.310018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-340603ba-faa6-4edc-bbec-48a61f8bab1a tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:58.312816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-340603ba-faa6-4edc-bbec-48a61f8bab1a tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:58.316739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-340603ba-faa6-4edc-bbec-48a61f8bab1a tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:58.319903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-340603ba-faa6-4edc-bbec-48a61f8bab1a tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:58.327856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c93d7c07-afaf-4dd9-bc58-cc5a0c4487c0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:58.337722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-340603ba-faa6-4edc-bbec-48a61f8bab1a tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:58.340300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-340603ba-faa6-4edc-bbec-48a61f8bab1a tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:58.370004 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c93d7c07-afaf-4dd9-bc58-cc5a0c4487c0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1518 microversion: 2.1 time: 0.500961 Oct 10 23:43:58.390292 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2661/5137] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:57 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1518 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:43:58.426230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:43:58.825983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-340603ba-faa6-4edc-bbec-48a61f8bab1a tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:58.838451 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-340603ba-faa6-4edc-bbec-48a61f8bab1a tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b" status: 200 len: 1319 microversion: 2.1 time: 0.564554 Oct 10 23:43:58.854538 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2477/5138] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:58 2022] GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b => generated 1319 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:58.878236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3713d2c4-df41-44a2-9df4-d8d9ba882715 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:58.879729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3713d2c4-df41-44a2-9df4-d8d9ba882715 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:58.883418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:43:58.902180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3713d2c4-df41-44a2-9df4-d8d9ba882715 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:58.903115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3713d2c4-df41-44a2-9df4-d8d9ba882715 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:58.904025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3713d2c4-df41-44a2-9df4-d8d9ba882715 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:58.906738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3713d2c4-df41-44a2-9df4-d8d9ba882715 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:58.907628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3713d2c4-df41-44a2-9df4-d8d9ba882715 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:58.908427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3713d2c4-df41-44a2-9df4-d8d9ba882715 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:59.068405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7bba145d-2a66-4635-a606-3672c274b5ad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:59.070972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7bba145d-2a66-4635-a606-3672c274b5ad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:59.096837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bba145d-2a66-4635-a606-3672c274b5ad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:59.097845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bba145d-2a66-4635-a606-3672c274b5ad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:59.098569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bba145d-2a66-4635-a606-3672c274b5ad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:59.099550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bba145d-2a66-4635-a606-3672c274b5ad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:59.100499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bba145d-2a66-4635-a606-3672c274b5ad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:59.103700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bba145d-2a66-4635-a606-3672c274b5ad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:59.483498 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7bba145d-2a66-4635-a606-3672c274b5ad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:59.497050 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7bba145d-2a66-4635-a606-3672c274b5ad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1683 microversion: 2.1 time: 0.435044 Oct 10 23:43:59.514044 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2478/5139] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:59 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1683 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:59.521300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fa64e0fb-72ba-48a8-9f86-da5e715f33d7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:59.521995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fa64e0fb-72ba-48a8-9f86-da5e715f33d7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:59.528476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa64e0fb-72ba-48a8-9f86-da5e715f33d7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:59.528976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa64e0fb-72ba-48a8-9f86-da5e715f33d7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:59.529441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa64e0fb-72ba-48a8-9f86-da5e715f33d7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:59.530822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa64e0fb-72ba-48a8-9f86-da5e715f33d7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:59.531223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa64e0fb-72ba-48a8-9f86-da5e715f33d7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:59.531655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa64e0fb-72ba-48a8-9f86-da5e715f33d7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:59.898170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3713d2c4-df41-44a2-9df4-d8d9ba882715 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:43:59.908145 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3713d2c4-df41-44a2-9df4-d8d9ba882715 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1513 microversion: 2.1 time: 1.038844 Oct 10 23:43:59.909471 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2662/5140] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:58 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1513 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:43:59.926000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a6390b79-e02e-4252-8b46-060dcae705e4 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:43:59.926626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a6390b79-e02e-4252-8b46-060dcae705e4 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 1f082ddb-a09e-4a05-9233-108fa544b12b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:43:59.942476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6390b79-e02e-4252-8b46-060dcae705e4 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:59.943018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6390b79-e02e-4252-8b46-060dcae705e4 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:59.943488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6390b79-e02e-4252-8b46-060dcae705e4 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:43:59.944194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6390b79-e02e-4252-8b46-060dcae705e4 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:43:59.944652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6390b79-e02e-4252-8b46-060dcae705e4 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:43:59.945080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a6390b79-e02e-4252-8b46-060dcae705e4 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:00.544101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fa64e0fb-72ba-48a8-9f86-da5e715f33d7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:00.567670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a6390b79-e02e-4252-8b46-060dcae705e4 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:00.579366 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a6390b79-e02e-4252-8b46-060dcae705e4 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b" status: 200 len: 1319 microversion: 2.1 time: 0.669422 Oct 10 23:44:00.582358 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2663/5141] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:59 2022] GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b => generated 1319 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:00.589657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e0705c72-b2bb-4410-bfe7-1e78a3b6e9a6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:00.595212 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fa64e0fb-72ba-48a8-9f86-da5e715f33d7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1518 microversion: 2.1 time: 1.071962 Oct 10 23:44:00.596309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e0705c72-b2bb-4410-bfe7-1e78a3b6e9a6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:00.605537 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2479/5142] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:43:59 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1518 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:00.619368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0705c72-b2bb-4410-bfe7-1e78a3b6e9a6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:00.619699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0705c72-b2bb-4410-bfe7-1e78a3b6e9a6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:00.620142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0705c72-b2bb-4410-bfe7-1e78a3b6e9a6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:00.620856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0705c72-b2bb-4410-bfe7-1e78a3b6e9a6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:00.621556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0705c72-b2bb-4410-bfe7-1e78a3b6e9a6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:00.621982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0705c72-b2bb-4410-bfe7-1e78a3b6e9a6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:00.904446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e0705c72-b2bb-4410-bfe7-1e78a3b6e9a6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:00.923001 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e0705c72-b2bb-4410-bfe7-1e78a3b6e9a6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1683 microversion: 2.1 time: 0.338788 Oct 10 23:44:00.924293 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2664/5143] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:00 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1683 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:00.947797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ed2265d5-838d-45f5-8f3c-fcb3498ad75d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:00.949171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ed2265d5-838d-45f5-8f3c-fcb3498ad75d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:00.960810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed2265d5-838d-45f5-8f3c-fcb3498ad75d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:00.964257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed2265d5-838d-45f5-8f3c-fcb3498ad75d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:00.965160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed2265d5-838d-45f5-8f3c-fcb3498ad75d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:00.966132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed2265d5-838d-45f5-8f3c-fcb3498ad75d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:00.968009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed2265d5-838d-45f5-8f3c-fcb3498ad75d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:00.970634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed2265d5-838d-45f5-8f3c-fcb3498ad75d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:01.317714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ed2265d5-838d-45f5-8f3c-fcb3498ad75d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:01.330149 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ed2265d5-838d-45f5-8f3c-fcb3498ad75d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1513 microversion: 2.1 time: 0.387153 Oct 10 23:44:01.331342 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2480/5144] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:00 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1513 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:01.606044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-da48c0ac-c068-44cb-8299-d7f5b2f66410 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:01.606902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-da48c0ac-c068-44cb-8299-d7f5b2f66410 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 1f082ddb-a09e-4a05-9233-108fa544b12b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:01.622399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da48c0ac-c068-44cb-8299-d7f5b2f66410 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:01.623025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da48c0ac-c068-44cb-8299-d7f5b2f66410 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:01.627562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da48c0ac-c068-44cb-8299-d7f5b2f66410 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:01.628883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da48c0ac-c068-44cb-8299-d7f5b2f66410 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:01.629588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da48c0ac-c068-44cb-8299-d7f5b2f66410 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:01.630902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da48c0ac-c068-44cb-8299-d7f5b2f66410 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:01.645230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-42c1756b-c714-4d21-a9c1-8af4d0ddb55e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:01.646578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-42c1756b-c714-4d21-a9c1-8af4d0ddb55e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:01.668593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42c1756b-c714-4d21-a9c1-8af4d0ddb55e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:01.669173 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42c1756b-c714-4d21-a9c1-8af4d0ddb55e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:01.669671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42c1756b-c714-4d21-a9c1-8af4d0ddb55e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:01.670955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42c1756b-c714-4d21-a9c1-8af4d0ddb55e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:01.671500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42c1756b-c714-4d21-a9c1-8af4d0ddb55e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:01.672054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42c1756b-c714-4d21-a9c1-8af4d0ddb55e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:02.234558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-da48c0ac-c068-44cb-8299-d7f5b2f66410 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:02.249962 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-da48c0ac-c068-44cb-8299-d7f5b2f66410 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b" status: 200 len: 1319 microversion: 2.1 time: 0.645480 Oct 10 23:44:02.252914 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2665/5145] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:01 2022] GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b => generated 1319 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:02.265164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-34dc473a-064a-4112-adb0-f4d1d63608de tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:02.266862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-34dc473a-064a-4112-adb0-f4d1d63608de tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:02.292792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34dc473a-064a-4112-adb0-f4d1d63608de tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:02.294171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34dc473a-064a-4112-adb0-f4d1d63608de tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:02.295209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34dc473a-064a-4112-adb0-f4d1d63608de tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:02.297676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34dc473a-064a-4112-adb0-f4d1d63608de tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:02.299750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34dc473a-064a-4112-adb0-f4d1d63608de tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:02.303863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34dc473a-064a-4112-adb0-f4d1d63608de tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:02.437649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-42c1756b-c714-4d21-a9c1-8af4d0ddb55e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:02.449690 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-42c1756b-c714-4d21-a9c1-8af4d0ddb55e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1518 microversion: 2.1 time: 0.808737 Oct 10 23:44:02.485748 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2481/5146] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:01 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1518 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:02.494796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7699de64-5073-4ad1-b9ad-37d8314c643b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:02.495913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7699de64-5073-4ad1-b9ad-37d8314c643b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:02.525649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7699de64-5073-4ad1-b9ad-37d8314c643b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:02.527300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7699de64-5073-4ad1-b9ad-37d8314c643b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:02.529046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7699de64-5073-4ad1-b9ad-37d8314c643b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:02.530989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7699de64-5073-4ad1-b9ad-37d8314c643b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:02.531978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7699de64-5073-4ad1-b9ad-37d8314c643b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:02.532697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7699de64-5073-4ad1-b9ad-37d8314c643b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:02.787641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:44:02.820206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-34dc473a-064a-4112-adb0-f4d1d63608de tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:02.867200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:44:02.876039 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-34dc473a-064a-4112-adb0-f4d1d63608de tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1683 microversion: 2.1 time: 0.617790 Oct 10 23:44:02.876958 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2666/5147] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:02 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1683 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:02.892355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-4e1e8408-a54c-413a-a9e2-90837eb749a6 req-2b08b08c-325e-46d3-bf6b-caeb5c501aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f082ddb-a09e-4a05-9233-108fa544b12b", "tag": "65cde77b-3347-4ce5-be55-d7afe6504321"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:44:02.908216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4e1e8408-a54c-413a-a9e2-90837eb749a6 req-2b08b08c-325e-46d3-bf6b-caeb5c501aa0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:02.909011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4e1e8408-a54c-413a-a9e2-90837eb749a6 req-2b08b08c-325e-46d3-bf6b-caeb5c501aa0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:02.909724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4e1e8408-a54c-413a-a9e2-90837eb749a6 req-2b08b08c-325e-46d3-bf6b-caeb5c501aa0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:02.934776 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-4e1e8408-a54c-413a-a9e2-90837eb749a6 req-2b08b08c-325e-46d3-bf6b-caeb5c501aa0 service nova] Creating event network-changed:65cde77b-3347-4ce5-be55-d7afe6504321 for instance 1f082ddb-a09e-4a05-9233-108fa544b12b on n-h1-860864-2 Oct 10 23:44:02.950035 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-4e1e8408-a54c-413a-a9e2-90837eb749a6 req-2b08b08c-325e-46d3-bf6b-caeb5c501aa0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068617 Oct 10 23:44:02.950871 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2667/5148] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:44:03.290224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-16e31160-c60b-4053-b06d-d5459ff95084 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:03.291078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-16e31160-c60b-4053-b06d-d5459ff95084 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 1f082ddb-a09e-4a05-9233-108fa544b12b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:03.327457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16e31160-c60b-4053-b06d-d5459ff95084 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:03.329777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16e31160-c60b-4053-b06d-d5459ff95084 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:03.331293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16e31160-c60b-4053-b06d-d5459ff95084 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:03.335517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16e31160-c60b-4053-b06d-d5459ff95084 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:03.340370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16e31160-c60b-4053-b06d-d5459ff95084 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:03.341434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16e31160-c60b-4053-b06d-d5459ff95084 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:03.873280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7699de64-5073-4ad1-b9ad-37d8314c643b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:03.886399 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7699de64-5073-4ad1-b9ad-37d8314c643b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1534 microversion: 2.1 time: 1.396693 Oct 10 23:44:03.890547 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2482/5149] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:02 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1534 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:03.897477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-16e31160-c60b-4053-b06d-d5459ff95084 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:03.904984 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-11f95f20-02dd-4791-aa99-a4e8cd0a1bf8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:03.923147 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-16e31160-c60b-4053-b06d-d5459ff95084 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b" status: 200 len: 1319 microversion: 2.1 time: 0.641730 Oct 10 23:44:03.924197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-11f95f20-02dd-4791-aa99-a4e8cd0a1bf8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:03.924989 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2668/5150] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:03 2022] GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b => generated 1319 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:03.935738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e7c667f4-0e76-4f0a-b4ac-930b97f78dd3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:03.946987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11f95f20-02dd-4791-aa99-a4e8cd0a1bf8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:03.950506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e7c667f4-0e76-4f0a-b4ac-930b97f78dd3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:03.961175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7c667f4-0e76-4f0a-b4ac-930b97f78dd3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:03.962218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7c667f4-0e76-4f0a-b4ac-930b97f78dd3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:03.963386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7c667f4-0e76-4f0a-b4ac-930b97f78dd3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:03.965625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7c667f4-0e76-4f0a-b4ac-930b97f78dd3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:03.966217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11f95f20-02dd-4791-aa99-a4e8cd0a1bf8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:03.966980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11f95f20-02dd-4791-aa99-a4e8cd0a1bf8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:03.968168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11f95f20-02dd-4791-aa99-a4e8cd0a1bf8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:03.968800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11f95f20-02dd-4791-aa99-a4e8cd0a1bf8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:03.969457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11f95f20-02dd-4791-aa99-a4e8cd0a1bf8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:03.970757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7c667f4-0e76-4f0a-b4ac-930b97f78dd3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:03.971777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7c667f4-0e76-4f0a-b4ac-930b97f78dd3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:04.290735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e7c667f4-0e76-4f0a-b4ac-930b97f78dd3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:04.305539 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e7c667f4-0e76-4f0a-b4ac-930b97f78dd3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1683 microversion: 2.1 time: 0.374020 Oct 10 23:44:04.309031 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2669/5151] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:03 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1683 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:04.387949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-11f95f20-02dd-4791-aa99-a4e8cd0a1bf8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:04.404790 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-11f95f20-02dd-4791-aa99-a4e8cd0a1bf8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1518 microversion: 2.1 time: 0.512781 Oct 10 23:44:04.410116 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2483/5152] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:03 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1518 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:04.914394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2b8fcc53-fa8f-45c2-ad3b-381315288991 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:04.915020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2b8fcc53-fa8f-45c2-ad3b-381315288991 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:04.932805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b8fcc53-fa8f-45c2-ad3b-381315288991 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:04.933360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b8fcc53-fa8f-45c2-ad3b-381315288991 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:04.934595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b8fcc53-fa8f-45c2-ad3b-381315288991 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:04.937148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b8fcc53-fa8f-45c2-ad3b-381315288991 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:04.938053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b8fcc53-fa8f-45c2-ad3b-381315288991 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:04.938699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b8fcc53-fa8f-45c2-ad3b-381315288991 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:04.955820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-63fa5abd-de31-4fc0-9940-8692724cdc6f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:04.956574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-63fa5abd-de31-4fc0-9940-8692724cdc6f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 1f082ddb-a09e-4a05-9233-108fa544b12b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:04.993012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63fa5abd-de31-4fc0-9940-8692724cdc6f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:04.995874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63fa5abd-de31-4fc0-9940-8692724cdc6f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:04.996886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63fa5abd-de31-4fc0-9940-8692724cdc6f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:05.001467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63fa5abd-de31-4fc0-9940-8692724cdc6f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:05.002257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63fa5abd-de31-4fc0-9940-8692724cdc6f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:05.022540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-63fa5abd-de31-4fc0-9940-8692724cdc6f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:05.612274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-63fa5abd-de31-4fc0-9940-8692724cdc6f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:05.638372 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-63fa5abd-de31-4fc0-9940-8692724cdc6f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b" status: 200 len: 1319 microversion: 2.1 time: 0.686589 Oct 10 23:44:05.658111 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2484/5153] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:04 2022] GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b => generated 1319 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:05.667082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-53fa05bf-c638-4905-9e95-957f0ac43b8a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:05.668854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-53fa05bf-c638-4905-9e95-957f0ac43b8a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:05.680988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53fa05bf-c638-4905-9e95-957f0ac43b8a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:05.682486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53fa05bf-c638-4905-9e95-957f0ac43b8a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:05.683097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53fa05bf-c638-4905-9e95-957f0ac43b8a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:05.685193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53fa05bf-c638-4905-9e95-957f0ac43b8a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:05.686818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53fa05bf-c638-4905-9e95-957f0ac43b8a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:05.687604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53fa05bf-c638-4905-9e95-957f0ac43b8a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:05.713902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2b8fcc53-fa8f-45c2-ad3b-381315288991 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:05.727740 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2b8fcc53-fa8f-45c2-ad3b-381315288991 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1529 microversion: 2.1 time: 0.817464 Oct 10 23:44:05.730303 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2670/5154] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:04 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1529 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:05.758420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-abe1c818-3a9d-4073-bc0c-af38fd24abd8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:05.767211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-abe1c818-3a9d-4073-bc0c-af38fd24abd8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:05.791151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abe1c818-3a9d-4073-bc0c-af38fd24abd8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:05.799081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abe1c818-3a9d-4073-bc0c-af38fd24abd8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:05.799876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abe1c818-3a9d-4073-bc0c-af38fd24abd8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:05.802229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abe1c818-3a9d-4073-bc0c-af38fd24abd8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:05.805124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abe1c818-3a9d-4073-bc0c-af38fd24abd8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:05.807214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abe1c818-3a9d-4073-bc0c-af38fd24abd8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:06.322695 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-53fa05bf-c638-4905-9e95-957f0ac43b8a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:06.345261 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-53fa05bf-c638-4905-9e95-957f0ac43b8a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1683 microversion: 2.1 time: 0.685848 Oct 10 23:44:06.351804 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2485/5155] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:05 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1683 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:06.481802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-abe1c818-3a9d-4073-bc0c-af38fd24abd8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:06.518151 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-abe1c818-3a9d-4073-bc0c-af38fd24abd8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1518 microversion: 2.1 time: 0.780566 Oct 10 23:44:06.520581 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2671/5156] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:05 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1518 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:06.675444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3d365279-b1dd-45a9-8020-aec02123c6e3 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:06.676114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3d365279-b1dd-45a9-8020-aec02123c6e3 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 1f082ddb-a09e-4a05-9233-108fa544b12b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:06.698905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d365279-b1dd-45a9-8020-aec02123c6e3 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:06.703986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d365279-b1dd-45a9-8020-aec02123c6e3 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:06.704453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d365279-b1dd-45a9-8020-aec02123c6e3 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:06.705204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d365279-b1dd-45a9-8020-aec02123c6e3 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:06.705694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d365279-b1dd-45a9-8020-aec02123c6e3 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:06.706130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3d365279-b1dd-45a9-8020-aec02123c6e3 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:06.760296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f5794378-e783-44ba-a953-86b470f198b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:06.761112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f5794378-e783-44ba-a953-86b470f198b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:06.788467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5794378-e783-44ba-a953-86b470f198b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:06.789435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5794378-e783-44ba-a953-86b470f198b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:06.792425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5794378-e783-44ba-a953-86b470f198b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:06.799809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5794378-e783-44ba-a953-86b470f198b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:06.800692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5794378-e783-44ba-a953-86b470f198b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:06.801612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5794378-e783-44ba-a953-86b470f198b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:07.400321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3d365279-b1dd-45a9-8020-aec02123c6e3 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:07.414564 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3d365279-b1dd-45a9-8020-aec02123c6e3 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b" status: 200 len: 1319 microversion: 2.1 time: 0.745370 Oct 10 23:44:07.432255 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2486/5157] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:06 2022] GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b => generated 1319 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:07.457624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6e77669a-0c9e-4e38-b4ad-30998f70280e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:07.458443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6e77669a-0c9e-4e38-b4ad-30998f70280e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:07.475480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e77669a-0c9e-4e38-b4ad-30998f70280e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:07.478205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e77669a-0c9e-4e38-b4ad-30998f70280e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:07.481512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e77669a-0c9e-4e38-b4ad-30998f70280e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:07.486165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e77669a-0c9e-4e38-b4ad-30998f70280e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:07.486982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e77669a-0c9e-4e38-b4ad-30998f70280e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:07.489828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e77669a-0c9e-4e38-b4ad-30998f70280e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:07.805431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f5794378-e783-44ba-a953-86b470f198b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:07.821946 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f5794378-e783-44ba-a953-86b470f198b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1529 microversion: 2.1 time: 1.069147 Oct 10 23:44:07.828958 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2672/5158] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:06 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1529 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:07.835862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-21160524-90b3-487f-8966-46d1e0e6dc48 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:07.846437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-21160524-90b3-487f-8966-46d1e0e6dc48 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:07.880626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21160524-90b3-487f-8966-46d1e0e6dc48 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:07.881131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21160524-90b3-487f-8966-46d1e0e6dc48 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:07.881604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21160524-90b3-487f-8966-46d1e0e6dc48 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:07.882343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21160524-90b3-487f-8966-46d1e0e6dc48 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:07.882790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21160524-90b3-487f-8966-46d1e0e6dc48 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:07.890506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21160524-90b3-487f-8966-46d1e0e6dc48 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:08.271338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6e77669a-0c9e-4e38-b4ad-30998f70280e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:08.281581 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6e77669a-0c9e-4e38-b4ad-30998f70280e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1683 microversion: 2.1 time: 0.847790 Oct 10 23:44:08.302677 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2487/5159] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:07 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1683 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:08.312990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-b76e30b5-5d66-4557-806e-0ad3283035ea req-f56ab92c-0c48-4d2f-b14c-8e46aae63265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc9e449-6324-411e-8af9-0533b23a4e3c", "name": "network-vif-plugged", "status": "completed", "tag": "c8d69949-457f-46f6-9402-4c349227f0a2"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:44:08.327833 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b76e30b5-5d66-4557-806e-0ad3283035ea req-f56ab92c-0c48-4d2f-b14c-8e46aae63265 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:08.332944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b76e30b5-5d66-4557-806e-0ad3283035ea req-f56ab92c-0c48-4d2f-b14c-8e46aae63265 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:08.333869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b76e30b5-5d66-4557-806e-0ad3283035ea req-f56ab92c-0c48-4d2f-b14c-8e46aae63265 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:08.356966 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-b76e30b5-5d66-4557-806e-0ad3283035ea req-f56ab92c-0c48-4d2f-b14c-8e46aae63265 service nova] Creating event network-vif-plugged:c8d69949-457f-46f6-9402-4c349227f0a2 for instance efc9e449-6324-411e-8af9-0533b23a4e3c on n-h2-860864-2 Oct 10 23:44:08.364469 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-b76e30b5-5d66-4557-806e-0ad3283035ea req-f56ab92c-0c48-4d2f-b14c-8e46aae63265 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059968 Oct 10 23:44:08.366364 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2488/5160] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:44:08.444939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-50f670d0-bc44-4c1f-878e-276410db1609 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:08.445689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-50f670d0-bc44-4c1f-878e-276410db1609 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 1f082ddb-a09e-4a05-9233-108fa544b12b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:08.486942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50f670d0-bc44-4c1f-878e-276410db1609 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:08.490260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50f670d0-bc44-4c1f-878e-276410db1609 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:08.491650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50f670d0-bc44-4c1f-878e-276410db1609 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:08.497562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50f670d0-bc44-4c1f-878e-276410db1609 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:08.498254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50f670d0-bc44-4c1f-878e-276410db1609 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:08.503818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50f670d0-bc44-4c1f-878e-276410db1609 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:09.220438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-50f670d0-bc44-4c1f-878e-276410db1609 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:09.238096 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-50f670d0-bc44-4c1f-878e-276410db1609 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b" status: 200 len: 1319 microversion: 2.1 time: 0.789721 Oct 10 23:44:09.242163 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2489/5161] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:08 2022] GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b => generated 1319 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:09.267305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0e9c5a64-d57c-4b63-81c4-0b755534c455 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:09.267974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0e9c5a64-d57c-4b63-81c4-0b755534c455 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:09.290819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e9c5a64-d57c-4b63-81c4-0b755534c455 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:09.291322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e9c5a64-d57c-4b63-81c4-0b755534c455 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:09.291764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e9c5a64-d57c-4b63-81c4-0b755534c455 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:09.294042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e9c5a64-d57c-4b63-81c4-0b755534c455 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:09.294560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e9c5a64-d57c-4b63-81c4-0b755534c455 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:09.309736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e9c5a64-d57c-4b63-81c4-0b755534c455 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:09.480342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-21160524-90b3-487f-8966-46d1e0e6dc48 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:09.495022 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-21160524-90b3-487f-8966-46d1e0e6dc48 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1518 microversion: 2.1 time: 1.664651 Oct 10 23:44:09.504569 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2673/5162] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:07 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1518 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:09.510892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c93b880b-81b0-4fe4-afb8-d48abaddc48e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:09.512175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c93b880b-81b0-4fe4-afb8-d48abaddc48e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:09.519779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c93b880b-81b0-4fe4-afb8-d48abaddc48e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:09.520582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c93b880b-81b0-4fe4-afb8-d48abaddc48e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:09.521350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c93b880b-81b0-4fe4-afb8-d48abaddc48e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:09.522369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c93b880b-81b0-4fe4-afb8-d48abaddc48e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:09.523113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c93b880b-81b0-4fe4-afb8-d48abaddc48e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:09.523748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c93b880b-81b0-4fe4-afb8-d48abaddc48e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:09.876655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c93b880b-81b0-4fe4-afb8-d48abaddc48e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:09.892234 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c93b880b-81b0-4fe4-afb8-d48abaddc48e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1683 microversion: 2.1 time: 0.386262 Oct 10 23:44:09.892682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0e9c5a64-d57c-4b63-81c4-0b755534c455 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:09.906736 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0e9c5a64-d57c-4b63-81c4-0b755534c455 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1529 microversion: 2.1 time: 0.660120 Oct 10 23:44:09.914479 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2490/5163] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:09 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1529 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:09.915268 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2674/5164] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:09 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1683 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:10.271156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-33b1bc19-52e8-4a43-8593-99d9ba8eda65 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:10.271156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-33b1bc19-52e8-4a43-8593-99d9ba8eda65 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 1f082ddb-a09e-4a05-9233-108fa544b12b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:10.299544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33b1bc19-52e8-4a43-8593-99d9ba8eda65 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:10.303410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33b1bc19-52e8-4a43-8593-99d9ba8eda65 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:10.304303 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33b1bc19-52e8-4a43-8593-99d9ba8eda65 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:10.323108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33b1bc19-52e8-4a43-8593-99d9ba8eda65 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:10.323619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33b1bc19-52e8-4a43-8593-99d9ba8eda65 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:10.324191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33b1bc19-52e8-4a43-8593-99d9ba8eda65 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:10.539258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fa02a3b8-40cf-43a5-9acf-1919fdcdd2e8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:10.542521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fa02a3b8-40cf-43a5-9acf-1919fdcdd2e8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:10.600511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa02a3b8-40cf-43a5-9acf-1919fdcdd2e8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:10.605840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa02a3b8-40cf-43a5-9acf-1919fdcdd2e8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:10.606858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa02a3b8-40cf-43a5-9acf-1919fdcdd2e8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:10.608338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa02a3b8-40cf-43a5-9acf-1919fdcdd2e8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:10.610042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa02a3b8-40cf-43a5-9acf-1919fdcdd2e8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:10.612579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa02a3b8-40cf-43a5-9acf-1919fdcdd2e8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:11.481075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-33b1bc19-52e8-4a43-8593-99d9ba8eda65 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:11.491305 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-33b1bc19-52e8-4a43-8593-99d9ba8eda65 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b" status: 200 len: 1319 microversion: 2.1 time: 1.227418 Oct 10 23:44:11.496451 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2491/5165] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:10 2022] GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b => generated 1319 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:11.512154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4393b028-9466-45c4-a7d9-ecdeaf889924 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:11.515595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4393b028-9466-45c4-a7d9-ecdeaf889924 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:11.545790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4393b028-9466-45c4-a7d9-ecdeaf889924 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:11.551585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4393b028-9466-45c4-a7d9-ecdeaf889924 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:11.560098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4393b028-9466-45c4-a7d9-ecdeaf889924 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:11.561679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4393b028-9466-45c4-a7d9-ecdeaf889924 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:11.566455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4393b028-9466-45c4-a7d9-ecdeaf889924 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:11.567713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4393b028-9466-45c4-a7d9-ecdeaf889924 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:12.018548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fa02a3b8-40cf-43a5-9acf-1919fdcdd2e8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:12.036532 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fa02a3b8-40cf-43a5-9acf-1919fdcdd2e8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1518 microversion: 2.1 time: 1.511235 Oct 10 23:44:12.037152 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2675/5166] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:10 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1518 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:44:12.083806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ee99208b-5603-40c6-bb8a-d6f40c3691b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:12.084447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ee99208b-5603-40c6-bb8a-d6f40c3691b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:12.113627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee99208b-5603-40c6-bb8a-d6f40c3691b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:12.114184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee99208b-5603-40c6-bb8a-d6f40c3691b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:12.116124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee99208b-5603-40c6-bb8a-d6f40c3691b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:12.116874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee99208b-5603-40c6-bb8a-d6f40c3691b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:12.117339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee99208b-5603-40c6-bb8a-d6f40c3691b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:12.117802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee99208b-5603-40c6-bb8a-d6f40c3691b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:12.703071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4393b028-9466-45c4-a7d9-ecdeaf889924 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:12.720155 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4393b028-9466-45c4-a7d9-ecdeaf889924 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1683 microversion: 2.1 time: 1.221618 Oct 10 23:44:12.722879 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2492/5167] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:11 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1683 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:12.740817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6125e80b-74fa-4485-849d-586d6cad4106 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:12.746239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6125e80b-74fa-4485-849d-586d6cad4106 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 1f082ddb-a09e-4a05-9233-108fa544b12b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:12.758707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:44:12.760185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6125e80b-74fa-4485-849d-586d6cad4106 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:12.760718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6125e80b-74fa-4485-849d-586d6cad4106 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:12.761211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6125e80b-74fa-4485-849d-586d6cad4106 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:12.762063 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6125e80b-74fa-4485-849d-586d6cad4106 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:12.766409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6125e80b-74fa-4485-849d-586d6cad4106 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:12.770069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6125e80b-74fa-4485-849d-586d6cad4106 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:12.823645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ee99208b-5603-40c6-bb8a-d6f40c3691b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:12.839405 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ee99208b-5603-40c6-bb8a-d6f40c3691b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1529 microversion: 2.1 time: 0.771596 Oct 10 23:44:12.854050 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2676/5168] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:12 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1529 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:13.069815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cf29532a-84fc-4f91-a0ec-b173c2ba8882 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:13.070527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cf29532a-84fc-4f91-a0ec-b173c2ba8882 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:13.083699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf29532a-84fc-4f91-a0ec-b173c2ba8882 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:13.088344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf29532a-84fc-4f91-a0ec-b173c2ba8882 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:13.088840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf29532a-84fc-4f91-a0ec-b173c2ba8882 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:13.093338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf29532a-84fc-4f91-a0ec-b173c2ba8882 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:13.094422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf29532a-84fc-4f91-a0ec-b173c2ba8882 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:13.095133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf29532a-84fc-4f91-a0ec-b173c2ba8882 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:13.122596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:44:13.654087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cf29532a-84fc-4f91-a0ec-b173c2ba8882 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:13.672385 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cf29532a-84fc-4f91-a0ec-b173c2ba8882 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1518 microversion: 2.1 time: 0.607732 Oct 10 23:44:13.689536 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2677/5169] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:13 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1518 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:13.701002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-d99d5e1c-054a-4507-8ae9-e76ebdeb2a1a req-0f824d3b-b67e-47ab-b5a0-0559af01db9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f082ddb-a09e-4a05-9233-108fa544b12b", "name": "network-vif-plugged", "status": "completed", "tag": "65cde77b-3347-4ce5-be55-d7afe6504321"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:44:13.725402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d99d5e1c-054a-4507-8ae9-e76ebdeb2a1a req-0f824d3b-b67e-47ab-b5a0-0559af01db9c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:13.726876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d99d5e1c-054a-4507-8ae9-e76ebdeb2a1a req-0f824d3b-b67e-47ab-b5a0-0559af01db9c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:13.730749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d99d5e1c-054a-4507-8ae9-e76ebdeb2a1a req-0f824d3b-b67e-47ab-b5a0-0559af01db9c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:13.748988 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-d99d5e1c-054a-4507-8ae9-e76ebdeb2a1a req-0f824d3b-b67e-47ab-b5a0-0559af01db9c service nova] Creating event network-vif-plugged:65cde77b-3347-4ce5-be55-d7afe6504321 for instance 1f082ddb-a09e-4a05-9233-108fa544b12b on n-h1-860864-2 Oct 10 23:44:13.788663 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-d99d5e1c-054a-4507-8ae9-e76ebdeb2a1a req-0f824d3b-b67e-47ab-b5a0-0559af01db9c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097329 Oct 10 23:44:13.789679 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2678/5170] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:44:13.806662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b6ad1f2f-872c-4ce6-acf4-5f4ee6845063 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:13.807671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b6ad1f2f-872c-4ce6-acf4-5f4ee6845063 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:13.851604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6ad1f2f-872c-4ce6-acf4-5f4ee6845063 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:13.853195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6ad1f2f-872c-4ce6-acf4-5f4ee6845063 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:13.855006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6ad1f2f-872c-4ce6-acf4-5f4ee6845063 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:13.856049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6ad1f2f-872c-4ce6-acf4-5f4ee6845063 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:13.858480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6ad1f2f-872c-4ce6-acf4-5f4ee6845063 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:13.859449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6ad1f2f-872c-4ce6-acf4-5f4ee6845063 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:14.668948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6125e80b-74fa-4485-849d-586d6cad4106 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:14.690429 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6125e80b-74fa-4485-849d-586d6cad4106 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b" status: 200 len: 1319 microversion: 2.1 time: 1.959345 Oct 10 23:44:14.694580 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2493/5171] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:12 2022] GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b => generated 1319 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:14.708338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b975989f-aa6c-43bc-8fb1-6060a6ff85b3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:14.710203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b975989f-aa6c-43bc-8fb1-6060a6ff85b3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:14.724307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b975989f-aa6c-43bc-8fb1-6060a6ff85b3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:14.725311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b975989f-aa6c-43bc-8fb1-6060a6ff85b3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:14.728598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b975989f-aa6c-43bc-8fb1-6060a6ff85b3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:14.735666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b975989f-aa6c-43bc-8fb1-6060a6ff85b3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:14.736362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b975989f-aa6c-43bc-8fb1-6060a6ff85b3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:14.736871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b975989f-aa6c-43bc-8fb1-6060a6ff85b3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:14.760714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b6ad1f2f-872c-4ce6-acf4-5f4ee6845063 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:14.771954 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b6ad1f2f-872c-4ce6-acf4-5f4ee6845063 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.978578 Oct 10 23:44:14.772671 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2679/5172] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:13 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:14.786167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e230a757-6966-4ed6-a3ef-b89a73bb8a3c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:14.790611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e230a757-6966-4ed6-a3ef-b89a73bb8a3c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:14.805129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e230a757-6966-4ed6-a3ef-b89a73bb8a3c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:14.808602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e230a757-6966-4ed6-a3ef-b89a73bb8a3c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:14.809306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e230a757-6966-4ed6-a3ef-b89a73bb8a3c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:14.810484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e230a757-6966-4ed6-a3ef-b89a73bb8a3c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:14.813907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e230a757-6966-4ed6-a3ef-b89a73bb8a3c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:14.814571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e230a757-6966-4ed6-a3ef-b89a73bb8a3c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:15.428756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b975989f-aa6c-43bc-8fb1-6060a6ff85b3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:15.439514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:44:15.441397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e230a757-6966-4ed6-a3ef-b89a73bb8a3c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:15.448250 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b975989f-aa6c-43bc-8fb1-6060a6ff85b3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1529 microversion: 2.1 time: 0.752206 Oct 10 23:44:15.469404 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2494/5173] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:14 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1529 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:15.469962 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e230a757-6966-4ed6-a3ef-b89a73bb8a3c tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1518 microversion: 2.1 time: 0.687275 Oct 10 23:44:15.470300 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2680/5174] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:14 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1518 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:15.481705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1a1e830d-6649-4d39-b635-42142617a1f4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:15.489315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1a1e830d-6649-4d39-b635-42142617a1f4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:15.527351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a1e830d-6649-4d39-b635-42142617a1f4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:15.528042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a1e830d-6649-4d39-b635-42142617a1f4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:15.531448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a1e830d-6649-4d39-b635-42142617a1f4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:15.532348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a1e830d-6649-4d39-b635-42142617a1f4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:15.535586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a1e830d-6649-4d39-b635-42142617a1f4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:15.538844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a1e830d-6649-4d39-b635-42142617a1f4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:15.720160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-17d9cb94-b8e1-40ba-bcfa-009d9080479d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:15.721092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-17d9cb94-b8e1-40ba-bcfa-009d9080479d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 1f082ddb-a09e-4a05-9233-108fa544b12b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:15.736736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17d9cb94-b8e1-40ba-bcfa-009d9080479d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:15.738815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17d9cb94-b8e1-40ba-bcfa-009d9080479d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:15.739295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17d9cb94-b8e1-40ba-bcfa-009d9080479d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:15.740051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17d9cb94-b8e1-40ba-bcfa-009d9080479d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:15.740523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17d9cb94-b8e1-40ba-bcfa-009d9080479d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:15.743540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17d9cb94-b8e1-40ba-bcfa-009d9080479d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:15.898619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1a1e830d-6649-4d39-b635-42142617a1f4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:15.912668 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1a1e830d-6649-4d39-b635-42142617a1f4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.453919 Oct 10 23:44:15.915660 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2495/5175] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:15 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:16.203779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-17d9cb94-b8e1-40ba-bcfa-009d9080479d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:16.215601 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-17d9cb94-b8e1-40ba-bcfa-009d9080479d tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b" status: 200 len: 1319 microversion: 2.1 time: 0.497379 Oct 10 23:44:16.216303 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2681/5176] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:15 2022] GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b => generated 1319 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:44:16.486144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c07a3480-ae90-412f-9232-40061498e6b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:16.487026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c07a3480-ae90-412f-9232-40061498e6b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:16.496362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9b9188b1-cc6e-4d84-acd0-f05177f5f435 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:16.496914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9b9188b1-cc6e-4d84-acd0-f05177f5f435 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:16.505853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b9188b1-cc6e-4d84-acd0-f05177f5f435 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:16.506565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b9188b1-cc6e-4d84-acd0-f05177f5f435 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:16.507333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b9188b1-cc6e-4d84-acd0-f05177f5f435 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:16.508514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b9188b1-cc6e-4d84-acd0-f05177f5f435 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:16.509472 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b9188b1-cc6e-4d84-acd0-f05177f5f435 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:16.510142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b9188b1-cc6e-4d84-acd0-f05177f5f435 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:16.516591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c07a3480-ae90-412f-9232-40061498e6b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:16.517069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c07a3480-ae90-412f-9232-40061498e6b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:16.517551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c07a3480-ae90-412f-9232-40061498e6b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:16.518277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c07a3480-ae90-412f-9232-40061498e6b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:16.518740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c07a3480-ae90-412f-9232-40061498e6b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:16.519175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c07a3480-ae90-412f-9232-40061498e6b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:16.865740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c07a3480-ae90-412f-9232-40061498e6b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:16.875378 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c07a3480-ae90-412f-9232-40061498e6b2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1529 microversion: 2.1 time: 0.393776 Oct 10 23:44:16.892237 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2496/5177] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:16 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1529 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:17.087957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9b9188b1-cc6e-4d84-acd0-f05177f5f435 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:17.101778 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9b9188b1-cc6e-4d84-acd0-f05177f5f435 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1524 microversion: 2.1 time: 0.606437 Oct 10 23:44:17.118204 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2682/5178] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:16 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1524 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:17.245698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-93969bbf-228f-4e66-b45b-23000868aadd tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:17.246557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-93969bbf-228f-4e66-b45b-23000868aadd tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 1f082ddb-a09e-4a05-9233-108fa544b12b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:17.257697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93969bbf-228f-4e66-b45b-23000868aadd tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:17.260842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93969bbf-228f-4e66-b45b-23000868aadd tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:17.261578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93969bbf-228f-4e66-b45b-23000868aadd tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:17.265608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93969bbf-228f-4e66-b45b-23000868aadd tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:17.266302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93969bbf-228f-4e66-b45b-23000868aadd tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:17.266909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93969bbf-228f-4e66-b45b-23000868aadd tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:17.700014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-93969bbf-228f-4e66-b45b-23000868aadd tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:17.712400 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-93969bbf-228f-4e66-b45b-23000868aadd tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b" status: 200 len: 1509 microversion: 2.1 time: 0.471146 Oct 10 23:44:17.725576 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2497/5179] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:17 2022] GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b => generated 1509 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:17.905864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-85a6df0c-15b8-44d7-8567-8b860c7ca271 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:17.907659 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-85a6df0c-15b8-44d7-8567-8b860c7ca271 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:17.934589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85a6df0c-15b8-44d7-8567-8b860c7ca271 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:17.939543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85a6df0c-15b8-44d7-8567-8b860c7ca271 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:17.940534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85a6df0c-15b8-44d7-8567-8b860c7ca271 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:17.944795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85a6df0c-15b8-44d7-8567-8b860c7ca271 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:17.950513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85a6df0c-15b8-44d7-8567-8b860c7ca271 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:17.951259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85a6df0c-15b8-44d7-8567-8b860c7ca271 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:18.128657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-05bb68d9-0668-4eea-a953-2866e52b3735 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:18.129784 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-05bb68d9-0668-4eea-a953-2866e52b3735 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:18.141510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05bb68d9-0668-4eea-a953-2866e52b3735 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:18.142023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05bb68d9-0668-4eea-a953-2866e52b3735 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:18.142455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05bb68d9-0668-4eea-a953-2866e52b3735 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:18.146346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05bb68d9-0668-4eea-a953-2866e52b3735 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:18.146873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05bb68d9-0668-4eea-a953-2866e52b3735 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:18.150172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05bb68d9-0668-4eea-a953-2866e52b3735 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:18.549767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-05bb68d9-0668-4eea-a953-2866e52b3735 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:18.582065 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-05bb68d9-0668-4eea-a953-2866e52b3735 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1524 microversion: 2.1 time: 0.455955 Oct 10 23:44:18.584057 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2498/5180] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:18 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1524 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:44:18.681977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-85a6df0c-15b8-44d7-8567-8b860c7ca271 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:18.694771 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-85a6df0c-15b8-44d7-8567-8b860c7ca271 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1529 microversion: 2.1 time: 0.795103 Oct 10 23:44:18.704762 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2683/5181] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:17 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1529 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:19.080495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a2996e4a-aa74-48d6-b871-492cc748c1f5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:19.081121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a2996e4a-aa74-48d6-b871-492cc748c1f5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:19.098800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2996e4a-aa74-48d6-b871-492cc748c1f5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:19.102123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2996e4a-aa74-48d6-b871-492cc748c1f5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:19.102819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2996e4a-aa74-48d6-b871-492cc748c1f5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:19.103631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2996e4a-aa74-48d6-b871-492cc748c1f5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:19.105944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2996e4a-aa74-48d6-b871-492cc748c1f5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:19.106392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2996e4a-aa74-48d6-b871-492cc748c1f5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:19.176390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-acccdb4d-8a42-4246-a3c0-f2962fb3eba6 req-21716356-bb8b-4a06-80be-781d2bab3e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c65eb2-4a59-4b1e-bf11-e2094d984d0a", "name": "network-vif-unplugged", "status": "completed", "tag": "db12b09d-2d47-4f71-9616-ebcc385cf4ab"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:44:19.213730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-acccdb4d-8a42-4246-a3c0-f2962fb3eba6 req-21716356-bb8b-4a06-80be-781d2bab3e22 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:19.214360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-acccdb4d-8a42-4246-a3c0-f2962fb3eba6 req-21716356-bb8b-4a06-80be-781d2bab3e22 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:19.214816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-acccdb4d-8a42-4246-a3c0-f2962fb3eba6 req-21716356-bb8b-4a06-80be-781d2bab3e22 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:19.249990 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-acccdb4d-8a42-4246-a3c0-f2962fb3eba6 req-21716356-bb8b-4a06-80be-781d2bab3e22 service nova] Creating event network-vif-unplugged:db12b09d-2d47-4f71-9616-ebcc385cf4ab for instance 88c65eb2-4a59-4b1e-bf11-e2094d984d0a on n-h2-860864-2 Oct 10 23:44:19.255526 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-acccdb4d-8a42-4246-a3c0-f2962fb3eba6 req-21716356-bb8b-4a06-80be-781d2bab3e22 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082712 Oct 10 23:44:19.256459 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2684/5182] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:44:19.565704 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a2996e4a-aa74-48d6-b871-492cc748c1f5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:19.582190 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a2996e4a-aa74-48d6-b871-492cc748c1f5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.506368 Oct 10 23:44:19.586767 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2499/5183] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:19 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:19.628261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1a068e81-619d-4395-8ef8-b57428d4f311 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:19.628997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1a068e81-619d-4395-8ef8-b57428d4f311 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:19.632027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b301b955-c93f-417b-81e4-aff3b4b6c9e3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:19.632769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b301b955-c93f-417b-81e4-aff3b4b6c9e3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:19.660278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a068e81-619d-4395-8ef8-b57428d4f311 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:19.666707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b301b955-c93f-417b-81e4-aff3b4b6c9e3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:19.667876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a068e81-619d-4395-8ef8-b57428d4f311 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:19.668524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a068e81-619d-4395-8ef8-b57428d4f311 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:19.669272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b301b955-c93f-417b-81e4-aff3b4b6c9e3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:19.670366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a068e81-619d-4395-8ef8-b57428d4f311 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:19.671689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b301b955-c93f-417b-81e4-aff3b4b6c9e3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:19.673140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a068e81-619d-4395-8ef8-b57428d4f311 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:19.673760 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b301b955-c93f-417b-81e4-aff3b4b6c9e3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:19.677642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a068e81-619d-4395-8ef8-b57428d4f311 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:19.678481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b301b955-c93f-417b-81e4-aff3b4b6c9e3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:19.682022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b301b955-c93f-417b-81e4-aff3b4b6c9e3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:20.027166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b301b955-c93f-417b-81e4-aff3b4b6c9e3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:20.042007 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b301b955-c93f-417b-81e4-aff3b4b6c9e3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.429537 Oct 10 23:44:20.043257 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2500/5184] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:19 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:20.050740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0da2d382-1157-4435-9adb-756d6bdd565f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:20.052084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0da2d382-1157-4435-9adb-756d6bdd565f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:20.062993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0da2d382-1157-4435-9adb-756d6bdd565f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:20.070256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0da2d382-1157-4435-9adb-756d6bdd565f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:20.073711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0da2d382-1157-4435-9adb-756d6bdd565f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:20.075018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0da2d382-1157-4435-9adb-756d6bdd565f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:20.075901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0da2d382-1157-4435-9adb-756d6bdd565f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:20.078162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0da2d382-1157-4435-9adb-756d6bdd565f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:20.447921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0da2d382-1157-4435-9adb-756d6bdd565f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:20.471287 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0da2d382-1157-4435-9adb-756d6bdd565f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1529 microversion: 2.1 time: 0.426251 Oct 10 23:44:20.472332 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2501/5185] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:20 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1529 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:20.489852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e402861f-9e64-49d1-9e8a-2037368de107 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:20.495482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e402861f-9e64-49d1-9e8a-2037368de107 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:20.511613 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e402861f-9e64-49d1-9e8a-2037368de107 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:20.517073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e402861f-9e64-49d1-9e8a-2037368de107 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:20.517904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e402861f-9e64-49d1-9e8a-2037368de107 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:20.518913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e402861f-9e64-49d1-9e8a-2037368de107 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:20.520204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e402861f-9e64-49d1-9e8a-2037368de107 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:20.522937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e402861f-9e64-49d1-9e8a-2037368de107 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:20.756687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1a068e81-619d-4395-8ef8-b57428d4f311 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:20.776837 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1a068e81-619d-4395-8ef8-b57428d4f311 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1524 microversion: 2.1 time: 1.171594 Oct 10 23:44:20.777776 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2685/5186] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:19 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1524 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:44:20.922357 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e402861f-9e64-49d1-9e8a-2037368de107 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:20.947088 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e402861f-9e64-49d1-9e8a-2037368de107 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.463943 Oct 10 23:44:20.947899 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2502/5187] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:20 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:20.977585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-94523610-0e1a-460c-af32-41827852972f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:44:20.979906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-94523610-0e1a-460c-af32-41827852972f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:20.995075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94523610-0e1a-460c-af32-41827852972f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:20.996526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94523610-0e1a-460c-af32-41827852972f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:20.997842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94523610-0e1a-460c-af32-41827852972f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:21.001734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94523610-0e1a-460c-af32-41827852972f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:21.002476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94523610-0e1a-460c-af32-41827852972f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:21.003521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94523610-0e1a-460c-af32-41827852972f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:21.224647 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-94523610-0e1a-460c-af32-41827852972f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action" status: 202 len: 0 microversion: 2.1 time: 0.250809 Oct 10 23:44:21.230867 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2686/5188] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:44:20 2022] POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:44:21.234772 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-726bffab-af54-434a-9a44-1b69dc145631 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:21.235780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-726bffab-af54-434a-9a44-1b69dc145631 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:21.247238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-726bffab-af54-434a-9a44-1b69dc145631 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:21.248011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-726bffab-af54-434a-9a44-1b69dc145631 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:21.249178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-726bffab-af54-434a-9a44-1b69dc145631 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:21.250205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-726bffab-af54-434a-9a44-1b69dc145631 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:21.256378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-726bffab-af54-434a-9a44-1b69dc145631 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:21.257143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-726bffab-af54-434a-9a44-1b69dc145631 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:21.502988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-329ce789-3291-4005-901a-8460999716b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:21.503784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-329ce789-3291-4005-901a-8460999716b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:21.540280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-329ce789-3291-4005-901a-8460999716b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:21.558409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-329ce789-3291-4005-901a-8460999716b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:21.558970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-329ce789-3291-4005-901a-8460999716b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:21.565969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-329ce789-3291-4005-901a-8460999716b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:21.571329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-329ce789-3291-4005-901a-8460999716b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:21.571841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-329ce789-3291-4005-901a-8460999716b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:21.877790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-726bffab-af54-434a-9a44-1b69dc145631 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:21.889974 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-726bffab-af54-434a-9a44-1b69dc145631 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1672 microversion: 2.1 time: 0.658997 Oct 10 23:44:21.902567 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2503/5189] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:21 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1672 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:21.930121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3f37a9f8-092a-46bf-9fa2-5c75a59848e3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:21.930861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3f37a9f8-092a-46bf-9fa2-5c75a59848e3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:21.958894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f37a9f8-092a-46bf-9fa2-5c75a59848e3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:21.959443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f37a9f8-092a-46bf-9fa2-5c75a59848e3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:21.959901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f37a9f8-092a-46bf-9fa2-5c75a59848e3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:21.960647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f37a9f8-092a-46bf-9fa2-5c75a59848e3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:21.961121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f37a9f8-092a-46bf-9fa2-5c75a59848e3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:21.961709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f37a9f8-092a-46bf-9fa2-5c75a59848e3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:22.297000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-329ce789-3291-4005-901a-8460999716b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:22.314766 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-329ce789-3291-4005-901a-8460999716b5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1529 microversion: 2.1 time: 0.818157 Oct 10 23:44:22.320688 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2687/5190] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:21 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1529 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:22.417546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3f37a9f8-092a-46bf-9fa2-5c75a59848e3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:22.427482 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3f37a9f8-092a-46bf-9fa2-5c75a59848e3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1524 microversion: 2.1 time: 0.522954 Oct 10 23:44:22.442337 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2504/5191] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:21 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1524 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:22.924245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-980ad284-1fba-462b-bf2d-105ef3bc5033 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:22.925047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-980ad284-1fba-462b-bf2d-105ef3bc5033 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:22.956859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-980ad284-1fba-462b-bf2d-105ef3bc5033 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:22.957414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-980ad284-1fba-462b-bf2d-105ef3bc5033 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:22.959970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-980ad284-1fba-462b-bf2d-105ef3bc5033 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:22.968145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-980ad284-1fba-462b-bf2d-105ef3bc5033 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:22.968955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-980ad284-1fba-462b-bf2d-105ef3bc5033 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:22.972503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-980ad284-1fba-462b-bf2d-105ef3bc5033 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:23.346966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-591027e4-2ef3-4db9-9079-b382f7ed4149 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:23.347595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-591027e4-2ef3-4db9-9079-b382f7ed4149 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:23.368700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-591027e4-2ef3-4db9-9079-b382f7ed4149 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:23.370138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-591027e4-2ef3-4db9-9079-b382f7ed4149 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:23.370597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-591027e4-2ef3-4db9-9079-b382f7ed4149 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:23.381809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-591027e4-2ef3-4db9-9079-b382f7ed4149 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:23.382503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-591027e4-2ef3-4db9-9079-b382f7ed4149 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:23.401157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-591027e4-2ef3-4db9-9079-b382f7ed4149 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:24.154214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-591027e4-2ef3-4db9-9079-b382f7ed4149 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:24.164215 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-591027e4-2ef3-4db9-9079-b382f7ed4149 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1529 microversion: 2.1 time: 0.822073 Oct 10 23:44:24.167539 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2505/5192] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:23 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1529 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:24.175801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-53055b98-5664-4704-afd9-46e6ae2d213e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:24.186357 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-53055b98-5664-4704-afd9-46e6ae2d213e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:24.203087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53055b98-5664-4704-afd9-46e6ae2d213e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:24.204370 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53055b98-5664-4704-afd9-46e6ae2d213e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:24.206149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53055b98-5664-4704-afd9-46e6ae2d213e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:24.207083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53055b98-5664-4704-afd9-46e6ae2d213e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:24.210837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53055b98-5664-4704-afd9-46e6ae2d213e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:24.214541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53055b98-5664-4704-afd9-46e6ae2d213e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:24.384873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-980ad284-1fba-462b-bf2d-105ef3bc5033 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:24.422390 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-980ad284-1fba-462b-bf2d-105ef3bc5033 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1672 microversion: 2.1 time: 1.503341 Oct 10 23:44:24.424697 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2688/5193] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:22 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1672 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:24.454073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-e1de9447-5e82-4d78-9e50-4ba7c32db3e6 req-49710c8e-219d-4ff7-a57f-fd0aac8d5421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27c2a97-533c-436b-8974-f05beb1027fd", "name": "network-vif-plugged", "status": "completed", "tag": "ff1e9960-44ed-4760-8712-c79e1b463cf9"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:44:24.479898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e1de9447-5e82-4d78-9e50-4ba7c32db3e6 req-49710c8e-219d-4ff7-a57f-fd0aac8d5421 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:24.488405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e1de9447-5e82-4d78-9e50-4ba7c32db3e6 req-49710c8e-219d-4ff7-a57f-fd0aac8d5421 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:24.497134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e1de9447-5e82-4d78-9e50-4ba7c32db3e6 req-49710c8e-219d-4ff7-a57f-fd0aac8d5421 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:24.539160 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-e1de9447-5e82-4d78-9e50-4ba7c32db3e6 req-49710c8e-219d-4ff7-a57f-fd0aac8d5421 service nova] Creating event network-vif-plugged:ff1e9960-44ed-4760-8712-c79e1b463cf9 for instance b27c2a97-533c-436b-8974-f05beb1027fd on n-h2-860864-2 Oct 10 23:44:24.560926 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-e1de9447-5e82-4d78-9e50-4ba7c32db3e6 req-49710c8e-219d-4ff7-a57f-fd0aac8d5421 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111380 Oct 10 23:44:24.562529 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2689/5194] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:44:25.023404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-53055b98-5664-4704-afd9-46e6ae2d213e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:25.036136 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-53055b98-5664-4704-afd9-46e6ae2d213e tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1524 microversion: 2.1 time: 0.864741 Oct 10 23:44:25.036754 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2506/5195] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:24 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1524 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:25.204202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-adc8ed61-3009-4f78-94bb-66fb1d7c13d5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:25.205268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-adc8ed61-3009-4f78-94bb-66fb1d7c13d5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:25.235551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc8ed61-3009-4f78-94bb-66fb1d7c13d5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:25.236549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc8ed61-3009-4f78-94bb-66fb1d7c13d5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:25.237186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc8ed61-3009-4f78-94bb-66fb1d7c13d5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:25.238117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc8ed61-3009-4f78-94bb-66fb1d7c13d5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:25.240470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc8ed61-3009-4f78-94bb-66fb1d7c13d5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:25.242996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc8ed61-3009-4f78-94bb-66fb1d7c13d5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:25.452637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c521dad1-e6d5-4974-a267-296b1afad0f1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:25.453537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c521dad1-e6d5-4974-a267-296b1afad0f1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:25.468655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c521dad1-e6d5-4974-a267-296b1afad0f1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:25.469288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c521dad1-e6d5-4974-a267-296b1afad0f1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:25.481431 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c521dad1-e6d5-4974-a267-296b1afad0f1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:25.483218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c521dad1-e6d5-4974-a267-296b1afad0f1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:25.483929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c521dad1-e6d5-4974-a267-296b1afad0f1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:25.484382 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c521dad1-e6d5-4974-a267-296b1afad0f1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:25.956790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-adc8ed61-3009-4f78-94bb-66fb1d7c13d5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:25.977299 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-adc8ed61-3009-4f78-94bb-66fb1d7c13d5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1529 microversion: 2.1 time: 0.782202 Oct 10 23:44:25.978039 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2690/5196] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:25 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1529 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:26.066055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-74db4eca-151a-4096-a3b8-f89736ec7781 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:26.066689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-74db4eca-151a-4096-a3b8-f89736ec7781 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:26.086590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74db4eca-151a-4096-a3b8-f89736ec7781 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:26.087382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74db4eca-151a-4096-a3b8-f89736ec7781 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:26.087846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74db4eca-151a-4096-a3b8-f89736ec7781 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:26.091607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74db4eca-151a-4096-a3b8-f89736ec7781 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:26.093535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74db4eca-151a-4096-a3b8-f89736ec7781 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:26.094000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74db4eca-151a-4096-a3b8-f89736ec7781 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:26.891374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c521dad1-e6d5-4974-a267-296b1afad0f1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:26.915984 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c521dad1-e6d5-4974-a267-296b1afad0f1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1672 microversion: 2.1 time: 1.467610 Oct 10 23:44:26.921323 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2507/5197] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:25 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1672 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:44:27.011409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8908d0e6-6b4f-4fba-9f22-c1732e8af715 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:27.016500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8908d0e6-6b4f-4fba-9f22-c1732e8af715 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:27.061434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8908d0e6-6b4f-4fba-9f22-c1732e8af715 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:27.062272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8908d0e6-6b4f-4fba-9f22-c1732e8af715 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:27.062541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8908d0e6-6b4f-4fba-9f22-c1732e8af715 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:27.063277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8908d0e6-6b4f-4fba-9f22-c1732e8af715 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:27.063735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8908d0e6-6b4f-4fba-9f22-c1732e8af715 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:27.090622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-74db4eca-151a-4096-a3b8-f89736ec7781 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:27.103083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8908d0e6-6b4f-4fba-9f22-c1732e8af715 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:27.116854 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-74db4eca-151a-4096-a3b8-f89736ec7781 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1524 microversion: 2.1 time: 1.055977 Oct 10 23:44:27.131934 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2691/5198] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:26 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1524 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:27.893752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8908d0e6-6b4f-4fba-9f22-c1732e8af715 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:27.903073 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8908d0e6-6b4f-4fba-9f22-c1732e8af715 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1529 microversion: 2.1 time: 0.899301 Oct 10 23:44:27.903898 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2508/5199] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:27 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1529 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:27.950031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-625049ee-bedd-4add-abc1-cbe2a037b6fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:27.950883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-625049ee-bedd-4add-abc1-cbe2a037b6fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:27.959910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-625049ee-bedd-4add-abc1-cbe2a037b6fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:27.960617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-625049ee-bedd-4add-abc1-cbe2a037b6fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:27.961243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-625049ee-bedd-4add-abc1-cbe2a037b6fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:27.962178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-625049ee-bedd-4add-abc1-cbe2a037b6fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:27.962803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-625049ee-bedd-4add-abc1-cbe2a037b6fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:27.963432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-625049ee-bedd-4add-abc1-cbe2a037b6fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:28.142955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e8a3844a-dddd-4323-b2aa-a22f8e072fde tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:28.150883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e8a3844a-dddd-4323-b2aa-a22f8e072fde tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:28.162107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8a3844a-dddd-4323-b2aa-a22f8e072fde tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:28.182034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8a3844a-dddd-4323-b2aa-a22f8e072fde tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:28.183763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8a3844a-dddd-4323-b2aa-a22f8e072fde tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:28.184722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8a3844a-dddd-4323-b2aa-a22f8e072fde tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:28.189270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8a3844a-dddd-4323-b2aa-a22f8e072fde tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:28.190682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8a3844a-dddd-4323-b2aa-a22f8e072fde tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:28.795309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-625049ee-bedd-4add-abc1-cbe2a037b6fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:28.824334 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-625049ee-bedd-4add-abc1-cbe2a037b6fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.873063 Oct 10 23:44:28.825477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e8a3844a-dddd-4323-b2aa-a22f8e072fde tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:28.836332 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e8a3844a-dddd-4323-b2aa-a22f8e072fde tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1509 microversion: 2.1 time: 0.697800 Oct 10 23:44:28.845801 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2692/5200] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:27 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:28.847941 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2509/5201] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:28 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1509 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:28.868492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a7a50b33-6789-4ad8-8850-5ebbc61e6735 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:44:28.883635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a7a50b33-6789-4ad8-8850-5ebbc61e6735 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:28.918535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7a50b33-6789-4ad8-8850-5ebbc61e6735 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:28.921975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7a50b33-6789-4ad8-8850-5ebbc61e6735 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:28.924212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7a50b33-6789-4ad8-8850-5ebbc61e6735 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:28.925258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7a50b33-6789-4ad8-8850-5ebbc61e6735 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:28.930110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7a50b33-6789-4ad8-8850-5ebbc61e6735 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:28.931064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7a50b33-6789-4ad8-8850-5ebbc61e6735 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:29.058953 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a7a50b33-6789-4ad8-8850-5ebbc61e6735 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action" status: 200 len: 322 microversion: 2.1 time: 0.207865 Oct 10 23:44:29.060179 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2510/5202] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:44:28 2022] POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action => generated 322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:44:29.066372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-545e8108-dfc1-41a5-a86c-4ce99d2fe06b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:29.074549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-545e8108-dfc1-41a5-a86c-4ce99d2fe06b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:29.096829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-545e8108-dfc1-41a5-a86c-4ce99d2fe06b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:29.099825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-545e8108-dfc1-41a5-a86c-4ce99d2fe06b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:29.100656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-545e8108-dfc1-41a5-a86c-4ce99d2fe06b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:29.104992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-545e8108-dfc1-41a5-a86c-4ce99d2fe06b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:29.108117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-545e8108-dfc1-41a5-a86c-4ce99d2fe06b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:29.108716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-545e8108-dfc1-41a5-a86c-4ce99d2fe06b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:29.466615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-545e8108-dfc1-41a5-a86c-4ce99d2fe06b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:29.470830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:44:29.477197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7f28abce-6e44-4a6a-9bc9-ffe0a474c285 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1024643218", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "abcacee0-1319-4318-8900-2ff15d7780f9"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:44:29.496647 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-545e8108-dfc1-41a5-a86c-4ce99d2fe06b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 200 len: 1509 microversion: 2.1 time: 0.422756 Oct 10 23:44:29.497496 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2511/5203] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:29 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 1509 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:29.507911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a039656b-89eb-4aa9-87ea-a9ef66bd8fb6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:29.515389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a039656b-89eb-4aa9-87ea-a9ef66bd8fb6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:29.532726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a039656b-89eb-4aa9-87ea-a9ef66bd8fb6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:29.537359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a039656b-89eb-4aa9-87ea-a9ef66bd8fb6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:29.538159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a039656b-89eb-4aa9-87ea-a9ef66bd8fb6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:29.539169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a039656b-89eb-4aa9-87ea-a9ef66bd8fb6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:29.542024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a039656b-89eb-4aa9-87ea-a9ef66bd8fb6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:29.542796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a039656b-89eb-4aa9-87ea-a9ef66bd8fb6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:29.557216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=62 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:44:30.023571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a039656b-89eb-4aa9-87ea-a9ef66bd8fb6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:30.043233 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a039656b-89eb-4aa9-87ea-a9ef66bd8fb6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1529 microversion: 2.1 time: 0.540513 Oct 10 23:44:30.044385 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2512/5204] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:29 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1529 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:30.059639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fa2527ff-bc49-45cd-8dba-cd7dabe7a3f8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:30.070384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fa2527ff-bc49-45cd-8dba-cd7dabe7a3f8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:30.102015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa2527ff-bc49-45cd-8dba-cd7dabe7a3f8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:30.105824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa2527ff-bc49-45cd-8dba-cd7dabe7a3f8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:30.106623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa2527ff-bc49-45cd-8dba-cd7dabe7a3f8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:30.108136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa2527ff-bc49-45cd-8dba-cd7dabe7a3f8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:30.108875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa2527ff-bc49-45cd-8dba-cd7dabe7a3f8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:30.119348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa2527ff-bc49-45cd-8dba-cd7dabe7a3f8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:30.471128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fa2527ff-bc49-45cd-8dba-cd7dabe7a3f8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:30.486666 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fa2527ff-bc49-45cd-8dba-cd7dabe7a3f8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.439268 Oct 10 23:44:30.490937 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2513/5205] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:30 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:30.509035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ce119b22-f56e-421d-9a12-3c123f6546c3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:30.510194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ce119b22-f56e-421d-9a12-3c123f6546c3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:30.541533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce119b22-f56e-421d-9a12-3c123f6546c3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:30.548659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce119b22-f56e-421d-9a12-3c123f6546c3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:30.549192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce119b22-f56e-421d-9a12-3c123f6546c3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:30.550002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce119b22-f56e-421d-9a12-3c123f6546c3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:30.550478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce119b22-f56e-421d-9a12-3c123f6546c3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:30.557841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce119b22-f56e-421d-9a12-3c123f6546c3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:30.695645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ce119b22-f56e-421d-9a12-3c123f6546c3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:44:30.865917 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ce119b22-f56e-421d-9a12-3c123f6546c3 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 204 len: 0 microversion: 2.1 time: 0.370677 Oct 10 23:44:30.868365 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2514/5206] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:44:30 2022] DELETE /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:44:30.910639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-001c9c13-b388-44c9-a4dc-78ba910c9237 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:30.916132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-001c9c13-b388-44c9-a4dc-78ba910c9237 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:30.944280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-001c9c13-b388-44c9-a4dc-78ba910c9237 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:30.946940 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-001c9c13-b388-44c9-a4dc-78ba910c9237 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:30.949820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-001c9c13-b388-44c9-a4dc-78ba910c9237 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:30.953959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-001c9c13-b388-44c9-a4dc-78ba910c9237 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:30.954748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-001c9c13-b388-44c9-a4dc-78ba910c9237 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:30.959133 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-001c9c13-b388-44c9-a4dc-78ba910c9237 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:32.033297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-001c9c13-b388-44c9-a4dc-78ba910c9237 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:32.044955 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-001c9c13-b388-44c9-a4dc-78ba910c9237 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 1.174831 Oct 10 23:44:32.045717 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2515/5207] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:30 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:32.052916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7d810fc3-a721-4efc-9f42-fea0a07c762f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:32.053707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7d810fc3-a721-4efc-9f42-fea0a07c762f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:32.075261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d810fc3-a721-4efc-9f42-fea0a07c762f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:32.075774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d810fc3-a721-4efc-9f42-fea0a07c762f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:32.076259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d810fc3-a721-4efc-9f42-fea0a07c762f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:32.084064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d810fc3-a721-4efc-9f42-fea0a07c762f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:32.084803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d810fc3-a721-4efc-9f42-fea0a07c762f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:32.085494 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d810fc3-a721-4efc-9f42-fea0a07c762f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:32.625304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7d810fc3-a721-4efc-9f42-fea0a07c762f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:32.636227 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7d810fc3-a721-4efc-9f42-fea0a07c762f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1529 microversion: 2.1 time: 0.589447 Oct 10 23:44:32.673504 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2516/5208] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:32 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1529 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:32.673504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-67563169-37b1-46ff-919f-b8a38b595a50 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1360657413", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "99aa30e7-a2c6-4b17-b974-bb1c36c895bd"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:44:35.221134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-7f28abce-6e44-4a6a-9bc9-ffe0a474c285 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] validate_networks() for [('abcacee0-1319-4318-8900-2ff15d7780f9', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:44:35.244837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-67563169-37b1-46ff-919f-b8a38b595a50 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] validate_networks() for [('99aa30e7-a2c6-4b17-b974-bb1c36c895bd', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:44:36.379202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7f28abce-6e44-4a6a-9bc9-ffe0a474c285 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:44:36.379839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7f28abce-6e44-4a6a-9bc9-ffe0a474c285 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:44:36.380532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7f28abce-6e44-4a6a-9bc9-ffe0a474c285 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:44:36.385575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7f28abce-6e44-4a6a-9bc9-ffe0a474c285 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:44:36.386375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7f28abce-6e44-4a6a-9bc9-ffe0a474c285 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:44:36.406908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f28abce-6e44-4a6a-9bc9-ffe0a474c285 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:36.407947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f28abce-6e44-4a6a-9bc9-ffe0a474c285 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:36.410443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f28abce-6e44-4a6a-9bc9-ffe0a474c285 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:36.417272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f28abce-6e44-4a6a-9bc9-ffe0a474c285 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:36.418517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f28abce-6e44-4a6a-9bc9-ffe0a474c285 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:36.419163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f28abce-6e44-4a6a-9bc9-ffe0a474c285 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:36.472862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-7f28abce-6e44-4a6a-9bc9-ffe0a474c285 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Getting quotas for project 7fcc4d45337140259bcd5b64b17aa7b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:44:36.483972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-67563169-37b1-46ff-919f-b8a38b595a50 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:44:36.484495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-67563169-37b1-46ff-919f-b8a38b595a50 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:44:36.484864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-67563169-37b1-46ff-919f-b8a38b595a50 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:44:36.485280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-67563169-37b1-46ff-919f-b8a38b595a50 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:44:36.485996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-67563169-37b1-46ff-919f-b8a38b595a50 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:44:36.504174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-7f28abce-6e44-4a6a-9bc9-ffe0a474c285 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Getting quotas for user daf7a1ddba654265a5e732363c85eefa and project 7fcc4d45337140259bcd5b64b17aa7b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:44:36.509618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67563169-37b1-46ff-919f-b8a38b595a50 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:36.510116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67563169-37b1-46ff-919f-b8a38b595a50 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:36.510556 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67563169-37b1-46ff-919f-b8a38b595a50 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:36.511286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67563169-37b1-46ff-919f-b8a38b595a50 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:36.511751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67563169-37b1-46ff-919f-b8a38b595a50 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:36.512175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67563169-37b1-46ff-919f-b8a38b595a50 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:36.541228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7f28abce-6e44-4a6a-9bc9-ffe0a474c285 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:44:36.543683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7f28abce-6e44-4a6a-9bc9-ffe0a474c285 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b1cad8e1-6af5-4151-8635-926f77f2ca07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:44:36.581059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-67563169-37b1-46ff-919f-b8a38b595a50 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Getting quotas for project fea9f7995c3349008497343ab1940287. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:44:36.601339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-67563169-37b1-46ff-919f-b8a38b595a50 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Getting quotas for user 8eb15e7a60664cc7a0e5f7236dada33c and project fea9f7995c3349008497343ab1940287. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:44:36.636576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-67563169-37b1-46ff-919f-b8a38b595a50 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:44:36.643393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-67563169-37b1-46ff-919f-b8a38b595a50 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:44:36.643603 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7f28abce-6e44-4a6a-9bc9-ffe0a474c285 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.796064 Oct 10 23:44:36.650345 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2693/5209] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:44:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 7798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:44:36.650345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-560a7b28-406b-4586-9a75-27e349b853e5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:36.651050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-560a7b28-406b-4586-9a75-27e349b853e5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:36.667388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-560a7b28-406b-4586-9a75-27e349b853e5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:36.667811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-560a7b28-406b-4586-9a75-27e349b853e5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:36.668264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-560a7b28-406b-4586-9a75-27e349b853e5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:36.668989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-560a7b28-406b-4586-9a75-27e349b853e5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:36.669510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-560a7b28-406b-4586-9a75-27e349b853e5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:36.669918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-560a7b28-406b-4586-9a75-27e349b853e5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:36.871203 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-67563169-37b1-46ff-919f-b8a38b595a50 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.188069 Oct 10 23:44:36.873866 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2517/5210] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:44:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 4211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:44:36.928575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-14b46188-a09b-4c06-81c8-a7ebac93d6d8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:36.929205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-14b46188-a09b-4c06-81c8-a7ebac93d6d8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:36.958907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14b46188-a09b-4c06-81c8-a7ebac93d6d8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:36.959390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14b46188-a09b-4c06-81c8-a7ebac93d6d8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:36.959828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14b46188-a09b-4c06-81c8-a7ebac93d6d8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:36.960540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14b46188-a09b-4c06-81c8-a7ebac93d6d8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:36.960995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14b46188-a09b-4c06-81c8-a7ebac93d6d8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:36.961441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14b46188-a09b-4c06-81c8-a7ebac93d6d8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:37.668464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-14b46188-a09b-4c06-81c8-a7ebac93d6d8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:37.679413 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-14b46188-a09b-4c06-81c8-a7ebac93d6d8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1511 microversion: 2.1 time: 0.803260 Oct 10 23:44:37.680001 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2518/5211] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:36 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1511 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:37.697712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-8ea1ff0a-02c0-4ab2-a492-aedbcbaec5b7 req-6c00fb72-898f-432f-851c-d1e27b6bd6f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27c2a97-533c-436b-8974-f05beb1027fd", "name": "network-vif-deleted", "tag": "ff1e9960-44ed-4760-8712-c79e1b463cf9"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:44:37.735718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8ea1ff0a-02c0-4ab2-a492-aedbcbaec5b7 req-6c00fb72-898f-432f-851c-d1e27b6bd6f2 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:37.742945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8ea1ff0a-02c0-4ab2-a492-aedbcbaec5b7 req-6c00fb72-898f-432f-851c-d1e27b6bd6f2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:37.745210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8ea1ff0a-02c0-4ab2-a492-aedbcbaec5b7 req-6c00fb72-898f-432f-851c-d1e27b6bd6f2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:37.774633 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-8ea1ff0a-02c0-4ab2-a492-aedbcbaec5b7 req-6c00fb72-898f-432f-851c-d1e27b6bd6f2 service nova] Creating event network-vif-deleted:ff1e9960-44ed-4760-8712-c79e1b463cf9 for instance b27c2a97-533c-436b-8974-f05beb1027fd on n-h2-860864-2 Oct 10 23:44:37.787975 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-8ea1ff0a-02c0-4ab2-a492-aedbcbaec5b7 req-6c00fb72-898f-432f-851c-d1e27b6bd6f2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106656 Oct 10 23:44:37.796450 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2519/5212] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:44:37.804239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7a7512dd-b698-4a19-9bf3-399b7d300215 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:37.807372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7a7512dd-b698-4a19-9bf3-399b7d300215 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b1cad8e1-6af5-4151-8635-926f77f2ca07] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:37.924124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7a7512dd-b698-4a19-9bf3-399b7d300215 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:37.927280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-560a7b28-406b-4586-9a75-27e349b853e5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:37.942435 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7a7512dd-b698-4a19-9bf3-399b7d300215 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07" status: 200 len: 1193 microversion: 2.1 time: 0.144589 Oct 10 23:44:37.944276 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-560a7b28-406b-4586-9a75-27e349b853e5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 1.298677 Oct 10 23:44:37.958838 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2520/5213] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:37 2022] GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07 => generated 1193 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:37.963437 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2694/5214] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:36 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:37.971564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-33fad3e6-a865-40b4-8821-ad91bfa9bf44 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:37.972563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-33fad3e6-a865-40b4-8821-ad91bfa9bf44 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:37.973706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-449f2f4c-06fc-4498-9824-75f0d20100a9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:37.974341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-449f2f4c-06fc-4498-9824-75f0d20100a9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:37.991753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-449f2f4c-06fc-4498-9824-75f0d20100a9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:37.992252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-449f2f4c-06fc-4498-9824-75f0d20100a9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:37.992687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-449f2f4c-06fc-4498-9824-75f0d20100a9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:37.996474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-449f2f4c-06fc-4498-9824-75f0d20100a9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:37.997187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-449f2f4c-06fc-4498-9824-75f0d20100a9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:37.997870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-449f2f4c-06fc-4498-9824-75f0d20100a9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:38.168073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-33fad3e6-a865-40b4-8821-ad91bfa9bf44 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:38.179262 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-33fad3e6-a865-40b4-8821-ad91bfa9bf44 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1218 microversion: 2.1 time: 0.218772 Oct 10 23:44:38.180997 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2521/5215] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:37 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1218 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:38.449347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-449f2f4c-06fc-4498-9824-75f0d20100a9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:38.459372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:44:38.465724 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-449f2f4c-06fc-4498-9824-75f0d20100a9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.499935 Oct 10 23:44:38.467579 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2695/5216] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:37 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:38.715569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3e67de4d-ee15-492a-933f-7e87b604ed99 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:38.716942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3e67de4d-ee15-492a-933f-7e87b604ed99 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:38.730602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e67de4d-ee15-492a-933f-7e87b604ed99 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:38.731102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e67de4d-ee15-492a-933f-7e87b604ed99 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:38.731553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e67de4d-ee15-492a-933f-7e87b604ed99 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:38.732260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e67de4d-ee15-492a-933f-7e87b604ed99 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:38.733531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e67de4d-ee15-492a-933f-7e87b604ed99 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:38.743151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e67de4d-ee15-492a-933f-7e87b604ed99 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:38.801262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c61cf8c1-2935-43fd-bf3b-7560e048de7c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-80336453", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "17157a6b-ea9d-4593-b208-9ce16ed44768"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:44:38.937893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-c61cf8c1-2935-43fd-bf3b-7560e048de7c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] validate_networks() for [('17157a6b-ea9d-4593-b208-9ce16ed44768', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:44:39.894937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3e67de4d-ee15-492a-933f-7e87b604ed99 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:39.912026 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3e67de4d-ee15-492a-933f-7e87b604ed99 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1511 microversion: 2.1 time: 1.201687 Oct 10 23:44:39.912692 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2522/5217] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:38 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1511 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:39.940445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7702b893-375c-49ff-bf69-b439821a9e08 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:39.946247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7702b893-375c-49ff-bf69-b439821a9e08 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b1cad8e1-6af5-4151-8635-926f77f2ca07] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:39.969091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7702b893-375c-49ff-bf69-b439821a9e08 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:39.970178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7702b893-375c-49ff-bf69-b439821a9e08 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:39.970828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7702b893-375c-49ff-bf69-b439821a9e08 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:39.973909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7702b893-375c-49ff-bf69-b439821a9e08 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:39.976024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7702b893-375c-49ff-bf69-b439821a9e08 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:39.977553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7702b893-375c-49ff-bf69-b439821a9e08 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:40.170207 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7702b893-375c-49ff-bf69-b439821a9e08 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:40.185093 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7702b893-375c-49ff-bf69-b439821a9e08 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07" status: 200 len: 1189 microversion: 2.1 time: 0.253983 Oct 10 23:44:40.186378 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2523/5218] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:39 2022] GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07 => generated 1189 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:40.192127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-db215a68-2908-447f-a366-efc7435b08d8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:40.193172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-db215a68-2908-447f-a366-efc7435b08d8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:40.208699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db215a68-2908-447f-a366-efc7435b08d8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:40.218536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db215a68-2908-447f-a366-efc7435b08d8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:40.219191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db215a68-2908-447f-a366-efc7435b08d8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:40.221304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db215a68-2908-447f-a366-efc7435b08d8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:40.221833 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db215a68-2908-447f-a366-efc7435b08d8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:40.228914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db215a68-2908-447f-a366-efc7435b08d8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:40.322467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c61cf8c1-2935-43fd-bf3b-7560e048de7c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:44:40.323237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c61cf8c1-2935-43fd-bf3b-7560e048de7c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:44:40.323479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c61cf8c1-2935-43fd-bf3b-7560e048de7c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:44:40.324111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c61cf8c1-2935-43fd-bf3b-7560e048de7c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:44:40.325270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c61cf8c1-2935-43fd-bf3b-7560e048de7c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:44:40.367938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c61cf8c1-2935-43fd-bf3b-7560e048de7c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:40.370237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c61cf8c1-2935-43fd-bf3b-7560e048de7c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:40.370692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c61cf8c1-2935-43fd-bf3b-7560e048de7c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:40.374654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c61cf8c1-2935-43fd-bf3b-7560e048de7c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:40.375268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c61cf8c1-2935-43fd-bf3b-7560e048de7c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:40.377441 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c61cf8c1-2935-43fd-bf3b-7560e048de7c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:40.445198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-c61cf8c1-2935-43fd-bf3b-7560e048de7c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Getting quotas for project f798f5f5321f40b89fc5bacc3b9389fe. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:44:40.462757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-c61cf8c1-2935-43fd-bf3b-7560e048de7c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Getting quotas for user cfd8618ee1864d1d86de2def024b49bb and project f798f5f5321f40b89fc5bacc3b9389fe. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:44:40.492417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c61cf8c1-2935-43fd-bf3b-7560e048de7c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:44:40.496756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c61cf8c1-2935-43fd-bf3b-7560e048de7c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:44:40.535765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-db215a68-2908-447f-a366-efc7435b08d8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:40.548704 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-db215a68-2908-447f-a366-efc7435b08d8 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1214 microversion: 2.1 time: 0.360886 Oct 10 23:44:40.549605 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2524/5219] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:40 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1214 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:40.615670 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c61cf8c1-2935-43fd-bf3b-7560e048de7c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.822217 Oct 10 23:44:40.627532 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2696/5220] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:44:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:44:40.629339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-02340ff2-8c96-4317-9c5f-3e2e5ab88985 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:40.630022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-02340ff2-8c96-4317-9c5f-3e2e5ab88985 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:40.728729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-02340ff2-8c96-4317-9c5f-3e2e5ab88985 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:40.738995 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-02340ff2-8c96-4317-9c5f-3e2e5ab88985 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1213 microversion: 2.1 time: 0.114992 Oct 10 23:44:40.740252 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2525/5221] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:40 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1213 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:44:40.938090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d2a92ee2-c311-481d-ae13-95bcddefbd4a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:40.939042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d2a92ee2-c311-481d-ae13-95bcddefbd4a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:40.953498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2a92ee2-c311-481d-ae13-95bcddefbd4a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:40.956525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2a92ee2-c311-481d-ae13-95bcddefbd4a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:40.959524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2a92ee2-c311-481d-ae13-95bcddefbd4a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:40.962019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2a92ee2-c311-481d-ae13-95bcddefbd4a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:40.966535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2a92ee2-c311-481d-ae13-95bcddefbd4a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:40.970232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2a92ee2-c311-481d-ae13-95bcddefbd4a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:41.218523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3fa1f028-9c6a-4e4f-aed7-aabccd58748c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:41.219426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3fa1f028-9c6a-4e4f-aed7-aabccd58748c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b1cad8e1-6af5-4151-8635-926f77f2ca07] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:41.245941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fa1f028-9c6a-4e4f-aed7-aabccd58748c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:41.246594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fa1f028-9c6a-4e4f-aed7-aabccd58748c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:41.247059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fa1f028-9c6a-4e4f-aed7-aabccd58748c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:41.247814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fa1f028-9c6a-4e4f-aed7-aabccd58748c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:41.248476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fa1f028-9c6a-4e4f-aed7-aabccd58748c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:41.248939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3fa1f028-9c6a-4e4f-aed7-aabccd58748c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:41.570326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3fa1f028-9c6a-4e4f-aed7-aabccd58748c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:41.596608 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3fa1f028-9c6a-4e4f-aed7-aabccd58748c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07" status: 200 len: 1263 microversion: 2.1 time: 0.383520 Oct 10 23:44:41.597589 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2526/5222] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:41 2022] GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07 => generated 1263 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:44:41.607412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-14acf2bc-06e9-4055-adfa-db209390ead5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:41.608512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-14acf2bc-06e9-4055-adfa-db209390ead5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:41.626475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14acf2bc-06e9-4055-adfa-db209390ead5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:41.631541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14acf2bc-06e9-4055-adfa-db209390ead5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:41.632383 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14acf2bc-06e9-4055-adfa-db209390ead5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:41.640385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14acf2bc-06e9-4055-adfa-db209390ead5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:41.640884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14acf2bc-06e9-4055-adfa-db209390ead5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:41.641340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14acf2bc-06e9-4055-adfa-db209390ead5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:41.921324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-14acf2bc-06e9-4055-adfa-db209390ead5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:41.935144 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-14acf2bc-06e9-4055-adfa-db209390ead5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1270 microversion: 2.1 time: 0.336206 Oct 10 23:44:41.938934 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2527/5223] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:41 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1270 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:41.949856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d4ec8fd0-52a6-4d0c-a243-a32751a84bee tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:41.951974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d4ec8fd0-52a6-4d0c-a243-a32751a84bee tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:41.986941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4ec8fd0-52a6-4d0c-a243-a32751a84bee tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:41.990361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4ec8fd0-52a6-4d0c-a243-a32751a84bee tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:41.991495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4ec8fd0-52a6-4d0c-a243-a32751a84bee tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:41.994468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4ec8fd0-52a6-4d0c-a243-a32751a84bee tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:41.995706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4ec8fd0-52a6-4d0c-a243-a32751a84bee tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:41.996748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4ec8fd0-52a6-4d0c-a243-a32751a84bee tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:42.429086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d4ec8fd0-52a6-4d0c-a243-a32751a84bee tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:42.446036 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d4ec8fd0-52a6-4d0c-a243-a32751a84bee tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1209 microversion: 2.1 time: 0.504173 Oct 10 23:44:42.446658 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2528/5224] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:41 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1209 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:42.631277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d7d54897-e361-45e6-b522-a044f1526c6f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:42.634504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d7d54897-e361-45e6-b522-a044f1526c6f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b1cad8e1-6af5-4151-8635-926f77f2ca07] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:42.669160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7d54897-e361-45e6-b522-a044f1526c6f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:42.674528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7d54897-e361-45e6-b522-a044f1526c6f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:42.677410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7d54897-e361-45e6-b522-a044f1526c6f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:42.681109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7d54897-e361-45e6-b522-a044f1526c6f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:42.683394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7d54897-e361-45e6-b522-a044f1526c6f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:42.684037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7d54897-e361-45e6-b522-a044f1526c6f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:43.040639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d2a92ee2-c311-481d-ae13-95bcddefbd4a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:43.051100 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d2a92ee2-c311-481d-ae13-95bcddefbd4a tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1514 microversion: 2.1 time: 2.118984 Oct 10 23:44:43.057722 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2697/5225] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:40 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1514 bytes in 2126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:43.069221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d2031c75-cea2-4d93-970a-71fa3acd27ce tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:43.091079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d2031c75-cea2-4d93-970a-71fa3acd27ce tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:43.135834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2031c75-cea2-4d93-970a-71fa3acd27ce tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:43.139540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2031c75-cea2-4d93-970a-71fa3acd27ce tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:43.140947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2031c75-cea2-4d93-970a-71fa3acd27ce tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:43.150452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2031c75-cea2-4d93-970a-71fa3acd27ce tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:43.152805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2031c75-cea2-4d93-970a-71fa3acd27ce tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:43.154151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2031c75-cea2-4d93-970a-71fa3acd27ce tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:43.363403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d7d54897-e361-45e6-b522-a044f1526c6f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:43.393434 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d7d54897-e361-45e6-b522-a044f1526c6f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07" status: 200 len: 1251 microversion: 2.1 time: 0.768467 Oct 10 23:44:43.403673 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2529/5226] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:42 2022] GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07 => generated 1251 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:44:43.419240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-70cb7241-52d9-4868-b425-95dfcfce505c req-73b4a8b1-93ef-496b-a20f-7076e273078d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc9e449-6324-411e-8af9-0533b23a4e3c", "name": "network-vif-unplugged", "status": "completed", "tag": "c8d69949-457f-46f6-9402-4c349227f0a2"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:44:43.514773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d2031c75-cea2-4d93-970a-71fa3acd27ce tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:43.531688 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d2031c75-cea2-4d93-970a-71fa3acd27ce tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1276 microversion: 2.1 time: 0.472230 Oct 10 23:44:43.532305 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2698/5227] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:43 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1276 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:43.538783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-68a22179-2281-4ac4-acc9-efdf771e5ed3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:43.539129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:44:43.539878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-68a22179-2281-4ac4-acc9-efdf771e5ed3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:43.548978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-70cb7241-52d9-4868-b425-95dfcfce505c req-73b4a8b1-93ef-496b-a20f-7076e273078d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:43.549335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68a22179-2281-4ac4-acc9-efdf771e5ed3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:43.551124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-70cb7241-52d9-4868-b425-95dfcfce505c req-73b4a8b1-93ef-496b-a20f-7076e273078d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:43.555306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-70cb7241-52d9-4868-b425-95dfcfce505c req-73b4a8b1-93ef-496b-a20f-7076e273078d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:43.556782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68a22179-2281-4ac4-acc9-efdf771e5ed3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:43.565917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68a22179-2281-4ac4-acc9-efdf771e5ed3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:43.570388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68a22179-2281-4ac4-acc9-efdf771e5ed3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:43.571865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68a22179-2281-4ac4-acc9-efdf771e5ed3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:43.573206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68a22179-2281-4ac4-acc9-efdf771e5ed3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:43.599113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.compute.server_external_events [req-70cb7241-52d9-4868-b425-95dfcfce505c req-73b4a8b1-93ef-496b-a20f-7076e273078d service nova] Unable to find a host for instance efc9e449-6324-411e-8af9-0533b23a4e3c. Dropping event network-vif-unplugged {{(pid=120614) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 10 23:44:43.603908 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-70cb7241-52d9-4868-b425-95dfcfce505c req-73b4a8b1-93ef-496b-a20f-7076e273078d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.198218 Oct 10 23:44:43.605328 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2530/5228] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 201 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 10 23:44:43.619830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a4007bf8-d397-4164-904c-c1750bba29c6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:43.620657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a4007bf8-d397-4164-904c-c1750bba29c6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:43.635934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4007bf8-d397-4164-904c-c1750bba29c6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:43.638136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4007bf8-d397-4164-904c-c1750bba29c6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:43.639410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4007bf8-d397-4164-904c-c1750bba29c6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:43.645662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4007bf8-d397-4164-904c-c1750bba29c6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:43.646527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4007bf8-d397-4164-904c-c1750bba29c6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:43.647223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4007bf8-d397-4164-904c-c1750bba29c6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:43.980405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a4007bf8-d397-4164-904c-c1750bba29c6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:43.987942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:44:44.000792 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a4007bf8-d397-4164-904c-c1750bba29c6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1271 microversion: 2.1 time: 0.394131 Oct 10 23:44:44.001471 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2531/5229] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:43 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1271 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:44.311464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-68a22179-2281-4ac4-acc9-efdf771e5ed3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:44.324141 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-68a22179-2281-4ac4-acc9-efdf771e5ed3 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1454 microversion: 2.1 time: 0.790757 Oct 10 23:44:44.328233 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2699/5230] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:43 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1454 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:44.392800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-df2bdff5-9601-4e43-b6a0-7f619b6d9b76 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:44:44.393565 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-df2bdff5-9601-4e43-b6a0-7f619b6d9b76 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:44.414717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df2bdff5-9601-4e43-b6a0-7f619b6d9b76 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:44.415506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df2bdff5-9601-4e43-b6a0-7f619b6d9b76 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:44.417116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df2bdff5-9601-4e43-b6a0-7f619b6d9b76 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:44.418689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df2bdff5-9601-4e43-b6a0-7f619b6d9b76 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:44.421436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df2bdff5-9601-4e43-b6a0-7f619b6d9b76 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:44.422375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-df2bdff5-9601-4e43-b6a0-7f619b6d9b76 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:44.433085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ac64f8aa-6d7d-450c-a4b1-b2fb6a4fe2b2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:44.433767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ac64f8aa-6d7d-450c-a4b1-b2fb6a4fe2b2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b1cad8e1-6af5-4151-8635-926f77f2ca07] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:44.446246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac64f8aa-6d7d-450c-a4b1-b2fb6a4fe2b2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:44.447037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac64f8aa-6d7d-450c-a4b1-b2fb6a4fe2b2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:44.449014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac64f8aa-6d7d-450c-a4b1-b2fb6a4fe2b2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:44.450196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac64f8aa-6d7d-450c-a4b1-b2fb6a4fe2b2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:44.452854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac64f8aa-6d7d-450c-a4b1-b2fb6a4fe2b2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:44.454175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac64f8aa-6d7d-450c-a4b1-b2fb6a4fe2b2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:44.512233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-df2bdff5-9601-4e43-b6a0-7f619b6d9b76 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lazy-loading 'flavor' on Instance uuid efc9e449-6324-411e-8af9-0533b23a4e3c {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:44:44.539813 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-df2bdff5-9601-4e43-b6a0-7f619b6d9b76 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Cannot 'shelve' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state shelved_offloaded Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-df2bdff5-9601-4e43-b6a0-7f619b6d9b76 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action HTTP/1.1 Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 14 Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: {"shelve": {}} Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: exception: Cannot 'shelve' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state shelved_offloaded Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'efc9e449-6324-411e-8af9-0533b23a4e3c', 'body': {'shelve': {}}} Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance efc9e449-6324-411e-8af9-0533b23a4e3c in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 23:44:44.541603 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 23:44:44.547981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 23:44:44.547981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state shelved_offloaded Oct 10 23:44:44.547981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:44:44.547981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:44:44.547981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:44:44.547981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:44:44.547981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:44:44.547981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:44:44.547981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:44:44.547981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:44:44.547981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state shelved_offloaded Oct 10 23:44:44.547981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:44:44.560393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-df2bdff5-9601-4e43-b6a0-7f619b6d9b76 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 409 to user: Cannot 'shelve' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state shelved_offloaded {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:44:44.564530 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-df2bdff5-9601-4e43-b6a0-7f619b6d9b76 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action" status: 409 len: 155 microversion: 2.1 time: 0.174646 Oct 10 23:44:44.566972 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2532/5231] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:44:44 2022] POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action => generated 155 bytes in 180 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:44:44.584816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1ae21402-c8fe-4814-b73b-c38240c30ed1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:44.585827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1ae21402-c8fe-4814-b73b-c38240c30ed1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:44.604467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ac64f8aa-6d7d-450c-a4b1-b2fb6a4fe2b2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:44.605245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ae21402-c8fe-4814-b73b-c38240c30ed1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:44.605841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ae21402-c8fe-4814-b73b-c38240c30ed1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:44.608606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ae21402-c8fe-4814-b73b-c38240c30ed1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:44.609882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ae21402-c8fe-4814-b73b-c38240c30ed1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:44.613878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ae21402-c8fe-4814-b73b-c38240c30ed1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:44.614771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ae21402-c8fe-4814-b73b-c38240c30ed1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:44.619266 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ac64f8aa-6d7d-450c-a4b1-b2fb6a4fe2b2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07" status: 200 len: 1251 microversion: 2.1 time: 0.188738 Oct 10 23:44:44.619916 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2700/5232] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:44 2022] GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07 => generated 1251 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:44.633752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f43194df-9058-4f10-978a-9fd80c271d54 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:44:44.634787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f43194df-9058-4f10-978a-9fd80c271d54 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:44.651099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f43194df-9058-4f10-978a-9fd80c271d54 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:44.652725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f43194df-9058-4f10-978a-9fd80c271d54 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:44.653196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f43194df-9058-4f10-978a-9fd80c271d54 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:44.655783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f43194df-9058-4f10-978a-9fd80c271d54 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:44.657538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f43194df-9058-4f10-978a-9fd80c271d54 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:44.658019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f43194df-9058-4f10-978a-9fd80c271d54 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:44.755537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f43194df-9058-4f10-978a-9fd80c271d54 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120613) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 10 23:44:44.773674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1ae21402-c8fe-4814-b73b-c38240c30ed1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:44.788628 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1ae21402-c8fe-4814-b73b-c38240c30ed1 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1276 microversion: 2.1 time: 0.217325 Oct 10 23:44:44.809194 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2533/5233] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:44 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1276 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:44.923878 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f43194df-9058-4f10-978a-9fd80c271d54 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action" status: 202 len: 0 microversion: 2.1 time: 0.302428 Oct 10 23:44:44.925134 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2701/5234] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:44:44 2022] POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:44:44.934657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6093736f-6369-4589-af1b-518119d12696 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:44.937809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6093736f-6369-4589-af1b-518119d12696 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:44.954211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6093736f-6369-4589-af1b-518119d12696 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:44.955203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6093736f-6369-4589-af1b-518119d12696 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:44.955859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6093736f-6369-4589-af1b-518119d12696 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:44.957178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6093736f-6369-4589-af1b-518119d12696 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:44.958302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6093736f-6369-4589-af1b-518119d12696 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:44.959006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6093736f-6369-4589-af1b-518119d12696 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:45.034147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3a7cb33e-f4af-4c62-b22b-673f92ccef85 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:45.035591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3a7cb33e-f4af-4c62-b22b-673f92ccef85 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:45.055665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a7cb33e-f4af-4c62-b22b-673f92ccef85 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:45.071467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a7cb33e-f4af-4c62-b22b-673f92ccef85 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:45.072270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a7cb33e-f4af-4c62-b22b-673f92ccef85 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:45.073288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a7cb33e-f4af-4c62-b22b-673f92ccef85 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:45.086818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a7cb33e-f4af-4c62-b22b-673f92ccef85 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:45.088516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a7cb33e-f4af-4c62-b22b-673f92ccef85 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:45.303986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3a7cb33e-f4af-4c62-b22b-673f92ccef85 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:45.325778 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3a7cb33e-f4af-4c62-b22b-673f92ccef85 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1271 microversion: 2.1 time: 0.301749 Oct 10 23:44:45.327287 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2702/5235] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:45 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1271 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:45.651108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3cbfe28f-e49f-4754-b85b-74d91d58772e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:45.651992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3cbfe28f-e49f-4754-b85b-74d91d58772e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b1cad8e1-6af5-4151-8635-926f77f2ca07] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:45.676317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cbfe28f-e49f-4754-b85b-74d91d58772e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:45.676939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cbfe28f-e49f-4754-b85b-74d91d58772e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:45.677444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cbfe28f-e49f-4754-b85b-74d91d58772e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:45.678289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cbfe28f-e49f-4754-b85b-74d91d58772e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:45.678760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cbfe28f-e49f-4754-b85b-74d91d58772e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:45.679199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cbfe28f-e49f-4754-b85b-74d91d58772e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:46.066976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6093736f-6369-4589-af1b-518119d12696 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:46.077155 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6093736f-6369-4589-af1b-518119d12696 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1462 microversion: 2.1 time: 1.147303 Oct 10 23:44:46.082700 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2534/5236] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:44 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1462 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:44:46.106822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1d53d1d9-b5a5-4a5a-b7a1-ad7921dbd03b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:46.107841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1d53d1d9-b5a5-4a5a-b7a1-ad7921dbd03b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:46.121715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d53d1d9-b5a5-4a5a-b7a1-ad7921dbd03b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:46.126394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d53d1d9-b5a5-4a5a-b7a1-ad7921dbd03b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:46.127080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d53d1d9-b5a5-4a5a-b7a1-ad7921dbd03b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:46.128027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d53d1d9-b5a5-4a5a-b7a1-ad7921dbd03b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:46.128665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d53d1d9-b5a5-4a5a-b7a1-ad7921dbd03b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:46.129262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d53d1d9-b5a5-4a5a-b7a1-ad7921dbd03b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:46.352716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1d53d1d9-b5a5-4a5a-b7a1-ad7921dbd03b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:46.364598 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1d53d1d9-b5a5-4a5a-b7a1-ad7921dbd03b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1276 microversion: 2.1 time: 0.280545 Oct 10 23:44:46.366853 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2535/5237] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:46 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1276 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:46.372724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-66edac68-5eb0-4fcf-974c-f8aed46ae54e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:46.374670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-66edac68-5eb0-4fcf-974c-f8aed46ae54e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:46.383232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66edac68-5eb0-4fcf-974c-f8aed46ae54e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:46.384167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66edac68-5eb0-4fcf-974c-f8aed46ae54e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:46.384878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66edac68-5eb0-4fcf-974c-f8aed46ae54e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:46.386717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66edac68-5eb0-4fcf-974c-f8aed46ae54e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:46.387840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66edac68-5eb0-4fcf-974c-f8aed46ae54e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:46.388556 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66edac68-5eb0-4fcf-974c-f8aed46ae54e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:46.547767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:44:47.083989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3cbfe28f-e49f-4754-b85b-74d91d58772e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:47.085877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-66edac68-5eb0-4fcf-974c-f8aed46ae54e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:47.101991 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-66edac68-5eb0-4fcf-974c-f8aed46ae54e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1313 microversion: 2.1 time: 0.729812 Oct 10 23:44:47.106449 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2536/5238] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:46 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1313 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:47.112830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-35a0a3c7-3c26-4a07-bde3-84a992495f08 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:47.115288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-35a0a3c7-3c26-4a07-bde3-84a992495f08 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:47.129620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35a0a3c7-3c26-4a07-bde3-84a992495f08 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:47.130701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35a0a3c7-3c26-4a07-bde3-84a992495f08 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:47.131432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35a0a3c7-3c26-4a07-bde3-84a992495f08 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:47.132585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35a0a3c7-3c26-4a07-bde3-84a992495f08 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:47.132997 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3cbfe28f-e49f-4754-b85b-74d91d58772e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07" status: 200 len: 1293 microversion: 2.1 time: 1.487919 Oct 10 23:44:47.133928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35a0a3c7-3c26-4a07-bde3-84a992495f08 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:47.135346 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2703/5239] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:45 2022] GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07 => generated 1293 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:47.138703 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35a0a3c7-3c26-4a07-bde3-84a992495f08 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:47.398522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7ae62c97-a899-4af2-a490-eddd0595fa5b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:47.399229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7ae62c97-a899-4af2-a490-eddd0595fa5b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:47.408201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ae62c97-a899-4af2-a490-eddd0595fa5b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:47.413274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ae62c97-a899-4af2-a490-eddd0595fa5b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:47.415248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ae62c97-a899-4af2-a490-eddd0595fa5b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:47.428345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ae62c97-a899-4af2-a490-eddd0595fa5b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:47.430130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ae62c97-a899-4af2-a490-eddd0595fa5b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:47.440259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ae62c97-a899-4af2-a490-eddd0595fa5b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:48.252832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-35a0a3c7-3c26-4a07-bde3-84a992495f08 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:48.271334 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-35a0a3c7-3c26-4a07-bde3-84a992495f08 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1462 microversion: 2.1 time: 1.161983 Oct 10 23:44:48.281410 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2537/5240] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:47 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1462 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:48.289594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2d0ade63-f492-4047-b1ac-959c167793b5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:48.289594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2d0ade63-f492-4047-b1ac-959c167793b5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:48.300341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d0ade63-f492-4047-b1ac-959c167793b5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:48.300842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d0ade63-f492-4047-b1ac-959c167793b5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:48.301295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d0ade63-f492-4047-b1ac-959c167793b5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:48.304909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d0ade63-f492-4047-b1ac-959c167793b5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:48.305419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d0ade63-f492-4047-b1ac-959c167793b5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:48.305874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2d0ade63-f492-4047-b1ac-959c167793b5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:48.744109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7ae62c97-a899-4af2-a490-eddd0595fa5b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:48.779035 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7ae62c97-a899-4af2-a490-eddd0595fa5b tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1318 microversion: 2.1 time: 1.385791 Oct 10 23:44:48.781077 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2704/5241] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:47 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1318 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:48.799220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5f5e5580-0e13-49c0-855a-6f6a4fb5b1a9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:48.803055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5f5e5580-0e13-49c0-855a-6f6a4fb5b1a9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b1cad8e1-6af5-4151-8635-926f77f2ca07] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:48.827960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f5e5580-0e13-49c0-855a-6f6a4fb5b1a9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:48.831972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f5e5580-0e13-49c0-855a-6f6a4fb5b1a9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:48.832836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f5e5580-0e13-49c0-855a-6f6a4fb5b1a9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:48.834142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f5e5580-0e13-49c0-855a-6f6a4fb5b1a9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:48.839667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f5e5580-0e13-49c0-855a-6f6a4fb5b1a9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:48.840842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f5e5580-0e13-49c0-855a-6f6a4fb5b1a9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:49.614330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5f5e5580-0e13-49c0-855a-6f6a4fb5b1a9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:49.625070 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5f5e5580-0e13-49c0-855a-6f6a4fb5b1a9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07" status: 200 len: 1293 microversion: 2.1 time: 0.841018 Oct 10 23:44:49.629745 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2705/5242] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:48 2022] GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07 => generated 1293 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:49.640907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-43f34049-cfd8-482c-8d41-d86c9c95dc87 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:49.644949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-43f34049-cfd8-482c-8d41-d86c9c95dc87 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:49.663492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43f34049-cfd8-482c-8d41-d86c9c95dc87 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:49.673182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43f34049-cfd8-482c-8d41-d86c9c95dc87 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:49.674561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43f34049-cfd8-482c-8d41-d86c9c95dc87 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:49.675643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43f34049-cfd8-482c-8d41-d86c9c95dc87 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:49.677024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43f34049-cfd8-482c-8d41-d86c9c95dc87 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:49.677174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43f34049-cfd8-482c-8d41-d86c9c95dc87 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:50.071955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-43f34049-cfd8-482c-8d41-d86c9c95dc87 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:50.096064 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-43f34049-cfd8-482c-8d41-d86c9c95dc87 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1520 microversion: 2.1 time: 0.461940 Oct 10 23:44:50.143072 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2706/5243] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:49 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1520 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:50.169535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3c19a92b-3fb7-4fcb-9e59-94824183f657 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:50.171856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3c19a92b-3fb7-4fcb-9e59-94824183f657 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:50.185440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c19a92b-3fb7-4fcb-9e59-94824183f657 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:50.186877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c19a92b-3fb7-4fcb-9e59-94824183f657 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:50.187713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c19a92b-3fb7-4fcb-9e59-94824183f657 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:50.188697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c19a92b-3fb7-4fcb-9e59-94824183f657 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:50.189609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c19a92b-3fb7-4fcb-9e59-94824183f657 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:50.190271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c19a92b-3fb7-4fcb-9e59-94824183f657 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:50.210033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2d0ade63-f492-4047-b1ac-959c167793b5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:50.226295 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2d0ade63-f492-4047-b1ac-959c167793b5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1313 microversion: 2.1 time: 1.951995 Oct 10 23:44:50.244763 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2538/5244] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:48 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1313 bytes in 1972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:50.272158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-7b66cc36-4740-4c2a-9384-063f03882207 req-153ea948-9306-456d-a40f-16f09425c932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1cad8e1-6af5-4151-8635-926f77f2ca07", "tag": "7d9a3838-d2f8-4bb5-85f2-5f7c173eaead"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:44:50.313905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7b66cc36-4740-4c2a-9384-063f03882207 req-153ea948-9306-456d-a40f-16f09425c932 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:50.314475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7b66cc36-4740-4c2a-9384-063f03882207 req-153ea948-9306-456d-a40f-16f09425c932 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:50.314837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7b66cc36-4740-4c2a-9384-063f03882207 req-153ea948-9306-456d-a40f-16f09425c932 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:50.344065 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-7b66cc36-4740-4c2a-9384-063f03882207 req-153ea948-9306-456d-a40f-16f09425c932 service nova] Creating event network-changed:7d9a3838-d2f8-4bb5-85f2-5f7c173eaead for instance b1cad8e1-6af5-4151-8635-926f77f2ca07 on n-h2-860864-2 Oct 10 23:44:50.356552 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-7b66cc36-4740-4c2a-9384-063f03882207 req-153ea948-9306-456d-a40f-16f09425c932 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093750 Oct 10 23:44:50.358477 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2539/5245] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:44:50.409007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:44:50.479050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=12 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:44:50.657037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-99537c0c-9b98-4a61-a04b-0e0be1b8282b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:50.657855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-99537c0c-9b98-4a61-a04b-0e0be1b8282b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b1cad8e1-6af5-4151-8635-926f77f2ca07] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:50.673358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99537c0c-9b98-4a61-a04b-0e0be1b8282b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:50.674222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99537c0c-9b98-4a61-a04b-0e0be1b8282b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:50.674856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99537c0c-9b98-4a61-a04b-0e0be1b8282b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:50.676245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99537c0c-9b98-4a61-a04b-0e0be1b8282b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:50.677176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99537c0c-9b98-4a61-a04b-0e0be1b8282b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:50.678439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99537c0c-9b98-4a61-a04b-0e0be1b8282b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:50.740201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=12 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:44:50.805561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3c19a92b-3fb7-4fcb-9e59-94824183f657 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:50.817943 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3c19a92b-3fb7-4fcb-9e59-94824183f657 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1318 microversion: 2.1 time: 0.668504 Oct 10 23:44:50.819030 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2707/5246] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:50 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1318 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:51.171012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f78b62b7-6a0b-477c-8624-c8ed9ac5cbcc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:51.171734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f78b62b7-6a0b-477c-8624-c8ed9ac5cbcc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:51.185847 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f78b62b7-6a0b-477c-8624-c8ed9ac5cbcc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:51.187025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f78b62b7-6a0b-477c-8624-c8ed9ac5cbcc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:51.187566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f78b62b7-6a0b-477c-8624-c8ed9ac5cbcc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:51.188438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f78b62b7-6a0b-477c-8624-c8ed9ac5cbcc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:51.188909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f78b62b7-6a0b-477c-8624-c8ed9ac5cbcc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:51.189728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f78b62b7-6a0b-477c-8624-c8ed9ac5cbcc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:51.409368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f78b62b7-6a0b-477c-8624-c8ed9ac5cbcc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:51.423486 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f78b62b7-6a0b-477c-8624-c8ed9ac5cbcc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1520 microversion: 2.1 time: 0.257586 Oct 10 23:44:51.425064 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2708/5247] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:51 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:44:51.431019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7bbade9d-f2e3-445b-9fe7-2e2ab8ac6d9e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:51.441201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7bbade9d-f2e3-445b-9fe7-2e2ab8ac6d9e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:51.448939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bbade9d-f2e3-445b-9fe7-2e2ab8ac6d9e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:51.452783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bbade9d-f2e3-445b-9fe7-2e2ab8ac6d9e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:51.454902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bbade9d-f2e3-445b-9fe7-2e2ab8ac6d9e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:51.456003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bbade9d-f2e3-445b-9fe7-2e2ab8ac6d9e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:51.457435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bbade9d-f2e3-445b-9fe7-2e2ab8ac6d9e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:51.459223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bbade9d-f2e3-445b-9fe7-2e2ab8ac6d9e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:51.487802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-99537c0c-9b98-4a61-a04b-0e0be1b8282b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:51.507867 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-99537c0c-9b98-4a61-a04b-0e0be1b8282b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07" status: 200 len: 1293 microversion: 2.1 time: 0.855928 Oct 10 23:44:51.510440 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2540/5248] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:50 2022] GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07 => generated 1293 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:44:51.661165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7bbade9d-f2e3-445b-9fe7-2e2ab8ac6d9e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:51.674181 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7bbade9d-f2e3-445b-9fe7-2e2ab8ac6d9e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1313 microversion: 2.1 time: 0.247116 Oct 10 23:44:51.675181 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2709/5249] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:51 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:51.857551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f024f54f-c665-4d74-9954-f00782aa0c6f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:51.861341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f024f54f-c665-4d74-9954-f00782aa0c6f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:51.888730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f024f54f-c665-4d74-9954-f00782aa0c6f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:51.889889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f024f54f-c665-4d74-9954-f00782aa0c6f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:51.895843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f024f54f-c665-4d74-9954-f00782aa0c6f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:51.896892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f024f54f-c665-4d74-9954-f00782aa0c6f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:51.898290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f024f54f-c665-4d74-9954-f00782aa0c6f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:51.898920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f024f54f-c665-4d74-9954-f00782aa0c6f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:52.461544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-29767b9c-2539-4a85-a259-30b3e9f6a9de tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:52.462891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-29767b9c-2539-4a85-a259-30b3e9f6a9de tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:52.472277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29767b9c-2539-4a85-a259-30b3e9f6a9de tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:52.473110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29767b9c-2539-4a85-a259-30b3e9f6a9de tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:52.473765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29767b9c-2539-4a85-a259-30b3e9f6a9de tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:52.474699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29767b9c-2539-4a85-a259-30b3e9f6a9de tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:52.475376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29767b9c-2539-4a85-a259-30b3e9f6a9de tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:52.476000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29767b9c-2539-4a85-a259-30b3e9f6a9de tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:52.789109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-29767b9c-2539-4a85-a259-30b3e9f6a9de tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:52.809495 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-29767b9c-2539-4a85-a259-30b3e9f6a9de tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1520 microversion: 2.1 time: 0.358096 Oct 10 23:44:52.835819 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2710/5250] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:52 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1520 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:52.845662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-53f2f9d6-b5f2-46f8-9ee8-f3f4546e1154 req-8a1d9b65-c4fd-4d1b-9d51-72b4b8d0865f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf", "tag": "9723fc72-e0e5-4907-9c7f-9bef1c53e610"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:44:52.861655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-53f2f9d6-b5f2-46f8-9ee8-f3f4546e1154 req-8a1d9b65-c4fd-4d1b-9d51-72b4b8d0865f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:52.862486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-53f2f9d6-b5f2-46f8-9ee8-f3f4546e1154 req-8a1d9b65-c4fd-4d1b-9d51-72b4b8d0865f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:52.863353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-53f2f9d6-b5f2-46f8-9ee8-f3f4546e1154 req-8a1d9b65-c4fd-4d1b-9d51-72b4b8d0865f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:52.879925 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-53f2f9d6-b5f2-46f8-9ee8-f3f4546e1154 req-8a1d9b65-c4fd-4d1b-9d51-72b4b8d0865f service nova] Creating event network-changed:9723fc72-e0e5-4907-9c7f-9bef1c53e610 for instance 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf on n-h1-860864-2 Oct 10 23:44:52.886544 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-53f2f9d6-b5f2-46f8-9ee8-f3f4546e1154 req-8a1d9b65-c4fd-4d1b-9d51-72b4b8d0865f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048669 Oct 10 23:44:52.887283 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2711/5251] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:44:52.894290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4cd3abef-7025-4641-97dd-5bd2ddd14bee tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:52.896961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4cd3abef-7025-4641-97dd-5bd2ddd14bee tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b1cad8e1-6af5-4151-8635-926f77f2ca07] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:52.906908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cd3abef-7025-4641-97dd-5bd2ddd14bee tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:52.907419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cd3abef-7025-4641-97dd-5bd2ddd14bee tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:52.907858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cd3abef-7025-4641-97dd-5bd2ddd14bee tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:52.908844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cd3abef-7025-4641-97dd-5bd2ddd14bee tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:52.909764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cd3abef-7025-4641-97dd-5bd2ddd14bee tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:52.911127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cd3abef-7025-4641-97dd-5bd2ddd14bee tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:53.063264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f024f54f-c665-4d74-9954-f00782aa0c6f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:53.100049 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f024f54f-c665-4d74-9954-f00782aa0c6f tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1318 microversion: 2.1 time: 1.260809 Oct 10 23:44:53.117295 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2541/5252] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:51 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1318 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:53.136029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-35f4b785-24fc-4e88-810d-adb1eccf5932 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:53.138028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-35f4b785-24fc-4e88-810d-adb1eccf5932 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:53.146950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35f4b785-24fc-4e88-810d-adb1eccf5932 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:53.147430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35f4b785-24fc-4e88-810d-adb1eccf5932 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:53.148100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35f4b785-24fc-4e88-810d-adb1eccf5932 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:53.149027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35f4b785-24fc-4e88-810d-adb1eccf5932 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:53.149801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35f4b785-24fc-4e88-810d-adb1eccf5932 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:53.150440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-35f4b785-24fc-4e88-810d-adb1eccf5932 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:53.328433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4cd3abef-7025-4641-97dd-5bd2ddd14bee tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:53.331466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:44:53.342089 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4cd3abef-7025-4641-97dd-5bd2ddd14bee tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07" status: 200 len: 1293 microversion: 2.1 time: 0.453108 Oct 10 23:44:53.345042 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2712/5253] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:52 2022] GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07 => generated 1293 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:53.857873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4f3a433f-f702-40ec-bb89-149e1518a7a7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:53.859369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4f3a433f-f702-40ec-bb89-149e1518a7a7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:53.867685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f3a433f-f702-40ec-bb89-149e1518a7a7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:53.868434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f3a433f-f702-40ec-bb89-149e1518a7a7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:53.869047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f3a433f-f702-40ec-bb89-149e1518a7a7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:53.870357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f3a433f-f702-40ec-bb89-149e1518a7a7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:53.871193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f3a433f-f702-40ec-bb89-149e1518a7a7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:53.871794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f3a433f-f702-40ec-bb89-149e1518a7a7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:54.115486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4f3a433f-f702-40ec-bb89-149e1518a7a7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:54.130159 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4f3a433f-f702-40ec-bb89-149e1518a7a7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1520 microversion: 2.1 time: 0.275597 Oct 10 23:44:54.130772 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2713/5254] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:53 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:44:54.140082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5bba128d-50fc-4f0e-8a54-69cdb38866d5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:54.140503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5bba128d-50fc-4f0e-8a54-69cdb38866d5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:54.151395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bba128d-50fc-4f0e-8a54-69cdb38866d5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:54.152252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bba128d-50fc-4f0e-8a54-69cdb38866d5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:54.152951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bba128d-50fc-4f0e-8a54-69cdb38866d5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:54.154023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bba128d-50fc-4f0e-8a54-69cdb38866d5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:54.154838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bba128d-50fc-4f0e-8a54-69cdb38866d5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:54.155514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bba128d-50fc-4f0e-8a54-69cdb38866d5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:54.366132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5bba128d-50fc-4f0e-8a54-69cdb38866d5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:54.383977 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5bba128d-50fc-4f0e-8a54-69cdb38866d5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1318 microversion: 2.1 time: 0.248311 Oct 10 23:44:54.384905 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2714/5255] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:54 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:44:54.425654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7e66ed2b-c35d-4e49-ac4f-5eb00fedb2ec tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:54.426610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7e66ed2b-c35d-4e49-ac4f-5eb00fedb2ec tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b1cad8e1-6af5-4151-8635-926f77f2ca07] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:54.438140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e66ed2b-c35d-4e49-ac4f-5eb00fedb2ec tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:54.438978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e66ed2b-c35d-4e49-ac4f-5eb00fedb2ec tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:54.439738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e66ed2b-c35d-4e49-ac4f-5eb00fedb2ec tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:54.440958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e66ed2b-c35d-4e49-ac4f-5eb00fedb2ec tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:54.441916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e66ed2b-c35d-4e49-ac4f-5eb00fedb2ec tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:54.443376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-35f4b785-24fc-4e88-810d-adb1eccf5932 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:54.453599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e66ed2b-c35d-4e49-ac4f-5eb00fedb2ec tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:54.454226 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-35f4b785-24fc-4e88-810d-adb1eccf5932 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1313 microversion: 2.1 time: 1.335538 Oct 10 23:44:54.470898 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2542/5256] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:53 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1313 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:54.648463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7e66ed2b-c35d-4e49-ac4f-5eb00fedb2ec tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:54.672955 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7e66ed2b-c35d-4e49-ac4f-5eb00fedb2ec tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07" status: 200 len: 1293 microversion: 2.1 time: 0.272565 Oct 10 23:44:54.686568 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2715/5257] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:54 2022] GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07 => generated 1293 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:55.171386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d816abe5-4dcc-4e46-8234-a6f5d9689a17 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:55.175032 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d816abe5-4dcc-4e46-8234-a6f5d9689a17 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:55.187268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d816abe5-4dcc-4e46-8234-a6f5d9689a17 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:55.188569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d816abe5-4dcc-4e46-8234-a6f5d9689a17 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:55.189468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d816abe5-4dcc-4e46-8234-a6f5d9689a17 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:55.190767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d816abe5-4dcc-4e46-8234-a6f5d9689a17 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:55.191245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d816abe5-4dcc-4e46-8234-a6f5d9689a17 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:55.191708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d816abe5-4dcc-4e46-8234-a6f5d9689a17 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:55.234705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-33f3eeb3-80e3-4c54-b043-97fd676884ad tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0c24c40-d827-4395-bb6a-c47cd9168744", "device": "/dev/sdb"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:44:55.241848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-33f3eeb3-80e3-4c54-b043-97fd676884ad tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 1f082ddb-a09e-4a05-9233-108fa544b12b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:55.268021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33f3eeb3-80e3-4c54-b043-97fd676884ad tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:55.268528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33f3eeb3-80e3-4c54-b043-97fd676884ad tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:55.268977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33f3eeb3-80e3-4c54-b043-97fd676884ad tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:55.269736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33f3eeb3-80e3-4c54-b043-97fd676884ad tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:55.270198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33f3eeb3-80e3-4c54-b043-97fd676884ad tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:55.270628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33f3eeb3-80e3-4c54-b043-97fd676884ad tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:55.743472 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-33f3eeb3-80e3-4c54-b043-97fd676884ad tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "POST /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.515722 Oct 10 23:44:55.755822 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2716/5258] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Oct 10 23:44:55 2022] POST /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b/os-volume_attachments => generated 194 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:44:55.767265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-58825ab8-77af-4bfd-a77b-dfb38458a1a5 req-d049f5c7-455f-4728-adbb-b1e824548c37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a649c07-a625-4509-9cd7-e03fe39f4948", "tag": "9c73069d-2cea-4b50-92ef-2d609cecdde7"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:44:55.789639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-58825ab8-77af-4bfd-a77b-dfb38458a1a5 req-d049f5c7-455f-4728-adbb-b1e824548c37 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:55.790818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-58825ab8-77af-4bfd-a77b-dfb38458a1a5 req-d049f5c7-455f-4728-adbb-b1e824548c37 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:55.791778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-58825ab8-77af-4bfd-a77b-dfb38458a1a5 req-d049f5c7-455f-4728-adbb-b1e824548c37 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:55.831860 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-58825ab8-77af-4bfd-a77b-dfb38458a1a5 req-d049f5c7-455f-4728-adbb-b1e824548c37 service nova] Creating event network-changed:9c73069d-2cea-4b50-92ef-2d609cecdde7 for instance 6a649c07-a625-4509-9cd7-e03fe39f4948 on n-h2-860864-2 Oct 10 23:44:55.841631 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-58825ab8-77af-4bfd-a77b-dfb38458a1a5 req-d049f5c7-455f-4728-adbb-b1e824548c37 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083283 Oct 10 23:44:55.844209 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2717/5259] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:44:55.862963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c47c64ee-5129-4d91-8a31-09cb64cff769 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:55.865096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c47c64ee-5129-4d91-8a31-09cb64cff769 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:55.879263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c47c64ee-5129-4d91-8a31-09cb64cff769 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:55.880841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c47c64ee-5129-4d91-8a31-09cb64cff769 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:55.881984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c47c64ee-5129-4d91-8a31-09cb64cff769 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:55.883605 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c47c64ee-5129-4d91-8a31-09cb64cff769 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:55.884481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c47c64ee-5129-4d91-8a31-09cb64cff769 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:55.885277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c47c64ee-5129-4d91-8a31-09cb64cff769 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:55.961862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d816abe5-4dcc-4e46-8234-a6f5d9689a17 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:55.974747 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d816abe5-4dcc-4e46-8234-a6f5d9689a17 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1520 microversion: 2.1 time: 0.823913 Oct 10 23:44:55.984020 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2543/5260] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:55 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1520 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:55.992419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-190951da-a6cc-44fe-848b-a8c807bdda12 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:55.993051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-190951da-a6cc-44fe-848b-a8c807bdda12 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:56.001750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-190951da-a6cc-44fe-848b-a8c807bdda12 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:56.002233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-190951da-a6cc-44fe-848b-a8c807bdda12 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:56.002672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-190951da-a6cc-44fe-848b-a8c807bdda12 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:56.003373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-190951da-a6cc-44fe-848b-a8c807bdda12 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:56.003825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-190951da-a6cc-44fe-848b-a8c807bdda12 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:56.004406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-190951da-a6cc-44fe-848b-a8c807bdda12 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:56.071823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c47c64ee-5129-4d91-8a31-09cb64cff769 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:56.081492 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c47c64ee-5129-4d91-8a31-09cb64cff769 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1318 microversion: 2.1 time: 0.235260 Oct 10 23:44:56.081919 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2718/5261] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:55 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:56.087124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f5c389fb-186f-45e5-b6dd-8013c09e5479 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:56.088116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f5c389fb-186f-45e5-b6dd-8013c09e5479 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b1cad8e1-6af5-4151-8635-926f77f2ca07] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:56.095666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5c389fb-186f-45e5-b6dd-8013c09e5479 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:56.096581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5c389fb-186f-45e5-b6dd-8013c09e5479 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:56.097030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5c389fb-186f-45e5-b6dd-8013c09e5479 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:56.097807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5c389fb-186f-45e5-b6dd-8013c09e5479 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:56.098274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5c389fb-186f-45e5-b6dd-8013c09e5479 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:56.098705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5c389fb-186f-45e5-b6dd-8013c09e5479 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:56.245741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f5c389fb-186f-45e5-b6dd-8013c09e5479 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:56.255197 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f5c389fb-186f-45e5-b6dd-8013c09e5479 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07" status: 200 len: 1293 microversion: 2.1 time: 0.172164 Oct 10 23:44:56.255796 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2719/5262] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:56 2022] GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07 => generated 1293 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:56.804265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-190951da-a6cc-44fe-848b-a8c807bdda12 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:56.841499 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-190951da-a6cc-44fe-848b-a8c807bdda12 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1313 microversion: 2.1 time: 0.853920 Oct 10 23:44:56.842858 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2544/5263] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:55 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1313 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:56.868673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-afdaa7cb-89d2-482a-a2b3-856f2fb9b13c req-9df76922-bade-4c2c-8d47-4a13c51498cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1cad8e1-6af5-4151-8635-926f77f2ca07", "name": "network-vif-plugged", "status": "completed", "tag": "7d9a3838-d2f8-4bb5-85f2-5f7c173eaead"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:44:56.882697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-afdaa7cb-89d2-482a-a2b3-856f2fb9b13c req-9df76922-bade-4c2c-8d47-4a13c51498cf service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:56.883292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-afdaa7cb-89d2-482a-a2b3-856f2fb9b13c req-9df76922-bade-4c2c-8d47-4a13c51498cf service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:56.883925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-afdaa7cb-89d2-482a-a2b3-856f2fb9b13c req-9df76922-bade-4c2c-8d47-4a13c51498cf service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:56.902008 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-afdaa7cb-89d2-482a-a2b3-856f2fb9b13c req-9df76922-bade-4c2c-8d47-4a13c51498cf service nova] Creating event network-vif-plugged:7d9a3838-d2f8-4bb5-85f2-5f7c173eaead for instance b1cad8e1-6af5-4151-8635-926f77f2ca07 on n-h2-860864-2 Oct 10 23:44:56.913893 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-afdaa7cb-89d2-482a-a2b3-856f2fb9b13c req-9df76922-bade-4c2c-8d47-4a13c51498cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049309 Oct 10 23:44:56.915050 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2720/5264] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:44:57.005844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0a2e63da-a0c6-4802-9537-5c40afd12f76 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:57.006799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0a2e63da-a0c6-4802-9537-5c40afd12f76 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:57.024173 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a2e63da-a0c6-4802-9537-5c40afd12f76 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:57.024759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a2e63da-a0c6-4802-9537-5c40afd12f76 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:57.025203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a2e63da-a0c6-4802-9537-5c40afd12f76 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:57.026014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a2e63da-a0c6-4802-9537-5c40afd12f76 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:57.026474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a2e63da-a0c6-4802-9537-5c40afd12f76 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:57.026933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a2e63da-a0c6-4802-9537-5c40afd12f76 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:57.108335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a8d1bb60-24be-4c29-820d-23269db60ce4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:57.109531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a8d1bb60-24be-4c29-820d-23269db60ce4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:57.124980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8d1bb60-24be-4c29-820d-23269db60ce4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:57.126323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8d1bb60-24be-4c29-820d-23269db60ce4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:57.127340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8d1bb60-24be-4c29-820d-23269db60ce4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:57.129054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8d1bb60-24be-4c29-820d-23269db60ce4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:57.130007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8d1bb60-24be-4c29-820d-23269db60ce4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:57.131108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8d1bb60-24be-4c29-820d-23269db60ce4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:57.343887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a8d1bb60-24be-4c29-820d-23269db60ce4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:57.353228 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a8d1bb60-24be-4c29-820d-23269db60ce4 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1318 microversion: 2.1 time: 0.251442 Oct 10 23:44:57.363899 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2721/5265] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:57 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:57.363899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1ccf5dc0-7788-4407-b56f-5e4fdd8a4c2f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:57.363899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1ccf5dc0-7788-4407-b56f-5e4fdd8a4c2f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b1cad8e1-6af5-4151-8635-926f77f2ca07] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:57.370970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ccf5dc0-7788-4407-b56f-5e4fdd8a4c2f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:57.371588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ccf5dc0-7788-4407-b56f-5e4fdd8a4c2f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:57.372098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ccf5dc0-7788-4407-b56f-5e4fdd8a4c2f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:57.372882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ccf5dc0-7788-4407-b56f-5e4fdd8a4c2f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:57.374006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ccf5dc0-7788-4407-b56f-5e4fdd8a4c2f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:57.374446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ccf5dc0-7788-4407-b56f-5e4fdd8a4c2f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:57.399073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0a2e63da-a0c6-4802-9537-5c40afd12f76 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:57.426440 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0a2e63da-a0c6-4802-9537-5c40afd12f76 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1520 microversion: 2.1 time: 0.424431 Oct 10 23:44:57.428200 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2545/5266] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:56 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1520 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:57.576255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1ccf5dc0-7788-4407-b56f-5e4fdd8a4c2f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:57.594563 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1ccf5dc0-7788-4407-b56f-5e4fdd8a4c2f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07" status: 200 len: 1293 microversion: 2.1 time: 0.238999 Oct 10 23:44:57.595730 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2722/5267] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:57 2022] GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07 => generated 1293 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:57.878142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8687a136-1406-43f9-adee-fa52273f105f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:57.878762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8687a136-1406-43f9-adee-fa52273f105f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:57.895686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8687a136-1406-43f9-adee-fa52273f105f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:57.896237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8687a136-1406-43f9-adee-fa52273f105f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:57.901860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8687a136-1406-43f9-adee-fa52273f105f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:57.903012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8687a136-1406-43f9-adee-fa52273f105f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:57.903953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8687a136-1406-43f9-adee-fa52273f105f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:57.903953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8687a136-1406-43f9-adee-fa52273f105f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:57.944432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-49b612c6-2828-4e81-9f99-2948ee5c1113 req-2c92f697-85e8-4571-99a5-a66a7d7bd638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efc9e449-6324-411e-8af9-0533b23a4e3c", "tag": "c8d69949-457f-46f6-9402-4c349227f0a2"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:44:57.959308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-49b612c6-2828-4e81-9f99-2948ee5c1113 req-2c92f697-85e8-4571-99a5-a66a7d7bd638 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:57.960949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-49b612c6-2828-4e81-9f99-2948ee5c1113 req-2c92f697-85e8-4571-99a5-a66a7d7bd638 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:57.961608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-49b612c6-2828-4e81-9f99-2948ee5c1113 req-2c92f697-85e8-4571-99a5-a66a7d7bd638 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:57.978673 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-49b612c6-2828-4e81-9f99-2948ee5c1113 req-2c92f697-85e8-4571-99a5-a66a7d7bd638 service nova] Creating event network-changed:c8d69949-457f-46f6-9402-4c349227f0a2 for instance efc9e449-6324-411e-8af9-0533b23a4e3c on n-h1-860864-2 Oct 10 23:44:57.987426 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-49b612c6-2828-4e81-9f99-2948ee5c1113 req-2c92f697-85e8-4571-99a5-a66a7d7bd638 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052675 Oct 10 23:44:57.990459 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2723/5268] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:44:58.381334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-707d7f9f-c3ae-43d5-b069-57a15bb8d30a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:58.382822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-707d7f9f-c3ae-43d5-b069-57a15bb8d30a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:58.398363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-707d7f9f-c3ae-43d5-b069-57a15bb8d30a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:58.401719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-707d7f9f-c3ae-43d5-b069-57a15bb8d30a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:58.402233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-707d7f9f-c3ae-43d5-b069-57a15bb8d30a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:58.403002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-707d7f9f-c3ae-43d5-b069-57a15bb8d30a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:58.403477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-707d7f9f-c3ae-43d5-b069-57a15bb8d30a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:58.403917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-707d7f9f-c3ae-43d5-b069-57a15bb8d30a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:58.614994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8687a136-1406-43f9-adee-fa52273f105f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:58.623845 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8687a136-1406-43f9-adee-fa52273f105f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1313 microversion: 2.1 time: 0.751649 Oct 10 23:44:58.637882 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2546/5269] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:57 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1313 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:58.647468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a7e11cbb-9b89-4450-bc7e-85f39018e3b4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:58.648378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a7e11cbb-9b89-4450-bc7e-85f39018e3b4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:58.663692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7e11cbb-9b89-4450-bc7e-85f39018e3b4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:58.664512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7e11cbb-9b89-4450-bc7e-85f39018e3b4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:58.665118 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7e11cbb-9b89-4450-bc7e-85f39018e3b4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:58.666876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7e11cbb-9b89-4450-bc7e-85f39018e3b4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:58.667555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7e11cbb-9b89-4450-bc7e-85f39018e3b4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:58.668163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7e11cbb-9b89-4450-bc7e-85f39018e3b4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:59.458650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-707d7f9f-c3ae-43d5-b069-57a15bb8d30a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:59.472998 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-707d7f9f-c3ae-43d5-b069-57a15bb8d30a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1318 microversion: 2.1 time: 1.097252 Oct 10 23:44:59.479932 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2724/5270] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:58 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1318 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:44:59.485684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7f0d7458-6270-4b3e-8ae0-88f6449e14d4 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:59.486316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7f0d7458-6270-4b3e-8ae0-88f6449e14d4 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b1cad8e1-6af5-4151-8635-926f77f2ca07] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:59.505465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f0d7458-6270-4b3e-8ae0-88f6449e14d4 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:59.506180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f0d7458-6270-4b3e-8ae0-88f6449e14d4 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:59.506827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f0d7458-6270-4b3e-8ae0-88f6449e14d4 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:59.518445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f0d7458-6270-4b3e-8ae0-88f6449e14d4 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:59.519117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f0d7458-6270-4b3e-8ae0-88f6449e14d4 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:59.519603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f0d7458-6270-4b3e-8ae0-88f6449e14d4 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:59.876793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7f0d7458-6270-4b3e-8ae0-88f6449e14d4 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:59.878492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a7e11cbb-9b89-4450-bc7e-85f39018e3b4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:44:59.894153 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a7e11cbb-9b89-4450-bc7e-85f39018e3b4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1520 microversion: 2.1 time: 1.253582 Oct 10 23:44:59.895858 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2547/5271] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:58 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1520 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:59.896256 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7f0d7458-6270-4b3e-8ae0-88f6449e14d4 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07" status: 200 len: 1293 microversion: 2.1 time: 0.415024 Oct 10 23:44:59.901777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eb996af1-208f-4dc4-8e39-00cd779e02b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:44:59.903206 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eb996af1-208f-4dc4-8e39-00cd779e02b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:44:59.910678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb996af1-208f-4dc4-8e39-00cd779e02b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:59.913811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb996af1-208f-4dc4-8e39-00cd779e02b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:59.914538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb996af1-208f-4dc4-8e39-00cd779e02b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:44:59.916479 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2725/5272] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:59 2022] GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07 => generated 1293 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:44:59.917570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb996af1-208f-4dc4-8e39-00cd779e02b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:44:59.918317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb996af1-208f-4dc4-8e39-00cd779e02b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:44:59.919057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eb996af1-208f-4dc4-8e39-00cd779e02b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:00.513311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8f67ece9-3ee3-45df-b4e0-fedefcf4e958 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:00.515143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8f67ece9-3ee3-45df-b4e0-fedefcf4e958 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:00.555986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:45:00.559187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f67ece9-3ee3-45df-b4e0-fedefcf4e958 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:00.568965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f67ece9-3ee3-45df-b4e0-fedefcf4e958 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:00.577623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f67ece9-3ee3-45df-b4e0-fedefcf4e958 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:00.578811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f67ece9-3ee3-45df-b4e0-fedefcf4e958 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:00.579300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f67ece9-3ee3-45df-b4e0-fedefcf4e958 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:00.579748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8f67ece9-3ee3-45df-b4e0-fedefcf4e958 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:00.910069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-eb996af1-208f-4dc4-8e39-00cd779e02b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:00.946556 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eb996af1-208f-4dc4-8e39-00cd779e02b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1313 microversion: 2.1 time: 1.048993 Oct 10 23:45:00.947345 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2548/5273] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:44:59 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1313 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:00.972076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-991370b6-6bb0-4977-8d76-5544967e7451 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:00.975970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-991370b6-6bb0-4977-8d76-5544967e7451 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b1cad8e1-6af5-4151-8635-926f77f2ca07] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:01.015041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-991370b6-6bb0-4977-8d76-5544967e7451 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:01.018890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-991370b6-6bb0-4977-8d76-5544967e7451 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:01.019741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-991370b6-6bb0-4977-8d76-5544967e7451 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:01.023130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-991370b6-6bb0-4977-8d76-5544967e7451 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:01.031131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-991370b6-6bb0-4977-8d76-5544967e7451 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:01.036620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-991370b6-6bb0-4977-8d76-5544967e7451 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:01.125325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:45:01.332807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8f67ece9-3ee3-45df-b4e0-fedefcf4e958 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:01.369297 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8f67ece9-3ee3-45df-b4e0-fedefcf4e958 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1318 microversion: 2.1 time: 0.868165 Oct 10 23:45:01.370479 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2726/5274] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:00 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1318 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:01.384678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5c3a2210-8ec4-4d60-b77d-3b067ccfae0b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:01.385416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5c3a2210-8ec4-4d60-b77d-3b067ccfae0b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:01.403802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c3a2210-8ec4-4d60-b77d-3b067ccfae0b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:01.405500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c3a2210-8ec4-4d60-b77d-3b067ccfae0b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:01.406099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c3a2210-8ec4-4d60-b77d-3b067ccfae0b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:01.406908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c3a2210-8ec4-4d60-b77d-3b067ccfae0b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:01.407520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c3a2210-8ec4-4d60-b77d-3b067ccfae0b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:01.412578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c3a2210-8ec4-4d60-b77d-3b067ccfae0b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:02.450936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5c3a2210-8ec4-4d60-b77d-3b067ccfae0b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:02.472640 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5c3a2210-8ec4-4d60-b77d-3b067ccfae0b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1520 microversion: 2.1 time: 1.098342 Oct 10 23:45:02.476924 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2727/5275] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:01 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1520 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:02.511621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1a6df143-1989-4907-9d05-060b4a545f41 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:02.512416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1a6df143-1989-4907-9d05-060b4a545f41 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:02.540917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a6df143-1989-4907-9d05-060b4a545f41 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:02.550569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a6df143-1989-4907-9d05-060b4a545f41 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:02.563283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a6df143-1989-4907-9d05-060b4a545f41 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:02.566373 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a6df143-1989-4907-9d05-060b4a545f41 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:02.566903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a6df143-1989-4907-9d05-060b4a545f41 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:02.567367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1a6df143-1989-4907-9d05-060b4a545f41 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:02.583738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-991370b6-6bb0-4977-8d76-5544967e7451 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:02.594981 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-991370b6-6bb0-4977-8d76-5544967e7451 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07" status: 200 len: 1474 microversion: 2.1 time: 1.646700 Oct 10 23:45:02.599251 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2549/5276] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:00 2022] GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07 => generated 1474 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:02.611775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e05a8bd4-8c21-4307-9c60-36345e781fb7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:02.612952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e05a8bd4-8c21-4307-9c60-36345e781fb7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:02.629851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e05a8bd4-8c21-4307-9c60-36345e781fb7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:02.630695 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e05a8bd4-8c21-4307-9c60-36345e781fb7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:02.631320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e05a8bd4-8c21-4307-9c60-36345e781fb7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:02.632212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e05a8bd4-8c21-4307-9c60-36345e781fb7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:02.632860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e05a8bd4-8c21-4307-9c60-36345e781fb7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:02.633486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e05a8bd4-8c21-4307-9c60-36345e781fb7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:03.284090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e05a8bd4-8c21-4307-9c60-36345e781fb7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:03.303273 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e05a8bd4-8c21-4307-9c60-36345e781fb7 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1318 microversion: 2.1 time: 0.702420 Oct 10 23:45:03.304728 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2550/5277] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:02 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1318 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:03.325628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-74bda459-f053-4429-b9ee-4e87fa019b77 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1151498633", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:03.345831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1a6df143-1989-4907-9d05-060b4a545f41 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:03.359406 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1a6df143-1989-4907-9d05-060b4a545f41 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1313 microversion: 2.1 time: 0.879693 Oct 10 23:45:03.363696 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2728/5278] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:02 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1313 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:03.507067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1ea521bb-eceb-4b6e-820e-62d4f8944ab6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:03.509216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1ea521bb-eceb-4b6e-820e-62d4f8944ab6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:03.514636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-74bda459-f053-4429-b9ee-4e87fa019b77 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] validate_networks() for [('abcacee0-1319-4318-8900-2ff15d7780f9', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:45:03.533673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ea521bb-eceb-4b6e-820e-62d4f8944ab6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:03.534245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ea521bb-eceb-4b6e-820e-62d4f8944ab6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:03.536478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ea521bb-eceb-4b6e-820e-62d4f8944ab6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:03.538139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ea521bb-eceb-4b6e-820e-62d4f8944ab6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:03.543089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ea521bb-eceb-4b6e-820e-62d4f8944ab6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:03.548178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ea521bb-eceb-4b6e-820e-62d4f8944ab6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:04.102639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1ea521bb-eceb-4b6e-820e-62d4f8944ab6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:04.117887 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1ea521bb-eceb-4b6e-820e-62d4f8944ab6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1520 microversion: 2.1 time: 0.617009 Oct 10 23:45:04.121138 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2729/5279] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:03 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1520 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:04.134671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-62f2f56d-6292-4037-9e08-d7339a0ea3ae req-42050818-0475-4eb6-8ce7-60686348e6fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a649c07-a625-4509-9cd7-e03fe39f4948", "name": "network-vif-plugged", "status": "completed", "tag": "9c73069d-2cea-4b50-92ef-2d609cecdde7"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:04.165770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-62f2f56d-6292-4037-9e08-d7339a0ea3ae req-42050818-0475-4eb6-8ce7-60686348e6fd service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:04.167266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-62f2f56d-6292-4037-9e08-d7339a0ea3ae req-42050818-0475-4eb6-8ce7-60686348e6fd service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:04.168174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-62f2f56d-6292-4037-9e08-d7339a0ea3ae req-42050818-0475-4eb6-8ce7-60686348e6fd service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:04.191019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:45:04.196180 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-62f2f56d-6292-4037-9e08-d7339a0ea3ae req-42050818-0475-4eb6-8ce7-60686348e6fd service nova] Creating event network-vif-plugged:9c73069d-2cea-4b50-92ef-2d609cecdde7 for instance 6a649c07-a625-4509-9cd7-e03fe39f4948 on n-h2-860864-2 Oct 10 23:45:04.207682 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-62f2f56d-6292-4037-9e08-d7339a0ea3ae req-42050818-0475-4eb6-8ce7-60686348e6fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084416 Oct 10 23:45:04.213661 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2730/5280] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:45:04.350394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3a08904e-75d1-4b8b-bee6-ffa798f3ade5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:04.351764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3a08904e-75d1-4b8b-bee6-ffa798f3ade5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:04.401417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a08904e-75d1-4b8b-bee6-ffa798f3ade5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:04.418786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a08904e-75d1-4b8b-bee6-ffa798f3ade5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:04.426804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a08904e-75d1-4b8b-bee6-ffa798f3ade5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:04.428673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a08904e-75d1-4b8b-bee6-ffa798f3ade5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:04.437820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a08904e-75d1-4b8b-bee6-ffa798f3ade5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:04.439069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a08904e-75d1-4b8b-bee6-ffa798f3ade5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:05.287682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3a08904e-75d1-4b8b-bee6-ffa798f3ade5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:05.303388 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3a08904e-75d1-4b8b-bee6-ffa798f3ade5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1318 microversion: 2.1 time: 0.964880 Oct 10 23:45:05.306385 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2731/5281] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:04 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1318 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:05.319010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-216c3342-2e1d-4b16-9745-ec28ad1743bb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:05.319933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-216c3342-2e1d-4b16-9745-ec28ad1743bb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:05.349980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-216c3342-2e1d-4b16-9745-ec28ad1743bb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:05.352436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-216c3342-2e1d-4b16-9745-ec28ad1743bb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:05.355985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-216c3342-2e1d-4b16-9745-ec28ad1743bb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:05.361848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-216c3342-2e1d-4b16-9745-ec28ad1743bb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:05.362695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-216c3342-2e1d-4b16-9745-ec28ad1743bb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:05.365339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-216c3342-2e1d-4b16-9745-ec28ad1743bb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:05.924196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-74bda459-f053-4429-b9ee-4e87fa019b77 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:45:05.925124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-74bda459-f053-4429-b9ee-4e87fa019b77 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:45:05.925810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-74bda459-f053-4429-b9ee-4e87fa019b77 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:45:05.926236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-74bda459-f053-4429-b9ee-4e87fa019b77 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:45:05.926850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-74bda459-f053-4429-b9ee-4e87fa019b77 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:45:05.950510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74bda459-f053-4429-b9ee-4e87fa019b77 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:05.951012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74bda459-f053-4429-b9ee-4e87fa019b77 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:05.952114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74bda459-f053-4429-b9ee-4e87fa019b77 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:05.952879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74bda459-f053-4429-b9ee-4e87fa019b77 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:05.953357 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74bda459-f053-4429-b9ee-4e87fa019b77 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:05.966664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74bda459-f053-4429-b9ee-4e87fa019b77 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:05.977598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-216c3342-2e1d-4b16-9745-ec28ad1743bb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:05.987849 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-216c3342-2e1d-4b16-9745-ec28ad1743bb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1313 microversion: 2.1 time: 0.679985 Oct 10 23:45:06.030457 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2732/5282] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:05 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1313 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:06.045934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-adb334cf-6b14-4712-b514-9e2fbb1f0a3b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:06.046640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-adb334cf-6b14-4712-b514-9e2fbb1f0a3b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:06.080264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adb334cf-6b14-4712-b514-9e2fbb1f0a3b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:06.080858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adb334cf-6b14-4712-b514-9e2fbb1f0a3b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:06.081309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adb334cf-6b14-4712-b514-9e2fbb1f0a3b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:06.082085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adb334cf-6b14-4712-b514-9e2fbb1f0a3b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:06.082550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adb334cf-6b14-4712-b514-9e2fbb1f0a3b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:06.082977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adb334cf-6b14-4712-b514-9e2fbb1f0a3b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:06.094990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-74bda459-f053-4429-b9ee-4e87fa019b77 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Getting quotas for project 7fcc4d45337140259bcd5b64b17aa7b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:45:06.120920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-74bda459-f053-4429-b9ee-4e87fa019b77 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Getting quotas for user daf7a1ddba654265a5e732363c85eefa and project 7fcc4d45337140259bcd5b64b17aa7b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:45:06.175939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-74bda459-f053-4429-b9ee-4e87fa019b77 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:45:06.182332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-74bda459-f053-4429-b9ee-4e87fa019b77 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 9686dae4-7c1f-442f-91a8-675b24f5d49e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:45:06.296457 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-74bda459-f053-4429-b9ee-4e87fa019b77 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.990212 Oct 10 23:45:06.297912 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2551/5283] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:45:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:45:06.333534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-9327b999-867c-442e-bd66-c6b79ff662b7 req-04e4050b-80f3-417e-a9bd-d14d2e981514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf", "name": "network-vif-plugged", "status": "completed", "tag": "9723fc72-e0e5-4907-9c7f-9bef1c53e610"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:06.375682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9327b999-867c-442e-bd66-c6b79ff662b7 req-04e4050b-80f3-417e-a9bd-d14d2e981514 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:06.376446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9327b999-867c-442e-bd66-c6b79ff662b7 req-04e4050b-80f3-417e-a9bd-d14d2e981514 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:06.376624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9327b999-867c-442e-bd66-c6b79ff662b7 req-04e4050b-80f3-417e-a9bd-d14d2e981514 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:06.446483 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-9327b999-867c-442e-bd66-c6b79ff662b7 req-04e4050b-80f3-417e-a9bd-d14d2e981514 service nova] Creating event network-vif-plugged:9723fc72-e0e5-4907-9c7f-9bef1c53e610 for instance 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf on n-h1-860864-2 Oct 10 23:45:06.492412 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-9327b999-867c-442e-bd66-c6b79ff662b7 req-04e4050b-80f3-417e-a9bd-d14d2e981514 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164804 Oct 10 23:45:06.494630 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2552/5284] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:45:06.508931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fb053167-56d5-46b8-8ecb-99d62e598337 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:06.509552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fb053167-56d5-46b8-8ecb-99d62e598337 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 9686dae4-7c1f-442f-91a8-675b24f5d49e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:06.593027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fb053167-56d5-46b8-8ecb-99d62e598337 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 9686dae4-7c1f-442f-91a8-675b24f5d49e] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:45:06.877182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-adb334cf-6b14-4712-b514-9e2fbb1f0a3b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:06.900306 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-adb334cf-6b14-4712-b514-9e2fbb1f0a3b tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1520 microversion: 2.1 time: 0.859965 Oct 10 23:45:06.901090 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2733/5285] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:06 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1520 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:06.928178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a7771ade-92f7-445d-9c59-fbbcfb072baf tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:06.929984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a7771ade-92f7-445d-9c59-fbbcfb072baf tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:06.948650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7771ade-92f7-445d-9c59-fbbcfb072baf tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:06.952432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7771ade-92f7-445d-9c59-fbbcfb072baf tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:06.953129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7771ade-92f7-445d-9c59-fbbcfb072baf tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:06.955110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7771ade-92f7-445d-9c59-fbbcfb072baf tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:06.957338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7771ade-92f7-445d-9c59-fbbcfb072baf tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:06.958136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7771ade-92f7-445d-9c59-fbbcfb072baf tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:07.086155 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fb053167-56d5-46b8-8ecb-99d62e598337 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9686dae4-7c1f-442f-91a8-675b24f5d49e" status: 204 len: 0 microversion: 2.1 time: 0.586926 Oct 10 23:45:07.088841 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2553/5286] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:45:06 2022] DELETE /compute/v2.1/servers/9686dae4-7c1f-442f-91a8-675b24f5d49e => generated 0 bytes in 593 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:45:07.107873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e0ee75ca-6008-4253-bc13-09012543173a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:07.110930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e0ee75ca-6008-4253-bc13-09012543173a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:07.160318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0ee75ca-6008-4253-bc13-09012543173a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:07.161890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0ee75ca-6008-4253-bc13-09012543173a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:07.163608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0ee75ca-6008-4253-bc13-09012543173a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:07.167260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0ee75ca-6008-4253-bc13-09012543173a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:07.173695 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0ee75ca-6008-4253-bc13-09012543173a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:07.174321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0ee75ca-6008-4253-bc13-09012543173a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:07.778088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a7771ade-92f7-445d-9c59-fbbcfb072baf tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:07.807393 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a7771ade-92f7-445d-9c59-fbbcfb072baf tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1509 microversion: 2.1 time: 0.897867 Oct 10 23:45:07.819990 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2734/5287] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:06 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1509 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:07.840217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0a36ffd7-f839-4a6b-a9ea-9ac922087fa5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:07.840766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0a36ffd7-f839-4a6b-a9ea-9ac922087fa5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 9686dae4-7c1f-442f-91a8-675b24f5d49e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:07.861981 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-0a36ffd7-f839-4a6b-a9ea-9ac922087fa5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] HTTP exception thrown: Instance 9686dae4-7c1f-442f-91a8-675b24f5d49e could not be found. Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0a36ffd7-f839-4a6b-a9ea-9ac922087fa5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Request method failure captured: Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/9686dae4-7c1f-442f-91a8-675b24f5d49e HTTP/1.1 Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK5cQzq5PmBN8ZK8xufnInf_nKzozFybG60EPi2LKIagIuIo6wmjCjt_dEi9KoG421lgq7o9GXzxCjj26_PYoj0IVUx4iuPxFYRw_bINPtYf7R0sv0LrnaNDyTyma9wRBMptURK1MlutQq_man6Zj75t-cnvbQ_0wIRWAQ7WKgqvlIM Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fcc4d45337140259bcd5b64b17aa7b5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersTestJSON-1882347849 Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersTestJSON-1882347849-project Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: daf7a1ddba654265a5e732363c85eefa Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersTestJSON-1882347849-project Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 9686dae4-7c1f-442f-91a8-675b24f5d49e could not be found. Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '9686dae4-7c1f-442f-91a8-675b24f5d49e'} Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9686dae4-7c1f-442f-91a8-675b24f5d49e could not be found. Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9686dae4-7c1f-442f-91a8-675b24f5d49e could not be found. Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:07.863665 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:07.868774 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:07.868774 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:45:07.868774 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:45:07.868774 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9686dae4-7c1f-442f-91a8-675b24f5d49e could not be found. Oct 10 23:45:07.868774 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:07.868774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0a36ffd7-f839-4a6b-a9ea-9ac922087fa5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Returning 404 to user: Instance 9686dae4-7c1f-442f-91a8-675b24f5d49e could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:45:07.868774 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0a36ffd7-f839-4a6b-a9ea-9ac922087fa5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/9686dae4-7c1f-442f-91a8-675b24f5d49e" status: 404 len: 111 microversion: 2.1 time: 0.034404 Oct 10 23:45:07.880324 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2735/5288] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:07 2022] GET /compute/v2.1/servers/9686dae4-7c1f-442f-91a8-675b24f5d49e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:45:07.898615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d995ef19-71ca-46e7-be12-1d889e0d5513 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:07.899728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d995ef19-71ca-46e7-be12-1d889e0d5513 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:07.925180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d995ef19-71ca-46e7-be12-1d889e0d5513 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:07.932410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d995ef19-71ca-46e7-be12-1d889e0d5513 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:07.933017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d995ef19-71ca-46e7-be12-1d889e0d5513 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:07.934609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d995ef19-71ca-46e7-be12-1d889e0d5513 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:07.935387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d995ef19-71ca-46e7-be12-1d889e0d5513 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:07.936623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d995ef19-71ca-46e7-be12-1d889e0d5513 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:08.191340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e0ee75ca-6008-4253-bc13-09012543173a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:08.210594 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e0ee75ca-6008-4253-bc13-09012543173a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1313 microversion: 2.1 time: 1.119953 Oct 10 23:45:08.219153 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2554/5289] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:07 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1313 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:08.239026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e8b25876-2867-440b-a04d-af4a683bd0be tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:08.240150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e8b25876-2867-440b-a04d-af4a683bd0be tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:08.258569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8b25876-2867-440b-a04d-af4a683bd0be tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:08.266785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8b25876-2867-440b-a04d-af4a683bd0be tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:08.270015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8b25876-2867-440b-a04d-af4a683bd0be tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:08.275526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8b25876-2867-440b-a04d-af4a683bd0be tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:08.276983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8b25876-2867-440b-a04d-af4a683bd0be tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:08.280238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8b25876-2867-440b-a04d-af4a683bd0be tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:08.658812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d995ef19-71ca-46e7-be12-1d889e0d5513 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:08.692628 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d995ef19-71ca-46e7-be12-1d889e0d5513 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1509 microversion: 2.1 time: 0.810864 Oct 10 23:45:08.696018 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2736/5290] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:07 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1509 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:08.712453 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d0bd7950-0103-4c5e-a512-80e3dad73157 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1921404464", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "abcacee0-1319-4318-8900-2ff15d7780f9"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:08.875426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-d0bd7950-0103-4c5e-a512-80e3dad73157 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] validate_networks() for [('abcacee0-1319-4318-8900-2ff15d7780f9', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:45:09.006470 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e8b25876-2867-440b-a04d-af4a683bd0be tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:09.018780 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e8b25876-2867-440b-a04d-af4a683bd0be tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1520 microversion: 2.1 time: 0.798231 Oct 10 23:45:09.030577 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2555/5291] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:08 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1520 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:09.060781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7536d178-d79f-4120-bd34-ceb72bd41169 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:09.068028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7536d178-d79f-4120-bd34-ceb72bd41169 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:09.096633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7536d178-d79f-4120-bd34-ceb72bd41169 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:09.098253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7536d178-d79f-4120-bd34-ceb72bd41169 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:09.099398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7536d178-d79f-4120-bd34-ceb72bd41169 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:09.101204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7536d178-d79f-4120-bd34-ceb72bd41169 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:09.102376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7536d178-d79f-4120-bd34-ceb72bd41169 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:09.106475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7536d178-d79f-4120-bd34-ceb72bd41169 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:09.399438 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7536d178-d79f-4120-bd34-ceb72bd41169 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "PUT /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1081 microversion: 2.1 time: 0.364249 Oct 10 23:45:09.402211 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2556/5292] 10.222.0.23 () {60 vars in 1256 bytes} [Mon Oct 10 23:45:09 2022] PUT /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1081 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:09.426678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5e1ad4b6-c485-4356-9621-f57a9906e7de tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:09.427794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5e1ad4b6-c485-4356-9621-f57a9906e7de tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:09.458914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e1ad4b6-c485-4356-9621-f57a9906e7de tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:09.459918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e1ad4b6-c485-4356-9621-f57a9906e7de tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:09.460706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e1ad4b6-c485-4356-9621-f57a9906e7de tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:09.462238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e1ad4b6-c485-4356-9621-f57a9906e7de tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:09.463581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e1ad4b6-c485-4356-9621-f57a9906e7de tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:09.464833 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5e1ad4b6-c485-4356-9621-f57a9906e7de tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:09.927401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5e1ad4b6-c485-4356-9621-f57a9906e7de tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:09.949043 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5e1ad4b6-c485-4356-9621-f57a9906e7de tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1500 microversion: 2.1 time: 0.543837 Oct 10 23:45:09.957045 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2557/5293] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:09 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1500 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:09.962609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a97326da-378e-4844-9b1a-b624448598c5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:09.966930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a97326da-378e-4844-9b1a-b624448598c5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:10.005837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a97326da-378e-4844-9b1a-b624448598c5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:10.005837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a97326da-378e-4844-9b1a-b624448598c5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:10.005837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a97326da-378e-4844-9b1a-b624448598c5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:10.016031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a97326da-378e-4844-9b1a-b624448598c5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:10.016031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a97326da-378e-4844-9b1a-b624448598c5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:10.016031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a97326da-378e-4844-9b1a-b624448598c5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:10.884861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d0bd7950-0103-4c5e-a512-80e3dad73157 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:45:10.888407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d0bd7950-0103-4c5e-a512-80e3dad73157 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:45:10.890965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d0bd7950-0103-4c5e-a512-80e3dad73157 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:45:10.892332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d0bd7950-0103-4c5e-a512-80e3dad73157 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:45:10.893626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d0bd7950-0103-4c5e-a512-80e3dad73157 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:45:10.919196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0bd7950-0103-4c5e-a512-80e3dad73157 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:10.921185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0bd7950-0103-4c5e-a512-80e3dad73157 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:10.922273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0bd7950-0103-4c5e-a512-80e3dad73157 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:10.924805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0bd7950-0103-4c5e-a512-80e3dad73157 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:10.925959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0bd7950-0103-4c5e-a512-80e3dad73157 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:10.926989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0bd7950-0103-4c5e-a512-80e3dad73157 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:10.972550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a97326da-378e-4844-9b1a-b624448598c5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:10.988599 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a97326da-378e-4844-9b1a-b624448598c5 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1507 microversion: 2.1 time: 1.030223 Oct 10 23:45:10.990311 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2558/5294] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:09 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1507 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:10.998998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ddacaf28-b458-4700-9975-0f6e355c50df tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:11.000397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-d0bd7950-0103-4c5e-a512-80e3dad73157 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Getting quotas for project 7fcc4d45337140259bcd5b64b17aa7b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:45:11.011490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-d0bd7950-0103-4c5e-a512-80e3dad73157 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Getting quotas for user daf7a1ddba654265a5e732363c85eefa and project 7fcc4d45337140259bcd5b64b17aa7b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:45:11.015484 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddacaf28-b458-4700-9975-0f6e355c50df tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:11.016261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddacaf28-b458-4700-9975-0f6e355c50df tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:11.016884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddacaf28-b458-4700-9975-0f6e355c50df tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:11.055169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d0bd7950-0103-4c5e-a512-80e3dad73157 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:45:11.059069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d0bd7950-0103-4c5e-a512-80e3dad73157 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:45:11.090129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ddacaf28-b458-4700-9975-0f6e355c50df tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Going to try to stop instance {{(pid=120614) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 23:45:11.182118 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d0bd7950-0103-4c5e-a512-80e3dad73157 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.483517 Oct 10 23:45:11.186522 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2737/5295] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:45:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:45:11.197343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8ddadbf7-1711-4107-b449-37ad268854a0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:11.198960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8ddadbf7-1711-4107-b449-37ad268854a0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:11.204659 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ddacaf28-b458-4700-9975-0f6e355c50df tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf/action" status: 202 len: 0 microversion: 2.1 time: 0.212821 Oct 10 23:45:11.205312 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2559/5296] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:45:10 2022] POST /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:45:11.215973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b69d3599-01fa-4074-9d25-421d4761a631 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:11.216714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b69d3599-01fa-4074-9d25-421d4761a631 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:11.222408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ddadbf7-1711-4107-b449-37ad268854a0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:11.223176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ddadbf7-1711-4107-b449-37ad268854a0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:11.223869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ddadbf7-1711-4107-b449-37ad268854a0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:11.225845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ddadbf7-1711-4107-b449-37ad268854a0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:11.228542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ddadbf7-1711-4107-b449-37ad268854a0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:11.229793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ddadbf7-1711-4107-b449-37ad268854a0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:11.237172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b69d3599-01fa-4074-9d25-421d4761a631 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:11.238044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b69d3599-01fa-4074-9d25-421d4761a631 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:11.238697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b69d3599-01fa-4074-9d25-421d4761a631 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:11.239632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b69d3599-01fa-4074-9d25-421d4761a631 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:11.240273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b69d3599-01fa-4074-9d25-421d4761a631 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:11.240886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b69d3599-01fa-4074-9d25-421d4761a631 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:11.573270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b69d3599-01fa-4074-9d25-421d4761a631 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:11.596918 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b69d3599-01fa-4074-9d25-421d4761a631 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1507 microversion: 2.1 time: 0.388669 Oct 10 23:45:11.599720 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2560/5297] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:11 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1507 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:11.617390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c52e49e3-1614-4459-b858-8b10794ccd48 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:11.619074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c52e49e3-1614-4459-b858-8b10794ccd48 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:11.857062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c52e49e3-1614-4459-b858-8b10794ccd48 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:11.874650 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c52e49e3-1614-4459-b858-8b10794ccd48 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 200 len: 1221 microversion: 2.1 time: 0.271946 Oct 10 23:45:11.876366 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2561/5298] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:11 2022] GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 1221 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:11.885471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c8f6954c-5ae8-4e51-8a46-8e84fdee9f0c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:11.887149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c8f6954c-5ae8-4e51-8a46-8e84fdee9f0c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:11.906548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8f6954c-5ae8-4e51-8a46-8e84fdee9f0c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:11.907772 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8f6954c-5ae8-4e51-8a46-8e84fdee9f0c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:11.908819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8f6954c-5ae8-4e51-8a46-8e84fdee9f0c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:11.910243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8f6954c-5ae8-4e51-8a46-8e84fdee9f0c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:11.914378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8f6954c-5ae8-4e51-8a46-8e84fdee9f0c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:11.915307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8f6954c-5ae8-4e51-8a46-8e84fdee9f0c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:12.507996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c8f6954c-5ae8-4e51-8a46-8e84fdee9f0c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:12.553731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8ddadbf7-1711-4107-b449-37ad268854a0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:12.567414 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8ddadbf7-1711-4107-b449-37ad268854a0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1520 microversion: 2.1 time: 1.377871 Oct 10 23:45:12.586231 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2738/5299] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:11 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1520 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:12.600354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3eab5f16-6eb3-4127-b9a2-2d8949557e18 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:12.603089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3eab5f16-6eb3-4127-b9a2-2d8949557e18 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:12.610352 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c8f6954c-5ae8-4e51-8a46-8e84fdee9f0c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1510 microversion: 2.1 time: 0.731666 Oct 10 23:45:12.619737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3eab5f16-6eb3-4127-b9a2-2d8949557e18 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:12.620229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3eab5f16-6eb3-4127-b9a2-2d8949557e18 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:12.620389 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2562/5300] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:11 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1510 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:12.620675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3eab5f16-6eb3-4127-b9a2-2d8949557e18 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:12.621409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3eab5f16-6eb3-4127-b9a2-2d8949557e18 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:12.621878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3eab5f16-6eb3-4127-b9a2-2d8949557e18 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:12.622305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3eab5f16-6eb3-4127-b9a2-2d8949557e18 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:12.859952 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3eab5f16-6eb3-4127-b9a2-2d8949557e18 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "PUT /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1083 microversion: 2.1 time: 0.267586 Oct 10 23:45:12.860937 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2739/5301] 10.222.0.23 () {60 vars in 1256 bytes} [Mon Oct 10 23:45:12 2022] PUT /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1083 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:12.904805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e26174ec-27f5-4f7b-bc83-f5256f5886ba tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:12.906056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e26174ec-27f5-4f7b-bc83-f5256f5886ba tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:12.907148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-da9e5d06-df29-4e12-b970-d5bebcc36d5d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:12.908860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-da9e5d06-df29-4e12-b970-d5bebcc36d5d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:12.919658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e26174ec-27f5-4f7b-bc83-f5256f5886ba tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:12.926999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e26174ec-27f5-4f7b-bc83-f5256f5886ba tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:12.928114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e26174ec-27f5-4f7b-bc83-f5256f5886ba tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:12.932024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e26174ec-27f5-4f7b-bc83-f5256f5886ba tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:12.934767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e26174ec-27f5-4f7b-bc83-f5256f5886ba tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:12.939007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e26174ec-27f5-4f7b-bc83-f5256f5886ba tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:12.942712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da9e5d06-df29-4e12-b970-d5bebcc36d5d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:12.943762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da9e5d06-df29-4e12-b970-d5bebcc36d5d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:12.957563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da9e5d06-df29-4e12-b970-d5bebcc36d5d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:12.961252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da9e5d06-df29-4e12-b970-d5bebcc36d5d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:12.962345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da9e5d06-df29-4e12-b970-d5bebcc36d5d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:12.965627 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da9e5d06-df29-4e12-b970-d5bebcc36d5d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:13.341834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e26174ec-27f5-4f7b-bc83-f5256f5886ba tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:13.366761 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e26174ec-27f5-4f7b-bc83-f5256f5886ba tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 200 len: 1217 microversion: 2.1 time: 0.465869 Oct 10 23:45:13.376141 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2740/5302] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:12 2022] GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 1217 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:45:13.476995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-da9e5d06-df29-4e12-b970-d5bebcc36d5d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:13.498501 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-da9e5d06-df29-4e12-b970-d5bebcc36d5d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1509 microversion: 2.1 time: 0.605132 Oct 10 23:45:13.504388 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2563/5303] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:12 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1509 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:13.564873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-09418b12-31e7-4cd2-949a-748d95895f22 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:13.568377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-09418b12-31e7-4cd2-949a-748d95895f22 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:13.610819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bbc42076-d7ca-400a-85bb-cff2ada54fc5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:13.612584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bbc42076-d7ca-400a-85bb-cff2ada54fc5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:13.627208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:45:13.634267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bbc42076-d7ca-400a-85bb-cff2ada54fc5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:13.634766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bbc42076-d7ca-400a-85bb-cff2ada54fc5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:13.637132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09418b12-31e7-4cd2-949a-748d95895f22 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:13.640543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09418b12-31e7-4cd2-949a-748d95895f22 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:13.643252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bbc42076-d7ca-400a-85bb-cff2ada54fc5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:13.645044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09418b12-31e7-4cd2-949a-748d95895f22 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:13.651248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09418b12-31e7-4cd2-949a-748d95895f22 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:13.651841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bbc42076-d7ca-400a-85bb-cff2ada54fc5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:13.653731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09418b12-31e7-4cd2-949a-748d95895f22 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:13.654567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bbc42076-d7ca-400a-85bb-cff2ada54fc5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:13.673754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09418b12-31e7-4cd2-949a-748d95895f22 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:13.674675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bbc42076-d7ca-400a-85bb-cff2ada54fc5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:14.252530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bbc42076-d7ca-400a-85bb-cff2ada54fc5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:14.266423 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bbc42076-d7ca-400a-85bb-cff2ada54fc5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1520 microversion: 2.1 time: 0.663685 Oct 10 23:45:14.267330 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2564/5304] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:13 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1520 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:14.280012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-07046934-91b0-496e-9897-6d8bc74a2b1a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:14.283643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-07046934-91b0-496e-9897-6d8bc74a2b1a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:14.299843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07046934-91b0-496e-9897-6d8bc74a2b1a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:14.300502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07046934-91b0-496e-9897-6d8bc74a2b1a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:14.301966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07046934-91b0-496e-9897-6d8bc74a2b1a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:14.304346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07046934-91b0-496e-9897-6d8bc74a2b1a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:14.305963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07046934-91b0-496e-9897-6d8bc74a2b1a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:14.308234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07046934-91b0-496e-9897-6d8bc74a2b1a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:14.984843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-07046934-91b0-496e-9897-6d8bc74a2b1a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:14.999762 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-07046934-91b0-496e-9897-6d8bc74a2b1a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1510 microversion: 2.1 time: 0.725058 Oct 10 23:45:15.000803 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2565/5305] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:14 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1510 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:15.008837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-45e0315a-5e63-4e56-b1fb-7a711398568f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:15.016273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-45e0315a-5e63-4e56-b1fb-7a711398568f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:15.036413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45e0315a-5e63-4e56-b1fb-7a711398568f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:15.041019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45e0315a-5e63-4e56-b1fb-7a711398568f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:15.041904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45e0315a-5e63-4e56-b1fb-7a711398568f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:15.045767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45e0315a-5e63-4e56-b1fb-7a711398568f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:15.048522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45e0315a-5e63-4e56-b1fb-7a711398568f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:15.050162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45e0315a-5e63-4e56-b1fb-7a711398568f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:15.252570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-45e0315a-5e63-4e56-b1fb-7a711398568f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:15.266439 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-45e0315a-5e63-4e56-b1fb-7a711398568f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 200 len: 1291 microversion: 2.1 time: 0.264076 Oct 10 23:45:15.269685 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2566/5306] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:15 2022] GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 1291 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:15.302767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b3e6b3f0-a9cc-439e-8c92-729a69c9b505 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:15.303918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b3e6b3f0-a9cc-439e-8c92-729a69c9b505 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:15.352176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3e6b3f0-a9cc-439e-8c92-729a69c9b505 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:15.357245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3e6b3f0-a9cc-439e-8c92-729a69c9b505 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:15.359535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3e6b3f0-a9cc-439e-8c92-729a69c9b505 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:15.363661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3e6b3f0-a9cc-439e-8c92-729a69c9b505 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:15.366082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3e6b3f0-a9cc-439e-8c92-729a69c9b505 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:15.368471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b3e6b3f0-a9cc-439e-8c92-729a69c9b505 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:15.416777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:45:15.432675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-09418b12-31e7-4cd2-949a-748d95895f22 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:15.456063 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-09418b12-31e7-4cd2-949a-748d95895f22 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1509 microversion: 2.1 time: 1.899834 Oct 10 23:45:15.466053 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2741/5307] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:13 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1509 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:15.502245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f3b1a52c-0497-4238-8e0a-87e91cd6597a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:15.503055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f3b1a52c-0497-4238-8e0a-87e91cd6597a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:15.511591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3b1a52c-0497-4238-8e0a-87e91cd6597a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:15.512503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3b1a52c-0497-4238-8e0a-87e91cd6597a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:15.513170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3b1a52c-0497-4238-8e0a-87e91cd6597a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:15.514421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3b1a52c-0497-4238-8e0a-87e91cd6597a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:15.515128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3b1a52c-0497-4238-8e0a-87e91cd6597a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:15.515833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3b1a52c-0497-4238-8e0a-87e91cd6597a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:15.582450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f3b1a52c-0497-4238-8e0a-87e91cd6597a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:45:15.762716 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f3b1a52c-0497-4238-8e0a-87e91cd6597a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 204 len: 0 microversion: 2.1 time: 0.277142 Oct 10 23:45:15.764431 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2742/5308] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:45:15 2022] DELETE /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 23:45:15.783171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-203b6ccb-24c6-4955-86f7-a42c98cc1615 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:15.806092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-203b6ccb-24c6-4955-86f7-a42c98cc1615 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:15.824048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-203b6ccb-24c6-4955-86f7-a42c98cc1615 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:15.824647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b3e6b3f0-a9cc-439e-8c92-729a69c9b505 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:15.827834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-203b6ccb-24c6-4955-86f7-a42c98cc1615 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:15.831910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-203b6ccb-24c6-4955-86f7-a42c98cc1615 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:15.833235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-203b6ccb-24c6-4955-86f7-a42c98cc1615 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:15.833934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-203b6ccb-24c6-4955-86f7-a42c98cc1615 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:15.834561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-203b6ccb-24c6-4955-86f7-a42c98cc1615 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:15.838225 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b3e6b3f0-a9cc-439e-8c92-729a69c9b505 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1520 microversion: 2.1 time: 0.541360 Oct 10 23:45:15.840666 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2567/5309] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:15 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1520 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:15.901956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-203b6ccb-24c6-4955-86f7-a42c98cc1615 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:45:16.032888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f6b9b7f1-042a-4179-8e30-81d0984f5e2e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:16.034201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f6b9b7f1-042a-4179-8e30-81d0984f5e2e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:16.036926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:45:16.052291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6b9b7f1-042a-4179-8e30-81d0984f5e2e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:16.053155 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6b9b7f1-042a-4179-8e30-81d0984f5e2e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:16.054152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6b9b7f1-042a-4179-8e30-81d0984f5e2e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:16.057516 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6b9b7f1-042a-4179-8e30-81d0984f5e2e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:16.059681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6b9b7f1-042a-4179-8e30-81d0984f5e2e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:16.060534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6b9b7f1-042a-4179-8e30-81d0984f5e2e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:16.079471 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.compute.api [None req-203b6ccb-24c6-4955-86f7-a42c98cc1615 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Instance is already in deleting state, ignoring this request Oct 10 23:45:16.080878 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-203b6ccb-24c6-4955-86f7-a42c98cc1615 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 204 len: 0 microversion: 2.1 time: 0.307921 Oct 10 23:45:16.085503 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2743/5310] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:45:15 2022] DELETE /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:45:16.115142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1120d62e-9ef7-42ed-a7c1-649031777843 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:16.118661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1120d62e-9ef7-42ed-a7c1-649031777843 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:16.138172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1120d62e-9ef7-42ed-a7c1-649031777843 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:16.138679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1120d62e-9ef7-42ed-a7c1-649031777843 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:16.139285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1120d62e-9ef7-42ed-a7c1-649031777843 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:16.140027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1120d62e-9ef7-42ed-a7c1-649031777843 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:16.140490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1120d62e-9ef7-42ed-a7c1-649031777843 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:16.140920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1120d62e-9ef7-42ed-a7c1-649031777843 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:16.992676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1120d62e-9ef7-42ed-a7c1-649031777843 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:17.006441 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1120d62e-9ef7-42ed-a7c1-649031777843 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1515 microversion: 2.1 time: 0.899294 Oct 10 23:45:17.008421 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2744/5311] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:16 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1515 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:17.019897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-930c8aad-4279-4db5-a140-dd56e1d41623 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:17.021738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-930c8aad-4279-4db5-a140-dd56e1d41623 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:17.034470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-930c8aad-4279-4db5-a140-dd56e1d41623 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:17.039038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-930c8aad-4279-4db5-a140-dd56e1d41623 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:17.039724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-930c8aad-4279-4db5-a140-dd56e1d41623 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:17.040705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-930c8aad-4279-4db5-a140-dd56e1d41623 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:17.042167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-930c8aad-4279-4db5-a140-dd56e1d41623 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:17.043856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-930c8aad-4279-4db5-a140-dd56e1d41623 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:17.072198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:45:17.103266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f6b9b7f1-042a-4179-8e30-81d0984f5e2e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:17.115752 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f6b9b7f1-042a-4179-8e30-81d0984f5e2e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1510 microversion: 2.1 time: 1.088138 Oct 10 23:45:17.129413 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2568/5312] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:16 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1510 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:17.129413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-73bdc2a5-7de0-481d-a8d6-45e78c0dfca2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:17.129413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-73bdc2a5-7de0-481d-a8d6-45e78c0dfca2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:17.131218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73bdc2a5-7de0-481d-a8d6-45e78c0dfca2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:17.132106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73bdc2a5-7de0-481d-a8d6-45e78c0dfca2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:17.132631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73bdc2a5-7de0-481d-a8d6-45e78c0dfca2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:17.133722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73bdc2a5-7de0-481d-a8d6-45e78c0dfca2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:17.134391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73bdc2a5-7de0-481d-a8d6-45e78c0dfca2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:17.135172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73bdc2a5-7de0-481d-a8d6-45e78c0dfca2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:17.684671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-930c8aad-4279-4db5-a140-dd56e1d41623 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:17.705269 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-930c8aad-4279-4db5-a140-dd56e1d41623 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 200 len: 1321 microversion: 2.1 time: 0.695590 Oct 10 23:45:17.706168 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2745/5313] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:17 2022] GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 1321 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:17.883671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-73bdc2a5-7de0-481d-a8d6-45e78c0dfca2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:17.892182 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-73bdc2a5-7de0-481d-a8d6-45e78c0dfca2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1520 microversion: 2.1 time: 0.773918 Oct 10 23:45:17.893195 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2569/5314] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:17 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1520 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:18.044726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a9413d53-e924-4380-a60f-f187b86503f0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:18.046406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a9413d53-e924-4380-a60f-f187b86503f0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:18.056035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a9413d53-e924-4380-a60f-f187b86503f0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:18.058462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a9413d53-e924-4380-a60f-f187b86503f0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:18.064064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a9413d53-e924-4380-a60f-f187b86503f0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:18.065889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a9413d53-e924-4380-a60f-f187b86503f0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:18.067350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a9413d53-e924-4380-a60f-f187b86503f0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:18.068421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a9413d53-e924-4380-a60f-f187b86503f0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:18.156480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-320ed9c9-c3b0-43d5-b9ff-a1a7efdecd52 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:18.157906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-320ed9c9-c3b0-43d5-b9ff-a1a7efdecd52 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:18.165273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-320ed9c9-c3b0-43d5-b9ff-a1a7efdecd52 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:18.166081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-320ed9c9-c3b0-43d5-b9ff-a1a7efdecd52 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:18.166717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-320ed9c9-c3b0-43d5-b9ff-a1a7efdecd52 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:18.167682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-320ed9c9-c3b0-43d5-b9ff-a1a7efdecd52 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:18.168442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-320ed9c9-c3b0-43d5-b9ff-a1a7efdecd52 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:18.169060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-320ed9c9-c3b0-43d5-b9ff-a1a7efdecd52 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:18.441868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a9413d53-e924-4380-a60f-f187b86503f0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:18.457049 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a9413d53-e924-4380-a60f-f187b86503f0 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1515 microversion: 2.1 time: 0.414260 Oct 10 23:45:18.458071 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2746/5315] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:18 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1515 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:18.626016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-320ed9c9-c3b0-43d5-b9ff-a1a7efdecd52 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:18.642555 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-320ed9c9-c3b0-43d5-b9ff-a1a7efdecd52 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1510 microversion: 2.1 time: 0.498465 Oct 10 23:45:18.644994 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2570/5316] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:18 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1510 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:45:18.736198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-613c7e36-21bf-4783-93e8-93a8d223c7b8 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:18.737231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-613c7e36-21bf-4783-93e8-93a8d223c7b8 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:18.747285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-613c7e36-21bf-4783-93e8-93a8d223c7b8 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:18.754310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-613c7e36-21bf-4783-93e8-93a8d223c7b8 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:18.755209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-613c7e36-21bf-4783-93e8-93a8d223c7b8 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:18.756150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-613c7e36-21bf-4783-93e8-93a8d223c7b8 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:18.756794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-613c7e36-21bf-4783-93e8-93a8d223c7b8 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:18.757460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-613c7e36-21bf-4783-93e8-93a8d223c7b8 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:18.927217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f02088a6-c7f4-4145-bcd9-bec82cf6ca36 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:18.928355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f02088a6-c7f4-4145-bcd9-bec82cf6ca36 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:18.950946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f02088a6-c7f4-4145-bcd9-bec82cf6ca36 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:18.951900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f02088a6-c7f4-4145-bcd9-bec82cf6ca36 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:18.952630 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f02088a6-c7f4-4145-bcd9-bec82cf6ca36 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:18.953090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f02088a6-c7f4-4145-bcd9-bec82cf6ca36 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:18.959320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f02088a6-c7f4-4145-bcd9-bec82cf6ca36 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:18.959901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f02088a6-c7f4-4145-bcd9-bec82cf6ca36 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:19.245231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-613c7e36-21bf-4783-93e8-93a8d223c7b8 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:19.262324 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-613c7e36-21bf-4783-93e8-93a8d223c7b8 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 200 len: 1321 microversion: 2.1 time: 0.531825 Oct 10 23:45:19.263460 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2747/5317] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:18 2022] GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 1321 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:19.272551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-e954c857-e375-4f3e-80c3-c0ff5d714c1e req-d1ef526d-8dba-4ebf-97e5-6a9237ec9b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a649c07-a625-4509-9cd7-e03fe39f4948", "name": "network-vif-deleted", "tag": "9c73069d-2cea-4b50-92ef-2d609cecdde7"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:19.285421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e954c857-e375-4f3e-80c3-c0ff5d714c1e req-d1ef526d-8dba-4ebf-97e5-6a9237ec9b8b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:19.286247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e954c857-e375-4f3e-80c3-c0ff5d714c1e req-d1ef526d-8dba-4ebf-97e5-6a9237ec9b8b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:19.287081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e954c857-e375-4f3e-80c3-c0ff5d714c1e req-d1ef526d-8dba-4ebf-97e5-6a9237ec9b8b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:19.320540 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-e954c857-e375-4f3e-80c3-c0ff5d714c1e req-d1ef526d-8dba-4ebf-97e5-6a9237ec9b8b service nova] Creating event network-vif-deleted:9c73069d-2cea-4b50-92ef-2d609cecdde7 for instance 6a649c07-a625-4509-9cd7-e03fe39f4948 on n-h2-860864-2 Oct 10 23:45:19.334229 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-e954c857-e375-4f3e-80c3-c0ff5d714c1e req-d1ef526d-8dba-4ebf-97e5-6a9237ec9b8b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068785 Oct 10 23:45:19.335569 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2748/5318] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:45:19.493367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7f25987a-07f5-4721-8967-adda6b11d0fc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:19.493367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7f25987a-07f5-4721-8967-adda6b11d0fc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:19.504840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f25987a-07f5-4721-8967-adda6b11d0fc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:19.505533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f25987a-07f5-4721-8967-adda6b11d0fc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:19.506422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f25987a-07f5-4721-8967-adda6b11d0fc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:19.507393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f25987a-07f5-4721-8967-adda6b11d0fc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:19.507966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f25987a-07f5-4721-8967-adda6b11d0fc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:19.508511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f25987a-07f5-4721-8967-adda6b11d0fc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:19.617622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f02088a6-c7f4-4145-bcd9-bec82cf6ca36 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:19.620765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f25987a-07f5-4721-8967-adda6b11d0fc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:19.621282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f25987a-07f5-4721-8967-adda6b11d0fc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:19.621767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f25987a-07f5-4721-8967-adda6b11d0fc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:19.625497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-7f25987a-07f5-4721-8967-adda6b11d0fc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lazy-loading 'fault' on Instance uuid 6a649c07-a625-4509-9cd7-e03fe39f4948 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:45:19.631692 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f02088a6-c7f4-4145-bcd9-bec82cf6ca36 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1520 microversion: 2.1 time: 0.708229 Oct 10 23:45:19.632969 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2571/5319] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:18 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1520 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:19.673103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4271c2cb-9c49-4638-9c55-b3aabeea62be tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:19.673751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4271c2cb-9c49-4638-9c55-b3aabeea62be tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:19.689020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4271c2cb-9c49-4638-9c55-b3aabeea62be tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:19.690017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4271c2cb-9c49-4638-9c55-b3aabeea62be tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:19.693129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4271c2cb-9c49-4638-9c55-b3aabeea62be tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:19.694677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4271c2cb-9c49-4638-9c55-b3aabeea62be tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:19.696775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4271c2cb-9c49-4638-9c55-b3aabeea62be tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:19.697915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4271c2cb-9c49-4638-9c55-b3aabeea62be tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:20.004145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7f25987a-07f5-4721-8967-adda6b11d0fc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb15e7a60664cc7a0e5f7236dada33c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea9f7995c3349008497343ab1940287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:20.028859 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7f25987a-07f5-4721-8967-adda6b11d0fc tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 200 len: 1308 microversion: 2.1 time: 0.548459 Oct 10 23:45:20.030048 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2749/5320] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:19 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 1308 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:20.177639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4271c2cb-9c49-4638-9c55-b3aabeea62be tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:20.196194 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4271c2cb-9c49-4638-9c55-b3aabeea62be tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1510 microversion: 2.1 time: 0.527676 Oct 10 23:45:20.210088 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2572/5321] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:19 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1510 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:45:20.293578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b16ce6dd-6c8d-4a32-a920-3ca89314dd23 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:20.294210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b16ce6dd-6c8d-4a32-a920-3ca89314dd23 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:20.314139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b16ce6dd-6c8d-4a32-a920-3ca89314dd23 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:20.314650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b16ce6dd-6c8d-4a32-a920-3ca89314dd23 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:20.315089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b16ce6dd-6c8d-4a32-a920-3ca89314dd23 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:20.315798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b16ce6dd-6c8d-4a32-a920-3ca89314dd23 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:20.316252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b16ce6dd-6c8d-4a32-a920-3ca89314dd23 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:20.316668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b16ce6dd-6c8d-4a32-a920-3ca89314dd23 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:20.605055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b16ce6dd-6c8d-4a32-a920-3ca89314dd23 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:20.618911 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b16ce6dd-6c8d-4a32-a920-3ca89314dd23 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 200 len: 1321 microversion: 2.1 time: 0.330257 Oct 10 23:45:20.635336 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2750/5322] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:20 2022] GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 1321 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:20.658848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7ca0847d-b860-4c7f-b2e0-d4a9eb14aab8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:20.659477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7ca0847d-b860-4c7f-b2e0-d4a9eb14aab8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:20.670187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ca0847d-b860-4c7f-b2e0-d4a9eb14aab8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:20.673252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ca0847d-b860-4c7f-b2e0-d4a9eb14aab8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:20.676756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ca0847d-b860-4c7f-b2e0-d4a9eb14aab8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:20.677933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ca0847d-b860-4c7f-b2e0-d4a9eb14aab8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:20.678599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ca0847d-b860-4c7f-b2e0-d4a9eb14aab8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:20.679913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ca0847d-b860-4c7f-b2e0-d4a9eb14aab8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:21.007252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-6e954573-3ce9-48f8-a797-835a51b55602 req-fb043e20-1138-444b-a848-6cf019aa6810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5704bab-05ad-4950-9a7b-0770cbbb6e9d", "tag": "67a0ae8d-b0f9-4e9b-9ea5-ecd5e09e3c3d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:21.023899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:45:21.038687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:45:21.042187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6e954573-3ce9-48f8-a797-835a51b55602 req-fb043e20-1138-444b-a848-6cf019aa6810 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:21.044788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6e954573-3ce9-48f8-a797-835a51b55602 req-fb043e20-1138-444b-a848-6cf019aa6810 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:21.046160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6e954573-3ce9-48f8-a797-835a51b55602 req-fb043e20-1138-444b-a848-6cf019aa6810 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:21.077760 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-6e954573-3ce9-48f8-a797-835a51b55602 req-fb043e20-1138-444b-a848-6cf019aa6810 service nova] Creating event network-changed:67a0ae8d-b0f9-4e9b-9ea5-ecd5e09e3c3d for instance b5704bab-05ad-4950-9a7b-0770cbbb6e9d on n-h1-860864-2 Oct 10 23:45:21.087039 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-6e954573-3ce9-48f8-a797-835a51b55602 req-fb043e20-1138-444b-a848-6cf019aa6810 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083533 Oct 10 23:45:21.093705 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2751/5323] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:45:21.100958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e4a19b6e-4f80-4c93-83f3-5edd7ffb62bd tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:21.106057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e4a19b6e-4f80-4c93-83f3-5edd7ffb62bd tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: 6a649c07-a625-4509-9cd7-e03fe39f4948] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:21.121195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4a19b6e-4f80-4c93-83f3-5edd7ffb62bd tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:21.126236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4a19b6e-4f80-4c93-83f3-5edd7ffb62bd tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:21.127071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4a19b6e-4f80-4c93-83f3-5edd7ffb62bd tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:21.128055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4a19b6e-4f80-4c93-83f3-5edd7ffb62bd tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:21.132956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4a19b6e-4f80-4c93-83f3-5edd7ffb62bd tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:21.133721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4a19b6e-4f80-4c93-83f3-5edd7ffb62bd tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:21.153885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7ca0847d-b860-4c7f-b2e0-d4a9eb14aab8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:21.167061 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7ca0847d-b860-4c7f-b2e0-d4a9eb14aab8 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1520 microversion: 2.1 time: 0.512480 Oct 10 23:45:21.170941 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2573/5324] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:20 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1520 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:21.176887 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-e4a19b6e-4f80-4c93-83f3-5edd7ffb62bd tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] HTTP exception thrown: Instance 6a649c07-a625-4509-9cd7-e03fe39f4948 could not be found. Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e4a19b6e-4f80-4c93-83f3-5edd7ffb62bd tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Request method failure captured: Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 HTTP/1.1 Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK3Mgmdfcr7-y7ialDzk8TpQbAOaDamUQqo7RZ1vBM97bXlgi07PnL3BLW91j0BvZDilJ_MYA_tzJIM2DXlCL1_8IgixjSSWoA5t63BOJ-XK6MSlz8IkIpmyE2l2Qy4FXbQhE6-4XdJoZzHQ__AxXLiArG8ZaoVtlgHy6YoEem_n688 Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: fea9f7995c3349008497343ab1940287 Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1859424014 Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fea9f7995c3349008497343ab1940287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fea9f7995c3349008497343ab1940287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fea9f7995c3349008497343ab1940287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fea9f7995c3349008497343ab1940287", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerDiskConfigTestJSON-1859424014 Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: fea9f7995c3349008497343ab1940287 Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1859424014 Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerDiskConfigTestJSON-1859424014-project Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 8eb15e7a60664cc7a0e5f7236dada33c Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerDiskConfigTestJSON-1859424014-project Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 6a649c07-a625-4509-9cd7-e03fe39f4948 could not be found. Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '6a649c07-a625-4509-9cd7-e03fe39f4948'} Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a649c07-a625-4509-9cd7-e03fe39f4948 could not be found. Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a649c07-a625-4509-9cd7-e03fe39f4948 could not be found. Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:21.179812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.186994 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:21.186994 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:21.186994 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:21.186994 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:45:21.186994 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:45:21.186994 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a649c07-a625-4509-9cd7-e03fe39f4948 could not be found. Oct 10 23:45:21.186994 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.186994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e4a19b6e-4f80-4c93-83f3-5edd7ffb62bd tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Returning 404 to user: Instance 6a649c07-a625-4509-9cd7-e03fe39f4948 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:45:21.186994 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e4a19b6e-4f80-4c93-83f3-5edd7ffb62bd tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948" status: 404 len: 111 microversion: 2.1 time: 0.085856 Oct 10 23:45:21.186994 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2752/5325] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:21 2022] GET /compute/v2.1/servers/6a649c07-a625-4509-9cd7-e03fe39f4948 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:45:21.194285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1af84c68-6e02-4679-af38-a7a97be58224 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:21.197254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1af84c68-6e02-4679-af38-a7a97be58224 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:21.223964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-da34b152-af37-431f-adf7-8612e6974ded tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:21.225016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-da34b152-af37-431f-adf7-8612e6974ded tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:21.244281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1af84c68-6e02-4679-af38-a7a97be58224 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:21.255239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1af84c68-6e02-4679-af38-a7a97be58224 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:21.257872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1af84c68-6e02-4679-af38-a7a97be58224 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:21.266937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1af84c68-6e02-4679-af38-a7a97be58224 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:21.272039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da34b152-af37-431f-adf7-8612e6974ded tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:21.274089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da34b152-af37-431f-adf7-8612e6974ded tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:21.274557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1af84c68-6e02-4679-af38-a7a97be58224 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:21.275472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1af84c68-6e02-4679-af38-a7a97be58224 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:21.287252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da34b152-af37-431f-adf7-8612e6974ded tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:21.288601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da34b152-af37-431f-adf7-8612e6974ded tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:21.292132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da34b152-af37-431f-adf7-8612e6974ded tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:21.293075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da34b152-af37-431f-adf7-8612e6974ded tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:21.340034 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-1af84c68-6e02-4679-af38-a7a97be58224 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] HTTP exception thrown: Instance b27c2a97-533c-436b-8974-f05beb1027fd could not be found. Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1af84c68-6e02-4679-af38-a7a97be58224 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Request method failure captured: Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd HTTP/1.1 Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK3Mgmdfcr7-y7ialDzk8TpQbAOaDamUQqo7RZ1vBM97bXlgi07PnL3BLW91j0BvZDilJ_MYA_tzJIM2DXlCL1_8IgixjSSWoA5t63BOJ-XK6MSlz8IkIpmyE2l2Qy4FXbQhE6-4XdJoZzHQ__AxXLiArG8ZaoVtlgHy6YoEem_n688 Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: fea9f7995c3349008497343ab1940287 Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1859424014 Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fea9f7995c3349008497343ab1940287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fea9f7995c3349008497343ab1940287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fea9f7995c3349008497343ab1940287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fea9f7995c3349008497343ab1940287", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerDiskConfigTestJSON-1859424014 Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: fea9f7995c3349008497343ab1940287 Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1859424014 Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerDiskConfigTestJSON-1859424014-project Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 8eb15e7a60664cc7a0e5f7236dada33c Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerDiskConfigTestJSON-1859424014-project Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance b27c2a97-533c-436b-8974-f05beb1027fd could not be found. Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'b27c2a97-533c-436b-8974-f05beb1027fd'} Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27c2a97-533c-436b-8974-f05beb1027fd could not be found. Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:45:21.342745 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:45:21.348438 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27c2a97-533c-436b-8974-f05beb1027fd could not be found. Oct 10 23:45:21.348438 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.348438 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:21.348438 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.348438 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:21.348438 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:21.348438 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:21.348438 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:45:21.348438 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:45:21.348438 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27c2a97-533c-436b-8974-f05beb1027fd could not be found. Oct 10 23:45:21.348438 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.352235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1af84c68-6e02-4679-af38-a7a97be58224 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Returning 404 to user: Instance b27c2a97-533c-436b-8974-f05beb1027fd could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:45:21.353538 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1af84c68-6e02-4679-af38-a7a97be58224 tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 404 len: 111 microversion: 2.1 time: 0.163652 Oct 10 23:45:21.354708 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2574/5326] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:45:21 2022] DELETE /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:45:21.371928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5c827c4e-13be-46fa-b969-8c41e9f0cf9a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:21.372808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5c827c4e-13be-46fa-b969-8c41e9f0cf9a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: b27c2a97-533c-436b-8974-f05beb1027fd] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:21.383181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c827c4e-13be-46fa-b969-8c41e9f0cf9a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:21.386146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c827c4e-13be-46fa-b969-8c41e9f0cf9a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:21.397359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c827c4e-13be-46fa-b969-8c41e9f0cf9a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:21.406701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c827c4e-13be-46fa-b969-8c41e9f0cf9a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:21.415156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c827c4e-13be-46fa-b969-8c41e9f0cf9a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:21.416048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c827c4e-13be-46fa-b969-8c41e9f0cf9a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:21.443936 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-5c827c4e-13be-46fa-b969-8c41e9f0cf9a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] HTTP exception thrown: Instance b27c2a97-533c-436b-8974-f05beb1027fd could not be found. Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5c827c4e-13be-46fa-b969-8c41e9f0cf9a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Request method failure captured: Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd HTTP/1.1 Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK3Mgmdfcr7-y7ialDzk8TpQbAOaDamUQqo7RZ1vBM97bXlgi07PnL3BLW91j0BvZDilJ_MYA_tzJIM2DXlCL1_8IgixjSSWoA5t63BOJ-XK6MSlz8IkIpmyE2l2Qy4FXbQhE6-4XdJoZzHQ__AxXLiArG8ZaoVtlgHy6YoEem_n688 Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: fea9f7995c3349008497343ab1940287 Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1859424014 Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fea9f7995c3349008497343ab1940287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fea9f7995c3349008497343ab1940287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fea9f7995c3349008497343ab1940287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fea9f7995c3349008497343ab1940287", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerDiskConfigTestJSON-1859424014 Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: fea9f7995c3349008497343ab1940287 Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1859424014 Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerDiskConfigTestJSON-1859424014-project Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 8eb15e7a60664cc7a0e5f7236dada33c Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerDiskConfigTestJSON-1859424014-project Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance b27c2a97-533c-436b-8974-f05beb1027fd could not be found. Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'b27c2a97-533c-436b-8974-f05beb1027fd'} Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27c2a97-533c-436b-8974-f05beb1027fd could not be found. Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27c2a97-533c-436b-8974-f05beb1027fd could not be found. Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:21.451998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.458196 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:21.458196 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:21.458196 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:21.458196 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:45:21.458196 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:45:21.458196 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27c2a97-533c-436b-8974-f05beb1027fd could not be found. Oct 10 23:45:21.458196 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.460229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5c827c4e-13be-46fa-b969-8c41e9f0cf9a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Returning 404 to user: Instance b27c2a97-533c-436b-8974-f05beb1027fd could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:45:21.461584 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5c827c4e-13be-46fa-b969-8c41e9f0cf9a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd" status: 404 len: 111 microversion: 2.1 time: 0.102674 Oct 10 23:45:21.462776 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2575/5327] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:21 2022] GET /compute/v2.1/servers/b27c2a97-533c-436b-8974-f05beb1027fd => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:45:21.474512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9c129bc9-0036-4f54-be3b-9970fb50db5d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:21.475333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9c129bc9-0036-4f54-be3b-9970fb50db5d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:21.485556 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c129bc9-0036-4f54-be3b-9970fb50db5d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:21.486604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c129bc9-0036-4f54-be3b-9970fb50db5d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:21.487284 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c129bc9-0036-4f54-be3b-9970fb50db5d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:21.489023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c129bc9-0036-4f54-be3b-9970fb50db5d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:21.489911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c129bc9-0036-4f54-be3b-9970fb50db5d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:21.491159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c129bc9-0036-4f54-be3b-9970fb50db5d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:21.524143 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-9c129bc9-0036-4f54-be3b-9970fb50db5d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] HTTP exception thrown: Instance e82c4dac-b092-4a01-a6ba-faeaf147e079 could not be found. Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9c129bc9-0036-4f54-be3b-9970fb50db5d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Request method failure captured: Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 HTTP/1.1 Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK3Mgmdfcr7-y7ialDzk8TpQbAOaDamUQqo7RZ1vBM97bXlgi07PnL3BLW91j0BvZDilJ_MYA_tzJIM2DXlCL1_8IgixjSSWoA5t63BOJ-XK6MSlz8IkIpmyE2l2Qy4FXbQhE6-4XdJoZzHQ__AxXLiArG8ZaoVtlgHy6YoEem_n688 Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: fea9f7995c3349008497343ab1940287 Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1859424014 Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fea9f7995c3349008497343ab1940287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fea9f7995c3349008497343ab1940287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fea9f7995c3349008497343ab1940287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fea9f7995c3349008497343ab1940287", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerDiskConfigTestJSON-1859424014 Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: fea9f7995c3349008497343ab1940287 Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1859424014 Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerDiskConfigTestJSON-1859424014-project Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 8eb15e7a60664cc7a0e5f7236dada33c Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerDiskConfigTestJSON-1859424014-project Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance e82c4dac-b092-4a01-a6ba-faeaf147e079 could not be found. Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'e82c4dac-b092-4a01-a6ba-faeaf147e079'} Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e82c4dac-b092-4a01-a6ba-faeaf147e079 could not be found. Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:45:21.526502 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:45:21.533586 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e82c4dac-b092-4a01-a6ba-faeaf147e079 could not be found. Oct 10 23:45:21.533586 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.533586 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:21.533586 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.533586 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:21.533586 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:21.533586 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:21.533586 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:45:21.533586 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:45:21.533586 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e82c4dac-b092-4a01-a6ba-faeaf147e079 could not be found. Oct 10 23:45:21.533586 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.539083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9c129bc9-0036-4f54-be3b-9970fb50db5d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Returning 404 to user: Instance e82c4dac-b092-4a01-a6ba-faeaf147e079 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:45:21.541664 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9c129bc9-0036-4f54-be3b-9970fb50db5d tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 404 len: 111 microversion: 2.1 time: 0.071694 Oct 10 23:45:21.542330 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2576/5328] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:45:21 2022] DELETE /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:45:21.551802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c5c7feca-935e-48d0-919e-5c5434d0ff3a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:21.552433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c5c7feca-935e-48d0-919e-5c5434d0ff3a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] [instance: e82c4dac-b092-4a01-a6ba-faeaf147e079] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:21.565795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5c7feca-935e-48d0-919e-5c5434d0ff3a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:21.567145 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5c7feca-935e-48d0-919e-5c5434d0ff3a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:21.567793 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5c7feca-935e-48d0-919e-5c5434d0ff3a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:21.568724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5c7feca-935e-48d0-919e-5c5434d0ff3a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:21.570521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5c7feca-935e-48d0-919e-5c5434d0ff3a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:21.571187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5c7feca-935e-48d0-919e-5c5434d0ff3a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:21.594863 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-c5c7feca-935e-48d0-919e-5c5434d0ff3a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] HTTP exception thrown: Instance e82c4dac-b092-4a01-a6ba-faeaf147e079 could not be found. Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c5c7feca-935e-48d0-919e-5c5434d0ff3a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Request method failure captured: Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 HTTP/1.1 Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK3Mgmdfcr7-y7ialDzk8TpQbAOaDamUQqo7RZ1vBM97bXlgi07PnL3BLW91j0BvZDilJ_MYA_tzJIM2DXlCL1_8IgixjSSWoA5t63BOJ-XK6MSlz8IkIpmyE2l2Qy4FXbQhE6-4XdJoZzHQ__AxXLiArG8ZaoVtlgHy6YoEem_n688 Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: fea9f7995c3349008497343ab1940287 Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1859424014 Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fea9f7995c3349008497343ab1940287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fea9f7995c3349008497343ab1940287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fea9f7995c3349008497343ab1940287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fea9f7995c3349008497343ab1940287", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerDiskConfigTestJSON-1859424014 Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: fea9f7995c3349008497343ab1940287 Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1859424014 Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerDiskConfigTestJSON-1859424014-project Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 8eb15e7a60664cc7a0e5f7236dada33c Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerDiskConfigTestJSON-1859424014-project Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance e82c4dac-b092-4a01-a6ba-faeaf147e079 could not be found. Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'e82c4dac-b092-4a01-a6ba-faeaf147e079'} Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e82c4dac-b092-4a01-a6ba-faeaf147e079 could not be found. Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e82c4dac-b092-4a01-a6ba-faeaf147e079 could not be found. Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:21.597800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.603918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:21.603918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:21.603918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:21.603918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:45:21.603918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:45:21.603918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e82c4dac-b092-4a01-a6ba-faeaf147e079 could not be found. Oct 10 23:45:21.603918 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:21.606417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c5c7feca-935e-48d0-919e-5c5434d0ff3a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] Returning 404 to user: Instance e82c4dac-b092-4a01-a6ba-faeaf147e079 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:45:21.608790 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c5c7feca-935e-48d0-919e-5c5434d0ff3a tempest-ServerDiskConfigTestJSON-1859424014 tempest-ServerDiskConfigTestJSON-1859424014-project] 10.222.0.23 "GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079" status: 404 len: 111 microversion: 2.1 time: 0.061086 Oct 10 23:45:21.609710 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2577/5329] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:21 2022] GET /compute/v2.1/servers/e82c4dac-b092-4a01-a6ba-faeaf147e079 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:45:21.665395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-242ad5c7-2694-45fe-bbb4-9525b286349d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:21.667117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-242ad5c7-2694-45fe-bbb4-9525b286349d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:21.676471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-242ad5c7-2694-45fe-bbb4-9525b286349d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:21.677779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-242ad5c7-2694-45fe-bbb4-9525b286349d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:21.682733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-242ad5c7-2694-45fe-bbb4-9525b286349d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:21.684205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-242ad5c7-2694-45fe-bbb4-9525b286349d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:21.685073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-242ad5c7-2694-45fe-bbb4-9525b286349d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:21.685794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-242ad5c7-2694-45fe-bbb4-9525b286349d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:21.864609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=10 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:45:22.114127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-242ad5c7-2694-45fe-bbb4-9525b286349d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:22.131180 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-242ad5c7-2694-45fe-bbb4-9525b286349d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 200 len: 1321 microversion: 2.1 time: 0.479936 Oct 10 23:45:22.134219 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2578/5330] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:21 2022] GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 1321 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:22.197881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c13e0dfe-61f4-49e3-bb59-15aeaca56e7c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:22.198816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c13e0dfe-61f4-49e3-bb59-15aeaca56e7c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:22.221270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c13e0dfe-61f4-49e3-bb59-15aeaca56e7c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:22.226551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c13e0dfe-61f4-49e3-bb59-15aeaca56e7c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:22.227056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c13e0dfe-61f4-49e3-bb59-15aeaca56e7c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:22.227948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c13e0dfe-61f4-49e3-bb59-15aeaca56e7c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:22.228431 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c13e0dfe-61f4-49e3-bb59-15aeaca56e7c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:22.228876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c13e0dfe-61f4-49e3-bb59-15aeaca56e7c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:22.369319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-da34b152-af37-431f-adf7-8612e6974ded tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:22.395611 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-da34b152-af37-431f-adf7-8612e6974ded tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1510 microversion: 2.1 time: 1.167621 Oct 10 23:45:22.397117 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2753/5331] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:21 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1510 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:23.215092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-99bd7ea9-cd67-442b-99c5-a158ce92899d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:23.215092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-99bd7ea9-cd67-442b-99c5-a158ce92899d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:23.215092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99bd7ea9-cd67-442b-99c5-a158ce92899d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:23.215092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99bd7ea9-cd67-442b-99c5-a158ce92899d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:23.215092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99bd7ea9-cd67-442b-99c5-a158ce92899d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:23.215092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99bd7ea9-cd67-442b-99c5-a158ce92899d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:23.215092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99bd7ea9-cd67-442b-99c5-a158ce92899d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:23.215092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99bd7ea9-cd67-442b-99c5-a158ce92899d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:23.387172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c13e0dfe-61f4-49e3-bb59-15aeaca56e7c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:23.407589 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c13e0dfe-61f4-49e3-bb59-15aeaca56e7c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1520 microversion: 2.1 time: 1.215839 Oct 10 23:45:23.408376 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2579/5332] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:22 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1520 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:23.425014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9250b624-2e0c-4246-8ddb-ed260f4aa57d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:23.425991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9250b624-2e0c-4246-8ddb-ed260f4aa57d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:23.441114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9250b624-2e0c-4246-8ddb-ed260f4aa57d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:23.442874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9250b624-2e0c-4246-8ddb-ed260f4aa57d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:23.454198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9250b624-2e0c-4246-8ddb-ed260f4aa57d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:23.455548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9250b624-2e0c-4246-8ddb-ed260f4aa57d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:23.456827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9250b624-2e0c-4246-8ddb-ed260f4aa57d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:23.457957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9250b624-2e0c-4246-8ddb-ed260f4aa57d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:23.528520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-99bd7ea9-cd67-442b-99c5-a158ce92899d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:23.546452 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-99bd7ea9-cd67-442b-99c5-a158ce92899d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 200 len: 1321 microversion: 2.1 time: 0.393906 Oct 10 23:45:23.562100 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2754/5333] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:23 2022] GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 1321 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:45:23.773112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9250b624-2e0c-4246-8ddb-ed260f4aa57d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:23.786277 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9250b624-2e0c-4246-8ddb-ed260f4aa57d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1510 microversion: 2.1 time: 0.366727 Oct 10 23:45:23.787738 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2580/5334] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:23 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1510 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:24.455211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3014731f-5060-49a1-ba77-fb6f0958e7a1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:24.459190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3014731f-5060-49a1-ba77-fb6f0958e7a1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:24.483299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3014731f-5060-49a1-ba77-fb6f0958e7a1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:24.486155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3014731f-5060-49a1-ba77-fb6f0958e7a1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:24.486667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3014731f-5060-49a1-ba77-fb6f0958e7a1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:24.487498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3014731f-5060-49a1-ba77-fb6f0958e7a1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:24.490540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3014731f-5060-49a1-ba77-fb6f0958e7a1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:24.491689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3014731f-5060-49a1-ba77-fb6f0958e7a1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:24.578082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1ddce876-8896-4fca-9485-4530a5dc0c79 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:24.579130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1ddce876-8896-4fca-9485-4530a5dc0c79 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:24.596603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ddce876-8896-4fca-9485-4530a5dc0c79 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:24.598942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ddce876-8896-4fca-9485-4530a5dc0c79 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:24.601414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ddce876-8896-4fca-9485-4530a5dc0c79 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:24.603209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ddce876-8896-4fca-9485-4530a5dc0c79 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:24.605674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ddce876-8896-4fca-9485-4530a5dc0c79 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:24.606383 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ddce876-8896-4fca-9485-4530a5dc0c79 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:24.979498 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1ddce876-8896-4fca-9485-4530a5dc0c79 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:24.998000 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1ddce876-8896-4fca-9485-4530a5dc0c79 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 200 len: 1321 microversion: 2.1 time: 0.427059 Oct 10 23:45:25.019154 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2581/5335] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:24 2022] GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 1321 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:25.034086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-08ff2439-abef-4be1-bec5-6cbcbb32b976 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:25.034887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-08ff2439-abef-4be1-bec5-6cbcbb32b976 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:25.045913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ff2439-abef-4be1-bec5-6cbcbb32b976 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:25.046418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ff2439-abef-4be1-bec5-6cbcbb32b976 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:25.046863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ff2439-abef-4be1-bec5-6cbcbb32b976 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:25.047823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ff2439-abef-4be1-bec5-6cbcbb32b976 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:25.048290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ff2439-abef-4be1-bec5-6cbcbb32b976 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:25.048951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ff2439-abef-4be1-bec5-6cbcbb32b976 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:25.116000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3014731f-5060-49a1-ba77-fb6f0958e7a1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:25.143625 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3014731f-5060-49a1-ba77-fb6f0958e7a1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1520 microversion: 2.1 time: 0.685252 Oct 10 23:45:25.204203 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2755/5336] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:24 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1520 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:45:25.554755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-08ff2439-abef-4be1-bec5-6cbcbb32b976 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:25.582179 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-08ff2439-abef-4be1-bec5-6cbcbb32b976 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1510 microversion: 2.1 time: 0.561405 Oct 10 23:45:25.586098 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2582/5337] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:25 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1510 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:25.760348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-379cfcb2-6b22-4760-8028-b009a04c27e2 req-71b52514-30ae-47a5-a01f-5be439573035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc9e449-6324-411e-8af9-0533b23a4e3c", "name": "network-vif-plugged", "status": "completed", "tag": "c8d69949-457f-46f6-9402-4c349227f0a2"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:25.786601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-379cfcb2-6b22-4760-8028-b009a04c27e2 req-71b52514-30ae-47a5-a01f-5be439573035 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:25.787103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-379cfcb2-6b22-4760-8028-b009a04c27e2 req-71b52514-30ae-47a5-a01f-5be439573035 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:25.787543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-379cfcb2-6b22-4760-8028-b009a04c27e2 req-71b52514-30ae-47a5-a01f-5be439573035 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:25.844378 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-379cfcb2-6b22-4760-8028-b009a04c27e2 req-71b52514-30ae-47a5-a01f-5be439573035 service nova] Creating event network-vif-plugged:c8d69949-457f-46f6-9402-4c349227f0a2 for instance efc9e449-6324-411e-8af9-0533b23a4e3c on n-h1-860864-2 Oct 10 23:45:25.865534 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-379cfcb2-6b22-4760-8028-b009a04c27e2 req-71b52514-30ae-47a5-a01f-5be439573035 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108772 Oct 10 23:45:25.866548 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2756/5338] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:45:26.028476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c2061ae4-f9e3-40f7-8a83-eb380d96b9a3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:26.030898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c2061ae4-f9e3-40f7-8a83-eb380d96b9a3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:26.039618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2061ae4-f9e3-40f7-8a83-eb380d96b9a3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:26.040530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2061ae4-f9e3-40f7-8a83-eb380d96b9a3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:26.041152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2061ae4-f9e3-40f7-8a83-eb380d96b9a3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:26.042100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2061ae4-f9e3-40f7-8a83-eb380d96b9a3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:26.042908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2061ae4-f9e3-40f7-8a83-eb380d96b9a3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:26.043533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2061ae4-f9e3-40f7-8a83-eb380d96b9a3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:26.205337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1f5b28ca-e46d-4da0-b6ad-197fd0ac7615 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:26.206072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1f5b28ca-e46d-4da0-b6ad-197fd0ac7615 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:26.216183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f5b28ca-e46d-4da0-b6ad-197fd0ac7615 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:26.216887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f5b28ca-e46d-4da0-b6ad-197fd0ac7615 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:26.217921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f5b28ca-e46d-4da0-b6ad-197fd0ac7615 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:26.221245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f5b28ca-e46d-4da0-b6ad-197fd0ac7615 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:26.223710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f5b28ca-e46d-4da0-b6ad-197fd0ac7615 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:26.224153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f5b28ca-e46d-4da0-b6ad-197fd0ac7615 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:26.361469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c2061ae4-f9e3-40f7-8a83-eb380d96b9a3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:26.376699 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c2061ae4-f9e3-40f7-8a83-eb380d96b9a3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 200 len: 1321 microversion: 2.1 time: 0.354414 Oct 10 23:45:26.377871 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2583/5339] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:26 2022] GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:26.609181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-be34522e-4b48-4ec0-8d2e-9a4d8a6622fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:26.609906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-be34522e-4b48-4ec0-8d2e-9a4d8a6622fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:26.625974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be34522e-4b48-4ec0-8d2e-9a4d8a6622fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:26.627381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be34522e-4b48-4ec0-8d2e-9a4d8a6622fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:26.633090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be34522e-4b48-4ec0-8d2e-9a4d8a6622fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:26.634159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be34522e-4b48-4ec0-8d2e-9a4d8a6622fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:26.634717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be34522e-4b48-4ec0-8d2e-9a4d8a6622fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:26.639142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be34522e-4b48-4ec0-8d2e-9a4d8a6622fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:26.853924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1f5b28ca-e46d-4da0-b6ad-197fd0ac7615 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:26.867533 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1f5b28ca-e46d-4da0-b6ad-197fd0ac7615 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1520 microversion: 2.1 time: 0.667223 Oct 10 23:45:26.868369 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2757/5340] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:26 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1520 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:27.109266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-be34522e-4b48-4ec0-8d2e-9a4d8a6622fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:27.122170 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-be34522e-4b48-4ec0-8d2e-9a4d8a6622fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1510 microversion: 2.1 time: 0.517757 Oct 10 23:45:27.137451 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2584/5341] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:26 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1510 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:45:27.402826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8467245f-d474-4554-b521-29d606788ef1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:27.404405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8467245f-d474-4554-b521-29d606788ef1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:27.416152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8467245f-d474-4554-b521-29d606788ef1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:27.420953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8467245f-d474-4554-b521-29d606788ef1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:27.421452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8467245f-d474-4554-b521-29d606788ef1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:27.422219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8467245f-d474-4554-b521-29d606788ef1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:27.422687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8467245f-d474-4554-b521-29d606788ef1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:27.423122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8467245f-d474-4554-b521-29d606788ef1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:27.827972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8467245f-d474-4554-b521-29d606788ef1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:27.846919 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8467245f-d474-4554-b521-29d606788ef1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 200 len: 1321 microversion: 2.1 time: 0.448380 Oct 10 23:45:27.850317 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2758/5342] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:27 2022] GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 1321 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:27.896694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-99d6e480-de44-4f3b-9329-22c9479c8c6e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:27.897938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-99d6e480-de44-4f3b-9329-22c9479c8c6e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:27.905918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99d6e480-de44-4f3b-9329-22c9479c8c6e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:27.906654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99d6e480-de44-4f3b-9329-22c9479c8c6e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:27.907563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99d6e480-de44-4f3b-9329-22c9479c8c6e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:27.908523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99d6e480-de44-4f3b-9329-22c9479c8c6e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:27.909120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99d6e480-de44-4f3b-9329-22c9479c8c6e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:27.909867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99d6e480-de44-4f3b-9329-22c9479c8c6e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:28.148078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4f10fc52-4247-420e-91b2-289e28347926 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:28.148859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4f10fc52-4247-420e-91b2-289e28347926 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:28.170396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f10fc52-4247-420e-91b2-289e28347926 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:28.172720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f10fc52-4247-420e-91b2-289e28347926 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:28.173291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f10fc52-4247-420e-91b2-289e28347926 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:28.174164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f10fc52-4247-420e-91b2-289e28347926 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:28.182030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f10fc52-4247-420e-91b2-289e28347926 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:28.185606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f10fc52-4247-420e-91b2-289e28347926 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:28.483326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-99d6e480-de44-4f3b-9329-22c9479c8c6e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:28.498481 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-99d6e480-de44-4f3b-9329-22c9479c8c6e tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1520 microversion: 2.1 time: 0.609414 Oct 10 23:45:28.503758 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2585/5343] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:27 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1520 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:28.745700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4f10fc52-4247-420e-91b2-289e28347926 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:28.777516 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4f10fc52-4247-420e-91b2-289e28347926 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1510 microversion: 2.1 time: 0.632695 Oct 10 23:45:28.778520 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2759/5344] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:28 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1510 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:45:28.876755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-28a7bd5b-aedd-44f1-9c01-3e2431d83eaa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:28.877550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-28a7bd5b-aedd-44f1-9c01-3e2431d83eaa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:28.890720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28a7bd5b-aedd-44f1-9c01-3e2431d83eaa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:28.892583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28a7bd5b-aedd-44f1-9c01-3e2431d83eaa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:28.893863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28a7bd5b-aedd-44f1-9c01-3e2431d83eaa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:28.896473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28a7bd5b-aedd-44f1-9c01-3e2431d83eaa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:28.899191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28a7bd5b-aedd-44f1-9c01-3e2431d83eaa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:28.900176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28a7bd5b-aedd-44f1-9c01-3e2431d83eaa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:29.534095 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-93853ad5-f986-41ce-9c95-9cd4b0c7c18f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:29.534765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-93853ad5-f986-41ce-9c95-9cd4b0c7c18f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:29.555236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93853ad5-f986-41ce-9c95-9cd4b0c7c18f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:29.555738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93853ad5-f986-41ce-9c95-9cd4b0c7c18f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:29.556193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93853ad5-f986-41ce-9c95-9cd4b0c7c18f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:29.556887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93853ad5-f986-41ce-9c95-9cd4b0c7c18f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:29.565021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93853ad5-f986-41ce-9c95-9cd4b0c7c18f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:29.565793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93853ad5-f986-41ce-9c95-9cd4b0c7c18f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:29.570854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-28a7bd5b-aedd-44f1-9c01-3e2431d83eaa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:29.573846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:45:29.593088 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-28a7bd5b-aedd-44f1-9c01-3e2431d83eaa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 200 len: 1321 microversion: 2.1 time: 0.720349 Oct 10 23:45:29.601604 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2586/5345] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:28 2022] GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 1321 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:29.800567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b2726605-7ae4-4072-be5d-de9d645f6e90 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:29.801725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b2726605-7ae4-4072-be5d-de9d645f6e90 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:29.811578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2726605-7ae4-4072-be5d-de9d645f6e90 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:29.819366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2726605-7ae4-4072-be5d-de9d645f6e90 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:29.821179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2726605-7ae4-4072-be5d-de9d645f6e90 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:29.824736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2726605-7ae4-4072-be5d-de9d645f6e90 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:29.827838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2726605-7ae4-4072-be5d-de9d645f6e90 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:29.830265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2726605-7ae4-4072-be5d-de9d645f6e90 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:30.172428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-93853ad5-f986-41ce-9c95-9cd4b0c7c18f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:30.184750 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-93853ad5-f986-41ce-9c95-9cd4b0c7c18f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1520 microversion: 2.1 time: 0.656029 Oct 10 23:45:30.188066 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2760/5346] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:29 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1520 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:30.241269 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b2726605-7ae4-4072-be5d-de9d645f6e90 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:30.257460 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b2726605-7ae4-4072-be5d-de9d645f6e90 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1510 microversion: 2.1 time: 0.460864 Oct 10 23:45:30.259154 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2587/5347] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:29 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1510 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:30.623082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-64e96e94-09bc-4604-ae83-24c60e60d866 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:30.626145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-64e96e94-09bc-4604-ae83-24c60e60d866 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:30.642003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64e96e94-09bc-4604-ae83-24c60e60d866 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:30.642762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64e96e94-09bc-4604-ae83-24c60e60d866 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:30.644060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64e96e94-09bc-4604-ae83-24c60e60d866 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:30.645301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64e96e94-09bc-4604-ae83-24c60e60d866 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:30.645959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64e96e94-09bc-4604-ae83-24c60e60d866 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:30.646568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64e96e94-09bc-4604-ae83-24c60e60d866 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:30.948221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-64e96e94-09bc-4604-ae83-24c60e60d866 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:30.960041 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-64e96e94-09bc-4604-ae83-24c60e60d866 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 200 len: 1321 microversion: 2.1 time: 0.341629 Oct 10 23:45:30.965614 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2761/5348] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:30 2022] GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 1321 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:31.221130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-70179629-0072-4ec3-a292-9ccde9b466a5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:31.222095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-70179629-0072-4ec3-a292-9ccde9b466a5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:31.231403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70179629-0072-4ec3-a292-9ccde9b466a5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:31.233248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70179629-0072-4ec3-a292-9ccde9b466a5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:31.234229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70179629-0072-4ec3-a292-9ccde9b466a5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:31.237013 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70179629-0072-4ec3-a292-9ccde9b466a5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:31.238157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70179629-0072-4ec3-a292-9ccde9b466a5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:31.239138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70179629-0072-4ec3-a292-9ccde9b466a5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:31.287337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3c884f64-91e2-4c6b-aa45-50ed440087a8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:31.287958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3c884f64-91e2-4c6b-aa45-50ed440087a8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:31.290519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:45:31.311810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c884f64-91e2-4c6b-aa45-50ed440087a8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:31.316525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c884f64-91e2-4c6b-aa45-50ed440087a8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:31.322339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c884f64-91e2-4c6b-aa45-50ed440087a8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:31.326359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c884f64-91e2-4c6b-aa45-50ed440087a8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:31.328165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c884f64-91e2-4c6b-aa45-50ed440087a8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:31.335732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c884f64-91e2-4c6b-aa45-50ed440087a8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:31.529738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-70179629-0072-4ec3-a292-9ccde9b466a5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:31.538569 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-70179629-0072-4ec3-a292-9ccde9b466a5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.322467 Oct 10 23:45:31.539169 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2588/5349] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:31 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:31.572817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-533e6b36-24c4-46d9-a47b-f34fbb596745 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:31.577668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-533e6b36-24c4-46d9-a47b-f34fbb596745 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:31.593034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-533e6b36-24c4-46d9-a47b-f34fbb596745 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:31.594936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-533e6b36-24c4-46d9-a47b-f34fbb596745 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:31.595548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-533e6b36-24c4-46d9-a47b-f34fbb596745 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:31.597304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-533e6b36-24c4-46d9-a47b-f34fbb596745 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:31.599956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-533e6b36-24c4-46d9-a47b-f34fbb596745 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:31.600725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-533e6b36-24c4-46d9-a47b-f34fbb596745 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:31.883693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-533e6b36-24c4-46d9-a47b-f34fbb596745 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:31.897141 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-533e6b36-24c4-46d9-a47b-f34fbb596745 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.334029 Oct 10 23:45:31.898020 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2589/5350] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:31 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:31.928560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aa843651-e509-4496-b367-ba17969e57ea tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:31.929273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aa843651-e509-4496-b367-ba17969e57ea tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:31.940537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa843651-e509-4496-b367-ba17969e57ea tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:31.941201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa843651-e509-4496-b367-ba17969e57ea tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:31.941769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa843651-e509-4496-b367-ba17969e57ea tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:31.943122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa843651-e509-4496-b367-ba17969e57ea tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:31.943667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa843651-e509-4496-b367-ba17969e57ea tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:31.944172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa843651-e509-4496-b367-ba17969e57ea tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:31.991989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3c884f64-91e2-4c6b-aa45-50ed440087a8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:32.018410 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3c884f64-91e2-4c6b-aa45-50ed440087a8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1510 microversion: 2.1 time: 0.735452 Oct 10 23:45:32.023678 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2762/5351] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:31 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1510 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:32.030890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1abdd07d-a694-4da2-a361-005defad3a1e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:32.031516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1abdd07d-a694-4da2-a361-005defad3a1e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:32.053027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1abdd07d-a694-4da2-a361-005defad3a1e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:32.056085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1abdd07d-a694-4da2-a361-005defad3a1e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:32.057216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1abdd07d-a694-4da2-a361-005defad3a1e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:32.059506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1abdd07d-a694-4da2-a361-005defad3a1e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:32.061985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1abdd07d-a694-4da2-a361-005defad3a1e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:32.064944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1abdd07d-a694-4da2-a361-005defad3a1e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:32.380818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aa843651-e509-4496-b367-ba17969e57ea tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:32.408571 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aa843651-e509-4496-b367-ba17969e57ea tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.482977 Oct 10 23:45:32.408571 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2590/5352] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:31 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:45:32.427018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-c1a26e45-e31d-4f76-9db7-0f5a6bc1dbbf req-ec7d8aa9-b8a2-4912-97b3-487084f3f916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5704bab-05ad-4950-9a7b-0770cbbb6e9d", "name": "network-vif-plugged", "status": "completed", "tag": "67a0ae8d-b0f9-4e9b-9ea5-ecd5e09e3c3d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:32.450799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c1a26e45-e31d-4f76-9db7-0f5a6bc1dbbf req-ec7d8aa9-b8a2-4912-97b3-487084f3f916 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:32.455047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c1a26e45-e31d-4f76-9db7-0f5a6bc1dbbf req-ec7d8aa9-b8a2-4912-97b3-487084f3f916 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:32.455770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c1a26e45-e31d-4f76-9db7-0f5a6bc1dbbf req-ec7d8aa9-b8a2-4912-97b3-487084f3f916 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:32.487400 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-c1a26e45-e31d-4f76-9db7-0f5a6bc1dbbf req-ec7d8aa9-b8a2-4912-97b3-487084f3f916 service nova] Creating event network-vif-plugged:67a0ae8d-b0f9-4e9b-9ea5-ecd5e09e3c3d for instance b5704bab-05ad-4950-9a7b-0770cbbb6e9d on n-h1-860864-2 Oct 10 23:45:32.500930 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-c1a26e45-e31d-4f76-9db7-0f5a6bc1dbbf req-ec7d8aa9-b8a2-4912-97b3-487084f3f916 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090645 Oct 10 23:45:32.508119 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2591/5353] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:45:32.534716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4c4df283-1132-47b1-9203-796a12ba75d6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:32.550702 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-4c4df283-1132-47b1-9203-796a12ba75d6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Instance 9ac97951-cb9b-492c-b6d7-db8f0d14197f has no mapping to a cell. Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4c4df283-1132-47b1-9203-796a12ba75d6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/9ac97951-cb9b-492c-b6d7-db8f0d14197f/action HTTP/1.1 Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 15 Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: {"os-stop": {}} Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 9ac97951-cb9b-492c-b6d7-db8f0d14197f has no mapping to a cell. Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '9ac97951-cb9b-492c-b6d7-db8f0d14197f', 'body': {'os-stop': {}}} Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 9ac97951-cb9b-492c-b6d7-db8f0d14197f has no mapping to a cell. Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:45:32.561518 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ac97951-cb9b-492c-b6d7-db8f0d14197f has no mapping to a cell. Oct 10 23:45:32.567231 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:32.567231 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:32.567231 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:32.567231 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:32.567231 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:32.567231 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:32.567231 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:45:32.567231 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:45:32.567231 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ac97951-cb9b-492c-b6d7-db8f0d14197f has no mapping to a cell. Oct 10 23:45:32.567231 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:32.569045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4c4df283-1132-47b1-9203-796a12ba75d6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 404 to user: Instance 9ac97951-cb9b-492c-b6d7-db8f0d14197f has no mapping to a cell. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:45:32.571481 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4c4df283-1132-47b1-9203-796a12ba75d6 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/9ac97951-cb9b-492c-b6d7-db8f0d14197f/action" status: 404 len: 117 microversion: 2.1 time: 0.061335 Oct 10 23:45:32.573568 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2592/5354] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:45:32 2022] POST /compute/v2.1/servers/9ac97951-cb9b-492c-b6d7-db8f0d14197f/action => generated 117 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:45:32.597871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-03534da9-de56-4de5-9685-b40d6c55a61f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:32.599318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-03534da9-de56-4de5-9685-b40d6c55a61f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:32.615699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03534da9-de56-4de5-9685-b40d6c55a61f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:32.617173 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03534da9-de56-4de5-9685-b40d6c55a61f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:32.619386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03534da9-de56-4de5-9685-b40d6c55a61f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:32.621052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03534da9-de56-4de5-9685-b40d6c55a61f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:32.621239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03534da9-de56-4de5-9685-b40d6c55a61f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:32.621705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03534da9-de56-4de5-9685-b40d6c55a61f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:32.852164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1abdd07d-a694-4da2-a361-005defad3a1e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:32.863305 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1abdd07d-a694-4da2-a361-005defad3a1e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 200 len: 1321 microversion: 2.1 time: 0.838263 Oct 10 23:45:32.865011 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2763/5355] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:32 2022] GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 1321 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:33.055030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-36b1b94d-73d0-4604-8938-b1f0224a2715 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:33.055933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-36b1b94d-73d0-4604-8938-b1f0224a2715 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:33.075282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36b1b94d-73d0-4604-8938-b1f0224a2715 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:33.076120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36b1b94d-73d0-4604-8938-b1f0224a2715 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:33.077328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36b1b94d-73d0-4604-8938-b1f0224a2715 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:33.078226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36b1b94d-73d0-4604-8938-b1f0224a2715 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:33.078706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36b1b94d-73d0-4604-8938-b1f0224a2715 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:33.079152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-36b1b94d-73d0-4604-8938-b1f0224a2715 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:33.110505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:45:33.235988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-03534da9-de56-4de5-9685-b40d6c55a61f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:33.248960 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-03534da9-de56-4de5-9685-b40d6c55a61f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.667602 Oct 10 23:45:33.249989 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2593/5356] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:32 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:33.275328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1484c7a2-b837-4ba2-8060-084d94362597 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:33.275958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1484c7a2-b837-4ba2-8060-084d94362597 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:33.293359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1484c7a2-b837-4ba2-8060-084d94362597 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:33.293750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1484c7a2-b837-4ba2-8060-084d94362597 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:33.294138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1484c7a2-b837-4ba2-8060-084d94362597 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:33.295236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1484c7a2-b837-4ba2-8060-084d94362597 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:33.295715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1484c7a2-b837-4ba2-8060-084d94362597 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:33.296157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1484c7a2-b837-4ba2-8060-084d94362597 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:33.535212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1484c7a2-b837-4ba2-8060-084d94362597 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:33.551506 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1484c7a2-b837-4ba2-8060-084d94362597 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.280918 Oct 10 23:45:33.567919 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2594/5357] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:33 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:45:33.577529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1430064b-e607-45cd-bc82-984c6b80feb5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:33.578667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1430064b-e607-45cd-bc82-984c6b80feb5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6f9aa410-bfae-48d5-a24f-e58e699af30e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:33.584979 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-1430064b-e607-45cd-bc82-984c6b80feb5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Instance 6f9aa410-bfae-48d5-a24f-e58e699af30e could not be found. Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1430064b-e607-45cd-bc82-984c6b80feb5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/6f9aa410-bfae-48d5-a24f-e58e699af30e/action HTTP/1.1 Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 15 Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: {"suspend": {}} Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 6f9aa410-bfae-48d5-a24f-e58e699af30e could not be found. Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '6f9aa410-bfae-48d5-a24f-e58e699af30e', 'body': {'suspend': {}}} Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f9aa410-bfae-48d5-a24f-e58e699af30e could not be found. Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f9aa410-bfae-48d5-a24f-e58e699af30e could not be found. Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:33.586862 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:33.590800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:45:33.590800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:45:33.590800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f9aa410-bfae-48d5-a24f-e58e699af30e could not be found. Oct 10 23:45:33.590800 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:33.592805 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1430064b-e607-45cd-bc82-984c6b80feb5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 404 to user: Instance 6f9aa410-bfae-48d5-a24f-e58e699af30e could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:45:33.593908 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1430064b-e607-45cd-bc82-984c6b80feb5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/6f9aa410-bfae-48d5-a24f-e58e699af30e/action" status: 404 len: 111 microversion: 2.1 time: 0.020933 Oct 10 23:45:33.594688 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2595/5358] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:45:33 2022] POST /compute/v2.1/servers/6f9aa410-bfae-48d5-a24f-e58e699af30e/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:45:33.603728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bc72b9b0-260d-4be1-b828-d9e64ec0bd97 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:33.604591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bc72b9b0-260d-4be1-b828-d9e64ec0bd97 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:33.615062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc72b9b0-260d-4be1-b828-d9e64ec0bd97 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:33.616462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc72b9b0-260d-4be1-b828-d9e64ec0bd97 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:33.617114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc72b9b0-260d-4be1-b828-d9e64ec0bd97 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:33.618082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc72b9b0-260d-4be1-b828-d9e64ec0bd97 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:33.620201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc72b9b0-260d-4be1-b828-d9e64ec0bd97 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:33.621861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc72b9b0-260d-4be1-b828-d9e64ec0bd97 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:33.868464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bc72b9b0-260d-4be1-b828-d9e64ec0bd97 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:33.880320 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bc72b9b0-260d-4be1-b828-d9e64ec0bd97 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.280534 Oct 10 23:45:33.898122 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2596/5359] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:33 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:33.922308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-73fcb42a-244b-4561-a921-205db4ed4cde tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:33.923167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-73fcb42a-244b-4561-a921-205db4ed4cde tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:33.935123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73fcb42a-244b-4561-a921-205db4ed4cde tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:33.935632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73fcb42a-244b-4561-a921-205db4ed4cde tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:33.939935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73fcb42a-244b-4561-a921-205db4ed4cde tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:33.940926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73fcb42a-244b-4561-a921-205db4ed4cde tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:33.941433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73fcb42a-244b-4561-a921-205db4ed4cde tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:33.949740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73fcb42a-244b-4561-a921-205db4ed4cde tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:33.954133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-36b1b94d-73d0-4604-8938-b1f0224a2715 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:33.967700 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-36b1b94d-73d0-4604-8938-b1f0224a2715 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1510 microversion: 2.1 time: 0.919031 Oct 10 23:45:33.973833 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2764/5360] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:33 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1510 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:33.986573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a679f20f-da1f-4872-9c1f-b512e8748b73 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:33.987202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a679f20f-da1f-4872-9c1f-b512e8748b73 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:34.005311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a679f20f-da1f-4872-9c1f-b512e8748b73 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:34.005841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a679f20f-da1f-4872-9c1f-b512e8748b73 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:34.006285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a679f20f-da1f-4872-9c1f-b512e8748b73 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:34.007008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a679f20f-da1f-4872-9c1f-b512e8748b73 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:34.007461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a679f20f-da1f-4872-9c1f-b512e8748b73 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:34.012101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a679f20f-da1f-4872-9c1f-b512e8748b73 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:34.339251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a679f20f-da1f-4872-9c1f-b512e8748b73 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:34.359199 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a679f20f-da1f-4872-9c1f-b512e8748b73 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.382006 Oct 10 23:45:34.360060 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2765/5361] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:33 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:34.386679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-58ce7f01-e19f-47ac-ada0-ddd764459f89 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:34.390383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-58ce7f01-e19f-47ac-ada0-ddd764459f89 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:34.401867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58ce7f01-e19f-47ac-ada0-ddd764459f89 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:34.402372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58ce7f01-e19f-47ac-ada0-ddd764459f89 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:34.402816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58ce7f01-e19f-47ac-ada0-ddd764459f89 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:34.403524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58ce7f01-e19f-47ac-ada0-ddd764459f89 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:34.415340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58ce7f01-e19f-47ac-ada0-ddd764459f89 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:34.415855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58ce7f01-e19f-47ac-ada0-ddd764459f89 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:34.458664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-73fcb42a-244b-4561-a921-205db4ed4cde tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:34.480929 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-73fcb42a-244b-4561-a921-205db4ed4cde tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 200 len: 1321 microversion: 2.1 time: 0.580397 Oct 10 23:45:34.482277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-58ce7f01-e19f-47ac-ada0-ddd764459f89 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lazy-loading 'flavor' on Instance uuid efc9e449-6324-411e-8af9-0533b23a4e3c {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:45:34.483642 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2597/5362] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:33 2022] GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 1321 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:34.660738 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-58ce7f01-e19f-47ac-ada0-ddd764459f89 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action" status: 202 len: 0 microversion: 2.1 time: 0.276548 Oct 10 23:45:34.666037 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2766/5363] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:45:34 2022] POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:45:34.679163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d0c27d4c-1ce3-4a97-8903-f0fa7197113d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:34.695576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d0c27d4c-1ce3-4a97-8903-f0fa7197113d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:34.727006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0c27d4c-1ce3-4a97-8903-f0fa7197113d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:34.730635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0c27d4c-1ce3-4a97-8903-f0fa7197113d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:34.731771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0c27d4c-1ce3-4a97-8903-f0fa7197113d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:34.734582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0c27d4c-1ce3-4a97-8903-f0fa7197113d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:34.738282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0c27d4c-1ce3-4a97-8903-f0fa7197113d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:34.739286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0c27d4c-1ce3-4a97-8903-f0fa7197113d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:35.000114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5531790a-122f-48b3-9cf8-48e1eccc2cad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:35.001474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5531790a-122f-48b3-9cf8-48e1eccc2cad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:35.008112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5531790a-122f-48b3-9cf8-48e1eccc2cad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:35.008799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5531790a-122f-48b3-9cf8-48e1eccc2cad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:35.009442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5531790a-122f-48b3-9cf8-48e1eccc2cad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:35.010911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5531790a-122f-48b3-9cf8-48e1eccc2cad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:35.011526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5531790a-122f-48b3-9cf8-48e1eccc2cad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:35.012220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5531790a-122f-48b3-9cf8-48e1eccc2cad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:35.027213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d0c27d4c-1ce3-4a97-8903-f0fa7197113d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:35.042131 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d0c27d4c-1ce3-4a97-8903-f0fa7197113d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1515 microversion: 2.1 time: 0.375480 Oct 10 23:45:35.042748 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2598/5364] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:34 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1515 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:35.508982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e6c7a09c-3be8-45bf-9786-107ff53b8fc7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:35.509546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e6c7a09c-3be8-45bf-9786-107ff53b8fc7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:35.517546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6c7a09c-3be8-45bf-9786-107ff53b8fc7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:35.518043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6c7a09c-3be8-45bf-9786-107ff53b8fc7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:35.518483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6c7a09c-3be8-45bf-9786-107ff53b8fc7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:35.519190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6c7a09c-3be8-45bf-9786-107ff53b8fc7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:35.519648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6c7a09c-3be8-45bf-9786-107ff53b8fc7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:35.520071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6c7a09c-3be8-45bf-9786-107ff53b8fc7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:35.524851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5531790a-122f-48b3-9cf8-48e1eccc2cad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:35.536984 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5531790a-122f-48b3-9cf8-48e1eccc2cad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1510 microversion: 2.1 time: 0.541189 Oct 10 23:45:35.537864 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2767/5365] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:34 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1510 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:45:35.751840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e6c7a09c-3be8-45bf-9786-107ff53b8fc7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:35.765162 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e6c7a09c-3be8-45bf-9786-107ff53b8fc7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 200 len: 1502 microversion: 2.1 time: 0.259954 Oct 10 23:45:35.765706 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2599/5366] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:35 2022] GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 1502 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:45:35.793690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b4a3a59a-afcd-41a8-8219-ca0a2757aafc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:35.794791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b4a3a59a-afcd-41a8-8219-ca0a2757aafc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:35.804360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4a3a59a-afcd-41a8-8219-ca0a2757aafc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:35.805157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4a3a59a-afcd-41a8-8219-ca0a2757aafc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:35.806214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4a3a59a-afcd-41a8-8219-ca0a2757aafc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:35.807246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4a3a59a-afcd-41a8-8219-ca0a2757aafc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:35.807904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4a3a59a-afcd-41a8-8219-ca0a2757aafc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:35.808680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4a3a59a-afcd-41a8-8219-ca0a2757aafc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:36.073922 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b6d741a5-2d6a-413f-8c87-0f03a79f1ed5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:36.074552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b6d741a5-2d6a-413f-8c87-0f03a79f1ed5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:36.084542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6d741a5-2d6a-413f-8c87-0f03a79f1ed5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:36.085050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6d741a5-2d6a-413f-8c87-0f03a79f1ed5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:36.085518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6d741a5-2d6a-413f-8c87-0f03a79f1ed5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:36.086929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6d741a5-2d6a-413f-8c87-0f03a79f1ed5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:36.088271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6d741a5-2d6a-413f-8c87-0f03a79f1ed5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:36.088871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6d741a5-2d6a-413f-8c87-0f03a79f1ed5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:36.142898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b4a3a59a-afcd-41a8-8219-ca0a2757aafc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:36.171507 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b4a3a59a-afcd-41a8-8219-ca0a2757aafc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 200 len: 1502 microversion: 2.1 time: 0.365266 Oct 10 23:45:36.177583 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2768/5367] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:35 2022] GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 1502 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:45:36.198284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5ae908fd-3ab8-499d-8bd0-430d5956d360 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:36.199098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5ae908fd-3ab8-499d-8bd0-430d5956d360 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:36.211115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ae908fd-3ab8-499d-8bd0-430d5956d360 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:36.212806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ae908fd-3ab8-499d-8bd0-430d5956d360 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:36.213584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ae908fd-3ab8-499d-8bd0-430d5956d360 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:36.215692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ae908fd-3ab8-499d-8bd0-430d5956d360 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:36.216282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ae908fd-3ab8-499d-8bd0-430d5956d360 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:36.216891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ae908fd-3ab8-499d-8bd0-430d5956d360 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:36.258404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5ae908fd-3ab8-499d-8bd0-430d5956d360 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:45:36.337249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b6d741a5-2d6a-413f-8c87-0f03a79f1ed5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:36.348605 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b6d741a5-2d6a-413f-8c87-0f03a79f1ed5 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1498 microversion: 2.1 time: 0.281835 Oct 10 23:45:36.349819 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2600/5368] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:36 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1498 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:36.376962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-10757e7c-5827-4d56-a972-6e4797650640 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:36.377529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-10757e7c-5827-4d56-a972-6e4797650640 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:36.393128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10757e7c-5827-4d56-a972-6e4797650640 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:36.393657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10757e7c-5827-4d56-a972-6e4797650640 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:36.394092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10757e7c-5827-4d56-a972-6e4797650640 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:36.399977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10757e7c-5827-4d56-a972-6e4797650640 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:36.400627 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10757e7c-5827-4d56-a972-6e4797650640 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:36.401214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10757e7c-5827-4d56-a972-6e4797650640 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:36.455603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-10757e7c-5827-4d56-a972-6e4797650640 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lazy-loading 'flavor' on Instance uuid efc9e449-6324-411e-8af9-0533b23a4e3c {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:45:36.508641 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-10757e7c-5827-4d56-a972-6e4797650640 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Cannot 'suspend' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state suspended Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-10757e7c-5827-4d56-a972-6e4797650640 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action HTTP/1.1 Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 15 Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: {"suspend": {}} Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: exception: Cannot 'suspend' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state suspended Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'efc9e449-6324-411e-8af9-0533b23a4e3c', 'body': {'suspend': {}}} Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance efc9e449-6324-411e-8af9-0533b23a4e3c in vm_state suspended. Cannot suspend while the instance is in this state. Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 10 23:45:36.510971 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 23:45:36.514951 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 23:45:36.514951 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 23:45:36.514951 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state suspended Oct 10 23:45:36.514951 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:36.514951 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:36.514951 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:36.514951 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:36.514951 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:36.514951 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:36.514951 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:45:36.514951 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:45:36.514951 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state suspended Oct 10 23:45:36.514951 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:36.516566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-10757e7c-5827-4d56-a972-6e4797650640 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 409 to user: Cannot 'suspend' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state suspended {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:45:36.517799 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-10757e7c-5827-4d56-a972-6e4797650640 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action" status: 409 len: 148 microversion: 2.1 time: 0.145607 Oct 10 23:45:36.518606 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5ae908fd-3ab8-499d-8bd0-430d5956d360 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 204 len: 0 microversion: 2.1 time: 0.319041 Oct 10 23:45:36.521465 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2601/5369] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:45:36 2022] POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action => generated 148 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:45:36.524198 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2769/5370] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:45:36 2022] DELETE /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 23:45:36.532427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-53c30604-33e2-40e0-b2d2-7c2a42305785 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:36.533743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-53c30604-33e2-40e0-b2d2-7c2a42305785 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:36.534066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4f1c0917-d1fd-4b30-a651-7a6eb209b874 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:36.534753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4f1c0917-d1fd-4b30-a651-7a6eb209b874 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 1f082ddb-a09e-4a05-9233-108fa544b12b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:36.547378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f1c0917-d1fd-4b30-a651-7a6eb209b874 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:36.548091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f1c0917-d1fd-4b30-a651-7a6eb209b874 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:36.548325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53c30604-33e2-40e0-b2d2-7c2a42305785 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:36.548842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f1c0917-d1fd-4b30-a651-7a6eb209b874 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:36.548951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53c30604-33e2-40e0-b2d2-7c2a42305785 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:36.549676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53c30604-33e2-40e0-b2d2-7c2a42305785 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:36.549979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f1c0917-d1fd-4b30-a651-7a6eb209b874 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:36.550557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f1c0917-d1fd-4b30-a651-7a6eb209b874 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:36.550663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53c30604-33e2-40e0-b2d2-7c2a42305785 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:36.551205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f1c0917-d1fd-4b30-a651-7a6eb209b874 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:36.551361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53c30604-33e2-40e0-b2d2-7c2a42305785 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:36.552467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53c30604-33e2-40e0-b2d2-7c2a42305785 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:36.657463 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-4f1c0917-d1fd-4b30-a651-7a6eb209b874 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lazy-loading 'services' on Instance uuid 1f082ddb-a09e-4a05-9233-108fa544b12b {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:45:36.721347 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-53c30604-33e2-40e0-b2d2-7c2a42305785 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action" status: 202 len: 0 microversion: 2.1 time: 0.194908 Oct 10 23:45:36.725628 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2770/5371] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:45:36 2022] POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:45:36.735976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b5464a0a-ed0a-4fbb-80d3-a02756178f40 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:36.738152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b5464a0a-ed0a-4fbb-80d3-a02756178f40 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:36.755392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b5464a0a-ed0a-4fbb-80d3-a02756178f40 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:36.760048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b5464a0a-ed0a-4fbb-80d3-a02756178f40 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:36.760694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b5464a0a-ed0a-4fbb-80d3-a02756178f40 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:36.761615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b5464a0a-ed0a-4fbb-80d3-a02756178f40 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:36.762146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b5464a0a-ed0a-4fbb-80d3-a02756178f40 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:36.762581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b5464a0a-ed0a-4fbb-80d3-a02756178f40 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:36.763145 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4f1c0917-d1fd-4b30-a651-7a6eb209b874 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b/os-volume_attachments/d0c24c40-d827-4395-bb6a-c47cd9168744" status: 202 len: 0 microversion: 2.1 time: 0.242398 Oct 10 23:45:36.765971 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2602/5372] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Oct 10 23:45:36 2022] DELETE /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b/os-volume_attachments/d0c24c40-d827-4395-bb6a-c47cd9168744 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:45:36.785283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4bdc7ace-ea52-452e-897b-7546c689d8e3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:36.796363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4bdc7ace-ea52-452e-897b-7546c689d8e3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:36.814963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bdc7ace-ea52-452e-897b-7546c689d8e3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:36.817860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bdc7ace-ea52-452e-897b-7546c689d8e3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:36.820056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bdc7ace-ea52-452e-897b-7546c689d8e3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:36.820928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bdc7ace-ea52-452e-897b-7546c689d8e3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:36.822905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bdc7ace-ea52-452e-897b-7546c689d8e3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:36.824048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4bdc7ace-ea52-452e-897b-7546c689d8e3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:37.110408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4bdc7ace-ea52-452e-897b-7546c689d8e3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:37.118736 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4bdc7ace-ea52-452e-897b-7546c689d8e3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1510 microversion: 2.1 time: 0.350734 Oct 10 23:45:37.119801 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2603/5373] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:36 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1510 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:37.129938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-08ad3b0e-a477-4b5c-b3fa-d0c26e28c6bc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:37.130954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-08ad3b0e-a477-4b5c-b3fa-d0c26e28c6bc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:37.138133 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ad3b0e-a477-4b5c-b3fa-d0c26e28c6bc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:37.138958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ad3b0e-a477-4b5c-b3fa-d0c26e28c6bc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:37.139549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ad3b0e-a477-4b5c-b3fa-d0c26e28c6bc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:37.140743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ad3b0e-a477-4b5c-b3fa-d0c26e28c6bc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:37.141405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ad3b0e-a477-4b5c-b3fa-d0c26e28c6bc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:37.146065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08ad3b0e-a477-4b5c-b3fa-d0c26e28c6bc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:37.276731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b5464a0a-ed0a-4fbb-80d3-a02756178f40 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:37.292399 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b5464a0a-ed0a-4fbb-80d3-a02756178f40 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 200 len: 1508 microversion: 2.1 time: 0.565282 Oct 10 23:45:37.293423 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2771/5374] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:36 2022] GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 1508 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:37.564071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-08ad3b0e-a477-4b5c-b3fa-d0c26e28c6bc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:37.575364 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-08ad3b0e-a477-4b5c-b3fa-d0c26e28c6bc tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1504 microversion: 2.1 time: 0.454196 Oct 10 23:45:37.586491 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2604/5375] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:37 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1504 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:38.147139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-19f45b08-bfa6-4f56-a2df-b34dac4cbb81 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:38.147756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-19f45b08-bfa6-4f56-a2df-b34dac4cbb81 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:38.159833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19f45b08-bfa6-4f56-a2df-b34dac4cbb81 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:38.160487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19f45b08-bfa6-4f56-a2df-b34dac4cbb81 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:38.161852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19f45b08-bfa6-4f56-a2df-b34dac4cbb81 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:38.162598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19f45b08-bfa6-4f56-a2df-b34dac4cbb81 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:38.163842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19f45b08-bfa6-4f56-a2df-b34dac4cbb81 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:38.164299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19f45b08-bfa6-4f56-a2df-b34dac4cbb81 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:38.318231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ca60231e-b96f-4f2d-a070-aa68b7b5cbcd tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:38.319767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ca60231e-b96f-4f2d-a070-aa68b7b5cbcd tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:38.332138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca60231e-b96f-4f2d-a070-aa68b7b5cbcd tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:38.332880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca60231e-b96f-4f2d-a070-aa68b7b5cbcd tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:38.333575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca60231e-b96f-4f2d-a070-aa68b7b5cbcd tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:38.334580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca60231e-b96f-4f2d-a070-aa68b7b5cbcd tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:38.335251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca60231e-b96f-4f2d-a070-aa68b7b5cbcd tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:38.335885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca60231e-b96f-4f2d-a070-aa68b7b5cbcd tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:38.381551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:45:39.117437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-19f45b08-bfa6-4f56-a2df-b34dac4cbb81 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:39.131207 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-19f45b08-bfa6-4f56-a2df-b34dac4cbb81 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1487 microversion: 2.1 time: 0.988607 Oct 10 23:45:39.132174 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2772/5376] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:38 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1487 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:39.136760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e7d6d301-94ab-4bce-ad85-5c099fd7cdde tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:39.137558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e7d6d301-94ab-4bce-ad85-5c099fd7cdde tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:39.159274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7d6d301-94ab-4bce-ad85-5c099fd7cdde tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:39.159784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7d6d301-94ab-4bce-ad85-5c099fd7cdde tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:39.160230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7d6d301-94ab-4bce-ad85-5c099fd7cdde tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:39.160954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7d6d301-94ab-4bce-ad85-5c099fd7cdde tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:39.161430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7d6d301-94ab-4bce-ad85-5c099fd7cdde tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:39.161865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7d6d301-94ab-4bce-ad85-5c099fd7cdde tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:39.596290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ca60231e-b96f-4f2d-a070-aa68b7b5cbcd tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:39.613396 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ca60231e-b96f-4f2d-a070-aa68b7b5cbcd tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 200 len: 1508 microversion: 2.1 time: 1.297453 Oct 10 23:45:39.621495 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2605/5377] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:38 2022] GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 1508 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:39.642828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4f00da85-f14b-4efb-99eb-c78c3cafb37e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:39.652615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4f00da85-f14b-4efb-99eb-c78c3cafb37e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:39.662664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f00da85-f14b-4efb-99eb-c78c3cafb37e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:39.673535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f00da85-f14b-4efb-99eb-c78c3cafb37e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:39.674355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f00da85-f14b-4efb-99eb-c78c3cafb37e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:39.675291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f00da85-f14b-4efb-99eb-c78c3cafb37e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:39.675938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f00da85-f14b-4efb-99eb-c78c3cafb37e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:39.676550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f00da85-f14b-4efb-99eb-c78c3cafb37e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:39.806194 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4f00da85-f14b-4efb-99eb-c78c3cafb37e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action" status: 200 len: 125 microversion: 2.1 time: 0.183336 Oct 10 23:45:39.807034 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2606/5378] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:45:39 2022] POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action => generated 125 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:45:39.825154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-041632df-7f1a-4e1a-847e-02addd7cd638 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:39.827797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-041632df-7f1a-4e1a-847e-02addd7cd638 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:39.855236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-041632df-7f1a-4e1a-847e-02addd7cd638 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:39.861665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-041632df-7f1a-4e1a-847e-02addd7cd638 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:39.864414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-041632df-7f1a-4e1a-847e-02addd7cd638 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:39.864552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e7d6d301-94ab-4bce-ad85-5c099fd7cdde tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:39.873686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-041632df-7f1a-4e1a-847e-02addd7cd638 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:39.873890 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e7d6d301-94ab-4bce-ad85-5c099fd7cdde tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1504 microversion: 2.1 time: 0.740283 Oct 10 23:45:39.874717 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2773/5379] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:39 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1504 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:39.875506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-041632df-7f1a-4e1a-847e-02addd7cd638 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:39.876840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-041632df-7f1a-4e1a-847e-02addd7cd638 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:40.272039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-041632df-7f1a-4e1a-847e-02addd7cd638 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:40.281647 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-041632df-7f1a-4e1a-847e-02addd7cd638 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.464417 Oct 10 23:45:40.286729 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2607/5380] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:39 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:45:40.319038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-42b9fcb2-ea0f-441a-9be2-ba259964bdf3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:40.319869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-42b9fcb2-ea0f-441a-9be2-ba259964bdf3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:40.333782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42b9fcb2-ea0f-441a-9be2-ba259964bdf3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:40.334400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42b9fcb2-ea0f-441a-9be2-ba259964bdf3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:40.334944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42b9fcb2-ea0f-441a-9be2-ba259964bdf3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:40.343052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42b9fcb2-ea0f-441a-9be2-ba259964bdf3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:40.343754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42b9fcb2-ea0f-441a-9be2-ba259964bdf3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:40.344382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42b9fcb2-ea0f-441a-9be2-ba259964bdf3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:40.639927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-42b9fcb2-ea0f-441a-9be2-ba259964bdf3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:40.649109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e06ab165-21d0-40c2-8101-ae01127c90eb tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:40.651818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e06ab165-21d0-40c2-8101-ae01127c90eb tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:40.669914 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-42b9fcb2-ea0f-441a-9be2-ba259964bdf3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.353565 Oct 10 23:45:40.672060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e06ab165-21d0-40c2-8101-ae01127c90eb tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:40.672853 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2774/5381] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:40 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:40.676006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e06ab165-21d0-40c2-8101-ae01127c90eb tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:40.676644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e06ab165-21d0-40c2-8101-ae01127c90eb tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:40.680757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e06ab165-21d0-40c2-8101-ae01127c90eb tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:40.681411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e06ab165-21d0-40c2-8101-ae01127c90eb tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:40.681989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e06ab165-21d0-40c2-8101-ae01127c90eb tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:40.699757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b6352329-f93d-49d7-9c1e-7af12982c7ad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:40.700617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b6352329-f93d-49d7-9c1e-7af12982c7ad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:40.716882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6352329-f93d-49d7-9c1e-7af12982c7ad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:40.719791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6352329-f93d-49d7-9c1e-7af12982c7ad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:40.722549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6352329-f93d-49d7-9c1e-7af12982c7ad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:40.723441 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6352329-f93d-49d7-9c1e-7af12982c7ad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:40.726872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6352329-f93d-49d7-9c1e-7af12982c7ad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:40.727454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6352329-f93d-49d7-9c1e-7af12982c7ad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:41.485192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e06ab165-21d0-40c2-8101-ae01127c90eb tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:41.499415 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e06ab165-21d0-40c2-8101-ae01127c90eb tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 200 len: 1466 microversion: 2.1 time: 0.856411 Oct 10 23:45:41.504633 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2608/5382] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:40 2022] GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 1466 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:41.516847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-7b318219-b777-47d5-bb0e-14bf71f90b5d req-bba7b32d-5199-447e-9564-cdd6f8f94296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5704bab-05ad-4950-9a7b-0770cbbb6e9d", "name": "network-vif-deleted", "tag": "67a0ae8d-b0f9-4e9b-9ea5-ecd5e09e3c3d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:41.543599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7b318219-b777-47d5-bb0e-14bf71f90b5d req-bba7b32d-5199-447e-9564-cdd6f8f94296 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:41.545326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7b318219-b777-47d5-bb0e-14bf71f90b5d req-bba7b32d-5199-447e-9564-cdd6f8f94296 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:41.546301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7b318219-b777-47d5-bb0e-14bf71f90b5d req-bba7b32d-5199-447e-9564-cdd6f8f94296 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:41.569359 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-7b318219-b777-47d5-bb0e-14bf71f90b5d req-bba7b32d-5199-447e-9564-cdd6f8f94296 service nova] Creating event network-vif-deleted:67a0ae8d-b0f9-4e9b-9ea5-ecd5e09e3c3d for instance b5704bab-05ad-4950-9a7b-0770cbbb6e9d on n-h1-860864-2 Oct 10 23:45:41.578278 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-7b318219-b777-47d5-bb0e-14bf71f90b5d req-bba7b32d-5199-447e-9564-cdd6f8f94296 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071859 Oct 10 23:45:41.580111 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2609/5383] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:45:41.589136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2a987bc3-5091-4244-86b5-47274886dc52 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:41.591808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2a987bc3-5091-4244-86b5-47274886dc52 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:41.602239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a987bc3-5091-4244-86b5-47274886dc52 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:41.603133 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a987bc3-5091-4244-86b5-47274886dc52 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:41.605077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a987bc3-5091-4244-86b5-47274886dc52 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:41.606208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a987bc3-5091-4244-86b5-47274886dc52 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:41.607654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a987bc3-5091-4244-86b5-47274886dc52 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:41.608795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a987bc3-5091-4244-86b5-47274886dc52 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:41.896526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b6352329-f93d-49d7-9c1e-7af12982c7ad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:41.915578 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b6352329-f93d-49d7-9c1e-7af12982c7ad tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 1.219903 Oct 10 23:45:41.929862 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2775/5384] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:40 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:45:41.945432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-75f7eb11-f1c5-4027-809d-da779a8bedb8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:41.946050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-75f7eb11-f1c5-4027-809d-da779a8bedb8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:41.956537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75f7eb11-f1c5-4027-809d-da779a8bedb8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:41.960240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75f7eb11-f1c5-4027-809d-da779a8bedb8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:41.962033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75f7eb11-f1c5-4027-809d-da779a8bedb8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:41.964817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75f7eb11-f1c5-4027-809d-da779a8bedb8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:41.965541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75f7eb11-f1c5-4027-809d-da779a8bedb8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:41.968368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75f7eb11-f1c5-4027-809d-da779a8bedb8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:42.131696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2a987bc3-5091-4244-86b5-47274886dc52 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:42.144433 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2a987bc3-5091-4244-86b5-47274886dc52 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.559379 Oct 10 23:45:42.147588 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2610/5385] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:41 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:42.176370 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-475caf47-576f-4191-834e-59a1e35c9093 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:42.176995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-475caf47-576f-4191-834e-59a1e35c9093 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:42.184279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-475caf47-576f-4191-834e-59a1e35c9093 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:42.185045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-475caf47-576f-4191-834e-59a1e35c9093 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:42.185538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-475caf47-576f-4191-834e-59a1e35c9093 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:42.186336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-475caf47-576f-4191-834e-59a1e35c9093 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:42.191646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-475caf47-576f-4191-834e-59a1e35c9093 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:42.192127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-475caf47-576f-4191-834e-59a1e35c9093 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:42.512548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-75f7eb11-f1c5-4027-809d-da779a8bedb8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:42.516180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:45:42.537301 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-75f7eb11-f1c5-4027-809d-da779a8bedb8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.596603 Oct 10 23:45:42.558871 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2776/5386] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:41 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:42.609323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b480ce87-54b9-4ed5-8550-1b814a65f2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:42.609988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b480ce87-54b9-4ed5-8550-1b814a65f2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:42.632832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b480ce87-54b9-4ed5-8550-1b814a65f2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:42.633341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b480ce87-54b9-4ed5-8550-1b814a65f2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:42.633818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b480ce87-54b9-4ed5-8550-1b814a65f2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:42.636023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b480ce87-54b9-4ed5-8550-1b814a65f2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:42.636795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b480ce87-54b9-4ed5-8550-1b814a65f2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:42.637405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b480ce87-54b9-4ed5-8550-1b814a65f2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:42.662005 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-b480ce87-54b9-4ed5-8550-1b814a65f2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] HTTP exception thrown: Instance b5704bab-05ad-4950-9a7b-0770cbbb6e9d could not be found. Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b480ce87-54b9-4ed5-8550-1b814a65f2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Request method failure captured: Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d HTTP/1.1 Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK5cQzq5PmBN8ZK8xufnInf_nKzozFybG60EPi2LKIagIuIo6wmjCjt_dEi9KoG421lgq7o9GXzxCjj26_PYoj0IVUx4iuPxFYRw_bINPtYf7R0sv0LrnaNDyTyma9wRBMptURK1MlutQq_man6Zj75t-cnvbQ_0wIRWAQ7WKgqvlIM Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fcc4d45337140259bcd5b64b17aa7b5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersTestJSON-1882347849 Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersTestJSON-1882347849-project Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: daf7a1ddba654265a5e732363c85eefa Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersTestJSON-1882347849-project Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance b5704bab-05ad-4950-9a7b-0770cbbb6e9d could not be found. Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'b5704bab-05ad-4950-9a7b-0770cbbb6e9d'} Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5704bab-05ad-4950-9a7b-0770cbbb6e9d could not be found. Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5704bab-05ad-4950-9a7b-0770cbbb6e9d could not be found. Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:42.663914 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:42.667672 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:42.667672 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:42.667672 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:42.667672 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:45:42.667672 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:45:42.667672 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5704bab-05ad-4950-9a7b-0770cbbb6e9d could not be found. Oct 10 23:45:42.667672 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:42.669346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b480ce87-54b9-4ed5-8550-1b814a65f2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Returning 404 to user: Instance b5704bab-05ad-4950-9a7b-0770cbbb6e9d could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:45:42.671779 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b480ce87-54b9-4ed5-8550-1b814a65f2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 404 len: 111 microversion: 2.1 time: 0.110945 Oct 10 23:45:42.673325 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2777/5387] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:42 2022] GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:45:42.693861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c41ad078-0eb8-4ce7-a944-fca5db4bb80f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Action: 'create', calling method: .version_select at 0x7f662ae700d0>, body: {"keypair": {"name": "tempest-key-1745789103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGA0ES5WqxnezjwO6VqYo661IYzIZHEN76poc8RBixFbJxu8XcEdVd3MBnQlS/5NoRjx/4Q7cF6y4+s4P+grCsiuL+AHzDO299NSW6Ghjr1YNGlYE9uuuuoYj+iY4MU4XQ=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:42.742100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-c41ad078-0eb8-4ce7-a944-fca5db4bb80f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Getting quotas for project 7fcc4d45337140259bcd5b64b17aa7b5. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:45:42.752912 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-475caf47-576f-4191-834e-59a1e35c9093 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:42.760710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-c41ad078-0eb8-4ce7-a944-fca5db4bb80f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Getting quotas for user daf7a1ddba654265a5e732363c85eefa and project 7fcc4d45337140259bcd5b64b17aa7b5. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:45:42.775054 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-475caf47-576f-4191-834e-59a1e35c9093 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.602982 Oct 10 23:45:42.776271 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2611/5388] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:42 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:45:42.798526 n-d-860864-2 devstack@n-api.service[120613]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c41ad078-0eb8-4ce7-a944-fca5db4bb80f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [9b518037-c822-4751-8c32-b8f9db7be4a5] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 10 23:45:42.802371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8fbbfe81-a958-49b0-af7c-fb0ff613f676 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:42.803044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8fbbfe81-a958-49b0-af7c-fb0ff613f676 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: bf1f709b-efc5-465e-b839-c0c1964b1756] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:42.811337 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-8fbbfe81-a958-49b0-af7c-fb0ff613f676 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Instance bf1f709b-efc5-465e-b839-c0c1964b1756 could not be found. Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8fbbfe81-a958-49b0-af7c-fb0ff613f676 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/bf1f709b-efc5-465e-b839-c0c1964b1756/action HTTP/1.1 Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 15 Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: {"unpause": {}} Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance bf1f709b-efc5-465e-b839-c0c1964b1756 could not be found. Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'bf1f709b-efc5-465e-b839-c0c1964b1756', 'body': {'unpause': {}}} Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf1f709b-efc5-465e-b839-c0c1964b1756 could not be found. Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf1f709b-efc5-465e-b839-c0c1964b1756 could not be found. Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:42.817553 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:42.820802 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:45:42.820802 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:45:42.820802 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf1f709b-efc5-465e-b839-c0c1964b1756 could not be found. Oct 10 23:45:42.820802 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:42.825900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8fbbfe81-a958-49b0-af7c-fb0ff613f676 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 404 to user: Instance bf1f709b-efc5-465e-b839-c0c1964b1756 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:45:42.830452 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8fbbfe81-a958-49b0-af7c-fb0ff613f676 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/bf1f709b-efc5-465e-b839-c0c1964b1756/action" status: 404 len: 111 microversion: 2.1 time: 0.032077 Oct 10 23:45:42.831707 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2612/5389] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:45:42 2022] POST /compute/v2.1/servers/bf1f709b-efc5-465e-b839-c0c1964b1756/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:45:42.839563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-85745d4a-3586-4693-9ff0-9511bd5da71c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:42.842328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-85745d4a-3586-4693-9ff0-9511bd5da71c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:42.865973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85745d4a-3586-4693-9ff0-9511bd5da71c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:42.866802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85745d4a-3586-4693-9ff0-9511bd5da71c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:42.867647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85745d4a-3586-4693-9ff0-9511bd5da71c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:42.868549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85745d4a-3586-4693-9ff0-9511bd5da71c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:42.869186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85745d4a-3586-4693-9ff0-9511bd5da71c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:42.869843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85745d4a-3586-4693-9ff0-9511bd5da71c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:43.349393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-85745d4a-3586-4693-9ff0-9511bd5da71c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:43.369932 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-85745d4a-3586-4693-9ff0-9511bd5da71c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.522178 Oct 10 23:45:43.371187 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2613/5390] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:42 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:43.376816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-50bfcc3a-3310-475d-96a7-fd07cadd36f2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-688489332", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "17157a6b-ea9d-4593-b208-9ce16ed44768"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:43.398972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:45:43.498336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-50bfcc3a-3310-475d-96a7-fd07cadd36f2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] validate_networks() for [('17157a6b-ea9d-4593-b208-9ce16ed44768', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:45:43.818210 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [None req-c41ad078-0eb8-4ce7-a944-fca5db4bb80f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [9b518037-c822-4751-8c32-b8f9db7be4a5] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 36662. Oct 10 23:45:43.866353 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c41ad078-0eb8-4ce7-a944-fca5db4bb80f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 1.179592 Oct 10 23:45:43.866956 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2778/5391] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:45:42 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:45:43.877510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-673a9bf3-125d-4bd7-acd7-f3009625b893 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:43.878364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-673a9bf3-125d-4bd7-acd7-f3009625b893 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:43.895005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-673a9bf3-125d-4bd7-acd7-f3009625b893 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:43.896236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-673a9bf3-125d-4bd7-acd7-f3009625b893 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:43.896844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-673a9bf3-125d-4bd7-acd7-f3009625b893 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:43.897782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-673a9bf3-125d-4bd7-acd7-f3009625b893 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:43.898414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-673a9bf3-125d-4bd7-acd7-f3009625b893 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:43.899167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-673a9bf3-125d-4bd7-acd7-f3009625b893 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:44.164135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-673a9bf3-125d-4bd7-acd7-f3009625b893 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:44.183100 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-673a9bf3-125d-4bd7-acd7-f3009625b893 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.310891 Oct 10 23:45:44.183984 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2779/5392] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:43 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:44.197983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-70f3c758-8dc4-4302-9494-cac68d4d07b2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '.version_select at 0x7f662a5df8b0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:44.211592 n-d-860864-2 devstack@n-api.service[120613]: WARNING oslo_db.sqlalchemy.utils [None req-70f3c758-8dc4-4302-9494-cac68d4d07b2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 10 23:45:44.223854 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-70f3c758-8dc4-4302-9494-cac68d4d07b2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.038953 Oct 10 23:45:44.232672 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2780/5393] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:45:44 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:45:44.238929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f8b1af6b-f8b1-4abf-bc1a-616f99d6de06 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:44.239470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f8b1af6b-f8b1-4abf-bc1a-616f99d6de06 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:44.274980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8b1af6b-f8b1-4abf-bc1a-616f99d6de06 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:44.275486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8b1af6b-f8b1-4abf-bc1a-616f99d6de06 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:44.278360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8b1af6b-f8b1-4abf-bc1a-616f99d6de06 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:44.279102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8b1af6b-f8b1-4abf-bc1a-616f99d6de06 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:44.279671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8b1af6b-f8b1-4abf-bc1a-616f99d6de06 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:44.280105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8b1af6b-f8b1-4abf-bc1a-616f99d6de06 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:44.404443 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-f8b1af6b-f8b1-4abf-bc1a-616f99d6de06 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Cannot 'unpause' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state active Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f8b1af6b-f8b1-4abf-bc1a-616f99d6de06 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action HTTP/1.1 Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 15 Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: {"unpause": {}} Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: exception: Cannot 'unpause' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state active Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'efc9e449-6324-411e-8af9-0533b23a4e3c', 'body': {'unpause': {}}} Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance efc9e449-6324-411e-8af9-0533b23a4e3c in vm_state active. Cannot unpause while the instance is in this state. Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state active Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:44.411616 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:44.415527 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:44.415527 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:45:44.415527 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:45:44.415527 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state active Oct 10 23:45:44.415527 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:44.416626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f8b1af6b-f8b1-4abf-bc1a-616f99d6de06 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 409 to user: Cannot 'unpause' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state active {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:45:44.419770 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f8b1af6b-f8b1-4abf-bc1a-616f99d6de06 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action" status: 409 len: 145 microversion: 2.1 time: 0.185814 Oct 10 23:45:44.425019 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2781/5394] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:45:44 2022] POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action => generated 145 bytes in 192 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:45:44.446181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c1ebb910-6e75-4c66-9312-afb5331c3cba tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:44.451317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c1ebb910-6e75-4c66-9312-afb5331c3cba tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:44.465083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1ebb910-6e75-4c66-9312-afb5331c3cba tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:44.470343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1ebb910-6e75-4c66-9312-afb5331c3cba tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:44.471197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1ebb910-6e75-4c66-9312-afb5331c3cba tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:44.472326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1ebb910-6e75-4c66-9312-afb5331c3cba tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:44.473033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1ebb910-6e75-4c66-9312-afb5331c3cba tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:44.473800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1ebb910-6e75-4c66-9312-afb5331c3cba tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:44.493131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-50bfcc3a-3310-475d-96a7-fd07cadd36f2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:45:44.495039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-50bfcc3a-3310-475d-96a7-fd07cadd36f2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:45:44.496312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-50bfcc3a-3310-475d-96a7-fd07cadd36f2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:45:44.497044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-50bfcc3a-3310-475d-96a7-fd07cadd36f2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:45:44.497706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-50bfcc3a-3310-475d-96a7-fd07cadd36f2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:45:44.530496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50bfcc3a-3310-475d-96a7-fd07cadd36f2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:44.531243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50bfcc3a-3310-475d-96a7-fd07cadd36f2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:44.532762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50bfcc3a-3310-475d-96a7-fd07cadd36f2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:44.534463 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50bfcc3a-3310-475d-96a7-fd07cadd36f2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:44.538600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50bfcc3a-3310-475d-96a7-fd07cadd36f2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:44.540009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50bfcc3a-3310-475d-96a7-fd07cadd36f2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:44.612376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-50bfcc3a-3310-475d-96a7-fd07cadd36f2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Getting quotas for project f798f5f5321f40b89fc5bacc3b9389fe. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:45:44.630492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-50bfcc3a-3310-475d-96a7-fd07cadd36f2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Getting quotas for user cfd8618ee1864d1d86de2def024b49bb and project f798f5f5321f40b89fc5bacc3b9389fe. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:45:44.683709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-50bfcc3a-3310-475d-96a7-fd07cadd36f2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:45:44.691637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-50bfcc3a-3310-475d-96a7-fd07cadd36f2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:45:44.939686 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-50bfcc3a-3310-475d-96a7-fd07cadd36f2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.565009 Oct 10 23:45:44.954815 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2614/5395] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:45:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:45:44.989909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fc6e5a29-1ad3-4136-a337-f2d7b5b46035 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1801744054", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "key_name": "tempest-key-1745789103", "networks": [{"uuid": "abcacee0-1319-4318-8900-2ff15d7780f9"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:45.114932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-fc6e5a29-1ad3-4136-a337-f2d7b5b46035 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] validate_networks() for [('abcacee0-1319-4318-8900-2ff15d7780f9', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:45:45.163337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c1ebb910-6e75-4c66-9312-afb5331c3cba tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:45.175684 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c1ebb910-6e75-4c66-9312-afb5331c3cba tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.742590 Oct 10 23:45:45.179291 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2782/5396] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:44 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:45.186340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bcc288f6-1f7e-40d1-a586-196708051711 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:45.187447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bcc288f6-1f7e-40d1-a586-196708051711 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:45.301289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bcc288f6-1f7e-40d1-a586-196708051711 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:45.319483 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bcc288f6-1f7e-40d1-a586-196708051711 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2" status: 200 len: 1214 microversion: 2.1 time: 0.138460 Oct 10 23:45:45.320100 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2783/5397] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:45 2022] GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2 => generated 1214 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:45.334272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c703872e-155c-489d-9e6a-cfb5c9673aa1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:45.335099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c703872e-155c-489d-9e6a-cfb5c9673aa1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:45.361289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c703872e-155c-489d-9e6a-cfb5c9673aa1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:45.361832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c703872e-155c-489d-9e6a-cfb5c9673aa1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:45.362278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c703872e-155c-489d-9e6a-cfb5c9673aa1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:45.374324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c703872e-155c-489d-9e6a-cfb5c9673aa1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:45.375262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c703872e-155c-489d-9e6a-cfb5c9673aa1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:45.376324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c703872e-155c-489d-9e6a-cfb5c9673aa1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:46.298584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c703872e-155c-489d-9e6a-cfb5c9673aa1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:46.340334 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c703872e-155c-489d-9e6a-cfb5c9673aa1 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 1.012645 Oct 10 23:45:46.347727 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2784/5398] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:45 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:46.366389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d0fff015-d99a-4eb0-bffb-f4bd391dac76 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:46.391695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d0fff015-d99a-4eb0-bffb-f4bd391dac76 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:46.418597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0fff015-d99a-4eb0-bffb-f4bd391dac76 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:46.422120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0fff015-d99a-4eb0-bffb-f4bd391dac76 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:46.422946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0fff015-d99a-4eb0-bffb-f4bd391dac76 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:46.423962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0fff015-d99a-4eb0-bffb-f4bd391dac76 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:46.424705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0fff015-d99a-4eb0-bffb-f4bd391dac76 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:46.426834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0fff015-d99a-4eb0-bffb-f4bd391dac76 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:46.501486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-fc6e5a29-1ad3-4136-a337-f2d7b5b46035 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:45:46.502024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-fc6e5a29-1ad3-4136-a337-f2d7b5b46035 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:45:46.502517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-fc6e5a29-1ad3-4136-a337-f2d7b5b46035 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:45:46.502936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-fc6e5a29-1ad3-4136-a337-f2d7b5b46035 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:45:46.503353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-fc6e5a29-1ad3-4136-a337-f2d7b5b46035 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:45:46.532152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc6e5a29-1ad3-4136-a337-f2d7b5b46035 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:46.532744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc6e5a29-1ad3-4136-a337-f2d7b5b46035 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:46.537848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc6e5a29-1ad3-4136-a337-f2d7b5b46035 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:46.556867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc6e5a29-1ad3-4136-a337-f2d7b5b46035 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:46.561621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc6e5a29-1ad3-4136-a337-f2d7b5b46035 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:46.566899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc6e5a29-1ad3-4136-a337-f2d7b5b46035 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:46.646719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d0fff015-d99a-4eb0-bffb-f4bd391dac76 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:46.660132 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d0fff015-d99a-4eb0-bffb-f4bd391dac76 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2" status: 200 len: 1266 microversion: 2.1 time: 0.310692 Oct 10 23:45:46.661131 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2785/5399] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:46 2022] GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2 => generated 1266 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:46.661667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-fc6e5a29-1ad3-4136-a337-f2d7b5b46035 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Getting quotas for project 7fcc4d45337140259bcd5b64b17aa7b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:45:46.668336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bf8d45bc-034d-4530-b3b5-2df0ebbc6aa4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:46.670498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bf8d45bc-034d-4530-b3b5-2df0ebbc6aa4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: f9e9f940-6429-4eb6-acd6-6d37bb776d40] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:46.678294 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-bf8d45bc-034d-4530-b3b5-2df0ebbc6aa4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Instance f9e9f940-6429-4eb6-acd6-6d37bb776d40 could not be found. Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bf8d45bc-034d-4530-b3b5-2df0ebbc6aa4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/f9e9f940-6429-4eb6-acd6-6d37bb776d40/action HTTP/1.1 Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 18 Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: {"unshelve": null} Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance f9e9f940-6429-4eb6-acd6-6d37bb776d40 could not be found. Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'f9e9f940-6429-4eb6-acd6-6d37bb776d40', 'body': {'unshelve': None}} Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9e9f940-6429-4eb6-acd6-6d37bb776d40 could not be found. Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9e9f940-6429-4eb6-acd6-6d37bb776d40 could not be found. Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:46.681194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:46.685028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:46.685028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:46.685028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:46.685028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:46.685028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:45:46.685028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:45:46.685028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9e9f940-6429-4eb6-acd6-6d37bb776d40 could not be found. Oct 10 23:45:46.685028 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:46.690035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bf8d45bc-034d-4530-b3b5-2df0ebbc6aa4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 404 to user: Instance f9e9f940-6429-4eb6-acd6-6d37bb776d40 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:45:46.691477 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bf8d45bc-034d-4530-b3b5-2df0ebbc6aa4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/f9e9f940-6429-4eb6-acd6-6d37bb776d40/action" status: 404 len: 111 microversion: 2.1 time: 0.028886 Oct 10 23:45:46.692387 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2786/5400] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:45:46 2022] POST /compute/v2.1/servers/f9e9f940-6429-4eb6-acd6-6d37bb776d40/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:45:46.706676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-fc6e5a29-1ad3-4136-a337-f2d7b5b46035 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Getting quotas for user daf7a1ddba654265a5e732363c85eefa and project 7fcc4d45337140259bcd5b64b17aa7b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:45:46.737218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-234c6333-bc56-4b9b-b8eb-cc4084ee2055 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:46.739037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-234c6333-bc56-4b9b-b8eb-cc4084ee2055 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:46.756082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fc6e5a29-1ad3-4136-a337-f2d7b5b46035 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:45:46.766596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-234c6333-bc56-4b9b-b8eb-cc4084ee2055 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:46.771570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fc6e5a29-1ad3-4136-a337-f2d7b5b46035 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:45:46.771937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-234c6333-bc56-4b9b-b8eb-cc4084ee2055 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:46.772624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-234c6333-bc56-4b9b-b8eb-cc4084ee2055 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:46.773645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-234c6333-bc56-4b9b-b8eb-cc4084ee2055 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:46.774377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-234c6333-bc56-4b9b-b8eb-cc4084ee2055 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:46.775277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-234c6333-bc56-4b9b-b8eb-cc4084ee2055 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:46.938205 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fc6e5a29-1ad3-4136-a337-f2d7b5b46035 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.981768 Oct 10 23:45:46.943216 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2615/5401] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:45:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:45:46.958508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d56b48c2-8a46-4984-8a6a-e3627ae334c9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:46.973009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d56b48c2-8a46-4984-8a6a-e3627ae334c9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:47.312708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-234c6333-bc56-4b9b-b8eb-cc4084ee2055 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:47.332579 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-234c6333-bc56-4b9b-b8eb-cc4084ee2055 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.635585 Oct 10 23:45:47.333195 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2787/5402] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:46 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:47.360529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2c7a7237-272a-4e58-9a63-ffe5b2da3fa0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:47.361624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2c7a7237-272a-4e58-9a63-ffe5b2da3fa0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:47.369725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c7a7237-272a-4e58-9a63-ffe5b2da3fa0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:47.370509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c7a7237-272a-4e58-9a63-ffe5b2da3fa0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:47.371117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c7a7237-272a-4e58-9a63-ffe5b2da3fa0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:47.372064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c7a7237-272a-4e58-9a63-ffe5b2da3fa0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:47.372739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c7a7237-272a-4e58-9a63-ffe5b2da3fa0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:47.373407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2c7a7237-272a-4e58-9a63-ffe5b2da3fa0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:47.627794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d56b48c2-8a46-4984-8a6a-e3627ae334c9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:47.649064 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d56b48c2-8a46-4984-8a6a-e3627ae334c9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 200 len: 1229 microversion: 2.1 time: 0.697185 Oct 10 23:45:47.653068 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2616/5403] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:46 2022] GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 1229 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:47.699108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6da1933a-2505-4722-ac18-ec977e25f2a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:47.699108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6da1933a-2505-4722-ac18-ec977e25f2a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:47.726983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6da1933a-2505-4722-ac18-ec977e25f2a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:47.731380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6da1933a-2505-4722-ac18-ec977e25f2a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:47.732156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6da1933a-2505-4722-ac18-ec977e25f2a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:47.733315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6da1933a-2505-4722-ac18-ec977e25f2a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:47.750614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6da1933a-2505-4722-ac18-ec977e25f2a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:47.759897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6da1933a-2505-4722-ac18-ec977e25f2a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:47.944096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6da1933a-2505-4722-ac18-ec977e25f2a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:47.959868 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6da1933a-2505-4722-ac18-ec977e25f2a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2" status: 200 len: 1272 microversion: 2.1 time: 0.269111 Oct 10 23:45:47.960417 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2617/5404] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:47 2022] GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2 => generated 1272 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:47.987743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7c7bf7c5-c9b7-4bb0-a281-7e9431b74ff2 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:47.993694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7c7bf7c5-c9b7-4bb0-a281-7e9431b74ff2 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 1f082ddb-a09e-4a05-9233-108fa544b12b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:48.013611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c7bf7c5-c9b7-4bb0-a281-7e9431b74ff2 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:48.014265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c7bf7c5-c9b7-4bb0-a281-7e9431b74ff2 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:48.014710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c7bf7c5-c9b7-4bb0-a281-7e9431b74ff2 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:48.015635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c7bf7c5-c9b7-4bb0-a281-7e9431b74ff2 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:48.016129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c7bf7c5-c9b7-4bb0-a281-7e9431b74ff2 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:48.016524 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c7bf7c5-c9b7-4bb0-a281-7e9431b74ff2 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:48.069369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2c7a7237-272a-4e58-9a63-ffe5b2da3fa0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:48.081987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7c7bf7c5-c9b7-4bb0-a281-7e9431b74ff2 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 1f082ddb-a09e-4a05-9233-108fa544b12b] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:45:48.088333 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2c7a7237-272a-4e58-9a63-ffe5b2da3fa0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.731862 Oct 10 23:45:48.090354 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2788/5405] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:47 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:48.129248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-80e8e471-7013-43c4-8331-f7613d753836 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:48.132843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-80e8e471-7013-43c4-8331-f7613d753836 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:48.164572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80e8e471-7013-43c4-8331-f7613d753836 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:48.165723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80e8e471-7013-43c4-8331-f7613d753836 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:48.169216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80e8e471-7013-43c4-8331-f7613d753836 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:48.183656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80e8e471-7013-43c4-8331-f7613d753836 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:48.185013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80e8e471-7013-43c4-8331-f7613d753836 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:48.185976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80e8e471-7013-43c4-8331-f7613d753836 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:48.279664 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-80e8e471-7013-43c4-8331-f7613d753836 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Cannot 'unshelve' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state active Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-80e8e471-7013-43c4-8331-f7613d753836 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action HTTP/1.1 Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 18 Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: {"unshelve": null} Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: exception: Cannot 'unshelve' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state active Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'efc9e449-6324-411e-8af9-0533b23a4e3c', 'body': {'unshelve': None}} Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance efc9e449-6324-411e-8af9-0533b23a4e3c in vm_state active. Cannot unshelve while the instance is in this state. Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 23:45:48.288167 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 23:45:48.292577 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state active Oct 10 23:45:48.292577 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:48.292577 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:48.292577 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:48.292577 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:48.292577 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:48.292577 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:48.292577 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:45:48.292577 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:45:48.292577 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state active Oct 10 23:45:48.292577 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:48.292577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-80e8e471-7013-43c4-8331-f7613d753836 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 409 to user: Cannot 'unshelve' instance efc9e449-6324-411e-8af9-0533b23a4e3c while it is in vm_state active {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:45:48.299408 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7c7bf7c5-c9b7-4bb0-a281-7e9431b74ff2 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b" status: 204 len: 0 microversion: 2.1 time: 0.337641 Oct 10 23:45:48.302248 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-80e8e471-7013-43c4-8331-f7613d753836 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action" status: 409 len: 146 microversion: 2.1 time: 0.175898 Oct 10 23:45:48.302673 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2618/5406] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:45:47 2022] DELETE /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:45:48.308011 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2789/5407] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:45:48 2022] POST /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c/action => generated 146 bytes in 189 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:45:48.318811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-64e1d9eb-f037-48a4-93eb-a0cb3ffe6ba8 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:48.320348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-64e1d9eb-f037-48a4-93eb-a0cb3ffe6ba8 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 1f082ddb-a09e-4a05-9233-108fa544b12b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:48.324165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6c339a35-7892-48ba-9b23-b6aee18e6c40 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:48.326174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6c339a35-7892-48ba-9b23-b6aee18e6c40 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:48.328314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64e1d9eb-f037-48a4-93eb-a0cb3ffe6ba8 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:48.328685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64e1d9eb-f037-48a4-93eb-a0cb3ffe6ba8 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:48.329296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64e1d9eb-f037-48a4-93eb-a0cb3ffe6ba8 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:48.330201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64e1d9eb-f037-48a4-93eb-a0cb3ffe6ba8 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:48.330841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64e1d9eb-f037-48a4-93eb-a0cb3ffe6ba8 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:48.335210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64e1d9eb-f037-48a4-93eb-a0cb3ffe6ba8 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:48.339686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c339a35-7892-48ba-9b23-b6aee18e6c40 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:48.342620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c339a35-7892-48ba-9b23-b6aee18e6c40 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:48.344232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c339a35-7892-48ba-9b23-b6aee18e6c40 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:48.345266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c339a35-7892-48ba-9b23-b6aee18e6c40 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:48.350745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c339a35-7892-48ba-9b23-b6aee18e6c40 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:48.354138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c339a35-7892-48ba-9b23-b6aee18e6c40 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:48.747997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-64e1d9eb-f037-48a4-93eb-a0cb3ffe6ba8 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:48.755974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6c339a35-7892-48ba-9b23-b6aee18e6c40 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:48.761765 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-64e1d9eb-f037-48a4-93eb-a0cb3ffe6ba8 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b" status: 200 len: 1515 microversion: 2.1 time: 0.448194 Oct 10 23:45:48.778635 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2619/5408] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:48 2022] GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b => generated 1515 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:48.787069 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6c339a35-7892-48ba-9b23-b6aee18e6c40 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.469592 Oct 10 23:45:48.792389 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2790/5409] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:48 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:48.802913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2826cb69-8b85-4051-9fa5-53ea2999bde6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:48.804996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2826cb69-8b85-4051-9fa5-53ea2999bde6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:48.821848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2826cb69-8b85-4051-9fa5-53ea2999bde6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:48.822613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2826cb69-8b85-4051-9fa5-53ea2999bde6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:48.823451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2826cb69-8b85-4051-9fa5-53ea2999bde6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:48.826936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2826cb69-8b85-4051-9fa5-53ea2999bde6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:48.827934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2826cb69-8b85-4051-9fa5-53ea2999bde6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:48.830188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2826cb69-8b85-4051-9fa5-53ea2999bde6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:49.053198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2826cb69-8b85-4051-9fa5-53ea2999bde6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:49.067760 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2826cb69-8b85-4051-9fa5-53ea2999bde6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 200 len: 1233 microversion: 2.1 time: 0.273006 Oct 10 23:45:49.082818 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2791/5410] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:48 2022] GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 1233 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:49.098642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-48190ff8-d4bf-4cab-a4ec-71ad62eed9d4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:49.099544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-48190ff8-d4bf-4cab-a4ec-71ad62eed9d4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:49.118444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-48190ff8-d4bf-4cab-a4ec-71ad62eed9d4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:49.119249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-48190ff8-d4bf-4cab-a4ec-71ad62eed9d4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:49.119870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-48190ff8-d4bf-4cab-a4ec-71ad62eed9d4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:49.121423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-48190ff8-d4bf-4cab-a4ec-71ad62eed9d4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:49.122050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-48190ff8-d4bf-4cab-a4ec-71ad62eed9d4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:49.122487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-48190ff8-d4bf-4cab-a4ec-71ad62eed9d4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:49.153261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3b78a7ca-fa25-426b-a37e-e11e8d8c7bc5 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-717030531", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "da9fb351-e54a-410b-b06e-a1f818927ea6"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:49.283708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-3b78a7ca-fa25-426b-a37e-e11e8d8c7bc5 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] validate_networks() for [('da9fb351-e54a-410b-b06e-a1f818927ea6', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:45:49.664369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-48190ff8-d4bf-4cab-a4ec-71ad62eed9d4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:49.680631 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-48190ff8-d4bf-4cab-a4ec-71ad62eed9d4 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.596484 Oct 10 23:45:49.682586 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2792/5411] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:49 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:49.705108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f50cc2c9-0165-4d81-af8a-f3ee14c2729a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:49.707226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f50cc2c9-0165-4d81-af8a-f3ee14c2729a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:49.741263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f50cc2c9-0165-4d81-af8a-f3ee14c2729a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:49.742990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f50cc2c9-0165-4d81-af8a-f3ee14c2729a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:49.744163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f50cc2c9-0165-4d81-af8a-f3ee14c2729a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:49.745321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f50cc2c9-0165-4d81-af8a-f3ee14c2729a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:49.751555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f50cc2c9-0165-4d81-af8a-f3ee14c2729a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:49.752451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f50cc2c9-0165-4d81-af8a-f3ee14c2729a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:50.143971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f50cc2c9-0165-4d81-af8a-f3ee14c2729a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:50.166058 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f50cc2c9-0165-4d81-af8a-f3ee14c2729a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2" status: 200 len: 1272 microversion: 2.1 time: 0.482247 Oct 10 23:45:50.171326 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2793/5412] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:49 2022] GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2 => generated 1272 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:50.183070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ef9b5336-65d4-43c8-946f-78df4aa63fba tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-843339138_updated"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:50.192599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ef9b5336-65d4-43c8-946f-78df4aa63fba tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6b9e0717-9033-424e-bdec-aec2b5833bdf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:50.210132 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-ef9b5336-65d4-43c8-946f-78df4aa63fba tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Instance 6b9e0717-9033-424e-bdec-aec2b5833bdf could not be found. Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ef9b5336-65d4-43c8-946f-78df4aa63fba tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: request: PUT /compute/v2.1/servers/6b9e0717-9033-424e-bdec-aec2b5833bdf HTTP/1.1 Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 80 Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-843339138_updated"}} Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 6b9e0717-9033-424e-bdec-aec2b5833bdf could not be found. Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '6b9e0717-9033-424e-bdec-aec2b5833bdf', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-843339138_updated'}}} Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b9e0717-9033-424e-bdec-aec2b5833bdf could not be found. Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 10 23:45:50.213324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:45:50.219626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:45:50.219626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:45:50.219626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:45:50.219626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b9e0717-9033-424e-bdec-aec2b5833bdf could not be found. Oct 10 23:45:50.219626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:50.219626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:50.219626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:50.219626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:50.219626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:50.219626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:50.219626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:45:50.219626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:45:50.219626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b9e0717-9033-424e-bdec-aec2b5833bdf could not be found. Oct 10 23:45:50.219626 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:50.224616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ef9b5336-65d4-43c8-946f-78df4aa63fba tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 404 to user: Instance 6b9e0717-9033-424e-bdec-aec2b5833bdf could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:45:50.226283 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ef9b5336-65d4-43c8-946f-78df4aa63fba tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "PUT /compute/v2.1/servers/6b9e0717-9033-424e-bdec-aec2b5833bdf" status: 404 len: 111 microversion: 2.1 time: 0.052635 Oct 10 23:45:50.229561 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2794/5413] 10.222.0.23 () {60 vars in 1256 bytes} [Mon Oct 10 23:45:50 2022] PUT /compute/v2.1/servers/6b9e0717-9033-424e-bdec-aec2b5833bdf => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:45:50.241103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-82652b23-a251-4110-b6f2-5824aac8769b tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:50.242571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-82652b23-a251-4110-b6f2-5824aac8769b tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 1f082ddb-a09e-4a05-9233-108fa544b12b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:50.279307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82652b23-a251-4110-b6f2-5824aac8769b tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:50.279998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82652b23-a251-4110-b6f2-5824aac8769b tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:50.280800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82652b23-a251-4110-b6f2-5824aac8769b tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:50.281967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82652b23-a251-4110-b6f2-5824aac8769b tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:50.282647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82652b23-a251-4110-b6f2-5824aac8769b tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:50.283586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82652b23-a251-4110-b6f2-5824aac8769b tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:50.804307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3b78a7ca-fa25-426b-a37e-e11e8d8c7bc5 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:45:50.807882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3b78a7ca-fa25-426b-a37e-e11e8d8c7bc5 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:45:50.809990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3b78a7ca-fa25-426b-a37e-e11e8d8c7bc5 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:45:50.811166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3b78a7ca-fa25-426b-a37e-e11e8d8c7bc5 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:45:50.812017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-3b78a7ca-fa25-426b-a37e-e11e8d8c7bc5 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:45:50.836214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b78a7ca-fa25-426b-a37e-e11e8d8c7bc5 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:50.836974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b78a7ca-fa25-426b-a37e-e11e8d8c7bc5 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:50.841462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b78a7ca-fa25-426b-a37e-e11e8d8c7bc5 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:50.845792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b78a7ca-fa25-426b-a37e-e11e8d8c7bc5 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:50.847425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b78a7ca-fa25-426b-a37e-e11e8d8c7bc5 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:50.848184 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b78a7ca-fa25-426b-a37e-e11e8d8c7bc5 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:50.930052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-3b78a7ca-fa25-426b-a37e-e11e8d8c7bc5 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Getting quotas for project c29d561525b74d4dbc698fe2522b1b5b. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:45:50.940623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-3b78a7ca-fa25-426b-a37e-e11e8d8c7bc5 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Getting quotas for user 2539fa08826e48d99de000ae1d8fbf55 and project c29d561525b74d4dbc698fe2522b1b5b. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:45:50.967217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3b78a7ca-fa25-426b-a37e-e11e8d8c7bc5 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:45:50.970321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3b78a7ca-fa25-426b-a37e-e11e8d8c7bc5 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:45:51.094009 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3b78a7ca-fa25-426b-a37e-e11e8d8c7bc5 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.311545 Oct 10 23:45:51.094912 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2620/5414] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:45:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:45:51.110829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9e09d6d7-f174-4c77-b4c6-93858f34848a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:51.113933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9e09d6d7-f174-4c77-b4c6-93858f34848a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:51.154533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e09d6d7-f174-4c77-b4c6-93858f34848a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:51.173215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e09d6d7-f174-4c77-b4c6-93858f34848a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:51.174194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e09d6d7-f174-4c77-b4c6-93858f34848a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:51.175260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e09d6d7-f174-4c77-b4c6-93858f34848a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:51.178187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e09d6d7-f174-4c77-b4c6-93858f34848a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:51.186406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9e09d6d7-f174-4c77-b4c6-93858f34848a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:51.622627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-82652b23-a251-4110-b6f2-5824aac8769b tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:51.641011 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-82652b23-a251-4110-b6f2-5824aac8769b tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b" status: 200 len: 1515 microversion: 2.1 time: 1.405854 Oct 10 23:45:51.644137 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2795/5415] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:50 2022] GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b => generated 1515 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:51.658746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c81704b9-99ad-41b2-8207-d981d9040e9d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:51.660546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c81704b9-99ad-41b2-8207-d981d9040e9d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:51.679062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c81704b9-99ad-41b2-8207-d981d9040e9d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:51.679530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c81704b9-99ad-41b2-8207-d981d9040e9d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:51.679972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c81704b9-99ad-41b2-8207-d981d9040e9d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:51.680688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c81704b9-99ad-41b2-8207-d981d9040e9d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:51.686119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c81704b9-99ad-41b2-8207-d981d9040e9d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:51.686841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c81704b9-99ad-41b2-8207-d981d9040e9d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:52.138345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9e09d6d7-f174-4c77-b4c6-93858f34848a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:52.149290 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9e09d6d7-f174-4c77-b4c6-93858f34848a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 200 len: 1281 microversion: 2.1 time: 1.051353 Oct 10 23:45:52.169434 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2621/5416] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:51 2022] GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 1281 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:52.169434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7deb94e5-9e62-46b5-ae17-ec4c3b2dba82 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:52.169434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7deb94e5-9e62-46b5-ae17-ec4c3b2dba82 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:52.405998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c81704b9-99ad-41b2-8207-d981d9040e9d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:52.422544 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c81704b9-99ad-41b2-8207-d981d9040e9d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.773339 Oct 10 23:45:52.423216 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2796/5417] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:51 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:52.447747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-092f62ec-db07-4c4a-833d-ddce36ad3eb1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:52.448565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-092f62ec-db07-4c4a-833d-ddce36ad3eb1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:52.480783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-092f62ec-db07-4c4a-833d-ddce36ad3eb1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:52.481293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-092f62ec-db07-4c4a-833d-ddce36ad3eb1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:52.481874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-092f62ec-db07-4c4a-833d-ddce36ad3eb1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:52.489922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-092f62ec-db07-4c4a-833d-ddce36ad3eb1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:52.493866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-092f62ec-db07-4c4a-833d-ddce36ad3eb1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:52.494739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-092f62ec-db07-4c4a-833d-ddce36ad3eb1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:52.916284 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7deb94e5-9e62-46b5-ae17-ec4c3b2dba82 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2539fa08826e48d99de000ae1d8fbf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c29d561525b74d4dbc698fe2522b1b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:53.009464 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7deb94e5-9e62-46b5-ae17-ec4c3b2dba82 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3" status: 200 len: 1216 microversion: 2.1 time: 0.855605 Oct 10 23:45:53.013621 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2622/5418] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:52 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 => generated 1216 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:53.028088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-effd39ce-a6a0-4eb6-b7d2-ea0db52a09f0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:53.029000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-effd39ce-a6a0-4eb6-b7d2-ea0db52a09f0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:53.046140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-effd39ce-a6a0-4eb6-b7d2-ea0db52a09f0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:53.046896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-effd39ce-a6a0-4eb6-b7d2-ea0db52a09f0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:53.070151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-effd39ce-a6a0-4eb6-b7d2-ea0db52a09f0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:53.071555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-effd39ce-a6a0-4eb6-b7d2-ea0db52a09f0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:53.072401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-effd39ce-a6a0-4eb6-b7d2-ea0db52a09f0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:53.078361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-effd39ce-a6a0-4eb6-b7d2-ea0db52a09f0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:53.498655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-effd39ce-a6a0-4eb6-b7d2-ea0db52a09f0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:53.514557 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-effd39ce-a6a0-4eb6-b7d2-ea0db52a09f0 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.497781 Oct 10 23:45:53.534392 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2623/5419] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:53 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:53.548171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-76e311a4-121d-4692-9069-c0f44fa420d5 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:53.549782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-76e311a4-121d-4692-9069-c0f44fa420d5 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 1f082ddb-a09e-4a05-9233-108fa544b12b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:53.575273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76e311a4-121d-4692-9069-c0f44fa420d5 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:53.576507 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76e311a4-121d-4692-9069-c0f44fa420d5 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:53.577117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76e311a4-121d-4692-9069-c0f44fa420d5 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:53.578322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76e311a4-121d-4692-9069-c0f44fa420d5 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:53.579009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76e311a4-121d-4692-9069-c0f44fa420d5 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:53.579788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76e311a4-121d-4692-9069-c0f44fa420d5 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:54.018264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-092f62ec-db07-4c4a-833d-ddce36ad3eb1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:54.039581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-76e311a4-121d-4692-9069-c0f44fa420d5 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:54.065895 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-092f62ec-db07-4c4a-833d-ddce36ad3eb1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2" status: 200 len: 1314 microversion: 2.1 time: 1.641490 Oct 10 23:45:54.069027 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-76e311a4-121d-4692-9069-c0f44fa420d5 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b" status: 200 len: 1473 microversion: 2.1 time: 0.532723 Oct 10 23:45:54.082365 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2797/5420] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:52 2022] GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2 => generated 1314 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:54.091363 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2624/5421] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:53 2022] GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b => generated 1473 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:54.101657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a923881c-b9b6-4996-9fbd-8b1e0e5e530e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:54.103685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a923881c-b9b6-4996-9fbd-8b1e0e5e530e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:54.115558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3f8c3915-454c-433c-8aeb-460215d7630d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:54.144390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a923881c-b9b6-4996-9fbd-8b1e0e5e530e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:54.144901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a923881c-b9b6-4996-9fbd-8b1e0e5e530e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:54.145352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a923881c-b9b6-4996-9fbd-8b1e0e5e530e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3f8c3915-454c-433c-8aeb-460215d7630d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: request: PUT /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c HTTP/1.1 Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 280 Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'efc9e449-6324-411e-8af9-0533b23a4e3c', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:54.146952 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3f8c3915-454c-433c-8aeb-460215d7630d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:45:54.149798 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3f8c3915-454c-433c-8aeb-460215d7630d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "PUT /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 400 len: 619 microversion: 2.1 time: 0.052175 Oct 10 23:45:54.159356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a923881c-b9b6-4996-9fbd-8b1e0e5e530e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:54.160139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a923881c-b9b6-4996-9fbd-8b1e0e5e530e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:54.160649 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2625/5422] 10.222.0.23 () {60 vars in 1257 bytes} [Mon Oct 10 23:45:54 2022] PUT /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 619 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:45:54.161261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a923881c-b9b6-4996-9fbd-8b1e0e5e530e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:54.171848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-c4d90b37-5de4-4f9e-9ea4-5deba2c0a584 req-0fd9bc58-37ac-49fe-8fd9-205ba32edb01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f082ddb-a09e-4a05-9233-108fa544b12b", "name": "network-vif-deleted", "tag": "65cde77b-3347-4ce5-be55-d7afe6504321"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:54.226800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c4d90b37-5de4-4f9e-9ea4-5deba2c0a584 req-0fd9bc58-37ac-49fe-8fd9-205ba32edb01 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:54.227329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c4d90b37-5de4-4f9e-9ea4-5deba2c0a584 req-0fd9bc58-37ac-49fe-8fd9-205ba32edb01 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:54.227770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c4d90b37-5de4-4f9e-9ea4-5deba2c0a584 req-0fd9bc58-37ac-49fe-8fd9-205ba32edb01 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:54.271081 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-c4d90b37-5de4-4f9e-9ea4-5deba2c0a584 req-0fd9bc58-37ac-49fe-8fd9-205ba32edb01 service nova] Creating event network-vif-deleted:65cde77b-3347-4ce5-be55-d7afe6504321 for instance 1f082ddb-a09e-4a05-9233-108fa544b12b on n-h1-860864-2 Oct 10 23:45:54.281834 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-c4d90b37-5de4-4f9e-9ea4-5deba2c0a584 req-0fd9bc58-37ac-49fe-8fd9-205ba32edb01 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119029 Oct 10 23:45:54.284268 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2626/5423] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:45:54.291651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c2fcd2e4-63e5-4039-bc14-9fed74ab2718 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:54.293751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c2fcd2e4-63e5-4039-bc14-9fed74ab2718 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:54.310420 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2fcd2e4-63e5-4039-bc14-9fed74ab2718 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:54.311705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2fcd2e4-63e5-4039-bc14-9fed74ab2718 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:54.319473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2fcd2e4-63e5-4039-bc14-9fed74ab2718 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:54.320511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2fcd2e4-63e5-4039-bc14-9fed74ab2718 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:54.321143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2fcd2e4-63e5-4039-bc14-9fed74ab2718 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:54.321758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2fcd2e4-63e5-4039-bc14-9fed74ab2718 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:54.423599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a923881c-b9b6-4996-9fbd-8b1e0e5e530e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:54.434577 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a923881c-b9b6-4996-9fbd-8b1e0e5e530e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 200 len: 1287 microversion: 2.1 time: 0.350632 Oct 10 23:45:54.439925 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2798/5424] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:54 2022] GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 1287 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:54.445026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-01ceeb4d-aa9c-47e5-876b-19710376ae5d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:54.451734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-01ceeb4d-aa9c-47e5-876b-19710376ae5d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:54.460324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01ceeb4d-aa9c-47e5-876b-19710376ae5d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:54.460835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01ceeb4d-aa9c-47e5-876b-19710376ae5d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:54.461279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01ceeb4d-aa9c-47e5-876b-19710376ae5d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:54.462045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01ceeb4d-aa9c-47e5-876b-19710376ae5d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:54.462502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01ceeb4d-aa9c-47e5-876b-19710376ae5d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:54.462932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01ceeb4d-aa9c-47e5-876b-19710376ae5d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:54.615766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c2fcd2e4-63e5-4039-bc14-9fed74ab2718 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2539fa08826e48d99de000ae1d8fbf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c29d561525b74d4dbc698fe2522b1b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:54.630173 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c2fcd2e4-63e5-4039-bc14-9fed74ab2718 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3" status: 200 len: 1274 microversion: 2.1 time: 0.343517 Oct 10 23:45:54.646971 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2627/5425] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:54 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 => generated 1274 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:54.807860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-01ceeb4d-aa9c-47e5-876b-19710376ae5d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:54.810509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:45:54.832754 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-01ceeb4d-aa9c-47e5-876b-19710376ae5d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.391468 Oct 10 23:45:54.839267 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2799/5426] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:54 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:54.865923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ffac0513-bd07-4cb0-b6c1-04f895eeca93 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:54.874581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ffac0513-bd07-4cb0-b6c1-04f895eeca93 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:54.896770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffac0513-bd07-4cb0-b6c1-04f895eeca93 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:54.897864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffac0513-bd07-4cb0-b6c1-04f895eeca93 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:54.898506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffac0513-bd07-4cb0-b6c1-04f895eeca93 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:54.899527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffac0513-bd07-4cb0-b6c1-04f895eeca93 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:54.900205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffac0513-bd07-4cb0-b6c1-04f895eeca93 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:54.900885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffac0513-bd07-4cb0-b6c1-04f895eeca93 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:54.919929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:45:55.100282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3af37bf6-3c47-4ed0-a82e-6ed9d23a8388 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:55.100991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3af37bf6-3c47-4ed0-a82e-6ed9d23a8388 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:55.112672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3af37bf6-3c47-4ed0-a82e-6ed9d23a8388 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:55.113483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3af37bf6-3c47-4ed0-a82e-6ed9d23a8388 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:55.114204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3af37bf6-3c47-4ed0-a82e-6ed9d23a8388 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:55.115529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3af37bf6-3c47-4ed0-a82e-6ed9d23a8388 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:55.116159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3af37bf6-3c47-4ed0-a82e-6ed9d23a8388 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:55.116743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3af37bf6-3c47-4ed0-a82e-6ed9d23a8388 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:55.318523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:45:55.376097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3af37bf6-3c47-4ed0-a82e-6ed9d23a8388 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:55.387081 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3af37bf6-3c47-4ed0-a82e-6ed9d23a8388 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2" status: 200 len: 1314 microversion: 2.1 time: 0.290409 Oct 10 23:45:55.402509 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2800/5427] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:55 2022] GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:55.417706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b6993e82-cffc-4a73-a778-d061d184ff62 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:55.418657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b6993e82-cffc-4a73-a778-d061d184ff62 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 1f082ddb-a09e-4a05-9233-108fa544b12b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:55.427653 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6993e82-cffc-4a73-a778-d061d184ff62 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:55.428344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6993e82-cffc-4a73-a778-d061d184ff62 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:55.428937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6993e82-cffc-4a73-a778-d061d184ff62 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:55.429854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6993e82-cffc-4a73-a778-d061d184ff62 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:55.430588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6993e82-cffc-4a73-a778-d061d184ff62 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:55.431321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6993e82-cffc-4a73-a778-d061d184ff62 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:55.450767 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-b6993e82-cffc-4a73-a778-d061d184ff62 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] HTTP exception thrown: Instance 1f082ddb-a09e-4a05-9233-108fa544b12b could not be found. Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b6993e82-cffc-4a73-a778-d061d184ff62 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Request method failure captured: Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b HTTP/1.1 Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK3KE0baiqBkCAIJsEELCBFIA0yQwvYRrjtmncNNffStjL5ZrJFEc5I2xTOWT27ZgMTcx_D8bCO7KLUpiRgaF4FLYH07cuUewOcH4GxnOeIi_x7dL49MkpWlsaBlWiBcjVnsG5lyIM6Dfbeb5e9dUrnOzf2O5t1Tvq1N7vFgpmFI5oI Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: a087b5d73d9240e3b5330975a2b39ea0 Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-VolumesSnapshotTestJSON-886023199 Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a087b5d73d9240e3b5330975a2b39ea0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a087b5d73d9240e3b5330975a2b39ea0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a087b5d73d9240e3b5330975a2b39ea0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a087b5d73d9240e3b5330975a2b39ea0", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-VolumesSnapshotTestJSON-886023199 Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: a087b5d73d9240e3b5330975a2b39ea0 Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-886023199 Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-VolumesSnapshotTestJSON-886023199-project Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 2613b3445bde4bd6b8a350f594458490 Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-VolumesSnapshotTestJSON-886023199-project Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 1f082ddb-a09e-4a05-9233-108fa544b12b could not be found. Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '1f082ddb-a09e-4a05-9233-108fa544b12b'} Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f082ddb-a09e-4a05-9233-108fa544b12b could not be found. Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f082ddb-a09e-4a05-9233-108fa544b12b could not be found. Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:55.454323 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:55.457816 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:55.457816 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:55.457816 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:55.457816 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:45:55.457816 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:45:55.457816 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f082ddb-a09e-4a05-9233-108fa544b12b could not be found. Oct 10 23:45:55.457816 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:45:55.457816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b6993e82-cffc-4a73-a778-d061d184ff62 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Returning 404 to user: Instance 1f082ddb-a09e-4a05-9233-108fa544b12b could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:45:55.457816 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b6993e82-cffc-4a73-a778-d061d184ff62 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b" status: 404 len: 111 microversion: 2.1 time: 0.052616 Oct 10 23:45:55.463883 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2801/5428] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:55 2022] GET /compute/v2.1/servers/1f082ddb-a09e-4a05-9233-108fa544b12b => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:45:55.467826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ffac0513-bd07-4cb0-b6c1-04f895eeca93 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:55.470086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-44d4f646-f17b-496f-8246-757bebf39951 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:55.470706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-44d4f646-f17b-496f-8246-757bebf39951 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:55.477672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44d4f646-f17b-496f-8246-757bebf39951 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:55.478166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44d4f646-f17b-496f-8246-757bebf39951 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:55.478607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44d4f646-f17b-496f-8246-757bebf39951 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:55.479313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44d4f646-f17b-496f-8246-757bebf39951 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:55.479960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44d4f646-f17b-496f-8246-757bebf39951 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:55.480388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44d4f646-f17b-496f-8246-757bebf39951 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:55.500474 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ffac0513-bd07-4cb0-b6c1-04f895eeca93 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.638518 Oct 10 23:45:55.502737 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2628/5429] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:54 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:55.535976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2029a123-ee74-4b0f-8c8f-25cbac9c681d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2029a123-ee74-4b0f-8c8f-25cbac9c681d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: request: PUT /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c HTTP/1.1 Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 24 Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: {"server": {"name": ""}} Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'efc9e449-6324-411e-8af9-0533b23a4e3c', 'body': {'server': {'name': ''}}} Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi '' Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:45:55.540910 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:45:55.544664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 10 23:45:55.544664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:55.544664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:45:55.544664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:55.544664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:45:55.544664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:45:55.544664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:45:55.544664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:45:55.544664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:45:55.544664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 10 23:45:55.544664 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:45:55.549504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2029a123-ee74-4b0f-8c8f-25cbac9c681d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:45:55.551493 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2029a123-ee74-4b0f-8c8f-25cbac9c681d tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "PUT /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 400 len: 108 microversion: 2.1 time: 0.019807 Oct 10 23:45:55.554525 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2629/5430] 10.222.0.23 () {60 vars in 1256 bytes} [Mon Oct 10 23:45:55 2022] PUT /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:45:55.569113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-445a0590-5a40-497b-b4e1-31f3f2eab40f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:55.570442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-445a0590-5a40-497b-b4e1-31f3f2eab40f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:55.581938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-445a0590-5a40-497b-b4e1-31f3f2eab40f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:55.582532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-445a0590-5a40-497b-b4e1-31f3f2eab40f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:55.582985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-445a0590-5a40-497b-b4e1-31f3f2eab40f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:55.583800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-445a0590-5a40-497b-b4e1-31f3f2eab40f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:55.584452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-445a0590-5a40-497b-b4e1-31f3f2eab40f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:55.585147 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-445a0590-5a40-497b-b4e1-31f3f2eab40f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:55.938274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-44d4f646-f17b-496f-8246-757bebf39951 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:55.960543 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-44d4f646-f17b-496f-8246-757bebf39951 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 200 len: 1329 microversion: 2.1 time: 0.495039 Oct 10 23:45:55.961081 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2802/5431] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:55 2022] GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 1329 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:55.973618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3db56d17-a011-4361-af7c-fd968751da56 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:55.984713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3db56d17-a011-4361-af7c-fd968751da56 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:55.992289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:45:55.994875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3db56d17-a011-4361-af7c-fd968751da56 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:55.995883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3db56d17-a011-4361-af7c-fd968751da56 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:55.996614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3db56d17-a011-4361-af7c-fd968751da56 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:55.997856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3db56d17-a011-4361-af7c-fd968751da56 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:55.999309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3db56d17-a011-4361-af7c-fd968751da56 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:55.999964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3db56d17-a011-4361-af7c-fd968751da56 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:56.126294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3db56d17-a011-4361-af7c-fd968751da56 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2539fa08826e48d99de000ae1d8fbf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c29d561525b74d4dbc698fe2522b1b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:56.144141 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3db56d17-a011-4361-af7c-fd968751da56 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3" status: 200 len: 1274 microversion: 2.1 time: 0.181511 Oct 10 23:45:56.164971 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2803/5432] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:55 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 => generated 1274 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:56.419232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-55724668-2ead-4a8a-a0b7-60b5c43facff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:56.419859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-55724668-2ead-4a8a-a0b7-60b5c43facff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:56.441105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-445a0590-5a40-497b-b4e1-31f3f2eab40f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:56.449695 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-445a0590-5a40-497b-b4e1-31f3f2eab40f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1507 microversion: 2.1 time: 0.889627 Oct 10 23:45:56.450294 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2630/5433] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:55 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1507 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:56.450712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55724668-2ead-4a8a-a0b7-60b5c43facff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:56.451998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55724668-2ead-4a8a-a0b7-60b5c43facff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:56.459686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55724668-2ead-4a8a-a0b7-60b5c43facff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:56.460871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55724668-2ead-4a8a-a0b7-60b5c43facff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:56.461514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55724668-2ead-4a8a-a0b7-60b5c43facff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:56.462109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55724668-2ead-4a8a-a0b7-60b5c43facff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:56.686824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-3adbc47d-e277-4a1b-a89d-afb3f2f744ca req-9104d9df-f08b-455a-8ef3-e1cf007db2cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9053f3ff-dd63-4991-8010-ff36800620e2", "tag": "9d911abb-be71-4368-98bf-fc90e3f5867b"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:45:56.711876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3adbc47d-e277-4a1b-a89d-afb3f2f744ca req-9104d9df-f08b-455a-8ef3-e1cf007db2cb service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:56.712415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3adbc47d-e277-4a1b-a89d-afb3f2f744ca req-9104d9df-f08b-455a-8ef3-e1cf007db2cb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:56.712846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3adbc47d-e277-4a1b-a89d-afb3f2f744ca req-9104d9df-f08b-455a-8ef3-e1cf007db2cb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:56.756230 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-3adbc47d-e277-4a1b-a89d-afb3f2f744ca req-9104d9df-f08b-455a-8ef3-e1cf007db2cb service nova] Creating event network-changed:9d911abb-be71-4368-98bf-fc90e3f5867b for instance 9053f3ff-dd63-4991-8010-ff36800620e2 on n-h2-860864-2 Oct 10 23:45:56.796660 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-3adbc47d-e277-4a1b-a89d-afb3f2f744ca req-9104d9df-f08b-455a-8ef3-e1cf007db2cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114622 Oct 10 23:45:56.797809 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2631/5434] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:45:56.993663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dcf09e78-4159-4acf-9008-c6d42daf6552 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:56.994289 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dcf09e78-4159-4acf-9008-c6d42daf6552 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:57.012045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcf09e78-4159-4acf-9008-c6d42daf6552 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:57.012538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcf09e78-4159-4acf-9008-c6d42daf6552 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:57.012977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcf09e78-4159-4acf-9008-c6d42daf6552 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:57.013715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcf09e78-4159-4acf-9008-c6d42daf6552 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:57.014925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcf09e78-4159-4acf-9008-c6d42daf6552 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:57.015355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcf09e78-4159-4acf-9008-c6d42daf6552 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:57.150740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-55724668-2ead-4a8a-a0b7-60b5c43facff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:57.159029 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-55724668-2ead-4a8a-a0b7-60b5c43facff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2" status: 200 len: 1314 microversion: 2.1 time: 0.746235 Oct 10 23:45:57.175525 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2804/5435] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:56 2022] GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2 => generated 1314 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:57.183035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3f7c9656-d5ce-4584-b4ea-ee520801c4ba tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:57.193765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3f7c9656-d5ce-4584-b4ea-ee520801c4ba tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:57.218994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f7c9656-d5ce-4584-b4ea-ee520801c4ba tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:57.220465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f7c9656-d5ce-4584-b4ea-ee520801c4ba tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:57.220970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f7c9656-d5ce-4584-b4ea-ee520801c4ba tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:57.222072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f7c9656-d5ce-4584-b4ea-ee520801c4ba tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:57.222183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f7c9656-d5ce-4584-b4ea-ee520801c4ba tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:57.226450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f7c9656-d5ce-4584-b4ea-ee520801c4ba tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:57.439105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3f7c9656-d5ce-4584-b4ea-ee520801c4ba tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2539fa08826e48d99de000ae1d8fbf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c29d561525b74d4dbc698fe2522b1b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:57.456877 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3f7c9656-d5ce-4584-b4ea-ee520801c4ba tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3" status: 200 len: 1274 microversion: 2.1 time: 0.279663 Oct 10 23:45:57.459975 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2805/5436] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:57 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 => generated 1274 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:58.195911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c3c0d11d-b236-461e-adc7-598e0e4c54d9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:58.198230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c3c0d11d-b236-461e-adc7-598e0e4c54d9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:58.227047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3c0d11d-b236-461e-adc7-598e0e4c54d9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:58.234740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3c0d11d-b236-461e-adc7-598e0e4c54d9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:58.235608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3c0d11d-b236-461e-adc7-598e0e4c54d9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:58.237238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3c0d11d-b236-461e-adc7-598e0e4c54d9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:58.238012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3c0d11d-b236-461e-adc7-598e0e4c54d9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:58.238762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3c0d11d-b236-461e-adc7-598e0e4c54d9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:58.450008 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dcf09e78-4159-4acf-9008-c6d42daf6552 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:58.472786 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dcf09e78-4159-4acf-9008-c6d42daf6552 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 200 len: 1329 microversion: 2.1 time: 1.484802 Oct 10 23:45:58.473414 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2632/5437] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:56 2022] GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 1329 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:58.487108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8a939b0c-03db-4eea-aa1b-7150ada5d6b8 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:58.487719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8a939b0c-03db-4eea-aa1b-7150ada5d6b8 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:58.503902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a939b0c-03db-4eea-aa1b-7150ada5d6b8 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:58.504394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a939b0c-03db-4eea-aa1b-7150ada5d6b8 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:58.509945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a939b0c-03db-4eea-aa1b-7150ada5d6b8 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:58.510799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a939b0c-03db-4eea-aa1b-7150ada5d6b8 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:58.511276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a939b0c-03db-4eea-aa1b-7150ada5d6b8 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:58.511717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a939b0c-03db-4eea-aa1b-7150ada5d6b8 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:58.582004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c3c0d11d-b236-461e-adc7-598e0e4c54d9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:58.612796 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c3c0d11d-b236-461e-adc7-598e0e4c54d9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2" status: 200 len: 1314 microversion: 2.1 time: 0.421249 Oct 10 23:45:58.616917 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2806/5438] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:58 2022] GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:58.849924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8a939b0c-03db-4eea-aa1b-7150ada5d6b8 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2539fa08826e48d99de000ae1d8fbf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c29d561525b74d4dbc698fe2522b1b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:58.860397 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8a939b0c-03db-4eea-aa1b-7150ada5d6b8 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3" status: 200 len: 1274 microversion: 2.1 time: 0.377945 Oct 10 23:45:58.875196 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2633/5439] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:58 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 => generated 1274 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:59.505645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f2abab38-214d-40fe-b4d3-a7f8ce9e7ad3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:59.507826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f2abab38-214d-40fe-b4d3-a7f8ce9e7ad3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:59.526220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2abab38-214d-40fe-b4d3-a7f8ce9e7ad3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:59.527138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2abab38-214d-40fe-b4d3-a7f8ce9e7ad3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:59.528304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2abab38-214d-40fe-b4d3-a7f8ce9e7ad3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:59.532189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2abab38-214d-40fe-b4d3-a7f8ce9e7ad3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:59.534821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2abab38-214d-40fe-b4d3-a7f8ce9e7ad3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:59.536927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2abab38-214d-40fe-b4d3-a7f8ce9e7ad3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:59.660367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-95e72a38-9f9a-4531-b385-94c6f8e4a34f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:59.677762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-95e72a38-9f9a-4531-b385-94c6f8e4a34f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:59.695836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95e72a38-9f9a-4531-b385-94c6f8e4a34f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:59.696504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95e72a38-9f9a-4531-b385-94c6f8e4a34f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:59.696914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95e72a38-9f9a-4531-b385-94c6f8e4a34f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:59.697716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95e72a38-9f9a-4531-b385-94c6f8e4a34f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:59.698664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95e72a38-9f9a-4531-b385-94c6f8e4a34f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:59.699368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95e72a38-9f9a-4531-b385-94c6f8e4a34f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:59.859007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f2abab38-214d-40fe-b4d3-a7f8ce9e7ad3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:45:59.875431 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f2abab38-214d-40fe-b4d3-a7f8ce9e7ad3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 200 len: 1329 microversion: 2.1 time: 0.375329 Oct 10 23:45:59.876388 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2807/5440] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:59 2022] GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 1329 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:45:59.891562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1d94e6bc-578c-4db8-9c39-156022f13b4a tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:45:59.896900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1d94e6bc-578c-4db8-9c39-156022f13b4a tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:45:59.915039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d94e6bc-578c-4db8-9c39-156022f13b4a tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:59.919796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d94e6bc-578c-4db8-9c39-156022f13b4a tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:59.921720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d94e6bc-578c-4db8-9c39-156022f13b4a tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:45:59.922621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d94e6bc-578c-4db8-9c39-156022f13b4a tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:45:59.929419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d94e6bc-578c-4db8-9c39-156022f13b4a tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:45:59.930212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d94e6bc-578c-4db8-9c39-156022f13b4a tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:00.267856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-95e72a38-9f9a-4531-b385-94c6f8e4a34f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:00.281329 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-95e72a38-9f9a-4531-b385-94c6f8e4a34f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2" status: 200 len: 1314 microversion: 2.1 time: 0.629106 Oct 10 23:46:00.301691 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2634/5441] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:59 2022] GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2 => generated 1314 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:00.590995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1d94e6bc-578c-4db8-9c39-156022f13b4a tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2539fa08826e48d99de000ae1d8fbf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c29d561525b74d4dbc698fe2522b1b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:00.605298 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1d94e6bc-578c-4db8-9c39-156022f13b4a tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3" status: 200 len: 1316 microversion: 2.1 time: 0.722064 Oct 10 23:46:00.606571 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2808/5442] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:45:59 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 => generated 1316 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:00.900650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-59c79bf5-6d59-45c9-8c1e-8d3535f69374 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:00.901263 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-59c79bf5-6d59-45c9-8c1e-8d3535f69374 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:00.904485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:46:00.926431 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59c79bf5-6d59-45c9-8c1e-8d3535f69374 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:00.931776 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59c79bf5-6d59-45c9-8c1e-8d3535f69374 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:00.932442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59c79bf5-6d59-45c9-8c1e-8d3535f69374 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:00.933534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59c79bf5-6d59-45c9-8c1e-8d3535f69374 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:00.941463 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59c79bf5-6d59-45c9-8c1e-8d3535f69374 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:00.942160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-59c79bf5-6d59-45c9-8c1e-8d3535f69374 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:01.125362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-ca85adee-d3aa-48c8-afcf-f8cb71f6eb79 req-1c580577-d05c-4b31-b6fa-ceb08eedd373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7deab0f3-dcff-4418-b980-179ec1e244f8", "tag": "def19659-5280-48d2-a772-e823d2496b13"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:01.153978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ca85adee-d3aa-48c8-afcf-f8cb71f6eb79 req-1c580577-d05c-4b31-b6fa-ceb08eedd373 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:01.155006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ca85adee-d3aa-48c8-afcf-f8cb71f6eb79 req-1c580577-d05c-4b31-b6fa-ceb08eedd373 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:01.155616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ca85adee-d3aa-48c8-afcf-f8cb71f6eb79 req-1c580577-d05c-4b31-b6fa-ceb08eedd373 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:01.204883 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-ca85adee-d3aa-48c8-afcf-f8cb71f6eb79 req-1c580577-d05c-4b31-b6fa-ceb08eedd373 service nova] Creating event network-changed:def19659-5280-48d2-a772-e823d2496b13 for instance 7deab0f3-dcff-4418-b980-179ec1e244f8 on n-h1-860864-2 Oct 10 23:46:01.226248 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-ca85adee-d3aa-48c8-afcf-f8cb71f6eb79 req-1c580577-d05c-4b31-b6fa-ceb08eedd373 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106025 Oct 10 23:46:01.231723 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2809/5443] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:46:01.314860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bee3e514-0c04-472a-8c30-5d0a83d2393c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:01.315894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bee3e514-0c04-472a-8c30-5d0a83d2393c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:01.330623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bee3e514-0c04-472a-8c30-5d0a83d2393c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:01.335394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bee3e514-0c04-472a-8c30-5d0a83d2393c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:01.336409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bee3e514-0c04-472a-8c30-5d0a83d2393c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:01.338721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bee3e514-0c04-472a-8c30-5d0a83d2393c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:01.340145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bee3e514-0c04-472a-8c30-5d0a83d2393c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:01.342468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bee3e514-0c04-472a-8c30-5d0a83d2393c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:01.799254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-59c79bf5-6d59-45c9-8c1e-8d3535f69374 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:01.839396 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-59c79bf5-6d59-45c9-8c1e-8d3535f69374 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 200 len: 1329 microversion: 2.1 time: 0.912378 Oct 10 23:46:01.840943 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2635/5444] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:00 2022] GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 1329 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:01.855628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dd0dc9fe-aba8-4299-a663-04e67e3139a0 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:01.856545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dd0dc9fe-aba8-4299-a663-04e67e3139a0 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:01.874368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd0dc9fe-aba8-4299-a663-04e67e3139a0 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:01.875271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd0dc9fe-aba8-4299-a663-04e67e3139a0 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:01.875941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd0dc9fe-aba8-4299-a663-04e67e3139a0 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:01.876907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd0dc9fe-aba8-4299-a663-04e67e3139a0 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:01.878811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd0dc9fe-aba8-4299-a663-04e67e3139a0 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:01.880840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd0dc9fe-aba8-4299-a663-04e67e3139a0 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:02.135517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bee3e514-0c04-472a-8c30-5d0a83d2393c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:02.144601 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bee3e514-0c04-472a-8c30-5d0a83d2393c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2" status: 200 len: 1314 microversion: 2.1 time: 0.836148 Oct 10 23:46:02.151888 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2810/5445] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:01 2022] GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2 => generated 1314 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:46:02.853601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dd0dc9fe-aba8-4299-a663-04e67e3139a0 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2539fa08826e48d99de000ae1d8fbf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c29d561525b74d4dbc698fe2522b1b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:02.868244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ef0cad76-5f53-4b4c-b8d8-3012d263c056 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:02.869074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ef0cad76-5f53-4b4c-b8d8-3012d263c056 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:02.887476 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dd0dc9fe-aba8-4299-a663-04e67e3139a0 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3" status: 200 len: 1316 microversion: 2.1 time: 1.044332 Oct 10 23:46:02.892241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef0cad76-5f53-4b4c-b8d8-3012d263c056 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:02.892944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef0cad76-5f53-4b4c-b8d8-3012d263c056 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:02.893890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef0cad76-5f53-4b4c-b8d8-3012d263c056 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:02.894004 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2636/5446] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:01 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 => generated 1316 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:02.895565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef0cad76-5f53-4b4c-b8d8-3012d263c056 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:02.901475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef0cad76-5f53-4b4c-b8d8-3012d263c056 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:02.902068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef0cad76-5f53-4b4c-b8d8-3012d263c056 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:03.215862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a19cb2b5-8e66-4c3d-856c-eadddc4e7cab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:03.218599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a19cb2b5-8e66-4c3d-856c-eadddc4e7cab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:03.219695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ef0cad76-5f53-4b4c-b8d8-3012d263c056 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:03.239339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=22 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:46:03.241772 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ef0cad76-5f53-4b4c-b8d8-3012d263c056 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 200 len: 1329 microversion: 2.1 time: 0.367091 Oct 10 23:46:03.242855 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2811/5447] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:02 2022] GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 1329 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:46:03.243110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a19cb2b5-8e66-4c3d-856c-eadddc4e7cab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:03.245538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a19cb2b5-8e66-4c3d-856c-eadddc4e7cab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:03.246357 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a19cb2b5-8e66-4c3d-856c-eadddc4e7cab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:03.247689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a19cb2b5-8e66-4c3d-856c-eadddc4e7cab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:03.248508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a19cb2b5-8e66-4c3d-856c-eadddc4e7cab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:03.251926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a19cb2b5-8e66-4c3d-856c-eadddc4e7cab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:03.620508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a19cb2b5-8e66-4c3d-856c-eadddc4e7cab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:03.652629 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a19cb2b5-8e66-4c3d-856c-eadddc4e7cab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2" status: 200 len: 1314 microversion: 2.1 time: 0.470837 Oct 10 23:46:03.657075 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2637/5448] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:03 2022] GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:46:03.835892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-e4e7c51f-6756-44c3-871e-6e2924215474 req-abd49501-2a19-4585-969f-e6990cecdd20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d46429-1fca-4e8f-9a22-68b54aa705e3", "tag": "4064b5b1-792f-40eb-aefe-0dccbf94e388"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:03.862933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e4e7c51f-6756-44c3-871e-6e2924215474 req-abd49501-2a19-4585-969f-e6990cecdd20 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:03.864810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e4e7c51f-6756-44c3-871e-6e2924215474 req-abd49501-2a19-4585-969f-e6990cecdd20 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:03.876005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e4e7c51f-6756-44c3-871e-6e2924215474 req-abd49501-2a19-4585-969f-e6990cecdd20 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:03.910862 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-e4e7c51f-6756-44c3-871e-6e2924215474 req-abd49501-2a19-4585-969f-e6990cecdd20 service nova] Creating event network-changed:4064b5b1-792f-40eb-aefe-0dccbf94e388 for instance c2d46429-1fca-4e8f-9a22-68b54aa705e3 on n-h1-860864-2 Oct 10 23:46:03.922056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c8844e4f-b9a6-4e17-abde-9f665a1d2cda tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:03.922680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c8844e4f-b9a6-4e17-abde-9f665a1d2cda tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:03.934330 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-e4e7c51f-6756-44c3-871e-6e2924215474 req-abd49501-2a19-4585-969f-e6990cecdd20 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100398 Oct 10 23:46:03.935049 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2812/5449] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:46:03.946781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8844e4f-b9a6-4e17-abde-9f665a1d2cda tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:03.950748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8844e4f-b9a6-4e17-abde-9f665a1d2cda tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:03.950748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8844e4f-b9a6-4e17-abde-9f665a1d2cda tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:03.965181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8844e4f-b9a6-4e17-abde-9f665a1d2cda tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:03.965973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8844e4f-b9a6-4e17-abde-9f665a1d2cda tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:03.966799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8844e4f-b9a6-4e17-abde-9f665a1d2cda tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:04.284686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-93347938-78a1-456d-96c1-ddb603eaf405 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:04.291825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c8844e4f-b9a6-4e17-abde-9f665a1d2cda tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2539fa08826e48d99de000ae1d8fbf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c29d561525b74d4dbc698fe2522b1b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:04.294183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-93347938-78a1-456d-96c1-ddb603eaf405 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:04.322763 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c8844e4f-b9a6-4e17-abde-9f665a1d2cda tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3" status: 200 len: 1316 microversion: 2.1 time: 0.408535 Oct 10 23:46:04.324409 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2638/5450] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:03 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 => generated 1316 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:04.331208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93347938-78a1-456d-96c1-ddb603eaf405 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:04.334152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93347938-78a1-456d-96c1-ddb603eaf405 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:04.335426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93347938-78a1-456d-96c1-ddb603eaf405 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:04.338429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93347938-78a1-456d-96c1-ddb603eaf405 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:04.338937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93347938-78a1-456d-96c1-ddb603eaf405 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:04.340976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-93347938-78a1-456d-96c1-ddb603eaf405 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:04.680792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3f58fe03-2c39-46f3-8925-24c4c65298d8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:04.681838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3f58fe03-2c39-46f3-8925-24c4c65298d8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:04.687809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:46:04.696252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f58fe03-2c39-46f3-8925-24c4c65298d8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:04.697249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f58fe03-2c39-46f3-8925-24c4c65298d8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:04.697930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f58fe03-2c39-46f3-8925-24c4c65298d8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:04.698865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f58fe03-2c39-46f3-8925-24c4c65298d8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:04.699692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f58fe03-2c39-46f3-8925-24c4c65298d8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:04.700523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f58fe03-2c39-46f3-8925-24c4c65298d8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:04.830326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-93347938-78a1-456d-96c1-ddb603eaf405 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:04.842707 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-93347938-78a1-456d-96c1-ddb603eaf405 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 200 len: 1329 microversion: 2.1 time: 0.572986 Oct 10 23:46:04.844058 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2813/5451] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:04 2022] GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 1329 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:05.040550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3f58fe03-2c39-46f3-8925-24c4c65298d8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:05.051717 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3f58fe03-2c39-46f3-8925-24c4c65298d8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2" status: 200 len: 1314 microversion: 2.1 time: 0.375159 Oct 10 23:46:05.052844 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2639/5452] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:04 2022] GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:05.362077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7da0a118-1b81-48d5-aa76-f54d40620d96 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:05.368165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7da0a118-1b81-48d5-aa76-f54d40620d96 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:05.405005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7da0a118-1b81-48d5-aa76-f54d40620d96 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:05.406007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7da0a118-1b81-48d5-aa76-f54d40620d96 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:05.406567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7da0a118-1b81-48d5-aa76-f54d40620d96 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:05.407410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7da0a118-1b81-48d5-aa76-f54d40620d96 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:05.410090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7da0a118-1b81-48d5-aa76-f54d40620d96 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:05.410961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7da0a118-1b81-48d5-aa76-f54d40620d96 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:05.676431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7da0a118-1b81-48d5-aa76-f54d40620d96 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2539fa08826e48d99de000ae1d8fbf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c29d561525b74d4dbc698fe2522b1b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:05.709423 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7da0a118-1b81-48d5-aa76-f54d40620d96 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3" status: 200 len: 1316 microversion: 2.1 time: 0.356232 Oct 10 23:46:05.732700 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2814/5453] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:05 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 => generated 1316 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:05.789919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-3067ae9c-87e2-404f-b175-2a933811a607 req-de47f398-4cee-48f2-a4d9-bd1233bf3a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9053f3ff-dd63-4991-8010-ff36800620e2", "name": "network-vif-plugged", "status": "completed", "tag": "9d911abb-be71-4368-98bf-fc90e3f5867b"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:05.836912 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3067ae9c-87e2-404f-b175-2a933811a607 req-de47f398-4cee-48f2-a4d9-bd1233bf3a27 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:05.841151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3067ae9c-87e2-404f-b175-2a933811a607 req-de47f398-4cee-48f2-a4d9-bd1233bf3a27 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:05.842542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3067ae9c-87e2-404f-b175-2a933811a607 req-de47f398-4cee-48f2-a4d9-bd1233bf3a27 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:05.870091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-86c2ee07-8647-4a37-ab6b-0167c951a09a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:05.871057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-86c2ee07-8647-4a37-ab6b-0167c951a09a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:05.885421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86c2ee07-8647-4a37-ab6b-0167c951a09a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:05.898324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86c2ee07-8647-4a37-ab6b-0167c951a09a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:05.899548 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-3067ae9c-87e2-404f-b175-2a933811a607 req-de47f398-4cee-48f2-a4d9-bd1233bf3a27 service nova] Creating event network-vif-plugged:9d911abb-be71-4368-98bf-fc90e3f5867b for instance 9053f3ff-dd63-4991-8010-ff36800620e2 on n-h2-860864-2 Oct 10 23:46:05.902989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86c2ee07-8647-4a37-ab6b-0167c951a09a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:05.905147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86c2ee07-8647-4a37-ab6b-0167c951a09a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:05.908444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86c2ee07-8647-4a37-ab6b-0167c951a09a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:05.911467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86c2ee07-8647-4a37-ab6b-0167c951a09a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:05.918363 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-3067ae9c-87e2-404f-b175-2a933811a607 req-de47f398-4cee-48f2-a4d9-bd1233bf3a27 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132598 Oct 10 23:46:05.923001 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2640/5454] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:46:06.079643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b0132a2b-5ab3-4951-8d2b-d606d4421c25 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:06.081273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b0132a2b-5ab3-4951-8d2b-d606d4421c25 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:06.111298 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0132a2b-5ab3-4951-8d2b-d606d4421c25 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:06.112051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0132a2b-5ab3-4951-8d2b-d606d4421c25 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:06.114915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0132a2b-5ab3-4951-8d2b-d606d4421c25 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:06.115984 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0132a2b-5ab3-4951-8d2b-d606d4421c25 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:06.117784 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0132a2b-5ab3-4951-8d2b-d606d4421c25 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:06.120171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0132a2b-5ab3-4951-8d2b-d606d4421c25 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:06.279193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-86c2ee07-8647-4a37-ab6b-0167c951a09a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:06.293752 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-86c2ee07-8647-4a37-ab6b-0167c951a09a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 200 len: 1329 microversion: 2.1 time: 0.424254 Oct 10 23:46:06.306129 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2815/5455] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:05 2022] GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 1329 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:06.319324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f04c0c77-1b8c-4e39-be07-6e86a03b0ba7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:06.319825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f04c0c77-1b8c-4e39-be07-6e86a03b0ba7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6195ee8f-6f37-4b7a-9b30-c813010aa4cb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:06.338864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f04c0c77-1b8c-4e39-be07-6e86a03b0ba7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:06.339636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f04c0c77-1b8c-4e39-be07-6e86a03b0ba7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:06.340225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f04c0c77-1b8c-4e39-be07-6e86a03b0ba7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:06.342682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f04c0c77-1b8c-4e39-be07-6e86a03b0ba7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:06.344682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f04c0c77-1b8c-4e39-be07-6e86a03b0ba7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:06.346209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f04c0c77-1b8c-4e39-be07-6e86a03b0ba7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:06.372734 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-f04c0c77-1b8c-4e39-be07-6e86a03b0ba7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f04c0c77-1b8c-4e39-be07-6e86a03b0ba7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb HTTP/1.1 Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '6195ee8f-6f37-4b7a-9b30-c813010aa4cb'} Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:46:06.379377 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:46:06.383340 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:46:06.383340 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:46:06.383340 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:46:06.383340 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:46:06.383340 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:46:06.383340 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:46:06.383340 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:46:06.383340 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:46:06.383340 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:46:06.383340 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:46:06.383340 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:46:06.390703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f04c0c77-1b8c-4e39-be07-6e86a03b0ba7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 404 to user: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:46:06.392450 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f04c0c77-1b8c-4e39-be07-6e86a03b0ba7 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb" status: 404 len: 111 microversion: 2.1 time: 0.084917 Oct 10 23:46:06.394494 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2816/5456] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:46:06 2022] DELETE /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:46:06.414186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-40dc92d2-43b6-4df8-ba62-6cb332549c2f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:06.415046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-40dc92d2-43b6-4df8-ba62-6cb332549c2f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: 6195ee8f-6f37-4b7a-9b30-c813010aa4cb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:06.447222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40dc92d2-43b6-4df8-ba62-6cb332549c2f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:06.447757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40dc92d2-43b6-4df8-ba62-6cb332549c2f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:06.448336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40dc92d2-43b6-4df8-ba62-6cb332549c2f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:06.449069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40dc92d2-43b6-4df8-ba62-6cb332549c2f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:06.449558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40dc92d2-43b6-4df8-ba62-6cb332549c2f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:06.450062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40dc92d2-43b6-4df8-ba62-6cb332549c2f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:06.509960 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-40dc92d2-43b6-4df8-ba62-6cb332549c2f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-40dc92d2-43b6-4df8-ba62-6cb332549c2f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb HTTP/1.1 Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '6195ee8f-6f37-4b7a-9b30-c813010aa4cb'} Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:46:06.511595 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:46:06.521068 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:46:06.521068 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:46:06.521068 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:46:06.521068 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:46:06.521068 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:46:06.521068 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. Oct 10 23:46:06.521068 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:46:06.521068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-40dc92d2-43b6-4df8-ba62-6cb332549c2f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 404 to user: Instance 6195ee8f-6f37-4b7a-9b30-c813010aa4cb could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:46:06.521068 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-40dc92d2-43b6-4df8-ba62-6cb332549c2f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb" status: 404 len: 111 microversion: 2.1 time: 0.113688 Oct 10 23:46:06.521960 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2817/5457] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:06 2022] GET /compute/v2.1/servers/6195ee8f-6f37-4b7a-9b30-c813010aa4cb => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:46:06.532596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-71f91f9c-0f42-44a3-8937-8847ec007e59 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:06.533533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-71f91f9c-0f42-44a3-8937-8847ec007e59 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:06.546146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-71f91f9c-0f42-44a3-8937-8847ec007e59 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:06.547456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-71f91f9c-0f42-44a3-8937-8847ec007e59 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:06.550190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-71f91f9c-0f42-44a3-8937-8847ec007e59 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:06.551319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-71f91f9c-0f42-44a3-8937-8847ec007e59 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:06.554428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-71f91f9c-0f42-44a3-8937-8847ec007e59 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:06.555161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-71f91f9c-0f42-44a3-8937-8847ec007e59 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:06.626954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-71f91f9c-0f42-44a3-8937-8847ec007e59 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:46:06.704361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:46:06.834938 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-71f91f9c-0f42-44a3-8937-8847ec007e59 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "DELETE /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 204 len: 0 microversion: 2.1 time: 0.306885 Oct 10 23:46:06.836435 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2818/5458] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:46:06 2022] DELETE /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 23:46:06.849948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b63b37c6-e736-4049-8b86-e02f795ee532 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:06.851499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b63b37c6-e736-4049-8b86-e02f795ee532 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:06.894533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b63b37c6-e736-4049-8b86-e02f795ee532 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:06.902099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b63b37c6-e736-4049-8b86-e02f795ee532 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:06.909942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b63b37c6-e736-4049-8b86-e02f795ee532 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:06.919008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b63b37c6-e736-4049-8b86-e02f795ee532 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:06.920740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b63b37c6-e736-4049-8b86-e02f795ee532 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:06.927556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b63b37c6-e736-4049-8b86-e02f795ee532 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:07.314260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b0132a2b-5ab3-4951-8d2b-d606d4421c25 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:07.349647 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b0132a2b-5ab3-4951-8d2b-d606d4421c25 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2" status: 200 len: 1314 microversion: 2.1 time: 1.275260 Oct 10 23:46:07.362148 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2641/5459] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:06 2022] GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2 => generated 1314 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:07.403672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6814118c-352f-40ba-94b4-9676f3fa2bc9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:07.404468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6814118c-352f-40ba-94b4-9676f3fa2bc9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:07.431498 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6814118c-352f-40ba-94b4-9676f3fa2bc9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:07.433548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6814118c-352f-40ba-94b4-9676f3fa2bc9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:07.434296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6814118c-352f-40ba-94b4-9676f3fa2bc9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:07.435845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6814118c-352f-40ba-94b4-9676f3fa2bc9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:07.441825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6814118c-352f-40ba-94b4-9676f3fa2bc9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:07.444065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6814118c-352f-40ba-94b4-9676f3fa2bc9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:07.515519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b63b37c6-e736-4049-8b86-e02f795ee532 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2539fa08826e48d99de000ae1d8fbf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c29d561525b74d4dbc698fe2522b1b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:07.557969 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b63b37c6-e736-4049-8b86-e02f795ee532 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3" status: 200 len: 1316 microversion: 2.1 time: 0.719080 Oct 10 23:46:07.558944 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2819/5460] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:06 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 => generated 1316 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:07.588000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2d0f0b3e-559f-4162-8714-5e0d7bf3e880 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:07.589037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2d0f0b3e-559f-4162-8714-5e0d7bf3e880 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:07.631031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d0f0b3e-559f-4162-8714-5e0d7bf3e880 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:07.631906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d0f0b3e-559f-4162-8714-5e0d7bf3e880 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:07.632683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d0f0b3e-559f-4162-8714-5e0d7bf3e880 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:07.633985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d0f0b3e-559f-4162-8714-5e0d7bf3e880 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:07.634807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d0f0b3e-559f-4162-8714-5e0d7bf3e880 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:07.646157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d0f0b3e-559f-4162-8714-5e0d7bf3e880 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:07.972087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6814118c-352f-40ba-94b4-9676f3fa2bc9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:07.997240 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6814118c-352f-40ba-94b4-9676f3fa2bc9 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1513 microversion: 2.1 time: 0.632937 Oct 10 23:46:07.999240 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2642/5461] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:07 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1513 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:08.025424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f11e9203-f000-4265-b73c-f6884a08c242 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1765187777", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "f411452a-97c5-471c-bc9b-c79e58a05eb2"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:08.157660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2d0f0b3e-559f-4162-8714-5e0d7bf3e880 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:08.171365 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2d0f0b3e-559f-4162-8714-5e0d7bf3e880 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 200 len: 1329 microversion: 2.1 time: 0.604605 Oct 10 23:46:08.172427 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2820/5462] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:07 2022] GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 1329 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:08.185040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-f11e9203-f000-4265-b73c-f6884a08c242 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] validate_networks() for [('f411452a-97c5-471c-bc9b-c79e58a05eb2', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:46:08.403791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-40fd69dc-55d5-4a3d-94fb-57d1f83cb166 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:08.407371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-40fd69dc-55d5-4a3d-94fb-57d1f83cb166 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:08.449794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40fd69dc-55d5-4a3d-94fb-57d1f83cb166 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:08.452272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40fd69dc-55d5-4a3d-94fb-57d1f83cb166 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:08.453096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40fd69dc-55d5-4a3d-94fb-57d1f83cb166 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:08.455381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40fd69dc-55d5-4a3d-94fb-57d1f83cb166 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:08.457357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40fd69dc-55d5-4a3d-94fb-57d1f83cb166 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:08.458390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40fd69dc-55d5-4a3d-94fb-57d1f83cb166 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:09.016809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-40fd69dc-55d5-4a3d-94fb-57d1f83cb166 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:09.027010 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-40fd69dc-55d5-4a3d-94fb-57d1f83cb166 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2" status: 200 len: 1314 microversion: 2.1 time: 0.637802 Oct 10 23:46:09.035360 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2821/5463] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:08 2022] GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2 => generated 1314 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:46:09.068182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7ac142fe-cb57-41a3-adbe-dc782a76c557 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:09.068817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7ac142fe-cb57-41a3-adbe-dc782a76c557 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:09.077130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ac142fe-cb57-41a3-adbe-dc782a76c557 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:09.078602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ac142fe-cb57-41a3-adbe-dc782a76c557 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:09.079051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ac142fe-cb57-41a3-adbe-dc782a76c557 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:09.079858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ac142fe-cb57-41a3-adbe-dc782a76c557 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:09.080342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ac142fe-cb57-41a3-adbe-dc782a76c557 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:09.080773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ac142fe-cb57-41a3-adbe-dc782a76c557 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:09.617194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-f11e9203-f000-4265-b73c-f6884a08c242 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:46:09.618325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-f11e9203-f000-4265-b73c-f6884a08c242 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:46:09.619073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-f11e9203-f000-4265-b73c-f6884a08c242 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:46:09.619457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-f11e9203-f000-4265-b73c-f6884a08c242 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:46:09.620018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-f11e9203-f000-4265-b73c-f6884a08c242 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:46:09.637495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f11e9203-f000-4265-b73c-f6884a08c242 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:09.638092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f11e9203-f000-4265-b73c-f6884a08c242 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:09.640761 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f11e9203-f000-4265-b73c-f6884a08c242 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:09.641672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f11e9203-f000-4265-b73c-f6884a08c242 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:09.642181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f11e9203-f000-4265-b73c-f6884a08c242 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:09.643559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f11e9203-f000-4265-b73c-f6884a08c242 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:09.701958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-f11e9203-f000-4265-b73c-f6884a08c242 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Getting quotas for project a087b5d73d9240e3b5330975a2b39ea0. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:46:09.721419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-f11e9203-f000-4265-b73c-f6884a08c242 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Getting quotas for user 2613b3445bde4bd6b8a350f594458490 and project a087b5d73d9240e3b5330975a2b39ea0. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:46:09.741310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f11e9203-f000-4265-b73c-f6884a08c242 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:46:09.744805 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f11e9203-f000-4265-b73c-f6884a08c242 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 8cb3edd4-435b-4619-afbf-86eebf0b1824] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:46:09.816536 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f11e9203-f000-4265-b73c-f6884a08c242 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.815496 Oct 10 23:46:09.817753 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2643/5464] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:46:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:46:09.824478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-41109858-4adc-4845-9095-3db5f58eab7f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:09.825811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-41109858-4adc-4845-9095-3db5f58eab7f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:09.836449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41109858-4adc-4845-9095-3db5f58eab7f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:09.837181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41109858-4adc-4845-9095-3db5f58eab7f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:09.838024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41109858-4adc-4845-9095-3db5f58eab7f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:09.839125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41109858-4adc-4845-9095-3db5f58eab7f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:09.839858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41109858-4adc-4845-9095-3db5f58eab7f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:09.840699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-41109858-4adc-4845-9095-3db5f58eab7f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:09.899011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7ac142fe-cb57-41a3-adbe-dc782a76c557 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2539fa08826e48d99de000ae1d8fbf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c29d561525b74d4dbc698fe2522b1b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:09.913915 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7ac142fe-cb57-41a3-adbe-dc782a76c557 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3" status: 200 len: 1316 microversion: 2.1 time: 0.862092 Oct 10 23:46:09.914781 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2822/5465] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:09 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 => generated 1316 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:09.933900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3140e4d8-7211-48b8-91a9-3c68dd1c4ae2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:09.934897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3140e4d8-7211-48b8-91a9-3c68dd1c4ae2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:09.949127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3140e4d8-7211-48b8-91a9-3c68dd1c4ae2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:09.953682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3140e4d8-7211-48b8-91a9-3c68dd1c4ae2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:09.954289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3140e4d8-7211-48b8-91a9-3c68dd1c4ae2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:09.955059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3140e4d8-7211-48b8-91a9-3c68dd1c4ae2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:09.955539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3140e4d8-7211-48b8-91a9-3c68dd1c4ae2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:09.955967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3140e4d8-7211-48b8-91a9-3c68dd1c4ae2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:10.106695 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-41109858-4adc-4845-9095-3db5f58eab7f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:10.126230 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-41109858-4adc-4845-9095-3db5f58eab7f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1513 microversion: 2.1 time: 0.307182 Oct 10 23:46:10.129563 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2644/5466] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:09 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1513 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:10.159978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-3239ea28-7cd4-4223-b80f-97e618d687d6 req-b0d27ec0-dd0c-48e1-9e63-ec34b3beb340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7deab0f3-dcff-4418-b980-179ec1e244f8", "name": "network-vif-plugged", "status": "completed", "tag": "def19659-5280-48d2-a772-e823d2496b13"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:10.182878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3239ea28-7cd4-4223-b80f-97e618d687d6 req-b0d27ec0-dd0c-48e1-9e63-ec34b3beb340 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:10.183680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3239ea28-7cd4-4223-b80f-97e618d687d6 req-b0d27ec0-dd0c-48e1-9e63-ec34b3beb340 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:10.184350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3239ea28-7cd4-4223-b80f-97e618d687d6 req-b0d27ec0-dd0c-48e1-9e63-ec34b3beb340 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:10.201242 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-3239ea28-7cd4-4223-b80f-97e618d687d6 req-b0d27ec0-dd0c-48e1-9e63-ec34b3beb340 service nova] Creating event network-vif-plugged:def19659-5280-48d2-a772-e823d2496b13 for instance 7deab0f3-dcff-4418-b980-179ec1e244f8 on n-h1-860864-2 Oct 10 23:46:10.207837 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-3239ea28-7cd4-4223-b80f-97e618d687d6 req-b0d27ec0-dd0c-48e1-9e63-ec34b3beb340 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076670 Oct 10 23:46:10.208849 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2645/5467] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:46:10.216665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d49a9436-2a0b-4218-9d20-ea02f1cbcd62 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:10.218158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d49a9436-2a0b-4218-9d20-ea02f1cbcd62 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 8cb3edd4-435b-4619-afbf-86eebf0b1824] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:10.286609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d49a9436-2a0b-4218-9d20-ea02f1cbcd62 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:10.297196 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d49a9436-2a0b-4218-9d20-ea02f1cbcd62 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824" status: 200 len: 1219 microversion: 2.1 time: 0.084288 Oct 10 23:46:10.298123 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2646/5468] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:10 2022] GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:10.305467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1fe581ac-6722-4381-a366-7fd2c03da8e2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:10.306097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1fe581ac-6722-4381-a366-7fd2c03da8e2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:10.314633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fe581ac-6722-4381-a366-7fd2c03da8e2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:10.315380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fe581ac-6722-4381-a366-7fd2c03da8e2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:10.316159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fe581ac-6722-4381-a366-7fd2c03da8e2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:10.317439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fe581ac-6722-4381-a366-7fd2c03da8e2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:10.318399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fe581ac-6722-4381-a366-7fd2c03da8e2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:10.319301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1fe581ac-6722-4381-a366-7fd2c03da8e2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:10.527315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3140e4d8-7211-48b8-91a9-3c68dd1c4ae2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:10.535464 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3140e4d8-7211-48b8-91a9-3c68dd1c4ae2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 200 len: 1329 microversion: 2.1 time: 0.619473 Oct 10 23:46:10.536051 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2823/5469] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:09 2022] GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 1329 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:10.598127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1fe581ac-6722-4381-a366-7fd2c03da8e2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:10.616940 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1fe581ac-6722-4381-a366-7fd2c03da8e2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2" status: 200 len: 1500 microversion: 2.1 time: 0.316555 Oct 10 23:46:10.617688 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2647/5470] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:10 2022] GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2 => generated 1500 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:10.647769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e72b5292-1a22-4298-98ae-a457a90e0b0e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:10.650673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e72b5292-1a22-4298-98ae-a457a90e0b0e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:10.660760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e72b5292-1a22-4298-98ae-a457a90e0b0e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:10.662176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e72b5292-1a22-4298-98ae-a457a90e0b0e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:10.663287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e72b5292-1a22-4298-98ae-a457a90e0b0e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:10.668199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e72b5292-1a22-4298-98ae-a457a90e0b0e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:10.668712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e72b5292-1a22-4298-98ae-a457a90e0b0e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:10.669123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e72b5292-1a22-4298-98ae-a457a90e0b0e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:10.738194 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e72b5292-1a22-4298-98ae-a457a90e0b0e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2/action" status: 200 len: 14 microversion: 2.1 time: 0.096383 Oct 10 23:46:10.745169 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2824/5471] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:46:10 2022] POST /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:46:10.864692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-b2b03ac6-6ebe-4d2c-aa39-b59298534987 req-33ef34c9-4df5-46cf-9646-e0d2cae68e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc9e449-6324-411e-8af9-0533b23a4e3c", "name": "network-vif-deleted", "tag": "c8d69949-457f-46f6-9402-4c349227f0a2"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:10.877727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b2b03ac6-6ebe-4d2c-aa39-b59298534987 req-33ef34c9-4df5-46cf-9646-e0d2cae68e30 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:10.878620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b2b03ac6-6ebe-4d2c-aa39-b59298534987 req-33ef34c9-4df5-46cf-9646-e0d2cae68e30 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:10.879216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b2b03ac6-6ebe-4d2c-aa39-b59298534987 req-33ef34c9-4df5-46cf-9646-e0d2cae68e30 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:10.903604 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-b2b03ac6-6ebe-4d2c-aa39-b59298534987 req-33ef34c9-4df5-46cf-9646-e0d2cae68e30 service nova] Creating event network-vif-deleted:c8d69949-457f-46f6-9402-4c349227f0a2 for instance efc9e449-6324-411e-8af9-0533b23a4e3c on n-h1-860864-2 Oct 10 23:46:10.913995 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-b2b03ac6-6ebe-4d2c-aa39-b59298534987 req-33ef34c9-4df5-46cf-9646-e0d2cae68e30 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057483 Oct 10 23:46:10.915938 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2648/5472] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:46:10.946841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e0d101e8-6525-46e5-b208-2f31caca7422 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:10.947348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e0d101e8-6525-46e5-b208-2f31caca7422 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:10.965329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0d101e8-6525-46e5-b208-2f31caca7422 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:10.970338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0d101e8-6525-46e5-b208-2f31caca7422 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:10.971232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0d101e8-6525-46e5-b208-2f31caca7422 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:10.975294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0d101e8-6525-46e5-b208-2f31caca7422 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:10.976080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0d101e8-6525-46e5-b208-2f31caca7422 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:10.976763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0d101e8-6525-46e5-b208-2f31caca7422 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:11.156372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-639f1ede-8e52-46a6-9385-c843d582912c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:11.157118 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-639f1ede-8e52-46a6-9385-c843d582912c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:11.176610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-639f1ede-8e52-46a6-9385-c843d582912c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:11.177491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-639f1ede-8e52-46a6-9385-c843d582912c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:11.178440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-639f1ede-8e52-46a6-9385-c843d582912c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:11.179790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-639f1ede-8e52-46a6-9385-c843d582912c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:11.180744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-639f1ede-8e52-46a6-9385-c843d582912c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:11.181688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-639f1ede-8e52-46a6-9385-c843d582912c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:11.284798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e0d101e8-6525-46e5-b208-2f31caca7422 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2539fa08826e48d99de000ae1d8fbf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c29d561525b74d4dbc698fe2522b1b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:11.295813 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e0d101e8-6525-46e5-b208-2f31caca7422 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3" status: 200 len: 1316 microversion: 2.1 time: 0.354413 Oct 10 23:46:11.297399 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2825/5473] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:10 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:11.323904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cf038058-46bb-41ca-95e1-83bbc91c8d65 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:11.324051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-639f1ede-8e52-46a6-9385-c843d582912c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:11.324947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cf038058-46bb-41ca-95e1-83bbc91c8d65 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 8cb3edd4-435b-4619-afbf-86eebf0b1824] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:11.333013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf038058-46bb-41ca-95e1-83bbc91c8d65 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:11.333546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf038058-46bb-41ca-95e1-83bbc91c8d65 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:11.334171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf038058-46bb-41ca-95e1-83bbc91c8d65 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:11.335050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf038058-46bb-41ca-95e1-83bbc91c8d65 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:11.336361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf038058-46bb-41ca-95e1-83bbc91c8d65 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:11.336996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf038058-46bb-41ca-95e1-83bbc91c8d65 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:11.338910 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-639f1ede-8e52-46a6-9385-c843d582912c tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1471 microversion: 2.1 time: 0.186595 Oct 10 23:46:11.352510 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2649/5474] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:11 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1471 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:46:11.466190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cf038058-46bb-41ca-95e1-83bbc91c8d65 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:11.478609 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cf038058-46bb-41ca-95e1-83bbc91c8d65 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824" status: 200 len: 1271 microversion: 2.1 time: 0.158990 Oct 10 23:46:11.495967 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2826/5475] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:11 2022] GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824 => generated 1271 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:11.562846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7d473567-827e-4c19-b38c-d547449ca766 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:11.563582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7d473567-827e-4c19-b38c-d547449ca766 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:11.571978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d473567-827e-4c19-b38c-d547449ca766 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:11.572531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d473567-827e-4c19-b38c-d547449ca766 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:11.572988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d473567-827e-4c19-b38c-d547449ca766 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:11.578200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d473567-827e-4c19-b38c-d547449ca766 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:11.578543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d473567-827e-4c19-b38c-d547449ca766 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:11.583701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7d473567-827e-4c19-b38c-d547449ca766 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:11.588665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:46:11.761869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-141cdac2-fc88-4600-90bd-4fb126edebb8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:11.765748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-141cdac2-fc88-4600-90bd-4fb126edebb8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:11.776253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-141cdac2-fc88-4600-90bd-4fb126edebb8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:11.776905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-141cdac2-fc88-4600-90bd-4fb126edebb8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:11.777863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-141cdac2-fc88-4600-90bd-4fb126edebb8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:11.778659 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-141cdac2-fc88-4600-90bd-4fb126edebb8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:11.779177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-141cdac2-fc88-4600-90bd-4fb126edebb8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:11.780310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-141cdac2-fc88-4600-90bd-4fb126edebb8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:11.898038 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-141cdac2-fc88-4600-90bd-4fb126edebb8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2/action" status: 200 len: 14 microversion: 2.1 time: 0.139531 Oct 10 23:46:11.899883 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2827/5476] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:46:11 2022] POST /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:46:12.067395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7d473567-827e-4c19-b38c-d547449ca766 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:12.078377 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7d473567-827e-4c19-b38c-d547449ca766 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 200 len: 1329 microversion: 2.1 time: 0.521306 Oct 10 23:46:12.083245 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2650/5477] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:11 2022] GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 1329 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:12.325087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-87df1e22-9bd3-48b7-a287-1459f622baa9 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:12.326103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-87df1e22-9bd3-48b7-a287-1459f622baa9 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:12.336440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87df1e22-9bd3-48b7-a287-1459f622baa9 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:12.337133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87df1e22-9bd3-48b7-a287-1459f622baa9 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:12.337788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87df1e22-9bd3-48b7-a287-1459f622baa9 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:12.338724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87df1e22-9bd3-48b7-a287-1459f622baa9 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:12.339616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87df1e22-9bd3-48b7-a287-1459f622baa9 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:12.346882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87df1e22-9bd3-48b7-a287-1459f622baa9 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:12.376749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b75b43c0-f861-40bf-bbcb-d4ad85cbc77f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:12.377638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b75b43c0-f861-40bf-bbcb-d4ad85cbc77f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:12.392749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b75b43c0-f861-40bf-bbcb-d4ad85cbc77f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:12.393258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b75b43c0-f861-40bf-bbcb-d4ad85cbc77f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:12.393729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b75b43c0-f861-40bf-bbcb-d4ad85cbc77f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:12.395411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b75b43c0-f861-40bf-bbcb-d4ad85cbc77f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:12.399930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b75b43c0-f861-40bf-bbcb-d4ad85cbc77f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:12.400483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b75b43c0-f861-40bf-bbcb-d4ad85cbc77f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:12.444099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b75b43c0-f861-40bf-bbcb-d4ad85cbc77f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:12.445047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b75b43c0-f861-40bf-bbcb-d4ad85cbc77f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:12.445784 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b75b43c0-f861-40bf-bbcb-d4ad85cbc77f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:12.446252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-b75b43c0-f861-40bf-bbcb-d4ad85cbc77f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lazy-loading 'fault' on Instance uuid efc9e449-6324-411e-8af9-0533b23a4e3c {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:46:12.605428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b75b43c0-f861-40bf-bbcb-d4ad85cbc77f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847536250ff1495c91a80222a0307788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ec432047e846409dbced00d713aa71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:12.625916 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b75b43c0-f861-40bf-bbcb-d4ad85cbc77f tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 200 len: 1307 microversion: 2.1 time: 0.254006 Oct 10 23:46:12.645726 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2651/5478] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:12 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 1307 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:12.654008 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3423e61c-0130-4895-b6ed-2e4d50ee53da tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:12.655055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3423e61c-0130-4895-b6ed-2e4d50ee53da tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 8cb3edd4-435b-4619-afbf-86eebf0b1824] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:12.667880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3423e61c-0130-4895-b6ed-2e4d50ee53da tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:12.668649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3423e61c-0130-4895-b6ed-2e4d50ee53da tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:12.670835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3423e61c-0130-4895-b6ed-2e4d50ee53da tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:12.673886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3423e61c-0130-4895-b6ed-2e4d50ee53da tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:12.674804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3423e61c-0130-4895-b6ed-2e4d50ee53da tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:12.675465 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3423e61c-0130-4895-b6ed-2e4d50ee53da tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:12.779981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-87df1e22-9bd3-48b7-a287-1459f622baa9 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2539fa08826e48d99de000ae1d8fbf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c29d561525b74d4dbc698fe2522b1b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:12.790364 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-87df1e22-9bd3-48b7-a287-1459f622baa9 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3" status: 200 len: 1316 microversion: 2.1 time: 0.469345 Oct 10 23:46:12.791200 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2828/5479] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:12 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:12.802775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3423e61c-0130-4895-b6ed-2e4d50ee53da tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:12.823288 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3423e61c-0130-4895-b6ed-2e4d50ee53da tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824" status: 200 len: 1277 microversion: 2.1 time: 0.175241 Oct 10 23:46:12.824148 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2652/5480] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:12 2022] GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824 => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:12.911798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-60b20d92-9e71-451a-b952-966644a083b4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:12.922368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-60b20d92-9e71-451a-b952-966644a083b4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:12.937367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60b20d92-9e71-451a-b952-966644a083b4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:12.946590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60b20d92-9e71-451a-b952-966644a083b4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:12.947391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60b20d92-9e71-451a-b952-966644a083b4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:12.948181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60b20d92-9e71-451a-b952-966644a083b4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:12.948648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60b20d92-9e71-451a-b952-966644a083b4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:12.949176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60b20d92-9e71-451a-b952-966644a083b4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:13.037773 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-60b20d92-9e71-451a-b952-966644a083b4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2/action" status: 200 len: 14 microversion: 2.1 time: 0.129615 Oct 10 23:46:13.038982 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2829/5481] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:46:12 2022] POST /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:46:13.105941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eae9f750-88a2-4305-b97f-3dd5c060f036 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:13.106889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eae9f750-88a2-4305-b97f-3dd5c060f036 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:13.140556 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eae9f750-88a2-4305-b97f-3dd5c060f036 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:13.143201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eae9f750-88a2-4305-b97f-3dd5c060f036 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:13.143957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eae9f750-88a2-4305-b97f-3dd5c060f036 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:13.148780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eae9f750-88a2-4305-b97f-3dd5c060f036 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:13.150679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eae9f750-88a2-4305-b97f-3dd5c060f036 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:13.153721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eae9f750-88a2-4305-b97f-3dd5c060f036 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:13.521568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-eae9f750-88a2-4305-b97f-3dd5c060f036 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:13.537930 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eae9f750-88a2-4305-b97f-3dd5c060f036 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 200 len: 1329 microversion: 2.1 time: 0.437572 Oct 10 23:46:13.538551 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2653/5482] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:13 2022] GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 1329 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:13.659695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4077be0e-a897-4051-a3de-a51cef4f2de2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:13.660699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4077be0e-a897-4051-a3de-a51cef4f2de2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] [instance: efc9e449-6324-411e-8af9-0533b23a4e3c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:13.675837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4077be0e-a897-4051-a3de-a51cef4f2de2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:13.676342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4077be0e-a897-4051-a3de-a51cef4f2de2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:13.676858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4077be0e-a897-4051-a3de-a51cef4f2de2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:13.677778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4077be0e-a897-4051-a3de-a51cef4f2de2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:13.679396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4077be0e-a897-4051-a3de-a51cef4f2de2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:13.679842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4077be0e-a897-4051-a3de-a51cef4f2de2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:13.705974 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-4077be0e-a897-4051-a3de-a51cef4f2de2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] HTTP exception thrown: Instance efc9e449-6324-411e-8af9-0533b23a4e3c could not be found. Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4077be0e-a897-4051-a3de-a51cef4f2de2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Request method failure captured: Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c HTTP/1.1 Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK26A99xg8yWsnh52z_Av1IsVnKsA7yQV2xM5f75ogOte3pJfRX326pAztQ3AKrfHZeVnpj8UdicN4hUExz7lvCOieyBA0oKW5kX4Rsv_zqfgjeZAtan6Eht2_sUMHdyiOme2Tr-UzTvdOi6fLWLwUQIAuVJwq197lcKzkkQcvFy3wo Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/36ec432047e846409dbced00d713aa71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/36ec432047e846409dbced00d713aa71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_36ec432047e846409dbced00d713aa71", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 36ec432047e846409dbced00d713aa71 Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1266247082 Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 847536250ff1495c91a80222a0307788 Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestJSON-1266247082-project Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance efc9e449-6324-411e-8af9-0533b23a4e3c could not be found. Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'efc9e449-6324-411e-8af9-0533b23a4e3c'} Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efc9e449-6324-411e-8af9-0533b23a4e3c could not be found. Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efc9e449-6324-411e-8af9-0533b23a4e3c could not be found. Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:46:13.707924 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:46:13.712278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:46:13.712278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:46:13.712278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:46:13.712278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:46:13.712278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:46:13.712278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efc9e449-6324-411e-8af9-0533b23a4e3c could not be found. Oct 10 23:46:13.712278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:46:13.712278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4077be0e-a897-4051-a3de-a51cef4f2de2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] Returning 404 to user: Instance efc9e449-6324-411e-8af9-0533b23a4e3c could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:46:13.712278 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4077be0e-a897-4051-a3de-a51cef4f2de2 tempest-ServersNegativeTestJSON-1266247082 tempest-ServersNegativeTestJSON-1266247082-project] 10.222.0.23 "GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c" status: 404 len: 111 microversion: 2.1 time: 0.060714 Oct 10 23:46:13.714913 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2830/5483] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:13 2022] GET /compute/v2.1/servers/efc9e449-6324-411e-8af9-0533b23a4e3c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:46:13.821099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-746d1d60-cfa0-4c61-bdc5-ec7ece2ad6e4 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:13.822441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-746d1d60-cfa0-4c61-bdc5-ec7ece2ad6e4 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:13.831450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-746d1d60-cfa0-4c61-bdc5-ec7ece2ad6e4 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:13.832280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-746d1d60-cfa0-4c61-bdc5-ec7ece2ad6e4 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:13.832952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-746d1d60-cfa0-4c61-bdc5-ec7ece2ad6e4 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:13.834289 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-746d1d60-cfa0-4c61-bdc5-ec7ece2ad6e4 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:13.834956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-746d1d60-cfa0-4c61-bdc5-ec7ece2ad6e4 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:13.835583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-746d1d60-cfa0-4c61-bdc5-ec7ece2ad6e4 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:13.858454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-066747d0-24b0-432d-a62b-ad3f165e8a6a tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:13.859764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-066747d0-24b0-432d-a62b-ad3f165e8a6a tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 8cb3edd4-435b-4619-afbf-86eebf0b1824] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:13.875406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-066747d0-24b0-432d-a62b-ad3f165e8a6a tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:13.881771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-066747d0-24b0-432d-a62b-ad3f165e8a6a tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:13.884144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-066747d0-24b0-432d-a62b-ad3f165e8a6a tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:13.885012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-066747d0-24b0-432d-a62b-ad3f165e8a6a tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:13.886454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-066747d0-24b0-432d-a62b-ad3f165e8a6a tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:13.887486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-066747d0-24b0-432d-a62b-ad3f165e8a6a tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:14.301305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-066747d0-24b0-432d-a62b-ad3f165e8a6a tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:14.317420 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-066747d0-24b0-432d-a62b-ad3f165e8a6a tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824" status: 200 len: 1319 microversion: 2.1 time: 0.464489 Oct 10 23:46:14.336414 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2831/5484] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:13 2022] GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824 => generated 1319 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:14.343995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-60786376-0d82-497d-999a-9e78280e72c7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:14.349994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-60786376-0d82-497d-999a-9e78280e72c7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:14.360046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-746d1d60-cfa0-4c61-bdc5-ec7ece2ad6e4 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2539fa08826e48d99de000ae1d8fbf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c29d561525b74d4dbc698fe2522b1b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:14.367129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60786376-0d82-497d-999a-9e78280e72c7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:14.368378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60786376-0d82-497d-999a-9e78280e72c7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:14.369127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60786376-0d82-497d-999a-9e78280e72c7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:14.370191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60786376-0d82-497d-999a-9e78280e72c7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:14.371092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60786376-0d82-497d-999a-9e78280e72c7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:14.371765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60786376-0d82-497d-999a-9e78280e72c7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:14.374362 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-746d1d60-cfa0-4c61-bdc5-ec7ece2ad6e4 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3" status: 200 len: 1316 microversion: 2.1 time: 0.559736 Oct 10 23:46:14.375324 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2654/5485] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:13 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 => generated 1316 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:14.426040 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-60786376-0d82-497d-999a-9e78280e72c7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2/action" status: 200 len: 14 microversion: 2.1 time: 0.088009 Oct 10 23:46:14.429688 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2832/5486] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:46:14 2022] POST /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:46:14.563576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-523d88c9-38b1-445f-893c-d842210025c0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:14.564201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-523d88c9-38b1-445f-893c-d842210025c0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:14.578037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-523d88c9-38b1-445f-893c-d842210025c0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:14.578244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-523d88c9-38b1-445f-893c-d842210025c0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:14.578697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-523d88c9-38b1-445f-893c-d842210025c0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:14.582244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-523d88c9-38b1-445f-893c-d842210025c0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:14.583354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-523d88c9-38b1-445f-893c-d842210025c0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:14.583812 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-523d88c9-38b1-445f-893c-d842210025c0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:15.135463 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-523d88c9-38b1-445f-893c-d842210025c0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:15.146329 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-523d88c9-38b1-445f-893c-d842210025c0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 200 len: 1511 microversion: 2.1 time: 0.587636 Oct 10 23:46:15.148425 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2655/5487] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:14 2022] GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 1511 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:46:15.174352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cfb72bc2-445b-4017-a64e-c972c559df32 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:15.175047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cfb72bc2-445b-4017-a64e-c972c559df32 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:15.186041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfb72bc2-445b-4017-a64e-c972c559df32 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:15.188329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfb72bc2-445b-4017-a64e-c972c559df32 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:15.190032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfb72bc2-445b-4017-a64e-c972c559df32 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:15.190780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfb72bc2-445b-4017-a64e-c972c559df32 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:15.192341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfb72bc2-445b-4017-a64e-c972c559df32 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:15.194358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfb72bc2-445b-4017-a64e-c972c559df32 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:15.350178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c743741a-4555-40fa-b441-9d66e1cfd78b tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:15.351042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c743741a-4555-40fa-b441-9d66e1cfd78b tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 8cb3edd4-435b-4619-afbf-86eebf0b1824] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:15.361683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c743741a-4555-40fa-b441-9d66e1cfd78b tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:15.366007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c743741a-4555-40fa-b441-9d66e1cfd78b tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:15.370455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c743741a-4555-40fa-b441-9d66e1cfd78b tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:15.371462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c743741a-4555-40fa-b441-9d66e1cfd78b tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:15.372089 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c743741a-4555-40fa-b441-9d66e1cfd78b tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:15.372707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c743741a-4555-40fa-b441-9d66e1cfd78b tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:15.554252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cfb72bc2-445b-4017-a64e-c972c559df32 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:15.573082 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cfb72bc2-445b-4017-a64e-c972c559df32 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 200 len: 1511 microversion: 2.1 time: 0.402306 Oct 10 23:46:15.595342 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2833/5488] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:15 2022] GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 1511 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:15.600324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5f337988-5cef-43d8-82ea-1eb10067c286 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:15.600958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5f337988-5cef-43d8-82ea-1eb10067c286 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:15.630363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f337988-5cef-43d8-82ea-1eb10067c286 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:15.631126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f337988-5cef-43d8-82ea-1eb10067c286 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:15.632285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f337988-5cef-43d8-82ea-1eb10067c286 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:15.633500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f337988-5cef-43d8-82ea-1eb10067c286 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:15.634155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f337988-5cef-43d8-82ea-1eb10067c286 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:15.634815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f337988-5cef-43d8-82ea-1eb10067c286 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:15.926051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c743741a-4555-40fa-b441-9d66e1cfd78b tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:15.938433 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c743741a-4555-40fa-b441-9d66e1cfd78b tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824" status: 200 len: 1319 microversion: 2.1 time: 0.593713 Oct 10 23:46:15.960840 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2656/5489] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:15 2022] GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824 => generated 1319 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:15.972136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d26f193c-f953-49d3-abd6-7abfb827db93 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:15.974896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d26f193c-f953-49d3-abd6-7abfb827db93 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:15.994168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d26f193c-f953-49d3-abd6-7abfb827db93 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:15.995073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d26f193c-f953-49d3-abd6-7abfb827db93 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:15.996628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d26f193c-f953-49d3-abd6-7abfb827db93 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:15.997608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d26f193c-f953-49d3-abd6-7abfb827db93 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:15.998395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d26f193c-f953-49d3-abd6-7abfb827db93 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:16.000059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d26f193c-f953-49d3-abd6-7abfb827db93 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:16.023362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5f337988-5cef-43d8-82ea-1eb10067c286 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2539fa08826e48d99de000ae1d8fbf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c29d561525b74d4dbc698fe2522b1b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:16.038911 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5f337988-5cef-43d8-82ea-1eb10067c286 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3" status: 200 len: 1316 microversion: 2.1 time: 0.442570 Oct 10 23:46:16.058473 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2834/5490] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:15 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 => generated 1316 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:16.068882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d85a8d74-3b6d-424c-b539-fe600568a10c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:16.070494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d85a8d74-3b6d-424c-b539-fe600568a10c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:16.078391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d85a8d74-3b6d-424c-b539-fe600568a10c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:16.079870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d85a8d74-3b6d-424c-b539-fe600568a10c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:16.080508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d85a8d74-3b6d-424c-b539-fe600568a10c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:16.082535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d85a8d74-3b6d-424c-b539-fe600568a10c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:16.083226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d85a8d74-3b6d-424c-b539-fe600568a10c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:16.083870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d85a8d74-3b6d-424c-b539-fe600568a10c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:16.100475 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d26f193c-f953-49d3-abd6-7abfb827db93 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2/action" status: 200 len: 14 microversion: 2.1 time: 0.137989 Oct 10 23:46:16.103080 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2657/5491] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:46:15 2022] POST /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:46:16.112454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-5fd88a45-4da0-4dc2-b1d7-0dfba290349f req-3febd4d1-23ba-4565-a895-65e9276301ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d46429-1fca-4e8f-9a22-68b54aa705e3", "name": "network-vif-plugged", "status": "completed", "tag": "4064b5b1-792f-40eb-aefe-0dccbf94e388"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:16.133699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5fd88a45-4da0-4dc2-b1d7-0dfba290349f req-3febd4d1-23ba-4565-a895-65e9276301ee service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:16.135241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5fd88a45-4da0-4dc2-b1d7-0dfba290349f req-3febd4d1-23ba-4565-a895-65e9276301ee service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:16.135835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5fd88a45-4da0-4dc2-b1d7-0dfba290349f req-3febd4d1-23ba-4565-a895-65e9276301ee service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:16.139630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d85a8d74-3b6d-424c-b539-fe600568a10c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:46:16.151826 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-5fd88a45-4da0-4dc2-b1d7-0dfba290349f req-3febd4d1-23ba-4565-a895-65e9276301ee service nova] Creating event network-vif-plugged:4064b5b1-792f-40eb-aefe-0dccbf94e388 for instance c2d46429-1fca-4e8f-9a22-68b54aa705e3 on n-h1-860864-2 Oct 10 23:46:16.159148 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-5fd88a45-4da0-4dc2-b1d7-0dfba290349f req-3febd4d1-23ba-4565-a895-65e9276301ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053608 Oct 10 23:46:16.160351 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2658/5492] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:46:16.230812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:46:16.307042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-356a5d7c-5875-49f9-92de-e72a7966b4af req-fe6fefa7-8ff1-432a-ae9e-f76350fc77dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cb3edd4-435b-4619-afbf-86eebf0b1824", "tag": "1d94aaa6-68c1-4f42-8419-400db5ecc9a0"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:16.331203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-356a5d7c-5875-49f9-92de-e72a7966b4af req-fe6fefa7-8ff1-432a-ae9e-f76350fc77dc service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:16.331729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-356a5d7c-5875-49f9-92de-e72a7966b4af req-fe6fefa7-8ff1-432a-ae9e-f76350fc77dc service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:16.332165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-356a5d7c-5875-49f9-92de-e72a7966b4af req-fe6fefa7-8ff1-432a-ae9e-f76350fc77dc service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:16.335917 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d85a8d74-3b6d-424c-b539-fe600568a10c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 204 len: 0 microversion: 2.1 time: 0.273632 Oct 10 23:46:16.340952 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2835/5493] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:46:16 2022] DELETE /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:46:16.384247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cffaab56-cd9d-4218-8e68-e0a81c67cdb7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:16.385321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cffaab56-cd9d-4218-8e68-e0a81c67cdb7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:16.403714 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-356a5d7c-5875-49f9-92de-e72a7966b4af req-fe6fefa7-8ff1-432a-ae9e-f76350fc77dc service nova] Creating event network-changed:1d94aaa6-68c1-4f42-8419-400db5ecc9a0 for instance 8cb3edd4-435b-4619-afbf-86eebf0b1824 on n-h2-860864-2 Oct 10 23:46:16.411852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cffaab56-cd9d-4218-8e68-e0a81c67cdb7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:16.412263 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-356a5d7c-5875-49f9-92de-e72a7966b4af req-fe6fefa7-8ff1-432a-ae9e-f76350fc77dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114194 Oct 10 23:46:16.414133 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2659/5494] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:46:16.422471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cffaab56-cd9d-4218-8e68-e0a81c67cdb7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:16.423649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cffaab56-cd9d-4218-8e68-e0a81c67cdb7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:16.437605 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cffaab56-cd9d-4218-8e68-e0a81c67cdb7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:16.438333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cffaab56-cd9d-4218-8e68-e0a81c67cdb7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:16.440129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cffaab56-cd9d-4218-8e68-e0a81c67cdb7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:16.640572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cffaab56-cd9d-4218-8e68-e0a81c67cdb7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:16.652299 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cffaab56-cd9d-4218-8e68-e0a81c67cdb7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 200 len: 1517 microversion: 2.1 time: 0.309503 Oct 10 23:46:16.653274 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2836/5495] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:16 2022] GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 1517 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:16.970222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-30afa8e4-4753-4b43-b3df-0e2c0bf14cec tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:16.971333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-30afa8e4-4753-4b43-b3df-0e2c0bf14cec tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 8cb3edd4-435b-4619-afbf-86eebf0b1824] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:16.979065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30afa8e4-4753-4b43-b3df-0e2c0bf14cec tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:16.980059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30afa8e4-4753-4b43-b3df-0e2c0bf14cec tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:16.980770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30afa8e4-4753-4b43-b3df-0e2c0bf14cec tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:16.981773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30afa8e4-4753-4b43-b3df-0e2c0bf14cec tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:16.982706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30afa8e4-4753-4b43-b3df-0e2c0bf14cec tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:16.983906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30afa8e4-4753-4b43-b3df-0e2c0bf14cec tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:17.063650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-73d6e3eb-39fc-4b60-abf8-aee94ebf4627 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:17.064567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-73d6e3eb-39fc-4b60-abf8-aee94ebf4627 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:17.073609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73d6e3eb-39fc-4b60-abf8-aee94ebf4627 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:17.074412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73d6e3eb-39fc-4b60-abf8-aee94ebf4627 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:17.074962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73d6e3eb-39fc-4b60-abf8-aee94ebf4627 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:17.075821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73d6e3eb-39fc-4b60-abf8-aee94ebf4627 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:17.076352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73d6e3eb-39fc-4b60-abf8-aee94ebf4627 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:17.076890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73d6e3eb-39fc-4b60-abf8-aee94ebf4627 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:17.239870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-73d6e3eb-39fc-4b60-abf8-aee94ebf4627 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2539fa08826e48d99de000ae1d8fbf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c29d561525b74d4dbc698fe2522b1b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:17.248914 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-73d6e3eb-39fc-4b60-abf8-aee94ebf4627 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3" status: 200 len: 1316 microversion: 2.1 time: 0.190139 Oct 10 23:46:17.249537 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2837/5496] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:17 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 => generated 1316 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:46:17.270448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8c39e414-193b-4105-8f3b-f8f4962548da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:17.273258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8c39e414-193b-4105-8f3b-f8f4962548da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:17.280035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c39e414-193b-4105-8f3b-f8f4962548da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:17.280534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c39e414-193b-4105-8f3b-f8f4962548da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:17.280979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c39e414-193b-4105-8f3b-f8f4962548da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:17.281783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c39e414-193b-4105-8f3b-f8f4962548da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:17.282235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c39e414-193b-4105-8f3b-f8f4962548da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:17.282661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8c39e414-193b-4105-8f3b-f8f4962548da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:17.341988 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8c39e414-193b-4105-8f3b-f8f4962548da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2/action" status: 200 len: 14 microversion: 2.1 time: 0.085374 Oct 10 23:46:17.342805 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2838/5497] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:46:17 2022] POST /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:46:17.615404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-30afa8e4-4753-4b43-b3df-0e2c0bf14cec tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:17.641501 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-30afa8e4-4753-4b43-b3df-0e2c0bf14cec tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824" status: 200 len: 1319 microversion: 2.1 time: 0.672580 Oct 10 23:46:17.645308 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2660/5498] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:16 2022] GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824 => generated 1319 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:17.679530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-07837f6e-28ef-4d7b-960a-829c003c183e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:17.699948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-07837f6e-28ef-4d7b-960a-829c003c183e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:17.724561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07837f6e-28ef-4d7b-960a-829c003c183e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:17.725226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07837f6e-28ef-4d7b-960a-829c003c183e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:17.725816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07837f6e-28ef-4d7b-960a-829c003c183e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:17.727948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07837f6e-28ef-4d7b-960a-829c003c183e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:17.729154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07837f6e-28ef-4d7b-960a-829c003c183e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:17.729763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07837f6e-28ef-4d7b-960a-829c003c183e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:17.949574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-07837f6e-28ef-4d7b-960a-829c003c183e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:17.961215 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-07837f6e-28ef-4d7b-960a-829c003c183e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 200 len: 1517 microversion: 2.1 time: 0.287070 Oct 10 23:46:17.963006 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2839/5499] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:17 2022] GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 1517 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:18.280214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1e9f3a15-4f0a-447a-be23-571242cde8a2 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:18.281040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1e9f3a15-4f0a-447a-be23-571242cde8a2 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:18.295994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e9f3a15-4f0a-447a-be23-571242cde8a2 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:18.297506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e9f3a15-4f0a-447a-be23-571242cde8a2 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:18.298188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e9f3a15-4f0a-447a-be23-571242cde8a2 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:18.299008 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e9f3a15-4f0a-447a-be23-571242cde8a2 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:18.299470 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e9f3a15-4f0a-447a-be23-571242cde8a2 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:18.299905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e9f3a15-4f0a-447a-be23-571242cde8a2 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:18.721993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d2816c1f-6899-4ef5-bf94-554e6f15d029 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:18.725485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d2816c1f-6899-4ef5-bf94-554e6f15d029 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:18.739323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2816c1f-6899-4ef5-bf94-554e6f15d029 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:18.739826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2816c1f-6899-4ef5-bf94-554e6f15d029 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:18.740454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2816c1f-6899-4ef5-bf94-554e6f15d029 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:18.742166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2816c1f-6899-4ef5-bf94-554e6f15d029 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:18.742862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2816c1f-6899-4ef5-bf94-554e6f15d029 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:18.743463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d2816c1f-6899-4ef5-bf94-554e6f15d029 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:18.801322 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d2816c1f-6899-4ef5-bf94-554e6f15d029 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2/action" status: 200 len: 14 microversion: 2.1 time: 0.450766 Oct 10 23:46:18.802272 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2840/5500] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:46:18 2022] POST /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2/action => generated 14 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:46:18.808071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e3ee5b4b-ae00-48f2-931c-697bed86a699 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:18.809132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e3ee5b4b-ae00-48f2-931c-697bed86a699 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 8cb3edd4-435b-4619-afbf-86eebf0b1824] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:18.820489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3ee5b4b-ae00-48f2-931c-697bed86a699 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:18.821478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3ee5b4b-ae00-48f2-931c-697bed86a699 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:18.822140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3ee5b4b-ae00-48f2-931c-697bed86a699 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:18.823507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3ee5b4b-ae00-48f2-931c-697bed86a699 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:18.824220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3ee5b4b-ae00-48f2-931c-697bed86a699 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:18.825071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3ee5b4b-ae00-48f2-931c-697bed86a699 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:19.110973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e3ee5b4b-ae00-48f2-931c-697bed86a699 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:19.119706 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e3ee5b4b-ae00-48f2-931c-697bed86a699 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824" status: 200 len: 1319 microversion: 2.1 time: 0.315911 Oct 10 23:46:19.120310 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2841/5501] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:18 2022] GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824 => generated 1319 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:19.137984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2b25bbbe-bd8d-4b37-af1c-4b5794c99917 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:19.139733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2b25bbbe-bd8d-4b37-af1c-4b5794c99917 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:19.147716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b25bbbe-bd8d-4b37-af1c-4b5794c99917 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:19.162052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b25bbbe-bd8d-4b37-af1c-4b5794c99917 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:19.165158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b25bbbe-bd8d-4b37-af1c-4b5794c99917 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:19.166752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b25bbbe-bd8d-4b37-af1c-4b5794c99917 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:19.171291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b25bbbe-bd8d-4b37-af1c-4b5794c99917 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:19.172188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b25bbbe-bd8d-4b37-af1c-4b5794c99917 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:19.246589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1e9f3a15-4f0a-447a-be23-571242cde8a2 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2539fa08826e48d99de000ae1d8fbf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c29d561525b74d4dbc698fe2522b1b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:19.259278 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1e9f3a15-4f0a-447a-be23-571242cde8a2 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3" status: 200 len: 1316 microversion: 2.1 time: 0.987533 Oct 10 23:46:19.259814 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2661/5502] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:18 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 => generated 1316 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:19.281251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-399c7035-bac0-4dd1-840e-ea519bb27fc2 req-44e0faea-5a76-4936-9a27-56498c9226c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7deab0f3-dcff-4418-b980-179ec1e244f8", "name": "network-vif-deleted", "tag": "def19659-5280-48d2-a772-e823d2496b13"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:19.316002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-399c7035-bac0-4dd1-840e-ea519bb27fc2 req-44e0faea-5a76-4936-9a27-56498c9226c8 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:19.316901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-399c7035-bac0-4dd1-840e-ea519bb27fc2 req-44e0faea-5a76-4936-9a27-56498c9226c8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:19.317515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-399c7035-bac0-4dd1-840e-ea519bb27fc2 req-44e0faea-5a76-4936-9a27-56498c9226c8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:19.347474 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-399c7035-bac0-4dd1-840e-ea519bb27fc2 req-44e0faea-5a76-4936-9a27-56498c9226c8 service nova] Creating event network-vif-deleted:def19659-5280-48d2-a772-e823d2496b13 for instance 7deab0f3-dcff-4418-b980-179ec1e244f8 on n-h1-860864-2 Oct 10 23:46:19.357630 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-399c7035-bac0-4dd1-840e-ea519bb27fc2 req-44e0faea-5a76-4936-9a27-56498c9226c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096442 Oct 10 23:46:19.361040 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2662/5503] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:46:19.376035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2b25bbbe-bd8d-4b37-af1c-4b5794c99917 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:19.387861 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2b25bbbe-bd8d-4b37-af1c-4b5794c99917 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 200 len: 1314 microversion: 2.1 time: 0.266390 Oct 10 23:46:19.393486 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2842/5504] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:19 2022] GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:19.809810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:46:19.837517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e41987a1-ab4a-409d-a5f6-c08898302936 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:19.844395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e41987a1-ab4a-409d-a5f6-c08898302936 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:19.864949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e41987a1-ab4a-409d-a5f6-c08898302936 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:19.866406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e41987a1-ab4a-409d-a5f6-c08898302936 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:19.868248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e41987a1-ab4a-409d-a5f6-c08898302936 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:19.872345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e41987a1-ab4a-409d-a5f6-c08898302936 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:19.874549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e41987a1-ab4a-409d-a5f6-c08898302936 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:19.876606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e41987a1-ab4a-409d-a5f6-c08898302936 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:19.984753 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e41987a1-ab4a-409d-a5f6-c08898302936 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2/action" status: 200 len: 14 microversion: 2.1 time: 0.175462 Oct 10 23:46:19.989232 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2663/5505] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:46:19 2022] POST /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:46:20.147539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d6784a0a-b013-499f-924e-27c0b11ef336 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:20.148175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d6784a0a-b013-499f-924e-27c0b11ef336 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 8cb3edd4-435b-4619-afbf-86eebf0b1824] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:20.163634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6784a0a-b013-499f-924e-27c0b11ef336 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:20.172980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6784a0a-b013-499f-924e-27c0b11ef336 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:20.173891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6784a0a-b013-499f-924e-27c0b11ef336 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:20.174828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6784a0a-b013-499f-924e-27c0b11ef336 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:20.175451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6784a0a-b013-499f-924e-27c0b11ef336 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:20.176051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6784a0a-b013-499f-924e-27c0b11ef336 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:20.286014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3ef3f1cb-eaa9-4c83-a6a4-416018f05ff1 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:20.287873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3ef3f1cb-eaa9-4c83-a6a4-416018f05ff1 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:20.311903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=8 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:46:20.315254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ef3f1cb-eaa9-4c83-a6a4-416018f05ff1 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:20.315881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ef3f1cb-eaa9-4c83-a6a4-416018f05ff1 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:20.316447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ef3f1cb-eaa9-4c83-a6a4-416018f05ff1 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:20.319040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ef3f1cb-eaa9-4c83-a6a4-416018f05ff1 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:20.319744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ef3f1cb-eaa9-4c83-a6a4-416018f05ff1 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:20.321245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ef3f1cb-eaa9-4c83-a6a4-416018f05ff1 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:20.619633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3ef3f1cb-eaa9-4c83-a6a4-416018f05ff1 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2539fa08826e48d99de000ae1d8fbf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c29d561525b74d4dbc698fe2522b1b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:20.657506 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3ef3f1cb-eaa9-4c83-a6a4-416018f05ff1 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3" status: 200 len: 1504 microversion: 2.1 time: 0.376832 Oct 10 23:46:20.659331 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2664/5506] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:20 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 => generated 1504 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:20.672499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f200a8fe-61fb-44a2-b8ce-e16b96e031b9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:20.673135 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f200a8fe-61fb-44a2-b8ce-e16b96e031b9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:20.690488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f200a8fe-61fb-44a2-b8ce-e16b96e031b9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:20.690998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f200a8fe-61fb-44a2-b8ce-e16b96e031b9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:20.691438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f200a8fe-61fb-44a2-b8ce-e16b96e031b9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:20.697991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f200a8fe-61fb-44a2-b8ce-e16b96e031b9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:20.698614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f200a8fe-61fb-44a2-b8ce-e16b96e031b9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:20.699084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f200a8fe-61fb-44a2-b8ce-e16b96e031b9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:20.741001 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-f200a8fe-61fb-44a2-b8ce-e16b96e031b9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] HTTP exception thrown: Instance 7deab0f3-dcff-4418-b980-179ec1e244f8 could not be found. Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f200a8fe-61fb-44a2-b8ce-e16b96e031b9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Request method failure captured: Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 HTTP/1.1 Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK5cQzq5PmBN8ZK8xufnInf_nKzozFybG60EPi2LKIagIuIo6wmjCjt_dEi9KoG421lgq7o9GXzxCjj26_PYoj0IVUx4iuPxFYRw_bINPtYf7R0sv0LrnaNDyTyma9wRBMptURK1MlutQq_man6Zj75t-cnvbQ_0wIRWAQ7WKgqvlIM Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fcc4d45337140259bcd5b64b17aa7b5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersTestJSON-1882347849 Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersTestJSON-1882347849-project Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: daf7a1ddba654265a5e732363c85eefa Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersTestJSON-1882347849-project Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 7deab0f3-dcff-4418-b980-179ec1e244f8 could not be found. Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '7deab0f3-dcff-4418-b980-179ec1e244f8'} Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7deab0f3-dcff-4418-b980-179ec1e244f8 could not be found. Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7deab0f3-dcff-4418-b980-179ec1e244f8 could not be found. Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:46:20.754781 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:46:20.761464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:46:20.761464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:46:20.761464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:46:20.761464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:46:20.761464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:46:20.761464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7deab0f3-dcff-4418-b980-179ec1e244f8 could not be found. Oct 10 23:46:20.761464 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:46:20.761464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f200a8fe-61fb-44a2-b8ce-e16b96e031b9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Returning 404 to user: Instance 7deab0f3-dcff-4418-b980-179ec1e244f8 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:46:20.761464 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f200a8fe-61fb-44a2-b8ce-e16b96e031b9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 404 len: 111 microversion: 2.1 time: 0.096245 Oct 10 23:46:20.762662 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2665/5507] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:20 2022] GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:46:20.768791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-377e7658-3c44-4254-a279-df8fc2aafb41 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:20.769305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-377e7658-3c44-4254-a279-df8fc2aafb41 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:20.777703 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-377e7658-3c44-4254-a279-df8fc2aafb41 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:20.778427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-377e7658-3c44-4254-a279-df8fc2aafb41 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:20.778969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-377e7658-3c44-4254-a279-df8fc2aafb41 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:20.780504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-377e7658-3c44-4254-a279-df8fc2aafb41 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:20.781019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-377e7658-3c44-4254-a279-df8fc2aafb41 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:20.781594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-377e7658-3c44-4254-a279-df8fc2aafb41 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:20.824783 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-377e7658-3c44-4254-a279-df8fc2aafb41 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3/ips" status: 200 len: 108 microversion: 2.1 time: 0.061156 Oct 10 23:46:20.846470 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2666/5508] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 10 23:46:20 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3/ips => generated 108 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:46:20.866872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b42aef45-34fc-48da-8bbb-441ece615f7c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '.version_select at 0x7f662b4cc3a0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:20.872630 n-d-860864-2 devstack@n-api.service[120614]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b42aef45-34fc-48da-8bbb-441ece615f7c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [65b652d7-8255-4975-ab29-45ae4d236b13] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 10 23:46:21.175575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d6784a0a-b013-499f-924e-27c0b11ef336 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:21.187124 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d6784a0a-b013-499f-924e-27c0b11ef336 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824" status: 200 len: 1319 microversion: 2.1 time: 1.045597 Oct 10 23:46:21.190861 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2843/5509] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:20 2022] GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824 => generated 1319 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:21.208468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3ee20ba4-0c2e-4487-a875-400115e1d2fd tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:21.209575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3ee20ba4-0c2e-4487-a875-400115e1d2fd tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:21.230760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ee20ba4-0c2e-4487-a875-400115e1d2fd tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:21.234469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ee20ba4-0c2e-4487-a875-400115e1d2fd tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:21.234933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ee20ba4-0c2e-4487-a875-400115e1d2fd tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:21.239379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ee20ba4-0c2e-4487-a875-400115e1d2fd tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:21.241223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ee20ba4-0c2e-4487-a875-400115e1d2fd tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:21.248889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ee20ba4-0c2e-4487-a875-400115e1d2fd tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:21.289513 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3ee20ba4-0c2e-4487-a875-400115e1d2fd tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3/ips" status: 200 len: 108 microversion: 2.1 time: 0.094724 Oct 10 23:46:21.290527 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2844/5510] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 10 23:46:21 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3/ips => generated 108 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:46:21.299374 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9120ea63-c858-4865-aab8-3d1599f0f8a4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:21.303445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9120ea63-c858-4865-aab8-3d1599f0f8a4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:21.322123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9120ea63-c858-4865-aab8-3d1599f0f8a4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:21.322633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9120ea63-c858-4865-aab8-3d1599f0f8a4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:21.323084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9120ea63-c858-4865-aab8-3d1599f0f8a4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:21.323816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9120ea63-c858-4865-aab8-3d1599f0f8a4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:21.324279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9120ea63-c858-4865-aab8-3d1599f0f8a4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:21.324715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9120ea63-c858-4865-aab8-3d1599f0f8a4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:21.400072 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9120ea63-c858-4865-aab8-3d1599f0f8a4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2/action" status: 200 len: 8205 microversion: 2.1 time: 0.107940 Oct 10 23:46:21.400981 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2845/5511] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:46:21 2022] POST /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2/action => generated 8205 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:21.411577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-63707de9-63c8-4b2c-b9ab-0554abc98887 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:21.412419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-63707de9-63c8-4b2c-b9ab-0554abc98887 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:21.421207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63707de9-63c8-4b2c-b9ab-0554abc98887 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:21.421983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63707de9-63c8-4b2c-b9ab-0554abc98887 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:21.422589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63707de9-63c8-4b2c-b9ab-0554abc98887 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:21.424147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63707de9-63c8-4b2c-b9ab-0554abc98887 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:21.424790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63707de9-63c8-4b2c-b9ab-0554abc98887 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:21.425400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63707de9-63c8-4b2c-b9ab-0554abc98887 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:21.461881 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-63707de9-63c8-4b2c-b9ab-0554abc98887 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3/ips/tempest-ServerAddressesTestJSON-574063969-network" status: 200 len: 93 microversion: 2.1 time: 0.059405 Oct 10 23:46:21.462763 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2846/5512] 10.222.0.23 () {58 vars in 1398 bytes} [Mon Oct 10 23:46:21 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3/ips/tempest-ServerAddressesTestJSON-574063969-network => generated 93 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:46:21.468706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-87036d32-33dc-4d24-be38-6bf1e99074ef tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:21.469652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-87036d32-33dc-4d24-be38-6bf1e99074ef tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:21.474873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:46:21.488472 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87036d32-33dc-4d24-be38-6bf1e99074ef tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:21.489417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87036d32-33dc-4d24-be38-6bf1e99074ef tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:21.490048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87036d32-33dc-4d24-be38-6bf1e99074ef tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:21.490933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87036d32-33dc-4d24-be38-6bf1e99074ef tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:21.491554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87036d32-33dc-4d24-be38-6bf1e99074ef tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:21.492281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87036d32-33dc-4d24-be38-6bf1e99074ef tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:21.863446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-87036d32-33dc-4d24-be38-6bf1e99074ef tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:21.884871 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [None req-b42aef45-34fc-48da-8bbb-441ece615f7c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [65b652d7-8255-4975-ab29-45ae4d236b13] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 37422. Oct 10 23:46:21.897975 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-87036d32-33dc-4d24-be38-6bf1e99074ef tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.423329 Oct 10 23:46:21.900436 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2847/5513] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:21 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:21.922704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ea27dcfd-6731-4382-95c1-9e841d0992eb tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:21.923981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ea27dcfd-6731-4382-95c1-9e841d0992eb tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:21.940090 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b42aef45-34fc-48da-8bbb-441ece615f7c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-key-1745789103" status: 202 len: 0 microversion: 2.1 time: 1.086597 Oct 10 23:46:21.945874 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2667/5514] 10.222.0.23 () {58 vars in 1209 bytes} [Mon Oct 10 23:46:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1745789103 => generated 0 bytes in 1098 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:46:21.958538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea27dcfd-6731-4382-95c1-9e841d0992eb tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:21.961075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea27dcfd-6731-4382-95c1-9e841d0992eb tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:21.962506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea27dcfd-6731-4382-95c1-9e841d0992eb tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:21.968645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea27dcfd-6731-4382-95c1-9e841d0992eb tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:21.971886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea27dcfd-6731-4382-95c1-9e841d0992eb tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:21.972511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6f87ec05-2ad0-4670-bc2f-4d8dcaa09174 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:21.973171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea27dcfd-6731-4382-95c1-9e841d0992eb tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:21.974481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6f87ec05-2ad0-4670-bc2f-4d8dcaa09174 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:22.017086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f87ec05-2ad0-4670-bc2f-4d8dcaa09174 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:22.017635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f87ec05-2ad0-4670-bc2f-4d8dcaa09174 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:22.036074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f87ec05-2ad0-4670-bc2f-4d8dcaa09174 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:22.036954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f87ec05-2ad0-4670-bc2f-4d8dcaa09174 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:22.038795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f87ec05-2ad0-4670-bc2f-4d8dcaa09174 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:22.042267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f87ec05-2ad0-4670-bc2f-4d8dcaa09174 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:22.169350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ea27dcfd-6731-4382-95c1-9e841d0992eb tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:46:22.429776 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ea27dcfd-6731-4382-95c1-9e841d0992eb tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3" status: 204 len: 0 microversion: 2.1 time: 0.525747 Oct 10 23:46:22.431915 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2848/5515] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:46:21 2022] DELETE /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:46:22.440796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6e1cce77-ff40-4d0c-998e-b92ac31c0485 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-511095855", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "abcacee0-1319-4318-8900-2ff15d7780f9"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:22.561011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-6e1cce77-ff40-4d0c-998e-b92ac31c0485 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] validate_networks() for [('abcacee0-1319-4318-8900-2ff15d7780f9', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:46:22.593325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6f87ec05-2ad0-4670-bc2f-4d8dcaa09174 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:22.603018 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6f87ec05-2ad0-4670-bc2f-4d8dcaa09174 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.652186 Oct 10 23:46:22.622812 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2668/5516] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:21 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:22.636127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-286c5c03-99f0-4240-a340-fafb31d7cb74 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:22.636983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-286c5c03-99f0-4240-a340-fafb31d7cb74 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 8cb3edd4-435b-4619-afbf-86eebf0b1824] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:22.652609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-286c5c03-99f0-4240-a340-fafb31d7cb74 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:22.653258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-286c5c03-99f0-4240-a340-fafb31d7cb74 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:22.653829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-286c5c03-99f0-4240-a340-fafb31d7cb74 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:22.654815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-286c5c03-99f0-4240-a340-fafb31d7cb74 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:22.655420 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-286c5c03-99f0-4240-a340-fafb31d7cb74 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:22.658981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-286c5c03-99f0-4240-a340-fafb31d7cb74 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:22.862801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-286c5c03-99f0-4240-a340-fafb31d7cb74 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:22.873896 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-286c5c03-99f0-4240-a340-fafb31d7cb74 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824" status: 200 len: 1319 microversion: 2.1 time: 0.248803 Oct 10 23:46:22.876180 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2669/5517] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:22 2022] GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:22.882791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e212c62b-c84a-47c5-a9a9-da7ddfd9732e tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:22.883637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e212c62b-c84a-47c5-a9a9-da7ddfd9732e tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:22.890571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e212c62b-c84a-47c5-a9a9-da7ddfd9732e tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:22.891703 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e212c62b-c84a-47c5-a9a9-da7ddfd9732e tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:22.892268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e212c62b-c84a-47c5-a9a9-da7ddfd9732e tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:22.893118 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e212c62b-c84a-47c5-a9a9-da7ddfd9732e tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:22.893763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e212c62b-c84a-47c5-a9a9-da7ddfd9732e tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:22.894378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e212c62b-c84a-47c5-a9a9-da7ddfd9732e tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:23.274886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e212c62b-c84a-47c5-a9a9-da7ddfd9732e tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2539fa08826e48d99de000ae1d8fbf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c29d561525b74d4dbc698fe2522b1b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:23.289756 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e212c62b-c84a-47c5-a9a9-da7ddfd9732e tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3" status: 200 len: 1510 microversion: 2.1 time: 0.412011 Oct 10 23:46:23.291071 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2670/5518] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:22 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 => generated 1510 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:23.304369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-394fff30-3629-4a93-adf0-d4663096e317 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:23.306579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-394fff30-3629-4a93-adf0-d4663096e317 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:23.325204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-394fff30-3629-4a93-adf0-d4663096e317 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:23.325918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-394fff30-3629-4a93-adf0-d4663096e317 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:23.328868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-394fff30-3629-4a93-adf0-d4663096e317 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:23.332429 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-394fff30-3629-4a93-adf0-d4663096e317 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:23.333737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-394fff30-3629-4a93-adf0-d4663096e317 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:23.334204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-394fff30-3629-4a93-adf0-d4663096e317 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:23.355486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:46:23.659813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-394fff30-3629-4a93-adf0-d4663096e317 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:23.671118 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-394fff30-3629-4a93-adf0-d4663096e317 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.377922 Oct 10 23:46:23.677096 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2671/5519] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:23 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:23.707867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-17ccd3b7-107c-4c16-b42d-70b61359e4ab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:23.709970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-17ccd3b7-107c-4c16-b42d-70b61359e4ab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:23.725893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17ccd3b7-107c-4c16-b42d-70b61359e4ab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:23.734059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17ccd3b7-107c-4c16-b42d-70b61359e4ab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:23.734885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17ccd3b7-107c-4c16-b42d-70b61359e4ab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:23.735859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17ccd3b7-107c-4c16-b42d-70b61359e4ab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:23.736522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17ccd3b7-107c-4c16-b42d-70b61359e4ab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:23.737307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17ccd3b7-107c-4c16-b42d-70b61359e4ab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:23.935554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6e1cce77-ff40-4d0c-998e-b92ac31c0485 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:46:23.937325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6e1cce77-ff40-4d0c-998e-b92ac31c0485 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:46:23.937946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6e1cce77-ff40-4d0c-998e-b92ac31c0485 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:46:23.938447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6e1cce77-ff40-4d0c-998e-b92ac31c0485 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:46:23.939050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6e1cce77-ff40-4d0c-998e-b92ac31c0485 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:46:23.962342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e1cce77-ff40-4d0c-998e-b92ac31c0485 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:23.963075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e1cce77-ff40-4d0c-998e-b92ac31c0485 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:23.963752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e1cce77-ff40-4d0c-998e-b92ac31c0485 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:23.964655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e1cce77-ff40-4d0c-998e-b92ac31c0485 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:23.966057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e1cce77-ff40-4d0c-998e-b92ac31c0485 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:23.969872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e1cce77-ff40-4d0c-998e-b92ac31c0485 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:24.038809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-6e1cce77-ff40-4d0c-998e-b92ac31c0485 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Getting quotas for project 7fcc4d45337140259bcd5b64b17aa7b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:46:24.050091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-6e1cce77-ff40-4d0c-998e-b92ac31c0485 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Getting quotas for user daf7a1ddba654265a5e732363c85eefa and project 7fcc4d45337140259bcd5b64b17aa7b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:46:24.081645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6e1cce77-ff40-4d0c-998e-b92ac31c0485 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:46:24.097254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6e1cce77-ff40-4d0c-998e-b92ac31c0485 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:46:24.241350 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6e1cce77-ff40-4d0c-998e-b92ac31c0485 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.807955 Oct 10 23:46:24.250613 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2849/5520] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:46:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:46:24.257442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7cdce3f4-3a79-4b81-8ce8-3b1aefda5402 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:24.258473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7cdce3f4-3a79-4b81-8ce8-3b1aefda5402 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 8cb3edd4-435b-4619-afbf-86eebf0b1824] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:24.267315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cdce3f4-3a79-4b81-8ce8-3b1aefda5402 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:24.270829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cdce3f4-3a79-4b81-8ce8-3b1aefda5402 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:24.271691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cdce3f4-3a79-4b81-8ce8-3b1aefda5402 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:24.272650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cdce3f4-3a79-4b81-8ce8-3b1aefda5402 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:24.273349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cdce3f4-3a79-4b81-8ce8-3b1aefda5402 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:24.274183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cdce3f4-3a79-4b81-8ce8-3b1aefda5402 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:24.563995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-17ccd3b7-107c-4c16-b42d-70b61359e4ab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:24.586894 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-17ccd3b7-107c-4c16-b42d-70b61359e4ab tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.885152 Oct 10 23:46:24.589512 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2672/5521] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:23 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:46:24.604128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0fe05faa-5a8b-42a2-902c-a234197d1b09 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:24.606362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0fe05faa-5a8b-42a2-902c-a234197d1b09 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:24.790418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0fe05faa-5a8b-42a2-902c-a234197d1b09 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:24.804539 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0fe05faa-5a8b-42a2-902c-a234197d1b09 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722" status: 200 len: 1208 microversion: 2.1 time: 0.213137 Oct 10 23:46:24.805320 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2673/5522] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:24 2022] GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 => generated 1208 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:24.829137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-879477f1-5cb6-4e32-a750-77a1a91e9a32 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:24.829950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-879477f1-5cb6-4e32-a750-77a1a91e9a32 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:24.850926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-879477f1-5cb6-4e32-a750-77a1a91e9a32 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:24.854474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-879477f1-5cb6-4e32-a750-77a1a91e9a32 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:24.855163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-879477f1-5cb6-4e32-a750-77a1a91e9a32 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:24.873595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-879477f1-5cb6-4e32-a750-77a1a91e9a32 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:24.874034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-879477f1-5cb6-4e32-a750-77a1a91e9a32 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:24.874678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-879477f1-5cb6-4e32-a750-77a1a91e9a32 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:25.068440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-879477f1-5cb6-4e32-a750-77a1a91e9a32 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2539fa08826e48d99de000ae1d8fbf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c29d561525b74d4dbc698fe2522b1b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:25.079013 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-879477f1-5cb6-4e32-a750-77a1a91e9a32 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3" status: 200 len: 1468 microversion: 2.1 time: 0.272478 Oct 10 23:46:25.090742 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2674/5523] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:24 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 => generated 1468 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:25.114920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-8c759d73-ef5f-40f0-88ad-0446621998eb req-c04641fd-6c03-49ed-8012-5d26b9c8405a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cb3edd4-435b-4619-afbf-86eebf0b1824", "name": "network-vif-plugged", "status": "completed", "tag": "1d94aaa6-68c1-4f42-8419-400db5ecc9a0"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:25.160667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8c759d73-ef5f-40f0-88ad-0446621998eb req-c04641fd-6c03-49ed-8012-5d26b9c8405a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:25.161693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8c759d73-ef5f-40f0-88ad-0446621998eb req-c04641fd-6c03-49ed-8012-5d26b9c8405a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:25.164683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8c759d73-ef5f-40f0-88ad-0446621998eb req-c04641fd-6c03-49ed-8012-5d26b9c8405a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:25.184627 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-8c759d73-ef5f-40f0-88ad-0446621998eb req-c04641fd-6c03-49ed-8012-5d26b9c8405a service nova] Creating event network-vif-plugged:1d94aaa6-68c1-4f42-8419-400db5ecc9a0 for instance 8cb3edd4-435b-4619-afbf-86eebf0b1824 on n-h2-860864-2 Oct 10 23:46:25.233625 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-8c759d73-ef5f-40f0-88ad-0446621998eb req-c04641fd-6c03-49ed-8012-5d26b9c8405a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139958 Oct 10 23:46:25.241335 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2675/5524] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:46:25.269252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-53673d63-7999-4690-8be1-2cb23dd11657 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:25.276473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-53673d63-7999-4690-8be1-2cb23dd11657 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:25.321590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53673d63-7999-4690-8be1-2cb23dd11657 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:25.322851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53673d63-7999-4690-8be1-2cb23dd11657 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:25.323736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53673d63-7999-4690-8be1-2cb23dd11657 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:25.325042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53673d63-7999-4690-8be1-2cb23dd11657 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:25.326115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53673d63-7999-4690-8be1-2cb23dd11657 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:25.327123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53673d63-7999-4690-8be1-2cb23dd11657 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:25.369814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7cdce3f4-3a79-4b81-8ce8-3b1aefda5402 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:25.421548 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7cdce3f4-3a79-4b81-8ce8-3b1aefda5402 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824" status: 200 len: 1319 microversion: 2.1 time: 1.144918 Oct 10 23:46:25.422242 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2850/5525] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:24 2022] GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824 => generated 1319 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:25.439083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-4690aba1-c594-4f48-81ba-307df97fb21d req-1aba6c8b-4942-4ffc-885f-9f488b2e1406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d46429-1fca-4e8f-9a22-68b54aa705e3", "name": "network-vif-deleted", "tag": "4064b5b1-792f-40eb-aefe-0dccbf94e388"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:25.453475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-53673d63-7999-4690-8be1-2cb23dd11657 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Locking {{(pid=120614) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 10 23:46:25.486533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4690aba1-c594-4f48-81ba-307df97fb21d req-1aba6c8b-4942-4ffc-885f-9f488b2e1406 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:25.487030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4690aba1-c594-4f48-81ba-307df97fb21d req-1aba6c8b-4942-4ffc-885f-9f488b2e1406 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:25.487554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4690aba1-c594-4f48-81ba-307df97fb21d req-1aba6c8b-4942-4ffc-885f-9f488b2e1406 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:25.539098 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-4690aba1-c594-4f48-81ba-307df97fb21d req-1aba6c8b-4942-4ffc-885f-9f488b2e1406 service nova] Creating event network-vif-deleted:4064b5b1-792f-40eb-aefe-0dccbf94e388 for instance c2d46429-1fca-4e8f-9a22-68b54aa705e3 on n-h1-860864-2 Oct 10 23:46:25.542080 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-53673d63-7999-4690-8be1-2cb23dd11657 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action" status: 202 len: 0 microversion: 2.1 time: 0.295576 Oct 10 23:46:25.543011 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2676/5526] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:46:25 2022] POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:46:25.553762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-06f89485-8fc2-4904-9ff3-7d8e3941fb12 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:25.554631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-06f89485-8fc2-4904-9ff3-7d8e3941fb12 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:25.563668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06f89485-8fc2-4904-9ff3-7d8e3941fb12 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:25.564070 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-4690aba1-c594-4f48-81ba-307df97fb21d req-1aba6c8b-4942-4ffc-885f-9f488b2e1406 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139584 Oct 10 23:46:25.564754 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06f89485-8fc2-4904-9ff3-7d8e3941fb12 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:25.565401 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2851/5527] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:46:25.566143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06f89485-8fc2-4904-9ff3-7d8e3941fb12 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:25.567929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06f89485-8fc2-4904-9ff3-7d8e3941fb12 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:25.568847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06f89485-8fc2-4904-9ff3-7d8e3941fb12 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:25.569333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06f89485-8fc2-4904-9ff3-7d8e3941fb12 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:25.838399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0bf4e5fe-c285-4c73-9612-4ab447918fb9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:25.839221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0bf4e5fe-c285-4c73-9612-4ab447918fb9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:25.847818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0bf4e5fe-c285-4c73-9612-4ab447918fb9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:25.848782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0bf4e5fe-c285-4c73-9612-4ab447918fb9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:25.849754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0bf4e5fe-c285-4c73-9612-4ab447918fb9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:25.850978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0bf4e5fe-c285-4c73-9612-4ab447918fb9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:25.851920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0bf4e5fe-c285-4c73-9612-4ab447918fb9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:25.853476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0bf4e5fe-c285-4c73-9612-4ab447918fb9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:25.912329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-06f89485-8fc2-4904-9ff3-7d8e3941fb12 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:25.950468 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-06f89485-8fc2-4904-9ff3-7d8e3941fb12 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.402334 Oct 10 23:46:25.953883 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2677/5528] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:25 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:46:25.979656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d6e0916f-fdba-4d6a-9e38-a18e808dc71f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:25.982665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:46:26.006104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6e0916f-fdba-4d6a-9e38-a18e808dc71f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:26.007563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6e0916f-fdba-4d6a-9e38-a18e808dc71f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:26.009925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6e0916f-fdba-4d6a-9e38-a18e808dc71f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:26.038521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0bf4e5fe-c285-4c73-9612-4ab447918fb9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:26.049314 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0bf4e5fe-c285-4c73-9612-4ab447918fb9 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722" status: 200 len: 1260 microversion: 2.1 time: 0.218858 Oct 10 23:46:26.052742 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-d6e0916f-fdba-4d6a-9e38-a18e808dc71f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] HTTP exception thrown: Instance 88c65eb2-4a59-4b1e-bf11-e2094d984d0a is locked Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d6e0916f-fdba-4d6a-9e38-a18e808dc71f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Request method failure captured: Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action HTTP/1.1 Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 15 Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK2deQVSAXVpYv94o2LGh3P4UN6EQKCeEUhzdUPwlu_hbPK829sK5-CZkQ_H2hrW9XbLpAmgRUb-TsEm491HxpX3P5rgh7EGL-C9ucmTRQYU_rnkI97wjRlyvrAaF6FhKhgLCvu1_PNfELqMhxeoxEC4Z8lOcwF5q5jMUclhgeln0n4 Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: f798f5f5321f40b89fc5bacc3b9389fe Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerActionsTestJSON-1712674003 Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f798f5f5321f40b89fc5bacc3b9389fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f798f5f5321f40b89fc5bacc3b9389fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f798f5f5321f40b89fc5bacc3b9389fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f798f5f5321f40b89fc5bacc3b9389fe", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerActionsTestJSON-1712674003 Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: f798f5f5321f40b89fc5bacc3b9389fe Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerActionsTestJSON-1712674003 Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerActionsTestJSON-1712674003-project Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: cfd8618ee1864d1d86de2def024b49bb Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerActionsTestJSON-1712674003-project Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: {"os-stop": {}} Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 88c65eb2-4a59-4b1e-bf11-e2094d984d0a is locked Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '88c65eb2-4a59-4b1e-bf11-e2094d984d0a', 'body': {'os-stop': {}}} Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 88c65eb2-4a59-4b1e-bf11-e2094d984d0a is locked Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 88c65eb2-4a59-4b1e-bf11-e2094d984d0a is locked Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c65eb2-4a59-4b1e-bf11-e2094d984d0a is locked Oct 10 23:46:26.055288 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:46:26.062980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d6e0916f-fdba-4d6a-9e38-a18e808dc71f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Returning 409 to user: Instance 88c65eb2-4a59-4b1e-bf11-e2094d984d0a is locked {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:46:26.064673 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d6e0916f-fdba-4d6a-9e38-a18e808dc71f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action" status: 409 len: 107 microversion: 2.1 time: 0.090505 Oct 10 23:46:26.065903 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2678/5529] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:46:25 2022] POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action => generated 107 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:46:26.083154 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2852/5530] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:25 2022] GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 => generated 1260 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:26.090673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-591bc0d9-155d-45be-9c16-b6ee3bc03a5b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:26.091268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-591bc0d9-155d-45be-9c16-b6ee3bc03a5b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:26.111103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-591bc0d9-155d-45be-9c16-b6ee3bc03a5b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:26.112800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-591bc0d9-155d-45be-9c16-b6ee3bc03a5b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:26.114857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-591bc0d9-155d-45be-9c16-b6ee3bc03a5b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:26.115800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-591bc0d9-155d-45be-9c16-b6ee3bc03a5b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:26.116258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-39f0fe8f-e3d9-4400-8e06-5a1a458a3c68 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:26.116887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-39f0fe8f-e3d9-4400-8e06-5a1a458a3c68 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:26.121215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-591bc0d9-155d-45be-9c16-b6ee3bc03a5b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:26.121960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-591bc0d9-155d-45be-9c16-b6ee3bc03a5b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:26.142286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39f0fe8f-e3d9-4400-8e06-5a1a458a3c68 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:26.142873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39f0fe8f-e3d9-4400-8e06-5a1a458a3c68 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:26.143328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39f0fe8f-e3d9-4400-8e06-5a1a458a3c68 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:26.144077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39f0fe8f-e3d9-4400-8e06-5a1a458a3c68 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:26.144537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39f0fe8f-e3d9-4400-8e06-5a1a458a3c68 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:26.144967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39f0fe8f-e3d9-4400-8e06-5a1a458a3c68 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:26.148198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:46:26.234721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-591bc0d9-155d-45be-9c16-b6ee3bc03a5b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Unlocking {{(pid=120614) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 10 23:46:26.240040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39f0fe8f-e3d9-4400-8e06-5a1a458a3c68 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:26.240674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39f0fe8f-e3d9-4400-8e06-5a1a458a3c68 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:26.248901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39f0fe8f-e3d9-4400-8e06-5a1a458a3c68 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:26.250167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-39f0fe8f-e3d9-4400-8e06-5a1a458a3c68 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lazy-loading 'fault' on Instance uuid c2d46429-1fca-4e8f-9a22-68b54aa705e3 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:46:26.306004 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-591bc0d9-155d-45be-9c16-b6ee3bc03a5b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action" status: 202 len: 0 microversion: 2.1 time: 0.231035 Oct 10 23:46:26.307612 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2679/5531] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:46:26 2022] POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:46:26.322127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dc05ad41-69ff-4967-98f4-84e627cc0419 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:26.340678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc05ad41-69ff-4967-98f4-84e627cc0419 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:26.341843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc05ad41-69ff-4967-98f4-84e627cc0419 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:26.342945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-39f0fe8f-e3d9-4400-8e06-5a1a458a3c68 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2539fa08826e48d99de000ae1d8fbf55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c29d561525b74d4dbc698fe2522b1b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:26.343578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc05ad41-69ff-4967-98f4-84e627cc0419 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:26.366832 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-39f0fe8f-e3d9-4400-8e06-5a1a458a3c68 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3" status: 200 len: 1306 microversion: 2.1 time: 0.256666 Oct 10 23:46:26.367768 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2853/5532] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:26 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 => generated 1306 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:26.400148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dc05ad41-69ff-4967-98f4-84e627cc0419 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Going to try to stop instance {{(pid=120614) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 23:46:26.449525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-200cde43-393c-425f-b0c9-653165f0c7d4 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:26.450995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-200cde43-393c-425f-b0c9-653165f0c7d4 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 8cb3edd4-435b-4619-afbf-86eebf0b1824] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:26.472361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-200cde43-393c-425f-b0c9-653165f0c7d4 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:26.474712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-200cde43-393c-425f-b0c9-653165f0c7d4 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:26.479404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-200cde43-393c-425f-b0c9-653165f0c7d4 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:26.480724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-200cde43-393c-425f-b0c9-653165f0c7d4 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:26.483466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-200cde43-393c-425f-b0c9-653165f0c7d4 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:26.485401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-200cde43-393c-425f-b0c9-653165f0c7d4 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:26.527394 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dc05ad41-69ff-4967-98f4-84e627cc0419 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action" status: 202 len: 0 microversion: 2.1 time: 0.210951 Oct 10 23:46:26.528000 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2680/5533] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:46:26 2022] POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:46:26.539007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d986d8c8-93b9-477e-9c74-cf401f59471d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:26.539717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d986d8c8-93b9-477e-9c74-cf401f59471d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:26.553050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d986d8c8-93b9-477e-9c74-cf401f59471d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:26.553791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d986d8c8-93b9-477e-9c74-cf401f59471d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:26.554392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d986d8c8-93b9-477e-9c74-cf401f59471d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:26.555459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d986d8c8-93b9-477e-9c74-cf401f59471d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:26.556913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d986d8c8-93b9-477e-9c74-cf401f59471d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:26.557528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d986d8c8-93b9-477e-9c74-cf401f59471d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:27.213014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-200cde43-393c-425f-b0c9-653165f0c7d4 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:27.218843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d986d8c8-93b9-477e-9c74-cf401f59471d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:27.230327 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d986d8c8-93b9-477e-9c74-cf401f59471d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1680 microversion: 2.1 time: 0.695442 Oct 10 23:46:27.237753 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-200cde43-393c-425f-b0c9-653165f0c7d4 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824" status: 200 len: 1319 microversion: 2.1 time: 0.783900 Oct 10 23:46:27.239259 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2854/5534] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:26 2022] GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824 => generated 1319 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:46:27.255733 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2681/5535] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:26 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1680 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:27.268783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-993496f9-c9ba-4d88-9744-c629105ddd1c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:27.271666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-993496f9-c9ba-4d88-9744-c629105ddd1c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:27.297166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-993496f9-c9ba-4d88-9744-c629105ddd1c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:27.297719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-993496f9-c9ba-4d88-9744-c629105ddd1c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:27.298204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-993496f9-c9ba-4d88-9744-c629105ddd1c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:27.298978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-993496f9-c9ba-4d88-9744-c629105ddd1c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:27.306731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-993496f9-c9ba-4d88-9744-c629105ddd1c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:27.307440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-993496f9-c9ba-4d88-9744-c629105ddd1c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:27.396513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d98ceb60-caf6-451a-a5d8-4bcc0c5d3de2 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:27.397265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d98ceb60-caf6-451a-a5d8-4bcc0c5d3de2 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] [instance: c2d46429-1fca-4e8f-9a22-68b54aa705e3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:27.415481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d98ceb60-caf6-451a-a5d8-4bcc0c5d3de2 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:27.422551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d98ceb60-caf6-451a-a5d8-4bcc0c5d3de2 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:27.423517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d98ceb60-caf6-451a-a5d8-4bcc0c5d3de2 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:27.425128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d98ceb60-caf6-451a-a5d8-4bcc0c5d3de2 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:27.428994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d98ceb60-caf6-451a-a5d8-4bcc0c5d3de2 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:27.434669 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d98ceb60-caf6-451a-a5d8-4bcc0c5d3de2 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:27.505344 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-d98ceb60-caf6-451a-a5d8-4bcc0c5d3de2 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] HTTP exception thrown: Instance c2d46429-1fca-4e8f-9a22-68b54aa705e3 could not be found. Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d98ceb60-caf6-451a-a5d8-4bcc0c5d3de2 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Request method failure captured: Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 HTTP/1.1 Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK6s90joJtWrc1rVUhaUdVSj0iQ-5WtXZxeGf8INsi06DTsESqOXrCQdIg1f2ILMpKM4mq09jeOSDt_UBe3BcYQbXZ9i-4GDyZn4t4meXgDKEkXGA9pPYBgEiCC6TUirg2pSA-LWbNd7oqcz_aDiw2eZ_PGS2Ad10htZTXfp9ZMUNuU Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: c29d561525b74d4dbc698fe2522b1b5b Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerAddressesTestJSON-313483193 Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c29d561525b74d4dbc698fe2522b1b5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c29d561525b74d4dbc698fe2522b1b5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c29d561525b74d4dbc698fe2522b1b5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c29d561525b74d4dbc698fe2522b1b5b", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerAddressesTestJSON-313483193 Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: c29d561525b74d4dbc698fe2522b1b5b Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerAddressesTestJSON-313483193 Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerAddressesTestJSON-313483193-project Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 2539fa08826e48d99de000ae1d8fbf55 Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerAddressesTestJSON-313483193-project Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance c2d46429-1fca-4e8f-9a22-68b54aa705e3 could not be found. Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'c2d46429-1fca-4e8f-9a22-68b54aa705e3'} Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2d46429-1fca-4e8f-9a22-68b54aa705e3 could not be found. Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2d46429-1fca-4e8f-9a22-68b54aa705e3 could not be found. Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:46:27.509509 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:46:27.514589 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:46:27.514589 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:46:27.514589 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:46:27.514589 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:46:27.514589 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:46:27.514589 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2d46429-1fca-4e8f-9a22-68b54aa705e3 could not be found. Oct 10 23:46:27.514589 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:46:27.520051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d98ceb60-caf6-451a-a5d8-4bcc0c5d3de2 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] Returning 404 to user: Instance c2d46429-1fca-4e8f-9a22-68b54aa705e3 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:46:27.523647 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d98ceb60-caf6-451a-a5d8-4bcc0c5d3de2 tempest-ServerAddressesTestJSON-313483193 tempest-ServerAddressesTestJSON-313483193-project] 10.222.0.23 "GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3" status: 404 len: 111 microversion: 2.1 time: 0.132136 Oct 10 23:46:27.524642 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2682/5536] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:27 2022] GET /compute/v2.1/servers/c2d46429-1fca-4e8f-9a22-68b54aa705e3 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:46:27.774434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-993496f9-c9ba-4d88-9744-c629105ddd1c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:27.782935 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-993496f9-c9ba-4d88-9744-c629105ddd1c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722" status: 200 len: 1266 microversion: 2.1 time: 0.542000 Oct 10 23:46:27.783532 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2855/5537] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:27 2022] GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 => generated 1266 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:28.268399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-14af7871-5e4c-441c-a872-8d3749d7303f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:28.269298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-14af7871-5e4c-441c-a872-8d3749d7303f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 8cb3edd4-435b-4619-afbf-86eebf0b1824] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:28.269452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-795e922d-91dd-4560-8804-a601e83c6a59 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:28.270403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-795e922d-91dd-4560-8804-a601e83c6a59 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:28.283166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14af7871-5e4c-441c-a872-8d3749d7303f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:28.286701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14af7871-5e4c-441c-a872-8d3749d7303f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:28.289879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14af7871-5e4c-441c-a872-8d3749d7303f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:28.291178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14af7871-5e4c-441c-a872-8d3749d7303f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:28.291893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14af7871-5e4c-441c-a872-8d3749d7303f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:28.294701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14af7871-5e4c-441c-a872-8d3749d7303f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:28.298333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795e922d-91dd-4560-8804-a601e83c6a59 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:28.299181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795e922d-91dd-4560-8804-a601e83c6a59 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:28.303255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795e922d-91dd-4560-8804-a601e83c6a59 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:28.306437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795e922d-91dd-4560-8804-a601e83c6a59 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:28.307009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795e922d-91dd-4560-8804-a601e83c6a59 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:28.313306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795e922d-91dd-4560-8804-a601e83c6a59 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:28.880675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-14af7871-5e4c-441c-a872-8d3749d7303f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:28.926137 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-14af7871-5e4c-441c-a872-8d3749d7303f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824" status: 200 len: 1508 microversion: 2.1 time: 0.662232 Oct 10 23:46:28.926758 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2856/5538] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:28 2022] GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824 => generated 1508 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:28.940245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-667af239-97cb-49f5-a4eb-1bec42d875f1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:28.940867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-667af239-97cb-49f5-a4eb-1bec42d875f1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:28.976231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-667af239-97cb-49f5-a4eb-1bec42d875f1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:28.976940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-667af239-97cb-49f5-a4eb-1bec42d875f1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:28.977709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-667af239-97cb-49f5-a4eb-1bec42d875f1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:28.978661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-667af239-97cb-49f5-a4eb-1bec42d875f1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:28.980645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-667af239-97cb-49f5-a4eb-1bec42d875f1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:28.981091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-667af239-97cb-49f5-a4eb-1bec42d875f1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:29.011416 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-795e922d-91dd-4560-8804-a601e83c6a59 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:29.030291 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-795e922d-91dd-4560-8804-a601e83c6a59 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1680 microversion: 2.1 time: 0.769199 Oct 10 23:46:29.031660 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2683/5539] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:28 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1680 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:29.037570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ef94637c-10fd-47a1-af13-4750bcb006f5 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7907ad4f-c4f5-4b5b-8f8e-bbacf92ae342", "device": "/dev/sdb"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:29.040403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ef94637c-10fd-47a1-af13-4750bcb006f5 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 8cb3edd4-435b-4619-afbf-86eebf0b1824] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:29.048863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef94637c-10fd-47a1-af13-4750bcb006f5 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:29.050337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef94637c-10fd-47a1-af13-4750bcb006f5 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:29.051362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef94637c-10fd-47a1-af13-4750bcb006f5 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:29.052406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef94637c-10fd-47a1-af13-4750bcb006f5 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:29.053232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef94637c-10fd-47a1-af13-4750bcb006f5 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:29.053911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef94637c-10fd-47a1-af13-4750bcb006f5 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:29.078766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:46:29.567342 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ef94637c-10fd-47a1-af13-4750bcb006f5 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "POST /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.533560 Oct 10 23:46:29.569132 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2684/5540] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Oct 10 23:46:29 2022] POST /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824/os-volume_attachments => generated 194 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:46:29.595555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-667af239-97cb-49f5-a4eb-1bec42d875f1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:29.615828 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-667af239-97cb-49f5-a4eb-1bec42d875f1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722" status: 200 len: 1308 microversion: 2.1 time: 0.687484 Oct 10 23:46:29.617184 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2857/5541] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:28 2022] GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 => generated 1308 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:30.068449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e0eddb8d-696d-47e9-8646-4723cb81c032 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:30.069336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e0eddb8d-696d-47e9-8646-4723cb81c032 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:30.092879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0eddb8d-696d-47e9-8646-4723cb81c032 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:30.093539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0eddb8d-696d-47e9-8646-4723cb81c032 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:30.095718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0eddb8d-696d-47e9-8646-4723cb81c032 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:30.099094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0eddb8d-696d-47e9-8646-4723cb81c032 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:30.099916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0eddb8d-696d-47e9-8646-4723cb81c032 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:30.103878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0eddb8d-696d-47e9-8646-4723cb81c032 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:30.647845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-086bf602-2da7-4da4-a6cb-fe9136b44a35 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:30.648701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-086bf602-2da7-4da4-a6cb-fe9136b44a35 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:30.661066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-086bf602-2da7-4da4-a6cb-fe9136b44a35 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:30.665941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-086bf602-2da7-4da4-a6cb-fe9136b44a35 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:30.666699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-086bf602-2da7-4da4-a6cb-fe9136b44a35 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:30.669740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-086bf602-2da7-4da4-a6cb-fe9136b44a35 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:30.671193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-086bf602-2da7-4da4-a6cb-fe9136b44a35 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:30.675842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-086bf602-2da7-4da4-a6cb-fe9136b44a35 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:31.279191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e0eddb8d-696d-47e9-8646-4723cb81c032 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:31.288604 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e0eddb8d-696d-47e9-8646-4723cb81c032 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1680 microversion: 2.1 time: 1.224527 Oct 10 23:46:31.289202 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2685/5542] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:30 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1680 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:31.750909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-086bf602-2da7-4da4-a6cb-fe9136b44a35 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:31.764353 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-086bf602-2da7-4da4-a6cb-fe9136b44a35 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722" status: 200 len: 1308 microversion: 2.1 time: 1.123249 Oct 10 23:46:31.765586 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2858/5543] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:30 2022] GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 => generated 1308 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:32.148847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-fd1d4a67-72ef-456c-8271-b381497e1fe3 req-8f9dd52c-339d-46f7-83bc-514262a9ef73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "894b12cd-a36c-4884-88a1-1c223cceb722", "tag": "a3013fc3-7008-43ce-a6fd-be3bf12ae4f5"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:32.192298 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fd1d4a67-72ef-456c-8271-b381497e1fe3 req-8f9dd52c-339d-46f7-83bc-514262a9ef73 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:32.195251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fd1d4a67-72ef-456c-8271-b381497e1fe3 req-8f9dd52c-339d-46f7-83bc-514262a9ef73 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:32.197551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fd1d4a67-72ef-456c-8271-b381497e1fe3 req-8f9dd52c-339d-46f7-83bc-514262a9ef73 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:32.238638 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-fd1d4a67-72ef-456c-8271-b381497e1fe3 req-8f9dd52c-339d-46f7-83bc-514262a9ef73 service nova] Creating event network-changed:a3013fc3-7008-43ce-a6fd-be3bf12ae4f5 for instance 894b12cd-a36c-4884-88a1-1c223cceb722 on n-h1-860864-2 Oct 10 23:46:32.251816 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-fd1d4a67-72ef-456c-8271-b381497e1fe3 req-8f9dd52c-339d-46f7-83bc-514262a9ef73 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109827 Oct 10 23:46:32.262493 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2686/5544] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:46:32.319289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e905e61b-104a-418e-9f7c-197e2e4385ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:32.319964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e905e61b-104a-418e-9f7c-197e2e4385ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:32.334337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e905e61b-104a-418e-9f7c-197e2e4385ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:32.334845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e905e61b-104a-418e-9f7c-197e2e4385ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:32.345555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e905e61b-104a-418e-9f7c-197e2e4385ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:32.349494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e905e61b-104a-418e-9f7c-197e2e4385ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:32.353961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e905e61b-104a-418e-9f7c-197e2e4385ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:32.355541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e905e61b-104a-418e-9f7c-197e2e4385ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:32.792814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b38375fc-4c89-4161-8b59-8e07b2d7cbae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:32.793558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b38375fc-4c89-4161-8b59-8e07b2d7cbae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:32.804371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b38375fc-4c89-4161-8b59-8e07b2d7cbae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:32.809435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b38375fc-4c89-4161-8b59-8e07b2d7cbae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:32.809905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b38375fc-4c89-4161-8b59-8e07b2d7cbae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:32.811536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b38375fc-4c89-4161-8b59-8e07b2d7cbae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:32.815228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b38375fc-4c89-4161-8b59-8e07b2d7cbae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:32.815887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b38375fc-4c89-4161-8b59-8e07b2d7cbae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:33.470750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e905e61b-104a-418e-9f7c-197e2e4385ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:33.488368 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e905e61b-104a-418e-9f7c-197e2e4385ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1680 microversion: 2.1 time: 1.173602 Oct 10 23:46:33.488992 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2859/5545] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:32 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1680 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:34.298037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b38375fc-4c89-4161-8b59-8e07b2d7cbae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:34.313529 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b38375fc-4c89-4161-8b59-8e07b2d7cbae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722" status: 200 len: 1308 microversion: 2.1 time: 1.524981 Oct 10 23:46:34.328276 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2687/5546] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:32 2022] GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 => generated 1308 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:34.518253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e8b12327-b21d-4f88-bd1e-5dbd56d5010c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:34.518875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e8b12327-b21d-4f88-bd1e-5dbd56d5010c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:34.521922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:46:34.530431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:46:34.542853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8b12327-b21d-4f88-bd1e-5dbd56d5010c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:34.543352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8b12327-b21d-4f88-bd1e-5dbd56d5010c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:34.554472 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8b12327-b21d-4f88-bd1e-5dbd56d5010c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:34.556018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8b12327-b21d-4f88-bd1e-5dbd56d5010c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:34.559344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8b12327-b21d-4f88-bd1e-5dbd56d5010c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:34.560376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8b12327-b21d-4f88-bd1e-5dbd56d5010c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:35.358052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7ccf121c-736f-4495-9945-949fb9cd4086 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:35.358928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7ccf121c-736f-4495-9945-949fb9cd4086 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:35.373723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:46:35.379036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ccf121c-736f-4495-9945-949fb9cd4086 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:35.379861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ccf121c-736f-4495-9945-949fb9cd4086 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:35.380534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ccf121c-736f-4495-9945-949fb9cd4086 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:35.381507 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ccf121c-736f-4495-9945-949fb9cd4086 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:35.382191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ccf121c-736f-4495-9945-949fb9cd4086 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:35.382841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7ccf121c-736f-4495-9945-949fb9cd4086 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:35.463733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e8b12327-b21d-4f88-bd1e-5dbd56d5010c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:35.473446 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e8b12327-b21d-4f88-bd1e-5dbd56d5010c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1680 microversion: 2.1 time: 0.959502 Oct 10 23:46:35.496575 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2860/5547] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:34 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1680 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:46:36.176300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7ccf121c-736f-4495-9945-949fb9cd4086 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:36.197333 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7ccf121c-736f-4495-9945-949fb9cd4086 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722" status: 200 len: 1308 microversion: 2.1 time: 0.844392 Oct 10 23:46:36.199251 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2688/5548] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:35 2022] GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 => generated 1308 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:46:36.501809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c8e5927d-2a8a-4317-99b4-a412c88d6538 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:36.503244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c8e5927d-2a8a-4317-99b4-a412c88d6538 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:36.522223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8e5927d-2a8a-4317-99b4-a412c88d6538 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:36.522757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8e5927d-2a8a-4317-99b4-a412c88d6538 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:36.523207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8e5927d-2a8a-4317-99b4-a412c88d6538 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:36.523955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8e5927d-2a8a-4317-99b4-a412c88d6538 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:36.524415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8e5927d-2a8a-4317-99b4-a412c88d6538 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:36.524845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8e5927d-2a8a-4317-99b4-a412c88d6538 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:37.089533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c8e5927d-2a8a-4317-99b4-a412c88d6538 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:37.101528 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c8e5927d-2a8a-4317-99b4-a412c88d6538 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1680 microversion: 2.1 time: 0.604224 Oct 10 23:46:37.102142 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2861/5549] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:36 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1680 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:37.228392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c83c0b59-7ab3-4557-90fc-9c2f6e306bfa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:37.228938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c83c0b59-7ab3-4557-90fc-9c2f6e306bfa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:37.262415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c83c0b59-7ab3-4557-90fc-9c2f6e306bfa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:37.266156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c83c0b59-7ab3-4557-90fc-9c2f6e306bfa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:37.267585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c83c0b59-7ab3-4557-90fc-9c2f6e306bfa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:37.280436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c83c0b59-7ab3-4557-90fc-9c2f6e306bfa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:37.286342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c83c0b59-7ab3-4557-90fc-9c2f6e306bfa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:37.290267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c83c0b59-7ab3-4557-90fc-9c2f6e306bfa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:37.885744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c83c0b59-7ab3-4557-90fc-9c2f6e306bfa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:37.895168 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c83c0b59-7ab3-4557-90fc-9c2f6e306bfa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722" status: 200 len: 1308 microversion: 2.1 time: 0.672537 Oct 10 23:46:37.897724 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2689/5550] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:37 2022] GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 => generated 1308 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:38.127121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cb86a89a-79e0-4106-8fec-1164166443ec tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:38.127749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cb86a89a-79e0-4106-8fec-1164166443ec tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:38.145402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb86a89a-79e0-4106-8fec-1164166443ec tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:38.146470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb86a89a-79e0-4106-8fec-1164166443ec tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:38.147072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb86a89a-79e0-4106-8fec-1164166443ec tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:38.147989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb86a89a-79e0-4106-8fec-1164166443ec tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:38.148599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb86a89a-79e0-4106-8fec-1164166443ec tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:38.149167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb86a89a-79e0-4106-8fec-1164166443ec tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:38.762180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cb86a89a-79e0-4106-8fec-1164166443ec tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:38.799985 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cb86a89a-79e0-4106-8fec-1164166443ec tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1657 microversion: 2.1 time: 0.677728 Oct 10 23:46:38.810562 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2862/5551] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:38 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1657 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:38.851878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d0fa2996-1828-4947-879a-f4f0672b9763 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:38.883830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0fa2996-1828-4947-879a-f4f0672b9763 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:38.884987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0fa2996-1828-4947-879a-f4f0672b9763 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:38.890718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0fa2996-1828-4947-879a-f4f0672b9763 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:38.925722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f9af4107-a0ca-415c-a9be-a3988af05e16 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:38.926351 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f9af4107-a0ca-415c-a9be-a3988af05e16 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:38.939954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9af4107-a0ca-415c-a9be-a3988af05e16 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:38.943558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9af4107-a0ca-415c-a9be-a3988af05e16 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:38.948635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9af4107-a0ca-415c-a9be-a3988af05e16 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:38.952371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9af4107-a0ca-415c-a9be-a3988af05e16 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:38.959183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9af4107-a0ca-415c-a9be-a3988af05e16 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:38.961726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9af4107-a0ca-415c-a9be-a3988af05e16 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:38.989071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d0fa2996-1828-4947-879a-f4f0672b9763 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Going to try to start instance {{(pid=120614) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 10 23:46:39.210256 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d0fa2996-1828-4947-879a-f4f0672b9763 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action" status: 202 len: 0 microversion: 2.1 time: 0.364577 Oct 10 23:46:39.216966 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2690/5552] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:46:38 2022] POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:46:39.245976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-28c6fbd4-1da6-407a-b175-d35ea75994ba tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:39.262988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-28c6fbd4-1da6-407a-b175-d35ea75994ba tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:39.295351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28c6fbd4-1da6-407a-b175-d35ea75994ba tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:39.296572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28c6fbd4-1da6-407a-b175-d35ea75994ba tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:39.297732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28c6fbd4-1da6-407a-b175-d35ea75994ba tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:39.299208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28c6fbd4-1da6-407a-b175-d35ea75994ba tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:39.300255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28c6fbd4-1da6-407a-b175-d35ea75994ba tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:39.301232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-28c6fbd4-1da6-407a-b175-d35ea75994ba tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:39.508398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f9af4107-a0ca-415c-a9be-a3988af05e16 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:39.524908 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f9af4107-a0ca-415c-a9be-a3988af05e16 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722" status: 200 len: 1308 microversion: 2.1 time: 0.602824 Oct 10 23:46:39.527288 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2863/5553] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:38 2022] GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 => generated 1308 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:46:40.202564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-28c6fbd4-1da6-407a-b175-d35ea75994ba tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:40.245370 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-28c6fbd4-1da6-407a-b175-d35ea75994ba tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1666 microversion: 2.1 time: 1.021979 Oct 10 23:46:40.246754 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2691/5554] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:39 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1666 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:46:40.568037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7e0da52a-5219-40cd-9038-b9446c355614 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:40.568832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7e0da52a-5219-40cd-9038-b9446c355614 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:40.583748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e0da52a-5219-40cd-9038-b9446c355614 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:40.583748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e0da52a-5219-40cd-9038-b9446c355614 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:40.583748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e0da52a-5219-40cd-9038-b9446c355614 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:40.594807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e0da52a-5219-40cd-9038-b9446c355614 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:40.596940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e0da52a-5219-40cd-9038-b9446c355614 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:40.597501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e0da52a-5219-40cd-9038-b9446c355614 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:41.276562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-686e62e6-a2eb-4c52-8ec0-83b126684be2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:41.277569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-686e62e6-a2eb-4c52-8ec0-83b126684be2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:41.288856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-686e62e6-a2eb-4c52-8ec0-83b126684be2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:41.289353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-686e62e6-a2eb-4c52-8ec0-83b126684be2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:41.289821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-686e62e6-a2eb-4c52-8ec0-83b126684be2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:41.290536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-686e62e6-a2eb-4c52-8ec0-83b126684be2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:41.290991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-686e62e6-a2eb-4c52-8ec0-83b126684be2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:41.296384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-686e62e6-a2eb-4c52-8ec0-83b126684be2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:41.459838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7e0da52a-5219-40cd-9038-b9446c355614 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:41.470628 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7e0da52a-5219-40cd-9038-b9446c355614 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722" status: 200 len: 1308 microversion: 2.1 time: 0.906510 Oct 10 23:46:41.475876 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2864/5555] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:40 2022] GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 => generated 1308 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:41.657906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-686e62e6-a2eb-4c52-8ec0-83b126684be2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:41.682842 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-686e62e6-a2eb-4c52-8ec0-83b126684be2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1666 microversion: 2.1 time: 0.409679 Oct 10 23:46:41.685056 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2692/5556] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:41 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1666 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:42.502319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0ce47f80-f17c-4bef-907d-322cbdc5831b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:42.503179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0ce47f80-f17c-4bef-907d-322cbdc5831b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:42.537249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ce47f80-f17c-4bef-907d-322cbdc5831b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:42.538096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ce47f80-f17c-4bef-907d-322cbdc5831b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:42.538775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ce47f80-f17c-4bef-907d-322cbdc5831b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:42.539743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ce47f80-f17c-4bef-907d-322cbdc5831b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:42.540269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ce47f80-f17c-4bef-907d-322cbdc5831b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:42.541182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ce47f80-f17c-4bef-907d-322cbdc5831b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:42.719580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-586a42a3-f69b-4006-a2a6-ee116e9e942d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:42.733754 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-586a42a3-f69b-4006-a2a6-ee116e9e942d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:42.742301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-586a42a3-f69b-4006-a2a6-ee116e9e942d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:42.746072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-586a42a3-f69b-4006-a2a6-ee116e9e942d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:42.746813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-586a42a3-f69b-4006-a2a6-ee116e9e942d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:42.747823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-586a42a3-f69b-4006-a2a6-ee116e9e942d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:42.748566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-586a42a3-f69b-4006-a2a6-ee116e9e942d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:42.749221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-586a42a3-f69b-4006-a2a6-ee116e9e942d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:42.750880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0ce47f80-f17c-4bef-907d-322cbdc5831b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:42.760142 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0ce47f80-f17c-4bef-907d-322cbdc5831b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722" status: 200 len: 1308 microversion: 2.1 time: 0.262156 Oct 10 23:46:42.762473 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2865/5557] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:42 2022] GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 => generated 1308 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:46:43.331461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-586a42a3-f69b-4006-a2a6-ee116e9e942d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:43.343834 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-586a42a3-f69b-4006-a2a6-ee116e9e942d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.627310 Oct 10 23:46:43.354344 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2693/5558] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:42 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:43.371241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3334da1f-33ae-455f-8fff-fe1a93e5e908 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:43.374725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3334da1f-33ae-455f-8fff-fe1a93e5e908 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:43.382646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3334da1f-33ae-455f-8fff-fe1a93e5e908 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:43.383877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3334da1f-33ae-455f-8fff-fe1a93e5e908 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:43.384706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3334da1f-33ae-455f-8fff-fe1a93e5e908 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:43.385747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3334da1f-33ae-455f-8fff-fe1a93e5e908 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:43.386633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3334da1f-33ae-455f-8fff-fe1a93e5e908 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:43.387715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3334da1f-33ae-455f-8fff-fe1a93e5e908 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:43.575892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3334da1f-33ae-455f-8fff-fe1a93e5e908 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:43.594790 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3334da1f-33ae-455f-8fff-fe1a93e5e908 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.229777 Oct 10 23:46:43.596992 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2866/5559] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:43 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:43.628543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7b79b72b-5f17-48ce-a7f4-be5a99ceab8d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:43.630586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7b79b72b-5f17-48ce-a7f4-be5a99ceab8d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:43.644340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b79b72b-5f17-48ce-a7f4-be5a99ceab8d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:43.645489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b79b72b-5f17-48ce-a7f4-be5a99ceab8d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:43.653900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b79b72b-5f17-48ce-a7f4-be5a99ceab8d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:43.667671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b79b72b-5f17-48ce-a7f4-be5a99ceab8d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:43.671887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b79b72b-5f17-48ce-a7f4-be5a99ceab8d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:43.672497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b79b72b-5f17-48ce-a7f4-be5a99ceab8d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:43.786877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a3e802b2-6413-40da-a608-7d186e6ed815 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:43.787820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a3e802b2-6413-40da-a608-7d186e6ed815 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:43.800250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3e802b2-6413-40da-a608-7d186e6ed815 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:43.806045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3e802b2-6413-40da-a608-7d186e6ed815 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:43.807268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3e802b2-6413-40da-a608-7d186e6ed815 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:43.810269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3e802b2-6413-40da-a608-7d186e6ed815 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:43.815211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3e802b2-6413-40da-a608-7d186e6ed815 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:43.816002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3e802b2-6413-40da-a608-7d186e6ed815 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:43.831772 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7b79b72b-5f17-48ce-a7f4-be5a99ceab8d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Unlocking {{(pid=120614) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 10 23:46:43.915983 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7b79b72b-5f17-48ce-a7f4-be5a99ceab8d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action" status: 202 len: 0 microversion: 2.1 time: 0.293828 Oct 10 23:46:43.918621 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2694/5560] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:46:43 2022] POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:46:43.934637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-16fcbc37-3f61-4b21-987a-163d40e1c2bc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:43.935507 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-16fcbc37-3f61-4b21-987a-163d40e1c2bc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:43.954714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16fcbc37-3f61-4b21-987a-163d40e1c2bc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:43.959160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16fcbc37-3f61-4b21-987a-163d40e1c2bc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:43.962966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16fcbc37-3f61-4b21-987a-163d40e1c2bc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:43.966618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16fcbc37-3f61-4b21-987a-163d40e1c2bc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:43.969980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16fcbc37-3f61-4b21-987a-163d40e1c2bc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:43.971229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16fcbc37-3f61-4b21-987a-163d40e1c2bc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:44.164369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a3e802b2-6413-40da-a608-7d186e6ed815 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:44.178158 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a3e802b2-6413-40da-a608-7d186e6ed815 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722" status: 200 len: 1308 microversion: 2.1 time: 0.393399 Oct 10 23:46:44.182612 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2867/5561] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:43 2022] GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 => generated 1308 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:44.356978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-16fcbc37-3f61-4b21-987a-163d40e1c2bc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:44.380789 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-16fcbc37-3f61-4b21-987a-163d40e1c2bc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.453327 Oct 10 23:46:44.383292 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2695/5562] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:43 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:46:44.429323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a990c7cb-4cb2-43c6-b41e-f7e7721d35e2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:44.430886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a990c7cb-4cb2-43c6-b41e-f7e7721d35e2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:44.443929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a990c7cb-4cb2-43c6-b41e-f7e7721d35e2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:44.445007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a990c7cb-4cb2-43c6-b41e-f7e7721d35e2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:44.446076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a990c7cb-4cb2-43c6-b41e-f7e7721d35e2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:44.456047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a990c7cb-4cb2-43c6-b41e-f7e7721d35e2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:44.457460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a990c7cb-4cb2-43c6-b41e-f7e7721d35e2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:44.459486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a990c7cb-4cb2-43c6-b41e-f7e7721d35e2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:44.473593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-a57b38c6-34d7-4b19-a13b-915fe461950e req-be0418cf-f278-4a27-afcf-7a56edc9f73c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "894b12cd-a36c-4884-88a1-1c223cceb722", "name": "network-vif-plugged", "status": "completed", "tag": "a3013fc3-7008-43ce-a6fd-be3bf12ae4f5"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:44.487823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a57b38c6-34d7-4b19-a13b-915fe461950e req-be0418cf-f278-4a27-afcf-7a56edc9f73c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:44.488605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a57b38c6-34d7-4b19-a13b-915fe461950e req-be0418cf-f278-4a27-afcf-7a56edc9f73c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:44.489671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a57b38c6-34d7-4b19-a13b-915fe461950e req-be0418cf-f278-4a27-afcf-7a56edc9f73c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:44.520854 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-a57b38c6-34d7-4b19-a13b-915fe461950e req-be0418cf-f278-4a27-afcf-7a56edc9f73c service nova] Creating event network-vif-plugged:a3013fc3-7008-43ce-a6fd-be3bf12ae4f5 for instance 894b12cd-a36c-4884-88a1-1c223cceb722 on n-h1-860864-2 Oct 10 23:46:44.538296 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-a57b38c6-34d7-4b19-a13b-915fe461950e req-be0418cf-f278-4a27-afcf-7a56edc9f73c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062402 Oct 10 23:46:44.539835 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2696/5563] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:46:45.214291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d2ea38db-a1a0-4a49-95d8-60ab539bb22e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:45.216624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d2ea38db-a1a0-4a49-95d8-60ab539bb22e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:45.245831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2ea38db-a1a0-4a49-95d8-60ab539bb22e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:45.250295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2ea38db-a1a0-4a49-95d8-60ab539bb22e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:45.253366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2ea38db-a1a0-4a49-95d8-60ab539bb22e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:45.254437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2ea38db-a1a0-4a49-95d8-60ab539bb22e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:45.255016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2ea38db-a1a0-4a49-95d8-60ab539bb22e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:45.257418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2ea38db-a1a0-4a49-95d8-60ab539bb22e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:45.308266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:46:45.331102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a990c7cb-4cb2-43c6-b41e-f7e7721d35e2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:45.343934 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a990c7cb-4cb2-43c6-b41e-f7e7721d35e2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.922589 Oct 10 23:46:45.350487 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2868/5564] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:44 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:45.375283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c9e75578-5d55-45d1-a890-f6ca8f07284b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:45.380862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c9e75578-5d55-45d1-a890-f6ca8f07284b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:45.394062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9e75578-5d55-45d1-a890-f6ca8f07284b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:45.394767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9e75578-5d55-45d1-a890-f6ca8f07284b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:45.395360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9e75578-5d55-45d1-a890-f6ca8f07284b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:45.396252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9e75578-5d55-45d1-a890-f6ca8f07284b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:45.398641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9e75578-5d55-45d1-a890-f6ca8f07284b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:45.399241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9e75578-5d55-45d1-a890-f6ca8f07284b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:45.439277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:46:45.633951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c9e75578-5d55-45d1-a890-f6ca8f07284b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:45.646323 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c9e75578-5d55-45d1-a890-f6ca8f07284b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.275437 Oct 10 23:46:45.647125 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2869/5565] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:45 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:46:45.670886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-254973f7-8507-43ca-9946-840eae82a33d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:45.671751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-254973f7-8507-43ca-9946-840eae82a33d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:45.678702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-254973f7-8507-43ca-9946-840eae82a33d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:45.679321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-254973f7-8507-43ca-9946-840eae82a33d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:45.679839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-254973f7-8507-43ca-9946-840eae82a33d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:45.680668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-254973f7-8507-43ca-9946-840eae82a33d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:45.681430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-254973f7-8507-43ca-9946-840eae82a33d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:45.682081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-254973f7-8507-43ca-9946-840eae82a33d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:45.785407 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-254973f7-8507-43ca-9946-840eae82a33d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action" status: 202 len: 0 microversion: 2.1 time: 0.105561 Oct 10 23:46:45.790857 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2870/5566] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:46:45 2022] POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 23:46:45.834502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fb4c8bf7-7925-43a7-aa32-9f56250236cb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:45.836910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fb4c8bf7-7925-43a7-aa32-9f56250236cb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:45.856506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb4c8bf7-7925-43a7-aa32-9f56250236cb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:45.857156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb4c8bf7-7925-43a7-aa32-9f56250236cb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:45.858148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb4c8bf7-7925-43a7-aa32-9f56250236cb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:45.860824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb4c8bf7-7925-43a7-aa32-9f56250236cb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:45.861309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb4c8bf7-7925-43a7-aa32-9f56250236cb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:45.861770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb4c8bf7-7925-43a7-aa32-9f56250236cb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:46.121400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d2ea38db-a1a0-4a49-95d8-60ab539bb22e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:46.131184 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d2ea38db-a1a0-4a49-95d8-60ab539bb22e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722" status: 200 len: 1308 microversion: 2.1 time: 0.925667 Oct 10 23:46:46.134933 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2697/5567] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:45 2022] GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 => generated 1308 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:46.239732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fb4c8bf7-7925-43a7-aa32-9f56250236cb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:46.250246 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fb4c8bf7-7925-43a7-aa32-9f56250236cb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1675 microversion: 2.1 time: 0.454511 Oct 10 23:46:46.254620 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2871/5568] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:45 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1675 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:47.174192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f998bc4d-717e-467c-b530-425b79e1a893 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:47.174953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f998bc4d-717e-467c-b530-425b79e1a893 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:47.223686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f998bc4d-717e-467c-b530-425b79e1a893 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:47.228074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f998bc4d-717e-467c-b530-425b79e1a893 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:47.229918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f998bc4d-717e-467c-b530-425b79e1a893 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:47.231370 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f998bc4d-717e-467c-b530-425b79e1a893 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:47.237321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f998bc4d-717e-467c-b530-425b79e1a893 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:47.239132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f998bc4d-717e-467c-b530-425b79e1a893 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:47.276575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cedca299-f776-414b-b687-d18f42d1580e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:47.279157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cedca299-f776-414b-b687-d18f42d1580e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:47.300819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cedca299-f776-414b-b687-d18f42d1580e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:47.303151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cedca299-f776-414b-b687-d18f42d1580e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:47.313061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cedca299-f776-414b-b687-d18f42d1580e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:47.318349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cedca299-f776-414b-b687-d18f42d1580e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:47.323043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cedca299-f776-414b-b687-d18f42d1580e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:47.325493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cedca299-f776-414b-b687-d18f42d1580e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:48.002797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cedca299-f776-414b-b687-d18f42d1580e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:48.017740 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cedca299-f776-414b-b687-d18f42d1580e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1655 microversion: 2.1 time: 0.743677 Oct 10 23:46:48.033414 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2872/5569] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:47 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1655 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:46:48.052567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c4dacee2-f52d-49c1-ae20-b517e5003137 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:48.053124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c4dacee2-f52d-49c1-ae20-b517e5003137 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:48.067262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4dacee2-f52d-49c1-ae20-b517e5003137 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:48.067769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4dacee2-f52d-49c1-ae20-b517e5003137 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:48.068226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4dacee2-f52d-49c1-ae20-b517e5003137 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:48.070521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f998bc4d-717e-467c-b530-425b79e1a893 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:48.071426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4dacee2-f52d-49c1-ae20-b517e5003137 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:48.077279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4dacee2-f52d-49c1-ae20-b517e5003137 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:48.077682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4dacee2-f52d-49c1-ae20-b517e5003137 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:48.124749 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f998bc4d-717e-467c-b530-425b79e1a893 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722" status: 200 len: 1490 microversion: 2.1 time: 0.961359 Oct 10 23:46:48.128545 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2698/5570] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:47 2022] GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 => generated 1490 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:48.325052 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c4dacee2-f52d-49c1-ae20-b517e5003137 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action" status: 202 len: 0 microversion: 2.1 time: 0.276441 Oct 10 23:46:48.326097 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2873/5571] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:46:48 2022] POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 23:46:48.338229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f3192592-5348-43de-af1d-e2198f3f76e0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:48.339086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f3192592-5348-43de-af1d-e2198f3f76e0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:48.362353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3192592-5348-43de-af1d-e2198f3f76e0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:48.363131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3192592-5348-43de-af1d-e2198f3f76e0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:48.363674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3192592-5348-43de-af1d-e2198f3f76e0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:48.364620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3192592-5348-43de-af1d-e2198f3f76e0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:48.365598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3192592-5348-43de-af1d-e2198f3f76e0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:48.366144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f3192592-5348-43de-af1d-e2198f3f76e0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:48.486974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f717a7cd-ab41-4000-b48c-ead6ae76aa7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-511095855", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "abcacee0-1319-4318-8900-2ff15d7780f9"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:48.710448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-f717a7cd-ab41-4000-b48c-ead6ae76aa7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] validate_networks() for [('abcacee0-1319-4318-8900-2ff15d7780f9', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:46:49.230707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f3192592-5348-43de-af1d-e2198f3f76e0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:49.246543 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f3192592-5348-43de-af1d-e2198f3f76e0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1662 microversion: 2.1 time: 0.915375 Oct 10 23:46:49.261790 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2699/5572] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:48 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1662 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:50.275846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2c146770-a4b2-42ae-9c5b-70d52040c45b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:50.276732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2c146770-a4b2-42ae-9c5b-70d52040c45b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:50.300166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c146770-a4b2-42ae-9c5b-70d52040c45b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:50.301960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c146770-a4b2-42ae-9c5b-70d52040c45b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:50.303589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c146770-a4b2-42ae-9c5b-70d52040c45b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:50.306244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c146770-a4b2-42ae-9c5b-70d52040c45b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:50.308964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c146770-a4b2-42ae-9c5b-70d52040c45b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:50.309688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c146770-a4b2-42ae-9c5b-70d52040c45b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:50.494451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-f717a7cd-ab41-4000-b48c-ead6ae76aa7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:46:50.495207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-f717a7cd-ab41-4000-b48c-ead6ae76aa7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:46:50.495369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-f717a7cd-ab41-4000-b48c-ead6ae76aa7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:46:50.495795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-f717a7cd-ab41-4000-b48c-ead6ae76aa7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:46:50.496212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-f717a7cd-ab41-4000-b48c-ead6ae76aa7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:46:50.519230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f717a7cd-ab41-4000-b48c-ead6ae76aa7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:50.520429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f717a7cd-ab41-4000-b48c-ead6ae76aa7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:50.523040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f717a7cd-ab41-4000-b48c-ead6ae76aa7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:50.523809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f717a7cd-ab41-4000-b48c-ead6ae76aa7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:50.524271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f717a7cd-ab41-4000-b48c-ead6ae76aa7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:50.524696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f717a7cd-ab41-4000-b48c-ead6ae76aa7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:50.908310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2c146770-a4b2-42ae-9c5b-70d52040c45b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:50.934352 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2c146770-a4b2-42ae-9c5b-70d52040c45b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.663008 Oct 10 23:46:50.935006 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2700/5573] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:50 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:50.967345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-99c7a3d9-4633-4fcd-80b5-e5b7de72ac26 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:50.974573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-99c7a3d9-4633-4fcd-80b5-e5b7de72ac26 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:50.995656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99c7a3d9-4633-4fcd-80b5-e5b7de72ac26 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:51.008040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99c7a3d9-4633-4fcd-80b5-e5b7de72ac26 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:51.008871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99c7a3d9-4633-4fcd-80b5-e5b7de72ac26 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:51.011218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99c7a3d9-4633-4fcd-80b5-e5b7de72ac26 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:51.013486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99c7a3d9-4633-4fcd-80b5-e5b7de72ac26 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:51.024692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99c7a3d9-4633-4fcd-80b5-e5b7de72ac26 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:51.082116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-f717a7cd-ab41-4000-b48c-ead6ae76aa7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Getting quotas for project 7fcc4d45337140259bcd5b64b17aa7b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:46:51.096348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-f717a7cd-ab41-4000-b48c-ead6ae76aa7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Getting quotas for user daf7a1ddba654265a5e732363c85eefa and project 7fcc4d45337140259bcd5b64b17aa7b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:46:51.141242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f717a7cd-ab41-4000-b48c-ead6ae76aa7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:46:51.149798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f717a7cd-ab41-4000-b48c-ead6ae76aa7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:46:51.253266 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f717a7cd-ab41-4000-b48c-ead6ae76aa7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.765595 Oct 10 23:46:51.263245 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2874/5574] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:46:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 23:46:51.268918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-26049a8d-4808-46fb-9deb-10ab16d6f98d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:51.282700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-26049a8d-4808-46fb-9deb-10ab16d6f98d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:51.430024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-26049a8d-4808-46fb-9deb-10ab16d6f98d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:51.450208 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-26049a8d-4808-46fb-9deb-10ab16d6f98d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1" status: 200 len: 1208 microversion: 2.1 time: 0.185093 Oct 10 23:46:51.451948 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2875/5575] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:51 2022] GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 => generated 1208 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:51.574163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-99c7a3d9-4633-4fcd-80b5-e5b7de72ac26 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:51.588891 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-99c7a3d9-4633-4fcd-80b5-e5b7de72ac26 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.624862 Oct 10 23:46:51.603117 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2701/5576] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:50 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:51.617857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ddc4ba08-1c88-4197-9aa1-2d5f49c3164b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:51.619105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ddc4ba08-1c88-4197-9aa1-2d5f49c3164b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:51.630157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:46:51.635887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddc4ba08-1c88-4197-9aa1-2d5f49c3164b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:51.637558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddc4ba08-1c88-4197-9aa1-2d5f49c3164b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:51.640770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddc4ba08-1c88-4197-9aa1-2d5f49c3164b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:51.643537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddc4ba08-1c88-4197-9aa1-2d5f49c3164b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:51.644762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddc4ba08-1c88-4197-9aa1-2d5f49c3164b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:51.646096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ddc4ba08-1c88-4197-9aa1-2d5f49c3164b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:52.446708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ddc4ba08-1c88-4197-9aa1-2d5f49c3164b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:52.472293 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ddc4ba08-1c88-4197-9aa1-2d5f49c3164b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.853022 Oct 10 23:46:52.474817 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2876/5577] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:51 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:52.493858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-05d39f22-28e4-43e3-b3cc-7350cb5ffe2e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:52.494722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-05d39f22-28e4-43e3-b3cc-7350cb5ffe2e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:52.517150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5e24349b-3af5-4eb0-b30c-031f564fd99d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:52.518109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5e24349b-3af5-4eb0-b30c-031f564fd99d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:52.530102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05d39f22-28e4-43e3-b3cc-7350cb5ffe2e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:52.530816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05d39f22-28e4-43e3-b3cc-7350cb5ffe2e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:52.531261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05d39f22-28e4-43e3-b3cc-7350cb5ffe2e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:52.531972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05d39f22-28e4-43e3-b3cc-7350cb5ffe2e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:52.532651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05d39f22-28e4-43e3-b3cc-7350cb5ffe2e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:52.533223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05d39f22-28e4-43e3-b3cc-7350cb5ffe2e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:52.540324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e24349b-3af5-4eb0-b30c-031f564fd99d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:52.542680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e24349b-3af5-4eb0-b30c-031f564fd99d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:52.543145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e24349b-3af5-4eb0-b30c-031f564fd99d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:52.550502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e24349b-3af5-4eb0-b30c-031f564fd99d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:52.551043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e24349b-3af5-4eb0-b30c-031f564fd99d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:52.552903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e24349b-3af5-4eb0-b30c-031f564fd99d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:52.768284 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-05d39f22-28e4-43e3-b3cc-7350cb5ffe2e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:52.782072 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-05d39f22-28e4-43e3-b3cc-7350cb5ffe2e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1" status: 200 len: 1212 microversion: 2.1 time: 0.306535 Oct 10 23:46:52.800182 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2702/5578] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:52 2022] GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 => generated 1212 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:52.964540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5e24349b-3af5-4eb0-b30c-031f564fd99d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:52.981564 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5e24349b-3af5-4eb0-b30c-031f564fd99d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.471679 Oct 10 23:46:52.984804 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2877/5579] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:52 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:53.014790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9c896367-d581-492e-a9f2-7e27eeec74bd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:53.015869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9c896367-d581-492e-a9f2-7e27eeec74bd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:53.036749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c896367-d581-492e-a9f2-7e27eeec74bd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:53.037573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c896367-d581-492e-a9f2-7e27eeec74bd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:53.038177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c896367-d581-492e-a9f2-7e27eeec74bd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:53.039264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c896367-d581-492e-a9f2-7e27eeec74bd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:53.039740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c896367-d581-492e-a9f2-7e27eeec74bd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:53.040176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c896367-d581-492e-a9f2-7e27eeec74bd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:53.737246 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9c896367-d581-492e-a9f2-7e27eeec74bd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:53.754321 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9c896367-d581-492e-a9f2-7e27eeec74bd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.745050 Oct 10 23:46:53.756164 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2703/5580] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:53 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:53.796506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-330ad824-065a-4a20-88ad-8fd445a8f7d2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:53.797146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-330ad824-065a-4a20-88ad-8fd445a8f7d2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:53.844941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-daa68e17-c2a1-47ee-bc46-be6e57e9103e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:53.846632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-daa68e17-c2a1-47ee-bc46-be6e57e9103e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:53.846966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-330ad824-065a-4a20-88ad-8fd445a8f7d2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:53.849430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-330ad824-065a-4a20-88ad-8fd445a8f7d2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:53.849921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-330ad824-065a-4a20-88ad-8fd445a8f7d2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:53.858152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-330ad824-065a-4a20-88ad-8fd445a8f7d2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:53.859788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-330ad824-065a-4a20-88ad-8fd445a8f7d2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:53.862940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-330ad824-065a-4a20-88ad-8fd445a8f7d2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:53.871380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-daa68e17-c2a1-47ee-bc46-be6e57e9103e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:53.874411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-daa68e17-c2a1-47ee-bc46-be6e57e9103e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:53.875062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-daa68e17-c2a1-47ee-bc46-be6e57e9103e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:53.876037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-daa68e17-c2a1-47ee-bc46-be6e57e9103e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:53.879229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-daa68e17-c2a1-47ee-bc46-be6e57e9103e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:53.894801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-daa68e17-c2a1-47ee-bc46-be6e57e9103e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:54.297095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-daa68e17-c2a1-47ee-bc46-be6e57e9103e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:54.322162 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-daa68e17-c2a1-47ee-bc46-be6e57e9103e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1" status: 200 len: 1278 microversion: 2.1 time: 0.513792 Oct 10 23:46:54.343243 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2704/5581] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:53 2022] GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 => generated 1278 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:54.814588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-330ad824-065a-4a20-88ad-8fd445a8f7d2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:54.830566 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-330ad824-065a-4a20-88ad-8fd445a8f7d2 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 1.040147 Oct 10 23:46:54.831672 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2878/5582] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:53 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:55.357357 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c84ba0aa-b33d-4a67-9d8e-c1c13241de7f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:55.358460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c84ba0aa-b33d-4a67-9d8e-c1c13241de7f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:55.370847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c84ba0aa-b33d-4a67-9d8e-c1c13241de7f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:55.371401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c84ba0aa-b33d-4a67-9d8e-c1c13241de7f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:55.371851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c84ba0aa-b33d-4a67-9d8e-c1c13241de7f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:55.374681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c84ba0aa-b33d-4a67-9d8e-c1c13241de7f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:55.376964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c84ba0aa-b33d-4a67-9d8e-c1c13241de7f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:55.377466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c84ba0aa-b33d-4a67-9d8e-c1c13241de7f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:56.144725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c84ba0aa-b33d-4a67-9d8e-c1c13241de7f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:56.162263 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c84ba0aa-b33d-4a67-9d8e-c1c13241de7f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1" status: 200 len: 1266 microversion: 2.1 time: 0.809988 Oct 10 23:46:56.167793 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2705/5583] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:55 2022] GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 => generated 1266 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:57.211269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c59f6cd2-9502-4a0b-afde-87298787eb7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:57.212424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c59f6cd2-9502-4a0b-afde-87298787eb7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:57.228432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c59f6cd2-9502-4a0b-afde-87298787eb7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:57.229513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c59f6cd2-9502-4a0b-afde-87298787eb7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:57.229651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c59f6cd2-9502-4a0b-afde-87298787eb7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:57.238497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c59f6cd2-9502-4a0b-afde-87298787eb7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:57.239069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c59f6cd2-9502-4a0b-afde-87298787eb7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:57.245111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c59f6cd2-9502-4a0b-afde-87298787eb7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:57.666886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c59f6cd2-9502-4a0b-afde-87298787eb7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:57.679030 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c59f6cd2-9502-4a0b-afde-87298787eb7a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1" status: 200 len: 1308 microversion: 2.1 time: 0.471796 Oct 10 23:46:57.682791 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2879/5584] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:57 2022] GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 => generated 1308 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:46:58.719543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-efdc2d59-17af-4a9a-befb-2e0fedcbde17 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1399775060", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "557c1b49-3d03-4789-9a79-2a6951edb64a"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:46:58.727431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fc676580-40b3-496f-821e-576fb57755b6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:46:58.731117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fc676580-40b3-496f-821e-576fb57755b6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:46:58.739670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=56 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:46:58.765440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc676580-40b3-496f-821e-576fb57755b6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:58.768784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc676580-40b3-496f-821e-576fb57755b6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:58.771973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc676580-40b3-496f-821e-576fb57755b6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:58.773142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc676580-40b3-496f-821e-576fb57755b6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:46:58.776410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc676580-40b3-496f-821e-576fb57755b6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:46:58.777069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc676580-40b3-496f-821e-576fb57755b6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:46:58.849950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-efdc2d59-17af-4a9a-befb-2e0fedcbde17 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] validate_networks() for [('557c1b49-3d03-4789-9a79-2a6951edb64a', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:46:59.638789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fc676580-40b3-496f-821e-576fb57755b6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:46:59.681633 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fc676580-40b3-496f-821e-576fb57755b6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1" status: 200 len: 1308 microversion: 2.1 time: 0.973927 Oct 10 23:46:59.683331 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2880/5585] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:46:58 2022] GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 => generated 1308 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:46:59.959997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-efdc2d59-17af-4a9a-befb-2e0fedcbde17 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:46:59.960548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-efdc2d59-17af-4a9a-befb-2e0fedcbde17 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:46:59.960893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-efdc2d59-17af-4a9a-befb-2e0fedcbde17 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:46:59.961304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-efdc2d59-17af-4a9a-befb-2e0fedcbde17 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:46:59.967351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-efdc2d59-17af-4a9a-befb-2e0fedcbde17 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:47:00.053452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efdc2d59-17af-4a9a-befb-2e0fedcbde17 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:00.061700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efdc2d59-17af-4a9a-befb-2e0fedcbde17 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:00.064249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efdc2d59-17af-4a9a-befb-2e0fedcbde17 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:00.066528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efdc2d59-17af-4a9a-befb-2e0fedcbde17 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:00.067220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efdc2d59-17af-4a9a-befb-2e0fedcbde17 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:00.071166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efdc2d59-17af-4a9a-befb-2e0fedcbde17 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:00.153183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-efdc2d59-17af-4a9a-befb-2e0fedcbde17 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Getting quotas for project 628f74afd564479e90696761249b95cd. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:47:00.183783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-efdc2d59-17af-4a9a-befb-2e0fedcbde17 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Getting quotas for user 871e17bf85d944159bf8911236edb561 and project 628f74afd564479e90696761249b95cd. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:47:00.211418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-efdc2d59-17af-4a9a-befb-2e0fedcbde17 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:47:00.224283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-efdc2d59-17af-4a9a-befb-2e0fedcbde17 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] [instance: 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:47:00.362222 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-efdc2d59-17af-4a9a-befb-2e0fedcbde17 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.951411 Oct 10 23:47:00.367640 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2706/5586] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:46:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:47:00.379171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8ce521b3-1b16-46ee-a4f2-c069c1dda8c9 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:00.380029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8ce521b3-1b16-46ee-a4f2-c069c1dda8c9 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] [instance: 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:00.641540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8ce521b3-1b16-46ee-a4f2-c069c1dda8c9 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e17bf85d944159bf8911236edb561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628f74afd564479e90696761249b95cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:00.654540 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8ce521b3-1b16-46ee-a4f2-c069c1dda8c9 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8" status: 200 len: 1225 microversion: 2.1 time: 0.278343 Oct 10 23:47:00.655951 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2881/5587] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:00 2022] GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 => generated 1225 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:00.717106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f1f5acf1-59ab-4a9c-aea1-2c39d8c4239c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:00.718823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f1f5acf1-59ab-4a9c-aea1-2c39d8c4239c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:00.767778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f1f5acf1-59ab-4a9c-aea1-2c39d8c4239c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:00.768959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f1f5acf1-59ab-4a9c-aea1-2c39d8c4239c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:00.772178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f1f5acf1-59ab-4a9c-aea1-2c39d8c4239c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:00.784530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f1f5acf1-59ab-4a9c-aea1-2c39d8c4239c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:00.793740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f1f5acf1-59ab-4a9c-aea1-2c39d8c4239c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:00.794867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f1f5acf1-59ab-4a9c-aea1-2c39d8c4239c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:01.362896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f1f5acf1-59ab-4a9c-aea1-2c39d8c4239c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:01.368479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-e375dd49-db9b-4331-9ef8-971dabecb522 req-5d0f86a2-e689-45f1-ae1b-0b675fe0911f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "326d64f9-9e2e-4efc-bd5a-113fa0a467f1", "tag": "6f201f82-7dc0-46bc-bf67-5c180c92ba48"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:47:01.376074 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f1f5acf1-59ab-4a9c-aea1-2c39d8c4239c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1" status: 200 len: 1308 microversion: 2.1 time: 0.667688 Oct 10 23:47:01.377023 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2707/5588] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:00 2022] GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 => generated 1308 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:47:01.411358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:47:01.440277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e375dd49-db9b-4331-9ef8-971dabecb522 req-5d0f86a2-e689-45f1-ae1b-0b675fe0911f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:01.440783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e375dd49-db9b-4331-9ef8-971dabecb522 req-5d0f86a2-e689-45f1-ae1b-0b675fe0911f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:01.441228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e375dd49-db9b-4331-9ef8-971dabecb522 req-5d0f86a2-e689-45f1-ae1b-0b675fe0911f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:01.496586 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-e375dd49-db9b-4331-9ef8-971dabecb522 req-5d0f86a2-e689-45f1-ae1b-0b675fe0911f service nova] Creating event network-changed:6f201f82-7dc0-46bc-bf67-5c180c92ba48 for instance 326d64f9-9e2e-4efc-bd5a-113fa0a467f1 on n-h1-860864-2 Oct 10 23:47:01.515942 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-e375dd49-db9b-4331-9ef8-971dabecb522 req-5d0f86a2-e689-45f1-ae1b-0b675fe0911f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151706 Oct 10 23:47:01.517301 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2882/5589] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:47:01.702236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7fa1575b-7072-411b-88d0-fe1e345e79db tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:01.703501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7fa1575b-7072-411b-88d0-fe1e345e79db tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] [instance: 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:01.715279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fa1575b-7072-411b-88d0-fe1e345e79db tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:01.720685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fa1575b-7072-411b-88d0-fe1e345e79db tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:01.722658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fa1575b-7072-411b-88d0-fe1e345e79db tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:01.728644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fa1575b-7072-411b-88d0-fe1e345e79db tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:01.730912 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fa1575b-7072-411b-88d0-fe1e345e79db tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:01.733536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7fa1575b-7072-411b-88d0-fe1e345e79db tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:01.933573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7fa1575b-7072-411b-88d0-fe1e345e79db tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e17bf85d944159bf8911236edb561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628f74afd564479e90696761249b95cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:01.946048 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7fa1575b-7072-411b-88d0-fe1e345e79db tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8" status: 200 len: 1229 microversion: 2.1 time: 0.248911 Oct 10 23:47:01.947637 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2708/5590] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:01 2022] GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 => generated 1229 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:02.408621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ba8679c2-20c1-485a-8557-005034522b06 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:02.409714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ba8679c2-20c1-485a-8557-005034522b06 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:02.444873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba8679c2-20c1-485a-8557-005034522b06 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:02.446235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba8679c2-20c1-485a-8557-005034522b06 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:02.447860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba8679c2-20c1-485a-8557-005034522b06 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:02.450035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba8679c2-20c1-485a-8557-005034522b06 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:02.455602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba8679c2-20c1-485a-8557-005034522b06 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:02.457551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba8679c2-20c1-485a-8557-005034522b06 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:02.861932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ba8679c2-20c1-485a-8557-005034522b06 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:02.877968 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ba8679c2-20c1-485a-8557-005034522b06 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1" status: 200 len: 1308 microversion: 2.1 time: 0.473233 Oct 10 23:47:02.881551 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2883/5591] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:02 2022] GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 => generated 1308 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:02.975518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f4f9b615-4059-446d-8e95-62ea7182975e tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:02.978186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f4f9b615-4059-446d-8e95-62ea7182975e tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] [instance: 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:03.010965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4f9b615-4059-446d-8e95-62ea7182975e tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:03.012694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4f9b615-4059-446d-8e95-62ea7182975e tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:03.013256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4f9b615-4059-446d-8e95-62ea7182975e tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:03.021485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4f9b615-4059-446d-8e95-62ea7182975e tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:03.023580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4f9b615-4059-446d-8e95-62ea7182975e tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:03.024214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4f9b615-4059-446d-8e95-62ea7182975e tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:03.576263 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f4f9b615-4059-446d-8e95-62ea7182975e tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e17bf85d944159bf8911236edb561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628f74afd564479e90696761249b95cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:03.608135 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f4f9b615-4059-446d-8e95-62ea7182975e tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8" status: 200 len: 1277 microversion: 2.1 time: 0.638739 Oct 10 23:47:03.625516 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2709/5592] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:02 2022] GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 => generated 1277 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:47:03.905365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5add9ce1-5adf-47dc-b2b6-3df85c7c18a2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:03.906948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5add9ce1-5adf-47dc-b2b6-3df85c7c18a2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:03.922895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5add9ce1-5adf-47dc-b2b6-3df85c7c18a2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:03.923802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5add9ce1-5adf-47dc-b2b6-3df85c7c18a2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:03.924471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5add9ce1-5adf-47dc-b2b6-3df85c7c18a2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:03.925524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5add9ce1-5adf-47dc-b2b6-3df85c7c18a2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:03.927461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5add9ce1-5adf-47dc-b2b6-3df85c7c18a2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:03.929202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5add9ce1-5adf-47dc-b2b6-3df85c7c18a2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:04.259899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5add9ce1-5adf-47dc-b2b6-3df85c7c18a2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:04.273669 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5add9ce1-5adf-47dc-b2b6-3df85c7c18a2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1" status: 200 len: 1308 microversion: 2.1 time: 0.376511 Oct 10 23:47:04.274586 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2884/5593] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:03 2022] GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 => generated 1308 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:04.640118 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ab98a71b-0ad8-490c-86ae-d302850188e2 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:04.640795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ab98a71b-0ad8-490c-86ae-d302850188e2 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] [instance: 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:04.667680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab98a71b-0ad8-490c-86ae-d302850188e2 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:04.668285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab98a71b-0ad8-490c-86ae-d302850188e2 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:04.680320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab98a71b-0ad8-490c-86ae-d302850188e2 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:04.715805 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab98a71b-0ad8-490c-86ae-d302850188e2 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:04.716808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab98a71b-0ad8-490c-86ae-d302850188e2 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:04.742011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab98a71b-0ad8-490c-86ae-d302850188e2 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:05.202902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ab98a71b-0ad8-490c-86ae-d302850188e2 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e17bf85d944159bf8911236edb561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628f74afd564479e90696761249b95cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:05.233248 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ab98a71b-0ad8-490c-86ae-d302850188e2 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8" status: 200 len: 1283 microversion: 2.1 time: 0.601280 Oct 10 23:47:05.234756 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2710/5594] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:04 2022] GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 => generated 1283 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:05.307912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a41187bd-8f60-4f37-84e6-a52beca757dc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:05.311700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a41187bd-8f60-4f37-84e6-a52beca757dc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:05.332956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a41187bd-8f60-4f37-84e6-a52beca757dc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:05.334031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a41187bd-8f60-4f37-84e6-a52beca757dc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:05.334591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a41187bd-8f60-4f37-84e6-a52beca757dc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:05.335475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a41187bd-8f60-4f37-84e6-a52beca757dc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:05.336089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a41187bd-8f60-4f37-84e6-a52beca757dc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:05.336805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a41187bd-8f60-4f37-84e6-a52beca757dc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:06.205519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a41187bd-8f60-4f37-84e6-a52beca757dc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:06.214995 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a41187bd-8f60-4f37-84e6-a52beca757dc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1" status: 200 len: 1308 microversion: 2.1 time: 0.919693 Oct 10 23:47:06.223078 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2885/5595] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:05 2022] GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 => generated 1308 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:06.269024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-02771837-e554-4a34-ac88-26bc9691c710 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:06.269894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-02771837-e554-4a34-ac88-26bc9691c710 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] [instance: 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:06.279097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02771837-e554-4a34-ac88-26bc9691c710 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:06.282572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02771837-e554-4a34-ac88-26bc9691c710 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:06.285505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02771837-e554-4a34-ac88-26bc9691c710 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:06.289734 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02771837-e554-4a34-ac88-26bc9691c710 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:06.290210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02771837-e554-4a34-ac88-26bc9691c710 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:06.296295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-02771837-e554-4a34-ac88-26bc9691c710 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:06.899799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-02771837-e554-4a34-ac88-26bc9691c710 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e17bf85d944159bf8911236edb561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628f74afd564479e90696761249b95cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:06.921810 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-02771837-e554-4a34-ac88-26bc9691c710 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8" status: 200 len: 1325 microversion: 2.1 time: 0.653075 Oct 10 23:47:06.922673 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2711/5596] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:06 2022] GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 => generated 1325 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:07.251063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8d3e7970-ac3b-4040-bc98-1153d0fad65f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:07.251684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8d3e7970-ac3b-4040-bc98-1153d0fad65f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:07.277453 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d3e7970-ac3b-4040-bc98-1153d0fad65f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:07.278604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d3e7970-ac3b-4040-bc98-1153d0fad65f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:07.280250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d3e7970-ac3b-4040-bc98-1153d0fad65f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:07.284476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d3e7970-ac3b-4040-bc98-1153d0fad65f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:07.285163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d3e7970-ac3b-4040-bc98-1153d0fad65f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:07.287958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d3e7970-ac3b-4040-bc98-1153d0fad65f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:07.953417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-052dc094-b078-4348-927f-a26e3335ae5c tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:07.954807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-052dc094-b078-4348-927f-a26e3335ae5c tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] [instance: 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:07.979214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-052dc094-b078-4348-927f-a26e3335ae5c tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:07.983931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-052dc094-b078-4348-927f-a26e3335ae5c tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:07.986370 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-052dc094-b078-4348-927f-a26e3335ae5c tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:07.993125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-052dc094-b078-4348-927f-a26e3335ae5c tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:07.996768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-052dc094-b078-4348-927f-a26e3335ae5c tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:08.002731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-052dc094-b078-4348-927f-a26e3335ae5c tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:08.915052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8d3e7970-ac3b-4040-bc98-1153d0fad65f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:08.929232 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8d3e7970-ac3b-4040-bc98-1153d0fad65f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1" status: 200 len: 1308 microversion: 2.1 time: 1.685125 Oct 10 23:47:08.937013 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2886/5597] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:07 2022] GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 => generated 1308 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:09.395044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-052dc094-b078-4348-927f-a26e3335ae5c tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e17bf85d944159bf8911236edb561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628f74afd564479e90696761249b95cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:09.414120 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-052dc094-b078-4348-927f-a26e3335ae5c tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8" status: 200 len: 1325 microversion: 2.1 time: 1.464664 Oct 10 23:47:09.417237 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2712/5598] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:07 2022] GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 => generated 1325 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:09.846597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-9a27cb34-c9a0-4fa0-bd22-e2352fdc206a req-288dd38c-010e-4180-baab-1e18c0fcf4ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c902fab-3bc3-4d50-a5b1-4f1ed67790c8", "tag": "1c1dab24-dca0-4119-a5fb-371d8a7bfaa0"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:47:09.905940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9a27cb34-c9a0-4fa0-bd22-e2352fdc206a req-288dd38c-010e-4180-baab-1e18c0fcf4ca service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:09.910184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9a27cb34-c9a0-4fa0-bd22-e2352fdc206a req-288dd38c-010e-4180-baab-1e18c0fcf4ca service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:09.911014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9a27cb34-c9a0-4fa0-bd22-e2352fdc206a req-288dd38c-010e-4180-baab-1e18c0fcf4ca service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:09.967158 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-9a27cb34-c9a0-4fa0-bd22-e2352fdc206a req-288dd38c-010e-4180-baab-1e18c0fcf4ca service nova] Creating event network-changed:1c1dab24-dca0-4119-a5fb-371d8a7bfaa0 for instance 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 on n-h2-860864-2 Oct 10 23:47:09.971015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f0b6b302-1c84-4604-8cfd-a29c5b3adc15 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:09.971981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f0b6b302-1c84-4604-8cfd-a29c5b3adc15 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:09.986357 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-9a27cb34-c9a0-4fa0-bd22-e2352fdc206a req-288dd38c-010e-4180-baab-1e18c0fcf4ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140508 Oct 10 23:47:09.987899 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2887/5599] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:47:09.994294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0b6b302-1c84-4604-8cfd-a29c5b3adc15 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:09.996802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0b6b302-1c84-4604-8cfd-a29c5b3adc15 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:09.999040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0b6b302-1c84-4604-8cfd-a29c5b3adc15 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:10.000983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0b6b302-1c84-4604-8cfd-a29c5b3adc15 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:10.003070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0b6b302-1c84-4604-8cfd-a29c5b3adc15 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:10.003762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0b6b302-1c84-4604-8cfd-a29c5b3adc15 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:10.111986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:47:10.129281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-15542b53-af6d-45a3-8e13-a8c9a320a5aa tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:10.130652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-15542b53-af6d-45a3-8e13-a8c9a320a5aa tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 8cb3edd4-435b-4619-afbf-86eebf0b1824] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:10.140791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15542b53-af6d-45a3-8e13-a8c9a320a5aa tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:10.141784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15542b53-af6d-45a3-8e13-a8c9a320a5aa tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:10.142494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15542b53-af6d-45a3-8e13-a8c9a320a5aa tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:10.144977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15542b53-af6d-45a3-8e13-a8c9a320a5aa tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:10.146371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15542b53-af6d-45a3-8e13-a8c9a320a5aa tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:10.147468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15542b53-af6d-45a3-8e13-a8c9a320a5aa tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:10.177831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:47:10.203897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:47:10.330389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-15542b53-af6d-45a3-8e13-a8c9a320a5aa tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lazy-loading 'services' on Instance uuid 8cb3edd4-435b-4619-afbf-86eebf0b1824 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:47:10.483322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f0b6b302-1c84-4604-8cfd-a29c5b3adc15 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:10.495536 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-15542b53-af6d-45a3-8e13-a8c9a320a5aa tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824/os-volume_attachments/7907ad4f-c4f5-4b5b-8f8e-bbacf92ae342" status: 202 len: 0 microversion: 2.1 time: 0.372458 Oct 10 23:47:10.501789 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2888/5600] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Oct 10 23:47:10 2022] DELETE /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824/os-volume_attachments/7907ad4f-c4f5-4b5b-8f8e-bbacf92ae342 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:47:10.509452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-037d7813-49f2-4061-8a25-2a148de7f0fb tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:10.511110 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f0b6b302-1c84-4604-8cfd-a29c5b3adc15 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1" status: 200 len: 1308 microversion: 2.1 time: 0.545852 Oct 10 23:47:10.514299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-037d7813-49f2-4061-8a25-2a148de7f0fb tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] [instance: 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:10.528750 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2713/5601] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:09 2022] GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 => generated 1308 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:10.534865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-037d7813-49f2-4061-8a25-2a148de7f0fb tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:10.535956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-037d7813-49f2-4061-8a25-2a148de7f0fb tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:10.537426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-037d7813-49f2-4061-8a25-2a148de7f0fb tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:10.538491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-037d7813-49f2-4061-8a25-2a148de7f0fb tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:10.541430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-037d7813-49f2-4061-8a25-2a148de7f0fb tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:10.542161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-037d7813-49f2-4061-8a25-2a148de7f0fb tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:10.648947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=10 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:47:11.119340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-037d7813-49f2-4061-8a25-2a148de7f0fb tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e17bf85d944159bf8911236edb561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628f74afd564479e90696761249b95cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:11.147823 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-037d7813-49f2-4061-8a25-2a148de7f0fb tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8" status: 200 len: 1325 microversion: 2.1 time: 0.645147 Oct 10 23:47:11.150400 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2889/5602] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:10 2022] GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 => generated 1325 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:11.544829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-66c0ee9f-162e-4342-936f-1741ffd74744 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:11.546346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-66c0ee9f-162e-4342-936f-1741ffd74744 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:11.580700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66c0ee9f-162e-4342-936f-1741ffd74744 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:11.581709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66c0ee9f-162e-4342-936f-1741ffd74744 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:11.582678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66c0ee9f-162e-4342-936f-1741ffd74744 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:11.584875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66c0ee9f-162e-4342-936f-1741ffd74744 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:11.592552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66c0ee9f-162e-4342-936f-1741ffd74744 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:11.593435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66c0ee9f-162e-4342-936f-1741ffd74744 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:12.182068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-59fc3410-26c8-448b-baf4-30d42eefca88 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:12.183318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-59fc3410-26c8-448b-baf4-30d42eefca88 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] [instance: 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:12.210063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59fc3410-26c8-448b-baf4-30d42eefca88 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:12.210570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59fc3410-26c8-448b-baf4-30d42eefca88 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:12.211012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59fc3410-26c8-448b-baf4-30d42eefca88 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:12.211894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59fc3410-26c8-448b-baf4-30d42eefca88 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:12.212366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59fc3410-26c8-448b-baf4-30d42eefca88 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:12.212804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59fc3410-26c8-448b-baf4-30d42eefca88 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:12.565281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-59fc3410-26c8-448b-baf4-30d42eefca88 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e17bf85d944159bf8911236edb561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628f74afd564479e90696761249b95cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:12.582602 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-59fc3410-26c8-448b-baf4-30d42eefca88 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8" status: 200 len: 1325 microversion: 2.1 time: 0.404097 Oct 10 23:47:12.602768 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2890/5603] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:12 2022] GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 => generated 1325 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:12.634109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-b5270b1d-4e54-4a96-bc80-29ef1027493a req-c3cd0ce3-ba20-49db-8505-4a5beba39b0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "326d64f9-9e2e-4efc-bd5a-113fa0a467f1", "name": "network-vif-plugged", "status": "completed", "tag": "6f201f82-7dc0-46bc-bf67-5c180c92ba48"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:47:12.648093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b5270b1d-4e54-4a96-bc80-29ef1027493a req-c3cd0ce3-ba20-49db-8505-4a5beba39b0a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:12.648598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b5270b1d-4e54-4a96-bc80-29ef1027493a req-c3cd0ce3-ba20-49db-8505-4a5beba39b0a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:12.649049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b5270b1d-4e54-4a96-bc80-29ef1027493a req-c3cd0ce3-ba20-49db-8505-4a5beba39b0a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:12.692382 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-b5270b1d-4e54-4a96-bc80-29ef1027493a req-c3cd0ce3-ba20-49db-8505-4a5beba39b0a service nova] Creating event network-vif-plugged:6f201f82-7dc0-46bc-bf67-5c180c92ba48 for instance 326d64f9-9e2e-4efc-bd5a-113fa0a467f1 on n-h1-860864-2 Oct 10 23:47:12.710378 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-b5270b1d-4e54-4a96-bc80-29ef1027493a req-c3cd0ce3-ba20-49db-8505-4a5beba39b0a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105283 Oct 10 23:47:12.712634 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2891/5604] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:47:13.051140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-66c0ee9f-162e-4342-936f-1741ffd74744 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:13.059978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:47:13.083304 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-66c0ee9f-162e-4342-936f-1741ffd74744 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1" status: 200 len: 1308 microversion: 2.1 time: 1.542172 Oct 10 23:47:13.103582 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2714/5605] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:11 2022] GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 => generated 1308 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:13.630778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ab256d85-14dd-4015-81e2-b53d3f0f39f3 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:13.632494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ab256d85-14dd-4015-81e2-b53d3f0f39f3 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] [instance: 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:13.645049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab256d85-14dd-4015-81e2-b53d3f0f39f3 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:13.645954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab256d85-14dd-4015-81e2-b53d3f0f39f3 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:13.646703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab256d85-14dd-4015-81e2-b53d3f0f39f3 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:13.648063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab256d85-14dd-4015-81e2-b53d3f0f39f3 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:13.648776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab256d85-14dd-4015-81e2-b53d3f0f39f3 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:13.649455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab256d85-14dd-4015-81e2-b53d3f0f39f3 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:14.129481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6d070981-9835-4780-9b9b-191c8681a2aa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:14.130114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6d070981-9835-4780-9b9b-191c8681a2aa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:14.136945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d070981-9835-4780-9b9b-191c8681a2aa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:14.144285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d070981-9835-4780-9b9b-191c8681a2aa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:14.145091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d070981-9835-4780-9b9b-191c8681a2aa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:14.146255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d070981-9835-4780-9b9b-191c8681a2aa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:14.146961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d070981-9835-4780-9b9b-191c8681a2aa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:14.147562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d070981-9835-4780-9b9b-191c8681a2aa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:14.273090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ab256d85-14dd-4015-81e2-b53d3f0f39f3 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e17bf85d944159bf8911236edb561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628f74afd564479e90696761249b95cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:14.284730 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ab256d85-14dd-4015-81e2-b53d3f0f39f3 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8" status: 200 len: 1325 microversion: 2.1 time: 0.659743 Oct 10 23:47:14.285282 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2892/5606] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:13 2022] GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 => generated 1325 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:14.485655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6d070981-9835-4780-9b9b-191c8681a2aa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:14.499817 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6d070981-9835-4780-9b9b-191c8681a2aa tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1" status: 200 len: 1308 microversion: 2.1 time: 0.385656 Oct 10 23:47:14.506706 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2715/5607] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:14 2022] GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 => generated 1308 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:15.319852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7d2361bf-7436-4dcd-8879-6311833a1f83 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:15.321687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7d2361bf-7436-4dcd-8879-6311833a1f83 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] [instance: 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:15.339600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d2361bf-7436-4dcd-8879-6311833a1f83 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:15.340998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d2361bf-7436-4dcd-8879-6311833a1f83 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:15.341852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d2361bf-7436-4dcd-8879-6311833a1f83 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:15.344257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d2361bf-7436-4dcd-8879-6311833a1f83 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:15.345719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d2361bf-7436-4dcd-8879-6311833a1f83 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:15.346550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d2361bf-7436-4dcd-8879-6311833a1f83 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:15.534539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-19c13889-eb8c-4c00-a028-825942aec6d2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:15.535285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-19c13889-eb8c-4c00-a028-825942aec6d2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:15.536864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7d2361bf-7436-4dcd-8879-6311833a1f83 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e17bf85d944159bf8911236edb561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628f74afd564479e90696761249b95cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:15.544632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19c13889-eb8c-4c00-a028-825942aec6d2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:15.545366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19c13889-eb8c-4c00-a028-825942aec6d2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:15.545912 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19c13889-eb8c-4c00-a028-825942aec6d2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:15.546645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19c13889-eb8c-4c00-a028-825942aec6d2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:15.547086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19c13889-eb8c-4c00-a028-825942aec6d2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:15.547704 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19c13889-eb8c-4c00-a028-825942aec6d2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:15.557056 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7d2361bf-7436-4dcd-8879-6311833a1f83 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8" status: 200 len: 1325 microversion: 2.1 time: 0.246407 Oct 10 23:47:15.572412 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2893/5608] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:15 2022] GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 => generated 1325 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:15.887296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-19c13889-eb8c-4c00-a028-825942aec6d2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:15.913978 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-19c13889-eb8c-4c00-a028-825942aec6d2 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1" status: 200 len: 1489 microversion: 2.1 time: 0.385962 Oct 10 23:47:15.916439 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2716/5609] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:15 2022] GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 => generated 1489 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:15.957454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1e68ae6a-e269-41b0-befd-83dcc7b9e261 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:15.958129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1e68ae6a-e269-41b0-befd-83dcc7b9e261 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:15.969159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e68ae6a-e269-41b0-befd-83dcc7b9e261 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:15.969723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e68ae6a-e269-41b0-befd-83dcc7b9e261 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:15.970173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e68ae6a-e269-41b0-befd-83dcc7b9e261 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:15.970912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e68ae6a-e269-41b0-befd-83dcc7b9e261 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:15.971379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e68ae6a-e269-41b0-befd-83dcc7b9e261 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:15.971818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e68ae6a-e269-41b0-befd-83dcc7b9e261 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:16.301740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1e68ae6a-e269-41b0-befd-83dcc7b9e261 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:16.317741 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1e68ae6a-e269-41b0-befd-83dcc7b9e261 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722" status: 200 len: 1490 microversion: 2.1 time: 0.364358 Oct 10 23:47:16.321530 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2894/5610] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:15 2022] GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 => generated 1490 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:16.359377 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e3c3e8fa-2f5c-4752-8d12-836dcd8e22ce tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:16.360071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e3c3e8fa-2f5c-4752-8d12-836dcd8e22ce tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:16.367439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3c3e8fa-2f5c-4752-8d12-836dcd8e22ce tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:16.367935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3c3e8fa-2f5c-4752-8d12-836dcd8e22ce tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:16.368375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3c3e8fa-2f5c-4752-8d12-836dcd8e22ce tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:16.369141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3c3e8fa-2f5c-4752-8d12-836dcd8e22ce tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:16.369653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3c3e8fa-2f5c-4752-8d12-836dcd8e22ce tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:16.370084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3c3e8fa-2f5c-4752-8d12-836dcd8e22ce tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:16.584240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cd3e52b2-275f-4dd8-a14f-0175b021a279 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:16.585249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cd3e52b2-275f-4dd8-a14f-0175b021a279 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] [instance: 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:16.600565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd3e52b2-275f-4dd8-a14f-0175b021a279 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:16.601403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd3e52b2-275f-4dd8-a14f-0175b021a279 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:16.603616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd3e52b2-275f-4dd8-a14f-0175b021a279 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:16.604751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd3e52b2-275f-4dd8-a14f-0175b021a279 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:16.608953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd3e52b2-275f-4dd8-a14f-0175b021a279 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:16.611688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd3e52b2-275f-4dd8-a14f-0175b021a279 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:16.762340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e3c3e8fa-2f5c-4752-8d12-836dcd8e22ce tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:16.788876 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e3c3e8fa-2f5c-4752-8d12-836dcd8e22ce tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1" status: 200 len: 1489 microversion: 2.1 time: 0.433643 Oct 10 23:47:16.816391 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2717/5611] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:16 2022] GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 => generated 1489 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:16.844253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-071a747d-b74b-4351-a283-94c6e2dbc172 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:16.845803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-071a747d-b74b-4351-a283-94c6e2dbc172 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:16.865657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-071a747d-b74b-4351-a283-94c6e2dbc172 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:16.868533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-071a747d-b74b-4351-a283-94c6e2dbc172 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:16.869012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-071a747d-b74b-4351-a283-94c6e2dbc172 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:16.870339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-071a747d-b74b-4351-a283-94c6e2dbc172 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:16.872075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-071a747d-b74b-4351-a283-94c6e2dbc172 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:16.874368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-071a747d-b74b-4351-a283-94c6e2dbc172 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:16.942884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-071a747d-b74b-4351-a283-94c6e2dbc172 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:47:17.016671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cd3e52b2-275f-4dd8-a14f-0175b021a279 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e17bf85d944159bf8911236edb561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628f74afd564479e90696761249b95cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:17.034097 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cd3e52b2-275f-4dd8-a14f-0175b021a279 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8" status: 200 len: 1325 microversion: 2.1 time: 0.450716 Oct 10 23:47:17.053129 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2895/5612] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:16 2022] GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 => generated 1325 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:17.070320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-fba393ac-4483-4963-a729-fb3af97a26ef req-1eebfa63-5b5d-4bab-8410-97ab12b91ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c902fab-3bc3-4d50-a5b1-4f1ed67790c8", "name": "network-vif-plugged", "status": "completed", "tag": "1c1dab24-dca0-4119-a5fb-371d8a7bfaa0"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:47:17.098664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-fba393ac-4483-4963-a729-fb3af97a26ef req-1eebfa63-5b5d-4bab-8410-97ab12b91ea4 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:17.099426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-fba393ac-4483-4963-a729-fb3af97a26ef req-1eebfa63-5b5d-4bab-8410-97ab12b91ea4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:17.102000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-fba393ac-4483-4963-a729-fb3af97a26ef req-1eebfa63-5b5d-4bab-8410-97ab12b91ea4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:17.147630 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-fba393ac-4483-4963-a729-fb3af97a26ef req-1eebfa63-5b5d-4bab-8410-97ab12b91ea4 service nova] Creating event network-vif-plugged:1c1dab24-dca0-4119-a5fb-371d8a7bfaa0 for instance 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 on n-h2-860864-2 Oct 10 23:47:17.152941 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-fba393ac-4483-4963-a729-fb3af97a26ef req-1eebfa63-5b5d-4bab-8410-97ab12b91ea4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096311 Oct 10 23:47:17.156496 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2896/5613] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:47:17.159396 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-071a747d-b74b-4351-a283-94c6e2dbc172 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "DELETE /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1" status: 204 len: 0 microversion: 2.1 time: 0.337911 Oct 10 23:47:17.160383 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2718/5614] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:47:16 2022] DELETE /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:47:17.181082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-06fe57ba-9cce-4136-9ead-f43509c798f0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:17.182587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-06fe57ba-9cce-4136-9ead-f43509c798f0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:17.203553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06fe57ba-9cce-4136-9ead-f43509c798f0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:17.204071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06fe57ba-9cce-4136-9ead-f43509c798f0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:17.204524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06fe57ba-9cce-4136-9ead-f43509c798f0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:17.205249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06fe57ba-9cce-4136-9ead-f43509c798f0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:17.205892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06fe57ba-9cce-4136-9ead-f43509c798f0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:17.206340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06fe57ba-9cce-4136-9ead-f43509c798f0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:17.551373 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-06fe57ba-9cce-4136-9ead-f43509c798f0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:17.562814 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-06fe57ba-9cce-4136-9ead-f43509c798f0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1" status: 200 len: 1495 microversion: 2.1 time: 0.396440 Oct 10 23:47:17.563542 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2897/5615] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:17 2022] GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 => generated 1495 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:18.061277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-031def8d-28eb-4bb7-a60c-52eafd22b0f5 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:18.062261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-031def8d-28eb-4bb7-a60c-52eafd22b0f5 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] [instance: 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:18.105635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-031def8d-28eb-4bb7-a60c-52eafd22b0f5 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:18.106547 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-031def8d-28eb-4bb7-a60c-52eafd22b0f5 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:18.107406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-031def8d-28eb-4bb7-a60c-52eafd22b0f5 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:18.109521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-031def8d-28eb-4bb7-a60c-52eafd22b0f5 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:18.110751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-031def8d-28eb-4bb7-a60c-52eafd22b0f5 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:18.112808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-031def8d-28eb-4bb7-a60c-52eafd22b0f5 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:18.604046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6a676c1f-fccc-4c4f-befc-0a09c6c34b9d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:18.605298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6a676c1f-fccc-4c4f-befc-0a09c6c34b9d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:18.615468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a676c1f-fccc-4c4f-befc-0a09c6c34b9d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:18.616728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a676c1f-fccc-4c4f-befc-0a09c6c34b9d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:18.617358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a676c1f-fccc-4c4f-befc-0a09c6c34b9d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:18.618333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a676c1f-fccc-4c4f-befc-0a09c6c34b9d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:18.619001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a676c1f-fccc-4c4f-befc-0a09c6c34b9d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:18.619643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a676c1f-fccc-4c4f-befc-0a09c6c34b9d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:18.890500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6a676c1f-fccc-4c4f-befc-0a09c6c34b9d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:18.912199 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6a676c1f-fccc-4c4f-befc-0a09c6c34b9d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1" status: 200 len: 1495 microversion: 2.1 time: 0.312347 Oct 10 23:47:18.916851 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2898/5616] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:18 2022] GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 => generated 1495 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:19.096313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-031def8d-28eb-4bb7-a60c-52eafd22b0f5 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e17bf85d944159bf8911236edb561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628f74afd564479e90696761249b95cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:19.131309 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-031def8d-28eb-4bb7-a60c-52eafd22b0f5 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8" status: 200 len: 1325 microversion: 2.1 time: 1.075280 Oct 10 23:47:19.133139 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2719/5617] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:18 2022] GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 => generated 1325 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:19.724050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e93640ad-d7fd-4125-960f-78b1ec1e361f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:19.724727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e93640ad-d7fd-4125-960f-78b1ec1e361f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 8cb3edd4-435b-4619-afbf-86eebf0b1824] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:19.739419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e93640ad-d7fd-4125-960f-78b1ec1e361f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:19.739918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e93640ad-d7fd-4125-960f-78b1ec1e361f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:19.740364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e93640ad-d7fd-4125-960f-78b1ec1e361f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:19.741085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e93640ad-d7fd-4125-960f-78b1ec1e361f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:19.741576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e93640ad-d7fd-4125-960f-78b1ec1e361f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:19.742009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e93640ad-d7fd-4125-960f-78b1ec1e361f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:19.848425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e93640ad-d7fd-4125-960f-78b1ec1e361f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 8cb3edd4-435b-4619-afbf-86eebf0b1824] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:47:20.088061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-67c1f436-c29d-4165-8e9a-e50e3995c9dc req-d2180134-969a-4ad6-b4fe-784398799fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "326d64f9-9e2e-4efc-bd5a-113fa0a467f1", "name": "network-vif-deleted", "tag": "6f201f82-7dc0-46bc-bf67-5c180c92ba48"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:47:20.114106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-67c1f436-c29d-4165-8e9a-e50e3995c9dc req-d2180134-969a-4ad6-b4fe-784398799fe4 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:20.114857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-67c1f436-c29d-4165-8e9a-e50e3995c9dc req-d2180134-969a-4ad6-b4fe-784398799fe4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:20.115489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-67c1f436-c29d-4165-8e9a-e50e3995c9dc req-d2180134-969a-4ad6-b4fe-784398799fe4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:20.126788 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e93640ad-d7fd-4125-960f-78b1ec1e361f tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824" status: 204 len: 0 microversion: 2.1 time: 0.406467 Oct 10 23:47:20.128496 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2720/5618] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:47:19 2022] DELETE /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 23:47:20.134972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-edd29a94-1299-437c-882b-1b3848582de3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:20.135998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-edd29a94-1299-437c-882b-1b3848582de3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:20.138504 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-67c1f436-c29d-4165-8e9a-e50e3995c9dc req-d2180134-969a-4ad6-b4fe-784398799fe4 service nova] Creating event network-vif-deleted:6f201f82-7dc0-46bc-bf67-5c180c92ba48 for instance 326d64f9-9e2e-4efc-bd5a-113fa0a467f1 on n-h1-860864-2 Oct 10 23:47:20.143208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-edd29a94-1299-437c-882b-1b3848582de3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:20.143988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-edd29a94-1299-437c-882b-1b3848582de3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:20.144157 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-67c1f436-c29d-4165-8e9a-e50e3995c9dc req-d2180134-969a-4ad6-b4fe-784398799fe4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.432858 Oct 10 23:47:20.144672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-edd29a94-1299-437c-882b-1b3848582de3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:20.145333 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2899/5619] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:47:20.145881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-edd29a94-1299-437c-882b-1b3848582de3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:20.146611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-edd29a94-1299-437c-882b-1b3848582de3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:20.147761 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-edd29a94-1299-437c-882b-1b3848582de3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:20.152753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a2bb0c15-eb8a-4749-97d9-fadcd5ed2ca2 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:20.152970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a2bb0c15-eb8a-4749-97d9-fadcd5ed2ca2 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 8cb3edd4-435b-4619-afbf-86eebf0b1824] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:20.162311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2bb0c15-eb8a-4749-97d9-fadcd5ed2ca2 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:20.162836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2bb0c15-eb8a-4749-97d9-fadcd5ed2ca2 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:20.163389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2bb0c15-eb8a-4749-97d9-fadcd5ed2ca2 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:20.164226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2bb0c15-eb8a-4749-97d9-fadcd5ed2ca2 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:20.164699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2bb0c15-eb8a-4749-97d9-fadcd5ed2ca2 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:20.165155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2bb0c15-eb8a-4749-97d9-fadcd5ed2ca2 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:20.204050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-edd29a94-1299-437c-882b-1b3848582de3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:20.204050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-edd29a94-1299-437c-882b-1b3848582de3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:20.204490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-edd29a94-1299-437c-882b-1b3848582de3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:20.204738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-edd29a94-1299-437c-882b-1b3848582de3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lazy-loading 'fault' on Instance uuid 326d64f9-9e2e-4efc-bd5a-113fa0a467f1 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:47:20.353859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-edd29a94-1299-437c-882b-1b3848582de3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:20.362690 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-edd29a94-1299-437c-882b-1b3848582de3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1" status: 200 len: 1298 microversion: 2.1 time: 0.232538 Oct 10 23:47:20.375636 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2721/5620] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:20 2022] GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 => generated 1298 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:20.381152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-af9ea7c7-4f78-4c49-8307-f18724d7e06a tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:20.381829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-af9ea7c7-4f78-4c49-8307-f18724d7e06a tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] [instance: 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:20.384306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a2bb0c15-eb8a-4749-97d9-fadcd5ed2ca2 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:20.391786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af9ea7c7-4f78-4c49-8307-f18724d7e06a tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:20.397649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af9ea7c7-4f78-4c49-8307-f18724d7e06a tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:20.398289 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a2bb0c15-eb8a-4749-97d9-fadcd5ed2ca2 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824" status: 200 len: 1514 microversion: 2.1 time: 0.250983 Oct 10 23:47:20.398486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af9ea7c7-4f78-4c49-8307-f18724d7e06a tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:20.399202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af9ea7c7-4f78-4c49-8307-f18724d7e06a tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:20.399679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af9ea7c7-4f78-4c49-8307-f18724d7e06a tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:20.400114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af9ea7c7-4f78-4c49-8307-f18724d7e06a tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:20.401289 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2900/5621] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:20 2022] GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824 => generated 1514 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:20.962205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-af9ea7c7-4f78-4c49-8307-f18724d7e06a tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e17bf85d944159bf8911236edb561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628f74afd564479e90696761249b95cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:20.973077 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-af9ea7c7-4f78-4c49-8307-f18724d7e06a tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8" status: 200 len: 1522 microversion: 2.1 time: 0.596239 Oct 10 23:47:20.973985 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2722/5622] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:20 2022] GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 => generated 1522 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:21.013577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dc1fe992-b1be-44eb-bd0f-a5f41ab0a777 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:21.014781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dc1fe992-b1be-44eb-bd0f-a5f41ab0a777 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] [instance: 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:21.022509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc1fe992-b1be-44eb-bd0f-a5f41ab0a777 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:21.023115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc1fe992-b1be-44eb-bd0f-a5f41ab0a777 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:21.023636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc1fe992-b1be-44eb-bd0f-a5f41ab0a777 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:21.025174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc1fe992-b1be-44eb-bd0f-a5f41ab0a777 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:21.025753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc1fe992-b1be-44eb-bd0f-a5f41ab0a777 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:21.026481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc1fe992-b1be-44eb-bd0f-a5f41ab0a777 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:21.058449 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-dc1fe992-b1be-44eb-bd0f-a5f41ab0a777 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] HTTP exception thrown: Instance is not a member of specified network Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dc1fe992-b1be-44eb-bd0f-a5f41ab0a777 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Request method failure captured: Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8/ips/invalid HTTP/1.1 Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK7xFid9erB0uHXq9dloSbkEq6ZJ3AMtHdLs9zgsURmDlyyd8O5v50QisMo5knXdNwZFjGBG7QZWgRfmk4bzrNRFs1sQvVCKEFc2Q5vS0FUO8fCq4e-U38aPrhVBoAPNf_yDSSHmvxLoaCYL_RTM5WwFdwv9ZzNQhqORtxVTlz0tLuI Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 628f74afd564479e90696761249b95cd Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-196892644 Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/628f74afd564479e90696761249b95cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/628f74afd564479e90696761249b95cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/628f74afd564479e90696761249b95cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_628f74afd564479e90696761249b95cd", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-196892644 Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 628f74afd564479e90696761249b95cd Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-196892644 Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerAddressesNegativeTestJSON-196892644-project Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 871e17bf85d944159bf8911236edb561 Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-196892644-project Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance is not a member of specified network Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'server_id': '5c902fab-3bc3-4d50-a5b1-4f1ed67790c8', 'id': 'invalid'} Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 10 23:47:21.063242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:47:21.066406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dc1fe992-b1be-44eb-bd0f-a5f41ab0a777 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:47:21.066406 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dc1fe992-b1be-44eb-bd0f-a5f41ab0a777 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.055737 Oct 10 23:47:21.066406 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2901/5623] 10.222.0.23 () {58 vars in 1272 bytes} [Mon Oct 10 23:47:21 2022] GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8/ips/invalid => generated 91 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 10 23:47:21.077401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-019061e8-0fb0-455d-97dd-7dfed05b7bf7 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:21.078300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-019061e8-0fb0-455d-97dd-7dfed05b7bf7 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Failed to fetch instance by id 999 {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 10 23:47:21.079012 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-019061e8-0fb0-455d-97dd-7dfed05b7bf7 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] HTTP exception thrown: Instance 999 could not be found. Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-019061e8-0fb0-455d-97dd-7dfed05b7bf7 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Request method failure captured: Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK7xFid9erB0uHXq9dloSbkEq6ZJ3AMtHdLs9zgsURmDlyyd8O5v50QisMo5knXdNwZFjGBG7QZWgRfmk4bzrNRFs1sQvVCKEFc2Q5vS0FUO8fCq4e-U38aPrhVBoAPNf_yDSSHmvxLoaCYL_RTM5WwFdwv9ZzNQhqORtxVTlz0tLuI Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 628f74afd564479e90696761249b95cd Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-196892644 Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/628f74afd564479e90696761249b95cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/628f74afd564479e90696761249b95cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/628f74afd564479e90696761249b95cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_628f74afd564479e90696761249b95cd", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-196892644 Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 628f74afd564479e90696761249b95cd Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-196892644 Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerAddressesNegativeTestJSON-196892644-project Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 871e17bf85d944159bf8911236edb561 Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-196892644-project Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 999 could not be found. Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'server_id': '999'} Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 10 23:47:21.080998 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:21.089045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-019061e8-0fb0-455d-97dd-7dfed05b7bf7 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:47:21.089045 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-019061e8-0fb0-455d-97dd-7dfed05b7bf7 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] 10.222.0.23 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.010252 Oct 10 23:47:21.089045 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2723/5624] 10.222.0.23 () {58 vars in 1149 bytes} [Mon Oct 10 23:47:21 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 23:47:21.097686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-28853ae1-eb89-40a7-8e6a-76f8664aafe0 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:21.098493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-28853ae1-eb89-40a7-8e6a-76f8664aafe0 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] [instance: 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:21.106160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28853ae1-eb89-40a7-8e6a-76f8664aafe0 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:21.106663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28853ae1-eb89-40a7-8e6a-76f8664aafe0 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:21.107110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28853ae1-eb89-40a7-8e6a-76f8664aafe0 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:21.111041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28853ae1-eb89-40a7-8e6a-76f8664aafe0 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:21.111575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28853ae1-eb89-40a7-8e6a-76f8664aafe0 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:21.112214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28853ae1-eb89-40a7-8e6a-76f8664aafe0 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:21.147238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-28853ae1-eb89-40a7-8e6a-76f8664aafe0 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] [instance: 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:47:21.280665 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-28853ae1-eb89-40a7-8e6a-76f8664aafe0 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8" status: 204 len: 0 microversion: 2.1 time: 0.188673 Oct 10 23:47:21.281644 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2902/5625] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:47:21 2022] DELETE /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:47:21.291084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ab9562cf-30eb-4e88-942e-e1fc6128d6d2 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:21.291890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ab9562cf-30eb-4e88-942e-e1fc6128d6d2 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] [instance: 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:21.300551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab9562cf-30eb-4e88-942e-e1fc6128d6d2 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:21.301362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab9562cf-30eb-4e88-942e-e1fc6128d6d2 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:21.302153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab9562cf-30eb-4e88-942e-e1fc6128d6d2 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:21.303118 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab9562cf-30eb-4e88-942e-e1fc6128d6d2 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:21.303787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab9562cf-30eb-4e88-942e-e1fc6128d6d2 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:21.304423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab9562cf-30eb-4e88-942e-e1fc6128d6d2 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:21.388202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-63264d74-4436-470c-b2e5-b1f8de111e96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:21.388915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-63264d74-4436-470c-b2e5-b1f8de111e96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:21.396721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63264d74-4436-470c-b2e5-b1f8de111e96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:21.397231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63264d74-4436-470c-b2e5-b1f8de111e96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:21.397704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63264d74-4436-470c-b2e5-b1f8de111e96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:21.398433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63264d74-4436-470c-b2e5-b1f8de111e96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:21.398900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63264d74-4436-470c-b2e5-b1f8de111e96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:21.399340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-63264d74-4436-470c-b2e5-b1f8de111e96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:21.420800 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-63264d74-4436-470c-b2e5-b1f8de111e96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] HTTP exception thrown: Instance 326d64f9-9e2e-4efc-bd5a-113fa0a467f1 could not be found. Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-63264d74-4436-470c-b2e5-b1f8de111e96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Request method failure captured: Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 HTTP/1.1 Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK5cQzq5PmBN8ZK8xufnInf_nKzozFybG60EPi2LKIagIuIo6wmjCjt_dEi9KoG421lgq7o9GXzxCjj26_PYoj0IVUx4iuPxFYRw_bINPtYf7R0sv0LrnaNDyTyma9wRBMptURK1MlutQq_man6Zj75t-cnvbQ_0wIRWAQ7WKgqvlIM Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fcc4d45337140259bcd5b64b17aa7b5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersTestJSON-1882347849 Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersTestJSON-1882347849-project Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: daf7a1ddba654265a5e732363c85eefa Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersTestJSON-1882347849-project Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 326d64f9-9e2e-4efc-bd5a-113fa0a467f1 could not be found. Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '326d64f9-9e2e-4efc-bd5a-113fa0a467f1'} Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 326d64f9-9e2e-4efc-bd5a-113fa0a467f1 could not be found. Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 326d64f9-9e2e-4efc-bd5a-113fa0a467f1 could not be found. Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:47:21.423280 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:47:21.428185 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:47:21.428185 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:47:21.428185 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:47:21.428185 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:47:21.428185 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:47:21.428185 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 326d64f9-9e2e-4efc-bd5a-113fa0a467f1 could not be found. Oct 10 23:47:21.428185 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:47:21.428185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-63264d74-4436-470c-b2e5-b1f8de111e96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Returning 404 to user: Instance 326d64f9-9e2e-4efc-bd5a-113fa0a467f1 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:47:21.428185 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-63264d74-4436-470c-b2e5-b1f8de111e96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1" status: 404 len: 111 microversion: 2.1 time: 0.041292 Oct 10 23:47:21.428185 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2903/5626] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:21 2022] GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:47:21.430667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cd85c533-ae77-45a1-8ade-a4f00a8d2a29 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:21.431332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cd85c533-ae77-45a1-8ade-a4f00a8d2a29 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 8cb3edd4-435b-4619-afbf-86eebf0b1824] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:21.439015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd85c533-ae77-45a1-8ade-a4f00a8d2a29 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:21.439531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd85c533-ae77-45a1-8ade-a4f00a8d2a29 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:21.439995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd85c533-ae77-45a1-8ade-a4f00a8d2a29 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:21.440734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd85c533-ae77-45a1-8ade-a4f00a8d2a29 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:21.441197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd85c533-ae77-45a1-8ade-a4f00a8d2a29 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:21.441742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd85c533-ae77-45a1-8ade-a4f00a8d2a29 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:21.554559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ab9562cf-30eb-4e88-942e-e1fc6128d6d2 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e17bf85d944159bf8911236edb561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628f74afd564479e90696761249b95cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:21.561664 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ab9562cf-30eb-4e88-942e-e1fc6128d6d2 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8" status: 200 len: 1528 microversion: 2.1 time: 0.275413 Oct 10 23:47:21.562860 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2724/5627] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:21 2022] GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 => generated 1528 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:47:21.584403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0bfa9bd1-4e9b-4a8a-8def-68e5ae340b42 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:21.585076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0bfa9bd1-4e9b-4a8a-8def-68e5ae340b42 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:21.593333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0bfa9bd1-4e9b-4a8a-8def-68e5ae340b42 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:21.594432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0bfa9bd1-4e9b-4a8a-8def-68e5ae340b42 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:21.594967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0bfa9bd1-4e9b-4a8a-8def-68e5ae340b42 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:21.595786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0bfa9bd1-4e9b-4a8a-8def-68e5ae340b42 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:21.596305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0bfa9bd1-4e9b-4a8a-8def-68e5ae340b42 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:21.596968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0bfa9bd1-4e9b-4a8a-8def-68e5ae340b42 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:21.626403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0bfa9bd1-4e9b-4a8a-8def-68e5ae340b42 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:47:21.736336 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0bfa9bd1-4e9b-4a8a-8def-68e5ae340b42 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "DELETE /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722" status: 204 len: 0 microversion: 2.1 time: 0.170910 Oct 10 23:47:21.736633 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2725/5628] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:47:21 2022] DELETE /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:47:21.746515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d26b173a-dede-4f4c-9f40-6e2c4beb1495 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:21.747262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d26b173a-dede-4f4c-9f40-6e2c4beb1495 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:21.754371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d26b173a-dede-4f4c-9f40-6e2c4beb1495 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:21.754870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d26b173a-dede-4f4c-9f40-6e2c4beb1495 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:21.755432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d26b173a-dede-4f4c-9f40-6e2c4beb1495 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:21.756149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d26b173a-dede-4f4c-9f40-6e2c4beb1495 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:21.756600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d26b173a-dede-4f4c-9f40-6e2c4beb1495 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:21.757226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d26b173a-dede-4f4c-9f40-6e2c4beb1495 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:21.915317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cd85c533-ae77-45a1-8ade-a4f00a8d2a29 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:21.930369 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cd85c533-ae77-45a1-8ade-a4f00a8d2a29 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824" status: 200 len: 1514 microversion: 2.1 time: 0.503765 Oct 10 23:47:21.931414 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2904/5629] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:21 2022] GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824 => generated 1514 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:22.011027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d26b173a-dede-4f4c-9f40-6e2c4beb1495 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:22.020076 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d26b173a-dede-4f4c-9f40-6e2c4beb1495 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722" status: 200 len: 1496 microversion: 2.1 time: 0.277871 Oct 10 23:47:22.020864 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2726/5630] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:21 2022] GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 => generated 1496 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:22.598679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b018fb9b-9d3d-4377-adbf-2a3a25042a3b tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:22.610492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b018fb9b-9d3d-4377-adbf-2a3a25042a3b tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] [instance: 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:22.624648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:47:22.645909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b018fb9b-9d3d-4377-adbf-2a3a25042a3b tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:22.647128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b018fb9b-9d3d-4377-adbf-2a3a25042a3b tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:22.648260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b018fb9b-9d3d-4377-adbf-2a3a25042a3b tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:22.650108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b018fb9b-9d3d-4377-adbf-2a3a25042a3b tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:22.651156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b018fb9b-9d3d-4377-adbf-2a3a25042a3b tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:22.652165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b018fb9b-9d3d-4377-adbf-2a3a25042a3b tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:22.708967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:47:22.974966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b018fb9b-9d3d-4377-adbf-2a3a25042a3b tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e17bf85d944159bf8911236edb561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628f74afd564479e90696761249b95cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:22.991788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-396b3771-b29c-4d24-8009-c0f627f80262 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:23.002181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-396b3771-b29c-4d24-8009-c0f627f80262 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 8cb3edd4-435b-4619-afbf-86eebf0b1824] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:23.023272 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b018fb9b-9d3d-4377-adbf-2a3a25042a3b tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8" status: 200 len: 1528 microversion: 2.1 time: 0.437459 Oct 10 23:47:23.023911 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2905/5631] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:22 2022] GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 => generated 1528 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:23.024511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-396b3771-b29c-4d24-8009-c0f627f80262 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:23.025184 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-396b3771-b29c-4d24-8009-c0f627f80262 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:23.030507 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-396b3771-b29c-4d24-8009-c0f627f80262 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:23.031536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-396b3771-b29c-4d24-8009-c0f627f80262 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:23.032177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-396b3771-b29c-4d24-8009-c0f627f80262 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:23.032758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-396b3771-b29c-4d24-8009-c0f627f80262 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:23.049917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:47:23.054227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-099141ce-0564-499a-9af2-918b2a52a1ef tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:23.058090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-099141ce-0564-499a-9af2-918b2a52a1ef tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:23.072757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-099141ce-0564-499a-9af2-918b2a52a1ef tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:23.075246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-099141ce-0564-499a-9af2-918b2a52a1ef tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:23.075756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-099141ce-0564-499a-9af2-918b2a52a1ef tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:23.076626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-099141ce-0564-499a-9af2-918b2a52a1ef tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:23.077109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-099141ce-0564-499a-9af2-918b2a52a1ef tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:23.082025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-099141ce-0564-499a-9af2-918b2a52a1ef tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:23.499331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-099141ce-0564-499a-9af2-918b2a52a1ef tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:23.513222 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-099141ce-0564-499a-9af2-918b2a52a1ef tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722" status: 200 len: 1496 microversion: 2.1 time: 0.471328 Oct 10 23:47:23.513445 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2906/5632] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:23 2022] GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 => generated 1496 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:23.575508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-396b3771-b29c-4d24-8009-c0f627f80262 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:23.612309 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-396b3771-b29c-4d24-8009-c0f627f80262 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824" status: 200 len: 1514 microversion: 2.1 time: 0.654039 Oct 10 23:47:23.626344 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2727/5633] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:22 2022] GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824 => generated 1514 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:24.061841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-53c3bba8-6792-4e48-b5ba-7541a0736f60 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:24.063422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-53c3bba8-6792-4e48-b5ba-7541a0736f60 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] [instance: 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:24.073723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53c3bba8-6792-4e48-b5ba-7541a0736f60 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:24.074996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53c3bba8-6792-4e48-b5ba-7541a0736f60 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:24.076924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53c3bba8-6792-4e48-b5ba-7541a0736f60 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:24.081235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53c3bba8-6792-4e48-b5ba-7541a0736f60 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:24.084877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53c3bba8-6792-4e48-b5ba-7541a0736f60 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:24.085639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53c3bba8-6792-4e48-b5ba-7541a0736f60 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:24.174922 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-3f20a9b3-bb99-493e-807c-a9df19dbef66 req-46d1c8be-c4a9-427f-91e7-5bbe29487efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c902fab-3bc3-4d50-a5b1-4f1ed67790c8", "name": "network-vif-deleted", "tag": "1c1dab24-dca0-4119-a5fb-371d8a7bfaa0"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:47:24.199648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3f20a9b3-bb99-493e-807c-a9df19dbef66 req-46d1c8be-c4a9-427f-91e7-5bbe29487efe service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:24.200832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3f20a9b3-bb99-493e-807c-a9df19dbef66 req-46d1c8be-c4a9-427f-91e7-5bbe29487efe service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:24.202634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3f20a9b3-bb99-493e-807c-a9df19dbef66 req-46d1c8be-c4a9-427f-91e7-5bbe29487efe service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:24.244272 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-3f20a9b3-bb99-493e-807c-a9df19dbef66 req-46d1c8be-c4a9-427f-91e7-5bbe29487efe service nova] Creating event network-vif-deleted:1c1dab24-dca0-4119-a5fb-371d8a7bfaa0 for instance 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 on n-h2-860864-2 Oct 10 23:47:24.263489 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-3f20a9b3-bb99-493e-807c-a9df19dbef66 req-46d1c8be-c4a9-427f-91e7-5bbe29487efe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091106 Oct 10 23:47:24.267149 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2728/5634] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:47:24.354539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-52cb780b-9dcf-4ca6-8f37-d3db75d66e7f req-b773ce04-d15b-4517-b834-ed00de5e7e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cb3edd4-435b-4619-afbf-86eebf0b1824", "name": "network-vif-deleted", "tag": "1d94aaa6-68c1-4f42-8419-400db5ecc9a0"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:47:24.384398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-52cb780b-9dcf-4ca6-8f37-d3db75d66e7f req-b773ce04-d15b-4517-b834-ed00de5e7e75 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:24.389730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-52cb780b-9dcf-4ca6-8f37-d3db75d66e7f req-b773ce04-d15b-4517-b834-ed00de5e7e75 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:24.390467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-52cb780b-9dcf-4ca6-8f37-d3db75d66e7f req-b773ce04-d15b-4517-b834-ed00de5e7e75 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:24.430011 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-52cb780b-9dcf-4ca6-8f37-d3db75d66e7f req-b773ce04-d15b-4517-b834-ed00de5e7e75 service nova] Creating event network-vif-deleted:1d94aaa6-68c1-4f42-8419-400db5ecc9a0 for instance 8cb3edd4-435b-4619-afbf-86eebf0b1824 on n-h2-860864-2 Oct 10 23:47:24.448751 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-52cb780b-9dcf-4ca6-8f37-d3db75d66e7f req-b773ce04-d15b-4517-b834-ed00de5e7e75 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104147 Oct 10 23:47:24.458185 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2729/5635] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:47:24.539623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-50432557-c058-42cf-aa72-12ec8ac76164 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:24.540433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-50432557-c058-42cf-aa72-12ec8ac76164 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:24.558480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50432557-c058-42cf-aa72-12ec8ac76164 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:24.559304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50432557-c058-42cf-aa72-12ec8ac76164 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:24.559767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50432557-c058-42cf-aa72-12ec8ac76164 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:24.562481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50432557-c058-42cf-aa72-12ec8ac76164 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:24.563240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50432557-c058-42cf-aa72-12ec8ac76164 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:24.563677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50432557-c058-42cf-aa72-12ec8ac76164 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:24.653846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-53c3bba8-6792-4e48-b5ba-7541a0736f60 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871e17bf85d944159bf8911236edb561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628f74afd564479e90696761249b95cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:24.691400 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-53c3bba8-6792-4e48-b5ba-7541a0736f60 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8" status: 200 len: 1486 microversion: 2.1 time: 0.633722 Oct 10 23:47:24.695850 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2907/5636] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:24 2022] GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 => generated 1486 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:24.741731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e8820bfa-16dd-4b16-919f-93220c77a5a6 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:24.743717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e8820bfa-16dd-4b16-919f-93220c77a5a6 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 8cb3edd4-435b-4619-afbf-86eebf0b1824] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:24.770946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8820bfa-16dd-4b16-919f-93220c77a5a6 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:24.772399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8820bfa-16dd-4b16-919f-93220c77a5a6 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:24.778136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8820bfa-16dd-4b16-919f-93220c77a5a6 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:24.785540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8820bfa-16dd-4b16-919f-93220c77a5a6 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:24.785540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8820bfa-16dd-4b16-919f-93220c77a5a6 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:24.785540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8820bfa-16dd-4b16-919f-93220c77a5a6 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:24.833226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-50432557-c058-42cf-aa72-12ec8ac76164 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:24.855660 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-50432557-c058-42cf-aa72-12ec8ac76164 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722" status: 200 len: 1454 microversion: 2.1 time: 0.320739 Oct 10 23:47:24.861536 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2730/5637] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:24 2022] GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 => generated 1454 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:24.913162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8820bfa-16dd-4b16-919f-93220c77a5a6 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:24.913990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8820bfa-16dd-4b16-919f-93220c77a5a6 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:24.914858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8820bfa-16dd-4b16-919f-93220c77a5a6 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:24.915705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-e8820bfa-16dd-4b16-919f-93220c77a5a6 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lazy-loading 'fault' on Instance uuid 8cb3edd4-435b-4619-afbf-86eebf0b1824 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:47:24.989944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e8820bfa-16dd-4b16-919f-93220c77a5a6 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:25.015520 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e8820bfa-16dd-4b16-919f-93220c77a5a6 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824" status: 200 len: 1309 microversion: 2.1 time: 0.311478 Oct 10 23:47:25.020883 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2908/5638] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:24 2022] GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824 => generated 1309 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:25.719618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8a922359-d6de-4f72-98b3-b403c7541959 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:25.720925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8a922359-d6de-4f72-98b3-b403c7541959 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] [instance: 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:25.729515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a922359-d6de-4f72-98b3-b403c7541959 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:25.730664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a922359-d6de-4f72-98b3-b403c7541959 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:25.731274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a922359-d6de-4f72-98b3-b403c7541959 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:25.732155 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a922359-d6de-4f72-98b3-b403c7541959 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:25.733300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a922359-d6de-4f72-98b3-b403c7541959 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:25.733974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a922359-d6de-4f72-98b3-b403c7541959 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:25.758684 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-8a922359-d6de-4f72-98b3-b403c7541959 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] HTTP exception thrown: Instance 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 could not be found. Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8a922359-d6de-4f72-98b3-b403c7541959 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Request method failure captured: Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 HTTP/1.1 Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK7xFid9erB0uHXq9dloSbkEq6ZJ3AMtHdLs9zgsURmDlyyd8O5v50QisMo5knXdNwZFjGBG7QZWgRfmk4bzrNRFs1sQvVCKEFc2Q5vS0FUO8fCq4e-U38aPrhVBoAPNf_yDSSHmvxLoaCYL_RTM5WwFdwv9ZzNQhqORtxVTlz0tLuI Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 628f74afd564479e90696761249b95cd Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-196892644 Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/628f74afd564479e90696761249b95cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/628f74afd564479e90696761249b95cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/628f74afd564479e90696761249b95cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_628f74afd564479e90696761249b95cd", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-196892644 Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 628f74afd564479e90696761249b95cd Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-196892644 Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerAddressesNegativeTestJSON-196892644-project Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 871e17bf85d944159bf8911236edb561 Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-196892644-project Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 could not be found. Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '5c902fab-3bc3-4d50-a5b1-4f1ed67790c8'} Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 could not be found. Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 could not be found. Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:25.760708 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:47:25.766189 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:25.766189 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:47:25.766189 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:47:25.766189 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:47:25.766189 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:47:25.766189 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:47:25.766189 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 could not be found. Oct 10 23:47:25.766189 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:25.766189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8a922359-d6de-4f72-98b3-b403c7541959 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] Returning 404 to user: Instance 5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:47:25.766189 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8a922359-d6de-4f72-98b3-b403c7541959 tempest-ServerAddressesNegativeTestJSON-196892644 tempest-ServerAddressesNegativeTestJSON-196892644-project] 10.222.0.23 "GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8" status: 404 len: 111 microversion: 2.1 time: 0.048126 Oct 10 23:47:25.766189 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2731/5639] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:25 2022] GET /compute/v2.1/servers/5c902fab-3bc3-4d50-a5b1-4f1ed67790c8 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:47:25.907097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f3b6fe63-a06a-4850-97e8-432423b278de tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:25.909370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f3b6fe63-a06a-4850-97e8-432423b278de tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:25.939075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3b6fe63-a06a-4850-97e8-432423b278de tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:25.939591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3b6fe63-a06a-4850-97e8-432423b278de tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:25.940047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3b6fe63-a06a-4850-97e8-432423b278de tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:25.948001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3b6fe63-a06a-4850-97e8-432423b278de tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:25.948574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3b6fe63-a06a-4850-97e8-432423b278de tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:25.949081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3b6fe63-a06a-4850-97e8-432423b278de tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:25.985559 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-f3b6fe63-a06a-4850-97e8-432423b278de tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] HTTP exception thrown: Instance 894b12cd-a36c-4884-88a1-1c223cceb722 could not be found. Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f3b6fe63-a06a-4850-97e8-432423b278de tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Request method failure captured: Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 HTTP/1.1 Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK5cQzq5PmBN8ZK8xufnInf_nKzozFybG60EPi2LKIagIuIo6wmjCjt_dEi9KoG421lgq7o9GXzxCjj26_PYoj0IVUx4iuPxFYRw_bINPtYf7R0sv0LrnaNDyTyma9wRBMptURK1MlutQq_man6Zj75t-cnvbQ_0wIRWAQ7WKgqvlIM Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fcc4d45337140259bcd5b64b17aa7b5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersTestJSON-1882347849 Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersTestJSON-1882347849-project Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: daf7a1ddba654265a5e732363c85eefa Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersTestJSON-1882347849-project Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 894b12cd-a36c-4884-88a1-1c223cceb722 could not be found. Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '894b12cd-a36c-4884-88a1-1c223cceb722'} Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 894b12cd-a36c-4884-88a1-1c223cceb722 could not be found. Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 894b12cd-a36c-4884-88a1-1c223cceb722 could not be found. Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:47:25.988381 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:47:25.992612 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:47:25.992612 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:47:25.992612 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:47:25.992612 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:47:25.992612 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:47:25.992612 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 894b12cd-a36c-4884-88a1-1c223cceb722 could not be found. Oct 10 23:47:25.992612 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:47:25.999326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f3b6fe63-a06a-4850-97e8-432423b278de tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Returning 404 to user: Instance 894b12cd-a36c-4884-88a1-1c223cceb722 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:47:26.000578 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f3b6fe63-a06a-4850-97e8-432423b278de tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722" status: 404 len: 111 microversion: 2.1 time: 0.100266 Oct 10 23:47:26.005135 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2909/5640] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:25 2022] GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:47:26.049416 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-556abf0a-1647-4f40-80b3-225f8b70ad33 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:26.050061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-556abf0a-1647-4f40-80b3-225f8b70ad33 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 8cb3edd4-435b-4619-afbf-86eebf0b1824] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:26.064860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-556abf0a-1647-4f40-80b3-225f8b70ad33 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:26.070211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-556abf0a-1647-4f40-80b3-225f8b70ad33 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:26.070761 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-556abf0a-1647-4f40-80b3-225f8b70ad33 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:26.073097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-556abf0a-1647-4f40-80b3-225f8b70ad33 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:26.075218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-556abf0a-1647-4f40-80b3-225f8b70ad33 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:26.075684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-556abf0a-1647-4f40-80b3-225f8b70ad33 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:26.187166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1b055e98-b0dd-4aad-b950-3e871b5e990c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1473275261", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "abcacee0-1319-4318-8900-2ff15d7780f9"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:47:26.188787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-556abf0a-1647-4f40-80b3-225f8b70ad33 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:26.189348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-556abf0a-1647-4f40-80b3-225f8b70ad33 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:26.189837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-556abf0a-1647-4f40-80b3-225f8b70ad33 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:26.190370 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-556abf0a-1647-4f40-80b3-225f8b70ad33 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lazy-loading 'fault' on Instance uuid 8cb3edd4-435b-4619-afbf-86eebf0b1824 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:47:26.272745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-1b055e98-b0dd-4aad-b950-3e871b5e990c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] validate_networks() for [('abcacee0-1319-4318-8900-2ff15d7780f9', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:47:26.309529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-556abf0a-1647-4f40-80b3-225f8b70ad33 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613b3445bde4bd6b8a350f594458490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a087b5d73d9240e3b5330975a2b39ea0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:26.324363 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-556abf0a-1647-4f40-80b3-225f8b70ad33 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824" status: 200 len: 1309 microversion: 2.1 time: 0.278837 Oct 10 23:47:26.342693 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2732/5641] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:26 2022] GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824 => generated 1309 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:26.425785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-7ff79f39-84d5-46d1-9df0-ffb8b070fd3c req-79d960fe-c74f-4632-b8ff-ddcb67271fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "894b12cd-a36c-4884-88a1-1c223cceb722", "name": "network-vif-deleted", "tag": "a3013fc3-7008-43ce-a6fd-be3bf12ae4f5"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:47:26.442305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7ff79f39-84d5-46d1-9df0-ffb8b070fd3c req-79d960fe-c74f-4632-b8ff-ddcb67271fee service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:26.445671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7ff79f39-84d5-46d1-9df0-ffb8b070fd3c req-79d960fe-c74f-4632-b8ff-ddcb67271fee service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:26.446377 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-7ff79f39-84d5-46d1-9df0-ffb8b070fd3c req-79d960fe-c74f-4632-b8ff-ddcb67271fee service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:26.476592 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-7ff79f39-84d5-46d1-9df0-ffb8b070fd3c req-79d960fe-c74f-4632-b8ff-ddcb67271fee service nova] Creating event network-vif-deleted:a3013fc3-7008-43ce-a6fd-be3bf12ae4f5 for instance 894b12cd-a36c-4884-88a1-1c223cceb722 on n-h1-860864-2 Oct 10 23:47:26.485554 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-7ff79f39-84d5-46d1-9df0-ffb8b070fd3c req-79d960fe-c74f-4632-b8ff-ddcb67271fee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063825 Oct 10 23:47:26.487523 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2733/5642] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:47:27.185322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dbb4f87a-8d54-4fe2-abbc-593452a87893 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:47:27.188543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dbb4f87a-8d54-4fe2-abbc-593452a87893 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:27.205811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dbb4f87a-8d54-4fe2-abbc-593452a87893 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:27.206241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dbb4f87a-8d54-4fe2-abbc-593452a87893 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:27.206675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dbb4f87a-8d54-4fe2-abbc-593452a87893 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:27.207415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dbb4f87a-8d54-4fe2-abbc-593452a87893 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:27.207840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dbb4f87a-8d54-4fe2-abbc-593452a87893 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:27.208270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dbb4f87a-8d54-4fe2-abbc-593452a87893 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:27.361864 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dbb4f87a-8d54-4fe2-abbc-593452a87893 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action" status: 202 len: 0 microversion: 2.1 time: 0.180581 Oct 10 23:47:27.365548 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2734/5643] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:47:27 2022] POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 23:47:27.368803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8630b5ce-6223-43a6-9462-dac27ac0ab92 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:27.369552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8630b5ce-6223-43a6-9462-dac27ac0ab92 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] [instance: 8cb3edd4-435b-4619-afbf-86eebf0b1824] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:27.378709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8630b5ce-6223-43a6-9462-dac27ac0ab92 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:27.379204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8630b5ce-6223-43a6-9462-dac27ac0ab92 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:27.379644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8630b5ce-6223-43a6-9462-dac27ac0ab92 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:27.380350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8630b5ce-6223-43a6-9462-dac27ac0ab92 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:27.380840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8630b5ce-6223-43a6-9462-dac27ac0ab92 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:27.381476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8630b5ce-6223-43a6-9462-dac27ac0ab92 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:27.409001 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-8630b5ce-6223-43a6-9462-dac27ac0ab92 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] HTTP exception thrown: Instance 8cb3edd4-435b-4619-afbf-86eebf0b1824 could not be found. Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8630b5ce-6223-43a6-9462-dac27ac0ab92 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Request method failure captured: Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824 HTTP/1.1 Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK3KE0baiqBkCAIJsEELCBFIA0yQwvYRrjtmncNNffStjL5ZrJFEc5I2xTOWT27ZgMTcx_D8bCO7KLUpiRgaF4FLYH07cuUewOcH4GxnOeIi_x7dL49MkpWlsaBlWiBcjVnsG5lyIM6Dfbeb5e9dUrnOzf2O5t1Tvq1N7vFgpmFI5oI Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: a087b5d73d9240e3b5330975a2b39ea0 Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-VolumesSnapshotTestJSON-886023199 Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a087b5d73d9240e3b5330975a2b39ea0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a087b5d73d9240e3b5330975a2b39ea0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a087b5d73d9240e3b5330975a2b39ea0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a087b5d73d9240e3b5330975a2b39ea0", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-VolumesSnapshotTestJSON-886023199 Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: a087b5d73d9240e3b5330975a2b39ea0 Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-886023199 Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-VolumesSnapshotTestJSON-886023199-project Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 2613b3445bde4bd6b8a350f594458490 Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-VolumesSnapshotTestJSON-886023199-project Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 8cb3edd4-435b-4619-afbf-86eebf0b1824 could not be found. Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '8cb3edd4-435b-4619-afbf-86eebf0b1824'} Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cb3edd4-435b-4619-afbf-86eebf0b1824 could not be found. Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cb3edd4-435b-4619-afbf-86eebf0b1824 could not be found. Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:47:27.413224 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:27.417604 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:47:27.417604 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:47:27.417604 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:47:27.417604 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:47:27.417604 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:47:27.417604 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cb3edd4-435b-4619-afbf-86eebf0b1824 could not be found. Oct 10 23:47:27.417604 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:27.418772 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8630b5ce-6223-43a6-9462-dac27ac0ab92 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] Returning 404 to user: Instance 8cb3edd4-435b-4619-afbf-86eebf0b1824 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:47:27.427927 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8630b5ce-6223-43a6-9462-dac27ac0ab92 tempest-VolumesSnapshotTestJSON-886023199 tempest-VolumesSnapshotTestJSON-886023199-project] 10.222.0.23 "GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824" status: 404 len: 111 microversion: 2.1 time: 0.055727 Oct 10 23:47:27.432186 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2735/5644] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:27 2022] GET /compute/v2.1/servers/8cb3edd4-435b-4619-afbf-86eebf0b1824 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:47:27.445062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-705451a4-e306-4eab-9960-31c01224aabc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:27.445062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-705451a4-e306-4eab-9960-31c01224aabc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:27.476211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-705451a4-e306-4eab-9960-31c01224aabc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:27.476731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-705451a4-e306-4eab-9960-31c01224aabc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:27.477180 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-705451a4-e306-4eab-9960-31c01224aabc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:27.478009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-705451a4-e306-4eab-9960-31c01224aabc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:27.478532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-705451a4-e306-4eab-9960-31c01224aabc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:27.478992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-705451a4-e306-4eab-9960-31c01224aabc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:28.178830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-1b055e98-b0dd-4aad-b950-3e871b5e990c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:47:28.179632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-1b055e98-b0dd-4aad-b950-3e871b5e990c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:47:28.180691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-1b055e98-b0dd-4aad-b950-3e871b5e990c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:47:28.181274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-1b055e98-b0dd-4aad-b950-3e871b5e990c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:47:28.181902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-1b055e98-b0dd-4aad-b950-3e871b5e990c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:47:28.204967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b055e98-b0dd-4aad-b950-3e871b5e990c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:28.205696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b055e98-b0dd-4aad-b950-3e871b5e990c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:28.207516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b055e98-b0dd-4aad-b950-3e871b5e990c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:28.210715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b055e98-b0dd-4aad-b950-3e871b5e990c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:28.211836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b055e98-b0dd-4aad-b950-3e871b5e990c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:28.212300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b055e98-b0dd-4aad-b950-3e871b5e990c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:28.307359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-1b055e98-b0dd-4aad-b950-3e871b5e990c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Getting quotas for project 7fcc4d45337140259bcd5b64b17aa7b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:47:28.319624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-1b055e98-b0dd-4aad-b950-3e871b5e990c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Getting quotas for user daf7a1ddba654265a5e732363c85eefa and project 7fcc4d45337140259bcd5b64b17aa7b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:47:28.352650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1b055e98-b0dd-4aad-b950-3e871b5e990c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:47:28.355069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1b055e98-b0dd-4aad-b950-3e871b5e990c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:47:28.438997 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1b055e98-b0dd-4aad-b950-3e871b5e990c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.256436 Oct 10 23:47:28.447585 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2910/5645] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:47:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 23:47:28.454572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-68427dac-34ff-491a-8dd6-b903aae5d0b6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:28.455205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-68427dac-34ff-491a-8dd6-b903aae5d0b6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:28.595733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-68427dac-34ff-491a-8dd6-b903aae5d0b6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:28.614828 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-68427dac-34ff-491a-8dd6-b903aae5d0b6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8" status: 200 len: 1209 microversion: 2.1 time: 0.164970 Oct 10 23:47:28.627023 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2911/5646] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:28 2022] GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 => generated 1209 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:28.799818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-705451a4-e306-4eab-9960-31c01224aabc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:28.822336 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-705451a4-e306-4eab-9960-31c01224aabc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1672 microversion: 2.1 time: 1.391501 Oct 10 23:47:28.823297 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2736/5647] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:27 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1672 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:29.642271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-02166d2b-585a-4c2d-89ff-a536f76f4ea7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:29.643741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-02166d2b-585a-4c2d-89ff-a536f76f4ea7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:29.655192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02166d2b-585a-4c2d-89ff-a536f76f4ea7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:29.656027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02166d2b-585a-4c2d-89ff-a536f76f4ea7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:29.656709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02166d2b-585a-4c2d-89ff-a536f76f4ea7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:29.657744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02166d2b-585a-4c2d-89ff-a536f76f4ea7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:29.658184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02166d2b-585a-4c2d-89ff-a536f76f4ea7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:29.658623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02166d2b-585a-4c2d-89ff-a536f76f4ea7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:29.799075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-02166d2b-585a-4c2d-89ff-a536f76f4ea7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:29.840205 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-02166d2b-585a-4c2d-89ff-a536f76f4ea7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8" status: 200 len: 1261 microversion: 2.1 time: 0.202537 Oct 10 23:47:29.853563 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2912/5648] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:29 2022] GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 => generated 1261 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:29.853858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-36a66ce6-9b0e-424d-85f7-cf15a57a25a1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:29.854334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-36a66ce6-9b0e-424d-85f7-cf15a57a25a1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:29.864281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:47:29.866204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36a66ce6-9b0e-424d-85f7-cf15a57a25a1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:29.866895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36a66ce6-9b0e-424d-85f7-cf15a57a25a1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:29.867314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36a66ce6-9b0e-424d-85f7-cf15a57a25a1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:29.868029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36a66ce6-9b0e-424d-85f7-cf15a57a25a1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:29.868480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36a66ce6-9b0e-424d-85f7-cf15a57a25a1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:29.868906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36a66ce6-9b0e-424d-85f7-cf15a57a25a1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:30.278015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-36a66ce6-9b0e-424d-85f7-cf15a57a25a1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:30.295319 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-36a66ce6-9b0e-424d-85f7-cf15a57a25a1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1677 microversion: 2.1 time: 0.446671 Oct 10 23:47:30.317461 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2737/5649] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:29 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1677 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:30.867241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c58c3e44-7fb5-43c2-8847-da9829033233 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:30.867872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c58c3e44-7fb5-43c2-8847-da9829033233 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:30.877198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c58c3e44-7fb5-43c2-8847-da9829033233 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:30.877991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c58c3e44-7fb5-43c2-8847-da9829033233 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:30.878631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c58c3e44-7fb5-43c2-8847-da9829033233 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:30.879518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c58c3e44-7fb5-43c2-8847-da9829033233 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:30.880226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c58c3e44-7fb5-43c2-8847-da9829033233 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:30.880823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c58c3e44-7fb5-43c2-8847-da9829033233 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:31.035394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c58c3e44-7fb5-43c2-8847-da9829033233 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:31.051202 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c58c3e44-7fb5-43c2-8847-da9829033233 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8" status: 200 len: 1267 microversion: 2.1 time: 0.187732 Oct 10 23:47:31.055705 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2913/5650] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:30 2022] GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:31.334289 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-95af22d9-5a59-440b-b124-3d682dc802e8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:31.335917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-95af22d9-5a59-440b-b124-3d682dc802e8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:31.350376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95af22d9-5a59-440b-b124-3d682dc802e8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:31.350893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95af22d9-5a59-440b-b124-3d682dc802e8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:31.351343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95af22d9-5a59-440b-b124-3d682dc802e8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:31.352071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95af22d9-5a59-440b-b124-3d682dc802e8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:31.353170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95af22d9-5a59-440b-b124-3d682dc802e8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:31.353811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95af22d9-5a59-440b-b124-3d682dc802e8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:31.767337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-95af22d9-5a59-440b-b124-3d682dc802e8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:31.781668 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-95af22d9-5a59-440b-b124-3d682dc802e8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.452752 Oct 10 23:47:31.782892 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2738/5651] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:31 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:32.096362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9a540386-700c-4c87-9827-c9175efeee04 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:32.110725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9a540386-700c-4c87-9827-c9175efeee04 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:32.127421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a540386-700c-4c87-9827-c9175efeee04 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:32.129305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a540386-700c-4c87-9827-c9175efeee04 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:32.130148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a540386-700c-4c87-9827-c9175efeee04 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:32.131568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a540386-700c-4c87-9827-c9175efeee04 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:32.132715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a540386-700c-4c87-9827-c9175efeee04 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:32.133538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a540386-700c-4c87-9827-c9175efeee04 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:32.645900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9a540386-700c-4c87-9827-c9175efeee04 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:32.668189 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9a540386-700c-4c87-9827-c9175efeee04 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8" status: 200 len: 1267 microversion: 2.1 time: 0.579510 Oct 10 23:47:32.669832 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2914/5652] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:32 2022] GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 => generated 1267 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:33.691776 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-875e122e-cd50-4182-bbb9-03218642289b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:33.692139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-875e122e-cd50-4182-bbb9-03218642289b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:33.699791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-875e122e-cd50-4182-bbb9-03218642289b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:33.701106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-875e122e-cd50-4182-bbb9-03218642289b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:33.702704 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-875e122e-cd50-4182-bbb9-03218642289b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:33.703793 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-875e122e-cd50-4182-bbb9-03218642289b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:33.705036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-875e122e-cd50-4182-bbb9-03218642289b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:33.705732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-875e122e-cd50-4182-bbb9-03218642289b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:34.058246 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-875e122e-cd50-4182-bbb9-03218642289b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:34.068260 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-875e122e-cd50-4182-bbb9-03218642289b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8" status: 200 len: 1309 microversion: 2.1 time: 0.381087 Oct 10 23:47:34.069252 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2739/5653] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:33 2022] GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 => generated 1309 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:35.095606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-75edf173-9b66-4857-a60e-fb4238532ece tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:35.096243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-75edf173-9b66-4857-a60e-fb4238532ece tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:35.115166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75edf173-9b66-4857-a60e-fb4238532ece tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:35.116040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75edf173-9b66-4857-a60e-fb4238532ece tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:35.116644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75edf173-9b66-4857-a60e-fb4238532ece tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:35.118196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75edf173-9b66-4857-a60e-fb4238532ece tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:35.119436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75edf173-9b66-4857-a60e-fb4238532ece tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:35.119886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75edf173-9b66-4857-a60e-fb4238532ece tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:35.125256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-82ea2115-729e-4c49-8db0-01b0bad1d3b4 req-4cfdb697-1a84-4f73-8cc2-bf9b88ee704e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12616f56-d1c0-4db0-82b5-8adabb53a8b8", "tag": "6f54900e-6979-46ab-9175-d20f79a69a73"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:47:35.140110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-82ea2115-729e-4c49-8db0-01b0bad1d3b4 req-4cfdb697-1a84-4f73-8cc2-bf9b88ee704e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:35.141010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-82ea2115-729e-4c49-8db0-01b0bad1d3b4 req-4cfdb697-1a84-4f73-8cc2-bf9b88ee704e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:35.141919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-82ea2115-729e-4c49-8db0-01b0bad1d3b4 req-4cfdb697-1a84-4f73-8cc2-bf9b88ee704e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:35.157534 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-82ea2115-729e-4c49-8db0-01b0bad1d3b4 req-4cfdb697-1a84-4f73-8cc2-bf9b88ee704e service nova] Creating event network-changed:6f54900e-6979-46ab-9175-d20f79a69a73 for instance 12616f56-d1c0-4db0-82b5-8adabb53a8b8 on n-h1-860864-2 Oct 10 23:47:35.165489 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-82ea2115-729e-4c49-8db0-01b0bad1d3b4 req-4cfdb697-1a84-4f73-8cc2-bf9b88ee704e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044490 Oct 10 23:47:35.167381 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2740/5654] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:47:35.485766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-75edf173-9b66-4857-a60e-fb4238532ece tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:35.495048 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-75edf173-9b66-4857-a60e-fb4238532ece tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8" status: 200 len: 1309 microversion: 2.1 time: 0.404282 Oct 10 23:47:35.502281 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2915/5655] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:35 2022] GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 => generated 1309 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:36.537732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e630efc8-dc4a-4530-acb6-87194d7d2673 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:36.539078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e630efc8-dc4a-4530-acb6-87194d7d2673 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:36.550510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e630efc8-dc4a-4530-acb6-87194d7d2673 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:36.551264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e630efc8-dc4a-4530-acb6-87194d7d2673 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:36.552204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e630efc8-dc4a-4530-acb6-87194d7d2673 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:36.553141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e630efc8-dc4a-4530-acb6-87194d7d2673 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:36.553953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e630efc8-dc4a-4530-acb6-87194d7d2673 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:36.554573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e630efc8-dc4a-4530-acb6-87194d7d2673 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:37.108331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e630efc8-dc4a-4530-acb6-87194d7d2673 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:37.119980 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e630efc8-dc4a-4530-acb6-87194d7d2673 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8" status: 200 len: 1309 microversion: 2.1 time: 0.592600 Oct 10 23:47:37.126200 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2741/5656] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:36 2022] GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 => generated 1309 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:38.156352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-79fa08ae-24a2-4b68-a82a-e30be956b71e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:38.158363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-79fa08ae-24a2-4b68-a82a-e30be956b71e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:38.174228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79fa08ae-24a2-4b68-a82a-e30be956b71e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:38.175567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79fa08ae-24a2-4b68-a82a-e30be956b71e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:38.179118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79fa08ae-24a2-4b68-a82a-e30be956b71e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:38.183182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79fa08ae-24a2-4b68-a82a-e30be956b71e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:38.184303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79fa08ae-24a2-4b68-a82a-e30be956b71e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:38.185296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79fa08ae-24a2-4b68-a82a-e30be956b71e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:38.272246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:47:38.542279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-79fa08ae-24a2-4b68-a82a-e30be956b71e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:38.566733 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-79fa08ae-24a2-4b68-a82a-e30be956b71e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8" status: 200 len: 1309 microversion: 2.1 time: 0.419693 Oct 10 23:47:38.571782 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2916/5657] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:38 2022] GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 => generated 1309 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:47:39.596686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-60fc5c0e-f532-4766-afab-4eaf76076015 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:39.597521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-60fc5c0e-f532-4766-afab-4eaf76076015 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:39.613735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60fc5c0e-f532-4766-afab-4eaf76076015 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:39.617556 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60fc5c0e-f532-4766-afab-4eaf76076015 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:39.625564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60fc5c0e-f532-4766-afab-4eaf76076015 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:39.626523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60fc5c0e-f532-4766-afab-4eaf76076015 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:39.627257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60fc5c0e-f532-4766-afab-4eaf76076015 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:39.627850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60fc5c0e-f532-4766-afab-4eaf76076015 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:40.482078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-60fc5c0e-f532-4766-afab-4eaf76076015 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:40.498553 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-60fc5c0e-f532-4766-afab-4eaf76076015 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8" status: 200 len: 1309 microversion: 2.1 time: 0.906718 Oct 10 23:47:40.519597 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2742/5658] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:39 2022] GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 => generated 1309 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:47:41.537528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-eb845688-d299-4740-9d21-5d187fde8349 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:41.539115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-eb845688-d299-4740-9d21-5d187fde8349 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:41.554521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:47:41.569278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb845688-d299-4740-9d21-5d187fde8349 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:41.576023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb845688-d299-4740-9d21-5d187fde8349 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:41.580571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb845688-d299-4740-9d21-5d187fde8349 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:41.581942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb845688-d299-4740-9d21-5d187fde8349 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:41.587315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb845688-d299-4740-9d21-5d187fde8349 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:41.588108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb845688-d299-4740-9d21-5d187fde8349 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:42.219659 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-eb845688-d299-4740-9d21-5d187fde8349 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:42.250481 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-eb845688-d299-4740-9d21-5d187fde8349 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8" status: 200 len: 1309 microversion: 2.1 time: 0.723131 Oct 10 23:47:42.254251 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2917/5659] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:41 2022] GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 => generated 1309 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:43.030628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-6dad49dc-4e08-4143-a872-3c5c78da497b req-3dae4c8b-c747-43b2-9abc-2ab0307fa08b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12616f56-d1c0-4db0-82b5-8adabb53a8b8", "name": "network-vif-plugged", "status": "completed", "tag": "6f54900e-6979-46ab-9175-d20f79a69a73"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:47:43.044283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6dad49dc-4e08-4143-a872-3c5c78da497b req-3dae4c8b-c747-43b2-9abc-2ab0307fa08b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:43.044965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6dad49dc-4e08-4143-a872-3c5c78da497b req-3dae4c8b-c747-43b2-9abc-2ab0307fa08b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:43.045622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6dad49dc-4e08-4143-a872-3c5c78da497b req-3dae4c8b-c747-43b2-9abc-2ab0307fa08b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:43.066844 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-6dad49dc-4e08-4143-a872-3c5c78da497b req-3dae4c8b-c747-43b2-9abc-2ab0307fa08b service nova] Creating event network-vif-plugged:6f54900e-6979-46ab-9175-d20f79a69a73 for instance 12616f56-d1c0-4db0-82b5-8adabb53a8b8 on n-h1-860864-2 Oct 10 23:47:43.073776 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-6dad49dc-4e08-4143-a872-3c5c78da497b req-3dae4c8b-c747-43b2-9abc-2ab0307fa08b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.391625 Oct 10 23:47:43.076172 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2743/5660] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:47:43.275161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dc33ca97-e6af-417a-9def-cf2b18c22f00 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:43.275909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dc33ca97-e6af-417a-9def-cf2b18c22f00 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:43.298399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc33ca97-e6af-417a-9def-cf2b18c22f00 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:43.300379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc33ca97-e6af-417a-9def-cf2b18c22f00 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:43.301883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc33ca97-e6af-417a-9def-cf2b18c22f00 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:43.304228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc33ca97-e6af-417a-9def-cf2b18c22f00 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:43.305734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc33ca97-e6af-417a-9def-cf2b18c22f00 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:43.307043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc33ca97-e6af-417a-9def-cf2b18c22f00 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:43.768912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dc33ca97-e6af-417a-9def-cf2b18c22f00 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:43.790690 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dc33ca97-e6af-417a-9def-cf2b18c22f00 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8" status: 200 len: 1309 microversion: 2.1 time: 0.518668 Oct 10 23:47:43.800536 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2918/5661] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:43 2022] GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 => generated 1309 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:44.832179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7b7f6ddb-1f6b-4c52-9957-2c7747534c41 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:44.832910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7b7f6ddb-1f6b-4c52-9957-2c7747534c41 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:44.846734 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b7f6ddb-1f6b-4c52-9957-2c7747534c41 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:44.848784 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b7f6ddb-1f6b-4c52-9957-2c7747534c41 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:44.850071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b7f6ddb-1f6b-4c52-9957-2c7747534c41 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:44.851418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b7f6ddb-1f6b-4c52-9957-2c7747534c41 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:44.853216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b7f6ddb-1f6b-4c52-9957-2c7747534c41 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:44.854251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b7f6ddb-1f6b-4c52-9957-2c7747534c41 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:45.514820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7b7f6ddb-1f6b-4c52-9957-2c7747534c41 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:45.525496 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7b7f6ddb-1f6b-4c52-9957-2c7747534c41 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8" status: 200 len: 1309 microversion: 2.1 time: 0.704545 Oct 10 23:47:45.526996 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2744/5662] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:44 2022] GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 => generated 1309 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:46.552331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c648d7fc-d3b4-4e0b-b584-870f86d5e8e0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:46.552956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c648d7fc-d3b4-4e0b-b584-870f86d5e8e0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:46.573279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c648d7fc-d3b4-4e0b-b584-870f86d5e8e0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:46.573975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c648d7fc-d3b4-4e0b-b584-870f86d5e8e0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:46.574439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c648d7fc-d3b4-4e0b-b584-870f86d5e8e0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:46.575194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c648d7fc-d3b4-4e0b-b584-870f86d5e8e0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:46.575658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c648d7fc-d3b4-4e0b-b584-870f86d5e8e0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:46.576090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c648d7fc-d3b4-4e0b-b584-870f86d5e8e0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:46.927851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c648d7fc-d3b4-4e0b-b584-870f86d5e8e0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:46.951264 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c648d7fc-d3b4-4e0b-b584-870f86d5e8e0 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8" status: 200 len: 1490 microversion: 2.1 time: 0.402743 Oct 10 23:47:46.958224 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2919/5663] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:46 2022] GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 => generated 1490 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:46.982952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6121a4d6-9e0a-4c8c-a42f-5e1a35ce62c6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:47:46.988842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6121a4d6-9e0a-4c8c-a42f-5e1a35ce62c6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:47.007915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6121a4d6-9e0a-4c8c-a42f-5e1a35ce62c6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:47.008693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6121a4d6-9e0a-4c8c-a42f-5e1a35ce62c6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:47.009301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6121a4d6-9e0a-4c8c-a42f-5e1a35ce62c6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:47.010222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6121a4d6-9e0a-4c8c-a42f-5e1a35ce62c6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:47.011185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6121a4d6-9e0a-4c8c-a42f-5e1a35ce62c6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:47.011810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6121a4d6-9e0a-4c8c-a42f-5e1a35ce62c6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:47.099701 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6121a4d6-9e0a-4c8c-a42f-5e1a35ce62c6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "PUT /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8" status: 200 len: 1085 microversion: 2.1 time: 0.120805 Oct 10 23:47:47.100645 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2745/5664] 10.222.0.23 () {60 vars in 1256 bytes} [Mon Oct 10 23:47:46 2022] PUT /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 => generated 1085 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:47.119576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d09df041-ab3a-4a23-8821-6a2df4ac9a3c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:47.120127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d09df041-ab3a-4a23-8821-6a2df4ac9a3c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:47.128836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d09df041-ab3a-4a23-8821-6a2df4ac9a3c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:47.129335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d09df041-ab3a-4a23-8821-6a2df4ac9a3c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:47.130033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d09df041-ab3a-4a23-8821-6a2df4ac9a3c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:47.130922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d09df041-ab3a-4a23-8821-6a2df4ac9a3c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:47.131542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d09df041-ab3a-4a23-8821-6a2df4ac9a3c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:47.132131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d09df041-ab3a-4a23-8821-6a2df4ac9a3c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:47.347926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d09df041-ab3a-4a23-8821-6a2df4ac9a3c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:47.349366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2391289c-89bd-4459-880c-04a4d9c9adf7 tempest-ServerGroup264TestJSON-2097382824 tempest-ServerGroup264TestJSON-2097382824-project] Action: 'create', calling method: .version_select at 0x7f662a4f1dc0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:47:47.357346 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d09df041-ab3a-4a23-8821-6a2df4ac9a3c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8" status: 200 len: 1511 microversion: 2.1 time: 0.241589 Oct 10 23:47:47.361987 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2920/5665] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:47 2022] GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 => generated 1511 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:47.374867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-2391289c-89bd-4459-880c-04a4d9c9adf7 tempest-ServerGroup264TestJSON-2097382824 tempest-ServerGroup264TestJSON-2097382824-project] Getting quotas for project 99a36d035825426a8fe607652a836122. Resources: {'server_groups'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:47:47.382602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-2391289c-89bd-4459-880c-04a4d9c9adf7 tempest-ServerGroup264TestJSON-2097382824 tempest-ServerGroup264TestJSON-2097382824-project] Getting quotas for user f47a1f9071314c02800a99a1b0f0158f and project 99a36d035825426a8fe607652a836122. Resources: {'server_groups'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:47:47.384619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-126b4b36-174a-492f-b621-3f4cf12eebe4 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:47.386083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-126b4b36-174a-492f-b621-3f4cf12eebe4 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:47.398270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-126b4b36-174a-492f-b621-3f4cf12eebe4 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:47.399822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-126b4b36-174a-492f-b621-3f4cf12eebe4 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:47.406375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-126b4b36-174a-492f-b621-3f4cf12eebe4 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:47.407608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-126b4b36-174a-492f-b621-3f4cf12eebe4 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:47.408283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-126b4b36-174a-492f-b621-3f4cf12eebe4 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:47.408878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-126b4b36-174a-492f-b621-3f4cf12eebe4 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:47.455856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-2391289c-89bd-4459-880c-04a4d9c9adf7 tempest-ServerGroup264TestJSON-2097382824 tempest-ServerGroup264TestJSON-2097382824-project] Getting quotas for project 99a36d035825426a8fe607652a836122. Resources: {'server_groups'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:47:47.463904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-2391289c-89bd-4459-880c-04a4d9c9adf7 tempest-ServerGroup264TestJSON-2097382824 tempest-ServerGroup264TestJSON-2097382824-project] Getting quotas for user f47a1f9071314c02800a99a1b0f0158f and project 99a36d035825426a8fe607652a836122. Resources: {'server_groups'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:47:47.492858 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2391289c-89bd-4459-880c-04a4d9c9adf7 tempest-ServerGroup264TestJSON-2097382824 tempest-ServerGroup264TestJSON-2097382824-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.204652 Oct 10 23:47:47.493493 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2746/5666] 10.222.0.23 () {62 vars in 1214 bytes} [Mon Oct 10 23:47:47 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:47:47.506644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bdfc4669-79fb-4a2d-97e9-ac84576e6b93 tempest-ServerGroup264TestJSON-2097382824 tempest-ServerGroup264TestJSON-2097382824-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:47.524421 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bdfc4669-79fb-4a2d-97e9-ac84576e6b93 tempest-ServerGroup264TestJSON-2097382824 tempest-ServerGroup264TestJSON-2097382824-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.021497 Oct 10 23:47:47.532807 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2747/5667] 10.222.0.23 () {60 vars in 1193 bytes} [Mon Oct 10 23:47:47 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:47:47.537818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-96674f3c-47c0-4b43-b93e-1ac768c9ccb0 tempest-ServerGroup264TestJSON-2097382824 tempest-ServerGroup264TestJSON-2097382824-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:47.548363 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-96674f3c-47c0-4b43-b93e-1ac768c9ccb0 tempest-ServerGroup264TestJSON-2097382824 tempest-ServerGroup264TestJSON-2097382824-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/0509d695-fa31-47af-97ac-61871963d98c" status: 200 len: 235 microversion: 2.64 time: 0.014116 Oct 10 23:47:47.555751 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2748/5668] 10.222.0.23 () {60 vars in 1304 bytes} [Mon Oct 10 23:47:47 2022] GET /compute/v2.1/os-server-groups/0509d695-fa31-47af-97ac-61871963d98c => generated 235 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:47:47.566719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-90932567-03ac-4382-b2c5-eb57a28b79ba tempest-ServerGroup264TestJSON-2097382824 tempest-ServerGroup264TestJSON-2097382824-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:47.605026 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-90932567-03ac-4382-b2c5-eb57a28b79ba tempest-ServerGroup264TestJSON-2097382824 tempest-ServerGroup264TestJSON-2097382824-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/0509d695-fa31-47af-97ac-61871963d98c" status: 204 len: 0 microversion: 2.64 time: 0.047390 Oct 10 23:47:47.606184 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2749/5669] 10.222.0.23 () {60 vars in 1307 bytes} [Mon Oct 10 23:47:47 2022] DELETE /compute/v2.1/os-server-groups/0509d695-fa31-47af-97ac-61871963d98c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:47:47.616402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3be7e2dd-cc52-40e0-953b-6494633f5780 tempest-ServerGroup264TestJSON-2097382824 tempest-ServerGroup264TestJSON-2097382824-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:47.626346 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-3be7e2dd-cc52-40e0-953b-6494633f5780 tempest-ServerGroup264TestJSON-2097382824 tempest-ServerGroup264TestJSON-2097382824-project] HTTP exception thrown: Instance group 0509d695-fa31-47af-97ac-61871963d98c could not be found. Oct 10 23:47:47.636720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-126b4b36-174a-492f-b621-3f4cf12eebe4 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3be7e2dd-cc52-40e0-953b-6494633f5780 tempest-ServerGroup264TestJSON-2097382824 tempest-ServerGroup264TestJSON-2097382824-project] Request method failure captured: Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/os-server-groups/0509d695-fa31-47af-97ac-61871963d98c HTTP/1.1 Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK8jTdZ6R37iqTMESc3kAI4LP3MDCH-DpfFHZUGZ25ncZWJkY8fng0rdla0hnoSVaYkdCFxwEg4lb4H90Za9gvN-VMU3MU2tOD_KTDHyyJzP1-LI59EUZKCcTARV3qBE3w54HGJpZiY0XKuljXNtgelpDQkuC5oU-8D4M3SxqmC6yX4 Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: X-Openstack-Nova-Api-Version: 2.64 Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 99a36d035825426a8fe607652a836122 Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerGroup264TestJSON-2097382824 Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99a36d035825426a8fe607652a836122"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99a36d035825426a8fe607652a836122"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99a36d035825426a8fe607652a836122"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99a36d035825426a8fe607652a836122", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerGroup264TestJSON-2097382824 Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 99a36d035825426a8fe607652a836122 Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerGroup264TestJSON-2097382824 Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerGroup264TestJSON-2097382824-project Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: f47a1f9071314c02800a99a1b0f0158f Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerGroup264TestJSON-2097382824-project Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance group 0509d695-fa31-47af-97ac-61871963d98c could not be found. Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '0509d695-fa31-47af-97ac-61871963d98c'} Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0509d695-fa31-47af-97ac-61871963d98c could not be found. Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0509d695-fa31-47af-97ac-61871963d98c could not be found. Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:47.645599 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:47:47.651741 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:47:47.651741 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:47:47.651741 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:47:47.651741 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:47:47.651741 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0509d695-fa31-47af-97ac-61871963d98c could not be found. Oct 10 23:47:47.651741 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:47.652182 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-126b4b36-174a-492f-b621-3f4cf12eebe4 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8" status: 200 len: 1511 microversion: 2.1 time: 0.267362 Oct 10 23:47:47.653983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3be7e2dd-cc52-40e0-953b-6494633f5780 tempest-ServerGroup264TestJSON-2097382824 tempest-ServerGroup264TestJSON-2097382824-project] Returning 404 to user: Instance group 0509d695-fa31-47af-97ac-61871963d98c could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:47:47.655422 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3be7e2dd-cc52-40e0-953b-6494633f5780 tempest-ServerGroup264TestJSON-2097382824 tempest-ServerGroup264TestJSON-2097382824-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/0509d695-fa31-47af-97ac-61871963d98c" status: 404 len: 117 microversion: 2.64 time: 0.044359 Oct 10 23:47:47.656186 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2750/5670] 10.222.0.23 () {60 vars in 1307 bytes} [Mon Oct 10 23:47:47 2022] DELETE /compute/v2.1/os-server-groups/0509d695-fa31-47af-97ac-61871963d98c => generated 117 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 10 23:47:47.670180 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2921/5671] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:47 2022] GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 => generated 1511 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:47:47.674465 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f5b093a8-e59b-4811-900b-da395874e858 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:47.686488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f5b093a8-e59b-4811-900b-da395874e858 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:47.694245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5b093a8-e59b-4811-900b-da395874e858 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:47.695298 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5b093a8-e59b-4811-900b-da395874e858 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:47.700313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5b093a8-e59b-4811-900b-da395874e858 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:47.702390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5b093a8-e59b-4811-900b-da395874e858 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:47.703202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5b093a8-e59b-4811-900b-da395874e858 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:47.703995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5b093a8-e59b-4811-900b-da395874e858 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:47.732675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:47:47.744649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f5b093a8-e59b-4811-900b-da395874e858 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:47:47.977249 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f5b093a8-e59b-4811-900b-da395874e858 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "DELETE /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8" status: 204 len: 0 microversion: 2.1 time: 0.307915 Oct 10 23:47:47.988189 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2751/5672] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:47:47 2022] DELETE /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 23:47:47.995064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-de346700-a588-4d53-8cd0-982aebdd2b86 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:47.997161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-de346700-a588-4d53-8cd0-982aebdd2b86 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:48.023554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de346700-a588-4d53-8cd0-982aebdd2b86 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:48.025824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de346700-a588-4d53-8cd0-982aebdd2b86 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:48.026388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de346700-a588-4d53-8cd0-982aebdd2b86 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:48.027240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de346700-a588-4d53-8cd0-982aebdd2b86 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:48.029237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de346700-a588-4d53-8cd0-982aebdd2b86 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:48.029882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de346700-a588-4d53-8cd0-982aebdd2b86 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:48.525853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-de346700-a588-4d53-8cd0-982aebdd2b86 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:48.540713 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-de346700-a588-4d53-8cd0-982aebdd2b86 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8" status: 200 len: 1517 microversion: 2.1 time: 0.549867 Oct 10 23:47:48.566041 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2922/5673] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:47 2022] GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 => generated 1517 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:47:49.573058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-17aed9e5-6c7a-444d-8e55-686c97ffecab tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:49.574588 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-17aed9e5-6c7a-444d-8e55-686c97ffecab tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:49.590566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17aed9e5-6c7a-444d-8e55-686c97ffecab tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:49.591248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17aed9e5-6c7a-444d-8e55-686c97ffecab tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:49.591870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17aed9e5-6c7a-444d-8e55-686c97ffecab tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:49.593122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17aed9e5-6c7a-444d-8e55-686c97ffecab tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:49.593797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17aed9e5-6c7a-444d-8e55-686c97ffecab tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:49.594396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17aed9e5-6c7a-444d-8e55-686c97ffecab tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:50.057487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-17aed9e5-6c7a-444d-8e55-686c97ffecab tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:50.068551 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-17aed9e5-6c7a-444d-8e55-686c97ffecab tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8" status: 200 len: 1517 microversion: 2.1 time: 0.501132 Oct 10 23:47:50.072485 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2752/5674] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:49 2022] GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 => generated 1517 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:51.100792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-454a27af-e8b6-458a-8f5a-271471025b4e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:51.109829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-454a27af-e8b6-458a-8f5a-271471025b4e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:51.126111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-454a27af-e8b6-458a-8f5a-271471025b4e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:51.129728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-454a27af-e8b6-458a-8f5a-271471025b4e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:51.130236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-454a27af-e8b6-458a-8f5a-271471025b4e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:51.133509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-454a27af-e8b6-458a-8f5a-271471025b4e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:51.144971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-454a27af-e8b6-458a-8f5a-271471025b4e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:51.145698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-454a27af-e8b6-458a-8f5a-271471025b4e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:51.355128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-abfce66c-2b3d-4e3a-9a91-3ce455d72bf4 req-2eb02333-f08c-4bb7-be55-0cda65f6355e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12616f56-d1c0-4db0-82b5-8adabb53a8b8", "name": "network-vif-deleted", "tag": "6f54900e-6979-46ab-9175-d20f79a69a73"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:47:51.396003 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-abfce66c-2b3d-4e3a-9a91-3ce455d72bf4 req-2eb02333-f08c-4bb7-be55-0cda65f6355e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:51.398760 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-abfce66c-2b3d-4e3a-9a91-3ce455d72bf4 req-2eb02333-f08c-4bb7-be55-0cda65f6355e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:51.399440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-abfce66c-2b3d-4e3a-9a91-3ce455d72bf4 req-2eb02333-f08c-4bb7-be55-0cda65f6355e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:51.419636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-454a27af-e8b6-458a-8f5a-271471025b4e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:51.422359 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-abfce66c-2b3d-4e3a-9a91-3ce455d72bf4 req-2eb02333-f08c-4bb7-be55-0cda65f6355e service nova] Creating event network-vif-deleted:6f54900e-6979-46ab-9175-d20f79a69a73 for instance 12616f56-d1c0-4db0-82b5-8adabb53a8b8 on n-h1-860864-2 Oct 10 23:47:51.431732 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-abfce66c-2b3d-4e3a-9a91-3ce455d72bf4 req-2eb02333-f08c-4bb7-be55-0cda65f6355e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087661 Oct 10 23:47:51.432837 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-454a27af-e8b6-458a-8f5a-271471025b4e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8" status: 200 len: 1475 microversion: 2.1 time: 0.336170 Oct 10 23:47:51.435454 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2753/5675] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:47:51.440310 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2923/5676] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:51 2022] GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 => generated 1475 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:52.468774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7736e4c9-5e83-4972-98ff-742a16f3620f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:52.470352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7736e4c9-5e83-4972-98ff-742a16f3620f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:52.491253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7736e4c9-5e83-4972-98ff-742a16f3620f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:52.493441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7736e4c9-5e83-4972-98ff-742a16f3620f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:52.494282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7736e4c9-5e83-4972-98ff-742a16f3620f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:52.495104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7736e4c9-5e83-4972-98ff-742a16f3620f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:52.498350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7736e4c9-5e83-4972-98ff-742a16f3620f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:52.499159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7736e4c9-5e83-4972-98ff-742a16f3620f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:52.558878 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-7736e4c9-5e83-4972-98ff-742a16f3620f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] HTTP exception thrown: Instance 12616f56-d1c0-4db0-82b5-8adabb53a8b8 could not be found. Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7736e4c9-5e83-4972-98ff-742a16f3620f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Request method failure captured: Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 HTTP/1.1 Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK5cQzq5PmBN8ZK8xufnInf_nKzozFybG60EPi2LKIagIuIo6wmjCjt_dEi9KoG421lgq7o9GXzxCjj26_PYoj0IVUx4iuPxFYRw_bINPtYf7R0sv0LrnaNDyTyma9wRBMptURK1MlutQq_man6Zj75t-cnvbQ_0wIRWAQ7WKgqvlIM Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fcc4d45337140259bcd5b64b17aa7b5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersTestJSON-1882347849 Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersTestJSON-1882347849-project Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: daf7a1ddba654265a5e732363c85eefa Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersTestJSON-1882347849-project Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 12616f56-d1c0-4db0-82b5-8adabb53a8b8 could not be found. Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '12616f56-d1c0-4db0-82b5-8adabb53a8b8'} Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12616f56-d1c0-4db0-82b5-8adabb53a8b8 could not be found. Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12616f56-d1c0-4db0-82b5-8adabb53a8b8 could not be found. Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:47:52.560598 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:52.572332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:47:52.572332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:47:52.572332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:47:52.572332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:47:52.572332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:47:52.572332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12616f56-d1c0-4db0-82b5-8adabb53a8b8 could not be found. Oct 10 23:47:52.572332 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:47:52.572332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7736e4c9-5e83-4972-98ff-742a16f3620f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Returning 404 to user: Instance 12616f56-d1c0-4db0-82b5-8adabb53a8b8 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:47:52.572332 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7736e4c9-5e83-4972-98ff-742a16f3620f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8" status: 404 len: 111 microversion: 2.1 time: 0.101126 Oct 10 23:47:52.572332 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2754/5677] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:52 2022] GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:47:52.749191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bdae3465-aea5-489b-a326-ee876fc6d761 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1074869767", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "abcacee0-1319-4318-8900-2ff15d7780f9"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:47:52.767975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:47:52.877725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-bdae3465-aea5-489b-a326-ee876fc6d761 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] validate_networks() for [('abcacee0-1319-4318-8900-2ff15d7780f9', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:47:53.624954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-bdae3465-aea5-489b-a326-ee876fc6d761 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:47:53.626202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-bdae3465-aea5-489b-a326-ee876fc6d761 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:47:53.627587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-bdae3465-aea5-489b-a326-ee876fc6d761 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:47:53.628297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-bdae3465-aea5-489b-a326-ee876fc6d761 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:47:53.628935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-bdae3465-aea5-489b-a326-ee876fc6d761 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:47:53.671489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdae3465-aea5-489b-a326-ee876fc6d761 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:53.672034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdae3465-aea5-489b-a326-ee876fc6d761 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:53.676453 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdae3465-aea5-489b-a326-ee876fc6d761 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:53.678336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdae3465-aea5-489b-a326-ee876fc6d761 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:53.679155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdae3465-aea5-489b-a326-ee876fc6d761 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:53.679825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdae3465-aea5-489b-a326-ee876fc6d761 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:53.740589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:47:53.781710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-bdae3465-aea5-489b-a326-ee876fc6d761 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Getting quotas for project 7fcc4d45337140259bcd5b64b17aa7b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:47:53.793069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-bdae3465-aea5-489b-a326-ee876fc6d761 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Getting quotas for user daf7a1ddba654265a5e732363c85eefa and project 7fcc4d45337140259bcd5b64b17aa7b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:47:53.821094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bdae3465-aea5-489b-a326-ee876fc6d761 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:47:53.823855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bdae3465-aea5-489b-a326-ee876fc6d761 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:47:53.896346 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bdae3465-aea5-489b-a326-ee876fc6d761 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.152282 Oct 10 23:47:53.907628 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2924/5678] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:47:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:47:53.910200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0b10ea80-59e6-4c64-9848-0e9b38c9b8ad tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:53.911113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0b10ea80-59e6-4c64-9848-0e9b38c9b8ad tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:54.498930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0b10ea80-59e6-4c64-9848-0e9b38c9b8ad tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:54.520566 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0b10ea80-59e6-4c64-9848-0e9b38c9b8ad tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1209 microversion: 2.1 time: 0.615004 Oct 10 23:47:54.541111 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2755/5679] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:53 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1209 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:55.544664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-afe9c1d8-97ca-4368-a350-50eb653243e5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:55.545369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-afe9c1d8-97ca-4368-a350-50eb653243e5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:55.553467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-afe9c1d8-97ca-4368-a350-50eb653243e5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:55.554287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-afe9c1d8-97ca-4368-a350-50eb653243e5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:55.554933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-afe9c1d8-97ca-4368-a350-50eb653243e5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:55.555897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-afe9c1d8-97ca-4368-a350-50eb653243e5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:55.556562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-afe9c1d8-97ca-4368-a350-50eb653243e5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:55.557198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-afe9c1d8-97ca-4368-a350-50eb653243e5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:55.853057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-afe9c1d8-97ca-4368-a350-50eb653243e5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:55.878328 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-afe9c1d8-97ca-4368-a350-50eb653243e5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1269 microversion: 2.1 time: 0.338534 Oct 10 23:47:55.878954 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2925/5680] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:55 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1269 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:56.906432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0d40ca3b-df1d-4e1e-afb1-3b73dda0196a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:56.907056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0d40ca3b-df1d-4e1e-afb1-3b73dda0196a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:56.915118 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d40ca3b-df1d-4e1e-afb1-3b73dda0196a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:56.915954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d40ca3b-df1d-4e1e-afb1-3b73dda0196a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:56.916682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d40ca3b-df1d-4e1e-afb1-3b73dda0196a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:56.917715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d40ca3b-df1d-4e1e-afb1-3b73dda0196a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:56.918455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d40ca3b-df1d-4e1e-afb1-3b73dda0196a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:56.919108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d40ca3b-df1d-4e1e-afb1-3b73dda0196a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:57.143394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0d40ca3b-df1d-4e1e-afb1-3b73dda0196a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:57.180816 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0d40ca3b-df1d-4e1e-afb1-3b73dda0196a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1267 microversion: 2.1 time: 0.277778 Oct 10 23:47:57.182510 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2756/5681] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:56 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1267 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:58.208897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-49c93455-d985-4e89-8227-ce521419653e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:58.210090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-49c93455-d985-4e89-8227-ce521419653e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:58.223259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49c93455-d985-4e89-8227-ce521419653e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:58.225222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49c93455-d985-4e89-8227-ce521419653e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:58.233551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49c93455-d985-4e89-8227-ce521419653e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:58.234549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49c93455-d985-4e89-8227-ce521419653e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:58.235228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49c93455-d985-4e89-8227-ce521419653e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:58.235883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49c93455-d985-4e89-8227-ce521419653e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:58.614008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-49c93455-d985-4e89-8227-ce521419653e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:47:58.625596 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-49c93455-d985-4e89-8227-ce521419653e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1309 microversion: 2.1 time: 0.420751 Oct 10 23:47:58.631023 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2926/5682] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:58 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1309 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:47:59.661220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-30fd2968-0fa0-4e99-b553-d73398816391 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:47:59.665810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-30fd2968-0fa0-4e99-b553-d73398816391 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:47:59.694450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30fd2968-0fa0-4e99-b553-d73398816391 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:59.694974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30fd2968-0fa0-4e99-b553-d73398816391 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:59.697177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30fd2968-0fa0-4e99-b553-d73398816391 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:47:59.698013 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30fd2968-0fa0-4e99-b553-d73398816391 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:47:59.698500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30fd2968-0fa0-4e99-b553-d73398816391 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:47:59.698944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30fd2968-0fa0-4e99-b553-d73398816391 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:00.046508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-30fd2968-0fa0-4e99-b553-d73398816391 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:00.059923 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-30fd2968-0fa0-4e99-b553-d73398816391 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1309 microversion: 2.1 time: 0.408897 Oct 10 23:48:00.060921 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2757/5683] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:47:59 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1309 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:00.341834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-06dd5fae-3a5e-4b88-8b00-904449f420a9 req-3b1f4967-9637-4bf7-880b-f6d6f95a00cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b27c4ace-98ac-4682-8831-ba316b45e35f", "tag": "2bf908b7-8037-4195-bf7c-73759ed2e157"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:00.366010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-06dd5fae-3a5e-4b88-8b00-904449f420a9 req-3b1f4967-9637-4bf7-880b-f6d6f95a00cf service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:00.366519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-06dd5fae-3a5e-4b88-8b00-904449f420a9 req-3b1f4967-9637-4bf7-880b-f6d6f95a00cf service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:00.367019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-06dd5fae-3a5e-4b88-8b00-904449f420a9 req-3b1f4967-9637-4bf7-880b-f6d6f95a00cf service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:00.403492 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-06dd5fae-3a5e-4b88-8b00-904449f420a9 req-3b1f4967-9637-4bf7-880b-f6d6f95a00cf service nova] Creating event network-changed:2bf908b7-8037-4195-bf7c-73759ed2e157 for instance b27c4ace-98ac-4682-8831-ba316b45e35f on n-h1-860864-2 Oct 10 23:48:00.418236 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-06dd5fae-3a5e-4b88-8b00-904449f420a9 req-3b1f4967-9637-4bf7-880b-f6d6f95a00cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089654 Oct 10 23:48:00.422895 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2927/5684] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:48:01.085358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3f54619a-02cc-422b-84ed-2e1b5dee02a6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:01.086235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3f54619a-02cc-422b-84ed-2e1b5dee02a6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:01.089741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:48:01.104485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f54619a-02cc-422b-84ed-2e1b5dee02a6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:01.108628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f54619a-02cc-422b-84ed-2e1b5dee02a6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:01.109260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f54619a-02cc-422b-84ed-2e1b5dee02a6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:01.110152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f54619a-02cc-422b-84ed-2e1b5dee02a6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:01.113657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f54619a-02cc-422b-84ed-2e1b5dee02a6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:01.114223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f54619a-02cc-422b-84ed-2e1b5dee02a6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:01.533928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3f54619a-02cc-422b-84ed-2e1b5dee02a6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:01.553122 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3f54619a-02cc-422b-84ed-2e1b5dee02a6 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1309 microversion: 2.1 time: 0.471468 Oct 10 23:48:01.555648 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2758/5685] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:01 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1309 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:02.597068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1615e0ea-ce69-40ed-875b-baab467060d5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:02.603647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1615e0ea-ce69-40ed-875b-baab467060d5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:02.636586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1615e0ea-ce69-40ed-875b-baab467060d5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:02.637357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1615e0ea-ce69-40ed-875b-baab467060d5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:02.638121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1615e0ea-ce69-40ed-875b-baab467060d5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:02.639513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1615e0ea-ce69-40ed-875b-baab467060d5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:02.640327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1615e0ea-ce69-40ed-875b-baab467060d5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:02.641048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1615e0ea-ce69-40ed-875b-baab467060d5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:03.044186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1615e0ea-ce69-40ed-875b-baab467060d5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:03.062947 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1615e0ea-ce69-40ed-875b-baab467060d5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1309 microversion: 2.1 time: 0.485992 Oct 10 23:48:03.085723 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2928/5686] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:02 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1309 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:04.097551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0032d41c-6812-4bb9-a6ac-e39e5aa4a7ea tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:04.098813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0032d41c-6812-4bb9-a6ac-e39e5aa4a7ea tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:04.112065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0032d41c-6812-4bb9-a6ac-e39e5aa4a7ea tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:04.115204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0032d41c-6812-4bb9-a6ac-e39e5aa4a7ea tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:04.117257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0032d41c-6812-4bb9-a6ac-e39e5aa4a7ea tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:04.118170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0032d41c-6812-4bb9-a6ac-e39e5aa4a7ea tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:04.120595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0032d41c-6812-4bb9-a6ac-e39e5aa4a7ea tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:04.121161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0032d41c-6812-4bb9-a6ac-e39e5aa4a7ea tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:04.452547 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b185600c-39d4-4194-97bd-c87a88b2162a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:04.453958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b185600c-39d4-4194-97bd-c87a88b2162a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:04.464984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:48:04.472429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:48:04.474504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b185600c-39d4-4194-97bd-c87a88b2162a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:04.475358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b185600c-39d4-4194-97bd-c87a88b2162a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:04.485127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b185600c-39d4-4194-97bd-c87a88b2162a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:04.486433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b185600c-39d4-4194-97bd-c87a88b2162a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:04.487126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b185600c-39d4-4194-97bd-c87a88b2162a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:04.487793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b185600c-39d4-4194-97bd-c87a88b2162a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:04.516852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=10 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:48:04.615906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0032d41c-6812-4bb9-a6ac-e39e5aa4a7ea tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:04.625423 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0032d41c-6812-4bb9-a6ac-e39e5aa4a7ea tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1309 microversion: 2.1 time: 0.531899 Oct 10 23:48:04.634327 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2759/5687] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:04 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1309 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:04.979205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b185600c-39d4-4194-97bd-c87a88b2162a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:05.013449 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b185600c-39d4-4194-97bd-c87a88b2162a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.566090 Oct 10 23:48:05.017178 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2929/5688] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:04 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:05.040797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-547b9fa9-92c2-4f27-a4f9-e9532af9aa76 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:05.055997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-547b9fa9-92c2-4f27-a4f9-e9532af9aa76 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:05.067418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-547b9fa9-92c2-4f27-a4f9-e9532af9aa76 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:05.068660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-547b9fa9-92c2-4f27-a4f9-e9532af9aa76 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:05.069144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-547b9fa9-92c2-4f27-a4f9-e9532af9aa76 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:05.069930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-547b9fa9-92c2-4f27-a4f9-e9532af9aa76 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:05.071908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-547b9fa9-92c2-4f27-a4f9-e9532af9aa76 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:05.073875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-547b9fa9-92c2-4f27-a4f9-e9532af9aa76 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:05.507900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-547b9fa9-92c2-4f27-a4f9-e9532af9aa76 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:05.521112 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-547b9fa9-92c2-4f27-a4f9-e9532af9aa76 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.484460 Oct 10 23:48:05.533885 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2760/5689] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:05 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:05.546344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e91bd558-05fe-49c1-931d-edc8677e57ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:05.547561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e91bd558-05fe-49c1-931d-edc8677e57ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:05.559650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e91bd558-05fe-49c1-931d-edc8677e57ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:05.560155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e91bd558-05fe-49c1-931d-edc8677e57ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:05.560603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e91bd558-05fe-49c1-931d-edc8677e57ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:05.562077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e91bd558-05fe-49c1-931d-edc8677e57ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:05.562575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e91bd558-05fe-49c1-931d-edc8677e57ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:05.563233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e91bd558-05fe-49c1-931d-edc8677e57ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:05.654267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-15d3161e-a2f6-43ba-892d-f0bee8575997 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:05.656116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-15d3161e-a2f6-43ba-892d-f0bee8575997 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:05.662791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15d3161e-a2f6-43ba-892d-f0bee8575997 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:05.663298 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15d3161e-a2f6-43ba-892d-f0bee8575997 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:05.663742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15d3161e-a2f6-43ba-892d-f0bee8575997 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:05.665152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15d3161e-a2f6-43ba-892d-f0bee8575997 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:05.665836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15d3161e-a2f6-43ba-892d-f0bee8575997 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:05.666418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15d3161e-a2f6-43ba-892d-f0bee8575997 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:06.027525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-15d3161e-a2f6-43ba-892d-f0bee8575997 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:06.043911 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-15d3161e-a2f6-43ba-892d-f0bee8575997 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1309 microversion: 2.1 time: 0.393333 Oct 10 23:48:06.046680 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2761/5690] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:05 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1309 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:06.388631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e91bd558-05fe-49c1-931d-edc8677e57ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:06.419857 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e91bd558-05fe-49c1-931d-edc8677e57ae tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.875248 Oct 10 23:48:06.426198 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2930/5691] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:05 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:06.469759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1b47e42e-c2fe-4a98-a9de-5f9d9957a075 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:06.470898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1b47e42e-c2fe-4a98-a9de-5f9d9957a075 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:06.478839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b47e42e-c2fe-4a98-a9de-5f9d9957a075 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:06.479643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b47e42e-c2fe-4a98-a9de-5f9d9957a075 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:06.480679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b47e42e-c2fe-4a98-a9de-5f9d9957a075 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:06.481663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b47e42e-c2fe-4a98-a9de-5f9d9957a075 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:06.482310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b47e42e-c2fe-4a98-a9de-5f9d9957a075 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:06.483597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1b47e42e-c2fe-4a98-a9de-5f9d9957a075 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:06.876658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1b47e42e-c2fe-4a98-a9de-5f9d9957a075 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:06.894093 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1b47e42e-c2fe-4a98-a9de-5f9d9957a075 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.429452 Oct 10 23:48:06.899273 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2762/5692] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:06 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:07.073505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cf04b349-7285-4a2b-9c2e-42ecef06710d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:07.077770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cf04b349-7285-4a2b-9c2e-42ecef06710d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:07.090138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf04b349-7285-4a2b-9c2e-42ecef06710d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:07.090681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf04b349-7285-4a2b-9c2e-42ecef06710d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:07.091129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf04b349-7285-4a2b-9c2e-42ecef06710d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:07.097286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf04b349-7285-4a2b-9c2e-42ecef06710d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:07.098090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf04b349-7285-4a2b-9c2e-42ecef06710d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:07.098694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf04b349-7285-4a2b-9c2e-42ecef06710d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:07.167851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cc6426eb-d734-4ac3-bd69-0dd1174945c8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1394942429", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "17157a6b-ea9d-4593-b208-9ce16ed44768"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:07.288690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-cc6426eb-d734-4ac3-bd69-0dd1174945c8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] validate_networks() for [('17157a6b-ea9d-4593-b208-9ce16ed44768', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:48:07.661429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cf04b349-7285-4a2b-9c2e-42ecef06710d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:07.690231 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cf04b349-7285-4a2b-9c2e-42ecef06710d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1309 microversion: 2.1 time: 0.620299 Oct 10 23:48:07.707606 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2931/5693] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:07 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1309 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:08.513446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-cc6426eb-d734-4ac3-bd69-0dd1174945c8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:48:08.515755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-cc6426eb-d734-4ac3-bd69-0dd1174945c8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:48:08.516418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-cc6426eb-d734-4ac3-bd69-0dd1174945c8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:48:08.516991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-cc6426eb-d734-4ac3-bd69-0dd1174945c8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:48:08.517592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-cc6426eb-d734-4ac3-bd69-0dd1174945c8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:48:08.537610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc6426eb-d734-4ac3-bd69-0dd1174945c8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:08.538105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc6426eb-d734-4ac3-bd69-0dd1174945c8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:08.538549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc6426eb-d734-4ac3-bd69-0dd1174945c8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:08.539288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc6426eb-d734-4ac3-bd69-0dd1174945c8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:08.539746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc6426eb-d734-4ac3-bd69-0dd1174945c8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:08.540174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc6426eb-d734-4ac3-bd69-0dd1174945c8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:08.580761 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-cc6426eb-d734-4ac3-bd69-0dd1174945c8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Getting quotas for project f798f5f5321f40b89fc5bacc3b9389fe. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:48:08.600040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-cc6426eb-d734-4ac3-bd69-0dd1174945c8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Getting quotas for user cfd8618ee1864d1d86de2def024b49bb and project f798f5f5321f40b89fc5bacc3b9389fe. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:48:08.626751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cc6426eb-d734-4ac3-bd69-0dd1174945c8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:48:08.629153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cc6426eb-d734-4ac3-bd69-0dd1174945c8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 33e611fa-a406-48a0-89d8-cc9217a87b5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:48:08.715898 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cc6426eb-d734-4ac3-bd69-0dd1174945c8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.551566 Oct 10 23:48:08.717833 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2763/5694] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:48:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 23:48:08.722027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e6b9b7c0-4090-48a9-954a-80c07e231ca1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:08.723018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e6b9b7c0-4090-48a9-954a-80c07e231ca1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:08.730407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b1ee6575-6b41-4e7d-a4d2-05c608a6d0e4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:08.732189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b1ee6575-6b41-4e7d-a4d2-05c608a6d0e4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 33e611fa-a406-48a0-89d8-cc9217a87b5d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:08.746851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6b9b7c0-4090-48a9-954a-80c07e231ca1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:08.748040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6b9b7c0-4090-48a9-954a-80c07e231ca1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:08.749963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6b9b7c0-4090-48a9-954a-80c07e231ca1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:08.751837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6b9b7c0-4090-48a9-954a-80c07e231ca1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:08.756248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6b9b7c0-4090-48a9-954a-80c07e231ca1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:08.757149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6b9b7c0-4090-48a9-954a-80c07e231ca1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:09.069632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e6b9b7c0-4090-48a9-954a-80c07e231ca1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:09.084090 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e6b9b7c0-4090-48a9-954a-80c07e231ca1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1309 microversion: 2.1 time: 0.368618 Oct 10 23:48:09.084950 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2932/5695] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:08 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1309 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:48:09.362034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b1ee6575-6b41-4e7d-a4d2-05c608a6d0e4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:09.370168 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b1ee6575-6b41-4e7d-a4d2-05c608a6d0e4 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d" status: 200 len: 1215 microversion: 2.1 time: 0.643867 Oct 10 23:48:09.377282 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2764/5696] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:08 2022] GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d => generated 1215 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:48:09.423912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-0bfa306b-34a7-49e8-9c9a-cafdefda3dfc req-df9b9b3d-1b75-40aa-9440-c5170b7d24bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27c4ace-98ac-4682-8831-ba316b45e35f", "name": "network-vif-plugged", "status": "completed", "tag": "2bf908b7-8037-4195-bf7c-73759ed2e157"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:09.444603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0bfa306b-34a7-49e8-9c9a-cafdefda3dfc req-df9b9b3d-1b75-40aa-9440-c5170b7d24bb service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:09.447357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0bfa306b-34a7-49e8-9c9a-cafdefda3dfc req-df9b9b3d-1b75-40aa-9440-c5170b7d24bb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:09.449642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0bfa306b-34a7-49e8-9c9a-cafdefda3dfc req-df9b9b3d-1b75-40aa-9440-c5170b7d24bb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:09.501291 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-0bfa306b-34a7-49e8-9c9a-cafdefda3dfc req-df9b9b3d-1b75-40aa-9440-c5170b7d24bb service nova] Creating event network-vif-plugged:2bf908b7-8037-4195-bf7c-73759ed2e157 for instance b27c4ace-98ac-4682-8831-ba316b45e35f on n-h1-860864-2 Oct 10 23:48:09.520182 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-0bfa306b-34a7-49e8-9c9a-cafdefda3dfc req-df9b9b3d-1b75-40aa-9440-c5170b7d24bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104002 Oct 10 23:48:09.526622 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2933/5697] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:48:10.117416 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f6764655-6404-46ed-b3be-016da57afa03 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:10.118848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f6764655-6404-46ed-b3be-016da57afa03 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:10.137739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6764655-6404-46ed-b3be-016da57afa03 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:10.142827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6764655-6404-46ed-b3be-016da57afa03 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:10.143532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6764655-6404-46ed-b3be-016da57afa03 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:10.144466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6764655-6404-46ed-b3be-016da57afa03 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:10.145113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6764655-6404-46ed-b3be-016da57afa03 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:10.145789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f6764655-6404-46ed-b3be-016da57afa03 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:10.412373 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4f8cfd1f-ecf6-4089-b46b-b18fa28970f3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:10.414338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4f8cfd1f-ecf6-4089-b46b-b18fa28970f3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 33e611fa-a406-48a0-89d8-cc9217a87b5d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:10.431756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f8cfd1f-ecf6-4089-b46b-b18fa28970f3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:10.433779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f8cfd1f-ecf6-4089-b46b-b18fa28970f3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:10.434618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f8cfd1f-ecf6-4089-b46b-b18fa28970f3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:10.443959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f8cfd1f-ecf6-4089-b46b-b18fa28970f3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:10.445142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f8cfd1f-ecf6-4089-b46b-b18fa28970f3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:10.445869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f8cfd1f-ecf6-4089-b46b-b18fa28970f3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:10.786745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4f8cfd1f-ecf6-4089-b46b-b18fa28970f3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:10.808292 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4f8cfd1f-ecf6-4089-b46b-b18fa28970f3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d" status: 200 len: 1267 microversion: 2.1 time: 0.403659 Oct 10 23:48:10.809303 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2934/5698] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:10 2022] GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d => generated 1267 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:10.903595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f6764655-6404-46ed-b3be-016da57afa03 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:10.932654 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f6764655-6404-46ed-b3be-016da57afa03 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1309 microversion: 2.1 time: 0.821900 Oct 10 23:48:10.938745 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2765/5699] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:10 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1309 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:11.844353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a699f032-a2ee-497a-b29c-73d2376e65ba tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:11.845959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a699f032-a2ee-497a-b29c-73d2376e65ba tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 33e611fa-a406-48a0-89d8-cc9217a87b5d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:11.859437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a699f032-a2ee-497a-b29c-73d2376e65ba tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:11.871651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a699f032-a2ee-497a-b29c-73d2376e65ba tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:11.872289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a699f032-a2ee-497a-b29c-73d2376e65ba tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:11.873845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a699f032-a2ee-497a-b29c-73d2376e65ba tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:11.874724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a699f032-a2ee-497a-b29c-73d2376e65ba tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:11.877475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a699f032-a2ee-497a-b29c-73d2376e65ba tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:12.065775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a699f032-a2ee-497a-b29c-73d2376e65ba tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:12.085751 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a699f032-a2ee-497a-b29c-73d2376e65ba tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d" status: 200 len: 1273 microversion: 2.1 time: 0.246013 Oct 10 23:48:12.089081 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2935/5700] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:11 2022] GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d => generated 1273 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:12.104061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-38519719-afdd-4cb3-aba1-ec535dc3ae3a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:12.105143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-38519719-afdd-4cb3-aba1-ec535dc3ae3a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:12.114899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38519719-afdd-4cb3-aba1-ec535dc3ae3a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:12.115739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38519719-afdd-4cb3-aba1-ec535dc3ae3a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:12.117036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38519719-afdd-4cb3-aba1-ec535dc3ae3a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:12.118176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38519719-afdd-4cb3-aba1-ec535dc3ae3a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:12.118891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38519719-afdd-4cb3-aba1-ec535dc3ae3a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:12.119546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-38519719-afdd-4cb3-aba1-ec535dc3ae3a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:12.178768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e5365b85-ce8d-4153-bc80-c1492f18f659 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Action: 'create', calling method: .version_select at 0x7f662a89e820>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1702767426", "policies": ["affinity"]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:12.226176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-e5365b85-ce8d-4153-bc80-c1492f18f659 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_groups'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:48:12.234879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-e5365b85-ce8d-4153-bc80-c1492f18f659 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for user 45dbc5ac25e34f3cba1d319565b485e3 and project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_groups'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:48:12.340941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-e5365b85-ce8d-4153-bc80-c1492f18f659 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_groups'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:48:12.358672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-e5365b85-ce8d-4153-bc80-c1492f18f659 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for user 45dbc5ac25e34f3cba1d319565b485e3 and project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_groups'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:48:12.410453 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e5365b85-ce8d-4153-bc80-c1492f18f659 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.545286 Oct 10 23:48:12.411724 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2766/5701] 10.222.0.23 () {60 vars in 1174 bytes} [Mon Oct 10 23:48:11 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:48:12.429026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-38519719-afdd-4cb3-aba1-ec535dc3ae3a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:12.431255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1cf6a93a-44b7-4e26-9fd1-2ce6696cc91e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Action: 'create', calling method: .version_select at 0x7f662a7ed310>, body: {"server_group": {"name": "tempest-server-group-1673956931", "policies": ["affinity"]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:12.445031 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-38519719-afdd-4cb3-aba1-ec535dc3ae3a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1491 microversion: 2.1 time: 0.353956 Oct 10 23:48:12.459165 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2936/5702] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:12 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1491 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:12.473086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-1cf6a93a-44b7-4e26-9fd1-2ce6696cc91e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_groups'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:48:12.473866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7434c07f-0227-491d-b353-a0ff28ab34eb tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1622866309"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:12.477413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7434c07f-0227-491d-b353-a0ff28ab34eb tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:12.486075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7434c07f-0227-491d-b353-a0ff28ab34eb tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:12.486830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7434c07f-0227-491d-b353-a0ff28ab34eb tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:12.487428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7434c07f-0227-491d-b353-a0ff28ab34eb tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:12.488951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7434c07f-0227-491d-b353-a0ff28ab34eb tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:12.489858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-1cf6a93a-44b7-4e26-9fd1-2ce6696cc91e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for user 45dbc5ac25e34f3cba1d319565b485e3 and project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_groups'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:48:12.490717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7434c07f-0227-491d-b353-a0ff28ab34eb tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:12.491778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7434c07f-0227-491d-b353-a0ff28ab34eb tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:12.590285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-1cf6a93a-44b7-4e26-9fd1-2ce6696cc91e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_groups'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:48:12.602209 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7434c07f-0227-491d-b353-a0ff28ab34eb tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "PUT /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1076 microversion: 2.1 time: 0.134279 Oct 10 23:48:12.618592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-1cf6a93a-44b7-4e26-9fd1-2ce6696cc91e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for user 45dbc5ac25e34f3cba1d319565b485e3 and project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_groups'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:48:12.619469 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2937/5703] 10.222.0.23 () {60 vars in 1256 bytes} [Mon Oct 10 23:48:12 2022] PUT /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1076 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:12.627624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0a895e3d-cbe9-4403-84aa-ef08ff015129 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:12.629701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0a895e3d-cbe9-4403-84aa-ef08ff015129 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:12.637792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a895e3d-cbe9-4403-84aa-ef08ff015129 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:12.640287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a895e3d-cbe9-4403-84aa-ef08ff015129 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:12.640958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a895e3d-cbe9-4403-84aa-ef08ff015129 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:12.642035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a895e3d-cbe9-4403-84aa-ef08ff015129 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:12.642706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a895e3d-cbe9-4403-84aa-ef08ff015129 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:12.643351 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a895e3d-cbe9-4403-84aa-ef08ff015129 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:12.649480 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1cf6a93a-44b7-4e26-9fd1-2ce6696cc91e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.228053 Oct 10 23:48:12.661752 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2767/5704] 10.222.0.23 () {60 vars in 1173 bytes} [Mon Oct 10 23:48:12 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:48:12.676790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ce161cee-2d0e-40f7-8881-084037d9f8ee tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Action: 'create', calling method: .version_select at 0x7f662a3ff0d0>, body: {"server_group": {"name": "tempest-server-group-1673956931", "policies": ["affinity"]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:12.736439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ce161cee-2d0e-40f7-8881-084037d9f8ee tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_groups'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:48:12.749940 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ce161cee-2d0e-40f7-8881-084037d9f8ee tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for user 45dbc5ac25e34f3cba1d319565b485e3 and project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_groups'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:48:12.819508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:48:12.876301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ce161cee-2d0e-40f7-8881-084037d9f8ee tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_groups'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:48:12.896164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ce161cee-2d0e-40f7-8881-084037d9f8ee tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for user 45dbc5ac25e34f3cba1d319565b485e3 and project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_groups'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:48:12.933407 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ce161cee-2d0e-40f7-8881-084037d9f8ee tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.263884 Oct 10 23:48:12.936489 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2768/5705] 10.222.0.23 () {60 vars in 1173 bytes} [Mon Oct 10 23:48:12 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:48:12.950635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-28befae1-b8dc-461e-8bb1-1f051667f8af tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:12.952224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0a895e3d-cbe9-4403-84aa-ef08ff015129 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:12.972906 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0a895e3d-cbe9-4403-84aa-ef08ff015129 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1502 microversion: 2.1 time: 0.349874 Oct 10 23:48:12.988762 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2938/5706] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:12 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1502 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:13.001509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c918b6ce-4123-4c5e-9c44-4e1ecf3befde tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:13.002176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c918b6ce-4123-4c5e-9c44-4e1ecf3befde tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:13.009733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c918b6ce-4123-4c5e-9c44-4e1ecf3befde tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:13.010231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c918b6ce-4123-4c5e-9c44-4e1ecf3befde tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:13.010667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c918b6ce-4123-4c5e-9c44-4e1ecf3befde tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:13.011378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c918b6ce-4123-4c5e-9c44-4e1ecf3befde tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:13.011968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c918b6ce-4123-4c5e-9c44-4e1ecf3befde tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:13.012254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c918b6ce-4123-4c5e-9c44-4e1ecf3befde tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:13.029987 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-28befae1-b8dc-461e-8bb1-1f051667f8af tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/ef5a94eb-7da1-402b-bfa5-3a40181c38bf" status: 204 len: 0 microversion: 2.1 time: 0.082971 Oct 10 23:48:13.032708 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2769/5707] 10.222.0.23 () {58 vars in 1266 bytes} [Mon Oct 10 23:48:12 2022] DELETE /compute/v2.1/os-server-groups/ef5a94eb-7da1-402b-bfa5-3a40181c38bf => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:48:13.055460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-832ad85a-ccd6-4aa6-87ef-c92ed658a3a9 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:13.077192 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-832ad85a-ccd6-4aa6-87ef-c92ed658a3a9 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.039446 Oct 10 23:48:13.081846 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2770/5708] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:48:13 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:48:13.109487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e905c0d6-d7e7-49d5-a087-4c3909db1a5d tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:13.193560 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e905c0d6-d7e7-49d5-a087-4c3909db1a5d tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/968d1964-5359-4558-97ff-d477732ddf9b" status: 204 len: 0 microversion: 2.1 time: 0.094481 Oct 10 23:48:13.202358 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2771/5709] 10.222.0.23 () {58 vars in 1266 bytes} [Mon Oct 10 23:48:13 2022] DELETE /compute/v2.1/os-server-groups/968d1964-5359-4558-97ff-d477732ddf9b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:48:13.221578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5ad56423-7def-4eea-b088-dbf0054aa26f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:13.222444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5ad56423-7def-4eea-b088-dbf0054aa26f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 33e611fa-a406-48a0-89d8-cc9217a87b5d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:13.260177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ad56423-7def-4eea-b088-dbf0054aa26f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:13.263730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ad56423-7def-4eea-b088-dbf0054aa26f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:13.265889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ad56423-7def-4eea-b088-dbf0054aa26f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:13.272119 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ad56423-7def-4eea-b088-dbf0054aa26f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:13.272681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ad56423-7def-4eea-b088-dbf0054aa26f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:13.273134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ad56423-7def-4eea-b088-dbf0054aa26f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:13.454311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c918b6ce-4123-4c5e-9c44-4e1ecf3befde tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:13.468124 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c918b6ce-4123-4c5e-9c44-4e1ecf3befde tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1502 microversion: 2.1 time: 0.472233 Oct 10 23:48:13.468727 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2939/5710] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:12 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1502 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:48:13.501409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-40011933-b021-4532-9266-22cd2e4a7866 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:13.536020 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-40011933-b021-4532-9266-22cd2e4a7866 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.049340 Oct 10 23:48:13.546949 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2940/5711] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:48:13 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:48:13.553021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2381fde6-9d16-4259-92a9-893687282668 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:13.562400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2381fde6-9d16-4259-92a9-893687282668 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:13.563283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2381fde6-9d16-4259-92a9-893687282668 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:13.564232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2381fde6-9d16-4259-92a9-893687282668 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:13.594927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2381fde6-9d16-4259-92a9-893687282668 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Going to try to stop instance {{(pid=120613) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 23:48:13.668907 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2381fde6-9d16-4259-92a9-893687282668 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "POST /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f/action" status: 202 len: 0 microversion: 2.1 time: 0.118719 Oct 10 23:48:13.680207 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2941/5712] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:48:13 2022] POST /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:48:13.697189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c4023277-1465-4676-b336-60b036d8e185 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Action: 'create', calling method: .version_select at 0x7f662a5f4310>, body: {"server_group": {"name": "tempest-server-group-1167332891", "policies": ["affinity"]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:13.747923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-c4023277-1465-4676-b336-60b036d8e185 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_groups'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:48:13.763520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-c4023277-1465-4676-b336-60b036d8e185 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for user 45dbc5ac25e34f3cba1d319565b485e3 and project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_groups'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:48:13.869924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-c4023277-1465-4676-b336-60b036d8e185 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_groups'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:48:13.898574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-c4023277-1465-4676-b336-60b036d8e185 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for user 45dbc5ac25e34f3cba1d319565b485e3 and project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_groups'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:48:13.961401 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c4023277-1465-4676-b336-60b036d8e185 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.278280 Oct 10 23:48:13.962022 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2942/5713] 10.222.0.23 () {60 vars in 1173 bytes} [Mon Oct 10 23:48:13 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:48:13.984775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a4762ee9-7455-47b3-ac2d-06aca308ec72 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:13.985586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a4762ee9-7455-47b3-ac2d-06aca308ec72 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:13.996567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4762ee9-7455-47b3-ac2d-06aca308ec72 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:13.997068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4762ee9-7455-47b3-ac2d-06aca308ec72 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:13.997584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4762ee9-7455-47b3-ac2d-06aca308ec72 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:14.001568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4762ee9-7455-47b3-ac2d-06aca308ec72 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:14.002999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4762ee9-7455-47b3-ac2d-06aca308ec72 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:14.004504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4762ee9-7455-47b3-ac2d-06aca308ec72 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:14.019972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:48:14.119600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5ad56423-7def-4eea-b088-dbf0054aa26f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:14.128662 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5ad56423-7def-4eea-b088-dbf0054aa26f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d" status: 200 len: 1315 microversion: 2.1 time: 0.924454 Oct 10 23:48:14.129265 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2772/5714] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:13 2022] GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d => generated 1315 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:14.172072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-af8f2f57-2d0a-4a27-b512-fe2697e20b98 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:14.241418 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-af8f2f57-2d0a-4a27-b512-fe2697e20b98 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/5a967451-77f7-49ab-a682-c5857f91e683" status: 204 len: 0 microversion: 2.1 time: 0.098545 Oct 10 23:48:14.242340 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2773/5715] 10.222.0.23 () {58 vars in 1266 bytes} [Mon Oct 10 23:48:14 2022] DELETE /compute/v2.1/os-server-groups/5a967451-77f7-49ab-a682-c5857f91e683 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:48:14.266005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f82a6865-3605-4919-939a-c23d57a9cde6 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:14.291521 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f82a6865-3605-4919-939a-c23d57a9cde6 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.043361 Oct 10 23:48:14.292883 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2774/5716] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:48:14 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:48:14.305890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5441853a-6d54-46ef-8124-74912cd2e18c tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Action: 'create', calling method: .version_select at 0x7f662a31a9d0>, body: {"server_group": {"name": "tempest-server-group-24675942", "policies": ["anti-affinity"]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:14.364367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-5441853a-6d54-46ef-8124-74912cd2e18c tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_groups'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:48:14.369105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a4762ee9-7455-47b3-ac2d-06aca308ec72 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:14.381695 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-5441853a-6d54-46ef-8124-74912cd2e18c tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for user 45dbc5ac25e34f3cba1d319565b485e3 and project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_groups'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:48:14.386853 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a4762ee9-7455-47b3-ac2d-06aca308ec72 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1512 microversion: 2.1 time: 0.423661 Oct 10 23:48:14.396062 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2943/5717] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:13 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1512 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:14.522771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-5441853a-6d54-46ef-8124-74912cd2e18c tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_groups'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:48:14.534805 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-5441853a-6d54-46ef-8124-74912cd2e18c tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for user 45dbc5ac25e34f3cba1d319565b485e3 and project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_groups'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:48:14.560188 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5441853a-6d54-46ef-8124-74912cd2e18c tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 167 microversion: 2.1 time: 0.257692 Oct 10 23:48:14.563337 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2775/5718] 10.222.0.23 () {60 vars in 1173 bytes} [Mon Oct 10 23:48:14 2022] POST /compute/v2.1/os-server-groups => generated 167 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:48:14.576722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1fe64a24-e388-4045-9f19-7137eb48b601 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:14.673829 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1fe64a24-e388-4045-9f19-7137eb48b601 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/1cd7783c-0b15-45c6-9fd1-207b0483281e" status: 204 len: 0 microversion: 2.1 time: 0.102878 Oct 10 23:48:14.674783 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2944/5719] 10.222.0.23 () {58 vars in 1266 bytes} [Mon Oct 10 23:48:14 2022] DELETE /compute/v2.1/os-server-groups/1cd7783c-0b15-45c6-9fd1-207b0483281e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:48:14.692668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a8d0d548-eeba-4874-a833-a8f1d77c3446 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:14.743332 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a8d0d548-eeba-4874-a833-a8f1d77c3446 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.059556 Oct 10 23:48:14.745712 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2776/5720] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:48:14 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:48:14.940062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2b7cefff-3526-43ce-8047-6628d510a8d8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1647668551", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "1365b3ba-504c-48c7-94dc-29b9f835ccf5"}]}, "os:scheduler_hints": {"group": "2f444903-8c1b-4de3-9573-8a66bdb782fa"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:15.051469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-2b7cefff-3526-43ce-8047-6628d510a8d8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] validate_networks() for [('1365b3ba-504c-48c7-94dc-29b9f835ccf5', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:48:15.159841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-40a56c32-8725-4242-9d24-23a1a348410e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:15.160468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-40a56c32-8725-4242-9d24-23a1a348410e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 33e611fa-a406-48a0-89d8-cc9217a87b5d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:15.172768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40a56c32-8725-4242-9d24-23a1a348410e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:15.173262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40a56c32-8725-4242-9d24-23a1a348410e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:15.173736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40a56c32-8725-4242-9d24-23a1a348410e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:15.179285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40a56c32-8725-4242-9d24-23a1a348410e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:15.179933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40a56c32-8725-4242-9d24-23a1a348410e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:15.180390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-40a56c32-8725-4242-9d24-23a1a348410e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:16.146973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-40a56c32-8725-4242-9d24-23a1a348410e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:16.165584 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-40a56c32-8725-4242-9d24-23a1a348410e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d" status: 200 len: 1315 microversion: 2.1 time: 1.008790 Oct 10 23:48:16.170023 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2777/5721] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:15 2022] GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d => generated 1315 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:48:16.190629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0b43163e-e5a6-4bbe-9f62-f97c1ae1b6d8 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:16.191807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0b43163e-e5a6-4bbe-9f62-f97c1ae1b6d8 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:16.203571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b43163e-e5a6-4bbe-9f62-f97c1ae1b6d8 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:16.204071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b43163e-e5a6-4bbe-9f62-f97c1ae1b6d8 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:16.204504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b43163e-e5a6-4bbe-9f62-f97c1ae1b6d8 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:16.213074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b43163e-e5a6-4bbe-9f62-f97c1ae1b6d8 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:16.214085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b43163e-e5a6-4bbe-9f62-f97c1ae1b6d8 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:16.218336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b43163e-e5a6-4bbe-9f62-f97c1ae1b6d8 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:16.382745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-2b7cefff-3526-43ce-8047-6628d510a8d8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:48:16.383351 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-2b7cefff-3526-43ce-8047-6628d510a8d8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:48:16.383720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-2b7cefff-3526-43ce-8047-6628d510a8d8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:48:16.384368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-2b7cefff-3526-43ce-8047-6628d510a8d8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:48:16.384960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-2b7cefff-3526-43ce-8047-6628d510a8d8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:48:16.412238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b7cefff-3526-43ce-8047-6628d510a8d8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:16.413059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b7cefff-3526-43ce-8047-6628d510a8d8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:16.413828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b7cefff-3526-43ce-8047-6628d510a8d8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:16.415466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b7cefff-3526-43ce-8047-6628d510a8d8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:16.416118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b7cefff-3526-43ce-8047-6628d510a8d8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:16.416869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b7cefff-3526-43ce-8047-6628d510a8d8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:16.442205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-2b7cefff-3526-43ce-8047-6628d510a8d8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:48:16.448216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-2b7cefff-3526-43ce-8047-6628d510a8d8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for user 45dbc5ac25e34f3cba1d319565b485e3 and project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:48:16.464554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:48:16.466356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2b7cefff-3526-43ce-8047-6628d510a8d8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:48:16.469686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2b7cefff-3526-43ce-8047-6628d510a8d8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] [instance: acb871a7-11b3-408c-b338-1c6310c113a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:48:16.551391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-2b7cefff-3526-43ce-8047-6628d510a8d8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_group_members'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:48:16.560647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-2b7cefff-3526-43ce-8047-6628d510a8d8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for user 45dbc5ac25e34f3cba1d319565b485e3 and project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_group_members'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:48:16.611145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-2b7cefff-3526-43ce-8047-6628d510a8d8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_group_members'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:48:16.618603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-2b7cefff-3526-43ce-8047-6628d510a8d8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Getting quotas for user 45dbc5ac25e34f3cba1d319565b485e3 and project ea6a1d72c53b4cc299596eed32fe9277. Resources: {'server_group_members'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:48:16.664236 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2b7cefff-3526-43ce-8047-6628d510a8d8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.732216 Oct 10 23:48:16.666060 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2945/5722] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:48:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:48:16.681278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-05861950-4080-44f6-b8b2-1616923dcc38 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:16.684737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-05861950-4080-44f6-b8b2-1616923dcc38 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] [instance: acb871a7-11b3-408c-b338-1c6310c113a7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:16.813335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-05861950-4080-44f6-b8b2-1616923dcc38 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dbc5ac25e34f3cba1d319565b485e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a1d72c53b4cc299596eed32fe9277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:16.831410 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-05861950-4080-44f6-b8b2-1616923dcc38 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7" status: 200 len: 1213 microversion: 2.1 time: 0.153016 Oct 10 23:48:16.831956 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2946/5723] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:16 2022] GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 => generated 1213 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:48:16.934641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0b43163e-e5a6-4bbe-9f62-f97c1ae1b6d8 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:16.951219 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0b43163e-e5a6-4bbe-9f62-f97c1ae1b6d8 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1512 microversion: 2.1 time: 0.779200 Oct 10 23:48:16.953883 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2778/5724] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:16 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1512 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:17.193022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-880118b2-a055-4867-a6e8-2372474ff87a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:17.194452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-880118b2-a055-4867-a6e8-2372474ff87a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 33e611fa-a406-48a0-89d8-cc9217a87b5d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:17.225061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-880118b2-a055-4867-a6e8-2372474ff87a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:17.230160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-880118b2-a055-4867-a6e8-2372474ff87a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:17.232077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-880118b2-a055-4867-a6e8-2372474ff87a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:17.237954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-880118b2-a055-4867-a6e8-2372474ff87a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:17.239196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-880118b2-a055-4867-a6e8-2372474ff87a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:17.243902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-880118b2-a055-4867-a6e8-2372474ff87a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:17.651399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-880118b2-a055-4867-a6e8-2372474ff87a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:17.668635 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-880118b2-a055-4867-a6e8-2372474ff87a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d" status: 200 len: 1315 microversion: 2.1 time: 0.483289 Oct 10 23:48:17.687710 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2947/5725] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:17 2022] GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:17.729825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-23f41bd0-7b6a-41f4-9db3-51e6abd4c89c req-af2ad3ad-be15-41d4-8480-cd2afa1ebd63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e611fa-a406-48a0-89d8-cc9217a87b5d", "tag": "1cbc9253-2a95-4a16-af9a-23e82d53caf6"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:17.745356 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-23f41bd0-7b6a-41f4-9db3-51e6abd4c89c req-af2ad3ad-be15-41d4-8480-cd2afa1ebd63 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:17.746027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-23f41bd0-7b6a-41f4-9db3-51e6abd4c89c req-af2ad3ad-be15-41d4-8480-cd2afa1ebd63 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:17.747170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-23f41bd0-7b6a-41f4-9db3-51e6abd4c89c req-af2ad3ad-be15-41d4-8480-cd2afa1ebd63 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:17.768164 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-23f41bd0-7b6a-41f4-9db3-51e6abd4c89c req-af2ad3ad-be15-41d4-8480-cd2afa1ebd63 service nova] Creating event network-changed:1cbc9253-2a95-4a16-af9a-23e82d53caf6 for instance 33e611fa-a406-48a0-89d8-cc9217a87b5d on n-h2-860864-2 Oct 10 23:48:17.775828 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-23f41bd0-7b6a-41f4-9db3-51e6abd4c89c req-af2ad3ad-be15-41d4-8480-cd2afa1ebd63 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.491174 Oct 10 23:48:17.777008 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2779/5726] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:48:17.857391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-638342a6-97ff-4370-aed2-bed9fbd6ef66 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:17.858175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-638342a6-97ff-4370-aed2-bed9fbd6ef66 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] [instance: acb871a7-11b3-408c-b338-1c6310c113a7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:17.986763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ab34ded1-2b6c-4092-9cf0-aff33155463c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:17.987560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ab34ded1-2b6c-4092-9cf0-aff33155463c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:17.998315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-638342a6-97ff-4370-aed2-bed9fbd6ef66 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dbc5ac25e34f3cba1d319565b485e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a1d72c53b4cc299596eed32fe9277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:18.013513 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-638342a6-97ff-4370-aed2-bed9fbd6ef66 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7" status: 200 len: 1213 microversion: 2.1 time: 0.161186 Oct 10 23:48:18.016404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab34ded1-2b6c-4092-9cf0-aff33155463c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:18.016916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab34ded1-2b6c-4092-9cf0-aff33155463c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:18.017367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab34ded1-2b6c-4092-9cf0-aff33155463c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:18.017722 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2948/5727] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:17 2022] GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 => generated 1213 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:18.018557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab34ded1-2b6c-4092-9cf0-aff33155463c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:18.019403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab34ded1-2b6c-4092-9cf0-aff33155463c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:18.020025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab34ded1-2b6c-4092-9cf0-aff33155463c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:18.025207 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:48:18.570387 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ab34ded1-2b6c-4092-9cf0-aff33155463c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:18.573664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:48:18.591611 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ab34ded1-2b6c-4092-9cf0-aff33155463c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1512 microversion: 2.1 time: 0.610426 Oct 10 23:48:18.593410 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2780/5728] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:17 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1512 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:18.700242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-df292df1-9616-4063-9119-b7e312153895 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:18.700926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-df292df1-9616-4063-9119-b7e312153895 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 33e611fa-a406-48a0-89d8-cc9217a87b5d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:18.748983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df292df1-9616-4063-9119-b7e312153895 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:18.752113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df292df1-9616-4063-9119-b7e312153895 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:18.765127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df292df1-9616-4063-9119-b7e312153895 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:18.768562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df292df1-9616-4063-9119-b7e312153895 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:18.800374 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df292df1-9616-4063-9119-b7e312153895 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:18.802489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df292df1-9616-4063-9119-b7e312153895 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:19.044077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-098bcb55-d738-49bb-be67-9662899999b8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:19.044663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-098bcb55-d738-49bb-be67-9662899999b8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] [instance: acb871a7-11b3-408c-b338-1c6310c113a7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:19.057330 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-098bcb55-d738-49bb-be67-9662899999b8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:19.057865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-098bcb55-d738-49bb-be67-9662899999b8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:19.059465 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-098bcb55-d738-49bb-be67-9662899999b8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:19.060220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-098bcb55-d738-49bb-be67-9662899999b8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:19.060697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-098bcb55-d738-49bb-be67-9662899999b8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:19.063866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-098bcb55-d738-49bb-be67-9662899999b8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:19.844651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-098bcb55-d738-49bb-be67-9662899999b8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dbc5ac25e34f3cba1d319565b485e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a1d72c53b4cc299596eed32fe9277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:19.861315 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-098bcb55-d738-49bb-be67-9662899999b8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7" status: 200 len: 1273 microversion: 2.1 time: 0.818475 Oct 10 23:48:19.862263 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2781/5729] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:19 2022] GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 => generated 1273 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:48:19.870013 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7804d41c-4fd0-46b6-8379-f0bb7bab1fd1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:19.888035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7804d41c-4fd0-46b6-8379-f0bb7bab1fd1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:19.910258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7804d41c-4fd0-46b6-8379-f0bb7bab1fd1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:19.915941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7804d41c-4fd0-46b6-8379-f0bb7bab1fd1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:19.916704 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7804d41c-4fd0-46b6-8379-f0bb7bab1fd1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:19.929662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7804d41c-4fd0-46b6-8379-f0bb7bab1fd1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:19.941167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7804d41c-4fd0-46b6-8379-f0bb7bab1fd1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:19.941985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7804d41c-4fd0-46b6-8379-f0bb7bab1fd1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:20.482307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-df292df1-9616-4063-9119-b7e312153895 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:20.505131 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-df292df1-9616-4063-9119-b7e312153895 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d" status: 200 len: 1315 microversion: 2.1 time: 1.804848 Oct 10 23:48:20.506503 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2949/5730] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:18 2022] GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d => generated 1315 bytes in 1811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:20.736684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7804d41c-4fd0-46b6-8379-f0bb7bab1fd1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:20.751656 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7804d41c-4fd0-46b6-8379-f0bb7bab1fd1 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1512 microversion: 2.1 time: 0.881612 Oct 10 23:48:20.753119 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2782/5731] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:19 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1512 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:20.902083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e2beba3c-3e4b-40b3-8ab6-a3088c5de39e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:20.903072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e2beba3c-3e4b-40b3-8ab6-a3088c5de39e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] [instance: acb871a7-11b3-408c-b338-1c6310c113a7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:20.928616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e2beba3c-3e4b-40b3-8ab6-a3088c5de39e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:20.932005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e2beba3c-3e4b-40b3-8ab6-a3088c5de39e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:20.932588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e2beba3c-3e4b-40b3-8ab6-a3088c5de39e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:20.944968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e2beba3c-3e4b-40b3-8ab6-a3088c5de39e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:20.950850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e2beba3c-3e4b-40b3-8ab6-a3088c5de39e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:20.953200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e2beba3c-3e4b-40b3-8ab6-a3088c5de39e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:21.448073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e2beba3c-3e4b-40b3-8ab6-a3088c5de39e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dbc5ac25e34f3cba1d319565b485e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a1d72c53b4cc299596eed32fe9277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:21.483648 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e2beba3c-3e4b-40b3-8ab6-a3088c5de39e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7" status: 200 len: 1271 microversion: 2.1 time: 0.586642 Oct 10 23:48:21.492661 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2950/5732] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:20 2022] GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 => generated 1271 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:21.531069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e4a0dc22-379a-4c4f-9ab5-6cefb24ba101 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:21.532185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e4a0dc22-379a-4c4f-9ab5-6cefb24ba101 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 33e611fa-a406-48a0-89d8-cc9217a87b5d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:21.560665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4a0dc22-379a-4c4f-9ab5-6cefb24ba101 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:21.569486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4a0dc22-379a-4c4f-9ab5-6cefb24ba101 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:21.570162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4a0dc22-379a-4c4f-9ab5-6cefb24ba101 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:21.571168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4a0dc22-379a-4c4f-9ab5-6cefb24ba101 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:21.578735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4a0dc22-379a-4c4f-9ab5-6cefb24ba101 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:21.579491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4a0dc22-379a-4c4f-9ab5-6cefb24ba101 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:21.781107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-599079ac-c3e8-4cd8-9d65-1bceed8d4c81 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:21.782173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-599079ac-c3e8-4cd8-9d65-1bceed8d4c81 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:21.793199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-599079ac-c3e8-4cd8-9d65-1bceed8d4c81 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:21.802267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-599079ac-c3e8-4cd8-9d65-1bceed8d4c81 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:21.802962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-599079ac-c3e8-4cd8-9d65-1bceed8d4c81 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:21.803961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-599079ac-c3e8-4cd8-9d65-1bceed8d4c81 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:21.804641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-599079ac-c3e8-4cd8-9d65-1bceed8d4c81 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:21.805286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-599079ac-c3e8-4cd8-9d65-1bceed8d4c81 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:22.205408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-599079ac-c3e8-4cd8-9d65-1bceed8d4c81 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:22.215548 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-599079ac-c3e8-4cd8-9d65-1bceed8d4c81 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1512 microversion: 2.1 time: 0.438646 Oct 10 23:48:22.224536 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2951/5733] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:21 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1512 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:22.527304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0b260af3-910a-4dab-8cd2-19764b1a185c tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:22.528806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0b260af3-910a-4dab-8cd2-19764b1a185c tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] [instance: acb871a7-11b3-408c-b338-1c6310c113a7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:22.553432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b260af3-910a-4dab-8cd2-19764b1a185c tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:22.557991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b260af3-910a-4dab-8cd2-19764b1a185c tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:22.558762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b260af3-910a-4dab-8cd2-19764b1a185c tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:22.560771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b260af3-910a-4dab-8cd2-19764b1a185c tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:22.561886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b260af3-910a-4dab-8cd2-19764b1a185c tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:22.562686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b260af3-910a-4dab-8cd2-19764b1a185c tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:22.628602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e4a0dc22-379a-4c4f-9ab5-6cefb24ba101 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:22.641658 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e4a0dc22-379a-4c4f-9ab5-6cefb24ba101 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d" status: 200 len: 1315 microversion: 2.1 time: 1.116301 Oct 10 23:48:22.649824 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2783/5734] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:21 2022] GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d => generated 1315 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:23.251818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1e895cac-6d14-4ccd-b16b-ae9e055d6b83 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:23.255347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1e895cac-6d14-4ccd-b16b-ae9e055d6b83 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:23.279816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e895cac-6d14-4ccd-b16b-ae9e055d6b83 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:23.283207 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e895cac-6d14-4ccd-b16b-ae9e055d6b83 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:23.284114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e895cac-6d14-4ccd-b16b-ae9e055d6b83 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:23.297898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e895cac-6d14-4ccd-b16b-ae9e055d6b83 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:23.301804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e895cac-6d14-4ccd-b16b-ae9e055d6b83 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:23.304473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e895cac-6d14-4ccd-b16b-ae9e055d6b83 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:23.681344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0b260af3-910a-4dab-8cd2-19764b1a185c tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dbc5ac25e34f3cba1d319565b485e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a1d72c53b4cc299596eed32fe9277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:23.701224 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0b260af3-910a-4dab-8cd2-19764b1a185c tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7" status: 200 len: 1313 microversion: 2.1 time: 1.177635 Oct 10 23:48:23.706105 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2952/5735] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:22 2022] GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 => generated 1313 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:23.720467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-37a5a6f6-c929-40d7-a8a1-a13fdafc2e34 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:23.724168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-37a5a6f6-c929-40d7-a8a1-a13fdafc2e34 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 33e611fa-a406-48a0-89d8-cc9217a87b5d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:23.741761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37a5a6f6-c929-40d7-a8a1-a13fdafc2e34 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:23.742992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37a5a6f6-c929-40d7-a8a1-a13fdafc2e34 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:23.744657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37a5a6f6-c929-40d7-a8a1-a13fdafc2e34 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:23.750206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37a5a6f6-c929-40d7-a8a1-a13fdafc2e34 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:23.751842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37a5a6f6-c929-40d7-a8a1-a13fdafc2e34 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:23.754220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37a5a6f6-c929-40d7-a8a1-a13fdafc2e34 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:23.977282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1e895cac-6d14-4ccd-b16b-ae9e055d6b83 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:23.992903 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1e895cac-6d14-4ccd-b16b-ae9e055d6b83 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1512 microversion: 2.1 time: 0.752486 Oct 10 23:48:23.993867 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2784/5736] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:23 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1512 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:24.286735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-37a5a6f6-c929-40d7-a8a1-a13fdafc2e34 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:24.300482 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-37a5a6f6-c929-40d7-a8a1-a13fdafc2e34 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d" status: 200 len: 1315 microversion: 2.1 time: 0.591402 Oct 10 23:48:24.304129 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2953/5737] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:23 2022] GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d => generated 1315 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:24.738411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cc8f9679-7842-4499-9313-27112ea95a64 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:24.744326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cc8f9679-7842-4499-9313-27112ea95a64 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] [instance: acb871a7-11b3-408c-b338-1c6310c113a7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:24.746556 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=40 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:48:24.771308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc8f9679-7842-4499-9313-27112ea95a64 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:24.771786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc8f9679-7842-4499-9313-27112ea95a64 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:24.772239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc8f9679-7842-4499-9313-27112ea95a64 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:24.772950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc8f9679-7842-4499-9313-27112ea95a64 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:24.773618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc8f9679-7842-4499-9313-27112ea95a64 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:24.774204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc8f9679-7842-4499-9313-27112ea95a64 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:25.024755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1868b9aa-e3d7-4fa2-bcb5-877f3b6fed8a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:25.025507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1868b9aa-e3d7-4fa2-bcb5-877f3b6fed8a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:25.056166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1868b9aa-e3d7-4fa2-bcb5-877f3b6fed8a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:25.057345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1868b9aa-e3d7-4fa2-bcb5-877f3b6fed8a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:25.058024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1868b9aa-e3d7-4fa2-bcb5-877f3b6fed8a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:25.065221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1868b9aa-e3d7-4fa2-bcb5-877f3b6fed8a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:25.077403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1868b9aa-e3d7-4fa2-bcb5-877f3b6fed8a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:25.078203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1868b9aa-e3d7-4fa2-bcb5-877f3b6fed8a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:25.349772 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cc8f9679-7842-4499-9313-27112ea95a64 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dbc5ac25e34f3cba1d319565b485e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a1d72c53b4cc299596eed32fe9277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:25.366408 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cc8f9679-7842-4499-9313-27112ea95a64 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7" status: 200 len: 1313 microversion: 2.1 time: 0.633961 Oct 10 23:48:25.367672 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2785/5738] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:24 2022] GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 => generated 1313 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:25.382650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e131f308-e2e1-4962-ba91-f156dcbd8233 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:25.387243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e131f308-e2e1-4962-ba91-f156dcbd8233 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 33e611fa-a406-48a0-89d8-cc9217a87b5d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:25.404237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e131f308-e2e1-4962-ba91-f156dcbd8233 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:25.405042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e131f308-e2e1-4962-ba91-f156dcbd8233 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:25.405685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e131f308-e2e1-4962-ba91-f156dcbd8233 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:25.406590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e131f308-e2e1-4962-ba91-f156dcbd8233 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:25.407046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e131f308-e2e1-4962-ba91-f156dcbd8233 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:25.407472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e131f308-e2e1-4962-ba91-f156dcbd8233 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:25.637785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1868b9aa-e3d7-4fa2-bcb5-877f3b6fed8a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:25.657741 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1868b9aa-e3d7-4fa2-bcb5-877f3b6fed8a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1512 microversion: 2.1 time: 0.637555 Oct 10 23:48:25.666063 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2954/5739] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:25 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1512 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:26.167200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e131f308-e2e1-4962-ba91-f156dcbd8233 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:26.178688 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e131f308-e2e1-4962-ba91-f156dcbd8233 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d" status: 200 len: 1315 microversion: 2.1 time: 0.809700 Oct 10 23:48:26.180774 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2786/5740] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:25 2022] GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d => generated 1315 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:26.263524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-ef02dfd0-56d7-45cb-9473-4f1aa9863803 req-3af4fb05-0a2e-4b1a-b850-2c7217c0289e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acb871a7-11b3-408c-b338-1c6310c113a7", "tag": "1dc2a085-74fa-4b23-ba25-961c8d20b8a3"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:26.291984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ef02dfd0-56d7-45cb-9473-4f1aa9863803 req-3af4fb05-0a2e-4b1a-b850-2c7217c0289e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:26.293630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ef02dfd0-56d7-45cb-9473-4f1aa9863803 req-3af4fb05-0a2e-4b1a-b850-2c7217c0289e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:26.294165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ef02dfd0-56d7-45cb-9473-4f1aa9863803 req-3af4fb05-0a2e-4b1a-b850-2c7217c0289e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:26.321163 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-ef02dfd0-56d7-45cb-9473-4f1aa9863803 req-3af4fb05-0a2e-4b1a-b850-2c7217c0289e service nova] Creating event network-changed:1dc2a085-74fa-4b23-ba25-961c8d20b8a3 for instance acb871a7-11b3-408c-b338-1c6310c113a7 on n-h1-860864-2 Oct 10 23:48:26.329472 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-ef02dfd0-56d7-45cb-9473-4f1aa9863803 req-3af4fb05-0a2e-4b1a-b850-2c7217c0289e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073728 Oct 10 23:48:26.331647 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2955/5741] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:48:26.392958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1d05cc1a-8c3c-4344-b788-c07e2b3021cc tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:26.393632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1d05cc1a-8c3c-4344-b788-c07e2b3021cc tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] [instance: acb871a7-11b3-408c-b338-1c6310c113a7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:26.407947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d05cc1a-8c3c-4344-b788-c07e2b3021cc tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:26.408809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d05cc1a-8c3c-4344-b788-c07e2b3021cc tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:26.409483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d05cc1a-8c3c-4344-b788-c07e2b3021cc tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:26.410408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d05cc1a-8c3c-4344-b788-c07e2b3021cc tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:26.417745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d05cc1a-8c3c-4344-b788-c07e2b3021cc tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:26.418651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d05cc1a-8c3c-4344-b788-c07e2b3021cc tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:26.691807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3c7b8549-a317-4a84-9a51-4a29bc3a8974 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:26.692665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3c7b8549-a317-4a84-9a51-4a29bc3a8974 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:26.708916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:48:26.720429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c7b8549-a317-4a84-9a51-4a29bc3a8974 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:26.723351 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c7b8549-a317-4a84-9a51-4a29bc3a8974 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:26.724594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c7b8549-a317-4a84-9a51-4a29bc3a8974 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:26.727595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c7b8549-a317-4a84-9a51-4a29bc3a8974 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:26.732803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c7b8549-a317-4a84-9a51-4a29bc3a8974 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:26.733627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c7b8549-a317-4a84-9a51-4a29bc3a8974 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:26.812230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1d05cc1a-8c3c-4344-b788-c07e2b3021cc tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dbc5ac25e34f3cba1d319565b485e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a1d72c53b4cc299596eed32fe9277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:26.823373 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1d05cc1a-8c3c-4344-b788-c07e2b3021cc tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7" status: 200 len: 1313 microversion: 2.1 time: 0.435053 Oct 10 23:48:26.834852 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2787/5742] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:26 2022] GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 => generated 1313 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:26.887109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-1b52a3b6-c04c-4376-8c30-1cdab8f0318a req-92b69177-5463-4c4e-a102-7a476c696786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e611fa-a406-48a0-89d8-cc9217a87b5d", "name": "network-vif-plugged", "status": "completed", "tag": "1cbc9253-2a95-4a16-af9a-23e82d53caf6"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:26.919000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1b52a3b6-c04c-4376-8c30-1cdab8f0318a req-92b69177-5463-4c4e-a102-7a476c696786 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:26.930680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1b52a3b6-c04c-4376-8c30-1cdab8f0318a req-92b69177-5463-4c4e-a102-7a476c696786 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:26.931628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1b52a3b6-c04c-4376-8c30-1cdab8f0318a req-92b69177-5463-4c4e-a102-7a476c696786 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:26.968516 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-1b52a3b6-c04c-4376-8c30-1cdab8f0318a req-92b69177-5463-4c4e-a102-7a476c696786 service nova] Creating event network-vif-plugged:1cbc9253-2a95-4a16-af9a-23e82d53caf6 for instance 33e611fa-a406-48a0-89d8-cc9217a87b5d on n-h2-860864-2 Oct 10 23:48:26.975650 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-1b52a3b6-c04c-4376-8c30-1cdab8f0318a req-92b69177-5463-4c4e-a102-7a476c696786 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092762 Oct 10 23:48:26.976524 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2788/5743] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:48:27.204042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-33ee2a8e-a679-4132-b35a-c6697f099b1b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:27.205064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-33ee2a8e-a679-4132-b35a-c6697f099b1b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 33e611fa-a406-48a0-89d8-cc9217a87b5d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:27.222955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33ee2a8e-a679-4132-b35a-c6697f099b1b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:27.223671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33ee2a8e-a679-4132-b35a-c6697f099b1b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:27.225962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33ee2a8e-a679-4132-b35a-c6697f099b1b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:27.228722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33ee2a8e-a679-4132-b35a-c6697f099b1b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:27.247006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33ee2a8e-a679-4132-b35a-c6697f099b1b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:27.247610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33ee2a8e-a679-4132-b35a-c6697f099b1b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:27.669433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-33ee2a8e-a679-4132-b35a-c6697f099b1b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:27.681869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3c7b8549-a317-4a84-9a51-4a29bc3a8974 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:27.686320 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-33ee2a8e-a679-4132-b35a-c6697f099b1b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d" status: 200 len: 1315 microversion: 2.1 time: 0.487536 Oct 10 23:48:27.690006 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2789/5744] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:27 2022] GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:48:27.700883 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3c7b8549-a317-4a84-9a51-4a29bc3a8974 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1512 microversion: 2.1 time: 1.019108 Oct 10 23:48:27.702699 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2956/5745] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:26 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1512 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:27.860454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7bcd604c-5b2b-4693-9ad5-e5853742fffc tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:27.861319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7bcd604c-5b2b-4693-9ad5-e5853742fffc tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] [instance: acb871a7-11b3-408c-b338-1c6310c113a7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:27.873902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bcd604c-5b2b-4693-9ad5-e5853742fffc tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:27.874332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bcd604c-5b2b-4693-9ad5-e5853742fffc tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:27.880058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bcd604c-5b2b-4693-9ad5-e5853742fffc tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:27.880931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bcd604c-5b2b-4693-9ad5-e5853742fffc tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:27.881434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bcd604c-5b2b-4693-9ad5-e5853742fffc tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:27.882073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bcd604c-5b2b-4693-9ad5-e5853742fffc tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:28.228454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7bcd604c-5b2b-4693-9ad5-e5853742fffc tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dbc5ac25e34f3cba1d319565b485e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a1d72c53b4cc299596eed32fe9277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:28.243749 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7bcd604c-5b2b-4693-9ad5-e5853742fffc tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7" status: 200 len: 1313 microversion: 2.1 time: 0.388450 Oct 10 23:48:28.246234 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2790/5746] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:27 2022] GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:48:28.719197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-27638493-be9f-455e-bef1-49833e954dd1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:28.720705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-27638493-be9f-455e-bef1-49833e954dd1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 33e611fa-a406-48a0-89d8-cc9217a87b5d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:28.729172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d6b40346-ded4-413a-9550-99e4a727ef6d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:28.730451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d6b40346-ded4-413a-9550-99e4a727ef6d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:28.744573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=9,nova_api:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:48:28.750375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=26 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:48:28.757178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6b40346-ded4-413a-9550-99e4a727ef6d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:28.759669 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6b40346-ded4-413a-9550-99e4a727ef6d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:28.761649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6b40346-ded4-413a-9550-99e4a727ef6d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:28.762795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27638493-be9f-455e-bef1-49833e954dd1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:28.762887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27638493-be9f-455e-bef1-49833e954dd1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:28.763787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6b40346-ded4-413a-9550-99e4a727ef6d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:28.765137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27638493-be9f-455e-bef1-49833e954dd1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:28.765943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27638493-be9f-455e-bef1-49833e954dd1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:28.766589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6b40346-ded4-413a-9550-99e4a727ef6d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:28.767089 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6b40346-ded4-413a-9550-99e4a727ef6d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:28.767642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27638493-be9f-455e-bef1-49833e954dd1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:28.769188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27638493-be9f-455e-bef1-49833e954dd1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:29.099456 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d6b40346-ded4-413a-9550-99e4a727ef6d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:29.109337 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d6b40346-ded4-413a-9550-99e4a727ef6d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1512 microversion: 2.1 time: 0.384284 Oct 10 23:48:29.113524 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2791/5747] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:28 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1512 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:48:29.275537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0a294ca9-d4a1-4f21-b50b-26825c5a298d tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:29.276265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0a294ca9-d4a1-4f21-b50b-26825c5a298d tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] [instance: acb871a7-11b3-408c-b338-1c6310c113a7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:29.285678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a294ca9-d4a1-4f21-b50b-26825c5a298d tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:29.289237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a294ca9-d4a1-4f21-b50b-26825c5a298d tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:29.290017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a294ca9-d4a1-4f21-b50b-26825c5a298d tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:29.292796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a294ca9-d4a1-4f21-b50b-26825c5a298d tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:29.293350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a294ca9-d4a1-4f21-b50b-26825c5a298d tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:29.298261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a294ca9-d4a1-4f21-b50b-26825c5a298d tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:29.591844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0a294ca9-d4a1-4f21-b50b-26825c5a298d tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dbc5ac25e34f3cba1d319565b485e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a1d72c53b4cc299596eed32fe9277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:29.602444 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0a294ca9-d4a1-4f21-b50b-26825c5a298d tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7" status: 200 len: 1313 microversion: 2.1 time: 0.330831 Oct 10 23:48:29.603439 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2792/5748] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:29 2022] GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:29.618887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-27638493-be9f-455e-bef1-49833e954dd1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:29.635515 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-27638493-be9f-455e-bef1-49833e954dd1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d" status: 200 len: 1315 microversion: 2.1 time: 0.920563 Oct 10 23:48:29.642896 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2957/5749] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:28 2022] GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d => generated 1315 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:48:30.145760 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1a3a1c2d-347a-470c-ab26-506ec6b84666 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:30.147054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1a3a1c2d-347a-470c-ab26-506ec6b84666 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:30.155137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a3a1c2d-347a-470c-ab26-506ec6b84666 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:30.156318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a3a1c2d-347a-470c-ab26-506ec6b84666 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:30.157164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a3a1c2d-347a-470c-ab26-506ec6b84666 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:30.158111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a3a1c2d-347a-470c-ab26-506ec6b84666 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:30.159006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a3a1c2d-347a-470c-ab26-506ec6b84666 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:30.159649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a3a1c2d-347a-470c-ab26-506ec6b84666 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:30.449329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1a3a1c2d-347a-470c-ab26-506ec6b84666 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:30.461283 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1a3a1c2d-347a-470c-ab26-506ec6b84666 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1512 microversion: 2.1 time: 0.321121 Oct 10 23:48:30.462509 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2793/5750] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:30 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1512 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:30.628694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5669e1f3-bbd9-4d80-8334-e03955dc9c56 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:30.629696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5669e1f3-bbd9-4d80-8334-e03955dc9c56 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] [instance: acb871a7-11b3-408c-b338-1c6310c113a7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:30.639382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5669e1f3-bbd9-4d80-8334-e03955dc9c56 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:30.640235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5669e1f3-bbd9-4d80-8334-e03955dc9c56 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:30.642473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5669e1f3-bbd9-4d80-8334-e03955dc9c56 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:30.648165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5669e1f3-bbd9-4d80-8334-e03955dc9c56 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:30.648964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5669e1f3-bbd9-4d80-8334-e03955dc9c56 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:30.649856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5669e1f3-bbd9-4d80-8334-e03955dc9c56 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:30.676121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f899faaa-f7d1-44b1-b9d3-5d11de54300f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:30.676750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f899faaa-f7d1-44b1-b9d3-5d11de54300f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 33e611fa-a406-48a0-89d8-cc9217a87b5d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:30.687831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f899faaa-f7d1-44b1-b9d3-5d11de54300f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:30.688613 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f899faaa-f7d1-44b1-b9d3-5d11de54300f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:30.689365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f899faaa-f7d1-44b1-b9d3-5d11de54300f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:30.690982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f899faaa-f7d1-44b1-b9d3-5d11de54300f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:30.694842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f899faaa-f7d1-44b1-b9d3-5d11de54300f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:30.695497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f899faaa-f7d1-44b1-b9d3-5d11de54300f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:31.115937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5669e1f3-bbd9-4d80-8334-e03955dc9c56 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dbc5ac25e34f3cba1d319565b485e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a1d72c53b4cc299596eed32fe9277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:31.122505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f899faaa-f7d1-44b1-b9d3-5d11de54300f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:31.128632 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5669e1f3-bbd9-4d80-8334-e03955dc9c56 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7" status: 200 len: 1313 microversion: 2.1 time: 0.504095 Oct 10 23:48:31.144069 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2958/5751] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:30 2022] GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:31.162868 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f899faaa-f7d1-44b1-b9d3-5d11de54300f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d" status: 200 len: 1501 microversion: 2.1 time: 0.492271 Oct 10 23:48:31.164401 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2794/5752] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:30 2022] GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d => generated 1501 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:31.196638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fdb521ba-879b-446e-ae5b-4be75f4352d0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:31.197576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fdb521ba-879b-446e-ae5b-4be75f4352d0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 33e611fa-a406-48a0-89d8-cc9217a87b5d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:31.204821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fdb521ba-879b-446e-ae5b-4be75f4352d0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:31.205596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fdb521ba-879b-446e-ae5b-4be75f4352d0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:31.206216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fdb521ba-879b-446e-ae5b-4be75f4352d0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:31.207114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fdb521ba-879b-446e-ae5b-4be75f4352d0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:31.207577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fdb521ba-879b-446e-ae5b-4be75f4352d0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:31.208006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fdb521ba-879b-446e-ae5b-4be75f4352d0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:31.496874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-32b34464-98fb-4216-9c60-54b71f890b82 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:31.499055 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.network.security_group_api [None req-fdb521ba-879b-446e-ae5b-4be75f4352d0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Removing security group 450893aa-b151-4619-a94d-c3897f96aba5 from port 1cbc9253-2a95-4a16-af9a-23e82d53caf6 Oct 10 23:48:31.504836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-32b34464-98fb-4216-9c60-54b71f890b82 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:31.512694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32b34464-98fb-4216-9c60-54b71f890b82 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:31.513602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32b34464-98fb-4216-9c60-54b71f890b82 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:31.514765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32b34464-98fb-4216-9c60-54b71f890b82 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:31.515692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32b34464-98fb-4216-9c60-54b71f890b82 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:31.516317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32b34464-98fb-4216-9c60-54b71f890b82 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:31.516905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-32b34464-98fb-4216-9c60-54b71f890b82 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:31.876370 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-32b34464-98fb-4216-9c60-54b71f890b82 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:31.884628 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-32b34464-98fb-4216-9c60-54b71f890b82 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1512 microversion: 2.1 time: 0.394620 Oct 10 23:48:31.901841 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2795/5753] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:31 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1512 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:32.151801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-017e131e-d9df-41cb-aa44-7005c7bcb204 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:32.161649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-017e131e-d9df-41cb-aa44-7005c7bcb204 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] [instance: acb871a7-11b3-408c-b338-1c6310c113a7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:32.171305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-017e131e-d9df-41cb-aa44-7005c7bcb204 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:32.172245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-017e131e-d9df-41cb-aa44-7005c7bcb204 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:32.178221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-017e131e-d9df-41cb-aa44-7005c7bcb204 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:32.179245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-017e131e-d9df-41cb-aa44-7005c7bcb204 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:32.179833 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-017e131e-d9df-41cb-aa44-7005c7bcb204 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:32.180384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-017e131e-d9df-41cb-aa44-7005c7bcb204 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:32.393622 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fdb521ba-879b-446e-ae5b-4be75f4352d0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d/action" status: 202 len: 0 microversion: 2.1 time: 1.202585 Oct 10 23:48:32.396200 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2959/5754] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:48:31 2022] POST /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d/action => generated 0 bytes in 1206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:48:32.408475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d027bc53-5ac0-4196-94a4-4222904b7cb9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:32.410308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d027bc53-5ac0-4196-94a4-4222904b7cb9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 33e611fa-a406-48a0-89d8-cc9217a87b5d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:32.430600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d027bc53-5ac0-4196-94a4-4222904b7cb9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:32.433693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d027bc53-5ac0-4196-94a4-4222904b7cb9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:32.434339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d027bc53-5ac0-4196-94a4-4222904b7cb9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:32.436439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d027bc53-5ac0-4196-94a4-4222904b7cb9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:32.437032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d027bc53-5ac0-4196-94a4-4222904b7cb9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:32.442040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d027bc53-5ac0-4196-94a4-4222904b7cb9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:32.500511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-017e131e-d9df-41cb-aa44-7005c7bcb204 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dbc5ac25e34f3cba1d319565b485e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a1d72c53b4cc299596eed32fe9277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:32.514441 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-017e131e-d9df-41cb-aa44-7005c7bcb204 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7" status: 200 len: 1313 microversion: 2.1 time: 0.365831 Oct 10 23:48:32.519182 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2796/5755] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:32 2022] GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:32.538375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-0f3d9ec0-f2db-4b7a-ba37-808f2042024d req-fcdc206a-b789-495e-82e4-cfb0e9982de6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e611fa-a406-48a0-89d8-cc9217a87b5d", "tag": "1cbc9253-2a95-4a16-af9a-23e82d53caf6"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:32.554432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0f3d9ec0-f2db-4b7a-ba37-808f2042024d req-fcdc206a-b789-495e-82e4-cfb0e9982de6 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:32.555444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0f3d9ec0-f2db-4b7a-ba37-808f2042024d req-fcdc206a-b789-495e-82e4-cfb0e9982de6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:32.558384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0f3d9ec0-f2db-4b7a-ba37-808f2042024d req-fcdc206a-b789-495e-82e4-cfb0e9982de6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:32.582660 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-0f3d9ec0-f2db-4b7a-ba37-808f2042024d req-fcdc206a-b789-495e-82e4-cfb0e9982de6 service nova] Creating event network-changed:1cbc9253-2a95-4a16-af9a-23e82d53caf6 for instance 33e611fa-a406-48a0-89d8-cc9217a87b5d on n-h2-860864-2 Oct 10 23:48:32.598491 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-0f3d9ec0-f2db-4b7a-ba37-808f2042024d req-fcdc206a-b789-495e-82e4-cfb0e9982de6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074990 Oct 10 23:48:32.599492 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2797/5756] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:48:32.613218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d027bc53-5ac0-4196-94a4-4222904b7cb9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:32.625884 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d027bc53-5ac0-4196-94a4-4222904b7cb9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d" status: 200 len: 1459 microversion: 2.1 time: 0.225175 Oct 10 23:48:32.642847 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2960/5757] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:32 2022] GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d => generated 1459 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:32.655226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dc52fa1c-dbd1-4dc2-b350-ba9716a18ab5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:32.657267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dc52fa1c-dbd1-4dc2-b350-ba9716a18ab5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:32.665507 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc52fa1c-dbd1-4dc2-b350-ba9716a18ab5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:32.666322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc52fa1c-dbd1-4dc2-b350-ba9716a18ab5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:32.666918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc52fa1c-dbd1-4dc2-b350-ba9716a18ab5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:32.667799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc52fa1c-dbd1-4dc2-b350-ba9716a18ab5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:32.668402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc52fa1c-dbd1-4dc2-b350-ba9716a18ab5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:32.668976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc52fa1c-dbd1-4dc2-b350-ba9716a18ab5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:32.678300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:48:32.914674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-de2af9da-4989-4c6c-95bd-f9db90181382 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:32.915799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-de2af9da-4989-4c6c-95bd-f9db90181382 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:32.930012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de2af9da-4989-4c6c-95bd-f9db90181382 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:32.931013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de2af9da-4989-4c6c-95bd-f9db90181382 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:32.932233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de2af9da-4989-4c6c-95bd-f9db90181382 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:32.933683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de2af9da-4989-4c6c-95bd-f9db90181382 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:32.935340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de2af9da-4989-4c6c-95bd-f9db90181382 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:32.937408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de2af9da-4989-4c6c-95bd-f9db90181382 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:33.176818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-de2af9da-4989-4c6c-95bd-f9db90181382 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:33.190530 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-de2af9da-4989-4c6c-95bd-f9db90181382 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1512 microversion: 2.1 time: 0.285774 Oct 10 23:48:33.191419 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2961/5758] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:32 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1512 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:33.307390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dc52fa1c-dbd1-4dc2-b350-ba9716a18ab5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:33.328340 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dc52fa1c-dbd1-4dc2-b350-ba9716a18ab5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.678549 Oct 10 23:48:33.329642 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2798/5759] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:32 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:33.374524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4cbb79dc-1d22-4ede-b513-48481d73061a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:33.375693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4cbb79dc-1d22-4ede-b513-48481d73061a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:33.387178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cbb79dc-1d22-4ede-b513-48481d73061a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:33.388030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cbb79dc-1d22-4ede-b513-48481d73061a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:33.388709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cbb79dc-1d22-4ede-b513-48481d73061a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:33.390898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cbb79dc-1d22-4ede-b513-48481d73061a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:33.391604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cbb79dc-1d22-4ede-b513-48481d73061a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:33.392268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cbb79dc-1d22-4ede-b513-48481d73061a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:33.551372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7a842478-d40a-4276-b864-22959595daad tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:33.552601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7a842478-d40a-4276-b864-22959595daad tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] [instance: acb871a7-11b3-408c-b338-1c6310c113a7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:33.577050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a842478-d40a-4276-b864-22959595daad tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:33.578223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a842478-d40a-4276-b864-22959595daad tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:33.579170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a842478-d40a-4276-b864-22959595daad tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:33.580545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a842478-d40a-4276-b864-22959595daad tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:33.581264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a842478-d40a-4276-b864-22959595daad tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:33.582112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a842478-d40a-4276-b864-22959595daad tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:33.617982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4cbb79dc-1d22-4ede-b513-48481d73061a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:33.627164 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4cbb79dc-1d22-4ede-b513-48481d73061a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.258348 Oct 10 23:48:33.629528 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2962/5760] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:33 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:33.671316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-14d6c41f-6e92-4819-b9bb-7a1cf63ae00c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:33.672517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-14d6c41f-6e92-4819-b9bb-7a1cf63ae00c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:33.690085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14d6c41f-6e92-4819-b9bb-7a1cf63ae00c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:33.693798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14d6c41f-6e92-4819-b9bb-7a1cf63ae00c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:33.695188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14d6c41f-6e92-4819-b9bb-7a1cf63ae00c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:33.695967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14d6c41f-6e92-4819-b9bb-7a1cf63ae00c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:33.698438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14d6c41f-6e92-4819-b9bb-7a1cf63ae00c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:33.699158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14d6c41f-6e92-4819-b9bb-7a1cf63ae00c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:33.883512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-14d6c41f-6e92-4819-b9bb-7a1cf63ae00c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:33.892848 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-14d6c41f-6e92-4819-b9bb-7a1cf63ae00c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.230304 Oct 10 23:48:33.893704 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2963/5761] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:33 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:48:33.915806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1109b98a-4be6-41c9-a0d9-8d5909400c20 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:33.916784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1109b98a-4be6-41c9-a0d9-8d5909400c20 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:33.924255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1109b98a-4be6-41c9-a0d9-8d5909400c20 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:33.925072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1109b98a-4be6-41c9-a0d9-8d5909400c20 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:33.925735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1109b98a-4be6-41c9-a0d9-8d5909400c20 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:33.926660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1109b98a-4be6-41c9-a0d9-8d5909400c20 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:33.927286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1109b98a-4be6-41c9-a0d9-8d5909400c20 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:33.927882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1109b98a-4be6-41c9-a0d9-8d5909400c20 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:33.947080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:48:34.111368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7a842478-d40a-4276-b864-22959595daad tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dbc5ac25e34f3cba1d319565b485e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a1d72c53b4cc299596eed32fe9277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:34.131998 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7a842478-d40a-4276-b864-22959595daad tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7" status: 200 len: 1313 microversion: 2.1 time: 0.591166 Oct 10 23:48:34.133211 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2799/5762] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:33 2022] GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 => generated 1313 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:34.161097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1109b98a-4be6-41c9-a0d9-8d5909400c20 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:34.172265 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1109b98a-4be6-41c9-a0d9-8d5909400c20 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.260270 Oct 10 23:48:34.186720 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2964/5763] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:33 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:48:34.220521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-69c05941-a781-4a92-a05f-5da5c706c472 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:34.221831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-69c05941-a781-4a92-a05f-5da5c706c472 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:34.231283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69c05941-a781-4a92-a05f-5da5c706c472 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:34.232203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69c05941-a781-4a92-a05f-5da5c706c472 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:34.233102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69c05941-a781-4a92-a05f-5da5c706c472 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:34.234105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69c05941-a781-4a92-a05f-5da5c706c472 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:34.235567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69c05941-a781-4a92-a05f-5da5c706c472 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:34.236381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-69c05941-a781-4a92-a05f-5da5c706c472 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:34.350473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dbfe1922-da5e-4efb-b0e6-5acfc4f9626c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-989072831", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "17157a6b-ea9d-4593-b208-9ce16ed44768"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:34.434474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-dbfe1922-da5e-4efb-b0e6-5acfc4f9626c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] validate_networks() for [('17157a6b-ea9d-4593-b208-9ce16ed44768', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:48:35.015379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-69c05941-a781-4a92-a05f-5da5c706c472 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:35.034904 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-69c05941-a781-4a92-a05f-5da5c706c472 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1512 microversion: 2.1 time: 0.823029 Oct 10 23:48:35.037009 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2800/5764] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:34 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1512 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:35.045107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-b9f465c4-a50a-4cad-beb6-727f2266bcd2 req-f328c4a0-d009-41c6-8fba-677da7db3d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acb871a7-11b3-408c-b338-1c6310c113a7", "name": "network-vif-plugged", "status": "completed", "tag": "1dc2a085-74fa-4b23-ba25-961c8d20b8a3"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:35.071166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b9f465c4-a50a-4cad-beb6-727f2266bcd2 req-f328c4a0-d009-41c6-8fba-677da7db3d86 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:35.073162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b9f465c4-a50a-4cad-beb6-727f2266bcd2 req-f328c4a0-d009-41c6-8fba-677da7db3d86 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:35.074143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b9f465c4-a50a-4cad-beb6-727f2266bcd2 req-f328c4a0-d009-41c6-8fba-677da7db3d86 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:35.097756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-dbfe1922-da5e-4efb-b0e6-5acfc4f9626c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:48:35.099279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-dbfe1922-da5e-4efb-b0e6-5acfc4f9626c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:48:35.099987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-dbfe1922-da5e-4efb-b0e6-5acfc4f9626c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:48:35.100619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-dbfe1922-da5e-4efb-b0e6-5acfc4f9626c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:48:35.101349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-dbfe1922-da5e-4efb-b0e6-5acfc4f9626c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:48:35.117235 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-b9f465c4-a50a-4cad-beb6-727f2266bcd2 req-f328c4a0-d009-41c6-8fba-677da7db3d86 service nova] Creating event network-vif-plugged:1dc2a085-74fa-4b23-ba25-961c8d20b8a3 for instance acb871a7-11b3-408c-b338-1c6310c113a7 on n-h1-860864-2 Oct 10 23:48:35.118577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbfe1922-da5e-4efb-b0e6-5acfc4f9626c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:35.120014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbfe1922-da5e-4efb-b0e6-5acfc4f9626c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:35.120860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbfe1922-da5e-4efb-b0e6-5acfc4f9626c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:35.123166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbfe1922-da5e-4efb-b0e6-5acfc4f9626c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:35.124844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbfe1922-da5e-4efb-b0e6-5acfc4f9626c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:35.125712 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-b9f465c4-a50a-4cad-beb6-727f2266bcd2 req-f328c4a0-d009-41c6-8fba-677da7db3d86 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085595 Oct 10 23:48:35.125970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbfe1922-da5e-4efb-b0e6-5acfc4f9626c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:35.128868 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2801/5765] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:48:35.157682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-dbfe1922-da5e-4efb-b0e6-5acfc4f9626c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Getting quotas for project f798f5f5321f40b89fc5bacc3b9389fe. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:48:35.164430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-dbfe1922-da5e-4efb-b0e6-5acfc4f9626c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Getting quotas for user cfd8618ee1864d1d86de2def024b49bb and project f798f5f5321f40b89fc5bacc3b9389fe. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:48:35.184458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dbfe1922-da5e-4efb-b0e6-5acfc4f9626c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:48:35.192032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dbfe1922-da5e-4efb-b0e6-5acfc4f9626c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:48:35.201274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b588496d-1629-4339-a587-ffae1055de47 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:35.205222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b588496d-1629-4339-a587-ffae1055de47 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] [instance: acb871a7-11b3-408c-b338-1c6310c113a7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:35.221024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b588496d-1629-4339-a587-ffae1055de47 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:35.221967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b588496d-1629-4339-a587-ffae1055de47 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:35.224949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b588496d-1629-4339-a587-ffae1055de47 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:35.226690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b588496d-1629-4339-a587-ffae1055de47 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:35.227756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b588496d-1629-4339-a587-ffae1055de47 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:35.229551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b588496d-1629-4339-a587-ffae1055de47 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:35.299433 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dbfe1922-da5e-4efb-b0e6-5acfc4f9626c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.953227 Oct 10 23:48:35.300449 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2965/5766] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:48:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 23:48:35.320201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2e386eb8-4497-4a54-b8f1-6f428aba3210 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:35.320832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2e386eb8-4497-4a54-b8f1-6f428aba3210 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:35.516460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2e386eb8-4497-4a54-b8f1-6f428aba3210 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:35.533304 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2e386eb8-4497-4a54-b8f1-6f428aba3210 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1214 microversion: 2.1 time: 0.222011 Oct 10 23:48:35.534403 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2966/5767] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:35 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1214 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:35.892975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b588496d-1629-4339-a587-ffae1055de47 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dbc5ac25e34f3cba1d319565b485e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a1d72c53b4cc299596eed32fe9277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:35.910533 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b588496d-1629-4339-a587-ffae1055de47 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7" status: 200 len: 1313 microversion: 2.1 time: 0.744751 Oct 10 23:48:35.911529 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2802/5768] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:35 2022] GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 => generated 1313 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:36.060371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fe9a7918-021a-4295-9fb1-32ff64b0c966 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:36.061313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fe9a7918-021a-4295-9fb1-32ff64b0c966 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:36.075904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe9a7918-021a-4295-9fb1-32ff64b0c966 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:36.077049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe9a7918-021a-4295-9fb1-32ff64b0c966 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:36.077720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe9a7918-021a-4295-9fb1-32ff64b0c966 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:36.081719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe9a7918-021a-4295-9fb1-32ff64b0c966 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:36.082392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe9a7918-021a-4295-9fb1-32ff64b0c966 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:36.083021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe9a7918-021a-4295-9fb1-32ff64b0c966 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:36.333337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fe9a7918-021a-4295-9fb1-32ff64b0c966 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:36.357826 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fe9a7918-021a-4295-9fb1-32ff64b0c966 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1512 microversion: 2.1 time: 0.301281 Oct 10 23:48:36.383569 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2967/5769] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:36 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1512 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:36.565460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-388cb256-296d-4935-8be1-adc86f7c589f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:36.565460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-388cb256-296d-4935-8be1-adc86f7c589f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:36.593249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-388cb256-296d-4935-8be1-adc86f7c589f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:36.594197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-388cb256-296d-4935-8be1-adc86f7c589f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:36.594866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-388cb256-296d-4935-8be1-adc86f7c589f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:36.595894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-388cb256-296d-4935-8be1-adc86f7c589f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:36.596554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-388cb256-296d-4935-8be1-adc86f7c589f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:36.597223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-388cb256-296d-4935-8be1-adc86f7c589f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:36.761324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-388cb256-296d-4935-8be1-adc86f7c589f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:36.775663 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-388cb256-296d-4935-8be1-adc86f7c589f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1266 microversion: 2.1 time: 0.220737 Oct 10 23:48:36.793808 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2803/5770] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:36 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:36.937304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-699a384b-7be3-4ecb-9d77-a161e022e9b8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:36.939168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-699a384b-7be3-4ecb-9d77-a161e022e9b8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] [instance: acb871a7-11b3-408c-b338-1c6310c113a7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:36.958481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-699a384b-7be3-4ecb-9d77-a161e022e9b8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:36.959561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-699a384b-7be3-4ecb-9d77-a161e022e9b8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:36.960767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-699a384b-7be3-4ecb-9d77-a161e022e9b8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:36.962008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-699a384b-7be3-4ecb-9d77-a161e022e9b8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:36.964737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-699a384b-7be3-4ecb-9d77-a161e022e9b8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:36.965671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-699a384b-7be3-4ecb-9d77-a161e022e9b8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:37.227613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-699a384b-7be3-4ecb-9d77-a161e022e9b8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dbc5ac25e34f3cba1d319565b485e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a1d72c53b4cc299596eed32fe9277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:37.240822 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-699a384b-7be3-4ecb-9d77-a161e022e9b8 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7" status: 200 len: 1499 microversion: 2.1 time: 0.309582 Oct 10 23:48:37.259514 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2968/5771] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:36 2022] GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 => generated 1499 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:37.273591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8e5dbb5f-aa47-44c7-af50-4fdfd58ca240 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:37.304464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.compute.server_groups [None req-8e5dbb5f-aa47-44c7-af50-4fdfd58ca240 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Querying cell c35e3cac-0e4f-44cc-a53a-8910e1eecc88(cell1) for 1 instances {{(pid=120614) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 10 23:48:37.305336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e5dbb5f-aa47-44c7-af50-4fdfd58ca240 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:37.306214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e5dbb5f-aa47-44c7-af50-4fdfd58ca240 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:37.306649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e5dbb5f-aa47-44c7-af50-4fdfd58ca240 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:37.344660 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8e5dbb5f-aa47-44c7-af50-4fdfd58ca240 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/2f444903-8c1b-4de3-9573-8a66bdb782fa" status: 200 len: 222 microversion: 2.1 time: 0.074953 Oct 10 23:48:37.352470 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2804/5772] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 10 23:48:37 2022] GET /compute/v2.1/os-server-groups/2f444903-8c1b-4de3-9573-8a66bdb782fa => generated 222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:48:37.366254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-00a4053a-3c0e-4db3-b49d-909e8326bd76 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:37.366782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-00a4053a-3c0e-4db3-b49d-909e8326bd76 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] [instance: acb871a7-11b3-408c-b338-1c6310c113a7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:37.377280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00a4053a-3c0e-4db3-b49d-909e8326bd76 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:37.377806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00a4053a-3c0e-4db3-b49d-909e8326bd76 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:37.378249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00a4053a-3c0e-4db3-b49d-909e8326bd76 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:37.378960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00a4053a-3c0e-4db3-b49d-909e8326bd76 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:37.392959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ad094907-61c8-452a-a311-b4199b88b6c5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:37.393676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ad094907-61c8-452a-a311-b4199b88b6c5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:37.399205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00a4053a-3c0e-4db3-b49d-909e8326bd76 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:37.399703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00a4053a-3c0e-4db3-b49d-909e8326bd76 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:37.412585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad094907-61c8-452a-a311-b4199b88b6c5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:37.413101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad094907-61c8-452a-a311-b4199b88b6c5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:37.413558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad094907-61c8-452a-a311-b4199b88b6c5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:37.417000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad094907-61c8-452a-a311-b4199b88b6c5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:37.417506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad094907-61c8-452a-a311-b4199b88b6c5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:37.417944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad094907-61c8-452a-a311-b4199b88b6c5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:37.474187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-00a4053a-3c0e-4db3-b49d-909e8326bd76 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] [instance: acb871a7-11b3-408c-b338-1c6310c113a7] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:48:37.634930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:48:37.642365 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-00a4053a-3c0e-4db3-b49d-909e8326bd76 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "DELETE /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7" status: 204 len: 0 microversion: 2.1 time: 0.280014 Oct 10 23:48:37.645128 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2969/5773] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:48:37 2022] DELETE /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:48:37.657038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0eb8e1cb-5d45-45c0-b52f-f8d7eb79190e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:37.657818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0eb8e1cb-5d45-45c0-b52f-f8d7eb79190e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] [instance: acb871a7-11b3-408c-b338-1c6310c113a7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:37.665907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0eb8e1cb-5d45-45c0-b52f-f8d7eb79190e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:37.667095 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0eb8e1cb-5d45-45c0-b52f-f8d7eb79190e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:37.667562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0eb8e1cb-5d45-45c0-b52f-f8d7eb79190e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:37.668471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0eb8e1cb-5d45-45c0-b52f-f8d7eb79190e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:37.669114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0eb8e1cb-5d45-45c0-b52f-f8d7eb79190e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:37.669743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0eb8e1cb-5d45-45c0-b52f-f8d7eb79190e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:37.903674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ad094907-61c8-452a-a311-b4199b88b6c5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:37.925408 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ad094907-61c8-452a-a311-b4199b88b6c5 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1512 microversion: 2.1 time: 0.526847 Oct 10 23:48:37.925408 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2805/5774] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:37 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1512 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:48:37.934466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e15aeaf7-0113-4218-b949-d8e3fa426250 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:37.934896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e15aeaf7-0113-4218-b949-d8e3fa426250 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:37.959862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e15aeaf7-0113-4218-b949-d8e3fa426250 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:37.960325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e15aeaf7-0113-4218-b949-d8e3fa426250 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:37.960821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e15aeaf7-0113-4218-b949-d8e3fa426250 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:37.961838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e15aeaf7-0113-4218-b949-d8e3fa426250 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:37.962338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e15aeaf7-0113-4218-b949-d8e3fa426250 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:37.962751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e15aeaf7-0113-4218-b949-d8e3fa426250 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:38.104974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0eb8e1cb-5d45-45c0-b52f-f8d7eb79190e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dbc5ac25e34f3cba1d319565b485e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a1d72c53b4cc299596eed32fe9277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:38.116084 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0eb8e1cb-5d45-45c0-b52f-f8d7eb79190e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7" status: 200 len: 1505 microversion: 2.1 time: 0.466444 Oct 10 23:48:38.140418 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2970/5775] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:37 2022] GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 => generated 1505 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:48:38.155717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e15aeaf7-0113-4218-b949-d8e3fa426250 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:38.175320 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e15aeaf7-0113-4218-b949-d8e3fa426250 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1272 microversion: 2.1 time: 0.252032 Oct 10 23:48:38.181184 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2806/5776] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:37 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1272 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:38.944575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-828e6c01-2646-448f-acb7-c7dbc4f6c6f7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:38.945206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-828e6c01-2646-448f-acb7-c7dbc4f6c6f7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:38.965944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-828e6c01-2646-448f-acb7-c7dbc4f6c6f7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:38.966788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-828e6c01-2646-448f-acb7-c7dbc4f6c6f7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:38.967708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-828e6c01-2646-448f-acb7-c7dbc4f6c6f7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:38.968810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-828e6c01-2646-448f-acb7-c7dbc4f6c6f7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:38.969681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-828e6c01-2646-448f-acb7-c7dbc4f6c6f7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:38.970280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-828e6c01-2646-448f-acb7-c7dbc4f6c6f7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:39.153819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3f9e2008-5e2b-4cb1-a345-7a986d72a9dd tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:39.154500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3f9e2008-5e2b-4cb1-a345-7a986d72a9dd tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] [instance: acb871a7-11b3-408c-b338-1c6310c113a7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:39.163640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f9e2008-5e2b-4cb1-a345-7a986d72a9dd tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:39.167941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f9e2008-5e2b-4cb1-a345-7a986d72a9dd tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:39.168500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f9e2008-5e2b-4cb1-a345-7a986d72a9dd tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:39.169482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f9e2008-5e2b-4cb1-a345-7a986d72a9dd tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:39.170846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f9e2008-5e2b-4cb1-a345-7a986d72a9dd tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:39.171724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3f9e2008-5e2b-4cb1-a345-7a986d72a9dd tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:39.603531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3f9e2008-5e2b-4cb1-a345-7a986d72a9dd tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dbc5ac25e34f3cba1d319565b485e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a1d72c53b4cc299596eed32fe9277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:39.614906 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3f9e2008-5e2b-4cb1-a345-7a986d72a9dd tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7" status: 200 len: 1505 microversion: 2.1 time: 0.466439 Oct 10 23:48:39.626003 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2807/5777] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:39 2022] GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 => generated 1505 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:48:39.630525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5d9eeb02-444b-4108-831a-456611c0eebf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:39.631443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5d9eeb02-444b-4108-831a-456611c0eebf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:39.638271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d9eeb02-444b-4108-831a-456611c0eebf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:39.639123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d9eeb02-444b-4108-831a-456611c0eebf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:39.639732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d9eeb02-444b-4108-831a-456611c0eebf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:39.640634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d9eeb02-444b-4108-831a-456611c0eebf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:39.641263 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d9eeb02-444b-4108-831a-456611c0eebf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:39.641880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d9eeb02-444b-4108-831a-456611c0eebf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:39.900405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-828e6c01-2646-448f-acb7-c7dbc4f6c6f7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:39.909940 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5d9eeb02-444b-4108-831a-456611c0eebf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:39.915225 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-828e6c01-2646-448f-acb7-c7dbc4f6c6f7 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1512 microversion: 2.1 time: 0.974581 Oct 10 23:48:39.918961 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5d9eeb02-444b-4108-831a-456611c0eebf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1314 microversion: 2.1 time: 0.292228 Oct 10 23:48:39.921395 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2808/5778] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:39 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:39.930699 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2971/5779] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:38 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1512 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:40.647468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a607891d-f92a-4bfb-af15-013850ab845d tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:40.651092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a607891d-f92a-4bfb-af15-013850ab845d tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] [instance: acb871a7-11b3-408c-b338-1c6310c113a7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:40.661544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a607891d-f92a-4bfb-af15-013850ab845d tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:40.662914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a607891d-f92a-4bfb-af15-013850ab845d tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:40.663746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a607891d-f92a-4bfb-af15-013850ab845d tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:40.664726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a607891d-f92a-4bfb-af15-013850ab845d tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:40.665488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a607891d-f92a-4bfb-af15-013850ab845d tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:40.666942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a607891d-f92a-4bfb-af15-013850ab845d tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:40.941531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fc3245b3-dd9e-4122-8ec7-197eefcbb122 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:40.942724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fc3245b3-dd9e-4122-8ec7-197eefcbb122 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:40.961083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc3245b3-dd9e-4122-8ec7-197eefcbb122 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:40.961852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc3245b3-dd9e-4122-8ec7-197eefcbb122 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:40.962435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc3245b3-dd9e-4122-8ec7-197eefcbb122 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:40.963305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc3245b3-dd9e-4122-8ec7-197eefcbb122 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:40.963915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc3245b3-dd9e-4122-8ec7-197eefcbb122 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:40.964486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc3245b3-dd9e-4122-8ec7-197eefcbb122 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:41.270432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a607891d-f92a-4bfb-af15-013850ab845d tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45dbc5ac25e34f3cba1d319565b485e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a1d72c53b4cc299596eed32fe9277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:41.307788 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a607891d-f92a-4bfb-af15-013850ab845d tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7" status: 200 len: 1505 microversion: 2.1 time: 0.668818 Oct 10 23:48:41.329892 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2809/5780] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:40 2022] GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 => generated 1505 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:41.337617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-483a06e2-9940-47a9-948e-a2558b580fbf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:41.338566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-483a06e2-9940-47a9-948e-a2558b580fbf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:41.363064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-483a06e2-9940-47a9-948e-a2558b580fbf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:41.364639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-483a06e2-9940-47a9-948e-a2558b580fbf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:41.367247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-483a06e2-9940-47a9-948e-a2558b580fbf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:41.368446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-483a06e2-9940-47a9-948e-a2558b580fbf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:41.368937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-483a06e2-9940-47a9-948e-a2558b580fbf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:41.370976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-483a06e2-9940-47a9-948e-a2558b580fbf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:41.428887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fc3245b3-dd9e-4122-8ec7-197eefcbb122 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:41.454656 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fc3245b3-dd9e-4122-8ec7-197eefcbb122 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1489 microversion: 2.1 time: 0.517982 Oct 10 23:48:41.469952 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2972/5781] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:40 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1489 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:41.486965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-08176a13-74ab-40c7-90b7-0d9f1f7cc487 req-149450bb-de88-48fe-aa4c-886134404c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acb871a7-11b3-408c-b338-1c6310c113a7", "name": "network-vif-deleted", "tag": "1dc2a085-74fa-4b23-ba25-961c8d20b8a3"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:41.515716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-08176a13-74ab-40c7-90b7-0d9f1f7cc487 req-149450bb-de88-48fe-aa4c-886134404c57 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:41.516553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-08176a13-74ab-40c7-90b7-0d9f1f7cc487 req-149450bb-de88-48fe-aa4c-886134404c57 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:41.517314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-08176a13-74ab-40c7-90b7-0d9f1f7cc487 req-149450bb-de88-48fe-aa4c-886134404c57 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:41.551590 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-08176a13-74ab-40c7-90b7-0d9f1f7cc487 req-149450bb-de88-48fe-aa4c-886134404c57 service nova] Creating event network-vif-deleted:1dc2a085-74fa-4b23-ba25-961c8d20b8a3 for instance acb871a7-11b3-408c-b338-1c6310c113a7 on n-h1-860864-2 Oct 10 23:48:41.560227 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-08176a13-74ab-40c7-90b7-0d9f1f7cc487 req-149450bb-de88-48fe-aa4c-886134404c57 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088075 Oct 10 23:48:41.562654 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2973/5782] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:48:41.572812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-520f7517-5f9e-47b0-bf7f-b81aec83b344 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1039434825"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:41.577916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-520f7517-5f9e-47b0-bf7f-b81aec83b344 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:41.590257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-520f7517-5f9e-47b0-bf7f-b81aec83b344 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:41.591696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-520f7517-5f9e-47b0-bf7f-b81aec83b344 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:41.593246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-520f7517-5f9e-47b0-bf7f-b81aec83b344 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:41.594860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-520f7517-5f9e-47b0-bf7f-b81aec83b344 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:41.595880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-520f7517-5f9e-47b0-bf7f-b81aec83b344 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:41.596837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-520f7517-5f9e-47b0-bf7f-b81aec83b344 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:41.732325 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-520f7517-5f9e-47b0-bf7f-b81aec83b344 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "PUT /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1062 microversion: 2.1 time: 0.167113 Oct 10 23:48:41.734302 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2974/5783] 10.222.0.23 () {60 vars in 1256 bytes} [Mon Oct 10 23:48:41 2022] PUT /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1062 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:41.750825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-1ae39b4e-2168-457a-9bba-13c3c802deba req-952a933d-f74d-4fd6-884c-a5ce34197a69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2606c2f7-d312-4418-b226-74371d7b8315", "tag": "7668ae94-786a-4b79-9096-53ff020bd6e1"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:41.764701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1ae39b4e-2168-457a-9bba-13c3c802deba req-952a933d-f74d-4fd6-884c-a5ce34197a69 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:41.765605 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1ae39b4e-2168-457a-9bba-13c3c802deba req-952a933d-f74d-4fd6-884c-a5ce34197a69 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:41.766185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1ae39b4e-2168-457a-9bba-13c3c802deba req-952a933d-f74d-4fd6-884c-a5ce34197a69 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:41.785512 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-1ae39b4e-2168-457a-9bba-13c3c802deba req-952a933d-f74d-4fd6-884c-a5ce34197a69 service nova] Creating event network-changed:7668ae94-786a-4b79-9096-53ff020bd6e1 for instance 2606c2f7-d312-4418-b226-74371d7b8315 on n-h2-860864-2 Oct 10 23:48:41.795532 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-1ae39b4e-2168-457a-9bba-13c3c802deba req-952a933d-f74d-4fd6-884c-a5ce34197a69 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049141 Oct 10 23:48:41.796742 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2975/5784] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:48:41.805804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bbb2598b-457d-47b7-9e1e-c5068701644b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:41.806784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bbb2598b-457d-47b7-9e1e-c5068701644b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:41.818086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbb2598b-457d-47b7-9e1e-c5068701644b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:41.819460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbb2598b-457d-47b7-9e1e-c5068701644b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:41.820472 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbb2598b-457d-47b7-9e1e-c5068701644b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:41.821466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbb2598b-457d-47b7-9e1e-c5068701644b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:41.822104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbb2598b-457d-47b7-9e1e-c5068701644b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:41.822700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbb2598b-457d-47b7-9e1e-c5068701644b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:42.032809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bbb2598b-457d-47b7-9e1e-c5068701644b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:42.056050 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bbb2598b-457d-47b7-9e1e-c5068701644b tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1489 microversion: 2.1 time: 0.257618 Oct 10 23:48:42.057480 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2976/5785] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:41 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1489 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:42.089260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0b6ee696-8380-403e-a9d7-729e1237a297 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:42.090217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0b6ee696-8380-403e-a9d7-729e1237a297 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:42.098523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b6ee696-8380-403e-a9d7-729e1237a297 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:42.099025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b6ee696-8380-403e-a9d7-729e1237a297 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:42.099711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b6ee696-8380-403e-a9d7-729e1237a297 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:42.100425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b6ee696-8380-403e-a9d7-729e1237a297 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:42.101051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b6ee696-8380-403e-a9d7-729e1237a297 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:42.101673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b6ee696-8380-403e-a9d7-729e1237a297 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:42.166203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-483a06e2-9940-47a9-948e-a2558b580fbf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:42.191409 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-483a06e2-9940-47a9-948e-a2558b580fbf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1314 microversion: 2.1 time: 0.860003 Oct 10 23:48:42.201970 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2810/5786] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:41 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1314 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:42.357074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-90b0ed10-4902-4cac-82a0-50ab5d323c4f tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:42.362828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-90b0ed10-4902-4cac-82a0-50ab5d323c4f tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] [instance: acb871a7-11b3-408c-b338-1c6310c113a7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:42.383629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90b0ed10-4902-4cac-82a0-50ab5d323c4f tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:42.384756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90b0ed10-4902-4cac-82a0-50ab5d323c4f tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:42.385980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90b0ed10-4902-4cac-82a0-50ab5d323c4f tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:42.387477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90b0ed10-4902-4cac-82a0-50ab5d323c4f tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:42.388379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90b0ed10-4902-4cac-82a0-50ab5d323c4f tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:42.389274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90b0ed10-4902-4cac-82a0-50ab5d323c4f tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:42.394590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0b6ee696-8380-403e-a9d7-729e1237a297 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:42.409916 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0b6ee696-8380-403e-a9d7-729e1237a297 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1489 microversion: 2.1 time: 0.325310 Oct 10 23:48:42.419670 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2977/5787] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:42 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1489 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:42.421683 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-90b0ed10-4902-4cac-82a0-50ab5d323c4f tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] HTTP exception thrown: Instance acb871a7-11b3-408c-b338-1c6310c113a7 could not be found. Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-90b0ed10-4902-4cac-82a0-50ab5d323c4f tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Request method failure captured: Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 HTTP/1.1 Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK87ChZruPQfWzKd0D1OoACANtWZ4HBxRHBusv4hc3o79mrKDOg18-8emHi51c6ytrqanbTU2I4JmXhOnU7ESVD5Oqe8jPHLArqVuhtY2C77l9P2ZiJ-9HrShBDV00IoZmwO8tAaryTce7mpVqzLHkfuMWVW7pRTlOVnp2thvhjlxKs Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: ea6a1d72c53b4cc299596eed32fe9277 Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerGroupTestJSON-1643137434 Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ea6a1d72c53b4cc299596eed32fe9277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ea6a1d72c53b4cc299596eed32fe9277"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ea6a1d72c53b4cc299596eed32fe9277"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ea6a1d72c53b4cc299596eed32fe9277", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerGroupTestJSON-1643137434 Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: ea6a1d72c53b4cc299596eed32fe9277 Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerGroupTestJSON-1643137434 Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerGroupTestJSON-1643137434-project Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 45dbc5ac25e34f3cba1d319565b485e3 Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerGroupTestJSON-1643137434-project Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance acb871a7-11b3-408c-b338-1c6310c113a7 could not be found. Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'acb871a7-11b3-408c-b338-1c6310c113a7'} Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acb871a7-11b3-408c-b338-1c6310c113a7 could not be found. Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acb871a7-11b3-408c-b338-1c6310c113a7 could not be found. Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:42.423524 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.428170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:42.428170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:42.428170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:42.428170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:48:42.428170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:48:42.428170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acb871a7-11b3-408c-b338-1c6310c113a7 could not be found. Oct 10 23:48:42.428170 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.428170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-90b0ed10-4902-4cac-82a0-50ab5d323c4f tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Returning 404 to user: Instance acb871a7-11b3-408c-b338-1c6310c113a7 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:48:42.428757 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-90b0ed10-4902-4cac-82a0-50ab5d323c4f tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7" status: 404 len: 111 microversion: 2.1 time: 0.090743 Oct 10 23:48:42.434911 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2811/5788] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:42 2022] GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:48:42.443894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1b9cf3c6-d4bd-428b-a223-b7f4030c8e47 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:42.452285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6905c709-b4eb-4371-91cd-334ee0cc6f27 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:42.452961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6905c709-b4eb-4371-91cd-334ee0cc6f27 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:42.459292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6905c709-b4eb-4371-91cd-334ee0cc6f27 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:42.459901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6905c709-b4eb-4371-91cd-334ee0cc6f27 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:42.460429 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6905c709-b4eb-4371-91cd-334ee0cc6f27 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:42.461219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6905c709-b4eb-4371-91cd-334ee0cc6f27 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:42.461895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6905c709-b4eb-4371-91cd-334ee0cc6f27 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:42.462398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6905c709-b4eb-4371-91cd-334ee0cc6f27 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:42.476045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.compute.server_groups [None req-1b9cf3c6-d4bd-428b-a223-b7f4030c8e47 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Querying cell c35e3cac-0e4f-44cc-a53a-8910e1eecc88(cell1) for 1 instances {{(pid=120613) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 10 23:48:42.477108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b9cf3c6-d4bd-428b-a223-b7f4030c8e47 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:42.478094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b9cf3c6-d4bd-428b-a223-b7f4030c8e47 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:42.478858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b9cf3c6-d4bd-428b-a223-b7f4030c8e47 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:42.494562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6905c709-b4eb-4371-91cd-334ee0cc6f27 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:48:42.499119 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1b9cf3c6-d4bd-428b-a223-b7f4030c8e47 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.059389 Oct 10 23:48:42.511111 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2978/5789] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:48:42 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:48:42.518209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-780b8233-3f9d-4269-a40b-7f800f0b97f3 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:42.565730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.compute.server_groups [None req-780b8233-3f9d-4269-a40b-7f800f0b97f3 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Querying cell c35e3cac-0e4f-44cc-a53a-8910e1eecc88(cell1) for 1 instances {{(pid=120613) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 10 23:48:42.566764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-780b8233-3f9d-4269-a40b-7f800f0b97f3 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:42.567322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-780b8233-3f9d-4269-a40b-7f800f0b97f3 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:42.567879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-780b8233-3f9d-4269-a40b-7f800f0b97f3 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:42.591539 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-780b8233-3f9d-4269-a40b-7f800f0b97f3 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/2f444903-8c1b-4de3-9573-8a66bdb782fa" status: 200 len: 184 microversion: 2.1 time: 0.077983 Oct 10 23:48:42.593367 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2979/5790] 10.222.0.23 () {58 vars in 1263 bytes} [Mon Oct 10 23:48:42 2022] GET /compute/v2.1/os-server-groups/2f444903-8c1b-4de3-9573-8a66bdb782fa => generated 184 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:48:42.611274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-40f82f0f-13ee-423a-9793-14b39fa9ba27 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:42.614169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-40f82f0f-13ee-423a-9793-14b39fa9ba27 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] [instance: acb871a7-11b3-408c-b338-1c6310c113a7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:42.620405 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6905c709-b4eb-4371-91cd-334ee0cc6f27 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 204 len: 0 microversion: 2.1 time: 0.171895 Oct 10 23:48:42.621291 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2812/5791] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:48:42 2022] DELETE /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 23:48:42.632120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d9dbee3a-94af-4dde-a888-bd508710e75c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:42.633104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d9dbee3a-94af-4dde-a888-bd508710e75c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:42.637909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40f82f0f-13ee-423a-9793-14b39fa9ba27 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:42.638964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40f82f0f-13ee-423a-9793-14b39fa9ba27 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:42.640388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40f82f0f-13ee-423a-9793-14b39fa9ba27 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:42.640588 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9dbee3a-94af-4dde-a888-bd508710e75c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:42.641251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9dbee3a-94af-4dde-a888-bd508710e75c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:42.641898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9dbee3a-94af-4dde-a888-bd508710e75c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:42.642720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40f82f0f-13ee-423a-9793-14b39fa9ba27 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:42.642956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9dbee3a-94af-4dde-a888-bd508710e75c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:42.643508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40f82f0f-13ee-423a-9793-14b39fa9ba27 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:42.644364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9dbee3a-94af-4dde-a888-bd508710e75c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:42.644958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9dbee3a-94af-4dde-a888-bd508710e75c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:42.645259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40f82f0f-13ee-423a-9793-14b39fa9ba27 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:42.668785 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-40f82f0f-13ee-423a-9793-14b39fa9ba27 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] HTTP exception thrown: Instance acb871a7-11b3-408c-b338-1c6310c113a7 could not be found. Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-40f82f0f-13ee-423a-9793-14b39fa9ba27 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Request method failure captured: Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 HTTP/1.1 Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK87ChZruPQfWzKd0D1OoACANtWZ4HBxRHBusv4hc3o79mrKDOg18-8emHi51c6ytrqanbTU2I4JmXhOnU7ESVD5Oqe8jPHLArqVuhtY2C77l9P2ZiJ-9HrShBDV00IoZmwO8tAaryTce7mpVqzLHkfuMWVW7pRTlOVnp2thvhjlxKs Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: ea6a1d72c53b4cc299596eed32fe9277 Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerGroupTestJSON-1643137434 Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ea6a1d72c53b4cc299596eed32fe9277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ea6a1d72c53b4cc299596eed32fe9277"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ea6a1d72c53b4cc299596eed32fe9277"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ea6a1d72c53b4cc299596eed32fe9277", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerGroupTestJSON-1643137434 Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: ea6a1d72c53b4cc299596eed32fe9277 Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerGroupTestJSON-1643137434 Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerGroupTestJSON-1643137434-project Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 45dbc5ac25e34f3cba1d319565b485e3 Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerGroupTestJSON-1643137434-project Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance acb871a7-11b3-408c-b338-1c6310c113a7 could not be found. Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'acb871a7-11b3-408c-b338-1c6310c113a7'} Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acb871a7-11b3-408c-b338-1c6310c113a7 could not be found. Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:48:42.672567 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:48:42.676944 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acb871a7-11b3-408c-b338-1c6310c113a7 could not be found. Oct 10 23:48:42.676944 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.676944 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:42.676944 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.676944 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:42.676944 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:42.676944 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:42.676944 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:48:42.676944 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:48:42.676944 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acb871a7-11b3-408c-b338-1c6310c113a7 could not be found. Oct 10 23:48:42.676944 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.681049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-40f82f0f-13ee-423a-9793-14b39fa9ba27 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Returning 404 to user: Instance acb871a7-11b3-408c-b338-1c6310c113a7 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:48:42.682124 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-40f82f0f-13ee-423a-9793-14b39fa9ba27 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "DELETE /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7" status: 404 len: 111 microversion: 2.1 time: 0.080867 Oct 10 23:48:42.686993 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2980/5792] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:48:42 2022] DELETE /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:48:42.695018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2917155e-8b91-4e5f-a430-bb2d8bbe867a tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:42.696512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2917155e-8b91-4e5f-a430-bb2d8bbe867a tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] [instance: acb871a7-11b3-408c-b338-1c6310c113a7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:42.710024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2917155e-8b91-4e5f-a430-bb2d8bbe867a tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:42.710721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2917155e-8b91-4e5f-a430-bb2d8bbe867a tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:42.711921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2917155e-8b91-4e5f-a430-bb2d8bbe867a tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:42.712839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2917155e-8b91-4e5f-a430-bb2d8bbe867a tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:42.713670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2917155e-8b91-4e5f-a430-bb2d8bbe867a tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:42.714401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2917155e-8b91-4e5f-a430-bb2d8bbe867a tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:42.739746 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-2917155e-8b91-4e5f-a430-bb2d8bbe867a tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] HTTP exception thrown: Instance acb871a7-11b3-408c-b338-1c6310c113a7 could not be found. Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2917155e-8b91-4e5f-a430-bb2d8bbe867a tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Request method failure captured: Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 HTTP/1.1 Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK87ChZruPQfWzKd0D1OoACANtWZ4HBxRHBusv4hc3o79mrKDOg18-8emHi51c6ytrqanbTU2I4JmXhOnU7ESVD5Oqe8jPHLArqVuhtY2C77l9P2ZiJ-9HrShBDV00IoZmwO8tAaryTce7mpVqzLHkfuMWVW7pRTlOVnp2thvhjlxKs Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: ea6a1d72c53b4cc299596eed32fe9277 Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerGroupTestJSON-1643137434 Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ea6a1d72c53b4cc299596eed32fe9277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ea6a1d72c53b4cc299596eed32fe9277"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ea6a1d72c53b4cc299596eed32fe9277"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ea6a1d72c53b4cc299596eed32fe9277", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerGroupTestJSON-1643137434 Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: ea6a1d72c53b4cc299596eed32fe9277 Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerGroupTestJSON-1643137434 Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerGroupTestJSON-1643137434-project Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 45dbc5ac25e34f3cba1d319565b485e3 Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerGroupTestJSON-1643137434-project Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance acb871a7-11b3-408c-b338-1c6310c113a7 could not be found. Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'acb871a7-11b3-408c-b338-1c6310c113a7'} Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acb871a7-11b3-408c-b338-1c6310c113a7 could not be found. Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acb871a7-11b3-408c-b338-1c6310c113a7 could not be found. Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:42.744202 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.752183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:42.752183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:42.752183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:42.752183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:48:42.752183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:48:42.752183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acb871a7-11b3-408c-b338-1c6310c113a7 could not be found. Oct 10 23:48:42.752183 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.757660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2917155e-8b91-4e5f-a430-bb2d8bbe867a tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Returning 404 to user: Instance acb871a7-11b3-408c-b338-1c6310c113a7 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:48:42.757660 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2917155e-8b91-4e5f-a430-bb2d8bbe867a tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7" status: 404 len: 111 microversion: 2.1 time: 0.066868 Oct 10 23:48:42.757660 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2981/5793] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:42 2022] GET /compute/v2.1/servers/acb871a7-11b3-408c-b338-1c6310c113a7 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:48:42.773083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-548aa9c7-2fd6-443d-a7d4-49ecd57f59e1 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:42.780926 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-548aa9c7-2fd6-443d-a7d4-49ecd57f59e1 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] HTTP exception thrown: Instance group 1cd7783c-0b15-45c6-9fd1-207b0483281e could not be found. Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-548aa9c7-2fd6-443d-a7d4-49ecd57f59e1 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Request method failure captured: Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/os-server-groups/1cd7783c-0b15-45c6-9fd1-207b0483281e HTTP/1.1 Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK87ChZruPQfWzKd0D1OoACANtWZ4HBxRHBusv4hc3o79mrKDOg18-8emHi51c6ytrqanbTU2I4JmXhOnU7ESVD5Oqe8jPHLArqVuhtY2C77l9P2ZiJ-9HrShBDV00IoZmwO8tAaryTce7mpVqzLHkfuMWVW7pRTlOVnp2thvhjlxKs Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: ea6a1d72c53b4cc299596eed32fe9277 Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerGroupTestJSON-1643137434 Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ea6a1d72c53b4cc299596eed32fe9277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ea6a1d72c53b4cc299596eed32fe9277"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ea6a1d72c53b4cc299596eed32fe9277"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ea6a1d72c53b4cc299596eed32fe9277", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerGroupTestJSON-1643137434 Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: ea6a1d72c53b4cc299596eed32fe9277 Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerGroupTestJSON-1643137434 Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerGroupTestJSON-1643137434-project Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 45dbc5ac25e34f3cba1d319565b485e3 Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerGroupTestJSON-1643137434-project Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance group 1cd7783c-0b15-45c6-9fd1-207b0483281e could not be found. Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '1cd7783c-0b15-45c6-9fd1-207b0483281e'} Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1cd7783c-0b15-45c6-9fd1-207b0483281e could not be found. Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1cd7783c-0b15-45c6-9fd1-207b0483281e could not be found. Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.783517 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:42.788282 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:42.788282 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:42.788282 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:48:42.788282 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:48:42.788282 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1cd7783c-0b15-45c6-9fd1-207b0483281e could not be found. Oct 10 23:48:42.788282 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.790211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-548aa9c7-2fd6-443d-a7d4-49ecd57f59e1 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Returning 404 to user: Instance group 1cd7783c-0b15-45c6-9fd1-207b0483281e could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:48:42.791110 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-548aa9c7-2fd6-443d-a7d4-49ecd57f59e1 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/1cd7783c-0b15-45c6-9fd1-207b0483281e" status: 404 len: 117 microversion: 2.1 time: 0.022501 Oct 10 23:48:42.792020 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2982/5794] 10.222.0.23 () {58 vars in 1266 bytes} [Mon Oct 10 23:48:42 2022] DELETE /compute/v2.1/os-server-groups/1cd7783c-0b15-45c6-9fd1-207b0483281e => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:48:42.804916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c60dd42e-325b-4d2d-a52b-8cc8880ca7e7 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:42.820314 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-c60dd42e-325b-4d2d-a52b-8cc8880ca7e7 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] HTTP exception thrown: Instance group 5a967451-77f7-49ab-a682-c5857f91e683 could not be found. Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c60dd42e-325b-4d2d-a52b-8cc8880ca7e7 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Request method failure captured: Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/os-server-groups/5a967451-77f7-49ab-a682-c5857f91e683 HTTP/1.1 Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK87ChZruPQfWzKd0D1OoACANtWZ4HBxRHBusv4hc3o79mrKDOg18-8emHi51c6ytrqanbTU2I4JmXhOnU7ESVD5Oqe8jPHLArqVuhtY2C77l9P2ZiJ-9HrShBDV00IoZmwO8tAaryTce7mpVqzLHkfuMWVW7pRTlOVnp2thvhjlxKs Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: ea6a1d72c53b4cc299596eed32fe9277 Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerGroupTestJSON-1643137434 Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ea6a1d72c53b4cc299596eed32fe9277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ea6a1d72c53b4cc299596eed32fe9277"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ea6a1d72c53b4cc299596eed32fe9277"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ea6a1d72c53b4cc299596eed32fe9277", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerGroupTestJSON-1643137434 Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: ea6a1d72c53b4cc299596eed32fe9277 Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerGroupTestJSON-1643137434 Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerGroupTestJSON-1643137434-project Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 45dbc5ac25e34f3cba1d319565b485e3 Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerGroupTestJSON-1643137434-project Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance group 5a967451-77f7-49ab-a682-c5857f91e683 could not be found. Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '5a967451-77f7-49ab-a682-c5857f91e683'} Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 5a967451-77f7-49ab-a682-c5857f91e683 could not be found. Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 5a967451-77f7-49ab-a682-c5857f91e683 could not be found. Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.828370 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:42.832397 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:42.832397 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:42.832397 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:48:42.832397 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:48:42.832397 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 5a967451-77f7-49ab-a682-c5857f91e683 could not be found. Oct 10 23:48:42.832397 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.834235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c60dd42e-325b-4d2d-a52b-8cc8880ca7e7 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Returning 404 to user: Instance group 5a967451-77f7-49ab-a682-c5857f91e683 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:48:42.835346 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c60dd42e-325b-4d2d-a52b-8cc8880ca7e7 tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/5a967451-77f7-49ab-a682-c5857f91e683" status: 404 len: 117 microversion: 2.1 time: 0.035671 Oct 10 23:48:42.836473 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2983/5795] 10.222.0.23 () {58 vars in 1266 bytes} [Mon Oct 10 23:48:42 2022] DELETE /compute/v2.1/os-server-groups/5a967451-77f7-49ab-a682-c5857f91e683 => generated 117 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:48:42.849627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5b5b0266-dd1b-4555-ad05-88b87c223a2b tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:42.878131 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-5b5b0266-dd1b-4555-ad05-88b87c223a2b tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] HTTP exception thrown: Instance group 968d1964-5359-4558-97ff-d477732ddf9b could not be found. Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5b5b0266-dd1b-4555-ad05-88b87c223a2b tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Request method failure captured: Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/os-server-groups/968d1964-5359-4558-97ff-d477732ddf9b HTTP/1.1 Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK87ChZruPQfWzKd0D1OoACANtWZ4HBxRHBusv4hc3o79mrKDOg18-8emHi51c6ytrqanbTU2I4JmXhOnU7ESVD5Oqe8jPHLArqVuhtY2C77l9P2ZiJ-9HrShBDV00IoZmwO8tAaryTce7mpVqzLHkfuMWVW7pRTlOVnp2thvhjlxKs Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: ea6a1d72c53b4cc299596eed32fe9277 Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerGroupTestJSON-1643137434 Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ea6a1d72c53b4cc299596eed32fe9277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ea6a1d72c53b4cc299596eed32fe9277"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ea6a1d72c53b4cc299596eed32fe9277"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ea6a1d72c53b4cc299596eed32fe9277", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerGroupTestJSON-1643137434 Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: ea6a1d72c53b4cc299596eed32fe9277 Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerGroupTestJSON-1643137434 Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerGroupTestJSON-1643137434-project Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 45dbc5ac25e34f3cba1d319565b485e3 Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerGroupTestJSON-1643137434-project Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance group 968d1964-5359-4558-97ff-d477732ddf9b could not be found. Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '968d1964-5359-4558-97ff-d477732ddf9b'} Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 968d1964-5359-4558-97ff-d477732ddf9b could not be found. Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 968d1964-5359-4558-97ff-d477732ddf9b could not be found. Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.879860 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:42.884762 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:42.884762 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:42.884762 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:48:42.884762 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:48:42.884762 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 968d1964-5359-4558-97ff-d477732ddf9b could not be found. Oct 10 23:48:42.884762 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.884762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5b5b0266-dd1b-4555-ad05-88b87c223a2b tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Returning 404 to user: Instance group 968d1964-5359-4558-97ff-d477732ddf9b could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:48:42.885398 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5b5b0266-dd1b-4555-ad05-88b87c223a2b tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/968d1964-5359-4558-97ff-d477732ddf9b" status: 404 len: 117 microversion: 2.1 time: 0.044079 Oct 10 23:48:42.890769 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2984/5796] 10.222.0.23 () {58 vars in 1266 bytes} [Mon Oct 10 23:48:42 2022] DELETE /compute/v2.1/os-server-groups/968d1964-5359-4558-97ff-d477732ddf9b => generated 117 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:48:42.904598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a588f97e-75f5-48b9-9f12-bab8a26bf23c tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:42.921611 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-a588f97e-75f5-48b9-9f12-bab8a26bf23c tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] HTTP exception thrown: Instance group ef5a94eb-7da1-402b-bfa5-3a40181c38bf could not be found. Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a588f97e-75f5-48b9-9f12-bab8a26bf23c tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Request method failure captured: Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/os-server-groups/ef5a94eb-7da1-402b-bfa5-3a40181c38bf HTTP/1.1 Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK87ChZruPQfWzKd0D1OoACANtWZ4HBxRHBusv4hc3o79mrKDOg18-8emHi51c6ytrqanbTU2I4JmXhOnU7ESVD5Oqe8jPHLArqVuhtY2C77l9P2ZiJ-9HrShBDV00IoZmwO8tAaryTce7mpVqzLHkfuMWVW7pRTlOVnp2thvhjlxKs Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: ea6a1d72c53b4cc299596eed32fe9277 Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerGroupTestJSON-1643137434 Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ea6a1d72c53b4cc299596eed32fe9277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ea6a1d72c53b4cc299596eed32fe9277"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ea6a1d72c53b4cc299596eed32fe9277"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ea6a1d72c53b4cc299596eed32fe9277", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerGroupTestJSON-1643137434 Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: ea6a1d72c53b4cc299596eed32fe9277 Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerGroupTestJSON-1643137434 Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerGroupTestJSON-1643137434-project Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 45dbc5ac25e34f3cba1d319565b485e3 Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerGroupTestJSON-1643137434-project Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance group ef5a94eb-7da1-402b-bfa5-3a40181c38bf could not be found. Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'ef5a94eb-7da1-402b-bfa5-3a40181c38bf'} Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ef5a94eb-7da1-402b-bfa5-3a40181c38bf could not be found. Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ef5a94eb-7da1-402b-bfa5-3a40181c38bf could not be found. Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.923221 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:42.927284 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:42.927284 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:42.927284 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:48:42.927284 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:48:42.927284 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ef5a94eb-7da1-402b-bfa5-3a40181c38bf could not be found. Oct 10 23:48:42.927284 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:42.931438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a588f97e-75f5-48b9-9f12-bab8a26bf23c tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Returning 404 to user: Instance group ef5a94eb-7da1-402b-bfa5-3a40181c38bf could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:48:42.932503 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a588f97e-75f5-48b9-9f12-bab8a26bf23c tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/ef5a94eb-7da1-402b-bfa5-3a40181c38bf" status: 404 len: 117 microversion: 2.1 time: 0.040003 Oct 10 23:48:42.941074 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2985/5797] 10.222.0.23 () {58 vars in 1266 bytes} [Mon Oct 10 23:48:42 2022] DELETE /compute/v2.1/os-server-groups/ef5a94eb-7da1-402b-bfa5-3a40181c38bf => generated 117 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:48:42.949555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-60050aa7-1238-4a4c-a0e4-b8e2cfa8401e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:42.997580 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-60050aa7-1238-4a4c-a0e4-b8e2cfa8401e tempest-ServerGroupTestJSON-1643137434 tempest-ServerGroupTestJSON-1643137434-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/2f444903-8c1b-4de3-9573-8a66bdb782fa" status: 204 len: 0 microversion: 2.1 time: 0.054827 Oct 10 23:48:43.004668 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2986/5798] 10.222.0.23 () {58 vars in 1266 bytes} [Mon Oct 10 23:48:42 2022] DELETE /compute/v2.1/os-server-groups/2f444903-8c1b-4de3-9573-8a66bdb782fa => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:48:43.121317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d9dbee3a-94af-4dde-a888-bd508710e75c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:43.144174 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d9dbee3a-94af-4dde-a888-bd508710e75c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1495 microversion: 2.1 time: 0.516195 Oct 10 23:48:43.161607 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2813/5799] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:42 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1495 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:43.220559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-919f0835-691b-49dc-96f8-46b87c25bbca tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:43.222045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-919f0835-691b-49dc-96f8-46b87c25bbca tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:43.235048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-919f0835-691b-49dc-96f8-46b87c25bbca tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:43.236930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-919f0835-691b-49dc-96f8-46b87c25bbca tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:43.236930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-919f0835-691b-49dc-96f8-46b87c25bbca tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:43.242387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-919f0835-691b-49dc-96f8-46b87c25bbca tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:43.242387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-919f0835-691b-49dc-96f8-46b87c25bbca tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:43.242387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-919f0835-691b-49dc-96f8-46b87c25bbca tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:43.517498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-919f0835-691b-49dc-96f8-46b87c25bbca tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:43.528379 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-919f0835-691b-49dc-96f8-46b87c25bbca tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1314 microversion: 2.1 time: 0.312851 Oct 10 23:48:43.538350 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2987/5800] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:43 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:44.174487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b995a0e7-c23c-4b69-8924-8b172339e805 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:44.174487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b995a0e7-c23c-4b69-8924-8b172339e805 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:44.193850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b995a0e7-c23c-4b69-8924-8b172339e805 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:44.198355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b995a0e7-c23c-4b69-8924-8b172339e805 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:44.200672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b995a0e7-c23c-4b69-8924-8b172339e805 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:44.203807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b995a0e7-c23c-4b69-8924-8b172339e805 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:44.204665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b995a0e7-c23c-4b69-8924-8b172339e805 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:44.206795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b995a0e7-c23c-4b69-8924-8b172339e805 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:44.556919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3108ce7e-6b90-4151-844c-f79460f805df tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:44.558010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3108ce7e-6b90-4151-844c-f79460f805df tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:44.582924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3108ce7e-6b90-4151-844c-f79460f805df tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:44.583704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3108ce7e-6b90-4151-844c-f79460f805df tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:44.584313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3108ce7e-6b90-4151-844c-f79460f805df tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:44.585229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3108ce7e-6b90-4151-844c-f79460f805df tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:44.585925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3108ce7e-6b90-4151-844c-f79460f805df tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:44.586529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3108ce7e-6b90-4151-844c-f79460f805df tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:45.147075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:48:45.200884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3108ce7e-6b90-4151-844c-f79460f805df tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:45.240367 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3108ce7e-6b90-4151-844c-f79460f805df tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1314 microversion: 2.1 time: 0.691159 Oct 10 23:48:45.245995 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2988/5801] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:44 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1314 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:45.844514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b995a0e7-c23c-4b69-8924-8b172339e805 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:45.851124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:48:45.880800 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b995a0e7-c23c-4b69-8924-8b172339e805 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 200 len: 1495 microversion: 2.1 time: 1.714592 Oct 10 23:48:45.886556 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2814/5802] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:44 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 1495 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:46.010088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-7939118a-0e5b-42a6-a47b-2bc95731515c req-2f84f8be-2cfa-45be-a936-ac3868843c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27c4ace-98ac-4682-8831-ba316b45e35f", "name": "network-vif-deleted", "tag": "2bf908b7-8037-4195-bf7c-73759ed2e157"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:46.067168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:48:46.094839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7939118a-0e5b-42a6-a47b-2bc95731515c req-2f84f8be-2cfa-45be-a936-ac3868843c5e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:46.096330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7939118a-0e5b-42a6-a47b-2bc95731515c req-2f84f8be-2cfa-45be-a936-ac3868843c5e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:46.099903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7939118a-0e5b-42a6-a47b-2bc95731515c req-2f84f8be-2cfa-45be-a936-ac3868843c5e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:46.139528 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-7939118a-0e5b-42a6-a47b-2bc95731515c req-2f84f8be-2cfa-45be-a936-ac3868843c5e service nova] Creating event network-vif-deleted:2bf908b7-8037-4195-bf7c-73759ed2e157 for instance b27c4ace-98ac-4682-8831-ba316b45e35f on n-h1-860864-2 Oct 10 23:48:46.153669 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-7939118a-0e5b-42a6-a47b-2bc95731515c req-2f84f8be-2cfa-45be-a936-ac3868843c5e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148958 Oct 10 23:48:46.157333 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2989/5803] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:48:46.268636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-730c567b-a6ea-4c6a-8a09-4de16621fcd8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:46.269729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-730c567b-a6ea-4c6a-8a09-4de16621fcd8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:46.294018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-730c567b-a6ea-4c6a-8a09-4de16621fcd8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:46.294919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-730c567b-a6ea-4c6a-8a09-4de16621fcd8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:46.295635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-730c567b-a6ea-4c6a-8a09-4de16621fcd8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:46.297842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-730c567b-a6ea-4c6a-8a09-4de16621fcd8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:46.298394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-730c567b-a6ea-4c6a-8a09-4de16621fcd8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:46.299109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-730c567b-a6ea-4c6a-8a09-4de16621fcd8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:46.915572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3f0a368c-a37b-4911-9276-ab7fc957588e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:46.916406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3f0a368c-a37b-4911-9276-ab7fc957588e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:46.936815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f0a368c-a37b-4911-9276-ab7fc957588e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:46.936815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f0a368c-a37b-4911-9276-ab7fc957588e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:46.952534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f0a368c-a37b-4911-9276-ab7fc957588e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:46.959490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f0a368c-a37b-4911-9276-ab7fc957588e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:46.960178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f0a368c-a37b-4911-9276-ab7fc957588e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:46.960699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f0a368c-a37b-4911-9276-ab7fc957588e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:46.969938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:48:47.000412 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-3f0a368c-a37b-4911-9276-ab7fc957588e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] HTTP exception thrown: Instance b27c4ace-98ac-4682-8831-ba316b45e35f could not be found. Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3f0a368c-a37b-4911-9276-ab7fc957588e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Request method failure captured: Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f HTTP/1.1 Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK5cQzq5PmBN8ZK8xufnInf_nKzozFybG60EPi2LKIagIuIo6wmjCjt_dEi9KoG421lgq7o9GXzxCjj26_PYoj0IVUx4iuPxFYRw_bINPtYf7R0sv0LrnaNDyTyma9wRBMptURK1MlutQq_man6Zj75t-cnvbQ_0wIRWAQ7WKgqvlIM Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fcc4d45337140259bcd5b64b17aa7b5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: daf7a1ddba654265a5e732363c85eefa Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance b27c4ace-98ac-4682-8831-ba316b45e35f could not be found. Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'b27c4ace-98ac-4682-8831-ba316b45e35f'} Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27c4ace-98ac-4682-8831-ba316b45e35f could not be found. Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27c4ace-98ac-4682-8831-ba316b45e35f could not be found. Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.006663 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.011684 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.011684 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.011684 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.011684 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:48:47.011684 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:48:47.011684 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27c4ace-98ac-4682-8831-ba316b45e35f could not be found. Oct 10 23:48:47.011684 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.011684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3f0a368c-a37b-4911-9276-ab7fc957588e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Returning 404 to user: Instance b27c4ace-98ac-4682-8831-ba316b45e35f could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:48:47.011684 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3f0a368c-a37b-4911-9276-ab7fc957588e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 404 len: 111 microversion: 2.1 time: 0.100772 Oct 10 23:48:47.023594 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2990/5804] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:46 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:48:47.040338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-21a158e5-ed55-40ca-a8d2-e3dc6939d2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:47.040813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-21a158e5-ed55-40ca-a8d2-e3dc6939d2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:47.067812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21a158e5-ed55-40ca-a8d2-e3dc6939d2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.068624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21a158e5-ed55-40ca-a8d2-e3dc6939d2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.069242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21a158e5-ed55-40ca-a8d2-e3dc6939d2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.070810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21a158e5-ed55-40ca-a8d2-e3dc6939d2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.071603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21a158e5-ed55-40ca-a8d2-e3dc6939d2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.072362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21a158e5-ed55-40ca-a8d2-e3dc6939d2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.140482 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-21a158e5-ed55-40ca-a8d2-e3dc6939d2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] HTTP exception thrown: Instance b27c4ace-98ac-4682-8831-ba316b45e35f could not be found. Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-21a158e5-ed55-40ca-a8d2-e3dc6939d2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Request method failure captured: Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f HTTP/1.1 Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK5cQzq5PmBN8ZK8xufnInf_nKzozFybG60EPi2LKIagIuIo6wmjCjt_dEi9KoG421lgq7o9GXzxCjj26_PYoj0IVUx4iuPxFYRw_bINPtYf7R0sv0LrnaNDyTyma9wRBMptURK1MlutQq_man6Zj75t-cnvbQ_0wIRWAQ7WKgqvlIM Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fcc4d45337140259bcd5b64b17aa7b5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: daf7a1ddba654265a5e732363c85eefa Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance b27c4ace-98ac-4682-8831-ba316b45e35f could not be found. Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'b27c4ace-98ac-4682-8831-ba316b45e35f'} Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27c4ace-98ac-4682-8831-ba316b45e35f could not be found. Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:48:47.144404 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27c4ace-98ac-4682-8831-ba316b45e35f could not be found. Oct 10 23:48:47.149875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.149875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.149875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.149875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.149875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.149875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.149875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:48:47.149875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:48:47.149875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27c4ace-98ac-4682-8831-ba316b45e35f could not be found. Oct 10 23:48:47.149875 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.149875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-21a158e5-ed55-40ca-a8d2-e3dc6939d2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Returning 404 to user: Instance b27c4ace-98ac-4682-8831-ba316b45e35f could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:48:47.149875 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-21a158e5-ed55-40ca-a8d2-e3dc6939d2ae tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 404 len: 111 microversion: 2.1 time: 0.126138 Oct 10 23:48:47.161607 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2991/5805] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:48:47 2022] DELETE /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:48:47.175069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d9191da2-7804-4608-92a2-bed511e49130 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:47.176210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d9191da2-7804-4608-92a2-bed511e49130 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b27c4ace-98ac-4682-8831-ba316b45e35f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:47.209922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9191da2-7804-4608-92a2-bed511e49130 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.210592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9191da2-7804-4608-92a2-bed511e49130 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.211050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9191da2-7804-4608-92a2-bed511e49130 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.211814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9191da2-7804-4608-92a2-bed511e49130 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.212274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9191da2-7804-4608-92a2-bed511e49130 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.212706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9191da2-7804-4608-92a2-bed511e49130 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.233351 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-d9191da2-7804-4608-92a2-bed511e49130 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] HTTP exception thrown: Instance b27c4ace-98ac-4682-8831-ba316b45e35f could not be found. Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d9191da2-7804-4608-92a2-bed511e49130 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Request method failure captured: Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f HTTP/1.1 Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK5cQzq5PmBN8ZK8xufnInf_nKzozFybG60EPi2LKIagIuIo6wmjCjt_dEi9KoG421lgq7o9GXzxCjj26_PYoj0IVUx4iuPxFYRw_bINPtYf7R0sv0LrnaNDyTyma9wRBMptURK1MlutQq_man6Zj75t-cnvbQ_0wIRWAQ7WKgqvlIM Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fcc4d45337140259bcd5b64b17aa7b5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: daf7a1ddba654265a5e732363c85eefa Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance b27c4ace-98ac-4682-8831-ba316b45e35f could not be found. Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'b27c4ace-98ac-4682-8831-ba316b45e35f'} Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27c4ace-98ac-4682-8831-ba316b45e35f could not be found. Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27c4ace-98ac-4682-8831-ba316b45e35f could not be found. Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.236716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.241652 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.241652 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.241652 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.241652 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:48:47.241652 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:48:47.241652 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27c4ace-98ac-4682-8831-ba316b45e35f could not be found. Oct 10 23:48:47.241652 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.245283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d9191da2-7804-4608-92a2-bed511e49130 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Returning 404 to user: Instance b27c4ace-98ac-4682-8831-ba316b45e35f could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:48:47.247823 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d9191da2-7804-4608-92a2-bed511e49130 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f" status: 404 len: 111 microversion: 2.1 time: 0.086398 Oct 10 23:48:47.253508 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2992/5806] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:47 2022] GET /compute/v2.1/servers/b27c4ace-98ac-4682-8831-ba316b45e35f => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:48:47.259236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f759e126-6365-45a5-81d8-d33694e48ce3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:47.259947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f759e126-6365-45a5-81d8-d33694e48ce3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:47.273073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f759e126-6365-45a5-81d8-d33694e48ce3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.274178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f759e126-6365-45a5-81d8-d33694e48ce3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.275352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f759e126-6365-45a5-81d8-d33694e48ce3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.278619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f759e126-6365-45a5-81d8-d33694e48ce3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.279458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f759e126-6365-45a5-81d8-d33694e48ce3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.281026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f759e126-6365-45a5-81d8-d33694e48ce3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.306771 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-f759e126-6365-45a5-81d8-d33694e48ce3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] HTTP exception thrown: Instance 12616f56-d1c0-4db0-82b5-8adabb53a8b8 could not be found. Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f759e126-6365-45a5-81d8-d33694e48ce3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Request method failure captured: Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 HTTP/1.1 Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK5cQzq5PmBN8ZK8xufnInf_nKzozFybG60EPi2LKIagIuIo6wmjCjt_dEi9KoG421lgq7o9GXzxCjj26_PYoj0IVUx4iuPxFYRw_bINPtYf7R0sv0LrnaNDyTyma9wRBMptURK1MlutQq_man6Zj75t-cnvbQ_0wIRWAQ7WKgqvlIM Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fcc4d45337140259bcd5b64b17aa7b5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: daf7a1ddba654265a5e732363c85eefa Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 12616f56-d1c0-4db0-82b5-8adabb53a8b8 could not be found. Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '12616f56-d1c0-4db0-82b5-8adabb53a8b8'} Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12616f56-d1c0-4db0-82b5-8adabb53a8b8 could not be found. Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:48:47.310115 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12616f56-d1c0-4db0-82b5-8adabb53a8b8 could not be found. Oct 10 23:48:47.317093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.317093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.317093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.317093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.317093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.317093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.317093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:48:47.317093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:48:47.317093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12616f56-d1c0-4db0-82b5-8adabb53a8b8 could not be found. Oct 10 23:48:47.317093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.319607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f759e126-6365-45a5-81d8-d33694e48ce3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Returning 404 to user: Instance 12616f56-d1c0-4db0-82b5-8adabb53a8b8 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:48:47.321157 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f759e126-6365-45a5-81d8-d33694e48ce3 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "DELETE /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8" status: 404 len: 111 microversion: 2.1 time: 0.066341 Oct 10 23:48:47.325283 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2993/5807] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:48:47 2022] DELETE /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:48:47.332814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-86fcea85-d692-4de9-90ad-6bc41e878e12 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:47.333760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-86fcea85-d692-4de9-90ad-6bc41e878e12 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 12616f56-d1c0-4db0-82b5-8adabb53a8b8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:47.343993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86fcea85-d692-4de9-90ad-6bc41e878e12 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.344755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86fcea85-d692-4de9-90ad-6bc41e878e12 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.345427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86fcea85-d692-4de9-90ad-6bc41e878e12 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.346502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86fcea85-d692-4de9-90ad-6bc41e878e12 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.347170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86fcea85-d692-4de9-90ad-6bc41e878e12 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.347937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86fcea85-d692-4de9-90ad-6bc41e878e12 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.367521 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-86fcea85-d692-4de9-90ad-6bc41e878e12 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] HTTP exception thrown: Instance 12616f56-d1c0-4db0-82b5-8adabb53a8b8 could not be found. Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-86fcea85-d692-4de9-90ad-6bc41e878e12 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Request method failure captured: Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 HTTP/1.1 Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK5cQzq5PmBN8ZK8xufnInf_nKzozFybG60EPi2LKIagIuIo6wmjCjt_dEi9KoG421lgq7o9GXzxCjj26_PYoj0IVUx4iuPxFYRw_bINPtYf7R0sv0LrnaNDyTyma9wRBMptURK1MlutQq_man6Zj75t-cnvbQ_0wIRWAQ7WKgqvlIM Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fcc4d45337140259bcd5b64b17aa7b5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: daf7a1ddba654265a5e732363c85eefa Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 12616f56-d1c0-4db0-82b5-8adabb53a8b8 could not be found. Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '12616f56-d1c0-4db0-82b5-8adabb53a8b8'} Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12616f56-d1c0-4db0-82b5-8adabb53a8b8 could not be found. Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12616f56-d1c0-4db0-82b5-8adabb53a8b8 could not be found. Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.369643 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.374448 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.374448 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.374448 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.374448 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:48:47.374448 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:48:47.374448 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12616f56-d1c0-4db0-82b5-8adabb53a8b8 could not be found. Oct 10 23:48:47.374448 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.374448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-86fcea85-d692-4de9-90ad-6bc41e878e12 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Returning 404 to user: Instance 12616f56-d1c0-4db0-82b5-8adabb53a8b8 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:48:47.374448 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-86fcea85-d692-4de9-90ad-6bc41e878e12 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8" status: 404 len: 111 microversion: 2.1 time: 0.043597 Oct 10 23:48:47.374448 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2994/5808] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:47 2022] GET /compute/v2.1/servers/12616f56-d1c0-4db0-82b5-8adabb53a8b8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:48:47.381119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c92967f6-14a9-4a6e-8ea3-11fe7558550d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:47.381665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c92967f6-14a9-4a6e-8ea3-11fe7558550d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:47.388356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c92967f6-14a9-4a6e-8ea3-11fe7558550d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.389635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c92967f6-14a9-4a6e-8ea3-11fe7558550d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.391278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c92967f6-14a9-4a6e-8ea3-11fe7558550d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.392770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c92967f6-14a9-4a6e-8ea3-11fe7558550d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.393308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c92967f6-14a9-4a6e-8ea3-11fe7558550d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.393809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c92967f6-14a9-4a6e-8ea3-11fe7558550d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.402834 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-730c567b-a6ea-4c6a-8a09-4de16621fcd8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:47.414941 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-c92967f6-14a9-4a6e-8ea3-11fe7558550d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] HTTP exception thrown: Instance 326d64f9-9e2e-4efc-bd5a-113fa0a467f1 could not be found. Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c92967f6-14a9-4a6e-8ea3-11fe7558550d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Request method failure captured: Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 HTTP/1.1 Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK5cQzq5PmBN8ZK8xufnInf_nKzozFybG60EPi2LKIagIuIo6wmjCjt_dEi9KoG421lgq7o9GXzxCjj26_PYoj0IVUx4iuPxFYRw_bINPtYf7R0sv0LrnaNDyTyma9wRBMptURK1MlutQq_man6Zj75t-cnvbQ_0wIRWAQ7WKgqvlIM Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fcc4d45337140259bcd5b64b17aa7b5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: daf7a1ddba654265a5e732363c85eefa Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 326d64f9-9e2e-4efc-bd5a-113fa0a467f1 could not be found. Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '326d64f9-9e2e-4efc-bd5a-113fa0a467f1'} Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 326d64f9-9e2e-4efc-bd5a-113fa0a467f1 could not be found. Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:48:47.417162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 326d64f9-9e2e-4efc-bd5a-113fa0a467f1 could not be found. Oct 10 23:48:47.423356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.423356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.423356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.423356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.423356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.423356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.423356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:48:47.423356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:48:47.423356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 326d64f9-9e2e-4efc-bd5a-113fa0a467f1 could not be found. Oct 10 23:48:47.423356 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.423356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c92967f6-14a9-4a6e-8ea3-11fe7558550d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Returning 404 to user: Instance 326d64f9-9e2e-4efc-bd5a-113fa0a467f1 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:48:47.423356 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c92967f6-14a9-4a6e-8ea3-11fe7558550d tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "DELETE /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1" status: 404 len: 111 microversion: 2.1 time: 0.042006 Oct 10 23:48:47.424401 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2995/5809] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:48:47 2022] DELETE /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:48:47.428641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2e8740c3-f73e-43a9-8fcf-97902701cc96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:47.429897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2e8740c3-f73e-43a9-8fcf-97902701cc96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 326d64f9-9e2e-4efc-bd5a-113fa0a467f1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:47.439326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e8740c3-f73e-43a9-8fcf-97902701cc96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.439865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e8740c3-f73e-43a9-8fcf-97902701cc96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.440612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e8740c3-f73e-43a9-8fcf-97902701cc96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.441334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e8740c3-f73e-43a9-8fcf-97902701cc96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.441851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e8740c3-f73e-43a9-8fcf-97902701cc96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.442282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e8740c3-f73e-43a9-8fcf-97902701cc96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.444747 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-730c567b-a6ea-4c6a-8a09-4de16621fcd8 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1314 microversion: 2.1 time: 1.179059 Oct 10 23:48:47.446074 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2815/5810] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:46 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1314 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:47.465138 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-2e8740c3-f73e-43a9-8fcf-97902701cc96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] HTTP exception thrown: Instance 326d64f9-9e2e-4efc-bd5a-113fa0a467f1 could not be found. Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2e8740c3-f73e-43a9-8fcf-97902701cc96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Request method failure captured: Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 HTTP/1.1 Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK5cQzq5PmBN8ZK8xufnInf_nKzozFybG60EPi2LKIagIuIo6wmjCjt_dEi9KoG421lgq7o9GXzxCjj26_PYoj0IVUx4iuPxFYRw_bINPtYf7R0sv0LrnaNDyTyma9wRBMptURK1MlutQq_man6Zj75t-cnvbQ_0wIRWAQ7WKgqvlIM Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fcc4d45337140259bcd5b64b17aa7b5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: daf7a1ddba654265a5e732363c85eefa Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 326d64f9-9e2e-4efc-bd5a-113fa0a467f1 could not be found. Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '326d64f9-9e2e-4efc-bd5a-113fa0a467f1'} Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 326d64f9-9e2e-4efc-bd5a-113fa0a467f1 could not be found. Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 326d64f9-9e2e-4efc-bd5a-113fa0a467f1 could not be found. Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.469077 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.477078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.477078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.477078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.477078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:48:47.477078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:48:47.477078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 326d64f9-9e2e-4efc-bd5a-113fa0a467f1 could not be found. Oct 10 23:48:47.477078 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.479232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2e8740c3-f73e-43a9-8fcf-97902701cc96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Returning 404 to user: Instance 326d64f9-9e2e-4efc-bd5a-113fa0a467f1 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:48:47.480604 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2e8740c3-f73e-43a9-8fcf-97902701cc96 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1" status: 404 len: 111 microversion: 2.1 time: 0.055798 Oct 10 23:48:47.486894 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2996/5811] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:47 2022] GET /compute/v2.1/servers/326d64f9-9e2e-4efc-bd5a-113fa0a467f1 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:48:47.491792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0ea5d0f2-9c7e-4a99-8489-1c730dc01f1c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:47.492632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0ea5d0f2-9c7e-4a99-8489-1c730dc01f1c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:47.506521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ea5d0f2-9c7e-4a99-8489-1c730dc01f1c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.507472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ea5d0f2-9c7e-4a99-8489-1c730dc01f1c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.507472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ea5d0f2-9c7e-4a99-8489-1c730dc01f1c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.510359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ea5d0f2-9c7e-4a99-8489-1c730dc01f1c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.511742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ea5d0f2-9c7e-4a99-8489-1c730dc01f1c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.513403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ea5d0f2-9c7e-4a99-8489-1c730dc01f1c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.540652 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-0ea5d0f2-9c7e-4a99-8489-1c730dc01f1c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] HTTP exception thrown: Instance 894b12cd-a36c-4884-88a1-1c223cceb722 could not be found. Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0ea5d0f2-9c7e-4a99-8489-1c730dc01f1c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Request method failure captured: Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 HTTP/1.1 Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK5cQzq5PmBN8ZK8xufnInf_nKzozFybG60EPi2LKIagIuIo6wmjCjt_dEi9KoG421lgq7o9GXzxCjj26_PYoj0IVUx4iuPxFYRw_bINPtYf7R0sv0LrnaNDyTyma9wRBMptURK1MlutQq_man6Zj75t-cnvbQ_0wIRWAQ7WKgqvlIM Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fcc4d45337140259bcd5b64b17aa7b5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: daf7a1ddba654265a5e732363c85eefa Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 894b12cd-a36c-4884-88a1-1c223cceb722 could not be found. Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '894b12cd-a36c-4884-88a1-1c223cceb722'} Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 894b12cd-a36c-4884-88a1-1c223cceb722 could not be found. Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:48:47.544706 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 894b12cd-a36c-4884-88a1-1c223cceb722 could not be found. Oct 10 23:48:47.552101 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.552101 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.552101 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.552101 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.552101 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.552101 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.552101 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:48:47.552101 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:48:47.552101 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 894b12cd-a36c-4884-88a1-1c223cceb722 could not be found. Oct 10 23:48:47.552101 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.555281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0ea5d0f2-9c7e-4a99-8489-1c730dc01f1c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Returning 404 to user: Instance 894b12cd-a36c-4884-88a1-1c223cceb722 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:48:47.556670 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0ea5d0f2-9c7e-4a99-8489-1c730dc01f1c tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "DELETE /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722" status: 404 len: 111 microversion: 2.1 time: 0.068900 Oct 10 23:48:47.558865 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2816/5812] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:48:47 2022] DELETE /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:48:47.568036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2bb3267a-f1cb-4073-ba0f-ea411eeffe2a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:47.568654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2bb3267a-f1cb-4073-ba0f-ea411eeffe2a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 894b12cd-a36c-4884-88a1-1c223cceb722] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:47.576166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bb3267a-f1cb-4073-ba0f-ea411eeffe2a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.577501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bb3267a-f1cb-4073-ba0f-ea411eeffe2a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.578389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bb3267a-f1cb-4073-ba0f-ea411eeffe2a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.579331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bb3267a-f1cb-4073-ba0f-ea411eeffe2a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.579958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bb3267a-f1cb-4073-ba0f-ea411eeffe2a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.580546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bb3267a-f1cb-4073-ba0f-ea411eeffe2a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.614709 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-2bb3267a-f1cb-4073-ba0f-ea411eeffe2a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] HTTP exception thrown: Instance 894b12cd-a36c-4884-88a1-1c223cceb722 could not be found. Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2bb3267a-f1cb-4073-ba0f-ea411eeffe2a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Request method failure captured: Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 HTTP/1.1 Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK5cQzq5PmBN8ZK8xufnInf_nKzozFybG60EPi2LKIagIuIo6wmjCjt_dEi9KoG421lgq7o9GXzxCjj26_PYoj0IVUx4iuPxFYRw_bINPtYf7R0sv0LrnaNDyTyma9wRBMptURK1MlutQq_man6Zj75t-cnvbQ_0wIRWAQ7WKgqvlIM Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fcc4d45337140259bcd5b64b17aa7b5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: daf7a1ddba654265a5e732363c85eefa Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 894b12cd-a36c-4884-88a1-1c223cceb722 could not be found. Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '894b12cd-a36c-4884-88a1-1c223cceb722'} Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 894b12cd-a36c-4884-88a1-1c223cceb722 could not be found. Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 894b12cd-a36c-4884-88a1-1c223cceb722 could not be found. Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.628784 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.633322 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.633322 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.633322 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.633322 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:48:47.633322 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:48:47.633322 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 894b12cd-a36c-4884-88a1-1c223cceb722 could not be found. Oct 10 23:48:47.633322 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.634102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2bb3267a-f1cb-4073-ba0f-ea411eeffe2a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Returning 404 to user: Instance 894b12cd-a36c-4884-88a1-1c223cceb722 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:48:47.635132 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2bb3267a-f1cb-4073-ba0f-ea411eeffe2a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722" status: 404 len: 111 microversion: 2.1 time: 0.071445 Oct 10 23:48:47.638738 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2997/5813] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:47 2022] GET /compute/v2.1/servers/894b12cd-a36c-4884-88a1-1c223cceb722 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:48:47.645092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-faee0f92-18dc-40c7-8f43-499d44cbb832 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:47.645658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-faee0f92-18dc-40c7-8f43-499d44cbb832 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:47.691970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faee0f92-18dc-40c7-8f43-499d44cbb832 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.693637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faee0f92-18dc-40c7-8f43-499d44cbb832 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.696834 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faee0f92-18dc-40c7-8f43-499d44cbb832 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.700983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faee0f92-18dc-40c7-8f43-499d44cbb832 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.704293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faee0f92-18dc-40c7-8f43-499d44cbb832 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.705183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faee0f92-18dc-40c7-8f43-499d44cbb832 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.771848 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-faee0f92-18dc-40c7-8f43-499d44cbb832 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] HTTP exception thrown: Instance 7deab0f3-dcff-4418-b980-179ec1e244f8 could not be found. Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-faee0f92-18dc-40c7-8f43-499d44cbb832 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Request method failure captured: Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 HTTP/1.1 Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK5cQzq5PmBN8ZK8xufnInf_nKzozFybG60EPi2LKIagIuIo6wmjCjt_dEi9KoG421lgq7o9GXzxCjj26_PYoj0IVUx4iuPxFYRw_bINPtYf7R0sv0LrnaNDyTyma9wRBMptURK1MlutQq_man6Zj75t-cnvbQ_0wIRWAQ7WKgqvlIM Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fcc4d45337140259bcd5b64b17aa7b5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: daf7a1ddba654265a5e732363c85eefa Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 7deab0f3-dcff-4418-b980-179ec1e244f8 could not be found. Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '7deab0f3-dcff-4418-b980-179ec1e244f8'} Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7deab0f3-dcff-4418-b980-179ec1e244f8 could not be found. Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:48:47.773746 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7deab0f3-dcff-4418-b980-179ec1e244f8 could not be found. Oct 10 23:48:47.778406 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.778406 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.778406 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.778406 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.778406 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.778406 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.778406 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:48:47.778406 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:48:47.778406 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7deab0f3-dcff-4418-b980-179ec1e244f8 could not be found. Oct 10 23:48:47.778406 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.782348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-faee0f92-18dc-40c7-8f43-499d44cbb832 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Returning 404 to user: Instance 7deab0f3-dcff-4418-b980-179ec1e244f8 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:48:47.783607 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-faee0f92-18dc-40c7-8f43-499d44cbb832 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 404 len: 111 microversion: 2.1 time: 0.143054 Oct 10 23:48:47.784897 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2817/5814] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:48:47 2022] DELETE /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:48:47.794648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-203ae5ad-0ebf-46ab-a6e2-0cab9c6d4e56 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:47.796271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-203ae5ad-0ebf-46ab-a6e2-0cab9c6d4e56 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 7deab0f3-dcff-4418-b980-179ec1e244f8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:47.805187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-203ae5ad-0ebf-46ab-a6e2-0cab9c6d4e56 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.806176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-203ae5ad-0ebf-46ab-a6e2-0cab9c6d4e56 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.806300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-203ae5ad-0ebf-46ab-a6e2-0cab9c6d4e56 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.806970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-203ae5ad-0ebf-46ab-a6e2-0cab9c6d4e56 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.807432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-203ae5ad-0ebf-46ab-a6e2-0cab9c6d4e56 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.808271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-203ae5ad-0ebf-46ab-a6e2-0cab9c6d4e56 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.854054 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-203ae5ad-0ebf-46ab-a6e2-0cab9c6d4e56 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] HTTP exception thrown: Instance 7deab0f3-dcff-4418-b980-179ec1e244f8 could not be found. Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-203ae5ad-0ebf-46ab-a6e2-0cab9c6d4e56 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Request method failure captured: Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 HTTP/1.1 Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK5cQzq5PmBN8ZK8xufnInf_nKzozFybG60EPi2LKIagIuIo6wmjCjt_dEi9KoG421lgq7o9GXzxCjj26_PYoj0IVUx4iuPxFYRw_bINPtYf7R0sv0LrnaNDyTyma9wRBMptURK1MlutQq_man6Zj75t-cnvbQ_0wIRWAQ7WKgqvlIM Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fcc4d45337140259bcd5b64b17aa7b5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: daf7a1ddba654265a5e732363c85eefa Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 7deab0f3-dcff-4418-b980-179ec1e244f8 could not be found. Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '7deab0f3-dcff-4418-b980-179ec1e244f8'} Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7deab0f3-dcff-4418-b980-179ec1e244f8 could not be found. Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7deab0f3-dcff-4418-b980-179ec1e244f8 could not be found. Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.855701 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.860726 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.860726 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.860726 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.860726 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:48:47.860726 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:48:47.860726 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7deab0f3-dcff-4418-b980-179ec1e244f8 could not be found. Oct 10 23:48:47.860726 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.860726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-203ae5ad-0ebf-46ab-a6e2-0cab9c6d4e56 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Returning 404 to user: Instance 7deab0f3-dcff-4418-b980-179ec1e244f8 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:48:47.860726 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-203ae5ad-0ebf-46ab-a6e2-0cab9c6d4e56 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8" status: 404 len: 111 microversion: 2.1 time: 0.067262 Oct 10 23:48:47.861674 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2998/5815] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:47 2022] GET /compute/v2.1/servers/7deab0f3-dcff-4418-b980-179ec1e244f8 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:48:47.867721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-252aa664-47d1-450f-b804-df761a62441e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:47.868406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-252aa664-47d1-450f-b804-df761a62441e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:47.879236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-252aa664-47d1-450f-b804-df761a62441e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.881605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-252aa664-47d1-450f-b804-df761a62441e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.885338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-252aa664-47d1-450f-b804-df761a62441e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.888098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-252aa664-47d1-450f-b804-df761a62441e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.891635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-252aa664-47d1-450f-b804-df761a62441e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.892531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-252aa664-47d1-450f-b804-df761a62441e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.919095 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-252aa664-47d1-450f-b804-df761a62441e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] HTTP exception thrown: Instance b5704bab-05ad-4950-9a7b-0770cbbb6e9d could not be found. Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-252aa664-47d1-450f-b804-df761a62441e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Request method failure captured: Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d HTTP/1.1 Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK5cQzq5PmBN8ZK8xufnInf_nKzozFybG60EPi2LKIagIuIo6wmjCjt_dEi9KoG421lgq7o9GXzxCjj26_PYoj0IVUx4iuPxFYRw_bINPtYf7R0sv0LrnaNDyTyma9wRBMptURK1MlutQq_man6Zj75t-cnvbQ_0wIRWAQ7WKgqvlIM Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fcc4d45337140259bcd5b64b17aa7b5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: daf7a1ddba654265a5e732363c85eefa Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance b5704bab-05ad-4950-9a7b-0770cbbb6e9d could not be found. Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'b5704bab-05ad-4950-9a7b-0770cbbb6e9d'} Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5704bab-05ad-4950-9a7b-0770cbbb6e9d could not be found. Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:48:47.928506 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5704bab-05ad-4950-9a7b-0770cbbb6e9d could not be found. Oct 10 23:48:47.933267 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.933267 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.933267 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.933267 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.933267 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.933267 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.933267 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:48:47.933267 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:48:47.933267 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5704bab-05ad-4950-9a7b-0770cbbb6e9d could not be found. Oct 10 23:48:47.933267 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.935264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-252aa664-47d1-450f-b804-df761a62441e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Returning 404 to user: Instance b5704bab-05ad-4950-9a7b-0770cbbb6e9d could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:48:47.937855 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-252aa664-47d1-450f-b804-df761a62441e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 404 len: 111 microversion: 2.1 time: 0.074838 Oct 10 23:48:47.939539 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2818/5816] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:48:47 2022] DELETE /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:48:47.948758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-da607207-3f01-453e-92a1-68b01596a41e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:47.949474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-da607207-3f01-453e-92a1-68b01596a41e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b5704bab-05ad-4950-9a7b-0770cbbb6e9d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:47.960497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da607207-3f01-453e-92a1-68b01596a41e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.961082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da607207-3f01-453e-92a1-68b01596a41e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.961559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da607207-3f01-453e-92a1-68b01596a41e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.962495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da607207-3f01-453e-92a1-68b01596a41e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:47.963131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da607207-3f01-453e-92a1-68b01596a41e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:47.963833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da607207-3f01-453e-92a1-68b01596a41e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:47.984315 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-da607207-3f01-453e-92a1-68b01596a41e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] HTTP exception thrown: Instance b5704bab-05ad-4950-9a7b-0770cbbb6e9d could not be found. Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-da607207-3f01-453e-92a1-68b01596a41e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Request method failure captured: Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d HTTP/1.1 Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK5cQzq5PmBN8ZK8xufnInf_nKzozFybG60EPi2LKIagIuIo6wmjCjt_dEi9KoG421lgq7o9GXzxCjj26_PYoj0IVUx4iuPxFYRw_bINPtYf7R0sv0LrnaNDyTyma9wRBMptURK1MlutQq_man6Zj75t-cnvbQ_0wIRWAQ7WKgqvlIM Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fcc4d45337140259bcd5b64b17aa7b5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: daf7a1ddba654265a5e732363c85eefa Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance b5704bab-05ad-4950-9a7b-0770cbbb6e9d could not be found. Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'b5704bab-05ad-4950-9a7b-0770cbbb6e9d'} Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5704bab-05ad-4950-9a7b-0770cbbb6e9d could not be found. Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5704bab-05ad-4950-9a7b-0770cbbb6e9d could not be found. Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:47.987020 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.993557 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:47.993557 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:47.993557 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:47.993557 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:48:47.993557 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:48:47.993557 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5704bab-05ad-4950-9a7b-0770cbbb6e9d could not be found. Oct 10 23:48:47.993557 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:47.995065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-da607207-3f01-453e-92a1-68b01596a41e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Returning 404 to user: Instance b5704bab-05ad-4950-9a7b-0770cbbb6e9d could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:48:47.996681 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-da607207-3f01-453e-92a1-68b01596a41e tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d" status: 404 len: 111 microversion: 2.1 time: 0.052567 Oct 10 23:48:48.003499 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 2999/5817] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:47 2022] GET /compute/v2.1/servers/b5704bab-05ad-4950-9a7b-0770cbbb6e9d => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:48:48.007319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-324c1796-297c-4c20-8832-06451ebf5673 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:48.007934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-324c1796-297c-4c20-8832-06451ebf5673 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 9686dae4-7c1f-442f-91a8-675b24f5d49e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:48.016130 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-324c1796-297c-4c20-8832-06451ebf5673 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] HTTP exception thrown: Instance 9686dae4-7c1f-442f-91a8-675b24f5d49e could not be found. Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-324c1796-297c-4c20-8832-06451ebf5673 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Request method failure captured: Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/9686dae4-7c1f-442f-91a8-675b24f5d49e HTTP/1.1 Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK5cQzq5PmBN8ZK8xufnInf_nKzozFybG60EPi2LKIagIuIo6wmjCjt_dEi9KoG421lgq7o9GXzxCjj26_PYoj0IVUx4iuPxFYRw_bINPtYf7R0sv0LrnaNDyTyma9wRBMptURK1MlutQq_man6Zj75t-cnvbQ_0wIRWAQ7WKgqvlIM Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fcc4d45337140259bcd5b64b17aa7b5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersTestJSON-1882347849 Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: daf7a1ddba654265a5e732363c85eefa Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 9686dae4-7c1f-442f-91a8-675b24f5d49e could not be found. Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '9686dae4-7c1f-442f-91a8-675b24f5d49e'} Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9686dae4-7c1f-442f-91a8-675b24f5d49e could not be found. Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9686dae4-7c1f-442f-91a8-675b24f5d49e could not be found. Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:48.017881 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:48.026191 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:48.026191 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:48.026191 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:48.026191 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:48:48.026191 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:48:48.026191 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9686dae4-7c1f-442f-91a8-675b24f5d49e could not be found. Oct 10 23:48:48.026191 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:48.026191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-324c1796-297c-4c20-8832-06451ebf5673 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Returning 404 to user: Instance 9686dae4-7c1f-442f-91a8-675b24f5d49e could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:48:48.026191 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-324c1796-297c-4c20-8832-06451ebf5673 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9686dae4-7c1f-442f-91a8-675b24f5d49e" status: 404 len: 111 microversion: 2.1 time: 0.016499 Oct 10 23:48:48.026191 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2819/5818] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:48:48 2022] DELETE /compute/v2.1/servers/9686dae4-7c1f-442f-91a8-675b24f5d49e => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:48:48.032608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c6e9eb84-85af-4b01-9c81-6eaddf70162a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:48.033505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c6e9eb84-85af-4b01-9c81-6eaddf70162a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: 9686dae4-7c1f-442f-91a8-675b24f5d49e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:48.044041 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-c6e9eb84-85af-4b01-9c81-6eaddf70162a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] HTTP exception thrown: Instance 9686dae4-7c1f-442f-91a8-675b24f5d49e could not be found. Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c6e9eb84-85af-4b01-9c81-6eaddf70162a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Request method failure captured: Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/9686dae4-7c1f-442f-91a8-675b24f5d49e HTTP/1.1 Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK5cQzq5PmBN8ZK8xufnInf_nKzozFybG60EPi2LKIagIuIo6wmjCjt_dEi9KoG421lgq7o9GXzxCjj26_PYoj0IVUx4iuPxFYRw_bINPtYf7R0sv0LrnaNDyTyma9wRBMptURK1MlutQq_man6Zj75t-cnvbQ_0wIRWAQ7WKgqvlIM Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fcc4d45337140259bcd5b64b17aa7b5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersTestJSON-1882347849 Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: daf7a1ddba654265a5e732363c85eefa Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 9686dae4-7c1f-442f-91a8-675b24f5d49e could not be found. Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '9686dae4-7c1f-442f-91a8-675b24f5d49e'} Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9686dae4-7c1f-442f-91a8-675b24f5d49e could not be found. Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9686dae4-7c1f-442f-91a8-675b24f5d49e could not be found. Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:48.046818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:48.056270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:48.056270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:48:48.056270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:48:48.056270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9686dae4-7c1f-442f-91a8-675b24f5d49e could not be found. Oct 10 23:48:48.056270 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:48:48.056270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c6e9eb84-85af-4b01-9c81-6eaddf70162a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Returning 404 to user: Instance 9686dae4-7c1f-442f-91a8-675b24f5d49e could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:48:48.056270 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c6e9eb84-85af-4b01-9c81-6eaddf70162a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/9686dae4-7c1f-442f-91a8-675b24f5d49e" status: 404 len: 111 microversion: 2.1 time: 0.023656 Oct 10 23:48:48.056270 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3000/5819] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:48 2022] GET /compute/v2.1/servers/9686dae4-7c1f-442f-91a8-675b24f5d49e => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:48:48.058904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c76897b7-af28-4db7-bb02-5e96787057bc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:48.059126 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c76897b7-af28-4db7-bb02-5e96787057bc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b1cad8e1-6af5-4151-8635-926f77f2ca07] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:48.071195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c76897b7-af28-4db7-bb02-5e96787057bc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:48.071911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c76897b7-af28-4db7-bb02-5e96787057bc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:48.072688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c76897b7-af28-4db7-bb02-5e96787057bc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:48.082920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c76897b7-af28-4db7-bb02-5e96787057bc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:48.083286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c76897b7-af28-4db7-bb02-5e96787057bc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:48.083750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c76897b7-af28-4db7-bb02-5e96787057bc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:48.135715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c76897b7-af28-4db7-bb02-5e96787057bc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b1cad8e1-6af5-4151-8635-926f77f2ca07] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:48:48.288840 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c76897b7-af28-4db7-bb02-5e96787057bc tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07" status: 204 len: 0 microversion: 2.1 time: 0.234427 Oct 10 23:48:48.293855 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2820/5820] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:48:48 2022] DELETE /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:48:48.300770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a8222930-72d6-456e-a39a-c3402a8e6650 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:48.301777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a8222930-72d6-456e-a39a-c3402a8e6650 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b1cad8e1-6af5-4151-8635-926f77f2ca07] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:48.310682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8222930-72d6-456e-a39a-c3402a8e6650 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:48.312819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8222930-72d6-456e-a39a-c3402a8e6650 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:48.316872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8222930-72d6-456e-a39a-c3402a8e6650 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:48.318059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8222930-72d6-456e-a39a-c3402a8e6650 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:48.319506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8222930-72d6-456e-a39a-c3402a8e6650 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:48.320295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8222930-72d6-456e-a39a-c3402a8e6650 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:48.473526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d1d8639b-806a-4d13-900b-07b1f4ab8c39 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:48.474328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d1d8639b-806a-4d13-900b-07b1f4ab8c39 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:48.487458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1d8639b-806a-4d13-900b-07b1f4ab8c39 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:48.490131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1d8639b-806a-4d13-900b-07b1f4ab8c39 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:48.490768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1d8639b-806a-4d13-900b-07b1f4ab8c39 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:48.491825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1d8639b-806a-4d13-900b-07b1f4ab8c39 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:48.493701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1d8639b-806a-4d13-900b-07b1f4ab8c39 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:48.494788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1d8639b-806a-4d13-900b-07b1f4ab8c39 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:49.053197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a8222930-72d6-456e-a39a-c3402a8e6650 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:49.079037 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a8222930-72d6-456e-a39a-c3402a8e6650 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07" status: 200 len: 1480 microversion: 2.1 time: 0.782299 Oct 10 23:48:49.091594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d1d8639b-806a-4d13-900b-07b1f4ab8c39 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:49.100318 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3001/5821] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:48 2022] GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07 => generated 1480 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:48:49.105564 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d1d8639b-806a-4d13-900b-07b1f4ab8c39 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1314 microversion: 2.1 time: 0.638107 Oct 10 23:48:49.110230 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2821/5822] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:48 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:48:50.112608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fd75d564-6767-4746-af98-d0c5d9890f10 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:50.113492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fd75d564-6767-4746-af98-d0c5d9890f10 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b1cad8e1-6af5-4151-8635-926f77f2ca07] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:50.120798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd75d564-6767-4746-af98-d0c5d9890f10 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:50.121580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd75d564-6767-4746-af98-d0c5d9890f10 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:50.122186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd75d564-6767-4746-af98-d0c5d9890f10 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:50.123211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd75d564-6767-4746-af98-d0c5d9890f10 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:50.124499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd75d564-6767-4746-af98-d0c5d9890f10 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:50.125100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd75d564-6767-4746-af98-d0c5d9890f10 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:50.140622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4fd94ee7-8113-4f88-a90b-afbc322277f9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:50.141339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4fd94ee7-8113-4f88-a90b-afbc322277f9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:50.153572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fd94ee7-8113-4f88-a90b-afbc322277f9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:50.159028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fd94ee7-8113-4f88-a90b-afbc322277f9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:50.160497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fd94ee7-8113-4f88-a90b-afbc322277f9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:50.163542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fd94ee7-8113-4f88-a90b-afbc322277f9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:50.166793 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fd94ee7-8113-4f88-a90b-afbc322277f9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:50.171456 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fd94ee7-8113-4f88-a90b-afbc322277f9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:50.668328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fd75d564-6767-4746-af98-d0c5d9890f10 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:50.688105 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fd75d564-6767-4746-af98-d0c5d9890f10 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07" status: 200 len: 1480 microversion: 2.1 time: 0.578347 Oct 10 23:48:50.690657 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3002/5823] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:50 2022] GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07 => generated 1480 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:48:50.790343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-963bbf92-4001-4935-8f92-a5332b0ce89e req-7edd5524-5e95-415c-b2ae-557113123624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2606c2f7-d312-4418-b226-74371d7b8315", "name": "network-vif-plugged", "status": "completed", "tag": "7668ae94-786a-4b79-9096-53ff020bd6e1"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:50.805080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-963bbf92-4001-4935-8f92-a5332b0ce89e req-7edd5524-5e95-415c-b2ae-557113123624 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:50.806043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-963bbf92-4001-4935-8f92-a5332b0ce89e req-7edd5524-5e95-415c-b2ae-557113123624 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:50.806726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-963bbf92-4001-4935-8f92-a5332b0ce89e req-7edd5524-5e95-415c-b2ae-557113123624 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:50.855012 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-963bbf92-4001-4935-8f92-a5332b0ce89e req-7edd5524-5e95-415c-b2ae-557113123624 service nova] Creating event network-vif-plugged:7668ae94-786a-4b79-9096-53ff020bd6e1 for instance 2606c2f7-d312-4418-b226-74371d7b8315 on n-h2-860864-2 Oct 10 23:48:50.862604 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-963bbf92-4001-4935-8f92-a5332b0ce89e req-7edd5524-5e95-415c-b2ae-557113123624 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077796 Oct 10 23:48:50.864728 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3003/5824] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:48:51.099831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4fd94ee7-8113-4f88-a90b-afbc322277f9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:51.109691 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4fd94ee7-8113-4f88-a90b-afbc322277f9 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1314 microversion: 2.1 time: 0.972925 Oct 10 23:48:51.110626 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2822/5825] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:50 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1314 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:48:51.719887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f14a7551-fe30-42d2-803b-3dd6e338ca9f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:51.720656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f14a7551-fe30-42d2-803b-3dd6e338ca9f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b1cad8e1-6af5-4151-8635-926f77f2ca07] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:51.749721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f14a7551-fe30-42d2-803b-3dd6e338ca9f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:51.750483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f14a7551-fe30-42d2-803b-3dd6e338ca9f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:51.751342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f14a7551-fe30-42d2-803b-3dd6e338ca9f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:51.752103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f14a7551-fe30-42d2-803b-3dd6e338ca9f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:51.752530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f14a7551-fe30-42d2-803b-3dd6e338ca9f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:51.752966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f14a7551-fe30-42d2-803b-3dd6e338ca9f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:51.806514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-aa777969-384a-41f4-b13d-a04387f02481 req-5a1096b5-e58b-498b-b727-4f288e7507e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1cad8e1-6af5-4151-8635-926f77f2ca07", "name": "network-vif-deleted", "tag": "7d9a3838-d2f8-4bb5-85f2-5f7c173eaead"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:51.844036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-aa777969-384a-41f4-b13d-a04387f02481 req-5a1096b5-e58b-498b-b727-4f288e7507e3 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:51.844599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-aa777969-384a-41f4-b13d-a04387f02481 req-5a1096b5-e58b-498b-b727-4f288e7507e3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:51.845714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-aa777969-384a-41f4-b13d-a04387f02481 req-5a1096b5-e58b-498b-b727-4f288e7507e3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:51.867761 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-aa777969-384a-41f4-b13d-a04387f02481 req-5a1096b5-e58b-498b-b727-4f288e7507e3 service nova] Creating event network-vif-deleted:7d9a3838-d2f8-4bb5-85f2-5f7c173eaead for instance b1cad8e1-6af5-4151-8635-926f77f2ca07 on n-h2-860864-2 Oct 10 23:48:51.875255 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-aa777969-384a-41f4-b13d-a04387f02481 req-5a1096b5-e58b-498b-b727-4f288e7507e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082194 Oct 10 23:48:51.877040 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2823/5826] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:48:51.892837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f14a7551-fe30-42d2-803b-3dd6e338ca9f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:51.903643 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f14a7551-fe30-42d2-803b-3dd6e338ca9f tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07" status: 200 len: 1438 microversion: 2.1 time: 0.189503 Oct 10 23:48:51.905116 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3004/5827] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:51 2022] GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07 => generated 1438 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:52.139871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a8804b5b-f6ff-459c-8f79-2a0bd8e2c98a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:52.140620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a8804b5b-f6ff-459c-8f79-2a0bd8e2c98a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:52.152346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8804b5b-f6ff-459c-8f79-2a0bd8e2c98a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:52.153546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8804b5b-f6ff-459c-8f79-2a0bd8e2c98a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:52.154295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8804b5b-f6ff-459c-8f79-2a0bd8e2c98a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:52.155861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8804b5b-f6ff-459c-8f79-2a0bd8e2c98a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:52.156734 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8804b5b-f6ff-459c-8f79-2a0bd8e2c98a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:52.157330 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8804b5b-f6ff-459c-8f79-2a0bd8e2c98a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:52.727927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a8804b5b-f6ff-459c-8f79-2a0bd8e2c98a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:52.736916 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a8804b5b-f6ff-459c-8f79-2a0bd8e2c98a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1314 microversion: 2.1 time: 0.601790 Oct 10 23:48:52.737592 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2824/5828] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:52 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:52.933560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-43f4fbc8-34aa-4cb2-a5aa-1605ea353939 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:52.934260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-43f4fbc8-34aa-4cb2-a5aa-1605ea353939 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b1cad8e1-6af5-4151-8635-926f77f2ca07] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:52.965594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43f4fbc8-34aa-4cb2-a5aa-1605ea353939 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:52.970681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43f4fbc8-34aa-4cb2-a5aa-1605ea353939 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:52.973620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43f4fbc8-34aa-4cb2-a5aa-1605ea353939 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:52.978725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43f4fbc8-34aa-4cb2-a5aa-1605ea353939 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:52.980385 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43f4fbc8-34aa-4cb2-a5aa-1605ea353939 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:52.981624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43f4fbc8-34aa-4cb2-a5aa-1605ea353939 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:53.102144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43f4fbc8-34aa-4cb2-a5aa-1605ea353939 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:53.103028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43f4fbc8-34aa-4cb2-a5aa-1605ea353939 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:53.103606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-43f4fbc8-34aa-4cb2-a5aa-1605ea353939 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:53.104224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-43f4fbc8-34aa-4cb2-a5aa-1605ea353939 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lazy-loading 'fault' on Instance uuid b1cad8e1-6af5-4151-8635-926f77f2ca07 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:48:53.305076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-43f4fbc8-34aa-4cb2-a5aa-1605ea353939 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daf7a1ddba654265a5e732363c85eefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fcc4d45337140259bcd5b64b17aa7b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:53.317997 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-43f4fbc8-34aa-4cb2-a5aa-1605ea353939 tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07" status: 200 len: 1283 microversion: 2.1 time: 0.388506 Oct 10 23:48:53.338857 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3005/5829] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:52 2022] GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07 => generated 1283 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:53.764383 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4eea4ec8-4ffd-4343-b612-4120ed99c69c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:53.765127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4eea4ec8-4ffd-4343-b612-4120ed99c69c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:53.787945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4eea4ec8-4ffd-4343-b612-4120ed99c69c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:53.792533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4eea4ec8-4ffd-4343-b612-4120ed99c69c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:53.793234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4eea4ec8-4ffd-4343-b612-4120ed99c69c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:53.800617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4eea4ec8-4ffd-4343-b612-4120ed99c69c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:53.801432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4eea4ec8-4ffd-4343-b612-4120ed99c69c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:53.802327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4eea4ec8-4ffd-4343-b612-4120ed99c69c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:54.215113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4eea4ec8-4ffd-4343-b612-4120ed99c69c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:54.231652 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4eea4ec8-4ffd-4343-b612-4120ed99c69c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1500 microversion: 2.1 time: 0.470843 Oct 10 23:48:54.233275 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2825/5830] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:53 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1500 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:54.256469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ed338ff6-4ba8-4996-bbc8-42e24bba0e0a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:54.257063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ed338ff6-4ba8-4996-bbc8-42e24bba0e0a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:54.270568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed338ff6-4ba8-4996-bbc8-42e24bba0e0a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:54.271075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed338ff6-4ba8-4996-bbc8-42e24bba0e0a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:54.271527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed338ff6-4ba8-4996-bbc8-42e24bba0e0a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:54.275249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed338ff6-4ba8-4996-bbc8-42e24bba0e0a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:54.277269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed338ff6-4ba8-4996-bbc8-42e24bba0e0a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:54.277765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed338ff6-4ba8-4996-bbc8-42e24bba0e0a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:54.346439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-20deaa28-968d-44b5-90ca-d4a5af75b84a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:54.347389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-20deaa28-968d-44b5-90ca-d4a5af75b84a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] [instance: b1cad8e1-6af5-4151-8635-926f77f2ca07] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:54.357886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20deaa28-968d-44b5-90ca-d4a5af75b84a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:54.365454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20deaa28-968d-44b5-90ca-d4a5af75b84a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:54.367064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20deaa28-968d-44b5-90ca-d4a5af75b84a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:54.369429 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20deaa28-968d-44b5-90ca-d4a5af75b84a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:54.370557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20deaa28-968d-44b5-90ca-d4a5af75b84a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:54.379471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20deaa28-968d-44b5-90ca-d4a5af75b84a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:54.425149 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-20deaa28-968d-44b5-90ca-d4a5af75b84a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] HTTP exception thrown: Instance b1cad8e1-6af5-4151-8635-926f77f2ca07 could not be found. Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-20deaa28-968d-44b5-90ca-d4a5af75b84a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Request method failure captured: Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07 HTTP/1.1 Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK5cQzq5PmBN8ZK8xufnInf_nKzozFybG60EPi2LKIagIuIo6wmjCjt_dEi9KoG421lgq7o9GXzxCjj26_PYoj0IVUx4iuPxFYRw_bINPtYf7R0sv0LrnaNDyTyma9wRBMptURK1MlutQq_man6Zj75t-cnvbQ_0wIRWAQ7WKgqvlIM Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7fcc4d45337140259bcd5b64b17aa7b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7fcc4d45337140259bcd5b64b17aa7b5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersTestJSON-1882347849 Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 7fcc4d45337140259bcd5b64b17aa7b5 Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersTestJSON-1882347849 Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: daf7a1ddba654265a5e732363c85eefa Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersTestJSON-1882347849-project Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance b1cad8e1-6af5-4151-8635-926f77f2ca07 could not be found. Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'b1cad8e1-6af5-4151-8635-926f77f2ca07'} Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1cad8e1-6af5-4151-8635-926f77f2ca07 could not be found. Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1cad8e1-6af5-4151-8635-926f77f2ca07 could not be found. Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:48:54.434471 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:54.441501 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:48:54.441501 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:48:54.441501 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:48:54.441501 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:48:54.441501 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:48:54.441501 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1cad8e1-6af5-4151-8635-926f77f2ca07 could not be found. Oct 10 23:48:54.441501 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:48:54.449844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-20deaa28-968d-44b5-90ca-d4a5af75b84a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] Returning 404 to user: Instance b1cad8e1-6af5-4151-8635-926f77f2ca07 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:48:54.451171 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-20deaa28-968d-44b5-90ca-d4a5af75b84a tempest-ServersTestJSON-1882347849 tempest-ServersTestJSON-1882347849-project] 10.222.0.23 "GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07" status: 404 len: 111 microversion: 2.1 time: 0.110975 Oct 10 23:48:54.453753 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2826/5831] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:54 2022] GET /compute/v2.1/servers/b1cad8e1-6af5-4151-8635-926f77f2ca07 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:48:54.501072 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ed338ff6-4ba8-4996-bbc8-42e24bba0e0a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315/action" status: 202 len: 0 microversion: 2.1 time: 0.246960 Oct 10 23:48:54.504793 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3006/5832] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:48:54 2022] POST /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:48:54.513203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7107bb51-df5e-4ed6-8787-cad58f8b2e4b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:54.515634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7107bb51-df5e-4ed6-8787-cad58f8b2e4b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:54.531824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7107bb51-df5e-4ed6-8787-cad58f8b2e4b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:54.537163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7107bb51-df5e-4ed6-8787-cad58f8b2e4b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:54.537951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7107bb51-df5e-4ed6-8787-cad58f8b2e4b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:54.545110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7107bb51-df5e-4ed6-8787-cad58f8b2e4b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:54.546745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7107bb51-df5e-4ed6-8787-cad58f8b2e4b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:54.554504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7107bb51-df5e-4ed6-8787-cad58f8b2e4b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:54.978713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7107bb51-df5e-4ed6-8787-cad58f8b2e4b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:54.989821 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7107bb51-df5e-4ed6-8787-cad58f8b2e4b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1505 microversion: 2.1 time: 0.480911 Oct 10 23:48:54.990938 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2827/5833] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:54 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1505 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:56.020834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1049159b-77a2-4230-8fdd-4a3aabe78872 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:56.024286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1049159b-77a2-4230-8fdd-4a3aabe78872 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:56.038283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1049159b-77a2-4230-8fdd-4a3aabe78872 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:56.040167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1049159b-77a2-4230-8fdd-4a3aabe78872 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:56.040810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1049159b-77a2-4230-8fdd-4a3aabe78872 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:56.041808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1049159b-77a2-4230-8fdd-4a3aabe78872 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:56.042431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1049159b-77a2-4230-8fdd-4a3aabe78872 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:56.043249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1049159b-77a2-4230-8fdd-4a3aabe78872 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:56.468122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1049159b-77a2-4230-8fdd-4a3aabe78872 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:56.484959 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1049159b-77a2-4230-8fdd-4a3aabe78872 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1485 microversion: 2.1 time: 0.472142 Oct 10 23:48:56.485842 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3007/5834] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:56 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1485 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:48:56.513680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-62cc46d2-cb1e-4cf5-97e9-ecceee3fd379 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:48:56.516989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-62cc46d2-cb1e-4cf5-97e9-ecceee3fd379 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:56.524919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62cc46d2-cb1e-4cf5-97e9-ecceee3fd379 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:56.525471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62cc46d2-cb1e-4cf5-97e9-ecceee3fd379 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:56.526415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62cc46d2-cb1e-4cf5-97e9-ecceee3fd379 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:56.527119 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62cc46d2-cb1e-4cf5-97e9-ecceee3fd379 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:56.528845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62cc46d2-cb1e-4cf5-97e9-ecceee3fd379 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:56.548513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-62cc46d2-cb1e-4cf5-97e9-ecceee3fd379 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:56.582732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-62cc46d2-cb1e-4cf5-97e9-ecceee3fd379 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lazy-loading 'flavor' on Instance uuid 2606c2f7-d312-4418-b226-74371d7b8315 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:48:56.836522 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-62cc46d2-cb1e-4cf5-97e9-ecceee3fd379 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315/action" status: 202 len: 0 microversion: 2.1 time: 0.329617 Oct 10 23:48:56.836861 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2828/5835] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:48:56 2022] POST /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:48:56.847804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-68023630-be7f-402f-84e1-c3a86f8c7df3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:56.849316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-68023630-be7f-402f-84e1-c3a86f8c7df3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:56.856445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68023630-be7f-402f-84e1-c3a86f8c7df3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:56.857271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68023630-be7f-402f-84e1-c3a86f8c7df3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:56.857892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68023630-be7f-402f-84e1-c3a86f8c7df3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:56.859051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68023630-be7f-402f-84e1-c3a86f8c7df3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:56.859537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68023630-be7f-402f-84e1-c3a86f8c7df3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:56.860425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68023630-be7f-402f-84e1-c3a86f8c7df3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:57.511487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-68023630-be7f-402f-84e1-c3a86f8c7df3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:48:57.527824 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-68023630-be7f-402f-84e1-c3a86f8c7df3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1491 microversion: 2.1 time: 0.684012 Oct 10 23:48:57.528925 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3008/5836] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:56 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1491 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:48:58.556848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-21725b68-40f1-47f3-ba71-08d1aa1897d5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:48:58.557443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-21725b68-40f1-47f3-ba71-08d1aa1897d5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:48:58.571842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21725b68-40f1-47f3-ba71-08d1aa1897d5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:58.578838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21725b68-40f1-47f3-ba71-08d1aa1897d5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:58.579626 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21725b68-40f1-47f3-ba71-08d1aa1897d5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:48:58.580603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21725b68-40f1-47f3-ba71-08d1aa1897d5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:48:58.581249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21725b68-40f1-47f3-ba71-08d1aa1897d5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:48:58.581871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-21725b68-40f1-47f3-ba71-08d1aa1897d5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:00.500538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-f2cf451a-7f06-4d32-92ff-20b88e69eb9d req-0ec388db-9a5b-4808-8f7f-92160ab09173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2606c2f7-d312-4418-b226-74371d7b8315", "name": "network-vif-plugged", "status": "completed", "tag": "7668ae94-786a-4b79-9096-53ff020bd6e1"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:49:00.538450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f2cf451a-7f06-4d32-92ff-20b88e69eb9d req-0ec388db-9a5b-4808-8f7f-92160ab09173 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:00.538951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f2cf451a-7f06-4d32-92ff-20b88e69eb9d req-0ec388db-9a5b-4808-8f7f-92160ab09173 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:00.539394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f2cf451a-7f06-4d32-92ff-20b88e69eb9d req-0ec388db-9a5b-4808-8f7f-92160ab09173 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:00.567138 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-f2cf451a-7f06-4d32-92ff-20b88e69eb9d req-0ec388db-9a5b-4808-8f7f-92160ab09173 service nova] Creating event network-vif-plugged:7668ae94-786a-4b79-9096-53ff020bd6e1 for instance 2606c2f7-d312-4418-b226-74371d7b8315 on n-h2-860864-2 Oct 10 23:49:00.584106 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-f2cf451a-7f06-4d32-92ff-20b88e69eb9d req-0ec388db-9a5b-4808-8f7f-92160ab09173 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088353 Oct 10 23:49:00.585212 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3009/5837] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:49:00.906429 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-21725b68-40f1-47f3-ba71-08d1aa1897d5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:00.922462 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-21725b68-40f1-47f3-ba71-08d1aa1897d5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1512 microversion: 2.1 time: 2.373333 Oct 10 23:49:00.937450 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2829/5838] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:48:58 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1512 bytes in 2379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:01.958403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f301af3e-631b-4409-984d-08c492e145e1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:01.959761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f301af3e-631b-4409-984d-08c492e145e1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:01.980140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f301af3e-631b-4409-984d-08c492e145e1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:01.980842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f301af3e-631b-4409-984d-08c492e145e1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:01.983185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f301af3e-631b-4409-984d-08c492e145e1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:01.986129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f301af3e-631b-4409-984d-08c492e145e1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:01.989992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f301af3e-631b-4409-984d-08c492e145e1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:01.990680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f301af3e-631b-4409-984d-08c492e145e1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:03.418797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f301af3e-631b-4409-984d-08c492e145e1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:03.431854 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f301af3e-631b-4409-984d-08c492e145e1 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1507 microversion: 2.1 time: 1.480478 Oct 10 23:49:03.434290 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3010/5839] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:01 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1507 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:49:04.460215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-72a00cec-9ebd-4143-ba10-64ad19aac65e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:04.461524 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-72a00cec-9ebd-4143-ba10-64ad19aac65e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:04.465256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:49:04.483565 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72a00cec-9ebd-4143-ba10-64ad19aac65e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:04.485459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72a00cec-9ebd-4143-ba10-64ad19aac65e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:04.486124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72a00cec-9ebd-4143-ba10-64ad19aac65e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:04.488550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72a00cec-9ebd-4143-ba10-64ad19aac65e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:04.489224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72a00cec-9ebd-4143-ba10-64ad19aac65e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:04.494236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72a00cec-9ebd-4143-ba10-64ad19aac65e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:05.168413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-72a00cec-9ebd-4143-ba10-64ad19aac65e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:05.191960 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-72a00cec-9ebd-4143-ba10-64ad19aac65e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1507 microversion: 2.1 time: 0.731923 Oct 10 23:49:05.207456 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2830/5840] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:04 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1507 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:06.221563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1491213b-6b8f-414b-806f-1a7182d2ff9d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:06.222814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1491213b-6b8f-414b-806f-1a7182d2ff9d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:06.255432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1491213b-6b8f-414b-806f-1a7182d2ff9d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:06.256124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1491213b-6b8f-414b-806f-1a7182d2ff9d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:06.256485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1491213b-6b8f-414b-806f-1a7182d2ff9d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:06.257327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1491213b-6b8f-414b-806f-1a7182d2ff9d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:06.258085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1491213b-6b8f-414b-806f-1a7182d2ff9d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:06.258808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1491213b-6b8f-414b-806f-1a7182d2ff9d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:07.142879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1491213b-6b8f-414b-806f-1a7182d2ff9d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:07.152761 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1491213b-6b8f-414b-806f-1a7182d2ff9d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1507 microversion: 2.1 time: 0.935002 Oct 10 23:49:07.167117 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3011/5841] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:06 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1507 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:08.189778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-008718a2-000f-43dd-9e1e-74c19fd48e2a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:08.191358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-008718a2-000f-43dd-9e1e-74c19fd48e2a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:08.202900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-008718a2-000f-43dd-9e1e-74c19fd48e2a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:08.203666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-008718a2-000f-43dd-9e1e-74c19fd48e2a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:08.204393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-008718a2-000f-43dd-9e1e-74c19fd48e2a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:08.205621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-008718a2-000f-43dd-9e1e-74c19fd48e2a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:08.206412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-008718a2-000f-43dd-9e1e-74c19fd48e2a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:08.207022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-008718a2-000f-43dd-9e1e-74c19fd48e2a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:09.031559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6d5f1959-8bce-4a3e-93d0-f9b21e77fc0e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1471270930", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": "none"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:49:09.054591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=95,nova_api:DELETE=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:49:09.176604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6d5f1959-8bce-4a3e-93d0-f9b21e77fc0e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:49:09.177043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6d5f1959-8bce-4a3e-93d0-f9b21e77fc0e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:49:09.178634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6d5f1959-8bce-4a3e-93d0-f9b21e77fc0e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:49:09.179075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6d5f1959-8bce-4a3e-93d0-f9b21e77fc0e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:49:09.179508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6d5f1959-8bce-4a3e-93d0-f9b21e77fc0e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:49:09.213206 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-008718a2-000f-43dd-9e1e-74c19fd48e2a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:09.222599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d5f1959-8bce-4a3e-93d0-f9b21e77fc0e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:09.223101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d5f1959-8bce-4a3e-93d0-f9b21e77fc0e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:09.223551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d5f1959-8bce-4a3e-93d0-f9b21e77fc0e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:09.224310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d5f1959-8bce-4a3e-93d0-f9b21e77fc0e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:09.224790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d5f1959-8bce-4a3e-93d0-f9b21e77fc0e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:09.225212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d5f1959-8bce-4a3e-93d0-f9b21e77fc0e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:09.228565 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-008718a2-000f-43dd-9e1e-74c19fd48e2a tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1507 microversion: 2.1 time: 1.043172 Oct 10 23:49:09.229544 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2831/5842] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:08 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1507 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:09.285231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-6d5f1959-8bce-4a3e-93d0-f9b21e77fc0e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Getting quotas for project 67236ed6eb974ea6866c0aaddcc69179. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:49:09.299419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-6d5f1959-8bce-4a3e-93d0-f9b21e77fc0e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Getting quotas for user 6da1f2226c43442c9a65b0b7b1b4395f and project 67236ed6eb974ea6866c0aaddcc69179. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:49:09.339508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6d5f1959-8bce-4a3e-93d0-f9b21e77fc0e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:49:09.342702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6d5f1959-8bce-4a3e-93d0-f9b21e77fc0e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:49:09.524026 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6d5f1959-8bce-4a3e-93d0-f9b21e77fc0e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.856987 Oct 10 23:49:09.537043 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3012/5843] 10.222.0.23 () {62 vars in 1188 bytes} [Mon Oct 10 23:49:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 23:49:09.543386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-055c0609-0935-4742-94ee-6ae816c20e47 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:09.544250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-055c0609-0935-4742-94ee-6ae816c20e47 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:09.784966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-055c0609-0935-4742-94ee-6ae816c20e47 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:09.807264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-055c0609-0935-4742-94ee-6ae816c20e47 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:09.830220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-055c0609-0935-4742-94ee-6ae816c20e47 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:09.833924 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-055c0609-0935-4742-94ee-6ae816c20e47 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1278 microversion: 2.54 time: 0.300284 Oct 10 23:49:09.845721 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2832/5844] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:09 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1278 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:10.253247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-872dbbc9-7e54-47f1-bb98-775cd19d110c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:10.255101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-872dbbc9-7e54-47f1-bb98-775cd19d110c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:10.317610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-872dbbc9-7e54-47f1-bb98-775cd19d110c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:10.327358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-872dbbc9-7e54-47f1-bb98-775cd19d110c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:10.327910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-872dbbc9-7e54-47f1-bb98-775cd19d110c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:10.328687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-872dbbc9-7e54-47f1-bb98-775cd19d110c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:10.329200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-872dbbc9-7e54-47f1-bb98-775cd19d110c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:10.329665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-872dbbc9-7e54-47f1-bb98-775cd19d110c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:10.876200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5627eaba-2c77-448a-b455-d52f1aaac430 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:10.889107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5627eaba-2c77-448a-b455-d52f1aaac430 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:10.952672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5627eaba-2c77-448a-b455-d52f1aaac430 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:10.953791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5627eaba-2c77-448a-b455-d52f1aaac430 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:10.956775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5627eaba-2c77-448a-b455-d52f1aaac430 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:10.958215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5627eaba-2c77-448a-b455-d52f1aaac430 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:10.961222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5627eaba-2c77-448a-b455-d52f1aaac430 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:10.961921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5627eaba-2c77-448a-b455-d52f1aaac430 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:11.072143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:49:11.122595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-872dbbc9-7e54-47f1-bb98-775cd19d110c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:11.139131 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-872dbbc9-7e54-47f1-bb98-775cd19d110c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1507 microversion: 2.1 time: 0.890358 Oct 10 23:49:11.147409 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3013/5845] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:10 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1507 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:11.351809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5627eaba-2c77-448a-b455-d52f1aaac430 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:11.374189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5627eaba-2c77-448a-b455-d52f1aaac430 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:11.375783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5627eaba-2c77-448a-b455-d52f1aaac430 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:11.376985 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5627eaba-2c77-448a-b455-d52f1aaac430 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1282 microversion: 2.54 time: 0.509737 Oct 10 23:49:11.417648 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2833/5846] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:10 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1282 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:49:12.172599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9e213124-3579-4047-8e28-3fab8dc2688f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:12.178174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9e213124-3579-4047-8e28-3fab8dc2688f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:12.204576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e213124-3579-4047-8e28-3fab8dc2688f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:12.219434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e213124-3579-4047-8e28-3fab8dc2688f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:12.220790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e213124-3579-4047-8e28-3fab8dc2688f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:12.222113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e213124-3579-4047-8e28-3fab8dc2688f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:12.223673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e213124-3579-4047-8e28-3fab8dc2688f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:12.227152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e213124-3579-4047-8e28-3fab8dc2688f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:12.441226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-054d831d-774a-4fcb-a0d5-112da2d27bd9 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:12.442452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-054d831d-774a-4fcb-a0d5-112da2d27bd9 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:12.489619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-054d831d-774a-4fcb-a0d5-112da2d27bd9 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:12.497847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-054d831d-774a-4fcb-a0d5-112da2d27bd9 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:12.502412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-054d831d-774a-4fcb-a0d5-112da2d27bd9 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:12.508001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-054d831d-774a-4fcb-a0d5-112da2d27bd9 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:12.511928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-054d831d-774a-4fcb-a0d5-112da2d27bd9 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:12.518326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-054d831d-774a-4fcb-a0d5-112da2d27bd9 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:12.883182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9e213124-3579-4047-8e28-3fab8dc2688f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:12.896860 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9e213124-3579-4047-8e28-3fab8dc2688f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1507 microversion: 2.1 time: 0.731085 Oct 10 23:49:12.902898 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3014/5847] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:12 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1507 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:12.943934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-054d831d-774a-4fcb-a0d5-112da2d27bd9 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:12.964771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-054d831d-774a-4fcb-a0d5-112da2d27bd9 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:12.968034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-054d831d-774a-4fcb-a0d5-112da2d27bd9 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:12.988606 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-054d831d-774a-4fcb-a0d5-112da2d27bd9 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1336 microversion: 2.54 time: 0.555410 Oct 10 23:49:12.991324 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2834/5848] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:12 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1336 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:13.927436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6ec5232e-4615-4edd-8c2a-115f8242f46f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:13.928893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6ec5232e-4615-4edd-8c2a-115f8242f46f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:13.943058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ec5232e-4615-4edd-8c2a-115f8242f46f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:13.946852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ec5232e-4615-4edd-8c2a-115f8242f46f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:13.947688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ec5232e-4615-4edd-8c2a-115f8242f46f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:13.949112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ec5232e-4615-4edd-8c2a-115f8242f46f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:13.950734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ec5232e-4615-4edd-8c2a-115f8242f46f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:13.953946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ec5232e-4615-4edd-8c2a-115f8242f46f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:13.965086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:49:14.021235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4fed913f-1b6b-4bd2-ac63-5720c00b0c15 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:14.022108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4fed913f-1b6b-4bd2-ac63-5720c00b0c15 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:14.040359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fed913f-1b6b-4bd2-ac63-5720c00b0c15 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:14.040867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fed913f-1b6b-4bd2-ac63-5720c00b0c15 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:14.041303 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fed913f-1b6b-4bd2-ac63-5720c00b0c15 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:14.048249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fed913f-1b6b-4bd2-ac63-5720c00b0c15 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:14.052042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fed913f-1b6b-4bd2-ac63-5720c00b0c15 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:14.054121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fed913f-1b6b-4bd2-ac63-5720c00b0c15 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:14.318762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6ec5232e-4615-4edd-8c2a-115f8242f46f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:14.338544 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6ec5232e-4615-4edd-8c2a-115f8242f46f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1507 microversion: 2.1 time: 0.416234 Oct 10 23:49:14.340693 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3015/5849] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:13 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1507 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:14.393659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4fed913f-1b6b-4bd2-ac63-5720c00b0c15 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:14.411647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4fed913f-1b6b-4bd2-ac63-5720c00b0c15 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:14.418813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4fed913f-1b6b-4bd2-ac63-5720c00b0c15 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:14.419953 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4fed913f-1b6b-4bd2-ac63-5720c00b0c15 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1336 microversion: 2.54 time: 0.404059 Oct 10 23:49:14.431809 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2835/5850] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:14 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1336 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:15.370606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5d1965d9-c484-44c4-87ce-d9a25bdafd57 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:15.371444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5d1965d9-c484-44c4-87ce-d9a25bdafd57 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:15.395510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d1965d9-c484-44c4-87ce-d9a25bdafd57 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:15.395904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d1965d9-c484-44c4-87ce-d9a25bdafd57 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:15.400145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d1965d9-c484-44c4-87ce-d9a25bdafd57 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:15.401591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d1965d9-c484-44c4-87ce-d9a25bdafd57 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:15.406783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d1965d9-c484-44c4-87ce-d9a25bdafd57 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:15.408024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5d1965d9-c484-44c4-87ce-d9a25bdafd57 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:15.456361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ce31931b-4eb3-4c9b-aab0-fa75773939d1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:15.457741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ce31931b-4eb3-4c9b-aab0-fa75773939d1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:15.475083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce31931b-4eb3-4c9b-aab0-fa75773939d1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:15.475941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce31931b-4eb3-4c9b-aab0-fa75773939d1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:15.476679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce31931b-4eb3-4c9b-aab0-fa75773939d1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:15.477711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce31931b-4eb3-4c9b-aab0-fa75773939d1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:15.478463 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce31931b-4eb3-4c9b-aab0-fa75773939d1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:15.479126 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce31931b-4eb3-4c9b-aab0-fa75773939d1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:15.954711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ce31931b-4eb3-4c9b-aab0-fa75773939d1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:15.964269 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ce31931b-4eb3-4c9b-aab0-fa75773939d1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:15.975885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ce31931b-4eb3-4c9b-aab0-fa75773939d1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:15.985044 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ce31931b-4eb3-4c9b-aab0-fa75773939d1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1336 microversion: 2.54 time: 0.532598 Oct 10 23:49:15.988569 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2836/5851] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:15 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1336 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:49:16.376631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5d1965d9-c484-44c4-87ce-d9a25bdafd57 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:16.390211 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5d1965d9-c484-44c4-87ce-d9a25bdafd57 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1507 microversion: 2.1 time: 1.025560 Oct 10 23:49:16.414737 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3016/5852] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:15 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1507 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:17.024301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2437fdfb-3ea4-4386-b28c-72f8dd54267e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:17.026749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2437fdfb-3ea4-4386-b28c-72f8dd54267e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:17.056987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2437fdfb-3ea4-4386-b28c-72f8dd54267e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:17.057750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2437fdfb-3ea4-4386-b28c-72f8dd54267e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:17.058284 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2437fdfb-3ea4-4386-b28c-72f8dd54267e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:17.058977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2437fdfb-3ea4-4386-b28c-72f8dd54267e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:17.059480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2437fdfb-3ea4-4386-b28c-72f8dd54267e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:17.059898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2437fdfb-3ea4-4386-b28c-72f8dd54267e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:17.374691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2437fdfb-3ea4-4386-b28c-72f8dd54267e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:17.423748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9671c7b5-7934-4b1d-bbd2-1802f6927d42 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:17.424365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9671c7b5-7934-4b1d-bbd2-1802f6927d42 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:17.425592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2437fdfb-3ea4-4386-b28c-72f8dd54267e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:17.433127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2437fdfb-3ea4-4386-b28c-72f8dd54267e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:17.434701 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2437fdfb-3ea4-4386-b28c-72f8dd54267e tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1357 microversion: 2.54 time: 0.416984 Oct 10 23:49:17.453732 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2837/5853] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:17 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1357 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:17.453858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9671c7b5-7934-4b1d-bbd2-1802f6927d42 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:17.453858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9671c7b5-7934-4b1d-bbd2-1802f6927d42 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:17.453858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9671c7b5-7934-4b1d-bbd2-1802f6927d42 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:17.453858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9671c7b5-7934-4b1d-bbd2-1802f6927d42 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:17.453858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9671c7b5-7934-4b1d-bbd2-1802f6927d42 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:17.453858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9671c7b5-7934-4b1d-bbd2-1802f6927d42 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:17.479509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e9b6e536-cf64-44f0-8b36-7902a30a689c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Action: 'create', calling method: .version_select at 0x7f662a2b5790>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1936909953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNtTr27iGK78iDlc/UkpJW/B2wTimaiXYxZrX33znQ3ups1+c8oCEATsd4BwFdZgrb5T3ChlUVcUnNFvXnI3wubJunNJEsvUjSKVVLleF2IkJ+U6P1gXYQ599xSO7VDIA=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:49:17.536189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-e9b6e536-cf64-44f0-8b36-7902a30a689c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Getting quotas for project 67236ed6eb974ea6866c0aaddcc69179. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:49:17.571974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-e9b6e536-cf64-44f0-8b36-7902a30a689c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Getting quotas for user 6da1f2226c43442c9a65b0b7b1b4395f and project 67236ed6eb974ea6866c0aaddcc69179. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:49:17.711763 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e9b6e536-cf64-44f0-8b36-7902a30a689c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.240514 Oct 10 23:49:17.718864 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2838/5854] 10.222.0.23 () {62 vars in 1200 bytes} [Mon Oct 10 23:49:17 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 249 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 23:49:17.730894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e83d96d6-5dea-4184-b6e4-6c6f93a55aad tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1936909953", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:49:17.743706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e83d96d6-5dea-4184-b6e4-6c6f93a55aad tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:17.778332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e83d96d6-5dea-4184-b6e4-6c6f93a55aad tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:17.778847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e83d96d6-5dea-4184-b6e4-6c6f93a55aad tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:17.779295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e83d96d6-5dea-4184-b6e4-6c6f93a55aad tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:17.781245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e83d96d6-5dea-4184-b6e4-6c6f93a55aad tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:17.781245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e83d96d6-5dea-4184-b6e4-6c6f93a55aad tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:17.781780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e83d96d6-5dea-4184-b6e4-6c6f93a55aad tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:17.996868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9671c7b5-7934-4b1d-bbd2-1802f6927d42 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:18.006689 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9671c7b5-7934-4b1d-bbd2-1802f6927d42 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1507 microversion: 2.1 time: 0.587889 Oct 10 23:49:18.015240 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3017/5855] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:17 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1507 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:18.025717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e83d96d6-5dea-4184-b6e4-6c6f93a55aad tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:49:18.027001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e83d96d6-5dea-4184-b6e4-6c6f93a55aad tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:49:18.027657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e83d96d6-5dea-4184-b6e4-6c6f93a55aad tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:49:18.029231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e83d96d6-5dea-4184-b6e4-6c6f93a55aad tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:49:18.031489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e83d96d6-5dea-4184-b6e4-6c6f93a55aad tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:49:18.270049 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e83d96d6-5dea-4184-b6e4-6c6f93a55aad tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:18.290344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e83d96d6-5dea-4184-b6e4-6c6f93a55aad tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:18.292052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e83d96d6-5dea-4184-b6e4-6c6f93a55aad tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:18.292512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e83d96d6-5dea-4184-b6e4-6c6f93a55aad tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:18.295040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e83d96d6-5dea-4184-b6e4-6c6f93a55aad tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:18.297636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e83d96d6-5dea-4184-b6e4-6c6f93a55aad tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:18.298094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e83d96d6-5dea-4184-b6e4-6c6f93a55aad tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:18.382765 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e83d96d6-5dea-4184-b6e4-6c6f93a55aad tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "POST /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11/action" status: 202 len: 1140 microversion: 2.54 time: 0.653612 Oct 10 23:49:18.387349 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2839/5856] 10.222.0.23 () {62 vars in 1320 bytes} [Mon Oct 10 23:49:17 2022] POST /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11/action => generated 1140 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 10 23:49:18.411076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ef8d25ef-d41b-4f0f-807d-42da27b1fc16 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:18.412057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ef8d25ef-d41b-4f0f-807d-42da27b1fc16 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:18.434924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef8d25ef-d41b-4f0f-807d-42da27b1fc16 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:18.441431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef8d25ef-d41b-4f0f-807d-42da27b1fc16 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:18.443201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef8d25ef-d41b-4f0f-807d-42da27b1fc16 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:18.446453 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef8d25ef-d41b-4f0f-807d-42da27b1fc16 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:18.447296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef8d25ef-d41b-4f0f-807d-42da27b1fc16 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:18.448554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef8d25ef-d41b-4f0f-807d-42da27b1fc16 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:18.850462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ef8d25ef-d41b-4f0f-807d-42da27b1fc16 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:18.873706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ef8d25ef-d41b-4f0f-807d-42da27b1fc16 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:18.891302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ef8d25ef-d41b-4f0f-807d-42da27b1fc16 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:18.893064 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ef8d25ef-d41b-4f0f-807d-42da27b1fc16 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1409 microversion: 2.54 time: 0.486023 Oct 10 23:49:18.896763 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3018/5857] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:18 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1409 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:49:19.047927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dd718039-76f0-48f4-84e8-0706cb78ef5e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:19.048630 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dd718039-76f0-48f4-84e8-0706cb78ef5e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:19.063877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd718039-76f0-48f4-84e8-0706cb78ef5e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:19.066591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd718039-76f0-48f4-84e8-0706cb78ef5e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:19.068503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd718039-76f0-48f4-84e8-0706cb78ef5e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:19.073685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd718039-76f0-48f4-84e8-0706cb78ef5e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:19.074472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd718039-76f0-48f4-84e8-0706cb78ef5e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:19.076773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd718039-76f0-48f4-84e8-0706cb78ef5e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:19.736924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dd718039-76f0-48f4-84e8-0706cb78ef5e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:19.745745 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dd718039-76f0-48f4-84e8-0706cb78ef5e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1507 microversion: 2.1 time: 0.703714 Oct 10 23:49:19.753077 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2840/5858] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:19 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1507 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:19.936123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2650da7e-0060-460a-90e4-796652bd6dcf tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:19.945799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2650da7e-0060-460a-90e4-796652bd6dcf tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:19.968573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:49:19.991314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:49:20.005101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2650da7e-0060-460a-90e4-796652bd6dcf tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:20.008180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2650da7e-0060-460a-90e4-796652bd6dcf tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:20.014673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2650da7e-0060-460a-90e4-796652bd6dcf tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:20.023222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2650da7e-0060-460a-90e4-796652bd6dcf tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:20.024970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2650da7e-0060-460a-90e4-796652bd6dcf tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:20.031735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2650da7e-0060-460a-90e4-796652bd6dcf tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:20.237229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2650da7e-0060-460a-90e4-796652bd6dcf tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:20.251752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2650da7e-0060-460a-90e4-796652bd6dcf tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:20.254516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2650da7e-0060-460a-90e4-796652bd6dcf tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:20.263795 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2650da7e-0060-460a-90e4-796652bd6dcf tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1409 microversion: 2.54 time: 0.338083 Oct 10 23:49:20.268771 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3019/5859] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:19 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1409 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:20.770880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-24b3b460-e305-4dcd-8a6a-9bd92180fb43 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:20.772247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-24b3b460-e305-4dcd-8a6a-9bd92180fb43 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:20.788052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24b3b460-e305-4dcd-8a6a-9bd92180fb43 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:20.799237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24b3b460-e305-4dcd-8a6a-9bd92180fb43 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:20.802643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24b3b460-e305-4dcd-8a6a-9bd92180fb43 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:20.803887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24b3b460-e305-4dcd-8a6a-9bd92180fb43 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:20.807195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24b3b460-e305-4dcd-8a6a-9bd92180fb43 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:20.810389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24b3b460-e305-4dcd-8a6a-9bd92180fb43 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:21.180393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-24b3b460-e305-4dcd-8a6a-9bd92180fb43 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:21.195319 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-24b3b460-e305-4dcd-8a6a-9bd92180fb43 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1507 microversion: 2.1 time: 0.425471 Oct 10 23:49:21.199678 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2841/5860] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:20 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1507 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:21.296712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3d19dd61-7607-47b6-a89f-6c2cfb31366b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:21.297430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3d19dd61-7607-47b6-a89f-6c2cfb31366b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:21.318522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d19dd61-7607-47b6-a89f-6c2cfb31366b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:21.323533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d19dd61-7607-47b6-a89f-6c2cfb31366b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:21.324481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d19dd61-7607-47b6-a89f-6c2cfb31366b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:21.331245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d19dd61-7607-47b6-a89f-6c2cfb31366b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:21.335334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d19dd61-7607-47b6-a89f-6c2cfb31366b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:21.336005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d19dd61-7607-47b6-a89f-6c2cfb31366b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:21.686830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3d19dd61-7607-47b6-a89f-6c2cfb31366b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:21.709718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3d19dd61-7607-47b6-a89f-6c2cfb31366b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:21.717870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3d19dd61-7607-47b6-a89f-6c2cfb31366b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:21.721882 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3d19dd61-7607-47b6-a89f-6c2cfb31366b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1409 microversion: 2.54 time: 0.427413 Oct 10 23:49:21.724481 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3020/5861] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:21 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1409 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:22.226109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-68fda9f9-419e-4679-b8ac-7498d2fcbae3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:22.226664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-68fda9f9-419e-4679-b8ac-7498d2fcbae3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:22.247025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68fda9f9-419e-4679-b8ac-7498d2fcbae3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:22.247867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68fda9f9-419e-4679-b8ac-7498d2fcbae3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:22.249577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68fda9f9-419e-4679-b8ac-7498d2fcbae3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:22.254821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68fda9f9-419e-4679-b8ac-7498d2fcbae3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:22.256026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68fda9f9-419e-4679-b8ac-7498d2fcbae3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:22.256647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68fda9f9-419e-4679-b8ac-7498d2fcbae3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:22.667130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-68fda9f9-419e-4679-b8ac-7498d2fcbae3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:22.695067 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-68fda9f9-419e-4679-b8ac-7498d2fcbae3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1507 microversion: 2.1 time: 0.473812 Oct 10 23:49:22.720569 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2842/5862] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:22 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1507 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:22.778319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d0a5b913-da29-4b91-8702-3372d1a84d28 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:22.779395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d0a5b913-da29-4b91-8702-3372d1a84d28 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:22.803838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0a5b913-da29-4b91-8702-3372d1a84d28 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:22.804452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0a5b913-da29-4b91-8702-3372d1a84d28 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:22.805272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0a5b913-da29-4b91-8702-3372d1a84d28 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:22.806550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0a5b913-da29-4b91-8702-3372d1a84d28 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:22.807109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0a5b913-da29-4b91-8702-3372d1a84d28 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:22.807622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0a5b913-da29-4b91-8702-3372d1a84d28 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:22.918581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d0a5b913-da29-4b91-8702-3372d1a84d28 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:22.934611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d0a5b913-da29-4b91-8702-3372d1a84d28 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:22.938276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d0a5b913-da29-4b91-8702-3372d1a84d28 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:22.941020 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d0a5b913-da29-4b91-8702-3372d1a84d28 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1409 microversion: 2.54 time: 0.188529 Oct 10 23:49:22.957420 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2843/5863] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:22 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1409 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:49:23.051328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a1dc8995-3787-435a-8ec4-41e8871420e3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Action: 'create', calling method: .version_select at 0x7f662ae4aaf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-912348890", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFMGwpchW7NNyanYdllZmYYvXczYMWTUqmzxFwgRQryjRICrSjeD9/q0P+OEYa+7tVO2OdGWTveECpWY9htYIPEy9AOlQ3unLnQSGxzPnwl+JyIyM3iFox9+Va5VZmdsA=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:49:23.087663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-a1dc8995-3787-435a-8ec4-41e8871420e3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Getting quotas for project fce4582b30d041c592240d09a95a37e5. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:49:23.102292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-a1dc8995-3787-435a-8ec4-41e8871420e3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Getting quotas for user ce22396752cd4d71991c6994a31f4905 and project fce4582b30d041c592240d09a95a37e5. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:49:23.158543 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a1dc8995-3787-435a-8ec4-41e8871420e3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.563045 Oct 10 23:49:23.159613 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3021/5864] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:49:22 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:49:23.730635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-71bd9a5d-ba31-48cf-913f-027ab008373e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:23.732308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-71bd9a5d-ba31-48cf-913f-027ab008373e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:23.746628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71bd9a5d-ba31-48cf-913f-027ab008373e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:23.747954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71bd9a5d-ba31-48cf-913f-027ab008373e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:23.749194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71bd9a5d-ba31-48cf-913f-027ab008373e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:23.750254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71bd9a5d-ba31-48cf-913f-027ab008373e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:23.751095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71bd9a5d-ba31-48cf-913f-027ab008373e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:23.752707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71bd9a5d-ba31-48cf-913f-027ab008373e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:23.986867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-451ecee7-ff7d-4aed-ab8f-4952df0d414b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:23.988044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-451ecee7-ff7d-4aed-ab8f-4952df0d414b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:24.019248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-451ecee7-ff7d-4aed-ab8f-4952df0d414b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:24.020357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-451ecee7-ff7d-4aed-ab8f-4952df0d414b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:24.021139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-451ecee7-ff7d-4aed-ab8f-4952df0d414b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:24.022270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-451ecee7-ff7d-4aed-ab8f-4952df0d414b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:24.023031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-451ecee7-ff7d-4aed-ab8f-4952df0d414b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:24.023727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-451ecee7-ff7d-4aed-ab8f-4952df0d414b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:24.204960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-451ecee7-ff7d-4aed-ab8f-4952df0d414b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:24.228911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-451ecee7-ff7d-4aed-ab8f-4952df0d414b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:24.230879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-451ecee7-ff7d-4aed-ab8f-4952df0d414b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:24.232458 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-451ecee7-ff7d-4aed-ab8f-4952df0d414b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1409 microversion: 2.54 time: 0.253189 Oct 10 23:49:24.233534 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3022/5865] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:23 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1409 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:49:24.357954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-71bd9a5d-ba31-48cf-913f-027ab008373e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:24.388481 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-71bd9a5d-ba31-48cf-913f-027ab008373e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1507 microversion: 2.1 time: 0.663201 Oct 10 23:49:24.392122 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2844/5866] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:23 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1507 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:25.262903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-41fb079d-2740-4444-86ca-15fb55a8d0c8 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:25.263665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-41fb079d-2740-4444-86ca-15fb55a8d0c8 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:25.282650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41fb079d-2740-4444-86ca-15fb55a8d0c8 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:25.287021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41fb079d-2740-4444-86ca-15fb55a8d0c8 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:25.290491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41fb079d-2740-4444-86ca-15fb55a8d0c8 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:25.291858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41fb079d-2740-4444-86ca-15fb55a8d0c8 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:25.295898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41fb079d-2740-4444-86ca-15fb55a8d0c8 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:25.297169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41fb079d-2740-4444-86ca-15fb55a8d0c8 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:25.429488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ee16adc3-d6ff-409b-82be-3c822946b393 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:25.431007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ee16adc3-d6ff-409b-82be-3c822946b393 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:25.443022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee16adc3-d6ff-409b-82be-3c822946b393 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:25.444151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee16adc3-d6ff-409b-82be-3c822946b393 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:25.444875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee16adc3-d6ff-409b-82be-3c822946b393 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:25.445813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee16adc3-d6ff-409b-82be-3c822946b393 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:25.446679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee16adc3-d6ff-409b-82be-3c822946b393 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:25.447301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee16adc3-d6ff-409b-82be-3c822946b393 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:25.481975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-41fb079d-2740-4444-86ca-15fb55a8d0c8 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:25.507785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-41fb079d-2740-4444-86ca-15fb55a8d0c8 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:25.514998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-41fb079d-2740-4444-86ca-15fb55a8d0c8 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:25.518169 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-41fb079d-2740-4444-86ca-15fb55a8d0c8 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1409 microversion: 2.54 time: 0.261370 Oct 10 23:49:25.534618 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3023/5867] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:25 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1409 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:25.823682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ee16adc3-d6ff-409b-82be-3c822946b393 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:25.859602 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ee16adc3-d6ff-409b-82be-3c822946b393 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1507 microversion: 2.1 time: 0.432320 Oct 10 23:49:25.878860 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2845/5868] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:25 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1507 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:49:26.558888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-03f79d8b-b6e1-4d88-950a-6b266d57db3f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:26.559529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-03f79d8b-b6e1-4d88-950a-6b266d57db3f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:26.576190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03f79d8b-b6e1-4d88-950a-6b266d57db3f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:26.577825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03f79d8b-b6e1-4d88-950a-6b266d57db3f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:26.578601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03f79d8b-b6e1-4d88-950a-6b266d57db3f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:26.580572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03f79d8b-b6e1-4d88-950a-6b266d57db3f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:26.581309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03f79d8b-b6e1-4d88-950a-6b266d57db3f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:26.582148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03f79d8b-b6e1-4d88-950a-6b266d57db3f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:26.903351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5f5f51c5-891b-47e3-a405-ca527d0025f0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:26.903982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5f5f51c5-891b-47e3-a405-ca527d0025f0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:26.917270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f5f51c5-891b-47e3-a405-ca527d0025f0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:26.918271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f5f51c5-891b-47e3-a405-ca527d0025f0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:26.919586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f5f51c5-891b-47e3-a405-ca527d0025f0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:26.921233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f5f51c5-891b-47e3-a405-ca527d0025f0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:26.921981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f5f51c5-891b-47e3-a405-ca527d0025f0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:26.922841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f5f51c5-891b-47e3-a405-ca527d0025f0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:27.056786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-03f79d8b-b6e1-4d88-950a-6b266d57db3f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:27.070927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-03f79d8b-b6e1-4d88-950a-6b266d57db3f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:27.072855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-03f79d8b-b6e1-4d88-950a-6b266d57db3f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:27.074115 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-03f79d8b-b6e1-4d88-950a-6b266d57db3f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1409 microversion: 2.54 time: 0.519911 Oct 10 23:49:27.074688 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3024/5869] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:26 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1409 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:27.463120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5f5f51c5-891b-47e3-a405-ca527d0025f0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:27.477583 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5f5f51c5-891b-47e3-a405-ca527d0025f0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1507 microversion: 2.1 time: 0.578056 Oct 10 23:49:27.494528 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2846/5870] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:26 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1507 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:28.106152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-372a826c-a028-4664-9d05-1a2e3e0c93c1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:28.106793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-372a826c-a028-4664-9d05-1a2e3e0c93c1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:28.114608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-372a826c-a028-4664-9d05-1a2e3e0c93c1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:28.115107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-372a826c-a028-4664-9d05-1a2e3e0c93c1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:28.115549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-372a826c-a028-4664-9d05-1a2e3e0c93c1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:28.116266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-372a826c-a028-4664-9d05-1a2e3e0c93c1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:28.116721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-372a826c-a028-4664-9d05-1a2e3e0c93c1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:28.117144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-372a826c-a028-4664-9d05-1a2e3e0c93c1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:28.251454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-372a826c-a028-4664-9d05-1a2e3e0c93c1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:28.269424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-372a826c-a028-4664-9d05-1a2e3e0c93c1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:28.271117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-372a826c-a028-4664-9d05-1a2e3e0c93c1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:28.272454 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-372a826c-a028-4664-9d05-1a2e3e0c93c1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1409 microversion: 2.54 time: 0.170337 Oct 10 23:49:28.291585 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3025/5871] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:28 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1409 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:28.505009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e7700c72-7dab-4900-8ec7-77197517a625 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:28.505683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e7700c72-7dab-4900-8ec7-77197517a625 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:28.507533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:49:28.513952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7700c72-7dab-4900-8ec7-77197517a625 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:28.515088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7700c72-7dab-4900-8ec7-77197517a625 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:28.515701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7700c72-7dab-4900-8ec7-77197517a625 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:28.516415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7700c72-7dab-4900-8ec7-77197517a625 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:28.516868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7700c72-7dab-4900-8ec7-77197517a625 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:28.517288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7700c72-7dab-4900-8ec7-77197517a625 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:28.806027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e7700c72-7dab-4900-8ec7-77197517a625 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:28.830557 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e7700c72-7dab-4900-8ec7-77197517a625 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1504 microversion: 2.1 time: 0.329566 Oct 10 23:49:28.833428 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2847/5872] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:28 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1504 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:29.300221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dfcccede-59b9-497c-ac96-ab6eb034faed tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:29.300841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dfcccede-59b9-497c-ac96-ab6eb034faed tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:29.309801 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfcccede-59b9-497c-ac96-ab6eb034faed tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:29.310596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfcccede-59b9-497c-ac96-ab6eb034faed tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:29.311758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfcccede-59b9-497c-ac96-ab6eb034faed tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:29.313339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfcccede-59b9-497c-ac96-ab6eb034faed tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:29.313988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfcccede-59b9-497c-ac96-ab6eb034faed tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:29.314717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dfcccede-59b9-497c-ac96-ab6eb034faed tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:29.437762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dfcccede-59b9-497c-ac96-ab6eb034faed tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:29.454310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dfcccede-59b9-497c-ac96-ab6eb034faed tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:29.456143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dfcccede-59b9-497c-ac96-ab6eb034faed tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:29.457325 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dfcccede-59b9-497c-ac96-ab6eb034faed tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1409 microversion: 2.54 time: 0.162735 Oct 10 23:49:29.457995 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3026/5873] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:29 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1409 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:29.854715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-05e0062f-dae5-4471-bd25-e449fc326f3c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:29.855982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-05e0062f-dae5-4471-bd25-e449fc326f3c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:29.864315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05e0062f-dae5-4471-bd25-e449fc326f3c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:29.865170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05e0062f-dae5-4471-bd25-e449fc326f3c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:29.866007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05e0062f-dae5-4471-bd25-e449fc326f3c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:29.866909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05e0062f-dae5-4471-bd25-e449fc326f3c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:29.867584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05e0062f-dae5-4471-bd25-e449fc326f3c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:29.868211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05e0062f-dae5-4471-bd25-e449fc326f3c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:29.884934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:49:30.025527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-05e0062f-dae5-4471-bd25-e449fc326f3c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:30.037073 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-05e0062f-dae5-4471-bd25-e449fc326f3c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1504 microversion: 2.1 time: 0.186286 Oct 10 23:49:30.038440 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2848/5874] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:29 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:30.484918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ed414dfc-5a91-4f7e-82aa-db1361c5a86f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:30.485766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ed414dfc-5a91-4f7e-82aa-db1361c5a86f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:30.501496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed414dfc-5a91-4f7e-82aa-db1361c5a86f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:30.502823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed414dfc-5a91-4f7e-82aa-db1361c5a86f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:30.504182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed414dfc-5a91-4f7e-82aa-db1361c5a86f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:30.506494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed414dfc-5a91-4f7e-82aa-db1361c5a86f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:30.508409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed414dfc-5a91-4f7e-82aa-db1361c5a86f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:30.509787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed414dfc-5a91-4f7e-82aa-db1361c5a86f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:30.564542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-5e664794-3af7-4675-afc0-97012f68951d req-caed26a9-5110-4b4b-9821-3dfb0cebfdf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2606c2f7-d312-4418-b226-74371d7b8315", "name": "network-vif-unplugged", "status": "completed", "tag": "7668ae94-786a-4b79-9096-53ff020bd6e1"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:49:30.588599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5e664794-3af7-4675-afc0-97012f68951d req-caed26a9-5110-4b4b-9821-3dfb0cebfdf0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:30.589678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5e664794-3af7-4675-afc0-97012f68951d req-caed26a9-5110-4b4b-9821-3dfb0cebfdf0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:30.590657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5e664794-3af7-4675-afc0-97012f68951d req-caed26a9-5110-4b4b-9821-3dfb0cebfdf0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:30.642368 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-5e664794-3af7-4675-afc0-97012f68951d req-caed26a9-5110-4b4b-9821-3dfb0cebfdf0 service nova] Creating event network-vif-unplugged:7668ae94-786a-4b79-9096-53ff020bd6e1 for instance 2606c2f7-d312-4418-b226-74371d7b8315 on n-h2-860864-2 Oct 10 23:49:30.662970 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-5e664794-3af7-4675-afc0-97012f68951d req-caed26a9-5110-4b4b-9821-3dfb0cebfdf0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102398 Oct 10 23:49:30.669661 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2849/5875] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:49:30.739747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ed414dfc-5a91-4f7e-82aa-db1361c5a86f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:30.753404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ed414dfc-5a91-4f7e-82aa-db1361c5a86f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:30.761811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ed414dfc-5a91-4f7e-82aa-db1361c5a86f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:30.763481 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ed414dfc-5a91-4f7e-82aa-db1361c5a86f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1409 microversion: 2.54 time: 0.282704 Oct 10 23:49:30.770856 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3027/5876] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:30 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1409 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:31.065654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-034ce0a2-81d7-4aea-9aed-d3b3b86893dd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:31.067208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-034ce0a2-81d7-4aea-9aed-d3b3b86893dd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:31.081639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-034ce0a2-81d7-4aea-9aed-d3b3b86893dd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:31.083975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-034ce0a2-81d7-4aea-9aed-d3b3b86893dd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:31.086279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-034ce0a2-81d7-4aea-9aed-d3b3b86893dd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:31.089547 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-034ce0a2-81d7-4aea-9aed-d3b3b86893dd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:31.090235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-034ce0a2-81d7-4aea-9aed-d3b3b86893dd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:31.092673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-034ce0a2-81d7-4aea-9aed-d3b3b86893dd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:31.643326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-034ce0a2-81d7-4aea-9aed-d3b3b86893dd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:31.655640 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-034ce0a2-81d7-4aea-9aed-d3b3b86893dd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 200 len: 1507 microversion: 2.1 time: 0.595104 Oct 10 23:49:31.657676 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2850/5877] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:31 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 1507 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:31.695461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d72f05c6-6ed4-48fb-8c27-c47377702dc3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:31.705220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d72f05c6-6ed4-48fb-8c27-c47377702dc3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:31.721071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d72f05c6-6ed4-48fb-8c27-c47377702dc3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:31.723917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d72f05c6-6ed4-48fb-8c27-c47377702dc3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:31.726227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d72f05c6-6ed4-48fb-8c27-c47377702dc3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:31.728051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d72f05c6-6ed4-48fb-8c27-c47377702dc3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:31.728766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d72f05c6-6ed4-48fb-8c27-c47377702dc3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:31.729465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d72f05c6-6ed4-48fb-8c27-c47377702dc3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:31.798347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3db0d17b-1185-40d0-b532-fb32f0a41719 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:31.798983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3db0d17b-1185-40d0-b532-fb32f0a41719 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:31.812220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3db0d17b-1185-40d0-b532-fb32f0a41719 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:31.813655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3db0d17b-1185-40d0-b532-fb32f0a41719 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:31.814822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3db0d17b-1185-40d0-b532-fb32f0a41719 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:31.825975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3db0d17b-1185-40d0-b532-fb32f0a41719 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:31.827297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3db0d17b-1185-40d0-b532-fb32f0a41719 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:31.827959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3db0d17b-1185-40d0-b532-fb32f0a41719 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:32.009945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3db0d17b-1185-40d0-b532-fb32f0a41719 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:32.026194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3db0d17b-1185-40d0-b532-fb32f0a41719 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:32.028189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3db0d17b-1185-40d0-b532-fb32f0a41719 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:32.032721 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3db0d17b-1185-40d0-b532-fb32f0a41719 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1409 microversion: 2.54 time: 0.237454 Oct 10 23:49:32.034070 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2851/5878] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:31 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1409 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:32.131632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d72f05c6-6ed4-48fb-8c27-c47377702dc3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:32.145019 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d72f05c6-6ed4-48fb-8c27-c47377702dc3 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.463570 Oct 10 23:49:32.147302 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3028/5879] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:31 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:32.187078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8f7df1a5-fa95-4c90-985e-7b58397b537e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:32.188502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8f7df1a5-fa95-4c90-985e-7b58397b537e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:32.200905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f7df1a5-fa95-4c90-985e-7b58397b537e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:32.202714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f7df1a5-fa95-4c90-985e-7b58397b537e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:32.203761 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f7df1a5-fa95-4c90-985e-7b58397b537e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:32.206192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f7df1a5-fa95-4c90-985e-7b58397b537e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:32.206908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f7df1a5-fa95-4c90-985e-7b58397b537e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:32.207908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f7df1a5-fa95-4c90-985e-7b58397b537e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:32.800184 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8f7df1a5-fa95-4c90-985e-7b58397b537e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:32.812668 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8f7df1a5-fa95-4c90-985e-7b58397b537e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.629850 Oct 10 23:49:32.813868 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2852/5880] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:32 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:32.839942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-681973f6-6844-46df-90b4-28a3cd4833da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:32.841601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-681973f6-6844-46df-90b4-28a3cd4833da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:32.855835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-681973f6-6844-46df-90b4-28a3cd4833da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:32.858668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-681973f6-6844-46df-90b4-28a3cd4833da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:32.859497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-681973f6-6844-46df-90b4-28a3cd4833da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:32.860478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-681973f6-6844-46df-90b4-28a3cd4833da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:32.863026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-681973f6-6844-46df-90b4-28a3cd4833da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:32.864635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-681973f6-6844-46df-90b4-28a3cd4833da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:33.064010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-14d9cdcd-83c9-405b-a018-82497ec763c0 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:33.064894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-14d9cdcd-83c9-405b-a018-82497ec763c0 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:33.082598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14d9cdcd-83c9-405b-a018-82497ec763c0 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:33.089934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14d9cdcd-83c9-405b-a018-82497ec763c0 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:33.090697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14d9cdcd-83c9-405b-a018-82497ec763c0 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:33.092051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14d9cdcd-83c9-405b-a018-82497ec763c0 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:33.093511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14d9cdcd-83c9-405b-a018-82497ec763c0 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:33.094138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14d9cdcd-83c9-405b-a018-82497ec763c0 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:33.122292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:49:33.181988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-681973f6-6844-46df-90b4-28a3cd4833da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:33.198047 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-681973f6-6844-46df-90b4-28a3cd4833da tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.362016 Oct 10 23:49:33.230777 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3029/5881] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:32 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:33.244028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7a24b606-06ea-4137-a51c-87c9d7aa1a3f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:33.244974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7a24b606-06ea-4137-a51c-87c9d7aa1a3f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:33.268533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a24b606-06ea-4137-a51c-87c9d7aa1a3f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:33.271465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a24b606-06ea-4137-a51c-87c9d7aa1a3f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:33.273250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a24b606-06ea-4137-a51c-87c9d7aa1a3f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:33.274265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a24b606-06ea-4137-a51c-87c9d7aa1a3f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:33.275535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-14d9cdcd-83c9-405b-a018-82497ec763c0 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:33.278065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a24b606-06ea-4137-a51c-87c9d7aa1a3f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:33.278529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a24b606-06ea-4137-a51c-87c9d7aa1a3f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:33.298073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-14d9cdcd-83c9-405b-a018-82497ec763c0 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:33.300210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-14d9cdcd-83c9-405b-a018-82497ec763c0 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:33.302317 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-14d9cdcd-83c9-405b-a018-82497ec763c0 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1409 microversion: 2.54 time: 0.242793 Oct 10 23:49:33.303503 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2853/5882] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:33 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1409 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:33.717121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7a24b606-06ea-4137-a51c-87c9d7aa1a3f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:33.735849 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7a24b606-06ea-4137-a51c-87c9d7aa1a3f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.503369 Oct 10 23:49:33.736476 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3030/5883] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:33 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:33.763781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4b50f013-6791-4877-a3b8-002b983eb229 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:49:33.785040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b50f013-6791-4877-a3b8-002b983eb229 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:33.785574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b50f013-6791-4877-a3b8-002b983eb229 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:33.785997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b50f013-6791-4877-a3b8-002b983eb229 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:33.858198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4b50f013-6791-4877-a3b8-002b983eb229 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Going to try to stop instance {{(pid=120614) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 23:49:33.925285 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4b50f013-6791-4877-a3b8-002b983eb229 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action" status: 202 len: 0 microversion: 2.1 time: 0.165306 Oct 10 23:49:33.926389 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2854/5884] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:49:33 2022] POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:49:33.940394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ae652151-de72-48b8-a574-914347a2263e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:33.942876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ae652151-de72-48b8-a574-914347a2263e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:34.000449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae652151-de72-48b8-a574-914347a2263e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:34.001075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae652151-de72-48b8-a574-914347a2263e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:34.005504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae652151-de72-48b8-a574-914347a2263e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:34.006735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae652151-de72-48b8-a574-914347a2263e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:34.009084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae652151-de72-48b8-a574-914347a2263e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:34.012863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae652151-de72-48b8-a574-914347a2263e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:34.263818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ae652151-de72-48b8-a574-914347a2263e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:34.275718 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ae652151-de72-48b8-a574-914347a2263e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1680 microversion: 2.1 time: 0.344253 Oct 10 23:49:34.290543 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3031/5885] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:33 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1680 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:34.339584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c0e2dbd6-f5a2-44d3-8045-e84607194a7a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:34.361250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c0e2dbd6-f5a2-44d3-8045-e84607194a7a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:34.386404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c0e2dbd6-f5a2-44d3-8045-e84607194a7a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:34.388474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c0e2dbd6-f5a2-44d3-8045-e84607194a7a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:34.390835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c0e2dbd6-f5a2-44d3-8045-e84607194a7a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:34.392044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c0e2dbd6-f5a2-44d3-8045-e84607194a7a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:34.395123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c0e2dbd6-f5a2-44d3-8045-e84607194a7a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:34.398218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c0e2dbd6-f5a2-44d3-8045-e84607194a7a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:35.167417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c0e2dbd6-f5a2-44d3-8045-e84607194a7a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:35.179577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c0e2dbd6-f5a2-44d3-8045-e84607194a7a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:35.183773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c0e2dbd6-f5a2-44d3-8045-e84607194a7a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:35.194956 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c0e2dbd6-f5a2-44d3-8045-e84607194a7a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1409 microversion: 2.54 time: 0.864720 Oct 10 23:49:35.220342 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2855/5886] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:34 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1409 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:35.305241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-70b94631-8a11-42b0-afa0-dfb879dea52c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:35.306450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-70b94631-8a11-42b0-afa0-dfb879dea52c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:35.325205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70b94631-8a11-42b0-afa0-dfb879dea52c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:35.326047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70b94631-8a11-42b0-afa0-dfb879dea52c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:35.327144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70b94631-8a11-42b0-afa0-dfb879dea52c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:35.328354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70b94631-8a11-42b0-afa0-dfb879dea52c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:35.329455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70b94631-8a11-42b0-afa0-dfb879dea52c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:35.330213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70b94631-8a11-42b0-afa0-dfb879dea52c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:35.588125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-70b94631-8a11-42b0-afa0-dfb879dea52c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:35.590507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:49:35.606939 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-70b94631-8a11-42b0-afa0-dfb879dea52c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1680 microversion: 2.1 time: 0.308230 Oct 10 23:49:35.621976 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3032/5887] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:35 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1680 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:36.230148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9b0a2ad1-d64f-4c51-885f-c35a0ad2b27a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:36.230901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9b0a2ad1-d64f-4c51-885f-c35a0ad2b27a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:36.235989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:49:36.245795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b0a2ad1-d64f-4c51-885f-c35a0ad2b27a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:36.246295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b0a2ad1-d64f-4c51-885f-c35a0ad2b27a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:36.246743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b0a2ad1-d64f-4c51-885f-c35a0ad2b27a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:36.247459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b0a2ad1-d64f-4c51-885f-c35a0ad2b27a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:36.247969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b0a2ad1-d64f-4c51-885f-c35a0ad2b27a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:36.248339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b0a2ad1-d64f-4c51-885f-c35a0ad2b27a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:36.409925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9b0a2ad1-d64f-4c51-885f-c35a0ad2b27a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:36.418442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9b0a2ad1-d64f-4c51-885f-c35a0ad2b27a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:36.419907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9b0a2ad1-d64f-4c51-885f-c35a0ad2b27a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:36.425580 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9b0a2ad1-d64f-4c51-885f-c35a0ad2b27a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1409 microversion: 2.54 time: 0.201667 Oct 10 23:49:36.448491 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2856/5888] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:36 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1409 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:36.642709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3fdec623-e5e3-445c-9fc3-230bd7561d4f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:36.645126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3fdec623-e5e3-445c-9fc3-230bd7561d4f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:36.657840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fdec623-e5e3-445c-9fc3-230bd7561d4f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:36.664016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fdec623-e5e3-445c-9fc3-230bd7561d4f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:36.668125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fdec623-e5e3-445c-9fc3-230bd7561d4f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:36.668930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fdec623-e5e3-445c-9fc3-230bd7561d4f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:36.670530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fdec623-e5e3-445c-9fc3-230bd7561d4f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:36.671206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3fdec623-e5e3-445c-9fc3-230bd7561d4f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:37.169073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3fdec623-e5e3-445c-9fc3-230bd7561d4f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:37.177866 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3fdec623-e5e3-445c-9fc3-230bd7561d4f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1680 microversion: 2.1 time: 0.548509 Oct 10 23:49:37.181954 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3033/5889] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:36 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1680 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:37.457558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7206eeed-8226-441f-9eb6-4ceb08fd2f9b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:37.459128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7206eeed-8226-441f-9eb6-4ceb08fd2f9b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:37.472207 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7206eeed-8226-441f-9eb6-4ceb08fd2f9b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:37.473037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7206eeed-8226-441f-9eb6-4ceb08fd2f9b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:37.473682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7206eeed-8226-441f-9eb6-4ceb08fd2f9b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:37.474622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7206eeed-8226-441f-9eb6-4ceb08fd2f9b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:37.475258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7206eeed-8226-441f-9eb6-4ceb08fd2f9b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:37.475692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7206eeed-8226-441f-9eb6-4ceb08fd2f9b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:37.630883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7206eeed-8226-441f-9eb6-4ceb08fd2f9b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:37.639913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7206eeed-8226-441f-9eb6-4ceb08fd2f9b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:37.643071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7206eeed-8226-441f-9eb6-4ceb08fd2f9b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:37.645952 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7206eeed-8226-441f-9eb6-4ceb08fd2f9b tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1409 microversion: 2.54 time: 0.193432 Oct 10 23:49:37.647908 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2857/5890] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:37 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1409 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:38.208797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-01054a90-4164-497d-8d7c-45567bce2dd7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:38.214209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-01054a90-4164-497d-8d7c-45567bce2dd7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:38.231750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01054a90-4164-497d-8d7c-45567bce2dd7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:38.232539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01054a90-4164-497d-8d7c-45567bce2dd7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:38.233258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01054a90-4164-497d-8d7c-45567bce2dd7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:38.234970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01054a90-4164-497d-8d7c-45567bce2dd7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:38.236146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01054a90-4164-497d-8d7c-45567bce2dd7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:38.236534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01054a90-4164-497d-8d7c-45567bce2dd7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:38.550911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-01054a90-4164-497d-8d7c-45567bce2dd7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:38.588127 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-01054a90-4164-497d-8d7c-45567bce2dd7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1680 microversion: 2.1 time: 0.383188 Oct 10 23:49:38.619467 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3034/5891] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:38 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1680 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:38.689349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a4beb552-387f-43cd-bf99-405ab4062c30 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:38.690554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a4beb552-387f-43cd-bf99-405ab4062c30 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:38.700961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4beb552-387f-43cd-bf99-405ab4062c30 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:38.707256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4beb552-387f-43cd-bf99-405ab4062c30 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:38.709353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4beb552-387f-43cd-bf99-405ab4062c30 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:38.710291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4beb552-387f-43cd-bf99-405ab4062c30 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:38.721641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4beb552-387f-43cd-bf99-405ab4062c30 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:38.722613 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4beb552-387f-43cd-bf99-405ab4062c30 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:38.888722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-91589831-fe7f-4b95-9e07-3ab9b6de3f56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1588076042", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "5dd9d2e3-8377-4c02-afe5-d6dd707475be"}], "key_name": "tempest-TestNetworkAdvancedServerOps-912348890", "security_groups": [{"name": "tempest-secgroup-smoke-1558165419"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:49:38.943553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a4beb552-387f-43cd-bf99-405ab4062c30 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:38.968283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a4beb552-387f-43cd-bf99-405ab4062c30 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:38.972425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a4beb552-387f-43cd-bf99-405ab4062c30 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:38.974053 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a4beb552-387f-43cd-bf99-405ab4062c30 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1409 microversion: 2.54 time: 0.289064 Oct 10 23:49:38.996349 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2858/5892] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:38 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1409 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:39.368394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-91589831-fe7f-4b95-9e07-3ab9b6de3f56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] validate_networks() for [('5dd9d2e3-8377-4c02-afe5-d6dd707475be', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:49:39.633693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-479f509e-44ed-471e-9088-c5db732015a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:39.635137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-479f509e-44ed-471e-9088-c5db732015a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:39.642349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-479f509e-44ed-471e-9088-c5db732015a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:39.643132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-479f509e-44ed-471e-9088-c5db732015a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:39.643731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-479f509e-44ed-471e-9088-c5db732015a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:39.644759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-479f509e-44ed-471e-9088-c5db732015a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:39.645401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-479f509e-44ed-471e-9088-c5db732015a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:39.646000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-479f509e-44ed-471e-9088-c5db732015a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:39.789151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:49:39.871727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-479f509e-44ed-471e-9088-c5db732015a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:39.885051 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-479f509e-44ed-471e-9088-c5db732015a7 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1680 microversion: 2.1 time: 0.255542 Oct 10 23:49:39.887643 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2859/5893] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:39 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1680 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:49:40.036515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-47818921-cc03-407d-bbae-7ef04ae5d94f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:40.037431 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-47818921-cc03-407d-bbae-7ef04ae5d94f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:40.062766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47818921-cc03-407d-bbae-7ef04ae5d94f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:40.063562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47818921-cc03-407d-bbae-7ef04ae5d94f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:40.064169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47818921-cc03-407d-bbae-7ef04ae5d94f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:40.065066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47818921-cc03-407d-bbae-7ef04ae5d94f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:40.066122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47818921-cc03-407d-bbae-7ef04ae5d94f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:40.066572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47818921-cc03-407d-bbae-7ef04ae5d94f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:40.205860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-47818921-cc03-407d-bbae-7ef04ae5d94f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:40.223652 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-47818921-cc03-407d-bbae-7ef04ae5d94f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:40.228911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-47818921-cc03-407d-bbae-7ef04ae5d94f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:40.231686 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-47818921-cc03-407d-bbae-7ef04ae5d94f tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1409 microversion: 2.54 time: 0.200270 Oct 10 23:49:40.233749 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2860/5894] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:40 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1409 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:40.912568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-929d4552-c1c4-435a-8177-53d575c2dcaf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:40.913203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-929d4552-c1c4-435a-8177-53d575c2dcaf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:40.924227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-929d4552-c1c4-435a-8177-53d575c2dcaf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:40.924851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-929d4552-c1c4-435a-8177-53d575c2dcaf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:40.925301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-929d4552-c1c4-435a-8177-53d575c2dcaf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:40.931077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-929d4552-c1c4-435a-8177-53d575c2dcaf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:40.933757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-929d4552-c1c4-435a-8177-53d575c2dcaf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:40.934384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-929d4552-c1c4-435a-8177-53d575c2dcaf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:40.956327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-91589831-fe7f-4b95-9e07-3ab9b6de3f56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:49:40.957090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-91589831-fe7f-4b95-9e07-3ab9b6de3f56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:49:40.957625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-91589831-fe7f-4b95-9e07-3ab9b6de3f56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:49:40.958132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-91589831-fe7f-4b95-9e07-3ab9b6de3f56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:49:40.958554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-91589831-fe7f-4b95-9e07-3ab9b6de3f56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:49:40.983167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91589831-fe7f-4b95-9e07-3ab9b6de3f56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:40.985834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91589831-fe7f-4b95-9e07-3ab9b6de3f56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:40.986303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91589831-fe7f-4b95-9e07-3ab9b6de3f56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:41.006027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91589831-fe7f-4b95-9e07-3ab9b6de3f56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:41.006638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91589831-fe7f-4b95-9e07-3ab9b6de3f56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:41.007100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91589831-fe7f-4b95-9e07-3ab9b6de3f56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:41.065059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-91589831-fe7f-4b95-9e07-3ab9b6de3f56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Getting quotas for project fce4582b30d041c592240d09a95a37e5. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:49:41.075419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-91589831-fe7f-4b95-9e07-3ab9b6de3f56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Getting quotas for user ce22396752cd4d71991c6994a31f4905 and project fce4582b30d041c592240d09a95a37e5. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:49:41.102797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-91589831-fe7f-4b95-9e07-3ab9b6de3f56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:49:41.105359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-91589831-fe7f-4b95-9e07-3ab9b6de3f56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:49:41.214925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-929d4552-c1c4-435a-8177-53d575c2dcaf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:41.227739 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-929d4552-c1c4-435a-8177-53d575c2dcaf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1680 microversion: 2.1 time: 0.318204 Oct 10 23:49:41.228671 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-91589831-fe7f-4b95-9e07-3ab9b6de3f56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.344521 Oct 10 23:49:41.240183 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3035/5895] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:49:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 2357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 23:49:41.247694 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2861/5896] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:40 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1680 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:49:41.251482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3a971131-1d12-46e4-84a4-cbeb2c9ac5f1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:41.252297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3a971131-1d12-46e4-84a4-cbeb2c9ac5f1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:41.283291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7a11a84e-6df2-4ca1-850b-c9412e9f8cbd tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:41.283918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7a11a84e-6df2-4ca1-850b-c9412e9f8cbd tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:41.316131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a11a84e-6df2-4ca1-850b-c9412e9f8cbd tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:41.316974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a11a84e-6df2-4ca1-850b-c9412e9f8cbd tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:41.317448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a11a84e-6df2-4ca1-850b-c9412e9f8cbd tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:41.322907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a11a84e-6df2-4ca1-850b-c9412e9f8cbd tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:41.323389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a11a84e-6df2-4ca1-850b-c9412e9f8cbd tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:41.324941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a11a84e-6df2-4ca1-850b-c9412e9f8cbd tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:41.473647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3a971131-1d12-46e4-84a4-cbeb2c9ac5f1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:41.474637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7a11a84e-6df2-4ca1-850b-c9412e9f8cbd tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:41.485685 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3a971131-1d12-46e4-84a4-cbeb2c9ac5f1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1266 microversion: 2.1 time: 0.244086 Oct 10 23:49:41.489002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7a11a84e-6df2-4ca1-850b-c9412e9f8cbd tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:41.496501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7a11a84e-6df2-4ca1-850b-c9412e9f8cbd tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:41.498427 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7a11a84e-6df2-4ca1-850b-c9412e9f8cbd tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1409 microversion: 2.54 time: 0.227642 Oct 10 23:49:41.500366 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2862/5897] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:41 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1409 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:41.502128 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3036/5898] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:41 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:42.273701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1295f059-c9af-4b5a-828f-44e094c02622 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:42.277301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1295f059-c9af-4b5a-828f-44e094c02622 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:42.302464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1295f059-c9af-4b5a-828f-44e094c02622 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:42.303663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1295f059-c9af-4b5a-828f-44e094c02622 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:42.305041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1295f059-c9af-4b5a-828f-44e094c02622 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:42.306249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1295f059-c9af-4b5a-828f-44e094c02622 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:42.306954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1295f059-c9af-4b5a-828f-44e094c02622 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:42.310898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1295f059-c9af-4b5a-828f-44e094c02622 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:42.512791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c0077267-224e-4f48-ad2d-b62fb214812f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:42.514096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c0077267-224e-4f48-ad2d-b62fb214812f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:42.527002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0077267-224e-4f48-ad2d-b62fb214812f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:42.527838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0077267-224e-4f48-ad2d-b62fb214812f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:42.529394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0077267-224e-4f48-ad2d-b62fb214812f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:42.530945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0077267-224e-4f48-ad2d-b62fb214812f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:42.531740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0077267-224e-4f48-ad2d-b62fb214812f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:42.532389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0077267-224e-4f48-ad2d-b62fb214812f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:42.693593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c0077267-224e-4f48-ad2d-b62fb214812f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:42.734437 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c0077267-224e-4f48-ad2d-b62fb214812f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1318 microversion: 2.1 time: 0.221177 Oct 10 23:49:42.735104 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3037/5899] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:42 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:42.769590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-025f06dc-1541-47b3-82b5-df309dfd03e1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:42.776319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-025f06dc-1541-47b3-82b5-df309dfd03e1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:42.794869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-025f06dc-1541-47b3-82b5-df309dfd03e1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:42.796721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-025f06dc-1541-47b3-82b5-df309dfd03e1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:42.797681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-025f06dc-1541-47b3-82b5-df309dfd03e1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:42.798650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-025f06dc-1541-47b3-82b5-df309dfd03e1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:42.800577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-025f06dc-1541-47b3-82b5-df309dfd03e1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:42.802018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-025f06dc-1541-47b3-82b5-df309dfd03e1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:42.953250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-025f06dc-1541-47b3-82b5-df309dfd03e1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:42.968572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-025f06dc-1541-47b3-82b5-df309dfd03e1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:42.970179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-025f06dc-1541-47b3-82b5-df309dfd03e1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:42.976819 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-025f06dc-1541-47b3-82b5-df309dfd03e1 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1409 microversion: 2.54 time: 0.219651 Oct 10 23:49:42.982041 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3038/5900] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:42 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1409 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:43.018276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1295f059-c9af-4b5a-828f-44e094c02622 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:43.041265 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1295f059-c9af-4b5a-828f-44e094c02622 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1680 microversion: 2.1 time: 0.774585 Oct 10 23:49:43.043024 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2863/5901] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:42 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1680 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:43.763059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c23d45ae-70e1-42ed-b951-19fd3a030437 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:43.763712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c23d45ae-70e1-42ed-b951-19fd3a030437 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:43.771731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c23d45ae-70e1-42ed-b951-19fd3a030437 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:43.772346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c23d45ae-70e1-42ed-b951-19fd3a030437 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:43.772790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c23d45ae-70e1-42ed-b951-19fd3a030437 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:43.773904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c23d45ae-70e1-42ed-b951-19fd3a030437 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:43.774359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c23d45ae-70e1-42ed-b951-19fd3a030437 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:43.774790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c23d45ae-70e1-42ed-b951-19fd3a030437 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:43.900043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c23d45ae-70e1-42ed-b951-19fd3a030437 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:43.909296 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c23d45ae-70e1-42ed-b951-19fd3a030437 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1324 microversion: 2.1 time: 0.150487 Oct 10 23:49:43.909918 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3039/5902] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:43 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1324 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:44.009101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b7b8516c-6f9f-4414-a187-117fc28fdee3 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:44.009763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b7b8516c-6f9f-4414-a187-117fc28fdee3 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:44.023207 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7b8516c-6f9f-4414-a187-117fc28fdee3 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:44.027520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7b8516c-6f9f-4414-a187-117fc28fdee3 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:44.028417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7b8516c-6f9f-4414-a187-117fc28fdee3 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:44.029190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7b8516c-6f9f-4414-a187-117fc28fdee3 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:44.029683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7b8516c-6f9f-4414-a187-117fc28fdee3 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:44.030668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7b8516c-6f9f-4414-a187-117fc28fdee3 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:44.079343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0a147a47-c6bc-471b-8680-74b8541c377b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:44.080445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0a147a47-c6bc-471b-8680-74b8541c377b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:44.096147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a147a47-c6bc-471b-8680-74b8541c377b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:44.096900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a147a47-c6bc-471b-8680-74b8541c377b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:44.097533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a147a47-c6bc-471b-8680-74b8541c377b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:44.098437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a147a47-c6bc-471b-8680-74b8541c377b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:44.099051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a147a47-c6bc-471b-8680-74b8541c377b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:44.099887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a147a47-c6bc-471b-8680-74b8541c377b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:44.202697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b7b8516c-6f9f-4414-a187-117fc28fdee3 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:44.206651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:49:44.228481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b7b8516c-6f9f-4414-a187-117fc28fdee3 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:44.239124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b7b8516c-6f9f-4414-a187-117fc28fdee3 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:44.240854 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b7b8516c-6f9f-4414-a187-117fc28fdee3 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1409 microversion: 2.54 time: 0.235869 Oct 10 23:49:44.246668 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2864/5903] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:44 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1409 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:44.461148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0a147a47-c6bc-471b-8680-74b8541c377b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:44.472072 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0a147a47-c6bc-471b-8680-74b8541c377b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1680 microversion: 2.1 time: 0.397752 Oct 10 23:49:44.479761 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3040/5904] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:44 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1680 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:49:44.954742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ae8c76ea-64d2-4575-9832-e4c18fb1bfa0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:44.956566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ae8c76ea-64d2-4575-9832-e4c18fb1bfa0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:44.980711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae8c76ea-64d2-4575-9832-e4c18fb1bfa0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:44.982414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae8c76ea-64d2-4575-9832-e4c18fb1bfa0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:44.983137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae8c76ea-64d2-4575-9832-e4c18fb1bfa0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:44.984148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae8c76ea-64d2-4575-9832-e4c18fb1bfa0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:44.984803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae8c76ea-64d2-4575-9832-e4c18fb1bfa0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:44.985447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae8c76ea-64d2-4575-9832-e4c18fb1bfa0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:45.271225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d6e2b29c-4e9e-4364-82dc-dcbec1781354 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:45.271875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d6e2b29c-4e9e-4364-82dc-dcbec1781354 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:45.287372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6e2b29c-4e9e-4364-82dc-dcbec1781354 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:45.287904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6e2b29c-4e9e-4364-82dc-dcbec1781354 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:45.288350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6e2b29c-4e9e-4364-82dc-dcbec1781354 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:45.289065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6e2b29c-4e9e-4364-82dc-dcbec1781354 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:45.289764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6e2b29c-4e9e-4364-82dc-dcbec1781354 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:45.290388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6e2b29c-4e9e-4364-82dc-dcbec1781354 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:45.367537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ae8c76ea-64d2-4575-9832-e4c18fb1bfa0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:45.383190 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ae8c76ea-64d2-4575-9832-e4c18fb1bfa0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1392 microversion: 2.1 time: 0.446047 Oct 10 23:49:45.384981 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2865/5905] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:44 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1392 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:45.394402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d6e2b29c-4e9e-4364-82dc-dcbec1781354 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:45.408616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d6e2b29c-4e9e-4364-82dc-dcbec1781354 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:45.413347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d6e2b29c-4e9e-4364-82dc-dcbec1781354 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:45.415822 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d6e2b29c-4e9e-4364-82dc-dcbec1781354 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1409 microversion: 2.54 time: 0.147550 Oct 10 23:49:45.419124 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3041/5906] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:45 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1409 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:49:45.508928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-16c73138-8523-4e96-be79-1ed2d074b2cf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:45.510555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-16c73138-8523-4e96-be79-1ed2d074b2cf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:45.523757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16c73138-8523-4e96-be79-1ed2d074b2cf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:45.524809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16c73138-8523-4e96-be79-1ed2d074b2cf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:45.525837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16c73138-8523-4e96-be79-1ed2d074b2cf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:45.527296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16c73138-8523-4e96-be79-1ed2d074b2cf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:45.528326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16c73138-8523-4e96-be79-1ed2d074b2cf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:45.529035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16c73138-8523-4e96-be79-1ed2d074b2cf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:46.259587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-16c73138-8523-4e96-be79-1ed2d074b2cf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:46.270835 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-16c73138-8523-4e96-be79-1ed2d074b2cf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1657 microversion: 2.1 time: 0.767914 Oct 10 23:49:46.271495 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2866/5907] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:45 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1657 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:46.299089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7fc5d1f6-462b-40e0-a42e-799496b89b17 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:49:46.324334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fc5d1f6-462b-40e0-a42e-799496b89b17 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:46.325137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fc5d1f6-462b-40e0-a42e-799496b89b17 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:46.325792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fc5d1f6-462b-40e0-a42e-799496b89b17 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:46.401665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7fc5d1f6-462b-40e0-a42e-799496b89b17 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Going to try to start instance {{(pid=120613) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 10 23:49:46.412831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6b64fd25-58a8-4a69-adaa-01475e82f18b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:46.414189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6b64fd25-58a8-4a69-adaa-01475e82f18b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:46.426297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b64fd25-58a8-4a69-adaa-01475e82f18b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:46.427494 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b64fd25-58a8-4a69-adaa-01475e82f18b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:46.429921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b64fd25-58a8-4a69-adaa-01475e82f18b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:46.430970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b64fd25-58a8-4a69-adaa-01475e82f18b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:46.434624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b64fd25-58a8-4a69-adaa-01475e82f18b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:46.435408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b64fd25-58a8-4a69-adaa-01475e82f18b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:46.492530 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7fc5d1f6-462b-40e0-a42e-799496b89b17 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action" status: 202 len: 0 microversion: 2.1 time: 0.197992 Oct 10 23:49:46.493209 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3042/5908] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:49:46 2022] POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:49:46.498649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e5039411-98e9-408c-86b6-5da7b91a3a3c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:46.526107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e5039411-98e9-408c-86b6-5da7b91a3a3c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:46.553330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5039411-98e9-408c-86b6-5da7b91a3a3c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:46.556625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5039411-98e9-408c-86b6-5da7b91a3a3c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:46.557988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5039411-98e9-408c-86b6-5da7b91a3a3c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:46.559309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5039411-98e9-408c-86b6-5da7b91a3a3c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:46.560413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5039411-98e9-408c-86b6-5da7b91a3a3c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:46.562182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5039411-98e9-408c-86b6-5da7b91a3a3c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:46.706172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6b64fd25-58a8-4a69-adaa-01475e82f18b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:46.723082 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6b64fd25-58a8-4a69-adaa-01475e82f18b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1392 microversion: 2.1 time: 0.313649 Oct 10 23:49:46.725145 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2867/5909] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:46 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1392 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:49:46.738695 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-29b3dd29-2ea2-456b-8403-4f9e546bad72 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:46.741437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-29b3dd29-2ea2-456b-8403-4f9e546bad72 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:46.757344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29b3dd29-2ea2-456b-8403-4f9e546bad72 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:46.758242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29b3dd29-2ea2-456b-8403-4f9e546bad72 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:46.760295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29b3dd29-2ea2-456b-8403-4f9e546bad72 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:46.762412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29b3dd29-2ea2-456b-8403-4f9e546bad72 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:46.763386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29b3dd29-2ea2-456b-8403-4f9e546bad72 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:46.764627 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29b3dd29-2ea2-456b-8403-4f9e546bad72 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:46.838627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e5039411-98e9-408c-86b6-5da7b91a3a3c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:46.852859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e5039411-98e9-408c-86b6-5da7b91a3a3c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:46.855493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e5039411-98e9-408c-86b6-5da7b91a3a3c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:46.860068 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e5039411-98e9-408c-86b6-5da7b91a3a3c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1415 microversion: 2.54 time: 0.365603 Oct 10 23:49:46.866450 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3043/5910] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:46 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1415 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:47.034788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-29b3dd29-2ea2-456b-8403-4f9e546bad72 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:47.045882 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-29b3dd29-2ea2-456b-8403-4f9e546bad72 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1666 microversion: 2.1 time: 0.318925 Oct 10 23:49:47.051016 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2868/5911] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:46 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1666 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:47.525797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-df26ee1f-f748-4f95-8742-e962880cb457 req-c3648812-8b40-4329-9dfe-cd9c2827711f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccbe503a-b7c8-4459-87d9-3655cd54bacb", "tag": "4528ff7b-3e24-4d58-a19b-e57043a8de5d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:49:47.560429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-df26ee1f-f748-4f95-8742-e962880cb457 req-c3648812-8b40-4329-9dfe-cd9c2827711f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:47.562512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-df26ee1f-f748-4f95-8742-e962880cb457 req-c3648812-8b40-4329-9dfe-cd9c2827711f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:47.563205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-df26ee1f-f748-4f95-8742-e962880cb457 req-c3648812-8b40-4329-9dfe-cd9c2827711f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:47.597668 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-df26ee1f-f748-4f95-8742-e962880cb457 req-c3648812-8b40-4329-9dfe-cd9c2827711f service nova] Creating event network-changed:4528ff7b-3e24-4d58-a19b-e57043a8de5d for instance ccbe503a-b7c8-4459-87d9-3655cd54bacb on n-h2-860864-2 Oct 10 23:49:47.610220 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-df26ee1f-f748-4f95-8742-e962880cb457 req-c3648812-8b40-4329-9dfe-cd9c2827711f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094752 Oct 10 23:49:47.611355 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3044/5912] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:49:47.752235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d02a5f6c-36e4-4a48-9645-5a586c31a34f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:47.753420 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d02a5f6c-36e4-4a48-9645-5a586c31a34f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:47.766612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d02a5f6c-36e4-4a48-9645-5a586c31a34f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:47.768308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d02a5f6c-36e4-4a48-9645-5a586c31a34f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:47.768990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d02a5f6c-36e4-4a48-9645-5a586c31a34f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:47.774450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d02a5f6c-36e4-4a48-9645-5a586c31a34f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:47.776134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d02a5f6c-36e4-4a48-9645-5a586c31a34f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:47.781648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d02a5f6c-36e4-4a48-9645-5a586c31a34f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:47.922778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ea25c3a6-b263-47d2-9eef-01a4986d6fdc tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:47.923924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ea25c3a6-b263-47d2-9eef-01a4986d6fdc tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:47.944672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea25c3a6-b263-47d2-9eef-01a4986d6fdc tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:47.947341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea25c3a6-b263-47d2-9eef-01a4986d6fdc tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:47.948190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea25c3a6-b263-47d2-9eef-01a4986d6fdc tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:47.953890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea25c3a6-b263-47d2-9eef-01a4986d6fdc tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:47.955525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea25c3a6-b263-47d2-9eef-01a4986d6fdc tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:47.956613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea25c3a6-b263-47d2-9eef-01a4986d6fdc tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:48.209024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d02a5f6c-36e4-4a48-9645-5a586c31a34f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:48.225063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ea25c3a6-b263-47d2-9eef-01a4986d6fdc tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:48.232149 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d02a5f6c-36e4-4a48-9645-5a586c31a34f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1392 microversion: 2.1 time: 0.478028 Oct 10 23:49:48.234083 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2869/5913] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:47 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1392 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:48.239179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4c328f1d-e4bb-4571-bbf1-2ca8dcc98188 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:48.240102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4c328f1d-e4bb-4571-bbf1-2ca8dcc98188 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:48.246755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c328f1d-e4bb-4571-bbf1-2ca8dcc98188 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:48.247522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c328f1d-e4bb-4571-bbf1-2ca8dcc98188 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:48.248200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c328f1d-e4bb-4571-bbf1-2ca8dcc98188 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:48.249168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c328f1d-e4bb-4571-bbf1-2ca8dcc98188 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:48.250552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c328f1d-e4bb-4571-bbf1-2ca8dcc98188 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:48.251240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c328f1d-e4bb-4571-bbf1-2ca8dcc98188 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:48.261891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ea25c3a6-b263-47d2-9eef-01a4986d6fdc tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:48.276659 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ea25c3a6-b263-47d2-9eef-01a4986d6fdc tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:48.290327 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ea25c3a6-b263-47d2-9eef-01a4986d6fdc tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1415 microversion: 2.54 time: 0.377117 Oct 10 23:49:48.297995 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3045/5914] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:47 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1415 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:48.706067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4c328f1d-e4bb-4571-bbf1-2ca8dcc98188 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:48.722279 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4c328f1d-e4bb-4571-bbf1-2ca8dcc98188 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1666 microversion: 2.1 time: 0.486765 Oct 10 23:49:48.724319 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2870/5915] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:48 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1666 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:49.260725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-057c67e5-11b0-454e-90c5-3fe84656aa0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:49.261363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-057c67e5-11b0-454e-90c5-3fe84656aa0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:49.280515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-057c67e5-11b0-454e-90c5-3fe84656aa0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:49.284790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-057c67e5-11b0-454e-90c5-3fe84656aa0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:49.285674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-057c67e5-11b0-454e-90c5-3fe84656aa0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:49.290716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-057c67e5-11b0-454e-90c5-3fe84656aa0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:49.291500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-057c67e5-11b0-454e-90c5-3fe84656aa0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:49.296278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-057c67e5-11b0-454e-90c5-3fe84656aa0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:49.375443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-77d4b037-28cf-4af9-84e2-d72c66476bef tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:49.378907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-77d4b037-28cf-4af9-84e2-d72c66476bef tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:49.397614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77d4b037-28cf-4af9-84e2-d72c66476bef tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:49.398371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77d4b037-28cf-4af9-84e2-d72c66476bef tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:49.402520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77d4b037-28cf-4af9-84e2-d72c66476bef tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:49.404084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77d4b037-28cf-4af9-84e2-d72c66476bef tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:49.405044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77d4b037-28cf-4af9-84e2-d72c66476bef tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:49.405959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77d4b037-28cf-4af9-84e2-d72c66476bef tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:49.621488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-77d4b037-28cf-4af9-84e2-d72c66476bef tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:49.650333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-77d4b037-28cf-4af9-84e2-d72c66476bef tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:49.658505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-77d4b037-28cf-4af9-84e2-d72c66476bef tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:49.663472 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-77d4b037-28cf-4af9-84e2-d72c66476bef tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1415 microversion: 2.54 time: 0.308974 Oct 10 23:49:49.664118 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2871/5916] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:49 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1415 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 23:49:49.756989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fae916a1-9df7-4aa9-87ec-45ec94ae169b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:49.757906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fae916a1-9df7-4aa9-87ec-45ec94ae169b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:49.808412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fae916a1-9df7-4aa9-87ec-45ec94ae169b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:49.829093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fae916a1-9df7-4aa9-87ec-45ec94ae169b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:49.829617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fae916a1-9df7-4aa9-87ec-45ec94ae169b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:49.835521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fae916a1-9df7-4aa9-87ec-45ec94ae169b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:49.844391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fae916a1-9df7-4aa9-87ec-45ec94ae169b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:49.849650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fae916a1-9df7-4aa9-87ec-45ec94ae169b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:50.012332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-057c67e5-11b0-454e-90c5-3fe84656aa0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:50.021644 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-057c67e5-11b0-454e-90c5-3fe84656aa0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1392 microversion: 2.1 time: 0.764761 Oct 10 23:49:50.041791 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3046/5917] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:49 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1392 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:50.141690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fae916a1-9df7-4aa9-87ec-45ec94ae169b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:50.150785 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fae916a1-9df7-4aa9-87ec-45ec94ae169b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1666 microversion: 2.1 time: 0.400269 Oct 10 23:49:50.162070 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2872/5918] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:49 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1666 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:50.699496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1b2e98fb-a16d-47ab-ae8d-f0241172b325 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:50.700704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1b2e98fb-a16d-47ab-ae8d-f0241172b325 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:50.721507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b2e98fb-a16d-47ab-ae8d-f0241172b325 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:50.722369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b2e98fb-a16d-47ab-ae8d-f0241172b325 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:50.725048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b2e98fb-a16d-47ab-ae8d-f0241172b325 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:50.726324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b2e98fb-a16d-47ab-ae8d-f0241172b325 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:50.728479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b2e98fb-a16d-47ab-ae8d-f0241172b325 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:50.729285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b2e98fb-a16d-47ab-ae8d-f0241172b325 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:50.870689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1b2e98fb-a16d-47ab-ae8d-f0241172b325 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:50.919218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1b2e98fb-a16d-47ab-ae8d-f0241172b325 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:50.922451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1b2e98fb-a16d-47ab-ae8d-f0241172b325 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:50.923943 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1b2e98fb-a16d-47ab-ae8d-f0241172b325 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1400 microversion: 2.54 time: 0.231800 Oct 10 23:49:50.939834 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3047/5919] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:50 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1400 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:50.956510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-63a9e936-bb9e-4ff1-a4ee-94ca99ac3ce9 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '.version_select at 0x7f662a297670>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:50.998058 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-63a9e936-bb9e-4ff1-a4ee-94ca99ac3ce9 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1936909953" status: 204 len: 0 microversion: 2.54 time: 0.045900 Oct 10 23:49:50.999819 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2873/5920] 10.222.0.23 () {60 vars in 1319 bytes} [Mon Oct 10 23:49:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1936909953 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:49:51.035823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d05f10ea-7839-4d5d-ba0c-bcd002ef815c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:51.036907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d05f10ea-7839-4d5d-ba0c-bcd002ef815c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:51.052502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f00d84e3-c626-4f25-8efb-e7cfe2a03c75 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:51.053512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f00d84e3-c626-4f25-8efb-e7cfe2a03c75 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:51.061553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f00d84e3-c626-4f25-8efb-e7cfe2a03c75 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:51.062145 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f00d84e3-c626-4f25-8efb-e7cfe2a03c75 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:51.062424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f00d84e3-c626-4f25-8efb-e7cfe2a03c75 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:51.063122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f00d84e3-c626-4f25-8efb-e7cfe2a03c75 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:51.063571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f00d84e3-c626-4f25-8efb-e7cfe2a03c75 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:51.063994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f00d84e3-c626-4f25-8efb-e7cfe2a03c75 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:51.071266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:49:51.073225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d05f10ea-7839-4d5d-ba0c-bcd002ef815c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:51.074228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d05f10ea-7839-4d5d-ba0c-bcd002ef815c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:51.081806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d05f10ea-7839-4d5d-ba0c-bcd002ef815c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:51.082666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d05f10ea-7839-4d5d-ba0c-bcd002ef815c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:51.083454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d05f10ea-7839-4d5d-ba0c-bcd002ef815c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:51.083713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d05f10ea-7839-4d5d-ba0c-bcd002ef815c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:51.171574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d05f10ea-7839-4d5d-ba0c-bcd002ef815c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:49:51.307832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f00d84e3-c626-4f25-8efb-e7cfe2a03c75 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:51.334795 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f00d84e3-c626-4f25-8efb-e7cfe2a03c75 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1392 microversion: 2.1 time: 0.286071 Oct 10 23:49:51.368950 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2874/5921] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:51 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1392 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:49:51.380584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3879b22b-5dd4-439f-b802-ffb28ac5264b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:51.381205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3879b22b-5dd4-439f-b802-ffb28ac5264b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:51.393782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3879b22b-5dd4-439f-b802-ffb28ac5264b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:51.394281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3879b22b-5dd4-439f-b802-ffb28ac5264b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:51.394717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3879b22b-5dd4-439f-b802-ffb28ac5264b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:51.395609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3879b22b-5dd4-439f-b802-ffb28ac5264b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:51.395915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3879b22b-5dd4-439f-b802-ffb28ac5264b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:51.396338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3879b22b-5dd4-439f-b802-ffb28ac5264b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:51.446600 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d05f10ea-7839-4d5d-ba0c-bcd002ef815c tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 204 len: 0 microversion: 2.54 time: 0.415622 Oct 10 23:49:51.453674 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3048/5922] 10.222.0.23 () {60 vars in 1280 bytes} [Mon Oct 10 23:49:51 2022] DELETE /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 23:49:51.463117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f6aed60e-c345-4681-a0e7-6f71333069d2 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:51.463829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f6aed60e-c345-4681-a0e7-6f71333069d2 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:51.479654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:49:51.481868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6aed60e-c345-4681-a0e7-6f71333069d2 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:51.484985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6aed60e-c345-4681-a0e7-6f71333069d2 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:51.485444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6aed60e-c345-4681-a0e7-6f71333069d2 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:51.486880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6aed60e-c345-4681-a0e7-6f71333069d2 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:51.486880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6aed60e-c345-4681-a0e7-6f71333069d2 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:51.487059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6aed60e-c345-4681-a0e7-6f71333069d2 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:51.560382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:49:51.725805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f6aed60e-c345-4681-a0e7-6f71333069d2 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:51.757947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f6aed60e-c345-4681-a0e7-6f71333069d2 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:51.760196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f6aed60e-c345-4681-a0e7-6f71333069d2 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:51.760475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3879b22b-5dd4-439f-b802-ffb28ac5264b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:51.761632 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f6aed60e-c345-4681-a0e7-6f71333069d2 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1406 microversion: 2.54 time: 0.306128 Oct 10 23:49:51.762702 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3049/5923] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:51 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1406 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:51.790259 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3879b22b-5dd4-439f-b802-ffb28ac5264b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.415546 Oct 10 23:49:51.791450 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2875/5924] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:51 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:51.825029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-45089113-713e-42b8-8cea-b3c8a197abcd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:51.826005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-45089113-713e-42b8-8cea-b3c8a197abcd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:51.834823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45089113-713e-42b8-8cea-b3c8a197abcd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:51.835628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45089113-713e-42b8-8cea-b3c8a197abcd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:51.836219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45089113-713e-42b8-8cea-b3c8a197abcd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:51.837080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45089113-713e-42b8-8cea-b3c8a197abcd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:51.837765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45089113-713e-42b8-8cea-b3c8a197abcd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:51.838569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45089113-713e-42b8-8cea-b3c8a197abcd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:52.256769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-45089113-713e-42b8-8cea-b3c8a197abcd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:52.267591 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-45089113-713e-42b8-8cea-b3c8a197abcd tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.447053 Oct 10 23:49:52.268388 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3050/5925] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:51 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:52.293852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-917eb16e-f1af-4a51-8ecf-56609839f0af tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:52.294467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-917eb16e-f1af-4a51-8ecf-56609839f0af tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:52.305590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-917eb16e-f1af-4a51-8ecf-56609839f0af tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:52.308275 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-917eb16e-f1af-4a51-8ecf-56609839f0af tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:52.309015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-917eb16e-f1af-4a51-8ecf-56609839f0af tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:52.310676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-917eb16e-f1af-4a51-8ecf-56609839f0af tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:52.313966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-917eb16e-f1af-4a51-8ecf-56609839f0af tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:52.314689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-917eb16e-f1af-4a51-8ecf-56609839f0af tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:52.377037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b48914b3-8ef9-4cdd-89a4-25dd23ab54fc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:52.378365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b48914b3-8ef9-4cdd-89a4-25dd23ab54fc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:52.402406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b48914b3-8ef9-4cdd-89a4-25dd23ab54fc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:52.402406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b48914b3-8ef9-4cdd-89a4-25dd23ab54fc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:52.402406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b48914b3-8ef9-4cdd-89a4-25dd23ab54fc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:52.408731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b48914b3-8ef9-4cdd-89a4-25dd23ab54fc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:52.409690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b48914b3-8ef9-4cdd-89a4-25dd23ab54fc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:52.410173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b48914b3-8ef9-4cdd-89a4-25dd23ab54fc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:52.679888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-917eb16e-f1af-4a51-8ecf-56609839f0af tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:52.689194 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-917eb16e-f1af-4a51-8ecf-56609839f0af tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.399135 Oct 10 23:49:52.690394 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2876/5926] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:52 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:52.720111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a996c524-beeb-4719-9ef7-e082d73004cf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:52.721183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a996c524-beeb-4719-9ef7-e082d73004cf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:52.744867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a996c524-beeb-4719-9ef7-e082d73004cf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:52.745358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a996c524-beeb-4719-9ef7-e082d73004cf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:52.747697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a996c524-beeb-4719-9ef7-e082d73004cf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:52.748458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a996c524-beeb-4719-9ef7-e082d73004cf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:52.749699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a996c524-beeb-4719-9ef7-e082d73004cf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:52.753980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a996c524-beeb-4719-9ef7-e082d73004cf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:52.800902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b48914b3-8ef9-4cdd-89a4-25dd23ab54fc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:52.811682 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b48914b3-8ef9-4cdd-89a4-25dd23ab54fc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1392 microversion: 2.1 time: 0.440365 Oct 10 23:49:52.814658 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3051/5927] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:52 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1392 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:49:52.824763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c36dd4ca-96b7-4a09-ae9b-e4fd7266ff94 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:52.833877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c36dd4ca-96b7-4a09-ae9b-e4fd7266ff94 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:52.841309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c36dd4ca-96b7-4a09-ae9b-e4fd7266ff94 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:52.842063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c36dd4ca-96b7-4a09-ae9b-e4fd7266ff94 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:52.842745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c36dd4ca-96b7-4a09-ae9b-e4fd7266ff94 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:52.843625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c36dd4ca-96b7-4a09-ae9b-e4fd7266ff94 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:52.844245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c36dd4ca-96b7-4a09-ae9b-e4fd7266ff94 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:52.845366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c36dd4ca-96b7-4a09-ae9b-e4fd7266ff94 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:53.025529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a996c524-beeb-4719-9ef7-e082d73004cf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:53.051114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c36dd4ca-96b7-4a09-ae9b-e4fd7266ff94 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:53.051475 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a996c524-beeb-4719-9ef7-e082d73004cf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.337831 Oct 10 23:49:53.052383 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2877/5928] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:52 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:53.061457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c36dd4ca-96b7-4a09-ae9b-e4fd7266ff94 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:53.062990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c36dd4ca-96b7-4a09-ae9b-e4fd7266ff94 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:53.064193 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c36dd4ca-96b7-4a09-ae9b-e4fd7266ff94 tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1406 microversion: 2.54 time: 0.244822 Oct 10 23:49:53.064769 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3052/5929] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:52 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:53.095281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-67e04543-c6a9-4f94-b537-8cbdb75aef56 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:53.096287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-67e04543-c6a9-4f94-b537-8cbdb75aef56 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:53.111495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67e04543-c6a9-4f94-b537-8cbdb75aef56 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:53.112088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67e04543-c6a9-4f94-b537-8cbdb75aef56 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:53.112961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67e04543-c6a9-4f94-b537-8cbdb75aef56 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:53.114381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67e04543-c6a9-4f94-b537-8cbdb75aef56 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:53.116648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67e04543-c6a9-4f94-b537-8cbdb75aef56 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:53.116648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67e04543-c6a9-4f94-b537-8cbdb75aef56 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:53.141987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-ce972db5-f58c-4939-bde8-3891d4f92a6e req-6607ae59-c2a3-4fa5-988a-d8fef0befa9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbe503a-b7c8-4459-87d9-3655cd54bacb", "name": "network-vif-plugged", "status": "completed", "tag": "4528ff7b-3e24-4d58-a19b-e57043a8de5d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:49:53.167905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ce972db5-f58c-4939-bde8-3891d4f92a6e req-6607ae59-c2a3-4fa5-988a-d8fef0befa9a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:53.181973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ce972db5-f58c-4939-bde8-3891d4f92a6e req-6607ae59-c2a3-4fa5-988a-d8fef0befa9a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:53.182637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ce972db5-f58c-4939-bde8-3891d4f92a6e req-6607ae59-c2a3-4fa5-988a-d8fef0befa9a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:53.222900 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-ce972db5-f58c-4939-bde8-3891d4f92a6e req-6607ae59-c2a3-4fa5-988a-d8fef0befa9a service nova] Creating event network-vif-plugged:4528ff7b-3e24-4d58-a19b-e57043a8de5d for instance ccbe503a-b7c8-4459-87d9-3655cd54bacb on n-h2-860864-2 Oct 10 23:49:53.247025 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-ce972db5-f58c-4939-bde8-3891d4f92a6e req-6607ae59-c2a3-4fa5-988a-d8fef0befa9a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109554 Oct 10 23:49:53.265122 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3053/5930] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:49:53.422010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-67e04543-c6a9-4f94-b537-8cbdb75aef56 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:53.439413 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-67e04543-c6a9-4f94-b537-8cbdb75aef56 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.349382 Oct 10 23:49:53.442727 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2878/5931] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:53 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:53.465743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8a56a463-1097-40ab-9bfa-6efdfe58b570 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:49:53.466766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8a56a463-1097-40ab-9bfa-6efdfe58b570 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:53.475362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a56a463-1097-40ab-9bfa-6efdfe58b570 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:53.476079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a56a463-1097-40ab-9bfa-6efdfe58b570 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:53.476980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a56a463-1097-40ab-9bfa-6efdfe58b570 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:53.478121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a56a463-1097-40ab-9bfa-6efdfe58b570 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:53.478815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a56a463-1097-40ab-9bfa-6efdfe58b570 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:53.479459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a56a463-1097-40ab-9bfa-6efdfe58b570 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:53.515936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-8a56a463-1097-40ab-9bfa-6efdfe58b570 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lazy-loading 'flavor' on Instance uuid 88c65eb2-4a59-4b1e-bf11-e2094d984d0a {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:49:53.627369 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8a56a463-1097-40ab-9bfa-6efdfe58b570 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action" status: 202 len: 0 microversion: 2.1 time: 0.164477 Oct 10 23:49:53.630879 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3054/5932] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:49:53 2022] POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:49:53.637196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-30e6d567-25e9-4631-9b2d-81223b6e301e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:53.638541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-30e6d567-25e9-4631-9b2d-81223b6e301e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:53.662949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30e6d567-25e9-4631-9b2d-81223b6e301e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:53.663621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30e6d567-25e9-4631-9b2d-81223b6e301e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:53.664329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30e6d567-25e9-4631-9b2d-81223b6e301e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:53.671633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30e6d567-25e9-4631-9b2d-81223b6e301e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:53.674786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30e6d567-25e9-4631-9b2d-81223b6e301e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:53.675528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30e6d567-25e9-4631-9b2d-81223b6e301e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:53.838815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-84c19ce9-2f9b-488f-9eac-353ab1d0b8cc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:53.840254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-84c19ce9-2f9b-488f-9eac-353ab1d0b8cc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:53.850898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84c19ce9-2f9b-488f-9eac-353ab1d0b8cc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:53.857148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84c19ce9-2f9b-488f-9eac-353ab1d0b8cc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:53.859975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84c19ce9-2f9b-488f-9eac-353ab1d0b8cc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:53.863353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84c19ce9-2f9b-488f-9eac-353ab1d0b8cc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:53.864473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84c19ce9-2f9b-488f-9eac-353ab1d0b8cc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:53.867293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84c19ce9-2f9b-488f-9eac-353ab1d0b8cc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:54.095157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-30e6d567-25e9-4631-9b2d-81223b6e301e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:54.106421 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-30e6d567-25e9-4631-9b2d-81223b6e301e tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1678 microversion: 2.1 time: 0.472999 Oct 10 23:49:54.107040 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2879/5933] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:53 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1678 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:49:54.115104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3e33eca0-008c-4c36-85af-24d6acae71ab tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:54.116158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3e33eca0-008c-4c36-85af-24d6acae71ab tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:54.126808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e33eca0-008c-4c36-85af-24d6acae71ab tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:54.127577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e33eca0-008c-4c36-85af-24d6acae71ab tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:54.129183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e33eca0-008c-4c36-85af-24d6acae71ab tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:54.130220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e33eca0-008c-4c36-85af-24d6acae71ab tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:54.130854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e33eca0-008c-4c36-85af-24d6acae71ab tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:54.132292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e33eca0-008c-4c36-85af-24d6acae71ab tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:54.183120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e33eca0-008c-4c36-85af-24d6acae71ab tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:54.184023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e33eca0-008c-4c36-85af-24d6acae71ab tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:54.184683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e33eca0-008c-4c36-85af-24d6acae71ab tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:54.185401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-3e33eca0-008c-4c36-85af-24d6acae71ab tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lazy-loading 'fault' on Instance uuid fa312a4b-8fb8-431d-8079-b5203d441a11 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:49:54.266845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3e33eca0-008c-4c36-85af-24d6acae71ab tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:54.284983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3e33eca0-008c-4c36-85af-24d6acae71ab tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:54.289503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3e33eca0-008c-4c36-85af-24d6acae71ab tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6da1f2226c43442c9a65b0b7b1b4395f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67236ed6eb974ea6866c0aaddcc69179', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:54.293588 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3e33eca0-008c-4c36-85af-24d6acae71ab tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 200 len: 1411 microversion: 2.54 time: 0.184694 Oct 10 23:49:54.295817 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2880/5934] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:54 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 1411 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 23:49:54.520856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-84c19ce9-2f9b-488f-9eac-353ab1d0b8cc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:54.532493 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-84c19ce9-2f9b-488f-9eac-353ab1d0b8cc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1392 microversion: 2.1 time: 0.698771 Oct 10 23:49:54.533543 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3055/5935] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:53 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1392 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:49:55.140706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9f926093-aeeb-4e05-8798-4a905d633456 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:55.142319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9f926093-aeeb-4e05-8798-4a905d633456 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:55.167269 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f926093-aeeb-4e05-8798-4a905d633456 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:55.167890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f926093-aeeb-4e05-8798-4a905d633456 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:55.168933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f926093-aeeb-4e05-8798-4a905d633456 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:55.173601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f926093-aeeb-4e05-8798-4a905d633456 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:55.175050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f926093-aeeb-4e05-8798-4a905d633456 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:55.177124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f926093-aeeb-4e05-8798-4a905d633456 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:55.336327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4ba8665b-d801-4241-bb96-0e785ff9827a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:55.337574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4ba8665b-d801-4241-bb96-0e785ff9827a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] [instance: fa312a4b-8fb8-431d-8079-b5203d441a11] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:55.376282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ba8665b-d801-4241-bb96-0e785ff9827a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:55.378403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ba8665b-d801-4241-bb96-0e785ff9827a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:55.379913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ba8665b-d801-4241-bb96-0e785ff9827a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:55.383938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ba8665b-d801-4241-bb96-0e785ff9827a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:55.384887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ba8665b-d801-4241-bb96-0e785ff9827a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:55.386581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ba8665b-d801-4241-bb96-0e785ff9827a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:55.463685 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-4ba8665b-d801-4241-bb96-0e785ff9827a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] HTTP exception thrown: Instance fa312a4b-8fb8-431d-8079-b5203d441a11 could not be found. Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4ba8665b-d801-4241-bb96-0e785ff9827a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Request method failure captured: Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 HTTP/1.1 Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK9zoZqhsbUqph4d1kMhhYO3lauDHPXpW-pBvYT85rFpdmqHdqAvNzPkOYabWQp5qtppRZyISwG1h-WkPwTf--2pyCUS3UB89zFHZvDY-7fqadmTI6-H6wi401GucoOScfV01AjoYuXswkX_zlJ-oJghbb3AIc3-bWdz6RUfWes4aKM Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: X-Openstack-Nova-Api-Version: 2.54 Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 67236ed6eb974ea6866c0aaddcc69179 Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerShowV254Test-645970132 Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/67236ed6eb974ea6866c0aaddcc69179"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/67236ed6eb974ea6866c0aaddcc69179"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/67236ed6eb974ea6866c0aaddcc69179"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_67236ed6eb974ea6866c0aaddcc69179", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerShowV254Test-645970132 Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 67236ed6eb974ea6866c0aaddcc69179 Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerShowV254Test-645970132 Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerShowV254Test-645970132-project Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 6da1f2226c43442c9a65b0b7b1b4395f Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerShowV254Test-645970132-project Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance fa312a4b-8fb8-431d-8079-b5203d441a11 could not be found. Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'fa312a4b-8fb8-431d-8079-b5203d441a11'} Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa312a4b-8fb8-431d-8079-b5203d441a11 could not be found. Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa312a4b-8fb8-431d-8079-b5203d441a11 could not be found. Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:49:55.473060 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:49:55.478272 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:49:55.478272 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:49:55.478272 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:49:55.478272 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:49:55.478272 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:49:55.478272 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa312a4b-8fb8-431d-8079-b5203d441a11 could not be found. Oct 10 23:49:55.478272 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:49:55.478272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4ba8665b-d801-4241-bb96-0e785ff9827a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] Returning 404 to user: Instance fa312a4b-8fb8-431d-8079-b5203d441a11 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:49:55.478272 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4ba8665b-d801-4241-bb96-0e785ff9827a tempest-ServerShowV254Test-645970132 tempest-ServerShowV254Test-645970132-project] 10.222.0.23 "GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11" status: 404 len: 111 microversion: 2.54 time: 0.148628 Oct 10 23:49:55.481400 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3056/5936] 10.222.0.23 () {60 vars in 1277 bytes} [Mon Oct 10 23:49:55 2022] GET /compute/v2.1/servers/fa312a4b-8fb8-431d-8079-b5203d441a11 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:49:55.560660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b47d4d6d-c828-4c7b-a80d-31ebd7cb56af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:55.562390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b47d4d6d-c828-4c7b-a80d-31ebd7cb56af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:55.590509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b47d4d6d-c828-4c7b-a80d-31ebd7cb56af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:55.591682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b47d4d6d-c828-4c7b-a80d-31ebd7cb56af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:55.597259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b47d4d6d-c828-4c7b-a80d-31ebd7cb56af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:55.600774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b47d4d6d-c828-4c7b-a80d-31ebd7cb56af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:55.601141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b47d4d6d-c828-4c7b-a80d-31ebd7cb56af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:55.607744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b47d4d6d-c828-4c7b-a80d-31ebd7cb56af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:55.701406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9f926093-aeeb-4e05-8798-4a905d633456 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:55.719825 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9f926093-aeeb-4e05-8798-4a905d633456 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1661 microversion: 2.1 time: 0.585139 Oct 10 23:49:55.725204 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2881/5937] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:55 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1661 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:55.751232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-acf6afca-4a58-4868-bf68-cb64063578eb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:49:55.753478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-acf6afca-4a58-4868-bf68-cb64063578eb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:55.761606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf6afca-4a58-4868-bf68-cb64063578eb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:55.762785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf6afca-4a58-4868-bf68-cb64063578eb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:55.764172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf6afca-4a58-4868-bf68-cb64063578eb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:55.765281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf6afca-4a58-4868-bf68-cb64063578eb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:55.766872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf6afca-4a58-4868-bf68-cb64063578eb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:55.770716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acf6afca-4a58-4868-bf68-cb64063578eb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:55.777657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:49:55.926820 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-acf6afca-4a58-4868-bf68-cb64063578eb tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action" status: 202 len: 0 microversion: 2.1 time: 0.179305 Oct 10 23:49:55.928169 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2882/5938] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:49:55 2022] POST /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 23:49:55.938453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9551a315-452f-4530-8159-4bc869f63f97 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:55.939590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9551a315-452f-4530-8159-4bc869f63f97 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:55.953404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9551a315-452f-4530-8159-4bc869f63f97 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:55.954280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9551a315-452f-4530-8159-4bc869f63f97 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:55.954887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9551a315-452f-4530-8159-4bc869f63f97 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:55.955973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9551a315-452f-4530-8159-4bc869f63f97 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:55.956441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9551a315-452f-4530-8159-4bc869f63f97 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:55.956912 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9551a315-452f-4530-8159-4bc869f63f97 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:56.278787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9551a315-452f-4530-8159-4bc869f63f97 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:56.291967 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9551a315-452f-4530-8159-4bc869f63f97 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1667 microversion: 2.1 time: 0.358923 Oct 10 23:49:56.292941 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2883/5939] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:55 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1667 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:49:56.661017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b47d4d6d-c828-4c7b-a80d-31ebd7cb56af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:56.670833 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b47d4d6d-c828-4c7b-a80d-31ebd7cb56af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1564 microversion: 2.1 time: 1.117851 Oct 10 23:49:56.676036 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3057/5940] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:55 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1564 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:56.698461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-da0aeac0-f812-4efc-afd8-6691aafd6241 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:56.699283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-da0aeac0-f812-4efc-afd8-6691aafd6241 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:56.713104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da0aeac0-f812-4efc-afd8-6691aafd6241 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:56.713754 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da0aeac0-f812-4efc-afd8-6691aafd6241 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:56.714289 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da0aeac0-f812-4efc-afd8-6691aafd6241 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:56.715442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da0aeac0-f812-4efc-afd8-6691aafd6241 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:56.718896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da0aeac0-f812-4efc-afd8-6691aafd6241 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:56.719645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da0aeac0-f812-4efc-afd8-6691aafd6241 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:57.239468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-da0aeac0-f812-4efc-afd8-6691aafd6241 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:57.253730 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-da0aeac0-f812-4efc-afd8-6691aafd6241 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1564 microversion: 2.1 time: 0.558982 Oct 10 23:49:57.258901 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2884/5941] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:56 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1564 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:49:57.319144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-39d422a8-c3e9-4396-a218-5d53b2268f9f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:57.320175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-39d422a8-c3e9-4396-a218-5d53b2268f9f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:57.333335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39d422a8-c3e9-4396-a218-5d53b2268f9f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:57.336977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39d422a8-c3e9-4396-a218-5d53b2268f9f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:57.338954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39d422a8-c3e9-4396-a218-5d53b2268f9f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:57.341538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39d422a8-c3e9-4396-a218-5d53b2268f9f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:57.342540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39d422a8-c3e9-4396-a218-5d53b2268f9f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:57.343466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39d422a8-c3e9-4396-a218-5d53b2268f9f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:58.163753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-39d422a8-c3e9-4396-a218-5d53b2268f9f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:58.181153 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-39d422a8-c3e9-4396-a218-5d53b2268f9f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1667 microversion: 2.1 time: 0.863497 Oct 10 23:49:58.181853 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3058/5942] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:57 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1667 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:49:59.205527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7e53ac88-9fc8-4814-9787-8953b2987daf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:59.206152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7e53ac88-9fc8-4814-9787-8953b2987daf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:59.216177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e53ac88-9fc8-4814-9787-8953b2987daf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:59.226171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e53ac88-9fc8-4814-9787-8953b2987daf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:59.227436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e53ac88-9fc8-4814-9787-8953b2987daf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:59.228571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e53ac88-9fc8-4814-9787-8953b2987daf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:59.232346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e53ac88-9fc8-4814-9787-8953b2987daf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:59.233982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e53ac88-9fc8-4814-9787-8953b2987daf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:59.704160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7e53ac88-9fc8-4814-9787-8953b2987daf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:49:59.718068 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7e53ac88-9fc8-4814-9787-8953b2987daf tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.517772 Oct 10 23:49:59.718661 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2885/5943] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:59 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:49:59.719328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-db02b60c-55a5-4717-bb30-41547d0e3cdf tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] Action: 'create', calling method: .version_select at 0x7f662b027700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-977070818", "metadata": {"Type": "work"}}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-db02b60c-55a5-4717-bb30-41547d0e3cdf tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] Request method failure captured: Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 121 Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK-nnZ-8GcFSKdtv7Mv7XnTDIOwECxrlpYSSEXjkIka8jxb3uRQ616blzkvCxmfVgQSkBiSTz7Wv8pFR1TTt4uAl_IlEKLrEO_gKDCccGlk7mx0LOavksW_pZWTD9QbuLKYWsgFUvPoYOXdRKAyZhUibHWyuY9Nx09y6hnLlE_N7jCk Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: f898568b18ba4b38b5b0e614b323fcc0 Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-VolumesNegativeTest-332283320 Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f898568b18ba4b38b5b0e614b323fcc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f898568b18ba4b38b5b0e614b323fcc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f898568b18ba4b38b5b0e614b323fcc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f898568b18ba4b38b5b0e614b323fcc0", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-VolumesNegativeTest-332283320 Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: f898568b18ba4b38b5b0e614b323fcc0 Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-VolumesNegativeTest-332283320 Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-VolumesNegativeTest-332283320-project Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 057745ff31e04824803539505048fe4e Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-VolumesNegativeTest-332283320-project Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-977070818", "metadata": {"Type": "work"}}} Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: method: Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-977070818', 'metadata': {'Type': 'work'}}}} Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi '#$%' Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:49:59.723879 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:49:59.728871 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 10 23:49:59.728871 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.728871 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:49:59.728871 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.728871 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:49:59.728871 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:49:59.728871 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:49:59.728871 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:49:59.728871 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:49:59.728871 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 10 23:49:59.728871 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.729893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-db02b60c-55a5-4717-bb30-41547d0e3cdf tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:49:59.730778 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-db02b60c-55a5-4717-bb30-41547d0e3cdf tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.286983 Oct 10 23:49:59.736793 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3059/5944] 10.222.0.23 () {60 vars in 1156 bytes} [Mon Oct 10 23:49:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 293 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:49:59.745089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d3a74cb9-35c7-4033-af6a-b19c08aeb2b6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:59.756509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d3a74cb9-35c7-4033-af6a-b19c08aeb2b6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:49:59.756754 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9d55efaf-1cb6-4d4c-861b-f0770e461281 tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] Action: 'create', calling method: .version_select at 0x7f662a297670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1265879420", "metadata": {"Type": "work"}}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9d55efaf-1cb6-4d4c-861b-f0770e461281 tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] Request method failure captured: Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 120 Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK-nnZ-8GcFSKdtv7Mv7XnTDIOwECxrlpYSSEXjkIka8jxb3uRQ616blzkvCxmfVgQSkBiSTz7Wv8pFR1TTt4uAl_IlEKLrEO_gKDCccGlk7mx0LOavksW_pZWTD9QbuLKYWsgFUvPoYOXdRKAyZhUibHWyuY9Nx09y6hnLlE_N7jCk Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: f898568b18ba4b38b5b0e614b323fcc0 Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-VolumesNegativeTest-332283320 Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f898568b18ba4b38b5b0e614b323fcc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f898568b18ba4b38b5b0e614b323fcc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f898568b18ba4b38b5b0e614b323fcc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f898568b18ba4b38b5b0e614b323fcc0", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-VolumesNegativeTest-332283320 Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: f898568b18ba4b38b5b0e614b323fcc0 Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-VolumesNegativeTest-332283320 Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-VolumesNegativeTest-332283320-project Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 057745ff31e04824803539505048fe4e Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-VolumesNegativeTest-332283320-project Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1265879420", "metadata": {"Type": "work"}}} Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1265879420', 'metadata': {'Type': 'work'}}}} Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi '0' Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:49:59.760857 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:49:59.766497 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 10 23:49:59.766497 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.766497 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:49:59.766497 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.766497 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:49:59.766497 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:49:59.766497 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:49:59.766497 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:49:59.766497 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:49:59.766497 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 10 23:49:59.766497 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.767283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3a74cb9-35c7-4033-af6a-b19c08aeb2b6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:59.767283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3a74cb9-35c7-4033-af6a-b19c08aeb2b6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:59.767283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3a74cb9-35c7-4033-af6a-b19c08aeb2b6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:59.767283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3a74cb9-35c7-4033-af6a-b19c08aeb2b6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:49:59.767283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3a74cb9-35c7-4033-af6a-b19c08aeb2b6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:49:59.767969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3a74cb9-35c7-4033-af6a-b19c08aeb2b6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:49:59.770900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9d55efaf-1cb6-4d4c-861b-f0770e461281 tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:49:59.771970 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9d55efaf-1cb6-4d4c-861b-f0770e461281 tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.030762 Oct 10 23:49:59.772559 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2886/5945] 10.222.0.23 () {60 vars in 1156 bytes} [Mon Oct 10 23:49:59 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:49:59.782585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-de2f598b-a5d3-4fad-9163-ab0144f238ef tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] Action: 'create', calling method: .version_select at 0x7f662a25cee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-681308947", "metadata": {"Type": "work"}}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-de2f598b-a5d3-4fad-9163-ab0144f238ef tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] Request method failure captured: Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 118 Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK-nnZ-8GcFSKdtv7Mv7XnTDIOwECxrlpYSSEXjkIka8jxb3uRQ616blzkvCxmfVgQSkBiSTz7Wv8pFR1TTt4uAl_IlEKLrEO_gKDCccGlk7mx0LOavksW_pZWTD9QbuLKYWsgFUvPoYOXdRKAyZhUibHWyuY9Nx09y6hnLlE_N7jCk Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: f898568b18ba4b38b5b0e614b323fcc0 Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-VolumesNegativeTest-332283320 Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f898568b18ba4b38b5b0e614b323fcc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f898568b18ba4b38b5b0e614b323fcc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f898568b18ba4b38b5b0e614b323fcc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f898568b18ba4b38b5b0e614b323fcc0", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-VolumesNegativeTest-332283320 Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: f898568b18ba4b38b5b0e614b323fcc0 Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-VolumesNegativeTest-332283320 Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-VolumesNegativeTest-332283320-project Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 057745ff31e04824803539505048fe4e Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-VolumesNegativeTest-332283320-project Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-681308947", "metadata": {"Type": "work"}}} Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-681308947', 'metadata': {'Type': 'work'}}}} Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi '' Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 23:49:59.798136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 23:49:59.803759 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 10 23:49:59.803759 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.803759 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:49:59.803759 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.803759 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:49:59.803759 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:49:59.803759 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:49:59.803759 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 23:49:59.803759 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 23:49:59.803759 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 10 23:49:59.803759 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.805987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-de2f598b-a5d3-4fad-9163-ab0144f238ef tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:49:59.807071 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-de2f598b-a5d3-4fad-9163-ab0144f238ef tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.028648 Oct 10 23:49:59.807870 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2887/5946] 10.222.0.23 () {60 vars in 1156 bytes} [Mon Oct 10 23:49:59 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 23:49:59.824424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3cf5a7c9-0d59-48fa-8a79-bdb55f481ca7 tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] Calling method '.version_select at 0x7f662a28b3a0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:59.874403 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-3cf5a7c9-0d59-48fa-8a79-bdb55f481ca7 tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] HTTP exception thrown: Volume tempest-invalid-494309415 could not be found. Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3cf5a7c9-0d59-48fa-8a79-bdb55f481ca7 tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] Request method failure captured: Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-494309415 HTTP/1.1 Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK-nnZ-8GcFSKdtv7Mv7XnTDIOwECxrlpYSSEXjkIka8jxb3uRQ616blzkvCxmfVgQSkBiSTz7Wv8pFR1TTt4uAl_IlEKLrEO_gKDCccGlk7mx0LOavksW_pZWTD9QbuLKYWsgFUvPoYOXdRKAyZhUibHWyuY9Nx09y6hnLlE_N7jCk Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: f898568b18ba4b38b5b0e614b323fcc0 Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-VolumesNegativeTest-332283320 Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f898568b18ba4b38b5b0e614b323fcc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f898568b18ba4b38b5b0e614b323fcc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f898568b18ba4b38b5b0e614b323fcc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f898568b18ba4b38b5b0e614b323fcc0", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-VolumesNegativeTest-332283320 Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: f898568b18ba4b38b5b0e614b323fcc0 Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-VolumesNegativeTest-332283320 Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-VolumesNegativeTest-332283320-project Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 057745ff31e04824803539505048fe4e Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-VolumesNegativeTest-332283320-project Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: exception: Volume tempest-invalid-494309415 could not be found. Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'tempest-invalid-494309415'} Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-494309415 could not be found. (HTTP 404) (Request-ID: req-afd87f8d-2385-4f9c-a46a-64d945cddcc6) Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 23:49:59.876582 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-494309415 could not be found. Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-494309415 could not be found. Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-494309415 could not be found. Oct 10 23:49:59.880577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.887757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3cf5a7c9-0d59-48fa-8a79-bdb55f481ca7 tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] Returning 404 to user: Volume tempest-invalid-494309415 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:49:59.888886 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3cf5a7c9-0d59-48fa-8a79-bdb55f481ca7 tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-494309415" status: 404 len: 98 microversion: 2.1 time: 0.073814 Oct 10 23:49:59.890609 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2888/5947] 10.222.0.23 () {58 vars in 1215 bytes} [Mon Oct 10 23:49:59 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-494309415 => generated 98 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 10 23:49:59.902585 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-35885d73-6a52-4da9-958f-c0da07b4f915 tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004706 Oct 10 23:49:59.903738 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2889/5948] 10.222.0.23 () {58 vars in 1140 bytes} [Mon Oct 10 23:49:59 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 10 23:49:59.913474 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-19a40e09-274f-4d87-84f3-5e0c62ed4b02 tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003983 Oct 10 23:49:59.914121 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2890/5949] 10.222.0.23 () {58 vars in 1137 bytes} [Mon Oct 10 23:49:59 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 10 23:49:59.924617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2e5dbf18-cb98-44a8-88a6-cd86addc89ec tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] Calling method '.version_select at 0x7f662a297670>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:49:59.986049 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-2e5dbf18-cb98-44a8-88a6-cd86addc89ec tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] HTTP exception thrown: Volume 5875951c-b975-4c9d-8ccb-30e937007e07 could not be found. Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2e5dbf18-cb98-44a8-88a6-cd86addc89ec tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] Request method failure captured: Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/os-volumes/5875951c-b975-4c9d-8ccb-30e937007e07 HTTP/1.1 Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK-nnZ-8GcFSKdtv7Mv7XnTDIOwECxrlpYSSEXjkIka8jxb3uRQ616blzkvCxmfVgQSkBiSTz7Wv8pFR1TTt4uAl_IlEKLrEO_gKDCccGlk7mx0LOavksW_pZWTD9QbuLKYWsgFUvPoYOXdRKAyZhUibHWyuY9Nx09y6hnLlE_N7jCk Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: f898568b18ba4b38b5b0e614b323fcc0 Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-VolumesNegativeTest-332283320 Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f898568b18ba4b38b5b0e614b323fcc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f898568b18ba4b38b5b0e614b323fcc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f898568b18ba4b38b5b0e614b323fcc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f898568b18ba4b38b5b0e614b323fcc0", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-VolumesNegativeTest-332283320 Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: f898568b18ba4b38b5b0e614b323fcc0 Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-VolumesNegativeTest-332283320 Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-VolumesNegativeTest-332283320-project Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 057745ff31e04824803539505048fe4e Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-VolumesNegativeTest-332283320-project Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: exception: Volume 5875951c-b975-4c9d-8ccb-30e937007e07 could not be found. Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '5875951c-b975-4c9d-8ccb-30e937007e07'} Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5875951c-b975-4c9d-8ccb-30e937007e07 could not be found. (HTTP 404) (Request-ID: req-5ce8e200-f731-45f1-89b1-dced2314e9c4) Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 23:49:59.987856 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5875951c-b975-4c9d-8ccb-30e937007e07 could not be found. Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5875951c-b975-4c9d-8ccb-30e937007e07 could not be found. Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5875951c-b975-4c9d-8ccb-30e937007e07 could not be found. Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2e5dbf18-cb98-44a8-88a6-cd86addc89ec tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] Returning 404 to user: Volume 5875951c-b975-4c9d-8ccb-30e937007e07 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2e5dbf18-cb98-44a8-88a6-cd86addc89ec tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/5875951c-b975-4c9d-8ccb-30e937007e07" status: 404 len: 109 microversion: 2.1 time: 0.069261 Oct 10 23:49:59.998127 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2891/5950] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 10 23:49:59 2022] DELETE /compute/v2.1/os-volumes/5875951c-b975-4c9d-8ccb-30e937007e07 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:50:00.007278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e76c667e-c023-432a-82e7-04ac420dbf03 tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] Calling method '.version_select at 0x7f662a206670>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:00.062846 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-e76c667e-c023-432a-82e7-04ac420dbf03 tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] HTTP exception thrown: Volume dfcd30b8-fdac-4c9d-b371-ab09cfe9d08f could not be found. Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e76c667e-c023-432a-82e7-04ac420dbf03 tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] Request method failure captured: Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/os-volumes/dfcd30b8-fdac-4c9d-b371-ab09cfe9d08f HTTP/1.1 Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK-nnZ-8GcFSKdtv7Mv7XnTDIOwECxrlpYSSEXjkIka8jxb3uRQ616blzkvCxmfVgQSkBiSTz7Wv8pFR1TTt4uAl_IlEKLrEO_gKDCccGlk7mx0LOavksW_pZWTD9QbuLKYWsgFUvPoYOXdRKAyZhUibHWyuY9Nx09y6hnLlE_N7jCk Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: f898568b18ba4b38b5b0e614b323fcc0 Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-VolumesNegativeTest-332283320 Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f898568b18ba4b38b5b0e614b323fcc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f898568b18ba4b38b5b0e614b323fcc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f898568b18ba4b38b5b0e614b323fcc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f898568b18ba4b38b5b0e614b323fcc0", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-VolumesNegativeTest-332283320 Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: f898568b18ba4b38b5b0e614b323fcc0 Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-VolumesNegativeTest-332283320 Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-VolumesNegativeTest-332283320-project Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 057745ff31e04824803539505048fe4e Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-VolumesNegativeTest-332283320-project Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: method: Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: exception: Volume dfcd30b8-fdac-4c9d-b371-ab09cfe9d08f could not be found. Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'dfcd30b8-fdac-4c9d-b371-ab09cfe9d08f'} Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dfcd30b8-fdac-4c9d-b371-ab09cfe9d08f could not be found. (HTTP 404) (Request-ID: req-b96b7268-27c9-4d31-9632-ed12cccbe45f) Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 23:50:00.065054 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dfcd30b8-fdac-4c9d-b371-ab09cfe9d08f could not be found. Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dfcd30b8-fdac-4c9d-b371-ab09cfe9d08f could not be found. Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dfcd30b8-fdac-4c9d-b371-ab09cfe9d08f could not be found. Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e76c667e-c023-432a-82e7-04ac420dbf03 tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] Returning 404 to user: Volume dfcd30b8-fdac-4c9d-b371-ab09cfe9d08f could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e76c667e-c023-432a-82e7-04ac420dbf03 tempest-VolumesNegativeTest-332283320 tempest-VolumesNegativeTest-332283320-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/dfcd30b8-fdac-4c9d-b371-ab09cfe9d08f" status: 404 len: 109 microversion: 2.1 time: 0.071490 Oct 10 23:50:00.073858 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2892/5951] 10.222.0.23 () {58 vars in 1245 bytes} [Mon Oct 10 23:49:59 2022] GET /compute/v2.1/os-volumes/dfcd30b8-fdac-4c9d-b371-ab09cfe9d08f => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:50:00.301415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d3a74cb9-35c7-4033-af6a-b19c08aeb2b6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:00.314525 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d3a74cb9-35c7-4033-af6a-b19c08aeb2b6 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1670 microversion: 2.1 time: 0.570917 Oct 10 23:50:00.316319 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3060/5952] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:49:59 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1670 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:00.350741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-71a360b8-47e9-443e-9b1f-fa45268518ff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:00.351854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-71a360b8-47e9-443e-9b1f-fa45268518ff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:00.361227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71a360b8-47e9-443e-9b1f-fa45268518ff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:00.364430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71a360b8-47e9-443e-9b1f-fa45268518ff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:00.365168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71a360b8-47e9-443e-9b1f-fa45268518ff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:00.366514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71a360b8-47e9-443e-9b1f-fa45268518ff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:00.367224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71a360b8-47e9-443e-9b1f-fa45268518ff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:00.368436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71a360b8-47e9-443e-9b1f-fa45268518ff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:00.402697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-71a360b8-47e9-443e-9b1f-fa45268518ff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:50:00.421784 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.compute.api [None req-71a360b8-47e9-443e-9b1f-fa45268518ff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Working on deleting snapshot dd195440-ad6b-4c19-9f23-0db5393fce7c from shelved instance... Oct 10 23:50:02.542071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-904a7cd4-45d4-4a25-82bb-a06b800f7e44 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:02.542696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-904a7cd4-45d4-4a25-82bb-a06b800f7e44 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:02.573630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-904a7cd4-45d4-4a25-82bb-a06b800f7e44 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:02.575096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-904a7cd4-45d4-4a25-82bb-a06b800f7e44 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:02.580228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-904a7cd4-45d4-4a25-82bb-a06b800f7e44 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:02.582165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-904a7cd4-45d4-4a25-82bb-a06b800f7e44 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:02.586331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-904a7cd4-45d4-4a25-82bb-a06b800f7e44 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:02.586893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-904a7cd4-45d4-4a25-82bb-a06b800f7e44 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:02.903030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-71a360b8-47e9-443e-9b1f-fa45268518ff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Doing local delete in cell c35e3cac-0e4f-44cc-a53a-8910e1eecc88(cell1) {{(pid=120614) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 10 23:50:02.903750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71a360b8-47e9-443e-9b1f-fa45268518ff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:02.904232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71a360b8-47e9-443e-9b1f-fa45268518ff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:02.904663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71a360b8-47e9-443e-9b1f-fa45268518ff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:02.926531 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.compute.api [None req-71a360b8-47e9-443e-9b1f-fa45268518ff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 10 23:50:02.938633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-71a360b8-47e9-443e-9b1f-fa45268518ff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] deallocate_for_instance() {{(pid=120614) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 10 23:50:03.579657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-904a7cd4-45d4-4a25-82bb-a06b800f7e44 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:03.597035 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-904a7cd4-45d4-4a25-82bb-a06b800f7e44 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1564 microversion: 2.1 time: 1.058821 Oct 10 23:50:03.606584 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3061/5953] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:02 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1564 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:50:03.628146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-3d7f2944-e6ef-4bdc-bf36-f62bb762b4cf req-f2d3ac98-3bd6-401e-8114-30998da17f42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccbe503a-b7c8-4459-87d9-3655cd54bacb", "tag": "4528ff7b-3e24-4d58-a19b-e57043a8de5d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:50:03.667469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3d7f2944-e6ef-4bdc-bf36-f62bb762b4cf req-f2d3ac98-3bd6-401e-8114-30998da17f42 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:03.670749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3d7f2944-e6ef-4bdc-bf36-f62bb762b4cf req-f2d3ac98-3bd6-401e-8114-30998da17f42 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:03.673410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3d7f2944-e6ef-4bdc-bf36-f62bb762b4cf req-f2d3ac98-3bd6-401e-8114-30998da17f42 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:03.702505 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-3d7f2944-e6ef-4bdc-bf36-f62bb762b4cf req-f2d3ac98-3bd6-401e-8114-30998da17f42 service nova] Creating event network-changed:4528ff7b-3e24-4d58-a19b-e57043a8de5d for instance ccbe503a-b7c8-4459-87d9-3655cd54bacb on n-h2-860864-2 Oct 10 23:50:03.742133 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-3d7f2944-e6ef-4bdc-bf36-f62bb762b4cf req-f2d3ac98-3bd6-401e-8114-30998da17f42 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128227 Oct 10 23:50:03.747396 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3062/5954] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:50:04.823310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-71a360b8-47e9-443e-9b1f-fa45268518ff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Updating instance_info_cache with network_info: [] {{(pid=120614) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 23:50:05.581238 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-71a360b8-47e9-443e-9b1f-fa45268518ff tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 204 len: 0 microversion: 2.1 time: 5.236753 Oct 10 23:50:05.587766 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2893/5955] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:50:00 2022] DELETE /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 0 bytes in 5241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:50:05.596959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fb41f82e-7e79-4a61-8fc3-e8462ed94e8b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:05.598313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fb41f82e-7e79-4a61-8fc3-e8462ed94e8b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 2606c2f7-d312-4418-b226-74371d7b8315] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:05.625141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb41f82e-7e79-4a61-8fc3-e8462ed94e8b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:05.626036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb41f82e-7e79-4a61-8fc3-e8462ed94e8b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:05.627550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb41f82e-7e79-4a61-8fc3-e8462ed94e8b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:05.630375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb41f82e-7e79-4a61-8fc3-e8462ed94e8b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:05.631065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb41f82e-7e79-4a61-8fc3-e8462ed94e8b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:05.631948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fb41f82e-7e79-4a61-8fc3-e8462ed94e8b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:05.653525 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-fb41f82e-7e79-4a61-8fc3-e8462ed94e8b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] HTTP exception thrown: Instance 2606c2f7-d312-4418-b226-74371d7b8315 could not be found. Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fb41f82e-7e79-4a61-8fc3-e8462ed94e8b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Request method failure captured: Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 HTTP/1.1 Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK2deQVSAXVpYv94o2LGh3P4UN6EQKCeEUhzdUPwlu_hbPK829sK5-CZkQ_H2hrW9XbLpAmgRUb-TsEm491HxpX3P5rgh7EGL-C9ucmTRQYU_rnkI97wjRlyvrAaF6FhKhgLCvu1_PNfELqMhxeoxEC4Z8lOcwF5q5jMUclhgeln0n4 Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: f798f5f5321f40b89fc5bacc3b9389fe Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerActionsTestJSON-1712674003 Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f798f5f5321f40b89fc5bacc3b9389fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f798f5f5321f40b89fc5bacc3b9389fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f798f5f5321f40b89fc5bacc3b9389fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f798f5f5321f40b89fc5bacc3b9389fe", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerActionsTestJSON-1712674003 Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: f798f5f5321f40b89fc5bacc3b9389fe Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerActionsTestJSON-1712674003 Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerActionsTestJSON-1712674003-project Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: cfd8618ee1864d1d86de2def024b49bb Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerActionsTestJSON-1712674003-project Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 2606c2f7-d312-4418-b226-74371d7b8315 could not be found. Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '2606c2f7-d312-4418-b226-74371d7b8315'} Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2606c2f7-d312-4418-b226-74371d7b8315 could not be found. Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2606c2f7-d312-4418-b226-74371d7b8315 could not be found. Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:50:05.655911 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:50:05.661061 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:50:05.661061 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:50:05.661061 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:50:05.661061 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:50:05.661061 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:50:05.661061 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2606c2f7-d312-4418-b226-74371d7b8315 could not be found. Oct 10 23:50:05.661061 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:50:05.664055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fb41f82e-7e79-4a61-8fc3-e8462ed94e8b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Returning 404 to user: Instance 2606c2f7-d312-4418-b226-74371d7b8315 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:50:05.665267 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fb41f82e-7e79-4a61-8fc3-e8462ed94e8b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315" status: 404 len: 111 microversion: 2.1 time: 0.076087 Oct 10 23:50:05.666429 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3063/5956] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:05 2022] GET /compute/v2.1/servers/2606c2f7-d312-4418-b226-74371d7b8315 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:50:05.677906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7961ab12-c62b-4491-a945-930541efd137 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:05.679556 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7961ab12-c62b-4491-a945-930541efd137 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 33e611fa-a406-48a0-89d8-cc9217a87b5d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:05.703452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7961ab12-c62b-4491-a945-930541efd137 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:05.705676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7961ab12-c62b-4491-a945-930541efd137 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:05.707573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7961ab12-c62b-4491-a945-930541efd137 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:05.711092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7961ab12-c62b-4491-a945-930541efd137 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:05.715104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7961ab12-c62b-4491-a945-930541efd137 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:05.715790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7961ab12-c62b-4491-a945-930541efd137 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:05.804738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-defaeb42-04d9-449e-864b-a9fb53189c9c req-4b78638b-a68c-482a-a42e-9228a34599b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2606c2f7-d312-4418-b226-74371d7b8315", "name": "network-vif-deleted", "tag": "7668ae94-786a-4b79-9096-53ff020bd6e1"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:50:05.851899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-defaeb42-04d9-449e-864b-a9fb53189c9c req-4b78638b-a68c-482a-a42e-9228a34599b7 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:05.853915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-defaeb42-04d9-449e-864b-a9fb53189c9c req-4b78638b-a68c-482a-a42e-9228a34599b7 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:05.854380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-defaeb42-04d9-449e-864b-a9fb53189c9c req-4b78638b-a68c-482a-a42e-9228a34599b7 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:05.897356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.compute.server_external_events [req-defaeb42-04d9-449e-864b-a9fb53189c9c req-4b78638b-a68c-482a-a42e-9228a34599b7 service nova] Unable to find a host for instance 2606c2f7-d312-4418-b226-74371d7b8315. Dropping event network-vif-deleted {{(pid=120613) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 10 23:50:05.899819 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-defaeb42-04d9-449e-864b-a9fb53189c9c req-4b78638b-a68c-482a-a42e-9228a34599b7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.098135 Oct 10 23:50:05.902101 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3064/5957] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 103 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 10 23:50:06.491177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7961ab12-c62b-4491-a945-930541efd137 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 33e611fa-a406-48a0-89d8-cc9217a87b5d] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:50:06.705743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:50:06.753664 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7961ab12-c62b-4491-a945-930541efd137 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "DELETE /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d" status: 204 len: 0 microversion: 2.1 time: 1.080005 Oct 10 23:50:06.756457 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2894/5958] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:50:05 2022] DELETE /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d => generated 0 bytes in 1086 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:50:06.765262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e22e74e3-8702-4e55-86ee-25f58c8eba00 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:06.766079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e22e74e3-8702-4e55-86ee-25f58c8eba00 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 33e611fa-a406-48a0-89d8-cc9217a87b5d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:06.788397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e22e74e3-8702-4e55-86ee-25f58c8eba00 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:06.789708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e22e74e3-8702-4e55-86ee-25f58c8eba00 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:06.792320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e22e74e3-8702-4e55-86ee-25f58c8eba00 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:06.793706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e22e74e3-8702-4e55-86ee-25f58c8eba00 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:06.794438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e22e74e3-8702-4e55-86ee-25f58c8eba00 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:06.795113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e22e74e3-8702-4e55-86ee-25f58c8eba00 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:07.112413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e22e74e3-8702-4e55-86ee-25f58c8eba00 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:07.129193 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e22e74e3-8702-4e55-86ee-25f58c8eba00 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d" status: 200 len: 1465 microversion: 2.1 time: 0.368495 Oct 10 23:50:07.132540 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3065/5959] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:06 2022] GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d => generated 1465 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:08.160447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6e0dccc3-1123-4f0e-ac5c-fe21e8221dfc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:08.162336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6e0dccc3-1123-4f0e-ac5c-fe21e8221dfc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 33e611fa-a406-48a0-89d8-cc9217a87b5d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:08.174736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e0dccc3-1123-4f0e-ac5c-fe21e8221dfc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:08.180766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e0dccc3-1123-4f0e-ac5c-fe21e8221dfc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:08.182187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e0dccc3-1123-4f0e-ac5c-fe21e8221dfc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:08.185023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e0dccc3-1123-4f0e-ac5c-fe21e8221dfc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:08.186997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e0dccc3-1123-4f0e-ac5c-fe21e8221dfc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:08.188504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e0dccc3-1123-4f0e-ac5c-fe21e8221dfc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:08.504355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6e0dccc3-1123-4f0e-ac5c-fe21e8221dfc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:08.518299 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6e0dccc3-1123-4f0e-ac5c-fe21e8221dfc tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d" status: 200 len: 1465 microversion: 2.1 time: 0.365368 Oct 10 23:50:08.523205 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2895/5960] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:08 2022] GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d => generated 1465 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:09.550873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-735a8d72-3687-48d4-8859-d6c33dff16fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:09.552119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-735a8d72-3687-48d4-8859-d6c33dff16fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 33e611fa-a406-48a0-89d8-cc9217a87b5d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:09.570781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-735a8d72-3687-48d4-8859-d6c33dff16fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:09.571851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-735a8d72-3687-48d4-8859-d6c33dff16fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:09.572491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-735a8d72-3687-48d4-8859-d6c33dff16fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:09.573475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-735a8d72-3687-48d4-8859-d6c33dff16fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:09.574321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-735a8d72-3687-48d4-8859-d6c33dff16fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:09.576265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-735a8d72-3687-48d4-8859-d6c33dff16fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:09.840604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-735a8d72-3687-48d4-8859-d6c33dff16fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:09.865626 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-735a8d72-3687-48d4-8859-d6c33dff16fe tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d" status: 200 len: 1465 microversion: 2.1 time: 0.305873 Oct 10 23:50:09.866330 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3066/5961] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:09 2022] GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d => generated 1465 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:10.043721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-a0f6517c-621d-4232-9654-4609ac19ec63 req-64687ea3-9efc-4748-ba28-5c99700829f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e611fa-a406-48a0-89d8-cc9217a87b5d", "name": "network-vif-deleted", "tag": "1cbc9253-2a95-4a16-af9a-23e82d53caf6"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:50:10.069216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a0f6517c-621d-4232-9654-4609ac19ec63 req-64687ea3-9efc-4748-ba28-5c99700829f4 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:10.074582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a0f6517c-621d-4232-9654-4609ac19ec63 req-64687ea3-9efc-4748-ba28-5c99700829f4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:10.075289 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a0f6517c-621d-4232-9654-4609ac19ec63 req-64687ea3-9efc-4748-ba28-5c99700829f4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:10.099883 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-a0f6517c-621d-4232-9654-4609ac19ec63 req-64687ea3-9efc-4748-ba28-5c99700829f4 service nova] Creating event network-vif-deleted:1cbc9253-2a95-4a16-af9a-23e82d53caf6 for instance 33e611fa-a406-48a0-89d8-cc9217a87b5d on n-h2-860864-2 Oct 10 23:50:10.115300 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-a0f6517c-621d-4232-9654-4609ac19ec63 req-64687ea3-9efc-4748-ba28-5c99700829f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079936 Oct 10 23:50:10.117119 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2896/5962] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:50:10.893136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f3009ade-ccc0-4029-8a33-a878bd45d4b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:10.895613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f3009ade-ccc0-4029-8a33-a878bd45d4b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 33e611fa-a406-48a0-89d8-cc9217a87b5d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:10.901836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:50:10.916132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3009ade-ccc0-4029-8a33-a878bd45d4b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:10.919110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3009ade-ccc0-4029-8a33-a878bd45d4b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:10.919684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3009ade-ccc0-4029-8a33-a878bd45d4b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:10.920612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3009ade-ccc0-4029-8a33-a878bd45d4b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:10.925532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3009ade-ccc0-4029-8a33-a878bd45d4b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:10.926298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3009ade-ccc0-4029-8a33-a878bd45d4b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:11.010824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3009ade-ccc0-4029-8a33-a878bd45d4b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:11.017686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3009ade-ccc0-4029-8a33-a878bd45d4b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:11.018512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3009ade-ccc0-4029-8a33-a878bd45d4b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:11.019251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-f3009ade-ccc0-4029-8a33-a878bd45d4b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lazy-loading 'fault' on Instance uuid 33e611fa-a406-48a0-89d8-cc9217a87b5d {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:50:11.130966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f3009ade-ccc0-4029-8a33-a878bd45d4b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:11.139775 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f3009ade-ccc0-4029-8a33-a878bd45d4b0 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d" status: 200 len: 1305 microversion: 2.1 time: 0.252223 Oct 10 23:50:11.148007 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3067/5963] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:10 2022] GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d => generated 1305 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:12.172439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-285b80d1-bab5-435d-b7ed-24cee8885331 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:12.174568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-285b80d1-bab5-435d-b7ed-24cee8885331 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 33e611fa-a406-48a0-89d8-cc9217a87b5d] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:12.192179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-285b80d1-bab5-435d-b7ed-24cee8885331 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:12.194997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-285b80d1-bab5-435d-b7ed-24cee8885331 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:12.195611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-285b80d1-bab5-435d-b7ed-24cee8885331 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:12.198343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-285b80d1-bab5-435d-b7ed-24cee8885331 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:12.200859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-285b80d1-bab5-435d-b7ed-24cee8885331 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:12.202900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-285b80d1-bab5-435d-b7ed-24cee8885331 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:12.241394 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-285b80d1-bab5-435d-b7ed-24cee8885331 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] HTTP exception thrown: Instance 33e611fa-a406-48a0-89d8-cc9217a87b5d could not be found. Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-285b80d1-bab5-435d-b7ed-24cee8885331 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Request method failure captured: Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d HTTP/1.1 Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK2deQVSAXVpYv94o2LGh3P4UN6EQKCeEUhzdUPwlu_hbPK829sK5-CZkQ_H2hrW9XbLpAmgRUb-TsEm491HxpX3P5rgh7EGL-C9ucmTRQYU_rnkI97wjRlyvrAaF6FhKhgLCvu1_PNfELqMhxeoxEC4Z8lOcwF5q5jMUclhgeln0n4 Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: f798f5f5321f40b89fc5bacc3b9389fe Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerActionsTestJSON-1712674003 Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f798f5f5321f40b89fc5bacc3b9389fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f798f5f5321f40b89fc5bacc3b9389fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f798f5f5321f40b89fc5bacc3b9389fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f798f5f5321f40b89fc5bacc3b9389fe", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerActionsTestJSON-1712674003 Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: f798f5f5321f40b89fc5bacc3b9389fe Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerActionsTestJSON-1712674003 Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerActionsTestJSON-1712674003-project Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: cfd8618ee1864d1d86de2def024b49bb Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerActionsTestJSON-1712674003-project Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 33e611fa-a406-48a0-89d8-cc9217a87b5d could not be found. Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '33e611fa-a406-48a0-89d8-cc9217a87b5d'} Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33e611fa-a406-48a0-89d8-cc9217a87b5d could not be found. Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33e611fa-a406-48a0-89d8-cc9217a87b5d could not be found. Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:50:12.247428 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:50:12.252039 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:50:12.252039 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:50:12.252039 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:50:12.252039 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:50:12.252039 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:50:12.252039 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33e611fa-a406-48a0-89d8-cc9217a87b5d could not be found. Oct 10 23:50:12.252039 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:50:12.257647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-285b80d1-bab5-435d-b7ed-24cee8885331 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Returning 404 to user: Instance 33e611fa-a406-48a0-89d8-cc9217a87b5d could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:50:12.260661 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-285b80d1-bab5-435d-b7ed-24cee8885331 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d" status: 404 len: 111 microversion: 2.1 time: 0.092608 Oct 10 23:50:12.261605 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2897/5964] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:12 2022] GET /compute/v2.1/servers/33e611fa-a406-48a0-89d8-cc9217a87b5d => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:50:12.270583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bcf85179-ab36-4385-abf7-e6479da5323f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:12.271133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bcf85179-ab36-4385-abf7-e6479da5323f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:12.282808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bcf85179-ab36-4385-abf7-e6479da5323f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:12.283221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bcf85179-ab36-4385-abf7-e6479da5323f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:12.285501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bcf85179-ab36-4385-abf7-e6479da5323f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:12.286381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bcf85179-ab36-4385-abf7-e6479da5323f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:12.286758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bcf85179-ab36-4385-abf7-e6479da5323f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:12.293327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bcf85179-ab36-4385-abf7-e6479da5323f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:12.349703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:50:12.363938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bcf85179-ab36-4385-abf7-e6479da5323f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:50:12.582000 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bcf85179-ab36-4385-abf7-e6479da5323f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2" status: 204 len: 0 microversion: 2.1 time: 0.314984 Oct 10 23:50:12.587402 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3068/5965] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:50:12 2022] DELETE /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:50:12.593144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5447afdc-0e99-4665-9dc6-c17aa4aef768 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:12.593972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5447afdc-0e99-4665-9dc6-c17aa4aef768 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:12.605080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5447afdc-0e99-4665-9dc6-c17aa4aef768 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:12.605738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5447afdc-0e99-4665-9dc6-c17aa4aef768 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:12.606260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5447afdc-0e99-4665-9dc6-c17aa4aef768 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:12.612461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5447afdc-0e99-4665-9dc6-c17aa4aef768 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:12.613044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5447afdc-0e99-4665-9dc6-c17aa4aef768 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:12.613530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5447afdc-0e99-4665-9dc6-c17aa4aef768 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:12.626828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=18,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:50:13.217251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5447afdc-0e99-4665-9dc6-c17aa4aef768 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:13.229626 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5447afdc-0e99-4665-9dc6-c17aa4aef768 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2" status: 200 len: 1506 microversion: 2.1 time: 0.640826 Oct 10 23:50:13.232148 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2898/5966] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:12 2022] GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2 => generated 1506 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:50:14.257317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0a769737-b457-490c-825a-8c47aed97624 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:14.258654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0a769737-b457-490c-825a-8c47aed97624 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:14.269593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a769737-b457-490c-825a-8c47aed97624 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:14.270616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a769737-b457-490c-825a-8c47aed97624 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:14.271498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a769737-b457-490c-825a-8c47aed97624 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:14.272564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a769737-b457-490c-825a-8c47aed97624 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:14.273195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a769737-b457-490c-825a-8c47aed97624 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:14.273738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a769737-b457-490c-825a-8c47aed97624 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:14.517070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0a769737-b457-490c-825a-8c47aed97624 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:14.529318 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0a769737-b457-490c-825a-8c47aed97624 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2" status: 200 len: 1506 microversion: 2.1 time: 0.276599 Oct 10 23:50:14.550807 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3069/5967] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:14 2022] GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2 => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:15.218274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-27860d04-b84f-4007-b2c3-152f8d0433b1 req-5f4d9637-2f91-4b76-926a-643428490a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9053f3ff-dd63-4991-8010-ff36800620e2", "name": "network-vif-deleted", "tag": "9d911abb-be71-4368-98bf-fc90e3f5867b"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:50:15.244261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-27860d04-b84f-4007-b2c3-152f8d0433b1 req-5f4d9637-2f91-4b76-926a-643428490a90 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:15.245315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-27860d04-b84f-4007-b2c3-152f8d0433b1 req-5f4d9637-2f91-4b76-926a-643428490a90 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:15.248589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-27860d04-b84f-4007-b2c3-152f8d0433b1 req-5f4d9637-2f91-4b76-926a-643428490a90 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:15.274112 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-27860d04-b84f-4007-b2c3-152f8d0433b1 req-5f4d9637-2f91-4b76-926a-643428490a90 service nova] Creating event network-vif-deleted:9d911abb-be71-4368-98bf-fc90e3f5867b for instance 9053f3ff-dd63-4991-8010-ff36800620e2 on n-h2-860864-2 Oct 10 23:50:15.290917 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-27860d04-b84f-4007-b2c3-152f8d0433b1 req-5f4d9637-2f91-4b76-926a-643428490a90 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073884 Oct 10 23:50:15.292008 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2899/5968] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:50:15.559370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-566c5741-3213-4475-9ff3-5e07a1ab2831 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:15.560236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-566c5741-3213-4475-9ff3-5e07a1ab2831 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:15.589275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-566c5741-3213-4475-9ff3-5e07a1ab2831 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:15.591791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-566c5741-3213-4475-9ff3-5e07a1ab2831 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:15.592980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-566c5741-3213-4475-9ff3-5e07a1ab2831 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:15.610305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-566c5741-3213-4475-9ff3-5e07a1ab2831 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:15.610305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-566c5741-3213-4475-9ff3-5e07a1ab2831 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:15.610305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-566c5741-3213-4475-9ff3-5e07a1ab2831 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:15.668500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-566c5741-3213-4475-9ff3-5e07a1ab2831 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:15.669413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-566c5741-3213-4475-9ff3-5e07a1ab2831 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:15.670048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-566c5741-3213-4475-9ff3-5e07a1ab2831 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:15.671460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-566c5741-3213-4475-9ff3-5e07a1ab2831 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lazy-loading 'fault' on Instance uuid 9053f3ff-dd63-4991-8010-ff36800620e2 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:50:15.799679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-566c5741-3213-4475-9ff3-5e07a1ab2831 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:15.810906 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-566c5741-3213-4475-9ff3-5e07a1ab2831 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2" status: 200 len: 1304 microversion: 2.1 time: 0.256495 Oct 10 23:50:15.813442 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3070/5969] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:15 2022] GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2 => generated 1304 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:16.838293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-47a21ea2-4925-486f-b58b-f35a2af4a513 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:16.839160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-47a21ea2-4925-486f-b58b-f35a2af4a513 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 9053f3ff-dd63-4991-8010-ff36800620e2] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:16.852898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47a21ea2-4925-486f-b58b-f35a2af4a513 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:16.856383 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47a21ea2-4925-486f-b58b-f35a2af4a513 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:16.857237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47a21ea2-4925-486f-b58b-f35a2af4a513 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:16.861123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47a21ea2-4925-486f-b58b-f35a2af4a513 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:16.862915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47a21ea2-4925-486f-b58b-f35a2af4a513 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:16.863590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47a21ea2-4925-486f-b58b-f35a2af4a513 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:16.892024 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-47a21ea2-4925-486f-b58b-f35a2af4a513 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] HTTP exception thrown: Instance 9053f3ff-dd63-4991-8010-ff36800620e2 could not be found. Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-47a21ea2-4925-486f-b58b-f35a2af4a513 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Request method failure captured: Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2 HTTP/1.1 Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK2deQVSAXVpYv94o2LGh3P4UN6EQKCeEUhzdUPwlu_hbPK829sK5-CZkQ_H2hrW9XbLpAmgRUb-TsEm491HxpX3P5rgh7EGL-C9ucmTRQYU_rnkI97wjRlyvrAaF6FhKhgLCvu1_PNfELqMhxeoxEC4Z8lOcwF5q5jMUclhgeln0n4 Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: f798f5f5321f40b89fc5bacc3b9389fe Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerActionsTestJSON-1712674003 Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f798f5f5321f40b89fc5bacc3b9389fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f798f5f5321f40b89fc5bacc3b9389fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f798f5f5321f40b89fc5bacc3b9389fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f798f5f5321f40b89fc5bacc3b9389fe", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerActionsTestJSON-1712674003 Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: f798f5f5321f40b89fc5bacc3b9389fe Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerActionsTestJSON-1712674003 Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerActionsTestJSON-1712674003-project Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: cfd8618ee1864d1d86de2def024b49bb Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerActionsTestJSON-1712674003-project Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 9053f3ff-dd63-4991-8010-ff36800620e2 could not be found. Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '9053f3ff-dd63-4991-8010-ff36800620e2'} Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9053f3ff-dd63-4991-8010-ff36800620e2 could not be found. Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9053f3ff-dd63-4991-8010-ff36800620e2 could not be found. Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:50:16.894201 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:50:16.898438 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:50:16.898438 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:50:16.898438 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:50:16.898438 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:50:16.898438 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:50:16.898438 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9053f3ff-dd63-4991-8010-ff36800620e2 could not be found. Oct 10 23:50:16.898438 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:50:16.901554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-47a21ea2-4925-486f-b58b-f35a2af4a513 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Returning 404 to user: Instance 9053f3ff-dd63-4991-8010-ff36800620e2 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:50:16.903084 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-47a21ea2-4925-486f-b58b-f35a2af4a513 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2" status: 404 len: 111 microversion: 2.1 time: 0.070270 Oct 10 23:50:16.904301 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2900/5970] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:16 2022] GET /compute/v2.1/servers/9053f3ff-dd63-4991-8010-ff36800620e2 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:50:16.917437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3439c28c-04f3-4525-bf20-644519971a58 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:16.917925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3439c28c-04f3-4525-bf20-644519971a58 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:16.931392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3439c28c-04f3-4525-bf20-644519971a58 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:16.931392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3439c28c-04f3-4525-bf20-644519971a58 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:16.931392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3439c28c-04f3-4525-bf20-644519971a58 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:16.931392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3439c28c-04f3-4525-bf20-644519971a58 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:16.931392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3439c28c-04f3-4525-bf20-644519971a58 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:16.943481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3439c28c-04f3-4525-bf20-644519971a58 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:17.012544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3439c28c-04f3-4525-bf20-644519971a58 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:50:17.183231 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3439c28c-04f3-4525-bf20-644519971a58 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 204 len: 0 microversion: 2.1 time: 0.272529 Oct 10 23:50:17.199461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-93509b25-3c9b-4674-b6e8-8c7b5da939a5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:17.200714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-93509b25-3c9b-4674-b6e8-8c7b5da939a5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:17.206028 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3071/5971] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:50:16 2022] DELETE /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:50:17.218337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93509b25-3c9b-4674-b6e8-8c7b5da939a5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:17.220356 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93509b25-3c9b-4674-b6e8-8c7b5da939a5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:17.221600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93509b25-3c9b-4674-b6e8-8c7b5da939a5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:17.222531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93509b25-3c9b-4674-b6e8-8c7b5da939a5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:17.223968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93509b25-3c9b-4674-b6e8-8c7b5da939a5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:17.224568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93509b25-3c9b-4674-b6e8-8c7b5da939a5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:17.436960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-93509b25-3c9b-4674-b6e8-8c7b5da939a5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:17.460187 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-93509b25-3c9b-4674-b6e8-8c7b5da939a5 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1493 microversion: 2.1 time: 0.266439 Oct 10 23:50:17.476140 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2901/5972] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:17 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1493 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:18.491953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b433f9ff-4ae5-4592-99b8-e86c808ad25c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:18.493019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b433f9ff-4ae5-4592-99b8-e86c808ad25c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:18.511998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b433f9ff-4ae5-4592-99b8-e86c808ad25c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:18.512527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b433f9ff-4ae5-4592-99b8-e86c808ad25c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:18.513026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b433f9ff-4ae5-4592-99b8-e86c808ad25c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:18.513783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b433f9ff-4ae5-4592-99b8-e86c808ad25c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:18.514304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b433f9ff-4ae5-4592-99b8-e86c808ad25c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:18.514754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b433f9ff-4ae5-4592-99b8-e86c808ad25c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:18.793467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-1171ffd2-238a-4f44-b903-556e0755d467 req-f69c8bc1-0843-443d-b292-0dbd11786019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf", "name": "network-vif-deleted", "tag": "9723fc72-e0e5-4907-9c7f-9bef1c53e610"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:50:18.796917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b433f9ff-4ae5-4592-99b8-e86c808ad25c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:18.810460 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b433f9ff-4ae5-4592-99b8-e86c808ad25c tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 200 len: 1451 microversion: 2.1 time: 0.328800 Oct 10 23:50:18.820707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1171ffd2-238a-4f44-b903-556e0755d467 req-f69c8bc1-0843-443d-b292-0dbd11786019 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:18.826026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1171ffd2-238a-4f44-b903-556e0755d467 req-f69c8bc1-0843-443d-b292-0dbd11786019 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:18.827606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1171ffd2-238a-4f44-b903-556e0755d467 req-f69c8bc1-0843-443d-b292-0dbd11786019 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:18.832038 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3072/5973] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:18 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 1451 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:18.872909 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-1171ffd2-238a-4f44-b903-556e0755d467 req-f69c8bc1-0843-443d-b292-0dbd11786019 service nova] Creating event network-vif-deleted:9723fc72-e0e5-4907-9c7f-9bef1c53e610 for instance 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf on n-h1-860864-2 Oct 10 23:50:18.892577 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-1171ffd2-238a-4f44-b903-556e0755d467 req-f69c8bc1-0843-443d-b292-0dbd11786019 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102220 Oct 10 23:50:18.913667 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2902/5974] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:50:19.851681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-34b92d32-34c1-4c62-86b9-58c0235c0635 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:19.852843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-34b92d32-34c1-4c62-86b9-58c0235c0635 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:19.866024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34b92d32-34c1-4c62-86b9-58c0235c0635 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:19.866799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34b92d32-34c1-4c62-86b9-58c0235c0635 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:19.867402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34b92d32-34c1-4c62-86b9-58c0235c0635 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:19.870680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34b92d32-34c1-4c62-86b9-58c0235c0635 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:19.886038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34b92d32-34c1-4c62-86b9-58c0235c0635 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:19.886533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34b92d32-34c1-4c62-86b9-58c0235c0635 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:19.925141 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-34b92d32-34c1-4c62-86b9-58c0235c0635 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] HTTP exception thrown: Instance 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf could not be found. Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-34b92d32-34c1-4c62-86b9-58c0235c0635 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Request method failure captured: Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf HTTP/1.1 Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK2deQVSAXVpYv94o2LGh3P4UN6EQKCeEUhzdUPwlu_hbPK829sK5-CZkQ_H2hrW9XbLpAmgRUb-TsEm491HxpX3P5rgh7EGL-C9ucmTRQYU_rnkI97wjRlyvrAaF6FhKhgLCvu1_PNfELqMhxeoxEC4Z8lOcwF5q5jMUclhgeln0n4 Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: f798f5f5321f40b89fc5bacc3b9389fe Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerActionsTestJSON-1712674003 Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f798f5f5321f40b89fc5bacc3b9389fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f798f5f5321f40b89fc5bacc3b9389fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f798f5f5321f40b89fc5bacc3b9389fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f798f5f5321f40b89fc5bacc3b9389fe", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerActionsTestJSON-1712674003 Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: f798f5f5321f40b89fc5bacc3b9389fe Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerActionsTestJSON-1712674003 Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerActionsTestJSON-1712674003-project Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: cfd8618ee1864d1d86de2def024b49bb Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerActionsTestJSON-1712674003-project Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf could not be found. Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf'} Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf could not be found. Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf could not be found. Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:50:19.927870 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:50:19.932449 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:50:19.932449 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:50:19.932449 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:50:19.932449 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:50:19.932449 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:50:19.932449 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf could not be found. Oct 10 23:50:19.932449 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:50:19.932449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-34b92d32-34c1-4c62-86b9-58c0235c0635 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Returning 404 to user: Instance 3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:50:19.933243 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-34b92d32-34c1-4c62-86b9-58c0235c0635 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf" status: 404 len: 111 microversion: 2.1 time: 0.090820 Oct 10 23:50:19.935010 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3073/5975] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:19 2022] GET /compute/v2.1/servers/3c4a2815-4b7e-43c5-99f5-e58bfcfcf1cf => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:50:19.949106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1bdf3926-ea4a-4e11-b25c-ff5344e31d2f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:19.949731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1bdf3926-ea4a-4e11-b25c-ff5344e31d2f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:19.972103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bdf3926-ea4a-4e11-b25c-ff5344e31d2f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:19.974426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bdf3926-ea4a-4e11-b25c-ff5344e31d2f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:19.975113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bdf3926-ea4a-4e11-b25c-ff5344e31d2f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:19.979987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bdf3926-ea4a-4e11-b25c-ff5344e31d2f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:19.980646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bdf3926-ea4a-4e11-b25c-ff5344e31d2f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:19.981260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1bdf3926-ea4a-4e11-b25c-ff5344e31d2f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:20.037346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1bdf3926-ea4a-4e11-b25c-ff5344e31d2f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:50:20.184074 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1bdf3926-ea4a-4e11-b25c-ff5344e31d2f tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "DELETE /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 204 len: 0 microversion: 2.1 time: 0.241494 Oct 10 23:50:20.185714 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2903/5976] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:50:19 2022] DELETE /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:50:20.196175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cefa5d53-64b5-4578-8d8e-f829c718660b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:20.196796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cefa5d53-64b5-4578-8d8e-f829c718660b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:20.211552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cefa5d53-64b5-4578-8d8e-f829c718660b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:20.212288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cefa5d53-64b5-4578-8d8e-f829c718660b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:20.214713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cefa5d53-64b5-4578-8d8e-f829c718660b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:20.215899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cefa5d53-64b5-4578-8d8e-f829c718660b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:20.216612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cefa5d53-64b5-4578-8d8e-f829c718660b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:20.219613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cefa5d53-64b5-4578-8d8e-f829c718660b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:20.589704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cefa5d53-64b5-4578-8d8e-f829c718660b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:20.601985 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cefa5d53-64b5-4578-8d8e-f829c718660b tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1676 microversion: 2.1 time: 0.410866 Oct 10 23:50:20.603163 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3074/5977] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:20 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1676 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:21.633711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cc04d0da-4a67-42a4-bd2c-ab41f096a877 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:21.634721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cc04d0da-4a67-42a4-bd2c-ab41f096a877 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:21.645791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc04d0da-4a67-42a4-bd2c-ab41f096a877 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:21.650258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc04d0da-4a67-42a4-bd2c-ab41f096a877 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:21.651694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc04d0da-4a67-42a4-bd2c-ab41f096a877 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:21.653311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc04d0da-4a67-42a4-bd2c-ab41f096a877 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:21.657111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc04d0da-4a67-42a4-bd2c-ab41f096a877 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:21.658076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc04d0da-4a67-42a4-bd2c-ab41f096a877 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:22.164872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cc04d0da-4a67-42a4-bd2c-ab41f096a877 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:22.176781 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cc04d0da-4a67-42a4-bd2c-ab41f096a877 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1676 microversion: 2.1 time: 0.548197 Oct 10 23:50:22.180815 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2904/5978] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:21 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1676 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:22.521586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1fb668a4-6acf-4a7c-8666-5045234abf46 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:50:22.523942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1fb668a4-6acf-4a7c-8666-5045234abf46 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:22.542623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1fb668a4-6acf-4a7c-8666-5045234abf46 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:22.543227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1fb668a4-6acf-4a7c-8666-5045234abf46 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:22.543721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1fb668a4-6acf-4a7c-8666-5045234abf46 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:22.544452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1fb668a4-6acf-4a7c-8666-5045234abf46 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:22.544915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1fb668a4-6acf-4a7c-8666-5045234abf46 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:22.545460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1fb668a4-6acf-4a7c-8666-5045234abf46 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:22.627257 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1fb668a4-6acf-4a7c-8666-5045234abf46 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "POST /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb/action" status: 200 len: 24552 microversion: 2.1 time: 0.109814 Oct 10 23:50:22.633463 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3075/5979] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:50:22 2022] POST /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb/action => generated 24552 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:50:23.204296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-af33e4a7-a46b-46ca-b902-ce77092a131d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:23.204874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-af33e4a7-a46b-46ca-b902-ce77092a131d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:23.226026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af33e4a7-a46b-46ca-b902-ce77092a131d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:23.226763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af33e4a7-a46b-46ca-b902-ce77092a131d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:23.228595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af33e4a7-a46b-46ca-b902-ce77092a131d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:23.231175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af33e4a7-a46b-46ca-b902-ce77092a131d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:23.231959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af33e4a7-a46b-46ca-b902-ce77092a131d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:23.234877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af33e4a7-a46b-46ca-b902-ce77092a131d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:23.487124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-af33e4a7-a46b-46ca-b902-ce77092a131d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:23.511267 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-af33e4a7-a46b-46ca-b902-ce77092a131d tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1609 microversion: 2.1 time: 0.306415 Oct 10 23:50:23.519814 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2905/5980] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:23 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1609 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:24.209609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-a8e8a3f8-256f-4d03-b69a-2af8b814314a req-518d7161-4b45-4ffd-a36c-2fb5948da92b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c65eb2-4a59-4b1e-bf11-e2094d984d0a", "name": "network-vif-deleted", "tag": "db12b09d-2d47-4f71-9616-ebcc385cf4ab"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:50:24.271791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a8e8a3f8-256f-4d03-b69a-2af8b814314a req-518d7161-4b45-4ffd-a36c-2fb5948da92b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:24.275244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a8e8a3f8-256f-4d03-b69a-2af8b814314a req-518d7161-4b45-4ffd-a36c-2fb5948da92b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:24.276993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a8e8a3f8-256f-4d03-b69a-2af8b814314a req-518d7161-4b45-4ffd-a36c-2fb5948da92b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:24.304141 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a8e8a3f8-256f-4d03-b69a-2af8b814314a req-518d7161-4b45-4ffd-a36c-2fb5948da92b service nova] Creating event network-vif-deleted:db12b09d-2d47-4f71-9616-ebcc385cf4ab for instance 88c65eb2-4a59-4b1e-bf11-e2094d984d0a on n-h2-860864-2 Oct 10 23:50:24.317108 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-a8e8a3f8-256f-4d03-b69a-2af8b814314a req-518d7161-4b45-4ffd-a36c-2fb5948da92b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116699 Oct 10 23:50:24.323182 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3076/5981] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:50:24.544577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8d7ff41a-23f1-450a-b397-3c3e6fc2b984 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:24.545316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8d7ff41a-23f1-450a-b397-3c3e6fc2b984 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:24.566429 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d7ff41a-23f1-450a-b397-3c3e6fc2b984 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:24.570661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d7ff41a-23f1-450a-b397-3c3e6fc2b984 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:24.574760 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d7ff41a-23f1-450a-b397-3c3e6fc2b984 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:24.575955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d7ff41a-23f1-450a-b397-3c3e6fc2b984 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:24.581492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d7ff41a-23f1-450a-b397-3c3e6fc2b984 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:24.582785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d7ff41a-23f1-450a-b397-3c3e6fc2b984 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:24.722758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d7ff41a-23f1-450a-b397-3c3e6fc2b984 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:24.728374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d7ff41a-23f1-450a-b397-3c3e6fc2b984 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:24.729698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d7ff41a-23f1-450a-b397-3c3e6fc2b984 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:24.730421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-8d7ff41a-23f1-450a-b397-3c3e6fc2b984 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lazy-loading 'fault' on Instance uuid 88c65eb2-4a59-4b1e-bf11-e2094d984d0a {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:50:24.840721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8d7ff41a-23f1-450a-b397-3c3e6fc2b984 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd8618ee1864d1d86de2def024b49bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f798f5f5321f40b89fc5bacc3b9389fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:24.856597 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8d7ff41a-23f1-450a-b397-3c3e6fc2b984 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 200 len: 1329 microversion: 2.1 time: 0.311277 Oct 10 23:50:24.859612 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2906/5982] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:24 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 1329 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:25.884617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f19d54be-a358-4002-8a1b-9a01342fe8db tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:25.885971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f19d54be-a358-4002-8a1b-9a01342fe8db tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] [instance: 88c65eb2-4a59-4b1e-bf11-e2094d984d0a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:25.914913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f19d54be-a358-4002-8a1b-9a01342fe8db tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:25.922364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f19d54be-a358-4002-8a1b-9a01342fe8db tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:25.925629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f19d54be-a358-4002-8a1b-9a01342fe8db tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:25.929285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f19d54be-a358-4002-8a1b-9a01342fe8db tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:25.931220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f19d54be-a358-4002-8a1b-9a01342fe8db tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:25.933494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f19d54be-a358-4002-8a1b-9a01342fe8db tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:25.995334 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-f19d54be-a358-4002-8a1b-9a01342fe8db tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] HTTP exception thrown: Instance 88c65eb2-4a59-4b1e-bf11-e2094d984d0a could not be found. Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f19d54be-a358-4002-8a1b-9a01342fe8db tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Request method failure captured: Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a HTTP/1.1 Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK2deQVSAXVpYv94o2LGh3P4UN6EQKCeEUhzdUPwlu_hbPK829sK5-CZkQ_H2hrW9XbLpAmgRUb-TsEm491HxpX3P5rgh7EGL-C9ucmTRQYU_rnkI97wjRlyvrAaF6FhKhgLCvu1_PNfELqMhxeoxEC4Z8lOcwF5q5jMUclhgeln0n4 Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: f798f5f5321f40b89fc5bacc3b9389fe Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerActionsTestJSON-1712674003 Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f798f5f5321f40b89fc5bacc3b9389fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f798f5f5321f40b89fc5bacc3b9389fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f798f5f5321f40b89fc5bacc3b9389fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f798f5f5321f40b89fc5bacc3b9389fe", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerActionsTestJSON-1712674003 Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: f798f5f5321f40b89fc5bacc3b9389fe Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerActionsTestJSON-1712674003 Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerActionsTestJSON-1712674003-project Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: cfd8618ee1864d1d86de2def024b49bb Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerActionsTestJSON-1712674003-project Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 88c65eb2-4a59-4b1e-bf11-e2094d984d0a could not be found. Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '88c65eb2-4a59-4b1e-bf11-e2094d984d0a'} Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c65eb2-4a59-4b1e-bf11-e2094d984d0a could not be found. Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c65eb2-4a59-4b1e-bf11-e2094d984d0a could not be found. Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:50:25.997259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:50:26.005093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:50:26.005093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:50:26.005093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:50:26.005093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:50:26.005093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:50:26.005093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c65eb2-4a59-4b1e-bf11-e2094d984d0a could not be found. Oct 10 23:50:26.005093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:50:26.012146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f19d54be-a358-4002-8a1b-9a01342fe8db tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Returning 404 to user: Instance 88c65eb2-4a59-4b1e-bf11-e2094d984d0a could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:50:26.015203 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f19d54be-a358-4002-8a1b-9a01342fe8db tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a" status: 404 len: 111 microversion: 2.1 time: 0.133313 Oct 10 23:50:26.018281 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3077/5983] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:25 2022] GET /compute/v2.1/servers/88c65eb2-4a59-4b1e-bf11-e2094d984d0a => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:50:26.028738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3dac1dca-3fdb-4255-b49c-a4a1f7f06387 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] Calling method '.version_select at 0x7f662a2a1790>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:26.149265 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3dac1dca-3fdb-4255-b49c-a4a1f7f06387 tempest-ServerActionsTestJSON-1712674003 tempest-ServerActionsTestJSON-1712674003-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136214815" status: 202 len: 0 microversion: 2.1 time: 0.127897 Oct 10 23:50:26.154477 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2907/5984] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 10 23:50:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136214815 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:50:33.676075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-764592cc-85dd-426f-91d1-672a7810cf15 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:33.677657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-764592cc-85dd-426f-91d1-672a7810cf15 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:33.690893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-764592cc-85dd-426f-91d1-672a7810cf15 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:33.691708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-764592cc-85dd-426f-91d1-672a7810cf15 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:33.692401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-764592cc-85dd-426f-91d1-672a7810cf15 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:33.693912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-764592cc-85dd-426f-91d1-672a7810cf15 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:33.694721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-764592cc-85dd-426f-91d1-672a7810cf15 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:33.695369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-764592cc-85dd-426f-91d1-672a7810cf15 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:34.456673 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-764592cc-85dd-426f-91d1-672a7810cf15 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1834 microversion: 2.1 time: 0.783503 Oct 10 23:50:34.457308 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3078/5985] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:33 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1834 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:34.484333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-447f8d4c-b952-4821-9a1a-afcb81510be7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:34.484960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-447f8d4c-b952-4821-9a1a-afcb81510be7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:34.518313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-447f8d4c-b952-4821-9a1a-afcb81510be7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:34.518812 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-447f8d4c-b952-4821-9a1a-afcb81510be7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:34.519313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-447f8d4c-b952-4821-9a1a-afcb81510be7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:34.519961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-447f8d4c-b952-4821-9a1a-afcb81510be7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:34.543410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-447f8d4c-b952-4821-9a1a-afcb81510be7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:34.543883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-447f8d4c-b952-4821-9a1a-afcb81510be7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:35.627152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-447f8d4c-b952-4821-9a1a-afcb81510be7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:35.642251 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-447f8d4c-b952-4821-9a1a-afcb81510be7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1683 microversion: 2.1 time: 1.158882 Oct 10 23:50:35.643145 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2908/5986] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:34 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1683 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:35.846229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3220eb92-6fcc-4f12-855b-07b2b71d5b78 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:50:35.849340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3220eb92-6fcc-4f12-855b-07b2b71d5b78 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:35.857050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3220eb92-6fcc-4f12-855b-07b2b71d5b78 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:35.857829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3220eb92-6fcc-4f12-855b-07b2b71d5b78 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:35.858599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3220eb92-6fcc-4f12-855b-07b2b71d5b78 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:35.859484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3220eb92-6fcc-4f12-855b-07b2b71d5b78 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:35.860129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3220eb92-6fcc-4f12-855b-07b2b71d5b78 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:35.860917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3220eb92-6fcc-4f12-855b-07b2b71d5b78 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:35.921628 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3220eb92-6fcc-4f12-855b-07b2b71d5b78 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "POST /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb/action" status: 200 len: 32621 microversion: 2.1 time: 0.079039 Oct 10 23:50:35.923149 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3079/5987] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:50:35 2022] POST /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb/action => generated 32621 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:50:36.072486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2b86bb31-e458-475b-942e-53fc73f4d447 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:50:36.073786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2b86bb31-e458-475b-942e-53fc73f4d447 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:36.085186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b86bb31-e458-475b-942e-53fc73f4d447 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:36.087523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b86bb31-e458-475b-942e-53fc73f4d447 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:36.087982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b86bb31-e458-475b-942e-53fc73f4d447 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:36.088704 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b86bb31-e458-475b-942e-53fc73f4d447 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:36.090621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b86bb31-e458-475b-942e-53fc73f4d447 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:36.091141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2b86bb31-e458-475b-942e-53fc73f4d447 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:36.603065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2b86bb31-e458-475b-942e-53fc73f4d447 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '817a705f87a849a8a73d1aafdfd7c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17e3fe005e447d6886023d681e16926', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:36.604772 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2b86bb31-e458-475b-942e-53fc73f4d447 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] flavor_id is None. Assuming migration. {{(pid=120614) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 10 23:50:36.605407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2b86bb31-e458-475b-942e-53fc73f4d447 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120614) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 10 23:50:37.146693 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2b86bb31-e458-475b-942e-53fc73f4d447 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb/action" status: 202 len: 0 microversion: 2.1 time: 1.078490 Oct 10 23:50:37.148452 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2909/5988] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:50:36 2022] POST /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb/action => generated 0 bytes in 1081 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:50:37.157940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-333a343f-1540-4a71-8ba2-39daab4e0a8c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:37.158780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-333a343f-1540-4a71-8ba2-39daab4e0a8c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:37.168840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-333a343f-1540-4a71-8ba2-39daab4e0a8c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:37.169708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-333a343f-1540-4a71-8ba2-39daab4e0a8c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:37.171452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-333a343f-1540-4a71-8ba2-39daab4e0a8c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:37.174796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-333a343f-1540-4a71-8ba2-39daab4e0a8c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:37.176251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-333a343f-1540-4a71-8ba2-39daab4e0a8c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:37.176969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-333a343f-1540-4a71-8ba2-39daab4e0a8c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:37.452822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-333a343f-1540-4a71-8ba2-39daab4e0a8c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:37.465324 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-333a343f-1540-4a71-8ba2-39daab4e0a8c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1692 microversion: 2.1 time: 0.312433 Oct 10 23:50:37.466252 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3080/5989] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:37 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1692 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:38.494598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-99261187-71ed-471c-9600-4fa63638fea9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:38.495832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-99261187-71ed-471c-9600-4fa63638fea9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:38.506220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:50:38.509116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99261187-71ed-471c-9600-4fa63638fea9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:38.510387 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99261187-71ed-471c-9600-4fa63638fea9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:38.511453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99261187-71ed-471c-9600-4fa63638fea9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:38.512567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99261187-71ed-471c-9600-4fa63638fea9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:38.513317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99261187-71ed-471c-9600-4fa63638fea9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:38.514016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-99261187-71ed-471c-9600-4fa63638fea9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:39.071432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-99261187-71ed-471c-9600-4fa63638fea9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:39.089663 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-99261187-71ed-471c-9600-4fa63638fea9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1692 microversion: 2.1 time: 0.596392 Oct 10 23:50:39.116548 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2910/5990] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:38 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1692 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:40.128974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2675eb3f-8a21-4992-a446-6855049d9d7a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:40.129804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2675eb3f-8a21-4992-a446-6855049d9d7a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:40.176032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2675eb3f-8a21-4992-a446-6855049d9d7a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:40.179341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2675eb3f-8a21-4992-a446-6855049d9d7a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:40.187650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2675eb3f-8a21-4992-a446-6855049d9d7a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:40.190433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2675eb3f-8a21-4992-a446-6855049d9d7a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:40.191124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2675eb3f-8a21-4992-a446-6855049d9d7a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:40.196377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2675eb3f-8a21-4992-a446-6855049d9d7a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:41.088985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2675eb3f-8a21-4992-a446-6855049d9d7a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:41.102227 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2675eb3f-8a21-4992-a446-6855049d9d7a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1692 microversion: 2.1 time: 0.980900 Oct 10 23:50:41.114466 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3081/5991] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:40 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1692 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:42.129093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-867bf598-b93c-4694-9566-38f416c6bb9f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:42.129723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-867bf598-b93c-4694-9566-38f416c6bb9f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:42.143016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-867bf598-b93c-4694-9566-38f416c6bb9f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:42.146595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-867bf598-b93c-4694-9566-38f416c6bb9f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:42.147266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-867bf598-b93c-4694-9566-38f416c6bb9f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:42.149300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-867bf598-b93c-4694-9566-38f416c6bb9f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:42.152041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-867bf598-b93c-4694-9566-38f416c6bb9f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:42.152709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-867bf598-b93c-4694-9566-38f416c6bb9f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:42.840477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-867bf598-b93c-4694-9566-38f416c6bb9f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:42.843298 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:50:42.871433 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-867bf598-b93c-4694-9566-38f416c6bb9f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1692 microversion: 2.1 time: 0.746679 Oct 10 23:50:42.890714 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2911/5992] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:42 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1692 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:43.898142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6461517e-c02e-43ab-bb99-342a44a361c7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:43.899900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6461517e-c02e-43ab-bb99-342a44a361c7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:43.922570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:50:43.926918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6461517e-c02e-43ab-bb99-342a44a361c7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:43.931838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6461517e-c02e-43ab-bb99-342a44a361c7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:43.936521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6461517e-c02e-43ab-bb99-342a44a361c7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:43.941227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6461517e-c02e-43ab-bb99-342a44a361c7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:43.943235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6461517e-c02e-43ab-bb99-342a44a361c7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:43.945269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6461517e-c02e-43ab-bb99-342a44a361c7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:44.023894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:50:45.003908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6461517e-c02e-43ab-bb99-342a44a361c7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:45.020523 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6461517e-c02e-43ab-bb99-342a44a361c7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1697 microversion: 2.1 time: 1.127219 Oct 10 23:50:45.021150 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3082/5993] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:43 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1697 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:46.052895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-227648fe-e821-45a3-98ed-42af6e53d1d4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:46.056406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-227648fe-e821-45a3-98ed-42af6e53d1d4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:46.066756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-227648fe-e821-45a3-98ed-42af6e53d1d4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:46.067512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-227648fe-e821-45a3-98ed-42af6e53d1d4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:46.068119 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-227648fe-e821-45a3-98ed-42af6e53d1d4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:46.069283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-227648fe-e821-45a3-98ed-42af6e53d1d4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:46.069929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-227648fe-e821-45a3-98ed-42af6e53d1d4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:46.070610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-227648fe-e821-45a3-98ed-42af6e53d1d4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:46.621469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-227648fe-e821-45a3-98ed-42af6e53d1d4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:46.635927 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-227648fe-e821-45a3-98ed-42af6e53d1d4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1697 microversion: 2.1 time: 0.592186 Oct 10 23:50:46.636690 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2912/5994] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:46 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1697 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:47.666501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bf9be0d4-92f5-46b2-8be9-7d987df3016c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:47.667850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bf9be0d4-92f5-46b2-8be9-7d987df3016c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:47.682569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf9be0d4-92f5-46b2-8be9-7d987df3016c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:47.684466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf9be0d4-92f5-46b2-8be9-7d987df3016c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:47.685180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf9be0d4-92f5-46b2-8be9-7d987df3016c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:47.690377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf9be0d4-92f5-46b2-8be9-7d987df3016c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:47.691208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf9be0d4-92f5-46b2-8be9-7d987df3016c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:47.691893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf9be0d4-92f5-46b2-8be9-7d987df3016c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:48.262879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bf9be0d4-92f5-46b2-8be9-7d987df3016c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:48.277530 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bf9be0d4-92f5-46b2-8be9-7d987df3016c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1697 microversion: 2.1 time: 0.615894 Oct 10 23:50:48.282450 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3083/5995] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:47 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1697 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:49.310277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-018bbfbe-0f74-4bbe-90ef-8d5befe066e0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:49.312561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-018bbfbe-0f74-4bbe-90ef-8d5befe066e0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:49.335929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-018bbfbe-0f74-4bbe-90ef-8d5befe066e0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:49.336622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-018bbfbe-0f74-4bbe-90ef-8d5befe066e0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:49.337259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-018bbfbe-0f74-4bbe-90ef-8d5befe066e0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:49.338213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-018bbfbe-0f74-4bbe-90ef-8d5befe066e0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:49.339310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-018bbfbe-0f74-4bbe-90ef-8d5befe066e0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:49.339730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-018bbfbe-0f74-4bbe-90ef-8d5befe066e0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:50.045351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-018bbfbe-0f74-4bbe-90ef-8d5befe066e0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:50.064024 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-018bbfbe-0f74-4bbe-90ef-8d5befe066e0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1697 microversion: 2.1 time: 0.760054 Oct 10 23:50:50.083010 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2913/5996] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:49 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1697 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:51.102687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-874da036-8ed6-4bd7-b05a-bcd898750395 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:51.103279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-874da036-8ed6-4bd7-b05a-bcd898750395 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:51.116934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-874da036-8ed6-4bd7-b05a-bcd898750395 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:51.117474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-874da036-8ed6-4bd7-b05a-bcd898750395 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:51.117932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-874da036-8ed6-4bd7-b05a-bcd898750395 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:51.119815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-874da036-8ed6-4bd7-b05a-bcd898750395 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:51.121017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-874da036-8ed6-4bd7-b05a-bcd898750395 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:51.122661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-874da036-8ed6-4bd7-b05a-bcd898750395 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:51.349641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-874da036-8ed6-4bd7-b05a-bcd898750395 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:51.362431 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-874da036-8ed6-4bd7-b05a-bcd898750395 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1697 microversion: 2.1 time: 0.259125 Oct 10 23:50:51.374069 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3084/5997] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:51 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1697 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:52.391131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8f421760-c199-43b8-8a85-4a8d1a2920af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:52.391886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8f421760-c199-43b8-8a85-4a8d1a2920af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:52.402889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f421760-c199-43b8-8a85-4a8d1a2920af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:52.413859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f421760-c199-43b8-8a85-4a8d1a2920af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:52.414425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f421760-c199-43b8-8a85-4a8d1a2920af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:52.415215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f421760-c199-43b8-8a85-4a8d1a2920af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:52.415697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f421760-c199-43b8-8a85-4a8d1a2920af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:52.416156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f421760-c199-43b8-8a85-4a8d1a2920af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:52.831365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8f421760-c199-43b8-8a85-4a8d1a2920af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:52.845702 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8f421760-c199-43b8-8a85-4a8d1a2920af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1697 microversion: 2.1 time: 0.455193 Oct 10 23:50:52.846703 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2914/5998] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:52 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1697 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:53.873139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-83ba428b-0be4-4745-9c52-42c03f163371 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:53.874485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-83ba428b-0be4-4745-9c52-42c03f163371 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:53.887010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83ba428b-0be4-4745-9c52-42c03f163371 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:53.887518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83ba428b-0be4-4745-9c52-42c03f163371 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:53.887956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83ba428b-0be4-4745-9c52-42c03f163371 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:53.888673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83ba428b-0be4-4745-9c52-42c03f163371 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:53.889134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83ba428b-0be4-4745-9c52-42c03f163371 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:53.890341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83ba428b-0be4-4745-9c52-42c03f163371 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:54.691578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-83ba428b-0be4-4745-9c52-42c03f163371 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:54.725047 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-83ba428b-0be4-4745-9c52-42c03f163371 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1697 microversion: 2.1 time: 0.851356 Oct 10 23:50:54.752181 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3085/5999] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:53 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1697 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:55.767163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5287a214-63cf-4ad0-ad81-414eae5be139 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:55.776124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5287a214-63cf-4ad0-ad81-414eae5be139 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:55.791106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5287a214-63cf-4ad0-ad81-414eae5be139 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:55.798254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5287a214-63cf-4ad0-ad81-414eae5be139 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:55.799164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5287a214-63cf-4ad0-ad81-414eae5be139 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:55.799958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5287a214-63cf-4ad0-ad81-414eae5be139 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:55.800501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5287a214-63cf-4ad0-ad81-414eae5be139 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:55.801044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5287a214-63cf-4ad0-ad81-414eae5be139 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:56.104693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8672f32b-0a08-45bb-b2d8-ffd26f100c76 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-644687152", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "d10c7ff6-c165-4497-b626-5f8f26847b4a"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:50:56.268608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-8672f32b-0a08-45bb-b2d8-ffd26f100c76 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] validate_networks() for [('d10c7ff6-c165-4497-b626-5f8f26847b4a', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:50:56.472068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5287a214-63cf-4ad0-ad81-414eae5be139 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:56.484722 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5287a214-63cf-4ad0-ad81-414eae5be139 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1696 microversion: 2.1 time: 0.724257 Oct 10 23:50:56.488862 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3086/6000] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:55 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1696 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:57.522901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bd17fe30-af05-4770-b6c3-a79511be6fae tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:57.525703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bd17fe30-af05-4770-b6c3-a79511be6fae tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:57.543008 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-8672f32b-0a08-45bb-b2d8-ffd26f100c76 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:50:57.544148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-8672f32b-0a08-45bb-b2d8-ffd26f100c76 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:50:57.544980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-8672f32b-0a08-45bb-b2d8-ffd26f100c76 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:50:57.546448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-8672f32b-0a08-45bb-b2d8-ffd26f100c76 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:50:57.546943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd17fe30-af05-4770-b6c3-a79511be6fae tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:57.547364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-8672f32b-0a08-45bb-b2d8-ffd26f100c76 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:50:57.549206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd17fe30-af05-4770-b6c3-a79511be6fae tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:57.550480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd17fe30-af05-4770-b6c3-a79511be6fae tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:57.567368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd17fe30-af05-4770-b6c3-a79511be6fae tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:57.572599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd17fe30-af05-4770-b6c3-a79511be6fae tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:57.574067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8672f32b-0a08-45bb-b2d8-ffd26f100c76 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:57.574622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd17fe30-af05-4770-b6c3-a79511be6fae tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:57.576416 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8672f32b-0a08-45bb-b2d8-ffd26f100c76 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:57.580126 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8672f32b-0a08-45bb-b2d8-ffd26f100c76 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:57.581154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8672f32b-0a08-45bb-b2d8-ffd26f100c76 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:57.584481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8672f32b-0a08-45bb-b2d8-ffd26f100c76 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:57.584969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8672f32b-0a08-45bb-b2d8-ffd26f100c76 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:57.654117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-8672f32b-0a08-45bb-b2d8-ffd26f100c76 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Getting quotas for project 26524bca9d5f46ed9979c2196265a2c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:50:57.667949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-8672f32b-0a08-45bb-b2d8-ffd26f100c76 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Getting quotas for user 7109b198f86b41f7a1746842b61752ab and project 26524bca9d5f46ed9979c2196265a2c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:50:57.707972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8672f32b-0a08-45bb-b2d8-ffd26f100c76 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:50:57.718620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8672f32b-0a08-45bb-b2d8-ffd26f100c76 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] [instance: 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:50:57.846848 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8672f32b-0a08-45bb-b2d8-ffd26f100c76 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.309029 Oct 10 23:50:57.847544 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2915/6001] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:50:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:50:57.869670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9c579432-62ea-4d62-91d3-56786ec3be88 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:57.876362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9c579432-62ea-4d62-91d3-56786ec3be88 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] [instance: 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:58.181920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9c579432-62ea-4d62-91d3-56786ec3be88 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109b198f86b41f7a1746842b61752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26524bca9d5f46ed9979c2196265a2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:58.194043 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9c579432-62ea-4d62-91d3-56786ec3be88 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] 10.222.0.23 "GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35" status: 200 len: 1213 microversion: 2.1 time: 0.336465 Oct 10 23:50:58.194843 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2916/6002] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:57 2022] GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 => generated 1213 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:58.692004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-67274e57-a85d-4840-a379-f7fa7e0d33c5 req-8a41f126-f2d3-4270-b18d-593587456436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbe503a-b7c8-4459-87d9-3655cd54bacb", "name": "network-vif-unplugged", "status": "completed", "tag": "4528ff7b-3e24-4d58-a19b-e57043a8de5d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:50:58.717103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-67274e57-a85d-4840-a379-f7fa7e0d33c5 req-8a41f126-f2d3-4270-b18d-593587456436 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:58.718539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-67274e57-a85d-4840-a379-f7fa7e0d33c5 req-8a41f126-f2d3-4270-b18d-593587456436 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:58.728348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-67274e57-a85d-4840-a379-f7fa7e0d33c5 req-8a41f126-f2d3-4270-b18d-593587456436 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:58.753874 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-67274e57-a85d-4840-a379-f7fa7e0d33c5 req-8a41f126-f2d3-4270-b18d-593587456436 service nova] Creating event network-vif-unplugged:4528ff7b-3e24-4d58-a19b-e57043a8de5d for instance ccbe503a-b7c8-4459-87d9-3655cd54bacb on n-h1-860864-2 Oct 10 23:50:58.767092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [req-67274e57-a85d-4840-a379-f7fa7e0d33c5 req-8a41f126-f2d3-4270-b18d-593587456436 service nova] Instance ccbe503a-b7c8-4459-87d9-3655cd54bacb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 23:50:58.799146 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-67274e57-a85d-4840-a379-f7fa7e0d33c5 req-8a41f126-f2d3-4270-b18d-593587456436 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113385 Oct 10 23:50:58.800061 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2917/6003] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:50:58.829688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bd17fe30-af05-4770-b6c3-a79511be6fae tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:58.847499 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bd17fe30-af05-4770-b6c3-a79511be6fae tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1696 microversion: 2.1 time: 1.334085 Oct 10 23:50:58.849356 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3087/6004] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:57 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1696 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:50:59.223849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0a0b3c42-eb65-4d78-bbea-32d63b781b5d tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:59.224885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0a0b3c42-eb65-4d78-bbea-32d63b781b5d tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] [instance: 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:59.232937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a0b3c42-eb65-4d78-bbea-32d63b781b5d tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:59.238653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a0b3c42-eb65-4d78-bbea-32d63b781b5d tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:59.239505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a0b3c42-eb65-4d78-bbea-32d63b781b5d tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:59.240473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a0b3c42-eb65-4d78-bbea-32d63b781b5d tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:59.241927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a0b3c42-eb65-4d78-bbea-32d63b781b5d tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:59.246766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0a0b3c42-eb65-4d78-bbea-32d63b781b5d tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:59.570677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0a0b3c42-eb65-4d78-bbea-32d63b781b5d tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109b198f86b41f7a1746842b61752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26524bca9d5f46ed9979c2196265a2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:50:59.588851 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0a0b3c42-eb65-4d78-bbea-32d63b781b5d tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] 10.222.0.23 "GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35" status: 200 len: 1217 microversion: 2.1 time: 0.370916 Oct 10 23:50:59.589477 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2918/6005] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:59 2022] GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 => generated 1217 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:50:59.877139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9232e32e-b374-4632-889d-c071d591cc37 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:50:59.877976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9232e32e-b374-4632-889d-c071d591cc37 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:50:59.902059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9232e32e-b374-4632-889d-c071d591cc37 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:59.907630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9232e32e-b374-4632-889d-c071d591cc37 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:59.908574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9232e32e-b374-4632-889d-c071d591cc37 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:50:59.916027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9232e32e-b374-4632-889d-c071d591cc37 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:50:59.917175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9232e32e-b374-4632-889d-c071d591cc37 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:50:59.918544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9232e32e-b374-4632-889d-c071d591cc37 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:00.617277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6db74c56-43cd-488a-a87e-761d485ad6e5 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:00.618824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6db74c56-43cd-488a-a87e-761d485ad6e5 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] [instance: 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:00.637341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6db74c56-43cd-488a-a87e-761d485ad6e5 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:00.638421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6db74c56-43cd-488a-a87e-761d485ad6e5 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:00.639794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6db74c56-43cd-488a-a87e-761d485ad6e5 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:00.644252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6db74c56-43cd-488a-a87e-761d485ad6e5 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:00.645107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6db74c56-43cd-488a-a87e-761d485ad6e5 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:00.645939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6db74c56-43cd-488a-a87e-761d485ad6e5 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:00.901182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9232e32e-b374-4632-889d-c071d591cc37 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:00.930528 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9232e32e-b374-4632-889d-c071d591cc37 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1696 microversion: 2.1 time: 1.058072 Oct 10 23:51:00.931757 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3088/6006] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:50:59 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1696 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:00.966728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6db74c56-43cd-488a-a87e-761d485ad6e5 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109b198f86b41f7a1746842b61752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26524bca9d5f46ed9979c2196265a2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:01.009900 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6db74c56-43cd-488a-a87e-761d485ad6e5 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] 10.222.0.23 "GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35" status: 200 len: 1271 microversion: 2.1 time: 0.393148 Oct 10 23:51:01.010972 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2919/6007] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:00 2022] GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 => generated 1271 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:01.958845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1ffa9257-b393-4d8c-9138-1f1024706780 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:01.959558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1ffa9257-b393-4d8c-9138-1f1024706780 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:01.970510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ffa9257-b393-4d8c-9138-1f1024706780 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:01.971012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ffa9257-b393-4d8c-9138-1f1024706780 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:01.988237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ffa9257-b393-4d8c-9138-1f1024706780 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:01.989596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ffa9257-b393-4d8c-9138-1f1024706780 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:01.992918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ffa9257-b393-4d8c-9138-1f1024706780 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:01.993626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ffa9257-b393-4d8c-9138-1f1024706780 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:02.059131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-73950d65-2005-4adb-918e-4b0553e8dcb1 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:02.065662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-73950d65-2005-4adb-918e-4b0553e8dcb1 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] [instance: 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:02.089693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73950d65-2005-4adb-918e-4b0553e8dcb1 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:02.090359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73950d65-2005-4adb-918e-4b0553e8dcb1 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:02.091853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73950d65-2005-4adb-918e-4b0553e8dcb1 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:02.094992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73950d65-2005-4adb-918e-4b0553e8dcb1 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:02.096899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73950d65-2005-4adb-918e-4b0553e8dcb1 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:02.097603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73950d65-2005-4adb-918e-4b0553e8dcb1 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:02.222221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-73950d65-2005-4adb-918e-4b0553e8dcb1 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109b198f86b41f7a1746842b61752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26524bca9d5f46ed9979c2196265a2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:02.231161 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-73950d65-2005-4adb-918e-4b0553e8dcb1 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] 10.222.0.23 "GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35" status: 200 len: 1271 microversion: 2.1 time: 0.196330 Oct 10 23:51:02.232156 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2920/6008] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:02 2022] GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 => generated 1271 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:02.305081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-a3ddc89e-d6a9-4206-b06a-4d84e323c517 req-16c095ab-04d8-4f5f-adc1-5effa44d1975 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccbe503a-b7c8-4459-87d9-3655cd54bacb", "tag": "4528ff7b-3e24-4d58-a19b-e57043a8de5d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:51:02.326589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a3ddc89e-d6a9-4206-b06a-4d84e323c517 req-16c095ab-04d8-4f5f-adc1-5effa44d1975 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:02.328583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a3ddc89e-d6a9-4206-b06a-4d84e323c517 req-16c095ab-04d8-4f5f-adc1-5effa44d1975 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:02.329235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a3ddc89e-d6a9-4206-b06a-4d84e323c517 req-16c095ab-04d8-4f5f-adc1-5effa44d1975 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:02.342122 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-a3ddc89e-d6a9-4206-b06a-4d84e323c517 req-16c095ab-04d8-4f5f-adc1-5effa44d1975 service nova] Creating event network-changed:4528ff7b-3e24-4d58-a19b-e57043a8de5d for instance ccbe503a-b7c8-4459-87d9-3655cd54bacb on n-h1-860864-2 Oct 10 23:51:02.351080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [req-a3ddc89e-d6a9-4206-b06a-4d84e323c517 req-16c095ab-04d8-4f5f-adc1-5effa44d1975 service nova] Instance ccbe503a-b7c8-4459-87d9-3655cd54bacb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 23:51:02.364345 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-a3ddc89e-d6a9-4206-b06a-4d84e323c517 req-16c095ab-04d8-4f5f-adc1-5effa44d1975 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062888 Oct 10 23:51:02.365325 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2921/6009] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:51:02.704108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1ffa9257-b393-4d8c-9138-1f1024706780 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:02.719441 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1ffa9257-b393-4d8c-9138-1f1024706780 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1696 microversion: 2.1 time: 0.764581 Oct 10 23:51:02.741086 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3089/6010] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:01 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1696 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:03.259235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dd6dea9e-ae13-4921-9d82-45a5663fc2a3 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:03.260710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dd6dea9e-ae13-4921-9d82-45a5663fc2a3 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] [instance: 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:03.286345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd6dea9e-ae13-4921-9d82-45a5663fc2a3 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:03.286974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd6dea9e-ae13-4921-9d82-45a5663fc2a3 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:03.287492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd6dea9e-ae13-4921-9d82-45a5663fc2a3 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:03.288649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd6dea9e-ae13-4921-9d82-45a5663fc2a3 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:03.289218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd6dea9e-ae13-4921-9d82-45a5663fc2a3 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:03.290113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd6dea9e-ae13-4921-9d82-45a5663fc2a3 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:03.740638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dd6dea9e-ae13-4921-9d82-45a5663fc2a3 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109b198f86b41f7a1746842b61752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26524bca9d5f46ed9979c2196265a2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:03.752874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d812fe07-05e0-412f-b34c-acd665844b32 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:03.754601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d812fe07-05e0-412f-b34c-acd665844b32 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:03.770452 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dd6dea9e-ae13-4921-9d82-45a5663fc2a3 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] 10.222.0.23 "GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35" status: 200 len: 1313 microversion: 2.1 time: 0.517666 Oct 10 23:51:03.802861 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2922/6011] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:03 2022] GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 => generated 1313 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:51:03.805133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d812fe07-05e0-412f-b34c-acd665844b32 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:03.806277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d812fe07-05e0-412f-b34c-acd665844b32 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:03.807762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d812fe07-05e0-412f-b34c-acd665844b32 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:03.808774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d812fe07-05e0-412f-b34c-acd665844b32 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:03.809537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d812fe07-05e0-412f-b34c-acd665844b32 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:03.810229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d812fe07-05e0-412f-b34c-acd665844b32 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:04.553401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d812fe07-05e0-412f-b34c-acd665844b32 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:04.564012 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d812fe07-05e0-412f-b34c-acd665844b32 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1696 microversion: 2.1 time: 0.815191 Oct 10 23:51:04.565452 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3090/6012] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:03 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1696 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:51:04.834687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-584a85dc-991f-4328-9987-e252d4f59063 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:04.835936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-584a85dc-991f-4328-9987-e252d4f59063 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] [instance: 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:04.853596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-584a85dc-991f-4328-9987-e252d4f59063 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:04.854292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-584a85dc-991f-4328-9987-e252d4f59063 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:04.854908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-584a85dc-991f-4328-9987-e252d4f59063 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:04.855811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-584a85dc-991f-4328-9987-e252d4f59063 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:04.856279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-584a85dc-991f-4328-9987-e252d4f59063 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:04.856723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-584a85dc-991f-4328-9987-e252d4f59063 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:05.592404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e0ecc17f-ae7b-48ad-b2ef-94e31d588157 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:05.594164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e0ecc17f-ae7b-48ad-b2ef-94e31d588157 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:05.603561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0ecc17f-ae7b-48ad-b2ef-94e31d588157 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:05.604046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0ecc17f-ae7b-48ad-b2ef-94e31d588157 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:05.606066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0ecc17f-ae7b-48ad-b2ef-94e31d588157 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:05.607463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0ecc17f-ae7b-48ad-b2ef-94e31d588157 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:05.608412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0ecc17f-ae7b-48ad-b2ef-94e31d588157 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:05.611461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0ecc17f-ae7b-48ad-b2ef-94e31d588157 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:05.873904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-584a85dc-991f-4328-9987-e252d4f59063 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109b198f86b41f7a1746842b61752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26524bca9d5f46ed9979c2196265a2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:05.883705 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-584a85dc-991f-4328-9987-e252d4f59063 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] 10.222.0.23 "GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35" status: 200 len: 1313 microversion: 2.1 time: 1.073644 Oct 10 23:51:05.886170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e0ecc17f-ae7b-48ad-b2ef-94e31d588157 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:05.893676 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2923/6013] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:04 2022] GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 => generated 1313 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:05.924031 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e0ecc17f-ae7b-48ad-b2ef-94e31d588157 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1694 microversion: 2.1 time: 0.335601 Oct 10 23:51:05.938573 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3091/6014] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:05 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1694 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:06.689700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-5e2b9bf6-bac4-4c26-97d7-9ec8ec636bcd req-b0b57586-d3ac-4d44-a713-a133099355ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35", "tag": "56714c2b-5a33-4f42-a7e3-fae7f6f80cf4"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:51:06.708768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5e2b9bf6-bac4-4c26-97d7-9ec8ec636bcd req-b0b57586-d3ac-4d44-a713-a133099355ae service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:06.710300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5e2b9bf6-bac4-4c26-97d7-9ec8ec636bcd req-b0b57586-d3ac-4d44-a713-a133099355ae service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:06.710982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5e2b9bf6-bac4-4c26-97d7-9ec8ec636bcd req-b0b57586-d3ac-4d44-a713-a133099355ae service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:06.729332 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-5e2b9bf6-bac4-4c26-97d7-9ec8ec636bcd req-b0b57586-d3ac-4d44-a713-a133099355ae service nova] Creating event network-changed:56714c2b-5a33-4f42-a7e3-fae7f6f80cf4 for instance 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 on n-h1-860864-2 Oct 10 23:51:06.738697 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-5e2b9bf6-bac4-4c26-97d7-9ec8ec636bcd req-b0b57586-d3ac-4d44-a713-a133099355ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053094 Oct 10 23:51:06.741973 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2924/6015] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:51:06.909963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f37bf728-f919-4648-8fce-7d5c85bd63fa tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:06.912604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f37bf728-f919-4648-8fce-7d5c85bd63fa tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] [instance: 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:06.923475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f37bf728-f919-4648-8fce-7d5c85bd63fa tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:06.924223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f37bf728-f919-4648-8fce-7d5c85bd63fa tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:06.925319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f37bf728-f919-4648-8fce-7d5c85bd63fa tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:06.926150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f37bf728-f919-4648-8fce-7d5c85bd63fa tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:06.926682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f37bf728-f919-4648-8fce-7d5c85bd63fa tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:06.927183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f37bf728-f919-4648-8fce-7d5c85bd63fa tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:07.066242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5d04db16-25fd-402e-9024-b0d09277e564 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-405426434", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "1b9324eb-0538-494a-aa7c-8557e297b166"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:51:07.129006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-5d04db16-25fd-402e-9024-b0d09277e564 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] validate_networks() for [('1b9324eb-0538-494a-aa7c-8557e297b166', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:51:07.422569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f37bf728-f919-4648-8fce-7d5c85bd63fa tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109b198f86b41f7a1746842b61752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26524bca9d5f46ed9979c2196265a2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:07.441689 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f37bf728-f919-4648-8fce-7d5c85bd63fa tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] 10.222.0.23 "GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35" status: 200 len: 1313 microversion: 2.1 time: 0.535967 Oct 10 23:51:07.444025 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3092/6016] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:06 2022] GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 => generated 1313 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:07.454658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-33647052-1bf3-46e9-9d8d-01dd92832df7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:07.456460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-33647052-1bf3-46e9-9d8d-01dd92832df7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:07.467581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33647052-1bf3-46e9-9d8d-01dd92832df7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:07.468983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33647052-1bf3-46e9-9d8d-01dd92832df7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:07.469664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33647052-1bf3-46e9-9d8d-01dd92832df7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:07.470567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33647052-1bf3-46e9-9d8d-01dd92832df7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:07.471179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33647052-1bf3-46e9-9d8d-01dd92832df7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:07.474085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33647052-1bf3-46e9-9d8d-01dd92832df7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:07.621085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:51:07.665243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-5d04db16-25fd-402e-9024-b0d09277e564 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:51:07.668650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-5d04db16-25fd-402e-9024-b0d09277e564 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:51:07.669054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-5d04db16-25fd-402e-9024-b0d09277e564 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:51:07.669511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-5d04db16-25fd-402e-9024-b0d09277e564 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:51:07.669932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-5d04db16-25fd-402e-9024-b0d09277e564 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:51:07.679771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d04db16-25fd-402e-9024-b0d09277e564 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:07.680252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d04db16-25fd-402e-9024-b0d09277e564 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:07.680681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d04db16-25fd-402e-9024-b0d09277e564 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:07.681640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d04db16-25fd-402e-9024-b0d09277e564 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:07.683012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d04db16-25fd-402e-9024-b0d09277e564 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:07.684409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5d04db16-25fd-402e-9024-b0d09277e564 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:07.704048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-5d04db16-25fd-402e-9024-b0d09277e564 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Getting quotas for project bff89df509844039922e2499bb4b242a. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:51:07.721471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-5d04db16-25fd-402e-9024-b0d09277e564 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Getting quotas for user 552b1a30eec14157b793b687d0eedb0c and project bff89df509844039922e2499bb4b242a. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:51:07.739927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5d04db16-25fd-402e-9024-b0d09277e564 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:51:07.742994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5d04db16-25fd-402e-9024-b0d09277e564 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] [instance: e0f07489-e1e1-4f2b-b093-47199e9cfad0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:51:07.855747 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5d04db16-25fd-402e-9024-b0d09277e564 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.951591 Oct 10 23:51:07.856829 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2925/6017] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:51:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:51:07.869341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-395817d6-dbc6-406c-8730-bdc321fe8f5b tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:07.872158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-395817d6-dbc6-406c-8730-bdc321fe8f5b tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] [instance: e0f07489-e1e1-4f2b-b093-47199e9cfad0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:08.228308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-33647052-1bf3-46e9-9d8d-01dd92832df7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:08.247925 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-33647052-1bf3-46e9-9d8d-01dd92832df7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1694 microversion: 2.1 time: 0.794784 Oct 10 23:51:08.248870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-395817d6-dbc6-406c-8730-bdc321fe8f5b tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552b1a30eec14157b793b687d0eedb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff89df509844039922e2499bb4b242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:08.252493 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3093/6018] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:07 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1694 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:08.273921 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-395817d6-dbc6-406c-8730-bdc321fe8f5b tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] 10.222.0.23 "GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0" status: 200 len: 1227 microversion: 2.1 time: 0.409359 Oct 10 23:51:08.274713 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2926/6019] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:07 2022] GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0 => generated 1227 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:51:08.479630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0dbc0925-20fb-4d15-93c0-de4b4a0bdf3b tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:08.480544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0dbc0925-20fb-4d15-93c0-de4b4a0bdf3b tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] [instance: 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:08.495578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0dbc0925-20fb-4d15-93c0-de4b4a0bdf3b tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:08.496350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0dbc0925-20fb-4d15-93c0-de4b4a0bdf3b tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:08.497029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0dbc0925-20fb-4d15-93c0-de4b4a0bdf3b tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:08.498010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0dbc0925-20fb-4d15-93c0-de4b4a0bdf3b tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:08.499546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0dbc0925-20fb-4d15-93c0-de4b4a0bdf3b tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:08.500263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0dbc0925-20fb-4d15-93c0-de4b4a0bdf3b tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:09.159943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0dbc0925-20fb-4d15-93c0-de4b4a0bdf3b tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109b198f86b41f7a1746842b61752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26524bca9d5f46ed9979c2196265a2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:09.203012 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0dbc0925-20fb-4d15-93c0-de4b4a0bdf3b tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] 10.222.0.23 "GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35" status: 200 len: 1313 microversion: 2.1 time: 0.731930 Oct 10 23:51:09.208619 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3094/6020] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:08 2022] GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 => generated 1313 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:09.284585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b05cdd1e-155d-46c0-bc71-aa0bb8ece0dc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:09.286053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b05cdd1e-155d-46c0-bc71-aa0bb8ece0dc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:09.293006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:51:09.308704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9115b68d-609e-408c-ae86-dc50ae61af79 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:09.309988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9115b68d-609e-408c-ae86-dc50ae61af79 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] [instance: e0f07489-e1e1-4f2b-b093-47199e9cfad0] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:09.318878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b05cdd1e-155d-46c0-bc71-aa0bb8ece0dc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:09.320777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b05cdd1e-155d-46c0-bc71-aa0bb8ece0dc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:09.322836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b05cdd1e-155d-46c0-bc71-aa0bb8ece0dc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:09.326030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b05cdd1e-155d-46c0-bc71-aa0bb8ece0dc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:09.327686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b05cdd1e-155d-46c0-bc71-aa0bb8ece0dc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:09.328660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b05cdd1e-155d-46c0-bc71-aa0bb8ece0dc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:09.339363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9115b68d-609e-408c-ae86-dc50ae61af79 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:09.340038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9115b68d-609e-408c-ae86-dc50ae61af79 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:09.340500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9115b68d-609e-408c-ae86-dc50ae61af79 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:09.341241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9115b68d-609e-408c-ae86-dc50ae61af79 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:09.344254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9115b68d-609e-408c-ae86-dc50ae61af79 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:09.346666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9115b68d-609e-408c-ae86-dc50ae61af79 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:09.544498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9115b68d-609e-408c-ae86-dc50ae61af79 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552b1a30eec14157b793b687d0eedb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff89df509844039922e2499bb4b242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:09.566134 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9115b68d-609e-408c-ae86-dc50ae61af79 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] 10.222.0.23 "GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0" status: 200 len: 1279 microversion: 2.1 time: 0.258280 Oct 10 23:51:09.567240 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3095/6021] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:09 2022] GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0 => generated 1279 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:09.939975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b05cdd1e-155d-46c0-bc71-aa0bb8ece0dc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:09.956087 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b05cdd1e-155d-46c0-bc71-aa0bb8ece0dc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1691 microversion: 2.1 time: 0.679472 Oct 10 23:51:09.978977 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2927/6022] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:09 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1691 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:09.983402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1c84888a-2bdf-4276-a83c-6fc6080b1b07 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:51:09.984798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1c84888a-2bdf-4276-a83c-6fc6080b1b07 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:10.002880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c84888a-2bdf-4276-a83c-6fc6080b1b07 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:10.005319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c84888a-2bdf-4276-a83c-6fc6080b1b07 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:10.006411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c84888a-2bdf-4276-a83c-6fc6080b1b07 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:10.007453 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c84888a-2bdf-4276-a83c-6fc6080b1b07 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:10.008423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c84888a-2bdf-4276-a83c-6fc6080b1b07 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:10.009145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c84888a-2bdf-4276-a83c-6fc6080b1b07 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:10.109323 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1c84888a-2bdf-4276-a83c-6fc6080b1b07 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "POST /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb/action" status: 204 len: 0 microversion: 2.1 time: 0.130128 Oct 10 23:51:10.110800 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3096/6023] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:51:09 2022] POST /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb/action => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:51:10.118983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dc0b1967-416c-419e-84d3-5f760a0d33a8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:10.119597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dc0b1967-416c-419e-84d3-5f760a0d33a8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:10.127723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc0b1967-416c-419e-84d3-5f760a0d33a8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:10.128608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc0b1967-416c-419e-84d3-5f760a0d33a8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:10.129234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc0b1967-416c-419e-84d3-5f760a0d33a8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:10.130165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc0b1967-416c-419e-84d3-5f760a0d33a8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:10.130924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc0b1967-416c-419e-84d3-5f760a0d33a8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:10.131505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc0b1967-416c-419e-84d3-5f760a0d33a8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:10.235138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fc4bde9d-d116-4cd7-9936-5fa5d4abd0f2 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:10.236112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fc4bde9d-d116-4cd7-9936-5fa5d4abd0f2 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] [instance: 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:10.257945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc4bde9d-d116-4cd7-9936-5fa5d4abd0f2 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:10.258513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc4bde9d-d116-4cd7-9936-5fa5d4abd0f2 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:10.258969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc4bde9d-d116-4cd7-9936-5fa5d4abd0f2 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:10.259768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc4bde9d-d116-4cd7-9936-5fa5d4abd0f2 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:10.261658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc4bde9d-d116-4cd7-9936-5fa5d4abd0f2 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:10.262115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc4bde9d-d116-4cd7-9936-5fa5d4abd0f2 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:10.311169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:51:10.870487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fc4bde9d-d116-4cd7-9936-5fa5d4abd0f2 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109b198f86b41f7a1746842b61752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26524bca9d5f46ed9979c2196265a2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:10.884851 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fc4bde9d-d116-4cd7-9936-5fa5d4abd0f2 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] 10.222.0.23 "GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35" status: 200 len: 1313 microversion: 2.1 time: 0.654497 Oct 10 23:51:10.897590 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3097/6024] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:10 2022] GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 => generated 1313 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:10.916605 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-09a2ea48-869d-4241-9e30-8a22d629355a tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:10.925222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-09a2ea48-869d-4241-9e30-8a22d629355a tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] [instance: e0f07489-e1e1-4f2b-b093-47199e9cfad0] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:10.951962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09a2ea48-869d-4241-9e30-8a22d629355a tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:10.952984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09a2ea48-869d-4241-9e30-8a22d629355a tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:10.953697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09a2ea48-869d-4241-9e30-8a22d629355a tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:10.954843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09a2ea48-869d-4241-9e30-8a22d629355a tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:10.966298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09a2ea48-869d-4241-9e30-8a22d629355a tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:10.967179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09a2ea48-869d-4241-9e30-8a22d629355a tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:11.159623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-09a2ea48-869d-4241-9e30-8a22d629355a tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552b1a30eec14157b793b687d0eedb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff89df509844039922e2499bb4b242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:11.176589 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-09a2ea48-869d-4241-9e30-8a22d629355a tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] 10.222.0.23 "GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0" status: 200 len: 1285 microversion: 2.1 time: 0.277595 Oct 10 23:51:11.178042 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3098/6025] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:10 2022] GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0 => generated 1285 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:11.580135 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dc0b1967-416c-419e-84d3-5f760a0d33a8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:11.601144 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dc0b1967-416c-419e-84d3-5f760a0d33a8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1691 microversion: 2.1 time: 1.484868 Oct 10 23:51:11.619800 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2928/6026] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:10 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1691 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:11.912927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7779365a-6295-4712-a07e-48ae9a36801e tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:11.914622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7779365a-6295-4712-a07e-48ae9a36801e tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] [instance: 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:11.924435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7779365a-6295-4712-a07e-48ae9a36801e tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:11.925306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7779365a-6295-4712-a07e-48ae9a36801e tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:11.926190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7779365a-6295-4712-a07e-48ae9a36801e tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:11.927136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7779365a-6295-4712-a07e-48ae9a36801e tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:11.927827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7779365a-6295-4712-a07e-48ae9a36801e tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:11.928483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7779365a-6295-4712-a07e-48ae9a36801e tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:12.219999 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-53cb9b4f-7511-427b-86eb-72a7bd194ea3 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:12.220712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-53cb9b4f-7511-427b-86eb-72a7bd194ea3 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] [instance: e0f07489-e1e1-4f2b-b093-47199e9cfad0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:12.227633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53cb9b4f-7511-427b-86eb-72a7bd194ea3 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:12.228445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53cb9b4f-7511-427b-86eb-72a7bd194ea3 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:12.228953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53cb9b4f-7511-427b-86eb-72a7bd194ea3 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:12.229814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53cb9b4f-7511-427b-86eb-72a7bd194ea3 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:12.230513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53cb9b4f-7511-427b-86eb-72a7bd194ea3 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:12.231681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53cb9b4f-7511-427b-86eb-72a7bd194ea3 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:12.339345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7779365a-6295-4712-a07e-48ae9a36801e tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109b198f86b41f7a1746842b61752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26524bca9d5f46ed9979c2196265a2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:12.350153 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7779365a-6295-4712-a07e-48ae9a36801e tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] 10.222.0.23 "GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35" status: 200 len: 1313 microversion: 2.1 time: 0.441883 Oct 10 23:51:12.357452 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3099/6027] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:11 2022] GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 => generated 1313 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:12.587451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-53cb9b4f-7511-427b-86eb-72a7bd194ea3 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552b1a30eec14157b793b687d0eedb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff89df509844039922e2499bb4b242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:12.605341 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-53cb9b4f-7511-427b-86eb-72a7bd194ea3 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] 10.222.0.23 "GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0" status: 200 len: 1327 microversion: 2.1 time: 0.389407 Oct 10 23:51:12.605971 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2929/6028] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:12 2022] GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0 => generated 1327 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:51:12.634993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-71817fc6-e1fc-461c-9842-3407407be740 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:12.635631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-71817fc6-e1fc-461c-9842-3407407be740 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:12.646668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-71817fc6-e1fc-461c-9842-3407407be740 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:12.647183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-71817fc6-e1fc-461c-9842-3407407be740 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:12.647972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-71817fc6-e1fc-461c-9842-3407407be740 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:12.648717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-71817fc6-e1fc-461c-9842-3407407be740 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:12.649185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-71817fc6-e1fc-461c-9842-3407407be740 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:12.649654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-71817fc6-e1fc-461c-9842-3407407be740 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:13.250275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-71817fc6-e1fc-461c-9842-3407407be740 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:13.271744 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-71817fc6-e1fc-461c-9842-3407407be740 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1691 microversion: 2.1 time: 0.642198 Oct 10 23:51:13.273828 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3100/6029] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:12 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1691 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:13.375242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8995df23-85b6-4209-a619-a716a6adc0f5 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:13.375872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8995df23-85b6-4209-a619-a716a6adc0f5 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] [instance: 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:13.390732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8995df23-85b6-4209-a619-a716a6adc0f5 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:13.391492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8995df23-85b6-4209-a619-a716a6adc0f5 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:13.392210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8995df23-85b6-4209-a619-a716a6adc0f5 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:13.393404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8995df23-85b6-4209-a619-a716a6adc0f5 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:13.394149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8995df23-85b6-4209-a619-a716a6adc0f5 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:13.400589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8995df23-85b6-4209-a619-a716a6adc0f5 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:13.474825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-17b8439f-792d-4595-954d-08437e05bf44 req-15db9566-11a1-47ef-8354-b88f689085da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbe503a-b7c8-4459-87d9-3655cd54bacb", "name": "network-vif-plugged", "status": "completed", "tag": "4528ff7b-3e24-4d58-a19b-e57043a8de5d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:51:13.494970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-17b8439f-792d-4595-954d-08437e05bf44 req-15db9566-11a1-47ef-8354-b88f689085da service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:13.495624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-17b8439f-792d-4595-954d-08437e05bf44 req-15db9566-11a1-47ef-8354-b88f689085da service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:13.496343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-17b8439f-792d-4595-954d-08437e05bf44 req-15db9566-11a1-47ef-8354-b88f689085da service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:13.525889 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-17b8439f-792d-4595-954d-08437e05bf44 req-15db9566-11a1-47ef-8354-b88f689085da service nova] Creating event network-vif-plugged:4528ff7b-3e24-4d58-a19b-e57043a8de5d for instance ccbe503a-b7c8-4459-87d9-3655cd54bacb on n-h1-860864-2 Oct 10 23:51:13.546343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-17b8439f-792d-4595-954d-08437e05bf44 req-15db9566-11a1-47ef-8354-b88f689085da service nova] Instance ccbe503a-b7c8-4459-87d9-3655cd54bacb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 23:51:13.568854 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-17b8439f-792d-4595-954d-08437e05bf44 req-15db9566-11a1-47ef-8354-b88f689085da service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097610 Oct 10 23:51:13.582517 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3101/6030] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:51:13.637271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0f11f342-04e7-4b51-bd90-f1366c67e287 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:13.638355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0f11f342-04e7-4b51-bd90-f1366c67e287 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] [instance: e0f07489-e1e1-4f2b-b093-47199e9cfad0] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:13.646993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f11f342-04e7-4b51-bd90-f1366c67e287 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:13.647830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f11f342-04e7-4b51-bd90-f1366c67e287 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:13.648345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f11f342-04e7-4b51-bd90-f1366c67e287 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:13.649131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f11f342-04e7-4b51-bd90-f1366c67e287 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:13.649760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f11f342-04e7-4b51-bd90-f1366c67e287 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:13.651845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f11f342-04e7-4b51-bd90-f1366c67e287 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:13.734439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8995df23-85b6-4209-a619-a716a6adc0f5 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109b198f86b41f7a1746842b61752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26524bca9d5f46ed9979c2196265a2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:13.744317 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8995df23-85b6-4209-a619-a716a6adc0f5 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] 10.222.0.23 "GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35" status: 200 len: 1313 microversion: 2.1 time: 0.373093 Oct 10 23:51:13.745625 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2930/6031] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:13 2022] GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:13.802357 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-df0b3587-9fda-4324-828b-1f5e77a19c12 req-7d31d929-6e22-4b91-92b3-611474a1fcc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0f07489-e1e1-4f2b-b093-47199e9cfad0", "tag": "313805e9-d6c1-4071-b3ef-28e2a33678ff"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:51:13.838385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-df0b3587-9fda-4324-828b-1f5e77a19c12 req-7d31d929-6e22-4b91-92b3-611474a1fcc0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:13.840282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-df0b3587-9fda-4324-828b-1f5e77a19c12 req-7d31d929-6e22-4b91-92b3-611474a1fcc0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:13.845102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-df0b3587-9fda-4324-828b-1f5e77a19c12 req-7d31d929-6e22-4b91-92b3-611474a1fcc0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:13.864140 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-df0b3587-9fda-4324-828b-1f5e77a19c12 req-7d31d929-6e22-4b91-92b3-611474a1fcc0 service nova] Creating event network-changed:313805e9-d6c1-4071-b3ef-28e2a33678ff for instance e0f07489-e1e1-4f2b-b093-47199e9cfad0 on n-h2-860864-2 Oct 10 23:51:13.875094 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-df0b3587-9fda-4324-828b-1f5e77a19c12 req-7d31d929-6e22-4b91-92b3-611474a1fcc0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074589 Oct 10 23:51:13.891547 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2931/6032] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:51:14.088992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0f11f342-04e7-4b51-bd90-f1366c67e287 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552b1a30eec14157b793b687d0eedb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff89df509844039922e2499bb4b242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:14.109482 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0f11f342-04e7-4b51-bd90-f1366c67e287 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] 10.222.0.23 "GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0" status: 200 len: 1327 microversion: 2.1 time: 0.477292 Oct 10 23:51:14.130766 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3102/6033] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:13 2022] GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0 => generated 1327 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:51:14.301643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0dad1ba1-0afc-4c70-8c1d-6c2383611461 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:14.302530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0dad1ba1-0afc-4c70-8c1d-6c2383611461 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:14.317366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0dad1ba1-0afc-4c70-8c1d-6c2383611461 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:14.317904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0dad1ba1-0afc-4c70-8c1d-6c2383611461 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:14.318350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0dad1ba1-0afc-4c70-8c1d-6c2383611461 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:14.324348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0dad1ba1-0afc-4c70-8c1d-6c2383611461 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:14.325125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0dad1ba1-0afc-4c70-8c1d-6c2383611461 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:14.325525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0dad1ba1-0afc-4c70-8c1d-6c2383611461 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:14.708253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0dad1ba1-0afc-4c70-8c1d-6c2383611461 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:14.720244 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0dad1ba1-0afc-4c70-8c1d-6c2383611461 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1683 microversion: 2.1 time: 0.422616 Oct 10 23:51:14.731725 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2932/6034] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:14 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1683 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:14.774262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-599fb0a2-3d49-46cd-a159-cda03bee0a96 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:14.775398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-599fb0a2-3d49-46cd-a159-cda03bee0a96 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] [instance: 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:14.779652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=42 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:51:14.794648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-599fb0a2-3d49-46cd-a159-cda03bee0a96 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:14.795225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-599fb0a2-3d49-46cd-a159-cda03bee0a96 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:14.795225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-599fb0a2-3d49-46cd-a159-cda03bee0a96 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:14.796473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-599fb0a2-3d49-46cd-a159-cda03bee0a96 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:14.796868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-599fb0a2-3d49-46cd-a159-cda03bee0a96 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:14.797290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-599fb0a2-3d49-46cd-a159-cda03bee0a96 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:15.148069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dc229839-2362-4b4a-ab7b-d398ec598841 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:15.149339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dc229839-2362-4b4a-ab7b-d398ec598841 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] [instance: e0f07489-e1e1-4f2b-b093-47199e9cfad0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:15.157408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc229839-2362-4b4a-ab7b-d398ec598841 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:15.158667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc229839-2362-4b4a-ab7b-d398ec598841 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:15.159445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc229839-2362-4b4a-ab7b-d398ec598841 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:15.160446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc229839-2362-4b4a-ab7b-d398ec598841 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:15.161127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc229839-2362-4b4a-ab7b-d398ec598841 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:15.161779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc229839-2362-4b4a-ab7b-d398ec598841 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:15.410594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dc229839-2362-4b4a-ab7b-d398ec598841 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552b1a30eec14157b793b687d0eedb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff89df509844039922e2499bb4b242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:15.414818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=100 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:51:15.428109 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dc229839-2362-4b4a-ab7b-d398ec598841 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] 10.222.0.23 "GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0" status: 200 len: 1327 microversion: 2.1 time: 0.284649 Oct 10 23:51:15.432753 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2933/6035] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:15 2022] GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0 => generated 1327 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:15.473795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-599fb0a2-3d49-46cd-a159-cda03bee0a96 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109b198f86b41f7a1746842b61752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26524bca9d5f46ed9979c2196265a2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:15.496350 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-599fb0a2-3d49-46cd-a159-cda03bee0a96 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] 10.222.0.23 "GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35" status: 200 len: 1313 microversion: 2.1 time: 0.724101 Oct 10 23:51:15.499213 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3103/6036] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:14 2022] GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 => generated 1313 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:16.456920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-95981991-528a-402f-823e-432920edeef6 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:16.460176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-95981991-528a-402f-823e-432920edeef6 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] [instance: e0f07489-e1e1-4f2b-b093-47199e9cfad0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:16.470624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95981991-528a-402f-823e-432920edeef6 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:16.471123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95981991-528a-402f-823e-432920edeef6 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:16.471565 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95981991-528a-402f-823e-432920edeef6 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:16.472275 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95981991-528a-402f-823e-432920edeef6 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:16.472733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95981991-528a-402f-823e-432920edeef6 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:16.473159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95981991-528a-402f-823e-432920edeef6 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:16.521060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7fbc9685-e7da-4e7a-9c79-5555eb05d642 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:16.521860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7fbc9685-e7da-4e7a-9c79-5555eb05d642 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] [instance: 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:16.541080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fbc9685-e7da-4e7a-9c79-5555eb05d642 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:16.541670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fbc9685-e7da-4e7a-9c79-5555eb05d642 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:16.542135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fbc9685-e7da-4e7a-9c79-5555eb05d642 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:16.542910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fbc9685-e7da-4e7a-9c79-5555eb05d642 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:16.543393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fbc9685-e7da-4e7a-9c79-5555eb05d642 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:16.543855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fbc9685-e7da-4e7a-9c79-5555eb05d642 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:16.805873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-95981991-528a-402f-823e-432920edeef6 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552b1a30eec14157b793b687d0eedb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff89df509844039922e2499bb4b242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:16.828970 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-95981991-528a-402f-823e-432920edeef6 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] 10.222.0.23 "GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0" status: 200 len: 1327 microversion: 2.1 time: 0.376673 Oct 10 23:51:16.830293 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2934/6037] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:16 2022] GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0 => generated 1327 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:17.064804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7fbc9685-e7da-4e7a-9c79-5555eb05d642 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109b198f86b41f7a1746842b61752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26524bca9d5f46ed9979c2196265a2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:17.081504 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7fbc9685-e7da-4e7a-9c79-5555eb05d642 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] 10.222.0.23 "GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35" status: 200 len: 1313 microversion: 2.1 time: 0.564410 Oct 10 23:51:17.098342 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3104/6038] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:16 2022] GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 => generated 1313 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:17.495136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-4aadf145-ff01-4625-8f80-bf59a3882f33 req-ac96ff5e-1e5f-4a96-8e84-d249b687b99c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35", "name": "network-vif-plugged", "status": "completed", "tag": "56714c2b-5a33-4f42-a7e3-fae7f6f80cf4"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:51:17.520606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4aadf145-ff01-4625-8f80-bf59a3882f33 req-ac96ff5e-1e5f-4a96-8e84-d249b687b99c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:17.521095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4aadf145-ff01-4625-8f80-bf59a3882f33 req-ac96ff5e-1e5f-4a96-8e84-d249b687b99c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:17.521570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4aadf145-ff01-4625-8f80-bf59a3882f33 req-ac96ff5e-1e5f-4a96-8e84-d249b687b99c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:17.569161 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-4aadf145-ff01-4625-8f80-bf59a3882f33 req-ac96ff5e-1e5f-4a96-8e84-d249b687b99c service nova] Creating event network-vif-plugged:56714c2b-5a33-4f42-a7e3-fae7f6f80cf4 for instance 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 on n-h1-860864-2 Oct 10 23:51:17.578732 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-4aadf145-ff01-4625-8f80-bf59a3882f33 req-ac96ff5e-1e5f-4a96-8e84-d249b687b99c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093912 Oct 10 23:51:17.580626 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2935/6039] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:51:17.852697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bb3b3ed7-914a-4a20-bdca-f190b17b60b1 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:17.853615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bb3b3ed7-914a-4a20-bdca-f190b17b60b1 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] [instance: e0f07489-e1e1-4f2b-b093-47199e9cfad0] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:17.860798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb3b3ed7-914a-4a20-bdca-f190b17b60b1 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:17.861399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb3b3ed7-914a-4a20-bdca-f190b17b60b1 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:17.862035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb3b3ed7-914a-4a20-bdca-f190b17b60b1 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:17.862737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb3b3ed7-914a-4a20-bdca-f190b17b60b1 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:17.863438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb3b3ed7-914a-4a20-bdca-f190b17b60b1 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:17.863867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb3b3ed7-914a-4a20-bdca-f190b17b60b1 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:18.018459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bb3b3ed7-914a-4a20-bdca-f190b17b60b1 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552b1a30eec14157b793b687d0eedb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff89df509844039922e2499bb4b242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:18.030565 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bb3b3ed7-914a-4a20-bdca-f190b17b60b1 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] 10.222.0.23 "GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0" status: 200 len: 1327 microversion: 2.1 time: 0.180787 Oct 10 23:51:18.031369 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3105/6040] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:17 2022] GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0 => generated 1327 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:18.103494 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:51:18.108277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dc4ac006-612a-4931-94aa-e828ffa59875 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:18.109123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dc4ac006-612a-4931-94aa-e828ffa59875 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] [instance: 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:18.117582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc4ac006-612a-4931-94aa-e828ffa59875 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:18.118180 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc4ac006-612a-4931-94aa-e828ffa59875 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:18.118924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc4ac006-612a-4931-94aa-e828ffa59875 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:18.119963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc4ac006-612a-4931-94aa-e828ffa59875 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:18.120673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc4ac006-612a-4931-94aa-e828ffa59875 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:18.121436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc4ac006-612a-4931-94aa-e828ffa59875 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:18.253794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=16 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:51:18.879436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dc4ac006-612a-4931-94aa-e828ffa59875 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109b198f86b41f7a1746842b61752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26524bca9d5f46ed9979c2196265a2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:18.891849 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dc4ac006-612a-4931-94aa-e828ffa59875 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] 10.222.0.23 "GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35" status: 200 len: 1313 microversion: 2.1 time: 0.788945 Oct 10 23:51:18.893641 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2936/6041] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:18 2022] GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 => generated 1313 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:19.060683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ae1536ed-4d5d-4160-97d0-53c844c351a8 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:19.062973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ae1536ed-4d5d-4160-97d0-53c844c351a8 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] [instance: e0f07489-e1e1-4f2b-b093-47199e9cfad0] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:19.072831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae1536ed-4d5d-4160-97d0-53c844c351a8 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:19.084281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae1536ed-4d5d-4160-97d0-53c844c351a8 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:19.092001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae1536ed-4d5d-4160-97d0-53c844c351a8 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:19.094108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae1536ed-4d5d-4160-97d0-53c844c351a8 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:19.097031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae1536ed-4d5d-4160-97d0-53c844c351a8 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:19.098198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae1536ed-4d5d-4160-97d0-53c844c351a8 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:19.523871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ae1536ed-4d5d-4160-97d0-53c844c351a8 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552b1a30eec14157b793b687d0eedb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff89df509844039922e2499bb4b242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:19.533906 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ae1536ed-4d5d-4160-97d0-53c844c351a8 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] 10.222.0.23 "GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0" status: 200 len: 1327 microversion: 2.1 time: 0.482694 Oct 10 23:51:19.534742 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3106/6042] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:19 2022] GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0 => generated 1327 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:19.603712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-6359d721-7d26-4e99-95a0-61e72a114d87 req-473f594e-dcda-4b9d-9d2f-39a95d75439d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0f07489-e1e1-4f2b-b093-47199e9cfad0", "name": "network-vif-plugged", "status": "completed", "tag": "313805e9-d6c1-4071-b3ef-28e2a33678ff"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:51:19.634903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6359d721-7d26-4e99-95a0-61e72a114d87 req-473f594e-dcda-4b9d-9d2f-39a95d75439d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:19.635756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6359d721-7d26-4e99-95a0-61e72a114d87 req-473f594e-dcda-4b9d-9d2f-39a95d75439d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:19.636758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6359d721-7d26-4e99-95a0-61e72a114d87 req-473f594e-dcda-4b9d-9d2f-39a95d75439d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:19.652204 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-6359d721-7d26-4e99-95a0-61e72a114d87 req-473f594e-dcda-4b9d-9d2f-39a95d75439d service nova] Creating event network-vif-plugged:313805e9-d6c1-4071-b3ef-28e2a33678ff for instance e0f07489-e1e1-4f2b-b093-47199e9cfad0 on n-h2-860864-2 Oct 10 23:51:19.658532 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-6359d721-7d26-4e99-95a0-61e72a114d87 req-473f594e-dcda-4b9d-9d2f-39a95d75439d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064606 Oct 10 23:51:19.659760 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2937/6043] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:51:19.919231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-32dc4a21-54b7-4236-aa05-b8410d29bd40 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:19.920444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-32dc4a21-54b7-4236-aa05-b8410d29bd40 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] [instance: 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:19.937428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32dc4a21-54b7-4236-aa05-b8410d29bd40 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:19.938253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32dc4a21-54b7-4236-aa05-b8410d29bd40 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:19.938921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32dc4a21-54b7-4236-aa05-b8410d29bd40 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:19.940587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32dc4a21-54b7-4236-aa05-b8410d29bd40 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:19.941025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32dc4a21-54b7-4236-aa05-b8410d29bd40 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:19.941489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32dc4a21-54b7-4236-aa05-b8410d29bd40 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:20.560462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-32dc4a21-54b7-4236-aa05-b8410d29bd40 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109b198f86b41f7a1746842b61752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26524bca9d5f46ed9979c2196265a2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:20.568442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-76251635-deac-432a-a5a9-4ef8061f156e tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:20.570864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-76251635-deac-432a-a5a9-4ef8061f156e tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] [instance: e0f07489-e1e1-4f2b-b093-47199e9cfad0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:20.586064 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-32dc4a21-54b7-4236-aa05-b8410d29bd40 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] 10.222.0.23 "GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35" status: 200 len: 1497 microversion: 2.1 time: 0.673316 Oct 10 23:51:20.588667 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3107/6044] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:19 2022] GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 => generated 1497 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:20.590853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76251635-deac-432a-a5a9-4ef8061f156e tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:20.591765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76251635-deac-432a-a5a9-4ef8061f156e tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:20.593215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76251635-deac-432a-a5a9-4ef8061f156e tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:20.594197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76251635-deac-432a-a5a9-4ef8061f156e tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:20.595142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76251635-deac-432a-a5a9-4ef8061f156e tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:20.595800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76251635-deac-432a-a5a9-4ef8061f156e tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:21.036694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-76251635-deac-432a-a5a9-4ef8061f156e tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552b1a30eec14157b793b687d0eedb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff89df509844039922e2499bb4b242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:21.052422 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-76251635-deac-432a-a5a9-4ef8061f156e tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] 10.222.0.23 "GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0" status: 200 len: 1327 microversion: 2.1 time: 0.497211 Oct 10 23:51:21.056660 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2938/6045] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:20 2022] GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0 => generated 1327 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:22.084590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c9fa392b-c7e4-402d-b7dd-1eb3189ae28e tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:22.085252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c9fa392b-c7e4-402d-b7dd-1eb3189ae28e tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] [instance: e0f07489-e1e1-4f2b-b093-47199e9cfad0] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:22.102931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9fa392b-c7e4-402d-b7dd-1eb3189ae28e tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:22.105291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9fa392b-c7e4-402d-b7dd-1eb3189ae28e tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:22.107039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9fa392b-c7e4-402d-b7dd-1eb3189ae28e tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:22.110054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9fa392b-c7e4-402d-b7dd-1eb3189ae28e tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:22.113455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9fa392b-c7e4-402d-b7dd-1eb3189ae28e tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:22.114170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9fa392b-c7e4-402d-b7dd-1eb3189ae28e tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:22.380686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c9fa392b-c7e4-402d-b7dd-1eb3189ae28e tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552b1a30eec14157b793b687d0eedb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff89df509844039922e2499bb4b242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:22.394324 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c9fa392b-c7e4-402d-b7dd-1eb3189ae28e tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] 10.222.0.23 "GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0" status: 200 len: 1528 microversion: 2.1 time: 0.315566 Oct 10 23:51:22.449623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-661bed0e-11c0-46f3-a436-4f5e8b6607cd tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:22.453647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-661bed0e-11c0-46f3-a436-4f5e8b6607cd tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] [instance: e0f07489-e1e1-4f2b-b093-47199e9cfad0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:22.457949 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3108/6046] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:22 2022] GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0 => generated 1528 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:22.482663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-661bed0e-11c0-46f3-a436-4f5e8b6607cd tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:22.484457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-661bed0e-11c0-46f3-a436-4f5e8b6607cd tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:22.503781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-661bed0e-11c0-46f3-a436-4f5e8b6607cd tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:22.504941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-661bed0e-11c0-46f3-a436-4f5e8b6607cd tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:22.506036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-661bed0e-11c0-46f3-a436-4f5e8b6607cd tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:22.506686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-661bed0e-11c0-46f3-a436-4f5e8b6607cd tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:22.953913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-661bed0e-11c0-46f3-a436-4f5e8b6607cd tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552b1a30eec14157b793b687d0eedb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff89df509844039922e2499bb4b242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:22.972368 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-661bed0e-11c0-46f3-a436-4f5e8b6607cd tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] 10.222.0.23 "GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0" status: 200 len: 1528 microversion: 2.1 time: 0.549135 Oct 10 23:51:22.973004 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2939/6047] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:22 2022] GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0 => generated 1528 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:23.529647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4ee99383-20d7-4ce2-85ea-869ee2a1c889 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:23.530213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4ee99383-20d7-4ce2-85ea-869ee2a1c889 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] [instance: e0f07489-e1e1-4f2b-b093-47199e9cfad0] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:23.548640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ee99383-20d7-4ce2-85ea-869ee2a1c889 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:23.549158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ee99383-20d7-4ce2-85ea-869ee2a1c889 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:23.556085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ee99383-20d7-4ce2-85ea-869ee2a1c889 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:23.558114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ee99383-20d7-4ce2-85ea-869ee2a1c889 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:23.558613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ee99383-20d7-4ce2-85ea-869ee2a1c889 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:23.559789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ee99383-20d7-4ce2-85ea-869ee2a1c889 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:23.597356 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-4ee99383-20d7-4ce2-85ea-869ee2a1c889 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] HTTP exception thrown: Instance e0f07489-e1e1-4f2b-b093-47199e9cfad0 could not be found. Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4ee99383-20d7-4ce2-85ea-869ee2a1c889 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] Request method failure captured: Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0 HTTP/1.1 Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK_qeLA1Vmm_BJkJeXraHGgAyM9pLg7hM_k8BW7iqC37ayBRIUbdlfjElccmQvxq-mwIkD4UYRAsjZ0cug6ZzmVZCo_r9iPXViX0rAWXItWEyGTc3r-1akPMBzLN8oRYxZwbBWgLJojZFEsYPYwNgoKUuPKZyBzcbjURs4atwhCqSZA Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 23a6c9d4678341a999097e569c72cfd7 Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1409325251 Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/23a6c9d4678341a999097e569c72cfd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/23a6c9d4678341a999097e569c72cfd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/23a6c9d4678341a999097e569c72cfd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_23a6c9d4678341a999097e569c72cfd7", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1409325251 Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 23a6c9d4678341a999097e569c72cfd7 Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1409325251 Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1409325251-project Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a14766d4fd4142908e9d9fdbf646ae0d Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1409325251-project Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance e0f07489-e1e1-4f2b-b093-47199e9cfad0 could not be found. Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'e0f07489-e1e1-4f2b-b093-47199e9cfad0'} Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0f07489-e1e1-4f2b-b093-47199e9cfad0 could not be found. Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:51:23.599423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:51:23.603858 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0f07489-e1e1-4f2b-b093-47199e9cfad0 could not be found. Oct 10 23:51:23.603858 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:51:23.603858 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:51:23.603858 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:51:23.603858 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:51:23.603858 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:51:23.603858 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:51:23.603858 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:51:23.603858 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:51:23.603858 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0f07489-e1e1-4f2b-b093-47199e9cfad0 could not be found. Oct 10 23:51:23.603858 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:51:23.603858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4ee99383-20d7-4ce2-85ea-869ee2a1c889 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] Returning 404 to user: Instance e0f07489-e1e1-4f2b-b093-47199e9cfad0 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:51:23.603858 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4ee99383-20d7-4ce2-85ea-869ee2a1c889 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0" status: 404 len: 111 microversion: 2.1 time: 0.607137 Oct 10 23:51:23.603858 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3109/6048] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:51:22 2022] DELETE /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0 => generated 111 bytes in 608 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:51:23.611640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b5a0a89e-ab31-47cf-9d94-06b3d543b5d7 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:23.612251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b5a0a89e-ab31-47cf-9d94-06b3d543b5d7 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] [instance: e0f07489-e1e1-4f2b-b093-47199e9cfad0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:23.625020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5a0a89e-ab31-47cf-9d94-06b3d543b5d7 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:23.625556 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5a0a89e-ab31-47cf-9d94-06b3d543b5d7 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:23.625997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5a0a89e-ab31-47cf-9d94-06b3d543b5d7 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:23.626800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5a0a89e-ab31-47cf-9d94-06b3d543b5d7 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:23.627343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5a0a89e-ab31-47cf-9d94-06b3d543b5d7 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:23.627806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5a0a89e-ab31-47cf-9d94-06b3d543b5d7 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:23.832324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b5a0a89e-ab31-47cf-9d94-06b3d543b5d7 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552b1a30eec14157b793b687d0eedb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff89df509844039922e2499bb4b242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:23.851013 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b5a0a89e-ab31-47cf-9d94-06b3d543b5d7 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] 10.222.0.23 "GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0" status: 200 len: 1528 microversion: 2.1 time: 0.244081 Oct 10 23:51:23.865881 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2940/6049] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:23 2022] GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0 => generated 1528 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:23.876281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6f33b0b1-d75a-4631-ae5e-bb5719a96b44 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] Action: 'update', calling method: >, body: {"server": {"name": "e0f07489-e1e1-4f2b-b093-47199e9cfad0_new"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:51:23.879157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6f33b0b1-d75a-4631-ae5e-bb5719a96b44 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] [instance: e0f07489-e1e1-4f2b-b093-47199e9cfad0] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:23.901289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f33b0b1-d75a-4631-ae5e-bb5719a96b44 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:23.901849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f33b0b1-d75a-4631-ae5e-bb5719a96b44 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:23.902297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f33b0b1-d75a-4631-ae5e-bb5719a96b44 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:23.903020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f33b0b1-d75a-4631-ae5e-bb5719a96b44 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:23.903481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f33b0b1-d75a-4631-ae5e-bb5719a96b44 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:23.903911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f33b0b1-d75a-4631-ae5e-bb5719a96b44 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:23.935591 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-6f33b0b1-d75a-4631-ae5e-bb5719a96b44 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] HTTP exception thrown: Instance e0f07489-e1e1-4f2b-b093-47199e9cfad0 could not be found. Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6f33b0b1-d75a-4631-ae5e-bb5719a96b44 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] Request method failure captured: Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: request: PUT /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0 HTTP/1.1 Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 64 Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK_qeLA1Vmm_BJkJeXraHGgAyM9pLg7hM_k8BW7iqC37ayBRIUbdlfjElccmQvxq-mwIkD4UYRAsjZ0cug6ZzmVZCo_r9iPXViX0rAWXItWEyGTc3r-1akPMBzLN8oRYxZwbBWgLJojZFEsYPYwNgoKUuPKZyBzcbjURs4atwhCqSZA Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 23a6c9d4678341a999097e569c72cfd7 Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1409325251 Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/23a6c9d4678341a999097e569c72cfd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/23a6c9d4678341a999097e569c72cfd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/23a6c9d4678341a999097e569c72cfd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_23a6c9d4678341a999097e569c72cfd7", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1409325251 Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 23a6c9d4678341a999097e569c72cfd7 Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1409325251 Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1409325251-project Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a14766d4fd4142908e9d9fdbf646ae0d Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1409325251-project Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: {"server": {"name": "e0f07489-e1e1-4f2b-b093-47199e9cfad0_new"}} Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance e0f07489-e1e1-4f2b-b093-47199e9cfad0 could not be found. Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'e0f07489-e1e1-4f2b-b093-47199e9cfad0', 'body': {'server': {'name': 'e0f07489-e1e1-4f2b-b093-47199e9cfad0_new'}}} Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0f07489-e1e1-4f2b-b093-47199e9cfad0 could not be found. Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:51:23.938861 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 10 23:51:23.943896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 10 23:51:23.943896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 10 23:51:23.943896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:51:23.943896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:51:23.943896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:51:23.943896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:51:23.943896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0f07489-e1e1-4f2b-b093-47199e9cfad0 could not be found. Oct 10 23:51:23.943896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:51:23.943896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:51:23.943896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:51:23.943896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:51:23.943896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:51:23.943896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:51:23.943896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:51:23.943896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:51:23.943896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0f07489-e1e1-4f2b-b093-47199e9cfad0 could not be found. Oct 10 23:51:23.943896 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:51:23.947522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6f33b0b1-d75a-4631-ae5e-bb5719a96b44 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] Returning 404 to user: Instance e0f07489-e1e1-4f2b-b093-47199e9cfad0 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:51:23.948640 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6f33b0b1-d75a-4631-ae5e-bb5719a96b44 tempest-ServersNegativeTestMultiTenantJSON-1409325251 tempest-ServersNegativeTestMultiTenantJSON-1409325251-project] 10.222.0.23 "PUT /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0" status: 404 len: 111 microversion: 2.1 time: 0.076828 Oct 10 23:51:23.949770 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3110/6050] 10.222.0.23 () {60 vars in 1256 bytes} [Mon Oct 10 23:51:23 2022] PUT /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:51:23.960245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-90c036a9-7b42-43c5-b11c-b8fb4b5096e3 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:23.961142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-90c036a9-7b42-43c5-b11c-b8fb4b5096e3 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] [instance: e0f07489-e1e1-4f2b-b093-47199e9cfad0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:23.972325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90c036a9-7b42-43c5-b11c-b8fb4b5096e3 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:23.973217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90c036a9-7b42-43c5-b11c-b8fb4b5096e3 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:23.973748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90c036a9-7b42-43c5-b11c-b8fb4b5096e3 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:23.974559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90c036a9-7b42-43c5-b11c-b8fb4b5096e3 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:23.975077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90c036a9-7b42-43c5-b11c-b8fb4b5096e3 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:23.975733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90c036a9-7b42-43c5-b11c-b8fb4b5096e3 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:24.007014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-90c036a9-7b42-43c5-b11c-b8fb4b5096e3 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] [instance: e0f07489-e1e1-4f2b-b093-47199e9cfad0] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:51:24.160579 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-90c036a9-7b42-43c5-b11c-b8fb4b5096e3 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0" status: 204 len: 0 microversion: 2.1 time: 0.201706 Oct 10 23:51:24.164754 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2941/6051] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:51:23 2022] DELETE /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:51:24.171645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3aadabe3-3432-4525-bdaa-f2630243447c tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:24.172636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3aadabe3-3432-4525-bdaa-f2630243447c tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] [instance: e0f07489-e1e1-4f2b-b093-47199e9cfad0] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:24.188378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aadabe3-3432-4525-bdaa-f2630243447c tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:24.189214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aadabe3-3432-4525-bdaa-f2630243447c tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:24.189702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aadabe3-3432-4525-bdaa-f2630243447c tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:24.190607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aadabe3-3432-4525-bdaa-f2630243447c tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:24.191117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aadabe3-3432-4525-bdaa-f2630243447c tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:24.191557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aadabe3-3432-4525-bdaa-f2630243447c tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:24.680668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3aadabe3-3432-4525-bdaa-f2630243447c tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552b1a30eec14157b793b687d0eedb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff89df509844039922e2499bb4b242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:24.696837 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3aadabe3-3432-4525-bdaa-f2630243447c tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] 10.222.0.23 "GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0" status: 200 len: 1534 microversion: 2.1 time: 0.528878 Oct 10 23:51:24.701632 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3111/6052] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:24 2022] GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0 => generated 1534 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:51:25.329906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0d0f5d3b-68cb-44f9-ae5c-715cb17da626 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:25.330514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0d0f5d3b-68cb-44f9-ae5c-715cb17da626 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] [instance: 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:25.337660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d0f5d3b-68cb-44f9-ae5c-715cb17da626 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:25.338421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d0f5d3b-68cb-44f9-ae5c-715cb17da626 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:25.339058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d0f5d3b-68cb-44f9-ae5c-715cb17da626 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:25.340029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d0f5d3b-68cb-44f9-ae5c-715cb17da626 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:25.340686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d0f5d3b-68cb-44f9-ae5c-715cb17da626 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:25.341308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d0f5d3b-68cb-44f9-ae5c-715cb17da626 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:25.379025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0d0f5d3b-68cb-44f9-ae5c-715cb17da626 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] [instance: 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:51:25.481711 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0d0f5d3b-68cb-44f9-ae5c-715cb17da626 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35" status: 204 len: 0 microversion: 2.1 time: 0.156726 Oct 10 23:51:25.482316 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2942/6053] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:51:25 2022] DELETE /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:51:25.493004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-890facab-a810-42ee-94fe-21877b3f54eb tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:25.493776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-890facab-a810-42ee-94fe-21877b3f54eb tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] [instance: 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:25.505121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-890facab-a810-42ee-94fe-21877b3f54eb tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:25.506290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-890facab-a810-42ee-94fe-21877b3f54eb tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:25.511944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-890facab-a810-42ee-94fe-21877b3f54eb tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:25.513150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-890facab-a810-42ee-94fe-21877b3f54eb tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:25.515166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-890facab-a810-42ee-94fe-21877b3f54eb tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:25.515884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-890facab-a810-42ee-94fe-21877b3f54eb tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:25.715276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-890facab-a810-42ee-94fe-21877b3f54eb tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109b198f86b41f7a1746842b61752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26524bca9d5f46ed9979c2196265a2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:25.724756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0c3e2912-8ad7-4110-9cb8-14ad9a0abb26 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:25.725829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0c3e2912-8ad7-4110-9cb8-14ad9a0abb26 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] [instance: e0f07489-e1e1-4f2b-b093-47199e9cfad0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:25.727044 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-890facab-a810-42ee-94fe-21877b3f54eb tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] 10.222.0.23 "GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35" status: 200 len: 1503 microversion: 2.1 time: 0.239913 Oct 10 23:51:25.730293 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3112/6054] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:25 2022] GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 => generated 1503 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:25.739426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c3e2912-8ad7-4110-9cb8-14ad9a0abb26 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:25.741608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c3e2912-8ad7-4110-9cb8-14ad9a0abb26 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:25.742388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c3e2912-8ad7-4110-9cb8-14ad9a0abb26 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:25.746307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c3e2912-8ad7-4110-9cb8-14ad9a0abb26 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:25.747132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c3e2912-8ad7-4110-9cb8-14ad9a0abb26 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:25.747835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0c3e2912-8ad7-4110-9cb8-14ad9a0abb26 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:26.115724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0c3e2912-8ad7-4110-9cb8-14ad9a0abb26 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552b1a30eec14157b793b687d0eedb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff89df509844039922e2499bb4b242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:26.128220 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0c3e2912-8ad7-4110-9cb8-14ad9a0abb26 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] 10.222.0.23 "GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0" status: 200 len: 1534 microversion: 2.1 time: 0.408041 Oct 10 23:51:26.146354 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2943/6055] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:25 2022] GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0 => generated 1534 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:26.762395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-24d916d2-a3aa-4d7f-b31b-5600fb3e7d48 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:26.767693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-24d916d2-a3aa-4d7f-b31b-5600fb3e7d48 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] [instance: 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:26.800865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24d916d2-a3aa-4d7f-b31b-5600fb3e7d48 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:26.804011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24d916d2-a3aa-4d7f-b31b-5600fb3e7d48 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:26.804739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24d916d2-a3aa-4d7f-b31b-5600fb3e7d48 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:26.805939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24d916d2-a3aa-4d7f-b31b-5600fb3e7d48 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:26.806627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24d916d2-a3aa-4d7f-b31b-5600fb3e7d48 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:26.807551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24d916d2-a3aa-4d7f-b31b-5600fb3e7d48 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:26.912825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-9b0141c5-5f1c-48e2-a9f3-2f321b3e2497 req-fbce55a5-45bd-4bc7-8c56-31ff85c5bdef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0f07489-e1e1-4f2b-b093-47199e9cfad0", "name": "network-vif-deleted", "tag": "313805e9-d6c1-4071-b3ef-28e2a33678ff"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:51:26.976916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9b0141c5-5f1c-48e2-a9f3-2f321b3e2497 req-fbce55a5-45bd-4bc7-8c56-31ff85c5bdef service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:26.977517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9b0141c5-5f1c-48e2-a9f3-2f321b3e2497 req-fbce55a5-45bd-4bc7-8c56-31ff85c5bdef service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:26.977960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9b0141c5-5f1c-48e2-a9f3-2f321b3e2497 req-fbce55a5-45bd-4bc7-8c56-31ff85c5bdef service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:27.037735 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-9b0141c5-5f1c-48e2-a9f3-2f321b3e2497 req-fbce55a5-45bd-4bc7-8c56-31ff85c5bdef service nova] Creating event network-vif-deleted:313805e9-d6c1-4071-b3ef-28e2a33678ff for instance e0f07489-e1e1-4f2b-b093-47199e9cfad0 on n-h2-860864-2 Oct 10 23:51:27.055391 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-9b0141c5-5f1c-48e2-a9f3-2f321b3e2497 req-fbce55a5-45bd-4bc7-8c56-31ff85c5bdef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150369 Oct 10 23:51:27.065647 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2944/6056] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:51:27.158684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1d25c787-59f6-4269-8941-d3c2984d4396 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:27.159781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1d25c787-59f6-4269-8941-d3c2984d4396 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] [instance: e0f07489-e1e1-4f2b-b093-47199e9cfad0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:27.177172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-24d916d2-a3aa-4d7f-b31b-5600fb3e7d48 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109b198f86b41f7a1746842b61752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26524bca9d5f46ed9979c2196265a2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:27.191230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d25c787-59f6-4269-8941-d3c2984d4396 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:27.192141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d25c787-59f6-4269-8941-d3c2984d4396 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:27.192826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d25c787-59f6-4269-8941-d3c2984d4396 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:27.194402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d25c787-59f6-4269-8941-d3c2984d4396 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:27.194989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d25c787-59f6-4269-8941-d3c2984d4396 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:27.195780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d25c787-59f6-4269-8941-d3c2984d4396 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:27.200124 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-24d916d2-a3aa-4d7f-b31b-5600fb3e7d48 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] 10.222.0.23 "GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35" status: 200 len: 1503 microversion: 2.1 time: 0.446062 Oct 10 23:51:27.205452 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3113/6057] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:26 2022] GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 => generated 1503 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:27.338944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d25c787-59f6-4269-8941-d3c2984d4396 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:27.339450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d25c787-59f6-4269-8941-d3c2984d4396 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:27.339898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d25c787-59f6-4269-8941-d3c2984d4396 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:27.340362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-1d25c787-59f6-4269-8941-d3c2984d4396 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lazy-loading 'fault' on Instance uuid e0f07489-e1e1-4f2b-b093-47199e9cfad0 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:51:27.466448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1d25c787-59f6-4269-8941-d3c2984d4396 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552b1a30eec14157b793b687d0eedb0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff89df509844039922e2499bb4b242a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:27.479880 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1d25c787-59f6-4269-8941-d3c2984d4396 tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] 10.222.0.23 "GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0" status: 200 len: 1317 microversion: 2.1 time: 0.324685 Oct 10 23:51:27.482745 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2945/6058] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:27 2022] GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:28.234702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-216b4fc3-9c08-4efe-bc40-0eaee46b23fc tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:28.235817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-216b4fc3-9c08-4efe-bc40-0eaee46b23fc tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] [instance: 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:28.258674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-216b4fc3-9c08-4efe-bc40-0eaee46b23fc tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:28.259196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-216b4fc3-9c08-4efe-bc40-0eaee46b23fc tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:28.263727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-216b4fc3-9c08-4efe-bc40-0eaee46b23fc tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:28.265404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-216b4fc3-9c08-4efe-bc40-0eaee46b23fc tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:28.270295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-216b4fc3-9c08-4efe-bc40-0eaee46b23fc tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:28.271110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-216b4fc3-9c08-4efe-bc40-0eaee46b23fc tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:28.516317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e2605cf6-37f1-4ffb-983d-8e31c6c5ce6a tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:28.517847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e2605cf6-37f1-4ffb-983d-8e31c6c5ce6a tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] [instance: e0f07489-e1e1-4f2b-b093-47199e9cfad0] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:28.527360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e2605cf6-37f1-4ffb-983d-8e31c6c5ce6a tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:28.528195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e2605cf6-37f1-4ffb-983d-8e31c6c5ce6a tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:28.528861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e2605cf6-37f1-4ffb-983d-8e31c6c5ce6a tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:28.530561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e2605cf6-37f1-4ffb-983d-8e31c6c5ce6a tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:28.532033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e2605cf6-37f1-4ffb-983d-8e31c6c5ce6a tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:28.532725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e2605cf6-37f1-4ffb-983d-8e31c6c5ce6a tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:28.558613 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-e2605cf6-37f1-4ffb-983d-8e31c6c5ce6a tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] HTTP exception thrown: Instance e0f07489-e1e1-4f2b-b093-47199e9cfad0 could not be found. Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e2605cf6-37f1-4ffb-983d-8e31c6c5ce6a tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Request method failure captured: Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0 HTTP/1.1 Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK_ZsE8L2fc0i7wl6ptWjsQNXq2QphVVfjtnv8ch6IY2lX9rCWhKe3EpFBAewdA31RNHB349zYWMI1zArpIKMCucV4jIc7NKTbwB4mKcG4KWXxpvDLQrXCia6otactjoNn_thwWIrM6rPgKcrQM-U1zlS1iQmcyPfNlH5KEqqx5V_Lo Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: bff89df509844039922e2499bb4b242a Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-402414241 Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bff89df509844039922e2499bb4b242a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bff89df509844039922e2499bb4b242a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bff89df509844039922e2499bb4b242a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bff89df509844039922e2499bb4b242a", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-402414241 Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: bff89df509844039922e2499bb4b242a Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-402414241 Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestMultiTenantJSON-402414241-project Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 552b1a30eec14157b793b687d0eedb0c Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-402414241-project Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance e0f07489-e1e1-4f2b-b093-47199e9cfad0 could not be found. Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'e0f07489-e1e1-4f2b-b093-47199e9cfad0'} Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0f07489-e1e1-4f2b-b093-47199e9cfad0 could not be found. Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0f07489-e1e1-4f2b-b093-47199e9cfad0 could not be found. Oct 10 23:51:28.564607 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:51:28.569420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:51:28.569420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:51:28.569420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:51:28.569420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:51:28.569420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:51:28.569420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:51:28.569420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:51:28.569420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0f07489-e1e1-4f2b-b093-47199e9cfad0 could not be found. Oct 10 23:51:28.569420 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:51:28.573837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e2605cf6-37f1-4ffb-983d-8e31c6c5ce6a tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] Returning 404 to user: Instance e0f07489-e1e1-4f2b-b093-47199e9cfad0 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:51:28.575599 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e2605cf6-37f1-4ffb-983d-8e31c6c5ce6a tempest-ServersNegativeTestMultiTenantJSON-402414241 tempest-ServersNegativeTestMultiTenantJSON-402414241-project] 10.222.0.23 "GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0" status: 404 len: 111 microversion: 2.1 time: 0.065403 Oct 10 23:51:28.581342 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2946/6059] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:28 2022] GET /compute/v2.1/servers/e0f07489-e1e1-4f2b-b093-47199e9cfad0 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:51:29.055530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-216b4fc3-9c08-4efe-bc40-0eaee46b23fc tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109b198f86b41f7a1746842b61752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26524bca9d5f46ed9979c2196265a2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:29.095768 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-216b4fc3-9c08-4efe-bc40-0eaee46b23fc tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] 10.222.0.23 "GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35" status: 200 len: 1503 microversion: 2.1 time: 0.865424 Oct 10 23:51:29.097099 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3114/6060] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:28 2022] GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 => generated 1503 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:29.549526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-a42703b7-b553-4143-9e0d-5fa140171dd5 req-832c3cb2-fcf3-4a6a-aadf-1388b9ac313e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35", "name": "network-vif-deleted", "tag": "56714c2b-5a33-4f42-a7e3-fae7f6f80cf4"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:51:29.594953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a42703b7-b553-4143-9e0d-5fa140171dd5 req-832c3cb2-fcf3-4a6a-aadf-1388b9ac313e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:29.596479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a42703b7-b553-4143-9e0d-5fa140171dd5 req-832c3cb2-fcf3-4a6a-aadf-1388b9ac313e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:29.597219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a42703b7-b553-4143-9e0d-5fa140171dd5 req-832c3cb2-fcf3-4a6a-aadf-1388b9ac313e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:29.629979 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-a42703b7-b553-4143-9e0d-5fa140171dd5 req-832c3cb2-fcf3-4a6a-aadf-1388b9ac313e service nova] Creating event network-vif-deleted:56714c2b-5a33-4f42-a7e3-fae7f6f80cf4 for instance 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 on n-h1-860864-2 Oct 10 23:51:29.642771 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-a42703b7-b553-4143-9e0d-5fa140171dd5 req-832c3cb2-fcf3-4a6a-aadf-1388b9ac313e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108075 Oct 10 23:51:29.646188 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2947/6061] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:51:30.125288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5633c523-71d6-453c-abdb-e7304599ded9 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:30.126039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5633c523-71d6-453c-abdb-e7304599ded9 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] [instance: 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:30.152159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5633c523-71d6-453c-abdb-e7304599ded9 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:30.152873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5633c523-71d6-453c-abdb-e7304599ded9 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:30.153335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5633c523-71d6-453c-abdb-e7304599ded9 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:30.156758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5633c523-71d6-453c-abdb-e7304599ded9 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:30.157323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5633c523-71d6-453c-abdb-e7304599ded9 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:30.157782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5633c523-71d6-453c-abdb-e7304599ded9 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:30.287030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5633c523-71d6-453c-abdb-e7304599ded9 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:30.287529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5633c523-71d6-453c-abdb-e7304599ded9 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:30.287970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5633c523-71d6-453c-abdb-e7304599ded9 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:30.288454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-5633c523-71d6-453c-abdb-e7304599ded9 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lazy-loading 'fault' on Instance uuid 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:51:30.291572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:51:30.391673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5633c523-71d6-453c-abdb-e7304599ded9 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109b198f86b41f7a1746842b61752ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26524bca9d5f46ed9979c2196265a2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:51:30.409593 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5633c523-71d6-453c-abdb-e7304599ded9 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] 10.222.0.23 "GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35" status: 200 len: 1303 microversion: 2.1 time: 0.289196 Oct 10 23:51:30.410215 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3115/6062] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:30 2022] GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 => generated 1303 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:51:31.438634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ea081b3d-f0ca-41da-8280-cb2a9c2945f8 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:51:31.439475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ea081b3d-f0ca-41da-8280-cb2a9c2945f8 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] [instance: 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:31.452039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea081b3d-f0ca-41da-8280-cb2a9c2945f8 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:31.461259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea081b3d-f0ca-41da-8280-cb2a9c2945f8 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:31.462060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea081b3d-f0ca-41da-8280-cb2a9c2945f8 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:31.463087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea081b3d-f0ca-41da-8280-cb2a9c2945f8 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:31.463827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea081b3d-f0ca-41da-8280-cb2a9c2945f8 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:31.464516 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea081b3d-f0ca-41da-8280-cb2a9c2945f8 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:31.505435 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-ea081b3d-f0ca-41da-8280-cb2a9c2945f8 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] HTTP exception thrown: Instance 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 could not be found. Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ea081b3d-f0ca-41da-8280-cb2a9c2945f8 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Request method failure captured: Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 HTTP/1.1 Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK_bxQf4WQe0_gwjiCURZp6BZ3zQFpSDNLdakawQb6b_LJUR_xrvMDrAK74A3hhNNBr-CAY99g9pCaTB9pNL33RWdJnNQdIYZa-gDtmq7WoaB67joqutFseQpVAxWA28aLLwSXPUT2ChYLtmPCnOuWxcyrCvFRu-yDT0X61MZhQjTHk Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 26524bca9d5f46ed9979c2196265a2c5 Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-VolumesActionsTest-566008731 Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/26524bca9d5f46ed9979c2196265a2c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/26524bca9d5f46ed9979c2196265a2c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/26524bca9d5f46ed9979c2196265a2c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_26524bca9d5f46ed9979c2196265a2c5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-VolumesActionsTest-566008731 Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 26524bca9d5f46ed9979c2196265a2c5 Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-VolumesActionsTest-566008731 Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-VolumesActionsTest-566008731-project Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 7109b198f86b41f7a1746842b61752ab Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-VolumesActionsTest-566008731-project Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 could not be found. Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35'} Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 could not be found. Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 could not be found. Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:51:31.507514 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:51:31.512451 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:51:31.512451 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:51:31.512451 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:51:31.512451 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:51:31.512451 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:51:31.512451 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 could not be found. Oct 10 23:51:31.512451 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:51:31.517020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ea081b3d-f0ca-41da-8280-cb2a9c2945f8 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] Returning 404 to user: Instance 6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:51:31.521494 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ea081b3d-f0ca-41da-8280-cb2a9c2945f8 tempest-VolumesActionsTest-566008731 tempest-VolumesActionsTest-566008731-project] 10.222.0.23 "GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35" status: 404 len: 111 microversion: 2.1 time: 0.087825 Oct 10 23:51:31.523208 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2948/6063] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:51:31 2022] GET /compute/v2.1/servers/6e92777c-eaa7-4c1d-b5e3-c193a1ca9d35 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:51:45.511989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9db541dd-24f8-4c7f-af0f-5871c944aefa tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:51:45.515290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9db541dd-24f8-4c7f-af0f-5871c944aefa tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:51:45.523285 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 23:51:45.523544 n-d-860864-2 devstack@n-api.service[120613]: Mon Oct 10 23:51:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb/action (ip 10.222.0.23) !!! Oct 10 23:51:45.533239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=27 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:51:45.534644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:51:45.560021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9db541dd-24f8-4c7f-af0f-5871c944aefa tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:45.560818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9db541dd-24f8-4c7f-af0f-5871c944aefa tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:45.561307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9db541dd-24f8-4c7f-af0f-5871c944aefa tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:45.562114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9db541dd-24f8-4c7f-af0f-5871c944aefa tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:51:45.562572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9db541dd-24f8-4c7f-af0f-5871c944aefa tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:51:45.563016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9db541dd-24f8-4c7f-af0f-5871c944aefa tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:51:45.650920 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9db541dd-24f8-4c7f-af0f-5871c944aefa tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "POST /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb/action" status: 200 len: 24569 microversion: 2.1 time: 0.143570 Oct 10 23:51:45.652551 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3116/6064] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:51:45 2022] POST /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb/action => generated 24569 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:52:01.892318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:52:01.894214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:52:01.899176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fc227945-416e-4b48-b288-853bae6fed10 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:01.899807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fc227945-416e-4b48-b288-853bae6fed10 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:01.930764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc227945-416e-4b48-b288-853bae6fed10 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:01.931561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc227945-416e-4b48-b288-853bae6fed10 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:01.932215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc227945-416e-4b48-b288-853bae6fed10 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:01.933329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc227945-416e-4b48-b288-853bae6fed10 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:01.934748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc227945-416e-4b48-b288-853bae6fed10 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:01.935355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc227945-416e-4b48-b288-853bae6fed10 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:02.472413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9db541dd-24f8-4c7f-af0f-5871c944aefa tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:02.475455 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9db541dd-24f8-4c7f-af0f-5871c944aefa tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.016215 Oct 10 23:52:02.476704 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3117/6065] 10.222.0.23 () {56 vars in 886 bytes} [Mon Oct 10 23:52:02 2022] GET /compute/ => generated 377 bytes in 20 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 10 23:52:03.280684 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fc227945-416e-4b48-b288-853bae6fed10 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1834 microversion: 2.1 time: 1.390843 Oct 10 23:52:03.288238 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2949/6066] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:01 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1834 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:52:06.726749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-678a3321-7d2b-478e-8614-73e93d64e670 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:06.731535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-678a3321-7d2b-478e-8614-73e93d64e670 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:06.742527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-76e20c95-282e-47da-bab7-c159ff5f3582 req-57e659b6-e89b-49ed-9be0-f812134ea036 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccbe503a-b7c8-4459-87d9-3655cd54bacb", "tag": "4528ff7b-3e24-4d58-a19b-e57043a8de5d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:52:06.759267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:52:06.764389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:52:06.773415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-678a3321-7d2b-478e-8614-73e93d64e670 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:06.776339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-678a3321-7d2b-478e-8614-73e93d64e670 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:06.777967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-678a3321-7d2b-478e-8614-73e93d64e670 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:06.783817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-678a3321-7d2b-478e-8614-73e93d64e670 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:06.786339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-678a3321-7d2b-478e-8614-73e93d64e670 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:06.788108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-678a3321-7d2b-478e-8614-73e93d64e670 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:06.799023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-76e20c95-282e-47da-bab7-c159ff5f3582 req-57e659b6-e89b-49ed-9be0-f812134ea036 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:06.802259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-76e20c95-282e-47da-bab7-c159ff5f3582 req-57e659b6-e89b-49ed-9be0-f812134ea036 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:06.806108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-76e20c95-282e-47da-bab7-c159ff5f3582 req-57e659b6-e89b-49ed-9be0-f812134ea036 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:06.882288 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-76e20c95-282e-47da-bab7-c159ff5f3582 req-57e659b6-e89b-49ed-9be0-f812134ea036 service nova] Creating event network-changed:4528ff7b-3e24-4d58-a19b-e57043a8de5d for instance ccbe503a-b7c8-4459-87d9-3655cd54bacb on n-h1-860864-2 Oct 10 23:52:06.895407 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-76e20c95-282e-47da-bab7-c159ff5f3582 req-57e659b6-e89b-49ed-9be0-f812134ea036 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159206 Oct 10 23:52:06.905958 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2950/6067] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:52:06.919998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-678a3321-7d2b-478e-8614-73e93d64e670 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:52:07.210787 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-678a3321-7d2b-478e-8614-73e93d64e670 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 204 len: 0 microversion: 2.1 time: 0.485496 Oct 10 23:52:07.216130 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3118/6068] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:52:06 2022] DELETE /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:52:07.231803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-92c7f9d5-4920-49d7-b675-35c231de303a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:07.239645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-92c7f9d5-4920-49d7-b675-35c231de303a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:07.290106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92c7f9d5-4920-49d7-b675-35c231de303a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:07.291139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92c7f9d5-4920-49d7-b675-35c231de303a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:07.294636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92c7f9d5-4920-49d7-b675-35c231de303a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:07.299711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92c7f9d5-4920-49d7-b675-35c231de303a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:07.300642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92c7f9d5-4920-49d7-b675-35c231de303a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:07.301399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92c7f9d5-4920-49d7-b675-35c231de303a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:08.738531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-92c7f9d5-4920-49d7-b675-35c231de303a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:52:08.747340 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-92c7f9d5-4920-49d7-b675-35c231de303a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1689 microversion: 2.1 time: 1.524831 Oct 10 23:52:08.756305 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2951/6069] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:07 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1689 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:52:09.782323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6195983f-26ea-4bcd-a9ed-0198f5343820 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:09.783046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6195983f-26ea-4bcd-a9ed-0198f5343820 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:09.801122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6195983f-26ea-4bcd-a9ed-0198f5343820 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:09.806229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6195983f-26ea-4bcd-a9ed-0198f5343820 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:09.809315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6195983f-26ea-4bcd-a9ed-0198f5343820 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:09.831514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6195983f-26ea-4bcd-a9ed-0198f5343820 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:09.834623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6195983f-26ea-4bcd-a9ed-0198f5343820 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:09.836591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6195983f-26ea-4bcd-a9ed-0198f5343820 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:11.518876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6195983f-26ea-4bcd-a9ed-0198f5343820 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:52:11.532292 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6195983f-26ea-4bcd-a9ed-0198f5343820 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1689 microversion: 2.1 time: 1.755615 Oct 10 23:52:11.534338 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3119/6070] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:09 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1689 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:52:12.239478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-ae2b0ac7-7d32-49d3-af6e-0c75f6a7a540 req-c01f7c79-1a23-43bc-be9e-532453f91c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbe503a-b7c8-4459-87d9-3655cd54bacb", "name": "network-vif-deleted", "tag": "4528ff7b-3e24-4d58-a19b-e57043a8de5d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:52:12.266237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ae2b0ac7-7d32-49d3-af6e-0c75f6a7a540 req-c01f7c79-1a23-43bc-be9e-532453f91c0f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:12.268481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ae2b0ac7-7d32-49d3-af6e-0c75f6a7a540 req-c01f7c79-1a23-43bc-be9e-532453f91c0f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:12.268978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ae2b0ac7-7d32-49d3-af6e-0c75f6a7a540 req-c01f7c79-1a23-43bc-be9e-532453f91c0f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:12.325629 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-ae2b0ac7-7d32-49d3-af6e-0c75f6a7a540 req-c01f7c79-1a23-43bc-be9e-532453f91c0f service nova] Creating event network-vif-deleted:4528ff7b-3e24-4d58-a19b-e57043a8de5d for instance ccbe503a-b7c8-4459-87d9-3655cd54bacb on n-h1-860864-2 Oct 10 23:52:12.352190 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-ae2b0ac7-7d32-49d3-af6e-0c75f6a7a540 req-c01f7c79-1a23-43bc-be9e-532453f91c0f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110764 Oct 10 23:52:12.352868 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2952/6071] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:52:12.566497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-86ec2bf6-0b4d-4a52-a3ac-525de17f1dca tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:12.567365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-86ec2bf6-0b4d-4a52-a3ac-525de17f1dca tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:12.599103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86ec2bf6-0b4d-4a52-a3ac-525de17f1dca tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:12.603626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86ec2bf6-0b4d-4a52-a3ac-525de17f1dca tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:12.604420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86ec2bf6-0b4d-4a52-a3ac-525de17f1dca tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:12.605527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86ec2bf6-0b4d-4a52-a3ac-525de17f1dca tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:12.606321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86ec2bf6-0b4d-4a52-a3ac-525de17f1dca tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:12.630202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86ec2bf6-0b4d-4a52-a3ac-525de17f1dca tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:12.711953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86ec2bf6-0b4d-4a52-a3ac-525de17f1dca tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:12.723313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86ec2bf6-0b4d-4a52-a3ac-525de17f1dca tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:12.725495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86ec2bf6-0b4d-4a52-a3ac-525de17f1dca tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:12.727466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-86ec2bf6-0b4d-4a52-a3ac-525de17f1dca tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lazy-loading 'fault' on Instance uuid ccbe503a-b7c8-4459-87d9-3655cd54bacb {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:52:12.864039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-86ec2bf6-0b4d-4a52-a3ac-525de17f1dca tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:52:12.912365 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-86ec2bf6-0b4d-4a52-a3ac-525de17f1dca tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 200 len: 1356 microversion: 2.1 time: 0.348255 Oct 10 23:52:12.932265 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3120/6072] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:12 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 1356 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:52:13.966622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6f4b5d91-516f-47a8-aa09-7d58cfd6cf37 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:13.968811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6f4b5d91-516f-47a8-aa09-7d58cfd6cf37 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: ccbe503a-b7c8-4459-87d9-3655cd54bacb] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:13.982233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f4b5d91-516f-47a8-aa09-7d58cfd6cf37 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:13.983717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f4b5d91-516f-47a8-aa09-7d58cfd6cf37 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:13.985641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f4b5d91-516f-47a8-aa09-7d58cfd6cf37 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:13.988632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f4b5d91-516f-47a8-aa09-7d58cfd6cf37 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:13.989895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f4b5d91-516f-47a8-aa09-7d58cfd6cf37 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:13.992862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f4b5d91-516f-47a8-aa09-7d58cfd6cf37 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:14.038230 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-6f4b5d91-516f-47a8-aa09-7d58cfd6cf37 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] HTTP exception thrown: Instance ccbe503a-b7c8-4459-87d9-3655cd54bacb could not be found. Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6f4b5d91-516f-47a8-aa09-7d58cfd6cf37 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Request method failure captured: Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb HTTP/1.1 Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK-BB4x4tnje8g7V7yndZ-eCfyvwZsAbSuBD8sfr6-xUWiLbFDaunp7PR2T5QmNvvFy5RcKeKPLvsd2T_42GBJZpMrvANis61xLfLWHDewFuoiaKXb-VOoVnXShsE7RvrF0WakEav91aLufkTYJLnPujB4bORnh17YSIuys0bjxdSkA Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: fce4582b30d041c592240d09a95a37e5 Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-704048199 Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fce4582b30d041c592240d09a95a37e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fce4582b30d041c592240d09a95a37e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fce4582b30d041c592240d09a95a37e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fce4582b30d041c592240d09a95a37e5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TestNetworkAdvancedServerOps-704048199 Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: fce4582b30d041c592240d09a95a37e5 Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-704048199 Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TestNetworkAdvancedServerOps-704048199-project Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: ce22396752cd4d71991c6994a31f4905 Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TestNetworkAdvancedServerOps-704048199-project Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance ccbe503a-b7c8-4459-87d9-3655cd54bacb could not be found. Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'ccbe503a-b7c8-4459-87d9-3655cd54bacb'} Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccbe503a-b7c8-4459-87d9-3655cd54bacb could not be found. Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccbe503a-b7c8-4459-87d9-3655cd54bacb could not be found. Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:52:14.040291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:52:14.052939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:52:14.052939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:52:14.052939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:52:14.052939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:52:14.052939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:52:14.052939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:52:14.052939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccbe503a-b7c8-4459-87d9-3655cd54bacb could not be found. Oct 10 23:52:14.052939 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:52:14.052939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6f4b5d91-516f-47a8-aa09-7d58cfd6cf37 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Returning 404 to user: Instance ccbe503a-b7c8-4459-87d9-3655cd54bacb could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:52:14.052939 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6f4b5d91-516f-47a8-aa09-7d58cfd6cf37 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb" status: 404 len: 111 microversion: 2.1 time: 0.083216 Oct 10 23:52:14.052939 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2953/6073] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:13 2022] GET /compute/v2.1/servers/ccbe503a-b7c8-4459-87d9-3655cd54bacb => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:52:22.360456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ea881a0e-1a08-4b2f-a661-e7f51e957e47 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '.version_select at 0x7f662b914820>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:22.411564 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ea881a0e-1a08-4b2f-a661-e7f51e957e47 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-912348890" status: 202 len: 0 microversion: 2.1 time: 0.058101 Oct 10 23:52:22.412873 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3121/6074] 10.222.0.23 () {58 vars in 1281 bytes} [Mon Oct 10 23:52:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-912348890 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:52:22.460356 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-86ca9dcc-5e79-41cd-a6ec-b00550b90e71 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Action: 'create', calling method: .version_select at 0x7f662a282f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-229235599", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9F2b6EdJEwucG+n8Ytdo5GGckz4FKGJAyYmIr2TLHQnOUC48+/ocMJSudqX1hLWD0KgarZ0z22dsatlLI7FSIXDUve0uD4Lt8Jwc3ZWz3Gg2zufd4knaW/04iRqSr/ew=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:52:22.497271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-86ca9dcc-5e79-41cd-a6ec-b00550b90e71 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Getting quotas for project fce4582b30d041c592240d09a95a37e5. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:52:22.515500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-86ca9dcc-5e79-41cd-a6ec-b00550b90e71 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Getting quotas for user ce22396752cd4d71991c6994a31f4905 and project fce4582b30d041c592240d09a95a37e5. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:52:22.585122 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-86ca9dcc-5e79-41cd-a6ec-b00550b90e71 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.127825 Oct 10 23:52:22.604091 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2954/6075] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:52:22 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:52:35.720244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:52:35.723096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:52:36.108139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fee295cc-679a-47db-a294-f5bcde55dab5 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Action: 'create', calling method: .version_select at 0x7f662a71cdc0>, body: {"keypair": {"name": "tempest-keypair-2110227326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5/rK4AmH84a5XqiZ4FiIwvECVGBv4Ltgo1p4xBJkE73seQCDVZ2e20GDTPuIJozpuIEWTjrfOIHihWhzNnMMCTxrDBmZPJOAv2gL0KDjKQKxO9QjjjLOjJklR2/Xm6LQ=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:52:36.156958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-fee295cc-679a-47db-a294-f5bcde55dab5 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Getting quotas for project 0fcaa1fb124e448b8bacb6353fca9d5d. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:52:36.177635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-fee295cc-679a-47db-a294-f5bcde55dab5 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Getting quotas for user b7008c9b5ad94dbea7edc12267dae2b5 and project 0fcaa1fb124e448b8bacb6353fca9d5d. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:52:36.242729 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fee295cc-679a-47db-a294-f5bcde55dab5 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.523198 Oct 10 23:52:36.251990 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3122/6076] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:52:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:52:43.534950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-29805ed5-4c58-430a-bf88-95d291c93111 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-197475874", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ab1ca05-35c0-4cfd-8d35-c70ce321d096"}], "security_groups": [{"name": "tempest-securitygroup--1529557768"}], "key_name": "tempest-keypair-2110227326", "user_data": "}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:52:43.566612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=18 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:52:43.569691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:52:43.571490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:52:43.780938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8d37eed9-d923-4ec8-8075-95af22ba67c2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1368289486", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "3eedc442-f202-4689-ab79-64c347ba1947"}], "key_name": "tempest-TestNetworkAdvancedServerOps-229235599", "security_groups": [{"name": "tempest-secgroup-smoke-968727939"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:52:43.911636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-29805ed5-4c58-430a-bf88-95d291c93111 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] validate_networks() for [('1ab1ca05-35c0-4cfd-8d35-c70ce321d096', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:52:44.102052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-8d37eed9-d923-4ec8-8075-95af22ba67c2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] validate_networks() for [('3eedc442-f202-4689-ab79-64c347ba1947', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:52:45.748057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-29805ed5-4c58-430a-bf88-95d291c93111 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:52:45.750407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-29805ed5-4c58-430a-bf88-95d291c93111 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:52:45.753154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-29805ed5-4c58-430a-bf88-95d291c93111 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:52:45.753988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-29805ed5-4c58-430a-bf88-95d291c93111 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:52:45.754650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-29805ed5-4c58-430a-bf88-95d291c93111 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:52:45.772619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29805ed5-4c58-430a-bf88-95d291c93111 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:45.773602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29805ed5-4c58-430a-bf88-95d291c93111 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:45.774907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29805ed5-4c58-430a-bf88-95d291c93111 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:45.775926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29805ed5-4c58-430a-bf88-95d291c93111 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:45.776626 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29805ed5-4c58-430a-bf88-95d291c93111 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:45.777303 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29805ed5-4c58-430a-bf88-95d291c93111 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:45.806745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-29805ed5-4c58-430a-bf88-95d291c93111 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Getting quotas for project 0fcaa1fb124e448b8bacb6353fca9d5d. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:52:45.818823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-29805ed5-4c58-430a-bf88-95d291c93111 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Getting quotas for user b7008c9b5ad94dbea7edc12267dae2b5 and project 0fcaa1fb124e448b8bacb6353fca9d5d. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:52:45.849320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-29805ed5-4c58-430a-bf88-95d291c93111 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:52:45.861107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-29805ed5-4c58-430a-bf88-95d291c93111 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:52:45.967663 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-29805ed5-4c58-430a-bf88-95d291c93111 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.440419 Oct 10 23:52:45.969499 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2955/6077] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:52:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 2443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:52:45.982471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ba0bdc39-5575-4639-8d80-6bf4162f803d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:45.983783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ba0bdc39-5575-4639-8d80-6bf4162f803d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:46.061658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-8d37eed9-d923-4ec8-8075-95af22ba67c2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:52:46.063555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-8d37eed9-d923-4ec8-8075-95af22ba67c2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:52:46.064702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-8d37eed9-d923-4ec8-8075-95af22ba67c2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:52:46.065323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-8d37eed9-d923-4ec8-8075-95af22ba67c2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:52:46.066019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-8d37eed9-d923-4ec8-8075-95af22ba67c2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:52:46.096270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d37eed9-d923-4ec8-8075-95af22ba67c2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:46.096839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d37eed9-d923-4ec8-8075-95af22ba67c2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:46.104541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d37eed9-d923-4ec8-8075-95af22ba67c2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:46.105531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d37eed9-d923-4ec8-8075-95af22ba67c2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:46.107799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d37eed9-d923-4ec8-8075-95af22ba67c2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:46.110101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d37eed9-d923-4ec8-8075-95af22ba67c2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:46.128949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ba0bdc39-5575-4639-8d80-6bf4162f803d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:52:46.153048 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ba0bdc39-5575-4639-8d80-6bf4162f803d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46" status: 200 len: 1241 microversion: 2.1 time: 0.175124 Oct 10 23:52:46.157115 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2956/6078] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:45 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 => generated 1241 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:52:46.204758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-8d37eed9-d923-4ec8-8075-95af22ba67c2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Getting quotas for project fce4582b30d041c592240d09a95a37e5. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:52:46.227178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-8d37eed9-d923-4ec8-8075-95af22ba67c2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Getting quotas for user ce22396752cd4d71991c6994a31f4905 and project fce4582b30d041c592240d09a95a37e5. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:52:46.289729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8d37eed9-d923-4ec8-8075-95af22ba67c2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:52:46.297298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8d37eed9-d923-4ec8-8075-95af22ba67c2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:52:46.455010 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8d37eed9-d923-4ec8-8075-95af22ba67c2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.680189 Oct 10 23:52:46.458857 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3123/6079] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:52:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 2685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:52:46.473010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c5173345-b09f-4822-b926-37885427a560 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:46.474164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c5173345-b09f-4822-b926-37885427a560 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:46.761831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c5173345-b09f-4822-b926-37885427a560 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:52:46.780362 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c5173345-b09f-4822-b926-37885427a560 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1266 microversion: 2.1 time: 0.313264 Oct 10 23:52:46.781064 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2957/6080] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:46 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1266 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:52:47.188245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f1d2bc7b-c1bf-4d29-bf7b-b0ae61333b1a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:47.193089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f1d2bc7b-c1bf-4d29-bf7b-b0ae61333b1a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:47.327611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f1d2bc7b-c1bf-4d29-bf7b-b0ae61333b1a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:52:47.339949 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f1d2bc7b-c1bf-4d29-bf7b-b0ae61333b1a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46" status: 200 len: 1241 microversion: 2.1 time: 0.154591 Oct 10 23:52:47.343886 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3124/6081] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:47 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 => generated 1241 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:52:47.804802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6570907c-3c6b-411f-9031-6d56b77b2ac7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:47.805768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6570907c-3c6b-411f-9031-6d56b77b2ac7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:47.841447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6570907c-3c6b-411f-9031-6d56b77b2ac7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:47.841951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6570907c-3c6b-411f-9031-6d56b77b2ac7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:47.842372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6570907c-3c6b-411f-9031-6d56b77b2ac7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:47.844126 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6570907c-3c6b-411f-9031-6d56b77b2ac7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:47.844730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6570907c-3c6b-411f-9031-6d56b77b2ac7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:47.845167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6570907c-3c6b-411f-9031-6d56b77b2ac7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:47.954878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6570907c-3c6b-411f-9031-6d56b77b2ac7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:52:47.967260 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6570907c-3c6b-411f-9031-6d56b77b2ac7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1262 microversion: 2.1 time: 0.166116 Oct 10 23:52:47.968704 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2958/6082] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:47 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1262 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:52:48.373338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fe01498a-d34c-4f46-b9ac-e112e04df768 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:48.374086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fe01498a-d34c-4f46-b9ac-e112e04df768 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:48.388257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe01498a-d34c-4f46-b9ac-e112e04df768 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:48.388257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe01498a-d34c-4f46-b9ac-e112e04df768 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:48.392647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe01498a-d34c-4f46-b9ac-e112e04df768 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:48.393756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe01498a-d34c-4f46-b9ac-e112e04df768 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:48.394511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe01498a-d34c-4f46-b9ac-e112e04df768 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:48.395198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe01498a-d34c-4f46-b9ac-e112e04df768 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:48.511429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fe01498a-d34c-4f46-b9ac-e112e04df768 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:52:48.525456 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fe01498a-d34c-4f46-b9ac-e112e04df768 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46" status: 200 len: 1293 microversion: 2.1 time: 0.155578 Oct 10 23:52:48.526089 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3125/6083] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:48 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 => generated 1293 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:52:49.002251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fa777b03-536e-4d4e-8433-6c9a53f8d8e1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:49.002971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fa777b03-536e-4d4e-8433-6c9a53f8d8e1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:49.020167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa777b03-536e-4d4e-8433-6c9a53f8d8e1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:49.041919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa777b03-536e-4d4e-8433-6c9a53f8d8e1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:49.042478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa777b03-536e-4d4e-8433-6c9a53f8d8e1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:49.046920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa777b03-536e-4d4e-8433-6c9a53f8d8e1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:49.047558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa777b03-536e-4d4e-8433-6c9a53f8d8e1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:49.048000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa777b03-536e-4d4e-8433-6c9a53f8d8e1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:49.251215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fa777b03-536e-4d4e-8433-6c9a53f8d8e1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:52:49.268647 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fa777b03-536e-4d4e-8433-6c9a53f8d8e1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1318 microversion: 2.1 time: 0.269028 Oct 10 23:52:49.277624 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2959/6084] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:48 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:52:49.559167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ac9d5809-9cb8-4b7e-8a9e-231d2fdcd949 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:49.560070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ac9d5809-9cb8-4b7e-8a9e-231d2fdcd949 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:49.581732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac9d5809-9cb8-4b7e-8a9e-231d2fdcd949 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:49.582300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac9d5809-9cb8-4b7e-8a9e-231d2fdcd949 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:49.583355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac9d5809-9cb8-4b7e-8a9e-231d2fdcd949 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:49.595551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac9d5809-9cb8-4b7e-8a9e-231d2fdcd949 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:49.595717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac9d5809-9cb8-4b7e-8a9e-231d2fdcd949 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:49.596157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac9d5809-9cb8-4b7e-8a9e-231d2fdcd949 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:49.803172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ac9d5809-9cb8-4b7e-8a9e-231d2fdcd949 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:52:49.811785 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ac9d5809-9cb8-4b7e-8a9e-231d2fdcd949 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46" status: 200 len: 1299 microversion: 2.1 time: 0.259887 Oct 10 23:52:49.830770 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3126/6085] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:49 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 => generated 1299 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:52:50.296546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-90e2653f-6caa-4dfc-b0a3-453f588274a2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:50.297427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-90e2653f-6caa-4dfc-b0a3-453f588274a2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:50.324722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90e2653f-6caa-4dfc-b0a3-453f588274a2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:50.325646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90e2653f-6caa-4dfc-b0a3-453f588274a2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:50.326403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90e2653f-6caa-4dfc-b0a3-453f588274a2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:50.327620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90e2653f-6caa-4dfc-b0a3-453f588274a2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:50.328349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90e2653f-6caa-4dfc-b0a3-453f588274a2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:50.342385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90e2653f-6caa-4dfc-b0a3-453f588274a2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:50.498479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-90e2653f-6caa-4dfc-b0a3-453f588274a2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:52:50.514422 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-90e2653f-6caa-4dfc-b0a3-453f588274a2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1324 microversion: 2.1 time: 0.223659 Oct 10 23:52:50.521801 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2960/6086] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:50 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1324 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:52:50.837417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9dad3d39-a1a1-4d23-b704-cb444e7c29a0 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:50.838193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9dad3d39-a1a1-4d23-b704-cb444e7c29a0 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:50.886470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9dad3d39-a1a1-4d23-b704-cb444e7c29a0 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:50.887123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9dad3d39-a1a1-4d23-b704-cb444e7c29a0 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:50.887581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9dad3d39-a1a1-4d23-b704-cb444e7c29a0 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:50.888335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9dad3d39-a1a1-4d23-b704-cb444e7c29a0 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:50.898240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9dad3d39-a1a1-4d23-b704-cb444e7c29a0 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:50.900579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9dad3d39-a1a1-4d23-b704-cb444e7c29a0 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:51.400444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9dad3d39-a1a1-4d23-b704-cb444e7c29a0 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:52:51.413805 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9dad3d39-a1a1-4d23-b704-cb444e7c29a0 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46" status: 200 len: 1367 microversion: 2.1 time: 0.581296 Oct 10 23:52:51.417809 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3127/6087] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:50 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 => generated 1367 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:52:51.561054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7215c811-61c5-452d-bb34-2f8333cac11d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:51.562037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7215c811-61c5-452d-bb34-2f8333cac11d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:51.586427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7215c811-61c5-452d-bb34-2f8333cac11d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:51.591900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7215c811-61c5-452d-bb34-2f8333cac11d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:51.592462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7215c811-61c5-452d-bb34-2f8333cac11d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:51.594154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7215c811-61c5-452d-bb34-2f8333cac11d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:51.595168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7215c811-61c5-452d-bb34-2f8333cac11d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:51.595871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7215c811-61c5-452d-bb34-2f8333cac11d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:52.074720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7215c811-61c5-452d-bb34-2f8333cac11d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:52:52.090734 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7215c811-61c5-452d-bb34-2f8333cac11d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1391 microversion: 2.1 time: 0.536969 Oct 10 23:52:52.095043 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2961/6088] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:51 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1391 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:52:52.211787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-2a1b4ee8-4888-4870-80de-301b1cc7f157 req-28b91010-a5d4-4f5e-9a35-5ca1045d804c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c7187f-8a0e-4319-8ec2-245aa1357f46", "tag": "a1a3a67e-c0c9-4fd7-8506-921dcf10af0a"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:52:52.224195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2a1b4ee8-4888-4870-80de-301b1cc7f157 req-28b91010-a5d4-4f5e-9a35-5ca1045d804c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:52.224949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2a1b4ee8-4888-4870-80de-301b1cc7f157 req-28b91010-a5d4-4f5e-9a35-5ca1045d804c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:52.225686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2a1b4ee8-4888-4870-80de-301b1cc7f157 req-28b91010-a5d4-4f5e-9a35-5ca1045d804c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:52.244238 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-2a1b4ee8-4888-4870-80de-301b1cc7f157 req-28b91010-a5d4-4f5e-9a35-5ca1045d804c service nova] Creating event network-changed:a1a3a67e-c0c9-4fd7-8506-921dcf10af0a for instance 38c7187f-8a0e-4319-8ec2-245aa1357f46 on n-h1-860864-2 Oct 10 23:52:52.251950 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-2a1b4ee8-4888-4870-80de-301b1cc7f157 req-28b91010-a5d4-4f5e-9a35-5ca1045d804c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043669 Oct 10 23:52:52.253187 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3128/6089] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:52:52.452675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7b3826fd-728d-4165-8ca2-646099c92eca tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:52.454701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7b3826fd-728d-4165-8ca2-646099c92eca tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:52.463865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b3826fd-728d-4165-8ca2-646099c92eca tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:52.464751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b3826fd-728d-4165-8ca2-646099c92eca tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:52.465758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b3826fd-728d-4165-8ca2-646099c92eca tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:52.466924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b3826fd-728d-4165-8ca2-646099c92eca tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:52.468556 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b3826fd-728d-4165-8ca2-646099c92eca tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:52.469123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b3826fd-728d-4165-8ca2-646099c92eca tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:53.034134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7b3826fd-728d-4165-8ca2-646099c92eca tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:52:53.063854 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7b3826fd-728d-4165-8ca2-646099c92eca tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46" status: 200 len: 1367 microversion: 2.1 time: 0.617098 Oct 10 23:52:53.064472 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2962/6090] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:52 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 => generated 1367 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:52:53.121806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c204b4bd-4257-44cb-a52f-60c5c0137c8c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:53.123233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c204b4bd-4257-44cb-a52f-60c5c0137c8c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:53.143499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c204b4bd-4257-44cb-a52f-60c5c0137c8c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:53.145346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c204b4bd-4257-44cb-a52f-60c5c0137c8c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:53.147764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c204b4bd-4257-44cb-a52f-60c5c0137c8c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:53.151788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c204b4bd-4257-44cb-a52f-60c5c0137c8c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:53.153101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c204b4bd-4257-44cb-a52f-60c5c0137c8c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:53.154393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c204b4bd-4257-44cb-a52f-60c5c0137c8c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:53.536338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-5c3a1d22-7f8f-4452-b420-2ef4821c9122 req-c6bfb24f-e8b0-4b54-9573-237d2fa8e102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1620135-b28b-4695-8abf-cbf46a5421d3", "tag": "15d44200-1f5f-4b96-924d-701730ace82a"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:52:53.583550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5c3a1d22-7f8f-4452-b420-2ef4821c9122 req-c6bfb24f-e8b0-4b54-9573-237d2fa8e102 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:53.584465 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5c3a1d22-7f8f-4452-b420-2ef4821c9122 req-c6bfb24f-e8b0-4b54-9573-237d2fa8e102 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:53.586155 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5c3a1d22-7f8f-4452-b420-2ef4821c9122 req-c6bfb24f-e8b0-4b54-9573-237d2fa8e102 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:53.588899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c204b4bd-4257-44cb-a52f-60c5c0137c8c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:52:53.610270 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-5c3a1d22-7f8f-4452-b420-2ef4821c9122 req-c6bfb24f-e8b0-4b54-9573-237d2fa8e102 service nova] Creating event network-changed:15d44200-1f5f-4b96-924d-701730ace82a for instance e1620135-b28b-4695-8abf-cbf46a5421d3 on n-h1-860864-2 Oct 10 23:52:53.616276 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c204b4bd-4257-44cb-a52f-60c5c0137c8c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1391 microversion: 2.1 time: 0.502112 Oct 10 23:52:53.619023 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-5c3a1d22-7f8f-4452-b420-2ef4821c9122 req-c6bfb24f-e8b0-4b54-9573-237d2fa8e102 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.452049 Oct 10 23:52:53.620785 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2963/6091] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:52:53.628789 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3129/6092] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:53 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1391 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:52:54.112050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-790d8f3a-0c92-4834-a2a9-e01847bcc8be tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:54.113396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-790d8f3a-0c92-4834-a2a9-e01847bcc8be tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:54.126131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-790d8f3a-0c92-4834-a2a9-e01847bcc8be tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:54.126131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-790d8f3a-0c92-4834-a2a9-e01847bcc8be tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:54.126131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-790d8f3a-0c92-4834-a2a9-e01847bcc8be tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:54.126744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-790d8f3a-0c92-4834-a2a9-e01847bcc8be tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:54.127305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-790d8f3a-0c92-4834-a2a9-e01847bcc8be tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:54.128347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-790d8f3a-0c92-4834-a2a9-e01847bcc8be tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:54.448555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-790d8f3a-0c92-4834-a2a9-e01847bcc8be tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:52:54.459145 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-790d8f3a-0c92-4834-a2a9-e01847bcc8be tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46" status: 200 len: 1367 microversion: 2.1 time: 0.352465 Oct 10 23:52:54.460480 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2964/6093] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:54 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 => generated 1367 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:52:54.654162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c05e4965-fa8f-42ef-b5a3-7c3e86cc5847 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:54.656609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c05e4965-fa8f-42ef-b5a3-7c3e86cc5847 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:54.668102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c05e4965-fa8f-42ef-b5a3-7c3e86cc5847 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:54.668693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c05e4965-fa8f-42ef-b5a3-7c3e86cc5847 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:54.669237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c05e4965-fa8f-42ef-b5a3-7c3e86cc5847 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:54.670194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c05e4965-fa8f-42ef-b5a3-7c3e86cc5847 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:54.670737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c05e4965-fa8f-42ef-b5a3-7c3e86cc5847 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:54.671222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c05e4965-fa8f-42ef-b5a3-7c3e86cc5847 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:54.839669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c05e4965-fa8f-42ef-b5a3-7c3e86cc5847 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:52:54.852311 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c05e4965-fa8f-42ef-b5a3-7c3e86cc5847 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1391 microversion: 2.1 time: 0.203401 Oct 10 23:52:54.853647 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3130/6094] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:54 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1391 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:52:55.498333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d0badeac-5e5b-4c94-b0cb-b2f9866872f3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:55.500943 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d0badeac-5e5b-4c94-b0cb-b2f9866872f3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:55.515502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0badeac-5e5b-4c94-b0cb-b2f9866872f3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:55.516427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0badeac-5e5b-4c94-b0cb-b2f9866872f3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:55.517235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0badeac-5e5b-4c94-b0cb-b2f9866872f3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:55.518599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0badeac-5e5b-4c94-b0cb-b2f9866872f3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:55.519613 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0badeac-5e5b-4c94-b0cb-b2f9866872f3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:55.520362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0badeac-5e5b-4c94-b0cb-b2f9866872f3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:55.796886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:52:55.822514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d0badeac-5e5b-4c94-b0cb-b2f9866872f3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:52:55.847322 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d0badeac-5e5b-4c94-b0cb-b2f9866872f3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46" status: 200 len: 1367 microversion: 2.1 time: 0.363878 Oct 10 23:52:55.849539 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2965/6095] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:55 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 => generated 1367 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:52:55.888047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c9a1bcc5-4792-4119-b577-f8acf2fe15bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:55.890749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c9a1bcc5-4792-4119-b577-f8acf2fe15bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:55.898950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9a1bcc5-4792-4119-b577-f8acf2fe15bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:55.899815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9a1bcc5-4792-4119-b577-f8acf2fe15bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:55.900442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9a1bcc5-4792-4119-b577-f8acf2fe15bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:55.901351 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9a1bcc5-4792-4119-b577-f8acf2fe15bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:55.902276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9a1bcc5-4792-4119-b577-f8acf2fe15bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:55.902883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9a1bcc5-4792-4119-b577-f8acf2fe15bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:56.132437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c9a1bcc5-4792-4119-b577-f8acf2fe15bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:52:56.161554 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c9a1bcc5-4792-4119-b577-f8acf2fe15bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1391 microversion: 2.1 time: 0.283321 Oct 10 23:52:56.181729 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3131/6096] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:55 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1391 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:52:56.891126 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f27f0601-5599-4cc6-a26e-d8609c297fb4 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:56.893090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f27f0601-5599-4cc6-a26e-d8609c297fb4 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:56.910926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=10 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:52:56.924159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f27f0601-5599-4cc6-a26e-d8609c297fb4 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:56.927146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f27f0601-5599-4cc6-a26e-d8609c297fb4 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:56.930905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f27f0601-5599-4cc6-a26e-d8609c297fb4 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:56.938896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f27f0601-5599-4cc6-a26e-d8609c297fb4 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:56.939881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f27f0601-5599-4cc6-a26e-d8609c297fb4 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:56.941028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f27f0601-5599-4cc6-a26e-d8609c297fb4 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:57.203778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e5f1d008-6363-4627-ace5-1bf5216857f7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:57.214218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e5f1d008-6363-4627-ace5-1bf5216857f7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:57.224582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:52:57.237486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5f1d008-6363-4627-ace5-1bf5216857f7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:57.238096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5f1d008-6363-4627-ace5-1bf5216857f7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:57.238787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5f1d008-6363-4627-ace5-1bf5216857f7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:57.239724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5f1d008-6363-4627-ace5-1bf5216857f7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:57.240396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5f1d008-6363-4627-ace5-1bf5216857f7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:57.241033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5f1d008-6363-4627-ace5-1bf5216857f7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:57.312584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f27f0601-5599-4cc6-a26e-d8609c297fb4 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:52:57.343197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=12 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:52:57.352114 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f27f0601-5599-4cc6-a26e-d8609c297fb4 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46" status: 200 len: 1367 microversion: 2.1 time: 0.465216 Oct 10 23:52:57.355843 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2966/6097] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:56 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 => generated 1367 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:52:57.598963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e5f1d008-6363-4627-ace5-1bf5216857f7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:52:57.611356 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e5f1d008-6363-4627-ace5-1bf5216857f7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1391 microversion: 2.1 time: 0.415751 Oct 10 23:52:57.613090 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3132/6098] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:57 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1391 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:52:58.391775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8b0471af-a8fb-462d-8d3f-670fd37b7d85 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:58.393991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8b0471af-a8fb-462d-8d3f-670fd37b7d85 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:58.425258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b0471af-a8fb-462d-8d3f-670fd37b7d85 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:58.426576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b0471af-a8fb-462d-8d3f-670fd37b7d85 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:58.429402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b0471af-a8fb-462d-8d3f-670fd37b7d85 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:58.439935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b0471af-a8fb-462d-8d3f-670fd37b7d85 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:58.444092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b0471af-a8fb-462d-8d3f-670fd37b7d85 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:58.450464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8b0471af-a8fb-462d-8d3f-670fd37b7d85 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:58.650533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b690e333-9eef-4c50-8b9c-4a450c7c0d2a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:52:58.658330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b690e333-9eef-4c50-8b9c-4a450c7c0d2a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:52:58.682578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b690e333-9eef-4c50-8b9c-4a450c7c0d2a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:58.683316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b690e333-9eef-4c50-8b9c-4a450c7c0d2a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:58.687668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b690e333-9eef-4c50-8b9c-4a450c7c0d2a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:58.688991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b690e333-9eef-4c50-8b9c-4a450c7c0d2a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:52:58.689673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b690e333-9eef-4c50-8b9c-4a450c7c0d2a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:52:58.691524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b690e333-9eef-4c50-8b9c-4a450c7c0d2a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:52:59.115272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8b0471af-a8fb-462d-8d3f-670fd37b7d85 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:52:59.127807 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8b0471af-a8fb-462d-8d3f-670fd37b7d85 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46" status: 200 len: 1367 microversion: 2.1 time: 0.749674 Oct 10 23:52:59.145470 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2967/6099] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:58 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 => generated 1367 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:52:59.320931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b690e333-9eef-4c50-8b9c-4a450c7c0d2a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:52:59.337998 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b690e333-9eef-4c50-8b9c-4a450c7c0d2a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1391 microversion: 2.1 time: 0.695812 Oct 10 23:52:59.354321 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3133/6100] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:52:58 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1391 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:53:00.152955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b6d0e4dd-3425-460a-b28d-52c9ecc61cce tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:53:00.154231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b6d0e4dd-3425-460a-b28d-52c9ecc61cce tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:53:00.162355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6d0e4dd-3425-460a-b28d-52c9ecc61cce tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:00.162847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6d0e4dd-3425-460a-b28d-52c9ecc61cce tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:00.163286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6d0e4dd-3425-460a-b28d-52c9ecc61cce tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:00.163995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6d0e4dd-3425-460a-b28d-52c9ecc61cce tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:00.164451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6d0e4dd-3425-460a-b28d-52c9ecc61cce tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:00.164883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b6d0e4dd-3425-460a-b28d-52c9ecc61cce tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:00.559349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-5262aa44-76b7-4add-9604-cee9cf92f93a req-71740efb-fce3-49c1-85f3-aca2295c023a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c7187f-8a0e-4319-8ec2-245aa1357f46", "name": "network-vif-plugged", "status": "completed", "tag": "a1a3a67e-c0c9-4fd7-8506-921dcf10af0a"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:53:00.589952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5262aa44-76b7-4add-9604-cee9cf92f93a req-71740efb-fce3-49c1-85f3-aca2295c023a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:00.591318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5262aa44-76b7-4add-9604-cee9cf92f93a req-71740efb-fce3-49c1-85f3-aca2295c023a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:00.595008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5262aa44-76b7-4add-9604-cee9cf92f93a req-71740efb-fce3-49c1-85f3-aca2295c023a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:00.628655 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-5262aa44-76b7-4add-9604-cee9cf92f93a req-71740efb-fce3-49c1-85f3-aca2295c023a service nova] Creating event network-vif-plugged:a1a3a67e-c0c9-4fd7-8506-921dcf10af0a for instance 38c7187f-8a0e-4319-8ec2-245aa1357f46 on n-h1-860864-2 Oct 10 23:53:00.641449 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-5262aa44-76b7-4add-9604-cee9cf92f93a req-71740efb-fce3-49c1-85f3-aca2295c023a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.372757 Oct 10 23:53:00.643820 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3134/6101] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:53:00.661975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-00269024-2e7a-4f4f-b926-b9509cb14623 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:53:00.662714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-00269024-2e7a-4f4f-b926-b9509cb14623 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:53:00.681272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00269024-2e7a-4f4f-b926-b9509cb14623 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:00.681816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00269024-2e7a-4f4f-b926-b9509cb14623 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:00.682247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00269024-2e7a-4f4f-b926-b9509cb14623 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:00.689593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00269024-2e7a-4f4f-b926-b9509cb14623 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:00.690352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00269024-2e7a-4f4f-b926-b9509cb14623 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:00.691001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00269024-2e7a-4f4f-b926-b9509cb14623 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:00.693589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b6d0e4dd-3425-460a-b28d-52c9ecc61cce tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:53:00.712665 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b6d0e4dd-3425-460a-b28d-52c9ecc61cce tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46" status: 200 len: 1367 microversion: 2.1 time: 0.564288 Oct 10 23:53:00.719757 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2968/6102] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:53:00 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 => generated 1367 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:53:01.223226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-00269024-2e7a-4f4f-b926-b9509cb14623 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:53:01.237331 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-00269024-2e7a-4f4f-b926-b9509cb14623 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1391 microversion: 2.1 time: 0.592000 Oct 10 23:53:01.250387 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3135/6103] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:53:00 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1391 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:53:01.742254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dc69321d-a10c-46bb-85f9-2a7e68be2d94 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:53:01.743721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dc69321d-a10c-46bb-85f9-2a7e68be2d94 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:53:01.752427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc69321d-a10c-46bb-85f9-2a7e68be2d94 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:01.753503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc69321d-a10c-46bb-85f9-2a7e68be2d94 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:01.754237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc69321d-a10c-46bb-85f9-2a7e68be2d94 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:01.755321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc69321d-a10c-46bb-85f9-2a7e68be2d94 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:01.756108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc69321d-a10c-46bb-85f9-2a7e68be2d94 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:01.756789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc69321d-a10c-46bb-85f9-2a7e68be2d94 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:01.967243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dc69321d-a10c-46bb-85f9-2a7e68be2d94 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:53:01.990440 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dc69321d-a10c-46bb-85f9-2a7e68be2d94 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46" status: 200 len: 1367 microversion: 2.1 time: 0.252447 Oct 10 23:53:01.991292 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2969/6104] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:53:01 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:53:02.273215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0b97b7df-9767-4ee1-a527-e0bc7abf3a23 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:53:02.273855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0b97b7df-9767-4ee1-a527-e0bc7abf3a23 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:53:02.288625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b97b7df-9767-4ee1-a527-e0bc7abf3a23 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:02.289292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b97b7df-9767-4ee1-a527-e0bc7abf3a23 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:02.290270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b97b7df-9767-4ee1-a527-e0bc7abf3a23 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:02.291029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b97b7df-9767-4ee1-a527-e0bc7abf3a23 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:02.293302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b97b7df-9767-4ee1-a527-e0bc7abf3a23 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:02.294276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0b97b7df-9767-4ee1-a527-e0bc7abf3a23 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:02.873125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0b97b7df-9767-4ee1-a527-e0bc7abf3a23 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:53:02.887492 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0b97b7df-9767-4ee1-a527-e0bc7abf3a23 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1391 microversion: 2.1 time: 0.618029 Oct 10 23:53:02.889243 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3136/6105] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:53:02 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1391 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:53:03.056362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-13f97610-4e8d-4a02-8026-9fa5a0ad991f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:53:03.056989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-13f97610-4e8d-4a02-8026-9fa5a0ad991f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:53:03.072092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13f97610-4e8d-4a02-8026-9fa5a0ad991f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:03.072810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13f97610-4e8d-4a02-8026-9fa5a0ad991f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:03.073723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13f97610-4e8d-4a02-8026-9fa5a0ad991f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:03.074869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13f97610-4e8d-4a02-8026-9fa5a0ad991f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:03.080113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13f97610-4e8d-4a02-8026-9fa5a0ad991f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:03.080562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13f97610-4e8d-4a02-8026-9fa5a0ad991f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:03.298285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-13f97610-4e8d-4a02-8026-9fa5a0ad991f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:53:03.317889 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-13f97610-4e8d-4a02-8026-9fa5a0ad991f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46" status: 200 len: 1556 microversion: 2.1 time: 0.277709 Oct 10 23:53:03.319371 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2970/6106] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:53:03 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 => generated 1556 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:53:03.355447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b7ab4cf2-9d09-4607-ba9a-6db4b46d97cd tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:53:03.356591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b7ab4cf2-9d09-4607-ba9a-6db4b46d97cd tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:53:03.365411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7ab4cf2-9d09-4607-ba9a-6db4b46d97cd tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:03.366210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7ab4cf2-9d09-4607-ba9a-6db4b46d97cd tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:03.366834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7ab4cf2-9d09-4607-ba9a-6db4b46d97cd tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:03.367716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7ab4cf2-9d09-4607-ba9a-6db4b46d97cd tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:03.368342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7ab4cf2-9d09-4607-ba9a-6db4b46d97cd tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:03.368941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7ab4cf2-9d09-4607-ba9a-6db4b46d97cd tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:03.584961 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b7ab4cf2-9d09-4607-ba9a-6db4b46d97cd tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.233408 Oct 10 23:53:03.586079 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3137/6107] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Oct 10 23:53:03 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/os-interface => generated 284 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:53:03.914677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ed3b27f9-5b23-403e-9b56-f1be422dd6c3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:53:03.917351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ed3b27f9-5b23-403e-9b56-f1be422dd6c3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:53:03.948809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed3b27f9-5b23-403e-9b56-f1be422dd6c3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:03.949568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed3b27f9-5b23-403e-9b56-f1be422dd6c3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:03.950537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed3b27f9-5b23-403e-9b56-f1be422dd6c3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:03.951739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed3b27f9-5b23-403e-9b56-f1be422dd6c3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:03.956223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed3b27f9-5b23-403e-9b56-f1be422dd6c3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:03.957088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ed3b27f9-5b23-403e-9b56-f1be422dd6c3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:04.382388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-f1446bfc-d386-4980-9dac-ef592d2c2655 req-77cd2cba-8f38-4597-9438-9cc58cb6392f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1620135-b28b-4695-8abf-cbf46a5421d3", "name": "network-vif-plugged", "status": "completed", "tag": "15d44200-1f5f-4b96-924d-701730ace82a"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:53:04.410820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f1446bfc-d386-4980-9dac-ef592d2c2655 req-77cd2cba-8f38-4597-9438-9cc58cb6392f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:04.411592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f1446bfc-d386-4980-9dac-ef592d2c2655 req-77cd2cba-8f38-4597-9438-9cc58cb6392f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:04.414142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f1446bfc-d386-4980-9dac-ef592d2c2655 req-77cd2cba-8f38-4597-9438-9cc58cb6392f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:04.457100 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-f1446bfc-d386-4980-9dac-ef592d2c2655 req-77cd2cba-8f38-4597-9438-9cc58cb6392f service nova] Creating event network-vif-plugged:15d44200-1f5f-4b96-924d-701730ace82a for instance e1620135-b28b-4695-8abf-cbf46a5421d3 on n-h1-860864-2 Oct 10 23:53:04.469420 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-f1446bfc-d386-4980-9dac-ef592d2c2655 req-77cd2cba-8f38-4597-9438-9cc58cb6392f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090609 Oct 10 23:53:04.470046 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3138/6108] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:53:04.480957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ed3b27f9-5b23-403e-9b56-f1be422dd6c3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:53:04.490871 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ed3b27f9-5b23-403e-9b56-f1be422dd6c3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1391 microversion: 2.1 time: 0.582817 Oct 10 23:53:04.507855 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2971/6109] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:53:03 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1391 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:53:05.518602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b6c13682-8b2b-431f-918b-1ec6ac5aa10b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:53:05.519493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b6c13682-8b2b-431f-918b-1ec6ac5aa10b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:53:05.538262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6c13682-8b2b-431f-918b-1ec6ac5aa10b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:05.538834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6c13682-8b2b-431f-918b-1ec6ac5aa10b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:05.539284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6c13682-8b2b-431f-918b-1ec6ac5aa10b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:05.540110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6c13682-8b2b-431f-918b-1ec6ac5aa10b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:05.540577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6c13682-8b2b-431f-918b-1ec6ac5aa10b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:05.541016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6c13682-8b2b-431f-918b-1ec6ac5aa10b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:06.076888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b6c13682-8b2b-431f-918b-1ec6ac5aa10b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:53:06.144128 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b6c13682-8b2b-431f-918b-1ec6ac5aa10b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1391 microversion: 2.1 time: 0.581600 Oct 10 23:53:06.157982 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3139/6110] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:53:05 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1391 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:53:06.506962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-3af8e90a-ee5e-44fc-9fb0-b890ded62366 req-ef3dd66a-9712-4347-ab41-bcd5be8f49d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c7187f-8a0e-4319-8ec2-245aa1357f46", "tag": "a1a3a67e-c0c9-4fd7-8506-921dcf10af0a"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:53:06.540710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3af8e90a-ee5e-44fc-9fb0-b890ded62366 req-ef3dd66a-9712-4347-ab41-bcd5be8f49d4 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:06.541568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3af8e90a-ee5e-44fc-9fb0-b890ded62366 req-ef3dd66a-9712-4347-ab41-bcd5be8f49d4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:06.542052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3af8e90a-ee5e-44fc-9fb0-b890ded62366 req-ef3dd66a-9712-4347-ab41-bcd5be8f49d4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:06.581425 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-3af8e90a-ee5e-44fc-9fb0-b890ded62366 req-ef3dd66a-9712-4347-ab41-bcd5be8f49d4 service nova] Creating event network-changed:a1a3a67e-c0c9-4fd7-8506-921dcf10af0a for instance 38c7187f-8a0e-4319-8ec2-245aa1357f46 on n-h1-860864-2 Oct 10 23:53:06.604800 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-3af8e90a-ee5e-44fc-9fb0-b890ded62366 req-ef3dd66a-9712-4347-ab41-bcd5be8f49d4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102407 Oct 10 23:53:06.605509 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2972/6111] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:53:07.175258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b23788ac-3c47-42de-a49a-887e49330b9c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:53:07.176255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b23788ac-3c47-42de-a49a-887e49330b9c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:53:07.185967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:53:07.188115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b23788ac-3c47-42de-a49a-887e49330b9c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:07.189105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b23788ac-3c47-42de-a49a-887e49330b9c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:07.189971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b23788ac-3c47-42de-a49a-887e49330b9c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:07.190977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b23788ac-3c47-42de-a49a-887e49330b9c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:07.191436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b23788ac-3c47-42de-a49a-887e49330b9c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:07.192171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b23788ac-3c47-42de-a49a-887e49330b9c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:07.746530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b23788ac-3c47-42de-a49a-887e49330b9c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:53:07.766592 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b23788ac-3c47-42de-a49a-887e49330b9c tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1563 microversion: 2.1 time: 0.596385 Oct 10 23:53:07.799026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5f2ef0b4-fd46-4e3e-9a76-44a82ba8a7e5 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:53:07.799797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5f2ef0b4-fd46-4e3e-9a76-44a82ba8a7e5 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:53:07.808705 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3140/6112] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:53:07 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1563 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:53:07.820437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f2ef0b4-fd46-4e3e-9a76-44a82ba8a7e5 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:07.821963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f2ef0b4-fd46-4e3e-9a76-44a82ba8a7e5 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:07.824282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f2ef0b4-fd46-4e3e-9a76-44a82ba8a7e5 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:07.825845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f2ef0b4-fd46-4e3e-9a76-44a82ba8a7e5 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:07.826509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f2ef0b4-fd46-4e3e-9a76-44a82ba8a7e5 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:07.829653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f2ef0b4-fd46-4e3e-9a76-44a82ba8a7e5 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:08.317781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5f2ef0b4-fd46-4e3e-9a76-44a82ba8a7e5 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:53:08.326486 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5f2ef0b4-fd46-4e3e-9a76-44a82ba8a7e5 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1563 microversion: 2.1 time: 0.532766 Oct 10 23:53:08.327797 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2973/6113] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:53:07 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1563 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:53:12.390203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f497efed-8484-4e38-bebc-8a1ca1190cf0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:53:12.390964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f497efed-8484-4e38-bebc-8a1ca1190cf0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:53:12.398519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-bb6fc5f3-2035-4439-ac08-187cfc02c390 req-0a842d48-6976-4885-bddf-892d787c5446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1620135-b28b-4695-8abf-cbf46a5421d3", "tag": "15d44200-1f5f-4b96-924d-701730ace82a"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:53:12.415858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f497efed-8484-4e38-bebc-8a1ca1190cf0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:12.417747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f497efed-8484-4e38-bebc-8a1ca1190cf0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:12.419521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f497efed-8484-4e38-bebc-8a1ca1190cf0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:12.421672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-bb6fc5f3-2035-4439-ac08-187cfc02c390 req-0a842d48-6976-4885-bddf-892d787c5446 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:12.422846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f497efed-8484-4e38-bebc-8a1ca1190cf0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:12.423603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f497efed-8484-4e38-bebc-8a1ca1190cf0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:12.424373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-bb6fc5f3-2035-4439-ac08-187cfc02c390 req-0a842d48-6976-4885-bddf-892d787c5446 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:12.425063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f497efed-8484-4e38-bebc-8a1ca1190cf0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:12.425865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-bb6fc5f3-2035-4439-ac08-187cfc02c390 req-0a842d48-6976-4885-bddf-892d787c5446 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:12.459165 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-bb6fc5f3-2035-4439-ac08-187cfc02c390 req-0a842d48-6976-4885-bddf-892d787c5446 service nova] Creating event network-changed:15d44200-1f5f-4b96-924d-701730ace82a for instance e1620135-b28b-4695-8abf-cbf46a5421d3 on n-h1-860864-2 Oct 10 23:53:12.474642 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-bb6fc5f3-2035-4439-ac08-187cfc02c390 req-0a842d48-6976-4885-bddf-892d787c5446 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079790 Oct 10 23:53:12.478170 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2974/6114] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:53:12.972938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f497efed-8484-4e38-bebc-8a1ca1190cf0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:53:13.010764 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f497efed-8484-4e38-bebc-8a1ca1190cf0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1563 microversion: 2.1 time: 0.623607 Oct 10 23:53:13.014357 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3141/6115] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:53:12 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1563 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:53:43.860929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3b9c34ad-2bc2-4cd9-b2c2-6d71ebe25867 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:53:43.863317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3b9c34ad-2bc2-4cd9-b2c2-6d71ebe25867 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:53:43.866129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:53:43.866783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=92 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:53:43.885082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b9c34ad-2bc2-4cd9-b2c2-6d71ebe25867 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:43.885618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b9c34ad-2bc2-4cd9-b2c2-6d71ebe25867 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:43.886057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b9c34ad-2bc2-4cd9-b2c2-6d71ebe25867 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:43.886775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b9c34ad-2bc2-4cd9-b2c2-6d71ebe25867 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:53:43.887223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b9c34ad-2bc2-4cd9-b2c2-6d71ebe25867 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:53:43.887649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b9c34ad-2bc2-4cd9-b2c2-6d71ebe25867 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:53:43.961367 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3b9c34ad-2bc2-4cd9-b2c2-6d71ebe25867 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "POST /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3/action" status: 200 len: 24538 microversion: 2.1 time: 0.104550 Oct 10 23:53:43.970436 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2975/6116] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:53:43 2022] POST /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3/action => generated 24538 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:54:14.250146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c8076bfd-d999-4b29-8701-3acf9275b507 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:14.251762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c8076bfd-d999-4b29-8701-3acf9275b507 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:14.254502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:54:14.257016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=90 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:54:14.272347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8076bfd-d999-4b29-8701-3acf9275b507 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:14.275134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8076bfd-d999-4b29-8701-3acf9275b507 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:14.275831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8076bfd-d999-4b29-8701-3acf9275b507 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:14.276583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8076bfd-d999-4b29-8701-3acf9275b507 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:14.277054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8076bfd-d999-4b29-8701-3acf9275b507 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:14.277523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8076bfd-d999-4b29-8701-3acf9275b507 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:14.501165 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c8076bfd-d999-4b29-8701-3acf9275b507 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1832 microversion: 2.1 time: 0.255859 Oct 10 23:54:14.515391 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3142/6117] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:14 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1832 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:54:14.539559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-634a75c8-fb4f-4c97-bbb9-8d5c81c106bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:14.540635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-634a75c8-fb4f-4c97-bbb9-8d5c81c106bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:14.550315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:54:14.551610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:54:14.554269 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-634a75c8-fb4f-4c97-bbb9-8d5c81c106bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:14.554907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-634a75c8-fb4f-4c97-bbb9-8d5c81c106bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:14.555573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-634a75c8-fb4f-4c97-bbb9-8d5c81c106bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:14.556632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-634a75c8-fb4f-4c97-bbb9-8d5c81c106bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:14.557320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-634a75c8-fb4f-4c97-bbb9-8d5c81c106bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:14.558009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-634a75c8-fb4f-4c97-bbb9-8d5c81c106bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:14.821565 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-634a75c8-fb4f-4c97-bbb9-8d5c81c106bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:14.843617 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-634a75c8-fb4f-4c97-bbb9-8d5c81c106bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1681 microversion: 2.1 time: 0.303396 Oct 10 23:54:14.844882 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2976/6118] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:14 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1681 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:14.993239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bbb5767d-1453-4d1b-a490-52aa554e70f5 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:54:15.002072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bbb5767d-1453-4d1b-a490-52aa554e70f5 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:15.017296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbb5767d-1453-4d1b-a490-52aa554e70f5 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:15.018546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbb5767d-1453-4d1b-a490-52aa554e70f5 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:15.021228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbb5767d-1453-4d1b-a490-52aa554e70f5 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:15.023362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbb5767d-1453-4d1b-a490-52aa554e70f5 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:15.024403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbb5767d-1453-4d1b-a490-52aa554e70f5 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:15.025398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bbb5767d-1453-4d1b-a490-52aa554e70f5 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:15.164654 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bbb5767d-1453-4d1b-a490-52aa554e70f5 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "POST /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3/action" status: 200 len: 32609 microversion: 2.1 time: 0.180540 Oct 10 23:54:15.178367 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3143/6119] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:54:14 2022] POST /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3/action => generated 32609 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:54:15.427774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9bd41f8e-182b-4284-99fe-4d6b6980f082 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:54:15.429495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9bd41f8e-182b-4284-99fe-4d6b6980f082 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:15.439372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bd41f8e-182b-4284-99fe-4d6b6980f082 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:15.440107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bd41f8e-182b-4284-99fe-4d6b6980f082 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:15.440826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bd41f8e-182b-4284-99fe-4d6b6980f082 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:15.441662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bd41f8e-182b-4284-99fe-4d6b6980f082 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:15.442175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bd41f8e-182b-4284-99fe-4d6b6980f082 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:15.442650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bd41f8e-182b-4284-99fe-4d6b6980f082 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:15.521918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9bd41f8e-182b-4284-99fe-4d6b6980f082 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '817a705f87a849a8a73d1aafdfd7c2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17e3fe005e447d6886023d681e16926', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:15.522427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9bd41f8e-182b-4284-99fe-4d6b6980f082 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] flavor_id is None. Assuming migration. {{(pid=120614) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 10 23:54:15.522791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9bd41f8e-182b-4284-99fe-4d6b6980f082 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120614) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 10 23:54:15.815202 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9bd41f8e-182b-4284-99fe-4d6b6980f082 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3/action" status: 202 len: 0 microversion: 2.1 time: 0.392344 Oct 10 23:54:15.817975 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2977/6120] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:54:15 2022] POST /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:54:15.827514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-da464f9d-48f0-42f3-a723-25d3a2aa9a5f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:15.829168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-da464f9d-48f0-42f3-a723-25d3a2aa9a5f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:15.860423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da464f9d-48f0-42f3-a723-25d3a2aa9a5f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:15.899782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da464f9d-48f0-42f3-a723-25d3a2aa9a5f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:15.900487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da464f9d-48f0-42f3-a723-25d3a2aa9a5f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:15.901274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da464f9d-48f0-42f3-a723-25d3a2aa9a5f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:15.901797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da464f9d-48f0-42f3-a723-25d3a2aa9a5f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:15.902243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da464f9d-48f0-42f3-a723-25d3a2aa9a5f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:16.290230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-da464f9d-48f0-42f3-a723-25d3a2aa9a5f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:16.314340 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-da464f9d-48f0-42f3-a723-25d3a2aa9a5f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1690 microversion: 2.1 time: 0.491764 Oct 10 23:54:16.315286 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3144/6121] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:15 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1690 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:17.353921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-575f6986-d643-4342-8a6d-fd121277a649 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:17.354785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-575f6986-d643-4342-8a6d-fd121277a649 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:17.368936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-575f6986-d643-4342-8a6d-fd121277a649 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:17.369452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-575f6986-d643-4342-8a6d-fd121277a649 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:17.370085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-575f6986-d643-4342-8a6d-fd121277a649 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:17.370998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-575f6986-d643-4342-8a6d-fd121277a649 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:17.371634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-575f6986-d643-4342-8a6d-fd121277a649 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:17.372092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-575f6986-d643-4342-8a6d-fd121277a649 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:17.670692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-575f6986-d643-4342-8a6d-fd121277a649 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:17.686391 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-575f6986-d643-4342-8a6d-fd121277a649 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1690 microversion: 2.1 time: 0.339399 Oct 10 23:54:17.693716 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2978/6122] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:17 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1690 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:54:18.715832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f5ce9a21-ae28-4712-b659-e96b2b799198 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:18.716597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f5ce9a21-ae28-4712-b659-e96b2b799198 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:18.726373 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5ce9a21-ae28-4712-b659-e96b2b799198 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:18.726844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5ce9a21-ae28-4712-b659-e96b2b799198 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:18.727358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5ce9a21-ae28-4712-b659-e96b2b799198 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:18.728220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5ce9a21-ae28-4712-b659-e96b2b799198 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:18.728753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5ce9a21-ae28-4712-b659-e96b2b799198 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:18.729221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f5ce9a21-ae28-4712-b659-e96b2b799198 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:18.925221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f5ce9a21-ae28-4712-b659-e96b2b799198 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:18.935109 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f5ce9a21-ae28-4712-b659-e96b2b799198 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1690 microversion: 2.1 time: 0.224128 Oct 10 23:54:18.961241 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3145/6123] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:18 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1690 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:54:19.961824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-880c9f34-9a63-4509-99ba-f67352b579e8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:19.963102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-880c9f34-9a63-4509-99ba-f67352b579e8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:19.978759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-880c9f34-9a63-4509-99ba-f67352b579e8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:19.980138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-880c9f34-9a63-4509-99ba-f67352b579e8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:19.981328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-880c9f34-9a63-4509-99ba-f67352b579e8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:19.983028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-880c9f34-9a63-4509-99ba-f67352b579e8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:19.984437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-880c9f34-9a63-4509-99ba-f67352b579e8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:19.986145 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-880c9f34-9a63-4509-99ba-f67352b579e8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:20.389989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-880c9f34-9a63-4509-99ba-f67352b579e8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:20.428202 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-880c9f34-9a63-4509-99ba-f67352b579e8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1690 microversion: 2.1 time: 0.470875 Oct 10 23:54:20.432561 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2979/6124] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:19 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1690 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:20.527119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e18e0a45-3eb9-404b-ad0a-414e9b304baa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:20.527642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e18e0a45-3eb9-404b-ad0a-414e9b304baa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:20.544662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e18e0a45-3eb9-404b-ad0a-414e9b304baa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:20.545426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e18e0a45-3eb9-404b-ad0a-414e9b304baa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:20.546337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e18e0a45-3eb9-404b-ad0a-414e9b304baa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:20.547944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e18e0a45-3eb9-404b-ad0a-414e9b304baa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:20.548609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e18e0a45-3eb9-404b-ad0a-414e9b304baa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:20.549226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e18e0a45-3eb9-404b-ad0a-414e9b304baa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:20.604616 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e18e0a45-3eb9-404b-ad0a-414e9b304baa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/ips" status: 200 len: 148 microversion: 2.1 time: 0.081291 Oct 10 23:54:20.606007 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3146/6125] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 10 23:54:20 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/ips => generated 148 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:54:21.475987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0e58730f-5e2d-49db-9e9f-63ef6b7dee31 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:21.477412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0e58730f-5e2d-49db-9e9f-63ef6b7dee31 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:21.498249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e58730f-5e2d-49db-9e9f-63ef6b7dee31 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:21.499827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e58730f-5e2d-49db-9e9f-63ef6b7dee31 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:21.502082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e58730f-5e2d-49db-9e9f-63ef6b7dee31 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:21.503154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e58730f-5e2d-49db-9e9f-63ef6b7dee31 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:21.505334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e58730f-5e2d-49db-9e9f-63ef6b7dee31 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:21.510737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e58730f-5e2d-49db-9e9f-63ef6b7dee31 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:22.018970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0e58730f-5e2d-49db-9e9f-63ef6b7dee31 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:22.053543 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0e58730f-5e2d-49db-9e9f-63ef6b7dee31 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1695 microversion: 2.1 time: 0.576245 Oct 10 23:54:22.054977 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2980/6126] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:21 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1695 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:54:23.346313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dd731bac-d8e0-4656-842d-707ceb6b8d30 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:23.347074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dd731bac-d8e0-4656-842d-707ceb6b8d30 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:23.366086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd731bac-d8e0-4656-842d-707ceb6b8d30 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:23.367376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd731bac-d8e0-4656-842d-707ceb6b8d30 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:23.368449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd731bac-d8e0-4656-842d-707ceb6b8d30 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:23.370006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd731bac-d8e0-4656-842d-707ceb6b8d30 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:23.371152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd731bac-d8e0-4656-842d-707ceb6b8d30 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:23.371968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd731bac-d8e0-4656-842d-707ceb6b8d30 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:23.425137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6c848e5a-0f0d-4c60-b5ba-3b7eadd620aa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52452010-a0ba-48a4-bb47-c855f1a97fec"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:54:23.429966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6c848e5a-0f0d-4c60-b5ba-3b7eadd620aa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:23.440029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c848e5a-0f0d-4c60-b5ba-3b7eadd620aa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:23.440535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c848e5a-0f0d-4c60-b5ba-3b7eadd620aa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:23.440982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c848e5a-0f0d-4c60-b5ba-3b7eadd620aa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:23.441761 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c848e5a-0f0d-4c60-b5ba-3b7eadd620aa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:23.442223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c848e5a-0f0d-4c60-b5ba-3b7eadd620aa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:23.442691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c848e5a-0f0d-4c60-b5ba-3b7eadd620aa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:23.685588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dd731bac-d8e0-4656-842d-707ceb6b8d30 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:23.700516 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dd731bac-d8e0-4656-842d-707ceb6b8d30 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1695 microversion: 2.1 time: 0.594207 Oct 10 23:54:23.701747 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3147/6127] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:23 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1695 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:23.926814 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6c848e5a-0f0d-4c60-b5ba-3b7eadd620aa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "POST /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.513624 Oct 10 23:54:23.927460 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2981/6128] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Oct 10 23:54:23 2022] POST /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/os-volume_attachments => generated 194 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:54:24.738149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5480f630-a473-49b3-866a-2edf583e2171 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:24.739277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5480f630-a473-49b3-866a-2edf583e2171 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:24.771460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5480f630-a473-49b3-866a-2edf583e2171 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:24.772318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5480f630-a473-49b3-866a-2edf583e2171 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:24.773096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5480f630-a473-49b3-866a-2edf583e2171 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:24.774325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5480f630-a473-49b3-866a-2edf583e2171 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:24.775138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5480f630-a473-49b3-866a-2edf583e2171 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:24.775993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5480f630-a473-49b3-866a-2edf583e2171 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:25.129772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5480f630-a473-49b3-866a-2edf583e2171 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:25.144955 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5480f630-a473-49b3-866a-2edf583e2171 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1695 microversion: 2.1 time: 0.413879 Oct 10 23:54:25.146581 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3148/6129] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:24 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1695 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:26.181807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9c7bcec0-d212-4243-8d46-a568c8759649 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:26.182973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9c7bcec0-d212-4243-8d46-a568c8759649 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:26.206910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c7bcec0-d212-4243-8d46-a568c8759649 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:26.207592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c7bcec0-d212-4243-8d46-a568c8759649 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:26.208172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c7bcec0-d212-4243-8d46-a568c8759649 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:26.209028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c7bcec0-d212-4243-8d46-a568c8759649 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:26.222056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c7bcec0-d212-4243-8d46-a568c8759649 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:26.222934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c7bcec0-d212-4243-8d46-a568c8759649 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:26.485501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9c7bcec0-d212-4243-8d46-a568c8759649 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:26.496562 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9c7bcec0-d212-4243-8d46-a568c8759649 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1695 microversion: 2.1 time: 0.322140 Oct 10 23:54:26.497887 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2982/6130] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:26 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1695 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:54:27.564429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3cb7f0d0-b5ac-48a2-b668-f03891265fdd tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:27.586055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3cb7f0d0-b5ac-48a2-b668-f03891265fdd tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:27.636168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cb7f0d0-b5ac-48a2-b668-f03891265fdd tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:27.639497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cb7f0d0-b5ac-48a2-b668-f03891265fdd tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:27.646301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cb7f0d0-b5ac-48a2-b668-f03891265fdd tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:27.650555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cb7f0d0-b5ac-48a2-b668-f03891265fdd tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:27.659064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cb7f0d0-b5ac-48a2-b668-f03891265fdd tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:27.660712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3cb7f0d0-b5ac-48a2-b668-f03891265fdd tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:27.938023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3cb7f0d0-b5ac-48a2-b668-f03891265fdd tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:27.966260 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3cb7f0d0-b5ac-48a2-b668-f03891265fdd tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1695 microversion: 2.1 time: 0.431986 Oct 10 23:54:27.982127 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3149/6131] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:27 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1695 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:28.999048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-22745413-5848-4d0b-827a-fa99a04b4e60 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:29.001646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-22745413-5848-4d0b-827a-fa99a04b4e60 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:29.011027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22745413-5848-4d0b-827a-fa99a04b4e60 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:29.011027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22745413-5848-4d0b-827a-fa99a04b4e60 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:29.011591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22745413-5848-4d0b-827a-fa99a04b4e60 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:29.012105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22745413-5848-4d0b-827a-fa99a04b4e60 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:29.012453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22745413-5848-4d0b-827a-fa99a04b4e60 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:29.012881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22745413-5848-4d0b-827a-fa99a04b4e60 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:29.233495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-22745413-5848-4d0b-827a-fa99a04b4e60 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:29.245475 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-22745413-5848-4d0b-827a-fa99a04b4e60 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1695 microversion: 2.1 time: 0.254113 Oct 10 23:54:29.246692 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2983/6132] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:28 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1695 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:30.293156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e8cbc6f4-1b5a-491c-8bb7-371adcca68a6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:30.295555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e8cbc6f4-1b5a-491c-8bb7-371adcca68a6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:30.317903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8cbc6f4-1b5a-491c-8bb7-371adcca68a6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:30.318837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8cbc6f4-1b5a-491c-8bb7-371adcca68a6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:30.320684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8cbc6f4-1b5a-491c-8bb7-371adcca68a6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:30.322454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8cbc6f4-1b5a-491c-8bb7-371adcca68a6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:30.324030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8cbc6f4-1b5a-491c-8bb7-371adcca68a6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:30.324708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8cbc6f4-1b5a-491c-8bb7-371adcca68a6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:30.526467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e8cbc6f4-1b5a-491c-8bb7-371adcca68a6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:30.536103 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e8cbc6f4-1b5a-491c-8bb7-371adcca68a6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1695 microversion: 2.1 time: 0.254671 Oct 10 23:54:30.546162 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3150/6133] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:30 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1695 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:31.567032 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-906f44ec-cc03-46b2-a2da-23bc5df66028 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:31.569066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-906f44ec-cc03-46b2-a2da-23bc5df66028 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:31.582389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-906f44ec-cc03-46b2-a2da-23bc5df66028 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:31.583538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-906f44ec-cc03-46b2-a2da-23bc5df66028 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:31.584622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-906f44ec-cc03-46b2-a2da-23bc5df66028 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:31.587963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-906f44ec-cc03-46b2-a2da-23bc5df66028 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:31.591257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-906f44ec-cc03-46b2-a2da-23bc5df66028 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:31.593254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-906f44ec-cc03-46b2-a2da-23bc5df66028 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:31.840358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-906f44ec-cc03-46b2-a2da-23bc5df66028 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:31.854692 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-906f44ec-cc03-46b2-a2da-23bc5df66028 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1695 microversion: 2.1 time: 0.295606 Oct 10 23:54:31.856322 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2984/6134] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:31 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1695 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:32.898820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4b05ddc6-73ee-48c9-a203-17d4e5c5b9fa tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:32.899542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4b05ddc6-73ee-48c9-a203-17d4e5c5b9fa tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:32.908345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b05ddc6-73ee-48c9-a203-17d4e5c5b9fa tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:32.908846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b05ddc6-73ee-48c9-a203-17d4e5c5b9fa tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:32.909293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b05ddc6-73ee-48c9-a203-17d4e5c5b9fa tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:32.910029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b05ddc6-73ee-48c9-a203-17d4e5c5b9fa tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:32.910492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b05ddc6-73ee-48c9-a203-17d4e5c5b9fa tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:32.918148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b05ddc6-73ee-48c9-a203-17d4e5c5b9fa tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:33.180063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4b05ddc6-73ee-48c9-a203-17d4e5c5b9fa tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:33.188508 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4b05ddc6-73ee-48c9-a203-17d4e5c5b9fa tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1694 microversion: 2.1 time: 0.300317 Oct 10 23:54:33.206627 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3151/6135] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:32 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1694 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:34.216422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5c04e1f6-aab9-47c6-8095-c99087c89df1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:34.217896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5c04e1f6-aab9-47c6-8095-c99087c89df1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:34.237102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c04e1f6-aab9-47c6-8095-c99087c89df1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:34.238601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c04e1f6-aab9-47c6-8095-c99087c89df1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:34.240880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c04e1f6-aab9-47c6-8095-c99087c89df1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:34.242412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c04e1f6-aab9-47c6-8095-c99087c89df1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:34.243500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c04e1f6-aab9-47c6-8095-c99087c89df1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:34.248293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c04e1f6-aab9-47c6-8095-c99087c89df1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:34.365969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-268b79ac-6c64-494e-b4a3-aa8e41d0b181 req-d1c7b1ac-5776-4e09-9298-82c516df1d43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1620135-b28b-4695-8abf-cbf46a5421d3", "name": "network-vif-unplugged", "status": "completed", "tag": "15d44200-1f5f-4b96-924d-701730ace82a"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:54:34.388898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-268b79ac-6c64-494e-b4a3-aa8e41d0b181 req-d1c7b1ac-5776-4e09-9298-82c516df1d43 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:34.390692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-268b79ac-6c64-494e-b4a3-aa8e41d0b181 req-d1c7b1ac-5776-4e09-9298-82c516df1d43 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:34.392832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-268b79ac-6c64-494e-b4a3-aa8e41d0b181 req-d1c7b1ac-5776-4e09-9298-82c516df1d43 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:34.412820 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-268b79ac-6c64-494e-b4a3-aa8e41d0b181 req-d1c7b1ac-5776-4e09-9298-82c516df1d43 service nova] Creating event network-vif-unplugged:15d44200-1f5f-4b96-924d-701730ace82a for instance e1620135-b28b-4695-8abf-cbf46a5421d3 on n-h2-860864-2 Oct 10 23:54:34.431532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [req-268b79ac-6c64-494e-b4a3-aa8e41d0b181 req-d1c7b1ac-5776-4e09-9298-82c516df1d43 service nova] Instance e1620135-b28b-4695-8abf-cbf46a5421d3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 23:54:34.474788 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-268b79ac-6c64-494e-b4a3-aa8e41d0b181 req-d1c7b1ac-5776-4e09-9298-82c516df1d43 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.531911 Oct 10 23:54:34.476497 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2985/6136] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:54:34.702328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5c04e1f6-aab9-47c6-8095-c99087c89df1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:34.721610 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5c04e1f6-aab9-47c6-8095-c99087c89df1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1694 microversion: 2.1 time: 0.505258 Oct 10 23:54:34.735130 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3152/6137] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:34 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1694 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:35.764361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8cfb1124-8da2-4285-820f-84d7d22d56e8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:35.766690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8cfb1124-8da2-4285-820f-84d7d22d56e8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:35.782321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cfb1124-8da2-4285-820f-84d7d22d56e8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:35.785299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cfb1124-8da2-4285-820f-84d7d22d56e8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:35.786762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cfb1124-8da2-4285-820f-84d7d22d56e8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:35.788837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cfb1124-8da2-4285-820f-84d7d22d56e8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:35.789880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cfb1124-8da2-4285-820f-84d7d22d56e8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:35.791000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cfb1124-8da2-4285-820f-84d7d22d56e8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:36.207200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8cfb1124-8da2-4285-820f-84d7d22d56e8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:36.247881 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8cfb1124-8da2-4285-820f-84d7d22d56e8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1694 microversion: 2.1 time: 0.490381 Oct 10 23:54:36.270198 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2986/6138] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:35 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1694 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:54:36.587119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-caed2164-3b44-4dac-9d2a-a117cf64cb6b req-b7311caf-578c-4a3e-a6e0-8c64005eeae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1620135-b28b-4695-8abf-cbf46a5421d3", "tag": "15d44200-1f5f-4b96-924d-701730ace82a"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:54:36.602865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-caed2164-3b44-4dac-9d2a-a117cf64cb6b req-b7311caf-578c-4a3e-a6e0-8c64005eeae4 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:36.603357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-caed2164-3b44-4dac-9d2a-a117cf64cb6b req-b7311caf-578c-4a3e-a6e0-8c64005eeae4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:36.603816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-caed2164-3b44-4dac-9d2a-a117cf64cb6b req-b7311caf-578c-4a3e-a6e0-8c64005eeae4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:36.653124 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-caed2164-3b44-4dac-9d2a-a117cf64cb6b req-b7311caf-578c-4a3e-a6e0-8c64005eeae4 service nova] Creating event network-changed:15d44200-1f5f-4b96-924d-701730ace82a for instance e1620135-b28b-4695-8abf-cbf46a5421d3 on n-h2-860864-2 Oct 10 23:54:36.661207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-caed2164-3b44-4dac-9d2a-a117cf64cb6b req-b7311caf-578c-4a3e-a6e0-8c64005eeae4 service nova] Instance e1620135-b28b-4695-8abf-cbf46a5421d3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 23:54:36.693713 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-caed2164-3b44-4dac-9d2a-a117cf64cb6b req-b7311caf-578c-4a3e-a6e0-8c64005eeae4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111061 Oct 10 23:54:36.693713 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3153/6139] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:54:37.308679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a5df7f74-62b9-4bc9-a242-9f30f61962d2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:37.312870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a5df7f74-62b9-4bc9-a242-9f30f61962d2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:37.345192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5df7f74-62b9-4bc9-a242-9f30f61962d2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:37.346570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5df7f74-62b9-4bc9-a242-9f30f61962d2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:37.348628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5df7f74-62b9-4bc9-a242-9f30f61962d2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:37.349887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5df7f74-62b9-4bc9-a242-9f30f61962d2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:37.360029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5df7f74-62b9-4bc9-a242-9f30f61962d2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:37.360970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5df7f74-62b9-4bc9-a242-9f30f61962d2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:37.763439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a5df7f74-62b9-4bc9-a242-9f30f61962d2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:37.795462 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a5df7f74-62b9-4bc9-a242-9f30f61962d2 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1692 microversion: 2.1 time: 0.498937 Oct 10 23:54:37.810715 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2987/6140] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:37 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1692 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:38.847034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1e2097cd-c5c1-4cfe-a1d8-be49bc27d460 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:38.848689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1e2097cd-c5c1-4cfe-a1d8-be49bc27d460 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:38.858606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e2097cd-c5c1-4cfe-a1d8-be49bc27d460 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:38.859484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e2097cd-c5c1-4cfe-a1d8-be49bc27d460 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:38.860112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e2097cd-c5c1-4cfe-a1d8-be49bc27d460 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:38.862999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e2097cd-c5c1-4cfe-a1d8-be49bc27d460 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:38.863982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e2097cd-c5c1-4cfe-a1d8-be49bc27d460 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:38.864585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e2097cd-c5c1-4cfe-a1d8-be49bc27d460 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:39.157317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1e2097cd-c5c1-4cfe-a1d8-be49bc27d460 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:39.167548 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1e2097cd-c5c1-4cfe-a1d8-be49bc27d460 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1689 microversion: 2.1 time: 0.334908 Oct 10 23:54:39.168160 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3154/6141] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:38 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1689 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:39.198377 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-92753f17-5477-4190-8d90-86884f55df3b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:54:39.199052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-92753f17-5477-4190-8d90-86884f55df3b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:39.210838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92753f17-5477-4190-8d90-86884f55df3b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:39.212410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92753f17-5477-4190-8d90-86884f55df3b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:39.213404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92753f17-5477-4190-8d90-86884f55df3b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:39.215014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92753f17-5477-4190-8d90-86884f55df3b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:39.215993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92753f17-5477-4190-8d90-86884f55df3b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:39.216890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92753f17-5477-4190-8d90-86884f55df3b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:39.339241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:54:39.403961 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-92753f17-5477-4190-8d90-86884f55df3b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "POST /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3/action" status: 202 len: 0 microversion: 2.1 time: 0.211128 Oct 10 23:54:39.405356 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2988/6142] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:54:39 2022] POST /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:54:39.414641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6a54de39-6293-4e94-b145-8298f8018572 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:39.415246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6a54de39-6293-4e94-b145-8298f8018572 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:39.425307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a54de39-6293-4e94-b145-8298f8018572 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:39.428223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a54de39-6293-4e94-b145-8298f8018572 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:39.442987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a54de39-6293-4e94-b145-8298f8018572 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:39.454364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a54de39-6293-4e94-b145-8298f8018572 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:39.454972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a54de39-6293-4e94-b145-8298f8018572 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:39.455667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a54de39-6293-4e94-b145-8298f8018572 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:39.716742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6a54de39-6293-4e94-b145-8298f8018572 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:39.735936 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6a54de39-6293-4e94-b145-8298f8018572 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1688 microversion: 2.1 time: 0.325539 Oct 10 23:54:39.737204 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3155/6143] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:39 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1688 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:40.783064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6f79ea73-188b-4655-a1ec-03b6254d9932 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:40.788441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6f79ea73-188b-4655-a1ec-03b6254d9932 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:40.854906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f79ea73-188b-4655-a1ec-03b6254d9932 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:40.856681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f79ea73-188b-4655-a1ec-03b6254d9932 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:40.868096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f79ea73-188b-4655-a1ec-03b6254d9932 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:40.869815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f79ea73-188b-4655-a1ec-03b6254d9932 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:40.871417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f79ea73-188b-4655-a1ec-03b6254d9932 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:40.873434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f79ea73-188b-4655-a1ec-03b6254d9932 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:41.492688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6f79ea73-188b-4655-a1ec-03b6254d9932 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:41.561590 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6f79ea73-188b-4655-a1ec-03b6254d9932 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1688 microversion: 2.1 time: 0.788316 Oct 10 23:54:41.566040 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2989/6144] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:40 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1688 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:41.667831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f1912ca8-642c-4ea6-a1a5-3d0abd5c01ea tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Action: 'create', calling method: .version_select at 0x7f662af765e0>, body: {"keypair": {"name": "tempest-keypair-725485399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESXYNRyUnxIq5CMA2fQ/k9v/aPF9cVBTabhCAgYZ6epeYZ2Xi8+qohkw26wqswXXY2ZMJZWMPKoj4BYNzj/nWFzPp7IulMRgRinFB+8Luarb2U+AF5AcU3q6747zyKifA=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:54:41.715706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-f1912ca8-642c-4ea6-a1a5-3d0abd5c01ea tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Getting quotas for project 0fcaa1fb124e448b8bacb6353fca9d5d. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:54:41.730310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-f1912ca8-642c-4ea6-a1a5-3d0abd5c01ea tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Getting quotas for user b7008c9b5ad94dbea7edc12267dae2b5 and project 0fcaa1fb124e448b8bacb6353fca9d5d. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:54:41.799135 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f1912ca8-642c-4ea6-a1a5-3d0abd5c01ea tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.141098 Oct 10 23:54:41.800292 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3156/6145] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:54:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:54:42.067679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-95fec007-d7c5-4d90-bb20-1abd99ef00ff req-aed64250-109a-4cc6-95e0-4ea7bf2cd90b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1620135-b28b-4695-8abf-cbf46a5421d3", "name": "network-vif-plugged", "status": "completed", "tag": "15d44200-1f5f-4b96-924d-701730ace82a"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:54:42.097457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-95fec007-d7c5-4d90-bb20-1abd99ef00ff req-aed64250-109a-4cc6-95e0-4ea7bf2cd90b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:42.097962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-95fec007-d7c5-4d90-bb20-1abd99ef00ff req-aed64250-109a-4cc6-95e0-4ea7bf2cd90b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:42.098399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-95fec007-d7c5-4d90-bb20-1abd99ef00ff req-aed64250-109a-4cc6-95e0-4ea7bf2cd90b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:42.149614 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-95fec007-d7c5-4d90-bb20-1abd99ef00ff req-aed64250-109a-4cc6-95e0-4ea7bf2cd90b service nova] Creating event network-vif-plugged:15d44200-1f5f-4b96-924d-701730ace82a for instance e1620135-b28b-4695-8abf-cbf46a5421d3 on n-h2-860864-2 Oct 10 23:54:42.175116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [req-95fec007-d7c5-4d90-bb20-1abd99ef00ff req-aed64250-109a-4cc6-95e0-4ea7bf2cd90b service nova] Instance e1620135-b28b-4695-8abf-cbf46a5421d3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 23:54:42.209793 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-95fec007-d7c5-4d90-bb20-1abd99ef00ff req-aed64250-109a-4cc6-95e0-4ea7bf2cd90b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144900 Oct 10 23:54:42.213920 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2990/6146] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:54:42.609600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2124ce8c-478f-4685-9ad9-241bae0ef49f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:42.611054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2124ce8c-478f-4685-9ad9-241bae0ef49f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:42.625716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2124ce8c-478f-4685-9ad9-241bae0ef49f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:42.627265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2124ce8c-478f-4685-9ad9-241bae0ef49f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:42.628776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2124ce8c-478f-4685-9ad9-241bae0ef49f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:42.639966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2124ce8c-478f-4685-9ad9-241bae0ef49f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:42.641269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2124ce8c-478f-4685-9ad9-241bae0ef49f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:42.641967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2124ce8c-478f-4685-9ad9-241bae0ef49f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:42.939754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2124ce8c-478f-4685-9ad9-241bae0ef49f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:42.949121 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2124ce8c-478f-4685-9ad9-241bae0ef49f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1688 microversion: 2.1 time: 0.344361 Oct 10 23:54:42.950412 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3157/6147] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:42 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1688 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:54:43.990756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-257f189f-f4a1-402f-a9fa-5a7cc7e6ea16 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:43.991622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-257f189f-f4a1-402f-a9fa-5a7cc7e6ea16 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:44.014107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-257f189f-f4a1-402f-a9fa-5a7cc7e6ea16 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:44.015958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-257f189f-f4a1-402f-a9fa-5a7cc7e6ea16 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:44.024036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-257f189f-f4a1-402f-a9fa-5a7cc7e6ea16 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:44.025809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-257f189f-f4a1-402f-a9fa-5a7cc7e6ea16 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:44.026489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-257f189f-f4a1-402f-a9fa-5a7cc7e6ea16 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:44.027093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-257f189f-f4a1-402f-a9fa-5a7cc7e6ea16 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:44.402694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-257f189f-f4a1-402f-a9fa-5a7cc7e6ea16 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:44.436600 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-257f189f-f4a1-402f-a9fa-5a7cc7e6ea16 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1688 microversion: 2.1 time: 0.454676 Oct 10 23:54:44.438356 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2991/6148] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:43 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1688 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:44.571400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c4c7cc64-f706-486a-b2f9-3cc895e25977 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1834620935", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ab1ca05-35c0-4cfd-8d35-c70ce321d096"}], "security_groups": [{"name": "tempest-securitygroup--2008466146"}], "key_name": "tempest-keypair-725485399", "user_data": "}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:54:44.642633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:54:44.865273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-c4c7cc64-f706-486a-b2f9-3cc895e25977 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] validate_networks() for [('1ab1ca05-35c0-4cfd-8d35-c70ce321d096', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:54:45.486109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-91913f29-4bbb-4823-bd65-c82d7373ec2d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:45.487022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-91913f29-4bbb-4823-bd65-c82d7373ec2d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:45.498260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=39 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:54:45.503260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91913f29-4bbb-4823-bd65-c82d7373ec2d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:45.504647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91913f29-4bbb-4823-bd65-c82d7373ec2d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:45.522084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91913f29-4bbb-4823-bd65-c82d7373ec2d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:45.526363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91913f29-4bbb-4823-bd65-c82d7373ec2d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:45.529729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91913f29-4bbb-4823-bd65-c82d7373ec2d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:45.534942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91913f29-4bbb-4823-bd65-c82d7373ec2d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:45.788487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c4c7cc64-f706-486a-b2f9-3cc895e25977 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:54:45.789126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c4c7cc64-f706-486a-b2f9-3cc895e25977 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:54:45.789652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c4c7cc64-f706-486a-b2f9-3cc895e25977 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:54:45.790284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c4c7cc64-f706-486a-b2f9-3cc895e25977 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:54:45.791798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c4c7cc64-f706-486a-b2f9-3cc895e25977 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:54:45.807883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4c7cc64-f706-486a-b2f9-3cc895e25977 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:45.808680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4c7cc64-f706-486a-b2f9-3cc895e25977 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:45.809239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4c7cc64-f706-486a-b2f9-3cc895e25977 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:45.810318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4c7cc64-f706-486a-b2f9-3cc895e25977 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:45.811029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4c7cc64-f706-486a-b2f9-3cc895e25977 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:45.811809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4c7cc64-f706-486a-b2f9-3cc895e25977 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:45.829363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=85 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:54:45.855712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-c4c7cc64-f706-486a-b2f9-3cc895e25977 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Getting quotas for project 0fcaa1fb124e448b8bacb6353fca9d5d. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:54:45.866454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-c4c7cc64-f706-486a-b2f9-3cc895e25977 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Getting quotas for user b7008c9b5ad94dbea7edc12267dae2b5 and project 0fcaa1fb124e448b8bacb6353fca9d5d. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:54:45.895847 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c4c7cc64-f706-486a-b2f9-3cc895e25977 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:54:45.909073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c4c7cc64-f706-486a-b2f9-3cc895e25977 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:54:46.026787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-91913f29-4bbb-4823-bd65-c82d7373ec2d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:46.037222 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-91913f29-4bbb-4823-bd65-c82d7373ec2d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1688 microversion: 2.1 time: 0.557806 Oct 10 23:54:46.039524 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2992/6149] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:45 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1688 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:46.055145 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-a49f3245-a857-484d-80c0-37df8c2c9065 req-ee6ed630-ae53-449c-89e8-5802a52b5d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1620135-b28b-4695-8abf-cbf46a5421d3", "name": "network-vif-unplugged", "status": "completed", "tag": "15d44200-1f5f-4b96-924d-701730ace82a"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:54:46.067311 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c4c7cc64-f706-486a-b2f9-3cc895e25977 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.519504 Oct 10 23:54:46.068781 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3158/6150] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:54:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 1523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:54:46.073687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a49f3245-a857-484d-80c0-37df8c2c9065 req-ee6ed630-ae53-449c-89e8-5802a52b5d09 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:46.077030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a49f3245-a857-484d-80c0-37df8c2c9065 req-ee6ed630-ae53-449c-89e8-5802a52b5d09 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:46.078996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a49f3245-a857-484d-80c0-37df8c2c9065 req-ee6ed630-ae53-449c-89e8-5802a52b5d09 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:46.111039 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-a49f3245-a857-484d-80c0-37df8c2c9065 req-ee6ed630-ae53-449c-89e8-5802a52b5d09 service nova] Creating event network-vif-unplugged:15d44200-1f5f-4b96-924d-701730ace82a for instance e1620135-b28b-4695-8abf-cbf46a5421d3 on n-h1-860864-2 Oct 10 23:54:46.117139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3f773d3f-bf6d-4df4-a4b1-9b22b005e568 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:46.124997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [req-a49f3245-a857-484d-80c0-37df8c2c9065 req-ee6ed630-ae53-449c-89e8-5802a52b5d09 service nova] Instance e1620135-b28b-4695-8abf-cbf46a5421d3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 23:54:46.139215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3f773d3f-bf6d-4df4-a4b1-9b22b005e568 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:46.150079 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-a49f3245-a857-484d-80c0-37df8c2c9065 req-ee6ed630-ae53-449c-89e8-5802a52b5d09 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098400 Oct 10 23:54:46.151575 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2993/6151] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:54:46.322255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3f773d3f-bf6d-4df4-a4b1-9b22b005e568 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:46.342462 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3f773d3f-bf6d-4df4-a4b1-9b22b005e568 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e" status: 200 len: 1241 microversion: 2.1 time: 0.264023 Oct 10 23:54:46.368230 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3159/6152] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:46 2022] GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e => generated 1241 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:47.083056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-30284701-2f17-489d-9ccd-a8a29f7dd8a1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:47.091341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-30284701-2f17-489d-9ccd-a8a29f7dd8a1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:47.121272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30284701-2f17-489d-9ccd-a8a29f7dd8a1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:47.121798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30284701-2f17-489d-9ccd-a8a29f7dd8a1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:47.125867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30284701-2f17-489d-9ccd-a8a29f7dd8a1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:47.126931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30284701-2f17-489d-9ccd-a8a29f7dd8a1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:47.127602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30284701-2f17-489d-9ccd-a8a29f7dd8a1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:47.128539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-30284701-2f17-489d-9ccd-a8a29f7dd8a1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:47.376338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-953875a2-8e6a-42ef-9378-605fcddf4b42 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:47.377268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-953875a2-8e6a-42ef-9378-605fcddf4b42 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:47.388816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-953875a2-8e6a-42ef-9378-605fcddf4b42 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:47.392449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-953875a2-8e6a-42ef-9378-605fcddf4b42 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:47.393713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-953875a2-8e6a-42ef-9378-605fcddf4b42 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:47.395264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-953875a2-8e6a-42ef-9378-605fcddf4b42 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:47.396441 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-953875a2-8e6a-42ef-9378-605fcddf4b42 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:47.397349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-953875a2-8e6a-42ef-9378-605fcddf4b42 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:47.624319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-953875a2-8e6a-42ef-9378-605fcddf4b42 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:47.644422 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-953875a2-8e6a-42ef-9378-605fcddf4b42 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e" status: 200 len: 1245 microversion: 2.1 time: 0.272461 Oct 10 23:54:47.645300 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3160/6153] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:47 2022] GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e => generated 1245 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:47.783548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-30284701-2f17-489d-9ccd-a8a29f7dd8a1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:47.795627 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-30284701-2f17-489d-9ccd-a8a29f7dd8a1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1688 microversion: 2.1 time: 0.726117 Oct 10 23:54:47.830640 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2994/6154] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:47 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1688 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:48.226053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-ce7b02de-4db5-48e5-a0be-14fe8f06b049 req-368d8612-4ddb-4a35-b18e-fb9261cf0697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1620135-b28b-4695-8abf-cbf46a5421d3", "tag": "15d44200-1f5f-4b96-924d-701730ace82a"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:54:48.250815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ce7b02de-4db5-48e5-a0be-14fe8f06b049 req-368d8612-4ddb-4a35-b18e-fb9261cf0697 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:48.251714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ce7b02de-4db5-48e5-a0be-14fe8f06b049 req-368d8612-4ddb-4a35-b18e-fb9261cf0697 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:48.252587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ce7b02de-4db5-48e5-a0be-14fe8f06b049 req-368d8612-4ddb-4a35-b18e-fb9261cf0697 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:48.305836 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-ce7b02de-4db5-48e5-a0be-14fe8f06b049 req-368d8612-4ddb-4a35-b18e-fb9261cf0697 service nova] Creating event network-changed:15d44200-1f5f-4b96-924d-701730ace82a for instance e1620135-b28b-4695-8abf-cbf46a5421d3 on n-h1-860864-2 Oct 10 23:54:48.314075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-ce7b02de-4db5-48e5-a0be-14fe8f06b049 req-368d8612-4ddb-4a35-b18e-fb9261cf0697 service nova] Instance e1620135-b28b-4695-8abf-cbf46a5421d3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 10 23:54:48.348448 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-ce7b02de-4db5-48e5-a0be-14fe8f06b049 req-368d8612-4ddb-4a35-b18e-fb9261cf0697 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131328 Oct 10 23:54:48.351722 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3161/6155] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:54:48.670227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-083f49f0-6ed5-49e4-81b5-7a50c4af478a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:48.674098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-083f49f0-6ed5-49e4-81b5-7a50c4af478a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:48.716753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-083f49f0-6ed5-49e4-81b5-7a50c4af478a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:48.724881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-083f49f0-6ed5-49e4-81b5-7a50c4af478a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:48.742889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-083f49f0-6ed5-49e4-81b5-7a50c4af478a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:48.748068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-083f49f0-6ed5-49e4-81b5-7a50c4af478a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:48.752472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-083f49f0-6ed5-49e4-81b5-7a50c4af478a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:48.760932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-083f49f0-6ed5-49e4-81b5-7a50c4af478a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:48.851182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-14d561a6-d0c2-43a1-bf17-f339d3672841 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:48.852503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-14d561a6-d0c2-43a1-bf17-f339d3672841 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:48.900042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14d561a6-d0c2-43a1-bf17-f339d3672841 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:48.901272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14d561a6-d0c2-43a1-bf17-f339d3672841 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:48.904840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14d561a6-d0c2-43a1-bf17-f339d3672841 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:48.906570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14d561a6-d0c2-43a1-bf17-f339d3672841 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:48.907788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14d561a6-d0c2-43a1-bf17-f339d3672841 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:48.908971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14d561a6-d0c2-43a1-bf17-f339d3672841 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:49.115391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-083f49f0-6ed5-49e4-81b5-7a50c4af478a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:49.130943 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-083f49f0-6ed5-49e4-81b5-7a50c4af478a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e" status: 200 len: 1311 microversion: 2.1 time: 0.465987 Oct 10 23:54:49.131569 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2995/6156] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:48 2022] GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e => generated 1311 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:54:49.421323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-14d561a6-d0c2-43a1-bf17-f339d3672841 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:49.437644 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-14d561a6-d0c2-43a1-bf17-f339d3672841 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1688 microversion: 2.1 time: 0.600675 Oct 10 23:54:49.465745 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3162/6157] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:48 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1688 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:50.174729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d9201b44-fe5a-4100-8e34-b32c39e0e09b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:50.175799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d9201b44-fe5a-4100-8e34-b32c39e0e09b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:50.195032 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9201b44-fe5a-4100-8e34-b32c39e0e09b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:50.195971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9201b44-fe5a-4100-8e34-b32c39e0e09b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:50.198731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9201b44-fe5a-4100-8e34-b32c39e0e09b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:50.199738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9201b44-fe5a-4100-8e34-b32c39e0e09b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:50.200332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9201b44-fe5a-4100-8e34-b32c39e0e09b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:50.200949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d9201b44-fe5a-4100-8e34-b32c39e0e09b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:50.338457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d9201b44-fe5a-4100-8e34-b32c39e0e09b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:50.353673 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d9201b44-fe5a-4100-8e34-b32c39e0e09b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e" status: 200 len: 1299 microversion: 2.1 time: 0.185251 Oct 10 23:54:50.368259 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2996/6158] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:50 2022] GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e => generated 1299 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:50.491974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-72170782-55a3-4254-ba5b-91c13ac3f9a6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:50.495532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-72170782-55a3-4254-ba5b-91c13ac3f9a6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:50.552670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72170782-55a3-4254-ba5b-91c13ac3f9a6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:50.553443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72170782-55a3-4254-ba5b-91c13ac3f9a6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:50.553787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72170782-55a3-4254-ba5b-91c13ac3f9a6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:50.554628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72170782-55a3-4254-ba5b-91c13ac3f9a6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:50.555108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72170782-55a3-4254-ba5b-91c13ac3f9a6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:50.557706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72170782-55a3-4254-ba5b-91c13ac3f9a6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:50.965563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-72170782-55a3-4254-ba5b-91c13ac3f9a6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:50.982626 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-72170782-55a3-4254-ba5b-91c13ac3f9a6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1688 microversion: 2.1 time: 0.510064 Oct 10 23:54:50.997069 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3163/6159] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:50 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1688 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:51.394132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e8e0d024-13b5-4f51-ae86-065f8f14f91c tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:51.395427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e8e0d024-13b5-4f51-ae86-065f8f14f91c tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:51.409713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8e0d024-13b5-4f51-ae86-065f8f14f91c tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:51.410203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8e0d024-13b5-4f51-ae86-065f8f14f91c tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:51.411124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8e0d024-13b5-4f51-ae86-065f8f14f91c tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:51.415539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8e0d024-13b5-4f51-ae86-065f8f14f91c tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:51.416210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8e0d024-13b5-4f51-ae86-065f8f14f91c tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:51.416839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8e0d024-13b5-4f51-ae86-065f8f14f91c tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:51.958041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e8e0d024-13b5-4f51-ae86-065f8f14f91c tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:51.976572 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e8e0d024-13b5-4f51-ae86-065f8f14f91c tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e" status: 200 len: 1367 microversion: 2.1 time: 0.587399 Oct 10 23:54:51.981190 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2997/6160] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:51 2022] GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e => generated 1367 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:52.011131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-59530b80-5f89-4ec0-9471-10867922912b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:52.012607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-59530b80-5f89-4ec0-9471-10867922912b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:52.022152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59530b80-5f89-4ec0-9471-10867922912b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:52.022937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59530b80-5f89-4ec0-9471-10867922912b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:52.023560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59530b80-5f89-4ec0-9471-10867922912b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:52.025236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59530b80-5f89-4ec0-9471-10867922912b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:52.025923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59530b80-5f89-4ec0-9471-10867922912b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:52.026579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-59530b80-5f89-4ec0-9471-10867922912b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:52.435928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-59530b80-5f89-4ec0-9471-10867922912b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:52.450939 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-59530b80-5f89-4ec0-9471-10867922912b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1681 microversion: 2.1 time: 0.444138 Oct 10 23:54:52.454094 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3164/6161] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:52 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1681 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:52.601085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-6ae6eb8c-8422-48bf-a5cb-93a0bad9f8a4 req-45e47098-095f-42a1-8b86-c27ca73e5771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e", "tag": "30d0f80e-9738-47e5-bda4-e55ac251dfae"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:54:52.628892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6ae6eb8c-8422-48bf-a5cb-93a0bad9f8a4 req-45e47098-095f-42a1-8b86-c27ca73e5771 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:52.629645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6ae6eb8c-8422-48bf-a5cb-93a0bad9f8a4 req-45e47098-095f-42a1-8b86-c27ca73e5771 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:52.630284 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6ae6eb8c-8422-48bf-a5cb-93a0bad9f8a4 req-45e47098-095f-42a1-8b86-c27ca73e5771 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:52.661800 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-6ae6eb8c-8422-48bf-a5cb-93a0bad9f8a4 req-45e47098-095f-42a1-8b86-c27ca73e5771 service nova] Creating event network-changed:30d0f80e-9738-47e5-bda4-e55ac251dfae for instance 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e on n-h2-860864-2 Oct 10 23:54:52.676782 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-6ae6eb8c-8422-48bf-a5cb-93a0bad9f8a4 req-45e47098-095f-42a1-8b86-c27ca73e5771 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102309 Oct 10 23:54:52.682067 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2998/6162] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:54:53.104381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-adc2c4c2-f8fe-4c58-b91e-a605734a3ddf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:53.104381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-adc2c4c2-f8fe-4c58-b91e-a605734a3ddf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:53.104381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc2c4c2-f8fe-4c58-b91e-a605734a3ddf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:53.104381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc2c4c2-f8fe-4c58-b91e-a605734a3ddf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:53.104381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc2c4c2-f8fe-4c58-b91e-a605734a3ddf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:53.104381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc2c4c2-f8fe-4c58-b91e-a605734a3ddf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:53.104381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc2c4c2-f8fe-4c58-b91e-a605734a3ddf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:53.104381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adc2c4c2-f8fe-4c58-b91e-a605734a3ddf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:53.445331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-adc2c4c2-f8fe-4c58-b91e-a605734a3ddf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:53.458309 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-adc2c4c2-f8fe-4c58-b91e-a605734a3ddf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e" status: 200 len: 1367 microversion: 2.1 time: 0.450514 Oct 10 23:54:53.458923 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3165/6163] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:53 2022] GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e => generated 1367 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:54.445773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-0f8a0db7-042a-40c9-84f3-d28ac96c91ad req-78a91c35-a8b5-4890-9b5f-0faee690df5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1620135-b28b-4695-8abf-cbf46a5421d3", "name": "network-vif-plugged", "status": "completed", "tag": "15d44200-1f5f-4b96-924d-701730ace82a"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:54:54.460890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0f8a0db7-042a-40c9-84f3-d28ac96c91ad req-78a91c35-a8b5-4890-9b5f-0faee690df5b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:54.461987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0f8a0db7-042a-40c9-84f3-d28ac96c91ad req-78a91c35-a8b5-4890-9b5f-0faee690df5b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:54.462989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0f8a0db7-042a-40c9-84f3-d28ac96c91ad req-78a91c35-a8b5-4890-9b5f-0faee690df5b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:54.493111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0d182e33-0af7-4e6e-9ef6-8e8031274cb3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:54.494089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0d182e33-0af7-4e6e-9ef6-8e8031274cb3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:54.522041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d182e33-0af7-4e6e-9ef6-8e8031274cb3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:54.522667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d182e33-0af7-4e6e-9ef6-8e8031274cb3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:54.523110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d182e33-0af7-4e6e-9ef6-8e8031274cb3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:54.523830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d182e33-0af7-4e6e-9ef6-8e8031274cb3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:54.524284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d182e33-0af7-4e6e-9ef6-8e8031274cb3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:54.524839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0d182e33-0af7-4e6e-9ef6-8e8031274cb3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:54.530092 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-0f8a0db7-042a-40c9-84f3-d28ac96c91ad req-78a91c35-a8b5-4890-9b5f-0faee690df5b service nova] Creating event network-vif-plugged:15d44200-1f5f-4b96-924d-701730ace82a for instance e1620135-b28b-4695-8abf-cbf46a5421d3 on n-h1-860864-2 Oct 10 23:54:54.552058 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-0f8a0db7-042a-40c9-84f3-d28ac96c91ad req-78a91c35-a8b5-4890-9b5f-0faee690df5b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114594 Oct 10 23:54:54.565205 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 2999/6164] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:54:54.838305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0d182e33-0af7-4e6e-9ef6-8e8031274cb3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:54.849698 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0d182e33-0af7-4e6e-9ef6-8e8031274cb3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e" status: 200 len: 1367 microversion: 2.1 time: 0.367063 Oct 10 23:54:54.861470 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3166/6165] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:54 2022] GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:55.878952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-66f366a1-2ab4-49f3-b1a4-62f25ee98895 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:55.880595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-66f366a1-2ab4-49f3-b1a4-62f25ee98895 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:55.887661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66f366a1-2ab4-49f3-b1a4-62f25ee98895 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:55.888345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66f366a1-2ab4-49f3-b1a4-62f25ee98895 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:55.888950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66f366a1-2ab4-49f3-b1a4-62f25ee98895 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:55.889824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66f366a1-2ab4-49f3-b1a4-62f25ee98895 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:55.890677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66f366a1-2ab4-49f3-b1a4-62f25ee98895 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:55.891264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66f366a1-2ab4-49f3-b1a4-62f25ee98895 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:56.055674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-66f366a1-2ab4-49f3-b1a4-62f25ee98895 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:56.070366 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-66f366a1-2ab4-49f3-b1a4-62f25ee98895 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e" status: 200 len: 1367 microversion: 2.1 time: 0.199645 Oct 10 23:54:56.074857 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3000/6166] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:55 2022] GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:57.102655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5b8a6a4e-f5fe-465a-bffb-22b574e1f749 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:57.104308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5b8a6a4e-f5fe-465a-bffb-22b574e1f749 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:57.106372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:54:57.107225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=12 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:54:57.122428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b8a6a4e-f5fe-465a-bffb-22b574e1f749 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:57.123168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b8a6a4e-f5fe-465a-bffb-22b574e1f749 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:57.123761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b8a6a4e-f5fe-465a-bffb-22b574e1f749 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:57.125194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b8a6a4e-f5fe-465a-bffb-22b574e1f749 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:57.126197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b8a6a4e-f5fe-465a-bffb-22b574e1f749 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:57.126856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b8a6a4e-f5fe-465a-bffb-22b574e1f749 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:57.361799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5b8a6a4e-f5fe-465a-bffb-22b574e1f749 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:57.370243 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5b8a6a4e-f5fe-465a-bffb-22b574e1f749 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e" status: 200 len: 1367 microversion: 2.1 time: 0.271471 Oct 10 23:54:57.370859 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3167/6167] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:57 2022] GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:54:58.009199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-d1fe48d4-2f60-4c63-9435-da35983b6710 req-581065eb-956d-4610-b492-9faab129f9ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e", "name": "network-vif-plugged", "status": "completed", "tag": "30d0f80e-9738-47e5-bda4-e55ac251dfae"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:54:58.032108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d1fe48d4-2f60-4c63-9435-da35983b6710 req-581065eb-956d-4610-b492-9faab129f9ed service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:58.035312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d1fe48d4-2f60-4c63-9435-da35983b6710 req-581065eb-956d-4610-b492-9faab129f9ed service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:58.035834 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d1fe48d4-2f60-4c63-9435-da35983b6710 req-581065eb-956d-4610-b492-9faab129f9ed service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:58.064722 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-d1fe48d4-2f60-4c63-9435-da35983b6710 req-581065eb-956d-4610-b492-9faab129f9ed service nova] Creating event network-vif-plugged:30d0f80e-9738-47e5-bda4-e55ac251dfae for instance 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e on n-h2-860864-2 Oct 10 23:54:58.078072 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-d1fe48d4-2f60-4c63-9435-da35983b6710 req-581065eb-956d-4610-b492-9faab129f9ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072806 Oct 10 23:54:58.080042 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3001/6168] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:54:58.402143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-df4a6e0a-f95d-45c4-9956-ea1ff00b7dcf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:54:58.403584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-df4a6e0a-f95d-45c4-9956-ea1ff00b7dcf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:54:58.456227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df4a6e0a-f95d-45c4-9956-ea1ff00b7dcf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:58.459266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df4a6e0a-f95d-45c4-9956-ea1ff00b7dcf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:58.460636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df4a6e0a-f95d-45c4-9956-ea1ff00b7dcf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:58.465623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df4a6e0a-f95d-45c4-9956-ea1ff00b7dcf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:54:58.468670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df4a6e0a-f95d-45c4-9956-ea1ff00b7dcf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:54:58.477962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-df4a6e0a-f95d-45c4-9956-ea1ff00b7dcf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:54:59.132723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-df4a6e0a-f95d-45c4-9956-ea1ff00b7dcf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:54:59.146699 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-df4a6e0a-f95d-45c4-9956-ea1ff00b7dcf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e" status: 200 len: 1367 microversion: 2.1 time: 0.750415 Oct 10 23:54:59.147977 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3168/6169] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:54:58 2022] GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e => generated 1367 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:00.173441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f210cf58-4e14-4b34-b53f-68547549bf9b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:00.174336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f210cf58-4e14-4b34-b53f-68547549bf9b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:00.190350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f210cf58-4e14-4b34-b53f-68547549bf9b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:00.191162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f210cf58-4e14-4b34-b53f-68547549bf9b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:00.191554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f210cf58-4e14-4b34-b53f-68547549bf9b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:00.192447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f210cf58-4e14-4b34-b53f-68547549bf9b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:00.194082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f210cf58-4e14-4b34-b53f-68547549bf9b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:00.194730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f210cf58-4e14-4b34-b53f-68547549bf9b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:00.441043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f210cf58-4e14-4b34-b53f-68547549bf9b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:00.460717 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f210cf58-4e14-4b34-b53f-68547549bf9b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e" status: 200 len: 1557 microversion: 2.1 time: 0.291395 Oct 10 23:55:00.465829 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3002/6170] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:00 2022] GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e => generated 1557 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:00.494074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-94f8b6ef-c451-483f-b5be-539e5aa72780 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:00.494845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-94f8b6ef-c451-483f-b5be-539e5aa72780 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:00.503322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94f8b6ef-c451-483f-b5be-539e5aa72780 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:00.504237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94f8b6ef-c451-483f-b5be-539e5aa72780 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:00.505056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94f8b6ef-c451-483f-b5be-539e5aa72780 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:00.506546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94f8b6ef-c451-483f-b5be-539e5aa72780 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:00.507477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94f8b6ef-c451-483f-b5be-539e5aa72780 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:00.508170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94f8b6ef-c451-483f-b5be-539e5aa72780 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:00.646281 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-94f8b6ef-c451-483f-b5be-539e5aa72780 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.157367 Oct 10 23:55:00.647533 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3169/6171] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Oct 10 23:55:00 2022] GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e/os-interface => generated 285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:55:03.041599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-dfbcbc7e-10e1-488c-8c38-abf3d6be7ce9 req-ef6deed5-27cf-46bc-920d-5166ea593bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e", "tag": "30d0f80e-9738-47e5-bda4-e55ac251dfae"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:55:03.070804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-dfbcbc7e-10e1-488c-8c38-abf3d6be7ce9 req-ef6deed5-27cf-46bc-920d-5166ea593bb0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:03.073285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-dfbcbc7e-10e1-488c-8c38-abf3d6be7ce9 req-ef6deed5-27cf-46bc-920d-5166ea593bb0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:03.074304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-dfbcbc7e-10e1-488c-8c38-abf3d6be7ce9 req-ef6deed5-27cf-46bc-920d-5166ea593bb0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:03.123320 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-dfbcbc7e-10e1-488c-8c38-abf3d6be7ce9 req-ef6deed5-27cf-46bc-920d-5166ea593bb0 service nova] Creating event network-changed:30d0f80e-9738-47e5-bda4-e55ac251dfae for instance 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e on n-h2-860864-2 Oct 10 23:55:03.138832 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-dfbcbc7e-10e1-488c-8c38-abf3d6be7ce9 req-ef6deed5-27cf-46bc-920d-5166ea593bb0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105877 Oct 10 23:55:03.157822 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3003/6172] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:55:19.585890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:55:19.587632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=57 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:55:19.798931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a1fc7a4a-853c-4038-8377-ac8cbd6a1034 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1528683080", "availability_zone": "foo_zone"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:55:19.829829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.aggregate [None req-a1fc7a4a-853c-4038-8377-ac8cbd6a1034 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Generated uuid 1b24f8c4-dfae-4747-aa0e-a35e1c01169b for aggregate {{(pid=120613) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 23:55:19.879948 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a1fc7a4a-853c-4038-8377-ac8cbd6a1034 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.303813 Oct 10 23:55:19.881469 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3170/6173] 10.222.0.23 () {60 vars in 1164 bytes} [Mon Oct 10 23:55:19 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:55:19.894111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3f0da433-0642-4038-8592-918261f21c11 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:55:19.900580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=23 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:55:19.901892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:55:19.945191 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3f0da433-0642-4038-8592-918261f21c11 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.055941 Oct 10 23:55:19.946657 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3004/6174] 10.222.0.23 () {60 vars in 1194 bytes} [Mon Oct 10 23:55:19 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:55:19.963560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8227513c-206b-494d-8846-95824b609405 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:19.969635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8227513c-206b-494d-8846-95824b609405 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:19.970586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8227513c-206b-494d-8846-95824b609405 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:19.971271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8227513c-206b-494d-8846-95824b609405 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:19.973407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8227513c-206b-494d-8846-95824b609405 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:19.974188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8227513c-206b-494d-8846-95824b609405 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:19.974716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8227513c-206b-494d-8846-95824b609405 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:20.029000 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8227513c-206b-494d-8846-95824b609405 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.071878 Oct 10 23:55:20.032539 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3171/6175] 10.222.0.23 () {58 vars in 1176 bytes} [Mon Oct 10 23:55:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:55:20.043417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c3399e4e-1ab3-45af-865c-777f86d018c4 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:20.053764 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c3399e4e-1ab3-45af-865c-777f86d018c4 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.014278 Oct 10 23:55:20.055084 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3005/6176] 10.222.0.23 () {58 vars in 1143 bytes} [Mon Oct 10 23:55:20 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:55:20.072004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-83412442-05fa-4abf-83b7-7e169e2e3428 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860864-2"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:55:20.099247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83412442-05fa-4abf-83b7-7e169e2e3428 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:20.100611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83412442-05fa-4abf-83b7-7e169e2e3428 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:20.101651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83412442-05fa-4abf-83b7-7e169e2e3428 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:20.743031 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-83412442-05fa-4abf-83b7-7e169e2e3428 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.676553 Oct 10 23:55:20.751772 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3172/6177] 10.222.0.23 () {60 vars in 1194 bytes} [Mon Oct 10 23:55:20 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:55:20.757662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5a686617-307a-495c-8021-835802080576 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:20.768993 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5a686617-307a-495c-8021-835802080576 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.015205 Oct 10 23:55:20.770242 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3006/6178] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:55:20 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:55:20.785157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0fd64d67-c7e7-4d1a-bac2-a8b8e27ae58b tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-395858884", "availability_zone": "foo_zone"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:55:20.901137 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0fd64d67-c7e7-4d1a-bac2-a8b8e27ae58b tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.121228 Oct 10 23:55:20.901834 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3173/6179] 10.222.0.23 () {60 vars in 1173 bytes} [Mon Oct 10 23:55:20 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:55:20.923094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6ab84d12-153b-4cff-9025-ac71014c7892 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:55:21.013245 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6ab84d12-153b-4cff-9025-ac71014c7892 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.097956 Oct 10 23:55:21.015886 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3007/6180] 10.222.0.23 () {60 vars in 1194 bytes} [Mon Oct 10 23:55:20 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:55:21.032276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-12daa24d-1f20-493a-a6e3-59a75140e85b tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:21.049425 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-12daa24d-1f20-493a-a6e3-59a75140e85b tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.025586 Oct 10 23:55:21.057267 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3174/6181] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Oct 10 23:55:21 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:55:21.062313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b12b80e5-fda9-4f1b-a18f-0436e61c8d28 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860864-2"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:55:21.082708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b12b80e5-fda9-4f1b-a18f-0436e61c8d28 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:21.083204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b12b80e5-fda9-4f1b-a18f-0436e61c8d28 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:21.083634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b12b80e5-fda9-4f1b-a18f-0436e61c8d28 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:21.397592 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b12b80e5-fda9-4f1b-a18f-0436e61c8d28 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.339276 Oct 10 23:55:21.398619 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3008/6182] 10.222.0.23 () {60 vars in 1194 bytes} [Mon Oct 10 23:55:21 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:55:21.422246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8d5a32b4-7374-49b3-90fc-8b34ee577cf9 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:21.456312 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8d5a32b4-7374-49b3-90fc-8b34ee577cf9 tempest-TestAggregatesBasicOps-421917846 tempest-TestAggregatesBasicOps-421917846-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.041757 Oct 10 23:55:21.474452 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3175/6183] 10.222.0.23 () {58 vars in 1155 bytes} [Mon Oct 10 23:55:21 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 23:55:24.918157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3041ea5a-d707-49ab-aa96-773d983f66ed tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:55:24.928549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3041ea5a-d707-49ab-aa96-773d983f66ed tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:24.966607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3041ea5a-d707-49ab-aa96-773d983f66ed tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:24.968113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3041ea5a-d707-49ab-aa96-773d983f66ed tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:24.969315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3041ea5a-d707-49ab-aa96-773d983f66ed tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:24.976595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3041ea5a-d707-49ab-aa96-773d983f66ed tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:24.982747 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3041ea5a-d707-49ab-aa96-773d983f66ed tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:24.984832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3041ea5a-d707-49ab-aa96-773d983f66ed tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:25.186651 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3041ea5a-d707-49ab-aa96-773d983f66ed tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "POST /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3/action" status: 200 len: 63089 microversion: 2.1 time: 0.278384 Oct 10 23:55:25.202366 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3009/6184] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:55:24 2022] POST /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3/action => generated 63089 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:55:30.923173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:55:30.925222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:55:30.934149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-49b22cdf-4b62-42b1-ae8e-7f3016c16cbb tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-2129267921", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:55:31.011130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-49b22cdf-4b62-42b1-ae8e-7f3016c16cbb tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] validate_networks() for None {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:55:31.585894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-49b22cdf-4b62-42b1-ae8e-7f3016c16cbb tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:55:31.587144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-49b22cdf-4b62-42b1-ae8e-7f3016c16cbb tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:55:31.588011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-49b22cdf-4b62-42b1-ae8e-7f3016c16cbb tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:55:31.588670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-49b22cdf-4b62-42b1-ae8e-7f3016c16cbb tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:55:31.589073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-49b22cdf-4b62-42b1-ae8e-7f3016c16cbb tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:55:31.607148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49b22cdf-4b62-42b1-ae8e-7f3016c16cbb tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:31.608074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49b22cdf-4b62-42b1-ae8e-7f3016c16cbb tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:31.610322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49b22cdf-4b62-42b1-ae8e-7f3016c16cbb tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:31.612058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49b22cdf-4b62-42b1-ae8e-7f3016c16cbb tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:31.612867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49b22cdf-4b62-42b1-ae8e-7f3016c16cbb tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:31.613972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49b22cdf-4b62-42b1-ae8e-7f3016c16cbb tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:31.659512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-49b22cdf-4b62-42b1-ae8e-7f3016c16cbb tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Getting quotas for project 3f65aaf3599647859ffc6f3c197c4bbe. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:55:31.675545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-49b22cdf-4b62-42b1-ae8e-7f3016c16cbb tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Getting quotas for user ccc9ba3ff84140ef8817e49936c5fd8a and project 3f65aaf3599647859ffc6f3c197c4bbe. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:55:31.728548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-49b22cdf-4b62-42b1-ae8e-7f3016c16cbb tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:55:31.732427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-49b22cdf-4b62-42b1-ae8e-7f3016c16cbb tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] [instance: 99063d0c-45e5-42c6-95c0-f663605cd5f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:55:31.819435 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-49b22cdf-4b62-42b1-ae8e-7f3016c16cbb tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899814 Oct 10 23:55:31.820633 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3176/6185] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:55:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:55:31.846854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-79a528d2-d449-4590-a4f7-7ce310779879 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:31.848212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-79a528d2-d449-4590-a4f7-7ce310779879 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] [instance: 99063d0c-45e5-42c6-95c0-f663605cd5f4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:32.014428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-79a528d2-d449-4590-a4f7-7ce310779879 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc9ba3ff84140ef8817e49936c5fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65aaf3599647859ffc6f3c197c4bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:32.038337 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-79a528d2-d449-4590-a4f7-7ce310779879 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] 10.222.0.23 "GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4" status: 200 len: 1214 microversion: 2.1 time: 0.207089 Oct 10 23:55:32.039243 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3010/6186] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:31 2022] GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4 => generated 1214 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:33.069910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e30a3e2d-a340-418c-b559-5bcf87792f3b tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:33.070945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e30a3e2d-a340-418c-b559-5bcf87792f3b tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] [instance: 99063d0c-45e5-42c6-95c0-f663605cd5f4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:33.086233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e30a3e2d-a340-418c-b559-5bcf87792f3b tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:33.087056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e30a3e2d-a340-418c-b559-5bcf87792f3b tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:33.088014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e30a3e2d-a340-418c-b559-5bcf87792f3b tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:33.089575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e30a3e2d-a340-418c-b559-5bcf87792f3b tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:33.091178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e30a3e2d-a340-418c-b559-5bcf87792f3b tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:33.091932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e30a3e2d-a340-418c-b559-5bcf87792f3b tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:33.219540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e30a3e2d-a340-418c-b559-5bcf87792f3b tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc9ba3ff84140ef8817e49936c5fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65aaf3599647859ffc6f3c197c4bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:33.236164 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e30a3e2d-a340-418c-b559-5bcf87792f3b tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] 10.222.0.23 "GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4" status: 200 len: 1266 microversion: 2.1 time: 0.171438 Oct 10 23:55:33.237165 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3177/6187] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:33 2022] GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:55:34.263761 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-64674e55-310b-4d04-acba-258fc3072c59 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:34.265095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-64674e55-310b-4d04-acba-258fc3072c59 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] [instance: 99063d0c-45e5-42c6-95c0-f663605cd5f4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:34.273192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64674e55-310b-4d04-acba-258fc3072c59 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:34.273741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64674e55-310b-4d04-acba-258fc3072c59 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:34.274603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64674e55-310b-4d04-acba-258fc3072c59 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:34.275193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64674e55-310b-4d04-acba-258fc3072c59 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:34.275387 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64674e55-310b-4d04-acba-258fc3072c59 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:34.275838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64674e55-310b-4d04-acba-258fc3072c59 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:34.388270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-64674e55-310b-4d04-acba-258fc3072c59 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc9ba3ff84140ef8817e49936c5fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65aaf3599647859ffc6f3c197c4bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:34.401950 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-64674e55-310b-4d04-acba-258fc3072c59 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] 10.222.0.23 "GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4" status: 200 len: 1272 microversion: 2.1 time: 0.141847 Oct 10 23:55:34.413625 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3011/6188] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:34 2022] GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4 => generated 1272 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:35.429810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d00680a1-039c-4aec-bcdf-32b94c28cac7 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:35.431061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d00680a1-039c-4aec-bcdf-32b94c28cac7 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] [instance: 99063d0c-45e5-42c6-95c0-f663605cd5f4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:35.447097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d00680a1-039c-4aec-bcdf-32b94c28cac7 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:35.447612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d00680a1-039c-4aec-bcdf-32b94c28cac7 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:35.448076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d00680a1-039c-4aec-bcdf-32b94c28cac7 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:35.449606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d00680a1-039c-4aec-bcdf-32b94c28cac7 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:35.449606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d00680a1-039c-4aec-bcdf-32b94c28cac7 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:35.450032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d00680a1-039c-4aec-bcdf-32b94c28cac7 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:35.774846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d00680a1-039c-4aec-bcdf-32b94c28cac7 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc9ba3ff84140ef8817e49936c5fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65aaf3599647859ffc6f3c197c4bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:35.791903 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d00680a1-039c-4aec-bcdf-32b94c28cac7 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] 10.222.0.23 "GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4" status: 200 len: 1314 microversion: 2.1 time: 0.365650 Oct 10 23:55:35.793330 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3178/6189] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:35 2022] GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:36.177745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-994d5527-ac31-415d-8d72-57c26b4bd088 req-355aab33-9107-482e-843d-088d5bf2f3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99063d0c-45e5-42c6-95c0-f663605cd5f4", "tag": "863f1bd6-de7f-401d-8061-146617a717ea"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:55:36.192051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-994d5527-ac31-415d-8d72-57c26b4bd088 req-355aab33-9107-482e-843d-088d5bf2f3b4 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:36.193113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-994d5527-ac31-415d-8d72-57c26b4bd088 req-355aab33-9107-482e-843d-088d5bf2f3b4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:36.193662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-994d5527-ac31-415d-8d72-57c26b4bd088 req-355aab33-9107-482e-843d-088d5bf2f3b4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:36.208082 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-994d5527-ac31-415d-8d72-57c26b4bd088 req-355aab33-9107-482e-843d-088d5bf2f3b4 service nova] Creating event network-changed:863f1bd6-de7f-401d-8061-146617a717ea for instance 99063d0c-45e5-42c6-95c0-f663605cd5f4 on n-h2-860864-2 Oct 10 23:55:36.215739 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-994d5527-ac31-415d-8d72-57c26b4bd088 req-355aab33-9107-482e-843d-088d5bf2f3b4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043294 Oct 10 23:55:36.217017 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3012/6190] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:55:36.824115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b2d68b7f-5032-4739-9050-690d64f575ca tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:36.824786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b2d68b7f-5032-4739-9050-690d64f575ca tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] [instance: 99063d0c-45e5-42c6-95c0-f663605cd5f4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:36.836804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2d68b7f-5032-4739-9050-690d64f575ca tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:36.837925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2d68b7f-5032-4739-9050-690d64f575ca tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:36.838808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2d68b7f-5032-4739-9050-690d64f575ca tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:36.840191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2d68b7f-5032-4739-9050-690d64f575ca tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:36.841121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2d68b7f-5032-4739-9050-690d64f575ca tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:36.842063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2d68b7f-5032-4739-9050-690d64f575ca tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:37.236396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b2d68b7f-5032-4739-9050-690d64f575ca tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc9ba3ff84140ef8817e49936c5fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65aaf3599647859ffc6f3c197c4bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:37.245492 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b2d68b7f-5032-4739-9050-690d64f575ca tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] 10.222.0.23 "GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4" status: 200 len: 1314 microversion: 2.1 time: 0.429013 Oct 10 23:55:37.249470 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3179/6191] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:36 2022] GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:38.272514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-162b1422-de96-461a-ba76-be244a05deee tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:38.273443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-162b1422-de96-461a-ba76-be244a05deee tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] [instance: 99063d0c-45e5-42c6-95c0-f663605cd5f4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:38.292461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-162b1422-de96-461a-ba76-be244a05deee tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:38.292977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-162b1422-de96-461a-ba76-be244a05deee tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:38.293474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-162b1422-de96-461a-ba76-be244a05deee tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:38.294358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-162b1422-de96-461a-ba76-be244a05deee tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:38.295092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-162b1422-de96-461a-ba76-be244a05deee tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:38.295587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-162b1422-de96-461a-ba76-be244a05deee tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:38.378809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-47a06db9-028c-48b6-b648-f95b9201eafa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:38.379502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-47a06db9-028c-48b6-b648-f95b9201eafa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:38.386502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47a06db9-028c-48b6-b648-f95b9201eafa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:38.387216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47a06db9-028c-48b6-b648-f95b9201eafa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:38.387810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47a06db9-028c-48b6-b648-f95b9201eafa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:38.388690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47a06db9-028c-48b6-b648-f95b9201eafa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:38.389293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47a06db9-028c-48b6-b648-f95b9201eafa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:38.389888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47a06db9-028c-48b6-b648-f95b9201eafa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:38.419615 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-47a06db9-028c-48b6-b648-f95b9201eafa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e/ips" status: 200 len: 150 microversion: 2.1 time: 0.045556 Oct 10 23:55:38.420456 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3180/6192] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 10 23:55:38 2022] GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:55:38.434422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4b163176-ed28-4e0d-9790-ed250a114959 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52452010-a0ba-48a4-bb47-c855f1a97fec"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:55:38.444425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4b163176-ed28-4e0d-9790-ed250a114959 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:38.454217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b163176-ed28-4e0d-9790-ed250a114959 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:38.455100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b163176-ed28-4e0d-9790-ed250a114959 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:38.455546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b163176-ed28-4e0d-9790-ed250a114959 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:38.457208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b163176-ed28-4e0d-9790-ed250a114959 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:38.457863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b163176-ed28-4e0d-9790-ed250a114959 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:38.458292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b163176-ed28-4e0d-9790-ed250a114959 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:38.574434 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-4b163176-ed28-4e0d-9790-ed250a114959 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] HTTP exception thrown: Invalid volume: volume 52452010-a0ba-48a4-bb47-c855f1a97fec is already attached to instances: 38c7187f-8a0e-4319-8ec2-245aa1357f46 Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4b163176-ed28-4e0d-9790-ed250a114959 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Request method failure captured: Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e/os-volume_attachments HTTP/1.1 Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 74 Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLBDAPlCX48YdEI_BZ56dd4NDqrF57jWSGWCNxNuvLmDVrys2ONyIxdRThQ39af5CDKFGrOPcPgopPvUqIoMURbU5-dQOyalOKZCOKYa5dePf9jQ4W3BnwA1ZRfPtasJlQSUVtB1nnR57fubblxeL4KqCwX3PMAeSV4rzGda9sHJhlU Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0fcaa1fb124e448b8bacb6353fca9d5d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: b7008c9b5ad94dbea7edc12267dae2b5 Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: {"volumeAttachment": {"volumeId": "52452010-a0ba-48a4-bb47-c855f1a97fec"}} Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: exception: Invalid volume: volume 52452010-a0ba-48a4-bb47-c855f1a97fec is already attached to instances: 38c7187f-8a0e-4319-8ec2-245aa1357f46 Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'server_id': '2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e', 'body': {'volumeAttachment': {'volumeId': '52452010-a0ba-48a4-bb47-c855f1a97fec'}}} Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 52452010-a0ba-48a4-bb47-c855f1a97fec is already attached to instances: 38c7187f-8a0e-4319-8ec2-245aa1357f46 Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:55:38.576439 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:55:38.580935 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:55:38.580935 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:55:38.580935 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 10 23:55:38.580935 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 10 23:55:38.580935 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 52452010-a0ba-48a4-bb47-c855f1a97fec is already attached to instances: 38c7187f-8a0e-4319-8ec2-245aa1357f46 Oct 10 23:55:38.580935 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:55:38.580935 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:55:38.580935 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:55:38.580935 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:55:38.580935 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:55:38.580935 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:55:38.580935 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:55:38.580935 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:55:38.580935 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 52452010-a0ba-48a4-bb47-c855f1a97fec is already attached to instances: 38c7187f-8a0e-4319-8ec2-245aa1357f46 Oct 10 23:55:38.580935 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:55:38.582837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4b163176-ed28-4e0d-9790-ed250a114959 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Returning 400 to user: Invalid volume: volume 52452010-a0ba-48a4-bb47-c855f1a97fec is already attached to instances: 38c7187f-8a0e-4319-8ec2-245aa1357f46 {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:55:38.583881 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4b163176-ed28-4e0d-9790-ed250a114959 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "POST /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.154524 Oct 10 23:55:38.585105 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3181/6193] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Oct 10 23:55:38 2022] POST /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e/os-volume_attachments => generated 174 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:55:38.593192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1adc5da0-3efe-4dab-b8e3-3d9c5ee329d8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:38.594493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1adc5da0-3efe-4dab-b8e3-3d9c5ee329d8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:38.601716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1adc5da0-3efe-4dab-b8e3-3d9c5ee329d8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:38.602569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1adc5da0-3efe-4dab-b8e3-3d9c5ee329d8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:38.603154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1adc5da0-3efe-4dab-b8e3-3d9c5ee329d8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:38.604009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1adc5da0-3efe-4dab-b8e3-3d9c5ee329d8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:38.604633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1adc5da0-3efe-4dab-b8e3-3d9c5ee329d8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:38.605228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1adc5da0-3efe-4dab-b8e3-3d9c5ee329d8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:38.649938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1adc5da0-3efe-4dab-b8e3-3d9c5ee329d8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:55:38.659505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-162b1422-de96-461a-ba76-be244a05deee tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc9ba3ff84140ef8817e49936c5fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65aaf3599647859ffc6f3c197c4bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:38.668787 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-162b1422-de96-461a-ba76-be244a05deee tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] 10.222.0.23 "GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4" status: 200 len: 1314 microversion: 2.1 time: 0.402372 Oct 10 23:55:38.673430 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3013/6194] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:38 2022] GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:38.768257 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1adc5da0-3efe-4dab-b8e3-3d9c5ee329d8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e" status: 204 len: 0 microversion: 2.1 time: 0.178763 Oct 10 23:55:38.772986 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3182/6195] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:55:38 2022] DELETE /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:55:38.778985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cd766ad5-838e-49ed-b7a8-548234e12415 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:38.779810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cd766ad5-838e-49ed-b7a8-548234e12415 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:38.789244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd766ad5-838e-49ed-b7a8-548234e12415 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:38.790072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd766ad5-838e-49ed-b7a8-548234e12415 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:38.790758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd766ad5-838e-49ed-b7a8-548234e12415 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:38.791698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd766ad5-838e-49ed-b7a8-548234e12415 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:38.792364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd766ad5-838e-49ed-b7a8-548234e12415 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:38.793001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd766ad5-838e-49ed-b7a8-548234e12415 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:39.054816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cd766ad5-838e-49ed-b7a8-548234e12415 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:39.065797 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cd766ad5-838e-49ed-b7a8-548234e12415 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e" status: 200 len: 1682 microversion: 2.1 time: 0.290648 Oct 10 23:55:39.066663 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3014/6196] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:38 2022] GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e => generated 1682 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:39.703626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7155e72a-0638-459b-bc92-94735caf4e0e tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:39.705012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7155e72a-0638-459b-bc92-94735caf4e0e tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] [instance: 99063d0c-45e5-42c6-95c0-f663605cd5f4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:39.713129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7155e72a-0638-459b-bc92-94735caf4e0e tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:39.713813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7155e72a-0638-459b-bc92-94735caf4e0e tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:39.714364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7155e72a-0638-459b-bc92-94735caf4e0e tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:39.715516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7155e72a-0638-459b-bc92-94735caf4e0e tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:39.716275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7155e72a-0638-459b-bc92-94735caf4e0e tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:39.716828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7155e72a-0638-459b-bc92-94735caf4e0e tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:39.972196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7155e72a-0638-459b-bc92-94735caf4e0e tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc9ba3ff84140ef8817e49936c5fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65aaf3599647859ffc6f3c197c4bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:39.993893 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7155e72a-0638-459b-bc92-94735caf4e0e tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] 10.222.0.23 "GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4" status: 200 len: 1314 microversion: 2.1 time: 0.296324 Oct 10 23:55:39.994918 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3183/6197] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:39 2022] GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:40.095405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d25ee81d-7ebf-4704-9883-97c52d831792 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:40.096100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d25ee81d-7ebf-4704-9883-97c52d831792 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:40.115559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d25ee81d-7ebf-4704-9883-97c52d831792 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:40.120083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d25ee81d-7ebf-4704-9883-97c52d831792 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:40.125652 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d25ee81d-7ebf-4704-9883-97c52d831792 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:40.127134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d25ee81d-7ebf-4704-9883-97c52d831792 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:40.133058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d25ee81d-7ebf-4704-9883-97c52d831792 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:40.135598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d25ee81d-7ebf-4704-9883-97c52d831792 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:40.418429 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d25ee81d-7ebf-4704-9883-97c52d831792 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:40.429880 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d25ee81d-7ebf-4704-9883-97c52d831792 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e" status: 200 len: 1682 microversion: 2.1 time: 0.342917 Oct 10 23:55:40.438046 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3015/6198] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:40 2022] GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e => generated 1682 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:41.028565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d251fa46-6789-447a-af6e-0a0e8f4cdf42 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:41.029855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d251fa46-6789-447a-af6e-0a0e8f4cdf42 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] [instance: 99063d0c-45e5-42c6-95c0-f663605cd5f4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:41.044937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d251fa46-6789-447a-af6e-0a0e8f4cdf42 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:41.047151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d251fa46-6789-447a-af6e-0a0e8f4cdf42 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:41.047904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d251fa46-6789-447a-af6e-0a0e8f4cdf42 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:41.048858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d251fa46-6789-447a-af6e-0a0e8f4cdf42 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:41.049574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d251fa46-6789-447a-af6e-0a0e8f4cdf42 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:41.050238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d251fa46-6789-447a-af6e-0a0e8f4cdf42 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:41.402111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d251fa46-6789-447a-af6e-0a0e8f4cdf42 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc9ba3ff84140ef8817e49936c5fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65aaf3599647859ffc6f3c197c4bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:41.412721 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d251fa46-6789-447a-af6e-0a0e8f4cdf42 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] 10.222.0.23 "GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4" status: 200 len: 1314 microversion: 2.1 time: 0.388126 Oct 10 23:55:41.415366 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3184/6199] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:41 2022] GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:41.462302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b30bc79f-a564-4dab-95b6-1c44bb6c1a21 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:41.463650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b30bc79f-a564-4dab-95b6-1c44bb6c1a21 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:41.476570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b30bc79f-a564-4dab-95b6-1c44bb6c1a21 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:41.478670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b30bc79f-a564-4dab-95b6-1c44bb6c1a21 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:41.480192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b30bc79f-a564-4dab-95b6-1c44bb6c1a21 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:41.482464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b30bc79f-a564-4dab-95b6-1c44bb6c1a21 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:41.485218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b30bc79f-a564-4dab-95b6-1c44bb6c1a21 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:41.486185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b30bc79f-a564-4dab-95b6-1c44bb6c1a21 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:41.599617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b30bc79f-a564-4dab-95b6-1c44bb6c1a21 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:41.608885 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b30bc79f-a564-4dab-95b6-1c44bb6c1a21 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e" status: 200 len: 1614 microversion: 2.1 time: 0.151283 Oct 10 23:55:41.612299 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3016/6200] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:41 2022] GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e => generated 1614 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:42.127041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-dde0488f-3699-47de-b954-1db46f9bfb13 req-1201c9ad-14d4-42ae-81cf-1ba216bcb5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e", "name": "network-vif-deleted", "tag": "30d0f80e-9738-47e5-bda4-e55ac251dfae"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:55:42.158920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:55:42.161593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:55:42.177922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-dde0488f-3699-47de-b954-1db46f9bfb13 req-1201c9ad-14d4-42ae-81cf-1ba216bcb5c8 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:42.179112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-dde0488f-3699-47de-b954-1db46f9bfb13 req-1201c9ad-14d4-42ae-81cf-1ba216bcb5c8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:42.180762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-dde0488f-3699-47de-b954-1db46f9bfb13 req-1201c9ad-14d4-42ae-81cf-1ba216bcb5c8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:42.208499 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-dde0488f-3699-47de-b954-1db46f9bfb13 req-1201c9ad-14d4-42ae-81cf-1ba216bcb5c8 service nova] Creating event network-vif-deleted:30d0f80e-9738-47e5-bda4-e55ac251dfae for instance 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e on n-h2-860864-2 Oct 10 23:55:42.226014 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-dde0488f-3699-47de-b954-1db46f9bfb13 req-1201c9ad-14d4-42ae-81cf-1ba216bcb5c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104073 Oct 10 23:55:42.236425 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3185/6201] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:55:42.473878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bb642531-3f0b-4861-a64d-5a82ea62b306 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:42.476965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bb642531-3f0b-4861-a64d-5a82ea62b306 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] [instance: 99063d0c-45e5-42c6-95c0-f663605cd5f4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:42.482244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:55:42.499235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb642531-3f0b-4861-a64d-5a82ea62b306 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:42.500822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb642531-3f0b-4861-a64d-5a82ea62b306 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:42.501208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb642531-3f0b-4861-a64d-5a82ea62b306 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:42.502066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb642531-3f0b-4861-a64d-5a82ea62b306 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:42.502628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb642531-3f0b-4861-a64d-5a82ea62b306 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:42.503065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb642531-3f0b-4861-a64d-5a82ea62b306 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:42.641426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e053d125-8255-435b-9e5d-8109868e71e9 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:42.642195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e053d125-8255-435b-9e5d-8109868e71e9 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:42.659071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e053d125-8255-435b-9e5d-8109868e71e9 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:42.659670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e053d125-8255-435b-9e5d-8109868e71e9 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:42.660202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e053d125-8255-435b-9e5d-8109868e71e9 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:42.660939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e053d125-8255-435b-9e5d-8109868e71e9 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:42.662736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e053d125-8255-435b-9e5d-8109868e71e9 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:42.663183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e053d125-8255-435b-9e5d-8109868e71e9 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:42.739015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e053d125-8255-435b-9e5d-8109868e71e9 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:42.739776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e053d125-8255-435b-9e5d-8109868e71e9 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:42.756490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e053d125-8255-435b-9e5d-8109868e71e9 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:42.757638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-e053d125-8255-435b-9e5d-8109868e71e9 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lazy-loading 'fault' on Instance uuid 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:55:42.873825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e053d125-8255-435b-9e5d-8109868e71e9 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:42.887010 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e053d125-8255-435b-9e5d-8109868e71e9 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e" status: 200 len: 1331 microversion: 2.1 time: 0.251106 Oct 10 23:55:42.899195 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3186/6202] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:42 2022] GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e => generated 1331 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:55:43.005014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb642531-3f0b-4861-a64d-5a82ea62b306 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc9ba3ff84140ef8817e49936c5fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65aaf3599647859ffc6f3c197c4bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:43.052907 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bb642531-3f0b-4861-a64d-5a82ea62b306 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] 10.222.0.23 "GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4" status: 200 len: 1314 microversion: 2.1 time: 0.608410 Oct 10 23:55:43.056935 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3017/6203] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:42 2022] GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4 => generated 1314 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:43.917161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4bc65b9d-b54d-46ff-80ee-318984e5654e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:43.918686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4bc65b9d-b54d-46ff-80ee-318984e5654e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:43.935667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4bc65b9d-b54d-46ff-80ee-318984e5654e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:43.936444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4bc65b9d-b54d-46ff-80ee-318984e5654e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:43.937894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4bc65b9d-b54d-46ff-80ee-318984e5654e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:43.939042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4bc65b9d-b54d-46ff-80ee-318984e5654e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:43.943217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4bc65b9d-b54d-46ff-80ee-318984e5654e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:43.943877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4bc65b9d-b54d-46ff-80ee-318984e5654e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:43.984358 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-4bc65b9d-b54d-46ff-80ee-318984e5654e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] HTTP exception thrown: Instance 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e could not be found. Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4bc65b9d-b54d-46ff-80ee-318984e5654e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Request method failure captured: Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e HTTP/1.1 Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLBDAPlCX48YdEI_BZ56dd4NDqrF57jWSGWCNxNuvLmDVrys2ONyIxdRThQ39af5CDKFGrOPcPgopPvUqIoMURbU5-dQOyalOKZCOKYa5dePf9jQ4W3BnwA1ZRfPtasJlQSUVtB1nnR57fubblxeL4KqCwX3PMAeSV4rzGda9sHJhlU Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0fcaa1fb124e448b8bacb6353fca9d5d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: b7008c9b5ad94dbea7edc12267dae2b5 Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e could not be found. Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e'} Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e could not be found. Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e could not be found. Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:55:43.992030 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:55:43.996306 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:55:43.996306 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:55:43.996306 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:55:43.996306 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:55:43.996306 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:55:43.996306 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e could not be found. Oct 10 23:55:43.996306 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:55:44.000405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4bc65b9d-b54d-46ff-80ee-318984e5654e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Returning 404 to user: Instance 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:55:44.012887 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4bc65b9d-b54d-46ff-80ee-318984e5654e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e" status: 404 len: 111 microversion: 2.1 time: 0.089718 Oct 10 23:55:44.012887 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3187/6204] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:43 2022] GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:55:44.023066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aa5bb77b-5553-41e1-822a-bdfc2940ac7e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '.version_select at 0x7f662a4f1700>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:44.072452 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aa5bb77b-5553-41e1-822a-bdfc2940ac7e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-725485399" status: 202 len: 0 microversion: 2.1 time: 0.053154 Oct 10 23:55:44.073275 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3018/6205] 10.222.0.23 () {58 vars in 1218 bytes} [Mon Oct 10 23:55:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-725485399 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:55:44.086281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-caa4c0b1-a7ca-4b99-93a6-e4820b463779 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:44.087113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-caa4c0b1-a7ca-4b99-93a6-e4820b463779 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] [instance: 99063d0c-45e5-42c6-95c0-f663605cd5f4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:44.100944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-caa4c0b1-a7ca-4b99-93a6-e4820b463779 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:44.101498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-caa4c0b1-a7ca-4b99-93a6-e4820b463779 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:44.101953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-caa4c0b1-a7ca-4b99-93a6-e4820b463779 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:44.105970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-caa4c0b1-a7ca-4b99-93a6-e4820b463779 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:44.107627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-caa4c0b1-a7ca-4b99-93a6-e4820b463779 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:44.110689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-caa4c0b1-a7ca-4b99-93a6-e4820b463779 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:44.384064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-fb2ed9c4-0a76-4bd7-b734-f3f7b78e0fad req-c2d1753e-0d12-41a8-963d-c6e6f1a1ff03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99063d0c-45e5-42c6-95c0-f663605cd5f4", "name": "network-vif-plugged", "status": "completed", "tag": "863f1bd6-de7f-401d-8061-146617a717ea"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:55:44.399928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fb2ed9c4-0a76-4bd7-b734-f3f7b78e0fad req-c2d1753e-0d12-41a8-963d-c6e6f1a1ff03 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:44.401278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fb2ed9c4-0a76-4bd7-b734-f3f7b78e0fad req-c2d1753e-0d12-41a8-963d-c6e6f1a1ff03 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:44.401885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fb2ed9c4-0a76-4bd7-b734-f3f7b78e0fad req-c2d1753e-0d12-41a8-963d-c6e6f1a1ff03 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:44.429950 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-fb2ed9c4-0a76-4bd7-b734-f3f7b78e0fad req-c2d1753e-0d12-41a8-963d-c6e6f1a1ff03 service nova] Creating event network-vif-plugged:863f1bd6-de7f-401d-8061-146617a717ea for instance 99063d0c-45e5-42c6-95c0-f663605cd5f4 on n-h2-860864-2 Oct 10 23:55:44.436773 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-fb2ed9c4-0a76-4bd7-b734-f3f7b78e0fad req-c2d1753e-0d12-41a8-963d-c6e6f1a1ff03 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056906 Oct 10 23:55:44.438572 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3019/6206] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:55:44.682322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-caa4c0b1-a7ca-4b99-93a6-e4820b463779 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc9ba3ff84140ef8817e49936c5fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65aaf3599647859ffc6f3c197c4bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:44.693933 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-caa4c0b1-a7ca-4b99-93a6-e4820b463779 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] 10.222.0.23 "GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4" status: 200 len: 1314 microversion: 2.1 time: 0.612438 Oct 10 23:55:44.697148 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3188/6207] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:44 2022] GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4 => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:45.723237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-37784421-c1eb-4717-a484-0d228863a2ad tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:45.724375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-37784421-c1eb-4717-a484-0d228863a2ad tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] [instance: 99063d0c-45e5-42c6-95c0-f663605cd5f4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:45.738342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37784421-c1eb-4717-a484-0d228863a2ad tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:45.739253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37784421-c1eb-4717-a484-0d228863a2ad tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:45.739587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37784421-c1eb-4717-a484-0d228863a2ad tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:45.740253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37784421-c1eb-4717-a484-0d228863a2ad tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:45.741187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37784421-c1eb-4717-a484-0d228863a2ad tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:45.741187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-37784421-c1eb-4717-a484-0d228863a2ad tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:46.187948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-37784421-c1eb-4717-a484-0d228863a2ad tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc9ba3ff84140ef8817e49936c5fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65aaf3599647859ffc6f3c197c4bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:46.199114 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-37784421-c1eb-4717-a484-0d228863a2ad tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] 10.222.0.23 "GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4" status: 200 len: 1314 microversion: 2.1 time: 0.481726 Oct 10 23:55:46.199747 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3020/6208] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:45 2022] GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4 => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:46.560539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-88b62df8-0de5-45ad-a656-a1944c8ef21b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:46.561090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-88b62df8-0de5-45ad-a656-a1944c8ef21b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:46.583120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88b62df8-0de5-45ad-a656-a1944c8ef21b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:46.583692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88b62df8-0de5-45ad-a656-a1944c8ef21b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:46.584048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88b62df8-0de5-45ad-a656-a1944c8ef21b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:46.584769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88b62df8-0de5-45ad-a656-a1944c8ef21b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:46.585293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88b62df8-0de5-45ad-a656-a1944c8ef21b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:46.586366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88b62df8-0de5-45ad-a656-a1944c8ef21b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:46.739979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-88b62df8-0de5-45ad-a656-a1944c8ef21b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lazy-loading 'services' on Instance uuid 38c7187f-8a0e-4319-8ec2-245aa1357f46 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:55:46.888257 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-88b62df8-0de5-45ad-a656-a1944c8ef21b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "DELETE /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/os-volume_attachments/52452010-a0ba-48a4-bb47-c855f1a97fec" status: 202 len: 0 microversion: 2.1 time: 0.332545 Oct 10 23:55:46.890668 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3189/6209] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Oct 10 23:55:46 2022] DELETE /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/os-volume_attachments/52452010-a0ba-48a4-bb47-c855f1a97fec => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:55:46.899114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1cad3440-40f0-4f85-b128-d8a23c2ccee8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:46.901516 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1cad3440-40f0-4f85-b128-d8a23c2ccee8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:46.920106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1cad3440-40f0-4f85-b128-d8a23c2ccee8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:46.920608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1cad3440-40f0-4f85-b128-d8a23c2ccee8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:46.921026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1cad3440-40f0-4f85-b128-d8a23c2ccee8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:46.924790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1cad3440-40f0-4f85-b128-d8a23c2ccee8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:46.928183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1cad3440-40f0-4f85-b128-d8a23c2ccee8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:46.929026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1cad3440-40f0-4f85-b128-d8a23c2ccee8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:47.022144 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1cad3440-40f0-4f85-b128-d8a23c2ccee8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126436 Oct 10 23:55:47.026999 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3021/6210] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:55:46 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:55:47.165109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9f2c1cd1-34ea-4158-9aa3-e29df3ec9304 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Action: 'create', calling method: .version_select at 0x7f662b991160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1787234900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0sLrUm+AI00bgL9jIBsoiuIIv+IxqkA+Sd6R8v76bD11Z5je79Z/ZbLQghxD+YZVNYHMzRVVk2K9sa60mmLZUkqv42zHXIR2S/5NkhlkjgMTW0qkFf3mKU/HlRZcrJbQ=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:55:47.200889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-9f2c1cd1-34ea-4158-9aa3-e29df3ec9304 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Getting quotas for project 897064e9041f4e4f94ced711d282deb4. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:55:47.210806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-9f2c1cd1-34ea-4158-9aa3-e29df3ec9304 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Getting quotas for user 82fc082060b54409a4361c04f8355580 and project 897064e9041f4e4f94ced711d282deb4. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:55:47.234609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:55:47.244304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f079d2bf-d7cd-42a9-9e56-287056015d02 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:47.245643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f079d2bf-d7cd-42a9-9e56-287056015d02 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] [instance: 99063d0c-45e5-42c6-95c0-f663605cd5f4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:47.261820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f079d2bf-d7cd-42a9-9e56-287056015d02 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:47.262794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f079d2bf-d7cd-42a9-9e56-287056015d02 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:47.263494 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f079d2bf-d7cd-42a9-9e56-287056015d02 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:47.265649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f079d2bf-d7cd-42a9-9e56-287056015d02 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:47.266837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f079d2bf-d7cd-42a9-9e56-287056015d02 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:47.267689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f079d2bf-d7cd-42a9-9e56-287056015d02 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:47.283641 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9f2c1cd1-34ea-4158-9aa3-e29df3ec9304 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.122548 Oct 10 23:55:47.284305 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3190/6211] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:55:47 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:55:47.533676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f079d2bf-d7cd-42a9-9e56-287056015d02 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc9ba3ff84140ef8817e49936c5fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65aaf3599647859ffc6f3c197c4bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:47.548321 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f079d2bf-d7cd-42a9-9e56-287056015d02 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] 10.222.0.23 "GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4" status: 200 len: 1464 microversion: 2.1 time: 0.311132 Oct 10 23:55:47.565076 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3022/6212] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:47 2022] GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4 => generated 1464 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:55:47.584709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e3467a44-2895-4192-b346-d5e2740bc805 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8613fe82-7013-404a-8167-61a1c1a21e42", "device": "/dev/sdb"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:55:47.588030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e3467a44-2895-4192-b346-d5e2740bc805 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] [instance: 99063d0c-45e5-42c6-95c0-f663605cd5f4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:47.606914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3467a44-2895-4192-b346-d5e2740bc805 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:47.610288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3467a44-2895-4192-b346-d5e2740bc805 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:47.611361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3467a44-2895-4192-b346-d5e2740bc805 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:47.612522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3467a44-2895-4192-b346-d5e2740bc805 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:47.613570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3467a44-2895-4192-b346-d5e2740bc805 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:47.614293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3467a44-2895-4192-b346-d5e2740bc805 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:48.020345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:55:48.049639 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e3467a44-2895-4192-b346-d5e2740bc805 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] 10.222.0.23 "POST /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.465003 Oct 10 23:55:48.051654 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3191/6213] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Oct 10 23:55:47 2022] POST /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4/os-volume_attachments => generated 194 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:55:48.064285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f1bece15-9885-499f-9230-606b40d21481 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:48.071140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f1bece15-9885-499f-9230-606b40d21481 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:48.090038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1bece15-9885-499f-9230-606b40d21481 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:48.090884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1bece15-9885-499f-9230-606b40d21481 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:48.095758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1bece15-9885-499f-9230-606b40d21481 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:48.097120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1bece15-9885-499f-9230-606b40d21481 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:48.097911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1bece15-9885-499f-9230-606b40d21481 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:48.100158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1bece15-9885-499f-9230-606b40d21481 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:48.182048 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f1bece15-9885-499f-9230-606b40d21481 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128771 Oct 10 23:55:48.184856 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3192/6214] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:55:48 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:55:48.601041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dcf19353-a6f2-4dd2-ad89-3a51cee9c0d2 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:48.601693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dcf19353-a6f2-4dd2-ad89-3a51cee9c0d2 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:48.608587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcf19353-a6f2-4dd2-ad89-3a51cee9c0d2 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:48.612982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcf19353-a6f2-4dd2-ad89-3a51cee9c0d2 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:48.614333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcf19353-a6f2-4dd2-ad89-3a51cee9c0d2 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:48.615544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcf19353-a6f2-4dd2-ad89-3a51cee9c0d2 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:48.616161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcf19353-a6f2-4dd2-ad89-3a51cee9c0d2 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:48.620379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dcf19353-a6f2-4dd2-ad89-3a51cee9c0d2 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:48.961953 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dcf19353-a6f2-4dd2-ad89-3a51cee9c0d2 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1832 microversion: 2.1 time: 1.023830 Oct 10 23:55:48.963200 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3023/6215] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:47 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1832 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:49.196555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-82b0aa51-babd-4400-8d9a-ca7dc41c92a2 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:49.200993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-82b0aa51-babd-4400-8d9a-ca7dc41c92a2 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:49.222099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82b0aa51-babd-4400-8d9a-ca7dc41c92a2 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:49.222664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82b0aa51-babd-4400-8d9a-ca7dc41c92a2 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:49.227272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82b0aa51-babd-4400-8d9a-ca7dc41c92a2 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:49.233180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82b0aa51-babd-4400-8d9a-ca7dc41c92a2 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:49.238015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82b0aa51-babd-4400-8d9a-ca7dc41c92a2 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:49.238604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82b0aa51-babd-4400-8d9a-ca7dc41c92a2 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:49.325552 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-82b0aa51-babd-4400-8d9a-ca7dc41c92a2 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130946 Oct 10 23:55:49.329711 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3193/6216] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:55:49 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:55:49.932953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c3457a5d-8101-4445-a4e6-c30d5dbb99ee tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1814271267", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "23a0519b-8895-488b-a77b-d2988423d8f2"}], "key_name": "tempest-TestNetworkBasicOps-1787234900", "security_groups": [{"name": "tempest-secgroup-smoke-656527721"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:55:49.970865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:55:50.233689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-c3457a5d-8101-4445-a4e6-c30d5dbb99ee tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] validate_networks() for [('23a0519b-8895-488b-a77b-d2988423d8f2', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:55:50.339538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f9d013ed-5f9b-4036-8114-76b52c22977b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:50.342029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f9d013ed-5f9b-4036-8114-76b52c22977b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:50.362690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9d013ed-5f9b-4036-8114-76b52c22977b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:50.367335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9d013ed-5f9b-4036-8114-76b52c22977b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:50.368042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9d013ed-5f9b-4036-8114-76b52c22977b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:50.369576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9d013ed-5f9b-4036-8114-76b52c22977b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:50.370202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9d013ed-5f9b-4036-8114-76b52c22977b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:50.370788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f9d013ed-5f9b-4036-8114-76b52c22977b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:50.425617 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f9d013ed-5f9b-4036-8114-76b52c22977b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090312 Oct 10 23:55:50.426579 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3194/6217] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:55:50 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:55:51.091427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7c3a61c2-e91f-4207-866f-46cba7262466 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:51.092512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7c3a61c2-e91f-4207-866f-46cba7262466 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:51.111644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c3a61c2-e91f-4207-866f-46cba7262466 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:51.113191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c3a61c2-e91f-4207-866f-46cba7262466 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:51.115069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c3a61c2-e91f-4207-866f-46cba7262466 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:51.117270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c3a61c2-e91f-4207-866f-46cba7262466 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:51.118035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c3a61c2-e91f-4207-866f-46cba7262466 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:51.118755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c3a61c2-e91f-4207-866f-46cba7262466 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:51.181185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7c3a61c2-e91f-4207-866f-46cba7262466 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:55:51.317138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c3457a5d-8101-4445-a4e6-c30d5dbb99ee tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:55:51.318390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c3457a5d-8101-4445-a4e6-c30d5dbb99ee tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:55:51.319551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c3457a5d-8101-4445-a4e6-c30d5dbb99ee tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:55:51.320130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c3457a5d-8101-4445-a4e6-c30d5dbb99ee tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:55:51.331018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c3457a5d-8101-4445-a4e6-c30d5dbb99ee tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:55:51.340877 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7c3a61c2-e91f-4207-866f-46cba7262466 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 204 len: 0 microversion: 2.1 time: 0.256796 Oct 10 23:55:51.342658 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3195/6218] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:55:51 2022] DELETE /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:55:51.350653 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-358af3a0-e61a-4939-b52a-34d269bc8279 req-07347bdd-037a-4c28-ac13-200816415512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1620135-b28b-4695-8abf-cbf46a5421d3", "tag": "15d44200-1f5f-4b96-924d-701730ace82a"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:55:51.368963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-358af3a0-e61a-4939-b52a-34d269bc8279 req-07347bdd-037a-4c28-ac13-200816415512 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:51.369440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3457a5d-8101-4445-a4e6-c30d5dbb99ee tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:51.370212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3457a5d-8101-4445-a4e6-c30d5dbb99ee tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:51.370706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-358af3a0-e61a-4939-b52a-34d269bc8279 req-07347bdd-037a-4c28-ac13-200816415512 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:51.371300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3457a5d-8101-4445-a4e6-c30d5dbb99ee tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:51.371415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-358af3a0-e61a-4939-b52a-34d269bc8279 req-07347bdd-037a-4c28-ac13-200816415512 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:51.372436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3457a5d-8101-4445-a4e6-c30d5dbb99ee tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:51.373183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3457a5d-8101-4445-a4e6-c30d5dbb99ee tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:51.373859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3457a5d-8101-4445-a4e6-c30d5dbb99ee tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:51.392502 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-358af3a0-e61a-4939-b52a-34d269bc8279 req-07347bdd-037a-4c28-ac13-200816415512 service nova] Creating event network-changed:15d44200-1f5f-4b96-924d-701730ace82a for instance e1620135-b28b-4695-8abf-cbf46a5421d3 on n-h1-860864-2 Oct 10 23:55:51.397587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=73 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:55:51.398688 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-358af3a0-e61a-4939-b52a-34d269bc8279 req-07347bdd-037a-4c28-ac13-200816415512 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053392 Oct 10 23:55:51.399489 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3196/6219] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:55:51.409767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-45e0b786-6886-4d99-a9ee-4c608030a5ce tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:51.410482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-45e0b786-6886-4d99-a9ee-4c608030a5ce tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:51.417685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-c3457a5d-8101-4445-a4e6-c30d5dbb99ee tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Getting quotas for project 897064e9041f4e4f94ced711d282deb4. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:55:51.418586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45e0b786-6886-4d99-a9ee-4c608030a5ce tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:51.419565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45e0b786-6886-4d99-a9ee-4c608030a5ce tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:51.420249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45e0b786-6886-4d99-a9ee-4c608030a5ce tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:51.421193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45e0b786-6886-4d99-a9ee-4c608030a5ce tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:51.422220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45e0b786-6886-4d99-a9ee-4c608030a5ce tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:51.422969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45e0b786-6886-4d99-a9ee-4c608030a5ce tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:51.431172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-c3457a5d-8101-4445-a4e6-c30d5dbb99ee tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Getting quotas for user 82fc082060b54409a4361c04f8355580 and project 897064e9041f4e4f94ced711d282deb4. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:55:51.457754 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c3457a5d-8101-4445-a4e6-c30d5dbb99ee tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:55:51.461227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c3457a5d-8101-4445-a4e6-c30d5dbb99ee tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: a2ab3eb3-f415-415b-9026-41a1befefdae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:55:51.530097 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c3457a5d-8101-4445-a4e6-c30d5dbb99ee tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.601144 Oct 10 23:55:51.539195 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3024/6220] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:55:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 1611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:55:51.545189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-46f234bd-1d99-42be-ade4-444a8f14af11 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:51.550529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-46f234bd-1d99-42be-ade4-444a8f14af11 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:51.562681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46f234bd-1d99-42be-ade4-444a8f14af11 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:51.563387 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46f234bd-1d99-42be-ade4-444a8f14af11 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:51.563985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46f234bd-1d99-42be-ade4-444a8f14af11 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:51.564880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46f234bd-1d99-42be-ade4-444a8f14af11 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:51.566329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46f234bd-1d99-42be-ade4-444a8f14af11 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:51.567191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-46f234bd-1d99-42be-ade4-444a8f14af11 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:51.678728 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-46f234bd-1d99-42be-ade4-444a8f14af11 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137631 Oct 10 23:55:51.683981 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3025/6221] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:55:51 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:55:51.690169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f51bdce6-03a9-45c4-917a-8d4af81f426b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:51.690636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f51bdce6-03a9-45c4-917a-8d4af81f426b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: a2ab3eb3-f415-415b-9026-41a1befefdae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:51.710075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-45e0b786-6886-4d99-a9ee-4c608030a5ce tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:51.722495 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-45e0b786-6886-4d99-a9ee-4c608030a5ce tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1687 microversion: 2.1 time: 0.318542 Oct 10 23:55:51.723415 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3197/6222] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:51 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1687 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:51.783319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f51bdce6-03a9-45c4-917a-8d4af81f426b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:51.792952 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f51bdce6-03a9-45c4-917a-8d4af81f426b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae" status: 200 len: 1249 microversion: 2.1 time: 0.107766 Oct 10 23:55:51.795426 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3026/6223] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:51 2022] GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae => generated 1249 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:52.692442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-106f8a8f-e21e-4da5-8b1b-c5cb70647def tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:52.695186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-106f8a8f-e21e-4da5-8b1b-c5cb70647def tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:52.702566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-106f8a8f-e21e-4da5-8b1b-c5cb70647def tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:52.703126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-106f8a8f-e21e-4da5-8b1b-c5cb70647def tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:52.703571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-106f8a8f-e21e-4da5-8b1b-c5cb70647def tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:52.704567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-106f8a8f-e21e-4da5-8b1b-c5cb70647def tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:52.705049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-106f8a8f-e21e-4da5-8b1b-c5cb70647def tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:52.705797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-106f8a8f-e21e-4da5-8b1b-c5cb70647def tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:52.741602 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-106f8a8f-e21e-4da5-8b1b-c5cb70647def tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053981 Oct 10 23:55:52.742473 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3198/6224] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:55:52 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:55:52.755014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a2066477-797d-4b01-acb0-4840b1cb7847 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:52.755717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a2066477-797d-4b01-acb0-4840b1cb7847 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:52.765090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2066477-797d-4b01-acb0-4840b1cb7847 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:52.767580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2066477-797d-4b01-acb0-4840b1cb7847 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:52.769081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2066477-797d-4b01-acb0-4840b1cb7847 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:52.770299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2066477-797d-4b01-acb0-4840b1cb7847 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:52.770911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2066477-797d-4b01-acb0-4840b1cb7847 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:52.771429 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a2066477-797d-4b01-acb0-4840b1cb7847 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:52.819672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c6062b3f-a035-46de-92d1-c62c2f809d42 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:52.820182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c6062b3f-a035-46de-92d1-c62c2f809d42 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: a2ab3eb3-f415-415b-9026-41a1befefdae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:52.833195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6062b3f-a035-46de-92d1-c62c2f809d42 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:52.833779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6062b3f-a035-46de-92d1-c62c2f809d42 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:52.834210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6062b3f-a035-46de-92d1-c62c2f809d42 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:52.837419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6062b3f-a035-46de-92d1-c62c2f809d42 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:52.837920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6062b3f-a035-46de-92d1-c62c2f809d42 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:52.838531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6062b3f-a035-46de-92d1-c62c2f809d42 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:52.945771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c6062b3f-a035-46de-92d1-c62c2f809d42 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:52.964307 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c6062b3f-a035-46de-92d1-c62c2f809d42 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae" status: 200 len: 1301 microversion: 2.1 time: 0.148497 Oct 10 23:55:52.965396 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3199/6225] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:52 2022] GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae => generated 1301 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:53.044312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a2066477-797d-4b01-acb0-4840b1cb7847 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:53.054871 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a2066477-797d-4b01-acb0-4840b1cb7847 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1687 microversion: 2.1 time: 0.306609 Oct 10 23:55:53.055594 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3027/6226] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:52 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1687 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:53.757865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-977d2ad3-5ced-40c6-95fc-5d7c21825357 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:53.760239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-977d2ad3-5ced-40c6-95fc-5d7c21825357 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:53.771032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-977d2ad3-5ced-40c6-95fc-5d7c21825357 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:53.772602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-977d2ad3-5ced-40c6-95fc-5d7c21825357 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:53.774463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-977d2ad3-5ced-40c6-95fc-5d7c21825357 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:53.776260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-977d2ad3-5ced-40c6-95fc-5d7c21825357 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:53.777178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-977d2ad3-5ced-40c6-95fc-5d7c21825357 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:53.778849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-977d2ad3-5ced-40c6-95fc-5d7c21825357 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:53.846382 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-977d2ad3-5ced-40c6-95fc-5d7c21825357 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088824 Oct 10 23:55:53.847590 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3200/6227] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:55:53 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:55:53.858888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-75b02d33-edbe-4404-a81d-096217dfa232 req-2ec1aed3-b097-4f9b-8caf-cc574e2ace82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1620135-b28b-4695-8abf-cbf46a5421d3", "name": "network-vif-deleted", "tag": "15d44200-1f5f-4b96-924d-701730ace82a"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:55:53.888855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-75b02d33-edbe-4404-a81d-096217dfa232 req-2ec1aed3-b097-4f9b-8caf-cc574e2ace82 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:53.890121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-75b02d33-edbe-4404-a81d-096217dfa232 req-2ec1aed3-b097-4f9b-8caf-cc574e2ace82 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:53.895629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-75b02d33-edbe-4404-a81d-096217dfa232 req-2ec1aed3-b097-4f9b-8caf-cc574e2ace82 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:53.917440 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-75b02d33-edbe-4404-a81d-096217dfa232 req-2ec1aed3-b097-4f9b-8caf-cc574e2ace82 service nova] Creating event network-vif-deleted:15d44200-1f5f-4b96-924d-701730ace82a for instance e1620135-b28b-4695-8abf-cbf46a5421d3 on n-h1-860864-2 Oct 10 23:55:53.925064 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-75b02d33-edbe-4404-a81d-096217dfa232 req-2ec1aed3-b097-4f9b-8caf-cc574e2ace82 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073750 Oct 10 23:55:53.931099 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3028/6228] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:55:54.012635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-16d41a7d-0531-42ae-b4f1-078ef83312c6 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:54.018276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-16d41a7d-0531-42ae-b4f1-078ef83312c6 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: a2ab3eb3-f415-415b-9026-41a1befefdae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:54.037368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16d41a7d-0531-42ae-b4f1-078ef83312c6 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:54.038078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16d41a7d-0531-42ae-b4f1-078ef83312c6 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:54.038564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16d41a7d-0531-42ae-b4f1-078ef83312c6 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:54.039886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16d41a7d-0531-42ae-b4f1-078ef83312c6 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:54.040428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16d41a7d-0531-42ae-b4f1-078ef83312c6 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:54.040892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-16d41a7d-0531-42ae-b4f1-078ef83312c6 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:54.082788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f7a7d6fa-955b-4313-ae69-5b2ab3e0204d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:54.083522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f7a7d6fa-955b-4313-ae69-5b2ab3e0204d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:54.097021 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7a7d6fa-955b-4313-ae69-5b2ab3e0204d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:54.106208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7a7d6fa-955b-4313-ae69-5b2ab3e0204d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:54.106671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7a7d6fa-955b-4313-ae69-5b2ab3e0204d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:54.110488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7a7d6fa-955b-4313-ae69-5b2ab3e0204d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:54.113687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7a7d6fa-955b-4313-ae69-5b2ab3e0204d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:54.119553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7a7d6fa-955b-4313-ae69-5b2ab3e0204d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:54.138746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-16d41a7d-0531-42ae-b4f1-078ef83312c6 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:54.150345 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-16d41a7d-0531-42ae-b4f1-078ef83312c6 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae" status: 200 len: 1307 microversion: 2.1 time: 0.154355 Oct 10 23:55:54.151514 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3201/6229] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:53 2022] GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae => generated 1307 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:54.207879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7a7d6fa-955b-4313-ae69-5b2ab3e0204d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:54.208685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7a7d6fa-955b-4313-ae69-5b2ab3e0204d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:54.209515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7a7d6fa-955b-4313-ae69-5b2ab3e0204d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:54.214663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-f7a7d6fa-955b-4313-ae69-5b2ab3e0204d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lazy-loading 'fault' on Instance uuid e1620135-b28b-4695-8abf-cbf46a5421d3 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:55:54.376130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f7a7d6fa-955b-4313-ae69-5b2ab3e0204d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:54.389725 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f7a7d6fa-955b-4313-ae69-5b2ab3e0204d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 200 len: 1356 microversion: 2.1 time: 0.312371 Oct 10 23:55:54.409163 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3029/6230] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:54 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 1356 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:54.860462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fd859460-7b10-4ca3-83ab-3e2dc8115f37 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:54.863517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fd859460-7b10-4ca3-83ab-3e2dc8115f37 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:54.871830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd859460-7b10-4ca3-83ab-3e2dc8115f37 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:54.872431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd859460-7b10-4ca3-83ab-3e2dc8115f37 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:54.872975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd859460-7b10-4ca3-83ab-3e2dc8115f37 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:54.873775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd859460-7b10-4ca3-83ab-3e2dc8115f37 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:54.875225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd859460-7b10-4ca3-83ab-3e2dc8115f37 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:54.876180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd859460-7b10-4ca3-83ab-3e2dc8115f37 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:54.921365 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fd859460-7b10-4ca3-83ab-3e2dc8115f37 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062449 Oct 10 23:55:54.922945 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3202/6231] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:55:54 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:55:55.150319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b12a2765-5344-43c7-9570-9f32509a0e89 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:55.151355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b12a2765-5344-43c7-9570-9f32509a0e89 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:55.163360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b12a2765-5344-43c7-9570-9f32509a0e89 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:55.164059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b12a2765-5344-43c7-9570-9f32509a0e89 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:55.164649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b12a2765-5344-43c7-9570-9f32509a0e89 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:55.165773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b12a2765-5344-43c7-9570-9f32509a0e89 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:55.166402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b12a2765-5344-43c7-9570-9f32509a0e89 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:55.166979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b12a2765-5344-43c7-9570-9f32509a0e89 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:55.182779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8ead689f-a244-41f2-96f7-a97581a18fe7 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:55.183631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8ead689f-a244-41f2-96f7-a97581a18fe7 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: a2ab3eb3-f415-415b-9026-41a1befefdae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:55.194102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ead689f-a244-41f2-96f7-a97581a18fe7 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:55.198100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ead689f-a244-41f2-96f7-a97581a18fe7 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:55.198776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ead689f-a244-41f2-96f7-a97581a18fe7 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:55.199728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ead689f-a244-41f2-96f7-a97581a18fe7 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:55.202286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ead689f-a244-41f2-96f7-a97581a18fe7 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:55.202997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ead689f-a244-41f2-96f7-a97581a18fe7 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:55.221906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b12a2765-5344-43c7-9570-9f32509a0e89 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:55:55.390147 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b12a2765-5344-43c7-9570-9f32509a0e89 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "DELETE /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46" status: 204 len: 0 microversion: 2.1 time: 0.243362 Oct 10 23:55:55.394339 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3030/6232] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:55:55 2022] DELETE /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:55:55.400523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5158d2e7-dac9-499c-9c38-31c145a8405e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:55.402742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5158d2e7-dac9-499c-9c38-31c145a8405e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:55.417904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5158d2e7-dac9-499c-9c38-31c145a8405e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:55.422993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5158d2e7-dac9-499c-9c38-31c145a8405e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:55.423637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5158d2e7-dac9-499c-9c38-31c145a8405e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:55.424910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5158d2e7-dac9-499c-9c38-31c145a8405e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:55.425569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5158d2e7-dac9-499c-9c38-31c145a8405e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:55.426334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5158d2e7-dac9-499c-9c38-31c145a8405e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:55.497649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8ead689f-a244-41f2-96f7-a97581a18fe7 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:55.506668 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8ead689f-a244-41f2-96f7-a97581a18fe7 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae" status: 200 len: 1374 microversion: 2.1 time: 0.328492 Oct 10 23:55:55.507263 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3203/6233] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:55 2022] GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae => generated 1374 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:55:55.513257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cba7838a-eda3-4afd-9c12-cfffeb9e9169 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:55.514159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cba7838a-eda3-4afd-9c12-cfffeb9e9169 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: e1620135-b28b-4695-8abf-cbf46a5421d3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:55.521039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cba7838a-eda3-4afd-9c12-cfffeb9e9169 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:55.522109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cba7838a-eda3-4afd-9c12-cfffeb9e9169 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:55.522736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cba7838a-eda3-4afd-9c12-cfffeb9e9169 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:55.525512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cba7838a-eda3-4afd-9c12-cfffeb9e9169 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:55.527015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cba7838a-eda3-4afd-9c12-cfffeb9e9169 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:55.527617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cba7838a-eda3-4afd-9c12-cfffeb9e9169 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:55.549808 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-cba7838a-eda3-4afd-9c12-cfffeb9e9169 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] HTTP exception thrown: Instance e1620135-b28b-4695-8abf-cbf46a5421d3 could not be found. Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cba7838a-eda3-4afd-9c12-cfffeb9e9169 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Request method failure captured: Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 HTTP/1.1 Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRK-BB4x4tnje8g7V7yndZ-eCfyvwZsAbSuBD8sfr6-xUWiLbFDaunp7PR2T5QmNvvFy5RcKeKPLvsd2T_42GBJZpMrvANis61xLfLWHDewFuoiaKXb-VOoVnXShsE7RvrF0WakEav91aLufkTYJLnPujB4bORnh17YSIuys0bjxdSkA Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: fce4582b30d041c592240d09a95a37e5 Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-704048199 Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fce4582b30d041c592240d09a95a37e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fce4582b30d041c592240d09a95a37e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fce4582b30d041c592240d09a95a37e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fce4582b30d041c592240d09a95a37e5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestNetworkAdvancedServerOps-704048199 Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: fce4582b30d041c592240d09a95a37e5 Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-704048199 Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestNetworkAdvancedServerOps-704048199-project Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: ce22396752cd4d71991c6994a31f4905 Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestNetworkAdvancedServerOps-704048199-project Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance e1620135-b28b-4695-8abf-cbf46a5421d3 could not be found. Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'e1620135-b28b-4695-8abf-cbf46a5421d3'} Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1620135-b28b-4695-8abf-cbf46a5421d3 could not be found. Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1620135-b28b-4695-8abf-cbf46a5421d3 could not be found. Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:55:55.552162 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:55:55.556425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:55:55.556425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:55:55.556425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:55:55.556425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:55:55.556425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:55:55.556425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:55:55.556425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1620135-b28b-4695-8abf-cbf46a5421d3 could not be found. Oct 10 23:55:55.556425 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:55:55.558007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cba7838a-eda3-4afd-9c12-cfffeb9e9169 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Returning 404 to user: Instance e1620135-b28b-4695-8abf-cbf46a5421d3 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:55:55.559045 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cba7838a-eda3-4afd-9c12-cfffeb9e9169 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3" status: 404 len: 111 microversion: 2.1 time: 0.050010 Oct 10 23:55:55.559931 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3204/6234] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:55 2022] GET /compute/v2.1/servers/e1620135-b28b-4695-8abf-cbf46a5421d3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:55:55.692260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5158d2e7-dac9-499c-9c38-31c145a8405e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:55.700829 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5158d2e7-dac9-499c-9c38-31c145a8405e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46" status: 200 len: 1680 microversion: 2.1 time: 0.305109 Oct 10 23:55:55.701973 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3031/6235] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:55 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 => generated 1680 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:55.732456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-7d578d31-7e5e-4135-875d-089412a3eab2 req-df9f3e73-f1da-465f-af2b-0f112769a3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ab3eb3-f415-415b-9026-41a1befefdae", "tag": "d8c517ee-4780-48a1-8112-33199393f494"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:55:55.751881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7d578d31-7e5e-4135-875d-089412a3eab2 req-df9f3e73-f1da-465f-af2b-0f112769a3e4 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:55.757009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7d578d31-7e5e-4135-875d-089412a3eab2 req-df9f3e73-f1da-465f-af2b-0f112769a3e4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:55.757706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7d578d31-7e5e-4135-875d-089412a3eab2 req-df9f3e73-f1da-465f-af2b-0f112769a3e4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:55.788158 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-7d578d31-7e5e-4135-875d-089412a3eab2 req-df9f3e73-f1da-465f-af2b-0f112769a3e4 service nova] Creating event network-changed:d8c517ee-4780-48a1-8112-33199393f494 for instance a2ab3eb3-f415-415b-9026-41a1befefdae on n-h1-860864-2 Oct 10 23:55:55.803409 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-7d578d31-7e5e-4135-875d-089412a3eab2 req-df9f3e73-f1da-465f-af2b-0f112769a3e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074456 Oct 10 23:55:55.804581 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3205/6236] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:55:56.536421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-325b7537-df5b-470b-99fd-de61aed41135 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:56.537660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-325b7537-df5b-470b-99fd-de61aed41135 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: a2ab3eb3-f415-415b-9026-41a1befefdae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:56.544593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-325b7537-df5b-470b-99fd-de61aed41135 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:56.545329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-325b7537-df5b-470b-99fd-de61aed41135 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:56.545956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-325b7537-df5b-470b-99fd-de61aed41135 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:56.546934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-325b7537-df5b-470b-99fd-de61aed41135 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:56.547550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-325b7537-df5b-470b-99fd-de61aed41135 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:56.548132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-325b7537-df5b-470b-99fd-de61aed41135 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:56.728532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3537f518-73f4-49f4-9fc3-2d327b346445 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:56.729253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3537f518-73f4-49f4-9fc3-2d327b346445 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:56.742151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3537f518-73f4-49f4-9fc3-2d327b346445 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:56.745221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3537f518-73f4-49f4-9fc3-2d327b346445 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:56.745867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3537f518-73f4-49f4-9fc3-2d327b346445 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:56.747393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3537f518-73f4-49f4-9fc3-2d327b346445 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:56.749017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3537f518-73f4-49f4-9fc3-2d327b346445 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:56.752306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3537f518-73f4-49f4-9fc3-2d327b346445 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:56.770465 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-325b7537-df5b-470b-99fd-de61aed41135 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:56.778958 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-325b7537-df5b-470b-99fd-de61aed41135 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae" status: 200 len: 1374 microversion: 2.1 time: 0.246511 Oct 10 23:55:56.782817 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3032/6237] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:56 2022] GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae => generated 1374 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:57.070462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3537f518-73f4-49f4-9fc3-2d327b346445 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:57.087002 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3537f518-73f4-49f4-9fc3-2d327b346445 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46" status: 200 len: 1680 microversion: 2.1 time: 0.363019 Oct 10 23:55:57.088324 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3206/6238] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:56 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 => generated 1680 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:55:57.809425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-48070c85-cd6e-4cb0-ac06-e475d90bf1e7 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:57.811603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-48070c85-cd6e-4cb0-ac06-e475d90bf1e7 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: a2ab3eb3-f415-415b-9026-41a1befefdae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:57.829574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48070c85-cd6e-4cb0-ac06-e475d90bf1e7 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:57.847081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48070c85-cd6e-4cb0-ac06-e475d90bf1e7 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:57.847752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48070c85-cd6e-4cb0-ac06-e475d90bf1e7 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:57.849345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48070c85-cd6e-4cb0-ac06-e475d90bf1e7 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:57.853057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48070c85-cd6e-4cb0-ac06-e475d90bf1e7 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:57.853946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48070c85-cd6e-4cb0-ac06-e475d90bf1e7 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:58.111687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cb70b2d1-bdb7-48a5-bcb6-345402085fd3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:58.112412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cb70b2d1-bdb7-48a5-bcb6-345402085fd3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:58.124220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:55:58.130326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb70b2d1-bdb7-48a5-bcb6-345402085fd3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:58.138204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb70b2d1-bdb7-48a5-bcb6-345402085fd3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:58.139086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb70b2d1-bdb7-48a5-bcb6-345402085fd3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:58.140278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb70b2d1-bdb7-48a5-bcb6-345402085fd3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:58.141774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb70b2d1-bdb7-48a5-bcb6-345402085fd3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:58.142415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb70b2d1-bdb7-48a5-bcb6-345402085fd3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:58.154419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-48070c85-cd6e-4cb0-ac06-e475d90bf1e7 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:58.174069 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-48070c85-cd6e-4cb0-ac06-e475d90bf1e7 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae" status: 200 len: 1374 microversion: 2.1 time: 0.369483 Oct 10 23:55:58.185265 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3033/6239] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:57 2022] GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae => generated 1374 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:58.455440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cb70b2d1-bdb7-48a5-bcb6-345402085fd3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:58.463692 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cb70b2d1-bdb7-48a5-bcb6-345402085fd3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46" status: 200 len: 1680 microversion: 2.1 time: 0.356249 Oct 10 23:55:58.464290 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3207/6240] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:58 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 => generated 1680 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:59.205117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9bbf02e5-5426-4f69-aa87-001b15bfc5d5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:59.206698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9bbf02e5-5426-4f69-aa87-001b15bfc5d5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: a2ab3eb3-f415-415b-9026-41a1befefdae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:59.230551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bbf02e5-5426-4f69-aa87-001b15bfc5d5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:59.231070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bbf02e5-5426-4f69-aa87-001b15bfc5d5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:59.231603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bbf02e5-5426-4f69-aa87-001b15bfc5d5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:59.232291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bbf02e5-5426-4f69-aa87-001b15bfc5d5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:59.242270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bbf02e5-5426-4f69-aa87-001b15bfc5d5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:59.242450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-7747d37b-572e-416c-830a-aa9c865f3acb req-a6f7785c-70e4-4d95-ac7b-6034e1c56ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c7187f-8a0e-4319-8ec2-245aa1357f46", "name": "network-vif-deleted", "tag": "a1a3a67e-c0c9-4fd7-8506-921dcf10af0a"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:55:59.243221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9bbf02e5-5426-4f69-aa87-001b15bfc5d5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:59.256086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7747d37b-572e-416c-830a-aa9c865f3acb req-a6f7785c-70e4-4d95-ac7b-6034e1c56ca8 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:59.256866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7747d37b-572e-416c-830a-aa9c865f3acb req-a6f7785c-70e4-4d95-ac7b-6034e1c56ca8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:59.257436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7747d37b-572e-416c-830a-aa9c865f3acb req-a6f7785c-70e4-4d95-ac7b-6034e1c56ca8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:59.283673 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-7747d37b-572e-416c-830a-aa9c865f3acb req-a6f7785c-70e4-4d95-ac7b-6034e1c56ca8 service nova] Creating event network-vif-deleted:a1a3a67e-c0c9-4fd7-8506-921dcf10af0a for instance 38c7187f-8a0e-4319-8ec2-245aa1357f46 on n-h1-860864-2 Oct 10 23:55:59.298090 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-7747d37b-572e-416c-830a-aa9c865f3acb req-a6f7785c-70e4-4d95-ac7b-6034e1c56ca8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064686 Oct 10 23:55:59.302059 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3208/6241] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:55:59.493775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b3128600-e448-4055-b09f-96a92311aff8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:55:59.495308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b3128600-e448-4055-b09f-96a92311aff8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:55:59.511359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3128600-e448-4055-b09f-96a92311aff8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:59.512237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3128600-e448-4055-b09f-96a92311aff8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:59.513209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3128600-e448-4055-b09f-96a92311aff8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:59.515997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3128600-e448-4055-b09f-96a92311aff8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:55:59.517240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3128600-e448-4055-b09f-96a92311aff8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:55:59.517948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3128600-e448-4055-b09f-96a92311aff8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:55:59.539833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:55:59.555375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9bbf02e5-5426-4f69-aa87-001b15bfc5d5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:59.567852 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9bbf02e5-5426-4f69-aa87-001b15bfc5d5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae" status: 200 len: 1374 microversion: 2.1 time: 0.368340 Oct 10 23:55:59.575645 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3034/6242] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:59 2022] GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae => generated 1374 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:55:59.639663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b3128600-e448-4055-b09f-96a92311aff8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:55:59.662787 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b3128600-e448-4055-b09f-96a92311aff8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46" status: 200 len: 1612 microversion: 2.1 time: 0.174163 Oct 10 23:55:59.677620 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3209/6243] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:55:59 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 => generated 1612 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:00.606396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-640972ef-9117-4d3a-9c63-b88d76b2bae5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:00.607985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-640972ef-9117-4d3a-9c63-b88d76b2bae5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: a2ab3eb3-f415-415b-9026-41a1befefdae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:00.630431 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-640972ef-9117-4d3a-9c63-b88d76b2bae5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:00.631340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-640972ef-9117-4d3a-9c63-b88d76b2bae5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:00.631967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-640972ef-9117-4d3a-9c63-b88d76b2bae5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:00.633071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-640972ef-9117-4d3a-9c63-b88d76b2bae5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:00.636175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-640972ef-9117-4d3a-9c63-b88d76b2bae5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:00.636427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-640972ef-9117-4d3a-9c63-b88d76b2bae5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:00.689598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-88aaa1a2-4594-47ce-a0b1-16b71fd6921b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:00.690251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-88aaa1a2-4594-47ce-a0b1-16b71fd6921b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:00.703399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88aaa1a2-4594-47ce-a0b1-16b71fd6921b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:00.703907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88aaa1a2-4594-47ce-a0b1-16b71fd6921b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:00.704606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88aaa1a2-4594-47ce-a0b1-16b71fd6921b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:00.714457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88aaa1a2-4594-47ce-a0b1-16b71fd6921b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:00.715053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88aaa1a2-4594-47ce-a0b1-16b71fd6921b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:00.720250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88aaa1a2-4594-47ce-a0b1-16b71fd6921b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:00.791839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88aaa1a2-4594-47ce-a0b1-16b71fd6921b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:00.792578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88aaa1a2-4594-47ce-a0b1-16b71fd6921b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:00.793200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88aaa1a2-4594-47ce-a0b1-16b71fd6921b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:00.809864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-88aaa1a2-4594-47ce-a0b1-16b71fd6921b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lazy-loading 'fault' on Instance uuid 38c7187f-8a0e-4319-8ec2-245aa1357f46 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:56:00.939125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-88aaa1a2-4594-47ce-a0b1-16b71fd6921b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:00.953577 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-88aaa1a2-4594-47ce-a0b1-16b71fd6921b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46" status: 200 len: 1331 microversion: 2.1 time: 0.266463 Oct 10 23:56:00.954512 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3210/6244] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:00 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 => generated 1331 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:01.321759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-640972ef-9117-4d3a-9c63-b88d76b2bae5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:01.321759 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-640972ef-9117-4d3a-9c63-b88d76b2bae5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae" status: 200 len: 1374 microversion: 2.1 time: 0.720909 Oct 10 23:56:01.322046 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3035/6245] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:00 2022] GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae => generated 1374 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:01.880415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6ed2d349-2231-490a-ac35-b5ffa84b57ca tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '.version_select at 0x7f6633b73430>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:01.905394 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6ed2d349-2231-490a-ac35-b5ffa84b57ca tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-229235599" status: 202 len: 0 microversion: 2.1 time: 0.029099 Oct 10 23:56:01.906986 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3211/6246] 10.222.0.23 () {58 vars in 1281 bytes} [Mon Oct 10 23:56:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-229235599 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:56:01.963686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-60161681-7349-494c-b2b0-907f9f25b822 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Action: 'create', calling method: .version_select at 0x7f662a31a700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2070336881", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZvBkEfd9o1EJoQI5XGBcMewP53QibgN8fupV7DNMPlTU68WLP2276iFgceE3L/yGaY89euIF44Q85GT2BjzBAu1xmbODR3ocEKzoEoXQP96jbRJIeHmXgOpIoTf/vSVg=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:56:01.974214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:56:01.976021 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=8 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:56:01.982433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5fbb3a31-7617-4077-8472-377a3fa9916f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:01.983064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5fbb3a31-7617-4077-8472-377a3fa9916f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:01.996405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fbb3a31-7617-4077-8472-377a3fa9916f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:01.997039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fbb3a31-7617-4077-8472-377a3fa9916f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:01.997606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fbb3a31-7617-4077-8472-377a3fa9916f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:01.998534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fbb3a31-7617-4077-8472-377a3fa9916f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:01.999309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fbb3a31-7617-4077-8472-377a3fa9916f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:02.000469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fbb3a31-7617-4077-8472-377a3fa9916f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:02.008827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-60161681-7349-494c-b2b0-907f9f25b822 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Getting quotas for project fce4582b30d041c592240d09a95a37e5. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:56:02.016897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-60161681-7349-494c-b2b0-907f9f25b822 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Getting quotas for user ce22396752cd4d71991c6994a31f4905 and project fce4582b30d041c592240d09a95a37e5. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:56:02.017492 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-5fbb3a31-7617-4077-8472-377a3fa9916f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] HTTP exception thrown: Instance 38c7187f-8a0e-4319-8ec2-245aa1357f46 could not be found. Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5fbb3a31-7617-4077-8472-377a3fa9916f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Request method failure captured: Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 HTTP/1.1 Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLBDAPlCX48YdEI_BZ56dd4NDqrF57jWSGWCNxNuvLmDVrys2ONyIxdRThQ39af5CDKFGrOPcPgopPvUqIoMURbU5-dQOyalOKZCOKYa5dePf9jQ4W3BnwA1ZRfPtasJlQSUVtB1nnR57fubblxeL4KqCwX3PMAeSV4rzGda9sHJhlU Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0fcaa1fb124e448b8bacb6353fca9d5d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: b7008c9b5ad94dbea7edc12267dae2b5 Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 38c7187f-8a0e-4319-8ec2-245aa1357f46 could not be found. Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '38c7187f-8a0e-4319-8ec2-245aa1357f46'} Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c7187f-8a0e-4319-8ec2-245aa1357f46 could not be found. Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c7187f-8a0e-4319-8ec2-245aa1357f46 could not be found. Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:56:02.019242 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:56:02.023508 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:56:02.023508 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:56:02.023508 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:56:02.023508 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:56:02.023508 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:56:02.023508 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c7187f-8a0e-4319-8ec2-245aa1357f46 could not be found. Oct 10 23:56:02.023508 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:56:02.023508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5fbb3a31-7617-4077-8472-377a3fa9916f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Returning 404 to user: Instance 38c7187f-8a0e-4319-8ec2-245aa1357f46 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:56:02.023508 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5fbb3a31-7617-4077-8472-377a3fa9916f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46" status: 404 len: 111 microversion: 2.1 time: 0.047395 Oct 10 23:56:02.025562 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3212/6247] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:01 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:56:02.038753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1b7bd7df-6984-42e5-9590-e938c0c8f365 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '.version_select at 0x7f6633a21a60>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:02.053528 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-60161681-7349-494c-b2b0-907f9f25b822 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.108287 Oct 10 23:56:02.054827 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3036/6248] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:56:01 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:56:02.069986 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1b7bd7df-6984-42e5-9590-e938c0c8f365 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110227326" status: 202 len: 0 microversion: 2.1 time: 0.035588 Oct 10 23:56:02.071012 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3213/6249] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 10 23:56:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110227326 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:56:02.344851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-17011879-6451-4448-81b1-a6d6a19ce9c1 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:02.345524 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-17011879-6451-4448-81b1-a6d6a19ce9c1 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: a2ab3eb3-f415-415b-9026-41a1befefdae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:02.352063 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17011879-6451-4448-81b1-a6d6a19ce9c1 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:02.352555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17011879-6451-4448-81b1-a6d6a19ce9c1 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:02.352991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17011879-6451-4448-81b1-a6d6a19ce9c1 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:02.353726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17011879-6451-4448-81b1-a6d6a19ce9c1 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:02.354182 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17011879-6451-4448-81b1-a6d6a19ce9c1 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:02.354610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-17011879-6451-4448-81b1-a6d6a19ce9c1 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:02.580094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-3721a18f-6843-4c0d-8ab8-8fb1105b93a0 req-99736bf1-bfe2-4e37-a827-b22c4c1bdc9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ab3eb3-f415-415b-9026-41a1befefdae", "name": "network-vif-plugged", "status": "completed", "tag": "d8c517ee-4780-48a1-8112-33199393f494"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:56:02.592338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3721a18f-6843-4c0d-8ab8-8fb1105b93a0 req-99736bf1-bfe2-4e37-a827-b22c4c1bdc9b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:02.592935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3721a18f-6843-4c0d-8ab8-8fb1105b93a0 req-99736bf1-bfe2-4e37-a827-b22c4c1bdc9b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:02.594075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3721a18f-6843-4c0d-8ab8-8fb1105b93a0 req-99736bf1-bfe2-4e37-a827-b22c4c1bdc9b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:02.606212 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-3721a18f-6843-4c0d-8ab8-8fb1105b93a0 req-99736bf1-bfe2-4e37-a827-b22c4c1bdc9b service nova] Creating event network-vif-plugged:d8c517ee-4780-48a1-8112-33199393f494 for instance a2ab3eb3-f415-415b-9026-41a1befefdae on n-h1-860864-2 Oct 10 23:56:02.611868 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-3721a18f-6843-4c0d-8ab8-8fb1105b93a0 req-99736bf1-bfe2-4e37-a827-b22c4c1bdc9b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035749 Oct 10 23:56:02.612711 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3214/6250] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:56:02.695684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-17011879-6451-4448-81b1-a6d6a19ce9c1 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:02.710069 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-17011879-6451-4448-81b1-a6d6a19ce9c1 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae" status: 200 len: 1374 microversion: 2.1 time: 0.369690 Oct 10 23:56:02.711419 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3037/6251] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:02 2022] GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae => generated 1374 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:03.173521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c81e44e6-3e56-4af3-b2ea-30671bf94774 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Action: 'create', calling method: .version_select at 0x7f6633a06af0>, body: {"keypair": {"name": "tempest-keypair-1019538048", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2pIuCcrNtIrAJwOqw243FWUGsFY071Q8YVlEaNx0UMlxYLIQXbdN7YKT/guLOa7Xu9zNGL1UYBHgGVMElDlLciBz73aMCoCauQAMJCfJWHZUE3V2Ygm0HIiXfhN+PcoQ=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:56:03.217737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-c81e44e6-3e56-4af3-b2ea-30671bf94774 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Getting quotas for project 0fcaa1fb124e448b8bacb6353fca9d5d. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:56:03.225789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-c81e44e6-3e56-4af3-b2ea-30671bf94774 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Getting quotas for user b7008c9b5ad94dbea7edc12267dae2b5 and project 0fcaa1fb124e448b8bacb6353fca9d5d. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:56:03.286023 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c81e44e6-3e56-4af3-b2ea-30671bf94774 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118288 Oct 10 23:56:03.287389 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3215/6252] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:56:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:56:03.742619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cae4f174-f451-40db-bc36-6d9251f13e34 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:03.744253 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cae4f174-f451-40db-bc36-6d9251f13e34 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: a2ab3eb3-f415-415b-9026-41a1befefdae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:03.772041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cae4f174-f451-40db-bc36-6d9251f13e34 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:03.772566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cae4f174-f451-40db-bc36-6d9251f13e34 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:03.773028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cae4f174-f451-40db-bc36-6d9251f13e34 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:03.777259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cae4f174-f451-40db-bc36-6d9251f13e34 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:03.778079 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cae4f174-f451-40db-bc36-6d9251f13e34 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:03.778689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cae4f174-f451-40db-bc36-6d9251f13e34 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:04.055647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cae4f174-f451-40db-bc36-6d9251f13e34 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:04.067010 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cae4f174-f451-40db-bc36-6d9251f13e34 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae" status: 200 len: 1374 microversion: 2.1 time: 0.333421 Oct 10 23:56:04.068015 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3038/6253] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:03 2022] GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae => generated 1374 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:05.093176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9175fd6f-eb0c-48b3-a3d7-e58750e20627 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:05.094390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9175fd6f-eb0c-48b3-a3d7-e58750e20627 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: a2ab3eb3-f415-415b-9026-41a1befefdae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:05.106675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9175fd6f-eb0c-48b3-a3d7-e58750e20627 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:05.111190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9175fd6f-eb0c-48b3-a3d7-e58750e20627 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:05.111910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9175fd6f-eb0c-48b3-a3d7-e58750e20627 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:05.112668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9175fd6f-eb0c-48b3-a3d7-e58750e20627 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:05.113416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9175fd6f-eb0c-48b3-a3d7-e58750e20627 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:05.113829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9175fd6f-eb0c-48b3-a3d7-e58750e20627 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:05.339905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9175fd6f-eb0c-48b3-a3d7-e58750e20627 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:05.349350 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9175fd6f-eb0c-48b3-a3d7-e58750e20627 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae" status: 200 len: 1547 microversion: 2.1 time: 0.261081 Oct 10 23:56:05.349970 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3216/6254] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:05 2022] GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae => generated 1547 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:05.372877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-496e9f0e-704a-46cd-896c-911b93e9d46c tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:05.373560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-496e9f0e-704a-46cd-896c-911b93e9d46c tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: a2ab3eb3-f415-415b-9026-41a1befefdae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:05.381070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-496e9f0e-704a-46cd-896c-911b93e9d46c tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:05.381674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-496e9f0e-704a-46cd-896c-911b93e9d46c tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:05.382180 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-496e9f0e-704a-46cd-896c-911b93e9d46c tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:05.383121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-496e9f0e-704a-46cd-896c-911b93e9d46c tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:05.383648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-496e9f0e-704a-46cd-896c-911b93e9d46c tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:05.384164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-496e9f0e-704a-46cd-896c-911b93e9d46c tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:05.580004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-496e9f0e-704a-46cd-896c-911b93e9d46c tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:05.590554 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-496e9f0e-704a-46cd-896c-911b93e9d46c tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae" status: 200 len: 1547 microversion: 2.1 time: 0.221559 Oct 10 23:56:05.591730 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3039/6255] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:05 2022] GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae => generated 1547 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:05.695360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5663c636-256b-4c04-8d88-7a5b3b1f925a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-745075093", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ab1ca05-35c0-4cfd-8d35-c70ce321d096"}], "security_groups": [{"name": "tempest-securitygroup--1400018571"}], "key_name": "tempest-keypair-1019538048", "user_data": "}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:56:05.899271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-5663c636-256b-4c04-8d88-7a5b3b1f925a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] validate_networks() for [('1ab1ca05-35c0-4cfd-8d35-c70ce321d096', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:56:06.728376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-5663c636-256b-4c04-8d88-7a5b3b1f925a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:56:06.729047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-5663c636-256b-4c04-8d88-7a5b3b1f925a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:56:06.729409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-5663c636-256b-4c04-8d88-7a5b3b1f925a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:56:06.729916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-5663c636-256b-4c04-8d88-7a5b3b1f925a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:56:06.730331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-5663c636-256b-4c04-8d88-7a5b3b1f925a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:56:06.751682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5663c636-256b-4c04-8d88-7a5b3b1f925a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:06.752517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5663c636-256b-4c04-8d88-7a5b3b1f925a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:06.753108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5663c636-256b-4c04-8d88-7a5b3b1f925a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:06.754362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5663c636-256b-4c04-8d88-7a5b3b1f925a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:06.757925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5663c636-256b-4c04-8d88-7a5b3b1f925a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:06.757925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5663c636-256b-4c04-8d88-7a5b3b1f925a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:06.811085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-5663c636-256b-4c04-8d88-7a5b3b1f925a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Getting quotas for project 0fcaa1fb124e448b8bacb6353fca9d5d. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:56:06.831097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-5663c636-256b-4c04-8d88-7a5b3b1f925a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Getting quotas for user b7008c9b5ad94dbea7edc12267dae2b5 and project 0fcaa1fb124e448b8bacb6353fca9d5d. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:56:06.867392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5663c636-256b-4c04-8d88-7a5b3b1f925a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:56:06.873664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5663c636-256b-4c04-8d88-7a5b3b1f925a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:56:07.027287 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5663c636-256b-4c04-8d88-7a5b3b1f925a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.325441 Oct 10 23:56:07.028651 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3217/6256] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:56:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 1339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:56:07.045285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7d8c4856-4346-44b2-bc78-6fbb827aa534 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:07.052178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7d8c4856-4346-44b2-bc78-6fbb827aa534 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:07.174500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7d8c4856-4346-44b2-bc78-6fbb827aa534 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:07.182752 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7d8c4856-4346-44b2-bc78-6fbb827aa534 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197" status: 200 len: 1241 microversion: 2.1 time: 0.145598 Oct 10 23:56:07.189481 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3040/6257] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:07 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197 => generated 1241 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:08.212135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1e2181d7-a511-47fd-ada6-a8a368cfd9d8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:08.212817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1e2181d7-a511-47fd-ada6-a8a368cfd9d8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:08.225253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e2181d7-a511-47fd-ada6-a8a368cfd9d8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:08.225799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e2181d7-a511-47fd-ada6-a8a368cfd9d8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:08.226248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e2181d7-a511-47fd-ada6-a8a368cfd9d8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:08.226969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e2181d7-a511-47fd-ada6-a8a368cfd9d8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:08.227429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e2181d7-a511-47fd-ada6-a8a368cfd9d8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:08.232051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1e2181d7-a511-47fd-ada6-a8a368cfd9d8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:08.442072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1e2181d7-a511-47fd-ada6-a8a368cfd9d8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:08.454946 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1e2181d7-a511-47fd-ada6-a8a368cfd9d8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197" status: 200 len: 1237 microversion: 2.1 time: 0.245139 Oct 10 23:56:08.455755 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3218/6258] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:08 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197 => generated 1237 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:09.484297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-56035041-3551-4063-b5a3-1556eab4b0cf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:09.485814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-56035041-3551-4063-b5a3-1556eab4b0cf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:09.504200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56035041-3551-4063-b5a3-1556eab4b0cf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:09.510193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56035041-3551-4063-b5a3-1556eab4b0cf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:09.510884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56035041-3551-4063-b5a3-1556eab4b0cf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:09.513916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56035041-3551-4063-b5a3-1556eab4b0cf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:09.514573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56035041-3551-4063-b5a3-1556eab4b0cf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:09.515167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56035041-3551-4063-b5a3-1556eab4b0cf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:09.803860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-56035041-3551-4063-b5a3-1556eab4b0cf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:09.818761 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-56035041-3551-4063-b5a3-1556eab4b0cf tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197" status: 200 len: 1299 microversion: 2.1 time: 0.338372 Oct 10 23:56:09.834232 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3041/6259] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:09 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197 => generated 1299 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:10.849240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-342b1ff0-f160-4347-bbd0-1a4e3a01cae5 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:10.850879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-342b1ff0-f160-4347-bbd0-1a4e3a01cae5 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:10.866768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-475c76e8-cbfe-4678-aa9d-295344442e4a req-a24beb7a-f85f-4f9b-a639-4643fba497a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ab3eb3-f415-415b-9026-41a1befefdae", "tag": "d8c517ee-4780-48a1-8112-33199393f494"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:56:10.882997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-342b1ff0-f160-4347-bbd0-1a4e3a01cae5 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:10.883507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-342b1ff0-f160-4347-bbd0-1a4e3a01cae5 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:10.883955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-342b1ff0-f160-4347-bbd0-1a4e3a01cae5 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:10.884677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-342b1ff0-f160-4347-bbd0-1a4e3a01cae5 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:10.885137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-342b1ff0-f160-4347-bbd0-1a4e3a01cae5 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:10.896423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-475c76e8-cbfe-4678-aa9d-295344442e4a req-a24beb7a-f85f-4f9b-a639-4643fba497a6 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:10.899982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-342b1ff0-f160-4347-bbd0-1a4e3a01cae5 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:10.909360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-475c76e8-cbfe-4678-aa9d-295344442e4a req-a24beb7a-f85f-4f9b-a639-4643fba497a6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:10.909846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-475c76e8-cbfe-4678-aa9d-295344442e4a req-a24beb7a-f85f-4f9b-a639-4643fba497a6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:10.961870 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-475c76e8-cbfe-4678-aa9d-295344442e4a req-a24beb7a-f85f-4f9b-a639-4643fba497a6 service nova] Creating event network-changed:d8c517ee-4780-48a1-8112-33199393f494 for instance a2ab3eb3-f415-415b-9026-41a1befefdae on n-h1-860864-2 Oct 10 23:56:10.989825 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-475c76e8-cbfe-4678-aa9d-295344442e4a req-a24beb7a-f85f-4f9b-a639-4643fba497a6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125086 Oct 10 23:56:10.990659 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3042/6260] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:56:11.317269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-342b1ff0-f160-4347-bbd0-1a4e3a01cae5 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:11.337424 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-342b1ff0-f160-4347-bbd0-1a4e3a01cae5 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197" status: 200 len: 1299 microversion: 2.1 time: 0.492512 Oct 10 23:56:11.340930 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3219/6261] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:10 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197 => generated 1299 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:12.371952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-45765b63-8a53-4130-a9f8-1811267d0b25 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:12.372951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-45765b63-8a53-4130-a9f8-1811267d0b25 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:12.392310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45765b63-8a53-4130-a9f8-1811267d0b25 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:12.393394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45765b63-8a53-4130-a9f8-1811267d0b25 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:12.394122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45765b63-8a53-4130-a9f8-1811267d0b25 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:12.408487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45765b63-8a53-4130-a9f8-1811267d0b25 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:12.415171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45765b63-8a53-4130-a9f8-1811267d0b25 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:12.416077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-45765b63-8a53-4130-a9f8-1811267d0b25 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:13.234357 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-45765b63-8a53-4130-a9f8-1811267d0b25 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:13.238219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:56:13.274293 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-45765b63-8a53-4130-a9f8-1811267d0b25 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197" status: 200 len: 1367 microversion: 2.1 time: 0.910308 Oct 10 23:56:13.292320 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3043/6262] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:12 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197 => generated 1367 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:14.310031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c2188e7b-7eda-49d8-aa25-636fd63a03ae tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:14.312850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c2188e7b-7eda-49d8-aa25-636fd63a03ae tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:14.341593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:56:14.350445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2188e7b-7eda-49d8-aa25-636fd63a03ae tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:14.352566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2188e7b-7eda-49d8-aa25-636fd63a03ae tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:14.356805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2188e7b-7eda-49d8-aa25-636fd63a03ae tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:14.357880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2188e7b-7eda-49d8-aa25-636fd63a03ae tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:14.358608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2188e7b-7eda-49d8-aa25-636fd63a03ae tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:14.360565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2188e7b-7eda-49d8-aa25-636fd63a03ae tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:15.118120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-947774bb-125c-4caa-9204-a5ccd86d443f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1370494076", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "e75abf67-c5dc-4881-a0b6-29378de743a6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2070336881", "security_groups": [{"name": "tempest-secgroup-smoke-105035443"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:56:15.237444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c2188e7b-7eda-49d8-aa25-636fd63a03ae tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:15.248426 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c2188e7b-7eda-49d8-aa25-636fd63a03ae tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197" status: 200 len: 1367 microversion: 2.1 time: 0.943930 Oct 10 23:56:15.249034 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3220/6263] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:14 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197 => generated 1367 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:15.460605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-947774bb-125c-4caa-9204-a5ccd86d443f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] validate_networks() for [('e75abf67-c5dc-4881-a0b6-29378de743a6', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:56:15.984733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-7efd02e3-620c-48c4-8873-380201fe938b req-2840cdd9-2dca-47f1-a1c3-1bfe4ed82b54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcca65a1-5074-42ee-bbe9-d6ac334af197", "tag": "5c7f8b1b-d48b-4a94-8319-e37fe69b4e8a"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:56:16.028941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7efd02e3-620c-48c4-8873-380201fe938b req-2840cdd9-2dca-47f1-a1c3-1bfe4ed82b54 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:16.031869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7efd02e3-620c-48c4-8873-380201fe938b req-2840cdd9-2dca-47f1-a1c3-1bfe4ed82b54 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:16.033197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7efd02e3-620c-48c4-8873-380201fe938b req-2840cdd9-2dca-47f1-a1c3-1bfe4ed82b54 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:16.063913 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-7efd02e3-620c-48c4-8873-380201fe938b req-2840cdd9-2dca-47f1-a1c3-1bfe4ed82b54 service nova] Creating event network-changed:5c7f8b1b-d48b-4a94-8319-e37fe69b4e8a for instance bcca65a1-5074-42ee-bbe9-d6ac334af197 on n-h2-860864-2 Oct 10 23:56:16.079810 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-7efd02e3-620c-48c4-8873-380201fe938b req-2840cdd9-2dca-47f1-a1c3-1bfe4ed82b54 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099581 Oct 10 23:56:16.080624 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3221/6264] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:56:16.204332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-947774bb-125c-4caa-9204-a5ccd86d443f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:56:16.205782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-947774bb-125c-4caa-9204-a5ccd86d443f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:56:16.206721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-947774bb-125c-4caa-9204-a5ccd86d443f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:56:16.207286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-947774bb-125c-4caa-9204-a5ccd86d443f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:56:16.207849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-947774bb-125c-4caa-9204-a5ccd86d443f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:56:16.226482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-947774bb-125c-4caa-9204-a5ccd86d443f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:16.227345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-947774bb-125c-4caa-9204-a5ccd86d443f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:16.229806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-947774bb-125c-4caa-9204-a5ccd86d443f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:16.231195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-947774bb-125c-4caa-9204-a5ccd86d443f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:16.231984 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-947774bb-125c-4caa-9204-a5ccd86d443f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:16.236502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-947774bb-125c-4caa-9204-a5ccd86d443f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:16.277718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5acbed37-9b8f-4f94-9f59-9332bcc24df1 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:16.278816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5acbed37-9b8f-4f94-9f59-9332bcc24df1 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:16.286789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5acbed37-9b8f-4f94-9f59-9332bcc24df1 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:16.287676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5acbed37-9b8f-4f94-9f59-9332bcc24df1 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:16.288358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5acbed37-9b8f-4f94-9f59-9332bcc24df1 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:16.289302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5acbed37-9b8f-4f94-9f59-9332bcc24df1 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:16.289816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-947774bb-125c-4caa-9204-a5ccd86d443f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Getting quotas for project fce4582b30d041c592240d09a95a37e5. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:56:16.290247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5acbed37-9b8f-4f94-9f59-9332bcc24df1 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:16.291602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5acbed37-9b8f-4f94-9f59-9332bcc24df1 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:16.303792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-947774bb-125c-4caa-9204-a5ccd86d443f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Getting quotas for user ce22396752cd4d71991c6994a31f4905 and project fce4582b30d041c592240d09a95a37e5. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:56:16.341144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-947774bb-125c-4caa-9204-a5ccd86d443f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:56:16.349670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-947774bb-125c-4caa-9204-a5ccd86d443f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:56:16.462466 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-947774bb-125c-4caa-9204-a5ccd86d443f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.346366 Oct 10 23:56:16.466160 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3044/6265] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:56:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 23:56:16.481830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2d685182-6034-46ce-831b-7ce369314625 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:16.483029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2d685182-6034-46ce-831b-7ce369314625 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:16.558098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2d685182-6034-46ce-831b-7ce369314625 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:16.576162 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2d685182-6034-46ce-831b-7ce369314625 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1267 microversion: 2.1 time: 0.103131 Oct 10 23:56:16.582211 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3045/6266] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:16 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1267 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:16.778995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:56:16.854101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=10 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:56:17.196438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5acbed37-9b8f-4f94-9f59-9332bcc24df1 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:17.214858 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5acbed37-9b8f-4f94-9f59-9332bcc24df1 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197" status: 200 len: 1367 microversion: 2.1 time: 0.941413 Oct 10 23:56:17.216601 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3222/6267] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:16 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197 => generated 1367 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:17.603708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8400f3f7-e41f-4054-9e62-d743fddb94e4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:17.604917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8400f3f7-e41f-4054-9e62-d743fddb94e4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:17.611858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:56:17.622153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8400f3f7-e41f-4054-9e62-d743fddb94e4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:17.622846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8400f3f7-e41f-4054-9e62-d743fddb94e4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:17.627946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8400f3f7-e41f-4054-9e62-d743fddb94e4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:17.630690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8400f3f7-e41f-4054-9e62-d743fddb94e4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:17.631178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8400f3f7-e41f-4054-9e62-d743fddb94e4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:17.634792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8400f3f7-e41f-4054-9e62-d743fddb94e4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:17.764768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8400f3f7-e41f-4054-9e62-d743fddb94e4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:17.773115 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8400f3f7-e41f-4054-9e62-d743fddb94e4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1263 microversion: 2.1 time: 0.173587 Oct 10 23:56:17.776773 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3046/6268] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:17 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1263 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:56:18.262230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a1971d07-d4c5-4f90-909f-bf5e40a28f2a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:18.263444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a1971d07-d4c5-4f90-909f-bf5e40a28f2a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:18.284178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1971d07-d4c5-4f90-909f-bf5e40a28f2a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:18.284915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1971d07-d4c5-4f90-909f-bf5e40a28f2a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:18.285531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1971d07-d4c5-4f90-909f-bf5e40a28f2a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:18.286542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1971d07-d4c5-4f90-909f-bf5e40a28f2a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:18.287193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1971d07-d4c5-4f90-909f-bf5e40a28f2a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:18.287777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1971d07-d4c5-4f90-909f-bf5e40a28f2a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:18.775144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a1971d07-d4c5-4f90-909f-bf5e40a28f2a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:18.786500 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a1971d07-d4c5-4f90-909f-bf5e40a28f2a tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197" status: 200 len: 1367 microversion: 2.1 time: 0.527750 Oct 10 23:56:18.788776 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3223/6269] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:18 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197 => generated 1367 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:18.832441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9c42bfff-1cc7-4c4f-908b-c722195c1758 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:18.833676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9c42bfff-1cc7-4c4f-908b-c722195c1758 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:18.860795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c42bfff-1cc7-4c4f-908b-c722195c1758 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:18.871783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c42bfff-1cc7-4c4f-908b-c722195c1758 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:18.872272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c42bfff-1cc7-4c4f-908b-c722195c1758 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:18.873887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c42bfff-1cc7-4c4f-908b-c722195c1758 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:18.881411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c42bfff-1cc7-4c4f-908b-c722195c1758 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:18.881411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c42bfff-1cc7-4c4f-908b-c722195c1758 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:19.042312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9c42bfff-1cc7-4c4f-908b-c722195c1758 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:19.072418 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9c42bfff-1cc7-4c4f-908b-c722195c1758 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1337 microversion: 2.1 time: 0.262929 Oct 10 23:56:19.079402 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3047/6270] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:18 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1337 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:19.833352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-47715f78-1c2f-48ad-8745-22cde6256720 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:19.834561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-47715f78-1c2f-48ad-8745-22cde6256720 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:19.852956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47715f78-1c2f-48ad-8745-22cde6256720 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:19.854978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47715f78-1c2f-48ad-8745-22cde6256720 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:19.857248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47715f78-1c2f-48ad-8745-22cde6256720 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:19.861023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47715f78-1c2f-48ad-8745-22cde6256720 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:19.864434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47715f78-1c2f-48ad-8745-22cde6256720 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:19.865127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47715f78-1c2f-48ad-8745-22cde6256720 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:20.103045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ec823a3e-18b1-40aa-9f7d-b17a6623d719 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:20.103615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ec823a3e-18b1-40aa-9f7d-b17a6623d719 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:20.131788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec823a3e-18b1-40aa-9f7d-b17a6623d719 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:20.138239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec823a3e-18b1-40aa-9f7d-b17a6623d719 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:20.138855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec823a3e-18b1-40aa-9f7d-b17a6623d719 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:20.144176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec823a3e-18b1-40aa-9f7d-b17a6623d719 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:20.144678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec823a3e-18b1-40aa-9f7d-b17a6623d719 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:20.150197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec823a3e-18b1-40aa-9f7d-b17a6623d719 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:20.534059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ec823a3e-18b1-40aa-9f7d-b17a6623d719 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:20.543297 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ec823a3e-18b1-40aa-9f7d-b17a6623d719 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1392 microversion: 2.1 time: 0.445118 Oct 10 23:56:20.544838 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3048/6271] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:20 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1392 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:20.901131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-47715f78-1c2f-48ad-8745-22cde6256720 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:20.918872 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-47715f78-1c2f-48ad-8745-22cde6256720 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197" status: 200 len: 1367 microversion: 2.1 time: 1.086135 Oct 10 23:56:20.921840 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3224/6272] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:19 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197 => generated 1367 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:21.585546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c2254f87-779d-4005-ab9b-24734ba2098b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:21.586900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c2254f87-779d-4005-ab9b-24734ba2098b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:21.614387 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2254f87-779d-4005-ab9b-24734ba2098b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:21.621295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2254f87-779d-4005-ab9b-24734ba2098b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:21.626832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2254f87-779d-4005-ab9b-24734ba2098b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:21.631161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2254f87-779d-4005-ab9b-24734ba2098b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:21.633318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2254f87-779d-4005-ab9b-24734ba2098b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:21.634313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2254f87-779d-4005-ab9b-24734ba2098b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:21.946335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ee2ee388-abf4-487d-b876-0c6a3b8e1df7 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:21.946957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ee2ee388-abf4-487d-b876-0c6a3b8e1df7 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:21.958740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee2ee388-abf4-487d-b876-0c6a3b8e1df7 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:21.962955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee2ee388-abf4-487d-b876-0c6a3b8e1df7 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:21.963587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee2ee388-abf4-487d-b876-0c6a3b8e1df7 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:21.964688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee2ee388-abf4-487d-b876-0c6a3b8e1df7 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:21.965314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee2ee388-abf4-487d-b876-0c6a3b8e1df7 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:21.967795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee2ee388-abf4-487d-b876-0c6a3b8e1df7 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:22.023333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c2254f87-779d-4005-ab9b-24734ba2098b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:22.036976 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c2254f87-779d-4005-ab9b-24734ba2098b tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1392 microversion: 2.1 time: 0.456366 Oct 10 23:56:22.049350 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3049/6273] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:21 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1392 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:22.420432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ee2ee388-abf4-487d-b876-0c6a3b8e1df7 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:22.429021 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ee2ee388-abf4-487d-b876-0c6a3b8e1df7 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197" status: 200 len: 1367 microversion: 2.1 time: 0.488232 Oct 10 23:56:22.434629 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3225/6274] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:21 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197 => generated 1367 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:22.501676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-fcc0d0bd-d0f1-4085-b47e-ef53091d0423 req-7ef03875-9849-429d-b541-c15c65deefb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcca65a1-5074-42ee-bbe9-d6ac334af197", "name": "network-vif-plugged", "status": "completed", "tag": "5c7f8b1b-d48b-4a94-8319-e37fe69b4e8a"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:56:22.549515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fcc0d0bd-d0f1-4085-b47e-ef53091d0423 req-7ef03875-9849-429d-b541-c15c65deefb8 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:22.550614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fcc0d0bd-d0f1-4085-b47e-ef53091d0423 req-7ef03875-9849-429d-b541-c15c65deefb8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:22.553444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-fcc0d0bd-d0f1-4085-b47e-ef53091d0423 req-7ef03875-9849-429d-b541-c15c65deefb8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:22.596983 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-fcc0d0bd-d0f1-4085-b47e-ef53091d0423 req-7ef03875-9849-429d-b541-c15c65deefb8 service nova] Creating event network-vif-plugged:5c7f8b1b-d48b-4a94-8319-e37fe69b4e8a for instance bcca65a1-5074-42ee-bbe9-d6ac334af197 on n-h2-860864-2 Oct 10 23:56:22.616555 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-fcc0d0bd-d0f1-4085-b47e-ef53091d0423 req-7ef03875-9849-429d-b541-c15c65deefb8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119523 Oct 10 23:56:22.622148 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3050/6275] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:56:22.783289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-0ad8bb2c-54ff-4885-a14e-1780bd662052 req-3f099ab4-6308-46df-83b2-42a66cd6c0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e8452c-1481-41ab-96c0-62b302343864", "tag": "cff1d37d-2601-472e-ad65-d6a7e2ef9ec9"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:56:22.816637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0ad8bb2c-54ff-4885-a14e-1780bd662052 req-3f099ab4-6308-46df-83b2-42a66cd6c0b8 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:22.825835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0ad8bb2c-54ff-4885-a14e-1780bd662052 req-3f099ab4-6308-46df-83b2-42a66cd6c0b8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:22.826521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0ad8bb2c-54ff-4885-a14e-1780bd662052 req-3f099ab4-6308-46df-83b2-42a66cd6c0b8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:22.855853 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-0ad8bb2c-54ff-4885-a14e-1780bd662052 req-3f099ab4-6308-46df-83b2-42a66cd6c0b8 service nova] Creating event network-changed:cff1d37d-2601-472e-ad65-d6a7e2ef9ec9 for instance d4e8452c-1481-41ab-96c0-62b302343864 on n-h1-860864-2 Oct 10 23:56:22.872020 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-0ad8bb2c-54ff-4885-a14e-1780bd662052 req-3f099ab4-6308-46df-83b2-42a66cd6c0b8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095529 Oct 10 23:56:22.872927 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3226/6276] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:56:23.078876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-05cefc26-99d8-476d-9ec6-ec4b0c2ee350 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:23.079778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-05cefc26-99d8-476d-9ec6-ec4b0c2ee350 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:23.092610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05cefc26-99d8-476d-9ec6-ec4b0c2ee350 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:23.101204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05cefc26-99d8-476d-9ec6-ec4b0c2ee350 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:23.101738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05cefc26-99d8-476d-9ec6-ec4b0c2ee350 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:23.102500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05cefc26-99d8-476d-9ec6-ec4b0c2ee350 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:23.103010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05cefc26-99d8-476d-9ec6-ec4b0c2ee350 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:23.103502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05cefc26-99d8-476d-9ec6-ec4b0c2ee350 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:23.324232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-05cefc26-99d8-476d-9ec6-ec4b0c2ee350 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:23.335866 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-05cefc26-99d8-476d-9ec6-ec4b0c2ee350 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1392 microversion: 2.1 time: 0.261807 Oct 10 23:56:23.351523 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3051/6277] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:23 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1392 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:23.456488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5707993a-72f0-461a-8db4-c72a81a7e58e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:23.457281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5707993a-72f0-461a-8db4-c72a81a7e58e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:23.463989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5707993a-72f0-461a-8db4-c72a81a7e58e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:23.464972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5707993a-72f0-461a-8db4-c72a81a7e58e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:23.466029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5707993a-72f0-461a-8db4-c72a81a7e58e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:23.467443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5707993a-72f0-461a-8db4-c72a81a7e58e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:23.468097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5707993a-72f0-461a-8db4-c72a81a7e58e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:23.468822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5707993a-72f0-461a-8db4-c72a81a7e58e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:23.630830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5707993a-72f0-461a-8db4-c72a81a7e58e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:23.639943 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5707993a-72f0-461a-8db4-c72a81a7e58e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197" status: 200 len: 1367 microversion: 2.1 time: 0.189219 Oct 10 23:56:23.654160 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3227/6278] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:23 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:24.360999 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-12fe02cc-ae96-4570-bc59-738c5a8a4ef1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:24.362506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-12fe02cc-ae96-4570-bc59-738c5a8a4ef1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:24.369872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12fe02cc-ae96-4570-bc59-738c5a8a4ef1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:24.370364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12fe02cc-ae96-4570-bc59-738c5a8a4ef1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:24.371266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12fe02cc-ae96-4570-bc59-738c5a8a4ef1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:24.372407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12fe02cc-ae96-4570-bc59-738c5a8a4ef1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:24.372923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12fe02cc-ae96-4570-bc59-738c5a8a4ef1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:24.373544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12fe02cc-ae96-4570-bc59-738c5a8a4ef1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:24.538318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-12fe02cc-ae96-4570-bc59-738c5a8a4ef1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:24.547727 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-12fe02cc-ae96-4570-bc59-738c5a8a4ef1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1392 microversion: 2.1 time: 0.190720 Oct 10 23:56:24.548699 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3052/6279] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:24 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1392 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:24.664295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cb4caa61-7e97-4513-8022-1ce117f21f74 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:24.664926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cb4caa61-7e97-4513-8022-1ce117f21f74 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:24.673078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb4caa61-7e97-4513-8022-1ce117f21f74 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:24.674865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb4caa61-7e97-4513-8022-1ce117f21f74 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:24.675445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb4caa61-7e97-4513-8022-1ce117f21f74 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:24.676402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb4caa61-7e97-4513-8022-1ce117f21f74 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:24.677155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb4caa61-7e97-4513-8022-1ce117f21f74 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:24.677957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb4caa61-7e97-4513-8022-1ce117f21f74 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:24.845027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cb4caa61-7e97-4513-8022-1ce117f21f74 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:24.856026 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cb4caa61-7e97-4513-8022-1ce117f21f74 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197" status: 200 len: 1556 microversion: 2.1 time: 0.195522 Oct 10 23:56:24.856785 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3228/6280] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:24 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197 => generated 1556 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:24.881570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-05eff882-bba0-4621-a20a-e4818c40a83b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:24.882275 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-05eff882-bba0-4621-a20a-e4818c40a83b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:24.889444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05eff882-bba0-4621-a20a-e4818c40a83b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:24.889939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05eff882-bba0-4621-a20a-e4818c40a83b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:24.890402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05eff882-bba0-4621-a20a-e4818c40a83b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:24.891459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05eff882-bba0-4621-a20a-e4818c40a83b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:24.893150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05eff882-bba0-4621-a20a-e4818c40a83b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:24.893150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05eff882-bba0-4621-a20a-e4818c40a83b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:24.979630 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-05eff882-bba0-4621-a20a-e4818c40a83b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101969 Oct 10 23:56:24.980232 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3053/6281] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Oct 10 23:56:24 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:56:25.572384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-703d1423-890c-4dc9-b701-24846d4ea9b8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:25.573085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-703d1423-890c-4dc9-b701-24846d4ea9b8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:25.594702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-703d1423-890c-4dc9-b701-24846d4ea9b8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:25.595207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-703d1423-890c-4dc9-b701-24846d4ea9b8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:25.595670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-703d1423-890c-4dc9-b701-24846d4ea9b8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:25.596650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-703d1423-890c-4dc9-b701-24846d4ea9b8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:25.597277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-703d1423-890c-4dc9-b701-24846d4ea9b8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:25.597744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-703d1423-890c-4dc9-b701-24846d4ea9b8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:25.840629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-703d1423-890c-4dc9-b701-24846d4ea9b8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:25.850247 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-703d1423-890c-4dc9-b701-24846d4ea9b8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1392 microversion: 2.1 time: 0.281716 Oct 10 23:56:25.851559 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3229/6282] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:25 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1392 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:26.800136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-e331bcce-be36-4a8d-bf6d-db7802224585 req-bef68a57-c33a-4d72-aecc-09ff1044e2d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcca65a1-5074-42ee-bbe9-d6ac334af197", "tag": "5c7f8b1b-d48b-4a94-8319-e37fe69b4e8a"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:56:26.816288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:56:26.821268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=14 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:56:26.855103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e331bcce-be36-4a8d-bf6d-db7802224585 req-bef68a57-c33a-4d72-aecc-09ff1044e2d4 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:26.856008 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e331bcce-be36-4a8d-bf6d-db7802224585 req-bef68a57-c33a-4d72-aecc-09ff1044e2d4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:26.857616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e331bcce-be36-4a8d-bf6d-db7802224585 req-bef68a57-c33a-4d72-aecc-09ff1044e2d4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:26.874659 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dcbe6105-76e7-4737-83f7-c9b002f4c987 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:26.876513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dcbe6105-76e7-4737-83f7-c9b002f4c987 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:26.892591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dcbe6105-76e7-4737-83f7-c9b002f4c987 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:26.898453 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dcbe6105-76e7-4737-83f7-c9b002f4c987 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:26.899059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dcbe6105-76e7-4737-83f7-c9b002f4c987 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:26.899889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dcbe6105-76e7-4737-83f7-c9b002f4c987 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:26.901089 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-e331bcce-be36-4a8d-bf6d-db7802224585 req-bef68a57-c33a-4d72-aecc-09ff1044e2d4 service nova] Creating event network-changed:5c7f8b1b-d48b-4a94-8319-e37fe69b4e8a for instance bcca65a1-5074-42ee-bbe9-d6ac334af197 on n-h2-860864-2 Oct 10 23:56:26.901736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dcbe6105-76e7-4737-83f7-c9b002f4c987 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:26.902260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dcbe6105-76e7-4737-83f7-c9b002f4c987 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:26.911127 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-e331bcce-be36-4a8d-bf6d-db7802224585 req-bef68a57-c33a-4d72-aecc-09ff1044e2d4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118472 Oct 10 23:56:26.913415 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3054/6283] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:56:27.237686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dcbe6105-76e7-4737-83f7-c9b002f4c987 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:27.252804 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dcbe6105-76e7-4737-83f7-c9b002f4c987 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1392 microversion: 2.1 time: 0.381854 Oct 10 23:56:27.272110 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3230/6284] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:26 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1392 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:56:28.286983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-16f62f38-1b45-46f2-8bf2-f2790a658dab tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:28.287940 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-16f62f38-1b45-46f2-8bf2-f2790a658dab tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:28.295471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16f62f38-1b45-46f2-8bf2-f2790a658dab tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:28.296384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16f62f38-1b45-46f2-8bf2-f2790a658dab tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:28.298462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16f62f38-1b45-46f2-8bf2-f2790a658dab tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:28.299674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16f62f38-1b45-46f2-8bf2-f2790a658dab tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:28.300371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16f62f38-1b45-46f2-8bf2-f2790a658dab tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:28.301057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16f62f38-1b45-46f2-8bf2-f2790a658dab tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:28.466723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-16f62f38-1b45-46f2-8bf2-f2790a658dab tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:28.475679 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-16f62f38-1b45-46f2-8bf2-f2790a658dab tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1392 microversion: 2.1 time: 0.195838 Oct 10 23:56:28.476387 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3055/6285] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:28 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1392 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:28.729267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-96ed07d8-a8fd-4bf7-bdc9-ad726d4441ba req-722afacb-7eda-40e0-a3e2-8981e826577d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e8452c-1481-41ab-96c0-62b302343864", "name": "network-vif-plugged", "status": "completed", "tag": "cff1d37d-2601-472e-ad65-d6a7e2ef9ec9"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:56:28.744034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-96ed07d8-a8fd-4bf7-bdc9-ad726d4441ba req-722afacb-7eda-40e0-a3e2-8981e826577d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:28.744787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-96ed07d8-a8fd-4bf7-bdc9-ad726d4441ba req-722afacb-7eda-40e0-a3e2-8981e826577d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:28.745390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-96ed07d8-a8fd-4bf7-bdc9-ad726d4441ba req-722afacb-7eda-40e0-a3e2-8981e826577d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:28.780156 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-96ed07d8-a8fd-4bf7-bdc9-ad726d4441ba req-722afacb-7eda-40e0-a3e2-8981e826577d service nova] Creating event network-vif-plugged:cff1d37d-2601-472e-ad65-d6a7e2ef9ec9 for instance d4e8452c-1481-41ab-96c0-62b302343864 on n-h1-860864-2 Oct 10 23:56:28.786551 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-96ed07d8-a8fd-4bf7-bdc9-ad726d4441ba req-722afacb-7eda-40e0-a3e2-8981e826577d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060865 Oct 10 23:56:28.787488 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3231/6286] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:56:29.500041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-24027683-95a3-432f-894b-c5178082b091 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:29.500715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-24027683-95a3-432f-894b-c5178082b091 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:29.508388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24027683-95a3-432f-894b-c5178082b091 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:29.508907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24027683-95a3-432f-894b-c5178082b091 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:29.509348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24027683-95a3-432f-894b-c5178082b091 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:29.510341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24027683-95a3-432f-894b-c5178082b091 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:29.510795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24027683-95a3-432f-894b-c5178082b091 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:29.511219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24027683-95a3-432f-894b-c5178082b091 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:29.655641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-24027683-95a3-432f-894b-c5178082b091 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:29.667900 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-24027683-95a3-432f-894b-c5178082b091 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1392 microversion: 2.1 time: 0.171914 Oct 10 23:56:29.681441 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3056/6287] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:29 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:56:30.695233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9040e0d7-17f6-4969-ae2a-db937199a6a4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:30.696624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9040e0d7-17f6-4969-ae2a-db937199a6a4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:30.707138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9040e0d7-17f6-4969-ae2a-db937199a6a4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:30.707504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9040e0d7-17f6-4969-ae2a-db937199a6a4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:30.707899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9040e0d7-17f6-4969-ae2a-db937199a6a4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:30.709022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9040e0d7-17f6-4969-ae2a-db937199a6a4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:30.710273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9040e0d7-17f6-4969-ae2a-db937199a6a4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:30.710940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9040e0d7-17f6-4969-ae2a-db937199a6a4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:30.720433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=95 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:56:30.897053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9040e0d7-17f6-4969-ae2a-db937199a6a4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:30.915852 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9040e0d7-17f6-4969-ae2a-db937199a6a4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1564 microversion: 2.1 time: 0.226110 Oct 10 23:56:30.921096 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3232/6288] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:30 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1564 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:30.945981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4ed1de07-b1cb-4aec-88ff-f68fa58ead25 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:30.948870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4ed1de07-b1cb-4aec-88ff-f68fa58ead25 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:30.959368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ed1de07-b1cb-4aec-88ff-f68fa58ead25 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:30.960313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ed1de07-b1cb-4aec-88ff-f68fa58ead25 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:30.960918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ed1de07-b1cb-4aec-88ff-f68fa58ead25 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:30.962132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ed1de07-b1cb-4aec-88ff-f68fa58ead25 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:30.962596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ed1de07-b1cb-4aec-88ff-f68fa58ead25 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:30.963025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ed1de07-b1cb-4aec-88ff-f68fa58ead25 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:31.135297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4ed1de07-b1cb-4aec-88ff-f68fa58ead25 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:31.148080 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4ed1de07-b1cb-4aec-88ff-f68fa58ead25 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1564 microversion: 2.1 time: 0.206231 Oct 10 23:56:31.149081 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3057/6289] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:30 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1564 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:33.119497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6ff5633a-9514-4a89-91d0-c8fabc422e56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:56:33.120131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6ff5633a-9514-4a89-91d0-c8fabc422e56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:33.141153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-de3e4266-5ca9-4c66-a24a-e6056119ee2c req-c9bf568d-7b4b-4c4c-83d5-f38e5fcf5581 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e8452c-1481-41ab-96c0-62b302343864", "tag": "cff1d37d-2601-472e-ad65-d6a7e2ef9ec9"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:56:33.149859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ff5633a-9514-4a89-91d0-c8fabc422e56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:33.150393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ff5633a-9514-4a89-91d0-c8fabc422e56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:33.153437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ff5633a-9514-4a89-91d0-c8fabc422e56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:33.154440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ff5633a-9514-4a89-91d0-c8fabc422e56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:33.155258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ff5633a-9514-4a89-91d0-c8fabc422e56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:33.156089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ff5633a-9514-4a89-91d0-c8fabc422e56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:33.156626 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-de3e4266-5ca9-4c66-a24a-e6056119ee2c req-c9bf568d-7b4b-4c4c-83d5-f38e5fcf5581 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:33.157257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-de3e4266-5ca9-4c66-a24a-e6056119ee2c req-c9bf568d-7b4b-4c4c-83d5-f38e5fcf5581 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:33.157899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-de3e4266-5ca9-4c66-a24a-e6056119ee2c req-c9bf568d-7b4b-4c4c-83d5-f38e5fcf5581 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:33.174000 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-de3e4266-5ca9-4c66-a24a-e6056119ee2c req-c9bf568d-7b4b-4c4c-83d5-f38e5fcf5581 service nova] Creating event network-changed:cff1d37d-2601-472e-ad65-d6a7e2ef9ec9 for instance d4e8452c-1481-41ab-96c0-62b302343864 on n-h1-860864-2 Oct 10 23:56:33.180053 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-de3e4266-5ca9-4c66-a24a-e6056119ee2c req-c9bf568d-7b4b-4c4c-83d5-f38e5fcf5581 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057840 Oct 10 23:56:33.181350 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3058/6290] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:56:33.472837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6ff5633a-9514-4a89-91d0-c8fabc422e56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:56:33.488248 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6ff5633a-9514-4a89-91d0-c8fabc422e56 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1564 microversion: 2.1 time: 0.378747 Oct 10 23:56:33.490015 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3233/6291] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:56:33 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1564 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:56:41.562199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8cdce523-54bd-4655-8a49-547ba9e2c2aa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:56:41.565851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8cdce523-54bd-4655-8a49-547ba9e2c2aa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: a2ab3eb3-f415-415b-9026-41a1befefdae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:56:41.573796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cdce523-54bd-4655-8a49-547ba9e2c2aa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:41.574287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cdce523-54bd-4655-8a49-547ba9e2c2aa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:41.574722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cdce523-54bd-4655-8a49-547ba9e2c2aa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:41.575427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cdce523-54bd-4655-8a49-547ba9e2c2aa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:56:41.575881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cdce523-54bd-4655-8a49-547ba9e2c2aa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:56:41.576307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cdce523-54bd-4655-8a49-547ba9e2c2aa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:56:41.641824 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8cdce523-54bd-4655-8a49-547ba9e2c2aa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "POST /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae/action" status: 200 len: 24569 microversion: 2.1 time: 0.083628 Oct 10 23:56:41.643024 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3059/6292] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:56:41 2022] POST /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae/action => generated 24569 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:57:02.144670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-06ed28ee-c387-49f3-8075-cdfc6f1d4120 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:02.146685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-06ed28ee-c387-49f3-8075-cdfc6f1d4120 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:02.148836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=26 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:57:02.149548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=11 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:57:02.156647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06ed28ee-c387-49f3-8075-cdfc6f1d4120 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:02.157391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06ed28ee-c387-49f3-8075-cdfc6f1d4120 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:02.158588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06ed28ee-c387-49f3-8075-cdfc6f1d4120 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:02.159346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06ed28ee-c387-49f3-8075-cdfc6f1d4120 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:02.159819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06ed28ee-c387-49f3-8075-cdfc6f1d4120 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:02.160262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06ed28ee-c387-49f3-8075-cdfc6f1d4120 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:02.187901 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-06ed28ee-c387-49f3-8075-cdfc6f1d4120 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/ips" status: 200 len: 148 microversion: 2.1 time: 0.047838 Oct 10 23:57:02.188504 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3234/6293] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 10 23:57:02 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/ips => generated 148 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:57:03.568427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5478f3a9-3e5b-4465-ab51-965c0600ea6e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc4b9ad6-2706-4ccc-8061-4941e63a0361"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:57:03.571591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5478f3a9-3e5b-4465-ab51-965c0600ea6e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:03.578601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=27 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:57:03.579586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=71 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:57:03.582364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5478f3a9-3e5b-4465-ab51-965c0600ea6e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:03.583006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5478f3a9-3e5b-4465-ab51-965c0600ea6e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:03.583579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5478f3a9-3e5b-4465-ab51-965c0600ea6e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:03.584419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5478f3a9-3e5b-4465-ab51-965c0600ea6e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:03.585006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5478f3a9-3e5b-4465-ab51-965c0600ea6e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:03.585727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5478f3a9-3e5b-4465-ab51-965c0600ea6e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:04.032901 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5478f3a9-3e5b-4465-ab51-965c0600ea6e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "POST /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.468990 Oct 10 23:57:04.037524 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3060/6294] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Oct 10 23:57:03 2022] POST /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/os-volume_attachments => generated 194 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:57:07.993682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-00254cff-c6f6-463f-a83b-785201013684 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:57:07.996039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-00254cff-c6f6-463f-a83b-785201013684 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:08.004156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00254cff-c6f6-463f-a83b-785201013684 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:08.004782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00254cff-c6f6-463f-a83b-785201013684 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:08.005436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00254cff-c6f6-463f-a83b-785201013684 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:08.006331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00254cff-c6f6-463f-a83b-785201013684 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:08.006878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00254cff-c6f6-463f-a83b-785201013684 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:08.007315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00254cff-c6f6-463f-a83b-785201013684 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:08.066401 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-00254cff-c6f6-463f-a83b-785201013684 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "POST /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864/action" status: 200 len: 24544 microversion: 2.1 time: 0.076367 Oct 10 23:57:08.073557 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3235/6295] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:57:07 2022] POST /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864/action => generated 24544 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 23:57:15.419622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:57:15.420394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:57:15.425842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8d691baf-c0af-4784-b564-a64249721028 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:15.426437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8d691baf-c0af-4784-b564-a64249721028 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] [instance: 99063d0c-45e5-42c6-95c0-f663605cd5f4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:15.434311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d691baf-c0af-4784-b564-a64249721028 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:15.434801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d691baf-c0af-4784-b564-a64249721028 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:15.435245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d691baf-c0af-4784-b564-a64249721028 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:15.435950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d691baf-c0af-4784-b564-a64249721028 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:15.436408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d691baf-c0af-4784-b564-a64249721028 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:15.436836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d691baf-c0af-4784-b564-a64249721028 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:15.524127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-8d691baf-c0af-4784-b564-a64249721028 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lazy-loading 'services' on Instance uuid 99063d0c-45e5-42c6-95c0-f663605cd5f4 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:57:15.597969 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8d691baf-c0af-4784-b564-a64249721028 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] 10.222.0.23 "DELETE /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4/os-volume_attachments/8613fe82-7013-404a-8167-61a1c1a21e42" status: 202 len: 0 microversion: 2.1 time: 0.180721 Oct 10 23:57:15.598610 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3061/6296] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Oct 10 23:57:15 2022] DELETE /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4/os-volume_attachments/8613fe82-7013-404a-8167-61a1c1a21e42 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:57:18.678292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fffe1c39-9151-4e71-85c7-2c63bf89f966 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc4b9ad6-2706-4ccc-8061-4941e63a0361"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:57:18.681842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fffe1c39-9151-4e71-85c7-2c63bf89f966 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:18.690830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:57:18.691924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:57:18.693884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fffe1c39-9151-4e71-85c7-2c63bf89f966 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:18.694835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fffe1c39-9151-4e71-85c7-2c63bf89f966 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:18.695652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fffe1c39-9151-4e71-85c7-2c63bf89f966 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:18.697257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fffe1c39-9151-4e71-85c7-2c63bf89f966 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:18.697992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fffe1c39-9151-4e71-85c7-2c63bf89f966 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:18.698612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fffe1c39-9151-4e71-85c7-2c63bf89f966 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:19.064764 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-fffe1c39-9151-4e71-85c7-2c63bf89f966 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] HTTP exception thrown: Invalid volume: volume bc4b9ad6-2706-4ccc-8061-4941e63a0361 is already attached to instances: bcca65a1-5074-42ee-bbe9-d6ac334af197 Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fffe1c39-9151-4e71-85c7-2c63bf89f966 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Request method failure captured: Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/os-volume_attachments HTTP/1.1 Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 74 Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLBDAPlCX48YdEI_BZ56dd4NDqrF57jWSGWCNxNuvLmDVrys2ONyIxdRThQ39af5CDKFGrOPcPgopPvUqIoMURbU5-dQOyalOKZCOKYa5dePf9jQ4W3BnwA1ZRfPtasJlQSUVtB1nnR57fubblxeL4KqCwX3PMAeSV4rzGda9sHJhlU Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0fcaa1fb124e448b8bacb6353fca9d5d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: b7008c9b5ad94dbea7edc12267dae2b5 Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: {"volumeAttachment": {"volumeId": "bc4b9ad6-2706-4ccc-8061-4941e63a0361"}} Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: exception: Invalid volume: volume bc4b9ad6-2706-4ccc-8061-4941e63a0361 is already attached to instances: bcca65a1-5074-42ee-bbe9-d6ac334af197 Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'server_id': 'bcca65a1-5074-42ee-bbe9-d6ac334af197', 'body': {'volumeAttachment': {'volumeId': 'bc4b9ad6-2706-4ccc-8061-4941e63a0361'}}} Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bc4b9ad6-2706-4ccc-8061-4941e63a0361 is already attached to instances: bcca65a1-5074-42ee-bbe9-d6ac334af197 Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:57:19.067076 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:57:19.071308 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 23:57:19.071308 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 23:57:19.071308 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 10 23:57:19.071308 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 10 23:57:19.071308 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bc4b9ad6-2706-4ccc-8061-4941e63a0361 is already attached to instances: bcca65a1-5074-42ee-bbe9-d6ac334af197 Oct 10 23:57:19.071308 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:57:19.071308 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:57:19.071308 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:57:19.071308 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:57:19.071308 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:57:19.071308 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:57:19.071308 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:57:19.071308 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:57:19.071308 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bc4b9ad6-2706-4ccc-8061-4941e63a0361 is already attached to instances: bcca65a1-5074-42ee-bbe9-d6ac334af197 Oct 10 23:57:19.071308 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:57:19.076081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fffe1c39-9151-4e71-85c7-2c63bf89f966 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Returning 400 to user: Invalid volume: volume bc4b9ad6-2706-4ccc-8061-4941e63a0361 is already attached to instances: bcca65a1-5074-42ee-bbe9-d6ac334af197 {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:57:19.077826 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fffe1c39-9151-4e71-85c7-2c63bf89f966 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "POST /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.404915 Oct 10 23:57:19.086075 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3236/6297] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Oct 10 23:57:18 2022] POST /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/os-volume_attachments => generated 174 bytes in 414 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 23:57:19.210342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8e2cca33-4632-4831-94e3-98ceccdd947f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:19.211746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8e2cca33-4632-4831-94e3-98ceccdd947f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:19.220410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e2cca33-4632-4831-94e3-98ceccdd947f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:19.221679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e2cca33-4632-4831-94e3-98ceccdd947f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:19.222802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e2cca33-4632-4831-94e3-98ceccdd947f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:19.223808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e2cca33-4632-4831-94e3-98ceccdd947f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:19.224488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e2cca33-4632-4831-94e3-98ceccdd947f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:19.225140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8e2cca33-4632-4831-94e3-98ceccdd947f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:19.332743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-8e2cca33-4632-4831-94e3-98ceccdd947f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lazy-loading 'services' on Instance uuid bcca65a1-5074-42ee-bbe9-d6ac334af197 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:57:19.419151 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8e2cca33-4632-4831-94e3-98ceccdd947f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/os-volume_attachments/bc4b9ad6-2706-4ccc-8061-4941e63a0361" status: 202 len: 0 microversion: 2.1 time: 0.215023 Oct 10 23:57:19.420566 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3062/6298] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Oct 10 23:57:19 2022] DELETE /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/os-volume_attachments/bc4b9ad6-2706-4ccc-8061-4941e63a0361 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:57:19.430616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a03c1e5f-b5e1-48b0-83cb-34e711fcdff4 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:19.435217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a03c1e5f-b5e1-48b0-83cb-34e711fcdff4 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:19.448017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a03c1e5f-b5e1-48b0-83cb-34e711fcdff4 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:19.448740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a03c1e5f-b5e1-48b0-83cb-34e711fcdff4 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:19.449235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a03c1e5f-b5e1-48b0-83cb-34e711fcdff4 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:19.450204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a03c1e5f-b5e1-48b0-83cb-34e711fcdff4 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:19.451183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a03c1e5f-b5e1-48b0-83cb-34e711fcdff4 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:19.451915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a03c1e5f-b5e1-48b0-83cb-34e711fcdff4 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:19.495206 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a03c1e5f-b5e1-48b0-83cb-34e711fcdff4 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069430 Oct 10 23:57:19.495904 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3237/6299] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:57:19 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:57:20.510309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-900ee20e-2645-4118-8451-a0e2b43ceee8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:20.512761 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-900ee20e-2645-4118-8451-a0e2b43ceee8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:20.528098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-900ee20e-2645-4118-8451-a0e2b43ceee8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:20.528600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-900ee20e-2645-4118-8451-a0e2b43ceee8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:20.529040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-900ee20e-2645-4118-8451-a0e2b43ceee8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:20.529784 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-900ee20e-2645-4118-8451-a0e2b43ceee8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:20.530312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-900ee20e-2645-4118-8451-a0e2b43ceee8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:20.537301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-900ee20e-2645-4118-8451-a0e2b43ceee8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:20.588845 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-900ee20e-2645-4118-8451-a0e2b43ceee8 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083767 Oct 10 23:57:20.590028 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3063/6300] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:57:20 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:57:20.962218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e406be49-2d02-468a-96a6-160d7b216ae6 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:20.963967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e406be49-2d02-468a-96a6-160d7b216ae6 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] [instance: 99063d0c-45e5-42c6-95c0-f663605cd5f4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:20.974466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e406be49-2d02-468a-96a6-160d7b216ae6 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:20.975237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e406be49-2d02-468a-96a6-160d7b216ae6 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:20.975859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e406be49-2d02-468a-96a6-160d7b216ae6 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:20.976872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e406be49-2d02-468a-96a6-160d7b216ae6 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:20.979838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e406be49-2d02-468a-96a6-160d7b216ae6 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:20.981605 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e406be49-2d02-468a-96a6-160d7b216ae6 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:21.027675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e406be49-2d02-468a-96a6-160d7b216ae6 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] [instance: 99063d0c-45e5-42c6-95c0-f663605cd5f4] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:57:21.158481 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e406be49-2d02-468a-96a6-160d7b216ae6 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] 10.222.0.23 "DELETE /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4" status: 204 len: 0 microversion: 2.1 time: 0.200022 Oct 10 23:57:21.160239 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3238/6301] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:57:20 2022] DELETE /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:57:21.173820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6b6a2ae0-40cf-4a06-b011-8ad495cc1769 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:21.174855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6b6a2ae0-40cf-4a06-b011-8ad495cc1769 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] [instance: 99063d0c-45e5-42c6-95c0-f663605cd5f4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:21.183858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b6a2ae0-40cf-4a06-b011-8ad495cc1769 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:21.184699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b6a2ae0-40cf-4a06-b011-8ad495cc1769 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:21.186063 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b6a2ae0-40cf-4a06-b011-8ad495cc1769 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:21.186852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b6a2ae0-40cf-4a06-b011-8ad495cc1769 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:21.189608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b6a2ae0-40cf-4a06-b011-8ad495cc1769 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:21.190263 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b6a2ae0-40cf-4a06-b011-8ad495cc1769 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:21.401218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6b6a2ae0-40cf-4a06-b011-8ad495cc1769 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc9ba3ff84140ef8817e49936c5fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65aaf3599647859ffc6f3c197c4bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:21.420085 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6b6a2ae0-40cf-4a06-b011-8ad495cc1769 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] 10.222.0.23 "GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4" status: 200 len: 1470 microversion: 2.1 time: 0.255118 Oct 10 23:57:21.421020 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3064/6302] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:21 2022] GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4 => generated 1470 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:21.613548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6886c0ae-ea1e-4f0e-ace8-8eac571bf299 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:21.617901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6886c0ae-ea1e-4f0e-ace8-8eac571bf299 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:21.626954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6886c0ae-ea1e-4f0e-ace8-8eac571bf299 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:21.627856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6886c0ae-ea1e-4f0e-ace8-8eac571bf299 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:21.628512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6886c0ae-ea1e-4f0e-ace8-8eac571bf299 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:21.630045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6886c0ae-ea1e-4f0e-ace8-8eac571bf299 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:21.630045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6886c0ae-ea1e-4f0e-ace8-8eac571bf299 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:21.630415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6886c0ae-ea1e-4f0e-ace8-8eac571bf299 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:21.666307 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6886c0ae-ea1e-4f0e-ace8-8eac571bf299 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067280 Oct 10 23:57:21.667149 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3239/6303] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:57:21 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:57:22.448187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1241df81-e864-405e-b9d8-8b3c806a7d59 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:22.449487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1241df81-e864-405e-b9d8-8b3c806a7d59 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] [instance: 99063d0c-45e5-42c6-95c0-f663605cd5f4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:22.459304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1241df81-e864-405e-b9d8-8b3c806a7d59 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:22.459815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1241df81-e864-405e-b9d8-8b3c806a7d59 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:22.460257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1241df81-e864-405e-b9d8-8b3c806a7d59 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:22.460990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1241df81-e864-405e-b9d8-8b3c806a7d59 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:22.461472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1241df81-e864-405e-b9d8-8b3c806a7d59 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:22.462181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1241df81-e864-405e-b9d8-8b3c806a7d59 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:22.655917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1241df81-e864-405e-b9d8-8b3c806a7d59 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc9ba3ff84140ef8817e49936c5fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65aaf3599647859ffc6f3c197c4bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:22.665895 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1241df81-e864-405e-b9d8-8b3c806a7d59 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] 10.222.0.23 "GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4" status: 200 len: 1470 microversion: 2.1 time: 0.221631 Oct 10 23:57:22.666992 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3065/6304] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:22 2022] GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4 => generated 1470 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:22.679563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b9a3a001-0517-4616-88fd-f124297fa5ec tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:22.682445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b9a3a001-0517-4616-88fd-f124297fa5ec tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:22.691277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9a3a001-0517-4616-88fd-f124297fa5ec tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:22.691871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9a3a001-0517-4616-88fd-f124297fa5ec tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:22.692552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9a3a001-0517-4616-88fd-f124297fa5ec tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:22.693346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9a3a001-0517-4616-88fd-f124297fa5ec tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:22.693921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9a3a001-0517-4616-88fd-f124297fa5ec tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:22.694431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b9a3a001-0517-4616-88fd-f124297fa5ec tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:22.729844 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b9a3a001-0517-4616-88fd-f124297fa5ec tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054856 Oct 10 23:57:22.730549 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3240/6305] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:57:22 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:57:23.580065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-5af99ce2-c9ba-4f83-a552-e369ed81f712 req-0083478c-209d-44d8-8dfe-a17f2ed905f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99063d0c-45e5-42c6-95c0-f663605cd5f4", "name": "network-vif-deleted", "tag": "863f1bd6-de7f-401d-8061-146617a717ea"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:57:23.597019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5af99ce2-c9ba-4f83-a552-e369ed81f712 req-0083478c-209d-44d8-8dfe-a17f2ed905f5 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:23.600588 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5af99ce2-c9ba-4f83-a552-e369ed81f712 req-0083478c-209d-44d8-8dfe-a17f2ed905f5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:23.600588 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5af99ce2-c9ba-4f83-a552-e369ed81f712 req-0083478c-209d-44d8-8dfe-a17f2ed905f5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:23.612387 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-5af99ce2-c9ba-4f83-a552-e369ed81f712 req-0083478c-209d-44d8-8dfe-a17f2ed905f5 service nova] Creating event network-vif-deleted:863f1bd6-de7f-401d-8061-146617a717ea for instance 99063d0c-45e5-42c6-95c0-f663605cd5f4 on n-h2-860864-2 Oct 10 23:57:23.617999 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-5af99ce2-c9ba-4f83-a552-e369ed81f712 req-0083478c-209d-44d8-8dfe-a17f2ed905f5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041953 Oct 10 23:57:23.619153 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3066/6306] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:57:23.691820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ebde26ed-c246-46f9-b46c-b407dd1a4695 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:23.693120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ebde26ed-c246-46f9-b46c-b407dd1a4695 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] [instance: 99063d0c-45e5-42c6-95c0-f663605cd5f4] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:23.709036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebde26ed-c246-46f9-b46c-b407dd1a4695 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:23.709678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebde26ed-c246-46f9-b46c-b407dd1a4695 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:23.710398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebde26ed-c246-46f9-b46c-b407dd1a4695 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:23.711263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebde26ed-c246-46f9-b46c-b407dd1a4695 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:23.711807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebde26ed-c246-46f9-b46c-b407dd1a4695 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:23.712532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebde26ed-c246-46f9-b46c-b407dd1a4695 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:23.743448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-14a341d5-4197-4679-ba37-369209e72229 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:23.745963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-14a341d5-4197-4679-ba37-369209e72229 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:23.758724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14a341d5-4197-4679-ba37-369209e72229 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:23.759551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14a341d5-4197-4679-ba37-369209e72229 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:23.760235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14a341d5-4197-4679-ba37-369209e72229 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:23.761064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14a341d5-4197-4679-ba37-369209e72229 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:23.761768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14a341d5-4197-4679-ba37-369209e72229 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:23.762459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14a341d5-4197-4679-ba37-369209e72229 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:23.767161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebde26ed-c246-46f9-b46c-b407dd1a4695 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:23.767982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebde26ed-c246-46f9-b46c-b407dd1a4695 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:23.768628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ebde26ed-c246-46f9-b46c-b407dd1a4695 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:23.769288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-ebde26ed-c246-46f9-b46c-b407dd1a4695 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lazy-loading 'fault' on Instance uuid 99063d0c-45e5-42c6-95c0-f663605cd5f4 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:57:23.818531 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-14a341d5-4197-4679-ba37-369209e72229 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079344 Oct 10 23:57:23.823331 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3067/6307] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:57:23 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:57:23.837329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ebde26ed-c246-46f9-b46c-b407dd1a4695 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccc9ba3ff84140ef8817e49936c5fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f65aaf3599647859ffc6f3c197c4bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:23.847135 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ebde26ed-c246-46f9-b46c-b407dd1a4695 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] 10.222.0.23 "GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4" status: 200 len: 1304 microversion: 2.1 time: 0.159781 Oct 10 23:57:23.847902 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3241/6308] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:23 2022] GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4 => generated 1304 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:24.382292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6b9cd000-84e3-4757-873e-8dde39f2f080 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Action: 'create', calling method: .version_select at 0x7f662a651e50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-799544408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBX047ccrI+l9agwoxbvbL0xHO33Tx6/I8kzhW3EvnLNggrPzqgP9hq8anNGNVrg0WDXMhA9NxtAuJQwvWu8F2t8QBe/5VI08IANsHs6A4dC+IJAQZVn7AcJYXkp9/G+g=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:57:24.399521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-6b9cd000-84e3-4757-873e-8dde39f2f080 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Getting quotas for project 897064e9041f4e4f94ced711d282deb4. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:57:24.405561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-6b9cd000-84e3-4757-873e-8dde39f2f080 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Getting quotas for user 82fc082060b54409a4361c04f8355580 and project 897064e9041f4e4f94ced711d282deb4. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:57:24.434749 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6b9cd000-84e3-4757-873e-8dde39f2f080 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.056186 Oct 10 23:57:24.435483 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3068/6309] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:57:24 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:57:24.840477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b0adf4d4-5498-4834-aff0-e4d7dc45a417 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:24.845722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b0adf4d4-5498-4834-aff0-e4d7dc45a417 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:24.854915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0adf4d4-5498-4834-aff0-e4d7dc45a417 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:24.855671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0adf4d4-5498-4834-aff0-e4d7dc45a417 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:24.856632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0adf4d4-5498-4834-aff0-e4d7dc45a417 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:24.861718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0adf4d4-5498-4834-aff0-e4d7dc45a417 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:24.868805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0adf4d4-5498-4834-aff0-e4d7dc45a417 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:24.870604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0adf4d4-5498-4834-aff0-e4d7dc45a417 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:24.874078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-29b2ba93-3026-4c00-99f8-d33e635df700 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:24.874949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-29b2ba93-3026-4c00-99f8-d33e635df700 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] [instance: 99063d0c-45e5-42c6-95c0-f663605cd5f4] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:24.888731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29b2ba93-3026-4c00-99f8-d33e635df700 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:24.889465 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29b2ba93-3026-4c00-99f8-d33e635df700 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:24.890174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29b2ba93-3026-4c00-99f8-d33e635df700 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:24.891763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29b2ba93-3026-4c00-99f8-d33e635df700 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:24.892753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29b2ba93-3026-4c00-99f8-d33e635df700 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:24.893655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29b2ba93-3026-4c00-99f8-d33e635df700 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:24.910710 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-29b2ba93-3026-4c00-99f8-d33e635df700 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] HTTP exception thrown: Instance 99063d0c-45e5-42c6-95c0-f663605cd5f4 could not be found. Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-29b2ba93-3026-4c00-99f8-d33e635df700 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Request method failure captured: Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4 HTTP/1.1 Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLDvpLxuqqdJA3Wk9a-p629E4OzimbdI2GgHXwx8jmJXmum0CCI4XYgeS_rnFA1xPrLr2ZPuCZqM9I2dYb4VTPXSaba4bJ417180otOtP4j-Gp2mUX6iAU45w_BYvasxEHxUtHkkXaTc59kiP0AUMZEwv5_cXLzow1pYHpp62W6RfTM Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 3f65aaf3599647859ffc6f3c197c4bbe Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-VolumesBackupsTest-1453791487 Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3f65aaf3599647859ffc6f3c197c4bbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f65aaf3599647859ffc6f3c197c4bbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f65aaf3599647859ffc6f3c197c4bbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3f65aaf3599647859ffc6f3c197c4bbe", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-VolumesBackupsTest-1453791487 Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 3f65aaf3599647859ffc6f3c197c4bbe Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-VolumesBackupsTest-1453791487 Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-VolumesBackupsTest-1453791487-project Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: ccc9ba3ff84140ef8817e49936c5fd8a Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-VolumesBackupsTest-1453791487-project Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 99063d0c-45e5-42c6-95c0-f663605cd5f4 could not be found. Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '99063d0c-45e5-42c6-95c0-f663605cd5f4'} Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99063d0c-45e5-42c6-95c0-f663605cd5f4 could not be found. Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99063d0c-45e5-42c6-95c0-f663605cd5f4 could not be found. Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:57:24.912789 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:57:24.916570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:57:24.916570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:57:24.916570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:57:24.916570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:57:24.916570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:57:24.916570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99063d0c-45e5-42c6-95c0-f663605cd5f4 could not be found. Oct 10 23:57:24.916570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:57:24.919146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-29b2ba93-3026-4c00-99f8-d33e635df700 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] Returning 404 to user: Instance 99063d0c-45e5-42c6-95c0-f663605cd5f4 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:57:24.920717 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-29b2ba93-3026-4c00-99f8-d33e635df700 tempest-VolumesBackupsTest-1453791487 tempest-VolumesBackupsTest-1453791487-project] 10.222.0.23 "GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4" status: 404 len: 111 microversion: 2.1 time: 0.052649 Oct 10 23:57:24.922355 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3069/6310] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:24 2022] GET /compute/v2.1/servers/99063d0c-45e5-42c6-95c0-f663605cd5f4 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:57:24.967637 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b0adf4d4-5498-4834-aff0-e4d7dc45a417 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140362 Oct 10 23:57:24.972443 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3242/6311] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:57:24 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:57:25.981592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-addf5d40-c535-48ad-8734-4f01551a939d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:25.983902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-addf5d40-c535-48ad-8734-4f01551a939d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:25.993850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-addf5d40-c535-48ad-8734-4f01551a939d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:25.994348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-addf5d40-c535-48ad-8734-4f01551a939d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:25.994789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-addf5d40-c535-48ad-8734-4f01551a939d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:25.995502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-addf5d40-c535-48ad-8734-4f01551a939d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:25.995957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-addf5d40-c535-48ad-8734-4f01551a939d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:25.996385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-addf5d40-c535-48ad-8734-4f01551a939d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:26.034740 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-addf5d40-c535-48ad-8734-4f01551a939d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058291 Oct 10 23:57:26.037763 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3070/6312] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:57:25 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:57:26.146661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-94c8ed4d-a016-4ace-868f-8c860a7ca0fb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:26.148271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-94c8ed4d-a016-4ace-868f-8c860a7ca0fb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:26.150902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-56c1d2e4-1c74-4779-ac33-0badb26528ec tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1208054762", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "4b96e122-70c5-494d-b7fb-701182b0ba13"}], "key_name": "tempest-TestNetworkBasicOps-799544408", "security_groups": [{"name": "tempest-secgroup-smoke-1380506583"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:57:26.165753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94c8ed4d-a016-4ace-868f-8c860a7ca0fb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:26.166505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94c8ed4d-a016-4ace-868f-8c860a7ca0fb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:26.167027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94c8ed4d-a016-4ace-868f-8c860a7ca0fb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:26.167978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94c8ed4d-a016-4ace-868f-8c860a7ca0fb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:26.168517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94c8ed4d-a016-4ace-868f-8c860a7ca0fb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:26.170550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94c8ed4d-a016-4ace-868f-8c860a7ca0fb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:26.222969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-94c8ed4d-a016-4ace-868f-8c860a7ca0fb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:57:26.290869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-56c1d2e4-1c74-4779-ac33-0badb26528ec tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] validate_networks() for [('4b96e122-70c5-494d-b7fb-701182b0ba13', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:57:26.351047 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-94c8ed4d-a016-4ace-868f-8c860a7ca0fb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197" status: 204 len: 0 microversion: 2.1 time: 0.213412 Oct 10 23:57:26.353957 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3243/6313] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:57:26 2022] DELETE /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:57:26.363592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9ca47fa0-08c2-425c-9608-900add1373bb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:26.364521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9ca47fa0-08c2-425c-9608-900add1373bb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:26.372194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ca47fa0-08c2-425c-9608-900add1373bb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:26.372718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ca47fa0-08c2-425c-9608-900add1373bb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:26.373161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ca47fa0-08c2-425c-9608-900add1373bb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:26.373968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ca47fa0-08c2-425c-9608-900add1373bb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:26.374423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ca47fa0-08c2-425c-9608-900add1373bb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:26.374868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ca47fa0-08c2-425c-9608-900add1373bb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:26.564309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9ca47fa0-08c2-425c-9608-900add1373bb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:26.576604 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9ca47fa0-08c2-425c-9608-900add1373bb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197" status: 200 len: 1680 microversion: 2.1 time: 0.218387 Oct 10 23:57:26.577833 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3244/6314] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:26 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197 => generated 1680 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:57:27.080718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-56c1d2e4-1c74-4779-ac33-0badb26528ec tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:57:27.081208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-56c1d2e4-1c74-4779-ac33-0badb26528ec tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:57:27.081647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-56c1d2e4-1c74-4779-ac33-0badb26528ec tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:57:27.082523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-56c1d2e4-1c74-4779-ac33-0badb26528ec tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:57:27.082950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-56c1d2e4-1c74-4779-ac33-0badb26528ec tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:57:27.100617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56c1d2e4-1c74-4779-ac33-0badb26528ec tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:27.111260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56c1d2e4-1c74-4779-ac33-0badb26528ec tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:27.112154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56c1d2e4-1c74-4779-ac33-0badb26528ec tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:27.113332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56c1d2e4-1c74-4779-ac33-0badb26528ec tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:27.114101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56c1d2e4-1c74-4779-ac33-0badb26528ec tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:27.114384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-56c1d2e4-1c74-4779-ac33-0badb26528ec tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:27.134897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-56c1d2e4-1c74-4779-ac33-0badb26528ec tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Getting quotas for project 897064e9041f4e4f94ced711d282deb4. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:57:27.142907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-56c1d2e4-1c74-4779-ac33-0badb26528ec tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Getting quotas for user 82fc082060b54409a4361c04f8355580 and project 897064e9041f4e4f94ced711d282deb4. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:57:27.158232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-56c1d2e4-1c74-4779-ac33-0badb26528ec tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:57:27.161519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-56c1d2e4-1c74-4779-ac33-0badb26528ec tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: b2d59383-8183-418f-96c6-cc05f94da40c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:57:27.241644 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-56c1d2e4-1c74-4779-ac33-0badb26528ec tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.095313 Oct 10 23:57:27.244881 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3071/6315] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:57:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:57:27.254981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bfed4aa1-ccff-4f44-b441-bd086aceb0b6 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:27.256322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bfed4aa1-ccff-4f44-b441-bd086aceb0b6 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: b2d59383-8183-418f-96c6-cc05f94da40c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:27.389092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bfed4aa1-ccff-4f44-b441-bd086aceb0b6 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:27.398229 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bfed4aa1-ccff-4f44-b441-bd086aceb0b6 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c" status: 200 len: 1248 microversion: 2.1 time: 0.148463 Oct 10 23:57:27.402853 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3245/6316] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:27 2022] GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c => generated 1248 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:27.604766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c7566027-1b88-412b-83fd-3bebde591d0f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:27.610610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c7566027-1b88-412b-83fd-3bebde591d0f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:27.622140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7566027-1b88-412b-83fd-3bebde591d0f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:27.622649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7566027-1b88-412b-83fd-3bebde591d0f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:27.623083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7566027-1b88-412b-83fd-3bebde591d0f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:27.624083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7566027-1b88-412b-83fd-3bebde591d0f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:27.624570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7566027-1b88-412b-83fd-3bebde591d0f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:27.625578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c7566027-1b88-412b-83fd-3bebde591d0f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:27.896418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c7566027-1b88-412b-83fd-3bebde591d0f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:27.905224 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c7566027-1b88-412b-83fd-3bebde591d0f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197" status: 200 len: 1680 microversion: 2.1 time: 0.306496 Oct 10 23:57:27.906176 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3072/6317] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:27 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197 => generated 1680 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:28.423306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6998a551-95b5-491d-9fc7-e9be2fb1c496 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:28.423966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6998a551-95b5-491d-9fc7-e9be2fb1c496 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: b2d59383-8183-418f-96c6-cc05f94da40c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:28.432040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6998a551-95b5-491d-9fc7-e9be2fb1c496 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:28.433973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6998a551-95b5-491d-9fc7-e9be2fb1c496 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:28.434500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6998a551-95b5-491d-9fc7-e9be2fb1c496 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:28.435307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6998a551-95b5-491d-9fc7-e9be2fb1c496 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:28.435870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6998a551-95b5-491d-9fc7-e9be2fb1c496 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:28.436420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6998a551-95b5-491d-9fc7-e9be2fb1c496 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:28.698365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6998a551-95b5-491d-9fc7-e9be2fb1c496 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:28.712170 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6998a551-95b5-491d-9fc7-e9be2fb1c496 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c" status: 200 len: 1300 microversion: 2.1 time: 0.292917 Oct 10 23:57:28.724479 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3246/6318] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:28 2022] GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c => generated 1300 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:28.932329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-47388a2f-5312-4750-8d80-6b89fbc62623 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:28.933062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-47388a2f-5312-4750-8d80-6b89fbc62623 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:28.946949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47388a2f-5312-4750-8d80-6b89fbc62623 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:28.947980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47388a2f-5312-4750-8d80-6b89fbc62623 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:28.948640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47388a2f-5312-4750-8d80-6b89fbc62623 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:28.954238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47388a2f-5312-4750-8d80-6b89fbc62623 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:28.956977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47388a2f-5312-4750-8d80-6b89fbc62623 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:28.958759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47388a2f-5312-4750-8d80-6b89fbc62623 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:29.151319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-47388a2f-5312-4750-8d80-6b89fbc62623 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:29.167592 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-47388a2f-5312-4750-8d80-6b89fbc62623 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197" status: 200 len: 1612 microversion: 2.1 time: 0.239327 Oct 10 23:57:29.175189 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3073/6319] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:28 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197 => generated 1612 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:29.583720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-a39d7239-cf49-4cce-a894-76ebe8d52912 req-2ed85089-4976-4129-8804-e842b56e1653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcca65a1-5074-42ee-bbe9-d6ac334af197", "name": "network-vif-deleted", "tag": "5c7f8b1b-d48b-4a94-8319-e37fe69b4e8a"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:57:29.599143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a39d7239-cf49-4cce-a894-76ebe8d52912 req-2ed85089-4976-4129-8804-e842b56e1653 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:29.599846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a39d7239-cf49-4cce-a894-76ebe8d52912 req-2ed85089-4976-4129-8804-e842b56e1653 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:29.600418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a39d7239-cf49-4cce-a894-76ebe8d52912 req-2ed85089-4976-4129-8804-e842b56e1653 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:29.618436 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a39d7239-cf49-4cce-a894-76ebe8d52912 req-2ed85089-4976-4129-8804-e842b56e1653 service nova] Creating event network-vif-deleted:5c7f8b1b-d48b-4a94-8319-e37fe69b4e8a for instance bcca65a1-5074-42ee-bbe9-d6ac334af197 on n-h2-860864-2 Oct 10 23:57:29.624574 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-a39d7239-cf49-4cce-a894-76ebe8d52912 req-2ed85089-4976-4129-8804-e842b56e1653 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045336 Oct 10 23:57:29.627240 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3247/6320] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:57:29.740187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1dec6dc5-ec65-4cfa-a308-06c267487a34 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:29.741256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1dec6dc5-ec65-4cfa-a308-06c267487a34 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: b2d59383-8183-418f-96c6-cc05f94da40c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:29.754509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1dec6dc5-ec65-4cfa-a308-06c267487a34 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:29.765019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1dec6dc5-ec65-4cfa-a308-06c267487a34 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:29.766448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1dec6dc5-ec65-4cfa-a308-06c267487a34 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:29.772003 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1dec6dc5-ec65-4cfa-a308-06c267487a34 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:29.772820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1dec6dc5-ec65-4cfa-a308-06c267487a34 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:29.776071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1dec6dc5-ec65-4cfa-a308-06c267487a34 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:29.940929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1dec6dc5-ec65-4cfa-a308-06c267487a34 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:29.953554 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1dec6dc5-ec65-4cfa-a308-06c267487a34 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c" status: 200 len: 1306 microversion: 2.1 time: 0.217032 Oct 10 23:57:29.956097 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3074/6321] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:29 2022] GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c => generated 1306 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:30.197561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b1daf894-c772-4ce4-8b39-228145140b47 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:30.198353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b1daf894-c772-4ce4-8b39-228145140b47 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:30.215872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1daf894-c772-4ce4-8b39-228145140b47 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:30.216424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1daf894-c772-4ce4-8b39-228145140b47 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:30.217089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1daf894-c772-4ce4-8b39-228145140b47 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:30.218004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1daf894-c772-4ce4-8b39-228145140b47 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:30.218622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1daf894-c772-4ce4-8b39-228145140b47 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:30.219484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1daf894-c772-4ce4-8b39-228145140b47 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:30.292292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1daf894-c772-4ce4-8b39-228145140b47 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:30.296052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1daf894-c772-4ce4-8b39-228145140b47 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:30.300125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1daf894-c772-4ce4-8b39-228145140b47 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:30.301100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-b1daf894-c772-4ce4-8b39-228145140b47 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lazy-loading 'fault' on Instance uuid bcca65a1-5074-42ee-bbe9-d6ac334af197 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:57:30.372745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b1daf894-c772-4ce4-8b39-228145140b47 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:30.383458 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b1daf894-c772-4ce4-8b39-228145140b47 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197" status: 200 len: 1331 microversion: 2.1 time: 0.190480 Oct 10 23:57:30.386129 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3248/6322] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:30 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197 => generated 1331 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:30.986166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c34b977b-597d-4c54-9af9-449e030301ae tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:30.989432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c34b977b-597d-4c54-9af9-449e030301ae tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: b2d59383-8183-418f-96c6-cc05f94da40c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:31.005312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c34b977b-597d-4c54-9af9-449e030301ae tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:31.006157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c34b977b-597d-4c54-9af9-449e030301ae tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:31.006842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c34b977b-597d-4c54-9af9-449e030301ae tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:31.009274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c34b977b-597d-4c54-9af9-449e030301ae tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:31.010033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c34b977b-597d-4c54-9af9-449e030301ae tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:31.011010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c34b977b-597d-4c54-9af9-449e030301ae tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:31.357067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c34b977b-597d-4c54-9af9-449e030301ae tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:31.366634 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c34b977b-597d-4c54-9af9-449e030301ae tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c" status: 200 len: 1374 microversion: 2.1 time: 0.391115 Oct 10 23:57:31.367559 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3075/6323] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:30 2022] GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c => generated 1374 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:31.414030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4fece22c-dc40-464b-b181-e568d7101265 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:31.414739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4fece22c-dc40-464b-b181-e568d7101265 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:31.431764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fece22c-dc40-464b-b181-e568d7101265 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:31.432193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fece22c-dc40-464b-b181-e568d7101265 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:31.433568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fece22c-dc40-464b-b181-e568d7101265 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:31.434200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fece22c-dc40-464b-b181-e568d7101265 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:31.434962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fece22c-dc40-464b-b181-e568d7101265 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:31.435417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fece22c-dc40-464b-b181-e568d7101265 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:31.472584 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-4fece22c-dc40-464b-b181-e568d7101265 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] HTTP exception thrown: Instance bcca65a1-5074-42ee-bbe9-d6ac334af197 could not be found. Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4fece22c-dc40-464b-b181-e568d7101265 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Request method failure captured: Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197 HTTP/1.1 Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLBDAPlCX48YdEI_BZ56dd4NDqrF57jWSGWCNxNuvLmDVrys2ONyIxdRThQ39af5CDKFGrOPcPgopPvUqIoMURbU5-dQOyalOKZCOKYa5dePf9jQ4W3BnwA1ZRfPtasJlQSUVtB1nnR57fubblxeL4KqCwX3PMAeSV4rzGda9sHJhlU Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0fcaa1fb124e448b8bacb6353fca9d5d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: b7008c9b5ad94dbea7edc12267dae2b5 Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance bcca65a1-5074-42ee-bbe9-d6ac334af197 could not be found. Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'bcca65a1-5074-42ee-bbe9-d6ac334af197'} Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcca65a1-5074-42ee-bbe9-d6ac334af197 could not be found. Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcca65a1-5074-42ee-bbe9-d6ac334af197 could not be found. Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:57:31.474324 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:57:31.479589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:57:31.479589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:57:31.479589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:57:31.479589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:57:31.479589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:57:31.479589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcca65a1-5074-42ee-bbe9-d6ac334af197 could not be found. Oct 10 23:57:31.479589 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:57:31.479589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4fece22c-dc40-464b-b181-e568d7101265 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Returning 404 to user: Instance bcca65a1-5074-42ee-bbe9-d6ac334af197 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:57:31.479589 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4fece22c-dc40-464b-b181-e568d7101265 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197" status: 404 len: 111 microversion: 2.1 time: 0.066187 Oct 10 23:57:31.479589 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3249/6324] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:31 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 23:57:31.485855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1f88a5e9-8555-452c-aca6-ee023aa4dbb1 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '.version_select at 0x7f662a5de790>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:31.521304 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1f88a5e9-8555-452c-aca6-ee023aa4dbb1 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019538048" status: 202 len: 0 microversion: 2.1 time: 0.039778 Oct 10 23:57:31.522477 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3076/6325] 10.222.0.23 () {58 vars in 1221 bytes} [Mon Oct 10 23:57:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019538048 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:57:31.983865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-f2fe963f-64fc-4fff-9ab1-dd1594b83e63 req-4bba84f1-4904-48ee-80bb-e359668e8c0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2d59383-8183-418f-96c6-cc05f94da40c", "tag": "9083248e-ad11-44dc-b327-951c28e7d64d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:57:32.014451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f2fe963f-64fc-4fff-9ab1-dd1594b83e63 req-4bba84f1-4904-48ee-80bb-e359668e8c0f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:32.014960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f2fe963f-64fc-4fff-9ab1-dd1594b83e63 req-4bba84f1-4904-48ee-80bb-e359668e8c0f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:32.015431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f2fe963f-64fc-4fff-9ab1-dd1594b83e63 req-4bba84f1-4904-48ee-80bb-e359668e8c0f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:32.041711 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-f2fe963f-64fc-4fff-9ab1-dd1594b83e63 req-4bba84f1-4904-48ee-80bb-e359668e8c0f service nova] Creating event network-changed:9083248e-ad11-44dc-b327-951c28e7d64d for instance b2d59383-8183-418f-96c6-cc05f94da40c on n-h2-860864-2 Oct 10 23:57:32.047257 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-f2fe963f-64fc-4fff-9ab1-dd1594b83e63 req-4bba84f1-4904-48ee-80bb-e359668e8c0f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067291 Oct 10 23:57:32.048294 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3250/6326] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:57:32.394427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-73fc5b83-662f-447d-9bc4-5837fe029c13 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:32.397970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-73fc5b83-662f-447d-9bc4-5837fe029c13 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: b2d59383-8183-418f-96c6-cc05f94da40c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:32.408631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73fc5b83-662f-447d-9bc4-5837fe029c13 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:32.409336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73fc5b83-662f-447d-9bc4-5837fe029c13 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:32.409878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73fc5b83-662f-447d-9bc4-5837fe029c13 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:32.410677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73fc5b83-662f-447d-9bc4-5837fe029c13 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:32.411221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73fc5b83-662f-447d-9bc4-5837fe029c13 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:32.411722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73fc5b83-662f-447d-9bc4-5837fe029c13 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:32.635027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ff01026e-4639-4369-b96d-a96e7542f21b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Action: 'create', calling method: .version_select at 0x7f6633b82af0>, body: {"keypair": {"name": "tempest-keypair-847531716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCRV/Y2W/ar9e0vjGhnEdOL48MMiYBU/cnmV/lmjChTu6ibd5XvZEqNDgILpSqv3b9LSV/XoAgxwoVZ9sk7JMSapwdT7DfrxGOEWVzmLVE4T2Uc5jvxpHIyElpe9fnQ9w=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:57:32.656226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-ff01026e-4639-4369-b96d-a96e7542f21b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Getting quotas for project 0fcaa1fb124e448b8bacb6353fca9d5d. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:57:32.663995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-ff01026e-4639-4369-b96d-a96e7542f21b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Getting quotas for user b7008c9b5ad94dbea7edc12267dae2b5 and project 0fcaa1fb124e448b8bacb6353fca9d5d. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:57:32.698727 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ff01026e-4639-4369-b96d-a96e7542f21b tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.068227 Oct 10 23:57:32.699981 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3251/6327] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:57:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:57:32.723711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-73fc5b83-662f-447d-9bc4-5837fe029c13 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:32.735975 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-73fc5b83-662f-447d-9bc4-5837fe029c13 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c" status: 200 len: 1374 microversion: 2.1 time: 0.349901 Oct 10 23:57:32.749648 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3077/6328] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:32 2022] GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c => generated 1374 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:33.764350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0257e2fa-35cc-436a-9c82-ba140d6a4baa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:33.766523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0257e2fa-35cc-436a-9c82-ba140d6a4baa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: b2d59383-8183-418f-96c6-cc05f94da40c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:33.774758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0257e2fa-35cc-436a-9c82-ba140d6a4baa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:33.775597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0257e2fa-35cc-436a-9c82-ba140d6a4baa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:33.776194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0257e2fa-35cc-436a-9c82-ba140d6a4baa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:33.777279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0257e2fa-35cc-436a-9c82-ba140d6a4baa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:33.777925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0257e2fa-35cc-436a-9c82-ba140d6a4baa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:33.778355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0257e2fa-35cc-436a-9c82-ba140d6a4baa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:33.813704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:57:34.020165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0257e2fa-35cc-436a-9c82-ba140d6a4baa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:34.036574 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0257e2fa-35cc-436a-9c82-ba140d6a4baa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c" status: 200 len: 1374 microversion: 2.1 time: 0.279319 Oct 10 23:57:34.037345 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3252/6329] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:33 2022] GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c => generated 1374 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:35.061005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7612005c-849f-4a78-890f-376099779008 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:35.062012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7612005c-849f-4a78-890f-376099779008 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: b2d59383-8183-418f-96c6-cc05f94da40c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:35.073287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7612005c-849f-4a78-890f-376099779008 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:35.078158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7612005c-849f-4a78-890f-376099779008 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:35.078982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7612005c-849f-4a78-890f-376099779008 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:35.079921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7612005c-849f-4a78-890f-376099779008 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:35.080551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7612005c-849f-4a78-890f-376099779008 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:35.081151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7612005c-849f-4a78-890f-376099779008 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:35.288642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7612005c-849f-4a78-890f-376099779008 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:35.298847 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7612005c-849f-4a78-890f-376099779008 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c" status: 200 len: 1374 microversion: 2.1 time: 0.241760 Oct 10 23:57:35.302012 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3078/6330] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:35 2022] GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c => generated 1374 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:35.351489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d5059920-1912-45ba-be75-3cb881710cdc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1011193116", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ab1ca05-35c0-4cfd-8d35-c70ce321d096"}], "security_groups": [{"name": "tempest-securitygroup--478086816"}], "key_name": "tempest-keypair-847531716", "user_data": "}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:57:35.464117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-d5059920-1912-45ba-be75-3cb881710cdc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] validate_networks() for [('1ab1ca05-35c0-4cfd-8d35-c70ce321d096', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:57:35.877763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d5059920-1912-45ba-be75-3cb881710cdc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:57:35.878228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d5059920-1912-45ba-be75-3cb881710cdc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:57:35.878714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d5059920-1912-45ba-be75-3cb881710cdc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:57:35.879131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d5059920-1912-45ba-be75-3cb881710cdc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:57:35.879552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d5059920-1912-45ba-be75-3cb881710cdc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:57:35.888819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5059920-1912-45ba-be75-3cb881710cdc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:35.889444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5059920-1912-45ba-be75-3cb881710cdc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:35.889763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5059920-1912-45ba-be75-3cb881710cdc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:35.890509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5059920-1912-45ba-be75-3cb881710cdc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:35.891563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5059920-1912-45ba-be75-3cb881710cdc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:35.892075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5059920-1912-45ba-be75-3cb881710cdc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:35.909697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-d5059920-1912-45ba-be75-3cb881710cdc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Getting quotas for project 0fcaa1fb124e448b8bacb6353fca9d5d. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:57:35.915113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-d5059920-1912-45ba-be75-3cb881710cdc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Getting quotas for user b7008c9b5ad94dbea7edc12267dae2b5 and project 0fcaa1fb124e448b8bacb6353fca9d5d. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:57:35.927651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d5059920-1912-45ba-be75-3cb881710cdc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:57:35.930020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d5059920-1912-45ba-be75-3cb881710cdc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:57:35.982980 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d5059920-1912-45ba-be75-3cb881710cdc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.636491 Oct 10 23:57:35.984020 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3253/6331] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:57:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 23:57:35.995881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-14c2950f-ab14-4788-bb48-5ffbcebf03fa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:35.996536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-14c2950f-ab14-4788-bb48-5ffbcebf03fa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:36.052802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-14c2950f-ab14-4788-bb48-5ffbcebf03fa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:36.060258 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-14c2950f-ab14-4788-bb48-5ffbcebf03fa tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae" status: 200 len: 1241 microversion: 2.1 time: 0.068740 Oct 10 23:57:36.061022 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3079/6332] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:35 2022] GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:36.323033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e59a6f95-dc16-431f-bfbf-e6043c503993 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:36.326217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e59a6f95-dc16-431f-bfbf-e6043c503993 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: b2d59383-8183-418f-96c6-cc05f94da40c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:36.335853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e59a6f95-dc16-431f-bfbf-e6043c503993 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:36.336354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e59a6f95-dc16-431f-bfbf-e6043c503993 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:36.336794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e59a6f95-dc16-431f-bfbf-e6043c503993 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:36.337991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e59a6f95-dc16-431f-bfbf-e6043c503993 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:36.338733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e59a6f95-dc16-431f-bfbf-e6043c503993 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:36.339172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e59a6f95-dc16-431f-bfbf-e6043c503993 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:36.511367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e59a6f95-dc16-431f-bfbf-e6043c503993 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:36.522235 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e59a6f95-dc16-431f-bfbf-e6043c503993 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c" status: 200 len: 1374 microversion: 2.1 time: 0.203115 Oct 10 23:57:36.523227 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3254/6333] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:36 2022] GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c => generated 1374 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:36.601591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-850cf98f-90c6-468c-8a8e-0c31e8d8ea57 req-0e56e95d-5efe-47ab-9802-e9f8cc085872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d59383-8183-418f-96c6-cc05f94da40c", "name": "network-vif-plugged", "status": "completed", "tag": "9083248e-ad11-44dc-b327-951c28e7d64d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:57:36.615514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-850cf98f-90c6-468c-8a8e-0c31e8d8ea57 req-0e56e95d-5efe-47ab-9802-e9f8cc085872 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:36.616174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-850cf98f-90c6-468c-8a8e-0c31e8d8ea57 req-0e56e95d-5efe-47ab-9802-e9f8cc085872 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:36.616769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-850cf98f-90c6-468c-8a8e-0c31e8d8ea57 req-0e56e95d-5efe-47ab-9802-e9f8cc085872 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:36.631253 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-850cf98f-90c6-468c-8a8e-0c31e8d8ea57 req-0e56e95d-5efe-47ab-9802-e9f8cc085872 service nova] Creating event network-vif-plugged:9083248e-ad11-44dc-b327-951c28e7d64d for instance b2d59383-8183-418f-96c6-cc05f94da40c on n-h2-860864-2 Oct 10 23:57:36.638796 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-850cf98f-90c6-468c-8a8e-0c31e8d8ea57 req-0e56e95d-5efe-47ab-9802-e9f8cc085872 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040990 Oct 10 23:57:36.639411 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3080/6334] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:57:37.261954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2cf335c0-b5d4-4c67-8ba0-0422fed9770d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:37.262665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2cf335c0-b5d4-4c67-8ba0-0422fed9770d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:37.272592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cf335c0-b5d4-4c67-8ba0-0422fed9770d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:37.273504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cf335c0-b5d4-4c67-8ba0-0422fed9770d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:37.274392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cf335c0-b5d4-4c67-8ba0-0422fed9770d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:37.275508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cf335c0-b5d4-4c67-8ba0-0422fed9770d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:37.276159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cf335c0-b5d4-4c67-8ba0-0422fed9770d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:37.276694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cf335c0-b5d4-4c67-8ba0-0422fed9770d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:37.403363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2cf335c0-b5d4-4c67-8ba0-0422fed9770d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:37.413366 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2cf335c0-b5d4-4c67-8ba0-0422fed9770d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae" status: 200 len: 1311 microversion: 2.1 time: 0.332909 Oct 10 23:57:37.414325 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3255/6335] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:37 2022] GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae => generated 1311 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:37.543801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:57:37.550495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bb756e4b-6798-4e70-afac-06950a0d5947 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:37.551651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bb756e4b-6798-4e70-afac-06950a0d5947 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: b2d59383-8183-418f-96c6-cc05f94da40c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:37.559525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb756e4b-6798-4e70-afac-06950a0d5947 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:37.560018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb756e4b-6798-4e70-afac-06950a0d5947 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:37.560456 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb756e4b-6798-4e70-afac-06950a0d5947 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:37.561452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb756e4b-6798-4e70-afac-06950a0d5947 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:37.561920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb756e4b-6798-4e70-afac-06950a0d5947 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:37.563869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb756e4b-6798-4e70-afac-06950a0d5947 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:37.737004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb756e4b-6798-4e70-afac-06950a0d5947 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:37.741883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:57:37.747744 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bb756e4b-6798-4e70-afac-06950a0d5947 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c" status: 200 len: 1374 microversion: 2.1 time: 0.205003 Oct 10 23:57:37.748551 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3081/6336] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:37 2022] GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c => generated 1374 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:38.437782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3633e3db-ac02-4819-96f1-3ba5984ceb2f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:38.439047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3633e3db-ac02-4819-96f1-3ba5984ceb2f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:38.445829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3633e3db-ac02-4819-96f1-3ba5984ceb2f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:38.447674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3633e3db-ac02-4819-96f1-3ba5984ceb2f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:38.448114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3633e3db-ac02-4819-96f1-3ba5984ceb2f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:38.449035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3633e3db-ac02-4819-96f1-3ba5984ceb2f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:38.449521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3633e3db-ac02-4819-96f1-3ba5984ceb2f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:38.449958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3633e3db-ac02-4819-96f1-3ba5984ceb2f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:38.779682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-08a5761a-dc03-45e9-bfa5-7abe413c37aa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:38.780218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-08a5761a-dc03-45e9-bfa5-7abe413c37aa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: b2d59383-8183-418f-96c6-cc05f94da40c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:38.791405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08a5761a-dc03-45e9-bfa5-7abe413c37aa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:38.792051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08a5761a-dc03-45e9-bfa5-7abe413c37aa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:38.792740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08a5761a-dc03-45e9-bfa5-7abe413c37aa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:38.793560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08a5761a-dc03-45e9-bfa5-7abe413c37aa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:38.795205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08a5761a-dc03-45e9-bfa5-7abe413c37aa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:38.795728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08a5761a-dc03-45e9-bfa5-7abe413c37aa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:38.963096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-08a5761a-dc03-45e9-bfa5-7abe413c37aa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:38.969435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3633e3db-ac02-4819-96f1-3ba5984ceb2f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:38.979302 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-08a5761a-dc03-45e9-bfa5-7abe413c37aa tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c" status: 200 len: 1546 microversion: 2.1 time: 0.203935 Oct 10 23:57:38.980056 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3082/6337] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:38 2022] GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c => generated 1546 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:57:38.980213 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3633e3db-ac02-4819-96f1-3ba5984ceb2f tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae" status: 200 len: 1366 microversion: 2.1 time: 0.546465 Oct 10 23:57:38.980743 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3256/6338] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:38 2022] GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae => generated 1366 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:39.004063 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8cdcd474-b4d3-4aed-8f04-6bfb8b95a6b4 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:39.004769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8cdcd474-b4d3-4aed-8f04-6bfb8b95a6b4 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: b2d59383-8183-418f-96c6-cc05f94da40c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:39.011292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cdcd474-b4d3-4aed-8f04-6bfb8b95a6b4 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:39.011782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cdcd474-b4d3-4aed-8f04-6bfb8b95a6b4 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:39.012225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cdcd474-b4d3-4aed-8f04-6bfb8b95a6b4 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:39.012946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cdcd474-b4d3-4aed-8f04-6bfb8b95a6b4 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:39.013510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cdcd474-b4d3-4aed-8f04-6bfb8b95a6b4 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:39.014102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cdcd474-b4d3-4aed-8f04-6bfb8b95a6b4 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:39.197061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8cdcd474-b4d3-4aed-8f04-6bfb8b95a6b4 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:39.207341 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8cdcd474-b4d3-4aed-8f04-6bfb8b95a6b4 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c" status: 200 len: 1546 microversion: 2.1 time: 0.207975 Oct 10 23:57:39.208280 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3083/6339] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:38 2022] GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c => generated 1546 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:39.381728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-21a50c93-18d8-49f3-8013-1af99c631f26 req-7b3967fe-bd61-45c6-92f3-ed444f1a2f57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e1755a-018f-4ce2-a49d-df4225ae03ae", "tag": "99bdec86-ea8b-49e2-8327-db793f2e67af"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:57:39.394123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-21a50c93-18d8-49f3-8013-1af99c631f26 req-7b3967fe-bd61-45c6-92f3-ed444f1a2f57 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:39.395826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-21a50c93-18d8-49f3-8013-1af99c631f26 req-7b3967fe-bd61-45c6-92f3-ed444f1a2f57 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:39.396634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-21a50c93-18d8-49f3-8013-1af99c631f26 req-7b3967fe-bd61-45c6-92f3-ed444f1a2f57 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:39.414899 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-21a50c93-18d8-49f3-8013-1af99c631f26 req-7b3967fe-bd61-45c6-92f3-ed444f1a2f57 service nova] Creating event network-changed:99bdec86-ea8b-49e2-8327-db793f2e67af for instance 39e1755a-018f-4ce2-a49d-df4225ae03ae on n-h1-860864-2 Oct 10 23:57:39.422833 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-21a50c93-18d8-49f3-8013-1af99c631f26 req-7b3967fe-bd61-45c6-92f3-ed444f1a2f57 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044882 Oct 10 23:57:39.424780 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3257/6340] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:57:40.004832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d2fa25a7-d7cc-4822-ab1a-7635befccddc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:40.005681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d2fa25a7-d7cc-4822-ab1a-7635befccddc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:40.013169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2fa25a7-d7cc-4822-ab1a-7635befccddc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:40.013820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2fa25a7-d7cc-4822-ab1a-7635befccddc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:40.014262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2fa25a7-d7cc-4822-ab1a-7635befccddc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:40.014976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2fa25a7-d7cc-4822-ab1a-7635befccddc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:40.015424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2fa25a7-d7cc-4822-ab1a-7635befccddc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:40.016641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d2fa25a7-d7cc-4822-ab1a-7635befccddc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:40.159572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d2fa25a7-d7cc-4822-ab1a-7635befccddc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:40.167795 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d2fa25a7-d7cc-4822-ab1a-7635befccddc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae" status: 200 len: 1366 microversion: 2.1 time: 0.167509 Oct 10 23:57:40.168392 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3084/6341] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:39 2022] GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:41.192540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-28ce841e-b050-4b62-a8f7-ced00de97c9c tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:41.195577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-28ce841e-b050-4b62-a8f7-ced00de97c9c tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:41.204803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28ce841e-b050-4b62-a8f7-ced00de97c9c tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:41.205627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28ce841e-b050-4b62-a8f7-ced00de97c9c tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:41.206109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28ce841e-b050-4b62-a8f7-ced00de97c9c tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:41.206826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28ce841e-b050-4b62-a8f7-ced00de97c9c tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:41.207294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28ce841e-b050-4b62-a8f7-ced00de97c9c tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:41.207999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-28ce841e-b050-4b62-a8f7-ced00de97c9c tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:41.372839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-28ce841e-b050-4b62-a8f7-ced00de97c9c tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:41.384500 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-28ce841e-b050-4b62-a8f7-ced00de97c9c tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae" status: 200 len: 1366 microversion: 2.1 time: 0.197113 Oct 10 23:57:41.393185 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3258/6342] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:41 2022] GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:42.412218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7f54d070-6528-42dc-b6d7-d24156c2f010 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:42.414321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7f54d070-6528-42dc-b6d7-d24156c2f010 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:42.431640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f54d070-6528-42dc-b6d7-d24156c2f010 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:42.433479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f54d070-6528-42dc-b6d7-d24156c2f010 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:42.434099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f54d070-6528-42dc-b6d7-d24156c2f010 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:42.435546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f54d070-6528-42dc-b6d7-d24156c2f010 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:42.436909 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f54d070-6528-42dc-b6d7-d24156c2f010 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:42.439357 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7f54d070-6528-42dc-b6d7-d24156c2f010 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:42.670977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7f54d070-6528-42dc-b6d7-d24156c2f010 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:42.680581 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7f54d070-6528-42dc-b6d7-d24156c2f010 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae" status: 200 len: 1366 microversion: 2.1 time: 0.276035 Oct 10 23:57:42.681463 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3085/6343] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:42 2022] GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:43.708962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b557dcef-2310-4dc3-b747-7f5bc092dfbc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:43.708962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b557dcef-2310-4dc3-b747-7f5bc092dfbc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:43.724278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b557dcef-2310-4dc3-b747-7f5bc092dfbc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:43.724278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b557dcef-2310-4dc3-b747-7f5bc092dfbc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:43.725489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b557dcef-2310-4dc3-b747-7f5bc092dfbc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:43.726451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b557dcef-2310-4dc3-b747-7f5bc092dfbc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:43.727771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b557dcef-2310-4dc3-b747-7f5bc092dfbc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:43.728381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b557dcef-2310-4dc3-b747-7f5bc092dfbc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:43.904729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b557dcef-2310-4dc3-b747-7f5bc092dfbc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:43.913478 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b557dcef-2310-4dc3-b747-7f5bc092dfbc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae" status: 200 len: 1366 microversion: 2.1 time: 0.212854 Oct 10 23:57:43.914077 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3259/6344] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:43 2022] GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:44.942182 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-14ca968d-6d2c-4b30-824d-c05908c4fcc2 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:44.943725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-14ca968d-6d2c-4b30-824d-c05908c4fcc2 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:44.950861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14ca968d-6d2c-4b30-824d-c05908c4fcc2 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:44.951462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14ca968d-6d2c-4b30-824d-c05908c4fcc2 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:44.951950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14ca968d-6d2c-4b30-824d-c05908c4fcc2 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:44.952843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14ca968d-6d2c-4b30-824d-c05908c4fcc2 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:44.954451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14ca968d-6d2c-4b30-824d-c05908c4fcc2 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:44.954966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-14ca968d-6d2c-4b30-824d-c05908c4fcc2 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:45.101030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-f6ac87a8-bc7d-4750-8c5e-09e58160ab18 req-9779021a-7f95-4690-b6dc-0938cebd8552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e1755a-018f-4ce2-a49d-df4225ae03ae", "name": "network-vif-plugged", "status": "completed", "tag": "99bdec86-ea8b-49e2-8327-db793f2e67af"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:57:45.110005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-14ca968d-6d2c-4b30-824d-c05908c4fcc2 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:45.119601 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-14ca968d-6d2c-4b30-824d-c05908c4fcc2 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae" status: 200 len: 1366 microversion: 2.1 time: 0.183851 Oct 10 23:57:45.120836 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3086/6345] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:44 2022] GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:57:45.123243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f6ac87a8-bc7d-4750-8c5e-09e58160ab18 req-9779021a-7f95-4690-b6dc-0938cebd8552 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:45.123501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f6ac87a8-bc7d-4750-8c5e-09e58160ab18 req-9779021a-7f95-4690-b6dc-0938cebd8552 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:45.124160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f6ac87a8-bc7d-4750-8c5e-09e58160ab18 req-9779021a-7f95-4690-b6dc-0938cebd8552 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:45.137459 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-f6ac87a8-bc7d-4750-8c5e-09e58160ab18 req-9779021a-7f95-4690-b6dc-0938cebd8552 service nova] Creating event network-vif-plugged:99bdec86-ea8b-49e2-8327-db793f2e67af for instance 39e1755a-018f-4ce2-a49d-df4225ae03ae on n-h1-860864-2 Oct 10 23:57:45.143778 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-f6ac87a8-bc7d-4750-8c5e-09e58160ab18 req-9779021a-7f95-4690-b6dc-0938cebd8552 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046230 Oct 10 23:57:45.144618 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3260/6346] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:57:46.150455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fae445cf-a37a-4659-abf9-54fe344e2ce1 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:46.151233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fae445cf-a37a-4659-abf9-54fe344e2ce1 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:46.154044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=12 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:57:46.154862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:57:46.161299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fae445cf-a37a-4659-abf9-54fe344e2ce1 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:46.161822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fae445cf-a37a-4659-abf9-54fe344e2ce1 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:46.162261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fae445cf-a37a-4659-abf9-54fe344e2ce1 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:46.162966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fae445cf-a37a-4659-abf9-54fe344e2ce1 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:46.163417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fae445cf-a37a-4659-abf9-54fe344e2ce1 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:46.163843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fae445cf-a37a-4659-abf9-54fe344e2ce1 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:46.308168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fae445cf-a37a-4659-abf9-54fe344e2ce1 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:46.317026 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fae445cf-a37a-4659-abf9-54fe344e2ce1 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae" status: 200 len: 1366 microversion: 2.1 time: 0.170441 Oct 10 23:57:46.317732 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3087/6347] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:46 2022] GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:47.182758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:57:47.183556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=12 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:57:47.189072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-353fad9f-cb57-41af-86e9-c128884bf8f8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:47.189800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-353fad9f-cb57-41af-86e9-c128884bf8f8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:47.196878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-353fad9f-cb57-41af-86e9-c128884bf8f8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:47.197366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-353fad9f-cb57-41af-86e9-c128884bf8f8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:47.197822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-353fad9f-cb57-41af-86e9-c128884bf8f8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:47.198513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-353fad9f-cb57-41af-86e9-c128884bf8f8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:47.198965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-353fad9f-cb57-41af-86e9-c128884bf8f8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:47.199391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-353fad9f-cb57-41af-86e9-c128884bf8f8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:47.341770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ccc03ab3-025f-4646-b073-8f3085bb4db3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:47.342550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ccc03ab3-025f-4646-b073-8f3085bb4db3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:47.349651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-353fad9f-cb57-41af-86e9-c128884bf8f8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:47.350976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccc03ab3-025f-4646-b073-8f3085bb4db3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:47.351595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccc03ab3-025f-4646-b073-8f3085bb4db3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:47.352139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccc03ab3-025f-4646-b073-8f3085bb4db3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:47.352949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccc03ab3-025f-4646-b073-8f3085bb4db3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:47.353548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccc03ab3-025f-4646-b073-8f3085bb4db3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:47.354081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccc03ab3-025f-4646-b073-8f3085bb4db3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:47.357762 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-353fad9f-cb57-41af-86e9-c128884bf8f8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1683 microversion: 2.1 time: 0.175958 Oct 10 23:57:47.358670 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3261/6348] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:47 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:47.466709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2286dd4f-4d8e-486d-8ad7-a4c949ee82f0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:57:47.470365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2286dd4f-4d8e-486d-8ad7-a4c949ee82f0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:47.479254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2286dd4f-4d8e-486d-8ad7-a4c949ee82f0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:47.479775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2286dd4f-4d8e-486d-8ad7-a4c949ee82f0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:47.480405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2286dd4f-4d8e-486d-8ad7-a4c949ee82f0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:47.481291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2286dd4f-4d8e-486d-8ad7-a4c949ee82f0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:47.481779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2286dd4f-4d8e-486d-8ad7-a4c949ee82f0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:47.482389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2286dd4f-4d8e-486d-8ad7-a4c949ee82f0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:47.545089 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2286dd4f-4d8e-486d-8ad7-a4c949ee82f0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "POST /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864/action" status: 200 len: 32618 microversion: 2.1 time: 0.081522 Oct 10 23:57:47.547799 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3262/6349] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:57:47 2022] POST /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864/action => generated 32618 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 23:57:47.578515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ccc03ab3-025f-4646-b073-8f3085bb4db3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:47.587672 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ccc03ab3-025f-4646-b073-8f3085bb4db3 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae" status: 200 len: 1555 microversion: 2.1 time: 0.249826 Oct 10 23:57:47.588257 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3088/6350] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:47 2022] GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae => generated 1555 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:47.615465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-42eb0197-3c5d-4371-938e-b2119190b048 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:47.616883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-42eb0197-3c5d-4371-938e-b2119190b048 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:47.621703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:57:47.628800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42eb0197-3c5d-4371-938e-b2119190b048 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:47.629866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42eb0197-3c5d-4371-938e-b2119190b048 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:47.630498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42eb0197-3c5d-4371-938e-b2119190b048 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:47.633485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42eb0197-3c5d-4371-938e-b2119190b048 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:47.634158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42eb0197-3c5d-4371-938e-b2119190b048 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:47.634780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42eb0197-3c5d-4371-938e-b2119190b048 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:47.698296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-efaadfae-6ee1-4c5c-9360-3ac5eb063aca tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:47.698907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-efaadfae-6ee1-4c5c-9360-3ac5eb063aca tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:47.708477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efaadfae-6ee1-4c5c-9360-3ac5eb063aca tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:47.709250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efaadfae-6ee1-4c5c-9360-3ac5eb063aca tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:47.709746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efaadfae-6ee1-4c5c-9360-3ac5eb063aca tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:47.710496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efaadfae-6ee1-4c5c-9360-3ac5eb063aca tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:47.710951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efaadfae-6ee1-4c5c-9360-3ac5eb063aca tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:47.711375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-efaadfae-6ee1-4c5c-9360-3ac5eb063aca tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:47.738666 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-42eb0197-3c5d-4371-938e-b2119190b048 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128838 Oct 10 23:57:47.739563 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3263/6351] 10.222.0.23 () {58 vars in 1275 bytes} [Mon Oct 10 23:57:47 2022] GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:57:47.880087 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-efaadfae-6ee1-4c5c-9360-3ac5eb063aca tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1834 microversion: 2.1 time: 0.185443 Oct 10 23:57:47.881017 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3089/6352] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:47 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1834 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:47.912153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bffb0d09-544f-4b4e-98d0-91ed805d1d19 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:57:47.914750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bffb0d09-544f-4b4e-98d0-91ed805d1d19 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:47.922869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bffb0d09-544f-4b4e-98d0-91ed805d1d19 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:47.923495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bffb0d09-544f-4b4e-98d0-91ed805d1d19 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:47.924060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bffb0d09-544f-4b4e-98d0-91ed805d1d19 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:47.924877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bffb0d09-544f-4b4e-98d0-91ed805d1d19 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:47.925465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bffb0d09-544f-4b4e-98d0-91ed805d1d19 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:47.925995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bffb0d09-544f-4b4e-98d0-91ed805d1d19 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:48.041083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-bffb0d09-544f-4b4e-98d0-91ed805d1d19 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lazy-loading 'flavor' on Instance uuid d4e8452c-1481-41ab-96c0-62b302343864 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:57:48.060212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bffb0d09-544f-4b4e-98d0-91ed805d1d19 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Going to try to live migrate instance to another host {{(pid=120613) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 23:57:49.075746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-9d102589-200d-4772-99e4-6ac12fc90501 req-fa0bffc6-47d6-44a4-9a7f-a642668f21c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e1755a-018f-4ce2-a49d-df4225ae03ae", "tag": "99bdec86-ea8b-49e2-8327-db793f2e67af"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:57:49.087464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9d102589-200d-4772-99e4-6ac12fc90501 req-fa0bffc6-47d6-44a4-9a7f-a642668f21c0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:49.088322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9d102589-200d-4772-99e4-6ac12fc90501 req-fa0bffc6-47d6-44a4-9a7f-a642668f21c0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:49.088986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9d102589-200d-4772-99e4-6ac12fc90501 req-fa0bffc6-47d6-44a4-9a7f-a642668f21c0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:49.105092 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-9d102589-200d-4772-99e4-6ac12fc90501 req-fa0bffc6-47d6-44a4-9a7f-a642668f21c0 service nova] Creating event network-changed:99bdec86-ea8b-49e2-8327-db793f2e67af for instance 39e1755a-018f-4ce2-a49d-df4225ae03ae on n-h1-860864-2 Oct 10 23:57:49.111666 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-9d102589-200d-4772-99e4-6ac12fc90501 req-fa0bffc6-47d6-44a4-9a7f-a642668f21c0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040015 Oct 10 23:57:49.112933 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3090/6353] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:57:50.426003 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bffb0d09-544f-4b4e-98d0-91ed805d1d19 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864/action" status: 202 len: 0 microversion: 2.1 time: 2.517376 Oct 10 23:57:50.426756 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3264/6354] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:57:47 2022] POST /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864/action => generated 0 bytes in 2520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:57:50.439819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c183863b-e6d8-4b53-8f92-3e8a5251fb9d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:50.440693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c183863b-e6d8-4b53-8f92-3e8a5251fb9d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:50.447527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c183863b-e6d8-4b53-8f92-3e8a5251fb9d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:50.448176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c183863b-e6d8-4b53-8f92-3e8a5251fb9d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:50.448765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c183863b-e6d8-4b53-8f92-3e8a5251fb9d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:50.449938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c183863b-e6d8-4b53-8f92-3e8a5251fb9d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:50.450496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c183863b-e6d8-4b53-8f92-3e8a5251fb9d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:50.451137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c183863b-e6d8-4b53-8f92-3e8a5251fb9d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:50.635254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c183863b-e6d8-4b53-8f92-3e8a5251fb9d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:50.643867 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c183863b-e6d8-4b53-8f92-3e8a5251fb9d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1693 microversion: 2.1 time: 0.211516 Oct 10 23:57:50.644627 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3091/6355] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:50 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1693 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:51.670148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a486e20d-fc13-4294-9643-65460147ffe9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:51.671428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a486e20d-fc13-4294-9643-65460147ffe9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:51.681071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a486e20d-fc13-4294-9643-65460147ffe9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:51.681914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a486e20d-fc13-4294-9643-65460147ffe9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:51.682439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a486e20d-fc13-4294-9643-65460147ffe9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:51.683253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a486e20d-fc13-4294-9643-65460147ffe9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:51.683789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a486e20d-fc13-4294-9643-65460147ffe9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:51.684318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a486e20d-fc13-4294-9643-65460147ffe9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:51.839555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a486e20d-fc13-4294-9643-65460147ffe9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:51.848539 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a486e20d-fc13-4294-9643-65460147ffe9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1693 microversion: 2.1 time: 0.182276 Oct 10 23:57:51.849277 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3265/6356] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:51 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1693 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:51.915715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-e0d82da9-abee-4e63-b6ed-b1382ecbcb8a req-ee44e1d8-7347-4321-8763-521d5cfb818f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e8452c-1481-41ab-96c0-62b302343864", "name": "network-vif-unplugged", "status": "completed", "tag": "cff1d37d-2601-472e-ad65-d6a7e2ef9ec9"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:57:51.929410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e0d82da9-abee-4e63-b6ed-b1382ecbcb8a req-ee44e1d8-7347-4321-8763-521d5cfb818f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:51.930512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e0d82da9-abee-4e63-b6ed-b1382ecbcb8a req-ee44e1d8-7347-4321-8763-521d5cfb818f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:51.931241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e0d82da9-abee-4e63-b6ed-b1382ecbcb8a req-ee44e1d8-7347-4321-8763-521d5cfb818f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:51.944819 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-e0d82da9-abee-4e63-b6ed-b1382ecbcb8a req-ee44e1d8-7347-4321-8763-521d5cfb818f service nova] Creating event network-vif-unplugged:cff1d37d-2601-472e-ad65-d6a7e2ef9ec9 for instance d4e8452c-1481-41ab-96c0-62b302343864 on n-h1-860864-2 Oct 10 23:57:51.950120 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-e0d82da9-abee-4e63-b6ed-b1382ecbcb8a req-ee44e1d8-7347-4321-8763-521d5cfb818f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039001 Oct 10 23:57:51.951194 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3092/6357] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:57:52.872380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1ba43c56-5a53-4a4c-960e-973b60b99bf3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:52.873037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1ba43c56-5a53-4a4c-960e-973b60b99bf3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:52.881278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ba43c56-5a53-4a4c-960e-973b60b99bf3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:52.881807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ba43c56-5a53-4a4c-960e-973b60b99bf3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:52.882259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ba43c56-5a53-4a4c-960e-973b60b99bf3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:52.882959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ba43c56-5a53-4a4c-960e-973b60b99bf3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:52.883423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ba43c56-5a53-4a4c-960e-973b60b99bf3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:52.883859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ba43c56-5a53-4a4c-960e-973b60b99bf3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:53.030287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1ba43c56-5a53-4a4c-960e-973b60b99bf3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:53.039021 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1ba43c56-5a53-4a4c-960e-973b60b99bf3 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1693 microversion: 2.1 time: 0.170686 Oct 10 23:57:53.039634 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3266/6358] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:52 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1693 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:53.985048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-edbc1a46-9287-434c-9d53-5c17bb7b181a req-055fed16-70dc-4853-a00e-4262ed56743d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e8452c-1481-41ab-96c0-62b302343864", "tag": "cff1d37d-2601-472e-ad65-d6a7e2ef9ec9"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:57:53.996106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-edbc1a46-9287-434c-9d53-5c17bb7b181a req-055fed16-70dc-4853-a00e-4262ed56743d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:53.996593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-edbc1a46-9287-434c-9d53-5c17bb7b181a req-055fed16-70dc-4853-a00e-4262ed56743d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:53.997010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-edbc1a46-9287-434c-9d53-5c17bb7b181a req-055fed16-70dc-4853-a00e-4262ed56743d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:54.009226 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-edbc1a46-9287-434c-9d53-5c17bb7b181a req-055fed16-70dc-4853-a00e-4262ed56743d service nova] Creating event network-changed:cff1d37d-2601-472e-ad65-d6a7e2ef9ec9 for instance d4e8452c-1481-41ab-96c0-62b302343864 on n-h1-860864-2 Oct 10 23:57:54.014232 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-edbc1a46-9287-434c-9d53-5c17bb7b181a req-055fed16-70dc-4853-a00e-4262ed56743d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033991 Oct 10 23:57:54.014834 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3093/6359] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:57:54.062218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3a0104a3-5900-46cb-8723-c0394f944aa1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:54.063855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3a0104a3-5900-46cb-8723-c0394f944aa1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:54.071523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a0104a3-5900-46cb-8723-c0394f944aa1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:54.072233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a0104a3-5900-46cb-8723-c0394f944aa1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:54.072685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a0104a3-5900-46cb-8723-c0394f944aa1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:54.073411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a0104a3-5900-46cb-8723-c0394f944aa1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:54.074246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a0104a3-5900-46cb-8723-c0394f944aa1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:54.074686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a0104a3-5900-46cb-8723-c0394f944aa1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:54.326274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3a0104a3-5900-46cb-8723-c0394f944aa1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:54.335555 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3a0104a3-5900-46cb-8723-c0394f944aa1 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1693 microversion: 2.1 time: 0.277341 Oct 10 23:57:54.336313 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3267/6360] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:54 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1693 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:55.362663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-82f0e088-4644-4e99-b30a-a42459462a6a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:55.363596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-82f0e088-4644-4e99-b30a-a42459462a6a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:55.370102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82f0e088-4644-4e99-b30a-a42459462a6a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:55.370713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82f0e088-4644-4e99-b30a-a42459462a6a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:55.371160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82f0e088-4644-4e99-b30a-a42459462a6a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:55.371863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82f0e088-4644-4e99-b30a-a42459462a6a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:55.372313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82f0e088-4644-4e99-b30a-a42459462a6a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:55.372743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82f0e088-4644-4e99-b30a-a42459462a6a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:55.519798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-82f0e088-4644-4e99-b30a-a42459462a6a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:55.527949 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-82f0e088-4644-4e99-b30a-a42459462a6a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1693 microversion: 2.1 time: 0.171272 Oct 10 23:57:55.528452 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3094/6361] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:55 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:57:56.553080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3099a12f-db39-4fba-899a-0993f75746cf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:56.553727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3099a12f-db39-4fba-899a-0993f75746cf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:56.560556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3099a12f-db39-4fba-899a-0993f75746cf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:56.561036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3099a12f-db39-4fba-899a-0993f75746cf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:56.561508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3099a12f-db39-4fba-899a-0993f75746cf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:56.562193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3099a12f-db39-4fba-899a-0993f75746cf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:56.562643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3099a12f-db39-4fba-899a-0993f75746cf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:56.564356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3099a12f-db39-4fba-899a-0993f75746cf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:56.709698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3099a12f-db39-4fba-899a-0993f75746cf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:56.717443 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3099a12f-db39-4fba-899a-0993f75746cf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1693 microversion: 2.1 time: 0.168249 Oct 10 23:57:56.718217 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3268/6362] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:56 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:57.741918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5f0c971d-bab0-4073-9aca-42b67aa46528 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:57.742534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5f0c971d-bab0-4073-9aca-42b67aa46528 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:57.749801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f0c971d-bab0-4073-9aca-42b67aa46528 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:57.750380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f0c971d-bab0-4073-9aca-42b67aa46528 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:57.750821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f0c971d-bab0-4073-9aca-42b67aa46528 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:57.751527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f0c971d-bab0-4073-9aca-42b67aa46528 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:57.751980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f0c971d-bab0-4073-9aca-42b67aa46528 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:57.752411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f0c971d-bab0-4073-9aca-42b67aa46528 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:57.908441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5f0c971d-bab0-4073-9aca-42b67aa46528 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:57.917159 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5f0c971d-bab0-4073-9aca-42b67aa46528 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1693 microversion: 2.1 time: 0.178970 Oct 10 23:57:57.917768 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3095/6363] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:57 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1693 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:57:58.943513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fae03f36-9335-4ffd-830c-423b03da743d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:57:58.944731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fae03f36-9335-4ffd-830c-423b03da743d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:57:58.954637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fae03f36-9335-4ffd-830c-423b03da743d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:58.955531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fae03f36-9335-4ffd-830c-423b03da743d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:58.956058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fae03f36-9335-4ffd-830c-423b03da743d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:58.956867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fae03f36-9335-4ffd-830c-423b03da743d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:57:58.957843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fae03f36-9335-4ffd-830c-423b03da743d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:57:58.957985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fae03f36-9335-4ffd-830c-423b03da743d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:57:59.131619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fae03f36-9335-4ffd-830c-423b03da743d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:57:59.146710 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fae03f36-9335-4ffd-830c-423b03da743d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1693 microversion: 2.1 time: 0.207090 Oct 10 23:57:59.163154 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3269/6364] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:57:58 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1693 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:00.177781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-36332d95-307f-442f-8a46-bbf461f5f63d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:00.179529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-36332d95-307f-442f-8a46-bbf461f5f63d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:00.195594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36332d95-307f-442f-8a46-bbf461f5f63d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:00.196270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36332d95-307f-442f-8a46-bbf461f5f63d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:00.196970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36332d95-307f-442f-8a46-bbf461f5f63d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:00.197711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36332d95-307f-442f-8a46-bbf461f5f63d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:00.198176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36332d95-307f-442f-8a46-bbf461f5f63d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:00.198610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-36332d95-307f-442f-8a46-bbf461f5f63d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:00.350445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-36332d95-307f-442f-8a46-bbf461f5f63d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:00.358594 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-36332d95-307f-442f-8a46-bbf461f5f63d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1683 microversion: 2.1 time: 0.190305 Oct 10 23:58:00.359184 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3096/6365] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:00 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1683 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:00.382221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7e5888ff-07f5-4e7b-817c-6f985d64f320 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:00.382950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7e5888ff-07f5-4e7b-817c-6f985d64f320 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:00.390444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e5888ff-07f5-4e7b-817c-6f985d64f320 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:00.391570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e5888ff-07f5-4e7b-817c-6f985d64f320 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:00.392014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e5888ff-07f5-4e7b-817c-6f985d64f320 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:00.392733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e5888ff-07f5-4e7b-817c-6f985d64f320 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:00.393300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e5888ff-07f5-4e7b-817c-6f985d64f320 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:00.393678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e5888ff-07f5-4e7b-817c-6f985d64f320 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:00.397720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:58:00.555292 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7e5888ff-07f5-4e7b-817c-6f985d64f320 tempest-TestNetworkAdvancedServerOps-411897544 tempest-TestNetworkAdvancedServerOps-411897544-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1834 microversion: 2.1 time: 0.176534 Oct 10 23:58:00.556219 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3270/6366] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:00 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1834 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:00.588824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3ee47c2a-e8ab-4c82-91e7-5cd9894ee983 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:00.589493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3ee47c2a-e8ab-4c82-91e7-5cd9894ee983 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:00.596598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ee47c2a-e8ab-4c82-91e7-5cd9894ee983 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:00.597217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ee47c2a-e8ab-4c82-91e7-5cd9894ee983 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:00.597906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ee47c2a-e8ab-4c82-91e7-5cd9894ee983 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:00.598723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ee47c2a-e8ab-4c82-91e7-5cd9894ee983 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:00.599282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ee47c2a-e8ab-4c82-91e7-5cd9894ee983 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:00.600056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ee47c2a-e8ab-4c82-91e7-5cd9894ee983 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:00.743439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3ee47c2a-e8ab-4c82-91e7-5cd9894ee983 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:00.752222 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3ee47c2a-e8ab-4c82-91e7-5cd9894ee983 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1683 microversion: 2.1 time: 0.167304 Oct 10 23:58:00.752814 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3097/6367] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:00 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:00.855692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f08658ea-95d8-4ac3-869f-7807826a1577 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:58:00.858009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f08658ea-95d8-4ac3-869f-7807826a1577 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:00.864900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f08658ea-95d8-4ac3-869f-7807826a1577 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:00.865417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f08658ea-95d8-4ac3-869f-7807826a1577 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:00.865865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f08658ea-95d8-4ac3-869f-7807826a1577 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:00.866574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f08658ea-95d8-4ac3-869f-7807826a1577 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:00.867034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f08658ea-95d8-4ac3-869f-7807826a1577 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:00.867461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f08658ea-95d8-4ac3-869f-7807826a1577 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:00.928362 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f08658ea-95d8-4ac3-869f-7807826a1577 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "POST /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864/action" status: 200 len: 38405 microversion: 2.1 time: 0.076335 Oct 10 23:58:00.929745 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3271/6368] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:58:00 2022] POST /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864/action => generated 38405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:58:02.026643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fdb1043b-7f96-4641-ad86-b38b5b8b0ef6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:02.028633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fdb1043b-7f96-4641-ad86-b38b5b8b0ef6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:02.037966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdb1043b-7f96-4641-ad86-b38b5b8b0ef6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:02.038459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdb1043b-7f96-4641-ad86-b38b5b8b0ef6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:02.039073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdb1043b-7f96-4641-ad86-b38b5b8b0ef6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:02.039919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdb1043b-7f96-4641-ad86-b38b5b8b0ef6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:02.040381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdb1043b-7f96-4641-ad86-b38b5b8b0ef6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:02.041000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fdb1043b-7f96-4641-ad86-b38b5b8b0ef6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:02.073267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fdb1043b-7f96-4641-ad86-b38b5b8b0ef6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:58:02.102815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-07873338-cca7-4dcb-8630-d343cecf8384 req-372e7b99-fe02-4757-ac7c-ffb83a4980b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e8452c-1481-41ab-96c0-62b302343864", "tag": "cff1d37d-2601-472e-ad65-d6a7e2ef9ec9"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:58:02.122941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-07873338-cca7-4dcb-8630-d343cecf8384 req-372e7b99-fe02-4757-ac7c-ffb83a4980b8 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:02.126082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-07873338-cca7-4dcb-8630-d343cecf8384 req-372e7b99-fe02-4757-ac7c-ffb83a4980b8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:02.127892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-07873338-cca7-4dcb-8630-d343cecf8384 req-372e7b99-fe02-4757-ac7c-ffb83a4980b8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:02.137246 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:58:02.148709 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-07873338-cca7-4dcb-8630-d343cecf8384 req-372e7b99-fe02-4757-ac7c-ffb83a4980b8 service nova] Creating event network-changed:cff1d37d-2601-472e-ad65-d6a7e2ef9ec9 for instance d4e8452c-1481-41ab-96c0-62b302343864 on n-h2-860864-2 Oct 10 23:58:02.159721 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-07873338-cca7-4dcb-8630-d343cecf8384 req-372e7b99-fe02-4757-ac7c-ffb83a4980b8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133369 Oct 10 23:58:02.160531 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3272/6369] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:58:02.181813 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fdb1043b-7f96-4641-ad86-b38b5b8b0ef6 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 204 len: 0 microversion: 2.1 time: 0.160148 Oct 10 23:58:02.186002 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3098/6370] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:58:02 2022] DELETE /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:58:02.193190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-46a27652-a4dd-459b-a071-1f75ce9808ee tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:02.194156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-46a27652-a4dd-459b-a071-1f75ce9808ee tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:02.201245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46a27652-a4dd-459b-a071-1f75ce9808ee tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:02.202008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46a27652-a4dd-459b-a071-1f75ce9808ee tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:02.202636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46a27652-a4dd-459b-a071-1f75ce9808ee tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:02.203617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46a27652-a4dd-459b-a071-1f75ce9808ee tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:02.204261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46a27652-a4dd-459b-a071-1f75ce9808ee tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:02.204870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46a27652-a4dd-459b-a071-1f75ce9808ee tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:02.362760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-46a27652-a4dd-459b-a071-1f75ce9808ee tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:02.381955 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-46a27652-a4dd-459b-a071-1f75ce9808ee tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1689 microversion: 2.1 time: 0.192479 Oct 10 23:58:02.383940 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3273/6371] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:02 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1689 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:03.408176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cef31ab5-49c1-445c-b3f1-a7b444bcbf0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:03.409617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cef31ab5-49c1-445c-b3f1-a7b444bcbf0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:03.416541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cef31ab5-49c1-445c-b3f1-a7b444bcbf0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:03.417033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cef31ab5-49c1-445c-b3f1-a7b444bcbf0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:03.417501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cef31ab5-49c1-445c-b3f1-a7b444bcbf0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:03.418212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cef31ab5-49c1-445c-b3f1-a7b444bcbf0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:03.418672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cef31ab5-49c1-445c-b3f1-a7b444bcbf0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:03.419353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cef31ab5-49c1-445c-b3f1-a7b444bcbf0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:03.457914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cef31ab5-49c1-445c-b3f1-a7b444bcbf0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:03.458914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cef31ab5-49c1-445c-b3f1-a7b444bcbf0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:03.459717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cef31ab5-49c1-445c-b3f1-a7b444bcbf0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:03.460335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-cef31ab5-49c1-445c-b3f1-a7b444bcbf0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lazy-loading 'fault' on Instance uuid d4e8452c-1481-41ab-96c0-62b302343864 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:58:03.511457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cef31ab5-49c1-445c-b3f1-a7b444bcbf0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:03.520991 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cef31ab5-49c1-445c-b3f1-a7b444bcbf0a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 200 len: 1357 microversion: 2.1 time: 0.117203 Oct 10 23:58:03.521638 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3099/6372] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:03 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 1357 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:04.174652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-66919a26-27e3-46ba-978c-a6d3c982a9c8 req-ea362b77-4f56-40a6-821e-319b56668b78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e8452c-1481-41ab-96c0-62b302343864", "name": "network-vif-deleted", "tag": "cff1d37d-2601-472e-ad65-d6a7e2ef9ec9"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:58:04.185633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-66919a26-27e3-46ba-978c-a6d3c982a9c8 req-ea362b77-4f56-40a6-821e-319b56668b78 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:04.186117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-66919a26-27e3-46ba-978c-a6d3c982a9c8 req-ea362b77-4f56-40a6-821e-319b56668b78 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:04.186555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-66919a26-27e3-46ba-978c-a6d3c982a9c8 req-ea362b77-4f56-40a6-821e-319b56668b78 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:04.198210 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-66919a26-27e3-46ba-978c-a6d3c982a9c8 req-ea362b77-4f56-40a6-821e-319b56668b78 service nova] Creating event network-vif-deleted:cff1d37d-2601-472e-ad65-d6a7e2ef9ec9 for instance d4e8452c-1481-41ab-96c0-62b302343864 on n-h2-860864-2 Oct 10 23:58:04.202974 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-66919a26-27e3-46ba-978c-a6d3c982a9c8 req-ea362b77-4f56-40a6-821e-319b56668b78 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032658 Oct 10 23:58:04.203840 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3274/6373] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:58:04.547792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b1b2f081-d89f-4f7c-a57b-557033efcbc0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:04.548328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b1b2f081-d89f-4f7c-a57b-557033efcbc0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: d4e8452c-1481-41ab-96c0-62b302343864] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:04.555660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1b2f081-d89f-4f7c-a57b-557033efcbc0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:04.556144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1b2f081-d89f-4f7c-a57b-557033efcbc0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:04.556611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1b2f081-d89f-4f7c-a57b-557033efcbc0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:04.557298 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1b2f081-d89f-4f7c-a57b-557033efcbc0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:04.557783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1b2f081-d89f-4f7c-a57b-557033efcbc0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:04.558208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1b2f081-d89f-4f7c-a57b-557033efcbc0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:04.571930 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-b1b2f081-d89f-4f7c-a57b-557033efcbc0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] HTTP exception thrown: Instance d4e8452c-1481-41ab-96c0-62b302343864 could not be found. Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b1b2f081-d89f-4f7c-a57b-557033efcbc0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Request method failure captured: Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 HTTP/1.1 Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK-BB4x4tnje8g7V7yndZ-eCfyvwZsAbSuBD8sfr6-xUWiLbFDaunp7PR2T5QmNvvFy5RcKeKPLvsd2T_42GBJZpMrvANis61xLfLWHDewFuoiaKXb-VOoVnXShsE7RvrF0WakEav91aLufkTYJLnPujB4bORnh17YSIuys0bjxdSkA Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: fce4582b30d041c592240d09a95a37e5 Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-704048199 Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fce4582b30d041c592240d09a95a37e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fce4582b30d041c592240d09a95a37e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fce4582b30d041c592240d09a95a37e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fce4582b30d041c592240d09a95a37e5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TestNetworkAdvancedServerOps-704048199 Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: fce4582b30d041c592240d09a95a37e5 Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-704048199 Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TestNetworkAdvancedServerOps-704048199-project Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: ce22396752cd4d71991c6994a31f4905 Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TestNetworkAdvancedServerOps-704048199-project Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance d4e8452c-1481-41ab-96c0-62b302343864 could not be found. Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'd4e8452c-1481-41ab-96c0-62b302343864'} Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4e8452c-1481-41ab-96c0-62b302343864 could not be found. Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4e8452c-1481-41ab-96c0-62b302343864 could not be found. Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:58:04.573621 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:58:04.582577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:58:04.582577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:58:04.582577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:58:04.582577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:58:04.582577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:58:04.582577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:58:04.582577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4e8452c-1481-41ab-96c0-62b302343864 could not be found. Oct 10 23:58:04.582577 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:58:04.582577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b1b2f081-d89f-4f7c-a57b-557033efcbc0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Returning 404 to user: Instance d4e8452c-1481-41ab-96c0-62b302343864 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:58:04.582577 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b1b2f081-d89f-4f7c-a57b-557033efcbc0 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864" status: 404 len: 111 microversion: 2.1 time: 0.031540 Oct 10 23:58:04.582577 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3100/6374] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:04 2022] GET /compute/v2.1/servers/d4e8452c-1481-41ab-96c0-62b302343864 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:58:08.180293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b3578c7a-f037-4f96-8e01-8aa220b7aa66 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:08.182759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b3578c7a-f037-4f96-8e01-8aa220b7aa66 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: b2d59383-8183-418f-96c6-cc05f94da40c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:08.194503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3578c7a-f037-4f96-8e01-8aa220b7aa66 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:08.195287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3578c7a-f037-4f96-8e01-8aa220b7aa66 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:08.196032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3578c7a-f037-4f96-8e01-8aa220b7aa66 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:08.197001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3578c7a-f037-4f96-8e01-8aa220b7aa66 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:08.197558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3578c7a-f037-4f96-8e01-8aa220b7aa66 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:08.198356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3578c7a-f037-4f96-8e01-8aa220b7aa66 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:08.240893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b3578c7a-f037-4f96-8e01-8aa220b7aa66 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: b2d59383-8183-418f-96c6-cc05f94da40c] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:58:08.380513 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b3578c7a-f037-4f96-8e01-8aa220b7aa66 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c" status: 204 len: 0 microversion: 2.1 time: 0.200700 Oct 10 23:58:08.382751 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3275/6375] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:58:08 2022] DELETE /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:58:08.392131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d91883a9-b33d-45cd-baac-0f5327acd913 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:08.393480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d91883a9-b33d-45cd-baac-0f5327acd913 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: b2d59383-8183-418f-96c6-cc05f94da40c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:08.410321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d91883a9-b33d-45cd-baac-0f5327acd913 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:08.411134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d91883a9-b33d-45cd-baac-0f5327acd913 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:08.411763 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d91883a9-b33d-45cd-baac-0f5327acd913 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:08.412877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d91883a9-b33d-45cd-baac-0f5327acd913 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:08.413687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d91883a9-b33d-45cd-baac-0f5327acd913 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:08.414332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d91883a9-b33d-45cd-baac-0f5327acd913 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:08.712570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d91883a9-b33d-45cd-baac-0f5327acd913 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:08.737882 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d91883a9-b33d-45cd-baac-0f5327acd913 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c" status: 200 len: 1552 microversion: 2.1 time: 0.350542 Oct 10 23:58:08.748000 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3101/6376] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:08 2022] GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c => generated 1552 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:08.889094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-88bff209-828f-42c0-8404-5ad0f9318f9e tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '.version_select at 0x7f6633a69e50>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:08.924889 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-88bff209-828f-42c0-8404-5ad0f9318f9e tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2070336881" status: 202 len: 0 microversion: 2.1 time: 0.044701 Oct 10 23:58:08.926127 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3276/6377] 10.222.0.23 () {58 vars in 1284 bytes} [Mon Oct 10 23:58:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2070336881 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:58:08.957045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-81c9802d-4db2-4f54-9b69-a68384b84d12 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Action: 'create', calling method: .version_select at 0x7f6633acd8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2093323450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZpSv7OOncNkEQet3O9L8jjFaSEVqIr9wcr/H6WdmK5Z1bLTTqjiRnAbufbOwZMCxhP8y9fnmWvXQYTNQ2wRpQZllgvYjp4oOd+JtI8ehb/VvwURSZc6AUrnkB4jZ3iAw=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:58:08.988171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-81c9802d-4db2-4f54-9b69-a68384b84d12 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Getting quotas for project fce4582b30d041c592240d09a95a37e5. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:58:08.996609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-81c9802d-4db2-4f54-9b69-a68384b84d12 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Getting quotas for user ce22396752cd4d71991c6994a31f4905 and project fce4582b30d041c592240d09a95a37e5. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:58:09.025256 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-81c9802d-4db2-4f54-9b69-a68384b84d12 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.072138 Oct 10 23:58:09.025917 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3102/6378] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:58:08 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:58:09.762933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ec7d93e1-51e1-4ef5-885d-049f37d388a4 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:09.763669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ec7d93e1-51e1-4ef5-885d-049f37d388a4 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: b2d59383-8183-418f-96c6-cc05f94da40c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:09.771925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ec7d93e1-51e1-4ef5-885d-049f37d388a4 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:09.772411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ec7d93e1-51e1-4ef5-885d-049f37d388a4 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:09.772853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ec7d93e1-51e1-4ef5-885d-049f37d388a4 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:09.773587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ec7d93e1-51e1-4ef5-885d-049f37d388a4 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:09.774044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ec7d93e1-51e1-4ef5-885d-049f37d388a4 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:09.774469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ec7d93e1-51e1-4ef5-885d-049f37d388a4 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:10.037276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ec7d93e1-51e1-4ef5-885d-049f37d388a4 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:10.048079 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ec7d93e1-51e1-4ef5-885d-049f37d388a4 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c" status: 200 len: 1552 microversion: 2.1 time: 0.288335 Oct 10 23:58:10.049364 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3277/6379] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:09 2022] GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c => generated 1552 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:10.521465 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-0c36fe21-27e0-408f-bb23-252b2e36aad3 req-af2888eb-1104-42f3-8c33-9f3f8bdf1769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d59383-8183-418f-96c6-cc05f94da40c", "name": "network-vif-deleted", "tag": "9083248e-ad11-44dc-b327-951c28e7d64d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:58:10.548048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0c36fe21-27e0-408f-bb23-252b2e36aad3 req-af2888eb-1104-42f3-8c33-9f3f8bdf1769 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:10.550810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0c36fe21-27e0-408f-bb23-252b2e36aad3 req-af2888eb-1104-42f3-8c33-9f3f8bdf1769 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:10.551641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0c36fe21-27e0-408f-bb23-252b2e36aad3 req-af2888eb-1104-42f3-8c33-9f3f8bdf1769 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:10.569558 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-0c36fe21-27e0-408f-bb23-252b2e36aad3 req-af2888eb-1104-42f3-8c33-9f3f8bdf1769 service nova] Creating event network-vif-deleted:9083248e-ad11-44dc-b327-951c28e7d64d for instance b2d59383-8183-418f-96c6-cc05f94da40c on n-h2-860864-2 Oct 10 23:58:10.576244 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-0c36fe21-27e0-408f-bb23-252b2e36aad3 req-af2888eb-1104-42f3-8c33-9f3f8bdf1769 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061932 Oct 10 23:58:10.577465 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3103/6380] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:58:11.075109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0828133c-c375-42ed-a0a1-6407c78ab254 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:11.076431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0828133c-c375-42ed-a0a1-6407c78ab254 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: b2d59383-8183-418f-96c6-cc05f94da40c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:11.088509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0828133c-c375-42ed-a0a1-6407c78ab254 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:11.089818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0828133c-c375-42ed-a0a1-6407c78ab254 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:11.090495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0828133c-c375-42ed-a0a1-6407c78ab254 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:11.091401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0828133c-c375-42ed-a0a1-6407c78ab254 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:11.092223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0828133c-c375-42ed-a0a1-6407c78ab254 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:11.093149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0828133c-c375-42ed-a0a1-6407c78ab254 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:11.132874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0828133c-c375-42ed-a0a1-6407c78ab254 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:11.133529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0828133c-c375-42ed-a0a1-6407c78ab254 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:11.134037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0828133c-c375-42ed-a0a1-6407c78ab254 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:11.134638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-0828133c-c375-42ed-a0a1-6407c78ab254 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lazy-loading 'fault' on Instance uuid b2d59383-8183-418f-96c6-cc05f94da40c {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:58:11.192162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0828133c-c375-42ed-a0a1-6407c78ab254 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:11.201720 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0828133c-c375-42ed-a0a1-6407c78ab254 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c" status: 200 len: 1338 microversion: 2.1 time: 0.130960 Oct 10 23:58:11.202745 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3278/6381] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:11 2022] GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c => generated 1338 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:12.230349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ddd5b330-81b2-41c5-956e-3a69e13f69e1 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:12.231066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ddd5b330-81b2-41c5-956e-3a69e13f69e1 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: b2d59383-8183-418f-96c6-cc05f94da40c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:12.238492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddd5b330-81b2-41c5-956e-3a69e13f69e1 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:12.239015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddd5b330-81b2-41c5-956e-3a69e13f69e1 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:12.239462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddd5b330-81b2-41c5-956e-3a69e13f69e1 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:12.240167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddd5b330-81b2-41c5-956e-3a69e13f69e1 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:12.240630 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddd5b330-81b2-41c5-956e-3a69e13f69e1 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:12.241997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddd5b330-81b2-41c5-956e-3a69e13f69e1 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:12.257264 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-ddd5b330-81b2-41c5-956e-3a69e13f69e1 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] HTTP exception thrown: Instance b2d59383-8183-418f-96c6-cc05f94da40c could not be found. Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ddd5b330-81b2-41c5-956e-3a69e13f69e1 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Request method failure captured: Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c HTTP/1.1 Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLD3saplG3N6SEeaygXUr722XI651Rsf-LEMWaC2U26f6I4Vwp7J24DL9Kd6DUTtYByTevr1DYSiNy15zeAU3NCR73MA8aqL-aJtfH1H9n05_WkyY1y7Ih6RxalN54wdxNwe-xmd0J6nW4xgs9sJRCL0LirZ0jW5DBMsKL1se93Vido Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 897064e9041f4e4f94ced711d282deb4 Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TestNetworkBasicOps-1125387914 Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/897064e9041f4e4f94ced711d282deb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/897064e9041f4e4f94ced711d282deb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/897064e9041f4e4f94ced711d282deb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_897064e9041f4e4f94ced711d282deb4", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TestNetworkBasicOps-1125387914 Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 897064e9041f4e4f94ced711d282deb4 Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestNetworkBasicOps-1125387914 Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TestNetworkBasicOps-1125387914-project Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 82fc082060b54409a4361c04f8355580 Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TestNetworkBasicOps-1125387914-project Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance b2d59383-8183-418f-96c6-cc05f94da40c could not be found. Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'b2d59383-8183-418f-96c6-cc05f94da40c'} Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2d59383-8183-418f-96c6-cc05f94da40c could not be found. Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2d59383-8183-418f-96c6-cc05f94da40c could not be found. Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:58:12.259031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:58:12.264284 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:58:12.264284 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:58:12.264284 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:58:12.264284 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:58:12.264284 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:58:12.264284 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2d59383-8183-418f-96c6-cc05f94da40c could not be found. Oct 10 23:58:12.264284 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:58:12.264284 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ddd5b330-81b2-41c5-956e-3a69e13f69e1 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Returning 404 to user: Instance b2d59383-8183-418f-96c6-cc05f94da40c could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:58:12.264284 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ddd5b330-81b2-41c5-956e-3a69e13f69e1 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c" status: 404 len: 111 microversion: 2.1 time: 0.036087 Oct 10 23:58:12.264284 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3104/6382] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:12 2022] GET /compute/v2.1/servers/b2d59383-8183-418f-96c6-cc05f94da40c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:58:12.471258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-26d0ac5f-d46c-46e0-a969-cce4a5b27938 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '.version_select at 0x7f662a5c70d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:12.510769 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-26d0ac5f-d46c-46e0-a969-cce4a5b27938 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-799544408" status: 202 len: 0 microversion: 2.1 time: 0.043233 Oct 10 23:58:12.512700 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3279/6383] 10.222.0.23 () {58 vars in 1254 bytes} [Mon Oct 10 23:58:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-799544408 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:58:16.440826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4ad58f91-99bf-4eca-bb06-943ea3fb0f3f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:16.441348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4ad58f91-99bf-4eca-bb06-943ea3fb0f3f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: a2ab3eb3-f415-415b-9026-41a1befefdae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:16.444199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:58:16.458227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ad58f91-99bf-4eca-bb06-943ea3fb0f3f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:16.459249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ad58f91-99bf-4eca-bb06-943ea3fb0f3f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:16.459844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ad58f91-99bf-4eca-bb06-943ea3fb0f3f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:16.460719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ad58f91-99bf-4eca-bb06-943ea3fb0f3f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:16.461443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ad58f91-99bf-4eca-bb06-943ea3fb0f3f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:16.462030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ad58f91-99bf-4eca-bb06-943ea3fb0f3f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:16.519252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4ad58f91-99bf-4eca-bb06-943ea3fb0f3f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: a2ab3eb3-f415-415b-9026-41a1befefdae] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:58:16.595862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-a1b4deaa-a2cc-4435-92a3-cdc844f91f13 req-5f6c51b3-8e0b-406b-b119-26b28e6f29bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ab3eb3-f415-415b-9026-41a1befefdae", "tag": "d8c517ee-4780-48a1-8112-33199393f494"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:58:16.620428 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4ad58f91-99bf-4eca-bb06-943ea3fb0f3f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae" status: 204 len: 0 microversion: 2.1 time: 0.183271 Oct 10 23:58:16.627801 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3105/6384] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:58:16 2022] DELETE /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:58:16.633199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a1b4deaa-a2cc-4435-92a3-cdc844f91f13 req-5f6c51b3-8e0b-406b-b119-26b28e6f29bf service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:16.634038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a1b4deaa-a2cc-4435-92a3-cdc844f91f13 req-5f6c51b3-8e0b-406b-b119-26b28e6f29bf service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:16.636220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a1b4deaa-a2cc-4435-92a3-cdc844f91f13 req-5f6c51b3-8e0b-406b-b119-26b28e6f29bf service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:16.643745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3dfbc13d-9c3d-4944-a755-ba7b88d2824d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:16.645070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3dfbc13d-9c3d-4944-a755-ba7b88d2824d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: a2ab3eb3-f415-415b-9026-41a1befefdae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:16.653587 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a1b4deaa-a2cc-4435-92a3-cdc844f91f13 req-5f6c51b3-8e0b-406b-b119-26b28e6f29bf service nova] Creating event network-changed:d8c517ee-4780-48a1-8112-33199393f494 for instance a2ab3eb3-f415-415b-9026-41a1befefdae on n-h1-860864-2 Oct 10 23:58:16.659700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3dfbc13d-9c3d-4944-a755-ba7b88d2824d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:16.660557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3dfbc13d-9c3d-4944-a755-ba7b88d2824d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:16.661830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3dfbc13d-9c3d-4944-a755-ba7b88d2824d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:16.662285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3dfbc13d-9c3d-4944-a755-ba7b88d2824d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:16.662860 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-a1b4deaa-a2cc-4435-92a3-cdc844f91f13 req-5f6c51b3-8e0b-406b-b119-26b28e6f29bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073065 Oct 10 23:58:16.663113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3dfbc13d-9c3d-4944-a755-ba7b88d2824d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:16.664937 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3280/6385] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 10 23:58:16.665839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3dfbc13d-9c3d-4944-a755-ba7b88d2824d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:16.888617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3dfbc13d-9c3d-4944-a755-ba7b88d2824d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:16.898207 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3dfbc13d-9c3d-4944-a755-ba7b88d2824d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae" status: 200 len: 1672 microversion: 2.1 time: 0.268176 Oct 10 23:58:16.900856 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3106/6386] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:16 2022] GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae => generated 1672 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:17.566498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e0a3f576-8a51-4f26-a2a2-253ae7a34e58 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2015998099", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "4253ec27-bcb5-47b0-92ed-ed70034e14b0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2093323450", "security_groups": [{"name": "tempest-secgroup-smoke-363643628"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:58:17.801418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-e0a3f576-8a51-4f26-a2a2-253ae7a34e58 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] validate_networks() for [('4253ec27-bcb5-47b0-92ed-ed70034e14b0', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:58:17.931952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d777c6d2-6966-4dbb-9b37-a40f45ac17b3 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:17.932869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d777c6d2-6966-4dbb-9b37-a40f45ac17b3 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: a2ab3eb3-f415-415b-9026-41a1befefdae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:17.945698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d777c6d2-6966-4dbb-9b37-a40f45ac17b3 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:17.946533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d777c6d2-6966-4dbb-9b37-a40f45ac17b3 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:17.947210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d777c6d2-6966-4dbb-9b37-a40f45ac17b3 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:17.948142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d777c6d2-6966-4dbb-9b37-a40f45ac17b3 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:17.953540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d777c6d2-6966-4dbb-9b37-a40f45ac17b3 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:17.954443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d777c6d2-6966-4dbb-9b37-a40f45ac17b3 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:18.168811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d777c6d2-6966-4dbb-9b37-a40f45ac17b3 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:18.178220 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d777c6d2-6966-4dbb-9b37-a40f45ac17b3 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae" status: 200 len: 1672 microversion: 2.1 time: 0.250247 Oct 10 23:58:18.185172 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3107/6387] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:17 2022] GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae => generated 1672 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:18.229175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:58:18.630031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e0a3f576-8a51-4f26-a2a2-253ae7a34e58 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:58:18.630888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e0a3f576-8a51-4f26-a2a2-253ae7a34e58 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:58:18.631458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e0a3f576-8a51-4f26-a2a2-253ae7a34e58 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:58:18.632463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e0a3f576-8a51-4f26-a2a2-253ae7a34e58 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:58:18.632898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e0a3f576-8a51-4f26-a2a2-253ae7a34e58 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:58:18.660039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0a3f576-8a51-4f26-a2a2-253ae7a34e58 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:18.660590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0a3f576-8a51-4f26-a2a2-253ae7a34e58 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:18.661054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0a3f576-8a51-4f26-a2a2-253ae7a34e58 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:18.664123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0a3f576-8a51-4f26-a2a2-253ae7a34e58 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:18.664608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0a3f576-8a51-4f26-a2a2-253ae7a34e58 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:18.665085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e0a3f576-8a51-4f26-a2a2-253ae7a34e58 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:18.701470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-e0a3f576-8a51-4f26-a2a2-253ae7a34e58 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Getting quotas for project fce4582b30d041c592240d09a95a37e5. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:58:18.707965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-e0a3f576-8a51-4f26-a2a2-253ae7a34e58 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Getting quotas for user ce22396752cd4d71991c6994a31f4905 and project fce4582b30d041c592240d09a95a37e5. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:58:18.722387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e0a3f576-8a51-4f26-a2a2-253ae7a34e58 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:58:18.725252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e0a3f576-8a51-4f26-a2a2-253ae7a34e58 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:58:18.784130 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e0a3f576-8a51-4f26-a2a2-253ae7a34e58 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.223286 Oct 10 23:58:18.785107 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3281/6388] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:58:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:58:18.800269 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-367a2260-e574-4052-bb2b-5b40a89c2089 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:18.801696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-367a2260-e574-4052-bb2b-5b40a89c2089 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:18.902271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-367a2260-e574-4052-bb2b-5b40a89c2089 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:18.911066 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-367a2260-e574-4052-bb2b-5b40a89c2089 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1267 microversion: 2.1 time: 0.117213 Oct 10 23:58:18.914024 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3108/6389] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:18 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1267 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:19.024548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-06b3659d-d337-4f2f-846d-bb089599adeb req-c5609aaa-864b-4a67-bf71-19b584d22e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ab3eb3-f415-415b-9026-41a1befefdae", "name": "network-vif-deleted", "tag": "d8c517ee-4780-48a1-8112-33199393f494"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:58:19.040736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-06b3659d-d337-4f2f-846d-bb089599adeb req-c5609aaa-864b-4a67-bf71-19b584d22e49 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:19.041614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-06b3659d-d337-4f2f-846d-bb089599adeb req-c5609aaa-864b-4a67-bf71-19b584d22e49 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:19.042309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-06b3659d-d337-4f2f-846d-bb089599adeb req-c5609aaa-864b-4a67-bf71-19b584d22e49 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:19.071013 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-06b3659d-d337-4f2f-846d-bb089599adeb req-c5609aaa-864b-4a67-bf71-19b584d22e49 service nova] Creating event network-vif-deleted:d8c517ee-4780-48a1-8112-33199393f494 for instance a2ab3eb3-f415-415b-9026-41a1befefdae on n-h1-860864-2 Oct 10 23:58:19.097941 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-06b3659d-d337-4f2f-846d-bb089599adeb req-c5609aaa-864b-4a67-bf71-19b584d22e49 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077383 Oct 10 23:58:19.101101 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3282/6390] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:58:19.221597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eae2be70-1348-4b73-ab6e-3394fc2791f5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:19.225225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eae2be70-1348-4b73-ab6e-3394fc2791f5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: a2ab3eb3-f415-415b-9026-41a1befefdae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:19.241217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eae2be70-1348-4b73-ab6e-3394fc2791f5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:19.241762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eae2be70-1348-4b73-ab6e-3394fc2791f5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:19.242211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eae2be70-1348-4b73-ab6e-3394fc2791f5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:19.242930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eae2be70-1348-4b73-ab6e-3394fc2791f5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:19.243644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eae2be70-1348-4b73-ab6e-3394fc2791f5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:19.244097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eae2be70-1348-4b73-ab6e-3394fc2791f5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:19.326288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eae2be70-1348-4b73-ab6e-3394fc2791f5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:19.326963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eae2be70-1348-4b73-ab6e-3394fc2791f5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:19.327575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eae2be70-1348-4b73-ab6e-3394fc2791f5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:19.328417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-eae2be70-1348-4b73-ab6e-3394fc2791f5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lazy-loading 'fault' on Instance uuid a2ab3eb3-f415-415b-9026-41a1befefdae {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:58:19.382011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-eae2be70-1348-4b73-ab6e-3394fc2791f5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:19.393125 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eae2be70-1348-4b73-ab6e-3394fc2791f5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae" status: 200 len: 1339 microversion: 2.1 time: 0.185511 Oct 10 23:58:19.405401 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3109/6391] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:19 2022] GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae => generated 1339 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:19.941823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c2a89e43-d6b2-448b-816d-b8be769d23bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:19.942885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c2a89e43-d6b2-448b-816d-b8be769d23bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:19.953084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2a89e43-d6b2-448b-816d-b8be769d23bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:19.953794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2a89e43-d6b2-448b-816d-b8be769d23bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:19.954618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2a89e43-d6b2-448b-816d-b8be769d23bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:19.955250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2a89e43-d6b2-448b-816d-b8be769d23bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:19.955916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2a89e43-d6b2-448b-816d-b8be769d23bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:19.956520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2a89e43-d6b2-448b-816d-b8be769d23bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:20.070212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c2a89e43-d6b2-448b-816d-b8be769d23bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:20.083551 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c2a89e43-d6b2-448b-816d-b8be769d23bf tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1319 microversion: 2.1 time: 0.146749 Oct 10 23:58:20.084794 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3283/6392] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:19 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:20.418441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4a2224db-d2b9-46a3-bedf-ce285036f47d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:20.419881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4a2224db-d2b9-46a3-bedf-ce285036f47d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: a2ab3eb3-f415-415b-9026-41a1befefdae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:20.435299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a2224db-d2b9-46a3-bedf-ce285036f47d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:20.437550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a2224db-d2b9-46a3-bedf-ce285036f47d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:20.440042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a2224db-d2b9-46a3-bedf-ce285036f47d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:20.443582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a2224db-d2b9-46a3-bedf-ce285036f47d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:20.444431 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a2224db-d2b9-46a3-bedf-ce285036f47d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:20.445106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a2224db-d2b9-46a3-bedf-ce285036f47d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:20.476337 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-4a2224db-d2b9-46a3-bedf-ce285036f47d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] HTTP exception thrown: Instance a2ab3eb3-f415-415b-9026-41a1befefdae could not be found. Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4a2224db-d2b9-46a3-bedf-ce285036f47d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Request method failure captured: Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae HTTP/1.1 Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLD3saplG3N6SEeaygXUr722XI651Rsf-LEMWaC2U26f6I4Vwp7J24DL9Kd6DUTtYByTevr1DYSiNy15zeAU3NCR73MA8aqL-aJtfH1H9n05_WkyY1y7Ih6RxalN54wdxNwe-xmd0J6nW4xgs9sJRCL0LirZ0jW5DBMsKL1se93Vido Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 897064e9041f4e4f94ced711d282deb4 Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TestNetworkBasicOps-1125387914 Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/897064e9041f4e4f94ced711d282deb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/897064e9041f4e4f94ced711d282deb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/897064e9041f4e4f94ced711d282deb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_897064e9041f4e4f94ced711d282deb4", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TestNetworkBasicOps-1125387914 Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 897064e9041f4e4f94ced711d282deb4 Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestNetworkBasicOps-1125387914 Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TestNetworkBasicOps-1125387914-project Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 82fc082060b54409a4361c04f8355580 Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TestNetworkBasicOps-1125387914-project Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance a2ab3eb3-f415-415b-9026-41a1befefdae could not be found. Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'a2ab3eb3-f415-415b-9026-41a1befefdae'} Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2ab3eb3-f415-415b-9026-41a1befefdae could not be found. Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2ab3eb3-f415-415b-9026-41a1befefdae could not be found. Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:58:20.480613 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:58:20.487011 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:58:20.487011 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:58:20.487011 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:58:20.487011 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:58:20.487011 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:58:20.487011 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2ab3eb3-f415-415b-9026-41a1befefdae could not be found. Oct 10 23:58:20.487011 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:58:20.487011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4a2224db-d2b9-46a3-bedf-ce285036f47d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Returning 404 to user: Instance a2ab3eb3-f415-415b-9026-41a1befefdae could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:58:20.487011 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4a2224db-d2b9-46a3-bedf-ce285036f47d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae" status: 404 len: 111 microversion: 2.1 time: 0.069554 Oct 10 23:58:20.506139 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3110/6393] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:20 2022] GET /compute/v2.1/servers/a2ab3eb3-f415-415b-9026-41a1befefdae => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:58:20.760609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3838d4a7-8411-4925-841b-fe656e309788 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '.version_select at 0x7f662af7e4c0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:20.808590 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3838d4a7-8411-4925-841b-fe656e309788 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1787234900" status: 202 len: 0 microversion: 2.1 time: 0.051752 Oct 10 23:58:20.809713 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3284/6394] 10.222.0.23 () {58 vars in 1257 bytes} [Mon Oct 10 23:58:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1787234900 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:58:21.110409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0098acb8-2ae7-4ba9-b936-05199b0178da tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:21.111682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0098acb8-2ae7-4ba9-b936-05199b0178da tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:21.141818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0098acb8-2ae7-4ba9-b936-05199b0178da tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:21.143807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0098acb8-2ae7-4ba9-b936-05199b0178da tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:21.146140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0098acb8-2ae7-4ba9-b936-05199b0178da tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:21.148875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0098acb8-2ae7-4ba9-b936-05199b0178da tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:21.152898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0098acb8-2ae7-4ba9-b936-05199b0178da tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:21.153733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0098acb8-2ae7-4ba9-b936-05199b0178da tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:21.300271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0098acb8-2ae7-4ba9-b936-05199b0178da tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:21.320622 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0098acb8-2ae7-4ba9-b936-05199b0178da tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1325 microversion: 2.1 time: 0.213095 Oct 10 23:58:21.324590 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3111/6395] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:21 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1325 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:22.348411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b3762190-8d86-4aa6-a679-dfe853de5109 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:22.349064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b3762190-8d86-4aa6-a679-dfe853de5109 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:22.356051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3762190-8d86-4aa6-a679-dfe853de5109 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:22.356835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3762190-8d86-4aa6-a679-dfe853de5109 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:22.357570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3762190-8d86-4aa6-a679-dfe853de5109 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:22.358495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3762190-8d86-4aa6-a679-dfe853de5109 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:22.359159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3762190-8d86-4aa6-a679-dfe853de5109 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:22.360045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3762190-8d86-4aa6-a679-dfe853de5109 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:22.592585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b3762190-8d86-4aa6-a679-dfe853de5109 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:22.607126 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b3762190-8d86-4aa6-a679-dfe853de5109 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1392 microversion: 2.1 time: 0.263416 Oct 10 23:58:22.608399 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3285/6396] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:22 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1392 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:22.776709 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-d5c6f6c0-fedb-48ed-a7e2-a2723c925eb7 req-2a5abe0e-bb3d-4ce1-a4cf-1b4d9284a07b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21b1818e-1773-44f3-8fd2-961584626f55", "tag": "6101695e-9095-4573-b82c-5f89f85b4261"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:58:22.791104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d5c6f6c0-fedb-48ed-a7e2-a2723c925eb7 req-2a5abe0e-bb3d-4ce1-a4cf-1b4d9284a07b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:22.791896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d5c6f6c0-fedb-48ed-a7e2-a2723c925eb7 req-2a5abe0e-bb3d-4ce1-a4cf-1b4d9284a07b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:22.792604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d5c6f6c0-fedb-48ed-a7e2-a2723c925eb7 req-2a5abe0e-bb3d-4ce1-a4cf-1b4d9284a07b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:22.807557 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-d5c6f6c0-fedb-48ed-a7e2-a2723c925eb7 req-2a5abe0e-bb3d-4ce1-a4cf-1b4d9284a07b service nova] Creating event network-changed:6101695e-9095-4573-b82c-5f89f85b4261 for instance 21b1818e-1773-44f3-8fd2-961584626f55 on n-h2-860864-2 Oct 10 23:58:22.816659 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-d5c6f6c0-fedb-48ed-a7e2-a2723c925eb7 req-2a5abe0e-bb3d-4ce1-a4cf-1b4d9284a07b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050324 Oct 10 23:58:22.818615 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3112/6397] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:58:23.641852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0cb05156-9252-4e74-a280-450f67a091de tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:23.642696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0cb05156-9252-4e74-a280-450f67a091de tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:23.666297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0cb05156-9252-4e74-a280-450f67a091de tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:23.677881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0cb05156-9252-4e74-a280-450f67a091de tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:23.678660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0cb05156-9252-4e74-a280-450f67a091de tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:23.679545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0cb05156-9252-4e74-a280-450f67a091de tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:23.680156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0cb05156-9252-4e74-a280-450f67a091de tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:23.680605 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0cb05156-9252-4e74-a280-450f67a091de tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:23.900552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0cb05156-9252-4e74-a280-450f67a091de tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:23.910740 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0cb05156-9252-4e74-a280-450f67a091de tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1392 microversion: 2.1 time: 0.280646 Oct 10 23:58:23.912063 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3286/6398] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:23 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1392 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:24.939755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2dfecfee-0df7-4394-952b-566c9a9b292d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:24.943445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2dfecfee-0df7-4394-952b-566c9a9b292d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:24.956929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2dfecfee-0df7-4394-952b-566c9a9b292d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:24.957885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2dfecfee-0df7-4394-952b-566c9a9b292d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:24.958560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2dfecfee-0df7-4394-952b-566c9a9b292d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:24.959953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2dfecfee-0df7-4394-952b-566c9a9b292d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:24.960661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2dfecfee-0df7-4394-952b-566c9a9b292d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:24.961316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2dfecfee-0df7-4394-952b-566c9a9b292d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:25.149698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2dfecfee-0df7-4394-952b-566c9a9b292d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:25.160098 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2dfecfee-0df7-4394-952b-566c9a9b292d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1392 microversion: 2.1 time: 0.228089 Oct 10 23:58:25.160828 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3113/6399] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:24 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1392 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:26.184313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-be9653ab-9749-4d4e-826e-7205169742a8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:26.185934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-be9653ab-9749-4d4e-826e-7205169742a8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:26.195010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be9653ab-9749-4d4e-826e-7205169742a8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:26.195656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be9653ab-9749-4d4e-826e-7205169742a8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:26.196206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be9653ab-9749-4d4e-826e-7205169742a8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:26.197217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be9653ab-9749-4d4e-826e-7205169742a8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:26.197810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be9653ab-9749-4d4e-826e-7205169742a8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:26.198336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be9653ab-9749-4d4e-826e-7205169742a8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:26.423913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-be9653ab-9749-4d4e-826e-7205169742a8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:26.432954 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-be9653ab-9749-4d4e-826e-7205169742a8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1392 microversion: 2.1 time: 0.252640 Oct 10 23:58:26.443743 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3287/6400] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:26 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1392 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:27.457393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-372dd7cf-2f22-43f0-af86-c1f2a2e2093a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:27.458035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-372dd7cf-2f22-43f0-af86-c1f2a2e2093a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:27.477232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-372dd7cf-2f22-43f0-af86-c1f2a2e2093a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:27.477818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-372dd7cf-2f22-43f0-af86-c1f2a2e2093a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:27.478281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-372dd7cf-2f22-43f0-af86-c1f2a2e2093a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:27.479079 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-372dd7cf-2f22-43f0-af86-c1f2a2e2093a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:27.480435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-372dd7cf-2f22-43f0-af86-c1f2a2e2093a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:27.480435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-372dd7cf-2f22-43f0-af86-c1f2a2e2093a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:27.677518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-372dd7cf-2f22-43f0-af86-c1f2a2e2093a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:27.686894 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-372dd7cf-2f22-43f0-af86-c1f2a2e2093a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1392 microversion: 2.1 time: 0.233464 Oct 10 23:58:27.688605 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3114/6401] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:27 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1392 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:28.711895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2408f7d3-007b-45b0-871a-bc7c93d2e4cb tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:28.712631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2408f7d3-007b-45b0-871a-bc7c93d2e4cb tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:28.725613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:58:28.726790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:58:28.728711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2408f7d3-007b-45b0-871a-bc7c93d2e4cb tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:28.731202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2408f7d3-007b-45b0-871a-bc7c93d2e4cb tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:28.735571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2408f7d3-007b-45b0-871a-bc7c93d2e4cb tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:28.736792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2408f7d3-007b-45b0-871a-bc7c93d2e4cb tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:28.737571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2408f7d3-007b-45b0-871a-bc7c93d2e4cb tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:28.738220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2408f7d3-007b-45b0-871a-bc7c93d2e4cb tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:28.962639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2408f7d3-007b-45b0-871a-bc7c93d2e4cb tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:28.982096 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2408f7d3-007b-45b0-871a-bc7c93d2e4cb tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1392 microversion: 2.1 time: 0.274314 Oct 10 23:58:28.983605 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3288/6402] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:28 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1392 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:29.121529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:58:29.280391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-c6ee1bda-b4f2-4b39-a152-aca7f79c7e9e req-8bbfeda3-451f-49b6-8dcb-1b947dcbd7bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b1818e-1773-44f3-8fd2-961584626f55", "name": "network-vif-plugged", "status": "completed", "tag": "6101695e-9095-4573-b82c-5f89f85b4261"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:58:29.294866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c6ee1bda-b4f2-4b39-a152-aca7f79c7e9e req-8bbfeda3-451f-49b6-8dcb-1b947dcbd7bb service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:29.296022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c6ee1bda-b4f2-4b39-a152-aca7f79c7e9e req-8bbfeda3-451f-49b6-8dcb-1b947dcbd7bb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:29.296753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c6ee1bda-b4f2-4b39-a152-aca7f79c7e9e req-8bbfeda3-451f-49b6-8dcb-1b947dcbd7bb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:29.310164 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-c6ee1bda-b4f2-4b39-a152-aca7f79c7e9e req-8bbfeda3-451f-49b6-8dcb-1b947dcbd7bb service nova] Creating event network-vif-plugged:6101695e-9095-4573-b82c-5f89f85b4261 for instance 21b1818e-1773-44f3-8fd2-961584626f55 on n-h2-860864-2 Oct 10 23:58:29.320685 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-c6ee1bda-b4f2-4b39-a152-aca7f79c7e9e req-8bbfeda3-451f-49b6-8dcb-1b947dcbd7bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212370 Oct 10 23:58:29.321954 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3115/6403] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:58:30.008939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-83c9c5ca-cfa3-416f-b589-265368608d1d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:30.009706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-83c9c5ca-cfa3-416f-b589-265368608d1d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:30.018771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83c9c5ca-cfa3-416f-b589-265368608d1d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:30.019270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83c9c5ca-cfa3-416f-b589-265368608d1d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:30.019718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83c9c5ca-cfa3-416f-b589-265368608d1d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:30.020434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83c9c5ca-cfa3-416f-b589-265368608d1d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:30.020897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83c9c5ca-cfa3-416f-b589-265368608d1d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:30.025673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83c9c5ca-cfa3-416f-b589-265368608d1d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:30.342835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-83c9c5ca-cfa3-416f-b589-265368608d1d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:30.352371 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-83c9c5ca-cfa3-416f-b589-265368608d1d tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1392 microversion: 2.1 time: 0.348975 Oct 10 23:58:30.369930 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3289/6404] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:30 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1392 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:58:31.383547 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f28c5b57-726e-4d88-ab32-6cb45c20bf7f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:31.384325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f28c5b57-726e-4d88-ab32-6cb45c20bf7f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:31.403800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f28c5b57-726e-4d88-ab32-6cb45c20bf7f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:31.404244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f28c5b57-726e-4d88-ab32-6cb45c20bf7f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:31.404694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f28c5b57-726e-4d88-ab32-6cb45c20bf7f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:31.405486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f28c5b57-726e-4d88-ab32-6cb45c20bf7f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:31.406137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f28c5b57-726e-4d88-ab32-6cb45c20bf7f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:31.407277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f28c5b57-726e-4d88-ab32-6cb45c20bf7f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:31.736294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f28c5b57-726e-4d88-ab32-6cb45c20bf7f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:31.745110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c5d5b3f5-066d-41d4-9fe7-4d7b8223d4cc tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Action: 'create', calling method: .version_select at 0x7f662a5f5ca0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1793063876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB49GH3HfX08fFvwyHpiI4HxDwrcsM4anpb4UTX9hM7PnjOfJOvsu7LymgHgeZn01BKh4GIKqEgGn66qkHWbyreRuBZ4yChS/gxuL0cAjMgBzqCHowJH20QNmsLBXxVcCg=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:58:31.749322 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f28c5b57-726e-4d88-ab32-6cb45c20bf7f tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1563 microversion: 2.1 time: 0.370287 Oct 10 23:58:31.751224 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3116/6405] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:31 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1563 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:31.771779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-c5d5b3f5-066d-41d4-9fe7-4d7b8223d4cc tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Getting quotas for project 897064e9041f4e4f94ced711d282deb4. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:58:31.778540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ddb6091f-397b-4708-92d3-82f3aa98d452 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:31.779902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ddb6091f-397b-4708-92d3-82f3aa98d452 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:31.787151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddb6091f-397b-4708-92d3-82f3aa98d452 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:31.787976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddb6091f-397b-4708-92d3-82f3aa98d452 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:31.788575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddb6091f-397b-4708-92d3-82f3aa98d452 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:31.789464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddb6091f-397b-4708-92d3-82f3aa98d452 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:31.790071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddb6091f-397b-4708-92d3-82f3aa98d452 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:31.790651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddb6091f-397b-4708-92d3-82f3aa98d452 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:31.792410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-c5d5b3f5-066d-41d4-9fe7-4d7b8223d4cc tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Getting quotas for user 82fc082060b54409a4361c04f8355580 and project 897064e9041f4e4f94ced711d282deb4. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:58:31.845580 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c5d5b3f5-066d-41d4-9fe7-4d7b8223d4cc tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.104414 Oct 10 23:58:31.848987 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3290/6406] 10.222.0.23 () {60 vars in 1159 bytes} [Mon Oct 10 23:58:31 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:58:32.025695 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ddb6091f-397b-4708-92d3-82f3aa98d452 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:32.039000 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ddb6091f-397b-4708-92d3-82f3aa98d452 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1563 microversion: 2.1 time: 0.265132 Oct 10 23:58:32.040227 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3117/6407] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:31 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1563 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:58:34.145412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-27bcecbd-1272-4562-b34a-318bcb65f81d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1384570113", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "8fb49ac5-6952-4115-bf32-fa0e13193328"}], "key_name": "tempest-TestNetworkBasicOps-1793063876", "security_groups": [{"name": "tempest-secgroup-smoke-500411999"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:58:34.290305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-27bcecbd-1272-4562-b34a-318bcb65f81d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] validate_networks() for [('8fb49ac5-6952-4115-bf32-fa0e13193328', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 23:58:34.856515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-27bcecbd-1272-4562-b34a-318bcb65f81d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:58:34.856945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-27bcecbd-1272-4562-b34a-318bcb65f81d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:58:34.857452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-27bcecbd-1272-4562-b34a-318bcb65f81d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:58:34.859043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-27bcecbd-1272-4562-b34a-318bcb65f81d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:58:34.859759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-27bcecbd-1272-4562-b34a-318bcb65f81d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:58:34.873407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27bcecbd-1272-4562-b34a-318bcb65f81d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:34.874003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27bcecbd-1272-4562-b34a-318bcb65f81d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:34.874692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27bcecbd-1272-4562-b34a-318bcb65f81d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:34.875716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27bcecbd-1272-4562-b34a-318bcb65f81d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:34.876387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27bcecbd-1272-4562-b34a-318bcb65f81d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:34.877042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27bcecbd-1272-4562-b34a-318bcb65f81d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:34.886026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:58:34.912792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-27bcecbd-1272-4562-b34a-318bcb65f81d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Getting quotas for project 897064e9041f4e4f94ced711d282deb4. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 23:58:34.919817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-27bcecbd-1272-4562-b34a-318bcb65f81d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Getting quotas for user 82fc082060b54409a4361c04f8355580 and project 897064e9041f4e4f94ced711d282deb4. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 23:58:34.934953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-27bcecbd-1272-4562-b34a-318bcb65f81d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 23:58:34.937428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-27bcecbd-1272-4562-b34a-318bcb65f81d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: cf240924-ed7e-4e52-ab1a-6a5bce0f7380] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 23:58:35.000148 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-27bcecbd-1272-4562-b34a-318bcb65f81d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.861096 Oct 10 23:58:35.001458 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3291/6408] 10.222.0.23 () {60 vars in 1147 bytes} [Mon Oct 10 23:58:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 23:58:35.015706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-017a4b69-c683-4d0f-a414-822ec4098e1f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:35.017689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-017a4b69-c683-4d0f-a414-822ec4098e1f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: cf240924-ed7e-4e52-ab1a-6a5bce0f7380] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:35.134981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-017a4b69-c683-4d0f-a414-822ec4098e1f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:35.144499 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-017a4b69-c683-4d0f-a414-822ec4098e1f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380" status: 200 len: 1249 microversion: 2.1 time: 0.135361 Oct 10 23:58:35.145841 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3118/6409] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:35 2022] GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380 => generated 1249 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:35.166972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8ca3d370-e968-45b2-93a3-c460c6567cbc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:35.179661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-b31d2c27-28e8-4e40-8e1e-d09fbd704b43 req-8d41e649-0da5-4f2a-9de9-5c12110560ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21b1818e-1773-44f3-8fd2-961584626f55", "tag": "6101695e-9095-4573-b82c-5f89f85b4261"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:58:35.180767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8ca3d370-e968-45b2-93a3-c460c6567cbc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:35.191473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ca3d370-e968-45b2-93a3-c460c6567cbc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:35.198174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ca3d370-e968-45b2-93a3-c460c6567cbc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:35.210316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ca3d370-e968-45b2-93a3-c460c6567cbc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:35.211106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ca3d370-e968-45b2-93a3-c460c6567cbc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:35.211593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ca3d370-e968-45b2-93a3-c460c6567cbc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:35.212031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ca3d370-e968-45b2-93a3-c460c6567cbc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:35.229977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b31d2c27-28e8-4e40-8e1e-d09fbd704b43 req-8d41e649-0da5-4f2a-9de9-5c12110560ad service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:35.230468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b31d2c27-28e8-4e40-8e1e-d09fbd704b43 req-8d41e649-0da5-4f2a-9de9-5c12110560ad service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:35.230891 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b31d2c27-28e8-4e40-8e1e-d09fbd704b43 req-8d41e649-0da5-4f2a-9de9-5c12110560ad service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:35.240145 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:58:35.256059 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-b31d2c27-28e8-4e40-8e1e-d09fbd704b43 req-8d41e649-0da5-4f2a-9de9-5c12110560ad service nova] Creating event network-changed:6101695e-9095-4573-b82c-5f89f85b4261 for instance 21b1818e-1773-44f3-8fd2-961584626f55 on n-h2-860864-2 Oct 10 23:58:35.261411 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-b31d2c27-28e8-4e40-8e1e-d09fbd704b43 req-8d41e649-0da5-4f2a-9de9-5c12110560ad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092489 Oct 10 23:58:35.274000 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3119/6410] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:58:35.543712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8ca3d370-e968-45b2-93a3-c460c6567cbc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:35.560006 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8ca3d370-e968-45b2-93a3-c460c6567cbc tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1563 microversion: 2.1 time: 0.397310 Oct 10 23:58:35.560633 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3292/6411] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:35 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1563 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:36.180512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6f3e6bfe-2ad2-40a7-98c8-0179a2a8b857 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:36.181955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6f3e6bfe-2ad2-40a7-98c8-0179a2a8b857 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: cf240924-ed7e-4e52-ab1a-6a5bce0f7380] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:36.197974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f3e6bfe-2ad2-40a7-98c8-0179a2a8b857 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:36.198518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f3e6bfe-2ad2-40a7-98c8-0179a2a8b857 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:36.200947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f3e6bfe-2ad2-40a7-98c8-0179a2a8b857 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:36.201956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f3e6bfe-2ad2-40a7-98c8-0179a2a8b857 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:36.203384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f3e6bfe-2ad2-40a7-98c8-0179a2a8b857 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:36.207953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f3e6bfe-2ad2-40a7-98c8-0179a2a8b857 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:36.325545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6f3e6bfe-2ad2-40a7-98c8-0179a2a8b857 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:36.352451 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6f3e6bfe-2ad2-40a7-98c8-0179a2a8b857 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380" status: 200 len: 1301 microversion: 2.1 time: 0.186827 Oct 10 23:58:36.354392 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3120/6412] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:36 2022] GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380 => generated 1301 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:37.401687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-47f0341d-6745-42f9-9936-02683884dc39 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:37.403037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-47f0341d-6745-42f9-9936-02683884dc39 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: cf240924-ed7e-4e52-ab1a-6a5bce0f7380] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:37.410922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47f0341d-6745-42f9-9936-02683884dc39 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:37.411290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47f0341d-6745-42f9-9936-02683884dc39 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:37.412003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47f0341d-6745-42f9-9936-02683884dc39 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:37.412785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47f0341d-6745-42f9-9936-02683884dc39 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:37.413508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47f0341d-6745-42f9-9936-02683884dc39 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:37.414005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47f0341d-6745-42f9-9936-02683884dc39 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:37.691861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-47f0341d-6745-42f9-9936-02683884dc39 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:37.704341 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-47f0341d-6745-42f9-9936-02683884dc39 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380" status: 200 len: 1374 microversion: 2.1 time: 0.306428 Oct 10 23:58:37.706084 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3293/6413] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:37 2022] GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380 => generated 1374 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:58:38.464012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-4eb726c7-2026-49a8-bfc3-c54ceb3a739f req-4468a433-0cfc-47db-a7a1-70030b6b452a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf240924-ed7e-4e52-ab1a-6a5bce0f7380", "tag": "05d56671-961f-4ad4-8ba5-aa6c6c52bb33"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:58:38.475671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4eb726c7-2026-49a8-bfc3-c54ceb3a739f req-4468a433-0cfc-47db-a7a1-70030b6b452a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:38.476179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4eb726c7-2026-49a8-bfc3-c54ceb3a739f req-4468a433-0cfc-47db-a7a1-70030b6b452a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:38.476600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4eb726c7-2026-49a8-bfc3-c54ceb3a739f req-4468a433-0cfc-47db-a7a1-70030b6b452a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:38.488510 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-4eb726c7-2026-49a8-bfc3-c54ceb3a739f req-4468a433-0cfc-47db-a7a1-70030b6b452a service nova] Creating event network-changed:05d56671-961f-4ad4-8ba5-aa6c6c52bb33 for instance cf240924-ed7e-4e52-ab1a-6a5bce0f7380 on n-h1-860864-2 Oct 10 23:58:38.493775 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-4eb726c7-2026-49a8-bfc3-c54ceb3a739f req-4468a433-0cfc-47db-a7a1-70030b6b452a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034457 Oct 10 23:58:38.494565 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3121/6414] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:58:38.728761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5ca8ab80-3de8-4eeb-b1d0-2935332b73ce tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:38.729563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5ca8ab80-3de8-4eeb-b1d0-2935332b73ce tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: cf240924-ed7e-4e52-ab1a-6a5bce0f7380] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:38.737646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ca8ab80-3de8-4eeb-b1d0-2935332b73ce tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:38.738353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ca8ab80-3de8-4eeb-b1d0-2935332b73ce tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:38.739015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ca8ab80-3de8-4eeb-b1d0-2935332b73ce tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:38.739892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ca8ab80-3de8-4eeb-b1d0-2935332b73ce tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:38.740547 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ca8ab80-3de8-4eeb-b1d0-2935332b73ce tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:38.741106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ca8ab80-3de8-4eeb-b1d0-2935332b73ce tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:38.904051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5ca8ab80-3de8-4eeb-b1d0-2935332b73ce tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:38.913005 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5ca8ab80-3de8-4eeb-b1d0-2935332b73ce tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380" status: 200 len: 1374 microversion: 2.1 time: 0.188333 Oct 10 23:58:38.914012 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3294/6415] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:38 2022] GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380 => generated 1374 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:39.939561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2ab67afa-505f-4589-bea9-322e739baf13 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:39.940372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2ab67afa-505f-4589-bea9-322e739baf13 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: cf240924-ed7e-4e52-ab1a-6a5bce0f7380] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:39.946933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ab67afa-505f-4589-bea9-322e739baf13 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:39.947434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ab67afa-505f-4589-bea9-322e739baf13 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:39.947979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ab67afa-505f-4589-bea9-322e739baf13 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:39.948582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ab67afa-505f-4589-bea9-322e739baf13 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:39.949038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ab67afa-505f-4589-bea9-322e739baf13 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:39.949494 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ab67afa-505f-4589-bea9-322e739baf13 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:40.120462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2ab67afa-505f-4589-bea9-322e739baf13 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:40.129837 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2ab67afa-505f-4589-bea9-322e739baf13 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380" status: 200 len: 1374 microversion: 2.1 time: 0.196771 Oct 10 23:58:40.130428 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3122/6416] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:39 2022] GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380 => generated 1374 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:41.153956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6ee2bdf1-1385-4f5f-85ee-c437e6037370 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:41.155227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6ee2bdf1-1385-4f5f-85ee-c437e6037370 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: cf240924-ed7e-4e52-ab1a-6a5bce0f7380] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:41.164160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ee2bdf1-1385-4f5f-85ee-c437e6037370 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:41.165004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ee2bdf1-1385-4f5f-85ee-c437e6037370 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:41.165732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ee2bdf1-1385-4f5f-85ee-c437e6037370 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:41.166694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ee2bdf1-1385-4f5f-85ee-c437e6037370 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:41.167526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ee2bdf1-1385-4f5f-85ee-c437e6037370 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:41.168177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ee2bdf1-1385-4f5f-85ee-c437e6037370 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:41.360573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6ee2bdf1-1385-4f5f-85ee-c437e6037370 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:41.375125 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6ee2bdf1-1385-4f5f-85ee-c437e6037370 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380" status: 200 len: 1374 microversion: 2.1 time: 0.225049 Oct 10 23:58:41.389399 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3295/6417] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:41 2022] GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380 => generated 1374 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:42.400129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c3f1cf76-e5b6-4559-b8af-7859d7b71d5b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:42.400747 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c3f1cf76-e5b6-4559-b8af-7859d7b71d5b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: cf240924-ed7e-4e52-ab1a-6a5bce0f7380] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:42.408111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3f1cf76-e5b6-4559-b8af-7859d7b71d5b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:42.408602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3f1cf76-e5b6-4559-b8af-7859d7b71d5b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:42.409040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3f1cf76-e5b6-4559-b8af-7859d7b71d5b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:42.409772 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3f1cf76-e5b6-4559-b8af-7859d7b71d5b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:42.410231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3f1cf76-e5b6-4559-b8af-7859d7b71d5b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:42.410657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3f1cf76-e5b6-4559-b8af-7859d7b71d5b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:42.570418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c3f1cf76-e5b6-4559-b8af-7859d7b71d5b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:42.581672 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c3f1cf76-e5b6-4559-b8af-7859d7b71d5b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380" status: 200 len: 1374 microversion: 2.1 time: 0.185373 Oct 10 23:58:42.582288 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3123/6418] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:42 2022] GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380 => generated 1374 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:43.380790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-7fd6aabc-47a8-4c2c-8947-e15582508a6c req-430f00b3-e164-40b1-a632-f96f499615fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf240924-ed7e-4e52-ab1a-6a5bce0f7380", "name": "network-vif-plugged", "status": "completed", "tag": "05d56671-961f-4ad4-8ba5-aa6c6c52bb33"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:58:43.393063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7fd6aabc-47a8-4c2c-8947-e15582508a6c req-430f00b3-e164-40b1-a632-f96f499615fe service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:43.394008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7fd6aabc-47a8-4c2c-8947-e15582508a6c req-430f00b3-e164-40b1-a632-f96f499615fe service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:43.394844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7fd6aabc-47a8-4c2c-8947-e15582508a6c req-430f00b3-e164-40b1-a632-f96f499615fe service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:43.409130 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-7fd6aabc-47a8-4c2c-8947-e15582508a6c req-430f00b3-e164-40b1-a632-f96f499615fe service nova] Creating event network-vif-plugged:05d56671-961f-4ad4-8ba5-aa6c6c52bb33 for instance cf240924-ed7e-4e52-ab1a-6a5bce0f7380 on n-h1-860864-2 Oct 10 23:58:43.422141 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-7fd6aabc-47a8-4c2c-8947-e15582508a6c req-430f00b3-e164-40b1-a632-f96f499615fe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046694 Oct 10 23:58:43.423332 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3296/6419] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:58:43.608640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-47f2b445-8433-4557-9711-b5038ff6dd7f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:43.609362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-47f2b445-8433-4557-9711-b5038ff6dd7f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: cf240924-ed7e-4e52-ab1a-6a5bce0f7380] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:43.618034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47f2b445-8433-4557-9711-b5038ff6dd7f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:43.618525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47f2b445-8433-4557-9711-b5038ff6dd7f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:43.618966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47f2b445-8433-4557-9711-b5038ff6dd7f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:43.619664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47f2b445-8433-4557-9711-b5038ff6dd7f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:43.620317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47f2b445-8433-4557-9711-b5038ff6dd7f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:43.620750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47f2b445-8433-4557-9711-b5038ff6dd7f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:43.791530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-47f2b445-8433-4557-9711-b5038ff6dd7f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:43.805351 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-47f2b445-8433-4557-9711-b5038ff6dd7f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380" status: 200 len: 1374 microversion: 2.1 time: 0.202346 Oct 10 23:58:43.817585 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3124/6420] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:43 2022] GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380 => generated 1374 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:44.833900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-56e5abd4-dec7-4c26-99f8-d521bb5e150c tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:44.835567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-56e5abd4-dec7-4c26-99f8-d521bb5e150c tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: cf240924-ed7e-4e52-ab1a-6a5bce0f7380] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:44.847066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56e5abd4-dec7-4c26-99f8-d521bb5e150c tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:44.847992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56e5abd4-dec7-4c26-99f8-d521bb5e150c tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:44.849692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56e5abd4-dec7-4c26-99f8-d521bb5e150c tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:44.850082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56e5abd4-dec7-4c26-99f8-d521bb5e150c tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:44.850944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56e5abd4-dec7-4c26-99f8-d521bb5e150c tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:44.851850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-56e5abd4-dec7-4c26-99f8-d521bb5e150c tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:44.891766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:58:44.930109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=10 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:58:45.086658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-56e5abd4-dec7-4c26-99f8-d521bb5e150c tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:45.100055 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-56e5abd4-dec7-4c26-99f8-d521bb5e150c tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380" status: 200 len: 1374 microversion: 2.1 time: 0.272121 Oct 10 23:58:45.100696 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3297/6421] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:44 2022] GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380 => generated 1374 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:46.129266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7e499a80-87e5-4968-b9f0-3a792314dc5d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:46.130425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7e499a80-87e5-4968-b9f0-3a792314dc5d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: cf240924-ed7e-4e52-ab1a-6a5bce0f7380] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:46.133494 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:58:46.139038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e499a80-87e5-4968-b9f0-3a792314dc5d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:46.139526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e499a80-87e5-4968-b9f0-3a792314dc5d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:46.139965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e499a80-87e5-4968-b9f0-3a792314dc5d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:46.140830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e499a80-87e5-4968-b9f0-3a792314dc5d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:46.142270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e499a80-87e5-4968-b9f0-3a792314dc5d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:46.142846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7e499a80-87e5-4968-b9f0-3a792314dc5d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:46.276076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7e499a80-87e5-4968-b9f0-3a792314dc5d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:46.284505 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7e499a80-87e5-4968-b9f0-3a792314dc5d tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380" status: 200 len: 1545 microversion: 2.1 time: 0.163743 Oct 10 23:58:46.285090 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3125/6422] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:46 2022] GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380 => generated 1545 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:46.307188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b5eb85e9-f2d4-4e21-b981-b52d634b7a93 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:58:46.307852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b5eb85e9-f2d4-4e21-b981-b52d634b7a93 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: cf240924-ed7e-4e52-ab1a-6a5bce0f7380] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:46.315341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b5eb85e9-f2d4-4e21-b981-b52d634b7a93 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:46.315828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b5eb85e9-f2d4-4e21-b981-b52d634b7a93 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:46.316309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b5eb85e9-f2d4-4e21-b981-b52d634b7a93 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:46.316972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b5eb85e9-f2d4-4e21-b981-b52d634b7a93 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:46.317470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b5eb85e9-f2d4-4e21-b981-b52d634b7a93 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:46.317907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b5eb85e9-f2d4-4e21-b981-b52d634b7a93 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:46.461896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b5eb85e9-f2d4-4e21-b981-b52d634b7a93 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:58:46.470720 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b5eb85e9-f2d4-4e21-b981-b52d634b7a93 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380" status: 200 len: 1545 microversion: 2.1 time: 0.167695 Oct 10 23:58:46.471326 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3298/6423] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:58:46 2022] GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380 => generated 1545 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:58:48.678376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-198d8aaf-44c2-41d9-b61e-0b9fc754bb69 req-8f89ad7f-bdb2-451d-b73d-161752083db8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf240924-ed7e-4e52-ab1a-6a5bce0f7380", "tag": "05d56671-961f-4ad4-8ba5-aa6c6c52bb33"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:58:48.688539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:58:48.691793 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-198d8aaf-44c2-41d9-b61e-0b9fc754bb69 req-8f89ad7f-bdb2-451d-b73d-161752083db8 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:48.692507 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-198d8aaf-44c2-41d9-b61e-0b9fc754bb69 req-8f89ad7f-bdb2-451d-b73d-161752083db8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:48.693104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-198d8aaf-44c2-41d9-b61e-0b9fc754bb69 req-8f89ad7f-bdb2-451d-b73d-161752083db8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:48.709288 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-198d8aaf-44c2-41d9-b61e-0b9fc754bb69 req-8f89ad7f-bdb2-451d-b73d-161752083db8 service nova] Creating event network-changed:05d56671-961f-4ad4-8ba5-aa6c6c52bb33 for instance cf240924-ed7e-4e52-ab1a-6a5bce0f7380 on n-h1-860864-2 Oct 10 23:58:48.716866 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-198d8aaf-44c2-41d9-b61e-0b9fc754bb69 req-8f89ad7f-bdb2-451d-b73d-161752083db8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043921 Oct 10 23:58:48.718464 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3126/6424] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:58:58.140551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-03813eeb-1c07-4741-bf11-95544caaf321 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:58:58.143673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-03813eeb-1c07-4741-bf11-95544caaf321 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:58:58.146449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:58:58.147316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=39 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:58:58.155582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03813eeb-1c07-4741-bf11-95544caaf321 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:58.156000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03813eeb-1c07-4741-bf11-95544caaf321 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:58.156441 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03813eeb-1c07-4741-bf11-95544caaf321 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:58.158082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03813eeb-1c07-4741-bf11-95544caaf321 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:58:58.158639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03813eeb-1c07-4741-bf11-95544caaf321 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:58:58.159082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03813eeb-1c07-4741-bf11-95544caaf321 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:58:58.212713 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-03813eeb-1c07-4741-bf11-95544caaf321 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "POST /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55/action" status: 200 len: 24565 microversion: 2.1 time: 0.076594 Oct 10 23:58:58.220594 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3299/6425] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:58:58 2022] POST /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55/action => generated 24565 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:59:02.912595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=35 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:59:02.913838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:59:02.918551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-39e3530e-07c7-4b8e-b45e-d445e3486797 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:02.919164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-39e3530e-07c7-4b8e-b45e-d445e3486797 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:02.928058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-39e3530e-07c7-4b8e-b45e-d445e3486797 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:02.928557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-39e3530e-07c7-4b8e-b45e-d445e3486797 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:02.929006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-39e3530e-07c7-4b8e-b45e-d445e3486797 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:02.929775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-39e3530e-07c7-4b8e-b45e-d445e3486797 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:02.930246 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-39e3530e-07c7-4b8e-b45e-d445e3486797 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:02.930683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-39e3530e-07c7-4b8e-b45e-d445e3486797 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:02.957592 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-39e3530e-07c7-4b8e-b45e-d445e3486797 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae/ips" status: 200 len: 149 microversion: 2.1 time: 0.048085 Oct 10 23:59:02.958217 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3127/6426] 10.222.0.23 () {58 vars in 1248 bytes} [Mon Oct 10 23:59:02 2022] GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:59:04.400227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-daf99c8e-811c-46cc-9a93-0a808c34aaee tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e981fc10-e439-411e-b0dc-5c1237689659"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:59:04.402925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-daf99c8e-811c-46cc-9a93-0a808c34aaee tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:04.411409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-daf99c8e-811c-46cc-9a93-0a808c34aaee tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:04.411959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-daf99c8e-811c-46cc-9a93-0a808c34aaee tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:04.412401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-daf99c8e-811c-46cc-9a93-0a808c34aaee tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:04.413116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-daf99c8e-811c-46cc-9a93-0a808c34aaee tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:04.413680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-daf99c8e-811c-46cc-9a93-0a808c34aaee tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:04.414111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-daf99c8e-811c-46cc-9a93-0a808c34aaee tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:04.708798 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-daf99c8e-811c-46cc-9a93-0a808c34aaee tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "POST /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314288 Oct 10 23:59:04.709827 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3300/6427] 10.222.0.23 () {60 vars in 1323 bytes} [Mon Oct 10 23:59:04 2022] POST /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:59:09.114963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4b02e9ec-c672-4b10-8872-732c0c697bc9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:59:09.118331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4b02e9ec-c672-4b10-8872-732c0c697bc9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:09.125358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b02e9ec-c672-4b10-8872-732c0c697bc9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:09.127042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b02e9ec-c672-4b10-8872-732c0c697bc9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:09.127500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b02e9ec-c672-4b10-8872-732c0c697bc9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:09.128202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b02e9ec-c672-4b10-8872-732c0c697bc9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:09.128660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b02e9ec-c672-4b10-8872-732c0c697bc9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:09.129089 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b02e9ec-c672-4b10-8872-732c0c697bc9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:09.211787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4b02e9ec-c672-4b10-8872-732c0c697bc9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 23:59:09.212311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4b02e9ec-c672-4b10-8872-732c0c697bc9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 23:59:09.212707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4b02e9ec-c672-4b10-8872-732c0c697bc9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 23:59:09.213126 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4b02e9ec-c672-4b10-8872-732c0c697bc9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 23:59:09.213608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4b02e9ec-c672-4b10-8872-732c0c697bc9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 23:59:09.277705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4b02e9ec-c672-4b10-8872-732c0c697bc9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:09.284573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b02e9ec-c672-4b10-8872-732c0c697bc9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:09.285173 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b02e9ec-c672-4b10-8872-732c0c697bc9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:09.285737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b02e9ec-c672-4b10-8872-732c0c697bc9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:09.286550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b02e9ec-c672-4b10-8872-732c0c697bc9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:09.287213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b02e9ec-c672-4b10-8872-732c0c697bc9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:09.287901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b02e9ec-c672-4b10-8872-732c0c697bc9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:09.320242 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4b02e9ec-c672-4b10-8872-732c0c697bc9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "POST /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55/action" status: 202 len: 1137 microversion: 2.1 time: 0.210886 Oct 10 23:59:09.330521 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3128/6428] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:59:09 2022] POST /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55/action => generated 1137 bytes in 212 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 10 23:59:09.343346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-578b0aa3-127a-4b79-b5cd-f141151b0757 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:09.344202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-578b0aa3-127a-4b79-b5cd-f141151b0757 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:09.353549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-578b0aa3-127a-4b79-b5cd-f141151b0757 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:09.354568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-578b0aa3-127a-4b79-b5cd-f141151b0757 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:09.355234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-578b0aa3-127a-4b79-b5cd-f141151b0757 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:09.356363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-578b0aa3-127a-4b79-b5cd-f141151b0757 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:09.357002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-578b0aa3-127a-4b79-b5cd-f141151b0757 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:09.357891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-578b0aa3-127a-4b79-b5cd-f141151b0757 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:09.529340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-578b0aa3-127a-4b79-b5cd-f141151b0757 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:59:09.539292 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-578b0aa3-127a-4b79-b5cd-f141151b0757 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1691 microversion: 2.1 time: 0.200361 Oct 10 23:59:09.539937 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3301/6429] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:09 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1691 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:59:10.570573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f45af022-aaab-4c2d-8fbf-e8b3cf86adb4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:10.571594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f45af022-aaab-4c2d-8fbf-e8b3cf86adb4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:10.579452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f45af022-aaab-4c2d-8fbf-e8b3cf86adb4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:10.579944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f45af022-aaab-4c2d-8fbf-e8b3cf86adb4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:10.580385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f45af022-aaab-4c2d-8fbf-e8b3cf86adb4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:10.581094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f45af022-aaab-4c2d-8fbf-e8b3cf86adb4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:10.581582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f45af022-aaab-4c2d-8fbf-e8b3cf86adb4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:10.582010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f45af022-aaab-4c2d-8fbf-e8b3cf86adb4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:10.747037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f45af022-aaab-4c2d-8fbf-e8b3cf86adb4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:59:10.756369 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f45af022-aaab-4c2d-8fbf-e8b3cf86adb4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1691 microversion: 2.1 time: 0.191630 Oct 10 23:59:10.757065 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3129/6430] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:10 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1691 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:59:11.781739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d1b14306-fe38-4756-ac6c-257599b79471 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:11.783152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d1b14306-fe38-4756-ac6c-257599b79471 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:11.790438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1b14306-fe38-4756-ac6c-257599b79471 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:11.791636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1b14306-fe38-4756-ac6c-257599b79471 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:11.792087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1b14306-fe38-4756-ac6c-257599b79471 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:11.792802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1b14306-fe38-4756-ac6c-257599b79471 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:11.793267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1b14306-fe38-4756-ac6c-257599b79471 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:11.793706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1b14306-fe38-4756-ac6c-257599b79471 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:11.949921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d1b14306-fe38-4756-ac6c-257599b79471 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:59:11.959828 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d1b14306-fe38-4756-ac6c-257599b79471 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1691 microversion: 2.1 time: 0.183089 Oct 10 23:59:11.961061 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3302/6431] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:11 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1691 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:59:12.984786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5ce310b2-1489-4c45-bf95-a23050e897d9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:12.987207 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5ce310b2-1489-4c45-bf95-a23050e897d9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:12.994925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ce310b2-1489-4c45-bf95-a23050e897d9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:12.995398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ce310b2-1489-4c45-bf95-a23050e897d9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:12.995837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ce310b2-1489-4c45-bf95-a23050e897d9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:12.996773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ce310b2-1489-4c45-bf95-a23050e897d9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:12.997367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ce310b2-1489-4c45-bf95-a23050e897d9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:12.997883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5ce310b2-1489-4c45-bf95-a23050e897d9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:13.182206 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5ce310b2-1489-4c45-bf95-a23050e897d9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:59:13.192512 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5ce310b2-1489-4c45-bf95-a23050e897d9 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1691 microversion: 2.1 time: 0.212004 Oct 10 23:59:13.193123 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3130/6432] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:12 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1691 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:59:14.218814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b0eabdc7-26ef-4047-bf2b-c27cf900e932 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:14.219682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b0eabdc7-26ef-4047-bf2b-c27cf900e932 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:14.227036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0eabdc7-26ef-4047-bf2b-c27cf900e932 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:14.227532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0eabdc7-26ef-4047-bf2b-c27cf900e932 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:14.227980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0eabdc7-26ef-4047-bf2b-c27cf900e932 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:14.228820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0eabdc7-26ef-4047-bf2b-c27cf900e932 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:14.229316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0eabdc7-26ef-4047-bf2b-c27cf900e932 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:14.229791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0eabdc7-26ef-4047-bf2b-c27cf900e932 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:14.378057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b0eabdc7-26ef-4047-bf2b-c27cf900e932 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:59:14.386664 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b0eabdc7-26ef-4047-bf2b-c27cf900e932 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1691 microversion: 2.1 time: 0.172238 Oct 10 23:59:14.387272 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3303/6433] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:14 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:59:15.411891 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f60ea607-4745-4a8f-a4bb-1b29e1e726fe tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:15.412581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f60ea607-4745-4a8f-a4bb-1b29e1e726fe tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:15.419676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f60ea607-4745-4a8f-a4bb-1b29e1e726fe tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:15.420164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f60ea607-4745-4a8f-a4bb-1b29e1e726fe tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:15.420604 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f60ea607-4745-4a8f-a4bb-1b29e1e726fe tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:15.421311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f60ea607-4745-4a8f-a4bb-1b29e1e726fe tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:15.421795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f60ea607-4745-4a8f-a4bb-1b29e1e726fe tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:15.422222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f60ea607-4745-4a8f-a4bb-1b29e1e726fe tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:15.594141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f60ea607-4745-4a8f-a4bb-1b29e1e726fe tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:59:15.604252 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f60ea607-4745-4a8f-a4bb-1b29e1e726fe tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1691 microversion: 2.1 time: 0.197389 Oct 10 23:59:15.604841 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3131/6434] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:15 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1691 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:59:16.630551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3ae9fd4e-191c-4a2e-8f32-c0194c6b7594 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:16.631196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3ae9fd4e-191c-4a2e-8f32-c0194c6b7594 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:16.638917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ae9fd4e-191c-4a2e-8f32-c0194c6b7594 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:16.639342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ae9fd4e-191c-4a2e-8f32-c0194c6b7594 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:16.639787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ae9fd4e-191c-4a2e-8f32-c0194c6b7594 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:16.640508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ae9fd4e-191c-4a2e-8f32-c0194c6b7594 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:16.640961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ae9fd4e-191c-4a2e-8f32-c0194c6b7594 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:16.642079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ae9fd4e-191c-4a2e-8f32-c0194c6b7594 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:16.791194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3ae9fd4e-191c-4a2e-8f32-c0194c6b7594 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:59:16.799979 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3ae9fd4e-191c-4a2e-8f32-c0194c6b7594 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1691 microversion: 2.1 time: 0.175217 Oct 10 23:59:16.800726 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3304/6435] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:16 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:59:17.824980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f5651a55-4d0b-4ddb-b80e-bbb1e4be1f59 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:17.825623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f5651a55-4d0b-4ddb-b80e-bbb1e4be1f59 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:17.833540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5651a55-4d0b-4ddb-b80e-bbb1e4be1f59 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:17.834037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5651a55-4d0b-4ddb-b80e-bbb1e4be1f59 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:17.834477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5651a55-4d0b-4ddb-b80e-bbb1e4be1f59 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:17.835183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5651a55-4d0b-4ddb-b80e-bbb1e4be1f59 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:17.835639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5651a55-4d0b-4ddb-b80e-bbb1e4be1f59 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:17.836318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f5651a55-4d0b-4ddb-b80e-bbb1e4be1f59 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:17.978184 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f5651a55-4d0b-4ddb-b80e-bbb1e4be1f59 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:59:17.987578 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f5651a55-4d0b-4ddb-b80e-bbb1e4be1f59 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1691 microversion: 2.1 time: 0.166406 Oct 10 23:59:17.988176 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3132/6436] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:17 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:59:19.012492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-91a70531-5306-4534-9819-ce41794a2c96 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:19.013193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-91a70531-5306-4534-9819-ce41794a2c96 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:19.020909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91a70531-5306-4534-9819-ce41794a2c96 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:19.021425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91a70531-5306-4534-9819-ce41794a2c96 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:19.021870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91a70531-5306-4534-9819-ce41794a2c96 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:19.022567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91a70531-5306-4534-9819-ce41794a2c96 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:19.023020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91a70531-5306-4534-9819-ce41794a2c96 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:19.023444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91a70531-5306-4534-9819-ce41794a2c96 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:19.186369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-91a70531-5306-4534-9819-ce41794a2c96 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:59:19.195828 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-91a70531-5306-4534-9819-ce41794a2c96 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1691 microversion: 2.1 time: 0.187342 Oct 10 23:59:19.196368 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3305/6437] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:19 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1691 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:59:19.644712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ca38d0f5-a2b2-4376-b4ef-6c9887ce32bd tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:19.645251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ca38d0f5-a2b2-4376-b4ef-6c9887ce32bd tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:19.652422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca38d0f5-a2b2-4376-b4ef-6c9887ce32bd tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:19.652838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca38d0f5-a2b2-4376-b4ef-6c9887ce32bd tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:19.653270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca38d0f5-a2b2-4376-b4ef-6c9887ce32bd tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:19.653987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca38d0f5-a2b2-4376-b4ef-6c9887ce32bd tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:19.654437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca38d0f5-a2b2-4376-b4ef-6c9887ce32bd tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:19.654859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca38d0f5-a2b2-4376-b4ef-6c9887ce32bd tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:19.742749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-ca38d0f5-a2b2-4376-b4ef-6c9887ce32bd tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lazy-loading 'services' on Instance uuid 39e1755a-018f-4ce2-a49d-df4225ae03ae {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:59:19.830199 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ca38d0f5-a2b2-4376-b4ef-6c9887ce32bd tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "DELETE /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae/os-volume_attachments/e981fc10-e439-411e-b0dc-5c1237689659" status: 202 len: 0 microversion: 2.1 time: 0.188413 Oct 10 23:59:19.831458 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3133/6438] 10.222.0.23 () {58 vars in 1416 bytes} [Mon Oct 10 23:59:19 2022] DELETE /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae/os-volume_attachments/e981fc10-e439-411e-b0dc-5c1237689659 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:59:19.840985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-19d6a7f6-5f0d-45a5-a058-cc34b248f2a6 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:19.843649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-19d6a7f6-5f0d-45a5-a058-cc34b248f2a6 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:19.851072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19d6a7f6-5f0d-45a5-a058-cc34b248f2a6 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:19.851883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19d6a7f6-5f0d-45a5-a058-cc34b248f2a6 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:19.852382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19d6a7f6-5f0d-45a5-a058-cc34b248f2a6 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:19.853319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19d6a7f6-5f0d-45a5-a058-cc34b248f2a6 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:19.854006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19d6a7f6-5f0d-45a5-a058-cc34b248f2a6 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:19.854432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19d6a7f6-5f0d-45a5-a058-cc34b248f2a6 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:19.893712 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-19d6a7f6-5f0d-45a5-a058-cc34b248f2a6 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056963 Oct 10 23:59:19.894298 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3306/6439] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:59:19 2022] GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:59:20.225688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fd37c2f8-6d17-4f0a-a7a0-28935a3717ff tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:20.227222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fd37c2f8-6d17-4f0a-a7a0-28935a3717ff tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:20.239579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd37c2f8-6d17-4f0a-a7a0-28935a3717ff tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:20.240529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd37c2f8-6d17-4f0a-a7a0-28935a3717ff tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:20.241594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd37c2f8-6d17-4f0a-a7a0-28935a3717ff tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:20.243516 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd37c2f8-6d17-4f0a-a7a0-28935a3717ff tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:20.244013 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd37c2f8-6d17-4f0a-a7a0-28935a3717ff tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:20.244886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fd37c2f8-6d17-4f0a-a7a0-28935a3717ff tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:20.428921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fd37c2f8-6d17-4f0a-a7a0-28935a3717ff tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:59:20.437345 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fd37c2f8-6d17-4f0a-a7a0-28935a3717ff tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1691 microversion: 2.1 time: 0.218939 Oct 10 23:59:20.453409 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3134/6440] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:20 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1691 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:59:20.908183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-deb6e1b0-0e72-43ac-87a6-f148d76ce331 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:20.910558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-deb6e1b0-0e72-43ac-87a6-f148d76ce331 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:20.918608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-deb6e1b0-0e72-43ac-87a6-f148d76ce331 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:20.919400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-deb6e1b0-0e72-43ac-87a6-f148d76ce331 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:20.920008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-deb6e1b0-0e72-43ac-87a6-f148d76ce331 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:20.920924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-deb6e1b0-0e72-43ac-87a6-f148d76ce331 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:20.921593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-deb6e1b0-0e72-43ac-87a6-f148d76ce331 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:20.922189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-deb6e1b0-0e72-43ac-87a6-f148d76ce331 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:20.966529 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-deb6e1b0-0e72-43ac-87a6-f148d76ce331 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062690 Oct 10 23:59:20.967276 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3307/6441] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:59:20 2022] GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:59:21.468184 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e5929882-1c90-4965-9143-e2f0dfff04a4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:21.469256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e5929882-1c90-4965-9143-e2f0dfff04a4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:21.483232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5929882-1c90-4965-9143-e2f0dfff04a4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:21.483785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5929882-1c90-4965-9143-e2f0dfff04a4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:21.484281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5929882-1c90-4965-9143-e2f0dfff04a4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:21.486477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5929882-1c90-4965-9143-e2f0dfff04a4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:21.486870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5929882-1c90-4965-9143-e2f0dfff04a4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:21.487726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5929882-1c90-4965-9143-e2f0dfff04a4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:21.717809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e5929882-1c90-4965-9143-e2f0dfff04a4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:59:21.727341 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e5929882-1c90-4965-9143-e2f0dfff04a4 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1697 microversion: 2.1 time: 0.265174 Oct 10 23:59:21.728220 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3135/6442] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:21 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1697 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:59:21.981569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0e5a33d3-8b10-4441-b22f-5d3dbfd1e9bc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:21.984170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0e5a33d3-8b10-4441-b22f-5d3dbfd1e9bc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:21.994201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e5a33d3-8b10-4441-b22f-5d3dbfd1e9bc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:21.994817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e5a33d3-8b10-4441-b22f-5d3dbfd1e9bc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:21.995336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e5a33d3-8b10-4441-b22f-5d3dbfd1e9bc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:21.996123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e5a33d3-8b10-4441-b22f-5d3dbfd1e9bc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:21.996672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e5a33d3-8b10-4441-b22f-5d3dbfd1e9bc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:21.997179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e5a33d3-8b10-4441-b22f-5d3dbfd1e9bc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:22.054461 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0e5a33d3-8b10-4441-b22f-5d3dbfd1e9bc tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077376 Oct 10 23:59:22.055685 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3308/6443] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:59:21 2022] GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:59:22.760033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d93b97c3-e043-48b6-a06b-7d595e7260cd tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:22.764447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d93b97c3-e043-48b6-a06b-7d595e7260cd tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:22.767324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d93b97c3-e043-48b6-a06b-7d595e7260cd tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:22.767911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d93b97c3-e043-48b6-a06b-7d595e7260cd tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:22.769060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d93b97c3-e043-48b6-a06b-7d595e7260cd tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:22.769956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d93b97c3-e043-48b6-a06b-7d595e7260cd tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:22.770595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d93b97c3-e043-48b6-a06b-7d595e7260cd tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:22.771097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d93b97c3-e043-48b6-a06b-7d595e7260cd tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:22.946007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d93b97c3-e043-48b6-a06b-7d595e7260cd tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:59:22.957754 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d93b97c3-e043-48b6-a06b-7d595e7260cd tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1697 microversion: 2.1 time: 0.203051 Oct 10 23:59:22.959017 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3136/6444] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:22 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1697 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:59:23.072395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2559f7a3-774f-4252-b31b-da26f05ac3bb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:23.075930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2559f7a3-774f-4252-b31b-da26f05ac3bb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:23.096571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d4428e4b-d545-4db3-8ee1-877cf073c04f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:59:23.097607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2559f7a3-774f-4252-b31b-da26f05ac3bb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:23.098300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2559f7a3-774f-4252-b31b-da26f05ac3bb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:23.098911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2559f7a3-774f-4252-b31b-da26f05ac3bb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:23.099887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2559f7a3-774f-4252-b31b-da26f05ac3bb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:23.100510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2559f7a3-774f-4252-b31b-da26f05ac3bb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:23.101104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2559f7a3-774f-4252-b31b-da26f05ac3bb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:23.103192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d4428e4b-d545-4db3-8ee1-877cf073c04f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: cf240924-ed7e-4e52-ab1a-6a5bce0f7380] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:23.122691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4428e4b-d545-4db3-8ee1-877cf073c04f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:23.123825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4428e4b-d545-4db3-8ee1-877cf073c04f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:23.123825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4428e4b-d545-4db3-8ee1-877cf073c04f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:23.125094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4428e4b-d545-4db3-8ee1-877cf073c04f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:23.126475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4428e4b-d545-4db3-8ee1-877cf073c04f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:23.126475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4428e4b-d545-4db3-8ee1-877cf073c04f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:23.140116 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2559f7a3-774f-4252-b31b-da26f05ac3bb tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075718 Oct 10 23:59:23.140735 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3309/6445] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:59:23 2022] GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:59:23.229589 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d4428e4b-d545-4db3-8ee1-877cf073c04f tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "POST /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380/action" status: 200 len: 24571 microversion: 2.1 time: 0.139203 Oct 10 23:59:23.231174 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3137/6446] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:59:23 2022] POST /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380/action => generated 24571 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:59:24.091765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3deaf7bd-e12a-4c6f-b640-65d6af5942af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:24.094583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3deaf7bd-e12a-4c6f-b640-65d6af5942af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:24.101407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3deaf7bd-e12a-4c6f-b640-65d6af5942af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:24.101683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3deaf7bd-e12a-4c6f-b640-65d6af5942af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:24.101985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3deaf7bd-e12a-4c6f-b640-65d6af5942af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:24.102726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3deaf7bd-e12a-4c6f-b640-65d6af5942af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:24.103192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3deaf7bd-e12a-4c6f-b640-65d6af5942af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:24.103620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3deaf7bd-e12a-4c6f-b640-65d6af5942af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:24.153250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-648ef86c-523c-4eb7-a732-0d3518b49f9d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:24.155820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-648ef86c-523c-4eb7-a732-0d3518b49f9d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:24.165121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-648ef86c-523c-4eb7-a732-0d3518b49f9d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:24.165717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-648ef86c-523c-4eb7-a732-0d3518b49f9d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:24.175252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-648ef86c-523c-4eb7-a732-0d3518b49f9d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:24.176232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-648ef86c-523c-4eb7-a732-0d3518b49f9d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:24.176730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-648ef86c-523c-4eb7-a732-0d3518b49f9d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:24.177174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-648ef86c-523c-4eb7-a732-0d3518b49f9d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:24.242164 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-648ef86c-523c-4eb7-a732-0d3518b49f9d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093381 Oct 10 23:59:24.243419 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3138/6447] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:59:24 2022] GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 23:59:24.320513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3deaf7bd-e12a-4c6f-b640-65d6af5942af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:59:24.331886 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3deaf7bd-e12a-4c6f-b640-65d6af5942af tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1682 microversion: 2.1 time: 0.352818 Oct 10 23:59:24.345401 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3310/6448] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:23 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1682 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:59:25.256034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1f80b67b-6e78-4b0c-bb15-f29a17b66392 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:25.258511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1f80b67b-6e78-4b0c-bb15-f29a17b66392 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:25.265129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f80b67b-6e78-4b0c-bb15-f29a17b66392 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:25.265894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f80b67b-6e78-4b0c-bb15-f29a17b66392 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:25.266777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f80b67b-6e78-4b0c-bb15-f29a17b66392 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:25.267729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f80b67b-6e78-4b0c-bb15-f29a17b66392 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:25.268358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f80b67b-6e78-4b0c-bb15-f29a17b66392 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:25.268953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f80b67b-6e78-4b0c-bb15-f29a17b66392 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:25.306975 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1f80b67b-6e78-4b0c-bb15-f29a17b66392 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055065 Oct 10 23:59:25.313820 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3139/6449] 10.222.0.23 () {58 vars in 1302 bytes} [Mon Oct 10 23:59:25 2022] GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 23:59:25.384165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c072479e-8bf4-422b-94c9-f63d321357ad tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:25.384665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c072479e-8bf4-422b-94c9-f63d321357ad tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:25.391848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c072479e-8bf4-422b-94c9-f63d321357ad tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:25.392348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c072479e-8bf4-422b-94c9-f63d321357ad tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:25.393698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c072479e-8bf4-422b-94c9-f63d321357ad tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:25.394422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c072479e-8bf4-422b-94c9-f63d321357ad tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:25.394877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c072479e-8bf4-422b-94c9-f63d321357ad tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:25.395305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c072479e-8bf4-422b-94c9-f63d321357ad tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:25.423945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c072479e-8bf4-422b-94c9-f63d321357ad tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:59:25.465920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-955fbbe2-9cb5-4c23-9d2b-d9dbabb0347c req-96711daf-9b79-45af-bfcf-e97d43584ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b1818e-1773-44f3-8fd2-961584626f55", "name": "network-vif-plugged", "status": "completed", "tag": "6101695e-9095-4573-b82c-5f89f85b4261"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:59:25.493804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-955fbbe2-9cb5-4c23-9d2b-d9dbabb0347c req-96711daf-9b79-45af-bfcf-e97d43584ab0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:25.498148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-955fbbe2-9cb5-4c23-9d2b-d9dbabb0347c req-96711daf-9b79-45af-bfcf-e97d43584ab0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:25.498680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-955fbbe2-9cb5-4c23-9d2b-d9dbabb0347c req-96711daf-9b79-45af-bfcf-e97d43584ab0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:25.516872 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-955fbbe2-9cb5-4c23-9d2b-d9dbabb0347c req-96711daf-9b79-45af-bfcf-e97d43584ab0 service nova] Creating event network-vif-plugged:6101695e-9095-4573-b82c-5f89f85b4261 for instance 21b1818e-1773-44f3-8fd2-961584626f55 on n-h2-860864-2 Oct 10 23:59:25.523784 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-955fbbe2-9cb5-4c23-9d2b-d9dbabb0347c req-96711daf-9b79-45af-bfcf-e97d43584ab0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065058 Oct 10 23:59:25.527418 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3140/6450] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:59:25.541659 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c072479e-8bf4-422b-94c9-f63d321357ad tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "DELETE /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae" status: 204 len: 0 microversion: 2.1 time: 0.160989 Oct 10 23:59:25.546676 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3311/6451] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:59:25 2022] DELETE /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:59:25.553645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ef6ce023-738a-4673-9bd8-cc44edfaee34 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:25.554287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ef6ce023-738a-4673-9bd8-cc44edfaee34 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:25.562219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef6ce023-738a-4673-9bd8-cc44edfaee34 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:25.562725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef6ce023-738a-4673-9bd8-cc44edfaee34 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:25.563731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef6ce023-738a-4673-9bd8-cc44edfaee34 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:25.564452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef6ce023-738a-4673-9bd8-cc44edfaee34 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:25.565042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef6ce023-738a-4673-9bd8-cc44edfaee34 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:25.566490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ef6ce023-738a-4673-9bd8-cc44edfaee34 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:25.725774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ef6ce023-738a-4673-9bd8-cc44edfaee34 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:59:25.734746 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ef6ce023-738a-4673-9bd8-cc44edfaee34 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae" status: 200 len: 1680 microversion: 2.1 time: 0.186185 Oct 10 23:59:25.752461 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3141/6452] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:25 2022] GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae => generated 1680 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:59:26.760916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-eeb99880-e084-4fc8-9a32-f556173187e7 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:26.761666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-eeb99880-e084-4fc8-9a32-f556173187e7 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:26.769548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eeb99880-e084-4fc8-9a32-f556173187e7 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:26.770055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eeb99880-e084-4fc8-9a32-f556173187e7 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:26.770495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eeb99880-e084-4fc8-9a32-f556173187e7 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:26.771218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eeb99880-e084-4fc8-9a32-f556173187e7 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:26.771676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eeb99880-e084-4fc8-9a32-f556173187e7 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:26.772106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eeb99880-e084-4fc8-9a32-f556173187e7 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:26.921833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-eeb99880-e084-4fc8-9a32-f556173187e7 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:59:26.925731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:59:26.931152 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-eeb99880-e084-4fc8-9a32-f556173187e7 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae" status: 200 len: 1680 microversion: 2.1 time: 0.174578 Oct 10 23:59:26.931759 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3312/6453] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:26 2022] GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:59:27.959249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-25335c89-b05c-4403-b739-7407ec628e48 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:27.959864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-25335c89-b05c-4403-b739-7407ec628e48 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:27.967298 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25335c89-b05c-4403-b739-7407ec628e48 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:27.967799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25335c89-b05c-4403-b739-7407ec628e48 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:27.968236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25335c89-b05c-4403-b739-7407ec628e48 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:27.968944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25335c89-b05c-4403-b739-7407ec628e48 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:27.970109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25335c89-b05c-4403-b739-7407ec628e48 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:27.971034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-25335c89-b05c-4403-b739-7407ec628e48 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:28.006943 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:59:28.066977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-25335c89-b05c-4403-b739-7407ec628e48 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7008c9b5ad94dbea7edc12267dae2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fcaa1fb124e448b8bacb6353fca9d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:59:28.075622 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-25335c89-b05c-4403-b739-7407ec628e48 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae" status: 200 len: 1613 microversion: 2.1 time: 0.121440 Oct 10 23:59:28.076230 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3142/6454] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:27 2022] GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae => generated 1613 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 23:59:28.274253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-4a416a1e-041d-4fff-8149-9a4ab2d7701b req-39b5089a-73f7-4461-89da-a0ddbffba62b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e1755a-018f-4ce2-a49d-df4225ae03ae", "name": "network-vif-deleted", "tag": "99bdec86-ea8b-49e2-8327-db793f2e67af"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:59:28.284214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:59:28.297552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4a416a1e-041d-4fff-8149-9a4ab2d7701b req-39b5089a-73f7-4461-89da-a0ddbffba62b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:28.298480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4a416a1e-041d-4fff-8149-9a4ab2d7701b req-39b5089a-73f7-4461-89da-a0ddbffba62b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:28.299239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4a416a1e-041d-4fff-8149-9a4ab2d7701b req-39b5089a-73f7-4461-89da-a0ddbffba62b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:28.313236 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-4a416a1e-041d-4fff-8149-9a4ab2d7701b req-39b5089a-73f7-4461-89da-a0ddbffba62b service nova] Creating event network-vif-deleted:99bdec86-ea8b-49e2-8327-db793f2e67af for instance 39e1755a-018f-4ce2-a49d-df4225ae03ae on n-h1-860864-2 Oct 10 23:59:28.326588 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-4a416a1e-041d-4fff-8149-9a4ab2d7701b req-39b5089a-73f7-4461-89da-a0ddbffba62b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050274 Oct 10 23:59:28.327688 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3313/6455] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:59:29.104117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6b8041f6-9e0c-4197-8ccd-be1978119887 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:29.118321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6b8041f6-9e0c-4197-8ccd-be1978119887 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:29.127607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b8041f6-9e0c-4197-8ccd-be1978119887 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:29.128145 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b8041f6-9e0c-4197-8ccd-be1978119887 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:29.128586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b8041f6-9e0c-4197-8ccd-be1978119887 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:29.129328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b8041f6-9e0c-4197-8ccd-be1978119887 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:29.129978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b8041f6-9e0c-4197-8ccd-be1978119887 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:29.130399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b8041f6-9e0c-4197-8ccd-be1978119887 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:29.146764 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-6b8041f6-9e0c-4197-8ccd-be1978119887 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] HTTP exception thrown: Instance 39e1755a-018f-4ce2-a49d-df4225ae03ae could not be found. Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6b8041f6-9e0c-4197-8ccd-be1978119887 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Request method failure captured: Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae HTTP/1.1 Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLBDAPlCX48YdEI_BZ56dd4NDqrF57jWSGWCNxNuvLmDVrys2ONyIxdRThQ39af5CDKFGrOPcPgopPvUqIoMURbU5-dQOyalOKZCOKYa5dePf9jQ4W3BnwA1ZRfPtasJlQSUVtB1nnR57fubblxeL4KqCwX3PMAeSV4rzGda9sHJhlU Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0fcaa1fb124e448b8bacb6353fca9d5d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: b7008c9b5ad94dbea7edc12267dae2b5 Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 39e1755a-018f-4ce2-a49d-df4225ae03ae could not be found. Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '39e1755a-018f-4ce2-a49d-df4225ae03ae'} Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39e1755a-018f-4ce2-a49d-df4225ae03ae could not be found. Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39e1755a-018f-4ce2-a49d-df4225ae03ae could not be found. Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:59:29.148472 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:29.153295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:29.153295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:59:29.153295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:59:29.153295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:59:29.153295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:59:29.153295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39e1755a-018f-4ce2-a49d-df4225ae03ae could not be found. Oct 10 23:59:29.153295 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:29.154928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6b8041f6-9e0c-4197-8ccd-be1978119887 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Returning 404 to user: Instance 39e1755a-018f-4ce2-a49d-df4225ae03ae could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:59:29.155818 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6b8041f6-9e0c-4197-8ccd-be1978119887 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae" status: 404 len: 111 microversion: 2.1 time: 0.055826 Oct 10 23:59:29.161442 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3143/6456] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:29 2022] GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:59:29.174210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fc0761e1-df0d-41a1-82be-d7af0f764303 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '.version_select at 0x7f662bbefc10>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:29.291563 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fc0761e1-df0d-41a1-82be-d7af0f764303 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-847531716" status: 202 len: 0 microversion: 2.1 time: 0.127054 Oct 10 23:59:29.293686 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3314/6457] 10.222.0.23 () {58 vars in 1218 bytes} [Mon Oct 10 23:59:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-847531716 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 23:59:33.418878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cc691d95-46f2-437e-9e51-cb7ba48fa74d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:33.419417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cc691d95-46f2-437e-9e51-cb7ba48fa74d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:33.425021 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=39 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:59:33.442635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc691d95-46f2-437e-9e51-cb7ba48fa74d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:33.443134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc691d95-46f2-437e-9e51-cb7ba48fa74d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:33.443580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc691d95-46f2-437e-9e51-cb7ba48fa74d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:33.444310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc691d95-46f2-437e-9e51-cb7ba48fa74d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:33.444765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc691d95-46f2-437e-9e51-cb7ba48fa74d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:33.445193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc691d95-46f2-437e-9e51-cb7ba48fa74d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:33.460933 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-cc691d95-46f2-437e-9e51-cb7ba48fa74d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] HTTP exception thrown: Instance 39e1755a-018f-4ce2-a49d-df4225ae03ae could not be found. Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cc691d95-46f2-437e-9e51-cb7ba48fa74d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Request method failure captured: Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae HTTP/1.1 Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLBDAPlCX48YdEI_BZ56dd4NDqrF57jWSGWCNxNuvLmDVrys2ONyIxdRThQ39af5CDKFGrOPcPgopPvUqIoMURbU5-dQOyalOKZCOKYa5dePf9jQ4W3BnwA1ZRfPtasJlQSUVtB1nnR57fubblxeL4KqCwX3PMAeSV4rzGda9sHJhlU Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0fcaa1fb124e448b8bacb6353fca9d5d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: b7008c9b5ad94dbea7edc12267dae2b5 Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 39e1755a-018f-4ce2-a49d-df4225ae03ae could not be found. Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '39e1755a-018f-4ce2-a49d-df4225ae03ae'} Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39e1755a-018f-4ce2-a49d-df4225ae03ae could not be found. Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:59:33.462702 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:59:33.471213 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39e1755a-018f-4ce2-a49d-df4225ae03ae could not be found. Oct 10 23:59:33.471213 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:33.471213 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:59:33.471213 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:33.471213 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:33.471213 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:59:33.471213 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:59:33.471213 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:59:33.471213 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:59:33.471213 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39e1755a-018f-4ce2-a49d-df4225ae03ae could not be found. Oct 10 23:59:33.471213 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:33.471213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cc691d95-46f2-437e-9e51-cb7ba48fa74d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Returning 404 to user: Instance 39e1755a-018f-4ce2-a49d-df4225ae03ae could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:59:33.471213 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cc691d95-46f2-437e-9e51-cb7ba48fa74d tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "DELETE /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae" status: 404 len: 111 microversion: 2.1 time: 0.049560 Oct 10 23:59:33.471213 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3144/6458] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:59:33 2022] DELETE /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:59:33.478688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-966f0624-c5d9-40a5-8624-846523a7415e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:33.479553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-966f0624-c5d9-40a5-8624-846523a7415e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 39e1755a-018f-4ce2-a49d-df4225ae03ae] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:33.489717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-966f0624-c5d9-40a5-8624-846523a7415e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:33.490323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-966f0624-c5d9-40a5-8624-846523a7415e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:33.496058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-966f0624-c5d9-40a5-8624-846523a7415e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:33.496913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-966f0624-c5d9-40a5-8624-846523a7415e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:33.497504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-966f0624-c5d9-40a5-8624-846523a7415e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:33.505081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-966f0624-c5d9-40a5-8624-846523a7415e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:33.527067 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-966f0624-c5d9-40a5-8624-846523a7415e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] HTTP exception thrown: Instance 39e1755a-018f-4ce2-a49d-df4225ae03ae could not be found. Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-966f0624-c5d9-40a5-8624-846523a7415e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Request method failure captured: Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae HTTP/1.1 Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLBDAPlCX48YdEI_BZ56dd4NDqrF57jWSGWCNxNuvLmDVrys2ONyIxdRThQ39af5CDKFGrOPcPgopPvUqIoMURbU5-dQOyalOKZCOKYa5dePf9jQ4W3BnwA1ZRfPtasJlQSUVtB1nnR57fubblxeL4KqCwX3PMAeSV4rzGda9sHJhlU Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0fcaa1fb124e448b8bacb6353fca9d5d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: b7008c9b5ad94dbea7edc12267dae2b5 Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 39e1755a-018f-4ce2-a49d-df4225ae03ae could not be found. Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '39e1755a-018f-4ce2-a49d-df4225ae03ae'} Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39e1755a-018f-4ce2-a49d-df4225ae03ae could not be found. Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39e1755a-018f-4ce2-a49d-df4225ae03ae could not be found. Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:59:33.528647 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:33.535159 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:33.535159 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:59:33.535159 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:59:33.535159 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:59:33.535159 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:59:33.535159 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39e1755a-018f-4ce2-a49d-df4225ae03ae could not be found. Oct 10 23:59:33.535159 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:33.535159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-966f0624-c5d9-40a5-8624-846523a7415e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Returning 404 to user: Instance 39e1755a-018f-4ce2-a49d-df4225ae03ae could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:59:33.535159 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-966f0624-c5d9-40a5-8624-846523a7415e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae" status: 404 len: 111 microversion: 2.1 time: 0.057152 Oct 10 23:59:33.535159 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3315/6459] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:33 2022] GET /compute/v2.1/servers/39e1755a-018f-4ce2-a49d-df4225ae03ae => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:59:36.862544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-73aff29c-6fb6-4134-9d1b-57f020eb525e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:36.863147 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-73aff29c-6fb6-4134-9d1b-57f020eb525e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:36.870196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73aff29c-6fb6-4134-9d1b-57f020eb525e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:36.870679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73aff29c-6fb6-4134-9d1b-57f020eb525e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:36.871108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73aff29c-6fb6-4134-9d1b-57f020eb525e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:36.871803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73aff29c-6fb6-4134-9d1b-57f020eb525e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:36.872250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73aff29c-6fb6-4134-9d1b-57f020eb525e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:36.872746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73aff29c-6fb6-4134-9d1b-57f020eb525e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:36.888044 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-73aff29c-6fb6-4134-9d1b-57f020eb525e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] HTTP exception thrown: Instance bcca65a1-5074-42ee-bbe9-d6ac334af197 could not be found. Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-73aff29c-6fb6-4134-9d1b-57f020eb525e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Request method failure captured: Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197 HTTP/1.1 Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLBDAPlCX48YdEI_BZ56dd4NDqrF57jWSGWCNxNuvLmDVrys2ONyIxdRThQ39af5CDKFGrOPcPgopPvUqIoMURbU5-dQOyalOKZCOKYa5dePf9jQ4W3BnwA1ZRfPtasJlQSUVtB1nnR57fubblxeL4KqCwX3PMAeSV4rzGda9sHJhlU Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0fcaa1fb124e448b8bacb6353fca9d5d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: b7008c9b5ad94dbea7edc12267dae2b5 Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance bcca65a1-5074-42ee-bbe9-d6ac334af197 could not be found. Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'bcca65a1-5074-42ee-bbe9-d6ac334af197'} Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcca65a1-5074-42ee-bbe9-d6ac334af197 could not be found. Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:59:36.890567 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:59:36.895431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcca65a1-5074-42ee-bbe9-d6ac334af197 could not be found. Oct 10 23:59:36.895431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:36.895431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:59:36.895431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:36.895431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:36.895431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:59:36.895431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:59:36.895431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:59:36.895431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:59:36.895431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcca65a1-5074-42ee-bbe9-d6ac334af197 could not be found. Oct 10 23:59:36.895431 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:36.895431 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-73aff29c-6fb6-4134-9d1b-57f020eb525e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Returning 404 to user: Instance bcca65a1-5074-42ee-bbe9-d6ac334af197 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:59:36.895431 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-73aff29c-6fb6-4134-9d1b-57f020eb525e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197" status: 404 len: 111 microversion: 2.1 time: 0.034943 Oct 10 23:59:36.895431 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3145/6460] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:59:36 2022] DELETE /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:59:36.901531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7942129b-61d2-4a44-bce3-19d0b28b1b83 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:36.902375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7942129b-61d2-4a44-bce3-19d0b28b1b83 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: bcca65a1-5074-42ee-bbe9-d6ac334af197] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:36.910477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7942129b-61d2-4a44-bce3-19d0b28b1b83 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:36.911093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7942129b-61d2-4a44-bce3-19d0b28b1b83 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:36.911601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7942129b-61d2-4a44-bce3-19d0b28b1b83 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:36.912502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7942129b-61d2-4a44-bce3-19d0b28b1b83 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:36.913025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7942129b-61d2-4a44-bce3-19d0b28b1b83 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:36.913718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7942129b-61d2-4a44-bce3-19d0b28b1b83 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:36.928521 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-7942129b-61d2-4a44-bce3-19d0b28b1b83 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] HTTP exception thrown: Instance bcca65a1-5074-42ee-bbe9-d6ac334af197 could not be found. Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7942129b-61d2-4a44-bce3-19d0b28b1b83 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Request method failure captured: Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197 HTTP/1.1 Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLBDAPlCX48YdEI_BZ56dd4NDqrF57jWSGWCNxNuvLmDVrys2ONyIxdRThQ39af5CDKFGrOPcPgopPvUqIoMURbU5-dQOyalOKZCOKYa5dePf9jQ4W3BnwA1ZRfPtasJlQSUVtB1nnR57fubblxeL4KqCwX3PMAeSV4rzGda9sHJhlU Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0fcaa1fb124e448b8bacb6353fca9d5d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: b7008c9b5ad94dbea7edc12267dae2b5 Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance bcca65a1-5074-42ee-bbe9-d6ac334af197 could not be found. Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'bcca65a1-5074-42ee-bbe9-d6ac334af197'} Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcca65a1-5074-42ee-bbe9-d6ac334af197 could not be found. Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcca65a1-5074-42ee-bbe9-d6ac334af197 could not be found. Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:59:36.930332 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:36.938093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:36.938093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:59:36.938093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:59:36.938093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:59:36.938093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:59:36.938093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcca65a1-5074-42ee-bbe9-d6ac334af197 could not be found. Oct 10 23:59:36.938093 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:36.938093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7942129b-61d2-4a44-bce3-19d0b28b1b83 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Returning 404 to user: Instance bcca65a1-5074-42ee-bbe9-d6ac334af197 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:59:36.938093 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7942129b-61d2-4a44-bce3-19d0b28b1b83 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197" status: 404 len: 111 microversion: 2.1 time: 0.034092 Oct 10 23:59:36.938093 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3316/6461] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:36 2022] GET /compute/v2.1/servers/bcca65a1-5074-42ee-bbe9-d6ac334af197 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:59:36.943199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-baeb6715-9956-4236-a720-e61811682c0e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:36.944037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-baeb6715-9956-4236-a720-e61811682c0e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:36.950145 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-baeb6715-9956-4236-a720-e61811682c0e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:36.950702 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-baeb6715-9956-4236-a720-e61811682c0e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:36.951214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-baeb6715-9956-4236-a720-e61811682c0e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:36.951982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-baeb6715-9956-4236-a720-e61811682c0e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:36.952512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-baeb6715-9956-4236-a720-e61811682c0e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:36.953015 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-baeb6715-9956-4236-a720-e61811682c0e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:36.967811 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-baeb6715-9956-4236-a720-e61811682c0e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] HTTP exception thrown: Instance 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e could not be found. Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-baeb6715-9956-4236-a720-e61811682c0e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Request method failure captured: Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e HTTP/1.1 Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLBDAPlCX48YdEI_BZ56dd4NDqrF57jWSGWCNxNuvLmDVrys2ONyIxdRThQ39af5CDKFGrOPcPgopPvUqIoMURbU5-dQOyalOKZCOKYa5dePf9jQ4W3BnwA1ZRfPtasJlQSUVtB1nnR57fubblxeL4KqCwX3PMAeSV4rzGda9sHJhlU Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0fcaa1fb124e448b8bacb6353fca9d5d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: b7008c9b5ad94dbea7edc12267dae2b5 Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e could not be found. Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e'} Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e could not be found. Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:59:36.970099 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:59:36.974685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e could not be found. Oct 10 23:59:36.974685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:36.974685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:59:36.974685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:36.974685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:36.974685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:59:36.974685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:59:36.974685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:59:36.974685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:59:36.974685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e could not be found. Oct 10 23:59:36.974685 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:36.974685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-baeb6715-9956-4236-a720-e61811682c0e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Returning 404 to user: Instance 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:59:36.974685 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-baeb6715-9956-4236-a720-e61811682c0e tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e" status: 404 len: 111 microversion: 2.1 time: 0.032378 Oct 10 23:59:36.974685 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3146/6462] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:59:36 2022] DELETE /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:59:36.979976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-61a64b96-56f9-45c1-ac46-18a5b2d30892 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:36.980585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-61a64b96-56f9-45c1-ac46-18a5b2d30892 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:36.987369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61a64b96-56f9-45c1-ac46-18a5b2d30892 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:36.988099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61a64b96-56f9-45c1-ac46-18a5b2d30892 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:36.988534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61a64b96-56f9-45c1-ac46-18a5b2d30892 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:36.989228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61a64b96-56f9-45c1-ac46-18a5b2d30892 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:36.989862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61a64b96-56f9-45c1-ac46-18a5b2d30892 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:36.990290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61a64b96-56f9-45c1-ac46-18a5b2d30892 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:37.005342 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-61a64b96-56f9-45c1-ac46-18a5b2d30892 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] HTTP exception thrown: Instance 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e could not be found. Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-61a64b96-56f9-45c1-ac46-18a5b2d30892 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Request method failure captured: Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e HTTP/1.1 Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLBDAPlCX48YdEI_BZ56dd4NDqrF57jWSGWCNxNuvLmDVrys2ONyIxdRThQ39af5CDKFGrOPcPgopPvUqIoMURbU5-dQOyalOKZCOKYa5dePf9jQ4W3BnwA1ZRfPtasJlQSUVtB1nnR57fubblxeL4KqCwX3PMAeSV4rzGda9sHJhlU Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0fcaa1fb124e448b8bacb6353fca9d5d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: b7008c9b5ad94dbea7edc12267dae2b5 Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e could not be found. Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e'} Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e could not be found. Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e could not be found. Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:59:37.006908 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:37.011374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:37.011374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:59:37.011374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:59:37.011374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:59:37.011374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:59:37.011374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e could not be found. Oct 10 23:59:37.011374 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:37.011374 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-61a64b96-56f9-45c1-ac46-18a5b2d30892 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Returning 404 to user: Instance 2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:59:37.011374 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-61a64b96-56f9-45c1-ac46-18a5b2d30892 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e" status: 404 len: 111 microversion: 2.1 time: 0.032094 Oct 10 23:59:37.021675 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3317/6463] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:36 2022] GET /compute/v2.1/servers/2dd2486e-f4af-4d10-9ccb-57dcbcebcc3e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:59:42.405111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aeb89240-ff33-4c0f-9365-c357c471f554 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:42.405634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aeb89240-ff33-4c0f-9365-c357c471f554 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:42.413128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeb89240-ff33-4c0f-9365-c357c471f554 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:42.413958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeb89240-ff33-4c0f-9365-c357c471f554 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:42.414637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeb89240-ff33-4c0f-9365-c357c471f554 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:42.415439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeb89240-ff33-4c0f-9365-c357c471f554 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:42.415973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeb89240-ff33-4c0f-9365-c357c471f554 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:42.416474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aeb89240-ff33-4c0f-9365-c357c471f554 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:42.431845 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-aeb89240-ff33-4c0f-9365-c357c471f554 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] HTTP exception thrown: Instance 38c7187f-8a0e-4319-8ec2-245aa1357f46 could not be found. Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aeb89240-ff33-4c0f-9365-c357c471f554 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Request method failure captured: Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 HTTP/1.1 Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLBDAPlCX48YdEI_BZ56dd4NDqrF57jWSGWCNxNuvLmDVrys2ONyIxdRThQ39af5CDKFGrOPcPgopPvUqIoMURbU5-dQOyalOKZCOKYa5dePf9jQ4W3BnwA1ZRfPtasJlQSUVtB1nnR57fubblxeL4KqCwX3PMAeSV4rzGda9sHJhlU Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0fcaa1fb124e448b8bacb6353fca9d5d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: b7008c9b5ad94dbea7edc12267dae2b5 Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 38c7187f-8a0e-4319-8ec2-245aa1357f46 could not be found. Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '38c7187f-8a0e-4319-8ec2-245aa1357f46'} Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c7187f-8a0e-4319-8ec2-245aa1357f46 could not be found. Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:59:42.433596 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:59:42.438137 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c7187f-8a0e-4319-8ec2-245aa1357f46 could not be found. Oct 10 23:59:42.438137 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:42.438137 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:59:42.438137 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:42.438137 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:42.438137 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:59:42.438137 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:59:42.438137 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:59:42.438137 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:59:42.438137 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c7187f-8a0e-4319-8ec2-245aa1357f46 could not be found. Oct 10 23:59:42.438137 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 10 23:59:42.438137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aeb89240-ff33-4c0f-9365-c357c471f554 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Returning 404 to user: Instance 38c7187f-8a0e-4319-8ec2-245aa1357f46 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:59:42.438137 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aeb89240-ff33-4c0f-9365-c357c471f554 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "DELETE /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46" status: 404 len: 111 microversion: 2.1 time: 0.034247 Oct 10 23:59:42.440962 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3147/6464] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:59:42 2022] DELETE /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:59:42.445240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-748b4635-a87e-4386-a045-a97588edb590 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:42.445908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-748b4635-a87e-4386-a045-a97588edb590 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] [instance: 38c7187f-8a0e-4319-8ec2-245aa1357f46] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:42.453303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-748b4635-a87e-4386-a045-a97588edb590 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:42.454117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-748b4635-a87e-4386-a045-a97588edb590 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:42.454803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-748b4635-a87e-4386-a045-a97588edb590 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:42.455502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-748b4635-a87e-4386-a045-a97588edb590 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:42.455951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-748b4635-a87e-4386-a045-a97588edb590 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:42.456372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-748b4635-a87e-4386-a045-a97588edb590 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:42.474158 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-748b4635-a87e-4386-a045-a97588edb590 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] HTTP exception thrown: Instance 38c7187f-8a0e-4319-8ec2-245aa1357f46 could not be found. Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-748b4635-a87e-4386-a045-a97588edb590 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Request method failure captured: Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 HTTP/1.1 Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLBDAPlCX48YdEI_BZ56dd4NDqrF57jWSGWCNxNuvLmDVrys2ONyIxdRThQ39af5CDKFGrOPcPgopPvUqIoMURbU5-dQOyalOKZCOKYa5dePf9jQ4W3BnwA1ZRfPtasJlQSUVtB1nnR57fubblxeL4KqCwX3PMAeSV4rzGda9sHJhlU Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0fcaa1fb124e448b8bacb6353fca9d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0fcaa1fb124e448b8bacb6353fca9d5d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 0fcaa1fb124e448b8bacb6353fca9d5d Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-330065276 Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: b7008c9b5ad94dbea7edc12267dae2b5 Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-AttachVolumeNegativeTest-330065276-project Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 38c7187f-8a0e-4319-8ec2-245aa1357f46 could not be found. Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '38c7187f-8a0e-4319-8ec2-245aa1357f46'} Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c7187f-8a0e-4319-8ec2-245aa1357f46 could not be found. Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c7187f-8a0e-4319-8ec2-245aa1357f46 could not be found. Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:59:42.475769 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:42.479918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:42.479918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:59:42.479918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:59:42.479918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:59:42.479918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:59:42.479918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c7187f-8a0e-4319-8ec2-245aa1357f46 could not be found. Oct 10 23:59:42.479918 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:42.479918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-748b4635-a87e-4386-a045-a97588edb590 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] Returning 404 to user: Instance 38c7187f-8a0e-4319-8ec2-245aa1357f46 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:59:42.479918 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-748b4635-a87e-4386-a045-a97588edb590 tempest-AttachVolumeNegativeTest-330065276 tempest-AttachVolumeNegativeTest-330065276-project] 10.222.0.23 "GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46" status: 404 len: 111 microversion: 2.1 time: 0.035764 Oct 10 23:59:42.479918 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3318/6465] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:42 2022] GET /compute/v2.1/servers/38c7187f-8a0e-4319-8ec2-245aa1357f46 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:59:50.562101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-502fe822-f932-49d2-bb80-81683a983cde tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:59:50.565841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-502fe822-f932-49d2-bb80-81683a983cde tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:50.573124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-502fe822-f932-49d2-bb80-81683a983cde tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:50.573693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-502fe822-f932-49d2-bb80-81683a983cde tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:50.574246 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-502fe822-f932-49d2-bb80-81683a983cde tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:50.574957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-502fe822-f932-49d2-bb80-81683a983cde tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:50.575411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-502fe822-f932-49d2-bb80-81683a983cde tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:50.575835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-502fe822-f932-49d2-bb80-81683a983cde tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:50.662835 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-502fe822-f932-49d2-bb80-81683a983cde tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "POST /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55/action" status: 200 len: 24560 microversion: 2.1 time: 0.104964 Oct 10 23:59:50.664047 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3148/6466] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:59:50 2022] POST /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55/action => generated 24560 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:59:53.783189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7b4456c8-4bec-4fcb-af1f-9cc23b3198cc tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:59:53.785689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7b4456c8-4bec-4fcb-af1f-9cc23b3198cc tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: cf240924-ed7e-4e52-ab1a-6a5bce0f7380] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:53.789001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:59:53.790017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=10 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 23:59:53.797022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b4456c8-4bec-4fcb-af1f-9cc23b3198cc tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:53.798602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b4456c8-4bec-4fcb-af1f-9cc23b3198cc tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:53.799442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b4456c8-4bec-4fcb-af1f-9cc23b3198cc tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:53.800510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b4456c8-4bec-4fcb-af1f-9cc23b3198cc tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:53.800972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b4456c8-4bec-4fcb-af1f-9cc23b3198cc tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:53.801405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b4456c8-4bec-4fcb-af1f-9cc23b3198cc tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:53.868162 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7b4456c8-4bec-4fcb-af1f-9cc23b3198cc tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "POST /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380/action" status: 200 len: 32646 microversion: 2.1 time: 0.088663 Oct 10 23:59:53.869407 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3319/6467] 10.222.0.23 () {60 vars in 1278 bytes} [Mon Oct 10 23:59:53 2022] POST /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380/action => generated 32646 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 23:59:55.054526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-869efb88-b57c-49c5-bb16-7ab7f6c1bc84 req-39b25826-d967-4cd5-b83a-3eaaa6193e2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf240924-ed7e-4e52-ab1a-6a5bce0f7380", "tag": "05d56671-961f-4ad4-8ba5-aa6c6c52bb33"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:59:55.056361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5a0ffee4-bb14-4baf-a2cb-83f4d3db216a tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:55.057153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5a0ffee4-bb14-4baf-a2cb-83f4d3db216a tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: cf240924-ed7e-4e52-ab1a-6a5bce0f7380] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:55.068307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a0ffee4-bb14-4baf-a2cb-83f4d3db216a tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:55.069038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a0ffee4-bb14-4baf-a2cb-83f4d3db216a tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:55.069233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a0ffee4-bb14-4baf-a2cb-83f4d3db216a tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:55.077130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-869efb88-b57c-49c5-bb16-7ab7f6c1bc84 req-39b25826-d967-4cd5-b83a-3eaaa6193e2e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:55.077893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a0ffee4-bb14-4baf-a2cb-83f4d3db216a tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:55.078425 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a0ffee4-bb14-4baf-a2cb-83f4d3db216a tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:55.078766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-869efb88-b57c-49c5-bb16-7ab7f6c1bc84 req-39b25826-d967-4cd5-b83a-3eaaa6193e2e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:55.080134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5a0ffee4-bb14-4baf-a2cb-83f4d3db216a tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:55.085417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-869efb88-b57c-49c5-bb16-7ab7f6c1bc84 req-39b25826-d967-4cd5-b83a-3eaaa6193e2e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:55.098562 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-869efb88-b57c-49c5-bb16-7ab7f6c1bc84 req-39b25826-d967-4cd5-b83a-3eaaa6193e2e service nova] Creating event network-changed:05d56671-961f-4ad4-8ba5-aa6c6c52bb33 for instance cf240924-ed7e-4e52-ab1a-6a5bce0f7380 on n-h1-860864-2 Oct 10 23:59:55.103524 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-869efb88-b57c-49c5-bb16-7ab7f6c1bc84 req-39b25826-d967-4cd5-b83a-3eaaa6193e2e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052865 Oct 10 23:59:55.104357 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3320/6468] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:59:55.119974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5a0ffee4-bb14-4baf-a2cb-83f4d3db216a tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: cf240924-ed7e-4e52-ab1a-6a5bce0f7380] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 23:59:55.235985 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5a0ffee4-bb14-4baf-a2cb-83f4d3db216a tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380" status: 204 len: 0 microversion: 2.1 time: 0.190323 Oct 10 23:59:55.238039 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3149/6469] 10.222.0.23 () {58 vars in 1239 bytes} [Mon Oct 10 23:59:55 2022] DELETE /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 23:59:55.249971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3b5fb71b-e7fc-4414-b5d7-c098e960a8e3 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:55.251788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3b5fb71b-e7fc-4414-b5d7-c098e960a8e3 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: cf240924-ed7e-4e52-ab1a-6a5bce0f7380] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:55.261627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b5fb71b-e7fc-4414-b5d7-c098e960a8e3 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:55.263042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b5fb71b-e7fc-4414-b5d7-c098e960a8e3 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:55.263906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b5fb71b-e7fc-4414-b5d7-c098e960a8e3 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:55.265278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b5fb71b-e7fc-4414-b5d7-c098e960a8e3 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:55.266061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b5fb71b-e7fc-4414-b5d7-c098e960a8e3 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:55.267247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b5fb71b-e7fc-4414-b5d7-c098e960a8e3 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:55.437740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3b5fb71b-e7fc-4414-b5d7-c098e960a8e3 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:59:55.448289 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3b5fb71b-e7fc-4414-b5d7-c098e960a8e3 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380" status: 200 len: 1670 microversion: 2.1 time: 0.205735 Oct 10 23:59:55.454034 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3321/6470] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:55 2022] GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380 => generated 1670 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:59:56.476484 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6514d398-8dbe-4501-900d-2a581dd9e40b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:56.477347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6514d398-8dbe-4501-900d-2a581dd9e40b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: cf240924-ed7e-4e52-ab1a-6a5bce0f7380] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:56.495535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6514d398-8dbe-4501-900d-2a581dd9e40b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:56.496305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6514d398-8dbe-4501-900d-2a581dd9e40b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:56.497245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6514d398-8dbe-4501-900d-2a581dd9e40b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:56.498157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6514d398-8dbe-4501-900d-2a581dd9e40b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:56.498867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6514d398-8dbe-4501-900d-2a581dd9e40b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:56.499409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6514d398-8dbe-4501-900d-2a581dd9e40b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:56.733261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6514d398-8dbe-4501-900d-2a581dd9e40b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:59:56.744701 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6514d398-8dbe-4501-900d-2a581dd9e40b tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380" status: 200 len: 1670 microversion: 2.1 time: 0.272300 Oct 10 23:59:56.749951 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3150/6471] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:56 2022] GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380 => generated 1670 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:59:57.737674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-b2e265bc-69e8-4f23-9734-ad24b17e546a req-931aaa47-c19b-47ed-8c57-95ecfe74c778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf240924-ed7e-4e52-ab1a-6a5bce0f7380", "name": "network-vif-deleted", "tag": "05d56671-961f-4ad4-8ba5-aa6c6c52bb33"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 23:59:57.752150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b2e265bc-69e8-4f23-9734-ad24b17e546a req-931aaa47-c19b-47ed-8c57-95ecfe74c778 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:57.752950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b2e265bc-69e8-4f23-9734-ad24b17e546a req-931aaa47-c19b-47ed-8c57-95ecfe74c778 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:57.753658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-b2e265bc-69e8-4f23-9734-ad24b17e546a req-931aaa47-c19b-47ed-8c57-95ecfe74c778 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:57.767962 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-b2e265bc-69e8-4f23-9734-ad24b17e546a req-931aaa47-c19b-47ed-8c57-95ecfe74c778 service nova] Creating event network-vif-deleted:05d56671-961f-4ad4-8ba5-aa6c6c52bb33 for instance cf240924-ed7e-4e52-ab1a-6a5bce0f7380 on n-h1-860864-2 Oct 10 23:59:57.773847 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-b2e265bc-69e8-4f23-9734-ad24b17e546a req-931aaa47-c19b-47ed-8c57-95ecfe74c778 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.337689 Oct 10 23:59:57.774264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c8402320-1092-4cf5-a732-1906e3cc3daf tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:57.775414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c8402320-1092-4cf5-a732-1906e3cc3daf tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: cf240924-ed7e-4e52-ab1a-6a5bce0f7380] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:57.778251 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3322/6472] 10.222.0.23 () {64 vars in 1317 bytes} [Mon Oct 10 23:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 23:59:57.789101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8402320-1092-4cf5-a732-1906e3cc3daf tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:57.790175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8402320-1092-4cf5-a732-1906e3cc3daf tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:57.791169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8402320-1092-4cf5-a732-1906e3cc3daf tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:57.792076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8402320-1092-4cf5-a732-1906e3cc3daf tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:57.792777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8402320-1092-4cf5-a732-1906e3cc3daf tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:57.798573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8402320-1092-4cf5-a732-1906e3cc3daf tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:57.851176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8402320-1092-4cf5-a732-1906e3cc3daf tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:57.851863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8402320-1092-4cf5-a732-1906e3cc3daf tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:57.852466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c8402320-1092-4cf5-a732-1906e3cc3daf tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:57.853080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-c8402320-1092-4cf5-a732-1906e3cc3daf tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lazy-loading 'fault' on Instance uuid cf240924-ed7e-4e52-ab1a-6a5bce0f7380 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 23:59:57.908614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c8402320-1092-4cf5-a732-1906e3cc3daf tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fc082060b54409a4361c04f8355580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897064e9041f4e4f94ced711d282deb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 23:59:57.917286 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c8402320-1092-4cf5-a732-1906e3cc3daf tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380" status: 200 len: 1339 microversion: 2.1 time: 0.147190 Oct 10 23:59:57.917988 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3151/6473] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:57 2022] GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380 => generated 1339 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 23:59:58.944032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3d1a6e72-9e97-426c-810a-3418c3e13fb5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:58.944809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3d1a6e72-9e97-426c-810a-3418c3e13fb5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] [instance: cf240924-ed7e-4e52-ab1a-6a5bce0f7380] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 23:59:58.956575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d1a6e72-9e97-426c-810a-3418c3e13fb5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:58.957218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d1a6e72-9e97-426c-810a-3418c3e13fb5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:58.958016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d1a6e72-9e97-426c-810a-3418c3e13fb5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:58.958735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d1a6e72-9e97-426c-810a-3418c3e13fb5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 23:59:58.959258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d1a6e72-9e97-426c-810a-3418c3e13fb5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 23:59:58.959698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d1a6e72-9e97-426c-810a-3418c3e13fb5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 23:59:58.977313 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-3d1a6e72-9e97-426c-810a-3418c3e13fb5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] HTTP exception thrown: Instance cf240924-ed7e-4e52-ab1a-6a5bce0f7380 could not be found. Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3d1a6e72-9e97-426c-810a-3418c3e13fb5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Request method failure captured: Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380 HTTP/1.1 Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLD3saplG3N6SEeaygXUr722XI651Rsf-LEMWaC2U26f6I4Vwp7J24DL9Kd6DUTtYByTevr1DYSiNy15zeAU3NCR73MA8aqL-aJtfH1H9n05_WkyY1y7Ih6RxalN54wdxNwe-xmd0J6nW4xgs9sJRCL0LirZ0jW5DBMsKL1se93Vido Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 897064e9041f4e4f94ced711d282deb4 Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestNetworkBasicOps-1125387914 Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/897064e9041f4e4f94ced711d282deb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/897064e9041f4e4f94ced711d282deb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/897064e9041f4e4f94ced711d282deb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_897064e9041f4e4f94ced711d282deb4", "adminURL": "http://10.222.0.23:8080"}]}] Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestNetworkBasicOps-1125387914 Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 897064e9041f4e4f94ced711d282deb4 Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestNetworkBasicOps-1125387914 Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestNetworkBasicOps-1125387914-project Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 82fc082060b54409a4361c04f8355580 Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestNetworkBasicOps-1125387914-project Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance cf240924-ed7e-4e52-ab1a-6a5bce0f7380 could not be found. Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'cf240924-ed7e-4e52-ab1a-6a5bce0f7380'} Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf240924-ed7e-4e52-ab1a-6a5bce0f7380 could not be found. Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf240924-ed7e-4e52-ab1a-6a5bce0f7380 could not be found. Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 23:59:58.979259 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:58.984423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 23:59:58.984423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 23:59:58.984423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 23:59:58.984423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 23:59:58.984423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 23:59:58.984423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf240924-ed7e-4e52-ab1a-6a5bce0f7380 could not be found. Oct 10 23:59:58.984423 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 10 23:59:58.984423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3d1a6e72-9e97-426c-810a-3418c3e13fb5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Returning 404 to user: Instance cf240924-ed7e-4e52-ab1a-6a5bce0f7380 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 23:59:58.984423 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3d1a6e72-9e97-426c-810a-3418c3e13fb5 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380" status: 404 len: 111 microversion: 2.1 time: 0.042477 Oct 10 23:59:58.984423 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3323/6474] 10.222.0.23 () {58 vars in 1236 bytes} [Mon Oct 10 23:59:58 2022] GET /compute/v2.1/servers/cf240924-ed7e-4e52-ab1a-6a5bce0f7380 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 23:59:59.180258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-520749af-bf00-452c-b4ad-381bdd928476 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] Calling method '.version_select at 0x7f662b4ccf70>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 23:59:59.206441 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-520749af-bf00-452c-b4ad-381bdd928476 tempest-TestNetworkBasicOps-1125387914 tempest-TestNetworkBasicOps-1125387914-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1793063876" status: 202 len: 0 microversion: 2.1 time: 0.030817 Oct 10 23:59:59.211786 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3152/6475] 10.222.0.23 () {58 vars in 1257 bytes} [Mon Oct 10 23:59:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1793063876 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:00:03.599449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7deb69a3-4854-44c0-a3a9-e8fce362d899 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:00:03.600021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7deb69a3-4854-44c0-a3a9-e8fce362d899 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:00:03.604395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-d3ba6271-a156-4f68-8234-481f317bd00b req-b7167f6f-929d-43ff-9174-7549b3972225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21b1818e-1773-44f3-8fd2-961584626f55", "tag": "6101695e-9095-4573-b82c-5f89f85b4261"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:00:03.630122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7deb69a3-4854-44c0-a3a9-e8fce362d899 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:03.632513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:00:03.632982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7deb69a3-4854-44c0-a3a9-e8fce362d899 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:03.633946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7deb69a3-4854-44c0-a3a9-e8fce362d899 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:03.640994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7deb69a3-4854-44c0-a3a9-e8fce362d899 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:03.648031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7deb69a3-4854-44c0-a3a9-e8fce362d899 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:03.651879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7deb69a3-4854-44c0-a3a9-e8fce362d899 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:03.667862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d3ba6271-a156-4f68-8234-481f317bd00b req-b7167f6f-929d-43ff-9174-7549b3972225 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:03.676681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d3ba6271-a156-4f68-8234-481f317bd00b req-b7167f6f-929d-43ff-9174-7549b3972225 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:03.677596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d3ba6271-a156-4f68-8234-481f317bd00b req-b7167f6f-929d-43ff-9174-7549b3972225 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:03.683837 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:00:03.719260 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-d3ba6271-a156-4f68-8234-481f317bd00b req-b7167f6f-929d-43ff-9174-7549b3972225 service nova] Creating event network-changed:6101695e-9095-4573-b82c-5f89f85b4261 for instance 21b1818e-1773-44f3-8fd2-961584626f55 on n-h2-860864-2 Oct 11 00:00:03.732204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7deb69a3-4854-44c0-a3a9-e8fce362d899 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:00:03.739247 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-d3ba6271-a156-4f68-8234-481f317bd00b req-b7167f6f-929d-43ff-9174-7549b3972225 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146426 Oct 11 00:00:03.740023 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3153/6476] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:00:03.933752 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7deb69a3-4854-44c0-a3a9-e8fce362d899 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "DELETE /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 204 len: 0 microversion: 2.1 time: 0.345123 Oct 11 00:00:03.939507 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3324/6477] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:00:03 2022] DELETE /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:00:03.946252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9828fb5c-206f-4fb8-988b-a0de6b0066f7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:00:03.947184 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9828fb5c-206f-4fb8-988b-a0de6b0066f7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:00:03.957855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9828fb5c-206f-4fb8-988b-a0de6b0066f7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:03.958313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9828fb5c-206f-4fb8-988b-a0de6b0066f7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:03.959402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9828fb5c-206f-4fb8-988b-a0de6b0066f7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:03.960778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9828fb5c-206f-4fb8-988b-a0de6b0066f7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:03.961596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9828fb5c-206f-4fb8-988b-a0de6b0066f7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:03.962045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9828fb5c-206f-4fb8-988b-a0de6b0066f7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:04.262429 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9828fb5c-206f-4fb8-988b-a0de6b0066f7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:00:04.275770 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9828fb5c-206f-4fb8-988b-a0de6b0066f7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1688 microversion: 2.1 time: 0.334383 Oct 11 00:00:04.278157 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3154/6478] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:00:03 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1688 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:00:05.304920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-724ca4b0-0b0d-4c15-8b71-4ce435ed86b8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:00:05.306335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-724ca4b0-0b0d-4c15-8b71-4ce435ed86b8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:00:05.334415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-724ca4b0-0b0d-4c15-8b71-4ce435ed86b8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:05.334922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-724ca4b0-0b0d-4c15-8b71-4ce435ed86b8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:05.335369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-724ca4b0-0b0d-4c15-8b71-4ce435ed86b8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:05.338461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-724ca4b0-0b0d-4c15-8b71-4ce435ed86b8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:05.339924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-724ca4b0-0b0d-4c15-8b71-4ce435ed86b8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:05.340407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-724ca4b0-0b0d-4c15-8b71-4ce435ed86b8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:05.766975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-724ca4b0-0b0d-4c15-8b71-4ce435ed86b8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:00:05.788726 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-724ca4b0-0b0d-4c15-8b71-4ce435ed86b8 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1688 microversion: 2.1 time: 0.488984 Oct 11 00:00:05.803095 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3325/6479] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:00:05 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1688 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:00:06.225847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-eee92b87-5907-4fea-a42e-1380fdd5cb64 req-c100e076-ce9b-4c39-a24e-93ea7ba4ef97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b1818e-1773-44f3-8fd2-961584626f55", "name": "network-vif-deleted", "tag": "6101695e-9095-4573-b82c-5f89f85b4261"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:00:06.254386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-eee92b87-5907-4fea-a42e-1380fdd5cb64 req-c100e076-ce9b-4c39-a24e-93ea7ba4ef97 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:06.258317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-eee92b87-5907-4fea-a42e-1380fdd5cb64 req-c100e076-ce9b-4c39-a24e-93ea7ba4ef97 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:06.259759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-eee92b87-5907-4fea-a42e-1380fdd5cb64 req-c100e076-ce9b-4c39-a24e-93ea7ba4ef97 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:06.296988 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-eee92b87-5907-4fea-a42e-1380fdd5cb64 req-c100e076-ce9b-4c39-a24e-93ea7ba4ef97 service nova] Creating event network-vif-deleted:6101695e-9095-4573-b82c-5f89f85b4261 for instance 21b1818e-1773-44f3-8fd2-961584626f55 on n-h2-860864-2 Oct 11 00:00:06.309976 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-eee92b87-5907-4fea-a42e-1380fdd5cb64 req-c100e076-ce9b-4c39-a24e-93ea7ba4ef97 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088161 Oct 11 00:00:06.310601 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3155/6480] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:00:06.854277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c4a2776c-68fc-4817-9841-d4fe53319458 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:00:06.855702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c4a2776c-68fc-4817-9841-d4fe53319458 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:00:06.871320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4a2776c-68fc-4817-9841-d4fe53319458 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:06.872111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4a2776c-68fc-4817-9841-d4fe53319458 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:06.873282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4a2776c-68fc-4817-9841-d4fe53319458 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:06.875132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4a2776c-68fc-4817-9841-d4fe53319458 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:06.877763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4a2776c-68fc-4817-9841-d4fe53319458 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:06.879512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4a2776c-68fc-4817-9841-d4fe53319458 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:06.933929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4a2776c-68fc-4817-9841-d4fe53319458 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:06.934753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4a2776c-68fc-4817-9841-d4fe53319458 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:06.935519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4a2776c-68fc-4817-9841-d4fe53319458 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:06.936153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-c4a2776c-68fc-4817-9841-d4fe53319458 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lazy-loading 'fault' on Instance uuid 21b1818e-1773-44f3-8fd2-961584626f55 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:00:07.014345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c4a2776c-68fc-4817-9841-d4fe53319458 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce22396752cd4d71991c6994a31f4905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce4582b30d041c592240d09a95a37e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:00:07.025570 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c4a2776c-68fc-4817-9841-d4fe53319458 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 200 len: 1357 microversion: 2.1 time: 0.179155 Oct 11 00:00:07.037538 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3326/6481] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:00:06 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:00:08.053953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-404cb52e-004f-43e3-937a-517074c8818a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:00:08.054705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-404cb52e-004f-43e3-937a-517074c8818a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] [instance: 21b1818e-1773-44f3-8fd2-961584626f55] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:00:08.063020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-404cb52e-004f-43e3-937a-517074c8818a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:08.063862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-404cb52e-004f-43e3-937a-517074c8818a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:08.064476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-404cb52e-004f-43e3-937a-517074c8818a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:08.065095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-404cb52e-004f-43e3-937a-517074c8818a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:08.065683 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-404cb52e-004f-43e3-937a-517074c8818a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:08.066351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-404cb52e-004f-43e3-937a-517074c8818a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:08.086572 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-404cb52e-004f-43e3-937a-517074c8818a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] HTTP exception thrown: Instance 21b1818e-1773-44f3-8fd2-961584626f55 could not be found. Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-404cb52e-004f-43e3-937a-517074c8818a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Request method failure captured: Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 HTTP/1.1 Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRK-BB4x4tnje8g7V7yndZ-eCfyvwZsAbSuBD8sfr6-xUWiLbFDaunp7PR2T5QmNvvFy5RcKeKPLvsd2T_42GBJZpMrvANis61xLfLWHDewFuoiaKXb-VOoVnXShsE7RvrF0WakEav91aLufkTYJLnPujB4bORnh17YSIuys0bjxdSkA Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: fce4582b30d041c592240d09a95a37e5 Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-704048199 Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fce4582b30d041c592240d09a95a37e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fce4582b30d041c592240d09a95a37e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fce4582b30d041c592240d09a95a37e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fce4582b30d041c592240d09a95a37e5", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TestNetworkAdvancedServerOps-704048199 Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: fce4582b30d041c592240d09a95a37e5 Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-704048199 Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TestNetworkAdvancedServerOps-704048199-project Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: ce22396752cd4d71991c6994a31f4905 Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TestNetworkAdvancedServerOps-704048199-project Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 21b1818e-1773-44f3-8fd2-961584626f55 could not be found. Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '21b1818e-1773-44f3-8fd2-961584626f55'} Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21b1818e-1773-44f3-8fd2-961584626f55 could not be found. Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21b1818e-1773-44f3-8fd2-961584626f55 could not be found. Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:00:08.088692 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:00:08.094242 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:00:08.094242 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:00:08.094242 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:00:08.094242 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:00:08.094242 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:00:08.094242 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:00:08.094242 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21b1818e-1773-44f3-8fd2-961584626f55 could not be found. Oct 11 00:00:08.094242 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:00:08.094242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-404cb52e-004f-43e3-937a-517074c8818a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Returning 404 to user: Instance 21b1818e-1773-44f3-8fd2-961584626f55 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:00:08.094242 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-404cb52e-004f-43e3-937a-517074c8818a tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55" status: 404 len: 111 microversion: 2.1 time: 0.046283 Oct 11 00:00:08.096962 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3156/6482] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:00:08 2022] GET /compute/v2.1/servers/21b1818e-1773-44f3-8fd2-961584626f55 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:00:12.262001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1667a660-900e-466d-9b04-27d22062b6f7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] Calling method '.version_select at 0x7f662af765e0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:00:12.285892 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1667a660-900e-466d-9b04-27d22062b6f7 tempest-TestNetworkAdvancedServerOps-704048199 tempest-TestNetworkAdvancedServerOps-704048199-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2093323450" status: 202 len: 0 microversion: 2.1 time: 0.027778 Oct 11 00:00:12.290890 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3327/6483] 10.222.0.23 () {58 vars in 1284 bytes} [Tue Oct 11 00:00:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2093323450 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:00:28.093514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=7 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:00:28.094367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=11 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:00:28.440262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f2941786-dcda-4b13-81e5-299d32ebe4e9 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Action: 'create', calling method: .version_select at 0x7f662b7a6f70>, body: {"keypair": {"name": "tempest-TestServerBasicOps-134761894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByErZU7bQnb/N437fW4q0WRCwmjc4MEOAcVYgIZpZ+MHI42bzqS0Vg6ZRJ4x6JCEUB4q92dSMApSfdYmkPclUEV42w7mOewIeMD+cDdyWbrhqhiykyrDYXiFOZ6U9uFiw=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:00:28.460208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-f2941786-dcda-4b13-81e5-299d32ebe4e9 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Getting quotas for project c9d7d94bdadb487380d28c69dfefaf1b. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:00:28.469691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-f2941786-dcda-4b13-81e5-299d32ebe4e9 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Getting quotas for user a713546d5688431e963cd7a0a6de512d and project c9d7d94bdadb487380d28c69dfefaf1b. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:00:28.500596 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f2941786-dcda-4b13-81e5-299d32ebe4e9 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.414981 Oct 11 00:00:28.502385 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3157/6484] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 11 00:00:28 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:00:30.031622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:00:30.033295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:00:30.038105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-94f49dc0-8081-4d83-9a8f-b790d456916e tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-226917111", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-134761894", "security_groups": [{"name": "tempest-secgroup-smoke-438159591"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "b4f491f3-caec-4c1a-83da-b020a556756d"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:00:30.194145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-94f49dc0-8081-4d83-9a8f-b790d456916e tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] validate_networks() for [('b4f491f3-caec-4c1a-83da-b020a556756d', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:00:30.979253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-94f49dc0-8081-4d83-9a8f-b790d456916e tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Getting quotas for project c9d7d94bdadb487380d28c69dfefaf1b. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:00:30.987169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-94f49dc0-8081-4d83-9a8f-b790d456916e tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Getting quotas for user a713546d5688431e963cd7a0a6de512d and project c9d7d94bdadb487380d28c69dfefaf1b. Resources: dict_keys(['metadata_items']) {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:00:31.006533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-94f49dc0-8081-4d83-9a8f-b790d456916e tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:00:31.007266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-94f49dc0-8081-4d83-9a8f-b790d456916e tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:00:31.008065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-94f49dc0-8081-4d83-9a8f-b790d456916e tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:00:31.008680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-94f49dc0-8081-4d83-9a8f-b790d456916e tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:00:31.009297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-94f49dc0-8081-4d83-9a8f-b790d456916e tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:00:31.026272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94f49dc0-8081-4d83-9a8f-b790d456916e tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:31.027015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94f49dc0-8081-4d83-9a8f-b790d456916e tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:31.028690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94f49dc0-8081-4d83-9a8f-b790d456916e tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:31.031121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94f49dc0-8081-4d83-9a8f-b790d456916e tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:31.031819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94f49dc0-8081-4d83-9a8f-b790d456916e tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:31.033940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94f49dc0-8081-4d83-9a8f-b790d456916e tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:31.057020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-94f49dc0-8081-4d83-9a8f-b790d456916e tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Getting quotas for project c9d7d94bdadb487380d28c69dfefaf1b. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:00:31.062662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-94f49dc0-8081-4d83-9a8f-b790d456916e tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Getting quotas for user a713546d5688431e963cd7a0a6de512d and project c9d7d94bdadb487380d28c69dfefaf1b. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:00:31.077264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-94f49dc0-8081-4d83-9a8f-b790d456916e tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:00:31.080266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-94f49dc0-8081-4d83-9a8f-b790d456916e tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [instance: df93df28-1536-4fe4-8a52-1477664665c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:00:31.134237 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-94f49dc0-8081-4d83-9a8f-b790d456916e tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.104430 Oct 11 00:00:31.135637 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3328/6485] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:00:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:00:31.154304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-785165f2-81a3-498f-bb14-c5254f825471 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:00:31.156316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-785165f2-81a3-498f-bb14-c5254f825471 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [instance: df93df28-1536-4fe4-8a52-1477664665c3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:00:31.234073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-785165f2-81a3-498f-bb14-c5254f825471 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a713546d5688431e963cd7a0a6de512d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7d94bdadb487380d28c69dfefaf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:00:31.245176 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-785165f2-81a3-498f-bb14-c5254f825471 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3" status: 200 len: 1301 microversion: 2.1 time: 0.101343 Oct 11 00:00:31.246131 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3158/6486] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:00:31 2022] GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3 => generated 1301 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:00:32.273823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c1708682-9bef-4d4c-8f6d-4b49de3b47f9 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:00:32.274411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c1708682-9bef-4d4c-8f6d-4b49de3b47f9 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [instance: df93df28-1536-4fe4-8a52-1477664665c3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:00:32.287454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1708682-9bef-4d4c-8f6d-4b49de3b47f9 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:32.288058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1708682-9bef-4d4c-8f6d-4b49de3b47f9 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:32.304351 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1708682-9bef-4d4c-8f6d-4b49de3b47f9 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:32.305128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1708682-9bef-4d4c-8f6d-4b49de3b47f9 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:32.305893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1708682-9bef-4d4c-8f6d-4b49de3b47f9 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:32.306335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1708682-9bef-4d4c-8f6d-4b49de3b47f9 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:32.405066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c1708682-9bef-4d4c-8f6d-4b49de3b47f9 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a713546d5688431e963cd7a0a6de512d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7d94bdadb487380d28c69dfefaf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:00:32.415271 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c1708682-9bef-4d4c-8f6d-4b49de3b47f9 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3" status: 200 len: 1353 microversion: 2.1 time: 0.148045 Oct 11 00:00:32.430566 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3329/6487] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:00:32 2022] GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3 => generated 1353 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:00:33.440411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-33d42ee8-3a12-4a6b-932a-6effcaa322dd tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:00:33.441846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-33d42ee8-3a12-4a6b-932a-6effcaa322dd tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [instance: df93df28-1536-4fe4-8a52-1477664665c3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:00:33.450215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33d42ee8-3a12-4a6b-932a-6effcaa322dd tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:33.451006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33d42ee8-3a12-4a6b-932a-6effcaa322dd tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:33.451713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33d42ee8-3a12-4a6b-932a-6effcaa322dd tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:33.452651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33d42ee8-3a12-4a6b-932a-6effcaa322dd tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:33.453329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33d42ee8-3a12-4a6b-932a-6effcaa322dd tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:33.454598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-33d42ee8-3a12-4a6b-932a-6effcaa322dd tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:33.987237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-33d42ee8-3a12-4a6b-932a-6effcaa322dd tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a713546d5688431e963cd7a0a6de512d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7d94bdadb487380d28c69dfefaf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:00:33.996463 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-33d42ee8-3a12-4a6b-932a-6effcaa322dd tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3" status: 200 len: 1426 microversion: 2.1 time: 0.560113 Oct 11 00:00:34.006514 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3159/6488] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:00:33 2022] GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3 => generated 1426 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:00:34.433474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b67bc96e-8e94-43f7-94bd-f9245dc99926 tempest-PortsAdminExtendedAttrsTestJSON-853341914 tempest-PortsAdminExtendedAttrsTestJSON-853341914-project-admin] Calling method '.version_select at 0x7f662a5cd5e0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:00:34.437673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b67bc96e-8e94-43f7-94bd-f9245dc99926 tempest-PortsAdminExtendedAttrsTestJSON-853341914 tempest-PortsAdminExtendedAttrsTestJSON-853341914-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:34.439125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b67bc96e-8e94-43f7-94bd-f9245dc99926 tempest-PortsAdminExtendedAttrsTestJSON-853341914 tempest-PortsAdminExtendedAttrsTestJSON-853341914-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:34.439125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b67bc96e-8e94-43f7-94bd-f9245dc99926 tempest-PortsAdminExtendedAttrsTestJSON-853341914 tempest-PortsAdminExtendedAttrsTestJSON-853341914-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:34.456585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b67bc96e-8e94-43f7-94bd-f9245dc99926 tempest-PortsAdminExtendedAttrsTestJSON-853341914 tempest-PortsAdminExtendedAttrsTestJSON-853341914-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:34.457555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b67bc96e-8e94-43f7-94bd-f9245dc99926 tempest-PortsAdminExtendedAttrsTestJSON-853341914 tempest-PortsAdminExtendedAttrsTestJSON-853341914-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:34.458290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b67bc96e-8e94-43f7-94bd-f9245dc99926 tempest-PortsAdminExtendedAttrsTestJSON-853341914 tempest-PortsAdminExtendedAttrsTestJSON-853341914-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:34.470858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b67bc96e-8e94-43f7-94bd-f9245dc99926 tempest-PortsAdminExtendedAttrsTestJSON-853341914 tempest-PortsAdminExtendedAttrsTestJSON-853341914-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:34.471925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b67bc96e-8e94-43f7-94bd-f9245dc99926 tempest-PortsAdminExtendedAttrsTestJSON-853341914 tempest-PortsAdminExtendedAttrsTestJSON-853341914-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:34.472874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b67bc96e-8e94-43f7-94bd-f9245dc99926 tempest-PortsAdminExtendedAttrsTestJSON-853341914 tempest-PortsAdminExtendedAttrsTestJSON-853341914-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:34.482045 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b67bc96e-8e94-43f7-94bd-f9245dc99926 tempest-PortsAdminExtendedAttrsTestJSON-853341914 tempest-PortsAdminExtendedAttrsTestJSON-853341914-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.290346 Oct 11 00:00:34.483311 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3330/6489] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 11 00:00:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:00:34.875663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-8ae3faf2-1dbe-46f3-83b3-0bde69c08783 req-c438b371-d600-404f-8cc9-2f5e36229b90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df93df28-1536-4fe4-8a52-1477664665c3", "tag": "f618f36c-1663-4379-81af-82742018100d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:00:34.895926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8ae3faf2-1dbe-46f3-83b3-0bde69c08783 req-c438b371-d600-404f-8cc9-2f5e36229b90 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:34.896665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8ae3faf2-1dbe-46f3-83b3-0bde69c08783 req-c438b371-d600-404f-8cc9-2f5e36229b90 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:34.897426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8ae3faf2-1dbe-46f3-83b3-0bde69c08783 req-c438b371-d600-404f-8cc9-2f5e36229b90 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:34.930102 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-8ae3faf2-1dbe-46f3-83b3-0bde69c08783 req-c438b371-d600-404f-8cc9-2f5e36229b90 service nova] Creating event network-changed:f618f36c-1663-4379-81af-82742018100d for instance df93df28-1536-4fe4-8a52-1477664665c3 on n-h1-860864-2 Oct 11 00:00:34.936642 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-8ae3faf2-1dbe-46f3-83b3-0bde69c08783 req-c438b371-d600-404f-8cc9-2f5e36229b90 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064888 Oct 11 00:00:34.937771 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3160/6490] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:00:35.035318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d6fd19f4-6bd0-4a65-becd-3a7b26bb319a tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:00:35.036561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d6fd19f4-6bd0-4a65-becd-3a7b26bb319a tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [instance: df93df28-1536-4fe4-8a52-1477664665c3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:00:35.055768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6fd19f4-6bd0-4a65-becd-3a7b26bb319a tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:35.056762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6fd19f4-6bd0-4a65-becd-3a7b26bb319a tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:35.057456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6fd19f4-6bd0-4a65-becd-3a7b26bb319a tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:35.058352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6fd19f4-6bd0-4a65-becd-3a7b26bb319a tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:35.059124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6fd19f4-6bd0-4a65-becd-3a7b26bb319a tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:35.059717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d6fd19f4-6bd0-4a65-becd-3a7b26bb319a tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:35.317095 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d6fd19f4-6bd0-4a65-becd-3a7b26bb319a tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a713546d5688431e963cd7a0a6de512d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7d94bdadb487380d28c69dfefaf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:00:35.328746 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d6fd19f4-6bd0-4a65-becd-3a7b26bb319a tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3" status: 200 len: 1426 microversion: 2.1 time: 0.301809 Oct 11 00:00:35.336361 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3331/6491] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:00:35 2022] GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3 => generated 1426 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:00:36.366637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1d14db42-501d-4b05-90b7-0ad3c2965fb0 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:00:36.366637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1d14db42-501d-4b05-90b7-0ad3c2965fb0 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [instance: df93df28-1536-4fe4-8a52-1477664665c3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:00:36.384249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d14db42-501d-4b05-90b7-0ad3c2965fb0 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:36.385848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d14db42-501d-4b05-90b7-0ad3c2965fb0 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:36.386519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d14db42-501d-4b05-90b7-0ad3c2965fb0 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:36.391297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d14db42-501d-4b05-90b7-0ad3c2965fb0 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:36.392429 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d14db42-501d-4b05-90b7-0ad3c2965fb0 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:36.393142 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d14db42-501d-4b05-90b7-0ad3c2965fb0 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:36.664500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1d14db42-501d-4b05-90b7-0ad3c2965fb0 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a713546d5688431e963cd7a0a6de512d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7d94bdadb487380d28c69dfefaf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:00:36.674246 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1d14db42-501d-4b05-90b7-0ad3c2965fb0 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3" status: 200 len: 1426 microversion: 2.1 time: 0.314591 Oct 11 00:00:36.675178 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3161/6492] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:00:36 2022] GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3 => generated 1426 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:00:37.704282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dbceb570-4c38-4915-aae1-aadfa8b31427 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:00:37.705224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dbceb570-4c38-4915-aae1-aadfa8b31427 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [instance: df93df28-1536-4fe4-8a52-1477664665c3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:00:37.712537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbceb570-4c38-4915-aae1-aadfa8b31427 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:37.714101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbceb570-4c38-4915-aae1-aadfa8b31427 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:37.714621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbceb570-4c38-4915-aae1-aadfa8b31427 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:37.715584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbceb570-4c38-4915-aae1-aadfa8b31427 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:37.716115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbceb570-4c38-4915-aae1-aadfa8b31427 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:37.716620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbceb570-4c38-4915-aae1-aadfa8b31427 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:37.910654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dbceb570-4c38-4915-aae1-aadfa8b31427 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a713546d5688431e963cd7a0a6de512d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7d94bdadb487380d28c69dfefaf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:00:37.922403 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dbceb570-4c38-4915-aae1-aadfa8b31427 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3" status: 200 len: 1426 microversion: 2.1 time: 0.222036 Oct 11 00:00:37.925099 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3332/6493] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:00:37 2022] GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3 => generated 1426 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:00:38.947482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-121ef0a5-3fea-446c-b892-1b14b7d5d005 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:00:38.948120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-121ef0a5-3fea-446c-b892-1b14b7d5d005 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [instance: df93df28-1536-4fe4-8a52-1477664665c3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:00:38.956147 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-121ef0a5-3fea-446c-b892-1b14b7d5d005 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:38.957049 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-121ef0a5-3fea-446c-b892-1b14b7d5d005 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:38.957531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-121ef0a5-3fea-446c-b892-1b14b7d5d005 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:38.958313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-121ef0a5-3fea-446c-b892-1b14b7d5d005 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:38.958806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-121ef0a5-3fea-446c-b892-1b14b7d5d005 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:38.959281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-121ef0a5-3fea-446c-b892-1b14b7d5d005 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:39.130653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-121ef0a5-3fea-446c-b892-1b14b7d5d005 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a713546d5688431e963cd7a0a6de512d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7d94bdadb487380d28c69dfefaf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:00:39.142483 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-121ef0a5-3fea-446c-b892-1b14b7d5d005 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3" status: 200 len: 1426 microversion: 2.1 time: 0.197923 Oct 11 00:00:39.145423 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3162/6494] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:00:38 2022] GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3 => generated 1426 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:00:40.168992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-818487ab-41c7-4105-8423-b68e72318f89 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:00:40.169924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-818487ab-41c7-4105-8423-b68e72318f89 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [instance: df93df28-1536-4fe4-8a52-1477664665c3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:00:40.178583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-818487ab-41c7-4105-8423-b68e72318f89 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:40.179326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-818487ab-41c7-4105-8423-b68e72318f89 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:40.180214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-818487ab-41c7-4105-8423-b68e72318f89 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:40.181432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-818487ab-41c7-4105-8423-b68e72318f89 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:40.182233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-818487ab-41c7-4105-8423-b68e72318f89 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:40.183047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-818487ab-41c7-4105-8423-b68e72318f89 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:40.508433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-818487ab-41c7-4105-8423-b68e72318f89 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a713546d5688431e963cd7a0a6de512d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7d94bdadb487380d28c69dfefaf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:00:40.528212 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-818487ab-41c7-4105-8423-b68e72318f89 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3" status: 200 len: 1426 microversion: 2.1 time: 0.364392 Oct 11 00:00:40.529191 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3333/6495] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:00:40 2022] GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3 => generated 1426 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:00:41.570230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-95e254eb-f084-4b45-9188-34bb737a655d tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:00:41.570856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-95e254eb-f084-4b45-9188-34bb737a655d tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [instance: df93df28-1536-4fe4-8a52-1477664665c3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:00:41.573696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:00:41.579207 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95e254eb-f084-4b45-9188-34bb737a655d tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:41.579721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95e254eb-f084-4b45-9188-34bb737a655d tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:41.580148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95e254eb-f084-4b45-9188-34bb737a655d tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:41.581045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95e254eb-f084-4b45-9188-34bb737a655d tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:41.581750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95e254eb-f084-4b45-9188-34bb737a655d tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:41.582384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95e254eb-f084-4b45-9188-34bb737a655d tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:41.752961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-95e254eb-f084-4b45-9188-34bb737a655d tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a713546d5688431e963cd7a0a6de512d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7d94bdadb487380d28c69dfefaf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:00:41.765162 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-95e254eb-f084-4b45-9188-34bb737a655d tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3" status: 200 len: 1426 microversion: 2.1 time: 0.198767 Oct 11 00:00:41.767782 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3163/6496] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:00:41 2022] GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3 => generated 1426 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:00:41.896262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-0483dbc8-0088-474a-81af-e7a5b02af691 req-1105be2c-ea49-47d6-970f-a63bee8a1704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df93df28-1536-4fe4-8a52-1477664665c3", "name": "network-vif-plugged", "status": "completed", "tag": "f618f36c-1663-4379-81af-82742018100d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:00:41.911153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:00:41.912119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=10 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:00:41.936858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0483dbc8-0088-474a-81af-e7a5b02af691 req-1105be2c-ea49-47d6-970f-a63bee8a1704 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:41.941480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0483dbc8-0088-474a-81af-e7a5b02af691 req-1105be2c-ea49-47d6-970f-a63bee8a1704 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:41.942154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-0483dbc8-0088-474a-81af-e7a5b02af691 req-1105be2c-ea49-47d6-970f-a63bee8a1704 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:41.979723 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-0483dbc8-0088-474a-81af-e7a5b02af691 req-1105be2c-ea49-47d6-970f-a63bee8a1704 service nova] Creating event network-vif-plugged:f618f36c-1663-4379-81af-82742018100d for instance df93df28-1536-4fe4-8a52-1477664665c3 on n-h1-860864-2 Oct 11 00:00:41.987007 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-0483dbc8-0088-474a-81af-e7a5b02af691 req-1105be2c-ea49-47d6-970f-a63bee8a1704 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095697 Oct 11 00:00:41.987854 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3334/6497] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:00:42.791293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4e07882d-b293-429c-ae60-99c1a32f7bcd tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:00:42.791910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4e07882d-b293-429c-ae60-99c1a32f7bcd tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [instance: df93df28-1536-4fe4-8a52-1477664665c3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:00:42.798926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e07882d-b293-429c-ae60-99c1a32f7bcd tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:42.799414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e07882d-b293-429c-ae60-99c1a32f7bcd tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:42.799848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e07882d-b293-429c-ae60-99c1a32f7bcd tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:42.800846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e07882d-b293-429c-ae60-99c1a32f7bcd tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:42.801331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e07882d-b293-429c-ae60-99c1a32f7bcd tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:42.801777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e07882d-b293-429c-ae60-99c1a32f7bcd tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:42.953399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4e07882d-b293-429c-ae60-99c1a32f7bcd tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a713546d5688431e963cd7a0a6de512d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7d94bdadb487380d28c69dfefaf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:00:42.963906 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4e07882d-b293-429c-ae60-99c1a32f7bcd tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3" status: 200 len: 1426 microversion: 2.1 time: 0.176123 Oct 11 00:00:42.964436 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3164/6498] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:00:42 2022] GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3 => generated 1426 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:00:43.992187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-afdeb717-6202-4f94-82a6-0d1f9c411176 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:00:43.993082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-afdeb717-6202-4f94-82a6-0d1f9c411176 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [instance: df93df28-1536-4fe4-8a52-1477664665c3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:00:44.000398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-afdeb717-6202-4f94-82a6-0d1f9c411176 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:44.001496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-afdeb717-6202-4f94-82a6-0d1f9c411176 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:44.002460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-afdeb717-6202-4f94-82a6-0d1f9c411176 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:44.002760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-afdeb717-6202-4f94-82a6-0d1f9c411176 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:44.003461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-afdeb717-6202-4f94-82a6-0d1f9c411176 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:44.004185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-afdeb717-6202-4f94-82a6-0d1f9c411176 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:44.234345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-afdeb717-6202-4f94-82a6-0d1f9c411176 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a713546d5688431e963cd7a0a6de512d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7d94bdadb487380d28c69dfefaf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:00:44.246619 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-afdeb717-6202-4f94-82a6-0d1f9c411176 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3" status: 200 len: 1606 microversion: 2.1 time: 0.260343 Oct 11 00:00:44.248063 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3335/6499] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:00:43 2022] GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3 => generated 1606 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:00:44.271337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-06908021-2627-4c26-8c65-80f8cf3d7359 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:00:44.272565 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-06908021-2627-4c26-8c65-80f8cf3d7359 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [instance: df93df28-1536-4fe4-8a52-1477664665c3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:00:44.280287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06908021-2627-4c26-8c65-80f8cf3d7359 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:44.280795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06908021-2627-4c26-8c65-80f8cf3d7359 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:44.281237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06908021-2627-4c26-8c65-80f8cf3d7359 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:44.282720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06908021-2627-4c26-8c65-80f8cf3d7359 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:44.283502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06908021-2627-4c26-8c65-80f8cf3d7359 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:44.283950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06908021-2627-4c26-8c65-80f8cf3d7359 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:44.481275 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-06908021-2627-4c26-8c65-80f8cf3d7359 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a713546d5688431e963cd7a0a6de512d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7d94bdadb487380d28c69dfefaf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:00:44.490763 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-06908021-2627-4c26-8c65-80f8cf3d7359 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3" status: 200 len: 1606 microversion: 2.1 time: 0.223545 Oct 11 00:00:44.491362 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3165/6500] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:00:44 2022] GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3 => generated 1606 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:00:44.514626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6744d1c6-f7c0-40d5-a93c-86027b711cfc tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:00:44.515523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6744d1c6-f7c0-40d5-a93c-86027b711cfc tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [instance: df93df28-1536-4fe4-8a52-1477664665c3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:00:44.523870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6744d1c6-f7c0-40d5-a93c-86027b711cfc tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:44.523870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6744d1c6-f7c0-40d5-a93c-86027b711cfc tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:44.524450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6744d1c6-f7c0-40d5-a93c-86027b711cfc tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:44.525263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6744d1c6-f7c0-40d5-a93c-86027b711cfc tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:44.525849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6744d1c6-f7c0-40d5-a93c-86027b711cfc tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:44.526523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6744d1c6-f7c0-40d5-a93c-86027b711cfc tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:44.772223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6744d1c6-f7c0-40d5-a93c-86027b711cfc tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a713546d5688431e963cd7a0a6de512d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7d94bdadb487380d28c69dfefaf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:00:44.781404 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6744d1c6-f7c0-40d5-a93c-86027b711cfc tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3" status: 200 len: 1606 microversion: 2.1 time: 0.270953 Oct 11 00:00:44.795160 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3336/6501] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:00:44 2022] GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3 => generated 1606 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:00:47.044066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-75fef33b-3f21-484c-bb3e-65b7693c08f4 req-156a875b-64e5-4bdd-8f94-755f2954eb4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df93df28-1536-4fe4-8a52-1477664665c3", "tag": "f618f36c-1663-4379-81af-82742018100d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:00:47.065127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-75fef33b-3f21-484c-bb3e-65b7693c08f4 req-156a875b-64e5-4bdd-8f94-755f2954eb4f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:00:47.066260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-75fef33b-3f21-484c-bb3e-65b7693c08f4 req-156a875b-64e5-4bdd-8f94-755f2954eb4f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:00:47.067044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-75fef33b-3f21-484c-bb3e-65b7693c08f4 req-156a875b-64e5-4bdd-8f94-755f2954eb4f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:00:47.087054 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-75fef33b-3f21-484c-bb3e-65b7693c08f4 req-156a875b-64e5-4bdd-8f94-755f2954eb4f service nova] Creating event network-changed:f618f36c-1663-4379-81af-82742018100d for instance df93df28-1536-4fe4-8a52-1477664665c3 on n-h1-860864-2 Oct 11 00:00:47.094397 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-75fef33b-3f21-484c-bb3e-65b7693c08f4 req-156a875b-64e5-4bdd-8f94-755f2954eb4f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053608 Oct 11 00:00:47.095776 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3166/6502] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:01:33.117327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:01:33.123520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=46 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:01:33.389160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-86c7e23b-430b-4758-98e2-3a69f5276efb tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Action: 'create', calling method: .version_select at 0x7f662a5f53a0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-957040439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJJAbjO8n2lgH/CL+oTEze+PnjQ/WDc3RgIoDwPwm6CAgC0MDPo1yR2O+VCuApkT90UcEYaVuve3uL2ajwuf0JUWePWOF8q5tM1Xt+iSA/3IFqDt59Ctho23aIknLzvmQ=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:01:33.408031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-86c7e23b-430b-4758-98e2-3a69f5276efb tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Getting quotas for project ce8b145e66094858841c169fc336aced. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:01:33.414699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-86c7e23b-430b-4758-98e2-3a69f5276efb tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Getting quotas for user ecf61f7621114c2fa5a809caf8303b65 and project ce8b145e66094858841c169fc336aced. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:01:33.447681 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-86c7e23b-430b-4758-98e2-3a69f5276efb tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.335692 Oct 11 00:01:33.448711 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3337/6503] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 11 00:01:33 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:01:41.104669 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8cf331c0-8724-4bde-8191-f009acbe01db tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1371459610-access_point-1722999730", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "18ba4075-8433-4622-8de7-d7b449dfe1f0"}], "key_name": "tempest-TestSecurityGroupsBasicOps-957040439", "security_groups": [{"name": "tempest-secgroup_access--1307046245"}, {"name": "tempest-secgroup_general--1763390831"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:01:41.114890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:01:41.115682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=40 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:01:41.374690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-8cf331c0-8724-4bde-8191-f009acbe01db tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] validate_networks() for [('18ba4075-8433-4622-8de7-d7b449dfe1f0', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:01:42.266377 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-8cf331c0-8724-4bde-8191-f009acbe01db tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:01:42.271086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-8cf331c0-8724-4bde-8191-f009acbe01db tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:01:42.271905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-8cf331c0-8724-4bde-8191-f009acbe01db tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:01:42.273787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-8cf331c0-8724-4bde-8191-f009acbe01db tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:01:42.275119 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-8cf331c0-8724-4bde-8191-f009acbe01db tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:01:42.288582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cf331c0-8724-4bde-8191-f009acbe01db tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:42.289422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cf331c0-8724-4bde-8191-f009acbe01db tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:42.290062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cf331c0-8724-4bde-8191-f009acbe01db tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:42.291001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cf331c0-8724-4bde-8191-f009acbe01db tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:42.291479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cf331c0-8724-4bde-8191-f009acbe01db tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:42.292034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cf331c0-8724-4bde-8191-f009acbe01db tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:42.326611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-8cf331c0-8724-4bde-8191-f009acbe01db tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Getting quotas for project ce8b145e66094858841c169fc336aced. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:01:42.336782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-8cf331c0-8724-4bde-8191-f009acbe01db tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Getting quotas for user ecf61f7621114c2fa5a809caf8303b65 and project ce8b145e66094858841c169fc336aced. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:01:42.359406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8cf331c0-8724-4bde-8191-f009acbe01db tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:01:42.362524 n-d-860864-2 devstack@n-api.service[120614]: WARNING nova.utils [None req-8cf331c0-8724-4bde-8191-f009acbe01db tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1371459610-access_point-1722999730 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1371459610-ac Oct 11 00:01:42.363792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8cf331c0-8724-4bde-8191-f009acbe01db tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 093acac2-d2fe-4fa6-9345-e3c99fc28abf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:01:42.437953 n-d-860864-2 devstack@n-api.service[120614]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8cf331c0-8724-4bde-8191-f009acbe01db tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [ef7180a5-4bd5-46c5-ad8d-3f7ac9b635b6] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 00:01:43.446979 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [None req-8cf331c0-8724-4bde-8191-f009acbe01db tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [ef7180a5-4bd5-46c5-ad8d-3f7ac9b635b6] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58034. Oct 11 00:01:43.451772 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8cf331c0-8724-4bde-8191-f009acbe01db tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 2.351636 Oct 11 00:01:43.452774 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3167/6504] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:01:41 2022] POST /compute/v2.1/servers => generated 458 bytes in 2354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:01:43.463073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:01:43.463997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:01:43.469020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-384152a8-8722-46a4-be27-202f378347f9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:01:43.469686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-384152a8-8722-46a4-be27-202f378347f9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 093acac2-d2fe-4fa6-9345-e3c99fc28abf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:01:43.558583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-384152a8-8722-46a4-be27-202f378347f9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:01:43.567195 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-384152a8-8722-46a4-be27-202f378347f9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf" status: 200 len: 1294 microversion: 2.1 time: 0.106018 Oct 11 00:01:43.568111 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3338/6505] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:01:43 2022] GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf => generated 1294 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:01:44.593902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-641153e6-a418-4a3a-bd32-8ad9497ce7ce tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:01:44.594654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-641153e6-a418-4a3a-bd32-8ad9497ce7ce tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 093acac2-d2fe-4fa6-9345-e3c99fc28abf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:01:44.603082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-641153e6-a418-4a3a-bd32-8ad9497ce7ce tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:44.603632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-641153e6-a418-4a3a-bd32-8ad9497ce7ce tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:44.604183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-641153e6-a418-4a3a-bd32-8ad9497ce7ce tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:44.604982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-641153e6-a418-4a3a-bd32-8ad9497ce7ce tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:44.605656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-641153e6-a418-4a3a-bd32-8ad9497ce7ce tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:44.606124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-641153e6-a418-4a3a-bd32-8ad9497ce7ce tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:44.684548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-641153e6-a418-4a3a-bd32-8ad9497ce7ce tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:01:44.698137 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-641153e6-a418-4a3a-bd32-8ad9497ce7ce tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf" status: 200 len: 1346 microversion: 2.1 time: 0.111260 Oct 11 00:01:44.699279 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3168/6506] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:01:44 2022] GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf => generated 1346 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:01:45.732428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4ff421f6-776b-464f-9995-540dc079172a tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:01:45.734262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4ff421f6-776b-464f-9995-540dc079172a tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 093acac2-d2fe-4fa6-9345-e3c99fc28abf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:01:45.743793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ff421f6-776b-464f-9995-540dc079172a tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:45.744692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ff421f6-776b-464f-9995-540dc079172a tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:45.745359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ff421f6-776b-464f-9995-540dc079172a tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:45.746250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ff421f6-776b-464f-9995-540dc079172a tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:45.746942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ff421f6-776b-464f-9995-540dc079172a tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:45.747599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ff421f6-776b-464f-9995-540dc079172a tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:45.983796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4ff421f6-776b-464f-9995-540dc079172a tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:01:45.993024 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4ff421f6-776b-464f-9995-540dc079172a tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf" status: 200 len: 1472 microversion: 2.1 time: 0.267799 Oct 11 00:01:45.994017 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3339/6507] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:01:45 2022] GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf => generated 1472 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:01:46.706000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-cd74eecd-d752-4ab7-8a27-529038375ab0 req-20b38e65-0551-4ef1-a329-5100305444bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "093acac2-d2fe-4fa6-9345-e3c99fc28abf", "tag": "7d91d4f1-4d31-49a2-bfdf-261c6c2f586c"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:01:46.721204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-cd74eecd-d752-4ab7-8a27-529038375ab0 req-20b38e65-0551-4ef1-a329-5100305444bb service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:46.722377 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-cd74eecd-d752-4ab7-8a27-529038375ab0 req-20b38e65-0551-4ef1-a329-5100305444bb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:46.734443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-cd74eecd-d752-4ab7-8a27-529038375ab0 req-20b38e65-0551-4ef1-a329-5100305444bb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:46.748579 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-cd74eecd-d752-4ab7-8a27-529038375ab0 req-20b38e65-0551-4ef1-a329-5100305444bb service nova] Creating event network-changed:7d91d4f1-4d31-49a2-bfdf-261c6c2f586c for instance 093acac2-d2fe-4fa6-9345-e3c99fc28abf on n-h2-860864-2 Oct 11 00:01:46.755131 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-cd74eecd-d752-4ab7-8a27-529038375ab0 req-20b38e65-0551-4ef1-a329-5100305444bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053357 Oct 11 00:01:46.755829 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3169/6508] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:01:47.020029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-47185aff-6e5c-4e9e-bc69-b18f88acce48 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:01:47.020645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-47185aff-6e5c-4e9e-bc69-b18f88acce48 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 093acac2-d2fe-4fa6-9345-e3c99fc28abf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:01:47.027610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47185aff-6e5c-4e9e-bc69-b18f88acce48 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:47.028228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47185aff-6e5c-4e9e-bc69-b18f88acce48 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:47.028876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47185aff-6e5c-4e9e-bc69-b18f88acce48 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:47.029843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47185aff-6e5c-4e9e-bc69-b18f88acce48 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:47.030344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47185aff-6e5c-4e9e-bc69-b18f88acce48 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:47.030819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47185aff-6e5c-4e9e-bc69-b18f88acce48 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:47.276195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-47185aff-6e5c-4e9e-bc69-b18f88acce48 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:01:47.285749 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-47185aff-6e5c-4e9e-bc69-b18f88acce48 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf" status: 200 len: 1472 microversion: 2.1 time: 0.270107 Oct 11 00:01:47.286368 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3340/6509] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:01:47 2022] GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf => generated 1472 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:01:48.317115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e7418ebf-a368-4dc8-8cee-d8d46b81612b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:01:48.317869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e7418ebf-a368-4dc8-8cee-d8d46b81612b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 093acac2-d2fe-4fa6-9345-e3c99fc28abf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:01:48.326332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7418ebf-a368-4dc8-8cee-d8d46b81612b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:48.326865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7418ebf-a368-4dc8-8cee-d8d46b81612b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:48.327543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7418ebf-a368-4dc8-8cee-d8d46b81612b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:48.328444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7418ebf-a368-4dc8-8cee-d8d46b81612b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:48.329011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7418ebf-a368-4dc8-8cee-d8d46b81612b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:48.329655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e7418ebf-a368-4dc8-8cee-d8d46b81612b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:48.625167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e7418ebf-a368-4dc8-8cee-d8d46b81612b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:01:48.633853 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e7418ebf-a368-4dc8-8cee-d8d46b81612b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf" status: 200 len: 1472 microversion: 2.1 time: 0.320956 Oct 11 00:01:48.634561 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3170/6510] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:01:48 2022] GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf => generated 1472 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:01:49.660023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-80e38126-f435-4e4f-9905-451363e5f681 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:01:49.660685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-80e38126-f435-4e4f-9905-451363e5f681 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 093acac2-d2fe-4fa6-9345-e3c99fc28abf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:01:49.667636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80e38126-f435-4e4f-9905-451363e5f681 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:49.668130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80e38126-f435-4e4f-9905-451363e5f681 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:49.668580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80e38126-f435-4e4f-9905-451363e5f681 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:49.669415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80e38126-f435-4e4f-9905-451363e5f681 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:49.669766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80e38126-f435-4e4f-9905-451363e5f681 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:49.670275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80e38126-f435-4e4f-9905-451363e5f681 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:49.913129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-80e38126-f435-4e4f-9905-451363e5f681 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:01:49.921924 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-80e38126-f435-4e4f-9905-451363e5f681 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf" status: 200 len: 1472 microversion: 2.1 time: 0.266443 Oct 11 00:01:49.922971 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3341/6511] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:01:49 2022] GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf => generated 1472 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:01:50.946861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4f7b4dba-7c79-4983-9918-75a5676825d9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:01:50.947504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4f7b4dba-7c79-4983-9918-75a5676825d9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 093acac2-d2fe-4fa6-9345-e3c99fc28abf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:01:50.955727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f7b4dba-7c79-4983-9918-75a5676825d9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:50.956214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f7b4dba-7c79-4983-9918-75a5676825d9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:50.956651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f7b4dba-7c79-4983-9918-75a5676825d9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:50.957352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f7b4dba-7c79-4983-9918-75a5676825d9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:50.957838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f7b4dba-7c79-4983-9918-75a5676825d9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:50.958258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4f7b4dba-7c79-4983-9918-75a5676825d9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:51.118161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4f7b4dba-7c79-4983-9918-75a5676825d9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:01:51.126024 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4f7b4dba-7c79-4983-9918-75a5676825d9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf" status: 200 len: 1472 microversion: 2.1 time: 0.183340 Oct 11 00:01:51.126673 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3171/6512] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:01:50 2022] GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf => generated 1472 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:01:52.151723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0feb1f94-6bea-4ad4-85c4-d1f6a8250139 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:01:52.153114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0feb1f94-6bea-4ad4-85c4-d1f6a8250139 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 093acac2-d2fe-4fa6-9345-e3c99fc28abf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:01:52.165857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0feb1f94-6bea-4ad4-85c4-d1f6a8250139 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:52.166920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0feb1f94-6bea-4ad4-85c4-d1f6a8250139 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:52.167508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0feb1f94-6bea-4ad4-85c4-d1f6a8250139 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:52.168245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0feb1f94-6bea-4ad4-85c4-d1f6a8250139 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:52.168752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0feb1f94-6bea-4ad4-85c4-d1f6a8250139 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:52.169778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0feb1f94-6bea-4ad4-85c4-d1f6a8250139 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:52.182306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-bb0ca130-c785-4346-9d56-ec1e445c63b9 req-de02a01d-457b-4462-9094-7d88a7448025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "093acac2-d2fe-4fa6-9345-e3c99fc28abf", "name": "network-vif-plugged", "status": "completed", "tag": "7d91d4f1-4d31-49a2-bfdf-261c6c2f586c"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:01:52.200500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-bb0ca130-c785-4346-9d56-ec1e445c63b9 req-de02a01d-457b-4462-9094-7d88a7448025 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:52.200987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-bb0ca130-c785-4346-9d56-ec1e445c63b9 req-de02a01d-457b-4462-9094-7d88a7448025 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:52.201495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-bb0ca130-c785-4346-9d56-ec1e445c63b9 req-de02a01d-457b-4462-9094-7d88a7448025 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:52.219824 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-bb0ca130-c785-4346-9d56-ec1e445c63b9 req-de02a01d-457b-4462-9094-7d88a7448025 service nova] Creating event network-vif-plugged:7d91d4f1-4d31-49a2-bfdf-261c6c2f586c for instance 093acac2-d2fe-4fa6-9345-e3c99fc28abf on n-h2-860864-2 Oct 11 00:01:52.232272 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-bb0ca130-c785-4346-9d56-ec1e445c63b9 req-de02a01d-457b-4462-9094-7d88a7448025 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053517 Oct 11 00:01:52.233827 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3172/6513] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:01:52.363308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0feb1f94-6bea-4ad4-85c4-d1f6a8250139 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:01:52.372038 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0feb1f94-6bea-4ad4-85c4-d1f6a8250139 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf" status: 200 len: 1472 microversion: 2.1 time: 0.225618 Oct 11 00:01:52.372637 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3342/6514] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:01:52 2022] GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf => generated 1472 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:01:53.396472 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-140a595e-a57e-4a4c-8e8e-8ff67c4af043 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:01:53.397429 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-140a595e-a57e-4a4c-8e8e-8ff67c4af043 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 093acac2-d2fe-4fa6-9345-e3c99fc28abf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:01:53.399546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:01:53.400329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:01:53.407842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-140a595e-a57e-4a4c-8e8e-8ff67c4af043 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:53.408706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-140a595e-a57e-4a4c-8e8e-8ff67c4af043 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:53.409235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-140a595e-a57e-4a4c-8e8e-8ff67c4af043 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:53.410052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-140a595e-a57e-4a4c-8e8e-8ff67c4af043 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:53.410593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-140a595e-a57e-4a4c-8e8e-8ff67c4af043 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:53.411110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-140a595e-a57e-4a4c-8e8e-8ff67c4af043 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:53.568623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-140a595e-a57e-4a4c-8e8e-8ff67c4af043 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:01:53.578421 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-140a595e-a57e-4a4c-8e8e-8ff67c4af043 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf" status: 200 len: 1472 microversion: 2.1 time: 0.186812 Oct 11 00:01:53.580128 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3173/6515] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:01:53 2022] GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf => generated 1472 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:01:54.608035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-023ff49d-f95f-4a73-8c73-43ac7c1ba682 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:01:54.609060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-023ff49d-f95f-4a73-8c73-43ac7c1ba682 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 093acac2-d2fe-4fa6-9345-e3c99fc28abf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:01:54.613253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:01:54.620925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-023ff49d-f95f-4a73-8c73-43ac7c1ba682 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:54.621750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-023ff49d-f95f-4a73-8c73-43ac7c1ba682 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:54.622233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-023ff49d-f95f-4a73-8c73-43ac7c1ba682 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:54.623146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-023ff49d-f95f-4a73-8c73-43ac7c1ba682 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:54.623864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-023ff49d-f95f-4a73-8c73-43ac7c1ba682 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:54.624346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-023ff49d-f95f-4a73-8c73-43ac7c1ba682 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:54.811809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-023ff49d-f95f-4a73-8c73-43ac7c1ba682 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:01:54.825641 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-023ff49d-f95f-4a73-8c73-43ac7c1ba682 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf" status: 200 len: 1644 microversion: 2.1 time: 0.223299 Oct 11 00:01:54.826613 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3343/6516] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:01:54 2022] GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf => generated 1644 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:01:54.850527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3e7ca474-67f9-4830-a6c5-ffbf27c6be27 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:01:54.851082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3e7ca474-67f9-4830-a6c5-ffbf27c6be27 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 093acac2-d2fe-4fa6-9345-e3c99fc28abf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:01:54.858703 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e7ca474-67f9-4830-a6c5-ffbf27c6be27 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:54.859193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e7ca474-67f9-4830-a6c5-ffbf27c6be27 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:54.859629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e7ca474-67f9-4830-a6c5-ffbf27c6be27 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:54.860536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e7ca474-67f9-4830-a6c5-ffbf27c6be27 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:54.861110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e7ca474-67f9-4830-a6c5-ffbf27c6be27 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:54.861680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3e7ca474-67f9-4830-a6c5-ffbf27c6be27 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:55.112650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3e7ca474-67f9-4830-a6c5-ffbf27c6be27 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:01:55.120754 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3e7ca474-67f9-4830-a6c5-ffbf27c6be27 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf" status: 200 len: 1644 microversion: 2.1 time: 0.274142 Oct 11 00:01:55.121413 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3174/6517] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:01:54 2022] GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf => generated 1644 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:01:55.145850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5e26a9c8-0ca7-472b-9991-275e5cb2f56a tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:01:55.146913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5e26a9c8-0ca7-472b-9991-275e5cb2f56a tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] [instance: 093acac2-d2fe-4fa6-9345-e3c99fc28abf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:01:55.153319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e26a9c8-0ca7-472b-9991-275e5cb2f56a tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:55.153992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e26a9c8-0ca7-472b-9991-275e5cb2f56a tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:55.154505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e26a9c8-0ca7-472b-9991-275e5cb2f56a tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:55.155323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e26a9c8-0ca7-472b-9991-275e5cb2f56a tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:55.155941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e26a9c8-0ca7-472b-9991-275e5cb2f56a tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:55.156450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e26a9c8-0ca7-472b-9991-275e5cb2f56a tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:55.504886 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5e26a9c8-0ca7-472b-9991-275e5cb2f56a tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf" status: 200 len: 1795 microversion: 2.1 time: 0.364925 Oct 11 00:01:55.505729 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3344/6518] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:01:55 2022] GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf => generated 1795 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:01:56.006818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bed943ea-5478-417b-87cf-b06ff12292b8 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:01:56.007408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bed943ea-5478-417b-87cf-b06ff12292b8 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [instance: df93df28-1536-4fe4-8a52-1477664665c3] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:01:56.013756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bed943ea-5478-417b-87cf-b06ff12292b8 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:56.014324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bed943ea-5478-417b-87cf-b06ff12292b8 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:56.014796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bed943ea-5478-417b-87cf-b06ff12292b8 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:56.015488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bed943ea-5478-417b-87cf-b06ff12292b8 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:56.015932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bed943ea-5478-417b-87cf-b06ff12292b8 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:56.016358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bed943ea-5478-417b-87cf-b06ff12292b8 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:56.044684 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bed943ea-5478-417b-87cf-b06ff12292b8 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.042840 Oct 11 00:01:56.045296 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3175/6519] 10.222.0.23 () {58 vars in 1293 bytes} [Tue Oct 11 00:01:56 2022] GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3/os-server-password => generated 116 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:01:57.881822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-8512fbbe-6d2f-44b2-9ce2-925f269141b0 req-722e7499-d478-41e1-b999-a34ecbc0e5fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "093acac2-d2fe-4fa6-9345-e3c99fc28abf", "tag": "7d91d4f1-4d31-49a2-bfdf-261c6c2f586c"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:01:57.899332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8512fbbe-6d2f-44b2-9ce2-925f269141b0 req-722e7499-d478-41e1-b999-a34ecbc0e5fd service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:01:57.901607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8512fbbe-6d2f-44b2-9ce2-925f269141b0 req-722e7499-d478-41e1-b999-a34ecbc0e5fd service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:01:57.902600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8512fbbe-6d2f-44b2-9ce2-925f269141b0 req-722e7499-d478-41e1-b999-a34ecbc0e5fd service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:01:57.919100 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-8512fbbe-6d2f-44b2-9ce2-925f269141b0 req-722e7499-d478-41e1-b999-a34ecbc0e5fd service nova] Creating event network-changed:7d91d4f1-4d31-49a2-bfdf-261c6c2f586c for instance 093acac2-d2fe-4fa6-9345-e3c99fc28abf on n-h2-860864-2 Oct 11 00:01:57.926357 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-8512fbbe-6d2f-44b2-9ce2-925f269141b0 req-722e7499-d478-41e1-b999-a34ecbc0e5fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048081 Oct 11 00:01:57.927595 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3345/6520] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:02:38.959942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4ec9edd9-fa11-4fda-b965-4682d4fad1c9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-949295327", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "c723dcb9-21ff-4e3f-ad96-30199e6e57d7"}], "key_name": "tempest-TestSecurityGroupsBasicOps-957040439", "security_groups": []}, "os:scheduler_hints": {"different_host": ["093acac2-d2fe-4fa6-9345-e3c99fc28abf"]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:02:38.973516 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:02:38.974972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=40 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:02:39.371281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-4ec9edd9-fa11-4fda-b965-4682d4fad1c9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] validate_networks() for [('c723dcb9-21ff-4e3f-ad96-30199e6e57d7', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:02:40.363150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4ec9edd9-fa11-4fda-b965-4682d4fad1c9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:02:40.363810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4ec9edd9-fa11-4fda-b965-4682d4fad1c9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:02:40.364304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4ec9edd9-fa11-4fda-b965-4682d4fad1c9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:02:40.364720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4ec9edd9-fa11-4fda-b965-4682d4fad1c9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:02:40.365138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-4ec9edd9-fa11-4fda-b965-4682d4fad1c9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:02:40.385205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ec9edd9-fa11-4fda-b965-4682d4fad1c9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:40.385822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ec9edd9-fa11-4fda-b965-4682d4fad1c9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:40.386746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ec9edd9-fa11-4fda-b965-4682d4fad1c9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:40.387458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ec9edd9-fa11-4fda-b965-4682d4fad1c9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:40.387922 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ec9edd9-fa11-4fda-b965-4682d4fad1c9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:40.388351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ec9edd9-fa11-4fda-b965-4682d4fad1c9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:40.443307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-4ec9edd9-fa11-4fda-b965-4682d4fad1c9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Getting quotas for project ce8b145e66094858841c169fc336aced. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:02:40.451665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-4ec9edd9-fa11-4fda-b965-4682d4fad1c9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Getting quotas for user ecf61f7621114c2fa5a809caf8303b65 and project ce8b145e66094858841c169fc336aced. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:02:40.471111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4ec9edd9-fa11-4fda-b965-4682d4fad1c9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:02:40.474050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4ec9edd9-fa11-4fda-b965-4682d4fad1c9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 75b60743-a9de-4a57-adc7-80c55d178086] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:02:40.560986 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4ec9edd9-fa11-4fda-b965-4682d4fad1c9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.605160 Oct 11 00:02:40.572411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=18 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:02:40.574674 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3176/6521] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:02:38 2022] POST /compute/v2.1/servers => generated 361 bytes in 1620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:02:40.576214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=38 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:02:40.583122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ecaae27c-99df-473a-b9c7-af9f7f063db1 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:02:40.584155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ecaae27c-99df-473a-b9c7-af9f7f063db1 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 75b60743-a9de-4a57-adc7-80c55d178086] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:02:40.984711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ecaae27c-99df-473a-b9c7-af9f7f063db1 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:02:40.993055 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ecaae27c-99df-473a-b9c7-af9f7f063db1 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086" status: 200 len: 1240 microversion: 2.1 time: 0.422799 Oct 11 00:02:41.006270 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3346/6522] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:02:40 2022] GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086 => generated 1240 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:02:42.019005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7be6628e-e821-4b19-89d3-214dddb45098 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:02:42.019620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7be6628e-e821-4b19-89d3-214dddb45098 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 75b60743-a9de-4a57-adc7-80c55d178086] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:02:42.075822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7be6628e-e821-4b19-89d3-214dddb45098 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:02:42.082867 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7be6628e-e821-4b19-89d3-214dddb45098 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086" status: 200 len: 1240 microversion: 2.1 time: 0.069057 Oct 11 00:02:42.083463 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3177/6523] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:02:42 2022] GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:02:43.108543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ef5d93f8-0112-4db9-9e9d-4a877b52243a tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:02:43.109277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ef5d93f8-0112-4db9-9e9d-4a877b52243a tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 75b60743-a9de-4a57-adc7-80c55d178086] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:02:43.180228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ef5d93f8-0112-4db9-9e9d-4a877b52243a tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:02:43.187731 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ef5d93f8-0112-4db9-9e9d-4a877b52243a tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086" status: 200 len: 1240 microversion: 2.1 time: 0.084231 Oct 11 00:02:43.188313 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3347/6524] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:02:43 2022] GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:02:44.210824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4da92ae6-d74d-4762-b2f5-9b1e913f293d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:02:44.212367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4da92ae6-d74d-4762-b2f5-9b1e913f293d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 75b60743-a9de-4a57-adc7-80c55d178086] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:02:44.220761 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4da92ae6-d74d-4762-b2f5-9b1e913f293d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:44.221248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4da92ae6-d74d-4762-b2f5-9b1e913f293d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:44.221710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4da92ae6-d74d-4762-b2f5-9b1e913f293d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:44.222659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4da92ae6-d74d-4762-b2f5-9b1e913f293d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:44.222940 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4da92ae6-d74d-4762-b2f5-9b1e913f293d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:44.223440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4da92ae6-d74d-4762-b2f5-9b1e913f293d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:44.291543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4da92ae6-d74d-4762-b2f5-9b1e913f293d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:02:44.299712 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4da92ae6-d74d-4762-b2f5-9b1e913f293d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086" status: 200 len: 1244 microversion: 2.1 time: 0.092640 Oct 11 00:02:44.300444 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3178/6525] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:02:44 2022] GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086 => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:02:45.325879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b870a3f2-ace8-47cb-ab9e-ee7206ab514b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:02:45.326615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b870a3f2-ace8-47cb-ab9e-ee7206ab514b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 75b60743-a9de-4a57-adc7-80c55d178086] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:02:45.335527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b870a3f2-ace8-47cb-ab9e-ee7206ab514b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:45.336299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b870a3f2-ace8-47cb-ab9e-ee7206ab514b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:45.337032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b870a3f2-ace8-47cb-ab9e-ee7206ab514b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:45.337852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b870a3f2-ace8-47cb-ab9e-ee7206ab514b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:45.338272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b870a3f2-ace8-47cb-ab9e-ee7206ab514b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:45.338813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b870a3f2-ace8-47cb-ab9e-ee7206ab514b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:45.437919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b870a3f2-ace8-47cb-ab9e-ee7206ab514b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:02:45.448090 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b870a3f2-ace8-47cb-ab9e-ee7206ab514b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086" status: 200 len: 1292 microversion: 2.1 time: 0.127653 Oct 11 00:02:45.448897 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3348/6526] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:02:45 2022] GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086 => generated 1292 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:02:46.473656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5db32e80-276b-4965-ab37-14656d02d0dd tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:02:46.474424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5db32e80-276b-4965-ab37-14656d02d0dd tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 75b60743-a9de-4a57-adc7-80c55d178086] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:02:46.481965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5db32e80-276b-4965-ab37-14656d02d0dd tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:46.482688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5db32e80-276b-4965-ab37-14656d02d0dd tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:46.483203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5db32e80-276b-4965-ab37-14656d02d0dd tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:46.483998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5db32e80-276b-4965-ab37-14656d02d0dd tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:46.484581 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5db32e80-276b-4965-ab37-14656d02d0dd tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:46.485078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5db32e80-276b-4965-ab37-14656d02d0dd tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:46.609447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5db32e80-276b-4965-ab37-14656d02d0dd tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:02:46.618914 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5db32e80-276b-4965-ab37-14656d02d0dd tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086" status: 200 len: 1298 microversion: 2.1 time: 0.149269 Oct 11 00:02:46.619483 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3179/6527] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:02:46 2022] GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086 => generated 1298 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:02:47.276314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-66c39743-ec24-4f69-a159-2e7c1d5bd372 req-403f1e4f-4220-46d6-bd1e-adab703cbe7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75b60743-a9de-4a57-adc7-80c55d178086", "tag": "770a7e90-27f8-4e52-88a8-d197a4a53d4f"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:02:47.287947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-66c39743-ec24-4f69-a159-2e7c1d5bd372 req-403f1e4f-4220-46d6-bd1e-adab703cbe7a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:47.288489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-66c39743-ec24-4f69-a159-2e7c1d5bd372 req-403f1e4f-4220-46d6-bd1e-adab703cbe7a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:47.288866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-66c39743-ec24-4f69-a159-2e7c1d5bd372 req-403f1e4f-4220-46d6-bd1e-adab703cbe7a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:47.309496 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-66c39743-ec24-4f69-a159-2e7c1d5bd372 req-403f1e4f-4220-46d6-bd1e-adab703cbe7a service nova] Creating event network-changed:770a7e90-27f8-4e52-88a8-d197a4a53d4f for instance 75b60743-a9de-4a57-adc7-80c55d178086 on n-h1-860864-2 Oct 11 00:02:47.315946 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-66c39743-ec24-4f69-a159-2e7c1d5bd372 req-403f1e4f-4220-46d6-bd1e-adab703cbe7a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043775 Oct 11 00:02:47.316570 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3349/6528] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:02:47.646169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1186002c-a51f-4654-a3d9-1481fc59b7f8 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:02:47.646911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1186002c-a51f-4654-a3d9-1481fc59b7f8 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 75b60743-a9de-4a57-adc7-80c55d178086] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:02:47.655167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1186002c-a51f-4654-a3d9-1481fc59b7f8 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:47.655705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1186002c-a51f-4654-a3d9-1481fc59b7f8 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:47.656168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1186002c-a51f-4654-a3d9-1481fc59b7f8 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:47.656951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1186002c-a51f-4654-a3d9-1481fc59b7f8 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:47.657640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1186002c-a51f-4654-a3d9-1481fc59b7f8 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:47.658075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1186002c-a51f-4654-a3d9-1481fc59b7f8 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:47.759873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1186002c-a51f-4654-a3d9-1481fc59b7f8 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:02:47.768864 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1186002c-a51f-4654-a3d9-1481fc59b7f8 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086" status: 200 len: 1298 microversion: 2.1 time: 0.127081 Oct 11 00:02:47.769652 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3180/6529] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:02:47 2022] GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086 => generated 1298 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:02:48.794980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0231c12f-2b2a-44a1-a26d-730ad28d340c tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:02:48.795602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0231c12f-2b2a-44a1-a26d-730ad28d340c tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 75b60743-a9de-4a57-adc7-80c55d178086] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:02:48.802045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0231c12f-2b2a-44a1-a26d-730ad28d340c tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:48.802535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0231c12f-2b2a-44a1-a26d-730ad28d340c tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:48.803005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0231c12f-2b2a-44a1-a26d-730ad28d340c tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:48.803707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0231c12f-2b2a-44a1-a26d-730ad28d340c tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:48.804164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0231c12f-2b2a-44a1-a26d-730ad28d340c tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:48.804592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0231c12f-2b2a-44a1-a26d-730ad28d340c tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:48.895182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0231c12f-2b2a-44a1-a26d-730ad28d340c tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:02:48.903326 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0231c12f-2b2a-44a1-a26d-730ad28d340c tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086" status: 200 len: 1298 microversion: 2.1 time: 0.113722 Oct 11 00:02:48.903937 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3350/6530] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:02:48 2022] GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086 => generated 1298 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:02:49.928128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-79776b1a-91a6-45c9-bd13-245275cf083b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:02:49.928758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-79776b1a-91a6-45c9-bd13-245275cf083b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 75b60743-a9de-4a57-adc7-80c55d178086] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:02:49.937514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79776b1a-91a6-45c9-bd13-245275cf083b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:49.938010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79776b1a-91a6-45c9-bd13-245275cf083b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:49.938444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79776b1a-91a6-45c9-bd13-245275cf083b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:49.939148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79776b1a-91a6-45c9-bd13-245275cf083b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:49.939599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79776b1a-91a6-45c9-bd13-245275cf083b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:49.940228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79776b1a-91a6-45c9-bd13-245275cf083b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:50.101390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-79776b1a-91a6-45c9-bd13-245275cf083b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:02:50.110545 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-79776b1a-91a6-45c9-bd13-245275cf083b tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086" status: 200 len: 1298 microversion: 2.1 time: 0.187092 Oct 11 00:02:50.111150 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3181/6531] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:02:49 2022] GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086 => generated 1298 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:02:51.139961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-735d396f-e701-4d73-9590-eb80f91e8ffe tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:02:51.142001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-735d396f-e701-4d73-9590-eb80f91e8ffe tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 75b60743-a9de-4a57-adc7-80c55d178086] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:02:51.152811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-735d396f-e701-4d73-9590-eb80f91e8ffe tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:51.153483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-735d396f-e701-4d73-9590-eb80f91e8ffe tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:51.154289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-735d396f-e701-4d73-9590-eb80f91e8ffe tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:51.155214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-735d396f-e701-4d73-9590-eb80f91e8ffe tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:51.155697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-735d396f-e701-4d73-9590-eb80f91e8ffe tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:51.156310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-735d396f-e701-4d73-9590-eb80f91e8ffe tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:51.256309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-735d396f-e701-4d73-9590-eb80f91e8ffe tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:02:51.267498 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-735d396f-e701-4d73-9590-eb80f91e8ffe tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086" status: 200 len: 1298 microversion: 2.1 time: 0.136231 Oct 11 00:02:51.268168 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3351/6532] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:02:51 2022] GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086 => generated 1298 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:02:52.298598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6c729f2f-d447-4ec3-a976-a24b7699d9aa tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:02:52.300185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6c729f2f-d447-4ec3-a976-a24b7699d9aa tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 75b60743-a9de-4a57-adc7-80c55d178086] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:02:52.325640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:02:52.330764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=8 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:02:52.336739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c729f2f-d447-4ec3-a976-a24b7699d9aa tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:52.337365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c729f2f-d447-4ec3-a976-a24b7699d9aa tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:52.339788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c729f2f-d447-4ec3-a976-a24b7699d9aa tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:52.341010 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c729f2f-d447-4ec3-a976-a24b7699d9aa tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:52.342487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c729f2f-d447-4ec3-a976-a24b7699d9aa tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:52.346136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6c729f2f-d447-4ec3-a976-a24b7699d9aa tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:52.487470 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6c729f2f-d447-4ec3-a976-a24b7699d9aa tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:02:52.497431 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6c729f2f-d447-4ec3-a976-a24b7699d9aa tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086" status: 200 len: 1298 microversion: 2.1 time: 0.210605 Oct 11 00:02:52.499487 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3182/6533] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:02:52 2022] GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086 => generated 1298 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:02:53.522444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-30184cce-fc98-480d-a48c-7ff36b886b00 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:02:53.523062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-30184cce-fc98-480d-a48c-7ff36b886b00 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 75b60743-a9de-4a57-adc7-80c55d178086] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:02:53.528034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:02:53.532466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30184cce-fc98-480d-a48c-7ff36b886b00 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:53.532969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30184cce-fc98-480d-a48c-7ff36b886b00 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:53.533433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30184cce-fc98-480d-a48c-7ff36b886b00 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:53.534488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30184cce-fc98-480d-a48c-7ff36b886b00 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:53.534936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30184cce-fc98-480d-a48c-7ff36b886b00 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:53.535660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30184cce-fc98-480d-a48c-7ff36b886b00 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:53.630930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-30184cce-fc98-480d-a48c-7ff36b886b00 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:02:53.639934 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-30184cce-fc98-480d-a48c-7ff36b886b00 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086" status: 200 len: 1298 microversion: 2.1 time: 0.121504 Oct 11 00:02:53.640526 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3352/6534] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:02:53 2022] GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086 => generated 1298 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:02:54.305632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-60f450c1-7179-4fb2-b5bc-48e516a89b98 req-62efde98-686b-4da4-8faf-a623bc59f7e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b60743-a9de-4a57-adc7-80c55d178086", "name": "network-vif-plugged", "status": "completed", "tag": "770a7e90-27f8-4e52-88a8-d197a4a53d4f"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:02:54.316380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-60f450c1-7179-4fb2-b5bc-48e516a89b98 req-62efde98-686b-4da4-8faf-a623bc59f7e6 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:54.316878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-60f450c1-7179-4fb2-b5bc-48e516a89b98 req-62efde98-686b-4da4-8faf-a623bc59f7e6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:54.317288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-60f450c1-7179-4fb2-b5bc-48e516a89b98 req-62efde98-686b-4da4-8faf-a623bc59f7e6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:54.330365 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-60f450c1-7179-4fb2-b5bc-48e516a89b98 req-62efde98-686b-4da4-8faf-a623bc59f7e6 service nova] Creating event network-vif-plugged:770a7e90-27f8-4e52-88a8-d197a4a53d4f for instance 75b60743-a9de-4a57-adc7-80c55d178086 on n-h1-860864-2 Oct 11 00:02:54.335818 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-60f450c1-7179-4fb2-b5bc-48e516a89b98 req-62efde98-686b-4da4-8faf-a623bc59f7e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033877 Oct 11 00:02:54.336437 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3183/6535] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:02:54.664204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-085bfeff-cd7a-4cba-9aa9-469a88eee486 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:02:54.664825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-085bfeff-cd7a-4cba-9aa9-469a88eee486 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 75b60743-a9de-4a57-adc7-80c55d178086] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:02:54.672369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-085bfeff-cd7a-4cba-9aa9-469a88eee486 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:54.672864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-085bfeff-cd7a-4cba-9aa9-469a88eee486 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:54.673317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-085bfeff-cd7a-4cba-9aa9-469a88eee486 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:54.674083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-085bfeff-cd7a-4cba-9aa9-469a88eee486 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:54.674574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-085bfeff-cd7a-4cba-9aa9-469a88eee486 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:54.675051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-085bfeff-cd7a-4cba-9aa9-469a88eee486 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:54.763841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-085bfeff-cd7a-4cba-9aa9-469a88eee486 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:02:54.770863 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-085bfeff-cd7a-4cba-9aa9-469a88eee486 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086" status: 200 len: 1298 microversion: 2.1 time: 0.110499 Oct 11 00:02:54.771524 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3353/6536] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:02:54 2022] GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086 => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:02:55.799149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ece1f074-18e4-406f-a419-7bfd2c484f05 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:02:55.799863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ece1f074-18e4-406f-a419-7bfd2c484f05 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 75b60743-a9de-4a57-adc7-80c55d178086] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:02:55.807846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ece1f074-18e4-406f-a419-7bfd2c484f05 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:55.808342 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ece1f074-18e4-406f-a419-7bfd2c484f05 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:55.808979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ece1f074-18e4-406f-a419-7bfd2c484f05 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:55.809733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ece1f074-18e4-406f-a419-7bfd2c484f05 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:55.810309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ece1f074-18e4-406f-a419-7bfd2c484f05 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:55.810731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ece1f074-18e4-406f-a419-7bfd2c484f05 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:55.912443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ece1f074-18e4-406f-a419-7bfd2c484f05 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:02:55.920986 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ece1f074-18e4-406f-a419-7bfd2c484f05 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086" status: 200 len: 1470 microversion: 2.1 time: 0.128480 Oct 11 00:02:55.921812 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3184/6537] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:02:55 2022] GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086 => generated 1470 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:02:55.945768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a268a02b-b29a-43f2-9f13-0ca8a8d4be4f tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:02:55.946645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a268a02b-b29a-43f2-9f13-0ca8a8d4be4f tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 75b60743-a9de-4a57-adc7-80c55d178086] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:02:55.954537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a268a02b-b29a-43f2-9f13-0ca8a8d4be4f tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:55.955032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a268a02b-b29a-43f2-9f13-0ca8a8d4be4f tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:55.955473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a268a02b-b29a-43f2-9f13-0ca8a8d4be4f tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:55.956195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a268a02b-b29a-43f2-9f13-0ca8a8d4be4f tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:55.956646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a268a02b-b29a-43f2-9f13-0ca8a8d4be4f tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:55.957077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a268a02b-b29a-43f2-9f13-0ca8a8d4be4f tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:56.061033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a268a02b-b29a-43f2-9f13-0ca8a8d4be4f tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:02:56.070287 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a268a02b-b29a-43f2-9f13-0ca8a8d4be4f tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086" status: 200 len: 1470 microversion: 2.1 time: 0.129400 Oct 11 00:02:56.071025 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3354/6538] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:02:55 2022] GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086 => generated 1470 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:02:56.095144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-974ba779-06fb-4dee-a148-2764277f9095 tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:02:56.095760 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-974ba779-06fb-4dee-a148-2764277f9095 tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] [instance: 75b60743-a9de-4a57-adc7-80c55d178086] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:02:56.102483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-974ba779-06fb-4dee-a148-2764277f9095 tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:56.102956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-974ba779-06fb-4dee-a148-2764277f9095 tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:56.103416 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-974ba779-06fb-4dee-a148-2764277f9095 tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:56.105072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-974ba779-06fb-4dee-a148-2764277f9095 tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:56.105667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-974ba779-06fb-4dee-a148-2764277f9095 tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:56.106028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-974ba779-06fb-4dee-a148-2764277f9095 tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:56.199745 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-974ba779-06fb-4dee-a148-2764277f9095 tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086" status: 200 len: 1621 microversion: 2.1 time: 0.108347 Oct 11 00:02:56.200368 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3185/6539] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:02:56 2022] GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086 => generated 1621 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:02:56.223711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8537f6bf-4f56-4a0b-98f0-1af4b82de15e tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:02:56.224335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8537f6bf-4f56-4a0b-98f0-1af4b82de15e tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] [instance: 093acac2-d2fe-4fa6-9345-e3c99fc28abf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:02:56.231303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8537f6bf-4f56-4a0b-98f0-1af4b82de15e tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:56.231794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8537f6bf-4f56-4a0b-98f0-1af4b82de15e tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:56.232234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8537f6bf-4f56-4a0b-98f0-1af4b82de15e tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:56.232985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8537f6bf-4f56-4a0b-98f0-1af4b82de15e tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:56.233621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8537f6bf-4f56-4a0b-98f0-1af4b82de15e tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:56.234064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8537f6bf-4f56-4a0b-98f0-1af4b82de15e tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:56.388502 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8537f6bf-4f56-4a0b-98f0-1af4b82de15e tempest-TestSecurityGroupsBasicOps-246751678 tempest-TestSecurityGroupsBasicOps-246751678-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf" status: 200 len: 1913 microversion: 2.1 time: 0.168426 Oct 11 00:02:56.389034 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3355/6540] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:02:56 2022] GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf => generated 1913 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:02:56.471568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2096cacf-1092-4bb9-8fcb-f165fd059698 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:02:56.472071 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2096cacf-1092-4bb9-8fcb-f165fd059698 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 75b60743-a9de-4a57-adc7-80c55d178086] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:02:56.484446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2096cacf-1092-4bb9-8fcb-f165fd059698 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:56.484948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2096cacf-1092-4bb9-8fcb-f165fd059698 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:56.485412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2096cacf-1092-4bb9-8fcb-f165fd059698 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:56.486129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2096cacf-1092-4bb9-8fcb-f165fd059698 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:56.486592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2096cacf-1092-4bb9-8fcb-f165fd059698 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:56.487025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2096cacf-1092-4bb9-8fcb-f165fd059698 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:56.515338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2096cacf-1092-4bb9-8fcb-f165fd059698 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 75b60743-a9de-4a57-adc7-80c55d178086] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:02:56.607069 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2096cacf-1092-4bb9-8fcb-f165fd059698 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "DELETE /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086" status: 204 len: 0 microversion: 2.1 time: 0.138801 Oct 11 00:02:56.608232 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3186/6541] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:02:56 2022] DELETE /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:02:56.618566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4fc6aa54-33a2-441f-9ffc-3cf4c07fdd56 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:02:56.618897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4fc6aa54-33a2-441f-9ffc-3cf4c07fdd56 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 75b60743-a9de-4a57-adc7-80c55d178086] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:02:56.626370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fc6aa54-33a2-441f-9ffc-3cf4c07fdd56 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:56.627152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fc6aa54-33a2-441f-9ffc-3cf4c07fdd56 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:56.627594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fc6aa54-33a2-441f-9ffc-3cf4c07fdd56 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:56.628314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fc6aa54-33a2-441f-9ffc-3cf4c07fdd56 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:56.628773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fc6aa54-33a2-441f-9ffc-3cf4c07fdd56 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:56.629196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4fc6aa54-33a2-441f-9ffc-3cf4c07fdd56 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:56.733521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4fc6aa54-33a2-441f-9ffc-3cf4c07fdd56 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:02:56.742018 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4fc6aa54-33a2-441f-9ffc-3cf4c07fdd56 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086" status: 200 len: 1476 microversion: 2.1 time: 0.128635 Oct 11 00:02:56.742733 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3356/6542] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:02:56 2022] GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086 => generated 1476 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:02:57.770470 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5f1da432-3318-42f0-b0b7-ec530244f307 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:02:57.771225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5f1da432-3318-42f0-b0b7-ec530244f307 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 75b60743-a9de-4a57-adc7-80c55d178086] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:02:57.779135 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f1da432-3318-42f0-b0b7-ec530244f307 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:57.779649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f1da432-3318-42f0-b0b7-ec530244f307 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:57.780082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f1da432-3318-42f0-b0b7-ec530244f307 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:57.780795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f1da432-3318-42f0-b0b7-ec530244f307 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:57.781254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f1da432-3318-42f0-b0b7-ec530244f307 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:57.781731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f1da432-3318-42f0-b0b7-ec530244f307 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:57.893285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5f1da432-3318-42f0-b0b7-ec530244f307 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:02:57.908047 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5f1da432-3318-42f0-b0b7-ec530244f307 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086" status: 200 len: 1476 microversion: 2.1 time: 0.141510 Oct 11 00:02:57.908993 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3187/6543] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:02:57 2022] GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086 => generated 1476 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:02:58.509560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-66c5b02c-9841-4a6e-bf59-6b2450089772 req-e14386ff-893e-4f41-a83a-5ccacc298920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b60743-a9de-4a57-adc7-80c55d178086", "name": "network-vif-deleted", "tag": "770a7e90-27f8-4e52-88a8-d197a4a53d4f"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:02:58.534314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-66c5b02c-9841-4a6e-bf59-6b2450089772 req-e14386ff-893e-4f41-a83a-5ccacc298920 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:58.534314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-66c5b02c-9841-4a6e-bf59-6b2450089772 req-e14386ff-893e-4f41-a83a-5ccacc298920 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:58.534314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-66c5b02c-9841-4a6e-bf59-6b2450089772 req-e14386ff-893e-4f41-a83a-5ccacc298920 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:58.539379 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-66c5b02c-9841-4a6e-bf59-6b2450089772 req-e14386ff-893e-4f41-a83a-5ccacc298920 service nova] Creating event network-vif-deleted:770a7e90-27f8-4e52-88a8-d197a4a53d4f for instance 75b60743-a9de-4a57-adc7-80c55d178086 on n-h1-860864-2 Oct 11 00:02:58.545909 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-66c5b02c-9841-4a6e-bf59-6b2450089772 req-e14386ff-893e-4f41-a83a-5ccacc298920 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041159 Oct 11 00:02:58.549808 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3357/6544] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:02:58.944376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dc0de0fe-db03-45d0-952f-e52f768d7445 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:02:58.945503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dc0de0fe-db03-45d0-952f-e52f768d7445 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 75b60743-a9de-4a57-adc7-80c55d178086] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:02:58.956174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc0de0fe-db03-45d0-952f-e52f768d7445 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:58.956677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc0de0fe-db03-45d0-952f-e52f768d7445 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:58.957244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc0de0fe-db03-45d0-952f-e52f768d7445 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:58.958038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc0de0fe-db03-45d0-952f-e52f768d7445 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:58.958497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc0de0fe-db03-45d0-952f-e52f768d7445 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:58.958961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc0de0fe-db03-45d0-952f-e52f768d7445 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:58.998682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc0de0fe-db03-45d0-952f-e52f768d7445 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:02:58.999191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc0de0fe-db03-45d0-952f-e52f768d7445 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:02:59.001410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc0de0fe-db03-45d0-952f-e52f768d7445 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:02:59.001410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-dc0de0fe-db03-45d0-952f-e52f768d7445 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lazy-loading 'fault' on Instance uuid 75b60743-a9de-4a57-adc7-80c55d178086 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:02:59.046326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dc0de0fe-db03-45d0-952f-e52f768d7445 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:02:59.055376 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dc0de0fe-db03-45d0-952f-e52f768d7445 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086" status: 200 len: 1330 microversion: 2.1 time: 0.114993 Oct 11 00:02:59.056385 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3188/6545] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:02:58 2022] GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086 => generated 1330 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:00.086153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4f506bbe-e2ed-4c1a-a5c0-462a27aba999 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:00.086772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4f506bbe-e2ed-4c1a-a5c0-462a27aba999 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 75b60743-a9de-4a57-adc7-80c55d178086] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:00.093702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f506bbe-e2ed-4c1a-a5c0-462a27aba999 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:00.094193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f506bbe-e2ed-4c1a-a5c0-462a27aba999 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:00.094634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f506bbe-e2ed-4c1a-a5c0-462a27aba999 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:00.095334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f506bbe-e2ed-4c1a-a5c0-462a27aba999 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:00.095788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f506bbe-e2ed-4c1a-a5c0-462a27aba999 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:00.096216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4f506bbe-e2ed-4c1a-a5c0-462a27aba999 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:00.110382 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-4f506bbe-e2ed-4c1a-a5c0-462a27aba999 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] HTTP exception thrown: Instance 75b60743-a9de-4a57-adc7-80c55d178086 could not be found. Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4f506bbe-e2ed-4c1a-a5c0-462a27aba999 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Request method failure captured: Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086 HTTP/1.1 Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLJblgE9zBdyKRBDcLGqAwK86tg_H4BgFZfpYy9A73LT_LvD3Joye25OjfWsQKWNNG-4o99_TNhhXzw7fjHJznGJfV3pQDyLzX4Z-hpM04h-NhPGwS3tnAdcsh1oK3N7xBWpeyNFFQzof5cixANwG6_qdV9dpdC9OkFx0t0z0gjWqT4 Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: ce8b145e66094858841c169fc336aced Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1371459610 Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ce8b145e66094858841c169fc336aced"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ce8b145e66094858841c169fc336aced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ce8b145e66094858841c169fc336aced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ce8b145e66094858841c169fc336aced", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1371459610 Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: ce8b145e66094858841c169fc336aced Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1371459610 Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestSecurityGroupsBasicOps-1371459610-project Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: ecf61f7621114c2fa5a809caf8303b65 Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1371459610-project Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 75b60743-a9de-4a57-adc7-80c55d178086 could not be found. Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '75b60743-a9de-4a57-adc7-80c55d178086'} Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75b60743-a9de-4a57-adc7-80c55d178086 could not be found. Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75b60743-a9de-4a57-adc7-80c55d178086 could not be found. Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:03:00.112013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:03:00.119430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:03:00.119430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:03:00.119430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:03:00.119430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:03:00.119430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:03:00.119430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:03:00.119430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75b60743-a9de-4a57-adc7-80c55d178086 could not be found. Oct 11 00:03:00.119430 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:03:00.119430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4f506bbe-e2ed-4c1a-a5c0-462a27aba999 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Returning 404 to user: Instance 75b60743-a9de-4a57-adc7-80c55d178086 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:03:00.119430 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4f506bbe-e2ed-4c1a-a5c0-462a27aba999 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086" status: 404 len: 111 microversion: 2.1 time: 0.032954 Oct 11 00:03:00.119430 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3358/6546] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:00 2022] GET /compute/v2.1/servers/75b60743-a9de-4a57-adc7-80c55d178086 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:03:05.416380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f7f43116-dad1-4363-825a-433c9597a093 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:05.417580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f7f43116-dad1-4363-825a-433c9597a093 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 093acac2-d2fe-4fa6-9345-e3c99fc28abf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:05.437230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7f43116-dad1-4363-825a-433c9597a093 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:05.438005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7f43116-dad1-4363-825a-433c9597a093 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:05.438757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7f43116-dad1-4363-825a-433c9597a093 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:05.439646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7f43116-dad1-4363-825a-433c9597a093 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:05.441285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7f43116-dad1-4363-825a-433c9597a093 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:05.442099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7f43116-dad1-4363-825a-433c9597a093 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:05.474863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f7f43116-dad1-4363-825a-433c9597a093 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 093acac2-d2fe-4fa6-9345-e3c99fc28abf] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:03:05.582542 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f7f43116-dad1-4363-825a-433c9597a093 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "DELETE /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf" status: 204 len: 0 microversion: 2.1 time: 0.170227 Oct 11 00:03:05.583840 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3189/6547] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:03:05 2022] DELETE /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:03:05.596834 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b1de51be-a030-4954-9a3d-14808fe186ed tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:05.597985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b1de51be-a030-4954-9a3d-14808fe186ed tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 093acac2-d2fe-4fa6-9345-e3c99fc28abf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:05.608620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1de51be-a030-4954-9a3d-14808fe186ed tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:05.610130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1de51be-a030-4954-9a3d-14808fe186ed tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:05.611058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1de51be-a030-4954-9a3d-14808fe186ed tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:05.612543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1de51be-a030-4954-9a3d-14808fe186ed tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:05.613287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1de51be-a030-4954-9a3d-14808fe186ed tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:05.613935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b1de51be-a030-4954-9a3d-14808fe186ed tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:05.770812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-a9ca6b71-7798-4a08-a125-fee46a3f5ac1 req-d1eeb141-9a8b-4788-a9b7-883ec15b2675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "093acac2-d2fe-4fa6-9345-e3c99fc28abf", "tag": "7d91d4f1-4d31-49a2-bfdf-261c6c2f586c"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:03:05.798527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a9ca6b71-7798-4a08-a125-fee46a3f5ac1 req-d1eeb141-9a8b-4788-a9b7-883ec15b2675 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:05.798947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a9ca6b71-7798-4a08-a125-fee46a3f5ac1 req-d1eeb141-9a8b-4788-a9b7-883ec15b2675 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:05.799392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a9ca6b71-7798-4a08-a125-fee46a3f5ac1 req-d1eeb141-9a8b-4788-a9b7-883ec15b2675 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:05.830893 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a9ca6b71-7798-4a08-a125-fee46a3f5ac1 req-d1eeb141-9a8b-4788-a9b7-883ec15b2675 service nova] Creating event network-changed:7d91d4f1-4d31-49a2-bfdf-261c6c2f586c for instance 093acac2-d2fe-4fa6-9345-e3c99fc28abf on n-h2-860864-2 Oct 11 00:03:05.847265 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-a9ca6b71-7798-4a08-a125-fee46a3f5ac1 req-d1eeb141-9a8b-4788-a9b7-883ec15b2675 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.420048 Oct 11 00:03:05.850983 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3359/6548] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:03:05.877328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b1de51be-a030-4954-9a3d-14808fe186ed tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:05.886094 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b1de51be-a030-4954-9a3d-14808fe186ed tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf" status: 200 len: 1768 microversion: 2.1 time: 0.294987 Oct 11 00:03:05.887444 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3190/6549] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:05 2022] GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf => generated 1768 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:06.914925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f3393eef-9f7a-45d0-ad56-20e8dcac0ae2 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:06.917394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f3393eef-9f7a-45d0-ad56-20e8dcac0ae2 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 093acac2-d2fe-4fa6-9345-e3c99fc28abf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:06.926218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3393eef-9f7a-45d0-ad56-20e8dcac0ae2 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:06.927682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3393eef-9f7a-45d0-ad56-20e8dcac0ae2 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:06.928302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3393eef-9f7a-45d0-ad56-20e8dcac0ae2 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:06.929230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3393eef-9f7a-45d0-ad56-20e8dcac0ae2 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:06.930152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3393eef-9f7a-45d0-ad56-20e8dcac0ae2 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:06.931053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f3393eef-9f7a-45d0-ad56-20e8dcac0ae2 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:07.112748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f3393eef-9f7a-45d0-ad56-20e8dcac0ae2 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:07.124878 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f3393eef-9f7a-45d0-ad56-20e8dcac0ae2 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf" status: 200 len: 1768 microversion: 2.1 time: 0.216514 Oct 11 00:03:07.125812 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3360/6550] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:06 2022] GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf => generated 1768 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:07.867279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-ce8bcb62-1311-4630-8cd1-5ff423f1bfad req-74320ded-310a-4462-9431-03092e322197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "093acac2-d2fe-4fa6-9345-e3c99fc28abf", "name": "network-vif-deleted", "tag": "7d91d4f1-4d31-49a2-bfdf-261c6c2f586c"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:03:07.883053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ce8bcb62-1311-4630-8cd1-5ff423f1bfad req-74320ded-310a-4462-9431-03092e322197 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:07.884640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ce8bcb62-1311-4630-8cd1-5ff423f1bfad req-74320ded-310a-4462-9431-03092e322197 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:07.885429 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ce8bcb62-1311-4630-8cd1-5ff423f1bfad req-74320ded-310a-4462-9431-03092e322197 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:07.893433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:03:07.905122 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-ce8bcb62-1311-4630-8cd1-5ff423f1bfad req-74320ded-310a-4462-9431-03092e322197 service nova] Creating event network-vif-deleted:7d91d4f1-4d31-49a2-bfdf-261c6c2f586c for instance 093acac2-d2fe-4fa6-9345-e3c99fc28abf on n-h2-860864-2 Oct 11 00:03:07.913317 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-ce8bcb62-1311-4630-8cd1-5ff423f1bfad req-74320ded-310a-4462-9431-03092e322197 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050743 Oct 11 00:03:07.913993 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3191/6551] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:03:08.151359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fa27c7a7-bc6b-4027-abd1-5ef54937476d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:08.152371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fa27c7a7-bc6b-4027-abd1-5ef54937476d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 093acac2-d2fe-4fa6-9345-e3c99fc28abf] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:08.163352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa27c7a7-bc6b-4027-abd1-5ef54937476d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:08.163750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa27c7a7-bc6b-4027-abd1-5ef54937476d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:08.164399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa27c7a7-bc6b-4027-abd1-5ef54937476d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:08.165260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa27c7a7-bc6b-4027-abd1-5ef54937476d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:08.166041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa27c7a7-bc6b-4027-abd1-5ef54937476d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:08.166506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa27c7a7-bc6b-4027-abd1-5ef54937476d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:08.222034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa27c7a7-bc6b-4027-abd1-5ef54937476d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:08.222524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa27c7a7-bc6b-4027-abd1-5ef54937476d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:08.222959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa27c7a7-bc6b-4027-abd1-5ef54937476d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:08.223415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-fa27c7a7-bc6b-4027-abd1-5ef54937476d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lazy-loading 'fault' on Instance uuid 093acac2-d2fe-4fa6-9345-e3c99fc28abf {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:03:08.292500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fa27c7a7-bc6b-4027-abd1-5ef54937476d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf61f7621114c2fa5a809caf8303b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8b145e66094858841c169fc336aced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:08.300846 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fa27c7a7-bc6b-4027-abd1-5ef54937476d tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf" status: 200 len: 1384 microversion: 2.1 time: 0.155353 Oct 11 00:03:08.301677 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3361/6552] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:08 2022] GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf => generated 1384 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:09.327682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-34fe3214-ae02-4b0d-8ac6-e8153b7d0930 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:09.329410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-34fe3214-ae02-4b0d-8ac6-e8153b7d0930 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] [instance: 093acac2-d2fe-4fa6-9345-e3c99fc28abf] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:09.331876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:03:09.340422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34fe3214-ae02-4b0d-8ac6-e8153b7d0930 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:09.341048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34fe3214-ae02-4b0d-8ac6-e8153b7d0930 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:09.341652 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34fe3214-ae02-4b0d-8ac6-e8153b7d0930 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:09.342554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34fe3214-ae02-4b0d-8ac6-e8153b7d0930 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:09.343075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34fe3214-ae02-4b0d-8ac6-e8153b7d0930 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:09.343890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34fe3214-ae02-4b0d-8ac6-e8153b7d0930 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:09.361623 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-34fe3214-ae02-4b0d-8ac6-e8153b7d0930 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] HTTP exception thrown: Instance 093acac2-d2fe-4fa6-9345-e3c99fc28abf could not be found. Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-34fe3214-ae02-4b0d-8ac6-e8153b7d0930 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Request method failure captured: Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf HTTP/1.1 Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLJblgE9zBdyKRBDcLGqAwK86tg_H4BgFZfpYy9A73LT_LvD3Joye25OjfWsQKWNNG-4o99_TNhhXzw7fjHJznGJfV3pQDyLzX4Z-hpM04h-NhPGwS3tnAdcsh1oK3N7xBWpeyNFFQzof5cixANwG6_qdV9dpdC9OkFx0t0z0gjWqT4 Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: ce8b145e66094858841c169fc336aced Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1371459610 Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ce8b145e66094858841c169fc336aced"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ce8b145e66094858841c169fc336aced"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ce8b145e66094858841c169fc336aced"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ce8b145e66094858841c169fc336aced", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1371459610 Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: ce8b145e66094858841c169fc336aced Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1371459610 Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TestSecurityGroupsBasicOps-1371459610-project Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: ecf61f7621114c2fa5a809caf8303b65 Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1371459610-project Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 093acac2-d2fe-4fa6-9345-e3c99fc28abf could not be found. Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '093acac2-d2fe-4fa6-9345-e3c99fc28abf'} Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 093acac2-d2fe-4fa6-9345-e3c99fc28abf could not be found. Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 093acac2-d2fe-4fa6-9345-e3c99fc28abf could not be found. Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:03:09.363690 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:03:09.372035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:03:09.372035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:03:09.372035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:03:09.372035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:03:09.372035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:03:09.372035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:03:09.372035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 093acac2-d2fe-4fa6-9345-e3c99fc28abf could not be found. Oct 11 00:03:09.372035 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:03:09.372035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-34fe3214-ae02-4b0d-8ac6-e8153b7d0930 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Returning 404 to user: Instance 093acac2-d2fe-4fa6-9345-e3c99fc28abf could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:03:09.372035 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-34fe3214-ae02-4b0d-8ac6-e8153b7d0930 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf" status: 404 len: 111 microversion: 2.1 time: 0.044177 Oct 11 00:03:09.372035 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3192/6553] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:09 2022] GET /compute/v2.1/servers/093acac2-d2fe-4fa6-9345-e3c99fc28abf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:03:13.177469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-be083e69-8cdf-479c-8540-e50bc3f5c6e9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] Calling method '.version_select at 0x7f662a56f8b0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:13.183150 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:03:13.183404 n-d-860864-2 devstack@n-api.service[120613]: Tue Oct 11 00:03:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-957040439 (ip 10.222.0.23) !!! Oct 11 00:03:13.189084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=39 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:03:13.215538 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-be083e69-8cdf-479c-8540-e50bc3f5c6e9 tempest-TestSecurityGroupsBasicOps-1371459610 tempest-TestSecurityGroupsBasicOps-1371459610-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-957040439" status: 202 len: 0 microversion: 2.1 time: 0.041878 Oct 11 00:03:13.216267 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3362/6554] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 11 00:03:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-957040439 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:03:19.349843 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:03:19.384926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c9c82d95-c82a-4250-8a85-7fe7408331ad tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-2102439167", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "ab8f91c4-cb55-4140-a1aa-88d6db281479"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:03:19.444435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-c9c82d95-c82a-4250-8a85-7fe7408331ad tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] validate_networks() for [('ab8f91c4-cb55-4140-a1aa-88d6db281479', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:03:20.135115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c9c82d95-c82a-4250-8a85-7fe7408331ad tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:03:20.136030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c9c82d95-c82a-4250-8a85-7fe7408331ad tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:03:20.136533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c9c82d95-c82a-4250-8a85-7fe7408331ad tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:03:20.136941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c9c82d95-c82a-4250-8a85-7fe7408331ad tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:03:20.137458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c9c82d95-c82a-4250-8a85-7fe7408331ad tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:03:20.158548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9c82d95-c82a-4250-8a85-7fe7408331ad tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:20.159379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9c82d95-c82a-4250-8a85-7fe7408331ad tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:20.159829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9c82d95-c82a-4250-8a85-7fe7408331ad tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:20.160810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9c82d95-c82a-4250-8a85-7fe7408331ad tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:20.161501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9c82d95-c82a-4250-8a85-7fe7408331ad tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:20.163199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c9c82d95-c82a-4250-8a85-7fe7408331ad tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:20.186043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-c9c82d95-c82a-4250-8a85-7fe7408331ad tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Getting quotas for project 7720f7fff5ca4cdfac4ceb36db3d8a32. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:03:20.192042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-c9c82d95-c82a-4250-8a85-7fe7408331ad tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Getting quotas for user 6f4fa3cc7b924b36847f10974e801e43 and project 7720f7fff5ca4cdfac4ceb36db3d8a32. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:03:20.208072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c9c82d95-c82a-4250-8a85-7fe7408331ad tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:03:20.212353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c9c82d95-c82a-4250-8a85-7fe7408331ad tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:03:20.282708 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c9c82d95-c82a-4250-8a85-7fe7408331ad tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.241007 Oct 11 00:03:20.284555 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3193/6555] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:03:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:03:20.298496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=70 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:03:20.303601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d1fd2887-4607-49ea-997d-98381b259cb9 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:20.304904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d1fd2887-4607-49ea-997d-98381b259cb9 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:20.402505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d1fd2887-4607-49ea-997d-98381b259cb9 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:20.413395 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d1fd2887-4607-49ea-997d-98381b259cb9 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1215 microversion: 2.1 time: 0.116730 Oct 11 00:03:20.414251 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3363/6556] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:20 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1215 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:21.438807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7eb1b60b-b7fb-4a0f-ace0-8cf28b3ada49 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:21.439439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7eb1b60b-b7fb-4a0f-ace0-8cf28b3ada49 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:21.447779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7eb1b60b-b7fb-4a0f-ace0-8cf28b3ada49 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:21.448276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7eb1b60b-b7fb-4a0f-ace0-8cf28b3ada49 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:21.448718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7eb1b60b-b7fb-4a0f-ace0-8cf28b3ada49 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:21.449447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7eb1b60b-b7fb-4a0f-ace0-8cf28b3ada49 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:21.449932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7eb1b60b-b7fb-4a0f-ace0-8cf28b3ada49 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:21.450348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7eb1b60b-b7fb-4a0f-ace0-8cf28b3ada49 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:21.539183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7eb1b60b-b7fb-4a0f-ace0-8cf28b3ada49 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:21.549241 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7eb1b60b-b7fb-4a0f-ace0-8cf28b3ada49 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1267 microversion: 2.1 time: 0.114849 Oct 11 00:03:21.552404 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3194/6557] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:21 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1267 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:03:22.578762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4793ade5-2138-4cbd-b0fb-441954be55a8 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:22.579823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4793ade5-2138-4cbd-b0fb-441954be55a8 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:22.590525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4793ade5-2138-4cbd-b0fb-441954be55a8 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:22.591083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4793ade5-2138-4cbd-b0fb-441954be55a8 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:22.592338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4793ade5-2138-4cbd-b0fb-441954be55a8 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:22.593916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4793ade5-2138-4cbd-b0fb-441954be55a8 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:22.595065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4793ade5-2138-4cbd-b0fb-441954be55a8 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:22.596166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4793ade5-2138-4cbd-b0fb-441954be55a8 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:22.787187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4793ade5-2138-4cbd-b0fb-441954be55a8 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:22.801018 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4793ade5-2138-4cbd-b0fb-441954be55a8 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1315 microversion: 2.1 time: 0.227718 Oct 11 00:03:22.801951 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3364/6558] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:22 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:23.388407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-935e2b77-1e3c-4bd0-90e0-75abf08f98e2 req-96c47266-20f0-4e83-8f84-c6f0c97177f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6", "tag": "08fc0ed7-fd80-4805-b1e6-806df442bd4f"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:03:23.404156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-935e2b77-1e3c-4bd0-90e0-75abf08f98e2 req-96c47266-20f0-4e83-8f84-c6f0c97177f3 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:23.405082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-935e2b77-1e3c-4bd0-90e0-75abf08f98e2 req-96c47266-20f0-4e83-8f84-c6f0c97177f3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:23.405572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-935e2b77-1e3c-4bd0-90e0-75abf08f98e2 req-96c47266-20f0-4e83-8f84-c6f0c97177f3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:23.424478 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-935e2b77-1e3c-4bd0-90e0-75abf08f98e2 req-96c47266-20f0-4e83-8f84-c6f0c97177f3 service nova] Creating event network-changed:08fc0ed7-fd80-4805-b1e6-806df442bd4f for instance a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 on n-h2-860864-2 Oct 11 00:03:23.431484 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-935e2b77-1e3c-4bd0-90e0-75abf08f98e2 req-96c47266-20f0-4e83-8f84-c6f0c97177f3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047916 Oct 11 00:03:23.433008 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3195/6559] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:03:23.826123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e5f198d7-4922-45af-a7ff-a49ff73a30ba tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:23.827375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e5f198d7-4922-45af-a7ff-a49ff73a30ba tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:23.835369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5f198d7-4922-45af-a7ff-a49ff73a30ba tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:23.836222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5f198d7-4922-45af-a7ff-a49ff73a30ba tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:23.837010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5f198d7-4922-45af-a7ff-a49ff73a30ba tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:23.838019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5f198d7-4922-45af-a7ff-a49ff73a30ba tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:23.838711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5f198d7-4922-45af-a7ff-a49ff73a30ba tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:23.839369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5f198d7-4922-45af-a7ff-a49ff73a30ba tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:23.981413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e5f198d7-4922-45af-a7ff-a49ff73a30ba tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:23.989514 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e5f198d7-4922-45af-a7ff-a49ff73a30ba tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1315 microversion: 2.1 time: 0.167490 Oct 11 00:03:23.990113 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3365/6560] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:23 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:25.013741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-50ed9d02-dae6-4f65-a486-f5804fac30f9 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:25.014631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-50ed9d02-dae6-4f65-a486-f5804fac30f9 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:25.022828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50ed9d02-dae6-4f65-a486-f5804fac30f9 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:25.023446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50ed9d02-dae6-4f65-a486-f5804fac30f9 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:25.024026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50ed9d02-dae6-4f65-a486-f5804fac30f9 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:25.024852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50ed9d02-dae6-4f65-a486-f5804fac30f9 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:25.025460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50ed9d02-dae6-4f65-a486-f5804fac30f9 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:25.025896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50ed9d02-dae6-4f65-a486-f5804fac30f9 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:25.519559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-50ed9d02-dae6-4f65-a486-f5804fac30f9 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:25.529004 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-50ed9d02-dae6-4f65-a486-f5804fac30f9 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1315 microversion: 2.1 time: 0.519739 Oct 11 00:03:25.545398 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3196/6561] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:25 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:26.554681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-808b8388-aaa7-4c19-a538-8be170d529c0 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:26.555248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-808b8388-aaa7-4c19-a538-8be170d529c0 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:26.562186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-808b8388-aaa7-4c19-a538-8be170d529c0 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:26.562670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-808b8388-aaa7-4c19-a538-8be170d529c0 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:26.563103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-808b8388-aaa7-4c19-a538-8be170d529c0 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:26.563794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-808b8388-aaa7-4c19-a538-8be170d529c0 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:26.564246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-808b8388-aaa7-4c19-a538-8be170d529c0 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:26.564672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-808b8388-aaa7-4c19-a538-8be170d529c0 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:26.705939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-808b8388-aaa7-4c19-a538-8be170d529c0 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:26.714026 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-808b8388-aaa7-4c19-a538-8be170d529c0 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1315 microversion: 2.1 time: 0.164373 Oct 11 00:03:26.714605 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3366/6562] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:26 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:27.737879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6e7bfb1f-5f7c-4f6a-90e7-bff1bcf4c9b6 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:27.738671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6e7bfb1f-5f7c-4f6a-90e7-bff1bcf4c9b6 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:27.746645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e7bfb1f-5f7c-4f6a-90e7-bff1bcf4c9b6 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:27.747179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e7bfb1f-5f7c-4f6a-90e7-bff1bcf4c9b6 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:27.747848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e7bfb1f-5f7c-4f6a-90e7-bff1bcf4c9b6 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:27.748572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e7bfb1f-5f7c-4f6a-90e7-bff1bcf4c9b6 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:27.748885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e7bfb1f-5f7c-4f6a-90e7-bff1bcf4c9b6 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:27.749325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e7bfb1f-5f7c-4f6a-90e7-bff1bcf4c9b6 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:27.916913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6e7bfb1f-5f7c-4f6a-90e7-bff1bcf4c9b6 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:27.931278 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6e7bfb1f-5f7c-4f6a-90e7-bff1bcf4c9b6 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1315 microversion: 2.1 time: 0.197033 Oct 11 00:03:27.932334 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3197/6563] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:27 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:28.971136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-52aa1b69-a511-4e92-9cf1-28ab01c21a14 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:28.973130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-52aa1b69-a511-4e92-9cf1-28ab01c21a14 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:28.984387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52aa1b69-a511-4e92-9cf1-28ab01c21a14 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:28.984893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52aa1b69-a511-4e92-9cf1-28ab01c21a14 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:28.985350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52aa1b69-a511-4e92-9cf1-28ab01c21a14 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:28.986109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52aa1b69-a511-4e92-9cf1-28ab01c21a14 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:28.986570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52aa1b69-a511-4e92-9cf1-28ab01c21a14 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:28.987012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-52aa1b69-a511-4e92-9cf1-28ab01c21a14 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:29.143991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-52aa1b69-a511-4e92-9cf1-28ab01c21a14 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:29.155346 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-52aa1b69-a511-4e92-9cf1-28ab01c21a14 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1315 microversion: 2.1 time: 0.190179 Oct 11 00:03:29.156424 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3367/6564] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:28 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:30.180167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-189c1b4e-b7f9-4b1f-a96b-02e195d8d8fe tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:30.180953 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-189c1b4e-b7f9-4b1f-a96b-02e195d8d8fe tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:30.183787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:03:30.189260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-189c1b4e-b7f9-4b1f-a96b-02e195d8d8fe tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:30.189794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-189c1b4e-b7f9-4b1f-a96b-02e195d8d8fe tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:30.190266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-189c1b4e-b7f9-4b1f-a96b-02e195d8d8fe tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:30.190981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-189c1b4e-b7f9-4b1f-a96b-02e195d8d8fe tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:30.191441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-189c1b4e-b7f9-4b1f-a96b-02e195d8d8fe tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:30.191875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-189c1b4e-b7f9-4b1f-a96b-02e195d8d8fe tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:30.207629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:03:30.332233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-189c1b4e-b7f9-4b1f-a96b-02e195d8d8fe tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:30.340846 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-189c1b4e-b7f9-4b1f-a96b-02e195d8d8fe tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1315 microversion: 2.1 time: 0.164567 Oct 11 00:03:30.341451 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3198/6565] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:30 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:30.544196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:03:30.706161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-c2636580-6c88-4073-9140-a6308a57f596 req-c95c92a1-b48b-4166-8520-6227ebad57dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6", "name": "network-vif-plugged", "status": "completed", "tag": "08fc0ed7-fd80-4805-b1e6-806df442bd4f"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:03:30.719804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c2636580-6c88-4073-9140-a6308a57f596 req-c95c92a1-b48b-4166-8520-6227ebad57dd service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:30.720435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c2636580-6c88-4073-9140-a6308a57f596 req-c95c92a1-b48b-4166-8520-6227ebad57dd service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:30.720960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c2636580-6c88-4073-9140-a6308a57f596 req-c95c92a1-b48b-4166-8520-6227ebad57dd service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:30.736612 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-c2636580-6c88-4073-9140-a6308a57f596 req-c95c92a1-b48b-4166-8520-6227ebad57dd service nova] Creating event network-vif-plugged:08fc0ed7-fd80-4805-b1e6-806df442bd4f for instance a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 on n-h2-860864-2 Oct 11 00:03:30.743653 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-c2636580-6c88-4073-9140-a6308a57f596 req-c95c92a1-b48b-4166-8520-6227ebad57dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204670 Oct 11 00:03:30.744342 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3368/6566] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:03:31.367453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b8f98634-7950-4018-8c72-7a9704a0e29c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:31.368212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b8f98634-7950-4018-8c72-7a9704a0e29c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:31.375934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8f98634-7950-4018-8c72-7a9704a0e29c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:31.376434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8f98634-7950-4018-8c72-7a9704a0e29c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:31.376871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8f98634-7950-4018-8c72-7a9704a0e29c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:31.378272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8f98634-7950-4018-8c72-7a9704a0e29c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:31.378886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8f98634-7950-4018-8c72-7a9704a0e29c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:31.379317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8f98634-7950-4018-8c72-7a9704a0e29c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:31.527642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b8f98634-7950-4018-8c72-7a9704a0e29c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:31.536086 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b8f98634-7950-4018-8c72-7a9704a0e29c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1315 microversion: 2.1 time: 0.173877 Oct 11 00:03:31.536848 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3199/6567] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:31 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:32.561974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c6442f77-fbb2-41af-b556-e387eb25e202 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:32.562699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c6442f77-fbb2-41af-b556-e387eb25e202 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:32.569977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6442f77-fbb2-41af-b556-e387eb25e202 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:32.570481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6442f77-fbb2-41af-b556-e387eb25e202 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:32.570931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6442f77-fbb2-41af-b556-e387eb25e202 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:32.571638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6442f77-fbb2-41af-b556-e387eb25e202 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:32.572096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6442f77-fbb2-41af-b556-e387eb25e202 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:32.572531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6442f77-fbb2-41af-b556-e387eb25e202 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:32.752976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c6442f77-fbb2-41af-b556-e387eb25e202 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:32.763625 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c6442f77-fbb2-41af-b556-e387eb25e202 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1503 microversion: 2.1 time: 0.207052 Oct 11 00:03:32.764229 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3369/6568] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:32 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1503 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:32.789558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-48811ad2-e8f9-4aad-9339-447d04daa28f tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:32.790197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-48811ad2-e8f9-4aad-9339-447d04daa28f tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:32.797773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48811ad2-e8f9-4aad-9339-447d04daa28f tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:32.798271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48811ad2-e8f9-4aad-9339-447d04daa28f tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:32.798839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48811ad2-e8f9-4aad-9339-447d04daa28f tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:32.799579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48811ad2-e8f9-4aad-9339-447d04daa28f tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:32.800034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48811ad2-e8f9-4aad-9339-447d04daa28f tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:32.800457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-48811ad2-e8f9-4aad-9339-447d04daa28f tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:32.961100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-48811ad2-e8f9-4aad-9339-447d04daa28f tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:32.973251 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-48811ad2-e8f9-4aad-9339-447d04daa28f tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1503 microversion: 2.1 time: 0.188413 Oct 11 00:03:32.973999 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3200/6569] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:32 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1503 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:32.999861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9b03de9e-617a-4248-b296-386a3ec606ff tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:03:33.000407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9b03de9e-617a-4248-b296-386a3ec606ff tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:33.007622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b03de9e-617a-4248-b296-386a3ec606ff tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:33.008341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b03de9e-617a-4248-b296-386a3ec606ff tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:33.008924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b03de9e-617a-4248-b296-386a3ec606ff tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:33.009897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b03de9e-617a-4248-b296-386a3ec606ff tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:33.010474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b03de9e-617a-4248-b296-386a3ec606ff tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:33.010983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b03de9e-617a-4248-b296-386a3ec606ff tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:33.041840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-9b03de9e-617a-4248-b296-386a3ec606ff tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lazy-loading 'flavor' on Instance uuid a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:03:33.139452 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9b03de9e-617a-4248-b296-386a3ec606ff tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "POST /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6/action" status: 202 len: 0 microversion: 2.1 time: 0.144257 Oct 11 00:03:33.140316 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3370/6570] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:03:32 2022] POST /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:03:33.154049 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-90e10779-543f-4eb5-bb0a-78cb5996dfd5 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:33.155385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-90e10779-543f-4eb5-bb0a-78cb5996dfd5 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:33.167384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90e10779-543f-4eb5-bb0a-78cb5996dfd5 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:33.167952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90e10779-543f-4eb5-bb0a-78cb5996dfd5 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:33.168402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90e10779-543f-4eb5-bb0a-78cb5996dfd5 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:33.169775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90e10779-543f-4eb5-bb0a-78cb5996dfd5 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:33.170336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90e10779-543f-4eb5-bb0a-78cb5996dfd5 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:33.170782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90e10779-543f-4eb5-bb0a-78cb5996dfd5 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:33.358950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-90e10779-543f-4eb5-bb0a-78cb5996dfd5 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:33.368496 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-90e10779-543f-4eb5-bb0a-78cb5996dfd5 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1511 microversion: 2.1 time: 0.222224 Oct 11 00:03:33.369455 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3201/6571] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:33 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1511 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:34.396351 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-00c06f9a-0dc3-41a4-85ef-1a81d66faa76 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:34.398063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-00c06f9a-0dc3-41a4-85ef-1a81d66faa76 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:34.407495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00c06f9a-0dc3-41a4-85ef-1a81d66faa76 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:34.408353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00c06f9a-0dc3-41a4-85ef-1a81d66faa76 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:34.409120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00c06f9a-0dc3-41a4-85ef-1a81d66faa76 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:34.410382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00c06f9a-0dc3-41a4-85ef-1a81d66faa76 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:34.411188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00c06f9a-0dc3-41a4-85ef-1a81d66faa76 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:34.412527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00c06f9a-0dc3-41a4-85ef-1a81d66faa76 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:34.620311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-00c06f9a-0dc3-41a4-85ef-1a81d66faa76 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:34.629135 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-00c06f9a-0dc3-41a4-85ef-1a81d66faa76 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1494 microversion: 2.1 time: 0.239645 Oct 11 00:03:34.630156 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3371/6572] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:34 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1494 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:34.659777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-01a1c1dc-881e-4263-84b2-c31ee922d809 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:03:34.660986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-01a1c1dc-881e-4263-84b2-c31ee922d809 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:34.669619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01a1c1dc-881e-4263-84b2-c31ee922d809 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:34.670669 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01a1c1dc-881e-4263-84b2-c31ee922d809 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:34.671398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01a1c1dc-881e-4263-84b2-c31ee922d809 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:34.672744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01a1c1dc-881e-4263-84b2-c31ee922d809 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:34.673497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01a1c1dc-881e-4263-84b2-c31ee922d809 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:34.674174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-01a1c1dc-881e-4263-84b2-c31ee922d809 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:34.786093 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-01a1c1dc-881e-4263-84b2-c31ee922d809 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "POST /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6/action" status: 202 len: 0 microversion: 2.1 time: 0.136167 Oct 11 00:03:34.792264 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3202/6573] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:03:34 2022] POST /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:03:34.800032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3f5cfc3a-6689-43b5-80ed-2a0d25382f06 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:34.801664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3f5cfc3a-6689-43b5-80ed-2a0d25382f06 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:34.811699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f5cfc3a-6689-43b5-80ed-2a0d25382f06 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:34.813603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f5cfc3a-6689-43b5-80ed-2a0d25382f06 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:34.814842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f5cfc3a-6689-43b5-80ed-2a0d25382f06 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:34.816316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f5cfc3a-6689-43b5-80ed-2a0d25382f06 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:34.817517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f5cfc3a-6689-43b5-80ed-2a0d25382f06 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:34.818115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f5cfc3a-6689-43b5-80ed-2a0d25382f06 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:35.043445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3f5cfc3a-6689-43b5-80ed-2a0d25382f06 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:35.063469 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3f5cfc3a-6689-43b5-80ed-2a0d25382f06 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1500 microversion: 2.1 time: 0.269235 Oct 11 00:03:35.065294 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3372/6574] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:34 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1500 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:36.095305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-93bb44b0-f1d1-4a7e-8a8c-fff6edc9b29c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:36.096915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-93bb44b0-f1d1-4a7e-8a8c-fff6edc9b29c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:36.106592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93bb44b0-f1d1-4a7e-8a8c-fff6edc9b29c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:36.107367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93bb44b0-f1d1-4a7e-8a8c-fff6edc9b29c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:36.108121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93bb44b0-f1d1-4a7e-8a8c-fff6edc9b29c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:36.108846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93bb44b0-f1d1-4a7e-8a8c-fff6edc9b29c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:36.109504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93bb44b0-f1d1-4a7e-8a8c-fff6edc9b29c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:36.110079 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-93bb44b0-f1d1-4a7e-8a8c-fff6edc9b29c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:36.325012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-93bb44b0-f1d1-4a7e-8a8c-fff6edc9b29c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:36.341104 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-93bb44b0-f1d1-4a7e-8a8c-fff6edc9b29c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1500 microversion: 2.1 time: 0.253202 Oct 11 00:03:36.342646 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3203/6575] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:36 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1500 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:37.367059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-886114a9-f8a0-4e62-9a4f-9f018a4be448 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:37.367831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-886114a9-f8a0-4e62-9a4f-9f018a4be448 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:37.375168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-886114a9-f8a0-4e62-9a4f-9f018a4be448 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:37.375675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-886114a9-f8a0-4e62-9a4f-9f018a4be448 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:37.376119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-886114a9-f8a0-4e62-9a4f-9f018a4be448 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:37.376827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-886114a9-f8a0-4e62-9a4f-9f018a4be448 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:37.377291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-886114a9-f8a0-4e62-9a4f-9f018a4be448 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:37.377755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-886114a9-f8a0-4e62-9a4f-9f018a4be448 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:37.573734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-886114a9-f8a0-4e62-9a4f-9f018a4be448 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:37.585165 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-886114a9-f8a0-4e62-9a4f-9f018a4be448 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1503 microversion: 2.1 time: 0.223493 Oct 11 00:03:37.586382 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3373/6576] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:37 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1503 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:37.608741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-66beb31c-4d8d-493c-beb4-661dc3aaf631 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:03:37.609629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-66beb31c-4d8d-493c-beb4-661dc3aaf631 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:37.617455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66beb31c-4d8d-493c-beb4-661dc3aaf631 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:37.618242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66beb31c-4d8d-493c-beb4-661dc3aaf631 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:37.618690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66beb31c-4d8d-493c-beb4-661dc3aaf631 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:37.619410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66beb31c-4d8d-493c-beb4-661dc3aaf631 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:37.619881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66beb31c-4d8d-493c-beb4-661dc3aaf631 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:37.620317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66beb31c-4d8d-493c-beb4-661dc3aaf631 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:37.655522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-66beb31c-4d8d-493c-beb4-661dc3aaf631 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lazy-loading 'flavor' on Instance uuid a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:03:37.758971 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-66beb31c-4d8d-493c-beb4-661dc3aaf631 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "POST /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6/action" status: 202 len: 0 microversion: 2.1 time: 0.154010 Oct 11 00:03:37.763384 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3204/6577] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:03:37 2022] POST /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:03:37.774873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-17b53733-84d4-434f-9890-847a642e5173 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:37.776115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-17b53733-84d4-434f-9890-847a642e5173 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:37.787161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17b53733-84d4-434f-9890-847a642e5173 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:37.788169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17b53733-84d4-434f-9890-847a642e5173 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:37.789059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17b53733-84d4-434f-9890-847a642e5173 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:37.790725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17b53733-84d4-434f-9890-847a642e5173 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:37.791838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17b53733-84d4-434f-9890-847a642e5173 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:37.792526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17b53733-84d4-434f-9890-847a642e5173 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:37.992512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-17b53733-84d4-434f-9890-847a642e5173 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:38.005737 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-17b53733-84d4-434f-9890-847a642e5173 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1511 microversion: 2.1 time: 0.238972 Oct 11 00:03:38.006849 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3374/6578] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:37 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1511 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:03:39.049427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a6fcabdb-146c-46b1-b814-31df4a26139a tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:39.051283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a6fcabdb-146c-46b1-b814-31df4a26139a tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:39.068388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6fcabdb-146c-46b1-b814-31df4a26139a tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:39.070117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6fcabdb-146c-46b1-b814-31df4a26139a tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:39.071668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6fcabdb-146c-46b1-b814-31df4a26139a tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:39.074556 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6fcabdb-146c-46b1-b814-31df4a26139a tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:39.075764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6fcabdb-146c-46b1-b814-31df4a26139a tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:39.076844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6fcabdb-146c-46b1-b814-31df4a26139a tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:39.372883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a6fcabdb-146c-46b1-b814-31df4a26139a tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:39.389442 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a6fcabdb-146c-46b1-b814-31df4a26139a tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1494 microversion: 2.1 time: 0.348374 Oct 11 00:03:39.390553 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3205/6579] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:39 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1494 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:39.423041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3990fbd9-3326-46da-b3ba-ac873fe2830a tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:03:39.423877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3990fbd9-3326-46da-b3ba-ac873fe2830a tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:39.432640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3990fbd9-3326-46da-b3ba-ac873fe2830a tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:39.433449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3990fbd9-3326-46da-b3ba-ac873fe2830a tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:39.433623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3990fbd9-3326-46da-b3ba-ac873fe2830a tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:39.434363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3990fbd9-3326-46da-b3ba-ac873fe2830a tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:39.434832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3990fbd9-3326-46da-b3ba-ac873fe2830a tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:39.435761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3990fbd9-3326-46da-b3ba-ac873fe2830a tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:39.513352 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3990fbd9-3326-46da-b3ba-ac873fe2830a tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "POST /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6/action" status: 202 len: 0 microversion: 2.1 time: 0.094604 Oct 11 00:03:39.514054 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3375/6580] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:03:39 2022] POST /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:03:39.522847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c56da7d6-d6b5-4211-9eb5-ff9b41f3a78c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:39.523480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c56da7d6-d6b5-4211-9eb5-ff9b41f3a78c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:39.529935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c56da7d6-d6b5-4211-9eb5-ff9b41f3a78c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:39.530435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c56da7d6-d6b5-4211-9eb5-ff9b41f3a78c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:39.530881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c56da7d6-d6b5-4211-9eb5-ff9b41f3a78c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:39.531599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c56da7d6-d6b5-4211-9eb5-ff9b41f3a78c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:39.532066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c56da7d6-d6b5-4211-9eb5-ff9b41f3a78c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:39.532501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c56da7d6-d6b5-4211-9eb5-ff9b41f3a78c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:39.723407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c56da7d6-d6b5-4211-9eb5-ff9b41f3a78c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:39.732103 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c56da7d6-d6b5-4211-9eb5-ff9b41f3a78c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1500 microversion: 2.1 time: 0.213531 Oct 11 00:03:39.734023 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3206/6581] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:39 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1500 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:40.759719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fbdbb13a-9e2e-4379-935f-5752982cf2dc tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:40.760689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fbdbb13a-9e2e-4379-935f-5752982cf2dc tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:40.769946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fbdbb13a-9e2e-4379-935f-5752982cf2dc tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:40.771431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fbdbb13a-9e2e-4379-935f-5752982cf2dc tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:40.772061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fbdbb13a-9e2e-4379-935f-5752982cf2dc tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:40.772985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fbdbb13a-9e2e-4379-935f-5752982cf2dc tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:40.773648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fbdbb13a-9e2e-4379-935f-5752982cf2dc tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:40.774676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fbdbb13a-9e2e-4379-935f-5752982cf2dc tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:41.028300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fbdbb13a-9e2e-4379-935f-5752982cf2dc tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:41.037061 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fbdbb13a-9e2e-4379-935f-5752982cf2dc tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1500 microversion: 2.1 time: 0.283800 Oct 11 00:03:41.037872 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3376/6582] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:40 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1500 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:03:42.064727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a310bb9c-1302-47db-8f56-2d9b6396b41c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:42.068113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a310bb9c-1302-47db-8f56-2d9b6396b41c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:42.075638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a310bb9c-1302-47db-8f56-2d9b6396b41c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:42.076132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a310bb9c-1302-47db-8f56-2d9b6396b41c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:42.076571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a310bb9c-1302-47db-8f56-2d9b6396b41c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:42.077279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a310bb9c-1302-47db-8f56-2d9b6396b41c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:42.077867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a310bb9c-1302-47db-8f56-2d9b6396b41c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:42.078299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a310bb9c-1302-47db-8f56-2d9b6396b41c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:42.239966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a310bb9c-1302-47db-8f56-2d9b6396b41c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:42.247891 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a310bb9c-1302-47db-8f56-2d9b6396b41c tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1503 microversion: 2.1 time: 0.187541 Oct 11 00:03:42.248469 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3207/6583] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:42 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1503 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:42.271283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0954cc0f-ab42-40b1-8e6f-890e6e4dd26e tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:42.271994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0954cc0f-ab42-40b1-8e6f-890e6e4dd26e tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:42.278811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0954cc0f-ab42-40b1-8e6f-890e6e4dd26e tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:42.279314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0954cc0f-ab42-40b1-8e6f-890e6e4dd26e tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:42.279759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0954cc0f-ab42-40b1-8e6f-890e6e4dd26e tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:42.280503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0954cc0f-ab42-40b1-8e6f-890e6e4dd26e tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:42.280945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0954cc0f-ab42-40b1-8e6f-890e6e4dd26e tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:42.281403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0954cc0f-ab42-40b1-8e6f-890e6e4dd26e tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:42.308331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0954cc0f-ab42-40b1-8e6f-890e6e4dd26e tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:03:42.336685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:03:42.390977 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0954cc0f-ab42-40b1-8e6f-890e6e4dd26e tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 204 len: 0 microversion: 2.1 time: 0.124013 Oct 11 00:03:42.391699 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3377/6584] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:03:42 2022] DELETE /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:03:42.402643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2c28dc68-1015-413a-b845-e45f5507a438 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:42.403262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2c28dc68-1015-413a-b845-e45f5507a438 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:42.409580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c28dc68-1015-413a-b845-e45f5507a438 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:42.410073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c28dc68-1015-413a-b845-e45f5507a438 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:42.410598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c28dc68-1015-413a-b845-e45f5507a438 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:42.411299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c28dc68-1015-413a-b845-e45f5507a438 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:42.411911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c28dc68-1015-413a-b845-e45f5507a438 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:42.412341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2c28dc68-1015-413a-b845-e45f5507a438 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:42.416732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:03:42.555158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2c28dc68-1015-413a-b845-e45f5507a438 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:42.563677 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2c28dc68-1015-413a-b845-e45f5507a438 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1509 microversion: 2.1 time: 0.165471 Oct 11 00:03:42.564466 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3208/6585] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:42 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:03:43.599000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d0298584-ea01-4992-9c0c-250b08a8a595 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:43.600376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d0298584-ea01-4992-9c0c-250b08a8a595 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:43.603410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:03:43.609181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0298584-ea01-4992-9c0c-250b08a8a595 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:43.609958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0298584-ea01-4992-9c0c-250b08a8a595 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:43.610463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0298584-ea01-4992-9c0c-250b08a8a595 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:43.611150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0298584-ea01-4992-9c0c-250b08a8a595 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:43.611774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0298584-ea01-4992-9c0c-250b08a8a595 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:43.612199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0298584-ea01-4992-9c0c-250b08a8a595 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:43.761713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d0298584-ea01-4992-9c0c-250b08a8a595 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:43.771735 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d0298584-ea01-4992-9c0c-250b08a8a595 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1509 microversion: 2.1 time: 0.178045 Oct 11 00:03:43.772316 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3378/6586] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:43 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:44.799486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7a1bf966-7c55-448f-8cec-09b75faad15e tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:44.799486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7a1bf966-7c55-448f-8cec-09b75faad15e tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:44.809655 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a1bf966-7c55-448f-8cec-09b75faad15e tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:44.811716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a1bf966-7c55-448f-8cec-09b75faad15e tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:44.811956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a1bf966-7c55-448f-8cec-09b75faad15e tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:44.820947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a1bf966-7c55-448f-8cec-09b75faad15e tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:44.822829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a1bf966-7c55-448f-8cec-09b75faad15e tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:44.827223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a1bf966-7c55-448f-8cec-09b75faad15e tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:45.152769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7a1bf966-7c55-448f-8cec-09b75faad15e tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f4fa3cc7b924b36847f10974e801e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7720f7fff5ca4cdfac4ceb36db3d8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:03:45.167258 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7a1bf966-7c55-448f-8cec-09b75faad15e tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 200 len: 1509 microversion: 2.1 time: 0.375042 Oct 11 00:03:45.168390 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3209/6587] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:44 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 1509 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:03:45.300664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-482bc781-5e0e-49ec-8440-b24ed68c2290 req-5a205df9-f770-44dc-ac99-5360eb692e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6", "name": "network-vif-deleted", "tag": "08fc0ed7-fd80-4805-b1e6-806df442bd4f"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:03:45.317863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-482bc781-5e0e-49ec-8440-b24ed68c2290 req-5a205df9-f770-44dc-ac99-5360eb692e21 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:45.318950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-482bc781-5e0e-49ec-8440-b24ed68c2290 req-5a205df9-f770-44dc-ac99-5360eb692e21 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:45.319608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-482bc781-5e0e-49ec-8440-b24ed68c2290 req-5a205df9-f770-44dc-ac99-5360eb692e21 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:45.341340 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-482bc781-5e0e-49ec-8440-b24ed68c2290 req-5a205df9-f770-44dc-ac99-5360eb692e21 service nova] Creating event network-vif-deleted:08fc0ed7-fd80-4805-b1e6-806df442bd4f for instance a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 on n-h2-860864-2 Oct 11 00:03:45.349506 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-482bc781-5e0e-49ec-8440-b24ed68c2290 req-5a205df9-f770-44dc-ac99-5360eb692e21 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053255 Oct 11 00:03:45.350490 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3379/6588] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:03:46.199718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c37be1f8-d13e-4bcc-a5f1-eb76611345b2 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:03:46.200933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c37be1f8-d13e-4bcc-a5f1-eb76611345b2 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] [instance: a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:03:46.212044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c37be1f8-d13e-4bcc-a5f1-eb76611345b2 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:46.212848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c37be1f8-d13e-4bcc-a5f1-eb76611345b2 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:46.213741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c37be1f8-d13e-4bcc-a5f1-eb76611345b2 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:46.214887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c37be1f8-d13e-4bcc-a5f1-eb76611345b2 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:03:46.215886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c37be1f8-d13e-4bcc-a5f1-eb76611345b2 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:03:46.216419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c37be1f8-d13e-4bcc-a5f1-eb76611345b2 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:03:46.240675 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-c37be1f8-d13e-4bcc-a5f1-eb76611345b2 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] HTTP exception thrown: Instance a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 could not be found. Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c37be1f8-d13e-4bcc-a5f1-eb76611345b2 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Request method failure captured: Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 HTTP/1.1 Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLLFoSI4PGijYLlzLWAX24kN-eLM8cA5s5_iXm2rVZvH1y5FEFcX_ryhGX2xbTV7anmszMKI2izr3frh53gHaB9bKGLizRCqgyb1uyWqUJg_aENmfWRUIknef6zvxU9jG_ZrT46QjpeyfHD-ApwTRYHSZXRwm3wSBmzC5NYZhj69J_M Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 7720f7fff5ca4cdfac4ceb36db3d8a32 Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TestServerAdvancedOps-341074719 Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7720f7fff5ca4cdfac4ceb36db3d8a32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7720f7fff5ca4cdfac4ceb36db3d8a32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7720f7fff5ca4cdfac4ceb36db3d8a32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7720f7fff5ca4cdfac4ceb36db3d8a32", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TestServerAdvancedOps-341074719 Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 7720f7fff5ca4cdfac4ceb36db3d8a32 Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestServerAdvancedOps-341074719 Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TestServerAdvancedOps-341074719-project Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 6f4fa3cc7b924b36847f10974e801e43 Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TestServerAdvancedOps-341074719-project Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 could not be found. Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6'} Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 could not be found. Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 could not be found. Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:03:46.242486 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:03:46.248816 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:03:46.248816 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:03:46.248816 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:03:46.248816 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:03:46.248816 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:03:46.248816 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 could not be found. Oct 11 00:03:46.248816 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:03:46.248816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c37be1f8-d13e-4bcc-a5f1-eb76611345b2 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] Returning 404 to user: Instance a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:03:46.248816 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c37be1f8-d13e-4bcc-a5f1-eb76611345b2 tempest-TestServerAdvancedOps-341074719 tempest-TestServerAdvancedOps-341074719-project] 10.222.0.23 "GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6" status: 404 len: 111 microversion: 2.1 time: 0.050432 Oct 11 00:03:46.248816 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3210/6589] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:03:46 2022] GET /compute/v2.1/servers/a14c3ff6-924c-4b0a-acbd-3f6e0d21c8a6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:04:04.151792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:04:04.153079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=12,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:04:04.158768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ce56c683-7e7f-4f94-a9d3-ea1b3e90e9b3 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-557300671", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "90a789b2-7833-4e89-b413-baf0c1e00bf1"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:04:04.225917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-ce56c683-7e7f-4f94-a9d3-ea1b3e90e9b3 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] validate_networks() for [('90a789b2-7833-4e89-b413-baf0c1e00bf1', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:04:04.852955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-ce56c683-7e7f-4f94-a9d3-ea1b3e90e9b3 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:04:04.872527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-ce56c683-7e7f-4f94-a9d3-ea1b3e90e9b3 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:04:04.880193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-ce56c683-7e7f-4f94-a9d3-ea1b3e90e9b3 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:04:04.883297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-ce56c683-7e7f-4f94-a9d3-ea1b3e90e9b3 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:04:04.884057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-ce56c683-7e7f-4f94-a9d3-ea1b3e90e9b3 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:04:04.904117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce56c683-7e7f-4f94-a9d3-ea1b3e90e9b3 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:04.904875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce56c683-7e7f-4f94-a9d3-ea1b3e90e9b3 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:04.907148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce56c683-7e7f-4f94-a9d3-ea1b3e90e9b3 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:04.908866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce56c683-7e7f-4f94-a9d3-ea1b3e90e9b3 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:04.910067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce56c683-7e7f-4f94-a9d3-ea1b3e90e9b3 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:04.911047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ce56c683-7e7f-4f94-a9d3-ea1b3e90e9b3 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:04.963309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-ce56c683-7e7f-4f94-a9d3-ea1b3e90e9b3 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Getting quotas for project d3a7bc18ec81449fb605391db82e3ba6. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:04:04.973453 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-ce56c683-7e7f-4f94-a9d3-ea1b3e90e9b3 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Getting quotas for user 2b14179e34864b7d9e9dc9f5f0d16316 and project d3a7bc18ec81449fb605391db82e3ba6. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:04:04.995279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ce56c683-7e7f-4f94-a9d3-ea1b3e90e9b3 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:04:04.999903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ce56c683-7e7f-4f94-a9d3-ea1b3e90e9b3 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 5b5822e9-0e72-4755-ada1-e10420c5d0d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:04:05.071986 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ce56c683-7e7f-4f94-a9d3-ea1b3e90e9b3 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.922744 Oct 11 00:04:05.073171 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3380/6590] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:04:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:04:05.100950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eec1c2a6-7b88-459a-933a-feedd0e04246 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:05.117043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eec1c2a6-7b88-459a-933a-feedd0e04246 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 5b5822e9-0e72-4755-ada1-e10420c5d0d8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:05.144344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:04:05.151222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=12 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:04:05.292817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-eec1c2a6-7b88-459a-933a-feedd0e04246 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:05.304520 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eec1c2a6-7b88-459a-933a-feedd0e04246 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8" status: 200 len: 1213 microversion: 2.1 time: 0.221175 Oct 11 00:04:05.305665 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3211/6591] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:05 2022] GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8 => generated 1213 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:05.376462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-14ebdeee-573c-4ecf-9cb1-198439189e25 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-289189687", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "158fa4b7-baa7-44d3-bf93-47187f8a9573", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6b4889cd-925d-4509-9797-a829b845f15b"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:04:05.478951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-14ebdeee-573c-4ecf-9cb1-198439189e25 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] validate_networks() for [('6b4889cd-925d-4509-9797-a829b845f15b', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:04:06.061991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-14ebdeee-573c-4ecf-9cb1-198439189e25 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:04:06.062522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-14ebdeee-573c-4ecf-9cb1-198439189e25 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:04:06.063032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-14ebdeee-573c-4ecf-9cb1-198439189e25 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:04:06.063823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-14ebdeee-573c-4ecf-9cb1-198439189e25 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:04:06.065319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-14ebdeee-573c-4ecf-9cb1-198439189e25 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:04:06.079316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14ebdeee-573c-4ecf-9cb1-198439189e25 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:06.080453 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14ebdeee-573c-4ecf-9cb1-198439189e25 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:06.080912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14ebdeee-573c-4ecf-9cb1-198439189e25 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:06.081715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14ebdeee-573c-4ecf-9cb1-198439189e25 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:06.082185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14ebdeee-573c-4ecf-9cb1-198439189e25 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:06.082619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-14ebdeee-573c-4ecf-9cb1-198439189e25 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:06.106842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-14ebdeee-573c-4ecf-9cb1-198439189e25 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Getting quotas for project be6e417773094ab08c170ca4b69f3742. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:04:06.115177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-14ebdeee-573c-4ecf-9cb1-198439189e25 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Getting quotas for user a27b050389ad48089e214ad65eaa83bb and project be6e417773094ab08c170ca4b69f3742. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:04:06.187940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-14ebdeee-573c-4ecf-9cb1-198439189e25 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:04:06.190890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-14ebdeee-573c-4ecf-9cb1-198439189e25 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='158fa4b7-baa7-44d3-bf93-47187f8a9573',volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:04:06.340902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-540af732-e967-449a-8085-1947ecdab044 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:06.343862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-540af732-e967-449a-8085-1947ecdab044 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 5b5822e9-0e72-4755-ada1-e10420c5d0d8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:06.347315 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-14ebdeee-573c-4ecf-9cb1-198439189e25 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.978818 Oct 11 00:04:06.348556 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3381/6592] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:04:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:04:06.367533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1be43c10-87ac-4344-89d3-7b4916a4c04b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:06.368155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1be43c10-87ac-4344-89d3-7b4916a4c04b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:06.372252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-540af732-e967-449a-8085-1947ecdab044 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:06.373150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-540af732-e967-449a-8085-1947ecdab044 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:06.373918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-540af732-e967-449a-8085-1947ecdab044 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:06.375060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-540af732-e967-449a-8085-1947ecdab044 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:06.375789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-540af732-e967-449a-8085-1947ecdab044 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:06.377264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-540af732-e967-449a-8085-1947ecdab044 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:06.438158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1be43c10-87ac-4344-89d3-7b4916a4c04b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:06.447791 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1be43c10-87ac-4344-89d3-7b4916a4c04b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1056 microversion: 2.1 time: 0.088127 Oct 11 00:04:06.449178 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3382/6593] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:06 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1056 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:06.472493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-540af732-e967-449a-8085-1947ecdab044 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:06.481365 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-540af732-e967-449a-8085-1947ecdab044 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8" status: 200 len: 1265 microversion: 2.1 time: 0.146604 Oct 11 00:04:06.481996 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3212/6594] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:06 2022] GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:07.473026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8869ff8b-4d5b-40b7-a99b-781317f336b7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:07.473746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8869ff8b-4d5b-40b7-a99b-781317f336b7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:07.483083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8869ff8b-4d5b-40b7-a99b-781317f336b7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:07.483345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8869ff8b-4d5b-40b7-a99b-781317f336b7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:07.483698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8869ff8b-4d5b-40b7-a99b-781317f336b7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:07.484452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8869ff8b-4d5b-40b7-a99b-781317f336b7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:07.485231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8869ff8b-4d5b-40b7-a99b-781317f336b7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:07.485444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8869ff8b-4d5b-40b7-a99b-781317f336b7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:07.516403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dc6f8343-f180-405b-9c62-794a0e886704 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:07.517905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dc6f8343-f180-405b-9c62-794a0e886704 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 5b5822e9-0e72-4755-ada1-e10420c5d0d8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:07.540357 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc6f8343-f180-405b-9c62-794a0e886704 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:07.540974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc6f8343-f180-405b-9c62-794a0e886704 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:07.541535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc6f8343-f180-405b-9c62-794a0e886704 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:07.542470 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc6f8343-f180-405b-9c62-794a0e886704 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:07.543574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc6f8343-f180-405b-9c62-794a0e886704 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:07.544205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc6f8343-f180-405b-9c62-794a0e886704 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:07.591989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8869ff8b-4d5b-40b7-a99b-781317f336b7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:07.603135 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8869ff8b-4d5b-40b7-a99b-781317f336b7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1154 microversion: 2.1 time: 0.134690 Oct 11 00:04:07.604198 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3383/6595] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:07 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1154 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:08.001158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dc6f8343-f180-405b-9c62-794a0e886704 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:08.016425 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dc6f8343-f180-405b-9c62-794a0e886704 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8" status: 200 len: 1313 microversion: 2.1 time: 0.505203 Oct 11 00:04:08.019564 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3213/6596] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:07 2022] GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8 => generated 1313 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:04:08.630769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ede6e5c1-800c-4e3e-98e0-c47e28af520b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:08.631577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ede6e5c1-800c-4e3e-98e0-c47e28af520b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:08.652789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ede6e5c1-800c-4e3e-98e0-c47e28af520b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:08.653345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ede6e5c1-800c-4e3e-98e0-c47e28af520b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:08.654011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ede6e5c1-800c-4e3e-98e0-c47e28af520b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:08.654513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ede6e5c1-800c-4e3e-98e0-c47e28af520b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:08.655496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ede6e5c1-800c-4e3e-98e0-c47e28af520b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:08.655496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ede6e5c1-800c-4e3e-98e0-c47e28af520b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:08.755459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ede6e5c1-800c-4e3e-98e0-c47e28af520b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:08.770452 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ede6e5c1-800c-4e3e-98e0-c47e28af520b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1172 microversion: 2.1 time: 0.144340 Oct 11 00:04:08.785422 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3384/6597] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:08 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1172 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:09.050614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d199de98-eb46-42b8-a77d-47fd7e16260e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:09.052128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d199de98-eb46-42b8-a77d-47fd7e16260e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 5b5822e9-0e72-4755-ada1-e10420c5d0d8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:09.067001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d199de98-eb46-42b8-a77d-47fd7e16260e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:09.067670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d199de98-eb46-42b8-a77d-47fd7e16260e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:09.068305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d199de98-eb46-42b8-a77d-47fd7e16260e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:09.069166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d199de98-eb46-42b8-a77d-47fd7e16260e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:09.069786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d199de98-eb46-42b8-a77d-47fd7e16260e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:09.070488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d199de98-eb46-42b8-a77d-47fd7e16260e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:09.549216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d199de98-eb46-42b8-a77d-47fd7e16260e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:09.566525 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d199de98-eb46-42b8-a77d-47fd7e16260e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8" status: 200 len: 1313 microversion: 2.1 time: 0.523517 Oct 11 00:04:09.567137 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3214/6598] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:09 2022] GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8 => generated 1313 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:09.635907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-13e4052f-4dd4-4c27-8180-df0fb286cc90 req-95d1b91d-d339-497d-a062-0625e33166fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b5822e9-0e72-4755-ada1-e10420c5d0d8", "tag": "0cd6a8fc-8e8c-4576-b99b-948cac4bd376"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:04:09.670513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-13e4052f-4dd4-4c27-8180-df0fb286cc90 req-95d1b91d-d339-497d-a062-0625e33166fb service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:09.671041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-13e4052f-4dd4-4c27-8180-df0fb286cc90 req-95d1b91d-d339-497d-a062-0625e33166fb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:09.671530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-13e4052f-4dd4-4c27-8180-df0fb286cc90 req-95d1b91d-d339-497d-a062-0625e33166fb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:09.686849 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-13e4052f-4dd4-4c27-8180-df0fb286cc90 req-95d1b91d-d339-497d-a062-0625e33166fb service nova] Creating event network-changed:0cd6a8fc-8e8c-4576-b99b-948cac4bd376 for instance 5b5822e9-0e72-4755-ada1-e10420c5d0d8 on n-h2-860864-2 Oct 11 00:04:09.694390 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-13e4052f-4dd4-4c27-8180-df0fb286cc90 req-95d1b91d-d339-497d-a062-0625e33166fb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067672 Oct 11 00:04:09.707384 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3385/6599] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:04:09.797600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8bee94da-7b89-4791-b37b-ad7346d1eac3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:09.798560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8bee94da-7b89-4791-b37b-ad7346d1eac3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:09.815589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bee94da-7b89-4791-b37b-ad7346d1eac3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:09.816111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bee94da-7b89-4791-b37b-ad7346d1eac3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:09.816568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bee94da-7b89-4791-b37b-ad7346d1eac3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:09.817329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bee94da-7b89-4791-b37b-ad7346d1eac3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:09.824390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bee94da-7b89-4791-b37b-ad7346d1eac3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:09.825319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bee94da-7b89-4791-b37b-ad7346d1eac3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:10.266108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8bee94da-7b89-4791-b37b-ad7346d1eac3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:10.276385 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8bee94da-7b89-4791-b37b-ad7346d1eac3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1214 microversion: 2.1 time: 0.483722 Oct 11 00:04:10.277519 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3215/6600] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:09 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1214 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:04:10.590817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0f7cb2da-e2a1-442a-a0d3-f7e57e93fc6e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:10.591450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0f7cb2da-e2a1-442a-a0d3-f7e57e93fc6e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 5b5822e9-0e72-4755-ada1-e10420c5d0d8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:10.598596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f7cb2da-e2a1-442a-a0d3-f7e57e93fc6e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:10.599377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f7cb2da-e2a1-442a-a0d3-f7e57e93fc6e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:10.600038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f7cb2da-e2a1-442a-a0d3-f7e57e93fc6e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:10.600785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f7cb2da-e2a1-442a-a0d3-f7e57e93fc6e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:10.601249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f7cb2da-e2a1-442a-a0d3-f7e57e93fc6e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:10.601713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f7cb2da-e2a1-442a-a0d3-f7e57e93fc6e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:10.795292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0f7cb2da-e2a1-442a-a0d3-f7e57e93fc6e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:10.805367 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0f7cb2da-e2a1-442a-a0d3-f7e57e93fc6e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8" status: 200 len: 1313 microversion: 2.1 time: 0.218720 Oct 11 00:04:10.806684 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3386/6601] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:10 2022] GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:11.304913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-60550198-87d8-4164-91bf-6da690ba1009 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:11.306936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-60550198-87d8-4164-91bf-6da690ba1009 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:11.320656 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60550198-87d8-4164-91bf-6da690ba1009 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:11.322696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60550198-87d8-4164-91bf-6da690ba1009 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:11.324256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60550198-87d8-4164-91bf-6da690ba1009 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:11.325221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60550198-87d8-4164-91bf-6da690ba1009 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:11.325927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60550198-87d8-4164-91bf-6da690ba1009 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:11.326529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-60550198-87d8-4164-91bf-6da690ba1009 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:11.678485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-60550198-87d8-4164-91bf-6da690ba1009 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:11.687776 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-60550198-87d8-4164-91bf-6da690ba1009 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1214 microversion: 2.1 time: 0.390915 Oct 11 00:04:11.688931 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3216/6602] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:11 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1214 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:11.772750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-de96ce7a-8fef-4f17-b465-a6a68e6a5143 req-1f33b85e-e348-49f9-bedc-2d006020fb43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3dda398-e32c-4f3b-a37c-1a5b96546a3b", "tag": "03d62ae0-2ea6-4c31-a636-2ae5a282f766"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:04:11.786534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-de96ce7a-8fef-4f17-b465-a6a68e6a5143 req-1f33b85e-e348-49f9-bedc-2d006020fb43 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:11.787570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-de96ce7a-8fef-4f17-b465-a6a68e6a5143 req-1f33b85e-e348-49f9-bedc-2d006020fb43 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:11.788216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-de96ce7a-8fef-4f17-b465-a6a68e6a5143 req-1f33b85e-e348-49f9-bedc-2d006020fb43 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:11.808843 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-de96ce7a-8fef-4f17-b465-a6a68e6a5143 req-1f33b85e-e348-49f9-bedc-2d006020fb43 service nova] Creating event network-changed:03d62ae0-2ea6-4c31-a636-2ae5a282f766 for instance d3dda398-e32c-4f3b-a37c-1a5b96546a3b on n-h1-860864-2 Oct 11 00:04:11.820674 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-de96ce7a-8fef-4f17-b465-a6a68e6a5143 req-1f33b85e-e348-49f9-bedc-2d006020fb43 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054087 Oct 11 00:04:11.822196 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3387/6603] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:04:11.832285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f409e776-bb1c-4098-816c-f20385173ebd tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:11.832900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f409e776-bb1c-4098-816c-f20385173ebd tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 5b5822e9-0e72-4755-ada1-e10420c5d0d8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:11.839518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f409e776-bb1c-4098-816c-f20385173ebd tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:11.840273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f409e776-bb1c-4098-816c-f20385173ebd tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:11.840713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f409e776-bb1c-4098-816c-f20385173ebd tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:11.841449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f409e776-bb1c-4098-816c-f20385173ebd tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:11.841905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f409e776-bb1c-4098-816c-f20385173ebd tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:11.842326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f409e776-bb1c-4098-816c-f20385173ebd tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:12.076392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f409e776-bb1c-4098-816c-f20385173ebd tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:12.086222 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f409e776-bb1c-4098-816c-f20385173ebd tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8" status: 200 len: 1313 microversion: 2.1 time: 0.258780 Oct 11 00:04:12.087102 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3217/6604] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:11 2022] GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8 => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:12.714738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-65f3678e-73bb-46f2-b20d-5a264c77c1bf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:12.715566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-65f3678e-73bb-46f2-b20d-5a264c77c1bf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:12.726258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65f3678e-73bb-46f2-b20d-5a264c77c1bf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:12.726768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65f3678e-73bb-46f2-b20d-5a264c77c1bf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:12.727217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65f3678e-73bb-46f2-b20d-5a264c77c1bf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:12.727931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65f3678e-73bb-46f2-b20d-5a264c77c1bf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:12.728618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65f3678e-73bb-46f2-b20d-5a264c77c1bf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:12.729425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65f3678e-73bb-46f2-b20d-5a264c77c1bf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:12.881527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-65f3678e-73bb-46f2-b20d-5a264c77c1bf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:12.890059 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-65f3678e-73bb-46f2-b20d-5a264c77c1bf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1214 microversion: 2.1 time: 0.179764 Oct 11 00:04:12.890655 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3388/6605] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:12 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1214 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:13.115492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-795f1a31-0265-4d0b-8cbb-72db50f09366 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:13.117654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-795f1a31-0265-4d0b-8cbb-72db50f09366 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 5b5822e9-0e72-4755-ada1-e10420c5d0d8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:13.135204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795f1a31-0265-4d0b-8cbb-72db50f09366 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:13.136045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795f1a31-0265-4d0b-8cbb-72db50f09366 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:13.137178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795f1a31-0265-4d0b-8cbb-72db50f09366 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:13.137956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795f1a31-0265-4d0b-8cbb-72db50f09366 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:13.138722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795f1a31-0265-4d0b-8cbb-72db50f09366 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:13.139432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-795f1a31-0265-4d0b-8cbb-72db50f09366 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:13.365773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-795f1a31-0265-4d0b-8cbb-72db50f09366 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:13.374418 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-795f1a31-0265-4d0b-8cbb-72db50f09366 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8" status: 200 len: 1313 microversion: 2.1 time: 0.265225 Oct 11 00:04:13.384151 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3218/6606] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:13 2022] GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:13.915623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-880523a9-c0c0-41ee-8ea8-0b6005d3ad1e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:13.916263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-880523a9-c0c0-41ee-8ea8-0b6005d3ad1e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:13.924475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-880523a9-c0c0-41ee-8ea8-0b6005d3ad1e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:13.924975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-880523a9-c0c0-41ee-8ea8-0b6005d3ad1e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:13.925472 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-880523a9-c0c0-41ee-8ea8-0b6005d3ad1e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:13.926192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-880523a9-c0c0-41ee-8ea8-0b6005d3ad1e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:13.926647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-880523a9-c0c0-41ee-8ea8-0b6005d3ad1e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:13.927070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-880523a9-c0c0-41ee-8ea8-0b6005d3ad1e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:14.069800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-880523a9-c0c0-41ee-8ea8-0b6005d3ad1e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:14.077761 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-880523a9-c0c0-41ee-8ea8-0b6005d3ad1e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1202 microversion: 2.1 time: 0.165925 Oct 11 00:04:14.078862 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3389/6607] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:13 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1202 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:14.399027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c3380787-7b47-44ee-8c38-9a59382a7cf5 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:14.399912 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c3380787-7b47-44ee-8c38-9a59382a7cf5 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 5b5822e9-0e72-4755-ada1-e10420c5d0d8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:14.409084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3380787-7b47-44ee-8c38-9a59382a7cf5 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:14.409673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3380787-7b47-44ee-8c38-9a59382a7cf5 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:14.410160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3380787-7b47-44ee-8c38-9a59382a7cf5 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:14.411036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3380787-7b47-44ee-8c38-9a59382a7cf5 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:14.411530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3380787-7b47-44ee-8c38-9a59382a7cf5 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:14.412128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3380787-7b47-44ee-8c38-9a59382a7cf5 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:14.562191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c3380787-7b47-44ee-8c38-9a59382a7cf5 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:14.571059 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c3380787-7b47-44ee-8c38-9a59382a7cf5 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8" status: 200 len: 1313 microversion: 2.1 time: 0.176030 Oct 11 00:04:14.571605 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3219/6608] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:14 2022] GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:04:15.105597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-627df988-6ce1-4f5d-944f-148b50d6ea94 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:15.106375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-627df988-6ce1-4f5d-944f-148b50d6ea94 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:15.114853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-627df988-6ce1-4f5d-944f-148b50d6ea94 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:15.115712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-627df988-6ce1-4f5d-944f-148b50d6ea94 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:15.116467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-627df988-6ce1-4f5d-944f-148b50d6ea94 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:15.117869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-627df988-6ce1-4f5d-944f-148b50d6ea94 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:15.118822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-627df988-6ce1-4f5d-944f-148b50d6ea94 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:15.119853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-627df988-6ce1-4f5d-944f-148b50d6ea94 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:15.278436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-627df988-6ce1-4f5d-944f-148b50d6ea94 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:15.288217 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-627df988-6ce1-4f5d-944f-148b50d6ea94 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1202 microversion: 2.1 time: 0.188039 Oct 11 00:04:15.290279 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3390/6609] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:15 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1202 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:04:15.599307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6e69cfc2-96e1-4df8-954a-99ac7195435c tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:15.599914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6e69cfc2-96e1-4df8-954a-99ac7195435c tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 5b5822e9-0e72-4755-ada1-e10420c5d0d8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:15.602063 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:04:15.609676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e69cfc2-96e1-4df8-954a-99ac7195435c tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:15.611229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e69cfc2-96e1-4df8-954a-99ac7195435c tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:15.611668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e69cfc2-96e1-4df8-954a-99ac7195435c tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:15.612397 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e69cfc2-96e1-4df8-954a-99ac7195435c tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:15.613095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e69cfc2-96e1-4df8-954a-99ac7195435c tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:15.613641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6e69cfc2-96e1-4df8-954a-99ac7195435c tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:15.777672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6e69cfc2-96e1-4df8-954a-99ac7195435c tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:15.790805 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6e69cfc2-96e1-4df8-954a-99ac7195435c tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8" status: 200 len: 1313 microversion: 2.1 time: 0.196846 Oct 11 00:04:15.791423 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3220/6610] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:15 2022] GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:16.315666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-589e9393-05b1-4619-a593-52393ff3bb6b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:16.316275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-589e9393-05b1-4619-a593-52393ff3bb6b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:16.318387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:04:16.324813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-589e9393-05b1-4619-a593-52393ff3bb6b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:16.325315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-589e9393-05b1-4619-a593-52393ff3bb6b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:16.325783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-589e9393-05b1-4619-a593-52393ff3bb6b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:16.326495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-589e9393-05b1-4619-a593-52393ff3bb6b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:16.326955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-589e9393-05b1-4619-a593-52393ff3bb6b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:16.327389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-589e9393-05b1-4619-a593-52393ff3bb6b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:16.444913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=14 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:04:16.502365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-589e9393-05b1-4619-a593-52393ff3bb6b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:16.514626 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-589e9393-05b1-4619-a593-52393ff3bb6b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1202 microversion: 2.1 time: 0.205148 Oct 11 00:04:16.515658 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3391/6611] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:16 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1202 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:16.706786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-a8d69ba6-a177-409b-be54-383726fffbb0 req-b8e28b00-e046-4822-b282-2727300b2596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5822e9-0e72-4755-ada1-e10420c5d0d8", "name": "network-vif-plugged", "status": "completed", "tag": "0cd6a8fc-8e8c-4576-b99b-948cac4bd376"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:04:16.718159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a8d69ba6-a177-409b-be54-383726fffbb0 req-b8e28b00-e046-4822-b282-2727300b2596 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:16.718553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a8d69ba6-a177-409b-be54-383726fffbb0 req-b8e28b00-e046-4822-b282-2727300b2596 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:16.718996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a8d69ba6-a177-409b-be54-383726fffbb0 req-b8e28b00-e046-4822-b282-2727300b2596 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:16.736673 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-a8d69ba6-a177-409b-be54-383726fffbb0 req-b8e28b00-e046-4822-b282-2727300b2596 service nova] Creating event network-vif-plugged:0cd6a8fc-8e8c-4576-b99b-948cac4bd376 for instance 5b5822e9-0e72-4755-ada1-e10420c5d0d8 on n-h2-860864-2 Oct 11 00:04:16.743891 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-a8d69ba6-a177-409b-be54-383726fffbb0 req-b8e28b00-e046-4822-b282-2727300b2596 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041463 Oct 11 00:04:16.744724 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3221/6612] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:04:16.817481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cc0a8f69-ac87-4edb-9b8c-2e74531db328 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:16.818431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cc0a8f69-ac87-4edb-9b8c-2e74531db328 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 5b5822e9-0e72-4755-ada1-e10420c5d0d8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:16.827617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc0a8f69-ac87-4edb-9b8c-2e74531db328 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:16.828626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc0a8f69-ac87-4edb-9b8c-2e74531db328 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:16.832086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc0a8f69-ac87-4edb-9b8c-2e74531db328 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:16.833130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc0a8f69-ac87-4edb-9b8c-2e74531db328 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:16.833752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc0a8f69-ac87-4edb-9b8c-2e74531db328 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:16.834206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc0a8f69-ac87-4edb-9b8c-2e74531db328 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:17.015534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cc0a8f69-ac87-4edb-9b8c-2e74531db328 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:17.026096 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cc0a8f69-ac87-4edb-9b8c-2e74531db328 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8" status: 200 len: 1313 microversion: 2.1 time: 0.215097 Oct 11 00:04:17.026756 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3392/6613] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:16 2022] GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:17.541241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-daffa883-aac2-42ed-bfe9-a36cf05a1808 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:17.541970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-daffa883-aac2-42ed-bfe9-a36cf05a1808 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:17.548934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-daffa883-aac2-42ed-bfe9-a36cf05a1808 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:17.549454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-daffa883-aac2-42ed-bfe9-a36cf05a1808 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:17.549898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-daffa883-aac2-42ed-bfe9-a36cf05a1808 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:17.550632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-daffa883-aac2-42ed-bfe9-a36cf05a1808 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:17.551086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-daffa883-aac2-42ed-bfe9-a36cf05a1808 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:17.551513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-daffa883-aac2-42ed-bfe9-a36cf05a1808 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:17.689619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-daffa883-aac2-42ed-bfe9-a36cf05a1808 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:17.697644 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-daffa883-aac2-42ed-bfe9-a36cf05a1808 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1202 microversion: 2.1 time: 0.160593 Oct 11 00:04:17.698323 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3222/6614] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:17 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:18.049630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-647a1398-711e-476c-b281-9b2514ec4943 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:18.050227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-647a1398-711e-476c-b281-9b2514ec4943 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 5b5822e9-0e72-4755-ada1-e10420c5d0d8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:18.057408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-647a1398-711e-476c-b281-9b2514ec4943 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:18.057932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-647a1398-711e-476c-b281-9b2514ec4943 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:18.058389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-647a1398-711e-476c-b281-9b2514ec4943 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:18.059112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-647a1398-711e-476c-b281-9b2514ec4943 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:18.059560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-647a1398-711e-476c-b281-9b2514ec4943 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:18.059981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-647a1398-711e-476c-b281-9b2514ec4943 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:18.212792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-647a1398-711e-476c-b281-9b2514ec4943 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:18.221507 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-647a1398-711e-476c-b281-9b2514ec4943 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8" status: 200 len: 1313 microversion: 2.1 time: 0.175880 Oct 11 00:04:18.222099 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3393/6615] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:18 2022] GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:18.720889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a46eefd3-c963-4c2a-9708-59ed639beef8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:18.721496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a46eefd3-c963-4c2a-9708-59ed639beef8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:18.728341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a46eefd3-c963-4c2a-9708-59ed639beef8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:18.728852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a46eefd3-c963-4c2a-9708-59ed639beef8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:18.729294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a46eefd3-c963-4c2a-9708-59ed639beef8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:18.730020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a46eefd3-c963-4c2a-9708-59ed639beef8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:18.730481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a46eefd3-c963-4c2a-9708-59ed639beef8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:18.730918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a46eefd3-c963-4c2a-9708-59ed639beef8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:18.898923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a46eefd3-c963-4c2a-9708-59ed639beef8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:18.908555 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a46eefd3-c963-4c2a-9708-59ed639beef8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1202 microversion: 2.1 time: 0.191685 Oct 11 00:04:18.909176 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3223/6616] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:18 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1202 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:19.244306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cb8b5cc0-4dcb-4675-92be-a0d2853e67d9 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:19.244935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cb8b5cc0-4dcb-4675-92be-a0d2853e67d9 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 5b5822e9-0e72-4755-ada1-e10420c5d0d8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:19.252075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb8b5cc0-4dcb-4675-92be-a0d2853e67d9 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:19.252571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb8b5cc0-4dcb-4675-92be-a0d2853e67d9 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:19.253012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb8b5cc0-4dcb-4675-92be-a0d2853e67d9 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:19.253759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb8b5cc0-4dcb-4675-92be-a0d2853e67d9 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:19.254225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb8b5cc0-4dcb-4675-92be-a0d2853e67d9 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:19.254646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb8b5cc0-4dcb-4675-92be-a0d2853e67d9 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:19.397999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cb8b5cc0-4dcb-4675-92be-a0d2853e67d9 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:19.407530 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cb8b5cc0-4dcb-4675-92be-a0d2853e67d9 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8" status: 200 len: 1497 microversion: 2.1 time: 0.166344 Oct 11 00:04:19.408146 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3394/6617] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:19 2022] GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8 => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:19.800727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-91dbbd01-868e-49f4-af13-df596d261715 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:19.801350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-91dbbd01-868e-49f4-af13-df596d261715 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 5b5822e9-0e72-4755-ada1-e10420c5d0d8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:19.808866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91dbbd01-868e-49f4-af13-df596d261715 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:19.809354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91dbbd01-868e-49f4-af13-df596d261715 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:19.809826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91dbbd01-868e-49f4-af13-df596d261715 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:19.810530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91dbbd01-868e-49f4-af13-df596d261715 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:19.810991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91dbbd01-868e-49f4-af13-df596d261715 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:19.811422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-91dbbd01-868e-49f4-af13-df596d261715 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:19.839300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-91dbbd01-868e-49f4-af13-df596d261715 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 5b5822e9-0e72-4755-ada1-e10420c5d0d8] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:04:19.924319 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-91dbbd01-868e-49f4-af13-df596d261715 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8" status: 204 len: 0 microversion: 2.1 time: 0.127776 Oct 11 00:04:19.925703 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3224/6618] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:04:19 2022] DELETE /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:04:19.932504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a696772b-e244-4e2a-8ef5-373bfcc80815 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:19.933125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a696772b-e244-4e2a-8ef5-373bfcc80815 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:19.935490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ebaedd05-1dda-45e4-9536-aa60259fb186 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:19.936213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ebaedd05-1dda-45e4-9536-aa60259fb186 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 5b5822e9-0e72-4755-ada1-e10420c5d0d8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:19.940202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a696772b-e244-4e2a-8ef5-373bfcc80815 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:19.940693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a696772b-e244-4e2a-8ef5-373bfcc80815 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:19.941135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a696772b-e244-4e2a-8ef5-373bfcc80815 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:19.941869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a696772b-e244-4e2a-8ef5-373bfcc80815 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:19.942326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a696772b-e244-4e2a-8ef5-373bfcc80815 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:19.942755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a696772b-e244-4e2a-8ef5-373bfcc80815 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:19.942861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebaedd05-1dda-45e4-9536-aa60259fb186 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:19.943284 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebaedd05-1dda-45e4-9536-aa60259fb186 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:19.943728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebaedd05-1dda-45e4-9536-aa60259fb186 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:19.944429 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebaedd05-1dda-45e4-9536-aa60259fb186 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:19.944888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebaedd05-1dda-45e4-9536-aa60259fb186 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:19.945323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ebaedd05-1dda-45e4-9536-aa60259fb186 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:20.079250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a696772b-e244-4e2a-8ef5-373bfcc80815 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:20.081114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ebaedd05-1dda-45e4-9536-aa60259fb186 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:20.087393 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a696772b-e244-4e2a-8ef5-373bfcc80815 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1202 microversion: 2.1 time: 0.159054 Oct 11 00:04:20.087988 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3395/6619] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:19 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:20.089124 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ebaedd05-1dda-45e4-9536-aa60259fb186 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8" status: 200 len: 1503 microversion: 2.1 time: 0.157982 Oct 11 00:04:20.089744 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3225/6620] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:19 2022] GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:04:21.123647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-584dba50-3306-4465-899f-796f59ecb760 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:21.124077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-afd6353d-1ed9-4e6b-bcd5-8609fae9858b tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:21.124457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-584dba50-3306-4465-899f-796f59ecb760 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:21.124550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-afd6353d-1ed9-4e6b-bcd5-8609fae9858b tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 5b5822e9-0e72-4755-ada1-e10420c5d0d8] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:21.132243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-584dba50-3306-4465-899f-796f59ecb760 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:21.132452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afd6353d-1ed9-4e6b-bcd5-8609fae9858b tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:21.132739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-584dba50-3306-4465-899f-796f59ecb760 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:21.132984 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afd6353d-1ed9-4e6b-bcd5-8609fae9858b tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:21.133179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-584dba50-3306-4465-899f-796f59ecb760 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:21.133583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afd6353d-1ed9-4e6b-bcd5-8609fae9858b tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:21.134131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-584dba50-3306-4465-899f-796f59ecb760 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:21.134591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-584dba50-3306-4465-899f-796f59ecb760 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:21.134845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afd6353d-1ed9-4e6b-bcd5-8609fae9858b tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:21.135088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-584dba50-3306-4465-899f-796f59ecb760 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:21.135993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afd6353d-1ed9-4e6b-bcd5-8609fae9858b tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:21.136424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-afd6353d-1ed9-4e6b-bcd5-8609fae9858b tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:21.282154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-afd6353d-1ed9-4e6b-bcd5-8609fae9858b tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:21.290642 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-afd6353d-1ed9-4e6b-bcd5-8609fae9858b tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8" status: 200 len: 1503 microversion: 2.1 time: 0.170894 Oct 11 00:04:21.291373 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3226/6621] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:21 2022] GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:21.293621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-584dba50-3306-4465-899f-796f59ecb760 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:21.304697 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-584dba50-3306-4465-899f-796f59ecb760 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1202 microversion: 2.1 time: 0.184902 Oct 11 00:04:21.305849 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3396/6622] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:21 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1202 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:21.801261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-8c0a94a6-19fa-49b8-9223-59da9f37fe23 req-563a99e8-4043-4c22-99a6-6544fd5e00cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5822e9-0e72-4755-ada1-e10420c5d0d8", "name": "network-vif-deleted", "tag": "0cd6a8fc-8e8c-4576-b99b-948cac4bd376"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:04:21.811501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8c0a94a6-19fa-49b8-9223-59da9f37fe23 req-563a99e8-4043-4c22-99a6-6544fd5e00cd service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:21.815467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8c0a94a6-19fa-49b8-9223-59da9f37fe23 req-563a99e8-4043-4c22-99a6-6544fd5e00cd service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:21.816016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8c0a94a6-19fa-49b8-9223-59da9f37fe23 req-563a99e8-4043-4c22-99a6-6544fd5e00cd service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:21.829450 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-8c0a94a6-19fa-49b8-9223-59da9f37fe23 req-563a99e8-4043-4c22-99a6-6544fd5e00cd service nova] Creating event network-vif-deleted:0cd6a8fc-8e8c-4576-b99b-948cac4bd376 for instance 5b5822e9-0e72-4755-ada1-e10420c5d0d8 on n-h2-860864-2 Oct 11 00:04:21.834476 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-8c0a94a6-19fa-49b8-9223-59da9f37fe23 req-563a99e8-4043-4c22-99a6-6544fd5e00cd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038253 Oct 11 00:04:21.835084 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3227/6623] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:04:22.325259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2fafcf94-7e0b-4b6f-8ed2-bfbb9181fbbf tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:22.326455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2fafcf94-7e0b-4b6f-8ed2-bfbb9181fbbf tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 5b5822e9-0e72-4755-ada1-e10420c5d0d8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:22.330567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8d401396-5c62-414c-819a-85e46ae7cfcd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:22.331272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8d401396-5c62-414c-819a-85e46ae7cfcd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:22.335230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fafcf94-7e0b-4b6f-8ed2-bfbb9181fbbf tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:22.336106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fafcf94-7e0b-4b6f-8ed2-bfbb9181fbbf tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:22.336669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fafcf94-7e0b-4b6f-8ed2-bfbb9181fbbf tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:22.337648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fafcf94-7e0b-4b6f-8ed2-bfbb9181fbbf tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:22.338226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fafcf94-7e0b-4b6f-8ed2-bfbb9181fbbf tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:22.338862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fafcf94-7e0b-4b6f-8ed2-bfbb9181fbbf tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:22.347139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d401396-5c62-414c-819a-85e46ae7cfcd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:22.347640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d401396-5c62-414c-819a-85e46ae7cfcd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:22.348082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d401396-5c62-414c-819a-85e46ae7cfcd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:22.348827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d401396-5c62-414c-819a-85e46ae7cfcd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:22.349284 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d401396-5c62-414c-819a-85e46ae7cfcd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:22.349739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8d401396-5c62-414c-819a-85e46ae7cfcd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:22.354355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:04:22.378234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fafcf94-7e0b-4b6f-8ed2-bfbb9181fbbf tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:22.380000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fafcf94-7e0b-4b6f-8ed2-bfbb9181fbbf tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:22.380602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2fafcf94-7e0b-4b6f-8ed2-bfbb9181fbbf tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:22.381197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-2fafcf94-7e0b-4b6f-8ed2-bfbb9181fbbf tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lazy-loading 'fault' on Instance uuid 5b5822e9-0e72-4755-ada1-e10420c5d0d8 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:04:22.425214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2fafcf94-7e0b-4b6f-8ed2-bfbb9181fbbf tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:22.432524 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2fafcf94-7e0b-4b6f-8ed2-bfbb9181fbbf tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8" status: 200 len: 1303 microversion: 2.1 time: 0.112274 Oct 11 00:04:22.433107 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3397/6624] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:22 2022] GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8 => generated 1303 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:22.497041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8d401396-5c62-414c-819a-85e46ae7cfcd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:22.504993 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8d401396-5c62-414c-819a-85e46ae7cfcd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1202 microversion: 2.1 time: 0.180586 Oct 11 00:04:22.505615 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3228/6625] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:22 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1202 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:23.456919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f169351e-03fd-4bbc-9328-3841ee1ab5d4 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:23.457574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f169351e-03fd-4bbc-9328-3841ee1ab5d4 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 5b5822e9-0e72-4755-ada1-e10420c5d0d8] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:23.464093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f169351e-03fd-4bbc-9328-3841ee1ab5d4 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:23.464583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f169351e-03fd-4bbc-9328-3841ee1ab5d4 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:23.465034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f169351e-03fd-4bbc-9328-3841ee1ab5d4 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:23.465779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f169351e-03fd-4bbc-9328-3841ee1ab5d4 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:23.466238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f169351e-03fd-4bbc-9328-3841ee1ab5d4 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:23.466683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f169351e-03fd-4bbc-9328-3841ee1ab5d4 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:23.480327 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-f169351e-03fd-4bbc-9328-3841ee1ab5d4 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] HTTP exception thrown: Instance 5b5822e9-0e72-4755-ada1-e10420c5d0d8 could not be found. Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f169351e-03fd-4bbc-9328-3841ee1ab5d4 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Request method failure captured: Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8 HTTP/1.1 Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLLxe6FYInJ-HAVuIuCT8ad3k3FsFKyBbLURkmP5Ne5h2JqhERhOg4h4gnk6tkE7wrjog4TsQAdIh9-QV8zCsRX5PgoRoJdrTnQ6755HvbgwxzgGmHsUf7yi2S6ji8qDngP7WaodBBn1opQB2jLRhRZNOv7Rj8Bc1rYuIGpGlcFJTfU Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: d3a7bc18ec81449fb605391db82e3ba6 Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-VolumesActionsTest-914814718 Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3a7bc18ec81449fb605391db82e3ba6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3a7bc18ec81449fb605391db82e3ba6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3a7bc18ec81449fb605391db82e3ba6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3a7bc18ec81449fb605391db82e3ba6", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-VolumesActionsTest-914814718 Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: d3a7bc18ec81449fb605391db82e3ba6 Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-VolumesActionsTest-914814718 Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-VolumesActionsTest-914814718-project Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 2b14179e34864b7d9e9dc9f5f0d16316 Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-VolumesActionsTest-914814718-project Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 5b5822e9-0e72-4755-ada1-e10420c5d0d8 could not be found. Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '5b5822e9-0e72-4755-ada1-e10420c5d0d8'} Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b5822e9-0e72-4755-ada1-e10420c5d0d8 could not be found. Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b5822e9-0e72-4755-ada1-e10420c5d0d8 could not be found. Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:04:23.482013 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:04:23.487591 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:04:23.487591 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:04:23.487591 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:04:23.487591 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:04:23.487591 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:04:23.487591 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b5822e9-0e72-4755-ada1-e10420c5d0d8 could not be found. Oct 11 00:04:23.487591 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:04:23.487591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f169351e-03fd-4bbc-9328-3841ee1ab5d4 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Returning 404 to user: Instance 5b5822e9-0e72-4755-ada1-e10420c5d0d8 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:04:23.487591 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f169351e-03fd-4bbc-9328-3841ee1ab5d4 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8" status: 404 len: 111 microversion: 2.1 time: 0.031207 Oct 11 00:04:23.487591 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3398/6626] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:23 2022] GET /compute/v2.1/servers/5b5822e9-0e72-4755-ada1-e10420c5d0d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:04:23.528097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-15f1dd8f-821d-42b3-996a-34528aa9acbf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:23.528748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-15f1dd8f-821d-42b3-996a-34528aa9acbf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:23.534275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7273fd9b-8575-42a5-91f8-a714ea394fe1 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1458355047", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "90a789b2-7833-4e89-b413-baf0c1e00bf1"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:04:23.536028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15f1dd8f-821d-42b3-996a-34528aa9acbf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:23.536523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15f1dd8f-821d-42b3-996a-34528aa9acbf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:23.536956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15f1dd8f-821d-42b3-996a-34528aa9acbf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:23.537684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15f1dd8f-821d-42b3-996a-34528aa9acbf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:23.538137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15f1dd8f-821d-42b3-996a-34528aa9acbf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:23.538568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-15f1dd8f-821d-42b3-996a-34528aa9acbf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:23.591893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-7273fd9b-8575-42a5-91f8-a714ea394fe1 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] validate_networks() for [('90a789b2-7833-4e89-b413-baf0c1e00bf1', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:04:23.675880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-15f1dd8f-821d-42b3-996a-34528aa9acbf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:23.683792 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-15f1dd8f-821d-42b3-996a-34528aa9acbf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1202 microversion: 2.1 time: 0.159428 Oct 11 00:04:23.684378 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3229/6627] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:23 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:23.962276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7273fd9b-8575-42a5-91f8-a714ea394fe1 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:04:23.962677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7273fd9b-8575-42a5-91f8-a714ea394fe1 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:04:23.963164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7273fd9b-8575-42a5-91f8-a714ea394fe1 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:04:23.963604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7273fd9b-8575-42a5-91f8-a714ea394fe1 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:04:23.964022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7273fd9b-8575-42a5-91f8-a714ea394fe1 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:04:23.973803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7273fd9b-8575-42a5-91f8-a714ea394fe1 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:23.974283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7273fd9b-8575-42a5-91f8-a714ea394fe1 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:23.974725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7273fd9b-8575-42a5-91f8-a714ea394fe1 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:23.976284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7273fd9b-8575-42a5-91f8-a714ea394fe1 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:23.976747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7273fd9b-8575-42a5-91f8-a714ea394fe1 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:23.977181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7273fd9b-8575-42a5-91f8-a714ea394fe1 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:23.995003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-7273fd9b-8575-42a5-91f8-a714ea394fe1 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Getting quotas for project d3a7bc18ec81449fb605391db82e3ba6. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:04:24.000862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-7273fd9b-8575-42a5-91f8-a714ea394fe1 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Getting quotas for user 2b14179e34864b7d9e9dc9f5f0d16316 and project d3a7bc18ec81449fb605391db82e3ba6. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:04:24.013519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7273fd9b-8575-42a5-91f8-a714ea394fe1 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:04:24.016529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7273fd9b-8575-42a5-91f8-a714ea394fe1 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 9e208474-2f04-429e-af29-ea3dcc2927a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:04:24.065148 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7273fd9b-8575-42a5-91f8-a714ea394fe1 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534822 Oct 11 00:04:24.065846 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3399/6628] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:04:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 00:04:24.077398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0d04a4ae-d6fa-430d-823b-5d35c80676e3 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:24.078629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0d04a4ae-d6fa-430d-823b-5d35c80676e3 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 9e208474-2f04-429e-af29-ea3dcc2927a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:24.137254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0d04a4ae-d6fa-430d-823b-5d35c80676e3 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:24.145020 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0d04a4ae-d6fa-430d-823b-5d35c80676e3 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1" status: 200 len: 1214 microversion: 2.1 time: 0.071975 Oct 11 00:04:24.145670 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3230/6629] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:24 2022] GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:24.708781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2ed22f09-77c6-41ca-bfb5-4d00d050d8b5 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:24.709424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2ed22f09-77c6-41ca-bfb5-4d00d050d8b5 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:24.716977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ed22f09-77c6-41ca-bfb5-4d00d050d8b5 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:24.717508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ed22f09-77c6-41ca-bfb5-4d00d050d8b5 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:24.717952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ed22f09-77c6-41ca-bfb5-4d00d050d8b5 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:24.720495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ed22f09-77c6-41ca-bfb5-4d00d050d8b5 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:24.721149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ed22f09-77c6-41ca-bfb5-4d00d050d8b5 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:24.721804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2ed22f09-77c6-41ca-bfb5-4d00d050d8b5 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:24.743489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-1ab5eb66-c73c-42ad-b690-2158ea4e344e req-036b2a4d-d1b9-44d4-8437-3b8f35505de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3dda398-e32c-4f3b-a37c-1a5b96546a3b", "name": "network-vif-plugged", "status": "completed", "tag": "03d62ae0-2ea6-4c31-a636-2ae5a282f766"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:04:24.763747 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1ab5eb66-c73c-42ad-b690-2158ea4e344e req-036b2a4d-d1b9-44d4-8437-3b8f35505de0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:24.764669 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1ab5eb66-c73c-42ad-b690-2158ea4e344e req-036b2a4d-d1b9-44d4-8437-3b8f35505de0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:24.765312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-1ab5eb66-c73c-42ad-b690-2158ea4e344e req-036b2a4d-d1b9-44d4-8437-3b8f35505de0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:24.777256 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-1ab5eb66-c73c-42ad-b690-2158ea4e344e req-036b2a4d-d1b9-44d4-8437-3b8f35505de0 service nova] Creating event network-vif-plugged:03d62ae0-2ea6-4c31-a636-2ae5a282f766 for instance d3dda398-e32c-4f3b-a37c-1a5b96546a3b on n-h1-860864-2 Oct 11 00:04:24.785766 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-1ab5eb66-c73c-42ad-b690-2158ea4e344e req-036b2a4d-d1b9-44d4-8437-3b8f35505de0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048253 Oct 11 00:04:24.787104 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3231/6630] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:04:24.903290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2ed22f09-77c6-41ca-bfb5-4d00d050d8b5 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:24.911606 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2ed22f09-77c6-41ca-bfb5-4d00d050d8b5 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1202 microversion: 2.1 time: 0.209061 Oct 11 00:04:24.912189 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3400/6631] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:24 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1202 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:25.171975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d0fc4934-5dc8-402b-b1f2-85e1c2e51775 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:25.172977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d0fc4934-5dc8-402b-b1f2-85e1c2e51775 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 9e208474-2f04-429e-af29-ea3dcc2927a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:25.180541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0fc4934-5dc8-402b-b1f2-85e1c2e51775 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:25.181127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0fc4934-5dc8-402b-b1f2-85e1c2e51775 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:25.181670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0fc4934-5dc8-402b-b1f2-85e1c2e51775 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:25.182433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0fc4934-5dc8-402b-b1f2-85e1c2e51775 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:25.182840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0fc4934-5dc8-402b-b1f2-85e1c2e51775 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:25.183269 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0fc4934-5dc8-402b-b1f2-85e1c2e51775 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:25.291567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d0fc4934-5dc8-402b-b1f2-85e1c2e51775 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:25.300306 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d0fc4934-5dc8-402b-b1f2-85e1c2e51775 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1" status: 200 len: 1274 microversion: 2.1 time: 0.134764 Oct 11 00:04:25.301336 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3232/6632] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:25 2022] GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1 => generated 1274 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:25.935167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ee3862a6-d4bd-439b-8841-2d25ad1237ab tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:25.935833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ee3862a6-d4bd-439b-8841-2d25ad1237ab tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:25.943130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee3862a6-d4bd-439b-8841-2d25ad1237ab tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:25.943616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee3862a6-d4bd-439b-8841-2d25ad1237ab tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:25.944057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee3862a6-d4bd-439b-8841-2d25ad1237ab tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:25.944765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee3862a6-d4bd-439b-8841-2d25ad1237ab tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:25.945220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee3862a6-d4bd-439b-8841-2d25ad1237ab tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:25.945760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee3862a6-d4bd-439b-8841-2d25ad1237ab tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:25.949995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:04:26.324992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-219fcfb6-ae24-4362-adf6-0487139bc55e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:26.325745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-219fcfb6-ae24-4362-adf6-0487139bc55e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 9e208474-2f04-429e-af29-ea3dcc2927a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:26.336249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-219fcfb6-ae24-4362-adf6-0487139bc55e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:26.337007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-219fcfb6-ae24-4362-adf6-0487139bc55e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:26.337730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-219fcfb6-ae24-4362-adf6-0487139bc55e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:26.338859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-219fcfb6-ae24-4362-adf6-0487139bc55e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:26.339845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-219fcfb6-ae24-4362-adf6-0487139bc55e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:26.340510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-219fcfb6-ae24-4362-adf6-0487139bc55e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:26.373353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ee3862a6-d4bd-439b-8841-2d25ad1237ab tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:26.382955 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ee3862a6-d4bd-439b-8841-2d25ad1237ab tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1202 microversion: 2.1 time: 0.451603 Oct 11 00:04:26.383545 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3401/6633] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:25 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1202 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:26.567531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-219fcfb6-ae24-4362-adf6-0487139bc55e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:26.575712 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-219fcfb6-ae24-4362-adf6-0487139bc55e tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1" status: 200 len: 1314 microversion: 2.1 time: 0.254624 Oct 11 00:04:26.576303 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3233/6634] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:26 2022] GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:26.830613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-24833d02-cc4e-4349-9d6f-9d47ec1bf346 req-71ab5547-7484-4ed9-ada4-5e65de1b99f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e208474-2f04-429e-af29-ea3dcc2927a1", "tag": "3af7a8a5-032d-4533-885c-4fe5240d7be4"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:04:26.841466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-24833d02-cc4e-4349-9d6f-9d47ec1bf346 req-71ab5547-7484-4ed9-ada4-5e65de1b99f5 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:26.841961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-24833d02-cc4e-4349-9d6f-9d47ec1bf346 req-71ab5547-7484-4ed9-ada4-5e65de1b99f5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:26.842398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-24833d02-cc4e-4349-9d6f-9d47ec1bf346 req-71ab5547-7484-4ed9-ada4-5e65de1b99f5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:26.855886 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-24833d02-cc4e-4349-9d6f-9d47ec1bf346 req-71ab5547-7484-4ed9-ada4-5e65de1b99f5 service nova] Creating event network-changed:3af7a8a5-032d-4533-885c-4fe5240d7be4 for instance 9e208474-2f04-429e-af29-ea3dcc2927a1 on n-h2-860864-2 Oct 11 00:04:26.862046 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-24833d02-cc4e-4349-9d6f-9d47ec1bf346 req-71ab5547-7484-4ed9-ada4-5e65de1b99f5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036035 Oct 11 00:04:26.862645 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3402/6635] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:04:27.407857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e6f067a3-3030-4a55-ab78-8ac6f2bcfbbc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:27.408444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e6f067a3-3030-4a55-ab78-8ac6f2bcfbbc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:27.415354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6f067a3-3030-4a55-ab78-8ac6f2bcfbbc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:27.415841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6f067a3-3030-4a55-ab78-8ac6f2bcfbbc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:27.416280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6f067a3-3030-4a55-ab78-8ac6f2bcfbbc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:27.416985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6f067a3-3030-4a55-ab78-8ac6f2bcfbbc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:27.417462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6f067a3-3030-4a55-ab78-8ac6f2bcfbbc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:27.417890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e6f067a3-3030-4a55-ab78-8ac6f2bcfbbc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:27.560365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e6f067a3-3030-4a55-ab78-8ac6f2bcfbbc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:27.569152 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e6f067a3-3030-4a55-ab78-8ac6f2bcfbbc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1389 microversion: 2.1 time: 0.165829 Oct 11 00:04:27.569767 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3234/6636] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:27 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:27.595231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-97bed0de-4c79-4a85-9d3e-b1977dfc9757 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:27.596025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-97bed0de-4c79-4a85-9d3e-b1977dfc9757 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:27.599795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-04874b9f-74ad-4bdc-b1a2-b29cacd436c8 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:27.600419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-04874b9f-74ad-4bdc-b1a2-b29cacd436c8 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 9e208474-2f04-429e-af29-ea3dcc2927a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:27.602488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97bed0de-4c79-4a85-9d3e-b1977dfc9757 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:27.602980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97bed0de-4c79-4a85-9d3e-b1977dfc9757 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:27.603423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97bed0de-4c79-4a85-9d3e-b1977dfc9757 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:27.604124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97bed0de-4c79-4a85-9d3e-b1977dfc9757 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:27.604591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97bed0de-4c79-4a85-9d3e-b1977dfc9757 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:27.605023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-97bed0de-4c79-4a85-9d3e-b1977dfc9757 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:27.606411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04874b9f-74ad-4bdc-b1a2-b29cacd436c8 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:27.606888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04874b9f-74ad-4bdc-b1a2-b29cacd436c8 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:27.607325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04874b9f-74ad-4bdc-b1a2-b29cacd436c8 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:27.608215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04874b9f-74ad-4bdc-b1a2-b29cacd436c8 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:27.609411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04874b9f-74ad-4bdc-b1a2-b29cacd436c8 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:27.609942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04874b9f-74ad-4bdc-b1a2-b29cacd436c8 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:27.743359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-97bed0de-4c79-4a85-9d3e-b1977dfc9757 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:27.751771 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-97bed0de-4c79-4a85-9d3e-b1977dfc9757 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1389 microversion: 2.1 time: 0.162227 Oct 11 00:04:27.752371 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3403/6637] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:27 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:27.755291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-04874b9f-74ad-4bdc-b1a2-b29cacd436c8 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:27.763025 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-04874b9f-74ad-4bdc-b1a2-b29cacd436c8 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1" status: 200 len: 1314 microversion: 2.1 time: 0.167001 Oct 11 00:04:27.763748 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3235/6638] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:27 2022] GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:04:27.775726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a82fd06c-7b4e-42d0-a42d-ac2386b7ca11 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:27.776346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a82fd06c-7b4e-42d0-a42d-ac2386b7ca11 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:27.783649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a82fd06c-7b4e-42d0-a42d-ac2386b7ca11 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:27.784140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a82fd06c-7b4e-42d0-a42d-ac2386b7ca11 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:27.784595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a82fd06c-7b4e-42d0-a42d-ac2386b7ca11 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:27.785269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a82fd06c-7b4e-42d0-a42d-ac2386b7ca11 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:27.785743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a82fd06c-7b4e-42d0-a42d-ac2386b7ca11 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:27.786165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a82fd06c-7b4e-42d0-a42d-ac2386b7ca11 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:27.924156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a82fd06c-7b4e-42d0-a42d-ac2386b7ca11 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:27.932416 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a82fd06c-7b4e-42d0-a42d-ac2386b7ca11 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1389 microversion: 2.1 time: 0.160179 Oct 11 00:04:27.932989 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3404/6639] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:27 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1389 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:27.956058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-624712ad-e0eb-4bb6-9519-8fb921c404b9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:27.956563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-624712ad-e0eb-4bb6-9519-8fb921c404b9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:27.962595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-624712ad-e0eb-4bb6-9519-8fb921c404b9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:27.963091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-624712ad-e0eb-4bb6-9519-8fb921c404b9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:27.963531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-624712ad-e0eb-4bb6-9519-8fb921c404b9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:27.964240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-624712ad-e0eb-4bb6-9519-8fb921c404b9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:27.964705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-624712ad-e0eb-4bb6-9519-8fb921c404b9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:27.965136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-624712ad-e0eb-4bb6-9519-8fb921c404b9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:27.993529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-624712ad-e0eb-4bb6-9519-8fb921c404b9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:04:28.075655 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-624712ad-e0eb-4bb6-9519-8fb921c404b9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 204 len: 0 microversion: 2.1 time: 0.123979 Oct 11 00:04:28.076239 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3236/6640] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:04:27 2022] DELETE /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:04:28.085343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4af4eac2-bc7d-484c-a444-b1fa9b51bd3c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:28.086297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4af4eac2-bc7d-484c-a444-b1fa9b51bd3c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:28.092791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4af4eac2-bc7d-484c-a444-b1fa9b51bd3c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:28.093395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4af4eac2-bc7d-484c-a444-b1fa9b51bd3c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:28.094000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4af4eac2-bc7d-484c-a444-b1fa9b51bd3c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:28.094992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4af4eac2-bc7d-484c-a444-b1fa9b51bd3c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:28.095189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4af4eac2-bc7d-484c-a444-b1fa9b51bd3c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:28.095627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4af4eac2-bc7d-484c-a444-b1fa9b51bd3c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:28.232424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4af4eac2-bc7d-484c-a444-b1fa9b51bd3c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:28.241179 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4af4eac2-bc7d-484c-a444-b1fa9b51bd3c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1395 microversion: 2.1 time: 0.159900 Oct 11 00:04:28.241803 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3405/6641] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:28 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1395 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:28.787112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c44a0a88-f98c-4c0a-90e8-c6e27a180e27 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:28.787753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c44a0a88-f98c-4c0a-90e8-c6e27a180e27 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 9e208474-2f04-429e-af29-ea3dcc2927a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:28.794772 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c44a0a88-f98c-4c0a-90e8-c6e27a180e27 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:28.795255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c44a0a88-f98c-4c0a-90e8-c6e27a180e27 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:28.795723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c44a0a88-f98c-4c0a-90e8-c6e27a180e27 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:28.796504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c44a0a88-f98c-4c0a-90e8-c6e27a180e27 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:28.796956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c44a0a88-f98c-4c0a-90e8-c6e27a180e27 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:28.797392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c44a0a88-f98c-4c0a-90e8-c6e27a180e27 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:28.931778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c44a0a88-f98c-4c0a-90e8-c6e27a180e27 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:28.940144 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c44a0a88-f98c-4c0a-90e8-c6e27a180e27 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1" status: 200 len: 1314 microversion: 2.1 time: 0.157365 Oct 11 00:04:28.940656 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3237/6642] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:28 2022] GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:29.264385 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cf5016bb-b359-4b13-9b48-f4dad08d49e1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:29.265725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cf5016bb-b359-4b13-9b48-f4dad08d49e1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:29.269800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:04:29.274291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf5016bb-b359-4b13-9b48-f4dad08d49e1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:29.274797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf5016bb-b359-4b13-9b48-f4dad08d49e1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:29.275245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf5016bb-b359-4b13-9b48-f4dad08d49e1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:29.275950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf5016bb-b359-4b13-9b48-f4dad08d49e1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:29.276406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf5016bb-b359-4b13-9b48-f4dad08d49e1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:29.277070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf5016bb-b359-4b13-9b48-f4dad08d49e1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:29.422852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cf5016bb-b359-4b13-9b48-f4dad08d49e1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:29.431007 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cf5016bb-b359-4b13-9b48-f4dad08d49e1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1395 microversion: 2.1 time: 0.170696 Oct 11 00:04:29.431591 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3406/6643] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:29 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1395 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:29.963358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-19522b7c-280e-47e9-91fc-65ac9873cd88 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:29.963914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-19522b7c-280e-47e9-91fc-65ac9873cd88 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 9e208474-2f04-429e-af29-ea3dcc2927a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:29.972159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19522b7c-280e-47e9-91fc-65ac9873cd88 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:29.972845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19522b7c-280e-47e9-91fc-65ac9873cd88 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:29.973501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19522b7c-280e-47e9-91fc-65ac9873cd88 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:29.974305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19522b7c-280e-47e9-91fc-65ac9873cd88 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:29.974902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19522b7c-280e-47e9-91fc-65ac9873cd88 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:29.975375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-19522b7c-280e-47e9-91fc-65ac9873cd88 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:30.164446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-3994048d-5f3c-40f6-80e8-174506d603af req-7067f14a-9b54-4665-b087-fcb9d9425c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3dda398-e32c-4f3b-a37c-1a5b96546a3b", "name": "network-vif-deleted", "tag": "03d62ae0-2ea6-4c31-a636-2ae5a282f766"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:04:30.191951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3994048d-5f3c-40f6-80e8-174506d603af req-7067f14a-9b54-4665-b087-fcb9d9425c8a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:30.192825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3994048d-5f3c-40f6-80e8-174506d603af req-7067f14a-9b54-4665-b087-fcb9d9425c8a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:30.193582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3994048d-5f3c-40f6-80e8-174506d603af req-7067f14a-9b54-4665-b087-fcb9d9425c8a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:30.209749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-19522b7c-280e-47e9-91fc-65ac9873cd88 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:30.213872 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-3994048d-5f3c-40f6-80e8-174506d603af req-7067f14a-9b54-4665-b087-fcb9d9425c8a service nova] Creating event network-vif-deleted:03d62ae0-2ea6-4c31-a636-2ae5a282f766 for instance d3dda398-e32c-4f3b-a37c-1a5b96546a3b on n-h1-860864-2 Oct 11 00:04:30.218359 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-19522b7c-280e-47e9-91fc-65ac9873cd88 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1" status: 200 len: 1314 microversion: 2.1 time: 0.258188 Oct 11 00:04:30.219088 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3238/6644] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:29 2022] GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:30.220618 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-3994048d-5f3c-40f6-80e8-174506d603af req-7067f14a-9b54-4665-b087-fcb9d9425c8a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060091 Oct 11 00:04:30.221310 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3407/6645] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:04:30.456057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6ac51bd3-a764-4330-8298-ae335de468aa tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:30.456736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6ac51bd3-a764-4330-8298-ae335de468aa tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:30.462962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ac51bd3-a764-4330-8298-ae335de468aa tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:30.463459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ac51bd3-a764-4330-8298-ae335de468aa tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:30.463957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ac51bd3-a764-4330-8298-ae335de468aa tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:30.464614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ac51bd3-a764-4330-8298-ae335de468aa tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:30.465228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ac51bd3-a764-4330-8298-ae335de468aa tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:30.465757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6ac51bd3-a764-4330-8298-ae335de468aa tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:30.528697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6ac51bd3-a764-4330-8298-ae335de468aa tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:30.536948 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6ac51bd3-a764-4330-8298-ae335de468aa tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1187 microversion: 2.1 time: 0.086284 Oct 11 00:04:30.537558 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3239/6646] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:30 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:04:31.244221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8b398ca0-803e-4670-a77e-bc738052404f tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:31.244938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8b398ca0-803e-4670-a77e-bc738052404f tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 9e208474-2f04-429e-af29-ea3dcc2927a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:31.251718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b398ca0-803e-4670-a77e-bc738052404f tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:31.252217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b398ca0-803e-4670-a77e-bc738052404f tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:31.252665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b398ca0-803e-4670-a77e-bc738052404f tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:31.253419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b398ca0-803e-4670-a77e-bc738052404f tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:31.253880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b398ca0-803e-4670-a77e-bc738052404f tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:31.254315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b398ca0-803e-4670-a77e-bc738052404f tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:31.391807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8b398ca0-803e-4670-a77e-bc738052404f tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:31.399972 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8b398ca0-803e-4670-a77e-bc738052404f tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1" status: 200 len: 1314 microversion: 2.1 time: 0.160950 Oct 11 00:04:31.400553 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3408/6647] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:31 2022] GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:31.560362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-27f4a74b-7405-481f-b678-87ac88ecc9d6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:31.561092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-27f4a74b-7405-481f-b678-87ac88ecc9d6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:31.568851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27f4a74b-7405-481f-b678-87ac88ecc9d6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:31.569549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27f4a74b-7405-481f-b678-87ac88ecc9d6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:31.569987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27f4a74b-7405-481f-b678-87ac88ecc9d6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:31.570757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27f4a74b-7405-481f-b678-87ac88ecc9d6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:31.571141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27f4a74b-7405-481f-b678-87ac88ecc9d6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:31.571557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27f4a74b-7405-481f-b678-87ac88ecc9d6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:31.641628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-27f4a74b-7405-481f-b678-87ac88ecc9d6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:31.649614 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-27f4a74b-7405-481f-b678-87ac88ecc9d6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1187 microversion: 2.1 time: 0.093182 Oct 11 00:04:31.650401 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3240/6648] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:31 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:32.424894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c7ef9bd3-c6ff-4a60-a9c9-6b42765d58e0 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:32.425562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c7ef9bd3-c6ff-4a60-a9c9-6b42765d58e0 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 9e208474-2f04-429e-af29-ea3dcc2927a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:32.432518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7ef9bd3-c6ff-4a60-a9c9-6b42765d58e0 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:32.432999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7ef9bd3-c6ff-4a60-a9c9-6b42765d58e0 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:32.433461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7ef9bd3-c6ff-4a60-a9c9-6b42765d58e0 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:32.434295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7ef9bd3-c6ff-4a60-a9c9-6b42765d58e0 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:32.434760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7ef9bd3-c6ff-4a60-a9c9-6b42765d58e0 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:32.435184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7ef9bd3-c6ff-4a60-a9c9-6b42765d58e0 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:32.576413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c7ef9bd3-c6ff-4a60-a9c9-6b42765d58e0 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:32.585166 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c7ef9bd3-c6ff-4a60-a9c9-6b42765d58e0 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1" status: 200 len: 1314 microversion: 2.1 time: 0.164701 Oct 11 00:04:32.585992 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3409/6649] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:32 2022] GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:04:32.675303 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-08e53138-b7b4-49e5-b8af-69e739dc16cb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:32.676116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-08e53138-b7b4-49e5-b8af-69e739dc16cb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:32.684043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08e53138-b7b4-49e5-b8af-69e739dc16cb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:32.684720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08e53138-b7b4-49e5-b8af-69e739dc16cb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:32.685273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08e53138-b7b4-49e5-b8af-69e739dc16cb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:32.686208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08e53138-b7b4-49e5-b8af-69e739dc16cb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:32.686818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08e53138-b7b4-49e5-b8af-69e739dc16cb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:32.687786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08e53138-b7b4-49e5-b8af-69e739dc16cb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:32.769410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-08e53138-b7b4-49e5-b8af-69e739dc16cb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:32.777513 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-08e53138-b7b4-49e5-b8af-69e739dc16cb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1187 microversion: 2.1 time: 0.107401 Oct 11 00:04:32.778369 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3241/6650] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:32 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1187 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:32.829946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-270da455-2077-4cc6-89d7-177edeece3bc req-3d909323-041d-4f14-a30e-eeb76d82e5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e208474-2f04-429e-af29-ea3dcc2927a1", "name": "network-vif-plugged", "status": "completed", "tag": "3af7a8a5-032d-4533-885c-4fe5240d7be4"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:04:32.840066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-270da455-2077-4cc6-89d7-177edeece3bc req-3d909323-041d-4f14-a30e-eeb76d82e5d1 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:32.840832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-270da455-2077-4cc6-89d7-177edeece3bc req-3d909323-041d-4f14-a30e-eeb76d82e5d1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:32.841225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-270da455-2077-4cc6-89d7-177edeece3bc req-3d909323-041d-4f14-a30e-eeb76d82e5d1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:32.854195 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-270da455-2077-4cc6-89d7-177edeece3bc req-3d909323-041d-4f14-a30e-eeb76d82e5d1 service nova] Creating event network-vif-plugged:3af7a8a5-032d-4533-885c-4fe5240d7be4 for instance 9e208474-2f04-429e-af29-ea3dcc2927a1 on n-h2-860864-2 Oct 11 00:04:32.859860 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-270da455-2077-4cc6-89d7-177edeece3bc req-3d909323-041d-4f14-a30e-eeb76d82e5d1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033944 Oct 11 00:04:32.860479 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3410/6651] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:04:33.608247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0582c4cd-8929-42a1-8b2b-59ac159c1613 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:33.609247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0582c4cd-8929-42a1-8b2b-59ac159c1613 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 9e208474-2f04-429e-af29-ea3dcc2927a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:33.615960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0582c4cd-8929-42a1-8b2b-59ac159c1613 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:33.616459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0582c4cd-8929-42a1-8b2b-59ac159c1613 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:33.616899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0582c4cd-8929-42a1-8b2b-59ac159c1613 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:33.617637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0582c4cd-8929-42a1-8b2b-59ac159c1613 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:33.618089 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0582c4cd-8929-42a1-8b2b-59ac159c1613 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:33.618522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0582c4cd-8929-42a1-8b2b-59ac159c1613 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:33.774554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0582c4cd-8929-42a1-8b2b-59ac159c1613 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:33.783247 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0582c4cd-8929-42a1-8b2b-59ac159c1613 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1" status: 200 len: 1314 microversion: 2.1 time: 0.178813 Oct 11 00:04:33.783858 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3242/6652] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:33 2022] GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:33.807973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-318078c1-1add-4993-80f3-f1e3075e7a63 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:33.807973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-318078c1-1add-4993-80f3-f1e3075e7a63 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:33.819267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-318078c1-1add-4993-80f3-f1e3075e7a63 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:33.819486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-318078c1-1add-4993-80f3-f1e3075e7a63 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:33.819758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-318078c1-1add-4993-80f3-f1e3075e7a63 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:33.821651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-318078c1-1add-4993-80f3-f1e3075e7a63 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:33.821651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-318078c1-1add-4993-80f3-f1e3075e7a63 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:33.821651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-318078c1-1add-4993-80f3-f1e3075e7a63 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:33.902533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-318078c1-1add-4993-80f3-f1e3075e7a63 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:33.911940 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-318078c1-1add-4993-80f3-f1e3075e7a63 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1187 microversion: 2.1 time: 0.112459 Oct 11 00:04:33.913182 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3411/6653] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:33 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1187 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:34.806932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9db45b95-a415-45f7-b654-dfdfe8b8dc78 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:34.807494 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9db45b95-a415-45f7-b654-dfdfe8b8dc78 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 9e208474-2f04-429e-af29-ea3dcc2927a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:34.809410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:04:34.817323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9db45b95-a415-45f7-b654-dfdfe8b8dc78 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:34.818002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9db45b95-a415-45f7-b654-dfdfe8b8dc78 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:34.818278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9db45b95-a415-45f7-b654-dfdfe8b8dc78 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:34.818988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9db45b95-a415-45f7-b654-dfdfe8b8dc78 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:34.819449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9db45b95-a415-45f7-b654-dfdfe8b8dc78 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:34.819884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9db45b95-a415-45f7-b654-dfdfe8b8dc78 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:34.940713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-66b1932c-d443-4629-ab44-5ebf0f01096e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:34.941509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-66b1932c-d443-4629-ab44-5ebf0f01096e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:34.943834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:04:34.944648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:04:34.953072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66b1932c-d443-4629-ab44-5ebf0f01096e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:34.953913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66b1932c-d443-4629-ab44-5ebf0f01096e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:34.954364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66b1932c-d443-4629-ab44-5ebf0f01096e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:34.955174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66b1932c-d443-4629-ab44-5ebf0f01096e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:34.955641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66b1932c-d443-4629-ab44-5ebf0f01096e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:34.956071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66b1932c-d443-4629-ab44-5ebf0f01096e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:34.962360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9db45b95-a415-45f7-b654-dfdfe8b8dc78 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:34.971696 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9db45b95-a415-45f7-b654-dfdfe8b8dc78 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1" status: 200 len: 1498 microversion: 2.1 time: 0.168810 Oct 11 00:04:34.973237 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3243/6654] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:34 2022] GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1 => generated 1498 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:35.019915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66b1932c-d443-4629-ab44-5ebf0f01096e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:35.020515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66b1932c-d443-4629-ab44-5ebf0f01096e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:35.021387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66b1932c-d443-4629-ab44-5ebf0f01096e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:35.021929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-66b1932c-d443-4629-ab44-5ebf0f01096e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lazy-loading 'fault' on Instance uuid d3dda398-e32c-4f3b-a37c-1a5b96546a3b {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:04:35.068994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-66b1932c-d443-4629-ab44-5ebf0f01096e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:35.077359 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-66b1932c-d443-4629-ab44-5ebf0f01096e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 200 len: 1146 microversion: 2.1 time: 0.144648 Oct 11 00:04:35.077996 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3412/6655] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:34 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 1146 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:35.444451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cc91c41c-1654-4166-a5ac-3819a11588a2 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:35.444951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cc91c41c-1654-4166-a5ac-3819a11588a2 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 9e208474-2f04-429e-af29-ea3dcc2927a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:35.446842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:04:35.453276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc91c41c-1654-4166-a5ac-3819a11588a2 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:35.453792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc91c41c-1654-4166-a5ac-3819a11588a2 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:35.454236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc91c41c-1654-4166-a5ac-3819a11588a2 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:35.454939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc91c41c-1654-4166-a5ac-3819a11588a2 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:35.455400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc91c41c-1654-4166-a5ac-3819a11588a2 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:35.455826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc91c41c-1654-4166-a5ac-3819a11588a2 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:35.482357 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cc91c41c-1654-4166-a5ac-3819a11588a2 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 9e208474-2f04-429e-af29-ea3dcc2927a1] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:04:35.485281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:04:35.569775 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cc91c41c-1654-4166-a5ac-3819a11588a2 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1" status: 204 len: 0 microversion: 2.1 time: 0.128065 Oct 11 00:04:35.573908 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3244/6656] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:04:35 2022] DELETE /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:04:35.580764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c0e7a681-68cd-42e5-b149-f9ed8add199b tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:35.581452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c0e7a681-68cd-42e5-b149-f9ed8add199b tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 9e208474-2f04-429e-af29-ea3dcc2927a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:35.587688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0e7a681-68cd-42e5-b149-f9ed8add199b tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:35.588176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0e7a681-68cd-42e5-b149-f9ed8add199b tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:35.588613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0e7a681-68cd-42e5-b149-f9ed8add199b tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:35.589311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0e7a681-68cd-42e5-b149-f9ed8add199b tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:35.590032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0e7a681-68cd-42e5-b149-f9ed8add199b tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:35.590456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0e7a681-68cd-42e5-b149-f9ed8add199b tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:35.726603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c0e7a681-68cd-42e5-b149-f9ed8add199b tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:35.735023 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c0e7a681-68cd-42e5-b149-f9ed8add199b tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1" status: 200 len: 1504 microversion: 2.1 time: 0.159130 Oct 11 00:04:35.735600 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3413/6657] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:35 2022] GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:36.100808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-74558ba3-6b82-43c4-af1c-8012ac805fff tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:36.101659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-74558ba3-6b82-43c4-af1c-8012ac805fff tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: d3dda398-e32c-4f3b-a37c-1a5b96546a3b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:36.109710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74558ba3-6b82-43c4-af1c-8012ac805fff tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:36.110198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74558ba3-6b82-43c4-af1c-8012ac805fff tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:36.110633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74558ba3-6b82-43c4-af1c-8012ac805fff tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:36.111324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74558ba3-6b82-43c4-af1c-8012ac805fff tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:36.111775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74558ba3-6b82-43c4-af1c-8012ac805fff tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:36.112197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-74558ba3-6b82-43c4-af1c-8012ac805fff tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:36.127384 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-74558ba3-6b82-43c4-af1c-8012ac805fff tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] HTTP exception thrown: Instance d3dda398-e32c-4f3b-a37c-1a5b96546a3b could not be found. Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-74558ba3-6b82-43c4-af1c-8012ac805fff tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Request method failure captured: Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b HTTP/1.1 Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLLstMFexBVKeRZfAj4OCdRv2YehxcaQe5WSbFwzJkUkY6SJnjfDm2dxiLn9eYpnR--tUOvl2KLmN3ree44KRlI2zh3Ld-tMuW3Hl-usm_NfJhejqaTW-3Rn2txi7roIax1gqv6lgH4fxV8-FpQFyIdTw_tVXsZtCYad971Mm27pxUg Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_be6e417773094ab08c170ca4b69f3742", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TestVolumeBootPattern-451663755 Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: a27b050389ad48089e214ad65eaa83bb Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance d3dda398-e32c-4f3b-a37c-1a5b96546a3b could not be found. Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'd3dda398-e32c-4f3b-a37c-1a5b96546a3b'} Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3dda398-e32c-4f3b-a37c-1a5b96546a3b could not be found. Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3dda398-e32c-4f3b-a37c-1a5b96546a3b could not be found. Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:04:36.129031 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:04:36.134831 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:04:36.134831 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:04:36.134831 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:04:36.134831 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:04:36.134831 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:04:36.134831 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3dda398-e32c-4f3b-a37c-1a5b96546a3b could not be found. Oct 11 00:04:36.134831 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:04:36.134831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-74558ba3-6b82-43c4-af1c-8012ac805fff tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Returning 404 to user: Instance d3dda398-e32c-4f3b-a37c-1a5b96546a3b could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:04:36.134831 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-74558ba3-6b82-43c4-af1c-8012ac805fff tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b" status: 404 len: 111 microversion: 2.1 time: 0.033988 Oct 11 00:04:36.134831 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3245/6658] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:36 2022] GET /compute/v2.1/servers/d3dda398-e32c-4f3b-a37c-1a5b96546a3b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:04:36.760280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-393236c6-4379-4de1-a26a-6f6bd08cbb18 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:36.760884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-393236c6-4379-4de1-a26a-6f6bd08cbb18 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 9e208474-2f04-429e-af29-ea3dcc2927a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:36.768631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-393236c6-4379-4de1-a26a-6f6bd08cbb18 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:36.769125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-393236c6-4379-4de1-a26a-6f6bd08cbb18 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:36.769600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-393236c6-4379-4de1-a26a-6f6bd08cbb18 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:36.770310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-393236c6-4379-4de1-a26a-6f6bd08cbb18 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:36.770770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-393236c6-4379-4de1-a26a-6f6bd08cbb18 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:36.771208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-393236c6-4379-4de1-a26a-6f6bd08cbb18 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:36.933907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-393236c6-4379-4de1-a26a-6f6bd08cbb18 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:36.943409 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-393236c6-4379-4de1-a26a-6f6bd08cbb18 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1" status: 200 len: 1504 microversion: 2.1 time: 0.187795 Oct 11 00:04:36.944316 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3414/6659] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:36 2022] GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1 => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:37.467449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-a0577fda-e980-4b79-8175-892fd643e57b req-d6719f17-6950-42a3-b309-f1cab90d68a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e208474-2f04-429e-af29-ea3dcc2927a1", "name": "network-vif-deleted", "tag": "3af7a8a5-032d-4533-885c-4fe5240d7be4"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:04:37.481847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a0577fda-e980-4b79-8175-892fd643e57b req-d6719f17-6950-42a3-b309-f1cab90d68a5 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:37.482313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a0577fda-e980-4b79-8175-892fd643e57b req-d6719f17-6950-42a3-b309-f1cab90d68a5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:37.484488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a0577fda-e980-4b79-8175-892fd643e57b req-d6719f17-6950-42a3-b309-f1cab90d68a5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:37.500103 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-a0577fda-e980-4b79-8175-892fd643e57b req-d6719f17-6950-42a3-b309-f1cab90d68a5 service nova] Creating event network-vif-deleted:3af7a8a5-032d-4533-885c-4fe5240d7be4 for instance 9e208474-2f04-429e-af29-ea3dcc2927a1 on n-h2-860864-2 Oct 11 00:04:37.506482 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-a0577fda-e980-4b79-8175-892fd643e57b req-d6719f17-6950-42a3-b309-f1cab90d68a5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042956 Oct 11 00:04:37.507362 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3246/6660] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:04:37.969343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d24bb6f2-87c8-4e40-a49d-c90e6abce067 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:37.969961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d24bb6f2-87c8-4e40-a49d-c90e6abce067 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 9e208474-2f04-429e-af29-ea3dcc2927a1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:37.977615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d24bb6f2-87c8-4e40-a49d-c90e6abce067 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:37.978121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d24bb6f2-87c8-4e40-a49d-c90e6abce067 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:37.978564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d24bb6f2-87c8-4e40-a49d-c90e6abce067 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:37.979283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d24bb6f2-87c8-4e40-a49d-c90e6abce067 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:37.979747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d24bb6f2-87c8-4e40-a49d-c90e6abce067 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:37.980179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d24bb6f2-87c8-4e40-a49d-c90e6abce067 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:38.020720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d24bb6f2-87c8-4e40-a49d-c90e6abce067 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:38.021176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d24bb6f2-87c8-4e40-a49d-c90e6abce067 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:38.021655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d24bb6f2-87c8-4e40-a49d-c90e6abce067 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:38.022112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-d24bb6f2-87c8-4e40-a49d-c90e6abce067 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lazy-loading 'fault' on Instance uuid 9e208474-2f04-429e-af29-ea3dcc2927a1 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:04:38.077185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d24bb6f2-87c8-4e40-a49d-c90e6abce067 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b14179e34864b7d9e9dc9f5f0d16316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a7bc18ec81449fb605391db82e3ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:38.088449 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d24bb6f2-87c8-4e40-a49d-c90e6abce067 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1" status: 200 len: 1304 microversion: 2.1 time: 0.124074 Oct 11 00:04:38.089151 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3415/6661] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:37 2022] GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1 => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:39.112987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f0e318a7-55ca-4722-af65-2158441b6ac7 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:39.113771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f0e318a7-55ca-4722-af65-2158441b6ac7 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] [instance: 9e208474-2f04-429e-af29-ea3dcc2927a1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:39.124951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0e318a7-55ca-4722-af65-2158441b6ac7 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:39.125644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0e318a7-55ca-4722-af65-2158441b6ac7 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:39.126088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0e318a7-55ca-4722-af65-2158441b6ac7 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:39.126793 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0e318a7-55ca-4722-af65-2158441b6ac7 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:39.127244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0e318a7-55ca-4722-af65-2158441b6ac7 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:39.127702 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f0e318a7-55ca-4722-af65-2158441b6ac7 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:39.144181 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-f0e318a7-55ca-4722-af65-2158441b6ac7 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] HTTP exception thrown: Instance 9e208474-2f04-429e-af29-ea3dcc2927a1 could not be found. Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f0e318a7-55ca-4722-af65-2158441b6ac7 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Request method failure captured: Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1 HTTP/1.1 Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLLxe6FYInJ-HAVuIuCT8ad3k3FsFKyBbLURkmP5Ne5h2JqhERhOg4h4gnk6tkE7wrjog4TsQAdIh9-QV8zCsRX5PgoRoJdrTnQ6755HvbgwxzgGmHsUf7yi2S6ji8qDngP7WaodBBn1opQB2jLRhRZNOv7Rj8Bc1rYuIGpGlcFJTfU Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: d3a7bc18ec81449fb605391db82e3ba6 Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-VolumesActionsTest-914814718 Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d3a7bc18ec81449fb605391db82e3ba6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3a7bc18ec81449fb605391db82e3ba6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d3a7bc18ec81449fb605391db82e3ba6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d3a7bc18ec81449fb605391db82e3ba6", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-VolumesActionsTest-914814718 Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: d3a7bc18ec81449fb605391db82e3ba6 Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-VolumesActionsTest-914814718 Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-VolumesActionsTest-914814718-project Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 2b14179e34864b7d9e9dc9f5f0d16316 Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-VolumesActionsTest-914814718-project Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 9e208474-2f04-429e-af29-ea3dcc2927a1 could not be found. Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '9e208474-2f04-429e-af29-ea3dcc2927a1'} Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e208474-2f04-429e-af29-ea3dcc2927a1 could not be found. Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e208474-2f04-429e-af29-ea3dcc2927a1 could not be found. Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:04:39.146008 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:04:39.151516 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:04:39.151516 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:04:39.151516 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:04:39.151516 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:04:39.151516 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:04:39.151516 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e208474-2f04-429e-af29-ea3dcc2927a1 could not be found. Oct 11 00:04:39.151516 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:04:39.151516 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f0e318a7-55ca-4722-af65-2158441b6ac7 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] Returning 404 to user: Instance 9e208474-2f04-429e-af29-ea3dcc2927a1 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:04:39.151516 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f0e318a7-55ca-4722-af65-2158441b6ac7 tempest-VolumesActionsTest-914814718 tempest-VolumesActionsTest-914814718-project] 10.222.0.23 "GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1" status: 404 len: 111 microversion: 2.1 time: 0.039038 Oct 11 00:04:39.151516 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3247/6662] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:39 2022] GET /compute/v2.1/servers/9e208474-2f04-429e-af29-ea3dcc2927a1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 00:04:41.287366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9fbafea7-2076-4322-b81d-edc51a51124d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-819941087", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8d61e4f5-33ad-47bc-9d25-fb5b3da41fc4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6b4889cd-925d-4509-9797-a829b845f15b"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:04:41.377732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-9fbafea7-2076-4322-b81d-edc51a51124d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] validate_networks() for [('6b4889cd-925d-4509-9797-a829b845f15b', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:04:41.852201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-9fbafea7-2076-4322-b81d-edc51a51124d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:04:41.852628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-9fbafea7-2076-4322-b81d-edc51a51124d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:04:41.853102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-9fbafea7-2076-4322-b81d-edc51a51124d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:04:41.854010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-9fbafea7-2076-4322-b81d-edc51a51124d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:04:41.854616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-9fbafea7-2076-4322-b81d-edc51a51124d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:04:41.866962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fbafea7-2076-4322-b81d-edc51a51124d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:41.867679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fbafea7-2076-4322-b81d-edc51a51124d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:41.868284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fbafea7-2076-4322-b81d-edc51a51124d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:41.869283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fbafea7-2076-4322-b81d-edc51a51124d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:41.869983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fbafea7-2076-4322-b81d-edc51a51124d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:41.870618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9fbafea7-2076-4322-b81d-edc51a51124d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:41.892284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-9fbafea7-2076-4322-b81d-edc51a51124d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Getting quotas for project be6e417773094ab08c170ca4b69f3742. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:04:41.898212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-9fbafea7-2076-4322-b81d-edc51a51124d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Getting quotas for user a27b050389ad48089e214ad65eaa83bb and project be6e417773094ab08c170ca4b69f3742. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:04:41.971199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9fbafea7-2076-4322-b81d-edc51a51124d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:04:41.973252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9fbafea7-2076-4322-b81d-edc51a51124d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8d61e4f5-33ad-47bc-9d25-fb5b3da41fc4',volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:04:42.137540 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9fbafea7-2076-4322-b81d-edc51a51124d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.854834 Oct 11 00:04:42.138540 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3416/6663] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:04:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:04:42.150986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4d8e2d7f-a6e1-482f-b062-e272b05e7d41 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:42.151654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4d8e2d7f-a6e1-482f-b062-e272b05e7d41 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:42.219687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4d8e2d7f-a6e1-482f-b062-e272b05e7d41 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:42.233741 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4d8e2d7f-a6e1-482f-b062-e272b05e7d41 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1056 microversion: 2.1 time: 0.086266 Oct 11 00:04:42.247132 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3248/6664] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:42 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1056 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:43.262547 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b8cb3a2b-823a-4f49-beff-b9c237dbb6f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:43.265050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b8cb3a2b-823a-4f49-beff-b9c237dbb6f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:43.274445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8cb3a2b-823a-4f49-beff-b9c237dbb6f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:43.275208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8cb3a2b-823a-4f49-beff-b9c237dbb6f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:43.275831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8cb3a2b-823a-4f49-beff-b9c237dbb6f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:43.276739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8cb3a2b-823a-4f49-beff-b9c237dbb6f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:43.277360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8cb3a2b-823a-4f49-beff-b9c237dbb6f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:43.277996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8cb3a2b-823a-4f49-beff-b9c237dbb6f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:43.356389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b8cb3a2b-823a-4f49-beff-b9c237dbb6f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:43.369170 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b8cb3a2b-823a-4f49-beff-b9c237dbb6f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1154 microversion: 2.1 time: 0.113146 Oct 11 00:04:43.385408 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3417/6665] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:43 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1154 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:44.406791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-995ecd41-c675-4bfb-a286-75f9f7d19a39 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:44.409701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-995ecd41-c675-4bfb-a286-75f9f7d19a39 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:44.432347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-995ecd41-c675-4bfb-a286-75f9f7d19a39 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:44.433335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-995ecd41-c675-4bfb-a286-75f9f7d19a39 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:44.434000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-995ecd41-c675-4bfb-a286-75f9f7d19a39 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:44.434810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-995ecd41-c675-4bfb-a286-75f9f7d19a39 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:44.435496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-995ecd41-c675-4bfb-a286-75f9f7d19a39 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:44.436245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-995ecd41-c675-4bfb-a286-75f9f7d19a39 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:44.807864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-995ecd41-c675-4bfb-a286-75f9f7d19a39 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:44.821592 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-995ecd41-c675-4bfb-a286-75f9f7d19a39 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1214 microversion: 2.1 time: 0.418773 Oct 11 00:04:44.822987 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3249/6666] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:44 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1214 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:45.480343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-1081d0c1-f9be-43a8-91b6-cf79bb61b91f req-ff25414c-6fe2-425d-b3a7-30b2fa654eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af", "tag": "dfaae92a-d130-4ac6-a25f-b2881103d73c"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:04:45.497031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1081d0c1-f9be-43a8-91b6-cf79bb61b91f req-ff25414c-6fe2-425d-b3a7-30b2fa654eb5 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:45.499150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1081d0c1-f9be-43a8-91b6-cf79bb61b91f req-ff25414c-6fe2-425d-b3a7-30b2fa654eb5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:45.499885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1081d0c1-f9be-43a8-91b6-cf79bb61b91f req-ff25414c-6fe2-425d-b3a7-30b2fa654eb5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:45.516782 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-1081d0c1-f9be-43a8-91b6-cf79bb61b91f req-ff25414c-6fe2-425d-b3a7-30b2fa654eb5 service nova] Creating event network-changed:dfaae92a-d130-4ac6-a25f-b2881103d73c for instance 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af on n-h2-860864-2 Oct 11 00:04:45.523338 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-1081d0c1-f9be-43a8-91b6-cf79bb61b91f req-ff25414c-6fe2-425d-b3a7-30b2fa654eb5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055518 Oct 11 00:04:45.524551 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3418/6667] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:04:45.851980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3492584b-0093-46e7-9348-19e8113d2118 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:45.853799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3492584b-0093-46e7-9348-19e8113d2118 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:45.878219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3492584b-0093-46e7-9348-19e8113d2118 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:45.886282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3492584b-0093-46e7-9348-19e8113d2118 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:45.888597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3492584b-0093-46e7-9348-19e8113d2118 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:45.891710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3492584b-0093-46e7-9348-19e8113d2118 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:45.893064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3492584b-0093-46e7-9348-19e8113d2118 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:45.893973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3492584b-0093-46e7-9348-19e8113d2118 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:46.195776 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3492584b-0093-46e7-9348-19e8113d2118 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:46.205961 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3492584b-0093-46e7-9348-19e8113d2118 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1214 microversion: 2.1 time: 0.357039 Oct 11 00:04:46.207328 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3250/6668] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:45 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1214 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:47.239238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ab2e8db0-e529-47f3-b850-0b89334d3623 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:47.240745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ab2e8db0-e529-47f3-b850-0b89334d3623 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:47.249612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab2e8db0-e529-47f3-b850-0b89334d3623 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:47.250564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab2e8db0-e529-47f3-b850-0b89334d3623 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:47.251831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab2e8db0-e529-47f3-b850-0b89334d3623 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:47.253143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab2e8db0-e529-47f3-b850-0b89334d3623 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:47.253876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab2e8db0-e529-47f3-b850-0b89334d3623 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:47.254784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab2e8db0-e529-47f3-b850-0b89334d3623 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:47.446377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ab2e8db0-e529-47f3-b850-0b89334d3623 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:47.456528 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ab2e8db0-e529-47f3-b850-0b89334d3623 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1214 microversion: 2.1 time: 0.225573 Oct 11 00:04:47.457919 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3419/6669] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:47 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1214 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:48.481967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8f957923-3db1-4930-b9f3-ffa090e6ebfb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:48.483720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8f957923-3db1-4930-b9f3-ffa090e6ebfb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:48.496381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f957923-3db1-4930-b9f3-ffa090e6ebfb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:48.498276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f957923-3db1-4930-b9f3-ffa090e6ebfb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:48.498976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f957923-3db1-4930-b9f3-ffa090e6ebfb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:48.500360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f957923-3db1-4930-b9f3-ffa090e6ebfb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:48.501070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f957923-3db1-4930-b9f3-ffa090e6ebfb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:48.501835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8f957923-3db1-4930-b9f3-ffa090e6ebfb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:48.687883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8f957923-3db1-4930-b9f3-ffa090e6ebfb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:48.697656 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8f957923-3db1-4930-b9f3-ffa090e6ebfb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1214 microversion: 2.1 time: 0.220230 Oct 11 00:04:48.698485 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3251/6670] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:48 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1214 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:49.722150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-daeb9ddf-3dc2-43f8-9ef5-44e351a758aa tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:49.723336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-daeb9ddf-3dc2-43f8-9ef5-44e351a758aa tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:49.742807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-daeb9ddf-3dc2-43f8-9ef5-44e351a758aa tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:49.743703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-daeb9ddf-3dc2-43f8-9ef5-44e351a758aa tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:49.746001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-daeb9ddf-3dc2-43f8-9ef5-44e351a758aa tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:49.754045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-daeb9ddf-3dc2-43f8-9ef5-44e351a758aa tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:49.754901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-daeb9ddf-3dc2-43f8-9ef5-44e351a758aa tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:49.755376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-daeb9ddf-3dc2-43f8-9ef5-44e351a758aa tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:49.786545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:04:49.937541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-daeb9ddf-3dc2-43f8-9ef5-44e351a758aa tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:49.947509 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-daeb9ddf-3dc2-43f8-9ef5-44e351a758aa tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1214 microversion: 2.1 time: 0.230345 Oct 11 00:04:49.961404 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3420/6671] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:49 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1214 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:50.972438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e670bb33-269f-4c2e-8770-281764029ec2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:50.973689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e670bb33-269f-4c2e-8770-281764029ec2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:50.980736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e670bb33-269f-4c2e-8770-281764029ec2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:50.982247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e670bb33-269f-4c2e-8770-281764029ec2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:50.982695 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e670bb33-269f-4c2e-8770-281764029ec2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:50.983396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e670bb33-269f-4c2e-8770-281764029ec2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:50.983850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e670bb33-269f-4c2e-8770-281764029ec2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:50.984275 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e670bb33-269f-4c2e-8770-281764029ec2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:51.163637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e670bb33-269f-4c2e-8770-281764029ec2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:51.180569 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e670bb33-269f-4c2e-8770-281764029ec2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1202 microversion: 2.1 time: 0.205133 Oct 11 00:04:51.180569 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3252/6672] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:50 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1202 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:52.200786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5932f03a-40cd-4f9b-a23d-e2dd41d601a1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:52.202546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5932f03a-40cd-4f9b-a23d-e2dd41d601a1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:52.211293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:04:52.213734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:04:52.216420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5932f03a-40cd-4f9b-a23d-e2dd41d601a1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:52.217172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5932f03a-40cd-4f9b-a23d-e2dd41d601a1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:52.218055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5932f03a-40cd-4f9b-a23d-e2dd41d601a1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:52.218937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5932f03a-40cd-4f9b-a23d-e2dd41d601a1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:52.220413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5932f03a-40cd-4f9b-a23d-e2dd41d601a1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:52.221043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5932f03a-40cd-4f9b-a23d-e2dd41d601a1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:52.374689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5932f03a-40cd-4f9b-a23d-e2dd41d601a1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:52.382862 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5932f03a-40cd-4f9b-a23d-e2dd41d601a1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1202 microversion: 2.1 time: 0.186560 Oct 11 00:04:52.387657 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3421/6673] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:52 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1202 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:53.410376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c1f8902e-405c-4350-b7ee-1b9133ad35fb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:53.411797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c1f8902e-405c-4350-b7ee-1b9133ad35fb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:53.416261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:04:53.421215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1f8902e-405c-4350-b7ee-1b9133ad35fb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:53.422058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1f8902e-405c-4350-b7ee-1b9133ad35fb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:53.422500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1f8902e-405c-4350-b7ee-1b9133ad35fb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:53.423201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1f8902e-405c-4350-b7ee-1b9133ad35fb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:53.423652 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1f8902e-405c-4350-b7ee-1b9133ad35fb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:53.424075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1f8902e-405c-4350-b7ee-1b9133ad35fb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:53.578060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c1f8902e-405c-4350-b7ee-1b9133ad35fb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:53.588574 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c1f8902e-405c-4350-b7ee-1b9133ad35fb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1202 microversion: 2.1 time: 0.182275 Oct 11 00:04:53.590008 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3253/6674] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:53 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1202 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:54.613018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e5340048-4b22-40fb-8fe6-5d0ccd9f70d7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:54.614076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e5340048-4b22-40fb-8fe6-5d0ccd9f70d7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:54.622925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5340048-4b22-40fb-8fe6-5d0ccd9f70d7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:54.623524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5340048-4b22-40fb-8fe6-5d0ccd9f70d7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:54.624057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5340048-4b22-40fb-8fe6-5d0ccd9f70d7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:54.624774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5340048-4b22-40fb-8fe6-5d0ccd9f70d7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:54.625233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5340048-4b22-40fb-8fe6-5d0ccd9f70d7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:54.625685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5340048-4b22-40fb-8fe6-5d0ccd9f70d7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:54.779666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e5340048-4b22-40fb-8fe6-5d0ccd9f70d7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:54.788428 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e5340048-4b22-40fb-8fe6-5d0ccd9f70d7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1202 microversion: 2.1 time: 0.179553 Oct 11 00:04:54.789198 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3422/6675] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:54 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1202 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:55.827150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e4fb9d88-ed7a-45fc-bc6d-db3ec39e64e3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:55.828523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e4fb9d88-ed7a-45fc-bc6d-db3ec39e64e3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:55.835697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4fb9d88-ed7a-45fc-bc6d-db3ec39e64e3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:55.836222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4fb9d88-ed7a-45fc-bc6d-db3ec39e64e3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:55.836761 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4fb9d88-ed7a-45fc-bc6d-db3ec39e64e3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:55.837835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4fb9d88-ed7a-45fc-bc6d-db3ec39e64e3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:55.838743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4fb9d88-ed7a-45fc-bc6d-db3ec39e64e3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:55.839191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e4fb9d88-ed7a-45fc-bc6d-db3ec39e64e3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:55.995929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e4fb9d88-ed7a-45fc-bc6d-db3ec39e64e3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:56.004421 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e4fb9d88-ed7a-45fc-bc6d-db3ec39e64e3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1202 microversion: 2.1 time: 0.197691 Oct 11 00:04:56.005321 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3254/6676] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:55 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1202 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:57.030936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-063a1652-0f2f-4aed-9986-744ffbaa0e21 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:57.030936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-063a1652-0f2f-4aed-9986-744ffbaa0e21 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:57.037120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-063a1652-0f2f-4aed-9986-744ffbaa0e21 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:57.037654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-063a1652-0f2f-4aed-9986-744ffbaa0e21 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:57.038103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-063a1652-0f2f-4aed-9986-744ffbaa0e21 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:57.038817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-063a1652-0f2f-4aed-9986-744ffbaa0e21 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:57.039278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-063a1652-0f2f-4aed-9986-744ffbaa0e21 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:57.039710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-063a1652-0f2f-4aed-9986-744ffbaa0e21 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:57.191462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-063a1652-0f2f-4aed-9986-744ffbaa0e21 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:57.204756 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-063a1652-0f2f-4aed-9986-744ffbaa0e21 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1202 microversion: 2.1 time: 0.179893 Oct 11 00:04:57.205750 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3423/6677] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:57 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1202 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:58.228080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-05bd8e04-4fa3-42f2-b566-e0c1fdd04413 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:58.228717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-05bd8e04-4fa3-42f2-b566-e0c1fdd04413 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:58.235932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05bd8e04-4fa3-42f2-b566-e0c1fdd04413 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:58.236421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05bd8e04-4fa3-42f2-b566-e0c1fdd04413 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:58.236857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05bd8e04-4fa3-42f2-b566-e0c1fdd04413 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:58.237583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05bd8e04-4fa3-42f2-b566-e0c1fdd04413 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:58.238045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05bd8e04-4fa3-42f2-b566-e0c1fdd04413 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:58.238469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05bd8e04-4fa3-42f2-b566-e0c1fdd04413 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:58.369143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-05bd8e04-4fa3-42f2-b566-e0c1fdd04413 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:58.377625 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-05bd8e04-4fa3-42f2-b566-e0c1fdd04413 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1202 microversion: 2.1 time: 0.153383 Oct 11 00:04:58.378206 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3255/6678] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:58 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:04:59.400213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e7c87b1c-b1ce-4b2d-a00d-fe44c704703f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:04:59.400824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e7c87b1c-b1ce-4b2d-a00d-fe44c704703f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:04:59.406179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:04:59.411285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7c87b1c-b1ce-4b2d-a00d-fe44c704703f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:59.411779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7c87b1c-b1ce-4b2d-a00d-fe44c704703f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:59.412405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7c87b1c-b1ce-4b2d-a00d-fe44c704703f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:59.413113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7c87b1c-b1ce-4b2d-a00d-fe44c704703f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:04:59.413769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7c87b1c-b1ce-4b2d-a00d-fe44c704703f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:04:59.414255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7c87b1c-b1ce-4b2d-a00d-fe44c704703f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:04:59.552233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e7c87b1c-b1ce-4b2d-a00d-fe44c704703f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:04:59.560758 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e7c87b1c-b1ce-4b2d-a00d-fe44c704703f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1202 microversion: 2.1 time: 0.164388 Oct 11 00:04:59.561340 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3424/6679] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:04:59 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1202 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:05:00.584299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aa5bdcc3-ae30-41c8-8251-81210b72c41f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:05:00.584947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aa5bdcc3-ae30-41c8-8251-81210b72c41f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:05:00.593525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa5bdcc3-ae30-41c8-8251-81210b72c41f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:00.594020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa5bdcc3-ae30-41c8-8251-81210b72c41f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:00.594457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa5bdcc3-ae30-41c8-8251-81210b72c41f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:00.595195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa5bdcc3-ae30-41c8-8251-81210b72c41f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:00.595647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa5bdcc3-ae30-41c8-8251-81210b72c41f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:00.596072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aa5bdcc3-ae30-41c8-8251-81210b72c41f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:00.734166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aa5bdcc3-ae30-41c8-8251-81210b72c41f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:05:00.742092 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aa5bdcc3-ae30-41c8-8251-81210b72c41f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1202 microversion: 2.1 time: 0.161752 Oct 11 00:05:00.742804 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3256/6680] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:05:00 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:05:00.898906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-e3019df4-d796-4918-9b62-1948df49476d req-94f2f995-9cc2-487f-91f6-1f341d285bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af", "name": "network-vif-plugged", "status": "completed", "tag": "dfaae92a-d130-4ac6-a25f-b2881103d73c"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:05:00.910344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e3019df4-d796-4918-9b62-1948df49476d req-94f2f995-9cc2-487f-91f6-1f341d285bd2 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:00.911072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e3019df4-d796-4918-9b62-1948df49476d req-94f2f995-9cc2-487f-91f6-1f341d285bd2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:00.911846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e3019df4-d796-4918-9b62-1948df49476d req-94f2f995-9cc2-487f-91f6-1f341d285bd2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:00.925263 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-e3019df4-d796-4918-9b62-1948df49476d req-94f2f995-9cc2-487f-91f6-1f341d285bd2 service nova] Creating event network-vif-plugged:dfaae92a-d130-4ac6-a25f-b2881103d73c for instance 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af on n-h2-860864-2 Oct 11 00:05:00.930913 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-e3019df4-d796-4918-9b62-1948df49476d req-94f2f995-9cc2-487f-91f6-1f341d285bd2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035729 Oct 11 00:05:00.931600 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3425/6681] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:05:01.765608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8be7f956-ffa6-42af-a580-1a81386e9eea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:05:01.766236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8be7f956-ffa6-42af-a580-1a81386e9eea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:05:01.772827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8be7f956-ffa6-42af-a580-1a81386e9eea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:01.773321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8be7f956-ffa6-42af-a580-1a81386e9eea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:01.773787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8be7f956-ffa6-42af-a580-1a81386e9eea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:01.774492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8be7f956-ffa6-42af-a580-1a81386e9eea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:01.774951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8be7f956-ffa6-42af-a580-1a81386e9eea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:01.775375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8be7f956-ffa6-42af-a580-1a81386e9eea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:01.985751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8be7f956-ffa6-42af-a580-1a81386e9eea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:05:01.996820 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8be7f956-ffa6-42af-a580-1a81386e9eea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1202 microversion: 2.1 time: 0.235026 Oct 11 00:05:01.997630 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3257/6682] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:05:01 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1202 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:05:03.020736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7035ac9b-dbc0-4f8a-8da5-26b30f8aef65 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:05:03.021572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7035ac9b-dbc0-4f8a-8da5-26b30f8aef65 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:05:03.029503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7035ac9b-dbc0-4f8a-8da5-26b30f8aef65 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:03.029995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7035ac9b-dbc0-4f8a-8da5-26b30f8aef65 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:03.030436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7035ac9b-dbc0-4f8a-8da5-26b30f8aef65 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:03.031136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7035ac9b-dbc0-4f8a-8da5-26b30f8aef65 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:03.031593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7035ac9b-dbc0-4f8a-8da5-26b30f8aef65 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:03.032022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7035ac9b-dbc0-4f8a-8da5-26b30f8aef65 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:03.182550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7035ac9b-dbc0-4f8a-8da5-26b30f8aef65 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:05:03.190841 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7035ac9b-dbc0-4f8a-8da5-26b30f8aef65 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1390 microversion: 2.1 time: 0.174397 Oct 11 00:05:03.191434 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3426/6683] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:05:03 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1390 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:05:03.215817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e8af1637-821e-4d66-88a9-73b9fa73361b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:05:03.216377 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e8af1637-821e-4d66-88a9-73b9fa73361b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:05:03.223211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8af1637-821e-4d66-88a9-73b9fa73361b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:03.223707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8af1637-821e-4d66-88a9-73b9fa73361b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:03.224130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8af1637-821e-4d66-88a9-73b9fa73361b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:03.224857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8af1637-821e-4d66-88a9-73b9fa73361b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:03.225312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8af1637-821e-4d66-88a9-73b9fa73361b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:03.225756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8af1637-821e-4d66-88a9-73b9fa73361b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:03.368540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e8af1637-821e-4d66-88a9-73b9fa73361b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:05:03.377545 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e8af1637-821e-4d66-88a9-73b9fa73361b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1390 microversion: 2.1 time: 0.166734 Oct 11 00:05:03.378102 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3258/6684] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:05:03 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:05:03.407811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9faa3fa8-200c-498a-9a4e-842b74532b37 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:05:03.408450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9faa3fa8-200c-498a-9a4e-842b74532b37 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:05:03.414622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9faa3fa8-200c-498a-9a4e-842b74532b37 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:03.415105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9faa3fa8-200c-498a-9a4e-842b74532b37 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:03.415735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9faa3fa8-200c-498a-9a4e-842b74532b37 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:03.416429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9faa3fa8-200c-498a-9a4e-842b74532b37 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:03.417077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9faa3fa8-200c-498a-9a4e-842b74532b37 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:03.417323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9faa3fa8-200c-498a-9a4e-842b74532b37 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:03.568468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9faa3fa8-200c-498a-9a4e-842b74532b37 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:05:03.576609 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9faa3fa8-200c-498a-9a4e-842b74532b37 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1390 microversion: 2.1 time: 0.172733 Oct 11 00:05:03.577192 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3427/6685] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:05:03 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1390 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:05:03.599051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-34266fc0-dc12-4db4-80d7-1002c49aee6d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:05:03.599558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-34266fc0-dc12-4db4-80d7-1002c49aee6d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:05:03.606723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34266fc0-dc12-4db4-80d7-1002c49aee6d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:03.607228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34266fc0-dc12-4db4-80d7-1002c49aee6d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:03.607697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34266fc0-dc12-4db4-80d7-1002c49aee6d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:03.608415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34266fc0-dc12-4db4-80d7-1002c49aee6d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:03.608874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34266fc0-dc12-4db4-80d7-1002c49aee6d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:03.609308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34266fc0-dc12-4db4-80d7-1002c49aee6d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:03.633887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-34266fc0-dc12-4db4-80d7-1002c49aee6d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:05:03.713397 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-34266fc0-dc12-4db4-80d7-1002c49aee6d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 204 len: 0 microversion: 2.1 time: 0.117795 Oct 11 00:05:03.714692 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3259/6686] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:05:03 2022] DELETE /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:05:03.722681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dbe8e08c-1a9f-448e-950d-8ed2f03e7172 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:05:03.723305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dbe8e08c-1a9f-448e-950d-8ed2f03e7172 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:05:03.729445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbe8e08c-1a9f-448e-950d-8ed2f03e7172 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:03.730236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbe8e08c-1a9f-448e-950d-8ed2f03e7172 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:03.730806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbe8e08c-1a9f-448e-950d-8ed2f03e7172 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:03.731517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbe8e08c-1a9f-448e-950d-8ed2f03e7172 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:03.731989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbe8e08c-1a9f-448e-950d-8ed2f03e7172 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:03.732426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbe8e08c-1a9f-448e-950d-8ed2f03e7172 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:03.875544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dbe8e08c-1a9f-448e-950d-8ed2f03e7172 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:05:03.883374 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dbe8e08c-1a9f-448e-950d-8ed2f03e7172 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1396 microversion: 2.1 time: 0.164677 Oct 11 00:05:03.883947 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3428/6687] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:05:03 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1396 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:05:04.909446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b5db9f24-94f3-41b2-b3e3-daec3367190d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:05:04.910347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b5db9f24-94f3-41b2-b3e3-daec3367190d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:05:04.918151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5db9f24-94f3-41b2-b3e3-daec3367190d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:04.918643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5db9f24-94f3-41b2-b3e3-daec3367190d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:04.919082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5db9f24-94f3-41b2-b3e3-daec3367190d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:04.919780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5db9f24-94f3-41b2-b3e3-daec3367190d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:04.920232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5db9f24-94f3-41b2-b3e3-daec3367190d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:04.920659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b5db9f24-94f3-41b2-b3e3-daec3367190d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:05.063865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b5db9f24-94f3-41b2-b3e3-daec3367190d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:05:05.072243 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b5db9f24-94f3-41b2-b3e3-daec3367190d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1396 microversion: 2.1 time: 0.168758 Oct 11 00:05:05.072826 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3260/6688] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:05:04 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1396 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:05:06.023179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-ddbd0472-650f-4aef-a5f9-130d3704d869 req-2a3a9997-6bb3-44f9-a40e-b26f59804365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af", "name": "network-vif-deleted", "tag": "dfaae92a-d130-4ac6-a25f-b2881103d73c"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:05:06.034629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ddbd0472-650f-4aef-a5f9-130d3704d869 req-2a3a9997-6bb3-44f9-a40e-b26f59804365 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:06.035118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ddbd0472-650f-4aef-a5f9-130d3704d869 req-2a3a9997-6bb3-44f9-a40e-b26f59804365 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:06.036038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ddbd0472-650f-4aef-a5f9-130d3704d869 req-2a3a9997-6bb3-44f9-a40e-b26f59804365 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:06.058404 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-ddbd0472-650f-4aef-a5f9-130d3704d869 req-2a3a9997-6bb3-44f9-a40e-b26f59804365 service nova] Creating event network-vif-deleted:dfaae92a-d130-4ac6-a25f-b2881103d73c for instance 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af on n-h2-860864-2 Oct 11 00:05:06.065189 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-ddbd0472-650f-4aef-a5f9-130d3704d869 req-2a3a9997-6bb3-44f9-a40e-b26f59804365 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214787 Oct 11 00:05:06.065189 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3429/6689] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:05:06.098387 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4b510568-8873-41ba-8afc-69f6ff99d592 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:05:06.099019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4b510568-8873-41ba-8afc-69f6ff99d592 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:05:06.101842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:05:06.113820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b510568-8873-41ba-8afc-69f6ff99d592 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:06.114526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b510568-8873-41ba-8afc-69f6ff99d592 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:06.115128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b510568-8873-41ba-8afc-69f6ff99d592 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:06.115992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b510568-8873-41ba-8afc-69f6ff99d592 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:06.116637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b510568-8873-41ba-8afc-69f6ff99d592 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:06.117225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b510568-8873-41ba-8afc-69f6ff99d592 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:06.122954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:05:06.187101 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4b510568-8873-41ba-8afc-69f6ff99d592 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:05:06.197976 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4b510568-8873-41ba-8afc-69f6ff99d592 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1187 microversion: 2.1 time: 0.104156 Oct 11 00:05:06.208201 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3261/6690] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:05:06 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1187 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:05:07.223187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-841b5c76-e9a6-4032-a453-67adabe767c5 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:05:07.224036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-841b5c76-e9a6-4032-a453-67adabe767c5 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:05:07.231169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-841b5c76-e9a6-4032-a453-67adabe767c5 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:07.231669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-841b5c76-e9a6-4032-a453-67adabe767c5 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:07.232118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-841b5c76-e9a6-4032-a453-67adabe767c5 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:07.233018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-841b5c76-e9a6-4032-a453-67adabe767c5 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:07.233514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-841b5c76-e9a6-4032-a453-67adabe767c5 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:07.233951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-841b5c76-e9a6-4032-a453-67adabe767c5 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:07.300477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-841b5c76-e9a6-4032-a453-67adabe767c5 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:05:07.310198 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-841b5c76-e9a6-4032-a453-67adabe767c5 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1187 microversion: 2.1 time: 0.091675 Oct 11 00:05:07.310791 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3430/6691] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:05:07 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:05:08.333971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ad5a04d6-894a-4858-8353-9c069a40e616 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:05:08.335332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ad5a04d6-894a-4858-8353-9c069a40e616 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:05:08.343154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad5a04d6-894a-4858-8353-9c069a40e616 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:08.343648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad5a04d6-894a-4858-8353-9c069a40e616 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:08.344085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad5a04d6-894a-4858-8353-9c069a40e616 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:08.344793 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad5a04d6-894a-4858-8353-9c069a40e616 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:08.345247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad5a04d6-894a-4858-8353-9c069a40e616 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:08.346045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ad5a04d6-894a-4858-8353-9c069a40e616 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:08.420795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ad5a04d6-894a-4858-8353-9c069a40e616 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:05:08.430306 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ad5a04d6-894a-4858-8353-9c069a40e616 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1187 microversion: 2.1 time: 0.100196 Oct 11 00:05:08.431458 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3262/6692] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:05:08 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1187 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:05:09.455983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-db0b2851-6c75-4e2b-87f3-e598abf3d9bf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:05:09.457327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-db0b2851-6c75-4e2b-87f3-e598abf3d9bf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:05:09.465671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db0b2851-6c75-4e2b-87f3-e598abf3d9bf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:09.466462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db0b2851-6c75-4e2b-87f3-e598abf3d9bf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:09.467082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db0b2851-6c75-4e2b-87f3-e598abf3d9bf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:09.468001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db0b2851-6c75-4e2b-87f3-e598abf3d9bf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:09.468636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db0b2851-6c75-4e2b-87f3-e598abf3d9bf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:09.469233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db0b2851-6c75-4e2b-87f3-e598abf3d9bf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:09.535345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-db0b2851-6c75-4e2b-87f3-e598abf3d9bf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:05:09.543982 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-db0b2851-6c75-4e2b-87f3-e598abf3d9bf tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1187 microversion: 2.1 time: 0.091750 Oct 11 00:05:09.544584 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3431/6693] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:05:09 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1187 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:05:10.571491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a9d6a6bc-4fdc-4c2d-9448-b6ed8c302254 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:05:10.572764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a9d6a6bc-4fdc-4c2d-9448-b6ed8c302254 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:05:10.580578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9d6a6bc-4fdc-4c2d-9448-b6ed8c302254 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:10.581067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9d6a6bc-4fdc-4c2d-9448-b6ed8c302254 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:10.581532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9d6a6bc-4fdc-4c2d-9448-b6ed8c302254 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:10.582233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9d6a6bc-4fdc-4c2d-9448-b6ed8c302254 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:10.582688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9d6a6bc-4fdc-4c2d-9448-b6ed8c302254 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:10.583110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9d6a6bc-4fdc-4c2d-9448-b6ed8c302254 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:10.614607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9d6a6bc-4fdc-4c2d-9448-b6ed8c302254 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:10.615089 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9d6a6bc-4fdc-4c2d-9448-b6ed8c302254 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:10.615529 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a9d6a6bc-4fdc-4c2d-9448-b6ed8c302254 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:10.615976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-a9d6a6bc-4fdc-4c2d-9448-b6ed8c302254 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lazy-loading 'fault' on Instance uuid 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:05:10.664479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a9d6a6bc-4fdc-4c2d-9448-b6ed8c302254 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:05:10.673064 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a9d6a6bc-4fdc-4c2d-9448-b6ed8c302254 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 200 len: 1192 microversion: 2.1 time: 0.106129 Oct 11 00:05:10.673899 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3263/6694] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:05:10 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 1192 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:05:11.699523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8e1416e4-0edf-4982-b345-f2253bc93461 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:05:11.700566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8e1416e4-0edf-4982-b345-f2253bc93461 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:05:11.711616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e1416e4-0edf-4982-b345-f2253bc93461 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:11.712377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e1416e4-0edf-4982-b345-f2253bc93461 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:11.713152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e1416e4-0edf-4982-b345-f2253bc93461 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:11.715511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e1416e4-0edf-4982-b345-f2253bc93461 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:11.716005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e1416e4-0edf-4982-b345-f2253bc93461 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:11.716517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e1416e4-0edf-4982-b345-f2253bc93461 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:11.734537 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-8e1416e4-0edf-4982-b345-f2253bc93461 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] HTTP exception thrown: Instance 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af could not be found. Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8e1416e4-0edf-4982-b345-f2253bc93461 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Request method failure captured: Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af HTTP/1.1 Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLLstMFexBVKeRZfAj4OCdRv2YehxcaQe5WSbFwzJkUkY6SJnjfDm2dxiLn9eYpnR--tUOvl2KLmN3ree44KRlI2zh3Ld-tMuW3Hl-usm_NfJhejqaTW-3Rn2txi7roIax1gqv6lgH4fxV8-FpQFyIdTw_tVXsZtCYad971Mm27pxUg Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_be6e417773094ab08c170ca4b69f3742", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestVolumeBootPattern-451663755 Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a27b050389ad48089e214ad65eaa83bb Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af could not be found. Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af'} Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af could not be found. Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af could not be found. Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:05:11.736265 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:05:11.741961 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:05:11.741961 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:05:11.741961 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:05:11.741961 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:05:11.741961 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:05:11.741961 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af could not be found. Oct 11 00:05:11.741961 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:05:11.744164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8e1416e4-0edf-4982-b345-f2253bc93461 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Returning 404 to user: Instance 3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:05:11.745083 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8e1416e4-0edf-4982-b345-f2253bc93461 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af" status: 404 len: 111 microversion: 2.1 time: 0.051428 Oct 11 00:05:11.748236 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3432/6695] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:05:11 2022] GET /compute/v2.1/servers/3cd8a39a-65a3-47f9-a0dd-3a1e70afa6af => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:05:36.253290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f3bdf2c6-13a1-4f91-9584-ece58a673dce tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1436740099", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d3f00b23-4a37-4cf5-a451-9f66cf8d3330", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "6b4889cd-925d-4509-9797-a829b845f15b"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:05:36.264162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=7 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:05:36.264820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=19 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:05:36.349986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-f3bdf2c6-13a1-4f91-9584-ece58a673dce tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] validate_networks() for [('6b4889cd-925d-4509-9797-a829b845f15b', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:05:46.269354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:05:59.676943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=17 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:05:59.679845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=62 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:05:59.808099 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:05:59.808099 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:05:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 11 00:05:59.810263 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:05:59.810420 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:05:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 11 00:05:59.970250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9625d8cd-5e53-4b3c-bc18-47e8c74c1426 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:05:59.971491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9625d8cd-5e53-4b3c-bc18-47e8c74c1426 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [instance: df93df28-1536-4fe4-8a52-1477664665c3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:05:59.984471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9625d8cd-5e53-4b3c-bc18-47e8c74c1426 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:59.985335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9625d8cd-5e53-4b3c-bc18-47e8c74c1426 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:59.985826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9625d8cd-5e53-4b3c-bc18-47e8c74c1426 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:05:59.988674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9625d8cd-5e53-4b3c-bc18-47e8c74c1426 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:05:59.989433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9625d8cd-5e53-4b3c-bc18-47e8c74c1426 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:05:59.992324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9625d8cd-5e53-4b3c-bc18-47e8c74c1426 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:06:00.033341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9625d8cd-5e53-4b3c-bc18-47e8c74c1426 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [instance: df93df28-1536-4fe4-8a52-1477664665c3] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:06:00.136484 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9625d8cd-5e53-4b3c-bc18-47e8c74c1426 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "DELETE /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3" status: 204 len: 0 microversion: 2.1 time: 0.462663 Oct 11 00:06:00.136484 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3433/6696] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:05:59 2022] DELETE /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 00:06:00.145031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b02208f9-e0a7-4455-bea0-6424b1e2b847 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:06:00.145937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b02208f9-e0a7-4455-bea0-6424b1e2b847 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [instance: df93df28-1536-4fe4-8a52-1477664665c3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:06:00.152997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b02208f9-e0a7-4455-bea0-6424b1e2b847 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:06:00.153540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b02208f9-e0a7-4455-bea0-6424b1e2b847 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:06:00.154023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b02208f9-e0a7-4455-bea0-6424b1e2b847 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:06:00.154742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b02208f9-e0a7-4455-bea0-6424b1e2b847 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:06:00.155226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b02208f9-e0a7-4455-bea0-6424b1e2b847 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:06:00.155772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b02208f9-e0a7-4455-bea0-6424b1e2b847 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:06:00.331945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b02208f9-e0a7-4455-bea0-6424b1e2b847 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a713546d5688431e963cd7a0a6de512d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7d94bdadb487380d28c69dfefaf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:06:00.342164 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b02208f9-e0a7-4455-bea0-6424b1e2b847 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3" status: 200 len: 1730 microversion: 2.1 time: 0.201445 Oct 11 00:06:00.343045 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3434/6697] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:06:00 2022] GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3 => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:06:01.368212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-12685b28-b667-4e04-94c7-2737ebce51ed tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:06:01.368954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-12685b28-b667-4e04-94c7-2737ebce51ed tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [instance: df93df28-1536-4fe4-8a52-1477664665c3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:06:01.375602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12685b28-b667-4e04-94c7-2737ebce51ed tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:06:01.376353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12685b28-b667-4e04-94c7-2737ebce51ed tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:06:01.376968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12685b28-b667-4e04-94c7-2737ebce51ed tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:06:01.378094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12685b28-b667-4e04-94c7-2737ebce51ed tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:06:01.378749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12685b28-b667-4e04-94c7-2737ebce51ed tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:06:01.379499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12685b28-b667-4e04-94c7-2737ebce51ed tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:06:01.602226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-12685b28-b667-4e04-94c7-2737ebce51ed tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a713546d5688431e963cd7a0a6de512d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7d94bdadb487380d28c69dfefaf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:06:01.615958 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-12685b28-b667-4e04-94c7-2737ebce51ed tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3" status: 200 len: 1730 microversion: 2.1 time: 0.252609 Oct 11 00:06:01.616181 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3435/6698] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:06:01 2022] GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3 => generated 1730 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:06:02.641237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f22cebf9-b22f-4d64-b125-7239e379d600 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:06:02.642667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f22cebf9-b22f-4d64-b125-7239e379d600 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [instance: df93df28-1536-4fe4-8a52-1477664665c3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:06:02.665990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f22cebf9-b22f-4d64-b125-7239e379d600 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:06:02.666758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f22cebf9-b22f-4d64-b125-7239e379d600 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:06:02.667367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f22cebf9-b22f-4d64-b125-7239e379d600 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:06:02.668283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f22cebf9-b22f-4d64-b125-7239e379d600 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:06:02.670858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f22cebf9-b22f-4d64-b125-7239e379d600 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:06:02.671506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f22cebf9-b22f-4d64-b125-7239e379d600 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:06:02.816585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f22cebf9-b22f-4d64-b125-7239e379d600 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a713546d5688431e963cd7a0a6de512d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7d94bdadb487380d28c69dfefaf1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:06:02.834436 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f22cebf9-b22f-4d64-b125-7239e379d600 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3" status: 200 len: 1663 microversion: 2.1 time: 0.196327 Oct 11 00:06:02.835707 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3436/6699] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:06:02 2022] GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3 => generated 1663 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:06:02.910836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-19ff7622-b797-4f9a-9b20-f5836fa7eb58 req-9463224c-5609-4f57-8910-9d29fa86463e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df93df28-1536-4fe4-8a52-1477664665c3", "name": "network-vif-deleted", "tag": "f618f36c-1663-4379-81af-82742018100d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:06:02.941130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-19ff7622-b797-4f9a-9b20-f5836fa7eb58 req-9463224c-5609-4f57-8910-9d29fa86463e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:06:02.944245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-19ff7622-b797-4f9a-9b20-f5836fa7eb58 req-9463224c-5609-4f57-8910-9d29fa86463e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:06:02.944993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-19ff7622-b797-4f9a-9b20-f5836fa7eb58 req-9463224c-5609-4f57-8910-9d29fa86463e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:06:02.981779 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-19ff7622-b797-4f9a-9b20-f5836fa7eb58 req-9463224c-5609-4f57-8910-9d29fa86463e service nova] Creating event network-vif-deleted:f618f36c-1663-4379-81af-82742018100d for instance df93df28-1536-4fe4-8a52-1477664665c3 on n-h1-860864-2 Oct 11 00:06:03.000038 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-19ff7622-b797-4f9a-9b20-f5836fa7eb58 req-9463224c-5609-4f57-8910-9d29fa86463e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105480 Oct 11 00:06:03.001395 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3437/6700] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:06:03.872404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b4f269d6-3925-4636-ab3b-d1a5827e9908 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:06:03.873176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b4f269d6-3925-4636-ab3b-d1a5827e9908 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [instance: df93df28-1536-4fe4-8a52-1477664665c3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:06:03.883554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4f269d6-3925-4636-ab3b-d1a5827e9908 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:06:03.884420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4f269d6-3925-4636-ab3b-d1a5827e9908 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:06:03.885025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4f269d6-3925-4636-ab3b-d1a5827e9908 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:06:03.886190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4f269d6-3925-4636-ab3b-d1a5827e9908 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:06:03.888123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4f269d6-3925-4636-ab3b-d1a5827e9908 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:06:03.888738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4f269d6-3925-4636-ab3b-d1a5827e9908 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:06:03.909790 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-b4f269d6-3925-4636-ab3b-d1a5827e9908 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] HTTP exception thrown: Instance df93df28-1536-4fe4-8a52-1477664665c3 could not be found. Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b4f269d6-3925-4636-ab3b-d1a5827e9908 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Request method failure captured: Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3 HTTP/1.1 Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLIUcdQwMCE4ucDzICjuaiblHKX4WryLo5GWkqJxyTeFgL3VwUWhODeEhIqXLuXpGYnqRertmxRSJ9Ak83Yd5TbYnKcU9n9KrwgljgobdYLOARikhRVFQsdf7mt6PHvwtGo-A9kN9swU3DV3wUtZzGMlrgh_GCjH7nFxrzTnSZsrMZE Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: c9d7d94bdadb487380d28c69dfefaf1b Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestServerBasicOps-821609864 Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c9d7d94bdadb487380d28c69dfefaf1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d7d94bdadb487380d28c69dfefaf1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d7d94bdadb487380d28c69dfefaf1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c9d7d94bdadb487380d28c69dfefaf1b", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestServerBasicOps-821609864 Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: c9d7d94bdadb487380d28c69dfefaf1b Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestServerBasicOps-821609864 Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestServerBasicOps-821609864-project Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a713546d5688431e963cd7a0a6de512d Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestServerBasicOps-821609864-project Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance df93df28-1536-4fe4-8a52-1477664665c3 could not be found. Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'df93df28-1536-4fe4-8a52-1477664665c3'} Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df93df28-1536-4fe4-8a52-1477664665c3 could not be found. Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df93df28-1536-4fe4-8a52-1477664665c3 could not be found. Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:06:03.914416 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:06:03.921207 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:06:03.921207 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:06:03.921207 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:06:03.921207 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:06:03.921207 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:06:03.921207 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df93df28-1536-4fe4-8a52-1477664665c3 could not be found. Oct 11 00:06:03.921207 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:06:03.922738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b4f269d6-3925-4636-ab3b-d1a5827e9908 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Returning 404 to user: Instance df93df28-1536-4fe4-8a52-1477664665c3 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:06:03.925018 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b4f269d6-3925-4636-ab3b-d1a5827e9908 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3" status: 404 len: 111 microversion: 2.1 time: 0.061357 Oct 11 00:06:03.928086 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3438/6701] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:06:03 2022] GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:06:04.780063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9c92b56b-81e8-47e6-9383-9dd7c7c9c15d tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:06:04.782036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9c92b56b-81e8-47e6-9383-9dd7c7c9c15d tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [instance: df93df28-1536-4fe4-8a52-1477664665c3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:06:04.817026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c92b56b-81e8-47e6-9383-9dd7c7c9c15d tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:06:04.818442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c92b56b-81e8-47e6-9383-9dd7c7c9c15d tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:06:04.819087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c92b56b-81e8-47e6-9383-9dd7c7c9c15d tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:06:04.829314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c92b56b-81e8-47e6-9383-9dd7c7c9c15d tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:06:04.829939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c92b56b-81e8-47e6-9383-9dd7c7c9c15d tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:06:04.830397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c92b56b-81e8-47e6-9383-9dd7c7c9c15d tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:06:04.863080 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-9c92b56b-81e8-47e6-9383-9dd7c7c9c15d tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] HTTP exception thrown: Instance df93df28-1536-4fe4-8a52-1477664665c3 could not be found. Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9c92b56b-81e8-47e6-9383-9dd7c7c9c15d tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Request method failure captured: Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3 HTTP/1.1 Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLIUcdQwMCE4ucDzICjuaiblHKX4WryLo5GWkqJxyTeFgL3VwUWhODeEhIqXLuXpGYnqRertmxRSJ9Ak83Yd5TbYnKcU9n9KrwgljgobdYLOARikhRVFQsdf7mt6PHvwtGo-A9kN9swU3DV3wUtZzGMlrgh_GCjH7nFxrzTnSZsrMZE Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: c9d7d94bdadb487380d28c69dfefaf1b Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestServerBasicOps-821609864 Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c9d7d94bdadb487380d28c69dfefaf1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d7d94bdadb487380d28c69dfefaf1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d7d94bdadb487380d28c69dfefaf1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c9d7d94bdadb487380d28c69dfefaf1b", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestServerBasicOps-821609864 Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: c9d7d94bdadb487380d28c69dfefaf1b Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestServerBasicOps-821609864 Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestServerBasicOps-821609864-project Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a713546d5688431e963cd7a0a6de512d Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestServerBasicOps-821609864-project Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance df93df28-1536-4fe4-8a52-1477664665c3 could not be found. Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'df93df28-1536-4fe4-8a52-1477664665c3'} Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df93df28-1536-4fe4-8a52-1477664665c3 could not be found. Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:06:04.864955 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:06:04.875852 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df93df28-1536-4fe4-8a52-1477664665c3 could not be found. Oct 11 00:06:04.875852 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:06:04.875852 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:06:04.875852 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:06:04.875852 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:06:04.875852 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:06:04.875852 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:06:04.875852 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:06:04.875852 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:06:04.875852 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df93df28-1536-4fe4-8a52-1477664665c3 could not be found. Oct 11 00:06:04.875852 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:06:04.877198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9c92b56b-81e8-47e6-9383-9dd7c7c9c15d tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Returning 404 to user: Instance df93df28-1536-4fe4-8a52-1477664665c3 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:06:04.878297 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9c92b56b-81e8-47e6-9383-9dd7c7c9c15d tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "DELETE /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3" status: 404 len: 111 microversion: 2.1 time: 0.104260 Oct 11 00:06:04.879427 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3439/6702] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:06:04 2022] DELETE /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:06:04.898032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-173e7a59-c3b8-4028-ad16-b8fb27bbd405 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:06:04.898798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-173e7a59-c3b8-4028-ad16-b8fb27bbd405 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [instance: df93df28-1536-4fe4-8a52-1477664665c3] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:06:04.915050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-173e7a59-c3b8-4028-ad16-b8fb27bbd405 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:06:04.915345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-173e7a59-c3b8-4028-ad16-b8fb27bbd405 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:06:04.915747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-173e7a59-c3b8-4028-ad16-b8fb27bbd405 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:06:04.917773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-173e7a59-c3b8-4028-ad16-b8fb27bbd405 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:06:04.923766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-173e7a59-c3b8-4028-ad16-b8fb27bbd405 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:06:04.924413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-173e7a59-c3b8-4028-ad16-b8fb27bbd405 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:06:04.941894 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-173e7a59-c3b8-4028-ad16-b8fb27bbd405 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] HTTP exception thrown: Instance df93df28-1536-4fe4-8a52-1477664665c3 could not be found. Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-173e7a59-c3b8-4028-ad16-b8fb27bbd405 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Request method failure captured: Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3 HTTP/1.1 Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLIUcdQwMCE4ucDzICjuaiblHKX4WryLo5GWkqJxyTeFgL3VwUWhODeEhIqXLuXpGYnqRertmxRSJ9Ak83Yd5TbYnKcU9n9KrwgljgobdYLOARikhRVFQsdf7mt6PHvwtGo-A9kN9swU3DV3wUtZzGMlrgh_GCjH7nFxrzTnSZsrMZE Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: c9d7d94bdadb487380d28c69dfefaf1b Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestServerBasicOps-821609864 Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c9d7d94bdadb487380d28c69dfefaf1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d7d94bdadb487380d28c69dfefaf1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c9d7d94bdadb487380d28c69dfefaf1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c9d7d94bdadb487380d28c69dfefaf1b", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestServerBasicOps-821609864 Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: c9d7d94bdadb487380d28c69dfefaf1b Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestServerBasicOps-821609864 Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestServerBasicOps-821609864-project Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a713546d5688431e963cd7a0a6de512d Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestServerBasicOps-821609864-project Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance df93df28-1536-4fe4-8a52-1477664665c3 could not be found. Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'df93df28-1536-4fe4-8a52-1477664665c3'} Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df93df28-1536-4fe4-8a52-1477664665c3 could not be found. Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df93df28-1536-4fe4-8a52-1477664665c3 could not be found. Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:06:04.944233 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:06:04.953292 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:06:04.953292 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:06:04.953292 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:06:04.953292 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:06:04.953292 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:06:04.953292 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df93df28-1536-4fe4-8a52-1477664665c3 could not be found. Oct 11 00:06:04.953292 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:06:04.953292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-173e7a59-c3b8-4028-ad16-b8fb27bbd405 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Returning 404 to user: Instance df93df28-1536-4fe4-8a52-1477664665c3 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:06:04.953292 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-173e7a59-c3b8-4028-ad16-b8fb27bbd405 tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3" status: 404 len: 111 microversion: 2.1 time: 0.061445 Oct 11 00:06:04.953292 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3440/6703] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:06:04 2022] GET /compute/v2.1/servers/df93df28-1536-4fe4-8a52-1477664665c3 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:06:05.269504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8ba2de7b-fe02-4038-9c64-ca8a5edeeeaf tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] Calling method '.version_select at 0x7f66339f41f0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:06:05.278305 n-d-860864-2 devstack@n-api.service[120613]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8ba2de7b-fe02-4038-9c64-ca8a5edeeeaf tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [9b518037-c822-4751-8c32-b8f9db7be4a5] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 00:06:06.289013 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [None req-8ba2de7b-fe02-4038-9c64-ca8a5edeeeaf tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] [9b518037-c822-4751-8c32-b8f9db7be4a5] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 60996. Oct 11 00:06:06.314319 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8ba2de7b-fe02-4038-9c64-ca8a5edeeeaf tempest-TestServerBasicOps-821609864 tempest-TestServerBasicOps-821609864-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-134761894" status: 202 len: 0 microversion: 2.1 time: 1.049490 Oct 11 00:06:06.323286 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3441/6704] 10.222.0.23 () {58 vars in 1251 bytes} [Tue Oct 11 00:06:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-134761894 => generated 0 bytes in 1060 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 00:06:59.850947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-42e7fa42-e9eb-4c7c-9daa-277ccb7373f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1425101635", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9aba274f-e194-4337-8e4e-1a31a5e3c6b0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "6b4889cd-925d-4509-9797-a829b845f15b"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:06:59.861784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:06:59.863044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:06:59.864734 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 11 00:06:59.924897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-42e7fa42-e9eb-4c7c-9daa-277ccb7373f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] validate_networks() for [('6b4889cd-925d-4509-9797-a829b845f15b', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:07:00.358264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-42e7fa42-e9eb-4c7c-9daa-277ccb7373f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:07:00.358692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-42e7fa42-e9eb-4c7c-9daa-277ccb7373f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:07:00.359169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-42e7fa42-e9eb-4c7c-9daa-277ccb7373f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:07:00.359580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-42e7fa42-e9eb-4c7c-9daa-277ccb7373f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:07:00.360513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-42e7fa42-e9eb-4c7c-9daa-277ccb7373f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:07:00.371794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42e7fa42-e9eb-4c7c-9daa-277ccb7373f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:00.372293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42e7fa42-e9eb-4c7c-9daa-277ccb7373f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:00.372735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42e7fa42-e9eb-4c7c-9daa-277ccb7373f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:00.373492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42e7fa42-e9eb-4c7c-9daa-277ccb7373f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:00.373950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42e7fa42-e9eb-4c7c-9daa-277ccb7373f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:00.374372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42e7fa42-e9eb-4c7c-9daa-277ccb7373f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:00.394720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-42e7fa42-e9eb-4c7c-9daa-277ccb7373f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Getting quotas for project be6e417773094ab08c170ca4b69f3742. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:07:00.400753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-42e7fa42-e9eb-4c7c-9daa-277ccb7373f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Getting quotas for user a27b050389ad48089e214ad65eaa83bb and project be6e417773094ab08c170ca4b69f3742. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:07:00.465783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-42e7fa42-e9eb-4c7c-9daa-277ccb7373f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:07:00.467924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-42e7fa42-e9eb-4c7c-9daa-277ccb7373f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9aba274f-e194-4337-8e4e-1a31a5e3c6b0',volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:07:00.607012 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-42e7fa42-e9eb-4c7c-9daa-277ccb7373f4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760226 Oct 11 00:07:00.609242 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3442/6705] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:06:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 00:07:00.621253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0501dd5a-2a11-4795-bbea-c5d00e78e279 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:00.623109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0501dd5a-2a11-4795-bbea-c5d00e78e279 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:00.681504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0501dd5a-2a11-4795-bbea-c5d00e78e279 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:00.689891 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0501dd5a-2a11-4795-bbea-c5d00e78e279 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 200 len: 1071 microversion: 2.1 time: 0.072694 Oct 11 00:07:00.690693 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3443/6706] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:00 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 1071 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:01.714211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a43d13d5-627a-4f13-9559-768332ae3b47 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:01.714951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a43d13d5-627a-4f13-9559-768332ae3b47 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:01.727797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a43d13d5-627a-4f13-9559-768332ae3b47 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:01.728198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a43d13d5-627a-4f13-9559-768332ae3b47 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:01.728644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a43d13d5-627a-4f13-9559-768332ae3b47 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:01.729361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a43d13d5-627a-4f13-9559-768332ae3b47 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:01.729866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a43d13d5-627a-4f13-9559-768332ae3b47 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:01.730280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a43d13d5-627a-4f13-9559-768332ae3b47 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:01.816272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a43d13d5-627a-4f13-9559-768332ae3b47 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:01.828004 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a43d13d5-627a-4f13-9559-768332ae3b47 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 200 len: 1169 microversion: 2.1 time: 0.118126 Oct 11 00:07:01.829405 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3444/6707] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:01 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 1169 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:02.853006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-390998af-dc56-419b-bbdc-2a8682a4847c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:02.854426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-390998af-dc56-419b-bbdc-2a8682a4847c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:02.862114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-390998af-dc56-419b-bbdc-2a8682a4847c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:02.862916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-390998af-dc56-419b-bbdc-2a8682a4847c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:02.863537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-390998af-dc56-419b-bbdc-2a8682a4847c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:02.864451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-390998af-dc56-419b-bbdc-2a8682a4847c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:02.865083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-390998af-dc56-419b-bbdc-2a8682a4847c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:02.865720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-390998af-dc56-419b-bbdc-2a8682a4847c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:03.023143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-390998af-dc56-419b-bbdc-2a8682a4847c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:03.032146 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-390998af-dc56-419b-bbdc-2a8682a4847c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 200 len: 1229 microversion: 2.1 time: 0.183799 Oct 11 00:07:03.033707 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3445/6708] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:02 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 1229 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:07:03.722311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-00024374-ca91-466f-8112-e102aac1244c req-10cba31a-86d0-40b1-af3b-897ee4522840 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21dbd311-94d7-4edf-8827-6ac59eb8e959", "tag": "67d70e37-7754-4e7f-9de9-17db1cf0b73d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:07:03.737257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-00024374-ca91-466f-8112-e102aac1244c req-10cba31a-86d0-40b1-af3b-897ee4522840 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:03.738288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-00024374-ca91-466f-8112-e102aac1244c req-10cba31a-86d0-40b1-af3b-897ee4522840 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:03.738915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-00024374-ca91-466f-8112-e102aac1244c req-10cba31a-86d0-40b1-af3b-897ee4522840 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:03.752783 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-00024374-ca91-466f-8112-e102aac1244c req-10cba31a-86d0-40b1-af3b-897ee4522840 service nova] Creating event network-changed:67d70e37-7754-4e7f-9de9-17db1cf0b73d for instance 21dbd311-94d7-4edf-8827-6ac59eb8e959 on n-h1-860864-2 Oct 11 00:07:03.760512 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-00024374-ca91-466f-8112-e102aac1244c req-10cba31a-86d0-40b1-af3b-897ee4522840 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042683 Oct 11 00:07:03.761787 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3446/6709] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:07:04.059963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f6ac5166-e368-45d6-a646-deef471fef89 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:04.061995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f6ac5166-e368-45d6-a646-deef471fef89 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:04.077822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6ac5166-e368-45d6-a646-deef471fef89 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:04.079153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6ac5166-e368-45d6-a646-deef471fef89 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:04.080945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6ac5166-e368-45d6-a646-deef471fef89 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:04.082065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6ac5166-e368-45d6-a646-deef471fef89 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:04.082825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6ac5166-e368-45d6-a646-deef471fef89 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:04.083849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6ac5166-e368-45d6-a646-deef471fef89 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:04.260258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f6ac5166-e368-45d6-a646-deef471fef89 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:04.269055 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f6ac5166-e368-45d6-a646-deef471fef89 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 200 len: 1229 microversion: 2.1 time: 0.216363 Oct 11 00:07:04.270032 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3447/6710] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:04 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 1229 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:07:05.293004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2b134e53-ebec-424d-8c35-52d3d505374f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:05.293734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2b134e53-ebec-424d-8c35-52d3d505374f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:05.301426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b134e53-ebec-424d-8c35-52d3d505374f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:05.302221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b134e53-ebec-424d-8c35-52d3d505374f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:05.302934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b134e53-ebec-424d-8c35-52d3d505374f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:05.303693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b134e53-ebec-424d-8c35-52d3d505374f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:05.304150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b134e53-ebec-424d-8c35-52d3d505374f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:05.304588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b134e53-ebec-424d-8c35-52d3d505374f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:05.471949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2b134e53-ebec-424d-8c35-52d3d505374f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:05.481203 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2b134e53-ebec-424d-8c35-52d3d505374f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 200 len: 1229 microversion: 2.1 time: 0.192163 Oct 11 00:07:05.481833 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3448/6711] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:05 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 1229 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:06.504898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-37b370ec-0cbe-4a22-a273-955ed802c75e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:06.505757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-37b370ec-0cbe-4a22-a273-955ed802c75e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:06.513744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37b370ec-0cbe-4a22-a273-955ed802c75e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:06.514373 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37b370ec-0cbe-4a22-a273-955ed802c75e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:06.514936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37b370ec-0cbe-4a22-a273-955ed802c75e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:06.516418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37b370ec-0cbe-4a22-a273-955ed802c75e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:06.517001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37b370ec-0cbe-4a22-a273-955ed802c75e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:06.517583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37b370ec-0cbe-4a22-a273-955ed802c75e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:06.659417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-37b370ec-0cbe-4a22-a273-955ed802c75e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:06.667764 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-37b370ec-0cbe-4a22-a273-955ed802c75e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 200 len: 1229 microversion: 2.1 time: 0.167323 Oct 11 00:07:06.677889 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3449/6712] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:06 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 1229 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:07.696412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-af4d8785-ff89-4d73-985f-78bf2d6a4e95 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:07.697620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-af4d8785-ff89-4d73-985f-78bf2d6a4e95 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:07.708160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af4d8785-ff89-4d73-985f-78bf2d6a4e95 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:07.708656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af4d8785-ff89-4d73-985f-78bf2d6a4e95 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:07.709102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af4d8785-ff89-4d73-985f-78bf2d6a4e95 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:07.709840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af4d8785-ff89-4d73-985f-78bf2d6a4e95 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:07.710293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af4d8785-ff89-4d73-985f-78bf2d6a4e95 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:07.710720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af4d8785-ff89-4d73-985f-78bf2d6a4e95 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:07.854947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-af4d8785-ff89-4d73-985f-78bf2d6a4e95 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:07.863431 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-af4d8785-ff89-4d73-985f-78bf2d6a4e95 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 200 len: 1217 microversion: 2.1 time: 0.175424 Oct 11 00:07:07.864014 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3450/6713] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:07 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 1217 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:08.887649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6f0070dc-5c10-459a-9750-5d32b1b672b9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:08.888339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6f0070dc-5c10-459a-9750-5d32b1b672b9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:08.895288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f0070dc-5c10-459a-9750-5d32b1b672b9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:08.895777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f0070dc-5c10-459a-9750-5d32b1b672b9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:08.896217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f0070dc-5c10-459a-9750-5d32b1b672b9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:08.896910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f0070dc-5c10-459a-9750-5d32b1b672b9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:08.897486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f0070dc-5c10-459a-9750-5d32b1b672b9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:08.897915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f0070dc-5c10-459a-9750-5d32b1b672b9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:09.035304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6f0070dc-5c10-459a-9750-5d32b1b672b9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:09.043279 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6f0070dc-5c10-459a-9750-5d32b1b672b9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 200 len: 1217 microversion: 2.1 time: 0.159585 Oct 11 00:07:09.043853 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3451/6714] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:08 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:10.067191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-da14017e-028e-46a0-b0b9-3d43c6aa1274 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:10.067904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-da14017e-028e-46a0-b0b9-3d43c6aa1274 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:10.074683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da14017e-028e-46a0-b0b9-3d43c6aa1274 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:10.075178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da14017e-028e-46a0-b0b9-3d43c6aa1274 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:10.075619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da14017e-028e-46a0-b0b9-3d43c6aa1274 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:10.076321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da14017e-028e-46a0-b0b9-3d43c6aa1274 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:10.076783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da14017e-028e-46a0-b0b9-3d43c6aa1274 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:10.077246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da14017e-028e-46a0-b0b9-3d43c6aa1274 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:10.212272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-da14017e-028e-46a0-b0b9-3d43c6aa1274 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:10.220366 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-da14017e-028e-46a0-b0b9-3d43c6aa1274 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 200 len: 1217 microversion: 2.1 time: 0.158119 Oct 11 00:07:10.220947 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3452/6715] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:10 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:11.243533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d3bdf581-b443-4911-833f-68e234a22917 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:11.244223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d3bdf581-b443-4911-833f-68e234a22917 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:11.246331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:07:11.247156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:07:11.255301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3bdf581-b443-4911-833f-68e234a22917 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:11.255804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3bdf581-b443-4911-833f-68e234a22917 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:11.256250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3bdf581-b443-4911-833f-68e234a22917 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:11.256988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3bdf581-b443-4911-833f-68e234a22917 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:11.257478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3bdf581-b443-4911-833f-68e234a22917 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:11.261060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3bdf581-b443-4911-833f-68e234a22917 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:11.400571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d3bdf581-b443-4911-833f-68e234a22917 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:11.408466 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d3bdf581-b443-4911-833f-68e234a22917 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 200 len: 1217 microversion: 2.1 time: 0.168940 Oct 11 00:07:11.409043 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3453/6716] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:11 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:12.432239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-42445b47-86f9-4d7c-a4aa-9f9264e2ef6a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:12.432939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-42445b47-86f9-4d7c-a4aa-9f9264e2ef6a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:12.440202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42445b47-86f9-4d7c-a4aa-9f9264e2ef6a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:12.440697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42445b47-86f9-4d7c-a4aa-9f9264e2ef6a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:12.441739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42445b47-86f9-4d7c-a4aa-9f9264e2ef6a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:12.442450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42445b47-86f9-4d7c-a4aa-9f9264e2ef6a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:12.442911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42445b47-86f9-4d7c-a4aa-9f9264e2ef6a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:12.443346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42445b47-86f9-4d7c-a4aa-9f9264e2ef6a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:12.576845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-42445b47-86f9-4d7c-a4aa-9f9264e2ef6a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:12.585993 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-42445b47-86f9-4d7c-a4aa-9f9264e2ef6a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 200 len: 1217 microversion: 2.1 time: 0.157722 Oct 11 00:07:12.586751 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3454/6717] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:12 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:13.605853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-56efcb45-aea4-4593-9090-03450fa98bf4 req-a256cf0b-ffe0-4b46-992a-787b69ee0f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21dbd311-94d7-4edf-8827-6ac59eb8e959", "name": "network-vif-plugged", "status": "completed", "tag": "67d70e37-7754-4e7f-9de9-17db1cf0b73d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:07:13.619048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-56efcb45-aea4-4593-9090-03450fa98bf4 req-a256cf0b-ffe0-4b46-992a-787b69ee0f56 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:13.619645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-56efcb45-aea4-4593-9090-03450fa98bf4 req-a256cf0b-ffe0-4b46-992a-787b69ee0f56 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:13.620156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-56efcb45-aea4-4593-9090-03450fa98bf4 req-a256cf0b-ffe0-4b46-992a-787b69ee0f56 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:13.632423 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-56efcb45-aea4-4593-9090-03450fa98bf4 req-a256cf0b-ffe0-4b46-992a-787b69ee0f56 service nova] Creating event network-vif-plugged:67d70e37-7754-4e7f-9de9-17db1cf0b73d for instance 21dbd311-94d7-4edf-8827-6ac59eb8e959 on n-h1-860864-2 Oct 11 00:07:13.638920 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-56efcb45-aea4-4593-9090-03450fa98bf4 req-a256cf0b-ffe0-4b46-992a-787b69ee0f56 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037597 Oct 11 00:07:13.639800 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3455/6718] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:07:13.645812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-30d03ab4-d183-4007-ad40-4f0dccf30cef tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:13.646767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-30d03ab4-d183-4007-ad40-4f0dccf30cef tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:13.654262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30d03ab4-d183-4007-ad40-4f0dccf30cef tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:13.655007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30d03ab4-d183-4007-ad40-4f0dccf30cef tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:13.656573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30d03ab4-d183-4007-ad40-4f0dccf30cef tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:13.657498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30d03ab4-d183-4007-ad40-4f0dccf30cef tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:13.658833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30d03ab4-d183-4007-ad40-4f0dccf30cef tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:13.659521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-30d03ab4-d183-4007-ad40-4f0dccf30cef tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:13.834262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-30d03ab4-d183-4007-ad40-4f0dccf30cef tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:13.842559 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-30d03ab4-d183-4007-ad40-4f0dccf30cef tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 200 len: 1217 microversion: 2.1 time: 0.200785 Oct 11 00:07:13.843211 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3456/6719] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:13 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 1217 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:07:14.866122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7e5e1ee2-d8ef-4f35-8fc7-759024088d33 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:14.866796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7e5e1ee2-d8ef-4f35-8fc7-759024088d33 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:14.873956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e5e1ee2-d8ef-4f35-8fc7-759024088d33 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:14.874549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e5e1ee2-d8ef-4f35-8fc7-759024088d33 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:14.874999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e5e1ee2-d8ef-4f35-8fc7-759024088d33 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:14.875711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e5e1ee2-d8ef-4f35-8fc7-759024088d33 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:14.876171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e5e1ee2-d8ef-4f35-8fc7-759024088d33 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:14.876601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e5e1ee2-d8ef-4f35-8fc7-759024088d33 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:15.020188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7e5e1ee2-d8ef-4f35-8fc7-759024088d33 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:15.028963 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7e5e1ee2-d8ef-4f35-8fc7-759024088d33 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 200 len: 1217 microversion: 2.1 time: 0.166815 Oct 11 00:07:15.029965 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3457/6720] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:14 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:16.052424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-274de0f2-764c-438b-a7a4-bb78c417e0ad tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:16.053145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-274de0f2-764c-438b-a7a4-bb78c417e0ad tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:16.060011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-274de0f2-764c-438b-a7a4-bb78c417e0ad tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:16.060499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-274de0f2-764c-438b-a7a4-bb78c417e0ad tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:16.060949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-274de0f2-764c-438b-a7a4-bb78c417e0ad tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:16.061824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-274de0f2-764c-438b-a7a4-bb78c417e0ad tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:16.062411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-274de0f2-764c-438b-a7a4-bb78c417e0ad tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:16.062889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-274de0f2-764c-438b-a7a4-bb78c417e0ad tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:16.200920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-274de0f2-764c-438b-a7a4-bb78c417e0ad tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:16.210593 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-274de0f2-764c-438b-a7a4-bb78c417e0ad tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 200 len: 1405 microversion: 2.1 time: 0.162051 Oct 11 00:07:16.211195 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3458/6721] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:16 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:16.233062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-01d2a42d-ca22-4bb4-aa1b-8b2315cecb3f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:16.234115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-01d2a42d-ca22-4bb4-aa1b-8b2315cecb3f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:16.240427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01d2a42d-ca22-4bb4-aa1b-8b2315cecb3f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:16.241002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01d2a42d-ca22-4bb4-aa1b-8b2315cecb3f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:16.241539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01d2a42d-ca22-4bb4-aa1b-8b2315cecb3f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:16.242312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01d2a42d-ca22-4bb4-aa1b-8b2315cecb3f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:16.242868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01d2a42d-ca22-4bb4-aa1b-8b2315cecb3f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:16.243371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01d2a42d-ca22-4bb4-aa1b-8b2315cecb3f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:16.377363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-01d2a42d-ca22-4bb4-aa1b-8b2315cecb3f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:16.385275 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-01d2a42d-ca22-4bb4-aa1b-8b2315cecb3f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 200 len: 1405 microversion: 2.1 time: 0.156154 Oct 11 00:07:16.385981 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3459/6722] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:16 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:16.408795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-74dfd925-9214-45dd-9c16-49ac18146fe4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-936127696"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:07:16.411110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-74dfd925-9214-45dd-9c16-49ac18146fe4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:16.416996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74dfd925-9214-45dd-9c16-49ac18146fe4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:16.417509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74dfd925-9214-45dd-9c16-49ac18146fe4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:16.417946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74dfd925-9214-45dd-9c16-49ac18146fe4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:16.418633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74dfd925-9214-45dd-9c16-49ac18146fe4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:16.419082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74dfd925-9214-45dd-9c16-49ac18146fe4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:16.419505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-74dfd925-9214-45dd-9c16-49ac18146fe4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:16.513609 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.compute.api [None req-74dfd925-9214-45dd-9c16-49ac18146fe4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Attempting to quiesce instance before volume snapshot. Oct 11 00:07:16.576859 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.compute.api [None req-74dfd925-9214-45dd-9c16-49ac18146fe4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 11 00:07:16.580708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:07:16.650425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-74dfd925-9214-45dd-9c16-49ac18146fe4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Creating snapshot from volume 9aba274f-e194-4337-8e4e-1a31a5e3c6b0. {{(pid=120613) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 11 00:07:17.505957 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-74dfd925-9214-45dd-9c16-49ac18146fe4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "POST /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959/action" status: 202 len: 0 microversion: 2.1 time: 1.101332 Oct 11 00:07:17.507331 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3460/6723] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:07:16 2022] POST /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959/action => generated 0 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 11 00:07:18.698678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-33784604-a81b-478e-9fdd-0d16861175ea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-91174208", "imageRef": "a19da32f-1983-4028-a29c-ceae4f7650c0", "flavorRef": "452", "networks": [{"uuid": "6b4889cd-925d-4509-9797-a829b845f15b"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:07:18.757460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-33784604-a81b-478e-9fdd-0d16861175ea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] validate_networks() for [('6b4889cd-925d-4509-9797-a829b845f15b', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:07:19.157002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-33784604-a81b-478e-9fdd-0d16861175ea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:07:19.157597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-33784604-a81b-478e-9fdd-0d16861175ea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:07:19.158089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-33784604-a81b-478e-9fdd-0d16861175ea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:07:19.158512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-33784604-a81b-478e-9fdd-0d16861175ea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:07:19.158969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-33784604-a81b-478e-9fdd-0d16861175ea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:07:19.167908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33784604-a81b-478e-9fdd-0d16861175ea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:19.168401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33784604-a81b-478e-9fdd-0d16861175ea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:19.168852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33784604-a81b-478e-9fdd-0d16861175ea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:19.169623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33784604-a81b-478e-9fdd-0d16861175ea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:19.174053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33784604-a81b-478e-9fdd-0d16861175ea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:19.174053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33784604-a81b-478e-9fdd-0d16861175ea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:19.192689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-33784604-a81b-478e-9fdd-0d16861175ea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Getting quotas for project be6e417773094ab08c170ca4b69f3742. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:07:19.198518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-33784604-a81b-478e-9fdd-0d16861175ea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Getting quotas for user a27b050389ad48089e214ad65eaa83bb and project be6e417773094ab08c170ca4b69f3742. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:07:19.215074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-33784604-a81b-478e-9fdd-0d16861175ea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:07:19.218812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-33784604-a81b-478e-9fdd-0d16861175ea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='a461866b-11c7-4a66-8c7e-5919727f81d8',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:07:19.298210 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-33784604-a81b-478e-9fdd-0d16861175ea tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604625 Oct 11 00:07:19.299059 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3461/6724] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:07:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 00:07:19.310218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cecbe946-72ca-492f-b4df-99ac66c7701d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:19.312749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cecbe946-72ca-492f-b4df-99ac66c7701d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:19.369693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cecbe946-72ca-492f-b4df-99ac66c7701d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:19.377631 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cecbe946-72ca-492f-b4df-99ac66c7701d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1228 microversion: 2.1 time: 0.071518 Oct 11 00:07:19.384236 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3462/6725] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:19 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1228 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:20.400863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7a13e9ca-1478-4853-86d8-f860e07c85c2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:20.402230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7a13e9ca-1478-4853-86d8-f860e07c85c2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:20.414591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a13e9ca-1478-4853-86d8-f860e07c85c2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:20.415162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a13e9ca-1478-4853-86d8-f860e07c85c2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:20.415589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a13e9ca-1478-4853-86d8-f860e07c85c2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:20.416491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a13e9ca-1478-4853-86d8-f860e07c85c2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:20.417705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a13e9ca-1478-4853-86d8-f860e07c85c2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:20.417705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a13e9ca-1478-4853-86d8-f860e07c85c2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:20.495772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7a13e9ca-1478-4853-86d8-f860e07c85c2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:20.511596 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7a13e9ca-1478-4853-86d8-f860e07c85c2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1280 microversion: 2.1 time: 0.114604 Oct 11 00:07:20.512835 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3463/6726] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:20 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1280 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:21.536862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8b84e76a-7efd-4f31-a392-a2b245be9d6c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:21.537563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8b84e76a-7efd-4f31-a392-a2b245be9d6c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:21.549727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b84e76a-7efd-4f31-a392-a2b245be9d6c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:21.550244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b84e76a-7efd-4f31-a392-a2b245be9d6c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:21.553123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b84e76a-7efd-4f31-a392-a2b245be9d6c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:21.562948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b84e76a-7efd-4f31-a392-a2b245be9d6c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:21.563679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b84e76a-7efd-4f31-a392-a2b245be9d6c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:21.563979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b84e76a-7efd-4f31-a392-a2b245be9d6c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:21.849836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8b84e76a-7efd-4f31-a392-a2b245be9d6c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:21.865297 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8b84e76a-7efd-4f31-a392-a2b245be9d6c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1340 microversion: 2.1 time: 0.332376 Oct 11 00:07:21.865955 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3464/6727] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:21 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1340 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:22.895129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4ccb6da2-d313-424c-ba47-7e41189bddd4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:22.897167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4ccb6da2-d313-424c-ba47-7e41189bddd4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:22.907199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ccb6da2-d313-424c-ba47-7e41189bddd4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:22.908560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ccb6da2-d313-424c-ba47-7e41189bddd4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:22.909654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ccb6da2-d313-424c-ba47-7e41189bddd4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:22.911351 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ccb6da2-d313-424c-ba47-7e41189bddd4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:22.912601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ccb6da2-d313-424c-ba47-7e41189bddd4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:22.913225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4ccb6da2-d313-424c-ba47-7e41189bddd4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:23.120237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4ccb6da2-d313-424c-ba47-7e41189bddd4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:23.132607 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4ccb6da2-d313-424c-ba47-7e41189bddd4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1340 microversion: 2.1 time: 0.243552 Oct 11 00:07:23.152591 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3465/6728] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:22 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1340 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:07:23.158071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-96f4154b-df1b-4ea4-8067-04bfebd5a4d7 req-6dcfbe8d-235b-4b08-8b19-bc27626f3211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df5f6657-05fb-4baf-b1e9-d2fabd443a6a", "tag": "ca5a95df-ca50-4b83-81a0-81a277ca3a61"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:07:23.190222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-96f4154b-df1b-4ea4-8067-04bfebd5a4d7 req-6dcfbe8d-235b-4b08-8b19-bc27626f3211 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:23.193669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-96f4154b-df1b-4ea4-8067-04bfebd5a4d7 req-6dcfbe8d-235b-4b08-8b19-bc27626f3211 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:23.194051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-96f4154b-df1b-4ea4-8067-04bfebd5a4d7 req-6dcfbe8d-235b-4b08-8b19-bc27626f3211 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:23.220542 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-96f4154b-df1b-4ea4-8067-04bfebd5a4d7 req-6dcfbe8d-235b-4b08-8b19-bc27626f3211 service nova] Creating event network-changed:ca5a95df-ca50-4b83-81a0-81a277ca3a61 for instance df5f6657-05fb-4baf-b1e9-d2fabd443a6a on n-h2-860864-2 Oct 11 00:07:23.227027 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-96f4154b-df1b-4ea4-8067-04bfebd5a4d7 req-6dcfbe8d-235b-4b08-8b19-bc27626f3211 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072637 Oct 11 00:07:23.227821 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3466/6729] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:07:24.161537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c684e421-fd0d-4ddb-8135-0ad098b5553e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:24.162394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c684e421-fd0d-4ddb-8135-0ad098b5553e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:24.169879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c684e421-fd0d-4ddb-8135-0ad098b5553e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:24.170995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c684e421-fd0d-4ddb-8135-0ad098b5553e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:24.171887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c684e421-fd0d-4ddb-8135-0ad098b5553e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:24.172821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c684e421-fd0d-4ddb-8135-0ad098b5553e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:24.173522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c684e421-fd0d-4ddb-8135-0ad098b5553e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:24.174156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c684e421-fd0d-4ddb-8135-0ad098b5553e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:24.344613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c684e421-fd0d-4ddb-8135-0ad098b5553e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:24.352921 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c684e421-fd0d-4ddb-8135-0ad098b5553e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1340 microversion: 2.1 time: 0.197277 Oct 11 00:07:24.353672 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3467/6730] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:24 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1340 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:07:25.383423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-acfcb9a3-9495-4f90-bc7f-632b988d27c7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:25.384464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-acfcb9a3-9495-4f90-bc7f-632b988d27c7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:25.401947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-acfcb9a3-9495-4f90-bc7f-632b988d27c7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:25.402648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-acfcb9a3-9495-4f90-bc7f-632b988d27c7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:25.403353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-acfcb9a3-9495-4f90-bc7f-632b988d27c7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:25.404345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-acfcb9a3-9495-4f90-bc7f-632b988d27c7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:25.405236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-acfcb9a3-9495-4f90-bc7f-632b988d27c7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:25.405722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-acfcb9a3-9495-4f90-bc7f-632b988d27c7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:25.576311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-acfcb9a3-9495-4f90-bc7f-632b988d27c7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:25.586618 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-acfcb9a3-9495-4f90-bc7f-632b988d27c7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1340 microversion: 2.1 time: 0.211206 Oct 11 00:07:25.587712 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3468/6731] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:25 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1340 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:07:26.612354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3e660de4-2cf7-4065-ab89-15669e2de9ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:26.613109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3e660de4-2cf7-4065-ab89-15669e2de9ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:26.622446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e660de4-2cf7-4065-ab89-15669e2de9ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:26.623804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e660de4-2cf7-4065-ab89-15669e2de9ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:26.624625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e660de4-2cf7-4065-ab89-15669e2de9ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:26.625402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e660de4-2cf7-4065-ab89-15669e2de9ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:26.625925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e660de4-2cf7-4065-ab89-15669e2de9ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:26.626596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e660de4-2cf7-4065-ab89-15669e2de9ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:26.810471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3e660de4-2cf7-4065-ab89-15669e2de9ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:26.821529 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3e660de4-2cf7-4065-ab89-15669e2de9ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1340 microversion: 2.1 time: 0.213434 Oct 11 00:07:26.837867 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3469/6732] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:26 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1340 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:27.851642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b15a49f9-a556-4529-8bdd-a18cd8da462a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:27.852348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b15a49f9-a556-4529-8bdd-a18cd8da462a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:27.861505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b15a49f9-a556-4529-8bdd-a18cd8da462a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:27.862267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b15a49f9-a556-4529-8bdd-a18cd8da462a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:27.863080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b15a49f9-a556-4529-8bdd-a18cd8da462a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:27.864249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b15a49f9-a556-4529-8bdd-a18cd8da462a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:27.864725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b15a49f9-a556-4529-8bdd-a18cd8da462a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:27.865221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b15a49f9-a556-4529-8bdd-a18cd8da462a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:28.078286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b15a49f9-a556-4529-8bdd-a18cd8da462a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:28.086485 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b15a49f9-a556-4529-8bdd-a18cd8da462a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1340 microversion: 2.1 time: 0.241069 Oct 11 00:07:28.087720 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3470/6733] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:27 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1340 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:07:29.113639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0585e424-1f66-4d38-8662-444e4d2b3081 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:29.114272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0585e424-1f66-4d38-8662-444e4d2b3081 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:29.129086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0585e424-1f66-4d38-8662-444e4d2b3081 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:29.129894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0585e424-1f66-4d38-8662-444e4d2b3081 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:29.130348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0585e424-1f66-4d38-8662-444e4d2b3081 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:29.131088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0585e424-1f66-4d38-8662-444e4d2b3081 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:29.135889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0585e424-1f66-4d38-8662-444e4d2b3081 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:29.136607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0585e424-1f66-4d38-8662-444e4d2b3081 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:29.185388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:07:29.323678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0585e424-1f66-4d38-8662-444e4d2b3081 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:29.332333 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0585e424-1f66-4d38-8662-444e4d2b3081 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1340 microversion: 2.1 time: 0.222698 Oct 11 00:07:29.342348 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3471/6734] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:29 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1340 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:07:30.353308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:07:30.360158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e754c6db-e442-4ab3-8400-7774d1ec62a4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:30.360797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e754c6db-e442-4ab3-8400-7774d1ec62a4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:30.362661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:07:30.370522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e754c6db-e442-4ab3-8400-7774d1ec62a4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:30.371245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e754c6db-e442-4ab3-8400-7774d1ec62a4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:30.371898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e754c6db-e442-4ab3-8400-7774d1ec62a4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:30.372727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e754c6db-e442-4ab3-8400-7774d1ec62a4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:30.373906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e754c6db-e442-4ab3-8400-7774d1ec62a4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:30.374663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e754c6db-e442-4ab3-8400-7774d1ec62a4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:30.531278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e754c6db-e442-4ab3-8400-7774d1ec62a4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:30.539571 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e754c6db-e442-4ab3-8400-7774d1ec62a4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1340 microversion: 2.1 time: 0.187076 Oct 11 00:07:30.540161 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3472/6735] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:30 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1340 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:07:31.563800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ae4d3f2e-5c9a-44c4-8fe2-103064a93813 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:31.564471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ae4d3f2e-5c9a-44c4-8fe2-103064a93813 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:31.571973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae4d3f2e-5c9a-44c4-8fe2-103064a93813 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:31.573077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae4d3f2e-5c9a-44c4-8fe2-103064a93813 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:31.573349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae4d3f2e-5c9a-44c4-8fe2-103064a93813 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:31.574122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae4d3f2e-5c9a-44c4-8fe2-103064a93813 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:31.574603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae4d3f2e-5c9a-44c4-8fe2-103064a93813 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:31.575054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ae4d3f2e-5c9a-44c4-8fe2-103064a93813 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:31.740769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ae4d3f2e-5c9a-44c4-8fe2-103064a93813 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:31.750750 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ae4d3f2e-5c9a-44c4-8fe2-103064a93813 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1340 microversion: 2.1 time: 0.191272 Oct 11 00:07:31.751623 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3473/6736] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:31 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1340 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:32.775056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0090ac78-f2f6-4438-9399-f920fa136c9a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:32.776844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0090ac78-f2f6-4438-9399-f920fa136c9a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:32.785471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0090ac78-f2f6-4438-9399-f920fa136c9a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:32.786022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0090ac78-f2f6-4438-9399-f920fa136c9a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:32.786654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0090ac78-f2f6-4438-9399-f920fa136c9a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:32.787408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0090ac78-f2f6-4438-9399-f920fa136c9a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:32.787891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0090ac78-f2f6-4438-9399-f920fa136c9a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:32.788343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0090ac78-f2f6-4438-9399-f920fa136c9a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:32.928626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0090ac78-f2f6-4438-9399-f920fa136c9a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:32.937243 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0090ac78-f2f6-4438-9399-f920fa136c9a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1340 microversion: 2.1 time: 0.166662 Oct 11 00:07:32.937999 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3474/6737] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:32 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1340 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:33.960874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-592821d7-299f-403c-919a-79da44ea9c6a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:33.962569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-592821d7-299f-403c-919a-79da44ea9c6a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:33.979503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-592821d7-299f-403c-919a-79da44ea9c6a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:33.979846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-592821d7-299f-403c-919a-79da44ea9c6a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:33.980187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-592821d7-299f-403c-919a-79da44ea9c6a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:33.980924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-592821d7-299f-403c-919a-79da44ea9c6a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:33.981428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-592821d7-299f-403c-919a-79da44ea9c6a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:33.981890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-592821d7-299f-403c-919a-79da44ea9c6a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:34.126681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-592821d7-299f-403c-919a-79da44ea9c6a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:34.146881 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-592821d7-299f-403c-919a-79da44ea9c6a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1340 microversion: 2.1 time: 0.179223 Oct 11 00:07:34.155443 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3475/6738] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:33 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1340 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:35.175328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-15430b45-581d-416b-9fc6-26070ac8932b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:35.176242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-15430b45-581d-416b-9fc6-26070ac8932b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:35.182409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15430b45-581d-416b-9fc6-26070ac8932b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:35.182923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15430b45-581d-416b-9fc6-26070ac8932b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:35.183407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15430b45-581d-416b-9fc6-26070ac8932b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:35.184126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15430b45-581d-416b-9fc6-26070ac8932b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:35.184596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15430b45-581d-416b-9fc6-26070ac8932b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:35.185039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15430b45-581d-416b-9fc6-26070ac8932b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:35.334669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-15430b45-581d-416b-9fc6-26070ac8932b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:35.344296 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-15430b45-581d-416b-9fc6-26070ac8932b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1340 microversion: 2.1 time: 0.174131 Oct 11 00:07:35.345251 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3476/6739] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:35 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1340 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:36.368265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-87409eeb-90a0-4ab9-9b1f-6305c258895f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:36.368964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-87409eeb-90a0-4ab9-9b1f-6305c258895f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:36.376922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87409eeb-90a0-4ab9-9b1f-6305c258895f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:36.377443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87409eeb-90a0-4ab9-9b1f-6305c258895f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:36.377901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87409eeb-90a0-4ab9-9b1f-6305c258895f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:36.378623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87409eeb-90a0-4ab9-9b1f-6305c258895f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:36.379097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87409eeb-90a0-4ab9-9b1f-6305c258895f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:36.379542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87409eeb-90a0-4ab9-9b1f-6305c258895f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:36.528135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-87409eeb-90a0-4ab9-9b1f-6305c258895f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:36.538261 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-87409eeb-90a0-4ab9-9b1f-6305c258895f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1374 microversion: 2.1 time: 0.173905 Oct 11 00:07:36.538842 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3477/6740] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:36 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:37.562848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7f75cd72-1b0d-4c09-ae5e-ca310d1aebfd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:37.564193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7f75cd72-1b0d-4c09-ae5e-ca310d1aebfd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:37.571643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f75cd72-1b0d-4c09-ae5e-ca310d1aebfd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:37.572169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f75cd72-1b0d-4c09-ae5e-ca310d1aebfd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:37.572618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f75cd72-1b0d-4c09-ae5e-ca310d1aebfd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:37.573527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f75cd72-1b0d-4c09-ae5e-ca310d1aebfd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:37.574056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f75cd72-1b0d-4c09-ae5e-ca310d1aebfd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:37.574528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f75cd72-1b0d-4c09-ae5e-ca310d1aebfd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:37.590395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:07:37.720395 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7f75cd72-1b0d-4c09-ae5e-ca310d1aebfd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:37.729167 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7f75cd72-1b0d-4c09-ae5e-ca310d1aebfd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1374 microversion: 2.1 time: 0.170803 Oct 11 00:07:37.730004 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3478/6741] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:37 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:38.753269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ef314b0e-2532-4602-816f-6dc202a9b58a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:38.754046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ef314b0e-2532-4602-816f-6dc202a9b58a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:38.761850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef314b0e-2532-4602-816f-6dc202a9b58a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:38.762358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef314b0e-2532-4602-816f-6dc202a9b58a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:38.763375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef314b0e-2532-4602-816f-6dc202a9b58a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:38.764164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef314b0e-2532-4602-816f-6dc202a9b58a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:38.764740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef314b0e-2532-4602-816f-6dc202a9b58a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:38.765216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef314b0e-2532-4602-816f-6dc202a9b58a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:38.914232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ef314b0e-2532-4602-816f-6dc202a9b58a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:38.923287 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ef314b0e-2532-4602-816f-6dc202a9b58a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1374 microversion: 2.1 time: 0.173879 Oct 11 00:07:38.923881 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3479/6742] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:38 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:07:39.948564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-13ca8d73-aa8e-4598-b5a8-f8426fd57dba tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:39.949237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-13ca8d73-aa8e-4598-b5a8-f8426fd57dba tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:39.957131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13ca8d73-aa8e-4598-b5a8-f8426fd57dba tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:39.957839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13ca8d73-aa8e-4598-b5a8-f8426fd57dba tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:39.958379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13ca8d73-aa8e-4598-b5a8-f8426fd57dba tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:39.959331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13ca8d73-aa8e-4598-b5a8-f8426fd57dba tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:39.959887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13ca8d73-aa8e-4598-b5a8-f8426fd57dba tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:39.960417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13ca8d73-aa8e-4598-b5a8-f8426fd57dba tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:40.127068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-13ca8d73-aa8e-4598-b5a8-f8426fd57dba tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:40.136680 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-13ca8d73-aa8e-4598-b5a8-f8426fd57dba tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1374 microversion: 2.1 time: 0.192785 Oct 11 00:07:40.137844 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3480/6743] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:39 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1374 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:41.164685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ab1e00c4-b725-4d17-873d-f85feb4cab69 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:41.166837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ab1e00c4-b725-4d17-873d-f85feb4cab69 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:41.176802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab1e00c4-b725-4d17-873d-f85feb4cab69 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:41.177313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab1e00c4-b725-4d17-873d-f85feb4cab69 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:41.177799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab1e00c4-b725-4d17-873d-f85feb4cab69 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:41.178538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab1e00c4-b725-4d17-873d-f85feb4cab69 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:41.179013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab1e00c4-b725-4d17-873d-f85feb4cab69 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:41.179459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab1e00c4-b725-4d17-873d-f85feb4cab69 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:41.486795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ab1e00c4-b725-4d17-873d-f85feb4cab69 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:41.496879 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ab1e00c4-b725-4d17-873d-f85feb4cab69 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1374 microversion: 2.1 time: 0.339378 Oct 11 00:07:41.497773 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3481/6744] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:41 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1374 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:42.523185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d07eb84f-dc4e-41d2-ae47-1bf0bbd9982a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:42.523843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d07eb84f-dc4e-41d2-ae47-1bf0bbd9982a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:42.530887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d07eb84f-dc4e-41d2-ae47-1bf0bbd9982a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:42.531396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d07eb84f-dc4e-41d2-ae47-1bf0bbd9982a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:42.531918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d07eb84f-dc4e-41d2-ae47-1bf0bbd9982a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:42.532649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d07eb84f-dc4e-41d2-ae47-1bf0bbd9982a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:42.533127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d07eb84f-dc4e-41d2-ae47-1bf0bbd9982a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:42.533603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d07eb84f-dc4e-41d2-ae47-1bf0bbd9982a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:42.685344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d07eb84f-dc4e-41d2-ae47-1bf0bbd9982a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:42.693749 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d07eb84f-dc4e-41d2-ae47-1bf0bbd9982a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1374 microversion: 2.1 time: 0.174489 Oct 11 00:07:42.694367 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3482/6745] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:42 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:43.720598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-978bc496-01e8-4128-8538-cba5bb435dd9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:43.722415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-978bc496-01e8-4128-8538-cba5bb435dd9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:43.733529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-978bc496-01e8-4128-8538-cba5bb435dd9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:43.734072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-978bc496-01e8-4128-8538-cba5bb435dd9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:43.734853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-978bc496-01e8-4128-8538-cba5bb435dd9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:43.735863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-978bc496-01e8-4128-8538-cba5bb435dd9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:43.736480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-978bc496-01e8-4128-8538-cba5bb435dd9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:43.737119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-978bc496-01e8-4128-8538-cba5bb435dd9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:43.902876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-978bc496-01e8-4128-8538-cba5bb435dd9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:43.915087 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-978bc496-01e8-4128-8538-cba5bb435dd9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1374 microversion: 2.1 time: 0.201005 Oct 11 00:07:43.924465 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3483/6746] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:43 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1374 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:44.940829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b0d0c179-caae-409c-b57d-1babae0e6f22 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:44.941588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b0d0c179-caae-409c-b57d-1babae0e6f22 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:44.948412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0d0c179-caae-409c-b57d-1babae0e6f22 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:44.948945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0d0c179-caae-409c-b57d-1babae0e6f22 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:44.949428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0d0c179-caae-409c-b57d-1babae0e6f22 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:44.950675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0d0c179-caae-409c-b57d-1babae0e6f22 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:44.951271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0d0c179-caae-409c-b57d-1babae0e6f22 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:44.951722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b0d0c179-caae-409c-b57d-1babae0e6f22 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:45.090290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b0d0c179-caae-409c-b57d-1babae0e6f22 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:45.099743 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b0d0c179-caae-409c-b57d-1babae0e6f22 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1374 microversion: 2.1 time: 0.163110 Oct 11 00:07:45.104738 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3484/6747] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:44 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:45.793204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-1f888723-a72c-4a44-abd2-5bfe59b1ea2c req-2e39c5ce-2c10-47b1-91fd-0fad412019dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df5f6657-05fb-4baf-b1e9-d2fabd443a6a", "name": "network-vif-plugged", "status": "completed", "tag": "ca5a95df-ca50-4b83-81a0-81a277ca3a61"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:07:45.805592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1f888723-a72c-4a44-abd2-5bfe59b1ea2c req-2e39c5ce-2c10-47b1-91fd-0fad412019dd service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:45.806193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1f888723-a72c-4a44-abd2-5bfe59b1ea2c req-2e39c5ce-2c10-47b1-91fd-0fad412019dd service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:45.806642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1f888723-a72c-4a44-abd2-5bfe59b1ea2c req-2e39c5ce-2c10-47b1-91fd-0fad412019dd service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:45.823178 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-1f888723-a72c-4a44-abd2-5bfe59b1ea2c req-2e39c5ce-2c10-47b1-91fd-0fad412019dd service nova] Creating event network-vif-plugged:ca5a95df-ca50-4b83-81a0-81a277ca3a61 for instance df5f6657-05fb-4baf-b1e9-d2fabd443a6a on n-h2-860864-2 Oct 11 00:07:45.830622 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-1f888723-a72c-4a44-abd2-5bfe59b1ea2c req-2e39c5ce-2c10-47b1-91fd-0fad412019dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041600 Oct 11 00:07:45.831305 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3485/6748] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:07:46.125675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0a4d8215-e190-476b-bd20-2f33ff24f010 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:46.127273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0a4d8215-e190-476b-bd20-2f33ff24f010 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:46.134079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a4d8215-e190-476b-bd20-2f33ff24f010 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:46.134666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a4d8215-e190-476b-bd20-2f33ff24f010 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:46.135197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a4d8215-e190-476b-bd20-2f33ff24f010 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:46.135988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a4d8215-e190-476b-bd20-2f33ff24f010 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:46.136682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a4d8215-e190-476b-bd20-2f33ff24f010 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:46.137306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a4d8215-e190-476b-bd20-2f33ff24f010 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:46.295729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0a4d8215-e190-476b-bd20-2f33ff24f010 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:46.305700 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0a4d8215-e190-476b-bd20-2f33ff24f010 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1374 microversion: 2.1 time: 0.186809 Oct 11 00:07:46.306315 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3486/6749] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:46 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1374 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:47.333237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cb51d66f-5949-4ab2-9d27-17552cddc513 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:47.334062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cb51d66f-5949-4ab2-9d27-17552cddc513 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:47.342902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb51d66f-5949-4ab2-9d27-17552cddc513 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:47.343549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb51d66f-5949-4ab2-9d27-17552cddc513 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:47.344013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb51d66f-5949-4ab2-9d27-17552cddc513 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:47.344743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb51d66f-5949-4ab2-9d27-17552cddc513 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:47.345280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb51d66f-5949-4ab2-9d27-17552cddc513 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:47.345756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb51d66f-5949-4ab2-9d27-17552cddc513 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:47.515664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cb51d66f-5949-4ab2-9d27-17552cddc513 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:47.525974 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cb51d66f-5949-4ab2-9d27-17552cddc513 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1561 microversion: 2.1 time: 0.196809 Oct 11 00:07:47.527342 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3487/6750] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:47 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1561 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:07:47.553473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-33b30165-edb8-4b29-9234-6368f39dac51 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:47.554114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-33b30165-edb8-4b29-9234-6368f39dac51 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:47.561905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33b30165-edb8-4b29-9234-6368f39dac51 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:47.562444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33b30165-edb8-4b29-9234-6368f39dac51 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:47.562978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33b30165-edb8-4b29-9234-6368f39dac51 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:47.563773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33b30165-edb8-4b29-9234-6368f39dac51 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:47.564743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33b30165-edb8-4b29-9234-6368f39dac51 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:47.565368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33b30165-edb8-4b29-9234-6368f39dac51 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:47.721564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-33b30165-edb8-4b29-9234-6368f39dac51 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:47.729862 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-33b30165-edb8-4b29-9234-6368f39dac51 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1561 microversion: 2.1 time: 0.181027 Oct 11 00:07:47.730625 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3488/6751] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:47 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:47.813606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1712a9d5-b99a-4848-ba21-b03e07c4a8f3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:47.814133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1712a9d5-b99a-4848-ba21-b03e07c4a8f3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:47.820867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1712a9d5-b99a-4848-ba21-b03e07c4a8f3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:47.821416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1712a9d5-b99a-4848-ba21-b03e07c4a8f3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:47.822127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1712a9d5-b99a-4848-ba21-b03e07c4a8f3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:47.823038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1712a9d5-b99a-4848-ba21-b03e07c4a8f3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:47.823608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1712a9d5-b99a-4848-ba21-b03e07c4a8f3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:47.824240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1712a9d5-b99a-4848-ba21-b03e07c4a8f3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:47.860577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1712a9d5-b99a-4848-ba21-b03e07c4a8f3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:07:47.948209 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1712a9d5-b99a-4848-ba21-b03e07c4a8f3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 204 len: 0 microversion: 2.1 time: 0.138288 Oct 11 00:07:47.949222 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3489/6752] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:07:47 2022] DELETE /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 00:07:47.960882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4cd4d6d4-7d2f-41cd-acc4-c3e8ec21f369 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:47.961672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4cd4d6d4-7d2f-41cd-acc4-c3e8ec21f369 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:47.968469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cd4d6d4-7d2f-41cd-acc4-c3e8ec21f369 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:47.969234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cd4d6d4-7d2f-41cd-acc4-c3e8ec21f369 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:47.969562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cd4d6d4-7d2f-41cd-acc4-c3e8ec21f369 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:47.970345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cd4d6d4-7d2f-41cd-acc4-c3e8ec21f369 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:47.970891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cd4d6d4-7d2f-41cd-acc4-c3e8ec21f369 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:47.971399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cd4d6d4-7d2f-41cd-acc4-c3e8ec21f369 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:48.109145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4cd4d6d4-7d2f-41cd-acc4-c3e8ec21f369 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:48.117417 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4cd4d6d4-7d2f-41cd-acc4-c3e8ec21f369 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1567 microversion: 2.1 time: 0.161094 Oct 11 00:07:48.118212 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3490/6753] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:47 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:07:49.141413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-409518b8-41a4-48c0-b125-50765cc5b8cc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:49.142139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-409518b8-41a4-48c0-b125-50765cc5b8cc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:49.149106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-409518b8-41a4-48c0-b125-50765cc5b8cc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:49.149648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-409518b8-41a4-48c0-b125-50765cc5b8cc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:49.150103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-409518b8-41a4-48c0-b125-50765cc5b8cc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:49.150822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-409518b8-41a4-48c0-b125-50765cc5b8cc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:49.151296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-409518b8-41a4-48c0-b125-50765cc5b8cc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:49.151740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-409518b8-41a4-48c0-b125-50765cc5b8cc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:49.304106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-409518b8-41a4-48c0-b125-50765cc5b8cc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:49.313220 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-409518b8-41a4-48c0-b125-50765cc5b8cc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1567 microversion: 2.1 time: 0.176222 Oct 11 00:07:49.313854 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3491/6754] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:49 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:50.055356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-9034f799-8a01-4872-ab61-f91c534be3cb req-2cf56b5b-8aa7-4c71-a07d-c726efb1d9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df5f6657-05fb-4baf-b1e9-d2fabd443a6a", "name": "network-vif-deleted", "tag": "ca5a95df-ca50-4b83-81a0-81a277ca3a61"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:07:50.071422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9034f799-8a01-4872-ab61-f91c534be3cb req-2cf56b5b-8aa7-4c71-a07d-c726efb1d9c8 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:50.071953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9034f799-8a01-4872-ab61-f91c534be3cb req-2cf56b5b-8aa7-4c71-a07d-c726efb1d9c8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:50.072605 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9034f799-8a01-4872-ab61-f91c534be3cb req-2cf56b5b-8aa7-4c71-a07d-c726efb1d9c8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:50.097196 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-9034f799-8a01-4872-ab61-f91c534be3cb req-2cf56b5b-8aa7-4c71-a07d-c726efb1d9c8 service nova] Creating event network-vif-deleted:ca5a95df-ca50-4b83-81a0-81a277ca3a61 for instance df5f6657-05fb-4baf-b1e9-d2fabd443a6a on n-h2-860864-2 Oct 11 00:07:50.104873 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-9034f799-8a01-4872-ab61-f91c534be3cb req-2cf56b5b-8aa7-4c71-a07d-c726efb1d9c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054403 Oct 11 00:07:50.107238 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3492/6755] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:07:50.339250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c2c8792f-a25e-4f95-85f0-ad7a8272c1f3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:50.340001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c2c8792f-a25e-4f95-85f0-ad7a8272c1f3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:50.347229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2c8792f-a25e-4f95-85f0-ad7a8272c1f3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:50.347757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2c8792f-a25e-4f95-85f0-ad7a8272c1f3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:50.348245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2c8792f-a25e-4f95-85f0-ad7a8272c1f3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:50.348950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2c8792f-a25e-4f95-85f0-ad7a8272c1f3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:50.349450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2c8792f-a25e-4f95-85f0-ad7a8272c1f3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:50.349905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2c8792f-a25e-4f95-85f0-ad7a8272c1f3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:50.420345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c2c8792f-a25e-4f95-85f0-ad7a8272c1f3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:50.429176 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c2c8792f-a25e-4f95-85f0-ad7a8272c1f3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1359 microversion: 2.1 time: 0.096111 Oct 11 00:07:50.429939 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3493/6756] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:50 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1359 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:51.455346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-901481e0-c685-4558-abf1-82f3c404f309 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:51.455997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-901481e0-c685-4558-abf1-82f3c404f309 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:51.463269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-901481e0-c685-4558-abf1-82f3c404f309 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:51.463676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-901481e0-c685-4558-abf1-82f3c404f309 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:51.464131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-901481e0-c685-4558-abf1-82f3c404f309 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:51.464894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-901481e0-c685-4558-abf1-82f3c404f309 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:51.465985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-901481e0-c685-4558-abf1-82f3c404f309 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:51.466441 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-901481e0-c685-4558-abf1-82f3c404f309 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:51.531444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-901481e0-c685-4558-abf1-82f3c404f309 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:51.533896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:07:51.541093 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-901481e0-c685-4558-abf1-82f3c404f309 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1359 microversion: 2.1 time: 0.089828 Oct 11 00:07:51.542031 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3494/6757] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:51 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1359 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:52.565303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a01c0b82-35cc-4767-9933-389233e57654 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:52.566011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a01c0b82-35cc-4767-9933-389233e57654 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:52.574145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a01c0b82-35cc-4767-9933-389233e57654 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:52.575253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a01c0b82-35cc-4767-9933-389233e57654 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:52.575838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a01c0b82-35cc-4767-9933-389233e57654 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:52.576463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a01c0b82-35cc-4767-9933-389233e57654 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:52.576944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a01c0b82-35cc-4767-9933-389233e57654 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:52.577407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a01c0b82-35cc-4767-9933-389233e57654 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:52.644534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a01c0b82-35cc-4767-9933-389233e57654 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:52.653778 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a01c0b82-35cc-4767-9933-389233e57654 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1359 microversion: 2.1 time: 0.092670 Oct 11 00:07:52.654461 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3495/6758] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:52 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1359 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:53.677761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-82f9d36a-4f4f-41b7-85a4-53eabd7d296f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:53.678388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-82f9d36a-4f4f-41b7-85a4-53eabd7d296f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:53.686110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82f9d36a-4f4f-41b7-85a4-53eabd7d296f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:53.686652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82f9d36a-4f4f-41b7-85a4-53eabd7d296f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:53.687109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82f9d36a-4f4f-41b7-85a4-53eabd7d296f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:53.687827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82f9d36a-4f4f-41b7-85a4-53eabd7d296f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:53.688299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82f9d36a-4f4f-41b7-85a4-53eabd7d296f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:53.688747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82f9d36a-4f4f-41b7-85a4-53eabd7d296f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:53.766837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-82f9d36a-4f4f-41b7-85a4-53eabd7d296f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:53.782213 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-82f9d36a-4f4f-41b7-85a4-53eabd7d296f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1359 microversion: 2.1 time: 0.108363 Oct 11 00:07:53.782812 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3496/6759] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:53 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1359 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:54.806128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5cb71857-10d6-4577-83e1-44c220683d61 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:54.806774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5cb71857-10d6-4577-83e1-44c220683d61 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:54.816833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cb71857-10d6-4577-83e1-44c220683d61 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:54.817766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cb71857-10d6-4577-83e1-44c220683d61 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:54.819499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cb71857-10d6-4577-83e1-44c220683d61 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:54.820837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cb71857-10d6-4577-83e1-44c220683d61 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:54.821767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cb71857-10d6-4577-83e1-44c220683d61 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:54.822596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cb71857-10d6-4577-83e1-44c220683d61 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:54.861924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cb71857-10d6-4577-83e1-44c220683d61 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:54.862430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cb71857-10d6-4577-83e1-44c220683d61 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:54.862905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5cb71857-10d6-4577-83e1-44c220683d61 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:54.863365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-5cb71857-10d6-4577-83e1-44c220683d61 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lazy-loading 'fault' on Instance uuid df5f6657-05fb-4baf-b1e9-d2fabd443a6a {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:07:54.906669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5cb71857-10d6-4577-83e1-44c220683d61 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:07:54.914691 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5cb71857-10d6-4577-83e1-44c220683d61 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 200 len: 1364 microversion: 2.1 time: 0.112715 Oct 11 00:07:54.915268 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3497/6760] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:54 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 1364 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:07:55.940639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ff6c1d09-7f0d-4857-83e4-f9d8ac1952ee tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:07:55.941466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ff6c1d09-7f0d-4857-83e4-f9d8ac1952ee tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:07:55.950648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff6c1d09-7f0d-4857-83e4-f9d8ac1952ee tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:55.951181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff6c1d09-7f0d-4857-83e4-f9d8ac1952ee tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:55.951802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff6c1d09-7f0d-4857-83e4-f9d8ac1952ee tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:55.952577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff6c1d09-7f0d-4857-83e4-f9d8ac1952ee tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:07:55.953153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff6c1d09-7f0d-4857-83e4-f9d8ac1952ee tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:07:55.953662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff6c1d09-7f0d-4857-83e4-f9d8ac1952ee tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:07:55.970408 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-ff6c1d09-7f0d-4857-83e4-f9d8ac1952ee tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] HTTP exception thrown: Instance df5f6657-05fb-4baf-b1e9-d2fabd443a6a could not be found. Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ff6c1d09-7f0d-4857-83e4-f9d8ac1952ee tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Request method failure captured: Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a HTTP/1.1 Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLLstMFexBVKeRZfAj4OCdRv2YehxcaQe5WSbFwzJkUkY6SJnjfDm2dxiLn9eYpnR--tUOvl2KLmN3ree44KRlI2zh3Ld-tMuW3Hl-usm_NfJhejqaTW-3Rn2txi7roIax1gqv6lgH4fxV8-FpQFyIdTw_tVXsZtCYad971Mm27pxUg Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_be6e417773094ab08c170ca4b69f3742", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestVolumeBootPattern-451663755 Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a27b050389ad48089e214ad65eaa83bb Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance df5f6657-05fb-4baf-b1e9-d2fabd443a6a could not be found. Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'df5f6657-05fb-4baf-b1e9-d2fabd443a6a'} Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df5f6657-05fb-4baf-b1e9-d2fabd443a6a could not be found. Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df5f6657-05fb-4baf-b1e9-d2fabd443a6a could not be found. Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:07:55.972473 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:07:55.980320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:07:55.980320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:07:55.980320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:07:55.980320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:07:55.980320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:07:55.980320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df5f6657-05fb-4baf-b1e9-d2fabd443a6a could not be found. Oct 11 00:07:55.980320 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:07:55.980320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ff6c1d09-7f0d-4857-83e4-f9d8ac1952ee tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Returning 404 to user: Instance df5f6657-05fb-4baf-b1e9-d2fabd443a6a could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:07:55.980320 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ff6c1d09-7f0d-4857-83e4-f9d8ac1952ee tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 404 len: 111 microversion: 2.1 time: 0.038547 Oct 11 00:07:55.980320 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3498/6761] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:07:55 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:08:01.384026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4da7c4a0-05f0-42ea-a961-8b525da799e6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:01.384647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4da7c4a0-05f0-42ea-a961-8b525da799e6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:01.387745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:08:01.393134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4da7c4a0-05f0-42ea-a961-8b525da799e6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:01.393663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4da7c4a0-05f0-42ea-a961-8b525da799e6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:01.394123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4da7c4a0-05f0-42ea-a961-8b525da799e6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:01.394846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4da7c4a0-05f0-42ea-a961-8b525da799e6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:01.395319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4da7c4a0-05f0-42ea-a961-8b525da799e6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:01.395763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4da7c4a0-05f0-42ea-a961-8b525da799e6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:01.423188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4da7c4a0-05f0-42ea-a961-8b525da799e6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:08:01.510616 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4da7c4a0-05f0-42ea-a961-8b525da799e6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 204 len: 0 microversion: 2.1 time: 0.129527 Oct 11 00:08:01.510996 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3499/6762] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:08:01 2022] DELETE /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 00:08:01.519155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dae659a3-03c6-4837-9725-b65f785903e3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:01.519870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dae659a3-03c6-4837-9725-b65f785903e3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:01.525871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dae659a3-03c6-4837-9725-b65f785903e3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:01.526371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dae659a3-03c6-4837-9725-b65f785903e3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:01.526847 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dae659a3-03c6-4837-9725-b65f785903e3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:01.527850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dae659a3-03c6-4837-9725-b65f785903e3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:01.528321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dae659a3-03c6-4837-9725-b65f785903e3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:01.528895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dae659a3-03c6-4837-9725-b65f785903e3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:01.682632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dae659a3-03c6-4837-9725-b65f785903e3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:01.691846 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dae659a3-03c6-4837-9725-b65f785903e3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 200 len: 1411 microversion: 2.1 time: 0.176724 Oct 11 00:08:01.692457 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3500/6763] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:01 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 1411 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:02.716748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2523ef2c-7b67-469e-a77e-b08ce9fd4aba tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:02.717559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2523ef2c-7b67-469e-a77e-b08ce9fd4aba tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:02.724562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2523ef2c-7b67-469e-a77e-b08ce9fd4aba tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:02.725062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2523ef2c-7b67-469e-a77e-b08ce9fd4aba tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:02.725546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2523ef2c-7b67-469e-a77e-b08ce9fd4aba tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:02.726359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2523ef2c-7b67-469e-a77e-b08ce9fd4aba tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:02.726837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2523ef2c-7b67-469e-a77e-b08ce9fd4aba tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:02.727278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2523ef2c-7b67-469e-a77e-b08ce9fd4aba tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:02.875331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2523ef2c-7b67-469e-a77e-b08ce9fd4aba tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:02.883833 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2523ef2c-7b67-469e-a77e-b08ce9fd4aba tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 200 len: 1411 microversion: 2.1 time: 0.172354 Oct 11 00:08:02.884422 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3501/6764] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:02 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 1411 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:03.637667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-ed9c1f6c-124f-4603-9792-e4fe6d0dbc21 req-2ca4ce8b-3520-4298-95f2-4cfe2e46c4de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21dbd311-94d7-4edf-8827-6ac59eb8e959", "name": "network-vif-deleted", "tag": "67d70e37-7754-4e7f-9de9-17db1cf0b73d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:08:03.655873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ed9c1f6c-124f-4603-9792-e4fe6d0dbc21 req-2ca4ce8b-3520-4298-95f2-4cfe2e46c4de service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:03.656644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ed9c1f6c-124f-4603-9792-e4fe6d0dbc21 req-2ca4ce8b-3520-4298-95f2-4cfe2e46c4de service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:03.657937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ed9c1f6c-124f-4603-9792-e4fe6d0dbc21 req-2ca4ce8b-3520-4298-95f2-4cfe2e46c4de service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:03.675287 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-ed9c1f6c-124f-4603-9792-e4fe6d0dbc21 req-2ca4ce8b-3520-4298-95f2-4cfe2e46c4de service nova] Creating event network-vif-deleted:67d70e37-7754-4e7f-9de9-17db1cf0b73d for instance 21dbd311-94d7-4edf-8827-6ac59eb8e959 on n-h1-860864-2 Oct 11 00:08:03.682688 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-ed9c1f6c-124f-4603-9792-e4fe6d0dbc21 req-2ca4ce8b-3520-4298-95f2-4cfe2e46c4de service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048923 Oct 11 00:08:03.684510 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3502/6765] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:08:03.917026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ab0b80d2-7302-41cb-877d-d54fcb116017 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:03.919087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ab0b80d2-7302-41cb-877d-d54fcb116017 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:03.926351 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab0b80d2-7302-41cb-877d-d54fcb116017 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:03.927061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab0b80d2-7302-41cb-877d-d54fcb116017 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:03.979570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab0b80d2-7302-41cb-877d-d54fcb116017 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:03.979570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab0b80d2-7302-41cb-877d-d54fcb116017 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:03.979570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab0b80d2-7302-41cb-877d-d54fcb116017 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:03.979570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab0b80d2-7302-41cb-877d-d54fcb116017 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:04.030401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ab0b80d2-7302-41cb-877d-d54fcb116017 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:04.038684 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ab0b80d2-7302-41cb-877d-d54fcb116017 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 200 len: 1202 microversion: 2.1 time: 0.125829 Oct 11 00:08:04.039920 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3503/6766] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:03 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 1202 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:05.062958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-37de9a89-b469-42c5-8375-e6e87a33e15f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:05.064333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-37de9a89-b469-42c5-8375-e6e87a33e15f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:05.072740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37de9a89-b469-42c5-8375-e6e87a33e15f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:05.074435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37de9a89-b469-42c5-8375-e6e87a33e15f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:05.075074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37de9a89-b469-42c5-8375-e6e87a33e15f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:05.075847 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37de9a89-b469-42c5-8375-e6e87a33e15f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:05.076326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37de9a89-b469-42c5-8375-e6e87a33e15f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:05.076934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37de9a89-b469-42c5-8375-e6e87a33e15f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:05.143253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-37de9a89-b469-42c5-8375-e6e87a33e15f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:05.151692 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-37de9a89-b469-42c5-8375-e6e87a33e15f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 200 len: 1202 microversion: 2.1 time: 0.093873 Oct 11 00:08:05.152312 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3504/6767] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:05 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 1202 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:06.185120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2487dcda-2839-41a7-bc5a-7d883c192461 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:06.185930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2487dcda-2839-41a7-bc5a-7d883c192461 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:06.193653 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2487dcda-2839-41a7-bc5a-7d883c192461 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:06.194425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2487dcda-2839-41a7-bc5a-7d883c192461 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:06.195044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2487dcda-2839-41a7-bc5a-7d883c192461 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:06.195805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2487dcda-2839-41a7-bc5a-7d883c192461 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:06.196313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2487dcda-2839-41a7-bc5a-7d883c192461 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:06.196763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2487dcda-2839-41a7-bc5a-7d883c192461 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:06.272079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2487dcda-2839-41a7-bc5a-7d883c192461 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:06.281878 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2487dcda-2839-41a7-bc5a-7d883c192461 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 200 len: 1202 microversion: 2.1 time: 0.101985 Oct 11 00:08:06.282678 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3505/6768] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:06 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 1202 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:08:07.305131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dce97c42-ea4f-41a9-8ade-fcb4a4c17494 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:07.305798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dce97c42-ea4f-41a9-8ade-fcb4a4c17494 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:07.314199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dce97c42-ea4f-41a9-8ade-fcb4a4c17494 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:07.314919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dce97c42-ea4f-41a9-8ade-fcb4a4c17494 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:07.315377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dce97c42-ea4f-41a9-8ade-fcb4a4c17494 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:07.316114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dce97c42-ea4f-41a9-8ade-fcb4a4c17494 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:07.316586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dce97c42-ea4f-41a9-8ade-fcb4a4c17494 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:07.317171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dce97c42-ea4f-41a9-8ade-fcb4a4c17494 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:07.393702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dce97c42-ea4f-41a9-8ade-fcb4a4c17494 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:07.402735 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dce97c42-ea4f-41a9-8ade-fcb4a4c17494 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 200 len: 1202 microversion: 2.1 time: 0.101404 Oct 11 00:08:07.403402 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3506/6769] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:07 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 1202 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:08.426610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-32158774-3108-4c55-aeba-1a8299bd1231 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:08.427240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-32158774-3108-4c55-aeba-1a8299bd1231 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:08.436023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32158774-3108-4c55-aeba-1a8299bd1231 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:08.436680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32158774-3108-4c55-aeba-1a8299bd1231 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:08.437329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32158774-3108-4c55-aeba-1a8299bd1231 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:08.447351 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32158774-3108-4c55-aeba-1a8299bd1231 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:08.450895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32158774-3108-4c55-aeba-1a8299bd1231 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:08.451428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32158774-3108-4c55-aeba-1a8299bd1231 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:08.491005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32158774-3108-4c55-aeba-1a8299bd1231 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:08.491760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32158774-3108-4c55-aeba-1a8299bd1231 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:08.492222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32158774-3108-4c55-aeba-1a8299bd1231 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:08.492695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-32158774-3108-4c55-aeba-1a8299bd1231 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lazy-loading 'fault' on Instance uuid 21dbd311-94d7-4edf-8827-6ac59eb8e959 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:08:08.561463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-32158774-3108-4c55-aeba-1a8299bd1231 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:08.585462 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-32158774-3108-4c55-aeba-1a8299bd1231 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 200 len: 1207 microversion: 2.1 time: 0.162594 Oct 11 00:08:08.586380 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3507/6770] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:08 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 1207 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:09.617915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-178ea30c-24fe-4f5c-b0f2-36ee3eaf78cd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:09.619328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-178ea30c-24fe-4f5c-b0f2-36ee3eaf78cd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:09.627420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-178ea30c-24fe-4f5c-b0f2-36ee3eaf78cd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:09.628010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-178ea30c-24fe-4f5c-b0f2-36ee3eaf78cd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:09.628545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-178ea30c-24fe-4f5c-b0f2-36ee3eaf78cd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:09.629350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-178ea30c-24fe-4f5c-b0f2-36ee3eaf78cd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:09.629953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-178ea30c-24fe-4f5c-b0f2-36ee3eaf78cd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:09.630463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-178ea30c-24fe-4f5c-b0f2-36ee3eaf78cd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:09.646005 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-178ea30c-24fe-4f5c-b0f2-36ee3eaf78cd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] HTTP exception thrown: Instance 21dbd311-94d7-4edf-8827-6ac59eb8e959 could not be found. Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-178ea30c-24fe-4f5c-b0f2-36ee3eaf78cd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Request method failure captured: Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 HTTP/1.1 Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLLstMFexBVKeRZfAj4OCdRv2YehxcaQe5WSbFwzJkUkY6SJnjfDm2dxiLn9eYpnR--tUOvl2KLmN3ree44KRlI2zh3Ld-tMuW3Hl-usm_NfJhejqaTW-3Rn2txi7roIax1gqv6lgH4fxV8-FpQFyIdTw_tVXsZtCYad971Mm27pxUg Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_be6e417773094ab08c170ca4b69f3742", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestVolumeBootPattern-451663755 Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a27b050389ad48089e214ad65eaa83bb Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 21dbd311-94d7-4edf-8827-6ac59eb8e959 could not be found. Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '21dbd311-94d7-4edf-8827-6ac59eb8e959'} Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21dbd311-94d7-4edf-8827-6ac59eb8e959 could not be found. Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21dbd311-94d7-4edf-8827-6ac59eb8e959 could not be found. Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:08:09.647736 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:09.651803 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:08:09.651803 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:08:09.651803 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:08:09.651803 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:08:09.651803 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:08:09.651803 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21dbd311-94d7-4edf-8827-6ac59eb8e959 could not be found. Oct 11 00:08:09.651803 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:09.651803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-178ea30c-24fe-4f5c-b0f2-36ee3eaf78cd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Returning 404 to user: Instance 21dbd311-94d7-4edf-8827-6ac59eb8e959 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:08:09.651803 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-178ea30c-24fe-4f5c-b0f2-36ee3eaf78cd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 404 len: 111 microversion: 2.1 time: 0.035714 Oct 11 00:08:09.663980 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3508/6771] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:09 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:08:11.810846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2f812052-d384-4cfc-97e4-c9ae5ab795b8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:11.811444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2f812052-d384-4cfc-97e4-c9ae5ab795b8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:11.824998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f812052-d384-4cfc-97e4-c9ae5ab795b8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:11.824998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f812052-d384-4cfc-97e4-c9ae5ab795b8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:11.824998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f812052-d384-4cfc-97e4-c9ae5ab795b8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:11.824998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f812052-d384-4cfc-97e4-c9ae5ab795b8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:11.824998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f812052-d384-4cfc-97e4-c9ae5ab795b8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:11.824998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f812052-d384-4cfc-97e4-c9ae5ab795b8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:11.843561 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-2f812052-d384-4cfc-97e4-c9ae5ab795b8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] HTTP exception thrown: Instance df5f6657-05fb-4baf-b1e9-d2fabd443a6a could not be found. Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2f812052-d384-4cfc-97e4-c9ae5ab795b8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Request method failure captured: Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a HTTP/1.1 Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLLstMFexBVKeRZfAj4OCdRv2YehxcaQe5WSbFwzJkUkY6SJnjfDm2dxiLn9eYpnR--tUOvl2KLmN3ree44KRlI2zh3Ld-tMuW3Hl-usm_NfJhejqaTW-3Rn2txi7roIax1gqv6lgH4fxV8-FpQFyIdTw_tVXsZtCYad971Mm27pxUg Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_be6e417773094ab08c170ca4b69f3742", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestVolumeBootPattern-451663755 Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a27b050389ad48089e214ad65eaa83bb Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance df5f6657-05fb-4baf-b1e9-d2fabd443a6a could not be found. Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'df5f6657-05fb-4baf-b1e9-d2fabd443a6a'} Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df5f6657-05fb-4baf-b1e9-d2fabd443a6a could not be found. Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:08:11.845168 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:08:11.848979 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df5f6657-05fb-4baf-b1e9-d2fabd443a6a could not be found. Oct 11 00:08:11.848979 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:11.848979 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:08:11.848979 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:11.848979 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:08:11.848979 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:08:11.848979 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:08:11.848979 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:08:11.848979 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:08:11.848979 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df5f6657-05fb-4baf-b1e9-d2fabd443a6a could not be found. Oct 11 00:08:11.848979 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:11.848979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2f812052-d384-4cfc-97e4-c9ae5ab795b8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Returning 404 to user: Instance df5f6657-05fb-4baf-b1e9-d2fabd443a6a could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:08:11.848979 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2f812052-d384-4cfc-97e4-c9ae5ab795b8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 404 len: 111 microversion: 2.1 time: 0.039939 Oct 11 00:08:11.848979 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3509/6772] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:08:11 2022] DELETE /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 00:08:11.857127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-056f58de-f12f-4e95-bf1a-6f34b4089955 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:11.857748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-056f58de-f12f-4e95-bf1a-6f34b4089955 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: df5f6657-05fb-4baf-b1e9-d2fabd443a6a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:11.864138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-056f58de-f12f-4e95-bf1a-6f34b4089955 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:11.864644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-056f58de-f12f-4e95-bf1a-6f34b4089955 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:11.865098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-056f58de-f12f-4e95-bf1a-6f34b4089955 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:11.866097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-056f58de-f12f-4e95-bf1a-6f34b4089955 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:11.866566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-056f58de-f12f-4e95-bf1a-6f34b4089955 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:11.867010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-056f58de-f12f-4e95-bf1a-6f34b4089955 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:11.882770 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-056f58de-f12f-4e95-bf1a-6f34b4089955 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] HTTP exception thrown: Instance df5f6657-05fb-4baf-b1e9-d2fabd443a6a could not be found. Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-056f58de-f12f-4e95-bf1a-6f34b4089955 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Request method failure captured: Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a HTTP/1.1 Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLLstMFexBVKeRZfAj4OCdRv2YehxcaQe5WSbFwzJkUkY6SJnjfDm2dxiLn9eYpnR--tUOvl2KLmN3ree44KRlI2zh3Ld-tMuW3Hl-usm_NfJhejqaTW-3Rn2txi7roIax1gqv6lgH4fxV8-FpQFyIdTw_tVXsZtCYad971Mm27pxUg Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_be6e417773094ab08c170ca4b69f3742", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestVolumeBootPattern-451663755 Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a27b050389ad48089e214ad65eaa83bb Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance df5f6657-05fb-4baf-b1e9-d2fabd443a6a could not be found. Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'df5f6657-05fb-4baf-b1e9-d2fabd443a6a'} Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df5f6657-05fb-4baf-b1e9-d2fabd443a6a could not be found. Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df5f6657-05fb-4baf-b1e9-d2fabd443a6a could not be found. Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:08:11.884337 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:11.887991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:08:11.887991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:08:11.887991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:08:11.887991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:08:11.887991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:08:11.887991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df5f6657-05fb-4baf-b1e9-d2fabd443a6a could not be found. Oct 11 00:08:11.887991 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:11.887991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-056f58de-f12f-4e95-bf1a-6f34b4089955 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Returning 404 to user: Instance df5f6657-05fb-4baf-b1e9-d2fabd443a6a could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:08:11.887991 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-056f58de-f12f-4e95-bf1a-6f34b4089955 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a" status: 404 len: 111 microversion: 2.1 time: 0.033888 Oct 11 00:08:11.887991 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3510/6773] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:11 2022] GET /compute/v2.1/servers/df5f6657-05fb-4baf-b1e9-d2fabd443a6a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 00:08:12.306477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3b0c2ec5-fd89-4643-86bd-4beff69c62ce tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:12.307086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3b0c2ec5-fd89-4643-86bd-4beff69c62ce tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:12.315025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b0c2ec5-fd89-4643-86bd-4beff69c62ce tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:12.315602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b0c2ec5-fd89-4643-86bd-4beff69c62ce tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:12.316131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b0c2ec5-fd89-4643-86bd-4beff69c62ce tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:12.316906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b0c2ec5-fd89-4643-86bd-4beff69c62ce tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:12.317502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b0c2ec5-fd89-4643-86bd-4beff69c62ce tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:12.318013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b0c2ec5-fd89-4643-86bd-4beff69c62ce tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:12.332564 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-3b0c2ec5-fd89-4643-86bd-4beff69c62ce tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] HTTP exception thrown: Instance 21dbd311-94d7-4edf-8827-6ac59eb8e959 could not be found. Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3b0c2ec5-fd89-4643-86bd-4beff69c62ce tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Request method failure captured: Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 HTTP/1.1 Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLLstMFexBVKeRZfAj4OCdRv2YehxcaQe5WSbFwzJkUkY6SJnjfDm2dxiLn9eYpnR--tUOvl2KLmN3ree44KRlI2zh3Ld-tMuW3Hl-usm_NfJhejqaTW-3Rn2txi7roIax1gqv6lgH4fxV8-FpQFyIdTw_tVXsZtCYad971Mm27pxUg Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_be6e417773094ab08c170ca4b69f3742", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestVolumeBootPattern-451663755 Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a27b050389ad48089e214ad65eaa83bb Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 21dbd311-94d7-4edf-8827-6ac59eb8e959 could not be found. Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '21dbd311-94d7-4edf-8827-6ac59eb8e959'} Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21dbd311-94d7-4edf-8827-6ac59eb8e959 could not be found. Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:08:12.334243 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:08:12.337609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21dbd311-94d7-4edf-8827-6ac59eb8e959 could not be found. Oct 11 00:08:12.337609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:12.337609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:08:12.337609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:12.337609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:08:12.337609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:08:12.337609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:08:12.337609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:08:12.337609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:08:12.337609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21dbd311-94d7-4edf-8827-6ac59eb8e959 could not be found. Oct 11 00:08:12.337609 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:12.337609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3b0c2ec5-fd89-4643-86bd-4beff69c62ce tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Returning 404 to user: Instance 21dbd311-94d7-4edf-8827-6ac59eb8e959 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:08:12.337609 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3b0c2ec5-fd89-4643-86bd-4beff69c62ce tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 404 len: 111 microversion: 2.1 time: 0.033187 Oct 11 00:08:12.337609 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3511/6774] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:08:12 2022] DELETE /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 00:08:12.344350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ed2d4f72-c446-4242-9ba5-4518a6841077 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:12.345003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ed2d4f72-c446-4242-9ba5-4518a6841077 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 21dbd311-94d7-4edf-8827-6ac59eb8e959] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:12.351431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed2d4f72-c446-4242-9ba5-4518a6841077 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:12.351936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed2d4f72-c446-4242-9ba5-4518a6841077 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:12.352388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed2d4f72-c446-4242-9ba5-4518a6841077 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:12.353101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed2d4f72-c446-4242-9ba5-4518a6841077 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:12.353603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed2d4f72-c446-4242-9ba5-4518a6841077 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:12.354047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed2d4f72-c446-4242-9ba5-4518a6841077 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:12.368714 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-ed2d4f72-c446-4242-9ba5-4518a6841077 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] HTTP exception thrown: Instance 21dbd311-94d7-4edf-8827-6ac59eb8e959 could not be found. Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ed2d4f72-c446-4242-9ba5-4518a6841077 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Request method failure captured: Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 HTTP/1.1 Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLLstMFexBVKeRZfAj4OCdRv2YehxcaQe5WSbFwzJkUkY6SJnjfDm2dxiLn9eYpnR--tUOvl2KLmN3ree44KRlI2zh3Ld-tMuW3Hl-usm_NfJhejqaTW-3Rn2txi7roIax1gqv6lgH4fxV8-FpQFyIdTw_tVXsZtCYad971Mm27pxUg Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_be6e417773094ab08c170ca4b69f3742", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestVolumeBootPattern-451663755 Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a27b050389ad48089e214ad65eaa83bb Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 21dbd311-94d7-4edf-8827-6ac59eb8e959 could not be found. Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '21dbd311-94d7-4edf-8827-6ac59eb8e959'} Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21dbd311-94d7-4edf-8827-6ac59eb8e959 could not be found. Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21dbd311-94d7-4edf-8827-6ac59eb8e959 could not be found. Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:08:12.371072 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:12.375133 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:08:12.375133 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:08:12.375133 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:08:12.375133 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:08:12.375133 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:08:12.375133 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21dbd311-94d7-4edf-8827-6ac59eb8e959 could not be found. Oct 11 00:08:12.375133 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:08:12.375133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ed2d4f72-c446-4242-9ba5-4518a6841077 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Returning 404 to user: Instance 21dbd311-94d7-4edf-8827-6ac59eb8e959 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:08:12.375133 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ed2d4f72-c446-4242-9ba5-4518a6841077 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959" status: 404 len: 111 microversion: 2.1 time: 0.031880 Oct 11 00:08:12.376260 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3512/6775] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:12 2022] GET /compute/v2.1/servers/21dbd311-94d7-4edf-8827-6ac59eb8e959 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 00:08:12.450663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-462a0f82-1e6e-4311-ad07-37320c258e48 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Action: 'create', calling method: .version_select at 0x7f6633a06a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1344377026", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQHev8wEd1viL1+DibN9iLh0PpT3FU1+opQpneSGBqsPbakmXC76LIxpJO2Gj5EaN8OMxIE2z/LZCyBHOoX6m2/G8Iu8I2sNaMbD1513FFVAvkjb4SgOSWDVwG+QbMr/g=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:08:12.467326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-462a0f82-1e6e-4311-ad07-37320c258e48 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Getting quotas for project be6e417773094ab08c170ca4b69f3742. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:08:12.472603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-462a0f82-1e6e-4311-ad07-37320c258e48 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Getting quotas for user a27b050389ad48089e214ad65eaa83bb and project be6e417773094ab08c170ca4b69f3742. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:08:12.496174 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-462a0f82-1e6e-4311-ad07-37320c258e48 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.051841 Oct 11 00:08:12.496787 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3513/6776] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 11 00:08:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:08:17.272066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4945ce0a-e05a-4941-b3f6-c58cd5335ae2 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Action: 'create', calling method: .version_select at 0x7f662b8a1040>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-429737726", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqwlLAsBXH+yPiyGTDY580+08x3ugWlRz6dnct1c//EkaOAoUb2lPbkiLsfNTALNd6bCjvAz6KoBX875pijk/6dB86bkqqe8bYNvcAezuOSovqT091gr9mLSKjOckwkhA=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:08:17.294847 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-4945ce0a-e05a-4941-b3f6-c58cd5335ae2 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Getting quotas for project 694831e8468045868e607aa38a8c5285. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:08:17.304372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-4945ce0a-e05a-4941-b3f6-c58cd5335ae2 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Getting quotas for user 95c9644f1b8343909aad2dc421119071 and project 694831e8468045868e607aa38a8c5285. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:08:17.340425 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4945ce0a-e05a-4941-b3f6-c58cd5335ae2 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.073564 Oct 11 00:08:17.341308 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3514/6777] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 11 00:08:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:08:18.383422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-70885a64-1647-41ba-b9ec-6b87f9edec1d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-272456786", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "edf2c1a6-18e8-4822-a598-abe5dd147748", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-429737726", "security_groups": [{"name": "tempest-secgroup-smoke-527220517"}], "networks": [{"uuid": "6629007f-3d4b-4b54-88d5-b350ddb7d28c"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:08:18.513284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-70885a64-1647-41ba-b9ec-6b87f9edec1d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] validate_networks() for [('6629007f-3d4b-4b54-88d5-b350ddb7d28c', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:08:18.908305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-70885a64-1647-41ba-b9ec-6b87f9edec1d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:08:18.908753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-70885a64-1647-41ba-b9ec-6b87f9edec1d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:08:18.909252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-70885a64-1647-41ba-b9ec-6b87f9edec1d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:08:18.909713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-70885a64-1647-41ba-b9ec-6b87f9edec1d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:08:18.910147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-70885a64-1647-41ba-b9ec-6b87f9edec1d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:08:18.920047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70885a64-1647-41ba-b9ec-6b87f9edec1d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:18.920560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70885a64-1647-41ba-b9ec-6b87f9edec1d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:18.921027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70885a64-1647-41ba-b9ec-6b87f9edec1d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:18.921826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70885a64-1647-41ba-b9ec-6b87f9edec1d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:18.922309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70885a64-1647-41ba-b9ec-6b87f9edec1d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:18.922761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70885a64-1647-41ba-b9ec-6b87f9edec1d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:18.940904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-70885a64-1647-41ba-b9ec-6b87f9edec1d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Getting quotas for project 694831e8468045868e607aa38a8c5285. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:08:18.946337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-70885a64-1647-41ba-b9ec-6b87f9edec1d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Getting quotas for user 95c9644f1b8343909aad2dc421119071 and project 694831e8468045868e607aa38a8c5285. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:08:19.009361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-70885a64-1647-41ba-b9ec-6b87f9edec1d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:08:19.011839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-70885a64-1647-41ba-b9ec-6b87f9edec1d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='edf2c1a6-18e8-4822-a598-abe5dd147748',volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:08:19.155513 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-70885a64-1647-41ba-b9ec-6b87f9edec1d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.776110 Oct 11 00:08:19.156235 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3515/6778] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:08:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 00:08:19.179948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ad313177-0085-4262-b385-d5bfbfb29f20 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:19.180754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ad313177-0085-4262-b385-d5bfbfb29f20 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:19.258595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ad313177-0085-4262-b385-d5bfbfb29f20 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:19.266605 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ad313177-0085-4262-b385-d5bfbfb29f20 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1097 microversion: 2.1 time: 0.103218 Oct 11 00:08:19.267629 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3516/6779] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:19 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1097 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:08:20.289713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e6671085-777d-4a1e-8982-13e741930a95 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:20.290673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e6671085-777d-4a1e-8982-13e741930a95 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:20.299593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6671085-777d-4a1e-8982-13e741930a95 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:20.300453 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6671085-777d-4a1e-8982-13e741930a95 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:20.301126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6671085-777d-4a1e-8982-13e741930a95 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:20.302202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6671085-777d-4a1e-8982-13e741930a95 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:20.302929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6671085-777d-4a1e-8982-13e741930a95 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:20.303635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e6671085-777d-4a1e-8982-13e741930a95 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:20.324473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:08:20.404678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e6671085-777d-4a1e-8982-13e741930a95 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:20.418170 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e6671085-777d-4a1e-8982-13e741930a95 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1203 microversion: 2.1 time: 0.132102 Oct 11 00:08:20.419159 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3517/6780] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:20 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1203 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:08:21.445850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ced3a171-b325-4a8d-adf5-2eed7a063e04 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:21.446434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ced3a171-b325-4a8d-adf5-2eed7a063e04 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:21.456620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ced3a171-b325-4a8d-adf5-2eed7a063e04 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:21.457352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ced3a171-b325-4a8d-adf5-2eed7a063e04 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:21.457864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ced3a171-b325-4a8d-adf5-2eed7a063e04 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:21.458598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ced3a171-b325-4a8d-adf5-2eed7a063e04 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:21.459079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ced3a171-b325-4a8d-adf5-2eed7a063e04 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:21.459533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ced3a171-b325-4a8d-adf5-2eed7a063e04 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:21.602744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ced3a171-b325-4a8d-adf5-2eed7a063e04 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:21.623663 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ced3a171-b325-4a8d-adf5-2eed7a063e04 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1213 microversion: 2.1 time: 0.182211 Oct 11 00:08:21.645759 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3518/6781] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:21 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1213 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:22.503921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-d983e1cb-4379-4dee-8060-8ecea8ea910b req-3737f9b8-2d2d-4b7b-8454-d21f8f751695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23b5c773-d7cc-495d-97ed-ddbbf0ca8dba", "tag": "5e2a4156-9ab3-4cfe-8382-216d561b2b35"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:08:22.527636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d983e1cb-4379-4dee-8060-8ecea8ea910b req-3737f9b8-2d2d-4b7b-8454-d21f8f751695 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:22.529745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d983e1cb-4379-4dee-8060-8ecea8ea910b req-3737f9b8-2d2d-4b7b-8454-d21f8f751695 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:22.530538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d983e1cb-4379-4dee-8060-8ecea8ea910b req-3737f9b8-2d2d-4b7b-8454-d21f8f751695 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:22.552474 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-d983e1cb-4379-4dee-8060-8ecea8ea910b req-3737f9b8-2d2d-4b7b-8454-d21f8f751695 service nova] Creating event network-changed:5e2a4156-9ab3-4cfe-8382-216d561b2b35 for instance 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba on n-h1-860864-2 Oct 11 00:08:22.561936 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-d983e1cb-4379-4dee-8060-8ecea8ea910b req-3737f9b8-2d2d-4b7b-8454-d21f8f751695 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060841 Oct 11 00:08:22.564298 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3519/6782] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:08:22.660812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ea4acfe6-38a3-4a6c-b385-00dfa6074a09 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:22.662506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ea4acfe6-38a3-4a6c-b385-00dfa6074a09 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:22.670484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea4acfe6-38a3-4a6c-b385-00dfa6074a09 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:22.671383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea4acfe6-38a3-4a6c-b385-00dfa6074a09 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:22.672301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea4acfe6-38a3-4a6c-b385-00dfa6074a09 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:22.673244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea4acfe6-38a3-4a6c-b385-00dfa6074a09 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:22.673943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea4acfe6-38a3-4a6c-b385-00dfa6074a09 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:22.674590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea4acfe6-38a3-4a6c-b385-00dfa6074a09 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:22.838524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ea4acfe6-38a3-4a6c-b385-00dfa6074a09 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:22.848108 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ea4acfe6-38a3-4a6c-b385-00dfa6074a09 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1280 microversion: 2.1 time: 0.191494 Oct 11 00:08:22.858212 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3520/6783] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:22 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1280 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:08:23.871390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-aa665b74-6c53-46af-826d-abedf4967e0d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:23.875119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-aa665b74-6c53-46af-826d-abedf4967e0d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:23.883016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa665b74-6c53-46af-826d-abedf4967e0d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:23.883791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa665b74-6c53-46af-826d-abedf4967e0d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:23.884407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa665b74-6c53-46af-826d-abedf4967e0d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:23.885336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa665b74-6c53-46af-826d-abedf4967e0d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:23.886184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa665b74-6c53-46af-826d-abedf4967e0d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:23.886642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa665b74-6c53-46af-826d-abedf4967e0d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:24.030483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-aa665b74-6c53-46af-826d-abedf4967e0d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:24.039583 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-aa665b74-6c53-46af-826d-abedf4967e0d tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1280 microversion: 2.1 time: 0.172276 Oct 11 00:08:24.040190 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3521/6784] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:23 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1280 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:25.064134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fae019a3-0732-405c-95dc-30cfc6228ccb tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:25.064797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fae019a3-0732-405c-95dc-30cfc6228ccb tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:25.072253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fae019a3-0732-405c-95dc-30cfc6228ccb tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:25.072765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fae019a3-0732-405c-95dc-30cfc6228ccb tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:25.073218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fae019a3-0732-405c-95dc-30cfc6228ccb tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:25.073974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fae019a3-0732-405c-95dc-30cfc6228ccb tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:25.074450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fae019a3-0732-405c-95dc-30cfc6228ccb tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:25.075040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fae019a3-0732-405c-95dc-30cfc6228ccb tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:25.223188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fae019a3-0732-405c-95dc-30cfc6228ccb tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:25.232456 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fae019a3-0732-405c-95dc-30cfc6228ccb tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1280 microversion: 2.1 time: 0.172635 Oct 11 00:08:25.244950 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3522/6785] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:25 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1280 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:26.257770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-24b76e8d-dc3f-404e-8e6e-eb0301df6b14 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:26.258368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-24b76e8d-dc3f-404e-8e6e-eb0301df6b14 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:26.266053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24b76e8d-dc3f-404e-8e6e-eb0301df6b14 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:26.266562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24b76e8d-dc3f-404e-8e6e-eb0301df6b14 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:26.267016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24b76e8d-dc3f-404e-8e6e-eb0301df6b14 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:26.267736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24b76e8d-dc3f-404e-8e6e-eb0301df6b14 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:26.268206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24b76e8d-dc3f-404e-8e6e-eb0301df6b14 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:26.268649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-24b76e8d-dc3f-404e-8e6e-eb0301df6b14 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:26.408201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-24b76e8d-dc3f-404e-8e6e-eb0301df6b14 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:26.416652 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-24b76e8d-dc3f-404e-8e6e-eb0301df6b14 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1268 microversion: 2.1 time: 0.163061 Oct 11 00:08:26.417231 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3523/6786] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:26 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:27.441017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-07bd5914-6f78-4c45-92e6-7361f3906af1 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:27.441689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-07bd5914-6f78-4c45-92e6-7361f3906af1 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:27.449491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07bd5914-6f78-4c45-92e6-7361f3906af1 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:27.449997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07bd5914-6f78-4c45-92e6-7361f3906af1 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:27.450451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07bd5914-6f78-4c45-92e6-7361f3906af1 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:27.451162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07bd5914-6f78-4c45-92e6-7361f3906af1 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:27.451630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07bd5914-6f78-4c45-92e6-7361f3906af1 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:27.452075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07bd5914-6f78-4c45-92e6-7361f3906af1 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:27.592764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-07bd5914-6f78-4c45-92e6-7361f3906af1 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:27.600766 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-07bd5914-6f78-4c45-92e6-7361f3906af1 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1268 microversion: 2.1 time: 0.164462 Oct 11 00:08:27.601347 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3524/6787] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:27 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:28.732967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6617e62f-b5a7-4aae-bcca-48f4f6c57c0c tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:28.733591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6617e62f-b5a7-4aae-bcca-48f4f6c57c0c tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:28.740531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6617e62f-b5a7-4aae-bcca-48f4f6c57c0c tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:28.741038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6617e62f-b5a7-4aae-bcca-48f4f6c57c0c tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:28.741526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6617e62f-b5a7-4aae-bcca-48f4f6c57c0c tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:28.742257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6617e62f-b5a7-4aae-bcca-48f4f6c57c0c tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:28.742726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6617e62f-b5a7-4aae-bcca-48f4f6c57c0c tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:28.743171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6617e62f-b5a7-4aae-bcca-48f4f6c57c0c tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:28.887363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6617e62f-b5a7-4aae-bcca-48f4f6c57c0c tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:28.895549 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6617e62f-b5a7-4aae-bcca-48f4f6c57c0c tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1268 microversion: 2.1 time: 0.166747 Oct 11 00:08:28.896145 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3525/6788] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:28 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:29.919905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cb0bb782-d5d8-4b0c-8a1a-cc340979f33b tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:29.920547 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cb0bb782-d5d8-4b0c-8a1a-cc340979f33b tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:29.922850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:08:29.923663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=16 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:08:29.925496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:08:29.932619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb0bb782-d5d8-4b0c-8a1a-cc340979f33b tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:29.933130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb0bb782-d5d8-4b0c-8a1a-cc340979f33b tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:29.933629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb0bb782-d5d8-4b0c-8a1a-cc340979f33b tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:29.934529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb0bb782-d5d8-4b0c-8a1a-cc340979f33b tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:29.935011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb0bb782-d5d8-4b0c-8a1a-cc340979f33b tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:29.935463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb0bb782-d5d8-4b0c-8a1a-cc340979f33b tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:30.076311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cb0bb782-d5d8-4b0c-8a1a-cc340979f33b tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:30.084430 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cb0bb782-d5d8-4b0c-8a1a-cc340979f33b tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1268 microversion: 2.1 time: 0.168765 Oct 11 00:08:30.085012 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3526/6789] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:29 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:31.109661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-263c76cf-8dff-4744-97f7-f5352aa8e235 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:31.110333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-263c76cf-8dff-4744-97f7-f5352aa8e235 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:31.117517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-263c76cf-8dff-4744-97f7-f5352aa8e235 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:31.118043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-263c76cf-8dff-4744-97f7-f5352aa8e235 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:31.118689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-263c76cf-8dff-4744-97f7-f5352aa8e235 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:31.119359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-263c76cf-8dff-4744-97f7-f5352aa8e235 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:31.119829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-263c76cf-8dff-4744-97f7-f5352aa8e235 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:31.120274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-263c76cf-8dff-4744-97f7-f5352aa8e235 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:31.259388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-263c76cf-8dff-4744-97f7-f5352aa8e235 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:31.267456 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-263c76cf-8dff-4744-97f7-f5352aa8e235 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1268 microversion: 2.1 time: 0.161815 Oct 11 00:08:31.268242 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3527/6790] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:31 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:31.313761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7b83f30e-bca4-40dd-bd65-b8872ff744ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1978268747", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1344377026", "security_groups": [{"name": "tempest-secgroup-smoke-991778925"}], "block_device_mapping_v2": [{"uuid": "54c1bc63-0dfd-4658-839c-8447aa878cfa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6b4889cd-925d-4509-9797-a829b845f15b"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:08:31.430222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-7b83f30e-bca4-40dd-bd65-b8872ff744ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] validate_networks() for [('6b4889cd-925d-4509-9797-a829b845f15b', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:08:31.815649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7b83f30e-bca4-40dd-bd65-b8872ff744ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:08:31.815924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7b83f30e-bca4-40dd-bd65-b8872ff744ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:08:31.816423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7b83f30e-bca4-40dd-bd65-b8872ff744ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:08:31.816850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7b83f30e-bca4-40dd-bd65-b8872ff744ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:08:31.817278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7b83f30e-bca4-40dd-bd65-b8872ff744ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:08:31.828417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b83f30e-bca4-40dd-bd65-b8872ff744ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:31.828914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b83f30e-bca4-40dd-bd65-b8872ff744ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:31.829365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b83f30e-bca4-40dd-bd65-b8872ff744ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:31.830136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b83f30e-bca4-40dd-bd65-b8872ff744ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:31.831008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b83f30e-bca4-40dd-bd65-b8872ff744ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:31.831122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b83f30e-bca4-40dd-bd65-b8872ff744ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:31.848957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-7b83f30e-bca4-40dd-bd65-b8872ff744ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Getting quotas for project be6e417773094ab08c170ca4b69f3742. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:08:31.854994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-7b83f30e-bca4-40dd-bd65-b8872ff744ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Getting quotas for user a27b050389ad48089e214ad65eaa83bb and project be6e417773094ab08c170ca4b69f3742. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:08:31.915527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7b83f30e-bca4-40dd-bd65-b8872ff744ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:08:31.917830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7b83f30e-bca4-40dd-bd65-b8872ff744ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='54c1bc63-0dfd-4658-839c-8447aa878cfa',volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:08:32.055160 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7b83f30e-bca4-40dd-bd65-b8872ff744ae tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.745523 Oct 11 00:08:32.055861 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3528/6791] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:08:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 00:08:32.068086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c8fc5860-6ba6-4fd4-9cd3-38efb636dcf2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:32.068715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c8fc5860-6ba6-4fd4-9cd3-38efb636dcf2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:32.125790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c8fc5860-6ba6-4fd4-9cd3-38efb636dcf2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:32.132901 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c8fc5860-6ba6-4fd4-9cd3-38efb636dcf2 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1095 microversion: 2.1 time: 0.068893 Oct 11 00:08:32.133516 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3529/6792] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:32 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:32.291925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6c024410-c46d-41f6-90f0-f6ab26a0e60c tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:32.292549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6c024410-c46d-41f6-90f0-f6ab26a0e60c tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:32.299939 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c024410-c46d-41f6-90f0-f6ab26a0e60c tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:32.300535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c024410-c46d-41f6-90f0-f6ab26a0e60c tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:32.300907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c024410-c46d-41f6-90f0-f6ab26a0e60c tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:32.301742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c024410-c46d-41f6-90f0-f6ab26a0e60c tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:32.302360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c024410-c46d-41f6-90f0-f6ab26a0e60c tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:32.302809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c024410-c46d-41f6-90f0-f6ab26a0e60c tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:32.455083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6c024410-c46d-41f6-90f0-f6ab26a0e60c tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:32.464267 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6c024410-c46d-41f6-90f0-f6ab26a0e60c tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1268 microversion: 2.1 time: 0.177093 Oct 11 00:08:32.464715 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3530/6793] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:32 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1268 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:33.156954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c4a78f4b-6a8d-410d-8eb9-3cf36352e0c3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:33.157642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c4a78f4b-6a8d-410d-8eb9-3cf36352e0c3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:33.164268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4a78f4b-6a8d-410d-8eb9-3cf36352e0c3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:33.164907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4a78f4b-6a8d-410d-8eb9-3cf36352e0c3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:33.165855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4a78f4b-6a8d-410d-8eb9-3cf36352e0c3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:33.166717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4a78f4b-6a8d-410d-8eb9-3cf36352e0c3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:33.167382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4a78f4b-6a8d-410d-8eb9-3cf36352e0c3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:33.167969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4a78f4b-6a8d-410d-8eb9-3cf36352e0c3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:33.241590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c4a78f4b-6a8d-410d-8eb9-3cf36352e0c3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:33.250461 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c4a78f4b-6a8d-410d-8eb9-3cf36352e0c3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1201 microversion: 2.1 time: 0.097449 Oct 11 00:08:33.251030 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3531/6794] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:33 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1201 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:33.489882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-94fcbd40-0423-4651-9361-93fbc25cacc0 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:33.490779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-94fcbd40-0423-4651-9361-93fbc25cacc0 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:33.496983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94fcbd40-0423-4651-9361-93fbc25cacc0 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:33.497534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94fcbd40-0423-4651-9361-93fbc25cacc0 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:33.497997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94fcbd40-0423-4651-9361-93fbc25cacc0 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:33.498729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94fcbd40-0423-4651-9361-93fbc25cacc0 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:33.499329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94fcbd40-0423-4651-9361-93fbc25cacc0 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:33.499887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-94fcbd40-0423-4651-9361-93fbc25cacc0 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:33.653133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-94fcbd40-0423-4651-9361-93fbc25cacc0 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:33.661684 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-94fcbd40-0423-4651-9361-93fbc25cacc0 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1268 microversion: 2.1 time: 0.175892 Oct 11 00:08:33.662373 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3532/6795] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:33 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:34.274419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-91781e33-9496-4c05-9af1-692ca9876e92 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:34.275166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-91781e33-9496-4c05-9af1-692ca9876e92 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:34.282340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91781e33-9496-4c05-9af1-692ca9876e92 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:34.282929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91781e33-9496-4c05-9af1-692ca9876e92 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:34.283471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91781e33-9496-4c05-9af1-692ca9876e92 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:34.284256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91781e33-9496-4c05-9af1-692ca9876e92 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:34.285224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91781e33-9496-4c05-9af1-692ca9876e92 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:34.285224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91781e33-9496-4c05-9af1-692ca9876e92 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:34.438872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-91781e33-9496-4c05-9af1-692ca9876e92 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:34.448788 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-91781e33-9496-4c05-9af1-692ca9876e92 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1278 microversion: 2.1 time: 0.178183 Oct 11 00:08:34.449959 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3533/6796] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:34 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:34.686447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-381f862f-4d99-4fa4-ad8d-37bf876b63d9 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:34.687213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-381f862f-4d99-4fa4-ad8d-37bf876b63d9 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:34.694324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-381f862f-4d99-4fa4-ad8d-37bf876b63d9 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:34.695028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-381f862f-4d99-4fa4-ad8d-37bf876b63d9 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:34.695638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-381f862f-4d99-4fa4-ad8d-37bf876b63d9 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:34.697158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-381f862f-4d99-4fa4-ad8d-37bf876b63d9 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:34.697831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-381f862f-4d99-4fa4-ad8d-37bf876b63d9 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:34.698638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-381f862f-4d99-4fa4-ad8d-37bf876b63d9 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:34.857948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-381f862f-4d99-4fa4-ad8d-37bf876b63d9 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:34.867433 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-381f862f-4d99-4fa4-ad8d-37bf876b63d9 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1268 microversion: 2.1 time: 0.184933 Oct 11 00:08:34.868364 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3534/6797] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:34 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1268 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:34.873812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-44b78d56-6a79-4f8f-98dc-2c91504c486d req-2e56ae59-5a51-431f-9506-4102247eb796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef051080-50b9-4445-a058-99cfd21e5096", "tag": "79c436d2-8fad-4829-a3dc-a431feb4ba9e"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:08:34.885158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-44b78d56-6a79-4f8f-98dc-2c91504c486d req-2e56ae59-5a51-431f-9506-4102247eb796 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:34.886015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-44b78d56-6a79-4f8f-98dc-2c91504c486d req-2e56ae59-5a51-431f-9506-4102247eb796 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:34.886546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-44b78d56-6a79-4f8f-98dc-2c91504c486d req-2e56ae59-5a51-431f-9506-4102247eb796 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:34.899348 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-44b78d56-6a79-4f8f-98dc-2c91504c486d req-2e56ae59-5a51-431f-9506-4102247eb796 service nova] Creating event network-changed:79c436d2-8fad-4829-a3dc-a431feb4ba9e for instance ef051080-50b9-4445-a058-99cfd21e5096 on n-h2-860864-2 Oct 11 00:08:34.905878 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-44b78d56-6a79-4f8f-98dc-2c91504c486d req-2e56ae59-5a51-431f-9506-4102247eb796 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035774 Oct 11 00:08:34.906889 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3535/6798] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:08:35.474023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ba5168fc-0c83-4836-91fc-5d6d85f52d0b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:35.474877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ba5168fc-0c83-4836-91fc-5d6d85f52d0b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:35.481437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba5168fc-0c83-4836-91fc-5d6d85f52d0b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:35.482678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba5168fc-0c83-4836-91fc-5d6d85f52d0b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:35.483234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba5168fc-0c83-4836-91fc-5d6d85f52d0b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:35.484053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba5168fc-0c83-4836-91fc-5d6d85f52d0b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:35.484716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba5168fc-0c83-4836-91fc-5d6d85f52d0b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:35.485384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba5168fc-0c83-4836-91fc-5d6d85f52d0b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:35.635107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ba5168fc-0c83-4836-91fc-5d6d85f52d0b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:35.643983 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ba5168fc-0c83-4836-91fc-5d6d85f52d0b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1278 microversion: 2.1 time: 0.175413 Oct 11 00:08:35.644830 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3536/6799] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:35 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:35.891935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8be6787f-9a2f-4ceb-aad0-bd5bae710335 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:35.892571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8be6787f-9a2f-4ceb-aad0-bd5bae710335 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:35.898771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8be6787f-9a2f-4ceb-aad0-bd5bae710335 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:35.899277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8be6787f-9a2f-4ceb-aad0-bd5bae710335 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:35.900723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8be6787f-9a2f-4ceb-aad0-bd5bae710335 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:35.901475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8be6787f-9a2f-4ceb-aad0-bd5bae710335 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:35.901953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8be6787f-9a2f-4ceb-aad0-bd5bae710335 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:35.902579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8be6787f-9a2f-4ceb-aad0-bd5bae710335 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:35.905830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:08:36.057464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8be6787f-9a2f-4ceb-aad0-bd5bae710335 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:36.065886 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8be6787f-9a2f-4ceb-aad0-bd5bae710335 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1268 microversion: 2.1 time: 0.178401 Oct 11 00:08:36.066574 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3537/6800] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:35 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:36.152307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-a12d8ba5-3411-48e1-a933-cf511213d3b6 req-a9a1cb67-47be-44cf-9083-8247d590ca74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23b5c773-d7cc-495d-97ed-ddbbf0ca8dba", "name": "network-vif-plugged", "status": "completed", "tag": "5e2a4156-9ab3-4cfe-8382-216d561b2b35"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:08:36.161930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a12d8ba5-3411-48e1-a933-cf511213d3b6 req-a9a1cb67-47be-44cf-9083-8247d590ca74 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:36.162439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a12d8ba5-3411-48e1-a933-cf511213d3b6 req-a9a1cb67-47be-44cf-9083-8247d590ca74 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:36.162891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a12d8ba5-3411-48e1-a933-cf511213d3b6 req-a9a1cb67-47be-44cf-9083-8247d590ca74 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:36.174227 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a12d8ba5-3411-48e1-a933-cf511213d3b6 req-a9a1cb67-47be-44cf-9083-8247d590ca74 service nova] Creating event network-vif-plugged:5e2a4156-9ab3-4cfe-8382-216d561b2b35 for instance 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba on n-h1-860864-2 Oct 11 00:08:36.179181 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-a12d8ba5-3411-48e1-a933-cf511213d3b6 req-a9a1cb67-47be-44cf-9083-8247d590ca74 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104514 Oct 11 00:08:36.179775 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3538/6801] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:08:36.670012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f14b1a36-6088-4c14-84fb-fd770cc3e7e1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:36.670764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f14b1a36-6088-4c14-84fb-fd770cc3e7e1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:36.677076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f14b1a36-6088-4c14-84fb-fd770cc3e7e1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:36.677622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f14b1a36-6088-4c14-84fb-fd770cc3e7e1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:36.678083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f14b1a36-6088-4c14-84fb-fd770cc3e7e1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:36.678806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f14b1a36-6088-4c14-84fb-fd770cc3e7e1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:36.679281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f14b1a36-6088-4c14-84fb-fd770cc3e7e1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:36.679730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f14b1a36-6088-4c14-84fb-fd770cc3e7e1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:36.816052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f14b1a36-6088-4c14-84fb-fd770cc3e7e1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:36.829911 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f14b1a36-6088-4c14-84fb-fd770cc3e7e1 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1278 microversion: 2.1 time: 0.165623 Oct 11 00:08:36.830507 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3539/6802] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:36 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:37.090403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-513ed778-4da4-429c-91e1-18c055d04ccc tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:37.091075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-513ed778-4da4-429c-91e1-18c055d04ccc tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:37.097279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-513ed778-4da4-429c-91e1-18c055d04ccc tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:37.097893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-513ed778-4da4-429c-91e1-18c055d04ccc tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:37.098428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-513ed778-4da4-429c-91e1-18c055d04ccc tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:37.099229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-513ed778-4da4-429c-91e1-18c055d04ccc tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:37.099782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-513ed778-4da4-429c-91e1-18c055d04ccc tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:37.100322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-513ed778-4da4-429c-91e1-18c055d04ccc tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:37.244204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-513ed778-4da4-429c-91e1-18c055d04ccc tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:37.252522 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-513ed778-4da4-429c-91e1-18c055d04ccc tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1268 microversion: 2.1 time: 0.166835 Oct 11 00:08:37.253125 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3540/6803] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:37 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:37.852127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9c2c21fc-b52f-4ecb-9d00-f4f6a12a8437 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:37.853056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9c2c21fc-b52f-4ecb-9d00-f4f6a12a8437 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:37.860257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c2c21fc-b52f-4ecb-9d00-f4f6a12a8437 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:37.860759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c2c21fc-b52f-4ecb-9d00-f4f6a12a8437 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:37.861214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c2c21fc-b52f-4ecb-9d00-f4f6a12a8437 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:37.861948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c2c21fc-b52f-4ecb-9d00-f4f6a12a8437 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:37.862420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c2c21fc-b52f-4ecb-9d00-f4f6a12a8437 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:37.862858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c2c21fc-b52f-4ecb-9d00-f4f6a12a8437 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:37.999244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9c2c21fc-b52f-4ecb-9d00-f4f6a12a8437 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:38.007231 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9c2c21fc-b52f-4ecb-9d00-f4f6a12a8437 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1278 microversion: 2.1 time: 0.159007 Oct 11 00:08:38.007818 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3541/6804] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:37 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:38.276467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d068d4d5-34d1-4ae6-bf59-5bfba042782a tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:38.277103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d068d4d5-34d1-4ae6-bf59-5bfba042782a tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:38.283190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d068d4d5-34d1-4ae6-bf59-5bfba042782a tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:38.283692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d068d4d5-34d1-4ae6-bf59-5bfba042782a tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:38.284147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d068d4d5-34d1-4ae6-bf59-5bfba042782a tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:38.284859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d068d4d5-34d1-4ae6-bf59-5bfba042782a tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:38.285340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d068d4d5-34d1-4ae6-bf59-5bfba042782a tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:38.285816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d068d4d5-34d1-4ae6-bf59-5bfba042782a tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:38.430228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d068d4d5-34d1-4ae6-bf59-5bfba042782a tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:38.438348 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d068d4d5-34d1-4ae6-bf59-5bfba042782a tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1456 microversion: 2.1 time: 0.165979 Oct 11 00:08:38.438936 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3542/6805] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:38 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1456 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:38.460362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9060e90e-cc3b-496f-8bf2-254be052dd8e tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:38.460991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9060e90e-cc3b-496f-8bf2-254be052dd8e tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:38.467546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9060e90e-cc3b-496f-8bf2-254be052dd8e tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:38.468054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9060e90e-cc3b-496f-8bf2-254be052dd8e tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:38.468507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9060e90e-cc3b-496f-8bf2-254be052dd8e tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:38.469226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9060e90e-cc3b-496f-8bf2-254be052dd8e tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:38.469734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9060e90e-cc3b-496f-8bf2-254be052dd8e tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:38.470182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9060e90e-cc3b-496f-8bf2-254be052dd8e tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:38.603207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9060e90e-cc3b-496f-8bf2-254be052dd8e tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:38.611185 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9060e90e-cc3b-496f-8bf2-254be052dd8e tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1456 microversion: 2.1 time: 0.154500 Oct 11 00:08:38.611764 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3543/6806] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:38 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1456 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:39.031723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dbe6475d-f3e3-405f-b401-2bc92a222cd9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:39.032471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dbe6475d-f3e3-405f-b401-2bc92a222cd9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:39.039590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbe6475d-f3e3-405f-b401-2bc92a222cd9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:39.040151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbe6475d-f3e3-405f-b401-2bc92a222cd9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:39.040606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbe6475d-f3e3-405f-b401-2bc92a222cd9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:39.041324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbe6475d-f3e3-405f-b401-2bc92a222cd9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:39.041822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbe6475d-f3e3-405f-b401-2bc92a222cd9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:39.042261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbe6475d-f3e3-405f-b401-2bc92a222cd9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:39.203116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dbe6475d-f3e3-405f-b401-2bc92a222cd9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:39.212995 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dbe6475d-f3e3-405f-b401-2bc92a222cd9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1266 microversion: 2.1 time: 0.185157 Oct 11 00:08:39.213887 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3544/6807] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:39 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:40.236344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5ebf770e-50dc-4815-969c-7da67bcac651 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:40.236961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5ebf770e-50dc-4815-969c-7da67bcac651 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:40.245184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ebf770e-50dc-4815-969c-7da67bcac651 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:40.245358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ebf770e-50dc-4815-969c-7da67bcac651 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:40.245752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ebf770e-50dc-4815-969c-7da67bcac651 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:40.246484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ebf770e-50dc-4815-969c-7da67bcac651 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:40.246961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ebf770e-50dc-4815-969c-7da67bcac651 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:40.247409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ebf770e-50dc-4815-969c-7da67bcac651 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:40.406459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5ebf770e-50dc-4815-969c-7da67bcac651 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:40.415603 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5ebf770e-50dc-4815-969c-7da67bcac651 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1266 microversion: 2.1 time: 0.182656 Oct 11 00:08:40.416738 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3545/6808] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:40 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:40.421761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-8f345cf8-a426-43a4-a5bb-ed680f395d77 req-861297a6-2b4a-4630-b628-f95c992e2de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23b5c773-d7cc-495d-97ed-ddbbf0ca8dba", "tag": "5e2a4156-9ab3-4cfe-8382-216d561b2b35"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:08:40.433112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8f345cf8-a426-43a4-a5bb-ed680f395d77 req-861297a6-2b4a-4630-b628-f95c992e2de2 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:40.433899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8f345cf8-a426-43a4-a5bb-ed680f395d77 req-861297a6-2b4a-4630-b628-f95c992e2de2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:40.434554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8f345cf8-a426-43a4-a5bb-ed680f395d77 req-861297a6-2b4a-4630-b628-f95c992e2de2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:40.448998 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-8f345cf8-a426-43a4-a5bb-ed680f395d77 req-861297a6-2b4a-4630-b628-f95c992e2de2 service nova] Creating event network-changed:5e2a4156-9ab3-4cfe-8382-216d561b2b35 for instance 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba on n-h1-860864-2 Oct 11 00:08:40.454559 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-8f345cf8-a426-43a4-a5bb-ed680f395d77 req-861297a6-2b4a-4630-b628-f95c992e2de2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036366 Oct 11 00:08:40.455409 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3546/6809] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:08:41.447282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-66b48ede-6bc8-4fec-907b-bf466381834c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:41.448092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-66b48ede-6bc8-4fec-907b-bf466381834c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:41.456550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66b48ede-6bc8-4fec-907b-bf466381834c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:41.457068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66b48ede-6bc8-4fec-907b-bf466381834c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:41.457781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66b48ede-6bc8-4fec-907b-bf466381834c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:41.458678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66b48ede-6bc8-4fec-907b-bf466381834c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:41.459165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66b48ede-6bc8-4fec-907b-bf466381834c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:41.459875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66b48ede-6bc8-4fec-907b-bf466381834c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:41.604102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-66b48ede-6bc8-4fec-907b-bf466381834c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:41.612297 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-66b48ede-6bc8-4fec-907b-bf466381834c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1266 microversion: 2.1 time: 0.169733 Oct 11 00:08:41.612897 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3547/6810] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:41 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:42.636019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cdbcdcf4-4278-4774-9733-a60c1cfe017d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:42.636664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cdbcdcf4-4278-4774-9733-a60c1cfe017d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:42.638682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:08:42.639597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:08:42.647666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdbcdcf4-4278-4774-9733-a60c1cfe017d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:42.648187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdbcdcf4-4278-4774-9733-a60c1cfe017d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:42.648660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdbcdcf4-4278-4774-9733-a60c1cfe017d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:42.649699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdbcdcf4-4278-4774-9733-a60c1cfe017d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:42.650291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdbcdcf4-4278-4774-9733-a60c1cfe017d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:42.650750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cdbcdcf4-4278-4774-9733-a60c1cfe017d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:42.806330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cdbcdcf4-4278-4774-9733-a60c1cfe017d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:42.817035 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cdbcdcf4-4278-4774-9733-a60c1cfe017d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1266 microversion: 2.1 time: 0.184350 Oct 11 00:08:42.817413 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3548/6811] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:42 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:42.822874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-726f7117-d746-4895-9347-6aeab7041006 req-a5147fb9-feac-4b18-98e6-db6e2cea2a7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23b5c773-d7cc-495d-97ed-ddbbf0ca8dba", "tag": "5e2a4156-9ab3-4cfe-8382-216d561b2b35"}, {"name": "network-changed", "server_uuid": "23b5c773-d7cc-495d-97ed-ddbbf0ca8dba", "tag": "5e2a4156-9ab3-4cfe-8382-216d561b2b35"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:08:42.833479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-726f7117-d746-4895-9347-6aeab7041006 req-a5147fb9-feac-4b18-98e6-db6e2cea2a7e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:42.833823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-726f7117-d746-4895-9347-6aeab7041006 req-a5147fb9-feac-4b18-98e6-db6e2cea2a7e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:42.834281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-726f7117-d746-4895-9347-6aeab7041006 req-a5147fb9-feac-4b18-98e6-db6e2cea2a7e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:42.846906 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-726f7117-d746-4895-9347-6aeab7041006 req-a5147fb9-feac-4b18-98e6-db6e2cea2a7e service nova] Creating event network-changed:5e2a4156-9ab3-4cfe-8382-216d561b2b35 for instance 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba on n-h1-860864-2 Oct 11 00:08:42.847843 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-726f7117-d746-4895-9347-6aeab7041006 req-a5147fb9-feac-4b18-98e6-db6e2cea2a7e service nova] Creating event network-changed:5e2a4156-9ab3-4cfe-8382-216d561b2b35 for instance 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba on n-h1-860864-2 Oct 11 00:08:42.853990 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-726f7117-d746-4895-9347-6aeab7041006 req-a5147fb9-feac-4b18-98e6-db6e2cea2a7e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035265 Oct 11 00:08:42.854788 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3549/6812] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:08:43.859310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-191f09c6-558d-43bc-aeae-bdf10354d045 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:43.860059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-191f09c6-558d-43bc-aeae-bdf10354d045 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:43.866476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-191f09c6-558d-43bc-aeae-bdf10354d045 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:43.867081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-191f09c6-558d-43bc-aeae-bdf10354d045 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:43.868148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-191f09c6-558d-43bc-aeae-bdf10354d045 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:43.868914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-191f09c6-558d-43bc-aeae-bdf10354d045 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:43.869420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-191f09c6-558d-43bc-aeae-bdf10354d045 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:43.869878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-191f09c6-558d-43bc-aeae-bdf10354d045 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:44.005302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-191f09c6-558d-43bc-aeae-bdf10354d045 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:44.014833 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-191f09c6-558d-43bc-aeae-bdf10354d045 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1266 microversion: 2.1 time: 0.166463 Oct 11 00:08:44.015241 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3550/6813] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:43 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:08:45.037710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8b1e9a26-6c26-4777-99b1-72c619cbaf6e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:45.038342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8b1e9a26-6c26-4777-99b1-72c619cbaf6e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:45.045690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b1e9a26-6c26-4777-99b1-72c619cbaf6e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:45.046203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b1e9a26-6c26-4777-99b1-72c619cbaf6e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:45.046667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b1e9a26-6c26-4777-99b1-72c619cbaf6e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:45.047425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b1e9a26-6c26-4777-99b1-72c619cbaf6e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:45.047919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b1e9a26-6c26-4777-99b1-72c619cbaf6e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:45.052207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b1e9a26-6c26-4777-99b1-72c619cbaf6e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:45.186057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8b1e9a26-6c26-4777-99b1-72c619cbaf6e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:45.194107 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8b1e9a26-6c26-4777-99b1-72c619cbaf6e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1266 microversion: 2.1 time: 0.160336 Oct 11 00:08:45.194696 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3551/6814] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:45 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:46.219231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-af111c15-d730-4433-97ee-ec5aafcead09 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:46.219866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-af111c15-d730-4433-97ee-ec5aafcead09 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:46.227754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af111c15-d730-4433-97ee-ec5aafcead09 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:46.228237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af111c15-d730-4433-97ee-ec5aafcead09 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:46.228686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af111c15-d730-4433-97ee-ec5aafcead09 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:46.229443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af111c15-d730-4433-97ee-ec5aafcead09 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:46.229912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af111c15-d730-4433-97ee-ec5aafcead09 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:46.230354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-af111c15-d730-4433-97ee-ec5aafcead09 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:46.364135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-af111c15-d730-4433-97ee-ec5aafcead09 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:46.372334 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-af111c15-d730-4433-97ee-ec5aafcead09 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1266 microversion: 2.1 time: 0.157501 Oct 11 00:08:46.372935 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3552/6815] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:46 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:47.395231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-29489504-34af-4d84-92e7-59b173db6424 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:47.395862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-29489504-34af-4d84-92e7-59b173db6424 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:47.403887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29489504-34af-4d84-92e7-59b173db6424 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:47.404416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29489504-34af-4d84-92e7-59b173db6424 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:47.404890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29489504-34af-4d84-92e7-59b173db6424 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:47.405637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29489504-34af-4d84-92e7-59b173db6424 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:47.406148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29489504-34af-4d84-92e7-59b173db6424 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:47.406590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29489504-34af-4d84-92e7-59b173db6424 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:47.540361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-29489504-34af-4d84-92e7-59b173db6424 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:47.549616 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-29489504-34af-4d84-92e7-59b173db6424 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1266 microversion: 2.1 time: 0.158228 Oct 11 00:08:47.550208 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3553/6816] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:47 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:48.118757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-36519ff4-4de6-42cd-9b01-45548d696e6e req-8eba9286-b07b-48ad-ad97-5e9c810c6dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef051080-50b9-4445-a058-99cfd21e5096", "name": "network-vif-plugged", "status": "completed", "tag": "79c436d2-8fad-4829-a3dc-a431feb4ba9e"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:08:48.128872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-36519ff4-4de6-42cd-9b01-45548d696e6e req-8eba9286-b07b-48ad-ad97-5e9c810c6dfa service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:48.129421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-36519ff4-4de6-42cd-9b01-45548d696e6e req-8eba9286-b07b-48ad-ad97-5e9c810c6dfa service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:48.129841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-36519ff4-4de6-42cd-9b01-45548d696e6e req-8eba9286-b07b-48ad-ad97-5e9c810c6dfa service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:48.143157 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-36519ff4-4de6-42cd-9b01-45548d696e6e req-8eba9286-b07b-48ad-ad97-5e9c810c6dfa service nova] Creating event network-vif-plugged:79c436d2-8fad-4829-a3dc-a431feb4ba9e for instance ef051080-50b9-4445-a058-99cfd21e5096 on n-h2-860864-2 Oct 11 00:08:48.149982 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-36519ff4-4de6-42cd-9b01-45548d696e6e req-8eba9286-b07b-48ad-ad97-5e9c810c6dfa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034706 Oct 11 00:08:48.151014 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3554/6817] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:08:48.573912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3315de38-fffe-4115-9304-41c9bdc56349 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:48.574604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3315de38-fffe-4115-9304-41c9bdc56349 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:48.582674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3315de38-fffe-4115-9304-41c9bdc56349 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:48.583425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3315de38-fffe-4115-9304-41c9bdc56349 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:48.583923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3315de38-fffe-4115-9304-41c9bdc56349 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:48.584841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3315de38-fffe-4115-9304-41c9bdc56349 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:48.585367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3315de38-fffe-4115-9304-41c9bdc56349 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:48.585859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3315de38-fffe-4115-9304-41c9bdc56349 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:48.741312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3315de38-fffe-4115-9304-41c9bdc56349 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:48.751173 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3315de38-fffe-4115-9304-41c9bdc56349 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1266 microversion: 2.1 time: 0.182438 Oct 11 00:08:48.751762 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3555/6818] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:48 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:08:49.775576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3594e982-df1d-471a-a6e1-95ae4604aacc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:49.776240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3594e982-df1d-471a-a6e1-95ae4604aacc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:49.783424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3594e982-df1d-471a-a6e1-95ae4604aacc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:49.783932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3594e982-df1d-471a-a6e1-95ae4604aacc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:49.784391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3594e982-df1d-471a-a6e1-95ae4604aacc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:49.785144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3594e982-df1d-471a-a6e1-95ae4604aacc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:49.785645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3594e982-df1d-471a-a6e1-95ae4604aacc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:49.786107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3594e982-df1d-471a-a6e1-95ae4604aacc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:49.801902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:08:49.920545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3594e982-df1d-471a-a6e1-95ae4604aacc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:49.928350 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3594e982-df1d-471a-a6e1-95ae4604aacc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1453 microversion: 2.1 time: 0.156882 Oct 11 00:08:49.928920 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3556/6819] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:49 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:49.950639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5659cfdb-9055-4a02-aed8-c8d9ccea8c31 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:08:49.951286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5659cfdb-9055-4a02-aed8-c8d9ccea8c31 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:08:49.957114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5659cfdb-9055-4a02-aed8-c8d9ccea8c31 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:49.957655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5659cfdb-9055-4a02-aed8-c8d9ccea8c31 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:49.958108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5659cfdb-9055-4a02-aed8-c8d9ccea8c31 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:49.958811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5659cfdb-9055-4a02-aed8-c8d9ccea8c31 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:49.959284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5659cfdb-9055-4a02-aed8-c8d9ccea8c31 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:49.959729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5659cfdb-9055-4a02-aed8-c8d9ccea8c31 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:50.095102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5659cfdb-9055-4a02-aed8-c8d9ccea8c31 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:08:50.103330 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5659cfdb-9055-4a02-aed8-c8d9ccea8c31 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1453 microversion: 2.1 time: 0.156460 Oct 11 00:08:50.103906 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3557/6820] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:08:49 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:08:52.101550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-157a7432-3dc2-48c4-b098-6586d79c73d2 req-792b8ac5-03c6-4db4-ae53-d2738bca97a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef051080-50b9-4445-a058-99cfd21e5096", "tag": "79c436d2-8fad-4829-a3dc-a431feb4ba9e"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:08:52.111587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-157a7432-3dc2-48c4-b098-6586d79c73d2 req-792b8ac5-03c6-4db4-ae53-d2738bca97a0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:08:52.112091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-157a7432-3dc2-48c4-b098-6586d79c73d2 req-792b8ac5-03c6-4db4-ae53-d2738bca97a0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:08:52.112608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-157a7432-3dc2-48c4-b098-6586d79c73d2 req-792b8ac5-03c6-4db4-ae53-d2738bca97a0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:08:52.124655 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-157a7432-3dc2-48c4-b098-6586d79c73d2 req-792b8ac5-03c6-4db4-ae53-d2738bca97a0 service nova] Creating event network-changed:79c436d2-8fad-4829-a3dc-a431feb4ba9e for instance ef051080-50b9-4445-a058-99cfd21e5096 on n-h2-860864-2 Oct 11 00:08:52.129779 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-157a7432-3dc2-48c4-b098-6586d79c73d2 req-792b8ac5-03c6-4db4-ae53-d2738bca97a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100841 Oct 11 00:08:52.130388 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3558/6821] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:09:11.317006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:09:11.317788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=11 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:09:11.330815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-02d8ef13-bdaf-4089-bc4b-351dcfa08427 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:09:11.331456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-02d8ef13-bdaf-4089-bc4b-351dcfa08427 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:09:11.346643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02d8ef13-bdaf-4089-bc4b-351dcfa08427 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:09:11.347262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02d8ef13-bdaf-4089-bc4b-351dcfa08427 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:09:11.347993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02d8ef13-bdaf-4089-bc4b-351dcfa08427 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:09:11.349081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02d8ef13-bdaf-4089-bc4b-351dcfa08427 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:09:11.349746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02d8ef13-bdaf-4089-bc4b-351dcfa08427 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:09:11.350239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-02d8ef13-bdaf-4089-bc4b-351dcfa08427 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:09:11.380883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-02d8ef13-bdaf-4089-bc4b-351dcfa08427 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:09:11.472826 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-02d8ef13-bdaf-4089-bc4b-351dcfa08427 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "DELETE /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 204 len: 0 microversion: 2.1 time: 0.157667 Oct 11 00:09:11.473534 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3559/6822] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:09:11 2022] DELETE /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 00:09:11.480689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-118998e1-abb3-4289-a2a3-0c3cd4502234 req-8834a704-5e64-4a1a-98ea-fc8d3acb95c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23b5c773-d7cc-495d-97ed-ddbbf0ca8dba", "tag": "5e2a4156-9ab3-4cfe-8382-216d561b2b35"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:09:11.492459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-118998e1-abb3-4289-a2a3-0c3cd4502234 req-8834a704-5e64-4a1a-98ea-fc8d3acb95c6 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:09:11.492990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-118998e1-abb3-4289-a2a3-0c3cd4502234 req-8834a704-5e64-4a1a-98ea-fc8d3acb95c6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:09:11.493464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-118998e1-abb3-4289-a2a3-0c3cd4502234 req-8834a704-5e64-4a1a-98ea-fc8d3acb95c6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:09:11.506820 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-118998e1-abb3-4289-a2a3-0c3cd4502234 req-8834a704-5e64-4a1a-98ea-fc8d3acb95c6 service nova] Creating event network-changed:5e2a4156-9ab3-4cfe-8382-216d561b2b35 for instance 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba on n-h1-860864-2 Oct 11 00:09:11.513300 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-118998e1-abb3-4289-a2a3-0c3cd4502234 req-8834a704-5e64-4a1a-98ea-fc8d3acb95c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038372 Oct 11 00:09:11.514153 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3560/6823] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:09:11.518948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bff6df3f-3e52-4876-9398-e9db0bb35cd4 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:09:11.519663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bff6df3f-3e52-4876-9398-e9db0bb35cd4 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:09:11.525861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bff6df3f-3e52-4876-9398-e9db0bb35cd4 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:09:11.526352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bff6df3f-3e52-4876-9398-e9db0bb35cd4 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:09:11.527098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bff6df3f-3e52-4876-9398-e9db0bb35cd4 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:09:11.527741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bff6df3f-3e52-4876-9398-e9db0bb35cd4 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:09:11.528283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bff6df3f-3e52-4876-9398-e9db0bb35cd4 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:09:11.528918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bff6df3f-3e52-4876-9398-e9db0bb35cd4 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:09:11.681114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bff6df3f-3e52-4876-9398-e9db0bb35cd4 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:09:11.696197 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bff6df3f-3e52-4876-9398-e9db0bb35cd4 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1580 microversion: 2.1 time: 0.180698 Oct 11 00:09:11.703095 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3561/6824] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:09:11 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1580 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:09:12.725144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-796958be-66ea-45f3-b0dc-7d47799b5a93 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:09:12.725833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-796958be-66ea-45f3-b0dc-7d47799b5a93 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:09:12.733298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-796958be-66ea-45f3-b0dc-7d47799b5a93 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:09:12.733834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-796958be-66ea-45f3-b0dc-7d47799b5a93 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:09:12.734294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-796958be-66ea-45f3-b0dc-7d47799b5a93 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:09:12.735015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-796958be-66ea-45f3-b0dc-7d47799b5a93 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:09:12.735490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-796958be-66ea-45f3-b0dc-7d47799b5a93 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:09:12.735941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-796958be-66ea-45f3-b0dc-7d47799b5a93 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:09:12.881521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-796958be-66ea-45f3-b0dc-7d47799b5a93 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:09:12.889638 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-796958be-66ea-45f3-b0dc-7d47799b5a93 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1580 microversion: 2.1 time: 0.168673 Oct 11 00:09:12.890214 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3562/6825] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:09:12 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1580 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:09:13.883477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-bc65cafe-8274-479f-8e87-7329b3a73d3a req-ab716a31-29e5-499b-ba37-fdd5cbf25c70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23b5c773-d7cc-495d-97ed-ddbbf0ca8dba", "name": "network-vif-deleted", "tag": "5e2a4156-9ab3-4cfe-8382-216d561b2b35"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:09:13.898227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-bc65cafe-8274-479f-8e87-7329b3a73d3a req-ab716a31-29e5-499b-ba37-fdd5cbf25c70 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:09:13.898960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-bc65cafe-8274-479f-8e87-7329b3a73d3a req-ab716a31-29e5-499b-ba37-fdd5cbf25c70 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:09:13.899410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-bc65cafe-8274-479f-8e87-7329b3a73d3a req-ab716a31-29e5-499b-ba37-fdd5cbf25c70 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:09:13.914761 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-bc65cafe-8274-479f-8e87-7329b3a73d3a req-ab716a31-29e5-499b-ba37-fdd5cbf25c70 service nova] Creating event network-vif-deleted:5e2a4156-9ab3-4cfe-8382-216d561b2b35 for instance 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba on n-h1-860864-2 Oct 11 00:09:13.921181 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-bc65cafe-8274-479f-8e87-7329b3a73d3a req-ab716a31-29e5-499b-ba37-fdd5cbf25c70 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042186 Oct 11 00:09:13.922063 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3563/6826] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:09:13.927407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a544e2b6-5252-4b44-8bb0-ae4815487f4b tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:09:13.928177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a544e2b6-5252-4b44-8bb0-ae4815487f4b tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:09:13.935337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a544e2b6-5252-4b44-8bb0-ae4815487f4b tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:09:13.936130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a544e2b6-5252-4b44-8bb0-ae4815487f4b tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:09:13.936605 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a544e2b6-5252-4b44-8bb0-ae4815487f4b tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:09:13.937346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a544e2b6-5252-4b44-8bb0-ae4815487f4b tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:09:13.937863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a544e2b6-5252-4b44-8bb0-ae4815487f4b tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:09:13.938413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a544e2b6-5252-4b44-8bb0-ae4815487f4b tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:09:14.003877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a544e2b6-5252-4b44-8bb0-ae4815487f4b tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:09:14.012327 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a544e2b6-5252-4b44-8bb0-ae4815487f4b tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1228 microversion: 2.1 time: 0.089046 Oct 11 00:09:14.013084 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3564/6827] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:09:13 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1228 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:09:15.036490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f2436159-7869-4cb5-a0b6-54178fba4119 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:09:15.037133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f2436159-7869-4cb5-a0b6-54178fba4119 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:09:15.044591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2436159-7869-4cb5-a0b6-54178fba4119 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:09:15.045097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2436159-7869-4cb5-a0b6-54178fba4119 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:09:15.045619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2436159-7869-4cb5-a0b6-54178fba4119 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:09:15.046342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2436159-7869-4cb5-a0b6-54178fba4119 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:09:15.046813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2436159-7869-4cb5-a0b6-54178fba4119 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:09:15.047261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f2436159-7869-4cb5-a0b6-54178fba4119 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:09:15.112549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f2436159-7869-4cb5-a0b6-54178fba4119 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:09:15.121397 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f2436159-7869-4cb5-a0b6-54178fba4119 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1228 microversion: 2.1 time: 0.088882 Oct 11 00:09:15.122001 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3565/6828] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:09:15 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1228 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:09:16.147143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-79278431-a66f-4c47-9ffa-7ae836414b59 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:09:16.148311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-79278431-a66f-4c47-9ffa-7ae836414b59 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:09:16.156319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79278431-a66f-4c47-9ffa-7ae836414b59 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:09:16.156833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79278431-a66f-4c47-9ffa-7ae836414b59 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:09:16.157292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79278431-a66f-4c47-9ffa-7ae836414b59 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:09:16.158098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79278431-a66f-4c47-9ffa-7ae836414b59 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:09:16.158575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79278431-a66f-4c47-9ffa-7ae836414b59 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:09:16.159025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79278431-a66f-4c47-9ffa-7ae836414b59 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:09:16.236632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-79278431-a66f-4c47-9ffa-7ae836414b59 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:09:16.245945 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-79278431-a66f-4c47-9ffa-7ae836414b59 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1228 microversion: 2.1 time: 0.102741 Oct 11 00:09:16.246641 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3566/6829] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:09:16 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1228 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:09:17.270037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6ae4363e-abf2-4872-ad62-1968a2b47843 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:09:17.270704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6ae4363e-abf2-4872-ad62-1968a2b47843 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:09:17.278149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ae4363e-abf2-4872-ad62-1968a2b47843 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:09:17.278655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ae4363e-abf2-4872-ad62-1968a2b47843 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:09:17.279102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ae4363e-abf2-4872-ad62-1968a2b47843 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:09:17.279831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ae4363e-abf2-4872-ad62-1968a2b47843 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:09:17.280298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ae4363e-abf2-4872-ad62-1968a2b47843 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:09:17.280743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ae4363e-abf2-4872-ad62-1968a2b47843 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:09:17.348532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6ae4363e-abf2-4872-ad62-1968a2b47843 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:09:17.357924 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6ae4363e-abf2-4872-ad62-1968a2b47843 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1228 microversion: 2.1 time: 0.091710 Oct 11 00:09:17.358518 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3567/6830] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:09:17 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1228 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:09:18.382486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e58e94dc-647d-42eb-8480-9be0d625ec44 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:09:18.383088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e58e94dc-647d-42eb-8480-9be0d625ec44 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:09:18.391614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e58e94dc-647d-42eb-8480-9be0d625ec44 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:09:18.392351 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e58e94dc-647d-42eb-8480-9be0d625ec44 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:09:18.393076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e58e94dc-647d-42eb-8480-9be0d625ec44 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:09:18.394104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e58e94dc-647d-42eb-8480-9be0d625ec44 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:09:18.394827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e58e94dc-647d-42eb-8480-9be0d625ec44 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:09:18.395403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e58e94dc-647d-42eb-8480-9be0d625ec44 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:09:18.437931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e58e94dc-647d-42eb-8480-9be0d625ec44 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:09:18.438508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e58e94dc-647d-42eb-8480-9be0d625ec44 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:09:18.439215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e58e94dc-647d-42eb-8480-9be0d625ec44 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:09:18.439701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-e58e94dc-647d-42eb-8480-9be0d625ec44 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lazy-loading 'fault' on Instance uuid 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:09:18.485112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e58e94dc-647d-42eb-8480-9be0d625ec44 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c9644f1b8343909aad2dc421119071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '694831e8468045868e607aa38a8c5285', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:09:18.495906 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e58e94dc-647d-42eb-8480-9be0d625ec44 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 200 len: 1233 microversion: 2.1 time: 0.117595 Oct 11 00:09:18.497302 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3568/6831] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:09:18 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 1233 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:09:19.520744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-80abfb17-a337-4994-9d0d-55abc18ad946 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:09:19.521437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-80abfb17-a337-4994-9d0d-55abc18ad946 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] [instance: 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:09:19.529613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80abfb17-a337-4994-9d0d-55abc18ad946 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:09:19.530157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80abfb17-a337-4994-9d0d-55abc18ad946 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:09:19.530793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80abfb17-a337-4994-9d0d-55abc18ad946 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:09:19.531549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80abfb17-a337-4994-9d0d-55abc18ad946 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:09:19.532276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80abfb17-a337-4994-9d0d-55abc18ad946 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:09:19.532769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-80abfb17-a337-4994-9d0d-55abc18ad946 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:09:19.560095 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-80abfb17-a337-4994-9d0d-55abc18ad946 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] HTTP exception thrown: Instance 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba could not be found. Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-80abfb17-a337-4994-9d0d-55abc18ad946 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Request method failure captured: Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba HTTP/1.1 Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLNn0m-4JzRhjdyUJWACa0aDihuLxAeA2a2nuGnWS0OtSIcqGwHIbJJPOEQoXmAyY3oBbZ0GSIb1INxIwzWEFKWqpnx-bLnI6nKCtuYqeRVETTcVP775uvOEeF4b3gCDZi5PcuIq7G7cQ9WZymp9vpCUdvqzPDGhwfjKPJ6l8E8MSI4 Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 694831e8468045868e607aa38a8c5285 Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestVolumeBackupRestore-385561684 Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/694831e8468045868e607aa38a8c5285"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/694831e8468045868e607aa38a8c5285"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/694831e8468045868e607aa38a8c5285"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_694831e8468045868e607aa38a8c5285", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestVolumeBackupRestore-385561684 Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 694831e8468045868e607aa38a8c5285 Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestVolumeBackupRestore-385561684 Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestVolumeBackupRestore-385561684-project Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 95c9644f1b8343909aad2dc421119071 Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestVolumeBackupRestore-385561684-project Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba could not be found. Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '23b5c773-d7cc-495d-97ed-ddbbf0ca8dba'} Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba could not be found. Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba could not be found. Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:09:19.562477 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:09:19.566390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:09:19.566390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:09:19.566390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:09:19.566390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:09:19.566390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:09:19.566390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba could not be found. Oct 11 00:09:19.566390 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:09:19.566390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-80abfb17-a337-4994-9d0d-55abc18ad946 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Returning 404 to user: Instance 23b5c773-d7cc-495d-97ed-ddbbf0ca8dba could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:09:19.566390 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-80abfb17-a337-4994-9d0d-55abc18ad946 tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba" status: 404 len: 111 microversion: 2.1 time: 0.048117 Oct 11 00:09:19.566390 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3569/6832] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:09:19 2022] GET /compute/v2.1/servers/23b5c773-d7cc-495d-97ed-ddbbf0ca8dba => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 00:09:19.738235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-56b89d0f-af27-4b11-b459-44f10238b8fb tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] Calling method '.version_select at 0x7f662aff5af0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:09:19.770893 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-56b89d0f-af27-4b11-b459-44f10238b8fb tempest-TestVolumeBackupRestore-385561684 tempest-TestVolumeBackupRestore-385561684-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-429737726" status: 202 len: 0 microversion: 2.1 time: 0.036881 Oct 11 00:09:19.772012 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3570/6833] 10.222.0.23 () {58 vars in 1266 bytes} [Tue Oct 11 00:09:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-429737726 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 00:09:19.825132 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:09:19.825722 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:09:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 11 00:09:19.840471 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:09:19.840471 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:09:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 11 00:10:50.558455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:10:50.559216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:10:50.560581 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 11 00:10:50.737009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a30f2d9a-2b67-4d73-bec7-043a2e86e20b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:10:50.737584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a30f2d9a-2b67-4d73-bec7-043a2e86e20b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:10:50.744786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a30f2d9a-2b67-4d73-bec7-043a2e86e20b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:10:50.745297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a30f2d9a-2b67-4d73-bec7-043a2e86e20b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:10:50.745807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a30f2d9a-2b67-4d73-bec7-043a2e86e20b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:10:50.746530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a30f2d9a-2b67-4d73-bec7-043a2e86e20b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:10:50.747030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a30f2d9a-2b67-4d73-bec7-043a2e86e20b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:10:50.747481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a30f2d9a-2b67-4d73-bec7-043a2e86e20b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:10:50.775185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a30f2d9a-2b67-4d73-bec7-043a2e86e20b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:10:50.855062 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a30f2d9a-2b67-4d73-bec7-043a2e86e20b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 204 len: 0 microversion: 2.1 time: 0.299402 Oct 11 00:10:50.855667 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3571/6834] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:10:50 2022] DELETE /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 00:10:50.864936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0f957929-f98b-4372-88ce-66e734b34298 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:10:50.865751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0f957929-f98b-4372-88ce-66e734b34298 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:10:50.872302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f957929-f98b-4372-88ce-66e734b34298 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:10:50.872851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f957929-f98b-4372-88ce-66e734b34298 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:10:50.873284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f957929-f98b-4372-88ce-66e734b34298 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:10:50.874083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f957929-f98b-4372-88ce-66e734b34298 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:10:50.874559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f957929-f98b-4372-88ce-66e734b34298 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:10:50.875008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f957929-f98b-4372-88ce-66e734b34298 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:10:51.017233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0f957929-f98b-4372-88ce-66e734b34298 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:10:51.026313 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0f957929-f98b-4372-88ce-66e734b34298 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1577 microversion: 2.1 time: 0.165997 Oct 11 00:10:51.026821 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3572/6835] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:10:50 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:10:52.051611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d8947aa8-7aff-45a9-938a-404d9c7ff87c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:10:52.052601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d8947aa8-7aff-45a9-938a-404d9c7ff87c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:10:52.059918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8947aa8-7aff-45a9-938a-404d9c7ff87c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:10:52.060433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8947aa8-7aff-45a9-938a-404d9c7ff87c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:10:52.060895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8947aa8-7aff-45a9-938a-404d9c7ff87c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:10:52.061641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8947aa8-7aff-45a9-938a-404d9c7ff87c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:10:52.062120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8947aa8-7aff-45a9-938a-404d9c7ff87c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:10:52.062577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8947aa8-7aff-45a9-938a-404d9c7ff87c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:10:52.196710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d8947aa8-7aff-45a9-938a-404d9c7ff87c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:10:52.205979 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d8947aa8-7aff-45a9-938a-404d9c7ff87c tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1577 microversion: 2.1 time: 0.158984 Oct 11 00:10:52.207272 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3573/6836] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:10:52 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:10:53.232318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-67837f36-7257-4bfb-8d9a-4ff1282f5946 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:10:53.233164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-67837f36-7257-4bfb-8d9a-4ff1282f5946 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:10:53.241092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67837f36-7257-4bfb-8d9a-4ff1282f5946 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:10:53.241644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67837f36-7257-4bfb-8d9a-4ff1282f5946 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:10:53.242099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67837f36-7257-4bfb-8d9a-4ff1282f5946 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:10:53.242827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67837f36-7257-4bfb-8d9a-4ff1282f5946 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:10:53.243296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67837f36-7257-4bfb-8d9a-4ff1282f5946 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:10:53.243738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67837f36-7257-4bfb-8d9a-4ff1282f5946 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:10:53.312959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-67837f36-7257-4bfb-8d9a-4ff1282f5946 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:10:53.322660 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-67837f36-7257-4bfb-8d9a-4ff1282f5946 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1510 microversion: 2.1 time: 0.094290 Oct 11 00:10:53.323184 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3574/6837] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:10:53 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1510 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:10:53.570483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-1163f626-8b97-4737-a8be-2bd9239ca0d6 req-91165fbe-9cd5-4c7b-991e-a3b5af57456f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef051080-50b9-4445-a058-99cfd21e5096", "name": "network-vif-deleted", "tag": "79c436d2-8fad-4829-a3dc-a431feb4ba9e"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:10:53.583368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1163f626-8b97-4737-a8be-2bd9239ca0d6 req-91165fbe-9cd5-4c7b-991e-a3b5af57456f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:10:53.584208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1163f626-8b97-4737-a8be-2bd9239ca0d6 req-91165fbe-9cd5-4c7b-991e-a3b5af57456f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:10:53.584827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1163f626-8b97-4737-a8be-2bd9239ca0d6 req-91165fbe-9cd5-4c7b-991e-a3b5af57456f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:10:53.599828 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-1163f626-8b97-4737-a8be-2bd9239ca0d6 req-91165fbe-9cd5-4c7b-991e-a3b5af57456f service nova] Creating event network-vif-deleted:79c436d2-8fad-4829-a3dc-a431feb4ba9e for instance ef051080-50b9-4445-a058-99cfd21e5096 on n-h2-860864-2 Oct 11 00:10:53.605769 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-1163f626-8b97-4737-a8be-2bd9239ca0d6 req-91165fbe-9cd5-4c7b-991e-a3b5af57456f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129078 Oct 11 00:10:53.610512 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3575/6838] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:10:54.352325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5684a462-800e-477a-8f0f-a014655b1ffd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:10:54.353056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5684a462-800e-477a-8f0f-a014655b1ffd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:10:54.360397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5684a462-800e-477a-8f0f-a014655b1ffd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:10:54.361188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5684a462-800e-477a-8f0f-a014655b1ffd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:10:54.361677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5684a462-800e-477a-8f0f-a014655b1ffd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:10:54.362563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5684a462-800e-477a-8f0f-a014655b1ffd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:10:54.363699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5684a462-800e-477a-8f0f-a014655b1ffd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:10:54.364189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5684a462-800e-477a-8f0f-a014655b1ffd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:10:54.443078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5684a462-800e-477a-8f0f-a014655b1ffd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:10:54.451631 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5684a462-800e-477a-8f0f-a014655b1ffd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1226 microversion: 2.1 time: 0.105287 Oct 11 00:10:54.452129 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3576/6839] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:10:54 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:10:55.474313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0a4221f9-ffdf-4992-bcc9-79825223f6c4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:10:55.474960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0a4221f9-ffdf-4992-bcc9-79825223f6c4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:10:55.482443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a4221f9-ffdf-4992-bcc9-79825223f6c4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:10:55.482958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a4221f9-ffdf-4992-bcc9-79825223f6c4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:10:55.483411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a4221f9-ffdf-4992-bcc9-79825223f6c4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:10:55.484142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a4221f9-ffdf-4992-bcc9-79825223f6c4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:10:55.484622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a4221f9-ffdf-4992-bcc9-79825223f6c4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:10:55.485070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a4221f9-ffdf-4992-bcc9-79825223f6c4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:10:55.549359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0a4221f9-ffdf-4992-bcc9-79825223f6c4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:10:55.558266 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0a4221f9-ffdf-4992-bcc9-79825223f6c4 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1226 microversion: 2.1 time: 0.087986 Oct 11 00:10:55.558881 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3577/6840] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:10:55 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:10:56.581478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-65de3504-10f8-4ef9-994f-8fa5c10c5f40 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:10:56.582224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-65de3504-10f8-4ef9-994f-8fa5c10c5f40 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:10:56.589244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65de3504-10f8-4ef9-994f-8fa5c10c5f40 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:10:56.589791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65de3504-10f8-4ef9-994f-8fa5c10c5f40 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:10:56.590251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65de3504-10f8-4ef9-994f-8fa5c10c5f40 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:10:56.590985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65de3504-10f8-4ef9-994f-8fa5c10c5f40 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:10:56.591463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65de3504-10f8-4ef9-994f-8fa5c10c5f40 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:10:56.591917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65de3504-10f8-4ef9-994f-8fa5c10c5f40 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:10:56.661197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-65de3504-10f8-4ef9-994f-8fa5c10c5f40 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:10:56.669219 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-65de3504-10f8-4ef9-994f-8fa5c10c5f40 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1226 microversion: 2.1 time: 0.091966 Oct 11 00:10:56.669840 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3578/6841] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:10:56 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:10:57.694013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c901b521-a45a-4d87-bd50-44ec19565256 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:10:57.694661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c901b521-a45a-4d87-bd50-44ec19565256 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:10:57.701593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c901b521-a45a-4d87-bd50-44ec19565256 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:10:57.702107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c901b521-a45a-4d87-bd50-44ec19565256 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:10:57.702564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c901b521-a45a-4d87-bd50-44ec19565256 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:10:57.703287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c901b521-a45a-4d87-bd50-44ec19565256 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:10:57.703760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c901b521-a45a-4d87-bd50-44ec19565256 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:10:57.704208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c901b521-a45a-4d87-bd50-44ec19565256 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:10:57.742921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c901b521-a45a-4d87-bd50-44ec19565256 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:10:57.743468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c901b521-a45a-4d87-bd50-44ec19565256 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:10:57.743930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c901b521-a45a-4d87-bd50-44ec19565256 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:10:57.744988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-c901b521-a45a-4d87-bd50-44ec19565256 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lazy-loading 'fault' on Instance uuid ef051080-50b9-4445-a058-99cfd21e5096 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:10:57.790123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c901b521-a45a-4d87-bd50-44ec19565256 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:10:57.798301 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c901b521-a45a-4d87-bd50-44ec19565256 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 200 len: 1231 microversion: 2.1 time: 0.108623 Oct 11 00:10:57.799191 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3579/6842] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:10:57 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 1231 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:10:58.821862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-96e0a6b2-4b89-44eb-85f8-17a689ed1663 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:10:58.822501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-96e0a6b2-4b89-44eb-85f8-17a689ed1663 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:10:58.829624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96e0a6b2-4b89-44eb-85f8-17a689ed1663 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:10:58.830137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96e0a6b2-4b89-44eb-85f8-17a689ed1663 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:10:58.830595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96e0a6b2-4b89-44eb-85f8-17a689ed1663 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:10:58.831340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96e0a6b2-4b89-44eb-85f8-17a689ed1663 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:10:58.831818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96e0a6b2-4b89-44eb-85f8-17a689ed1663 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:10:58.832261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96e0a6b2-4b89-44eb-85f8-17a689ed1663 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:10:58.845918 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-96e0a6b2-4b89-44eb-85f8-17a689ed1663 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] HTTP exception thrown: Instance ef051080-50b9-4445-a058-99cfd21e5096 could not be found. Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-96e0a6b2-4b89-44eb-85f8-17a689ed1663 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Request method failure captured: Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 HTTP/1.1 Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLLstMFexBVKeRZfAj4OCdRv2YehxcaQe5WSbFwzJkUkY6SJnjfDm2dxiLn9eYpnR--tUOvl2KLmN3ree44KRlI2zh3Ld-tMuW3Hl-usm_NfJhejqaTW-3Rn2txi7roIax1gqv6lgH4fxV8-FpQFyIdTw_tVXsZtCYad971Mm27pxUg Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_be6e417773094ab08c170ca4b69f3742", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestVolumeBootPattern-451663755 Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a27b050389ad48089e214ad65eaa83bb Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance ef051080-50b9-4445-a058-99cfd21e5096 could not be found. Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'ef051080-50b9-4445-a058-99cfd21e5096'} Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef051080-50b9-4445-a058-99cfd21e5096 could not be found. Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef051080-50b9-4445-a058-99cfd21e5096 could not be found. Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:10:58.848128 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:10:58.852034 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:10:58.852034 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:10:58.852034 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:10:58.852034 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:10:58.852034 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:10:58.852034 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef051080-50b9-4445-a058-99cfd21e5096 could not be found. Oct 11 00:10:58.852034 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:10:58.852034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-96e0a6b2-4b89-44eb-85f8-17a689ed1663 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Returning 404 to user: Instance ef051080-50b9-4445-a058-99cfd21e5096 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:10:58.852034 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-96e0a6b2-4b89-44eb-85f8-17a689ed1663 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 404 len: 111 microversion: 2.1 time: 0.031775 Oct 11 00:10:58.852034 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3580/6843] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:10:58 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 00:10:58.898723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-79962d20-f583-4879-9c4f-e02dc9e7d31f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1607154147", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1344377026", "security_groups": [{"name": "tempest-secgroup-smoke-991778925"}], "block_device_mapping_v2": [{"uuid": "54c1bc63-0dfd-4658-839c-8447aa878cfa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6b4889cd-925d-4509-9797-a829b845f15b"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:10:59.015442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-79962d20-f583-4879-9c4f-e02dc9e7d31f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] validate_networks() for [('6b4889cd-925d-4509-9797-a829b845f15b', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:10:59.548363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-79962d20-f583-4879-9c4f-e02dc9e7d31f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:10:59.548835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-79962d20-f583-4879-9c4f-e02dc9e7d31f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:10:59.549329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-79962d20-f583-4879-9c4f-e02dc9e7d31f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:10:59.549907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-79962d20-f583-4879-9c4f-e02dc9e7d31f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:10:59.550491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-79962d20-f583-4879-9c4f-e02dc9e7d31f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:10:59.559758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79962d20-f583-4879-9c4f-e02dc9e7d31f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:10:59.560261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79962d20-f583-4879-9c4f-e02dc9e7d31f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:10:59.560720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79962d20-f583-4879-9c4f-e02dc9e7d31f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:10:59.561501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79962d20-f583-4879-9c4f-e02dc9e7d31f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:10:59.561978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79962d20-f583-4879-9c4f-e02dc9e7d31f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:10:59.562422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79962d20-f583-4879-9c4f-e02dc9e7d31f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:10:59.579865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-79962d20-f583-4879-9c4f-e02dc9e7d31f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Getting quotas for project be6e417773094ab08c170ca4b69f3742. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:10:59.586063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-79962d20-f583-4879-9c4f-e02dc9e7d31f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Getting quotas for user a27b050389ad48089e214ad65eaa83bb and project be6e417773094ab08c170ca4b69f3742. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:10:59.646364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-79962d20-f583-4879-9c4f-e02dc9e7d31f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:10:59.648650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-79962d20-f583-4879-9c4f-e02dc9e7d31f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='54c1bc63-0dfd-4658-839c-8447aa878cfa',volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:10:59.783519 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-79962d20-f583-4879-9c4f-e02dc9e7d31f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.888567 Oct 11 00:10:59.789483 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3581/6844] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:10:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 00:10:59.795360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4b400bf6-197e-4c91-9dc9-52fbdbbadfc8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:10:59.796001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4b400bf6-197e-4c91-9dc9-52fbdbbadfc8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:10:59.848469 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:10:59.848915 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:10:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 11 00:10:59.851710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4b400bf6-197e-4c91-9dc9-52fbdbbadfc8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:10:59.858952 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4b400bf6-197e-4c91-9dc9-52fbdbbadfc8 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1095 microversion: 2.1 time: 0.067451 Oct 11 00:10:59.859533 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3582/6845] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:10:59 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:11:00.882842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5394bd8d-b1bd-482e-8ca5-2f78bd57db5f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:11:00.883545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5394bd8d-b1bd-482e-8ca5-2f78bd57db5f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:11:00.940610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5394bd8d-b1bd-482e-8ca5-2f78bd57db5f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:11:00.947722 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5394bd8d-b1bd-482e-8ca5-2f78bd57db5f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1095 microversion: 2.1 time: 0.068922 Oct 11 00:11:00.948304 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3583/6846] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:11:00 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:11:01.975025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4309e5c1-b8eb-43cc-a1fd-f4d16a0eb997 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:11:01.976408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4309e5c1-b8eb-43cc-a1fd-f4d16a0eb997 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:11:02.030892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4309e5c1-b8eb-43cc-a1fd-f4d16a0eb997 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:11:02.039028 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4309e5c1-b8eb-43cc-a1fd-f4d16a0eb997 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1095 microversion: 2.1 time: 0.071116 Oct 11 00:11:02.039642 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3584/6847] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:11:01 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:11:03.064168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9291aa1f-7ab9-454e-b4be-fcc79a02b592 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:11:03.064857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9291aa1f-7ab9-454e-b4be-fcc79a02b592 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:11:03.127738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9291aa1f-7ab9-454e-b4be-fcc79a02b592 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:11:03.135403 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9291aa1f-7ab9-454e-b4be-fcc79a02b592 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1095 microversion: 2.1 time: 0.075122 Oct 11 00:11:03.135988 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3585/6848] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:11:03 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:11:04.159493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c2dd6b8e-c188-40f5-b25d-560034330717 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:11:04.160282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c2dd6b8e-c188-40f5-b25d-560034330717 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:11:04.168679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2dd6b8e-c188-40f5-b25d-560034330717 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:04.169679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2dd6b8e-c188-40f5-b25d-560034330717 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:04.170481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2dd6b8e-c188-40f5-b25d-560034330717 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:04.171748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2dd6b8e-c188-40f5-b25d-560034330717 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:04.172270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2dd6b8e-c188-40f5-b25d-560034330717 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:04.172786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2dd6b8e-c188-40f5-b25d-560034330717 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:04.256931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c2dd6b8e-c188-40f5-b25d-560034330717 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:11:04.267510 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c2dd6b8e-c188-40f5-b25d-560034330717 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1211 microversion: 2.1 time: 0.112906 Oct 11 00:11:04.281780 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3586/6849] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:11:04 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1211 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:11:05.291958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e7d47b49-6f5c-4608-8bbf-4bf1dea21852 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:11:05.292674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e7d47b49-6f5c-4608-8bbf-4bf1dea21852 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:11:05.299823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7d47b49-6f5c-4608-8bbf-4bf1dea21852 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:05.300948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7d47b49-6f5c-4608-8bbf-4bf1dea21852 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:05.301512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7d47b49-6f5c-4608-8bbf-4bf1dea21852 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:05.302319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7d47b49-6f5c-4608-8bbf-4bf1dea21852 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:05.302889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7d47b49-6f5c-4608-8bbf-4bf1dea21852 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:05.303436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e7d47b49-6f5c-4608-8bbf-4bf1dea21852 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:05.541113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e7d47b49-6f5c-4608-8bbf-4bf1dea21852 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:11:05.553511 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e7d47b49-6f5c-4608-8bbf-4bf1dea21852 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1278 microversion: 2.1 time: 0.265548 Oct 11 00:11:05.565405 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3587/6850] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:11:05 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1278 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:11:05.565405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-66f48fad-397f-4272-ae6b-4c5ecde2e354 req-41333a7c-39f1-4682-9fb8-eac63bb800de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02a8dae0-751a-4730-8e02-f9e02fef44d5", "tag": "f3a172dc-ba55-4d82-a42a-3379941c30be"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:11:05.573147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-66f48fad-397f-4272-ae6b-4c5ecde2e354 req-41333a7c-39f1-4682-9fb8-eac63bb800de service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:05.574266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-66f48fad-397f-4272-ae6b-4c5ecde2e354 req-41333a7c-39f1-4682-9fb8-eac63bb800de service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:05.574829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-66f48fad-397f-4272-ae6b-4c5ecde2e354 req-41333a7c-39f1-4682-9fb8-eac63bb800de service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:05.594675 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-66f48fad-397f-4272-ae6b-4c5ecde2e354 req-41333a7c-39f1-4682-9fb8-eac63bb800de service nova] Creating event network-changed:f3a172dc-ba55-4d82-a42a-3379941c30be for instance 02a8dae0-751a-4730-8e02-f9e02fef44d5 on n-h1-860864-2 Oct 11 00:11:05.601447 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-66f48fad-397f-4272-ae6b-4c5ecde2e354 req-41333a7c-39f1-4682-9fb8-eac63bb800de service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045380 Oct 11 00:11:05.602389 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3588/6851] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:11:06.584318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-daf7b61f-42d1-4fc5-a349-d9eba57ee1c0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:11:06.585828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-daf7b61f-42d1-4fc5-a349-d9eba57ee1c0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:11:06.593519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-daf7b61f-42d1-4fc5-a349-d9eba57ee1c0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:06.594860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-daf7b61f-42d1-4fc5-a349-d9eba57ee1c0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:06.595468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-daf7b61f-42d1-4fc5-a349-d9eba57ee1c0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:06.596481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-daf7b61f-42d1-4fc5-a349-d9eba57ee1c0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:06.597132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-daf7b61f-42d1-4fc5-a349-d9eba57ee1c0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:06.598731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-daf7b61f-42d1-4fc5-a349-d9eba57ee1c0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:06.824833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-daf7b61f-42d1-4fc5-a349-d9eba57ee1c0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:11:06.834836 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-daf7b61f-42d1-4fc5-a349-d9eba57ee1c0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1278 microversion: 2.1 time: 0.256636 Oct 11 00:11:06.835625 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3589/6852] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:11:06 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1278 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:11:07.859313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-95c16322-ca4f-4c0f-9c10-b17bfdb8ba96 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:11:07.859954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-95c16322-ca4f-4c0f-9c10-b17bfdb8ba96 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:11:07.867567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95c16322-ca4f-4c0f-9c10-b17bfdb8ba96 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:07.868073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95c16322-ca4f-4c0f-9c10-b17bfdb8ba96 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:07.868527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95c16322-ca4f-4c0f-9c10-b17bfdb8ba96 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:07.869241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95c16322-ca4f-4c0f-9c10-b17bfdb8ba96 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:07.869741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95c16322-ca4f-4c0f-9c10-b17bfdb8ba96 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:07.870188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95c16322-ca4f-4c0f-9c10-b17bfdb8ba96 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:08.010052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-95c16322-ca4f-4c0f-9c10-b17bfdb8ba96 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:11:08.022725 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-95c16322-ca4f-4c0f-9c10-b17bfdb8ba96 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1278 microversion: 2.1 time: 0.166898 Oct 11 00:11:08.023625 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3590/6853] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:11:07 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:11:09.046731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e783ddf0-a8d1-40fc-9842-bc43c3c4c313 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:11:09.047470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e783ddf0-a8d1-40fc-9842-bc43c3c4c313 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:11:09.054024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e783ddf0-a8d1-40fc-9842-bc43c3c4c313 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:09.054529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e783ddf0-a8d1-40fc-9842-bc43c3c4c313 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:09.054982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e783ddf0-a8d1-40fc-9842-bc43c3c4c313 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:09.055736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e783ddf0-a8d1-40fc-9842-bc43c3c4c313 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:09.056210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e783ddf0-a8d1-40fc-9842-bc43c3c4c313 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:09.056650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e783ddf0-a8d1-40fc-9842-bc43c3c4c313 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:09.210488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e783ddf0-a8d1-40fc-9842-bc43c3c4c313 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:11:09.218484 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e783ddf0-a8d1-40fc-9842-bc43c3c4c313 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1278 microversion: 2.1 time: 0.175694 Oct 11 00:11:09.219072 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3591/6854] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:11:09 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:11:10.242326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ed21349b-1ad0-478e-a986-8556449c22dc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:11:10.242980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ed21349b-1ad0-478e-a986-8556449c22dc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:11:10.244938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:11:10.251193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed21349b-1ad0-478e-a986-8556449c22dc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:10.251694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed21349b-1ad0-478e-a986-8556449c22dc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:10.252144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed21349b-1ad0-478e-a986-8556449c22dc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:10.252849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed21349b-1ad0-478e-a986-8556449c22dc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:10.253357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed21349b-1ad0-478e-a986-8556449c22dc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:10.254069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed21349b-1ad0-478e-a986-8556449c22dc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:10.257868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:11:10.390987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ed21349b-1ad0-478e-a986-8556449c22dc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:11:10.399496 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ed21349b-1ad0-478e-a986-8556449c22dc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1266 microversion: 2.1 time: 0.161111 Oct 11 00:11:10.400071 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3592/6855] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:11:10 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:11:11.423319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-506d398f-86c5-4415-a4e8-a368f0eba61b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:11:11.423954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-506d398f-86c5-4415-a4e8-a368f0eba61b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:11:11.432298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-506d398f-86c5-4415-a4e8-a368f0eba61b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:11.432796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-506d398f-86c5-4415-a4e8-a368f0eba61b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:11.433255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-506d398f-86c5-4415-a4e8-a368f0eba61b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:11.434045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-506d398f-86c5-4415-a4e8-a368f0eba61b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:11.434524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-506d398f-86c5-4415-a4e8-a368f0eba61b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:11.434971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-506d398f-86c5-4415-a4e8-a368f0eba61b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:11.583777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-506d398f-86c5-4415-a4e8-a368f0eba61b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:11:11.592117 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-506d398f-86c5-4415-a4e8-a368f0eba61b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1266 microversion: 2.1 time: 0.173249 Oct 11 00:11:11.592746 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3593/6856] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:11:11 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:11:12.620283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c7eb6c98-2a4d-40e4-8ccb-f960cb1feac3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:11:12.621151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c7eb6c98-2a4d-40e4-8ccb-f960cb1feac3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:11:12.628857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7eb6c98-2a4d-40e4-8ccb-f960cb1feac3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:12.629392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7eb6c98-2a4d-40e4-8ccb-f960cb1feac3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:12.629841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7eb6c98-2a4d-40e4-8ccb-f960cb1feac3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:12.630560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7eb6c98-2a4d-40e4-8ccb-f960cb1feac3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:12.631029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7eb6c98-2a4d-40e4-8ccb-f960cb1feac3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:12.631472 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7eb6c98-2a4d-40e4-8ccb-f960cb1feac3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:12.767262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c7eb6c98-2a4d-40e4-8ccb-f960cb1feac3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:11:12.775075 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c7eb6c98-2a4d-40e4-8ccb-f960cb1feac3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1266 microversion: 2.1 time: 0.162877 Oct 11 00:11:12.775649 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3594/6857] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:11:12 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:11:13.798816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9c28b6d9-8a24-4a5a-b3ac-8ff0df01c86b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:11:13.799457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9c28b6d9-8a24-4a5a-b3ac-8ff0df01c86b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:11:13.801207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=14 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:11:13.808189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c28b6d9-8a24-4a5a-b3ac-8ff0df01c86b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:13.808716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c28b6d9-8a24-4a5a-b3ac-8ff0df01c86b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:13.809159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c28b6d9-8a24-4a5a-b3ac-8ff0df01c86b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:13.809919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c28b6d9-8a24-4a5a-b3ac-8ff0df01c86b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:13.810396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c28b6d9-8a24-4a5a-b3ac-8ff0df01c86b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:13.810848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c28b6d9-8a24-4a5a-b3ac-8ff0df01c86b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:13.948276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9c28b6d9-8a24-4a5a-b3ac-8ff0df01c86b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:11:13.957074 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9c28b6d9-8a24-4a5a-b3ac-8ff0df01c86b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1266 microversion: 2.1 time: 0.162467 Oct 11 00:11:13.957696 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3595/6858] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:11:13 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:11:14.982372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3f65a269-dd98-4948-94b1-4463dd12b265 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:11:14.983512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3f65a269-dd98-4948-94b1-4463dd12b265 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:11:14.995545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f65a269-dd98-4948-94b1-4463dd12b265 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:14.996388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f65a269-dd98-4948-94b1-4463dd12b265 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:14.997159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f65a269-dd98-4948-94b1-4463dd12b265 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:14.998435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f65a269-dd98-4948-94b1-4463dd12b265 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:14.999163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f65a269-dd98-4948-94b1-4463dd12b265 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:14.999863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f65a269-dd98-4948-94b1-4463dd12b265 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:15.158597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3f65a269-dd98-4948-94b1-4463dd12b265 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:11:15.169271 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3f65a269-dd98-4948-94b1-4463dd12b265 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1266 microversion: 2.1 time: 0.192595 Oct 11 00:11:15.169886 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3596/6859] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:11:14 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:11:16.195545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cb950aa3-0401-420f-8d9e-18396a8377bd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:11:16.196183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cb950aa3-0401-420f-8d9e-18396a8377bd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:11:16.203141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb950aa3-0401-420f-8d9e-18396a8377bd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:16.203644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb950aa3-0401-420f-8d9e-18396a8377bd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:16.204096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb950aa3-0401-420f-8d9e-18396a8377bd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:16.204810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb950aa3-0401-420f-8d9e-18396a8377bd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:16.205278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb950aa3-0401-420f-8d9e-18396a8377bd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:16.205746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb950aa3-0401-420f-8d9e-18396a8377bd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:16.353487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cb950aa3-0401-420f-8d9e-18396a8377bd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:11:16.361419 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cb950aa3-0401-420f-8d9e-18396a8377bd tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1266 microversion: 2.1 time: 0.171485 Oct 11 00:11:16.362012 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3597/6860] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:11:16 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:11:17.386074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6b003385-6481-45b1-a164-eb34fffb5094 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:11:17.386816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6b003385-6481-45b1-a164-eb34fffb5094 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:11:17.393795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b003385-6481-45b1-a164-eb34fffb5094 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:17.394302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b003385-6481-45b1-a164-eb34fffb5094 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:17.394758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b003385-6481-45b1-a164-eb34fffb5094 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:17.395487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b003385-6481-45b1-a164-eb34fffb5094 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:17.396183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b003385-6481-45b1-a164-eb34fffb5094 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:17.396723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b003385-6481-45b1-a164-eb34fffb5094 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:17.549329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6b003385-6481-45b1-a164-eb34fffb5094 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:11:17.559940 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6b003385-6481-45b1-a164-eb34fffb5094 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1266 microversion: 2.1 time: 0.177700 Oct 11 00:11:17.560554 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3598/6861] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:11:17 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:11:18.584861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-608519d6-e541-4dd9-8d38-d3cc2bbe19db tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:11:18.585556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-608519d6-e541-4dd9-8d38-d3cc2bbe19db tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:11:18.592880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-608519d6-e541-4dd9-8d38-d3cc2bbe19db tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:18.593418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-608519d6-e541-4dd9-8d38-d3cc2bbe19db tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:18.593883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-608519d6-e541-4dd9-8d38-d3cc2bbe19db tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:18.594631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-608519d6-e541-4dd9-8d38-d3cc2bbe19db tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:18.595107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-608519d6-e541-4dd9-8d38-d3cc2bbe19db tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:18.595555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-608519d6-e541-4dd9-8d38-d3cc2bbe19db tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:18.739721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-608519d6-e541-4dd9-8d38-d3cc2bbe19db tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:11:18.747629 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-608519d6-e541-4dd9-8d38-d3cc2bbe19db tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1266 microversion: 2.1 time: 0.167764 Oct 11 00:11:18.748206 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3599/6862] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:11:18 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:11:18.752624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-015b6d43-2ea1-46ba-970a-b3c9b4270967 req-1f24d874-7291-4af0-8b6c-d582f78b736c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02a8dae0-751a-4730-8e02-f9e02fef44d5", "name": "network-vif-plugged", "status": "completed", "tag": "f3a172dc-ba55-4d82-a42a-3379941c30be"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:11:18.762569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-015b6d43-2ea1-46ba-970a-b3c9b4270967 req-1f24d874-7291-4af0-8b6c-d582f78b736c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:18.762912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-015b6d43-2ea1-46ba-970a-b3c9b4270967 req-1f24d874-7291-4af0-8b6c-d582f78b736c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:18.763362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-015b6d43-2ea1-46ba-970a-b3c9b4270967 req-1f24d874-7291-4af0-8b6c-d582f78b736c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:18.774884 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-015b6d43-2ea1-46ba-970a-b3c9b4270967 req-1f24d874-7291-4af0-8b6c-d582f78b736c service nova] Creating event network-vif-plugged:f3a172dc-ba55-4d82-a42a-3379941c30be for instance 02a8dae0-751a-4730-8e02-f9e02fef44d5 on n-h1-860864-2 Oct 11 00:11:18.780053 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-015b6d43-2ea1-46ba-970a-b3c9b4270967 req-1f24d874-7291-4af0-8b6c-d582f78b736c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030724 Oct 11 00:11:18.780646 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3600/6863] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:11:19.773051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6d997c22-3e70-4d0a-9dcb-b1bc765289c0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:11:19.773793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6d997c22-3e70-4d0a-9dcb-b1bc765289c0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:11:19.780210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d997c22-3e70-4d0a-9dcb-b1bc765289c0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:19.780709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d997c22-3e70-4d0a-9dcb-b1bc765289c0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:19.781160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d997c22-3e70-4d0a-9dcb-b1bc765289c0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:19.782009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d997c22-3e70-4d0a-9dcb-b1bc765289c0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:19.782483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d997c22-3e70-4d0a-9dcb-b1bc765289c0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:19.782923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d997c22-3e70-4d0a-9dcb-b1bc765289c0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:19.922215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6d997c22-3e70-4d0a-9dcb-b1bc765289c0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:11:19.932068 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6d997c22-3e70-4d0a-9dcb-b1bc765289c0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1266 microversion: 2.1 time: 0.163660 Oct 11 00:11:19.932906 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3601/6864] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:11:19 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:11:20.958929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-17b184f4-4c3a-4553-ad4c-a82d708019d9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:11:20.959728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-17b184f4-4c3a-4553-ad4c-a82d708019d9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:11:20.962665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:11:20.967789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17b184f4-4c3a-4553-ad4c-a82d708019d9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:20.968302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17b184f4-4c3a-4553-ad4c-a82d708019d9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:20.968778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17b184f4-4c3a-4553-ad4c-a82d708019d9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:20.969533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17b184f4-4c3a-4553-ad4c-a82d708019d9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:20.970012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17b184f4-4c3a-4553-ad4c-a82d708019d9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:20.970465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17b184f4-4c3a-4553-ad4c-a82d708019d9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:21.111160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-17b184f4-4c3a-4553-ad4c-a82d708019d9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:11:21.120195 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-17b184f4-4c3a-4553-ad4c-a82d708019d9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1453 microversion: 2.1 time: 0.165938 Oct 11 00:11:21.120789 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3602/6865] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:11:20 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:11:21.143412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-83ee230b-1fd2-44d8-8fb3-c790d3906d8a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:11:21.144053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-83ee230b-1fd2-44d8-8fb3-c790d3906d8a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:11:21.150523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83ee230b-1fd2-44d8-8fb3-c790d3906d8a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:21.151041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83ee230b-1fd2-44d8-8fb3-c790d3906d8a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:21.151528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83ee230b-1fd2-44d8-8fb3-c790d3906d8a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:21.152245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83ee230b-1fd2-44d8-8fb3-c790d3906d8a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:21.152725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83ee230b-1fd2-44d8-8fb3-c790d3906d8a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:21.153178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83ee230b-1fd2-44d8-8fb3-c790d3906d8a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:21.311526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-83ee230b-1fd2-44d8-8fb3-c790d3906d8a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:11:21.320261 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-83ee230b-1fd2-44d8-8fb3-c790d3906d8a tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1453 microversion: 2.1 time: 0.180717 Oct 11 00:11:21.320851 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3603/6866] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:11:21 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1453 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:11:23.087872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-9f0614d3-aab7-4b44-8ce4-9c352bb9818c req-f2075f43-8a20-49ab-ba47-cc0bf8f141a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02a8dae0-751a-4730-8e02-f9e02fef44d5", "tag": "f3a172dc-ba55-4d82-a42a-3379941c30be"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:11:23.099089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9f0614d3-aab7-4b44-8ce4-9c352bb9818c req-f2075f43-8a20-49ab-ba47-cc0bf8f141a8 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:11:23.099606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9f0614d3-aab7-4b44-8ce4-9c352bb9818c req-f2075f43-8a20-49ab-ba47-cc0bf8f141a8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:11:23.100160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9f0614d3-aab7-4b44-8ce4-9c352bb9818c req-f2075f43-8a20-49ab-ba47-cc0bf8f141a8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:11:23.112150 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-9f0614d3-aab7-4b44-8ce4-9c352bb9818c req-f2075f43-8a20-49ab-ba47-cc0bf8f141a8 service nova] Creating event network-changed:f3a172dc-ba55-4d82-a42a-3379941c30be for instance 02a8dae0-751a-4730-8e02-f9e02fef44d5 on n-h1-860864-2 Oct 11 00:11:23.118556 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-9f0614d3-aab7-4b44-8ce4-9c352bb9818c req-f2075f43-8a20-49ab-ba47-cc0bf8f141a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034516 Oct 11 00:11:23.119174 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3604/6867] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:12:39.843409 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:12:39.843941 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:12:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 11 00:12:39.851721 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:12:39.851906 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:12:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 11 00:13:06.286317 n-d-860864-2 devstack@n-api.service[120613]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9b2b028e-60c1-4dc3-ac1e-06905f87835c] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 00:13:06.286951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=5 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:13:06.287724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=68 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:13:06.288886 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:13:06.289267 n-d-860864-2 devstack@n-api.service[120613]: Tue Oct 11 00:13:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 11 00:13:06.295209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cc1973aa-1831-480a-a997-dff17172929f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-242453359", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1344377026", "security_groups": [{"name": "tempest-secgroup-smoke-991778925"}], "block_device_mapping_v2": [{"uuid": "532f21ed-f6a1-48c8-9069-49365f2df1ca", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6b4889cd-925d-4509-9797-a829b845f15b"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:13:06.609028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-cc1973aa-1831-480a-a997-dff17172929f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] validate_networks() for [('6b4889cd-925d-4509-9797-a829b845f15b', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:13:07.002660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-cc1973aa-1831-480a-a997-dff17172929f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:13:07.003134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-cc1973aa-1831-480a-a997-dff17172929f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:13:07.003631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-cc1973aa-1831-480a-a997-dff17172929f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:13:07.004064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-cc1973aa-1831-480a-a997-dff17172929f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:13:07.004532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-cc1973aa-1831-480a-a997-dff17172929f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:13:07.014001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc1973aa-1831-480a-a997-dff17172929f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:07.014506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc1973aa-1831-480a-a997-dff17172929f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:07.014963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc1973aa-1831-480a-a997-dff17172929f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:07.015712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc1973aa-1831-480a-a997-dff17172929f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:07.016181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc1973aa-1831-480a-a997-dff17172929f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:07.016623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc1973aa-1831-480a-a997-dff17172929f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:07.035714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-cc1973aa-1831-480a-a997-dff17172929f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Getting quotas for project be6e417773094ab08c170ca4b69f3742. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:13:07.042796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-cc1973aa-1831-480a-a997-dff17172929f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Getting quotas for user a27b050389ad48089e214ad65eaa83bb and project be6e417773094ab08c170ca4b69f3742. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:13:07.105063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cc1973aa-1831-480a-a997-dff17172929f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:13:07.107396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cc1973aa-1831-480a-a997-dff17172929f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='532f21ed-f6a1-48c8-9069-49365f2df1ca',volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:13:07.246029 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cc1973aa-1831-480a-a997-dff17172929f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.962146 Oct 11 00:13:07.246895 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3605/6868] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:13:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 00:13:07.257976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-57ef7bc7-8a7f-4e31-9491-b9f7dd4f81fc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:13:07.258551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-57ef7bc7-8a7f-4e31-9491-b9f7dd4f81fc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:13:07.298952 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] [9b2b028e-60c1-4dc3-ac1e-06905f87835c] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 35488. Oct 11 00:13:07.314081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-57ef7bc7-8a7f-4e31-9491-b9f7dd4f81fc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:13:07.321369 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-57ef7bc7-8a7f-4e31-9491-b9f7dd4f81fc tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 200 len: 1094 microversion: 2.1 time: 0.067352 Oct 11 00:13:07.321986 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3606/6869] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:13:07 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:13:08.344354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e254df23-d045-4ea7-b2e8-aafc98484a16 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:13:08.344997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e254df23-d045-4ea7-b2e8-aafc98484a16 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:13:08.356491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e254df23-d045-4ea7-b2e8-aafc98484a16 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:08.356996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e254df23-d045-4ea7-b2e8-aafc98484a16 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:08.357484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e254df23-d045-4ea7-b2e8-aafc98484a16 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:08.358210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e254df23-d045-4ea7-b2e8-aafc98484a16 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:08.358686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e254df23-d045-4ea7-b2e8-aafc98484a16 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:08.359132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e254df23-d045-4ea7-b2e8-aafc98484a16 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:08.431054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e254df23-d045-4ea7-b2e8-aafc98484a16 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:13:08.439747 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e254df23-d045-4ea7-b2e8-aafc98484a16 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 200 len: 1192 microversion: 2.1 time: 0.099433 Oct 11 00:13:08.440705 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3607/6870] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:13:08 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 1192 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:13:09.468806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-031ad7ef-8b65-432e-910b-68866fa059a3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:13:09.470087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-031ad7ef-8b65-432e-910b-68866fa059a3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:13:09.481178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-031ad7ef-8b65-432e-910b-68866fa059a3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:09.482076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-031ad7ef-8b65-432e-910b-68866fa059a3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:09.482697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-031ad7ef-8b65-432e-910b-68866fa059a3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:09.483804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-031ad7ef-8b65-432e-910b-68866fa059a3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:09.484442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-031ad7ef-8b65-432e-910b-68866fa059a3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:09.485047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-031ad7ef-8b65-432e-910b-68866fa059a3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:09.633928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-031ad7ef-8b65-432e-910b-68866fa059a3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:13:09.641996 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-031ad7ef-8b65-432e-910b-68866fa059a3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 200 len: 1277 microversion: 2.1 time: 0.179133 Oct 11 00:13:09.642740 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3608/6871] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:13:09 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:13:10.001591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-46540dd8-b728-4285-810c-6539b5e3e458 req-7da49a73-2e2e-4367-8f76-738ba8387434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f5e80ae-43be-407a-b5fc-4a54984d445c", "tag": "8e41add8-0fb4-4278-95c2-1d25517ed486"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:13:10.013636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-46540dd8-b728-4285-810c-6539b5e3e458 req-7da49a73-2e2e-4367-8f76-738ba8387434 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:10.014286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-46540dd8-b728-4285-810c-6539b5e3e458 req-7da49a73-2e2e-4367-8f76-738ba8387434 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:10.014979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-46540dd8-b728-4285-810c-6539b5e3e458 req-7da49a73-2e2e-4367-8f76-738ba8387434 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:10.027214 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-46540dd8-b728-4285-810c-6539b5e3e458 req-7da49a73-2e2e-4367-8f76-738ba8387434 service nova] Creating event network-changed:8e41add8-0fb4-4278-95c2-1d25517ed486 for instance 7f5e80ae-43be-407a-b5fc-4a54984d445c on n-h2-860864-2 Oct 11 00:13:10.032704 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-46540dd8-b728-4285-810c-6539b5e3e458 req-7da49a73-2e2e-4367-8f76-738ba8387434 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034986 Oct 11 00:13:10.033923 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3609/6872] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:13:10.668172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3560daba-f41c-4c28-b195-b3f7e32f26ee tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:13:10.669058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3560daba-f41c-4c28-b195-b3f7e32f26ee tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:13:10.675473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3560daba-f41c-4c28-b195-b3f7e32f26ee tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:10.676055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3560daba-f41c-4c28-b195-b3f7e32f26ee tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:10.676590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3560daba-f41c-4c28-b195-b3f7e32f26ee tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:10.677403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3560daba-f41c-4c28-b195-b3f7e32f26ee tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:10.678090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3560daba-f41c-4c28-b195-b3f7e32f26ee tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:10.678742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3560daba-f41c-4c28-b195-b3f7e32f26ee tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:10.823213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3560daba-f41c-4c28-b195-b3f7e32f26ee tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:13:10.831966 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3560daba-f41c-4c28-b195-b3f7e32f26ee tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 200 len: 1277 microversion: 2.1 time: 0.169515 Oct 11 00:13:10.832563 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3610/6873] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:13:10 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:13:11.856915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-35d92619-2b91-4ac3-8d8e-af1f4d612db3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:13:11.857595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-35d92619-2b91-4ac3-8d8e-af1f4d612db3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:13:11.864407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-35d92619-2b91-4ac3-8d8e-af1f4d612db3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:11.864904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-35d92619-2b91-4ac3-8d8e-af1f4d612db3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:11.865356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-35d92619-2b91-4ac3-8d8e-af1f4d612db3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:11.866090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-35d92619-2b91-4ac3-8d8e-af1f4d612db3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:11.866559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-35d92619-2b91-4ac3-8d8e-af1f4d612db3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:11.866995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-35d92619-2b91-4ac3-8d8e-af1f4d612db3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:12.005406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-35d92619-2b91-4ac3-8d8e-af1f4d612db3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:13:12.014450 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-35d92619-2b91-4ac3-8d8e-af1f4d612db3 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 200 len: 1277 microversion: 2.1 time: 0.161391 Oct 11 00:13:12.015030 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3611/6874] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:13:11 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:13:13.037608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-704b8cfc-8922-400f-aa21-87b86b6270f6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:13:13.038256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-704b8cfc-8922-400f-aa21-87b86b6270f6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:13:13.046523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-704b8cfc-8922-400f-aa21-87b86b6270f6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:13.047025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-704b8cfc-8922-400f-aa21-87b86b6270f6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:13.047477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-704b8cfc-8922-400f-aa21-87b86b6270f6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:13.048195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-704b8cfc-8922-400f-aa21-87b86b6270f6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:13.048673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-704b8cfc-8922-400f-aa21-87b86b6270f6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:13.049117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-704b8cfc-8922-400f-aa21-87b86b6270f6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:13.193228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-704b8cfc-8922-400f-aa21-87b86b6270f6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:13:13.201965 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-704b8cfc-8922-400f-aa21-87b86b6270f6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 200 len: 1277 microversion: 2.1 time: 0.168203 Oct 11 00:13:13.202555 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3612/6875] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:13:13 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:13:14.227337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cf3235c3-9839-4e9b-8c58-ae67409b4606 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:13:14.228007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cf3235c3-9839-4e9b-8c58-ae67409b4606 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:13:14.234807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf3235c3-9839-4e9b-8c58-ae67409b4606 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:14.235307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf3235c3-9839-4e9b-8c58-ae67409b4606 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:14.235759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf3235c3-9839-4e9b-8c58-ae67409b4606 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:14.236469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf3235c3-9839-4e9b-8c58-ae67409b4606 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:14.236935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf3235c3-9839-4e9b-8c58-ae67409b4606 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:14.237386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cf3235c3-9839-4e9b-8c58-ae67409b4606 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:14.380583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cf3235c3-9839-4e9b-8c58-ae67409b4606 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:13:14.389216 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cf3235c3-9839-4e9b-8c58-ae67409b4606 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 200 len: 1265 microversion: 2.1 time: 0.167638 Oct 11 00:13:14.389838 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3613/6876] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:13:14 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:13:15.412777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b67c9eb6-6997-4d05-8f3b-e67aba58dd4f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:13:15.413474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b67c9eb6-6997-4d05-8f3b-e67aba58dd4f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:13:15.420517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b67c9eb6-6997-4d05-8f3b-e67aba58dd4f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:15.421028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b67c9eb6-6997-4d05-8f3b-e67aba58dd4f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:15.421525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b67c9eb6-6997-4d05-8f3b-e67aba58dd4f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:15.422271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b67c9eb6-6997-4d05-8f3b-e67aba58dd4f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:15.422747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b67c9eb6-6997-4d05-8f3b-e67aba58dd4f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:15.423193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b67c9eb6-6997-4d05-8f3b-e67aba58dd4f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:15.559672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b67c9eb6-6997-4d05-8f3b-e67aba58dd4f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:13:15.567459 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b67c9eb6-6997-4d05-8f3b-e67aba58dd4f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 200 len: 1265 microversion: 2.1 time: 0.158711 Oct 11 00:13:15.568040 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3614/6877] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:13:15 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:13:16.590385 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-582bf088-67a1-4cee-8b83-73871baa5a00 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:13:16.591083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-582bf088-67a1-4cee-8b83-73871baa5a00 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:13:16.598030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-582bf088-67a1-4cee-8b83-73871baa5a00 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:16.598535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-582bf088-67a1-4cee-8b83-73871baa5a00 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:16.598992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-582bf088-67a1-4cee-8b83-73871baa5a00 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:16.599706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-582bf088-67a1-4cee-8b83-73871baa5a00 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:16.600181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-582bf088-67a1-4cee-8b83-73871baa5a00 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:16.600628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-582bf088-67a1-4cee-8b83-73871baa5a00 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:16.732985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-582bf088-67a1-4cee-8b83-73871baa5a00 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:13:16.740834 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-582bf088-67a1-4cee-8b83-73871baa5a00 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 200 len: 1265 microversion: 2.1 time: 0.154387 Oct 11 00:13:16.741424 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3615/6878] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:13:16 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:13:17.879007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ee202133-1643-41e6-9a17-18159517f1a7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:13:17.879687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ee202133-1643-41e6-9a17-18159517f1a7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:13:17.881715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:13:17.882474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:13:17.889504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee202133-1643-41e6-9a17-18159517f1a7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:17.890016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee202133-1643-41e6-9a17-18159517f1a7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:17.890471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee202133-1643-41e6-9a17-18159517f1a7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:17.891189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee202133-1643-41e6-9a17-18159517f1a7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:17.891664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee202133-1643-41e6-9a17-18159517f1a7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:17.892110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee202133-1643-41e6-9a17-18159517f1a7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:18.031345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ee202133-1643-41e6-9a17-18159517f1a7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:13:18.040266 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ee202133-1643-41e6-9a17-18159517f1a7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 200 len: 1265 microversion: 2.1 time: 0.164139 Oct 11 00:13:18.040841 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3616/6879] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:13:17 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:13:19.065410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6b8c2985-82b5-435d-8af6-2d97d211f5f9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:13:19.066264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6b8c2985-82b5-435d-8af6-2d97d211f5f9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:13:19.074655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b8c2985-82b5-435d-8af6-2d97d211f5f9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:19.075091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b8c2985-82b5-435d-8af6-2d97d211f5f9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:19.075548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b8c2985-82b5-435d-8af6-2d97d211f5f9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:19.076375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b8c2985-82b5-435d-8af6-2d97d211f5f9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:19.076755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b8c2985-82b5-435d-8af6-2d97d211f5f9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:19.077200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b8c2985-82b5-435d-8af6-2d97d211f5f9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:19.248929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6b8c2985-82b5-435d-8af6-2d97d211f5f9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:13:19.260792 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6b8c2985-82b5-435d-8af6-2d97d211f5f9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 200 len: 1265 microversion: 2.1 time: 0.199530 Oct 11 00:13:19.261610 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3617/6880] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:13:19 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:13:20.287295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-26cd5b02-7f73-42e3-9ac7-b651de9b2dc7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:13:20.287943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-26cd5b02-7f73-42e3-9ac7-b651de9b2dc7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:13:20.295210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26cd5b02-7f73-42e3-9ac7-b651de9b2dc7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:20.295865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26cd5b02-7f73-42e3-9ac7-b651de9b2dc7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:20.296319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26cd5b02-7f73-42e3-9ac7-b651de9b2dc7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:20.297044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26cd5b02-7f73-42e3-9ac7-b651de9b2dc7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:20.297553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26cd5b02-7f73-42e3-9ac7-b651de9b2dc7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:20.297992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26cd5b02-7f73-42e3-9ac7-b651de9b2dc7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:20.753002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-26cd5b02-7f73-42e3-9ac7-b651de9b2dc7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:13:20.761928 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-26cd5b02-7f73-42e3-9ac7-b651de9b2dc7 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 200 len: 1265 microversion: 2.1 time: 0.478594 Oct 11 00:13:20.762537 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3618/6881] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:13:20 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 1265 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:13:21.784219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-29ea248e-97e8-45de-baf9-f4dd15315a2b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:13:21.784872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-29ea248e-97e8-45de-baf9-f4dd15315a2b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:13:21.792859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29ea248e-97e8-45de-baf9-f4dd15315a2b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:21.793306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29ea248e-97e8-45de-baf9-f4dd15315a2b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:21.793794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29ea248e-97e8-45de-baf9-f4dd15315a2b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:21.794525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29ea248e-97e8-45de-baf9-f4dd15315a2b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:21.795010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29ea248e-97e8-45de-baf9-f4dd15315a2b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:21.795462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29ea248e-97e8-45de-baf9-f4dd15315a2b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:21.939309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-29ea248e-97e8-45de-baf9-f4dd15315a2b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:13:21.947536 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-29ea248e-97e8-45de-baf9-f4dd15315a2b tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 200 len: 1265 microversion: 2.1 time: 0.167218 Oct 11 00:13:21.948144 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3619/6882] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:13:21 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:13:22.970512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d880e2fb-9e29-4a8d-ba10-cf468521bd16 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:13:22.971190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d880e2fb-9e29-4a8d-ba10-cf468521bd16 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:13:22.979049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d880e2fb-9e29-4a8d-ba10-cf468521bd16 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:22.979553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d880e2fb-9e29-4a8d-ba10-cf468521bd16 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:22.980007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d880e2fb-9e29-4a8d-ba10-cf468521bd16 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:22.980723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d880e2fb-9e29-4a8d-ba10-cf468521bd16 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:22.981190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d880e2fb-9e29-4a8d-ba10-cf468521bd16 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:22.981657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d880e2fb-9e29-4a8d-ba10-cf468521bd16 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:23.120886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d880e2fb-9e29-4a8d-ba10-cf468521bd16 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:13:23.128692 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d880e2fb-9e29-4a8d-ba10-cf468521bd16 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 200 len: 1265 microversion: 2.1 time: 0.162149 Oct 11 00:13:23.129467 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3620/6883] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:13:22 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:13:23.447804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-4405508a-1948-4878-b635-d044a38d5216 req-d54730da-92f9-410d-a5d6-aca66d60f287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5e80ae-43be-407a-b5fc-4a54984d445c", "name": "network-vif-plugged", "status": "completed", "tag": "8e41add8-0fb4-4278-95c2-1d25517ed486"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:13:23.457714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4405508a-1948-4878-b635-d044a38d5216 req-d54730da-92f9-410d-a5d6-aca66d60f287 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:23.458208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4405508a-1948-4878-b635-d044a38d5216 req-d54730da-92f9-410d-a5d6-aca66d60f287 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:23.458674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4405508a-1948-4878-b635-d044a38d5216 req-d54730da-92f9-410d-a5d6-aca66d60f287 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:23.471801 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-4405508a-1948-4878-b635-d044a38d5216 req-d54730da-92f9-410d-a5d6-aca66d60f287 service nova] Creating event network-vif-plugged:8e41add8-0fb4-4278-95c2-1d25517ed486 for instance 7f5e80ae-43be-407a-b5fc-4a54984d445c on n-h2-860864-2 Oct 11 00:13:23.477618 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-4405508a-1948-4878-b635-d044a38d5216 req-d54730da-92f9-410d-a5d6-aca66d60f287 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033574 Oct 11 00:13:23.478399 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3621/6884] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:13:24.153725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7d78ebd1-60dd-4495-8dde-661b978fa321 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:13:24.154447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7d78ebd1-60dd-4495-8dde-661b978fa321 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:13:24.160797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d78ebd1-60dd-4495-8dde-661b978fa321 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:24.161303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d78ebd1-60dd-4495-8dde-661b978fa321 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:24.161784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d78ebd1-60dd-4495-8dde-661b978fa321 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:24.162503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d78ebd1-60dd-4495-8dde-661b978fa321 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:24.162978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d78ebd1-60dd-4495-8dde-661b978fa321 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:24.164062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d78ebd1-60dd-4495-8dde-661b978fa321 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:24.294029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7d78ebd1-60dd-4495-8dde-661b978fa321 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:13:24.301886 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7d78ebd1-60dd-4495-8dde-661b978fa321 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 200 len: 1265 microversion: 2.1 time: 0.153960 Oct 11 00:13:24.302456 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3622/6885] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:13:24 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:13:25.325302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2690f9c9-0fea-49cd-bb66-5ce4c0d202bb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:13:25.326041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2690f9c9-0fea-49cd-bb66-5ce4c0d202bb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:13:25.332781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2690f9c9-0fea-49cd-bb66-5ce4c0d202bb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:25.333286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2690f9c9-0fea-49cd-bb66-5ce4c0d202bb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:25.333760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2690f9c9-0fea-49cd-bb66-5ce4c0d202bb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:25.334462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2690f9c9-0fea-49cd-bb66-5ce4c0d202bb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:25.334929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2690f9c9-0fea-49cd-bb66-5ce4c0d202bb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:25.335368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2690f9c9-0fea-49cd-bb66-5ce4c0d202bb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:25.470108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2690f9c9-0fea-49cd-bb66-5ce4c0d202bb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:13:25.478709 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2690f9c9-0fea-49cd-bb66-5ce4c0d202bb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 200 len: 1453 microversion: 2.1 time: 0.157323 Oct 11 00:13:25.479291 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3623/6886] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:13:25 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:13:25.500940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2914377e-f18c-4ca6-91f0-7fea4e0e6286 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:13:25.501610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2914377e-f18c-4ca6-91f0-7fea4e0e6286 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:13:25.507488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2914377e-f18c-4ca6-91f0-7fea4e0e6286 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:25.508079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2914377e-f18c-4ca6-91f0-7fea4e0e6286 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:25.508527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2914377e-f18c-4ca6-91f0-7fea4e0e6286 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:25.509223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2914377e-f18c-4ca6-91f0-7fea4e0e6286 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:25.509720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2914377e-f18c-4ca6-91f0-7fea4e0e6286 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:25.510158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2914377e-f18c-4ca6-91f0-7fea4e0e6286 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:25.528725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:13:25.642900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2914377e-f18c-4ca6-91f0-7fea4e0e6286 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:13:25.651598 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2914377e-f18c-4ca6-91f0-7fea4e0e6286 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 200 len: 1453 microversion: 2.1 time: 0.154486 Oct 11 00:13:25.652171 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3624/6887] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:13:25 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:13:27.261164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-1ab0d22a-3266-40dd-9993-96d7b5b914b3 req-658d4efb-a838-44a0-8d19-e87398c9f09f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f5e80ae-43be-407a-b5fc-4a54984d445c", "tag": "8e41add8-0fb4-4278-95c2-1d25517ed486"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:13:27.271622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1ab0d22a-3266-40dd-9993-96d7b5b914b3 req-658d4efb-a838-44a0-8d19-e87398c9f09f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:13:27.272125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1ab0d22a-3266-40dd-9993-96d7b5b914b3 req-658d4efb-a838-44a0-8d19-e87398c9f09f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:13:27.272603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1ab0d22a-3266-40dd-9993-96d7b5b914b3 req-658d4efb-a838-44a0-8d19-e87398c9f09f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:13:27.288844 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-1ab0d22a-3266-40dd-9993-96d7b5b914b3 req-658d4efb-a838-44a0-8d19-e87398c9f09f service nova] Creating event network-changed:8e41add8-0fb4-4278-95c2-1d25517ed486 for instance 7f5e80ae-43be-407a-b5fc-4a54984d445c on n-h2-860864-2 Oct 11 00:13:27.292827 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-1ab0d22a-3266-40dd-9993-96d7b5b914b3 req-658d4efb-a838-44a0-8d19-e87398c9f09f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035222 Oct 11 00:13:27.293982 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3625/6888] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:14:19.858228 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:14:19.858228 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:14:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 11 00:15:07.140402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:15:07.141183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:15:07.147548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1889fd69-68d7-42c2-a9c7-4d8a183c0460 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:07.148165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1889fd69-68d7-42c2-a9c7-4d8a183c0460 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:07.156244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1889fd69-68d7-42c2-a9c7-4d8a183c0460 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:07.157028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1889fd69-68d7-42c2-a9c7-4d8a183c0460 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:07.157603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1889fd69-68d7-42c2-a9c7-4d8a183c0460 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:07.158580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1889fd69-68d7-42c2-a9c7-4d8a183c0460 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:07.158759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1889fd69-68d7-42c2-a9c7-4d8a183c0460 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:07.159209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1889fd69-68d7-42c2-a9c7-4d8a183c0460 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:07.193230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1889fd69-68d7-42c2-a9c7-4d8a183c0460 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:15:07.278978 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1889fd69-68d7-42c2-a9c7-4d8a183c0460 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 204 len: 0 microversion: 2.1 time: 0.142318 Oct 11 00:15:07.283047 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3626/6889] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:15:07 2022] DELETE /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 00:15:07.373621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-9ce8fe64-8ffb-4a6f-abfd-5c0356942bf3 req-50505376-63b5-43b2-8ac6-d7fadd87ae23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f5e80ae-43be-407a-b5fc-4a54984d445c", "tag": "8e41add8-0fb4-4278-95c2-1d25517ed486"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:15:07.384158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9ce8fe64-8ffb-4a6f-abfd-5c0356942bf3 req-50505376-63b5-43b2-8ac6-d7fadd87ae23 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:07.384653 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9ce8fe64-8ffb-4a6f-abfd-5c0356942bf3 req-50505376-63b5-43b2-8ac6-d7fadd87ae23 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:07.385104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9ce8fe64-8ffb-4a6f-abfd-5c0356942bf3 req-50505376-63b5-43b2-8ac6-d7fadd87ae23 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:07.397199 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-9ce8fe64-8ffb-4a6f-abfd-5c0356942bf3 req-50505376-63b5-43b2-8ac6-d7fadd87ae23 service nova] Creating event network-changed:8e41add8-0fb4-4278-95c2-1d25517ed486 for instance 7f5e80ae-43be-407a-b5fc-4a54984d445c on n-h2-860864-2 Oct 11 00:15:07.402276 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-9ce8fe64-8ffb-4a6f-abfd-5c0356942bf3 req-50505376-63b5-43b2-8ac6-d7fadd87ae23 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121292 Oct 11 00:15:07.402881 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3627/6890] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:15:07.410926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-07eb7ccb-2f33-4086-8aa5-fe9af4d12e14 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:07.411643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-07eb7ccb-2f33-4086-8aa5-fe9af4d12e14 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:07.417992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07eb7ccb-2f33-4086-8aa5-fe9af4d12e14 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:07.418501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07eb7ccb-2f33-4086-8aa5-fe9af4d12e14 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:07.418956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07eb7ccb-2f33-4086-8aa5-fe9af4d12e14 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:07.419673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07eb7ccb-2f33-4086-8aa5-fe9af4d12e14 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:07.420146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07eb7ccb-2f33-4086-8aa5-fe9af4d12e14 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:07.420591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07eb7ccb-2f33-4086-8aa5-fe9af4d12e14 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:07.647641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-07eb7ccb-2f33-4086-8aa5-fe9af4d12e14 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:15:07.655579 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-07eb7ccb-2f33-4086-8aa5-fe9af4d12e14 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 200 len: 1577 microversion: 2.1 time: 0.248708 Oct 11 00:15:07.656155 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3628/6891] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:15:07 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 1577 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:15:08.679978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-60734543-7b84-4fd2-95bf-9ba8926a8253 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:08.680682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-60734543-7b84-4fd2-95bf-9ba8926a8253 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:08.687237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60734543-7b84-4fd2-95bf-9ba8926a8253 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:08.687743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60734543-7b84-4fd2-95bf-9ba8926a8253 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:08.688194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60734543-7b84-4fd2-95bf-9ba8926a8253 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:08.689084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60734543-7b84-4fd2-95bf-9ba8926a8253 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:08.689747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60734543-7b84-4fd2-95bf-9ba8926a8253 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:08.690338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-60734543-7b84-4fd2-95bf-9ba8926a8253 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:08.828408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-60734543-7b84-4fd2-95bf-9ba8926a8253 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:15:08.836830 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-60734543-7b84-4fd2-95bf-9ba8926a8253 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 200 len: 1577 microversion: 2.1 time: 0.161667 Oct 11 00:15:08.837431 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3629/6892] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:15:08 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:15:09.631270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-28e7d84c-c5a5-4770-9e1c-3d4cffedffe2 req-5260f010-1843-48c0-a7b6-5db0e1e28617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5e80ae-43be-407a-b5fc-4a54984d445c", "name": "network-vif-deleted", "tag": "8e41add8-0fb4-4278-95c2-1d25517ed486"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:15:09.641242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-28e7d84c-c5a5-4770-9e1c-3d4cffedffe2 req-5260f010-1843-48c0-a7b6-5db0e1e28617 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:09.641782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-28e7d84c-c5a5-4770-9e1c-3d4cffedffe2 req-5260f010-1843-48c0-a7b6-5db0e1e28617 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:09.642275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-28e7d84c-c5a5-4770-9e1c-3d4cffedffe2 req-5260f010-1843-48c0-a7b6-5db0e1e28617 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:09.654904 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-28e7d84c-c5a5-4770-9e1c-3d4cffedffe2 req-5260f010-1843-48c0-a7b6-5db0e1e28617 service nova] Creating event network-vif-deleted:8e41add8-0fb4-4278-95c2-1d25517ed486 for instance 7f5e80ae-43be-407a-b5fc-4a54984d445c on n-h2-860864-2 Oct 11 00:15:09.660162 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-28e7d84c-c5a5-4770-9e1c-3d4cffedffe2 req-5260f010-1843-48c0-a7b6-5db0e1e28617 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099264 Oct 11 00:15:09.660855 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3630/6893] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:15:09.861703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a5ee81ee-10a3-4dc2-997e-9dbeaf431bbb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:09.863610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a5ee81ee-10a3-4dc2-997e-9dbeaf431bbb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:09.869845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5ee81ee-10a3-4dc2-997e-9dbeaf431bbb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:09.870360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5ee81ee-10a3-4dc2-997e-9dbeaf431bbb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:09.870824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5ee81ee-10a3-4dc2-997e-9dbeaf431bbb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:09.871549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5ee81ee-10a3-4dc2-997e-9dbeaf431bbb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:09.872029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5ee81ee-10a3-4dc2-997e-9dbeaf431bbb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:09.872478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a5ee81ee-10a3-4dc2-997e-9dbeaf431bbb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:09.940347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a5ee81ee-10a3-4dc2-997e-9dbeaf431bbb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:15:09.950169 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a5ee81ee-10a3-4dc2-997e-9dbeaf431bbb tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 200 len: 1225 microversion: 2.1 time: 0.093523 Oct 11 00:15:09.950767 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3631/6894] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:15:09 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:15:10.973745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0650dbb4-4022-44aa-a655-0d62c320ab3f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:10.974386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0650dbb4-4022-44aa-a655-0d62c320ab3f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:10.981467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0650dbb4-4022-44aa-a655-0d62c320ab3f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:10.982001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0650dbb4-4022-44aa-a655-0d62c320ab3f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:10.982458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0650dbb4-4022-44aa-a655-0d62c320ab3f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:10.983174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0650dbb4-4022-44aa-a655-0d62c320ab3f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:10.983661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0650dbb4-4022-44aa-a655-0d62c320ab3f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:10.984103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0650dbb4-4022-44aa-a655-0d62c320ab3f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:11.047682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0650dbb4-4022-44aa-a655-0d62c320ab3f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:15:11.057257 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0650dbb4-4022-44aa-a655-0d62c320ab3f tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 200 len: 1225 microversion: 2.1 time: 0.088069 Oct 11 00:15:11.057984 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3632/6895] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:15:10 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:15:12.080729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-639ae22b-d92c-433d-abe3-20c1a8d8371d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:12.081316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-639ae22b-d92c-433d-abe3-20c1a8d8371d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:12.089133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-639ae22b-d92c-433d-abe3-20c1a8d8371d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:12.089697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-639ae22b-d92c-433d-abe3-20c1a8d8371d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:12.090160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-639ae22b-d92c-433d-abe3-20c1a8d8371d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:12.090895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-639ae22b-d92c-433d-abe3-20c1a8d8371d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:12.091373 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-639ae22b-d92c-433d-abe3-20c1a8d8371d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:12.091826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-639ae22b-d92c-433d-abe3-20c1a8d8371d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:12.163135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-639ae22b-d92c-433d-abe3-20c1a8d8371d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:15:12.171088 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-639ae22b-d92c-433d-abe3-20c1a8d8371d tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 200 len: 1225 microversion: 2.1 time: 0.094452 Oct 11 00:15:12.171672 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3633/6896] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:15:12 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:15:13.195895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-07fd399f-305f-4efe-a6dd-83c8295ed4a9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:13.196576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-07fd399f-305f-4efe-a6dd-83c8295ed4a9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:13.202659 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07fd399f-305f-4efe-a6dd-83c8295ed4a9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:13.203168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07fd399f-305f-4efe-a6dd-83c8295ed4a9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:13.203898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07fd399f-305f-4efe-a6dd-83c8295ed4a9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:13.204349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07fd399f-305f-4efe-a6dd-83c8295ed4a9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:13.204830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07fd399f-305f-4efe-a6dd-83c8295ed4a9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:13.205278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07fd399f-305f-4efe-a6dd-83c8295ed4a9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:13.270895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-07fd399f-305f-4efe-a6dd-83c8295ed4a9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:15:13.279100 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-07fd399f-305f-4efe-a6dd-83c8295ed4a9 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 200 len: 1225 microversion: 2.1 time: 0.088135 Oct 11 00:15:13.279694 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3634/6897] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:15:13 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:15:14.304482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4a5f35aa-88f2-4dae-ad69-37a7b4f68a1e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:14.305149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4a5f35aa-88f2-4dae-ad69-37a7b4f68a1e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 7f5e80ae-43be-407a-b5fc-4a54984d445c] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:14.312193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a5f35aa-88f2-4dae-ad69-37a7b4f68a1e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:14.312702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a5f35aa-88f2-4dae-ad69-37a7b4f68a1e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:14.313162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a5f35aa-88f2-4dae-ad69-37a7b4f68a1e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:14.313934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a5f35aa-88f2-4dae-ad69-37a7b4f68a1e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:14.314409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a5f35aa-88f2-4dae-ad69-37a7b4f68a1e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:14.314854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a5f35aa-88f2-4dae-ad69-37a7b4f68a1e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:14.328458 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-4a5f35aa-88f2-4dae-ad69-37a7b4f68a1e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] HTTP exception thrown: Instance 7f5e80ae-43be-407a-b5fc-4a54984d445c could not be found. Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4a5f35aa-88f2-4dae-ad69-37a7b4f68a1e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Request method failure captured: Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c HTTP/1.1 Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLLstMFexBVKeRZfAj4OCdRv2YehxcaQe5WSbFwzJkUkY6SJnjfDm2dxiLn9eYpnR--tUOvl2KLmN3ree44KRlI2zh3Ld-tMuW3Hl-usm_NfJhejqaTW-3Rn2txi7roIax1gqv6lgH4fxV8-FpQFyIdTw_tVXsZtCYad971Mm27pxUg Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_be6e417773094ab08c170ca4b69f3742", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestVolumeBootPattern-451663755 Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a27b050389ad48089e214ad65eaa83bb Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 7f5e80ae-43be-407a-b5fc-4a54984d445c could not be found. Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '7f5e80ae-43be-407a-b5fc-4a54984d445c'} Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f5e80ae-43be-407a-b5fc-4a54984d445c could not be found. Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f5e80ae-43be-407a-b5fc-4a54984d445c could not be found. Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:15:14.330100 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:15:14.338611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:15:14.338611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:15:14.338611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:15:14.338611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:15:14.338611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:15:14.338611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f5e80ae-43be-407a-b5fc-4a54984d445c could not be found. Oct 11 00:15:14.338611 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:15:14.338611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4a5f35aa-88f2-4dae-ad69-37a7b4f68a1e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Returning 404 to user: Instance 7f5e80ae-43be-407a-b5fc-4a54984d445c could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:15:14.338611 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4a5f35aa-88f2-4dae-ad69-37a7b4f68a1e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c" status: 404 len: 111 microversion: 2.1 time: 0.032474 Oct 11 00:15:14.338611 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3635/6898] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:15:14 2022] GET /compute/v2.1/servers/7f5e80ae-43be-407a-b5fc-4a54984d445c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 00:15:20.574534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-79c53ea7-662c-4fa0-bc6c-22b5a0c67b6e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:20.575710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-79c53ea7-662c-4fa0-bc6c-22b5a0c67b6e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:20.584025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79c53ea7-662c-4fa0-bc6c-22b5a0c67b6e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:20.585085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79c53ea7-662c-4fa0-bc6c-22b5a0c67b6e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:20.585738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79c53ea7-662c-4fa0-bc6c-22b5a0c67b6e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:20.586639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79c53ea7-662c-4fa0-bc6c-22b5a0c67b6e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:20.587264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79c53ea7-662c-4fa0-bc6c-22b5a0c67b6e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:20.587861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-79c53ea7-662c-4fa0-bc6c-22b5a0c67b6e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:20.617947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-79c53ea7-662c-4fa0-bc6c-22b5a0c67b6e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:15:20.700048 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-79c53ea7-662c-4fa0-bc6c-22b5a0c67b6e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 204 len: 0 microversion: 2.1 time: 0.129538 Oct 11 00:15:20.700648 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3636/6899] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:15:20 2022] DELETE /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 00:15:20.705943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-f7250a61-fb56-4608-b50e-355a0f3d8754 req-e1e60b15-02ca-4d17-a795-a67cae1ab254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02a8dae0-751a-4730-8e02-f9e02fef44d5", "tag": "f3a172dc-ba55-4d82-a42a-3379941c30be"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:15:20.716956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f7250a61-fb56-4608-b50e-355a0f3d8754 req-e1e60b15-02ca-4d17-a795-a67cae1ab254 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:20.717493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f7250a61-fb56-4608-b50e-355a0f3d8754 req-e1e60b15-02ca-4d17-a795-a67cae1ab254 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:20.717955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f7250a61-fb56-4608-b50e-355a0f3d8754 req-e1e60b15-02ca-4d17-a795-a67cae1ab254 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:20.731488 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-f7250a61-fb56-4608-b50e-355a0f3d8754 req-e1e60b15-02ca-4d17-a795-a67cae1ab254 service nova] Creating event network-changed:f3a172dc-ba55-4d82-a42a-3379941c30be for instance 02a8dae0-751a-4730-8e02-f9e02fef44d5 on n-h1-860864-2 Oct 11 00:15:20.736912 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-f7250a61-fb56-4608-b50e-355a0f3d8754 req-e1e60b15-02ca-4d17-a795-a67cae1ab254 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034840 Oct 11 00:15:20.738006 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3637/6900] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:15:20.744931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2a65d888-c302-48df-b027-719587b62204 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:20.745165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2a65d888-c302-48df-b027-719587b62204 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:20.751875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a65d888-c302-48df-b027-719587b62204 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:20.752405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a65d888-c302-48df-b027-719587b62204 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:20.752872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a65d888-c302-48df-b027-719587b62204 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:20.755027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a65d888-c302-48df-b027-719587b62204 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:20.756050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a65d888-c302-48df-b027-719587b62204 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:20.756568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2a65d888-c302-48df-b027-719587b62204 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:20.906577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2a65d888-c302-48df-b027-719587b62204 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:15:20.915312 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2a65d888-c302-48df-b027-719587b62204 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1577 microversion: 2.1 time: 0.175974 Oct 11 00:15:20.916085 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3638/6901] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:15:20 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:15:21.939721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1fa92b40-8a89-4ef1-949e-cb956fb24bb0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:21.940492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1fa92b40-8a89-4ef1-949e-cb956fb24bb0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:21.948069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1fa92b40-8a89-4ef1-949e-cb956fb24bb0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:21.948573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1fa92b40-8a89-4ef1-949e-cb956fb24bb0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:21.949031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1fa92b40-8a89-4ef1-949e-cb956fb24bb0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:21.949779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1fa92b40-8a89-4ef1-949e-cb956fb24bb0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:21.950255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1fa92b40-8a89-4ef1-949e-cb956fb24bb0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:21.950699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1fa92b40-8a89-4ef1-949e-cb956fb24bb0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:22.119841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1fa92b40-8a89-4ef1-949e-cb956fb24bb0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:15:22.127811 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1fa92b40-8a89-4ef1-949e-cb956fb24bb0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1577 microversion: 2.1 time: 0.191977 Oct 11 00:15:22.128391 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3639/6902] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:15:21 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1577 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:15:22.773347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-a79e8e83-3188-41d1-9519-d03ee1b66c29 req-f30cfa17-8959-4f90-8050-23c308762892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02a8dae0-751a-4730-8e02-f9e02fef44d5", "name": "network-vif-deleted", "tag": "f3a172dc-ba55-4d82-a42a-3379941c30be"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:15:22.783071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a79e8e83-3188-41d1-9519-d03ee1b66c29 req-f30cfa17-8959-4f90-8050-23c308762892 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:22.783576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a79e8e83-3188-41d1-9519-d03ee1b66c29 req-f30cfa17-8959-4f90-8050-23c308762892 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:22.784025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a79e8e83-3188-41d1-9519-d03ee1b66c29 req-f30cfa17-8959-4f90-8050-23c308762892 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:22.795412 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a79e8e83-3188-41d1-9519-d03ee1b66c29 req-f30cfa17-8959-4f90-8050-23c308762892 service nova] Creating event network-vif-deleted:f3a172dc-ba55-4d82-a42a-3379941c30be for instance 02a8dae0-751a-4730-8e02-f9e02fef44d5 on n-h1-860864-2 Oct 11 00:15:22.800331 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-a79e8e83-3188-41d1-9519-d03ee1b66c29 req-f30cfa17-8959-4f90-8050-23c308762892 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031459 Oct 11 00:15:22.800931 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3640/6903] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:15:23.153188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f6a1c9b6-61c5-44c6-961c-ff6aee993325 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:23.154303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f6a1c9b6-61c5-44c6-961c-ff6aee993325 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:23.162519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6a1c9b6-61c5-44c6-961c-ff6aee993325 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:23.163390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6a1c9b6-61c5-44c6-961c-ff6aee993325 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:23.164093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6a1c9b6-61c5-44c6-961c-ff6aee993325 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:23.164912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6a1c9b6-61c5-44c6-961c-ff6aee993325 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:23.165816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6a1c9b6-61c5-44c6-961c-ff6aee993325 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:23.165941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f6a1c9b6-61c5-44c6-961c-ff6aee993325 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:23.236656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f6a1c9b6-61c5-44c6-961c-ff6aee993325 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:15:23.245336 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f6a1c9b6-61c5-44c6-961c-ff6aee993325 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1226 microversion: 2.1 time: 0.096542 Oct 11 00:15:23.246741 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3641/6904] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:15:23 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:15:24.270441 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-08e8b5dd-870d-4535-9418-19d93a9a5ae0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:24.271209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-08e8b5dd-870d-4535-9418-19d93a9a5ae0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:24.278275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08e8b5dd-870d-4535-9418-19d93a9a5ae0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:24.278782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08e8b5dd-870d-4535-9418-19d93a9a5ae0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:24.279232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08e8b5dd-870d-4535-9418-19d93a9a5ae0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:24.279950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08e8b5dd-870d-4535-9418-19d93a9a5ae0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:24.280422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08e8b5dd-870d-4535-9418-19d93a9a5ae0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:24.280864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-08e8b5dd-870d-4535-9418-19d93a9a5ae0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:24.299772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:15:24.346277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-08e8b5dd-870d-4535-9418-19d93a9a5ae0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:15:24.354573 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-08e8b5dd-870d-4535-9418-19d93a9a5ae0 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1226 microversion: 2.1 time: 0.088635 Oct 11 00:15:24.355145 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3642/6905] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:15:24 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:15:25.378182 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-91c68231-0cd5-4226-809f-b5efcc37fb06 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:25.378833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-91c68231-0cd5-4226-809f-b5efcc37fb06 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:25.386080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91c68231-0cd5-4226-809f-b5efcc37fb06 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:25.386584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91c68231-0cd5-4226-809f-b5efcc37fb06 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:25.387036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91c68231-0cd5-4226-809f-b5efcc37fb06 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:25.387751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91c68231-0cd5-4226-809f-b5efcc37fb06 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:25.388220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91c68231-0cd5-4226-809f-b5efcc37fb06 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:25.388661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91c68231-0cd5-4226-809f-b5efcc37fb06 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:25.453778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-91c68231-0cd5-4226-809f-b5efcc37fb06 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:15:25.462741 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-91c68231-0cd5-4226-809f-b5efcc37fb06 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1226 microversion: 2.1 time: 0.088398 Oct 11 00:15:25.463313 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3643/6906] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:15:25 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:15:26.486149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9225a72d-40f8-463d-ae4f-383545872232 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:26.486792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9225a72d-40f8-463d-ae4f-383545872232 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:26.494499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9225a72d-40f8-463d-ae4f-383545872232 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:26.495010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9225a72d-40f8-463d-ae4f-383545872232 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:26.495468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9225a72d-40f8-463d-ae4f-383545872232 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:26.496193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9225a72d-40f8-463d-ae4f-383545872232 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:26.496669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9225a72d-40f8-463d-ae4f-383545872232 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:26.497116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9225a72d-40f8-463d-ae4f-383545872232 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:26.563400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9225a72d-40f8-463d-ae4f-383545872232 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27b050389ad48089e214ad65eaa83bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be6e417773094ab08c170ca4b69f3742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:15:26.571815 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9225a72d-40f8-463d-ae4f-383545872232 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 200 len: 1226 microversion: 2.1 time: 0.089583 Oct 11 00:15:26.572600 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3644/6907] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:15:26 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:15:27.595381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-05a1b2a9-52aa-466b-89b3-f148288a994e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:27.596009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-05a1b2a9-52aa-466b-89b3-f148288a994e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: 02a8dae0-751a-4730-8e02-f9e02fef44d5] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:27.604031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05a1b2a9-52aa-466b-89b3-f148288a994e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:27.604529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05a1b2a9-52aa-466b-89b3-f148288a994e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:27.604979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05a1b2a9-52aa-466b-89b3-f148288a994e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:27.605723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05a1b2a9-52aa-466b-89b3-f148288a994e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:27.606194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05a1b2a9-52aa-466b-89b3-f148288a994e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:27.606637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05a1b2a9-52aa-466b-89b3-f148288a994e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:27.620500 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-05a1b2a9-52aa-466b-89b3-f148288a994e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] HTTP exception thrown: Instance 02a8dae0-751a-4730-8e02-f9e02fef44d5 could not be found. Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-05a1b2a9-52aa-466b-89b3-f148288a994e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Request method failure captured: Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 HTTP/1.1 Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLLstMFexBVKeRZfAj4OCdRv2YehxcaQe5WSbFwzJkUkY6SJnjfDm2dxiLn9eYpnR--tUOvl2KLmN3ree44KRlI2zh3Ld-tMuW3Hl-usm_NfJhejqaTW-3Rn2txi7roIax1gqv6lgH4fxV8-FpQFyIdTw_tVXsZtCYad971Mm27pxUg Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_be6e417773094ab08c170ca4b69f3742", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestVolumeBootPattern-451663755 Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a27b050389ad48089e214ad65eaa83bb Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 02a8dae0-751a-4730-8e02-f9e02fef44d5 could not be found. Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '02a8dae0-751a-4730-8e02-f9e02fef44d5'} Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02a8dae0-751a-4730-8e02-f9e02fef44d5 could not be found. Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02a8dae0-751a-4730-8e02-f9e02fef44d5 could not be found. Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:15:27.622193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:15:27.626344 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:15:27.626344 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:15:27.626344 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:15:27.626344 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:15:27.626344 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:15:27.626344 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02a8dae0-751a-4730-8e02-f9e02fef44d5 could not be found. Oct 11 00:15:27.626344 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:15:27.626344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-05a1b2a9-52aa-466b-89b3-f148288a994e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Returning 404 to user: Instance 02a8dae0-751a-4730-8e02-f9e02fef44d5 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:15:27.626344 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-05a1b2a9-52aa-466b-89b3-f148288a994e tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5" status: 404 len: 111 microversion: 2.1 time: 0.032234 Oct 11 00:15:27.626344 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3645/6908] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:15:27 2022] GET /compute/v2.1/servers/02a8dae0-751a-4730-8e02-f9e02fef44d5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 00:15:28.071100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-37e2878a-7ffb-4bc7-b4db-32c1b8c738b6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:28.071557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-37e2878a-7ffb-4bc7-b4db-32c1b8c738b6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:28.077672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37e2878a-7ffb-4bc7-b4db-32c1b8c738b6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:28.078174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37e2878a-7ffb-4bc7-b4db-32c1b8c738b6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:28.078634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37e2878a-7ffb-4bc7-b4db-32c1b8c738b6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:28.079343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37e2878a-7ffb-4bc7-b4db-32c1b8c738b6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:28.079818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37e2878a-7ffb-4bc7-b4db-32c1b8c738b6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:28.080298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37e2878a-7ffb-4bc7-b4db-32c1b8c738b6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:28.094319 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-37e2878a-7ffb-4bc7-b4db-32c1b8c738b6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] HTTP exception thrown: Instance ef051080-50b9-4445-a058-99cfd21e5096 could not be found. Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-37e2878a-7ffb-4bc7-b4db-32c1b8c738b6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Request method failure captured: Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 HTTP/1.1 Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLLstMFexBVKeRZfAj4OCdRv2YehxcaQe5WSbFwzJkUkY6SJnjfDm2dxiLn9eYpnR--tUOvl2KLmN3ree44KRlI2zh3Ld-tMuW3Hl-usm_NfJhejqaTW-3Rn2txi7roIax1gqv6lgH4fxV8-FpQFyIdTw_tVXsZtCYad971Mm27pxUg Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_be6e417773094ab08c170ca4b69f3742", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestVolumeBootPattern-451663755 Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a27b050389ad48089e214ad65eaa83bb Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance ef051080-50b9-4445-a058-99cfd21e5096 could not be found. Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'ef051080-50b9-4445-a058-99cfd21e5096'} Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef051080-50b9-4445-a058-99cfd21e5096 could not be found. Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:15:28.095891 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:15:28.100206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef051080-50b9-4445-a058-99cfd21e5096 could not be found. Oct 11 00:15:28.100206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:15:28.100206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:15:28.100206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:15:28.100206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:15:28.100206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:15:28.100206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:15:28.100206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:15:28.100206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:15:28.100206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef051080-50b9-4445-a058-99cfd21e5096 could not be found. Oct 11 00:15:28.100206 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:15:28.100206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-37e2878a-7ffb-4bc7-b4db-32c1b8c738b6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Returning 404 to user: Instance ef051080-50b9-4445-a058-99cfd21e5096 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:15:28.100206 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-37e2878a-7ffb-4bc7-b4db-32c1b8c738b6 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 404 len: 111 microversion: 2.1 time: 0.030861 Oct 11 00:15:28.100206 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3646/6909] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:15:28 2022] DELETE /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 00:15:28.105831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-436ebe1f-273f-4e40-a712-170a309bb710 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:28.106457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-436ebe1f-273f-4e40-a712-170a309bb710 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] [instance: ef051080-50b9-4445-a058-99cfd21e5096] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:28.112223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-436ebe1f-273f-4e40-a712-170a309bb710 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:28.112724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-436ebe1f-273f-4e40-a712-170a309bb710 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:28.113209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-436ebe1f-273f-4e40-a712-170a309bb710 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:28.113950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-436ebe1f-273f-4e40-a712-170a309bb710 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:28.114983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-436ebe1f-273f-4e40-a712-170a309bb710 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:28.115429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-436ebe1f-273f-4e40-a712-170a309bb710 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:28.132120 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-436ebe1f-273f-4e40-a712-170a309bb710 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] HTTP exception thrown: Instance ef051080-50b9-4445-a058-99cfd21e5096 could not be found. Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-436ebe1f-273f-4e40-a712-170a309bb710 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Request method failure captured: Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 HTTP/1.1 Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLLstMFexBVKeRZfAj4OCdRv2YehxcaQe5WSbFwzJkUkY6SJnjfDm2dxiLn9eYpnR--tUOvl2KLmN3ree44KRlI2zh3Ld-tMuW3Hl-usm_NfJhejqaTW-3Rn2txi7roIax1gqv6lgH4fxV8-FpQFyIdTw_tVXsZtCYad971Mm27pxUg Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_be6e417773094ab08c170ca4b69f3742", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestVolumeBootPattern-451663755 Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a27b050389ad48089e214ad65eaa83bb Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance ef051080-50b9-4445-a058-99cfd21e5096 could not be found. Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'ef051080-50b9-4445-a058-99cfd21e5096'} Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef051080-50b9-4445-a058-99cfd21e5096 could not be found. Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef051080-50b9-4445-a058-99cfd21e5096 could not be found. Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:15:28.133703 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:15:28.137971 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:15:28.137971 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:15:28.137971 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:15:28.137971 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:15:28.137971 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:15:28.137971 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef051080-50b9-4445-a058-99cfd21e5096 could not be found. Oct 11 00:15:28.137971 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:15:28.137971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-436ebe1f-273f-4e40-a712-170a309bb710 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Returning 404 to user: Instance ef051080-50b9-4445-a058-99cfd21e5096 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:15:28.137971 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-436ebe1f-273f-4e40-a712-170a309bb710 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096" status: 404 len: 111 microversion: 2.1 time: 0.032807 Oct 11 00:15:28.137971 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3647/6910] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:15:28 2022] GET /compute/v2.1/servers/ef051080-50b9-4445-a058-99cfd21e5096 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 00:15:31.568208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-40a47399-1b22-4f95-86a9-916dea524607 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Calling method '.version_select at 0x7f662b035940>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:31.597390 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-40a47399-1b22-4f95-86a9-916dea524607 tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1344377026" status: 202 len: 0 microversion: 2.1 time: 0.033084 Oct 11 00:15:31.598263 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3648/6911] 10.222.0.23 () {58 vars in 1263 bytes} [Tue Oct 11 00:15:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1344377026 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 00:15:50.275165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=20 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:15:50.276137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:15:50.396783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9e652d9a-d1ec-4c64-beec-4e09b5311d56 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-460928929", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:15:50.453152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-9e652d9a-d1ec-4c64-beec-4e09b5311d56 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] validate_networks() for None {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:15:50.654006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-9e652d9a-d1ec-4c64-beec-4e09b5311d56 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:15:50.654443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-9e652d9a-d1ec-4c64-beec-4e09b5311d56 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:15:50.654964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-9e652d9a-d1ec-4c64-beec-4e09b5311d56 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:15:50.655385 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-9e652d9a-d1ec-4c64-beec-4e09b5311d56 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:15:50.655807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-9e652d9a-d1ec-4c64-beec-4e09b5311d56 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:15:50.670576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e652d9a-d1ec-4c64-beec-4e09b5311d56 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:50.671072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e652d9a-d1ec-4c64-beec-4e09b5311d56 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:50.671520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e652d9a-d1ec-4c64-beec-4e09b5311d56 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:50.672258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e652d9a-d1ec-4c64-beec-4e09b5311d56 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:50.672724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e652d9a-d1ec-4c64-beec-4e09b5311d56 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:50.673195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e652d9a-d1ec-4c64-beec-4e09b5311d56 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:50.694988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-9e652d9a-d1ec-4c64-beec-4e09b5311d56 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Getting quotas for project 260931049a704ebd8c617b452a6e7719. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:15:50.700307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-9e652d9a-d1ec-4c64-beec-4e09b5311d56 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Getting quotas for user b71019a5215944d6bafc66647af0b35d and project 260931049a704ebd8c617b452a6e7719. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:15:50.713354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9e652d9a-d1ec-4c64-beec-4e09b5311d56 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:15:50.715675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9e652d9a-d1ec-4c64-beec-4e09b5311d56 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] [instance: fe0754f3-a19b-4f04-8079-f833b41c46e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:15:50.761995 n-d-860864-2 devstack@n-api.service[120613]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9e652d9a-d1ec-4c64-beec-4e09b5311d56 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] [445fe529-0216-4ae2-b3e3-f79e44970469] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 00:15:51.769708 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [None req-9e652d9a-d1ec-4c64-beec-4e09b5311d56 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] [445fe529-0216-4ae2-b3e3-f79e44970469] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 35782. Oct 11 00:15:51.774037 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9e652d9a-d1ec-4c64-beec-4e09b5311d56 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.500516 Oct 11 00:15:51.774700 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3649/6912] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:15:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 00:15:51.788083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1eb3f3ad-2fd1-4b0d-abae-ce807db817dd tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:51.788720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1eb3f3ad-2fd1-4b0d-abae-ce807db817dd tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] [instance: fe0754f3-a19b-4f04-8079-f833b41c46e9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:51.850324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1eb3f3ad-2fd1-4b0d-abae-ce807db817dd tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71019a5215944d6bafc66647af0b35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260931049a704ebd8c617b452a6e7719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:15:51.858355 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1eb3f3ad-2fd1-4b0d-abae-ce807db817dd tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] 10.222.0.23 "GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9" status: 200 len: 1221 microversion: 2.1 time: 0.074886 Oct 11 00:15:51.859007 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3650/6913] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:15:51 2022] GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9 => generated 1221 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:15:52.883546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-abc4e74c-759b-461c-bc2f-80359d986936 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:52.884185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-abc4e74c-759b-461c-bc2f-80359d986936 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] [instance: fe0754f3-a19b-4f04-8079-f833b41c46e9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:52.891296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abc4e74c-759b-461c-bc2f-80359d986936 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:52.891794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abc4e74c-759b-461c-bc2f-80359d986936 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:52.892248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abc4e74c-759b-461c-bc2f-80359d986936 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:52.892957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abc4e74c-759b-461c-bc2f-80359d986936 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:52.893468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abc4e74c-759b-461c-bc2f-80359d986936 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:52.893917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abc4e74c-759b-461c-bc2f-80359d986936 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:52.960279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-abc4e74c-759b-461c-bc2f-80359d986936 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71019a5215944d6bafc66647af0b35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260931049a704ebd8c617b452a6e7719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:15:52.968311 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-abc4e74c-759b-461c-bc2f-80359d986936 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] 10.222.0.23 "GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9" status: 200 len: 1225 microversion: 2.1 time: 0.089605 Oct 11 00:15:52.968895 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3651/6914] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:15:52 2022] GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:15:53.994347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8e77469d-b6fe-4dfb-946a-9024e96eebb1 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:53.995039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8e77469d-b6fe-4dfb-946a-9024e96eebb1 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] [instance: fe0754f3-a19b-4f04-8079-f833b41c46e9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:54.002296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e77469d-b6fe-4dfb-946a-9024e96eebb1 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:54.003017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e77469d-b6fe-4dfb-946a-9024e96eebb1 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:54.003674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e77469d-b6fe-4dfb-946a-9024e96eebb1 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:54.004398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e77469d-b6fe-4dfb-946a-9024e96eebb1 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:54.004868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e77469d-b6fe-4dfb-946a-9024e96eebb1 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:54.005844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e77469d-b6fe-4dfb-946a-9024e96eebb1 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:54.073224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8e77469d-b6fe-4dfb-946a-9024e96eebb1 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71019a5215944d6bafc66647af0b35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260931049a704ebd8c617b452a6e7719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:15:54.081034 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8e77469d-b6fe-4dfb-946a-9024e96eebb1 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] 10.222.0.23 "GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9" status: 200 len: 1279 microversion: 2.1 time: 0.091599 Oct 11 00:15:54.081625 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3652/6915] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:15:53 2022] GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9 => generated 1279 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:15:55.105935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6c085858-b1b6-4bd9-935d-2a3f85df7fac tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:55.106534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6c085858-b1b6-4bd9-935d-2a3f85df7fac tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] [instance: fe0754f3-a19b-4f04-8079-f833b41c46e9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:55.113302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c085858-b1b6-4bd9-935d-2a3f85df7fac tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:55.113830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c085858-b1b6-4bd9-935d-2a3f85df7fac tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:55.114283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c085858-b1b6-4bd9-935d-2a3f85df7fac tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:55.115643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c085858-b1b6-4bd9-935d-2a3f85df7fac tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:55.116111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c085858-b1b6-4bd9-935d-2a3f85df7fac tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:55.116556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c085858-b1b6-4bd9-935d-2a3f85df7fac tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:55.252009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6c085858-b1b6-4bd9-935d-2a3f85df7fac tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71019a5215944d6bafc66647af0b35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260931049a704ebd8c617b452a6e7719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:15:55.261782 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6c085858-b1b6-4bd9-935d-2a3f85df7fac tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] 10.222.0.23 "GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9" status: 200 len: 1321 microversion: 2.1 time: 0.159445 Oct 11 00:15:55.262604 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3653/6916] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:15:55 2022] GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:15:55.434984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-df11b9ba-1e07-4dd2-950b-f1a2ec7486cc req-bec59147-0ac6-4642-9eb4-2173da92e914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe0754f3-a19b-4f04-8079-f833b41c46e9", "tag": "0dd91b55-e062-485e-ac53-d6c2ba93c458"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:15:55.447775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-df11b9ba-1e07-4dd2-950b-f1a2ec7486cc req-bec59147-0ac6-4642-9eb4-2173da92e914 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:55.448572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-df11b9ba-1e07-4dd2-950b-f1a2ec7486cc req-bec59147-0ac6-4642-9eb4-2173da92e914 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:55.449028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-df11b9ba-1e07-4dd2-950b-f1a2ec7486cc req-bec59147-0ac6-4642-9eb4-2173da92e914 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:55.462166 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-df11b9ba-1e07-4dd2-950b-f1a2ec7486cc req-bec59147-0ac6-4642-9eb4-2173da92e914 service nova] Creating event network-changed:0dd91b55-e062-485e-ac53-d6c2ba93c458 for instance fe0754f3-a19b-4f04-8079-f833b41c46e9 on n-h1-860864-2 Oct 11 00:15:55.467152 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-df11b9ba-1e07-4dd2-950b-f1a2ec7486cc req-bec59147-0ac6-4642-9eb4-2173da92e914 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036758 Oct 11 00:15:55.467938 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3654/6917] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:15:56.288047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e590294e-6cf5-492c-beec-992cddf740c5 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:56.288790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e590294e-6cf5-492c-beec-992cddf740c5 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] [instance: fe0754f3-a19b-4f04-8079-f833b41c46e9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:56.295887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e590294e-6cf5-492c-beec-992cddf740c5 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:56.296390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e590294e-6cf5-492c-beec-992cddf740c5 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:56.296839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e590294e-6cf5-492c-beec-992cddf740c5 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:56.297583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e590294e-6cf5-492c-beec-992cddf740c5 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:56.298055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e590294e-6cf5-492c-beec-992cddf740c5 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:56.298496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e590294e-6cf5-492c-beec-992cddf740c5 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:56.435801 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e590294e-6cf5-492c-beec-992cddf740c5 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71019a5215944d6bafc66647af0b35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260931049a704ebd8c617b452a6e7719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:15:56.443757 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e590294e-6cf5-492c-beec-992cddf740c5 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] 10.222.0.23 "GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9" status: 200 len: 1321 microversion: 2.1 time: 0.160546 Oct 11 00:15:56.444335 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3655/6918] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:15:56 2022] GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:15:57.466198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b7df0626-aaba-469f-9fd4-130e0d8bed5b tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:57.466885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b7df0626-aaba-469f-9fd4-130e0d8bed5b tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] [instance: fe0754f3-a19b-4f04-8079-f833b41c46e9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:57.473686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7df0626-aaba-469f-9fd4-130e0d8bed5b tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:57.475383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7df0626-aaba-469f-9fd4-130e0d8bed5b tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:57.475818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7df0626-aaba-469f-9fd4-130e0d8bed5b tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:57.476532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7df0626-aaba-469f-9fd4-130e0d8bed5b tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:57.477010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7df0626-aaba-469f-9fd4-130e0d8bed5b tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:57.477477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7df0626-aaba-469f-9fd4-130e0d8bed5b tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:57.609860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b7df0626-aaba-469f-9fd4-130e0d8bed5b tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71019a5215944d6bafc66647af0b35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260931049a704ebd8c617b452a6e7719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:15:57.618087 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b7df0626-aaba-469f-9fd4-130e0d8bed5b tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] 10.222.0.23 "GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9" status: 200 len: 1321 microversion: 2.1 time: 0.155781 Oct 11 00:15:57.618687 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3656/6919] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:15:57 2022] GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:15:58.641094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e373ada4-47ee-4d2d-983b-2f16fb1dd6ad tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:58.641743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e373ada4-47ee-4d2d-983b-2f16fb1dd6ad tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] [instance: fe0754f3-a19b-4f04-8079-f833b41c46e9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:58.648837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e373ada4-47ee-4d2d-983b-2f16fb1dd6ad tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:58.649343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e373ada4-47ee-4d2d-983b-2f16fb1dd6ad tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:58.649830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e373ada4-47ee-4d2d-983b-2f16fb1dd6ad tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:58.650577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e373ada4-47ee-4d2d-983b-2f16fb1dd6ad tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:58.651054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e373ada4-47ee-4d2d-983b-2f16fb1dd6ad tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:58.651505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e373ada4-47ee-4d2d-983b-2f16fb1dd6ad tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:58.784549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e373ada4-47ee-4d2d-983b-2f16fb1dd6ad tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71019a5215944d6bafc66647af0b35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260931049a704ebd8c617b452a6e7719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:15:58.792966 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e373ada4-47ee-4d2d-983b-2f16fb1dd6ad tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] 10.222.0.23 "GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9" status: 200 len: 1321 microversion: 2.1 time: 0.155958 Oct 11 00:15:58.793569 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3657/6920] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:15:58 2022] GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:15:59.816380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-72d88686-bef2-4a4c-a797-e1081643bd92 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:15:59.818026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-72d88686-bef2-4a4c-a797-e1081643bd92 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] [instance: fe0754f3-a19b-4f04-8079-f833b41c46e9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:15:59.824838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72d88686-bef2-4a4c-a797-e1081643bd92 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:59.825448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72d88686-bef2-4a4c-a797-e1081643bd92 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:59.826084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72d88686-bef2-4a4c-a797-e1081643bd92 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:59.826819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72d88686-bef2-4a4c-a797-e1081643bd92 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:15:59.827655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72d88686-bef2-4a4c-a797-e1081643bd92 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:15:59.827787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72d88686-bef2-4a4c-a797-e1081643bd92 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:15:59.855794 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:15:59.856401 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:15:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 11 00:15:59.865571 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:15:59.865724 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:15:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 11 00:15:59.984881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-72d88686-bef2-4a4c-a797-e1081643bd92 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71019a5215944d6bafc66647af0b35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260931049a704ebd8c617b452a6e7719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:15:59.993501 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-72d88686-bef2-4a4c-a797-e1081643bd92 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] 10.222.0.23 "GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9" status: 200 len: 1321 microversion: 2.1 time: 0.181325 Oct 11 00:15:59.994087 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3658/6921] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:15:59 2022] GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:16:00.046994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-8b069c1b-6d11-4813-ba32-7845647ba866 req-4833aa84-ca59-46d3-8ac2-4cd3d2ae9d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe0754f3-a19b-4f04-8079-f833b41c46e9", "name": "network-vif-plugged", "status": "completed", "tag": "0dd91b55-e062-485e-ac53-d6c2ba93c458"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:16:00.057908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8b069c1b-6d11-4813-ba32-7845647ba866 req-4833aa84-ca59-46d3-8ac2-4cd3d2ae9d21 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:00.058400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8b069c1b-6d11-4813-ba32-7845647ba866 req-4833aa84-ca59-46d3-8ac2-4cd3d2ae9d21 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:00.058845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8b069c1b-6d11-4813-ba32-7845647ba866 req-4833aa84-ca59-46d3-8ac2-4cd3d2ae9d21 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:00.070100 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-8b069c1b-6d11-4813-ba32-7845647ba866 req-4833aa84-ca59-46d3-8ac2-4cd3d2ae9d21 service nova] Creating event network-vif-plugged:0dd91b55-e062-485e-ac53-d6c2ba93c458 for instance fe0754f3-a19b-4f04-8079-f833b41c46e9 on n-h1-860864-2 Oct 11 00:16:00.075047 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-8b069c1b-6d11-4813-ba32-7845647ba866 req-4833aa84-ca59-46d3-8ac2-4cd3d2ae9d21 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079854 Oct 11 00:16:00.075629 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3659/6922] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:16:01.013490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:16:01.018672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b032ac40-8d85-45d9-a140-5ca80abcc0b5 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:01.019385 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b032ac40-8d85-45d9-a140-5ca80abcc0b5 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] [instance: fe0754f3-a19b-4f04-8079-f833b41c46e9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:01.026021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b032ac40-8d85-45d9-a140-5ca80abcc0b5 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:01.026519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b032ac40-8d85-45d9-a140-5ca80abcc0b5 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:01.026970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b032ac40-8d85-45d9-a140-5ca80abcc0b5 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:01.027669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b032ac40-8d85-45d9-a140-5ca80abcc0b5 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:01.028137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b032ac40-8d85-45d9-a140-5ca80abcc0b5 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:01.028583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b032ac40-8d85-45d9-a140-5ca80abcc0b5 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:01.157519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b032ac40-8d85-45d9-a140-5ca80abcc0b5 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71019a5215944d6bafc66647af0b35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260931049a704ebd8c617b452a6e7719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:01.165591 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b032ac40-8d85-45d9-a140-5ca80abcc0b5 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] 10.222.0.23 "GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9" status: 200 len: 1321 microversion: 2.1 time: 0.153079 Oct 11 00:16:01.166160 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3660/6923] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:01 2022] GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:02.188849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0ebf3777-8cba-4f46-9bed-65bb2dad44aa tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:02.189518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0ebf3777-8cba-4f46-9bed-65bb2dad44aa tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] [instance: fe0754f3-a19b-4f04-8079-f833b41c46e9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:02.191415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:16:02.198620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ebf3777-8cba-4f46-9bed-65bb2dad44aa tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:02.199128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ebf3777-8cba-4f46-9bed-65bb2dad44aa tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:02.199586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ebf3777-8cba-4f46-9bed-65bb2dad44aa tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:02.200300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ebf3777-8cba-4f46-9bed-65bb2dad44aa tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:02.200774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ebf3777-8cba-4f46-9bed-65bb2dad44aa tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:02.201230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0ebf3777-8cba-4f46-9bed-65bb2dad44aa tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:02.338355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0ebf3777-8cba-4f46-9bed-65bb2dad44aa tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71019a5215944d6bafc66647af0b35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260931049a704ebd8c617b452a6e7719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:02.346252 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0ebf3777-8cba-4f46-9bed-65bb2dad44aa tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] 10.222.0.23 "GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9" status: 200 len: 1471 microversion: 2.1 time: 0.161491 Oct 11 00:16:02.346820 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3661/6924] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:02 2022] GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:02.417951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dc89178c-3438-4c96-a515-b8ae0531f123 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Calling method '.version_select at 0x7f662bdb7ca0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:02.481246 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dc89178c-3438-4c96-a515-b8ae0531f123 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/1f5de341a56e4c41825bcb9c191b8dff" status: 200 len: 371 microversion: 2.1 time: 0.114287 Oct 11 00:16:02.481862 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3662/6925] 10.222.0.23 () {58 vars in 1242 bytes} [Tue Oct 11 00:16:02 2022] GET /compute/v2.1/os-quota-sets/1f5de341a56e4c41825bcb9c191b8dff => generated 371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:16:02.494542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-12b95202-1314-4850-9123-036f80d4003d tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1086500731", "id": 1996505102, "os-flavor-access:is_public": "True"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:16:02.513413 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-12b95202-1314-4850-9123-036f80d4003d tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.023505 Oct 11 00:16:02.514000 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3663/6926] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:16:02 2022] POST /compute/v2.1/flavors => generated 438 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:16:02.526060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6bb0acd0-707f-478b-badd-b615e230e86e tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1996505102"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:16:02.528286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6bb0acd0-707f-478b-badd-b615e230e86e tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] [instance: fe0754f3-a19b-4f04-8079-f833b41c46e9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:02.534175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bb0acd0-707f-478b-badd-b615e230e86e tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:02.534685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bb0acd0-707f-478b-badd-b615e230e86e tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:02.535144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bb0acd0-707f-478b-badd-b615e230e86e tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:02.535861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bb0acd0-707f-478b-badd-b615e230e86e tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:02.536338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bb0acd0-707f-478b-badd-b615e230e86e tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:02.536788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bb0acd0-707f-478b-badd-b615e230e86e tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:02.724065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6bb0acd0-707f-478b-badd-b615e230e86e tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '259482a7175249e8a52e410c2aa28ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f5de341a56e4c41825bcb9c191b8dff', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:02.730448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6bb0acd0-707f-478b-badd-b615e230e86e tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] [instance: fe0754f3-a19b-4f04-8079-f833b41c46e9] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1086500731 {{(pid=120613) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 00:16:02.737771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bb0acd0-707f-478b-badd-b615e230e86e tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:02.738273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bb0acd0-707f-478b-badd-b615e230e86e tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:02.738729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bb0acd0-707f-478b-badd-b615e230e86e tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:02.739480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bb0acd0-707f-478b-badd-b615e230e86e tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:02.740532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bb0acd0-707f-478b-badd-b615e230e86e tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:02.741007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bb0acd0-707f-478b-badd-b615e230e86e tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:02.762960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-6bb0acd0-707f-478b-badd-b615e230e86e tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Getting quotas for project 260931049a704ebd8c617b452a6e7719. Resources: {'cores', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:16:02.768010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-6bb0acd0-707f-478b-badd-b615e230e86e tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Getting quotas for user b71019a5215944d6bafc66647af0b35d and project 260931049a704ebd8c617b452a6e7719. Resources: {'cores', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:16:02.780361 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.compute.api [None req-6bb0acd0-707f-478b-badd-b615e230e86e tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] ram quota exceeded for 1f5de341a56e4c41825bcb9c191b8dff, tried to resize instance. Oct 11 00:16:02.780922 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-6bb0acd0-707f-478b-badd-b615e230e86e tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6bb0acd0-707f-478b-badd-b615e230e86e tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Request method failure captured: Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9/action HTTP/1.1 Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 39 Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLW20qgLf--oP0N1MFKwbQb_keQMF1rijQWhR6xAI4zZjqKLUTZ7VFKubEJfyCILS1dDju3kbb4cSqFcyc631zZQqt4oDKGVvnoMyTk0VtB9ANNN0m4dUO0k0rRuTDReG7lF58yDnZdgmo6IufkkdXasxtv_LDdJ1KyP6IE_kSz-zNE Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 1f5de341a56e4c41825bcb9c191b8dff Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1362946341 Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: X-Role: admin,member,reader Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: admin,member,reader Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1f5de341a56e4c41825bcb9c191b8dff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f5de341a56e4c41825bcb9c191b8dff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f5de341a56e4c41825bcb9c191b8dff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1f5de341a56e4c41825bcb9c191b8dff", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1362946341 Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 1f5de341a56e4c41825bcb9c191b8dff Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1362946341 Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersAdminNegativeTestJSON-1362946341-project-admin Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 259482a7175249e8a52e410c2aa28ce6 Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1362946341-project-admin Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: {"resize": {"flavorRef": "1996505102"}} Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'fe0754f3-a19b-4f04-8079-f833b41c46e9', 'body': {'resize': {'flavorRef': '1996505102'}}} Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 00:16:02.783109 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6bb0acd0-707f-478b-badd-b615e230e86e tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6bb0acd0-707f-478b-badd-b615e230e86e tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9/action" status: 403 len: 118 microversion: 2.1 time: 0.262157 Oct 11 00:16:02.787573 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3664/6927] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:16:02 2022] POST /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9/action => generated 118 bytes in 263 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:16:02.793449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8bf23f8e-d495-46c2-a40d-52c345b006b1 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:02.810769 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8bf23f8e-d495-46c2-a40d-52c345b006b1 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1996505102" status: 202 len: 0 microversion: 2.1 time: 0.020745 Oct 11 00:16:02.811335 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3665/6928] 10.222.0.23 () {58 vars in 1161 bytes} [Tue Oct 11 00:16:02 2022] DELETE /compute/v2.1/flavors/1996505102 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 00:16:02.819703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8dea103b-9fbc-41a6-b5ac-500789d79b15 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:02.839610 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8dea103b-9fbc-41a6-b5ac-500789d79b15 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023979 Oct 11 00:16:02.840189 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3666/6929] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 11 00:16:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:02.860168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5ad9c9f6-b73b-41fc-8ab6-3da485048f8d tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Calling method '.version_select at 0x7f662ad33550>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:02.924379 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5ad9c9f6-b73b-41fc-8ab6-3da485048f8d tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/1f5de341a56e4c41825bcb9c191b8dff" status: 200 len: 371 microversion: 2.1 time: 0.067550 Oct 11 00:16:02.924958 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3667/6930] 10.222.0.23 () {58 vars in 1242 bytes} [Tue Oct 11 00:16:02 2022] GET /compute/v2.1/os-quota-sets/1f5de341a56e4c41825bcb9c191b8dff => generated 371 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:16:02.937320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-87553531-6fb3-4b91-8420-eecf0b412f82 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-90423559", "id": 1719727431, "os-flavor-access:is_public": "True"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:16:02.956318 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-87553531-6fb3-4b91-8420-eecf0b412f82 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.022438 Oct 11 00:16:02.956815 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3668/6931] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:16:02 2022] POST /compute/v2.1/flavors => generated 435 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:16:02.969293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-eb8152ab-07b0-463b-b090-f4e9bb2db264 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1719727431"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:16:02.971523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-eb8152ab-07b0-463b-b090-f4e9bb2db264 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] [instance: fe0754f3-a19b-4f04-8079-f833b41c46e9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:02.978787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb8152ab-07b0-463b-b090-f4e9bb2db264 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:02.979280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb8152ab-07b0-463b-b090-f4e9bb2db264 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:02.979727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb8152ab-07b0-463b-b090-f4e9bb2db264 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:02.980427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb8152ab-07b0-463b-b090-f4e9bb2db264 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:02.980893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb8152ab-07b0-463b-b090-f4e9bb2db264 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:02.981332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb8152ab-07b0-463b-b090-f4e9bb2db264 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:03.009639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-eb8152ab-07b0-463b-b090-f4e9bb2db264 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '259482a7175249e8a52e410c2aa28ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f5de341a56e4c41825bcb9c191b8dff', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:03.015136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-eb8152ab-07b0-463b-b090-f4e9bb2db264 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] [instance: fe0754f3-a19b-4f04-8079-f833b41c46e9] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-90423559 {{(pid=120613) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 00:16:03.021930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb8152ab-07b0-463b-b090-f4e9bb2db264 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:03.022425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb8152ab-07b0-463b-b090-f4e9bb2db264 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:03.022873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb8152ab-07b0-463b-b090-f4e9bb2db264 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:03.023603 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb8152ab-07b0-463b-b090-f4e9bb2db264 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:03.024067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb8152ab-07b0-463b-b090-f4e9bb2db264 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:03.024500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eb8152ab-07b0-463b-b090-f4e9bb2db264 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:03.045018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-eb8152ab-07b0-463b-b090-f4e9bb2db264 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Getting quotas for project 260931049a704ebd8c617b452a6e7719. Resources: {'cores', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:16:03.050121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-eb8152ab-07b0-463b-b090-f4e9bb2db264 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Getting quotas for user b71019a5215944d6bafc66647af0b35d and project 260931049a704ebd8c617b452a6e7719. Resources: {'cores', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:16:03.062719 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.compute.api [None req-eb8152ab-07b0-463b-b090-f4e9bb2db264 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] cores quota exceeded for 1f5de341a56e4c41825bcb9c191b8dff, tried to resize instance. Oct 11 00:16:03.063266 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-eb8152ab-07b0-463b-b090-f4e9bb2db264 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-eb8152ab-07b0-463b-b090-f4e9bb2db264 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Request method failure captured: Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9/action HTTP/1.1 Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 39 Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLW20qgLf--oP0N1MFKwbQb_keQMF1rijQWhR6xAI4zZjqKLUTZ7VFKubEJfyCILS1dDju3kbb4cSqFcyc631zZQqt4oDKGVvnoMyTk0VtB9ANNN0m4dUO0k0rRuTDReG7lF58yDnZdgmo6IufkkdXasxtv_LDdJ1KyP6IE_kSz-zNE Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 1f5de341a56e4c41825bcb9c191b8dff Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1362946341 Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: X-Role: admin,member,reader Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: admin,member,reader Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1f5de341a56e4c41825bcb9c191b8dff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f5de341a56e4c41825bcb9c191b8dff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1f5de341a56e4c41825bcb9c191b8dff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1f5de341a56e4c41825bcb9c191b8dff", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1362946341 Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 1f5de341a56e4c41825bcb9c191b8dff Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1362946341 Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersAdminNegativeTestJSON-1362946341-project-admin Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 259482a7175249e8a52e410c2aa28ce6 Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1362946341-project-admin Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: {"resize": {"flavorRef": "1719727431"}} Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'fe0754f3-a19b-4f04-8079-f833b41c46e9', 'body': {'resize': {'flavorRef': '1719727431'}}} Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 00:16:03.065194 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-eb8152ab-07b0-463b-b090-f4e9bb2db264 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-eb8152ab-07b0-463b-b090-f4e9bb2db264 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9/action" status: 403 len: 113 microversion: 2.1 time: 0.101077 Oct 11 00:16:03.068868 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3669/6932] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:16:02 2022] POST /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9/action => generated 113 bytes in 102 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 11 00:16:03.075035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e615da4a-fba4-4be2-8f12-21508075ba8a tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:03.093276 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e615da4a-fba4-4be2-8f12-21508075ba8a tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1719727431" status: 202 len: 0 microversion: 2.1 time: 0.021584 Oct 11 00:16:03.093869 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3670/6933] 10.222.0.23 () {58 vars in 1161 bytes} [Tue Oct 11 00:16:03 2022] DELETE /compute/v2.1/flavors/1719727431 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 00:16:03.102313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3aa07b5f-5226-4a1a-aea8-1b592c881999 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:03.108117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:16:03.122729 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3aa07b5f-5226-4a1a-aea8-1b592c881999 tempest-ServersAdminNegativeTestJSON-1362946341 tempest-ServersAdminNegativeTestJSON-1362946341-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024712 Oct 11 00:16:03.123290 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3671/6934] 10.222.0.23 () {58 vars in 1146 bytes} [Tue Oct 11 00:16:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:03.144205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7fbf615b-ddb1-462f-8c66-9fcccc6a6a2c tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:03.144707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7fbf615b-ddb1-462f-8c66-9fcccc6a6a2c tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] [instance: fe0754f3-a19b-4f04-8079-f833b41c46e9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:03.152080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fbf615b-ddb1-462f-8c66-9fcccc6a6a2c tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:03.152575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fbf615b-ddb1-462f-8c66-9fcccc6a6a2c tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:03.153024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fbf615b-ddb1-462f-8c66-9fcccc6a6a2c tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:03.153750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fbf615b-ddb1-462f-8c66-9fcccc6a6a2c tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:03.154217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fbf615b-ddb1-462f-8c66-9fcccc6a6a2c tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:03.154657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fbf615b-ddb1-462f-8c66-9fcccc6a6a2c tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:03.181665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7fbf615b-ddb1-462f-8c66-9fcccc6a6a2c tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] [instance: fe0754f3-a19b-4f04-8079-f833b41c46e9] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:16:03.227552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:16:03.261279 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7fbf615b-ddb1-462f-8c66-9fcccc6a6a2c tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9" status: 204 len: 0 microversion: 2.1 time: 0.120686 Oct 11 00:16:03.262408 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3672/6935] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:16:03 2022] DELETE /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 00:16:03.272221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d17f03c0-bba6-4e8b-abd3-36eff67a3506 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:03.272966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d17f03c0-bba6-4e8b-abd3-36eff67a3506 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] [instance: fe0754f3-a19b-4f04-8079-f833b41c46e9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:03.278888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d17f03c0-bba6-4e8b-abd3-36eff67a3506 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:03.279383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d17f03c0-bba6-4e8b-abd3-36eff67a3506 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:03.279826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d17f03c0-bba6-4e8b-abd3-36eff67a3506 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:03.280526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d17f03c0-bba6-4e8b-abd3-36eff67a3506 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:03.280988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d17f03c0-bba6-4e8b-abd3-36eff67a3506 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:03.281462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d17f03c0-bba6-4e8b-abd3-36eff67a3506 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:03.416016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d17f03c0-bba6-4e8b-abd3-36eff67a3506 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71019a5215944d6bafc66647af0b35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260931049a704ebd8c617b452a6e7719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:03.423964 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d17f03c0-bba6-4e8b-abd3-36eff67a3506 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] 10.222.0.23 "GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9" status: 200 len: 1477 microversion: 2.1 time: 0.156764 Oct 11 00:16:03.424535 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3673/6936] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:03 2022] GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9 => generated 1477 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:16:04.449245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d3d28347-6e0c-490f-9b77-ba3530e4f957 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:04.450077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d3d28347-6e0c-490f-9b77-ba3530e4f957 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] [instance: fe0754f3-a19b-4f04-8079-f833b41c46e9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:04.457007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3d28347-6e0c-490f-9b77-ba3530e4f957 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:04.457542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3d28347-6e0c-490f-9b77-ba3530e4f957 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:04.457995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3d28347-6e0c-490f-9b77-ba3530e4f957 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:04.459490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3d28347-6e0c-490f-9b77-ba3530e4f957 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:04.459991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3d28347-6e0c-490f-9b77-ba3530e4f957 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:04.460436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3d28347-6e0c-490f-9b77-ba3530e4f957 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:04.594237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d3d28347-6e0c-490f-9b77-ba3530e4f957 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71019a5215944d6bafc66647af0b35d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260931049a704ebd8c617b452a6e7719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:04.602238 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d3d28347-6e0c-490f-9b77-ba3530e4f957 tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] 10.222.0.23 "GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9" status: 200 len: 1477 microversion: 2.1 time: 0.158039 Oct 11 00:16:04.602813 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3674/6937] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:04 2022] GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9 => generated 1477 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:05.152072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-a74445a0-5bf3-44c5-87f4-27dae93a9394 req-f0cadd4c-932a-4b78-a2e4-8494e832560c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe0754f3-a19b-4f04-8079-f833b41c46e9", "name": "network-vif-deleted", "tag": "0dd91b55-e062-485e-ac53-d6c2ba93c458"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:16:05.165062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a74445a0-5bf3-44c5-87f4-27dae93a9394 req-f0cadd4c-932a-4b78-a2e4-8494e832560c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:05.165684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a74445a0-5bf3-44c5-87f4-27dae93a9394 req-f0cadd4c-932a-4b78-a2e4-8494e832560c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:05.166184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a74445a0-5bf3-44c5-87f4-27dae93a9394 req-f0cadd4c-932a-4b78-a2e4-8494e832560c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:05.182083 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a74445a0-5bf3-44c5-87f4-27dae93a9394 req-f0cadd4c-932a-4b78-a2e4-8494e832560c service nova] Creating event network-vif-deleted:0dd91b55-e062-485e-ac53-d6c2ba93c458 for instance fe0754f3-a19b-4f04-8079-f833b41c46e9 on n-h1-860864-2 Oct 11 00:16:05.188860 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-a74445a0-5bf3-44c5-87f4-27dae93a9394 req-f0cadd4c-932a-4b78-a2e4-8494e832560c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040550 Oct 11 00:16:05.189996 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3675/6938] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:16:05.626771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c9cddc51-5058-4c3a-bffd-ec0a73cee1ef tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:05.628117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c9cddc51-5058-4c3a-bffd-ec0a73cee1ef tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] [instance: fe0754f3-a19b-4f04-8079-f833b41c46e9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:05.636746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9cddc51-5058-4c3a-bffd-ec0a73cee1ef tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:05.637349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9cddc51-5058-4c3a-bffd-ec0a73cee1ef tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:05.637831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9cddc51-5058-4c3a-bffd-ec0a73cee1ef tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:05.638561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9cddc51-5058-4c3a-bffd-ec0a73cee1ef tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:05.639506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9cddc51-5058-4c3a-bffd-ec0a73cee1ef tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:05.640100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9cddc51-5058-4c3a-bffd-ec0a73cee1ef tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:05.657000 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-c9cddc51-5058-4c3a-bffd-ec0a73cee1ef tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] HTTP exception thrown: Instance fe0754f3-a19b-4f04-8079-f833b41c46e9 could not be found. Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c9cddc51-5058-4c3a-bffd-ec0a73cee1ef tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Request method failure captured: Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9 HTTP/1.1 Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLW1QYw3CnHA2Q_AaAe99sNDV9bwPzRt3R6ZNbWqiTURHbEZN4naityzLgzYC6qu5xntzLYWiRIXGgHDmo4bu5koeOEtTPsGnUKsOa8WyxzaRksqx0YvIPMmEkliiQLQdTfIj6c9jJLHDGwuKOwqBohvYgJXu5f37Kz6af8ax9CZ-DE Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 260931049a704ebd8c617b452a6e7719 Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-386665239 Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/260931049a704ebd8c617b452a6e7719"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/260931049a704ebd8c617b452a6e7719"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/260931049a704ebd8c617b452a6e7719"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_260931049a704ebd8c617b452a6e7719", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersAdminNegativeTestJSON-386665239 Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 260931049a704ebd8c617b452a6e7719 Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-386665239 Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersAdminNegativeTestJSON-386665239-project Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: b71019a5215944d6bafc66647af0b35d Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersAdminNegativeTestJSON-386665239-project Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance fe0754f3-a19b-4f04-8079-f833b41c46e9 could not be found. Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'fe0754f3-a19b-4f04-8079-f833b41c46e9'} Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe0754f3-a19b-4f04-8079-f833b41c46e9 could not be found. Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe0754f3-a19b-4f04-8079-f833b41c46e9 could not be found. Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:05.658926 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:16:05.663400 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:05.663400 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:16:05.663400 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:16:05.663400 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:16:05.663400 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:16:05.663400 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:16:05.663400 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe0754f3-a19b-4f04-8079-f833b41c46e9 could not be found. Oct 11 00:16:05.663400 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:05.663400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c9cddc51-5058-4c3a-bffd-ec0a73cee1ef tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] Returning 404 to user: Instance fe0754f3-a19b-4f04-8079-f833b41c46e9 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:16:05.663400 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c9cddc51-5058-4c3a-bffd-ec0a73cee1ef tempest-ServersAdminNegativeTestJSON-386665239 tempest-ServersAdminNegativeTestJSON-386665239-project] 10.222.0.23 "GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9" status: 404 len: 111 microversion: 2.1 time: 0.038594 Oct 11 00:16:05.663400 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3676/6939] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:05 2022] GET /compute/v2.1/servers/fe0754f3-a19b-4f04-8079-f833b41c46e9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:16:11.994438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-974994d0-f5b0-4a08-a490-72ce3752a002 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1921556677", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "10db29e9-3737-4f30-92d0-e3af5d43c6dd"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:16:12.049692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-974994d0-f5b0-4a08-a490-72ce3752a002 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] validate_networks() for [('10db29e9-3737-4f30-92d0-e3af5d43c6dd', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:16:12.481757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-974994d0-f5b0-4a08-a490-72ce3752a002 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:16:12.482194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-974994d0-f5b0-4a08-a490-72ce3752a002 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:16:12.482685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-974994d0-f5b0-4a08-a490-72ce3752a002 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:16:12.483145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-974994d0-f5b0-4a08-a490-72ce3752a002 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:16:12.483601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-974994d0-f5b0-4a08-a490-72ce3752a002 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:16:12.493606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-974994d0-f5b0-4a08-a490-72ce3752a002 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:12.494107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-974994d0-f5b0-4a08-a490-72ce3752a002 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:12.494557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-974994d0-f5b0-4a08-a490-72ce3752a002 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:12.495298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-974994d0-f5b0-4a08-a490-72ce3752a002 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:12.495765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-974994d0-f5b0-4a08-a490-72ce3752a002 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:12.496208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-974994d0-f5b0-4a08-a490-72ce3752a002 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:12.514827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-974994d0-f5b0-4a08-a490-72ce3752a002 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Getting quotas for project 65410c1e930041169b1dc25c07280bc6. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:16:12.521143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-974994d0-f5b0-4a08-a490-72ce3752a002 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Getting quotas for user 854efec99b144187b79ebd4742522f13 and project 65410c1e930041169b1dc25c07280bc6. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:16:12.535077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-974994d0-f5b0-4a08-a490-72ce3752a002 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:16:12.538311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-974994d0-f5b0-4a08-a490-72ce3752a002 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:16:12.589466 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-974994d0-f5b0-4a08-a490-72ce3752a002 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.726374 Oct 11 00:16:12.590307 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3677/6940] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:16:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:16:12.602397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-24eb1e00-630a-4def-8fdf-ebba81a21810 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:12.603043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-24eb1e00-630a-4def-8fdf-ebba81a21810 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:12.659631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-24eb1e00-630a-4def-8fdf-ebba81a21810 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:12.667790 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-24eb1e00-630a-4def-8fdf-ebba81a21810 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1215 microversion: 2.1 time: 0.070239 Oct 11 00:16:12.681403 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3678/6941] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:12 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:13.693427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dccd9943-a2e1-440b-a51e-2d54d2ed9299 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:13.695193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dccd9943-a2e1-440b-a51e-2d54d2ed9299 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:13.710861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dccd9943-a2e1-440b-a51e-2d54d2ed9299 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:13.711519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dccd9943-a2e1-440b-a51e-2d54d2ed9299 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:13.712114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dccd9943-a2e1-440b-a51e-2d54d2ed9299 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:13.712952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dccd9943-a2e1-440b-a51e-2d54d2ed9299 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:13.718208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dccd9943-a2e1-440b-a51e-2d54d2ed9299 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:13.719022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dccd9943-a2e1-440b-a51e-2d54d2ed9299 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:13.843468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dccd9943-a2e1-440b-a51e-2d54d2ed9299 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:13.853919 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dccd9943-a2e1-440b-a51e-2d54d2ed9299 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1285 microversion: 2.1 time: 0.165342 Oct 11 00:16:13.856170 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3679/6942] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:13 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1285 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:16:14.879051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-42adee4e-a190-40a9-bd6a-f9fd663e8f01 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:14.879694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-42adee4e-a190-40a9-bd6a-f9fd663e8f01 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:14.888695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42adee4e-a190-40a9-bd6a-f9fd663e8f01 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:14.889367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42adee4e-a190-40a9-bd6a-f9fd663e8f01 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:14.890048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42adee4e-a190-40a9-bd6a-f9fd663e8f01 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:14.890775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42adee4e-a190-40a9-bd6a-f9fd663e8f01 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:14.891255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42adee4e-a190-40a9-bd6a-f9fd663e8f01 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:14.891777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42adee4e-a190-40a9-bd6a-f9fd663e8f01 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:15.041824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-42adee4e-a190-40a9-bd6a-f9fd663e8f01 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:15.052411 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-42adee4e-a190-40a9-bd6a-f9fd663e8f01 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1315 microversion: 2.1 time: 0.177029 Oct 11 00:16:15.053552 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3680/6943] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:14 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:15.097950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-f64af967-0813-4227-8401-ea311e1128b8 req-9c0afae3-1264-4881-a527-e1dfe0d60e91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21232408-94d1-42fa-8a6f-cea5ad2ee78b", "tag": "e06eec3c-7f0e-4ddc-9f5d-e7ae1a231f39"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:16:15.111290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f64af967-0813-4227-8401-ea311e1128b8 req-9c0afae3-1264-4881-a527-e1dfe0d60e91 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:15.111898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f64af967-0813-4227-8401-ea311e1128b8 req-9c0afae3-1264-4881-a527-e1dfe0d60e91 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:15.112435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f64af967-0813-4227-8401-ea311e1128b8 req-9c0afae3-1264-4881-a527-e1dfe0d60e91 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:15.125398 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-f64af967-0813-4227-8401-ea311e1128b8 req-9c0afae3-1264-4881-a527-e1dfe0d60e91 service nova] Creating event network-changed:e06eec3c-7f0e-4ddc-9f5d-e7ae1a231f39 for instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b on n-h1-860864-2 Oct 11 00:16:15.135452 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-f64af967-0813-4227-8401-ea311e1128b8 req-9c0afae3-1264-4881-a527-e1dfe0d60e91 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041736 Oct 11 00:16:15.136619 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3681/6944] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:16:16.079214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-243e7838-8dcc-49ba-a550-c3d8378511ac tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:16.079924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-243e7838-8dcc-49ba-a550-c3d8378511ac tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:16.086868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-243e7838-8dcc-49ba-a550-c3d8378511ac tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:16.087367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-243e7838-8dcc-49ba-a550-c3d8378511ac tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:16.087818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-243e7838-8dcc-49ba-a550-c3d8378511ac tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:16.088520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-243e7838-8dcc-49ba-a550-c3d8378511ac tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:16.088991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-243e7838-8dcc-49ba-a550-c3d8378511ac tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:16.089459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-243e7838-8dcc-49ba-a550-c3d8378511ac tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:16.222107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-243e7838-8dcc-49ba-a550-c3d8378511ac tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:16.230904 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-243e7838-8dcc-49ba-a550-c3d8378511ac tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1315 microversion: 2.1 time: 0.156716 Oct 11 00:16:16.231489 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3682/6945] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:16 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:17.253898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7b007645-d1ca-45f9-83b0-e803ccf568ed tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:17.254559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7b007645-d1ca-45f9-83b0-e803ccf568ed tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:17.262007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b007645-d1ca-45f9-83b0-e803ccf568ed tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:17.262503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b007645-d1ca-45f9-83b0-e803ccf568ed tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:17.262961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b007645-d1ca-45f9-83b0-e803ccf568ed tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:17.263653 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b007645-d1ca-45f9-83b0-e803ccf568ed tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:17.264117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b007645-d1ca-45f9-83b0-e803ccf568ed tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:17.264558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b007645-d1ca-45f9-83b0-e803ccf568ed tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:17.397752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7b007645-d1ca-45f9-83b0-e803ccf568ed tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:17.405475 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7b007645-d1ca-45f9-83b0-e803ccf568ed tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1315 microversion: 2.1 time: 0.155547 Oct 11 00:16:17.406053 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3683/6946] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:17 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:18.428541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ecdc6f1a-5635-4574-a013-a3c14d7cf149 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:18.429192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ecdc6f1a-5635-4574-a013-a3c14d7cf149 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:18.436095 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecdc6f1a-5635-4574-a013-a3c14d7cf149 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:18.436594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecdc6f1a-5635-4574-a013-a3c14d7cf149 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:18.437048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecdc6f1a-5635-4574-a013-a3c14d7cf149 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:18.437796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecdc6f1a-5635-4574-a013-a3c14d7cf149 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:18.438268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecdc6f1a-5635-4574-a013-a3c14d7cf149 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:18.438711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ecdc6f1a-5635-4574-a013-a3c14d7cf149 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:18.582329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ecdc6f1a-5635-4574-a013-a3c14d7cf149 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:18.591898 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ecdc6f1a-5635-4574-a013-a3c14d7cf149 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1315 microversion: 2.1 time: 0.167557 Oct 11 00:16:18.593635 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3684/6947] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:18 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:19.616082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fccfeaec-ef90-4f8c-ab45-b9918faab0dd tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:19.616711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fccfeaec-ef90-4f8c-ab45-b9918faab0dd tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:19.623707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fccfeaec-ef90-4f8c-ab45-b9918faab0dd tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:19.624224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fccfeaec-ef90-4f8c-ab45-b9918faab0dd tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:19.624651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fccfeaec-ef90-4f8c-ab45-b9918faab0dd tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:19.625355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fccfeaec-ef90-4f8c-ab45-b9918faab0dd tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:19.625843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fccfeaec-ef90-4f8c-ab45-b9918faab0dd tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:19.626282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fccfeaec-ef90-4f8c-ab45-b9918faab0dd tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:19.762921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fccfeaec-ef90-4f8c-ab45-b9918faab0dd tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:19.771271 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fccfeaec-ef90-4f8c-ab45-b9918faab0dd tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1315 microversion: 2.1 time: 0.159141 Oct 11 00:16:19.772257 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3685/6948] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:19 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:16:19.920392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-09e6c655-6582-4371-95bb-42b77ce2b7a6 req-b924e38e-05e8-4e5b-bcbf-f092c94b7440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21232408-94d1-42fa-8a6f-cea5ad2ee78b", "name": "network-vif-plugged", "status": "completed", "tag": "e06eec3c-7f0e-4ddc-9f5d-e7ae1a231f39"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:16:19.931137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-09e6c655-6582-4371-95bb-42b77ce2b7a6 req-b924e38e-05e8-4e5b-bcbf-f092c94b7440 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:19.931636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-09e6c655-6582-4371-95bb-42b77ce2b7a6 req-b924e38e-05e8-4e5b-bcbf-f092c94b7440 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:19.932081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-09e6c655-6582-4371-95bb-42b77ce2b7a6 req-b924e38e-05e8-4e5b-bcbf-f092c94b7440 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:19.943883 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-09e6c655-6582-4371-95bb-42b77ce2b7a6 req-b924e38e-05e8-4e5b-bcbf-f092c94b7440 service nova] Creating event network-vif-plugged:e06eec3c-7f0e-4ddc-9f5d-e7ae1a231f39 for instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b on n-h1-860864-2 Oct 11 00:16:19.948843 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-09e6c655-6582-4371-95bb-42b77ce2b7a6 req-b924e38e-05e8-4e5b-bcbf-f092c94b7440 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032215 Oct 11 00:16:19.949461 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3686/6949] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:16:20.796185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-da7b0c4f-ec32-4af1-b030-827df4c6390d tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:20.796949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-da7b0c4f-ec32-4af1-b030-827df4c6390d tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:20.805048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da7b0c4f-ec32-4af1-b030-827df4c6390d tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:20.805542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da7b0c4f-ec32-4af1-b030-827df4c6390d tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:20.806026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da7b0c4f-ec32-4af1-b030-827df4c6390d tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:20.806755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da7b0c4f-ec32-4af1-b030-827df4c6390d tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:20.807222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da7b0c4f-ec32-4af1-b030-827df4c6390d tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:20.807660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da7b0c4f-ec32-4af1-b030-827df4c6390d tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:20.952368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-da7b0c4f-ec32-4af1-b030-827df4c6390d tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:20.961708 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-da7b0c4f-ec32-4af1-b030-827df4c6390d tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1315 microversion: 2.1 time: 0.170692 Oct 11 00:16:20.962298 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3687/6950] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:20 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:21.985484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5acb200f-731c-456b-91fd-040e840c19d1 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:21.986118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5acb200f-731c-456b-91fd-040e840c19d1 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:21.994390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5acb200f-731c-456b-91fd-040e840c19d1 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:21.994898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5acb200f-731c-456b-91fd-040e840c19d1 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:21.995356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5acb200f-731c-456b-91fd-040e840c19d1 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:21.996106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5acb200f-731c-456b-91fd-040e840c19d1 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:21.996578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5acb200f-731c-456b-91fd-040e840c19d1 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:21.997021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5acb200f-731c-456b-91fd-040e840c19d1 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:22.134868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5acb200f-731c-456b-91fd-040e840c19d1 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:22.142790 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5acb200f-731c-456b-91fd-040e840c19d1 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1501 microversion: 2.1 time: 0.161382 Oct 11 00:16:22.143366 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3688/6951] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:21 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:16:22.166230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e05f4939-bf62-4ebb-be29-41341fc52adf tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:16:22.168454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e05f4939-bf62-4ebb-be29-41341fc52adf tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:22.175177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e05f4939-bf62-4ebb-be29-41341fc52adf tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:22.175777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e05f4939-bf62-4ebb-be29-41341fc52adf tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:22.176384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e05f4939-bf62-4ebb-be29-41341fc52adf tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:22.177303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e05f4939-bf62-4ebb-be29-41341fc52adf tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:22.178180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e05f4939-bf62-4ebb-be29-41341fc52adf tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:22.178723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e05f4939-bf62-4ebb-be29-41341fc52adf tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:22.256500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e05f4939-bf62-4ebb-be29-41341fc52adf tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:22.262094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e05f4939-bf62-4ebb-be29-41341fc52adf tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Old instance type m1.heat2, new instance type m1.heat {{(pid=120613) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 00:16:22.268521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e05f4939-bf62-4ebb-be29-41341fc52adf tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:16:22.268960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e05f4939-bf62-4ebb-be29-41341fc52adf tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:16:22.269483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e05f4939-bf62-4ebb-be29-41341fc52adf tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:16:22.269911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e05f4939-bf62-4ebb-be29-41341fc52adf tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:16:22.270883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e05f4939-bf62-4ebb-be29-41341fc52adf tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:16:22.378639 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e05f4939-bf62-4ebb-be29-41341fc52adf tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "POST /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b/action" status: 202 len: 0 microversion: 2.1 time: 0.216077 Oct 11 00:16:22.379440 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3689/6952] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:16:22 2022] POST /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 00:16:22.390284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-de0a847c-c593-49b9-8554-5ed7f890739e tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:22.391092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-de0a847c-c593-49b9-8554-5ed7f890739e tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:22.398028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de0a847c-c593-49b9-8554-5ed7f890739e tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:22.398552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de0a847c-c593-49b9-8554-5ed7f890739e tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:22.399009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de0a847c-c593-49b9-8554-5ed7f890739e tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:22.399735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de0a847c-c593-49b9-8554-5ed7f890739e tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:22.400212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de0a847c-c593-49b9-8554-5ed7f890739e tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:22.400946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de0a847c-c593-49b9-8554-5ed7f890739e tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:22.503047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:16:22.547510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-de0a847c-c593-49b9-8554-5ed7f890739e tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:22.556918 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-de0a847c-c593-49b9-8554-5ed7f890739e tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1510 microversion: 2.1 time: 0.170619 Oct 11 00:16:22.557734 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3690/6953] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:22 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:23.580039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-51697dc4-2c83-4855-adbb-bfbcac59feb3 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:23.580671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-51697dc4-2c83-4855-adbb-bfbcac59feb3 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:23.582808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=12 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:16:23.588930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51697dc4-2c83-4855-adbb-bfbcac59feb3 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:23.589468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51697dc4-2c83-4855-adbb-bfbcac59feb3 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:23.589932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51697dc4-2c83-4855-adbb-bfbcac59feb3 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:23.590651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51697dc4-2c83-4855-adbb-bfbcac59feb3 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:23.591128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51697dc4-2c83-4855-adbb-bfbcac59feb3 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:23.591574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51697dc4-2c83-4855-adbb-bfbcac59feb3 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:23.728750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-51697dc4-2c83-4855-adbb-bfbcac59feb3 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:23.736497 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-51697dc4-2c83-4855-adbb-bfbcac59feb3 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1510 microversion: 2.1 time: 0.160341 Oct 11 00:16:23.737072 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3691/6954] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:23 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:24.761840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-58f978be-7d6e-46b0-b9d7-d0ad365c815b tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:24.763156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-58f978be-7d6e-46b0-b9d7-d0ad365c815b tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:24.772737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58f978be-7d6e-46b0-b9d7-d0ad365c815b tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:24.773257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58f978be-7d6e-46b0-b9d7-d0ad365c815b tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:24.773748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58f978be-7d6e-46b0-b9d7-d0ad365c815b tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:24.774486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58f978be-7d6e-46b0-b9d7-d0ad365c815b tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:24.774960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58f978be-7d6e-46b0-b9d7-d0ad365c815b tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:24.775442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-58f978be-7d6e-46b0-b9d7-d0ad365c815b tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:24.780041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:16:24.923925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-58f978be-7d6e-46b0-b9d7-d0ad365c815b tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:24.933031 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-58f978be-7d6e-46b0-b9d7-d0ad365c815b tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1510 microversion: 2.1 time: 0.176730 Oct 11 00:16:24.933652 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3692/6955] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:24 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:25.957581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a99390a7-1fca-4730-9d93-86550d415ea0 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:25.958200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a99390a7-1fca-4730-9d93-86550d415ea0 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:25.965864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a99390a7-1fca-4730-9d93-86550d415ea0 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:25.966367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a99390a7-1fca-4730-9d93-86550d415ea0 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:25.966828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a99390a7-1fca-4730-9d93-86550d415ea0 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:25.967541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a99390a7-1fca-4730-9d93-86550d415ea0 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:25.968011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a99390a7-1fca-4730-9d93-86550d415ea0 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:25.968454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a99390a7-1fca-4730-9d93-86550d415ea0 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:26.101523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a99390a7-1fca-4730-9d93-86550d415ea0 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:26.109297 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a99390a7-1fca-4730-9d93-86550d415ea0 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1515 microversion: 2.1 time: 0.155650 Oct 11 00:16:26.109913 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3693/6956] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:25 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:27.132799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4e7cf3f6-37cc-45ac-9392-567dc2f7949f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:27.133497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4e7cf3f6-37cc-45ac-9392-567dc2f7949f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:27.140338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e7cf3f6-37cc-45ac-9392-567dc2f7949f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:27.140861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e7cf3f6-37cc-45ac-9392-567dc2f7949f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:27.141317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e7cf3f6-37cc-45ac-9392-567dc2f7949f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:27.142049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e7cf3f6-37cc-45ac-9392-567dc2f7949f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:27.142520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e7cf3f6-37cc-45ac-9392-567dc2f7949f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:27.142962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e7cf3f6-37cc-45ac-9392-567dc2f7949f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:27.276881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4e7cf3f6-37cc-45ac-9392-567dc2f7949f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:27.284563 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4e7cf3f6-37cc-45ac-9392-567dc2f7949f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1515 microversion: 2.1 time: 0.155834 Oct 11 00:16:27.285129 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3694/6957] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:27 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:28.308941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-29b9f5d8-862c-4d2a-84f1-4661bba96523 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:28.309618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-29b9f5d8-862c-4d2a-84f1-4661bba96523 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:28.316528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29b9f5d8-862c-4d2a-84f1-4661bba96523 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:28.317043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29b9f5d8-862c-4d2a-84f1-4661bba96523 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:28.317650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29b9f5d8-862c-4d2a-84f1-4661bba96523 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:28.318372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29b9f5d8-862c-4d2a-84f1-4661bba96523 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:28.319425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29b9f5d8-862c-4d2a-84f1-4661bba96523 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:28.319872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29b9f5d8-862c-4d2a-84f1-4661bba96523 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:28.456321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-29b9f5d8-862c-4d2a-84f1-4661bba96523 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:28.464935 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-29b9f5d8-862c-4d2a-84f1-4661bba96523 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1515 microversion: 2.1 time: 0.159825 Oct 11 00:16:28.465552 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3695/6958] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:28 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:29.488456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9f2a5e8e-5136-4b72-9851-ff7bac4d1310 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:29.489313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9f2a5e8e-5136-4b72-9851-ff7bac4d1310 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:29.496913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f2a5e8e-5136-4b72-9851-ff7bac4d1310 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:29.497419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f2a5e8e-5136-4b72-9851-ff7bac4d1310 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:29.497876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f2a5e8e-5136-4b72-9851-ff7bac4d1310 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:29.498581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f2a5e8e-5136-4b72-9851-ff7bac4d1310 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:29.499047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f2a5e8e-5136-4b72-9851-ff7bac4d1310 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:29.499484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f2a5e8e-5136-4b72-9851-ff7bac4d1310 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:29.635169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9f2a5e8e-5136-4b72-9851-ff7bac4d1310 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:29.643057 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9f2a5e8e-5136-4b72-9851-ff7bac4d1310 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1515 microversion: 2.1 time: 0.158574 Oct 11 00:16:29.643637 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3696/6959] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:29 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:16:30.666568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-584b92c9-78e0-4d0b-a858-d330d38bcd68 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:30.667244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-584b92c9-78e0-4d0b-a858-d330d38bcd68 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:30.674000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-584b92c9-78e0-4d0b-a858-d330d38bcd68 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:30.674497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-584b92c9-78e0-4d0b-a858-d330d38bcd68 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:30.674946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-584b92c9-78e0-4d0b-a858-d330d38bcd68 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:30.675644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-584b92c9-78e0-4d0b-a858-d330d38bcd68 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:30.676106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-584b92c9-78e0-4d0b-a858-d330d38bcd68 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:30.676544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-584b92c9-78e0-4d0b-a858-d330d38bcd68 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:30.815439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-584b92c9-78e0-4d0b-a858-d330d38bcd68 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:30.824384 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-584b92c9-78e0-4d0b-a858-d330d38bcd68 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1515 microversion: 2.1 time: 0.162684 Oct 11 00:16:30.824985 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3697/6960] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:30 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:31.847725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6ed10155-20e7-43d5-890a-a9af364e90f1 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:31.848342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6ed10155-20e7-43d5-890a-a9af364e90f1 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:31.858283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ed10155-20e7-43d5-890a-a9af364e90f1 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:31.858948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ed10155-20e7-43d5-890a-a9af364e90f1 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:31.859456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ed10155-20e7-43d5-890a-a9af364e90f1 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:31.860235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ed10155-20e7-43d5-890a-a9af364e90f1 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:31.860751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ed10155-20e7-43d5-890a-a9af364e90f1 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:31.861235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ed10155-20e7-43d5-890a-a9af364e90f1 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:31.993149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6ed10155-20e7-43d5-890a-a9af364e90f1 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:32.001057 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6ed10155-20e7-43d5-890a-a9af364e90f1 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1515 microversion: 2.1 time: 0.157248 Oct 11 00:16:32.001671 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3698/6961] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:31 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:33.024495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-98458a0c-bef0-42b9-91dd-0bc391ef16be tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:33.025160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-98458a0c-bef0-42b9-91dd-0bc391ef16be tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:33.032228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98458a0c-bef0-42b9-91dd-0bc391ef16be tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:33.032736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98458a0c-bef0-42b9-91dd-0bc391ef16be tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:33.033212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98458a0c-bef0-42b9-91dd-0bc391ef16be tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:33.033963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98458a0c-bef0-42b9-91dd-0bc391ef16be tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:33.034436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98458a0c-bef0-42b9-91dd-0bc391ef16be tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:33.034876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98458a0c-bef0-42b9-91dd-0bc391ef16be tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:33.180341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-98458a0c-bef0-42b9-91dd-0bc391ef16be tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:33.188276 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-98458a0c-bef0-42b9-91dd-0bc391ef16be tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1515 microversion: 2.1 time: 0.167962 Oct 11 00:16:33.189227 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3699/6962] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:33 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:34.212902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-21bc433c-07b1-4db4-91cb-24445b4238da tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:34.213585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-21bc433c-07b1-4db4-91cb-24445b4238da tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:34.216336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:16:34.222043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21bc433c-07b1-4db4-91cb-24445b4238da tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:34.222549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21bc433c-07b1-4db4-91cb-24445b4238da tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:34.223016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21bc433c-07b1-4db4-91cb-24445b4238da tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:34.223725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21bc433c-07b1-4db4-91cb-24445b4238da tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:34.224196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21bc433c-07b1-4db4-91cb-24445b4238da tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:34.225245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21bc433c-07b1-4db4-91cb-24445b4238da tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:34.356463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-21bc433c-07b1-4db4-91cb-24445b4238da tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:34.364266 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-21bc433c-07b1-4db4-91cb-24445b4238da tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1515 microversion: 2.1 time: 0.156204 Oct 11 00:16:34.364847 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3700/6963] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:34 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:35.386199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-98864e73-7054-4641-89de-9d62198176b2 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:35.386903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-98864e73-7054-4641-89de-9d62198176b2 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:35.393845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98864e73-7054-4641-89de-9d62198176b2 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:35.394337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98864e73-7054-4641-89de-9d62198176b2 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:35.394787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98864e73-7054-4641-89de-9d62198176b2 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:35.395490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98864e73-7054-4641-89de-9d62198176b2 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:35.395951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98864e73-7054-4641-89de-9d62198176b2 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:35.396388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98864e73-7054-4641-89de-9d62198176b2 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:35.528066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-98864e73-7054-4641-89de-9d62198176b2 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:35.535938 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-98864e73-7054-4641-89de-9d62198176b2 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1515 microversion: 2.1 time: 0.153627 Oct 11 00:16:35.536516 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3701/6964] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:35 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:36.561196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bf6863fd-d203-4c46-abb3-09af988e9d5a tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:36.561975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bf6863fd-d203-4c46-abb3-09af988e9d5a tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:36.569754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf6863fd-d203-4c46-abb3-09af988e9d5a tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:36.570254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf6863fd-d203-4c46-abb3-09af988e9d5a tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:36.570699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf6863fd-d203-4c46-abb3-09af988e9d5a tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:36.571406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf6863fd-d203-4c46-abb3-09af988e9d5a tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:36.571871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf6863fd-d203-4c46-abb3-09af988e9d5a tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:36.572307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf6863fd-d203-4c46-abb3-09af988e9d5a tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:36.715165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bf6863fd-d203-4c46-abb3-09af988e9d5a tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:36.723039 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bf6863fd-d203-4c46-abb3-09af988e9d5a tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1515 microversion: 2.1 time: 0.165759 Oct 11 00:16:36.723617 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3702/6965] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:36 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:37.746458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-98352688-e682-4a38-bcde-6859ac5355c6 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:37.747130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-98352688-e682-4a38-bcde-6859ac5355c6 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:37.756323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98352688-e682-4a38-bcde-6859ac5355c6 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:37.756824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98352688-e682-4a38-bcde-6859ac5355c6 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:37.757275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98352688-e682-4a38-bcde-6859ac5355c6 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:37.758024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98352688-e682-4a38-bcde-6859ac5355c6 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:37.758497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98352688-e682-4a38-bcde-6859ac5355c6 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:37.758940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-98352688-e682-4a38-bcde-6859ac5355c6 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:37.894510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-98352688-e682-4a38-bcde-6859ac5355c6 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:37.903012 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-98352688-e682-4a38-bcde-6859ac5355c6 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1515 microversion: 2.1 time: 0.160609 Oct 11 00:16:37.903597 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3703/6966] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:37 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:38.926646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-84650462-883a-4760-be7e-c124cc0421c7 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:38.927360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-84650462-883a-4760-be7e-c124cc0421c7 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:38.935528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84650462-883a-4760-be7e-c124cc0421c7 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:38.936071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84650462-883a-4760-be7e-c124cc0421c7 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:38.936531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84650462-883a-4760-be7e-c124cc0421c7 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:38.937247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84650462-883a-4760-be7e-c124cc0421c7 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:38.937748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84650462-883a-4760-be7e-c124cc0421c7 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:38.938196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84650462-883a-4760-be7e-c124cc0421c7 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:39.072459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-84650462-883a-4760-be7e-c124cc0421c7 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:39.080871 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-84650462-883a-4760-be7e-c124cc0421c7 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1515 microversion: 2.1 time: 0.158128 Oct 11 00:16:39.081464 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3704/6967] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:38 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:40.104821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7ad243eb-2745-4250-aab4-9997072ea15c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:40.105493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7ad243eb-2745-4250-aab4-9997072ea15c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:40.112215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ad243eb-2745-4250-aab4-9997072ea15c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:40.112712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ad243eb-2745-4250-aab4-9997072ea15c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:40.113192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ad243eb-2745-4250-aab4-9997072ea15c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:40.113943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ad243eb-2745-4250-aab4-9997072ea15c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:40.114445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ad243eb-2745-4250-aab4-9997072ea15c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:40.114890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ad243eb-2745-4250-aab4-9997072ea15c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:40.251061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7ad243eb-2745-4250-aab4-9997072ea15c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:40.259196 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7ad243eb-2745-4250-aab4-9997072ea15c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1515 microversion: 2.1 time: 0.158415 Oct 11 00:16:40.259785 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3705/6968] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:40 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:41.283330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0465f7fa-e52d-485a-abff-18b76f77e21c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:41.283982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0465f7fa-e52d-485a-abff-18b76f77e21c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:41.291265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0465f7fa-e52d-485a-abff-18b76f77e21c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:41.291776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0465f7fa-e52d-485a-abff-18b76f77e21c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:41.292236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0465f7fa-e52d-485a-abff-18b76f77e21c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:41.292961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0465f7fa-e52d-485a-abff-18b76f77e21c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:41.293468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0465f7fa-e52d-485a-abff-18b76f77e21c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:41.293936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0465f7fa-e52d-485a-abff-18b76f77e21c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:41.436040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0465f7fa-e52d-485a-abff-18b76f77e21c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:41.444851 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0465f7fa-e52d-485a-abff-18b76f77e21c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1515 microversion: 2.1 time: 0.165357 Oct 11 00:16:41.445466 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3706/6969] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:41 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:42.468794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c4dc9a9b-7f8d-4660-8f2f-4632915b89ad tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:42.469561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c4dc9a9b-7f8d-4660-8f2f-4632915b89ad tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:42.476267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4dc9a9b-7f8d-4660-8f2f-4632915b89ad tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:42.478028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4dc9a9b-7f8d-4660-8f2f-4632915b89ad tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:42.478484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4dc9a9b-7f8d-4660-8f2f-4632915b89ad tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:42.479193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4dc9a9b-7f8d-4660-8f2f-4632915b89ad tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:42.479661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4dc9a9b-7f8d-4660-8f2f-4632915b89ad tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:42.480107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c4dc9a9b-7f8d-4660-8f2f-4632915b89ad tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:42.615592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c4dc9a9b-7f8d-4660-8f2f-4632915b89ad tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:42.624133 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c4dc9a9b-7f8d-4660-8f2f-4632915b89ad tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1515 microversion: 2.1 time: 0.159159 Oct 11 00:16:42.624750 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3707/6970] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:42 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:43.652669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2499b374-c9e0-489e-a3e5-8db2f6f26725 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:43.653349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2499b374-c9e0-489e-a3e5-8db2f6f26725 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:43.660261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2499b374-c9e0-489e-a3e5-8db2f6f26725 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:43.660758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2499b374-c9e0-489e-a3e5-8db2f6f26725 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:43.661207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2499b374-c9e0-489e-a3e5-8db2f6f26725 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:43.661943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2499b374-c9e0-489e-a3e5-8db2f6f26725 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:43.662410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2499b374-c9e0-489e-a3e5-8db2f6f26725 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:43.662848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2499b374-c9e0-489e-a3e5-8db2f6f26725 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:43.799325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2499b374-c9e0-489e-a3e5-8db2f6f26725 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:43.803026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:16:43.808419 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2499b374-c9e0-489e-a3e5-8db2f6f26725 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1515 microversion: 2.1 time: 0.160375 Oct 11 00:16:43.808998 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3708/6971] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:43 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:44.832489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-69dc0b9c-66d6-4bbb-8db0-f1da28bec138 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:44.833158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-69dc0b9c-66d6-4bbb-8db0-f1da28bec138 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:44.840080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69dc0b9c-66d6-4bbb-8db0-f1da28bec138 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:44.840642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69dc0b9c-66d6-4bbb-8db0-f1da28bec138 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:44.841091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69dc0b9c-66d6-4bbb-8db0-f1da28bec138 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:44.841826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69dc0b9c-66d6-4bbb-8db0-f1da28bec138 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:44.842292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69dc0b9c-66d6-4bbb-8db0-f1da28bec138 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:44.842733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69dc0b9c-66d6-4bbb-8db0-f1da28bec138 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:44.983380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-69dc0b9c-66d6-4bbb-8db0-f1da28bec138 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:44.991293 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-69dc0b9c-66d6-4bbb-8db0-f1da28bec138 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1515 microversion: 2.1 time: 0.163409 Oct 11 00:16:44.995937 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3709/6972] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:44 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:46.016285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ba624616-168b-4b72-804f-81f669d8ba40 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:46.016913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ba624616-168b-4b72-804f-81f669d8ba40 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:46.023829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba624616-168b-4b72-804f-81f669d8ba40 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:46.024339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba624616-168b-4b72-804f-81f669d8ba40 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:46.024797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba624616-168b-4b72-804f-81f669d8ba40 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:46.025557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba624616-168b-4b72-804f-81f669d8ba40 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:46.026034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba624616-168b-4b72-804f-81f669d8ba40 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:46.026513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba624616-168b-4b72-804f-81f669d8ba40 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:46.160631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ba624616-168b-4b72-804f-81f669d8ba40 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:46.168722 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ba624616-168b-4b72-804f-81f669d8ba40 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1515 microversion: 2.1 time: 0.156381 Oct 11 00:16:46.169292 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3710/6973] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:46 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:47.192731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ccee5c26-9c0e-4fb2-8cb4-820dea046b5f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:47.193528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ccee5c26-9c0e-4fb2-8cb4-820dea046b5f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:47.203719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccee5c26-9c0e-4fb2-8cb4-820dea046b5f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:47.204419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccee5c26-9c0e-4fb2-8cb4-820dea046b5f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:47.204950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccee5c26-9c0e-4fb2-8cb4-820dea046b5f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:47.205912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccee5c26-9c0e-4fb2-8cb4-820dea046b5f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:47.206575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccee5c26-9c0e-4fb2-8cb4-820dea046b5f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:47.207114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccee5c26-9c0e-4fb2-8cb4-820dea046b5f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:47.356713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ccee5c26-9c0e-4fb2-8cb4-820dea046b5f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:47.364729 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ccee5c26-9c0e-4fb2-8cb4-820dea046b5f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1515 microversion: 2.1 time: 0.176245 Oct 11 00:16:47.365313 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3711/6974] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:47 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:16:48.389814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-141e3085-5a4d-4c12-abb6-659c91c1316c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:48.390684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-141e3085-5a4d-4c12-abb6-659c91c1316c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:48.400441 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-141e3085-5a4d-4c12-abb6-659c91c1316c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:48.401127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-141e3085-5a4d-4c12-abb6-659c91c1316c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:48.401597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-141e3085-5a4d-4c12-abb6-659c91c1316c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:48.402613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-141e3085-5a4d-4c12-abb6-659c91c1316c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:48.403247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-141e3085-5a4d-4c12-abb6-659c91c1316c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:48.403830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-141e3085-5a4d-4c12-abb6-659c91c1316c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:48.562041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-141e3085-5a4d-4c12-abb6-659c91c1316c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:48.570280 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-141e3085-5a4d-4c12-abb6-659c91c1316c tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1515 microversion: 2.1 time: 0.186437 Oct 11 00:16:48.570863 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3712/6975] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:48 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:49.594975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-db8e73b2-1f93-4e40-9a69-53c1ee0da779 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:49.595624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-db8e73b2-1f93-4e40-9a69-53c1ee0da779 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:49.602606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db8e73b2-1f93-4e40-9a69-53c1ee0da779 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:49.603740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db8e73b2-1f93-4e40-9a69-53c1ee0da779 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:49.604199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db8e73b2-1f93-4e40-9a69-53c1ee0da779 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:49.604918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db8e73b2-1f93-4e40-9a69-53c1ee0da779 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:49.605403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db8e73b2-1f93-4e40-9a69-53c1ee0da779 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:49.605846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-db8e73b2-1f93-4e40-9a69-53c1ee0da779 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:49.746294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-db8e73b2-1f93-4e40-9a69-53c1ee0da779 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:49.755276 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-db8e73b2-1f93-4e40-9a69-53c1ee0da779 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1515 microversion: 2.1 time: 0.164079 Oct 11 00:16:49.755927 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3713/6976] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:49 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:50.779842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-11da712e-0b51-4753-aa83-b4361798d611 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:50.780542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-11da712e-0b51-4753-aa83-b4361798d611 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:50.787665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11da712e-0b51-4753-aa83-b4361798d611 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:50.788160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11da712e-0b51-4753-aa83-b4361798d611 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:50.788611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11da712e-0b51-4753-aa83-b4361798d611 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:50.789329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11da712e-0b51-4753-aa83-b4361798d611 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:50.789825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11da712e-0b51-4753-aa83-b4361798d611 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:50.790274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11da712e-0b51-4753-aa83-b4361798d611 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:50.933573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-11da712e-0b51-4753-aa83-b4361798d611 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:50.941729 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-11da712e-0b51-4753-aa83-b4361798d611 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1515 microversion: 2.1 time: 0.166356 Oct 11 00:16:50.942309 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3714/6977] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:50 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:51.966764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-472b8bf7-00cb-4a77-af78-73798abd876b tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:51.967654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-472b8bf7-00cb-4a77-af78-73798abd876b tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:51.974560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-472b8bf7-00cb-4a77-af78-73798abd876b tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:51.975457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-472b8bf7-00cb-4a77-af78-73798abd876b tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:51.976285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-472b8bf7-00cb-4a77-af78-73798abd876b tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:51.977017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-472b8bf7-00cb-4a77-af78-73798abd876b tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:51.977592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-472b8bf7-00cb-4a77-af78-73798abd876b tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:51.978581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-472b8bf7-00cb-4a77-af78-73798abd876b tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:52.237304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-472b8bf7-00cb-4a77-af78-73798abd876b tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:52.246974 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-472b8bf7-00cb-4a77-af78-73798abd876b tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1515 microversion: 2.1 time: 0.284802 Oct 11 00:16:52.247662 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3715/6978] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:51 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1515 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:52.656933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-e3f91e6a-9842-4cbb-a6a2-7a12b4a88e19 req-7889659d-172c-48e9-8555-3bfd294e1303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21232408-94d1-42fa-8a6f-cea5ad2ee78b", "name": "network-vif-unplugged", "status": "completed", "tag": "e06eec3c-7f0e-4ddc-9f5d-e7ae1a231f39"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:16:52.668020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e3f91e6a-9842-4cbb-a6a2-7a12b4a88e19 req-7889659d-172c-48e9-8555-3bfd294e1303 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:52.668563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e3f91e6a-9842-4cbb-a6a2-7a12b4a88e19 req-7889659d-172c-48e9-8555-3bfd294e1303 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:52.669015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e3f91e6a-9842-4cbb-a6a2-7a12b4a88e19 req-7889659d-172c-48e9-8555-3bfd294e1303 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:52.682949 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-e3f91e6a-9842-4cbb-a6a2-7a12b4a88e19 req-7889659d-172c-48e9-8555-3bfd294e1303 service nova] Creating event network-vif-unplugged:e06eec3c-7f0e-4ddc-9f5d-e7ae1a231f39 for instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b on n-h2-860864-2 Oct 11 00:16:52.689535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-e3f91e6a-9842-4cbb-a6a2-7a12b4a88e19 req-7889659d-172c-48e9-8555-3bfd294e1303 service nova] Instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 00:16:52.708505 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-e3f91e6a-9842-4cbb-a6a2-7a12b4a88e19 req-7889659d-172c-48e9-8555-3bfd294e1303 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055711 Oct 11 00:16:52.709360 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3716/6979] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:16:53.275557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-00e03ac8-4d9f-4a8c-a514-99d8a0df7537 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:53.276391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-00e03ac8-4d9f-4a8c-a514-99d8a0df7537 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:53.282759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00e03ac8-4d9f-4a8c-a514-99d8a0df7537 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:53.283263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00e03ac8-4d9f-4a8c-a514-99d8a0df7537 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:53.283726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00e03ac8-4d9f-4a8c-a514-99d8a0df7537 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:53.284448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00e03ac8-4d9f-4a8c-a514-99d8a0df7537 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:53.284917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00e03ac8-4d9f-4a8c-a514-99d8a0df7537 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:53.286020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-00e03ac8-4d9f-4a8c-a514-99d8a0df7537 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:53.505129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-00e03ac8-4d9f-4a8c-a514-99d8a0df7537 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:53.513903 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-00e03ac8-4d9f-4a8c-a514-99d8a0df7537 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1514 microversion: 2.1 time: 0.243058 Oct 11 00:16:53.514484 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3717/6980] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:53 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1514 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:54.539710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8cd2ce06-893a-41f3-b4ec-a1cfb69b33ae tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:54.540392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8cd2ce06-893a-41f3-b4ec-a1cfb69b33ae tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:54.547529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8cd2ce06-893a-41f3-b4ec-a1cfb69b33ae tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:54.548037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8cd2ce06-893a-41f3-b4ec-a1cfb69b33ae tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:54.548496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8cd2ce06-893a-41f3-b4ec-a1cfb69b33ae tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:54.549214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8cd2ce06-893a-41f3-b4ec-a1cfb69b33ae tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:54.549728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8cd2ce06-893a-41f3-b4ec-a1cfb69b33ae tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:54.550178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8cd2ce06-893a-41f3-b4ec-a1cfb69b33ae tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:54.684835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8cd2ce06-893a-41f3-b4ec-a1cfb69b33ae tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:54.693414 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8cd2ce06-893a-41f3-b4ec-a1cfb69b33ae tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1512 microversion: 2.1 time: 0.157638 Oct 11 00:16:54.693996 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3718/6981] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:54 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:54.735122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-cc893f81-1149-4a75-8e4f-3f8db15a40ac req-0570780b-ecb9-445d-8b26-b3c753746c12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21232408-94d1-42fa-8a6f-cea5ad2ee78b", "tag": "e06eec3c-7f0e-4ddc-9f5d-e7ae1a231f39"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:16:54.744880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cc893f81-1149-4a75-8e4f-3f8db15a40ac req-0570780b-ecb9-445d-8b26-b3c753746c12 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:54.745391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cc893f81-1149-4a75-8e4f-3f8db15a40ac req-0570780b-ecb9-445d-8b26-b3c753746c12 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:54.745854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cc893f81-1149-4a75-8e4f-3f8db15a40ac req-0570780b-ecb9-445d-8b26-b3c753746c12 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:54.757672 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-cc893f81-1149-4a75-8e4f-3f8db15a40ac req-0570780b-ecb9-445d-8b26-b3c753746c12 service nova] Creating event network-changed:e06eec3c-7f0e-4ddc-9f5d-e7ae1a231f39 for instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b on n-h2-860864-2 Oct 11 00:16:54.763561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-cc893f81-1149-4a75-8e4f-3f8db15a40ac req-0570780b-ecb9-445d-8b26-b3c753746c12 service nova] Instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 00:16:54.774313 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-cc893f81-1149-4a75-8e4f-3f8db15a40ac req-0570780b-ecb9-445d-8b26-b3c753746c12 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042706 Oct 11 00:16:54.774928 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3719/6982] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:16:55.719728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-84430d12-34f6-44ac-8b8d-612c3efc5072 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:55.720431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-84430d12-34f6-44ac-8b8d-612c3efc5072 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:55.726635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84430d12-34f6-44ac-8b8d-612c3efc5072 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:55.727133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84430d12-34f6-44ac-8b8d-612c3efc5072 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:55.727579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84430d12-34f6-44ac-8b8d-612c3efc5072 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:55.728278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84430d12-34f6-44ac-8b8d-612c3efc5072 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:55.729344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84430d12-34f6-44ac-8b8d-612c3efc5072 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:55.729817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84430d12-34f6-44ac-8b8d-612c3efc5072 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:55.868724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-84430d12-34f6-44ac-8b8d-612c3efc5072 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:55.877578 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-84430d12-34f6-44ac-8b8d-612c3efc5072 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1509 microversion: 2.1 time: 0.162933 Oct 11 00:16:55.878167 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3720/6983] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:55 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:55.900679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-01264cc3-deba-47af-be74-dad72b4f8404 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:55.901305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-01264cc3-deba-47af-be74-dad72b4f8404 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:55.907340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01264cc3-deba-47af-be74-dad72b4f8404 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:55.907839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01264cc3-deba-47af-be74-dad72b4f8404 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:55.908291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01264cc3-deba-47af-be74-dad72b4f8404 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:55.908996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01264cc3-deba-47af-be74-dad72b4f8404 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:55.909483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01264cc3-deba-47af-be74-dad72b4f8404 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:55.909945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01264cc3-deba-47af-be74-dad72b4f8404 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:55.938913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-01264cc3-deba-47af-be74-dad72b4f8404 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:16:55.995175 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.compute.api [None req-01264cc3-deba-47af-be74-dad72b4f8404 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Found an unconfirmed migration during delete, id: 16, status: finished Oct 11 00:16:57.438835 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-01264cc3-deba-47af-be74-dad72b4f8404 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "DELETE /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 204 len: 0 microversion: 2.1 time: 1.541567 Oct 11 00:16:57.439713 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3721/6984] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:16:55 2022] DELETE /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 0 bytes in 1544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 00:16:57.452546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8b66527e-a8c8-454a-a72b-7c8aa12a3a6f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:57.453803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8b66527e-a8c8-454a-a72b-7c8aa12a3a6f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:57.459985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b66527e-a8c8-454a-a72b-7c8aa12a3a6f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:57.460492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b66527e-a8c8-454a-a72b-7c8aa12a3a6f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:57.460946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b66527e-a8c8-454a-a72b-7c8aa12a3a6f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:57.461694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b66527e-a8c8-454a-a72b-7c8aa12a3a6f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:57.462174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b66527e-a8c8-454a-a72b-7c8aa12a3a6f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:57.462651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b66527e-a8c8-454a-a72b-7c8aa12a3a6f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:57.597734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8b66527e-a8c8-454a-a72b-7c8aa12a3a6f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:57.606610 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8b66527e-a8c8-454a-a72b-7c8aa12a3a6f tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1501 microversion: 2.1 time: 0.160892 Oct 11 00:16:57.607218 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3722/6985] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:57 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:16:58.528342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-7403268f-d21d-409f-886d-a41efca446a7 req-52da5b86-174f-4365-87f9-09894bd3f85f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21232408-94d1-42fa-8a6f-cea5ad2ee78b", "name": "network-vif-plugged", "status": "completed", "tag": "e06eec3c-7f0e-4ddc-9f5d-e7ae1a231f39"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:16:58.540500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7403268f-d21d-409f-886d-a41efca446a7 req-52da5b86-174f-4365-87f9-09894bd3f85f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:58.541786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7403268f-d21d-409f-886d-a41efca446a7 req-52da5b86-174f-4365-87f9-09894bd3f85f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:58.542344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7403268f-d21d-409f-886d-a41efca446a7 req-52da5b86-174f-4365-87f9-09894bd3f85f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:58.555662 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-7403268f-d21d-409f-886d-a41efca446a7 req-52da5b86-174f-4365-87f9-09894bd3f85f service nova] Creating event network-vif-plugged:e06eec3c-7f0e-4ddc-9f5d-e7ae1a231f39 for instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b on n-h2-860864-2 Oct 11 00:16:58.563776 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-7403268f-d21d-409f-886d-a41efca446a7 req-52da5b86-174f-4365-87f9-09894bd3f85f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040310 Oct 11 00:16:58.564395 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3723/6986] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:16:58.638840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bae2a6ff-15f1-4e9b-9000-0aa9919a9ddc tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:58.639490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bae2a6ff-15f1-4e9b-9000-0aa9919a9ddc tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:58.646033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bae2a6ff-15f1-4e9b-9000-0aa9919a9ddc tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:58.646532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bae2a6ff-15f1-4e9b-9000-0aa9919a9ddc tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:58.646982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bae2a6ff-15f1-4e9b-9000-0aa9919a9ddc tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:58.647698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bae2a6ff-15f1-4e9b-9000-0aa9919a9ddc tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:58.648157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bae2a6ff-15f1-4e9b-9000-0aa9919a9ddc tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:58.648614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bae2a6ff-15f1-4e9b-9000-0aa9919a9ddc tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:58.667209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:16:58.792938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bae2a6ff-15f1-4e9b-9000-0aa9919a9ddc tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854efec99b144187b79ebd4742522f13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65410c1e930041169b1dc25c07280bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:16:58.801348 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bae2a6ff-15f1-4e9b-9000-0aa9919a9ddc tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 200 len: 1501 microversion: 2.1 time: 0.174027 Oct 11 00:16:58.801949 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3724/6987] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:58 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 1501 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:16:59.371009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-086df89d-10e6-49e4-a49a-f9e726c0a111 req-2dfa12bc-7caf-4abb-af02-89a7cb86e6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21232408-94d1-42fa-8a6f-cea5ad2ee78b", "name": "network-vif-deleted", "tag": "e06eec3c-7f0e-4ddc-9f5d-e7ae1a231f39"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:16:59.386384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-086df89d-10e6-49e4-a49a-f9e726c0a111 req-2dfa12bc-7caf-4abb-af02-89a7cb86e6d5 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:59.387209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-086df89d-10e6-49e4-a49a-f9e726c0a111 req-2dfa12bc-7caf-4abb-af02-89a7cb86e6d5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:59.387874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-086df89d-10e6-49e4-a49a-f9e726c0a111 req-2dfa12bc-7caf-4abb-af02-89a7cb86e6d5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:59.403993 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-086df89d-10e6-49e4-a49a-f9e726c0a111 req-2dfa12bc-7caf-4abb-af02-89a7cb86e6d5 service nova] Creating event network-vif-deleted:e06eec3c-7f0e-4ddc-9f5d-e7ae1a231f39 for instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b on n-h2-860864-2 Oct 11 00:16:59.412228 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-086df89d-10e6-49e4-a49a-f9e726c0a111 req-2dfa12bc-7caf-4abb-af02-89a7cb86e6d5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043797 Oct 11 00:16:59.414019 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3725/6988] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:16:59.827194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b8853fc3-5c59-4075-9072-5fb4dba0036a tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:59.828015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b8853fc3-5c59-4075-9072-5fb4dba0036a tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:59.834519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8853fc3-5c59-4075-9072-5fb4dba0036a tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:59.835039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8853fc3-5c59-4075-9072-5fb4dba0036a tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:59.835496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8853fc3-5c59-4075-9072-5fb4dba0036a tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:59.836220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8853fc3-5c59-4075-9072-5fb4dba0036a tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:59.836693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8853fc3-5c59-4075-9072-5fb4dba0036a tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:59.837139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8853fc3-5c59-4075-9072-5fb4dba0036a tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:59.851654 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-b8853fc3-5c59-4075-9072-5fb4dba0036a tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] HTTP exception thrown: Instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b could not be found. Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b8853fc3-5c59-4075-9072-5fb4dba0036a tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Request method failure captured: Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b HTTP/1.1 Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLXLtHCME3MwWQnYUMHyhbqJMZcWaruMBWIfmZU9ODmWE8beN4tEQfRqENVHDO61jtgyB2wqRVGAiKYRYhViR7FBcoZMl_yXJSeIdNnsasIBzAuDuJR8J2MjV-5pptKzhlucz7Heu76XMw0j6h-a-kw1q7D9evVY1kUuoZIfbZeL5wI Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 65410c1e930041169b1dc25c07280bc6 Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-DeleteServersTestJSON-776044557 Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/65410c1e930041169b1dc25c07280bc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65410c1e930041169b1dc25c07280bc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65410c1e930041169b1dc25c07280bc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_65410c1e930041169b1dc25c07280bc6", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-DeleteServersTestJSON-776044557 Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 65410c1e930041169b1dc25c07280bc6 Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-DeleteServersTestJSON-776044557 Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-DeleteServersTestJSON-776044557-project Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 854efec99b144187b79ebd4742522f13 Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-DeleteServersTestJSON-776044557-project Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b could not be found. Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '21232408-94d1-42fa-8a6f-cea5ad2ee78b'} Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b could not be found. Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b could not be found. Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:16:59.853452 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:59.858192 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:16:59.858192 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:16:59.858192 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:16:59.858192 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:16:59.858192 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:16:59.858192 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b could not be found. Oct 11 00:16:59.858192 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:59.858192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b8853fc3-5c59-4075-9072-5fb4dba0036a tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Returning 404 to user: Instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:16:59.858192 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b8853fc3-5c59-4075-9072-5fb4dba0036a tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 404 len: 111 microversion: 2.1 time: 0.033806 Oct 11 00:16:59.858192 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3726/6989] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:59 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 00:16:59.870070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bdb820fb-79af-47ed-ab6d-0f679e1f24f8 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:59.870590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bdb820fb-79af-47ed-ab6d-0f679e1f24f8 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:59.876618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdb820fb-79af-47ed-ab6d-0f679e1f24f8 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:59.877119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdb820fb-79af-47ed-ab6d-0f679e1f24f8 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:59.877606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdb820fb-79af-47ed-ab6d-0f679e1f24f8 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:59.878328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdb820fb-79af-47ed-ab6d-0f679e1f24f8 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:59.878796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdb820fb-79af-47ed-ab6d-0f679e1f24f8 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:59.879238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bdb820fb-79af-47ed-ab6d-0f679e1f24f8 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:59.893627 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-bdb820fb-79af-47ed-ab6d-0f679e1f24f8 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] HTTP exception thrown: Instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b could not be found. Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bdb820fb-79af-47ed-ab6d-0f679e1f24f8 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Request method failure captured: Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b HTTP/1.1 Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLXLtHCME3MwWQnYUMHyhbqJMZcWaruMBWIfmZU9ODmWE8beN4tEQfRqENVHDO61jtgyB2wqRVGAiKYRYhViR7FBcoZMl_yXJSeIdNnsasIBzAuDuJR8J2MjV-5pptKzhlucz7Heu76XMw0j6h-a-kw1q7D9evVY1kUuoZIfbZeL5wI Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 65410c1e930041169b1dc25c07280bc6 Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-DeleteServersTestJSON-776044557 Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/65410c1e930041169b1dc25c07280bc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65410c1e930041169b1dc25c07280bc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65410c1e930041169b1dc25c07280bc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_65410c1e930041169b1dc25c07280bc6", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-DeleteServersTestJSON-776044557 Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 65410c1e930041169b1dc25c07280bc6 Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-DeleteServersTestJSON-776044557 Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-DeleteServersTestJSON-776044557-project Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 854efec99b144187b79ebd4742522f13 Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-DeleteServersTestJSON-776044557-project Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b could not be found. Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '21232408-94d1-42fa-8a6f-cea5ad2ee78b'} Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b could not be found. Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:16:59.895197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:16:59.899755 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b could not be found. Oct 11 00:16:59.899755 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:59.899755 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:16:59.899755 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:59.899755 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:16:59.899755 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:16:59.899755 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:16:59.899755 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:16:59.899755 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:16:59.899755 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b could not be found. Oct 11 00:16:59.899755 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:59.899755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bdb820fb-79af-47ed-ab6d-0f679e1f24f8 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Returning 404 to user: Instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:16:59.899755 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bdb820fb-79af-47ed-ab6d-0f679e1f24f8 tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "DELETE /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 404 len: 111 microversion: 2.1 time: 0.030561 Oct 11 00:16:59.899755 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3727/6990] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:16:59 2022] DELETE /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 00:16:59.905606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f170e9e0-e9ec-4859-8ea2-245feb62e8bb tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:16:59.906225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f170e9e0-e9ec-4859-8ea2-245feb62e8bb tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] [instance: 21232408-94d1-42fa-8a6f-cea5ad2ee78b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:16:59.912093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f170e9e0-e9ec-4859-8ea2-245feb62e8bb tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:59.912595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f170e9e0-e9ec-4859-8ea2-245feb62e8bb tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:59.913077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f170e9e0-e9ec-4859-8ea2-245feb62e8bb tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:59.913819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f170e9e0-e9ec-4859-8ea2-245feb62e8bb tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:16:59.914525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f170e9e0-e9ec-4859-8ea2-245feb62e8bb tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:16:59.914977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f170e9e0-e9ec-4859-8ea2-245feb62e8bb tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:16:59.929111 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-f170e9e0-e9ec-4859-8ea2-245feb62e8bb tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] HTTP exception thrown: Instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b could not be found. Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f170e9e0-e9ec-4859-8ea2-245feb62e8bb tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Request method failure captured: Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b HTTP/1.1 Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLXLtHCME3MwWQnYUMHyhbqJMZcWaruMBWIfmZU9ODmWE8beN4tEQfRqENVHDO61jtgyB2wqRVGAiKYRYhViR7FBcoZMl_yXJSeIdNnsasIBzAuDuJR8J2MjV-5pptKzhlucz7Heu76XMw0j6h-a-kw1q7D9evVY1kUuoZIfbZeL5wI Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 65410c1e930041169b1dc25c07280bc6 Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-DeleteServersTestJSON-776044557 Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/65410c1e930041169b1dc25c07280bc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65410c1e930041169b1dc25c07280bc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/65410c1e930041169b1dc25c07280bc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_65410c1e930041169b1dc25c07280bc6", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-DeleteServersTestJSON-776044557 Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 65410c1e930041169b1dc25c07280bc6 Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-DeleteServersTestJSON-776044557 Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-DeleteServersTestJSON-776044557-project Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 854efec99b144187b79ebd4742522f13 Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-DeleteServersTestJSON-776044557-project Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b could not be found. Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '21232408-94d1-42fa-8a6f-cea5ad2ee78b'} Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b could not be found. Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b could not be found. Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:16:59.930697 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:59.935283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:16:59.935283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:16:59.935283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:16:59.935283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:16:59.935283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:16:59.935283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b could not be found. Oct 11 00:16:59.935283 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:16:59.935283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f170e9e0-e9ec-4859-8ea2-245feb62e8bb tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] Returning 404 to user: Instance 21232408-94d1-42fa-8a6f-cea5ad2ee78b could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:16:59.935283 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f170e9e0-e9ec-4859-8ea2-245feb62e8bb tempest-DeleteServersTestJSON-776044557 tempest-DeleteServersTestJSON-776044557-project] 10.222.0.23 "GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b" status: 404 len: 111 microversion: 2.1 time: 0.030116 Oct 11 00:16:59.935283 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3728/6991] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:16:59 2022] GET /compute/v2.1/servers/21232408-94d1-42fa-8a6f-cea5ad2ee78b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:17:08.720888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d43814fb-11e1-4bf2-9ab0-eddc2a7d3fe0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-422836158", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "b6d62dc6-fc1f-4355-b6b7-14f299b4a6f6"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:17:08.730000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:17:08.776318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-d43814fb-11e1-4bf2-9ab0-eddc2a7d3fe0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] validate_networks() for [('b6d62dc6-fc1f-4355-b6b7-14f299b4a6f6', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:17:09.257787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d43814fb-11e1-4bf2-9ab0-eddc2a7d3fe0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:17:09.258263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d43814fb-11e1-4bf2-9ab0-eddc2a7d3fe0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:17:09.258779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d43814fb-11e1-4bf2-9ab0-eddc2a7d3fe0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:17:09.259288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d43814fb-11e1-4bf2-9ab0-eddc2a7d3fe0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:17:09.259867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-d43814fb-11e1-4bf2-9ab0-eddc2a7d3fe0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:17:09.268727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d43814fb-11e1-4bf2-9ab0-eddc2a7d3fe0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:09.269222 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d43814fb-11e1-4bf2-9ab0-eddc2a7d3fe0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:09.269706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d43814fb-11e1-4bf2-9ab0-eddc2a7d3fe0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:09.270453 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d43814fb-11e1-4bf2-9ab0-eddc2a7d3fe0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:09.270921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d43814fb-11e1-4bf2-9ab0-eddc2a7d3fe0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:09.271363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d43814fb-11e1-4bf2-9ab0-eddc2a7d3fe0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:09.290049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-d43814fb-11e1-4bf2-9ab0-eddc2a7d3fe0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Getting quotas for project 85f5135a4e6c4e9d9cea62b8c1b23463. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:17:09.296750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-d43814fb-11e1-4bf2-9ab0-eddc2a7d3fe0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Getting quotas for user 736e28623d9d4d43b6ffb5ff8d53624d and project 85f5135a4e6c4e9d9cea62b8c1b23463. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:17:09.310386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d43814fb-11e1-4bf2-9ab0-eddc2a7d3fe0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:17:09.312768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d43814fb-11e1-4bf2-9ab0-eddc2a7d3fe0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:17:09.361041 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d43814fb-11e1-4bf2-9ab0-eddc2a7d3fe0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767838 Oct 11 00:17:09.361926 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3729/6992] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:17:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 00:17:09.373286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e86697d6-e855-4b87-8632-ae83ebd7b77f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:09.373962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e86697d6-e855-4b87-8632-ae83ebd7b77f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:09.433739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e86697d6-e855-4b87-8632-ae83ebd7b77f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:09.443349 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e86697d6-e855-4b87-8632-ae83ebd7b77f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1217 microversion: 2.1 time: 0.073869 Oct 11 00:17:09.459425 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3730/6993] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:09 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:10.469048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-99938c3d-06cb-4990-9572-10e054465523 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:10.470385 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-99938c3d-06cb-4990-9572-10e054465523 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:10.479214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99938c3d-06cb-4990-9572-10e054465523 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:10.479795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99938c3d-06cb-4990-9572-10e054465523 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:10.480257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99938c3d-06cb-4990-9572-10e054465523 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:10.481000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99938c3d-06cb-4990-9572-10e054465523 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:10.481527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99938c3d-06cb-4990-9572-10e054465523 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:10.481972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99938c3d-06cb-4990-9572-10e054465523 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:10.591584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-99938c3d-06cb-4990-9572-10e054465523 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:10.601737 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-99938c3d-06cb-4990-9572-10e054465523 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1277 microversion: 2.1 time: 0.137505 Oct 11 00:17:10.603624 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3731/6994] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:10 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1277 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:17:11.627155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cd970b66-35c6-4701-879f-993a3f3871a6 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:11.628426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cd970b66-35c6-4701-879f-993a3f3871a6 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:11.636959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd970b66-35c6-4701-879f-993a3f3871a6 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:11.637762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd970b66-35c6-4701-879f-993a3f3871a6 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:11.638364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd970b66-35c6-4701-879f-993a3f3871a6 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:11.639291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd970b66-35c6-4701-879f-993a3f3871a6 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:11.639946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd970b66-35c6-4701-879f-993a3f3871a6 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:11.643550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd970b66-35c6-4701-879f-993a3f3871a6 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:11.856774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cd970b66-35c6-4701-879f-993a3f3871a6 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:11.870868 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cd970b66-35c6-4701-879f-993a3f3871a6 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1317 microversion: 2.1 time: 0.246925 Oct 11 00:17:11.874066 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3732/6995] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:11 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:17:12.187255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-4b20d799-daa6-40a6-8eee-3b583ce6e231 req-b17fc5b6-2098-4654-a6b3-55643c5ba4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1353bbe9-3485-4c95-bd9b-c7560b6bab0d", "tag": "1ef9acc6-9016-4863-8f66-44835a266895"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:17:12.198285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4b20d799-daa6-40a6-8eee-3b583ce6e231 req-b17fc5b6-2098-4654-a6b3-55643c5ba4e8 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:12.198780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4b20d799-daa6-40a6-8eee-3b583ce6e231 req-b17fc5b6-2098-4654-a6b3-55643c5ba4e8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:12.199239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4b20d799-daa6-40a6-8eee-3b583ce6e231 req-b17fc5b6-2098-4654-a6b3-55643c5ba4e8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:12.215471 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-4b20d799-daa6-40a6-8eee-3b583ce6e231 req-b17fc5b6-2098-4654-a6b3-55643c5ba4e8 service nova] Creating event network-changed:1ef9acc6-9016-4863-8f66-44835a266895 for instance 1353bbe9-3485-4c95-bd9b-c7560b6bab0d on n-h2-860864-2 Oct 11 00:17:12.221457 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-4b20d799-daa6-40a6-8eee-3b583ce6e231 req-b17fc5b6-2098-4654-a6b3-55643c5ba4e8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037939 Oct 11 00:17:12.222087 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3733/6996] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:17:12.901646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-12eda2c2-cb73-486e-9b85-927620862127 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:12.903018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-12eda2c2-cb73-486e-9b85-927620862127 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:12.911269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12eda2c2-cb73-486e-9b85-927620862127 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:12.911771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12eda2c2-cb73-486e-9b85-927620862127 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:12.912229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12eda2c2-cb73-486e-9b85-927620862127 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:12.912968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12eda2c2-cb73-486e-9b85-927620862127 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:12.913499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12eda2c2-cb73-486e-9b85-927620862127 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:12.913973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12eda2c2-cb73-486e-9b85-927620862127 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:13.052963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-12eda2c2-cb73-486e-9b85-927620862127 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:13.061482 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-12eda2c2-cb73-486e-9b85-927620862127 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1317 microversion: 2.1 time: 0.168602 Oct 11 00:17:13.062068 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3734/6997] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:12 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:14.084307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-99bf90a8-d49d-4f56-b12e-098cb1471770 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:14.084952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-99bf90a8-d49d-4f56-b12e-098cb1471770 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:14.091947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99bf90a8-d49d-4f56-b12e-098cb1471770 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:14.092453 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99bf90a8-d49d-4f56-b12e-098cb1471770 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:14.092912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99bf90a8-d49d-4f56-b12e-098cb1471770 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:14.093658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99bf90a8-d49d-4f56-b12e-098cb1471770 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:14.094136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99bf90a8-d49d-4f56-b12e-098cb1471770 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:14.094583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-99bf90a8-d49d-4f56-b12e-098cb1471770 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:14.228955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-99bf90a8-d49d-4f56-b12e-098cb1471770 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:14.236475 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-99bf90a8-d49d-4f56-b12e-098cb1471770 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1317 microversion: 2.1 time: 0.156194 Oct 11 00:17:14.237048 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3735/6998] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:14 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:15.260931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4c9e3241-22dc-41db-9164-d35612c50378 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:15.261591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4c9e3241-22dc-41db-9164-d35612c50378 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:15.268306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c9e3241-22dc-41db-9164-d35612c50378 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:15.268805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c9e3241-22dc-41db-9164-d35612c50378 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:15.269251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c9e3241-22dc-41db-9164-d35612c50378 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:15.269987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c9e3241-22dc-41db-9164-d35612c50378 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:15.270453 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c9e3241-22dc-41db-9164-d35612c50378 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:15.270890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c9e3241-22dc-41db-9164-d35612c50378 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:15.401019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4c9e3241-22dc-41db-9164-d35612c50378 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:15.408786 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4c9e3241-22dc-41db-9164-d35612c50378 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1317 microversion: 2.1 time: 0.152787 Oct 11 00:17:15.409356 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3736/6999] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:15 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:16.433398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bf622969-61e4-47b5-a93f-720b5a3beb02 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:16.434081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bf622969-61e4-47b5-a93f-720b5a3beb02 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:16.441576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf622969-61e4-47b5-a93f-720b5a3beb02 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:16.442086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf622969-61e4-47b5-a93f-720b5a3beb02 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:16.442540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf622969-61e4-47b5-a93f-720b5a3beb02 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:16.443260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf622969-61e4-47b5-a93f-720b5a3beb02 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:16.443729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf622969-61e4-47b5-a93f-720b5a3beb02 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:16.444170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf622969-61e4-47b5-a93f-720b5a3beb02 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:16.585251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bf622969-61e4-47b5-a93f-720b5a3beb02 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:16.594312 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bf622969-61e4-47b5-a93f-720b5a3beb02 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1317 microversion: 2.1 time: 0.165607 Oct 11 00:17:16.594941 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3737/7000] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:16 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:16.600854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-006e104f-f7b7-42ae-8c86-c6c29b5d2c33 req-2f5b1259-3213-4db9-a006-15e8b0f62872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1353bbe9-3485-4c95-bd9b-c7560b6bab0d", "name": "network-vif-plugged", "status": "completed", "tag": "1ef9acc6-9016-4863-8f66-44835a266895"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:17:16.609166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-006e104f-f7b7-42ae-8c86-c6c29b5d2c33 req-2f5b1259-3213-4db9-a006-15e8b0f62872 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:16.609813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-006e104f-f7b7-42ae-8c86-c6c29b5d2c33 req-2f5b1259-3213-4db9-a006-15e8b0f62872 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:16.610262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-006e104f-f7b7-42ae-8c86-c6c29b5d2c33 req-2f5b1259-3213-4db9-a006-15e8b0f62872 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:16.622931 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-006e104f-f7b7-42ae-8c86-c6c29b5d2c33 req-2f5b1259-3213-4db9-a006-15e8b0f62872 service nova] Creating event network-vif-plugged:1ef9acc6-9016-4863-8f66-44835a266895 for instance 1353bbe9-3485-4c95-bd9b-c7560b6bab0d on n-h2-860864-2 Oct 11 00:17:16.628017 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-006e104f-f7b7-42ae-8c86-c6c29b5d2c33 req-2f5b1259-3213-4db9-a006-15e8b0f62872 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031951 Oct 11 00:17:16.628646 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3738/7001] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:17:17.620684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-66ca2e38-e9fa-4fea-9d74-50e6d7d01a62 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:17.622172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-66ca2e38-e9fa-4fea-9d74-50e6d7d01a62 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:17.629394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66ca2e38-e9fa-4fea-9d74-50e6d7d01a62 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:17.629912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66ca2e38-e9fa-4fea-9d74-50e6d7d01a62 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:17.630362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66ca2e38-e9fa-4fea-9d74-50e6d7d01a62 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:17.631063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66ca2e38-e9fa-4fea-9d74-50e6d7d01a62 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:17.631530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66ca2e38-e9fa-4fea-9d74-50e6d7d01a62 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:17.631968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-66ca2e38-e9fa-4fea-9d74-50e6d7d01a62 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:17.770531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-66ca2e38-e9fa-4fea-9d74-50e6d7d01a62 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:17.779937 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-66ca2e38-e9fa-4fea-9d74-50e6d7d01a62 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1317 microversion: 2.1 time: 0.164699 Oct 11 00:17:17.780518 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3739/7002] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:17 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:18.803238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-82902cd9-8f80-4732-b022-e07b0fcaf338 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:18.803885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-82902cd9-8f80-4732-b022-e07b0fcaf338 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:18.810904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82902cd9-8f80-4732-b022-e07b0fcaf338 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:18.811405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82902cd9-8f80-4732-b022-e07b0fcaf338 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:18.811854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82902cd9-8f80-4732-b022-e07b0fcaf338 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:18.812563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82902cd9-8f80-4732-b022-e07b0fcaf338 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:18.813025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82902cd9-8f80-4732-b022-e07b0fcaf338 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:18.813563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-82902cd9-8f80-4732-b022-e07b0fcaf338 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:18.944342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-82902cd9-8f80-4732-b022-e07b0fcaf338 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:18.952349 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-82902cd9-8f80-4732-b022-e07b0fcaf338 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1508 microversion: 2.1 time: 0.153282 Oct 11 00:17:18.952920 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3740/7003] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:18 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:18.974319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bccdf072-3842-4214-87ca-bcc3f40beb7d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:18.974931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bccdf072-3842-4214-87ca-bcc3f40beb7d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:18.981456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bccdf072-3842-4214-87ca-bcc3f40beb7d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:18.981954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bccdf072-3842-4214-87ca-bcc3f40beb7d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:18.982401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bccdf072-3842-4214-87ca-bcc3f40beb7d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:18.983102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bccdf072-3842-4214-87ca-bcc3f40beb7d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:18.983565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bccdf072-3842-4214-87ca-bcc3f40beb7d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:18.984003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bccdf072-3842-4214-87ca-bcc3f40beb7d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:19.111610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bccdf072-3842-4214-87ca-bcc3f40beb7d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:19.119314 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bccdf072-3842-4214-87ca-bcc3f40beb7d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1508 microversion: 2.1 time: 0.148565 Oct 11 00:17:19.119884 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3741/7004] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:18 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:19.141863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0a62bdac-3806-40fe-89c7-b0470e099885 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:17:19.144278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0a62bdac-3806-40fe-89c7-b0470e099885 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:19.150031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a62bdac-3806-40fe-89c7-b0470e099885 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:19.150526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a62bdac-3806-40fe-89c7-b0470e099885 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:19.150974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a62bdac-3806-40fe-89c7-b0470e099885 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:19.152398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a62bdac-3806-40fe-89c7-b0470e099885 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:19.153175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a62bdac-3806-40fe-89c7-b0470e099885 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:19.153643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a62bdac-3806-40fe-89c7-b0470e099885 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:19.217571 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0a62bdac-3806-40fe-89c7-b0470e099885 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "PUT /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1080 microversion: 2.1 time: 0.079187 Oct 11 00:17:19.218222 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3742/7005] 10.222.0.23 () {60 vars in 1256 bytes} [Tue Oct 11 00:17:19 2022] PUT /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1080 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:19.236135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-64e69d36-851e-4e45-a790-fbc54fa5f48d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:19.236751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-64e69d36-851e-4e45-a790-fbc54fa5f48d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:19.242609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64e69d36-851e-4e45-a790-fbc54fa5f48d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:19.243098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64e69d36-851e-4e45-a790-fbc54fa5f48d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:19.243541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64e69d36-851e-4e45-a790-fbc54fa5f48d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:19.244236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64e69d36-851e-4e45-a790-fbc54fa5f48d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:19.244698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64e69d36-851e-4e45-a790-fbc54fa5f48d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:19.245135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64e69d36-851e-4e45-a790-fbc54fa5f48d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:19.279387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:17:19.384215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-64e69d36-851e-4e45-a790-fbc54fa5f48d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:19.392619 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-64e69d36-851e-4e45-a790-fbc54fa5f48d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1506 microversion: 2.1 time: 0.160081 Oct 11 00:17:19.393202 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3743/7006] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:19 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:19.415056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6e4d668e-941a-4501-a8cf-6b52bc93f9ff tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:19.415678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6e4d668e-941a-4501-a8cf-6b52bc93f9ff tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:19.422059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e4d668e-941a-4501-a8cf-6b52bc93f9ff tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:19.422587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e4d668e-941a-4501-a8cf-6b52bc93f9ff tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:19.423035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e4d668e-941a-4501-a8cf-6b52bc93f9ff tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:19.423739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e4d668e-941a-4501-a8cf-6b52bc93f9ff tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:19.424199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e4d668e-941a-4501-a8cf-6b52bc93f9ff tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:19.424634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e4d668e-941a-4501-a8cf-6b52bc93f9ff tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:19.443580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:17:19.556056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6e4d668e-941a-4501-a8cf-6b52bc93f9ff tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:19.564395 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6e4d668e-941a-4501-a8cf-6b52bc93f9ff tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1506 microversion: 2.1 time: 0.153081 Oct 11 00:17:19.564974 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3744/7007] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:19 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:19.587261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-aeae3bf9-30c4-4109-842b-2576f0a43a6a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:17:19.589641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-aeae3bf9-30c4-4109-842b-2576f0a43a6a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:19.595539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aeae3bf9-30c4-4109-842b-2576f0a43a6a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:19.596041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aeae3bf9-30c4-4109-842b-2576f0a43a6a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:19.596498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aeae3bf9-30c4-4109-842b-2576f0a43a6a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:19.597202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aeae3bf9-30c4-4109-842b-2576f0a43a6a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:19.597699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aeae3bf9-30c4-4109-842b-2576f0a43a6a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:19.598177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aeae3bf9-30c4-4109-842b-2576f0a43a6a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:19.626470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-aeae3bf9-30c4-4109-842b-2576f0a43a6a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:19.631884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-aeae3bf9-30c4-4109-842b-2576f0a43a6a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Old instance type m1.heat2, new instance type m1.heat {{(pid=120613) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 00:17:19.639275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-aeae3bf9-30c4-4109-842b-2576f0a43a6a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:17:19.639711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-aeae3bf9-30c4-4109-842b-2576f0a43a6a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:17:19.640205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-aeae3bf9-30c4-4109-842b-2576f0a43a6a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:17:19.640630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-aeae3bf9-30c4-4109-842b-2576f0a43a6a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:17:19.641054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-aeae3bf9-30c4-4109-842b-2576f0a43a6a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:17:19.656116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:17:19.704819 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-aeae3bf9-30c4-4109-842b-2576f0a43a6a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "POST /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d/action" status: 202 len: 0 microversion: 2.1 time: 0.121363 Oct 11 00:17:19.705989 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3745/7008] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:17:19 2022] POST /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:17:19.715863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6d10974a-9d57-4703-a1f1-8b626af04ba3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:19.716514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6d10974a-9d57-4703-a1f1-8b626af04ba3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:19.722772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d10974a-9d57-4703-a1f1-8b626af04ba3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:19.723368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d10974a-9d57-4703-a1f1-8b626af04ba3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:19.724195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d10974a-9d57-4703-a1f1-8b626af04ba3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:19.724923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d10974a-9d57-4703-a1f1-8b626af04ba3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:19.725431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d10974a-9d57-4703-a1f1-8b626af04ba3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:19.725880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6d10974a-9d57-4703-a1f1-8b626af04ba3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:19.874353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6d10974a-9d57-4703-a1f1-8b626af04ba3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:19.882524 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6d10974a-9d57-4703-a1f1-8b626af04ba3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1517 microversion: 2.1 time: 0.172309 Oct 11 00:17:19.883097 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3746/7009] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:19 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:17:20.906077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3682ea0c-1dfa-4b4d-adbd-d91e53d4a554 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:20.906697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3682ea0c-1dfa-4b4d-adbd-d91e53d4a554 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:20.913526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3682ea0c-1dfa-4b4d-adbd-d91e53d4a554 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:20.914023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3682ea0c-1dfa-4b4d-adbd-d91e53d4a554 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:20.914469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3682ea0c-1dfa-4b4d-adbd-d91e53d4a554 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:20.915173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3682ea0c-1dfa-4b4d-adbd-d91e53d4a554 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:20.915651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3682ea0c-1dfa-4b4d-adbd-d91e53d4a554 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:20.916091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3682ea0c-1dfa-4b4d-adbd-d91e53d4a554 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:21.156055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3682ea0c-1dfa-4b4d-adbd-d91e53d4a554 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:21.164128 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3682ea0c-1dfa-4b4d-adbd-d91e53d4a554 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1517 microversion: 2.1 time: 0.262249 Oct 11 00:17:21.164856 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3747/7010] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:20 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1517 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:22.188975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-44c65a82-d09e-4e6a-bf0f-5c117c1fafa3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:22.189643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-44c65a82-d09e-4e6a-bf0f-5c117c1fafa3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:22.196571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44c65a82-d09e-4e6a-bf0f-5c117c1fafa3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:22.197071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44c65a82-d09e-4e6a-bf0f-5c117c1fafa3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:22.197552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44c65a82-d09e-4e6a-bf0f-5c117c1fafa3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:22.198309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44c65a82-d09e-4e6a-bf0f-5c117c1fafa3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:22.198901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44c65a82-d09e-4e6a-bf0f-5c117c1fafa3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:22.199219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-44c65a82-d09e-4e6a-bf0f-5c117c1fafa3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:22.332390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-44c65a82-d09e-4e6a-bf0f-5c117c1fafa3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:22.340901 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-44c65a82-d09e-4e6a-bf0f-5c117c1fafa3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1522 microversion: 2.1 time: 0.155817 Oct 11 00:17:22.341517 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3748/7011] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:22 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:17:23.365592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7b41685b-7a00-4a26-9453-8b9ff201528d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:23.366535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7b41685b-7a00-4a26-9453-8b9ff201528d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:23.373859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b41685b-7a00-4a26-9453-8b9ff201528d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:23.374368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b41685b-7a00-4a26-9453-8b9ff201528d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:23.374818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b41685b-7a00-4a26-9453-8b9ff201528d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:23.375524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b41685b-7a00-4a26-9453-8b9ff201528d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:23.376044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b41685b-7a00-4a26-9453-8b9ff201528d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:23.376518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b41685b-7a00-4a26-9453-8b9ff201528d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:23.599278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7b41685b-7a00-4a26-9453-8b9ff201528d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:23.607868 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7b41685b-7a00-4a26-9453-8b9ff201528d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1522 microversion: 2.1 time: 0.246184 Oct 11 00:17:23.608656 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3749/7012] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:23 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:24.630879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5e2cdda2-cda6-440d-9c0b-2ab36db98aa0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:24.631541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5e2cdda2-cda6-440d-9c0b-2ab36db98aa0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:24.638740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e2cdda2-cda6-440d-9c0b-2ab36db98aa0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:24.639249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e2cdda2-cda6-440d-9c0b-2ab36db98aa0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:24.639708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e2cdda2-cda6-440d-9c0b-2ab36db98aa0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:24.640422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e2cdda2-cda6-440d-9c0b-2ab36db98aa0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:24.640898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e2cdda2-cda6-440d-9c0b-2ab36db98aa0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:24.641347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e2cdda2-cda6-440d-9c0b-2ab36db98aa0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:24.773194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5e2cdda2-cda6-440d-9c0b-2ab36db98aa0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:24.782211 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5e2cdda2-cda6-440d-9c0b-2ab36db98aa0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1522 microversion: 2.1 time: 0.155161 Oct 11 00:17:24.782797 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3750/7013] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:24 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:25.806434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a9174627-e47a-4a7f-acfb-d9f5f2c9f67e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:25.807052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a9174627-e47a-4a7f-acfb-d9f5f2c9f67e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:25.814418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a9174627-e47a-4a7f-acfb-d9f5f2c9f67e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:25.814925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a9174627-e47a-4a7f-acfb-d9f5f2c9f67e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:25.815375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a9174627-e47a-4a7f-acfb-d9f5f2c9f67e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:25.816126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a9174627-e47a-4a7f-acfb-d9f5f2c9f67e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:25.816858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a9174627-e47a-4a7f-acfb-d9f5f2c9f67e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:25.817014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a9174627-e47a-4a7f-acfb-d9f5f2c9f67e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:25.951982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a9174627-e47a-4a7f-acfb-d9f5f2c9f67e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:25.959773 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a9174627-e47a-4a7f-acfb-d9f5f2c9f67e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1522 microversion: 2.1 time: 0.157604 Oct 11 00:17:25.960344 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3751/7014] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:25 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:26.985754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-296fa8f3-bded-4fa8-ad0b-8d97cff34627 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:26.986383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-296fa8f3-bded-4fa8-ad0b-8d97cff34627 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:26.993212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-296fa8f3-bded-4fa8-ad0b-8d97cff34627 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:26.993752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-296fa8f3-bded-4fa8-ad0b-8d97cff34627 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:26.994207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-296fa8f3-bded-4fa8-ad0b-8d97cff34627 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:26.994919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-296fa8f3-bded-4fa8-ad0b-8d97cff34627 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:26.995968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-296fa8f3-bded-4fa8-ad0b-8d97cff34627 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:26.996435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-296fa8f3-bded-4fa8-ad0b-8d97cff34627 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:27.126011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-296fa8f3-bded-4fa8-ad0b-8d97cff34627 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:27.133752 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-296fa8f3-bded-4fa8-ad0b-8d97cff34627 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1522 microversion: 2.1 time: 0.152026 Oct 11 00:17:27.134325 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3752/7015] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:26 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:17:28.156205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-53fd3cd2-7935-479e-b22c-e528568b4249 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:28.156876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-53fd3cd2-7935-479e-b22c-e528568b4249 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:28.163781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53fd3cd2-7935-479e-b22c-e528568b4249 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:28.164271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53fd3cd2-7935-479e-b22c-e528568b4249 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:28.164716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53fd3cd2-7935-479e-b22c-e528568b4249 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:28.165433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53fd3cd2-7935-479e-b22c-e528568b4249 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:28.165900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53fd3cd2-7935-479e-b22c-e528568b4249 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:28.166337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53fd3cd2-7935-479e-b22c-e528568b4249 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:28.295745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-53fd3cd2-7935-479e-b22c-e528568b4249 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:28.303772 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-53fd3cd2-7935-479e-b22c-e528568b4249 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1522 microversion: 2.1 time: 0.151432 Oct 11 00:17:28.304345 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3753/7016] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:28 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:29.328126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-533b2c1e-4f98-4b23-90f4-b9e0978f7e85 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:29.328838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-533b2c1e-4f98-4b23-90f4-b9e0978f7e85 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:29.335706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-533b2c1e-4f98-4b23-90f4-b9e0978f7e85 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:29.336203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-533b2c1e-4f98-4b23-90f4-b9e0978f7e85 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:29.336658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-533b2c1e-4f98-4b23-90f4-b9e0978f7e85 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:29.337361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-533b2c1e-4f98-4b23-90f4-b9e0978f7e85 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:29.337859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-533b2c1e-4f98-4b23-90f4-b9e0978f7e85 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:29.338300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-533b2c1e-4f98-4b23-90f4-b9e0978f7e85 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:29.472669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-533b2c1e-4f98-4b23-90f4-b9e0978f7e85 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:29.480483 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-533b2c1e-4f98-4b23-90f4-b9e0978f7e85 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1522 microversion: 2.1 time: 0.157122 Oct 11 00:17:29.481060 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3754/7017] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:29 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:30.504158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e520736c-013c-449a-b5b9-d1258f33a290 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:30.504811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e520736c-013c-449a-b5b9-d1258f33a290 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:30.512489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e520736c-013c-449a-b5b9-d1258f33a290 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:30.512992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e520736c-013c-449a-b5b9-d1258f33a290 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:30.513466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e520736c-013c-449a-b5b9-d1258f33a290 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:30.514177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e520736c-013c-449a-b5b9-d1258f33a290 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:30.514648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e520736c-013c-449a-b5b9-d1258f33a290 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:30.515090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e520736c-013c-449a-b5b9-d1258f33a290 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:30.651126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e520736c-013c-449a-b5b9-d1258f33a290 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:30.659502 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e520736c-013c-449a-b5b9-d1258f33a290 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1522 microversion: 2.1 time: 0.159254 Oct 11 00:17:30.660113 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3755/7018] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:30 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:31.683855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b6e26ee2-4e10-4242-b304-fc6e4f6b0463 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:31.684500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b6e26ee2-4e10-4242-b304-fc6e4f6b0463 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:31.691331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6e26ee2-4e10-4242-b304-fc6e4f6b0463 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:31.691836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6e26ee2-4e10-4242-b304-fc6e4f6b0463 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:31.692292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6e26ee2-4e10-4242-b304-fc6e4f6b0463 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:31.693010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6e26ee2-4e10-4242-b304-fc6e4f6b0463 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:31.693517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6e26ee2-4e10-4242-b304-fc6e4f6b0463 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:31.693968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6e26ee2-4e10-4242-b304-fc6e4f6b0463 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:31.828259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b6e26ee2-4e10-4242-b304-fc6e4f6b0463 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:31.836228 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b6e26ee2-4e10-4242-b304-fc6e4f6b0463 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1522 microversion: 2.1 time: 0.156927 Oct 11 00:17:31.836751 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3756/7019] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:31 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:32.859282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-246ca42f-0b1c-4772-ab16-9c095e555bd7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:32.859960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-246ca42f-0b1c-4772-ab16-9c095e555bd7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:32.866754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-246ca42f-0b1c-4772-ab16-9c095e555bd7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:32.867260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-246ca42f-0b1c-4772-ab16-9c095e555bd7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:32.867718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-246ca42f-0b1c-4772-ab16-9c095e555bd7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:32.868435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-246ca42f-0b1c-4772-ab16-9c095e555bd7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:32.868911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-246ca42f-0b1c-4772-ab16-9c095e555bd7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:32.869356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-246ca42f-0b1c-4772-ab16-9c095e555bd7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:33.000176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-246ca42f-0b1c-4772-ab16-9c095e555bd7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:33.007956 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-246ca42f-0b1c-4772-ab16-9c095e555bd7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1522 microversion: 2.1 time: 0.152593 Oct 11 00:17:33.008549 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3757/7020] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:32 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:34.032119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6883793c-5231-45c7-a5da-a32f89c8d0ed tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:34.032785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6883793c-5231-45c7-a5da-a32f89c8d0ed tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:34.039763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6883793c-5231-45c7-a5da-a32f89c8d0ed tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:34.040266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6883793c-5231-45c7-a5da-a32f89c8d0ed tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:34.040721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6883793c-5231-45c7-a5da-a32f89c8d0ed tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:34.041465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6883793c-5231-45c7-a5da-a32f89c8d0ed tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:34.041937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6883793c-5231-45c7-a5da-a32f89c8d0ed tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:34.042381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6883793c-5231-45c7-a5da-a32f89c8d0ed tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:34.177053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6883793c-5231-45c7-a5da-a32f89c8d0ed tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:34.185155 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6883793c-5231-45c7-a5da-a32f89c8d0ed tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1522 microversion: 2.1 time: 0.157511 Oct 11 00:17:34.185778 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3758/7021] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:34 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:35.208729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1c8f4d61-db0c-47a5-ac8e-5db85b288a8d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:35.209362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1c8f4d61-db0c-47a5-ac8e-5db85b288a8d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:35.216389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c8f4d61-db0c-47a5-ac8e-5db85b288a8d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:35.216888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c8f4d61-db0c-47a5-ac8e-5db85b288a8d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:35.217340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c8f4d61-db0c-47a5-ac8e-5db85b288a8d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:35.218076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c8f4d61-db0c-47a5-ac8e-5db85b288a8d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:35.218546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c8f4d61-db0c-47a5-ac8e-5db85b288a8d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:35.218983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c8f4d61-db0c-47a5-ac8e-5db85b288a8d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:35.665002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1c8f4d61-db0c-47a5-ac8e-5db85b288a8d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:35.673344 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1c8f4d61-db0c-47a5-ac8e-5db85b288a8d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1522 microversion: 2.1 time: 0.468526 Oct 11 00:17:35.673953 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3759/7022] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:35 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:36.697946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-12f22703-5b34-4a68-bfac-a6e9d5e71253 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:36.698584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-12f22703-5b34-4a68-bfac-a6e9d5e71253 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:36.705562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12f22703-5b34-4a68-bfac-a6e9d5e71253 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:36.706065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12f22703-5b34-4a68-bfac-a6e9d5e71253 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:36.706516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12f22703-5b34-4a68-bfac-a6e9d5e71253 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:36.707230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12f22703-5b34-4a68-bfac-a6e9d5e71253 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:36.707699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12f22703-5b34-4a68-bfac-a6e9d5e71253 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:36.708140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12f22703-5b34-4a68-bfac-a6e9d5e71253 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:36.838620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-12f22703-5b34-4a68-bfac-a6e9d5e71253 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:36.847640 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-12f22703-5b34-4a68-bfac-a6e9d5e71253 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1522 microversion: 2.1 time: 0.153547 Oct 11 00:17:36.848265 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3760/7023] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:36 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:37.871404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8ef27cd0-7098-4213-a438-5c66516ecd9c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:37.872741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8ef27cd0-7098-4213-a438-5c66516ecd9c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:37.879302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ef27cd0-7098-4213-a438-5c66516ecd9c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:37.879802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ef27cd0-7098-4213-a438-5c66516ecd9c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:37.880254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ef27cd0-7098-4213-a438-5c66516ecd9c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:37.880966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ef27cd0-7098-4213-a438-5c66516ecd9c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:37.881466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ef27cd0-7098-4213-a438-5c66516ecd9c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:37.881913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8ef27cd0-7098-4213-a438-5c66516ecd9c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:37.902959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:17:38.020162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8ef27cd0-7098-4213-a438-5c66516ecd9c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:38.028102 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8ef27cd0-7098-4213-a438-5c66516ecd9c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1522 microversion: 2.1 time: 0.160745 Oct 11 00:17:38.028675 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3761/7024] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:37 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:39.051940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-37342cdd-414d-4e9e-823a-ef0f2a1f46ca tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:39.052860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-37342cdd-414d-4e9e-823a-ef0f2a1f46ca tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:39.055511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:17:39.062133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37342cdd-414d-4e9e-823a-ef0f2a1f46ca tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:39.062626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37342cdd-414d-4e9e-823a-ef0f2a1f46ca tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:39.063075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37342cdd-414d-4e9e-823a-ef0f2a1f46ca tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:39.063776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37342cdd-414d-4e9e-823a-ef0f2a1f46ca tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:39.064240 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37342cdd-414d-4e9e-823a-ef0f2a1f46ca tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:39.064677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37342cdd-414d-4e9e-823a-ef0f2a1f46ca tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:39.193633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-37342cdd-414d-4e9e-823a-ef0f2a1f46ca tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:39.202165 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-37342cdd-414d-4e9e-823a-ef0f2a1f46ca tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1522 microversion: 2.1 time: 0.154147 Oct 11 00:17:39.202743 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3762/7025] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:39 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:39.870934 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:17:39.871420 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:17:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 11 00:17:40.225304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dac2fbf1-ecc3-4ed8-bb0b-00feafed97a5 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:40.225866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dac2fbf1-ecc3-4ed8-bb0b-00feafed97a5 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:40.232972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dac2fbf1-ecc3-4ed8-bb0b-00feafed97a5 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:40.233510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dac2fbf1-ecc3-4ed8-bb0b-00feafed97a5 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:40.233973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dac2fbf1-ecc3-4ed8-bb0b-00feafed97a5 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:40.234683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dac2fbf1-ecc3-4ed8-bb0b-00feafed97a5 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:40.235154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dac2fbf1-ecc3-4ed8-bb0b-00feafed97a5 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:40.235598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dac2fbf1-ecc3-4ed8-bb0b-00feafed97a5 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:40.366672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dac2fbf1-ecc3-4ed8-bb0b-00feafed97a5 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:40.374837 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dac2fbf1-ecc3-4ed8-bb0b-00feafed97a5 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1522 microversion: 2.1 time: 0.153539 Oct 11 00:17:40.375417 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3763/7026] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:40 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:41.398672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-262d5903-09bd-4fea-8b36-987026756cb2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:41.399311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-262d5903-09bd-4fea-8b36-987026756cb2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:41.407144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-262d5903-09bd-4fea-8b36-987026756cb2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:41.407677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-262d5903-09bd-4fea-8b36-987026756cb2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:41.408125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-262d5903-09bd-4fea-8b36-987026756cb2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:41.408825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-262d5903-09bd-4fea-8b36-987026756cb2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:41.409286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-262d5903-09bd-4fea-8b36-987026756cb2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:41.409755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-262d5903-09bd-4fea-8b36-987026756cb2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:41.545573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-262d5903-09bd-4fea-8b36-987026756cb2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:41.553809 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-262d5903-09bd-4fea-8b36-987026756cb2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1522 microversion: 2.1 time: 0.159061 Oct 11 00:17:41.554391 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3764/7027] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:41 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:42.576916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9a9d946d-c7ac-4d94-99a8-c76c1e1fcb51 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:42.577624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9a9d946d-c7ac-4d94-99a8-c76c1e1fcb51 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:42.584590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a9d946d-c7ac-4d94-99a8-c76c1e1fcb51 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:42.585093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a9d946d-c7ac-4d94-99a8-c76c1e1fcb51 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:42.585584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a9d946d-c7ac-4d94-99a8-c76c1e1fcb51 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:42.586303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a9d946d-c7ac-4d94-99a8-c76c1e1fcb51 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:42.586777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a9d946d-c7ac-4d94-99a8-c76c1e1fcb51 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:42.587224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9a9d946d-c7ac-4d94-99a8-c76c1e1fcb51 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:42.721555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9a9d946d-c7ac-4d94-99a8-c76c1e1fcb51 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:42.729338 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9a9d946d-c7ac-4d94-99a8-c76c1e1fcb51 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1522 microversion: 2.1 time: 0.156401 Oct 11 00:17:42.729944 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3765/7028] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:42 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:43.753741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f21e72a9-9b39-4feb-bdbc-dcce5a06254f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:43.754402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f21e72a9-9b39-4feb-bdbc-dcce5a06254f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:43.761236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f21e72a9-9b39-4feb-bdbc-dcce5a06254f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:43.761773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f21e72a9-9b39-4feb-bdbc-dcce5a06254f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:43.762937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f21e72a9-9b39-4feb-bdbc-dcce5a06254f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:43.763809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f21e72a9-9b39-4feb-bdbc-dcce5a06254f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:43.764280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f21e72a9-9b39-4feb-bdbc-dcce5a06254f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:43.764727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f21e72a9-9b39-4feb-bdbc-dcce5a06254f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:43.895144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f21e72a9-9b39-4feb-bdbc-dcce5a06254f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:43.903176 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f21e72a9-9b39-4feb-bdbc-dcce5a06254f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1522 microversion: 2.1 time: 0.153295 Oct 11 00:17:43.903776 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3766/7029] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:43 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:44.926800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-adae4130-808b-421b-98d6-009e15d77d3c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:44.927739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-adae4130-808b-421b-98d6-009e15d77d3c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:44.934700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adae4130-808b-421b-98d6-009e15d77d3c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:44.935203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adae4130-808b-421b-98d6-009e15d77d3c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:44.935657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adae4130-808b-421b-98d6-009e15d77d3c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:44.936366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adae4130-808b-421b-98d6-009e15d77d3c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:44.936836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adae4130-808b-421b-98d6-009e15d77d3c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:44.937278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-adae4130-808b-421b-98d6-009e15d77d3c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:45.069268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-adae4130-808b-421b-98d6-009e15d77d3c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:45.077840 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-adae4130-808b-421b-98d6-009e15d77d3c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1522 microversion: 2.1 time: 0.154944 Oct 11 00:17:45.078430 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3767/7030] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:44 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:46.100952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ad0ab95d-c490-4b39-b112-1968fc7d13bd tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:46.101659 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ad0ab95d-c490-4b39-b112-1968fc7d13bd tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:46.109754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad0ab95d-c490-4b39-b112-1968fc7d13bd tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:46.110255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad0ab95d-c490-4b39-b112-1968fc7d13bd tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:46.110699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad0ab95d-c490-4b39-b112-1968fc7d13bd tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:46.111398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad0ab95d-c490-4b39-b112-1968fc7d13bd tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:46.111882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad0ab95d-c490-4b39-b112-1968fc7d13bd tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:46.112319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad0ab95d-c490-4b39-b112-1968fc7d13bd tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:46.245136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ad0ab95d-c490-4b39-b112-1968fc7d13bd tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:46.253861 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ad0ab95d-c490-4b39-b112-1968fc7d13bd tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1522 microversion: 2.1 time: 0.156713 Oct 11 00:17:46.254442 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3768/7031] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:46 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:47.278485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dc49845a-654d-4047-aef5-c6906c8b3ba9 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:47.279206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dc49845a-654d-4047-aef5-c6906c8b3ba9 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:47.286155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc49845a-654d-4047-aef5-c6906c8b3ba9 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:47.286649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc49845a-654d-4047-aef5-c6906c8b3ba9 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:47.287098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc49845a-654d-4047-aef5-c6906c8b3ba9 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:47.287802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc49845a-654d-4047-aef5-c6906c8b3ba9 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:47.288268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc49845a-654d-4047-aef5-c6906c8b3ba9 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:47.288718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc49845a-654d-4047-aef5-c6906c8b3ba9 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:47.421083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dc49845a-654d-4047-aef5-c6906c8b3ba9 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:47.429116 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dc49845a-654d-4047-aef5-c6906c8b3ba9 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1522 microversion: 2.1 time: 0.155346 Oct 11 00:17:47.429719 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3769/7032] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:47 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:48.452650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5e406564-25e3-41fb-8118-68b20632f4b1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:48.453323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5e406564-25e3-41fb-8118-68b20632f4b1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:48.460153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e406564-25e3-41fb-8118-68b20632f4b1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:48.460647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e406564-25e3-41fb-8118-68b20632f4b1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:48.461097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e406564-25e3-41fb-8118-68b20632f4b1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:48.461830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e406564-25e3-41fb-8118-68b20632f4b1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:48.462298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e406564-25e3-41fb-8118-68b20632f4b1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:48.462736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e406564-25e3-41fb-8118-68b20632f4b1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:48.628026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5e406564-25e3-41fb-8118-68b20632f4b1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:48.636163 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5e406564-25e3-41fb-8118-68b20632f4b1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1522 microversion: 2.1 time: 0.187588 Oct 11 00:17:48.636764 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3770/7033] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:48 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:49.296775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-f761292c-311f-4a29-8b31-3d447669f8e0 req-4fad53c5-0dfa-4935-ad84-cc472e3d97e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1353bbe9-3485-4c95-bd9b-c7560b6bab0d", "name": "network-vif-unplugged", "status": "completed", "tag": "1ef9acc6-9016-4863-8f66-44835a266895"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:17:49.306415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f761292c-311f-4a29-8b31-3d447669f8e0 req-4fad53c5-0dfa-4935-ad84-cc472e3d97e1 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:49.306909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f761292c-311f-4a29-8b31-3d447669f8e0 req-4fad53c5-0dfa-4935-ad84-cc472e3d97e1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:49.307466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f761292c-311f-4a29-8b31-3d447669f8e0 req-4fad53c5-0dfa-4935-ad84-cc472e3d97e1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:49.319323 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-f761292c-311f-4a29-8b31-3d447669f8e0 req-4fad53c5-0dfa-4935-ad84-cc472e3d97e1 service nova] Creating event network-vif-unplugged:1ef9acc6-9016-4863-8f66-44835a266895 for instance 1353bbe9-3485-4c95-bd9b-c7560b6bab0d on n-h1-860864-2 Oct 11 00:17:49.325263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-f761292c-311f-4a29-8b31-3d447669f8e0 req-4fad53c5-0dfa-4935-ad84-cc472e3d97e1 service nova] Instance 1353bbe9-3485-4c95-bd9b-c7560b6bab0d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 00:17:49.336469 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-f761292c-311f-4a29-8b31-3d447669f8e0 req-4fad53c5-0dfa-4935-ad84-cc472e3d97e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043675 Oct 11 00:17:49.337251 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3771/7034] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:17:49.660481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-106d7ecf-9c71-44a2-b802-03b5b7a3e31b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:49.661219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-106d7ecf-9c71-44a2-b802-03b5b7a3e31b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:49.667323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-106d7ecf-9c71-44a2-b802-03b5b7a3e31b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:49.667828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-106d7ecf-9c71-44a2-b802-03b5b7a3e31b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:49.668341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-106d7ecf-9c71-44a2-b802-03b5b7a3e31b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:49.669058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-106d7ecf-9c71-44a2-b802-03b5b7a3e31b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:49.669561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-106d7ecf-9c71-44a2-b802-03b5b7a3e31b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:49.670011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-106d7ecf-9c71-44a2-b802-03b5b7a3e31b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:49.805658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-106d7ecf-9c71-44a2-b802-03b5b7a3e31b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:49.814926 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-106d7ecf-9c71-44a2-b802-03b5b7a3e31b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1521 microversion: 2.1 time: 0.159438 Oct 11 00:17:49.815528 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3772/7035] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:49 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:50.839894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-523de418-d11d-4976-96d6-eeb06785a2ad tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:50.841092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-523de418-d11d-4976-96d6-eeb06785a2ad tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:50.848096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-523de418-d11d-4976-96d6-eeb06785a2ad tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:50.848590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-523de418-d11d-4976-96d6-eeb06785a2ad tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:50.849053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-523de418-d11d-4976-96d6-eeb06785a2ad tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:50.849788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-523de418-d11d-4976-96d6-eeb06785a2ad tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:50.850253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-523de418-d11d-4976-96d6-eeb06785a2ad tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:50.850690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-523de418-d11d-4976-96d6-eeb06785a2ad tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:50.986617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-523de418-d11d-4976-96d6-eeb06785a2ad tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:50.994594 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-523de418-d11d-4976-96d6-eeb06785a2ad tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1519 microversion: 2.1 time: 0.158579 Oct 11 00:17:50.994931 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3773/7036] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:50 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:51.368600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-435b4d20-3878-4788-92e4-e39cf4110e74 req-f8e062c6-8f1d-41b4-8516-07f7424d9f72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1353bbe9-3485-4c95-bd9b-c7560b6bab0d", "tag": "1ef9acc6-9016-4863-8f66-44835a266895"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:17:51.379651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-435b4d20-3878-4788-92e4-e39cf4110e74 req-f8e062c6-8f1d-41b4-8516-07f7424d9f72 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:51.380158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-435b4d20-3878-4788-92e4-e39cf4110e74 req-f8e062c6-8f1d-41b4-8516-07f7424d9f72 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:51.380607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-435b4d20-3878-4788-92e4-e39cf4110e74 req-f8e062c6-8f1d-41b4-8516-07f7424d9f72 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:51.397406 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-435b4d20-3878-4788-92e4-e39cf4110e74 req-f8e062c6-8f1d-41b4-8516-07f7424d9f72 service nova] Creating event network-changed:1ef9acc6-9016-4863-8f66-44835a266895 for instance 1353bbe9-3485-4c95-bd9b-c7560b6bab0d on n-h1-860864-2 Oct 11 00:17:51.404016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-435b4d20-3878-4788-92e4-e39cf4110e74 req-f8e062c6-8f1d-41b4-8516-07f7424d9f72 service nova] Instance 1353bbe9-3485-4c95-bd9b-c7560b6bab0d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 00:17:51.415494 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-435b4d20-3878-4788-92e4-e39cf4110e74 req-f8e062c6-8f1d-41b4-8516-07f7424d9f72 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050955 Oct 11 00:17:51.416119 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3774/7037] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:17:52.020070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4d01dfd2-7e73-4696-ab04-caa603c0b1a8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:52.020779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4d01dfd2-7e73-4696-ab04-caa603c0b1a8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:52.029921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d01dfd2-7e73-4696-ab04-caa603c0b1a8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:52.030850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d01dfd2-7e73-4696-ab04-caa603c0b1a8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:52.031472 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d01dfd2-7e73-4696-ab04-caa603c0b1a8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:52.032197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d01dfd2-7e73-4696-ab04-caa603c0b1a8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:52.032770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d01dfd2-7e73-4696-ab04-caa603c0b1a8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:52.033224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4d01dfd2-7e73-4696-ab04-caa603c0b1a8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:52.201580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4d01dfd2-7e73-4696-ab04-caa603c0b1a8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:52.210039 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4d01dfd2-7e73-4696-ab04-caa603c0b1a8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1519 microversion: 2.1 time: 0.194375 Oct 11 00:17:52.210635 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3775/7038] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:52 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:53.235870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-33fa7ec2-25bc-4170-846a-315f455c62e0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:53.236689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-33fa7ec2-25bc-4170-846a-315f455c62e0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:53.244032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33fa7ec2-25bc-4170-846a-315f455c62e0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:53.244582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33fa7ec2-25bc-4170-846a-315f455c62e0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:53.245198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33fa7ec2-25bc-4170-846a-315f455c62e0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:53.245982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33fa7ec2-25bc-4170-846a-315f455c62e0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:53.247344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33fa7ec2-25bc-4170-846a-315f455c62e0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:53.247475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33fa7ec2-25bc-4170-846a-315f455c62e0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:53.397942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-33fa7ec2-25bc-4170-846a-315f455c62e0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:53.406892 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-33fa7ec2-25bc-4170-846a-315f455c62e0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1516 microversion: 2.1 time: 0.176263 Oct 11 00:17:53.407523 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3776/7039] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:53 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1516 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:53.430983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6eb0fd54-5fee-4949-b7b8-142823e82717 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:17:53.431534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6eb0fd54-5fee-4949-b7b8-142823e82717 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:53.438379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6eb0fd54-5fee-4949-b7b8-142823e82717 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:53.438883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6eb0fd54-5fee-4949-b7b8-142823e82717 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:53.439330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6eb0fd54-5fee-4949-b7b8-142823e82717 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:53.440031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6eb0fd54-5fee-4949-b7b8-142823e82717 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:53.440494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6eb0fd54-5fee-4949-b7b8-142823e82717 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:53.440931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6eb0fd54-5fee-4949-b7b8-142823e82717 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:53.491700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:17:53.502944 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6eb0fd54-5fee-4949-b7b8-142823e82717 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "POST /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d/action" status: 204 len: 0 microversion: 2.1 time: 0.075912 Oct 11 00:17:53.503609 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3777/7040] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:17:53 2022] POST /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 00:17:53.512739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7c56d2ae-72fd-4bdd-877a-96ef86378d5a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:53.513495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7c56d2ae-72fd-4bdd-877a-96ef86378d5a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:53.520386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c56d2ae-72fd-4bdd-877a-96ef86378d5a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:53.521031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c56d2ae-72fd-4bdd-877a-96ef86378d5a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:53.521339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c56d2ae-72fd-4bdd-877a-96ef86378d5a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:53.522088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c56d2ae-72fd-4bdd-877a-96ef86378d5a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:53.522551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c56d2ae-72fd-4bdd-877a-96ef86378d5a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:53.522992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c56d2ae-72fd-4bdd-877a-96ef86378d5a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:53.788197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7c56d2ae-72fd-4bdd-877a-96ef86378d5a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:53.796250 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7c56d2ae-72fd-4bdd-877a-96ef86378d5a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1516 microversion: 2.1 time: 0.288086 Oct 11 00:17:53.796870 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3778/7041] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:53 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1516 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:54.767486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-1796355e-a7f7-4e2a-b2f7-261d23a4005e req-fd6551cf-54ce-43a3-b297-67b771c9232f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1353bbe9-3485-4c95-bd9b-c7560b6bab0d", "name": "network-vif-plugged", "status": "completed", "tag": "1ef9acc6-9016-4863-8f66-44835a266895"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:17:54.779920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1796355e-a7f7-4e2a-b2f7-261d23a4005e req-fd6551cf-54ce-43a3-b297-67b771c9232f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:54.780416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1796355e-a7f7-4e2a-b2f7-261d23a4005e req-fd6551cf-54ce-43a3-b297-67b771c9232f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:54.780891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1796355e-a7f7-4e2a-b2f7-261d23a4005e req-fd6551cf-54ce-43a3-b297-67b771c9232f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:54.795034 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-1796355e-a7f7-4e2a-b2f7-261d23a4005e req-fd6551cf-54ce-43a3-b297-67b771c9232f service nova] Creating event network-vif-plugged:1ef9acc6-9016-4863-8f66-44835a266895 for instance 1353bbe9-3485-4c95-bd9b-c7560b6bab0d on n-h1-860864-2 Oct 11 00:17:54.801020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-1796355e-a7f7-4e2a-b2f7-261d23a4005e req-fd6551cf-54ce-43a3-b297-67b771c9232f service nova] Instance 1353bbe9-3485-4c95-bd9b-c7560b6bab0d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 00:17:54.812365 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-1796355e-a7f7-4e2a-b2f7-261d23a4005e req-fd6551cf-54ce-43a3-b297-67b771c9232f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048507 Oct 11 00:17:54.813238 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3779/7042] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:17:54.821119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c574f320-f5c4-472d-9663-1e8d687953d7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:54.821887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c574f320-f5c4-472d-9663-1e8d687953d7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:54.831202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c574f320-f5c4-472d-9663-1e8d687953d7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:54.831688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c574f320-f5c4-472d-9663-1e8d687953d7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:54.832154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c574f320-f5c4-472d-9663-1e8d687953d7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:54.832920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c574f320-f5c4-472d-9663-1e8d687953d7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:54.833488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c574f320-f5c4-472d-9663-1e8d687953d7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:54.833940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c574f320-f5c4-472d-9663-1e8d687953d7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:54.974765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c574f320-f5c4-472d-9663-1e8d687953d7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:54.983952 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c574f320-f5c4-472d-9663-1e8d687953d7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1516 microversion: 2.1 time: 0.167344 Oct 11 00:17:54.984797 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3780/7043] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:54 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:56.007763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e955933f-d8af-406f-ae08-5996b11d787d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:56.008415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e955933f-d8af-406f-ae08-5996b11d787d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:56.015264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e955933f-d8af-406f-ae08-5996b11d787d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:56.015756 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e955933f-d8af-406f-ae08-5996b11d787d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:56.016205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e955933f-d8af-406f-ae08-5996b11d787d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:56.016904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e955933f-d8af-406f-ae08-5996b11d787d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:56.017368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e955933f-d8af-406f-ae08-5996b11d787d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:56.017826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e955933f-d8af-406f-ae08-5996b11d787d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:56.148636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e955933f-d8af-406f-ae08-5996b11d787d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:56.156592 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e955933f-d8af-406f-ae08-5996b11d787d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1508 microversion: 2.1 time: 0.152739 Oct 11 00:17:56.157171 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3781/7044] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:56 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:56.178988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c59a35e0-3049-4c9a-8e8d-d8bea3b89fe2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:56.179612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c59a35e0-3049-4c9a-8e8d-d8bea3b89fe2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:56.186099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c59a35e0-3049-4c9a-8e8d-d8bea3b89fe2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:56.186596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c59a35e0-3049-4c9a-8e8d-d8bea3b89fe2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:56.187049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c59a35e0-3049-4c9a-8e8d-d8bea3b89fe2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:56.187772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c59a35e0-3049-4c9a-8e8d-d8bea3b89fe2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:56.188230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c59a35e0-3049-4c9a-8e8d-d8bea3b89fe2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:56.188662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c59a35e0-3049-4c9a-8e8d-d8bea3b89fe2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:56.320379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c59a35e0-3049-4c9a-8e8d-d8bea3b89fe2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:56.328229 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c59a35e0-3049-4c9a-8e8d-d8bea3b89fe2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1508 microversion: 2.1 time: 0.153068 Oct 11 00:17:56.328806 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3782/7045] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:56 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:56.353418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3933ff26-1fa4-42cc-be6b-38a77b7850ab tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Action: 'create', calling method: .version_select at 0x7f662b0c68b0>, body: {"keypair": {"name": "tempest-keypair-1309792727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuQh26ODAHSkaoQKd7klrJu/8/6aKnfARH44TVLVSh5SWlff0+hpmHYe/NQr+hS3hXayzv0t7iqk9Sik3Pk/K8MZvoVRgh3T47htTdXpUf40RvO/IRk8WFlBJU2fDSeKA=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:17:56.369294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-3933ff26-1fa4-42cc-be6b-38a77b7850ab tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Getting quotas for project 85f5135a4e6c4e9d9cea62b8c1b23463. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:17:56.374637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-3933ff26-1fa4-42cc-be6b-38a77b7850ab tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Getting quotas for user 736e28623d9d4d43b6ffb5ff8d53624d and project 85f5135a4e6c4e9d9cea62b8c1b23463. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:17:56.398827 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3933ff26-1fa4-42cc-be6b-38a77b7850ab tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049041 Oct 11 00:17:56.399433 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3783/7046] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 11 00:17:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:17:57.635074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f725b4d4-f995-4bd1-a308-64e86db2cf6b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:57.635708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f725b4d4-f995-4bd1-a308-64e86db2cf6b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:57.643416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f725b4d4-f995-4bd1-a308-64e86db2cf6b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:57.643924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f725b4d4-f995-4bd1-a308-64e86db2cf6b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:57.644382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f725b4d4-f995-4bd1-a308-64e86db2cf6b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:57.645099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f725b4d4-f995-4bd1-a308-64e86db2cf6b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:57.645602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f725b4d4-f995-4bd1-a308-64e86db2cf6b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:57.646050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f725b4d4-f995-4bd1-a308-64e86db2cf6b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:57.781219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f725b4d4-f995-4bd1-a308-64e86db2cf6b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:57.789136 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f725b4d4-f995-4bd1-a308-64e86db2cf6b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 200 len: 1508 microversion: 2.1 time: 0.159039 Oct 11 00:17:57.789749 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3784/7047] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:57 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:57.812348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bd7d2de8-5b06-4c86-8ab3-7f8579eaaa2e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:57.813235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bd7d2de8-5b06-4c86-8ab3-7f8579eaaa2e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:57.819181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd7d2de8-5b06-4c86-8ab3-7f8579eaaa2e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:57.819693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd7d2de8-5b06-4c86-8ab3-7f8579eaaa2e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:57.820155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd7d2de8-5b06-4c86-8ab3-7f8579eaaa2e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:57.820883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd7d2de8-5b06-4c86-8ab3-7f8579eaaa2e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:57.821355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd7d2de8-5b06-4c86-8ab3-7f8579eaaa2e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:57.821838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd7d2de8-5b06-4c86-8ab3-7f8579eaaa2e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:57.847657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bd7d2de8-5b06-4c86-8ab3-7f8579eaaa2e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:17:57.923752 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bd7d2de8-5b06-4c86-8ab3-7f8579eaaa2e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 204 len: 0 microversion: 2.1 time: 0.115596 Oct 11 00:17:57.924436 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3785/7048] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:17:57 2022] DELETE /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 00:17:57.983360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-18556190-661e-47a6-beac-15e92af0464f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1846387165", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "b6d62dc6-fc1f-4355-b6b7-14f299b4a6f6"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:17:58.036614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-18556190-661e-47a6-beac-15e92af0464f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] validate_networks() for [('b6d62dc6-fc1f-4355-b6b7-14f299b4a6f6', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:17:58.409773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-18556190-661e-47a6-beac-15e92af0464f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:17:58.410216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-18556190-661e-47a6-beac-15e92af0464f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:17:58.410744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-18556190-661e-47a6-beac-15e92af0464f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:17:58.411173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-18556190-661e-47a6-beac-15e92af0464f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:17:58.411604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-18556190-661e-47a6-beac-15e92af0464f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:17:58.421150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18556190-661e-47a6-beac-15e92af0464f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:58.421681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18556190-661e-47a6-beac-15e92af0464f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:58.422133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18556190-661e-47a6-beac-15e92af0464f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:58.422875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18556190-661e-47a6-beac-15e92af0464f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:58.423336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18556190-661e-47a6-beac-15e92af0464f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:58.423778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18556190-661e-47a6-beac-15e92af0464f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:58.441587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-18556190-661e-47a6-beac-15e92af0464f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Getting quotas for project 85f5135a4e6c4e9d9cea62b8c1b23463. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:17:58.446806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-18556190-661e-47a6-beac-15e92af0464f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Getting quotas for user 736e28623d9d4d43b6ffb5ff8d53624d and project 85f5135a4e6c4e9d9cea62b8c1b23463. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:17:58.459233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-18556190-661e-47a6-beac-15e92af0464f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:17:58.461657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-18556190-661e-47a6-beac-15e92af0464f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:17:58.508053 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-18556190-661e-47a6-beac-15e92af0464f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528976 Oct 11 00:17:58.508717 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3786/7049] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:17:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 00:17:58.519811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-eb1cef06-20e6-4d32-a812-7334f8b72225 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:58.520436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-eb1cef06-20e6-4d32-a812-7334f8b72225 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:58.582302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-eb1cef06-20e6-4d32-a812-7334f8b72225 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:58.589335 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-eb1cef06-20e6-4d32-a812-7334f8b72225 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1218 microversion: 2.1 time: 0.073315 Oct 11 00:17:58.590076 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3787/7050] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:58 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:17:59.612759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1b8932a2-d30a-410b-ad69-ba80cd9ede0c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:17:59.613426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1b8932a2-d30a-410b-ad69-ba80cd9ede0c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:17:59.620554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b8932a2-d30a-410b-ad69-ba80cd9ede0c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:59.621120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b8932a2-d30a-410b-ad69-ba80cd9ede0c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:59.621885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b8932a2-d30a-410b-ad69-ba80cd9ede0c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:59.622329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b8932a2-d30a-410b-ad69-ba80cd9ede0c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:17:59.622800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b8932a2-d30a-410b-ad69-ba80cd9ede0c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:17:59.623245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b8932a2-d30a-410b-ad69-ba80cd9ede0c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:17:59.736121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1b8932a2-d30a-410b-ad69-ba80cd9ede0c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:17:59.748216 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1b8932a2-d30a-410b-ad69-ba80cd9ede0c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1278 microversion: 2.1 time: 0.138932 Oct 11 00:17:59.750175 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3788/7051] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:17:59 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1278 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:00.017613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-79bb65e5-6a80-4c40-aba7-74a96074508d req-8f8bbb61-314c-4d39-8f88-08401d37c891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1353bbe9-3485-4c95-bd9b-c7560b6bab0d", "name": "network-vif-deleted", "tag": "1ef9acc6-9016-4863-8f66-44835a266895"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:18:00.034114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-79bb65e5-6a80-4c40-aba7-74a96074508d req-8f8bbb61-314c-4d39-8f88-08401d37c891 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:00.034681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-79bb65e5-6a80-4c40-aba7-74a96074508d req-8f8bbb61-314c-4d39-8f88-08401d37c891 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:00.035135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-79bb65e5-6a80-4c40-aba7-74a96074508d req-8f8bbb61-314c-4d39-8f88-08401d37c891 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:00.063365 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-79bb65e5-6a80-4c40-aba7-74a96074508d req-8f8bbb61-314c-4d39-8f88-08401d37c891 service nova] Creating event network-vif-deleted:1ef9acc6-9016-4863-8f66-44835a266895 for instance 1353bbe9-3485-4c95-bd9b-c7560b6bab0d on n-h1-860864-2 Oct 11 00:18:00.083980 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-79bb65e5-6a80-4c40-aba7-74a96074508d req-8f8bbb61-314c-4d39-8f88-08401d37c891 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072916 Oct 11 00:18:00.085742 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3789/7052] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:18:00.775527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ac7392fc-4e28-4d0b-8159-77e1c782f0ad tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:00.776342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ac7392fc-4e28-4d0b-8159-77e1c782f0ad tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:00.783806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac7392fc-4e28-4d0b-8159-77e1c782f0ad tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:00.784321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac7392fc-4e28-4d0b-8159-77e1c782f0ad tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:00.784776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac7392fc-4e28-4d0b-8159-77e1c782f0ad tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:00.785527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac7392fc-4e28-4d0b-8159-77e1c782f0ad tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:00.786002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac7392fc-4e28-4d0b-8159-77e1c782f0ad tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:00.786452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac7392fc-4e28-4d0b-8159-77e1c782f0ad tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:01.044734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ac7392fc-4e28-4d0b-8159-77e1c782f0ad tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:01.053118 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ac7392fc-4e28-4d0b-8159-77e1c782f0ad tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1318 microversion: 2.1 time: 0.281740 Oct 11 00:18:01.053881 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3790/7053] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:00 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:01.270008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-82c9fb2a-63ca-415b-bff1-2d547f5cdf39 req-123d7e94-3ae6-4631-84e1-23e78dd6d103 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94f90da5-651d-49d8-a7cb-7d57deb4820d", "tag": "3cb9edc3-4ea8-402d-8f88-13eff533ebfd"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:18:01.281791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-82c9fb2a-63ca-415b-bff1-2d547f5cdf39 req-123d7e94-3ae6-4631-84e1-23e78dd6d103 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:01.282292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-82c9fb2a-63ca-415b-bff1-2d547f5cdf39 req-123d7e94-3ae6-4631-84e1-23e78dd6d103 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:01.282742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-82c9fb2a-63ca-415b-bff1-2d547f5cdf39 req-123d7e94-3ae6-4631-84e1-23e78dd6d103 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:01.296620 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-82c9fb2a-63ca-415b-bff1-2d547f5cdf39 req-123d7e94-3ae6-4631-84e1-23e78dd6d103 service nova] Creating event network-changed:3cb9edc3-4ea8-402d-8f88-13eff533ebfd for instance 94f90da5-651d-49d8-a7cb-7d57deb4820d on n-h1-860864-2 Oct 11 00:18:01.302471 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-82c9fb2a-63ca-415b-bff1-2d547f5cdf39 req-123d7e94-3ae6-4631-84e1-23e78dd6d103 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036150 Oct 11 00:18:01.303272 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3791/7054] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:18:02.081112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6b8020b6-df89-42be-9d68-380d1a7b4e0a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:02.081818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6b8020b6-df89-42be-9d68-380d1a7b4e0a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:02.087932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b8020b6-df89-42be-9d68-380d1a7b4e0a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:02.088423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b8020b6-df89-42be-9d68-380d1a7b4e0a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:02.088877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b8020b6-df89-42be-9d68-380d1a7b4e0a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:02.089615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b8020b6-df89-42be-9d68-380d1a7b4e0a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:02.090622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b8020b6-df89-42be-9d68-380d1a7b4e0a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:02.091071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6b8020b6-df89-42be-9d68-380d1a7b4e0a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:02.220024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6b8020b6-df89-42be-9d68-380d1a7b4e0a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:02.227773 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6b8020b6-df89-42be-9d68-380d1a7b4e0a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1318 microversion: 2.1 time: 0.151886 Oct 11 00:18:02.228349 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3792/7055] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:02 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:18:03.252645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2f67579d-6414-4e7f-ab5c-4da583b48f00 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:03.254043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2f67579d-6414-4e7f-ab5c-4da583b48f00 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:03.261205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f67579d-6414-4e7f-ab5c-4da583b48f00 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:03.262462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f67579d-6414-4e7f-ab5c-4da583b48f00 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:03.262884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f67579d-6414-4e7f-ab5c-4da583b48f00 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:03.263615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f67579d-6414-4e7f-ab5c-4da583b48f00 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:03.264089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f67579d-6414-4e7f-ab5c-4da583b48f00 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:03.264538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2f67579d-6414-4e7f-ab5c-4da583b48f00 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:03.407083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2f67579d-6414-4e7f-ab5c-4da583b48f00 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:03.415654 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2f67579d-6414-4e7f-ab5c-4da583b48f00 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1318 microversion: 2.1 time: 0.166752 Oct 11 00:18:03.416192 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3793/7056] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:03 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:04.439614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5aaa9f3b-e0d9-4621-83d7-004616ed98e8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:04.440286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5aaa9f3b-e0d9-4621-83d7-004616ed98e8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:04.447213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5aaa9f3b-e0d9-4621-83d7-004616ed98e8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:04.447709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5aaa9f3b-e0d9-4621-83d7-004616ed98e8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:04.448163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5aaa9f3b-e0d9-4621-83d7-004616ed98e8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:04.448898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5aaa9f3b-e0d9-4621-83d7-004616ed98e8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:04.449362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5aaa9f3b-e0d9-4621-83d7-004616ed98e8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:04.450782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5aaa9f3b-e0d9-4621-83d7-004616ed98e8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:04.580656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5aaa9f3b-e0d9-4621-83d7-004616ed98e8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:04.588514 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5aaa9f3b-e0d9-4621-83d7-004616ed98e8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1318 microversion: 2.1 time: 0.152778 Oct 11 00:18:04.589095 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3794/7057] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:04 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:18:05.612213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a16bc10d-89a7-4d92-8a88-9d3f1b09088a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:05.612847 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a16bc10d-89a7-4d92-8a88-9d3f1b09088a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:05.619822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a16bc10d-89a7-4d92-8a88-9d3f1b09088a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:05.620322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a16bc10d-89a7-4d92-8a88-9d3f1b09088a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:05.620775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a16bc10d-89a7-4d92-8a88-9d3f1b09088a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:05.621623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a16bc10d-89a7-4d92-8a88-9d3f1b09088a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:05.622859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a16bc10d-89a7-4d92-8a88-9d3f1b09088a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:05.623312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a16bc10d-89a7-4d92-8a88-9d3f1b09088a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:05.753069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a16bc10d-89a7-4d92-8a88-9d3f1b09088a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:05.761021 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a16bc10d-89a7-4d92-8a88-9d3f1b09088a tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1318 microversion: 2.1 time: 0.152735 Oct 11 00:18:05.761617 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3795/7058] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:05 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:06.784118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-55b17de5-dd63-4590-8fb1-4c4a038690e1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:06.784772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-55b17de5-dd63-4590-8fb1-4c4a038690e1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:06.787793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:18:06.794544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55b17de5-dd63-4590-8fb1-4c4a038690e1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:06.795052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55b17de5-dd63-4590-8fb1-4c4a038690e1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:06.795506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55b17de5-dd63-4590-8fb1-4c4a038690e1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:06.796311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55b17de5-dd63-4590-8fb1-4c4a038690e1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:06.796767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55b17de5-dd63-4590-8fb1-4c4a038690e1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:06.797210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55b17de5-dd63-4590-8fb1-4c4a038690e1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:06.944342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-55b17de5-dd63-4590-8fb1-4c4a038690e1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:06.952939 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-55b17de5-dd63-4590-8fb1-4c4a038690e1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1318 microversion: 2.1 time: 0.172960 Oct 11 00:18:06.953557 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3796/7059] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:06 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:06.957927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-d455070a-364a-4392-8ecc-eee96cae0561 req-912a8df8-6ab2-4111-80fa-8dd09775c701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94f90da5-651d-49d8-a7cb-7d57deb4820d", "name": "network-vif-plugged", "status": "completed", "tag": "3cb9edc3-4ea8-402d-8f88-13eff533ebfd"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:18:06.967300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d455070a-364a-4392-8ecc-eee96cae0561 req-912a8df8-6ab2-4111-80fa-8dd09775c701 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:06.968398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d455070a-364a-4392-8ecc-eee96cae0561 req-912a8df8-6ab2-4111-80fa-8dd09775c701 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:06.968885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d455070a-364a-4392-8ecc-eee96cae0561 req-912a8df8-6ab2-4111-80fa-8dd09775c701 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:06.972773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:18:06.980503 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-d455070a-364a-4392-8ecc-eee96cae0561 req-912a8df8-6ab2-4111-80fa-8dd09775c701 service nova] Creating event network-vif-plugged:3cb9edc3-4ea8-402d-8f88-13eff533ebfd for instance 94f90da5-651d-49d8-a7cb-7d57deb4820d on n-h1-860864-2 Oct 11 00:18:06.985741 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-d455070a-364a-4392-8ecc-eee96cae0561 req-912a8df8-6ab2-4111-80fa-8dd09775c701 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030936 Oct 11 00:18:06.986415 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3797/7060] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:18:07.978079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fd996dc4-8016-46ff-a34f-b9ce8b88777c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:07.978787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fd996dc4-8016-46ff-a34f-b9ce8b88777c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:07.985855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd996dc4-8016-46ff-a34f-b9ce8b88777c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:07.986347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd996dc4-8016-46ff-a34f-b9ce8b88777c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:07.986795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd996dc4-8016-46ff-a34f-b9ce8b88777c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:07.987493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd996dc4-8016-46ff-a34f-b9ce8b88777c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:07.987957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd996dc4-8016-46ff-a34f-b9ce8b88777c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:07.988393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd996dc4-8016-46ff-a34f-b9ce8b88777c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:08.120110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fd996dc4-8016-46ff-a34f-b9ce8b88777c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:08.128242 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fd996dc4-8016-46ff-a34f-b9ce8b88777c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1318 microversion: 2.1 time: 0.155723 Oct 11 00:18:08.128815 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3798/7061] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:07 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:09.152228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e323ae96-64aa-4473-b388-57b190c274a2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:09.153424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e323ae96-64aa-4473-b388-57b190c274a2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:09.155397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:18:09.156103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=12 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:18:09.163333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e323ae96-64aa-4473-b388-57b190c274a2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:09.163833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e323ae96-64aa-4473-b388-57b190c274a2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:09.164285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e323ae96-64aa-4473-b388-57b190c274a2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:09.164993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e323ae96-64aa-4473-b388-57b190c274a2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:09.165488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e323ae96-64aa-4473-b388-57b190c274a2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:09.165926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e323ae96-64aa-4473-b388-57b190c274a2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:09.297225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e323ae96-64aa-4473-b388-57b190c274a2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:09.305334 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e323ae96-64aa-4473-b388-57b190c274a2 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1509 microversion: 2.1 time: 0.156978 Oct 11 00:18:09.305938 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3799/7062] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:09 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:09.328654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-10b22e24-4cf6-420c-b7d3-42ceeafb3131 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:09.329277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-10b22e24-4cf6-420c-b7d3-42ceeafb3131 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:09.335454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10b22e24-4cf6-420c-b7d3-42ceeafb3131 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:09.336051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10b22e24-4cf6-420c-b7d3-42ceeafb3131 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:09.336552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10b22e24-4cf6-420c-b7d3-42ceeafb3131 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:09.337327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10b22e24-4cf6-420c-b7d3-42ceeafb3131 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:09.338209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10b22e24-4cf6-420c-b7d3-42ceeafb3131 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:09.338466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10b22e24-4cf6-420c-b7d3-42ceeafb3131 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:09.465146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-10b22e24-4cf6-420c-b7d3-42ceeafb3131 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:09.473793 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-10b22e24-4cf6-420c-b7d3-42ceeafb3131 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1509 microversion: 2.1 time: 0.149452 Oct 11 00:18:09.474378 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3800/7063] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:09 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:09.495506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a85ca5b3-f9ea-46aa-8221-2189e5ff979b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:18:09.497749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a85ca5b3-f9ea-46aa-8221-2189e5ff979b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:09.503437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a85ca5b3-f9ea-46aa-8221-2189e5ff979b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:09.503930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a85ca5b3-f9ea-46aa-8221-2189e5ff979b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:09.504378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a85ca5b3-f9ea-46aa-8221-2189e5ff979b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:09.505076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a85ca5b3-f9ea-46aa-8221-2189e5ff979b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:09.505598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a85ca5b3-f9ea-46aa-8221-2189e5ff979b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:09.506034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a85ca5b3-f9ea-46aa-8221-2189e5ff979b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:09.534559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a85ca5b3-f9ea-46aa-8221-2189e5ff979b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:09.539911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a85ca5b3-f9ea-46aa-8221-2189e5ff979b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Old instance type m1.heat2, new instance type m1.heat {{(pid=120613) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 00:18:09.546717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a85ca5b3-f9ea-46aa-8221-2189e5ff979b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:18:09.547150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a85ca5b3-f9ea-46aa-8221-2189e5ff979b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:18:09.547631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a85ca5b3-f9ea-46aa-8221-2189e5ff979b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:18:09.548050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a85ca5b3-f9ea-46aa-8221-2189e5ff979b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:18:09.548466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-a85ca5b3-f9ea-46aa-8221-2189e5ff979b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:18:09.613535 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a85ca5b3-f9ea-46aa-8221-2189e5ff979b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "POST /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d/action" status: 202 len: 0 microversion: 2.1 time: 0.121547 Oct 11 00:18:09.614150 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3801/7064] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:18:09 2022] POST /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:18:09.622147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-53f7a152-e057-440e-b20e-55763aad37ec tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:09.622857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-53f7a152-e057-440e-b20e-55763aad37ec tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:09.629587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53f7a152-e057-440e-b20e-55763aad37ec tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:09.629731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53f7a152-e057-440e-b20e-55763aad37ec tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:09.630076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53f7a152-e057-440e-b20e-55763aad37ec tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:09.630794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53f7a152-e057-440e-b20e-55763aad37ec tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:09.631276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53f7a152-e057-440e-b20e-55763aad37ec tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:09.631724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-53f7a152-e057-440e-b20e-55763aad37ec tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:09.775621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-53f7a152-e057-440e-b20e-55763aad37ec tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:09.784008 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-53f7a152-e057-440e-b20e-55763aad37ec tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1516 microversion: 2.1 time: 0.165695 Oct 11 00:18:09.784807 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3802/7065] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:09 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:10.807157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-51c918b0-6b97-4fc1-9e37-778e167590a1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:10.807780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-51c918b0-6b97-4fc1-9e37-778e167590a1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:10.815711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51c918b0-6b97-4fc1-9e37-778e167590a1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:10.816212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51c918b0-6b97-4fc1-9e37-778e167590a1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:10.817082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51c918b0-6b97-4fc1-9e37-778e167590a1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:10.817356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51c918b0-6b97-4fc1-9e37-778e167590a1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:10.817841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51c918b0-6b97-4fc1-9e37-778e167590a1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:10.818281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-51c918b0-6b97-4fc1-9e37-778e167590a1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:10.955569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-51c918b0-6b97-4fc1-9e37-778e167590a1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:10.966108 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-51c918b0-6b97-4fc1-9e37-778e167590a1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1516 microversion: 2.1 time: 0.162672 Oct 11 00:18:10.967032 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3803/7066] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:10 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:18:11.990846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-34e3d07e-db67-4935-af9e-a4f6af97316c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:11.991498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-34e3d07e-db67-4935-af9e-a4f6af97316c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:11.998791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34e3d07e-db67-4935-af9e-a4f6af97316c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:11.999292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34e3d07e-db67-4935-af9e-a4f6af97316c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:11.999743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34e3d07e-db67-4935-af9e-a4f6af97316c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:12.000449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34e3d07e-db67-4935-af9e-a4f6af97316c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:12.000927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34e3d07e-db67-4935-af9e-a4f6af97316c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:12.001369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-34e3d07e-db67-4935-af9e-a4f6af97316c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:12.129268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-34e3d07e-db67-4935-af9e-a4f6af97316c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:12.136975 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-34e3d07e-db67-4935-af9e-a4f6af97316c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1521 microversion: 2.1 time: 0.150137 Oct 11 00:18:12.138181 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3804/7067] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:11 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:13.160234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f393ec2f-3d86-467e-95d2-e172357a8cf0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:13.160912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f393ec2f-3d86-467e-95d2-e172357a8cf0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:13.167765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f393ec2f-3d86-467e-95d2-e172357a8cf0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:13.168263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f393ec2f-3d86-467e-95d2-e172357a8cf0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:13.168722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f393ec2f-3d86-467e-95d2-e172357a8cf0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:13.169494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f393ec2f-3d86-467e-95d2-e172357a8cf0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:13.169965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f393ec2f-3d86-467e-95d2-e172357a8cf0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:13.170402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f393ec2f-3d86-467e-95d2-e172357a8cf0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:13.304201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f393ec2f-3d86-467e-95d2-e172357a8cf0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:13.312450 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f393ec2f-3d86-467e-95d2-e172357a8cf0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1521 microversion: 2.1 time: 0.156191 Oct 11 00:18:13.313023 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3805/7068] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:13 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:14.337788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e8913f6a-97e1-4699-bb13-2f37c4ff2c71 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:14.338426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e8913f6a-97e1-4699-bb13-2f37c4ff2c71 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:14.346388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8913f6a-97e1-4699-bb13-2f37c4ff2c71 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:14.346890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8913f6a-97e1-4699-bb13-2f37c4ff2c71 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:14.347340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8913f6a-97e1-4699-bb13-2f37c4ff2c71 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:14.348046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8913f6a-97e1-4699-bb13-2f37c4ff2c71 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:14.348512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8913f6a-97e1-4699-bb13-2f37c4ff2c71 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:14.348945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e8913f6a-97e1-4699-bb13-2f37c4ff2c71 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:14.478952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e8913f6a-97e1-4699-bb13-2f37c4ff2c71 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:14.487425 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e8913f6a-97e1-4699-bb13-2f37c4ff2c71 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1521 microversion: 2.1 time: 0.153643 Oct 11 00:18:14.488003 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3806/7069] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:14 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:15.510553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-27e58e13-110f-417b-a7c3-35e93125e9f7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:15.511226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-27e58e13-110f-417b-a7c3-35e93125e9f7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:15.518291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27e58e13-110f-417b-a7c3-35e93125e9f7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:15.518809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27e58e13-110f-417b-a7c3-35e93125e9f7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:15.519247 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27e58e13-110f-417b-a7c3-35e93125e9f7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:15.519989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27e58e13-110f-417b-a7c3-35e93125e9f7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:15.520460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27e58e13-110f-417b-a7c3-35e93125e9f7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:15.520905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27e58e13-110f-417b-a7c3-35e93125e9f7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:15.652449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-27e58e13-110f-417b-a7c3-35e93125e9f7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:15.660350 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-27e58e13-110f-417b-a7c3-35e93125e9f7 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1521 microversion: 2.1 time: 0.153755 Oct 11 00:18:15.660924 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3807/7070] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:15 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:16.684197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ea844a95-80b8-4a0f-9ce9-a797588d8046 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:16.684867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ea844a95-80b8-4a0f-9ce9-a797588d8046 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:16.691774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea844a95-80b8-4a0f-9ce9-a797588d8046 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:16.692266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea844a95-80b8-4a0f-9ce9-a797588d8046 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:16.692709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea844a95-80b8-4a0f-9ce9-a797588d8046 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:16.693431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea844a95-80b8-4a0f-9ce9-a797588d8046 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:16.693997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea844a95-80b8-4a0f-9ce9-a797588d8046 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:16.694438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea844a95-80b8-4a0f-9ce9-a797588d8046 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:16.827580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ea844a95-80b8-4a0f-9ce9-a797588d8046 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:16.835434 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ea844a95-80b8-4a0f-9ce9-a797588d8046 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1521 microversion: 2.1 time: 0.155137 Oct 11 00:18:16.836021 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3808/7071] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:16 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:17.858558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4c493449-7f1e-4a91-9801-e7bd379236b1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:17.859194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4c493449-7f1e-4a91-9801-e7bd379236b1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:17.866100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c493449-7f1e-4a91-9801-e7bd379236b1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:17.866601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c493449-7f1e-4a91-9801-e7bd379236b1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:17.867053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c493449-7f1e-4a91-9801-e7bd379236b1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:17.867758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c493449-7f1e-4a91-9801-e7bd379236b1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:17.868227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c493449-7f1e-4a91-9801-e7bd379236b1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:17.868667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4c493449-7f1e-4a91-9801-e7bd379236b1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:17.999731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4c493449-7f1e-4a91-9801-e7bd379236b1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:18.007488 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4c493449-7f1e-4a91-9801-e7bd379236b1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1521 microversion: 2.1 time: 0.153039 Oct 11 00:18:18.008088 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3809/7072] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:17 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:19.031873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-da275885-e067-47db-946d-df2e4505a6fc tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:19.032527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-da275885-e067-47db-946d-df2e4505a6fc tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:19.039288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da275885-e067-47db-946d-df2e4505a6fc tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:19.039784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da275885-e067-47db-946d-df2e4505a6fc tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:19.040234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da275885-e067-47db-946d-df2e4505a6fc tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:19.040945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da275885-e067-47db-946d-df2e4505a6fc tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:19.041435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da275885-e067-47db-946d-df2e4505a6fc tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:19.041883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da275885-e067-47db-946d-df2e4505a6fc tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:19.178396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-da275885-e067-47db-946d-df2e4505a6fc tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:19.187154 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-da275885-e067-47db-946d-df2e4505a6fc tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1521 microversion: 2.1 time: 0.159040 Oct 11 00:18:19.187365 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3810/7073] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:19 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:20.210655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-85d0882e-e4de-4b7e-abea-64f78e81116d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:20.211295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-85d0882e-e4de-4b7e-abea-64f78e81116d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:20.218631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85d0882e-e4de-4b7e-abea-64f78e81116d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:20.219669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85d0882e-e4de-4b7e-abea-64f78e81116d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:20.220127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85d0882e-e4de-4b7e-abea-64f78e81116d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:20.220838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85d0882e-e4de-4b7e-abea-64f78e81116d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:20.221310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85d0882e-e4de-4b7e-abea-64f78e81116d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:20.221914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-85d0882e-e4de-4b7e-abea-64f78e81116d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:20.355949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-85d0882e-e4de-4b7e-abea-64f78e81116d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:20.364076 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-85d0882e-e4de-4b7e-abea-64f78e81116d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1521 microversion: 2.1 time: 0.157212 Oct 11 00:18:20.364665 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3811/7074] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:20 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:21.387860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3e3747e1-cbb8-4ae4-a83c-af27300ee945 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:21.388600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3e3747e1-cbb8-4ae4-a83c-af27300ee945 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:21.396946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e3747e1-cbb8-4ae4-a83c-af27300ee945 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:21.397475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e3747e1-cbb8-4ae4-a83c-af27300ee945 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:21.397931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e3747e1-cbb8-4ae4-a83c-af27300ee945 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:21.398658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e3747e1-cbb8-4ae4-a83c-af27300ee945 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:21.399129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e3747e1-cbb8-4ae4-a83c-af27300ee945 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:21.399570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e3747e1-cbb8-4ae4-a83c-af27300ee945 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:21.535167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3e3747e1-cbb8-4ae4-a83c-af27300ee945 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:21.543065 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3e3747e1-cbb8-4ae4-a83c-af27300ee945 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1521 microversion: 2.1 time: 0.159216 Oct 11 00:18:21.543648 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3812/7075] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:21 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:22.566503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-13b81da2-7136-4776-af31-ba7ae2fe0940 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:22.567175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-13b81da2-7136-4776-af31-ba7ae2fe0940 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:22.574049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13b81da2-7136-4776-af31-ba7ae2fe0940 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:22.574557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13b81da2-7136-4776-af31-ba7ae2fe0940 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:22.575014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13b81da2-7136-4776-af31-ba7ae2fe0940 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:22.575733 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13b81da2-7136-4776-af31-ba7ae2fe0940 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:22.576208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13b81da2-7136-4776-af31-ba7ae2fe0940 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:22.577153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13b81da2-7136-4776-af31-ba7ae2fe0940 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:22.581763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:18:22.709136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-13b81da2-7136-4776-af31-ba7ae2fe0940 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:22.717293 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-13b81da2-7136-4776-af31-ba7ae2fe0940 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1521 microversion: 2.1 time: 0.154552 Oct 11 00:18:22.718506 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3813/7076] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:22 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:18:23.740316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a3961696-9126-4b2e-b8d9-40803ad03721 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:23.740950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a3961696-9126-4b2e-b8d9-40803ad03721 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:23.747889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3961696-9126-4b2e-b8d9-40803ad03721 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:23.748388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3961696-9126-4b2e-b8d9-40803ad03721 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:23.748910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3961696-9126-4b2e-b8d9-40803ad03721 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:23.749650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3961696-9126-4b2e-b8d9-40803ad03721 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:23.750122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3961696-9126-4b2e-b8d9-40803ad03721 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:23.750563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3961696-9126-4b2e-b8d9-40803ad03721 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:23.888457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a3961696-9126-4b2e-b8d9-40803ad03721 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:23.896466 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a3961696-9126-4b2e-b8d9-40803ad03721 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1521 microversion: 2.1 time: 0.160028 Oct 11 00:18:23.897052 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3814/7077] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:23 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:24.921099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5173f2fd-c439-48ce-943d-a3a508245955 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:24.921865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5173f2fd-c439-48ce-943d-a3a508245955 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:24.929124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5173f2fd-c439-48ce-943d-a3a508245955 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:24.929654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5173f2fd-c439-48ce-943d-a3a508245955 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:24.930100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5173f2fd-c439-48ce-943d-a3a508245955 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:24.930805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5173f2fd-c439-48ce-943d-a3a508245955 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:24.931271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5173f2fd-c439-48ce-943d-a3a508245955 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:24.931710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5173f2fd-c439-48ce-943d-a3a508245955 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:25.062993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5173f2fd-c439-48ce-943d-a3a508245955 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:25.070843 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5173f2fd-c439-48ce-943d-a3a508245955 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1521 microversion: 2.1 time: 0.153711 Oct 11 00:18:25.071346 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3815/7078] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:24 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:26.094682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b6664089-4244-41a1-a933-1e7149c00794 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:26.095997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b6664089-4244-41a1-a933-1e7149c00794 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:26.103104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6664089-4244-41a1-a933-1e7149c00794 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:26.103596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6664089-4244-41a1-a933-1e7149c00794 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:26.104047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6664089-4244-41a1-a933-1e7149c00794 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:26.104765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6664089-4244-41a1-a933-1e7149c00794 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:26.105230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6664089-4244-41a1-a933-1e7149c00794 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:26.105697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b6664089-4244-41a1-a933-1e7149c00794 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:26.251019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b6664089-4244-41a1-a933-1e7149c00794 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:26.260358 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b6664089-4244-41a1-a933-1e7149c00794 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1521 microversion: 2.1 time: 0.169619 Oct 11 00:18:26.260950 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3816/7079] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:26 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:27.284299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-01df027f-0f49-4607-9089-3a15aa84e6a6 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:27.284972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-01df027f-0f49-4607-9089-3a15aa84e6a6 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:27.292209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01df027f-0f49-4607-9089-3a15aa84e6a6 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:27.292710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01df027f-0f49-4607-9089-3a15aa84e6a6 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:27.293162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01df027f-0f49-4607-9089-3a15aa84e6a6 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:27.293897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01df027f-0f49-4607-9089-3a15aa84e6a6 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:27.294366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01df027f-0f49-4607-9089-3a15aa84e6a6 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:27.294811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01df027f-0f49-4607-9089-3a15aa84e6a6 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:27.430787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-01df027f-0f49-4607-9089-3a15aa84e6a6 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:27.438501 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-01df027f-0f49-4607-9089-3a15aa84e6a6 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1521 microversion: 2.1 time: 0.158279 Oct 11 00:18:27.439684 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3817/7080] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:27 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:28.463994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7765e435-6d7b-406b-a842-bb009cdbd71c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:28.464666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7765e435-6d7b-406b-a842-bb009cdbd71c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:28.473044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7765e435-6d7b-406b-a842-bb009cdbd71c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:28.473584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7765e435-6d7b-406b-a842-bb009cdbd71c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:28.474039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7765e435-6d7b-406b-a842-bb009cdbd71c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:28.474765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7765e435-6d7b-406b-a842-bb009cdbd71c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:28.475232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7765e435-6d7b-406b-a842-bb009cdbd71c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:28.475675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7765e435-6d7b-406b-a842-bb009cdbd71c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:28.608621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7765e435-6d7b-406b-a842-bb009cdbd71c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:28.617816 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7765e435-6d7b-406b-a842-bb009cdbd71c tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1521 microversion: 2.1 time: 0.158221 Oct 11 00:18:28.618450 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3818/7081] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:28 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:18:29.641890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e9a5c002-a32c-4071-b708-5512a0beda64 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:29.643319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e9a5c002-a32c-4071-b708-5512a0beda64 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:29.650225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9a5c002-a32c-4071-b708-5512a0beda64 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:29.650726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9a5c002-a32c-4071-b708-5512a0beda64 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:29.651180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9a5c002-a32c-4071-b708-5512a0beda64 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:29.651915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9a5c002-a32c-4071-b708-5512a0beda64 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:29.652367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9a5c002-a32c-4071-b708-5512a0beda64 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:29.652809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e9a5c002-a32c-4071-b708-5512a0beda64 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:29.787095 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e9a5c002-a32c-4071-b708-5512a0beda64 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:29.795086 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e9a5c002-a32c-4071-b708-5512a0beda64 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1521 microversion: 2.1 time: 0.157007 Oct 11 00:18:29.795676 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3819/7082] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:29 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:30.819483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9da650d1-9811-425c-8095-5314dbe99f79 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:30.820116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9da650d1-9811-425c-8095-5314dbe99f79 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:30.827316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9da650d1-9811-425c-8095-5314dbe99f79 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:30.827813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9da650d1-9811-425c-8095-5314dbe99f79 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:30.828259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9da650d1-9811-425c-8095-5314dbe99f79 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:30.828978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9da650d1-9811-425c-8095-5314dbe99f79 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:30.829950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9da650d1-9811-425c-8095-5314dbe99f79 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:30.830776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9da650d1-9811-425c-8095-5314dbe99f79 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:30.965108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9da650d1-9811-425c-8095-5314dbe99f79 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:30.973728 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9da650d1-9811-425c-8095-5314dbe99f79 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1521 microversion: 2.1 time: 0.158358 Oct 11 00:18:30.974319 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3820/7083] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:30 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:31.996368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fc5778d2-84cc-4c61-a43b-c237ca359427 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:31.997078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fc5778d2-84cc-4c61-a43b-c237ca359427 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:32.003988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc5778d2-84cc-4c61-a43b-c237ca359427 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:32.004491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc5778d2-84cc-4c61-a43b-c237ca359427 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:32.004942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc5778d2-84cc-4c61-a43b-c237ca359427 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:32.005738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc5778d2-84cc-4c61-a43b-c237ca359427 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:32.006163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc5778d2-84cc-4c61-a43b-c237ca359427 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:32.006609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fc5778d2-84cc-4c61-a43b-c237ca359427 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:32.143001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fc5778d2-84cc-4c61-a43b-c237ca359427 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:32.151077 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fc5778d2-84cc-4c61-a43b-c237ca359427 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1521 microversion: 2.1 time: 0.158666 Oct 11 00:18:32.151875 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3821/7084] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:31 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:33.182144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-69c2692e-c799-471c-b45f-138af916ca4d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:33.182831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-69c2692e-c799-471c-b45f-138af916ca4d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:33.189806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69c2692e-c799-471c-b45f-138af916ca4d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:33.190405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69c2692e-c799-471c-b45f-138af916ca4d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:33.191310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69c2692e-c799-471c-b45f-138af916ca4d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:33.192042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69c2692e-c799-471c-b45f-138af916ca4d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:33.192516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69c2692e-c799-471c-b45f-138af916ca4d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:33.192959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-69c2692e-c799-471c-b45f-138af916ca4d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:33.333212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-69c2692e-c799-471c-b45f-138af916ca4d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:33.341043 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-69c2692e-c799-471c-b45f-138af916ca4d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1521 microversion: 2.1 time: 0.166329 Oct 11 00:18:33.341648 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3822/7085] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:33 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:18:34.364280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-40b5a05b-9eec-417b-ab0e-dfee80a23d7d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:34.365026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-40b5a05b-9eec-417b-ab0e-dfee80a23d7d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:34.371909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40b5a05b-9eec-417b-ab0e-dfee80a23d7d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:34.372406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40b5a05b-9eec-417b-ab0e-dfee80a23d7d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:34.372859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40b5a05b-9eec-417b-ab0e-dfee80a23d7d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:34.373627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40b5a05b-9eec-417b-ab0e-dfee80a23d7d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:34.374094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40b5a05b-9eec-417b-ab0e-dfee80a23d7d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:34.374535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40b5a05b-9eec-417b-ab0e-dfee80a23d7d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:34.505537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-40b5a05b-9eec-417b-ab0e-dfee80a23d7d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:34.513489 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-40b5a05b-9eec-417b-ab0e-dfee80a23d7d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1521 microversion: 2.1 time: 0.153214 Oct 11 00:18:34.514063 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3823/7086] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:34 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:35.537159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1f659d38-992a-40c8-9030-c56b48269667 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:35.537815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1f659d38-992a-40c8-9030-c56b48269667 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:35.544685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f659d38-992a-40c8-9030-c56b48269667 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:35.545183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f659d38-992a-40c8-9030-c56b48269667 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:35.545673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f659d38-992a-40c8-9030-c56b48269667 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:35.546380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f659d38-992a-40c8-9030-c56b48269667 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:35.546878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f659d38-992a-40c8-9030-c56b48269667 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:35.547321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f659d38-992a-40c8-9030-c56b48269667 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:35.683207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1f659d38-992a-40c8-9030-c56b48269667 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:35.691141 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1f659d38-992a-40c8-9030-c56b48269667 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1521 microversion: 2.1 time: 0.158417 Oct 11 00:18:35.691721 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3824/7087] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:35 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:36.714400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b75cc68e-6edb-4aca-a65a-a14d6135aba8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:36.715077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b75cc68e-6edb-4aca-a65a-a14d6135aba8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:36.722105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b75cc68e-6edb-4aca-a65a-a14d6135aba8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:36.722606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b75cc68e-6edb-4aca-a65a-a14d6135aba8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:36.723061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b75cc68e-6edb-4aca-a65a-a14d6135aba8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:36.723772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b75cc68e-6edb-4aca-a65a-a14d6135aba8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:36.724241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b75cc68e-6edb-4aca-a65a-a14d6135aba8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:36.724728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b75cc68e-6edb-4aca-a65a-a14d6135aba8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:36.856832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b75cc68e-6edb-4aca-a65a-a14d6135aba8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:36.865206 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b75cc68e-6edb-4aca-a65a-a14d6135aba8 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1521 microversion: 2.1 time: 0.154716 Oct 11 00:18:36.865812 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3825/7088] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:36 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:37.888361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c2337eb1-7336-4bd9-bcd9-826fdf6d8344 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:37.889040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c2337eb1-7336-4bd9-bcd9-826fdf6d8344 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:37.891515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=64 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:18:37.897960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2337eb1-7336-4bd9-bcd9-826fdf6d8344 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:37.898463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2337eb1-7336-4bd9-bcd9-826fdf6d8344 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:37.898912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2337eb1-7336-4bd9-bcd9-826fdf6d8344 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:37.899625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2337eb1-7336-4bd9-bcd9-826fdf6d8344 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:37.900086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2337eb1-7336-4bd9-bcd9-826fdf6d8344 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:37.900521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c2337eb1-7336-4bd9-bcd9-826fdf6d8344 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:38.041515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c2337eb1-7336-4bd9-bcd9-826fdf6d8344 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:38.051030 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c2337eb1-7336-4bd9-bcd9-826fdf6d8344 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1521 microversion: 2.1 time: 0.166529 Oct 11 00:18:38.051627 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3826/7089] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:37 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:39.063849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-2063b957-2c88-4fa7-a442-4babfdbba860 req-cb700413-c7d4-498c-831b-30dbba9f19a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94f90da5-651d-49d8-a7cb-7d57deb4820d", "name": "network-vif-unplugged", "status": "completed", "tag": "3cb9edc3-4ea8-402d-8f88-13eff533ebfd"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:18:39.074951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2063b957-2c88-4fa7-a442-4babfdbba860 req-cb700413-c7d4-498c-831b-30dbba9f19a4 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:39.075670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2063b957-2c88-4fa7-a442-4babfdbba860 req-cb700413-c7d4-498c-831b-30dbba9f19a4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:39.076296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-2063b957-2c88-4fa7-a442-4babfdbba860 req-cb700413-c7d4-498c-831b-30dbba9f19a4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:39.089683 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-2063b957-2c88-4fa7-a442-4babfdbba860 req-cb700413-c7d4-498c-831b-30dbba9f19a4 service nova] Creating event network-vif-unplugged:3cb9edc3-4ea8-402d-8f88-13eff533ebfd for instance 94f90da5-651d-49d8-a7cb-7d57deb4820d on n-h2-860864-2 Oct 11 00:18:39.095804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-2063b957-2c88-4fa7-a442-4babfdbba860 req-cb700413-c7d4-498c-831b-30dbba9f19a4 service nova] Instance 94f90da5-651d-49d8-a7cb-7d57deb4820d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 00:18:39.107665 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-2063b957-2c88-4fa7-a442-4babfdbba860 req-cb700413-c7d4-498c-831b-30dbba9f19a4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047928 Oct 11 00:18:39.108454 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3827/7090] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:18:39.113769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-20a383fb-393c-4015-a174-90fbd7e8ff7b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:39.114477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-20a383fb-393c-4015-a174-90fbd7e8ff7b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:39.121090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-20a383fb-393c-4015-a174-90fbd7e8ff7b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:39.121523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-20a383fb-393c-4015-a174-90fbd7e8ff7b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:39.121944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-20a383fb-393c-4015-a174-90fbd7e8ff7b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:39.122659 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-20a383fb-393c-4015-a174-90fbd7e8ff7b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:39.123121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-20a383fb-393c-4015-a174-90fbd7e8ff7b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:39.123558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-20a383fb-393c-4015-a174-90fbd7e8ff7b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:39.353396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-20a383fb-393c-4015-a174-90fbd7e8ff7b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:39.361175 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-20a383fb-393c-4015-a174-90fbd7e8ff7b tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1520 microversion: 2.1 time: 0.251516 Oct 11 00:18:39.361785 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3828/7091] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:39 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:18:40.385665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2849981f-4292-41ad-8090-98f6450aedd5 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:40.386289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2849981f-4292-41ad-8090-98f6450aedd5 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:40.393341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2849981f-4292-41ad-8090-98f6450aedd5 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:40.393912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2849981f-4292-41ad-8090-98f6450aedd5 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:40.394374 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2849981f-4292-41ad-8090-98f6450aedd5 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:40.395093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2849981f-4292-41ad-8090-98f6450aedd5 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:40.395568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2849981f-4292-41ad-8090-98f6450aedd5 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:40.396015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2849981f-4292-41ad-8090-98f6450aedd5 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:40.526177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2849981f-4292-41ad-8090-98f6450aedd5 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:40.534760 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2849981f-4292-41ad-8090-98f6450aedd5 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1518 microversion: 2.1 time: 0.153081 Oct 11 00:18:40.535342 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3829/7092] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:40 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:41.136110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-7eb05cfe-3c08-4069-887b-7d97092135b0 req-7a917290-9b7d-4d80-a372-af57f15a37bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94f90da5-651d-49d8-a7cb-7d57deb4820d", "tag": "3cb9edc3-4ea8-402d-8f88-13eff533ebfd"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:18:41.146027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7eb05cfe-3c08-4069-887b-7d97092135b0 req-7a917290-9b7d-4d80-a372-af57f15a37bc service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:41.146529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7eb05cfe-3c08-4069-887b-7d97092135b0 req-7a917290-9b7d-4d80-a372-af57f15a37bc service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:41.146983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7eb05cfe-3c08-4069-887b-7d97092135b0 req-7a917290-9b7d-4d80-a372-af57f15a37bc service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:41.149692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=100 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:18:41.160517 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-7eb05cfe-3c08-4069-887b-7d97092135b0 req-7a917290-9b7d-4d80-a372-af57f15a37bc service nova] Creating event network-changed:3cb9edc3-4ea8-402d-8f88-13eff533ebfd for instance 94f90da5-651d-49d8-a7cb-7d57deb4820d on n-h2-860864-2 Oct 11 00:18:41.165902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-7eb05cfe-3c08-4069-887b-7d97092135b0 req-7a917290-9b7d-4d80-a372-af57f15a37bc service nova] Instance 94f90da5-651d-49d8-a7cb-7d57deb4820d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 00:18:41.176719 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-7eb05cfe-3c08-4069-887b-7d97092135b0 req-7a917290-9b7d-4d80-a372-af57f15a37bc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045809 Oct 11 00:18:41.177589 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3830/7093] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:18:41.558397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-768cebbd-6191-4548-af35-f2fa52a1fa13 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:41.559125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-768cebbd-6191-4548-af35-f2fa52a1fa13 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:41.566761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-768cebbd-6191-4548-af35-f2fa52a1fa13 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:41.567258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-768cebbd-6191-4548-af35-f2fa52a1fa13 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:41.567714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-768cebbd-6191-4548-af35-f2fa52a1fa13 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:41.568424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-768cebbd-6191-4548-af35-f2fa52a1fa13 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:41.568909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-768cebbd-6191-4548-af35-f2fa52a1fa13 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:41.569332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-768cebbd-6191-4548-af35-f2fa52a1fa13 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:41.863271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-768cebbd-6191-4548-af35-f2fa52a1fa13 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:41.871423 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-768cebbd-6191-4548-af35-f2fa52a1fa13 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1518 microversion: 2.1 time: 0.317194 Oct 11 00:18:41.872123 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3831/7094] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:41 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1518 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:42.897014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b55d1b81-c76d-48a1-b4dc-2cd12c30438e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:42.897737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b55d1b81-c76d-48a1-b4dc-2cd12c30438e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:42.904817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b55d1b81-c76d-48a1-b4dc-2cd12c30438e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:42.905319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b55d1b81-c76d-48a1-b4dc-2cd12c30438e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:42.905798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b55d1b81-c76d-48a1-b4dc-2cd12c30438e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:42.906509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b55d1b81-c76d-48a1-b4dc-2cd12c30438e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:42.906974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b55d1b81-c76d-48a1-b4dc-2cd12c30438e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:42.907413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b55d1b81-c76d-48a1-b4dc-2cd12c30438e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:43.041900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b55d1b81-c76d-48a1-b4dc-2cd12c30438e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:43.050267 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b55d1b81-c76d-48a1-b4dc-2cd12c30438e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1515 microversion: 2.1 time: 0.158397 Oct 11 00:18:43.050841 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3832/7095] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:42 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:43.073994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c104a593-5d7d-4fdf-8b2a-ddec3eb6aa77 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:18:43.074466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c104a593-5d7d-4fdf-8b2a-ddec3eb6aa77 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:43.081751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c104a593-5d7d-4fdf-8b2a-ddec3eb6aa77 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:43.082254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c104a593-5d7d-4fdf-8b2a-ddec3eb6aa77 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:43.082701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c104a593-5d7d-4fdf-8b2a-ddec3eb6aa77 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:43.083407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c104a593-5d7d-4fdf-8b2a-ddec3eb6aa77 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:43.083876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c104a593-5d7d-4fdf-8b2a-ddec3eb6aa77 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:43.084311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c104a593-5d7d-4fdf-8b2a-ddec3eb6aa77 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:43.151799 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c104a593-5d7d-4fdf-8b2a-ddec3eb6aa77 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "POST /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d/action" status: 204 len: 0 microversion: 2.1 time: 0.081375 Oct 11 00:18:43.152711 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3833/7096] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:18:43 2022] POST /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 00:18:43.161762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-660eec8d-db20-4c25-ba64-091d84f2750e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:43.162473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-660eec8d-db20-4c25-ba64-091d84f2750e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:43.168748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-660eec8d-db20-4c25-ba64-091d84f2750e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:43.169239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-660eec8d-db20-4c25-ba64-091d84f2750e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:43.169730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-660eec8d-db20-4c25-ba64-091d84f2750e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:43.170493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-660eec8d-db20-4c25-ba64-091d84f2750e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:43.171140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-660eec8d-db20-4c25-ba64-091d84f2750e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:43.171565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-660eec8d-db20-4c25-ba64-091d84f2750e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:43.673287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-660eec8d-db20-4c25-ba64-091d84f2750e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:43.682099 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-660eec8d-db20-4c25-ba64-091d84f2750e tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1515 microversion: 2.1 time: 0.525189 Oct 11 00:18:43.682694 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3834/7097] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:43 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1515 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:44.706762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1d0895d1-e403-47b5-b12d-98863ac7729f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:44.707390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1d0895d1-e403-47b5-b12d-98863ac7729f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:44.714134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d0895d1-e403-47b5-b12d-98863ac7729f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:44.714657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d0895d1-e403-47b5-b12d-98863ac7729f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:44.715111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d0895d1-e403-47b5-b12d-98863ac7729f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:44.715818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d0895d1-e403-47b5-b12d-98863ac7729f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:44.716286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d0895d1-e403-47b5-b12d-98863ac7729f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:44.716729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d0895d1-e403-47b5-b12d-98863ac7729f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:44.854508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1d0895d1-e403-47b5-b12d-98863ac7729f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:44.863615 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1d0895d1-e403-47b5-b12d-98863ac7729f tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1507 microversion: 2.1 time: 0.161456 Oct 11 00:18:44.864195 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3835/7098] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:44 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:44.886599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9d576c4f-c2ea-4b0b-a52e-2e77c4212fd0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:44.887234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9d576c4f-c2ea-4b0b-a52e-2e77c4212fd0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:44.893543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d576c4f-c2ea-4b0b-a52e-2e77c4212fd0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:44.894054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d576c4f-c2ea-4b0b-a52e-2e77c4212fd0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:44.894508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d576c4f-c2ea-4b0b-a52e-2e77c4212fd0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:44.895226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d576c4f-c2ea-4b0b-a52e-2e77c4212fd0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:44.895699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d576c4f-c2ea-4b0b-a52e-2e77c4212fd0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:44.896144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d576c4f-c2ea-4b0b-a52e-2e77c4212fd0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:45.034414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9d576c4f-c2ea-4b0b-a52e-2e77c4212fd0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:45.042663 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9d576c4f-c2ea-4b0b-a52e-2e77c4212fd0 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1507 microversion: 2.1 time: 0.159888 Oct 11 00:18:45.043233 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3836/7099] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:44 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:45.065558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1fbf6eee-3cc1-4213-964d-0185325bdf90 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:45.066191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1fbf6eee-3cc1-4213-964d-0185325bdf90 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:45.072057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1fbf6eee-3cc1-4213-964d-0185325bdf90 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:45.072566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1fbf6eee-3cc1-4213-964d-0185325bdf90 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:45.073031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1fbf6eee-3cc1-4213-964d-0185325bdf90 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:45.073779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1fbf6eee-3cc1-4213-964d-0185325bdf90 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:45.074265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1fbf6eee-3cc1-4213-964d-0185325bdf90 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:45.074714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1fbf6eee-3cc1-4213-964d-0185325bdf90 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:45.207230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1fbf6eee-3cc1-4213-964d-0185325bdf90 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:45.215113 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1fbf6eee-3cc1-4213-964d-0185325bdf90 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1507 microversion: 2.1 time: 0.153796 Oct 11 00:18:45.215694 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3837/7100] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:45 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:45.238642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-71e3a3bc-3298-425d-9c52-f1bcde96b9b3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:45.239082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-71e3a3bc-3298-425d-9c52-f1bcde96b9b3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:45.245156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-71e3a3bc-3298-425d-9c52-f1bcde96b9b3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:45.245693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-71e3a3bc-3298-425d-9c52-f1bcde96b9b3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:45.246151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-71e3a3bc-3298-425d-9c52-f1bcde96b9b3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:45.246876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-71e3a3bc-3298-425d-9c52-f1bcde96b9b3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:45.247346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-71e3a3bc-3298-425d-9c52-f1bcde96b9b3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:45.247784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-71e3a3bc-3298-425d-9c52-f1bcde96b9b3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:45.274561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-71e3a3bc-3298-425d-9c52-f1bcde96b9b3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:18:45.362591 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-71e3a3bc-3298-425d-9c52-f1bcde96b9b3 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "DELETE /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 204 len: 0 microversion: 2.1 time: 0.126863 Oct 11 00:18:45.363792 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3838/7101] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:18:45 2022] DELETE /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 00:18:45.379473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-49d59727-c1c5-44e5-bc6b-17919259dc80 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:45.380071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-49d59727-c1c5-44e5-bc6b-17919259dc80 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:45.385982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49d59727-c1c5-44e5-bc6b-17919259dc80 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:45.386478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49d59727-c1c5-44e5-bc6b-17919259dc80 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:45.386941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49d59727-c1c5-44e5-bc6b-17919259dc80 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:45.387641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49d59727-c1c5-44e5-bc6b-17919259dc80 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:45.388105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49d59727-c1c5-44e5-bc6b-17919259dc80 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:45.388538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49d59727-c1c5-44e5-bc6b-17919259dc80 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:45.416770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-49d59727-c1c5-44e5-bc6b-17919259dc80 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:18:45.461686 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.compute.api [None req-49d59727-c1c5-44e5-bc6b-17919259dc80 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Instance is already in deleting state, ignoring this request Oct 11 00:18:45.462522 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-49d59727-c1c5-44e5-bc6b-17919259dc80 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "DELETE /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 204 len: 0 microversion: 2.1 time: 0.087712 Oct 11 00:18:45.463102 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3839/7102] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:18:45 2022] DELETE /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 00:18:45.471635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4a3afba8-28f2-49d4-845f-9fee4d0b4473 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:45.472439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4a3afba8-28f2-49d4-845f-9fee4d0b4473 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:45.478150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a3afba8-28f2-49d4-845f-9fee4d0b4473 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:45.478636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a3afba8-28f2-49d4-845f-9fee4d0b4473 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:45.479097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a3afba8-28f2-49d4-845f-9fee4d0b4473 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:45.479772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a3afba8-28f2-49d4-845f-9fee4d0b4473 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:45.480232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a3afba8-28f2-49d4-845f-9fee4d0b4473 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:45.480677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a3afba8-28f2-49d4-845f-9fee4d0b4473 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:45.615078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4a3afba8-28f2-49d4-845f-9fee4d0b4473 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:45.623111 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4a3afba8-28f2-49d4-845f-9fee4d0b4473 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1513 microversion: 2.1 time: 0.155872 Oct 11 00:18:45.623686 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3840/7103] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:45 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:46.646583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-695f78d7-f589-4f73-8a4a-0a69d1c6f956 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:46.647261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-695f78d7-f589-4f73-8a4a-0a69d1c6f956 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:46.654099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-695f78d7-f589-4f73-8a4a-0a69d1c6f956 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:46.654598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-695f78d7-f589-4f73-8a4a-0a69d1c6f956 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:46.655045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-695f78d7-f589-4f73-8a4a-0a69d1c6f956 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:46.655745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-695f78d7-f589-4f73-8a4a-0a69d1c6f956 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:46.656212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-695f78d7-f589-4f73-8a4a-0a69d1c6f956 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:46.656650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-695f78d7-f589-4f73-8a4a-0a69d1c6f956 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:46.787012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-695f78d7-f589-4f73-8a4a-0a69d1c6f956 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736e28623d9d4d43b6ffb5ff8d53624d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f5135a4e6c4e9d9cea62b8c1b23463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:46.795352 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-695f78d7-f589-4f73-8a4a-0a69d1c6f956 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 200 len: 1513 microversion: 2.1 time: 0.152873 Oct 11 00:18:46.795944 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3841/7104] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:46 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:18:46.931397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-df710230-8b9a-4009-9453-8007dde3af1f req-98e67090-0d1c-4489-9c1e-2697e80e8d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94f90da5-651d-49d8-a7cb-7d57deb4820d", "name": "network-vif-plugged", "status": "completed", "tag": "3cb9edc3-4ea8-402d-8f88-13eff533ebfd"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:18:46.941994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-df710230-8b9a-4009-9453-8007dde3af1f req-98e67090-0d1c-4489-9c1e-2697e80e8d39 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:46.942510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-df710230-8b9a-4009-9453-8007dde3af1f req-98e67090-0d1c-4489-9c1e-2697e80e8d39 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:46.943097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-df710230-8b9a-4009-9453-8007dde3af1f req-98e67090-0d1c-4489-9c1e-2697e80e8d39 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:46.955656 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-df710230-8b9a-4009-9453-8007dde3af1f req-98e67090-0d1c-4489-9c1e-2697e80e8d39 service nova] Creating event network-vif-plugged:3cb9edc3-4ea8-402d-8f88-13eff533ebfd for instance 94f90da5-651d-49d8-a7cb-7d57deb4820d on n-h2-860864-2 Oct 11 00:18:46.960842 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-df710230-8b9a-4009-9453-8007dde3af1f req-98e67090-0d1c-4489-9c1e-2697e80e8d39 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033569 Oct 11 00:18:46.961483 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3842/7105] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:18:47.282547 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-7996c37e-4737-4905-af67-2e10e62d4e53 req-6865d6c6-9ab0-4678-bd11-9abf1cc74cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94f90da5-651d-49d8-a7cb-7d57deb4820d", "name": "network-vif-deleted", "tag": "3cb9edc3-4ea8-402d-8f88-13eff533ebfd"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:18:47.293684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7996c37e-4737-4905-af67-2e10e62d4e53 req-6865d6c6-9ab0-4678-bd11-9abf1cc74cb5 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:47.294204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7996c37e-4737-4905-af67-2e10e62d4e53 req-6865d6c6-9ab0-4678-bd11-9abf1cc74cb5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:47.294737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7996c37e-4737-4905-af67-2e10e62d4e53 req-6865d6c6-9ab0-4678-bd11-9abf1cc74cb5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:47.308159 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-7996c37e-4737-4905-af67-2e10e62d4e53 req-6865d6c6-9ab0-4678-bd11-9abf1cc74cb5 service nova] Creating event network-vif-deleted:3cb9edc3-4ea8-402d-8f88-13eff533ebfd for instance 94f90da5-651d-49d8-a7cb-7d57deb4820d on n-h2-860864-2 Oct 11 00:18:47.314428 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-7996c37e-4737-4905-af67-2e10e62d4e53 req-6865d6c6-9ab0-4678-bd11-9abf1cc74cb5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035805 Oct 11 00:18:47.315348 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3843/7106] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:18:47.824715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ac725746-54bd-41be-adf3-178b0d339d07 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:47.825458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ac725746-54bd-41be-adf3-178b0d339d07 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 94f90da5-651d-49d8-a7cb-7d57deb4820d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:47.833430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac725746-54bd-41be-adf3-178b0d339d07 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:47.833937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac725746-54bd-41be-adf3-178b0d339d07 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:47.834392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac725746-54bd-41be-adf3-178b0d339d07 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:47.835098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac725746-54bd-41be-adf3-178b0d339d07 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:47.835563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac725746-54bd-41be-adf3-178b0d339d07 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:47.836001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac725746-54bd-41be-adf3-178b0d339d07 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:47.840122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:18:47.851695 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-ac725746-54bd-41be-adf3-178b0d339d07 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] HTTP exception thrown: Instance 94f90da5-651d-49d8-a7cb-7d57deb4820d could not be found. Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ac725746-54bd-41be-adf3-178b0d339d07 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Request method failure captured: Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d HTTP/1.1 Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLYEW7iynDtJWP3nySIX1lw2BhYsS9Wjwq5Mp4JDC9oyYggQ04VJF9GA5cuYODVsHLAlCaqLkU56AkhD6t1TfaIt7tXyQxy8DYPVgFMvDghE0sF_1Lbzhwaa0KkiuIasRk4uFzh9IB4mblK795rbJsBtoZC6NaEqyZTj18--sKuahiI Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 85f5135a4e6c4e9d9cea62b8c1b23463 Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1869430437 Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/85f5135a4e6c4e9d9cea62b8c1b23463"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/85f5135a4e6c4e9d9cea62b8c1b23463"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/85f5135a4e6c4e9d9cea62b8c1b23463"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_85f5135a4e6c4e9d9cea62b8c1b23463", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerDiskConfigTestJSON-1869430437 Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 85f5135a4e6c4e9d9cea62b8c1b23463 Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1869430437 Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerDiskConfigTestJSON-1869430437-project Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 736e28623d9d4d43b6ffb5ff8d53624d Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerDiskConfigTestJSON-1869430437-project Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 94f90da5-651d-49d8-a7cb-7d57deb4820d could not be found. Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '94f90da5-651d-49d8-a7cb-7d57deb4820d'} Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94f90da5-651d-49d8-a7cb-7d57deb4820d could not be found. Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94f90da5-651d-49d8-a7cb-7d57deb4820d could not be found. Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:18:47.853856 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:18:47.858069 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:18:47.858069 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:18:47.858069 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:18:47.858069 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:18:47.858069 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:18:47.858069 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94f90da5-651d-49d8-a7cb-7d57deb4820d could not be found. Oct 11 00:18:47.858069 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:18:47.858069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ac725746-54bd-41be-adf3-178b0d339d07 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Returning 404 to user: Instance 94f90da5-651d-49d8-a7cb-7d57deb4820d could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:18:47.858069 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ac725746-54bd-41be-adf3-178b0d339d07 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d" status: 404 len: 111 microversion: 2.1 time: 0.034912 Oct 11 00:18:47.858069 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3844/7107] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:47 2022] GET /compute/v2.1/servers/94f90da5-651d-49d8-a7cb-7d57deb4820d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 00:18:47.864281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-33dcba42-24c7-4990-bb64-33cca39ea3d1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '.version_select at 0x7f662b13e940>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:47.886210 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-33dcba42-24c7-4990-bb64-33cca39ea3d1 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1309792727" status: 202 len: 0 microversion: 2.1 time: 0.025961 Oct 11 00:18:47.886787 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3845/7108] 10.222.0.23 () {58 vars in 1221 bytes} [Tue Oct 11 00:18:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1309792727 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 00:18:48.499388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-32987fdc-750b-4988-b4ec-8bd32ec3b38d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:48.499839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-32987fdc-750b-4988-b4ec-8bd32ec3b38d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:48.507242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32987fdc-750b-4988-b4ec-8bd32ec3b38d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:48.507739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32987fdc-750b-4988-b4ec-8bd32ec3b38d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:48.508198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32987fdc-750b-4988-b4ec-8bd32ec3b38d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:48.508896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32987fdc-750b-4988-b4ec-8bd32ec3b38d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:48.509362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32987fdc-750b-4988-b4ec-8bd32ec3b38d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:48.509897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-32987fdc-750b-4988-b4ec-8bd32ec3b38d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:48.523438 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-32987fdc-750b-4988-b4ec-8bd32ec3b38d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] HTTP exception thrown: Instance 1353bbe9-3485-4c95-bd9b-c7560b6bab0d could not be found. Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-32987fdc-750b-4988-b4ec-8bd32ec3b38d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Request method failure captured: Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d HTTP/1.1 Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLYEW7iynDtJWP3nySIX1lw2BhYsS9Wjwq5Mp4JDC9oyYggQ04VJF9GA5cuYODVsHLAlCaqLkU56AkhD6t1TfaIt7tXyQxy8DYPVgFMvDghE0sF_1Lbzhwaa0KkiuIasRk4uFzh9IB4mblK795rbJsBtoZC6NaEqyZTj18--sKuahiI Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 85f5135a4e6c4e9d9cea62b8c1b23463 Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1869430437 Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/85f5135a4e6c4e9d9cea62b8c1b23463"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/85f5135a4e6c4e9d9cea62b8c1b23463"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/85f5135a4e6c4e9d9cea62b8c1b23463"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_85f5135a4e6c4e9d9cea62b8c1b23463", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerDiskConfigTestJSON-1869430437 Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 85f5135a4e6c4e9d9cea62b8c1b23463 Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1869430437 Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerDiskConfigTestJSON-1869430437-project Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 736e28623d9d4d43b6ffb5ff8d53624d Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerDiskConfigTestJSON-1869430437-project Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 1353bbe9-3485-4c95-bd9b-c7560b6bab0d could not be found. Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '1353bbe9-3485-4c95-bd9b-c7560b6bab0d'} Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1353bbe9-3485-4c95-bd9b-c7560b6bab0d could not be found. Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:18:48.525009 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:18:48.528974 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1353bbe9-3485-4c95-bd9b-c7560b6bab0d could not be found. Oct 11 00:18:48.528974 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:18:48.528974 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:18:48.528974 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:18:48.528974 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:18:48.528974 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:18:48.528974 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:18:48.528974 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:18:48.528974 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:18:48.528974 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1353bbe9-3485-4c95-bd9b-c7560b6bab0d could not be found. Oct 11 00:18:48.528974 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:18:48.528974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-32987fdc-750b-4988-b4ec-8bd32ec3b38d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Returning 404 to user: Instance 1353bbe9-3485-4c95-bd9b-c7560b6bab0d could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:18:48.528974 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-32987fdc-750b-4988-b4ec-8bd32ec3b38d tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 404 len: 111 microversion: 2.1 time: 0.031198 Oct 11 00:18:48.528974 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3846/7109] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:18:48 2022] DELETE /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 00:18:48.535637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f8d245b5-2666-45b9-84c5-d6025492e718 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:48.536265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f8d245b5-2666-45b9-84c5-d6025492e718 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] [instance: 1353bbe9-3485-4c95-bd9b-c7560b6bab0d] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:48.542068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8d245b5-2666-45b9-84c5-d6025492e718 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:48.542564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8d245b5-2666-45b9-84c5-d6025492e718 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:48.543019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8d245b5-2666-45b9-84c5-d6025492e718 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:48.543722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8d245b5-2666-45b9-84c5-d6025492e718 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:48.544190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8d245b5-2666-45b9-84c5-d6025492e718 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:48.544631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8d245b5-2666-45b9-84c5-d6025492e718 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:48.558967 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-f8d245b5-2666-45b9-84c5-d6025492e718 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] HTTP exception thrown: Instance 1353bbe9-3485-4c95-bd9b-c7560b6bab0d could not be found. Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f8d245b5-2666-45b9-84c5-d6025492e718 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Request method failure captured: Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d HTTP/1.1 Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLYEW7iynDtJWP3nySIX1lw2BhYsS9Wjwq5Mp4JDC9oyYggQ04VJF9GA5cuYODVsHLAlCaqLkU56AkhD6t1TfaIt7tXyQxy8DYPVgFMvDghE0sF_1Lbzhwaa0KkiuIasRk4uFzh9IB4mblK795rbJsBtoZC6NaEqyZTj18--sKuahiI Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 85f5135a4e6c4e9d9cea62b8c1b23463 Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1869430437 Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/85f5135a4e6c4e9d9cea62b8c1b23463"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/85f5135a4e6c4e9d9cea62b8c1b23463"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/85f5135a4e6c4e9d9cea62b8c1b23463"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_85f5135a4e6c4e9d9cea62b8c1b23463", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerDiskConfigTestJSON-1869430437 Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 85f5135a4e6c4e9d9cea62b8c1b23463 Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1869430437 Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerDiskConfigTestJSON-1869430437-project Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 736e28623d9d4d43b6ffb5ff8d53624d Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerDiskConfigTestJSON-1869430437-project Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 1353bbe9-3485-4c95-bd9b-c7560b6bab0d could not be found. Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '1353bbe9-3485-4c95-bd9b-c7560b6bab0d'} Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1353bbe9-3485-4c95-bd9b-c7560b6bab0d could not be found. Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1353bbe9-3485-4c95-bd9b-c7560b6bab0d could not be found. Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:18:48.560518 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:18:48.565723 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:18:48.565723 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:18:48.565723 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:18:48.565723 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:18:48.565723 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:18:48.565723 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1353bbe9-3485-4c95-bd9b-c7560b6bab0d could not be found. Oct 11 00:18:48.565723 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:18:48.565723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f8d245b5-2666-45b9-84c5-d6025492e718 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] Returning 404 to user: Instance 1353bbe9-3485-4c95-bd9b-c7560b6bab0d could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:18:48.565723 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f8d245b5-2666-45b9-84c5-d6025492e718 tempest-ServerDiskConfigTestJSON-1869430437 tempest-ServerDiskConfigTestJSON-1869430437-project] 10.222.0.23 "GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d" status: 404 len: 111 microversion: 2.1 time: 0.031041 Oct 11 00:18:48.565723 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3847/7110] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:48 2022] GET /compute/v2.1/servers/1353bbe9-3485-4c95-bd9b-c7560b6bab0d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:18:57.594217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d321ce96-3dd2-4235-845b-ef9be618ba89 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Action: 'create', calling method: .version_select at 0x7f662a58f5e0>, body: {"keypair": {"name": "tempest-keypair-921070498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDDAoBwq6HhJx1nFk/Xpdu2bHvuNpGaL863KM2+xy7u6zJ+L0Rw1ywMgCU95104MpBYGAGRb1uanutUAOCzfkxkXwEO0xUZWqS6PMDKCT0WCugfeglbg6slb6EPhw5AQg=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:18:57.610947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-d321ce96-3dd2-4235-845b-ef9be618ba89 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Getting quotas for project f7cd77bf414e471ebaef6c378429ce00. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:18:57.617110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-d321ce96-3dd2-4235-845b-ef9be618ba89 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Getting quotas for user a9570fd898f2441e814db0a76968d902 and project f7cd77bf414e471ebaef6c378429ce00. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:18:57.645691 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d321ce96-3dd2-4235-845b-ef9be618ba89 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.185987 Oct 11 00:18:57.646227 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3848/7111] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 11 00:18:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:18:59.019528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6226995f-b550-4336-9e22-edd7cda0e685 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-947243226", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4816c55-6e00-4869-ba90-e42e23995d4c"}], "security_groups": [{"name": "tempest-securitygroup--965510550"}], "key_name": "tempest-keypair-921070498", "user_data": "}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:18:59.031573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:18:59.132331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-6226995f-b550-4336-9e22-edd7cda0e685 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] validate_networks() for [('a4816c55-6e00-4869-ba90-e42e23995d4c', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:18:59.526707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6226995f-b550-4336-9e22-edd7cda0e685 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:18:59.527165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6226995f-b550-4336-9e22-edd7cda0e685 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:18:59.527699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6226995f-b550-4336-9e22-edd7cda0e685 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:18:59.528111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6226995f-b550-4336-9e22-edd7cda0e685 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:18:59.528548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-6226995f-b550-4336-9e22-edd7cda0e685 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:18:59.538649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6226995f-b550-4336-9e22-edd7cda0e685 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:59.539158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6226995f-b550-4336-9e22-edd7cda0e685 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:59.539622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6226995f-b550-4336-9e22-edd7cda0e685 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:59.541040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6226995f-b550-4336-9e22-edd7cda0e685 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:18:59.541040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6226995f-b550-4336-9e22-edd7cda0e685 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:18:59.541288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6226995f-b550-4336-9e22-edd7cda0e685 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:18:59.561037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-6226995f-b550-4336-9e22-edd7cda0e685 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Getting quotas for project f7cd77bf414e471ebaef6c378429ce00. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:18:59.568861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-6226995f-b550-4336-9e22-edd7cda0e685 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Getting quotas for user a9570fd898f2441e814db0a76968d902 and project f7cd77bf414e471ebaef6c378429ce00. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:18:59.585672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6226995f-b550-4336-9e22-edd7cda0e685 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:18:59.588483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6226995f-b550-4336-9e22-edd7cda0e685 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:18:59.639560 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6226995f-b550-4336-9e22-edd7cda0e685 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.624906 Oct 11 00:18:59.646639 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3849/7112] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:18:59 2022] POST /compute/v2.1/servers => generated 408 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 00:18:59.652248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c01dfc75-c51f-4985-a500-172ea73a9b38 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:18:59.653070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c01dfc75-c51f-4985-a500-172ea73a9b38 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:18:59.718578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c01dfc75-c51f-4985-a500-172ea73a9b38 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:18:59.726943 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c01dfc75-c51f-4985-a500-172ea73a9b38 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1237 microversion: 2.1 time: 0.078726 Oct 11 00:18:59.728157 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3850/7113] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:18:59 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1237 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:19:00.752305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d20e4a0c-d3aa-4c7d-8138-fd74adac82be tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:19:00.754434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d20e4a0c-d3aa-4c7d-8138-fd74adac82be tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:00.762550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d20e4a0c-d3aa-4c7d-8138-fd74adac82be tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:00.762990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d20e4a0c-d3aa-4c7d-8138-fd74adac82be tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:00.763439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d20e4a0c-d3aa-4c7d-8138-fd74adac82be tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:00.764230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d20e4a0c-d3aa-4c7d-8138-fd74adac82be tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:00.764698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d20e4a0c-d3aa-4c7d-8138-fd74adac82be tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:00.765137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d20e4a0c-d3aa-4c7d-8138-fd74adac82be tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:00.840221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d20e4a0c-d3aa-4c7d-8138-fd74adac82be tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:19:00.849570 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d20e4a0c-d3aa-4c7d-8138-fd74adac82be tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1289 microversion: 2.1 time: 0.101397 Oct 11 00:19:00.850171 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3851/7114] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:19:00 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1289 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:19:01.875032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bd768d83-052c-4b24-bacc-5573f38c0ca3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:19:01.876340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bd768d83-052c-4b24-bacc-5573f38c0ca3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:01.885609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd768d83-052c-4b24-bacc-5573f38c0ca3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:01.886117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd768d83-052c-4b24-bacc-5573f38c0ca3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:01.886717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd768d83-052c-4b24-bacc-5573f38c0ca3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:01.887611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd768d83-052c-4b24-bacc-5573f38c0ca3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:01.888243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd768d83-052c-4b24-bacc-5573f38c0ca3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:01.888686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bd768d83-052c-4b24-bacc-5573f38c0ca3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:02.128233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bd768d83-052c-4b24-bacc-5573f38c0ca3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:19:02.137336 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bd768d83-052c-4b24-bacc-5573f38c0ca3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1362 microversion: 2.1 time: 0.266907 Oct 11 00:19:02.150945 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3852/7115] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:19:01 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1362 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:19:02.706637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-999685dc-4575-411d-9874-19c26bb5db4d req-ea48deb5-b1cd-4d6b-8382-133279376ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14168ff9-2322-4b1e-8cdf-183d731facc6", "tag": "50c35db1-8eb4-4d10-868c-4703baf2bc24"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:19:02.717927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-999685dc-4575-411d-9874-19c26bb5db4d req-ea48deb5-b1cd-4d6b-8382-133279376ae4 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:02.718595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-999685dc-4575-411d-9874-19c26bb5db4d req-ea48deb5-b1cd-4d6b-8382-133279376ae4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:02.719049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-999685dc-4575-411d-9874-19c26bb5db4d req-ea48deb5-b1cd-4d6b-8382-133279376ae4 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:02.732208 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-999685dc-4575-411d-9874-19c26bb5db4d req-ea48deb5-b1cd-4d6b-8382-133279376ae4 service nova] Creating event network-changed:50c35db1-8eb4-4d10-868c-4703baf2bc24 for instance 14168ff9-2322-4b1e-8cdf-183d731facc6 on n-h2-860864-2 Oct 11 00:19:02.737903 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-999685dc-4575-411d-9874-19c26bb5db4d req-ea48deb5-b1cd-4d6b-8382-133279376ae4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035918 Oct 11 00:19:02.738644 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3853/7116] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:19:03.169271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ad6fcaf8-cc4f-4bde-8c37-830ed9737ab6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:19:03.171737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ad6fcaf8-cc4f-4bde-8c37-830ed9737ab6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:03.179670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad6fcaf8-cc4f-4bde-8c37-830ed9737ab6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:03.180170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad6fcaf8-cc4f-4bde-8c37-830ed9737ab6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:03.180621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad6fcaf8-cc4f-4bde-8c37-830ed9737ab6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:03.181331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad6fcaf8-cc4f-4bde-8c37-830ed9737ab6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:03.181829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad6fcaf8-cc4f-4bde-8c37-830ed9737ab6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:03.182266 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad6fcaf8-cc4f-4bde-8c37-830ed9737ab6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:03.313845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ad6fcaf8-cc4f-4bde-8c37-830ed9737ab6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:19:03.322135 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ad6fcaf8-cc4f-4bde-8c37-830ed9737ab6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1362 microversion: 2.1 time: 0.157279 Oct 11 00:19:03.322726 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3854/7117] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:19:03 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:19:04.346697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-de8e2606-f3a8-4e4c-b9e3-8103a60723f3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:19:04.347343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-de8e2606-f3a8-4e4c-b9e3-8103a60723f3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:04.354273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de8e2606-f3a8-4e4c-b9e3-8103a60723f3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:04.354778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de8e2606-f3a8-4e4c-b9e3-8103a60723f3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:04.355228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de8e2606-f3a8-4e4c-b9e3-8103a60723f3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:04.355947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de8e2606-f3a8-4e4c-b9e3-8103a60723f3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:04.356510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de8e2606-f3a8-4e4c-b9e3-8103a60723f3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:04.356838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de8e2606-f3a8-4e4c-b9e3-8103a60723f3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:04.561786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-de8e2606-f3a8-4e4c-b9e3-8103a60723f3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:19:04.570518 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-de8e2606-f3a8-4e4c-b9e3-8103a60723f3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1362 microversion: 2.1 time: 0.228226 Oct 11 00:19:04.571112 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3855/7118] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:19:04 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:19:05.594239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6997cde8-b2d6-4dc4-8a7b-de570afcdac8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:19:05.594861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6997cde8-b2d6-4dc4-8a7b-de570afcdac8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:05.602036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6997cde8-b2d6-4dc4-8a7b-de570afcdac8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:05.602551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6997cde8-b2d6-4dc4-8a7b-de570afcdac8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:05.603042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6997cde8-b2d6-4dc4-8a7b-de570afcdac8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:05.603803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6997cde8-b2d6-4dc4-8a7b-de570afcdac8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:05.604285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6997cde8-b2d6-4dc4-8a7b-de570afcdac8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:05.604738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6997cde8-b2d6-4dc4-8a7b-de570afcdac8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:05.739471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6997cde8-b2d6-4dc4-8a7b-de570afcdac8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:19:05.747184 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6997cde8-b2d6-4dc4-8a7b-de570afcdac8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1362 microversion: 2.1 time: 0.156956 Oct 11 00:19:05.747760 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3856/7119] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:19:05 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:19:06.771298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9495e35a-864b-49f5-8f44-f5b77cda4498 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:19:06.772064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9495e35a-864b-49f5-8f44-f5b77cda4498 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:06.778743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9495e35a-864b-49f5-8f44-f5b77cda4498 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:06.779249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9495e35a-864b-49f5-8f44-f5b77cda4498 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:06.779705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9495e35a-864b-49f5-8f44-f5b77cda4498 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:06.780448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9495e35a-864b-49f5-8f44-f5b77cda4498 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:06.780925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9495e35a-864b-49f5-8f44-f5b77cda4498 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:06.781366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9495e35a-864b-49f5-8f44-f5b77cda4498 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:06.927533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9495e35a-864b-49f5-8f44-f5b77cda4498 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:19:06.936930 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9495e35a-864b-49f5-8f44-f5b77cda4498 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1362 microversion: 2.1 time: 0.170191 Oct 11 00:19:06.938546 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3857/7120] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:19:06 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:19:07.963034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-199b77a1-86ab-4d06-9ee7-873ab7d2dfd0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:19:07.963633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-199b77a1-86ab-4d06-9ee7-873ab7d2dfd0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:07.966166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:19:07.972762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-199b77a1-86ab-4d06-9ee7-873ab7d2dfd0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:07.973270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-199b77a1-86ab-4d06-9ee7-873ab7d2dfd0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:07.973751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-199b77a1-86ab-4d06-9ee7-873ab7d2dfd0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:07.974499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-199b77a1-86ab-4d06-9ee7-873ab7d2dfd0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:07.974972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-199b77a1-86ab-4d06-9ee7-873ab7d2dfd0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:07.975415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-199b77a1-86ab-4d06-9ee7-873ab7d2dfd0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:08.110279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-199b77a1-86ab-4d06-9ee7-873ab7d2dfd0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:19:08.118951 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-199b77a1-86ab-4d06-9ee7-873ab7d2dfd0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1362 microversion: 2.1 time: 0.160047 Oct 11 00:19:08.119540 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3858/7121] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:19:07 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:19:09.008297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-8eab086c-01b5-4a5a-9ff0-0fa1b5f2105f req-61c02c3f-118c-452d-a746-92d7214ee1ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14168ff9-2322-4b1e-8cdf-183d731facc6", "name": "network-vif-plugged", "status": "completed", "tag": "50c35db1-8eb4-4d10-868c-4703baf2bc24"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:19:09.019341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8eab086c-01b5-4a5a-9ff0-0fa1b5f2105f req-61c02c3f-118c-452d-a746-92d7214ee1ca service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:09.019850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8eab086c-01b5-4a5a-9ff0-0fa1b5f2105f req-61c02c3f-118c-452d-a746-92d7214ee1ca service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:09.020324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8eab086c-01b5-4a5a-9ff0-0fa1b5f2105f req-61c02c3f-118c-452d-a746-92d7214ee1ca service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:09.032138 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-8eab086c-01b5-4a5a-9ff0-0fa1b5f2105f req-61c02c3f-118c-452d-a746-92d7214ee1ca service nova] Creating event network-vif-plugged:50c35db1-8eb4-4d10-868c-4703baf2bc24 for instance 14168ff9-2322-4b1e-8cdf-183d731facc6 on n-h2-860864-2 Oct 11 00:19:09.037956 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-8eab086c-01b5-4a5a-9ff0-0fa1b5f2105f req-61c02c3f-118c-452d-a746-92d7214ee1ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033471 Oct 11 00:19:09.038563 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3859/7122] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:19:09.142306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-75b00b2d-ffb9-414c-86e6-f3a62cc448a8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:19:09.143898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-75b00b2d-ffb9-414c-86e6-f3a62cc448a8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:09.150560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75b00b2d-ffb9-414c-86e6-f3a62cc448a8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:09.151089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75b00b2d-ffb9-414c-86e6-f3a62cc448a8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:09.151548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75b00b2d-ffb9-414c-86e6-f3a62cc448a8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:09.152274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75b00b2d-ffb9-414c-86e6-f3a62cc448a8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:09.152752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75b00b2d-ffb9-414c-86e6-f3a62cc448a8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:09.153199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-75b00b2d-ffb9-414c-86e6-f3a62cc448a8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:09.296646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-75b00b2d-ffb9-414c-86e6-f3a62cc448a8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:19:09.304976 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-75b00b2d-ffb9-414c-86e6-f3a62cc448a8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1362 microversion: 2.1 time: 0.167019 Oct 11 00:19:09.305581 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3860/7123] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:19:09 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:19:10.328099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7fb064d9-1709-455d-a23d-20b95ea53259 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:19:10.328735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7fb064d9-1709-455d-a23d-20b95ea53259 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:10.332007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:19:10.332786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=12 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:19:10.339545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fb064d9-1709-455d-a23d-20b95ea53259 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:10.340058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fb064d9-1709-455d-a23d-20b95ea53259 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:10.340517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fb064d9-1709-455d-a23d-20b95ea53259 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:10.341239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fb064d9-1709-455d-a23d-20b95ea53259 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:10.341830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fb064d9-1709-455d-a23d-20b95ea53259 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:10.342276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7fb064d9-1709-455d-a23d-20b95ea53259 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:10.483713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7fb064d9-1709-455d-a23d-20b95ea53259 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:19:10.492611 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7fb064d9-1709-455d-a23d-20b95ea53259 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1362 microversion: 2.1 time: 0.168362 Oct 11 00:19:10.493204 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3861/7124] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:19:10 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:19:11.516169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9249cb43-b195-4a70-8689-cd79a4088098 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:19:11.516796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9249cb43-b195-4a70-8689-cd79a4088098 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:11.524211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9249cb43-b195-4a70-8689-cd79a4088098 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:11.524706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9249cb43-b195-4a70-8689-cd79a4088098 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:11.525153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9249cb43-b195-4a70-8689-cd79a4088098 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:11.525888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9249cb43-b195-4a70-8689-cd79a4088098 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:11.526352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9249cb43-b195-4a70-8689-cd79a4088098 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:11.526788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9249cb43-b195-4a70-8689-cd79a4088098 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:11.660301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9249cb43-b195-4a70-8689-cd79a4088098 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:19:11.668625 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9249cb43-b195-4a70-8689-cd79a4088098 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1548 microversion: 2.1 time: 0.156294 Oct 11 00:19:11.669224 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3862/7125] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:19:11 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:19:11.692190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6ea984e4-17ac-47b5-a933-ed2a56e63daf tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:19:11.692708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6ea984e4-17ac-47b5-a933-ed2a56e63daf tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:11.698771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ea984e4-17ac-47b5-a933-ed2a56e63daf tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:11.699281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ea984e4-17ac-47b5-a933-ed2a56e63daf tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:11.699742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ea984e4-17ac-47b5-a933-ed2a56e63daf tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:11.700493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ea984e4-17ac-47b5-a933-ed2a56e63daf tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:11.700976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ea984e4-17ac-47b5-a933-ed2a56e63daf tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:11.701455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6ea984e4-17ac-47b5-a933-ed2a56e63daf tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:11.782966 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6ea984e4-17ac-47b5-a933-ed2a56e63daf tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094586 Oct 11 00:19:11.784196 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3863/7126] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 11 00:19:11 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:19:13.091684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-619b3117-931e-4710-bb3f-00da1a381be2 req-5c2c966f-fee8-41be-b270-68c1777890cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14168ff9-2322-4b1e-8cdf-183d731facc6", "tag": "50c35db1-8eb4-4d10-868c-4703baf2bc24"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:19:13.101894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-619b3117-931e-4710-bb3f-00da1a381be2 req-5c2c966f-fee8-41be-b270-68c1777890cc service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:13.102401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-619b3117-931e-4710-bb3f-00da1a381be2 req-5c2c966f-fee8-41be-b270-68c1777890cc service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:13.102906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-619b3117-931e-4710-bb3f-00da1a381be2 req-5c2c966f-fee8-41be-b270-68c1777890cc service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:13.115046 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-619b3117-931e-4710-bb3f-00da1a381be2 req-5c2c966f-fee8-41be-b270-68c1777890cc service nova] Creating event network-changed:50c35db1-8eb4-4d10-868c-4703baf2bc24 for instance 14168ff9-2322-4b1e-8cdf-183d731facc6 on n-h2-860864-2 Oct 11 00:19:13.120032 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-619b3117-931e-4710-bb3f-00da1a381be2 req-5c2c966f-fee8-41be-b270-68c1777890cc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033154 Oct 11 00:19:13.120663 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3864/7127] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:19:19.870672 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:19:19.871155 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:19:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 11 00:19:19.878606 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:19:19.878745 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:19:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 11 00:19:48.700005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=13 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:19:48.700768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=72 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:19:48.704994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e5991de6-cf52-4f7e-9c7c-82970296acc5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:19:48.705731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e5991de6-cf52-4f7e-9c7c-82970296acc5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:48.712952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5991de6-cf52-4f7e-9c7c-82970296acc5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:48.713474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5991de6-cf52-4f7e-9c7c-82970296acc5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:48.713923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5991de6-cf52-4f7e-9c7c-82970296acc5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:48.714626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5991de6-cf52-4f7e-9c7c-82970296acc5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:48.715099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5991de6-cf52-4f7e-9c7c-82970296acc5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:48.715587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5991de6-cf52-4f7e-9c7c-82970296acc5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:48.855970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e5991de6-cf52-4f7e-9c7c-82970296acc5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:19:48.863793 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e5991de6-cf52-4f7e-9c7c-82970296acc5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1666 microversion: 2.1 time: 0.166174 Oct 11 00:19:48.865015 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3865/7128] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:19:48 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1666 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:19:48.886235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-eaa2548e-185d-4ad2-9057-a83488573fbd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:19:48.886870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-eaa2548e-185d-4ad2-9057-a83488573fbd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:48.892662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eaa2548e-185d-4ad2-9057-a83488573fbd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:48.893112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eaa2548e-185d-4ad2-9057-a83488573fbd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:48.893613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eaa2548e-185d-4ad2-9057-a83488573fbd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:48.894324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eaa2548e-185d-4ad2-9057-a83488573fbd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:48.894802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eaa2548e-185d-4ad2-9057-a83488573fbd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:48.895265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eaa2548e-185d-4ad2-9057-a83488573fbd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:49.026973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-eaa2548e-185d-4ad2-9057-a83488573fbd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:19:49.034687 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-eaa2548e-185d-4ad2-9057-a83488573fbd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1666 microversion: 2.1 time: 0.152055 Oct 11 00:19:49.035258 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3866/7129] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:19:48 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1666 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:19:49.058025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-68415419-0ff6-4fff-9160-ac07cdcad9f9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:19:49.058683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-68415419-0ff6-4fff-9160-ac07cdcad9f9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:49.064527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68415419-0ff6-4fff-9160-ac07cdcad9f9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:49.065027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68415419-0ff6-4fff-9160-ac07cdcad9f9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:49.065518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68415419-0ff6-4fff-9160-ac07cdcad9f9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:49.066230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68415419-0ff6-4fff-9160-ac07cdcad9f9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:49.066705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68415419-0ff6-4fff-9160-ac07cdcad9f9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:49.067150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68415419-0ff6-4fff-9160-ac07cdcad9f9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:49.197999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-68415419-0ff6-4fff-9160-ac07cdcad9f9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:19:49.205887 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-68415419-0ff6-4fff-9160-ac07cdcad9f9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1666 microversion: 2.1 time: 0.151636 Oct 11 00:19:49.206459 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3867/7130] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:19:49 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1666 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:19:49.228897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-876d83f8-cab8-41c8-9a47-9fea0f7000b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:19:49.231170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-876d83f8-cab8-41c8-9a47-9fea0f7000b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:49.236967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-876d83f8-cab8-41c8-9a47-9fea0f7000b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:49.237505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-876d83f8-cab8-41c8-9a47-9fea0f7000b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:49.237964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-876d83f8-cab8-41c8-9a47-9fea0f7000b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:49.238675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-876d83f8-cab8-41c8-9a47-9fea0f7000b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:49.239151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-876d83f8-cab8-41c8-9a47-9fea0f7000b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:49.239600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-876d83f8-cab8-41c8-9a47-9fea0f7000b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:49.267942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-876d83f8-cab8-41c8-9a47-9fea0f7000b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:19:49.274171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-876d83f8-cab8-41c8-9a47-9fea0f7000b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Old instance type m1.heat2, new instance type m1.heat {{(pid=120613) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 00:19:49.280653 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-876d83f8-cab8-41c8-9a47-9fea0f7000b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:19:49.281092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-876d83f8-cab8-41c8-9a47-9fea0f7000b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:19:49.281614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-876d83f8-cab8-41c8-9a47-9fea0f7000b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:19:49.282049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-876d83f8-cab8-41c8-9a47-9fea0f7000b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:19:49.282476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-876d83f8-cab8-41c8-9a47-9fea0f7000b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:19:49.346912 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-876d83f8-cab8-41c8-9a47-9fea0f7000b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "POST /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6/action" status: 202 len: 0 microversion: 2.1 time: 0.121675 Oct 11 00:19:49.347544 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3868/7131] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:19:49 2022] POST /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 00:19:49.355956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-19bbf1e3-5d64-4ab2-9e3f-67165a598688 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:19:49.356597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-19bbf1e3-5d64-4ab2-9e3f-67165a598688 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:49.362621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19bbf1e3-5d64-4ab2-9e3f-67165a598688 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:49.363133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19bbf1e3-5d64-4ab2-9e3f-67165a598688 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:49.363595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19bbf1e3-5d64-4ab2-9e3f-67165a598688 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:49.364416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19bbf1e3-5d64-4ab2-9e3f-67165a598688 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:49.364863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19bbf1e3-5d64-4ab2-9e3f-67165a598688 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:49.365314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-19bbf1e3-5d64-4ab2-9e3f-67165a598688 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:49.504454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-19bbf1e3-5d64-4ab2-9e3f-67165a598688 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:19:49.514135 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-19bbf1e3-5d64-4ab2-9e3f-67165a598688 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1675 microversion: 2.1 time: 0.161736 Oct 11 00:19:49.514855 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3869/7132] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:19:49 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:19:50.539531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-03022e57-12fa-43cd-a8f1-41ca2daa8c24 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:19:50.540166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-03022e57-12fa-43cd-a8f1-41ca2daa8c24 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:50.547252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03022e57-12fa-43cd-a8f1-41ca2daa8c24 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:50.547763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03022e57-12fa-43cd-a8f1-41ca2daa8c24 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:50.548219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03022e57-12fa-43cd-a8f1-41ca2daa8c24 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:50.548942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03022e57-12fa-43cd-a8f1-41ca2daa8c24 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:50.549433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03022e57-12fa-43cd-a8f1-41ca2daa8c24 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:50.549883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03022e57-12fa-43cd-a8f1-41ca2daa8c24 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:50.773360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-03022e57-12fa-43cd-a8f1-41ca2daa8c24 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:19:50.781284 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-03022e57-12fa-43cd-a8f1-41ca2daa8c24 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1675 microversion: 2.1 time: 0.246661 Oct 11 00:19:50.781908 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3870/7133] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:19:50 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1675 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:19:51.806745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-04aff4ce-ad3f-45de-872e-7415541df70c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:19:51.807392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-04aff4ce-ad3f-45de-872e-7415541df70c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:51.814674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04aff4ce-ad3f-45de-872e-7415541df70c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:51.815188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04aff4ce-ad3f-45de-872e-7415541df70c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:51.815646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04aff4ce-ad3f-45de-872e-7415541df70c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:51.816358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04aff4ce-ad3f-45de-872e-7415541df70c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:51.816849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04aff4ce-ad3f-45de-872e-7415541df70c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:51.817291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-04aff4ce-ad3f-45de-872e-7415541df70c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:51.954908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-04aff4ce-ad3f-45de-872e-7415541df70c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:19:51.963267 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-04aff4ce-ad3f-45de-872e-7415541df70c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1680 microversion: 2.1 time: 0.161525 Oct 11 00:19:51.963845 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3871/7134] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:19:51 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:19:52.987800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f1236f77-8fdf-467a-97d3-49962fa887f7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:19:52.988490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f1236f77-8fdf-467a-97d3-49962fa887f7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:52.995994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1236f77-8fdf-467a-97d3-49962fa887f7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:52.996505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1236f77-8fdf-467a-97d3-49962fa887f7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:52.996984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1236f77-8fdf-467a-97d3-49962fa887f7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:52.997714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1236f77-8fdf-467a-97d3-49962fa887f7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:52.998191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1236f77-8fdf-467a-97d3-49962fa887f7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:52.998642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f1236f77-8fdf-467a-97d3-49962fa887f7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:53.144298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f1236f77-8fdf-467a-97d3-49962fa887f7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:19:53.153360 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f1236f77-8fdf-467a-97d3-49962fa887f7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1680 microversion: 2.1 time: 0.169660 Oct 11 00:19:53.153980 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3872/7135] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:19:52 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:19:54.179511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-baaf990b-5b2a-4690-958b-b2f4d58df46d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:19:54.180192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-baaf990b-5b2a-4690-958b-b2f4d58df46d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:54.187053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-baaf990b-5b2a-4690-958b-b2f4d58df46d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:54.187555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-baaf990b-5b2a-4690-958b-b2f4d58df46d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:54.188011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-baaf990b-5b2a-4690-958b-b2f4d58df46d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:54.188713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-baaf990b-5b2a-4690-958b-b2f4d58df46d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:54.189183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-baaf990b-5b2a-4690-958b-b2f4d58df46d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:54.189661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-baaf990b-5b2a-4690-958b-b2f4d58df46d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:54.325146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-baaf990b-5b2a-4690-958b-b2f4d58df46d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:19:54.332951 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-baaf990b-5b2a-4690-958b-b2f4d58df46d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1680 microversion: 2.1 time: 0.157961 Oct 11 00:19:54.333568 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3873/7136] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:19:54 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:19:55.356332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8949322d-21f4-4a92-96d5-0d2cca363db6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:19:55.357002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8949322d-21f4-4a92-96d5-0d2cca363db6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:55.363804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8949322d-21f4-4a92-96d5-0d2cca363db6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:55.364329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8949322d-21f4-4a92-96d5-0d2cca363db6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:55.364788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8949322d-21f4-4a92-96d5-0d2cca363db6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:55.365531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8949322d-21f4-4a92-96d5-0d2cca363db6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:55.366011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8949322d-21f4-4a92-96d5-0d2cca363db6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:55.366459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8949322d-21f4-4a92-96d5-0d2cca363db6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:55.499417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8949322d-21f4-4a92-96d5-0d2cca363db6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:19:55.508373 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8949322d-21f4-4a92-96d5-0d2cca363db6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1680 microversion: 2.1 time: 0.155964 Oct 11 00:19:55.509127 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3874/7137] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:19:55 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:19:56.532662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8b7655dc-8b43-4676-a200-ed5ef8129699 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:19:56.533330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8b7655dc-8b43-4676-a200-ed5ef8129699 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:56.540976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b7655dc-8b43-4676-a200-ed5ef8129699 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:56.541522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b7655dc-8b43-4676-a200-ed5ef8129699 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:56.541987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b7655dc-8b43-4676-a200-ed5ef8129699 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:56.542708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b7655dc-8b43-4676-a200-ed5ef8129699 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:56.543184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b7655dc-8b43-4676-a200-ed5ef8129699 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:56.543632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8b7655dc-8b43-4676-a200-ed5ef8129699 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:56.672418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8b7655dc-8b43-4676-a200-ed5ef8129699 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:19:56.681002 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8b7655dc-8b43-4676-a200-ed5ef8129699 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1680 microversion: 2.1 time: 0.152326 Oct 11 00:19:56.681625 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3875/7138] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:19:56 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:19:57.704853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ef136ffc-3a8e-4849-a056-19e718717ff3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:19:57.705539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ef136ffc-3a8e-4849-a056-19e718717ff3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:57.713041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef136ffc-3a8e-4849-a056-19e718717ff3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:57.713582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef136ffc-3a8e-4849-a056-19e718717ff3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:57.714041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef136ffc-3a8e-4849-a056-19e718717ff3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:57.714759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef136ffc-3a8e-4849-a056-19e718717ff3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:57.715235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef136ffc-3a8e-4849-a056-19e718717ff3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:57.715681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef136ffc-3a8e-4849-a056-19e718717ff3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:57.851080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ef136ffc-3a8e-4849-a056-19e718717ff3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:19:57.858844 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ef136ffc-3a8e-4849-a056-19e718717ff3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1680 microversion: 2.1 time: 0.157951 Oct 11 00:19:57.859416 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3876/7139] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:19:57 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:19:58.881676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-49ce7bce-a482-4978-9229-d69ef8439224 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:19:58.882330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-49ce7bce-a482-4978-9229-d69ef8439224 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:19:58.889298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49ce7bce-a482-4978-9229-d69ef8439224 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:58.890006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49ce7bce-a482-4978-9229-d69ef8439224 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:58.890468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49ce7bce-a482-4978-9229-d69ef8439224 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:58.891177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49ce7bce-a482-4978-9229-d69ef8439224 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:19:58.891647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49ce7bce-a482-4978-9229-d69ef8439224 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:19:58.892085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-49ce7bce-a482-4978-9229-d69ef8439224 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:19:59.026362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-49ce7bce-a482-4978-9229-d69ef8439224 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:19:59.034059 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-49ce7bce-a482-4978-9229-d69ef8439224 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1680 microversion: 2.1 time: 0.156542 Oct 11 00:19:59.034641 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3877/7140] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:19:58 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:00.059109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e4d65892-bed4-47c0-ad0a-58e6f61dbdf2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:00.059746 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e4d65892-bed4-47c0-ad0a-58e6f61dbdf2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:00.067258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4d65892-bed4-47c0-ad0a-58e6f61dbdf2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:00.067797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4d65892-bed4-47c0-ad0a-58e6f61dbdf2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:00.068252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4d65892-bed4-47c0-ad0a-58e6f61dbdf2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:00.069509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4d65892-bed4-47c0-ad0a-58e6f61dbdf2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:00.069988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4d65892-bed4-47c0-ad0a-58e6f61dbdf2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:00.070459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e4d65892-bed4-47c0-ad0a-58e6f61dbdf2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:00.204641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e4d65892-bed4-47c0-ad0a-58e6f61dbdf2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:00.213147 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e4d65892-bed4-47c0-ad0a-58e6f61dbdf2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1680 microversion: 2.1 time: 0.158005 Oct 11 00:20:00.213754 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3878/7141] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:00 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:01.236009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7079ade8-5af4-4989-85f7-941d7be1ff2b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:01.236656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7079ade8-5af4-4989-85f7-941d7be1ff2b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:01.243862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7079ade8-5af4-4989-85f7-941d7be1ff2b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:01.244370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7079ade8-5af4-4989-85f7-941d7be1ff2b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:01.244831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7079ade8-5af4-4989-85f7-941d7be1ff2b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:01.245583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7079ade8-5af4-4989-85f7-941d7be1ff2b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:01.246067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7079ade8-5af4-4989-85f7-941d7be1ff2b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:01.246517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7079ade8-5af4-4989-85f7-941d7be1ff2b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:01.376245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7079ade8-5af4-4989-85f7-941d7be1ff2b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:01.384638 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7079ade8-5af4-4989-85f7-941d7be1ff2b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1680 microversion: 2.1 time: 0.152626 Oct 11 00:20:01.385216 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3879/7142] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:01 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:02.408279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5ed4243b-7839-4b8c-b913-2168cb3f30d2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:02.408923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5ed4243b-7839-4b8c-b913-2168cb3f30d2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:02.416724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ed4243b-7839-4b8c-b913-2168cb3f30d2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:02.417230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ed4243b-7839-4b8c-b913-2168cb3f30d2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:02.417722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ed4243b-7839-4b8c-b913-2168cb3f30d2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:02.418426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ed4243b-7839-4b8c-b913-2168cb3f30d2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:02.418893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ed4243b-7839-4b8c-b913-2168cb3f30d2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:02.419333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5ed4243b-7839-4b8c-b913-2168cb3f30d2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:02.423274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:20:02.552219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5ed4243b-7839-4b8c-b913-2168cb3f30d2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:02.561161 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5ed4243b-7839-4b8c-b913-2168cb3f30d2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1680 microversion: 2.1 time: 0.156786 Oct 11 00:20:02.561780 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3880/7143] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:02 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:03.586328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-341445d4-0571-4f38-9854-9f6c86731c37 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:03.586985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-341445d4-0571-4f38-9854-9f6c86731c37 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:03.593876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-341445d4-0571-4f38-9854-9f6c86731c37 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:03.594382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-341445d4-0571-4f38-9854-9f6c86731c37 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:03.594844 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-341445d4-0571-4f38-9854-9f6c86731c37 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:03.595564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-341445d4-0571-4f38-9854-9f6c86731c37 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:03.596043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-341445d4-0571-4f38-9854-9f6c86731c37 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:03.596495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-341445d4-0571-4f38-9854-9f6c86731c37 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:03.735118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-341445d4-0571-4f38-9854-9f6c86731c37 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:03.743470 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-341445d4-0571-4f38-9854-9f6c86731c37 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1680 microversion: 2.1 time: 0.161846 Oct 11 00:20:03.744047 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3881/7144] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:03 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:04.767889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-95e0f933-84d9-48e7-9cad-91835e62a103 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:04.768556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-95e0f933-84d9-48e7-9cad-91835e62a103 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:04.776288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95e0f933-84d9-48e7-9cad-91835e62a103 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:04.776796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95e0f933-84d9-48e7-9cad-91835e62a103 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:04.777253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95e0f933-84d9-48e7-9cad-91835e62a103 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:04.778012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95e0f933-84d9-48e7-9cad-91835e62a103 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:04.778489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95e0f933-84d9-48e7-9cad-91835e62a103 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:04.778955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95e0f933-84d9-48e7-9cad-91835e62a103 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:04.915898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-95e0f933-84d9-48e7-9cad-91835e62a103 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:04.923722 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-95e0f933-84d9-48e7-9cad-91835e62a103 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1680 microversion: 2.1 time: 0.159855 Oct 11 00:20:04.924289 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3882/7145] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:04 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:05.946964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d3f91a27-3149-48b0-9049-01aebebd59b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:05.947593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d3f91a27-3149-48b0-9049-01aebebd59b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:05.954520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3f91a27-3149-48b0-9049-01aebebd59b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:05.955023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3f91a27-3149-48b0-9049-01aebebd59b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:05.955478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3f91a27-3149-48b0-9049-01aebebd59b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:05.956188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3f91a27-3149-48b0-9049-01aebebd59b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:05.956663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3f91a27-3149-48b0-9049-01aebebd59b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:05.957111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3f91a27-3149-48b0-9049-01aebebd59b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:06.094127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d3f91a27-3149-48b0-9049-01aebebd59b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:06.102697 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d3f91a27-3149-48b0-9049-01aebebd59b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1680 microversion: 2.1 time: 0.159616 Oct 11 00:20:06.103292 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3883/7146] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:05 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:07.125718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-91a81e7f-6396-4ec6-a1a7-116eab32ecf2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:07.126381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-91a81e7f-6396-4ec6-a1a7-116eab32ecf2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:07.133787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91a81e7f-6396-4ec6-a1a7-116eab32ecf2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:07.134296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91a81e7f-6396-4ec6-a1a7-116eab32ecf2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:07.134753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91a81e7f-6396-4ec6-a1a7-116eab32ecf2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:07.135465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91a81e7f-6396-4ec6-a1a7-116eab32ecf2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:07.135936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91a81e7f-6396-4ec6-a1a7-116eab32ecf2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:07.136381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-91a81e7f-6396-4ec6-a1a7-116eab32ecf2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:07.274840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-91a81e7f-6396-4ec6-a1a7-116eab32ecf2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:07.282755 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-91a81e7f-6396-4ec6-a1a7-116eab32ecf2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1680 microversion: 2.1 time: 0.161064 Oct 11 00:20:07.283323 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3884/7147] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:07 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:08.306331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5c50ad97-56b2-4ebb-b317-1c62bfdd010f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:08.307005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5c50ad97-56b2-4ebb-b317-1c62bfdd010f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:08.314540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c50ad97-56b2-4ebb-b317-1c62bfdd010f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:08.315043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c50ad97-56b2-4ebb-b317-1c62bfdd010f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:08.315500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c50ad97-56b2-4ebb-b317-1c62bfdd010f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:08.316216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c50ad97-56b2-4ebb-b317-1c62bfdd010f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:08.316689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c50ad97-56b2-4ebb-b317-1c62bfdd010f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:08.317136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5c50ad97-56b2-4ebb-b317-1c62bfdd010f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:08.513648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5c50ad97-56b2-4ebb-b317-1c62bfdd010f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:08.522839 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5c50ad97-56b2-4ebb-b317-1c62bfdd010f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1680 microversion: 2.1 time: 0.220647 Oct 11 00:20:08.533310 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3885/7148] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:08 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:08.924890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-9298db6b-8b93-475b-b566-21e14a6054a8 req-623d3f25-8b04-4bbe-a04d-19361b4c6ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14168ff9-2322-4b1e-8cdf-183d731facc6", "name": "network-vif-unplugged", "status": "completed", "tag": "50c35db1-8eb4-4d10-868c-4703baf2bc24"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:20:08.935431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9298db6b-8b93-475b-b566-21e14a6054a8 req-623d3f25-8b04-4bbe-a04d-19361b4c6ec2 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:08.936129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9298db6b-8b93-475b-b566-21e14a6054a8 req-623d3f25-8b04-4bbe-a04d-19361b4c6ec2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:08.936629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9298db6b-8b93-475b-b566-21e14a6054a8 req-623d3f25-8b04-4bbe-a04d-19361b4c6ec2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:08.949645 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-9298db6b-8b93-475b-b566-21e14a6054a8 req-623d3f25-8b04-4bbe-a04d-19361b4c6ec2 service nova] Creating event network-vif-unplugged:50c35db1-8eb4-4d10-868c-4703baf2bc24 for instance 14168ff9-2322-4b1e-8cdf-183d731facc6 on n-h1-860864-2 Oct 11 00:20:08.955328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-9298db6b-8b93-475b-b566-21e14a6054a8 req-623d3f25-8b04-4bbe-a04d-19361b4c6ec2 service nova] Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 00:20:08.967680 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-9298db6b-8b93-475b-b566-21e14a6054a8 req-623d3f25-8b04-4bbe-a04d-19361b4c6ec2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046348 Oct 11 00:20:08.968316 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3886/7149] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:20:09.547117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e1029f99-6aef-47ed-96f4-5556cb227709 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:09.547855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e1029f99-6aef-47ed-96f4-5556cb227709 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:09.555892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1029f99-6aef-47ed-96f4-5556cb227709 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:09.556407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1029f99-6aef-47ed-96f4-5556cb227709 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:09.556868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1029f99-6aef-47ed-96f4-5556cb227709 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:09.557620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1029f99-6aef-47ed-96f4-5556cb227709 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:09.558101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1029f99-6aef-47ed-96f4-5556cb227709 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:09.558558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e1029f99-6aef-47ed-96f4-5556cb227709 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:09.759133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e1029f99-6aef-47ed-96f4-5556cb227709 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:09.767120 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e1029f99-6aef-47ed-96f4-5556cb227709 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1679 microversion: 2.1 time: 0.224432 Oct 11 00:20:09.767703 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3887/7150] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:09 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1679 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:10.792687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-651dff6b-e967-4ca9-ad32-bf60e577f881 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:10.793325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-651dff6b-e967-4ca9-ad32-bf60e577f881 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:10.800280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-651dff6b-e967-4ca9-ad32-bf60e577f881 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:10.800788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-651dff6b-e967-4ca9-ad32-bf60e577f881 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:10.801251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-651dff6b-e967-4ca9-ad32-bf60e577f881 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:10.801985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-651dff6b-e967-4ca9-ad32-bf60e577f881 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:10.803246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-651dff6b-e967-4ca9-ad32-bf60e577f881 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:10.803818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-651dff6b-e967-4ca9-ad32-bf60e577f881 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:10.936121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-651dff6b-e967-4ca9-ad32-bf60e577f881 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:10.944550 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-651dff6b-e967-4ca9-ad32-bf60e577f881 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1677 microversion: 2.1 time: 0.155812 Oct 11 00:20:10.945191 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3888/7151] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:10 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:11.060768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-d94f1a8c-510e-41af-8a69-f9f888267437 req-b05c2ad5-192c-4246-b1fd-efe38d1ff7ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14168ff9-2322-4b1e-8cdf-183d731facc6", "tag": "50c35db1-8eb4-4d10-868c-4703baf2bc24"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:20:11.071787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d94f1a8c-510e-41af-8a69-f9f888267437 req-b05c2ad5-192c-4246-b1fd-efe38d1ff7ff service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:11.072284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d94f1a8c-510e-41af-8a69-f9f888267437 req-b05c2ad5-192c-4246-b1fd-efe38d1ff7ff service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:11.072727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-d94f1a8c-510e-41af-8a69-f9f888267437 req-b05c2ad5-192c-4246-b1fd-efe38d1ff7ff service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:11.085708 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-d94f1a8c-510e-41af-8a69-f9f888267437 req-b05c2ad5-192c-4246-b1fd-efe38d1ff7ff service nova] Creating event network-changed:50c35db1-8eb4-4d10-868c-4703baf2bc24 for instance 14168ff9-2322-4b1e-8cdf-183d731facc6 on n-h1-860864-2 Oct 11 00:20:11.091493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-d94f1a8c-510e-41af-8a69-f9f888267437 req-b05c2ad5-192c-4246-b1fd-efe38d1ff7ff service nova] Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 00:20:11.103801 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-d94f1a8c-510e-41af-8a69-f9f888267437 req-b05c2ad5-192c-4246-b1fd-efe38d1ff7ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099592 Oct 11 00:20:11.104481 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3889/7152] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:20:11.968698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-660cdf22-839b-4cb7-ad92-e49f440d1c7c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:11.969521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-660cdf22-839b-4cb7-ad92-e49f440d1c7c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:11.977720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-660cdf22-839b-4cb7-ad92-e49f440d1c7c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:11.978226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-660cdf22-839b-4cb7-ad92-e49f440d1c7c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:11.978678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-660cdf22-839b-4cb7-ad92-e49f440d1c7c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:11.979388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-660cdf22-839b-4cb7-ad92-e49f440d1c7c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:11.979854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-660cdf22-839b-4cb7-ad92-e49f440d1c7c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:11.980296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-660cdf22-839b-4cb7-ad92-e49f440d1c7c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:12.121544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-660cdf22-839b-4cb7-ad92-e49f440d1c7c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:12.129593 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-660cdf22-839b-4cb7-ad92-e49f440d1c7c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1677 microversion: 2.1 time: 0.165084 Oct 11 00:20:12.130179 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3890/7153] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:11 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:13.152648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c9efe198-d75f-41d3-b1d9-a7468d44a56f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:13.153278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c9efe198-d75f-41d3-b1d9-a7468d44a56f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:13.160250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9efe198-d75f-41d3-b1d9-a7468d44a56f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:13.160752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9efe198-d75f-41d3-b1d9-a7468d44a56f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:13.161208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9efe198-d75f-41d3-b1d9-a7468d44a56f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:13.162016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9efe198-d75f-41d3-b1d9-a7468d44a56f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:13.162638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9efe198-d75f-41d3-b1d9-a7468d44a56f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:13.163177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9efe198-d75f-41d3-b1d9-a7468d44a56f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:13.296388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c9efe198-d75f-41d3-b1d9-a7468d44a56f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:13.306853 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c9efe198-d75f-41d3-b1d9-a7468d44a56f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1674 microversion: 2.1 time: 0.158053 Oct 11 00:20:13.307456 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3891/7154] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:13 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:13.330088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a3b92279-4c93-4e35-8730-9b33d2d6b403 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:20:13.330636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a3b92279-4c93-4e35-8730-9b33d2d6b403 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:13.337064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3b92279-4c93-4e35-8730-9b33d2d6b403 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:13.337638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3b92279-4c93-4e35-8730-9b33d2d6b403 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:13.338098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3b92279-4c93-4e35-8730-9b33d2d6b403 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:13.338820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3b92279-4c93-4e35-8730-9b33d2d6b403 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:13.339325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3b92279-4c93-4e35-8730-9b33d2d6b403 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:13.339774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3b92279-4c93-4e35-8730-9b33d2d6b403 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:13.401527 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a3b92279-4c93-4e35-8730-9b33d2d6b403 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "POST /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6/action" status: 204 len: 0 microversion: 2.1 time: 0.075042 Oct 11 00:20:13.402345 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3892/7155] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:20:13 2022] POST /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 00:20:13.410758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-10a5aa75-08ea-4ebb-90b9-df902a113a37 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:13.411416 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-10a5aa75-08ea-4ebb-90b9-df902a113a37 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:13.419192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10a5aa75-08ea-4ebb-90b9-df902a113a37 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:13.419706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10a5aa75-08ea-4ebb-90b9-df902a113a37 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:13.420169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10a5aa75-08ea-4ebb-90b9-df902a113a37 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:13.420901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10a5aa75-08ea-4ebb-90b9-df902a113a37 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:13.421411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10a5aa75-08ea-4ebb-90b9-df902a113a37 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:13.421848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10a5aa75-08ea-4ebb-90b9-df902a113a37 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:13.640981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-10a5aa75-08ea-4ebb-90b9-df902a113a37 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:13.650502 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-10a5aa75-08ea-4ebb-90b9-df902a113a37 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1674 microversion: 2.1 time: 0.243754 Oct 11 00:20:13.651174 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3893/7156] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:13 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1674 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:20:14.674352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d3b99d41-50b1-4db0-8301-8160f8747733 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:14.674991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d3b99d41-50b1-4db0-8301-8160f8747733 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:14.682693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3b99d41-50b1-4db0-8301-8160f8747733 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:14.683201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3b99d41-50b1-4db0-8301-8160f8747733 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:14.683655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3b99d41-50b1-4db0-8301-8160f8747733 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:14.684372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3b99d41-50b1-4db0-8301-8160f8747733 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:14.684845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3b99d41-50b1-4db0-8301-8160f8747733 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:14.685288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d3b99d41-50b1-4db0-8301-8160f8747733 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:14.822823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d3b99d41-50b1-4db0-8301-8160f8747733 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:14.833189 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d3b99d41-50b1-4db0-8301-8160f8747733 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1674 microversion: 2.1 time: 0.162989 Oct 11 00:20:14.833860 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3894/7157] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:14 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:15.395405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-68406c3a-e6c9-41ae-82df-effafe811a46 req-071c544e-69ca-4cdf-9b88-e4dc129f88cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14168ff9-2322-4b1e-8cdf-183d731facc6", "name": "network-vif-plugged", "status": "completed", "tag": "50c35db1-8eb4-4d10-868c-4703baf2bc24"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:20:15.406982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-68406c3a-e6c9-41ae-82df-effafe811a46 req-071c544e-69ca-4cdf-9b88-e4dc129f88cc service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:15.406982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-68406c3a-e6c9-41ae-82df-effafe811a46 req-071c544e-69ca-4cdf-9b88-e4dc129f88cc service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:15.407487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-68406c3a-e6c9-41ae-82df-effafe811a46 req-071c544e-69ca-4cdf-9b88-e4dc129f88cc service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:15.419753 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-68406c3a-e6c9-41ae-82df-effafe811a46 req-071c544e-69ca-4cdf-9b88-e4dc129f88cc service nova] Creating event network-vif-plugged:50c35db1-8eb4-4d10-868c-4703baf2bc24 for instance 14168ff9-2322-4b1e-8cdf-183d731facc6 on n-h1-860864-2 Oct 11 00:20:15.424929 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-68406c3a-e6c9-41ae-82df-effafe811a46 req-071c544e-69ca-4cdf-9b88-e4dc129f88cc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033245 Oct 11 00:20:15.425630 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3895/7158] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:20:15.858285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9b116963-cecc-48bf-af7b-a1119df7c023 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:15.859010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9b116963-cecc-48bf-af7b-a1119df7c023 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:15.865331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b116963-cecc-48bf-af7b-a1119df7c023 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:15.866358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b116963-cecc-48bf-af7b-a1119df7c023 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:15.866358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b116963-cecc-48bf-af7b-a1119df7c023 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:15.867038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b116963-cecc-48bf-af7b-a1119df7c023 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:15.867516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b116963-cecc-48bf-af7b-a1119df7c023 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:15.867968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b116963-cecc-48bf-af7b-a1119df7c023 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:16.002620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9b116963-cecc-48bf-af7b-a1119df7c023 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:16.011478 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9b116963-cecc-48bf-af7b-a1119df7c023 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1666 microversion: 2.1 time: 0.158303 Oct 11 00:20:16.012067 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3896/7159] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:15 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1666 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:16.034363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a53dbd99-5531-455f-9dce-a35b69df0779 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:16.035030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a53dbd99-5531-455f-9dce-a35b69df0779 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:16.041711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a53dbd99-5531-455f-9dce-a35b69df0779 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:16.042228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a53dbd99-5531-455f-9dce-a35b69df0779 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:16.042692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a53dbd99-5531-455f-9dce-a35b69df0779 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:16.043419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a53dbd99-5531-455f-9dce-a35b69df0779 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:16.043898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a53dbd99-5531-455f-9dce-a35b69df0779 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:16.044358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a53dbd99-5531-455f-9dce-a35b69df0779 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:16.048587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:20:16.184718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a53dbd99-5531-455f-9dce-a35b69df0779 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:16.192716 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a53dbd99-5531-455f-9dce-a35b69df0779 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1666 microversion: 2.1 time: 0.162140 Oct 11 00:20:16.193941 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3897/7160] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:16 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1666 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:16.215390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-13284e4d-b2fc-40e9-83d8-fa5fff74c5eb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:16.216017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-13284e4d-b2fc-40e9-83d8-fa5fff74c5eb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:16.221833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13284e4d-b2fc-40e9-83d8-fa5fff74c5eb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:16.222339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13284e4d-b2fc-40e9-83d8-fa5fff74c5eb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:16.222796 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13284e4d-b2fc-40e9-83d8-fa5fff74c5eb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:16.223506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13284e4d-b2fc-40e9-83d8-fa5fff74c5eb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:16.223979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13284e4d-b2fc-40e9-83d8-fa5fff74c5eb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:16.224509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-13284e4d-b2fc-40e9-83d8-fa5fff74c5eb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:16.362272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-13284e4d-b2fc-40e9-83d8-fa5fff74c5eb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:16.371018 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-13284e4d-b2fc-40e9-83d8-fa5fff74c5eb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1666 microversion: 2.1 time: 0.159241 Oct 11 00:20:16.371591 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3898/7161] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:16 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1666 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:16.392784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-805f4db9-eccf-42e8-a5bd-8788340b1888 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:16.393291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-805f4db9-eccf-42e8-a5bd-8788340b1888 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:16.399298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-805f4db9-eccf-42e8-a5bd-8788340b1888 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:16.399797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-805f4db9-eccf-42e8-a5bd-8788340b1888 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:16.400248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-805f4db9-eccf-42e8-a5bd-8788340b1888 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:16.400951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-805f4db9-eccf-42e8-a5bd-8788340b1888 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:16.401442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-805f4db9-eccf-42e8-a5bd-8788340b1888 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:16.401886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-805f4db9-eccf-42e8-a5bd-8788340b1888 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:16.427232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-805f4db9-eccf-42e8-a5bd-8788340b1888 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:20:16.503867 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-805f4db9-eccf-42e8-a5bd-8788340b1888 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "DELETE /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 204 len: 0 microversion: 2.1 time: 0.114309 Oct 11 00:20:16.504494 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3899/7162] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:20:16 2022] DELETE /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 00:20:16.514141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fddd1ef9-4b06-4768-8789-b360457634e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:16.514872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fddd1ef9-4b06-4768-8789-b360457634e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:16.520774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fddd1ef9-4b06-4768-8789-b360457634e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:16.521366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fddd1ef9-4b06-4768-8789-b360457634e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:16.522251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fddd1ef9-4b06-4768-8789-b360457634e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:16.522724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fddd1ef9-4b06-4768-8789-b360457634e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:16.523205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fddd1ef9-4b06-4768-8789-b360457634e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:16.523665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fddd1ef9-4b06-4768-8789-b360457634e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:16.653946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fddd1ef9-4b06-4768-8789-b360457634e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:16.662367 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fddd1ef9-4b06-4768-8789-b360457634e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1672 microversion: 2.1 time: 0.151896 Oct 11 00:20:16.663011 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3900/7163] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:16 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:20:17.687054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4e5314dd-d517-4135-a73d-f55d2c46ea26 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:17.687760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4e5314dd-d517-4135-a73d-f55d2c46ea26 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:17.695748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e5314dd-d517-4135-a73d-f55d2c46ea26 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:17.696263 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e5314dd-d517-4135-a73d-f55d2c46ea26 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:17.696717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e5314dd-d517-4135-a73d-f55d2c46ea26 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:17.697465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e5314dd-d517-4135-a73d-f55d2c46ea26 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:17.697934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e5314dd-d517-4135-a73d-f55d2c46ea26 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:17.698387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4e5314dd-d517-4135-a73d-f55d2c46ea26 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:17.843655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4e5314dd-d517-4135-a73d-f55d2c46ea26 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:17.852835 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4e5314dd-d517-4135-a73d-f55d2c46ea26 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1672 microversion: 2.1 time: 0.169816 Oct 11 00:20:17.853514 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3901/7164] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:17 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:18.858126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-ec94b288-b460-453e-9a8e-1706cc02684b req-dd0ed915-82b1-429b-bc87-b1580b89f8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14168ff9-2322-4b1e-8cdf-183d731facc6", "name": "network-vif-deleted", "tag": "50c35db1-8eb4-4d10-868c-4703baf2bc24"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:20:18.866845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:20:18.878111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ec94b288-b460-453e-9a8e-1706cc02684b req-dd0ed915-82b1-429b-bc87-b1580b89f8e3 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:18.878620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ec94b288-b460-453e-9a8e-1706cc02684b req-dd0ed915-82b1-429b-bc87-b1580b89f8e3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:18.879251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ec94b288-b460-453e-9a8e-1706cc02684b req-dd0ed915-82b1-429b-bc87-b1580b89f8e3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:18.896286 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-ec94b288-b460-453e-9a8e-1706cc02684b req-dd0ed915-82b1-429b-bc87-b1580b89f8e3 service nova] Creating event network-vif-deleted:50c35db1-8eb4-4d10-868c-4703baf2bc24 for instance 14168ff9-2322-4b1e-8cdf-183d731facc6 on n-h1-860864-2 Oct 11 00:20:18.902346 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-ec94b288-b460-453e-9a8e-1706cc02684b req-dd0ed915-82b1-429b-bc87-b1580b89f8e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048427 Oct 11 00:20:18.903718 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3902/7165] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:20:18.911120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c78dd9cf-9b51-4e2b-908f-a20e2b676020 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:18.912696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c78dd9cf-9b51-4e2b-908f-a20e2b676020 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:18.920303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c78dd9cf-9b51-4e2b-908f-a20e2b676020 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:18.921100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c78dd9cf-9b51-4e2b-908f-a20e2b676020 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:18.921753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c78dd9cf-9b51-4e2b-908f-a20e2b676020 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:18.922632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c78dd9cf-9b51-4e2b-908f-a20e2b676020 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:18.923258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c78dd9cf-9b51-4e2b-908f-a20e2b676020 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:18.924386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c78dd9cf-9b51-4e2b-908f-a20e2b676020 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:18.997779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c78dd9cf-9b51-4e2b-908f-a20e2b676020 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:19.006261 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c78dd9cf-9b51-4e2b-908f-a20e2b676020 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 200 len: 1322 microversion: 2.1 time: 0.101017 Oct 11 00:20:19.017413 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3903/7166] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:18 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 1322 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:20:20.030955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c52a6896-4101-4daf-a86c-bf54e774d3c2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:20.031627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c52a6896-4101-4daf-a86c-bf54e774d3c2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:20.039701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c52a6896-4101-4daf-a86c-bf54e774d3c2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:20.040210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c52a6896-4101-4daf-a86c-bf54e774d3c2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:20.040667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c52a6896-4101-4daf-a86c-bf54e774d3c2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:20.041400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c52a6896-4101-4daf-a86c-bf54e774d3c2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:20.041910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c52a6896-4101-4daf-a86c-bf54e774d3c2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:20.042384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c52a6896-4101-4daf-a86c-bf54e774d3c2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:20.057630 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-c52a6896-4101-4daf-a86c-bf54e774d3c2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] HTTP exception thrown: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c52a6896-4101-4daf-a86c-bf54e774d3c2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Request method failure captured: Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 HTTP/1.1 Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLZxfLc8Q7Icn9DecaGe5gcChOHeFqpqEXkmJ2LBp2kaQghRPSuL_6yNQKoNJrZLgbTTr8mxh5HHn7k6cnYW1dBqXduwGRSIKp1_hC3HFPdzua2afeL-3QExGQACpymRN5ysngyDUJc_A6H1lS2CdmxbOx6trU-c0z1aLDt5QVmHkl4 Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f7cd77bf414e471ebaef6c378429ce00", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a9570fd898f2441e814db0a76968d902 Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '14168ff9-2322-4b1e-8cdf-183d731facc6'} Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:20:20.059241 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:20:20.063947 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:20:20.063947 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:20:20.063947 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:20:20.063947 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:20:20.063947 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:20:20.063947 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. Oct 11 00:20:20.063947 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:20:20.063947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c52a6896-4101-4daf-a86c-bf54e774d3c2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Returning 404 to user: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:20:20.063947 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c52a6896-4101-4daf-a86c-bf54e774d3c2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 404 len: 111 microversion: 2.1 time: 0.033657 Oct 11 00:20:20.063947 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3904/7167] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:20 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 00:20:20.074816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-62c123e6-05da-491e-8dee-7e7318648ce8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:20.075453 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-62c123e6-05da-491e-8dee-7e7318648ce8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:20.081501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62c123e6-05da-491e-8dee-7e7318648ce8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:20.082002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62c123e6-05da-491e-8dee-7e7318648ce8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:20.082463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62c123e6-05da-491e-8dee-7e7318648ce8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:20.083176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62c123e6-05da-491e-8dee-7e7318648ce8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:20.083703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62c123e6-05da-491e-8dee-7e7318648ce8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:20.084436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-62c123e6-05da-491e-8dee-7e7318648ce8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:20.097779 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-62c123e6-05da-491e-8dee-7e7318648ce8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] HTTP exception thrown: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-62c123e6-05da-491e-8dee-7e7318648ce8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Request method failure captured: Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 HTTP/1.1 Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLZxfLc8Q7Icn9DecaGe5gcChOHeFqpqEXkmJ2LBp2kaQghRPSuL_6yNQKoNJrZLgbTTr8mxh5HHn7k6cnYW1dBqXduwGRSIKp1_hC3HFPdzua2afeL-3QExGQACpymRN5ysngyDUJc_A6H1lS2CdmxbOx6trU-c0z1aLDt5QVmHkl4 Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f7cd77bf414e471ebaef6c378429ce00", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a9570fd898f2441e814db0a76968d902 Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '14168ff9-2322-4b1e-8cdf-183d731facc6'} Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:20:20.099865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:20:20.103855 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:20:20.103855 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:20:20.103855 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:20:20.103855 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:20:20.103855 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:20:20.103855 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. Oct 11 00:20:20.103855 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:20:20.103855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-62c123e6-05da-491e-8dee-7e7318648ce8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Returning 404 to user: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:20:20.103855 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-62c123e6-05da-491e-8dee-7e7318648ce8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 404 len: 111 microversion: 2.1 time: 0.030337 Oct 11 00:20:20.103855 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3905/7168] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:20 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 00:20:20.151711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fa3f11c5-b73d-42f6-a17b-78f69cf969d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-177640929", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "a4816c55-6e00-4869-ba90-e42e23995d4c"}], "security_groups": [{"name": "tempest-securitygroup--965510550"}], "key_name": "tempest-keypair-921070498", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:20:20.266015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-fa3f11c5-b73d-42f6-a17b-78f69cf969d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] validate_networks() for [('a4816c55-6e00-4869-ba90-e42e23995d4c', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:20:20.657601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-fa3f11c5-b73d-42f6-a17b-78f69cf969d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:20:20.658101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-fa3f11c5-b73d-42f6-a17b-78f69cf969d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:20:20.658616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-fa3f11c5-b73d-42f6-a17b-78f69cf969d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:20:20.659041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-fa3f11c5-b73d-42f6-a17b-78f69cf969d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:20:20.659491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-fa3f11c5-b73d-42f6-a17b-78f69cf969d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:20:20.669054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa3f11c5-b73d-42f6-a17b-78f69cf969d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:20.669588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa3f11c5-b73d-42f6-a17b-78f69cf969d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:20.670043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa3f11c5-b73d-42f6-a17b-78f69cf969d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:20.670781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa3f11c5-b73d-42f6-a17b-78f69cf969d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:20.671251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa3f11c5-b73d-42f6-a17b-78f69cf969d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:20.671686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fa3f11c5-b73d-42f6-a17b-78f69cf969d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:20.690367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-fa3f11c5-b73d-42f6-a17b-78f69cf969d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Getting quotas for project f7cd77bf414e471ebaef6c378429ce00. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:20:20.697424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-fa3f11c5-b73d-42f6-a17b-78f69cf969d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Getting quotas for user a9570fd898f2441e814db0a76968d902 and project f7cd77bf414e471ebaef6c378429ce00. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:20:20.710541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fa3f11c5-b73d-42f6-a17b-78f69cf969d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:20:20.712872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fa3f11c5-b73d-42f6-a17b-78f69cf969d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:20:20.759718 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fa3f11c5-b73d-42f6-a17b-78f69cf969d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.611902 Oct 11 00:20:20.760360 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3906/7169] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:20:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 00:20:20.771584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9dabaa17-4539-41af-97e6-0642d57f139b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:20.772160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9dabaa17-4539-41af-97e6-0642d57f139b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:20.839974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9dabaa17-4539-41af-97e6-0642d57f139b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:20.848578 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9dabaa17-4539-41af-97e6-0642d57f139b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1237 microversion: 2.1 time: 0.080899 Oct 11 00:20:20.854947 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3907/7170] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:20 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:21.873658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-54294afe-9270-433b-aa92-fc3ff4d1e3eb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:21.874713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-54294afe-9270-433b-aa92-fc3ff4d1e3eb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:21.884259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54294afe-9270-433b-aa92-fc3ff4d1e3eb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:21.884768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54294afe-9270-433b-aa92-fc3ff4d1e3eb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:21.885226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54294afe-9270-433b-aa92-fc3ff4d1e3eb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:21.885993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54294afe-9270-433b-aa92-fc3ff4d1e3eb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:21.886471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54294afe-9270-433b-aa92-fc3ff4d1e3eb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:21.886921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54294afe-9270-433b-aa92-fc3ff4d1e3eb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:21.970706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-54294afe-9270-433b-aa92-fc3ff4d1e3eb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:21.980237 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-54294afe-9270-433b-aa92-fc3ff4d1e3eb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1297 microversion: 2.1 time: 0.111655 Oct 11 00:20:21.980840 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3908/7171] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:21 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1297 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:23.008850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b1157e58-7c9e-4687-88bf-2889c71865fa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:23.009541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b1157e58-7c9e-4687-88bf-2889c71865fa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:23.016270 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1157e58-7c9e-4687-88bf-2889c71865fa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:23.016774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1157e58-7c9e-4687-88bf-2889c71865fa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:23.017243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1157e58-7c9e-4687-88bf-2889c71865fa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:23.017995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1157e58-7c9e-4687-88bf-2889c71865fa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:23.018473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1157e58-7c9e-4687-88bf-2889c71865fa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:23.018921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1157e58-7c9e-4687-88bf-2889c71865fa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:23.260098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b1157e58-7c9e-4687-88bf-2889c71865fa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:23.268035 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b1157e58-7c9e-4687-88bf-2889c71865fa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1362 microversion: 2.1 time: 0.264155 Oct 11 00:20:23.268629 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3909/7172] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:23 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:23.454450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-9bb7ab75-1470-4198-a631-d14ee095e550 req-45fbb874-8db3-4aac-b356-23fad3ff633a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a715295-b7cf-48df-a5e1-c7404ae94e70", "tag": "6708e863-d19b-403b-b026-0e88a99545f1"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:20:23.466521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9bb7ab75-1470-4198-a631-d14ee095e550 req-45fbb874-8db3-4aac-b356-23fad3ff633a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:23.467028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9bb7ab75-1470-4198-a631-d14ee095e550 req-45fbb874-8db3-4aac-b356-23fad3ff633a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:23.467479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-9bb7ab75-1470-4198-a631-d14ee095e550 req-45fbb874-8db3-4aac-b356-23fad3ff633a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:23.480166 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-9bb7ab75-1470-4198-a631-d14ee095e550 req-45fbb874-8db3-4aac-b356-23fad3ff633a service nova] Creating event network-changed:6708e863-d19b-403b-b026-0e88a99545f1 for instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 on n-h2-860864-2 Oct 11 00:20:23.484948 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-9bb7ab75-1470-4198-a631-d14ee095e550 req-45fbb874-8db3-4aac-b356-23fad3ff633a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034843 Oct 11 00:20:23.485593 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3910/7173] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:20:24.294017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-251816e4-e0b5-4252-bdd8-50b992cfea43 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:24.294689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-251816e4-e0b5-4252-bdd8-50b992cfea43 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:24.300910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-251816e4-e0b5-4252-bdd8-50b992cfea43 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:24.301444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-251816e4-e0b5-4252-bdd8-50b992cfea43 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:24.301930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-251816e4-e0b5-4252-bdd8-50b992cfea43 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:24.303225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-251816e4-e0b5-4252-bdd8-50b992cfea43 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:24.303697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-251816e4-e0b5-4252-bdd8-50b992cfea43 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:24.304143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-251816e4-e0b5-4252-bdd8-50b992cfea43 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:24.433690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-251816e4-e0b5-4252-bdd8-50b992cfea43 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:24.441395 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-251816e4-e0b5-4252-bdd8-50b992cfea43 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1362 microversion: 2.1 time: 0.152646 Oct 11 00:20:24.441970 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3911/7174] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:24 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:25.464765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ee21b181-dc05-4acf-94a1-4aa7a907e3b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:25.465444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ee21b181-dc05-4acf-94a1-4aa7a907e3b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:25.472435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee21b181-dc05-4acf-94a1-4aa7a907e3b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:25.472946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee21b181-dc05-4acf-94a1-4aa7a907e3b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:25.473433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee21b181-dc05-4acf-94a1-4aa7a907e3b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:25.474160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee21b181-dc05-4acf-94a1-4aa7a907e3b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:25.474635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee21b181-dc05-4acf-94a1-4aa7a907e3b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:25.475185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ee21b181-dc05-4acf-94a1-4aa7a907e3b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:25.605990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ee21b181-dc05-4acf-94a1-4aa7a907e3b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:25.613827 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ee21b181-dc05-4acf-94a1-4aa7a907e3b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1362 microversion: 2.1 time: 0.152967 Oct 11 00:20:25.614408 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3912/7175] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:25 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:26.637050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9cfcd47e-32d0-4870-97a5-401d355ac950 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:26.637778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9cfcd47e-32d0-4870-97a5-401d355ac950 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:26.644754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cfcd47e-32d0-4870-97a5-401d355ac950 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:26.645257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cfcd47e-32d0-4870-97a5-401d355ac950 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:26.645752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cfcd47e-32d0-4870-97a5-401d355ac950 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:26.646781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cfcd47e-32d0-4870-97a5-401d355ac950 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:26.647257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cfcd47e-32d0-4870-97a5-401d355ac950 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:26.647707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cfcd47e-32d0-4870-97a5-401d355ac950 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:26.781744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9cfcd47e-32d0-4870-97a5-401d355ac950 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:26.789689 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9cfcd47e-32d0-4870-97a5-401d355ac950 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1362 microversion: 2.1 time: 0.156780 Oct 11 00:20:26.790271 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3913/7176] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:26 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:27.813489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a386c3a7-6c77-425d-be8c-f734d3b23cbd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:27.814154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a386c3a7-6c77-425d-be8c-f734d3b23cbd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:27.821792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a386c3a7-6c77-425d-be8c-f734d3b23cbd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:27.822300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a386c3a7-6c77-425d-be8c-f734d3b23cbd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:27.822759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a386c3a7-6c77-425d-be8c-f734d3b23cbd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:27.823485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a386c3a7-6c77-425d-be8c-f734d3b23cbd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:27.823959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a386c3a7-6c77-425d-be8c-f734d3b23cbd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:27.824443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a386c3a7-6c77-425d-be8c-f734d3b23cbd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:27.964533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a386c3a7-6c77-425d-be8c-f734d3b23cbd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:27.972314 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a386c3a7-6c77-425d-be8c-f734d3b23cbd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1362 microversion: 2.1 time: 0.162822 Oct 11 00:20:27.972885 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3914/7177] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:27 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:28.996961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ed1a2fa1-d21c-4211-bcf8-4c93180d2816 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:28.997675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ed1a2fa1-d21c-4211-bcf8-4c93180d2816 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:29.004488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed1a2fa1-d21c-4211-bcf8-4c93180d2816 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:29.004990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed1a2fa1-d21c-4211-bcf8-4c93180d2816 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:29.006094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed1a2fa1-d21c-4211-bcf8-4c93180d2816 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:29.006818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed1a2fa1-d21c-4211-bcf8-4c93180d2816 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:29.007291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed1a2fa1-d21c-4211-bcf8-4c93180d2816 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:29.007737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed1a2fa1-d21c-4211-bcf8-4c93180d2816 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:29.141644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ed1a2fa1-d21c-4211-bcf8-4c93180d2816 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:29.151173 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ed1a2fa1-d21c-4211-bcf8-4c93180d2816 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1362 microversion: 2.1 time: 0.158092 Oct 11 00:20:29.151759 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3915/7178] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:28 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:29.407984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-f6053c5a-1808-40c7-a524-4dac0b876ffc req-8d525180-1b89-4861-81af-e8ca7e70b485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a715295-b7cf-48df-a5e1-c7404ae94e70", "name": "network-vif-plugged", "status": "completed", "tag": "6708e863-d19b-403b-b026-0e88a99545f1"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:20:29.418932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f6053c5a-1808-40c7-a524-4dac0b876ffc req-8d525180-1b89-4861-81af-e8ca7e70b485 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:29.419438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f6053c5a-1808-40c7-a524-4dac0b876ffc req-8d525180-1b89-4861-81af-e8ca7e70b485 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:29.419883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f6053c5a-1808-40c7-a524-4dac0b876ffc req-8d525180-1b89-4861-81af-e8ca7e70b485 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:29.432844 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-f6053c5a-1808-40c7-a524-4dac0b876ffc req-8d525180-1b89-4861-81af-e8ca7e70b485 service nova] Creating event network-vif-plugged:6708e863-d19b-403b-b026-0e88a99545f1 for instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 on n-h2-860864-2 Oct 11 00:20:29.437758 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-f6053c5a-1808-40c7-a524-4dac0b876ffc req-8d525180-1b89-4861-81af-e8ca7e70b485 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033429 Oct 11 00:20:29.438368 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3916/7179] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:20:30.176303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b08fe214-403e-495c-8742-4694e3fb2d62 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:30.177152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b08fe214-403e-495c-8742-4694e3fb2d62 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:30.183714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b08fe214-403e-495c-8742-4694e3fb2d62 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:30.184219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b08fe214-403e-495c-8742-4694e3fb2d62 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:30.184669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b08fe214-403e-495c-8742-4694e3fb2d62 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:30.185404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b08fe214-403e-495c-8742-4694e3fb2d62 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:30.185879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b08fe214-403e-495c-8742-4694e3fb2d62 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:30.186324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b08fe214-403e-495c-8742-4694e3fb2d62 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:30.190448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:20:30.319811 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b08fe214-403e-495c-8742-4694e3fb2d62 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:30.327659 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b08fe214-403e-495c-8742-4694e3fb2d62 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1362 microversion: 2.1 time: 0.156445 Oct 11 00:20:30.328232 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3917/7180] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:30 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:31.352429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-21d575b7-d897-488a-8c2e-10d58b51ae75 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:31.353081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-21d575b7-d897-488a-8c2e-10d58b51ae75 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:31.354963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:20:31.355686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:20:31.362286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21d575b7-d897-488a-8c2e-10d58b51ae75 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:31.362793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21d575b7-d897-488a-8c2e-10d58b51ae75 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:31.363250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21d575b7-d897-488a-8c2e-10d58b51ae75 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:31.363961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21d575b7-d897-488a-8c2e-10d58b51ae75 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:31.364436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21d575b7-d897-488a-8c2e-10d58b51ae75 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:31.365169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21d575b7-d897-488a-8c2e-10d58b51ae75 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:31.503156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-21d575b7-d897-488a-8c2e-10d58b51ae75 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:20:31.511911 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-21d575b7-d897-488a-8c2e-10d58b51ae75 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1549 microversion: 2.1 time: 0.164189 Oct 11 00:20:31.512492 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3918/7181] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:20:31 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:20:31.534965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a73b3832-a3ba-4aec-ade4-32fbeb460edc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:20:31.535507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a73b3832-a3ba-4aec-ade4-32fbeb460edc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:20:31.541634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a73b3832-a3ba-4aec-ade4-32fbeb460edc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:31.542143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a73b3832-a3ba-4aec-ade4-32fbeb460edc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:31.542597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a73b3832-a3ba-4aec-ade4-32fbeb460edc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:31.543301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a73b3832-a3ba-4aec-ade4-32fbeb460edc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:31.543773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a73b3832-a3ba-4aec-ade4-32fbeb460edc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:31.544217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a73b3832-a3ba-4aec-ade4-32fbeb460edc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:31.621457 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a73b3832-a3ba-4aec-ade4-32fbeb460edc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090139 Oct 11 00:20:31.622073 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3919/7182] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 11 00:20:31 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:20:32.901832 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-11e7a3cb-66b6-4dbf-a1b6-d55824e1164e req-5fc13dbd-30ae-4c59-ae69-4a5ebb4fcd21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a715295-b7cf-48df-a5e1-c7404ae94e70", "tag": "6708e863-d19b-403b-b026-0e88a99545f1"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:20:32.911359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-11e7a3cb-66b6-4dbf-a1b6-d55824e1164e req-5fc13dbd-30ae-4c59-ae69-4a5ebb4fcd21 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:20:32.912638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-11e7a3cb-66b6-4dbf-a1b6-d55824e1164e req-5fc13dbd-30ae-4c59-ae69-4a5ebb4fcd21 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:20:32.913164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-11e7a3cb-66b6-4dbf-a1b6-d55824e1164e req-5fc13dbd-30ae-4c59-ae69-4a5ebb4fcd21 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:20:32.924873 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-11e7a3cb-66b6-4dbf-a1b6-d55824e1164e req-5fc13dbd-30ae-4c59-ae69-4a5ebb4fcd21 service nova] Creating event network-changed:6708e863-d19b-403b-b026-0e88a99545f1 for instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 on n-h2-860864-2 Oct 11 00:20:32.930846 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-11e7a3cb-66b6-4dbf-a1b6-d55824e1164e req-5fc13dbd-30ae-4c59-ae69-4a5ebb4fcd21 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034903 Oct 11 00:20:32.931456 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3920/7183] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:20:36.727783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG neutronclient.v2_0.client [None req-f3bdf2c6-13a1-4f91-9584-ece58a673dce tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Error message: {"NeutronError": {"type": "NetworkNotFound", "message": "Network 6b4889cd-925d-4509-9797-a829b845f15b could not be found.", "detail": ""}} {{(pid=120614) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi [None req-f3bdf2c6-13a1-4f91-9584-ece58a673dce tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Unexpected exception in API method: neutronclient.common.exceptions.NetworkNotFoundClient: Network 6b4889cd-925d-4509-9797-a829b845f15b could not be found. Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: Neutron server returns request_ids: ['req-6911ed52-e4da-44d6-8aae-6640b59dd078'] Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2347, in create_resource_requests Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi physnet, tunneled_ = self._get_physnet_tunneled_info( Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2133, in _get_physnet_tunneled_info Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi network = neutron.show_network(net_id, Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 865, in show_network Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.get(self.network_path % (network), params=_params) Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NetworkNotFoundClient: Network 6b4889cd-925d-4509-9797-a829b845f15b could not be found. Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6911ed52-e4da-44d6-8aae-6640b59dd078'] Oct 11 00:20:36.729494 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-f3bdf2c6-13a1-4f91-9584-ece58a673dce tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f3bdf2c6-13a1-4f91-9584-ece58a673dce tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Request method failure captured: Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 355 Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLLstMFexBVKeRZfAj4OCdRv2YehxcaQe5WSbFwzJkUkY6SJnjfDm2dxiLn9eYpnR--tUOvl2KLmN3ree44KRlI2zh3Ld-tMuW3Hl-usm_NfJhejqaTW-3Rn2txi7roIax1gqv6lgH4fxV8-FpQFyIdTw_tVXsZtCYad971Mm27pxUg Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/be6e417773094ab08c170ca4b69f3742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_be6e417773094ab08c170ca4b69f3742", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TestVolumeBootPattern-451663755 Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: be6e417773094ab08c170ca4b69f3742 Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestVolumeBootPattern-451663755 Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: a27b050389ad48089e214ad65eaa83bb Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TestVolumeBootPattern-451663755-project Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: {"server": {"name": "tempest-TestVolumeBootPattern-server-1436740099", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d3f00b23-4a37-4cf5-a451-9f66cf8d3330", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "6b4889cd-925d-4509-9797-a829b845f15b"}]}} Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-1436740099', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'snapshot', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'snapshot_id': 'd3f00b23-4a37-4cf5-a451-9f66cf8d3330'}], 'networks': [{'uuid': '6b4889cd-925d-4509-9797-a829b845f15b'}]}}} Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Oct 11 00:20:36.732719 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2347, in create_resource_requests Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi physnet, tunneled_ = self._get_physnet_tunneled_info( Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2133, in _get_physnet_tunneled_info Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi network = neutron.show_network(net_id, Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 865, in show_network Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.get(self.network_path % (network), params=_params) Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NetworkNotFoundClient: Network 6b4889cd-925d-4509-9797-a829b845f15b could not be found. Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6911ed52-e4da-44d6-8aae-6640b59dd078'] Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f3bdf2c6-13a1-4f91-9584-ece58a673dce tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Oct 11 00:20:36.736018 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:20:36.740291 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f3bdf2c6-13a1-4f91-9584-ece58a673dce tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 500 len: 227 microversion: 2.1 time: 900.484710 Oct 11 00:20:36.740291 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:20:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 11 00:20:36.740291 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:20:36 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/servers (10.222.0.23) Oct 11 00:20:36.740291 n-d-860864-2 devstack@n-api.service[120614]: CRITICAL nova [None req-f3bdf2c6-13a1-4f91-9584-ece58a673dce tempest-TestVolumeBootPattern-451663755 tempest-TestVolumeBootPattern-451663755-project] Unhandled error: OSError: write error Oct 11 00:20:36.740291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova OSError: write error Oct 11 00:20:36.740291 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova Oct 11 00:20:36.740291 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3264/7184] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:05:36 2022] POST /compute/v2.1/servers => generated 0 bytes in 900487 msecs (HTTP/1.1 500) 9 headers in 0 bytes (0 switches on core 0) Oct 11 00:21:06.104544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:21:06.105229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=17 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:21:06.109816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-84669e64-2546-49fd-bcb5-a2a8ce6e0981 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:21:06.117641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84669e64-2546-49fd-bcb5-a2a8ce6e0981 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:06.118146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84669e64-2546-49fd-bcb5-a2a8ce6e0981 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:06.118600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84669e64-2546-49fd-bcb5-a2a8ce6e0981 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:06.141394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-84669e64-2546-49fd-bcb5-a2a8ce6e0981 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Going to try to stop instance {{(pid=120613) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 00:21:06.184373 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-84669e64-2546-49fd-bcb5-a2a8ce6e0981 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "POST /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70/action" status: 202 len: 0 microversion: 2.1 time: 0.082032 Oct 11 00:21:06.185758 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3921/7185] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:21:06 2022] POST /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:21:06.193209 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:21:06.193805 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:21:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 (ip 10.222.0.23) !!! Oct 11 00:21:06.198420 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-53a46714-4334-4b11-8366-d08f9f3597b9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:06.199025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-53a46714-4334-4b11-8366-d08f9f3597b9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:06.211518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53a46714-4334-4b11-8366-d08f9f3597b9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:06.212014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53a46714-4334-4b11-8366-d08f9f3597b9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:06.212457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53a46714-4334-4b11-8366-d08f9f3597b9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:06.213197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53a46714-4334-4b11-8366-d08f9f3597b9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:06.215693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53a46714-4334-4b11-8366-d08f9f3597b9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:06.215693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53a46714-4334-4b11-8366-d08f9f3597b9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:06.484011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-53a46714-4334-4b11-8366-d08f9f3597b9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:06.492303 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-53a46714-4334-4b11-8366-d08f9f3597b9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1677 microversion: 2.1 time: 0.302902 Oct 11 00:21:06.492883 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3265/7186] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:06 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1677 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:07.516936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bcc06737-7648-4ac5-858f-114a6f4442aa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:07.517952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bcc06737-7648-4ac5-858f-114a6f4442aa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:07.524537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bcc06737-7648-4ac5-858f-114a6f4442aa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:07.525037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bcc06737-7648-4ac5-858f-114a6f4442aa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:07.525520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bcc06737-7648-4ac5-858f-114a6f4442aa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:07.526230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bcc06737-7648-4ac5-858f-114a6f4442aa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:07.526703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bcc06737-7648-4ac5-858f-114a6f4442aa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:07.527148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bcc06737-7648-4ac5-858f-114a6f4442aa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:07.658855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bcc06737-7648-4ac5-858f-114a6f4442aa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:07.667249 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bcc06737-7648-4ac5-858f-114a6f4442aa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1677 microversion: 2.1 time: 0.155472 Oct 11 00:21:07.667822 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3922/7187] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:07 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:08.691505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-85aba700-e184-437c-a195-96214a66fcfb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:08.692471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-85aba700-e184-437c-a195-96214a66fcfb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:08.702384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85aba700-e184-437c-a195-96214a66fcfb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:08.702929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85aba700-e184-437c-a195-96214a66fcfb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:08.703467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85aba700-e184-437c-a195-96214a66fcfb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:08.704286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85aba700-e184-437c-a195-96214a66fcfb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:08.704838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85aba700-e184-437c-a195-96214a66fcfb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:08.705398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85aba700-e184-437c-a195-96214a66fcfb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:08.841651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-85aba700-e184-437c-a195-96214a66fcfb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:08.850049 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-85aba700-e184-437c-a195-96214a66fcfb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1677 microversion: 2.1 time: 0.162478 Oct 11 00:21:08.850628 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3266/7188] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:08 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:09.875645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-45dd6f58-c04d-4ec5-92a9-9505d3b4f3ef tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:09.876281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-45dd6f58-c04d-4ec5-92a9-9505d3b4f3ef tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:09.883442 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45dd6f58-c04d-4ec5-92a9-9505d3b4f3ef tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:09.883942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45dd6f58-c04d-4ec5-92a9-9505d3b4f3ef tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:09.884399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45dd6f58-c04d-4ec5-92a9-9505d3b4f3ef tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:09.885112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45dd6f58-c04d-4ec5-92a9-9505d3b4f3ef tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:09.885624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45dd6f58-c04d-4ec5-92a9-9505d3b4f3ef tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:09.886069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45dd6f58-c04d-4ec5-92a9-9505d3b4f3ef tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:10.014867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-45dd6f58-c04d-4ec5-92a9-9505d3b4f3ef tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:10.023334 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-45dd6f58-c04d-4ec5-92a9-9505d3b4f3ef tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1677 microversion: 2.1 time: 0.151654 Oct 11 00:21:10.023916 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3923/7189] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:09 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:11.047380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bf3588a5-6bd5-4402-b61b-f13bd839179e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:11.047995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bf3588a5-6bd5-4402-b61b-f13bd839179e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:11.057638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf3588a5-6bd5-4402-b61b-f13bd839179e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:11.058125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf3588a5-6bd5-4402-b61b-f13bd839179e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:11.058564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf3588a5-6bd5-4402-b61b-f13bd839179e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:11.059260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf3588a5-6bd5-4402-b61b-f13bd839179e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:11.059714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf3588a5-6bd5-4402-b61b-f13bd839179e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:11.060141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bf3588a5-6bd5-4402-b61b-f13bd839179e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:11.192288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bf3588a5-6bd5-4402-b61b-f13bd839179e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:11.200013 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bf3588a5-6bd5-4402-b61b-f13bd839179e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1677 microversion: 2.1 time: 0.156683 Oct 11 00:21:11.200584 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3267/7190] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:11 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:12.224146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-55906270-5dbf-47fb-996d-1809f89cf334 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:12.224828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-55906270-5dbf-47fb-996d-1809f89cf334 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:12.231712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55906270-5dbf-47fb-996d-1809f89cf334 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:12.232217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55906270-5dbf-47fb-996d-1809f89cf334 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:12.232670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55906270-5dbf-47fb-996d-1809f89cf334 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:12.233403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55906270-5dbf-47fb-996d-1809f89cf334 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:12.233890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55906270-5dbf-47fb-996d-1809f89cf334 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:12.234337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-55906270-5dbf-47fb-996d-1809f89cf334 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:12.365930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-55906270-5dbf-47fb-996d-1809f89cf334 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:12.373717 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-55906270-5dbf-47fb-996d-1809f89cf334 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1677 microversion: 2.1 time: 0.154181 Oct 11 00:21:12.374292 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3924/7191] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:12 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:13.397109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dc324c07-4c18-4bad-9f22-5991e469a48e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:13.397740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dc324c07-4c18-4bad-9f22-5991e469a48e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:13.404440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc324c07-4c18-4bad-9f22-5991e469a48e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:13.404920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc324c07-4c18-4bad-9f22-5991e469a48e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:13.405352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc324c07-4c18-4bad-9f22-5991e469a48e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:13.406074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc324c07-4c18-4bad-9f22-5991e469a48e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:13.406527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc324c07-4c18-4bad-9f22-5991e469a48e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:13.406952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc324c07-4c18-4bad-9f22-5991e469a48e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:13.536981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dc324c07-4c18-4bad-9f22-5991e469a48e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:13.544364 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dc324c07-4c18-4bad-9f22-5991e469a48e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1677 microversion: 2.1 time: 0.151235 Oct 11 00:21:13.544922 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3268/7192] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:13 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:14.569618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f874a68f-247b-4231-8859-94d09caeaf13 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:14.570249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f874a68f-247b-4231-8859-94d09caeaf13 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:14.577125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f874a68f-247b-4231-8859-94d09caeaf13 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:14.577661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f874a68f-247b-4231-8859-94d09caeaf13 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:14.578111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f874a68f-247b-4231-8859-94d09caeaf13 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:14.578816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f874a68f-247b-4231-8859-94d09caeaf13 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:14.579283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f874a68f-247b-4231-8859-94d09caeaf13 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:14.579719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f874a68f-247b-4231-8859-94d09caeaf13 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:14.714974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f874a68f-247b-4231-8859-94d09caeaf13 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:14.722831 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f874a68f-247b-4231-8859-94d09caeaf13 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1677 microversion: 2.1 time: 0.158274 Oct 11 00:21:14.723430 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3925/7193] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:14 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:15.746927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4ac26f3f-393c-400e-879b-1192767bc55c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:15.747544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4ac26f3f-393c-400e-879b-1192767bc55c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:15.754372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ac26f3f-393c-400e-879b-1192767bc55c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:15.754848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ac26f3f-393c-400e-879b-1192767bc55c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:15.755283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ac26f3f-393c-400e-879b-1192767bc55c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:15.755992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ac26f3f-393c-400e-879b-1192767bc55c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:15.756428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ac26f3f-393c-400e-879b-1192767bc55c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:15.756862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4ac26f3f-393c-400e-879b-1192767bc55c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:15.886562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4ac26f3f-393c-400e-879b-1192767bc55c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:15.894539 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4ac26f3f-393c-400e-879b-1192767bc55c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1677 microversion: 2.1 time: 0.151575 Oct 11 00:21:15.896050 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3269/7194] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:15 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:16.918609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2475de0f-631f-426f-8212-e465b0f31866 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:16.919168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2475de0f-631f-426f-8212-e465b0f31866 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:16.926214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2475de0f-631f-426f-8212-e465b0f31866 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:16.926890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2475de0f-631f-426f-8212-e465b0f31866 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:16.927397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2475de0f-631f-426f-8212-e465b0f31866 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:16.928386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2475de0f-631f-426f-8212-e465b0f31866 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:16.928853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2475de0f-631f-426f-8212-e465b0f31866 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:16.929303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2475de0f-631f-426f-8212-e465b0f31866 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:17.061201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2475de0f-631f-426f-8212-e465b0f31866 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:17.069306 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2475de0f-631f-426f-8212-e465b0f31866 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1677 microversion: 2.1 time: 0.154716 Oct 11 00:21:17.069929 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3926/7195] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:16 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:18.093457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2a4745c7-29a5-4ec1-adeb-66aab4b092de tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:18.093992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2a4745c7-29a5-4ec1-adeb-66aab4b092de tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:18.101766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a4745c7-29a5-4ec1-adeb-66aab4b092de tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:18.102250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a4745c7-29a5-4ec1-adeb-66aab4b092de tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:18.102685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a4745c7-29a5-4ec1-adeb-66aab4b092de tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:18.103378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a4745c7-29a5-4ec1-adeb-66aab4b092de tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:18.103833 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a4745c7-29a5-4ec1-adeb-66aab4b092de tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:18.104262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a4745c7-29a5-4ec1-adeb-66aab4b092de tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:18.236977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2a4745c7-29a5-4ec1-adeb-66aab4b092de tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:18.245342 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2a4745c7-29a5-4ec1-adeb-66aab4b092de tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1677 microversion: 2.1 time: 0.155904 Oct 11 00:21:18.245969 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3270/7196] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:18 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:19.268286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-37bddbd7-b0c6-4106-a927-0cba52c4fcd3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:19.269098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-37bddbd7-b0c6-4106-a927-0cba52c4fcd3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:19.276004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37bddbd7-b0c6-4106-a927-0cba52c4fcd3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:19.276504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37bddbd7-b0c6-4106-a927-0cba52c4fcd3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:19.276960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37bddbd7-b0c6-4106-a927-0cba52c4fcd3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:19.277718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37bddbd7-b0c6-4106-a927-0cba52c4fcd3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:19.278190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37bddbd7-b0c6-4106-a927-0cba52c4fcd3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:19.278636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37bddbd7-b0c6-4106-a927-0cba52c4fcd3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:19.408747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-37bddbd7-b0c6-4106-a927-0cba52c4fcd3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:19.417395 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-37bddbd7-b0c6-4106-a927-0cba52c4fcd3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1677 microversion: 2.1 time: 0.153155 Oct 11 00:21:19.417974 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3927/7197] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:19 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:20.441420 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-16ad96b1-6c71-4a09-9818-2af180317394 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:20.442038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-16ad96b1-6c71-4a09-9818-2af180317394 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:20.450060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16ad96b1-6c71-4a09-9818-2af180317394 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:20.450478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16ad96b1-6c71-4a09-9818-2af180317394 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:20.450907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16ad96b1-6c71-4a09-9818-2af180317394 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:20.451596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16ad96b1-6c71-4a09-9818-2af180317394 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:20.452042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16ad96b1-6c71-4a09-9818-2af180317394 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:20.452460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-16ad96b1-6c71-4a09-9818-2af180317394 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:20.597424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-16ad96b1-6c71-4a09-9818-2af180317394 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:20.605823 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-16ad96b1-6c71-4a09-9818-2af180317394 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1677 microversion: 2.1 time: 0.168131 Oct 11 00:21:20.618154 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3271/7198] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:20 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:21.630040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-95ecfdd6-3fd3-4ac9-9e5a-05e6d4040163 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:21.630923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-95ecfdd6-3fd3-4ac9-9e5a-05e6d4040163 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:21.638908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95ecfdd6-3fd3-4ac9-9e5a-05e6d4040163 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:21.639421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95ecfdd6-3fd3-4ac9-9e5a-05e6d4040163 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:21.639880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95ecfdd6-3fd3-4ac9-9e5a-05e6d4040163 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:21.640606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95ecfdd6-3fd3-4ac9-9e5a-05e6d4040163 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:21.641245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95ecfdd6-3fd3-4ac9-9e5a-05e6d4040163 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:21.641727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95ecfdd6-3fd3-4ac9-9e5a-05e6d4040163 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:21.777945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-95ecfdd6-3fd3-4ac9-9e5a-05e6d4040163 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:21.785961 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-95ecfdd6-3fd3-4ac9-9e5a-05e6d4040163 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1654 microversion: 2.1 time: 0.159813 Oct 11 00:21:21.787384 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3928/7199] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:21 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1654 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:21.809884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5dccba5c-40ed-4dc5-a3b9-41b0ede10919 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:21:21.812266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5dccba5c-40ed-4dc5-a3b9-41b0ede10919 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:21.819639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5dccba5c-40ed-4dc5-a3b9-41b0ede10919 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:21.820146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5dccba5c-40ed-4dc5-a3b9-41b0ede10919 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:21.820588 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5dccba5c-40ed-4dc5-a3b9-41b0ede10919 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:21.821297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5dccba5c-40ed-4dc5-a3b9-41b0ede10919 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:21.821782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5dccba5c-40ed-4dc5-a3b9-41b0ede10919 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:21.822210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5dccba5c-40ed-4dc5-a3b9-41b0ede10919 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:21.861854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5dccba5c-40ed-4dc5-a3b9-41b0ede10919 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:21.868518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5dccba5c-40ed-4dc5-a3b9-41b0ede10919 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Old instance type m1.heat2, new instance type m1.heat {{(pid=120614) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 00:21:21.875143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-5dccba5c-40ed-4dc5-a3b9-41b0ede10919 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:21:21.875568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-5dccba5c-40ed-4dc5-a3b9-41b0ede10919 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:21:21.876044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-5dccba5c-40ed-4dc5-a3b9-41b0ede10919 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:21:21.876456 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-5dccba5c-40ed-4dc5-a3b9-41b0ede10919 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:21:21.876870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-5dccba5c-40ed-4dc5-a3b9-41b0ede10919 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:21:21.942171 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5dccba5c-40ed-4dc5-a3b9-41b0ede10919 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "POST /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70/action" status: 202 len: 0 microversion: 2.1 time: 0.136124 Oct 11 00:21:21.945863 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3272/7200] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:21:21 2022] POST /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:21:21.951096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4343dd02-3ad8-41d2-a418-d5083d911fa2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:21.951725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4343dd02-3ad8-41d2-a418-d5083d911fa2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:21.959339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4343dd02-3ad8-41d2-a418-d5083d911fa2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:21.959696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4343dd02-3ad8-41d2-a418-d5083d911fa2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:21.960371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4343dd02-3ad8-41d2-a418-d5083d911fa2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:21.960952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4343dd02-3ad8-41d2-a418-d5083d911fa2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:21.961349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4343dd02-3ad8-41d2-a418-d5083d911fa2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:21.961820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4343dd02-3ad8-41d2-a418-d5083d911fa2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:22.107690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4343dd02-3ad8-41d2-a418-d5083d911fa2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:22.116659 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4343dd02-3ad8-41d2-a418-d5083d911fa2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1677 microversion: 2.1 time: 0.169444 Oct 11 00:21:22.117339 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3929/7201] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:21 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:23.142075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-149a4375-5e76-4967-9e43-98647eb5810b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:23.142694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-149a4375-5e76-4967-9e43-98647eb5810b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:23.150014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-149a4375-5e76-4967-9e43-98647eb5810b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:23.150503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-149a4375-5e76-4967-9e43-98647eb5810b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:23.150940 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-149a4375-5e76-4967-9e43-98647eb5810b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:23.151635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-149a4375-5e76-4967-9e43-98647eb5810b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:23.152088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-149a4375-5e76-4967-9e43-98647eb5810b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:23.152520 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-149a4375-5e76-4967-9e43-98647eb5810b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:23.377404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-149a4375-5e76-4967-9e43-98647eb5810b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:23.385599 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-149a4375-5e76-4967-9e43-98647eb5810b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1677 microversion: 2.1 time: 0.248348 Oct 11 00:21:23.386176 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3273/7202] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:23 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1677 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:24.409586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bad0a133-2b2c-4476-b27e-745357426112 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:24.410216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bad0a133-2b2c-4476-b27e-745357426112 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:24.417671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bad0a133-2b2c-4476-b27e-745357426112 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:24.418170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bad0a133-2b2c-4476-b27e-745357426112 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:24.418622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bad0a133-2b2c-4476-b27e-745357426112 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:24.419334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bad0a133-2b2c-4476-b27e-745357426112 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:24.419803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bad0a133-2b2c-4476-b27e-745357426112 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:24.420243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bad0a133-2b2c-4476-b27e-745357426112 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:24.557179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bad0a133-2b2c-4476-b27e-745357426112 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:24.565034 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bad0a133-2b2c-4476-b27e-745357426112 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1682 microversion: 2.1 time: 0.159451 Oct 11 00:21:24.565637 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3930/7203] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:24 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:25.589670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b8a23dc9-3f41-4384-a46a-95ab832d253a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:25.590285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b8a23dc9-3f41-4384-a46a-95ab832d253a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:25.596719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8a23dc9-3f41-4384-a46a-95ab832d253a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:25.597203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8a23dc9-3f41-4384-a46a-95ab832d253a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:25.597680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8a23dc9-3f41-4384-a46a-95ab832d253a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:25.598379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8a23dc9-3f41-4384-a46a-95ab832d253a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:25.599320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8a23dc9-3f41-4384-a46a-95ab832d253a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:25.599807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8a23dc9-3f41-4384-a46a-95ab832d253a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:25.730134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b8a23dc9-3f41-4384-a46a-95ab832d253a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:25.737778 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b8a23dc9-3f41-4384-a46a-95ab832d253a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1682 microversion: 2.1 time: 0.152236 Oct 11 00:21:25.738347 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3274/7204] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:25 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:26.762483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3ddcc61d-aa46-4ecd-9790-3e82184fcccb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:26.763422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3ddcc61d-aa46-4ecd-9790-3e82184fcccb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:26.772080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ddcc61d-aa46-4ecd-9790-3e82184fcccb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:26.772710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ddcc61d-aa46-4ecd-9790-3e82184fcccb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:26.773211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ddcc61d-aa46-4ecd-9790-3e82184fcccb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:26.774208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ddcc61d-aa46-4ecd-9790-3e82184fcccb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:26.774785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ddcc61d-aa46-4ecd-9790-3e82184fcccb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:26.775305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ddcc61d-aa46-4ecd-9790-3e82184fcccb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:26.781893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-082aabba-8038-43ac-b2d6-15536994db1c req-d18b5de6-6570-4ce7-9953-1cc994fd39b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a715295-b7cf-48df-a5e1-c7404ae94e70", "name": "network-vif-unplugged", "status": "completed", "tag": "6708e863-d19b-403b-b026-0e88a99545f1"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:21:26.798122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-082aabba-8038-43ac-b2d6-15536994db1c req-d18b5de6-6570-4ce7-9953-1cc994fd39b9 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:26.799006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-082aabba-8038-43ac-b2d6-15536994db1c req-d18b5de6-6570-4ce7-9953-1cc994fd39b9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:26.799660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-082aabba-8038-43ac-b2d6-15536994db1c req-d18b5de6-6570-4ce7-9953-1cc994fd39b9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:26.826590 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-082aabba-8038-43ac-b2d6-15536994db1c req-d18b5de6-6570-4ce7-9953-1cc994fd39b9 service nova] Creating event network-vif-unplugged:6708e863-d19b-403b-b026-0e88a99545f1 for instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 on n-h1-860864-2 Oct 11 00:21:26.832832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [req-082aabba-8038-43ac-b2d6-15536994db1c req-d18b5de6-6570-4ce7-9953-1cc994fd39b9 service nova] Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 00:21:26.846721 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-082aabba-8038-43ac-b2d6-15536994db1c req-d18b5de6-6570-4ce7-9953-1cc994fd39b9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068688 Oct 11 00:21:26.848012 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3275/7205] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:21:27.070519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3ddcc61d-aa46-4ecd-9790-3e82184fcccb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:27.078401 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3ddcc61d-aa46-4ecd-9790-3e82184fcccb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1681 microversion: 2.1 time: 0.320858 Oct 11 00:21:27.079018 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3931/7206] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:26 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1681 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:28.105560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d325a1ea-f37c-49b8-ad7c-42d967fba56f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:28.106190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d325a1ea-f37c-49b8-ad7c-42d967fba56f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:28.112318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d325a1ea-f37c-49b8-ad7c-42d967fba56f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:28.112805 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d325a1ea-f37c-49b8-ad7c-42d967fba56f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:28.113242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d325a1ea-f37c-49b8-ad7c-42d967fba56f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:28.113961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d325a1ea-f37c-49b8-ad7c-42d967fba56f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:28.115313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d325a1ea-f37c-49b8-ad7c-42d967fba56f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:28.115742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d325a1ea-f37c-49b8-ad7c-42d967fba56f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:28.255023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d325a1ea-f37c-49b8-ad7c-42d967fba56f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:28.263040 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d325a1ea-f37c-49b8-ad7c-42d967fba56f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1679 microversion: 2.1 time: 0.162701 Oct 11 00:21:28.263626 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3276/7207] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:28 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:28.883699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-870af772-6f34-4217-96f9-c553e053f9aa req-2ee20a26-0446-4c23-a6f5-74068e9a4b15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a715295-b7cf-48df-a5e1-c7404ae94e70", "tag": "6708e863-d19b-403b-b026-0e88a99545f1"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:21:28.893854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-870af772-6f34-4217-96f9-c553e053f9aa req-2ee20a26-0446-4c23-a6f5-74068e9a4b15 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:28.894344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-870af772-6f34-4217-96f9-c553e053f9aa req-2ee20a26-0446-4c23-a6f5-74068e9a4b15 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:28.894792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-870af772-6f34-4217-96f9-c553e053f9aa req-2ee20a26-0446-4c23-a6f5-74068e9a4b15 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:28.906720 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-870af772-6f34-4217-96f9-c553e053f9aa req-2ee20a26-0446-4c23-a6f5-74068e9a4b15 service nova] Creating event network-changed:6708e863-d19b-403b-b026-0e88a99545f1 for instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 on n-h1-860864-2 Oct 11 00:21:28.912855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-870af772-6f34-4217-96f9-c553e053f9aa req-2ee20a26-0446-4c23-a6f5-74068e9a4b15 service nova] Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 00:21:28.923744 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-870af772-6f34-4217-96f9-c553e053f9aa req-2ee20a26-0446-4c23-a6f5-74068e9a4b15 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044244 Oct 11 00:21:28.924349 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3932/7208] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:21:29.288575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-57334b5d-e858-4cc8-a1e3-6712713de571 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:29.289818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-57334b5d-e858-4cc8-a1e3-6712713de571 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:29.298172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57334b5d-e858-4cc8-a1e3-6712713de571 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:29.298172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57334b5d-e858-4cc8-a1e3-6712713de571 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:29.298590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57334b5d-e858-4cc8-a1e3-6712713de571 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:29.299296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57334b5d-e858-4cc8-a1e3-6712713de571 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:29.299739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57334b5d-e858-4cc8-a1e3-6712713de571 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:29.300334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-57334b5d-e858-4cc8-a1e3-6712713de571 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:29.450789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-57334b5d-e858-4cc8-a1e3-6712713de571 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:29.461239 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-57334b5d-e858-4cc8-a1e3-6712713de571 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1679 microversion: 2.1 time: 0.178413 Oct 11 00:21:29.461884 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3277/7209] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:29 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:30.485894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7b049657-fa4f-45c3-a7b0-f23ea7725802 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:30.486608 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7b049657-fa4f-45c3-a7b0-f23ea7725802 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:30.493682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b049657-fa4f-45c3-a7b0-f23ea7725802 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:30.494188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b049657-fa4f-45c3-a7b0-f23ea7725802 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:30.494639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b049657-fa4f-45c3-a7b0-f23ea7725802 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:30.495358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b049657-fa4f-45c3-a7b0-f23ea7725802 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:30.495822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b049657-fa4f-45c3-a7b0-f23ea7725802 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:30.496257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b049657-fa4f-45c3-a7b0-f23ea7725802 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:30.738038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7b049657-fa4f-45c3-a7b0-f23ea7725802 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:30.745938 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7b049657-fa4f-45c3-a7b0-f23ea7725802 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1675 microversion: 2.1 time: 0.265196 Oct 11 00:21:30.746524 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3933/7210] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:30 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1675 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:30.768518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-85740529-fc1e-4292-853c-f8df5c52fe5f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:21:30.769129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-85740529-fc1e-4292-853c-f8df5c52fe5f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:30.776496 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85740529-fc1e-4292-853c-f8df5c52fe5f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:30.776988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85740529-fc1e-4292-853c-f8df5c52fe5f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:30.777447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85740529-fc1e-4292-853c-f8df5c52fe5f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:30.778146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85740529-fc1e-4292-853c-f8df5c52fe5f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:30.778601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85740529-fc1e-4292-853c-f8df5c52fe5f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:30.779048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-85740529-fc1e-4292-853c-f8df5c52fe5f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:30.842219 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-85740529-fc1e-4292-853c-f8df5c52fe5f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "POST /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70/action" status: 204 len: 0 microversion: 2.1 time: 0.077414 Oct 11 00:21:30.843029 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3278/7211] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:21:30 2022] POST /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:21:30.851848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c7297eb7-2853-4b7e-97e3-50680c17f6d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:30.852404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c7297eb7-2853-4b7e-97e3-50680c17f6d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:30.858802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7297eb7-2853-4b7e-97e3-50680c17f6d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:30.859315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7297eb7-2853-4b7e-97e3-50680c17f6d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:30.859770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7297eb7-2853-4b7e-97e3-50680c17f6d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:30.860492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7297eb7-2853-4b7e-97e3-50680c17f6d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:30.860971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7297eb7-2853-4b7e-97e3-50680c17f6d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:30.861435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c7297eb7-2853-4b7e-97e3-50680c17f6d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:30.997117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c7297eb7-2853-4b7e-97e3-50680c17f6d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:31.005833 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c7297eb7-2853-4b7e-97e3-50680c17f6d4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1675 microversion: 2.1 time: 0.157920 Oct 11 00:21:31.006536 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3934/7212] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:30 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:32.031602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-51ec6ec4-76f2-4e52-a0f0-77b5f3bfd3ed tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:32.032258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-51ec6ec4-76f2-4e52-a0f0-77b5f3bfd3ed tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:32.038723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51ec6ec4-76f2-4e52-a0f0-77b5f3bfd3ed tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:32.039212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51ec6ec4-76f2-4e52-a0f0-77b5f3bfd3ed tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:32.039649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51ec6ec4-76f2-4e52-a0f0-77b5f3bfd3ed tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:32.040353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51ec6ec4-76f2-4e52-a0f0-77b5f3bfd3ed tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:32.040808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51ec6ec4-76f2-4e52-a0f0-77b5f3bfd3ed tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:32.041232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51ec6ec4-76f2-4e52-a0f0-77b5f3bfd3ed tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:32.057802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:21:32.185492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-51ec6ec4-76f2-4e52-a0f0-77b5f3bfd3ed tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:32.195226 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-51ec6ec4-76f2-4e52-a0f0-77b5f3bfd3ed tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1675 microversion: 2.1 time: 0.168689 Oct 11 00:21:32.196183 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3279/7213] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:32 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:33.220584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9e837767-3c7c-4a8e-bf65-cde592dc7fd0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:33.221220 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9e837767-3c7c-4a8e-bf65-cde592dc7fd0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:33.229045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e837767-3c7c-4a8e-bf65-cde592dc7fd0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:33.229588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e837767-3c7c-4a8e-bf65-cde592dc7fd0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:33.230046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e837767-3c7c-4a8e-bf65-cde592dc7fd0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:33.230762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e837767-3c7c-4a8e-bf65-cde592dc7fd0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:33.231243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e837767-3c7c-4a8e-bf65-cde592dc7fd0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:33.231690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9e837767-3c7c-4a8e-bf65-cde592dc7fd0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:33.365652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9e837767-3c7c-4a8e-bf65-cde592dc7fd0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:33.374280 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9e837767-3c7c-4a8e-bf65-cde592dc7fd0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1654 microversion: 2.1 time: 0.157967 Oct 11 00:21:33.375082 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3935/7214] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:33 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1654 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:33.397515 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1d886726-fc29-435c-8f2e-b86364a5b332 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:33.398143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1d886726-fc29-435c-8f2e-b86364a5b332 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:33.405120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d886726-fc29-435c-8f2e-b86364a5b332 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:33.405645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d886726-fc29-435c-8f2e-b86364a5b332 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:33.406087 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d886726-fc29-435c-8f2e-b86364a5b332 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:33.406782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d886726-fc29-435c-8f2e-b86364a5b332 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:33.407246 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d886726-fc29-435c-8f2e-b86364a5b332 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:33.407675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d886726-fc29-435c-8f2e-b86364a5b332 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:33.538433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1d886726-fc29-435c-8f2e-b86364a5b332 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:33.546171 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1d886726-fc29-435c-8f2e-b86364a5b332 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1654 microversion: 2.1 time: 0.153112 Oct 11 00:21:33.546742 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3280/7215] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:33 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:33.569987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9806f6b0-1f09-4118-83a4-59246780bcbb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:21:33.575961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9806f6b0-1f09-4118-83a4-59246780bcbb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:33.576465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9806f6b0-1f09-4118-83a4-59246780bcbb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:33.576948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9806f6b0-1f09-4118-83a4-59246780bcbb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:33.600755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9806f6b0-1f09-4118-83a4-59246780bcbb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Going to try to start instance {{(pid=120613) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 00:21:33.605804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:21:33.659185 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9806f6b0-1f09-4118-83a4-59246780bcbb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "POST /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70/action" status: 202 len: 0 microversion: 2.1 time: 0.093520 Oct 11 00:21:33.659911 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3936/7216] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:21:33 2022] POST /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:21:33.669031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-04c82213-dc37-4c60-bbfe-cb0a1205d867 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:33.669791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-04c82213-dc37-4c60-bbfe-cb0a1205d867 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:33.675967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04c82213-dc37-4c60-bbfe-cb0a1205d867 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:33.676463 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04c82213-dc37-4c60-bbfe-cb0a1205d867 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:33.676963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04c82213-dc37-4c60-bbfe-cb0a1205d867 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:33.678349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04c82213-dc37-4c60-bbfe-cb0a1205d867 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:33.679001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04c82213-dc37-4c60-bbfe-cb0a1205d867 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:33.679727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04c82213-dc37-4c60-bbfe-cb0a1205d867 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:33.840259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-40e26f43-be7f-4c29-9ad8-3f29a59f1a4a req-8a6abb78-ffcb-406c-a685-b54e24cf5974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a715295-b7cf-48df-a5e1-c7404ae94e70", "name": "network-vif-plugged", "status": "completed", "tag": "6708e863-d19b-403b-b026-0e88a99545f1"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:21:33.851684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-40e26f43-be7f-4c29-9ad8-3f29a59f1a4a req-8a6abb78-ffcb-406c-a685-b54e24cf5974 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:33.852195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-40e26f43-be7f-4c29-9ad8-3f29a59f1a4a req-8a6abb78-ffcb-406c-a685-b54e24cf5974 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:33.852657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-40e26f43-be7f-4c29-9ad8-3f29a59f1a4a req-8a6abb78-ffcb-406c-a685-b54e24cf5974 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:33.864519 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-40e26f43-be7f-4c29-9ad8-3f29a59f1a4a req-8a6abb78-ffcb-406c-a685-b54e24cf5974 service nova] Creating event network-vif-plugged:6708e863-d19b-403b-b026-0e88a99545f1 for instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 on n-h1-860864-2 Oct 11 00:21:33.870995 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-40e26f43-be7f-4c29-9ad8-3f29a59f1a4a req-8a6abb78-ffcb-406c-a685-b54e24cf5974 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113447 Oct 11 00:21:33.871700 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3937/7217] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:21:33.907225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-04c82213-dc37-4c60-bbfe-cb0a1205d867 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:33.915966 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-04c82213-dc37-4c60-bbfe-cb0a1205d867 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1663 microversion: 2.1 time: 0.250872 Oct 11 00:21:33.916557 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3281/7218] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:33 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1663 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:21:34.940753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-84fb1a3a-8d3f-4f2a-aa81-b6e1c813c733 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:34.941490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-84fb1a3a-8d3f-4f2a-aa81-b6e1c813c733 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:34.948971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84fb1a3a-8d3f-4f2a-aa81-b6e1c813c733 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:34.949499 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84fb1a3a-8d3f-4f2a-aa81-b6e1c813c733 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:34.949958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84fb1a3a-8d3f-4f2a-aa81-b6e1c813c733 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:34.950669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84fb1a3a-8d3f-4f2a-aa81-b6e1c813c733 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:34.951141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84fb1a3a-8d3f-4f2a-aa81-b6e1c813c733 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:34.951585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-84fb1a3a-8d3f-4f2a-aa81-b6e1c813c733 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:35.085016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-84fb1a3a-8d3f-4f2a-aa81-b6e1c813c733 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:35.092784 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-84fb1a3a-8d3f-4f2a-aa81-b6e1c813c733 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1667 microversion: 2.1 time: 0.156376 Oct 11 00:21:35.093358 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3938/7219] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:34 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:35.115667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-359159a4-dbfe-4896-9e92-d6855c5e7572 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:35.116189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-359159a4-dbfe-4896-9e92-d6855c5e7572 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:35.122996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-359159a4-dbfe-4896-9e92-d6855c5e7572 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:35.123482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-359159a4-dbfe-4896-9e92-d6855c5e7572 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:35.123918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-359159a4-dbfe-4896-9e92-d6855c5e7572 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:35.124612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-359159a4-dbfe-4896-9e92-d6855c5e7572 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:35.125063 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-359159a4-dbfe-4896-9e92-d6855c5e7572 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:35.125516 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-359159a4-dbfe-4896-9e92-d6855c5e7572 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:35.160642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-359159a4-dbfe-4896-9e92-d6855c5e7572 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:21:35.239528 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-359159a4-dbfe-4896-9e92-d6855c5e7572 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 204 len: 0 microversion: 2.1 time: 0.127607 Oct 11 00:21:35.241058 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3282/7220] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:21:35 2022] DELETE /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:21:35.249189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-896483ea-222d-4307-b68d-c8807a1117ce tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:35.249867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-896483ea-222d-4307-b68d-c8807a1117ce tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:35.256718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-896483ea-222d-4307-b68d-c8807a1117ce tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:35.257230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-896483ea-222d-4307-b68d-c8807a1117ce tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:35.257755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-896483ea-222d-4307-b68d-c8807a1117ce tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:35.258470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-896483ea-222d-4307-b68d-c8807a1117ce tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:35.258947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-896483ea-222d-4307-b68d-c8807a1117ce tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:35.259396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-896483ea-222d-4307-b68d-c8807a1117ce tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:35.396906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-896483ea-222d-4307-b68d-c8807a1117ce tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:35.404966 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-896483ea-222d-4307-b68d-c8807a1117ce tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1673 microversion: 2.1 time: 0.159659 Oct 11 00:21:35.405579 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3939/7221] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:35 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:36.429078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-22792d5a-5c9b-4d86-a9d8-bd4f6c7cbfa0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:36.429819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-22792d5a-5c9b-4d86-a9d8-bd4f6c7cbfa0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:36.432647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:21:36.438031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22792d5a-5c9b-4d86-a9d8-bd4f6c7cbfa0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:36.438521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22792d5a-5c9b-4d86-a9d8-bd4f6c7cbfa0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:36.438958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22792d5a-5c9b-4d86-a9d8-bd4f6c7cbfa0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:36.439659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22792d5a-5c9b-4d86-a9d8-bd4f6c7cbfa0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:36.440108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22792d5a-5c9b-4d86-a9d8-bd4f6c7cbfa0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:36.440537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22792d5a-5c9b-4d86-a9d8-bd4f6c7cbfa0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:36.572873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-22792d5a-5c9b-4d86-a9d8-bd4f6c7cbfa0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:36.580716 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-22792d5a-5c9b-4d86-a9d8-bd4f6c7cbfa0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1673 microversion: 2.1 time: 0.156496 Oct 11 00:21:36.581291 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3283/7222] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:36 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:37.468601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-8eef4f48-b244-4df2-942b-99e180fc8e4f req-2d68c599-5764-4025-8817-03ce2d32def3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a715295-b7cf-48df-a5e1-c7404ae94e70", "name": "network-vif-deleted", "tag": "6708e863-d19b-403b-b026-0e88a99545f1"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:21:37.475278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=39 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:21:37.481715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8eef4f48-b244-4df2-942b-99e180fc8e4f req-2d68c599-5764-4025-8817-03ce2d32def3 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:37.482211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8eef4f48-b244-4df2-942b-99e180fc8e4f req-2d68c599-5764-4025-8817-03ce2d32def3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:37.482651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8eef4f48-b244-4df2-942b-99e180fc8e4f req-2d68c599-5764-4025-8817-03ce2d32def3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:37.495660 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-8eef4f48-b244-4df2-942b-99e180fc8e4f req-2d68c599-5764-4025-8817-03ce2d32def3 service nova] Creating event network-vif-deleted:6708e863-d19b-403b-b026-0e88a99545f1 for instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 on n-h1-860864-2 Oct 11 00:21:37.500619 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-8eef4f48-b244-4df2-942b-99e180fc8e4f req-2d68c599-5764-4025-8817-03ce2d32def3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035882 Oct 11 00:21:37.501229 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3940/7223] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:21:37.605776 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ec1f93cf-ec9b-414c-9041-86e933caf4e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:37.607034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ec1f93cf-ec9b-414c-9041-86e933caf4e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:37.613817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec1f93cf-ec9b-414c-9041-86e933caf4e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:37.614512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec1f93cf-ec9b-414c-9041-86e933caf4e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:37.615556 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec1f93cf-ec9b-414c-9041-86e933caf4e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:37.617157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec1f93cf-ec9b-414c-9041-86e933caf4e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:37.617798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec1f93cf-ec9b-414c-9041-86e933caf4e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:37.618224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec1f93cf-ec9b-414c-9041-86e933caf4e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:37.657777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec1f93cf-ec9b-414c-9041-86e933caf4e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:37.658172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec1f93cf-ec9b-414c-9041-86e933caf4e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:37.658599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ec1f93cf-ec9b-414c-9041-86e933caf4e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:37.659044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-ec1f93cf-ec9b-414c-9041-86e933caf4e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lazy-loading 'fault' on Instance uuid 7a715295-b7cf-48df-a5e1-c7404ae94e70 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:21:38.046144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ec1f93cf-ec9b-414c-9041-86e933caf4e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:38.054224 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ec1f93cf-ec9b-414c-9041-86e933caf4e9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 200 len: 1327 microversion: 2.1 time: 0.452515 Oct 11 00:21:38.054901 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3284/7224] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:37 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 1327 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:39.080250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cc7268cc-72db-47ad-9169-51afea5d7510 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:39.080976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cc7268cc-72db-47ad-9169-51afea5d7510 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:39.088023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc7268cc-72db-47ad-9169-51afea5d7510 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:39.088521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc7268cc-72db-47ad-9169-51afea5d7510 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:39.088978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc7268cc-72db-47ad-9169-51afea5d7510 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:39.089719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc7268cc-72db-47ad-9169-51afea5d7510 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:39.090194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc7268cc-72db-47ad-9169-51afea5d7510 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:39.090643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc7268cc-72db-47ad-9169-51afea5d7510 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:39.104177 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-cc7268cc-72db-47ad-9169-51afea5d7510 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] HTTP exception thrown: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cc7268cc-72db-47ad-9169-51afea5d7510 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Request method failure captured: Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 HTTP/1.1 Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLZxfLc8Q7Icn9DecaGe5gcChOHeFqpqEXkmJ2LBp2kaQghRPSuL_6yNQKoNJrZLgbTTr8mxh5HHn7k6cnYW1dBqXduwGRSIKp1_hC3HFPdzua2afeL-3QExGQACpymRN5ysngyDUJc_A6H1lS2CdmxbOx6trU-c0z1aLDt5QVmHkl4 Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f7cd77bf414e471ebaef6c378429ce00", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a9570fd898f2441e814db0a76968d902 Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '7a715295-b7cf-48df-a5e1-c7404ae94e70'} Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:21:39.105922 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:21:39.110540 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:21:39.110540 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:21:39.110540 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:21:39.110540 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:21:39.110540 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:21:39.110540 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. Oct 11 00:21:39.110540 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:21:39.110540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cc7268cc-72db-47ad-9169-51afea5d7510 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Returning 404 to user: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:21:39.110540 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cc7268cc-72db-47ad-9169-51afea5d7510 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 404 len: 111 microversion: 2.1 time: 0.032291 Oct 11 00:21:39.110540 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3941/7225] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:39 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:21:39.124991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-51f34cd8-4adc-4ad5-89a5-8f6d4823f451 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:39.125652 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-51f34cd8-4adc-4ad5-89a5-8f6d4823f451 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:39.133304 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51f34cd8-4adc-4ad5-89a5-8f6d4823f451 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:39.133888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51f34cd8-4adc-4ad5-89a5-8f6d4823f451 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:39.134323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51f34cd8-4adc-4ad5-89a5-8f6d4823f451 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:39.135012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51f34cd8-4adc-4ad5-89a5-8f6d4823f451 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:39.135462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51f34cd8-4adc-4ad5-89a5-8f6d4823f451 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:39.135880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-51f34cd8-4adc-4ad5-89a5-8f6d4823f451 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:39.150351 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-51f34cd8-4adc-4ad5-89a5-8f6d4823f451 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] HTTP exception thrown: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-51f34cd8-4adc-4ad5-89a5-8f6d4823f451 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Request method failure captured: Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 HTTP/1.1 Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLZxfLc8Q7Icn9DecaGe5gcChOHeFqpqEXkmJ2LBp2kaQghRPSuL_6yNQKoNJrZLgbTTr8mxh5HHn7k6cnYW1dBqXduwGRSIKp1_hC3HFPdzua2afeL-3QExGQACpymRN5ysngyDUJc_A6H1lS2CdmxbOx6trU-c0z1aLDt5QVmHkl4 Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f7cd77bf414e471ebaef6c378429ce00", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: a9570fd898f2441e814db0a76968d902 Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '7a715295-b7cf-48df-a5e1-c7404ae94e70'} Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:21:39.151981 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:21:39.156551 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:21:39.156551 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:21:39.156551 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:21:39.156551 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:21:39.156551 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:21:39.156551 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. Oct 11 00:21:39.156551 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:21:39.156551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-51f34cd8-4adc-4ad5-89a5-8f6d4823f451 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Returning 404 to user: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:21:39.156551 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-51f34cd8-4adc-4ad5-89a5-8f6d4823f451 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 404 len: 111 microversion: 2.1 time: 0.032308 Oct 11 00:21:39.156551 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3285/7226] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:39 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:21:39.201466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3057bd87-c4fb-4fa7-b72f-282322b5a71c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-371672407", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "a4816c55-6e00-4869-ba90-e42e23995d4c"}], "security_groups": [{"name": "tempest-securitygroup--965510550"}], "key_name": "tempest-keypair-921070498", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:21:39.308392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-3057bd87-c4fb-4fa7-b72f-282322b5a71c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] validate_networks() for [('a4816c55-6e00-4869-ba90-e42e23995d4c', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:21:39.690181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-3057bd87-c4fb-4fa7-b72f-282322b5a71c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:21:39.690635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-3057bd87-c4fb-4fa7-b72f-282322b5a71c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:21:39.691134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-3057bd87-c4fb-4fa7-b72f-282322b5a71c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:21:39.691567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-3057bd87-c4fb-4fa7-b72f-282322b5a71c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:21:39.692032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-3057bd87-c4fb-4fa7-b72f-282322b5a71c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:21:39.701327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3057bd87-c4fb-4fa7-b72f-282322b5a71c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:39.701865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3057bd87-c4fb-4fa7-b72f-282322b5a71c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:39.702356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3057bd87-c4fb-4fa7-b72f-282322b5a71c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:39.703108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3057bd87-c4fb-4fa7-b72f-282322b5a71c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:39.703584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3057bd87-c4fb-4fa7-b72f-282322b5a71c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:39.704031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3057bd87-c4fb-4fa7-b72f-282322b5a71c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:39.721545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-3057bd87-c4fb-4fa7-b72f-282322b5a71c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Getting quotas for project f7cd77bf414e471ebaef6c378429ce00. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:21:39.728345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-3057bd87-c4fb-4fa7-b72f-282322b5a71c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Getting quotas for user a9570fd898f2441e814db0a76968d902 and project f7cd77bf414e471ebaef6c378429ce00. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:21:39.741701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3057bd87-c4fb-4fa7-b72f-282322b5a71c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:21:39.744036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3057bd87-c4fb-4fa7-b72f-282322b5a71c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:21:39.790359 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3057bd87-c4fb-4fa7-b72f-282322b5a71c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.592756 Oct 11 00:21:39.791218 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3942/7227] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:21:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:21:39.803323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ac25113b-a564-4b86-a3b1-1781d8e5cd0e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:39.804125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ac25113b-a564-4b86-a3b1-1781d8e5cd0e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:39.859583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ac25113b-a564-4b86-a3b1-1781d8e5cd0e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:39.877250 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ac25113b-a564-4b86-a3b1-1781d8e5cd0e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1237 microversion: 2.1 time: 0.078512 Oct 11 00:21:39.878689 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3286/7228] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:39 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1237 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:40.902539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-788dc94a-4977-44d5-bb20-870c3d9a616d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:40.903976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-788dc94a-4977-44d5-bb20-870c3d9a616d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:40.913081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-788dc94a-4977-44d5-bb20-870c3d9a616d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:40.913924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-788dc94a-4977-44d5-bb20-870c3d9a616d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:40.914667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-788dc94a-4977-44d5-bb20-870c3d9a616d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:40.915522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-788dc94a-4977-44d5-bb20-870c3d9a616d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:40.916081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-788dc94a-4977-44d5-bb20-870c3d9a616d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:40.916624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-788dc94a-4977-44d5-bb20-870c3d9a616d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:40.989948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-788dc94a-4977-44d5-bb20-870c3d9a616d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:40.998383 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-788dc94a-4977-44d5-bb20-870c3d9a616d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1307 microversion: 2.1 time: 0.100731 Oct 11 00:21:40.999553 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3943/7229] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:40 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:42.023659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f7949c29-1b86-443f-9b29-c847968f714d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:42.024583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f7949c29-1b86-443f-9b29-c847968f714d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:42.032384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7949c29-1b86-443f-9b29-c847968f714d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:42.032874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7949c29-1b86-443f-9b29-c847968f714d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:42.033310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7949c29-1b86-443f-9b29-c847968f714d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:42.034036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7949c29-1b86-443f-9b29-c847968f714d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:42.034525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7949c29-1b86-443f-9b29-c847968f714d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:42.034955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f7949c29-1b86-443f-9b29-c847968f714d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:42.170888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f7949c29-1b86-443f-9b29-c847968f714d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:42.179657 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f7949c29-1b86-443f-9b29-c847968f714d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1362 microversion: 2.1 time: 0.160641 Oct 11 00:21:42.180243 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3287/7230] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:42 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:42.343185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-8a8f428b-e310-4f1e-a68b-db8f609248a7 req-a715a28f-9cfd-49c0-a843-cb42f417b9fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef186d9-0b84-4c5a-ab3e-00ce60822cde", "tag": "d90626e9-36c2-4477-aedd-498bfd037505"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:21:42.354641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8a8f428b-e310-4f1e-a68b-db8f609248a7 req-a715a28f-9cfd-49c0-a843-cb42f417b9fe service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:42.355143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8a8f428b-e310-4f1e-a68b-db8f609248a7 req-a715a28f-9cfd-49c0-a843-cb42f417b9fe service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:42.355588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8a8f428b-e310-4f1e-a68b-db8f609248a7 req-a715a28f-9cfd-49c0-a843-cb42f417b9fe service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:42.368307 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-8a8f428b-e310-4f1e-a68b-db8f609248a7 req-a715a28f-9cfd-49c0-a843-cb42f417b9fe service nova] Creating event network-changed:d90626e9-36c2-4477-aedd-498bfd037505 for instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde on n-h2-860864-2 Oct 11 00:21:42.373224 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-8a8f428b-e310-4f1e-a68b-db8f609248a7 req-a715a28f-9cfd-49c0-a843-cb42f417b9fe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097047 Oct 11 00:21:42.373865 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3944/7231] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:21:43.204786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cf03cb81-804c-437c-8eab-18fa1f72b4ab tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:43.205611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cf03cb81-804c-437c-8eab-18fa1f72b4ab tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:43.213864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf03cb81-804c-437c-8eab-18fa1f72b4ab tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:43.214353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf03cb81-804c-437c-8eab-18fa1f72b4ab tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:43.214793 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf03cb81-804c-437c-8eab-18fa1f72b4ab tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:43.215492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf03cb81-804c-437c-8eab-18fa1f72b4ab tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:43.215942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf03cb81-804c-437c-8eab-18fa1f72b4ab tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:43.216363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf03cb81-804c-437c-8eab-18fa1f72b4ab tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:43.356687 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cf03cb81-804c-437c-8eab-18fa1f72b4ab tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:43.364560 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cf03cb81-804c-437c-8eab-18fa1f72b4ab tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1362 microversion: 2.1 time: 0.163599 Oct 11 00:21:43.365673 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3288/7232] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:43 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:44.391968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d84e830e-652c-4fa3-b1f7-2d6d79807db0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:44.392693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d84e830e-652c-4fa3-b1f7-2d6d79807db0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:44.400721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d84e830e-652c-4fa3-b1f7-2d6d79807db0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:44.401229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d84e830e-652c-4fa3-b1f7-2d6d79807db0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:44.401714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d84e830e-652c-4fa3-b1f7-2d6d79807db0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:44.402439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d84e830e-652c-4fa3-b1f7-2d6d79807db0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:44.402908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d84e830e-652c-4fa3-b1f7-2d6d79807db0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:44.403352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d84e830e-652c-4fa3-b1f7-2d6d79807db0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:44.551187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d84e830e-652c-4fa3-b1f7-2d6d79807db0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:44.564265 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d84e830e-652c-4fa3-b1f7-2d6d79807db0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1362 microversion: 2.1 time: 0.177174 Oct 11 00:21:44.565150 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3945/7233] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:44 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:45.589442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a7df003e-3725-466d-a0ba-6d46c627f1f3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:45.590006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a7df003e-3725-466d-a0ba-6d46c627f1f3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:45.596926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7df003e-3725-466d-a0ba-6d46c627f1f3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:45.597445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7df003e-3725-466d-a0ba-6d46c627f1f3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:45.597882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7df003e-3725-466d-a0ba-6d46c627f1f3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:45.598647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7df003e-3725-466d-a0ba-6d46c627f1f3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:45.599096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7df003e-3725-466d-a0ba-6d46c627f1f3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:45.600057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7df003e-3725-466d-a0ba-6d46c627f1f3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:45.753912 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a7df003e-3725-466d-a0ba-6d46c627f1f3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:45.762042 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a7df003e-3725-466d-a0ba-6d46c627f1f3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1362 microversion: 2.1 time: 0.176641 Oct 11 00:21:45.762652 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3289/7234] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:45 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:46.786425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c108eb2b-d147-46e8-a63c-53a4d5fb2d62 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:46.787697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c108eb2b-d147-46e8-a63c-53a4d5fb2d62 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:46.794866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c108eb2b-d147-46e8-a63c-53a4d5fb2d62 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:46.795374 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c108eb2b-d147-46e8-a63c-53a4d5fb2d62 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:46.795829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c108eb2b-d147-46e8-a63c-53a4d5fb2d62 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:46.796537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c108eb2b-d147-46e8-a63c-53a4d5fb2d62 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:46.797009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c108eb2b-d147-46e8-a63c-53a4d5fb2d62 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:46.797485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c108eb2b-d147-46e8-a63c-53a4d5fb2d62 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:46.936379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c108eb2b-d147-46e8-a63c-53a4d5fb2d62 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:46.944727 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c108eb2b-d147-46e8-a63c-53a4d5fb2d62 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1362 microversion: 2.1 time: 0.162293 Oct 11 00:21:46.945320 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3946/7235] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:46 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:47.788731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-babe9149-39cd-49ac-a0f8-d16e103a6117 req-3aa4dd08-111d-428b-9d4a-e1ddee9c764c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef186d9-0b84-4c5a-ab3e-00ce60822cde", "name": "network-vif-plugged", "status": "completed", "tag": "d90626e9-36c2-4477-aedd-498bfd037505"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:21:47.804661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-babe9149-39cd-49ac-a0f8-d16e103a6117 req-3aa4dd08-111d-428b-9d4a-e1ddee9c764c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:47.805054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-babe9149-39cd-49ac-a0f8-d16e103a6117 req-3aa4dd08-111d-428b-9d4a-e1ddee9c764c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:47.805526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-babe9149-39cd-49ac-a0f8-d16e103a6117 req-3aa4dd08-111d-428b-9d4a-e1ddee9c764c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:47.819004 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-babe9149-39cd-49ac-a0f8-d16e103a6117 req-3aa4dd08-111d-428b-9d4a-e1ddee9c764c service nova] Creating event network-vif-plugged:d90626e9-36c2-4477-aedd-498bfd037505 for instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde on n-h2-860864-2 Oct 11 00:21:47.824663 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-babe9149-39cd-49ac-a0f8-d16e103a6117 req-3aa4dd08-111d-428b-9d4a-e1ddee9c764c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040528 Oct 11 00:21:47.825493 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3290/7236] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:21:47.968243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-65c8733b-bf00-4803-a5ee-c76ce92168f5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:47.968868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-65c8733b-bf00-4803-a5ee-c76ce92168f5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:47.976970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65c8733b-bf00-4803-a5ee-c76ce92168f5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:47.977504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65c8733b-bf00-4803-a5ee-c76ce92168f5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:47.977956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65c8733b-bf00-4803-a5ee-c76ce92168f5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:47.978668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65c8733b-bf00-4803-a5ee-c76ce92168f5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:47.979134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65c8733b-bf00-4803-a5ee-c76ce92168f5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:47.979570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-65c8733b-bf00-4803-a5ee-c76ce92168f5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:48.112913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-65c8733b-bf00-4803-a5ee-c76ce92168f5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:48.121738 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-65c8733b-bf00-4803-a5ee-c76ce92168f5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1362 microversion: 2.1 time: 0.157347 Oct 11 00:21:48.122545 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3947/7237] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:47 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:49.145517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-228a82c4-b740-43cd-9197-41fa797cb13e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:49.146222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-228a82c4-b740-43cd-9197-41fa797cb13e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:49.152407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-228a82c4-b740-43cd-9197-41fa797cb13e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:49.152889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-228a82c4-b740-43cd-9197-41fa797cb13e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:49.153928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-228a82c4-b740-43cd-9197-41fa797cb13e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:49.154619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-228a82c4-b740-43cd-9197-41fa797cb13e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:49.155074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-228a82c4-b740-43cd-9197-41fa797cb13e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:49.155502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-228a82c4-b740-43cd-9197-41fa797cb13e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:49.287695 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-228a82c4-b740-43cd-9197-41fa797cb13e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:49.295431 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-228a82c4-b740-43cd-9197-41fa797cb13e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1362 microversion: 2.1 time: 0.155086 Oct 11 00:21:49.296014 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3291/7238] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:49 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:50.320739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4822b5d9-1b9b-4187-abed-d22d1796073b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:50.321403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4822b5d9-1b9b-4187-abed-d22d1796073b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:50.323879 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:21:50.324031 n-d-860864-2 devstack@n-api.service[120613]: Tue Oct 11 00:21:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde (ip 10.222.0.23) !!! Oct 11 00:21:50.325857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:21:50.326546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:21:50.334413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4822b5d9-1b9b-4187-abed-d22d1796073b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:50.335715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4822b5d9-1b9b-4187-abed-d22d1796073b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:50.336155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4822b5d9-1b9b-4187-abed-d22d1796073b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:50.336875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4822b5d9-1b9b-4187-abed-d22d1796073b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:50.337347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4822b5d9-1b9b-4187-abed-d22d1796073b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:50.337818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4822b5d9-1b9b-4187-abed-d22d1796073b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:50.472959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4822b5d9-1b9b-4187-abed-d22d1796073b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:21:50.481765 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4822b5d9-1b9b-4187-abed-d22d1796073b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1548 microversion: 2.1 time: 0.165472 Oct 11 00:21:50.482350 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3948/7239] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:21:50 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:21:50.507824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c712f2d3-477a-49ce-aa8f-684388cc277e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:21:50.508626 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c712f2d3-477a-49ce-aa8f-684388cc277e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:21:50.510368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:21:50.517640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c712f2d3-477a-49ce-aa8f-684388cc277e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:50.518140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c712f2d3-477a-49ce-aa8f-684388cc277e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:50.518616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c712f2d3-477a-49ce-aa8f-684388cc277e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:50.519327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c712f2d3-477a-49ce-aa8f-684388cc277e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:50.519785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c712f2d3-477a-49ce-aa8f-684388cc277e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:50.520215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c712f2d3-477a-49ce-aa8f-684388cc277e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:50.601008 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c712f2d3-477a-49ce-aa8f-684388cc277e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097642 Oct 11 00:21:50.601795 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3292/7240] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 11 00:21:50 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:21:51.559936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-848a364c-19db-47ed-b2e5-803fb250497c req-8dc5b618-3847-45cf-8242-037bfb6c740b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef186d9-0b84-4c5a-ab3e-00ce60822cde", "tag": "d90626e9-36c2-4477-aedd-498bfd037505"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:21:51.570867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-848a364c-19db-47ed-b2e5-803fb250497c req-8dc5b618-3847-45cf-8242-037bfb6c740b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:21:51.571606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-848a364c-19db-47ed-b2e5-803fb250497c req-8dc5b618-3847-45cf-8242-037bfb6c740b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:21:51.571967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-848a364c-19db-47ed-b2e5-803fb250497c req-8dc5b618-3847-45cf-8242-037bfb6c740b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:21:51.583999 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-848a364c-19db-47ed-b2e5-803fb250497c req-8dc5b618-3847-45cf-8242-037bfb6c740b service nova] Creating event network-changed:d90626e9-36c2-4477-aedd-498bfd037505 for instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde on n-h2-860864-2 Oct 11 00:21:51.589975 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-848a364c-19db-47ed-b2e5-803fb250497c req-8dc5b618-3847-45cf-8242-037bfb6c740b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033732 Oct 11 00:21:51.590781 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3949/7241] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:22:24.761914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=23 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:22:24.762715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:22:24.767367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c3712bd7-3aab-4e11-90c1-ba111c8157fc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:22:24.769591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c3712bd7-3aab-4e11-90c1-ba111c8157fc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:24.776771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3712bd7-3aab-4e11-90c1-ba111c8157fc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:24.777292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3712bd7-3aab-4e11-90c1-ba111c8157fc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:24.777760 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3712bd7-3aab-4e11-90c1-ba111c8157fc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:24.778458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3712bd7-3aab-4e11-90c1-ba111c8157fc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:24.778913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3712bd7-3aab-4e11-90c1-ba111c8157fc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:24.779339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3712bd7-3aab-4e11-90c1-ba111c8157fc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:24.809437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c3712bd7-3aab-4e11-90c1-ba111c8157fc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:24.815541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c3712bd7-3aab-4e11-90c1-ba111c8157fc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Old instance type m1.heat2, new instance type m1.heat {{(pid=120614) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 00:22:24.823569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c3712bd7-3aab-4e11-90c1-ba111c8157fc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:22:24.823997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c3712bd7-3aab-4e11-90c1-ba111c8157fc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:22:24.824478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c3712bd7-3aab-4e11-90c1-ba111c8157fc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:22:24.824886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c3712bd7-3aab-4e11-90c1-ba111c8157fc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:22:24.825308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-c3712bd7-3aab-4e11-90c1-ba111c8157fc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:22:24.892626 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c3712bd7-3aab-4e11-90c1-ba111c8157fc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "POST /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde/action" status: 202 len: 0 microversion: 2.1 time: 0.132483 Oct 11 00:22:24.893602 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3293/7242] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:22:24 2022] POST /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:22:24.901165 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:22:24.903000 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:22:24.910139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5dcd0667-2b80-4bd9-a63a-7ed051fec366 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:24.910345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5dcd0667-2b80-4bd9-a63a-7ed051fec366 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:24.920139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5dcd0667-2b80-4bd9-a63a-7ed051fec366 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:24.920650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5dcd0667-2b80-4bd9-a63a-7ed051fec366 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:24.921144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5dcd0667-2b80-4bd9-a63a-7ed051fec366 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:24.922040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5dcd0667-2b80-4bd9-a63a-7ed051fec366 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:24.922587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5dcd0667-2b80-4bd9-a63a-7ed051fec366 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:24.923030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5dcd0667-2b80-4bd9-a63a-7ed051fec366 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:25.064151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5dcd0667-2b80-4bd9-a63a-7ed051fec366 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:25.073044 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5dcd0667-2b80-4bd9-a63a-7ed051fec366 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1675 microversion: 2.1 time: 0.175348 Oct 11 00:22:25.073841 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3950/7243] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:24 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1675 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:26.097199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-442c7f7a-621a-4ddc-af57-434f69212978 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:26.097827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-442c7f7a-621a-4ddc-af57-434f69212978 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:26.105098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-442c7f7a-621a-4ddc-af57-434f69212978 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:26.105625 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-442c7f7a-621a-4ddc-af57-434f69212978 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:26.106065 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-442c7f7a-621a-4ddc-af57-434f69212978 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:26.106765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-442c7f7a-621a-4ddc-af57-434f69212978 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:26.107222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-442c7f7a-621a-4ddc-af57-434f69212978 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:26.107649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-442c7f7a-621a-4ddc-af57-434f69212978 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:26.247077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-442c7f7a-621a-4ddc-af57-434f69212978 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:26.255278 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-442c7f7a-621a-4ddc-af57-434f69212978 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1675 microversion: 2.1 time: 0.163036 Oct 11 00:22:26.255872 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3294/7244] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:26 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:27.280663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-de5abf40-963f-41bc-8164-c304e9b22abb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:27.281388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-de5abf40-963f-41bc-8164-c304e9b22abb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:27.288209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de5abf40-963f-41bc-8164-c304e9b22abb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:27.288729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de5abf40-963f-41bc-8164-c304e9b22abb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:27.289682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de5abf40-963f-41bc-8164-c304e9b22abb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:27.290389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de5abf40-963f-41bc-8164-c304e9b22abb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:27.290859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de5abf40-963f-41bc-8164-c304e9b22abb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:27.291336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de5abf40-963f-41bc-8164-c304e9b22abb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:27.434418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-de5abf40-963f-41bc-8164-c304e9b22abb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:27.443877 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-de5abf40-963f-41bc-8164-c304e9b22abb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1675 microversion: 2.1 time: 0.167221 Oct 11 00:22:27.444473 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3951/7245] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:27 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:28.470647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8956b5f4-8be0-4e91-8c6a-61200de30d13 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:28.471261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8956b5f4-8be0-4e91-8c6a-61200de30d13 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:28.479241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8956b5f4-8be0-4e91-8c6a-61200de30d13 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:28.479727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8956b5f4-8be0-4e91-8c6a-61200de30d13 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:28.480164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8956b5f4-8be0-4e91-8c6a-61200de30d13 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:28.480853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8956b5f4-8be0-4e91-8c6a-61200de30d13 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:28.481302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8956b5f4-8be0-4e91-8c6a-61200de30d13 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:28.481748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8956b5f4-8be0-4e91-8c6a-61200de30d13 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:28.617908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8956b5f4-8be0-4e91-8c6a-61200de30d13 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:28.625566 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8956b5f4-8be0-4e91-8c6a-61200de30d13 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1680 microversion: 2.1 time: 0.158900 Oct 11 00:22:28.626156 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3295/7246] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:28 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:22:29.648272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a0d33143-edb2-499f-b12f-8987f7d6ca15 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:29.649666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a0d33143-edb2-499f-b12f-8987f7d6ca15 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:29.656434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0d33143-edb2-499f-b12f-8987f7d6ca15 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:29.656943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0d33143-edb2-499f-b12f-8987f7d6ca15 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:29.657428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0d33143-edb2-499f-b12f-8987f7d6ca15 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:29.658149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0d33143-edb2-499f-b12f-8987f7d6ca15 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:29.658626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0d33143-edb2-499f-b12f-8987f7d6ca15 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:29.659077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a0d33143-edb2-499f-b12f-8987f7d6ca15 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:29.799974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a0d33143-edb2-499f-b12f-8987f7d6ca15 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:29.808580 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a0d33143-edb2-499f-b12f-8987f7d6ca15 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1680 microversion: 2.1 time: 0.164288 Oct 11 00:22:29.809155 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3952/7247] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:29 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:30.832054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-776f372a-ed62-4231-8a00-b7ba97676a70 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:30.832660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-776f372a-ed62-4231-8a00-b7ba97676a70 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:30.840045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-776f372a-ed62-4231-8a00-b7ba97676a70 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:30.840522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-776f372a-ed62-4231-8a00-b7ba97676a70 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:30.840951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-776f372a-ed62-4231-8a00-b7ba97676a70 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:30.841657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-776f372a-ed62-4231-8a00-b7ba97676a70 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:30.842106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-776f372a-ed62-4231-8a00-b7ba97676a70 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:30.842526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-776f372a-ed62-4231-8a00-b7ba97676a70 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:30.971859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-776f372a-ed62-4231-8a00-b7ba97676a70 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:30.980238 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-776f372a-ed62-4231-8a00-b7ba97676a70 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1680 microversion: 2.1 time: 0.152085 Oct 11 00:22:30.980810 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3296/7248] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:30 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:32.003710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4cc3a186-0b73-47bf-b2f5-d0f9872a9d89 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:32.004368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4cc3a186-0b73-47bf-b2f5-d0f9872a9d89 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:32.011825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cc3a186-0b73-47bf-b2f5-d0f9872a9d89 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:32.012327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cc3a186-0b73-47bf-b2f5-d0f9872a9d89 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:32.012776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cc3a186-0b73-47bf-b2f5-d0f9872a9d89 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:32.013516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cc3a186-0b73-47bf-b2f5-d0f9872a9d89 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:32.013987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cc3a186-0b73-47bf-b2f5-d0f9872a9d89 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:32.014426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4cc3a186-0b73-47bf-b2f5-d0f9872a9d89 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:32.150275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4cc3a186-0b73-47bf-b2f5-d0f9872a9d89 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:32.158068 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4cc3a186-0b73-47bf-b2f5-d0f9872a9d89 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1680 microversion: 2.1 time: 0.158289 Oct 11 00:22:32.158661 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3953/7249] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:31 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:33.182239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e64d35bd-ff41-4d0f-801a-6297094c1510 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:33.182891 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e64d35bd-ff41-4d0f-801a-6297094c1510 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:33.189828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e64d35bd-ff41-4d0f-801a-6297094c1510 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:33.190398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e64d35bd-ff41-4d0f-801a-6297094c1510 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:33.190835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e64d35bd-ff41-4d0f-801a-6297094c1510 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:33.191530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e64d35bd-ff41-4d0f-801a-6297094c1510 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:33.191980 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e64d35bd-ff41-4d0f-801a-6297094c1510 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:33.192399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e64d35bd-ff41-4d0f-801a-6297094c1510 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:33.326421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e64d35bd-ff41-4d0f-801a-6297094c1510 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:33.334214 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e64d35bd-ff41-4d0f-801a-6297094c1510 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1680 microversion: 2.1 time: 0.156782 Oct 11 00:22:33.334792 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3297/7250] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:33 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:34.358053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d1632581-bb8b-442e-ad3d-9eb0bef2042b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:34.358684 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d1632581-bb8b-442e-ad3d-9eb0bef2042b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:34.365692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1632581-bb8b-442e-ad3d-9eb0bef2042b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:34.366196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1632581-bb8b-442e-ad3d-9eb0bef2042b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:34.366648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1632581-bb8b-442e-ad3d-9eb0bef2042b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:34.368493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1632581-bb8b-442e-ad3d-9eb0bef2042b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:34.368493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1632581-bb8b-442e-ad3d-9eb0bef2042b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:34.368797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d1632581-bb8b-442e-ad3d-9eb0bef2042b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:34.501736 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d1632581-bb8b-442e-ad3d-9eb0bef2042b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:34.510206 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d1632581-bb8b-442e-ad3d-9eb0bef2042b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1680 microversion: 2.1 time: 0.156179 Oct 11 00:22:34.510789 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3954/7251] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:34 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:35.533441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3ed98363-75c1-40cf-b254-522c1b46ec6c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:35.534056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3ed98363-75c1-40cf-b254-522c1b46ec6c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:35.541198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ed98363-75c1-40cf-b254-522c1b46ec6c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:35.541714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ed98363-75c1-40cf-b254-522c1b46ec6c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:35.542154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ed98363-75c1-40cf-b254-522c1b46ec6c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:35.542836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ed98363-75c1-40cf-b254-522c1b46ec6c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:35.543294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ed98363-75c1-40cf-b254-522c1b46ec6c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:35.543714 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3ed98363-75c1-40cf-b254-522c1b46ec6c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:35.673819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3ed98363-75c1-40cf-b254-522c1b46ec6c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:35.682391 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3ed98363-75c1-40cf-b254-522c1b46ec6c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1680 microversion: 2.1 time: 0.152828 Oct 11 00:22:35.682967 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3298/7252] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:35 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:36.706410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0cf95596-1db1-4766-aa65-f2df9b04f175 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:36.707046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0cf95596-1db1-4766-aa65-f2df9b04f175 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:36.714404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0cf95596-1db1-4766-aa65-f2df9b04f175 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:36.714909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0cf95596-1db1-4766-aa65-f2df9b04f175 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:36.715363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0cf95596-1db1-4766-aa65-f2df9b04f175 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:36.716079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0cf95596-1db1-4766-aa65-f2df9b04f175 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:36.716549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0cf95596-1db1-4766-aa65-f2df9b04f175 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:36.717021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0cf95596-1db1-4766-aa65-f2df9b04f175 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:36.848928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0cf95596-1db1-4766-aa65-f2df9b04f175 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:36.857346 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0cf95596-1db1-4766-aa65-f2df9b04f175 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1680 microversion: 2.1 time: 0.154839 Oct 11 00:22:36.857962 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3955/7253] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:36 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:37.881900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-751432cd-5a70-4336-8926-f1efb4c10ee2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:37.882509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-751432cd-5a70-4336-8926-f1efb4c10ee2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:37.890232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-751432cd-5a70-4336-8926-f1efb4c10ee2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:37.890713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-751432cd-5a70-4336-8926-f1efb4c10ee2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:37.891147 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-751432cd-5a70-4336-8926-f1efb4c10ee2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:37.891825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-751432cd-5a70-4336-8926-f1efb4c10ee2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:37.892291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-751432cd-5a70-4336-8926-f1efb4c10ee2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:37.892767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-751432cd-5a70-4336-8926-f1efb4c10ee2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:38.029607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-751432cd-5a70-4336-8926-f1efb4c10ee2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:38.037346 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-751432cd-5a70-4336-8926-f1efb4c10ee2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1680 microversion: 2.1 time: 0.159305 Oct 11 00:22:38.037951 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3299/7254] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:37 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:39.061013 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-525f8e7f-f603-413c-b8a7-a60b96db933c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:39.061596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-525f8e7f-f603-413c-b8a7-a60b96db933c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:39.068174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-525f8e7f-f603-413c-b8a7-a60b96db933c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:39.068665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-525f8e7f-f603-413c-b8a7-a60b96db933c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:39.069111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-525f8e7f-f603-413c-b8a7-a60b96db933c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:39.069836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-525f8e7f-f603-413c-b8a7-a60b96db933c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:39.070313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-525f8e7f-f603-413c-b8a7-a60b96db933c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:39.070742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-525f8e7f-f603-413c-b8a7-a60b96db933c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:39.202801 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-525f8e7f-f603-413c-b8a7-a60b96db933c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:39.210695 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-525f8e7f-f603-413c-b8a7-a60b96db933c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1680 microversion: 2.1 time: 0.153862 Oct 11 00:22:39.212750 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3956/7255] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:39 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:40.170230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-f6312286-6d08-4b52-9340-3c48b78aea85 req-fee28700-5456-4a01-9d1c-b4c356a6473d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef186d9-0b84-4c5a-ab3e-00ce60822cde", "name": "network-vif-unplugged", "status": "completed", "tag": "d90626e9-36c2-4477-aedd-498bfd037505"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:22:40.181330 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f6312286-6d08-4b52-9340-3c48b78aea85 req-fee28700-5456-4a01-9d1c-b4c356a6473d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:40.181838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f6312286-6d08-4b52-9340-3c48b78aea85 req-fee28700-5456-4a01-9d1c-b4c356a6473d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:40.182277 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f6312286-6d08-4b52-9340-3c48b78aea85 req-fee28700-5456-4a01-9d1c-b4c356a6473d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:40.194104 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-f6312286-6d08-4b52-9340-3c48b78aea85 req-fee28700-5456-4a01-9d1c-b4c356a6473d service nova] Creating event network-vif-unplugged:d90626e9-36c2-4477-aedd-498bfd037505 for instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde on n-h1-860864-2 Oct 11 00:22:40.200025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [req-f6312286-6d08-4b52-9340-3c48b78aea85 req-fee28700-5456-4a01-9d1c-b4c356a6473d service nova] Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 00:22:40.211135 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-f6312286-6d08-4b52-9340-3c48b78aea85 req-fee28700-5456-4a01-9d1c-b4c356a6473d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044698 Oct 11 00:22:40.212180 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3300/7256] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:22:40.236330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6df94c0c-c4bc-4187-951f-05097afa4912 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:40.236967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6df94c0c-c4bc-4187-951f-05097afa4912 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:40.244987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6df94c0c-c4bc-4187-951f-05097afa4912 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:40.245520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6df94c0c-c4bc-4187-951f-05097afa4912 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:40.246014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6df94c0c-c4bc-4187-951f-05097afa4912 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:40.246745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6df94c0c-c4bc-4187-951f-05097afa4912 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:40.247216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6df94c0c-c4bc-4187-951f-05097afa4912 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:40.247662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6df94c0c-c4bc-4187-951f-05097afa4912 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:40.484741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6df94c0c-c4bc-4187-951f-05097afa4912 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:40.493340 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6df94c0c-c4bc-4187-951f-05097afa4912 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1679 microversion: 2.1 time: 0.260878 Oct 11 00:22:40.493963 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3957/7257] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:40 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1679 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:41.518131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cc0f1a75-875e-4715-a869-b8a5ce0898b1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:41.518753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cc0f1a75-875e-4715-a869-b8a5ce0898b1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:41.525240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc0f1a75-875e-4715-a869-b8a5ce0898b1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:41.525751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc0f1a75-875e-4715-a869-b8a5ce0898b1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:41.526186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc0f1a75-875e-4715-a869-b8a5ce0898b1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:41.526871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc0f1a75-875e-4715-a869-b8a5ce0898b1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:41.527320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc0f1a75-875e-4715-a869-b8a5ce0898b1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:41.527741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc0f1a75-875e-4715-a869-b8a5ce0898b1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:41.659001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cc0f1a75-875e-4715-a869-b8a5ce0898b1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:41.667457 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cc0f1a75-875e-4715-a869-b8a5ce0898b1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1677 microversion: 2.1 time: 0.154546 Oct 11 00:22:41.668039 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3301/7258] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:41 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:42.252292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-e79b3c85-543a-41f8-a812-a28597f13172 req-02899ede-147e-4878-8e3d-4d9219bca661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef186d9-0b84-4c5a-ab3e-00ce60822cde", "tag": "d90626e9-36c2-4477-aedd-498bfd037505"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:22:42.263640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e79b3c85-543a-41f8-a812-a28597f13172 req-02899ede-147e-4878-8e3d-4d9219bca661 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:42.264141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e79b3c85-543a-41f8-a812-a28597f13172 req-02899ede-147e-4878-8e3d-4d9219bca661 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:42.264593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e79b3c85-543a-41f8-a812-a28597f13172 req-02899ede-147e-4878-8e3d-4d9219bca661 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:42.278631 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-e79b3c85-543a-41f8-a812-a28597f13172 req-02899ede-147e-4878-8e3d-4d9219bca661 service nova] Creating event network-changed:d90626e9-36c2-4477-aedd-498bfd037505 for instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde on n-h1-860864-2 Oct 11 00:22:42.284878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-e79b3c85-543a-41f8-a812-a28597f13172 req-02899ede-147e-4878-8e3d-4d9219bca661 service nova] Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 00:22:42.296710 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-e79b3c85-543a-41f8-a812-a28597f13172 req-02899ede-147e-4878-8e3d-4d9219bca661 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048181 Oct 11 00:22:42.297341 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3958/7259] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:22:42.692167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-905ed321-cc18-42f6-bb09-90684a8887c9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:42.692768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-905ed321-cc18-42f6-bb09-90684a8887c9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:42.705025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-905ed321-cc18-42f6-bb09-90684a8887c9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:42.705561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-905ed321-cc18-42f6-bb09-90684a8887c9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:42.706005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-905ed321-cc18-42f6-bb09-90684a8887c9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:42.706711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-905ed321-cc18-42f6-bb09-90684a8887c9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:42.708905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-905ed321-cc18-42f6-bb09-90684a8887c9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:42.709367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-905ed321-cc18-42f6-bb09-90684a8887c9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:42.856957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-905ed321-cc18-42f6-bb09-90684a8887c9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:42.864922 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-905ed321-cc18-42f6-bb09-90684a8887c9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1677 microversion: 2.1 time: 0.176616 Oct 11 00:22:42.865545 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3302/7260] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:42 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:22:43.889634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2997a196-a382-4574-ba6b-57c5a3cdf6e1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:43.890506 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2997a196-a382-4574-ba6b-57c5a3cdf6e1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:43.897365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2997a196-a382-4574-ba6b-57c5a3cdf6e1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:43.897887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2997a196-a382-4574-ba6b-57c5a3cdf6e1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:43.898340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2997a196-a382-4574-ba6b-57c5a3cdf6e1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:43.900517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2997a196-a382-4574-ba6b-57c5a3cdf6e1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:43.900998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2997a196-a382-4574-ba6b-57c5a3cdf6e1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:43.901465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2997a196-a382-4574-ba6b-57c5a3cdf6e1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:44.119241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2997a196-a382-4574-ba6b-57c5a3cdf6e1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:44.127245 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2997a196-a382-4574-ba6b-57c5a3cdf6e1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1677 microversion: 2.1 time: 0.241967 Oct 11 00:22:44.128191 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3959/7261] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:43 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1677 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:45.153551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f4ddf555-2144-4e9d-a729-2e0129201e15 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:45.154170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f4ddf555-2144-4e9d-a729-2e0129201e15 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:45.160216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4ddf555-2144-4e9d-a729-2e0129201e15 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:45.160701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4ddf555-2144-4e9d-a729-2e0129201e15 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:45.161139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4ddf555-2144-4e9d-a729-2e0129201e15 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:45.161873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4ddf555-2144-4e9d-a729-2e0129201e15 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:45.162328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4ddf555-2144-4e9d-a729-2e0129201e15 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:45.162757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f4ddf555-2144-4e9d-a729-2e0129201e15 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:45.298894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f4ddf555-2144-4e9d-a729-2e0129201e15 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:45.307390 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f4ddf555-2144-4e9d-a729-2e0129201e15 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1674 microversion: 2.1 time: 0.159212 Oct 11 00:22:45.307981 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3303/7262] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:45 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:45.330290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5e7925d4-5bfe-4d05-83cf-d20777915ac7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:22:45.330982 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5e7925d4-5bfe-4d05-83cf-d20777915ac7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:45.338425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e7925d4-5bfe-4d05-83cf-d20777915ac7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:45.338922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e7925d4-5bfe-4d05-83cf-d20777915ac7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:45.339369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e7925d4-5bfe-4d05-83cf-d20777915ac7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:45.340070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e7925d4-5bfe-4d05-83cf-d20777915ac7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:45.340535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e7925d4-5bfe-4d05-83cf-d20777915ac7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:45.340972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e7925d4-5bfe-4d05-83cf-d20777915ac7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:45.378091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e7925d4-5bfe-4d05-83cf-d20777915ac7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:45.378580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e7925d4-5bfe-4d05-83cf-d20777915ac7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:45.379027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e7925d4-5bfe-4d05-83cf-d20777915ac7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:45.379761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e7925d4-5bfe-4d05-83cf-d20777915ac7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:45.380224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e7925d4-5bfe-4d05-83cf-d20777915ac7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:45.380658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5e7925d4-5bfe-4d05-83cf-d20777915ac7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:45.402319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-5e7925d4-5bfe-4d05-83cf-d20777915ac7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Getting quotas for project f7cd77bf414e471ebaef6c378429ce00. Resources: {'cores', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:22:45.407481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-5e7925d4-5bfe-4d05-83cf-d20777915ac7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Getting quotas for user a9570fd898f2441e814db0a76968d902 and project f7cd77bf414e471ebaef6c378429ce00. Resources: {'cores', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:22:45.510855 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5e7925d4-5bfe-4d05-83cf-d20777915ac7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "POST /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde/action" status: 202 len: 0 microversion: 2.1 time: 0.184206 Oct 11 00:22:45.511468 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3960/7263] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:22:45 2022] POST /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:22:45.520242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-53acea5b-6ef6-4247-9e76-c4d5648d7ec0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:45.520857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-53acea5b-6ef6-4247-9e76-c4d5648d7ec0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:45.527915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53acea5b-6ef6-4247-9e76-c4d5648d7ec0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:45.528458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53acea5b-6ef6-4247-9e76-c4d5648d7ec0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:45.528986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53acea5b-6ef6-4247-9e76-c4d5648d7ec0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:45.529780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53acea5b-6ef6-4247-9e76-c4d5648d7ec0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:45.530305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53acea5b-6ef6-4247-9e76-c4d5648d7ec0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:45.530820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53acea5b-6ef6-4247-9e76-c4d5648d7ec0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:45.731325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-53acea5b-6ef6-4247-9e76-c4d5648d7ec0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:45.740528 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-53acea5b-6ef6-4247-9e76-c4d5648d7ec0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1673 microversion: 2.1 time: 0.224733 Oct 11 00:22:45.741126 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3304/7264] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:45 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1673 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:46.123530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-039acd6e-fece-45e6-b8f7-4177cf7c6bbb req-918b976f-64dc-449f-b391-8a57b749e78a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef186d9-0b84-4c5a-ab3e-00ce60822cde", "name": "network-vif-plugged", "status": "completed", "tag": "d90626e9-36c2-4477-aedd-498bfd037505"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:22:46.135909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-039acd6e-fece-45e6-b8f7-4177cf7c6bbb req-918b976f-64dc-449f-b391-8a57b749e78a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:46.136520 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-039acd6e-fece-45e6-b8f7-4177cf7c6bbb req-918b976f-64dc-449f-b391-8a57b749e78a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:46.137067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-039acd6e-fece-45e6-b8f7-4177cf7c6bbb req-918b976f-64dc-449f-b391-8a57b749e78a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:46.152395 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-039acd6e-fece-45e6-b8f7-4177cf7c6bbb req-918b976f-64dc-449f-b391-8a57b749e78a service nova] Creating event network-vif-plugged:d90626e9-36c2-4477-aedd-498bfd037505 for instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde on n-h1-860864-2 Oct 11 00:22:46.158159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-039acd6e-fece-45e6-b8f7-4177cf7c6bbb req-918b976f-64dc-449f-b391-8a57b749e78a service nova] Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 00:22:46.171084 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-039acd6e-fece-45e6-b8f7-4177cf7c6bbb req-918b976f-64dc-449f-b391-8a57b749e78a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053183 Oct 11 00:22:46.172017 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3961/7265] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:22:46.766257 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-312e2957-d19f-4ff2-b8c3-94a5b9a97649 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:46.766868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-312e2957-d19f-4ff2-b8c3-94a5b9a97649 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:46.769910 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:22:46.770047 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:22:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde (ip 10.222.0.23) !!! Oct 11 00:22:46.776678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-312e2957-d19f-4ff2-b8c3-94a5b9a97649 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:46.777164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-312e2957-d19f-4ff2-b8c3-94a5b9a97649 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:46.777618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-312e2957-d19f-4ff2-b8c3-94a5b9a97649 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:46.778316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-312e2957-d19f-4ff2-b8c3-94a5b9a97649 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:46.778764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-312e2957-d19f-4ff2-b8c3-94a5b9a97649 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:46.779213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-312e2957-d19f-4ff2-b8c3-94a5b9a97649 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:46.914730 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-312e2957-d19f-4ff2-b8c3-94a5b9a97649 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:46.922658 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-312e2957-d19f-4ff2-b8c3-94a5b9a97649 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1673 microversion: 2.1 time: 0.160331 Oct 11 00:22:46.923245 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3305/7266] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:46 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:47.948970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e35946d9-3e47-4c82-a794-e0a64e97e13e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:47.949728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e35946d9-3e47-4c82-a794-e0a64e97e13e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:47.955985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e35946d9-3e47-4c82-a794-e0a64e97e13e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:47.956488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e35946d9-3e47-4c82-a794-e0a64e97e13e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:47.956946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e35946d9-3e47-4c82-a794-e0a64e97e13e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:47.957692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e35946d9-3e47-4c82-a794-e0a64e97e13e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:47.958167 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e35946d9-3e47-4c82-a794-e0a64e97e13e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:47.958611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e35946d9-3e47-4c82-a794-e0a64e97e13e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:48.106453 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e35946d9-3e47-4c82-a794-e0a64e97e13e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:48.114455 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e35946d9-3e47-4c82-a794-e0a64e97e13e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1673 microversion: 2.1 time: 0.171388 Oct 11 00:22:48.115040 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3962/7267] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:47 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:48.879167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-129a0fb3-844d-4591-9d7b-fba1d2ba97d7 req-a5b1efdf-b549-4011-93f2-cbee46de8c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef186d9-0b84-4c5a-ab3e-00ce60822cde", "name": "network-vif-unplugged", "status": "completed", "tag": "d90626e9-36c2-4477-aedd-498bfd037505"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:22:48.890240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-129a0fb3-844d-4591-9d7b-fba1d2ba97d7 req-a5b1efdf-b549-4011-93f2-cbee46de8c89 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:48.890793 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-129a0fb3-844d-4591-9d7b-fba1d2ba97d7 req-a5b1efdf-b549-4011-93f2-cbee46de8c89 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:48.891301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-129a0fb3-844d-4591-9d7b-fba1d2ba97d7 req-a5b1efdf-b549-4011-93f2-cbee46de8c89 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:48.904358 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-129a0fb3-844d-4591-9d7b-fba1d2ba97d7 req-a5b1efdf-b549-4011-93f2-cbee46de8c89 service nova] Creating event network-vif-unplugged:d90626e9-36c2-4477-aedd-498bfd037505 for instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde on n-h2-860864-2 Oct 11 00:22:48.909979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [req-129a0fb3-844d-4591-9d7b-fba1d2ba97d7 req-a5b1efdf-b549-4011-93f2-cbee46de8c89 service nova] Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 00:22:48.921991 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-129a0fb3-844d-4591-9d7b-fba1d2ba97d7 req-a5b1efdf-b549-4011-93f2-cbee46de8c89 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046723 Oct 11 00:22:48.922607 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3306/7268] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:22:49.139934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-39de8b7f-a5ea-43c1-bed2-e52c969f2020 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:49.140697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-39de8b7f-a5ea-43c1-bed2-e52c969f2020 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:49.147891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39de8b7f-a5ea-43c1-bed2-e52c969f2020 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:49.149898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39de8b7f-a5ea-43c1-bed2-e52c969f2020 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:49.149898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39de8b7f-a5ea-43c1-bed2-e52c969f2020 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:49.150548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39de8b7f-a5ea-43c1-bed2-e52c969f2020 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:49.151172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39de8b7f-a5ea-43c1-bed2-e52c969f2020 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:49.151457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39de8b7f-a5ea-43c1-bed2-e52c969f2020 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:49.286926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-39de8b7f-a5ea-43c1-bed2-e52c969f2020 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:49.295020 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-39de8b7f-a5ea-43c1-bed2-e52c969f2020 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1673 microversion: 2.1 time: 0.159267 Oct 11 00:22:49.295830 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3963/7269] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:49 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:50.321064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-22d74368-0bcf-47b5-9bff-c7bf9f295559 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:50.321778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-22d74368-0bcf-47b5-9bff-c7bf9f295559 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:50.327890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22d74368-0bcf-47b5-9bff-c7bf9f295559 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:50.328370 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22d74368-0bcf-47b5-9bff-c7bf9f295559 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:50.328810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22d74368-0bcf-47b5-9bff-c7bf9f295559 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:50.329519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22d74368-0bcf-47b5-9bff-c7bf9f295559 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:50.329973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22d74368-0bcf-47b5-9bff-c7bf9f295559 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:50.330846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22d74368-0bcf-47b5-9bff-c7bf9f295559 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:50.463893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-22d74368-0bcf-47b5-9bff-c7bf9f295559 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:50.471802 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-22d74368-0bcf-47b5-9bff-c7bf9f295559 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1673 microversion: 2.1 time: 0.155856 Oct 11 00:22:50.472496 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3307/7270] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:50 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:50.952680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-e7736b69-6b06-466a-a1d5-67ddbdaf2f08 req-0d7447bd-7dba-4379-bb39-10ceb4de03d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef186d9-0b84-4c5a-ab3e-00ce60822cde", "tag": "d90626e9-36c2-4477-aedd-498bfd037505"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:22:50.963147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e7736b69-6b06-466a-a1d5-67ddbdaf2f08 req-0d7447bd-7dba-4379-bb39-10ceb4de03d2 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:50.963636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e7736b69-6b06-466a-a1d5-67ddbdaf2f08 req-0d7447bd-7dba-4379-bb39-10ceb4de03d2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:50.964082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e7736b69-6b06-466a-a1d5-67ddbdaf2f08 req-0d7447bd-7dba-4379-bb39-10ceb4de03d2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:50.967817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:22:50.976173 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-e7736b69-6b06-466a-a1d5-67ddbdaf2f08 req-0d7447bd-7dba-4379-bb39-10ceb4de03d2 service nova] Creating event network-changed:d90626e9-36c2-4477-aedd-498bfd037505 for instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde on n-h2-860864-2 Oct 11 00:22:50.983142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-e7736b69-6b06-466a-a1d5-67ddbdaf2f08 req-0d7447bd-7dba-4379-bb39-10ceb4de03d2 service nova] Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 00:22:50.994848 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-e7736b69-6b06-466a-a1d5-67ddbdaf2f08 req-0d7447bd-7dba-4379-bb39-10ceb4de03d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045808 Oct 11 00:22:50.995452 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3964/7271] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:22:51.499109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d7dadd60-6ed8-41d3-a894-efb76382d50a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:51.504907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d7dadd60-6ed8-41d3-a894-efb76382d50a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:51.517189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7dadd60-6ed8-41d3-a894-efb76382d50a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:51.518052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7dadd60-6ed8-41d3-a894-efb76382d50a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:51.518571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7dadd60-6ed8-41d3-a894-efb76382d50a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:51.519532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7dadd60-6ed8-41d3-a894-efb76382d50a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:51.519801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7dadd60-6ed8-41d3-a894-efb76382d50a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:51.520218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d7dadd60-6ed8-41d3-a894-efb76382d50a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:51.661162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d7dadd60-6ed8-41d3-a894-efb76382d50a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:51.666007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:22:51.673249 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d7dadd60-6ed8-41d3-a894-efb76382d50a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1673 microversion: 2.1 time: 0.181250 Oct 11 00:22:51.673867 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3308/7272] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:51 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:22:52.699824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-402faf6d-b6f8-46b7-b383-ffc8c1ae9fc9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:52.700711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-402faf6d-b6f8-46b7-b383-ffc8c1ae9fc9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:52.707312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-402faf6d-b6f8-46b7-b383-ffc8c1ae9fc9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:52.707820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-402faf6d-b6f8-46b7-b383-ffc8c1ae9fc9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:52.708272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-402faf6d-b6f8-46b7-b383-ffc8c1ae9fc9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:52.708989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-402faf6d-b6f8-46b7-b383-ffc8c1ae9fc9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:52.709496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-402faf6d-b6f8-46b7-b383-ffc8c1ae9fc9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:52.709941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-402faf6d-b6f8-46b7-b383-ffc8c1ae9fc9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:52.848873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-402faf6d-b6f8-46b7-b383-ffc8c1ae9fc9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:52.857461 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-402faf6d-b6f8-46b7-b383-ffc8c1ae9fc9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1666 microversion: 2.1 time: 0.163703 Oct 11 00:22:52.858083 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3965/7273] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:52 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1666 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:52.881197 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c1fc3c0d-2f76-48bf-bff1-755526c74ef4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:52.881841 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c1fc3c0d-2f76-48bf-bff1-755526c74ef4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:52.890877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1fc3c0d-2f76-48bf-bff1-755526c74ef4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:52.891383 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1fc3c0d-2f76-48bf-bff1-755526c74ef4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:52.891821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1fc3c0d-2f76-48bf-bff1-755526c74ef4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:52.892540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1fc3c0d-2f76-48bf-bff1-755526c74ef4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:52.892994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1fc3c0d-2f76-48bf-bff1-755526c74ef4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:52.893448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1fc3c0d-2f76-48bf-bff1-755526c74ef4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:53.032121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c1fc3c0d-2f76-48bf-bff1-755526c74ef4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:53.040368 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c1fc3c0d-2f76-48bf-bff1-755526c74ef4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1666 microversion: 2.1 time: 0.163015 Oct 11 00:22:53.040882 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3309/7274] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:52 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1666 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:53.062957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1f3251ae-9601-4a02-a406-f7379f12b0c6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:53.063593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1f3251ae-9601-4a02-a406-f7379f12b0c6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:53.069564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f3251ae-9601-4a02-a406-f7379f12b0c6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:53.070601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f3251ae-9601-4a02-a406-f7379f12b0c6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:53.071147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f3251ae-9601-4a02-a406-f7379f12b0c6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:53.071751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f3251ae-9601-4a02-a406-f7379f12b0c6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:53.072218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f3251ae-9601-4a02-a406-f7379f12b0c6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:53.072659 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f3251ae-9601-4a02-a406-f7379f12b0c6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:53.204972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1f3251ae-9601-4a02-a406-f7379f12b0c6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:53.213520 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1f3251ae-9601-4a02-a406-f7379f12b0c6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1666 microversion: 2.1 time: 0.154229 Oct 11 00:22:53.214001 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3966/7275] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:53 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1666 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:53.237359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d6306fa4-4be9-400c-8283-7e58e0ba5b61 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:53.237888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d6306fa4-4be9-400c-8283-7e58e0ba5b61 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:53.244583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6306fa4-4be9-400c-8283-7e58e0ba5b61 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:53.245077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6306fa4-4be9-400c-8283-7e58e0ba5b61 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:53.245632 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6306fa4-4be9-400c-8283-7e58e0ba5b61 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:53.246337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6306fa4-4be9-400c-8283-7e58e0ba5b61 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:53.246794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6306fa4-4be9-400c-8283-7e58e0ba5b61 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:53.247228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d6306fa4-4be9-400c-8283-7e58e0ba5b61 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:53.273356 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d6306fa4-4be9-400c-8283-7e58e0ba5b61 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:22:53.348027 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d6306fa4-4be9-400c-8283-7e58e0ba5b61 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 204 len: 0 microversion: 2.1 time: 0.113993 Oct 11 00:22:53.348547 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3310/7276] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:22:53 2022] DELETE /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:22:53.357994 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-23a21ebd-9239-42fc-86df-69b7cbbc882f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:53.358624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-23a21ebd-9239-42fc-86df-69b7cbbc882f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:53.364660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23a21ebd-9239-42fc-86df-69b7cbbc882f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:53.365168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23a21ebd-9239-42fc-86df-69b7cbbc882f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:53.365651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23a21ebd-9239-42fc-86df-69b7cbbc882f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:53.366358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23a21ebd-9239-42fc-86df-69b7cbbc882f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:53.367413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23a21ebd-9239-42fc-86df-69b7cbbc882f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:53.368028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-23a21ebd-9239-42fc-86df-69b7cbbc882f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:53.500981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-23a21ebd-9239-42fc-86df-69b7cbbc882f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:53.508981 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-23a21ebd-9239-42fc-86df-69b7cbbc882f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1672 microversion: 2.1 time: 0.154934 Oct 11 00:22:53.509598 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3967/7277] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:53 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:22:54.007946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-9cab7310-676c-43fb-9fb6-07046a6df4a2 req-0e37d75e-d73b-4f3f-ac81-f9d12f606a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef186d9-0b84-4c5a-ab3e-00ce60822cde", "name": "network-vif-plugged", "status": "completed", "tag": "d90626e9-36c2-4477-aedd-498bfd037505"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:22:54.020229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9cab7310-676c-43fb-9fb6-07046a6df4a2 req-0e37d75e-d73b-4f3f-ac81-f9d12f606a10 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:54.020721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9cab7310-676c-43fb-9fb6-07046a6df4a2 req-0e37d75e-d73b-4f3f-ac81-f9d12f606a10 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:54.021156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9cab7310-676c-43fb-9fb6-07046a6df4a2 req-0e37d75e-d73b-4f3f-ac81-f9d12f606a10 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:54.032402 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-9cab7310-676c-43fb-9fb6-07046a6df4a2 req-0e37d75e-d73b-4f3f-ac81-f9d12f606a10 service nova] Creating event network-vif-plugged:d90626e9-36c2-4477-aedd-498bfd037505 for instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde on n-h2-860864-2 Oct 11 00:22:54.037245 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-9cab7310-676c-43fb-9fb6-07046a6df4a2 req-0e37d75e-d73b-4f3f-ac81-f9d12f606a10 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033563 Oct 11 00:22:54.038055 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3311/7278] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:22:54.532090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ab2acf70-95a5-45b4-8f5c-8839c3400a14 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:54.532788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ab2acf70-95a5-45b4-8f5c-8839c3400a14 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:54.540491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab2acf70-95a5-45b4-8f5c-8839c3400a14 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:54.540992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab2acf70-95a5-45b4-8f5c-8839c3400a14 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:54.541480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab2acf70-95a5-45b4-8f5c-8839c3400a14 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:54.542200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab2acf70-95a5-45b4-8f5c-8839c3400a14 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:54.542669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab2acf70-95a5-45b4-8f5c-8839c3400a14 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:54.543108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab2acf70-95a5-45b4-8f5c-8839c3400a14 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:54.683383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ab2acf70-95a5-45b4-8f5c-8839c3400a14 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:54.691283 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ab2acf70-95a5-45b4-8f5c-8839c3400a14 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1672 microversion: 2.1 time: 0.163091 Oct 11 00:22:54.692103 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3968/7279] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:54 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:55.718004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-017b63f4-c7d1-4bc1-9a10-8e58a8487d3e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:55.718805 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-017b63f4-c7d1-4bc1-9a10-8e58a8487d3e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:55.721619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:22:55.728280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-017b63f4-c7d1-4bc1-9a10-8e58a8487d3e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:55.728778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-017b63f4-c7d1-4bc1-9a10-8e58a8487d3e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:55.729222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-017b63f4-c7d1-4bc1-9a10-8e58a8487d3e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:55.729959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-017b63f4-c7d1-4bc1-9a10-8e58a8487d3e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:55.730418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-017b63f4-c7d1-4bc1-9a10-8e58a8487d3e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:55.730845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-017b63f4-c7d1-4bc1-9a10-8e58a8487d3e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:55.802742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-017b63f4-c7d1-4bc1-9a10-8e58a8487d3e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:55.811284 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-017b63f4-c7d1-4bc1-9a10-8e58a8487d3e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 200 len: 1605 microversion: 2.1 time: 0.099582 Oct 11 00:22:55.824929 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3312/7280] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:55 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 1605 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:55.862498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-824cda08-865a-48f2-a549-7d1fd8049927 req-c38c941b-bc3f-4ed0-83d8-bb3b615984fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef186d9-0b84-4c5a-ab3e-00ce60822cde", "name": "network-vif-deleted", "tag": "d90626e9-36c2-4477-aedd-498bfd037505"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:22:55.867875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:22:55.869933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:22:55.878686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-824cda08-865a-48f2-a549-7d1fd8049927 req-c38c941b-bc3f-4ed0-83d8-bb3b615984fc service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:55.879185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-824cda08-865a-48f2-a549-7d1fd8049927 req-c38c941b-bc3f-4ed0-83d8-bb3b615984fc service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:55.879639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-824cda08-865a-48f2-a549-7d1fd8049927 req-c38c941b-bc3f-4ed0-83d8-bb3b615984fc service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:55.893016 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-824cda08-865a-48f2-a549-7d1fd8049927 req-c38c941b-bc3f-4ed0-83d8-bb3b615984fc service nova] Creating event network-vif-deleted:d90626e9-36c2-4477-aedd-498bfd037505 for instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde on n-h2-860864-2 Oct 11 00:22:55.899710 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-824cda08-865a-48f2-a549-7d1fd8049927 req-c38c941b-bc3f-4ed0-83d8-bb3b615984fc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039885 Oct 11 00:22:55.900329 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3969/7281] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:22:56.844231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-637fc115-8ddb-4756-b2e6-c7aaee1fa7b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:56.845045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-637fc115-8ddb-4756-b2e6-c7aaee1fa7b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:56.852856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-637fc115-8ddb-4756-b2e6-c7aaee1fa7b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:56.853288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-637fc115-8ddb-4756-b2e6-c7aaee1fa7b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:56.854492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-637fc115-8ddb-4756-b2e6-c7aaee1fa7b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:56.855376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-637fc115-8ddb-4756-b2e6-c7aaee1fa7b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:56.855845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-637fc115-8ddb-4756-b2e6-c7aaee1fa7b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:56.856268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-637fc115-8ddb-4756-b2e6-c7aaee1fa7b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:56.872921 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-637fc115-8ddb-4756-b2e6-c7aaee1fa7b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] HTTP exception thrown: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-637fc115-8ddb-4756-b2e6-c7aaee1fa7b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Request method failure captured: Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde HTTP/1.1 Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLZxfLc8Q7Icn9DecaGe5gcChOHeFqpqEXkmJ2LBp2kaQghRPSuL_6yNQKoNJrZLgbTTr8mxh5HHn7k6cnYW1dBqXduwGRSIKp1_hC3HFPdzua2afeL-3QExGQACpymRN5ysngyDUJc_A6H1lS2CdmxbOx6trU-c0z1aLDt5QVmHkl4 Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f7cd77bf414e471ebaef6c378429ce00", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: a9570fd898f2441e814db0a76968d902 Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '6ef186d9-0b84-4c5a-ab3e-00ce60822cde'} Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:22:56.874676 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:22:56.879436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:22:56.879436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:22:56.879436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:22:56.879436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:22:56.879436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:22:56.879436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. Oct 11 00:22:56.879436 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:22:56.879436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-637fc115-8ddb-4756-b2e6-c7aaee1fa7b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Returning 404 to user: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:22:56.879436 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-637fc115-8ddb-4756-b2e6-c7aaee1fa7b2 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 404 len: 111 microversion: 2.1 time: 0.035803 Oct 11 00:22:56.879436 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3313/7282] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:56 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:22:56.897172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ef068f5e-bc22-42ca-8047-f1e1a83ccf6a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:56.897929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ef068f5e-bc22-42ca-8047-f1e1a83ccf6a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:56.904776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef068f5e-bc22-42ca-8047-f1e1a83ccf6a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:56.905276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef068f5e-bc22-42ca-8047-f1e1a83ccf6a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:56.905753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef068f5e-bc22-42ca-8047-f1e1a83ccf6a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:56.906463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef068f5e-bc22-42ca-8047-f1e1a83ccf6a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:56.906928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef068f5e-bc22-42ca-8047-f1e1a83ccf6a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:56.907365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef068f5e-bc22-42ca-8047-f1e1a83ccf6a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:56.922109 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-ef068f5e-bc22-42ca-8047-f1e1a83ccf6a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] HTTP exception thrown: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ef068f5e-bc22-42ca-8047-f1e1a83ccf6a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Request method failure captured: Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde HTTP/1.1 Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLZxfLc8Q7Icn9DecaGe5gcChOHeFqpqEXkmJ2LBp2kaQghRPSuL_6yNQKoNJrZLgbTTr8mxh5HHn7k6cnYW1dBqXduwGRSIKp1_hC3HFPdzua2afeL-3QExGQACpymRN5ysngyDUJc_A6H1lS2CdmxbOx6trU-c0z1aLDt5QVmHkl4 Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f7cd77bf414e471ebaef6c378429ce00", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a9570fd898f2441e814db0a76968d902 Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '6ef186d9-0b84-4c5a-ab3e-00ce60822cde'} Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:22:56.923865 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:22:56.928732 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:22:56.928732 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:22:56.928732 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:22:56.928732 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:22:56.928732 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:22:56.928732 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. Oct 11 00:22:56.928732 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:22:56.928732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ef068f5e-bc22-42ca-8047-f1e1a83ccf6a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Returning 404 to user: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:22:56.928732 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ef068f5e-bc22-42ca-8047-f1e1a83ccf6a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 404 len: 111 microversion: 2.1 time: 0.035069 Oct 11 00:22:56.928732 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3970/7283] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:56 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:22:56.976807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1cdb25fb-3364-47a9-b96f-faf6e4acfa2c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1921981012", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "a4816c55-6e00-4869-ba90-e42e23995d4c"}], "security_groups": [{"name": "tempest-securitygroup--965510550"}], "key_name": "tempest-keypair-921070498", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:22:57.084455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-1cdb25fb-3364-47a9-b96f-faf6e4acfa2c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] validate_networks() for [('a4816c55-6e00-4869-ba90-e42e23995d4c', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:22:57.485608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-1cdb25fb-3364-47a9-b96f-faf6e4acfa2c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:22:57.486045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-1cdb25fb-3364-47a9-b96f-faf6e4acfa2c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:22:57.486528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-1cdb25fb-3364-47a9-b96f-faf6e4acfa2c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:22:57.486940 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-1cdb25fb-3364-47a9-b96f-faf6e4acfa2c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:22:57.487363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-1cdb25fb-3364-47a9-b96f-faf6e4acfa2c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:22:57.503722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1cdb25fb-3364-47a9-b96f-faf6e4acfa2c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:57.504223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1cdb25fb-3364-47a9-b96f-faf6e4acfa2c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:57.504659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1cdb25fb-3364-47a9-b96f-faf6e4acfa2c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:57.505445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1cdb25fb-3364-47a9-b96f-faf6e4acfa2c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:57.505899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1cdb25fb-3364-47a9-b96f-faf6e4acfa2c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:57.506324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1cdb25fb-3364-47a9-b96f-faf6e4acfa2c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:57.528599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-1cdb25fb-3364-47a9-b96f-faf6e4acfa2c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Getting quotas for project f7cd77bf414e471ebaef6c378429ce00. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:22:57.534212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-1cdb25fb-3364-47a9-b96f-faf6e4acfa2c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Getting quotas for user a9570fd898f2441e814db0a76968d902 and project f7cd77bf414e471ebaef6c378429ce00. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:22:57.547579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1cdb25fb-3364-47a9-b96f-faf6e4acfa2c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:22:57.549956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1cdb25fb-3364-47a9-b96f-faf6e4acfa2c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:22:57.600779 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1cdb25fb-3364-47a9-b96f-faf6e4acfa2c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.628596 Oct 11 00:22:57.608357 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3314/7284] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:22:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:22:57.613592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c9a0044f-01c3-41cc-b76a-1dddebaaac07 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:57.614276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c9a0044f-01c3-41cc-b76a-1dddebaaac07 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:57.669318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c9a0044f-01c3-41cc-b76a-1dddebaaac07 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:57.676942 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c9a0044f-01c3-41cc-b76a-1dddebaaac07 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1238 microversion: 2.1 time: 0.067445 Oct 11 00:22:57.677585 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3971/7285] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:57 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:22:58.702961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-77197725-230b-44e5-9243-d27e853b7549 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:58.703692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-77197725-230b-44e5-9243-d27e853b7549 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:58.710203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77197725-230b-44e5-9243-d27e853b7549 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:58.711176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77197725-230b-44e5-9243-d27e853b7549 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:58.711797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77197725-230b-44e5-9243-d27e853b7549 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:58.712601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77197725-230b-44e5-9243-d27e853b7549 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:58.713357 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77197725-230b-44e5-9243-d27e853b7549 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:58.713906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77197725-230b-44e5-9243-d27e853b7549 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:58.800592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-77197725-230b-44e5-9243-d27e853b7549 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:22:58.808969 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-77197725-230b-44e5-9243-d27e853b7549 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1308 microversion: 2.1 time: 0.110818 Oct 11 00:22:58.809589 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3315/7286] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:58 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:22:59.834136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6153cb39-5aaf-4ca0-abd9-323976c178ba tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:22:59.834876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6153cb39-5aaf-4ca0-abd9-323976c178ba tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:22:59.844123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6153cb39-5aaf-4ca0-abd9-323976c178ba tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:59.844711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6153cb39-5aaf-4ca0-abd9-323976c178ba tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:59.845243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6153cb39-5aaf-4ca0-abd9-323976c178ba tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:22:59.846078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6153cb39-5aaf-4ca0-abd9-323976c178ba tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:22:59.846632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6153cb39-5aaf-4ca0-abd9-323976c178ba tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:22:59.847144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6153cb39-5aaf-4ca0-abd9-323976c178ba tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:23:00.041849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6153cb39-5aaf-4ca0-abd9-323976c178ba tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:23:00.049932 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6153cb39-5aaf-4ca0-abd9-323976c178ba tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1363 microversion: 2.1 time: 0.220131 Oct 11 00:23:00.050507 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3972/7287] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:22:59 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:23:00.188551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-e2e2e28b-6047-4eb5-a780-a24da9301fb1 req-1f05d161-32d1-4b0b-bd07-0a9bf4056883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16267e26-ba47-471e-8e39-4ea98f7391d9", "tag": "5f7b673c-3e6b-42ef-8a3d-419eda20e19d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:23:00.208218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e2e2e28b-6047-4eb5-a780-a24da9301fb1 req-1f05d161-32d1-4b0b-bd07-0a9bf4056883 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:23:00.209421 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e2e2e28b-6047-4eb5-a780-a24da9301fb1 req-1f05d161-32d1-4b0b-bd07-0a9bf4056883 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:23:00.211191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e2e2e28b-6047-4eb5-a780-a24da9301fb1 req-1f05d161-32d1-4b0b-bd07-0a9bf4056883 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:23:00.229138 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-e2e2e28b-6047-4eb5-a780-a24da9301fb1 req-1f05d161-32d1-4b0b-bd07-0a9bf4056883 service nova] Creating event network-changed:5f7b673c-3e6b-42ef-8a3d-419eda20e19d for instance 16267e26-ba47-471e-8e39-4ea98f7391d9 on n-h1-860864-2 Oct 11 00:23:00.234221 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-e2e2e28b-6047-4eb5-a780-a24da9301fb1 req-1f05d161-32d1-4b0b-bd07-0a9bf4056883 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053769 Oct 11 00:23:00.234835 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3316/7288] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:23:01.074916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b8081cba-3719-4f98-b3fe-2cffb35772a9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:23:01.075519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b8081cba-3719-4f98-b3fe-2cffb35772a9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:23:01.082386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8081cba-3719-4f98-b3fe-2cffb35772a9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:23:01.082885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8081cba-3719-4f98-b3fe-2cffb35772a9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:23:01.083339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8081cba-3719-4f98-b3fe-2cffb35772a9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:23:01.084054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8081cba-3719-4f98-b3fe-2cffb35772a9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:23:01.084523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8081cba-3719-4f98-b3fe-2cffb35772a9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:23:01.084966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b8081cba-3719-4f98-b3fe-2cffb35772a9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:23:01.219179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b8081cba-3719-4f98-b3fe-2cffb35772a9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:23:01.227700 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b8081cba-3719-4f98-b3fe-2cffb35772a9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1363 microversion: 2.1 time: 0.156753 Oct 11 00:23:01.228291 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3973/7289] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:23:01 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:23:02.252816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ce02c16c-d9fc-4d04-9948-5e1ad32a6e63 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:23:02.253570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ce02c16c-d9fc-4d04-9948-5e1ad32a6e63 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:23:02.259914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce02c16c-d9fc-4d04-9948-5e1ad32a6e63 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:23:02.260404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce02c16c-d9fc-4d04-9948-5e1ad32a6e63 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:23:02.260846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce02c16c-d9fc-4d04-9948-5e1ad32a6e63 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:23:02.261566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce02c16c-d9fc-4d04-9948-5e1ad32a6e63 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:23:02.262026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce02c16c-d9fc-4d04-9948-5e1ad32a6e63 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:23:02.262456 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ce02c16c-d9fc-4d04-9948-5e1ad32a6e63 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:23:02.395193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ce02c16c-d9fc-4d04-9948-5e1ad32a6e63 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:23:02.403695 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ce02c16c-d9fc-4d04-9948-5e1ad32a6e63 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1363 microversion: 2.1 time: 0.156265 Oct 11 00:23:02.404285 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3317/7290] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:23:02 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:23:03.427262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1b5e899c-4527-49f2-9de9-98b9c4bbaad3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:23:03.427897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1b5e899c-4527-49f2-9de9-98b9c4bbaad3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:23:03.436002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b5e899c-4527-49f2-9de9-98b9c4bbaad3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:23:03.436501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b5e899c-4527-49f2-9de9-98b9c4bbaad3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:23:03.436976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b5e899c-4527-49f2-9de9-98b9c4bbaad3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:23:03.437722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b5e899c-4527-49f2-9de9-98b9c4bbaad3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:23:03.438188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b5e899c-4527-49f2-9de9-98b9c4bbaad3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:23:03.438629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b5e899c-4527-49f2-9de9-98b9c4bbaad3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:23:03.579498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1b5e899c-4527-49f2-9de9-98b9c4bbaad3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:23:03.587882 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1b5e899c-4527-49f2-9de9-98b9c4bbaad3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1363 microversion: 2.1 time: 0.164516 Oct 11 00:23:03.588472 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3974/7291] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:23:03 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:23:04.611981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bb04f0f6-eeb4-4cf3-be1c-1561b35bce4e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:23:04.612589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bb04f0f6-eeb4-4cf3-be1c-1561b35bce4e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:23:04.620239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb04f0f6-eeb4-4cf3-be1c-1561b35bce4e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:23:04.620723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb04f0f6-eeb4-4cf3-be1c-1561b35bce4e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:23:04.621161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb04f0f6-eeb4-4cf3-be1c-1561b35bce4e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:23:04.621879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb04f0f6-eeb4-4cf3-be1c-1561b35bce4e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:23:04.622328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb04f0f6-eeb4-4cf3-be1c-1561b35bce4e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:23:04.622747 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bb04f0f6-eeb4-4cf3-be1c-1561b35bce4e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:23:04.758018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bb04f0f6-eeb4-4cf3-be1c-1561b35bce4e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:23:04.765790 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bb04f0f6-eeb4-4cf3-be1c-1561b35bce4e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1363 microversion: 2.1 time: 0.157733 Oct 11 00:23:04.766378 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3318/7292] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:23:04 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:23:05.788228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-aa2c3480-c69f-4505-923f-109d04a8859f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:23:05.789121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-aa2c3480-c69f-4505-923f-109d04a8859f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:23:05.796424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa2c3480-c69f-4505-923f-109d04a8859f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:23:05.796953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa2c3480-c69f-4505-923f-109d04a8859f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:23:05.797406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa2c3480-c69f-4505-923f-109d04a8859f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:23:05.798133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa2c3480-c69f-4505-923f-109d04a8859f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:23:05.798609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa2c3480-c69f-4505-923f-109d04a8859f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:23:05.799096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa2c3480-c69f-4505-923f-109d04a8859f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:23:05.933123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-aa2c3480-c69f-4505-923f-109d04a8859f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:23:05.940917 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-aa2c3480-c69f-4505-923f-109d04a8859f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1363 microversion: 2.1 time: 0.156733 Oct 11 00:23:05.941532 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3975/7293] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:23:05 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:23:06.204998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-b4480e02-a2da-4243-90d4-87a8058ef060 req-5796df5e-cfe3-43ca-a0bb-b5a3cba6ed08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16267e26-ba47-471e-8e39-4ea98f7391d9", "name": "network-vif-plugged", "status": "completed", "tag": "5f7b673c-3e6b-42ef-8a3d-419eda20e19d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:23:06.216880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b4480e02-a2da-4243-90d4-87a8058ef060 req-5796df5e-cfe3-43ca-a0bb-b5a3cba6ed08 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:23:06.217523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b4480e02-a2da-4243-90d4-87a8058ef060 req-5796df5e-cfe3-43ca-a0bb-b5a3cba6ed08 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:23:06.217827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-b4480e02-a2da-4243-90d4-87a8058ef060 req-5796df5e-cfe3-43ca-a0bb-b5a3cba6ed08 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:23:06.230708 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-b4480e02-a2da-4243-90d4-87a8058ef060 req-5796df5e-cfe3-43ca-a0bb-b5a3cba6ed08 service nova] Creating event network-vif-plugged:5f7b673c-3e6b-42ef-8a3d-419eda20e19d for instance 16267e26-ba47-471e-8e39-4ea98f7391d9 on n-h1-860864-2 Oct 11 00:23:06.235533 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-b4480e02-a2da-4243-90d4-87a8058ef060 req-5796df5e-cfe3-43ca-a0bb-b5a3cba6ed08 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034224 Oct 11 00:23:06.236140 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3319/7294] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:23:06.965611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-eedc1783-e29e-4af5-9240-f2e7e3660f40 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:23:06.966245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-eedc1783-e29e-4af5-9240-f2e7e3660f40 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:23:06.973216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eedc1783-e29e-4af5-9240-f2e7e3660f40 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:23:06.973758 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eedc1783-e29e-4af5-9240-f2e7e3660f40 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:23:06.974209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eedc1783-e29e-4af5-9240-f2e7e3660f40 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:23:06.974919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eedc1783-e29e-4af5-9240-f2e7e3660f40 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:23:06.975384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eedc1783-e29e-4af5-9240-f2e7e3660f40 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:23:06.975821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eedc1783-e29e-4af5-9240-f2e7e3660f40 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:23:07.110054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-eedc1783-e29e-4af5-9240-f2e7e3660f40 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:23:07.118336 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-eedc1783-e29e-4af5-9240-f2e7e3660f40 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1363 microversion: 2.1 time: 0.156762 Oct 11 00:23:07.118905 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3976/7295] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:23:06 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:23:08.140407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:23:08.141346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:23:08.145443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-870aa258-8d2c-42f6-90d5-67d460a70b43 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:23:08.146227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-870aa258-8d2c-42f6-90d5-67d460a70b43 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:23:08.153369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-870aa258-8d2c-42f6-90d5-67d460a70b43 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:23:08.153879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-870aa258-8d2c-42f6-90d5-67d460a70b43 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:23:08.154320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-870aa258-8d2c-42f6-90d5-67d460a70b43 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:23:08.155009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-870aa258-8d2c-42f6-90d5-67d460a70b43 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:23:08.155464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-870aa258-8d2c-42f6-90d5-67d460a70b43 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:23:08.155890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-870aa258-8d2c-42f6-90d5-67d460a70b43 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:23:08.285726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-870aa258-8d2c-42f6-90d5-67d460a70b43 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:23:08.293893 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-870aa258-8d2c-42f6-90d5-67d460a70b43 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1549 microversion: 2.1 time: 0.155257 Oct 11 00:23:08.294475 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3320/7296] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:23:08 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:23:08.317812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c9a41d40-c501-4738-9045-07d806fcd094 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:23:08.318289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c9a41d40-c501-4738-9045-07d806fcd094 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:23:08.321121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:23:08.326941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9a41d40-c501-4738-9045-07d806fcd094 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:23:08.327445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9a41d40-c501-4738-9045-07d806fcd094 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:23:08.327904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9a41d40-c501-4738-9045-07d806fcd094 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:23:08.328611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9a41d40-c501-4738-9045-07d806fcd094 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:23:08.329076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9a41d40-c501-4738-9045-07d806fcd094 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:23:08.329554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9a41d40-c501-4738-9045-07d806fcd094 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:23:08.409855 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c9a41d40-c501-4738-9045-07d806fcd094 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096171 Oct 11 00:23:08.410469 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3977/7297] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 11 00:23:08 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:23:09.686680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-33921b31-4978-4b42-b2ed-c8067aae240d req-fbefb077-604e-4a51-8418-ebbfb742228d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16267e26-ba47-471e-8e39-4ea98f7391d9", "tag": "5f7b673c-3e6b-42ef-8a3d-419eda20e19d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:23:09.697817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-33921b31-4978-4b42-b2ed-c8067aae240d req-fbefb077-604e-4a51-8418-ebbfb742228d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:23:09.698307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-33921b31-4978-4b42-b2ed-c8067aae240d req-fbefb077-604e-4a51-8418-ebbfb742228d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:23:09.698749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-33921b31-4978-4b42-b2ed-c8067aae240d req-fbefb077-604e-4a51-8418-ebbfb742228d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:23:09.710436 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-33921b31-4978-4b42-b2ed-c8067aae240d req-fbefb077-604e-4a51-8418-ebbfb742228d service nova] Creating event network-changed:5f7b673c-3e6b-42ef-8a3d-419eda20e19d for instance 16267e26-ba47-471e-8e39-4ea98f7391d9 on n-h1-860864-2 Oct 11 00:23:09.715628 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-33921b31-4978-4b42-b2ed-c8067aae240d req-fbefb077-604e-4a51-8418-ebbfb742228d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032619 Oct 11 00:23:09.716295 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3321/7298] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:24:24.136624 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=19 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:24:24.137465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=64 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:24:24.138470 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:24:24.138615 n-d-860864-2 devstack@n-api.service[120613]: Tue Oct 11 00:24:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 (ip 10.222.0.23) !!! Oct 11 00:24:24.145155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-deb2f241-01c7-484e-a26d-1376c0d6497a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:24:24.145803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-deb2f241-01c7-484e-a26d-1376c0d6497a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:24.153500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-deb2f241-01c7-484e-a26d-1376c0d6497a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:24.153947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-deb2f241-01c7-484e-a26d-1376c0d6497a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:24.154396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-deb2f241-01c7-484e-a26d-1376c0d6497a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:24.155095 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-deb2f241-01c7-484e-a26d-1376c0d6497a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:24.156161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-deb2f241-01c7-484e-a26d-1376c0d6497a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:24.156613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-deb2f241-01c7-484e-a26d-1376c0d6497a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:24.293941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-deb2f241-01c7-484e-a26d-1376c0d6497a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:24:24.302839 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-deb2f241-01c7-484e-a26d-1376c0d6497a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1667 microversion: 2.1 time: 0.168657 Oct 11 00:24:24.303416 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3978/7299] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:24:24 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1667 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:24:24.324530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:24:24.325283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:24:24.330307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a6efc764-65eb-4957-8e2a-a4d14b8d4f84 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a81f600-7b72-4867-9ada-4234b8e7f29d"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:24:24.332702 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a6efc764-65eb-4957-8e2a-a4d14b8d4f84 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:24.340815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6efc764-65eb-4957-8e2a-a4d14b8d4f84 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:24.341298 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6efc764-65eb-4957-8e2a-a4d14b8d4f84 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:24.341802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6efc764-65eb-4957-8e2a-a4d14b8d4f84 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:24.342500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6efc764-65eb-4957-8e2a-a4d14b8d4f84 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:24.343050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6efc764-65eb-4957-8e2a-a4d14b8d4f84 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:24.343619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6efc764-65eb-4957-8e2a-a4d14b8d4f84 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:24.586337 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a6efc764-65eb-4957-8e2a-a4d14b8d4f84 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "POST /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263970 Oct 11 00:24:24.586905 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3322/7300] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 11 00:24:24 2022] POST /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:24:35.335264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-70be2261-c982-434f-9c60-1adb8674b7b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:24:35.337666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-70be2261-c982-434f-9c60-1adb8674b7b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:35.340488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:24:35.341308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:24:35.347884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70be2261-c982-434f-9c60-1adb8674b7b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:35.348392 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70be2261-c982-434f-9c60-1adb8674b7b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:35.348846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70be2261-c982-434f-9c60-1adb8674b7b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:35.349600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70be2261-c982-434f-9c60-1adb8674b7b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:35.350075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70be2261-c982-434f-9c60-1adb8674b7b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:35.350889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-70be2261-c982-434f-9c60-1adb8674b7b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:35.379902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-70be2261-c982-434f-9c60-1adb8674b7b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:24:35.386471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-70be2261-c982-434f-9c60-1adb8674b7b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Old instance type m1.heat2, new instance type m1.heat {{(pid=120613) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 00:24:35.394363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-70be2261-c982-434f-9c60-1adb8674b7b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:24:35.394802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-70be2261-c982-434f-9c60-1adb8674b7b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:24:35.395298 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-70be2261-c982-434f-9c60-1adb8674b7b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:24:35.395726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-70be2261-c982-434f-9c60-1adb8674b7b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:24:35.396153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-70be2261-c982-434f-9c60-1adb8674b7b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:24:35.461602 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-70be2261-c982-434f-9c60-1adb8674b7b7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "POST /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9/action" status: 202 len: 0 microversion: 2.1 time: 0.130084 Oct 11 00:24:35.462884 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3979/7301] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:24:35 2022] POST /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:24:35.472659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b8d323a2-ec83-488f-ae78-17967a020a74 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:24:35.474042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b8d323a2-ec83-488f-ae78-17967a020a74 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:35.478871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:24:35.479545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:24:35.484256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8d323a2-ec83-488f-ae78-17967a020a74 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:35.484758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8d323a2-ec83-488f-ae78-17967a020a74 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:35.485198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8d323a2-ec83-488f-ae78-17967a020a74 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:35.485935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8d323a2-ec83-488f-ae78-17967a020a74 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:35.486392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8d323a2-ec83-488f-ae78-17967a020a74 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:35.486822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b8d323a2-ec83-488f-ae78-17967a020a74 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:35.631589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b8d323a2-ec83-488f-ae78-17967a020a74 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:24:35.641273 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b8d323a2-ec83-488f-ae78-17967a020a74 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1722 microversion: 2.1 time: 0.174076 Oct 11 00:24:35.642017 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3323/7302] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:24:35 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:24:36.664293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-479931bc-656d-4c42-b175-b593cd6d557f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:24:36.664923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-479931bc-656d-4c42-b175-b593cd6d557f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:36.673621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-479931bc-656d-4c42-b175-b593cd6d557f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:36.674124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-479931bc-656d-4c42-b175-b593cd6d557f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:36.674569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-479931bc-656d-4c42-b175-b593cd6d557f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:36.675284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-479931bc-656d-4c42-b175-b593cd6d557f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:36.675748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-479931bc-656d-4c42-b175-b593cd6d557f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:36.676189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-479931bc-656d-4c42-b175-b593cd6d557f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:36.814983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-479931bc-656d-4c42-b175-b593cd6d557f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:24:36.831695 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-479931bc-656d-4c42-b175-b593cd6d557f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1722 microversion: 2.1 time: 0.171282 Oct 11 00:24:36.832492 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3980/7303] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:24:36 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:24:37.856271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b75437e7-4e0d-4696-9f32-dc3037c6e9c8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:24:37.856912 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b75437e7-4e0d-4696-9f32-dc3037c6e9c8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:37.864598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b75437e7-4e0d-4696-9f32-dc3037c6e9c8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:37.865083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b75437e7-4e0d-4696-9f32-dc3037c6e9c8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:37.865550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b75437e7-4e0d-4696-9f32-dc3037c6e9c8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:37.866248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b75437e7-4e0d-4696-9f32-dc3037c6e9c8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:37.866698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b75437e7-4e0d-4696-9f32-dc3037c6e9c8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:37.867123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b75437e7-4e0d-4696-9f32-dc3037c6e9c8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:38.000325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b75437e7-4e0d-4696-9f32-dc3037c6e9c8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:24:38.008647 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b75437e7-4e0d-4696-9f32-dc3037c6e9c8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1727 microversion: 2.1 time: 0.156439 Oct 11 00:24:38.009231 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3324/7304] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:24:37 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:24:39.033638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dc60e705-8c2a-45e4-b8c7-3161a4dc0eab tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:24:39.034216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dc60e705-8c2a-45e4-b8c7-3161a4dc0eab tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:39.041034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc60e705-8c2a-45e4-b8c7-3161a4dc0eab tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:39.041580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc60e705-8c2a-45e4-b8c7-3161a4dc0eab tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:39.042037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc60e705-8c2a-45e4-b8c7-3161a4dc0eab tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:39.042755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc60e705-8c2a-45e4-b8c7-3161a4dc0eab tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:39.043237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc60e705-8c2a-45e4-b8c7-3161a4dc0eab tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:39.043679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc60e705-8c2a-45e4-b8c7-3161a4dc0eab tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:39.188799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dc60e705-8c2a-45e4-b8c7-3161a4dc0eab tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:24:39.197587 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dc60e705-8c2a-45e4-b8c7-3161a4dc0eab tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1727 microversion: 2.1 time: 0.168697 Oct 11 00:24:39.198169 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3981/7305] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:24:39 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:24:40.222745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-42455a6d-78e4-488e-8d6c-4a4fc9d928c0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:24:40.223423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-42455a6d-78e4-488e-8d6c-4a4fc9d928c0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:40.230719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42455a6d-78e4-488e-8d6c-4a4fc9d928c0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:40.231208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42455a6d-78e4-488e-8d6c-4a4fc9d928c0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:40.231644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42455a6d-78e4-488e-8d6c-4a4fc9d928c0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:40.232344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42455a6d-78e4-488e-8d6c-4a4fc9d928c0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:40.232792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42455a6d-78e4-488e-8d6c-4a4fc9d928c0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:40.233855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42455a6d-78e4-488e-8d6c-4a4fc9d928c0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:40.370323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-42455a6d-78e4-488e-8d6c-4a4fc9d928c0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:24:40.378967 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-42455a6d-78e4-488e-8d6c-4a4fc9d928c0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1727 microversion: 2.1 time: 0.160261 Oct 11 00:24:40.379602 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3325/7306] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:24:40 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:24:41.402569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c5f9763b-c06f-4e48-9c39-031bdd6d6ced tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:24:41.403218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c5f9763b-c06f-4e48-9c39-031bdd6d6ced tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:41.411637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5f9763b-c06f-4e48-9c39-031bdd6d6ced tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:41.412196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5f9763b-c06f-4e48-9c39-031bdd6d6ced tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:41.412653 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5f9763b-c06f-4e48-9c39-031bdd6d6ced tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:41.413397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5f9763b-c06f-4e48-9c39-031bdd6d6ced tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:41.413873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5f9763b-c06f-4e48-9c39-031bdd6d6ced tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:41.414317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c5f9763b-c06f-4e48-9c39-031bdd6d6ced tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:41.563938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c5f9763b-c06f-4e48-9c39-031bdd6d6ced tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:24:41.575046 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c5f9763b-c06f-4e48-9c39-031bdd6d6ced tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1727 microversion: 2.1 time: 0.176302 Oct 11 00:24:41.575643 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3982/7307] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:24:41 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:24:42.598831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c5661b80-207a-459e-b247-1dcc48cafa96 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:24:42.599455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c5661b80-207a-459e-b247-1dcc48cafa96 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:42.606721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5661b80-207a-459e-b247-1dcc48cafa96 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:42.607209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5661b80-207a-459e-b247-1dcc48cafa96 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:42.607641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5661b80-207a-459e-b247-1dcc48cafa96 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:42.608575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5661b80-207a-459e-b247-1dcc48cafa96 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:42.609027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5661b80-207a-459e-b247-1dcc48cafa96 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:42.609653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5661b80-207a-459e-b247-1dcc48cafa96 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:42.750050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c5661b80-207a-459e-b247-1dcc48cafa96 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:24:42.758603 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c5661b80-207a-459e-b247-1dcc48cafa96 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1727 microversion: 2.1 time: 0.163689 Oct 11 00:24:42.759594 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3326/7308] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:24:42 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:24:43.783518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5de9cc3c-ddf5-41b7-89c1-396ee500e19d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:24:43.784353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5de9cc3c-ddf5-41b7-89c1-396ee500e19d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:43.791859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5de9cc3c-ddf5-41b7-89c1-396ee500e19d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:43.792372 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5de9cc3c-ddf5-41b7-89c1-396ee500e19d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:43.792824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5de9cc3c-ddf5-41b7-89c1-396ee500e19d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:43.793588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5de9cc3c-ddf5-41b7-89c1-396ee500e19d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:43.794089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5de9cc3c-ddf5-41b7-89c1-396ee500e19d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:43.794530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5de9cc3c-ddf5-41b7-89c1-396ee500e19d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:43.933282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5de9cc3c-ddf5-41b7-89c1-396ee500e19d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:24:43.942092 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5de9cc3c-ddf5-41b7-89c1-396ee500e19d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1727 microversion: 2.1 time: 0.163363 Oct 11 00:24:43.942672 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3983/7309] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:24:43 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:24:44.964739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b02c4099-7c01-4335-809e-e237c80b23e3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:24:44.965363 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b02c4099-7c01-4335-809e-e237c80b23e3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:44.972998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b02c4099-7c01-4335-809e-e237c80b23e3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:44.973525 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b02c4099-7c01-4335-809e-e237c80b23e3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:44.973964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b02c4099-7c01-4335-809e-e237c80b23e3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:44.974660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b02c4099-7c01-4335-809e-e237c80b23e3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:44.975111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b02c4099-7c01-4335-809e-e237c80b23e3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:44.975537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b02c4099-7c01-4335-809e-e237c80b23e3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:45.117402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b02c4099-7c01-4335-809e-e237c80b23e3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:24:45.127837 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b02c4099-7c01-4335-809e-e237c80b23e3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1727 microversion: 2.1 time: 0.167035 Oct 11 00:24:45.128483 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3327/7310] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:24:44 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:24:46.153883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-722cce3b-413f-4b5a-9665-1446ea6f398f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:24:46.154521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-722cce3b-413f-4b5a-9665-1446ea6f398f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:46.163976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-722cce3b-413f-4b5a-9665-1446ea6f398f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:46.164481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-722cce3b-413f-4b5a-9665-1446ea6f398f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:46.164936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-722cce3b-413f-4b5a-9665-1446ea6f398f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:46.165718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-722cce3b-413f-4b5a-9665-1446ea6f398f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:46.166192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-722cce3b-413f-4b5a-9665-1446ea6f398f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:46.166641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-722cce3b-413f-4b5a-9665-1446ea6f398f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:46.310390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-722cce3b-413f-4b5a-9665-1446ea6f398f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:24:46.321582 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-722cce3b-413f-4b5a-9665-1446ea6f398f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1727 microversion: 2.1 time: 0.171718 Oct 11 00:24:46.322342 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3984/7311] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:24:46 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:24:47.347147 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-94255300-47b1-4b69-9ade-1884a958a679 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:24:47.347955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-94255300-47b1-4b69-9ade-1884a958a679 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:47.354963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94255300-47b1-4b69-9ade-1884a958a679 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:47.355453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94255300-47b1-4b69-9ade-1884a958a679 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:47.355899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94255300-47b1-4b69-9ade-1884a958a679 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:47.356596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94255300-47b1-4b69-9ade-1884a958a679 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:47.357052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94255300-47b1-4b69-9ade-1884a958a679 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:47.357522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-94255300-47b1-4b69-9ade-1884a958a679 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:47.500971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-94255300-47b1-4b69-9ade-1884a958a679 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:24:47.509404 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-94255300-47b1-4b69-9ade-1884a958a679 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1727 microversion: 2.1 time: 0.166951 Oct 11 00:24:47.510020 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3328/7312] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:24:47 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:24:48.535264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ad44ad3b-2af2-4c83-8770-19b2d5c2d2bc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:24:48.535968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ad44ad3b-2af2-4c83-8770-19b2d5c2d2bc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:48.543100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad44ad3b-2af2-4c83-8770-19b2d5c2d2bc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:48.543610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad44ad3b-2af2-4c83-8770-19b2d5c2d2bc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:48.544069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad44ad3b-2af2-4c83-8770-19b2d5c2d2bc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:48.544776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad44ad3b-2af2-4c83-8770-19b2d5c2d2bc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:48.545251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad44ad3b-2af2-4c83-8770-19b2d5c2d2bc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:48.546600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ad44ad3b-2af2-4c83-8770-19b2d5c2d2bc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:48.684029 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ad44ad3b-2af2-4c83-8770-19b2d5c2d2bc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:24:48.702495 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ad44ad3b-2af2-4c83-8770-19b2d5c2d2bc tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1727 microversion: 2.1 time: 0.170131 Oct 11 00:24:48.704630 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3985/7313] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:24:48 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:24:49.728675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b9da9cc3-9d0f-4a37-af16-4bd31b0d0ab8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:24:49.729317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b9da9cc3-9d0f-4a37-af16-4bd31b0d0ab8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:49.736881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9da9cc3-9d0f-4a37-af16-4bd31b0d0ab8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:49.737365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9da9cc3-9d0f-4a37-af16-4bd31b0d0ab8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:49.737828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9da9cc3-9d0f-4a37-af16-4bd31b0d0ab8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:49.738521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9da9cc3-9d0f-4a37-af16-4bd31b0d0ab8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:49.738971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9da9cc3-9d0f-4a37-af16-4bd31b0d0ab8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:49.739393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9da9cc3-9d0f-4a37-af16-4bd31b0d0ab8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:49.876965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b9da9cc3-9d0f-4a37-af16-4bd31b0d0ab8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:24:49.885229 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b9da9cc3-9d0f-4a37-af16-4bd31b0d0ab8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1727 microversion: 2.1 time: 0.160573 Oct 11 00:24:49.885840 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3329/7314] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:24:49 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:24:50.910482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c3db97b3-59b8-4aad-94bd-e28d46684bcd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:24:50.911111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c3db97b3-59b8-4aad-94bd-e28d46684bcd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:50.917130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3db97b3-59b8-4aad-94bd-e28d46684bcd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:50.917665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3db97b3-59b8-4aad-94bd-e28d46684bcd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:50.918121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3db97b3-59b8-4aad-94bd-e28d46684bcd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:50.918835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3db97b3-59b8-4aad-94bd-e28d46684bcd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:50.919304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3db97b3-59b8-4aad-94bd-e28d46684bcd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:50.919745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c3db97b3-59b8-4aad-94bd-e28d46684bcd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:51.057525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c3db97b3-59b8-4aad-94bd-e28d46684bcd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:24:51.066850 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c3db97b3-59b8-4aad-94bd-e28d46684bcd tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1727 microversion: 2.1 time: 0.161364 Oct 11 00:24:51.067575 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3986/7315] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:24:50 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:24:52.091775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e79e0c5b-4735-4e76-aa01-9ca9c5cffa79 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:24:52.092345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e79e0c5b-4735-4e76-aa01-9ca9c5cffa79 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:52.100395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e79e0c5b-4735-4e76-aa01-9ca9c5cffa79 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:52.100930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e79e0c5b-4735-4e76-aa01-9ca9c5cffa79 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:52.101414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e79e0c5b-4735-4e76-aa01-9ca9c5cffa79 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:52.102093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e79e0c5b-4735-4e76-aa01-9ca9c5cffa79 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:52.102550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e79e0c5b-4735-4e76-aa01-9ca9c5cffa79 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:52.102977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e79e0c5b-4735-4e76-aa01-9ca9c5cffa79 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:52.242902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e79e0c5b-4735-4e76-aa01-9ca9c5cffa79 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:24:52.252476 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e79e0c5b-4735-4e76-aa01-9ca9c5cffa79 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1727 microversion: 2.1 time: 0.164692 Oct 11 00:24:52.253057 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3330/7316] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:24:52 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:24:53.277450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4003e711-b8d7-498b-bcab-88caf010ac21 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:24:53.278088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4003e711-b8d7-498b-bcab-88caf010ac21 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:53.284882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4003e711-b8d7-498b-bcab-88caf010ac21 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:53.285398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4003e711-b8d7-498b-bcab-88caf010ac21 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:53.285888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4003e711-b8d7-498b-bcab-88caf010ac21 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:53.286642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4003e711-b8d7-498b-bcab-88caf010ac21 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:53.287141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4003e711-b8d7-498b-bcab-88caf010ac21 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:53.287522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4003e711-b8d7-498b-bcab-88caf010ac21 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:53.435375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4003e711-b8d7-498b-bcab-88caf010ac21 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:24:53.445821 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4003e711-b8d7-498b-bcab-88caf010ac21 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1727 microversion: 2.1 time: 0.171824 Oct 11 00:24:53.446905 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3987/7317] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:24:53 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:24:54.471936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0e9f04d8-7bcd-4042-80d0-284f041aa48f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:24:54.472814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0e9f04d8-7bcd-4042-80d0-284f041aa48f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:54.479391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e9f04d8-7bcd-4042-80d0-284f041aa48f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:54.479871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e9f04d8-7bcd-4042-80d0-284f041aa48f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:54.480301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e9f04d8-7bcd-4042-80d0-284f041aa48f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:54.480986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e9f04d8-7bcd-4042-80d0-284f041aa48f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:54.481471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e9f04d8-7bcd-4042-80d0-284f041aa48f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:54.481900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e9f04d8-7bcd-4042-80d0-284f041aa48f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:54.621799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0e9f04d8-7bcd-4042-80d0-284f041aa48f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:24:54.630817 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0e9f04d8-7bcd-4042-80d0-284f041aa48f tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1727 microversion: 2.1 time: 0.164160 Oct 11 00:24:54.631404 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3331/7318] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:24:54 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:24:55.654333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-37747b7c-2b3d-4c09-9f00-7dcd497e8636 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:24:55.655060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-37747b7c-2b3d-4c09-9f00-7dcd497e8636 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:55.662349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37747b7c-2b3d-4c09-9f00-7dcd497e8636 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:55.662858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37747b7c-2b3d-4c09-9f00-7dcd497e8636 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:55.663320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37747b7c-2b3d-4c09-9f00-7dcd497e8636 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:55.664047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37747b7c-2b3d-4c09-9f00-7dcd497e8636 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:55.664527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37747b7c-2b3d-4c09-9f00-7dcd497e8636 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:55.664975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37747b7c-2b3d-4c09-9f00-7dcd497e8636 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:55.813548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-37747b7c-2b3d-4c09-9f00-7dcd497e8636 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:24:55.823532 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-37747b7c-2b3d-4c09-9f00-7dcd497e8636 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1727 microversion: 2.1 time: 0.173124 Oct 11 00:24:55.824169 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3988/7319] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:24:55 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:24:56.847747 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a43fb0da-d443-4030-92c6-e4ff0bed00af tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:24:56.848404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a43fb0da-d443-4030-92c6-e4ff0bed00af tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:56.855336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43fb0da-d443-4030-92c6-e4ff0bed00af tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:56.855826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43fb0da-d443-4030-92c6-e4ff0bed00af tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:56.856260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43fb0da-d443-4030-92c6-e4ff0bed00af tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:56.856964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43fb0da-d443-4030-92c6-e4ff0bed00af tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:56.857459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43fb0da-d443-4030-92c6-e4ff0bed00af tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:56.857877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43fb0da-d443-4030-92c6-e4ff0bed00af tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:57.004032 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a43fb0da-d443-4030-92c6-e4ff0bed00af tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:24:57.013129 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a43fb0da-d443-4030-92c6-e4ff0bed00af tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1727 microversion: 2.1 time: 0.169264 Oct 11 00:24:57.013799 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3332/7320] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:24:56 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:24:58.051535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-751cc996-a269-49ed-87dc-e09b8b626253 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:24:58.052194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-751cc996-a269-49ed-87dc-e09b8b626253 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:58.059669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-751cc996-a269-49ed-87dc-e09b8b626253 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:58.060173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-751cc996-a269-49ed-87dc-e09b8b626253 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:58.060621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-751cc996-a269-49ed-87dc-e09b8b626253 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:58.061337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-751cc996-a269-49ed-87dc-e09b8b626253 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:58.061932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-751cc996-a269-49ed-87dc-e09b8b626253 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:58.062493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-751cc996-a269-49ed-87dc-e09b8b626253 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:58.195767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-751cc996-a269-49ed-87dc-e09b8b626253 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:24:58.204914 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-751cc996-a269-49ed-87dc-e09b8b626253 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1727 microversion: 2.1 time: 0.157513 Oct 11 00:24:58.205594 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3989/7321] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:24:58 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:24:59.228187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-920ebb1c-feea-40c0-8cfc-3d5e48f12e28 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:24:59.228902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-920ebb1c-feea-40c0-8cfc-3d5e48f12e28 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:24:59.236548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-920ebb1c-feea-40c0-8cfc-3d5e48f12e28 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:59.237039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-920ebb1c-feea-40c0-8cfc-3d5e48f12e28 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:59.237508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-920ebb1c-feea-40c0-8cfc-3d5e48f12e28 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:59.238209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-920ebb1c-feea-40c0-8cfc-3d5e48f12e28 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:24:59.238663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-920ebb1c-feea-40c0-8cfc-3d5e48f12e28 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:24:59.239093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-920ebb1c-feea-40c0-8cfc-3d5e48f12e28 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:24:59.383146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-920ebb1c-feea-40c0-8cfc-3d5e48f12e28 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:24:59.392683 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-920ebb1c-feea-40c0-8cfc-3d5e48f12e28 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1727 microversion: 2.1 time: 0.168385 Oct 11 00:24:59.393269 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3333/7322] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:24:59 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:00.418453 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3349ba13-0ac5-4a83-b080-2556f322f4db tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:00.419087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3349ba13-0ac5-4a83-b080-2556f322f4db tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:00.431233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3349ba13-0ac5-4a83-b080-2556f322f4db tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:00.431233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3349ba13-0ac5-4a83-b080-2556f322f4db tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:00.431233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3349ba13-0ac5-4a83-b080-2556f322f4db tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:00.431233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3349ba13-0ac5-4a83-b080-2556f322f4db tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:00.431233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3349ba13-0ac5-4a83-b080-2556f322f4db tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:00.431233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3349ba13-0ac5-4a83-b080-2556f322f4db tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:00.571288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3349ba13-0ac5-4a83-b080-2556f322f4db tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:00.580542 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3349ba13-0ac5-4a83-b080-2556f322f4db tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1727 microversion: 2.1 time: 0.166011 Oct 11 00:25:00.581189 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3990/7323] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:00 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:01.604548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-112da574-4c8b-40d5-be14-aa6e5aa58110 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:01.605183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-112da574-4c8b-40d5-be14-aa6e5aa58110 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:01.612832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-112da574-4c8b-40d5-be14-aa6e5aa58110 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:01.613389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-112da574-4c8b-40d5-be14-aa6e5aa58110 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:01.613836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-112da574-4c8b-40d5-be14-aa6e5aa58110 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:01.614532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-112da574-4c8b-40d5-be14-aa6e5aa58110 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:01.614981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-112da574-4c8b-40d5-be14-aa6e5aa58110 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:01.615402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-112da574-4c8b-40d5-be14-aa6e5aa58110 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:01.766636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-112da574-4c8b-40d5-be14-aa6e5aa58110 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:01.775549 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-112da574-4c8b-40d5-be14-aa6e5aa58110 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1726 microversion: 2.1 time: 0.175276 Oct 11 00:25:01.776249 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3334/7324] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:01 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:02.091855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-1665908c-f48a-4e5c-b7aa-3b6de24bdcd6 req-d9b92edb-702b-402e-8df2-de55c1eb6079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16267e26-ba47-471e-8e39-4ea98f7391d9", "name": "network-vif-unplugged", "status": "completed", "tag": "5f7b673c-3e6b-42ef-8a3d-419eda20e19d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:25:02.104317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1665908c-f48a-4e5c-b7aa-3b6de24bdcd6 req-d9b92edb-702b-402e-8df2-de55c1eb6079 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:02.105683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1665908c-f48a-4e5c-b7aa-3b6de24bdcd6 req-d9b92edb-702b-402e-8df2-de55c1eb6079 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:02.106346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1665908c-f48a-4e5c-b7aa-3b6de24bdcd6 req-d9b92edb-702b-402e-8df2-de55c1eb6079 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:02.119814 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-1665908c-f48a-4e5c-b7aa-3b6de24bdcd6 req-d9b92edb-702b-402e-8df2-de55c1eb6079 service nova] Creating event network-vif-unplugged:5f7b673c-3e6b-42ef-8a3d-419eda20e19d for instance 16267e26-ba47-471e-8e39-4ea98f7391d9 on n-h2-860864-2 Oct 11 00:25:02.127203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-1665908c-f48a-4e5c-b7aa-3b6de24bdcd6 req-d9b92edb-702b-402e-8df2-de55c1eb6079 service nova] Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 00:25:02.132338 n-d-860864-2 devstack@n-api.service[120613]: ERROR oslo.messaging._drivers.impl_rabbit [req-1665908c-f48a-4e5c-b7aa-3b6de24bdcd6 req-d9b92edb-702b-402e-8df2-de55c1eb6079 service nova] [0caf815f-5f30-493d-a3ef-5da2e3871c24] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 00:25:02.800725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-796c7cfd-d6df-4105-adc8-ef5d344da452 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:02.801345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-796c7cfd-d6df-4105-adc8-ef5d344da452 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:02.808476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-796c7cfd-d6df-4105-adc8-ef5d344da452 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:02.808963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-796c7cfd-d6df-4105-adc8-ef5d344da452 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:02.809426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-796c7cfd-d6df-4105-adc8-ef5d344da452 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:02.810134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-796c7cfd-d6df-4105-adc8-ef5d344da452 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:02.810585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-796c7cfd-d6df-4105-adc8-ef5d344da452 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:02.811012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-796c7cfd-d6df-4105-adc8-ef5d344da452 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:02.950352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-796c7cfd-d6df-4105-adc8-ef5d344da452 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:02.963892 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-796c7cfd-d6df-4105-adc8-ef5d344da452 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1726 microversion: 2.1 time: 0.167371 Oct 11 00:25:02.964754 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3335/7325] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:02 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:25:03.141435 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [req-1665908c-f48a-4e5c-b7aa-3b6de24bdcd6 req-d9b92edb-702b-402e-8df2-de55c1eb6079 service nova] [0caf815f-5f30-493d-a3ef-5da2e3871c24] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 37358. Oct 11 00:25:03.154149 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-1665908c-f48a-4e5c-b7aa-3b6de24bdcd6 req-d9b92edb-702b-402e-8df2-de55c1eb6079 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.066249 Oct 11 00:25:03.154821 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3991/7326] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:25:03.995929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bc49254f-2137-42f2-961b-117e5c0ca726 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:03.996540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bc49254f-2137-42f2-961b-117e5c0ca726 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:04.003819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc49254f-2137-42f2-961b-117e5c0ca726 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:04.005034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc49254f-2137-42f2-961b-117e5c0ca726 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:04.005034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc49254f-2137-42f2-961b-117e5c0ca726 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:04.006794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc49254f-2137-42f2-961b-117e5c0ca726 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:04.006794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc49254f-2137-42f2-961b-117e5c0ca726 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:04.006794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc49254f-2137-42f2-961b-117e5c0ca726 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:04.183173 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bc49254f-2137-42f2-961b-117e5c0ca726 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:04.198260 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bc49254f-2137-42f2-961b-117e5c0ca726 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1724 microversion: 2.1 time: 0.206148 Oct 11 00:25:04.198790 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3336/7327] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:03 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:05.170211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-291c692d-42a0-4083-9c8e-991bfbd60f93 req-7cf06cf4-44bd-45cf-845b-2a6e88ce8783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16267e26-ba47-471e-8e39-4ea98f7391d9", "tag": "5f7b673c-3e6b-42ef-8a3d-419eda20e19d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:25:05.182609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-291c692d-42a0-4083-9c8e-991bfbd60f93 req-7cf06cf4-44bd-45cf-845b-2a6e88ce8783 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:05.183101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-291c692d-42a0-4083-9c8e-991bfbd60f93 req-7cf06cf4-44bd-45cf-845b-2a6e88ce8783 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:05.183545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-291c692d-42a0-4083-9c8e-991bfbd60f93 req-7cf06cf4-44bd-45cf-845b-2a6e88ce8783 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:05.195531 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-291c692d-42a0-4083-9c8e-991bfbd60f93 req-7cf06cf4-44bd-45cf-845b-2a6e88ce8783 service nova] Creating event network-changed:5f7b673c-3e6b-42ef-8a3d-419eda20e19d for instance 16267e26-ba47-471e-8e39-4ea98f7391d9 on n-h2-860864-2 Oct 11 00:25:05.200942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-291c692d-42a0-4083-9c8e-991bfbd60f93 req-7cf06cf4-44bd-45cf-845b-2a6e88ce8783 service nova] Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 00:25:05.213652 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-291c692d-42a0-4083-9c8e-991bfbd60f93 req-7cf06cf4-44bd-45cf-845b-2a6e88ce8783 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048216 Oct 11 00:25:05.214660 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3992/7328] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:25:05.223955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1986401c-ad83-4eee-835d-db1c1d85a436 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:05.224825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1986401c-ad83-4eee-835d-db1c1d85a436 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:05.232712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1986401c-ad83-4eee-835d-db1c1d85a436 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:05.233224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1986401c-ad83-4eee-835d-db1c1d85a436 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:05.233739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1986401c-ad83-4eee-835d-db1c1d85a436 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:05.235490 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1986401c-ad83-4eee-835d-db1c1d85a436 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:05.235984 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1986401c-ad83-4eee-835d-db1c1d85a436 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:05.236440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1986401c-ad83-4eee-835d-db1c1d85a436 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:05.477511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1986401c-ad83-4eee-835d-db1c1d85a436 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:05.490833 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1986401c-ad83-4eee-835d-db1c1d85a436 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1724 microversion: 2.1 time: 0.270631 Oct 11 00:25:05.493548 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3337/7329] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:05 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:06.516748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-17f1f813-2fe8-413d-b3da-fb8fd02223c6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:06.517642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-17f1f813-2fe8-413d-b3da-fb8fd02223c6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:06.519791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=33 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:25:06.525728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17f1f813-2fe8-413d-b3da-fb8fd02223c6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:06.526301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17f1f813-2fe8-413d-b3da-fb8fd02223c6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:06.526692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17f1f813-2fe8-413d-b3da-fb8fd02223c6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:06.527414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17f1f813-2fe8-413d-b3da-fb8fd02223c6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:06.527880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17f1f813-2fe8-413d-b3da-fb8fd02223c6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:06.528319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-17f1f813-2fe8-413d-b3da-fb8fd02223c6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:06.531881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:25:06.688918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-17f1f813-2fe8-413d-b3da-fb8fd02223c6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:06.697669 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-17f1f813-2fe8-413d-b3da-fb8fd02223c6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1724 microversion: 2.1 time: 0.186486 Oct 11 00:25:06.698503 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3993/7330] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:06 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:07.722480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e1fc3027-9c09-4a26-9484-ebf018a7b4fb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:07.723097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e1fc3027-9c09-4a26-9484-ebf018a7b4fb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:07.725854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=31 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:25:07.731365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1fc3027-9c09-4a26-9484-ebf018a7b4fb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:07.731868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1fc3027-9c09-4a26-9484-ebf018a7b4fb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:07.732307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1fc3027-9c09-4a26-9484-ebf018a7b4fb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:07.733018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1fc3027-9c09-4a26-9484-ebf018a7b4fb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:07.733510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1fc3027-9c09-4a26-9484-ebf018a7b4fb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:07.734034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e1fc3027-9c09-4a26-9484-ebf018a7b4fb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:07.737115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=91 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:25:07.880853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e1fc3027-9c09-4a26-9484-ebf018a7b4fb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:07.889483 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e1fc3027-9c09-4a26-9484-ebf018a7b4fb tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1724 microversion: 2.1 time: 0.171467 Oct 11 00:25:07.890626 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3338/7331] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:07 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:08.913163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9b16aaeb-1dd0-4e00-92fb-8393b226f3de tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:08.913898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9b16aaeb-1dd0-4e00-92fb-8393b226f3de tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:08.922352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b16aaeb-1dd0-4e00-92fb-8393b226f3de tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:08.922867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b16aaeb-1dd0-4e00-92fb-8393b226f3de tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:08.923378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b16aaeb-1dd0-4e00-92fb-8393b226f3de tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:08.924245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b16aaeb-1dd0-4e00-92fb-8393b226f3de tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:08.924869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b16aaeb-1dd0-4e00-92fb-8393b226f3de tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:08.925322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9b16aaeb-1dd0-4e00-92fb-8393b226f3de tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:09.157839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9b16aaeb-1dd0-4e00-92fb-8393b226f3de tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:09.166356 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9b16aaeb-1dd0-4e00-92fb-8393b226f3de tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1724 microversion: 2.1 time: 0.257161 Oct 11 00:25:09.166953 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3994/7332] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:08 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:10.190417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a664ea16-997b-42b4-872d-f538c6b162da tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:10.191024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a664ea16-997b-42b4-872d-f538c6b162da tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:10.197857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a664ea16-997b-42b4-872d-f538c6b162da tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:10.198350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a664ea16-997b-42b4-872d-f538c6b162da tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:10.198788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a664ea16-997b-42b4-872d-f538c6b162da tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:10.199493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a664ea16-997b-42b4-872d-f538c6b162da tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:10.199944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a664ea16-997b-42b4-872d-f538c6b162da tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:10.200373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a664ea16-997b-42b4-872d-f538c6b162da tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:10.339175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a664ea16-997b-42b4-872d-f538c6b162da tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:10.348504 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a664ea16-997b-42b4-872d-f538c6b162da tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1724 microversion: 2.1 time: 0.162267 Oct 11 00:25:10.349111 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3339/7333] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:10 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:11.372283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-88d9bee1-9c6f-4a4e-8193-a580782479a3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:11.372911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-88d9bee1-9c6f-4a4e-8193-a580782479a3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:11.380528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88d9bee1-9c6f-4a4e-8193-a580782479a3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:11.381030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88d9bee1-9c6f-4a4e-8193-a580782479a3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:11.381518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88d9bee1-9c6f-4a4e-8193-a580782479a3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:11.382236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88d9bee1-9c6f-4a4e-8193-a580782479a3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:11.382708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88d9bee1-9c6f-4a4e-8193-a580782479a3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:11.383151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88d9bee1-9c6f-4a4e-8193-a580782479a3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:11.518235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-88d9bee1-9c6f-4a4e-8193-a580782479a3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:11.526641 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-88d9bee1-9c6f-4a4e-8193-a580782479a3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1724 microversion: 2.1 time: 0.158335 Oct 11 00:25:11.527227 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3995/7334] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:11 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:12.550720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e077b933-a398-4b37-9a67-89b08c6d3198 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:12.551336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e077b933-a398-4b37-9a67-89b08c6d3198 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:12.558542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e077b933-a398-4b37-9a67-89b08c6d3198 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:12.559024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e077b933-a398-4b37-9a67-89b08c6d3198 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:12.559469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e077b933-a398-4b37-9a67-89b08c6d3198 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:12.560180 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e077b933-a398-4b37-9a67-89b08c6d3198 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:12.560663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e077b933-a398-4b37-9a67-89b08c6d3198 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:12.561083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e077b933-a398-4b37-9a67-89b08c6d3198 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:12.700023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e077b933-a398-4b37-9a67-89b08c6d3198 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:12.708529 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e077b933-a398-4b37-9a67-89b08c6d3198 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1724 microversion: 2.1 time: 0.162555 Oct 11 00:25:12.709115 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3340/7335] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:12 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:13.735469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b778d4c3-e080-47b8-8df6-62278967d652 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:13.736408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b778d4c3-e080-47b8-8df6-62278967d652 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:13.746912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b778d4c3-e080-47b8-8df6-62278967d652 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:13.747726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b778d4c3-e080-47b8-8df6-62278967d652 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:13.748448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b778d4c3-e080-47b8-8df6-62278967d652 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:13.750198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b778d4c3-e080-47b8-8df6-62278967d652 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:13.751076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b778d4c3-e080-47b8-8df6-62278967d652 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:13.751874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b778d4c3-e080-47b8-8df6-62278967d652 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:13.896145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b778d4c3-e080-47b8-8df6-62278967d652 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:13.908725 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b778d4c3-e080-47b8-8df6-62278967d652 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1724 microversion: 2.1 time: 0.179504 Oct 11 00:25:13.909347 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3996/7336] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:13 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:14.935619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9913061c-3872-4630-8cf3-1cfb9329c4c9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:14.936245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9913061c-3872-4630-8cf3-1cfb9329c4c9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:14.943886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9913061c-3872-4630-8cf3-1cfb9329c4c9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:14.944364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9913061c-3872-4630-8cf3-1cfb9329c4c9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:14.944790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9913061c-3872-4630-8cf3-1cfb9329c4c9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:14.945510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9913061c-3872-4630-8cf3-1cfb9329c4c9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:14.945954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9913061c-3872-4630-8cf3-1cfb9329c4c9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:14.946375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9913061c-3872-4630-8cf3-1cfb9329c4c9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:15.079508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9913061c-3872-4630-8cf3-1cfb9329c4c9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:15.087632 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9913061c-3872-4630-8cf3-1cfb9329c4c9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1724 microversion: 2.1 time: 0.157105 Oct 11 00:25:15.088206 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3341/7337] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:14 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:16.111841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a735e11d-6197-4916-ab3a-e2080c296308 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:16.112474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a735e11d-6197-4916-ab3a-e2080c296308 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:16.119446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a735e11d-6197-4916-ab3a-e2080c296308 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:16.119946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a735e11d-6197-4916-ab3a-e2080c296308 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:16.120396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a735e11d-6197-4916-ab3a-e2080c296308 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:16.121106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a735e11d-6197-4916-ab3a-e2080c296308 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:16.121609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a735e11d-6197-4916-ab3a-e2080c296308 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:16.122047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a735e11d-6197-4916-ab3a-e2080c296308 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:16.260355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a735e11d-6197-4916-ab3a-e2080c296308 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:16.269649 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a735e11d-6197-4916-ab3a-e2080c296308 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1721 microversion: 2.1 time: 0.162167 Oct 11 00:25:16.270243 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3997/7338] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:16 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:16.292932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8bc9c4c4-5e0a-4204-911a-6b2a36e242b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:25:16.293500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8bc9c4c4-5e0a-4204-911a-6b2a36e242b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:16.300658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bc9c4c4-5e0a-4204-911a-6b2a36e242b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:16.301149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bc9c4c4-5e0a-4204-911a-6b2a36e242b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:16.301619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bc9c4c4-5e0a-4204-911a-6b2a36e242b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:16.302312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bc9c4c4-5e0a-4204-911a-6b2a36e242b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:16.302768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bc9c4c4-5e0a-4204-911a-6b2a36e242b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:16.303195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bc9c4c4-5e0a-4204-911a-6b2a36e242b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:16.341324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bc9c4c4-5e0a-4204-911a-6b2a36e242b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:16.341827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bc9c4c4-5e0a-4204-911a-6b2a36e242b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:16.342261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bc9c4c4-5e0a-4204-911a-6b2a36e242b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:16.343141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bc9c4c4-5e0a-4204-911a-6b2a36e242b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:16.343571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bc9c4c4-5e0a-4204-911a-6b2a36e242b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:16.343939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8bc9c4c4-5e0a-4204-911a-6b2a36e242b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:16.364159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-8bc9c4c4-5e0a-4204-911a-6b2a36e242b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Getting quotas for project f7cd77bf414e471ebaef6c378429ce00. Resources: {'cores', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:25:16.370397 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-8bc9c4c4-5e0a-4204-911a-6b2a36e242b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Getting quotas for user a9570fd898f2441e814db0a76968d902 and project f7cd77bf414e471ebaef6c378429ce00. Resources: {'cores', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:25:16.475386 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8bc9c4c4-5e0a-4204-911a-6b2a36e242b3 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "POST /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9/action" status: 202 len: 0 microversion: 2.1 time: 0.186351 Oct 11 00:25:16.476009 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3342/7339] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:25:16 2022] POST /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 00:25:16.485676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7bf024e4-bc43-47cb-a389-444cc281d983 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:16.486320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7bf024e4-bc43-47cb-a389-444cc281d983 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:16.492415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bf024e4-bc43-47cb-a389-444cc281d983 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:16.492919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bf024e4-bc43-47cb-a389-444cc281d983 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:16.493510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bf024e4-bc43-47cb-a389-444cc281d983 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:16.494237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bf024e4-bc43-47cb-a389-444cc281d983 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:16.494732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bf024e4-bc43-47cb-a389-444cc281d983 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:16.495389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bf024e4-bc43-47cb-a389-444cc281d983 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:16.648511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7bf024e4-bc43-47cb-a389-444cc281d983 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:16.658026 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7bf024e4-bc43-47cb-a389-444cc281d983 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1720 microversion: 2.1 time: 0.177659 Oct 11 00:25:16.658823 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3998/7340] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:16 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1720 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:17.683230 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fe4279f4-bc88-40dc-b286-6f5c211c7ea7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:17.683931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fe4279f4-bc88-40dc-b286-6f5c211c7ea7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:17.692992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe4279f4-bc88-40dc-b286-6f5c211c7ea7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:17.693545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe4279f4-bc88-40dc-b286-6f5c211c7ea7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:17.693987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe4279f4-bc88-40dc-b286-6f5c211c7ea7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:17.694688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe4279f4-bc88-40dc-b286-6f5c211c7ea7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:17.695143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe4279f4-bc88-40dc-b286-6f5c211c7ea7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:17.695563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fe4279f4-bc88-40dc-b286-6f5c211c7ea7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:17.840426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fe4279f4-bc88-40dc-b286-6f5c211c7ea7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:17.849978 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fe4279f4-bc88-40dc-b286-6f5c211c7ea7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1720 microversion: 2.1 time: 0.171205 Oct 11 00:25:17.850578 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3343/7341] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:17 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:18.617944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-668686e7-4406-46c5-a1af-4db65f2c9eb1 req-c572e14e-9e86-4c1b-b4a8-fc0b289e4405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16267e26-ba47-471e-8e39-4ea98f7391d9", "name": "network-vif-plugged", "status": "completed", "tag": "5f7b673c-3e6b-42ef-8a3d-419eda20e19d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:25:18.629851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-668686e7-4406-46c5-a1af-4db65f2c9eb1 req-c572e14e-9e86-4c1b-b4a8-fc0b289e4405 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:18.630340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-668686e7-4406-46c5-a1af-4db65f2c9eb1 req-c572e14e-9e86-4c1b-b4a8-fc0b289e4405 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:18.630793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-668686e7-4406-46c5-a1af-4db65f2c9eb1 req-c572e14e-9e86-4c1b-b4a8-fc0b289e4405 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:18.644234 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-668686e7-4406-46c5-a1af-4db65f2c9eb1 req-c572e14e-9e86-4c1b-b4a8-fc0b289e4405 service nova] Creating event network-vif-plugged:5f7b673c-3e6b-42ef-8a3d-419eda20e19d for instance 16267e26-ba47-471e-8e39-4ea98f7391d9 on n-h2-860864-2 Oct 11 00:25:18.649860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-668686e7-4406-46c5-a1af-4db65f2c9eb1 req-c572e14e-9e86-4c1b-b4a8-fc0b289e4405 service nova] Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 00:25:18.662132 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-668686e7-4406-46c5-a1af-4db65f2c9eb1 req-c572e14e-9e86-4c1b-b4a8-fc0b289e4405 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048340 Oct 11 00:25:18.662763 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 3999/7342] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:25:18.873703 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-52113554-7d0b-4197-aca0-67ee045d8b68 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:18.875554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-52113554-7d0b-4197-aca0-67ee045d8b68 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:18.882706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52113554-7d0b-4197-aca0-67ee045d8b68 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:18.883195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52113554-7d0b-4197-aca0-67ee045d8b68 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:18.883624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52113554-7d0b-4197-aca0-67ee045d8b68 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:18.884317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52113554-7d0b-4197-aca0-67ee045d8b68 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:18.884764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52113554-7d0b-4197-aca0-67ee045d8b68 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:18.885182 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52113554-7d0b-4197-aca0-67ee045d8b68 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:19.028893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-52113554-7d0b-4197-aca0-67ee045d8b68 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:19.038179 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-52113554-7d0b-4197-aca0-67ee045d8b68 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1720 microversion: 2.1 time: 0.168291 Oct 11 00:25:19.038773 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3344/7343] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:18 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:20.064115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-95851f73-5cef-49ce-957a-4d76e4d4eb74 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:20.064840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-95851f73-5cef-49ce-957a-4d76e4d4eb74 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:20.071318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95851f73-5cef-49ce-957a-4d76e4d4eb74 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:20.071760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95851f73-5cef-49ce-957a-4d76e4d4eb74 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:20.072215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95851f73-5cef-49ce-957a-4d76e4d4eb74 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:20.072933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95851f73-5cef-49ce-957a-4d76e4d4eb74 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:20.073425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95851f73-5cef-49ce-957a-4d76e4d4eb74 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:20.073873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-95851f73-5cef-49ce-957a-4d76e4d4eb74 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:20.213886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-95851f73-5cef-49ce-957a-4d76e4d4eb74 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:20.226084 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-95851f73-5cef-49ce-957a-4d76e4d4eb74 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1720 microversion: 2.1 time: 0.167371 Oct 11 00:25:20.227356 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4000/7344] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:20 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:21.252892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-634e0016-d2c2-47c3-8bb9-c169b6a92386 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:21.253508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-634e0016-d2c2-47c3-8bb9-c169b6a92386 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:21.261248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-634e0016-d2c2-47c3-8bb9-c169b6a92386 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:21.261777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-634e0016-d2c2-47c3-8bb9-c169b6a92386 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:21.262217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-634e0016-d2c2-47c3-8bb9-c169b6a92386 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:21.262919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-634e0016-d2c2-47c3-8bb9-c169b6a92386 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:21.263374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-634e0016-d2c2-47c3-8bb9-c169b6a92386 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:21.263805 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-634e0016-d2c2-47c3-8bb9-c169b6a92386 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:21.424876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-634e0016-d2c2-47c3-8bb9-c169b6a92386 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:21.434264 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-634e0016-d2c2-47c3-8bb9-c169b6a92386 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1720 microversion: 2.1 time: 0.186218 Oct 11 00:25:21.434988 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3345/7345] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:21 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1720 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:22.151159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-74612133-3ff1-43e9-8b80-ffec3f3fcfdd req-10d91075-5383-4555-8a12-cde52e16143b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16267e26-ba47-471e-8e39-4ea98f7391d9", "name": "network-vif-unplugged", "status": "completed", "tag": "5f7b673c-3e6b-42ef-8a3d-419eda20e19d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:25:22.160858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-74612133-3ff1-43e9-8b80-ffec3f3fcfdd req-10d91075-5383-4555-8a12-cde52e16143b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:22.161355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-74612133-3ff1-43e9-8b80-ffec3f3fcfdd req-10d91075-5383-4555-8a12-cde52e16143b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:22.161827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-74612133-3ff1-43e9-8b80-ffec3f3fcfdd req-10d91075-5383-4555-8a12-cde52e16143b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:22.177066 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-74612133-3ff1-43e9-8b80-ffec3f3fcfdd req-10d91075-5383-4555-8a12-cde52e16143b service nova] Creating event network-vif-unplugged:5f7b673c-3e6b-42ef-8a3d-419eda20e19d for instance 16267e26-ba47-471e-8e39-4ea98f7391d9 on n-h1-860864-2 Oct 11 00:25:22.182931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-74612133-3ff1-43e9-8b80-ffec3f3fcfdd req-10d91075-5383-4555-8a12-cde52e16143b service nova] Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 00:25:22.194940 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-74612133-3ff1-43e9-8b80-ffec3f3fcfdd req-10d91075-5383-4555-8a12-cde52e16143b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102717 Oct 11 00:25:22.195748 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4001/7346] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:25:22.459846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-61036754-279b-4813-812f-78cc34bfc83e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:22.460403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-61036754-279b-4813-812f-78cc34bfc83e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:22.469590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61036754-279b-4813-812f-78cc34bfc83e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:22.470088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61036754-279b-4813-812f-78cc34bfc83e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:22.470531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61036754-279b-4813-812f-78cc34bfc83e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:22.471391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61036754-279b-4813-812f-78cc34bfc83e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:22.472012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61036754-279b-4813-812f-78cc34bfc83e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:22.472438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-61036754-279b-4813-812f-78cc34bfc83e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:22.713716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-61036754-279b-4813-812f-78cc34bfc83e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:22.723574 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-61036754-279b-4813-812f-78cc34bfc83e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1720 microversion: 2.1 time: 0.267462 Oct 11 00:25:22.724167 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3346/7347] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:22 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1720 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:23.750951 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-117453a0-0abb-4368-9bed-663e2872d761 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:23.751759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-117453a0-0abb-4368-9bed-663e2872d761 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:23.758231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-117453a0-0abb-4368-9bed-663e2872d761 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:23.758805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-117453a0-0abb-4368-9bed-663e2872d761 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:23.759340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-117453a0-0abb-4368-9bed-663e2872d761 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:23.760143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-117453a0-0abb-4368-9bed-663e2872d761 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:23.760693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-117453a0-0abb-4368-9bed-663e2872d761 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:23.761211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-117453a0-0abb-4368-9bed-663e2872d761 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:23.899655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-117453a0-0abb-4368-9bed-663e2872d761 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:23.909409 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-117453a0-0abb-4368-9bed-663e2872d761 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1720 microversion: 2.1 time: 0.163660 Oct 11 00:25:23.910074 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4002/7348] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:23 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:24.211433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-90472219-a7c0-4379-8743-937aa81deb7c req-97cfcc65-e30b-428d-a829-3952dba4be0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16267e26-ba47-471e-8e39-4ea98f7391d9", "tag": "5f7b673c-3e6b-42ef-8a3d-419eda20e19d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:25:24.222433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-90472219-a7c0-4379-8743-937aa81deb7c req-97cfcc65-e30b-428d-a829-3952dba4be0b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:24.222918 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-90472219-a7c0-4379-8743-937aa81deb7c req-97cfcc65-e30b-428d-a829-3952dba4be0b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:24.223348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-90472219-a7c0-4379-8743-937aa81deb7c req-97cfcc65-e30b-428d-a829-3952dba4be0b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:24.235376 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-90472219-a7c0-4379-8743-937aa81deb7c req-97cfcc65-e30b-428d-a829-3952dba4be0b service nova] Creating event network-changed:5f7b673c-3e6b-42ef-8a3d-419eda20e19d for instance 16267e26-ba47-471e-8e39-4ea98f7391d9 on n-h1-860864-2 Oct 11 00:25:24.241825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [req-90472219-a7c0-4379-8743-937aa81deb7c req-97cfcc65-e30b-428d-a829-3952dba4be0b service nova] Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 00:25:24.253997 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-90472219-a7c0-4379-8743-937aa81deb7c req-97cfcc65-e30b-428d-a829-3952dba4be0b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046072 Oct 11 00:25:24.254617 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3347/7349] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:25:24.933024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ab879795-8122-47e6-b1f4-325c15dfdaaa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:24.933682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ab879795-8122-47e6-b1f4-325c15dfdaaa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:24.941051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab879795-8122-47e6-b1f4-325c15dfdaaa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:24.941618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab879795-8122-47e6-b1f4-325c15dfdaaa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:24.942139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab879795-8122-47e6-b1f4-325c15dfdaaa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:24.942944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab879795-8122-47e6-b1f4-325c15dfdaaa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:24.943473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab879795-8122-47e6-b1f4-325c15dfdaaa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:24.943914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ab879795-8122-47e6-b1f4-325c15dfdaaa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:25.086787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ab879795-8122-47e6-b1f4-325c15dfdaaa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:25.096539 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ab879795-8122-47e6-b1f4-325c15dfdaaa tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1720 microversion: 2.1 time: 0.167517 Oct 11 00:25:25.097146 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4003/7350] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:24 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:26.121066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-39779756-047a-45a3-aaeb-3d56ba377b3e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:26.121794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-39779756-047a-45a3-aaeb-3d56ba377b3e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:26.129483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-39779756-047a-45a3-aaeb-3d56ba377b3e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:26.129978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-39779756-047a-45a3-aaeb-3d56ba377b3e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:26.130481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-39779756-047a-45a3-aaeb-3d56ba377b3e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:26.131362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-39779756-047a-45a3-aaeb-3d56ba377b3e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:26.131831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-39779756-047a-45a3-aaeb-3d56ba377b3e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:26.132338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-39779756-047a-45a3-aaeb-3d56ba377b3e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:26.353797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:25:26.360733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-39779756-047a-45a3-aaeb-3d56ba377b3e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:26.370064 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-39779756-047a-45a3-aaeb-3d56ba377b3e tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1720 microversion: 2.1 time: 0.253358 Oct 11 00:25:26.370668 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3348/7351] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:26 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1720 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:27.394694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-50a76273-88b8-4dd9-bd7e-1daf31e070c5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:27.395326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-50a76273-88b8-4dd9-bd7e-1daf31e070c5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:27.402486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50a76273-88b8-4dd9-bd7e-1daf31e070c5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:27.402992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50a76273-88b8-4dd9-bd7e-1daf31e070c5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:27.403449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50a76273-88b8-4dd9-bd7e-1daf31e070c5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:27.404175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50a76273-88b8-4dd9-bd7e-1daf31e070c5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:27.404647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50a76273-88b8-4dd9-bd7e-1daf31e070c5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:27.405623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50a76273-88b8-4dd9-bd7e-1daf31e070c5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:27.548133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-50a76273-88b8-4dd9-bd7e-1daf31e070c5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:27.556880 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-50a76273-88b8-4dd9-bd7e-1daf31e070c5 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1720 microversion: 2.1 time: 0.166115 Oct 11 00:25:27.557483 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4004/7352] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:27 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:28.581531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f364ca96-8319-4832-a29a-2f2055627be4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:28.582110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f364ca96-8319-4832-a29a-2f2055627be4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:28.588854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f364ca96-8319-4832-a29a-2f2055627be4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:28.589333 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f364ca96-8319-4832-a29a-2f2055627be4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:28.589802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f364ca96-8319-4832-a29a-2f2055627be4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:28.590478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f364ca96-8319-4832-a29a-2f2055627be4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:28.590923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f364ca96-8319-4832-a29a-2f2055627be4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:28.591343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f364ca96-8319-4832-a29a-2f2055627be4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:28.722856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f364ca96-8319-4832-a29a-2f2055627be4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:28.731129 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f364ca96-8319-4832-a29a-2f2055627be4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1720 microversion: 2.1 time: 0.154572 Oct 11 00:25:28.731701 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3349/7353] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:28 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:29.757664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3f1e92a5-d44f-453f-aef8-edb119067aae tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:29.758303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3f1e92a5-d44f-453f-aef8-edb119067aae tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:29.765208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f1e92a5-d44f-453f-aef8-edb119067aae tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:29.765732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f1e92a5-d44f-453f-aef8-edb119067aae tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:29.766187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f1e92a5-d44f-453f-aef8-edb119067aae tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:29.766888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f1e92a5-d44f-453f-aef8-edb119067aae tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:29.767356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f1e92a5-d44f-453f-aef8-edb119067aae tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:29.767797 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f1e92a5-d44f-453f-aef8-edb119067aae tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:29.900973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3f1e92a5-d44f-453f-aef8-edb119067aae tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:29.910830 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3f1e92a5-d44f-453f-aef8-edb119067aae tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1720 microversion: 2.1 time: 0.157135 Oct 11 00:25:29.911430 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4005/7354] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:29 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:30.997083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-105b1941-edd9-43bb-a279-0397b786d4e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:30.997720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-105b1941-edd9-43bb-a279-0397b786d4e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:31.008125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-105b1941-edd9-43bb-a279-0397b786d4e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:31.008951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-105b1941-edd9-43bb-a279-0397b786d4e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:31.009648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-105b1941-edd9-43bb-a279-0397b786d4e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:31.010589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-105b1941-edd9-43bb-a279-0397b786d4e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:31.011171 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-105b1941-edd9-43bb-a279-0397b786d4e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:31.011704 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-105b1941-edd9-43bb-a279-0397b786d4e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:31.166822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-105b1941-edd9-43bb-a279-0397b786d4e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:31.180423 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-105b1941-edd9-43bb-a279-0397b786d4e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1720 microversion: 2.1 time: 0.187310 Oct 11 00:25:31.181014 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3350/7355] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:30 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1720 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:32.204867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-01c37490-d643-4852-9481-d4be01583f73 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:32.205724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-01c37490-d643-4852-9481-d4be01583f73 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:32.212789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01c37490-d643-4852-9481-d4be01583f73 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:32.213296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01c37490-d643-4852-9481-d4be01583f73 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:32.213764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01c37490-d643-4852-9481-d4be01583f73 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:32.214467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01c37490-d643-4852-9481-d4be01583f73 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:32.214935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01c37490-d643-4852-9481-d4be01583f73 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:32.215377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01c37490-d643-4852-9481-d4be01583f73 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:32.347248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-01c37490-d643-4852-9481-d4be01583f73 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:32.355735 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-01c37490-d643-4852-9481-d4be01583f73 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1720 microversion: 2.1 time: 0.155382 Oct 11 00:25:32.356316 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4006/7356] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:32 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:33.379218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-03341706-ec4f-496e-a077-6926392f5962 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:33.379868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-03341706-ec4f-496e-a077-6926392f5962 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:33.386960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03341706-ec4f-496e-a077-6926392f5962 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:33.387450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03341706-ec4f-496e-a077-6926392f5962 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:33.387888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03341706-ec4f-496e-a077-6926392f5962 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:33.388588 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03341706-ec4f-496e-a077-6926392f5962 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:33.389042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03341706-ec4f-496e-a077-6926392f5962 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:33.389508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03341706-ec4f-496e-a077-6926392f5962 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:33.528478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-03341706-ec4f-496e-a077-6926392f5962 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:33.540820 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-03341706-ec4f-496e-a077-6926392f5962 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1720 microversion: 2.1 time: 0.165854 Oct 11 00:25:33.541687 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3351/7357] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:33 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:34.569160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-101de5e1-6184-4391-b2ec-a64e1ae5de70 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:34.569837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-101de5e1-6184-4391-b2ec-a64e1ae5de70 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:34.576742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-101de5e1-6184-4391-b2ec-a64e1ae5de70 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:34.577245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-101de5e1-6184-4391-b2ec-a64e1ae5de70 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:34.577750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-101de5e1-6184-4391-b2ec-a64e1ae5de70 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:34.578465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-101de5e1-6184-4391-b2ec-a64e1ae5de70 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:34.578943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-101de5e1-6184-4391-b2ec-a64e1ae5de70 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:34.579724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-101de5e1-6184-4391-b2ec-a64e1ae5de70 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:34.716588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-101de5e1-6184-4391-b2ec-a64e1ae5de70 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:34.725642 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-101de5e1-6184-4391-b2ec-a64e1ae5de70 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1720 microversion: 2.1 time: 0.160416 Oct 11 00:25:34.726243 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4007/7358] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:34 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:35.751824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4019275c-b597-4560-9b21-4d88c4bc32e0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:35.752562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4019275c-b597-4560-9b21-4d88c4bc32e0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:35.759848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4019275c-b597-4560-9b21-4d88c4bc32e0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:35.760338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4019275c-b597-4560-9b21-4d88c4bc32e0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:35.760775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4019275c-b597-4560-9b21-4d88c4bc32e0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:35.761512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4019275c-b597-4560-9b21-4d88c4bc32e0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:35.761969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4019275c-b597-4560-9b21-4d88c4bc32e0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:35.762395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4019275c-b597-4560-9b21-4d88c4bc32e0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:35.765097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:25:35.904059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4019275c-b597-4560-9b21-4d88c4bc32e0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:35.913707 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4019275c-b597-4560-9b21-4d88c4bc32e0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1720 microversion: 2.1 time: 0.166346 Oct 11 00:25:35.914445 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3352/7359] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:35 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:36.938591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a24919b5-4de2-4bf6-ba4f-72fbd40b33e6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:36.939679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a24919b5-4de2-4bf6-ba4f-72fbd40b33e6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:36.942714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=30 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:25:36.948234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a24919b5-4de2-4bf6-ba4f-72fbd40b33e6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:36.948729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a24919b5-4de2-4bf6-ba4f-72fbd40b33e6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:36.949177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a24919b5-4de2-4bf6-ba4f-72fbd40b33e6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:36.949917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a24919b5-4de2-4bf6-ba4f-72fbd40b33e6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:36.950387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a24919b5-4de2-4bf6-ba4f-72fbd40b33e6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:36.950825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a24919b5-4de2-4bf6-ba4f-72fbd40b33e6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:36.953394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=86 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:25:37.087188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a24919b5-4de2-4bf6-ba4f-72fbd40b33e6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:37.095769 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a24919b5-4de2-4bf6-ba4f-72fbd40b33e6 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1713 microversion: 2.1 time: 0.161075 Oct 11 00:25:37.096348 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4008/7360] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:36 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1713 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:37.117993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-967d7cd3-ec80-4a7d-be02-1a63713d1da7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:37.118615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-967d7cd3-ec80-4a7d-be02-1a63713d1da7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:37.125400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-967d7cd3-ec80-4a7d-be02-1a63713d1da7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:37.126423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-967d7cd3-ec80-4a7d-be02-1a63713d1da7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:37.126935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-967d7cd3-ec80-4a7d-be02-1a63713d1da7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:37.127579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-967d7cd3-ec80-4a7d-be02-1a63713d1da7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:37.128029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-967d7cd3-ec80-4a7d-be02-1a63713d1da7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:37.128452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-967d7cd3-ec80-4a7d-be02-1a63713d1da7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:37.256431 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-967d7cd3-ec80-4a7d-be02-1a63713d1da7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:37.264697 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-967d7cd3-ec80-4a7d-be02-1a63713d1da7 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1713 microversion: 2.1 time: 0.150588 Oct 11 00:25:37.265269 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3353/7361] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:37 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1713 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:25:37.288316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-31af1d81-60b5-4227-b6ff-57135c3b5056 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:37.288957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-31af1d81-60b5-4227-b6ff-57135c3b5056 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:37.295360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-31af1d81-60b5-4227-b6ff-57135c3b5056 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:37.295867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-31af1d81-60b5-4227-b6ff-57135c3b5056 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:37.296353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-31af1d81-60b5-4227-b6ff-57135c3b5056 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:37.297071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-31af1d81-60b5-4227-b6ff-57135c3b5056 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:37.297580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-31af1d81-60b5-4227-b6ff-57135c3b5056 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:37.298034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-31af1d81-60b5-4227-b6ff-57135c3b5056 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:37.433278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-31af1d81-60b5-4227-b6ff-57135c3b5056 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:37.442752 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-31af1d81-60b5-4227-b6ff-57135c3b5056 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1713 microversion: 2.1 time: 0.158408 Oct 11 00:25:37.443336 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4009/7362] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:37 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1713 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:37.464965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-34c686a6-ec2d-486c-9de5-f659e8d61323 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:37.465492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-34c686a6-ec2d-486c-9de5-f659e8d61323 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:37.471694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34c686a6-ec2d-486c-9de5-f659e8d61323 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:37.472179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34c686a6-ec2d-486c-9de5-f659e8d61323 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:37.472617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34c686a6-ec2d-486c-9de5-f659e8d61323 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:37.473314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34c686a6-ec2d-486c-9de5-f659e8d61323 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:37.473804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34c686a6-ec2d-486c-9de5-f659e8d61323 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:37.474232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-34c686a6-ec2d-486c-9de5-f659e8d61323 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:37.499823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-34c686a6-ec2d-486c-9de5-f659e8d61323 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:25:37.580401 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-34c686a6-ec2d-486c-9de5-f659e8d61323 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "DELETE /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 204 len: 0 microversion: 2.1 time: 0.118102 Oct 11 00:25:37.581359 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3354/7363] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:25:37 2022] DELETE /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:25:37.590277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a1576cb6-6a7a-44c6-b37d-a4fbd82ff99c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:37.590917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a1576cb6-6a7a-44c6-b37d-a4fbd82ff99c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:37.597974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1576cb6-6a7a-44c6-b37d-a4fbd82ff99c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:37.598480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1576cb6-6a7a-44c6-b37d-a4fbd82ff99c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:37.598936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1576cb6-6a7a-44c6-b37d-a4fbd82ff99c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:37.599647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1576cb6-6a7a-44c6-b37d-a4fbd82ff99c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:37.600117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1576cb6-6a7a-44c6-b37d-a4fbd82ff99c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:37.600584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a1576cb6-6a7a-44c6-b37d-a4fbd82ff99c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:37.733454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a1576cb6-6a7a-44c6-b37d-a4fbd82ff99c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:37.742607 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a1576cb6-6a7a-44c6-b37d-a4fbd82ff99c tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1719 microversion: 2.1 time: 0.156358 Oct 11 00:25:37.743207 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4010/7364] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:37 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:38.767713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-79aab3d2-99a4-4952-86d3-dda5791fc3f4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:38.768308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-79aab3d2-99a4-4952-86d3-dda5791fc3f4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:38.774211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:25:38.776104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79aab3d2-99a4-4952-86d3-dda5791fc3f4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:38.776652 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79aab3d2-99a4-4952-86d3-dda5791fc3f4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:38.777913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79aab3d2-99a4-4952-86d3-dda5791fc3f4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:38.777913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79aab3d2-99a4-4952-86d3-dda5791fc3f4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:38.778261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79aab3d2-99a4-4952-86d3-dda5791fc3f4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:38.778680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-79aab3d2-99a4-4952-86d3-dda5791fc3f4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:38.930861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-79aab3d2-99a4-4952-86d3-dda5791fc3f4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:38.941583 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-79aab3d2-99a4-4952-86d3-dda5791fc3f4 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1719 microversion: 2.1 time: 0.178682 Oct 11 00:25:38.942641 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3355/7365] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:38 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1719 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:39.968450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e78fab76-1311-442f-8633-268b9f3f6bb1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:39.973908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e78fab76-1311-442f-8633-268b9f3f6bb1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:39.981760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e78fab76-1311-442f-8633-268b9f3f6bb1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:39.982371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e78fab76-1311-442f-8633-268b9f3f6bb1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:39.984899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e78fab76-1311-442f-8633-268b9f3f6bb1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:39.984899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e78fab76-1311-442f-8633-268b9f3f6bb1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:39.984899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e78fab76-1311-442f-8633-268b9f3f6bb1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:39.984899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e78fab76-1311-442f-8633-268b9f3f6bb1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:40.056189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e78fab76-1311-442f-8633-268b9f3f6bb1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:40.065853 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e78fab76-1311-442f-8633-268b9f3f6bb1 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1652 microversion: 2.1 time: 0.102030 Oct 11 00:25:40.066319 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4011/7366] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:39 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1652 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:40.121397 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-76d10796-67e1-49c1-8ee4-88a041d244f8 req-e0ec71d4-a082-4983-a7ec-2dbc6c1391b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16267e26-ba47-471e-8e39-4ea98f7391d9", "name": "network-vif-deleted", "tag": "5f7b673c-3e6b-42ef-8a3d-419eda20e19d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:25:40.131488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-76d10796-67e1-49c1-8ee4-88a041d244f8 req-e0ec71d4-a082-4983-a7ec-2dbc6c1391b9 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:40.131972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-76d10796-67e1-49c1-8ee4-88a041d244f8 req-e0ec71d4-a082-4983-a7ec-2dbc6c1391b9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:40.132426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-76d10796-67e1-49c1-8ee4-88a041d244f8 req-e0ec71d4-a082-4983-a7ec-2dbc6c1391b9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:40.144358 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-76d10796-67e1-49c1-8ee4-88a041d244f8 req-e0ec71d4-a082-4983-a7ec-2dbc6c1391b9 service nova] Creating event network-vif-deleted:5f7b673c-3e6b-42ef-8a3d-419eda20e19d for instance 16267e26-ba47-471e-8e39-4ea98f7391d9 on n-h1-860864-2 Oct 11 00:25:40.149555 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-76d10796-67e1-49c1-8ee4-88a041d244f8 req-e0ec71d4-a082-4983-a7ec-2dbc6c1391b9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031895 Oct 11 00:25:40.150282 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3356/7367] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:25:41.090155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a35aa179-81c8-47d3-a848-39e902d99855 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:41.091404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a35aa179-81c8-47d3-a848-39e902d99855 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:41.099563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a35aa179-81c8-47d3-a848-39e902d99855 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:41.100106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a35aa179-81c8-47d3-a848-39e902d99855 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:41.100610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a35aa179-81c8-47d3-a848-39e902d99855 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:41.101288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a35aa179-81c8-47d3-a848-39e902d99855 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:41.102087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a35aa179-81c8-47d3-a848-39e902d99855 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:41.102526 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a35aa179-81c8-47d3-a848-39e902d99855 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:41.181665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a35aa179-81c8-47d3-a848-39e902d99855 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:41.190402 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a35aa179-81c8-47d3-a848-39e902d99855 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1369 microversion: 2.1 time: 0.104157 Oct 11 00:25:41.190991 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4012/7368] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:41 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:42.215118 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2fb40787-6793-4b76-8c22-4f66e4eb7b0a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:42.215887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2fb40787-6793-4b76-8c22-4f66e4eb7b0a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:42.222593 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fb40787-6793-4b76-8c22-4f66e4eb7b0a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:42.223090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fb40787-6793-4b76-8c22-4f66e4eb7b0a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:42.223548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fb40787-6793-4b76-8c22-4f66e4eb7b0a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:42.224250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fb40787-6793-4b76-8c22-4f66e4eb7b0a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:42.224701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fb40787-6793-4b76-8c22-4f66e4eb7b0a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:42.225132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2fb40787-6793-4b76-8c22-4f66e4eb7b0a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:42.290288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2fb40787-6793-4b76-8c22-4f66e4eb7b0a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:42.299749 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2fb40787-6793-4b76-8c22-4f66e4eb7b0a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1369 microversion: 2.1 time: 0.089808 Oct 11 00:25:42.300365 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3357/7369] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:42 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:43.324116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6c58d026-4e92-4067-92df-2e017eb622ac tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:43.324788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6c58d026-4e92-4067-92df-2e017eb622ac tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:43.332301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c58d026-4e92-4067-92df-2e017eb622ac tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:43.332805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c58d026-4e92-4067-92df-2e017eb622ac tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:43.333256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c58d026-4e92-4067-92df-2e017eb622ac tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:43.334009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c58d026-4e92-4067-92df-2e017eb622ac tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:43.334477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c58d026-4e92-4067-92df-2e017eb622ac tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:43.334922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6c58d026-4e92-4067-92df-2e017eb622ac tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:43.401654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6c58d026-4e92-4067-92df-2e017eb622ac tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:43.411589 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6c58d026-4e92-4067-92df-2e017eb622ac tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1369 microversion: 2.1 time: 0.091324 Oct 11 00:25:43.412185 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4013/7370] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:43 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:44.435910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e3073878-812d-4a5f-b87e-5c13708809e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:44.436596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e3073878-812d-4a5f-b87e-5c13708809e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:44.444162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3073878-812d-4a5f-b87e-5c13708809e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:44.444645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3073878-812d-4a5f-b87e-5c13708809e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:44.445083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3073878-812d-4a5f-b87e-5c13708809e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:44.445806 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3073878-812d-4a5f-b87e-5c13708809e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:44.446261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3073878-812d-4a5f-b87e-5c13708809e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:44.446688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3073878-812d-4a5f-b87e-5c13708809e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:44.480542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3073878-812d-4a5f-b87e-5c13708809e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:44.481028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3073878-812d-4a5f-b87e-5c13708809e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:44.481497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3073878-812d-4a5f-b87e-5c13708809e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:44.481955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-e3073878-812d-4a5f-b87e-5c13708809e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lazy-loading 'fault' on Instance uuid 16267e26-ba47-471e-8e39-4ea98f7391d9 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:25:44.522858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e3073878-812d-4a5f-b87e-5c13708809e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9570fd898f2441e814db0a76968d902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cd77bf414e471ebaef6c378429ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:25:44.531202 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e3073878-812d-4a5f-b87e-5c13708809e8 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 200 len: 1374 microversion: 2.1 time: 0.099293 Oct 11 00:25:44.531779 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3358/7371] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:44 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 1374 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:25:45.556217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f4b54245-83b7-4da9-be4b-53c0c5bc588a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:45.556888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f4b54245-83b7-4da9-be4b-53c0c5bc588a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:45.564511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4b54245-83b7-4da9-be4b-53c0c5bc588a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:45.565026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4b54245-83b7-4da9-be4b-53c0c5bc588a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:45.565583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4b54245-83b7-4da9-be4b-53c0c5bc588a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:45.566315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4b54245-83b7-4da9-be4b-53c0c5bc588a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:45.566793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4b54245-83b7-4da9-be4b-53c0c5bc588a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:45.567242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4b54245-83b7-4da9-be4b-53c0c5bc588a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:45.585339 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-f4b54245-83b7-4da9-be4b-53c0c5bc588a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] HTTP exception thrown: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f4b54245-83b7-4da9-be4b-53c0c5bc588a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Request method failure captured: Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 HTTP/1.1 Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLZxfLc8Q7Icn9DecaGe5gcChOHeFqpqEXkmJ2LBp2kaQghRPSuL_6yNQKoNJrZLgbTTr8mxh5HHn7k6cnYW1dBqXduwGRSIKp1_hC3HFPdzua2afeL-3QExGQACpymRN5ysngyDUJc_A6H1lS2CdmxbOx6trU-c0z1aLDt5QVmHkl4 Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f7cd77bf414e471ebaef6c378429ce00", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a9570fd898f2441e814db0a76968d902 Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '16267e26-ba47-471e-8e39-4ea98f7391d9'} Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:25:45.587083 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:45.593088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:45.593088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:25:45.593088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:25:45.593088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:25:45.593088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:25:45.593088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. Oct 11 00:25:45.593088 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:45.593088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f4b54245-83b7-4da9-be4b-53c0c5bc588a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Returning 404 to user: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:25:45.593088 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f4b54245-83b7-4da9-be4b-53c0c5bc588a tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 404 len: 111 microversion: 2.1 time: 0.036592 Oct 11 00:25:45.593088 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4014/7372] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:45 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:25:45.652446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d600ccac-7707-41c2-812f-5945fa1c46f0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:45.654666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d600ccac-7707-41c2-812f-5945fa1c46f0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:45.661830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d600ccac-7707-41c2-812f-5945fa1c46f0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:45.662321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d600ccac-7707-41c2-812f-5945fa1c46f0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:45.662871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d600ccac-7707-41c2-812f-5945fa1c46f0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:45.663454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d600ccac-7707-41c2-812f-5945fa1c46f0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:45.663907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d600ccac-7707-41c2-812f-5945fa1c46f0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:45.664330 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d600ccac-7707-41c2-812f-5945fa1c46f0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:45.679328 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-d600ccac-7707-41c2-812f-5945fa1c46f0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] HTTP exception thrown: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d600ccac-7707-41c2-812f-5945fa1c46f0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Request method failure captured: Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9/os-volume_attachments HTTP/1.1 Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLZxfLc8Q7Icn9DecaGe5gcChOHeFqpqEXkmJ2LBp2kaQghRPSuL_6yNQKoNJrZLgbTTr8mxh5HHn7k6cnYW1dBqXduwGRSIKp1_hC3HFPdzua2afeL-3QExGQACpymRN5ysngyDUJc_A6H1lS2CdmxbOx6trU-c0z1aLDt5QVmHkl4 Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f7cd77bf414e471ebaef6c378429ce00", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: a9570fd898f2441e814db0a76968d902 Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'server_id': '16267e26-ba47-471e-8e39-4ea98f7391d9'} Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:25:45.681297 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:25:45.685326 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. Oct 11 00:25:45.685326 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:45.685326 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:25:45.685326 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:45.685326 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:45.685326 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:25:45.685326 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:25:45.685326 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:25:45.685326 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:25:45.685326 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. Oct 11 00:25:45.685326 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:45.685326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d600ccac-7707-41c2-812f-5945fa1c46f0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Returning 404 to user: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:25:45.685326 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d600ccac-7707-41c2-812f-5945fa1c46f0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034476 Oct 11 00:25:45.685326 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3359/7373] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:25:45 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:25:49.029740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-792867ce-e82d-4e7e-93b1-cb1167c7f22d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:49.030256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-792867ce-e82d-4e7e-93b1-cb1167c7f22d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:49.037783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-792867ce-e82d-4e7e-93b1-cb1167c7f22d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:49.038280 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-792867ce-e82d-4e7e-93b1-cb1167c7f22d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:49.038731 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-792867ce-e82d-4e7e-93b1-cb1167c7f22d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:49.039484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-792867ce-e82d-4e7e-93b1-cb1167c7f22d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:49.039900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-792867ce-e82d-4e7e-93b1-cb1167c7f22d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:49.040341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-792867ce-e82d-4e7e-93b1-cb1167c7f22d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:49.055410 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-792867ce-e82d-4e7e-93b1-cb1167c7f22d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] HTTP exception thrown: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-792867ce-e82d-4e7e-93b1-cb1167c7f22d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Request method failure captured: Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 HTTP/1.1 Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLZxfLc8Q7Icn9DecaGe5gcChOHeFqpqEXkmJ2LBp2kaQghRPSuL_6yNQKoNJrZLgbTTr8mxh5HHn7k6cnYW1dBqXduwGRSIKp1_hC3HFPdzua2afeL-3QExGQACpymRN5ysngyDUJc_A6H1lS2CdmxbOx6trU-c0z1aLDt5QVmHkl4 Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f7cd77bf414e471ebaef6c378429ce00", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a9570fd898f2441e814db0a76968d902 Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '16267e26-ba47-471e-8e39-4ea98f7391d9'} Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:25:49.056980 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:25:49.061098 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. Oct 11 00:25:49.061098 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.061098 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:25:49.061098 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.061098 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.061098 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:25:49.061098 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:25:49.061098 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:25:49.061098 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:25:49.061098 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. Oct 11 00:25:49.061098 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.061098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-792867ce-e82d-4e7e-93b1-cb1167c7f22d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Returning 404 to user: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:25:49.061098 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-792867ce-e82d-4e7e-93b1-cb1167c7f22d tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "DELETE /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 404 len: 111 microversion: 2.1 time: 0.032713 Oct 11 00:25:49.061098 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4015/7374] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:25:49 2022] DELETE /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:25:49.067756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e576858b-af15-4f30-b37a-3796794bf57b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:49.068367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e576858b-af15-4f30-b37a-3796794bf57b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 16267e26-ba47-471e-8e39-4ea98f7391d9] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:49.075053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e576858b-af15-4f30-b37a-3796794bf57b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:49.075533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e576858b-af15-4f30-b37a-3796794bf57b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:49.075971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e576858b-af15-4f30-b37a-3796794bf57b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:49.076653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e576858b-af15-4f30-b37a-3796794bf57b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:49.077104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e576858b-af15-4f30-b37a-3796794bf57b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:49.077567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e576858b-af15-4f30-b37a-3796794bf57b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:49.091668 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-e576858b-af15-4f30-b37a-3796794bf57b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] HTTP exception thrown: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e576858b-af15-4f30-b37a-3796794bf57b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Request method failure captured: Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 HTTP/1.1 Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLZxfLc8Q7Icn9DecaGe5gcChOHeFqpqEXkmJ2LBp2kaQghRPSuL_6yNQKoNJrZLgbTTr8mxh5HHn7k6cnYW1dBqXduwGRSIKp1_hC3HFPdzua2afeL-3QExGQACpymRN5ysngyDUJc_A6H1lS2CdmxbOx6trU-c0z1aLDt5QVmHkl4 Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f7cd77bf414e471ebaef6c378429ce00", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: a9570fd898f2441e814db0a76968d902 Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '16267e26-ba47-471e-8e39-4ea98f7391d9'} Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:25:49.093182 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.098151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.098151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:25:49.098151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:25:49.098151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:25:49.098151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:25:49.098151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. Oct 11 00:25:49.098151 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.098151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e576858b-af15-4f30-b37a-3796794bf57b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Returning 404 to user: Instance 16267e26-ba47-471e-8e39-4ea98f7391d9 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:25:49.098151 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e576858b-af15-4f30-b37a-3796794bf57b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9" status: 404 len: 111 microversion: 2.1 time: 0.031546 Oct 11 00:25:49.098151 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3360/7375] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:49 2022] GET /compute/v2.1/servers/16267e26-ba47-471e-8e39-4ea98f7391d9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:25:49.104715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f8c1fa24-c13c-4eb8-bfcb-4bbd9928fe02 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:49.105250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f8c1fa24-c13c-4eb8-bfcb-4bbd9928fe02 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:49.112475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8c1fa24-c13c-4eb8-bfcb-4bbd9928fe02 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:49.112997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8c1fa24-c13c-4eb8-bfcb-4bbd9928fe02 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:49.113487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8c1fa24-c13c-4eb8-bfcb-4bbd9928fe02 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:49.114228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8c1fa24-c13c-4eb8-bfcb-4bbd9928fe02 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:49.114710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8c1fa24-c13c-4eb8-bfcb-4bbd9928fe02 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:49.115164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f8c1fa24-c13c-4eb8-bfcb-4bbd9928fe02 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:49.130573 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-f8c1fa24-c13c-4eb8-bfcb-4bbd9928fe02 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] HTTP exception thrown: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f8c1fa24-c13c-4eb8-bfcb-4bbd9928fe02 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Request method failure captured: Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde HTTP/1.1 Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLZxfLc8Q7Icn9DecaGe5gcChOHeFqpqEXkmJ2LBp2kaQghRPSuL_6yNQKoNJrZLgbTTr8mxh5HHn7k6cnYW1dBqXduwGRSIKp1_hC3HFPdzua2afeL-3QExGQACpymRN5ysngyDUJc_A6H1lS2CdmxbOx6trU-c0z1aLDt5QVmHkl4 Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f7cd77bf414e471ebaef6c378429ce00", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a9570fd898f2441e814db0a76968d902 Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '6ef186d9-0b84-4c5a-ab3e-00ce60822cde'} Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:25:49.132204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:25:49.136393 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. Oct 11 00:25:49.136393 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.136393 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:25:49.136393 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.136393 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.136393 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:25:49.136393 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:25:49.136393 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:25:49.136393 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:25:49.136393 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. Oct 11 00:25:49.136393 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.136393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f8c1fa24-c13c-4eb8-bfcb-4bbd9928fe02 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Returning 404 to user: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:25:49.136393 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f8c1fa24-c13c-4eb8-bfcb-4bbd9928fe02 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 404 len: 111 microversion: 2.1 time: 0.033072 Oct 11 00:25:49.137681 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4016/7376] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:25:49 2022] DELETE /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:25:49.143122 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0ed8dfaa-26df-4ec9-833f-65003866f0d0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:49.143853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0ed8dfaa-26df-4ec9-833f-65003866f0d0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 6ef186d9-0b84-4c5a-ab3e-00ce60822cde] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:49.150335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ed8dfaa-26df-4ec9-833f-65003866f0d0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:49.150924 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ed8dfaa-26df-4ec9-833f-65003866f0d0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:49.151440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ed8dfaa-26df-4ec9-833f-65003866f0d0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:49.152236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ed8dfaa-26df-4ec9-833f-65003866f0d0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:49.152789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ed8dfaa-26df-4ec9-833f-65003866f0d0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:49.153288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0ed8dfaa-26df-4ec9-833f-65003866f0d0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:49.168568 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-0ed8dfaa-26df-4ec9-833f-65003866f0d0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] HTTP exception thrown: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0ed8dfaa-26df-4ec9-833f-65003866f0d0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Request method failure captured: Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde HTTP/1.1 Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLZxfLc8Q7Icn9DecaGe5gcChOHeFqpqEXkmJ2LBp2kaQghRPSuL_6yNQKoNJrZLgbTTr8mxh5HHn7k6cnYW1dBqXduwGRSIKp1_hC3HFPdzua2afeL-3QExGQACpymRN5ysngyDUJc_A6H1lS2CdmxbOx6trU-c0z1aLDt5QVmHkl4 Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f7cd77bf414e471ebaef6c378429ce00", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: a9570fd898f2441e814db0a76968d902 Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '6ef186d9-0b84-4c5a-ab3e-00ce60822cde'} Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:25:49.170158 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.175254 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.175254 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:25:49.175254 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:25:49.175254 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:25:49.175254 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:25:49.175254 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. Oct 11 00:25:49.175254 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.175254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0ed8dfaa-26df-4ec9-833f-65003866f0d0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Returning 404 to user: Instance 6ef186d9-0b84-4c5a-ab3e-00ce60822cde could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:25:49.175254 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0ed8dfaa-26df-4ec9-833f-65003866f0d0 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde" status: 404 len: 111 microversion: 2.1 time: 0.032800 Oct 11 00:25:49.176349 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3361/7377] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:49 2022] GET /compute/v2.1/servers/6ef186d9-0b84-4c5a-ab3e-00ce60822cde => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:25:49.182054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-18dc8eb0-2e2a-4c52-b9cc-d5b748e7dfb9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:49.182054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-18dc8eb0-2e2a-4c52-b9cc-d5b748e7dfb9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:49.188321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18dc8eb0-2e2a-4c52-b9cc-d5b748e7dfb9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:49.188830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18dc8eb0-2e2a-4c52-b9cc-d5b748e7dfb9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:49.189480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18dc8eb0-2e2a-4c52-b9cc-d5b748e7dfb9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:49.190199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18dc8eb0-2e2a-4c52-b9cc-d5b748e7dfb9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:49.190810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18dc8eb0-2e2a-4c52-b9cc-d5b748e7dfb9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:49.191256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18dc8eb0-2e2a-4c52-b9cc-d5b748e7dfb9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:49.205115 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-18dc8eb0-2e2a-4c52-b9cc-d5b748e7dfb9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] HTTP exception thrown: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-18dc8eb0-2e2a-4c52-b9cc-d5b748e7dfb9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Request method failure captured: Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 HTTP/1.1 Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLZxfLc8Q7Icn9DecaGe5gcChOHeFqpqEXkmJ2LBp2kaQghRPSuL_6yNQKoNJrZLgbTTr8mxh5HHn7k6cnYW1dBqXduwGRSIKp1_hC3HFPdzua2afeL-3QExGQACpymRN5ysngyDUJc_A6H1lS2CdmxbOx6trU-c0z1aLDt5QVmHkl4 Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f7cd77bf414e471ebaef6c378429ce00", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a9570fd898f2441e814db0a76968d902 Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '7a715295-b7cf-48df-a5e1-c7404ae94e70'} Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:25:49.206716 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:25:49.213620 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. Oct 11 00:25:49.213620 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.213620 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:25:49.213620 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.213620 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.213620 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:25:49.213620 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:25:49.213620 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:25:49.213620 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:25:49.213620 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. Oct 11 00:25:49.213620 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.213620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-18dc8eb0-2e2a-4c52-b9cc-d5b748e7dfb9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Returning 404 to user: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:25:49.213620 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-18dc8eb0-2e2a-4c52-b9cc-d5b748e7dfb9 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 404 len: 111 microversion: 2.1 time: 0.031287 Oct 11 00:25:49.213620 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4017/7378] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:25:49 2022] DELETE /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 00:25:49.216666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4a4eec2d-eafb-4f2b-a51d-bcb8e567ca91 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:49.217405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4a4eec2d-eafb-4f2b-a51d-bcb8e567ca91 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 7a715295-b7cf-48df-a5e1-c7404ae94e70] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:49.224291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a4eec2d-eafb-4f2b-a51d-bcb8e567ca91 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:49.224782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a4eec2d-eafb-4f2b-a51d-bcb8e567ca91 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:49.225227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a4eec2d-eafb-4f2b-a51d-bcb8e567ca91 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:49.225978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a4eec2d-eafb-4f2b-a51d-bcb8e567ca91 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:49.226439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a4eec2d-eafb-4f2b-a51d-bcb8e567ca91 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:49.226871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4a4eec2d-eafb-4f2b-a51d-bcb8e567ca91 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:49.241072 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-4a4eec2d-eafb-4f2b-a51d-bcb8e567ca91 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] HTTP exception thrown: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4a4eec2d-eafb-4f2b-a51d-bcb8e567ca91 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Request method failure captured: Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 HTTP/1.1 Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLZxfLc8Q7Icn9DecaGe5gcChOHeFqpqEXkmJ2LBp2kaQghRPSuL_6yNQKoNJrZLgbTTr8mxh5HHn7k6cnYW1dBqXduwGRSIKp1_hC3HFPdzua2afeL-3QExGQACpymRN5ysngyDUJc_A6H1lS2CdmxbOx6trU-c0z1aLDt5QVmHkl4 Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f7cd77bf414e471ebaef6c378429ce00", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: a9570fd898f2441e814db0a76968d902 Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '7a715295-b7cf-48df-a5e1-c7404ae94e70'} Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:25:49.242659 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.247323 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.247323 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:25:49.247323 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:25:49.247323 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:25:49.247323 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:25:49.247323 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. Oct 11 00:25:49.247323 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.247323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4a4eec2d-eafb-4f2b-a51d-bcb8e567ca91 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Returning 404 to user: Instance 7a715295-b7cf-48df-a5e1-c7404ae94e70 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:25:49.247323 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4a4eec2d-eafb-4f2b-a51d-bcb8e567ca91 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70" status: 404 len: 111 microversion: 2.1 time: 0.031284 Oct 11 00:25:49.247323 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3362/7379] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:49 2022] GET /compute/v2.1/servers/7a715295-b7cf-48df-a5e1-c7404ae94e70 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:25:49.253400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-86eba6e5-5116-49f1-a71a-9633b07d1f5b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:49.253995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-86eba6e5-5116-49f1-a71a-9633b07d1f5b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:49.263034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86eba6e5-5116-49f1-a71a-9633b07d1f5b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:49.263988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86eba6e5-5116-49f1-a71a-9633b07d1f5b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:49.265086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86eba6e5-5116-49f1-a71a-9633b07d1f5b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:49.266138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86eba6e5-5116-49f1-a71a-9633b07d1f5b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:49.267018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86eba6e5-5116-49f1-a71a-9633b07d1f5b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:49.267741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86eba6e5-5116-49f1-a71a-9633b07d1f5b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:49.293042 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-86eba6e5-5116-49f1-a71a-9633b07d1f5b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] HTTP exception thrown: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-86eba6e5-5116-49f1-a71a-9633b07d1f5b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Request method failure captured: Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 HTTP/1.1 Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLZxfLc8Q7Icn9DecaGe5gcChOHeFqpqEXkmJ2LBp2kaQghRPSuL_6yNQKoNJrZLgbTTr8mxh5HHn7k6cnYW1dBqXduwGRSIKp1_hC3HFPdzua2afeL-3QExGQACpymRN5ysngyDUJc_A6H1lS2CdmxbOx6trU-c0z1aLDt5QVmHkl4 Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f7cd77bf414e471ebaef6c378429ce00", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: a9570fd898f2441e814db0a76968d902 Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '14168ff9-2322-4b1e-8cdf-183d731facc6'} Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:25:49.294604 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:25:49.301197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. Oct 11 00:25:49.301197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.301197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:25:49.301197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.301197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.301197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:25:49.301197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:25:49.301197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:25:49.301197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:25:49.301197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. Oct 11 00:25:49.301197 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.301197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-86eba6e5-5116-49f1-a71a-9633b07d1f5b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Returning 404 to user: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:25:49.301197 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-86eba6e5-5116-49f1-a71a-9633b07d1f5b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "DELETE /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 404 len: 111 microversion: 2.1 time: 0.046758 Oct 11 00:25:49.301197 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4018/7380] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:25:49 2022] DELETE /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:25:49.307301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-31eb9f37-3c67-4dcb-bd4d-61e65187b469 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:49.307929 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-31eb9f37-3c67-4dcb-bd4d-61e65187b469 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [instance: 14168ff9-2322-4b1e-8cdf-183d731facc6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:25:49.314294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31eb9f37-3c67-4dcb-bd4d-61e65187b469 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:49.315194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31eb9f37-3c67-4dcb-bd4d-61e65187b469 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:49.315919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31eb9f37-3c67-4dcb-bd4d-61e65187b469 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:49.317064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31eb9f37-3c67-4dcb-bd4d-61e65187b469 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:25:49.317587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31eb9f37-3c67-4dcb-bd4d-61e65187b469 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:25:49.318035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-31eb9f37-3c67-4dcb-bd4d-61e65187b469 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:25:49.333522 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-31eb9f37-3c67-4dcb-bd4d-61e65187b469 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] HTTP exception thrown: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-31eb9f37-3c67-4dcb-bd4d-61e65187b469 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Request method failure captured: Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 HTTP/1.1 Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLZxfLc8Q7Icn9DecaGe5gcChOHeFqpqEXkmJ2LBp2kaQghRPSuL_6yNQKoNJrZLgbTTr8mxh5HHn7k6cnYW1dBqXduwGRSIKp1_hC3HFPdzua2afeL-3QExGQACpymRN5ysngyDUJc_A6H1lS2CdmxbOx6trU-c0z1aLDt5QVmHkl4 Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7cd77bf414e471ebaef6c378429ce00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f7cd77bf414e471ebaef6c378429ce00", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: f7cd77bf414e471ebaef6c378429ce00 Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServerActionsTestJSON-1721988784 Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: a9570fd898f2441e814db0a76968d902 Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServerActionsTestJSON-1721988784-project Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '14168ff9-2322-4b1e-8cdf-183d731facc6'} Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:25:49.335112 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.339344 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:25:49.339344 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:25:49.339344 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:25:49.339344 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:25:49.339344 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:25:49.339344 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. Oct 11 00:25:49.339344 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:25:49.339344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-31eb9f37-3c67-4dcb-bd4d-61e65187b469 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Returning 404 to user: Instance 14168ff9-2322-4b1e-8cdf-183d731facc6 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:25:49.339344 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-31eb9f37-3c67-4dcb-bd4d-61e65187b469 tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6" status: 404 len: 111 microversion: 2.1 time: 0.033974 Oct 11 00:25:49.339344 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3363/7381] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:25:49 2022] GET /compute/v2.1/servers/14168ff9-2322-4b1e-8cdf-183d731facc6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 00:25:49.346630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-503471af-f53e-45d8-a4fb-e8019cc0406b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] Calling method '.version_select at 0x7f662b17c040>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:25:49.351268 n-d-860864-2 devstack@n-api.service[120613]: ERROR oslo.messaging._drivers.impl_rabbit [None req-503471af-f53e-45d8-a4fb-e8019cc0406b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [9b518037-c822-4751-8c32-b8f9db7be4a5] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 00:25:50.358429 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [None req-503471af-f53e-45d8-a4fb-e8019cc0406b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] [9b518037-c822-4751-8c32-b8f9db7be4a5] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 37494. Oct 11 00:25:50.383701 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-503471af-f53e-45d8-a4fb-e8019cc0406b tempest-ServerActionsTestJSON-1721988784 tempest-ServerActionsTestJSON-1721988784-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-921070498" status: 202 len: 0 microversion: 2.1 time: 1.041346 Oct 11 00:25:50.384311 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4019/7382] 10.222.0.23 () {58 vars in 1218 bytes} [Tue Oct 11 00:25:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-921070498 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:26:00.131369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=19 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:26:00.132894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:26:00.288140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-27c240cc-1769-4f93-a0fa-3b655553db86 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-411011278", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "464de441-5067-49d3-8eb9-50d4e7b573c8"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:26:00.350641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-27c240cc-1769-4f93-a0fa-3b655553db86 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] validate_networks() for [('464de441-5067-49d3-8eb9-50d4e7b573c8', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:26:00.843288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-27c240cc-1769-4f93-a0fa-3b655553db86 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:26:00.843884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-27c240cc-1769-4f93-a0fa-3b655553db86 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:26:00.844592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-27c240cc-1769-4f93-a0fa-3b655553db86 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:26:00.845570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-27c240cc-1769-4f93-a0fa-3b655553db86 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:26:00.846170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-27c240cc-1769-4f93-a0fa-3b655553db86 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:26:00.865899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27c240cc-1769-4f93-a0fa-3b655553db86 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:00.867408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27c240cc-1769-4f93-a0fa-3b655553db86 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:00.867408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27c240cc-1769-4f93-a0fa-3b655553db86 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:00.867408 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27c240cc-1769-4f93-a0fa-3b655553db86 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:00.867767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27c240cc-1769-4f93-a0fa-3b655553db86 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:00.868187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27c240cc-1769-4f93-a0fa-3b655553db86 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:00.887857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-27c240cc-1769-4f93-a0fa-3b655553db86 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Getting quotas for project 8e6cd2a845484563aec840ba55c20a0b. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:26:00.894192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-27c240cc-1769-4f93-a0fa-3b655553db86 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Getting quotas for user 7231d55264f74b26b24a325e62469387 and project 8e6cd2a845484563aec840ba55c20a0b. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:26:00.906390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-27c240cc-1769-4f93-a0fa-3b655553db86 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:26:00.909323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-27c240cc-1769-4f93-a0fa-3b655553db86 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:26:00.955374 n-d-860864-2 devstack@n-api.service[120614]: ERROR oslo.messaging._drivers.impl_rabbit [None req-27c240cc-1769-4f93-a0fa-3b655553db86 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [ef7180a5-4bd5-46c5-ad8d-3f7ac9b635b6] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 00:26:01.966518 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [None req-27c240cc-1769-4f93-a0fa-3b655553db86 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [ef7180a5-4bd5-46c5-ad8d-3f7ac9b635b6] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 37576. Oct 11 00:26:01.982187 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-27c240cc-1769-4f93-a0fa-3b655553db86 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.857017 Oct 11 00:26:01.990589 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3364/7383] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:26:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:26:01.993655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=45 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:26:01.995971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:26:02.001769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-87d327a5-f55d-4dc2-b2c6-0cc9d1800e2a tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:02.002421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-87d327a5-f55d-4dc2-b2c6-0cc9d1800e2a tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:02.075546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-87d327a5-f55d-4dc2-b2c6-0cc9d1800e2a tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:02.087382 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-87d327a5-f55d-4dc2-b2c6-0cc9d1800e2a tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04" status: 200 len: 1216 microversion: 2.1 time: 0.094999 Oct 11 00:26:02.090361 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4020/7384] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:01 2022] GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04 => generated 1216 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:03.114646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-08a81236-68da-4e95-b1f2-74e0e88e5d45 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:03.115267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-08a81236-68da-4e95-b1f2-74e0e88e5d45 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:03.122060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08a81236-68da-4e95-b1f2-74e0e88e5d45 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:03.122640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08a81236-68da-4e95-b1f2-74e0e88e5d45 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:03.123132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08a81236-68da-4e95-b1f2-74e0e88e5d45 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:03.123846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08a81236-68da-4e95-b1f2-74e0e88e5d45 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:03.124295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08a81236-68da-4e95-b1f2-74e0e88e5d45 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:03.124808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-08a81236-68da-4e95-b1f2-74e0e88e5d45 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:03.205452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-08a81236-68da-4e95-b1f2-74e0e88e5d45 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:03.214539 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-08a81236-68da-4e95-b1f2-74e0e88e5d45 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04" status: 200 len: 1268 microversion: 2.1 time: 0.105636 Oct 11 00:26:03.215007 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3365/7385] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:03 2022] GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04 => generated 1268 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:04.243812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9c73dc3e-95fc-48af-8af0-b351c6692076 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:04.245947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9c73dc3e-95fc-48af-8af0-b351c6692076 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:04.262237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c73dc3e-95fc-48af-8af0-b351c6692076 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:04.266842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c73dc3e-95fc-48af-8af0-b351c6692076 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:04.267250 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c73dc3e-95fc-48af-8af0-b351c6692076 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:04.268032 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c73dc3e-95fc-48af-8af0-b351c6692076 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:04.268523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c73dc3e-95fc-48af-8af0-b351c6692076 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:04.268978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9c73dc3e-95fc-48af-8af0-b351c6692076 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:04.487400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9c73dc3e-95fc-48af-8af0-b351c6692076 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:04.495663 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9c73dc3e-95fc-48af-8af0-b351c6692076 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04" status: 200 len: 1316 microversion: 2.1 time: 0.261206 Oct 11 00:26:04.496253 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4021/7386] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:04 2022] GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04 => generated 1316 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:04.888415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-eeb3599c-010a-41e7-a2d9-0171607a8233 req-270384d4-1ebf-4ed7-a3a6-517f897a75f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45a40a06-b2c3-493b-848d-aaafc31dad04", "tag": "a64f3ef8-b3f4-4f42-afa6-e19c4aac9ec1"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:26:04.900804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-eeb3599c-010a-41e7-a2d9-0171607a8233 req-270384d4-1ebf-4ed7-a3a6-517f897a75f1 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:04.901471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-eeb3599c-010a-41e7-a2d9-0171607a8233 req-270384d4-1ebf-4ed7-a3a6-517f897a75f1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:04.901910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-eeb3599c-010a-41e7-a2d9-0171607a8233 req-270384d4-1ebf-4ed7-a3a6-517f897a75f1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:04.917050 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-eeb3599c-010a-41e7-a2d9-0171607a8233 req-270384d4-1ebf-4ed7-a3a6-517f897a75f1 service nova] Creating event network-changed:a64f3ef8-b3f4-4f42-afa6-e19c4aac9ec1 for instance 45a40a06-b2c3-493b-848d-aaafc31dad04 on n-h1-860864-2 Oct 11 00:26:04.923844 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-eeb3599c-010a-41e7-a2d9-0171607a8233 req-270384d4-1ebf-4ed7-a3a6-517f897a75f1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039123 Oct 11 00:26:04.924658 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3366/7387] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:26:05.520493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-496bc599-8624-4576-8747-ab4ca8bce833 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:05.521137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-496bc599-8624-4576-8747-ab4ca8bce833 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:05.528216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-496bc599-8624-4576-8747-ab4ca8bce833 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:05.528717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-496bc599-8624-4576-8747-ab4ca8bce833 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:05.529175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-496bc599-8624-4576-8747-ab4ca8bce833 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:05.529929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-496bc599-8624-4576-8747-ab4ca8bce833 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:05.530478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-496bc599-8624-4576-8747-ab4ca8bce833 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:05.530921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-496bc599-8624-4576-8747-ab4ca8bce833 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:05.674116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-496bc599-8624-4576-8747-ab4ca8bce833 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:05.682213 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-496bc599-8624-4576-8747-ab4ca8bce833 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04" status: 200 len: 1316 microversion: 2.1 time: 0.166368 Oct 11 00:26:05.682788 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4022/7388] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:05 2022] GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04 => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:06.707627 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eaea32fb-3265-4cdf-af67-c2460ddc86de tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:06.708341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eaea32fb-3265-4cdf-af67-c2460ddc86de tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:06.714994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaea32fb-3265-4cdf-af67-c2460ddc86de tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:06.715481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaea32fb-3265-4cdf-af67-c2460ddc86de tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:06.715934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaea32fb-3265-4cdf-af67-c2460ddc86de tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:06.716663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaea32fb-3265-4cdf-af67-c2460ddc86de tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:06.717121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaea32fb-3265-4cdf-af67-c2460ddc86de tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:06.717660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eaea32fb-3265-4cdf-af67-c2460ddc86de tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:06.931774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-eaea32fb-3265-4cdf-af67-c2460ddc86de tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:06.940478 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eaea32fb-3265-4cdf-af67-c2460ddc86de tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04" status: 200 len: 1316 microversion: 2.1 time: 0.238619 Oct 11 00:26:06.941100 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3367/7389] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:06 2022] GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04 => generated 1316 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:07.964491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3d60783b-b949-47fc-8c16-7a6c9f86f72c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:07.965141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3d60783b-b949-47fc-8c16-7a6c9f86f72c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:07.972860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d60783b-b949-47fc-8c16-7a6c9f86f72c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:07.973449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d60783b-b949-47fc-8c16-7a6c9f86f72c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:07.973920 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d60783b-b949-47fc-8c16-7a6c9f86f72c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:07.974654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d60783b-b949-47fc-8c16-7a6c9f86f72c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:07.975133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d60783b-b949-47fc-8c16-7a6c9f86f72c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:07.975593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3d60783b-b949-47fc-8c16-7a6c9f86f72c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:08.117071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3d60783b-b949-47fc-8c16-7a6c9f86f72c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:08.125320 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3d60783b-b949-47fc-8c16-7a6c9f86f72c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04" status: 200 len: 1316 microversion: 2.1 time: 0.164928 Oct 11 00:26:08.125941 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4023/7390] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:07 2022] GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:09.149078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e3652698-9a13-4b7c-a75b-80fc7b7fffa1 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:09.149867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e3652698-9a13-4b7c-a75b-80fc7b7fffa1 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:09.160144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3652698-9a13-4b7c-a75b-80fc7b7fffa1 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:09.160561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3652698-9a13-4b7c-a75b-80fc7b7fffa1 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:09.161040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3652698-9a13-4b7c-a75b-80fc7b7fffa1 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:09.161778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3652698-9a13-4b7c-a75b-80fc7b7fffa1 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:09.162237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3652698-9a13-4b7c-a75b-80fc7b7fffa1 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:09.162666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3652698-9a13-4b7c-a75b-80fc7b7fffa1 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:09.316893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e3652698-9a13-4b7c-a75b-80fc7b7fffa1 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:09.324904 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e3652698-9a13-4b7c-a75b-80fc7b7fffa1 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04" status: 200 len: 1316 microversion: 2.1 time: 0.179849 Oct 11 00:26:09.325424 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3368/7391] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:09 2022] GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04 => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:10.350625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d15bf6d2-ffcc-403c-b004-f9a72c6f48eb tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:10.351259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d15bf6d2-ffcc-403c-b004-f9a72c6f48eb tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:10.358199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d15bf6d2-ffcc-403c-b004-f9a72c6f48eb tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:10.358700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d15bf6d2-ffcc-403c-b004-f9a72c6f48eb tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:10.359158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d15bf6d2-ffcc-403c-b004-f9a72c6f48eb tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:10.360490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d15bf6d2-ffcc-403c-b004-f9a72c6f48eb tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:10.360941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d15bf6d2-ffcc-403c-b004-f9a72c6f48eb tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:10.361410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d15bf6d2-ffcc-403c-b004-f9a72c6f48eb tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:10.502754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d15bf6d2-ffcc-403c-b004-f9a72c6f48eb tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:10.510673 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d15bf6d2-ffcc-403c-b004-f9a72c6f48eb tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04" status: 200 len: 1316 microversion: 2.1 time: 0.164042 Oct 11 00:26:10.511263 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4024/7392] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:10 2022] GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:11.081174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-f494deff-c84b-4171-96ad-02f53a3025ff req-b7ac47ff-0d15-4c84-8c62-f4ab04525ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45a40a06-b2c3-493b-848d-aaafc31dad04", "name": "network-vif-plugged", "status": "completed", "tag": "a64f3ef8-b3f4-4f42-afa6-e19c4aac9ec1"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:26:11.087139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:26:11.087927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:26:11.095545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f494deff-c84b-4171-96ad-02f53a3025ff req-b7ac47ff-0d15-4c84-8c62-f4ab04525ab2 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:11.096033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f494deff-c84b-4171-96ad-02f53a3025ff req-b7ac47ff-0d15-4c84-8c62-f4ab04525ab2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:11.096466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f494deff-c84b-4171-96ad-02f53a3025ff req-b7ac47ff-0d15-4c84-8c62-f4ab04525ab2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:11.109247 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-f494deff-c84b-4171-96ad-02f53a3025ff req-b7ac47ff-0d15-4c84-8c62-f4ab04525ab2 service nova] Creating event network-vif-plugged:a64f3ef8-b3f4-4f42-afa6-e19c4aac9ec1 for instance 45a40a06-b2c3-493b-848d-aaafc31dad04 on n-h1-860864-2 Oct 11 00:26:11.114678 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-f494deff-c84b-4171-96ad-02f53a3025ff req-b7ac47ff-0d15-4c84-8c62-f4ab04525ab2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037813 Oct 11 00:26:11.115667 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3369/7393] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:26:11.534515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9faec13d-67e4-46b7-b0e5-e0ea319cb78f tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:11.535147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9faec13d-67e4-46b7-b0e5-e0ea319cb78f tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:11.542171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9faec13d-67e4-46b7-b0e5-e0ea319cb78f tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:11.542695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9faec13d-67e4-46b7-b0e5-e0ea319cb78f tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:11.543133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9faec13d-67e4-46b7-b0e5-e0ea319cb78f tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:11.543852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9faec13d-67e4-46b7-b0e5-e0ea319cb78f tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:11.544324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9faec13d-67e4-46b7-b0e5-e0ea319cb78f tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:11.544768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9faec13d-67e4-46b7-b0e5-e0ea319cb78f tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:11.679065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9faec13d-67e4-46b7-b0e5-e0ea319cb78f tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:11.687190 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9faec13d-67e4-46b7-b0e5-e0ea319cb78f tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04" status: 200 len: 1316 microversion: 2.1 time: 0.156736 Oct 11 00:26:11.687790 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4025/7394] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:11 2022] GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:12.711199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-71c327cb-f284-483d-826c-3275d9ce9334 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:12.711960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-71c327cb-f284-483d-826c-3275d9ce9334 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:12.719337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71c327cb-f284-483d-826c-3275d9ce9334 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:12.719832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71c327cb-f284-483d-826c-3275d9ce9334 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:12.720302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71c327cb-f284-483d-826c-3275d9ce9334 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:12.721192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71c327cb-f284-483d-826c-3275d9ce9334 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:12.721725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71c327cb-f284-483d-826c-3275d9ce9334 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:12.722195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71c327cb-f284-483d-826c-3275d9ce9334 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:12.863471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-71c327cb-f284-483d-826c-3275d9ce9334 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:12.872325 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-71c327cb-f284-483d-826c-3275d9ce9334 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04" status: 200 len: 1504 microversion: 2.1 time: 0.165505 Oct 11 00:26:12.872915 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3370/7395] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:12 2022] GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:12.940104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-18f31d0d-fe0b-44bb-953e-acfb02599180 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1082848490", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "464de441-5067-49d3-8eb9-50d4e7b573c8"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:26:12.948653 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:26:12.999674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-18f31d0d-fe0b-44bb-953e-acfb02599180 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] validate_networks() for [('464de441-5067-49d3-8eb9-50d4e7b573c8', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:26:13.465958 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-18f31d0d-fe0b-44bb-953e-acfb02599180 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:26:13.466385 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-18f31d0d-fe0b-44bb-953e-acfb02599180 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:26:13.466876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-18f31d0d-fe0b-44bb-953e-acfb02599180 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:26:13.467299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-18f31d0d-fe0b-44bb-953e-acfb02599180 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:26:13.467725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-18f31d0d-fe0b-44bb-953e-acfb02599180 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:26:13.478044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18f31d0d-fe0b-44bb-953e-acfb02599180 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:13.478536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18f31d0d-fe0b-44bb-953e-acfb02599180 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:13.478983 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18f31d0d-fe0b-44bb-953e-acfb02599180 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:13.479717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18f31d0d-fe0b-44bb-953e-acfb02599180 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:13.480181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18f31d0d-fe0b-44bb-953e-acfb02599180 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:13.480616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18f31d0d-fe0b-44bb-953e-acfb02599180 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:13.497587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-18f31d0d-fe0b-44bb-953e-acfb02599180 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Getting quotas for project 8e6cd2a845484563aec840ba55c20a0b. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:26:13.503654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-18f31d0d-fe0b-44bb-953e-acfb02599180 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Getting quotas for user 7231d55264f74b26b24a325e62469387 and project 8e6cd2a845484563aec840ba55c20a0b. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:26:13.517464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-18f31d0d-fe0b-44bb-953e-acfb02599180 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:26:13.520076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-18f31d0d-fe0b-44bb-953e-acfb02599180 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: af5f2bd0-2527-48fa-b2be-b064b224c6b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:26:13.569032 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-18f31d0d-fe0b-44bb-953e-acfb02599180 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.633842 Oct 11 00:26:13.570013 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4026/7396] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:26:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:26:13.583573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-584d4061-f64b-479a-a690-446d4248a09c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:13.584191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-584d4061-f64b-479a-a690-446d4248a09c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: af5f2bd0-2527-48fa-b2be-b064b224c6b6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:13.639074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-584d4061-f64b-479a-a690-446d4248a09c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:13.647635 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-584d4061-f64b-479a-a690-446d4248a09c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6" status: 200 len: 1217 microversion: 2.1 time: 0.070121 Oct 11 00:26:13.648231 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3371/7397] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:13 2022] GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:26:14.670842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-937f5939-6798-4591-a5dc-ec10bd7fbea7 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:14.671563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-937f5939-6798-4591-a5dc-ec10bd7fbea7 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: af5f2bd0-2527-48fa-b2be-b064b224c6b6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:14.681962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-937f5939-6798-4591-a5dc-ec10bd7fbea7 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:14.682562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-937f5939-6798-4591-a5dc-ec10bd7fbea7 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:14.683077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-937f5939-6798-4591-a5dc-ec10bd7fbea7 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:14.683812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-937f5939-6798-4591-a5dc-ec10bd7fbea7 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:14.684292 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-937f5939-6798-4591-a5dc-ec10bd7fbea7 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:14.684745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-937f5939-6798-4591-a5dc-ec10bd7fbea7 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:14.760941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-937f5939-6798-4591-a5dc-ec10bd7fbea7 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:14.770571 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-937f5939-6798-4591-a5dc-ec10bd7fbea7 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6" status: 200 len: 1269 microversion: 2.1 time: 0.103877 Oct 11 00:26:14.771432 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4027/7398] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:14 2022] GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6 => generated 1269 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:15.794480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bc10a2c1-33f1-4d5c-97b9-e31afa20a370 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:15.795274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bc10a2c1-33f1-4d5c-97b9-e31afa20a370 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: af5f2bd0-2527-48fa-b2be-b064b224c6b6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:15.799132 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:26:15.799296 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:26:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6 (ip 10.222.0.23) !!! Oct 11 00:26:15.806745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc10a2c1-33f1-4d5c-97b9-e31afa20a370 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:15.807239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc10a2c1-33f1-4d5c-97b9-e31afa20a370 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:15.807681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc10a2c1-33f1-4d5c-97b9-e31afa20a370 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:15.808390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc10a2c1-33f1-4d5c-97b9-e31afa20a370 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:15.808846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc10a2c1-33f1-4d5c-97b9-e31afa20a370 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:15.809278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc10a2c1-33f1-4d5c-97b9-e31afa20a370 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:15.949590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bc10a2c1-33f1-4d5c-97b9-e31afa20a370 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:15.959224 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bc10a2c1-33f1-4d5c-97b9-e31afa20a370 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6" status: 200 len: 1317 microversion: 2.1 time: 0.168635 Oct 11 00:26:15.959867 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3372/7399] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:15 2022] GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:16.467115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-57894f2e-c2b6-4fd5-a1fe-87403d92e520 req-b607e1f9-e7fa-4c42-a22a-57bd0d341a51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af5f2bd0-2527-48fa-b2be-b064b224c6b6", "tag": "59696493-1d40-48cf-883c-45a1f2b55079"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:26:16.490753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-57894f2e-c2b6-4fd5-a1fe-87403d92e520 req-b607e1f9-e7fa-4c42-a22a-57bd0d341a51 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:16.491254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-57894f2e-c2b6-4fd5-a1fe-87403d92e520 req-b607e1f9-e7fa-4c42-a22a-57bd0d341a51 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:16.491713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-57894f2e-c2b6-4fd5-a1fe-87403d92e520 req-b607e1f9-e7fa-4c42-a22a-57bd0d341a51 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:16.507667 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-57894f2e-c2b6-4fd5-a1fe-87403d92e520 req-b607e1f9-e7fa-4c42-a22a-57bd0d341a51 service nova] Creating event network-changed:59696493-1d40-48cf-883c-45a1f2b55079 for instance af5f2bd0-2527-48fa-b2be-b064b224c6b6 on n-h2-860864-2 Oct 11 00:26:16.513888 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-57894f2e-c2b6-4fd5-a1fe-87403d92e520 req-b607e1f9-e7fa-4c42-a22a-57bd0d341a51 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050811 Oct 11 00:26:16.514527 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4028/7400] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:26:16.990692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1393eb89-1fde-4699-913e-092cddb9a456 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:16.991252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1393eb89-1fde-4699-913e-092cddb9a456 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: af5f2bd0-2527-48fa-b2be-b064b224c6b6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:16.998178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1393eb89-1fde-4699-913e-092cddb9a456 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:16.998737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1393eb89-1fde-4699-913e-092cddb9a456 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:16.999181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1393eb89-1fde-4699-913e-092cddb9a456 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:16.999904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1393eb89-1fde-4699-913e-092cddb9a456 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:17.001347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1393eb89-1fde-4699-913e-092cddb9a456 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:17.001811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1393eb89-1fde-4699-913e-092cddb9a456 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:17.137315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1393eb89-1fde-4699-913e-092cddb9a456 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:17.147034 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1393eb89-1fde-4699-913e-092cddb9a456 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6" status: 200 len: 1317 microversion: 2.1 time: 0.160351 Oct 11 00:26:17.147610 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3373/7401] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:16 2022] GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:26:18.171354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d9fd3238-ecc5-4a7f-a24c-308e6e9e7536 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:18.172370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d9fd3238-ecc5-4a7f-a24c-308e6e9e7536 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: af5f2bd0-2527-48fa-b2be-b064b224c6b6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:18.181196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9fd3238-ecc5-4a7f-a24c-308e6e9e7536 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:18.181732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9fd3238-ecc5-4a7f-a24c-308e6e9e7536 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:18.182196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9fd3238-ecc5-4a7f-a24c-308e6e9e7536 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:18.182932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9fd3238-ecc5-4a7f-a24c-308e6e9e7536 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:18.183401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9fd3238-ecc5-4a7f-a24c-308e6e9e7536 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:18.183900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d9fd3238-ecc5-4a7f-a24c-308e6e9e7536 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:18.329413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d9fd3238-ecc5-4a7f-a24c-308e6e9e7536 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:18.337903 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d9fd3238-ecc5-4a7f-a24c-308e6e9e7536 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6" status: 200 len: 1317 microversion: 2.1 time: 0.171993 Oct 11 00:26:18.338630 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4029/7402] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:18 2022] GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:19.361962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8348169b-db07-489d-a56e-b8bf7fa8861f tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:19.362596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8348169b-db07-489d-a56e-b8bf7fa8861f tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: af5f2bd0-2527-48fa-b2be-b064b224c6b6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:19.369530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8348169b-db07-489d-a56e-b8bf7fa8861f tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:19.370022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8348169b-db07-489d-a56e-b8bf7fa8861f tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:19.370475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8348169b-db07-489d-a56e-b8bf7fa8861f tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:19.371176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8348169b-db07-489d-a56e-b8bf7fa8861f tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:19.371624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8348169b-db07-489d-a56e-b8bf7fa8861f tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:19.372054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8348169b-db07-489d-a56e-b8bf7fa8861f tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:19.524008 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8348169b-db07-489d-a56e-b8bf7fa8861f tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:19.532796 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8348169b-db07-489d-a56e-b8bf7fa8861f tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6" status: 200 len: 1317 microversion: 2.1 time: 0.175920 Oct 11 00:26:19.533327 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3374/7403] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:19 2022] GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:20.559726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-89862d73-7423-4d03-bb7f-d0d09e29fff8 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:20.560245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-89862d73-7423-4d03-bb7f-d0d09e29fff8 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: af5f2bd0-2527-48fa-b2be-b064b224c6b6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:20.568269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89862d73-7423-4d03-bb7f-d0d09e29fff8 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:20.568989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89862d73-7423-4d03-bb7f-d0d09e29fff8 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:20.569235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89862d73-7423-4d03-bb7f-d0d09e29fff8 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:20.569992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89862d73-7423-4d03-bb7f-d0d09e29fff8 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:20.570465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89862d73-7423-4d03-bb7f-d0d09e29fff8 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:20.570912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-89862d73-7423-4d03-bb7f-d0d09e29fff8 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:20.717963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-89862d73-7423-4d03-bb7f-d0d09e29fff8 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:20.728249 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-89862d73-7423-4d03-bb7f-d0d09e29fff8 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6" status: 200 len: 1317 microversion: 2.1 time: 0.175177 Oct 11 00:26:20.728913 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4030/7404] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:20 2022] GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:20.876405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-6e3807b8-1ea9-49b6-bb70-46a05b80c6f9 req-a93bdec5-43b7-4108-8028-00372f0274c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af5f2bd0-2527-48fa-b2be-b064b224c6b6", "name": "network-vif-plugged", "status": "completed", "tag": "59696493-1d40-48cf-883c-45a1f2b55079"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:26:20.887796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6e3807b8-1ea9-49b6-bb70-46a05b80c6f9 req-a93bdec5-43b7-4108-8028-00372f0274c7 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:20.888527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6e3807b8-1ea9-49b6-bb70-46a05b80c6f9 req-a93bdec5-43b7-4108-8028-00372f0274c7 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:20.889045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6e3807b8-1ea9-49b6-bb70-46a05b80c6f9 req-a93bdec5-43b7-4108-8028-00372f0274c7 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:20.904488 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-6e3807b8-1ea9-49b6-bb70-46a05b80c6f9 req-a93bdec5-43b7-4108-8028-00372f0274c7 service nova] Creating event network-vif-plugged:59696493-1d40-48cf-883c-45a1f2b55079 for instance af5f2bd0-2527-48fa-b2be-b064b224c6b6 on n-h2-860864-2 Oct 11 00:26:20.911433 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-6e3807b8-1ea9-49b6-bb70-46a05b80c6f9 req-a93bdec5-43b7-4108-8028-00372f0274c7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041061 Oct 11 00:26:20.912465 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3375/7405] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:26:21.758747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c063be33-4720-445b-9dce-e3a1488d8393 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:21.759328 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c063be33-4720-445b-9dce-e3a1488d8393 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: af5f2bd0-2527-48fa-b2be-b064b224c6b6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:21.766901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c063be33-4720-445b-9dce-e3a1488d8393 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:21.767910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c063be33-4720-445b-9dce-e3a1488d8393 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:21.768359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c063be33-4720-445b-9dce-e3a1488d8393 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:21.769072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c063be33-4720-445b-9dce-e3a1488d8393 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:21.769566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c063be33-4720-445b-9dce-e3a1488d8393 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:21.770010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c063be33-4720-445b-9dce-e3a1488d8393 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:21.916726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c063be33-4720-445b-9dce-e3a1488d8393 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:21.925058 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c063be33-4720-445b-9dce-e3a1488d8393 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6" status: 200 len: 1317 microversion: 2.1 time: 0.176703 Oct 11 00:26:21.925705 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4031/7406] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:21 2022] GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:22.949973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2299cc78-1a96-49b8-bf55-2048a9fa14c4 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:22.950744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2299cc78-1a96-49b8-bf55-2048a9fa14c4 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: af5f2bd0-2527-48fa-b2be-b064b224c6b6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:22.957839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2299cc78-1a96-49b8-bf55-2048a9fa14c4 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:22.958323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2299cc78-1a96-49b8-bf55-2048a9fa14c4 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:22.958762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2299cc78-1a96-49b8-bf55-2048a9fa14c4 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:22.959457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2299cc78-1a96-49b8-bf55-2048a9fa14c4 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:22.959899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2299cc78-1a96-49b8-bf55-2048a9fa14c4 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:22.960321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2299cc78-1a96-49b8-bf55-2048a9fa14c4 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:23.098029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2299cc78-1a96-49b8-bf55-2048a9fa14c4 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:23.109222 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2299cc78-1a96-49b8-bf55-2048a9fa14c4 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6" status: 200 len: 1505 microversion: 2.1 time: 0.164202 Oct 11 00:26:23.110079 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3376/7407] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:22 2022] GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:23.133017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-37b353f5-d000-4171-8006-66ef4859577e tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:23.133594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-37b353f5-d000-4171-8006-66ef4859577e tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: af5f2bd0-2527-48fa-b2be-b064b224c6b6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:23.140633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37b353f5-d000-4171-8006-66ef4859577e tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:23.141132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37b353f5-d000-4171-8006-66ef4859577e tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:23.141720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37b353f5-d000-4171-8006-66ef4859577e tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:23.142444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37b353f5-d000-4171-8006-66ef4859577e tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:23.142915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37b353f5-d000-4171-8006-66ef4859577e tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:23.143361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37b353f5-d000-4171-8006-66ef4859577e tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:23.171214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-37b353f5-d000-4171-8006-66ef4859577e tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: af5f2bd0-2527-48fa-b2be-b064b224c6b6] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:26:23.269625 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-37b353f5-d000-4171-8006-66ef4859577e tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "DELETE /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6" status: 204 len: 0 microversion: 2.1 time: 0.140310 Oct 11 00:26:23.270570 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4032/7408] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:26:23 2022] DELETE /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:26:23.279066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e73f9f7e-10f3-4c9e-8d87-3df531cd2f7b tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:23.279721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e73f9f7e-10f3-4c9e-8d87-3df531cd2f7b tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: af5f2bd0-2527-48fa-b2be-b064b224c6b6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:23.286648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e73f9f7e-10f3-4c9e-8d87-3df531cd2f7b tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:23.287138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e73f9f7e-10f3-4c9e-8d87-3df531cd2f7b tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:23.287797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e73f9f7e-10f3-4c9e-8d87-3df531cd2f7b tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:23.288499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e73f9f7e-10f3-4c9e-8d87-3df531cd2f7b tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:23.289026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e73f9f7e-10f3-4c9e-8d87-3df531cd2f7b tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:23.289400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e73f9f7e-10f3-4c9e-8d87-3df531cd2f7b tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:23.429998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e73f9f7e-10f3-4c9e-8d87-3df531cd2f7b tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:23.438171 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e73f9f7e-10f3-4c9e-8d87-3df531cd2f7b tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6" status: 200 len: 1511 microversion: 2.1 time: 0.163462 Oct 11 00:26:23.438876 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3377/7409] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:23 2022] GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:24.467647 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-946d96db-7a0f-4d5a-a20f-6b1287de976b tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:24.468360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-946d96db-7a0f-4d5a-a20f-6b1287de976b tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: af5f2bd0-2527-48fa-b2be-b064b224c6b6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:24.471593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:26:24.472419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:26:24.481002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-946d96db-7a0f-4d5a-a20f-6b1287de976b tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:24.481543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-946d96db-7a0f-4d5a-a20f-6b1287de976b tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:24.482018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-946d96db-7a0f-4d5a-a20f-6b1287de976b tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:24.482783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-946d96db-7a0f-4d5a-a20f-6b1287de976b tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:24.483253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-946d96db-7a0f-4d5a-a20f-6b1287de976b tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:24.483692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-946d96db-7a0f-4d5a-a20f-6b1287de976b tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:24.623491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-946d96db-7a0f-4d5a-a20f-6b1287de976b tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:24.631866 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-946d96db-7a0f-4d5a-a20f-6b1287de976b tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6" status: 200 len: 1511 microversion: 2.1 time: 0.168544 Oct 11 00:26:24.632670 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4033/7410] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:24 2022] GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6 => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:25.222886 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-3358ec5c-a4e8-4eed-8710-3a3241e3e8fe req-cc68d4ca-4705-4967-8529-9d89994266e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af5f2bd0-2527-48fa-b2be-b064b224c6b6", "name": "network-vif-deleted", "tag": "59696493-1d40-48cf-883c-45a1f2b55079"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:26:25.233038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:26:25.242988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3358ec5c-a4e8-4eed-8710-3a3241e3e8fe req-cc68d4ca-4705-4967-8529-9d89994266e6 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:25.243847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3358ec5c-a4e8-4eed-8710-3a3241e3e8fe req-cc68d4ca-4705-4967-8529-9d89994266e6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:25.244517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3358ec5c-a4e8-4eed-8710-3a3241e3e8fe req-cc68d4ca-4705-4967-8529-9d89994266e6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:25.259044 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-3358ec5c-a4e8-4eed-8710-3a3241e3e8fe req-cc68d4ca-4705-4967-8529-9d89994266e6 service nova] Creating event network-vif-deleted:59696493-1d40-48cf-883c-45a1f2b55079 for instance af5f2bd0-2527-48fa-b2be-b064b224c6b6 on n-h2-860864-2 Oct 11 00:26:25.264646 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-3358ec5c-a4e8-4eed-8710-3a3241e3e8fe req-cc68d4ca-4705-4967-8529-9d89994266e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049665 Oct 11 00:26:25.266267 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3378/7411] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:26:25.656431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-795a5c1b-7c69-42b2-be0c-715560561307 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:25.657643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-795a5c1b-7c69-42b2-be0c-715560561307 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: af5f2bd0-2527-48fa-b2be-b064b224c6b6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:25.665553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-795a5c1b-7c69-42b2-be0c-715560561307 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:25.666086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-795a5c1b-7c69-42b2-be0c-715560561307 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:25.666537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-795a5c1b-7c69-42b2-be0c-715560561307 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:25.667265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-795a5c1b-7c69-42b2-be0c-715560561307 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:25.667730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-795a5c1b-7c69-42b2-be0c-715560561307 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:25.668168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-795a5c1b-7c69-42b2-be0c-715560561307 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:25.710131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-795a5c1b-7c69-42b2-be0c-715560561307 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:25.710636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-795a5c1b-7c69-42b2-be0c-715560561307 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:25.711090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-795a5c1b-7c69-42b2-be0c-715560561307 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:25.711560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-795a5c1b-7c69-42b2-be0c-715560561307 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lazy-loading 'fault' on Instance uuid af5f2bd0-2527-48fa-b2be-b064b224c6b6 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:26:25.756501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-795a5c1b-7c69-42b2-be0c-715560561307 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:25.765173 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-795a5c1b-7c69-42b2-be0c-715560561307 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6" status: 200 len: 1307 microversion: 2.1 time: 0.112448 Oct 11 00:26:25.765520 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4034/7412] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:25 2022] GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6 => generated 1307 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:26.793037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1f89d396-50cc-4341-92e0-898b87714897 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:26.793809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1f89d396-50cc-4341-92e0-898b87714897 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: af5f2bd0-2527-48fa-b2be-b064b224c6b6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:26.800165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f89d396-50cc-4341-92e0-898b87714897 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:26.800648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f89d396-50cc-4341-92e0-898b87714897 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:26.801086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f89d396-50cc-4341-92e0-898b87714897 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:26.801826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f89d396-50cc-4341-92e0-898b87714897 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:26.802285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f89d396-50cc-4341-92e0-898b87714897 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:26.802713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1f89d396-50cc-4341-92e0-898b87714897 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:26.816989 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-1f89d396-50cc-4341-92e0-898b87714897 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] HTTP exception thrown: Instance af5f2bd0-2527-48fa-b2be-b064b224c6b6 could not be found. Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1f89d396-50cc-4341-92e0-898b87714897 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Request method failure captured: Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6 HTTP/1.1 Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLgXg3RJZbCUjyn0_qCZQ1taJIodryFuA0w6aguUSdRPeTAM5ff4yt6igaDAfGM_PNMVYPodz0pnNSaTbLsL327mbxEun7uAX6cYUvaM0bTEuWfv_P8BCEKVT-i9YHJciZ4_mSn_D6YZHcMy5LS6Z0rUcR0Ng2eFZDLucLIk0MqEP9c Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 8e6cd2a845484563aec840ba55c20a0b Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-2090589087 Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e6cd2a845484563aec840ba55c20a0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e6cd2a845484563aec840ba55c20a0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e6cd2a845484563aec840ba55c20a0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e6cd2a845484563aec840ba55c20a0b", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-2090589087 Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 8e6cd2a845484563aec840ba55c20a0b Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2090589087 Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-2090589087-project Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 7231d55264f74b26b24a325e62469387 Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-2090589087-project Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance af5f2bd0-2527-48fa-b2be-b064b224c6b6 could not be found. Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'af5f2bd0-2527-48fa-b2be-b064b224c6b6'} Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af5f2bd0-2527-48fa-b2be-b064b224c6b6 could not be found. Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af5f2bd0-2527-48fa-b2be-b064b224c6b6 could not be found. Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:26:26.818693 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:26:26.827150 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:26:26.827150 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:26:26.827150 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:26:26.827150 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:26:26.827150 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:26:26.827150 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af5f2bd0-2527-48fa-b2be-b064b224c6b6 could not be found. Oct 11 00:26:26.827150 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:26:26.827150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1f89d396-50cc-4341-92e0-898b87714897 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Returning 404 to user: Instance af5f2bd0-2527-48fa-b2be-b064b224c6b6 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:26:26.827150 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1f89d396-50cc-4341-92e0-898b87714897 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6" status: 404 len: 111 microversion: 2.1 time: 0.032185 Oct 11 00:26:26.827150 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3379/7413] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:26 2022] GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:26:26.830044 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-add1bbbd-d1ac-4bb3-a998-c5444329ee5e tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:26.830740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-add1bbbd-d1ac-4bb3-a998-c5444329ee5e tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:26.837701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-add1bbbd-d1ac-4bb3-a998-c5444329ee5e tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:26.838213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-add1bbbd-d1ac-4bb3-a998-c5444329ee5e tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:26.838688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-add1bbbd-d1ac-4bb3-a998-c5444329ee5e tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:26.839386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-add1bbbd-d1ac-4bb3-a998-c5444329ee5e tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:26.839860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-add1bbbd-d1ac-4bb3-a998-c5444329ee5e tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:26.840305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-add1bbbd-d1ac-4bb3-a998-c5444329ee5e tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:26.978356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-add1bbbd-d1ac-4bb3-a998-c5444329ee5e tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:26.987561 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-add1bbbd-d1ac-4bb3-a998-c5444329ee5e tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04" status: 200 len: 1504 microversion: 2.1 time: 0.162074 Oct 11 00:26:26.988157 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4035/7414] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:26 2022] GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:27.010544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-be3a072f-95c3-4d17-92c9-b9aa1e75fb9d tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:26:27.012795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-be3a072f-95c3-4d17-92c9-b9aa1e75fb9d tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 4897c54a-6141-4516-8b94-d15762fcb70c] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:27.018530 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-be3a072f-95c3-4d17-92c9-b9aa1e75fb9d tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] HTTP exception thrown: Instance 4897c54a-6141-4516-8b94-d15762fcb70c could not be found. Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-be3a072f-95c3-4d17-92c9-b9aa1e75fb9d tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Request method failure captured: Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/4897c54a-6141-4516-8b94-d15762fcb70c/action HTTP/1.1 Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 32 Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLgXg3RJZbCUjyn0_qCZQ1taJIodryFuA0w6aguUSdRPeTAM5ff4yt6igaDAfGM_PNMVYPodz0pnNSaTbLsL327mbxEun7uAX6cYUvaM0bTEuWfv_P8BCEKVT-i9YHJciZ4_mSn_D6YZHcMy5LS6Z0rUcR0Ng2eFZDLucLIk0MqEP9c Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 8e6cd2a845484563aec840ba55c20a0b Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-2090589087 Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e6cd2a845484563aec840ba55c20a0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e6cd2a845484563aec840ba55c20a0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e6cd2a845484563aec840ba55c20a0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e6cd2a845484563aec840ba55c20a0b", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-2090589087 Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 8e6cd2a845484563aec840ba55c20a0b Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2090589087 Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-2090589087-project Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 7231d55264f74b26b24a325e62469387 Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-2090589087-project Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: {"resize": {"flavorRef": "452"}} Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 4897c54a-6141-4516-8b94-d15762fcb70c could not be found. Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '4897c54a-6141-4516-8b94-d15762fcb70c', 'body': {'resize': {'flavorRef': '452'}}} Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4897c54a-6141-4516-8b94-d15762fcb70c could not be found. Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:26:27.020138 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:26:27.025006 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4897c54a-6141-4516-8b94-d15762fcb70c could not be found. Oct 11 00:26:27.025006 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:26:27.025006 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:26:27.025006 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:26:27.025006 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:26:27.025006 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:26:27.025006 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:26:27.025006 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:26:27.025006 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:26:27.025006 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4897c54a-6141-4516-8b94-d15762fcb70c could not be found. Oct 11 00:26:27.025006 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:26:27.025006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-be3a072f-95c3-4d17-92c9-b9aa1e75fb9d tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Returning 404 to user: Instance 4897c54a-6141-4516-8b94-d15762fcb70c could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:26:27.025006 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-be3a072f-95c3-4d17-92c9-b9aa1e75fb9d tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "POST /compute/v2.1/servers/4897c54a-6141-4516-8b94-d15762fcb70c/action" status: 404 len: 111 microversion: 2.1 time: 0.014961 Oct 11 00:26:27.025006 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3380/7415] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:26:27 2022] POST /compute/v2.1/servers/4897c54a-6141-4516-8b94-d15762fcb70c/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:26:27.031618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-785b27a3-eec2-4423-8118-1867117a5375 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:27.032562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-785b27a3-eec2-4423-8118-1867117a5375 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:27.038389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-785b27a3-eec2-4423-8118-1867117a5375 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:27.038895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-785b27a3-eec2-4423-8118-1867117a5375 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:27.039352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-785b27a3-eec2-4423-8118-1867117a5375 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:27.040071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-785b27a3-eec2-4423-8118-1867117a5375 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:27.040551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-785b27a3-eec2-4423-8118-1867117a5375 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:27.040991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-785b27a3-eec2-4423-8118-1867117a5375 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:27.183960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-785b27a3-eec2-4423-8118-1867117a5375 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:27.187467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:26:27.193522 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-785b27a3-eec2-4423-8118-1867117a5375 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04" status: 200 len: 1504 microversion: 2.1 time: 0.165668 Oct 11 00:26:27.194105 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4036/7416] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:27 2022] GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:26:27.216469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a84cf464-0683-4fb0-93ca-89611c5becab tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:27.217084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a84cf464-0683-4fb0-93ca-89611c5becab tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:27.224225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a84cf464-0683-4fb0-93ca-89611c5becab tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:27.224716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a84cf464-0683-4fb0-93ca-89611c5becab tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:27.225162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a84cf464-0683-4fb0-93ca-89611c5becab tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:27.225892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a84cf464-0683-4fb0-93ca-89611c5becab tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:27.226350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a84cf464-0683-4fb0-93ca-89611c5becab tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:27.226782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a84cf464-0683-4fb0-93ca-89611c5becab tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:27.359741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a84cf464-0683-4fb0-93ca-89611c5becab tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:27.368195 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a84cf464-0683-4fb0-93ca-89611c5becab tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04" status: 200 len: 1504 microversion: 2.1 time: 0.155649 Oct 11 00:26:27.368771 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3381/7417] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:27 2022] GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:27.390805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-737e6b4d-a374-4baf-9769-1c600a46bf77 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "0e155cf6-7382-4e84-87f6-0d9b37eacaa9"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:26:27.393198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-737e6b4d-a374-4baf-9769-1c600a46bf77 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:27.400366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-737e6b4d-a374-4baf-9769-1c600a46bf77 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:27.400877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-737e6b4d-a374-4baf-9769-1c600a46bf77 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:27.401341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-737e6b4d-a374-4baf-9769-1c600a46bf77 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:27.402091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-737e6b4d-a374-4baf-9769-1c600a46bf77 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:27.402570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-737e6b4d-a374-4baf-9769-1c600a46bf77 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:27.403020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-737e6b4d-a374-4baf-9769-1c600a46bf77 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:27.446051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-737e6b4d-a374-4baf-9769-1c600a46bf77 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:27.451380 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-737e6b4d-a374-4baf-9769-1c600a46bf77 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] HTTP exception thrown: Flavor 0e155cf6-7382-4e84-87f6-0d9b37eacaa9 could not be found. Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-737e6b4d-a374-4baf-9769-1c600a46bf77 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Request method failure captured: Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: request: POST /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04/action HTTP/1.1 Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 65 Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLgXg3RJZbCUjyn0_qCZQ1taJIodryFuA0w6aguUSdRPeTAM5ff4yt6igaDAfGM_PNMVYPodz0pnNSaTbLsL327mbxEun7uAX6cYUvaM0bTEuWfv_P8BCEKVT-i9YHJciZ4_mSn_D6YZHcMy5LS6Z0rUcR0Ng2eFZDLucLIk0MqEP9c Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 8e6cd2a845484563aec840ba55c20a0b Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestJSON-2090589087 Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e6cd2a845484563aec840ba55c20a0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e6cd2a845484563aec840ba55c20a0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e6cd2a845484563aec840ba55c20a0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e6cd2a845484563aec840ba55c20a0b", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestJSON-2090589087 Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 8e6cd2a845484563aec840ba55c20a0b Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2090589087 Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestJSON-2090589087-project Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 7231d55264f74b26b24a325e62469387 Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestJSON-2090589087-project Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: {"resize": {"flavorRef": "0e155cf6-7382-4e84-87f6-0d9b37eacaa9"}} Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: exception: Flavor 0e155cf6-7382-4e84-87f6-0d9b37eacaa9 could not be found. Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '45a40a06-b2c3-493b-848d-aaafc31dad04', 'body': {'resize': {'flavorRef': '0e155cf6-7382-4e84-87f6-0d9b37eacaa9'}}} Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:26:27.453334 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 0e155cf6-7382-4e84-87f6-0d9b37eacaa9 could not be found. Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 0e155cf6-7382-4e84-87f6-0d9b37eacaa9 could not be found. Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 0e155cf6-7382-4e84-87f6-0d9b37eacaa9 could not be found. Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-737e6b4d-a374-4baf-9769-1c600a46bf77 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Returning 400 to user: Flavor 0e155cf6-7382-4e84-87f6-0d9b37eacaa9 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-737e6b4d-a374-4baf-9769-1c600a46bf77 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "POST /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04/action" status: 400 len: 107 microversion: 2.1 time: 0.068189 Oct 11 00:26:27.458783 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4037/7418] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:26:27 2022] POST /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04/action => generated 107 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 00:26:27.463667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d392a01d-a664-4c73-93d0-3785ed3b0d04 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:27.464281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d392a01d-a664-4c73-93d0-3785ed3b0d04 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:27.471247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d392a01d-a664-4c73-93d0-3785ed3b0d04 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:27.471727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d392a01d-a664-4c73-93d0-3785ed3b0d04 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:27.472167 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d392a01d-a664-4c73-93d0-3785ed3b0d04 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:27.472860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d392a01d-a664-4c73-93d0-3785ed3b0d04 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:27.473310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d392a01d-a664-4c73-93d0-3785ed3b0d04 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:27.473863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d392a01d-a664-4c73-93d0-3785ed3b0d04 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:27.626083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d392a01d-a664-4c73-93d0-3785ed3b0d04 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:27.634158 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d392a01d-a664-4c73-93d0-3785ed3b0d04 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04" status: 200 len: 1504 microversion: 2.1 time: 0.174253 Oct 11 00:26:27.634728 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3382/7419] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:27 2022] GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04 => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:27.658491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a99fec20-4026-4cce-9343-86b2ba102938 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:27.659078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a99fec20-4026-4cce-9343-86b2ba102938 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:27.665179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a99fec20-4026-4cce-9343-86b2ba102938 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:27.665732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a99fec20-4026-4cce-9343-86b2ba102938 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:27.666189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a99fec20-4026-4cce-9343-86b2ba102938 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:27.666912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a99fec20-4026-4cce-9343-86b2ba102938 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:27.667383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a99fec20-4026-4cce-9343-86b2ba102938 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:27.667833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a99fec20-4026-4cce-9343-86b2ba102938 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:27.803236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a99fec20-4026-4cce-9343-86b2ba102938 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:27.811807 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a99fec20-4026-4cce-9343-86b2ba102938 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04" status: 200 len: 1504 microversion: 2.1 time: 0.157630 Oct 11 00:26:27.821908 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4038/7420] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:27 2022] GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:27.834486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a565e63a-7a46-4880-bb56-18f72f073683 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a565e63a-7a46-4880-bb56-18f72f073683 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Request method failure captured: Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: request: POST /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04/action HTTP/1.1 Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 29 Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLgXg3RJZbCUjyn0_qCZQ1taJIodryFuA0w6aguUSdRPeTAM5ff4yt6igaDAfGM_PNMVYPodz0pnNSaTbLsL327mbxEun7uAX6cYUvaM0bTEuWfv_P8BCEKVT-i9YHJciZ4_mSn_D6YZHcMy5LS6Z0rUcR0Ng2eFZDLucLIk0MqEP9c Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 8e6cd2a845484563aec840ba55c20a0b Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-2090589087 Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e6cd2a845484563aec840ba55c20a0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e6cd2a845484563aec840ba55c20a0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e6cd2a845484563aec840ba55c20a0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e6cd2a845484563aec840ba55c20a0b", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-2090589087 Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 8e6cd2a845484563aec840ba55c20a0b Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2090589087 Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-2090589087-project Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 7231d55264f74b26b24a325e62469387 Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-2090589087-project Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: {"resize": {"flavorRef": ""}} Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '45a40a06-b2c3-493b-848d-aaafc31dad04', 'body': {'resize': {'flavorRef': ''}}} Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise error Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi '' Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:26:27.838061 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:26:27.842989 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:26:27.842989 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:26:27.842989 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:26:27.842989 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:26:27.842989 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 00:26:27.842989 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 00:26:27.842989 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 11 00:26:27.842989 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:26:27.842989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a565e63a-7a46-4880-bb56-18f72f073683 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:26:27.842989 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a565e63a-7a46-4880-bb56-18f72f073683 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "POST /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04/action" status: 400 len: 113 microversion: 2.1 time: 0.008974 Oct 11 00:26:27.842989 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3383/7421] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:26:27 2022] POST /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 00:26:27.848715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d8e526a7-05d0-44d4-9823-63bfa90677c1 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:27.849345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d8e526a7-05d0-44d4-9823-63bfa90677c1 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:27.856297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8e526a7-05d0-44d4-9823-63bfa90677c1 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:27.856790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8e526a7-05d0-44d4-9823-63bfa90677c1 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:27.857239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8e526a7-05d0-44d4-9823-63bfa90677c1 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:27.858152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8e526a7-05d0-44d4-9823-63bfa90677c1 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:27.858616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8e526a7-05d0-44d4-9823-63bfa90677c1 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:27.859056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d8e526a7-05d0-44d4-9823-63bfa90677c1 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:27.994850 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d8e526a7-05d0-44d4-9823-63bfa90677c1 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:28.003630 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d8e526a7-05d0-44d4-9823-63bfa90677c1 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04" status: 200 len: 1504 microversion: 2.1 time: 0.159475 Oct 11 00:26:28.004211 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4039/7422] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:27 2022] GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:26:28.030661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a43213cc-60d8-4e80-9589-86520731140c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:28.031157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a43213cc-60d8-4e80-9589-86520731140c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: af5f2bd0-2527-48fa-b2be-b064b224c6b6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:28.039259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43213cc-60d8-4e80-9589-86520731140c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:28.039781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43213cc-60d8-4e80-9589-86520731140c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:28.040228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43213cc-60d8-4e80-9589-86520731140c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:28.040934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43213cc-60d8-4e80-9589-86520731140c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:28.041417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43213cc-60d8-4e80-9589-86520731140c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:28.041861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a43213cc-60d8-4e80-9589-86520731140c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:28.057098 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-a43213cc-60d8-4e80-9589-86520731140c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] HTTP exception thrown: Instance af5f2bd0-2527-48fa-b2be-b064b224c6b6 could not be found. Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a43213cc-60d8-4e80-9589-86520731140c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Request method failure captured: Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6 HTTP/1.1 Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLgXg3RJZbCUjyn0_qCZQ1taJIodryFuA0w6aguUSdRPeTAM5ff4yt6igaDAfGM_PNMVYPodz0pnNSaTbLsL327mbxEun7uAX6cYUvaM0bTEuWfv_P8BCEKVT-i9YHJciZ4_mSn_D6YZHcMy5LS6Z0rUcR0Ng2eFZDLucLIk0MqEP9c Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 8e6cd2a845484563aec840ba55c20a0b Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-ServersNegativeTestJSON-2090589087 Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e6cd2a845484563aec840ba55c20a0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e6cd2a845484563aec840ba55c20a0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e6cd2a845484563aec840ba55c20a0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e6cd2a845484563aec840ba55c20a0b", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-ServersNegativeTestJSON-2090589087 Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 8e6cd2a845484563aec840ba55c20a0b Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2090589087 Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-ServersNegativeTestJSON-2090589087-project Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 7231d55264f74b26b24a325e62469387 Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-ServersNegativeTestJSON-2090589087-project Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance af5f2bd0-2527-48fa-b2be-b064b224c6b6 could not be found. Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'af5f2bd0-2527-48fa-b2be-b064b224c6b6'} Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af5f2bd0-2527-48fa-b2be-b064b224c6b6 could not be found. Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:26:28.058977 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:26:28.064614 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af5f2bd0-2527-48fa-b2be-b064b224c6b6 could not be found. Oct 11 00:26:28.064614 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:26:28.064614 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:26:28.064614 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:26:28.064614 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:26:28.064614 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:26:28.064614 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:26:28.064614 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:26:28.064614 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:26:28.064614 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af5f2bd0-2527-48fa-b2be-b064b224c6b6 could not be found. Oct 11 00:26:28.064614 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:26:28.064614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a43213cc-60d8-4e80-9589-86520731140c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Returning 404 to user: Instance af5f2bd0-2527-48fa-b2be-b064b224c6b6 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:26:28.064614 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a43213cc-60d8-4e80-9589-86520731140c tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "DELETE /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6" status: 404 len: 111 microversion: 2.1 time: 0.034400 Oct 11 00:26:28.064614 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3384/7423] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:26:28 2022] DELETE /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:26:28.070236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-64881f70-6a70-4e3e-8df3-9a551c8c4a24 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:28.070868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-64881f70-6a70-4e3e-8df3-9a551c8c4a24 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: af5f2bd0-2527-48fa-b2be-b064b224c6b6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:28.077181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64881f70-6a70-4e3e-8df3-9a551c8c4a24 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:28.077716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64881f70-6a70-4e3e-8df3-9a551c8c4a24 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:28.078173 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64881f70-6a70-4e3e-8df3-9a551c8c4a24 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:28.079787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64881f70-6a70-4e3e-8df3-9a551c8c4a24 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:28.080228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64881f70-6a70-4e3e-8df3-9a551c8c4a24 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:28.080669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-64881f70-6a70-4e3e-8df3-9a551c8c4a24 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:28.094614 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-64881f70-6a70-4e3e-8df3-9a551c8c4a24 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] HTTP exception thrown: Instance af5f2bd0-2527-48fa-b2be-b064b224c6b6 could not be found. Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-64881f70-6a70-4e3e-8df3-9a551c8c4a24 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Request method failure captured: Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6 HTTP/1.1 Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLgXg3RJZbCUjyn0_qCZQ1taJIodryFuA0w6aguUSdRPeTAM5ff4yt6igaDAfGM_PNMVYPodz0pnNSaTbLsL327mbxEun7uAX6cYUvaM0bTEuWfv_P8BCEKVT-i9YHJciZ4_mSn_D6YZHcMy5LS6Z0rUcR0Ng2eFZDLucLIk0MqEP9c Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 8e6cd2a845484563aec840ba55c20a0b Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestJSON-2090589087 Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e6cd2a845484563aec840ba55c20a0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e6cd2a845484563aec840ba55c20a0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e6cd2a845484563aec840ba55c20a0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e6cd2a845484563aec840ba55c20a0b", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestJSON-2090589087 Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 8e6cd2a845484563aec840ba55c20a0b Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2090589087 Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestJSON-2090589087-project Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 7231d55264f74b26b24a325e62469387 Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestJSON-2090589087-project Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance af5f2bd0-2527-48fa-b2be-b064b224c6b6 could not be found. Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'af5f2bd0-2527-48fa-b2be-b064b224c6b6'} Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af5f2bd0-2527-48fa-b2be-b064b224c6b6 could not be found. Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af5f2bd0-2527-48fa-b2be-b064b224c6b6 could not be found. Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:26:28.096198 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:26:28.100632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:26:28.100632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:26:28.100632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:26:28.100632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:26:28.100632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:26:28.100632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af5f2bd0-2527-48fa-b2be-b064b224c6b6 could not be found. Oct 11 00:26:28.100632 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:26:28.100632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-64881f70-6a70-4e3e-8df3-9a551c8c4a24 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Returning 404 to user: Instance af5f2bd0-2527-48fa-b2be-b064b224c6b6 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:26:28.100632 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-64881f70-6a70-4e3e-8df3-9a551c8c4a24 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6" status: 404 len: 111 microversion: 2.1 time: 0.031893 Oct 11 00:26:28.100632 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4040/7424] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:28 2022] GET /compute/v2.1/servers/af5f2bd0-2527-48fa-b2be-b064b224c6b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 00:26:28.106519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-38a193ed-a838-414d-88f2-d354dd3534b3 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:28.107016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-38a193ed-a838-414d-88f2-d354dd3534b3 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:28.113527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38a193ed-a838-414d-88f2-d354dd3534b3 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:28.114011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38a193ed-a838-414d-88f2-d354dd3534b3 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:28.114439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38a193ed-a838-414d-88f2-d354dd3534b3 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:28.115123 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38a193ed-a838-414d-88f2-d354dd3534b3 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:28.115572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38a193ed-a838-414d-88f2-d354dd3534b3 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:28.115991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-38a193ed-a838-414d-88f2-d354dd3534b3 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:28.144813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-38a193ed-a838-414d-88f2-d354dd3534b3 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:26:28.508763 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-38a193ed-a838-414d-88f2-d354dd3534b3 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "DELETE /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04" status: 204 len: 0 microversion: 2.1 time: 0.405769 Oct 11 00:26:28.509358 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3385/7425] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:26:28 2022] DELETE /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:26:28.519583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0f700715-0083-41c7-9f4e-c7d541072102 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:28.520587 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0f700715-0083-41c7-9f4e-c7d541072102 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:28.528551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f700715-0083-41c7-9f4e-c7d541072102 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:28.529057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f700715-0083-41c7-9f4e-c7d541072102 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:28.529547 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f700715-0083-41c7-9f4e-c7d541072102 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:28.530273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f700715-0083-41c7-9f4e-c7d541072102 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:28.530745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f700715-0083-41c7-9f4e-c7d541072102 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:28.531221 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0f700715-0083-41c7-9f4e-c7d541072102 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:28.674507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0f700715-0083-41c7-9f4e-c7d541072102 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:28.682743 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0f700715-0083-41c7-9f4e-c7d541072102 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04" status: 200 len: 1510 microversion: 2.1 time: 0.168988 Oct 11 00:26:28.683327 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4041/7426] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:28 2022] GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:26:29.708561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3c763233-ddcb-494a-a80c-f5c22f7e3dd7 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:29.709262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3c763233-ddcb-494a-a80c-f5c22f7e3dd7 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:29.716489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c763233-ddcb-494a-a80c-f5c22f7e3dd7 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:29.717000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c763233-ddcb-494a-a80c-f5c22f7e3dd7 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:29.717473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c763233-ddcb-494a-a80c-f5c22f7e3dd7 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:29.718172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c763233-ddcb-494a-a80c-f5c22f7e3dd7 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:29.718626 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c763233-ddcb-494a-a80c-f5c22f7e3dd7 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:29.719064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c763233-ddcb-494a-a80c-f5c22f7e3dd7 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:29.738547 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:26:29.861977 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3c763233-ddcb-494a-a80c-f5c22f7e3dd7 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:29.869683 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3c763233-ddcb-494a-a80c-f5c22f7e3dd7 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04" status: 200 len: 1510 microversion: 2.1 time: 0.166195 Oct 11 00:26:29.870461 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3386/7427] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:29 2022] GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:30.611763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-62295f98-0b2e-4d25-939c-bc5ecd7fa57c req-e22de611-f114-4c29-9851-f1b9e5a5ac0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45a40a06-b2c3-493b-848d-aaafc31dad04", "name": "network-vif-deleted", "tag": "a64f3ef8-b3f4-4f42-afa6-e19c4aac9ec1"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:26:30.622411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-62295f98-0b2e-4d25-939c-bc5ecd7fa57c req-e22de611-f114-4c29-9851-f1b9e5a5ac0a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:30.622988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-62295f98-0b2e-4d25-939c-bc5ecd7fa57c req-e22de611-f114-4c29-9851-f1b9e5a5ac0a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:30.623476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-62295f98-0b2e-4d25-939c-bc5ecd7fa57c req-e22de611-f114-4c29-9851-f1b9e5a5ac0a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:30.644159 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-62295f98-0b2e-4d25-939c-bc5ecd7fa57c req-e22de611-f114-4c29-9851-f1b9e5a5ac0a service nova] Creating event network-vif-deleted:a64f3ef8-b3f4-4f42-afa6-e19c4aac9ec1 for instance 45a40a06-b2c3-493b-848d-aaafc31dad04 on n-h1-860864-2 Oct 11 00:26:30.649941 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-62295f98-0b2e-4d25-939c-bc5ecd7fa57c req-e22de611-f114-4c29-9851-f1b9e5a5ac0a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042449 Oct 11 00:26:30.650575 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4042/7428] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:26:30.895860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0d8d3478-4ea0-4c25-95dc-e4f8bf700e27 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:30.896474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0d8d3478-4ea0-4c25-95dc-e4f8bf700e27 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:30.899338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:26:30.911120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d8d3478-4ea0-4c25-95dc-e4f8bf700e27 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:30.911615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d8d3478-4ea0-4c25-95dc-e4f8bf700e27 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:30.912070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d8d3478-4ea0-4c25-95dc-e4f8bf700e27 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:30.913135 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d8d3478-4ea0-4c25-95dc-e4f8bf700e27 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:30.914108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d8d3478-4ea0-4c25-95dc-e4f8bf700e27 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:30.914766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d8d3478-4ea0-4c25-95dc-e4f8bf700e27 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:30.971208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d8d3478-4ea0-4c25-95dc-e4f8bf700e27 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:30.972869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d8d3478-4ea0-4c25-95dc-e4f8bf700e27 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:30.973898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d8d3478-4ea0-4c25-95dc-e4f8bf700e27 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:30.974688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-0d8d3478-4ea0-4c25-95dc-e4f8bf700e27 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lazy-loading 'fault' on Instance uuid 45a40a06-b2c3-493b-848d-aaafc31dad04 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:26:31.025220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0d8d3478-4ea0-4c25-95dc-e4f8bf700e27 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231d55264f74b26b24a325e62469387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6cd2a845484563aec840ba55c20a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:26:31.036406 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0d8d3478-4ea0-4c25-95dc-e4f8bf700e27 tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04" status: 200 len: 1306 microversion: 2.1 time: 0.145472 Oct 11 00:26:31.037036 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3387/7429] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:30 2022] GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04 => generated 1306 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:26:32.063047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-491a228a-fdf6-4c3a-b32e-3ab45c911cec tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:26:32.064149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-491a228a-fdf6-4c3a-b32e-3ab45c911cec tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] [instance: 45a40a06-b2c3-493b-848d-aaafc31dad04] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:26:32.065901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:26:32.075319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-491a228a-fdf6-4c3a-b32e-3ab45c911cec tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:32.075760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-491a228a-fdf6-4c3a-b32e-3ab45c911cec tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:32.076213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-491a228a-fdf6-4c3a-b32e-3ab45c911cec tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:32.076933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-491a228a-fdf6-4c3a-b32e-3ab45c911cec tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:26:32.077474 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-491a228a-fdf6-4c3a-b32e-3ab45c911cec tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:26:32.077871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-491a228a-fdf6-4c3a-b32e-3ab45c911cec tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:26:32.101161 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-491a228a-fdf6-4c3a-b32e-3ab45c911cec tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] HTTP exception thrown: Instance 45a40a06-b2c3-493b-848d-aaafc31dad04 could not be found. Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-491a228a-fdf6-4c3a-b32e-3ab45c911cec tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Request method failure captured: Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04 HTTP/1.1 Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLgXg3RJZbCUjyn0_qCZQ1taJIodryFuA0w6aguUSdRPeTAM5ff4yt6igaDAfGM_PNMVYPodz0pnNSaTbLsL327mbxEun7uAX6cYUvaM0bTEuWfv_P8BCEKVT-i9YHJciZ4_mSn_D6YZHcMy5LS6Z0rUcR0Ng2eFZDLucLIk0MqEP9c Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 8e6cd2a845484563aec840ba55c20a0b Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-ServersNegativeTestJSON-2090589087 Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e6cd2a845484563aec840ba55c20a0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e6cd2a845484563aec840ba55c20a0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e6cd2a845484563aec840ba55c20a0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e6cd2a845484563aec840ba55c20a0b", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-ServersNegativeTestJSON-2090589087 Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 8e6cd2a845484563aec840ba55c20a0b Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2090589087 Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-ServersNegativeTestJSON-2090589087-project Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 7231d55264f74b26b24a325e62469387 Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-ServersNegativeTestJSON-2090589087-project Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 45a40a06-b2c3-493b-848d-aaafc31dad04 could not be found. Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '45a40a06-b2c3-493b-848d-aaafc31dad04'} Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45a40a06-b2c3-493b-848d-aaafc31dad04 could not be found. Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45a40a06-b2c3-493b-848d-aaafc31dad04 could not be found. Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:26:32.102906 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:26:32.111812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:26:32.111812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:26:32.111812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:26:32.111812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:26:32.111812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:26:32.111812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45a40a06-b2c3-493b-848d-aaafc31dad04 could not be found. Oct 11 00:26:32.111812 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:26:32.111812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-491a228a-fdf6-4c3a-b32e-3ab45c911cec tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] Returning 404 to user: Instance 45a40a06-b2c3-493b-848d-aaafc31dad04 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:26:32.111812 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-491a228a-fdf6-4c3a-b32e-3ab45c911cec tempest-ServersNegativeTestJSON-2090589087 tempest-ServersNegativeTestJSON-2090589087-project] 10.222.0.23 "GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04" status: 404 len: 111 microversion: 2.1 time: 0.046708 Oct 11 00:26:32.111812 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4043/7430] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:26:32 2022] GET /compute/v2.1/servers/45a40a06-b2c3-493b-848d-aaafc31dad04 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:27:07.200255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:27:07.201992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=10 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:27:07.430193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7fda36be-ddf3-458e-a520-93397b712b6e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Action: 'create', calling method: .version_select at 0x7f662a1003a0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1173722936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBMW6Ftv9CZOPW+xooTmImCXffeHoXgamFZdo2/+nuoNUL5LDh8Lpq46IWmFWf2J8z9ZnAiVl3AO/EekX9B2IMNw7hqofdSr6gvlKXht0LY/375RDm0a4RwpeBKq1ZRDw=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:27:07.447249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-7fda36be-ddf3-458e-a520-93397b712b6e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Getting quotas for project 9c9f9ee9368546b89f207a9eb5c5165f. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:27:07.452631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-7fda36be-ddf3-458e-a520-93397b712b6e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Getting quotas for user 573a47f88384410fbbca9a397fa3ffc5 and project 9c9f9ee9368546b89f207a9eb5c5165f. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:27:07.482568 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7fda36be-ddf3-458e-a520-93397b712b6e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.283624 Oct 11 00:27:07.483183 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3388/7431] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 11 00:27:07 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:27:07.536672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e959d7b0-4001-479f-8484-08d60c2af362 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2124132653", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1173722936", "networks": [{"uuid": "3275473c-f018-44e4-9e6c-78c273af5848"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:27:07.546101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=28 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:27:07.547358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:27:07.601511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-e959d7b0-4001-479f-8484-08d60c2af362 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] validate_networks() for [('3275473c-f018-44e4-9e6c-78c273af5848', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:27:08.007160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e959d7b0-4001-479f-8484-08d60c2af362 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:27:08.007990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e959d7b0-4001-479f-8484-08d60c2af362 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:27:08.008657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e959d7b0-4001-479f-8484-08d60c2af362 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:27:08.009174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e959d7b0-4001-479f-8484-08d60c2af362 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:27:08.009714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-e959d7b0-4001-479f-8484-08d60c2af362 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:27:08.023935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e959d7b0-4001-479f-8484-08d60c2af362 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:08.024449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e959d7b0-4001-479f-8484-08d60c2af362 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:08.024909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e959d7b0-4001-479f-8484-08d60c2af362 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:08.026641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e959d7b0-4001-479f-8484-08d60c2af362 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:08.027125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e959d7b0-4001-479f-8484-08d60c2af362 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:08.027585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e959d7b0-4001-479f-8484-08d60c2af362 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:08.059253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-e959d7b0-4001-479f-8484-08d60c2af362 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Getting quotas for project 9c9f9ee9368546b89f207a9eb5c5165f. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:27:08.065559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-e959d7b0-4001-479f-8484-08d60c2af362 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Getting quotas for user 573a47f88384410fbbca9a397fa3ffc5 and project 9c9f9ee9368546b89f207a9eb5c5165f. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:27:08.081628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e959d7b0-4001-479f-8484-08d60c2af362 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:27:08.084770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e959d7b0-4001-479f-8484-08d60c2af362 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:27:08.136452 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e959d7b0-4001-479f-8484-08d60c2af362 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604323 Oct 11 00:27:08.137794 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4044/7432] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:27:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:27:08.151568 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b43752ac-1651-44cc-ba3a-0c584b221ffb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:08.152269 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b43752ac-1651-44cc-ba3a-0c584b221ffb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:08.215614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b43752ac-1651-44cc-ba3a-0c584b221ffb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:08.224812 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b43752ac-1651-44cc-ba3a-0c584b221ffb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1" status: 200 len: 1263 microversion: 2.1 time: 0.077047 Oct 11 00:27:08.225761 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3389/7433] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:08 2022] GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1 => generated 1263 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:27:09.252968 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2681c172-21d6-45da-88a1-1684f20831dd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:09.253666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2681c172-21d6-45da-88a1-1684f20831dd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:09.262209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2681c172-21d6-45da-88a1-1684f20831dd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:09.263120 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2681c172-21d6-45da-88a1-1684f20831dd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:09.266674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2681c172-21d6-45da-88a1-1684f20831dd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:09.267725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2681c172-21d6-45da-88a1-1684f20831dd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:09.268462 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2681c172-21d6-45da-88a1-1684f20831dd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:09.268945 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2681c172-21d6-45da-88a1-1684f20831dd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:09.374605 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2681c172-21d6-45da-88a1-1684f20831dd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:09.383989 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2681c172-21d6-45da-88a1-1684f20831dd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1" status: 200 len: 1333 microversion: 2.1 time: 0.138226 Oct 11 00:27:09.384631 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4045/7434] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:09 2022] GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1 => generated 1333 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:27:10.412436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e0b55034-9626-40e6-a07f-e0a16110bfc3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:10.413644 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e0b55034-9626-40e6-a07f-e0a16110bfc3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:10.422259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0b55034-9626-40e6-a07f-e0a16110bfc3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:10.423090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0b55034-9626-40e6-a07f-e0a16110bfc3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:10.424261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0b55034-9626-40e6-a07f-e0a16110bfc3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:10.425287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0b55034-9626-40e6-a07f-e0a16110bfc3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:10.426322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0b55034-9626-40e6-a07f-e0a16110bfc3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:10.427005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0b55034-9626-40e6-a07f-e0a16110bfc3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:10.640540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e0b55034-9626-40e6-a07f-e0a16110bfc3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:10.654447 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e0b55034-9626-40e6-a07f-e0a16110bfc3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1" status: 200 len: 1363 microversion: 2.1 time: 0.245080 Oct 11 00:27:10.654447 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3390/7435] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:10 2022] GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:27:10.994493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-58d87a64-65ee-4f9a-9ed4-6b959d44f2d6 req-6bb301d8-a538-4478-bf2d-ca69ede40e2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26ae06f7-1933-47b1-ba9f-04bdb413ffc1", "tag": "472845bf-ce05-4c44-93a7-835ac95fc41f"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:27:11.008871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-58d87a64-65ee-4f9a-9ed4-6b959d44f2d6 req-6bb301d8-a538-4478-bf2d-ca69ede40e2b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:11.009717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-58d87a64-65ee-4f9a-9ed4-6b959d44f2d6 req-6bb301d8-a538-4478-bf2d-ca69ede40e2b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:11.010996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-58d87a64-65ee-4f9a-9ed4-6b959d44f2d6 req-6bb301d8-a538-4478-bf2d-ca69ede40e2b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:11.031252 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-58d87a64-65ee-4f9a-9ed4-6b959d44f2d6 req-6bb301d8-a538-4478-bf2d-ca69ede40e2b service nova] Creating event network-changed:472845bf-ce05-4c44-93a7-835ac95fc41f for instance 26ae06f7-1933-47b1-ba9f-04bdb413ffc1 on n-h1-860864-2 Oct 11 00:27:11.038831 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-58d87a64-65ee-4f9a-9ed4-6b959d44f2d6 req-6bb301d8-a538-4478-bf2d-ca69ede40e2b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052557 Oct 11 00:27:11.041348 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4046/7436] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:27:11.678195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-073cc583-5ec9-4201-b9d9-c61817c51703 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:11.678814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-073cc583-5ec9-4201-b9d9-c61817c51703 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:11.686653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-073cc583-5ec9-4201-b9d9-c61817c51703 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:11.686996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-073cc583-5ec9-4201-b9d9-c61817c51703 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:11.687478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-073cc583-5ec9-4201-b9d9-c61817c51703 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:11.688371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-073cc583-5ec9-4201-b9d9-c61817c51703 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:11.688829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-073cc583-5ec9-4201-b9d9-c61817c51703 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:11.689260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-073cc583-5ec9-4201-b9d9-c61817c51703 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:11.830018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-073cc583-5ec9-4201-b9d9-c61817c51703 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:11.837880 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-073cc583-5ec9-4201-b9d9-c61817c51703 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1" status: 200 len: 1363 microversion: 2.1 time: 0.163705 Oct 11 00:27:11.838458 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3391/7437] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:11 2022] GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:27:12.864390 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ed736b7e-7127-4299-9aed-e23ed047e808 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:12.865124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ed736b7e-7127-4299-9aed-e23ed047e808 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:12.871612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed736b7e-7127-4299-9aed-e23ed047e808 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:12.872112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed736b7e-7127-4299-9aed-e23ed047e808 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:12.872589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed736b7e-7127-4299-9aed-e23ed047e808 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:12.873306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed736b7e-7127-4299-9aed-e23ed047e808 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:12.873801 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed736b7e-7127-4299-9aed-e23ed047e808 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:12.874261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ed736b7e-7127-4299-9aed-e23ed047e808 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:13.013033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ed736b7e-7127-4299-9aed-e23ed047e808 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:13.021308 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ed736b7e-7127-4299-9aed-e23ed047e808 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1" status: 200 len: 1363 microversion: 2.1 time: 0.162672 Oct 11 00:27:13.021925 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4047/7438] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:12 2022] GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:27:14.044538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bc37ba21-a184-43a2-b5ef-68cd22e7e977 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:14.045271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bc37ba21-a184-43a2-b5ef-68cd22e7e977 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:14.053583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc37ba21-a184-43a2-b5ef-68cd22e7e977 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:14.054145 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc37ba21-a184-43a2-b5ef-68cd22e7e977 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:14.054533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc37ba21-a184-43a2-b5ef-68cd22e7e977 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:14.055240 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc37ba21-a184-43a2-b5ef-68cd22e7e977 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:14.055699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc37ba21-a184-43a2-b5ef-68cd22e7e977 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:14.056385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc37ba21-a184-43a2-b5ef-68cd22e7e977 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:14.202130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bc37ba21-a184-43a2-b5ef-68cd22e7e977 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:14.210553 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bc37ba21-a184-43a2-b5ef-68cd22e7e977 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1" status: 200 len: 1363 microversion: 2.1 time: 0.170202 Oct 11 00:27:14.211143 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3392/7439] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:14 2022] GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:27:15.233110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-26e98833-e862-4a9b-ab22-6ffe395ca27e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:15.233819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-26e98833-e862-4a9b-ab22-6ffe395ca27e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:15.241714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26e98833-e862-4a9b-ab22-6ffe395ca27e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:15.242228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26e98833-e862-4a9b-ab22-6ffe395ca27e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:15.242687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26e98833-e862-4a9b-ab22-6ffe395ca27e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:15.243412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26e98833-e862-4a9b-ab22-6ffe395ca27e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:15.243902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26e98833-e862-4a9b-ab22-6ffe395ca27e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:15.244347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-26e98833-e862-4a9b-ab22-6ffe395ca27e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:15.381219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-26e98833-e862-4a9b-ab22-6ffe395ca27e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:15.388980 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-26e98833-e862-4a9b-ab22-6ffe395ca27e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1" status: 200 len: 1363 microversion: 2.1 time: 0.159768 Oct 11 00:27:15.389597 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4048/7440] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:15 2022] GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:27:16.413090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e8104711-c525-499e-b867-f5526be03d23 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:16.413722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e8104711-c525-499e-b867-f5526be03d23 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:16.420474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8104711-c525-499e-b867-f5526be03d23 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:16.420959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8104711-c525-499e-b867-f5526be03d23 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:16.421413 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8104711-c525-499e-b867-f5526be03d23 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:16.422657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8104711-c525-499e-b867-f5526be03d23 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:16.423107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8104711-c525-499e-b867-f5526be03d23 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:16.423539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8104711-c525-499e-b867-f5526be03d23 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:16.560261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e8104711-c525-499e-b867-f5526be03d23 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:16.568915 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e8104711-c525-499e-b867-f5526be03d23 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1" status: 200 len: 1363 microversion: 2.1 time: 0.159759 Oct 11 00:27:16.569528 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3393/7441] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:16 2022] GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:27:17.485660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-87d6fada-86d6-4ef0-bceb-b059a5c44a13 req-38802c12-be38-4c6c-b322-a1e0ff92b54b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26ae06f7-1933-47b1-ba9f-04bdb413ffc1", "name": "network-vif-plugged", "status": "completed", "tag": "472845bf-ce05-4c44-93a7-835ac95fc41f"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:27:17.495396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-87d6fada-86d6-4ef0-bceb-b059a5c44a13 req-38802c12-be38-4c6c-b322-a1e0ff92b54b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:17.495891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-87d6fada-86d6-4ef0-bceb-b059a5c44a13 req-38802c12-be38-4c6c-b322-a1e0ff92b54b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:17.496344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-87d6fada-86d6-4ef0-bceb-b059a5c44a13 req-38802c12-be38-4c6c-b322-a1e0ff92b54b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:17.508035 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-87d6fada-86d6-4ef0-bceb-b059a5c44a13 req-38802c12-be38-4c6c-b322-a1e0ff92b54b service nova] Creating event network-vif-plugged:472845bf-ce05-4c44-93a7-835ac95fc41f for instance 26ae06f7-1933-47b1-ba9f-04bdb413ffc1 on n-h1-860864-2 Oct 11 00:27:17.513232 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-87d6fada-86d6-4ef0-bceb-b059a5c44a13 req-38802c12-be38-4c6c-b322-a1e0ff92b54b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098809 Oct 11 00:27:17.513948 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4049/7442] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:27:17.592025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-af73062e-da38-451c-88a1-b0949ca319df tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:17.592648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-af73062e-da38-451c-88a1-b0949ca319df tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:17.600381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af73062e-da38-451c-88a1-b0949ca319df tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:17.600863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af73062e-da38-451c-88a1-b0949ca319df tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:17.601293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af73062e-da38-451c-88a1-b0949ca319df tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:17.602044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af73062e-da38-451c-88a1-b0949ca319df tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:17.602493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af73062e-da38-451c-88a1-b0949ca319df tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:17.602915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af73062e-da38-451c-88a1-b0949ca319df tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:17.756346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-af73062e-da38-451c-88a1-b0949ca319df tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:17.764353 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-af73062e-da38-451c-88a1-b0949ca319df tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1" status: 200 len: 1363 microversion: 2.1 time: 0.176244 Oct 11 00:27:17.764860 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3394/7443] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:17 2022] GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:27:18.785510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:27:18.786313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:27:18.791924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-46ffe3cf-5261-4bd5-8131-7bf1255cca35 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:18.792646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-46ffe3cf-5261-4bd5-8131-7bf1255cca35 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:18.801358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46ffe3cf-5261-4bd5-8131-7bf1255cca35 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:18.801905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46ffe3cf-5261-4bd5-8131-7bf1255cca35 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:18.802356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46ffe3cf-5261-4bd5-8131-7bf1255cca35 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:18.803215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46ffe3cf-5261-4bd5-8131-7bf1255cca35 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:18.803712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46ffe3cf-5261-4bd5-8131-7bf1255cca35 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:18.804136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46ffe3cf-5261-4bd5-8131-7bf1255cca35 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:18.954391 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-46ffe3cf-5261-4bd5-8131-7bf1255cca35 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:18.963335 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-46ffe3cf-5261-4bd5-8131-7bf1255cca35 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1" status: 200 len: 1363 microversion: 2.1 time: 0.178728 Oct 11 00:27:18.978002 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4050/7444] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:18 2022] GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1 => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:27:19.987867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-98efe318-0119-43aa-8f64-77a57e05ab4c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:19.988480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-98efe318-0119-43aa-8f64-77a57e05ab4c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:19.990400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:27:19.996784 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98efe318-0119-43aa-8f64-77a57e05ab4c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:19.997281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98efe318-0119-43aa-8f64-77a57e05ab4c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:19.997830 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98efe318-0119-43aa-8f64-77a57e05ab4c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:19.998612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98efe318-0119-43aa-8f64-77a57e05ab4c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:19.999100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98efe318-0119-43aa-8f64-77a57e05ab4c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:19.999536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-98efe318-0119-43aa-8f64-77a57e05ab4c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:20.137279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-98efe318-0119-43aa-8f64-77a57e05ab4c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:20.145806 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-98efe318-0119-43aa-8f64-77a57e05ab4c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1" status: 200 len: 1555 microversion: 2.1 time: 0.162465 Oct 11 00:27:20.146503 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3395/7445] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:19 2022] GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:27:20.168709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4b818f3a-7243-4ec4-b9b8-87eac885c9c1 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:20.169600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4b818f3a-7243-4ec4-b9b8-87eac885c9c1 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:20.177051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b818f3a-7243-4ec4-b9b8-87eac885c9c1 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:20.177599 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b818f3a-7243-4ec4-b9b8-87eac885c9c1 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:20.178055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b818f3a-7243-4ec4-b9b8-87eac885c9c1 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:20.178781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b818f3a-7243-4ec4-b9b8-87eac885c9c1 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:20.179251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b818f3a-7243-4ec4-b9b8-87eac885c9c1 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:20.179697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4b818f3a-7243-4ec4-b9b8-87eac885c9c1 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:20.318921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4b818f3a-7243-4ec4-b9b8-87eac885c9c1 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:20.327031 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4b818f3a-7243-4ec4-b9b8-87eac885c9c1 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1" status: 200 len: 1555 microversion: 2.1 time: 0.162508 Oct 11 00:27:20.327640 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4051/7446] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:20 2022] GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:27:22.044020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9b344f86-e364-4d8e-aeeb-059d0a129696 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6cc49b85-40a0-41a0-bb28-95a80045330f"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:27:22.046459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9b344f86-e364-4d8e-aeeb-059d0a129696 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:22.053956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b344f86-e364-4d8e-aeeb-059d0a129696 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:22.054444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b344f86-e364-4d8e-aeeb-059d0a129696 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:22.054881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b344f86-e364-4d8e-aeeb-059d0a129696 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:22.055587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b344f86-e364-4d8e-aeeb-059d0a129696 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:22.056299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b344f86-e364-4d8e-aeeb-059d0a129696 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:22.056729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9b344f86-e364-4d8e-aeeb-059d0a129696 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:22.505296 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9b344f86-e364-4d8e-aeeb-059d0a129696 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "POST /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.465096 Oct 11 00:27:22.506400 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3396/7447] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 11 00:27:22 2022] POST /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1/os-volume_attachments => generated 194 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:27:33.267678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4483e572-8ca1-47e6-9d72-b199689e70e4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:33.268297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4483e572-8ca1-47e6-9d72-b199689e70e4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:33.271166 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:27:33.272101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=36 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:27:33.279333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4483e572-8ca1-47e6-9d72-b199689e70e4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:33.279853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4483e572-8ca1-47e6-9d72-b199689e70e4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:33.280316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4483e572-8ca1-47e6-9d72-b199689e70e4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:33.281056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4483e572-8ca1-47e6-9d72-b199689e70e4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:33.281557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4483e572-8ca1-47e6-9d72-b199689e70e4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:33.282889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4483e572-8ca1-47e6-9d72-b199689e70e4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:33.370466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-4483e572-8ca1-47e6-9d72-b199689e70e4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lazy-loading 'services' on Instance uuid 26ae06f7-1933-47b1-ba9f-04bdb413ffc1 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:27:33.448669 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4483e572-8ca1-47e6-9d72-b199689e70e4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "DELETE /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1/os-volume_attachments/6cc49b85-40a0-41a0-bb28-95a80045330f" status: 202 len: 0 microversion: 2.1 time: 0.185070 Oct 11 00:27:33.449316 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4052/7448] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 11 00:27:33 2022] DELETE /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1/os-volume_attachments/6cc49b85-40a0-41a0-bb28-95a80045330f => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:27:33.456272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:27:33.457064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:27:33.461961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-78fd7374-3045-460b-ba4d-9c01e23a172b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:33.464323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-78fd7374-3045-460b-ba4d-9c01e23a172b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:33.484386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78fd7374-3045-460b-ba4d-9c01e23a172b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:33.485881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78fd7374-3045-460b-ba4d-9c01e23a172b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:33.486322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78fd7374-3045-460b-ba4d-9c01e23a172b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:33.488352 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78fd7374-3045-460b-ba4d-9c01e23a172b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:33.488838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78fd7374-3045-460b-ba4d-9c01e23a172b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:33.489290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-78fd7374-3045-460b-ba4d-9c01e23a172b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:33.526897 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-78fd7374-3045-460b-ba4d-9c01e23a172b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072825 Oct 11 00:27:33.527611 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3397/7449] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:27:33 2022] GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:27:34.541299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-31dca1d6-85e2-43d3-9f2b-4d46f1d287eb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:34.543820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-31dca1d6-85e2-43d3-9f2b-4d46f1d287eb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:34.551568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-31dca1d6-85e2-43d3-9f2b-4d46f1d287eb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:34.552066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-31dca1d6-85e2-43d3-9f2b-4d46f1d287eb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:34.552518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-31dca1d6-85e2-43d3-9f2b-4d46f1d287eb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:34.553227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-31dca1d6-85e2-43d3-9f2b-4d46f1d287eb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:34.553715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-31dca1d6-85e2-43d3-9f2b-4d46f1d287eb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:34.554157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-31dca1d6-85e2-43d3-9f2b-4d46f1d287eb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:34.593457 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-31dca1d6-85e2-43d3-9f2b-4d46f1d287eb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056447 Oct 11 00:27:34.594040 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4053/7450] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:27:34 2022] GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:27:35.605864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0613567e-21ad-43c2-a16f-da256fea2052 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:35.608067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0613567e-21ad-43c2-a16f-da256fea2052 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:35.615436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0613567e-21ad-43c2-a16f-da256fea2052 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:35.615930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0613567e-21ad-43c2-a16f-da256fea2052 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:35.616379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0613567e-21ad-43c2-a16f-da256fea2052 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:35.617092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0613567e-21ad-43c2-a16f-da256fea2052 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:35.617570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0613567e-21ad-43c2-a16f-da256fea2052 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:35.618005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0613567e-21ad-43c2-a16f-da256fea2052 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:35.652218 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0613567e-21ad-43c2-a16f-da256fea2052 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050274 Oct 11 00:27:35.652802 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3398/7451] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:27:35 2022] GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:27:36.664533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9305085e-005a-4e75-8039-9fd854bff11c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:36.666896 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9305085e-005a-4e75-8039-9fd854bff11c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:36.674848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9305085e-005a-4e75-8039-9fd854bff11c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:36.675354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9305085e-005a-4e75-8039-9fd854bff11c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:36.675813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9305085e-005a-4e75-8039-9fd854bff11c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:36.676530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9305085e-005a-4e75-8039-9fd854bff11c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:36.677014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9305085e-005a-4e75-8039-9fd854bff11c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:36.677483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9305085e-005a-4e75-8039-9fd854bff11c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:36.709307 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9305085e-005a-4e75-8039-9fd854bff11c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048764 Oct 11 00:27:36.714368 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4054/7452] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:27:36 2022] GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:27:37.722327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-247c39ec-5ffa-4a6d-9a3a-4b4871817d18 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:37.725179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-247c39ec-5ffa-4a6d-9a3a-4b4871817d18 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:37.732131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-247c39ec-5ffa-4a6d-9a3a-4b4871817d18 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:37.732620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-247c39ec-5ffa-4a6d-9a3a-4b4871817d18 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:37.733069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-247c39ec-5ffa-4a6d-9a3a-4b4871817d18 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:37.733803 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-247c39ec-5ffa-4a6d-9a3a-4b4871817d18 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:37.734264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-247c39ec-5ffa-4a6d-9a3a-4b4871817d18 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:37.734695 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-247c39ec-5ffa-4a6d-9a3a-4b4871817d18 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:37.765388 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-247c39ec-5ffa-4a6d-9a3a-4b4871817d18 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046971 Oct 11 00:27:37.766061 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3399/7453] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:27:37 2022] GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:27:38.778326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-abc746a0-5670-4d49-968e-a70cb31d546d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:38.780510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-abc746a0-5670-4d49-968e-a70cb31d546d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:38.787138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abc746a0-5670-4d49-968e-a70cb31d546d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:38.787636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abc746a0-5670-4d49-968e-a70cb31d546d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:38.788085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abc746a0-5670-4d49-968e-a70cb31d546d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:38.788789 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abc746a0-5670-4d49-968e-a70cb31d546d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:38.789256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abc746a0-5670-4d49-968e-a70cb31d546d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:38.789721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abc746a0-5670-4d49-968e-a70cb31d546d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:38.823025 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-abc746a0-5670-4d49-968e-a70cb31d546d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048784 Oct 11 00:27:38.823613 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4055/7454] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:27:38 2022] GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 00:27:38.835285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-26128650-209f-4454-afde-ab025c55a156 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:38.835799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-26128650-209f-4454-afde-ab025c55a156 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:38.842561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26128650-209f-4454-afde-ab025c55a156 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:38.843047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26128650-209f-4454-afde-ab025c55a156 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:38.843488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26128650-209f-4454-afde-ab025c55a156 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:38.844179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26128650-209f-4454-afde-ab025c55a156 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:38.844631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26128650-209f-4454-afde-ab025c55a156 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:38.845063 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26128650-209f-4454-afde-ab025c55a156 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:38.922059 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-26128650-209f-4454-afde-ab025c55a156 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] HTTP exception thrown: Instance 26ae06f7-1933-47b1-ba9f-04bdb413ffc1 is not attached to volume 6cc49b85-40a0-41a0-bb28-95a80045330f Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-26128650-209f-4454-afde-ab025c55a156 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Request method failure captured: Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1/os-volume_attachments/6cc49b85-40a0-41a0-bb28-95a80045330f HTTP/1.1 Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLhV55gbLVb0l_5bSGDinadOtlBuKHjRNnlsJ1vrC50OtjtLVO4icuJ0tvFV64re-70r3m-oR9GwrtPiDZbBAkuitJzJ4pASF1eoBCZEbrM2ptAI6ejT_LKgeF09U62ICDbOTlyU1CMBs6XExcV8b6mBiO4jjy_koTK7s_InRG_Hezw Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 9c9f9ee9368546b89f207a9eb5c5165f Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1673977834 Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9c9f9ee9368546b89f207a9eb5c5165f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c9f9ee9368546b89f207a9eb5c5165f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c9f9ee9368546b89f207a9eb5c5165f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9c9f9ee9368546b89f207a9eb5c5165f", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TestEncryptedCinderVolumes-1673977834 Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 9c9f9ee9368546b89f207a9eb5c5165f Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1673977834 Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TestEncryptedCinderVolumes-1673977834-project Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 573a47f88384410fbbca9a397fa3ffc5 Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TestEncryptedCinderVolumes-1673977834-project Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 26ae06f7-1933-47b1-ba9f-04bdb413ffc1 is not attached to volume 6cc49b85-40a0-41a0-bb28-95a80045330f Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'server_id': '26ae06f7-1933-47b1-ba9f-04bdb413ffc1', 'id': '6cc49b85-40a0-41a0-bb28-95a80045330f'} Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6cc49b85-40a0-41a0-bb28-95a80045330f. Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26ae06f7-1933-47b1-ba9f-04bdb413ffc1 is not attached to volume 6cc49b85-40a0-41a0-bb28-95a80045330f Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:27:38.929136 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:27:38.934449 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:27:38.934449 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:27:38.934449 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26ae06f7-1933-47b1-ba9f-04bdb413ffc1 is not attached to volume 6cc49b85-40a0-41a0-bb28-95a80045330f Oct 11 00:27:38.934449 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:27:38.934449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-26128650-209f-4454-afde-ab025c55a156 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Returning 404 to user: Instance 26ae06f7-1933-47b1-ba9f-04bdb413ffc1 is not attached to volume 6cc49b85-40a0-41a0-bb28-95a80045330f {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:27:38.934449 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-26128650-209f-4454-afde-ab025c55a156 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "DELETE /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1/os-volume_attachments/6cc49b85-40a0-41a0-bb28-95a80045330f" status: 404 len: 154 microversion: 2.1 time: 0.099484 Oct 11 00:27:38.934449 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3400/7455] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 11 00:27:38 2022] DELETE /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1/os-volume_attachments/6cc49b85-40a0-41a0-bb28-95a80045330f => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:27:42.286438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9addae8a-b8c2-4bb5-8034-444bdf3a695b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:42.287086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9addae8a-b8c2-4bb5-8034-444bdf3a695b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:42.294244 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9addae8a-b8c2-4bb5-8034-444bdf3a695b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:42.294749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9addae8a-b8c2-4bb5-8034-444bdf3a695b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:42.295207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9addae8a-b8c2-4bb5-8034-444bdf3a695b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:42.295928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9addae8a-b8c2-4bb5-8034-444bdf3a695b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:42.296394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9addae8a-b8c2-4bb5-8034-444bdf3a695b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:42.296834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9addae8a-b8c2-4bb5-8034-444bdf3a695b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:42.326183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9addae8a-b8c2-4bb5-8034-444bdf3a695b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:27:42.409970 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9addae8a-b8c2-4bb5-8034-444bdf3a695b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "DELETE /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1" status: 204 len: 0 microversion: 2.1 time: 0.127816 Oct 11 00:27:42.410968 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4056/7456] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:27:42 2022] DELETE /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:27:42.419058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b09317e5-3bdc-434f-9d1c-1edb3327930b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:42.419750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b09317e5-3bdc-434f-9d1c-1edb3327930b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:42.427426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b09317e5-3bdc-434f-9d1c-1edb3327930b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:42.427915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b09317e5-3bdc-434f-9d1c-1edb3327930b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:42.428349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b09317e5-3bdc-434f-9d1c-1edb3327930b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:42.429226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b09317e5-3bdc-434f-9d1c-1edb3327930b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:42.429716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b09317e5-3bdc-434f-9d1c-1edb3327930b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:42.430148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b09317e5-3bdc-434f-9d1c-1edb3327930b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:42.574537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b09317e5-3bdc-434f-9d1c-1edb3327930b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:42.582602 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b09317e5-3bdc-434f-9d1c-1edb3327930b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1" status: 200 len: 1561 microversion: 2.1 time: 0.167497 Oct 11 00:27:42.583178 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3401/7457] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:42 2022] GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:27:43.607209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bc7ac535-b937-48e3-890a-4748c8aea6e0 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:43.607934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bc7ac535-b937-48e3-890a-4748c8aea6e0 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:43.615079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc7ac535-b937-48e3-890a-4748c8aea6e0 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:43.615564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc7ac535-b937-48e3-890a-4748c8aea6e0 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:43.616019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc7ac535-b937-48e3-890a-4748c8aea6e0 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:43.616730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc7ac535-b937-48e3-890a-4748c8aea6e0 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:43.617207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc7ac535-b937-48e3-890a-4748c8aea6e0 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:43.617692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bc7ac535-b937-48e3-890a-4748c8aea6e0 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:43.751230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bc7ac535-b937-48e3-890a-4748c8aea6e0 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:43.759178 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bc7ac535-b937-48e3-890a-4748c8aea6e0 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1" status: 200 len: 1561 microversion: 2.1 time: 0.156340 Oct 11 00:27:43.759757 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4057/7458] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:43 2022] GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:27:44.488183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-8c682ff7-08e5-4334-ada3-f2748e31bf97 req-0d6e7ee2-1c93-4a98-9f91-81c1d80abc98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26ae06f7-1933-47b1-ba9f-04bdb413ffc1", "name": "network-vif-deleted", "tag": "472845bf-ce05-4c44-93a7-835ac95fc41f"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:27:44.499169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8c682ff7-08e5-4334-ada3-f2748e31bf97 req-0d6e7ee2-1c93-4a98-9f91-81c1d80abc98 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:44.499723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8c682ff7-08e5-4334-ada3-f2748e31bf97 req-0d6e7ee2-1c93-4a98-9f91-81c1d80abc98 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:44.500160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-8c682ff7-08e5-4334-ada3-f2748e31bf97 req-0d6e7ee2-1c93-4a98-9f91-81c1d80abc98 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:44.513838 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-8c682ff7-08e5-4334-ada3-f2748e31bf97 req-0d6e7ee2-1c93-4a98-9f91-81c1d80abc98 service nova] Creating event network-vif-deleted:472845bf-ce05-4c44-93a7-835ac95fc41f for instance 26ae06f7-1933-47b1-ba9f-04bdb413ffc1 on n-h1-860864-2 Oct 11 00:27:44.519921 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-8c682ff7-08e5-4334-ada3-f2748e31bf97 req-0d6e7ee2-1c93-4a98-9f91-81c1d80abc98 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036158 Oct 11 00:27:44.520532 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3402/7459] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:27:44.784034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9cf185f3-1cd2-486a-8edd-132e3eae8862 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:44.784588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9cf185f3-1cd2-486a-8edd-132e3eae8862 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:44.792399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cf185f3-1cd2-486a-8edd-132e3eae8862 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:44.792899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cf185f3-1cd2-486a-8edd-132e3eae8862 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:44.793358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cf185f3-1cd2-486a-8edd-132e3eae8862 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:44.794089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cf185f3-1cd2-486a-8edd-132e3eae8862 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:44.794559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cf185f3-1cd2-486a-8edd-132e3eae8862 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:44.794997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cf185f3-1cd2-486a-8edd-132e3eae8862 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:44.828193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cf185f3-1cd2-486a-8edd-132e3eae8862 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:44.828749 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cf185f3-1cd2-486a-8edd-132e3eae8862 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:44.829312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9cf185f3-1cd2-486a-8edd-132e3eae8862 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:44.829715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-9cf185f3-1cd2-486a-8edd-132e3eae8862 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lazy-loading 'fault' on Instance uuid 26ae06f7-1933-47b1-ba9f-04bdb413ffc1 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:27:44.871643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9cf185f3-1cd2-486a-8edd-132e3eae8862 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:44.879774 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9cf185f3-1cd2-486a-8edd-132e3eae8862 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1" status: 200 len: 1353 microversion: 2.1 time: 0.100391 Oct 11 00:27:44.880364 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4058/7460] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:44 2022] GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1 => generated 1353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:27:45.905341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-135262a2-62be-4aef-beba-d78f94007322 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:45.906074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-135262a2-62be-4aef-beba-d78f94007322 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 26ae06f7-1933-47b1-ba9f-04bdb413ffc1] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:45.912809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-135262a2-62be-4aef-beba-d78f94007322 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:45.913316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-135262a2-62be-4aef-beba-d78f94007322 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:45.913778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-135262a2-62be-4aef-beba-d78f94007322 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:45.914458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-135262a2-62be-4aef-beba-d78f94007322 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:45.914912 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-135262a2-62be-4aef-beba-d78f94007322 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:45.915330 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-135262a2-62be-4aef-beba-d78f94007322 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:45.928332 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-135262a2-62be-4aef-beba-d78f94007322 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] HTTP exception thrown: Instance 26ae06f7-1933-47b1-ba9f-04bdb413ffc1 could not be found. Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-135262a2-62be-4aef-beba-d78f94007322 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Request method failure captured: Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1 HTTP/1.1 Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLhV55gbLVb0l_5bSGDinadOtlBuKHjRNnlsJ1vrC50OtjtLVO4icuJ0tvFV64re-70r3m-oR9GwrtPiDZbBAkuitJzJ4pASF1eoBCZEbrM2ptAI6ejT_LKgeF09U62ICDbOTlyU1CMBs6XExcV8b6mBiO4jjy_koTK7s_InRG_Hezw Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 9c9f9ee9368546b89f207a9eb5c5165f Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1673977834 Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9c9f9ee9368546b89f207a9eb5c5165f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c9f9ee9368546b89f207a9eb5c5165f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c9f9ee9368546b89f207a9eb5c5165f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9c9f9ee9368546b89f207a9eb5c5165f", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TestEncryptedCinderVolumes-1673977834 Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 9c9f9ee9368546b89f207a9eb5c5165f Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1673977834 Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TestEncryptedCinderVolumes-1673977834-project Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 573a47f88384410fbbca9a397fa3ffc5 Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TestEncryptedCinderVolumes-1673977834-project Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 26ae06f7-1933-47b1-ba9f-04bdb413ffc1 could not be found. Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '26ae06f7-1933-47b1-ba9f-04bdb413ffc1'} Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26ae06f7-1933-47b1-ba9f-04bdb413ffc1 could not be found. Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26ae06f7-1933-47b1-ba9f-04bdb413ffc1 could not be found. Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:27:45.929978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:27:45.935141 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:27:45.935141 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:27:45.935141 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:27:45.935141 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:27:45.935141 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:27:45.935141 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:27:45.935141 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26ae06f7-1933-47b1-ba9f-04bdb413ffc1 could not be found. Oct 11 00:27:45.935141 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:27:45.935141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-135262a2-62be-4aef-beba-d78f94007322 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Returning 404 to user: Instance 26ae06f7-1933-47b1-ba9f-04bdb413ffc1 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:27:45.935141 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-135262a2-62be-4aef-beba-d78f94007322 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1" status: 404 len: 111 microversion: 2.1 time: 0.031088 Oct 11 00:27:45.935141 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3403/7461] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:45 2022] GET /compute/v2.1/servers/26ae06f7-1933-47b1-ba9f-04bdb413ffc1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:27:45.940713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-13413a11-71cd-423f-855f-81fcc3f45ca3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '.version_select at 0x7f662aff5d30>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:45.962057 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-13413a11-71cd-423f-855f-81fcc3f45ca3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1173722936" status: 202 len: 0 microversion: 2.1 time: 0.025433 Oct 11 00:27:45.962645 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4059/7462] 10.222.0.23 () {58 vars in 1278 bytes} [Tue Oct 11 00:27:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1173722936 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:27:45.980378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aa60cc8e-b33b-48f1-afc9-82210378a024 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Action: 'create', calling method: .version_select at 0x7f662a21fb80>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1777271112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfUzb4wLxed1Gi9QMfDDx7uWY/F2RhDhXUEvT7TtLwWCpNtoiXtPhxIOQ8pABeo+M411zz0tI/yqEVluKd1UrjEnkHIYjEd/syveYyVmJ1lP78Qr6++s5e6caibHARPeA=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:27:45.995859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-aa60cc8e-b33b-48f1-afc9-82210378a024 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Getting quotas for project 9c9f9ee9368546b89f207a9eb5c5165f. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:27:46.002431 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-aa60cc8e-b33b-48f1-afc9-82210378a024 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Getting quotas for user 573a47f88384410fbbca9a397fa3ffc5 and project 9c9f9ee9368546b89f207a9eb5c5165f. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:27:46.026907 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aa60cc8e-b33b-48f1-afc9-82210378a024 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.050414 Oct 11 00:27:46.029634 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3404/7463] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 11 00:27:45 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:27:46.080610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-800c97a4-d17d-4b01-a30d-89d8fa23e425 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1288745322", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1777271112", "networks": [{"uuid": "3275473c-f018-44e4-9e6c-78c273af5848"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:27:46.134214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-800c97a4-d17d-4b01-a30d-89d8fa23e425 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] validate_networks() for [('3275473c-f018-44e4-9e6c-78c273af5848', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:27:46.832831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-800c97a4-d17d-4b01-a30d-89d8fa23e425 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:27:46.833276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-800c97a4-d17d-4b01-a30d-89d8fa23e425 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:27:46.833805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-800c97a4-d17d-4b01-a30d-89d8fa23e425 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:27:46.834234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-800c97a4-d17d-4b01-a30d-89d8fa23e425 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:27:46.834666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-800c97a4-d17d-4b01-a30d-89d8fa23e425 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:27:46.843674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-800c97a4-d17d-4b01-a30d-89d8fa23e425 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:46.844666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-800c97a4-d17d-4b01-a30d-89d8fa23e425 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:46.845457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-800c97a4-d17d-4b01-a30d-89d8fa23e425 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:46.846063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-800c97a4-d17d-4b01-a30d-89d8fa23e425 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:46.846534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-800c97a4-d17d-4b01-a30d-89d8fa23e425 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:46.846977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-800c97a4-d17d-4b01-a30d-89d8fa23e425 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:46.864161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-800c97a4-d17d-4b01-a30d-89d8fa23e425 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Getting quotas for project 9c9f9ee9368546b89f207a9eb5c5165f. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:27:46.869402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-800c97a4-d17d-4b01-a30d-89d8fa23e425 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Getting quotas for user 573a47f88384410fbbca9a397fa3ffc5 and project 9c9f9ee9368546b89f207a9eb5c5165f. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:27:46.882745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-800c97a4-d17d-4b01-a30d-89d8fa23e425 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:27:46.885135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-800c97a4-d17d-4b01-a30d-89d8fa23e425 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:27:46.933671 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-800c97a4-d17d-4b01-a30d-89d8fa23e425 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.858005 Oct 11 00:27:46.934336 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4060/7464] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:27:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:27:46.947405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a4f8535e-81ab-445b-90ca-263df8ef9a1b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:46.948261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a4f8535e-81ab-445b-90ca-263df8ef9a1b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:47.005810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a4f8535e-81ab-445b-90ca-263df8ef9a1b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:47.014175 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a4f8535e-81ab-445b-90ca-263df8ef9a1b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a" status: 200 len: 1263 microversion: 2.1 time: 0.070784 Oct 11 00:27:47.014748 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3405/7465] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:46 2022] GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a => generated 1263 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:27:48.044178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1d687b31-0333-4502-8a80-3a9d85746230 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:48.046342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1d687b31-0333-4502-8a80-3a9d85746230 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:48.056830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d687b31-0333-4502-8a80-3a9d85746230 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:48.057713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d687b31-0333-4502-8a80-3a9d85746230 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:48.058379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d687b31-0333-4502-8a80-3a9d85746230 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:48.059434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d687b31-0333-4502-8a80-3a9d85746230 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:48.060403 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d687b31-0333-4502-8a80-3a9d85746230 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:48.061047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1d687b31-0333-4502-8a80-3a9d85746230 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:48.157897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1d687b31-0333-4502-8a80-3a9d85746230 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:48.167194 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1d687b31-0333-4502-8a80-3a9d85746230 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a" status: 200 len: 1321 microversion: 2.1 time: 0.131379 Oct 11 00:27:48.168197 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4061/7466] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:48 2022] GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a => generated 1321 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:27:49.192179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1dbcb34b-f19d-4522-b8ed-7294f4eee5d1 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:49.193465 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1dbcb34b-f19d-4522-b8ed-7294f4eee5d1 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:49.201038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1dbcb34b-f19d-4522-b8ed-7294f4eee5d1 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:49.201580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1dbcb34b-f19d-4522-b8ed-7294f4eee5d1 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:49.202017 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1dbcb34b-f19d-4522-b8ed-7294f4eee5d1 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:49.202759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1dbcb34b-f19d-4522-b8ed-7294f4eee5d1 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:49.203218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1dbcb34b-f19d-4522-b8ed-7294f4eee5d1 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:49.203640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1dbcb34b-f19d-4522-b8ed-7294f4eee5d1 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:49.424056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1dbcb34b-f19d-4522-b8ed-7294f4eee5d1 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:49.432962 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1dbcb34b-f19d-4522-b8ed-7294f4eee5d1 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a" status: 200 len: 1363 microversion: 2.1 time: 0.245082 Oct 11 00:27:49.433733 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3406/7467] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:49 2022] GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:27:49.481516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-e6a77f84-b77e-4905-8564-01829bbb73a8 req-386cfd36-a113-4e28-983b-73791565b988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "284bae99-05e1-4124-9c16-809191ca189a", "tag": "0e1b314d-42b5-442b-9e95-d830cb7b7173"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:27:49.492170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e6a77f84-b77e-4905-8564-01829bbb73a8 req-386cfd36-a113-4e28-983b-73791565b988 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:49.492722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e6a77f84-b77e-4905-8564-01829bbb73a8 req-386cfd36-a113-4e28-983b-73791565b988 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:49.493196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-e6a77f84-b77e-4905-8564-01829bbb73a8 req-386cfd36-a113-4e28-983b-73791565b988 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:49.505803 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-e6a77f84-b77e-4905-8564-01829bbb73a8 req-386cfd36-a113-4e28-983b-73791565b988 service nova] Creating event network-changed:0e1b314d-42b5-442b-9e95-d830cb7b7173 for instance 284bae99-05e1-4124-9c16-809191ca189a on n-h1-860864-2 Oct 11 00:27:49.511508 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-e6a77f84-b77e-4905-8564-01829bbb73a8 req-386cfd36-a113-4e28-983b-73791565b988 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035693 Oct 11 00:27:49.512339 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4062/7468] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:27:50.458386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0b88af41-1261-404d-a7e6-22c3852ecb12 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:50.458985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0b88af41-1261-404d-a7e6-22c3852ecb12 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:50.466016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b88af41-1261-404d-a7e6-22c3852ecb12 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:50.466499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b88af41-1261-404d-a7e6-22c3852ecb12 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:50.466936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b88af41-1261-404d-a7e6-22c3852ecb12 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:50.467628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b88af41-1261-404d-a7e6-22c3852ecb12 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:50.468078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b88af41-1261-404d-a7e6-22c3852ecb12 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:50.468500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b88af41-1261-404d-a7e6-22c3852ecb12 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:50.604181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0b88af41-1261-404d-a7e6-22c3852ecb12 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:50.612059 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0b88af41-1261-404d-a7e6-22c3852ecb12 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a" status: 200 len: 1363 microversion: 2.1 time: 0.158042 Oct 11 00:27:50.612735 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3407/7469] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:50 2022] GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:27:51.637810 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7ad33950-38c4-41ea-a7f0-6235909e8cd8 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:51.638533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7ad33950-38c4-41ea-a7f0-6235909e8cd8 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:51.645555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ad33950-38c4-41ea-a7f0-6235909e8cd8 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:51.646061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ad33950-38c4-41ea-a7f0-6235909e8cd8 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:51.646516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ad33950-38c4-41ea-a7f0-6235909e8cd8 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:51.647237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ad33950-38c4-41ea-a7f0-6235909e8cd8 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:51.647705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ad33950-38c4-41ea-a7f0-6235909e8cd8 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:51.648145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ad33950-38c4-41ea-a7f0-6235909e8cd8 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:51.792055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7ad33950-38c4-41ea-a7f0-6235909e8cd8 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:51.800701 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7ad33950-38c4-41ea-a7f0-6235909e8cd8 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a" status: 200 len: 1363 microversion: 2.1 time: 0.168074 Oct 11 00:27:51.801298 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4063/7470] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:51 2022] GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:27:52.824267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-44ed04fa-1cc4-4be4-a0a8-3c5c7698fd39 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:52.824912 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-44ed04fa-1cc4-4be4-a0a8-3c5c7698fd39 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:52.831972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44ed04fa-1cc4-4be4-a0a8-3c5c7698fd39 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:52.832451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44ed04fa-1cc4-4be4-a0a8-3c5c7698fd39 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:52.832880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44ed04fa-1cc4-4be4-a0a8-3c5c7698fd39 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:52.833589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44ed04fa-1cc4-4be4-a0a8-3c5c7698fd39 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:52.834037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44ed04fa-1cc4-4be4-a0a8-3c5c7698fd39 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:52.834453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-44ed04fa-1cc4-4be4-a0a8-3c5c7698fd39 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:52.965244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-44ed04fa-1cc4-4be4-a0a8-3c5c7698fd39 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:52.973725 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-44ed04fa-1cc4-4be4-a0a8-3c5c7698fd39 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a" status: 200 len: 1363 microversion: 2.1 time: 0.153333 Oct 11 00:27:52.974303 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3408/7471] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:52 2022] GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:27:53.997616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2bc5d3a0-af2a-4e0f-a148-322288d65741 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:53.998249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2bc5d3a0-af2a-4e0f-a148-322288d65741 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:54.005940 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bc5d3a0-af2a-4e0f-a148-322288d65741 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:54.006441 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bc5d3a0-af2a-4e0f-a148-322288d65741 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:54.006915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bc5d3a0-af2a-4e0f-a148-322288d65741 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:54.007617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bc5d3a0-af2a-4e0f-a148-322288d65741 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:54.008082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bc5d3a0-af2a-4e0f-a148-322288d65741 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:54.008553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bc5d3a0-af2a-4e0f-a148-322288d65741 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:54.136954 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2bc5d3a0-af2a-4e0f-a148-322288d65741 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:54.144891 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2bc5d3a0-af2a-4e0f-a148-322288d65741 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a" status: 200 len: 1363 microversion: 2.1 time: 0.151431 Oct 11 00:27:54.145513 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4064/7472] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:53 2022] GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:27:55.168096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5996c4bd-7cd0-480a-8889-78361955cdc4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:55.168866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5996c4bd-7cd0-480a-8889-78361955cdc4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:55.175780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5996c4bd-7cd0-480a-8889-78361955cdc4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:55.176268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5996c4bd-7cd0-480a-8889-78361955cdc4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:55.176706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5996c4bd-7cd0-480a-8889-78361955cdc4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:55.177423 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5996c4bd-7cd0-480a-8889-78361955cdc4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:55.177884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5996c4bd-7cd0-480a-8889-78361955cdc4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:55.178309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5996c4bd-7cd0-480a-8889-78361955cdc4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:55.308855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5996c4bd-7cd0-480a-8889-78361955cdc4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:55.317486 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5996c4bd-7cd0-480a-8889-78361955cdc4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a" status: 200 len: 1363 microversion: 2.1 time: 0.153188 Oct 11 00:27:55.318062 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3409/7473] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:55 2022] GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:27:56.340386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-12117f81-97f6-47bb-903f-9843d3df6ab6 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:56.340927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-12117f81-97f6-47bb-903f-9843d3df6ab6 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:56.348591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12117f81-97f6-47bb-903f-9843d3df6ab6 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:56.349101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12117f81-97f6-47bb-903f-9843d3df6ab6 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:56.349618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12117f81-97f6-47bb-903f-9843d3df6ab6 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:56.350346 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12117f81-97f6-47bb-903f-9843d3df6ab6 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:56.350824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12117f81-97f6-47bb-903f-9843d3df6ab6 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:56.351303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12117f81-97f6-47bb-903f-9843d3df6ab6 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:56.485054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-12117f81-97f6-47bb-903f-9843d3df6ab6 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:56.493030 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-12117f81-97f6-47bb-903f-9843d3df6ab6 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a" status: 200 len: 1363 microversion: 2.1 time: 0.156630 Oct 11 00:27:56.493660 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4065/7474] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:56 2022] GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:27:57.516486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-26b9dab5-275f-4398-96cf-dbecea175409 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:57.517111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-26b9dab5-275f-4398-96cf-dbecea175409 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:57.520804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:27:57.526620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26b9dab5-275f-4398-96cf-dbecea175409 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:57.527118 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26b9dab5-275f-4398-96cf-dbecea175409 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:57.527564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26b9dab5-275f-4398-96cf-dbecea175409 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:57.528328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26b9dab5-275f-4398-96cf-dbecea175409 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:57.528782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26b9dab5-275f-4398-96cf-dbecea175409 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:57.529212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-26b9dab5-275f-4398-96cf-dbecea175409 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:57.620947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-6608e1fc-2c65-49e6-8943-d647eefb48aa req-cd08f2f4-c343-4a1a-aa9a-91b64619c04a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "284bae99-05e1-4124-9c16-809191ca189a", "name": "network-vif-plugged", "status": "completed", "tag": "0e1b314d-42b5-442b-9e95-d830cb7b7173"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:27:57.626910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:27:57.627972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:27:57.635219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6608e1fc-2c65-49e6-8943-d647eefb48aa req-cd08f2f4-c343-4a1a-aa9a-91b64619c04a service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:57.635724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6608e1fc-2c65-49e6-8943-d647eefb48aa req-cd08f2f4-c343-4a1a-aa9a-91b64619c04a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:57.636465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6608e1fc-2c65-49e6-8943-d647eefb48aa req-cd08f2f4-c343-4a1a-aa9a-91b64619c04a service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:57.650110 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-6608e1fc-2c65-49e6-8943-d647eefb48aa req-cd08f2f4-c343-4a1a-aa9a-91b64619c04a service nova] Creating event network-vif-plugged:0e1b314d-42b5-442b-9e95-d830cb7b7173 for instance 284bae99-05e1-4124-9c16-809191ca189a on n-h1-860864-2 Oct 11 00:27:57.659186 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-6608e1fc-2c65-49e6-8943-d647eefb48aa req-cd08f2f4-c343-4a1a-aa9a-91b64619c04a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041062 Oct 11 00:27:57.660018 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4066/7475] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:27:57.679647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-26b9dab5-275f-4398-96cf-dbecea175409 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:57.687994 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-26b9dab5-275f-4398-96cf-dbecea175409 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a" status: 200 len: 1363 microversion: 2.1 time: 0.175732 Oct 11 00:27:57.688584 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3410/7476] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:57 2022] GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:27:58.712904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5392921d-d1c8-45b4-b9b7-44bf5c0fa69d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:58.713686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5392921d-d1c8-45b4-b9b7-44bf5c0fa69d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:58.719927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5392921d-d1c8-45b4-b9b7-44bf5c0fa69d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:58.721007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5392921d-d1c8-45b4-b9b7-44bf5c0fa69d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:58.721494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5392921d-d1c8-45b4-b9b7-44bf5c0fa69d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:58.722209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5392921d-d1c8-45b4-b9b7-44bf5c0fa69d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:58.722681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5392921d-d1c8-45b4-b9b7-44bf5c0fa69d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:58.723125 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5392921d-d1c8-45b4-b9b7-44bf5c0fa69d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:58.857038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5392921d-d1c8-45b4-b9b7-44bf5c0fa69d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:27:58.865596 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5392921d-d1c8-45b4-b9b7-44bf5c0fa69d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a" status: 200 len: 1363 microversion: 2.1 time: 0.157725 Oct 11 00:27:58.866181 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4067/7477] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:58 2022] GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:27:59.888557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ca2cca09-1f72-4050-ab5c-f0e007648f3d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:27:59.889179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ca2cca09-1f72-4050-ab5c-f0e007648f3d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:27:59.896225 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca2cca09-1f72-4050-ab5c-f0e007648f3d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:59.896715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca2cca09-1f72-4050-ab5c-f0e007648f3d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:59.897161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca2cca09-1f72-4050-ab5c-f0e007648f3d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:27:59.897883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca2cca09-1f72-4050-ab5c-f0e007648f3d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:27:59.898344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca2cca09-1f72-4050-ab5c-f0e007648f3d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:27:59.898775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca2cca09-1f72-4050-ab5c-f0e007648f3d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:00.031415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ca2cca09-1f72-4050-ab5c-f0e007648f3d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:28:00.039325 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ca2cca09-1f72-4050-ab5c-f0e007648f3d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a" status: 200 len: 1554 microversion: 2.1 time: 0.154737 Oct 11 00:28:00.039901 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3411/7478] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:27:59 2022] GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:28:00.062356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-21740ef3-55bf-4059-aeb2-fb3a8f701d09 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:00.062991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-21740ef3-55bf-4059-aeb2-fb3a8f701d09 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:00.070648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21740ef3-55bf-4059-aeb2-fb3a8f701d09 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:00.071095 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21740ef3-55bf-4059-aeb2-fb3a8f701d09 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:00.071555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21740ef3-55bf-4059-aeb2-fb3a8f701d09 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:00.072276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21740ef3-55bf-4059-aeb2-fb3a8f701d09 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:00.072757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21740ef3-55bf-4059-aeb2-fb3a8f701d09 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:00.073209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-21740ef3-55bf-4059-aeb2-fb3a8f701d09 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:00.201545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-21740ef3-55bf-4059-aeb2-fb3a8f701d09 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:28:00.205178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:28:00.210317 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-21740ef3-55bf-4059-aeb2-fb3a8f701d09 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a" status: 200 len: 1554 microversion: 2.1 time: 0.151811 Oct 11 00:28:00.210898 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4068/7479] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:28:00 2022] GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:28:01.716967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cc1b42b0-9df9-4d82-ba60-46c399878e06 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82d3cf9d-4fe4-4add-b593-4faa6db8ed7a"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:28:01.719389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cc1b42b0-9df9-4d82-ba60-46c399878e06 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:01.727326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc1b42b0-9df9-4d82-ba60-46c399878e06 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:01.727814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc1b42b0-9df9-4d82-ba60-46c399878e06 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:01.728252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc1b42b0-9df9-4d82-ba60-46c399878e06 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:01.728952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc1b42b0-9df9-4d82-ba60-46c399878e06 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:01.729428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc1b42b0-9df9-4d82-ba60-46c399878e06 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:01.729864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc1b42b0-9df9-4d82-ba60-46c399878e06 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:01.993122 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cc1b42b0-9df9-4d82-ba60-46c399878e06 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "POST /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279846 Oct 11 00:28:01.994196 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3412/7480] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 11 00:28:01 2022] POST /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:28:12.726516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f7ae0417-ba6b-4911-964d-35c3c2e6e703 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:12.727086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f7ae0417-ba6b-4911-964d-35c3c2e6e703 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:12.730371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:28:12.737682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7ae0417-ba6b-4911-964d-35c3c2e6e703 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:12.737682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7ae0417-ba6b-4911-964d-35c3c2e6e703 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:12.737682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7ae0417-ba6b-4911-964d-35c3c2e6e703 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:12.741449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7ae0417-ba6b-4911-964d-35c3c2e6e703 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:12.741449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7ae0417-ba6b-4911-964d-35c3c2e6e703 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:12.741449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f7ae0417-ba6b-4911-964d-35c3c2e6e703 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:12.824103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-f7ae0417-ba6b-4911-964d-35c3c2e6e703 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lazy-loading 'services' on Instance uuid 284bae99-05e1-4124-9c16-809191ca189a {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:28:12.896218 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f7ae0417-ba6b-4911-964d-35c3c2e6e703 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "DELETE /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a/os-volume_attachments/82d3cf9d-4fe4-4add-b593-4faa6db8ed7a" status: 202 len: 0 microversion: 2.1 time: 0.173508 Oct 11 00:28:12.896848 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4069/7481] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 11 00:28:12 2022] DELETE /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a/os-volume_attachments/82d3cf9d-4fe4-4add-b593-4faa6db8ed7a => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:28:12.905792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9d33261e-5ab8-4035-8b21-2d3a2623a0fd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:12.908136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9d33261e-5ab8-4035-8b21-2d3a2623a0fd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:12.911637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:28:12.912346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:28:12.918218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d33261e-5ab8-4035-8b21-2d3a2623a0fd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:12.918713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d33261e-5ab8-4035-8b21-2d3a2623a0fd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:12.919160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d33261e-5ab8-4035-8b21-2d3a2623a0fd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:12.919867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d33261e-5ab8-4035-8b21-2d3a2623a0fd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:12.920326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d33261e-5ab8-4035-8b21-2d3a2623a0fd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:12.920811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9d33261e-5ab8-4035-8b21-2d3a2623a0fd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:12.955616 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9d33261e-5ab8-4035-8b21-2d3a2623a0fd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054164 Oct 11 00:28:12.956224 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3413/7482] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:28:12 2022] GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:28:13.970864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-935d1391-33aa-444e-bafc-7b9db553788a tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:13.974228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-935d1391-33aa-444e-bafc-7b9db553788a tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:13.980880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-935d1391-33aa-444e-bafc-7b9db553788a tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:13.981496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-935d1391-33aa-444e-bafc-7b9db553788a tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:13.982028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-935d1391-33aa-444e-bafc-7b9db553788a tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:13.982871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-935d1391-33aa-444e-bafc-7b9db553788a tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:13.983415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-935d1391-33aa-444e-bafc-7b9db553788a tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:13.983931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-935d1391-33aa-444e-bafc-7b9db553788a tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:14.015170 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-935d1391-33aa-444e-bafc-7b9db553788a tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050319 Oct 11 00:28:14.015747 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4070/7483] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:28:13 2022] GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:28:15.027737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5076acef-4138-4f4d-a84f-1dbe7256c071 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:15.029988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5076acef-4138-4f4d-a84f-1dbe7256c071 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:15.037279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5076acef-4138-4f4d-a84f-1dbe7256c071 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:15.037798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5076acef-4138-4f4d-a84f-1dbe7256c071 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:15.038234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5076acef-4138-4f4d-a84f-1dbe7256c071 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:15.038931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5076acef-4138-4f4d-a84f-1dbe7256c071 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:15.039420 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5076acef-4138-4f4d-a84f-1dbe7256c071 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:15.039844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5076acef-4138-4f4d-a84f-1dbe7256c071 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:15.072063 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5076acef-4138-4f4d-a84f-1dbe7256c071 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048101 Oct 11 00:28:15.072562 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3414/7484] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:28:15 2022] GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:28:16.086891 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bf3c08a6-3259-4bcc-b6e3-2563c836cc58 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:16.089098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bf3c08a6-3259-4bcc-b6e3-2563c836cc58 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:16.096358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf3c08a6-3259-4bcc-b6e3-2563c836cc58 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:16.098170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf3c08a6-3259-4bcc-b6e3-2563c836cc58 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:16.098634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf3c08a6-3259-4bcc-b6e3-2563c836cc58 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:16.099364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf3c08a6-3259-4bcc-b6e3-2563c836cc58 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:16.099835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf3c08a6-3259-4bcc-b6e3-2563c836cc58 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:16.100278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bf3c08a6-3259-4bcc-b6e3-2563c836cc58 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:16.135002 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bf3c08a6-3259-4bcc-b6e3-2563c836cc58 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052077 Oct 11 00:28:16.135581 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4071/7485] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:28:16 2022] GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:28:17.148028 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8cd385d5-5932-44d2-b098-556079d5b1b5 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:17.150310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8cd385d5-5932-44d2-b098-556079d5b1b5 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:17.157978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cd385d5-5932-44d2-b098-556079d5b1b5 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:17.158519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cd385d5-5932-44d2-b098-556079d5b1b5 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:17.158966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cd385d5-5932-44d2-b098-556079d5b1b5 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:17.159658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cd385d5-5932-44d2-b098-556079d5b1b5 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:17.160110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cd385d5-5932-44d2-b098-556079d5b1b5 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:17.160634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8cd385d5-5932-44d2-b098-556079d5b1b5 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:17.192819 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8cd385d5-5932-44d2-b098-556079d5b1b5 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049110 Oct 11 00:28:17.193415 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3415/7486] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:28:17 2022] GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:28:18.206759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-81475168-013d-49ca-9d07-7a76f9907cd8 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:18.209025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-81475168-013d-49ca-9d07-7a76f9907cd8 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:18.215886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81475168-013d-49ca-9d07-7a76f9907cd8 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:18.216378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81475168-013d-49ca-9d07-7a76f9907cd8 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:18.216826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81475168-013d-49ca-9d07-7a76f9907cd8 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:18.217556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81475168-013d-49ca-9d07-7a76f9907cd8 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:18.218022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81475168-013d-49ca-9d07-7a76f9907cd8 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:18.218465 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-81475168-013d-49ca-9d07-7a76f9907cd8 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:18.247605 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-81475168-013d-49ca-9d07-7a76f9907cd8 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045694 Oct 11 00:28:18.248170 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4072/7487] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:28:18 2022] GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 00:28:18.263528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-440d6a45-b025-42b8-96ac-ac8727b02625 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:18.264074 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-440d6a45-b025-42b8-96ac-ac8727b02625 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:18.271745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-440d6a45-b025-42b8-96ac-ac8727b02625 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:18.272226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-440d6a45-b025-42b8-96ac-ac8727b02625 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:18.272661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-440d6a45-b025-42b8-96ac-ac8727b02625 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:18.273346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-440d6a45-b025-42b8-96ac-ac8727b02625 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:18.273829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-440d6a45-b025-42b8-96ac-ac8727b02625 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:18.274251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-440d6a45-b025-42b8-96ac-ac8727b02625 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:18.354310 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-440d6a45-b025-42b8-96ac-ac8727b02625 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] HTTP exception thrown: Instance 284bae99-05e1-4124-9c16-809191ca189a is not attached to volume 82d3cf9d-4fe4-4add-b593-4faa6db8ed7a Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-440d6a45-b025-42b8-96ac-ac8727b02625 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Request method failure captured: Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a/os-volume_attachments/82d3cf9d-4fe4-4add-b593-4faa6db8ed7a HTTP/1.1 Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLhV55gbLVb0l_5bSGDinadOtlBuKHjRNnlsJ1vrC50OtjtLVO4icuJ0tvFV64re-70r3m-oR9GwrtPiDZbBAkuitJzJ4pASF1eoBCZEbrM2ptAI6ejT_LKgeF09U62ICDbOTlyU1CMBs6XExcV8b6mBiO4jjy_koTK7s_InRG_Hezw Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 9c9f9ee9368546b89f207a9eb5c5165f Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1673977834 Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9c9f9ee9368546b89f207a9eb5c5165f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c9f9ee9368546b89f207a9eb5c5165f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c9f9ee9368546b89f207a9eb5c5165f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9c9f9ee9368546b89f207a9eb5c5165f", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TestEncryptedCinderVolumes-1673977834 Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 9c9f9ee9368546b89f207a9eb5c5165f Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1673977834 Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TestEncryptedCinderVolumes-1673977834-project Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 573a47f88384410fbbca9a397fa3ffc5 Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TestEncryptedCinderVolumes-1673977834-project Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 284bae99-05e1-4124-9c16-809191ca189a is not attached to volume 82d3cf9d-4fe4-4add-b593-4faa6db8ed7a Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'server_id': '284bae99-05e1-4124-9c16-809191ca189a', 'id': '82d3cf9d-4fe4-4add-b593-4faa6db8ed7a'} Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 82d3cf9d-4fe4-4add-b593-4faa6db8ed7a. Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 284bae99-05e1-4124-9c16-809191ca189a is not attached to volume 82d3cf9d-4fe4-4add-b593-4faa6db8ed7a Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:28:18.355885 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:28:18.360086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:28:18.360086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:28:18.360086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 284bae99-05e1-4124-9c16-809191ca189a is not attached to volume 82d3cf9d-4fe4-4add-b593-4faa6db8ed7a Oct 11 00:28:18.360086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:28:18.360086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-440d6a45-b025-42b8-96ac-ac8727b02625 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Returning 404 to user: Instance 284bae99-05e1-4124-9c16-809191ca189a is not attached to volume 82d3cf9d-4fe4-4add-b593-4faa6db8ed7a {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:28:18.360086 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-440d6a45-b025-42b8-96ac-ac8727b02625 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "DELETE /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a/os-volume_attachments/82d3cf9d-4fe4-4add-b593-4faa6db8ed7a" status: 404 len: 154 microversion: 2.1 time: 0.097859 Oct 11 00:28:18.360086 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3416/7488] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 11 00:28:18 2022] DELETE /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a/os-volume_attachments/82d3cf9d-4fe4-4add-b593-4faa6db8ed7a => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:28:21.711653 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-da2d8f87-d4ee-47e2-a54c-40dc76d3f7dc tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:21.712217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-da2d8f87-d4ee-47e2-a54c-40dc76d3f7dc tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:21.719211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da2d8f87-d4ee-47e2-a54c-40dc76d3f7dc tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:21.719714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da2d8f87-d4ee-47e2-a54c-40dc76d3f7dc tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:21.720171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da2d8f87-d4ee-47e2-a54c-40dc76d3f7dc tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:21.720886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da2d8f87-d4ee-47e2-a54c-40dc76d3f7dc tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:21.721410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da2d8f87-d4ee-47e2-a54c-40dc76d3f7dc tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:21.722558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-da2d8f87-d4ee-47e2-a54c-40dc76d3f7dc tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:21.748059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-da2d8f87-d4ee-47e2-a54c-40dc76d3f7dc tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:28:21.834942 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-da2d8f87-d4ee-47e2-a54c-40dc76d3f7dc tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "DELETE /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a" status: 204 len: 0 microversion: 2.1 time: 0.126833 Oct 11 00:28:21.836228 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4073/7489] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:28:21 2022] DELETE /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:28:21.844489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3bf3f69d-cff6-4357-b7e0-d99484f35c87 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:21.845204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3bf3f69d-cff6-4357-b7e0-d99484f35c87 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:21.853816 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3bf3f69d-cff6-4357-b7e0-d99484f35c87 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:21.854417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3bf3f69d-cff6-4357-b7e0-d99484f35c87 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:21.854863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3bf3f69d-cff6-4357-b7e0-d99484f35c87 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:21.855976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3bf3f69d-cff6-4357-b7e0-d99484f35c87 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:21.856416 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3bf3f69d-cff6-4357-b7e0-d99484f35c87 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:21.857034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3bf3f69d-cff6-4357-b7e0-d99484f35c87 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:21.991791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3bf3f69d-cff6-4357-b7e0-d99484f35c87 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:28:21.999683 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3bf3f69d-cff6-4357-b7e0-d99484f35c87 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a" status: 200 len: 1560 microversion: 2.1 time: 0.159097 Oct 11 00:28:22.000258 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3417/7490] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:28:21 2022] GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:28:23.028399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1c3eaec7-62cd-4573-987f-b02755d46a18 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:23.029118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1c3eaec7-62cd-4573-987f-b02755d46a18 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:23.036589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c3eaec7-62cd-4573-987f-b02755d46a18 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:23.037093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c3eaec7-62cd-4573-987f-b02755d46a18 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:23.037598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c3eaec7-62cd-4573-987f-b02755d46a18 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:23.038315 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c3eaec7-62cd-4573-987f-b02755d46a18 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:23.038787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c3eaec7-62cd-4573-987f-b02755d46a18 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:23.039232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1c3eaec7-62cd-4573-987f-b02755d46a18 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:23.173495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1c3eaec7-62cd-4573-987f-b02755d46a18 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:28:23.181330 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1c3eaec7-62cd-4573-987f-b02755d46a18 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a" status: 200 len: 1560 microversion: 2.1 time: 0.157368 Oct 11 00:28:23.182204 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4074/7491] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:28:23 2022] GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:28:23.920522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-f6c356a3-2fb2-48d2-9cdd-3b5176ba42af req-8ef04cac-ff08-4b6a-993c-a19b2b6f2744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "284bae99-05e1-4124-9c16-809191ca189a", "name": "network-vif-deleted", "tag": "0e1b314d-42b5-442b-9e95-d830cb7b7173"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:28:23.935186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f6c356a3-2fb2-48d2-9cdd-3b5176ba42af req-8ef04cac-ff08-4b6a-993c-a19b2b6f2744 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:23.935956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f6c356a3-2fb2-48d2-9cdd-3b5176ba42af req-8ef04cac-ff08-4b6a-993c-a19b2b6f2744 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:23.936569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f6c356a3-2fb2-48d2-9cdd-3b5176ba42af req-8ef04cac-ff08-4b6a-993c-a19b2b6f2744 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:23.951221 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-f6c356a3-2fb2-48d2-9cdd-3b5176ba42af req-8ef04cac-ff08-4b6a-993c-a19b2b6f2744 service nova] Creating event network-vif-deleted:0e1b314d-42b5-442b-9e95-d830cb7b7173 for instance 284bae99-05e1-4124-9c16-809191ca189a on n-h1-860864-2 Oct 11 00:28:23.964522 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-f6c356a3-2fb2-48d2-9cdd-3b5176ba42af req-8ef04cac-ff08-4b6a-993c-a19b2b6f2744 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047869 Oct 11 00:28:23.965874 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3418/7492] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:28:24.204807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-29dc684f-1859-4b6e-ae9a-3c6b07c8eaa3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:24.205342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-29dc684f-1859-4b6e-ae9a-3c6b07c8eaa3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:24.213090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29dc684f-1859-4b6e-ae9a-3c6b07c8eaa3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:24.213683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29dc684f-1859-4b6e-ae9a-3c6b07c8eaa3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:24.214136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29dc684f-1859-4b6e-ae9a-3c6b07c8eaa3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:24.214841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29dc684f-1859-4b6e-ae9a-3c6b07c8eaa3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:24.215305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29dc684f-1859-4b6e-ae9a-3c6b07c8eaa3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:24.215743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29dc684f-1859-4b6e-ae9a-3c6b07c8eaa3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:24.246071 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29dc684f-1859-4b6e-ae9a-3c6b07c8eaa3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:24.246564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29dc684f-1859-4b6e-ae9a-3c6b07c8eaa3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:24.247016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-29dc684f-1859-4b6e-ae9a-3c6b07c8eaa3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:24.247471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-29dc684f-1859-4b6e-ae9a-3c6b07c8eaa3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lazy-loading 'fault' on Instance uuid 284bae99-05e1-4124-9c16-809191ca189a {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:28:24.288938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-29dc684f-1859-4b6e-ae9a-3c6b07c8eaa3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:28:24.297546 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-29dc684f-1859-4b6e-ae9a-3c6b07c8eaa3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a" status: 200 len: 1353 microversion: 2.1 time: 0.096648 Oct 11 00:28:24.298139 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4075/7493] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:28:24 2022] GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a => generated 1353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:28:25.323890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-29d58a65-413b-4854-8422-a8119c8c3720 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:25.324589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-29d58a65-413b-4854-8422-a8119c8c3720 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: 284bae99-05e1-4124-9c16-809191ca189a] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:25.330789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29d58a65-413b-4854-8422-a8119c8c3720 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:25.331961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29d58a65-413b-4854-8422-a8119c8c3720 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:25.332379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29d58a65-413b-4854-8422-a8119c8c3720 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:25.333060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29d58a65-413b-4854-8422-a8119c8c3720 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:25.333544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29d58a65-413b-4854-8422-a8119c8c3720 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:25.333968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-29d58a65-413b-4854-8422-a8119c8c3720 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:25.347158 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-29d58a65-413b-4854-8422-a8119c8c3720 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] HTTP exception thrown: Instance 284bae99-05e1-4124-9c16-809191ca189a could not be found. Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-29d58a65-413b-4854-8422-a8119c8c3720 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Request method failure captured: Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a HTTP/1.1 Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLhV55gbLVb0l_5bSGDinadOtlBuKHjRNnlsJ1vrC50OtjtLVO4icuJ0tvFV64re-70r3m-oR9GwrtPiDZbBAkuitJzJ4pASF1eoBCZEbrM2ptAI6ejT_LKgeF09U62ICDbOTlyU1CMBs6XExcV8b6mBiO4jjy_koTK7s_InRG_Hezw Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 9c9f9ee9368546b89f207a9eb5c5165f Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1673977834 Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9c9f9ee9368546b89f207a9eb5c5165f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c9f9ee9368546b89f207a9eb5c5165f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c9f9ee9368546b89f207a9eb5c5165f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9c9f9ee9368546b89f207a9eb5c5165f", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TestEncryptedCinderVolumes-1673977834 Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 9c9f9ee9368546b89f207a9eb5c5165f Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1673977834 Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TestEncryptedCinderVolumes-1673977834-project Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 573a47f88384410fbbca9a397fa3ffc5 Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TestEncryptedCinderVolumes-1673977834-project Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 284bae99-05e1-4124-9c16-809191ca189a could not be found. Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '284bae99-05e1-4124-9c16-809191ca189a'} Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 284bae99-05e1-4124-9c16-809191ca189a could not be found. Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 284bae99-05e1-4124-9c16-809191ca189a could not be found. Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:28:25.348780 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:28:25.353103 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:28:25.353103 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:28:25.353103 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:28:25.353103 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:28:25.353103 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:28:25.353103 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:28:25.353103 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 284bae99-05e1-4124-9c16-809191ca189a could not be found. Oct 11 00:28:25.353103 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:28:25.353103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-29d58a65-413b-4854-8422-a8119c8c3720 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Returning 404 to user: Instance 284bae99-05e1-4124-9c16-809191ca189a could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:28:25.353103 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-29d58a65-413b-4854-8422-a8119c8c3720 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a" status: 404 len: 111 microversion: 2.1 time: 0.031502 Oct 11 00:28:25.353103 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3419/7494] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:28:25 2022] GET /compute/v2.1/servers/284bae99-05e1-4124-9c16-809191ca189a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:28:25.359023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-18e521b5-2a7a-43e1-b94a-ef84aad49514 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '.version_select at 0x7f662ad37c10>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:25.380630 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-18e521b5-2a7a-43e1-b94a-ef84aad49514 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1777271112" status: 202 len: 0 microversion: 2.1 time: 0.025354 Oct 11 00:28:25.381219 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4076/7495] 10.222.0.23 () {58 vars in 1278 bytes} [Tue Oct 11 00:28:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1777271112 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:28:25.399210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-54d18b5d-229a-437c-aa91-dd7c71796b1a tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Action: 'create', calling method: .version_select at 0x7f662bebc670>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-930191000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpyqK4TegfOLXLNsC1bo9FvjiE2QPup4BX/sPqfcxerXyPN8fT6xQPea59bQdGmwSuYQ5ksjm9lwwLzYHHLW2zKXjGqj2vKQW9UMo6A60AbbCdTLZRWSfR58TpFUp9SHQ=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:28:25.414508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-54d18b5d-229a-437c-aa91-dd7c71796b1a tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Getting quotas for project 9c9f9ee9368546b89f207a9eb5c5165f. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:28:25.422836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-54d18b5d-229a-437c-aa91-dd7c71796b1a tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Getting quotas for user 573a47f88384410fbbca9a397fa3ffc5 and project 9c9f9ee9368546b89f207a9eb5c5165f. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:28:25.447579 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-54d18b5d-229a-437c-aa91-dd7c71796b1a tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.052262 Oct 11 00:28:25.448205 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3420/7496] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 11 00:28:25 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:28:25.499754 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-de6d6d57-e0d8-4614-8ce2-3b14c256f80e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1066645231", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-930191000", "networks": [{"uuid": "3275473c-f018-44e4-9e6c-78c273af5848"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:28:25.553306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-de6d6d57-e0d8-4614-8ce2-3b14c256f80e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] validate_networks() for [('3275473c-f018-44e4-9e6c-78c273af5848', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:28:25.926952 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-de6d6d57-e0d8-4614-8ce2-3b14c256f80e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:28:25.927397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-de6d6d57-e0d8-4614-8ce2-3b14c256f80e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:28:25.927895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-de6d6d57-e0d8-4614-8ce2-3b14c256f80e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:28:25.928325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-de6d6d57-e0d8-4614-8ce2-3b14c256f80e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:28:25.928757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-de6d6d57-e0d8-4614-8ce2-3b14c256f80e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:28:25.938422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de6d6d57-e0d8-4614-8ce2-3b14c256f80e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:25.938856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de6d6d57-e0d8-4614-8ce2-3b14c256f80e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:25.939308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de6d6d57-e0d8-4614-8ce2-3b14c256f80e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:25.940057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de6d6d57-e0d8-4614-8ce2-3b14c256f80e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:25.940559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de6d6d57-e0d8-4614-8ce2-3b14c256f80e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:25.941006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de6d6d57-e0d8-4614-8ce2-3b14c256f80e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:25.958254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-de6d6d57-e0d8-4614-8ce2-3b14c256f80e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Getting quotas for project 9c9f9ee9368546b89f207a9eb5c5165f. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:28:25.963563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-de6d6d57-e0d8-4614-8ce2-3b14c256f80e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Getting quotas for user 573a47f88384410fbbca9a397fa3ffc5 and project 9c9f9ee9368546b89f207a9eb5c5165f. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:28:25.976224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-de6d6d57-e0d8-4614-8ce2-3b14c256f80e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:28:25.978564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-de6d6d57-e0d8-4614-8ce2-3b14c256f80e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:28:26.023751 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-de6d6d57-e0d8-4614-8ce2-3b14c256f80e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527912 Oct 11 00:28:26.024412 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4077/7497] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:28:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:28:26.036374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-42bf60ca-97b1-48e2-b408-d47a55421139 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:26.037091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-42bf60ca-97b1-48e2-b408-d47a55421139 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:26.092165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-42bf60ca-97b1-48e2-b408-d47a55421139 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:28:26.099830 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-42bf60ca-97b1-48e2-b408-d47a55421139 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862" status: 200 len: 1262 microversion: 2.1 time: 0.068205 Oct 11 00:28:26.100417 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3421/7498] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:28:26 2022] GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862 => generated 1262 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:28:27.123975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c1229ff3-d725-44d3-a0f0-1d05731910c3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:27.124627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c1229ff3-d725-44d3-a0f0-1d05731910c3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:27.133284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1229ff3-d725-44d3-a0f0-1d05731910c3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:27.134058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1229ff3-d725-44d3-a0f0-1d05731910c3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:27.134514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1229ff3-d725-44d3-a0f0-1d05731910c3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:27.135582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1229ff3-d725-44d3-a0f0-1d05731910c3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:27.136217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1229ff3-d725-44d3-a0f0-1d05731910c3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:27.136663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1229ff3-d725-44d3-a0f0-1d05731910c3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:27.239674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c1229ff3-d725-44d3-a0f0-1d05731910c3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:28:27.247595 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c1229ff3-d725-44d3-a0f0-1d05731910c3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862" status: 200 len: 1332 microversion: 2.1 time: 0.128488 Oct 11 00:28:27.248199 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4078/7499] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:28:27 2022] GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862 => generated 1332 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:28:28.271238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-537d1f35-9dfb-46ed-bd99-8dc07006ffe4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:28.271914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-537d1f35-9dfb-46ed-bd99-8dc07006ffe4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:28.279344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-537d1f35-9dfb-46ed-bd99-8dc07006ffe4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:28.279839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-537d1f35-9dfb-46ed-bd99-8dc07006ffe4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:28.280274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-537d1f35-9dfb-46ed-bd99-8dc07006ffe4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:28.280979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-537d1f35-9dfb-46ed-bd99-8dc07006ffe4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:28.281449 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-537d1f35-9dfb-46ed-bd99-8dc07006ffe4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:28.281874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-537d1f35-9dfb-46ed-bd99-8dc07006ffe4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:28.705440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-537d1f35-9dfb-46ed-bd99-8dc07006ffe4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:28:28.713789 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-537d1f35-9dfb-46ed-bd99-8dc07006ffe4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862" status: 200 len: 1362 microversion: 2.1 time: 0.446621 Oct 11 00:28:28.714378 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3422/7500] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:28:28 2022] GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862 => generated 1362 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:28:28.799228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-cc2ab5bd-a19a-453a-9240-9966a38d45a5 req-060f7257-2ac7-48ad-a043-2b0335f83b22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b53e5959-6678-401a-99d2-180134491862", "tag": "ca490a77-e18f-4539-b86f-e7bcaca82d40"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:28:28.826864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cc2ab5bd-a19a-453a-9240-9966a38d45a5 req-060f7257-2ac7-48ad-a043-2b0335f83b22 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:28.827429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cc2ab5bd-a19a-453a-9240-9966a38d45a5 req-060f7257-2ac7-48ad-a043-2b0335f83b22 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:28.828105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-cc2ab5bd-a19a-453a-9240-9966a38d45a5 req-060f7257-2ac7-48ad-a043-2b0335f83b22 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:28.842754 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-cc2ab5bd-a19a-453a-9240-9966a38d45a5 req-060f7257-2ac7-48ad-a043-2b0335f83b22 service nova] Creating event network-changed:ca490a77-e18f-4539-b86f-e7bcaca82d40 for instance b53e5959-6678-401a-99d2-180134491862 on n-h1-860864-2 Oct 11 00:28:28.848357 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-cc2ab5bd-a19a-453a-9240-9966a38d45a5 req-060f7257-2ac7-48ad-a043-2b0335f83b22 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053930 Oct 11 00:28:28.849065 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4079/7501] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:28:29.736566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5f2ac66a-09d8-4f0d-9412-68ce40a2d3ec tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:29.737159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5f2ac66a-09d8-4f0d-9412-68ce40a2d3ec tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:29.744649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f2ac66a-09d8-4f0d-9412-68ce40a2d3ec tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:29.745139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f2ac66a-09d8-4f0d-9412-68ce40a2d3ec tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:29.745617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f2ac66a-09d8-4f0d-9412-68ce40a2d3ec tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:29.746321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f2ac66a-09d8-4f0d-9412-68ce40a2d3ec tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:29.746835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f2ac66a-09d8-4f0d-9412-68ce40a2d3ec tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:29.747271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f2ac66a-09d8-4f0d-9412-68ce40a2d3ec tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:29.876642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5f2ac66a-09d8-4f0d-9412-68ce40a2d3ec tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:28:29.884560 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5f2ac66a-09d8-4f0d-9412-68ce40a2d3ec tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862" status: 200 len: 1362 microversion: 2.1 time: 0.152023 Oct 11 00:28:29.885144 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3423/7502] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:28:29 2022] GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:28:30.908858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-07e7d396-8feb-41b7-ae86-2be587e1d497 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:30.909597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-07e7d396-8feb-41b7-ae86-2be587e1d497 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:30.917654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07e7d396-8feb-41b7-ae86-2be587e1d497 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:30.918149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07e7d396-8feb-41b7-ae86-2be587e1d497 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:30.918598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07e7d396-8feb-41b7-ae86-2be587e1d497 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:30.919302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07e7d396-8feb-41b7-ae86-2be587e1d497 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:30.919768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07e7d396-8feb-41b7-ae86-2be587e1d497 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:30.920255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-07e7d396-8feb-41b7-ae86-2be587e1d497 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:31.050122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-07e7d396-8feb-41b7-ae86-2be587e1d497 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:28:31.058786 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-07e7d396-8feb-41b7-ae86-2be587e1d497 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862" status: 200 len: 1362 microversion: 2.1 time: 0.154310 Oct 11 00:28:31.059362 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4080/7503] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:28:30 2022] GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:28:32.082732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3458e6d2-0486-4fd3-b1e6-a19fb00ddeee tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:32.083298 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3458e6d2-0486-4fd3-b1e6-a19fb00ddeee tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:32.090144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3458e6d2-0486-4fd3-b1e6-a19fb00ddeee tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:32.090640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3458e6d2-0486-4fd3-b1e6-a19fb00ddeee tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:32.091083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3458e6d2-0486-4fd3-b1e6-a19fb00ddeee tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:32.091791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3458e6d2-0486-4fd3-b1e6-a19fb00ddeee tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:32.092249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3458e6d2-0486-4fd3-b1e6-a19fb00ddeee tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:32.092677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3458e6d2-0486-4fd3-b1e6-a19fb00ddeee tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:32.226188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3458e6d2-0486-4fd3-b1e6-a19fb00ddeee tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:28:32.234022 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3458e6d2-0486-4fd3-b1e6-a19fb00ddeee tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862" status: 200 len: 1362 microversion: 2.1 time: 0.155327 Oct 11 00:28:32.234596 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3424/7504] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:28:32 2022] GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:28:33.257917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-786558dd-abf0-4a50-afec-b5846de33740 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:33.259301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-786558dd-abf0-4a50-afec-b5846de33740 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:33.267306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-786558dd-abf0-4a50-afec-b5846de33740 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:33.267814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-786558dd-abf0-4a50-afec-b5846de33740 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:33.268272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-786558dd-abf0-4a50-afec-b5846de33740 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:33.268997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-786558dd-abf0-4a50-afec-b5846de33740 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:33.269503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-786558dd-abf0-4a50-afec-b5846de33740 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:33.269949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-786558dd-abf0-4a50-afec-b5846de33740 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:33.401253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-786558dd-abf0-4a50-afec-b5846de33740 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:28:33.408914 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-786558dd-abf0-4a50-afec-b5846de33740 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862" status: 200 len: 1362 microversion: 2.1 time: 0.155592 Oct 11 00:28:33.409506 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4081/7505] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:28:33 2022] GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:28:34.431526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3c2d4b09-590e-4ee2-8c83-83ce3d009c7e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:34.432405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3c2d4b09-590e-4ee2-8c83-83ce3d009c7e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:34.439366 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c2d4b09-590e-4ee2-8c83-83ce3d009c7e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:34.439860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c2d4b09-590e-4ee2-8c83-83ce3d009c7e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:34.440297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c2d4b09-590e-4ee2-8c83-83ce3d009c7e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:34.440990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c2d4b09-590e-4ee2-8c83-83ce3d009c7e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:34.441479 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c2d4b09-590e-4ee2-8c83-83ce3d009c7e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:34.441911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3c2d4b09-590e-4ee2-8c83-83ce3d009c7e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:34.578483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3c2d4b09-590e-4ee2-8c83-83ce3d009c7e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:28:34.586943 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3c2d4b09-590e-4ee2-8c83-83ce3d009c7e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862" status: 200 len: 1362 microversion: 2.1 time: 0.159324 Oct 11 00:28:34.587517 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3425/7506] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:28:34 2022] GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:28:35.610643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-05932c6e-5cf3-4e05-b285-86fbaca1a9db tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:35.611267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-05932c6e-5cf3-4e05-b285-86fbaca1a9db tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:35.619375 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05932c6e-5cf3-4e05-b285-86fbaca1a9db tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:35.619877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05932c6e-5cf3-4e05-b285-86fbaca1a9db tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:35.620329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05932c6e-5cf3-4e05-b285-86fbaca1a9db tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:35.621037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05932c6e-5cf3-4e05-b285-86fbaca1a9db tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:35.621542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05932c6e-5cf3-4e05-b285-86fbaca1a9db tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:35.621986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05932c6e-5cf3-4e05-b285-86fbaca1a9db tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:35.758919 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-05932c6e-5cf3-4e05-b285-86fbaca1a9db tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:28:35.767249 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-05932c6e-5cf3-4e05-b285-86fbaca1a9db tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862" status: 200 len: 1362 microversion: 2.1 time: 0.160517 Oct 11 00:28:35.768074 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4082/7507] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:28:35 2022] GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:28:35.837185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-e34f2000-ea06-410a-a56c-0d6b9960e5e2 req-6940dfab-d9f1-44a4-8e20-765a07d91ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b53e5959-6678-401a-99d2-180134491862", "name": "network-vif-plugged", "status": "completed", "tag": "ca490a77-e18f-4539-b86f-e7bcaca82d40"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:28:35.851424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e34f2000-ea06-410a-a56c-0d6b9960e5e2 req-6940dfab-d9f1-44a4-8e20-765a07d91ac6 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:35.852095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e34f2000-ea06-410a-a56c-0d6b9960e5e2 req-6940dfab-d9f1-44a4-8e20-765a07d91ac6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:35.852540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e34f2000-ea06-410a-a56c-0d6b9960e5e2 req-6940dfab-d9f1-44a4-8e20-765a07d91ac6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:35.864464 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-e34f2000-ea06-410a-a56c-0d6b9960e5e2 req-6940dfab-d9f1-44a4-8e20-765a07d91ac6 service nova] Creating event network-vif-plugged:ca490a77-e18f-4539-b86f-e7bcaca82d40 for instance b53e5959-6678-401a-99d2-180134491862 on n-h1-860864-2 Oct 11 00:28:35.869675 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-e34f2000-ea06-410a-a56c-0d6b9960e5e2 req-6940dfab-d9f1-44a4-8e20-765a07d91ac6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036217 Oct 11 00:28:35.870310 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3426/7508] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:28:36.793338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-06ac13eb-6cbd-414a-94cb-a7efbffca0ee tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:36.793911 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-06ac13eb-6cbd-414a-94cb-a7efbffca0ee tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:36.796073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:28:36.796800 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:28:36.804380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06ac13eb-6cbd-414a-94cb-a7efbffca0ee tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:36.804880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06ac13eb-6cbd-414a-94cb-a7efbffca0ee tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:36.805338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06ac13eb-6cbd-414a-94cb-a7efbffca0ee tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:36.806074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06ac13eb-6cbd-414a-94cb-a7efbffca0ee tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:36.806541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06ac13eb-6cbd-414a-94cb-a7efbffca0ee tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:36.807255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-06ac13eb-6cbd-414a-94cb-a7efbffca0ee tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:36.951090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-06ac13eb-6cbd-414a-94cb-a7efbffca0ee tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:28:36.959623 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-06ac13eb-6cbd-414a-94cb-a7efbffca0ee tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862" status: 200 len: 1362 microversion: 2.1 time: 0.170298 Oct 11 00:28:36.960204 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4083/7509] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:28:36 2022] GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:28:37.983014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e5596b86-e9dc-4414-8424-99654d7a30d7 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:37.983723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e5596b86-e9dc-4414-8424-99654d7a30d7 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:37.985697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:28:37.992899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5596b86-e9dc-4414-8424-99654d7a30d7 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:37.993410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5596b86-e9dc-4414-8424-99654d7a30d7 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:37.993861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5596b86-e9dc-4414-8424-99654d7a30d7 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:37.994566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5596b86-e9dc-4414-8424-99654d7a30d7 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:37.995024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5596b86-e9dc-4414-8424-99654d7a30d7 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:37.995457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e5596b86-e9dc-4414-8424-99654d7a30d7 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:38.126441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e5596b86-e9dc-4414-8424-99654d7a30d7 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:28:38.134537 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e5596b86-e9dc-4414-8424-99654d7a30d7 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862" status: 200 len: 1554 microversion: 2.1 time: 0.155949 Oct 11 00:28:38.135114 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3427/7510] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:28:37 2022] GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:28:38.157485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dd5818cb-00d9-4c4f-b3df-fcb90c04d8a7 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:38.158127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dd5818cb-00d9-4c4f-b3df-fcb90c04d8a7 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:38.165551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd5818cb-00d9-4c4f-b3df-fcb90c04d8a7 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:38.166061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd5818cb-00d9-4c4f-b3df-fcb90c04d8a7 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:38.166522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd5818cb-00d9-4c4f-b3df-fcb90c04d8a7 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:38.167235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd5818cb-00d9-4c4f-b3df-fcb90c04d8a7 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:38.167712 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd5818cb-00d9-4c4f-b3df-fcb90c04d8a7 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:38.168172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd5818cb-00d9-4c4f-b3df-fcb90c04d8a7 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:38.305445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dd5818cb-00d9-4c4f-b3df-fcb90c04d8a7 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:28:38.313622 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dd5818cb-00d9-4c4f-b3df-fcb90c04d8a7 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862" status: 200 len: 1554 microversion: 2.1 time: 0.160034 Oct 11 00:28:38.314202 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4084/7511] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:28:38 2022] GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:28:39.820177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c5685109-d9d5-45d3-a7bc-785aacb75d0b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5ae0d27-bb6d-4d68-82f6-f836c273d4ae"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:28:39.822623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c5685109-d9d5-45d3-a7bc-785aacb75d0b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:39.830012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5685109-d9d5-45d3-a7bc-785aacb75d0b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:39.830502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5685109-d9d5-45d3-a7bc-785aacb75d0b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:39.830940 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5685109-d9d5-45d3-a7bc-785aacb75d0b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:39.831642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5685109-d9d5-45d3-a7bc-785aacb75d0b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:39.832098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5685109-d9d5-45d3-a7bc-785aacb75d0b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:39.832558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5685109-d9d5-45d3-a7bc-785aacb75d0b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:40.078821 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c5685109-d9d5-45d3-a7bc-785aacb75d0b tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "POST /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262784 Oct 11 00:28:40.079478 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3428/7512] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 11 00:28:39 2022] POST /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:28:50.801626 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-88a0d396-6f16-4e6c-8fe7-fa720ae705e3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:50.802181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-88a0d396-6f16-4e6c-8fe7-fa720ae705e3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:50.805667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:28:50.806466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:28:50.813031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88a0d396-6f16-4e6c-8fe7-fa720ae705e3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:50.813641 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88a0d396-6f16-4e6c-8fe7-fa720ae705e3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:50.814110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88a0d396-6f16-4e6c-8fe7-fa720ae705e3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:50.814843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88a0d396-6f16-4e6c-8fe7-fa720ae705e3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:50.815325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88a0d396-6f16-4e6c-8fe7-fa720ae705e3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:50.815803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88a0d396-6f16-4e6c-8fe7-fa720ae705e3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:50.904376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-88a0d396-6f16-4e6c-8fe7-fa720ae705e3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lazy-loading 'services' on Instance uuid b53e5959-6678-401a-99d2-180134491862 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:28:50.978826 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-88a0d396-6f16-4e6c-8fe7-fa720ae705e3 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862/os-volume_attachments/e5ae0d27-bb6d-4d68-82f6-f836c273d4ae" status: 202 len: 0 microversion: 2.1 time: 0.181051 Oct 11 00:28:50.979490 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4085/7513] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 11 00:28:50 2022] DELETE /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862/os-volume_attachments/e5ae0d27-bb6d-4d68-82f6-f836c273d4ae => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:28:50.988428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-886e4b30-4e65-4510-b408-de86f9120a86 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:50.991445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-886e4b30-4e65-4510-b408-de86f9120a86 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:50.995218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:28:50.996106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:28:51.003233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-886e4b30-4e65-4510-b408-de86f9120a86 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:51.003727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-886e4b30-4e65-4510-b408-de86f9120a86 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:51.004168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-886e4b30-4e65-4510-b408-de86f9120a86 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:51.004875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-886e4b30-4e65-4510-b408-de86f9120a86 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:51.005338 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-886e4b30-4e65-4510-b408-de86f9120a86 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:51.005796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-886e4b30-4e65-4510-b408-de86f9120a86 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:51.040455 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-886e4b30-4e65-4510-b408-de86f9120a86 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056459 Oct 11 00:28:51.041002 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3429/7514] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:28:50 2022] GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:28:52.054784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b839529f-b433-4f57-9722-b54cce39805d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:52.057649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b839529f-b433-4f57-9722-b54cce39805d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:52.064111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b839529f-b433-4f57-9722-b54cce39805d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:52.064615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b839529f-b433-4f57-9722-b54cce39805d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:52.065070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b839529f-b433-4f57-9722-b54cce39805d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:52.066092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b839529f-b433-4f57-9722-b54cce39805d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:52.066286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b839529f-b433-4f57-9722-b54cce39805d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:52.066783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b839529f-b433-4f57-9722-b54cce39805d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:52.098744 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b839529f-b433-4f57-9722-b54cce39805d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049158 Oct 11 00:28:52.099326 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4086/7515] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:28:52 2022] GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:28:53.112180 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fc222e66-441e-4ace-a5ba-2bd4563b20d4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:53.114646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fc222e66-441e-4ace-a5ba-2bd4563b20d4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:53.122941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc222e66-441e-4ace-a5ba-2bd4563b20d4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:53.123553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc222e66-441e-4ace-a5ba-2bd4563b20d4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:53.124068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc222e66-441e-4ace-a5ba-2bd4563b20d4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:53.124853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc222e66-441e-4ace-a5ba-2bd4563b20d4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:53.125400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc222e66-441e-4ace-a5ba-2bd4563b20d4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:53.125928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc222e66-441e-4ace-a5ba-2bd4563b20d4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:53.158092 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fc222e66-441e-4ace-a5ba-2bd4563b20d4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050001 Oct 11 00:28:53.158688 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3430/7516] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:28:53 2022] GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:28:54.170998 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3e52622d-d2e8-4aa4-9fc6-fb3af1b7642d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:54.173258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3e52622d-d2e8-4aa4-9fc6-fb3af1b7642d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:54.180254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e52622d-d2e8-4aa4-9fc6-fb3af1b7642d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:54.180757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e52622d-d2e8-4aa4-9fc6-fb3af1b7642d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:54.181209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e52622d-d2e8-4aa4-9fc6-fb3af1b7642d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:54.181949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e52622d-d2e8-4aa4-9fc6-fb3af1b7642d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:54.182673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e52622d-d2e8-4aa4-9fc6-fb3af1b7642d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:54.183112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3e52622d-d2e8-4aa4-9fc6-fb3af1b7642d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:54.214984 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3e52622d-d2e8-4aa4-9fc6-fb3af1b7642d tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048240 Oct 11 00:28:54.215559 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4087/7517] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:28:54 2022] GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:28:55.228287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a7dbabca-b7d6-4996-8467-ff052d0b0f47 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:55.230486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a7dbabca-b7d6-4996-8467-ff052d0b0f47 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:55.237143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7dbabca-b7d6-4996-8467-ff052d0b0f47 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:55.237661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7dbabca-b7d6-4996-8467-ff052d0b0f47 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:55.238099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7dbabca-b7d6-4996-8467-ff052d0b0f47 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:55.238784 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7dbabca-b7d6-4996-8467-ff052d0b0f47 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:55.239235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7dbabca-b7d6-4996-8467-ff052d0b0f47 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:55.239659 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a7dbabca-b7d6-4996-8467-ff052d0b0f47 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:55.269696 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a7dbabca-b7d6-4996-8467-ff052d0b0f47 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046101 Oct 11 00:28:55.270267 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3431/7518] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:28:55 2022] GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:28:56.282729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-991222ed-c958-46e7-92cd-aaa5250692fd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:56.284935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-991222ed-c958-46e7-92cd-aaa5250692fd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:56.292972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-991222ed-c958-46e7-92cd-aaa5250692fd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:56.293493 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-991222ed-c958-46e7-92cd-aaa5250692fd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:56.293944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-991222ed-c958-46e7-92cd-aaa5250692fd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:56.294648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-991222ed-c958-46e7-92cd-aaa5250692fd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:56.295111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-991222ed-c958-46e7-92cd-aaa5250692fd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:56.295547 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-991222ed-c958-46e7-92cd-aaa5250692fd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:56.326742 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-991222ed-c958-46e7-92cd-aaa5250692fd tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048017 Oct 11 00:28:56.327302 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4088/7519] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:28:56 2022] GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 00:28:56.339574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-faae71d3-8fc8-4298-bda0-c1db2afdb99e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:56.340103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-faae71d3-8fc8-4298-bda0-c1db2afdb99e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:56.346814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faae71d3-8fc8-4298-bda0-c1db2afdb99e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:56.347303 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faae71d3-8fc8-4298-bda0-c1db2afdb99e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:56.347746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faae71d3-8fc8-4298-bda0-c1db2afdb99e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:56.348491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faae71d3-8fc8-4298-bda0-c1db2afdb99e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:56.348997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faae71d3-8fc8-4298-bda0-c1db2afdb99e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:56.349560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-faae71d3-8fc8-4298-bda0-c1db2afdb99e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:56.426632 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-faae71d3-8fc8-4298-bda0-c1db2afdb99e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] HTTP exception thrown: Instance b53e5959-6678-401a-99d2-180134491862 is not attached to volume e5ae0d27-bb6d-4d68-82f6-f836c273d4ae Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-faae71d3-8fc8-4298-bda0-c1db2afdb99e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Request method failure captured: Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862/os-volume_attachments/e5ae0d27-bb6d-4d68-82f6-f836c273d4ae HTTP/1.1 Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLhV55gbLVb0l_5bSGDinadOtlBuKHjRNnlsJ1vrC50OtjtLVO4icuJ0tvFV64re-70r3m-oR9GwrtPiDZbBAkuitJzJ4pASF1eoBCZEbrM2ptAI6ejT_LKgeF09U62ICDbOTlyU1CMBs6XExcV8b6mBiO4jjy_koTK7s_InRG_Hezw Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 9c9f9ee9368546b89f207a9eb5c5165f Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1673977834 Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9c9f9ee9368546b89f207a9eb5c5165f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c9f9ee9368546b89f207a9eb5c5165f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c9f9ee9368546b89f207a9eb5c5165f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9c9f9ee9368546b89f207a9eb5c5165f", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TestEncryptedCinderVolumes-1673977834 Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 9c9f9ee9368546b89f207a9eb5c5165f Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1673977834 Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TestEncryptedCinderVolumes-1673977834-project Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 573a47f88384410fbbca9a397fa3ffc5 Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TestEncryptedCinderVolumes-1673977834-project Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance b53e5959-6678-401a-99d2-180134491862 is not attached to volume e5ae0d27-bb6d-4d68-82f6-f836c273d4ae Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'server_id': 'b53e5959-6678-401a-99d2-180134491862', 'id': 'e5ae0d27-bb6d-4d68-82f6-f836c273d4ae'} Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e5ae0d27-bb6d-4d68-82f6-f836c273d4ae. Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b53e5959-6678-401a-99d2-180134491862 is not attached to volume e5ae0d27-bb6d-4d68-82f6-f836c273d4ae Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:28:56.428274 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:28:56.433978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:28:56.433978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:28:56.433978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b53e5959-6678-401a-99d2-180134491862 is not attached to volume e5ae0d27-bb6d-4d68-82f6-f836c273d4ae Oct 11 00:28:56.433978 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:28:56.433978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-faae71d3-8fc8-4298-bda0-c1db2afdb99e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Returning 404 to user: Instance b53e5959-6678-401a-99d2-180134491862 is not attached to volume e5ae0d27-bb6d-4d68-82f6-f836c273d4ae {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:28:56.433978 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-faae71d3-8fc8-4298-bda0-c1db2afdb99e tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862/os-volume_attachments/e5ae0d27-bb6d-4d68-82f6-f836c273d4ae" status: 404 len: 154 microversion: 2.1 time: 0.094476 Oct 11 00:28:56.433978 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3432/7520] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 11 00:28:56 2022] DELETE /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862/os-volume_attachments/e5ae0d27-bb6d-4d68-82f6-f836c273d4ae => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:28:59.781255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ff486aa2-215c-4cde-818f-9a2beeeaca26 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:59.782050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ff486aa2-215c-4cde-818f-9a2beeeaca26 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:59.789228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff486aa2-215c-4cde-818f-9a2beeeaca26 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:59.791008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff486aa2-215c-4cde-818f-9a2beeeaca26 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:59.791008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff486aa2-215c-4cde-818f-9a2beeeaca26 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:59.792137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff486aa2-215c-4cde-818f-9a2beeeaca26 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:59.792617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff486aa2-215c-4cde-818f-9a2beeeaca26 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:59.793064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ff486aa2-215c-4cde-818f-9a2beeeaca26 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:59.821262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ff486aa2-215c-4cde-818f-9a2beeeaca26 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:28:59.903074 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ff486aa2-215c-4cde-818f-9a2beeeaca26 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862" status: 204 len: 0 microversion: 2.1 time: 0.125693 Oct 11 00:28:59.903897 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4089/7521] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:28:59 2022] DELETE /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:28:59.914014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-03379183-1b4a-4274-8072-dfd330cf20e4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:28:59.915202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-03379183-1b4a-4274-8072-dfd330cf20e4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:28:59.922463 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03379183-1b4a-4274-8072-dfd330cf20e4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:59.922944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03379183-1b4a-4274-8072-dfd330cf20e4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:59.923407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03379183-1b4a-4274-8072-dfd330cf20e4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:28:59.924098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03379183-1b4a-4274-8072-dfd330cf20e4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:28:59.924545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03379183-1b4a-4274-8072-dfd330cf20e4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:28:59.924965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-03379183-1b4a-4274-8072-dfd330cf20e4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:00.061996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-03379183-1b4a-4274-8072-dfd330cf20e4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:00.069978 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-03379183-1b4a-4274-8072-dfd330cf20e4 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862" status: 200 len: 1560 microversion: 2.1 time: 0.160982 Oct 11 00:29:00.071232 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3433/7522] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:28:59 2022] GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:29:01.095378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b7706a1b-c5d1-4c76-9bd8-8f87f1a061f6 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:01.096021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b7706a1b-c5d1-4c76-9bd8-8f87f1a061f6 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:01.103964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7706a1b-c5d1-4c76-9bd8-8f87f1a061f6 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:01.104467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7706a1b-c5d1-4c76-9bd8-8f87f1a061f6 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:01.104924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7706a1b-c5d1-4c76-9bd8-8f87f1a061f6 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:01.105668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7706a1b-c5d1-4c76-9bd8-8f87f1a061f6 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:01.106145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7706a1b-c5d1-4c76-9bd8-8f87f1a061f6 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:01.106589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7706a1b-c5d1-4c76-9bd8-8f87f1a061f6 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:01.242534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b7706a1b-c5d1-4c76-9bd8-8f87f1a061f6 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:01.250414 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b7706a1b-c5d1-4c76-9bd8-8f87f1a061f6 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862" status: 200 len: 1560 microversion: 2.1 time: 0.159482 Oct 11 00:29:01.250995 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4090/7523] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:29:01 2022] GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:29:01.960728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-4592a3fb-abd0-4baa-b65f-3e0d051e1f2d req-435fae45-db14-429e-8607-31c039b2e0ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b53e5959-6678-401a-99d2-180134491862", "name": "network-vif-deleted", "tag": "ca490a77-e18f-4539-b86f-e7bcaca82d40"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:29:01.976177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4592a3fb-abd0-4baa-b65f-3e0d051e1f2d req-435fae45-db14-429e-8607-31c039b2e0ad service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:01.976663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4592a3fb-abd0-4baa-b65f-3e0d051e1f2d req-435fae45-db14-429e-8607-31c039b2e0ad service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:01.977262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4592a3fb-abd0-4baa-b65f-3e0d051e1f2d req-435fae45-db14-429e-8607-31c039b2e0ad service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:01.991719 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-4592a3fb-abd0-4baa-b65f-3e0d051e1f2d req-435fae45-db14-429e-8607-31c039b2e0ad service nova] Creating event network-vif-deleted:ca490a77-e18f-4539-b86f-e7bcaca82d40 for instance b53e5959-6678-401a-99d2-180134491862 on n-h1-860864-2 Oct 11 00:29:02.001609 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-4592a3fb-abd0-4baa-b65f-3e0d051e1f2d req-435fae45-db14-429e-8607-31c039b2e0ad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044582 Oct 11 00:29:02.003085 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3434/7524] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:29:02.274505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3ef24e3e-b972-4bf4-b107-0a7b403ee19c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:02.275061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3ef24e3e-b972-4bf4-b107-0a7b403ee19c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:02.282003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ef24e3e-b972-4bf4-b107-0a7b403ee19c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:02.282509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ef24e3e-b972-4bf4-b107-0a7b403ee19c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:02.282963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ef24e3e-b972-4bf4-b107-0a7b403ee19c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:02.283672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ef24e3e-b972-4bf4-b107-0a7b403ee19c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:02.284140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ef24e3e-b972-4bf4-b107-0a7b403ee19c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:02.284580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ef24e3e-b972-4bf4-b107-0a7b403ee19c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:02.317046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ef24e3e-b972-4bf4-b107-0a7b403ee19c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:02.317500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ef24e3e-b972-4bf4-b107-0a7b403ee19c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:02.317960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ef24e3e-b972-4bf4-b107-0a7b403ee19c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:02.318429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-3ef24e3e-b972-4bf4-b107-0a7b403ee19c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lazy-loading 'fault' on Instance uuid b53e5959-6678-401a-99d2-180134491862 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:29:02.360518 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3ef24e3e-b972-4bf4-b107-0a7b403ee19c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '573a47f88384410fbbca9a397fa3ffc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f9ee9368546b89f207a9eb5c5165f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:02.369638 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3ef24e3e-b972-4bf4-b107-0a7b403ee19c tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862" status: 200 len: 1352 microversion: 2.1 time: 0.099230 Oct 11 00:29:02.370235 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4091/7525] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:29:02 2022] GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862 => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:29:03.396002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-763b2b30-6d4d-40c9-92c8-d571858caadb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:03.396733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-763b2b30-6d4d-40c9-92c8-d571858caadb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] [instance: b53e5959-6678-401a-99d2-180134491862] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:03.403368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-763b2b30-6d4d-40c9-92c8-d571858caadb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:03.403859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-763b2b30-6d4d-40c9-92c8-d571858caadb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:03.404300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-763b2b30-6d4d-40c9-92c8-d571858caadb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:03.405011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-763b2b30-6d4d-40c9-92c8-d571858caadb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:03.405500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-763b2b30-6d4d-40c9-92c8-d571858caadb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:03.405930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-763b2b30-6d4d-40c9-92c8-d571858caadb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:03.422377 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-763b2b30-6d4d-40c9-92c8-d571858caadb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] HTTP exception thrown: Instance b53e5959-6678-401a-99d2-180134491862 could not be found. Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-763b2b30-6d4d-40c9-92c8-d571858caadb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Request method failure captured: Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862 HTTP/1.1 Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLhV55gbLVb0l_5bSGDinadOtlBuKHjRNnlsJ1vrC50OtjtLVO4icuJ0tvFV64re-70r3m-oR9GwrtPiDZbBAkuitJzJ4pASF1eoBCZEbrM2ptAI6ejT_LKgeF09U62ICDbOTlyU1CMBs6XExcV8b6mBiO4jjy_koTK7s_InRG_Hezw Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 9c9f9ee9368546b89f207a9eb5c5165f Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1673977834 Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9c9f9ee9368546b89f207a9eb5c5165f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c9f9ee9368546b89f207a9eb5c5165f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9c9f9ee9368546b89f207a9eb5c5165f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9c9f9ee9368546b89f207a9eb5c5165f", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TestEncryptedCinderVolumes-1673977834 Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 9c9f9ee9368546b89f207a9eb5c5165f Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1673977834 Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TestEncryptedCinderVolumes-1673977834-project Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 573a47f88384410fbbca9a397fa3ffc5 Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TestEncryptedCinderVolumes-1673977834-project Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance b53e5959-6678-401a-99d2-180134491862 could not be found. Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'b53e5959-6678-401a-99d2-180134491862'} Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b53e5959-6678-401a-99d2-180134491862 could not be found. Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b53e5959-6678-401a-99d2-180134491862 could not be found. Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:29:03.424053 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:29:03.428748 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:29:03.428748 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:29:03.428748 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:29:03.428748 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:29:03.428748 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:29:03.428748 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:29:03.428748 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b53e5959-6678-401a-99d2-180134491862 could not be found. Oct 11 00:29:03.428748 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:29:03.428748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-763b2b30-6d4d-40c9-92c8-d571858caadb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Returning 404 to user: Instance b53e5959-6678-401a-99d2-180134491862 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:29:03.428748 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-763b2b30-6d4d-40c9-92c8-d571858caadb tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862" status: 404 len: 111 microversion: 2.1 time: 0.035086 Oct 11 00:29:03.428748 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3435/7526] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:29:03 2022] GET /compute/v2.1/servers/b53e5959-6678-401a-99d2-180134491862 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:29:03.438744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3f53767d-5f62-45d2-b393-c529e3eb59e5 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] Calling method '.version_select at 0x7f662bdb70d0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:03.466345 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3f53767d-5f62-45d2-b393-c529e3eb59e5 tempest-TestEncryptedCinderVolumes-1673977834 tempest-TestEncryptedCinderVolumes-1673977834-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-930191000" status: 202 len: 0 microversion: 2.1 time: 0.034525 Oct 11 00:29:03.466948 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4092/7527] 10.222.0.23 () {58 vars in 1275 bytes} [Tue Oct 11 00:29:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-930191000 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 00:29:31.611775 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c4c57cb2-692d-4280-8e2f-e57885b9aaaf tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Action: 'create', calling method: .version_select at 0x7f662a292d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1505106336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGevZwKuEx3ADwCm1m45VN/IoUCOPc/IO/h5O5+lBZ7AUeFEC1mGqjhZBiq1Z9s5UlByQEvfoL+zPEfJnZZ84lYX9dyj3qXj6lnPJtlMF1LzxBaxTWPIkkz3e+1cEseYWg=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:29:31.618608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=14 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:29:31.619410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=34 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:29:31.632204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-c4c57cb2-692d-4280-8e2f-e57885b9aaaf tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Getting quotas for project 9690f354b0074e9e9b442e6154bcd41d. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:29:31.638880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-c4c57cb2-692d-4280-8e2f-e57885b9aaaf tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Getting quotas for user 4eef568ea2ab44119b61203db2dc25a9 and project 9690f354b0074e9e9b442e6154bcd41d. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:29:31.668341 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c4c57cb2-692d-4280-8e2f-e57885b9aaaf tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.060371 Oct 11 00:29:31.669251 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3436/7528] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 11 00:29:31 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:29:31.719242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:29:31.720207 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:29:31.725492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7f37622b-ecc0-46ae-8434-5fa2d3095100 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-563976107", "imageRef": "eb619211-cbc3-4b6c-a5ac-0f1551810746", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1505106336", "networks": [{"uuid": "1bad6c58-f3ee-4dcd-b87e-c21d35f7b604"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:29:31.782666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-7f37622b-ecc0-46ae-8434-5fa2d3095100 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] validate_networks() for [('1bad6c58-f3ee-4dcd-b87e-c21d35f7b604', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:29:32.191700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7f37622b-ecc0-46ae-8434-5fa2d3095100 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:29:32.192147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7f37622b-ecc0-46ae-8434-5fa2d3095100 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:29:32.192648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7f37622b-ecc0-46ae-8434-5fa2d3095100 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:29:32.193104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7f37622b-ecc0-46ae-8434-5fa2d3095100 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:29:32.193567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-7f37622b-ecc0-46ae-8434-5fa2d3095100 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:29:32.203519 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f37622b-ecc0-46ae-8434-5fa2d3095100 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:32.204018 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f37622b-ecc0-46ae-8434-5fa2d3095100 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:32.204473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f37622b-ecc0-46ae-8434-5fa2d3095100 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:32.205217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f37622b-ecc0-46ae-8434-5fa2d3095100 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:32.205720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f37622b-ecc0-46ae-8434-5fa2d3095100 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:32.206164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f37622b-ecc0-46ae-8434-5fa2d3095100 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:32.226098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-7f37622b-ecc0-46ae-8434-5fa2d3095100 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Getting quotas for project 9690f354b0074e9e9b442e6154bcd41d. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:29:32.232724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-7f37622b-ecc0-46ae-8434-5fa2d3095100 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Getting quotas for user 4eef568ea2ab44119b61203db2dc25a9 and project 9690f354b0074e9e9b442e6154bcd41d. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:29:32.246765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7f37622b-ecc0-46ae-8434-5fa2d3095100 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:29:32.249031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7f37622b-ecc0-46ae-8434-5fa2d3095100 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eb619211-cbc3-4b6c-a5ac-0f1551810746',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:29:32.298480 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7f37622b-ecc0-46ae-8434-5fa2d3095100 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581314 Oct 11 00:29:32.299157 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4093/7529] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:29:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:29:32.311063 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a7fa0461-20c9-4c2b-b9d2-a4d07b995065 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:32.311794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a7fa0461-20c9-4c2b-b9d2-a4d07b995065 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:32.377040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a7fa0461-20c9-4c2b-b9d2-a4d07b995065 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:32.387455 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a7fa0461-20c9-4c2b-b9d2-a4d07b995065 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1258 microversion: 2.1 time: 0.080955 Oct 11 00:29:32.388148 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3437/7530] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:29:32 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1258 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:29:33.413228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7d04e192-d4c8-4b62-a2f0-19e91446d365 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:33.414283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7d04e192-d4c8-4b62-a2f0-19e91446d365 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:33.421340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d04e192-d4c8-4b62-a2f0-19e91446d365 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:33.421973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d04e192-d4c8-4b62-a2f0-19e91446d365 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:33.422505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d04e192-d4c8-4b62-a2f0-19e91446d365 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:33.423316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d04e192-d4c8-4b62-a2f0-19e91446d365 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:33.424030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d04e192-d4c8-4b62-a2f0-19e91446d365 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:33.424559 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7d04e192-d4c8-4b62-a2f0-19e91446d365 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:33.530543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7d04e192-d4c8-4b62-a2f0-19e91446d365 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:33.539029 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7d04e192-d4c8-4b62-a2f0-19e91446d365 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1328 microversion: 2.1 time: 0.130667 Oct 11 00:29:33.539945 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4094/7531] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:29:33 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1328 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:29:34.562910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f8d30d60-e5a5-4bb5-a344-be11bd6773f7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:34.563667 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f8d30d60-e5a5-4bb5-a344-be11bd6773f7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:34.571468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f8d30d60-e5a5-4bb5-a344-be11bd6773f7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:34.571974 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f8d30d60-e5a5-4bb5-a344-be11bd6773f7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:34.572436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f8d30d60-e5a5-4bb5-a344-be11bd6773f7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:34.573220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f8d30d60-e5a5-4bb5-a344-be11bd6773f7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:34.573707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f8d30d60-e5a5-4bb5-a344-be11bd6773f7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:34.574137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f8d30d60-e5a5-4bb5-a344-be11bd6773f7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:34.717247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f8d30d60-e5a5-4bb5-a344-be11bd6773f7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:34.725818 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f8d30d60-e5a5-4bb5-a344-be11bd6773f7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1358 microversion: 2.1 time: 0.166773 Oct 11 00:29:34.726654 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3438/7532] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:29:34 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:29:35.751801 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9d0f5b0b-a400-40bf-8823-a28cd62c4cf3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:35.752451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9d0f5b0b-a400-40bf-8823-a28cd62c4cf3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:35.765573 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d0f5b0b-a400-40bf-8823-a28cd62c4cf3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:35.766098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d0f5b0b-a400-40bf-8823-a28cd62c4cf3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:35.766556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d0f5b0b-a400-40bf-8823-a28cd62c4cf3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:35.767299 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d0f5b0b-a400-40bf-8823-a28cd62c4cf3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:35.767963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d0f5b0b-a400-40bf-8823-a28cd62c4cf3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:35.768419 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d0f5b0b-a400-40bf-8823-a28cd62c4cf3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:35.920211 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9d0f5b0b-a400-40bf-8823-a28cd62c4cf3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:35.928252 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9d0f5b0b-a400-40bf-8823-a28cd62c4cf3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1358 microversion: 2.1 time: 0.181116 Oct 11 00:29:35.929173 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4095/7533] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:29:35 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:29:36.951861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cd5ffa73-4a87-4f9f-87f9-f99bb833b5ec tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:36.953412 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cd5ffa73-4a87-4f9f-87f9-f99bb833b5ec tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:36.960854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd5ffa73-4a87-4f9f-87f9-f99bb833b5ec tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:36.962161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd5ffa73-4a87-4f9f-87f9-f99bb833b5ec tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:36.962978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd5ffa73-4a87-4f9f-87f9-f99bb833b5ec tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:36.963767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd5ffa73-4a87-4f9f-87f9-f99bb833b5ec tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:36.964311 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd5ffa73-4a87-4f9f-87f9-f99bb833b5ec tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:36.964835 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cd5ffa73-4a87-4f9f-87f9-f99bb833b5ec tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:37.107856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cd5ffa73-4a87-4f9f-87f9-f99bb833b5ec tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:37.116311 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cd5ffa73-4a87-4f9f-87f9-f99bb833b5ec tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1358 microversion: 2.1 time: 0.168301 Oct 11 00:29:37.116894 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3439/7534] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:29:36 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:29:38.141160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-83134de9-cc9a-4a5a-aec1-b909e13cb1a4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:38.142047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-83134de9-cc9a-4a5a-aec1-b909e13cb1a4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:38.155557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83134de9-cc9a-4a5a-aec1-b909e13cb1a4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:38.156081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83134de9-cc9a-4a5a-aec1-b909e13cb1a4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:38.156540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83134de9-cc9a-4a5a-aec1-b909e13cb1a4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:38.157279 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83134de9-cc9a-4a5a-aec1-b909e13cb1a4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:38.157794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83134de9-cc9a-4a5a-aec1-b909e13cb1a4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:38.158242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83134de9-cc9a-4a5a-aec1-b909e13cb1a4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:38.321407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-83134de9-cc9a-4a5a-aec1-b909e13cb1a4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:38.332378 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-83134de9-cc9a-4a5a-aec1-b909e13cb1a4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1358 microversion: 2.1 time: 0.195185 Oct 11 00:29:38.333781 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4096/7535] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:29:38 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:29:39.358499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-66ad2461-2b30-42e9-95c3-dd0844a8bb57 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:39.359141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-66ad2461-2b30-42e9-95c3-dd0844a8bb57 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:39.366571 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66ad2461-2b30-42e9-95c3-dd0844a8bb57 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:39.367102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66ad2461-2b30-42e9-95c3-dd0844a8bb57 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:39.367863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66ad2461-2b30-42e9-95c3-dd0844a8bb57 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:39.368685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66ad2461-2b30-42e9-95c3-dd0844a8bb57 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:39.369029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66ad2461-2b30-42e9-95c3-dd0844a8bb57 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:39.369481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-66ad2461-2b30-42e9-95c3-dd0844a8bb57 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:39.535834 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-66ad2461-2b30-42e9-95c3-dd0844a8bb57 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:39.545084 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-66ad2461-2b30-42e9-95c3-dd0844a8bb57 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1358 microversion: 2.1 time: 0.190694 Oct 11 00:29:39.545704 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3440/7536] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:29:39 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:29:40.569330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-76d4d4b5-fa39-49cb-af24-59d5486f9ce3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:40.571200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-76d4d4b5-fa39-49cb-af24-59d5486f9ce3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:40.578752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76d4d4b5-fa39-49cb-af24-59d5486f9ce3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:40.579616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76d4d4b5-fa39-49cb-af24-59d5486f9ce3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:40.580314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76d4d4b5-fa39-49cb-af24-59d5486f9ce3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:40.581294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76d4d4b5-fa39-49cb-af24-59d5486f9ce3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:40.581893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76d4d4b5-fa39-49cb-af24-59d5486f9ce3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:40.582453 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-76d4d4b5-fa39-49cb-af24-59d5486f9ce3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:40.725576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-76d4d4b5-fa39-49cb-af24-59d5486f9ce3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:40.733843 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-76d4d4b5-fa39-49cb-af24-59d5486f9ce3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1358 microversion: 2.1 time: 0.168402 Oct 11 00:29:40.734443 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4097/7537] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:29:40 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:29:41.760163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-af17c903-d642-4de0-a642-8092121e47fb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:41.760856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-af17c903-d642-4de0-a642-8092121e47fb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:41.767894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af17c903-d642-4de0-a642-8092121e47fb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:41.768389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af17c903-d642-4de0-a642-8092121e47fb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:41.768862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af17c903-d642-4de0-a642-8092121e47fb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:41.769590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af17c903-d642-4de0-a642-8092121e47fb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:41.770050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af17c903-d642-4de0-a642-8092121e47fb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:41.770482 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-af17c903-d642-4de0-a642-8092121e47fb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:41.900649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-af17c903-d642-4de0-a642-8092121e47fb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:41.908350 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-af17c903-d642-4de0-a642-8092121e47fb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1358 microversion: 2.1 time: 0.152850 Oct 11 00:29:41.908928 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3441/7538] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:29:41 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:29:42.931837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6bfa8c3d-3c25-4497-9685-aad0e48992a5 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:42.932512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6bfa8c3d-3c25-4497-9685-aad0e48992a5 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:42.935535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:29:42.936319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:29:42.942586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bfa8c3d-3c25-4497-9685-aad0e48992a5 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:42.943091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bfa8c3d-3c25-4497-9685-aad0e48992a5 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:42.943544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bfa8c3d-3c25-4497-9685-aad0e48992a5 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:42.944268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bfa8c3d-3c25-4497-9685-aad0e48992a5 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:42.944734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bfa8c3d-3c25-4497-9685-aad0e48992a5 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:42.945180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6bfa8c3d-3c25-4497-9685-aad0e48992a5 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:43.172477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6bfa8c3d-3c25-4497-9685-aad0e48992a5 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:43.186002 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6bfa8c3d-3c25-4497-9685-aad0e48992a5 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1358 microversion: 2.1 time: 0.258505 Oct 11 00:29:43.186601 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4098/7539] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:29:42 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:29:43.672183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-0ac04120-c7c1-4870-8b20-65d2f78f7d54 req-90d607b8-90f2-4dd8-8308-9f534333b156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef545fee-e899-4075-9772-c8554ec53a8f", "tag": "2b71ce71-1798-4541-974e-fcb59b4332cc"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:29:43.679907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:29:43.692302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0ac04120-c7c1-4870-8b20-65d2f78f7d54 req-90d607b8-90f2-4dd8-8308-9f534333b156 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:43.693152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0ac04120-c7c1-4870-8b20-65d2f78f7d54 req-90d607b8-90f2-4dd8-8308-9f534333b156 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:43.693686 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0ac04120-c7c1-4870-8b20-65d2f78f7d54 req-90d607b8-90f2-4dd8-8308-9f534333b156 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:43.708334 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-0ac04120-c7c1-4870-8b20-65d2f78f7d54 req-90d607b8-90f2-4dd8-8308-9f534333b156 service nova] Creating event network-changed:2b71ce71-1798-4541-974e-fcb59b4332cc for instance ef545fee-e899-4075-9772-c8554ec53a8f on n-h1-860864-2 Oct 11 00:29:43.714056 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-0ac04120-c7c1-4870-8b20-65d2f78f7d54 req-90d607b8-90f2-4dd8-8308-9f534333b156 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046598 Oct 11 00:29:43.715158 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3442/7540] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:29:44.210217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-15bfa6ad-ce28-4ea9-8d90-0942bb1eb7ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:44.210764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-15bfa6ad-ce28-4ea9-8d90-0942bb1eb7ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:44.218941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15bfa6ad-ce28-4ea9-8d90-0942bb1eb7ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:44.219438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15bfa6ad-ce28-4ea9-8d90-0942bb1eb7ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:44.219887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15bfa6ad-ce28-4ea9-8d90-0942bb1eb7ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:44.220589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15bfa6ad-ce28-4ea9-8d90-0942bb1eb7ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:44.221055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15bfa6ad-ce28-4ea9-8d90-0942bb1eb7ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:44.221598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-15bfa6ad-ce28-4ea9-8d90-0942bb1eb7ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:44.355871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-15bfa6ad-ce28-4ea9-8d90-0942bb1eb7ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:44.363777 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-15bfa6ad-ce28-4ea9-8d90-0942bb1eb7ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1358 microversion: 2.1 time: 0.157560 Oct 11 00:29:44.364361 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4099/7541] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:29:44 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:29:45.387861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c3cd53a9-bfca-4a72-8924-75960ad6dfb6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:45.388566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c3cd53a9-bfca-4a72-8924-75960ad6dfb6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:45.394737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3cd53a9-bfca-4a72-8924-75960ad6dfb6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:45.395211 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3cd53a9-bfca-4a72-8924-75960ad6dfb6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:45.395642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3cd53a9-bfca-4a72-8924-75960ad6dfb6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:45.396320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3cd53a9-bfca-4a72-8924-75960ad6dfb6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:45.396768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3cd53a9-bfca-4a72-8924-75960ad6dfb6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:45.397185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c3cd53a9-bfca-4a72-8924-75960ad6dfb6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:45.527139 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c3cd53a9-bfca-4a72-8924-75960ad6dfb6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:45.534872 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c3cd53a9-bfca-4a72-8924-75960ad6dfb6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1358 microversion: 2.1 time: 0.152123 Oct 11 00:29:45.535457 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3443/7542] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:29:45 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:29:46.559828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6169af1a-7593-491b-9ddf-8bb389da8244 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:46.560464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6169af1a-7593-491b-9ddf-8bb389da8244 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:46.567709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6169af1a-7593-491b-9ddf-8bb389da8244 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:46.568214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6169af1a-7593-491b-9ddf-8bb389da8244 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:46.568668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6169af1a-7593-491b-9ddf-8bb389da8244 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:46.569418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6169af1a-7593-491b-9ddf-8bb389da8244 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:46.569894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6169af1a-7593-491b-9ddf-8bb389da8244 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:46.570339 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6169af1a-7593-491b-9ddf-8bb389da8244 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:46.880360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6169af1a-7593-491b-9ddf-8bb389da8244 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:46.888994 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6169af1a-7593-491b-9ddf-8bb389da8244 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1358 microversion: 2.1 time: 0.334229 Oct 11 00:29:46.889920 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4100/7543] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:29:46 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1358 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:29:47.912517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7a2fc3d1-47f6-4501-b8ba-b11cb4fcc40c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:47.913199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7a2fc3d1-47f6-4501-b8ba-b11cb4fcc40c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:47.920331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a2fc3d1-47f6-4501-b8ba-b11cb4fcc40c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:47.920813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a2fc3d1-47f6-4501-b8ba-b11cb4fcc40c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:47.921243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a2fc3d1-47f6-4501-b8ba-b11cb4fcc40c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:47.921946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a2fc3d1-47f6-4501-b8ba-b11cb4fcc40c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:47.922398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a2fc3d1-47f6-4501-b8ba-b11cb4fcc40c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:47.922819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a2fc3d1-47f6-4501-b8ba-b11cb4fcc40c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:48.059521 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7a2fc3d1-47f6-4501-b8ba-b11cb4fcc40c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:48.068349 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7a2fc3d1-47f6-4501-b8ba-b11cb4fcc40c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1358 microversion: 2.1 time: 0.159463 Oct 11 00:29:48.069413 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3444/7544] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:29:47 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:29:49.093288 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-40a7f29f-9e6a-41f2-abec-e52234527a91 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:49.093861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-40a7f29f-9e6a-41f2-abec-e52234527a91 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:49.100905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40a7f29f-9e6a-41f2-abec-e52234527a91 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:49.101438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40a7f29f-9e6a-41f2-abec-e52234527a91 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:49.101895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40a7f29f-9e6a-41f2-abec-e52234527a91 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:49.102609 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40a7f29f-9e6a-41f2-abec-e52234527a91 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:49.103172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40a7f29f-9e6a-41f2-abec-e52234527a91 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:49.103815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40a7f29f-9e6a-41f2-abec-e52234527a91 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:49.238049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-40a7f29f-9e6a-41f2-abec-e52234527a91 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:49.246061 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-40a7f29f-9e6a-41f2-abec-e52234527a91 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1358 microversion: 2.1 time: 0.157968 Oct 11 00:29:49.246665 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4101/7545] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:29:49 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:29:50.176746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-59962032-c4dc-4307-95fd-14235c5203a9 req-40b602f2-8ea3-49bc-8b7c-056604a35023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef545fee-e899-4075-9772-c8554ec53a8f", "name": "network-vif-plugged", "status": "completed", "tag": "2b71ce71-1798-4541-974e-fcb59b4332cc"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:29:50.188455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-59962032-c4dc-4307-95fd-14235c5203a9 req-40b602f2-8ea3-49bc-8b7c-056604a35023 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:50.188943 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-59962032-c4dc-4307-95fd-14235c5203a9 req-40b602f2-8ea3-49bc-8b7c-056604a35023 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:50.189394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-59962032-c4dc-4307-95fd-14235c5203a9 req-40b602f2-8ea3-49bc-8b7c-056604a35023 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:50.201225 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-59962032-c4dc-4307-95fd-14235c5203a9 req-40b602f2-8ea3-49bc-8b7c-056604a35023 service nova] Creating event network-vif-plugged:2b71ce71-1798-4541-974e-fcb59b4332cc for instance ef545fee-e899-4075-9772-c8554ec53a8f on n-h1-860864-2 Oct 11 00:29:50.206384 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-59962032-c4dc-4307-95fd-14235c5203a9 req-40b602f2-8ea3-49bc-8b7c-056604a35023 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033371 Oct 11 00:29:50.207015 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3445/7546] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:29:50.270149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d0d2c64b-0cf9-4e5d-a4f6-5e7c28759dc7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:50.270794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d0d2c64b-0cf9-4e5d-a4f6-5e7c28759dc7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:50.278777 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0d2c64b-0cf9-4e5d-a4f6-5e7c28759dc7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:50.279411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0d2c64b-0cf9-4e5d-a4f6-5e7c28759dc7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:50.280115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0d2c64b-0cf9-4e5d-a4f6-5e7c28759dc7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:50.281003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0d2c64b-0cf9-4e5d-a4f6-5e7c28759dc7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:50.281581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0d2c64b-0cf9-4e5d-a4f6-5e7c28759dc7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:50.282237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d0d2c64b-0cf9-4e5d-a4f6-5e7c28759dc7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:50.445668 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d0d2c64b-0cf9-4e5d-a4f6-5e7c28759dc7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:50.453989 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d0d2c64b-0cf9-4e5d-a4f6-5e7c28759dc7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1358 microversion: 2.1 time: 0.187949 Oct 11 00:29:50.454570 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4102/7547] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:29:50 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:29:51.480635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-54e12b8d-c08d-4d94-8619-4f955362baff tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:51.481331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-54e12b8d-c08d-4d94-8619-4f955362baff tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:51.487471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54e12b8d-c08d-4d94-8619-4f955362baff tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:51.487952 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54e12b8d-c08d-4d94-8619-4f955362baff tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:51.488383 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54e12b8d-c08d-4d94-8619-4f955362baff tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:51.489067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54e12b8d-c08d-4d94-8619-4f955362baff tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:51.489555 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54e12b8d-c08d-4d94-8619-4f955362baff tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:51.489982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54e12b8d-c08d-4d94-8619-4f955362baff tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:51.623802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-54e12b8d-c08d-4d94-8619-4f955362baff tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:51.631828 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-54e12b8d-c08d-4d94-8619-4f955362baff tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1358 microversion: 2.1 time: 0.156794 Oct 11 00:29:51.632607 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3446/7548] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:29:51 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:29:52.656620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-22e3f418-ee8a-4414-bf36-210ebf7987c6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:52.657239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-22e3f418-ee8a-4414-bf36-210ebf7987c6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:52.663913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22e3f418-ee8a-4414-bf36-210ebf7987c6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:52.664411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22e3f418-ee8a-4414-bf36-210ebf7987c6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:52.664859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22e3f418-ee8a-4414-bf36-210ebf7987c6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:52.666459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22e3f418-ee8a-4414-bf36-210ebf7987c6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:52.667368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22e3f418-ee8a-4414-bf36-210ebf7987c6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:52.667818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-22e3f418-ee8a-4414-bf36-210ebf7987c6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:52.810667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-22e3f418-ee8a-4414-bf36-210ebf7987c6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:52.819182 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-22e3f418-ee8a-4414-bf36-210ebf7987c6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1548 microversion: 2.1 time: 0.166620 Oct 11 00:29:52.819816 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4103/7549] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:29:52 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:29:52.843206 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8acc8382-d5f4-43cd-955f-a0dba962ed71 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:52.843797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8acc8382-d5f4-43cd-955f-a0dba962ed71 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:52.850858 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8acc8382-d5f4-43cd-955f-a0dba962ed71 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:52.851345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8acc8382-d5f4-43cd-955f-a0dba962ed71 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:52.851777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8acc8382-d5f4-43cd-955f-a0dba962ed71 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:52.852486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8acc8382-d5f4-43cd-955f-a0dba962ed71 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:52.852942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8acc8382-d5f4-43cd-955f-a0dba962ed71 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:52.853881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8acc8382-d5f4-43cd-955f-a0dba962ed71 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:52.987330 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8acc8382-d5f4-43cd-955f-a0dba962ed71 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:52.995393 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8acc8382-d5f4-43cd-955f-a0dba962ed71 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1548 microversion: 2.1 time: 0.156141 Oct 11 00:29:52.995970 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3447/7550] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:29:52 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:29:53.018254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9665f45c-01c5-4db9-9c28-b29f508bd64e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:53.023030 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9665f45c-01c5-4db9-9c28-b29f508bd64e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:53.023815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9665f45c-01c5-4db9-9c28-b29f508bd64e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Searching by: {'deleted': False, 'project_id': '9690f354b0074e9e9b442e6154bcd41d'} {{(pid=120613) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 00:29:53.030123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9665f45c-01c5-4db9-9c28-b29f508bd64e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:53.030618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9665f45c-01c5-4db9-9c28-b29f508bd64e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:53.031070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9665f45c-01c5-4db9-9c28-b29f508bd64e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:53.031809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9665f45c-01c5-4db9-9c28-b29f508bd64e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:53.032317 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9665f45c-01c5-4db9-9c28-b29f508bd64e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:53.032760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9665f45c-01c5-4db9-9c28-b29f508bd64e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:53.056751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.multi_cell_list [None req-9665f45c-01c5-4db9-9c28-b29f508bd64e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120613) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 00:29:53.085249 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9665f45c-01c5-4db9-9c28-b29f508bd64e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.070732 Oct 11 00:29:53.085952 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4104/7551] 10.222.0.23 () {58 vars in 1125 bytes} [Tue Oct 11 00:29:53 2022] GET /compute/v2.1/servers => generated 342 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:29:53.098401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ba0e0ca8-26e4-4094-af5b-6be8ddc2020d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:29:53.099198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ba0e0ca8-26e4-4094-af5b-6be8ddc2020d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:53.105905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba0e0ca8-26e4-4094-af5b-6be8ddc2020d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:53.106386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba0e0ca8-26e4-4094-af5b-6be8ddc2020d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:53.106818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba0e0ca8-26e4-4094-af5b-6be8ddc2020d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:53.107500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba0e0ca8-26e4-4094-af5b-6be8ddc2020d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:53.107950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba0e0ca8-26e4-4094-af5b-6be8ddc2020d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:53.108372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba0e0ca8-26e4-4094-af5b-6be8ddc2020d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:53.248649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ba0e0ca8-26e4-4094-af5b-6be8ddc2020d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:29:53.256688 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ba0e0ca8-26e4-4094-af5b-6be8ddc2020d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1548 microversion: 2.1 time: 0.162236 Oct 11 00:29:53.257270 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3448/7552] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:29:53 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:29:54.821825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2b1414f3-2c4e-472c-b78a-8a8580c50403 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb7f437d-17ad-4db4-affe-53bda8232153"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:29:54.824290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2b1414f3-2c4e-472c-b78a-8a8580c50403 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:29:54.831338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b1414f3-2c4e-472c-b78a-8a8580c50403 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:54.831875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b1414f3-2c4e-472c-b78a-8a8580c50403 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:54.832335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b1414f3-2c4e-472c-b78a-8a8580c50403 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:54.833087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b1414f3-2c4e-472c-b78a-8a8580c50403 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:29:54.833596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b1414f3-2c4e-472c-b78a-8a8580c50403 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:29:54.834046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2b1414f3-2c4e-472c-b78a-8a8580c50403 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:29:55.083440 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2b1414f3-2c4e-472c-b78a-8a8580c50403 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "POST /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265336 Oct 11 00:29:55.084076 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4105/7553] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 11 00:29:54 2022] POST /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:30:08.190267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8a4703b1-4457-4dde-a75e-f275c063609b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:30:08.190910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8a4703b1-4457-4dde-a75e-f275c063609b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:30:08.193723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:30:08.194382 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=58 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:30:08.201435 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a4703b1-4457-4dde-a75e-f275c063609b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:30:08.201925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a4703b1-4457-4dde-a75e-f275c063609b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:30:08.202362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a4703b1-4457-4dde-a75e-f275c063609b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:30:08.203055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a4703b1-4457-4dde-a75e-f275c063609b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:30:08.203503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a4703b1-4457-4dde-a75e-f275c063609b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:30:08.203925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8a4703b1-4457-4dde-a75e-f275c063609b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:30:08.335710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8a4703b1-4457-4dde-a75e-f275c063609b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:30:08.344544 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8a4703b1-4457-4dde-a75e-f275c063609b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1594 microversion: 2.1 time: 0.158192 Oct 11 00:30:08.345127 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3449/7554] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:30:08 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1594 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:30:10.155357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:30:10.156246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:30:10.157004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:30:10.335466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-5a44b4cd-8628-480f-af81-893efccf2416 req-9d633fdf-b442-4be2-999b-1d82eb9ad26b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef545fee-e899-4075-9772-c8554ec53a8f", "tag": "2b71ce71-1798-4541-974e-fcb59b4332cc"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:30:10.347077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5a44b4cd-8628-480f-af81-893efccf2416 req-9d633fdf-b442-4be2-999b-1d82eb9ad26b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:30:10.347492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5a44b4cd-8628-480f-af81-893efccf2416 req-9d633fdf-b442-4be2-999b-1d82eb9ad26b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:30:10.348146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5a44b4cd-8628-480f-af81-893efccf2416 req-9d633fdf-b442-4be2-999b-1d82eb9ad26b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:30:10.361770 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-5a44b4cd-8628-480f-af81-893efccf2416 req-9d633fdf-b442-4be2-999b-1d82eb9ad26b service nova] Creating event network-changed:2b71ce71-1798-4541-974e-fcb59b4332cc for instance ef545fee-e899-4075-9772-c8554ec53a8f on n-h1-860864-2 Oct 11 00:30:10.371389 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-5a44b4cd-8628-480f-af81-893efccf2416 req-9d633fdf-b442-4be2-999b-1d82eb9ad26b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222386 Oct 11 00:30:10.372448 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4106/7555] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:30:11.227116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d8fbc729-a909-423e-ba15-6938220afae1 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1705366226"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:30:11.227543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d8fbc729-a909-423e-ba15-6938220afae1 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:30:11.236109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8fbc729-a909-423e-ba15-6938220afae1 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:30:11.236787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8fbc729-a909-423e-ba15-6938220afae1 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:30:11.237228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8fbc729-a909-423e-ba15-6938220afae1 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:30:11.238183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8fbc729-a909-423e-ba15-6938220afae1 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:30:11.238789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8fbc729-a909-423e-ba15-6938220afae1 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:30:11.239222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d8fbc729-a909-423e-ba15-6938220afae1 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:30:11.376468 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.network.security_group_api [None req-d8fbc729-a909-423e-ba15-6938220afae1 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Adding security group 507b0051-1960-4748-8ae0-3778ee6d4253 to port 2b71ce71-1798-4541-974e-fcb59b4332cc Oct 11 00:30:11.710214 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d8fbc729-a909-423e-ba15-6938220afae1 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "POST /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/action" status: 202 len: 0 microversion: 2.1 time: 0.487547 Oct 11 00:30:11.711039 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3450/7556] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:30:11 2022] POST /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:30:11.721842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-990af34a-ae89-414e-bf1f-8bcf11ae40b7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:30:11.723366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-990af34a-ae89-414e-bf1f-8bcf11ae40b7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:30:11.731258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-990af34a-ae89-414e-bf1f-8bcf11ae40b7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:30:11.732630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-990af34a-ae89-414e-bf1f-8bcf11ae40b7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:30:11.733171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-990af34a-ae89-414e-bf1f-8bcf11ae40b7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:30:11.734101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-990af34a-ae89-414e-bf1f-8bcf11ae40b7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:30:11.736086 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-990af34a-ae89-414e-bf1f-8bcf11ae40b7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:30:11.737180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-990af34a-ae89-414e-bf1f-8bcf11ae40b7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:30:11.748474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-2c351411-95d2-40e4-91be-e59474bad2f7 req-c3799d82-ca31-4ffe-8a90-57d81d66d552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef545fee-e899-4075-9772-c8554ec53a8f", "tag": "2b71ce71-1798-4541-974e-fcb59b4332cc"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:30:11.758831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2c351411-95d2-40e4-91be-e59474bad2f7 req-c3799d82-ca31-4ffe-8a90-57d81d66d552 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:30:11.759306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2c351411-95d2-40e4-91be-e59474bad2f7 req-c3799d82-ca31-4ffe-8a90-57d81d66d552 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:30:11.759949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2c351411-95d2-40e4-91be-e59474bad2f7 req-c3799d82-ca31-4ffe-8a90-57d81d66d552 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:30:11.773130 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-2c351411-95d2-40e4-91be-e59474bad2f7 req-c3799d82-ca31-4ffe-8a90-57d81d66d552 service nova] Creating event network-changed:2b71ce71-1798-4541-974e-fcb59b4332cc for instance ef545fee-e899-4075-9772-c8554ec53a8f on n-h1-860864-2 Oct 11 00:30:11.780052 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-2c351411-95d2-40e4-91be-e59474bad2f7 req-c3799d82-ca31-4ffe-8a90-57d81d66d552 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035738 Oct 11 00:30:11.780745 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3451/7557] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:30:12.104338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-990af34a-ae89-414e-bf1f-8bcf11ae40b7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:30:12.114273 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-990af34a-ae89-414e-bf1f-8bcf11ae40b7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1760 microversion: 2.1 time: 0.397408 Oct 11 00:30:12.114893 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4107/7558] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:30:11 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1760 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:32:24.216175 n-d-860864-2 devstack@n-api.service[120614]: ERROR oslo.messaging._drivers.impl_rabbit [-] [31233ac2-692f-4d5e-84d4-7551eaa91acd] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 00:32:24.217113 n-d-860864-2 devstack@n-api.service[120614]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0f2d80e9-f410-4772-8046-431e3c70ceb3] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 11 00:32:24.217719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:32:24.218453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=12 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:32:24.219225 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:32:24.219360 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:32:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/action (ip 10.222.0.23) !!! Oct 11 00:32:24.220659 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:32:24.220777 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:32:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/action (ip 10.222.0.23) !!! Oct 11 00:32:24.226849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dc4a5188-cc81-49be-949b-cc33c9a4e71f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:32:24.231754 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dc4a5188-cc81-49be-949b-cc33c9a4e71f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:32:24.241553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc4a5188-cc81-49be-949b-cc33c9a4e71f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:32:24.242019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc4a5188-cc81-49be-949b-cc33c9a4e71f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:32:24.242455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc4a5188-cc81-49be-949b-cc33c9a4e71f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:32:24.243642 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc4a5188-cc81-49be-949b-cc33c9a4e71f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:32:24.244203 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc4a5188-cc81-49be-949b-cc33c9a4e71f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:32:24.244504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc4a5188-cc81-49be-949b-cc33c9a4e71f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:32:24.316863 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dc4a5188-cc81-49be-949b-cc33c9a4e71f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "POST /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/action" status: 202 len: 0 microversion: 2.1 time: 0.102213 Oct 11 00:32:24.317606 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3452/7559] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:32:24 2022] POST /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:32:24.324928 n-d-860864-2 devstack@n-api.service[120613]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dded55a6-8973-44c5-bba8-4440254057cd] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 00:32:24.326509 n-d-860864-2 devstack@n-api.service[120613]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9b2b028e-60c1-4dc3-ac1e-06905f87835c] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 00:32:24.327016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:32:24.327930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=8 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:32:24.329189 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:32:24.329403 n-d-860864-2 devstack@n-api.service[120613]: Tue Oct 11 00:32:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f (ip 10.222.0.23) !!! Oct 11 00:32:24.330932 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 00:32:24.331081 n-d-860864-2 devstack@n-api.service[120613]: Tue Oct 11 00:32:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f (ip 10.222.0.23) !!! Oct 11 00:32:24.335742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d32b3f91-ecbf-42ae-be96-522b06254bd4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:32:24.336471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d32b3f91-ecbf-42ae-be96-522b06254bd4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:32:24.347719 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d32b3f91-ecbf-42ae-be96-522b06254bd4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:32:24.348225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d32b3f91-ecbf-42ae-be96-522b06254bd4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:32:24.348686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d32b3f91-ecbf-42ae-be96-522b06254bd4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:32:24.349432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d32b3f91-ecbf-42ae-be96-522b06254bd4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:32:24.349912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d32b3f91-ecbf-42ae-be96-522b06254bd4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:32:24.350366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d32b3f91-ecbf-42ae-be96-522b06254bd4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:32:24.575364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d32b3f91-ecbf-42ae-be96-522b06254bd4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:32:24.583632 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d32b3f91-ecbf-42ae-be96-522b06254bd4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1762 microversion: 2.1 time: 0.261081 Oct 11 00:32:24.584216 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4108/7560] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:32:24 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1762 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:32:25.613262 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a6e1c0bf-6ef4-421b-ab42-ecb1c52fa9a1 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:32:25.614027 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a6e1c0bf-6ef4-421b-ab42-ecb1c52fa9a1 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:32:25.627954 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] [0f2d80e9-f410-4772-8046-431e3c70ceb3] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38816. Oct 11 00:32:25.632429 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] [31233ac2-692f-4d5e-84d4-7551eaa91acd] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38814. Oct 11 00:32:25.634212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6e1c0bf-6ef4-421b-ab42-ecb1c52fa9a1 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:32:25.634747 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6e1c0bf-6ef4-421b-ab42-ecb1c52fa9a1 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:32:25.635190 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6e1c0bf-6ef4-421b-ab42-ecb1c52fa9a1 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:32:25.635885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6e1c0bf-6ef4-421b-ab42-ecb1c52fa9a1 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:32:25.636336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6e1c0bf-6ef4-421b-ab42-ecb1c52fa9a1 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:32:25.636760 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a6e1c0bf-6ef4-421b-ab42-ecb1c52fa9a1 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:32:25.842291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a6e1c0bf-6ef4-421b-ab42-ecb1c52fa9a1 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:32:25.850725 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a6e1c0bf-6ef4-421b-ab42-ecb1c52fa9a1 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1767 microversion: 2.1 time: 0.245097 Oct 11 00:32:25.851290 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3453/7561] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:32:25 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1767 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:32:26.876112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fe547878-4583-4b35-8625-a0640a6f797e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:32:26.876748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fe547878-4583-4b35-8625-a0640a6f797e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:32:26.886697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe547878-4583-4b35-8625-a0640a6f797e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:32:26.887214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe547878-4583-4b35-8625-a0640a6f797e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:32:26.887681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe547878-4583-4b35-8625-a0640a6f797e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:32:26.888414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe547878-4583-4b35-8625-a0640a6f797e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:32:26.888892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe547878-4583-4b35-8625-a0640a6f797e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:32:26.889344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fe547878-4583-4b35-8625-a0640a6f797e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:32:26.915708 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] [9b2b028e-60c1-4dc3-ac1e-06905f87835c] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38824. Oct 11 00:32:26.919234 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] [dded55a6-8973-44c5-bba8-4440254057cd] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38822. Oct 11 00:32:27.038989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fe547878-4583-4b35-8625-a0640a6f797e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:32:27.047235 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fe547878-4583-4b35-8625-a0640a6f797e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1767 microversion: 2.1 time: 0.175390 Oct 11 00:32:27.047820 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4109/7562] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:32:26 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1767 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:32:28.070703 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4db89a35-2311-4d18-a6c1-aeede545101c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:32:28.071242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4db89a35-2311-4d18-a6c1-aeede545101c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:32:28.079316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4db89a35-2311-4d18-a6c1-aeede545101c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:32:28.082043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4db89a35-2311-4d18-a6c1-aeede545101c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:32:28.082043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4db89a35-2311-4d18-a6c1-aeede545101c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:32:28.082043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4db89a35-2311-4d18-a6c1-aeede545101c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:32:28.082043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4db89a35-2311-4d18-a6c1-aeede545101c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:32:28.082043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4db89a35-2311-4d18-a6c1-aeede545101c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:32:28.236206 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4db89a35-2311-4d18-a6c1-aeede545101c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:32:28.245046 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4db89a35-2311-4d18-a6c1-aeede545101c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1767 microversion: 2.1 time: 0.177842 Oct 11 00:32:28.245650 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3454/7563] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:32:28 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1767 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:32:29.268903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7bf00d60-8829-490f-a112-249080c91633 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:32:29.269562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7bf00d60-8829-490f-a112-249080c91633 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:32:29.277957 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bf00d60-8829-490f-a112-249080c91633 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:32:29.278460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bf00d60-8829-490f-a112-249080c91633 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:32:29.278915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bf00d60-8829-490f-a112-249080c91633 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:32:29.279627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bf00d60-8829-490f-a112-249080c91633 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:32:29.280096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bf00d60-8829-490f-a112-249080c91633 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:32:29.280539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bf00d60-8829-490f-a112-249080c91633 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:32:29.427778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7bf00d60-8829-490f-a112-249080c91633 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:32:29.436850 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7bf00d60-8829-490f-a112-249080c91633 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1767 microversion: 2.1 time: 0.171910 Oct 11 00:32:29.437444 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4110/7564] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:32:29 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1767 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:32:30.460360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5f98c058-a90f-4d18-996c-d7763304b819 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:32:30.460916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5f98c058-a90f-4d18-996c-d7763304b819 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:32:30.468318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f98c058-a90f-4d18-996c-d7763304b819 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:32:30.468785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f98c058-a90f-4d18-996c-d7763304b819 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:32:30.469219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f98c058-a90f-4d18-996c-d7763304b819 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:32:30.469934 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f98c058-a90f-4d18-996c-d7763304b819 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:32:30.470385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f98c058-a90f-4d18-996c-d7763304b819 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:32:30.470807 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f98c058-a90f-4d18-996c-d7763304b819 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:32:30.617107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5f98c058-a90f-4d18-996c-d7763304b819 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:32:30.626416 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5f98c058-a90f-4d18-996c-d7763304b819 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1760 microversion: 2.1 time: 0.170017 Oct 11 00:32:30.626998 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3455/7565] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:32:30 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1760 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:34:02.935664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:34:02.936443 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=18 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:34:02.941418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-712f1c75-2804-4969-a299-d2fa9d7d8178 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1705366226"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:34:02.942008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-712f1c75-2804-4969-a299-d2fa9d7d8178 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:02.949718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-712f1c75-2804-4969-a299-d2fa9d7d8178 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:02.950228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-712f1c75-2804-4969-a299-d2fa9d7d8178 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:02.950687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-712f1c75-2804-4969-a299-d2fa9d7d8178 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:02.951407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-712f1c75-2804-4969-a299-d2fa9d7d8178 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:02.951885 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-712f1c75-2804-4969-a299-d2fa9d7d8178 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:02.952333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-712f1c75-2804-4969-a299-d2fa9d7d8178 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:03.084379 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.network.security_group_api [None req-712f1c75-2804-4969-a299-d2fa9d7d8178 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Removing security group 507b0051-1960-4748-8ae0-3778ee6d4253 from port 2b71ce71-1798-4541-974e-fcb59b4332cc Oct 11 00:34:03.391895 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-712f1c75-2804-4969-a299-d2fa9d7d8178 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "POST /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/action" status: 202 len: 0 microversion: 2.1 time: 0.458078 Oct 11 00:34:03.395729 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4111/7566] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:34:02 2022] POST /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:34:03.397933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=8 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:34:03.398704 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:34:03.473625 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-3135b293-51bd-408b-81cd-189bfd779833 req-d1e1c113-a233-4979-a959-27253786ac34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef545fee-e899-4075-9772-c8554ec53a8f", "tag": "2b71ce71-1798-4541-974e-fcb59b4332cc"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:34:03.485113 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3135b293-51bd-408b-81cd-189bfd779833 req-d1e1c113-a233-4979-a959-27253786ac34 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:03.485610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3135b293-51bd-408b-81cd-189bfd779833 req-d1e1c113-a233-4979-a959-27253786ac34 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:03.486047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3135b293-51bd-408b-81cd-189bfd779833 req-d1e1c113-a233-4979-a959-27253786ac34 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:03.498229 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-3135b293-51bd-408b-81cd-189bfd779833 req-d1e1c113-a233-4979-a959-27253786ac34 service nova] Creating event network-changed:2b71ce71-1798-4541-974e-fcb59b4332cc for instance ef545fee-e899-4075-9772-c8554ec53a8f on n-h1-860864-2 Oct 11 00:34:03.503465 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-3135b293-51bd-408b-81cd-189bfd779833 req-d1e1c113-a233-4979-a959-27253786ac34 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107763 Oct 11 00:34:03.504388 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3456/7567] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:34:04.944944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-15b881d0-9e44-4213-9dec-5197216dd237 req-41a50af7-f526-4a05-abd9-9703310df098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef545fee-e899-4075-9772-c8554ec53a8f", "tag": "2b71ce71-1798-4541-974e-fcb59b4332cc"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:34:04.958441 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:34:04.958664 n-d-860864-2 devstack@n-api.service[120613]: Tue Oct 11 00:34:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 11 00:34:04.974703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-15b881d0-9e44-4213-9dec-5197216dd237 req-41a50af7-f526-4a05-abd9-9703310df098 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:04.975561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-15b881d0-9e44-4213-9dec-5197216dd237 req-41a50af7-f526-4a05-abd9-9703310df098 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:04.976234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-15b881d0-9e44-4213-9dec-5197216dd237 req-41a50af7-f526-4a05-abd9-9703310df098 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:04.988031 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-15b881d0-9e44-4213-9dec-5197216dd237 req-41a50af7-f526-4a05-abd9-9703310df098 service nova] Creating event network-changed:2b71ce71-1798-4541-974e-fcb59b4332cc for instance ef545fee-e899-4075-9772-c8554ec53a8f on n-h1-860864-2 Oct 11 00:34:04.988372 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ccf5b4e8-2141-4223-803f-6141647bec43 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:04.989527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ccf5b4e8-2141-4223-803f-6141647bec43 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:04.995705 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-15b881d0-9e44-4213-9dec-5197216dd237 req-41a50af7-f526-4a05-abd9-9703310df098 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055044 Oct 11 00:34:04.996782 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4112/7568] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:34:04.998295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccf5b4e8-2141-4223-803f-6141647bec43 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:04.999049 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccf5b4e8-2141-4223-803f-6141647bec43 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:05.000038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccf5b4e8-2141-4223-803f-6141647bec43 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:05.001226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccf5b4e8-2141-4223-803f-6141647bec43 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:05.001716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccf5b4e8-2141-4223-803f-6141647bec43 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:05.002166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccf5b4e8-2141-4223-803f-6141647bec43 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:05.096601 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-ccf5b4e8-2141-4223-803f-6141647bec43 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lazy-loading 'services' on Instance uuid ef545fee-e899-4075-9772-c8554ec53a8f {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:34:05.181892 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ccf5b4e8-2141-4223-803f-6141647bec43 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/os-volume_attachments/fb7f437d-17ad-4db4-affe-53bda8232153" status: 202 len: 0 microversion: 2.1 time: 0.197848 Oct 11 00:34:05.185661 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3457/7569] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 11 00:34:04 2022] DELETE /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/os-volume_attachments/fb7f437d-17ad-4db4-affe-53bda8232153 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:34:05.196347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-abbdfa21-1d3f-46f4-ba76-5cc02e271b18 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:05.199941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-abbdfa21-1d3f-46f4-ba76-5cc02e271b18 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:05.208678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abbdfa21-1d3f-46f4-ba76-5cc02e271b18 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:05.209685 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abbdfa21-1d3f-46f4-ba76-5cc02e271b18 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:05.210348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abbdfa21-1d3f-46f4-ba76-5cc02e271b18 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:05.211174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abbdfa21-1d3f-46f4-ba76-5cc02e271b18 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:05.211726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abbdfa21-1d3f-46f4-ba76-5cc02e271b18 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:05.212281 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-abbdfa21-1d3f-46f4-ba76-5cc02e271b18 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:05.259270 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-abbdfa21-1d3f-46f4-ba76-5cc02e271b18 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070808 Oct 11 00:34:05.262035 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4113/7570] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:34:05 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:34:06.273811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a4b7b254-f73e-4c8a-bdaa-4c209be629ef tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:06.276064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a4b7b254-f73e-4c8a-bdaa-4c209be629ef tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:06.282402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4b7b254-f73e-4c8a-bdaa-4c209be629ef tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:06.282887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4b7b254-f73e-4c8a-bdaa-4c209be629ef tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:06.283331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4b7b254-f73e-4c8a-bdaa-4c209be629ef tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:06.284024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4b7b254-f73e-4c8a-bdaa-4c209be629ef tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:06.284480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4b7b254-f73e-4c8a-bdaa-4c209be629ef tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:06.284907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a4b7b254-f73e-4c8a-bdaa-4c209be629ef tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:06.315902 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a4b7b254-f73e-4c8a-bdaa-4c209be629ef tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047409 Oct 11 00:34:06.316469 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3458/7571] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:34:06 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:34:07.328701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6394941d-50fb-4997-b775-7f7026fe1bc9 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:07.331062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6394941d-50fb-4997-b775-7f7026fe1bc9 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:07.338881 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6394941d-50fb-4997-b775-7f7026fe1bc9 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:07.339397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6394941d-50fb-4997-b775-7f7026fe1bc9 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:07.339854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6394941d-50fb-4997-b775-7f7026fe1bc9 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:07.340578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6394941d-50fb-4997-b775-7f7026fe1bc9 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:07.341049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6394941d-50fb-4997-b775-7f7026fe1bc9 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:07.341529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6394941d-50fb-4997-b775-7f7026fe1bc9 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:07.372684 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6394941d-50fb-4997-b775-7f7026fe1bc9 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048004 Oct 11 00:34:07.373266 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4114/7572] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:34:07 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:34:08.386384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3708888c-3ecf-4f46-832d-af5e96d4ef4c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:08.388602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3708888c-3ecf-4f46-832d-af5e96d4ef4c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:08.395517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3708888c-3ecf-4f46-832d-af5e96d4ef4c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:08.396001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3708888c-3ecf-4f46-832d-af5e96d4ef4c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:08.396720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3708888c-3ecf-4f46-832d-af5e96d4ef4c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:08.397558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3708888c-3ecf-4f46-832d-af5e96d4ef4c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:08.398018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3708888c-3ecf-4f46-832d-af5e96d4ef4c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:08.398445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3708888c-3ecf-4f46-832d-af5e96d4ef4c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:08.428681 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3708888c-3ecf-4f46-832d-af5e96d4ef4c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046272 Oct 11 00:34:08.429258 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3459/7573] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:34:08 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:34:09.441143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2cc76994-08bc-47ae-b79c-fa2d5d1634e7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:09.443934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2cc76994-08bc-47ae-b79c-fa2d5d1634e7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:09.450943 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cc76994-08bc-47ae-b79c-fa2d5d1634e7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:09.451449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cc76994-08bc-47ae-b79c-fa2d5d1634e7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:09.451906 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cc76994-08bc-47ae-b79c-fa2d5d1634e7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:09.452634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cc76994-08bc-47ae-b79c-fa2d5d1634e7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:09.453108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cc76994-08bc-47ae-b79c-fa2d5d1634e7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:09.453584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cc76994-08bc-47ae-b79c-fa2d5d1634e7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:09.484982 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2cc76994-08bc-47ae-b79c-fa2d5d1634e7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048060 Oct 11 00:34:09.485798 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4115/7574] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:34:09 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:34:10.497976 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0bd09419-bb3e-4705-b980-b422c21f1e6c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:10.500108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0bd09419-bb3e-4705-b980-b422c21f1e6c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:10.507671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0bd09419-bb3e-4705-b980-b422c21f1e6c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:10.508159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0bd09419-bb3e-4705-b980-b422c21f1e6c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:10.508685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0bd09419-bb3e-4705-b980-b422c21f1e6c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:10.509417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0bd09419-bb3e-4705-b980-b422c21f1e6c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:10.509879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0bd09419-bb3e-4705-b980-b422c21f1e6c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:10.510314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0bd09419-bb3e-4705-b980-b422c21f1e6c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:10.545071 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0bd09419-bb3e-4705-b980-b422c21f1e6c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051223 Oct 11 00:34:10.545673 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3460/7575] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:34:10 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 00:34:10.557539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3aa507b0-a1a6-471b-bb85-ea84d48e205f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:10.558045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3aa507b0-a1a6-471b-bb85-ea84d48e205f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:10.565092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aa507b0-a1a6-471b-bb85-ea84d48e205f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:10.565629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aa507b0-a1a6-471b-bb85-ea84d48e205f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:10.566084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aa507b0-a1a6-471b-bb85-ea84d48e205f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:10.566784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aa507b0-a1a6-471b-bb85-ea84d48e205f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:10.567257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aa507b0-a1a6-471b-bb85-ea84d48e205f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:10.567693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3aa507b0-a1a6-471b-bb85-ea84d48e205f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:10.660697 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-3aa507b0-a1a6-471b-bb85-ea84d48e205f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] HTTP exception thrown: Instance ef545fee-e899-4075-9772-c8554ec53a8f is not attached to volume fb7f437d-17ad-4db4-affe-53bda8232153 Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3aa507b0-a1a6-471b-bb85-ea84d48e205f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Request method failure captured: Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: request: DELETE /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/os-volume_attachments/fb7f437d-17ad-4db4-affe-53bda8232153 HTTP/1.1 Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLjcu4rF5rbuEN0k2W4hdj_pZd-XRykqlk1Ho5AhVl255rnP-Qt0shYcTuuHXMz0puWUxTJj6f6pzxGcUNsb9hyInEi09OpeyVs_fGCO4cIKlLm_V_1q-81MnzZh3OcJMdtXr9EO3p0Jg3fosL_8KO8jg6OUoXIsQaMoz-mf4W2AYv4 Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 9690f354b0074e9e9b442e6154bcd41d Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestMinimumBasicScenario-2035497586 Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9690f354b0074e9e9b442e6154bcd41d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9690f354b0074e9e9b442e6154bcd41d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9690f354b0074e9e9b442e6154bcd41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9690f354b0074e9e9b442e6154bcd41d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestMinimumBasicScenario-2035497586 Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 9690f354b0074e9e9b442e6154bcd41d Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2035497586 Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestMinimumBasicScenario-2035497586-project Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 4eef568ea2ab44119b61203db2dc25a9 Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestMinimumBasicScenario-2035497586-project Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance ef545fee-e899-4075-9772-c8554ec53a8f is not attached to volume fb7f437d-17ad-4db4-affe-53bda8232153 Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'server_id': 'ef545fee-e899-4075-9772-c8554ec53a8f', 'id': 'fb7f437d-17ad-4db4-affe-53bda8232153'} Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fb7f437d-17ad-4db4-affe-53bda8232153. Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef545fee-e899-4075-9772-c8554ec53a8f is not attached to volume fb7f437d-17ad-4db4-affe-53bda8232153 Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:34:10.664153 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:34:10.668312 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:34:10.668312 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:34:10.668312 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef545fee-e899-4075-9772-c8554ec53a8f is not attached to volume fb7f437d-17ad-4db4-affe-53bda8232153 Oct 11 00:34:10.668312 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:34:10.668312 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3aa507b0-a1a6-471b-bb85-ea84d48e205f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Returning 404 to user: Instance ef545fee-e899-4075-9772-c8554ec53a8f is not attached to volume fb7f437d-17ad-4db4-affe-53bda8232153 {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:34:10.668312 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3aa507b0-a1a6-471b-bb85-ea84d48e205f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/os-volume_attachments/fb7f437d-17ad-4db4-affe-53bda8232153" status: 404 len: 154 microversion: 2.1 time: 0.113284 Oct 11 00:34:10.668312 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4116/7576] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 11 00:34:10 2022] DELETE /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f/os-volume_attachments/fb7f437d-17ad-4db4-affe-53bda8232153 => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:34:13.935855 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3dfc01ac-5575-48e0-a615-b66337b3aa6f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:13.936354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3dfc01ac-5575-48e0-a615-b66337b3aa6f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:13.943450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3dfc01ac-5575-48e0-a615-b66337b3aa6f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:13.944486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3dfc01ac-5575-48e0-a615-b66337b3aa6f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:13.945538 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3dfc01ac-5575-48e0-a615-b66337b3aa6f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:13.946229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3dfc01ac-5575-48e0-a615-b66337b3aa6f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:13.946699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3dfc01ac-5575-48e0-a615-b66337b3aa6f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:13.947108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3dfc01ac-5575-48e0-a615-b66337b3aa6f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:13.972653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3dfc01ac-5575-48e0-a615-b66337b3aa6f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:34:14.068774 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3dfc01ac-5575-48e0-a615-b66337b3aa6f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 204 len: 0 microversion: 2.1 time: 0.136280 Oct 11 00:34:14.069661 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3461/7577] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:34:13 2022] DELETE /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:34:14.081767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-47fda577-6f71-482b-a5ed-7a6537937b25 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:14.082432 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-47fda577-6f71-482b-a5ed-7a6537937b25 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:14.091525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47fda577-6f71-482b-a5ed-7a6537937b25 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:14.092035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47fda577-6f71-482b-a5ed-7a6537937b25 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:14.092484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47fda577-6f71-482b-a5ed-7a6537937b25 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:14.093203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47fda577-6f71-482b-a5ed-7a6537937b25 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:14.093705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47fda577-6f71-482b-a5ed-7a6537937b25 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:14.094148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-47fda577-6f71-482b-a5ed-7a6537937b25 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:14.243168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-47fda577-6f71-482b-a5ed-7a6537937b25 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:14.251697 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-47fda577-6f71-482b-a5ed-7a6537937b25 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1554 microversion: 2.1 time: 0.175545 Oct 11 00:34:14.252308 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4117/7578] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:14 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:34:15.276369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f2214841-48c9-4a00-a8be-15aae11a8189 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:15.277081 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f2214841-48c9-4a00-a8be-15aae11a8189 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:15.284693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2214841-48c9-4a00-a8be-15aae11a8189 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:15.285179 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2214841-48c9-4a00-a8be-15aae11a8189 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:15.285648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2214841-48c9-4a00-a8be-15aae11a8189 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:15.286336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2214841-48c9-4a00-a8be-15aae11a8189 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:15.286787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2214841-48c9-4a00-a8be-15aae11a8189 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:15.287205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2214841-48c9-4a00-a8be-15aae11a8189 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:15.420875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f2214841-48c9-4a00-a8be-15aae11a8189 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:15.428765 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f2214841-48c9-4a00-a8be-15aae11a8189 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1554 microversion: 2.1 time: 0.157242 Oct 11 00:34:15.429350 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3462/7579] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:15 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:34:16.283126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-5562a5ea-9619-4de7-b93c-0e9bdd55f602 req-842e3e9f-008c-4743-a1ad-cadae80a4804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef545fee-e899-4075-9772-c8554ec53a8f", "name": "network-vif-deleted", "tag": "2b71ce71-1798-4541-974e-fcb59b4332cc"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:34:16.295515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5562a5ea-9619-4de7-b93c-0e9bdd55f602 req-842e3e9f-008c-4743-a1ad-cadae80a4804 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:16.296019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5562a5ea-9619-4de7-b93c-0e9bdd55f602 req-842e3e9f-008c-4743-a1ad-cadae80a4804 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:16.296467 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5562a5ea-9619-4de7-b93c-0e9bdd55f602 req-842e3e9f-008c-4743-a1ad-cadae80a4804 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:16.310437 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-5562a5ea-9619-4de7-b93c-0e9bdd55f602 req-842e3e9f-008c-4743-a1ad-cadae80a4804 service nova] Creating event network-vif-deleted:2b71ce71-1798-4541-974e-fcb59b4332cc for instance ef545fee-e899-4075-9772-c8554ec53a8f on n-h1-860864-2 Oct 11 00:34:16.316932 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-5562a5ea-9619-4de7-b93c-0e9bdd55f602 req-842e3e9f-008c-4743-a1ad-cadae80a4804 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037581 Oct 11 00:34:16.317596 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4118/7580] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:34:16.452545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-43f4f4cb-af01-41ba-a268-cd13900b68ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:16.453291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-43f4f4cb-af01-41ba-a268-cd13900b68ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:16.460360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43f4f4cb-af01-41ba-a268-cd13900b68ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:16.461832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43f4f4cb-af01-41ba-a268-cd13900b68ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:16.462334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43f4f4cb-af01-41ba-a268-cd13900b68ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:16.463332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43f4f4cb-af01-41ba-a268-cd13900b68ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:16.463773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43f4f4cb-af01-41ba-a268-cd13900b68ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:16.464193 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43f4f4cb-af01-41ba-a268-cd13900b68ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:16.496150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43f4f4cb-af01-41ba-a268-cd13900b68ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:16.496539 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43f4f4cb-af01-41ba-a268-cd13900b68ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:16.497216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-43f4f4cb-af01-41ba-a268-cd13900b68ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:16.497693 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-43f4f4cb-af01-41ba-a268-cd13900b68ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lazy-loading 'fault' on Instance uuid ef545fee-e899-4075-9772-c8554ec53a8f {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:34:16.542990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-43f4f4cb-af01-41ba-a268-cd13900b68ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:16.551399 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-43f4f4cb-af01-41ba-a268-cd13900b68ab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 200 len: 1348 microversion: 2.1 time: 0.102713 Oct 11 00:34:16.551999 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3463/7581] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:16 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 1348 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:34:17.579348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-069e1fe9-7a5d-4c9f-898a-9f650b516e11 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:17.580065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-069e1fe9-7a5d-4c9f-898a-9f650b516e11 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: ef545fee-e899-4075-9772-c8554ec53a8f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:17.586349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-069e1fe9-7a5d-4c9f-898a-9f650b516e11 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:17.586853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-069e1fe9-7a5d-4c9f-898a-9f650b516e11 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:17.587308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-069e1fe9-7a5d-4c9f-898a-9f650b516e11 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:17.588022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-069e1fe9-7a5d-4c9f-898a-9f650b516e11 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:17.588491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-069e1fe9-7a5d-4c9f-898a-9f650b516e11 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:17.588937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-069e1fe9-7a5d-4c9f-898a-9f650b516e11 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:17.602836 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-069e1fe9-7a5d-4c9f-898a-9f650b516e11 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] HTTP exception thrown: Instance ef545fee-e899-4075-9772-c8554ec53a8f could not be found. Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-069e1fe9-7a5d-4c9f-898a-9f650b516e11 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Request method failure captured: Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f HTTP/1.1 Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLjcu4rF5rbuEN0k2W4hdj_pZd-XRykqlk1Ho5AhVl255rnP-Qt0shYcTuuHXMz0puWUxTJj6f6pzxGcUNsb9hyInEi09OpeyVs_fGCO4cIKlLm_V_1q-81MnzZh3OcJMdtXr9EO3p0Jg3fosL_8KO8jg6OUoXIsQaMoz-mf4W2AYv4 Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 9690f354b0074e9e9b442e6154bcd41d Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestMinimumBasicScenario-2035497586 Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9690f354b0074e9e9b442e6154bcd41d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9690f354b0074e9e9b442e6154bcd41d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9690f354b0074e9e9b442e6154bcd41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9690f354b0074e9e9b442e6154bcd41d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestMinimumBasicScenario-2035497586 Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 9690f354b0074e9e9b442e6154bcd41d Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2035497586 Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestMinimumBasicScenario-2035497586-project Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 4eef568ea2ab44119b61203db2dc25a9 Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestMinimumBasicScenario-2035497586-project Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance ef545fee-e899-4075-9772-c8554ec53a8f could not be found. Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'ef545fee-e899-4075-9772-c8554ec53a8f'} Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef545fee-e899-4075-9772-c8554ec53a8f could not be found. Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef545fee-e899-4075-9772-c8554ec53a8f could not be found. Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:34:17.604484 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:34:17.608992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:34:17.608992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:34:17.608992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:34:17.608992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:34:17.608992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:34:17.608992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef545fee-e899-4075-9772-c8554ec53a8f could not be found. Oct 11 00:34:17.608992 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:34:17.608992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-069e1fe9-7a5d-4c9f-898a-9f650b516e11 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Returning 404 to user: Instance ef545fee-e899-4075-9772-c8554ec53a8f could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:34:17.608992 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-069e1fe9-7a5d-4c9f-898a-9f650b516e11 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f" status: 404 len: 111 microversion: 2.1 time: 0.031781 Oct 11 00:34:17.608992 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4119/7582] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:17 2022] GET /compute/v2.1/servers/ef545fee-e899-4075-9772-c8554ec53a8f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:34:17.614788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eba8e3f5-7577-4f55-a897-2be0f17e82bb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '.version_select at 0x7f6633ab1dc0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:17.640008 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eba8e3f5-7577-4f55-a897-2be0f17e82bb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1505106336" status: 202 len: 0 microversion: 2.1 time: 0.029009 Oct 11 00:34:17.640613 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3464/7583] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 11 00:34:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1505106336 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:34:27.075422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1a8a669b-60b5-4061-891f-d5673ad7b819 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Action: 'create', calling method: .version_select at 0x7f662b3f5b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1026665296", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjRN7GPtiJLR1H4ttEHrfp8siYwJ84aGHubbgoEoLE+CY4m+VyYgZj71Up4SbRjufBw00RsMj/v+zBubOlSIfDAuekoAnloJ4RBincv1foo8HNcueSJim6Djdvp6eNPlA=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:34:27.091421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-1a8a669b-60b5-4061-891f-d5673ad7b819 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Getting quotas for project 9690f354b0074e9e9b442e6154bcd41d. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:34:27.096500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-1a8a669b-60b5-4061-891f-d5673ad7b819 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Getting quotas for user 4eef568ea2ab44119b61203db2dc25a9 and project 9690f354b0074e9e9b442e6154bcd41d. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:34:27.123527 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1a8a669b-60b5-4061-891f-d5673ad7b819 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.100357 Oct 11 00:34:27.124146 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4120/7584] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 11 00:34:27 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:34:27.173146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:34:27.177265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-50526c4f-14ef-431e-8bb2-8adaad26a590 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1295223887", "imageRef": "f8f836b3-fa0f-4c25-bf4a-379be70f8c4c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1026665296", "networks": [{"uuid": "1bad6c58-f3ee-4dcd-b87e-c21d35f7b604"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:34:27.230183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-50526c4f-14ef-431e-8bb2-8adaad26a590 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] validate_networks() for [('1bad6c58-f3ee-4dcd-b87e-c21d35f7b604', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:34:27.660811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-50526c4f-14ef-431e-8bb2-8adaad26a590 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:34:27.661236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-50526c4f-14ef-431e-8bb2-8adaad26a590 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:34:27.661758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-50526c4f-14ef-431e-8bb2-8adaad26a590 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:34:27.662154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-50526c4f-14ef-431e-8bb2-8adaad26a590 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:34:27.662684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-50526c4f-14ef-431e-8bb2-8adaad26a590 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:34:27.672853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50526c4f-14ef-431e-8bb2-8adaad26a590 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:27.673332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50526c4f-14ef-431e-8bb2-8adaad26a590 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:27.674082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50526c4f-14ef-431e-8bb2-8adaad26a590 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:27.674808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50526c4f-14ef-431e-8bb2-8adaad26a590 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:27.675259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50526c4f-14ef-431e-8bb2-8adaad26a590 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:27.675679 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-50526c4f-14ef-431e-8bb2-8adaad26a590 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:27.697483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-50526c4f-14ef-431e-8bb2-8adaad26a590 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Getting quotas for project 9690f354b0074e9e9b442e6154bcd41d. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:34:27.702755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-50526c4f-14ef-431e-8bb2-8adaad26a590 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Getting quotas for user 4eef568ea2ab44119b61203db2dc25a9 and project 9690f354b0074e9e9b442e6154bcd41d. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:34:27.715385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-50526c4f-14ef-431e-8bb2-8adaad26a590 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:34:27.717638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-50526c4f-14ef-431e-8bb2-8adaad26a590 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f8f836b3-fa0f-4c25-bf4a-379be70f8c4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:34:27.763990 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-50526c4f-14ef-431e-8bb2-8adaad26a590 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.592701 Oct 11 00:34:27.764672 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3465/7585] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:34:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:34:27.772759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=40 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:34:27.777126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-28fec5dc-5361-4fcf-a4e8-7d2205eeff11 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:27.777784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-28fec5dc-5361-4fcf-a4e8-7d2205eeff11 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:27.837642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-28fec5dc-5361-4fcf-a4e8-7d2205eeff11 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:27.844931 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-28fec5dc-5361-4fcf-a4e8-7d2205eeff11 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1259 microversion: 2.1 time: 0.072996 Oct 11 00:34:27.845550 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4121/7586] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:27 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1259 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:34:28.872554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-07c2f2e9-cb19-409f-8f35-e20bf74a63de tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:28.874001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-07c2f2e9-cb19-409f-8f35-e20bf74a63de tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:28.880573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07c2f2e9-cb19-409f-8f35-e20bf74a63de tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:28.881083 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07c2f2e9-cb19-409f-8f35-e20bf74a63de tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:28.881885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07c2f2e9-cb19-409f-8f35-e20bf74a63de tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:28.882796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07c2f2e9-cb19-409f-8f35-e20bf74a63de tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:28.883265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07c2f2e9-cb19-409f-8f35-e20bf74a63de tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:28.883699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07c2f2e9-cb19-409f-8f35-e20bf74a63de tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:28.961095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-07c2f2e9-cb19-409f-8f35-e20bf74a63de tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:28.969504 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-07c2f2e9-cb19-409f-8f35-e20bf74a63de tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1329 microversion: 2.1 time: 0.104925 Oct 11 00:34:28.970097 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3466/7587] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:28 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1329 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:34:29.993360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1b04515b-83b3-49f0-958a-6721544485bb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:29.994031 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1b04515b-83b3-49f0-958a-6721544485bb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:30.000905 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b04515b-83b3-49f0-958a-6721544485bb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:30.001436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b04515b-83b3-49f0-958a-6721544485bb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:30.001902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b04515b-83b3-49f0-958a-6721544485bb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:30.002633 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b04515b-83b3-49f0-958a-6721544485bb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:30.003111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b04515b-83b3-49f0-958a-6721544485bb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:30.003563 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1b04515b-83b3-49f0-958a-6721544485bb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:30.155327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1b04515b-83b3-49f0-958a-6721544485bb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:30.163345 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1b04515b-83b3-49f0-958a-6721544485bb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1359 microversion: 2.1 time: 0.173862 Oct 11 00:34:30.163938 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4122/7588] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:29 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:34:31.188795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e14d0ca9-d085-4340-9566-c6d310c73165 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:31.190169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e14d0ca9-d085-4340-9566-c6d310c73165 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:31.197631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e14d0ca9-d085-4340-9566-c6d310c73165 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:31.198129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e14d0ca9-d085-4340-9566-c6d310c73165 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:31.198576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e14d0ca9-d085-4340-9566-c6d310c73165 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:31.199297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e14d0ca9-d085-4340-9566-c6d310c73165 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:31.199756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e14d0ca9-d085-4340-9566-c6d310c73165 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:31.200189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e14d0ca9-d085-4340-9566-c6d310c73165 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:31.348935 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e14d0ca9-d085-4340-9566-c6d310c73165 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:31.357693 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e14d0ca9-d085-4340-9566-c6d310c73165 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1359 microversion: 2.1 time: 0.173042 Oct 11 00:34:31.373708 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3467/7589] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:31 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:34:32.382265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bea67452-8d9a-4a68-9941-9e4cf1c2549e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:32.383376 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bea67452-8d9a-4a68-9941-9e4cf1c2549e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:32.391646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bea67452-8d9a-4a68-9941-9e4cf1c2549e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:32.392157 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bea67452-8d9a-4a68-9941-9e4cf1c2549e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:32.392610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bea67452-8d9a-4a68-9941-9e4cf1c2549e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:32.393336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bea67452-8d9a-4a68-9941-9e4cf1c2549e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:32.393841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bea67452-8d9a-4a68-9941-9e4cf1c2549e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:32.394293 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bea67452-8d9a-4a68-9941-9e4cf1c2549e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:32.544739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bea67452-8d9a-4a68-9941-9e4cf1c2549e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:32.553669 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bea67452-8d9a-4a68-9941-9e4cf1c2549e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1359 microversion: 2.1 time: 0.175306 Oct 11 00:34:32.556400 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4123/7590] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:32 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:34:33.579063 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-13f4d481-e779-4642-8d99-57b1cbd8aca8 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:33.579454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-13f4d481-e779-4642-8d99-57b1cbd8aca8 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:33.582391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:34:33.590077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13f4d481-e779-4642-8d99-57b1cbd8aca8 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:33.590589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13f4d481-e779-4642-8d99-57b1cbd8aca8 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:33.591038 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13f4d481-e779-4642-8d99-57b1cbd8aca8 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:33.591793 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13f4d481-e779-4642-8d99-57b1cbd8aca8 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:33.592325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13f4d481-e779-4642-8d99-57b1cbd8aca8 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:33.592718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-13f4d481-e779-4642-8d99-57b1cbd8aca8 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:33.771518 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-13f4d481-e779-4642-8d99-57b1cbd8aca8 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:33.806697 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-13f4d481-e779-4642-8d99-57b1cbd8aca8 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1359 microversion: 2.1 time: 0.230229 Oct 11 00:34:33.822461 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3468/7591] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:33 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:34:34.843665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9692a411-e459-4d42-9fef-bb43ee7733b6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:34.844470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9692a411-e459-4d42-9fef-bb43ee7733b6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:34.847260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:34:34.852662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9692a411-e459-4d42-9fef-bb43ee7733b6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:34.853183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9692a411-e459-4d42-9fef-bb43ee7733b6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:34.853676 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9692a411-e459-4d42-9fef-bb43ee7733b6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:34.854412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9692a411-e459-4d42-9fef-bb43ee7733b6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:34.855058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9692a411-e459-4d42-9fef-bb43ee7733b6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:34.855517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9692a411-e459-4d42-9fef-bb43ee7733b6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:34.999890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9692a411-e459-4d42-9fef-bb43ee7733b6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:35.011336 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9692a411-e459-4d42-9fef-bb43ee7733b6 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1359 microversion: 2.1 time: 0.171512 Oct 11 00:34:35.017117 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4124/7592] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:34 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:34:36.035865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dc064689-2ce3-4ad9-b841-d8cfa2910a94 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:36.037305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dc064689-2ce3-4ad9-b841-d8cfa2910a94 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:36.045603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc064689-2ce3-4ad9-b841-d8cfa2910a94 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:36.050969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc064689-2ce3-4ad9-b841-d8cfa2910a94 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:36.051484 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc064689-2ce3-4ad9-b841-d8cfa2910a94 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:36.052276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc064689-2ce3-4ad9-b841-d8cfa2910a94 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:36.052856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc064689-2ce3-4ad9-b841-d8cfa2910a94 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:36.053286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc064689-2ce3-4ad9-b841-d8cfa2910a94 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:36.198702 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dc064689-2ce3-4ad9-b841-d8cfa2910a94 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:36.206837 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dc064689-2ce3-4ad9-b841-d8cfa2910a94 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1359 microversion: 2.1 time: 0.174914 Oct 11 00:34:36.207413 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3469/7593] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:36 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:34:37.231618 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0287790f-172f-49ac-a294-2175db7b1567 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:37.232252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0287790f-172f-49ac-a294-2175db7b1567 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:37.240637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0287790f-172f-49ac-a294-2175db7b1567 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:37.241574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0287790f-172f-49ac-a294-2175db7b1567 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:37.242449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0287790f-172f-49ac-a294-2175db7b1567 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:37.243686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0287790f-172f-49ac-a294-2175db7b1567 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:37.245219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0287790f-172f-49ac-a294-2175db7b1567 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:37.246054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0287790f-172f-49ac-a294-2175db7b1567 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:37.380845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0287790f-172f-49ac-a294-2175db7b1567 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:37.388928 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0287790f-172f-49ac-a294-2175db7b1567 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1359 microversion: 2.1 time: 0.162049 Oct 11 00:34:37.389535 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4125/7594] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:37 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:34:38.412936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c5428de9-461b-482e-a3e5-a1bfbce35242 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:38.413577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c5428de9-461b-482e-a3e5-a1bfbce35242 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:38.416757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:34:38.417658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:34:38.423774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5428de9-461b-482e-a3e5-a1bfbce35242 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:38.424263 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5428de9-461b-482e-a3e5-a1bfbce35242 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:38.424715 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5428de9-461b-482e-a3e5-a1bfbce35242 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:38.425431 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5428de9-461b-482e-a3e5-a1bfbce35242 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:38.425895 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5428de9-461b-482e-a3e5-a1bfbce35242 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:38.426322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c5428de9-461b-482e-a3e5-a1bfbce35242 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:38.640808 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c5428de9-461b-482e-a3e5-a1bfbce35242 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:38.649592 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c5428de9-461b-482e-a3e5-a1bfbce35242 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1359 microversion: 2.1 time: 0.240758 Oct 11 00:34:38.651450 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3470/7595] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:38 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:34:39.068786 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-810e34a9-7cbd-40a1-87e3-e442f44b77ab req-4eb176f2-d355-4858-bb1a-d6d82576d013 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba", "tag": "76db4c41-1666-4c19-8b0f-3340973007ee"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:34:39.075975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:34:39.084779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-810e34a9-7cbd-40a1-87e3-e442f44b77ab req-4eb176f2-d355-4858-bb1a-d6d82576d013 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:39.086002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-810e34a9-7cbd-40a1-87e3-e442f44b77ab req-4eb176f2-d355-4858-bb1a-d6d82576d013 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:39.086463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-810e34a9-7cbd-40a1-87e3-e442f44b77ab req-4eb176f2-d355-4858-bb1a-d6d82576d013 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:39.101712 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-810e34a9-7cbd-40a1-87e3-e442f44b77ab req-4eb176f2-d355-4858-bb1a-d6d82576d013 service nova] Creating event network-changed:76db4c41-1666-4c19-8b0f-3340973007ee for instance 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba on n-h1-860864-2 Oct 11 00:34:39.107912 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-810e34a9-7cbd-40a1-87e3-e442f44b77ab req-4eb176f2-d355-4858-bb1a-d6d82576d013 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044169 Oct 11 00:34:39.108865 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4126/7596] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:34:39.677445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b13b8a1f-f402-488c-8b76-4f8f0bb5f82f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:39.678077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b13b8a1f-f402-488c-8b76-4f8f0bb5f82f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:39.685169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b13b8a1f-f402-488c-8b76-4f8f0bb5f82f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:39.685691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b13b8a1f-f402-488c-8b76-4f8f0bb5f82f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:39.686129 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b13b8a1f-f402-488c-8b76-4f8f0bb5f82f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:39.686815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b13b8a1f-f402-488c-8b76-4f8f0bb5f82f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:39.687511 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b13b8a1f-f402-488c-8b76-4f8f0bb5f82f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:39.687940 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b13b8a1f-f402-488c-8b76-4f8f0bb5f82f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:39.826266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b13b8a1f-f402-488c-8b76-4f8f0bb5f82f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:39.833945 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b13b8a1f-f402-488c-8b76-4f8f0bb5f82f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1359 microversion: 2.1 time: 0.160445 Oct 11 00:34:39.834525 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3471/7597] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:39 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:34:40.859334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b2b3aff6-09cf-4e90-8227-9c1c869e478b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:40.860066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b2b3aff6-09cf-4e90-8227-9c1c869e478b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:40.867389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2b3aff6-09cf-4e90-8227-9c1c869e478b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:40.867897 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2b3aff6-09cf-4e90-8227-9c1c869e478b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:40.868350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2b3aff6-09cf-4e90-8227-9c1c869e478b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:40.869176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2b3aff6-09cf-4e90-8227-9c1c869e478b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:40.869705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2b3aff6-09cf-4e90-8227-9c1c869e478b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:40.870158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b2b3aff6-09cf-4e90-8227-9c1c869e478b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:41.004657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b2b3aff6-09cf-4e90-8227-9c1c869e478b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:41.012947 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b2b3aff6-09cf-4e90-8227-9c1c869e478b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1359 microversion: 2.1 time: 0.158615 Oct 11 00:34:41.013548 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4127/7598] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:40 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:34:42.036200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0e62f45b-aaeb-468a-98d5-7643a72970f3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:42.036849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0e62f45b-aaeb-468a-98d5-7643a72970f3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:42.044543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e62f45b-aaeb-468a-98d5-7643a72970f3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:42.045029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e62f45b-aaeb-468a-98d5-7643a72970f3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:42.045503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e62f45b-aaeb-468a-98d5-7643a72970f3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:42.046209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e62f45b-aaeb-468a-98d5-7643a72970f3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:42.046664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e62f45b-aaeb-468a-98d5-7643a72970f3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:42.047091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e62f45b-aaeb-468a-98d5-7643a72970f3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:42.178454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0e62f45b-aaeb-468a-98d5-7643a72970f3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:42.186863 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0e62f45b-aaeb-468a-98d5-7643a72970f3 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1359 microversion: 2.1 time: 0.154582 Oct 11 00:34:42.187707 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3472/7599] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:42 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:34:43.210342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cbabfe19-b32f-4d4a-8efd-cac8eb926c22 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:43.210977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cbabfe19-b32f-4d4a-8efd-cac8eb926c22 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:43.218119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbabfe19-b32f-4d4a-8efd-cac8eb926c22 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:43.218627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbabfe19-b32f-4d4a-8efd-cac8eb926c22 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:43.219081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbabfe19-b32f-4d4a-8efd-cac8eb926c22 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:43.219801 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbabfe19-b32f-4d4a-8efd-cac8eb926c22 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:43.220272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbabfe19-b32f-4d4a-8efd-cac8eb926c22 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:43.220717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cbabfe19-b32f-4d4a-8efd-cac8eb926c22 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:43.360186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cbabfe19-b32f-4d4a-8efd-cac8eb926c22 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:43.367980 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cbabfe19-b32f-4d4a-8efd-cac8eb926c22 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1359 microversion: 2.1 time: 0.161695 Oct 11 00:34:43.368556 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4128/7600] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:43 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:34:44.393584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c2e9cae3-ba02-47ef-af3c-d19d900ec9e4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:44.394196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c2e9cae3-ba02-47ef-af3c-d19d900ec9e4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:44.401805 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2e9cae3-ba02-47ef-af3c-d19d900ec9e4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:44.402424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2e9cae3-ba02-47ef-af3c-d19d900ec9e4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:44.402861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2e9cae3-ba02-47ef-af3c-d19d900ec9e4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:44.403546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2e9cae3-ba02-47ef-af3c-d19d900ec9e4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:44.403996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2e9cae3-ba02-47ef-af3c-d19d900ec9e4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:44.404417 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c2e9cae3-ba02-47ef-af3c-d19d900ec9e4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:44.535543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c2e9cae3-ba02-47ef-af3c-d19d900ec9e4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:44.543501 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c2e9cae3-ba02-47ef-af3c-d19d900ec9e4 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1359 microversion: 2.1 time: 0.153871 Oct 11 00:34:44.544078 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3473/7601] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:44 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:34:45.569019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-695ffc35-2db8-4048-a97c-87ee28a7a7ba tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:45.570110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-695ffc35-2db8-4048-a97c-87ee28a7a7ba tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:45.578647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-695ffc35-2db8-4048-a97c-87ee28a7a7ba tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:45.579235 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-695ffc35-2db8-4048-a97c-87ee28a7a7ba tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:45.580316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-695ffc35-2db8-4048-a97c-87ee28a7a7ba tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:45.581036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-695ffc35-2db8-4048-a97c-87ee28a7a7ba tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:45.581524 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-695ffc35-2db8-4048-a97c-87ee28a7a7ba tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:45.582079 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-695ffc35-2db8-4048-a97c-87ee28a7a7ba tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:45.625889 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-18621c6f-12c3-4452-ac89-3e710f1561e7 req-8053f211-356b-45c9-9bf4-26004072f449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba", "name": "network-vif-plugged", "status": "completed", "tag": "76db4c41-1666-4c19-8b0f-3340973007ee"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:34:45.636190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-18621c6f-12c3-4452-ac89-3e710f1561e7 req-8053f211-356b-45c9-9bf4-26004072f449 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:45.636938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-18621c6f-12c3-4452-ac89-3e710f1561e7 req-8053f211-356b-45c9-9bf4-26004072f449 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:45.637409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-18621c6f-12c3-4452-ac89-3e710f1561e7 req-8053f211-356b-45c9-9bf4-26004072f449 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:45.648899 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-18621c6f-12c3-4452-ac89-3e710f1561e7 req-8053f211-356b-45c9-9bf4-26004072f449 service nova] Creating event network-vif-plugged:76db4c41-1666-4c19-8b0f-3340973007ee for instance 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba on n-h1-860864-2 Oct 11 00:34:45.655994 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-18621c6f-12c3-4452-ac89-3e710f1561e7 req-8053f211-356b-45c9-9bf4-26004072f449 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105959 Oct 11 00:34:45.656616 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4129/7602] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:34:45.742610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-695ffc35-2db8-4048-a97c-87ee28a7a7ba tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:45.751695 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-695ffc35-2db8-4048-a97c-87ee28a7a7ba tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1359 microversion: 2.1 time: 0.188252 Oct 11 00:34:45.752296 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3474/7603] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:45 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:34:46.777162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-27565dc9-80bf-474f-b48f-6cc94fe7cfd7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:46.778187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-27565dc9-80bf-474f-b48f-6cc94fe7cfd7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:46.785551 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27565dc9-80bf-474f-b48f-6cc94fe7cfd7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:46.786061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27565dc9-80bf-474f-b48f-6cc94fe7cfd7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:46.786513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27565dc9-80bf-474f-b48f-6cc94fe7cfd7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:46.787235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27565dc9-80bf-474f-b48f-6cc94fe7cfd7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:46.787701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27565dc9-80bf-474f-b48f-6cc94fe7cfd7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:46.788384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27565dc9-80bf-474f-b48f-6cc94fe7cfd7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:46.921658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-27565dc9-80bf-474f-b48f-6cc94fe7cfd7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:46.929425 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-27565dc9-80bf-474f-b48f-6cc94fe7cfd7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1359 microversion: 2.1 time: 0.157115 Oct 11 00:34:46.930000 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4130/7604] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:46 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:34:47.953712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9f8e3bba-9922-48b6-bd1e-fcfc54c28124 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:47.954362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9f8e3bba-9922-48b6-bd1e-fcfc54c28124 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:47.961172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f8e3bba-9922-48b6-bd1e-fcfc54c28124 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:47.962011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f8e3bba-9922-48b6-bd1e-fcfc54c28124 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:47.962182 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f8e3bba-9922-48b6-bd1e-fcfc54c28124 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:47.962791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f8e3bba-9922-48b6-bd1e-fcfc54c28124 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:47.963887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f8e3bba-9922-48b6-bd1e-fcfc54c28124 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:47.964292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9f8e3bba-9922-48b6-bd1e-fcfc54c28124 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:48.173769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9f8e3bba-9922-48b6-bd1e-fcfc54c28124 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:48.181563 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9f8e3bba-9922-48b6-bd1e-fcfc54c28124 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1548 microversion: 2.1 time: 0.231890 Oct 11 00:34:48.182750 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3475/7605] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:47 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1548 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:34:48.204878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e5722d7b-5b2d-4d83-af54-aa054eb2ea10 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:48.205517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e5722d7b-5b2d-4d83-af54-aa054eb2ea10 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:48.212826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5722d7b-5b2d-4d83-af54-aa054eb2ea10 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:48.213860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5722d7b-5b2d-4d83-af54-aa054eb2ea10 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:48.214388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5722d7b-5b2d-4d83-af54-aa054eb2ea10 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:48.215134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5722d7b-5b2d-4d83-af54-aa054eb2ea10 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:48.215615 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5722d7b-5b2d-4d83-af54-aa054eb2ea10 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:48.216132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e5722d7b-5b2d-4d83-af54-aa054eb2ea10 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:48.372581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e5722d7b-5b2d-4d83-af54-aa054eb2ea10 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:48.380373 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e5722d7b-5b2d-4d83-af54-aa054eb2ea10 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1548 microversion: 2.1 time: 0.179614 Oct 11 00:34:48.380946 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4131/7606] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:48 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1548 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:34:48.403430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e8d30019-95e5-45a1-bd68-ed425717c6bf tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:48.408210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e8d30019-95e5-45a1-bd68-ed425717c6bf tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:48.408985 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e8d30019-95e5-45a1-bd68-ed425717c6bf tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Searching by: {'deleted': False, 'project_id': '9690f354b0074e9e9b442e6154bcd41d'} {{(pid=120614) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 00:34:48.414294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8d30019-95e5-45a1-bd68-ed425717c6bf tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:48.414771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8d30019-95e5-45a1-bd68-ed425717c6bf tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:48.415205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8d30019-95e5-45a1-bd68-ed425717c6bf tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:48.415928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8d30019-95e5-45a1-bd68-ed425717c6bf tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:48.416944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8d30019-95e5-45a1-bd68-ed425717c6bf tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:48.417463 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e8d30019-95e5-45a1-bd68-ed425717c6bf tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:48.441043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.multi_cell_list [None req-e8d30019-95e5-45a1-bd68-ed425717c6bf tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120614) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 00:34:48.467927 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e8d30019-95e5-45a1-bd68-ed425717c6bf tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068994 Oct 11 00:34:48.468484 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3476/7607] 10.222.0.23 () {58 vars in 1125 bytes} [Tue Oct 11 00:34:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:34:48.480705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6e408145-3897-4221-aba8-e7908fe2d846 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:34:48.481332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6e408145-3897-4221-aba8-e7908fe2d846 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:48.487444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e408145-3897-4221-aba8-e7908fe2d846 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:48.487948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e408145-3897-4221-aba8-e7908fe2d846 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:48.488410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e408145-3897-4221-aba8-e7908fe2d846 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:48.489122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e408145-3897-4221-aba8-e7908fe2d846 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:48.489622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e408145-3897-4221-aba8-e7908fe2d846 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:48.490070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6e408145-3897-4221-aba8-e7908fe2d846 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:48.621313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6e408145-3897-4221-aba8-e7908fe2d846 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:34:48.629230 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6e408145-3897-4221-aba8-e7908fe2d846 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1548 microversion: 2.1 time: 0.153095 Oct 11 00:34:48.629837 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4132/7608] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:34:48 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:34:50.157056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f1db4087-0e4f-4f3d-9e12-07125cf23fa7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04437641-1bee-4ff5-9bea-71210c98e954"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:34:50.159444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f1db4087-0e4f-4f3d-9e12-07125cf23fa7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:34:50.166848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f1db4087-0e4f-4f3d-9e12-07125cf23fa7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:50.167341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f1db4087-0e4f-4f3d-9e12-07125cf23fa7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:50.167785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f1db4087-0e4f-4f3d-9e12-07125cf23fa7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:50.168492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f1db4087-0e4f-4f3d-9e12-07125cf23fa7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:34:50.168949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f1db4087-0e4f-4f3d-9e12-07125cf23fa7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:34:50.169406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f1db4087-0e4f-4f3d-9e12-07125cf23fa7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:34:50.414891 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f1db4087-0e4f-4f3d-9e12-07125cf23fa7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "POST /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261710 Oct 11 00:34:50.415527 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3477/7609] 10.222.0.23 () {60 vars in 1323 bytes} [Tue Oct 11 00:34:50 2022] POST /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:35:01.248808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4a329cdd-967e-4cd2-aa3b-b6b28d96a10d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:35:01.249475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4a329cdd-967e-4cd2-aa3b-b6b28d96a10d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:35:01.251862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=17 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:35:01.252671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=58 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:35:01.258418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a329cdd-967e-4cd2-aa3b-b6b28d96a10d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:35:01.258923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a329cdd-967e-4cd2-aa3b-b6b28d96a10d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:35:01.259382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a329cdd-967e-4cd2-aa3b-b6b28d96a10d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:35:01.260102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a329cdd-967e-4cd2-aa3b-b6b28d96a10d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:35:01.261291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a329cdd-967e-4cd2-aa3b-b6b28d96a10d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:35:01.261877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4a329cdd-967e-4cd2-aa3b-b6b28d96a10d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:35:01.396253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4a329cdd-967e-4cd2-aa3b-b6b28d96a10d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:35:01.404834 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4a329cdd-967e-4cd2-aa3b-b6b28d96a10d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1594 microversion: 2.1 time: 0.160744 Oct 11 00:35:01.405443 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4133/7610] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:35:01 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1594 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:35:03.057251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:35:03.058968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=19 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:35:03.059696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:35:03.065668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-03fba705-405b-487f-9140-bd8f3f3f09c8 req-0b8759ce-0c6f-4a21-86a3-38b0bb5d7665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba", "tag": "76db4c41-1666-4c19-8b0f-3340973007ee"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:35:03.079584 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-03fba705-405b-487f-9140-bd8f3f3f09c8 req-0b8759ce-0c6f-4a21-86a3-38b0bb5d7665 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:35:03.080410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-03fba705-405b-487f-9140-bd8f3f3f09c8 req-0b8759ce-0c6f-4a21-86a3-38b0bb5d7665 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:35:03.080926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-03fba705-405b-487f-9140-bd8f3f3f09c8 req-0b8759ce-0c6f-4a21-86a3-38b0bb5d7665 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:35:03.093721 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-03fba705-405b-487f-9140-bd8f3f3f09c8 req-0b8759ce-0c6f-4a21-86a3-38b0bb5d7665 service nova] Creating event network-changed:76db4c41-1666-4c19-8b0f-3340973007ee for instance 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba on n-h1-860864-2 Oct 11 00:35:03.099018 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-03fba705-405b-487f-9140-bd8f3f3f09c8 req-0b8759ce-0c6f-4a21-86a3-38b0bb5d7665 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044305 Oct 11 00:35:03.099815 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3478/7611] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:35:04.368650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bb33703e-36a4-4d23-bb42-816df5262c37 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-707618540"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:35:04.368650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bb33703e-36a4-4d23-bb42-816df5262c37 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:35:04.377646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb33703e-36a4-4d23-bb42-816df5262c37 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:35:04.378168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb33703e-36a4-4d23-bb42-816df5262c37 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:35:04.378636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb33703e-36a4-4d23-bb42-816df5262c37 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:35:04.379367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb33703e-36a4-4d23-bb42-816df5262c37 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:35:04.381770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb33703e-36a4-4d23-bb42-816df5262c37 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:35:04.381770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb33703e-36a4-4d23-bb42-816df5262c37 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:35:04.545609 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.network.security_group_api [None req-bb33703e-36a4-4d23-bb42-816df5262c37 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Adding security group 6acc8060-c1ab-49f5-85a4-6da0103137d0 to port 76db4c41-1666-4c19-8b0f-3340973007ee Oct 11 00:35:04.911143 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bb33703e-36a4-4d23-bb42-816df5262c37 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "POST /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/action" status: 202 len: 0 microversion: 2.1 time: 0.548645 Oct 11 00:35:04.914965 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4134/7612] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:35:04 2022] POST /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:35:04.921530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-56766cc5-a4e2-495b-8d53-e7e319f1ac96 req-1f4e2711-2cff-4d44-bd4f-ed1d6a2c480f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba", "tag": "76db4c41-1666-4c19-8b0f-3340973007ee"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:35:04.923427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b1d9695e-7bc4-422a-a60c-7c7583f2d80d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:35:04.924290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b1d9695e-7bc4-422a-a60c-7c7583f2d80d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:35:04.933128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-56766cc5-a4e2-495b-8d53-e7e319f1ac96 req-1f4e2711-2cff-4d44-bd4f-ed1d6a2c480f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:35:04.933961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-56766cc5-a4e2-495b-8d53-e7e319f1ac96 req-1f4e2711-2cff-4d44-bd4f-ed1d6a2c480f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:35:04.934104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1d9695e-7bc4-422a-a60c-7c7583f2d80d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:35:04.934592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1d9695e-7bc4-422a-a60c-7c7583f2d80d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:35:04.934863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-56766cc5-a4e2-495b-8d53-e7e319f1ac96 req-1f4e2711-2cff-4d44-bd4f-ed1d6a2c480f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:35:04.935046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1d9695e-7bc4-422a-a60c-7c7583f2d80d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:35:04.935948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1d9695e-7bc4-422a-a60c-7c7583f2d80d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:35:04.936425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1d9695e-7bc4-422a-a60c-7c7583f2d80d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:35:04.937592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b1d9695e-7bc4-422a-a60c-7c7583f2d80d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:35:04.949190 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-56766cc5-a4e2-495b-8d53-e7e319f1ac96 req-1f4e2711-2cff-4d44-bd4f-ed1d6a2c480f service nova] Creating event network-changed:76db4c41-1666-4c19-8b0f-3340973007ee for instance 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba on n-h1-860864-2 Oct 11 00:35:04.954851 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-56766cc5-a4e2-495b-8d53-e7e319f1ac96 req-1f4e2711-2cff-4d44-bd4f-ed1d6a2c480f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039124 Oct 11 00:35:04.955738 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3479/7613] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:35:05.219230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b1d9695e-7bc4-422a-a60c-7c7583f2d80d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:35:05.227628 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b1d9695e-7bc4-422a-a60c-7c7583f2d80d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1759 microversion: 2.1 time: 0.310540 Oct 11 00:35:05.228232 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4135/7614] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:35:04 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1759 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:36:02.998306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:36:02.999052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:36:03.004900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-04bf2eb5-18ad-4fca-95ba-20a01e2b2e99 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:36:03.007198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-04bf2eb5-18ad-4fca-95ba-20a01e2b2e99 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:36:03.015004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04bf2eb5-18ad-4fca-95ba-20a01e2b2e99 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:03.015481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04bf2eb5-18ad-4fca-95ba-20a01e2b2e99 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:03.016384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04bf2eb5-18ad-4fca-95ba-20a01e2b2e99 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:03.017077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04bf2eb5-18ad-4fca-95ba-20a01e2b2e99 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:03.017560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04bf2eb5-18ad-4fca-95ba-20a01e2b2e99 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:03.017987 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-04bf2eb5-18ad-4fca-95ba-20a01e2b2e99 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:03.090614 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-04bf2eb5-18ad-4fca-95ba-20a01e2b2e99 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "POST /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/action" status: 202 len: 0 microversion: 2.1 time: 0.094183 Oct 11 00:36:03.091211 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3480/7615] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:36:02 2022] POST /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:36:03.100411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a4511567-896c-47c5-b62d-cb52c0d7d7f7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:36:03.101073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a4511567-896c-47c5-b62d-cb52c0d7d7f7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:36:03.103110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:36:03.103884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=16 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:36:03.105360 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:36:03.105541 n-d-860864-2 devstack@n-api.service[120613]: Tue Oct 11 00:36:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba (ip 10.222.0.23) !!! Oct 11 00:36:03.113707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4511567-896c-47c5-b62d-cb52c0d7d7f7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:03.114290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4511567-896c-47c5-b62d-cb52c0d7d7f7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:03.114745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4511567-896c-47c5-b62d-cb52c0d7d7f7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:03.115458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4511567-896c-47c5-b62d-cb52c0d7d7f7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:03.115924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4511567-896c-47c5-b62d-cb52c0d7d7f7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:03.116363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a4511567-896c-47c5-b62d-cb52c0d7d7f7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:03.449843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a4511567-896c-47c5-b62d-cb52c0d7d7f7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:36:03.459640 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a4511567-896c-47c5-b62d-cb52c0d7d7f7 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1751 microversion: 2.1 time: 0.363444 Oct 11 00:36:03.460253 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4136/7616] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:36:03 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1751 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:36:04.484144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1ab4c0d5-b3da-47be-87e3-c2fb3d12e2df tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:36:04.484917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1ab4c0d5-b3da-47be-87e3-c2fb3d12e2df tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:36:04.491305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ab4c0d5-b3da-47be-87e3-c2fb3d12e2df tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:04.491847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ab4c0d5-b3da-47be-87e3-c2fb3d12e2df tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:04.492287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ab4c0d5-b3da-47be-87e3-c2fb3d12e2df tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:04.492986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ab4c0d5-b3da-47be-87e3-c2fb3d12e2df tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:04.493464 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ab4c0d5-b3da-47be-87e3-c2fb3d12e2df tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:04.493893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1ab4c0d5-b3da-47be-87e3-c2fb3d12e2df tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:04.643165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1ab4c0d5-b3da-47be-87e3-c2fb3d12e2df tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:36:04.651843 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1ab4c0d5-b3da-47be-87e3-c2fb3d12e2df tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1756 microversion: 2.1 time: 0.172885 Oct 11 00:36:04.652414 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3481/7617] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:36:04 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:36:05.675871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-175ac2a6-d856-4bb5-8146-27b4eb0c9ab9 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:36:05.676505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-175ac2a6-d856-4bb5-8146-27b4eb0c9ab9 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:36:05.683583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-175ac2a6-d856-4bb5-8146-27b4eb0c9ab9 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:05.684080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-175ac2a6-d856-4bb5-8146-27b4eb0c9ab9 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:05.684531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-175ac2a6-d856-4bb5-8146-27b4eb0c9ab9 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:05.685237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-175ac2a6-d856-4bb5-8146-27b4eb0c9ab9 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:05.685740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-175ac2a6-d856-4bb5-8146-27b4eb0c9ab9 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:05.686191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-175ac2a6-d856-4bb5-8146-27b4eb0c9ab9 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:05.831025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-175ac2a6-d856-4bb5-8146-27b4eb0c9ab9 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:36:05.839713 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-175ac2a6-d856-4bb5-8146-27b4eb0c9ab9 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1756 microversion: 2.1 time: 0.168070 Oct 11 00:36:05.840298 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4137/7618] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:36:05 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:36:06.866305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aba40a32-58fd-40b7-a40a-663e1b652b20 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:36:06.866915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aba40a32-58fd-40b7-a40a-663e1b652b20 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:36:06.873823 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aba40a32-58fd-40b7-a40a-663e1b652b20 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:06.874314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aba40a32-58fd-40b7-a40a-663e1b652b20 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:06.874755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aba40a32-58fd-40b7-a40a-663e1b652b20 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:06.875602 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aba40a32-58fd-40b7-a40a-663e1b652b20 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:06.876056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aba40a32-58fd-40b7-a40a-663e1b652b20 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:06.876487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aba40a32-58fd-40b7-a40a-663e1b652b20 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:07.022440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aba40a32-58fd-40b7-a40a-663e1b652b20 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:36:07.030791 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aba40a32-58fd-40b7-a40a-663e1b652b20 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1756 microversion: 2.1 time: 0.168441 Oct 11 00:36:07.031930 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3482/7619] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:36:06 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:36:08.054619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-508b7304-9057-4228-856b-ddfd22712fde tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:36:08.055246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-508b7304-9057-4228-856b-ddfd22712fde tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:36:08.062183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-508b7304-9057-4228-856b-ddfd22712fde tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:08.064083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-508b7304-9057-4228-856b-ddfd22712fde tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:08.064549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-508b7304-9057-4228-856b-ddfd22712fde tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:08.065257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-508b7304-9057-4228-856b-ddfd22712fde tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:08.065753 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-508b7304-9057-4228-856b-ddfd22712fde tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:08.066199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-508b7304-9057-4228-856b-ddfd22712fde tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:08.211769 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-508b7304-9057-4228-856b-ddfd22712fde tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:36:08.220220 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-508b7304-9057-4228-856b-ddfd22712fde tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1756 microversion: 2.1 time: 0.169493 Oct 11 00:36:08.220798 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4138/7620] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:36:08 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:36:09.243873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a006df5c-54e0-4716-873b-0030eadb4256 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:36:09.244469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a006df5c-54e0-4716-873b-0030eadb4256 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:36:09.251836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a006df5c-54e0-4716-873b-0030eadb4256 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:09.252317 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a006df5c-54e0-4716-873b-0030eadb4256 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:09.252746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a006df5c-54e0-4716-873b-0030eadb4256 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:09.253453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a006df5c-54e0-4716-873b-0030eadb4256 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:09.253908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a006df5c-54e0-4716-873b-0030eadb4256 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:09.254361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a006df5c-54e0-4716-873b-0030eadb4256 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:09.407430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a006df5c-54e0-4716-873b-0030eadb4256 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:36:09.415700 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a006df5c-54e0-4716-873b-0030eadb4256 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1756 microversion: 2.1 time: 0.175692 Oct 11 00:36:09.416282 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3483/7621] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:36:09 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:36:10.440255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-091772f3-143e-440b-a88a-6a1fc74b69cb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:36:10.440909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-091772f3-143e-440b-a88a-6a1fc74b69cb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:36:10.448548 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-091772f3-143e-440b-a88a-6a1fc74b69cb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:10.449045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-091772f3-143e-440b-a88a-6a1fc74b69cb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:10.449528 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-091772f3-143e-440b-a88a-6a1fc74b69cb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:10.450231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-091772f3-143e-440b-a88a-6a1fc74b69cb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:10.450696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-091772f3-143e-440b-a88a-6a1fc74b69cb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:10.451133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-091772f3-143e-440b-a88a-6a1fc74b69cb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:10.593575 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-091772f3-143e-440b-a88a-6a1fc74b69cb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:36:10.601884 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-091772f3-143e-440b-a88a-6a1fc74b69cb tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1756 microversion: 2.1 time: 0.165864 Oct 11 00:36:10.602454 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4139/7622] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:36:10 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:36:11.625339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-58e686a3-50b7-4235-a8e6-729eb586c12a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:36:11.625986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-58e686a3-50b7-4235-a8e6-729eb586c12a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:36:11.632749 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58e686a3-50b7-4235-a8e6-729eb586c12a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:11.633231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58e686a3-50b7-4235-a8e6-729eb586c12a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:11.633701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58e686a3-50b7-4235-a8e6-729eb586c12a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:11.634389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58e686a3-50b7-4235-a8e6-729eb586c12a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:11.634847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58e686a3-50b7-4235-a8e6-729eb586c12a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:11.635268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58e686a3-50b7-4235-a8e6-729eb586c12a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:11.779232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-58e686a3-50b7-4235-a8e6-729eb586c12a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:36:11.788123 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-58e686a3-50b7-4235-a8e6-729eb586c12a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1756 microversion: 2.1 time: 0.166798 Oct 11 00:36:11.788696 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3484/7623] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:36:11 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:36:12.810924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7e57d3eb-7c1e-4845-9da6-70c87a6d3e90 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:36:12.811560 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7e57d3eb-7c1e-4845-9da6-70c87a6d3e90 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:36:12.818665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e57d3eb-7c1e-4845-9da6-70c87a6d3e90 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:12.819068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e57d3eb-7c1e-4845-9da6-70c87a6d3e90 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:12.819527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e57d3eb-7c1e-4845-9da6-70c87a6d3e90 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:12.820252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e57d3eb-7c1e-4845-9da6-70c87a6d3e90 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:12.820721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e57d3eb-7c1e-4845-9da6-70c87a6d3e90 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:12.821164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e57d3eb-7c1e-4845-9da6-70c87a6d3e90 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:12.963055 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7e57d3eb-7c1e-4845-9da6-70c87a6d3e90 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:36:12.972344 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7e57d3eb-7c1e-4845-9da6-70c87a6d3e90 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1756 microversion: 2.1 time: 0.165353 Oct 11 00:36:12.972917 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4140/7624] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:36:12 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:36:13.996634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-aaf1d554-dd58-4066-ac03-7fa8ff9a0cfe tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:36:13.997234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-aaf1d554-dd58-4066-ac03-7fa8ff9a0cfe tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:36:14.004848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aaf1d554-dd58-4066-ac03-7fa8ff9a0cfe tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:14.005329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aaf1d554-dd58-4066-ac03-7fa8ff9a0cfe tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:14.005801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aaf1d554-dd58-4066-ac03-7fa8ff9a0cfe tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:14.006488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aaf1d554-dd58-4066-ac03-7fa8ff9a0cfe tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:14.006938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aaf1d554-dd58-4066-ac03-7fa8ff9a0cfe tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:14.007361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-aaf1d554-dd58-4066-ac03-7fa8ff9a0cfe tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:14.148700 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-aaf1d554-dd58-4066-ac03-7fa8ff9a0cfe tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:36:14.157150 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-aaf1d554-dd58-4066-ac03-7fa8ff9a0cfe tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1756 microversion: 2.1 time: 0.164365 Oct 11 00:36:14.157765 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3485/7625] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:36:13 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:36:15.180556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cfba0675-8837-4230-8419-2fd085a1b105 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:36:15.181185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cfba0675-8837-4230-8419-2fd085a1b105 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:36:15.189101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfba0675-8837-4230-8419-2fd085a1b105 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:15.190232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfba0675-8837-4230-8419-2fd085a1b105 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:15.190694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfba0675-8837-4230-8419-2fd085a1b105 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:15.191415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfba0675-8837-4230-8419-2fd085a1b105 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:15.191890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfba0675-8837-4230-8419-2fd085a1b105 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:15.192338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cfba0675-8837-4230-8419-2fd085a1b105 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:15.339969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cfba0675-8837-4230-8419-2fd085a1b105 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:36:15.349433 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cfba0675-8837-4230-8419-2fd085a1b105 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1756 microversion: 2.1 time: 0.172745 Oct 11 00:36:15.350026 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4141/7626] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:36:15 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:36:16.374072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-deb4fdc0-f146-4303-a838-2b7551b26e6d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:36:16.374682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-deb4fdc0-f146-4303-a838-2b7551b26e6d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:36:16.381778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-deb4fdc0-f146-4303-a838-2b7551b26e6d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:16.382261 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-deb4fdc0-f146-4303-a838-2b7551b26e6d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:16.382691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-deb4fdc0-f146-4303-a838-2b7551b26e6d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:16.383470 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-deb4fdc0-f146-4303-a838-2b7551b26e6d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:16.383917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-deb4fdc0-f146-4303-a838-2b7551b26e6d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:16.384339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-deb4fdc0-f146-4303-a838-2b7551b26e6d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:16.526863 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-deb4fdc0-f146-4303-a838-2b7551b26e6d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:36:16.536643 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-deb4fdc0-f146-4303-a838-2b7551b26e6d tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1756 microversion: 2.1 time: 0.166476 Oct 11 00:36:16.537246 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3486/7627] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:36:16 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:36:17.560176 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a3dc4ec1-929a-42be-9b37-61250648787e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:36:17.560807 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a3dc4ec1-929a-42be-9b37-61250648787e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:36:17.568229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3dc4ec1-929a-42be-9b37-61250648787e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:17.568730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3dc4ec1-929a-42be-9b37-61250648787e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:17.569217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3dc4ec1-929a-42be-9b37-61250648787e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:17.570001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3dc4ec1-929a-42be-9b37-61250648787e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:17.570471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3dc4ec1-929a-42be-9b37-61250648787e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:17.570912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3dc4ec1-929a-42be-9b37-61250648787e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:17.720944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a3dc4ec1-929a-42be-9b37-61250648787e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:36:17.729346 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a3dc4ec1-929a-42be-9b37-61250648787e tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1756 microversion: 2.1 time: 0.173113 Oct 11 00:36:17.729947 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4142/7628] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:36:17 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:36:18.753444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-67134ad4-2e04-4e50-ae85-d5932ea44e8c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:36:18.754060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-67134ad4-2e04-4e50-ae85-d5932ea44e8c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:36:18.760925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67134ad4-2e04-4e50-ae85-d5932ea44e8c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:18.761440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67134ad4-2e04-4e50-ae85-d5932ea44e8c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:18.761876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67134ad4-2e04-4e50-ae85-d5932ea44e8c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:18.762576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67134ad4-2e04-4e50-ae85-d5932ea44e8c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:18.763023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67134ad4-2e04-4e50-ae85-d5932ea44e8c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:18.763445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67134ad4-2e04-4e50-ae85-d5932ea44e8c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:18.916359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-67134ad4-2e04-4e50-ae85-d5932ea44e8c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:36:18.926378 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-67134ad4-2e04-4e50-ae85-d5932ea44e8c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1756 microversion: 2.1 time: 0.177457 Oct 11 00:36:18.927001 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3487/7629] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:36:18 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:36:19.951585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7ecdc506-f863-483f-887a-46086866e7fd tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:36:19.952245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7ecdc506-f863-483f-887a-46086866e7fd tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:36:19.959460 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ecdc506-f863-483f-887a-46086866e7fd tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:19.960001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ecdc506-f863-483f-887a-46086866e7fd tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:19.960459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ecdc506-f863-483f-887a-46086866e7fd tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:19.961177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ecdc506-f863-483f-887a-46086866e7fd tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:36:19.961678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ecdc506-f863-483f-887a-46086866e7fd tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:36:19.962127 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7ecdc506-f863-483f-887a-46086866e7fd tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:36:20.112382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7ecdc506-f863-483f-887a-46086866e7fd tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:36:20.121068 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7ecdc506-f863-483f-887a-46086866e7fd tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1759 microversion: 2.1 time: 0.173452 Oct 11 00:36:20.121684 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4143/7630] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:36:19 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1759 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:37:23.514155 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=16 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:37:23.514917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:37:23.519322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-71aa3c3c-14c7-4754-ab7f-22fb1ab4ab86 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-707618540"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:37:23.519892 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-71aa3c3c-14c7-4754-ab7f-22fb1ab4ab86 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:37:23.527299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71aa3c3c-14c7-4754-ab7f-22fb1ab4ab86 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:23.527786 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71aa3c3c-14c7-4754-ab7f-22fb1ab4ab86 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:23.528222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71aa3c3c-14c7-4754-ab7f-22fb1ab4ab86 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:23.528913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71aa3c3c-14c7-4754-ab7f-22fb1ab4ab86 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:23.529456 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71aa3c3c-14c7-4754-ab7f-22fb1ab4ab86 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:23.529880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-71aa3c3c-14c7-4754-ab7f-22fb1ab4ab86 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:23.660137 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.network.security_group_api [None req-71aa3c3c-14c7-4754-ab7f-22fb1ab4ab86 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Removing security group 6acc8060-c1ab-49f5-85a4-6da0103137d0 from port 76db4c41-1666-4c19-8b0f-3340973007ee Oct 11 00:37:23.971088 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-71aa3c3c-14c7-4754-ab7f-22fb1ab4ab86 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "POST /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/action" status: 202 len: 0 microversion: 2.1 time: 0.459057 Oct 11 00:37:23.971895 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3488/7631] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:37:23 2022] POST /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:37:23.978012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=16 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:37:23.979143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=48 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:37:23.985234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-c65d117d-1a97-448f-bce5-e9a364ae00be req-5e6f86f3-d731-423f-9de6-9708c0bf32da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba", "tag": "76db4c41-1666-4c19-8b0f-3340973007ee"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:37:24.008913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c65d117d-1a97-448f-bce5-e9a364ae00be req-5e6f86f3-d731-423f-9de6-9708c0bf32da service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:24.009738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c65d117d-1a97-448f-bce5-e9a364ae00be req-5e6f86f3-d731-423f-9de6-9708c0bf32da service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:24.010371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-c65d117d-1a97-448f-bce5-e9a364ae00be req-5e6f86f3-d731-423f-9de6-9708c0bf32da service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:24.022946 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-c65d117d-1a97-448f-bce5-e9a364ae00be req-5e6f86f3-d731-423f-9de6-9708c0bf32da service nova] Creating event network-changed:76db4c41-1666-4c19-8b0f-3340973007ee for instance 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba on n-h1-860864-2 Oct 11 00:37:24.027054 n-d-860864-2 devstack@n-api.service[120613]: ERROR oslo.messaging._drivers.impl_rabbit [req-c65d117d-1a97-448f-bce5-e9a364ae00be req-5e6f86f3-d731-423f-9de6-9708c0bf32da service nova] [0caf815f-5f30-493d-a3ef-5da2e3871c24] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 00:37:24.987037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1e0cee2c-8ec9-409c-88af-aaa8cfa3839c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:37:24.987606 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1e0cee2c-8ec9-409c-88af-aaa8cfa3839c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:37:24.993785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e0cee2c-8ec9-409c-88af-aaa8cfa3839c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:24.994287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e0cee2c-8ec9-409c-88af-aaa8cfa3839c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:24.994755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e0cee2c-8ec9-409c-88af-aaa8cfa3839c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:24.995458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e0cee2c-8ec9-409c-88af-aaa8cfa3839c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:24.995916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e0cee2c-8ec9-409c-88af-aaa8cfa3839c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:24.996348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1e0cee2c-8ec9-409c-88af-aaa8cfa3839c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:25.036615 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [req-c65d117d-1a97-448f-bce5-e9a364ae00be req-5e6f86f3-d731-423f-9de6-9708c0bf32da service nova] [0caf815f-5f30-493d-a3ef-5da2e3871c24] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39288. Oct 11 00:37:25.040908 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-c65d117d-1a97-448f-bce5-e9a364ae00be req-5e6f86f3-d731-423f-9de6-9708c0bf32da service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.065068 Oct 11 00:37:25.043855 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4144/7632] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:37:25.085315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-1e0cee2c-8ec9-409c-88af-aaa8cfa3839c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lazy-loading 'services' on Instance uuid 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:37:25.167804 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1e0cee2c-8ec9-409c-88af-aaa8cfa3839c tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "DELETE /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/os-volume_attachments/04437641-1bee-4ff5-9bea-71210c98e954" status: 202 len: 0 microversion: 2.1 time: 0.186441 Oct 11 00:37:25.171533 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3489/7633] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 11 00:37:24 2022] DELETE /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/os-volume_attachments/04437641-1bee-4ff5-9bea-71210c98e954 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 00:37:25.177664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-03b16258-c584-4461-b86b-7fa88daf0361 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:37:25.180735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-03b16258-c584-4461-b86b-7fa88daf0361 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:37:25.191504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03b16258-c584-4461-b86b-7fa88daf0361 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:25.192102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03b16258-c584-4461-b86b-7fa88daf0361 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:25.192569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03b16258-c584-4461-b86b-7fa88daf0361 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:25.193307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03b16258-c584-4461-b86b-7fa88daf0361 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:25.193843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03b16258-c584-4461-b86b-7fa88daf0361 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:25.194566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-03b16258-c584-4461-b86b-7fa88daf0361 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:25.232179 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-03b16258-c584-4461-b86b-7fa88daf0361 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059113 Oct 11 00:37:25.233520 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4145/7634] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:37:25 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:37:26.248321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e0f4f543-dc70-4b99-9ace-fb0db404080b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:37:26.250948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e0f4f543-dc70-4b99-9ace-fb0db404080b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:37:26.257442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0f4f543-dc70-4b99-9ace-fb0db404080b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:26.258037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0f4f543-dc70-4b99-9ace-fb0db404080b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:26.258545 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0f4f543-dc70-4b99-9ace-fb0db404080b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:26.259350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0f4f543-dc70-4b99-9ace-fb0db404080b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:26.259884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0f4f543-dc70-4b99-9ace-fb0db404080b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:26.260346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e0f4f543-dc70-4b99-9ace-fb0db404080b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:26.290542 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e0f4f543-dc70-4b99-9ace-fb0db404080b tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047719 Oct 11 00:37:26.291119 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3490/7635] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:37:26 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:37:27.058425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-8dae92d6-c2de-46dd-8a7d-57a2a3f4a3a6 req-eafbe574-d6fb-495b-af12-7e5ab0c9a918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba", "tag": "76db4c41-1666-4c19-8b0f-3340973007ee"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:37:27.068451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8dae92d6-c2de-46dd-8a7d-57a2a3f4a3a6 req-eafbe574-d6fb-495b-af12-7e5ab0c9a918 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:27.068871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8dae92d6-c2de-46dd-8a7d-57a2a3f4a3a6 req-eafbe574-d6fb-495b-af12-7e5ab0c9a918 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:27.069325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-8dae92d6-c2de-46dd-8a7d-57a2a3f4a3a6 req-eafbe574-d6fb-495b-af12-7e5ab0c9a918 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:27.080481 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-8dae92d6-c2de-46dd-8a7d-57a2a3f4a3a6 req-eafbe574-d6fb-495b-af12-7e5ab0c9a918 service nova] Creating event network-changed:76db4c41-1666-4c19-8b0f-3340973007ee for instance 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba on n-h1-860864-2 Oct 11 00:37:27.085759 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-8dae92d6-c2de-46dd-8a7d-57a2a3f4a3a6 req-eafbe574-d6fb-495b-af12-7e5ab0c9a918 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031160 Oct 11 00:37:27.086373 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4146/7636] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:37:27.303787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dd739a78-43c0-4c2e-b983-c82f46b77c90 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:37:27.306913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dd739a78-43c0-4c2e-b983-c82f46b77c90 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:37:27.315060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd739a78-43c0-4c2e-b983-c82f46b77c90 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:27.315640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd739a78-43c0-4c2e-b983-c82f46b77c90 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:27.316660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd739a78-43c0-4c2e-b983-c82f46b77c90 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:27.317389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd739a78-43c0-4c2e-b983-c82f46b77c90 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:27.317852 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd739a78-43c0-4c2e-b983-c82f46b77c90 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:27.318279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dd739a78-43c0-4c2e-b983-c82f46b77c90 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:27.353038 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dd739a78-43c0-4c2e-b983-c82f46b77c90 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053035 Oct 11 00:37:27.357778 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3491/7637] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:37:27 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:37:28.367938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-42fc45b5-4ab4-457f-9bdf-4f235c2c2225 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:37:28.370152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-42fc45b5-4ab4-457f-9bdf-4f235c2c2225 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:37:28.376550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42fc45b5-4ab4-457f-9bdf-4f235c2c2225 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:28.376887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42fc45b5-4ab4-457f-9bdf-4f235c2c2225 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:28.377549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42fc45b5-4ab4-457f-9bdf-4f235c2c2225 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:28.378938 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42fc45b5-4ab4-457f-9bdf-4f235c2c2225 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:28.379412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42fc45b5-4ab4-457f-9bdf-4f235c2c2225 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:28.379860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-42fc45b5-4ab4-457f-9bdf-4f235c2c2225 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:28.410702 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-42fc45b5-4ab4-457f-9bdf-4f235c2c2225 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048347 Oct 11 00:37:28.414915 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4147/7638] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:37:28 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:37:29.422349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-42a9eb68-37fc-451d-b110-ce29c205bbfe tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:37:29.425286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-42a9eb68-37fc-451d-b110-ce29c205bbfe tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:37:29.432066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42a9eb68-37fc-451d-b110-ce29c205bbfe tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:29.432554 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42a9eb68-37fc-451d-b110-ce29c205bbfe tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:29.432990 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42a9eb68-37fc-451d-b110-ce29c205bbfe tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:29.433718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42a9eb68-37fc-451d-b110-ce29c205bbfe tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:29.434174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42a9eb68-37fc-451d-b110-ce29c205bbfe tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:29.434620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-42a9eb68-37fc-451d-b110-ce29c205bbfe tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:29.469323 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-42a9eb68-37fc-451d-b110-ce29c205bbfe tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050924 Oct 11 00:37:29.470043 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3492/7639] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:37:29 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:37:30.482852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-051bd210-fa02-4da3-8218-4aaf5ddc475a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:37:30.485084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-051bd210-fa02-4da3-8218-4aaf5ddc475a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:37:30.492057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-051bd210-fa02-4da3-8218-4aaf5ddc475a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:30.492558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-051bd210-fa02-4da3-8218-4aaf5ddc475a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:30.493015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-051bd210-fa02-4da3-8218-4aaf5ddc475a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:30.493782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-051bd210-fa02-4da3-8218-4aaf5ddc475a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:30.494290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-051bd210-fa02-4da3-8218-4aaf5ddc475a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:30.494745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-051bd210-fa02-4da3-8218-4aaf5ddc475a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:30.526837 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-051bd210-fa02-4da3-8218-4aaf5ddc475a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047943 Oct 11 00:37:30.527409 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4148/7640] 10.222.0.23 () {58 vars in 1302 bytes} [Tue Oct 11 00:37:30 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 00:37:30.539047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-07de3c8d-5c20-48d5-839b-598187d315d0 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:37:30.539578 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-07de3c8d-5c20-48d5-839b-598187d315d0 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:37:30.546341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07de3c8d-5c20-48d5-839b-598187d315d0 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:30.546829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07de3c8d-5c20-48d5-839b-598187d315d0 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:30.547270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07de3c8d-5c20-48d5-839b-598187d315d0 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:30.547963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07de3c8d-5c20-48d5-839b-598187d315d0 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:30.548416 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07de3c8d-5c20-48d5-839b-598187d315d0 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:30.548890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-07de3c8d-5c20-48d5-839b-598187d315d0 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:30.759980 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-07de3c8d-5c20-48d5-839b-598187d315d0 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] HTTP exception thrown: Instance 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba is not attached to volume 04437641-1bee-4ff5-9bea-71210c98e954 Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-07de3c8d-5c20-48d5-839b-598187d315d0 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Request method failure captured: Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: request: DELETE /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/os-volume_attachments/04437641-1bee-4ff5-9bea-71210c98e954 HTTP/1.1 Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLjcu4rF5rbuEN0k2W4hdj_pZd-XRykqlk1Ho5AhVl255rnP-Qt0shYcTuuHXMz0puWUxTJj6f6pzxGcUNsb9hyInEi09OpeyVs_fGCO4cIKlLm_V_1q-81MnzZh3OcJMdtXr9EO3p0Jg3fosL_8KO8jg6OUoXIsQaMoz-mf4W2AYv4 Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 9690f354b0074e9e9b442e6154bcd41d Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TestMinimumBasicScenario-2035497586 Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9690f354b0074e9e9b442e6154bcd41d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9690f354b0074e9e9b442e6154bcd41d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9690f354b0074e9e9b442e6154bcd41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9690f354b0074e9e9b442e6154bcd41d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TestMinimumBasicScenario-2035497586 Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 9690f354b0074e9e9b442e6154bcd41d Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2035497586 Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TestMinimumBasicScenario-2035497586-project Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 4eef568ea2ab44119b61203db2dc25a9 Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TestMinimumBasicScenario-2035497586-project Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba is not attached to volume 04437641-1bee-4ff5-9bea-71210c98e954 Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'server_id': '375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba', 'id': '04437641-1bee-4ff5-9bea-71210c98e954'} Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 04437641-1bee-4ff5-9bea-71210c98e954. Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba is not attached to volume 04437641-1bee-4ff5-9bea-71210c98e954 Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:37:30.761645 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:37:30.765906 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:37:30.765906 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:37:30.765906 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba is not attached to volume 04437641-1bee-4ff5-9bea-71210c98e954 Oct 11 00:37:30.765906 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:37:30.765906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-07de3c8d-5c20-48d5-839b-598187d315d0 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Returning 404 to user: Instance 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba is not attached to volume 04437641-1bee-4ff5-9bea-71210c98e954 {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:37:30.765906 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-07de3c8d-5c20-48d5-839b-598187d315d0 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "DELETE /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/os-volume_attachments/04437641-1bee-4ff5-9bea-71210c98e954" status: 404 len: 154 microversion: 2.1 time: 0.228252 Oct 11 00:37:30.765906 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3493/7641] 10.222.0.23 () {58 vars in 1416 bytes} [Tue Oct 11 00:37:30 2022] DELETE /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba/os-volume_attachments/04437641-1bee-4ff5-9bea-71210c98e954 => generated 154 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:37:34.028309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f49b458d-7378-400b-b40c-7dfdfa4070d0 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:37:34.028823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f49b458d-7378-400b-b40c-7dfdfa4070d0 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:37:34.035976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f49b458d-7378-400b-b40c-7dfdfa4070d0 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:34.036484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f49b458d-7378-400b-b40c-7dfdfa4070d0 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:34.036969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f49b458d-7378-400b-b40c-7dfdfa4070d0 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:34.037718 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f49b458d-7378-400b-b40c-7dfdfa4070d0 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:34.038195 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f49b458d-7378-400b-b40c-7dfdfa4070d0 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:34.038645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f49b458d-7378-400b-b40c-7dfdfa4070d0 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:34.065261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f49b458d-7378-400b-b40c-7dfdfa4070d0 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:37:34.149829 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f49b458d-7378-400b-b40c-7dfdfa4070d0 tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "DELETE /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 204 len: 0 microversion: 2.1 time: 0.125038 Oct 11 00:37:34.150625 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4149/7642] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:37:34 2022] DELETE /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:37:34.161282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7383cc3b-a3de-43ff-af57-5e403ef42bab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:37:34.162117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7383cc3b-a3de-43ff-af57-5e403ef42bab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:37:34.170210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7383cc3b-a3de-43ff-af57-5e403ef42bab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:34.170776 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7383cc3b-a3de-43ff-af57-5e403ef42bab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:34.171651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7383cc3b-a3de-43ff-af57-5e403ef42bab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:34.172502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7383cc3b-a3de-43ff-af57-5e403ef42bab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:34.172502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7383cc3b-a3de-43ff-af57-5e403ef42bab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:34.172839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7383cc3b-a3de-43ff-af57-5e403ef42bab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:34.306825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7383cc3b-a3de-43ff-af57-5e403ef42bab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:37:34.316366 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7383cc3b-a3de-43ff-af57-5e403ef42bab tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1554 microversion: 2.1 time: 0.160378 Oct 11 00:37:34.316953 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3494/7643] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:37:34 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:37:35.339882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-11889d6c-bc6a-4597-a8ee-1e344def4d4f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:37:35.340606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-11889d6c-bc6a-4597-a8ee-1e344def4d4f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:37:35.348269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11889d6c-bc6a-4597-a8ee-1e344def4d4f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:35.348764 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11889d6c-bc6a-4597-a8ee-1e344def4d4f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:35.349213 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11889d6c-bc6a-4597-a8ee-1e344def4d4f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:35.349979 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11889d6c-bc6a-4597-a8ee-1e344def4d4f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:35.350427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11889d6c-bc6a-4597-a8ee-1e344def4d4f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:35.350866 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-11889d6c-bc6a-4597-a8ee-1e344def4d4f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:35.485310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-11889d6c-bc6a-4597-a8ee-1e344def4d4f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:37:35.500806 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-11889d6c-bc6a-4597-a8ee-1e344def4d4f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1554 microversion: 2.1 time: 0.164941 Oct 11 00:37:35.501433 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4150/7644] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:37:35 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:37:36.525106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0088f9ed-9bdc-41e7-892d-9efb20f5ab6f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:37:36.525764 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0088f9ed-9bdc-41e7-892d-9efb20f5ab6f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:37:36.534389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-ce0707d4-d726-40a8-90f3-f0135d1340e2 req-d941e48f-beec-4889-891f-6a75d4e48a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba", "name": "network-vif-deleted", "tag": "76db4c41-1666-4c19-8b0f-3340973007ee"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:37:36.535860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0088f9ed-9bdc-41e7-892d-9efb20f5ab6f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:36.536489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0088f9ed-9bdc-41e7-892d-9efb20f5ab6f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:36.536945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0088f9ed-9bdc-41e7-892d-9efb20f5ab6f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:36.537698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0088f9ed-9bdc-41e7-892d-9efb20f5ab6f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:36.538195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0088f9ed-9bdc-41e7-892d-9efb20f5ab6f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:36.538597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0088f9ed-9bdc-41e7-892d-9efb20f5ab6f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:36.546448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ce0707d4-d726-40a8-90f3-f0135d1340e2 req-d941e48f-beec-4889-891f-6a75d4e48a04 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:36.547028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ce0707d4-d726-40a8-90f3-f0135d1340e2 req-d941e48f-beec-4889-891f-6a75d4e48a04 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:36.547550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ce0707d4-d726-40a8-90f3-f0135d1340e2 req-d941e48f-beec-4889-891f-6a75d4e48a04 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:36.559399 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-ce0707d4-d726-40a8-90f3-f0135d1340e2 req-d941e48f-beec-4889-891f-6a75d4e48a04 service nova] Creating event network-vif-deleted:76db4c41-1666-4c19-8b0f-3340973007ee for instance 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba on n-h1-860864-2 Oct 11 00:37:36.565040 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-ce0707d4-d726-40a8-90f3-f0135d1340e2 req-d941e48f-beec-4889-891f-6a75d4e48a04 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034791 Oct 11 00:37:36.566085 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4151/7645] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:37:36.622393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0088f9ed-9bdc-41e7-892d-9efb20f5ab6f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef568ea2ab44119b61203db2dc25a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9690f354b0074e9e9b442e6154bcd41d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:37:36.632957 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0088f9ed-9bdc-41e7-892d-9efb20f5ab6f tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 200 len: 1512 microversion: 2.1 time: 0.111861 Oct 11 00:37:36.633589 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3495/7646] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:37:36 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 1512 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:37:37.658775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b83c0ea8-2c36-4a7f-bda8-9208f060169a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:37:37.660048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b83c0ea8-2c36-4a7f-bda8-9208f060169a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [instance: 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:37:37.666445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b83c0ea8-2c36-4a7f-bda8-9208f060169a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:37.666949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b83c0ea8-2c36-4a7f-bda8-9208f060169a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:37.667401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b83c0ea8-2c36-4a7f-bda8-9208f060169a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:37.668109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b83c0ea8-2c36-4a7f-bda8-9208f060169a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:37.668593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b83c0ea8-2c36-4a7f-bda8-9208f060169a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:37.669026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b83c0ea8-2c36-4a7f-bda8-9208f060169a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:37.683115 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-b83c0ea8-2c36-4a7f-bda8-9208f060169a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] HTTP exception thrown: Instance 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba could not be found. Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b83c0ea8-2c36-4a7f-bda8-9208f060169a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Request method failure captured: Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba HTTP/1.1 Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLjcu4rF5rbuEN0k2W4hdj_pZd-XRykqlk1Ho5AhVl255rnP-Qt0shYcTuuHXMz0puWUxTJj6f6pzxGcUNsb9hyInEi09OpeyVs_fGCO4cIKlLm_V_1q-81MnzZh3OcJMdtXr9EO3p0Jg3fosL_8KO8jg6OUoXIsQaMoz-mf4W2AYv4 Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 9690f354b0074e9e9b442e6154bcd41d Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestMinimumBasicScenario-2035497586 Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9690f354b0074e9e9b442e6154bcd41d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9690f354b0074e9e9b442e6154bcd41d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9690f354b0074e9e9b442e6154bcd41d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9690f354b0074e9e9b442e6154bcd41d", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestMinimumBasicScenario-2035497586 Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 9690f354b0074e9e9b442e6154bcd41d Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2035497586 Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestMinimumBasicScenario-2035497586-project Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 4eef568ea2ab44119b61203db2dc25a9 Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestMinimumBasicScenario-2035497586-project Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba could not be found. Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba'} Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba could not be found. Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba could not be found. Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:37:37.684741 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:37:37.689887 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:37:37.689887 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:37:37.689887 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:37:37.689887 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:37:37.689887 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:37:37.689887 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba could not be found. Oct 11 00:37:37.689887 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:37:37.689887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b83c0ea8-2c36-4a7f-bda8-9208f060169a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Returning 404 to user: Instance 375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:37:37.689887 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b83c0ea8-2c36-4a7f-bda8-9208f060169a tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba" status: 404 len: 111 microversion: 2.1 time: 0.032724 Oct 11 00:37:37.689887 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4152/7647] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:37:37 2022] GET /compute/v2.1/servers/375fe54b-f7bf-4e05-ac73-5e8f9ae9a4ba => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:37:37.695873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-64ec12f1-e632-44ff-abd4-3787d4d371de tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] Calling method '.version_select at 0x7f662a8fbdc0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:37:37.700351 n-d-860864-2 devstack@n-api.service[120614]: ERROR oslo.messaging._drivers.impl_rabbit [None req-64ec12f1-e632-44ff-abd4-3787d4d371de tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [65b652d7-8255-4975-ab29-45ae4d236b13] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 00:37:38.709482 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [None req-64ec12f1-e632-44ff-abd4-3787d4d371de tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] [65b652d7-8255-4975-ab29-45ae4d236b13] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39342. Oct 11 00:37:38.729952 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-64ec12f1-e632-44ff-abd4-3787d4d371de tempest-TestMinimumBasicScenario-2035497586 tempest-TestMinimumBasicScenario-2035497586-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1026665296" status: 202 len: 0 microversion: 2.1 time: 1.037762 Oct 11 00:37:38.730548 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3496/7648] 10.222.0.23 () {58 vars in 1272 bytes} [Tue Oct 11 00:37:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1026665296 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:37:47.961526 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:37:47.962081 n-d-860864-2 devstack@n-api.service[120613]: Tue Oct 11 00:37:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.23) !!! Oct 11 00:37:47.963469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:37:47.964301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:37:48.126912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f9e39697-68f5-4526-8e9a-cbf4c40e5094 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'create', calling method: .version_select at 0x7f6633a06c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1679557744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTQ17nVKJO9vw2WIX1l0O9rAty9XBCCC1bnoDbyCwxjHM9lZW24I1MTaJrYOp8t0XTkL1qr7RdJkT01zXN9lC7YMk5l4ACmhJ5mlDgVbOAUN4jCMx2vTBGuAvi7/+8gAg=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:37:48.143296 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-f9e39697-68f5-4526-8e9a-cbf4c40e5094 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Getting quotas for project 60c10fdea561499c9f87fac524ca4113. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:37:48.148470 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-f9e39697-68f5-4526-8e9a-cbf4c40e5094 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Getting quotas for user 84c8a15123fb4b0292320555bceb3681 and project 60c10fdea561499c9f87fac524ca4113. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:37:48.177494 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f9e39697-68f5-4526-8e9a-cbf4c40e5094 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.221756 Oct 11 00:37:48.178108 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4153/7649] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 11 00:37:47 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:37:53.865222 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:37:53.865767 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:37:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 11 00:37:53.866576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:37:53.867530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:37:53.872016 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7bcd30dd-d84d-477c-96bd-7ec5d5af72e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1717110401", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "d85a79b5-39d0-4388-8967-99a7dc5482f9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1679557744", "security_groups": [{"name": "tempest-secgroup-smoke-1715117467"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:37:53.998247 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-7bcd30dd-d84d-477c-96bd-7ec5d5af72e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] validate_networks() for [('d85a79b5-39d0-4388-8967-99a7dc5482f9', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:37:54.454313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-7bcd30dd-d84d-477c-96bd-7ec5d5af72e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:37:54.455201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-7bcd30dd-d84d-477c-96bd-7ec5d5af72e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:37:54.455829 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-7bcd30dd-d84d-477c-96bd-7ec5d5af72e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:37:54.456517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-7bcd30dd-d84d-477c-96bd-7ec5d5af72e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:37:54.456874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-7bcd30dd-d84d-477c-96bd-7ec5d5af72e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:37:54.467665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bcd30dd-d84d-477c-96bd-7ec5d5af72e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:54.468254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bcd30dd-d84d-477c-96bd-7ec5d5af72e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:54.468831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bcd30dd-d84d-477c-96bd-7ec5d5af72e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:54.469926 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bcd30dd-d84d-477c-96bd-7ec5d5af72e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:54.470488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bcd30dd-d84d-477c-96bd-7ec5d5af72e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:54.471018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7bcd30dd-d84d-477c-96bd-7ec5d5af72e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:54.507595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-7bcd30dd-d84d-477c-96bd-7ec5d5af72e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Getting quotas for project 60c10fdea561499c9f87fac524ca4113. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:37:54.514040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-7bcd30dd-d84d-477c-96bd-7ec5d5af72e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Getting quotas for user 84c8a15123fb4b0292320555bceb3681 and project 60c10fdea561499c9f87fac524ca4113. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:37:54.528592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7bcd30dd-d84d-477c-96bd-7ec5d5af72e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:37:54.531706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7bcd30dd-d84d-477c-96bd-7ec5d5af72e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:37:54.592200 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7bcd30dd-d84d-477c-96bd-7ec5d5af72e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.729024 Oct 11 00:37:54.593606 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3497/7650] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:37:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:37:54.607246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9c50251a-5224-4e4b-a788-b56fe378e606 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:37:54.607892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9c50251a-5224-4e4b-a788-b56fe378e606 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:37:54.702724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9c50251a-5224-4e4b-a788-b56fe378e606 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:37:54.715368 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9c50251a-5224-4e4b-a788-b56fe378e606 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f" status: 200 len: 1267 microversion: 2.1 time: 0.112754 Oct 11 00:37:54.716665 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4154/7651] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:37:54 2022] GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f => generated 1267 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:37:55.739058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5319b047-b4be-45ec-871f-829ae52759d7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:37:55.739728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5319b047-b4be-45ec-871f-829ae52759d7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:37:55.746567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5319b047-b4be-45ec-871f-829ae52759d7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:55.747153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5319b047-b4be-45ec-871f-829ae52759d7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:55.747658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5319b047-b4be-45ec-871f-829ae52759d7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:55.748485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5319b047-b4be-45ec-871f-829ae52759d7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:55.749007 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5319b047-b4be-45ec-871f-829ae52759d7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:55.749552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5319b047-b4be-45ec-871f-829ae52759d7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:55.822406 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5319b047-b4be-45ec-871f-829ae52759d7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:37:55.835473 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5319b047-b4be-45ec-871f-829ae52759d7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f" status: 200 len: 1319 microversion: 2.1 time: 0.100861 Oct 11 00:37:55.838151 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3498/7652] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:37:55 2022] GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f => generated 1319 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:37:56.861631 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9519f8c8-c272-4804-b981-460e477eb1e1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:37:56.863171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9519f8c8-c272-4804-b981-460e477eb1e1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:37:56.883540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9519f8c8-c272-4804-b981-460e477eb1e1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:56.887972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9519f8c8-c272-4804-b981-460e477eb1e1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:56.890466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9519f8c8-c272-4804-b981-460e477eb1e1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:56.892588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9519f8c8-c272-4804-b981-460e477eb1e1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:56.893996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9519f8c8-c272-4804-b981-460e477eb1e1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:56.894600 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9519f8c8-c272-4804-b981-460e477eb1e1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:57.137638 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9519f8c8-c272-4804-b981-460e477eb1e1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:37:57.146513 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9519f8c8-c272-4804-b981-460e477eb1e1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f" status: 200 len: 1393 microversion: 2.1 time: 0.289421 Oct 11 00:37:57.147110 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4155/7653] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:37:56 2022] GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f => generated 1393 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:37:57.525178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-126c1deb-52d6-4bdc-baa0-df7e4fa28a53 req-d6daa613-4a82-4cb7-abbc-de440fd17406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0fb09cc-28ba-4a32-92e5-cf7570b5835f", "tag": "7a0f6431-5e88-479c-b4e3-27b07d412c27"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:37:57.537404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-126c1deb-52d6-4bdc-baa0-df7e4fa28a53 req-d6daa613-4a82-4cb7-abbc-de440fd17406 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:57.538098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-126c1deb-52d6-4bdc-baa0-df7e4fa28a53 req-d6daa613-4a82-4cb7-abbc-de440fd17406 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:57.538537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-126c1deb-52d6-4bdc-baa0-df7e4fa28a53 req-d6daa613-4a82-4cb7-abbc-de440fd17406 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:57.551034 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-126c1deb-52d6-4bdc-baa0-df7e4fa28a53 req-d6daa613-4a82-4cb7-abbc-de440fd17406 service nova] Creating event network-changed:7a0f6431-5e88-479c-b4e3-27b07d412c27 for instance f0fb09cc-28ba-4a32-92e5-cf7570b5835f on n-h1-860864-2 Oct 11 00:37:57.556223 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-126c1deb-52d6-4bdc-baa0-df7e4fa28a53 req-d6daa613-4a82-4cb7-abbc-de440fd17406 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035244 Oct 11 00:37:57.556808 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3499/7654] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:37:58.171578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-eeeb9229-536b-4530-8f76-af6cbb2da031 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:37:58.172265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-eeeb9229-536b-4530-8f76-af6cbb2da031 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:37:58.180322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eeeb9229-536b-4530-8f76-af6cbb2da031 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:58.180821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eeeb9229-536b-4530-8f76-af6cbb2da031 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:58.181273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eeeb9229-536b-4530-8f76-af6cbb2da031 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:58.182004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eeeb9229-536b-4530-8f76-af6cbb2da031 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:58.182471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eeeb9229-536b-4530-8f76-af6cbb2da031 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:58.182908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-eeeb9229-536b-4530-8f76-af6cbb2da031 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:58.322178 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-eeeb9229-536b-4530-8f76-af6cbb2da031 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:37:58.330082 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-eeeb9229-536b-4530-8f76-af6cbb2da031 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f" status: 200 len: 1393 microversion: 2.1 time: 0.162742 Oct 11 00:37:58.331034 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4156/7655] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:37:58 2022] GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:37:59.354035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-657a5b87-5165-4412-8ce2-856586ec9394 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:37:59.354734 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-657a5b87-5165-4412-8ce2-856586ec9394 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:37:59.361003 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-657a5b87-5165-4412-8ce2-856586ec9394 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:59.361663 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-657a5b87-5165-4412-8ce2-856586ec9394 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:59.362110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-657a5b87-5165-4412-8ce2-856586ec9394 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:59.362818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-657a5b87-5165-4412-8ce2-856586ec9394 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:37:59.363264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-657a5b87-5165-4412-8ce2-856586ec9394 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:37:59.363689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-657a5b87-5165-4412-8ce2-856586ec9394 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:37:59.502034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-657a5b87-5165-4412-8ce2-856586ec9394 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:37:59.510520 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-657a5b87-5165-4412-8ce2-856586ec9394 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f" status: 200 len: 1393 microversion: 2.1 time: 0.161675 Oct 11 00:37:59.511091 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3500/7656] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:37:59 2022] GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:38:00.533463 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-50b864cd-8667-4c49-963f-850f91c90952 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:38:00.535527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-50b864cd-8667-4c49-963f-850f91c90952 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:38:00.542772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50b864cd-8667-4c49-963f-850f91c90952 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:38:00.543264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50b864cd-8667-4c49-963f-850f91c90952 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:38:00.543717 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50b864cd-8667-4c49-963f-850f91c90952 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:38:00.544422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50b864cd-8667-4c49-963f-850f91c90952 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:38:00.544887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50b864cd-8667-4c49-963f-850f91c90952 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:38:00.545354 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50b864cd-8667-4c49-963f-850f91c90952 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:38:00.682311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-50b864cd-8667-4c49-963f-850f91c90952 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:38:00.691165 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-50b864cd-8667-4c49-963f-850f91c90952 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f" status: 200 len: 1393 microversion: 2.1 time: 0.160781 Oct 11 00:38:00.692215 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4157/7657] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:38:00 2022] GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:38:01.716169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9a65748d-0bf1-4388-ae8e-83034caaaae3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:38:01.716767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9a65748d-0bf1-4388-ae8e-83034caaaae3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:38:01.724760 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a65748d-0bf1-4388-ae8e-83034caaaae3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:38:01.725249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a65748d-0bf1-4388-ae8e-83034caaaae3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:38:01.725722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a65748d-0bf1-4388-ae8e-83034caaaae3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:38:01.726410 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a65748d-0bf1-4388-ae8e-83034caaaae3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:38:01.726870 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a65748d-0bf1-4388-ae8e-83034caaaae3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:38:01.727296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9a65748d-0bf1-4388-ae8e-83034caaaae3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:38:01.861350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-9a65748d-0bf1-4388-ae8e-83034caaaae3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:38:01.869340 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9a65748d-0bf1-4388-ae8e-83034caaaae3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f" status: 200 len: 1393 microversion: 2.1 time: 0.157224 Oct 11 00:38:01.869965 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3501/7658] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:38:01 2022] GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:38:02.481581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-076ee339-470b-466f-a7b2-5b7363e8a254 req-09eada5b-49f7-4875-b151-b33b08ccab60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fb09cc-28ba-4a32-92e5-cf7570b5835f", "name": "network-vif-plugged", "status": "completed", "tag": "7a0f6431-5e88-479c-b4e3-27b07d412c27"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:38:02.493259 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-076ee339-470b-466f-a7b2-5b7363e8a254 req-09eada5b-49f7-4875-b151-b33b08ccab60 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:38:02.493995 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-076ee339-470b-466f-a7b2-5b7363e8a254 req-09eada5b-49f7-4875-b151-b33b08ccab60 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:38:02.495248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-076ee339-470b-466f-a7b2-5b7363e8a254 req-09eada5b-49f7-4875-b151-b33b08ccab60 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:38:02.507893 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-076ee339-470b-466f-a7b2-5b7363e8a254 req-09eada5b-49f7-4875-b151-b33b08ccab60 service nova] Creating event network-vif-plugged:7a0f6431-5e88-479c-b4e3-27b07d412c27 for instance f0fb09cc-28ba-4a32-92e5-cf7570b5835f on n-h1-860864-2 Oct 11 00:38:02.513111 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-076ee339-470b-466f-a7b2-5b7363e8a254 req-09eada5b-49f7-4875-b151-b33b08ccab60 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035464 Oct 11 00:38:02.513763 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4158/7659] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:38:02.892215 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-64264c8a-4648-4ab9-8cdf-e8255b1f7c4f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:38:02.892756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-64264c8a-4648-4ab9-8cdf-e8255b1f7c4f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:38:02.900696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64264c8a-4648-4ab9-8cdf-e8255b1f7c4f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:38:02.901182 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64264c8a-4648-4ab9-8cdf-e8255b1f7c4f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:38:02.901658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64264c8a-4648-4ab9-8cdf-e8255b1f7c4f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:38:02.902398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64264c8a-4648-4ab9-8cdf-e8255b1f7c4f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:38:02.902818 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64264c8a-4648-4ab9-8cdf-e8255b1f7c4f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:38:02.903245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-64264c8a-4648-4ab9-8cdf-e8255b1f7c4f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:38:03.036450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-64264c8a-4648-4ab9-8cdf-e8255b1f7c4f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:38:03.044188 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-64264c8a-4648-4ab9-8cdf-e8255b1f7c4f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f" status: 200 len: 1393 microversion: 2.1 time: 0.156003 Oct 11 00:38:03.044774 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3502/7660] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:38:02 2022] GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:38:04.070459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9ea33a36-080c-4bc2-8897-411bc309cccd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:38:04.071093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9ea33a36-080c-4bc2-8897-411bc309cccd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:38:04.077491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ea33a36-080c-4bc2-8897-411bc309cccd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:38:04.078001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ea33a36-080c-4bc2-8897-411bc309cccd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:38:04.078459 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ea33a36-080c-4bc2-8897-411bc309cccd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:38:04.079181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ea33a36-080c-4bc2-8897-411bc309cccd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:38:04.079655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ea33a36-080c-4bc2-8897-411bc309cccd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:38:04.080099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9ea33a36-080c-4bc2-8897-411bc309cccd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:38:04.218831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9ea33a36-080c-4bc2-8897-411bc309cccd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:38:04.227537 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9ea33a36-080c-4bc2-8897-411bc309cccd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f" status: 200 len: 1565 microversion: 2.1 time: 0.163076 Oct 11 00:38:04.228136 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4159/7661] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:38:04 2022] GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:38:04.250278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d0e8b91f-214e-47ba-9b4b-4c7fb05b5124 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:38:04.250893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d0e8b91f-214e-47ba-9b4b-4c7fb05b5124 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:38:04.258628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0e8b91f-214e-47ba-9b4b-4c7fb05b5124 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:38:04.259125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0e8b91f-214e-47ba-9b4b-4c7fb05b5124 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:38:04.259566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0e8b91f-214e-47ba-9b4b-4c7fb05b5124 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:38:04.260265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0e8b91f-214e-47ba-9b4b-4c7fb05b5124 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:38:04.260720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0e8b91f-214e-47ba-9b4b-4c7fb05b5124 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:38:04.261147 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d0e8b91f-214e-47ba-9b4b-4c7fb05b5124 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:38:04.396137 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d0e8b91f-214e-47ba-9b4b-4c7fb05b5124 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:38:04.403928 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d0e8b91f-214e-47ba-9b4b-4c7fb05b5124 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f" status: 200 len: 1565 microversion: 2.1 time: 0.157556 Oct 11 00:38:04.404503 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3503/7662] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:38:04 2022] GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:38:06.324018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-37bec500-b8b3-4e31-ac3d-3ea35203df6b req-bce20af5-b911-4764-928f-af1a28108490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0fb09cc-28ba-4a32-92e5-cf7570b5835f", "tag": "7a0f6431-5e88-479c-b4e3-27b07d412c27"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:38:06.327820 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4aab75c5-e248-43f1-8647-12eeb4fb0bd6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:38:06.334037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4aab75c5-e248-43f1-8647-12eeb4fb0bd6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:38:06.336206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:38:06.339488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:38:06.340301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:38:06.352276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4aab75c5-e248-43f1-8647-12eeb4fb0bd6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:38:06.352849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4aab75c5-e248-43f1-8647-12eeb4fb0bd6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:38:06.353319 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4aab75c5-e248-43f1-8647-12eeb4fb0bd6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:38:06.354268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4aab75c5-e248-43f1-8647-12eeb4fb0bd6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:38:06.354752 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4aab75c5-e248-43f1-8647-12eeb4fb0bd6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:38:06.354879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-37bec500-b8b3-4e31-ac3d-3ea35203df6b req-bce20af5-b911-4764-928f-af1a28108490 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:38:06.355206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4aab75c5-e248-43f1-8647-12eeb4fb0bd6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:38:06.355334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-37bec500-b8b3-4e31-ac3d-3ea35203df6b req-bce20af5-b911-4764-928f-af1a28108490 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:38:06.355871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-37bec500-b8b3-4e31-ac3d-3ea35203df6b req-bce20af5-b911-4764-928f-af1a28108490 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:38:06.370303 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-37bec500-b8b3-4e31-ac3d-3ea35203df6b req-bce20af5-b911-4764-928f-af1a28108490 service nova] Creating event network-changed:7a0f6431-5e88-479c-b4e3-27b07d412c27 for instance f0fb09cc-28ba-4a32-92e5-cf7570b5835f on n-h1-860864-2 Oct 11 00:38:06.376710 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-37bec500-b8b3-4e31-ac3d-3ea35203df6b req-bce20af5-b911-4764-928f-af1a28108490 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055975 Oct 11 00:38:06.377961 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3504/7663] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:38:06.591197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4aab75c5-e248-43f1-8647-12eeb4fb0bd6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:38:06.602837 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4aab75c5-e248-43f1-8647-12eeb4fb0bd6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f" status: 200 len: 1565 microversion: 2.1 time: 0.285013 Oct 11 00:38:06.603733 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4160/7664] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:38:06 2022] GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f => generated 1565 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:38:39.916733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0d0e16a8-d303-4049-bc6f-dd5c379f85ed tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:38:39.919077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0d0e16a8-d303-4049-bc6f-dd5c379f85ed tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:38:39.921078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:38:39.921994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=36 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:38:39.927873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d0e16a8-d303-4049-bc6f-dd5c379f85ed tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:38:39.928400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d0e16a8-d303-4049-bc6f-dd5c379f85ed tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:38:39.928839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d0e16a8-d303-4049-bc6f-dd5c379f85ed tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:38:39.929576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d0e16a8-d303-4049-bc6f-dd5c379f85ed tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:38:39.930039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d0e16a8-d303-4049-bc6f-dd5c379f85ed tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:38:39.930468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0d0e16a8-d303-4049-bc6f-dd5c379f85ed tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:38:39.987217 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0d0e16a8-d303-4049-bc6f-dd5c379f85ed tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f/action" status: 200 len: 24570 microversion: 2.1 time: 0.074823 Oct 11 00:38:39.987903 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3505/7665] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:38:39 2022] POST /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f/action => generated 24570 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 00:39:10.393981 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:39:10.394808 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=32 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:39:10.402666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b4d0b1fe-3d27-4343-b499-589e2c52ade9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:39:10.403515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b4d0b1fe-3d27-4343-b499-589e2c52ade9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:10.410900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4d0b1fe-3d27-4343-b499-589e2c52ade9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:10.411425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4d0b1fe-3d27-4343-b499-589e2c52ade9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:10.411888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4d0b1fe-3d27-4343-b499-589e2c52ade9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:10.413171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4d0b1fe-3d27-4343-b499-589e2c52ade9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:10.413681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4d0b1fe-3d27-4343-b499-589e2c52ade9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:10.414124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b4d0b1fe-3d27-4343-b499-589e2c52ade9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:10.481308 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b4d0b1fe-3d27-4343-b499-589e2c52ade9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f/action" status: 202 len: 0 microversion: 2.1 time: 0.088909 Oct 11 00:39:10.485008 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4161/7666] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:39:10 2022] POST /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:39:10.491068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c1cddcb3-d47f-4bc5-aea2-0957e1a773a9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:39:10.491779 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c1cddcb3-d47f-4bc5-aea2-0957e1a773a9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:10.496677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:39:10.496677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:39:10.503800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1cddcb3-d47f-4bc5-aea2-0957e1a773a9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:10.504374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1cddcb3-d47f-4bc5-aea2-0957e1a773a9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:10.504951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1cddcb3-d47f-4bc5-aea2-0957e1a773a9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:10.506242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1cddcb3-d47f-4bc5-aea2-0957e1a773a9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:10.506685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1cddcb3-d47f-4bc5-aea2-0957e1a773a9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:10.507112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c1cddcb3-d47f-4bc5-aea2-0957e1a773a9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:10.646348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c1cddcb3-d47f-4bc5-aea2-0957e1a773a9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:39:10.655409 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c1cddcb3-d47f-4bc5-aea2-0957e1a773a9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f" status: 200 len: 1689 microversion: 2.1 time: 0.168823 Oct 11 00:39:10.656225 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3506/7667] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:39:10 2022] GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:39:11.683360 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c8e4e6cb-7d52-42de-a2b0-4efe404ddd05 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:39:11.684108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c8e4e6cb-7d52-42de-a2b0-4efe404ddd05 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:11.690899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8e4e6cb-7d52-42de-a2b0-4efe404ddd05 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:11.691426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8e4e6cb-7d52-42de-a2b0-4efe404ddd05 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:11.691864 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8e4e6cb-7d52-42de-a2b0-4efe404ddd05 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:11.692584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8e4e6cb-7d52-42de-a2b0-4efe404ddd05 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:11.693056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8e4e6cb-7d52-42de-a2b0-4efe404ddd05 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:11.694089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c8e4e6cb-7d52-42de-a2b0-4efe404ddd05 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:11.830694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c8e4e6cb-7d52-42de-a2b0-4efe404ddd05 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:39:11.839257 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c8e4e6cb-7d52-42de-a2b0-4efe404ddd05 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f" status: 200 len: 1669 microversion: 2.1 time: 0.161355 Oct 11 00:39:11.839820 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4162/7668] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:39:11 2022] GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:39:12.939201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6f8a59db-8465-4cc5-819e-3a1f0f300f9a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:39:12.941434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6f8a59db-8465-4cc5-819e-3a1f0f300f9a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:12.949411 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f8a59db-8465-4cc5-819e-3a1f0f300f9a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:12.949905 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f8a59db-8465-4cc5-819e-3a1f0f300f9a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:12.950351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f8a59db-8465-4cc5-819e-3a1f0f300f9a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:12.951048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f8a59db-8465-4cc5-819e-3a1f0f300f9a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:12.951510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f8a59db-8465-4cc5-819e-3a1f0f300f9a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:12.951942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f8a59db-8465-4cc5-819e-3a1f0f300f9a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:13.004839 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6f8a59db-8465-4cc5-819e-3a1f0f300f9a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f/action" status: 200 len: 32646 microversion: 2.1 time: 0.069937 Oct 11 00:39:13.005542 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3507/7669] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:39:12 2022] POST /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f/action => generated 32646 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 00:39:13.017398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-46496374-ec62-4cc1-922d-253572f04f5b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:39:13.017963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-46496374-ec62-4cc1-922d-253572f04f5b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:13.025989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46496374-ec62-4cc1-922d-253572f04f5b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:13.026481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46496374-ec62-4cc1-922d-253572f04f5b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:13.026930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46496374-ec62-4cc1-922d-253572f04f5b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:13.027661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46496374-ec62-4cc1-922d-253572f04f5b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:13.028129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46496374-ec62-4cc1-922d-253572f04f5b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:13.028593 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-46496374-ec62-4cc1-922d-253572f04f5b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:13.104723 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-46496374-ec62-4cc1-922d-253572f04f5b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f/action" status: 202 len: 0 microversion: 2.1 time: 0.090867 Oct 11 00:39:13.105481 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4163/7670] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:39:13 2022] POST /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:39:13.114501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2784fd64-bad4-4c30-841b-6105d9d49cf7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:39:13.115274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2784fd64-bad4-4c30-841b-6105d9d49cf7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:13.123428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2784fd64-bad4-4c30-841b-6105d9d49cf7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:13.123899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2784fd64-bad4-4c30-841b-6105d9d49cf7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:13.124321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2784fd64-bad4-4c30-841b-6105d9d49cf7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:13.125047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2784fd64-bad4-4c30-841b-6105d9d49cf7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:13.126323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2784fd64-bad4-4c30-841b-6105d9d49cf7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:13.126323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2784fd64-bad4-4c30-841b-6105d9d49cf7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:13.270259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2784fd64-bad4-4c30-841b-6105d9d49cf7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:39:13.279845 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2784fd64-bad4-4c30-841b-6105d9d49cf7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f" status: 200 len: 1676 microversion: 2.1 time: 0.169828 Oct 11 00:39:13.280988 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3508/7671] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:39:13 2022] GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:39:14.308730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-61861619-d49f-4589-be86-58e9973646a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:39:14.309484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-61861619-d49f-4589-be86-58e9973646a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:14.316341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61861619-d49f-4589-be86-58e9973646a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:14.316842 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61861619-d49f-4589-be86-58e9973646a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:14.317301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61861619-d49f-4589-be86-58e9973646a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:14.318099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61861619-d49f-4589-be86-58e9973646a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:14.318536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61861619-d49f-4589-be86-58e9973646a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:14.318990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61861619-d49f-4589-be86-58e9973646a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:14.456865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-61861619-d49f-4589-be86-58e9973646a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:39:14.465360 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-61861619-d49f-4589-be86-58e9973646a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f" status: 200 len: 1684 microversion: 2.1 time: 0.162696 Oct 11 00:39:14.465955 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4164/7672] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:39:14 2022] GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:39:14.562708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ea28a744-b432-4924-a318-fd7842a0f51c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:39:14.564825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ea28a744-b432-4924-a318-fd7842a0f51c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:14.572436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea28a744-b432-4924-a318-fd7842a0f51c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:14.572923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea28a744-b432-4924-a318-fd7842a0f51c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:14.573360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea28a744-b432-4924-a318-fd7842a0f51c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:14.574068 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea28a744-b432-4924-a318-fd7842a0f51c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:14.574522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea28a744-b432-4924-a318-fd7842a0f51c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:14.575130 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ea28a744-b432-4924-a318-fd7842a0f51c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:14.627789 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ea28a744-b432-4924-a318-fd7842a0f51c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f/action" status: 200 len: 37177 microversion: 2.1 time: 0.069217 Oct 11 00:39:14.628450 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3509/7673] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:39:14 2022] POST /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f/action => generated 37177 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 00:39:15.633542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3c3154d1-8caa-4cb6-9bbc-d2db81a94cc9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:39:15.634062 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3c3154d1-8caa-4cb6-9bbc-d2db81a94cc9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:15.641766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c3154d1-8caa-4cb6-9bbc-d2db81a94cc9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:15.642487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c3154d1-8caa-4cb6-9bbc-d2db81a94cc9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:15.642949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c3154d1-8caa-4cb6-9bbc-d2db81a94cc9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:15.643672 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c3154d1-8caa-4cb6-9bbc-d2db81a94cc9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:15.644141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c3154d1-8caa-4cb6-9bbc-d2db81a94cc9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:15.644774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c3154d1-8caa-4cb6-9bbc-d2db81a94cc9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:15.674566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3c3154d1-8caa-4cb6-9bbc-d2db81a94cc9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:39:15.701648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-f3988f41-1787-49a0-a17f-3d3c9955b6dc req-16c61c7c-f405-4be8-bb8a-a9f720ffa764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0fb09cc-28ba-4a32-92e5-cf7570b5835f", "tag": "7a0f6431-5e88-479c-b4e3-27b07d412c27"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:39:15.715794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f3988f41-1787-49a0-a17f-3d3c9955b6dc req-16c61c7c-f405-4be8-bb8a-a9f720ffa764 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:15.716296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f3988f41-1787-49a0-a17f-3d3c9955b6dc req-16c61c7c-f405-4be8-bb8a-a9f720ffa764 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:15.716720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f3988f41-1787-49a0-a17f-3d3c9955b6dc req-16c61c7c-f405-4be8-bb8a-a9f720ffa764 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:15.728921 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-f3988f41-1787-49a0-a17f-3d3c9955b6dc req-16c61c7c-f405-4be8-bb8a-a9f720ffa764 service nova] Creating event network-changed:7a0f6431-5e88-479c-b4e3-27b07d412c27 for instance f0fb09cc-28ba-4a32-92e5-cf7570b5835f on n-h1-860864-2 Oct 11 00:39:15.734470 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-f3988f41-1787-49a0-a17f-3d3c9955b6dc req-16c61c7c-f405-4be8-bb8a-a9f720ffa764 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101039 Oct 11 00:39:15.735402 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3510/7674] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:39:15.773408 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3c3154d1-8caa-4cb6-9bbc-d2db81a94cc9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f" status: 204 len: 0 microversion: 2.1 time: 0.143314 Oct 11 00:39:15.774382 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4165/7675] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:39:15 2022] DELETE /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:39:15.783628 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ba1af3f4-1f77-4d35-b9c6-f4669c53c1ae tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:39:15.784345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ba1af3f4-1f77-4d35-b9c6-f4669c53c1ae tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:15.791023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba1af3f4-1f77-4d35-b9c6-f4669c53c1ae tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:15.791519 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba1af3f4-1f77-4d35-b9c6-f4669c53c1ae tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:15.792039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba1af3f4-1f77-4d35-b9c6-f4669c53c1ae tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:15.792755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba1af3f4-1f77-4d35-b9c6-f4669c53c1ae tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:15.793531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba1af3f4-1f77-4d35-b9c6-f4669c53c1ae tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:15.794422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ba1af3f4-1f77-4d35-b9c6-f4669c53c1ae tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:15.951591 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ba1af3f4-1f77-4d35-b9c6-f4669c53c1ae tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:39:15.960969 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ba1af3f4-1f77-4d35-b9c6-f4669c53c1ae tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f" status: 200 len: 1690 microversion: 2.1 time: 0.182079 Oct 11 00:39:15.961744 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3511/7676] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:39:15 2022] GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f => generated 1690 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:39:16.985508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e55d1e52-08ec-4bfa-a8b0-58f70b28dd93 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:39:16.986227 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e55d1e52-08ec-4bfa-a8b0-58f70b28dd93 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:16.993790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e55d1e52-08ec-4bfa-a8b0-58f70b28dd93 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:16.994306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e55d1e52-08ec-4bfa-a8b0-58f70b28dd93 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:16.994768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e55d1e52-08ec-4bfa-a8b0-58f70b28dd93 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:16.995527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e55d1e52-08ec-4bfa-a8b0-58f70b28dd93 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:16.996004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e55d1e52-08ec-4bfa-a8b0-58f70b28dd93 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:16.996450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e55d1e52-08ec-4bfa-a8b0-58f70b28dd93 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:17.220862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e55d1e52-08ec-4bfa-a8b0-58f70b28dd93 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:39:17.229177 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e55d1e52-08ec-4bfa-a8b0-58f70b28dd93 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f" status: 200 len: 1690 microversion: 2.1 time: 0.248015 Oct 11 00:39:17.229792 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4166/7677] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:39:16 2022] GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f => generated 1690 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:39:17.926246 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-ad3f498f-c78a-4470-aa4d-55adba386a34 req-55c7cbc5-93bc-4f89-ac47-b10d572afbd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fb09cc-28ba-4a32-92e5-cf7570b5835f", "name": "network-vif-deleted", "tag": "7a0f6431-5e88-479c-b4e3-27b07d412c27"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:39:17.940344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ad3f498f-c78a-4470-aa4d-55adba386a34 req-55c7cbc5-93bc-4f89-ac47-b10d572afbd0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:17.940820 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ad3f498f-c78a-4470-aa4d-55adba386a34 req-55c7cbc5-93bc-4f89-ac47-b10d572afbd0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:17.941249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ad3f498f-c78a-4470-aa4d-55adba386a34 req-55c7cbc5-93bc-4f89-ac47-b10d572afbd0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:17.958267 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-ad3f498f-c78a-4470-aa4d-55adba386a34 req-55c7cbc5-93bc-4f89-ac47-b10d572afbd0 service nova] Creating event network-vif-deleted:7a0f6431-5e88-479c-b4e3-27b07d412c27 for instance f0fb09cc-28ba-4a32-92e5-cf7570b5835f on n-h1-860864-2 Oct 11 00:39:17.966433 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-ad3f498f-c78a-4470-aa4d-55adba386a34 req-55c7cbc5-93bc-4f89-ac47-b10d572afbd0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044482 Oct 11 00:39:17.967123 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3512/7678] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:39:18.256466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e979b2ff-3ca5-4f02-bf9e-a6838cd5db9f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:39:18.257300 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e979b2ff-3ca5-4f02-bf9e-a6838cd5db9f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:18.265111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e979b2ff-3ca5-4f02-bf9e-a6838cd5db9f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:18.266106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e979b2ff-3ca5-4f02-bf9e-a6838cd5db9f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:18.266965 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e979b2ff-3ca5-4f02-bf9e-a6838cd5db9f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:18.268110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e979b2ff-3ca5-4f02-bf9e-a6838cd5db9f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:18.268805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e979b2ff-3ca5-4f02-bf9e-a6838cd5db9f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:18.269314 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e979b2ff-3ca5-4f02-bf9e-a6838cd5db9f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:18.307703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e979b2ff-3ca5-4f02-bf9e-a6838cd5db9f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:18.308311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e979b2ff-3ca5-4f02-bf9e-a6838cd5db9f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:18.308772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e979b2ff-3ca5-4f02-bf9e-a6838cd5db9f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:18.309249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-e979b2ff-3ca5-4f02-bf9e-a6838cd5db9f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lazy-loading 'fault' on Instance uuid f0fb09cc-28ba-4a32-92e5-cf7570b5835f {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:39:18.357763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e979b2ff-3ca5-4f02-bf9e-a6838cd5db9f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:39:18.367996 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e979b2ff-3ca5-4f02-bf9e-a6838cd5db9f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f" status: 200 len: 1357 microversion: 2.1 time: 0.117560 Oct 11 00:39:18.368603 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4167/7679] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:39:18 2022] GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f => generated 1357 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:39:19.395866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1151b526-dd66-4076-b247-28319022658e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:39:19.396636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1151b526-dd66-4076-b247-28319022658e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: f0fb09cc-28ba-4a32-92e5-cf7570b5835f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:19.403000 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1151b526-dd66-4076-b247-28319022658e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:19.403489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1151b526-dd66-4076-b247-28319022658e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:19.403927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1151b526-dd66-4076-b247-28319022658e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:19.404623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1151b526-dd66-4076-b247-28319022658e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:19.405078 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1151b526-dd66-4076-b247-28319022658e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:19.405551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1151b526-dd66-4076-b247-28319022658e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:19.419842 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-1151b526-dd66-4076-b247-28319022658e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] HTTP exception thrown: Instance f0fb09cc-28ba-4a32-92e5-cf7570b5835f could not be found. Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1151b526-dd66-4076-b247-28319022658e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Request method failure captured: Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f HTTP/1.1 Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLrbIgsnFdcSLuDWSG0BXZJgQ-0aoLaqeEz8A0UaMKXZIvv_xdAg16W-tgk2ATxwWwXTsmkAKVRXeF_uFIvkXsNHX3CXRwU3FdonpA1rskUDVW9HI_SHIbYvWd9DxLNyTUfkF2HQNHtRL2_zgZlbWNH1devNuUVY45TC5ljRE7Bwb78 Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 60c10fdea561499c9f87fac524ca4113 Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-886185438 Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60c10fdea561499c9f87fac524ca4113"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60c10fdea561499c9f87fac524ca4113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60c10fdea561499c9f87fac524ca4113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60c10fdea561499c9f87fac524ca4113", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TestNetworkAdvancedServerOps-886185438 Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 60c10fdea561499c9f87fac524ca4113 Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-886185438 Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TestNetworkAdvancedServerOps-886185438-project Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 84c8a15123fb4b0292320555bceb3681 Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TestNetworkAdvancedServerOps-886185438-project Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance f0fb09cc-28ba-4a32-92e5-cf7570b5835f could not be found. Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': 'f0fb09cc-28ba-4a32-92e5-cf7570b5835f'} Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0fb09cc-28ba-4a32-92e5-cf7570b5835f could not be found. Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0fb09cc-28ba-4a32-92e5-cf7570b5835f could not be found. Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:39:19.421612 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:39:19.427046 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:39:19.427046 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:39:19.427046 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:39:19.427046 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:39:19.427046 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:39:19.427046 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:39:19.427046 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0fb09cc-28ba-4a32-92e5-cf7570b5835f could not be found. Oct 11 00:39:19.427046 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:39:19.427046 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1151b526-dd66-4076-b247-28319022658e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Returning 404 to user: Instance f0fb09cc-28ba-4a32-92e5-cf7570b5835f could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:39:19.427046 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1151b526-dd66-4076-b247-28319022658e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f" status: 404 len: 111 microversion: 2.1 time: 0.032406 Oct 11 00:39:19.427046 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3513/7680] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:39:19 2022] GET /compute/v2.1/servers/f0fb09cc-28ba-4a32-92e5-cf7570b5835f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:39:22.892040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-96dfcfe0-ba60-4ae0-a5d6-a8d524f240dc tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '.version_select at 0x7f662a516700>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:39:22.919118 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-96dfcfe0-ba60-4ae0-a5d6-a8d524f240dc tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1679557744" status: 202 len: 0 microversion: 2.1 time: 0.030725 Oct 11 00:39:22.919987 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4168/7681] 10.222.0.23 () {58 vars in 1284 bytes} [Tue Oct 11 00:39:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1679557744 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:39:22.945248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a7ea5c96-5cc7-434d-9d21-ade2041ebcbe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'create', calling method: .version_select at 0x7f662be999d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2128477277", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4iIiwHiZJKBS/PfM2hMyfPaM5phYFBgPnV30cKe4wQ+n+/3gXjzx4/SjOj3iFkr7zn/lRBuwVV7LKPAI5hSyiEcCPI9hYnpguWC+qi8KR4f5fMJ43siJF6yHnvtfGlaw=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:39:22.963287 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-a7ea5c96-5cc7-434d-9d21-ade2041ebcbe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Getting quotas for project 60c10fdea561499c9f87fac524ca4113. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:39:22.972747 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-a7ea5c96-5cc7-434d-9d21-ade2041ebcbe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Getting quotas for user 84c8a15123fb4b0292320555bceb3681 and project 60c10fdea561499c9f87fac524ca4113. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:39:22.998638 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a7ea5c96-5cc7-434d-9d21-ade2041ebcbe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057817 Oct 11 00:39:22.999288 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3514/7682] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 11 00:39:22 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:39:29.028691 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-960d3316-4cff-4628-9f99-50be5332b51d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2043010532", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "2233569b-9845-44cd-976f-e5a2c23731e9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2128477277", "security_groups": [{"name": "tempest-secgroup-smoke-1738761269"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:39:29.045306 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:39:29.045592 n-d-860864-2 devstack@n-api.service[120613]: Tue Oct 11 00:39:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Oct 11 00:39:29.048063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:39:29.191730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-960d3316-4cff-4628-9f99-50be5332b51d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] validate_networks() for [('2233569b-9845-44cd-976f-e5a2c23731e9', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:39:29.679521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-960d3316-4cff-4628-9f99-50be5332b51d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:39:29.679964 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-960d3316-4cff-4628-9f99-50be5332b51d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:39:29.680469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-960d3316-4cff-4628-9f99-50be5332b51d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:39:29.680925 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-960d3316-4cff-4628-9f99-50be5332b51d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:39:29.681364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-960d3316-4cff-4628-9f99-50be5332b51d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:39:29.690683 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-960d3316-4cff-4628-9f99-50be5332b51d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:29.691251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-960d3316-4cff-4628-9f99-50be5332b51d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:29.691708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-960d3316-4cff-4628-9f99-50be5332b51d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:29.693076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-960d3316-4cff-4628-9f99-50be5332b51d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:29.694020 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-960d3316-4cff-4628-9f99-50be5332b51d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:29.694217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-960d3316-4cff-4628-9f99-50be5332b51d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:29.717069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-960d3316-4cff-4628-9f99-50be5332b51d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Getting quotas for project 60c10fdea561499c9f87fac524ca4113. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:39:29.722581 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-960d3316-4cff-4628-9f99-50be5332b51d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Getting quotas for user 84c8a15123fb4b0292320555bceb3681 and project 60c10fdea561499c9f87fac524ca4113. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:39:29.735625 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-960d3316-4cff-4628-9f99-50be5332b51d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:39:29.737914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-960d3316-4cff-4628-9f99-50be5332b51d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:39:29.787243 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-960d3316-4cff-4628-9f99-50be5332b51d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.764700 Oct 11 00:39:29.794270 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4169/7683] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:39:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:39:29.797629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=32 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:39:29.802218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4f4735d0-98c5-44ab-a645-81f22bfaa220 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:39:29.803057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4f4735d0-98c5-44ab-a645-81f22bfaa220 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:29.885335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4f4735d0-98c5-44ab-a645-81f22bfaa220 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:39:29.893337 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4f4735d0-98c5-44ab-a645-81f22bfaa220 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1267 microversion: 2.1 time: 0.097337 Oct 11 00:39:29.894115 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3515/7684] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:39:29 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:39:30.920366 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d34e631d-bc08-4f19-9252-ad968a7c20f9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:39:30.921005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d34e631d-bc08-4f19-9252-ad968a7c20f9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:30.929971 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d34e631d-bc08-4f19-9252-ad968a7c20f9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:30.930639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d34e631d-bc08-4f19-9252-ad968a7c20f9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:30.931592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d34e631d-bc08-4f19-9252-ad968a7c20f9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:30.933033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d34e631d-bc08-4f19-9252-ad968a7c20f9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:30.933033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d34e631d-bc08-4f19-9252-ad968a7c20f9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:30.934448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d34e631d-bc08-4f19-9252-ad968a7c20f9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:31.069827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d34e631d-bc08-4f19-9252-ad968a7c20f9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:39:31.080857 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d34e631d-bc08-4f19-9252-ad968a7c20f9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1327 microversion: 2.1 time: 0.166231 Oct 11 00:39:31.082148 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4170/7685] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:39:30 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1327 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:39:32.108286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-752cee2e-909c-478c-bc3e-60678360ff45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:39:32.109367 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-752cee2e-909c-478c-bc3e-60678360ff45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:32.119245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-752cee2e-909c-478c-bc3e-60678360ff45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:32.119901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-752cee2e-909c-478c-bc3e-60678360ff45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:32.120598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-752cee2e-909c-478c-bc3e-60678360ff45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:32.121462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-752cee2e-909c-478c-bc3e-60678360ff45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:32.122002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-752cee2e-909c-478c-bc3e-60678360ff45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:32.122506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-752cee2e-909c-478c-bc3e-60678360ff45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:32.273091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-752cee2e-909c-478c-bc3e-60678360ff45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:39:32.282145 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-752cee2e-909c-478c-bc3e-60678360ff45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1393 microversion: 2.1 time: 0.178366 Oct 11 00:39:32.282743 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3516/7686] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:39:32 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1393 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:39:32.581917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-ec338f20-9d35-4ec9-9e08-1196d2aab3c3 req-c53cd9fa-86b0-4c3b-bbfe-9a4229a619d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41a3021d-8526-4bdf-b201-ed7a65b6742e", "tag": "e0553266-ea0b-4c88-9add-6582e8e10d1d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:39:32.596667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ec338f20-9d35-4ec9-9e08-1196d2aab3c3 req-c53cd9fa-86b0-4c3b-bbfe-9a4229a619d3 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:32.597505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ec338f20-9d35-4ec9-9e08-1196d2aab3c3 req-c53cd9fa-86b0-4c3b-bbfe-9a4229a619d3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:32.598248 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-ec338f20-9d35-4ec9-9e08-1196d2aab3c3 req-c53cd9fa-86b0-4c3b-bbfe-9a4229a619d3 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:32.612922 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-ec338f20-9d35-4ec9-9e08-1196d2aab3c3 req-c53cd9fa-86b0-4c3b-bbfe-9a4229a619d3 service nova] Creating event network-changed:e0553266-ea0b-4c88-9add-6582e8e10d1d for instance 41a3021d-8526-4bdf-b201-ed7a65b6742e on n-h1-860864-2 Oct 11 00:39:32.619274 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-ec338f20-9d35-4ec9-9e08-1196d2aab3c3 req-c53cd9fa-86b0-4c3b-bbfe-9a4229a619d3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040926 Oct 11 00:39:32.619903 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4171/7687] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:39:33.306546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4b447570-d6bb-456a-9d67-063067da2aa1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:39:33.307384 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4b447570-d6bb-456a-9d67-063067da2aa1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:33.314527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b447570-d6bb-456a-9d67-063067da2aa1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:33.315012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b447570-d6bb-456a-9d67-063067da2aa1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:33.315444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b447570-d6bb-456a-9d67-063067da2aa1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:33.316156 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b447570-d6bb-456a-9d67-063067da2aa1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:33.316615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b447570-d6bb-456a-9d67-063067da2aa1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:33.317035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4b447570-d6bb-456a-9d67-063067da2aa1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:33.452635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4b447570-d6bb-456a-9d67-063067da2aa1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:39:33.461212 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4b447570-d6bb-456a-9d67-063067da2aa1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1393 microversion: 2.1 time: 0.158573 Oct 11 00:39:33.461852 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3517/7688] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:39:33 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:39:34.485602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9546ff3a-b647-42f4-bd3d-749e0c8dbaa8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:39:34.486333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9546ff3a-b647-42f4-bd3d-749e0c8dbaa8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:34.493301 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9546ff3a-b647-42f4-bd3d-749e0c8dbaa8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:34.493833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9546ff3a-b647-42f4-bd3d-749e0c8dbaa8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:34.494289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9546ff3a-b647-42f4-bd3d-749e0c8dbaa8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:34.495011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9546ff3a-b647-42f4-bd3d-749e0c8dbaa8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:34.495482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9546ff3a-b647-42f4-bd3d-749e0c8dbaa8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:34.495928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9546ff3a-b647-42f4-bd3d-749e0c8dbaa8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:34.638774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9546ff3a-b647-42f4-bd3d-749e0c8dbaa8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:39:34.647924 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9546ff3a-b647-42f4-bd3d-749e0c8dbaa8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1393 microversion: 2.1 time: 0.167445 Oct 11 00:39:34.648514 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4172/7689] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:39:34 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:39:35.670513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0b688c8d-aed1-4664-9650-02bd2ec61f22 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:39:35.671145 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0b688c8d-aed1-4664-9650-02bd2ec61f22 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:35.679128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b688c8d-aed1-4664-9650-02bd2ec61f22 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:35.679614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b688c8d-aed1-4664-9650-02bd2ec61f22 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:35.680053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b688c8d-aed1-4664-9650-02bd2ec61f22 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:35.680927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b688c8d-aed1-4664-9650-02bd2ec61f22 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:35.681502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b688c8d-aed1-4664-9650-02bd2ec61f22 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:35.681931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0b688c8d-aed1-4664-9650-02bd2ec61f22 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:35.819839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0b688c8d-aed1-4664-9650-02bd2ec61f22 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:39:35.827976 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0b688c8d-aed1-4664-9650-02bd2ec61f22 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1393 microversion: 2.1 time: 0.161319 Oct 11 00:39:35.828559 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3518/7690] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:39:35 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:39:36.851791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c9b6be38-0e69-45c7-9504-a4cbaa0d8569 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:39:36.852601 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c9b6be38-0e69-45c7-9504-a4cbaa0d8569 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:36.859483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9b6be38-0e69-45c7-9504-a4cbaa0d8569 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:36.859988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9b6be38-0e69-45c7-9504-a4cbaa0d8569 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:36.860434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9b6be38-0e69-45c7-9504-a4cbaa0d8569 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:36.861148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9b6be38-0e69-45c7-9504-a4cbaa0d8569 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:36.861640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9b6be38-0e69-45c7-9504-a4cbaa0d8569 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:36.862105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c9b6be38-0e69-45c7-9504-a4cbaa0d8569 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:37.010093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c9b6be38-0e69-45c7-9504-a4cbaa0d8569 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:39:37.018251 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c9b6be38-0e69-45c7-9504-a4cbaa0d8569 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1393 microversion: 2.1 time: 0.171020 Oct 11 00:39:37.018844 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4173/7691] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:39:36 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:39:38.041210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-68844325-1075-4eba-bd5d-c766036a8052 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:39:38.041867 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-68844325-1075-4eba-bd5d-c766036a8052 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:38.048883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68844325-1075-4eba-bd5d-c766036a8052 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:38.049368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68844325-1075-4eba-bd5d-c766036a8052 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:38.049844 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68844325-1075-4eba-bd5d-c766036a8052 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:38.050544 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68844325-1075-4eba-bd5d-c766036a8052 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:38.051004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68844325-1075-4eba-bd5d-c766036a8052 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:38.051440 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68844325-1075-4eba-bd5d-c766036a8052 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:38.190177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-68844325-1075-4eba-bd5d-c766036a8052 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:39:38.198894 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-68844325-1075-4eba-bd5d-c766036a8052 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1393 microversion: 2.1 time: 0.161589 Oct 11 00:39:38.199484 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3519/7692] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:39:38 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:39:38.965847 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-737a924a-e3fa-496e-b762-999dc866e471 req-32403028-4dc9-4d8c-9c02-d82a718cd1ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41a3021d-8526-4bdf-b201-ed7a65b6742e", "name": "network-vif-plugged", "status": "completed", "tag": "e0553266-ea0b-4c88-9add-6582e8e10d1d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:39:38.980414 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-737a924a-e3fa-496e-b762-999dc866e471 req-32403028-4dc9-4d8c-9c02-d82a718cd1ef service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:38.980999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-737a924a-e3fa-496e-b762-999dc866e471 req-32403028-4dc9-4d8c-9c02-d82a718cd1ef service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:38.981485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-737a924a-e3fa-496e-b762-999dc866e471 req-32403028-4dc9-4d8c-9c02-d82a718cd1ef service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:38.994526 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-737a924a-e3fa-496e-b762-999dc866e471 req-32403028-4dc9-4d8c-9c02-d82a718cd1ef service nova] Creating event network-vif-plugged:e0553266-ea0b-4c88-9add-6582e8e10d1d for instance 41a3021d-8526-4bdf-b201-ed7a65b6742e on n-h1-860864-2 Oct 11 00:39:39.001090 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-737a924a-e3fa-496e-b762-999dc866e471 req-32403028-4dc9-4d8c-9c02-d82a718cd1ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038857 Oct 11 00:39:39.001782 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4174/7693] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:39:39.221956 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e43ac383-46d6-4939-8ea7-cebfd6919287 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:39:39.222586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e43ac383-46d6-4939-8ea7-cebfd6919287 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:39.230301 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e43ac383-46d6-4939-8ea7-cebfd6919287 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:39.230799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e43ac383-46d6-4939-8ea7-cebfd6919287 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:39.231248 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e43ac383-46d6-4939-8ea7-cebfd6919287 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:39.231962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e43ac383-46d6-4939-8ea7-cebfd6919287 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:39.232422 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e43ac383-46d6-4939-8ea7-cebfd6919287 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:39.232887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e43ac383-46d6-4939-8ea7-cebfd6919287 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:39.372727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e43ac383-46d6-4939-8ea7-cebfd6919287 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:39:39.380721 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e43ac383-46d6-4939-8ea7-cebfd6919287 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1393 microversion: 2.1 time: 0.162743 Oct 11 00:39:39.381343 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3520/7694] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:39:39 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:39:40.414483 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:39:40.415320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:39:40.421022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3c27fa3d-0c90-4df2-a117-0bc9019696f0 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:39:40.421787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3c27fa3d-0c90-4df2-a117-0bc9019696f0 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:40.424159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:39:40.431456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c27fa3d-0c90-4df2-a117-0bc9019696f0 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:40.431970 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c27fa3d-0c90-4df2-a117-0bc9019696f0 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:40.432427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c27fa3d-0c90-4df2-a117-0bc9019696f0 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:40.433156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c27fa3d-0c90-4df2-a117-0bc9019696f0 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:40.433657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c27fa3d-0c90-4df2-a117-0bc9019696f0 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:40.434111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3c27fa3d-0c90-4df2-a117-0bc9019696f0 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:40.574409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3c27fa3d-0c90-4df2-a117-0bc9019696f0 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:39:40.582475 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3c27fa3d-0c90-4df2-a117-0bc9019696f0 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1393 microversion: 2.1 time: 0.169698 Oct 11 00:39:40.583050 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4175/7695] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:39:40 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:39:41.606557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-77a87a90-aaf8-42f5-8223-edff056147ba tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:39:41.607380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-77a87a90-aaf8-42f5-8223-edff056147ba tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:41.609523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:39:41.611452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:39:41.618662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77a87a90-aaf8-42f5-8223-edff056147ba tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:41.619283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77a87a90-aaf8-42f5-8223-edff056147ba tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:41.619719 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77a87a90-aaf8-42f5-8223-edff056147ba tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:41.620542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77a87a90-aaf8-42f5-8223-edff056147ba tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:41.620995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77a87a90-aaf8-42f5-8223-edff056147ba tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:41.621443 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-77a87a90-aaf8-42f5-8223-edff056147ba tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:41.767005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-77a87a90-aaf8-42f5-8223-edff056147ba tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:39:41.775953 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-77a87a90-aaf8-42f5-8223-edff056147ba tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1564 microversion: 2.1 time: 0.173306 Oct 11 00:39:41.776548 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3521/7696] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:39:41 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:39:41.799431 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-4bef92f6-a258-4883-93d1-b3abd656e99b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:39:41.800063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-4bef92f6-a258-4883-93d1-b3abd656e99b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:41.807680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4bef92f6-a258-4883-93d1-b3abd656e99b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:41.808198 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4bef92f6-a258-4883-93d1-b3abd656e99b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:41.808653 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4bef92f6-a258-4883-93d1-b3abd656e99b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:41.809406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4bef92f6-a258-4883-93d1-b3abd656e99b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:41.809886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4bef92f6-a258-4883-93d1-b3abd656e99b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:41.810337 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-4bef92f6-a258-4883-93d1-b3abd656e99b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:41.949827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-4bef92f6-a258-4883-93d1-b3abd656e99b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:39:41.957787 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-4bef92f6-a258-4883-93d1-b3abd656e99b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1564 microversion: 2.1 time: 0.162365 Oct 11 00:39:41.958385 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4176/7697] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:39:41 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:39:43.891566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c312ec1f-1fa7-4791-958c-12f6d3ed8cc6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:39:43.897590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-52944965-e214-464d-bdfa-64242072f594 req-59c710ec-b257-4b70-91e3-932c63955326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41a3021d-8526-4bdf-b201-ed7a65b6742e", "tag": "e0553266-ea0b-4c88-9add-6582e8e10d1d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:39:43.904611 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c312ec1f-1fa7-4791-958c-12f6d3ed8cc6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:39:43.908017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-52944965-e214-464d-bdfa-64242072f594 req-59c710ec-b257-4b70-91e3-932c63955326 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:43.908525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-52944965-e214-464d-bdfa-64242072f594 req-59c710ec-b257-4b70-91e3-932c63955326 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:43.908973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-52944965-e214-464d-bdfa-64242072f594 req-59c710ec-b257-4b70-91e3-932c63955326 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:43.912177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c312ec1f-1fa7-4791-958c-12f6d3ed8cc6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:43.914316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c312ec1f-1fa7-4791-958c-12f6d3ed8cc6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:43.914864 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c312ec1f-1fa7-4791-958c-12f6d3ed8cc6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:43.915690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c312ec1f-1fa7-4791-958c-12f6d3ed8cc6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:39:43.916409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c312ec1f-1fa7-4791-958c-12f6d3ed8cc6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:39:43.917024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c312ec1f-1fa7-4791-958c-12f6d3ed8cc6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:39:43.921580 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-52944965-e214-464d-bdfa-64242072f594 req-59c710ec-b257-4b70-91e3-932c63955326 service nova] Creating event network-changed:e0553266-ea0b-4c88-9add-6582e8e10d1d for instance 41a3021d-8526-4bdf-b201-ed7a65b6742e on n-h1-860864-2 Oct 11 00:39:43.926950 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-52944965-e214-464d-bdfa-64242072f594 req-59c710ec-b257-4b70-91e3-932c63955326 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033649 Oct 11 00:39:43.927758 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4177/7698] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:39:44.069664 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c312ec1f-1fa7-4791-958c-12f6d3ed8cc6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:39:44.078302 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c312ec1f-1fa7-4791-958c-12f6d3ed8cc6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1564 microversion: 2.1 time: 0.190640 Oct 11 00:39:44.078899 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3522/7699] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:39:43 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1564 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:40:17.375870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=5 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:40:17.376630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=38 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:40:17.381025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7bf94eff-378c-40c2-8275-da9890dba8a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:40:17.383324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7bf94eff-378c-40c2-8275-da9890dba8a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:40:17.390956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bf94eff-378c-40c2-8275-da9890dba8a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:40:17.391458 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bf94eff-378c-40c2-8275-da9890dba8a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:40:17.391915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bf94eff-378c-40c2-8275-da9890dba8a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:40:17.392627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bf94eff-378c-40c2-8275-da9890dba8a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:40:17.393108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bf94eff-378c-40c2-8275-da9890dba8a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:40:17.393592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7bf94eff-378c-40c2-8275-da9890dba8a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:40:17.446515 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7bf94eff-378c-40c2-8275-da9890dba8a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e/action" status: 200 len: 24549 microversion: 2.1 time: 0.072659 Oct 11 00:40:17.448087 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4178/7700] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:40:17 2022] POST /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e/action => generated 24549 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 00:40:56.552666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:40:56.553448 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=42 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:40:56.558495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e3f45470-2581-4585-b3a8-0fc4e55a8c6e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:40:56.560983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e3f45470-2581-4585-b3a8-0fc4e55a8c6e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:40:56.567967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3f45470-2581-4585-b3a8-0fc4e55a8c6e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:40:56.568450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3f45470-2581-4585-b3a8-0fc4e55a8c6e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:40:56.568885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3f45470-2581-4585-b3a8-0fc4e55a8c6e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:40:56.569599 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3f45470-2581-4585-b3a8-0fc4e55a8c6e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:40:56.570051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3f45470-2581-4585-b3a8-0fc4e55a8c6e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:40:56.570478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e3f45470-2581-4585-b3a8-0fc4e55a8c6e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:40:56.643540 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e3f45470-2581-4585-b3a8-0fc4e55a8c6e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e/action" status: 202 len: 0 microversion: 2.1 time: 0.092588 Oct 11 00:40:56.644198 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3523/7701] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:40:56 2022] POST /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:40:56.653256 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a29fcaa9-9d74-4264-836f-ccfbd83de3ee tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:40:56.654686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a29fcaa9-9d74-4264-836f-ccfbd83de3ee tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:40:56.657246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:40:56.657941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:40:56.663774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a29fcaa9-9d74-4264-836f-ccfbd83de3ee tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:40:56.664282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a29fcaa9-9d74-4264-836f-ccfbd83de3ee tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:40:56.664740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a29fcaa9-9d74-4264-836f-ccfbd83de3ee tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:40:56.665610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a29fcaa9-9d74-4264-836f-ccfbd83de3ee tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:40:56.666084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a29fcaa9-9d74-4264-836f-ccfbd83de3ee tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:40:56.666561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a29fcaa9-9d74-4264-836f-ccfbd83de3ee tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:40:56.812251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a29fcaa9-9d74-4264-836f-ccfbd83de3ee tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:40:56.822224 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a29fcaa9-9d74-4264-836f-ccfbd83de3ee tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1675 microversion: 2.1 time: 0.172960 Oct 11 00:40:56.826566 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4179/7702] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:40:56 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:40:57.848881 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fbff8f87-5bdd-4bb9-a4dd-a7f35018fa9d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:40:57.849626 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fbff8f87-5bdd-4bb9-a4dd-a7f35018fa9d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:40:57.855906 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbff8f87-5bdd-4bb9-a4dd-a7f35018fa9d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:40:57.856394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbff8f87-5bdd-4bb9-a4dd-a7f35018fa9d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:40:57.856872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbff8f87-5bdd-4bb9-a4dd-a7f35018fa9d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:40:57.858185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbff8f87-5bdd-4bb9-a4dd-a7f35018fa9d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:40:57.858649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbff8f87-5bdd-4bb9-a4dd-a7f35018fa9d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:40:57.859079 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fbff8f87-5bdd-4bb9-a4dd-a7f35018fa9d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:40:57.991648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fbff8f87-5bdd-4bb9-a4dd-a7f35018fa9d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:40:57.999514 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fbff8f87-5bdd-4bb9-a4dd-a7f35018fa9d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1680 microversion: 2.1 time: 0.155959 Oct 11 00:40:58.000086 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3524/7703] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:40:57 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:40:59.024335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-294866b6-d397-405c-bff2-8d4593da925e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:40:59.024969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-294866b6-d397-405c-bff2-8d4593da925e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:40:59.031268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-294866b6-d397-405c-bff2-8d4593da925e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:40:59.031766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-294866b6-d397-405c-bff2-8d4593da925e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:40:59.032217 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-294866b6-d397-405c-bff2-8d4593da925e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:40:59.032922 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-294866b6-d397-405c-bff2-8d4593da925e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:40:59.033406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-294866b6-d397-405c-bff2-8d4593da925e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:40:59.033849 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-294866b6-d397-405c-bff2-8d4593da925e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:40:59.168237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-294866b6-d397-405c-bff2-8d4593da925e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:40:59.176750 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-294866b6-d397-405c-bff2-8d4593da925e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1680 microversion: 2.1 time: 0.156770 Oct 11 00:40:59.177328 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4180/7704] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:40:59 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:41:00.200358 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cf7143d5-cb29-4063-942b-c3e26471ba86 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:41:00.201994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cf7143d5-cb29-4063-942b-c3e26471ba86 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:41:00.208718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf7143d5-cb29-4063-942b-c3e26471ba86 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:00.209204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf7143d5-cb29-4063-942b-c3e26471ba86 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:00.209665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf7143d5-cb29-4063-942b-c3e26471ba86 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:00.210347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf7143d5-cb29-4063-942b-c3e26471ba86 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:00.210797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf7143d5-cb29-4063-942b-c3e26471ba86 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:00.211221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cf7143d5-cb29-4063-942b-c3e26471ba86 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:00.342047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cf7143d5-cb29-4063-942b-c3e26471ba86 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:41:00.349807 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cf7143d5-cb29-4063-942b-c3e26471ba86 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1680 microversion: 2.1 time: 0.153450 Oct 11 00:41:00.350409 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3525/7705] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:41:00 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:41:01.374888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-18cd4fde-e3d4-4ca7-9158-a34b8cedf55f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:41:01.375512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-18cd4fde-e3d4-4ca7-9158-a34b8cedf55f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:41:01.382361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18cd4fde-e3d4-4ca7-9158-a34b8cedf55f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:01.382868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18cd4fde-e3d4-4ca7-9158-a34b8cedf55f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:01.383343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18cd4fde-e3d4-4ca7-9158-a34b8cedf55f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:01.384152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18cd4fde-e3d4-4ca7-9158-a34b8cedf55f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:01.384622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18cd4fde-e3d4-4ca7-9158-a34b8cedf55f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:01.385064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18cd4fde-e3d4-4ca7-9158-a34b8cedf55f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:01.517245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-18cd4fde-e3d4-4ca7-9158-a34b8cedf55f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:41:01.525127 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-18cd4fde-e3d4-4ca7-9158-a34b8cedf55f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1680 microversion: 2.1 time: 0.155393 Oct 11 00:41:01.525729 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4181/7706] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:41:01 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:41:02.549364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4151fbba-2a50-4d68-a91f-128da8c0e2ce tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:41:02.550004 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4151fbba-2a50-4d68-a91f-128da8c0e2ce tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:41:02.557018 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4151fbba-2a50-4d68-a91f-128da8c0e2ce tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:02.557551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4151fbba-2a50-4d68-a91f-128da8c0e2ce tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:02.558005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4151fbba-2a50-4d68-a91f-128da8c0e2ce tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:02.558704 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4151fbba-2a50-4d68-a91f-128da8c0e2ce tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:02.559164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4151fbba-2a50-4d68-a91f-128da8c0e2ce tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:02.559597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4151fbba-2a50-4d68-a91f-128da8c0e2ce tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:02.699161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4151fbba-2a50-4d68-a91f-128da8c0e2ce tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:41:02.707277 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4151fbba-2a50-4d68-a91f-128da8c0e2ce tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1680 microversion: 2.1 time: 0.161896 Oct 11 00:41:02.707860 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3526/7707] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:41:02 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:41:03.731144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-579b438d-2da0-46b5-be23-4ac2b3f09210 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:41:03.733273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-579b438d-2da0-46b5-be23-4ac2b3f09210 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:41:03.743803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-579b438d-2da0-46b5-be23-4ac2b3f09210 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:03.744352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-579b438d-2da0-46b5-be23-4ac2b3f09210 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:03.744814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-579b438d-2da0-46b5-be23-4ac2b3f09210 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:03.745574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-579b438d-2da0-46b5-be23-4ac2b3f09210 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:03.746053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-579b438d-2da0-46b5-be23-4ac2b3f09210 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:03.746495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-579b438d-2da0-46b5-be23-4ac2b3f09210 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:03.947491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-579b438d-2da0-46b5-be23-4ac2b3f09210 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:41:03.955816 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-579b438d-2da0-46b5-be23-4ac2b3f09210 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1680 microversion: 2.1 time: 0.229037 Oct 11 00:41:03.956394 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4182/7708] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:41:03 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1680 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:41:04.979527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a5b6d846-0350-4356-9b65-dfeae71b6d73 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:41:04.980144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a5b6d846-0350-4356-9b65-dfeae71b6d73 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:41:04.987570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5b6d846-0350-4356-9b65-dfeae71b6d73 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:04.988053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5b6d846-0350-4356-9b65-dfeae71b6d73 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:04.988489 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5b6d846-0350-4356-9b65-dfeae71b6d73 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:04.989188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5b6d846-0350-4356-9b65-dfeae71b6d73 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:04.989668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5b6d846-0350-4356-9b65-dfeae71b6d73 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:04.990096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5b6d846-0350-4356-9b65-dfeae71b6d73 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:05.128396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a5b6d846-0350-4356-9b65-dfeae71b6d73 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:41:05.136363 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a5b6d846-0350-4356-9b65-dfeae71b6d73 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1680 microversion: 2.1 time: 0.160735 Oct 11 00:41:05.136939 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3527/7709] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:41:04 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:41:06.160860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-bb593fab-5dbf-4e2b-924b-5054c4489e7f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:41:06.162163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-bb593fab-5dbf-4e2b-924b-5054c4489e7f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:41:06.171137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb593fab-5dbf-4e2b-924b-5054c4489e7f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:06.171785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb593fab-5dbf-4e2b-924b-5054c4489e7f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:06.172236 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb593fab-5dbf-4e2b-924b-5054c4489e7f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:06.172966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb593fab-5dbf-4e2b-924b-5054c4489e7f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:06.173704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb593fab-5dbf-4e2b-924b-5054c4489e7f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:06.174500 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-bb593fab-5dbf-4e2b-924b-5054c4489e7f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:06.321975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-bb593fab-5dbf-4e2b-924b-5054c4489e7f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:41:06.330710 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-bb593fab-5dbf-4e2b-924b-5054c4489e7f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1680 microversion: 2.1 time: 0.173874 Oct 11 00:41:06.331294 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4183/7710] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:41:06 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:41:07.354669 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c807848e-0a99-4faf-a4b8-9217f92f34a6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:41:07.355282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c807848e-0a99-4faf-a4b8-9217f92f34a6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:41:07.362964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c807848e-0a99-4faf-a4b8-9217f92f34a6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:07.363454 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c807848e-0a99-4faf-a4b8-9217f92f34a6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:07.363893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c807848e-0a99-4faf-a4b8-9217f92f34a6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:07.364585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c807848e-0a99-4faf-a4b8-9217f92f34a6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:07.365040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c807848e-0a99-4faf-a4b8-9217f92f34a6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:07.365492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c807848e-0a99-4faf-a4b8-9217f92f34a6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:07.495751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c807848e-0a99-4faf-a4b8-9217f92f34a6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:41:07.503954 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c807848e-0a99-4faf-a4b8-9217f92f34a6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1680 microversion: 2.1 time: 0.153223 Oct 11 00:41:07.504543 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3528/7711] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:41:07 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:41:08.527867 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-09484c9d-954a-49fa-ae06-32b30391315d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:41:08.528507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-09484c9d-954a-49fa-ae06-32b30391315d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:41:08.536058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09484c9d-954a-49fa-ae06-32b30391315d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:08.536566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09484c9d-954a-49fa-ae06-32b30391315d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:08.537024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09484c9d-954a-49fa-ae06-32b30391315d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:08.537774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09484c9d-954a-49fa-ae06-32b30391315d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:08.538251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09484c9d-954a-49fa-ae06-32b30391315d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:08.538698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-09484c9d-954a-49fa-ae06-32b30391315d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:08.679028 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-09484c9d-954a-49fa-ae06-32b30391315d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:41:08.688035 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-09484c9d-954a-49fa-ae06-32b30391315d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1680 microversion: 2.1 time: 0.164065 Oct 11 00:41:08.688623 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4184/7712] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:41:08 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:41:09.712005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4fdb0f78-0a35-4487-a33c-83d4511fb98d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:41:09.712610 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4fdb0f78-0a35-4487-a33c-83d4511fb98d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:41:09.719885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fdb0f78-0a35-4487-a33c-83d4511fb98d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:09.720371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fdb0f78-0a35-4487-a33c-83d4511fb98d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:09.720805 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fdb0f78-0a35-4487-a33c-83d4511fb98d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:09.721514 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fdb0f78-0a35-4487-a33c-83d4511fb98d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:09.721968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fdb0f78-0a35-4487-a33c-83d4511fb98d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:09.722388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fdb0f78-0a35-4487-a33c-83d4511fb98d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:09.855624 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4fdb0f78-0a35-4487-a33c-83d4511fb98d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:41:09.863853 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4fdb0f78-0a35-4487-a33c-83d4511fb98d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1680 microversion: 2.1 time: 0.155822 Oct 11 00:41:09.864436 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3529/7713] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:41:09 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:41:10.891124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8d857248-b4d8-4282-9450-79e92a3d1b93 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:41:10.891124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8d857248-b4d8-4282-9450-79e92a3d1b93 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:41:10.897201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d857248-b4d8-4282-9450-79e92a3d1b93 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:10.897740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d857248-b4d8-4282-9450-79e92a3d1b93 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:10.898201 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d857248-b4d8-4282-9450-79e92a3d1b93 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:10.898926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d857248-b4d8-4282-9450-79e92a3d1b93 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:10.899402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d857248-b4d8-4282-9450-79e92a3d1b93 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:10.900136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d857248-b4d8-4282-9450-79e92a3d1b93 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:11.057043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8d857248-b4d8-4282-9450-79e92a3d1b93 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:41:11.068168 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8d857248-b4d8-4282-9450-79e92a3d1b93 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1680 microversion: 2.1 time: 0.184774 Oct 11 00:41:11.068683 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4185/7714] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:41:10 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:41:12.092649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-402425ca-ce45-46d7-8bcf-422d65c3763c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:41:12.093232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-402425ca-ce45-46d7-8bcf-422d65c3763c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:41:12.100204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-402425ca-ce45-46d7-8bcf-422d65c3763c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:12.100696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-402425ca-ce45-46d7-8bcf-422d65c3763c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:12.101133 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-402425ca-ce45-46d7-8bcf-422d65c3763c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:12.101885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-402425ca-ce45-46d7-8bcf-422d65c3763c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:12.102351 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-402425ca-ce45-46d7-8bcf-422d65c3763c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:12.102780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-402425ca-ce45-46d7-8bcf-422d65c3763c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:12.233998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-402425ca-ce45-46d7-8bcf-422d65c3763c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:41:12.241756 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-402425ca-ce45-46d7-8bcf-422d65c3763c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1680 microversion: 2.1 time: 0.153780 Oct 11 00:41:12.242333 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3530/7715] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:41:12 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:41:13.265471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-452c53cf-e65e-4e1f-b01a-015eba52d7b1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:41:13.266114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-452c53cf-e65e-4e1f-b01a-015eba52d7b1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:41:13.273064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-452c53cf-e65e-4e1f-b01a-015eba52d7b1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:13.273616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-452c53cf-e65e-4e1f-b01a-015eba52d7b1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:13.274082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-452c53cf-e65e-4e1f-b01a-015eba52d7b1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:13.274798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-452c53cf-e65e-4e1f-b01a-015eba52d7b1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:13.275277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-452c53cf-e65e-4e1f-b01a-015eba52d7b1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:13.275730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-452c53cf-e65e-4e1f-b01a-015eba52d7b1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:13.413830 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-452c53cf-e65e-4e1f-b01a-015eba52d7b1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:41:13.423041 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-452c53cf-e65e-4e1f-b01a-015eba52d7b1 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1683 microversion: 2.1 time: 0.161766 Oct 11 00:41:13.423653 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4186/7716] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:41:13 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:41:47.648151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-9c97553b-55c2-47ac-bf64-7a4ae83c119d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:41:47.650437 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-9c97553b-55c2-47ac-bf64-7a4ae83c119d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:41:47.652968 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:41:47.653107 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:41:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e/action (ip 10.222.0.23) !!! Oct 11 00:41:47.654183 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:41:47.654927 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:41:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e/action (ip 10.222.0.23) !!! Oct 11 00:41:47.655907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=16 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:41:47.656739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:41:47.665082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c97553b-55c2-47ac-bf64-7a4ae83c119d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:47.665608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c97553b-55c2-47ac-bf64-7a4ae83c119d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:47.666050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c97553b-55c2-47ac-bf64-7a4ae83c119d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:47.666777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c97553b-55c2-47ac-bf64-7a4ae83c119d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:41:47.667233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c97553b-55c2-47ac-bf64-7a4ae83c119d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:41:47.667657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-9c97553b-55c2-47ac-bf64-7a4ae83c119d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:41:47.726032 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-9c97553b-55c2-47ac-bf64-7a4ae83c119d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e/action" status: 200 len: 69106 microversion: 2.1 time: 0.081824 Oct 11 00:41:47.726701 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3531/7717] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:41:47 2022] POST /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e/action => generated 69106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 00:42:11.332290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-83389d29-4efa-436b-a3a8-a3b7b8ea3870 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:42:11.333087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-83389d29-4efa-436b-a3a8-a3b7b8ea3870 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:42:11.335299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-d19f3503-8b74-4c30-a0ee-3b5d1b97d317 req-62721b14-0528-42f9-ab15-d4bc33a6ae8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41a3021d-8526-4bdf-b201-ed7a65b6742e", "tag": "e0553266-ea0b-4c88-9add-6582e8e10d1d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:42:11.335978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=16 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:42:11.337093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=48 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:42:11.344613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83389d29-4efa-436b-a3a8-a3b7b8ea3870 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:11.344856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83389d29-4efa-436b-a3a8-a3b7b8ea3870 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:11.345541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83389d29-4efa-436b-a3a8-a3b7b8ea3870 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:11.345733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:42:11.346579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83389d29-4efa-436b-a3a8-a3b7b8ea3870 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:11.347273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83389d29-4efa-436b-a3a8-a3b7b8ea3870 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:11.347477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:42:11.347853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-83389d29-4efa-436b-a3a8-a3b7b8ea3870 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:11.350091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d19f3503-8b74-4c30-a0ee-3b5d1b97d317 req-62721b14-0528-42f9-ab15-d4bc33a6ae8c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:11.350573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d19f3503-8b74-4c30-a0ee-3b5d1b97d317 req-62721b14-0528-42f9-ab15-d4bc33a6ae8c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:11.351006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d19f3503-8b74-4c30-a0ee-3b5d1b97d317 req-62721b14-0528-42f9-ab15-d4bc33a6ae8c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:11.370597 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-d19f3503-8b74-4c30-a0ee-3b5d1b97d317 req-62721b14-0528-42f9-ab15-d4bc33a6ae8c service nova] Creating event network-changed:e0553266-ea0b-4c88-9add-6582e8e10d1d for instance 41a3021d-8526-4bdf-b201-ed7a65b6742e on n-h1-860864-2 Oct 11 00:42:11.377635 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-d19f3503-8b74-4c30-a0ee-3b5d1b97d317 req-62721b14-0528-42f9-ab15-d4bc33a6ae8c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046905 Oct 11 00:42:11.378532 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3532/7718] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:42:11.383353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-83389d29-4efa-436b-a3a8-a3b7b8ea3870 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:42:11.477148 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-83389d29-4efa-436b-a3a8-a3b7b8ea3870 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "DELETE /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 204 len: 0 microversion: 2.1 time: 0.149126 Oct 11 00:42:11.478301 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4187/7719] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:42:11 2022] DELETE /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:42:11.489092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3b31437f-09cc-427c-856d-d8aeb1aa6ca3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:42:11.490131 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3b31437f-09cc-427c-856d-d8aeb1aa6ca3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:42:11.497742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b31437f-09cc-427c-856d-d8aeb1aa6ca3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:11.498236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b31437f-09cc-427c-856d-d8aeb1aa6ca3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:11.498676 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b31437f-09cc-427c-856d-d8aeb1aa6ca3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:11.499688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b31437f-09cc-427c-856d-d8aeb1aa6ca3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:11.500151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b31437f-09cc-427c-856d-d8aeb1aa6ca3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:11.500585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b31437f-09cc-427c-856d-d8aeb1aa6ca3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:11.643798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3b31437f-09cc-427c-856d-d8aeb1aa6ca3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:42:11.652012 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3b31437f-09cc-427c-856d-d8aeb1aa6ca3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1689 microversion: 2.1 time: 0.169283 Oct 11 00:42:11.652610 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3533/7720] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:42:11 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:42:12.678955 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-73937faf-0905-4b45-95bf-eff7ea16d447 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:42:12.679722 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-73937faf-0905-4b45-95bf-eff7ea16d447 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:42:12.687507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73937faf-0905-4b45-95bf-eff7ea16d447 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:12.688076 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73937faf-0905-4b45-95bf-eff7ea16d447 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:12.688542 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73937faf-0905-4b45-95bf-eff7ea16d447 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:12.689268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73937faf-0905-4b45-95bf-eff7ea16d447 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:12.689761 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73937faf-0905-4b45-95bf-eff7ea16d447 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:12.690203 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-73937faf-0905-4b45-95bf-eff7ea16d447 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:12.855916 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-73937faf-0905-4b45-95bf-eff7ea16d447 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:42:12.864522 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-73937faf-0905-4b45-95bf-eff7ea16d447 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1689 microversion: 2.1 time: 0.189826 Oct 11 00:42:12.865362 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4188/7721] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:42:12 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1689 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:42:13.825362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-00ef159a-8c3c-40cf-8fbe-3c1f556876f1 req-a06e868a-abcc-4acc-a128-6aaf77d80297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41a3021d-8526-4bdf-b201-ed7a65b6742e", "name": "network-vif-deleted", "tag": "e0553266-ea0b-4c88-9add-6582e8e10d1d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:42:13.836770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-00ef159a-8c3c-40cf-8fbe-3c1f556876f1 req-a06e868a-abcc-4acc-a128-6aaf77d80297 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:13.837295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-00ef159a-8c3c-40cf-8fbe-3c1f556876f1 req-a06e868a-abcc-4acc-a128-6aaf77d80297 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:13.837741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-00ef159a-8c3c-40cf-8fbe-3c1f556876f1 req-a06e868a-abcc-4acc-a128-6aaf77d80297 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:13.851210 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-00ef159a-8c3c-40cf-8fbe-3c1f556876f1 req-a06e868a-abcc-4acc-a128-6aaf77d80297 service nova] Creating event network-vif-deleted:e0553266-ea0b-4c88-9add-6582e8e10d1d for instance 41a3021d-8526-4bdf-b201-ed7a65b6742e on n-h1-860864-2 Oct 11 00:42:13.856629 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-00ef159a-8c3c-40cf-8fbe-3c1f556876f1 req-a06e868a-abcc-4acc-a128-6aaf77d80297 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034979 Oct 11 00:42:13.857261 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3534/7722] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:42:13.888310 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1f93b1d7-72eb-4a74-8501-f82a5d908af3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:42:13.888898 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1f93b1d7-72eb-4a74-8501-f82a5d908af3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:42:13.897428 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f93b1d7-72eb-4a74-8501-f82a5d908af3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:13.897950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f93b1d7-72eb-4a74-8501-f82a5d908af3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:13.898412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f93b1d7-72eb-4a74-8501-f82a5d908af3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:13.899143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f93b1d7-72eb-4a74-8501-f82a5d908af3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:13.899649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f93b1d7-72eb-4a74-8501-f82a5d908af3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:13.900097 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f93b1d7-72eb-4a74-8501-f82a5d908af3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:13.974877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1f93b1d7-72eb-4a74-8501-f82a5d908af3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:42:13.985637 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1f93b1d7-72eb-4a74-8501-f82a5d908af3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 200 len: 1352 microversion: 2.1 time: 0.101215 Oct 11 00:42:13.986405 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4189/7723] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:42:13 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:42:15.009916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6758da3c-cbce-4993-a40b-277335231575 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:42:15.010944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6758da3c-cbce-4993-a40b-277335231575 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 41a3021d-8526-4bdf-b201-ed7a65b6742e] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:42:15.017094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6758da3c-cbce-4993-a40b-277335231575 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:15.017618 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6758da3c-cbce-4993-a40b-277335231575 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:15.018059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6758da3c-cbce-4993-a40b-277335231575 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:15.018767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6758da3c-cbce-4993-a40b-277335231575 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:15.019224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6758da3c-cbce-4993-a40b-277335231575 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:15.019651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6758da3c-cbce-4993-a40b-277335231575 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:15.037036 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-6758da3c-cbce-4993-a40b-277335231575 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] HTTP exception thrown: Instance 41a3021d-8526-4bdf-b201-ed7a65b6742e could not be found. Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6758da3c-cbce-4993-a40b-277335231575 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Request method failure captured: Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e HTTP/1.1 Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRLrbIgsnFdcSLuDWSG0BXZJgQ-0aoLaqeEz8A0UaMKXZIvv_xdAg16W-tgk2ATxwWwXTsmkAKVRXeF_uFIvkXsNHX3CXRwU3FdonpA1rskUDVW9HI_SHIbYvWd9DxLNyTUfkF2HQNHtRL2_zgZlbWNH1devNuUVY45TC5ljRE7Bwb78 Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 60c10fdea561499c9f87fac524ca4113 Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-886185438 Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60c10fdea561499c9f87fac524ca4113"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60c10fdea561499c9f87fac524ca4113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60c10fdea561499c9f87fac524ca4113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60c10fdea561499c9f87fac524ca4113", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TestNetworkAdvancedServerOps-886185438 Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 60c10fdea561499c9f87fac524ca4113 Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-886185438 Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TestNetworkAdvancedServerOps-886185438-project Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 84c8a15123fb4b0292320555bceb3681 Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TestNetworkAdvancedServerOps-886185438-project Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 41a3021d-8526-4bdf-b201-ed7a65b6742e could not be found. Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '41a3021d-8526-4bdf-b201-ed7a65b6742e'} Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41a3021d-8526-4bdf-b201-ed7a65b6742e could not be found. Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41a3021d-8526-4bdf-b201-ed7a65b6742e could not be found. Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:42:15.040086 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:42:15.044783 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:42:15.044783 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:42:15.044783 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:42:15.044783 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:42:15.044783 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:42:15.044783 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:42:15.044783 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41a3021d-8526-4bdf-b201-ed7a65b6742e could not be found. Oct 11 00:42:15.044783 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:42:15.044783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6758da3c-cbce-4993-a40b-277335231575 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Returning 404 to user: Instance 41a3021d-8526-4bdf-b201-ed7a65b6742e could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:42:15.044783 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6758da3c-cbce-4993-a40b-277335231575 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e" status: 404 len: 111 microversion: 2.1 time: 0.036951 Oct 11 00:42:15.044783 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3535/7724] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:42:15 2022] GET /compute/v2.1/servers/41a3021d-8526-4bdf-b201-ed7a65b6742e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:42:18.386723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e960b4c1-b1df-41c9-ac29-3a43b57e1e4b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '.version_select at 0x7f662aca9310>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:42:18.414599 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e960b4c1-b1df-41c9-ac29-3a43b57e1e4b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2128477277" status: 202 len: 0 microversion: 2.1 time: 0.035084 Oct 11 00:42:18.415642 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4190/7725] 10.222.0.23 () {58 vars in 1284 bytes} [Tue Oct 11 00:42:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2128477277 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:42:18.447076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d224f396-62e9-41c7-98bb-083820015e07 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'create', calling method: .version_select at 0x7f662a8e31f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2011732679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN5SGzatmG+IUrJjFy1gaV0l9/rCtiV10uu+/qFtWFALt3Rnem5rbTUkCeB7y7zf90KzP/a4vaXZxxfDhOZ0uxlgpdI7OFhvZyQxYkpNdtWrH/I7cAiUTzNtdqtTILZEA=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:42:18.463975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-d224f396-62e9-41c7-98bb-083820015e07 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Getting quotas for project 60c10fdea561499c9f87fac524ca4113. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:42:18.469963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-d224f396-62e9-41c7-98bb-083820015e07 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Getting quotas for user 84c8a15123fb4b0292320555bceb3681 and project 60c10fdea561499c9f87fac524ca4113. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:42:18.497403 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d224f396-62e9-41c7-98bb-083820015e07 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054226 Oct 11 00:42:18.498030 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3536/7726] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 11 00:42:18 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:42:24.713191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:42:24.722524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-39db073e-1eb6-41eb-adfe-b41fb81a4c6b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-185693648", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "d899a6ab-ed9b-45c8-861f-f592a4bcaf0c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2011732679", "security_groups": [{"name": "tempest-secgroup-smoke-1128712633"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:42:24.851909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-39db073e-1eb6-41eb-adfe-b41fb81a4c6b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] validate_networks() for [('d899a6ab-ed9b-45c8-861f-f592a4bcaf0c', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:42:25.339960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-39db073e-1eb6-41eb-adfe-b41fb81a4c6b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:42:25.340436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-39db073e-1eb6-41eb-adfe-b41fb81a4c6b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:42:25.340936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-39db073e-1eb6-41eb-adfe-b41fb81a4c6b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:42:25.341367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-39db073e-1eb6-41eb-adfe-b41fb81a4c6b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:42:25.341857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-39db073e-1eb6-41eb-adfe-b41fb81a4c6b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:42:25.351935 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39db073e-1eb6-41eb-adfe-b41fb81a4c6b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:25.352429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39db073e-1eb6-41eb-adfe-b41fb81a4c6b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:25.352877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39db073e-1eb6-41eb-adfe-b41fb81a4c6b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:25.353653 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39db073e-1eb6-41eb-adfe-b41fb81a4c6b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:25.354269 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39db073e-1eb6-41eb-adfe-b41fb81a4c6b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:25.354709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39db073e-1eb6-41eb-adfe-b41fb81a4c6b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:25.372729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-39db073e-1eb6-41eb-adfe-b41fb81a4c6b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Getting quotas for project 60c10fdea561499c9f87fac524ca4113. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:42:25.378307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-39db073e-1eb6-41eb-adfe-b41fb81a4c6b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Getting quotas for user 84c8a15123fb4b0292320555bceb3681 and project 60c10fdea561499c9f87fac524ca4113. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:42:25.391502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-39db073e-1eb6-41eb-adfe-b41fb81a4c6b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:42:25.393927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-39db073e-1eb6-41eb-adfe-b41fb81a4c6b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:42:25.444539 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-39db073e-1eb6-41eb-adfe-b41fb81a4c6b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.733180 Oct 11 00:42:25.445401 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4191/7727] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:42:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:42:25.455866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=12 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:42:25.460947 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b2e9643e-2147-4d35-8821-d42ac041e42d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:42:25.461917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b2e9643e-2147-4d35-8821-d42ac041e42d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:42:25.525963 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b2e9643e-2147-4d35-8821-d42ac041e42d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:42:25.534683 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b2e9643e-2147-4d35-8821-d42ac041e42d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1266 microversion: 2.1 time: 0.080599 Oct 11 00:42:25.535427 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3537/7728] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:42:25 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:42:26.560191 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8de486c2-a3e6-4a56-8f98-96c66b1d4f76 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:42:26.562036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8de486c2-a3e6-4a56-8f98-96c66b1d4f76 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:42:26.573365 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8de486c2-a3e6-4a56-8f98-96c66b1d4f76 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:26.573926 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8de486c2-a3e6-4a56-8f98-96c66b1d4f76 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:26.574725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8de486c2-a3e6-4a56-8f98-96c66b1d4f76 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:26.588185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8de486c2-a3e6-4a56-8f98-96c66b1d4f76 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:26.588695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8de486c2-a3e6-4a56-8f98-96c66b1d4f76 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:26.589160 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8de486c2-a3e6-4a56-8f98-96c66b1d4f76 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:26.674297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8de486c2-a3e6-4a56-8f98-96c66b1d4f76 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:42:26.686344 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8de486c2-a3e6-4a56-8f98-96c66b1d4f76 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1326 microversion: 2.1 time: 0.132023 Oct 11 00:42:26.687270 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4192/7729] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:42:26 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1326 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:42:27.711653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-05584806-0d88-40e7-b806-e88ee7a659fe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:42:27.712386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-05584806-0d88-40e7-b806-e88ee7a659fe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:42:27.719424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05584806-0d88-40e7-b806-e88ee7a659fe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:27.719996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05584806-0d88-40e7-b806-e88ee7a659fe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:27.720528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05584806-0d88-40e7-b806-e88ee7a659fe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:27.721286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05584806-0d88-40e7-b806-e88ee7a659fe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:27.721869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05584806-0d88-40e7-b806-e88ee7a659fe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:27.722370 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-05584806-0d88-40e7-b806-e88ee7a659fe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:27.860125 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-05584806-0d88-40e7-b806-e88ee7a659fe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:42:27.868042 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-05584806-0d88-40e7-b806-e88ee7a659fe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1392 microversion: 2.1 time: 0.160565 Oct 11 00:42:27.868628 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3538/7730] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:42:27 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:42:28.230452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-28df5ae0-1a53-4c4f-b1e9-1180d7e712d2 req-dce0bf5b-cdca-44b5-bff7-d39ae61befe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a0bff3a-e205-4a8b-a205-86f0de58e4f7", "tag": "4e3edc61-0abe-4776-b3f0-30fc8764d1e4"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:42:28.241424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-28df5ae0-1a53-4c4f-b1e9-1180d7e712d2 req-dce0bf5b-cdca-44b5-bff7-d39ae61befe5 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:28.242009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-28df5ae0-1a53-4c4f-b1e9-1180d7e712d2 req-dce0bf5b-cdca-44b5-bff7-d39ae61befe5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:28.242544 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-28df5ae0-1a53-4c4f-b1e9-1180d7e712d2 req-dce0bf5b-cdca-44b5-bff7-d39ae61befe5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:28.255490 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-28df5ae0-1a53-4c4f-b1e9-1180d7e712d2 req-dce0bf5b-cdca-44b5-bff7-d39ae61befe5 service nova] Creating event network-changed:4e3edc61-0abe-4776-b3f0-30fc8764d1e4 for instance 5a0bff3a-e205-4a8b-a205-86f0de58e4f7 on n-h2-860864-2 Oct 11 00:42:28.260532 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-28df5ae0-1a53-4c4f-b1e9-1180d7e712d2 req-dce0bf5b-cdca-44b5-bff7-d39ae61befe5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034193 Oct 11 00:42:28.261323 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4193/7731] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:42:28.891889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f604eaa8-6e6c-4c61-8e48-1d436cd8ac6a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:42:28.892453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f604eaa8-6e6c-4c61-8e48-1d436cd8ac6a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:42:28.899414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f604eaa8-6e6c-4c61-8e48-1d436cd8ac6a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:28.899902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f604eaa8-6e6c-4c61-8e48-1d436cd8ac6a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:28.900343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f604eaa8-6e6c-4c61-8e48-1d436cd8ac6a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:28.901037 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f604eaa8-6e6c-4c61-8e48-1d436cd8ac6a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:28.901527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f604eaa8-6e6c-4c61-8e48-1d436cd8ac6a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:28.901959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f604eaa8-6e6c-4c61-8e48-1d436cd8ac6a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:29.041268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f604eaa8-6e6c-4c61-8e48-1d436cd8ac6a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:42:29.049833 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f604eaa8-6e6c-4c61-8e48-1d436cd8ac6a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1392 microversion: 2.1 time: 0.162128 Oct 11 00:42:29.050409 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3539/7732] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:42:28 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:42:30.074371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8e67bdf1-d061-451f-a11d-294c2ce9f5de tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:42:30.075037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8e67bdf1-d061-451f-a11d-294c2ce9f5de tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:42:30.081671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e67bdf1-d061-451f-a11d-294c2ce9f5de tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:30.082179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e67bdf1-d061-451f-a11d-294c2ce9f5de tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:30.082666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e67bdf1-d061-451f-a11d-294c2ce9f5de tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:30.083341 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e67bdf1-d061-451f-a11d-294c2ce9f5de tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:30.083988 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e67bdf1-d061-451f-a11d-294c2ce9f5de tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:30.084698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8e67bdf1-d061-451f-a11d-294c2ce9f5de tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:30.223065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8e67bdf1-d061-451f-a11d-294c2ce9f5de tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:42:30.231076 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8e67bdf1-d061-451f-a11d-294c2ce9f5de tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1392 microversion: 2.1 time: 0.162350 Oct 11 00:42:30.231650 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4194/7733] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:42:30 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:42:31.254710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7420f975-7266-4fef-841b-b791cb373276 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:42:31.255325 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7420f975-7266-4fef-841b-b791cb373276 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:42:31.262161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7420f975-7266-4fef-841b-b791cb373276 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:31.262652 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7420f975-7266-4fef-841b-b791cb373276 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:31.263097 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7420f975-7266-4fef-841b-b791cb373276 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:31.263939 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7420f975-7266-4fef-841b-b791cb373276 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:31.264904 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7420f975-7266-4fef-841b-b791cb373276 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:31.265331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7420f975-7266-4fef-841b-b791cb373276 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:31.448917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7420f975-7266-4fef-841b-b791cb373276 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:42:31.457198 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7420f975-7266-4fef-841b-b791cb373276 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1392 microversion: 2.1 time: 0.206474 Oct 11 00:42:31.457811 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3540/7734] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:42:31 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1392 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:42:32.481446 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-54ce06eb-b8e3-4e2b-b60f-533fb6545a90 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:42:32.482098 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-54ce06eb-b8e3-4e2b-b60f-533fb6545a90 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:42:32.489732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54ce06eb-b8e3-4e2b-b60f-533fb6545a90 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:32.490230 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54ce06eb-b8e3-4e2b-b60f-533fb6545a90 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:32.490682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54ce06eb-b8e3-4e2b-b60f-533fb6545a90 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:32.491386 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54ce06eb-b8e3-4e2b-b60f-533fb6545a90 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:32.491854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54ce06eb-b8e3-4e2b-b60f-533fb6545a90 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:32.492290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54ce06eb-b8e3-4e2b-b60f-533fb6545a90 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:32.631644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-54ce06eb-b8e3-4e2b-b60f-533fb6545a90 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:42:32.639890 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-54ce06eb-b8e3-4e2b-b60f-533fb6545a90 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1392 microversion: 2.1 time: 0.162341 Oct 11 00:42:32.640460 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4195/7735] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:42:32 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:42:33.662890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-27dc258a-f84f-4f62-9b0a-a82d1c57d84b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:42:33.663600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-27dc258a-f84f-4f62-9b0a-a82d1c57d84b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:42:33.671523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27dc258a-f84f-4f62-9b0a-a82d1c57d84b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:33.672012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27dc258a-f84f-4f62-9b0a-a82d1c57d84b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:33.672447 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27dc258a-f84f-4f62-9b0a-a82d1c57d84b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:33.673135 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27dc258a-f84f-4f62-9b0a-a82d1c57d84b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:33.673612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27dc258a-f84f-4f62-9b0a-a82d1c57d84b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:33.674034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-27dc258a-f84f-4f62-9b0a-a82d1c57d84b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:33.810517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-27dc258a-f84f-4f62-9b0a-a82d1c57d84b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:42:33.819401 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-27dc258a-f84f-4f62-9b0a-a82d1c57d84b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1392 microversion: 2.1 time: 0.160314 Oct 11 00:42:33.820005 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3541/7736] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:42:33 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:42:34.843812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0e9a23b6-efc1-4b83-b76f-e2f04e650e15 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:42:34.844476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0e9a23b6-efc1-4b83-b76f-e2f04e650e15 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:42:34.851570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e9a23b6-efc1-4b83-b76f-e2f04e650e15 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:34.852073 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e9a23b6-efc1-4b83-b76f-e2f04e650e15 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:34.852524 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e9a23b6-efc1-4b83-b76f-e2f04e650e15 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:34.853273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e9a23b6-efc1-4b83-b76f-e2f04e650e15 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:34.853767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e9a23b6-efc1-4b83-b76f-e2f04e650e15 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:34.854210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e9a23b6-efc1-4b83-b76f-e2f04e650e15 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:34.995725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0e9a23b6-efc1-4b83-b76f-e2f04e650e15 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:42:35.004744 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0e9a23b6-efc1-4b83-b76f-e2f04e650e15 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1392 microversion: 2.1 time: 0.165718 Oct 11 00:42:35.007275 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4196/7737] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:42:34 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:42:35.070565 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-4d7bc312-2a5f-4e03-93ca-e8721b7dde2d req-e9148705-f392-4de1-8dca-34ff6d17b88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0bff3a-e205-4a8b-a205-86f0de58e4f7", "name": "network-vif-plugged", "status": "completed", "tag": "4e3edc61-0abe-4776-b3f0-30fc8764d1e4"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:42:35.082742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4d7bc312-2a5f-4e03-93ca-e8721b7dde2d req-e9148705-f392-4de1-8dca-34ff6d17b88b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:35.083232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4d7bc312-2a5f-4e03-93ca-e8721b7dde2d req-e9148705-f392-4de1-8dca-34ff6d17b88b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:35.083885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4d7bc312-2a5f-4e03-93ca-e8721b7dde2d req-e9148705-f392-4de1-8dca-34ff6d17b88b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:35.096680 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-4d7bc312-2a5f-4e03-93ca-e8721b7dde2d req-e9148705-f392-4de1-8dca-34ff6d17b88b service nova] Creating event network-vif-plugged:4e3edc61-0abe-4776-b3f0-30fc8764d1e4 for instance 5a0bff3a-e205-4a8b-a205-86f0de58e4f7 on n-h2-860864-2 Oct 11 00:42:35.103121 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-4d7bc312-2a5f-4e03-93ca-e8721b7dde2d req-e9148705-f392-4de1-8dca-34ff6d17b88b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099299 Oct 11 00:42:35.104291 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3542/7738] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:42:36.112677 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ea4b5fd9-acea-4320-8e5b-8af16c12c635 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:42:36.113580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ea4b5fd9-acea-4320-8e5b-8af16c12c635 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:42:36.115621 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:42:36.116304 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:42:36.122861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea4b5fd9-acea-4320-8e5b-8af16c12c635 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:36.124567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea4b5fd9-acea-4320-8e5b-8af16c12c635 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:36.125025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea4b5fd9-acea-4320-8e5b-8af16c12c635 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:36.125765 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea4b5fd9-acea-4320-8e5b-8af16c12c635 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:36.126233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea4b5fd9-acea-4320-8e5b-8af16c12c635 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:36.126673 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea4b5fd9-acea-4320-8e5b-8af16c12c635 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:36.265840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ea4b5fd9-acea-4320-8e5b-8af16c12c635 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:42:36.273674 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ea4b5fd9-acea-4320-8e5b-8af16c12c635 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1392 microversion: 2.1 time: 0.164846 Oct 11 00:42:36.274271 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4197/7739] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:42:36 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:42:37.297585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1c765023-c2fb-458e-99dd-fceef5fd6853 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:42:37.298290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1c765023-c2fb-458e-99dd-fceef5fd6853 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:42:37.300280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:42:37.306623 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c765023-c2fb-458e-99dd-fceef5fd6853 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:37.307103 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c765023-c2fb-458e-99dd-fceef5fd6853 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:37.307535 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c765023-c2fb-458e-99dd-fceef5fd6853 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:37.308219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c765023-c2fb-458e-99dd-fceef5fd6853 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:37.308670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c765023-c2fb-458e-99dd-fceef5fd6853 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:37.309094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1c765023-c2fb-458e-99dd-fceef5fd6853 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:37.446112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1c765023-c2fb-458e-99dd-fceef5fd6853 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:42:37.454056 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1c765023-c2fb-458e-99dd-fceef5fd6853 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1564 microversion: 2.1 time: 0.161688 Oct 11 00:42:37.454634 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3543/7740] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:42:37 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:42:37.477193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-87fc3fc9-e4db-4c32-a09d-479a4a317fbe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:42:37.477855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-87fc3fc9-e4db-4c32-a09d-479a4a317fbe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:42:37.485396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87fc3fc9-e4db-4c32-a09d-479a4a317fbe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:37.485908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87fc3fc9-e4db-4c32-a09d-479a4a317fbe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:37.486367 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87fc3fc9-e4db-4c32-a09d-479a4a317fbe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:37.487084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87fc3fc9-e4db-4c32-a09d-479a4a317fbe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:37.487553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87fc3fc9-e4db-4c32-a09d-479a4a317fbe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:37.487996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-87fc3fc9-e4db-4c32-a09d-479a4a317fbe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:37.621457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-87fc3fc9-e4db-4c32-a09d-479a4a317fbe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:42:37.629926 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-87fc3fc9-e4db-4c32-a09d-479a4a317fbe tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1564 microversion: 2.1 time: 0.156645 Oct 11 00:42:37.630507 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4198/7741] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:42:37 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:42:39.492237 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-95cae823-04a7-4486-9432-e3342741fbc3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:42:39.492856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-95cae823-04a7-4486-9432-e3342741fbc3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:42:39.495665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-4e7e62a2-54cc-49dc-aefe-ca33abba15df req-7b94b4d9-1e00-4ce9-994e-c85c4f36f30c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a0bff3a-e205-4a8b-a205-86f0de58e4f7", "tag": "4e3edc61-0abe-4776-b3f0-30fc8764d1e4"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:42:39.501512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95cae823-04a7-4486-9432-e3342741fbc3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:39.502296 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95cae823-04a7-4486-9432-e3342741fbc3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:39.502742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95cae823-04a7-4486-9432-e3342741fbc3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:39.503453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95cae823-04a7-4486-9432-e3342741fbc3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:39.504041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95cae823-04a7-4486-9432-e3342741fbc3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:39.504735 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95cae823-04a7-4486-9432-e3342741fbc3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:39.507727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4e7e62a2-54cc-49dc-aefe-ca33abba15df req-7b94b4d9-1e00-4ce9-994e-c85c4f36f30c service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:42:39.508239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4e7e62a2-54cc-49dc-aefe-ca33abba15df req-7b94b4d9-1e00-4ce9-994e-c85c4f36f30c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:42:39.508693 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4e7e62a2-54cc-49dc-aefe-ca33abba15df req-7b94b4d9-1e00-4ce9-994e-c85c4f36f30c service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:42:39.521545 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-4e7e62a2-54cc-49dc-aefe-ca33abba15df req-7b94b4d9-1e00-4ce9-994e-c85c4f36f30c service nova] Creating event network-changed:4e3edc61-0abe-4776-b3f0-30fc8764d1e4 for instance 5a0bff3a-e205-4a8b-a205-86f0de58e4f7 on n-h2-860864-2 Oct 11 00:42:39.527304 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-4e7e62a2-54cc-49dc-aefe-ca33abba15df req-7b94b4d9-1e00-4ce9-994e-c85c4f36f30c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035360 Oct 11 00:42:39.528284 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4199/7742] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:42:39.648313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-95cae823-04a7-4486-9432-e3342741fbc3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:42:39.657933 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-95cae823-04a7-4486-9432-e3342741fbc3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1564 microversion: 2.1 time: 0.169687 Oct 11 00:42:39.658721 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3544/7743] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:42:39 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:02.916209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:43:02.916974 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=42 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:43:02.967389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5bb3040e-d95b-4e14-8408-d311d2c8a5e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:43:02.969795 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5bb3040e-d95b-4e14-8408-d311d2c8a5e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:02.977598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bb3040e-d95b-4e14-8408-d311d2c8a5e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:02.978128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bb3040e-d95b-4e14-8408-d311d2c8a5e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:02.978578 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bb3040e-d95b-4e14-8408-d311d2c8a5e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:02.979282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bb3040e-d95b-4e14-8408-d311d2c8a5e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:02.979748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bb3040e-d95b-4e14-8408-d311d2c8a5e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:02.980184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bb3040e-d95b-4e14-8408-d311d2c8a5e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:03.035776 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5bb3040e-d95b-4e14-8408-d311d2c8a5e7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7/action" status: 200 len: 24568 microversion: 2.1 time: 0.121341 Oct 11 00:43:03.036406 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4200/7744] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:43:02 2022] POST /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7/action => generated 24568 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 00:43:14.151390 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ab1a1b40-32e2-4e90-9d1e-72dfa34e7738 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:43:14.153796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ab1a1b40-32e2-4e90-9d1e-72dfa34e7738 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:14.155815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:43:14.156477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=38 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:43:14.162391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab1a1b40-32e2-4e90-9d1e-72dfa34e7738 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:14.162882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab1a1b40-32e2-4e90-9d1e-72dfa34e7738 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:14.163326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab1a1b40-32e2-4e90-9d1e-72dfa34e7738 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:14.164023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab1a1b40-32e2-4e90-9d1e-72dfa34e7738 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:14.164480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab1a1b40-32e2-4e90-9d1e-72dfa34e7738 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:14.164908 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab1a1b40-32e2-4e90-9d1e-72dfa34e7738 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:14.248055 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ab1a1b40-32e2-4e90-9d1e-72dfa34e7738 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:14.254283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ab1a1b40-32e2-4e90-9d1e-72dfa34e7738 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Old instance type m1.heat2, new instance type m1.heat {{(pid=120614) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 00:43:14.261335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ab1a1b40-32e2-4e90-9d1e-72dfa34e7738 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:43:14.261791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ab1a1b40-32e2-4e90-9d1e-72dfa34e7738 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:43:14.262267 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ab1a1b40-32e2-4e90-9d1e-72dfa34e7738 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:43:14.262677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ab1a1b40-32e2-4e90-9d1e-72dfa34e7738 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:43:14.263090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ab1a1b40-32e2-4e90-9d1e-72dfa34e7738 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:43:14.327854 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ab1a1b40-32e2-4e90-9d1e-72dfa34e7738 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7/action" status: 202 len: 0 microversion: 2.1 time: 0.180704 Oct 11 00:43:14.328474 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3545/7745] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:43:14 2022] POST /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:43:14.335330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:43:14.336369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=4 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:43:14.341042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-88a96efc-6949-40ec-88e9-394cd2033222 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:14.341409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-88a96efc-6949-40ec-88e9-394cd2033222 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:14.349527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88a96efc-6949-40ec-88e9-394cd2033222 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:14.350036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88a96efc-6949-40ec-88e9-394cd2033222 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:14.350491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88a96efc-6949-40ec-88e9-394cd2033222 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:14.351209 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88a96efc-6949-40ec-88e9-394cd2033222 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:14.351669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88a96efc-6949-40ec-88e9-394cd2033222 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:14.352111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-88a96efc-6949-40ec-88e9-394cd2033222 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:14.490393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-88a96efc-6949-40ec-88e9-394cd2033222 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:14.498403 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-88a96efc-6949-40ec-88e9-394cd2033222 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1692 microversion: 2.1 time: 0.165287 Oct 11 00:43:14.499000 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4201/7746] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:14 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:15.524745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7b805b20-30d1-4f16-aa99-1e43b02d39a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:15.525336 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7b805b20-30d1-4f16-aa99-1e43b02d39a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:15.532992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b805b20-30d1-4f16-aa99-1e43b02d39a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:15.533442 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b805b20-30d1-4f16-aa99-1e43b02d39a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:15.534104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b805b20-30d1-4f16-aa99-1e43b02d39a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:15.535350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b805b20-30d1-4f16-aa99-1e43b02d39a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:15.536641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b805b20-30d1-4f16-aa99-1e43b02d39a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:15.537324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7b805b20-30d1-4f16-aa99-1e43b02d39a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:15.688124 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7b805b20-30d1-4f16-aa99-1e43b02d39a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:15.696234 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7b805b20-30d1-4f16-aa99-1e43b02d39a2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1692 microversion: 2.1 time: 0.176673 Oct 11 00:43:15.696814 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3546/7747] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:15 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:16.719118 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2cbfe008-2faa-4435-a69e-97448ae1cf1b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:16.719739 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2cbfe008-2faa-4435-a69e-97448ae1cf1b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:16.727780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cbfe008-2faa-4435-a69e-97448ae1cf1b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:16.728307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cbfe008-2faa-4435-a69e-97448ae1cf1b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:16.728759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cbfe008-2faa-4435-a69e-97448ae1cf1b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:16.729502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cbfe008-2faa-4435-a69e-97448ae1cf1b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:16.729972 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cbfe008-2faa-4435-a69e-97448ae1cf1b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:16.730410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cbfe008-2faa-4435-a69e-97448ae1cf1b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:16.864016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2cbfe008-2faa-4435-a69e-97448ae1cf1b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:16.872083 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2cbfe008-2faa-4435-a69e-97448ae1cf1b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1697 microversion: 2.1 time: 0.156912 Oct 11 00:43:16.872692 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4202/7748] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:16 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:17.896415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1a546d7c-4078-41f2-9b50-821649ea009a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:17.897039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1a546d7c-4078-41f2-9b50-821649ea009a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:17.904059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a546d7c-4078-41f2-9b50-821649ea009a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:17.904550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a546d7c-4078-41f2-9b50-821649ea009a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:17.904993 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a546d7c-4078-41f2-9b50-821649ea009a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:17.905731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a546d7c-4078-41f2-9b50-821649ea009a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:17.906188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a546d7c-4078-41f2-9b50-821649ea009a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:17.906617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1a546d7c-4078-41f2-9b50-821649ea009a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:18.046118 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1a546d7c-4078-41f2-9b50-821649ea009a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:18.054115 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1a546d7c-4078-41f2-9b50-821649ea009a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1697 microversion: 2.1 time: 0.161811 Oct 11 00:43:18.054960 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3547/7749] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:17 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:43:19.078135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-18209961-d8e0-4672-9d62-b84cbdb022ce tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:19.078726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-18209961-d8e0-4672-9d62-b84cbdb022ce tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:19.086128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18209961-d8e0-4672-9d62-b84cbdb022ce tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:19.086630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18209961-d8e0-4672-9d62-b84cbdb022ce tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:19.087084 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18209961-d8e0-4672-9d62-b84cbdb022ce tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:19.087791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18209961-d8e0-4672-9d62-b84cbdb022ce tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:19.088257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18209961-d8e0-4672-9d62-b84cbdb022ce tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:19.088779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-18209961-d8e0-4672-9d62-b84cbdb022ce tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:19.228163 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-18209961-d8e0-4672-9d62-b84cbdb022ce tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:19.236036 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-18209961-d8e0-4672-9d62-b84cbdb022ce tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1697 microversion: 2.1 time: 0.162029 Oct 11 00:43:19.236629 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4203/7750] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:19 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:20.260891 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2ba3d3e4-8133-4c2f-8a6f-71ff2ce782f8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:20.261577 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2ba3d3e4-8133-4c2f-8a6f-71ff2ce782f8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:20.268821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ba3d3e4-8133-4c2f-8a6f-71ff2ce782f8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:20.269297 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ba3d3e4-8133-4c2f-8a6f-71ff2ce782f8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:20.269762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ba3d3e4-8133-4c2f-8a6f-71ff2ce782f8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:20.270453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ba3d3e4-8133-4c2f-8a6f-71ff2ce782f8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:20.270901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ba3d3e4-8133-4c2f-8a6f-71ff2ce782f8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:20.271353 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2ba3d3e4-8133-4c2f-8a6f-71ff2ce782f8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:20.407036 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2ba3d3e4-8133-4c2f-8a6f-71ff2ce782f8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:20.415507 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2ba3d3e4-8133-4c2f-8a6f-71ff2ce782f8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1697 microversion: 2.1 time: 0.159262 Oct 11 00:43:20.416094 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3548/7751] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:20 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:21.440666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-008c073d-aabf-49ed-9d46-02913103e00c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:21.441464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-008c073d-aabf-49ed-9d46-02913103e00c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:21.448872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-008c073d-aabf-49ed-9d46-02913103e00c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:21.449405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-008c073d-aabf-49ed-9d46-02913103e00c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:21.449862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-008c073d-aabf-49ed-9d46-02913103e00c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:21.450582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-008c073d-aabf-49ed-9d46-02913103e00c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:21.451253 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-008c073d-aabf-49ed-9d46-02913103e00c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:21.451505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-008c073d-aabf-49ed-9d46-02913103e00c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:21.588284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-008c073d-aabf-49ed-9d46-02913103e00c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:21.596027 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-008c073d-aabf-49ed-9d46-02913103e00c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1697 microversion: 2.1 time: 0.159409 Oct 11 00:43:21.596606 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4204/7752] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:21 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:22.620673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cc7e6bbd-21ee-4c58-90aa-9398d81d837d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:22.621292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cc7e6bbd-21ee-4c58-90aa-9398d81d837d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:22.628181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc7e6bbd-21ee-4c58-90aa-9398d81d837d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:22.628650 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc7e6bbd-21ee-4c58-90aa-9398d81d837d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:22.629091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc7e6bbd-21ee-4c58-90aa-9398d81d837d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:22.629817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc7e6bbd-21ee-4c58-90aa-9398d81d837d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:22.630274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc7e6bbd-21ee-4c58-90aa-9398d81d837d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:22.630699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cc7e6bbd-21ee-4c58-90aa-9398d81d837d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:22.765643 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cc7e6bbd-21ee-4c58-90aa-9398d81d837d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:22.774415 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cc7e6bbd-21ee-4c58-90aa-9398d81d837d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1697 microversion: 2.1 time: 0.158543 Oct 11 00:43:22.774986 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3549/7753] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:22 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:23.798841 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-de3d4b17-639f-40b9-8108-23b56606cfab tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:23.799477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-de3d4b17-639f-40b9-8108-23b56606cfab tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:23.807040 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de3d4b17-639f-40b9-8108-23b56606cfab tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:23.807545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de3d4b17-639f-40b9-8108-23b56606cfab tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:23.808003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de3d4b17-639f-40b9-8108-23b56606cfab tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:23.808710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de3d4b17-639f-40b9-8108-23b56606cfab tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:23.809181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de3d4b17-639f-40b9-8108-23b56606cfab tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:23.810338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-de3d4b17-639f-40b9-8108-23b56606cfab tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:23.944302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-de3d4b17-639f-40b9-8108-23b56606cfab tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:23.952173 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-de3d4b17-639f-40b9-8108-23b56606cfab tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1697 microversion: 2.1 time: 0.157300 Oct 11 00:43:23.952759 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4205/7754] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:23 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:24.976432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-585fac00-f162-4655-a870-ba50020604c6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:24.977048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-585fac00-f162-4655-a870-ba50020604c6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:24.984108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-585fac00-f162-4655-a870-ba50020604c6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:24.984594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-585fac00-f162-4655-a870-ba50020604c6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:24.985032 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-585fac00-f162-4655-a870-ba50020604c6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:24.985750 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-585fac00-f162-4655-a870-ba50020604c6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:24.986205 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-585fac00-f162-4655-a870-ba50020604c6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:24.986631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-585fac00-f162-4655-a870-ba50020604c6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:25.121674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-585fac00-f162-4655-a870-ba50020604c6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:25.129571 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-585fac00-f162-4655-a870-ba50020604c6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1697 microversion: 2.1 time: 0.157227 Oct 11 00:43:25.130144 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3550/7755] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:24 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:26.153649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-addf8e8c-2905-42ed-bf71-0177931ba498 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:26.154282 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-addf8e8c-2905-42ed-bf71-0177931ba498 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:26.161267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-addf8e8c-2905-42ed-bf71-0177931ba498 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:26.161798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-addf8e8c-2905-42ed-bf71-0177931ba498 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:26.162257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-addf8e8c-2905-42ed-bf71-0177931ba498 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:26.163343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-addf8e8c-2905-42ed-bf71-0177931ba498 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:26.163847 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-addf8e8c-2905-42ed-bf71-0177931ba498 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:26.164295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-addf8e8c-2905-42ed-bf71-0177931ba498 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:26.295476 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-addf8e8c-2905-42ed-bf71-0177931ba498 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:26.303708 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-addf8e8c-2905-42ed-bf71-0177931ba498 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1697 microversion: 2.1 time: 0.153658 Oct 11 00:43:26.304917 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4206/7756] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:26 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:27.328446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b0314e94-2d10-40a0-9b7d-6104f6fd8493 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:27.329043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b0314e94-2d10-40a0-9b7d-6104f6fd8493 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:27.335133 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0314e94-2d10-40a0-9b7d-6104f6fd8493 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:27.335614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0314e94-2d10-40a0-9b7d-6104f6fd8493 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:27.336053 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0314e94-2d10-40a0-9b7d-6104f6fd8493 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:27.336738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0314e94-2d10-40a0-9b7d-6104f6fd8493 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:27.337192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0314e94-2d10-40a0-9b7d-6104f6fd8493 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:27.337648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b0314e94-2d10-40a0-9b7d-6104f6fd8493 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:27.473115 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b0314e94-2d10-40a0-9b7d-6104f6fd8493 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:27.481672 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b0314e94-2d10-40a0-9b7d-6104f6fd8493 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1697 microversion: 2.1 time: 0.157417 Oct 11 00:43:27.482248 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3551/7757] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:27 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:28.505956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b3aaf38b-f049-4bd2-940a-76f7a261d88a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:28.507283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b3aaf38b-f049-4bd2-940a-76f7a261d88a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:28.513931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3aaf38b-f049-4bd2-940a-76f7a261d88a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:28.514427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3aaf38b-f049-4bd2-940a-76f7a261d88a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:28.514875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3aaf38b-f049-4bd2-940a-76f7a261d88a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:28.515584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3aaf38b-f049-4bd2-940a-76f7a261d88a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:28.516051 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3aaf38b-f049-4bd2-940a-76f7a261d88a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:28.516489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b3aaf38b-f049-4bd2-940a-76f7a261d88a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:28.646651 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b3aaf38b-f049-4bd2-940a-76f7a261d88a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:28.655033 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b3aaf38b-f049-4bd2-940a-76f7a261d88a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1697 microversion: 2.1 time: 0.153381 Oct 11 00:43:28.655609 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4207/7758] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:28 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:29.680234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bcc42b05-4bf1-414a-8a85-3da6068e543c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:29.680878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bcc42b05-4bf1-414a-8a85-3da6068e543c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:29.688522 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bcc42b05-4bf1-414a-8a85-3da6068e543c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:29.689002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bcc42b05-4bf1-414a-8a85-3da6068e543c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:29.689471 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bcc42b05-4bf1-414a-8a85-3da6068e543c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:29.690157 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bcc42b05-4bf1-414a-8a85-3da6068e543c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:29.690612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bcc42b05-4bf1-414a-8a85-3da6068e543c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:29.691035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bcc42b05-4bf1-414a-8a85-3da6068e543c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:29.825491 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bcc42b05-4bf1-414a-8a85-3da6068e543c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:29.833487 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bcc42b05-4bf1-414a-8a85-3da6068e543c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1697 microversion: 2.1 time: 0.158158 Oct 11 00:43:29.834056 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3552/7759] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:29 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:30.857437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5f652f0c-296e-415f-a9d4-43e8ad76b757 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:30.858096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5f652f0c-296e-415f-a9d4-43e8ad76b757 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:30.864927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f652f0c-296e-415f-a9d4-43e8ad76b757 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:30.865457 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f652f0c-296e-415f-a9d4-43e8ad76b757 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:30.866430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f652f0c-296e-415f-a9d4-43e8ad76b757 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:30.867216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f652f0c-296e-415f-a9d4-43e8ad76b757 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:30.867682 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f652f0c-296e-415f-a9d4-43e8ad76b757 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:30.868124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5f652f0c-296e-415f-a9d4-43e8ad76b757 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:30.999759 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5f652f0c-296e-415f-a9d4-43e8ad76b757 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:31.008344 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5f652f0c-296e-415f-a9d4-43e8ad76b757 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1697 microversion: 2.1 time: 0.154828 Oct 11 00:43:31.008942 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4208/7760] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:30 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:32.032523 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6167ecb8-5123-4e8d-8090-167a5ec324e4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:32.033140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6167ecb8-5123-4e8d-8090-167a5ec324e4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:32.040725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6167ecb8-5123-4e8d-8090-167a5ec324e4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:32.041207 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6167ecb8-5123-4e8d-8090-167a5ec324e4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:32.041675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6167ecb8-5123-4e8d-8090-167a5ec324e4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:32.042368 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6167ecb8-5123-4e8d-8090-167a5ec324e4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:32.042821 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6167ecb8-5123-4e8d-8090-167a5ec324e4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:32.043249 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6167ecb8-5123-4e8d-8090-167a5ec324e4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:32.180799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6167ecb8-5123-4e8d-8090-167a5ec324e4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:32.188987 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6167ecb8-5123-4e8d-8090-167a5ec324e4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1697 microversion: 2.1 time: 0.160474 Oct 11 00:43:32.189604 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3553/7761] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:32 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:33.213105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-147dc7ef-d9bd-4ce0-abaa-2c520e624be3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:33.213748 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-147dc7ef-d9bd-4ce0-abaa-2c520e624be3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:33.224099 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-147dc7ef-d9bd-4ce0-abaa-2c520e624be3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:33.225008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-147dc7ef-d9bd-4ce0-abaa-2c520e624be3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:33.225887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-147dc7ef-d9bd-4ce0-abaa-2c520e624be3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:33.227183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-147dc7ef-d9bd-4ce0-abaa-2c520e624be3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:33.228048 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-147dc7ef-d9bd-4ce0-abaa-2c520e624be3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:33.228899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-147dc7ef-d9bd-4ce0-abaa-2c520e624be3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:33.366804 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-147dc7ef-d9bd-4ce0-abaa-2c520e624be3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:33.374869 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-147dc7ef-d9bd-4ce0-abaa-2c520e624be3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1697 microversion: 2.1 time: 0.165923 Oct 11 00:43:33.375479 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4209/7762] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:33 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:34.203913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-074ce715-bff3-4102-a315-5faeb5169529 req-7ce3fbf2-0f9d-4d1e-9218-58d8b2a429b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0bff3a-e205-4a8b-a205-86f0de58e4f7", "name": "network-vif-unplugged", "status": "completed", "tag": "4e3edc61-0abe-4776-b3f0-30fc8764d1e4"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:43:34.215227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-074ce715-bff3-4102-a315-5faeb5169529 req-7ce3fbf2-0f9d-4d1e-9218-58d8b2a429b7 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:34.215711 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-074ce715-bff3-4102-a315-5faeb5169529 req-7ce3fbf2-0f9d-4d1e-9218-58d8b2a429b7 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:34.216153 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-074ce715-bff3-4102-a315-5faeb5169529 req-7ce3fbf2-0f9d-4d1e-9218-58d8b2a429b7 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:34.228474 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-074ce715-bff3-4102-a315-5faeb5169529 req-7ce3fbf2-0f9d-4d1e-9218-58d8b2a429b7 service nova] Creating event network-vif-unplugged:4e3edc61-0abe-4776-b3f0-30fc8764d1e4 for instance 5a0bff3a-e205-4a8b-a205-86f0de58e4f7 on n-h1-860864-2 Oct 11 00:43:34.234076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [req-074ce715-bff3-4102-a315-5faeb5169529 req-7ce3fbf2-0f9d-4d1e-9218-58d8b2a429b7 service nova] Instance 5a0bff3a-e205-4a8b-a205-86f0de58e4f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120614) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 00:43:34.245643 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-074ce715-bff3-4102-a315-5faeb5169529 req-7ce3fbf2-0f9d-4d1e-9218-58d8b2a429b7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045611 Oct 11 00:43:34.246411 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3554/7763] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:43:34.399363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5b082c4b-2c98-4349-b393-867693459d90 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:34.399921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5b082c4b-2c98-4349-b393-867693459d90 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:34.406858 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b082c4b-2c98-4349-b393-867693459d90 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:34.407362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b082c4b-2c98-4349-b393-867693459d90 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:34.407815 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b082c4b-2c98-4349-b393-867693459d90 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:34.408535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b082c4b-2c98-4349-b393-867693459d90 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:34.409009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b082c4b-2c98-4349-b393-867693459d90 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:34.409491 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5b082c4b-2c98-4349-b393-867693459d90 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:34.543960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5b082c4b-2c98-4349-b393-867693459d90 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:34.552873 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5b082c4b-2c98-4349-b393-867693459d90 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1696 microversion: 2.1 time: 0.158297 Oct 11 00:43:34.561712 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4210/7764] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:34 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:35.579398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-1d006b45-7d4d-44cb-b09f-eb0664b80ae4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:35.580096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-1d006b45-7d4d-44cb-b09f-eb0664b80ae4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:35.587743 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d006b45-7d4d-44cb-b09f-eb0664b80ae4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:35.588226 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d006b45-7d4d-44cb-b09f-eb0664b80ae4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:35.588742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d006b45-7d4d-44cb-b09f-eb0664b80ae4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:35.589469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d006b45-7d4d-44cb-b09f-eb0664b80ae4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:35.590003 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d006b45-7d4d-44cb-b09f-eb0664b80ae4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:35.590419 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-1d006b45-7d4d-44cb-b09f-eb0664b80ae4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:35.728637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-1d006b45-7d4d-44cb-b09f-eb0664b80ae4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:35.736431 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-1d006b45-7d4d-44cb-b09f-eb0664b80ae4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1694 microversion: 2.1 time: 0.162216 Oct 11 00:43:35.736999 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3555/7765] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:35 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:36.285254 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-dbfc3bb6-6450-4b97-92bc-09dfd67de20a req-2120d312-658b-48bb-bf22-559f9e9d5592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a0bff3a-e205-4a8b-a205-86f0de58e4f7", "tag": "4e3edc61-0abe-4776-b3f0-30fc8764d1e4"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:43:36.295855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-dbfc3bb6-6450-4b97-92bc-09dfd67de20a req-2120d312-658b-48bb-bf22-559f9e9d5592 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:36.296345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-dbfc3bb6-6450-4b97-92bc-09dfd67de20a req-2120d312-658b-48bb-bf22-559f9e9d5592 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:36.296788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-dbfc3bb6-6450-4b97-92bc-09dfd67de20a req-2120d312-658b-48bb-bf22-559f9e9d5592 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:36.308817 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-dbfc3bb6-6450-4b97-92bc-09dfd67de20a req-2120d312-658b-48bb-bf22-559f9e9d5592 service nova] Creating event network-changed:4e3edc61-0abe-4776-b3f0-30fc8764d1e4 for instance 5a0bff3a-e205-4a8b-a205-86f0de58e4f7 on n-h1-860864-2 Oct 11 00:43:36.314325 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [req-dbfc3bb6-6450-4b97-92bc-09dfd67de20a req-2120d312-658b-48bb-bf22-559f9e9d5592 service nova] Instance 5a0bff3a-e205-4a8b-a205-86f0de58e4f7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-860864-2', 'n-h1-860864-2'} {{(pid=120613) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 00:43:36.326053 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-dbfc3bb6-6450-4b97-92bc-09dfd67de20a req-2120d312-658b-48bb-bf22-559f9e9d5592 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044513 Oct 11 00:43:36.326647 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4211/7766] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:43:36.759574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-24659527-d86b-49ff-a70e-7f6ed21fe2fd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:36.760174 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-24659527-d86b-49ff-a70e-7f6ed21fe2fd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:36.767145 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24659527-d86b-49ff-a70e-7f6ed21fe2fd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:36.767639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24659527-d86b-49ff-a70e-7f6ed21fe2fd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:36.768080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24659527-d86b-49ff-a70e-7f6ed21fe2fd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:36.768776 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24659527-d86b-49ff-a70e-7f6ed21fe2fd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:36.769227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24659527-d86b-49ff-a70e-7f6ed21fe2fd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:36.769696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24659527-d86b-49ff-a70e-7f6ed21fe2fd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:36.909964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-24659527-d86b-49ff-a70e-7f6ed21fe2fd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:36.919022 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-24659527-d86b-49ff-a70e-7f6ed21fe2fd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1694 microversion: 2.1 time: 0.163376 Oct 11 00:43:36.919614 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3556/7767] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:36 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:37.944488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c6353280-c9b6-4ff6-a219-9112eccb3549 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:37.945745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c6353280-c9b6-4ff6-a219-9112eccb3549 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:37.951990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6353280-c9b6-4ff6-a219-9112eccb3549 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:37.952485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6353280-c9b6-4ff6-a219-9112eccb3549 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:37.952937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6353280-c9b6-4ff6-a219-9112eccb3549 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:37.953671 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6353280-c9b6-4ff6-a219-9112eccb3549 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:37.954141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6353280-c9b6-4ff6-a219-9112eccb3549 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:37.954584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c6353280-c9b6-4ff6-a219-9112eccb3549 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:38.095202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c6353280-c9b6-4ff6-a219-9112eccb3549 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:38.104541 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c6353280-c9b6-4ff6-a219-9112eccb3549 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1694 microversion: 2.1 time: 0.165339 Oct 11 00:43:38.105130 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4212/7768] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:37 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:39.129059 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e59a3644-982d-421f-b493-d64f5917953c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:39.129716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e59a3644-982d-421f-b493-d64f5917953c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:39.137148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e59a3644-982d-421f-b493-d64f5917953c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:39.137671 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e59a3644-982d-421f-b493-d64f5917953c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:39.138107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e59a3644-982d-421f-b493-d64f5917953c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:39.138789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e59a3644-982d-421f-b493-d64f5917953c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:39.139238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e59a3644-982d-421f-b493-d64f5917953c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:39.139660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e59a3644-982d-421f-b493-d64f5917953c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:39.271223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e59a3644-982d-421f-b493-d64f5917953c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:39.279361 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e59a3644-982d-421f-b493-d64f5917953c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1691 microversion: 2.1 time: 0.154184 Oct 11 00:43:39.279945 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3557/7769] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:39 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:39.302164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7b48260c-5845-4d1c-a1fb-37c3152eefae tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:43:39.302740 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7b48260c-5845-4d1c-a1fb-37c3152eefae tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:39.310862 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b48260c-5845-4d1c-a1fb-37c3152eefae tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:39.311359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b48260c-5845-4d1c-a1fb-37c3152eefae tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:39.311814 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b48260c-5845-4d1c-a1fb-37c3152eefae tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:39.312513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b48260c-5845-4d1c-a1fb-37c3152eefae tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:39.312985 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b48260c-5845-4d1c-a1fb-37c3152eefae tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:39.313454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7b48260c-5845-4d1c-a1fb-37c3152eefae tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:39.372607 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7b48260c-5845-4d1c-a1fb-37c3152eefae tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7/action" status: 204 len: 0 microversion: 2.1 time: 0.074144 Oct 11 00:43:39.373256 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4213/7770] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:43:39 2022] POST /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:43:39.381290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-47d9607f-d085-49e9-adbf-e59f4f1c95c2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:39.382236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-47d9607f-d085-49e9-adbf-e59f4f1c95c2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:39.388546 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47d9607f-d085-49e9-adbf-e59f4f1c95c2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:39.389047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47d9607f-d085-49e9-adbf-e59f4f1c95c2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:39.389516 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47d9607f-d085-49e9-adbf-e59f4f1c95c2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:39.390252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47d9607f-d085-49e9-adbf-e59f4f1c95c2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:39.390705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47d9607f-d085-49e9-adbf-e59f4f1c95c2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:39.391326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-47d9607f-d085-49e9-adbf-e59f4f1c95c2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:39.528398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-47d9607f-d085-49e9-adbf-e59f4f1c95c2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:39.536081 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-47d9607f-d085-49e9-adbf-e59f4f1c95c2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1691 microversion: 2.1 time: 0.158670 Oct 11 00:43:39.536656 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3558/7771] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:39 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:39.560583 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1bc05e52-1442-40a2-8a26-1ff27c90eaf9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:39.561398 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1bc05e52-1442-40a2-8a26-1ff27c90eaf9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:39.567709 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bc05e52-1442-40a2-8a26-1ff27c90eaf9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:39.568205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bc05e52-1442-40a2-8a26-1ff27c90eaf9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:39.568658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bc05e52-1442-40a2-8a26-1ff27c90eaf9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:39.569531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bc05e52-1442-40a2-8a26-1ff27c90eaf9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:39.570112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bc05e52-1442-40a2-8a26-1ff27c90eaf9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:39.570362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1bc05e52-1442-40a2-8a26-1ff27c90eaf9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:39.710937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1bc05e52-1442-40a2-8a26-1ff27c90eaf9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:39.719377 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1bc05e52-1442-40a2-8a26-1ff27c90eaf9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1691 microversion: 2.1 time: 0.163241 Oct 11 00:43:39.719967 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4214/7772] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:39 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:40.743941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-915a9dda-8c86-4924-a3ad-69787d89775f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:43:40.744639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-915a9dda-8c86-4924-a3ad-69787d89775f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:43:40.753478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-915a9dda-8c86-4924-a3ad-69787d89775f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:40.754172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-915a9dda-8c86-4924-a3ad-69787d89775f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:40.754884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-915a9dda-8c86-4924-a3ad-69787d89775f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:40.755727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-915a9dda-8c86-4924-a3ad-69787d89775f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:40.756264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-915a9dda-8c86-4924-a3ad-69787d89775f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:40.756699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-915a9dda-8c86-4924-a3ad-69787d89775f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:40.911893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-915a9dda-8c86-4924-a3ad-69787d89775f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:43:40.920454 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-915a9dda-8c86-4924-a3ad-69787d89775f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1683 microversion: 2.1 time: 0.180720 Oct 11 00:43:40.921031 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3559/7773] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:43:40 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:43:42.166168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-4a0bff6b-b310-4c85-b57d-a35b662b04cf req-cb14fcd2-f9eb-4163-8918-13840709e1ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0bff3a-e205-4a8b-a205-86f0de58e4f7", "name": "network-vif-plugged", "status": "completed", "tag": "4e3edc61-0abe-4776-b3f0-30fc8764d1e4"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:43:42.177155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4a0bff6b-b310-4c85-b57d-a35b662b04cf req-cb14fcd2-f9eb-4163-8918-13840709e1ff service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:43:42.177711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4a0bff6b-b310-4c85-b57d-a35b662b04cf req-cb14fcd2-f9eb-4163-8918-13840709e1ff service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:43:42.178161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4a0bff6b-b310-4c85-b57d-a35b662b04cf req-cb14fcd2-f9eb-4163-8918-13840709e1ff service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:43:42.190008 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-4a0bff6b-b310-4c85-b57d-a35b662b04cf req-cb14fcd2-f9eb-4163-8918-13840709e1ff service nova] Creating event network-vif-plugged:4e3edc61-0abe-4776-b3f0-30fc8764d1e4 for instance 5a0bff3a-e205-4a8b-a205-86f0de58e4f7 on n-h1-860864-2 Oct 11 00:43:42.195174 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-4a0bff6b-b310-4c85-b57d-a35b662b04cf req-cb14fcd2-f9eb-4163-8918-13840709e1ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033363 Oct 11 00:43:42.195808 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4215/7774] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:44:13.147092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-629ffab6-6caf-432a-b0b1-9a9939bb40e6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:44:13.150916 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-629ffab6-6caf-432a-b0b1-9a9939bb40e6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:44:13.156639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=34 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:44:13.157303 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:44:13.158859 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-629ffab6-6caf-432a-b0b1-9a9939bb40e6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:13.159439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-629ffab6-6caf-432a-b0b1-9a9939bb40e6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:13.159930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-629ffab6-6caf-432a-b0b1-9a9939bb40e6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:13.160708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-629ffab6-6caf-432a-b0b1-9a9939bb40e6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:13.161168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-629ffab6-6caf-432a-b0b1-9a9939bb40e6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:13.161645 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-629ffab6-6caf-432a-b0b1-9a9939bb40e6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:13.223504 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-629ffab6-6caf-432a-b0b1-9a9939bb40e6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7/action" status: 200 len: 24575 microversion: 2.1 time: 0.080255 Oct 11 00:44:13.224198 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3560/7775] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:44:13 2022] POST /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7/action => generated 24575 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 00:44:37.122023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=30 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:44:37.130638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:44:37.131576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:44:37.136937 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5fb6a115-eb44-403e-88de-f40a33f042d8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:44:37.137334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:44:37.140846 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5fb6a115-eb44-403e-88de-f40a33f042d8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:44:37.149473 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fb6a115-eb44-403e-88de-f40a33f042d8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:37.150085 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fb6a115-eb44-403e-88de-f40a33f042d8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:37.150612 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fb6a115-eb44-403e-88de-f40a33f042d8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:37.151404 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fb6a115-eb44-403e-88de-f40a33f042d8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:37.151947 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fb6a115-eb44-403e-88de-f40a33f042d8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:37.152452 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5fb6a115-eb44-403e-88de-f40a33f042d8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:37.183545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5fb6a115-eb44-403e-88de-f40a33f042d8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:44:37.197648 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-0bfcbb4e-db88-42a5-ac3b-22525e24bab8 req-1ab6bab9-80a3-4c0e-a2d3-54cbb290bbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a0bff3a-e205-4a8b-a205-86f0de58e4f7", "tag": "4e3edc61-0abe-4776-b3f0-30fc8764d1e4"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:44:37.209043 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0bfcbb4e-db88-42a5-ac3b-22525e24bab8 req-1ab6bab9-80a3-4c0e-a2d3-54cbb290bbf9 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:37.209466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0bfcbb4e-db88-42a5-ac3b-22525e24bab8 req-1ab6bab9-80a3-4c0e-a2d3-54cbb290bbf9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:37.209903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-0bfcbb4e-db88-42a5-ac3b-22525e24bab8 req-1ab6bab9-80a3-4c0e-a2d3-54cbb290bbf9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:37.221970 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-0bfcbb4e-db88-42a5-ac3b-22525e24bab8 req-1ab6bab9-80a3-4c0e-a2d3-54cbb290bbf9 service nova] Creating event network-changed:4e3edc61-0abe-4776-b3f0-30fc8764d1e4 for instance 5a0bff3a-e205-4a8b-a205-86f0de58e4f7 on n-h1-860864-2 Oct 11 00:44:37.228146 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-0bfcbb4e-db88-42a5-ac3b-22525e24bab8 req-1ab6bab9-80a3-4c0e-a2d3-54cbb290bbf9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102702 Oct 11 00:44:37.229363 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3561/7776] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:44:37.274849 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5fb6a115-eb44-403e-88de-f40a33f042d8 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 204 len: 0 microversion: 2.1 time: 0.154346 Oct 11 00:44:37.278892 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4216/7777] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:44:37 2022] DELETE /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:44:37.284804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-72a53ef8-c560-4af7-a5b0-5811fe2facaa tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:44:37.285533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-72a53ef8-c560-4af7-a5b0-5811fe2facaa tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:44:37.292355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72a53ef8-c560-4af7-a5b0-5811fe2facaa tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:37.293361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72a53ef8-c560-4af7-a5b0-5811fe2facaa tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:37.293361 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72a53ef8-c560-4af7-a5b0-5811fe2facaa tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:37.293992 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72a53ef8-c560-4af7-a5b0-5811fe2facaa tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:37.294453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72a53ef8-c560-4af7-a5b0-5811fe2facaa tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:37.294938 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-72a53ef8-c560-4af7-a5b0-5811fe2facaa tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:37.435873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-72a53ef8-c560-4af7-a5b0-5811fe2facaa tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:44:37.443819 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-72a53ef8-c560-4af7-a5b0-5811fe2facaa tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1689 microversion: 2.1 time: 0.163645 Oct 11 00:44:37.444726 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3562/7778] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:44:37 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:44:38.469243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7f2a37cb-d679-41a3-b479-b45c7a3a99c7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:44:38.470009 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7f2a37cb-d679-41a3-b479-b45c7a3a99c7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:44:38.476950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f2a37cb-d679-41a3-b479-b45c7a3a99c7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:38.477495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f2a37cb-d679-41a3-b479-b45c7a3a99c7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:38.477949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f2a37cb-d679-41a3-b479-b45c7a3a99c7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:38.478657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f2a37cb-d679-41a3-b479-b45c7a3a99c7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:38.479122 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f2a37cb-d679-41a3-b479-b45c7a3a99c7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:38.479562 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7f2a37cb-d679-41a3-b479-b45c7a3a99c7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:38.620539 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7f2a37cb-d679-41a3-b479-b45c7a3a99c7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:44:38.628600 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7f2a37cb-d679-41a3-b479-b45c7a3a99c7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 200 len: 1689 microversion: 2.1 time: 0.164288 Oct 11 00:44:38.629173 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4217/7779] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:44:38 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:44:39.217278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-9d76afc9-c6a1-4be7-9255-8c07d76fc8f6 req-064ec054-81e6-481b-9185-da61142baa81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0bff3a-e205-4a8b-a205-86f0de58e4f7", "name": "network-vif-deleted", "tag": "4e3edc61-0abe-4776-b3f0-30fc8764d1e4"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:44:39.228310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9d76afc9-c6a1-4be7-9255-8c07d76fc8f6 req-064ec054-81e6-481b-9185-da61142baa81 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:39.228788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9d76afc9-c6a1-4be7-9255-8c07d76fc8f6 req-064ec054-81e6-481b-9185-da61142baa81 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:39.229222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-9d76afc9-c6a1-4be7-9255-8c07d76fc8f6 req-064ec054-81e6-481b-9185-da61142baa81 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:39.243041 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-9d76afc9-c6a1-4be7-9255-8c07d76fc8f6 req-064ec054-81e6-481b-9185-da61142baa81 service nova] Creating event network-vif-deleted:4e3edc61-0abe-4776-b3f0-30fc8764d1e4 for instance 5a0bff3a-e205-4a8b-a205-86f0de58e4f7 on n-h1-860864-2 Oct 11 00:44:39.248797 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-9d76afc9-c6a1-4be7-9255-8c07d76fc8f6 req-064ec054-81e6-481b-9185-da61142baa81 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102161 Oct 11 00:44:39.250010 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3563/7780] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:44:39.653038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-96ad5ef1-8b42-4bff-ad0b-058667ffc858 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:44:39.653703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-96ad5ef1-8b42-4bff-ad0b-058667ffc858 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 5a0bff3a-e205-4a8b-a205-86f0de58e4f7] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:44:39.661264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96ad5ef1-8b42-4bff-ad0b-058667ffc858 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:39.661743 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96ad5ef1-8b42-4bff-ad0b-058667ffc858 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:39.662204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96ad5ef1-8b42-4bff-ad0b-058667ffc858 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:39.662921 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96ad5ef1-8b42-4bff-ad0b-058667ffc858 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:39.663394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96ad5ef1-8b42-4bff-ad0b-058667ffc858 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:39.663837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-96ad5ef1-8b42-4bff-ad0b-058667ffc858 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:39.678458 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-96ad5ef1-8b42-4bff-ad0b-058667ffc858 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] HTTP exception thrown: Instance 5a0bff3a-e205-4a8b-a205-86f0de58e4f7 could not be found. Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-96ad5ef1-8b42-4bff-ad0b-058667ffc858 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Request method failure captured: Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 HTTP/1.1 Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLrbIgsnFdcSLuDWSG0BXZJgQ-0aoLaqeEz8A0UaMKXZIvv_xdAg16W-tgk2ATxwWwXTsmkAKVRXeF_uFIvkXsNHX3CXRwU3FdonpA1rskUDVW9HI_SHIbYvWd9DxLNyTUfkF2HQNHtRL2_zgZlbWNH1devNuUVY45TC5ljRE7Bwb78 Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 60c10fdea561499c9f87fac524ca4113 Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-886185438 Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60c10fdea561499c9f87fac524ca4113"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60c10fdea561499c9f87fac524ca4113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60c10fdea561499c9f87fac524ca4113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60c10fdea561499c9f87fac524ca4113", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestNetworkAdvancedServerOps-886185438 Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 60c10fdea561499c9f87fac524ca4113 Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-886185438 Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestNetworkAdvancedServerOps-886185438-project Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 84c8a15123fb4b0292320555bceb3681 Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestNetworkAdvancedServerOps-886185438-project Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 5a0bff3a-e205-4a8b-a205-86f0de58e4f7 could not be found. Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '5a0bff3a-e205-4a8b-a205-86f0de58e4f7'} Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a0bff3a-e205-4a8b-a205-86f0de58e4f7 could not be found. Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a0bff3a-e205-4a8b-a205-86f0de58e4f7 could not be found. Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:44:39.680096 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:44:39.686193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:44:39.686193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:44:39.686193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:44:39.686193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:44:39.686193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:44:39.686193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:44:39.686193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a0bff3a-e205-4a8b-a205-86f0de58e4f7 could not be found. Oct 11 00:44:39.686193 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:44:39.686193 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-96ad5ef1-8b42-4bff-ad0b-058667ffc858 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Returning 404 to user: Instance 5a0bff3a-e205-4a8b-a205-86f0de58e4f7 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:44:39.686193 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-96ad5ef1-8b42-4bff-ad0b-058667ffc858 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7" status: 404 len: 111 microversion: 2.1 time: 0.033828 Oct 11 00:44:39.686193 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4218/7781] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:44:39 2022] GET /compute/v2.1/servers/5a0bff3a-e205-4a8b-a205-86f0de58e4f7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:44:42.995173 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8ea5649b-40a2-4c26-8e41-d68f0f103b67 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '.version_select at 0x7f662a9c1f70>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:44:43.017910 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8ea5649b-40a2-4c26-8e41-d68f0f103b67 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2011732679" status: 202 len: 0 microversion: 2.1 time: 0.027471 Oct 11 00:44:43.018511 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3564/7782] 10.222.0.23 () {58 vars in 1284 bytes} [Tue Oct 11 00:44:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2011732679 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:44:43.044064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-94a87fa2-e1d0-4a8e-b448-69e8f8046d0a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'create', calling method: .version_select at 0x7f662af7e280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1694004154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTZhQcTz/t0URWBCROCEtR9DgG192dX0xVpcFijbV5wo3qYfWy5E3fkNKCfH+Tw3WEjmElVcL4Ya6W/EkqtYQzEGeDEzZ439JTvBj9UAcsH+OGD1xTCBKvhzY9Xzw1BAw=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:44:43.051062 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:44:43.051385 n-d-860864-2 devstack@n-api.service[120613]: Tue Oct 11 00:44:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.23) !!! Oct 11 00:44:43.066628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-94a87fa2-e1d0-4a8e-b448-69e8f8046d0a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Getting quotas for project 60c10fdea561499c9f87fac524ca4113. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:44:43.072494 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-94a87fa2-e1d0-4a8e-b448-69e8f8046d0a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Getting quotas for user 84c8a15123fb4b0292320555bceb3681 and project 60c10fdea561499c9f87fac524ca4113. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:44:43.097369 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-94a87fa2-e1d0-4a8e-b448-69e8f8046d0a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.058000 Oct 11 00:44:43.098061 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4219/7783] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 11 00:44:43 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:44:49.053787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-acb233b3-4245-4718-9533-63c6e05fc273 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1418341140", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "e1c8d674-8ad1-4d60-9ca4-9f87767cf4b4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1694004154", "security_groups": [{"name": "tempest-secgroup-smoke-1185831847"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:44:49.180484 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-acb233b3-4245-4718-9533-63c6e05fc273 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] validate_networks() for [('e1c8d674-8ad1-4d60-9ca4-9f87767cf4b4', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:44:49.234869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=10 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:44:49.597481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-acb233b3-4245-4718-9533-63c6e05fc273 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:44:49.597920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-acb233b3-4245-4718-9533-63c6e05fc273 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:44:49.598407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-acb233b3-4245-4718-9533-63c6e05fc273 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:44:49.598819 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-acb233b3-4245-4718-9533-63c6e05fc273 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:44:49.599236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-acb233b3-4245-4718-9533-63c6e05fc273 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:44:49.608945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acb233b3-4245-4718-9533-63c6e05fc273 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:49.609452 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acb233b3-4245-4718-9533-63c6e05fc273 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:49.609921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acb233b3-4245-4718-9533-63c6e05fc273 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:49.610849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acb233b3-4245-4718-9533-63c6e05fc273 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:49.611373 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acb233b3-4245-4718-9533-63c6e05fc273 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:49.611800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-acb233b3-4245-4718-9533-63c6e05fc273 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:49.632293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-acb233b3-4245-4718-9533-63c6e05fc273 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Getting quotas for project 60c10fdea561499c9f87fac524ca4113. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:44:49.639001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-acb233b3-4245-4718-9533-63c6e05fc273 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Getting quotas for user 84c8a15123fb4b0292320555bceb3681 and project 60c10fdea561499c9f87fac524ca4113. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:44:49.652737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-acb233b3-4245-4718-9533-63c6e05fc273 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:44:49.655561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-acb233b3-4245-4718-9533-63c6e05fc273 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:44:49.706448 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-acb233b3-4245-4718-9533-63c6e05fc273 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.658245 Oct 11 00:44:49.707440 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3565/7784] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:44:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:44:49.717552 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:44:49.723080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2f655852-3293-4e0f-8804-24d5c250e989 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:44:49.723907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2f655852-3293-4e0f-8804-24d5c250e989 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:44:49.799516 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2f655852-3293-4e0f-8804-24d5c250e989 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:44:49.808017 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2f655852-3293-4e0f-8804-24d5c250e989 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1267 microversion: 2.1 time: 0.091902 Oct 11 00:44:49.808818 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4220/7785] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:44:49 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:44:50.849617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d54436dd-52bb-47a8-a6cb-e9bc3de1343d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:44:50.850958 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d54436dd-52bb-47a8-a6cb-e9bc3de1343d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:44:50.870134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d54436dd-52bb-47a8-a6cb-e9bc3de1343d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:50.871104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d54436dd-52bb-47a8-a6cb-e9bc3de1343d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:50.872170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d54436dd-52bb-47a8-a6cb-e9bc3de1343d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:50.893911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d54436dd-52bb-47a8-a6cb-e9bc3de1343d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:50.898469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d54436dd-52bb-47a8-a6cb-e9bc3de1343d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:50.899580 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d54436dd-52bb-47a8-a6cb-e9bc3de1343d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:51.036698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d54436dd-52bb-47a8-a6cb-e9bc3de1343d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:44:51.054690 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d54436dd-52bb-47a8-a6cb-e9bc3de1343d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1327 microversion: 2.1 time: 0.221323 Oct 11 00:44:51.054690 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3566/7786] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:44:50 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1327 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:44:52.077715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9d3d603d-28fd-4af2-8ca4-57f0a804422c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:44:52.078356 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9d3d603d-28fd-4af2-8ca4-57f0a804422c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:44:52.086116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d3d603d-28fd-4af2-8ca4-57f0a804422c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:52.086713 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d3d603d-28fd-4af2-8ca4-57f0a804422c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:52.087197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d3d603d-28fd-4af2-8ca4-57f0a804422c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:52.087941 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d3d603d-28fd-4af2-8ca4-57f0a804422c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:52.088424 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d3d603d-28fd-4af2-8ca4-57f0a804422c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:52.088871 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9d3d603d-28fd-4af2-8ca4-57f0a804422c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:52.297834 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9d3d603d-28fd-4af2-8ca4-57f0a804422c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:44:52.306574 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9d3d603d-28fd-4af2-8ca4-57f0a804422c tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1393 microversion: 2.1 time: 0.232023 Oct 11 00:44:52.307270 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4221/7787] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:44:52 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1393 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:44:52.566991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-a605e4c5-9c09-422f-af51-fd1a736bfe20 req-9d63bcff-c650-4635-9fd1-56366a7b30cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b308f4c-a107-401d-ae35-24986456f2a6", "tag": "b7a6cb4a-9460-4568-b6b5-7049ad3a0a6d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:44:52.582831 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a605e4c5-9c09-422f-af51-fd1a736bfe20 req-9d63bcff-c650-4635-9fd1-56366a7b30cf service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:52.583328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a605e4c5-9c09-422f-af51-fd1a736bfe20 req-9d63bcff-c650-4635-9fd1-56366a7b30cf service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:52.583741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-a605e4c5-9c09-422f-af51-fd1a736bfe20 req-9d63bcff-c650-4635-9fd1-56366a7b30cf service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:52.598613 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-a605e4c5-9c09-422f-af51-fd1a736bfe20 req-9d63bcff-c650-4635-9fd1-56366a7b30cf service nova] Creating event network-changed:b7a6cb4a-9460-4568-b6b5-7049ad3a0a6d for instance 2b308f4c-a107-401d-ae35-24986456f2a6 on n-h1-860864-2 Oct 11 00:44:52.605904 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-a605e4c5-9c09-422f-af51-fd1a736bfe20 req-9d63bcff-c650-4635-9fd1-56366a7b30cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046146 Oct 11 00:44:52.606825 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3567/7788] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:44:53.330141 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8d39f75c-1d69-4d6e-bd13-9a66e80cad6d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:44:53.330695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8d39f75c-1d69-4d6e-bd13-9a66e80cad6d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:44:53.338869 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d39f75c-1d69-4d6e-bd13-9a66e80cad6d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:53.339373 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d39f75c-1d69-4d6e-bd13-9a66e80cad6d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:53.339826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d39f75c-1d69-4d6e-bd13-9a66e80cad6d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:53.340531 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d39f75c-1d69-4d6e-bd13-9a66e80cad6d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:53.340996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d39f75c-1d69-4d6e-bd13-9a66e80cad6d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:53.341546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8d39f75c-1d69-4d6e-bd13-9a66e80cad6d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:53.484511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8d39f75c-1d69-4d6e-bd13-9a66e80cad6d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:44:53.492502 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8d39f75c-1d69-4d6e-bd13-9a66e80cad6d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1393 microversion: 2.1 time: 0.166387 Oct 11 00:44:53.494013 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4222/7789] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:44:53 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:44:54.517080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-da375f80-dbd5-44c4-8fae-6c6ea4f06ad2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:44:54.517811 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-da375f80-dbd5-44c4-8fae-6c6ea4f06ad2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:44:54.525328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da375f80-dbd5-44c4-8fae-6c6ea4f06ad2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:54.525827 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da375f80-dbd5-44c4-8fae-6c6ea4f06ad2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:54.526265 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da375f80-dbd5-44c4-8fae-6c6ea4f06ad2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:54.526946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da375f80-dbd5-44c4-8fae-6c6ea4f06ad2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:54.527392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da375f80-dbd5-44c4-8fae-6c6ea4f06ad2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:54.527813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da375f80-dbd5-44c4-8fae-6c6ea4f06ad2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:54.669460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-da375f80-dbd5-44c4-8fae-6c6ea4f06ad2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:44:54.677459 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-da375f80-dbd5-44c4-8fae-6c6ea4f06ad2 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1393 microversion: 2.1 time: 0.164733 Oct 11 00:44:54.678042 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3568/7790] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:44:54 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:44:55.701828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3ae0cf2a-b723-4422-9b86-6b2d2c24a781 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:44:55.702466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3ae0cf2a-b723-4422-9b86-6b2d2c24a781 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:44:55.709466 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ae0cf2a-b723-4422-9b86-6b2d2c24a781 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:55.709980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ae0cf2a-b723-4422-9b86-6b2d2c24a781 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:55.710438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ae0cf2a-b723-4422-9b86-6b2d2c24a781 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:55.711154 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ae0cf2a-b723-4422-9b86-6b2d2c24a781 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:55.711772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ae0cf2a-b723-4422-9b86-6b2d2c24a781 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:55.712368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3ae0cf2a-b723-4422-9b86-6b2d2c24a781 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:55.845534 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3ae0cf2a-b723-4422-9b86-6b2d2c24a781 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:44:55.854873 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3ae0cf2a-b723-4422-9b86-6b2d2c24a781 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1393 microversion: 2.1 time: 0.156657 Oct 11 00:44:55.855466 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4223/7791] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:44:55 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:44:56.879350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-70aa4363-6bc5-4349-9b5f-f846858ce358 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:44:56.879971 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-70aa4363-6bc5-4349-9b5f-f846858ce358 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:44:56.888210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70aa4363-6bc5-4349-9b5f-f846858ce358 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:56.888696 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70aa4363-6bc5-4349-9b5f-f846858ce358 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:56.889135 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70aa4363-6bc5-4349-9b5f-f846858ce358 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:56.890202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70aa4363-6bc5-4349-9b5f-f846858ce358 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:56.890665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70aa4363-6bc5-4349-9b5f-f846858ce358 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:56.891102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-70aa4363-6bc5-4349-9b5f-f846858ce358 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:57.028983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-70aa4363-6bc5-4349-9b5f-f846858ce358 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:44:57.036779 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-70aa4363-6bc5-4349-9b5f-f846858ce358 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1393 microversion: 2.1 time: 0.161989 Oct 11 00:44:57.037370 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3569/7792] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:44:56 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:44:58.060307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-601af761-631a-48a2-8cc7-9960f5eeee98 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:44:58.060950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-601af761-631a-48a2-8cc7-9960f5eeee98 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:44:58.067900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-601af761-631a-48a2-8cc7-9960f5eeee98 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:58.068357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-601af761-631a-48a2-8cc7-9960f5eeee98 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:58.068817 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-601af761-631a-48a2-8cc7-9960f5eeee98 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:58.069565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-601af761-631a-48a2-8cc7-9960f5eeee98 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:58.070045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-601af761-631a-48a2-8cc7-9960f5eeee98 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:58.070495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-601af761-631a-48a2-8cc7-9960f5eeee98 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:58.204455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-601af761-631a-48a2-8cc7-9960f5eeee98 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:44:58.213083 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-601af761-631a-48a2-8cc7-9960f5eeee98 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1393 microversion: 2.1 time: 0.157291 Oct 11 00:44:58.213715 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4224/7793] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:44:58 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:44:59.236020 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eea204e3-03db-48fc-a01a-3bc196c6ba06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:44:59.236634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eea204e3-03db-48fc-a01a-3bc196c6ba06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:44:59.244192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eea204e3-03db-48fc-a01a-3bc196c6ba06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:59.244674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eea204e3-03db-48fc-a01a-3bc196c6ba06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:59.245134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eea204e3-03db-48fc-a01a-3bc196c6ba06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:59.245842 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eea204e3-03db-48fc-a01a-3bc196c6ba06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:44:59.246291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eea204e3-03db-48fc-a01a-3bc196c6ba06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:44:59.246712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eea204e3-03db-48fc-a01a-3bc196c6ba06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:44:59.379868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-eea204e3-03db-48fc-a01a-3bc196c6ba06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:44:59.387802 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eea204e3-03db-48fc-a01a-3bc196c6ba06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1393 microversion: 2.1 time: 0.155738 Oct 11 00:44:59.388394 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3570/7794] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:44:59 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:45:00.410490 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-68cc1019-a6fc-4520-86c6-3d1a60ea4fb3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:45:00.411074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-68cc1019-a6fc-4520-86c6-3d1a60ea4fb3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:45:00.413987 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:45:00.419782 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68cc1019-a6fc-4520-86c6-3d1a60ea4fb3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:45:00.420294 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68cc1019-a6fc-4520-86c6-3d1a60ea4fb3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:45:00.420755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68cc1019-a6fc-4520-86c6-3d1a60ea4fb3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:45:00.421504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68cc1019-a6fc-4520-86c6-3d1a60ea4fb3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:45:00.421978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68cc1019-a6fc-4520-86c6-3d1a60ea4fb3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:45:00.422425 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-68cc1019-a6fc-4520-86c6-3d1a60ea4fb3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:45:00.477260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-f850e789-5370-4c36-9caf-adb13cd5bebb req-77616b5e-baef-4cc5-bed5-a455fae9852b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b308f4c-a107-401d-ae35-24986456f2a6", "name": "network-vif-plugged", "status": "completed", "tag": "b7a6cb4a-9460-4568-b6b5-7049ad3a0a6d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:45:00.482633 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:45:00.483322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:45:00.490682 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f850e789-5370-4c36-9caf-adb13cd5bebb req-77616b5e-baef-4cc5-bed5-a455fae9852b service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:45:00.491164 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f850e789-5370-4c36-9caf-adb13cd5bebb req-77616b5e-baef-4cc5-bed5-a455fae9852b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:45:00.491597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-f850e789-5370-4c36-9caf-adb13cd5bebb req-77616b5e-baef-4cc5-bed5-a455fae9852b service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:45:00.503983 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-f850e789-5370-4c36-9caf-adb13cd5bebb req-77616b5e-baef-4cc5-bed5-a455fae9852b service nova] Creating event network-vif-plugged:b7a6cb4a-9460-4568-b6b5-7049ad3a0a6d for instance 2b308f4c-a107-401d-ae35-24986456f2a6 on n-h1-860864-2 Oct 11 00:45:00.509106 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-f850e789-5370-4c36-9caf-adb13cd5bebb req-77616b5e-baef-4cc5-bed5-a455fae9852b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036158 Oct 11 00:45:00.510404 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3571/7795] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:45:00.575907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-68cc1019-a6fc-4520-86c6-3d1a60ea4fb3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:45:00.583945 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-68cc1019-a6fc-4520-86c6-3d1a60ea4fb3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1393 microversion: 2.1 time: 0.177419 Oct 11 00:45:00.584541 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4225/7796] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:45:00 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1393 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:45:01.610146 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-58932386-ab46-44d1-9280-d027901e160f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:45:01.610868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-58932386-ab46-44d1-9280-d027901e160f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:45:01.618315 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58932386-ab46-44d1-9280-d027901e160f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:45:01.619527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58932386-ab46-44d1-9280-d027901e160f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:45:01.620127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58932386-ab46-44d1-9280-d027901e160f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:45:01.620846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58932386-ab46-44d1-9280-d027901e160f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:45:01.621364 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58932386-ab46-44d1-9280-d027901e160f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:45:01.622061 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-58932386-ab46-44d1-9280-d027901e160f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:45:01.763690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-58932386-ab46-44d1-9280-d027901e160f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:45:01.771423 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-58932386-ab46-44d1-9280-d027901e160f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1393 microversion: 2.1 time: 0.166666 Oct 11 00:45:01.771999 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3572/7797] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:45:01 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:45:02.794857 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b73a563c-e161-49bf-bee4-98a26c943c4a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:45:02.795513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b73a563c-e161-49bf-bee4-98a26c943c4a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:45:02.802527 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b73a563c-e161-49bf-bee4-98a26c943c4a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:45:02.803026 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b73a563c-e161-49bf-bee4-98a26c943c4a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:45:02.803481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b73a563c-e161-49bf-bee4-98a26c943c4a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:45:02.804184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b73a563c-e161-49bf-bee4-98a26c943c4a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:45:02.804650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b73a563c-e161-49bf-bee4-98a26c943c4a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:45:02.805090 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b73a563c-e161-49bf-bee4-98a26c943c4a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:45:02.938875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b73a563c-e161-49bf-bee4-98a26c943c4a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:45:02.946737 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b73a563c-e161-49bf-bee4-98a26c943c4a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1565 microversion: 2.1 time: 0.156226 Oct 11 00:45:02.947943 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4226/7798] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:45:02 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:45:02.969838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-73f0e17a-913f-47e5-81e0-a32d930d3385 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:45:02.970480 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-73f0e17a-913f-47e5-81e0-a32d930d3385 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:45:02.977288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73f0e17a-913f-47e5-81e0-a32d930d3385 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:45:02.977813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73f0e17a-913f-47e5-81e0-a32d930d3385 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:45:02.978769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73f0e17a-913f-47e5-81e0-a32d930d3385 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:45:02.979457 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73f0e17a-913f-47e5-81e0-a32d930d3385 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:45:02.979920 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73f0e17a-913f-47e5-81e0-a32d930d3385 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:45:02.980350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-73f0e17a-913f-47e5-81e0-a32d930d3385 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:45:03.111501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-73f0e17a-913f-47e5-81e0-a32d930d3385 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:45:03.120081 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-73f0e17a-913f-47e5-81e0-a32d930d3385 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1565 microversion: 2.1 time: 0.154076 Oct 11 00:45:03.120661 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3573/7799] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:45:02 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:45:04.690614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ac6d05b8-839e-4e6b-ba01-b261251d5eb3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:45:04.691486 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ac6d05b8-839e-4e6b-ba01-b261251d5eb3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:45:04.692595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-3e24ef58-3c7d-44c4-8e6e-33a9627c34d3 req-26173254-ca45-4a3c-8ec0-31fb5e8dce3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b308f4c-a107-401d-ae35-24986456f2a6", "tag": "b7a6cb4a-9460-4568-b6b5-7049ad3a0a6d"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:45:04.699124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac6d05b8-839e-4e6b-ba01-b261251d5eb3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:45:04.699708 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac6d05b8-839e-4e6b-ba01-b261251d5eb3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:45:04.700233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac6d05b8-839e-4e6b-ba01-b261251d5eb3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:45:04.701036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac6d05b8-839e-4e6b-ba01-b261251d5eb3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:45:04.701728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac6d05b8-839e-4e6b-ba01-b261251d5eb3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:45:04.702533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ac6d05b8-839e-4e6b-ba01-b261251d5eb3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:45:04.703148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3e24ef58-3c7d-44c4-8e6e-33a9627c34d3 req-26173254-ca45-4a3c-8ec0-31fb5e8dce3d service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:45:04.703635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3e24ef58-3c7d-44c4-8e6e-33a9627c34d3 req-26173254-ca45-4a3c-8ec0-31fb5e8dce3d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:45:04.704456 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-3e24ef58-3c7d-44c4-8e6e-33a9627c34d3 req-26173254-ca45-4a3c-8ec0-31fb5e8dce3d service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:45:04.716867 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-3e24ef58-3c7d-44c4-8e6e-33a9627c34d3 req-26173254-ca45-4a3c-8ec0-31fb5e8dce3d service nova] Creating event network-changed:b7a6cb4a-9460-4568-b6b5-7049ad3a0a6d for instance 2b308f4c-a107-401d-ae35-24986456f2a6 on n-h1-860864-2 Oct 11 00:45:04.722496 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-3e24ef58-3c7d-44c4-8e6e-33a9627c34d3 req-26173254-ca45-4a3c-8ec0-31fb5e8dce3d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033705 Oct 11 00:45:04.723633 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3574/7800] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:45:04.932264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ac6d05b8-839e-4e6b-ba01-b261251d5eb3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:45:04.941202 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ac6d05b8-839e-4e6b-ba01-b261251d5eb3 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1565 microversion: 2.1 time: 0.254679 Oct 11 00:45:04.941927 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4227/7801] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:45:04 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1565 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:45:36.223254 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:45:36.224127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=44 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:45:36.228608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c6b04e05-ea23-48e2-9109-5a7fffb5cc5e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:45:36.230927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c6b04e05-ea23-48e2-9109-5a7fffb5cc5e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:45:36.240148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6b04e05-ea23-48e2-9109-5a7fffb5cc5e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:45:36.240641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6b04e05-ea23-48e2-9109-5a7fffb5cc5e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:45:36.241084 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6b04e05-ea23-48e2-9109-5a7fffb5cc5e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:45:36.241822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6b04e05-ea23-48e2-9109-5a7fffb5cc5e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:45:36.242283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6b04e05-ea23-48e2-9109-5a7fffb5cc5e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:45:36.242713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c6b04e05-ea23-48e2-9109-5a7fffb5cc5e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:45:36.311016 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c6b04e05-ea23-48e2-9109-5a7fffb5cc5e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6/action" status: 200 len: 24568 microversion: 2.1 time: 0.090852 Oct 11 00:45:36.311960 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3575/7802] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:45:36 2022] POST /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6/action => generated 24568 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 00:46:06.748309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:46:06.749123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=42 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:46:06.754330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-01d3272b-bd84-420a-ba9b-002e2a528087 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:46:06.761792 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01d3272b-bd84-420a-ba9b-002e2a528087 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:06.762295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01d3272b-bd84-420a-ba9b-002e2a528087 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:06.762751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-01d3272b-bd84-420a-ba9b-002e2a528087 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:06.786721 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-01d3272b-bd84-420a-ba9b-002e2a528087 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Going to try to stop instance {{(pid=120613) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 00:46:06.831451 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-01d3272b-bd84-420a-ba9b-002e2a528087 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6/action" status: 202 len: 0 microversion: 2.1 time: 0.084733 Oct 11 00:46:06.832074 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4228/7803] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:46:06 2022] POST /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:46:06.841403 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a5dc9562-0236-43df-9555-767d9bc2f6ac tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:46:06.842160 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a5dc9562-0236-43df-9555-767d9bc2f6ac tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:46:06.844854 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:46:06.845478 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:46:06.852180 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5dc9562-0236-43df-9555-767d9bc2f6ac tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:06.852657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5dc9562-0236-43df-9555-767d9bc2f6ac tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:06.853098 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5dc9562-0236-43df-9555-767d9bc2f6ac tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:06.853995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5dc9562-0236-43df-9555-767d9bc2f6ac tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:06.854462 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5dc9562-0236-43df-9555-767d9bc2f6ac tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:06.854889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5dc9562-0236-43df-9555-767d9bc2f6ac tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:06.992788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a5dc9562-0236-43df-9555-767d9bc2f6ac tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:46:07.000563 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a5dc9562-0236-43df-9555-767d9bc2f6ac tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1694 microversion: 2.1 time: 0.163619 Oct 11 00:46:07.001140 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3576/7804] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:46:06 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:46:08.029306 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7c41a540-1eb3-4c6e-bc27-074abcb859d4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:46:08.030137 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7c41a540-1eb3-4c6e-bc27-074abcb859d4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:46:08.036890 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c41a540-1eb3-4c6e-bc27-074abcb859d4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:08.037434 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c41a540-1eb3-4c6e-bc27-074abcb859d4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:08.037901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c41a540-1eb3-4c6e-bc27-074abcb859d4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:08.038617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c41a540-1eb3-4c6e-bc27-074abcb859d4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:08.039089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c41a540-1eb3-4c6e-bc27-074abcb859d4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:08.039536 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7c41a540-1eb3-4c6e-bc27-074abcb859d4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:08.258054 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7c41a540-1eb3-4c6e-bc27-074abcb859d4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:46:08.265886 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7c41a540-1eb3-4c6e-bc27-074abcb859d4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1694 microversion: 2.1 time: 0.241920 Oct 11 00:46:08.266473 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4229/7805] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:46:08 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1694 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:46:09.290828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f2eb0f81-c51b-46c5-bcba-728249dd69d9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:46:09.291451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f2eb0f81-c51b-46c5-bcba-728249dd69d9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:46:09.298418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2eb0f81-c51b-46c5-bcba-728249dd69d9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:09.298907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2eb0f81-c51b-46c5-bcba-728249dd69d9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:09.299349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2eb0f81-c51b-46c5-bcba-728249dd69d9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:09.300050 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2eb0f81-c51b-46c5-bcba-728249dd69d9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:09.300505 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2eb0f81-c51b-46c5-bcba-728249dd69d9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:09.300944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f2eb0f81-c51b-46c5-bcba-728249dd69d9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:09.432996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f2eb0f81-c51b-46c5-bcba-728249dd69d9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:46:09.441564 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f2eb0f81-c51b-46c5-bcba-728249dd69d9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1694 microversion: 2.1 time: 0.154460 Oct 11 00:46:09.442148 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3577/7806] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:46:09 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:46:10.465725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-027914f8-5138-488a-b233-a94b65f4d293 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:46:10.466352 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-027914f8-5138-488a-b233-a94b65f4d293 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:46:10.473902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-027914f8-5138-488a-b233-a94b65f4d293 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:10.474408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-027914f8-5138-488a-b233-a94b65f4d293 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:10.474865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-027914f8-5138-488a-b233-a94b65f4d293 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:10.475579 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-027914f8-5138-488a-b233-a94b65f4d293 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:10.476050 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-027914f8-5138-488a-b233-a94b65f4d293 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:10.476492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-027914f8-5138-488a-b233-a94b65f4d293 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:10.614505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-027914f8-5138-488a-b233-a94b65f4d293 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:46:10.622355 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-027914f8-5138-488a-b233-a94b65f4d293 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1694 microversion: 2.1 time: 0.160661 Oct 11 00:46:10.622937 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4230/7807] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:46:10 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:46:11.645898 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6160bce8-1dee-4d1f-b1fb-33cdf700ba05 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:46:11.646550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6160bce8-1dee-4d1f-b1fb-33cdf700ba05 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:46:11.653270 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6160bce8-1dee-4d1f-b1fb-33cdf700ba05 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:11.653787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6160bce8-1dee-4d1f-b1fb-33cdf700ba05 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:11.654227 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6160bce8-1dee-4d1f-b1fb-33cdf700ba05 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:11.654913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6160bce8-1dee-4d1f-b1fb-33cdf700ba05 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:11.655365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6160bce8-1dee-4d1f-b1fb-33cdf700ba05 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:11.655790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6160bce8-1dee-4d1f-b1fb-33cdf700ba05 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:11.789754 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6160bce8-1dee-4d1f-b1fb-33cdf700ba05 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:46:11.797496 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6160bce8-1dee-4d1f-b1fb-33cdf700ba05 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1694 microversion: 2.1 time: 0.155533 Oct 11 00:46:11.798076 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3578/7808] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:46:11 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:46:12.822687 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a3ec0978-af27-426d-b98a-57b63ec6cd7d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:46:12.823724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a3ec0978-af27-426d-b98a-57b63ec6cd7d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:46:12.832933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3ec0978-af27-426d-b98a-57b63ec6cd7d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:12.833109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3ec0978-af27-426d-b98a-57b63ec6cd7d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:12.833550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3ec0978-af27-426d-b98a-57b63ec6cd7d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:12.834276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3ec0978-af27-426d-b98a-57b63ec6cd7d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:12.834747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3ec0978-af27-426d-b98a-57b63ec6cd7d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:12.835192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3ec0978-af27-426d-b98a-57b63ec6cd7d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:12.971145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a3ec0978-af27-426d-b98a-57b63ec6cd7d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:46:12.979117 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a3ec0978-af27-426d-b98a-57b63ec6cd7d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1694 microversion: 2.1 time: 0.160583 Oct 11 00:46:12.979697 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4231/7809] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:46:12 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:46:14.002640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-bc5bb9fb-7d6a-4046-8764-5ab7108c931e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:46:14.003757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-bc5bb9fb-7d6a-4046-8764-5ab7108c931e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:46:14.011188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc5bb9fb-7d6a-4046-8764-5ab7108c931e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:14.011699 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc5bb9fb-7d6a-4046-8764-5ab7108c931e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:14.012144 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc5bb9fb-7d6a-4046-8764-5ab7108c931e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:14.012896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc5bb9fb-7d6a-4046-8764-5ab7108c931e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:14.013465 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc5bb9fb-7d6a-4046-8764-5ab7108c931e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:14.013903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-bc5bb9fb-7d6a-4046-8764-5ab7108c931e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:14.151586 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-bc5bb9fb-7d6a-4046-8764-5ab7108c931e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:46:14.159529 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-bc5bb9fb-7d6a-4046-8764-5ab7108c931e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1694 microversion: 2.1 time: 0.160760 Oct 11 00:46:14.160547 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3579/7810] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:46:13 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:46:15.183060 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-017d1f47-eac5-4c35-b956-9cf6cbc3cf23 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:46:15.183696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-017d1f47-eac5-4c35-b956-9cf6cbc3cf23 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:46:15.190821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-017d1f47-eac5-4c35-b956-9cf6cbc3cf23 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:15.191409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-017d1f47-eac5-4c35-b956-9cf6cbc3cf23 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:15.191768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-017d1f47-eac5-4c35-b956-9cf6cbc3cf23 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:15.192481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-017d1f47-eac5-4c35-b956-9cf6cbc3cf23 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:15.192953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-017d1f47-eac5-4c35-b956-9cf6cbc3cf23 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:15.193421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-017d1f47-eac5-4c35-b956-9cf6cbc3cf23 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:15.325406 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-017d1f47-eac5-4c35-b956-9cf6cbc3cf23 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:46:15.334741 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-017d1f47-eac5-4c35-b956-9cf6cbc3cf23 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1694 microversion: 2.1 time: 0.155545 Oct 11 00:46:15.335318 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4232/7811] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:46:15 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:46:16.358438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-84e28ed5-9dcd-4068-a514-369a949618bd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:46:16.359057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-84e28ed5-9dcd-4068-a514-369a949618bd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:46:16.366185 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-84e28ed5-9dcd-4068-a514-369a949618bd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:16.366668 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-84e28ed5-9dcd-4068-a514-369a949618bd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:16.367104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-84e28ed5-9dcd-4068-a514-369a949618bd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:16.367791 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-84e28ed5-9dcd-4068-a514-369a949618bd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:16.368239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-84e28ed5-9dcd-4068-a514-369a949618bd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:16.368665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-84e28ed5-9dcd-4068-a514-369a949618bd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:16.504968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-84e28ed5-9dcd-4068-a514-369a949618bd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:46:16.512713 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-84e28ed5-9dcd-4068-a514-369a949618bd tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1694 microversion: 2.1 time: 0.158217 Oct 11 00:46:16.513281 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3580/7812] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:46:16 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:46:17.541389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-33812d81-4afd-49f3-a779-7d72eabcd948 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:46:17.542079 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-33812d81-4afd-49f3-a779-7d72eabcd948 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:46:17.549582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33812d81-4afd-49f3-a779-7d72eabcd948 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:17.549696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33812d81-4afd-49f3-a779-7d72eabcd948 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:17.550613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33812d81-4afd-49f3-a779-7d72eabcd948 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:17.551407 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33812d81-4afd-49f3-a779-7d72eabcd948 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:17.551888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33812d81-4afd-49f3-a779-7d72eabcd948 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:17.552333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33812d81-4afd-49f3-a779-7d72eabcd948 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:17.687006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-33812d81-4afd-49f3-a779-7d72eabcd948 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:46:17.695810 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-33812d81-4afd-49f3-a779-7d72eabcd948 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1671 microversion: 2.1 time: 0.161924 Oct 11 00:46:17.696376 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4233/7813] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:46:17 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:46:18.792194 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5932ee1c-3293-4b75-a96e-f56ca6fcf0f9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:46:18.794444 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5932ee1c-3293-4b75-a96e-f56ca6fcf0f9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:46:18.801629 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5932ee1c-3293-4b75-a96e-f56ca6fcf0f9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:18.802100 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5932ee1c-3293-4b75-a96e-f56ca6fcf0f9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:18.802533 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5932ee1c-3293-4b75-a96e-f56ca6fcf0f9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:18.803231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5932ee1c-3293-4b75-a96e-f56ca6fcf0f9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:18.803684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5932ee1c-3293-4b75-a96e-f56ca6fcf0f9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:18.804110 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5932ee1c-3293-4b75-a96e-f56ca6fcf0f9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:18.858176 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5932ee1c-3293-4b75-a96e-f56ca6fcf0f9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6/action" status: 200 len: 37553 microversion: 2.1 time: 0.069834 Oct 11 00:46:18.858832 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3581/7814] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:46:18 2022] POST /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6/action => generated 37553 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 00:46:18.871607 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-811f733e-63ac-43d1-8608-564fd3ba3147 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:46:18.879408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-811f733e-63ac-43d1-8608-564fd3ba3147 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:18.879851 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-811f733e-63ac-43d1-8608-564fd3ba3147 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:18.880307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-811f733e-63ac-43d1-8608-564fd3ba3147 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:18.902015 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-811f733e-63ac-43d1-8608-564fd3ba3147 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Going to try to start instance {{(pid=120613) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 00:46:18.944493 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-811f733e-63ac-43d1-8608-564fd3ba3147 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6/action" status: 202 len: 0 microversion: 2.1 time: 0.076625 Oct 11 00:46:18.945162 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4234/7815] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:46:18 2022] POST /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:46:18.954631 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b7b3782a-cd1a-480f-8709-436c709a9498 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:46:18.955334 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b7b3782a-cd1a-480f-8709-436c709a9498 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:46:18.962574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7b3782a-cd1a-480f-8709-436c709a9498 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:18.963062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7b3782a-cd1a-480f-8709-436c709a9498 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:18.963570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7b3782a-cd1a-480f-8709-436c709a9498 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:18.964175 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7b3782a-cd1a-480f-8709-436c709a9498 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:18.964615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7b3782a-cd1a-480f-8709-436c709a9498 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:18.965034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b7b3782a-cd1a-480f-8709-436c709a9498 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:19.196305 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b7b3782a-cd1a-480f-8709-436c709a9498 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:46:19.204051 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b7b3782a-cd1a-480f-8709-436c709a9498 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1680 microversion: 2.1 time: 0.254184 Oct 11 00:46:19.204635 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3582/7816] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:46:18 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1680 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:46:20.230001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-573dba3b-5eed-4451-b94c-d870cfb56023 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:46:20.230875 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-573dba3b-5eed-4451-b94c-d870cfb56023 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:46:20.237784 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-573dba3b-5eed-4451-b94c-d870cfb56023 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:20.238819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-573dba3b-5eed-4451-b94c-d870cfb56023 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:20.239273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-573dba3b-5eed-4451-b94c-d870cfb56023 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:20.240004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-573dba3b-5eed-4451-b94c-d870cfb56023 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:20.240472 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-573dba3b-5eed-4451-b94c-d870cfb56023 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:20.241088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-573dba3b-5eed-4451-b94c-d870cfb56023 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:20.382980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-573dba3b-5eed-4451-b94c-d870cfb56023 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:46:20.391059 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-573dba3b-5eed-4451-b94c-d870cfb56023 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1684 microversion: 2.1 time: 0.166341 Oct 11 00:46:20.391745 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4235/7817] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:46:20 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:46:52.620748 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-82a17ce8-c798-4d01-8d43-2ceadb1e5c06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:46:52.622970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-82a17ce8-c798-4d01-8d43-2ceadb1e5c06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:46:52.625712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=14 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:46:52.626402 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=40 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:46:52.633603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82a17ce8-c798-4d01-8d43-2ceadb1e5c06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:52.634092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82a17ce8-c798-4d01-8d43-2ceadb1e5c06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:52.634530 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82a17ce8-c798-4d01-8d43-2ceadb1e5c06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:52.635222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82a17ce8-c798-4d01-8d43-2ceadb1e5c06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:46:52.635675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82a17ce8-c798-4d01-8d43-2ceadb1e5c06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:46:52.636095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-82a17ce8-c798-4d01-8d43-2ceadb1e5c06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:46:52.692341 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-82a17ce8-c798-4d01-8d43-2ceadb1e5c06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6/action" status: 200 len: 62112 microversion: 2.1 time: 0.075325 Oct 11 00:46:52.693924 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3583/7818] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:46:52 2022] POST /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6/action => generated 62112 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 00:47:16.279533 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-a0f59782-b0fa-4484-bc12-5e1f446b8a22 req-524ce7b2-a601-46e3-a705-d01e88d1c26e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b308f4c-a107-401d-ae35-24986456f2a6", "tag": "b7a6cb4a-9460-4568-b6b5-7049ad3a0a6d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:47:16.283445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-017bf363-48cc-4d57-a5b6-352008c77e34 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:47:16.284883 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-017bf363-48cc-4d57-a5b6-352008c77e34 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:47:16.287721 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 00:47:16.288161 n-d-860864-2 devstack@n-api.service[120613]: Tue Oct 11 00:47:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 11 00:47:16.288825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:47:16.289976 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=16 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:47:16.290329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:47:16.291091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:47:16.293260 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:47:16.293543 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:47:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 (ip 10.222.0.23) !!! Oct 11 00:47:16.297785 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a0f59782-b0fa-4484-bc12-5e1f446b8a22 req-524ce7b2-a601-46e3-a705-d01e88d1c26e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:16.298522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a0f59782-b0fa-4484-bc12-5e1f446b8a22 req-524ce7b2-a601-46e3-a705-d01e88d1c26e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:16.299172 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-a0f59782-b0fa-4484-bc12-5e1f446b8a22 req-524ce7b2-a601-46e3-a705-d01e88d1c26e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:16.303023 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-017bf363-48cc-4d57-a5b6-352008c77e34 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:16.304276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-017bf363-48cc-4d57-a5b6-352008c77e34 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:16.304724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-017bf363-48cc-4d57-a5b6-352008c77e34 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:16.305474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-017bf363-48cc-4d57-a5b6-352008c77e34 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:16.306085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-017bf363-48cc-4d57-a5b6-352008c77e34 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:16.307925 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-017bf363-48cc-4d57-a5b6-352008c77e34 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:16.316047 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-a0f59782-b0fa-4484-bc12-5e1f446b8a22 req-524ce7b2-a601-46e3-a705-d01e88d1c26e service nova] Creating event network-changed:b7a6cb4a-9460-4568-b6b5-7049ad3a0a6d for instance 2b308f4c-a107-401d-ae35-24986456f2a6 on n-h1-860864-2 Oct 11 00:47:16.321678 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-a0f59782-b0fa-4484-bc12-5e1f446b8a22 req-524ce7b2-a601-46e3-a705-d01e88d1c26e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045838 Oct 11 00:47:16.322506 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4236/7819] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:47:16.354114 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-017bf363-48cc-4d57-a5b6-352008c77e34 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:47:16.442521 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-017bf363-48cc-4d57-a5b6-352008c77e34 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 204 len: 0 microversion: 2.1 time: 0.162928 Oct 11 00:47:16.443565 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3584/7820] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:47:16 2022] DELETE /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 00:47:16.454650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ccf226ec-6e09-44ef-859d-c3f22df86235 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:47:16.456286 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ccf226ec-6e09-44ef-859d-c3f22df86235 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:47:16.466283 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccf226ec-6e09-44ef-859d-c3f22df86235 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:16.467978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccf226ec-6e09-44ef-859d-c3f22df86235 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:16.467978 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccf226ec-6e09-44ef-859d-c3f22df86235 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:16.468223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccf226ec-6e09-44ef-859d-c3f22df86235 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:16.468771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccf226ec-6e09-44ef-859d-c3f22df86235 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:16.469228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ccf226ec-6e09-44ef-859d-c3f22df86235 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:16.618697 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ccf226ec-6e09-44ef-859d-c3f22df86235 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:47:16.626684 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ccf226ec-6e09-44ef-859d-c3f22df86235 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1690 microversion: 2.1 time: 0.177639 Oct 11 00:47:16.627282 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4237/7821] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:47:16 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:47:17.654427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-76850e99-7059-4330-aa9b-c4c891e8c095 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:47:17.655161 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-76850e99-7059-4330-aa9b-c4c891e8c095 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:47:17.663647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76850e99-7059-4330-aa9b-c4c891e8c095 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:17.664135 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76850e99-7059-4330-aa9b-c4c891e8c095 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:17.664574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76850e99-7059-4330-aa9b-c4c891e8c095 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:17.665283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76850e99-7059-4330-aa9b-c4c891e8c095 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:17.665768 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76850e99-7059-4330-aa9b-c4c891e8c095 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:17.666196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-76850e99-7059-4330-aa9b-c4c891e8c095 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:17.935785 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-76850e99-7059-4330-aa9b-c4c891e8c095 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:47:17.944128 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-76850e99-7059-4330-aa9b-c4c891e8c095 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1690 microversion: 2.1 time: 0.294008 Oct 11 00:47:17.944827 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3585/7822] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:47:17 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1690 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:47:18.607061 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-6b4a6abd-5526-45f2-adf7-a94e21111c5e req-4cde0b53-0966-4491-a37e-881553486049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b308f4c-a107-401d-ae35-24986456f2a6", "name": "network-vif-deleted", "tag": "b7a6cb4a-9460-4568-b6b5-7049ad3a0a6d"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:47:18.622444 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6b4a6abd-5526-45f2-adf7-a94e21111c5e req-4cde0b53-0966-4491-a37e-881553486049 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:18.622923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6b4a6abd-5526-45f2-adf7-a94e21111c5e req-4cde0b53-0966-4491-a37e-881553486049 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:18.623370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6b4a6abd-5526-45f2-adf7-a94e21111c5e req-4cde0b53-0966-4491-a37e-881553486049 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:18.638979 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-6b4a6abd-5526-45f2-adf7-a94e21111c5e req-4cde0b53-0966-4491-a37e-881553486049 service nova] Creating event network-vif-deleted:b7a6cb4a-9460-4568-b6b5-7049ad3a0a6d for instance 2b308f4c-a107-401d-ae35-24986456f2a6 on n-h1-860864-2 Oct 11 00:47:18.646296 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-6b4a6abd-5526-45f2-adf7-a94e21111c5e req-4cde0b53-0966-4491-a37e-881553486049 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042804 Oct 11 00:47:18.646906 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4238/7823] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:47:18.973506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b91becf2-fe6e-4e07-b504-af739d237e45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:47:18.974789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b91becf2-fe6e-4e07-b504-af739d237e45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:47:18.981848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b91becf2-fe6e-4e07-b504-af739d237e45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:18.982343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b91becf2-fe6e-4e07-b504-af739d237e45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:18.982794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b91becf2-fe6e-4e07-b504-af739d237e45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:18.983509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b91becf2-fe6e-4e07-b504-af739d237e45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:18.983967 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b91becf2-fe6e-4e07-b504-af739d237e45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:18.984395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b91becf2-fe6e-4e07-b504-af739d237e45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:19.025596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b91becf2-fe6e-4e07-b504-af739d237e45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:19.025845 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b91becf2-fe6e-4e07-b504-af739d237e45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:19.026560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b91becf2-fe6e-4e07-b504-af739d237e45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:19.027090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-b91becf2-fe6e-4e07-b504-af739d237e45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lazy-loading 'fault' on Instance uuid 2b308f4c-a107-401d-ae35-24986456f2a6 {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:47:19.074792 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b91becf2-fe6e-4e07-b504-af739d237e45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:47:19.083598 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b91becf2-fe6e-4e07-b504-af739d237e45 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 200 len: 1357 microversion: 2.1 time: 0.115811 Oct 11 00:47:19.084463 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3586/7824] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:47:18 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 1357 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:47:20.108543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-aa18c1b9-4df3-4e81-9591-d6f79e393797 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:47:20.109169 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-aa18c1b9-4df3-4e81-9591-d6f79e393797 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 2b308f4c-a107-401d-ae35-24986456f2a6] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:47:20.121364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa18c1b9-4df3-4e81-9591-d6f79e393797 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:20.121918 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa18c1b9-4df3-4e81-9591-d6f79e393797 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:20.122378 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa18c1b9-4df3-4e81-9591-d6f79e393797 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:20.123156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa18c1b9-4df3-4e81-9591-d6f79e393797 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:20.123636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa18c1b9-4df3-4e81-9591-d6f79e393797 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:20.124131 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa18c1b9-4df3-4e81-9591-d6f79e393797 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:20.139600 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-aa18c1b9-4df3-4e81-9591-d6f79e393797 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] HTTP exception thrown: Instance 2b308f4c-a107-401d-ae35-24986456f2a6 could not be found. Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-aa18c1b9-4df3-4e81-9591-d6f79e393797 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Request method failure captured: Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 HTTP/1.1 Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLrbIgsnFdcSLuDWSG0BXZJgQ-0aoLaqeEz8A0UaMKXZIvv_xdAg16W-tgk2ATxwWwXTsmkAKVRXeF_uFIvkXsNHX3CXRwU3FdonpA1rskUDVW9HI_SHIbYvWd9DxLNyTUfkF2HQNHtRL2_zgZlbWNH1devNuUVY45TC5ljRE7Bwb78 Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 60c10fdea561499c9f87fac524ca4113 Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-886185438 Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60c10fdea561499c9f87fac524ca4113"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60c10fdea561499c9f87fac524ca4113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60c10fdea561499c9f87fac524ca4113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60c10fdea561499c9f87fac524ca4113", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestNetworkAdvancedServerOps-886185438 Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 60c10fdea561499c9f87fac524ca4113 Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-886185438 Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestNetworkAdvancedServerOps-886185438-project Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 84c8a15123fb4b0292320555bceb3681 Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestNetworkAdvancedServerOps-886185438-project Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 2b308f4c-a107-401d-ae35-24986456f2a6 could not be found. Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '2b308f4c-a107-401d-ae35-24986456f2a6'} Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b308f4c-a107-401d-ae35-24986456f2a6 could not be found. Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b308f4c-a107-401d-ae35-24986456f2a6 could not be found. Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:47:20.141278 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:47:20.146977 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:47:20.146977 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:47:20.146977 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:47:20.146977 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:47:20.146977 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:47:20.146977 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:47:20.146977 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b308f4c-a107-401d-ae35-24986456f2a6 could not be found. Oct 11 00:47:20.146977 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:47:20.146977 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-aa18c1b9-4df3-4e81-9591-d6f79e393797 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Returning 404 to user: Instance 2b308f4c-a107-401d-ae35-24986456f2a6 could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:47:20.146977 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-aa18c1b9-4df3-4e81-9591-d6f79e393797 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6" status: 404 len: 111 microversion: 2.1 time: 0.038651 Oct 11 00:47:20.146977 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4239/7825] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:47:20 2022] GET /compute/v2.1/servers/2b308f4c-a107-401d-ae35-24986456f2a6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:47:23.785927 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ff2f887e-07ff-44cf-a612-f1e4b47851f7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '.version_select at 0x7f662a7db280>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:47:23.823060 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ff2f887e-07ff-44cf-a612-f1e4b47851f7 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1694004154" status: 202 len: 0 microversion: 2.1 time: 0.042317 Oct 11 00:47:23.824057 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3587/7826] 10.222.0.23 () {58 vars in 1284 bytes} [Tue Oct 11 00:47:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1694004154 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:47:23.860892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c8bca793-0142-4d5a-81b0-f35241227695 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'create', calling method: .version_select at 0x7f662a5d0160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1391697735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2hihFIaPA4mo9H4YJ7l14se2Hd6/IsyNnuukawooQW6gKCkeBcFc+xm+hYur+uf3iDgkjE+mrVSWVo/bIrHjAELFg8DoPezO4raJTPDYmjI1E4FjjZKusqfeMD1UciXQ=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:47:23.878388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-c8bca793-0142-4d5a-81b0-f35241227695 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Getting quotas for project 60c10fdea561499c9f87fac524ca4113. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:47:23.885036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-c8bca793-0142-4d5a-81b0-f35241227695 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Getting quotas for user 84c8a15123fb4b0292320555bceb3681 and project 60c10fdea561499c9f87fac524ca4113. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:47:23.921545 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c8bca793-0142-4d5a-81b0-f35241227695 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.064530 Oct 11 00:47:23.922250 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4240/7827] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 11 00:47:23 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:47:29.894717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:47:29.898888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ae932df0-9120-4dc6-9473-dbc9750cd58d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1389503944", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "networks": [{"uuid": "18c1e1f6-2d47-4225-aa4c-7c92be9ba6ed"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1391697735", "security_groups": [{"name": "tempest-secgroup-smoke-322976255"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:47:30.027012 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-ae932df0-9120-4dc6-9473-dbc9750cd58d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] validate_networks() for [('18c1e1f6-2d47-4225-aa4c-7c92be9ba6ed', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:47:30.504813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ae932df0-9120-4dc6-9473-dbc9750cd58d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:47:30.510066 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ae932df0-9120-4dc6-9473-dbc9750cd58d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:47:30.510710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ae932df0-9120-4dc6-9473-dbc9750cd58d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:47:30.511208 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ae932df0-9120-4dc6-9473-dbc9750cd58d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:47:30.511707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ae932df0-9120-4dc6-9473-dbc9750cd58d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:47:30.527651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae932df0-9120-4dc6-9473-dbc9750cd58d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:30.527651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae932df0-9120-4dc6-9473-dbc9750cd58d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:30.527651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae932df0-9120-4dc6-9473-dbc9750cd58d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:30.527651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae932df0-9120-4dc6-9473-dbc9750cd58d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:30.527651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae932df0-9120-4dc6-9473-dbc9750cd58d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:30.527651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ae932df0-9120-4dc6-9473-dbc9750cd58d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:30.551836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ae932df0-9120-4dc6-9473-dbc9750cd58d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Getting quotas for project 60c10fdea561499c9f87fac524ca4113. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:47:30.559111 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ae932df0-9120-4dc6-9473-dbc9750cd58d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Getting quotas for user 84c8a15123fb4b0292320555bceb3681 and project 60c10fdea561499c9f87fac524ca4113. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:47:30.574255 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ae932df0-9120-4dc6-9473-dbc9750cd58d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:47:30.577349 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ae932df0-9120-4dc6-9473-dbc9750cd58d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:47:30.638994 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ae932df0-9120-4dc6-9473-dbc9750cd58d tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.746489 Oct 11 00:47:30.648507 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3588/7828] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:47:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:47:30.659567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b36d9352-9565-48b8-bcd0-a0b02961c5ba tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:47:30.667008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b36d9352-9565-48b8-bcd0-a0b02961c5ba tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:47:30.676345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=12 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:47:30.818670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b36d9352-9565-48b8-bcd0-a0b02961c5ba tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:47:30.836191 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b36d9352-9565-48b8-bcd0-a0b02961c5ba tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f" status: 200 len: 1267 microversion: 2.1 time: 0.186252 Oct 11 00:47:30.836787 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4241/7829] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:47:30 2022] GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:47:31.863721 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f01cb169-a0e0-4804-8502-efd3dcfdcd3f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:47:31.864344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f01cb169-a0e0-4804-8502-efd3dcfdcd3f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:47:31.871033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f01cb169-a0e0-4804-8502-efd3dcfdcd3f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:31.871513 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f01cb169-a0e0-4804-8502-efd3dcfdcd3f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:31.871950 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f01cb169-a0e0-4804-8502-efd3dcfdcd3f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:31.872639 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f01cb169-a0e0-4804-8502-efd3dcfdcd3f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:31.873093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f01cb169-a0e0-4804-8502-efd3dcfdcd3f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:31.873553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f01cb169-a0e0-4804-8502-efd3dcfdcd3f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:31.997961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f01cb169-a0e0-4804-8502-efd3dcfdcd3f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:47:32.007377 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f01cb169-a0e0-4804-8502-efd3dcfdcd3f tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f" status: 200 len: 1319 microversion: 2.1 time: 0.149457 Oct 11 00:47:32.008343 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3589/7830] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:47:31 2022] GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:47:33.032320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-33813f8a-4503-45b0-a622-4b91cc20c60a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:47:33.033027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-33813f8a-4503-45b0-a622-4b91cc20c60a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:47:33.043053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33813f8a-4503-45b0-a622-4b91cc20c60a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:33.043649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33813f8a-4503-45b0-a622-4b91cc20c60a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:33.044369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33813f8a-4503-45b0-a622-4b91cc20c60a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:33.051859 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33813f8a-4503-45b0-a622-4b91cc20c60a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:33.052900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33813f8a-4503-45b0-a622-4b91cc20c60a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:33.053604 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33813f8a-4503-45b0-a622-4b91cc20c60a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:33.288507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-33813f8a-4503-45b0-a622-4b91cc20c60a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:47:33.298112 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-33813f8a-4503-45b0-a622-4b91cc20c60a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f" status: 200 len: 1392 microversion: 2.1 time: 0.269742 Oct 11 00:47:33.299078 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4242/7831] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:47:33 2022] GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f => generated 1392 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:47:34.148884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-86a30596-0771-4abd-b242-36efd5ae007c req-508b9147-140a-48c1-bf25-408576f25a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73d6a064-da00-40d9-8498-2d6a8b120f9f", "tag": "d1185f93-7103-4487-9e5d-31f8c9ed37dc"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:47:34.161848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-86a30596-0771-4abd-b242-36efd5ae007c req-508b9147-140a-48c1-bf25-408576f25a92 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:34.162332 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-86a30596-0771-4abd-b242-36efd5ae007c req-508b9147-140a-48c1-bf25-408576f25a92 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:34.162767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-86a30596-0771-4abd-b242-36efd5ae007c req-508b9147-140a-48c1-bf25-408576f25a92 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:34.174857 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-86a30596-0771-4abd-b242-36efd5ae007c req-508b9147-140a-48c1-bf25-408576f25a92 service nova] Creating event network-changed:d1185f93-7103-4487-9e5d-31f8c9ed37dc for instance 73d6a064-da00-40d9-8498-2d6a8b120f9f on n-h2-860864-2 Oct 11 00:47:34.180161 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-86a30596-0771-4abd-b242-36efd5ae007c req-508b9147-140a-48c1-bf25-408576f25a92 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035207 Oct 11 00:47:34.180785 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3590/7832] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:47:34.324002 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-86b1f18a-c794-49f4-a301-4416e2609427 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:47:34.324656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-86b1f18a-c794-49f4-a301-4416e2609427 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:47:34.331623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86b1f18a-c794-49f4-a301-4416e2609427 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:34.332130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86b1f18a-c794-49f4-a301-4416e2609427 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:34.332590 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86b1f18a-c794-49f4-a301-4416e2609427 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:34.333320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86b1f18a-c794-49f4-a301-4416e2609427 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:34.333823 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86b1f18a-c794-49f4-a301-4416e2609427 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:34.334271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-86b1f18a-c794-49f4-a301-4416e2609427 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:34.468364 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-86b1f18a-c794-49f4-a301-4416e2609427 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:47:34.476315 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-86b1f18a-c794-49f4-a301-4416e2609427 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f" status: 200 len: 1392 microversion: 2.1 time: 0.156343 Oct 11 00:47:34.476906 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4243/7833] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:47:34 2022] GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:47:35.509493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-22daeb4f-b262-4dea-b01a-0cf3caf84779 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:47:35.510200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-22daeb4f-b262-4dea-b01a-0cf3caf84779 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:47:35.516475 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22daeb4f-b262-4dea-b01a-0cf3caf84779 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:35.516959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22daeb4f-b262-4dea-b01a-0cf3caf84779 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:35.517427 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22daeb4f-b262-4dea-b01a-0cf3caf84779 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:35.518120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22daeb4f-b262-4dea-b01a-0cf3caf84779 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:35.518576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22daeb4f-b262-4dea-b01a-0cf3caf84779 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:35.519001 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-22daeb4f-b262-4dea-b01a-0cf3caf84779 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:35.653717 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-22daeb4f-b262-4dea-b01a-0cf3caf84779 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:47:35.661898 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-22daeb4f-b262-4dea-b01a-0cf3caf84779 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f" status: 200 len: 1392 microversion: 2.1 time: 0.158415 Oct 11 00:47:35.662407 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3591/7834] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:47:35 2022] GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:47:36.684188 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-9f52febe-42f7-4032-a7bd-91d34bfa6eac tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:47:36.685080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-9f52febe-42f7-4032-a7bd-91d34bfa6eac tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:47:36.692284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f52febe-42f7-4032-a7bd-91d34bfa6eac tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:36.692781 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f52febe-42f7-4032-a7bd-91d34bfa6eac tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:36.693229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f52febe-42f7-4032-a7bd-91d34bfa6eac tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:36.694602 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f52febe-42f7-4032-a7bd-91d34bfa6eac tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:36.695449 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f52febe-42f7-4032-a7bd-91d34bfa6eac tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:36.695904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-9f52febe-42f7-4032-a7bd-91d34bfa6eac tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:36.839662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-9f52febe-42f7-4032-a7bd-91d34bfa6eac tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:47:36.847670 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-9f52febe-42f7-4032-a7bd-91d34bfa6eac tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f" status: 200 len: 1392 microversion: 2.1 time: 0.167300 Oct 11 00:47:36.848245 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4244/7835] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:47:36 2022] GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:47:37.871132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-10d7e494-5b9b-4ca9-b5ce-303a75136be9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:47:37.871767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-10d7e494-5b9b-4ca9-b5ce-303a75136be9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:47:37.878680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10d7e494-5b9b-4ca9-b5ce-303a75136be9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:37.879158 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10d7e494-5b9b-4ca9-b5ce-303a75136be9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:37.879589 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10d7e494-5b9b-4ca9-b5ce-303a75136be9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:37.880274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10d7e494-5b9b-4ca9-b5ce-303a75136be9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:37.880729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10d7e494-5b9b-4ca9-b5ce-303a75136be9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:37.881150 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-10d7e494-5b9b-4ca9-b5ce-303a75136be9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:38.018744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-10d7e494-5b9b-4ca9-b5ce-303a75136be9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:47:38.027297 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-10d7e494-5b9b-4ca9-b5ce-303a75136be9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f" status: 200 len: 1392 microversion: 2.1 time: 0.160043 Oct 11 00:47:38.027887 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3592/7836] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:47:37 2022] GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:47:38.479572 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-f8879a7a-f0b5-4617-83fa-d625385940b9 req-e61612b8-9552-4b40-ac1a-9de9ada3c4b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73d6a064-da00-40d9-8498-2d6a8b120f9f", "name": "network-vif-plugged", "status": "completed", "tag": "d1185f93-7103-4487-9e5d-31f8c9ed37dc"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:47:38.491147 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f8879a7a-f0b5-4617-83fa-d625385940b9 req-e61612b8-9552-4b40-ac1a-9de9ada3c4b1 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:38.491654 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f8879a7a-f0b5-4617-83fa-d625385940b9 req-e61612b8-9552-4b40-ac1a-9de9ada3c4b1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:38.492108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-f8879a7a-f0b5-4617-83fa-d625385940b9 req-e61612b8-9552-4b40-ac1a-9de9ada3c4b1 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:38.509152 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-f8879a7a-f0b5-4617-83fa-d625385940b9 req-e61612b8-9552-4b40-ac1a-9de9ada3c4b1 service nova] Creating event network-vif-plugged:d1185f93-7103-4487-9e5d-31f8c9ed37dc for instance 73d6a064-da00-40d9-8498-2d6a8b120f9f on n-h2-860864-2 Oct 11 00:47:38.515757 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-f8879a7a-f0b5-4617-83fa-d625385940b9 req-e61612b8-9552-4b40-ac1a-9de9ada3c4b1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093183 Oct 11 00:47:38.516374 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4245/7837] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:47:39.050649 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4c3e93da-d124-48cb-9465-93d71f5a2187 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:47:39.051196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4c3e93da-d124-48cb-9465-93d71f5a2187 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:47:39.059307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c3e93da-d124-48cb-9465-93d71f5a2187 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:39.060045 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c3e93da-d124-48cb-9465-93d71f5a2187 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:39.060476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c3e93da-d124-48cb-9465-93d71f5a2187 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:39.061159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c3e93da-d124-48cb-9465-93d71f5a2187 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:39.061638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c3e93da-d124-48cb-9465-93d71f5a2187 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:39.062060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c3e93da-d124-48cb-9465-93d71f5a2187 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:39.198838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4c3e93da-d124-48cb-9465-93d71f5a2187 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:47:39.206480 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4c3e93da-d124-48cb-9465-93d71f5a2187 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f" status: 200 len: 1392 microversion: 2.1 time: 0.159913 Oct 11 00:47:39.207058 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3593/7838] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:47:39 2022] GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:47:40.230558 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a30bc4eb-a2a4-4037-939d-102ce8169ac5 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:47:40.231344 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a30bc4eb-a2a4-4037-939d-102ce8169ac5 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:47:40.238525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a30bc4eb-a2a4-4037-939d-102ce8169ac5 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:40.239023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a30bc4eb-a2a4-4037-939d-102ce8169ac5 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:40.239477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a30bc4eb-a2a4-4037-939d-102ce8169ac5 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:40.240235 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a30bc4eb-a2a4-4037-939d-102ce8169ac5 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:40.240695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a30bc4eb-a2a4-4037-939d-102ce8169ac5 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:40.241136 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a30bc4eb-a2a4-4037-939d-102ce8169ac5 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:40.377990 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a30bc4eb-a2a4-4037-939d-102ce8169ac5 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:47:40.386021 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a30bc4eb-a2a4-4037-939d-102ce8169ac5 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f" status: 200 len: 1565 microversion: 2.1 time: 0.160476 Oct 11 00:47:40.386608 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4246/7839] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:47:40 2022] GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:47:40.409329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-649d11a1-25ff-40d5-a576-58ccc550316b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:47:40.409970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-649d11a1-25ff-40d5-a576-58ccc550316b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:47:40.417400 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-649d11a1-25ff-40d5-a576-58ccc550316b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:40.417901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-649d11a1-25ff-40d5-a576-58ccc550316b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:40.418339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-649d11a1-25ff-40d5-a576-58ccc550316b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:40.419030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-649d11a1-25ff-40d5-a576-58ccc550316b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:40.419485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-649d11a1-25ff-40d5-a576-58ccc550316b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:40.419913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-649d11a1-25ff-40d5-a576-58ccc550316b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:40.534138 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:47:40.558210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-649d11a1-25ff-40d5-a576-58ccc550316b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:47:40.566390 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-649d11a1-25ff-40d5-a576-58ccc550316b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f" status: 200 len: 1565 microversion: 2.1 time: 0.161412 Oct 11 00:47:40.566961 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3594/7840] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:47:40 2022] GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:47:42.155145 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-acc8f1ee-855e-421b-89f7-28ef89fb99c4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:47:42.156064 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-acc8f1ee-855e-421b-89f7-28ef89fb99c4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:47:42.157109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-c43b7672-06ee-451f-b852-6ce3c9471151 req-de16adf2-d7a5-4929-9369-2e9ca2c353ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73d6a064-da00-40d9-8498-2d6a8b120f9f", "tag": "d1185f93-7103-4487-9e5d-31f8c9ed37dc"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:47:42.161402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:47:42.165059 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-acc8f1ee-855e-421b-89f7-28ef89fb99c4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:42.165229 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:47:42.165694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-acc8f1ee-855e-421b-89f7-28ef89fb99c4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:42.166437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-acc8f1ee-855e-421b-89f7-28ef89fb99c4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:42.167245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-acc8f1ee-855e-421b-89f7-28ef89fb99c4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:42.167787 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-acc8f1ee-855e-421b-89f7-28ef89fb99c4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:42.168438 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-acc8f1ee-855e-421b-89f7-28ef89fb99c4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:42.172021 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c43b7672-06ee-451f-b852-6ce3c9471151 req-de16adf2-d7a5-4929-9369-2e9ca2c353ac service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:47:42.172508 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c43b7672-06ee-451f-b852-6ce3c9471151 req-de16adf2-d7a5-4929-9369-2e9ca2c353ac service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:47:42.172941 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-c43b7672-06ee-451f-b852-6ce3c9471151 req-de16adf2-d7a5-4929-9369-2e9ca2c353ac service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:47:42.185296 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-c43b7672-06ee-451f-b852-6ce3c9471151 req-de16adf2-d7a5-4929-9369-2e9ca2c353ac service nova] Creating event network-changed:d1185f93-7103-4487-9e5d-31f8c9ed37dc for instance 73d6a064-da00-40d9-8498-2d6a8b120f9f on n-h2-860864-2 Oct 11 00:47:42.190587 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-c43b7672-06ee-451f-b852-6ce3c9471151 req-de16adf2-d7a5-4929-9369-2e9ca2c353ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037252 Oct 11 00:47:42.191763 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3595/7841] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:47:42.317275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-acc8f1ee-855e-421b-89f7-28ef89fb99c4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:47:42.327576 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-acc8f1ee-855e-421b-89f7-28ef89fb99c4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f" status: 200 len: 1565 microversion: 2.1 time: 0.176262 Oct 11 00:47:42.328316 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4247/7842] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:47:42 2022] GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:48:07.589140 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:48:07.589897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=36 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:48:07.799713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ca271b64-76b4-439c-a355-a485a74cef3e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:48:07.802112 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ca271b64-76b4-439c-a355-a485a74cef3e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:07.808375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca271b64-76b4-439c-a355-a485a74cef3e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:07.808862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca271b64-76b4-439c-a355-a485a74cef3e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:07.809302 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca271b64-76b4-439c-a355-a485a74cef3e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:07.810276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca271b64-76b4-439c-a355-a485a74cef3e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:07.810737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca271b64-76b4-439c-a355-a485a74cef3e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:07.811162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ca271b64-76b4-439c-a355-a485a74cef3e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:07.868341 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ca271b64-76b4-439c-a355-a485a74cef3e tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f/action" status: 200 len: 24565 microversion: 2.1 time: 0.284083 Oct 11 00:48:07.868973 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3596/7843] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:48:07 2022] POST /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f/action => generated 24565 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 00:48:18.992350 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-40172951-99ef-4c46-bb36-54b1c4d36e22 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:48:18.992915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-40172951-99ef-4c46-bb36-54b1c4d36e22 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:18.995068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:48:18.995903 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=32 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:48:19.002588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40172951-99ef-4c46-bb36-54b1c4d36e22 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:19.003110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40172951-99ef-4c46-bb36-54b1c4d36e22 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:19.003640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40172951-99ef-4c46-bb36-54b1c4d36e22 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:19.004550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40172951-99ef-4c46-bb36-54b1c4d36e22 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:19.005226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40172951-99ef-4c46-bb36-54b1c4d36e22 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:19.006192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40172951-99ef-4c46-bb36-54b1c4d36e22 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:19.036264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-40172951-99ef-4c46-bb36-54b1c4d36e22 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lazy-loading 'flavor' on Instance uuid 73d6a064-da00-40d9-8498-2d6a8b120f9f {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:48:19.124564 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-40172951-99ef-4c46-bb36-54b1c4d36e22 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f/action" status: 202 len: 0 microversion: 2.1 time: 0.136729 Oct 11 00:48:19.125432 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4248/7844] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:48:18 2022] POST /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:48:19.136278 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-24fe97ac-0d5a-4dca-ab18-ee2e186a4a06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:48:19.137080 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-24fe97ac-0d5a-4dca-ab18-ee2e186a4a06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:19.141802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:48:19.142921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:48:19.149251 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24fe97ac-0d5a-4dca-ab18-ee2e186a4a06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:19.149894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24fe97ac-0d5a-4dca-ab18-ee2e186a4a06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:19.152148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24fe97ac-0d5a-4dca-ab18-ee2e186a4a06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:19.152148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24fe97ac-0d5a-4dca-ab18-ee2e186a4a06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:19.152148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24fe97ac-0d5a-4dca-ab18-ee2e186a4a06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:19.152724 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-24fe97ac-0d5a-4dca-ab18-ee2e186a4a06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:19.311217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-24fe97ac-0d5a-4dca-ab18-ee2e186a4a06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:48:19.320477 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-24fe97ac-0d5a-4dca-ab18-ee2e186a4a06 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f" status: 200 len: 1692 microversion: 2.1 time: 0.189689 Oct 11 00:48:19.321079 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3597/7845] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:48:19 2022] GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f => generated 1692 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:48:20.348549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e79de568-479e-47a2-bec9-aa1a1c1885d6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:48:20.349297 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e79de568-479e-47a2-bec9-aa1a1c1885d6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:20.355617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e79de568-479e-47a2-bec9-aa1a1c1885d6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:20.356117 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e79de568-479e-47a2-bec9-aa1a1c1885d6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:20.356566 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e79de568-479e-47a2-bec9-aa1a1c1885d6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:20.357272 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e79de568-479e-47a2-bec9-aa1a1c1885d6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:20.357760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e79de568-479e-47a2-bec9-aa1a1c1885d6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:20.358199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e79de568-479e-47a2-bec9-aa1a1c1885d6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:20.496855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e79de568-479e-47a2-bec9-aa1a1c1885d6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:48:20.505730 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e79de568-479e-47a2-bec9-aa1a1c1885d6 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f" status: 200 len: 1675 microversion: 2.1 time: 0.162457 Oct 11 00:48:20.506245 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4249/7846] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:48:20 2022] GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:48:21.603048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-09369e37-86c4-425e-8151-2c9646ee162a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:48:21.605359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-09369e37-86c4-425e-8151-2c9646ee162a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:21.612319 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09369e37-86c4-425e-8151-2c9646ee162a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:21.612814 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09369e37-86c4-425e-8151-2c9646ee162a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:21.613256 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09369e37-86c4-425e-8151-2c9646ee162a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:21.613994 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09369e37-86c4-425e-8151-2c9646ee162a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:21.614615 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09369e37-86c4-425e-8151-2c9646ee162a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:21.615054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-09369e37-86c4-425e-8151-2c9646ee162a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:21.676622 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-09369e37-86c4-425e-8151-2c9646ee162a tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f/action" status: 200 len: 38402 microversion: 2.1 time: 0.078049 Oct 11 00:48:21.677618 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3598/7847] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:48:21 2022] POST /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f/action => generated 38402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 00:48:21.689942 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cd37d4f0-3b65-4017-abd4-247cfef5f7e9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:48:21.690495 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cd37d4f0-3b65-4017-abd4-247cfef5f7e9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:21.697726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd37d4f0-3b65-4017-abd4-247cfef5f7e9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:21.698232 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd37d4f0-3b65-4017-abd4-247cfef5f7e9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:21.698689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd37d4f0-3b65-4017-abd4-247cfef5f7e9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:21.699399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd37d4f0-3b65-4017-abd4-247cfef5f7e9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:21.699870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd37d4f0-3b65-4017-abd4-247cfef5f7e9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:21.700316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd37d4f0-3b65-4017-abd4-247cfef5f7e9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:21.767120 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cd37d4f0-3b65-4017-abd4-247cfef5f7e9 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f/action" status: 202 len: 0 microversion: 2.1 time: 0.080758 Oct 11 00:48:21.767660 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4250/7848] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:48:21 2022] POST /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:48:21.777572 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cacee854-51e4-485c-8cf5-19e6b678b887 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:48:21.778288 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cacee854-51e4-485c-8cf5-19e6b678b887 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:21.785531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cacee854-51e4-485c-8cf5-19e6b678b887 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:21.786079 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cacee854-51e4-485c-8cf5-19e6b678b887 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:21.787090 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cacee854-51e4-485c-8cf5-19e6b678b887 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:21.788013 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cacee854-51e4-485c-8cf5-19e6b678b887 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:21.788528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cacee854-51e4-485c-8cf5-19e6b678b887 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:21.789005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cacee854-51e4-485c-8cf5-19e6b678b887 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:21.934780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cacee854-51e4-485c-8cf5-19e6b678b887 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:48:21.943525 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cacee854-51e4-485c-8cf5-19e6b678b887 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f" status: 200 len: 1681 microversion: 2.1 time: 0.170245 Oct 11 00:48:21.944306 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3599/7849] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:48:21 2022] GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:48:22.969330 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-129f3d64-11c5-4691-b74e-d3b4c1c82d92 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:48:22.970004 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-129f3d64-11c5-4691-b74e-d3b4c1c82d92 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:22.976953 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-129f3d64-11c5-4691-b74e-d3b4c1c82d92 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:22.977496 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-129f3d64-11c5-4691-b74e-d3b4c1c82d92 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:22.977959 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-129f3d64-11c5-4691-b74e-d3b4c1c82d92 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:22.978667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-129f3d64-11c5-4691-b74e-d3b4c1c82d92 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:22.979138 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-129f3d64-11c5-4691-b74e-d3b4c1c82d92 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:22.979584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-129f3d64-11c5-4691-b74e-d3b4c1c82d92 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:23.116417 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-129f3d64-11c5-4691-b74e-d3b4c1c82d92 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:48:23.124224 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-129f3d64-11c5-4691-b74e-d3b4c1c82d92 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f" status: 200 len: 1681 microversion: 2.1 time: 0.160219 Oct 11 00:48:23.124807 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4251/7850] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:48:22 2022] GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:48:24.148246 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-569aeeff-3ff1-4fbd-94d9-7eccaec1bc21 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:48:24.148922 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-569aeeff-3ff1-4fbd-94d9-7eccaec1bc21 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:24.155675 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-569aeeff-3ff1-4fbd-94d9-7eccaec1bc21 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:24.156189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-569aeeff-3ff1-4fbd-94d9-7eccaec1bc21 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:24.156625 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-569aeeff-3ff1-4fbd-94d9-7eccaec1bc21 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:24.157310 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-569aeeff-3ff1-4fbd-94d9-7eccaec1bc21 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:24.157795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-569aeeff-3ff1-4fbd-94d9-7eccaec1bc21 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:24.158216 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-569aeeff-3ff1-4fbd-94d9-7eccaec1bc21 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:24.289865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-569aeeff-3ff1-4fbd-94d9-7eccaec1bc21 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:48:24.297715 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-569aeeff-3ff1-4fbd-94d9-7eccaec1bc21 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f" status: 200 len: 1684 microversion: 2.1 time: 0.153845 Oct 11 00:48:24.298294 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3600/7851] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:48:24 2022] GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:48:24.397630 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ea6e63c9-6cbe-46a2-aa8e-6b4ae11c5b80 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:48:24.399948 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ea6e63c9-6cbe-46a2-aa8e-6b4ae11c5b80 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:24.407088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea6e63c9-6cbe-46a2-aa8e-6b4ae11c5b80 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:24.407561 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea6e63c9-6cbe-46a2-aa8e-6b4ae11c5b80 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:24.408037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea6e63c9-6cbe-46a2-aa8e-6b4ae11c5b80 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:24.408860 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea6e63c9-6cbe-46a2-aa8e-6b4ae11c5b80 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:24.409537 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea6e63c9-6cbe-46a2-aa8e-6b4ae11c5b80 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:24.410008 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ea6e63c9-6cbe-46a2-aa8e-6b4ae11c5b80 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:24.455940 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ea6e63c9-6cbe-46a2-aa8e-6b4ae11c5b80 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "POST /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f/action" status: 200 len: 38402 microversion: 2.1 time: 0.062195 Oct 11 00:48:24.456556 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4252/7852] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:48:24 2022] POST /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f/action => generated 38402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 00:48:25.793619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-08440798-0094-40cd-a8f6-c858c804ac72 req-e0aeebe3-ebd7-4477-aa21-c08c43771f33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73d6a064-da00-40d9-8498-2d6a8b120f9f", "tag": "d1185f93-7103-4487-9e5d-31f8c9ed37dc"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:48:25.796619 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-52d4bb28-ffb0-4a57-aa1b-a3ac2b103327 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:48:25.806266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-52d4bb28-ffb0-4a57-aa1b-a3ac2b103327 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:25.816056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-08440798-0094-40cd-a8f6-c858c804ac72 req-e0aeebe3-ebd7-4477-aa21-c08c43771f33 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:25.816056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-08440798-0094-40cd-a8f6-c858c804ac72 req-e0aeebe3-ebd7-4477-aa21-c08c43771f33 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:25.816056 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-08440798-0094-40cd-a8f6-c858c804ac72 req-e0aeebe3-ebd7-4477-aa21-c08c43771f33 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:25.819214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52d4bb28-ffb0-4a57-aa1b-a3ac2b103327 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:25.820026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52d4bb28-ffb0-4a57-aa1b-a3ac2b103327 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:25.820722 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52d4bb28-ffb0-4a57-aa1b-a3ac2b103327 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:25.821704 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52d4bb28-ffb0-4a57-aa1b-a3ac2b103327 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:25.822378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52d4bb28-ffb0-4a57-aa1b-a3ac2b103327 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:25.823022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-52d4bb28-ffb0-4a57-aa1b-a3ac2b103327 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:25.830177 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-08440798-0094-40cd-a8f6-c858c804ac72 req-e0aeebe3-ebd7-4477-aa21-c08c43771f33 service nova] Creating event network-changed:d1185f93-7103-4487-9e5d-31f8c9ed37dc for instance 73d6a064-da00-40d9-8498-2d6a8b120f9f on n-h2-860864-2 Oct 11 00:48:25.835759 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-08440798-0094-40cd-a8f6-c858c804ac72 req-e0aeebe3-ebd7-4477-aa21-c08c43771f33 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046029 Oct 11 00:48:25.836558 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4253/7853] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:48:25.852800 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-52d4bb28-ffb0-4a57-aa1b-a3ac2b103327 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:48:25.937802 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-52d4bb28-ffb0-4a57-aa1b-a3ac2b103327 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "DELETE /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f" status: 204 len: 0 microversion: 2.1 time: 0.151953 Oct 11 00:48:25.938959 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3601/7854] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:48:25 2022] DELETE /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 00:48:25.949255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a2d8e9c0-10da-43c4-88a1-51c5d89e7b0b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:48:25.950223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a2d8e9c0-10da-43c4-88a1-51c5d89e7b0b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:25.961705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2d8e9c0-10da-43c4-88a1-51c5d89e7b0b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:25.962384 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2d8e9c0-10da-43c4-88a1-51c5d89e7b0b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:25.963012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2d8e9c0-10da-43c4-88a1-51c5d89e7b0b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:25.963720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2d8e9c0-10da-43c4-88a1-51c5d89e7b0b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:25.964430 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2d8e9c0-10da-43c4-88a1-51c5d89e7b0b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:25.964963 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a2d8e9c0-10da-43c4-88a1-51c5d89e7b0b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:26.109475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a2d8e9c0-10da-43c4-88a1-51c5d89e7b0b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:48:26.117927 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a2d8e9c0-10da-43c4-88a1-51c5d89e7b0b tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f" status: 200 len: 1690 microversion: 2.1 time: 0.173081 Oct 11 00:48:26.118509 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4254/7855] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:48:25 2022] GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:48:27.143409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b758a9fa-ac47-4a1f-a8b5-b7f9f1634ab0 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:48:27.144141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b758a9fa-ac47-4a1f-a8b5-b7f9f1634ab0 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:27.152058 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b758a9fa-ac47-4a1f-a8b5-b7f9f1634ab0 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:27.152536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b758a9fa-ac47-4a1f-a8b5-b7f9f1634ab0 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:27.152969 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b758a9fa-ac47-4a1f-a8b5-b7f9f1634ab0 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:27.153677 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b758a9fa-ac47-4a1f-a8b5-b7f9f1634ab0 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:27.154127 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b758a9fa-ac47-4a1f-a8b5-b7f9f1634ab0 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:27.154548 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b758a9fa-ac47-4a1f-a8b5-b7f9f1634ab0 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:27.292218 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b758a9fa-ac47-4a1f-a8b5-b7f9f1634ab0 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:48:27.300011 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b758a9fa-ac47-4a1f-a8b5-b7f9f1634ab0 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f" status: 200 len: 1690 microversion: 2.1 time: 0.160896 Oct 11 00:48:27.300616 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3602/7856] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:48:27 2022] GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:48:28.189389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-7fabffc4-b505-4b47-a491-fa69a9979a80 req-e8cad762-cd09-41ad-8089-e8b54cc3aad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73d6a064-da00-40d9-8498-2d6a8b120f9f", "name": "network-vif-deleted", "tag": "d1185f93-7103-4487-9e5d-31f8c9ed37dc"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:48:28.200399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7fabffc4-b505-4b47-a491-fa69a9979a80 req-e8cad762-cd09-41ad-8089-e8b54cc3aad8 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:28.201033 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7fabffc4-b505-4b47-a491-fa69a9979a80 req-e8cad762-cd09-41ad-8089-e8b54cc3aad8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:28.201580 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-7fabffc4-b505-4b47-a491-fa69a9979a80 req-e8cad762-cd09-41ad-8089-e8b54cc3aad8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:28.213308 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-7fabffc4-b505-4b47-a491-fa69a9979a80 req-e8cad762-cd09-41ad-8089-e8b54cc3aad8 service nova] Creating event network-vif-deleted:d1185f93-7103-4487-9e5d-31f8c9ed37dc for instance 73d6a064-da00-40d9-8498-2d6a8b120f9f on n-h2-860864-2 Oct 11 00:48:28.218087 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-7fabffc4-b505-4b47-a491-fa69a9979a80 req-e8cad762-cd09-41ad-8089-e8b54cc3aad8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032956 Oct 11 00:48:28.218681 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4255/7857] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:48:28.324761 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a8df878d-49c0-4563-abee-fdd812db20ca tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:48:28.325308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a8df878d-49c0-4563-abee-fdd812db20ca tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:28.332108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8df878d-49c0-4563-abee-fdd812db20ca tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:28.332594 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8df878d-49c0-4563-abee-fdd812db20ca tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:28.333564 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8df878d-49c0-4563-abee-fdd812db20ca tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:28.334252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8df878d-49c0-4563-abee-fdd812db20ca tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:28.334701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8df878d-49c0-4563-abee-fdd812db20ca tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:28.335120 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8df878d-49c0-4563-abee-fdd812db20ca tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:28.368313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8df878d-49c0-4563-abee-fdd812db20ca tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:28.368798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8df878d-49c0-4563-abee-fdd812db20ca tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:28.369233 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a8df878d-49c0-4563-abee-fdd812db20ca tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:28.369706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-a8df878d-49c0-4563-abee-fdd812db20ca tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lazy-loading 'fault' on Instance uuid 73d6a064-da00-40d9-8498-2d6a8b120f9f {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:48:28.416187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a8df878d-49c0-4563-abee-fdd812db20ca tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84c8a15123fb4b0292320555bceb3681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c10fdea561499c9f87fac524ca4113', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:48:28.424080 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a8df878d-49c0-4563-abee-fdd812db20ca tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f" status: 200 len: 1357 microversion: 2.1 time: 0.103449 Oct 11 00:48:28.424647 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3603/7858] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:48:28 2022] GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f => generated 1357 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:48:29.449409 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c1384147-3816-427b-b1fb-c0c761aef5e4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:48:29.450143 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c1384147-3816-427b-b1fb-c0c761aef5e4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] [instance: 73d6a064-da00-40d9-8498-2d6a8b120f9f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:29.456385 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1384147-3816-427b-b1fb-c0c761aef5e4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:29.456888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1384147-3816-427b-b1fb-c0c761aef5e4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:29.457348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1384147-3816-427b-b1fb-c0c761aef5e4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:29.458078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1384147-3816-427b-b1fb-c0c761aef5e4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:29.458705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1384147-3816-427b-b1fb-c0c761aef5e4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:29.459155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1384147-3816-427b-b1fb-c0c761aef5e4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:29.472890 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-c1384147-3816-427b-b1fb-c0c761aef5e4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] HTTP exception thrown: Instance 73d6a064-da00-40d9-8498-2d6a8b120f9f could not be found. Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c1384147-3816-427b-b1fb-c0c761aef5e4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Request method failure captured: Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f HTTP/1.1 Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRLrbIgsnFdcSLuDWSG0BXZJgQ-0aoLaqeEz8A0UaMKXZIvv_xdAg16W-tgk2ATxwWwXTsmkAKVRXeF_uFIvkXsNHX3CXRwU3FdonpA1rskUDVW9HI_SHIbYvWd9DxLNyTUfkF2HQNHtRL2_zgZlbWNH1devNuUVY45TC5ljRE7Bwb78 Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 60c10fdea561499c9f87fac524ca4113 Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-886185438 Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/60c10fdea561499c9f87fac524ca4113"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60c10fdea561499c9f87fac524ca4113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/60c10fdea561499c9f87fac524ca4113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_60c10fdea561499c9f87fac524ca4113", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestNetworkAdvancedServerOps-886185438 Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 60c10fdea561499c9f87fac524ca4113 Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-886185438 Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestNetworkAdvancedServerOps-886185438-project Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 84c8a15123fb4b0292320555bceb3681 Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestNetworkAdvancedServerOps-886185438-project Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance 73d6a064-da00-40d9-8498-2d6a8b120f9f could not be found. Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': '73d6a064-da00-40d9-8498-2d6a8b120f9f'} Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73d6a064-da00-40d9-8498-2d6a8b120f9f could not be found. Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73d6a064-da00-40d9-8498-2d6a8b120f9f could not be found. Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:48:29.475219 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:48:29.480204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:48:29.480204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:48:29.480204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:48:29.480204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:48:29.480204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:48:29.480204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:48:29.480204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73d6a064-da00-40d9-8498-2d6a8b120f9f could not be found. Oct 11 00:48:29.480204 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:48:29.480204 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c1384147-3816-427b-b1fb-c0c761aef5e4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Returning 404 to user: Instance 73d6a064-da00-40d9-8498-2d6a8b120f9f could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:48:29.480204 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c1384147-3816-427b-b1fb-c0c761aef5e4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f" status: 404 len: 111 microversion: 2.1 time: 0.032511 Oct 11 00:48:29.480204 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4256/7859] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:48:29 2022] GET /compute/v2.1/servers/73d6a064-da00-40d9-8498-2d6a8b120f9f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 00:48:32.482308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dae46ff4-b451-48e7-9708-886be6169eb4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] Calling method '.version_select at 0x7f662aab0dc0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:48:32.518963 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dae46ff4-b451-48e7-9708-886be6169eb4 tempest-TestNetworkAdvancedServerOps-886185438 tempest-TestNetworkAdvancedServerOps-886185438-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1391697735" status: 202 len: 0 microversion: 2.1 time: 0.040746 Oct 11 00:48:32.519655 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3604/7860] 10.222.0.23 () {58 vars in 1284 bytes} [Tue Oct 11 00:48:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1391697735 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:48:44.087082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=18 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:48:44.087847 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:48:44.304616 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-59a2b9ea-283a-47b1-950d-348d93da80fe tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Action: 'create', calling method: .version_select at 0x7f662ac100d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1814195076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNADS9/6ui063BXFexvNjge3LUlNe96AxJh0ZCQi9VCmf32uvluViZf1b8l5dYnV2kqq0haE/YZCkMmcS4SLPrf4MucYNw4h2flO+DcMNl3SwVWgRlYYSP5FgF2tP0Mylw=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:48:44.324241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-59a2b9ea-283a-47b1-950d-348d93da80fe tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Getting quotas for project 07c56bef58d3426b8b9f10433063ec54. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:48:44.330895 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-59a2b9ea-283a-47b1-950d-348d93da80fe tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Getting quotas for user 719d0446d98f43fba827fd2731b49a45 and project 07c56bef58d3426b8b9f10433063ec54. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:48:44.359930 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-59a2b9ea-283a-47b1-950d-348d93da80fe tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.278540 Oct 11 00:48:44.360852 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4257/7861] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 11 00:48:44 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:48:45.439009 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:48:45.440149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:48:45.445206 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e978bfe1-6f40-492e-a533-f28a194bfcb3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-910613324", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1814195076", "security_groups": [{"name": "tempest-secgroup-smoke-1856248556"}], "networks": [{"uuid": "548c05f7-34ab-4e56-816f-396f1f378857"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:48:45.564052 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-e978bfe1-6f40-492e-a533-f28a194bfcb3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] validate_networks() for [('548c05f7-34ab-4e56-816f-396f1f378857', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:48:46.075189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e978bfe1-6f40-492e-a533-f28a194bfcb3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:48:46.075741 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e978bfe1-6f40-492e-a533-f28a194bfcb3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:48:46.076293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e978bfe1-6f40-492e-a533-f28a194bfcb3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:48:46.076783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e978bfe1-6f40-492e-a533-f28a194bfcb3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:48:46.077283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-e978bfe1-6f40-492e-a533-f28a194bfcb3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:48:46.087810 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e978bfe1-6f40-492e-a533-f28a194bfcb3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:46.088503 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e978bfe1-6f40-492e-a533-f28a194bfcb3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:46.088931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e978bfe1-6f40-492e-a533-f28a194bfcb3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:46.089745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e978bfe1-6f40-492e-a533-f28a194bfcb3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:46.090212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e978bfe1-6f40-492e-a533-f28a194bfcb3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:46.090706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e978bfe1-6f40-492e-a533-f28a194bfcb3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:46.110388 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-e978bfe1-6f40-492e-a533-f28a194bfcb3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Getting quotas for project 07c56bef58d3426b8b9f10433063ec54. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:48:46.116459 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-e978bfe1-6f40-492e-a533-f28a194bfcb3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Getting quotas for user 719d0446d98f43fba827fd2731b49a45 and project 07c56bef58d3426b8b9f10433063ec54. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:48:46.130183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e978bfe1-6f40-492e-a533-f28a194bfcb3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:48:46.132559 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e978bfe1-6f40-492e-a533-f28a194bfcb3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:48:46.182598 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e978bfe1-6f40-492e-a533-f28a194bfcb3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.745463 Oct 11 00:48:46.189919 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3605/7862] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:48:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:48:46.196634 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7e3fcd61-00dd-471a-ad81-31185e2b689c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:48:46.198063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7e3fcd61-00dd-471a-ad81-31185e2b689c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:46.258429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7e3fcd61-00dd-471a-ad81-31185e2b689c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:48:46.266235 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7e3fcd61-00dd-471a-ad81-31185e2b689c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1246 microversion: 2.1 time: 0.074755 Oct 11 00:48:46.271953 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4258/7863] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:48:46 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1246 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:48:47.293321 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-92cc267e-cf26-476e-ae06-26d0b03632bf tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:48:47.294782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-92cc267e-cf26-476e-ae06-26d0b03632bf tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:47.306603 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92cc267e-cf26-476e-ae06-26d0b03632bf tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:47.307096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92cc267e-cf26-476e-ae06-26d0b03632bf tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:47.307556 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92cc267e-cf26-476e-ae06-26d0b03632bf tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:47.308290 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92cc267e-cf26-476e-ae06-26d0b03632bf tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:47.308771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92cc267e-cf26-476e-ae06-26d0b03632bf tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:47.309222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-92cc267e-cf26-476e-ae06-26d0b03632bf tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:47.398937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-92cc267e-cf26-476e-ae06-26d0b03632bf tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:48:47.408573 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-92cc267e-cf26-476e-ae06-26d0b03632bf tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1298 microversion: 2.1 time: 0.119223 Oct 11 00:48:47.411975 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3606/7864] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:48:47 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1298 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:48:48.439509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d5826e5a-7fe3-41db-be91-89cb2361d296 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:48:48.440148 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d5826e5a-7fe3-41db-be91-89cb2361d296 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:48.450100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5826e5a-7fe3-41db-be91-89cb2361d296 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:48.450681 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5826e5a-7fe3-41db-be91-89cb2361d296 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:48.451216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5826e5a-7fe3-41db-be91-89cb2361d296 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:48.452245 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5826e5a-7fe3-41db-be91-89cb2361d296 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:48.452821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5826e5a-7fe3-41db-be91-89cb2361d296 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:48.453273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5826e5a-7fe3-41db-be91-89cb2361d296 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:48.615747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d5826e5a-7fe3-41db-be91-89cb2361d296 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:48:48.623991 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d5826e5a-7fe3-41db-be91-89cb2361d296 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1372 microversion: 2.1 time: 0.189135 Oct 11 00:48:48.624584 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4259/7865] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:48:48 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1372 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:48:49.245678 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-e38c7589-c07a-4ef5-b0ad-1779f8cb61db req-186b5174-2189-49b3-ad02-a3a955fbb091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "266c1087-a8ea-4f20-a438-9cae049be7da", "tag": "fe59bf96-88a9-4ca1-b6bf-8726519358ff"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:48:49.261705 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e38c7589-c07a-4ef5-b0ad-1779f8cb61db req-186b5174-2189-49b3-ad02-a3a955fbb091 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:49.262557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e38c7589-c07a-4ef5-b0ad-1779f8cb61db req-186b5174-2189-49b3-ad02-a3a955fbb091 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:49.262991 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-e38c7589-c07a-4ef5-b0ad-1779f8cb61db req-186b5174-2189-49b3-ad02-a3a955fbb091 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:49.275578 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-e38c7589-c07a-4ef5-b0ad-1779f8cb61db req-186b5174-2189-49b3-ad02-a3a955fbb091 service nova] Creating event network-changed:fe59bf96-88a9-4ca1-b6bf-8726519358ff for instance 266c1087-a8ea-4f20-a438-9cae049be7da on n-h1-860864-2 Oct 11 00:48:49.282784 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-e38c7589-c07a-4ef5-b0ad-1779f8cb61db req-186b5174-2189-49b3-ad02-a3a955fbb091 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040477 Oct 11 00:48:49.283408 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3607/7866] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:48:49.647738 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-41479593-778e-483a-83dc-1039e67ff6d9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:48:49.648564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-41479593-778e-483a-83dc-1039e67ff6d9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:49.657065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41479593-778e-483a-83dc-1039e67ff6d9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:49.657620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41479593-778e-483a-83dc-1039e67ff6d9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:49.658088 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41479593-778e-483a-83dc-1039e67ff6d9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:49.658836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41479593-778e-483a-83dc-1039e67ff6d9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:49.659316 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41479593-778e-483a-83dc-1039e67ff6d9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:49.659767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-41479593-778e-483a-83dc-1039e67ff6d9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:49.812105 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-41479593-778e-483a-83dc-1039e67ff6d9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:48:49.820379 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-41479593-778e-483a-83dc-1039e67ff6d9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1372 microversion: 2.1 time: 0.177294 Oct 11 00:48:49.820975 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4260/7867] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:48:49 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:48:50.846393 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f50f28c8-b206-40ae-8e96-7c0b25c1c78c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:48:50.847569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f50f28c8-b206-40ae-8e96-7c0b25c1c78c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:50.857782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f50f28c8-b206-40ae-8e96-7c0b25c1c78c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:50.858759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f50f28c8-b206-40ae-8e96-7c0b25c1c78c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:50.859202 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f50f28c8-b206-40ae-8e96-7c0b25c1c78c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:50.859910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f50f28c8-b206-40ae-8e96-7c0b25c1c78c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:50.860637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f50f28c8-b206-40ae-8e96-7c0b25c1c78c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:50.861073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f50f28c8-b206-40ae-8e96-7c0b25c1c78c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:51.010691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f50f28c8-b206-40ae-8e96-7c0b25c1c78c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:48:51.018623 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f50f28c8-b206-40ae-8e96-7c0b25c1c78c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1372 microversion: 2.1 time: 0.178396 Oct 11 00:48:51.019225 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3608/7868] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:48:50 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1372 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:48:52.042646 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-37d640dd-0a87-40da-8adf-34328cd21be8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:48:52.043284 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-37d640dd-0a87-40da-8adf-34328cd21be8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:52.050243 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37d640dd-0a87-40da-8adf-34328cd21be8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:52.050747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37d640dd-0a87-40da-8adf-34328cd21be8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:52.052093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37d640dd-0a87-40da-8adf-34328cd21be8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:52.052835 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37d640dd-0a87-40da-8adf-34328cd21be8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:52.053311 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37d640dd-0a87-40da-8adf-34328cd21be8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:52.053778 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-37d640dd-0a87-40da-8adf-34328cd21be8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:52.196252 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-37d640dd-0a87-40da-8adf-34328cd21be8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:48:52.204735 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-37d640dd-0a87-40da-8adf-34328cd21be8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1372 microversion: 2.1 time: 0.166100 Oct 11 00:48:52.205334 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4261/7869] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:48:52 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:48:53.228889 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6da96ea5-a9b5-4080-bf2b-ca58b16b9d3d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:48:53.229541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6da96ea5-a9b5-4080-bf2b-ca58b16b9d3d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:53.236913 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6da96ea5-a9b5-4080-bf2b-ca58b16b9d3d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:53.237430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6da96ea5-a9b5-4080-bf2b-ca58b16b9d3d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:53.237872 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6da96ea5-a9b5-4080-bf2b-ca58b16b9d3d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:53.239092 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6da96ea5-a9b5-4080-bf2b-ca58b16b9d3d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:53.239713 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6da96ea5-a9b5-4080-bf2b-ca58b16b9d3d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:53.240141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6da96ea5-a9b5-4080-bf2b-ca58b16b9d3d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:53.376165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6da96ea5-a9b5-4080-bf2b-ca58b16b9d3d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:48:53.384892 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6da96ea5-a9b5-4080-bf2b-ca58b16b9d3d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1372 microversion: 2.1 time: 0.159838 Oct 11 00:48:53.387414 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3609/7870] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:48:53 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:48:54.407907 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a30fd702-8b02-42d4-a2d0-9d7a0696ca08 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:48:54.408530 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a30fd702-8b02-42d4-a2d0-9d7a0696ca08 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:54.416278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a30fd702-8b02-42d4-a2d0-9d7a0696ca08 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:54.416962 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a30fd702-8b02-42d4-a2d0-9d7a0696ca08 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:54.417447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a30fd702-8b02-42d4-a2d0-9d7a0696ca08 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:54.418237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a30fd702-8b02-42d4-a2d0-9d7a0696ca08 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:54.418699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a30fd702-8b02-42d4-a2d0-9d7a0696ca08 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:54.419140 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a30fd702-8b02-42d4-a2d0-9d7a0696ca08 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:54.556622 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a30fd702-8b02-42d4-a2d0-9d7a0696ca08 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:48:54.564554 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a30fd702-8b02-42d4-a2d0-9d7a0696ca08 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1372 microversion: 2.1 time: 0.160635 Oct 11 00:48:54.565125 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4262/7871] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:48:54 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:48:55.588965 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-496c28ef-b480-4a13-83eb-035f5917a2ca tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:48:55.589622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-496c28ef-b480-4a13-83eb-035f5917a2ca tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:55.596549 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-496c28ef-b480-4a13-83eb-035f5917a2ca tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:55.597035 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-496c28ef-b480-4a13-83eb-035f5917a2ca tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:55.597502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-496c28ef-b480-4a13-83eb-035f5917a2ca tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:55.598868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-496c28ef-b480-4a13-83eb-035f5917a2ca tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:55.599495 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-496c28ef-b480-4a13-83eb-035f5917a2ca tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:55.599928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-496c28ef-b480-4a13-83eb-035f5917a2ca tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:55.662212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-6fbeea8e-a9ad-438f-99b5-04d09a192587 req-f9aa3f19-03e0-410c-9bea-dc6d58458476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "266c1087-a8ea-4f20-a438-9cae049be7da", "name": "network-vif-plugged", "status": "completed", "tag": "fe59bf96-88a9-4ca1-b6bf-8726519358ff"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:48:55.672829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6fbeea8e-a9ad-438f-99b5-04d09a192587 req-f9aa3f19-03e0-410c-9bea-dc6d58458476 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:55.673949 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6fbeea8e-a9ad-438f-99b5-04d09a192587 req-f9aa3f19-03e0-410c-9bea-dc6d58458476 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:55.674087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-6fbeea8e-a9ad-438f-99b5-04d09a192587 req-f9aa3f19-03e0-410c-9bea-dc6d58458476 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:55.686164 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-6fbeea8e-a9ad-438f-99b5-04d09a192587 req-f9aa3f19-03e0-410c-9bea-dc6d58458476 service nova] Creating event network-vif-plugged:fe59bf96-88a9-4ca1-b6bf-8726519358ff for instance 266c1087-a8ea-4f20-a438-9cae049be7da on n-h1-860864-2 Oct 11 00:48:55.691314 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-6fbeea8e-a9ad-438f-99b5-04d09a192587 req-f9aa3f19-03e0-410c-9bea-dc6d58458476 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033392 Oct 11 00:48:55.692678 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4263/7872] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:48:55.745198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-496c28ef-b480-4a13-83eb-035f5917a2ca tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:48:55.753268 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-496c28ef-b480-4a13-83eb-035f5917a2ca tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1372 microversion: 2.1 time: 0.168321 Oct 11 00:48:55.753905 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3610/7873] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:48:55 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:48:56.774302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:48:56.775412 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:48:56.775623 n-d-860864-2 devstack@n-api.service[120613]: Tue Oct 11 00:48:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da (ip 10.222.0.23) !!! Oct 11 00:48:56.781538 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0a635370-f5f2-4814-848e-94253a149acb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:48:56.782274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0a635370-f5f2-4814-848e-94253a149acb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:56.792645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a635370-f5f2-4814-848e-94253a149acb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:56.793139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a635370-f5f2-4814-848e-94253a149acb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:56.793610 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a635370-f5f2-4814-848e-94253a149acb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:56.794324 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a635370-f5f2-4814-848e-94253a149acb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:56.794790 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a635370-f5f2-4814-848e-94253a149acb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:56.795225 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0a635370-f5f2-4814-848e-94253a149acb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:56.929880 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0a635370-f5f2-4814-848e-94253a149acb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:48:56.938533 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0a635370-f5f2-4814-848e-94253a149acb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1372 microversion: 2.1 time: 0.165227 Oct 11 00:48:56.939146 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4264/7874] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:48:56 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:48:57.961774 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-db01bf12-2ceb-4358-b934-e311df99fa9e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:48:57.962386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-db01bf12-2ceb-4358-b934-e311df99fa9e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:57.964407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:48:57.965082 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:48:57.973695 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db01bf12-2ceb-4358-b934-e311df99fa9e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:57.974620 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db01bf12-2ceb-4358-b934-e311df99fa9e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:57.975069 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db01bf12-2ceb-4358-b934-e311df99fa9e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:57.975769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db01bf12-2ceb-4358-b934-e311df99fa9e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:57.976217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db01bf12-2ceb-4358-b934-e311df99fa9e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:57.976640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-db01bf12-2ceb-4358-b934-e311df99fa9e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:58.116573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-db01bf12-2ceb-4358-b934-e311df99fa9e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:48:58.124771 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-db01bf12-2ceb-4358-b934-e311df99fa9e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1557 microversion: 2.1 time: 0.167638 Oct 11 00:48:58.125365 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3611/7875] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:48:57 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1557 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:48:58.148068 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6fdd85f7-978f-4b75-859d-568efe62ae3c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:48:58.148699 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6fdd85f7-978f-4b75-859d-568efe62ae3c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:48:58.154716 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fdd85f7-978f-4b75-859d-568efe62ae3c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:58.155215 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fdd85f7-978f-4b75-859d-568efe62ae3c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:58.155666 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fdd85f7-978f-4b75-859d-568efe62ae3c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:58.156363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fdd85f7-978f-4b75-859d-568efe62ae3c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:48:58.156827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fdd85f7-978f-4b75-859d-568efe62ae3c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:48:58.157273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fdd85f7-978f-4b75-859d-568efe62ae3c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:48:58.294886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6fdd85f7-978f-4b75-859d-568efe62ae3c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:48:58.303374 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6fdd85f7-978f-4b75-859d-568efe62ae3c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1557 microversion: 2.1 time: 0.159888 Oct 11 00:48:58.303974 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4265/7876] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:48:58 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:49:00.031995 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-caaefb2e-5401-4b9f-9fd5-534e5d8c29e9 req-abcaccde-cfaf-4505-b9e4-c89e5dcf9090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "266c1087-a8ea-4f20-a438-9cae049be7da", "tag": "fe59bf96-88a9-4ca1-b6bf-8726519358ff"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:49:00.043441 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-caaefb2e-5401-4b9f-9fd5-534e5d8c29e9 req-abcaccde-cfaf-4505-b9e4-c89e5dcf9090 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:49:00.043944 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-caaefb2e-5401-4b9f-9fd5-534e5d8c29e9 req-abcaccde-cfaf-4505-b9e4-c89e5dcf9090 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:49:00.044399 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-caaefb2e-5401-4b9f-9fd5-534e5d8c29e9 req-abcaccde-cfaf-4505-b9e4-c89e5dcf9090 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:49:00.056959 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-caaefb2e-5401-4b9f-9fd5-534e5d8c29e9 req-abcaccde-cfaf-4505-b9e4-c89e5dcf9090 service nova] Creating event network-changed:fe59bf96-88a9-4ca1-b6bf-8726519358ff for instance 266c1087-a8ea-4f20-a438-9cae049be7da on n-h1-860864-2 Oct 11 00:49:00.062798 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-caaefb2e-5401-4b9f-9fd5-534e5d8c29e9 req-abcaccde-cfaf-4505-b9e4-c89e5dcf9090 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034641 Oct 11 00:49:00.063425 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3612/7877] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:51:36.872808 n-d-860864-2 devstack@n-api.service[120613]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dded55a6-8973-44c5-bba8-4440254057cd] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 00:51:36.873731 n-d-860864-2 devstack@n-api.service[120613]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9b2b028e-60c1-4dc3-ac1e-06905f87835c] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 00:51:36.874597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:51:36.875335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=38 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:51:36.876429 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:51:36.876585 n-d-860864-2 devstack@n-api.service[120613]: Tue Oct 11 00:51:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da/action (ip 10.222.0.23) !!! Oct 11 00:51:36.878608 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:51:36.878733 n-d-860864-2 devstack@n-api.service[120613]: Tue Oct 11 00:51:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da/action (ip 10.222.0.23) !!! Oct 11 00:51:36.887380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a7ea8232-e1dc-4b39-8d20-549c31fd64a2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:51:36.887929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a7ea8232-e1dc-4b39-8d20-549c31fd64a2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:51:36.900093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7ea8232-e1dc-4b39-8d20-549c31fd64a2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:36.900585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7ea8232-e1dc-4b39-8d20-549c31fd64a2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:36.901042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7ea8232-e1dc-4b39-8d20-549c31fd64a2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:36.901793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7ea8232-e1dc-4b39-8d20-549c31fd64a2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:36.902265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7ea8232-e1dc-4b39-8d20-549c31fd64a2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:36.902707 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a7ea8232-e1dc-4b39-8d20-549c31fd64a2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:36.928034 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-a7ea8232-e1dc-4b39-8d20-549c31fd64a2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lazy-loading 'flavor' on Instance uuid 266c1087-a8ea-4f20-a438-9cae049be7da {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:51:37.250999 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a7ea8232-e1dc-4b39-8d20-549c31fd64a2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "POST /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da/action" status: 202 len: 0 microversion: 2.1 time: 0.379723 Oct 11 00:51:37.251601 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4266/7878] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:51:36 2022] POST /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:51:37.258324 n-d-860864-2 devstack@n-api.service[120614]: ERROR oslo.messaging._drivers.impl_rabbit [-] [31233ac2-692f-4d5e-84d4-7551eaa91acd] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 00:51:37.259135 n-d-860864-2 devstack@n-api.service[120614]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0f2d80e9-f410-4772-8046-431e3c70ceb3] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 00:51:37.259766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:51:37.260915 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=36 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:51:37.262086 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 00:51:37.262315 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:51:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da (ip 10.222.0.23) !!! Oct 11 00:51:37.263285 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:51:37.263602 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:51:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da (ip 10.222.0.23) !!! Oct 11 00:51:37.264827 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:51:37.265158 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:51:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da (ip 10.222.0.23) !!! Oct 11 00:51:37.271034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-da2de56c-ccc5-4b78-8be1-b9dfcaf1f515 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:51:37.271720 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-da2de56c-ccc5-4b78-8be1-b9dfcaf1f515 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:51:37.284292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da2de56c-ccc5-4b78-8be1-b9dfcaf1f515 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:37.284783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da2de56c-ccc5-4b78-8be1-b9dfcaf1f515 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:37.285219 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da2de56c-ccc5-4b78-8be1-b9dfcaf1f515 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:37.285945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da2de56c-ccc5-4b78-8be1-b9dfcaf1f515 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:37.286397 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da2de56c-ccc5-4b78-8be1-b9dfcaf1f515 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:37.286822 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da2de56c-ccc5-4b78-8be1-b9dfcaf1f515 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:37.427104 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-da2de56c-ccc5-4b78-8be1-b9dfcaf1f515 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:51:37.435586 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-da2de56c-ccc5-4b78-8be1-b9dfcaf1f515 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1682 microversion: 2.1 time: 0.179451 Oct 11 00:51:37.436415 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3613/7879] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:51:37 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:51:38.464853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7144883b-28ab-44e7-9f24-29faa661235d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:51:38.465620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7144883b-28ab-44e7-9f24-29faa661235d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:51:38.478703 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] [9b2b028e-60c1-4dc3-ac1e-06905f87835c] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 40768. Oct 11 00:51:38.482197 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7144883b-28ab-44e7-9f24-29faa661235d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:38.482695 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7144883b-28ab-44e7-9f24-29faa661235d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:38.483146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7144883b-28ab-44e7-9f24-29faa661235d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:38.483876 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7144883b-28ab-44e7-9f24-29faa661235d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:38.484345 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7144883b-28ab-44e7-9f24-29faa661235d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:38.484779 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7144883b-28ab-44e7-9f24-29faa661235d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:38.488361 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] [dded55a6-8973-44c5-bba8-4440254057cd] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 40766. Oct 11 00:51:38.618370 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7144883b-28ab-44e7-9f24-29faa661235d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:51:38.626333 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7144883b-28ab-44e7-9f24-29faa661235d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1682 microversion: 2.1 time: 0.170489 Oct 11 00:51:38.626904 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4267/7880] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:51:38 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:51:39.650954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4e008331-4143-4269-9561-75f082def142 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:51:39.651553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4e008331-4143-4269-9561-75f082def142 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:51:39.660386 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e008331-4143-4269-9561-75f082def142 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:39.660921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e008331-4143-4269-9561-75f082def142 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:39.661308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e008331-4143-4269-9561-75f082def142 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:39.662030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e008331-4143-4269-9561-75f082def142 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:39.662485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e008331-4143-4269-9561-75f082def142 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:39.662911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4e008331-4143-4269-9561-75f082def142 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:39.670483 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] [31233ac2-692f-4d5e-84d4-7551eaa91acd] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 40776. Oct 11 00:51:39.681397 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] [0f2d80e9-f410-4772-8046-431e3c70ceb3] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 40778. Oct 11 00:51:39.802534 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4e008331-4143-4269-9561-75f082def142 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:51:39.811561 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4e008331-4143-4269-9561-75f082def142 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1682 microversion: 2.1 time: 0.165236 Oct 11 00:51:39.812139 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3614/7881] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:51:39 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:51:40.835258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-155bb4a6-e54d-4755-b603-187f8e6408e2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:51:40.836498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-155bb4a6-e54d-4755-b603-187f8e6408e2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:51:40.843170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-155bb4a6-e54d-4755-b603-187f8e6408e2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:40.843670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-155bb4a6-e54d-4755-b603-187f8e6408e2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:40.844128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-155bb4a6-e54d-4755-b603-187f8e6408e2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:40.844837 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-155bb4a6-e54d-4755-b603-187f8e6408e2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:40.845309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-155bb4a6-e54d-4755-b603-187f8e6408e2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:40.845775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-155bb4a6-e54d-4755-b603-187f8e6408e2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:40.979735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-155bb4a6-e54d-4755-b603-187f8e6408e2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:51:40.987610 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-155bb4a6-e54d-4755-b603-187f8e6408e2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1682 microversion: 2.1 time: 0.156290 Oct 11 00:51:40.988191 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4268/7882] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:51:40 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:51:42.012526 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-c0c21b2d-bf87-4e47-b234-20581a9ef6ce tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:51:42.013181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-c0c21b2d-bf87-4e47-b234-20581a9ef6ce tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:51:42.020064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c0c21b2d-bf87-4e47-b234-20581a9ef6ce tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:42.020550 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c0c21b2d-bf87-4e47-b234-20581a9ef6ce tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:42.020986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c0c21b2d-bf87-4e47-b234-20581a9ef6ce tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:42.021707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c0c21b2d-bf87-4e47-b234-20581a9ef6ce tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:42.022169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c0c21b2d-bf87-4e47-b234-20581a9ef6ce tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:42.022596 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-c0c21b2d-bf87-4e47-b234-20581a9ef6ce tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:42.153917 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-c0c21b2d-bf87-4e47-b234-20581a9ef6ce tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:51:42.161647 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-c0c21b2d-bf87-4e47-b234-20581a9ef6ce tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1682 microversion: 2.1 time: 0.153759 Oct 11 00:51:42.162228 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3615/7883] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:51:42 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:51:43.188175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-77318cfe-2b56-4ab0-a47a-9df7884561e9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:51:43.188840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-77318cfe-2b56-4ab0-a47a-9df7884561e9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:51:43.195852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77318cfe-2b56-4ab0-a47a-9df7884561e9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:43.196413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77318cfe-2b56-4ab0-a47a-9df7884561e9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:43.196874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77318cfe-2b56-4ab0-a47a-9df7884561e9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:43.197637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77318cfe-2b56-4ab0-a47a-9df7884561e9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:43.198111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77318cfe-2b56-4ab0-a47a-9df7884561e9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:43.198553 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-77318cfe-2b56-4ab0-a47a-9df7884561e9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:43.336075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-77318cfe-2b56-4ab0-a47a-9df7884561e9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:51:43.343956 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-77318cfe-2b56-4ab0-a47a-9df7884561e9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1682 microversion: 2.1 time: 0.160014 Oct 11 00:51:43.344563 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4269/7884] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:51:43 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:51:44.367107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b9b88013-b448-4d08-975b-d670a099bd4b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:51:44.367955 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b9b88013-b448-4d08-975b-d670a099bd4b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:51:44.374684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9b88013-b448-4d08-975b-d670a099bd4b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:44.375172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9b88013-b448-4d08-975b-d670a099bd4b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:44.375607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9b88013-b448-4d08-975b-d670a099bd4b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:44.376300 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9b88013-b448-4d08-975b-d670a099bd4b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:44.376755 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9b88013-b448-4d08-975b-d670a099bd4b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:44.377188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b9b88013-b448-4d08-975b-d670a099bd4b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:44.511731 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b9b88013-b448-4d08-975b-d670a099bd4b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:51:44.519447 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b9b88013-b448-4d08-975b-d670a099bd4b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1682 microversion: 2.1 time: 0.156353 Oct 11 00:51:44.520036 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3616/7885] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:51:44 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:51:45.543878 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c0354ace-538d-4bb8-85d5-5e94521fcc9b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:51:45.544422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c0354ace-538d-4bb8-85d5-5e94521fcc9b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:51:45.551400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0354ace-538d-4bb8-85d5-5e94521fcc9b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:45.551901 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0354ace-538d-4bb8-85d5-5e94521fcc9b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:45.552362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0354ace-538d-4bb8-85d5-5e94521fcc9b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:45.553067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0354ace-538d-4bb8-85d5-5e94521fcc9b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:45.553565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0354ace-538d-4bb8-85d5-5e94521fcc9b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:45.554016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0354ace-538d-4bb8-85d5-5e94521fcc9b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:45.692057 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c0354ace-538d-4bb8-85d5-5e94521fcc9b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:51:45.700702 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c0354ace-538d-4bb8-85d5-5e94521fcc9b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1682 microversion: 2.1 time: 0.161304 Oct 11 00:51:45.701300 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4270/7886] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:51:45 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:51:46.724271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-678d71db-4101-42f2-ac2a-52f0e5a422d8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:51:46.724887 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-678d71db-4101-42f2-ac2a-52f0e5a422d8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:51:46.731875 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-678d71db-4101-42f2-ac2a-52f0e5a422d8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:46.732355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-678d71db-4101-42f2-ac2a-52f0e5a422d8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:46.732790 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-678d71db-4101-42f2-ac2a-52f0e5a422d8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:46.733500 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-678d71db-4101-42f2-ac2a-52f0e5a422d8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:46.733959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-678d71db-4101-42f2-ac2a-52f0e5a422d8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:46.734382 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-678d71db-4101-42f2-ac2a-52f0e5a422d8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:46.868640 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-678d71db-4101-42f2-ac2a-52f0e5a422d8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:51:46.876414 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-678d71db-4101-42f2-ac2a-52f0e5a422d8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1682 microversion: 2.1 time: 0.156128 Oct 11 00:51:46.876992 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3617/7887] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:51:46 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:51:47.901011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6f816139-3f42-4035-b3d4-8c1723507bfc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:51:47.901658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6f816139-3f42-4035-b3d4-8c1723507bfc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:51:47.908704 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f816139-3f42-4035-b3d4-8c1723507bfc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:47.909208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f816139-3f42-4035-b3d4-8c1723507bfc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:47.909696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f816139-3f42-4035-b3d4-8c1723507bfc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:47.910413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f816139-3f42-4035-b3d4-8c1723507bfc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:47.910883 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f816139-3f42-4035-b3d4-8c1723507bfc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:47.911329 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6f816139-3f42-4035-b3d4-8c1723507bfc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:48.045101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6f816139-3f42-4035-b3d4-8c1723507bfc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:51:48.052879 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6f816139-3f42-4035-b3d4-8c1723507bfc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1682 microversion: 2.1 time: 0.156478 Oct 11 00:51:48.053488 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4271/7888] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:51:47 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:51:49.077091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-11ae38d0-8f2f-4029-9998-46d8187b693c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:51:49.077666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-11ae38d0-8f2f-4029-9998-46d8187b693c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:51:49.084825 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11ae38d0-8f2f-4029-9998-46d8187b693c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:49.085307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11ae38d0-8f2f-4029-9998-46d8187b693c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:49.085788 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11ae38d0-8f2f-4029-9998-46d8187b693c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:49.087575 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11ae38d0-8f2f-4029-9998-46d8187b693c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:49.088019 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11ae38d0-8f2f-4029-9998-46d8187b693c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:49.088445 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11ae38d0-8f2f-4029-9998-46d8187b693c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:49.225962 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-11ae38d0-8f2f-4029-9998-46d8187b693c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:51:49.234336 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-11ae38d0-8f2f-4029-9998-46d8187b693c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1703 microversion: 2.1 time: 0.161205 Oct 11 00:51:49.234915 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3618/7889] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:51:49 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1703 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:51:50.257505 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-05cb1d70-28bb-497f-83d9-546c767334a8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:51:50.258164 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-05cb1d70-28bb-497f-83d9-546c767334a8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:51:50.266547 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05cb1d70-28bb-497f-83d9-546c767334a8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:50.267047 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05cb1d70-28bb-497f-83d9-546c767334a8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:50.267497 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05cb1d70-28bb-497f-83d9-546c767334a8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:50.268200 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05cb1d70-28bb-497f-83d9-546c767334a8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:50.268664 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05cb1d70-28bb-497f-83d9-546c767334a8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:50.269100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-05cb1d70-28bb-497f-83d9-546c767334a8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:50.406501 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-05cb1d70-28bb-497f-83d9-546c767334a8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:51:50.414409 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-05cb1d70-28bb-497f-83d9-546c767334a8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1703 microversion: 2.1 time: 0.160785 Oct 11 00:51:50.415132 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4272/7890] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:51:50 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1703 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:51:51.440473 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2a2d042d-6905-4066-a921-4038bc9b3aea tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:51:51.441091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2a2d042d-6905-4066-a921-4038bc9b3aea tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:51:51.448389 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a2d042d-6905-4066-a921-4038bc9b3aea tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:51.448878 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a2d042d-6905-4066-a921-4038bc9b3aea tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:51.449314 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a2d042d-6905-4066-a921-4038bc9b3aea tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:51.450030 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a2d042d-6905-4066-a921-4038bc9b3aea tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:51.450485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a2d042d-6905-4066-a921-4038bc9b3aea tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:51.450910 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2a2d042d-6905-4066-a921-4038bc9b3aea tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:51.586510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2a2d042d-6905-4066-a921-4038bc9b3aea tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:51:51.595107 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2a2d042d-6905-4066-a921-4038bc9b3aea tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1703 microversion: 2.1 time: 0.158803 Oct 11 00:51:51.595689 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3619/7891] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:51:51 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1703 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:51:52.470323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-580485a2-b7e4-42d8-8cc8-44120772eb2f req-4ad17861-582b-4d5c-8425-76811e5e50f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "266c1087-a8ea-4f20-a438-9cae049be7da", "name": "network-vif-plugged", "status": "completed", "tag": "fe59bf96-88a9-4ca1-b6bf-8726519358ff"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:51:52.480806 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-580485a2-b7e4-42d8-8cc8-44120772eb2f req-4ad17861-582b-4d5c-8425-76811e5e50f8 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:52.481302 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-580485a2-b7e4-42d8-8cc8-44120772eb2f req-4ad17861-582b-4d5c-8425-76811e5e50f8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:52.481773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-580485a2-b7e4-42d8-8cc8-44120772eb2f req-4ad17861-582b-4d5c-8425-76811e5e50f8 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:52.493148 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-580485a2-b7e4-42d8-8cc8-44120772eb2f req-4ad17861-582b-4d5c-8425-76811e5e50f8 service nova] Creating event network-vif-plugged:fe59bf96-88a9-4ca1-b6bf-8726519358ff for instance 266c1087-a8ea-4f20-a438-9cae049be7da on n-h1-860864-2 Oct 11 00:51:52.498619 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-580485a2-b7e4-42d8-8cc8-44120772eb2f req-4ad17861-582b-4d5c-8425-76811e5e50f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032010 Oct 11 00:51:52.499230 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4273/7892] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:51:52.618966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a5df8839-57bf-4463-a581-e9e3fb9ad633 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:51:52.620673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a5df8839-57bf-4463-a581-e9e3fb9ad633 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:51:52.627528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5df8839-57bf-4463-a581-e9e3fb9ad633 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:52.628022 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5df8839-57bf-4463-a581-e9e3fb9ad633 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:52.628476 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5df8839-57bf-4463-a581-e9e3fb9ad633 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:52.629169 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5df8839-57bf-4463-a581-e9e3fb9ad633 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:52.629665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5df8839-57bf-4463-a581-e9e3fb9ad633 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:52.630088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5df8839-57bf-4463-a581-e9e3fb9ad633 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:52.764360 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a5df8839-57bf-4463-a581-e9e3fb9ad633 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:51:52.772265 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a5df8839-57bf-4463-a581-e9e3fb9ad633 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1703 microversion: 2.1 time: 0.157755 Oct 11 00:51:52.772839 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3620/7893] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:51:52 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1703 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:51:53.797451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2e468872-c8c8-4ed7-a4d3-4f3a2f5a5753 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:51:53.798083 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2e468872-c8c8-4ed7-a4d3-4f3a2f5a5753 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:51:53.804274 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e468872-c8c8-4ed7-a4d3-4f3a2f5a5753 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:53.804768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e468872-c8c8-4ed7-a4d3-4f3a2f5a5753 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:53.805218 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e468872-c8c8-4ed7-a4d3-4f3a2f5a5753 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:53.805956 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e468872-c8c8-4ed7-a4d3-4f3a2f5a5753 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:53.806585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e468872-c8c8-4ed7-a4d3-4f3a2f5a5753 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:53.807021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2e468872-c8c8-4ed7-a4d3-4f3a2f5a5753 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:53.946189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2e468872-c8c8-4ed7-a4d3-4f3a2f5a5753 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:51:53.955234 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2e468872-c8c8-4ed7-a4d3-4f3a2f5a5753 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1703 microversion: 2.1 time: 0.163078 Oct 11 00:51:53.955838 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4274/7894] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:51:53 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1703 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:51:54.981453 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0bd6d1f3-e77d-49ee-aeba-1d7698a77e99 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:51:54.982239 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0bd6d1f3-e77d-49ee-aeba-1d7698a77e99 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:51:54.990815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0bd6d1f3-e77d-49ee-aeba-1d7698a77e99 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:54.991487 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0bd6d1f3-e77d-49ee-aeba-1d7698a77e99 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:54.991930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0bd6d1f3-e77d-49ee-aeba-1d7698a77e99 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:54.992783 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0bd6d1f3-e77d-49ee-aeba-1d7698a77e99 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:54.993243 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0bd6d1f3-e77d-49ee-aeba-1d7698a77e99 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:54.994826 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0bd6d1f3-e77d-49ee-aeba-1d7698a77e99 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:55.135583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0bd6d1f3-e77d-49ee-aeba-1d7698a77e99 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:51:55.144088 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0bd6d1f3-e77d-49ee-aeba-1d7698a77e99 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1698 microversion: 2.1 time: 0.167882 Oct 11 00:51:55.144754 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3621/7895] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:51:54 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1698 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:51:56.170586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-340db76b-02b9-4067-b3c3-6209935f9f08 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:51:56.171237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-340db76b-02b9-4067-b3c3-6209935f9f08 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:51:56.178586 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-340db76b-02b9-4067-b3c3-6209935f9f08 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:56.179338 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-340db76b-02b9-4067-b3c3-6209935f9f08 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:56.179980 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-340db76b-02b9-4067-b3c3-6209935f9f08 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:56.180924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-340db76b-02b9-4067-b3c3-6209935f9f08 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:56.182128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-340db76b-02b9-4067-b3c3-6209935f9f08 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:56.182574 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-340db76b-02b9-4067-b3c3-6209935f9f08 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:56.331802 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-340db76b-02b9-4067-b3c3-6209935f9f08 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:51:56.344579 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-340db76b-02b9-4067-b3c3-6209935f9f08 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1698 microversion: 2.1 time: 0.177963 Oct 11 00:51:56.349954 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4275/7896] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:51:56 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1698 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:51:57.378567 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0e27fe17-e83b-4de1-9254-22ed8f528b40 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:51:57.379840 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0e27fe17-e83b-4de1-9254-22ed8f528b40 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:51:57.387492 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e27fe17-e83b-4de1-9254-22ed8f528b40 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:57.388340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e27fe17-e83b-4de1-9254-22ed8f528b40 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:57.388862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e27fe17-e83b-4de1-9254-22ed8f528b40 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:57.389597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e27fe17-e83b-4de1-9254-22ed8f528b40 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:57.390054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e27fe17-e83b-4de1-9254-22ed8f528b40 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:57.390486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0e27fe17-e83b-4de1-9254-22ed8f528b40 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:57.543608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0e27fe17-e83b-4de1-9254-22ed8f528b40 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:51:57.552016 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0e27fe17-e83b-4de1-9254-22ed8f528b40 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1698 microversion: 2.1 time: 0.178226 Oct 11 00:51:57.552649 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3622/7897] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:51:57 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1698 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:51:58.577208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-90ba3dec-1a86-4b9b-8c1a-da6541198561 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:51:58.577892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-90ba3dec-1a86-4b9b-8c1a-da6541198561 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:51:58.585043 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90ba3dec-1a86-4b9b-8c1a-da6541198561 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:58.585554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90ba3dec-1a86-4b9b-8c1a-da6541198561 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:58.586024 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90ba3dec-1a86-4b9b-8c1a-da6541198561 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:58.586726 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90ba3dec-1a86-4b9b-8c1a-da6541198561 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:58.587223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90ba3dec-1a86-4b9b-8c1a-da6541198561 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:58.588132 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-90ba3dec-1a86-4b9b-8c1a-da6541198561 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:58.741156 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-90ba3dec-1a86-4b9b-8c1a-da6541198561 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:51:58.751023 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-90ba3dec-1a86-4b9b-8c1a-da6541198561 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1698 microversion: 2.1 time: 0.177865 Oct 11 00:51:58.752020 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4276/7898] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:51:58 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1698 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:51:59.782488 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6f9b067e-bbd4-41ff-b68d-68a8baba33e0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:51:59.783395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6f9b067e-bbd4-41ff-b68d-68a8baba33e0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:51:59.795329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f9b067e-bbd4-41ff-b68d-68a8baba33e0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:59.796212 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f9b067e-bbd4-41ff-b68d-68a8baba33e0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:59.796959 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f9b067e-bbd4-41ff-b68d-68a8baba33e0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:59.797937 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f9b067e-bbd4-41ff-b68d-68a8baba33e0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:51:59.798502 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f9b067e-bbd4-41ff-b68d-68a8baba33e0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:51:59.799047 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6f9b067e-bbd4-41ff-b68d-68a8baba33e0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:51:59.963684 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6f9b067e-bbd4-41ff-b68d-68a8baba33e0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:51:59.972316 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6f9b067e-bbd4-41ff-b68d-68a8baba33e0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1698 microversion: 2.1 time: 0.193744 Oct 11 00:51:59.972912 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3623/7899] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:51:59 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1698 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:00.996660 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-764f2ec3-76e8-4432-bf82-3e321ecaccf6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:00.997291 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-764f2ec3-76e8-4432-bf82-3e321ecaccf6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:01.006776 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-764f2ec3-76e8-4432-bf82-3e321ecaccf6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:01.007368 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-764f2ec3-76e8-4432-bf82-3e321ecaccf6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:01.008077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-764f2ec3-76e8-4432-bf82-3e321ecaccf6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:01.008904 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-764f2ec3-76e8-4432-bf82-3e321ecaccf6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:01.010070 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-764f2ec3-76e8-4432-bf82-3e321ecaccf6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:01.010780 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-764f2ec3-76e8-4432-bf82-3e321ecaccf6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:01.176374 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-764f2ec3-76e8-4432-bf82-3e321ecaccf6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:01.188448 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-764f2ec3-76e8-4432-bf82-3e321ecaccf6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1698 microversion: 2.1 time: 0.196101 Oct 11 00:52:01.189091 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4277/7900] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:00 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1698 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:02.212922 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-18dcc69c-b7e6-4c13-8503-bdffa194790b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:02.213824 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-18dcc69c-b7e6-4c13-8503-bdffa194790b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:02.223787 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-18dcc69c-b7e6-4c13-8503-bdffa194790b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:02.224293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-18dcc69c-b7e6-4c13-8503-bdffa194790b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:02.224746 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-18dcc69c-b7e6-4c13-8503-bdffa194790b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:02.225470 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-18dcc69c-b7e6-4c13-8503-bdffa194790b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:02.225932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-18dcc69c-b7e6-4c13-8503-bdffa194790b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:02.226362 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-18dcc69c-b7e6-4c13-8503-bdffa194790b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:02.382860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-18dcc69c-b7e6-4c13-8503-bdffa194790b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:02.392079 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-18dcc69c-b7e6-4c13-8503-bdffa194790b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1698 microversion: 2.1 time: 0.183607 Oct 11 00:52:02.392666 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3624/7901] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:02 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1698 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:03.418936 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a761df03-a094-4a66-bd5f-e87bdcbaf7fe tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:03.419582 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a761df03-a094-4a66-bd5f-e87bdcbaf7fe tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:03.429322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a761df03-a094-4a66-bd5f-e87bdcbaf7fe tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:03.430161 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a761df03-a094-4a66-bd5f-e87bdcbaf7fe tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:03.430644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a761df03-a094-4a66-bd5f-e87bdcbaf7fe tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:03.431686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a761df03-a094-4a66-bd5f-e87bdcbaf7fe tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:03.432909 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a761df03-a094-4a66-bd5f-e87bdcbaf7fe tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:03.433510 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a761df03-a094-4a66-bd5f-e87bdcbaf7fe tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:03.587042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a761df03-a094-4a66-bd5f-e87bdcbaf7fe tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:03.597011 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a761df03-a094-4a66-bd5f-e87bdcbaf7fe tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1698 microversion: 2.1 time: 0.182037 Oct 11 00:52:03.597625 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4278/7902] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:03 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1698 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:04.620758 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fa1f2e78-2649-414a-b54f-5101c1254845 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:04.621391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fa1f2e78-2649-414a-b54f-5101c1254845 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:04.628187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa1f2e78-2649-414a-b54f-5101c1254845 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:04.628745 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa1f2e78-2649-414a-b54f-5101c1254845 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:04.629192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa1f2e78-2649-414a-b54f-5101c1254845 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:04.629923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa1f2e78-2649-414a-b54f-5101c1254845 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:04.630383 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa1f2e78-2649-414a-b54f-5101c1254845 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:04.630815 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fa1f2e78-2649-414a-b54f-5101c1254845 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:04.761832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fa1f2e78-2649-414a-b54f-5101c1254845 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:04.769603 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fa1f2e78-2649-414a-b54f-5101c1254845 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1698 microversion: 2.1 time: 0.153260 Oct 11 00:52:04.770181 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3625/7903] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:04 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1698 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:05.792783 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5bd01e57-056f-44f5-adc2-9c68d1e42218 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:05.793475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5bd01e57-056f-44f5-adc2-9c68d1e42218 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:05.800670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bd01e57-056f-44f5-adc2-9c68d1e42218 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:05.801177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bd01e57-056f-44f5-adc2-9c68d1e42218 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:05.801656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bd01e57-056f-44f5-adc2-9c68d1e42218 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:05.802411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bd01e57-056f-44f5-adc2-9c68d1e42218 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:05.802886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bd01e57-056f-44f5-adc2-9c68d1e42218 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:05.803331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5bd01e57-056f-44f5-adc2-9c68d1e42218 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:05.949614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5bd01e57-056f-44f5-adc2-9c68d1e42218 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:05.958865 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5bd01e57-056f-44f5-adc2-9c68d1e42218 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1680 microversion: 2.1 time: 0.169989 Oct 11 00:52:05.959479 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4279/7904] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:05 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:06.984109 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dc5b4038-4177-4a8b-8631-5c5f946e05e0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:06.984716 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dc5b4038-4177-4a8b-8631-5c5f946e05e0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:06.991637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc5b4038-4177-4a8b-8631-5c5f946e05e0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:06.992132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc5b4038-4177-4a8b-8631-5c5f946e05e0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:06.992573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc5b4038-4177-4a8b-8631-5c5f946e05e0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:06.993318 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc5b4038-4177-4a8b-8631-5c5f946e05e0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:06.993907 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc5b4038-4177-4a8b-8631-5c5f946e05e0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:06.994344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc5b4038-4177-4a8b-8631-5c5f946e05e0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:07.126866 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dc5b4038-4177-4a8b-8631-5c5f946e05e0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:07.135198 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dc5b4038-4177-4a8b-8631-5c5f946e05e0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1680 microversion: 2.1 time: 0.155050 Oct 11 00:52:07.135780 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3626/7905] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:06 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:08.158773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-61ef2b13-8d87-4846-b1d8-cd0bb91a82de tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:08.159405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-61ef2b13-8d87-4846-b1d8-cd0bb91a82de tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:08.162239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=29 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:52:08.168307 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61ef2b13-8d87-4846-b1d8-cd0bb91a82de tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:08.168809 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61ef2b13-8d87-4846-b1d8-cd0bb91a82de tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:08.169265 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61ef2b13-8d87-4846-b1d8-cd0bb91a82de tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:08.170001 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61ef2b13-8d87-4846-b1d8-cd0bb91a82de tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:08.170475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61ef2b13-8d87-4846-b1d8-cd0bb91a82de tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:08.170912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-61ef2b13-8d87-4846-b1d8-cd0bb91a82de tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:08.173522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:52:08.308652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-61ef2b13-8d87-4846-b1d8-cd0bb91a82de tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:08.316918 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-61ef2b13-8d87-4846-b1d8-cd0bb91a82de tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1623 microversion: 2.1 time: 0.162050 Oct 11 00:52:08.317542 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4280/7906] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:08 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1623 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:08.340466 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e56389b1-8aeb-4615-a2b4-370cc28b9919 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:52:08.341072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e56389b1-8aeb-4615-a2b4-370cc28b9919 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:08.343809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=29 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:52:08.349135 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e56389b1-8aeb-4615-a2b4-370cc28b9919 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:08.349651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e56389b1-8aeb-4615-a2b4-370cc28b9919 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:08.350088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e56389b1-8aeb-4615-a2b4-370cc28b9919 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:08.350780 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e56389b1-8aeb-4615-a2b4-370cc28b9919 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:08.351236 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e56389b1-8aeb-4615-a2b4-370cc28b9919 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:08.351666 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e56389b1-8aeb-4615-a2b4-370cc28b9919 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:08.354868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=85 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:52:08.393702 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e56389b1-8aeb-4615-a2b4-370cc28b9919 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120614) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 00:52:08.465911 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e56389b1-8aeb-4615-a2b4-370cc28b9919 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "POST /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da/action" status: 202 len: 0 microversion: 2.1 time: 0.129985 Oct 11 00:52:08.466543 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3627/7907] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:52:08 2022] POST /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:52:08.474767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dbb59434-6445-4383-bd6c-bb4bc9969e56 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:08.475295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dbb59434-6445-4383-bd6c-bb4bc9969e56 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:08.482667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbb59434-6445-4383-bd6c-bb4bc9969e56 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:08.483278 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbb59434-6445-4383-bd6c-bb4bc9969e56 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:08.483652 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbb59434-6445-4383-bd6c-bb4bc9969e56 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:08.484362 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbb59434-6445-4383-bd6c-bb4bc9969e56 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:08.484833 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbb59434-6445-4383-bd6c-bb4bc9969e56 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:08.485276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbb59434-6445-4383-bd6c-bb4bc9969e56 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:08.526355 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-cdefd02d-5d6a-49f6-ae63-fb88213f7a98 req-3bd09fd9-9e23-4e20-b5ba-9ac3bd0f919f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "266c1087-a8ea-4f20-a438-9cae049be7da", "name": "network-vif-unplugged", "status": "completed", "tag": "fe59bf96-88a9-4ca1-b6bf-8726519358ff"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:52:08.539723 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-cdefd02d-5d6a-49f6-ae63-fb88213f7a98 req-3bd09fd9-9e23-4e20-b5ba-9ac3bd0f919f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:08.540989 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-cdefd02d-5d6a-49f6-ae63-fb88213f7a98 req-3bd09fd9-9e23-4e20-b5ba-9ac3bd0f919f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:08.544900 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-cdefd02d-5d6a-49f6-ae63-fb88213f7a98 req-3bd09fd9-9e23-4e20-b5ba-9ac3bd0f919f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:08.568328 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.compute.server_external_events [req-cdefd02d-5d6a-49f6-ae63-fb88213f7a98 req-3bd09fd9-9e23-4e20-b5ba-9ac3bd0f919f service nova] Unable to find a host for instance 266c1087-a8ea-4f20-a438-9cae049be7da. Dropping event network-vif-unplugged {{(pid=120614) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 00:52:08.568812 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-cdefd02d-5d6a-49f6-ae63-fb88213f7a98 req-3bd09fd9-9e23-4e20-b5ba-9ac3bd0f919f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.047234 Oct 11 00:52:08.569904 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3628/7908] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 49 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 11 00:52:08.643821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dbb59434-6445-4383-bd6c-bb4bc9969e56 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:08.652695 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dbb59434-6445-4383-bd6c-bb4bc9969e56 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1631 microversion: 2.1 time: 0.181891 Oct 11 00:52:08.653300 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4281/7909] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:08 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1631 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:09.677680 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-279cb86a-e902-4cba-a4de-0dc29159149d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:09.678292 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-279cb86a-e902-4cba-a4de-0dc29159149d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:09.684570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-279cb86a-e902-4cba-a4de-0dc29159149d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:09.685051 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-279cb86a-e902-4cba-a4de-0dc29159149d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:09.686102 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-279cb86a-e902-4cba-a4de-0dc29159149d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:09.687056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-279cb86a-e902-4cba-a4de-0dc29159149d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:09.687509 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-279cb86a-e902-4cba-a4de-0dc29159149d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:09.687928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-279cb86a-e902-4cba-a4de-0dc29159149d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:09.825210 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-279cb86a-e902-4cba-a4de-0dc29159149d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:09.833583 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-279cb86a-e902-4cba-a4de-0dc29159149d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1689 microversion: 2.1 time: 0.160069 Oct 11 00:52:09.834173 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3629/7910] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:09 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:10.857648 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d5730866-de50-4a8c-8e27-30badcf29a3f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:10.858387 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d5730866-de50-4a8c-8e27-30badcf29a3f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:10.865257 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5730866-de50-4a8c-8e27-30badcf29a3f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:10.865882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5730866-de50-4a8c-8e27-30badcf29a3f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:10.867037 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5730866-de50-4a8c-8e27-30badcf29a3f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:10.867840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5730866-de50-4a8c-8e27-30badcf29a3f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:10.868929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5730866-de50-4a8c-8e27-30badcf29a3f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:10.869675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d5730866-de50-4a8c-8e27-30badcf29a3f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:11.014887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d5730866-de50-4a8c-8e27-30badcf29a3f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:11.023272 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d5730866-de50-4a8c-8e27-30badcf29a3f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1689 microversion: 2.1 time: 0.169502 Oct 11 00:52:11.023859 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4282/7911] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:10 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:12.048093 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a5f204b2-55ec-4166-9068-c87b7a388180 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:12.048708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a5f204b2-55ec-4166-9068-c87b7a388180 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:12.056493 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5f204b2-55ec-4166-9068-c87b7a388180 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:12.056997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5f204b2-55ec-4166-9068-c87b7a388180 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:12.057470 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5f204b2-55ec-4166-9068-c87b7a388180 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:12.058188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5f204b2-55ec-4166-9068-c87b7a388180 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:12.058647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5f204b2-55ec-4166-9068-c87b7a388180 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:12.059073 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a5f204b2-55ec-4166-9068-c87b7a388180 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:12.206280 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a5f204b2-55ec-4166-9068-c87b7a388180 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:12.215390 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a5f204b2-55ec-4166-9068-c87b7a388180 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1689 microversion: 2.1 time: 0.171101 Oct 11 00:52:12.216241 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3630/7912] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:12 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:13.239320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-189b1b62-fdc3-4da7-bda7-3965cc0b6aa0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:13.240075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-189b1b62-fdc3-4da7-bda7-3965cc0b6aa0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:13.249233 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-189b1b62-fdc3-4da7-bda7-3965cc0b6aa0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:13.249894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-189b1b62-fdc3-4da7-bda7-3965cc0b6aa0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:13.250399 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-189b1b62-fdc3-4da7-bda7-3965cc0b6aa0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:13.251142 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-189b1b62-fdc3-4da7-bda7-3965cc0b6aa0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:13.251619 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-189b1b62-fdc3-4da7-bda7-3965cc0b6aa0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:13.252094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-189b1b62-fdc3-4da7-bda7-3965cc0b6aa0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:13.406268 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-189b1b62-fdc3-4da7-bda7-3965cc0b6aa0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:13.416508 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-189b1b62-fdc3-4da7-bda7-3965cc0b6aa0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1689 microversion: 2.1 time: 0.180920 Oct 11 00:52:13.417362 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4283/7913] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:13 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:14.445042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cceecdd5-b6bc-4c4e-8770-c4b9c056f90d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:14.445697 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cceecdd5-b6bc-4c4e-8770-c4b9c056f90d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:14.453622 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cceecdd5-b6bc-4c4e-8770-c4b9c056f90d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:14.454116 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cceecdd5-b6bc-4c4e-8770-c4b9c056f90d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:14.454553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cceecdd5-b6bc-4c4e-8770-c4b9c056f90d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:14.455260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cceecdd5-b6bc-4c4e-8770-c4b9c056f90d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:14.455726 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cceecdd5-b6bc-4c4e-8770-c4b9c056f90d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:14.456148 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cceecdd5-b6bc-4c4e-8770-c4b9c056f90d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:14.604064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cceecdd5-b6bc-4c4e-8770-c4b9c056f90d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:14.612381 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cceecdd5-b6bc-4c4e-8770-c4b9c056f90d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1689 microversion: 2.1 time: 0.171141 Oct 11 00:52:14.612975 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3631/7914] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:14 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:15.637655 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-67ea07b5-095a-4e4f-8b01-57b89ea1d6e3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:15.638313 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-67ea07b5-095a-4e4f-8b01-57b89ea1d6e3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:15.654041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67ea07b5-095a-4e4f-8b01-57b89ea1d6e3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:15.654041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67ea07b5-095a-4e4f-8b01-57b89ea1d6e3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:15.654041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67ea07b5-095a-4e4f-8b01-57b89ea1d6e3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:15.654041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67ea07b5-095a-4e4f-8b01-57b89ea1d6e3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:15.654041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67ea07b5-095a-4e4f-8b01-57b89ea1d6e3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:15.654041 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-67ea07b5-095a-4e4f-8b01-57b89ea1d6e3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:15.800658 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-67ea07b5-095a-4e4f-8b01-57b89ea1d6e3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:15.818614 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-67ea07b5-095a-4e4f-8b01-57b89ea1d6e3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1689 microversion: 2.1 time: 0.177275 Oct 11 00:52:15.819549 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4284/7915] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:15 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1689 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:16.843006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ccecc9dc-763d-4415-9467-8f2794aaa8eb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:16.843605 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ccecc9dc-763d-4415-9467-8f2794aaa8eb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:16.851431 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccecc9dc-763d-4415-9467-8f2794aaa8eb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:16.851933 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccecc9dc-763d-4415-9467-8f2794aaa8eb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:16.852374 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccecc9dc-763d-4415-9467-8f2794aaa8eb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:16.853095 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccecc9dc-763d-4415-9467-8f2794aaa8eb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:16.854165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccecc9dc-763d-4415-9467-8f2794aaa8eb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:16.854869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ccecc9dc-763d-4415-9467-8f2794aaa8eb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:17.022757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ccecc9dc-763d-4415-9467-8f2794aaa8eb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:17.033272 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ccecc9dc-763d-4415-9467-8f2794aaa8eb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1689 microversion: 2.1 time: 0.193861 Oct 11 00:52:17.034294 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3632/7916] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:16 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1689 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:52:18.059570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3a44b1d5-2c3b-4d05-b008-615262a7536f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:18.060183 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3a44b1d5-2c3b-4d05-b008-615262a7536f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:18.067377 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a44b1d5-2c3b-4d05-b008-615262a7536f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:18.067924 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a44b1d5-2c3b-4d05-b008-615262a7536f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:18.068320 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a44b1d5-2c3b-4d05-b008-615262a7536f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:18.069025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a44b1d5-2c3b-4d05-b008-615262a7536f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:18.069512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a44b1d5-2c3b-4d05-b008-615262a7536f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:18.069950 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3a44b1d5-2c3b-4d05-b008-615262a7536f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:18.202255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3a44b1d5-2c3b-4d05-b008-615262a7536f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:18.209994 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3a44b1d5-2c3b-4d05-b008-615262a7536f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1689 microversion: 2.1 time: 0.155366 Oct 11 00:52:18.210573 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4285/7917] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:18 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:52:19.234966 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-54a75a3e-b798-4c31-a4e1-78263ba644ed tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:19.235617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-54a75a3e-b798-4c31-a4e1-78263ba644ed tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:19.242498 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54a75a3e-b798-4c31-a4e1-78263ba644ed tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:19.242983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54a75a3e-b798-4c31-a4e1-78263ba644ed tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:19.243418 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54a75a3e-b798-4c31-a4e1-78263ba644ed tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:19.244106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54a75a3e-b798-4c31-a4e1-78263ba644ed tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:19.245347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54a75a3e-b798-4c31-a4e1-78263ba644ed tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:19.245921 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-54a75a3e-b798-4c31-a4e1-78263ba644ed tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:19.379307 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-54a75a3e-b798-4c31-a4e1-78263ba644ed tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:19.387302 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-54a75a3e-b798-4c31-a4e1-78263ba644ed tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1689 microversion: 2.1 time: 0.156209 Oct 11 00:52:19.387883 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3633/7918] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:19 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:20.411373 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8a67cc5e-60cd-4475-8f49-85a6175ad6e6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:20.412005 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8a67cc5e-60cd-4475-8f49-85a6175ad6e6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:20.420124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a67cc5e-60cd-4475-8f49-85a6175ad6e6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:20.420632 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a67cc5e-60cd-4475-8f49-85a6175ad6e6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:20.421081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a67cc5e-60cd-4475-8f49-85a6175ad6e6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:20.421822 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a67cc5e-60cd-4475-8f49-85a6175ad6e6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:20.422289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a67cc5e-60cd-4475-8f49-85a6175ad6e6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:20.422724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8a67cc5e-60cd-4475-8f49-85a6175ad6e6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:20.557591 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8a67cc5e-60cd-4475-8f49-85a6175ad6e6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:20.565808 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8a67cc5e-60cd-4475-8f49-85a6175ad6e6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1689 microversion: 2.1 time: 0.158782 Oct 11 00:52:20.566382 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4286/7919] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:20 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:21.589888 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7a4e67b9-ee09-4928-a1e2-eea5093f40c7 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:21.590531 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7a4e67b9-ee09-4928-a1e2-eea5093f40c7 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:21.597579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a4e67b9-ee09-4928-a1e2-eea5093f40c7 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:21.598064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a4e67b9-ee09-4928-a1e2-eea5093f40c7 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:21.598499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a4e67b9-ee09-4928-a1e2-eea5093f40c7 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:21.599200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a4e67b9-ee09-4928-a1e2-eea5093f40c7 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:21.599651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a4e67b9-ee09-4928-a1e2-eea5093f40c7 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:21.600064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7a4e67b9-ee09-4928-a1e2-eea5093f40c7 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:21.744141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7a4e67b9-ee09-4928-a1e2-eea5093f40c7 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:21.752890 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7a4e67b9-ee09-4928-a1e2-eea5093f40c7 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1689 microversion: 2.1 time: 0.167010 Oct 11 00:52:21.753509 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3634/7920] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:21 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:22.776521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6fc5ffe0-4e5e-4f90-9b67-e39bc614c236 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:22.777093 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6fc5ffe0-4e5e-4f90-9b67-e39bc614c236 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:22.783879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fc5ffe0-4e5e-4f90-9b67-e39bc614c236 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:22.784382 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fc5ffe0-4e5e-4f90-9b67-e39bc614c236 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:22.784838 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fc5ffe0-4e5e-4f90-9b67-e39bc614c236 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:22.785595 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fc5ffe0-4e5e-4f90-9b67-e39bc614c236 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:22.786100 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fc5ffe0-4e5e-4f90-9b67-e39bc614c236 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:22.786546 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6fc5ffe0-4e5e-4f90-9b67-e39bc614c236 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:22.921271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6fc5ffe0-4e5e-4f90-9b67-e39bc614c236 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:22.928957 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6fc5ffe0-4e5e-4f90-9b67-e39bc614c236 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1689 microversion: 2.1 time: 0.156774 Oct 11 00:52:22.929567 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4287/7921] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:22 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:23.954323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d62aa8b7-9284-4420-baf4-7b767940ff62 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:23.954940 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d62aa8b7-9284-4420-baf4-7b767940ff62 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:23.961902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d62aa8b7-9284-4420-baf4-7b767940ff62 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:23.962391 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d62aa8b7-9284-4420-baf4-7b767940ff62 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:23.962885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d62aa8b7-9284-4420-baf4-7b767940ff62 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:23.964232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d62aa8b7-9284-4420-baf4-7b767940ff62 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:23.964740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d62aa8b7-9284-4420-baf4-7b767940ff62 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:23.965165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d62aa8b7-9284-4420-baf4-7b767940ff62 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:24.102975 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d62aa8b7-9284-4420-baf4-7b767940ff62 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:24.111275 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d62aa8b7-9284-4420-baf4-7b767940ff62 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1689 microversion: 2.1 time: 0.160897 Oct 11 00:52:24.111871 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3635/7922] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:23 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:25.137475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-50406840-3459-4336-aaf8-7dd2c550b99c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:25.138109 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-50406840-3459-4336-aaf8-7dd2c550b99c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:25.145361 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50406840-3459-4336-aaf8-7dd2c550b99c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:25.145900 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50406840-3459-4336-aaf8-7dd2c550b99c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:25.146369 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50406840-3459-4336-aaf8-7dd2c550b99c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:25.147091 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50406840-3459-4336-aaf8-7dd2c550b99c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:25.147565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50406840-3459-4336-aaf8-7dd2c550b99c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:25.148011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-50406840-3459-4336-aaf8-7dd2c550b99c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:25.301206 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-50406840-3459-4336-aaf8-7dd2c550b99c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:25.310159 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-50406840-3459-4336-aaf8-7dd2c550b99c tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1689 microversion: 2.1 time: 0.177695 Oct 11 00:52:25.310772 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4288/7923] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:25 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:52:26.335734 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6bada293-ddf7-48c0-91d2-224f95189e01 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:26.336347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6bada293-ddf7-48c0-91d2-224f95189e01 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:26.343773 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6bada293-ddf7-48c0-91d2-224f95189e01 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:26.344259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6bada293-ddf7-48c0-91d2-224f95189e01 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:26.344692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6bada293-ddf7-48c0-91d2-224f95189e01 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:26.345401 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6bada293-ddf7-48c0-91d2-224f95189e01 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:26.345861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6bada293-ddf7-48c0-91d2-224f95189e01 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:26.346283 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6bada293-ddf7-48c0-91d2-224f95189e01 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:26.484728 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6bada293-ddf7-48c0-91d2-224f95189e01 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:26.492632 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6bada293-ddf7-48c0-91d2-224f95189e01 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1689 microversion: 2.1 time: 0.160816 Oct 11 00:52:26.493216 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3636/7924] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:26 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:27.517273 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-72cb2ff0-455b-4d30-a743-4792e2b4e9c6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:27.517928 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-72cb2ff0-455b-4d30-a743-4792e2b4e9c6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:27.524760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72cb2ff0-455b-4d30-a743-4792e2b4e9c6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:27.525821 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72cb2ff0-455b-4d30-a743-4792e2b4e9c6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:27.526290 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72cb2ff0-455b-4d30-a743-4792e2b4e9c6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:27.526999 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72cb2ff0-455b-4d30-a743-4792e2b4e9c6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:27.527554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72cb2ff0-455b-4d30-a743-4792e2b4e9c6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:27.527997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-72cb2ff0-455b-4d30-a743-4792e2b4e9c6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:27.663755 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-72cb2ff0-455b-4d30-a743-4792e2b4e9c6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:27.672548 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-72cb2ff0-455b-4d30-a743-4792e2b4e9c6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1689 microversion: 2.1 time: 0.159254 Oct 11 00:52:27.673136 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4289/7925] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:27 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:28.637998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-d209d0d3-b241-4660-950e-0e368fd46a32 req-d74fba91-d414-4e41-83e6-a387649615bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "266c1087-a8ea-4f20-a438-9cae049be7da", "name": "network-vif-plugged", "status": "completed", "tag": "fe59bf96-88a9-4ca1-b6bf-8726519358ff"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:52:28.648560 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d209d0d3-b241-4660-950e-0e368fd46a32 req-d74fba91-d414-4e41-83e6-a387649615bc service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:28.649049 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d209d0d3-b241-4660-950e-0e368fd46a32 req-d74fba91-d414-4e41-83e6-a387649615bc service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:28.649512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-d209d0d3-b241-4660-950e-0e368fd46a32 req-d74fba91-d414-4e41-83e6-a387649615bc service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:28.661009 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-d209d0d3-b241-4660-950e-0e368fd46a32 req-d74fba91-d414-4e41-83e6-a387649615bc service nova] Creating event network-vif-plugged:fe59bf96-88a9-4ca1-b6bf-8726519358ff for instance 266c1087-a8ea-4f20-a438-9cae049be7da on n-h1-860864-2 Oct 11 00:52:28.667781 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-d209d0d3-b241-4660-950e-0e368fd46a32 req-d74fba91-d414-4e41-83e6-a387649615bc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034378 Oct 11 00:52:28.668401 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3637/7926] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:52:28.696477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dd09344a-74f5-43dd-9cb9-92b1201ab65f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:28.698303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dd09344a-74f5-43dd-9cb9-92b1201ab65f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:28.705969 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd09344a-74f5-43dd-9cb9-92b1201ab65f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:28.706484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd09344a-74f5-43dd-9cb9-92b1201ab65f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:28.707336 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd09344a-74f5-43dd-9cb9-92b1201ab65f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:28.707656 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd09344a-74f5-43dd-9cb9-92b1201ab65f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:28.708128 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd09344a-74f5-43dd-9cb9-92b1201ab65f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:28.708571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd09344a-74f5-43dd-9cb9-92b1201ab65f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:28.854418 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dd09344a-74f5-43dd-9cb9-92b1201ab65f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:28.862464 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dd09344a-74f5-43dd-9cb9-92b1201ab65f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1689 microversion: 2.1 time: 0.170186 Oct 11 00:52:28.863248 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4290/7927] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:28 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:29.889186 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ffe8dbad-f9cf-4e02-bcd3-4a4b61de78f1 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:29.889919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ffe8dbad-f9cf-4e02-bcd3-4a4b61de78f1 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:29.896085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffe8dbad-f9cf-4e02-bcd3-4a4b61de78f1 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:29.896569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffe8dbad-f9cf-4e02-bcd3-4a4b61de78f1 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:29.897008 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffe8dbad-f9cf-4e02-bcd3-4a4b61de78f1 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:29.897727 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffe8dbad-f9cf-4e02-bcd3-4a4b61de78f1 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:29.898183 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffe8dbad-f9cf-4e02-bcd3-4a4b61de78f1 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:29.898608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ffe8dbad-f9cf-4e02-bcd3-4a4b61de78f1 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:30.040260 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ffe8dbad-f9cf-4e02-bcd3-4a4b61de78f1 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:30.048805 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ffe8dbad-f9cf-4e02-bcd3-4a4b61de78f1 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1689 microversion: 2.1 time: 0.165447 Oct 11 00:52:30.049396 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3638/7928] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:29 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:52:31.073984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-d72b190c-27e5-4812-b76c-75e76204af13 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:52:31.074529 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-d72b190c-27e5-4812-b76c-75e76204af13 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:52:31.081522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d72b190c-27e5-4812-b76c-75e76204af13 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:31.082023 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d72b190c-27e5-4812-b76c-75e76204af13 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:31.082475 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d72b190c-27e5-4812-b76c-75e76204af13 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:31.083184 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d72b190c-27e5-4812-b76c-75e76204af13 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:52:31.083657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d72b190c-27e5-4812-b76c-75e76204af13 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:52:31.084095 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-d72b190c-27e5-4812-b76c-75e76204af13 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:52:31.219174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-d72b190c-27e5-4812-b76c-75e76204af13 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:52:31.227063 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-d72b190c-27e5-4812-b76c-75e76204af13 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1676 microversion: 2.1 time: 0.157706 Oct 11 00:52:31.227643 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4291/7929] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:52:31 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:54:16.831856 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:54:16.833258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:54:16.836986 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=23 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:54:16.838149 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=71 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:54:16.838941 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:54:16.839091 n-d-860864-2 devstack@n-api.service[120613]: Tue Oct 11 00:54:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 11 00:54:16.840014 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-da55b5ea-904f-499d-8008-07dad2c08b73 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:54:16.840590 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-da55b5ea-904f-499d-8008-07dad2c08b73 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:54:16.852238 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da55b5ea-904f-499d-8008-07dad2c08b73 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:16.853250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da55b5ea-904f-499d-8008-07dad2c08b73 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:16.853797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da55b5ea-904f-499d-8008-07dad2c08b73 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:16.854737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da55b5ea-904f-499d-8008-07dad2c08b73 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:16.855919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da55b5ea-904f-499d-8008-07dad2c08b73 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:16.856573 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-da55b5ea-904f-499d-8008-07dad2c08b73 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:16.888446 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-da55b5ea-904f-499d-8008-07dad2c08b73 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:54:16.916264 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-3efeb974-acce-42ce-bd0f-8de823c954de req-d360cf7c-8e85-4515-a062-0c48570c2c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "266c1087-a8ea-4f20-a438-9cae049be7da", "tag": "fe59bf96-88a9-4ca1-b6bf-8726519358ff"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:54:16.934667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3efeb974-acce-42ce-bd0f-8de823c954de req-d360cf7c-8e85-4515-a062-0c48570c2c82 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:16.935411 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3efeb974-acce-42ce-bd0f-8de823c954de req-d360cf7c-8e85-4515-a062-0c48570c2c82 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:16.936146 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-3efeb974-acce-42ce-bd0f-8de823c954de req-d360cf7c-8e85-4515-a062-0c48570c2c82 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:16.956040 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-3efeb974-acce-42ce-bd0f-8de823c954de req-d360cf7c-8e85-4515-a062-0c48570c2c82 service nova] Creating event network-changed:fe59bf96-88a9-4ca1-b6bf-8726519358ff for instance 266c1087-a8ea-4f20-a438-9cae049be7da on n-h1-860864-2 Oct 11 00:54:16.964119 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-3efeb974-acce-42ce-bd0f-8de823c954de req-d360cf7c-8e85-4515-a062-0c48570c2c82 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134533 Oct 11 00:54:16.965637 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4292/7930] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 00:54:16.999883 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-da55b5ea-904f-499d-8008-07dad2c08b73 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "DELETE /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 204 len: 0 microversion: 2.1 time: 0.171929 Oct 11 00:54:17.003808 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3639/7931] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:54:16 2022] DELETE /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:54:17.010576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-647a71d8-616b-4121-bf90-8f68221572ee tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:54:17.011323 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-647a71d8-616b-4121-bf90-8f68221572ee tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:54:17.018144 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-647a71d8-616b-4121-bf90-8f68221572ee tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:17.018669 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-647a71d8-616b-4121-bf90-8f68221572ee tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:17.019135 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-647a71d8-616b-4121-bf90-8f68221572ee tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:17.020039 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-647a71d8-616b-4121-bf90-8f68221572ee tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:17.020525 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-647a71d8-616b-4121-bf90-8f68221572ee tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:17.020984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-647a71d8-616b-4121-bf90-8f68221572ee tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:17.167168 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-647a71d8-616b-4121-bf90-8f68221572ee tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:54:17.175288 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-647a71d8-616b-4121-bf90-8f68221572ee tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1682 microversion: 2.1 time: 0.169536 Oct 11 00:54:17.175890 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4293/7932] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:54:17 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:54:18.199871 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-108d9d82-8765-48f2-bf17-55bf6fcc67e8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:54:18.200576 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-108d9d82-8765-48f2-bf17-55bf6fcc67e8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:54:18.207662 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-108d9d82-8765-48f2-bf17-55bf6fcc67e8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:18.208154 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-108d9d82-8765-48f2-bf17-55bf6fcc67e8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:18.208585 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-108d9d82-8765-48f2-bf17-55bf6fcc67e8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:18.209284 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-108d9d82-8765-48f2-bf17-55bf6fcc67e8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:18.209757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-108d9d82-8765-48f2-bf17-55bf6fcc67e8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:18.210180 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-108d9d82-8765-48f2-bf17-55bf6fcc67e8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:18.405312 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-108d9d82-8765-48f2-bf17-55bf6fcc67e8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:54:18.414402 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-108d9d82-8765-48f2-bf17-55bf6fcc67e8 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 200 len: 1682 microversion: 2.1 time: 0.218728 Oct 11 00:54:18.415063 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3640/7933] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:54:18 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:54:18.980847 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-5a293451-894e-4de6-969d-ca1f716d263f req-6883f8a1-f95d-4b4d-ac6d-db390468d5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "266c1087-a8ea-4f20-a438-9cae049be7da", "name": "network-vif-deleted", "tag": "fe59bf96-88a9-4ca1-b6bf-8726519358ff"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:54:18.994931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5a293451-894e-4de6-969d-ca1f716d263f req-6883f8a1-f95d-4b4d-ac6d-db390468d5e6 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:18.995439 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5a293451-894e-4de6-969d-ca1f716d263f req-6883f8a1-f95d-4b4d-ac6d-db390468d5e6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:18.995892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-5a293451-894e-4de6-969d-ca1f716d263f req-6883f8a1-f95d-4b4d-ac6d-db390468d5e6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:19.011003 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-5a293451-894e-4de6-969d-ca1f716d263f req-6883f8a1-f95d-4b4d-ac6d-db390468d5e6 service nova] Creating event network-vif-deleted:fe59bf96-88a9-4ca1-b6bf-8726519358ff for instance 266c1087-a8ea-4f20-a438-9cae049be7da on n-h1-860864-2 Oct 11 00:54:19.017494 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-5a293451-894e-4de6-969d-ca1f716d263f req-6883f8a1-f95d-4b4d-ac6d-db390468d5e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040157 Oct 11 00:54:19.018441 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4294/7934] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:54:19.439088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-68006106-4df7-48ca-8c88-00fa2cf69e74 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:54:19.439739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-68006106-4df7-48ca-8c88-00fa2cf69e74 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: 266c1087-a8ea-4f20-a438-9cae049be7da] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:54:19.446778 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68006106-4df7-48ca-8c88-00fa2cf69e74 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:19.447274 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68006106-4df7-48ca-8c88-00fa2cf69e74 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:19.447740 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68006106-4df7-48ca-8c88-00fa2cf69e74 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:19.448450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68006106-4df7-48ca-8c88-00fa2cf69e74 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:19.448912 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68006106-4df7-48ca-8c88-00fa2cf69e74 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:19.449595 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-68006106-4df7-48ca-8c88-00fa2cf69e74 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:19.467820 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-68006106-4df7-48ca-8c88-00fa2cf69e74 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] HTTP exception thrown: Instance 266c1087-a8ea-4f20-a438-9cae049be7da could not be found. Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-68006106-4df7-48ca-8c88-00fa2cf69e74 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Request method failure captured: Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da HTTP/1.1 Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRL1mB-7u78IRhfxFgoxQJdekZzN6NrapHC0GuxU1tNmmGFTc3gqMcqMIdRft7jlWzEWeo6xluHWAdusfl1KB6euFX2Olq5ue9njzkc_LM3uLqzp2YC5rPJ96CMXHRxF10fIdm4qqZuAfjNPR_naixT23Tfeb6b0XQIwgIt-g9PPsOSc Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 07c56bef58d3426b8b9f10433063ec54 Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TestShelveInstance-1719244884 Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/07c56bef58d3426b8b9f10433063ec54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/07c56bef58d3426b8b9f10433063ec54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/07c56bef58d3426b8b9f10433063ec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_07c56bef58d3426b8b9f10433063ec54", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TestShelveInstance-1719244884 Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 07c56bef58d3426b8b9f10433063ec54 Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestShelveInstance-1719244884 Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TestShelveInstance-1719244884-project Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: 719d0446d98f43fba827fd2731b49a45 Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TestShelveInstance-1719244884-project Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 266c1087-a8ea-4f20-a438-9cae049be7da could not be found. Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '266c1087-a8ea-4f20-a438-9cae049be7da'} Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 266c1087-a8ea-4f20-a438-9cae049be7da could not be found. Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 266c1087-a8ea-4f20-a438-9cae049be7da could not be found. Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:54:19.469570 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:54:19.475282 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:54:19.475282 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:54:19.475282 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:54:19.475282 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:54:19.475282 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:54:19.475282 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 266c1087-a8ea-4f20-a438-9cae049be7da could not be found. Oct 11 00:54:19.475282 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 00:54:19.475282 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-68006106-4df7-48ca-8c88-00fa2cf69e74 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Returning 404 to user: Instance 266c1087-a8ea-4f20-a438-9cae049be7da could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:54:19.475282 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-68006106-4df7-48ca-8c88-00fa2cf69e74 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da" status: 404 len: 111 microversion: 2.1 time: 0.036861 Oct 11 00:54:19.475282 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3641/7935] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:54:19 2022] GET /compute/v2.1/servers/266c1087-a8ea-4f20-a438-9cae049be7da => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 00:54:19.635489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-370ff767-34f7-4e41-b3f8-121f1df92a78 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '.version_select at 0x7f662ac16ee0>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:54:19.661228 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-370ff767-34f7-4e41-b3f8-121f1df92a78 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1814195076" status: 202 len: 0 microversion: 2.1 time: 0.030080 Oct 11 00:54:19.661895 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4295/7936] 10.222.0.23 () {58 vars in 1254 bytes} [Tue Oct 11 00:54:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1814195076 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:54:19.686673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b2588877-c439-4532-9841-2fd7cf9b99f0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Action: 'create', calling method: .version_select at 0x7f662b794280>, body: {"keypair": {"name": "tempest-TestShelveInstance-2057159074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/FQ0EEyfGLSukeKB9/keunTyMNAMurS/cfGiC1y9EfbtOgrbDJu3Z+SdZN6jFz4ySjmmwWX0ig+Usulv7GpHS/EVEJX8fPVIjiAZlVEnZO6Eosx0MweAKAl3NChTzWTg=="}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:54:19.703170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-b2588877-c439-4532-9841-2fd7cf9b99f0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Getting quotas for project 07c56bef58d3426b8b9f10433063ec54. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:54:19.709672 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-b2588877-c439-4532-9841-2fd7cf9b99f0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Getting quotas for user 719d0446d98f43fba827fd2731b49a45 and project 07c56bef58d3426b8b9f10433063ec54. Resources: {'key_pairs'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:54:19.738400 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b2588877-c439-4532-9841-2fd7cf9b99f0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.055956 Oct 11 00:54:19.738937 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3642/7937] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 11 00:54:19 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:54:37.056186 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=10 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:54:37.056946 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:54:37.061798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c1c449a0-c424-4df0-b459-c0deccc763ba tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1890071361", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2057159074", "security_groups": [{"name": "tempest-secgroup-smoke-485548914"}], "networks": [{"uuid": "548c05f7-34ab-4e56-816f-396f1f378857"}], "block_device_mapping_v2": [{"uuid": "f61ecff7-241d-4efa-87e5-e6a1e3a2a7e9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:54:37.459737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-c1c449a0-c424-4df0-b459-c0deccc763ba tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] validate_networks() for [('548c05f7-34ab-4e56-816f-396f1f378857', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:54:37.878074 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c1c449a0-c424-4df0-b459-c0deccc763ba tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:54:37.878550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c1c449a0-c424-4df0-b459-c0deccc763ba tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:54:37.879046 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c1c449a0-c424-4df0-b459-c0deccc763ba tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:54:37.879480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c1c449a0-c424-4df0-b459-c0deccc763ba tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:54:37.879910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-c1c449a0-c424-4df0-b459-c0deccc763ba tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:54:37.889611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1c449a0-c424-4df0-b459-c0deccc763ba tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:37.890126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1c449a0-c424-4df0-b459-c0deccc763ba tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:37.890596 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1c449a0-c424-4df0-b459-c0deccc763ba tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:37.891348 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1c449a0-c424-4df0-b459-c0deccc763ba tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:37.891819 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1c449a0-c424-4df0-b459-c0deccc763ba tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:37.892262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c1c449a0-c424-4df0-b459-c0deccc763ba tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:37.909598 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-c1c449a0-c424-4df0-b459-c0deccc763ba tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Getting quotas for project 07c56bef58d3426b8b9f10433063ec54. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:54:37.915231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-c1c449a0-c424-4df0-b459-c0deccc763ba tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Getting quotas for user 719d0446d98f43fba827fd2731b49a45 and project 07c56bef58d3426b8b9f10433063ec54. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:54:37.974332 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c1c449a0-c424-4df0-b459-c0deccc763ba tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:54:37.976577 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c1c449a0-c424-4df0-b459-c0deccc763ba tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f61ecff7-241d-4efa-87e5-e6a1e3a2a7e9',volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:54:38.109067 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c1c449a0-c424-4df0-b459-c0deccc763ba tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.053711 Oct 11 00:54:38.110131 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4296/7938] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:54:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:54:38.118899 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:54:38.119657 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=4 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:54:38.120382 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:54:38.124901 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b46c3dec-fb14-40d3-8431-9bb851694480 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:54:38.125638 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b46c3dec-fb14-40d3-8431-9bb851694480 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:54:38.191607 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b46c3dec-fb14-40d3-8431-9bb851694480 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:54:38.198514 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b46c3dec-fb14-40d3-8431-9bb851694480 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1089 microversion: 2.1 time: 0.081493 Oct 11 00:54:38.199123 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3643/7939] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:54:38 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1089 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:54:39.223469 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b43234f9-3064-4f24-81bc-936d54170344 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:54:39.224102 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b43234f9-3064-4f24-81bc-936d54170344 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:54:39.230426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b43234f9-3064-4f24-81bc-936d54170344 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:39.230931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b43234f9-3064-4f24-81bc-936d54170344 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:39.231380 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b43234f9-3064-4f24-81bc-936d54170344 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:39.232119 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b43234f9-3064-4f24-81bc-936d54170344 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:39.232569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b43234f9-3064-4f24-81bc-936d54170344 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:39.234275 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b43234f9-3064-4f24-81bc-936d54170344 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:39.337479 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-b43234f9-3064-4f24-81bc-936d54170344 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:54:39.346148 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b43234f9-3064-4f24-81bc-936d54170344 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1195 microversion: 2.1 time: 0.128272 Oct 11 00:54:39.346756 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4297/7940] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:54:39 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1195 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:54:40.370299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-12b1af40-275f-4d25-8d52-d41ffdf7000e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:54:40.371799 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-12b1af40-275f-4d25-8d52-d41ffdf7000e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:54:40.378371 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12b1af40-275f-4d25-8d52-d41ffdf7000e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:40.379170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12b1af40-275f-4d25-8d52-d41ffdf7000e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:40.379796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12b1af40-275f-4d25-8d52-d41ffdf7000e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:40.380506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12b1af40-275f-4d25-8d52-d41ffdf7000e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:40.380964 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12b1af40-275f-4d25-8d52-d41ffdf7000e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:40.381415 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-12b1af40-275f-4d25-8d52-d41ffdf7000e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:40.583997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-12b1af40-275f-4d25-8d52-d41ffdf7000e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:54:40.592078 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-12b1af40-275f-4d25-8d52-d41ffdf7000e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1272 microversion: 2.1 time: 0.225985 Oct 11 00:54:40.593343 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3644/7941] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:54:40 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1272 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:54:40.982487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-1d025365-0d89-4f47-89a2-a1a58035f072 req-2212c8d0-8eb6-4c2f-8cd8-26981a00af01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9a2ea3f-6d48-400b-8a14-2ef629a4155b", "tag": "e91f4477-d3be-411a-874c-4362c0bdae8f"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:54:40.996853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1d025365-0d89-4f47-89a2-a1a58035f072 req-2212c8d0-8eb6-4c2f-8cd8-26981a00af01 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:40.997775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1d025365-0d89-4f47-89a2-a1a58035f072 req-2212c8d0-8eb6-4c2f-8cd8-26981a00af01 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:40.998429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1d025365-0d89-4f47-89a2-a1a58035f072 req-2212c8d0-8eb6-4c2f-8cd8-26981a00af01 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:41.011767 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-1d025365-0d89-4f47-89a2-a1a58035f072 req-2212c8d0-8eb6-4c2f-8cd8-26981a00af01 service nova] Creating event network-changed:e91f4477-d3be-411a-874c-4362c0bdae8f for instance c9a2ea3f-6d48-400b-8a14-2ef629a4155b on n-h2-860864-2 Oct 11 00:54:41.018125 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-1d025365-0d89-4f47-89a2-a1a58035f072 req-2212c8d0-8eb6-4c2f-8cd8-26981a00af01 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111328 Oct 11 00:54:41.019171 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4298/7942] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:54:41.616281 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-cb5ceca9-bab0-4252-9edd-27f8311db33b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:54:41.616957 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-cb5ceca9-bab0-4252-9edd-27f8311db33b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:54:41.624486 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb5ceca9-bab0-4252-9edd-27f8311db33b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:41.624986 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb5ceca9-bab0-4252-9edd-27f8311db33b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:41.625468 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb5ceca9-bab0-4252-9edd-27f8311db33b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:41.626191 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb5ceca9-bab0-4252-9edd-27f8311db33b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:41.626654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb5ceca9-bab0-4252-9edd-27f8311db33b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:41.627751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-cb5ceca9-bab0-4252-9edd-27f8311db33b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:41.792689 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-cb5ceca9-bab0-4252-9edd-27f8311db33b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:54:41.801780 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-cb5ceca9-bab0-4252-9edd-27f8311db33b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1272 microversion: 2.1 time: 0.189026 Oct 11 00:54:41.808030 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3645/7943] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:54:41 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1272 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:54:42.829997 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-be23edb0-7a6c-4b2b-b7bd-8ef339f1c0ea tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:54:42.830725 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-be23edb0-7a6c-4b2b-b7bd-8ef339f1c0ea tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:54:42.837342 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be23edb0-7a6c-4b2b-b7bd-8ef339f1c0ea tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:42.838216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be23edb0-7a6c-4b2b-b7bd-8ef339f1c0ea tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:42.838667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be23edb0-7a6c-4b2b-b7bd-8ef339f1c0ea tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:42.839371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be23edb0-7a6c-4b2b-b7bd-8ef339f1c0ea tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:42.839914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be23edb0-7a6c-4b2b-b7bd-8ef339f1c0ea tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:42.840347 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-be23edb0-7a6c-4b2b-b7bd-8ef339f1c0ea tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:42.980606 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-be23edb0-7a6c-4b2b-b7bd-8ef339f1c0ea tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:54:42.988810 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-be23edb0-7a6c-4b2b-b7bd-8ef339f1c0ea tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1272 microversion: 2.1 time: 0.165504 Oct 11 00:54:42.998210 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4299/7944] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:54:42 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:54:44.011769 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-2819104f-499f-40b0-92ed-802e9171f106 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:54:44.012396 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-2819104f-499f-40b0-92ed-802e9171f106 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:54:44.019857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2819104f-499f-40b0-92ed-802e9171f106 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:44.020348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2819104f-499f-40b0-92ed-802e9171f106 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:44.020789 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2819104f-499f-40b0-92ed-802e9171f106 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:44.021512 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2819104f-499f-40b0-92ed-802e9171f106 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:44.021968 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2819104f-499f-40b0-92ed-802e9171f106 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:44.022397 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-2819104f-499f-40b0-92ed-802e9171f106 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:44.160846 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-2819104f-499f-40b0-92ed-802e9171f106 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:54:44.169545 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-2819104f-499f-40b0-92ed-802e9171f106 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1272 microversion: 2.1 time: 0.161599 Oct 11 00:54:44.170165 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3646/7945] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:54:44 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:54:45.193484 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dd56f360-c42f-4654-80b9-dd3b8c1af762 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:54:45.194115 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dd56f360-c42f-4654-80b9-dd3b8c1af762 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:54:45.200984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd56f360-c42f-4654-80b9-dd3b8c1af762 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:45.201522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd56f360-c42f-4654-80b9-dd3b8c1af762 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:45.202514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd56f360-c42f-4654-80b9-dd3b8c1af762 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:45.203175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd56f360-c42f-4654-80b9-dd3b8c1af762 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:45.203640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd56f360-c42f-4654-80b9-dd3b8c1af762 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:45.204080 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dd56f360-c42f-4654-80b9-dd3b8c1af762 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:45.335768 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dd56f360-c42f-4654-80b9-dd3b8c1af762 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:54:45.344265 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dd56f360-c42f-4654-80b9-dd3b8c1af762 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1260 microversion: 2.1 time: 0.154749 Oct 11 00:54:45.344845 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4300/7946] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:54:45 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:54:46.368970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b2477694-7fa2-4219-be9a-cc9b319ee1f9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:54:46.369627 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b2477694-7fa2-4219-be9a-cc9b319ee1f9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:54:46.377893 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2477694-7fa2-4219-be9a-cc9b319ee1f9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:46.378379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2477694-7fa2-4219-be9a-cc9b319ee1f9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:46.378832 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2477694-7fa2-4219-be9a-cc9b319ee1f9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:46.379617 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2477694-7fa2-4219-be9a-cc9b319ee1f9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:46.380076 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2477694-7fa2-4219-be9a-cc9b319ee1f9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:46.380579 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2477694-7fa2-4219-be9a-cc9b319ee1f9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:46.518106 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b2477694-7fa2-4219-be9a-cc9b319ee1f9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:54:46.525926 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b2477694-7fa2-4219-be9a-cc9b319ee1f9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1260 microversion: 2.1 time: 0.161457 Oct 11 00:54:46.526505 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3647/7947] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:54:46 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:54:47.550402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-33736cdc-d43a-4be0-9ac5-b81e5b2f275f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:54:47.551021 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-33736cdc-d43a-4be0-9ac5-b81e5b2f275f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:54:47.557973 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33736cdc-d43a-4be0-9ac5-b81e5b2f275f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:47.558478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33736cdc-d43a-4be0-9ac5-b81e5b2f275f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:47.558934 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33736cdc-d43a-4be0-9ac5-b81e5b2f275f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:47.559650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33736cdc-d43a-4be0-9ac5-b81e5b2f275f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:47.560124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33736cdc-d43a-4be0-9ac5-b81e5b2f275f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:47.560570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-33736cdc-d43a-4be0-9ac5-b81e5b2f275f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:47.692309 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-33736cdc-d43a-4be0-9ac5-b81e5b2f275f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:54:47.700317 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-33736cdc-d43a-4be0-9ac5-b81e5b2f275f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1260 microversion: 2.1 time: 0.154638 Oct 11 00:54:47.700891 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4301/7948] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:54:47 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:54:48.722701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8c25b956-1fc6-4a7a-8ee2-82b38ba1a8b0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:54:48.723324 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8c25b956-1fc6-4a7a-8ee2-82b38ba1a8b0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:54:48.726077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:54:48.731902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c25b956-1fc6-4a7a-8ee2-82b38ba1a8b0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:48.732394 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c25b956-1fc6-4a7a-8ee2-82b38ba1a8b0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:48.732839 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c25b956-1fc6-4a7a-8ee2-82b38ba1a8b0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:48.734136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c25b956-1fc6-4a7a-8ee2-82b38ba1a8b0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:48.734851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c25b956-1fc6-4a7a-8ee2-82b38ba1a8b0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:48.735044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8c25b956-1fc6-4a7a-8ee2-82b38ba1a8b0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:48.870752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-8c25b956-1fc6-4a7a-8ee2-82b38ba1a8b0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:54:48.879605 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8c25b956-1fc6-4a7a-8ee2-82b38ba1a8b0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1260 microversion: 2.1 time: 0.160833 Oct 11 00:54:48.880179 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3648/7949] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:54:48 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:54:49.902854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cc5a433e-b5f0-4023-82cb-8d18c7074c2e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:54:49.903512 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cc5a433e-b5f0-4023-82cb-8d18c7074c2e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:54:49.905504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:54:49.906831 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:54:49.913908 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc5a433e-b5f0-4023-82cb-8d18c7074c2e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:49.914405 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc5a433e-b5f0-4023-82cb-8d18c7074c2e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:49.914853 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc5a433e-b5f0-4023-82cb-8d18c7074c2e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:49.915554 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc5a433e-b5f0-4023-82cb-8d18c7074c2e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:49.916019 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc5a433e-b5f0-4023-82cb-8d18c7074c2e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:49.916456 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cc5a433e-b5f0-4023-82cb-8d18c7074c2e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:50.050420 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cc5a433e-b5f0-4023-82cb-8d18c7074c2e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:54:50.058180 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cc5a433e-b5f0-4023-82cb-8d18c7074c2e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1260 microversion: 2.1 time: 0.159319 Oct 11 00:54:50.058760 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4302/7950] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:54:49 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:54:51.083200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3af96e86-84ce-4c85-9401-6314b9b57682 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:54:51.083756 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3af96e86-84ce-4c85-9401-6314b9b57682 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:54:51.090627 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3af96e86-84ce-4c85-9401-6314b9b57682 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:51.091107 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3af96e86-84ce-4c85-9401-6314b9b57682 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:51.091540 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3af96e86-84ce-4c85-9401-6314b9b57682 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:51.092224 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3af96e86-84ce-4c85-9401-6314b9b57682 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:51.092673 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3af96e86-84ce-4c85-9401-6314b9b57682 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:51.093096 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3af96e86-84ce-4c85-9401-6314b9b57682 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:51.230660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3af96e86-84ce-4c85-9401-6314b9b57682 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:54:51.238495 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3af96e86-84ce-4c85-9401-6314b9b57682 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1260 microversion: 2.1 time: 0.159445 Oct 11 00:54:51.239097 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3649/7951] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:54:51 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:54:52.262343 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2cbad063-4569-4504-9ee9-126b1cc9157f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:54:52.262932 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2cbad063-4569-4504-9ee9-126b1cc9157f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:54:52.270628 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cbad063-4569-4504-9ee9-126b1cc9157f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:52.271112 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cbad063-4569-4504-9ee9-126b1cc9157f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:52.271555 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cbad063-4569-4504-9ee9-126b1cc9157f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:52.272271 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cbad063-4569-4504-9ee9-126b1cc9157f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:52.273393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cbad063-4569-4504-9ee9-126b1cc9157f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:52.273393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2cbad063-4569-4504-9ee9-126b1cc9157f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:52.412887 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2cbad063-4569-4504-9ee9-126b1cc9157f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:54:52.420892 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2cbad063-4569-4504-9ee9-126b1cc9157f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1260 microversion: 2.1 time: 0.162633 Oct 11 00:54:52.421510 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4303/7952] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:54:52 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:54:53.445409 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-fc56f771-4325-4aa4-8c9d-5df05f979377 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:54:53.446049 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-fc56f771-4325-4aa4-8c9d-5df05f979377 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:54:53.452896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc56f771-4325-4aa4-8c9d-5df05f979377 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:53.453395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc56f771-4325-4aa4-8c9d-5df05f979377 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:53.453890 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc56f771-4325-4aa4-8c9d-5df05f979377 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:53.454587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc56f771-4325-4aa4-8c9d-5df05f979377 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:53.455057 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc56f771-4325-4aa4-8c9d-5df05f979377 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:53.455469 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-fc56f771-4325-4aa4-8c9d-5df05f979377 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:53.588377 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-fc56f771-4325-4aa4-8c9d-5df05f979377 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:54:53.596929 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-fc56f771-4325-4aa4-8c9d-5df05f979377 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1260 microversion: 2.1 time: 0.155640 Oct 11 00:54:53.597535 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3650/7953] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:54:53 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:54:54.425447 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-1f840383-3941-4032-baa7-c49bb6910ea0 req-1d13bf52-45cc-47d1-b9a0-6fa08b7eb1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a2ea3f-6d48-400b-8a14-2ef629a4155b", "name": "network-vif-plugged", "status": "completed", "tag": "e91f4477-d3be-411a-874c-4362c0bdae8f"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:54:54.435267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1f840383-3941-4032-baa7-c49bb6910ea0 req-1d13bf52-45cc-47d1-b9a0-6fa08b7eb1d0 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:54.435771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1f840383-3941-4032-baa7-c49bb6910ea0 req-1d13bf52-45cc-47d1-b9a0-6fa08b7eb1d0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:54.436223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-1f840383-3941-4032-baa7-c49bb6910ea0 req-1d13bf52-45cc-47d1-b9a0-6fa08b7eb1d0 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:54.449627 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-1f840383-3941-4032-baa7-c49bb6910ea0 req-1d13bf52-45cc-47d1-b9a0-6fa08b7eb1d0 service nova] Creating event network-vif-plugged:e91f4477-d3be-411a-874c-4362c0bdae8f for instance c9a2ea3f-6d48-400b-8a14-2ef629a4155b on n-h2-860864-2 Oct 11 00:54:54.455407 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-1f840383-3941-4032-baa7-c49bb6910ea0 req-1d13bf52-45cc-47d1-b9a0-6fa08b7eb1d0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093715 Oct 11 00:54:54.456013 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4304/7954] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:54:54.620152 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-95e3b8ca-e9fe-4e41-a4a9-ccf6b9c7d3c5 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:54:54.620797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-95e3b8ca-e9fe-4e41-a4a9-ccf6b9c7d3c5 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:54:54.628268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95e3b8ca-e9fe-4e41-a4a9-ccf6b9c7d3c5 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:54.628794 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95e3b8ca-e9fe-4e41-a4a9-ccf6b9c7d3c5 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:54.629228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95e3b8ca-e9fe-4e41-a4a9-ccf6b9c7d3c5 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:54.629949 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95e3b8ca-e9fe-4e41-a4a9-ccf6b9c7d3c5 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:54.630404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95e3b8ca-e9fe-4e41-a4a9-ccf6b9c7d3c5 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:54.630828 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-95e3b8ca-e9fe-4e41-a4a9-ccf6b9c7d3c5 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:54.762616 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-95e3b8ca-e9fe-4e41-a4a9-ccf6b9c7d3c5 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:54:54.771250 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-95e3b8ca-e9fe-4e41-a4a9-ccf6b9c7d3c5 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1260 microversion: 2.1 time: 0.155034 Oct 11 00:54:54.771820 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3651/7955] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:54:54 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:54:55.796151 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-aa40161a-7099-4478-a318-60792add7c17 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:54:55.796899 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-aa40161a-7099-4478-a318-60792add7c17 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:54:55.804174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa40161a-7099-4478-a318-60792add7c17 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:55.804674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa40161a-7099-4478-a318-60792add7c17 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:55.805126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa40161a-7099-4478-a318-60792add7c17 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:55.805882 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa40161a-7099-4478-a318-60792add7c17 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:55.806357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa40161a-7099-4478-a318-60792add7c17 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:55.806803 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aa40161a-7099-4478-a318-60792add7c17 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:55.951700 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-aa40161a-7099-4478-a318-60792add7c17 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:54:55.959895 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-aa40161a-7099-4478-a318-60792add7c17 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1260 microversion: 2.1 time: 0.168964 Oct 11 00:54:55.960473 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4305/7956] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:54:55 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:54:56.983375 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-20430d6f-a113-4388-991d-13871f13d203 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:54:56.984031 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-20430d6f-a113-4388-991d-13871f13d203 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:54:56.991597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20430d6f-a113-4388-991d-13871f13d203 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:56.992128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20430d6f-a113-4388-991d-13871f13d203 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:56.992543 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20430d6f-a113-4388-991d-13871f13d203 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:56.993244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20430d6f-a113-4388-991d-13871f13d203 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:56.993742 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20430d6f-a113-4388-991d-13871f13d203 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:56.994177 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-20430d6f-a113-4388-991d-13871f13d203 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:57.135380 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-20430d6f-a113-4388-991d-13871f13d203 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:54:57.143914 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-20430d6f-a113-4388-991d-13871f13d203 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1444 microversion: 2.1 time: 0.164465 Oct 11 00:54:57.144494 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3652/7957] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:54:56 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1444 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:54:57.167502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7659e514-47a5-4b80-b3f1-0ab40b08671a tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:54:57.168129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7659e514-47a5-4b80-b3f1-0ab40b08671a tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:54:57.175162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7659e514-47a5-4b80-b3f1-0ab40b08671a tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:57.175663 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7659e514-47a5-4b80-b3f1-0ab40b08671a tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:57.176116 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7659e514-47a5-4b80-b3f1-0ab40b08671a tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:57.176827 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7659e514-47a5-4b80-b3f1-0ab40b08671a tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:57.177295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7659e514-47a5-4b80-b3f1-0ab40b08671a tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:57.177760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7659e514-47a5-4b80-b3f1-0ab40b08671a tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:57.309038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7659e514-47a5-4b80-b3f1-0ab40b08671a tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:54:57.318186 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7659e514-47a5-4b80-b3f1-0ab40b08671a tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1444 microversion: 2.1 time: 0.154831 Oct 11 00:54:57.318768 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4306/7958] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:54:57 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:54:59.818752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-11a4976a-6905-4875-a66a-51fda6f937f7 req-8ca03ff5-e4df-4ee9-a938-9aaee2236435 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9a2ea3f-6d48-400b-8a14-2ef629a4155b", "tag": "e91f4477-d3be-411a-874c-4362c0bdae8f"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:54:59.829570 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-11a4976a-6905-4875-a66a-51fda6f937f7 req-8ca03ff5-e4df-4ee9-a938-9aaee2236435 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:54:59.830558 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-11a4976a-6905-4875-a66a-51fda6f937f7 req-8ca03ff5-e4df-4ee9-a938-9aaee2236435 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:54:59.831005 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-11a4976a-6905-4875-a66a-51fda6f937f7 req-8ca03ff5-e4df-4ee9-a938-9aaee2236435 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:54:59.843730 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-11a4976a-6905-4875-a66a-51fda6f937f7 req-8ca03ff5-e4df-4ee9-a938-9aaee2236435 service nova] Creating event network-changed:e91f4477-d3be-411a-874c-4362c0bdae8f for instance c9a2ea3f-6d48-400b-8a14-2ef629a4155b on n-h2-860864-2 Oct 11 00:54:59.851760 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-11a4976a-6905-4875-a66a-51fda6f937f7 req-8ca03ff5-e4df-4ee9-a938-9aaee2236435 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038124 Oct 11 00:54:59.852857 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3653/7959] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:56:56.987109 n-d-860864-2 devstack@n-api.service[120613]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9b2b028e-60c1-4dc3-ac1e-06905f87835c] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 00:56:56.988273 n-d-860864-2 devstack@n-api.service[120613]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dded55a6-8973-44c5-bba8-4440254057cd] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 00:56:56.988854 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:56:56.989639 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=54 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:56:56.990534 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 00:56:56.990736 n-d-860864-2 devstack@n-api.service[120613]: Tue Oct 11 00:56:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b/action (ip 10.222.0.23) !!! Oct 11 00:56:56.998481 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f4692b2a-8ca0-40e1-921d-9776c8e82068 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:56:56.999072 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f4692b2a-8ca0-40e1-921d-9776c8e82068 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:56:57.009771 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4692b2a-8ca0-40e1-921d-9776c8e82068 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:56:57.010238 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4692b2a-8ca0-40e1-921d-9776c8e82068 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:56:57.010766 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4692b2a-8ca0-40e1-921d-9776c8e82068 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:56:57.011450 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4692b2a-8ca0-40e1-921d-9776c8e82068 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:56:57.011913 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4692b2a-8ca0-40e1-921d-9776c8e82068 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:56:57.012353 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f4692b2a-8ca0-40e1-921d-9776c8e82068 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:56:57.037010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-f4692b2a-8ca0-40e1-921d-9776c8e82068 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lazy-loading 'flavor' on Instance uuid c9a2ea3f-6d48-400b-8a14-2ef629a4155b {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:56:57.112099 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f4692b2a-8ca0-40e1-921d-9776c8e82068 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "POST /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b/action" status: 202 len: 0 microversion: 2.1 time: 0.126695 Oct 11 00:56:57.112709 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4307/7960] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:56:56 2022] POST /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:56:57.120243 n-d-860864-2 devstack@n-api.service[120614]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0f2d80e9-f410-4772-8046-431e3c70ceb3] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 00:56:57.121057 n-d-860864-2 devstack@n-api.service[120614]: ERROR oslo.messaging._drivers.impl_rabbit [-] [31233ac2-692f-4d5e-84d4-7551eaa91acd] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 00:56:57.121681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=24 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:56:57.122850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=56 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:56:57.123974 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 00:56:57.124128 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:56:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b (ip 10.222.0.23) !!! Oct 11 00:56:57.125663 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:56:57.125918 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:56:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b (ip 10.222.0.23) !!! Oct 11 00:56:57.131196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-90b9ecf5-4a5c-4502-abd4-c0090bc13869 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:56:57.131919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-90b9ecf5-4a5c-4502-abd4-c0090bc13869 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:56:57.142483 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90b9ecf5-4a5c-4502-abd4-c0090bc13869 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:56:57.142982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90b9ecf5-4a5c-4502-abd4-c0090bc13869 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:56:57.143424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90b9ecf5-4a5c-4502-abd4-c0090bc13869 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:56:57.144136 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90b9ecf5-4a5c-4502-abd4-c0090bc13869 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:56:57.144600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90b9ecf5-4a5c-4502-abd4-c0090bc13869 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:56:57.145026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-90b9ecf5-4a5c-4502-abd4-c0090bc13869 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:56:57.296988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-90b9ecf5-4a5c-4502-abd4-c0090bc13869 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:56:57.305337 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-90b9ecf5-4a5c-4502-abd4-c0090bc13869 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1569 microversion: 2.1 time: 0.186605 Oct 11 00:56:57.306005 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3654/7961] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:56:57 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:56:58.337107 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-614580ae-6bc5-4cc4-ac3a-3d6ff18b3236 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:56:58.337856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-614580ae-6bc5-4cc4-ac3a-3d6ff18b3236 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:56:58.347543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-614580ae-6bc5-4cc4-ac3a-3d6ff18b3236 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:56:58.348036 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-614580ae-6bc5-4cc4-ac3a-3d6ff18b3236 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:56:58.348485 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-614580ae-6bc5-4cc4-ac3a-3d6ff18b3236 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:56:58.349194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-614580ae-6bc5-4cc4-ac3a-3d6ff18b3236 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:56:58.349689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-614580ae-6bc5-4cc4-ac3a-3d6ff18b3236 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:56:58.350129 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-614580ae-6bc5-4cc4-ac3a-3d6ff18b3236 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:56:58.354892 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] [9b2b028e-60c1-4dc3-ac1e-06905f87835c] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 41348. Oct 11 00:56:58.355596 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] [dded55a6-8973-44c5-bba8-4440254057cd] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 41350. Oct 11 00:56:58.558884 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-614580ae-6bc5-4cc4-ac3a-3d6ff18b3236 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:56:58.567911 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-614580ae-6bc5-4cc4-ac3a-3d6ff18b3236 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1569 microversion: 2.1 time: 0.236275 Oct 11 00:56:58.568502 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4308/7962] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:56:58 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1569 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:56:59.591597 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-0469f23b-e321-47ea-9e45-8a02e4be6a65 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:56:59.592272 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-0469f23b-e321-47ea-9e45-8a02e4be6a65 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:56:59.604460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0469f23b-e321-47ea-9e45-8a02e4be6a65 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:56:59.604982 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0469f23b-e321-47ea-9e45-8a02e4be6a65 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:56:59.605461 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0469f23b-e321-47ea-9e45-8a02e4be6a65 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:56:59.606200 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0469f23b-e321-47ea-9e45-8a02e4be6a65 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:56:59.606681 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0469f23b-e321-47ea-9e45-8a02e4be6a65 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:56:59.607091 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-0469f23b-e321-47ea-9e45-8a02e4be6a65 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:56:59.615047 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] [0f2d80e9-f410-4772-8046-431e3c70ceb3] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 41356. Oct 11 00:56:59.615844 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] [31233ac2-692f-4d5e-84d4-7551eaa91acd] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 41358. Oct 11 00:56:59.742674 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-0469f23b-e321-47ea-9e45-8a02e4be6a65 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:56:59.752481 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-0469f23b-e321-47ea-9e45-8a02e4be6a65 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1569 microversion: 2.1 time: 0.164679 Oct 11 00:56:59.753108 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3655/7963] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:56:59 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:00.776189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ef428017-a2cd-453b-823b-c56cdaa9e1c0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:00.776825 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ef428017-a2cd-453b-823b-c56cdaa9e1c0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:00.784022 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef428017-a2cd-453b-823b-c56cdaa9e1c0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:00.784541 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef428017-a2cd-453b-823b-c56cdaa9e1c0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:00.785096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef428017-a2cd-453b-823b-c56cdaa9e1c0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:00.785856 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef428017-a2cd-453b-823b-c56cdaa9e1c0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:00.786333 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef428017-a2cd-453b-823b-c56cdaa9e1c0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:00.786774 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ef428017-a2cd-453b-823b-c56cdaa9e1c0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:00.929130 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ef428017-a2cd-453b-823b-c56cdaa9e1c0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:00.938006 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ef428017-a2cd-453b-823b-c56cdaa9e1c0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1569 microversion: 2.1 time: 0.164872 Oct 11 00:57:00.938657 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4309/7964] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:00 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:01.961542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d4cc3d2d-6c23-499c-90fc-4ced1409fcbc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:01.962162 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d4cc3d2d-6c23-499c-90fc-4ced1409fcbc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:01.969346 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4cc3d2d-6c23-499c-90fc-4ced1409fcbc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:01.969865 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4cc3d2d-6c23-499c-90fc-4ced1409fcbc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:01.970356 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4cc3d2d-6c23-499c-90fc-4ced1409fcbc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:01.971108 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4cc3d2d-6c23-499c-90fc-4ced1409fcbc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:01.971561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4cc3d2d-6c23-499c-90fc-4ced1409fcbc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:01.971984 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d4cc3d2d-6c23-499c-90fc-4ced1409fcbc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:02.108983 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d4cc3d2d-6c23-499c-90fc-4ced1409fcbc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:02.118301 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d4cc3d2d-6c23-499c-90fc-4ced1409fcbc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1569 microversion: 2.1 time: 0.160698 Oct 11 00:57:02.118905 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3656/7965] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:01 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:03.145762 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-296635f7-3827-4999-b601-1e15a96e2ab9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:03.146421 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-296635f7-3827-4999-b601-1e15a96e2ab9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:03.153187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-296635f7-3827-4999-b601-1e15a96e2ab9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:03.153714 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-296635f7-3827-4999-b601-1e15a96e2ab9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:03.154162 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-296635f7-3827-4999-b601-1e15a96e2ab9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:03.154870 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-296635f7-3827-4999-b601-1e15a96e2ab9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:03.155335 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-296635f7-3827-4999-b601-1e15a96e2ab9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:03.155772 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-296635f7-3827-4999-b601-1e15a96e2ab9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:03.295110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-296635f7-3827-4999-b601-1e15a96e2ab9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:03.303619 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-296635f7-3827-4999-b601-1e15a96e2ab9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1569 microversion: 2.1 time: 0.162926 Oct 11 00:57:03.304243 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4310/7966] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:03 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:04.327234 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-67f1dfb0-6876-4839-ba47-ee87ac676855 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:04.327847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-67f1dfb0-6876-4839-ba47-ee87ac676855 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:04.335306 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67f1dfb0-6876-4839-ba47-ee87ac676855 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:04.335732 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67f1dfb0-6876-4839-ba47-ee87ac676855 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:04.336172 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67f1dfb0-6876-4839-ba47-ee87ac676855 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:04.336862 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67f1dfb0-6876-4839-ba47-ee87ac676855 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:04.337316 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67f1dfb0-6876-4839-ba47-ee87ac676855 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:04.337766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-67f1dfb0-6876-4839-ba47-ee87ac676855 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:04.473998 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-67f1dfb0-6876-4839-ba47-ee87ac676855 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:04.481850 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-67f1dfb0-6876-4839-ba47-ee87ac676855 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1569 microversion: 2.1 time: 0.158514 Oct 11 00:57:04.482428 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3657/7967] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:04 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:05.507027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cd96b33a-c634-40e5-baa4-3ae3499628cb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:05.507642 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cd96b33a-c634-40e5-baa4-3ae3499628cb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:05.514861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd96b33a-c634-40e5-baa4-3ae3499628cb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:05.515448 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd96b33a-c634-40e5-baa4-3ae3499628cb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:05.516025 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd96b33a-c634-40e5-baa4-3ae3499628cb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:05.516773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd96b33a-c634-40e5-baa4-3ae3499628cb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:05.517246 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd96b33a-c634-40e5-baa4-3ae3499628cb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:05.517760 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cd96b33a-c634-40e5-baa4-3ae3499628cb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:05.650836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cd96b33a-c634-40e5-baa4-3ae3499628cb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:05.658735 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cd96b33a-c634-40e5-baa4-3ae3499628cb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1569 microversion: 2.1 time: 0.156946 Oct 11 00:57:05.659309 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4311/7968] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:05 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:06.684369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5f4254bc-e4e7-42fa-8efe-8b544540848b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:06.684979 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5f4254bc-e4e7-42fa-8efe-8b544540848b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:06.692213 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f4254bc-e4e7-42fa-8efe-8b544540848b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:06.692701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f4254bc-e4e7-42fa-8efe-8b544540848b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:06.693147 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f4254bc-e4e7-42fa-8efe-8b544540848b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:06.693869 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f4254bc-e4e7-42fa-8efe-8b544540848b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:06.694327 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f4254bc-e4e7-42fa-8efe-8b544540848b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:06.694757 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5f4254bc-e4e7-42fa-8efe-8b544540848b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:06.831747 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5f4254bc-e4e7-42fa-8efe-8b544540848b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:06.840448 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5f4254bc-e4e7-42fa-8efe-8b544540848b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1569 microversion: 2.1 time: 0.160644 Oct 11 00:57:06.841031 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3658/7969] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:06 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:07.863751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2d3542a9-3ddb-46e5-9fd1-c7a9b9696edc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:07.864451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2d3542a9-3ddb-46e5-9fd1-c7a9b9696edc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:07.873326 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d3542a9-3ddb-46e5-9fd1-c7a9b9696edc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:07.873902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d3542a9-3ddb-46e5-9fd1-c7a9b9696edc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:07.874402 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d3542a9-3ddb-46e5-9fd1-c7a9b9696edc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:07.875179 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d3542a9-3ddb-46e5-9fd1-c7a9b9696edc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:07.875730 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d3542a9-3ddb-46e5-9fd1-c7a9b9696edc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:07.876223 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2d3542a9-3ddb-46e5-9fd1-c7a9b9696edc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:08.012620 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2d3542a9-3ddb-46e5-9fd1-c7a9b9696edc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:08.021512 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2d3542a9-3ddb-46e5-9fd1-c7a9b9696edc tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1569 microversion: 2.1 time: 0.162060 Oct 11 00:57:08.022175 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4312/7970] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:07 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:09.046244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7c82bd56-513d-4777-a34d-81a414503a38 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:09.046896 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7c82bd56-513d-4777-a34d-81a414503a38 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:09.055647 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c82bd56-513d-4777-a34d-81a414503a38 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:09.056804 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c82bd56-513d-4777-a34d-81a414503a38 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:09.057582 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c82bd56-513d-4777-a34d-81a414503a38 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:09.058592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c82bd56-513d-4777-a34d-81a414503a38 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:09.059033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c82bd56-513d-4777-a34d-81a414503a38 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:09.059455 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7c82bd56-513d-4777-a34d-81a414503a38 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:09.198876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7c82bd56-513d-4777-a34d-81a414503a38 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:09.206676 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7c82bd56-513d-4777-a34d-81a414503a38 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1569 microversion: 2.1 time: 0.164425 Oct 11 00:57:09.207255 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3659/7971] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:09 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:10.233285 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-cb9742b8-8557-4726-a250-41ee33bda1e7 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:10.234241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-cb9742b8-8557-4726-a250-41ee33bda1e7 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:10.243686 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb9742b8-8557-4726-a250-41ee33bda1e7 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:10.244194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb9742b8-8557-4726-a250-41ee33bda1e7 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:10.244650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb9742b8-8557-4726-a250-41ee33bda1e7 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:10.245394 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb9742b8-8557-4726-a250-41ee33bda1e7 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:10.245868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb9742b8-8557-4726-a250-41ee33bda1e7 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:10.246321 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-cb9742b8-8557-4726-a250-41ee33bda1e7 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:10.388744 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-cb9742b8-8557-4726-a250-41ee33bda1e7 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:10.400202 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-cb9742b8-8557-4726-a250-41ee33bda1e7 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1569 microversion: 2.1 time: 0.172714 Oct 11 00:57:10.401015 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4313/7972] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:10 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:11.426707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-b2d16e21-ed46-4cef-bda4-bdff6fb25fa9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:11.427436 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-b2d16e21-ed46-4cef-bda4-bdff6fb25fa9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:11.436660 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2d16e21-ed46-4cef-bda4-bdff6fb25fa9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:11.437245 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2d16e21-ed46-4cef-bda4-bdff6fb25fa9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:11.437772 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2d16e21-ed46-4cef-bda4-bdff6fb25fa9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:11.438850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2d16e21-ed46-4cef-bda4-bdff6fb25fa9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:11.439770 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2d16e21-ed46-4cef-bda4-bdff6fb25fa9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:11.440151 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-b2d16e21-ed46-4cef-bda4-bdff6fb25fa9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:11.593499 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-b2d16e21-ed46-4cef-bda4-bdff6fb25fa9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:11.604230 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-b2d16e21-ed46-4cef-bda4-bdff6fb25fa9 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1569 microversion: 2.1 time: 0.182379 Oct 11 00:57:11.604820 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3660/7973] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:11 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:12.629087 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-260495c2-ac15-4808-906f-0fb5718f6668 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:12.629826 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-260495c2-ac15-4808-906f-0fb5718f6668 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:12.638123 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-260495c2-ac15-4808-906f-0fb5718f6668 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:12.638661 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-260495c2-ac15-4808-906f-0fb5718f6668 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:12.639180 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-260495c2-ac15-4808-906f-0fb5718f6668 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:12.639929 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-260495c2-ac15-4808-906f-0fb5718f6668 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:12.640426 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-260495c2-ac15-4808-906f-0fb5718f6668 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:12.640930 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-260495c2-ac15-4808-906f-0fb5718f6668 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:12.782503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-260495c2-ac15-4808-906f-0fb5718f6668 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:12.791003 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-260495c2-ac15-4808-906f-0fb5718f6668 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1510 microversion: 2.1 time: 0.166276 Oct 11 00:57:12.791598 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4314/7974] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:12 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:12.814850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d95b9afe-f985-48c2-b6bd-5938457e5fbf tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:57:12.815528 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d95b9afe-f985-48c2-b6bd-5938457e5fbf tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:12.822817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d95b9afe-f985-48c2-b6bd-5938457e5fbf tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:12.823271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d95b9afe-f985-48c2-b6bd-5938457e5fbf tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:12.823718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d95b9afe-f985-48c2-b6bd-5938457e5fbf tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:12.824834 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d95b9afe-f985-48c2-b6bd-5938457e5fbf tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:12.825299 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d95b9afe-f985-48c2-b6bd-5938457e5fbf tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:12.825762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d95b9afe-f985-48c2-b6bd-5938457e5fbf tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:12.855347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d95b9afe-f985-48c2-b6bd-5938457e5fbf tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120614) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 00:57:12.930076 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d95b9afe-f985-48c2-b6bd-5938457e5fbf tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "POST /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b/action" status: 202 len: 0 microversion: 2.1 time: 0.119150 Oct 11 00:57:12.930672 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3661/7975] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 00:57:12 2022] POST /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 00:57:12.940565 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5aec3077-551d-4357-916c-7e0da87450e3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:12.942464 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5aec3077-551d-4357-916c-7e0da87450e3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:12.948798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5aec3077-551d-4357-916c-7e0da87450e3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:12.949308 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5aec3077-551d-4357-916c-7e0da87450e3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:12.949989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5aec3077-551d-4357-916c-7e0da87450e3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:12.950724 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5aec3077-551d-4357-916c-7e0da87450e3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:12.951202 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5aec3077-551d-4357-916c-7e0da87450e3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:12.951644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5aec3077-551d-4357-916c-7e0da87450e3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:13.060999 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-45e4b7d8-b97a-475b-9854-2f6d04a698df req-012fb12b-565c-4753-b297-d061cdb2a5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a2ea3f-6d48-400b-8a14-2ef629a4155b", "name": "network-vif-unplugged", "status": "completed", "tag": "e91f4477-d3be-411a-874c-4362c0bdae8f"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:57:13.076354 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-45e4b7d8-b97a-475b-9854-2f6d04a698df req-012fb12b-565c-4753-b297-d061cdb2a5c6 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:13.077592 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-45e4b7d8-b97a-475b-9854-2f6d04a698df req-012fb12b-565c-4753-b297-d061cdb2a5c6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:13.078077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-45e4b7d8-b97a-475b-9854-2f6d04a698df req-012fb12b-565c-4753-b297-d061cdb2a5c6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:13.092517 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.compute.server_external_events [req-45e4b7d8-b97a-475b-9854-2f6d04a698df req-012fb12b-565c-4753-b297-d061cdb2a5c6 service nova] Unable to find a host for instance c9a2ea3f-6d48-400b-8a14-2ef629a4155b. Dropping event network-vif-unplugged {{(pid=120614) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 00:57:13.094206 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-45e4b7d8-b97a-475b-9854-2f6d04a698df req-012fb12b-565c-4753-b297-d061cdb2a5c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037050 Oct 11 00:57:13.095454 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3662/7976] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 11 00:57:13.113703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5aec3077-551d-4357-916c-7e0da87450e3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:13.130278 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5aec3077-551d-4357-916c-7e0da87450e3 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1518 microversion: 2.1 time: 0.195132 Oct 11 00:57:13.141408 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4315/7977] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:12 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1518 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:14.157062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6d626139-851b-4225-8595-9493913d9b7f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:14.157710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6d626139-851b-4225-8595-9493913d9b7f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:14.165337 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d626139-851b-4225-8595-9493913d9b7f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:14.165851 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d626139-851b-4225-8595-9493913d9b7f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:14.166293 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d626139-851b-4225-8595-9493913d9b7f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:14.166996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d626139-851b-4225-8595-9493913d9b7f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:14.167450 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d626139-851b-4225-8595-9493913d9b7f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:14.167877 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6d626139-851b-4225-8595-9493913d9b7f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:14.304207 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6d626139-851b-4225-8595-9493913d9b7f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:14.312264 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6d626139-851b-4225-8595-9493913d9b7f tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1520 microversion: 2.1 time: 0.159190 Oct 11 00:57:14.312836 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3663/7978] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:14 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:15.336735 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-2bdf8ab0-f830-42b0-9812-4b0842df4925 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:15.337423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-2bdf8ab0-f830-42b0-9812-4b0842df4925 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:15.344436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bdf8ab0-f830-42b0-9812-4b0842df4925 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:15.344944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bdf8ab0-f830-42b0-9812-4b0842df4925 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:15.345423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bdf8ab0-f830-42b0-9812-4b0842df4925 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:15.346152 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bdf8ab0-f830-42b0-9812-4b0842df4925 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:15.346627 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bdf8ab0-f830-42b0-9812-4b0842df4925 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:15.347077 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-2bdf8ab0-f830-42b0-9812-4b0842df4925 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:15.491747 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-2bdf8ab0-f830-42b0-9812-4b0842df4925 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:15.499754 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-2bdf8ab0-f830-42b0-9812-4b0842df4925 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1520 microversion: 2.1 time: 0.167258 Oct 11 00:57:15.500344 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4316/7979] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:15 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:16.528132 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4fc16b2d-e2cc-4642-a31c-f7a722daab5b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:16.528751 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4fc16b2d-e2cc-4642-a31c-f7a722daab5b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:16.535972 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fc16b2d-e2cc-4642-a31c-f7a722daab5b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:16.536504 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fc16b2d-e2cc-4642-a31c-f7a722daab5b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:16.536911 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fc16b2d-e2cc-4642-a31c-f7a722daab5b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:16.537658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fc16b2d-e2cc-4642-a31c-f7a722daab5b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:16.538199 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fc16b2d-e2cc-4642-a31c-f7a722daab5b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:16.538635 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4fc16b2d-e2cc-4642-a31c-f7a722daab5b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:16.684204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4fc16b2d-e2cc-4642-a31c-f7a722daab5b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:16.692815 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4fc16b2d-e2cc-4642-a31c-f7a722daab5b tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1520 microversion: 2.1 time: 0.169177 Oct 11 00:57:16.693430 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3664/7980] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:16 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:17.716723 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-54166204-0b3d-44e3-8815-1e0cc16313a6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:17.717388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-54166204-0b3d-44e3-8815-1e0cc16313a6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:17.724471 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54166204-0b3d-44e3-8815-1e0cc16313a6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:17.724993 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54166204-0b3d-44e3-8815-1e0cc16313a6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:17.725492 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54166204-0b3d-44e3-8815-1e0cc16313a6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:17.726187 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54166204-0b3d-44e3-8815-1e0cc16313a6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:17.726662 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54166204-0b3d-44e3-8815-1e0cc16313a6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:17.727110 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-54166204-0b3d-44e3-8815-1e0cc16313a6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:17.861678 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-54166204-0b3d-44e3-8815-1e0cc16313a6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:17.870935 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-54166204-0b3d-44e3-8815-1e0cc16313a6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1520 microversion: 2.1 time: 0.158118 Oct 11 00:57:17.871528 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4317/7981] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:17 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:18.894848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-4c430446-ac1f-4a8f-8954-a7dc24823754 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:18.895458 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-4c430446-ac1f-4a8f-8954-a7dc24823754 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:18.903798 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c430446-ac1f-4a8f-8954-a7dc24823754 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:18.904291 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c430446-ac1f-4a8f-8954-a7dc24823754 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:18.904739 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c430446-ac1f-4a8f-8954-a7dc24823754 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:18.905481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c430446-ac1f-4a8f-8954-a7dc24823754 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:18.905948 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c430446-ac1f-4a8f-8954-a7dc24823754 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:18.906376 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-4c430446-ac1f-4a8f-8954-a7dc24823754 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:19.055088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-4c430446-ac1f-4a8f-8954-a7dc24823754 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:19.066312 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-4c430446-ac1f-4a8f-8954-a7dc24823754 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1576 microversion: 2.1 time: 0.175273 Oct 11 00:57:19.067044 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3665/7982] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:18 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:19.819427 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-74bbdec3-7fd7-4b29-8768-7d87b85889d0 req-42ee329d-f7e2-426b-b75d-c333b547ab3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9a2ea3f-6d48-400b-8a14-2ef629a4155b", "tag": "e91f4477-d3be-411a-874c-4362c0bdae8f"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:57:19.833106 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-74bbdec3-7fd7-4b29-8768-7d87b85889d0 req-42ee329d-f7e2-426b-b75d-c333b547ab3e service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:19.833629 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-74bbdec3-7fd7-4b29-8768-7d87b85889d0 req-42ee329d-f7e2-426b-b75d-c333b547ab3e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:19.834078 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-74bbdec3-7fd7-4b29-8768-7d87b85889d0 req-42ee329d-f7e2-426b-b75d-c333b547ab3e service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:19.845774 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-74bbdec3-7fd7-4b29-8768-7d87b85889d0 req-42ee329d-f7e2-426b-b75d-c333b547ab3e service nova] Creating event network-changed:e91f4477-d3be-411a-874c-4362c0bdae8f for instance c9a2ea3f-6d48-400b-8a14-2ef629a4155b on n-h1-860864-2 Oct 11 00:57:19.851446 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-74bbdec3-7fd7-4b29-8768-7d87b85889d0 req-42ee329d-f7e2-426b-b75d-c333b547ab3e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041219 Oct 11 00:57:19.852725 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4318/7983] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:57:20.096072 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ddf87261-de5f-4613-9ca0-360b6c432297 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:20.096636 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ddf87261-de5f-4613-9ca0-360b6c432297 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:20.105042 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddf87261-de5f-4613-9ca0-360b6c432297 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:20.105566 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddf87261-de5f-4613-9ca0-360b6c432297 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:20.106002 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddf87261-de5f-4613-9ca0-360b6c432297 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:20.106708 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddf87261-de5f-4613-9ca0-360b6c432297 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:20.107201 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddf87261-de5f-4613-9ca0-360b6c432297 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:20.107583 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddf87261-de5f-4613-9ca0-360b6c432297 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:20.251034 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ddf87261-de5f-4613-9ca0-360b6c432297 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:20.260631 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ddf87261-de5f-4613-9ca0-360b6c432297 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1576 microversion: 2.1 time: 0.168607 Oct 11 00:57:20.261411 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3666/7984] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:20 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:21.285961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3f7a3e53-018e-4605-91dc-ad508cd3b8a6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:21.286592 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3f7a3e53-018e-4605-91dc-ad508cd3b8a6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:21.293732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f7a3e53-018e-4605-91dc-ad508cd3b8a6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:21.294237 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f7a3e53-018e-4605-91dc-ad508cd3b8a6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:21.294689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f7a3e53-018e-4605-91dc-ad508cd3b8a6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:21.295410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f7a3e53-018e-4605-91dc-ad508cd3b8a6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:21.295886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f7a3e53-018e-4605-91dc-ad508cd3b8a6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:21.296331 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3f7a3e53-018e-4605-91dc-ad508cd3b8a6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:21.446665 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-3f7a3e53-018e-4605-91dc-ad508cd3b8a6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:21.461877 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3f7a3e53-018e-4605-91dc-ad508cd3b8a6 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1576 microversion: 2.1 time: 0.180607 Oct 11 00:57:21.463050 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4319/7985] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:21 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:22.486752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-dc6d7136-a69f-4ff2-a369-c2c8dcf0739e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:22.487365 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-dc6d7136-a69f-4ff2-a369-c2c8dcf0739e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:22.495303 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc6d7136-a69f-4ff2-a369-c2c8dcf0739e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:22.495882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc6d7136-a69f-4ff2-a369-c2c8dcf0739e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:22.496320 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc6d7136-a69f-4ff2-a369-c2c8dcf0739e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:22.497008 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc6d7136-a69f-4ff2-a369-c2c8dcf0739e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:22.497498 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc6d7136-a69f-4ff2-a369-c2c8dcf0739e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:22.497928 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-dc6d7136-a69f-4ff2-a369-c2c8dcf0739e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:22.633914 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-dc6d7136-a69f-4ff2-a369-c2c8dcf0739e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:22.642189 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-dc6d7136-a69f-4ff2-a369-c2c8dcf0739e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1576 microversion: 2.1 time: 0.159397 Oct 11 00:57:22.642767 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3667/7986] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:22 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:23.665967 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-6a8cae99-44ef-4018-84e5-1e2760f13092 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:23.666643 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-6a8cae99-44ef-4018-84e5-1e2760f13092 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:23.674069 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a8cae99-44ef-4018-84e5-1e2760f13092 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:23.674613 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a8cae99-44ef-4018-84e5-1e2760f13092 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:23.675108 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a8cae99-44ef-4018-84e5-1e2760f13092 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:23.675813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a8cae99-44ef-4018-84e5-1e2760f13092 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:23.676277 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a8cae99-44ef-4018-84e5-1e2760f13092 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:23.676757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-6a8cae99-44ef-4018-84e5-1e2760f13092 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:23.818171 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-6a8cae99-44ef-4018-84e5-1e2760f13092 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:23.827169 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-6a8cae99-44ef-4018-84e5-1e2760f13092 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1576 microversion: 2.1 time: 0.165578 Oct 11 00:57:23.827751 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4320/7987] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:23 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:24.851536 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-620b8b35-dbcf-486c-beb6-8c1217cc2817 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:24.852182 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-620b8b35-dbcf-486c-beb6-8c1217cc2817 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:24.859795 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-620b8b35-dbcf-486c-beb6-8c1217cc2817 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:24.860285 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-620b8b35-dbcf-486c-beb6-8c1217cc2817 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:24.860737 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-620b8b35-dbcf-486c-beb6-8c1217cc2817 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:24.861524 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-620b8b35-dbcf-486c-beb6-8c1217cc2817 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:24.861981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-620b8b35-dbcf-486c-beb6-8c1217cc2817 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:24.862404 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-620b8b35-dbcf-486c-beb6-8c1217cc2817 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:25.000474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-620b8b35-dbcf-486c-beb6-8c1217cc2817 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:25.008511 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-620b8b35-dbcf-486c-beb6-8c1217cc2817 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1576 microversion: 2.1 time: 0.160954 Oct 11 00:57:25.009087 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3668/7988] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:24 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:26.033181 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-038c0317-f78e-4104-8337-bd2c219f7c92 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:26.034035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-038c0317-f78e-4104-8337-bd2c219f7c92 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:26.041649 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-038c0317-f78e-4104-8337-bd2c219f7c92 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:26.042205 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-038c0317-f78e-4104-8337-bd2c219f7c92 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:26.042710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-038c0317-f78e-4104-8337-bd2c219f7c92 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:26.044192 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-038c0317-f78e-4104-8337-bd2c219f7c92 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:26.044703 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-038c0317-f78e-4104-8337-bd2c219f7c92 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:26.045249 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-038c0317-f78e-4104-8337-bd2c219f7c92 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:26.187550 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-038c0317-f78e-4104-8337-bd2c219f7c92 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:26.195661 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-038c0317-f78e-4104-8337-bd2c219f7c92 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1576 microversion: 2.1 time: 0.166832 Oct 11 00:57:26.196245 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4321/7989] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:26 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:27.221025 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-6b0a1df6-e386-40d9-b362-c28dbf9a3aae tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:27.221738 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-6b0a1df6-e386-40d9-b362-c28dbf9a3aae tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:27.224612 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:57:27.229996 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b0a1df6-e386-40d9-b362-c28dbf9a3aae tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:27.230474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b0a1df6-e386-40d9-b362-c28dbf9a3aae tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:27.231428 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b0a1df6-e386-40d9-b362-c28dbf9a3aae tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:27.232654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b0a1df6-e386-40d9-b362-c28dbf9a3aae tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:27.233105 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b0a1df6-e386-40d9-b362-c28dbf9a3aae tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:27.233561 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-6b0a1df6-e386-40d9-b362-c28dbf9a3aae tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:27.238258 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:57:27.370062 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-6b0a1df6-e386-40d9-b362-c28dbf9a3aae tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:27.377864 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-6b0a1df6-e386-40d9-b362-c28dbf9a3aae tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1576 microversion: 2.1 time: 0.161162 Oct 11 00:57:27.378447 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3669/7990] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:27 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:28.401003 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dbc6d78a-2c88-4d95-ac3a-f477cb723128 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:28.401692 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dbc6d78a-2c88-4d95-ac3a-f477cb723128 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:28.404503 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=31 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:57:28.409865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbc6d78a-2c88-4d95-ac3a-f477cb723128 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:28.410374 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbc6d78a-2c88-4d95-ac3a-f477cb723128 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:28.410829 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbc6d78a-2c88-4d95-ac3a-f477cb723128 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:28.411545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbc6d78a-2c88-4d95-ac3a-f477cb723128 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:28.412012 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbc6d78a-2c88-4d95-ac3a-f477cb723128 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:28.412454 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dbc6d78a-2c88-4d95-ac3a-f477cb723128 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:28.415276 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:57:28.550865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-dbc6d78a-2c88-4d95-ac3a-f477cb723128 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:28.558815 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dbc6d78a-2c88-4d95-ac3a-f477cb723128 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1576 microversion: 2.1 time: 0.161754 Oct 11 00:57:28.560038 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4322/7991] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:28 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:29.583551 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-11719384-f24b-4e74-8aea-29b74ccd3732 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:29.584134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-11719384-f24b-4e74-8aea-29b74ccd3732 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:29.591707 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11719384-f24b-4e74-8aea-29b74ccd3732 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:29.592196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11719384-f24b-4e74-8aea-29b74ccd3732 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:29.592634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11719384-f24b-4e74-8aea-29b74ccd3732 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:29.593322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11719384-f24b-4e74-8aea-29b74ccd3732 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:29.593801 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11719384-f24b-4e74-8aea-29b74ccd3732 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:29.594222 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-11719384-f24b-4e74-8aea-29b74ccd3732 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:29.727691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-11719384-f24b-4e74-8aea-29b74ccd3732 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:29.735538 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-11719384-f24b-4e74-8aea-29b74ccd3732 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1576 microversion: 2.1 time: 0.156463 Oct 11 00:57:29.736121 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3670/7992] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:29 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:30.759334 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1f80b59d-045d-49c4-9526-a6c80937b447 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:30.759872 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1f80b59d-045d-49c4-9526-a6c80937b447 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:30.768035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f80b59d-045d-49c4-9526-a6c80937b447 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:30.768535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f80b59d-045d-49c4-9526-a6c80937b447 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:30.768989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f80b59d-045d-49c4-9526-a6c80937b447 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:30.769741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f80b59d-045d-49c4-9526-a6c80937b447 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:30.770212 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f80b59d-045d-49c4-9526-a6c80937b447 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:30.770653 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1f80b59d-045d-49c4-9526-a6c80937b447 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:30.921196 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1f80b59d-045d-49c4-9526-a6c80937b447 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:30.929632 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1f80b59d-045d-49c4-9526-a6c80937b447 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1576 microversion: 2.1 time: 0.174265 Oct 11 00:57:30.930215 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4323/7993] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:30 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:31.954011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-3b8e5c06-0340-4ed0-969f-b7afbbed6100 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:31.954861 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-3b8e5c06-0340-4ed0-969f-b7afbbed6100 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:31.961847 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b8e5c06-0340-4ed0-969f-b7afbbed6100 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:31.962331 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b8e5c06-0340-4ed0-969f-b7afbbed6100 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:31.962796 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b8e5c06-0340-4ed0-969f-b7afbbed6100 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:31.963481 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b8e5c06-0340-4ed0-969f-b7afbbed6100 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:31.963936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b8e5c06-0340-4ed0-969f-b7afbbed6100 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:31.964359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-3b8e5c06-0340-4ed0-969f-b7afbbed6100 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:32.100121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-3b8e5c06-0340-4ed0-969f-b7afbbed6100 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:32.108663 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-3b8e5c06-0340-4ed0-969f-b7afbbed6100 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1576 microversion: 2.1 time: 0.158637 Oct 11 00:57:32.109561 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3671/7994] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:31 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:32.115770 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-410c2c4c-5e9c-42c5-9ac7-4e827debc782 req-aa508290-a2eb-43b0-a902-10275e53e5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a2ea3f-6d48-400b-8a14-2ef629a4155b", "name": "network-vif-plugged", "status": "completed", "tag": "e91f4477-d3be-411a-874c-4362c0bdae8f"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:57:32.127210 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-410c2c4c-5e9c-42c5-9ac7-4e827debc782 req-aa508290-a2eb-43b0-a902-10275e53e5c2 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:32.127715 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-410c2c4c-5e9c-42c5-9ac7-4e827debc782 req-aa508290-a2eb-43b0-a902-10275e53e5c2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:32.128174 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-410c2c4c-5e9c-42c5-9ac7-4e827debc782 req-aa508290-a2eb-43b0-a902-10275e53e5c2 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:32.140679 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-410c2c4c-5e9c-42c5-9ac7-4e827debc782 req-aa508290-a2eb-43b0-a902-10275e53e5c2 service nova] Creating event network-vif-plugged:e91f4477-d3be-411a-874c-4362c0bdae8f for instance c9a2ea3f-6d48-400b-8a14-2ef629a4155b on n-h1-860864-2 Oct 11 00:57:32.145942 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-410c2c4c-5e9c-42c5-9ac7-4e827debc782 req-aa508290-a2eb-43b0-a902-10275e53e5c2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034874 Oct 11 00:57:32.146554 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4324/7995] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:57:33.132942 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5c7d9786-9459-4ac3-9eac-ba278c8c1f09 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:33.133600 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5c7d9786-9459-4ac3-9eac-ba278c8c1f09 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:33.140532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c7d9786-9459-4ac3-9eac-ba278c8c1f09 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:33.141039 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c7d9786-9459-4ac3-9eac-ba278c8c1f09 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:33.141510 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c7d9786-9459-4ac3-9eac-ba278c8c1f09 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:33.142214 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c7d9786-9459-4ac3-9eac-ba278c8c1f09 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:33.142701 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c7d9786-9459-4ac3-9eac-ba278c8c1f09 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:33.143134 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5c7d9786-9459-4ac3-9eac-ba278c8c1f09 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:33.281181 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5c7d9786-9459-4ac3-9eac-ba278c8c1f09 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:33.289728 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5c7d9786-9459-4ac3-9eac-ba278c8c1f09 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1576 microversion: 2.1 time: 0.161372 Oct 11 00:57:33.290407 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3672/7996] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:33 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:57:34.316894 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-27719750-2eb2-47dd-bc28-2a428988b863 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:57:34.318251 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-27719750-2eb2-47dd-bc28-2a428988b863 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:57:34.324509 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27719750-2eb2-47dd-bc28-2a428988b863 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:34.325017 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27719750-2eb2-47dd-bc28-2a428988b863 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:34.325504 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27719750-2eb2-47dd-bc28-2a428988b863 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:34.326214 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27719750-2eb2-47dd-bc28-2a428988b863 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:57:34.326688 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27719750-2eb2-47dd-bc28-2a428988b863 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:57:34.327133 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-27719750-2eb2-47dd-bc28-2a428988b863 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:57:34.463241 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-27719750-2eb2-47dd-bc28-2a428988b863 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:57:34.471214 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-27719750-2eb2-47dd-bc28-2a428988b863 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1563 microversion: 2.1 time: 0.159799 Oct 11 00:57:34.471793 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4325/7997] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:57:34 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:58:48.378873 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=7 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:58:48.379637 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=23 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:58:48.380495 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:58:48.384255 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=7 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:58:48.385075 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=19 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:58:48.386239 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 00:58:48.386384 n-d-860864-2 devstack@n-api.service[120613]: Tue Oct 11 00:58:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 11 00:58:48.387221 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 00:58:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b (ip 10.222.0.23) !!! Oct 11 00:58:48.393231 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-8050601f-e8a8-49ce-a096-efd41314b0d0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:58:48.393766 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8050601f-e8a8-49ce-a096-efd41314b0d0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:58:48.402771 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8050601f-e8a8-49ce-a096-efd41314b0d0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:58:48.403266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8050601f-e8a8-49ce-a096-efd41314b0d0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:58:48.403706 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8050601f-e8a8-49ce-a096-efd41314b0d0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:58:48.404258 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-4e65a52d-d35b-497b-a3f3-bb51e96f449f req-018c54bf-d3da-4b58-97c8-9a2d70d0d114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9a2ea3f-6d48-400b-8a14-2ef629a4155b", "tag": "e91f4477-d3be-411a-874c-4362c0bdae8f"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:58:48.404485 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8050601f-e8a8-49ce-a096-efd41314b0d0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:58:48.404945 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8050601f-e8a8-49ce-a096-efd41314b0d0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:58:48.405392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-8050601f-e8a8-49ce-a096-efd41314b0d0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:58:48.420260 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4e65a52d-d35b-497b-a3f3-bb51e96f449f req-018c54bf-d3da-4b58-97c8-9a2d70d0d114 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:58:48.420893 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4e65a52d-d35b-497b-a3f3-bb51e96f449f req-018c54bf-d3da-4b58-97c8-9a2d70d0d114 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:58:48.421576 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-4e65a52d-d35b-497b-a3f3-bb51e96f449f req-018c54bf-d3da-4b58-97c8-9a2d70d0d114 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:58:48.435276 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-8050601f-e8a8-49ce-a096-efd41314b0d0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Going to try to terminate instance {{(pid=120614) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 00:58:48.435561 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-4e65a52d-d35b-497b-a3f3-bb51e96f449f req-018c54bf-d3da-4b58-97c8-9a2d70d0d114 service nova] Creating event network-changed:e91f4477-d3be-411a-874c-4362c0bdae8f for instance c9a2ea3f-6d48-400b-8a14-2ef629a4155b on n-h1-860864-2 Oct 11 00:58:48.441738 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-4e65a52d-d35b-497b-a3f3-bb51e96f449f req-018c54bf-d3da-4b58-97c8-9a2d70d0d114 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059127 Oct 11 00:58:48.443121 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4326/7998] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:58:48.531714 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-8050601f-e8a8-49ce-a096-efd41314b0d0 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 204 len: 0 microversion: 2.1 time: 0.153777 Oct 11 00:58:48.532927 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3673/7999] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 00:58:48 2022] DELETE /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 00:58:48.542170 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5502beb8-4c30-477e-9106-091d5e456a53 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:58:48.543134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5502beb8-4c30-477e-9106-091d5e456a53 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:58:48.549675 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5502beb8-4c30-477e-9106-091d5e456a53 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:58:48.550287 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5502beb8-4c30-477e-9106-091d5e456a53 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:58:48.550813 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5502beb8-4c30-477e-9106-091d5e456a53 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:58:48.551644 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5502beb8-4c30-477e-9106-091d5e456a53 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:58:48.552190 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5502beb8-4c30-477e-9106-091d5e456a53 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:58:48.553318 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5502beb8-4c30-477e-9106-091d5e456a53 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:58:48.696393 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5502beb8-4c30-477e-9106-091d5e456a53 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:58:48.704775 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5502beb8-4c30-477e-9106-091d5e456a53 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1569 microversion: 2.1 time: 0.167518 Oct 11 00:58:48.705367 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4327/8000] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:58:48 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:58:49.729725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e99c79ee-c45f-4be2-afa5-c64e64665923 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:58:49.730433 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e99c79ee-c45f-4be2-afa5-c64e64665923 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:58:49.738634 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e99c79ee-c45f-4be2-afa5-c64e64665923 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:58:49.739165 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e99c79ee-c45f-4be2-afa5-c64e64665923 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:58:49.739609 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e99c79ee-c45f-4be2-afa5-c64e64665923 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:58:49.740463 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e99c79ee-c45f-4be2-afa5-c64e64665923 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:58:49.741159 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e99c79ee-c45f-4be2-afa5-c64e64665923 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:58:49.741753 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e99c79ee-c45f-4be2-afa5-c64e64665923 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:58:49.887029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e99c79ee-c45f-4be2-afa5-c64e64665923 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:58:49.894902 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e99c79ee-c45f-4be2-afa5-c64e64665923 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1569 microversion: 2.1 time: 0.170431 Oct 11 00:58:49.895491 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3674/8001] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:58:49 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:58:50.629568 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-dc3cf841-0b42-4dd6-ad83-bb1e2ed0636f req-2d4cb0b2-4b66-486e-aea7-de743e247d7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a2ea3f-6d48-400b-8a14-2ef629a4155b", "name": "network-vif-deleted", "tag": "e91f4477-d3be-411a-874c-4362c0bdae8f"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:58:50.640650 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-dc3cf841-0b42-4dd6-ad83-bb1e2ed0636f req-2d4cb0b2-4b66-486e-aea7-de743e247d7f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:58:50.641199 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-dc3cf841-0b42-4dd6-ad83-bb1e2ed0636f req-2d4cb0b2-4b66-486e-aea7-de743e247d7f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:58:50.641690 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-dc3cf841-0b42-4dd6-ad83-bb1e2ed0636f req-2d4cb0b2-4b66-486e-aea7-de743e247d7f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:58:50.655879 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-dc3cf841-0b42-4dd6-ad83-bb1e2ed0636f req-2d4cb0b2-4b66-486e-aea7-de743e247d7f service nova] Creating event network-vif-deleted:e91f4477-d3be-411a-874c-4362c0bdae8f for instance c9a2ea3f-6d48-400b-8a14-2ef629a4155b on n-h1-860864-2 Oct 11 00:58:50.660929 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-dc3cf841-0b42-4dd6-ad83-bb1e2ed0636f req-2d4cb0b2-4b66-486e-aea7-de743e247d7f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035251 Oct 11 00:58:50.661575 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4328/8002] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:58:50.918781 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-5cfd1ecc-f160-4b8d-9757-b7404bc7d1eb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:58:50.919553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-5cfd1ecc-f160-4b8d-9757-b7404bc7d1eb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:58:50.927264 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5cfd1ecc-f160-4b8d-9757-b7404bc7d1eb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:58:50.928497 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5cfd1ecc-f160-4b8d-9757-b7404bc7d1eb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:58:50.929021 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5cfd1ecc-f160-4b8d-9757-b7404bc7d1eb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:58:50.929853 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5cfd1ecc-f160-4b8d-9757-b7404bc7d1eb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:58:50.930378 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5cfd1ecc-f160-4b8d-9757-b7404bc7d1eb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:58:50.930876 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-5cfd1ecc-f160-4b8d-9757-b7404bc7d1eb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:58:51.005569 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-5cfd1ecc-f160-4b8d-9757-b7404bc7d1eb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:58:51.015558 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-5cfd1ecc-f160-4b8d-9757-b7404bc7d1eb tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1220 microversion: 2.1 time: 0.100663 Oct 11 00:58:51.016380 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3675/8003] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:58:50 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:58:52.042422 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-40281021-fc69-48a7-8d95-010132d91a6e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:58:52.043153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-40281021-fc69-48a7-8d95-010132d91a6e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:58:52.050261 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40281021-fc69-48a7-8d95-010132d91a6e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:58:52.050773 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40281021-fc69-48a7-8d95-010132d91a6e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:58:52.051226 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40281021-fc69-48a7-8d95-010132d91a6e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:58:52.051966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40281021-fc69-48a7-8d95-010132d91a6e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:58:52.052468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40281021-fc69-48a7-8d95-010132d91a6e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:58:52.053397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40281021-fc69-48a7-8d95-010132d91a6e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:58:52.124549 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-40281021-fc69-48a7-8d95-010132d91a6e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:58:52.134821 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-40281021-fc69-48a7-8d95-010132d91a6e tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1220 microversion: 2.1 time: 0.098286 Oct 11 00:58:52.135453 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4329/8004] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:58:52 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:58:53.161220 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-eea9ed4f-1f38-4ef4-b6ba-1109295278f2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:58:53.162653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-eea9ed4f-1f38-4ef4-b6ba-1109295278f2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:58:53.172196 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eea9ed4f-1f38-4ef4-b6ba-1109295278f2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:58:53.172729 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eea9ed4f-1f38-4ef4-b6ba-1109295278f2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:58:53.173187 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eea9ed4f-1f38-4ef4-b6ba-1109295278f2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:58:53.174430 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eea9ed4f-1f38-4ef4-b6ba-1109295278f2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:58:53.174897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eea9ed4f-1f38-4ef4-b6ba-1109295278f2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:58:53.175343 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-eea9ed4f-1f38-4ef4-b6ba-1109295278f2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:58:53.257209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-eea9ed4f-1f38-4ef4-b6ba-1109295278f2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:58:53.266574 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-eea9ed4f-1f38-4ef4-b6ba-1109295278f2 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1220 microversion: 2.1 time: 0.110542 Oct 11 00:58:53.267184 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3676/8005] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:58:53 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1220 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:58:54.290879 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a8824058-e46a-4598-9fb9-f9a27a73a572 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:58:54.291514 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a8824058-e46a-4598-9fb9-f9a27a73a572 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:58:54.298480 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8824058-e46a-4598-9fb9-f9a27a73a572 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:58:54.298984 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8824058-e46a-4598-9fb9-f9a27a73a572 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:58:54.299436 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8824058-e46a-4598-9fb9-f9a27a73a572 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:58:54.300159 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8824058-e46a-4598-9fb9-f9a27a73a572 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:58:54.300657 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8824058-e46a-4598-9fb9-f9a27a73a572 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:58:54.301101 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a8824058-e46a-4598-9fb9-f9a27a73a572 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:58:54.365791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a8824058-e46a-4598-9fb9-f9a27a73a572 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:58:54.374149 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a8824058-e46a-4598-9fb9-f9a27a73a572 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1220 microversion: 2.1 time: 0.087808 Oct 11 00:58:54.374742 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4330/8006] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:58:54 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:58:55.398284 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-a52d0d3d-a6c1-4c87-a1be-1a1f77ef454d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:58:55.399128 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-a52d0d3d-a6c1-4c87-a1be-1a1f77ef454d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:58:55.406271 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a52d0d3d-a6c1-4c87-a1be-1a1f77ef454d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:58:55.406762 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a52d0d3d-a6c1-4c87-a1be-1a1f77ef454d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:58:55.407204 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a52d0d3d-a6c1-4c87-a1be-1a1f77ef454d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:58:55.407903 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a52d0d3d-a6c1-4c87-a1be-1a1f77ef454d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:58:55.408359 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a52d0d3d-a6c1-4c87-a1be-1a1f77ef454d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:58:55.408812 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a52d0d3d-a6c1-4c87-a1be-1a1f77ef454d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:58:55.442562 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a52d0d3d-a6c1-4c87-a1be-1a1f77ef454d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:58:55.443067 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a52d0d3d-a6c1-4c87-a1be-1a1f77ef454d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:58:55.443541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-a52d0d3d-a6c1-4c87-a1be-1a1f77ef454d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:58:55.444117 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.objects.instance [None req-a52d0d3d-a6c1-4c87-a1be-1a1f77ef454d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lazy-loading 'fault' on Instance uuid c9a2ea3f-6d48-400b-8a14-2ef629a4155b {{(pid=120614) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 00:58:55.488501 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-a52d0d3d-a6c1-4c87-a1be-1a1f77ef454d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d0446d98f43fba827fd2731b49a45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c56bef58d3426b8b9f10433063ec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:58:55.497599 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-a52d0d3d-a6c1-4c87-a1be-1a1f77ef454d tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 200 len: 1225 microversion: 2.1 time: 0.103258 Oct 11 00:58:55.498182 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3677/8007] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:58:55 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:58:56.520242 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c511ae91-fc0b-4447-85be-e9e28cbe43e5 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:58:56.520989 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c511ae91-fc0b-4447-85be-e9e28cbe43e5 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] [instance: c9a2ea3f-6d48-400b-8a14-2ef629a4155b] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:58:56.528902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c511ae91-fc0b-4447-85be-e9e28cbe43e5 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:58:56.529433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c511ae91-fc0b-4447-85be-e9e28cbe43e5 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:58:56.529892 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c511ae91-fc0b-4447-85be-e9e28cbe43e5 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:58:56.530614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c511ae91-fc0b-4447-85be-e9e28cbe43e5 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:58:56.531081 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c511ae91-fc0b-4447-85be-e9e28cbe43e5 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:58:56.531523 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c511ae91-fc0b-4447-85be-e9e28cbe43e5 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:58:56.546660 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-c511ae91-fc0b-4447-85be-e9e28cbe43e5 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] HTTP exception thrown: Instance c9a2ea3f-6d48-400b-8a14-2ef629a4155b could not be found. Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c511ae91-fc0b-4447-85be-e9e28cbe43e5 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Request method failure captured: Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b HTTP/1.1 Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRL1mB-7u78IRhfxFgoxQJdekZzN6NrapHC0GuxU1tNmmGFTc3gqMcqMIdRft7jlWzEWeo6xluHWAdusfl1KB6euFX2Olq5ue9njzkc_LM3uLqzp2YC5rPJ96CMXHRxF10fIdm4qqZuAfjNPR_naixT23Tfeb6b0XQIwgIt-g9PPsOSc Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 07c56bef58d3426b8b9f10433063ec54 Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestShelveInstance-1719244884 Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/07c56bef58d3426b8b9f10433063ec54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/07c56bef58d3426b8b9f10433063ec54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/07c56bef58d3426b8b9f10433063ec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_07c56bef58d3426b8b9f10433063ec54", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestShelveInstance-1719244884 Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 07c56bef58d3426b8b9f10433063ec54 Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestShelveInstance-1719244884 Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestShelveInstance-1719244884-project Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: 719d0446d98f43fba827fd2731b49a45 Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestShelveInstance-1719244884-project Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance c9a2ea3f-6d48-400b-8a14-2ef629a4155b could not be found. Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'c9a2ea3f-6d48-400b-8a14-2ef629a4155b'} Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9a2ea3f-6d48-400b-8a14-2ef629a4155b could not be found. Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9a2ea3f-6d48-400b-8a14-2ef629a4155b could not be found. Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 00:58:56.548363 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:58:56.553584 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 00:58:56.553584 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 00:58:56.553584 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 00:58:56.553584 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 00:58:56.553584 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 00:58:56.553584 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9a2ea3f-6d48-400b-8a14-2ef629a4155b could not be found. Oct 11 00:58:56.553584 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 00:58:56.553584 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c511ae91-fc0b-4447-85be-e9e28cbe43e5 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Returning 404 to user: Instance c9a2ea3f-6d48-400b-8a14-2ef629a4155b could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 00:58:56.553584 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c511ae91-fc0b-4447-85be-e9e28cbe43e5 tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b" status: 404 len: 111 microversion: 2.1 time: 0.033506 Oct 11 00:58:56.553584 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4331/8008] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:58:56 2022] GET /compute/v2.1/servers/c9a2ea3f-6d48-400b-8a14-2ef629a4155b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 00:58:56.720613 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-76206445-f12a-4546-bf90-1bb0f1c3bcae tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] Calling method '.version_select at 0x7f662a818790>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:58:56.756309 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-76206445-f12a-4546-bf90-1bb0f1c3bcae tempest-TestShelveInstance-1719244884 tempest-TestShelveInstance-1719244884-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2057159074" status: 202 len: 0 microversion: 2.1 time: 0.040301 Oct 11 00:58:56.758035 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3678/8009] 10.222.0.23 () {58 vars in 1254 bytes} [Tue Oct 11 00:58:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2057159074 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 00:59:15.264517 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=12 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:59:15.265295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=24 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:59:15.496415 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0bb35f2c-5117-4651-91aa-a6e85292372f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Action: 'create', calling method: .version_select at 0x7f662a5c4040>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-273602832", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyrWl6tWRDO2adIu/XE2clCfSUmT24DzHXeq75wLbfRuQtzVgka02iU8LydS9K6CrHsMVXhKM4gadn8FGGt5/4D/s2f0Lsa991GoGTEQxKBk/2y0MzFCHh1wzH4iDrcBA=="}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:59:15.515741 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-0bb35f2c-5117-4651-91aa-a6e85292372f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Getting quotas for project 1e40a46f67db43b18e260b299f689874. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:59:15.522670 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-0bb35f2c-5117-4651-91aa-a6e85292372f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Getting quotas for user b687a63ff37940d0989110af8f7d448f and project 1e40a46f67db43b18e260b299f689874. Resources: {'key_pairs'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:59:15.560312 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0bb35f2c-5117-4651-91aa-a6e85292372f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.300929 Oct 11 00:59:15.561266 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4332/8010] 10.222.0.23 () {60 vars in 1159 bytes} [Tue Oct 11 00:59:15 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:59:16.634189 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ddf30208-81d9-49e0-a520-b40130bea60b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-829447231", "imageRef": "70c986fa-2f30-4b1e-8ea0-fb6ffa975889", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-273602832", "security_groups": [{"name": "tempest-secgroup-smoke-1156352095"}], "networks": [{"uuid": "3fea53cd-7523-43ed-af66-a513f419c25b"}]}} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:59:16.644192 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:59:16.644836 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:59:16.747879 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.network.neutron [None req-ddf30208-81d9-49e0-a520-b40130bea60b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] validate_networks() for [('3fea53cd-7523-43ed-af66-a513f419c25b', None, None, None, None, None)] {{(pid=120614) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 00:59:17.305295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ddf30208-81d9-49e0-a520-b40130bea60b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Flavor limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 00:59:17.305850 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ddf30208-81d9-49e0-a520-b40130bea60b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Image limits 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 00:59:17.306345 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ddf30208-81d9-49e0-a520-b40130bea60b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Flavor pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 00:59:17.306765 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ddf30208-81d9-49e0-a520-b40130bea60b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Image pref 0:0:0 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 00:59:17.307188 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.virt.hardware [None req-ddf30208-81d9-49e0-a520-b40130bea60b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120614) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 00:59:17.316474 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddf30208-81d9-49e0-a520-b40130bea60b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:17.316960 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddf30208-81d9-49e0-a520-b40130bea60b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:17.317439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddf30208-81d9-49e0-a520-b40130bea60b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:17.318405 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddf30208-81d9-49e0-a520-b40130bea60b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:17.318848 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddf30208-81d9-49e0-a520-b40130bea60b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:17.319279 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ddf30208-81d9-49e0-a520-b40130bea60b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:17.337767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ddf30208-81d9-49e0-a520-b40130bea60b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Getting quotas for project 1e40a46f67db43b18e260b299f689874. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 00:59:17.343147 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.quota [None req-ddf30208-81d9-49e0-a520-b40130bea60b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Getting quotas for user b687a63ff37940d0989110af8f7d448f and project 1e40a46f67db43b18e260b299f689874. Resources: {'cores', 'instances', 'ram'} {{(pid=120614) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 00:59:17.356451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ddf30208-81d9-49e0-a520-b40130bea60b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Going to run 1 instances... {{(pid=120614) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 00:59:17.358834 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ddf30208-81d9-49e0-a520-b40130bea60b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c986fa-2f30-4b1e-8ea0-fb6ffa975889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120614) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 00:59:17.407947 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ddf30208-81d9-49e0-a520-b40130bea60b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.778036 Oct 11 00:59:17.409088 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3679/8011] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 00:59:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 00:59:17.421757 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0ba28f74-b702-461b-8530-7ffa88c0e5d7 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:59:17.433732 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0ba28f74-b702-461b-8530-7ffa88c0e5d7 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:59:17.531674 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0ba28f74-b702-461b-8530-7ffa88c0e5d7 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:59:17.541321 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0ba28f74-b702-461b-8530-7ffa88c0e5d7 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f" status: 200 len: 1247 microversion: 2.1 time: 0.124012 Oct 11 00:59:17.542308 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4333/8012] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:59:17 2022] GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f => generated 1247 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:59:18.565874 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-327baed6-44b6-4a59-99d8-8a822aaa2ad3 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:59:18.566665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-327baed6-44b6-4a59-99d8-8a822aaa2ad3 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:59:18.580767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-327baed6-44b6-4a59-99d8-8a822aaa2ad3 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:18.581946 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-327baed6-44b6-4a59-99d8-8a822aaa2ad3 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:18.582685 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-327baed6-44b6-4a59-99d8-8a822aaa2ad3 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:18.585344 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-327baed6-44b6-4a59-99d8-8a822aaa2ad3 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:18.586166 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-327baed6-44b6-4a59-99d8-8a822aaa2ad3 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:18.587395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-327baed6-44b6-4a59-99d8-8a822aaa2ad3 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:18.793369 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-327baed6-44b6-4a59-99d8-8a822aaa2ad3 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:59:18.819541 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-327baed6-44b6-4a59-99d8-8a822aaa2ad3 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f" status: 200 len: 1307 microversion: 2.1 time: 0.259075 Oct 11 00:59:18.823072 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3680/8013] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:59:18 2022] GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f => generated 1307 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:59:19.851139 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-10138cb0-46a6-49fe-a87e-b4735ccb205f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:59:19.851775 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-10138cb0-46a6-49fe-a87e-b4735ccb205f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:59:19.859408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10138cb0-46a6-49fe-a87e-b4735ccb205f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:19.860228 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10138cb0-46a6-49fe-a87e-b4735ccb205f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:19.860689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10138cb0-46a6-49fe-a87e-b4735ccb205f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:19.861445 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10138cb0-46a6-49fe-a87e-b4735ccb205f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:19.862096 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10138cb0-46a6-49fe-a87e-b4735ccb205f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:19.862545 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-10138cb0-46a6-49fe-a87e-b4735ccb205f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:20.126126 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-10138cb0-46a6-49fe-a87e-b4735ccb205f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:59:20.134111 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-10138cb0-46a6-49fe-a87e-b4735ccb205f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f" status: 200 len: 1373 microversion: 2.1 time: 0.287035 Oct 11 00:59:20.134702 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4334/8014] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:59:19 2022] GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f => generated 1373 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 00:59:20.616691 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-075e0269-a8a5-4caf-bb5e-8e1eadf60289 req-67a1a83d-42e5-4eea-8015-c691856e3a34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f", "tag": "5224a792-33f5-4505-a116-14d7a434c8bc"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:59:20.628341 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-075e0269-a8a5-4caf-bb5e-8e1eadf60289 req-67a1a83d-42e5-4eea-8015-c691856e3a34 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:20.629145 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-075e0269-a8a5-4caf-bb5e-8e1eadf60289 req-67a1a83d-42e5-4eea-8015-c691856e3a34 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:20.629860 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-075e0269-a8a5-4caf-bb5e-8e1eadf60289 req-67a1a83d-42e5-4eea-8015-c691856e3a34 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:20.648433 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-075e0269-a8a5-4caf-bb5e-8e1eadf60289 req-67a1a83d-42e5-4eea-8015-c691856e3a34 service nova] Creating event network-changed:5224a792-33f5-4505-a116-14d7a434c8bc for instance e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f on n-h1-860864-2 Oct 11 00:59:20.654872 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-075e0269-a8a5-4caf-bb5e-8e1eadf60289 req-67a1a83d-42e5-4eea-8015-c691856e3a34 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042425 Oct 11 00:59:20.656196 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3681/8015] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:59:21.158408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-f538541b-c6d1-49a5-ab8b-b032d821ae6b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:59:21.159763 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-f538541b-c6d1-49a5-ab8b-b032d821ae6b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:59:21.171824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f538541b-c6d1-49a5-ab8b-b032d821ae6b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:21.172791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f538541b-c6d1-49a5-ab8b-b032d821ae6b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:21.181239 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f538541b-c6d1-49a5-ab8b-b032d821ae6b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:21.182543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f538541b-c6d1-49a5-ab8b-b032d821ae6b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:21.183114 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f538541b-c6d1-49a5-ab8b-b032d821ae6b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:21.185855 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-f538541b-c6d1-49a5-ab8b-b032d821ae6b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:21.332917 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-f538541b-c6d1-49a5-ab8b-b032d821ae6b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:59:21.343882 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-f538541b-c6d1-49a5-ab8b-b032d821ae6b tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f" status: 200 len: 1373 microversion: 2.1 time: 0.190702 Oct 11 00:59:21.344478 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4335/8016] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:59:21 2022] GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f => generated 1373 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:59:22.370627 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-53d54255-9f3e-4989-a2d9-8428083334cf tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:59:22.371340 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-53d54255-9f3e-4989-a2d9-8428083334cf tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:59:22.377553 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53d54255-9f3e-4989-a2d9-8428083334cf tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:22.378041 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53d54255-9f3e-4989-a2d9-8428083334cf tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:22.378484 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53d54255-9f3e-4989-a2d9-8428083334cf tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:22.379170 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53d54255-9f3e-4989-a2d9-8428083334cf tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:22.379625 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53d54255-9f3e-4989-a2d9-8428083334cf tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:22.380537 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-53d54255-9f3e-4989-a2d9-8428083334cf tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:22.517712 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-53d54255-9f3e-4989-a2d9-8428083334cf tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:59:22.526206 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-53d54255-9f3e-4989-a2d9-8428083334cf tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f" status: 200 len: 1373 microversion: 2.1 time: 0.162433 Oct 11 00:59:22.526790 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3682/8017] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:59:22 2022] GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:59:23.550042 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7e19f6c0-e206-4dcd-a2a8-54dba2a30122 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:59:23.550711 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7e19f6c0-e206-4dcd-a2a8-54dba2a30122 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:59:23.557927 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e19f6c0-e206-4dcd-a2a8-54dba2a30122 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:23.558435 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e19f6c0-e206-4dcd-a2a8-54dba2a30122 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:23.558886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e19f6c0-e206-4dcd-a2a8-54dba2a30122 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:23.559614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e19f6c0-e206-4dcd-a2a8-54dba2a30122 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:23.560095 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e19f6c0-e206-4dcd-a2a8-54dba2a30122 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:23.560540 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7e19f6c0-e206-4dcd-a2a8-54dba2a30122 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:23.703564 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7e19f6c0-e206-4dcd-a2a8-54dba2a30122 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:59:23.712178 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7e19f6c0-e206-4dcd-a2a8-54dba2a30122 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f" status: 200 len: 1373 microversion: 2.1 time: 0.166237 Oct 11 00:59:23.712808 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4336/8018] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:59:23 2022] GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:59:24.734793 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-06788dbb-6d33-4acf-b80d-421dda230b93 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:59:24.735432 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-06788dbb-6d33-4acf-b80d-421dda230b93 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:59:24.742736 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06788dbb-6d33-4acf-b80d-421dda230b93 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:24.743241 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06788dbb-6d33-4acf-b80d-421dda230b93 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:24.743688 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06788dbb-6d33-4acf-b80d-421dda230b93 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:24.744392 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06788dbb-6d33-4acf-b80d-421dda230b93 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:24.744880 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06788dbb-6d33-4acf-b80d-421dda230b93 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:24.745313 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-06788dbb-6d33-4acf-b80d-421dda230b93 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:24.910149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-06788dbb-6d33-4acf-b80d-421dda230b93 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:59:24.918750 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-06788dbb-6d33-4acf-b80d-421dda230b93 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f" status: 200 len: 1373 microversion: 2.1 time: 0.187916 Oct 11 00:59:24.919261 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3683/8019] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:59:24 2022] GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f => generated 1373 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:59:25.943371 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a3664452-6913-48cb-a2e1-ecfb6e8d1c57 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:59:25.943996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a3664452-6913-48cb-a2e1-ecfb6e8d1c57 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:59:25.951049 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3664452-6913-48cb-a2e1-ecfb6e8d1c57 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:25.951636 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3664452-6913-48cb-a2e1-ecfb6e8d1c57 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:25.952089 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3664452-6913-48cb-a2e1-ecfb6e8d1c57 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:25.952799 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3664452-6913-48cb-a2e1-ecfb6e8d1c57 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:25.953267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3664452-6913-48cb-a2e1-ecfb6e8d1c57 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:25.953729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a3664452-6913-48cb-a2e1-ecfb6e8d1c57 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:26.098734 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-a3664452-6913-48cb-a2e1-ecfb6e8d1c57 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:59:26.111063 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a3664452-6913-48cb-a2e1-ecfb6e8d1c57 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f" status: 200 len: 1373 microversion: 2.1 time: 0.172372 Oct 11 00:59:26.111675 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4337/8020] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:59:25 2022] GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:59:26.760232 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-955d4d73-add4-4deb-a70f-a95b758c04e9 req-90880ed7-25ae-45e5-86be-99b5b8b155b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f", "name": "network-vif-plugged", "status": "completed", "tag": "5224a792-33f5-4505-a116-14d7a434c8bc"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:59:26.773309 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-955d4d73-add4-4deb-a70f-a95b758c04e9 req-90880ed7-25ae-45e5-86be-99b5b8b155b9 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:26.773813 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-955d4d73-add4-4deb-a70f-a95b758c04e9 req-90880ed7-25ae-45e5-86be-99b5b8b155b9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:26.774242 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-955d4d73-add4-4deb-a70f-a95b758c04e9 req-90880ed7-25ae-45e5-86be-99b5b8b155b9 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:26.786198 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-955d4d73-add4-4deb-a70f-a95b758c04e9 req-90880ed7-25ae-45e5-86be-99b5b8b155b9 service nova] Creating event network-vif-plugged:5224a792-33f5-4505-a116-14d7a434c8bc for instance e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f on n-h1-860864-2 Oct 11 00:59:26.792383 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-955d4d73-add4-4deb-a70f-a95b758c04e9 req-90880ed7-25ae-45e5-86be-99b5b8b155b9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037627 Oct 11 00:59:26.793333 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3684/8021] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 00:59:27.135801 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-5a4f20a6-fdf3-44a3-87f9-3a475ac2537d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:59:27.136441 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-5a4f20a6-fdf3-44a3-87f9-3a475ac2537d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:59:27.143556 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a4f20a6-fdf3-44a3-87f9-3a475ac2537d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:27.144063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a4f20a6-fdf3-44a3-87f9-3a475ac2537d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:27.144455 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a4f20a6-fdf3-44a3-87f9-3a475ac2537d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:27.146397 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a4f20a6-fdf3-44a3-87f9-3a475ac2537d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:27.146910 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a4f20a6-fdf3-44a3-87f9-3a475ac2537d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:27.147357 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-5a4f20a6-fdf3-44a3-87f9-3a475ac2537d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:27.288513 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-5a4f20a6-fdf3-44a3-87f9-3a475ac2537d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:59:27.296366 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-5a4f20a6-fdf3-44a3-87f9-3a475ac2537d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f" status: 200 len: 1373 microversion: 2.1 time: 0.165251 Oct 11 00:59:27.296938 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4338/8022] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:59:27 2022] GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:59:28.316434 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:59:28.317250 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=6 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:59:28.322951 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-83b24642-646b-4da1-9967-44a98a6187b8 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:59:28.323665 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-83b24642-646b-4da1-9967-44a98a6187b8 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:59:28.330838 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83b24642-646b-4da1-9967-44a98a6187b8 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:28.331329 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83b24642-646b-4da1-9967-44a98a6187b8 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:28.331767 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83b24642-646b-4da1-9967-44a98a6187b8 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:28.332541 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83b24642-646b-4da1-9967-44a98a6187b8 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:28.332997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83b24642-646b-4da1-9967-44a98a6187b8 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:28.333733 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-83b24642-646b-4da1-9967-44a98a6187b8 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:28.473294 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-83b24642-646b-4da1-9967-44a98a6187b8 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:59:28.482089 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-83b24642-646b-4da1-9967-44a98a6187b8 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f" status: 200 len: 1557 microversion: 2.1 time: 0.166861 Oct 11 00:59:28.482704 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3685/8023] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:59:28 2022] GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:59:28.505006 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-8efc8804-f38f-4d0f-b4aa-076040429c4d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 00:59:28.505698 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-8efc8804-f38f-4d0f-b4aa-076040429c4d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 00:59:28.507727 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 00:59:28.513295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8efc8804-f38f-4d0f-b4aa-076040429c4d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:28.515379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8efc8804-f38f-4d0f-b4aa-076040429c4d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:28.515379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8efc8804-f38f-4d0f-b4aa-076040429c4d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:28.515379 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8efc8804-f38f-4d0f-b4aa-076040429c4d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:28.515728 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8efc8804-f38f-4d0f-b4aa-076040429c4d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:28.516027 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-8efc8804-f38f-4d0f-b4aa-076040429c4d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:28.653189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-8efc8804-f38f-4d0f-b4aa-076040429c4d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 00:59:28.662127 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-8efc8804-f38f-4d0f-b4aa-076040429c4d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f" status: 200 len: 1557 microversion: 2.1 time: 0.160402 Oct 11 00:59:28.662850 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4339/8024] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 00:59:28 2022] GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 00:59:30.461970 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-6df07f25-9da0-44d3-972c-fad0a1231b11 req-45c36abc-433c-47c1-879c-92878c31dfbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f", "tag": "5224a792-33f5-4505-a116-14d7a434c8bc"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 00:59:30.472323 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6df07f25-9da0-44d3-972c-fad0a1231b11 req-45c36abc-433c-47c1-879c-92878c31dfbb service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 00:59:30.472809 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6df07f25-9da0-44d3-972c-fad0a1231b11 req-45c36abc-433c-47c1-879c-92878c31dfbb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 00:59:30.473621 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6df07f25-9da0-44d3-972c-fad0a1231b11 req-45c36abc-433c-47c1-879c-92878c31dfbb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 00:59:30.485777 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-6df07f25-9da0-44d3-972c-fad0a1231b11 req-45c36abc-433c-47c1-879c-92878c31dfbb service nova] Creating event network-changed:5224a792-33f5-4505-a116-14d7a434c8bc for instance e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f on n-h1-860864-2 Oct 11 00:59:30.493811 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-6df07f25-9da0-44d3-972c-fad0a1231b11 req-45c36abc-433c-47c1-879c-92878c31dfbb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035916 Oct 11 00:59:30.494465 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3686/8025] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 00:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:02:07.305961 n-d-860864-2 devstack@n-api.service[120613]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dded55a6-8973-44c5-bba8-4440254057cd] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 01:02:07.306897 n-d-860864-2 devstack@n-api.service[120613]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9b2b028e-60c1-4dc3-ac1e-06905f87835c] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 01:02:07.307694 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:02:07.308705 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=36 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:02:07.309583 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 01:02:07.309766 n-d-860864-2 devstack@n-api.service[120613]: Tue Oct 11 01:02:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f/action (ip 10.222.0.23) !!! Oct 11 01:02:07.310884 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 01:02:07.311142 n-d-860864-2 devstack@n-api.service[120613]: Tue Oct 11 01:02:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f/action (ip 10.222.0.23) !!! Oct 11 01:02:07.312349 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 01:02:07.312480 n-d-860864-2 devstack@n-api.service[120613]: Tue Oct 11 01:02:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f/action (ip 10.222.0.23) !!! Oct 11 01:02:07.318408 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-3b014815-8060-488b-a974-07fd36b847ed tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-187132333"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:02:07.320720 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-3b014815-8060-488b-a974-07fd36b847ed tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:02:07.333839 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b014815-8060-488b-a974-07fd36b847ed tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:07.334340 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b014815-8060-488b-a974-07fd36b847ed tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:07.334852 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b014815-8060-488b-a974-07fd36b847ed tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:07.335569 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b014815-8060-488b-a974-07fd36b847ed tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:07.336045 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b014815-8060-488b-a974-07fd36b847ed tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:07.336487 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-3b014815-8060-488b-a974-07fd36b847ed tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:07.679907 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-3b014815-8060-488b-a974-07fd36b847ed tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "POST /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f/action" status: 202 len: 0 microversion: 2.1 time: 0.373807 Oct 11 01:02:07.679907 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4340/8026] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 01:02:07 2022] POST /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 01:02:15.526154 n-d-860864-2 devstack@n-api.service[120614]: ERROR oslo.messaging._drivers.impl_rabbit [-] [31233ac2-692f-4d5e-84d4-7551eaa91acd] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 01:02:15.527268 n-d-860864-2 devstack@n-api.service[120614]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0f2d80e9-f410-4772-8046-431e3c70ceb3] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 01:02:15.527931 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:02:15.528902 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=32 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:02:15.530150 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 01:02:15.530327 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 01:02:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 11 01:02:15.533080 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 01:02:15.533230 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 01:02:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 11 01:02:15.534300 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 01:02:15.534440 n-d-860864-2 devstack@n-api.service[120614]: Tue Oct 11 01:02:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 11 01:02:15.615654 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-129055ab-b402-4397-b49b-12ab7763b65f req-3f193ad3-42ab-4426-99af-9d34b7953cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f", "name": "network-vif-plugged", "status": "completed", "tag": "5224a792-33f5-4505-a116-14d7a434c8bc"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:02:15.626379 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-129055ab-b402-4397-b49b-12ab7763b65f req-3f193ad3-42ab-4426-99af-9d34b7953cb6 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:15.626954 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-129055ab-b402-4397-b49b-12ab7763b65f req-3f193ad3-42ab-4426-99af-9d34b7953cb6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:15.627385 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-129055ab-b402-4397-b49b-12ab7763b65f req-3f193ad3-42ab-4426-99af-9d34b7953cb6 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:15.638629 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-129055ab-b402-4397-b49b-12ab7763b65f req-3f193ad3-42ab-4426-99af-9d34b7953cb6 service nova] Creating event network-vif-plugged:5224a792-33f5-4505-a116-14d7a434c8bc for instance e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f on n-h1-860864-2 Oct 11 01:02:15.645621 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-129055ab-b402-4397-b49b-12ab7763b65f req-3f193ad3-42ab-4426-99af-9d34b7953cb6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121356 Oct 11 01:02:15.646274 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3687/8027] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 01:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:02:27.399845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:02:27.400805 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:02:27.405401 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-b7ef978b-b085-496d-86ad-fcd9e1ebfd62 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1272468887", "imageRef": "430f8814-a948-4e29-8b04-6d89f136110f", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-273602832", "security_groups": [{"name": "tempest-secgroup-smoke-1156352095"}], "networks": [{"uuid": "3fea53cd-7523-43ed-af66-a513f419c25b"}]}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:02:27.430006 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] [9b2b028e-60c1-4dc3-ac1e-06905f87835c] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 41906. Oct 11 01:02:27.434121 n-d-860864-2 devstack@n-api.service[120613]: INFO oslo.messaging._drivers.impl_rabbit [-] [dded55a6-8973-44c5-bba8-4440254057cd] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 41904. Oct 11 01:02:27.518667 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.network.neutron [None req-b7ef978b-b085-496d-86ad-fcd9e1ebfd62 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] validate_networks() for [('3fea53cd-7523-43ed-af66-a513f419c25b', None, None, None, None, None)] {{(pid=120613) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 01:02:28.289750 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-b7ef978b-b085-496d-86ad-fcd9e1ebfd62 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Flavor limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 01:02:28.290189 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-b7ef978b-b085-496d-86ad-fcd9e1ebfd62 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Image limits 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 01:02:28.290680 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-b7ef978b-b085-496d-86ad-fcd9e1ebfd62 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Flavor pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 01:02:28.291104 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-b7ef978b-b085-496d-86ad-fcd9e1ebfd62 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Image pref 0:0:0 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 01:02:28.291532 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.virt.hardware [None req-b7ef978b-b085-496d-86ad-fcd9e1ebfd62 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120613) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 01:02:28.301082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7ef978b-b085-496d-86ad-fcd9e1ebfd62 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:28.301614 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7ef978b-b085-496d-86ad-fcd9e1ebfd62 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:28.302063 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7ef978b-b085-496d-86ad-fcd9e1ebfd62 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:28.302798 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7ef978b-b085-496d-86ad-fcd9e1ebfd62 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:28.303262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7ef978b-b085-496d-86ad-fcd9e1ebfd62 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:28.303696 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-b7ef978b-b085-496d-86ad-fcd9e1ebfd62 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:28.321429 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-b7ef978b-b085-496d-86ad-fcd9e1ebfd62 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Getting quotas for project 1e40a46f67db43b18e260b299f689874. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 01:02:28.326751 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.quota [None req-b7ef978b-b085-496d-86ad-fcd9e1ebfd62 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Getting quotas for user b687a63ff37940d0989110af8f7d448f and project 1e40a46f67db43b18e260b299f689874. Resources: {'cores', 'instances', 'ram'} {{(pid=120613) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 01:02:28.338991 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b7ef978b-b085-496d-86ad-fcd9e1ebfd62 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Going to run 1 instances... {{(pid=120613) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 01:02:28.341507 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-b7ef978b-b085-496d-86ad-fcd9e1ebfd62 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='430f8814-a948-4e29-8b04-6d89f136110f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120613) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 01:02:28.390902 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-b7ef978b-b085-496d-86ad-fcd9e1ebfd62 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.993167 Oct 11 01:02:28.395754 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4341/8028] 10.222.0.23 () {60 vars in 1147 bytes} [Tue Oct 11 01:02:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 01:02:28.403923 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-12cf0f56-d4c4-4645-acdc-0d28567d4b3d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:02:28.404710 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-12cf0f56-d4c4-4645-acdc-0d28567d4b3d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:02:28.408322 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:02:28.409259 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:02:28.444087 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] [31233ac2-692f-4d5e-84d4-7551eaa91acd] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 41920. Oct 11 01:02:28.445679 n-d-860864-2 devstack@n-api.service[120614]: INFO oslo.messaging._drivers.impl_rabbit [-] [0f2d80e9-f410-4772-8046-431e3c70ceb3] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 41922. Oct 11 01:02:28.472070 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-12cf0f56-d4c4-4645-acdc-0d28567d4b3d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:02:28.479137 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-12cf0f56-d4c4-4645-acdc-0d28567d4b3d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566" status: 200 len: 1248 microversion: 2.1 time: 0.079520 Oct 11 01:02:28.479949 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3688/8029] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:02:28 2022] GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566 => generated 1248 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:02:29.503888 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-0e2aa316-b795-45d4-ac1b-6cf9f975d380 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:02:29.504440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-0e2aa316-b795-45d4-ac1b-6cf9f975d380 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:02:29.510843 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e2aa316-b795-45d4-ac1b-6cf9f975d380 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:29.511349 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e2aa316-b795-45d4-ac1b-6cf9f975d380 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:29.511874 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e2aa316-b795-45d4-ac1b-6cf9f975d380 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:29.512589 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e2aa316-b795-45d4-ac1b-6cf9f975d380 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:29.513067 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e2aa316-b795-45d4-ac1b-6cf9f975d380 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:29.513535 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-0e2aa316-b795-45d4-ac1b-6cf9f975d380 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:29.585121 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-0e2aa316-b795-45d4-ac1b-6cf9f975d380 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:02:29.595276 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-0e2aa316-b795-45d4-ac1b-6cf9f975d380 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566" status: 200 len: 1300 microversion: 2.1 time: 0.096143 Oct 11 01:02:29.595881 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4342/8030] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:02:29 2022] GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566 => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:02:30.625414 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-86de65ad-511e-4a7d-8397-a23a72d8cb9f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:02:30.631930 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-86de65ad-511e-4a7d-8397-a23a72d8cb9f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:02:30.664532 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86de65ad-511e-4a7d-8397-a23a72d8cb9f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:30.666574 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86de65ad-511e-4a7d-8397-a23a72d8cb9f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:30.668552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86de65ad-511e-4a7d-8397-a23a72d8cb9f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:30.671997 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86de65ad-511e-4a7d-8397-a23a72d8cb9f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:30.675506 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86de65ad-511e-4a7d-8397-a23a72d8cb9f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:30.676744 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-86de65ad-511e-4a7d-8397-a23a72d8cb9f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:31.090064 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-86de65ad-511e-4a7d-8397-a23a72d8cb9f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:02:31.101802 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-86de65ad-511e-4a7d-8397-a23a72d8cb9f tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566" status: 200 len: 1374 microversion: 2.1 time: 0.485973 Oct 11 01:02:31.106253 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3689/8031] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:02:30 2022] GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566 => generated 1374 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:02:31.570933 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [req-bb1ec6dc-2171-4fd6-9a91-1a23a4cd1c2d req-10c338e8-fe7b-4e3f-a516-09bf0bcc91b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f", "name": "network-vif-unplugged", "status": "completed", "tag": "5224a792-33f5-4505-a116-14d7a434c8bc"}]} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:02:31.600153 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-bb1ec6dc-2171-4fd6-9a91-1a23a4cd1c2d req-10c338e8-fe7b-4e3f-a516-09bf0bcc91b5 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:31.611635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-bb1ec6dc-2171-4fd6-9a91-1a23a4cd1c2d req-10c338e8-fe7b-4e3f-a516-09bf0bcc91b5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:31.612498 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [req-bb1ec6dc-2171-4fd6-9a91-1a23a4cd1c2d req-10c338e8-fe7b-4e3f-a516-09bf0bcc91b5 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:31.626363 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.compute.server_external_events [req-bb1ec6dc-2171-4fd6-9a91-1a23a4cd1c2d req-10c338e8-fe7b-4e3f-a516-09bf0bcc91b5 service nova] Creating event network-vif-unplugged:5224a792-33f5-4505-a116-14d7a434c8bc for instance e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f on n-h1-860864-2 Oct 11 01:02:31.633283 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [req-bb1ec6dc-2171-4fd6-9a91-1a23a4cd1c2d req-10c338e8-fe7b-4e3f-a516-09bf0bcc91b5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066204 Oct 11 01:02:31.634937 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4343/8032] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 01:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:02:32.036223 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-2e530bfa-227b-447d-abe8-7a57ee75f5f6 req-303d3b35-7b91-4b7d-86d9-a7790a64b930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87e90b23-7c68-4958-8776-ad98c624c566", "tag": "1674d01a-56b9-45da-9002-6658ef6fbee0"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:02:32.046395 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2e530bfa-227b-447d-abe8-7a57ee75f5f6 req-303d3b35-7b91-4b7d-86d9-a7790a64b930 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:32.046919 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2e530bfa-227b-447d-abe8-7a57ee75f5f6 req-303d3b35-7b91-4b7d-86d9-a7790a64b930 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:32.047407 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-2e530bfa-227b-447d-abe8-7a57ee75f5f6 req-303d3b35-7b91-4b7d-86d9-a7790a64b930 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:32.060131 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-2e530bfa-227b-447d-abe8-7a57ee75f5f6 req-303d3b35-7b91-4b7d-86d9-a7790a64b930 service nova] Creating event network-changed:1674d01a-56b9-45da-9002-6658ef6fbee0 for instance 87e90b23-7c68-4958-8776-ad98c624c566 on n-h2-860864-2 Oct 11 01:02:32.066053 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-2e530bfa-227b-447d-abe8-7a57ee75f5f6 req-303d3b35-7b91-4b7d-86d9-a7790a64b930 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098073 Oct 11 01:02:32.070258 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3690/8033] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 01:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:02:32.148437 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-fd4be77f-a5b3-4259-8f1d-b7cf24e005f4 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:02:32.149570 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-fd4be77f-a5b3-4259-8f1d-b7cf24e005f4 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:02:32.156177 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd4be77f-a5b3-4259-8f1d-b7cf24e005f4 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:32.157824 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd4be77f-a5b3-4259-8f1d-b7cf24e005f4 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:32.158623 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd4be77f-a5b3-4259-8f1d-b7cf24e005f4 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:32.159710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd4be77f-a5b3-4259-8f1d-b7cf24e005f4 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:32.160433 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd4be77f-a5b3-4259-8f1d-b7cf24e005f4 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:32.161082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-fd4be77f-a5b3-4259-8f1d-b7cf24e005f4 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:32.329961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-fd4be77f-a5b3-4259-8f1d-b7cf24e005f4 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:02:32.338617 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-fd4be77f-a5b3-4259-8f1d-b7cf24e005f4 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566" status: 200 len: 1374 microversion: 2.1 time: 0.194510 Oct 11 01:02:32.339483 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4344/8034] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:02:32 2022] GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566 => generated 1374 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:02:33.366094 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-e910015b-61fc-42c3-a96f-acf79762683d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:02:33.367048 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-e910015b-61fc-42c3-a96f-acf79762683d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:02:33.373527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e910015b-61fc-42c3-a96f-acf79762683d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:33.374335 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e910015b-61fc-42c3-a96f-acf79762683d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:33.374978 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e910015b-61fc-42c3-a96f-acf79762683d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:33.375782 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e910015b-61fc-42c3-a96f-acf79762683d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:33.376244 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e910015b-61fc-42c3-a96f-acf79762683d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:33.376882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-e910015b-61fc-42c3-a96f-acf79762683d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:33.545467 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-e910015b-61fc-42c3-a96f-acf79762683d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:02:33.553324 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-e910015b-61fc-42c3-a96f-acf79762683d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566" status: 200 len: 1374 microversion: 2.1 time: 0.192406 Oct 11 01:02:33.553923 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3691/8035] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:02:33 2022] GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566 => generated 1374 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:02:34.576229 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-12e97e85-b588-4555-8793-3c5b30fdf170 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:02:34.576873 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-12e97e85-b588-4555-8793-3c5b30fdf170 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:02:34.584358 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12e97e85-b588-4555-8793-3c5b30fdf170 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:34.584861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12e97e85-b588-4555-8793-3c5b30fdf170 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:34.585322 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12e97e85-b588-4555-8793-3c5b30fdf170 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:34.586052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12e97e85-b588-4555-8793-3c5b30fdf170 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:34.586522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12e97e85-b588-4555-8793-3c5b30fdf170 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:34.586960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-12e97e85-b588-4555-8793-3c5b30fdf170 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:34.729679 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-12e97e85-b588-4555-8793-3c5b30fdf170 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:02:34.743662 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-12e97e85-b588-4555-8793-3c5b30fdf170 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566" status: 200 len: 1374 microversion: 2.1 time: 0.171240 Oct 11 01:02:34.757819 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4345/8036] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:02:34 2022] GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566 => generated 1374 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:02:35.768694 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-7df19e7f-7a95-4ad1-86bf-85a5ad441f39 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:02:35.769347 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-7df19e7f-7a95-4ad1-86bf-85a5ad441f39 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:02:35.776176 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7df19e7f-7a95-4ad1-86bf-85a5ad441f39 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:35.776658 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7df19e7f-7a95-4ad1-86bf-85a5ad441f39 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:35.777088 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7df19e7f-7a95-4ad1-86bf-85a5ad441f39 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:35.777802 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7df19e7f-7a95-4ad1-86bf-85a5ad441f39 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:35.778252 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7df19e7f-7a95-4ad1-86bf-85a5ad441f39 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:35.779029 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-7df19e7f-7a95-4ad1-86bf-85a5ad441f39 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:35.927099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-7df19e7f-7a95-4ad1-86bf-85a5ad441f39 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:02:35.940426 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-7df19e7f-7a95-4ad1-86bf-85a5ad441f39 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566" status: 200 len: 1374 microversion: 2.1 time: 0.171514 Oct 11 01:02:35.941568 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3692/8037] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:02:35 2022] GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566 => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:02:36.980289 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7a6609fe-8b75-4b16-ad81-a5200faacd22 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:02:36.981007 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7a6609fe-8b75-4b16-ad81-a5200faacd22 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:02:36.989038 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a6609fe-8b75-4b16-ad81-a5200faacd22 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:36.989594 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a6609fe-8b75-4b16-ad81-a5200faacd22 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:36.990058 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a6609fe-8b75-4b16-ad81-a5200faacd22 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:36.990791 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a6609fe-8b75-4b16-ad81-a5200faacd22 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:36.991267 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a6609fe-8b75-4b16-ad81-a5200faacd22 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:36.991793 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7a6609fe-8b75-4b16-ad81-a5200faacd22 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:37.127863 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7a6609fe-8b75-4b16-ad81-a5200faacd22 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:02:37.135607 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7a6609fe-8b75-4b16-ad81-a5200faacd22 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566" status: 200 len: 1374 microversion: 2.1 time: 0.159521 Oct 11 01:02:37.136185 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4346/8038] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:02:36 2022] GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:02:38.158988 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-f219214f-a5f7-4e02-99dd-892370e519dd tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:02:38.159651 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-f219214f-a5f7-4e02-99dd-892370e519dd tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:02:38.166587 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f219214f-a5f7-4e02-99dd-892370e519dd tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:38.167060 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f219214f-a5f7-4e02-99dd-892370e519dd tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:38.167498 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f219214f-a5f7-4e02-99dd-892370e519dd tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:38.168198 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f219214f-a5f7-4e02-99dd-892370e519dd tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:38.168653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f219214f-a5f7-4e02-99dd-892370e519dd tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:38.169077 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-f219214f-a5f7-4e02-99dd-892370e519dd tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:38.301669 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-f219214f-a5f7-4e02-99dd-892370e519dd tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:02:38.309535 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-f219214f-a5f7-4e02-99dd-892370e519dd tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566" status: 200 len: 1374 microversion: 2.1 time: 0.155182 Oct 11 01:02:38.310111 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3693/8039] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:02:38 2022] GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:02:39.334014 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-e3bbffbc-cbee-498b-bd2c-bda743b69b48 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:02:39.334635 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-e3bbffbc-cbee-498b-bd2c-bda743b69b48 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:02:39.338400 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:02:39.339094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell0:SELECT=6 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:02:39.345303 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3bbffbc-cbee-498b-bd2c-bda743b69b48 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:39.345836 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3bbffbc-cbee-498b-bd2c-bda743b69b48 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:39.346359 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3bbffbc-cbee-498b-bd2c-bda743b69b48 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:39.347158 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3bbffbc-cbee-498b-bd2c-bda743b69b48 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:39.347645 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3bbffbc-cbee-498b-bd2c-bda743b69b48 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:39.348092 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-e3bbffbc-cbee-498b-bd2c-bda743b69b48 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:39.510865 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-e3bbffbc-cbee-498b-bd2c-bda743b69b48 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:02:39.520791 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-e3bbffbc-cbee-498b-bd2c-bda743b69b48 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566" status: 200 len: 1374 microversion: 2.1 time: 0.190673 Oct 11 01:02:39.521689 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4347/8040] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:02:39 2022] GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566 => generated 1374 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:02:40.544228 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ab424ae6-b492-4d93-a637-0287bc906825 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:02:40.544857 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ab424ae6-b492-4d93-a637-0287bc906825 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:02:40.546884 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell0:SELECT=2 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:02:40.554221 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab424ae6-b492-4d93-a637-0287bc906825 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:40.554725 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab424ae6-b492-4d93-a637-0287bc906825 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:40.555168 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab424ae6-b492-4d93-a637-0287bc906825 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:40.555868 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab424ae6-b492-4d93-a637-0287bc906825 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:40.556326 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab424ae6-b492-4d93-a637-0287bc906825 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:40.556759 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ab424ae6-b492-4d93-a637-0287bc906825 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:40.688897 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ab424ae6-b492-4d93-a637-0287bc906825 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:02:40.696993 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ab424ae6-b492-4d93-a637-0287bc906825 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566" status: 200 len: 1374 microversion: 2.1 time: 0.156742 Oct 11 01:02:40.697588 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3694/8041] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:02:40 2022] GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:02:41.719886 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-aada7935-207a-4eee-b7d8-f9599a70e4aa tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:02:41.720742 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-aada7935-207a-4eee-b7d8-f9599a70e4aa tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:02:41.727543 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aada7935-207a-4eee-b7d8-f9599a70e4aa tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:41.728053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aada7935-207a-4eee-b7d8-f9599a70e4aa tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:41.728508 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aada7935-207a-4eee-b7d8-f9599a70e4aa tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:41.729224 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aada7935-207a-4eee-b7d8-f9599a70e4aa tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:41.729729 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aada7935-207a-4eee-b7d8-f9599a70e4aa tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:41.730175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-aada7935-207a-4eee-b7d8-f9599a70e4aa tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:41.868511 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-aada7935-207a-4eee-b7d8-f9599a70e4aa tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:02:41.876996 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-aada7935-207a-4eee-b7d8-f9599a70e4aa tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566" status: 200 len: 1374 microversion: 2.1 time: 0.160431 Oct 11 01:02:41.877606 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4348/8042] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:02:41 2022] GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:02:42.900217 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-ee99e422-9e47-4194-b859-c28296a57ee5 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:02:42.900849 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-ee99e422-9e47-4194-b859-c28296a57ee5 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:02:42.908460 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee99e422-9e47-4194-b859-c28296a57ee5 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:42.908973 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee99e422-9e47-4194-b859-c28296a57ee5 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:42.909426 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee99e422-9e47-4194-b859-c28296a57ee5 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:42.910143 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee99e422-9e47-4194-b859-c28296a57ee5 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:42.910598 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee99e422-9e47-4194-b859-c28296a57ee5 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:42.911056 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-ee99e422-9e47-4194-b859-c28296a57ee5 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:43.045885 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-ee99e422-9e47-4194-b859-c28296a57ee5 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:02:43.054258 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-ee99e422-9e47-4194-b859-c28296a57ee5 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566" status: 200 len: 1374 microversion: 2.1 time: 0.157986 Oct 11 01:02:43.054839 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3695/8043] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:02:42 2022] GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:02:44.077053 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-1ec1aae7-b3d8-4c37-a588-3e828fb59c22 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:02:44.077640 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-1ec1aae7-b3d8-4c37-a588-3e828fb59c22 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:02:44.085111 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ec1aae7-b3d8-4c37-a588-3e828fb59c22 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:44.085637 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ec1aae7-b3d8-4c37-a588-3e828fb59c22 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:44.086094 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ec1aae7-b3d8-4c37-a588-3e828fb59c22 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:44.086794 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ec1aae7-b3d8-4c37-a588-3e828fb59c22 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:44.087262 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ec1aae7-b3d8-4c37-a588-3e828fb59c22 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:44.087701 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-1ec1aae7-b3d8-4c37-a588-3e828fb59c22 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:44.222482 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-1ec1aae7-b3d8-4c37-a588-3e828fb59c22 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:02:44.230320 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-1ec1aae7-b3d8-4c37-a588-3e828fb59c22 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566" status: 200 len: 1374 microversion: 2.1 time: 0.157300 Oct 11 01:02:44.230906 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4349/8044] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:02:44 2022] GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:02:44.406006 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-18bfb80f-898c-49be-99a8-b40b372ca44e req-da69905e-31d7-4f93-9010-b7cc560bdffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e90b23-7c68-4958-8776-ad98c624c566", "name": "network-vif-plugged", "status": "completed", "tag": "1674d01a-56b9-45da-9002-6658ef6fbee0"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:02:44.417099 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-18bfb80f-898c-49be-99a8-b40b372ca44e req-da69905e-31d7-4f93-9010-b7cc560bdffa service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:44.417614 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-18bfb80f-898c-49be-99a8-b40b372ca44e req-da69905e-31d7-4f93-9010-b7cc560bdffa service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:44.418044 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-18bfb80f-898c-49be-99a8-b40b372ca44e req-da69905e-31d7-4f93-9010-b7cc560bdffa service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:44.432358 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-18bfb80f-898c-49be-99a8-b40b372ca44e req-da69905e-31d7-4f93-9010-b7cc560bdffa service nova] Creating event network-vif-plugged:1674d01a-56b9-45da-9002-6658ef6fbee0 for instance 87e90b23-7c68-4958-8776-ad98c624c566 on n-h2-860864-2 Oct 11 01:02:44.437567 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-18bfb80f-898c-49be-99a8-b40b372ca44e req-da69905e-31d7-4f93-9010-b7cc560bdffa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035198 Oct 11 01:02:44.438190 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3696/8045] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 01:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:02:45.252767 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-40547c80-a07e-451f-a1b6-64a51c715390 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:02:45.253423 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-40547c80-a07e-451f-a1b6-64a51c715390 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:02:45.261016 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40547c80-a07e-451f-a1b6-64a51c715390 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:45.261585 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40547c80-a07e-451f-a1b6-64a51c715390 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:45.262052 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40547c80-a07e-451f-a1b6-64a51c715390 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:45.262816 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40547c80-a07e-451f-a1b6-64a51c715390 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:45.263295 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40547c80-a07e-451f-a1b6-64a51c715390 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:45.263745 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-40547c80-a07e-451f-a1b6-64a51c715390 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:45.398113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-40547c80-a07e-451f-a1b6-64a51c715390 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:02:45.405863 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-40547c80-a07e-451f-a1b6-64a51c715390 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566" status: 200 len: 1374 microversion: 2.1 time: 0.157021 Oct 11 01:02:45.406455 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4350/8046] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:02:45 2022] GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:02:46.430690 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-d1499efc-eea5-4533-8da5-ac369cde3d25 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:02:46.431295 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-d1499efc-eea5-4533-8da5-ac369cde3d25 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:02:46.437670 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1499efc-eea5-4533-8da5-ac369cde3d25 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:46.438163 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1499efc-eea5-4533-8da5-ac369cde3d25 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:46.439398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1499efc-eea5-4533-8da5-ac369cde3d25 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:46.440149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1499efc-eea5-4533-8da5-ac369cde3d25 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:46.440608 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1499efc-eea5-4533-8da5-ac369cde3d25 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:46.441040 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-d1499efc-eea5-4533-8da5-ac369cde3d25 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:46.571451 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-d1499efc-eea5-4533-8da5-ac369cde3d25 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:02:46.579445 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-d1499efc-eea5-4533-8da5-ac369cde3d25 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566" status: 200 len: 1559 microversion: 2.1 time: 0.154001 Oct 11 01:02:46.580032 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3697/8047] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:02:46 2022] GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:02:46.601845 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-c0e1afc8-a8b3-4b7c-a732-0583b73114f8 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:02:46.602461 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-c0e1afc8-a8b3-4b7c-a732-0583b73114f8 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:02:46.609489 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0e1afc8-a8b3-4b7c-a732-0583b73114f8 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:46.609992 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0e1afc8-a8b3-4b7c-a732-0583b73114f8 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:46.611124 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0e1afc8-a8b3-4b7c-a732-0583b73114f8 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:46.611923 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0e1afc8-a8b3-4b7c-a732-0583b73114f8 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:46.612388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0e1afc8-a8b3-4b7c-a732-0583b73114f8 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:46.612828 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-c0e1afc8-a8b3-4b7c-a732-0583b73114f8 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:46.750389 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-c0e1afc8-a8b3-4b7c-a732-0583b73114f8 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:02:46.758537 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-c0e1afc8-a8b3-4b7c-a732-0583b73114f8 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566" status: 200 len: 1559 microversion: 2.1 time: 0.160562 Oct 11 01:02:46.759359 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4351/8048] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:02:46 2022] GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:02:48.329698 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-728af5c9-77de-4858-822d-fb10714feafd req-5afd3a82-4546-468f-9130-7e113f3daecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87e90b23-7c68-4958-8776-ad98c624c566", "tag": "1674d01a-56b9-45da-9002-6658ef6fbee0"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:02:48.339981 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-728af5c9-77de-4858-822d-fb10714feafd req-5afd3a82-4546-468f-9130-7e113f3daecb service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:02:48.342308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-728af5c9-77de-4858-822d-fb10714feafd req-5afd3a82-4546-468f-9130-7e113f3daecb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:02:48.342308 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-728af5c9-77de-4858-822d-fb10714feafd req-5afd3a82-4546-468f-9130-7e113f3daecb service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:02:48.352532 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-728af5c9-77de-4858-822d-fb10714feafd req-5afd3a82-4546-468f-9130-7e113f3daecb service nova] Creating event network-changed:1674d01a-56b9-45da-9002-6658ef6fbee0 for instance 87e90b23-7c68-4958-8776-ad98c624c566 on n-h2-860864-2 Oct 11 01:02:48.357638 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-728af5c9-77de-4858-822d-fb10714feafd req-5afd3a82-4546-468f-9130-7e113f3daecb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032275 Oct 11 01:02:48.358564 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3698/8049] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 01:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:04:15.806383 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:04:15.807155 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=58 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:04:15.861010 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-a50ef618-9aa5-4039-b7e8-e3290951b76e tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1236833315"}} {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:04:15.863515 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-a50ef618-9aa5-4039-b7e8-e3290951b76e tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:04:15.870557 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a50ef618-9aa5-4039-b7e8-e3290951b76e tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:15.871066 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a50ef618-9aa5-4039-b7e8-e3290951b76e tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:15.871521 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a50ef618-9aa5-4039-b7e8-e3290951b76e tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:15.872234 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a50ef618-9aa5-4039-b7e8-e3290951b76e tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:15.872706 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a50ef618-9aa5-4039-b7e8-e3290951b76e tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:15.873150 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-a50ef618-9aa5-4039-b7e8-e3290951b76e tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:16.076947 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-a50ef618-9aa5-4039-b7e8-e3290951b76e tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "POST /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566/action" status: 202 len: 0 microversion: 2.1 time: 0.272793 Oct 11 01:04:16.077536 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4352/8050] 10.222.0.23 () {60 vars in 1278 bytes} [Tue Oct 11 01:04:15 2022] POST /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 01:04:21.045024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_api:SELECT=24 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:04:21.046477 n-d-860864-2 devstack@n-api.service[120614]: DEBUG dbcounter [-] [120614] Writing DB stats nova_cell1:SELECT=48 {{(pid=120614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:04:21.052777 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-85678baa-7f94-4028-a171-3752abf3c95b req-437e3956-b54f-473f-bd31-fea42e93572f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e90b23-7c68-4958-8776-ad98c624c566", "name": "network-vif-plugged", "status": "completed", "tag": "1674d01a-56b9-45da-9002-6658ef6fbee0"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:04:21.067178 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-85678baa-7f94-4028-a171-3752abf3c95b req-437e3956-b54f-473f-bd31-fea42e93572f service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:21.067932 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-85678baa-7f94-4028-a171-3752abf3c95b req-437e3956-b54f-473f-bd31-fea42e93572f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:21.068797 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-85678baa-7f94-4028-a171-3752abf3c95b req-437e3956-b54f-473f-bd31-fea42e93572f service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:21.081588 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-85678baa-7f94-4028-a171-3752abf3c95b req-437e3956-b54f-473f-bd31-fea42e93572f service nova] Creating event network-vif-plugged:1674d01a-56b9-45da-9002-6658ef6fbee0 for instance 87e90b23-7c68-4958-8776-ad98c624c566 on n-h2-860864-2 Oct 11 01:04:21.092482 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-85678baa-7f94-4028-a171-3752abf3c95b req-437e3956-b54f-473f-bd31-fea42e93572f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050016 Oct 11 01:04:21.093273 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3699/8051] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 01:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:04:30.735175 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_api:SELECT=2 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:04:30.736847 n-d-860864-2 devstack@n-api.service[120613]: DEBUG dbcounter [-] [120613] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120613) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 01:04:30.741617 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-dc439846-307d-4219-9282-88c499c2ccee tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:04:30.743502 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dc439846-307d-4219-9282-88c499c2ccee tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:04:30.751877 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc439846-307d-4219-9282-88c499c2ccee tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:30.752388 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc439846-307d-4219-9282-88c499c2ccee tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:30.752848 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc439846-307d-4219-9282-88c499c2ccee tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:30.753611 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc439846-307d-4219-9282-88c499c2ccee tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:30.754231 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc439846-307d-4219-9282-88c499c2ccee tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:30.754868 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-dc439846-307d-4219-9282-88c499c2ccee tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:30.789208 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-dc439846-307d-4219-9282-88c499c2ccee tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:04:30.806692 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-4b597c74-414f-419e-8015-5a4a39422484 req-8a890463-0818-4ca6-9b1c-eb65bd4f9389 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87e90b23-7c68-4958-8776-ad98c624c566", "tag": "1674d01a-56b9-45da-9002-6658ef6fbee0"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:04:30.819424 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4b597c74-414f-419e-8015-5a4a39422484 req-8a890463-0818-4ca6-9b1c-eb65bd4f9389 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:30.820339 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4b597c74-414f-419e-8015-5a4a39422484 req-8a890463-0818-4ca6-9b1c-eb65bd4f9389 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:30.820894 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-4b597c74-414f-419e-8015-5a4a39422484 req-8a890463-0818-4ca6-9b1c-eb65bd4f9389 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:30.838332 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-4b597c74-414f-419e-8015-5a4a39422484 req-8a890463-0818-4ca6-9b1c-eb65bd4f9389 service nova] Creating event network-changed:1674d01a-56b9-45da-9002-6658ef6fbee0 for instance 87e90b23-7c68-4958-8776-ad98c624c566 on n-h2-860864-2 Oct 11 01:04:30.844639 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-4b597c74-414f-419e-8015-5a4a39422484 req-8a890463-0818-4ca6-9b1c-eb65bd4f9389 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115840 Oct 11 01:04:30.845609 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3700/8052] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 01:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:04:30.892091 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-dc439846-307d-4219-9282-88c499c2ccee tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "DELETE /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566" status: 204 len: 0 microversion: 2.1 time: 0.166928 Oct 11 01:04:30.903563 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-87b44d62-bc64-4474-b525-9210fcd6a5e3 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:04:30.904752 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-87b44d62-bc64-4474-b525-9210fcd6a5e3 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:04:30.905443 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4353/8053] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 01:04:30 2022] DELETE /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:04:30.911398 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87b44d62-bc64-4474-b525-9210fcd6a5e3 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:30.912024 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87b44d62-bc64-4474-b525-9210fcd6a5e3 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:30.912552 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87b44d62-bc64-4474-b525-9210fcd6a5e3 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:30.913527 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87b44d62-bc64-4474-b525-9210fcd6a5e3 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:30.915141 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87b44d62-bc64-4474-b525-9210fcd6a5e3 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:30.915669 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-87b44d62-bc64-4474-b525-9210fcd6a5e3 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:31.183011 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-87b44d62-bc64-4474-b525-9210fcd6a5e3 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:04:31.190895 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-87b44d62-bc64-4474-b525-9210fcd6a5e3 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566" status: 200 len: 1682 microversion: 2.1 time: 0.292800 Oct 11 01:04:31.191494 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3701/8054] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:04:30 2022] GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566 => generated 1682 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 01:04:32.215588 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-7cd56c5a-fcdd-4521-806a-450bfc83a0ca tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:04:32.216305 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-7cd56c5a-fcdd-4521-806a-450bfc83a0ca tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:04:32.223396 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cd56c5a-fcdd-4521-806a-450bfc83a0ca tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:32.223902 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cd56c5a-fcdd-4521-806a-450bfc83a0ca tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:32.224355 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cd56c5a-fcdd-4521-806a-450bfc83a0ca tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:32.225065 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cd56c5a-fcdd-4521-806a-450bfc83a0ca tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:32.225567 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cd56c5a-fcdd-4521-806a-450bfc83a0ca tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:32.226011 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-7cd56c5a-fcdd-4521-806a-450bfc83a0ca tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:32.361788 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-7cd56c5a-fcdd-4521-806a-450bfc83a0ca tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:04:32.370555 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-7cd56c5a-fcdd-4521-806a-450bfc83a0ca tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566" status: 200 len: 1682 microversion: 2.1 time: 0.159152 Oct 11 01:04:32.371154 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4354/8055] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:04:32 2022] GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:04:33.140438 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-6be1f597-6ed2-4868-9101-dcee00a2265a req-3c640e51-c6cf-46ce-b414-7a4d4682ebef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e90b23-7c68-4958-8776-ad98c624c566", "name": "network-vif-deleted", "tag": "1674d01a-56b9-45da-9002-6658ef6fbee0"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:04:33.151350 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6be1f597-6ed2-4868-9101-dcee00a2265a req-3c640e51-c6cf-46ce-b414-7a4d4682ebef service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:33.151834 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6be1f597-6ed2-4868-9101-dcee00a2265a req-3c640e51-c6cf-46ce-b414-7a4d4682ebef service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:33.152266 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-6be1f597-6ed2-4868-9101-dcee00a2265a req-3c640e51-c6cf-46ce-b414-7a4d4682ebef service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:33.164242 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-6be1f597-6ed2-4868-9101-dcee00a2265a req-3c640e51-c6cf-46ce-b414-7a4d4682ebef service nova] Creating event network-vif-deleted:1674d01a-56b9-45da-9002-6658ef6fbee0 for instance 87e90b23-7c68-4958-8776-ad98c624c566 on n-h2-860864-2 Oct 11 01:04:33.169566 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-6be1f597-6ed2-4868-9101-dcee00a2265a req-3c640e51-c6cf-46ce-b414-7a4d4682ebef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032913 Oct 11 01:04:33.170171 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3702/8056] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 01:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:04:33.395327 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-ba1b29c0-d4e1-4df7-90d1-fc2f9cc5e329 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:04:33.395961 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-ba1b29c0-d4e1-4df7-90d1-fc2f9cc5e329 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:04:33.403710 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba1b29c0-d4e1-4df7-90d1-fc2f9cc5e329 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:33.404216 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba1b29c0-d4e1-4df7-90d1-fc2f9cc5e329 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:33.404702 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba1b29c0-d4e1-4df7-90d1-fc2f9cc5e329 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:33.405522 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba1b29c0-d4e1-4df7-90d1-fc2f9cc5e329 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:33.405996 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba1b29c0-d4e1-4df7-90d1-fc2f9cc5e329 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:33.406440 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba1b29c0-d4e1-4df7-90d1-fc2f9cc5e329 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:33.447966 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba1b29c0-d4e1-4df7-90d1-fc2f9cc5e329 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:33.448840 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba1b29c0-d4e1-4df7-90d1-fc2f9cc5e329 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:33.449413 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-ba1b29c0-d4e1-4df7-90d1-fc2f9cc5e329 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:33.449960 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.objects.instance [None req-ba1b29c0-d4e1-4df7-90d1-fc2f9cc5e329 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lazy-loading 'fault' on Instance uuid 87e90b23-7c68-4958-8776-ad98c624c566 {{(pid=120613) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 01:04:33.503082 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-ba1b29c0-d4e1-4df7-90d1-fc2f9cc5e329 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:04:33.512282 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-ba1b29c0-d4e1-4df7-90d1-fc2f9cc5e329 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566" status: 200 len: 1338 microversion: 2.1 time: 0.120806 Oct 11 01:04:33.512877 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4355/8057] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:04:33 2022] GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566 => generated 1338 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:04:34.537653 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-be168c45-acd2-4642-9852-dbeb026cfcb7 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:04:34.538273 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-be168c45-acd2-4642-9852-dbeb026cfcb7 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: 87e90b23-7c68-4958-8776-ad98c624c566] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:04:34.545121 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be168c45-acd2-4642-9852-dbeb026cfcb7 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:34.545641 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be168c45-acd2-4642-9852-dbeb026cfcb7 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:34.546075 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be168c45-acd2-4642-9852-dbeb026cfcb7 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:34.546760 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be168c45-acd2-4642-9852-dbeb026cfcb7 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:34.547209 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be168c45-acd2-4642-9852-dbeb026cfcb7 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:34.547661 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-be168c45-acd2-4642-9852-dbeb026cfcb7 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:34.561233 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.wsgi [None req-be168c45-acd2-4642-9852-dbeb026cfcb7 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] HTTP exception thrown: Instance 87e90b23-7c68-4958-8776-ad98c624c566 could not be found. Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-be168c45-acd2-4642-9852-dbeb026cfcb7 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Request method failure captured: Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: request: GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566 HTTP/1.1 Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: Accept: application/json Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: Accept-Encoding: identity Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: Connection: close Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: Content-Length: 0 Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: Content-Type: application/json Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: Host: 10.222.0.23 Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: Openstack-System-Scope: None Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: User-Agent: python-urllib3/1.26.12 Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: X-Auth-Token: gAAAAABjRL_e5yJB6uIK2yLuv_kfa0xZzdg6qUR8yeVlpOymvPtYODVN355clS_OIu-Zv4t2SW-PfegwBRNAByHPMt1lmUoVN6sFLZptg7Bcl2LvWCxgnZoJOodJwNjN08siI5-80DOadQbcK1JtuU_qA58UwhD7XoPTwoKEkM_1FS-xYy0HwQ0 Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Id: None Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: X-Domain-Name: None Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: X-Identity-Status: Confirmed Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: X-Is-Admin-Project: True Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Id: default Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Domain-Name: Default Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Id: 1e40a46f67db43b18e260b299f689874 Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: X-Project-Name: tempest-TestSnapshotPattern-827248921 Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: X-Role: member,reader Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: X-Roles: member,reader Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1e40a46f67db43b18e260b299f689874"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1e40a46f67db43b18e260b299f689874"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1e40a46f67db43b18e260b299f689874"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1e40a46f67db43b18e260b299f689874", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant: tempest-TestSnapshotPattern-827248921 Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Id: 1e40a46f67db43b18e260b299f689874 Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: X-Tenant-Name: tempest-TestSnapshotPattern-827248921 Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: X-User: tempest-TestSnapshotPattern-827248921-project Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Id: default Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: X-User-Domain-Name: Default Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: X-User-Id: b687a63ff37940d0989110af8f7d448f Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: X-User-Name: tempest-TestSnapshotPattern-827248921-project Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: method: > Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: exception: Instance 87e90b23-7c68-4958-8776-ad98c624c566 could not be found. Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: action_args: {'id': '87e90b23-7c68-4958-8776-ad98c624c566'} Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87e90b23-7c68-4958-8776-ad98c624c566 could not be found. Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87e90b23-7c68-4958-8776-ad98c624c566 could not be found. Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:04:34.562882 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 01:04:34.568936 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:04:34.568936 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:04:34.568936 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:04:34.568936 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:04:34.568936 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:04:34.568936 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87e90b23-7c68-4958-8776-ad98c624c566 could not be found. Oct 11 01:04:34.568936 n-d-860864-2 devstack@n-api.service[120614]: ERROR nova.api.openstack.wsgi Oct 11 01:04:34.568936 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-be168c45-acd2-4642-9852-dbeb026cfcb7 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Returning 404 to user: Instance 87e90b23-7c68-4958-8776-ad98c624c566 could not be found. {{(pid=120614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:04:34.568936 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-be168c45-acd2-4642-9852-dbeb026cfcb7 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566" status: 404 len: 111 microversion: 2.1 time: 0.031829 Oct 11 01:04:34.568936 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3703/8058] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:04:34 2022] GET /compute/v2.1/servers/87e90b23-7c68-4958-8776-ad98c624c566 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:04:36.182915 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-130bdbdc-c557-43f9-b8a9-0c98e36ee93e tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:04:36.183478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-130bdbdc-c557-43f9-b8a9-0c98e36ee93e tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:04:36.185195 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-5a30909b-33a8-4386-b83a-9e8520812325 req-914da6ac-d2e0-4c36-a976-2b25bdcaf048 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f", "tag": "5224a792-33f5-4505-a116-14d7a434c8bc"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:04:36.190975 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-130bdbdc-c557-43f9-b8a9-0c98e36ee93e tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:36.191488 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-130bdbdc-c557-43f9-b8a9-0c98e36ee93e tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:36.191944 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-130bdbdc-c557-43f9-b8a9-0c98e36ee93e tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:36.192912 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-130bdbdc-c557-43f9-b8a9-0c98e36ee93e tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:36.193410 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-130bdbdc-c557-43f9-b8a9-0c98e36ee93e tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:36.194113 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-130bdbdc-c557-43f9-b8a9-0c98e36ee93e tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:36.197286 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5a30909b-33a8-4386-b83a-9e8520812325 req-914da6ac-d2e0-4c36-a976-2b25bdcaf048 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:36.198348 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5a30909b-33a8-4386-b83a-9e8520812325 req-914da6ac-d2e0-4c36-a976-2b25bdcaf048 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:36.199026 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-5a30909b-33a8-4386-b83a-9e8520812325 req-914da6ac-d2e0-4c36-a976-2b25bdcaf048 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:36.210796 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-5a30909b-33a8-4386-b83a-9e8520812325 req-914da6ac-d2e0-4c36-a976-2b25bdcaf048 service nova] Creating event network-changed:5224a792-33f5-4505-a116-14d7a434c8bc for instance e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f on n-h1-860864-2 Oct 11 01:04:36.217304 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-5a30909b-33a8-4386-b83a-9e8520812325 req-914da6ac-d2e0-4c36-a976-2b25bdcaf048 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036810 Oct 11 01:04:36.218056 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3704/8059] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 01:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 01:04:36.222597 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-130bdbdc-c557-43f9-b8a9-0c98e36ee93e tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f] Going to try to terminate instance {{(pid=120613) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 01:04:36.312488 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-130bdbdc-c557-43f9-b8a9-0c98e36ee93e tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f" status: 204 len: 0 microversion: 2.1 time: 0.133676 Oct 11 01:04:36.316212 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4356/8060] 10.222.0.23 () {58 vars in 1239 bytes} [Tue Oct 11 01:04:36 2022] DELETE /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 01:04:36.322542 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-895da313-c916-46a1-9b11-e22531c9f224 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:04:36.323439 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.compute.api [None req-895da313-c916-46a1-9b11-e22531c9f224 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f] Fetching instance by UUID {{(pid=120614) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:04:36.332149 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-895da313-c916-46a1-9b11-e22531c9f224 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:36.332646 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-895da313-c916-46a1-9b11-e22531c9f224 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:36.333089 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-895da313-c916-46a1-9b11-e22531c9f224 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:36.333817 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-895da313-c916-46a1-9b11-e22531c9f224 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:36.334268 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-895da313-c916-46a1-9b11-e22531c9f224 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:36.335033 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [None req-895da313-c916-46a1-9b11-e22531c9f224 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:36.482054 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.policy [None req-895da313-c916-46a1-9b11-e22531c9f224 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120614) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:04:36.489876 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-895da313-c916-46a1-9b11-e22531c9f224 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f" status: 200 len: 1682 microversion: 2.1 time: 0.172141 Oct 11 01:04:36.490472 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3705/8061] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:04:36 2022] GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:04:37.515812 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-45adb2a2-106a-49bc-bea8-1091f97136e2 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:04:37.516451 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-45adb2a2-106a-49bc-bea8-1091f97136e2 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:04:37.523381 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45adb2a2-106a-49bc-bea8-1091f97136e2 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:37.523931 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45adb2a2-106a-49bc-bea8-1091f97136e2 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:37.524478 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45adb2a2-106a-49bc-bea8-1091f97136e2 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:37.525194 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45adb2a2-106a-49bc-bea8-1091f97136e2 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:37.525689 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45adb2a2-106a-49bc-bea8-1091f97136e2 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:37.526134 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-45adb2a2-106a-49bc-bea8-1091f97136e2 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:37.594185 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.policy [None req-45adb2a2-106a-49bc-bea8-1091f97136e2 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687a63ff37940d0989110af8f7d448f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e40a46f67db43b18e260b299f689874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120613) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 01:04:37.603871 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-45adb2a2-106a-49bc-bea8-1091f97136e2 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f" status: 200 len: 1495 microversion: 2.1 time: 0.092500 Oct 11 01:04:37.604646 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4357/8062] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:04:37 2022] GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f => generated 1495 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 01:04:38.231961 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [req-ba3ed17d-fa1a-46cd-b284-9390065ca735 req-76c8727b-d07e-44cf-9026-16fb85284433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f", "name": "network-vif-deleted", "tag": "5224a792-33f5-4505-a116-14d7a434c8bc"}]} {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 01:04:38.242085 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ba3ed17d-fa1a-46cd-b284-9390065ca735 req-76c8727b-d07e-44cf-9026-16fb85284433 service nova] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:38.242557 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ba3ed17d-fa1a-46cd-b284-9390065ca735 req-76c8727b-d07e-44cf-9026-16fb85284433 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:38.243381 n-d-860864-2 devstack@n-api.service[120614]: DEBUG oslo_concurrency.lockutils [req-ba3ed17d-fa1a-46cd-b284-9390065ca735 req-76c8727b-d07e-44cf-9026-16fb85284433 service nova] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:38.254467 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.compute.server_external_events [req-ba3ed17d-fa1a-46cd-b284-9390065ca735 req-76c8727b-d07e-44cf-9026-16fb85284433 service nova] Creating event network-vif-deleted:5224a792-33f5-4505-a116-14d7a434c8bc for instance e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f on n-h1-860864-2 Oct 11 01:04:38.259941 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [req-ba3ed17d-fa1a-46cd-b284-9390065ca735 req-76c8727b-d07e-44cf-9026-16fb85284433 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031633 Oct 11 01:04:38.260546 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3706/8063] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Oct 11 01:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 01:04:38.629468 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-39bb12d5-6c8d-4d2b-875e-abf6cbcc7e74 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '>' {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:04:38.630103 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.compute.api [None req-39bb12d5-6c8d-4d2b-875e-abf6cbcc7e74 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] [instance: e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f] Fetching instance by UUID {{(pid=120613) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 01:04:38.637914 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39bb12d5-6c8d-4d2b-875e-abf6cbcc7e74 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:38.638412 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39bb12d5-6c8d-4d2b-875e-abf6cbcc7e74 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:38.638861 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39bb12d5-6c8d-4d2b-875e-abf6cbcc7e74 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:38.639571 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39bb12d5-6c8d-4d2b-875e-abf6cbcc7e74 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Acquiring lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 01:04:38.640035 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39bb12d5-6c8d-4d2b-875e-abf6cbcc7e74 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 01:04:38.640477 n-d-860864-2 devstack@n-api.service[120613]: DEBUG oslo_concurrency.lockutils [None req-39bb12d5-6c8d-4d2b-875e-abf6cbcc7e74 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Lock "c35e3cac-0e4f-44cc-a53a-8910e1eecc88" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120613) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 01:04:38.654140 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.wsgi [None req-39bb12d5-6c8d-4d2b-875e-abf6cbcc7e74 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] HTTP exception thrown: Instance e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f could not be found. Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-39bb12d5-6c8d-4d2b-875e-abf6cbcc7e74 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Request method failure captured: Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: request: GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f HTTP/1.1 Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: Accept: application/json Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: Accept-Encoding: identity Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: Connection: close Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: Content-Length: 0 Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: Content-Type: application/json Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: Host: 10.222.0.23 Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: Openstack-System-Scope: None Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: User-Agent: python-urllib3/1.26.12 Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: X-Auth-Token: gAAAAABjRL_e5yJB6uIK2yLuv_kfa0xZzdg6qUR8yeVlpOymvPtYODVN355clS_OIu-Zv4t2SW-PfegwBRNAByHPMt1lmUoVN6sFLZptg7Bcl2LvWCxgnZoJOodJwNjN08siI5-80DOadQbcK1JtuU_qA58UwhD7XoPTwoKEkM_1FS-xYy0HwQ0 Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Id: None Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: X-Domain-Name: None Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: X-Identity-Status: Confirmed Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: X-Is-Admin-Project: True Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Id: default Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Domain-Name: Default Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Id: 1e40a46f67db43b18e260b299f689874 Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: X-Project-Name: tempest-TestSnapshotPattern-827248921 Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: X-Role: member,reader Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: X-Roles: member,reader Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1e40a46f67db43b18e260b299f689874"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1e40a46f67db43b18e260b299f689874"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1e40a46f67db43b18e260b299f689874"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1e40a46f67db43b18e260b299f689874", "adminURL": "http://10.222.0.23:8080"}]}] Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant: tempest-TestSnapshotPattern-827248921 Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Id: 1e40a46f67db43b18e260b299f689874 Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: X-Tenant-Name: tempest-TestSnapshotPattern-827248921 Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: X-User: tempest-TestSnapshotPattern-827248921-project Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Id: default Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: X-User-Domain-Name: Default Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: X-User-Id: b687a63ff37940d0989110af8f7d448f Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: X-User-Name: tempest-TestSnapshotPattern-827248921-project Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: method: > Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: exception: Instance e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f could not be found. Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: action_args: {'id': 'e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f'} Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: {{(pid=120613) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f could not be found. Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f could not be found. Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 01:04:38.655818 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 01:04:38.660737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 01:04:38.660737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 01:04:38.660737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 01:04:38.660737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 01:04:38.660737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 01:04:38.660737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f could not be found. Oct 11 01:04:38.660737 n-d-860864-2 devstack@n-api.service[120613]: ERROR nova.api.openstack.wsgi Oct 11 01:04:38.660737 n-d-860864-2 devstack@n-api.service[120613]: DEBUG nova.api.openstack.wsgi [None req-39bb12d5-6c8d-4d2b-875e-abf6cbcc7e74 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Returning 404 to user: Instance e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f could not be found. {{(pid=120613) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 01:04:38.660737 n-d-860864-2 devstack@n-api.service[120613]: INFO nova.api.openstack.requestlog [None req-39bb12d5-6c8d-4d2b-875e-abf6cbcc7e74 tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f" status: 404 len: 111 microversion: 2.1 time: 0.031825 Oct 11 01:04:38.660737 n-d-860864-2 devstack@n-api.service[120613]: [pid: 120613|app: 0|req: 4358/8064] 10.222.0.23 () {58 vars in 1236 bytes} [Tue Oct 11 01:04:38 2022] GET /compute/v2.1/servers/e9cc2cc9-bac3-44b2-9d22-ca6a50a4034f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 01:04:38.823718 n-d-860864-2 devstack@n-api.service[120614]: DEBUG nova.api.openstack.wsgi [None req-16c3ea59-2671-4e72-8811-6e227ceee06d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] Calling method '.version_select at 0x7f662a89e5e0>' {{(pid=120614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 01:04:38.848152 n-d-860864-2 devstack@n-api.service[120614]: INFO nova.api.openstack.requestlog [None req-16c3ea59-2671-4e72-8811-6e227ceee06d tempest-TestSnapshotPattern-827248921 tempest-TestSnapshotPattern-827248921-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-273602832" status: 202 len: 0 microversion: 2.1 time: 0.029494 Oct 11 01:04:38.849216 n-d-860864-2 devstack@n-api.service[120614]: [pid: 120614|app: 0|req: 3707/8065] 10.222.0.23 () {58 vars in 1254 bytes} [Tue Oct 11 01:04:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-273602832 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)